2024-09-14T10:34:13.534 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-14T10:34:13.554 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-14T10:34:13.633 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904126 branch: main description: rgw/verify/{0-install accounts$/{main} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} email: ceph-qa@ceph.com first_in_suite: false job_id: '7904126' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: client: debug rgw: 20 debug rgw notification: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw max chunk size: 4194304 rgw obj stripe size: 6291456 rgw reshard progress judge interval: 10 rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 lockdep: true osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug objclass: 20 debug osd: 20 debug rocksdb: 4/10 lockdep: true mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 rgw: compression type: random ec-data-pool: false frontend: beast inline data: false storage classes: LUKEWARM, FROZEN s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 s3 main: RGW11111111111111111 force-branch: ceph-master storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 1c941a66c1b420259b8fc5ac19e792dbbf60aded owner: scheduled_teuthology@teuthology priority: 950 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 9419 sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 sleep_before_teardown: 0 subset: 0/1 suite: rgw suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 1c941a66c1b420259b8fc5ac19e792dbbf60aded targets: smithi097.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFCq7tK2fcMtQz4LadMdB5Xxun5ICmaNUIeWZDNviIeHNbFgiHjhwl3vc2qrjWYYXsM2TzHcaB/1+YuOBQsMLR0= smithi152.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCOo+mddRKiYVyCETY4tqiHNZ5ASjRH4qNaTXBUev8ca1fvwWCnG71a1pY2RfHogabVRdPiWZ0MTHQT2FxnNKJI= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - cls/test_cls_user.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_20:40:18 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-14T10:34:13.633 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa; will attempt to use it 2024-09-14T10:34:13.634 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa/tasks 2024-09-14T10:34:13.634 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-14T10:34:13.635 INFO:teuthology.task.internal:Checking packages... 2024-09-14T10:34:13.656 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8' 2024-09-14T10:34:13.656 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-14T10:34:13.657 INFO:teuthology.packaging:ref: None 2024-09-14T10:34:13.657 INFO:teuthology.packaging:tag: None 2024-09-14T10:34:13.657 INFO:teuthology.packaging:branch: main 2024-09-14T10:34:13.657 INFO:teuthology.packaging:sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T10:34:13.657 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2024-09-14T10:34:13.916 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4926.g1c941a66 2024-09-14T10:34:13.917 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-14T10:34:13.923 INFO:teuthology.task.internal:no buildpackages task found 2024-09-14T10:34:13.924 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-14T10:34:13.933 INFO:teuthology.task.internal:Saving configuration 2024-09-14T10:34:13.949 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-14T10:34:13.955 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-14T10:34:13.981 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi097.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904126', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-14 10:29:12.497788', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFCq7tK2fcMtQz4LadMdB5Xxun5ICmaNUIeWZDNviIeHNbFgiHjhwl3vc2qrjWYYXsM2TzHcaB/1+YuOBQsMLR0='} 2024-09-14T10:34:14.004 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904126', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-14 10:29:12.499558', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCOo+mddRKiYVyCETY4tqiHNZ5ASjRH4qNaTXBUev8ca1fvwWCnG71a1pY2RfHogabVRdPiWZ0MTHQT2FxnNKJI='} 2024-09-14T10:34:14.004 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-14T10:34:14.011 INFO:teuthology.task.internal:roles: ubuntu@smithi097.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-14T10:34:14.011 INFO:teuthology.task.internal:roles: ubuntu@smithi152.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-14T10:34:14.011 INFO:teuthology.run_tasks:Running task console_log... 2024-09-14T10:34:14.072 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd1ab9541f0>, signals=[15]) 2024-09-14T10:34:14.072 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-14T10:34:14.078 INFO:teuthology.task.internal:Opening connections... 2024-09-14T10:34:14.078 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi097.front.sepia.ceph.com 2024-09-14T10:34:14.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:34:14.160 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi152.front.sepia.ceph.com 2024-09-14T10:34:14.161 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:34:14.235 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-14T10:34:14.242 DEBUG:teuthology.orchestra.run.smithi097:> uname -m 2024-09-14T10:34:14.261 INFO:teuthology.orchestra.run.smithi097.stdout:x86_64 2024-09-14T10:34:14.261 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release 2024-09-14T10:34:14.319 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="CentOS Stream" 2024-09-14T10:34:14.320 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="9" 2024-09-14T10:34:14.320 INFO:teuthology.orchestra.run.smithi097.stdout:ID="centos" 2024-09-14T10:34:14.320 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE="rhel fedora" 2024-09-14T10:34:14.320 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="9" 2024-09-14T10:34:14.320 INFO:teuthology.orchestra.run.smithi097.stdout:PLATFORM_ID="platform:el9" 2024-09-14T10:34:14.320 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-14T10:34:14.320 INFO:teuthology.orchestra.run.smithi097.stdout:ANSI_COLOR="0;31" 2024-09-14T10:34:14.320 INFO:teuthology.orchestra.run.smithi097.stdout:LOGO="fedora-logo-icon" 2024-09-14T10:34:14.320 INFO:teuthology.orchestra.run.smithi097.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-14T10:34:14.320 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://centos.org/" 2024-09-14T10:34:14.320 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-14T10:34:14.320 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-14T10:34:14.321 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-14T10:34:14.322 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server 2024-09-14T10:34:14.340 DEBUG:teuthology.orchestra.run.smithi152:> uname -m 2024-09-14T10:34:14.358 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64 2024-09-14T10:34:14.359 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2024-09-14T10:34:14.416 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="CentOS Stream" 2024-09-14T10:34:14.416 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="9" 2024-09-14T10:34:14.416 INFO:teuthology.orchestra.run.smithi152.stdout:ID="centos" 2024-09-14T10:34:14.417 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="rhel fedora" 2024-09-14T10:34:14.417 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="9" 2024-09-14T10:34:14.417 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el9" 2024-09-14T10:34:14.417 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-14T10:34:14.418 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2024-09-14T10:34:14.418 INFO:teuthology.orchestra.run.smithi152.stdout:LOGO="fedora-logo-icon" 2024-09-14T10:34:14.418 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-14T10:34:14.418 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://centos.org/" 2024-09-14T10:34:14.418 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-14T10:34:14.418 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-14T10:34:14.418 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-14T10:34:14.418 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2024-09-14T10:34:14.439 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-14T10:34:14.448 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-14T10:34:14.506 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-14T10:34:14.506 DEBUG:teuthology.orchestra.run.smithi097:> test '!' -e /home/ubuntu/cephtest 2024-09-14T10:34:14.509 DEBUG:teuthology.orchestra.run.smithi152:> test '!' -e /home/ubuntu/cephtest 2024-09-14T10:34:14.526 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-14T10:34:14.533 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-14T10:34:14.533 DEBUG:teuthology.orchestra.run.smithi097:> test -z $(ls -A /var/lib/ceph) 2024-09-14T10:34:14.567 DEBUG:teuthology.orchestra.run.smithi152:> test -z $(ls -A /var/lib/ceph) 2024-09-14T10:34:14.644 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-14T10:34:14.701 INFO:teuthology.run_tasks:Running task kernel... 2024-09-14T10:34:14.716 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-14T10:34:14.716 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-14T10:34:14.716 DEBUG:teuthology.orchestra.run.smithi097:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-14T10:34:14.717 DEBUG:teuthology.orchestra.run.smithi152:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-14T10:34:14.734 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:34:14.734 DEBUG:teuthology.orchestra.run.smithi097:> uname -r 2024-09-14T10:34:14.735 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:34:14.736 DEBUG:teuthology.orchestra.run.smithi152:> uname -r 2024-09-14T10:34:14.792 INFO:teuthology.orchestra.run.smithi097.stdout:5.14.0-503.el9.x86_64 2024-09-14T10:34:14.792 INFO:teuthology.task.kernel:Running kernel on smithi097: 5.14.0-503.el9.x86_64 2024-09-14T10:34:14.792 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum install -y kernel 2024-09-14T10:34:14.794 INFO:teuthology.orchestra.run.smithi152.stdout:5.14.0-503.el9.x86_64 2024-09-14T10:34:14.794 INFO:teuthology.task.kernel:Running kernel on smithi152: 5.14.0-503.el9.x86_64 2024-09-14T10:34:14.794 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum install -y kernel 2024-09-14T10:34:17.016 INFO:teuthology.orchestra.run.smithi097.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 8.2 MB 00:00 2024-09-14T10:34:19.109 INFO:teuthology.orchestra.run.smithi097.stdout:CentOS Stream 9 - AppStream 21 MB/s | 20 MB 00:00 2024-09-14T10:34:19.253 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - BaseOS 3.1 MB/s | 8.2 MB 00:02 2024-09-14T10:34:21.158 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - AppStream 28 MB/s | 20 MB 00:00 2024-09-14T10:34:23.434 INFO:teuthology.orchestra.run.smithi097.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-14T10:34:24.943 INFO:teuthology.orchestra.run.smithi097.stdout:CentOS Stream 9 - Extras packages 59 kB/s | 19 kB 00:00 2024-09-14T10:34:25.831 INFO:teuthology.orchestra.run.smithi097.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-14T10:34:25.875 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - CRB 7.7 MB/s | 6.5 MB 00:00 2024-09-14T10:34:27.543 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 19 kB 00:00 2024-09-14T10:34:28.314 INFO:teuthology.orchestra.run.smithi152.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-14T10:34:31.295 INFO:teuthology.orchestra.run.smithi097.stdout:lab-extras 50 kB/s | 1.7 kB 00:00 2024-09-14T10:34:33.310 INFO:teuthology.orchestra.run.smithi097.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-14T10:34:33.310 INFO:teuthology.orchestra.run.smithi097.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-14T10:34:33.393 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2024-09-14T10:34:33.402 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-14T10:34:33.402 INFO:teuthology.orchestra.run.smithi097.stdout: Package Architecture Version Repository Size 2024-09-14T10:34:33.402 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-14T10:34:33.402 INFO:teuthology.orchestra.run.smithi097.stdout:Installing: 2024-09-14T10:34:33.402 INFO:teuthology.orchestra.run.smithi097.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-14T10:34:33.402 INFO:teuthology.orchestra.run.smithi097.stdout:Installing dependencies: 2024-09-14T10:34:33.402 INFO:teuthology.orchestra.run.smithi097.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-14T10:34:33.402 INFO:teuthology.orchestra.run.smithi097.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-14T10:34:33.403 INFO:teuthology.orchestra.run.smithi097.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-14T10:34:33.403 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:34:33.403 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction Summary 2024-09-14T10:34:33.403 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-14T10:34:33.403 INFO:teuthology.orchestra.run.smithi097.stdout:Install 4 Packages 2024-09-14T10:34:33.403 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:34:33.403 INFO:teuthology.orchestra.run.smithi097.stdout:Total download size: 79 M 2024-09-14T10:34:33.404 INFO:teuthology.orchestra.run.smithi097.stdout:Installed size: 126 M 2024-09-14T10:34:33.404 INFO:teuthology.orchestra.run.smithi097.stdout:Downloading Packages: 2024-09-14T10:34:33.597 INFO:teuthology.orchestra.run.smithi097.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 240 kB/s | 23 kB 00:00 2024-09-14T10:34:33.736 INFO:teuthology.orchestra.run.smithi152.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-14T10:34:33.914 INFO:teuthology.orchestra.run.smithi097.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 38 MB/s | 16 MB 00:00 2024-09-14T10:34:34.314 INFO:teuthology.orchestra.run.smithi097.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 40 MB/s | 29 MB 00:00 2024-09-14T10:34:34.698 INFO:teuthology.orchestra.run.smithi097.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 29 MB/s | 35 MB 00:01 2024-09-14T10:34:34.698 INFO:teuthology.orchestra.run.smithi097.stdout:-------------------------------------------------------------------------------- 2024-09-14T10:34:34.698 INFO:teuthology.orchestra.run.smithi097.stdout:Total 61 MB/s | 79 MB 00:01 2024-09-14T10:34:35.381 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction check 2024-09-14T10:34:35.739 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction check succeeded. 2024-09-14T10:34:35.739 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction test 2024-09-14T10:34:35.751 INFO:teuthology.orchestra.run.smithi152.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-14T10:34:35.751 INFO:teuthology.orchestra.run.smithi152.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-14T10:34:35.849 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-14T10:34:35.855 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-14T10:34:35.856 INFO:teuthology.orchestra.run.smithi152.stdout: Package Architecture Version Repository Size 2024-09-14T10:34:35.856 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-14T10:34:35.856 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-14T10:34:35.856 INFO:teuthology.orchestra.run.smithi152.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-14T10:34:35.856 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2024-09-14T10:34:35.856 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-14T10:34:35.856 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-14T10:34:35.856 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-14T10:34:35.856 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:34:35.856 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-14T10:34:35.856 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-14T10:34:35.856 INFO:teuthology.orchestra.run.smithi152.stdout:Install 4 Packages 2024-09-14T10:34:35.857 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:34:35.857 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 79 M 2024-09-14T10:34:35.857 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 126 M 2024-09-14T10:34:35.857 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-14T10:34:36.638 INFO:teuthology.orchestra.run.smithi152.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 43 kB/s | 23 kB 00:00 2024-09-14T10:34:36.672 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction test succeeded. 2024-09-14T10:34:36.672 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction 2024-09-14T10:34:37.513 INFO:teuthology.orchestra.run.smithi152.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-14T10:34:38.171 INFO:teuthology.orchestra.run.smithi152.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 17 MB/s | 35 MB 00:02 2024-09-14T10:34:38.872 INFO:teuthology.orchestra.run.smithi152.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 13 MB/s | 29 MB 00:02 2024-09-14T10:34:38.872 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-14T10:34:38.872 INFO:teuthology.orchestra.run.smithi152.stdout:Total 26 MB/s | 79 MB 00:03 2024-09-14T10:34:39.092 INFO:teuthology.orchestra.run.smithi097.stdout: Preparing : 1/1 2024-09-14T10:34:39.557 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-14T10:34:39.722 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-14T10:34:39.800 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T10:34:39.917 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-14T10:34:39.917 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-14T10:34:40.887 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-14T10:34:40.887 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-14T10:34:42.586 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T10:34:42.710 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T10:34:43.361 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-14T10:34:44.033 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-14T10:34:44.123 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T10:34:46.969 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T10:34:47.111 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T10:34:47.526 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T10:34:47.568 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:34:51.950 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T10:34:52.053 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:34:52.395 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:34:56.935 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:35:31.017 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:35:31.066 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:35:31.458 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:35:31.458 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-14T10:35:31.458 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T10:35:31.458 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T10:35:32.256 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:35:32.256 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:35:32.256 INFO:teuthology.orchestra.run.smithi097.stdout:Installed: 2024-09-14T10:35:32.256 INFO:teuthology.orchestra.run.smithi097.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-14T10:35:32.256 INFO:teuthology.orchestra.run.smithi097.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-14T10:35:32.257 INFO:teuthology.orchestra.run.smithi097.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-14T10:35:32.257 INFO:teuthology.orchestra.run.smithi097.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-14T10:35:32.257 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:35:32.257 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2024-09-14T10:35:32.568 DEBUG:teuthology.orchestra.run.smithi097:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T10:35:32.650 INFO:teuthology.orchestra.run.smithi097.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T10:35:32.651 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T10:35:32.651 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-14T10:35:32.651 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-14T10:35:32.651 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-14T10:35:32.651 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-14T10:35:32.651 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi097.front.sepia.ceph.com, path=None, version=distro) 2024-09-14T10:35:32.651 DEBUG:teuthology.orchestra.run.smithi097:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T10:35:32.709 INFO:teuthology.orchestra.run.smithi097.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T10:35:32.710 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T10:35:32.710 DEBUG:teuthology.orchestra.run.smithi097:> sudo rpm -qi grub2-tools 2024-09-14T10:35:32.741 INFO:teuthology.orchestra.run.smithi097.stdout:Name : grub2-tools 2024-09-14T10:35:32.741 INFO:teuthology.orchestra.run.smithi097.stdout:Epoch : 1 2024-09-14T10:35:32.742 INFO:teuthology.orchestra.run.smithi097.stdout:Version : 2.06 2024-09-14T10:35:32.742 INFO:teuthology.orchestra.run.smithi097.stdout:Release : 82.el9 2024-09-14T10:35:32.742 INFO:teuthology.orchestra.run.smithi097.stdout:Architecture: x86_64 2024-09-14T10:35:32.742 INFO:teuthology.orchestra.run.smithi097.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-14T10:35:32.742 INFO:teuthology.orchestra.run.smithi097.stdout:Group : Unspecified 2024-09-14T10:35:32.742 INFO:teuthology.orchestra.run.smithi097.stdout:Size : 8274670 2024-09-14T10:35:32.742 INFO:teuthology.orchestra.run.smithi097.stdout:License : GPLv3+ 2024-09-14T10:35:32.742 INFO:teuthology.orchestra.run.smithi097.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-14T10:35:32.742 INFO:teuthology.orchestra.run.smithi097.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-14T10:35:32.742 INFO:teuthology.orchestra.run.smithi097.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-14T10:35:32.742 INFO:teuthology.orchestra.run.smithi097.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-14T10:35:32.742 INFO:teuthology.orchestra.run.smithi097.stdout:Packager : builder@centos.org 2024-09-14T10:35:32.742 INFO:teuthology.orchestra.run.smithi097.stdout:Vendor : CentOS 2024-09-14T10:35:32.743 INFO:teuthology.orchestra.run.smithi097.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-14T10:35:32.743 INFO:teuthology.orchestra.run.smithi097.stdout:Summary : Support tools for GRUB. 2024-09-14T10:35:32.743 INFO:teuthology.orchestra.run.smithi097.stdout:Description : 2024-09-14T10:35:32.743 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:35:32.743 INFO:teuthology.orchestra.run.smithi097.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-14T10:35:32.743 INFO:teuthology.orchestra.run.smithi097.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-14T10:35:32.743 INFO:teuthology.orchestra.run.smithi097.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-14T10:35:32.743 INFO:teuthology.orchestra.run.smithi097.stdout:hardware devices. 2024-09-14T10:35:32.743 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:35:32.743 INFO:teuthology.orchestra.run.smithi097.stdout:This subpackage provides tools for support of all platforms. 2024-09-14T10:35:32.744 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-14T10:35:32.744 INFO:teuthology.task.kernel:Updating grub on smithi097 to boot 5.14.0-505.el9.x86_64 2024-09-14T10:35:32.745 DEBUG:teuthology.orchestra.run.smithi097:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-14T10:35:33.381 INFO:teuthology.orchestra.run.smithi097.stderr:Generating grub configuration file ... 2024-09-14T10:35:34.677 INFO:teuthology.orchestra.run.smithi097.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-14T10:35:34.714 INFO:teuthology.orchestra.run.smithi097.stderr:done 2024-09-14T10:35:34.716 DEBUG:teuthology.orchestra.run.smithi097:> mktemp 2024-09-14T10:35:34.733 INFO:teuthology.orchestra.run.smithi097.stdout:/tmp/tmp.fTXNGCBTzJ 2024-09-14T10:35:34.733 DEBUG:teuthology.orchestra.run.smithi097:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.fTXNGCBTzJ 2024-09-14T10:35:34.802 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0666 /tmp/tmp.fTXNGCBTzJ 2024-09-14T10:35:34.942 DEBUG:teuthology.orchestra.remote:smithi097:/tmp/tmp.fTXNGCBTzJ is 6KB 2024-09-14T10:35:34.990 DEBUG:teuthology.orchestra.run.smithi097:> rm -fr /tmp/tmp.fTXNGCBTzJ 2024-09-14T10:35:35.006 DEBUG:teuthology.orchestra.run.smithi097:> sudo /bin/ls /boot/loader/entries || true 2024-09-14T10:35:35.077 INFO:teuthology.orchestra.run.smithi097.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-14T10:35:35.078 INFO:teuthology.orchestra.run.smithi097.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-14T10:35:35.078 INFO:teuthology.orchestra.run.smithi097.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-14T10:35:35.078 INFO:teuthology.orchestra.run.smithi097.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-14T10:35:35.079 DEBUG:teuthology.orchestra.run.smithi097:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-14T10:35:35.236 DEBUG:teuthology.orchestra.run.smithi097:> sudo shutdown -r now 2024-09-14T10:35:35.412 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:35:35.453 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:35:35.800 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:35:35.800 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-14T10:35:35.800 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T10:35:35.800 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T10:35:36.673 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:35:36.673 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:35:36.674 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-14T10:35:36.674 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-14T10:35:36.674 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-14T10:35:36.674 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-14T10:35:36.674 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-14T10:35:36.674 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:35:36.674 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-14T10:35:37.048 DEBUG:teuthology.orchestra.run.smithi152:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T10:35:37.153 INFO:teuthology.orchestra.run.smithi152.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T10:35:37.153 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T10:35:37.153 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-14T10:35:37.153 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-14T10:35:37.153 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-14T10:35:37.153 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-14T10:35:37.154 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi152.front.sepia.ceph.com, path=None, version=distro) 2024-09-14T10:35:37.154 DEBUG:teuthology.orchestra.run.smithi152:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T10:35:37.212 INFO:teuthology.orchestra.run.smithi152.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T10:35:37.213 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T10:35:37.213 DEBUG:teuthology.orchestra.run.smithi152:> sudo rpm -qi grub2-tools 2024-09-14T10:35:37.245 INFO:teuthology.orchestra.run.smithi152.stdout:Name : grub2-tools 2024-09-14T10:35:37.245 INFO:teuthology.orchestra.run.smithi152.stdout:Epoch : 1 2024-09-14T10:35:37.245 INFO:teuthology.orchestra.run.smithi152.stdout:Version : 2.06 2024-09-14T10:35:37.245 INFO:teuthology.orchestra.run.smithi152.stdout:Release : 82.el9 2024-09-14T10:35:37.246 INFO:teuthology.orchestra.run.smithi152.stdout:Architecture: x86_64 2024-09-14T10:35:37.246 INFO:teuthology.orchestra.run.smithi152.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-14T10:35:37.246 INFO:teuthology.orchestra.run.smithi152.stdout:Group : Unspecified 2024-09-14T10:35:37.246 INFO:teuthology.orchestra.run.smithi152.stdout:Size : 8274670 2024-09-14T10:35:37.246 INFO:teuthology.orchestra.run.smithi152.stdout:License : GPLv3+ 2024-09-14T10:35:37.246 INFO:teuthology.orchestra.run.smithi152.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-14T10:35:37.246 INFO:teuthology.orchestra.run.smithi152.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-14T10:35:37.246 INFO:teuthology.orchestra.run.smithi152.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-14T10:35:37.246 INFO:teuthology.orchestra.run.smithi152.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-14T10:35:37.246 INFO:teuthology.orchestra.run.smithi152.stdout:Packager : builder@centos.org 2024-09-14T10:35:37.246 INFO:teuthology.orchestra.run.smithi152.stdout:Vendor : CentOS 2024-09-14T10:35:37.246 INFO:teuthology.orchestra.run.smithi152.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-14T10:35:37.246 INFO:teuthology.orchestra.run.smithi152.stdout:Summary : Support tools for GRUB. 2024-09-14T10:35:37.247 INFO:teuthology.orchestra.run.smithi152.stdout:Description : 2024-09-14T10:35:37.247 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:35:37.247 INFO:teuthology.orchestra.run.smithi152.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-14T10:35:37.247 INFO:teuthology.orchestra.run.smithi152.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-14T10:35:37.247 INFO:teuthology.orchestra.run.smithi152.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-14T10:35:37.247 INFO:teuthology.orchestra.run.smithi152.stdout:hardware devices. 2024-09-14T10:35:37.247 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:35:37.247 INFO:teuthology.orchestra.run.smithi152.stdout:This subpackage provides tools for support of all platforms. 2024-09-14T10:35:37.248 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-14T10:35:37.248 INFO:teuthology.task.kernel:Updating grub on smithi152 to boot 5.14.0-505.el9.x86_64 2024-09-14T10:35:37.248 DEBUG:teuthology.orchestra.run.smithi152:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-14T10:35:37.928 INFO:teuthology.orchestra.run.smithi152.stderr:Generating grub configuration file ... 2024-09-14T10:35:39.303 INFO:teuthology.orchestra.run.smithi152.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-14T10:35:39.326 INFO:teuthology.orchestra.run.smithi152.stderr:done 2024-09-14T10:35:39.329 DEBUG:teuthology.orchestra.run.smithi152:> mktemp 2024-09-14T10:35:39.344 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/tmp.CONvbMeeNO 2024-09-14T10:35:39.344 DEBUG:teuthology.orchestra.run.smithi152:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.CONvbMeeNO 2024-09-14T10:35:39.411 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0666 /tmp/tmp.CONvbMeeNO 2024-09-14T10:35:39.550 DEBUG:teuthology.orchestra.remote:smithi152:/tmp/tmp.CONvbMeeNO is 6KB 2024-09-14T10:35:39.598 DEBUG:teuthology.orchestra.run.smithi152:> rm -fr /tmp/tmp.CONvbMeeNO 2024-09-14T10:35:39.613 DEBUG:teuthology.orchestra.run.smithi152:> sudo /bin/ls /boot/loader/entries || true 2024-09-14T10:35:39.676 INFO:teuthology.orchestra.run.smithi152.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-14T10:35:39.677 INFO:teuthology.orchestra.run.smithi152.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-14T10:35:39.677 INFO:teuthology.orchestra.run.smithi152.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-14T10:35:39.677 INFO:teuthology.orchestra.run.smithi152.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-14T10:35:39.678 DEBUG:teuthology.orchestra.run.smithi152:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-14T10:35:39.831 DEBUG:teuthology.orchestra.run.smithi152:> sudo shutdown -r now 2024-09-14T10:36:05.261 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-14T10:36:05.261 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-09-14T10:36:05.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:36:09.839 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-14T10:36:09.839 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-09-14T10:36:09.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:36:39.873 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.97 2024-09-14T10:36:44.477 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.152 2024-09-14T10:36:48.877 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-09-14T10:36:48.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:36:53.481 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-09-14T10:36:53.481 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:37:07.265 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.97 2024-09-14T10:37:11.869 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.152 2024-09-14T10:37:19.271 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-09-14T10:37:19.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:37:19.651 DEBUG:teuthology.orchestra.run.smithi097:> true 2024-09-14T10:37:20.034 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-09-14T10:37:20.034 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-14T10:37:20.034 DEBUG:teuthology.orchestra.run.smithi097:> uname -r 2024-09-14T10:37:20.049 INFO:teuthology.orchestra.run.smithi097.stdout:5.14.0-505.el9.x86_64 2024-09-14T10:37:20.049 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-14T10:37:20.049 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-14T10:37:20.049 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-14T10:37:21.050 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-14T10:37:21.050 DEBUG:teuthology.orchestra.run.smithi097:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-14T10:37:21.133 INFO:teuthology.orchestra.run.smithi097.stdout:ttyS1 2024-09-14T10:37:21.161 DEBUG:teuthology.parallel:result is None 2024-09-14T10:37:23.869 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-09-14T10:37:23.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:37:24.266 DEBUG:teuthology.orchestra.run.smithi152:> true 2024-09-14T10:37:24.638 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-09-14T10:37:24.638 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-505.el9.x86_64"... 2024-09-14T10:37:24.638 DEBUG:teuthology.orchestra.run.smithi152:> uname -r 2024-09-14T10:37:24.653 INFO:teuthology.orchestra.run.smithi152.stdout:5.14.0-505.el9.x86_64 2024-09-14T10:37:24.653 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-14T10:37:24.653 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-14T10:37:24.653 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-14T10:37:25.654 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-14T10:37:25.654 DEBUG:teuthology.orchestra.run.smithi152:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-14T10:37:25.752 INFO:teuthology.orchestra.run.smithi152.stdout:ttyS1 2024-09-14T10:37:25.789 DEBUG:teuthology.parallel:result is None 2024-09-14T10:37:25.789 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-14T10:37:25.797 INFO:teuthology.task.internal:Creating test directory... 2024-09-14T10:37:25.797 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-14T10:37:25.799 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-14T10:37:25.814 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-14T10:37:25.821 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-14T10:37:25.832 INFO:teuthology.task.internal:Creating archive directory... 2024-09-14T10:37:25.832 DEBUG:teuthology.orchestra.run.smithi097:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-14T10:37:25.856 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-14T10:37:25.882 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-14T10:37:25.888 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-14T10:37:25.888 DEBUG:teuthology.orchestra.run.smithi097:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-14T10:37:25.919 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-14T10:37:25.943 INFO:teuthology.orchestra.run.smithi097.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T10:37:25.947 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T10:37:25.954 INFO:teuthology.orchestra.run.smithi097.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T10:37:25.957 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T10:37:25.959 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-14T10:37:25.966 INFO:teuthology.task.internal:Configuring sudo... 2024-09-14T10:37:25.966 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-14T10:37:25.998 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-14T10:37:26.026 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-14T10:37:26.035 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-14T10:37:26.035 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-14T10:37:26.064 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-14T10:37:26.080 DEBUG:teuthology.orchestra.run.smithi097:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T10:37:26.159 DEBUG:teuthology.orchestra.run.smithi097:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T10:37:26.218 DEBUG:teuthology.orchestra.run.smithi097:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T10:37:26.301 DEBUG:teuthology.orchestra.run.smithi097:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T10:37:26.339 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-14T10:37:26.339 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-14T10:37:26.403 DEBUG:teuthology.orchestra.run.smithi152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T10:37:26.445 DEBUG:teuthology.orchestra.run.smithi152:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T10:37:26.495 DEBUG:teuthology.orchestra.run.smithi152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T10:37:26.572 DEBUG:teuthology.orchestra.run.smithi152:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T10:37:26.616 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-14T10:37:26.616 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-14T10:37:26.680 DEBUG:teuthology.orchestra.run.smithi097:> sudo service rsyslog restart 2024-09-14T10:37:26.683 DEBUG:teuthology.orchestra.run.smithi152:> sudo service rsyslog restart 2024-09-14T10:37:26.719 INFO:teuthology.orchestra.run.smithi097.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T10:37:26.784 INFO:teuthology.orchestra.run.smithi152.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T10:37:27.165 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-14T10:37:27.174 INFO:teuthology.task.internal:Starting timer... 2024-09-14T10:37:27.174 INFO:teuthology.run_tasks:Running task pcp... 2024-09-14T10:37:27.199 INFO:teuthology.run_tasks:Running task selinux... 2024-09-14T10:37:27.210 DEBUG:teuthology.orchestra.run.smithi097:> sudo service auditd rotate 2024-09-14T10:37:27.272 INFO:teuthology.orchestra.run.smithi097.stdout:Rotating logs: 2024-09-14T10:37:27.274 DEBUG:teuthology.orchestra.run.smithi152:> sudo service auditd rotate 2024-09-14T10:37:27.354 INFO:teuthology.orchestra.run.smithi152.stdout:Rotating logs: 2024-09-14T10:37:27.356 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-14T10:37:27.356 DEBUG:teuthology.orchestra.run.smithi097:> /usr/sbin/getenforce 2024-09-14T10:37:27.390 INFO:teuthology.orchestra.run.smithi097.stdout:Permissive 2024-09-14T10:37:27.390 DEBUG:teuthology.orchestra.run.smithi152:> /usr/sbin/getenforce 2024-09-14T10:37:27.410 INFO:teuthology.orchestra.run.smithi152.stdout:Permissive 2024-09-14T10:37:27.410 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi097.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi152.front.sepia.ceph.com': 'permissive'} 2024-09-14T10:37:27.410 DEBUG:teuthology.orchestra.run.smithi097:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T10:37:27.455 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:37:27.455 DEBUG:teuthology.orchestra.run.smithi152:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T10:37:27.493 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:37:27.494 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-14T10:37:27.494 DEBUG:teuthology.orchestra.run.smithi097:> sudo /usr/sbin/setenforce permissive 2024-09-14T10:37:27.532 DEBUG:teuthology.orchestra.run.smithi152:> sudo /usr/sbin/setenforce permissive 2024-09-14T10:37:27.563 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-14T10:37:27.573 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-14T10:37:27.575 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-14T10:37:27.685 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-14T10:37:27.698 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-14T10:37:27.699 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi097.front.sepia.ceph.com,smithi152.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-14T10:41:11.157 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi097.front.sepia.ceph.com'), Remote(name='ubuntu@smithi152.front.sepia.ceph.com')] 2024-09-14T10:41:11.158 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-09-14T10:41:11.159 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:41:11.240 DEBUG:teuthology.orchestra.run.smithi097:> true 2024-09-14T10:41:11.324 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-09-14T10:41:11.324 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-09-14T10:41:11.325 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:41:11.401 DEBUG:teuthology.orchestra.run.smithi152:> true 2024-09-14T10:41:11.481 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-09-14T10:41:11.481 INFO:teuthology.run_tasks:Running task clock... 2024-09-14T10:41:11.491 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-14T10:41:11.491 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-14T10:41:11.492 DEBUG:teuthology.orchestra.run.smithi097:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T10:41:11.494 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-14T10:41:11.494 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T10:41:11.522 INFO:teuthology.orchestra.run.smithi097.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-14T10:41:11.537 INFO:teuthology.orchestra.run.smithi097.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-14T10:41:11.551 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-14T10:41:11.561 INFO:teuthology.orchestra.run.smithi097.stderr:sudo: ntpd: command not found 2024-09-14T10:41:11.566 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-14T10:41:11.572 INFO:teuthology.orchestra.run.smithi097.stdout:506 Cannot talk to daemon 2024-09-14T10:41:11.587 INFO:teuthology.orchestra.run.smithi097.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-14T10:41:11.592 INFO:teuthology.orchestra.run.smithi152.stderr:sudo: ntpd: command not found 2024-09-14T10:41:11.601 INFO:teuthology.orchestra.run.smithi097.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-14T10:41:11.605 INFO:teuthology.orchestra.run.smithi152.stdout:506 Cannot talk to daemon 2024-09-14T10:41:11.619 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-14T10:41:11.633 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-14T10:41:11.668 INFO:teuthology.orchestra.run.smithi097.stderr:bash: line 1: ntpq: command not found 2024-09-14T10:41:11.670 INFO:teuthology.orchestra.run.smithi097.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T10:41:11.670 INFO:teuthology.orchestra.run.smithi097.stdout:=============================================================================== 2024-09-14T10:41:11.670 INFO:teuthology.orchestra.run.smithi097.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T10:41:11.670 INFO:teuthology.orchestra.run.smithi097.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T10:41:11.670 INFO:teuthology.orchestra.run.smithi097.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T10:41:11.670 INFO:teuthology.orchestra.run.smithi097.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T10:41:11.698 INFO:teuthology.orchestra.run.smithi152.stderr:bash: line 1: ntpq: command not found 2024-09-14T10:41:11.701 INFO:teuthology.orchestra.run.smithi152.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T10:41:11.701 INFO:teuthology.orchestra.run.smithi152.stdout:=============================================================================== 2024-09-14T10:41:11.702 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T10:41:11.702 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T10:41:11.702 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T10:41:11.702 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T10:41:11.703 INFO:teuthology.run_tasks:Running task install... 2024-09-14T10:41:11.710 DEBUG:teuthology.task.install:project ceph 2024-09-14T10:41:11.711 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}} 2024-09-14T10:41:11.711 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'} 2024-09-14T10:41:11.711 INFO:teuthology.task.install:Using flavor: default 2024-09-14T10:41:11.716 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-14T10:41:11.716 INFO:teuthology.task.install:extra packages: [] 2024-09-14T10:41:11.716 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8', 'tag': None, 'wait_for_package': False} 2024-09-14T10:41:11.717 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T10:41:11.719 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8', 'tag': None, 'wait_for_package': False} 2024-09-14T10:41:11.719 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T10:41:11.863 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/ 2024-09-14T10:41:11.864 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4907.ga2782315 2024-09-14T10:41:11.868 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/ 2024-09-14T10:41:11.868 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4907.ga2782315 2024-09-14T10:41:11.972 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-14T10:41:11.973 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-14T10:41:11.973 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-14T10:41:11.979 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-14T10:41:11.979 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-14T10:41:11.979 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-14T10:41:11.998 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-14T10:41:11.998 DEBUG:teuthology.orchestra.run.smithi097:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-14T10:41:12.005 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-14T10:41:12.005 DEBUG:teuthology.orchestra.run.smithi152:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-14T10:41:12.064 DEBUG:teuthology.orchestra.run.smithi097:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-14T10:41:12.071 DEBUG:teuthology.orchestra.run.smithi152:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-14T10:41:12.139 DEBUG:teuthology.orchestra.run.smithi097:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-14T10:41:12.146 DEBUG:teuthology.orchestra.run.smithi152:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-14T10:41:12.203 INFO:teuthology.orchestra.run.smithi097.stdout:check_obsoletes = 1 2024-09-14T10:41:12.205 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum clean all 2024-09-14T10:41:12.211 INFO:teuthology.orchestra.run.smithi152.stdout:check_obsoletes = 1 2024-09-14T10:41:12.212 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum clean all 2024-09-14T10:41:12.446 INFO:teuthology.orchestra.run.smithi152.stdout:45 files removed 2024-09-14T10:41:12.448 INFO:teuthology.orchestra.run.smithi097.stdout:45 files removed 2024-09-14T10:41:12.474 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-14T10:41:12.475 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-14T10:41:13.019 INFO:teuthology.orchestra.run.smithi097.stdout:ceph packages for x86_64 322 kB/s | 84 kB 00:00 2024-09-14T10:41:13.029 INFO:teuthology.orchestra.run.smithi152.stdout:ceph packages for x86_64 312 kB/s | 84 kB 00:00 2024-09-14T10:41:13.311 INFO:teuthology.orchestra.run.smithi097.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-14T10:41:13.321 INFO:teuthology.orchestra.run.smithi152.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-14T10:41:13.587 INFO:teuthology.orchestra.run.smithi097.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-14T10:41:13.597 INFO:teuthology.orchestra.run.smithi152.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-14T10:41:14.162 INFO:teuthology.orchestra.run.smithi097.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.2 MB 00:00 2024-09-14T10:41:17.047 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - BaseOS 2.4 MB/s | 8.2 MB 00:03 2024-09-14T10:41:17.305 INFO:teuthology.orchestra.run.smithi097.stdout:CentOS Stream 9 - AppStream 9.9 MB/s | 20 MB 00:02 2024-09-14T10:41:22.865 INFO:teuthology.orchestra.run.smithi097.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.5 MB 00:01 2024-09-14T10:41:24.265 INFO:teuthology.orchestra.run.smithi097.stdout:CentOS Stream 9 - Extras packages 109 kB/s | 19 kB 00:00 2024-09-14T10:41:25.261 INFO:teuthology.orchestra.run.smithi097.stdout:Extra Packages for Enterprise Linux 26 MB/s | 23 MB 00:00 2024-09-14T10:41:30.609 INFO:teuthology.orchestra.run.smithi097.stdout:lab-extras 22 kB/s | 1.7 kB 00:00 2024-09-14T10:41:32.970 INFO:teuthology.orchestra.run.smithi097.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-14T10:41:32.970 INFO:teuthology.orchestra.run.smithi097.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-14T10:41:33.059 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2024-09-14T10:41:33.085 INFO:teuthology.orchestra.run.smithi097.stdout:====================================================================================================== 2024-09-14T10:41:33.086 INFO:teuthology.orchestra.run.smithi097.stdout: Package Arch Version Repository Size 2024-09-14T10:41:33.086 INFO:teuthology.orchestra.run.smithi097.stdout:====================================================================================================== 2024-09-14T10:41:33.086 INFO:teuthology.orchestra.run.smithi097.stdout:Installing: 2024-09-14T10:41:33.086 INFO:teuthology.orchestra.run.smithi097.stdout: ceph x86_64 2:19.3.0-4907.ga2782315.el9 ceph 6.6 k 2024-09-14T10:41:33.086 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-base x86_64 2:19.3.0-4907.ga2782315.el9 ceph 5.5 M 2024-09-14T10:41:33.086 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-fuse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 900 k 2024-09-14T10:41:33.086 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4907.ga2782315.el9 ceph 145 k 2024-09-14T10:41:33.086 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr x86_64 2:19.3.0-4907.ga2782315.el9 ceph 1.5 M 2024-09-14T10:41:33.086 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 154 k 2024-09-14T10:41:33.086 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 14 M 2024-09-14T10:41:33.086 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 7.4 M 2024-09-14T10:41:33.087 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-rook noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 49 k 2024-09-14T10:41:33.087 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-radosgw x86_64 2:19.3.0-4907.ga2782315.el9 ceph 11 M 2024-09-14T10:41:33.087 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-test x86_64 2:19.3.0-4907.ga2782315.el9 ceph 50 M 2024-09-14T10:41:33.087 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-volume noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 285 k 2024-09-14T10:41:33.087 INFO:teuthology.orchestra.run.smithi097.stdout: cephadm noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 784 k 2024-09-14T10:41:33.087 INFO:teuthology.orchestra.run.smithi097.stdout: libcephfs-devel x86_64 2:19.3.0-4907.ga2782315.el9 ceph 32 k 2024-09-14T10:41:33.087 INFO:teuthology.orchestra.run.smithi097.stdout: libcephfs2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 756 k 2024-09-14T10:41:33.087 INFO:teuthology.orchestra.run.smithi097.stdout: librados-devel x86_64 2:19.3.0-4907.ga2782315.el9 ceph 127 k 2024-09-14T10:41:33.087 INFO:teuthology.orchestra.run.smithi097.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-14T10:41:33.087 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cephfs x86_64 2:19.3.0-4907.ga2782315.el9 ceph 161 k 2024-09-14T10:41:33.087 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rados x86_64 2:19.3.0-4907.ga2782315.el9 ceph 320 k 2024-09-14T10:41:33.087 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rbd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 305 k 2024-09-14T10:41:33.088 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rgw x86_64 2:19.3.0-4907.ga2782315.el9 ceph 99 k 2024-09-14T10:41:33.088 INFO:teuthology.orchestra.run.smithi097.stdout: rbd-fuse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 85 k 2024-09-14T10:41:33.088 INFO:teuthology.orchestra.run.smithi097.stdout: rbd-mirror x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.2 M 2024-09-14T10:41:33.088 INFO:teuthology.orchestra.run.smithi097.stdout: rbd-nbd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 171 k 2024-09-14T10:41:33.088 INFO:teuthology.orchestra.run.smithi097.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-14T10:41:33.088 INFO:teuthology.orchestra.run.smithi097.stdout:Upgrading: 2024-09-14T10:41:33.088 INFO:teuthology.orchestra.run.smithi097.stdout: librados2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.5 M 2024-09-14T10:41:33.088 INFO:teuthology.orchestra.run.smithi097.stdout: librbd1 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.2 M 2024-09-14T10:41:33.088 INFO:teuthology.orchestra.run.smithi097.stdout:Installing dependencies: 2024-09-14T10:41:33.088 INFO:teuthology.orchestra.run.smithi097.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-14T10:41:33.088 INFO:teuthology.orchestra.run.smithi097.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-14T10:41:33.088 INFO:teuthology.orchestra.run.smithi097.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-14T10:41:33.089 INFO:teuthology.orchestra.run.smithi097.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-14T10:41:33.089 INFO:teuthology.orchestra.run.smithi097.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-14T10:41:33.089 INFO:teuthology.orchestra.run.smithi097.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-14T10:41:33.089 INFO:teuthology.orchestra.run.smithi097.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-14T10:41:33.089 INFO:teuthology.orchestra.run.smithi097.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-14T10:41:33.089 INFO:teuthology.orchestra.run.smithi097.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-14T10:41:33.089 INFO:teuthology.orchestra.run.smithi097.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-14T10:41:33.089 INFO:teuthology.orchestra.run.smithi097.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-14T10:41:33.089 INFO:teuthology.orchestra.run.smithi097.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-14T10:41:33.089 INFO:teuthology.orchestra.run.smithi097.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-14T10:41:33.090 INFO:teuthology.orchestra.run.smithi097.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-14T10:41:33.090 INFO:teuthology.orchestra.run.smithi097.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-14T10:41:33.090 INFO:teuthology.orchestra.run.smithi097.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-14T10:41:33.090 INFO:teuthology.orchestra.run.smithi097.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-14T10:41:33.090 INFO:teuthology.orchestra.run.smithi097.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-14T10:41:33.090 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-common x86_64 2:19.3.0-4907.ga2782315.el9 ceph 22 M 2024-09-14T10:41:33.091 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 34 k 2024-09-14T10:41:33.091 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mds x86_64 2:19.3.0-4907.ga2782315.el9 ceph 2.4 M 2024-09-14T10:41:33.091 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 291 k 2024-09-14T10:41:33.091 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mon x86_64 2:19.3.0-4907.ga2782315.el9 ceph 4.8 M 2024-09-14T10:41:33.091 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-osd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 17 M 2024-09-14T10:41:33.091 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 16 k 2024-09-14T10:41:33.092 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-selinux x86_64 2:19.3.0-4907.ga2782315.el9 ceph 25 k 2024-09-14T10:41:33.092 INFO:teuthology.orchestra.run.smithi097.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-14T10:41:33.092 INFO:teuthology.orchestra.run.smithi097.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-14T10:41:33.092 INFO:teuthology.orchestra.run.smithi097.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-14T10:41:33.093 INFO:teuthology.orchestra.run.smithi097.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-14T10:41:33.094 INFO:teuthology.orchestra.run.smithi097.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-14T10:41:33.094 INFO:teuthology.orchestra.run.smithi097.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-14T10:41:33.094 INFO:teuthology.orchestra.run.smithi097.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-14T10:41:33.094 INFO:teuthology.orchestra.run.smithi097.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-14T10:41:33.094 INFO:teuthology.orchestra.run.smithi097.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-14T10:41:33.094 INFO:teuthology.orchestra.run.smithi097.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-14T10:41:33.094 INFO:teuthology.orchestra.run.smithi097.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-14T10:41:33.094 INFO:teuthology.orchestra.run.smithi097.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-14T10:41:33.095 INFO:teuthology.orchestra.run.smithi097.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-14T10:41:33.095 INFO:teuthology.orchestra.run.smithi097.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-14T10:41:33.095 INFO:teuthology.orchestra.run.smithi097.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-14T10:41:33.095 INFO:teuthology.orchestra.run.smithi097.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-14T10:41:33.095 INFO:teuthology.orchestra.run.smithi097.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-14T10:41:33.095 INFO:teuthology.orchestra.run.smithi097.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-14T10:41:33.095 INFO:teuthology.orchestra.run.smithi097.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-14T10:41:33.095 INFO:teuthology.orchestra.run.smithi097.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-14T10:41:33.095 INFO:teuthology.orchestra.run.smithi097.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-14T10:41:33.096 INFO:teuthology.orchestra.run.smithi097.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-14T10:41:33.096 INFO:teuthology.orchestra.run.smithi097.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-14T10:41:33.096 INFO:teuthology.orchestra.run.smithi097.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-14T10:41:33.096 INFO:teuthology.orchestra.run.smithi097.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-14T10:41:33.096 INFO:teuthology.orchestra.run.smithi097.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-14T10:41:33.096 INFO:teuthology.orchestra.run.smithi097.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-14T10:41:33.096 INFO:teuthology.orchestra.run.smithi097.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-14T10:41:33.096 INFO:teuthology.orchestra.run.smithi097.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-14T10:41:33.097 INFO:teuthology.orchestra.run.smithi097.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-14T10:41:33.097 INFO:teuthology.orchestra.run.smithi097.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-14T10:41:33.097 INFO:teuthology.orchestra.run.smithi097.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-14T10:41:33.097 INFO:teuthology.orchestra.run.smithi097.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-14T10:41:33.097 INFO:teuthology.orchestra.run.smithi097.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-14T10:41:33.097 INFO:teuthology.orchestra.run.smithi097.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-14T10:41:33.097 INFO:teuthology.orchestra.run.smithi097.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-14T10:41:33.097 INFO:teuthology.orchestra.run.smithi097.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-14T10:41:33.097 INFO:teuthology.orchestra.run.smithi097.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-14T10:41:33.097 INFO:teuthology.orchestra.run.smithi097.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-14T10:41:33.097 INFO:teuthology.orchestra.run.smithi097.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-14T10:41:33.097 INFO:teuthology.orchestra.run.smithi097.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-14T10:41:33.097 INFO:teuthology.orchestra.run.smithi097.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-14T10:41:33.098 INFO:teuthology.orchestra.run.smithi097.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-14T10:41:33.098 INFO:teuthology.orchestra.run.smithi097.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-14T10:41:33.098 INFO:teuthology.orchestra.run.smithi097.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-14T10:41:33.098 INFO:teuthology.orchestra.run.smithi097.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-14T10:41:33.098 INFO:teuthology.orchestra.run.smithi097.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-14T10:41:33.098 INFO:teuthology.orchestra.run.smithi097.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-14T10:41:33.098 INFO:teuthology.orchestra.run.smithi097.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-14T10:41:33.098 INFO:teuthology.orchestra.run.smithi097.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-14T10:41:33.098 INFO:teuthology.orchestra.run.smithi097.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-14T10:41:33.099 INFO:teuthology.orchestra.run.smithi097.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-14T10:41:33.099 INFO:teuthology.orchestra.run.smithi097.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-14T10:41:33.099 INFO:teuthology.orchestra.run.smithi097.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-14T10:41:33.099 INFO:teuthology.orchestra.run.smithi097.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-14T10:41:33.099 INFO:teuthology.orchestra.run.smithi097.stdout: libcephsqlite x86_64 2:19.3.0-4907.ga2782315.el9 ceph 161 k 2024-09-14T10:41:33.099 INFO:teuthology.orchestra.run.smithi097.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-14T10:41:33.099 INFO:teuthology.orchestra.run.smithi097.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-14T10:41:33.099 INFO:teuthology.orchestra.run.smithi097.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-14T10:41:33.100 INFO:teuthology.orchestra.run.smithi097.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-14T10:41:33.100 INFO:teuthology.orchestra.run.smithi097.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-14T10:41:33.100 INFO:teuthology.orchestra.run.smithi097.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-14T10:41:33.100 INFO:teuthology.orchestra.run.smithi097.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-14T10:41:33.100 INFO:teuthology.orchestra.run.smithi097.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-14T10:41:33.101 INFO:teuthology.orchestra.run.smithi097.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-14T10:41:33.101 INFO:teuthology.orchestra.run.smithi097.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-14T10:41:33.101 INFO:teuthology.orchestra.run.smithi097.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-14T10:41:33.101 INFO:teuthology.orchestra.run.smithi097.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-14T10:41:33.101 INFO:teuthology.orchestra.run.smithi097.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-14T10:41:33.101 INFO:teuthology.orchestra.run.smithi097.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-14T10:41:33.101 INFO:teuthology.orchestra.run.smithi097.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-14T10:41:33.101 INFO:teuthology.orchestra.run.smithi097.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-14T10:41:33.101 INFO:teuthology.orchestra.run.smithi097.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-14T10:41:33.102 INFO:teuthology.orchestra.run.smithi097.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-14T10:41:33.102 INFO:teuthology.orchestra.run.smithi097.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-14T10:41:33.102 INFO:teuthology.orchestra.run.smithi097.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-14T10:41:33.102 INFO:teuthology.orchestra.run.smithi097.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-14T10:41:33.102 INFO:teuthology.orchestra.run.smithi097.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-14T10:41:33.102 INFO:teuthology.orchestra.run.smithi097.stdout: libradosstriper1 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 508 k 2024-09-14T10:41:33.102 INFO:teuthology.orchestra.run.smithi097.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-14T10:41:33.102 INFO:teuthology.orchestra.run.smithi097.stdout: librgw2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 5.5 M 2024-09-14T10:41:33.102 INFO:teuthology.orchestra.run.smithi097.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-14T10:41:33.102 INFO:teuthology.orchestra.run.smithi097.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-14T10:41:33.102 INFO:teuthology.orchestra.run.smithi097.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-14T10:41:33.102 INFO:teuthology.orchestra.run.smithi097.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-14T10:41:33.103 INFO:teuthology.orchestra.run.smithi097.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-14T10:41:33.103 INFO:teuthology.orchestra.run.smithi097.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-14T10:41:33.103 INFO:teuthology.orchestra.run.smithi097.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-14T10:41:33.103 INFO:teuthology.orchestra.run.smithi097.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-14T10:41:33.103 INFO:teuthology.orchestra.run.smithi097.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-14T10:41:33.103 INFO:teuthology.orchestra.run.smithi097.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-14T10:41:33.103 INFO:teuthology.orchestra.run.smithi097.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-14T10:41:33.103 INFO:teuthology.orchestra.run.smithi097.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-14T10:41:33.103 INFO:teuthology.orchestra.run.smithi097.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-14T10:41:33.103 INFO:teuthology.orchestra.run.smithi097.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-14T10:41:33.103 INFO:teuthology.orchestra.run.smithi097.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-14T10:41:33.103 INFO:teuthology.orchestra.run.smithi097.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-14T10:41:33.104 INFO:teuthology.orchestra.run.smithi097.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-14T10:41:33.104 INFO:teuthology.orchestra.run.smithi097.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-14T10:41:33.104 INFO:teuthology.orchestra.run.smithi097.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-14T10:41:33.104 INFO:teuthology.orchestra.run.smithi097.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-14T10:41:33.104 INFO:teuthology.orchestra.run.smithi097.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-14T10:41:33.104 INFO:teuthology.orchestra.run.smithi097.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-14T10:41:33.104 INFO:teuthology.orchestra.run.smithi097.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-14T10:41:33.104 INFO:teuthology.orchestra.run.smithi097.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-14T10:41:33.104 INFO:teuthology.orchestra.run.smithi097.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-14T10:41:33.104 INFO:teuthology.orchestra.run.smithi097.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-14T10:41:33.104 INFO:teuthology.orchestra.run.smithi097.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-14T10:41:33.104 INFO:teuthology.orchestra.run.smithi097.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-14T10:41:33.104 INFO:teuthology.orchestra.run.smithi097.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-14T10:41:33.105 INFO:teuthology.orchestra.run.smithi097.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-14T10:41:33.105 INFO:teuthology.orchestra.run.smithi097.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-14T10:41:33.105 INFO:teuthology.orchestra.run.smithi097.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-14T10:41:33.105 INFO:teuthology.orchestra.run.smithi097.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-14T10:41:33.105 INFO:teuthology.orchestra.run.smithi097.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-14T10:41:33.105 INFO:teuthology.orchestra.run.smithi097.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-14T10:41:33.105 INFO:teuthology.orchestra.run.smithi097.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-14T10:41:33.105 INFO:teuthology.orchestra.run.smithi097.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-14T10:41:33.105 INFO:teuthology.orchestra.run.smithi097.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-14T10:41:33.105 INFO:teuthology.orchestra.run.smithi097.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-14T10:41:33.105 INFO:teuthology.orchestra.run.smithi097.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-14T10:41:33.105 INFO:teuthology.orchestra.run.smithi097.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-14T10:41:33.105 INFO:teuthology.orchestra.run.smithi097.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-14T10:41:33.105 INFO:teuthology.orchestra.run.smithi097.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-14T10:41:33.106 INFO:teuthology.orchestra.run.smithi097.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-14T10:41:33.106 INFO:teuthology.orchestra.run.smithi097.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-14T10:41:33.106 INFO:teuthology.orchestra.run.smithi097.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-14T10:41:33.106 INFO:teuthology.orchestra.run.smithi097.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-14T10:41:33.106 INFO:teuthology.orchestra.run.smithi097.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-14T10:41:33.106 INFO:teuthology.orchestra.run.smithi097.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-14T10:41:33.106 INFO:teuthology.orchestra.run.smithi097.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-14T10:41:33.106 INFO:teuthology.orchestra.run.smithi097.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-14T10:41:33.106 INFO:teuthology.orchestra.run.smithi097.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-14T10:41:33.106 INFO:teuthology.orchestra.run.smithi097.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-14T10:41:33.106 INFO:teuthology.orchestra.run.smithi097.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-14T10:41:33.107 INFO:teuthology.orchestra.run.smithi097.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-14T10:41:33.107 INFO:teuthology.orchestra.run.smithi097.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-14T10:41:33.107 INFO:teuthology.orchestra.run.smithi097.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-14T10:41:33.107 INFO:teuthology.orchestra.run.smithi097.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-14T10:41:33.107 INFO:teuthology.orchestra.run.smithi097.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-14T10:41:33.107 INFO:teuthology.orchestra.run.smithi097.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-14T10:41:33.107 INFO:teuthology.orchestra.run.smithi097.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-14T10:41:33.107 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-14T10:41:33.107 INFO:teuthology.orchestra.run.smithi097.stdout: python3-ceph-argparse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 45 k 2024-09-14T10:41:33.107 INFO:teuthology.orchestra.run.smithi097.stdout: python3-ceph-common x86_64 2:19.3.0-4907.ga2782315.el9 ceph 143 k 2024-09-14T10:41:33.107 INFO:teuthology.orchestra.run.smithi097.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-14T10:41:33.107 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-14T10:41:33.107 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-14T10:41:33.108 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-14T10:41:33.108 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-14T10:41:33.108 INFO:teuthology.orchestra.run.smithi097.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-14T10:41:33.108 INFO:teuthology.orchestra.run.smithi097.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-14T10:41:33.108 INFO:teuthology.orchestra.run.smithi097.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-14T10:41:33.108 INFO:teuthology.orchestra.run.smithi097.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-14T10:41:33.108 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-14T10:41:33.108 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-14T10:41:33.108 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-14T10:41:33.108 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-14T10:41:33.108 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-14T10:41:33.108 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-14T10:41:33.108 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-14T10:41:33.109 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-14T10:41:33.109 INFO:teuthology.orchestra.run.smithi097.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-14T10:41:33.109 INFO:teuthology.orchestra.run.smithi097.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-14T10:41:33.109 INFO:teuthology.orchestra.run.smithi097.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-14T10:41:33.109 INFO:teuthology.orchestra.run.smithi097.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-14T10:41:33.109 INFO:teuthology.orchestra.run.smithi097.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-14T10:41:33.109 INFO:teuthology.orchestra.run.smithi097.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-14T10:41:33.109 INFO:teuthology.orchestra.run.smithi097.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-14T10:41:33.109 INFO:teuthology.orchestra.run.smithi097.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-14T10:41:33.109 INFO:teuthology.orchestra.run.smithi097.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-14T10:41:33.109 INFO:teuthology.orchestra.run.smithi097.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-14T10:41:33.109 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-14T10:41:33.109 INFO:teuthology.orchestra.run.smithi097.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-14T10:41:33.110 INFO:teuthology.orchestra.run.smithi097.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-14T10:41:33.110 INFO:teuthology.orchestra.run.smithi097.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-14T10:41:33.110 INFO:teuthology.orchestra.run.smithi097.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-14T10:41:33.110 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-14T10:41:33.110 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-14T10:41:33.110 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-14T10:41:33.110 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-14T10:41:33.110 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-14T10:41:33.110 INFO:teuthology.orchestra.run.smithi097.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-14T10:41:33.111 INFO:teuthology.orchestra.run.smithi097.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-14T10:41:33.111 INFO:teuthology.orchestra.run.smithi097.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-14T10:41:33.111 INFO:teuthology.orchestra.run.smithi097.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-14T10:41:33.111 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-14T10:41:33.111 INFO:teuthology.orchestra.run.smithi097.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-14T10:41:33.111 INFO:teuthology.orchestra.run.smithi097.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-14T10:41:33.111 INFO:teuthology.orchestra.run.smithi097.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-14T10:41:33.111 INFO:teuthology.orchestra.run.smithi097.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-14T10:41:33.111 INFO:teuthology.orchestra.run.smithi097.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-14T10:41:33.111 INFO:teuthology.orchestra.run.smithi097.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-14T10:41:33.111 INFO:teuthology.orchestra.run.smithi097.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-14T10:41:33.111 INFO:teuthology.orchestra.run.smithi097.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-14T10:41:33.112 INFO:teuthology.orchestra.run.smithi097.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-14T10:41:33.112 INFO:teuthology.orchestra.run.smithi097.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-14T10:41:33.112 INFO:teuthology.orchestra.run.smithi097.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-14T10:41:33.112 INFO:teuthology.orchestra.run.smithi097.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-14T10:41:33.112 INFO:teuthology.orchestra.run.smithi097.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-14T10:41:33.112 INFO:teuthology.orchestra.run.smithi097.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-14T10:41:33.112 INFO:teuthology.orchestra.run.smithi097.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-14T10:41:33.112 INFO:teuthology.orchestra.run.smithi097.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-14T10:41:33.112 INFO:teuthology.orchestra.run.smithi097.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-14T10:41:33.112 INFO:teuthology.orchestra.run.smithi097.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-14T10:41:33.112 INFO:teuthology.orchestra.run.smithi097.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-14T10:41:33.112 INFO:teuthology.orchestra.run.smithi097.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-14T10:41:33.112 INFO:teuthology.orchestra.run.smithi097.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-14T10:41:33.113 INFO:teuthology.orchestra.run.smithi097.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-14T10:41:33.113 INFO:teuthology.orchestra.run.smithi097.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-14T10:41:33.113 INFO:teuthology.orchestra.run.smithi097.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-14T10:41:33.113 INFO:teuthology.orchestra.run.smithi097.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-14T10:41:33.113 INFO:teuthology.orchestra.run.smithi097.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-14T10:41:33.113 INFO:teuthology.orchestra.run.smithi097.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-14T10:41:33.113 INFO:teuthology.orchestra.run.smithi097.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-14T10:41:33.113 INFO:teuthology.orchestra.run.smithi097.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-14T10:41:33.113 INFO:teuthology.orchestra.run.smithi097.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-14T10:41:33.113 INFO:teuthology.orchestra.run.smithi097.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-14T10:41:33.113 INFO:teuthology.orchestra.run.smithi097.stdout:Installing weak dependencies: 2024-09-14T10:41:33.113 INFO:teuthology.orchestra.run.smithi097.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-14T10:41:33.113 INFO:teuthology.orchestra.run.smithi097.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-14T10:41:33.114 INFO:teuthology.orchestra.run.smithi097.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-14T10:41:33.114 INFO:teuthology.orchestra.run.smithi097.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-14T10:41:33.114 INFO:teuthology.orchestra.run.smithi097.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-14T10:41:33.114 INFO:teuthology.orchestra.run.smithi097.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-14T10:41:33.114 INFO:teuthology.orchestra.run.smithi097.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-14T10:41:33.114 INFO:teuthology.orchestra.run.smithi097.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-14T10:41:33.114 INFO:teuthology.orchestra.run.smithi097.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-14T10:41:33.114 INFO:teuthology.orchestra.run.smithi097.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-14T10:41:33.114 INFO:teuthology.orchestra.run.smithi097.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-14T10:41:33.114 INFO:teuthology.orchestra.run.smithi097.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-14T10:41:33.114 INFO:teuthology.orchestra.run.smithi097.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-14T10:41:33.115 INFO:teuthology.orchestra.run.smithi097.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-14T10:41:33.115 INFO:teuthology.orchestra.run.smithi097.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-14T10:41:33.115 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:41:33.115 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction Summary 2024-09-14T10:41:33.115 INFO:teuthology.orchestra.run.smithi097.stdout:====================================================================================================== 2024-09-14T10:41:33.115 INFO:teuthology.orchestra.run.smithi097.stdout:Install 284 Packages 2024-09-14T10:41:33.115 INFO:teuthology.orchestra.run.smithi097.stdout:Upgrade 2 Packages 2024-09-14T10:41:33.115 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:41:33.116 INFO:teuthology.orchestra.run.smithi097.stdout:Total download size: 327 M 2024-09-14T10:41:33.116 INFO:teuthology.orchestra.run.smithi097.stdout:Downloading Packages: 2024-09-14T10:41:33.477 INFO:teuthology.orchestra.run.smithi097.stdout:(1/286): ceph-19.3.0-4907.ga2782315.el9.x86_64. 38 kB/s | 6.6 kB 00:00 2024-09-14T10:41:34.044 INFO:teuthology.orchestra.run.smithi097.stdout:(2/286): ceph-fuse-19.3.0-4907.ga2782315.el9.x8 1.6 MB/s | 900 kB 00:00 2024-09-14T10:41:34.261 INFO:teuthology.orchestra.run.smithi097.stdout:(3/286): ceph-immutable-object-cache-19.3.0-490 668 kB/s | 145 kB 00:00 2024-09-14T10:41:35.128 INFO:teuthology.orchestra.run.smithi097.stdout:(4/286): ceph-base-19.3.0-4907.ga2782315.el9.x8 3.0 MB/s | 5.5 MB 00:01 2024-09-14T10:41:35.170 INFO:teuthology.orchestra.run.smithi097.stdout:(5/286): ceph-mds-19.3.0-4907.ga2782315.el9.x86 2.6 MB/s | 2.4 MB 00:00 2024-09-14T10:41:35.554 INFO:teuthology.orchestra.run.smithi097.stdout:(6/286): ceph-mgr-19.3.0-4907.ga2782315.el9.x86 3.6 MB/s | 1.5 MB 00:00 2024-09-14T10:41:37.129 INFO:teuthology.orchestra.run.smithi097.stdout:(7/286): ceph-mon-19.3.0-4907.ga2782315.el9.x86 2.4 MB/s | 4.8 MB 00:01 2024-09-14T10:41:37.287 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - AppStream 1.1 MB/s | 20 MB 00:19 2024-09-14T10:41:38.631 INFO:teuthology.orchestra.run.smithi097.stdout:(8/286): ceph-common-19.3.0-4907.ga2782315.el9. 4.1 MB/s | 22 MB 00:05 2024-09-14T10:41:38.704 INFO:teuthology.orchestra.run.smithi097.stdout:(9/286): ceph-selinux-19.3.0-4907.ga2782315.el9 337 kB/s | 25 kB 00:00 2024-09-14T10:41:39.113 INFO:teuthology.orchestra.run.smithi097.stdout:(10/286): ceph-osd-19.3.0-4907.ga2782315.el9.x8 4.8 MB/s | 17 MB 00:03 2024-09-14T10:41:39.188 INFO:teuthology.orchestra.run.smithi097.stdout:(11/286): libcephfs-devel-19.3.0-4907.ga2782315 425 kB/s | 32 kB 00:00 2024-09-14T10:41:39.388 INFO:teuthology.orchestra.run.smithi097.stdout:(12/286): libcephfs2-19.3.0-4907.ga2782315.el9. 3.7 MB/s | 756 kB 00:00 2024-09-14T10:41:39.472 INFO:teuthology.orchestra.run.smithi097.stdout:(13/286): libcephsqlite-19.3.0-4907.ga2782315.e 1.9 MB/s | 161 kB 00:00 2024-09-14T10:41:39.564 INFO:teuthology.orchestra.run.smithi097.stdout:(14/286): librados-devel-19.3.0-4907.ga2782315. 1.4 MB/s | 127 kB 00:00 2024-09-14T10:41:39.706 INFO:teuthology.orchestra.run.smithi097.stdout:(15/286): libradosstriper1-19.3.0-4907.ga278231 3.5 MB/s | 508 kB 00:00 2024-09-14T10:41:40.839 INFO:teuthology.orchestra.run.smithi097.stdout:(16/286): librgw2-19.3.0-4907.ga2782315.el9.x86 4.9 MB/s | 5.5 MB 00:01 2024-09-14T10:41:40.914 INFO:teuthology.orchestra.run.smithi097.stdout:(17/286): python3-ceph-argparse-19.3.0-4907.ga2 602 kB/s | 45 kB 00:00 2024-09-14T10:41:40.998 INFO:teuthology.orchestra.run.smithi097.stdout:(18/286): python3-ceph-common-19.3.0-4907.ga278 1.7 MB/s | 143 kB 00:00 2024-09-14T10:41:41.082 INFO:teuthology.orchestra.run.smithi097.stdout:(19/286): python3-cephfs-19.3.0-4907.ga2782315. 1.9 MB/s | 161 kB 00:00 2024-09-14T10:41:41.224 INFO:teuthology.orchestra.run.smithi097.stdout:(20/286): python3-rados-19.3.0-4907.ga2782315.e 2.2 MB/s | 320 kB 00:00 2024-09-14T10:41:41.307 INFO:teuthology.orchestra.run.smithi097.stdout:(21/286): python3-rbd-19.3.0-4907.ga2782315.el9 3.6 MB/s | 305 kB 00:00 2024-09-14T10:41:41.416 INFO:teuthology.orchestra.run.smithi097.stdout:(22/286): ceph-radosgw-19.3.0-4907.ga2782315.el 2.6 MB/s | 11 MB 00:04 2024-09-14T10:41:41.441 INFO:teuthology.orchestra.run.smithi097.stdout:(23/286): python3-rgw-19.3.0-4907.ga2782315.el9 742 kB/s | 99 kB 00:00 2024-09-14T10:41:41.500 INFO:teuthology.orchestra.run.smithi097.stdout:(24/286): rbd-fuse-19.3.0-4907.ga2782315.el9.x8 1.0 MB/s | 85 kB 00:00 2024-09-14T10:41:41.567 INFO:teuthology.orchestra.run.smithi097.stdout:(25/286): rbd-nbd-19.3.0-4907.ga2782315.el9.x86 2.5 MB/s | 171 kB 00:00 2024-09-14T10:41:41.626 INFO:teuthology.orchestra.run.smithi097.stdout:(26/286): ceph-grafana-dashboards-19.3.0-4907.g 586 kB/s | 34 kB 00:00 2024-09-14T10:41:41.701 INFO:teuthology.orchestra.run.smithi097.stdout:(27/286): ceph-mgr-cephadm-19.3.0-4907.ga278231 2.0 MB/s | 154 kB 00:00 2024-09-14T10:41:42.026 INFO:teuthology.orchestra.run.smithi097.stdout:(28/286): rbd-mirror-19.3.0-4907.ga2782315.el9. 5.5 MB/s | 3.2 MB 00:00 2024-09-14T10:41:42.246 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - CRB 5.6 MB/s | 6.5 MB 00:01 2024-09-14T10:41:42.852 INFO:teuthology.orchestra.run.smithi097.stdout:(29/286): ceph-mgr-diskprediction-local-19.3.0- 9.0 MB/s | 7.4 MB 00:00 2024-09-14T10:41:42.902 INFO:teuthology.orchestra.run.smithi097.stdout:(30/286): ceph-mgr-modules-core-19.3.0-4907.ga2 5.7 MB/s | 291 kB 00:00 2024-09-14T10:41:42.944 INFO:teuthology.orchestra.run.smithi097.stdout:(31/286): ceph-mgr-rook-19.3.0-4907.ga2782315.e 1.2 MB/s | 49 kB 00:00 2024-09-14T10:41:42.986 INFO:teuthology.orchestra.run.smithi097.stdout:(32/286): ceph-prometheus-alerts-19.3.0-4907.ga 393 kB/s | 16 kB 00:00 2024-09-14T10:41:43.036 INFO:teuthology.orchestra.run.smithi097.stdout:(33/286): ceph-volume-19.3.0-4907.ga2782315.el9 5.6 MB/s | 285 kB 00:00 2024-09-14T10:41:43.128 INFO:teuthology.orchestra.run.smithi097.stdout:(34/286): cephadm-19.3.0-4907.ga2782315.el9.noa 8.3 MB/s | 784 kB 00:00 2024-09-14T10:41:43.312 INFO:teuthology.orchestra.run.smithi097.stdout:(35/286): ModemManager-glib-1.20.2-1.el9.x86_64 1.8 MB/s | 335 kB 00:00 2024-09-14T10:41:43.420 INFO:teuthology.orchestra.run.smithi097.stdout:(36/286): bluez-libs-5.56-6.el9.x86_64.rpm 782 kB/s | 85 kB 00:00 2024-09-14T10:41:43.513 INFO:teuthology.orchestra.run.smithi097.stdout:(37/286): bubblewrap-0.4.1-7.el9.x86_64.rpm 538 kB/s | 49 kB 00:00 2024-09-14T10:41:43.588 INFO:teuthology.orchestra.run.smithi097.stdout:(38/286): cups-libs-2.3.3op2-30.el9.x86_64.rpm 3.4 MB/s | 262 kB 00:00 2024-09-14T10:41:43.655 INFO:teuthology.orchestra.run.smithi097.stdout:(39/286): fuse-2.9.9-16.el9.x86_64.rpm 1.2 MB/s | 80 kB 00:00 2024-09-14T10:41:43.780 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - Extras packages 57 kB/s | 19 kB 00:00 2024-09-14T10:41:43.822 INFO:teuthology.orchestra.run.smithi097.stdout:(40/286): libgfortran-11.5.0-2.el9.x86_64.rpm 4.7 MB/s | 801 kB 00:00 2024-09-14T10:41:43.989 INFO:teuthology.orchestra.run.smithi097.stdout:(41/286): ceph-mgr-dashboard-19.3.0-4907.ga2782 6.2 MB/s | 14 MB 00:02 2024-09-14T10:41:44.005 INFO:teuthology.orchestra.run.smithi097.stdout:(42/286): libpciaccess-0.16-7.el9.x86_64.rpm 146 kB/s | 27 kB 00:00 2024-09-14T10:41:44.081 INFO:teuthology.orchestra.run.smithi097.stdout:(43/286): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.2 MB/s | 94 kB 00:00 2024-09-14T10:41:44.140 INFO:teuthology.orchestra.run.smithi097.stdout:(44/286): libquadmath-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 191 kB 00:00 2024-09-14T10:41:44.173 INFO:teuthology.orchestra.run.smithi097.stdout:(45/286): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-09-14T10:41:44.249 INFO:teuthology.orchestra.run.smithi097.stdout:(46/286): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-14T10:41:44.291 INFO:teuthology.orchestra.run.smithi097.stdout:(47/286): python3-cryptography-36.0.1-4.el9.x86 8.1 MB/s | 1.2 MB 00:00 2024-09-14T10:41:44.324 INFO:teuthology.orchestra.run.smithi097.stdout:(48/286): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 135 kB 00:00 2024-09-14T10:41:44.374 INFO:teuthology.orchestra.run.smithi097.stdout:(49/286): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-09-14T10:41:44.408 INFO:teuthology.orchestra.run.smithi097.stdout:(50/286): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-14T10:41:44.959 INFO:teuthology.orchestra.run.smithi152.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-14T10:41:45.076 INFO:teuthology.orchestra.run.smithi097.stdout:(51/286): ceph-test-19.3.0-4907.ga2782315.el9.x 7.9 MB/s | 50 MB 00:06 2024-09-14T10:41:45.684 INFO:teuthology.orchestra.run.smithi097.stdout:(52/286): adwaita-cursor-theme-40.1.1-3.el9.noa 497 kB/s | 650 kB 00:01 2024-09-14T10:41:45.818 INFO:teuthology.orchestra.run.smithi097.stdout:(53/286): apache-commons-cli-1.4-17.el9.noarch. 532 kB/s | 71 kB 00:00 2024-09-14T10:41:45.893 INFO:teuthology.orchestra.run.smithi097.stdout:(54/286): alsa-lib-1.2.12-1.el9.x86_64.rpm 641 kB/s | 523 kB 00:00 2024-09-14T10:41:45.985 INFO:teuthology.orchestra.run.smithi097.stdout:(55/286): apache-commons-codec-1.15-7.el9.noarc 1.8 MB/s | 302 kB 00:00 2024-09-14T10:41:46.177 INFO:teuthology.orchestra.run.smithi097.stdout:(56/286): apache-commons-io-2.8.0-8.el9.noarch. 999 kB/s | 283 kB 00:00 2024-09-14T10:41:46.311 INFO:teuthology.orchestra.run.smithi097.stdout:(57/286): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 651 kB/s | 87 kB 00:00 2024-09-14T10:41:46.444 INFO:teuthology.orchestra.run.smithi097.stdout:(58/286): at-spi2-core-2.40.3-1.el9.x86_64.rpm 1.4 MB/s | 195 kB 00:00 2024-09-14T10:41:46.569 INFO:teuthology.orchestra.run.smithi097.stdout:(59/286): atinject-1.0.3-6.el9.noarch.rpm 186 kB/s | 23 kB 00:00 2024-09-14T10:41:46.689 INFO:teuthology.orchestra.run.smithi097.stdout:(60/286): atk-2.36.0-5.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-14T10:41:46.803 INFO:teuthology.orchestra.run.smithi097.stdout:(61/286): avahi-glib-0.8-21.el9.x86_64.rpm 128 kB/s | 15 kB 00:00 2024-09-14T10:41:46.912 INFO:teuthology.orchestra.run.smithi097.stdout:(62/286): boost-program-options-1.75.0-8.el9.x8 985 kB/s | 107 kB 00:00 2024-09-14T10:41:47.020 INFO:teuthology.orchestra.run.smithi097.stdout:(63/286): cdi-api-2.0.2-6.el9.noarch.rpm 493 kB/s | 53 kB 00:00 2024-09-14T10:41:47.137 INFO:teuthology.orchestra.run.smithi097.stdout:(64/286): colord-libs-1.4.5-4.el9.x86_64.rpm 1.9 MB/s | 229 kB 00:00 2024-09-14T10:41:47.246 INFO:teuthology.orchestra.run.smithi097.stdout:(65/286): composefs-libs-1.0.5-1.el9.x86_64.rpm 563 kB/s | 61 kB 00:00 2024-09-14T10:41:47.355 INFO:teuthology.orchestra.run.smithi097.stdout:(66/286): copy-jdk-configs-4.0-3.el9.noarch.rpm 261 kB/s | 28 kB 00:00 2024-09-14T10:41:47.471 INFO:teuthology.orchestra.run.smithi097.stdout:(67/286): dconf-0.40.0-6.el9.x86_64.rpm 964 kB/s | 113 kB 00:00 2024-09-14T10:41:47.614 INFO:teuthology.orchestra.run.smithi097.stdout:(68/286): exempi-2.6.0-0.2.20211007gite23c213.e 3.6 MB/s | 525 kB 00:00 2024-09-14T10:41:47.747 INFO:teuthology.orchestra.run.smithi097.stdout:(69/286): exiv2-0.27.5-2.el9.x86_64.rpm 7.2 MB/s | 980 kB 00:00 2024-09-14T10:41:47.873 INFO:teuthology.orchestra.run.smithi097.stdout:(70/286): exiv2-libs-0.27.5-2.el9.x86_64.rpm 6.1 MB/s | 781 kB 00:00 2024-09-14T10:41:47.998 INFO:teuthology.orchestra.run.smithi097.stdout:(71/286): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 2.5 MB/s | 325 kB 00:00 2024-09-14T10:41:48.048 INFO:teuthology.orchestra.run.smithi097.stdout:(72/286): apache-commons-lang3-3.12.0-6.el9.noa 271 kB/s | 559 kB 00:02 2024-09-14T10:41:48.115 INFO:teuthology.orchestra.run.smithi097.stdout:(73/286): flac-libs-1.3.3-12.el9.x86_64.rpm 1.8 MB/s | 218 kB 00:00 2024-09-14T10:41:48.282 INFO:teuthology.orchestra.run.smithi097.stdout:(74/286): flatpak-selinux-1.12.9-1.el9.noarch.r 129 kB/s | 22 kB 00:00 2024-09-14T10:41:48.399 INFO:teuthology.orchestra.run.smithi097.stdout:(75/286): flatpak-session-helper-1.12.9-1.el9.x 626 kB/s | 73 kB 00:00 2024-09-14T10:41:48.508 INFO:teuthology.orchestra.run.smithi097.stdout:(76/286): flexiblas-3.0.4-8.el9.x86_64.rpm 302 kB/s | 33 kB 00:00 2024-09-14T10:41:48.842 INFO:teuthology.orchestra.run.smithi097.stdout:(77/286): flatpak-1.12.9-1.el9.x86_64.rpm 2.2 MB/s | 1.7 MB 00:00 2024-09-14T10:41:48.950 INFO:teuthology.orchestra.run.smithi097.stdout:(78/286): flexiblas-openblas-openmp-3.0.4-8.el9 168 kB/s | 18 kB 00:00 2024-09-14T10:41:49.059 INFO:teuthology.orchestra.run.smithi097.stdout:(79/286): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 821 kB/s | 89 kB 00:00 2024-09-14T10:41:49.168 INFO:teuthology.orchestra.run.smithi097.stdout:(80/286): geoclue2-2.6.0-7.el9.x86_64.rpm 1.1 MB/s | 124 kB 00:00 2024-09-14T10:41:49.276 INFO:teuthology.orchestra.run.smithi097.stdout:(81/286): giflib-5.2.1-9.el9.x86_64.rpm 449 kB/s | 49 kB 00:00 2024-09-14T10:41:49.568 INFO:teuthology.orchestra.run.smithi097.stdout:(82/286): google-guice-4.2.3-9.el9.noarch.rpm 1.6 MB/s | 473 kB 00:00 2024-09-14T10:41:49.694 INFO:teuthology.orchestra.run.smithi097.stdout:(83/286): graphene-1.10.6-2.el9.x86_64.rpm 516 kB/s | 64 kB 00:00 2024-09-14T10:41:49.810 INFO:teuthology.orchestra.run.smithi097.stdout:(84/286): gsm-1.0.19-6.el9.x86_64.rpm 294 kB/s | 34 kB 00:00 2024-09-14T10:41:50.332 INFO:teuthology.orchestra.run.smithi152.stdout:lab-extras 35 kB/s | 1.7 kB 00:00 2024-09-14T10:41:50.502 INFO:teuthology.orchestra.run.smithi097.stdout:(85/286): flexiblas-netlib-3.0.4-8.el9.x86_64.r 1.5 MB/s | 3.0 MB 00:01 2024-09-14T10:41:50.544 INFO:teuthology.orchestra.run.smithi097.stdout:(86/286): gstreamer1-1.22.1-2.el9.x86_64.rpm 1.9 MB/s | 1.4 MB 00:00 2024-09-14T10:41:50.653 INFO:teuthology.orchestra.run.smithi097.stdout:(87/286): gtk-update-icon-cache-3.24.31-5.el9.x 305 kB/s | 33 kB 00:00 2024-09-14T10:41:52.195 INFO:teuthology.orchestra.run.smithi097.stdout:(88/286): gtk3-3.24.31-5.el9.x86_64.rpm 3.2 MB/s | 4.9 MB 00:01 2024-09-14T10:41:52.701 INFO:teuthology.orchestra.run.smithi152.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-14T10:41:52.701 INFO:teuthology.orchestra.run.smithi152.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-14T10:41:52.794 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-14T10:41:52.816 INFO:teuthology.orchestra.run.smithi152.stdout:====================================================================================================== 2024-09-14T10:41:52.816 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2024-09-14T10:41:52.816 INFO:teuthology.orchestra.run.smithi152.stdout:====================================================================================================== 2024-09-14T10:41:52.816 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-14T10:41:52.817 INFO:teuthology.orchestra.run.smithi152.stdout: ceph x86_64 2:19.3.0-4907.ga2782315.el9 ceph 6.6 k 2024-09-14T10:41:52.817 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-base x86_64 2:19.3.0-4907.ga2782315.el9 ceph 5.5 M 2024-09-14T10:41:52.817 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-fuse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 900 k 2024-09-14T10:41:52.817 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4907.ga2782315.el9 ceph 145 k 2024-09-14T10:41:52.817 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr x86_64 2:19.3.0-4907.ga2782315.el9 ceph 1.5 M 2024-09-14T10:41:52.818 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 154 k 2024-09-14T10:41:52.818 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 14 M 2024-09-14T10:41:52.818 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 7.4 M 2024-09-14T10:41:52.818 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-rook noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 49 k 2024-09-14T10:41:52.818 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-radosgw x86_64 2:19.3.0-4907.ga2782315.el9 ceph 11 M 2024-09-14T10:41:52.818 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-test x86_64 2:19.3.0-4907.ga2782315.el9 ceph 50 M 2024-09-14T10:41:52.819 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-volume noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 285 k 2024-09-14T10:41:52.819 INFO:teuthology.orchestra.run.smithi152.stdout: cephadm noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 784 k 2024-09-14T10:41:52.819 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs-devel x86_64 2:19.3.0-4907.ga2782315.el9 ceph 32 k 2024-09-14T10:41:52.819 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 756 k 2024-09-14T10:41:52.819 INFO:teuthology.orchestra.run.smithi152.stdout: librados-devel x86_64 2:19.3.0-4907.ga2782315.el9 ceph 127 k 2024-09-14T10:41:52.819 INFO:teuthology.orchestra.run.smithi152.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-14T10:41:52.820 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cephfs x86_64 2:19.3.0-4907.ga2782315.el9 ceph 161 k 2024-09-14T10:41:52.820 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rados x86_64 2:19.3.0-4907.ga2782315.el9 ceph 320 k 2024-09-14T10:41:52.820 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rbd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 305 k 2024-09-14T10:41:52.821 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rgw x86_64 2:19.3.0-4907.ga2782315.el9 ceph 99 k 2024-09-14T10:41:52.821 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-fuse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 85 k 2024-09-14T10:41:52.821 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-mirror x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.2 M 2024-09-14T10:41:52.821 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-nbd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 171 k 2024-09-14T10:41:52.821 INFO:teuthology.orchestra.run.smithi152.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-14T10:41:52.821 INFO:teuthology.orchestra.run.smithi152.stdout:Upgrading: 2024-09-14T10:41:52.821 INFO:teuthology.orchestra.run.smithi152.stdout: librados2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.5 M 2024-09-14T10:41:52.822 INFO:teuthology.orchestra.run.smithi152.stdout: librbd1 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.2 M 2024-09-14T10:41:52.822 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2024-09-14T10:41:52.822 INFO:teuthology.orchestra.run.smithi152.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-14T10:41:52.822 INFO:teuthology.orchestra.run.smithi152.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-14T10:41:52.822 INFO:teuthology.orchestra.run.smithi152.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-14T10:41:52.822 INFO:teuthology.orchestra.run.smithi152.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-14T10:41:52.823 INFO:teuthology.orchestra.run.smithi152.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-14T10:41:52.823 INFO:teuthology.orchestra.run.smithi152.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-14T10:41:52.823 INFO:teuthology.orchestra.run.smithi152.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-14T10:41:52.824 INFO:teuthology.orchestra.run.smithi152.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-14T10:41:52.824 INFO:teuthology.orchestra.run.smithi152.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-14T10:41:52.824 INFO:teuthology.orchestra.run.smithi152.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-14T10:41:52.824 INFO:teuthology.orchestra.run.smithi152.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-14T10:41:52.824 INFO:teuthology.orchestra.run.smithi152.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-14T10:41:52.824 INFO:teuthology.orchestra.run.smithi152.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-14T10:41:52.825 INFO:teuthology.orchestra.run.smithi152.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-14T10:41:52.825 INFO:teuthology.orchestra.run.smithi152.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-14T10:41:52.825 INFO:teuthology.orchestra.run.smithi152.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-14T10:41:52.825 INFO:teuthology.orchestra.run.smithi152.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-14T10:41:52.825 INFO:teuthology.orchestra.run.smithi152.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-14T10:41:52.825 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-common x86_64 2:19.3.0-4907.ga2782315.el9 ceph 22 M 2024-09-14T10:41:52.826 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 34 k 2024-09-14T10:41:52.826 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mds x86_64 2:19.3.0-4907.ga2782315.el9 ceph 2.4 M 2024-09-14T10:41:52.826 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 291 k 2024-09-14T10:41:52.826 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mon x86_64 2:19.3.0-4907.ga2782315.el9 ceph 4.8 M 2024-09-14T10:41:52.826 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-osd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 17 M 2024-09-14T10:41:52.826 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 16 k 2024-09-14T10:41:52.826 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-selinux x86_64 2:19.3.0-4907.ga2782315.el9 ceph 25 k 2024-09-14T10:41:52.826 INFO:teuthology.orchestra.run.smithi152.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-14T10:41:52.826 INFO:teuthology.orchestra.run.smithi152.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-14T10:41:52.826 INFO:teuthology.orchestra.run.smithi152.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-14T10:41:52.826 INFO:teuthology.orchestra.run.smithi152.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-14T10:41:52.827 INFO:teuthology.orchestra.run.smithi152.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-14T10:41:52.827 INFO:teuthology.orchestra.run.smithi152.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-14T10:41:52.827 INFO:teuthology.orchestra.run.smithi152.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-14T10:41:52.827 INFO:teuthology.orchestra.run.smithi152.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-14T10:41:52.827 INFO:teuthology.orchestra.run.smithi152.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-14T10:41:52.827 INFO:teuthology.orchestra.run.smithi152.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-14T10:41:52.827 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-14T10:41:52.827 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-14T10:41:52.827 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-14T10:41:52.827 INFO:teuthology.orchestra.run.smithi152.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-14T10:41:52.827 INFO:teuthology.orchestra.run.smithi152.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-14T10:41:52.827 INFO:teuthology.orchestra.run.smithi152.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-14T10:41:52.827 INFO:teuthology.orchestra.run.smithi152.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-14T10:41:52.828 INFO:teuthology.orchestra.run.smithi152.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-14T10:41:52.828 INFO:teuthology.orchestra.run.smithi152.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-14T10:41:52.828 INFO:teuthology.orchestra.run.smithi152.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-14T10:41:52.828 INFO:teuthology.orchestra.run.smithi152.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-14T10:41:52.828 INFO:teuthology.orchestra.run.smithi152.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-14T10:41:52.828 INFO:teuthology.orchestra.run.smithi152.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-14T10:41:52.828 INFO:teuthology.orchestra.run.smithi152.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-14T10:41:52.828 INFO:teuthology.orchestra.run.smithi152.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-14T10:41:52.828 INFO:teuthology.orchestra.run.smithi152.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-14T10:41:52.828 INFO:teuthology.orchestra.run.smithi152.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-14T10:41:52.829 INFO:teuthology.orchestra.run.smithi152.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-14T10:41:52.829 INFO:teuthology.orchestra.run.smithi152.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-14T10:41:52.829 INFO:teuthology.orchestra.run.smithi152.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-14T10:41:52.829 INFO:teuthology.orchestra.run.smithi152.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-14T10:41:52.829 INFO:teuthology.orchestra.run.smithi152.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-14T10:41:52.829 INFO:teuthology.orchestra.run.smithi152.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-14T10:41:52.829 INFO:teuthology.orchestra.run.smithi152.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-14T10:41:52.829 INFO:teuthology.orchestra.run.smithi152.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-14T10:41:52.829 INFO:teuthology.orchestra.run.smithi152.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-14T10:41:52.829 INFO:teuthology.orchestra.run.smithi152.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-14T10:41:52.829 INFO:teuthology.orchestra.run.smithi152.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-14T10:41:52.829 INFO:teuthology.orchestra.run.smithi152.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-14T10:41:52.829 INFO:teuthology.orchestra.run.smithi152.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-14T10:41:52.830 INFO:teuthology.orchestra.run.smithi152.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-14T10:41:52.830 INFO:teuthology.orchestra.run.smithi152.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-14T10:41:52.830 INFO:teuthology.orchestra.run.smithi152.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-14T10:41:52.830 INFO:teuthology.orchestra.run.smithi152.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-14T10:41:52.830 INFO:teuthology.orchestra.run.smithi152.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-14T10:41:52.830 INFO:teuthology.orchestra.run.smithi152.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-14T10:41:52.830 INFO:teuthology.orchestra.run.smithi152.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-14T10:41:52.830 INFO:teuthology.orchestra.run.smithi152.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-14T10:41:52.831 INFO:teuthology.orchestra.run.smithi152.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-14T10:41:52.831 INFO:teuthology.orchestra.run.smithi152.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-14T10:41:52.831 INFO:teuthology.orchestra.run.smithi152.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-14T10:41:52.831 INFO:teuthology.orchestra.run.smithi152.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-14T10:41:52.831 INFO:teuthology.orchestra.run.smithi152.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-14T10:41:52.831 INFO:teuthology.orchestra.run.smithi152.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-14T10:41:52.831 INFO:teuthology.orchestra.run.smithi152.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-14T10:41:52.831 INFO:teuthology.orchestra.run.smithi152.stdout: libcephsqlite x86_64 2:19.3.0-4907.ga2782315.el9 ceph 161 k 2024-09-14T10:41:52.831 INFO:teuthology.orchestra.run.smithi152.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-14T10:41:52.831 INFO:teuthology.orchestra.run.smithi152.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-14T10:41:52.831 INFO:teuthology.orchestra.run.smithi152.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-14T10:41:52.831 INFO:teuthology.orchestra.run.smithi152.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-14T10:41:52.831 INFO:teuthology.orchestra.run.smithi152.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-14T10:41:52.832 INFO:teuthology.orchestra.run.smithi152.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-14T10:41:52.832 INFO:teuthology.orchestra.run.smithi152.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-14T10:41:52.832 INFO:teuthology.orchestra.run.smithi152.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-14T10:41:52.832 INFO:teuthology.orchestra.run.smithi152.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-14T10:41:52.832 INFO:teuthology.orchestra.run.smithi152.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-14T10:41:52.832 INFO:teuthology.orchestra.run.smithi152.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-14T10:41:52.832 INFO:teuthology.orchestra.run.smithi152.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-14T10:41:52.832 INFO:teuthology.orchestra.run.smithi152.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-14T10:41:52.832 INFO:teuthology.orchestra.run.smithi152.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-14T10:41:52.832 INFO:teuthology.orchestra.run.smithi152.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-14T10:41:52.832 INFO:teuthology.orchestra.run.smithi152.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-14T10:41:52.832 INFO:teuthology.orchestra.run.smithi152.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-14T10:41:52.832 INFO:teuthology.orchestra.run.smithi152.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-14T10:41:52.833 INFO:teuthology.orchestra.run.smithi152.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-14T10:41:52.833 INFO:teuthology.orchestra.run.smithi152.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-14T10:41:52.833 INFO:teuthology.orchestra.run.smithi152.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-14T10:41:52.833 INFO:teuthology.orchestra.run.smithi152.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-14T10:41:52.833 INFO:teuthology.orchestra.run.smithi152.stdout: libradosstriper1 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 508 k 2024-09-14T10:41:52.833 INFO:teuthology.orchestra.run.smithi152.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-14T10:41:52.833 INFO:teuthology.orchestra.run.smithi152.stdout: librgw2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 5.5 M 2024-09-14T10:41:52.834 INFO:teuthology.orchestra.run.smithi152.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-14T10:41:52.834 INFO:teuthology.orchestra.run.smithi152.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-14T10:41:52.834 INFO:teuthology.orchestra.run.smithi152.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-14T10:41:52.834 INFO:teuthology.orchestra.run.smithi152.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-14T10:41:52.834 INFO:teuthology.orchestra.run.smithi152.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-14T10:41:52.834 INFO:teuthology.orchestra.run.smithi152.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-14T10:41:52.834 INFO:teuthology.orchestra.run.smithi152.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-14T10:41:52.834 INFO:teuthology.orchestra.run.smithi152.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-14T10:41:52.834 INFO:teuthology.orchestra.run.smithi152.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-14T10:41:52.834 INFO:teuthology.orchestra.run.smithi152.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-14T10:41:52.834 INFO:teuthology.orchestra.run.smithi152.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-14T10:41:52.835 INFO:teuthology.orchestra.run.smithi152.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-14T10:41:52.835 INFO:teuthology.orchestra.run.smithi152.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-14T10:41:52.835 INFO:teuthology.orchestra.run.smithi152.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-14T10:41:52.835 INFO:teuthology.orchestra.run.smithi152.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-14T10:41:52.835 INFO:teuthology.orchestra.run.smithi152.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-14T10:41:52.835 INFO:teuthology.orchestra.run.smithi152.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-14T10:41:52.835 INFO:teuthology.orchestra.run.smithi152.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-14T10:41:52.835 INFO:teuthology.orchestra.run.smithi152.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-14T10:41:52.835 INFO:teuthology.orchestra.run.smithi152.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-14T10:41:52.835 INFO:teuthology.orchestra.run.smithi152.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-14T10:41:52.835 INFO:teuthology.orchestra.run.smithi152.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-14T10:41:52.835 INFO:teuthology.orchestra.run.smithi152.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-14T10:41:52.835 INFO:teuthology.orchestra.run.smithi152.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-14T10:41:52.836 INFO:teuthology.orchestra.run.smithi152.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-14T10:41:52.836 INFO:teuthology.orchestra.run.smithi152.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-14T10:41:52.836 INFO:teuthology.orchestra.run.smithi152.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-14T10:41:52.836 INFO:teuthology.orchestra.run.smithi152.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-14T10:41:52.836 INFO:teuthology.orchestra.run.smithi152.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-14T10:41:52.836 INFO:teuthology.orchestra.run.smithi152.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-14T10:41:52.836 INFO:teuthology.orchestra.run.smithi152.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-14T10:41:52.836 INFO:teuthology.orchestra.run.smithi152.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-14T10:41:52.836 INFO:teuthology.orchestra.run.smithi152.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-14T10:41:52.836 INFO:teuthology.orchestra.run.smithi152.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-14T10:41:52.836 INFO:teuthology.orchestra.run.smithi152.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-14T10:41:52.836 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-14T10:41:52.837 INFO:teuthology.orchestra.run.smithi152.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-14T10:41:52.837 INFO:teuthology.orchestra.run.smithi152.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-14T10:41:52.837 INFO:teuthology.orchestra.run.smithi152.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-14T10:41:52.837 INFO:teuthology.orchestra.run.smithi152.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-14T10:41:52.837 INFO:teuthology.orchestra.run.smithi152.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-14T10:41:52.837 INFO:teuthology.orchestra.run.smithi152.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-14T10:41:52.837 INFO:teuthology.orchestra.run.smithi152.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-14T10:41:52.837 INFO:teuthology.orchestra.run.smithi152.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-14T10:41:52.837 INFO:teuthology.orchestra.run.smithi152.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-14T10:41:52.837 INFO:teuthology.orchestra.run.smithi152.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-14T10:41:52.837 INFO:teuthology.orchestra.run.smithi152.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-14T10:41:52.837 INFO:teuthology.orchestra.run.smithi152.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-14T10:41:52.837 INFO:teuthology.orchestra.run.smithi152.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-14T10:41:52.838 INFO:teuthology.orchestra.run.smithi152.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-14T10:41:52.838 INFO:teuthology.orchestra.run.smithi152.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-14T10:41:52.838 INFO:teuthology.orchestra.run.smithi152.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-14T10:41:52.838 INFO:teuthology.orchestra.run.smithi152.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-14T10:41:52.838 INFO:teuthology.orchestra.run.smithi152.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-14T10:41:52.838 INFO:teuthology.orchestra.run.smithi152.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-14T10:41:52.838 INFO:teuthology.orchestra.run.smithi152.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-14T10:41:52.838 INFO:teuthology.orchestra.run.smithi152.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-14T10:41:52.838 INFO:teuthology.orchestra.run.smithi152.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-14T10:41:52.838 INFO:teuthology.orchestra.run.smithi152.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-14T10:41:52.838 INFO:teuthology.orchestra.run.smithi152.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-14T10:41:52.838 INFO:teuthology.orchestra.run.smithi152.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-14T10:41:52.838 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-14T10:41:52.839 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-argparse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 45 k 2024-09-14T10:41:52.839 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-common x86_64 2:19.3.0-4907.ga2782315.el9 ceph 143 k 2024-09-14T10:41:52.839 INFO:teuthology.orchestra.run.smithi152.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-14T10:41:52.839 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-14T10:41:52.839 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-14T10:41:52.839 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-14T10:41:52.839 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-14T10:41:52.839 INFO:teuthology.orchestra.run.smithi152.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-14T10:41:52.839 INFO:teuthology.orchestra.run.smithi152.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-14T10:41:52.839 INFO:teuthology.orchestra.run.smithi152.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-14T10:41:52.839 INFO:teuthology.orchestra.run.smithi152.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-14T10:41:52.839 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-14T10:41:52.839 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-14T10:41:52.840 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-14T10:41:52.840 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-14T10:41:52.840 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-14T10:41:52.840 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-14T10:41:52.840 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-14T10:41:52.840 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-14T10:41:52.840 INFO:teuthology.orchestra.run.smithi152.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-14T10:41:52.840 INFO:teuthology.orchestra.run.smithi152.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-14T10:41:52.840 INFO:teuthology.orchestra.run.smithi152.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-14T10:41:52.840 INFO:teuthology.orchestra.run.smithi152.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-14T10:41:52.840 INFO:teuthology.orchestra.run.smithi152.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-14T10:41:52.840 INFO:teuthology.orchestra.run.smithi152.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-14T10:41:52.841 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-14T10:41:52.841 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-14T10:41:52.841 INFO:teuthology.orchestra.run.smithi152.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-14T10:41:52.841 INFO:teuthology.orchestra.run.smithi152.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-14T10:41:52.841 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-14T10:41:52.841 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-14T10:41:52.841 INFO:teuthology.orchestra.run.smithi152.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-14T10:41:52.841 INFO:teuthology.orchestra.run.smithi152.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-14T10:41:52.841 INFO:teuthology.orchestra.run.smithi152.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-14T10:41:52.841 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-14T10:41:52.841 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-14T10:41:52.841 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-14T10:41:52.841 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-14T10:41:52.842 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-14T10:41:52.842 INFO:teuthology.orchestra.run.smithi152.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-14T10:41:52.842 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-14T10:41:52.842 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-14T10:41:52.842 INFO:teuthology.orchestra.run.smithi152.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-14T10:41:52.842 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-14T10:41:52.842 INFO:teuthology.orchestra.run.smithi152.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-14T10:41:52.842 INFO:teuthology.orchestra.run.smithi152.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-14T10:41:52.842 INFO:teuthology.orchestra.run.smithi152.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-14T10:41:52.842 INFO:teuthology.orchestra.run.smithi152.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-14T10:41:52.842 INFO:teuthology.orchestra.run.smithi152.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-14T10:41:52.842 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-14T10:41:52.843 INFO:teuthology.orchestra.run.smithi152.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-14T10:41:52.843 INFO:teuthology.orchestra.run.smithi152.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-14T10:41:52.843 INFO:teuthology.orchestra.run.smithi152.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-14T10:41:52.843 INFO:teuthology.orchestra.run.smithi152.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-14T10:41:52.843 INFO:teuthology.orchestra.run.smithi152.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-14T10:41:52.843 INFO:teuthology.orchestra.run.smithi152.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-14T10:41:52.843 INFO:teuthology.orchestra.run.smithi152.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-14T10:41:52.843 INFO:teuthology.orchestra.run.smithi152.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-14T10:41:52.843 INFO:teuthology.orchestra.run.smithi152.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-14T10:41:52.844 INFO:teuthology.orchestra.run.smithi152.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-14T10:41:52.844 INFO:teuthology.orchestra.run.smithi152.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-14T10:41:52.844 INFO:teuthology.orchestra.run.smithi152.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-14T10:41:52.844 INFO:teuthology.orchestra.run.smithi152.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-14T10:41:52.844 INFO:teuthology.orchestra.run.smithi152.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-14T10:41:52.844 INFO:teuthology.orchestra.run.smithi152.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-14T10:41:52.845 INFO:teuthology.orchestra.run.smithi152.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-14T10:41:52.845 INFO:teuthology.orchestra.run.smithi152.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-14T10:41:52.845 INFO:teuthology.orchestra.run.smithi152.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-14T10:41:52.845 INFO:teuthology.orchestra.run.smithi152.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-14T10:41:52.845 INFO:teuthology.orchestra.run.smithi152.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-14T10:41:52.845 INFO:teuthology.orchestra.run.smithi152.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-14T10:41:52.845 INFO:teuthology.orchestra.run.smithi152.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-14T10:41:52.845 INFO:teuthology.orchestra.run.smithi152.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-14T10:41:52.845 INFO:teuthology.orchestra.run.smithi152.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-14T10:41:52.845 INFO:teuthology.orchestra.run.smithi152.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-14T10:41:52.845 INFO:teuthology.orchestra.run.smithi152.stdout:Installing weak dependencies: 2024-09-14T10:41:52.845 INFO:teuthology.orchestra.run.smithi152.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-14T10:41:52.845 INFO:teuthology.orchestra.run.smithi152.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-14T10:41:52.846 INFO:teuthology.orchestra.run.smithi152.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-14T10:41:52.846 INFO:teuthology.orchestra.run.smithi152.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-14T10:41:52.846 INFO:teuthology.orchestra.run.smithi152.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-14T10:41:52.846 INFO:teuthology.orchestra.run.smithi152.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-14T10:41:52.846 INFO:teuthology.orchestra.run.smithi152.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-14T10:41:52.846 INFO:teuthology.orchestra.run.smithi152.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-14T10:41:52.846 INFO:teuthology.orchestra.run.smithi152.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-14T10:41:52.846 INFO:teuthology.orchestra.run.smithi152.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-14T10:41:52.846 INFO:teuthology.orchestra.run.smithi152.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-14T10:41:52.846 INFO:teuthology.orchestra.run.smithi152.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-14T10:41:52.846 INFO:teuthology.orchestra.run.smithi152.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-14T10:41:52.846 INFO:teuthology.orchestra.run.smithi152.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-14T10:41:52.846 INFO:teuthology.orchestra.run.smithi152.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-14T10:41:52.847 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:41:52.847 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-14T10:41:52.847 INFO:teuthology.orchestra.run.smithi152.stdout:====================================================================================================== 2024-09-14T10:41:52.847 INFO:teuthology.orchestra.run.smithi152.stdout:Install 284 Packages 2024-09-14T10:41:52.847 INFO:teuthology.orchestra.run.smithi152.stdout:Upgrade 2 Packages 2024-09-14T10:41:52.847 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:41:52.847 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 327 M 2024-09-14T10:41:52.848 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-14T10:41:52.862 INFO:teuthology.orchestra.run.smithi097.stdout:(89/286): guava-30.1-6.el9.noarch.rpm 3.5 MB/s | 2.3 MB 00:00 2024-09-14T10:41:52.979 INFO:teuthology.orchestra.run.smithi097.stdout:(90/286): hicolor-icon-theme-0.17-13.el9.noarch 1.8 MB/s | 219 kB 00:00 2024-09-14T10:41:53.096 INFO:teuthology.orchestra.run.smithi097.stdout:(91/286): httpcomponents-client-4.5.13-3.el9.no 5.5 MB/s | 657 kB 00:00 2024-09-14T10:41:53.221 INFO:teuthology.orchestra.run.smithi097.stdout:(92/286): httpcomponents-core-4.4.13-7.el9.noar 4.9 MB/s | 632 kB 00:00 2024-09-14T10:41:53.525 INFO:teuthology.orchestra.run.smithi152.stdout:(1/286): ceph-19.3.0-4907.ga2782315.el9.x86_64. 50 kB/s | 6.6 kB 00:00 2024-09-14T10:41:53.880 INFO:teuthology.orchestra.run.smithi097.stdout:(93/286): gstreamer1-plugins-base-1.22.1-2.el9. 680 kB/s | 2.2 MB 00:03 2024-09-14T10:41:53.996 INFO:teuthology.orchestra.run.smithi097.stdout:(94/286): jakarta-annotations-1.3.5-13.el9.noar 387 kB/s | 45 kB 00:00 2024-09-14T10:41:54.055 INFO:teuthology.orchestra.run.smithi097.stdout:(95/286): iso-codes-4.6.0-3.el9.noarch.rpm 4.2 MB/s | 3.5 MB 00:00 2024-09-14T10:41:54.172 INFO:teuthology.orchestra.run.smithi097.stdout:(96/286): java-11-openjdk-11.0.20.1.1-2.el9.x86 3.5 MB/s | 413 kB 00:00 2024-09-14T10:41:54.197 INFO:teuthology.orchestra.run.smithi097.stdout:(97/286): jansi-2.3.3-6.el9.x86_64.rpm 547 kB/s | 110 kB 00:00 2024-09-14T10:41:54.200 INFO:teuthology.orchestra.run.smithi152.stdout:(2/286): ceph-fuse-19.3.0-4907.ga2782315.el9.x8 1.3 MB/s | 900 kB 00:00 2024-09-14T10:41:54.284 INFO:teuthology.orchestra.run.smithi152.stdout:(3/286): ceph-immutable-object-cache-19.3.0-490 1.7 MB/s | 145 kB 00:00 2024-09-14T10:41:54.792 INFO:teuthology.orchestra.run.smithi152.stdout:(4/286): ceph-mds-19.3.0-4907.ga2782315.el9.x86 4.7 MB/s | 2.4 MB 00:00 2024-09-14T10:41:54.839 INFO:teuthology.orchestra.run.smithi097.stdout:(98/286): java-11-openjdk-devel-11.0.20.1.1-2.e 5.0 MB/s | 3.3 MB 00:00 2024-09-14T10:41:54.909 INFO:teuthology.orchestra.run.smithi152.stdout:(5/286): ceph-base-19.3.0-4907.ga2782315.el9.x8 3.6 MB/s | 5.5 MB 00:01 2024-09-14T10:41:54.948 INFO:teuthology.orchestra.run.smithi097.stdout:(99/286): javapackages-filesystem-6.0.0-4.el9.n 120 kB/s | 13 kB 00:00 2024-09-14T10:41:55.043 INFO:teuthology.orchestra.run.smithi152.stdout:(6/286): ceph-mgr-19.3.0-4907.ga2782315.el9.x86 6.1 MB/s | 1.5 MB 00:00 2024-09-14T10:41:55.056 INFO:teuthology.orchestra.run.smithi097.stdout:(100/286): jbigkit-libs-2.1-23.el9.x86_64.rpm 489 kB/s | 53 kB 00:00 2024-09-14T10:41:55.165 INFO:teuthology.orchestra.run.smithi097.stdout:(101/286): jcl-over-slf4j-1.7.30-13.el9.noarch. 221 kB/s | 24 kB 00:00 2024-09-14T10:41:55.282 INFO:teuthology.orchestra.run.smithi097.stdout:(102/286): jsoup-1.13.1-10.el9.noarch.rpm 3.2 MB/s | 377 kB 00:00 2024-09-14T10:41:55.310 INFO:teuthology.orchestra.run.smithi152.stdout:(7/286): ceph-mon-19.3.0-4907.ga2782315.el9.x86 12 MB/s | 4.8 MB 00:00 2024-09-14T10:41:55.383 INFO:teuthology.orchestra.run.smithi097.stdout:(103/286): jsr-305-3.0.2-6.el9.noarch.rpm 354 kB/s | 35 kB 00:00 2024-09-14T10:41:55.500 INFO:teuthology.orchestra.run.smithi097.stdout:(104/286): lcms2-2.12-3.el9.x86_64.rpm 1.4 MB/s | 168 kB 00:00 2024-09-14T10:41:55.608 INFO:teuthology.orchestra.run.smithi097.stdout:(105/286): libX11-xcb-1.7.0-9.el9.x86_64.rpm 102 kB/s | 11 kB 00:00 2024-09-14T10:41:55.717 INFO:teuthology.orchestra.run.smithi097.stdout:(106/286): libXcomposite-0.4.5-7.el9.x86_64.rpm 223 kB/s | 24 kB 00:00 2024-09-14T10:41:55.825 INFO:teuthology.orchestra.run.smithi097.stdout:(107/286): libXcursor-1.2.0-7.el9.x86_64.rpm 284 kB/s | 31 kB 00:00 2024-09-14T10:41:55.934 INFO:teuthology.orchestra.run.smithi097.stdout:(108/286): libXdamage-1.1.5-7.el9.x86_64.rpm 211 kB/s | 23 kB 00:00 2024-09-14T10:41:55.968 INFO:teuthology.orchestra.run.smithi152.stdout:(8/286): ceph-common-19.3.0-4907.ga2782315.el9. 8.4 MB/s | 22 MB 00:02 2024-09-14T10:41:56.018 INFO:teuthology.orchestra.run.smithi152.stdout:(9/286): ceph-selinux-19.3.0-4907.ga2782315.el9 506 kB/s | 25 kB 00:00 2024-09-14T10:41:56.043 INFO:teuthology.orchestra.run.smithi097.stdout:(109/286): libXfixes-5.0.3-16.el9.x86_64.rpm 182 kB/s | 20 kB 00:00 2024-09-14T10:41:56.144 INFO:teuthology.orchestra.run.smithi152.stdout:(10/286): ceph-radosgw-19.3.0-4907.ga2782315.el 13 MB/s | 11 MB 00:00 2024-09-14T10:41:56.160 INFO:teuthology.orchestra.run.smithi097.stdout:(110/286): libXi-1.7.10-8.el9.x86_64.rpm 339 kB/s | 40 kB 00:00 2024-09-14T10:41:56.202 INFO:teuthology.orchestra.run.smithi152.stdout:(11/286): libcephfs-devel-19.3.0-4907.ga2782315 546 kB/s | 32 kB 00:00 2024-09-14T10:41:56.277 INFO:teuthology.orchestra.run.smithi097.stdout:(111/286): libXinerama-1.1.4-10.el9.x86_64.rpm 129 kB/s | 15 kB 00:00 2024-09-14T10:41:56.385 INFO:teuthology.orchestra.run.smithi097.stdout:(112/286): libXrandr-1.5.2-8.el9.x86_64.rpm 263 kB/s | 28 kB 00:00 2024-09-14T10:41:56.402 INFO:teuthology.orchestra.run.smithi152.stdout:(12/286): ceph-osd-19.3.0-4907.ga2782315.el9.x8 13 MB/s | 17 MB 00:01 2024-09-14T10:41:56.454 INFO:teuthology.orchestra.run.smithi152.stdout:(13/286): libcephfs2-19.3.0-4907.ga2782315.el9. 2.9 MB/s | 756 kB 00:00 2024-09-14T10:41:56.478 INFO:teuthology.orchestra.run.smithi152.stdout:(14/286): libcephsqlite-19.3.0-4907.ga2782315.e 2.1 MB/s | 161 kB 00:00 2024-09-14T10:41:56.503 INFO:teuthology.orchestra.run.smithi152.stdout:(15/286): librados-devel-19.3.0-4907.ga2782315. 2.5 MB/s | 127 kB 00:00 2024-09-14T10:41:56.519 INFO:teuthology.orchestra.run.smithi097.stdout:(113/286): libXtst-1.2.3-16.el9.x86_64.rpm 161 kB/s | 21 kB 00:00 2024-09-14T10:41:56.537 INFO:teuthology.orchestra.run.smithi152.stdout:(16/286): libradosstriper1-19.3.0-4907.ga278231 8.5 MB/s | 508 kB 00:00 2024-09-14T10:41:56.595 INFO:teuthology.orchestra.run.smithi152.stdout:(17/286): python3-ceph-argparse-19.3.0-4907.ga2 777 kB/s | 45 kB 00:00 2024-09-14T10:41:56.636 INFO:teuthology.orchestra.run.smithi097.stdout:(114/286): libXv-1.0.11-16.el9.x86_64.rpm 164 kB/s | 19 kB 00:00 2024-09-14T10:41:56.679 INFO:teuthology.orchestra.run.smithi152.stdout:(18/286): python3-ceph-common-19.3.0-4907.ga278 1.7 MB/s | 143 kB 00:00 2024-09-14T10:41:56.754 INFO:teuthology.orchestra.run.smithi152.stdout:(19/286): python3-cephfs-19.3.0-4907.ga2782315. 2.1 MB/s | 161 kB 00:00 2024-09-14T10:41:56.761 INFO:teuthology.orchestra.run.smithi097.stdout:(115/286): libXxf86vm-1.1.4-18.el9.x86_64.rpm 150 kB/s | 19 kB 00:00 2024-09-14T10:41:56.838 INFO:teuthology.orchestra.run.smithi152.stdout:(20/286): librgw2-19.3.0-4907.ga2782315.el9.x86 17 MB/s | 5.5 MB 00:00 2024-09-14T10:41:56.863 INFO:teuthology.orchestra.run.smithi152.stdout:(21/286): python3-rados-19.3.0-4907.ga2782315.e 2.9 MB/s | 320 kB 00:00 2024-09-14T10:41:56.895 INFO:teuthology.orchestra.run.smithi097.stdout:(116/286): libasyncns-0.8-22.el9.x86_64.rpm 228 kB/s | 30 kB 00:00 2024-09-14T10:41:56.897 INFO:teuthology.orchestra.run.smithi152.stdout:(22/286): python3-rbd-19.3.0-4907.ga2782315.el9 5.1 MB/s | 305 kB 00:00 2024-09-14T10:41:56.930 INFO:teuthology.orchestra.run.smithi152.stdout:(23/286): python3-rgw-19.3.0-4907.ga2782315.el9 1.5 MB/s | 99 kB 00:00 2024-09-14T10:41:56.956 INFO:teuthology.orchestra.run.smithi152.stdout:(24/286): rbd-fuse-19.3.0-4907.ga2782315.el9.x8 1.4 MB/s | 85 kB 00:00 2024-09-14T10:41:57.014 INFO:teuthology.orchestra.run.smithi152.stdout:(25/286): rbd-nbd-19.3.0-4907.ga2782315.el9.x86 2.9 MB/s | 171 kB 00:00 2024-09-14T10:41:57.020 INFO:teuthology.orchestra.run.smithi097.stdout:(117/286): libcanberra-0.30-27.el9.x86_64.rpm 691 kB/s | 86 kB 00:00 2024-09-14T10:41:57.081 INFO:teuthology.orchestra.run.smithi152.stdout:(26/286): rbd-mirror-19.3.0-4907.ga2782315.el9. 21 MB/s | 3.2 MB 00:00 2024-09-14T10:41:57.106 INFO:teuthology.orchestra.run.smithi152.stdout:(27/286): ceph-grafana-dashboards-19.3.0-4907.g 374 kB/s | 34 kB 00:00 2024-09-14T10:41:57.140 INFO:teuthology.orchestra.run.smithi152.stdout:(28/286): ceph-mgr-cephadm-19.3.0-4907.ga278231 2.6 MB/s | 154 kB 00:00 2024-09-14T10:41:57.179 INFO:teuthology.orchestra.run.smithi097.stdout:(118/286): adwaita-icon-theme-40.1.1-3.el9.noar 955 kB/s | 12 MB 00:12 2024-09-14T10:41:57.204 INFO:teuthology.orchestra.run.smithi097.stdout:(119/286): libcanberra-gtk3-0.30-27.el9.x86_64. 173 kB/s | 32 kB 00:00 2024-09-14T10:41:57.296 INFO:teuthology.orchestra.run.smithi097.stdout:(120/286): libdrm-2.4.121-1.el9.x86_64.rpm 1.3 MB/s | 161 kB 00:00 2024-09-14T10:41:57.321 INFO:teuthology.orchestra.run.smithi097.stdout:(121/286): libepoxy-1.5.5-4.el9.x86_64.rpm 2.0 MB/s | 241 kB 00:00 2024-09-14T10:41:57.447 INFO:teuthology.orchestra.run.smithi097.stdout:(122/286): libexif-0.6.22-6.el9.x86_64.rpm 2.8 MB/s | 435 kB 00:00 2024-09-14T10:41:57.472 INFO:teuthology.orchestra.run.smithi097.stdout:(123/286): libfontenc-1.1.3-17.el9.x86_64.rpm 206 kB/s | 31 kB 00:00 2024-09-14T10:41:57.606 INFO:teuthology.orchestra.run.smithi097.stdout:(124/286): libgexiv2-0.12.3-1.el9.x86_64.rpm 521 kB/s | 83 kB 00:00 2024-09-14T10:41:57.639 INFO:teuthology.orchestra.run.smithi097.stdout:(125/286): libglvnd-1.3.4-1.el9.x86_64.rpm 810 kB/s | 135 kB 00:00 2024-09-14T10:41:57.657 INFO:teuthology.orchestra.run.smithi152.stdout:(29/286): ceph-mgr-diskprediction-local-19.3.0- 14 MB/s | 7.4 MB 00:00 2024-09-14T10:41:57.731 INFO:teuthology.orchestra.run.smithi097.stdout:(126/286): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 293 kB/s | 37 kB 00:00 2024-09-14T10:41:57.732 INFO:teuthology.orchestra.run.smithi152.stdout:(30/286): ceph-mgr-modules-core-19.3.0-4907.ga2 3.8 MB/s | 291 kB 00:00 2024-09-14T10:41:57.757 INFO:teuthology.orchestra.run.smithi097.stdout:(127/286): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 1.2 MB/s | 142 kB 00:00 2024-09-14T10:41:57.791 INFO:teuthology.orchestra.run.smithi152.stdout:(31/286): ceph-mgr-rook-19.3.0-4907.ga2782315.e 848 kB/s | 49 kB 00:00 2024-09-14T10:41:57.873 INFO:teuthology.orchestra.run.smithi097.stdout:(128/286): libgsf-1.14.47-5.el9.x86_64.rpm 1.8 MB/s | 256 kB 00:00 2024-09-14T10:41:57.899 INFO:teuthology.orchestra.run.smithi097.stdout:(129/286): libgxps-0.3.2-3.el9.x86_64.rpm 555 kB/s | 79 kB 00:00 2024-09-14T10:41:57.950 INFO:teuthology.orchestra.run.smithi152.stdout:(32/286): ceph-mgr-dashboard-19.3.0-4907.ga2782 17 MB/s | 14 MB 00:00 2024-09-14T10:41:57.966 INFO:teuthology.orchestra.run.smithi152.stdout:(33/286): ceph-prometheus-alerts-19.3.0-4907.ga 94 kB/s | 16 kB 00:00 2024-09-14T10:41:58.000 INFO:teuthology.orchestra.run.smithi152.stdout:(34/286): ceph-volume-19.3.0-4907.ga2782315.el9 5.6 MB/s | 285 kB 00:00 2024-09-14T10:41:58.008 INFO:teuthology.orchestra.run.smithi097.stdout:(130/286): libiptcdata-1.0.5-10.el9.x86_64.rpm 457 kB/s | 61 kB 00:00 2024-09-14T10:41:58.033 INFO:teuthology.orchestra.run.smithi097.stdout:(131/286): libldac-2.0.2.3-10.el9.x86_64.rpm 309 kB/s | 41 kB 00:00 2024-09-14T10:41:58.042 INFO:teuthology.orchestra.run.smithi152.stdout:(35/286): cephadm-19.3.0-4907.ga2782315.el9.noa 10 MB/s | 784 kB 00:00 2024-09-14T10:41:58.133 INFO:teuthology.orchestra.run.smithi097.stdout:(132/286): libnbd-1.20.2-2.el9.x86_64.rpm 1.3 MB/s | 171 kB 00:00 2024-09-14T10:41:58.158 INFO:teuthology.orchestra.run.smithi097.stdout:(133/286): libnotify-0.7.9-8.el9.x86_64.rpm 348 kB/s | 44 kB 00:00 2024-09-14T10:41:58.159 INFO:teuthology.orchestra.run.smithi152.stdout:(36/286): ModemManager-glib-1.20.2-1.el9.x86_64 2.1 MB/s | 335 kB 00:00 2024-09-14T10:41:58.184 INFO:teuthology.orchestra.run.smithi152.stdout:(37/286): bluez-libs-5.56-6.el9.x86_64.rpm 596 kB/s | 85 kB 00:00 2024-09-14T10:41:58.226 INFO:teuthology.orchestra.run.smithi152.stdout:(38/286): bubblewrap-0.4.1-7.el9.x86_64.rpm 740 kB/s | 49 kB 00:00 2024-09-14T10:41:58.242 INFO:teuthology.orchestra.run.smithi097.stdout:(134/286): libogg-1.3.4-6.el9.x86_64.rpm 309 kB/s | 34 kB 00:00 2024-09-14T10:41:58.276 INFO:teuthology.orchestra.run.smithi097.stdout:(135/286): libosinfo-1.10.0-1.el9.x86_64.rpm 2.7 MB/s | 319 kB 00:00 2024-09-14T10:41:58.277 INFO:teuthology.orchestra.run.smithi152.stdout:(39/286): cups-libs-2.3.3op2-30.el9.x86_64.rpm 2.8 MB/s | 262 kB 00:00 2024-09-14T10:41:58.302 INFO:teuthology.orchestra.run.smithi152.stdout:(40/286): fuse-2.9.9-16.el9.x86_64.rpm 1.0 MB/s | 80 kB 00:00 2024-09-14T10:41:58.359 INFO:teuthology.orchestra.run.smithi097.stdout:(136/286): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-09-14T10:41:58.385 INFO:teuthology.orchestra.run.smithi097.stdout:(137/286): librabbitmq-0.11.0-7.el9.x86_64.rpm 416 kB/s | 45 kB 00:00 2024-09-14T10:41:58.552 INFO:teuthology.orchestra.run.smithi097.stdout:(138/286): librdkafka-1.6.1-102.el9.x86_64.rpm 3.4 MB/s | 662 kB 00:00 2024-09-14T10:41:58.577 INFO:teuthology.orchestra.run.smithi097.stdout:(139/286): libsbc-1.4-9.el9.x86_64.rpm 233 kB/s | 45 kB 00:00 2024-09-14T10:41:58.694 INFO:teuthology.orchestra.run.smithi097.stdout:(140/286): libsndfile-1.0.31-8.el9.x86_64.rpm 1.4 MB/s | 206 kB 00:00 2024-09-14T10:41:58.719 INFO:teuthology.orchestra.run.smithi097.stdout:(141/286): libtheora-1.1.1-31.el9.x86_64.rpm 1.1 MB/s | 164 kB 00:00 2024-09-14T10:41:58.744 INFO:teuthology.orchestra.run.smithi152.stdout:(41/286): ceph-test-19.3.0-4907.ga2782315.el9.x 18 MB/s | 50 MB 00:02 2024-09-14T10:41:58.769 INFO:teuthology.orchestra.run.smithi152.stdout:(42/286): libpciaccess-0.16-7.el9.x86_64.rpm 58 kB/s | 27 kB 00:00 2024-09-14T10:41:58.811 INFO:teuthology.orchestra.run.smithi152.stdout:(43/286): libgfortran-11.5.0-2.el9.x86_64.rpm 1.5 MB/s | 801 kB 00:00 2024-09-14T10:41:58.812 INFO:teuthology.orchestra.run.smithi097.stdout:(142/286): libtiff-4.4.0-13.el9.x86_64.rpm 1.7 MB/s | 198 kB 00:00 2024-09-14T10:41:58.836 INFO:teuthology.orchestra.run.smithi152.stdout:(44/286): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.4 MB/s | 94 kB 00:00 2024-09-14T10:41:58.845 INFO:teuthology.orchestra.run.smithi097.stdout:(143/286): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 284 kB/s | 36 kB 00:00 2024-09-14T10:41:58.886 INFO:teuthology.orchestra.run.smithi152.stdout:(45/286): libquadmath-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 191 kB 00:00 2024-09-14T10:41:58.912 INFO:teuthology.orchestra.run.smithi152.stdout:(46/286): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.5 MB/s | 253 kB 00:00 2024-09-14T10:41:58.945 INFO:teuthology.orchestra.run.smithi097.stdout:(144/286): libtracker-sparql-3.1.2-3.el9.x86_64 2.4 MB/s | 324 kB 00:00 2024-09-14T10:41:58.946 INFO:teuthology.orchestra.run.smithi152.stdout:(47/286): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.2 MB 00:00 2024-09-14T10:41:58.971 INFO:teuthology.orchestra.run.smithi097.stdout:(145/286): libvisual-0.4.0-34.el9.x86_64.rpm 1.1 MB/s | 144 kB 00:00 2024-09-14T10:41:58.971 INFO:teuthology.orchestra.run.smithi152.stdout:(48/286): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 106 kB 00:00 2024-09-14T10:41:59.004 INFO:teuthology.orchestra.run.smithi152.stdout:(49/286): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 135 kB 00:00 2024-09-14T10:41:59.030 INFO:teuthology.orchestra.run.smithi152.stdout:(50/286): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-09-14T10:41:59.063 INFO:teuthology.orchestra.run.smithi152.stdout:(51/286): python3-urllib3-1.26.5-6.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-09-14T10:41:59.071 INFO:teuthology.orchestra.run.smithi097.stdout:(146/286): libvorbis-1.3.7-5.el9.x86_64.rpm 1.5 MB/s | 193 kB 00:00 2024-09-14T10:41:59.096 INFO:teuthology.orchestra.run.smithi097.stdout:(147/286): libwayland-client-1.21.0-1.el9.x86_6 266 kB/s | 33 kB 00:00 2024-09-14T10:41:59.189 INFO:teuthology.orchestra.run.smithi097.stdout:(148/286): libwayland-cursor-1.21.0-1.el9.x86_6 166 kB/s | 19 kB 00:00 2024-09-14T10:41:59.238 INFO:teuthology.orchestra.run.smithi097.stdout:(149/286): libwayland-egl-1.21.0-1.el9.x86_64.r 90 kB/s | 13 kB 00:00 2024-09-14T10:41:59.247 INFO:teuthology.orchestra.run.smithi152.stdout:(52/286): adwaita-cursor-theme-40.1.1-3.el9.noa 2.6 MB/s | 650 kB 00:00 2024-09-14T10:41:59.297 INFO:teuthology.orchestra.run.smithi152.stdout:(53/286): alsa-lib-1.2.12-1.el9.x86_64.rpm 2.2 MB/s | 523 kB 00:00 2024-09-14T10:41:59.314 INFO:teuthology.orchestra.run.smithi097.stdout:(150/286): libwayland-server-1.21.0-1.el9.x86_6 333 kB/s | 42 kB 00:00 2024-09-14T10:41:59.322 INFO:teuthology.orchestra.run.smithi152.stdout:(54/286): apache-commons-cli-1.4-17.el9.noarch. 942 kB/s | 71 kB 00:00 2024-09-14T10:41:59.356 INFO:teuthology.orchestra.run.smithi152.stdout:(55/286): apache-commons-codec-1.15-7.el9.noarc 5.0 MB/s | 302 kB 00:00 2024-09-14T10:41:59.364 INFO:teuthology.orchestra.run.smithi097.stdout:(151/286): libwebp-1.2.0-8.el9.x86_64.rpm 2.2 MB/s | 277 kB 00:00 2024-09-14T10:41:59.415 INFO:teuthology.orchestra.run.smithi152.stdout:(56/286): apache-commons-io-2.8.0-8.el9.noarch. 3.0 MB/s | 283 kB 00:00 2024-09-14T10:41:59.440 INFO:teuthology.orchestra.run.smithi152.stdout:(57/286): apache-commons-lang3-3.12.0-6.el9.noa 6.5 MB/s | 559 kB 00:00 2024-09-14T10:41:59.456 INFO:teuthology.orchestra.run.smithi097.stdout:(152/286): libxkbcommon-1.0.3-4.el9.x86_64.rpm 940 kB/s | 133 kB 00:00 2024-09-14T10:41:59.490 INFO:teuthology.orchestra.run.smithi152.stdout:(58/286): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 1.1 MB/s | 87 kB 00:00 2024-09-14T10:41:59.498 INFO:teuthology.orchestra.run.smithi097.stdout:(153/286): libxshmfence-1.3-10.el9.x86_64.rpm 94 kB/s | 13 kB 00:00 2024-09-14T10:41:59.524 INFO:teuthology.orchestra.run.smithi152.stdout:(59/286): at-spi2-core-2.40.3-1.el9.x86_64.rpm 2.3 MB/s | 195 kB 00:00 2024-09-14T10:41:59.582 INFO:teuthology.orchestra.run.smithi152.stdout:(60/286): atinject-1.0.3-6.el9.noarch.rpm 253 kB/s | 23 kB 00:00 2024-09-14T10:41:59.590 INFO:teuthology.orchestra.run.smithi097.stdout:(154/286): low-memory-monitor-2.1-4.el9.x86_64. 268 kB/s | 36 kB 00:00 2024-09-14T10:41:59.616 INFO:teuthology.orchestra.run.smithi152.stdout:(61/286): atk-2.36.0-5.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-09-14T10:41:59.643 INFO:teuthology.orchestra.run.smithi097.stdout:(155/286): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.0 MB/s | 292 kB 00:00 2024-09-14T10:41:59.719 INFO:teuthology.orchestra.run.smithi097.stdout:(156/286): lua-5.4.4-4.el9.x86_64.rpm 1.4 MB/s | 188 kB 00:00 2024-09-14T10:41:59.750 INFO:teuthology.orchestra.run.smithi152.stdout:(62/286): adwaita-icon-theme-40.1.1-3.el9.noarc 17 MB/s | 12 MB 00:00 2024-09-14T10:41:59.776 INFO:teuthology.orchestra.run.smithi152.stdout:(63/286): avahi-glib-0.8-21.el9.x86_64.rpm 77 kB/s | 15 kB 00:00 2024-09-14T10:41:59.777 INFO:teuthology.orchestra.run.smithi097.stdout:(157/286): lua-posix-35.0-8.el9.x86_64.rpm 1.1 MB/s | 151 kB 00:00 2024-09-14T10:41:59.800 INFO:teuthology.orchestra.run.smithi152.stdout:(64/286): cdi-api-2.0.2-6.el9.noarch.rpm 1.0 MB/s | 53 kB 00:00 2024-09-14T10:41:59.826 INFO:teuthology.orchestra.run.smithi152.stdout:(65/286): boost-program-options-1.75.0-8.el9.x8 511 kB/s | 107 kB 00:00 2024-09-14T10:41:59.827 INFO:teuthology.orchestra.run.smithi097.stdout:(158/286): maven-3.6.3-15.el9.noarch.rpm 163 kB/s | 18 kB 00:00 2024-09-14T10:41:59.851 INFO:teuthology.orchestra.run.smithi152.stdout:(66/286): composefs-libs-1.0.5-1.el9.x86_64.rpm 1.2 MB/s | 61 kB 00:00 2024-09-14T10:41:59.868 INFO:teuthology.orchestra.run.smithi152.stdout:(67/286): copy-jdk-configs-4.0-3.el9.noarch.rpm 673 kB/s | 28 kB 00:00 2024-09-14T10:41:59.893 INFO:teuthology.orchestra.run.smithi152.stdout:(68/286): colord-libs-1.4.5-4.el9.x86_64.rpm 1.9 MB/s | 229 kB 00:00 2024-09-14T10:41:59.918 INFO:teuthology.orchestra.run.smithi152.stdout:(69/286): dconf-0.40.0-6.el9.x86_64.rpm 1.6 MB/s | 113 kB 00:00 2024-09-14T10:41:59.953 INFO:teuthology.orchestra.run.smithi097.stdout:(159/286): maven-openjdk11-3.6.3-15.el9.noarch. 72 kB/s | 9.0 kB 00:00 2024-09-14T10:41:59.960 INFO:teuthology.orchestra.run.smithi152.stdout:(70/286): exempi-2.6.0-0.2.20211007gite23c213.e 5.6 MB/s | 525 kB 00:00 2024-09-14T10:42:00.002 INFO:teuthology.orchestra.run.smithi152.stdout:(71/286): exiv2-0.27.5-2.el9.x86_64.rpm 8.8 MB/s | 980 kB 00:00 2024-09-14T10:42:00.036 INFO:teuthology.orchestra.run.smithi152.stdout:(72/286): exiv2-libs-0.27.5-2.el9.x86_64.rpm 6.5 MB/s | 781 kB 00:00 2024-09-14T10:42:00.061 INFO:teuthology.orchestra.run.smithi152.stdout:(73/286): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 3.2 MB/s | 325 kB 00:00 2024-09-14T10:42:00.078 INFO:teuthology.orchestra.run.smithi097.stdout:(160/286): maven-resolver-1.6.1-10.el9.noarch.r 4.0 MB/s | 517 kB 00:00 2024-09-14T10:42:00.086 INFO:teuthology.orchestra.run.smithi152.stdout:(74/286): flac-libs-1.3.3-12.el9.x86_64.rpm 2.5 MB/s | 218 kB 00:00 2024-09-14T10:42:00.111 INFO:teuthology.orchestra.run.smithi152.stdout:(75/286): flatpak-selinux-1.12.9-1.el9.noarch.r 431 kB/s | 22 kB 00:00 2024-09-14T10:42:00.120 INFO:teuthology.orchestra.run.smithi097.stdout:(161/286): maven-lib-3.6.3-15.el9.noarch.rpm 4.3 MB/s | 1.5 MB 00:00 2024-09-14T10:42:00.137 INFO:teuthology.orchestra.run.smithi152.stdout:(76/286): flatpak-session-helper-1.12.9-1.el9.x 1.4 MB/s | 73 kB 00:00 2024-09-14T10:42:00.162 INFO:teuthology.orchestra.run.smithi152.stdout:(77/286): flexiblas-3.0.4-8.el9.x86_64.rpm 649 kB/s | 33 kB 00:00 2024-09-14T10:42:00.204 INFO:teuthology.orchestra.run.smithi152.stdout:(78/286): flatpak-1.12.9-1.el9.x86_64.rpm 10 MB/s | 1.7 MB 00:00 2024-09-14T10:42:00.229 INFO:teuthology.orchestra.run.smithi097.stdout:(162/286): maven-shared-utils-3.3.4-3.el9.noarc 1.0 MB/s | 151 kB 00:00 2024-09-14T10:42:00.229 INFO:teuthology.orchestra.run.smithi152.stdout:(79/286): flexiblas-openblas-openmp-3.0.4-8.el9 272 kB/s | 18 kB 00:00 2024-09-14T10:42:00.270 INFO:teuthology.orchestra.run.smithi097.stdout:(163/286): maven-wagon-3.4.2-7.el9.noarch.rpm 748 kB/s | 112 kB 00:00 2024-09-14T10:42:00.304 INFO:teuthology.orchestra.run.smithi152.stdout:(80/286): flexiblas-netlib-3.0.4-8.el9.x86_64.r 18 MB/s | 3.0 MB 00:00 2024-09-14T10:42:00.338 INFO:teuthology.orchestra.run.smithi152.stdout:(81/286): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 666 kB/s | 89 kB 00:00 2024-09-14T10:42:00.363 INFO:teuthology.orchestra.run.smithi152.stdout:(82/286): geoclue2-2.6.0-7.el9.x86_64.rpm 932 kB/s | 124 kB 00:00 2024-09-14T10:42:00.389 INFO:teuthology.orchestra.run.smithi152.stdout:(83/286): giflib-5.2.1-9.el9.x86_64.rpm 580 kB/s | 49 kB 00:00 2024-09-14T10:42:00.414 INFO:teuthology.orchestra.run.smithi152.stdout:(84/286): google-guice-4.2.3-9.el9.noarch.rpm 6.1 MB/s | 473 kB 00:00 2024-09-14T10:42:00.421 INFO:teuthology.orchestra.run.smithi097.stdout:(164/286): mesa-filesystem-24.1.2-3.el9.x86_64. 75 kB/s | 11 kB 00:00 2024-09-14T10:42:00.439 INFO:teuthology.orchestra.run.smithi152.stdout:(85/286): graphene-1.10.6-2.el9.x86_64.rpm 852 kB/s | 64 kB 00:00 2024-09-14T10:42:00.464 INFO:teuthology.orchestra.run.smithi152.stdout:(86/286): gsm-1.0.19-6.el9.x86_64.rpm 452 kB/s | 34 kB 00:00 2024-09-14T10:42:00.531 INFO:teuthology.orchestra.run.smithi152.stdout:(87/286): gtk-update-icon-cache-3.24.31-5.el9.x 495 kB/s | 33 kB 00:00 2024-09-14T10:42:00.563 INFO:teuthology.orchestra.run.smithi097.stdout:(165/286): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 978 kB/s | 139 kB 00:00 2024-09-14T10:42:00.590 INFO:teuthology.orchestra.run.smithi152.stdout:(88/286): gstreamer1-1.22.1-2.el9.x86_64.rpm 8.1 MB/s | 1.4 MB 00:00 2024-09-14T10:42:00.713 INFO:teuthology.orchestra.run.smithi097.stdout:(166/286): mesa-libGL-24.1.2-3.el9.x86_64.rpm 1.1 MB/s | 171 kB 00:00 2024-09-14T10:42:00.732 INFO:teuthology.orchestra.run.smithi152.stdout:(89/286): gstreamer1-plugins-base-1.22.1-2.el9. 7.7 MB/s | 2.2 MB 00:00 2024-09-14T10:42:00.807 INFO:teuthology.orchestra.run.smithi152.stdout:(90/286): guava-30.1-6.el9.noarch.rpm 11 MB/s | 2.3 MB 00:00 2024-09-14T10:42:00.830 INFO:teuthology.orchestra.run.smithi097.stdout:(167/286): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 310 kB/s | 36 kB 00:00 2024-09-14T10:42:00.874 INFO:teuthology.orchestra.run.smithi152.stdout:(91/286): gtk3-3.24.31-5.el9.x86_64.rpm 14 MB/s | 4.9 MB 00:00 2024-09-14T10:42:00.899 INFO:teuthology.orchestra.run.smithi152.stdout:(92/286): hicolor-icon-theme-0.17-13.el9.noarch 1.3 MB/s | 219 kB 00:00 2024-09-14T10:42:00.933 INFO:teuthology.orchestra.run.smithi152.stdout:(93/286): httpcomponents-client-4.5.13-3.el9.no 5.1 MB/s | 657 kB 00:00 2024-09-14T10:42:00.958 INFO:teuthology.orchestra.run.smithi152.stdout:(94/286): httpcomponents-core-4.4.13-7.el9.noar 7.4 MB/s | 632 kB 00:00 2024-09-14T10:42:00.972 INFO:teuthology.orchestra.run.smithi097.stdout:(168/286): mesa-libglapi-24.1.2-3.el9.x86_64.rp 324 kB/s | 46 kB 00:00 2024-09-14T10:42:00.983 INFO:teuthology.orchestra.run.smithi152.stdout:(95/286): jakarta-annotations-1.3.5-13.el9.noar 897 kB/s | 45 kB 00:00 2024-09-14T10:42:01.009 INFO:teuthology.orchestra.run.smithi152.stdout:(96/286): jansi-2.3.3-6.el9.x86_64.rpm 2.1 MB/s | 110 kB 00:00 2024-09-14T10:42:01.034 INFO:teuthology.orchestra.run.smithi152.stdout:(97/286): java-11-openjdk-11.0.20.1.1-2.el9.x86 8.1 MB/s | 413 kB 00:00 2024-09-14T10:42:01.114 INFO:teuthology.orchestra.run.smithi097.stdout:(169/286): mkfontscale-1.2.1-3.el9.x86_64.rpm 227 kB/s | 32 kB 00:00 2024-09-14T10:42:01.134 INFO:teuthology.orchestra.run.smithi152.stdout:(98/286): java-11-openjdk-devel-11.0.20.1.1-2.e 27 MB/s | 3.3 MB 00:00 2024-09-14T10:42:01.209 INFO:teuthology.orchestra.run.smithi152.stdout:(99/286): iso-codes-4.6.0-3.el9.noarch.rpm 11 MB/s | 3.5 MB 00:00 2024-09-14T10:42:01.214 INFO:teuthology.orchestra.run.smithi097.stdout:(170/286): mesa-dri-drivers-24.1.2-3.el9.x86_64 8.9 MB/s | 8.8 MB 00:00 2024-09-14T10:42:01.226 INFO:teuthology.orchestra.run.smithi152.stdout:(100/286): javapackages-filesystem-6.0.0-4.el9. 142 kB/s | 13 kB 00:00 2024-09-14T10:42:01.241 INFO:teuthology.orchestra.run.smithi097.stdout:(171/286): openblas-0.3.26-2.el9.x86_64.rpm 307 kB/s | 38 kB 00:00 2024-09-14T10:42:01.251 INFO:teuthology.orchestra.run.smithi152.stdout:(101/286): jbigkit-libs-2.1-23.el9.x86_64.rpm 1.2 MB/s | 53 kB 00:00 2024-09-14T10:42:01.269 INFO:teuthology.orchestra.run.smithi152.stdout:(102/286): jcl-over-slf4j-1.7.30-13.el9.noarch. 572 kB/s | 24 kB 00:00 2024-09-14T10:42:01.311 INFO:teuthology.orchestra.run.smithi152.stdout:(103/286): jsoup-1.13.1-10.el9.noarch.rpm 6.3 MB/s | 377 kB 00:00 2024-09-14T10:42:01.336 INFO:teuthology.orchestra.run.smithi152.stdout:(104/286): jsr-305-3.0.2-6.el9.noarch.rpm 531 kB/s | 35 kB 00:00 2024-09-14T10:42:01.377 INFO:teuthology.orchestra.run.smithi152.stdout:(105/286): lcms2-2.12-3.el9.x86_64.rpm 2.5 MB/s | 168 kB 00:00 2024-09-14T10:42:01.381 INFO:teuthology.orchestra.run.smithi097.stdout:(172/286): openjpeg2-2.4.0-7.el9.x86_64.rpm 1.1 MB/s | 163 kB 00:00 2024-09-14T10:42:01.394 INFO:teuthology.orchestra.run.smithi152.stdout:(106/286): libX11-xcb-1.7.0-9.el9.x86_64.rpm 189 kB/s | 11 kB 00:00 2024-09-14T10:42:01.411 INFO:teuthology.orchestra.run.smithi152.stdout:(107/286): libXcomposite-0.4.5-7.el9.x86_64.rpm 720 kB/s | 24 kB 00:00 2024-09-14T10:42:01.428 INFO:teuthology.orchestra.run.smithi152.stdout:(108/286): libXcursor-1.2.0-7.el9.x86_64.rpm 914 kB/s | 31 kB 00:00 2024-09-14T10:42:01.462 INFO:teuthology.orchestra.run.smithi152.stdout:(109/286): libXdamage-1.1.5-7.el9.x86_64.rpm 453 kB/s | 23 kB 00:00 2024-09-14T10:42:01.479 INFO:teuthology.orchestra.run.smithi152.stdout:(110/286): libXfixes-5.0.3-16.el9.x86_64.rpm 393 kB/s | 20 kB 00:00 2024-09-14T10:42:01.504 INFO:teuthology.orchestra.run.smithi152.stdout:(111/286): libXi-1.7.10-8.el9.x86_64.rpm 945 kB/s | 40 kB 00:00 2024-09-14T10:42:01.521 INFO:teuthology.orchestra.run.smithi152.stdout:(112/286): libXinerama-1.1.4-10.el9.x86_64.rpm 359 kB/s | 15 kB 00:00 2024-09-14T10:42:01.523 INFO:teuthology.orchestra.run.smithi097.stdout:(173/286): opus-1.3.1-10.el9.x86_64.rpm 1.4 MB/s | 200 kB 00:00 2024-09-14T10:42:01.546 INFO:teuthology.orchestra.run.smithi152.stdout:(113/286): libXrandr-1.5.2-8.el9.x86_64.rpm 680 kB/s | 28 kB 00:00 2024-09-14T10:42:01.563 INFO:teuthology.orchestra.run.smithi152.stdout:(114/286): libXtst-1.2.3-16.el9.x86_64.rpm 513 kB/s | 21 kB 00:00 2024-09-14T10:42:01.588 INFO:teuthology.orchestra.run.smithi152.stdout:(115/286): libXv-1.0.11-16.el9.x86_64.rpm 456 kB/s | 19 kB 00:00 2024-09-14T10:42:01.614 INFO:teuthology.orchestra.run.smithi152.stdout:(116/286): libXxf86vm-1.1.4-18.el9.x86_64.rpm 373 kB/s | 19 kB 00:00 2024-09-14T10:42:01.632 INFO:teuthology.orchestra.run.smithi097.stdout:(174/286): openblas-openmp-0.3.26-2.el9.x86_64. 12 MB/s | 4.9 MB 00:00 2024-09-14T10:42:01.639 INFO:teuthology.orchestra.run.smithi152.stdout:(117/286): libasyncns-0.8-22.el9.x86_64.rpm 606 kB/s | 30 kB 00:00 2024-09-14T10:42:01.664 INFO:teuthology.orchestra.run.smithi152.stdout:(118/286): libcanberra-0.30-27.el9.x86_64.rpm 1.7 MB/s | 86 kB 00:00 2024-09-14T10:42:01.666 INFO:teuthology.orchestra.run.smithi097.stdout:(175/286): orc-0.4.31-8.el9.x86_64.rpm 1.3 MB/s | 183 kB 00:00 2024-09-14T10:42:01.690 INFO:teuthology.orchestra.run.smithi152.stdout:(119/286): libcanberra-gtk3-0.30-27.el9.x86_64. 632 kB/s | 32 kB 00:00 2024-09-14T10:42:01.715 INFO:teuthology.orchestra.run.smithi152.stdout:(120/286): libdrm-2.4.121-1.el9.x86_64.rpm 3.1 MB/s | 161 kB 00:00 2024-09-14T10:42:01.749 INFO:teuthology.orchestra.run.smithi152.stdout:(121/286): libepoxy-1.5.5-4.el9.x86_64.rpm 4.0 MB/s | 241 kB 00:00 2024-09-14T10:42:01.758 INFO:teuthology.orchestra.run.smithi097.stdout:(176/286): osinfo-db-20240701-2.el9.noarch.rpm 4.1 MB/s | 531 kB 00:00 2024-09-14T10:42:01.774 INFO:teuthology.orchestra.run.smithi152.stdout:(122/286): libexif-0.6.22-6.el9.x86_64.rpm 7.2 MB/s | 435 kB 00:00 2024-09-14T10:42:01.783 INFO:teuthology.orchestra.run.smithi097.stdout:(177/286): osinfo-db-tools-1.10.0-1.el9.x86_64. 630 kB/s | 74 kB 00:00 2024-09-14T10:42:01.799 INFO:teuthology.orchestra.run.smithi152.stdout:(123/286): libfontenc-1.1.3-17.el9.x86_64.rpm 614 kB/s | 31 kB 00:00 2024-09-14T10:42:01.825 INFO:teuthology.orchestra.run.smithi152.stdout:(124/286): libgexiv2-0.12.3-1.el9.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2024-09-14T10:42:01.852 INFO:teuthology.orchestra.run.smithi152.stdout:(125/286): libglvnd-1.3.4-1.el9.x86_64.rpm 2.6 MB/s | 135 kB 00:00 2024-09-14T10:42:01.867 INFO:teuthology.orchestra.run.smithi152.stdout:(126/286): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 879 kB/s | 37 kB 00:00 2024-09-14T10:42:01.892 INFO:teuthology.orchestra.run.smithi097.stdout:(178/286): ostree-libs-2024.7-2.el9.x86_64.rpm 3.4 MB/s | 468 kB 00:00 2024-09-14T10:42:01.892 INFO:teuthology.orchestra.run.smithi152.stdout:(127/286): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 3.3 MB/s | 142 kB 00:00 2024-09-14T10:42:01.917 INFO:teuthology.orchestra.run.smithi097.stdout:(179/286): p11-kit-server-0.25.3-2.el9.x86_64.r 1.8 MB/s | 246 kB 00:00 2024-09-14T10:42:01.918 INFO:teuthology.orchestra.run.smithi152.stdout:(128/286): libgsf-1.14.47-5.el9.x86_64.rpm 5.0 MB/s | 256 kB 00:00 2024-09-14T10:42:01.942 INFO:teuthology.orchestra.run.smithi152.stdout:(129/286): libgxps-0.3.2-3.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2024-09-14T10:42:01.968 INFO:teuthology.orchestra.run.smithi152.stdout:(130/286): libiptcdata-1.0.5-10.el9.x86_64.rpm 1.2 MB/s | 61 kB 00:00 2024-09-14T10:42:01.993 INFO:teuthology.orchestra.run.smithi152.stdout:(131/286): libldac-2.0.2.3-10.el9.x86_64.rpm 822 kB/s | 41 kB 00:00 2024-09-14T10:42:02.009 INFO:teuthology.orchestra.run.smithi097.stdout:(180/286): pipewire-1.0.1-1.el9.x86_64.rpm 910 kB/s | 107 kB 00:00 2024-09-14T10:42:02.018 INFO:teuthology.orchestra.run.smithi152.stdout:(132/286): libnbd-1.20.2-2.el9.x86_64.rpm 3.3 MB/s | 171 kB 00:00 2024-09-14T10:42:02.035 INFO:teuthology.orchestra.run.smithi097.stdout:(181/286): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 489 kB/s | 57 kB 00:00 2024-09-14T10:42:02.044 INFO:teuthology.orchestra.run.smithi152.stdout:(133/286): libnotify-0.7.9-8.el9.x86_64.rpm 867 kB/s | 44 kB 00:00 2024-09-14T10:42:02.069 INFO:teuthology.orchestra.run.smithi152.stdout:(134/286): libogg-1.3.4-6.el9.x86_64.rpm 669 kB/s | 34 kB 00:00 2024-09-14T10:42:02.095 INFO:teuthology.orchestra.run.smithi152.stdout:(135/286): libosinfo-1.10.0-1.el9.x86_64.rpm 6.2 MB/s | 319 kB 00:00 2024-09-14T10:42:02.118 INFO:teuthology.orchestra.run.smithi097.stdout:(182/286): pipewire-jack-audio-connection-kit-1 84 kB/s | 9.1 kB 00:00 2024-09-14T10:42:02.119 INFO:teuthology.orchestra.run.smithi152.stdout:(136/286): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-14T10:42:02.144 INFO:teuthology.orchestra.run.smithi097.stdout:(183/286): pipewire-jack-audio-connection-kit-l 1.2 MB/s | 135 kB 00:00 2024-09-14T10:42:02.145 INFO:teuthology.orchestra.run.smithi152.stdout:(137/286): librabbitmq-0.11.0-7.el9.x86_64.rpm 902 kB/s | 45 kB 00:00 2024-09-14T10:42:02.187 INFO:teuthology.orchestra.run.smithi152.stdout:(138/286): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-09-14T10:42:02.212 INFO:teuthology.orchestra.run.smithi152.stdout:(139/286): libsbc-1.4-9.el9.x86_64.rpm 670 kB/s | 45 kB 00:00 2024-09-14T10:42:02.237 INFO:teuthology.orchestra.run.smithi152.stdout:(140/286): libsndfile-1.0.31-8.el9.x86_64.rpm 4.0 MB/s | 206 kB 00:00 2024-09-14T10:42:02.279 INFO:teuthology.orchestra.run.smithi152.stdout:(141/286): libtheora-1.1.1-31.el9.x86_64.rpm 2.4 MB/s | 164 kB 00:00 2024-09-14T10:42:02.285 INFO:teuthology.orchestra.run.smithi097.stdout:(184/286): pipewire-pulseaudio-1.0.1-1.el9.x86_ 1.3 MB/s | 192 kB 00:00 2024-09-14T10:42:02.305 INFO:teuthology.orchestra.run.smithi152.stdout:(142/286): libtiff-4.4.0-13.el9.x86_64.rpm 2.9 MB/s | 198 kB 00:00 2024-09-14T10:42:02.355 INFO:teuthology.orchestra.run.smithi152.stdout:(143/286): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 472 kB/s | 36 kB 00:00 2024-09-14T10:42:02.380 INFO:teuthology.orchestra.run.smithi152.stdout:(144/286): libtracker-sparql-3.1.2-3.el9.x86_64 4.2 MB/s | 324 kB 00:00 2024-09-14T10:42:02.402 INFO:teuthology.orchestra.run.smithi097.stdout:(185/286): pipewire-libs-1.0.1-1.el9.x86_64.rpm 6.8 MB/s | 1.9 MB 00:00 2024-09-14T10:42:02.414 INFO:teuthology.orchestra.run.smithi152.stdout:(145/286): libvisual-0.4.0-34.el9.x86_64.rpm 2.4 MB/s | 144 kB 00:00 2024-09-14T10:42:02.428 INFO:teuthology.orchestra.run.smithi097.stdout:(186/286): plexus-cipher-1.7-27.el9.noarch.rpm 182 kB/s | 26 kB 00:00 2024-09-14T10:42:02.439 INFO:teuthology.orchestra.run.smithi152.stdout:(146/286): libvorbis-1.3.7-5.el9.x86_64.rpm 3.2 MB/s | 193 kB 00:00 2024-09-14T10:42:02.465 INFO:teuthology.orchestra.run.smithi152.stdout:(147/286): libwayland-client-1.21.0-1.el9.x86_6 663 kB/s | 33 kB 00:00 2024-09-14T10:42:02.488 INFO:teuthology.orchestra.run.smithi152.stdout:(148/286): libwayland-cursor-1.21.0-1.el9.x86_6 398 kB/s | 19 kB 00:00 2024-09-14T10:42:02.513 INFO:teuthology.orchestra.run.smithi152.stdout:(149/286): libwayland-egl-1.21.0-1.el9.x86_64.r 263 kB/s | 13 kB 00:00 2024-09-14T10:42:02.519 INFO:teuthology.orchestra.run.smithi097.stdout:(187/286): plexus-classworlds-2.6.0-11.el9.noar 513 kB/s | 60 kB 00:00 2024-09-14T10:42:02.539 INFO:teuthology.orchestra.run.smithi152.stdout:(150/286): libwayland-server-1.21.0-1.el9.x86_6 835 kB/s | 42 kB 00:00 2024-09-14T10:42:02.545 INFO:teuthology.orchestra.run.smithi097.stdout:(188/286): plexus-containers-component-annotati 157 kB/s | 18 kB 00:00 2024-09-14T10:42:02.572 INFO:teuthology.orchestra.run.smithi152.stdout:(151/286): libwebp-1.2.0-8.el9.x86_64.rpm 4.6 MB/s | 277 kB 00:00 2024-09-14T10:42:02.597 INFO:teuthology.orchestra.run.smithi152.stdout:(152/286): libxkbcommon-1.0.3-4.el9.x86_64.rpm 2.2 MB/s | 133 kB 00:00 2024-09-14T10:42:02.623 INFO:teuthology.orchestra.run.smithi152.stdout:(153/286): libxshmfence-1.3-10.el9.x86_64.rpm 251 kB/s | 13 kB 00:00 2024-09-14T10:42:02.628 INFO:teuthology.orchestra.run.smithi097.stdout:(189/286): plexus-interpolation-1.26-11.el9.noa 733 kB/s | 80 kB 00:00 2024-09-14T10:42:02.648 INFO:teuthology.orchestra.run.smithi152.stdout:(154/286): low-memory-monitor-2.1-4.el9.x86_64. 714 kB/s | 36 kB 00:00 2024-09-14T10:42:02.654 INFO:teuthology.orchestra.run.smithi097.stdout:(190/286): plexus-sec-dispatcher-1.4-37.el9.noa 309 kB/s | 34 kB 00:00 2024-09-14T10:42:02.673 INFO:teuthology.orchestra.run.smithi152.stdout:(155/286): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-14T10:42:02.719 INFO:teuthology.orchestra.run.smithi152.stdout:(156/286): lua-5.4.4-4.el9.x86_64.rpm 2.6 MB/s | 188 kB 00:00 2024-09-14T10:42:02.749 INFO:teuthology.orchestra.run.smithi152.stdout:(157/286): lua-posix-35.0-8.el9.x86_64.rpm 2.0 MB/s | 151 kB 00:00 2024-09-14T10:42:02.754 INFO:teuthology.orchestra.run.smithi097.stdout:(191/286): plexus-utils-3.3.0-10.el9.noarch.rpm 2.0 MB/s | 254 kB 00:00 2024-09-14T10:42:02.774 INFO:teuthology.orchestra.run.smithi152.stdout:(158/286): maven-3.6.3-15.el9.noarch.rpm 325 kB/s | 18 kB 00:00 2024-09-14T10:42:02.816 INFO:teuthology.orchestra.run.smithi152.stdout:(159/286): maven-openjdk11-3.6.3-15.el9.noarch. 216 kB/s | 9.0 kB 00:00 2024-09-14T10:42:02.880 INFO:teuthology.orchestra.run.smithi097.stdout:(192/286): poppler-21.01.0-21.el9.x86_64.rpm 4.7 MB/s | 1.1 MB 00:00 2024-09-14T10:42:03.005 INFO:teuthology.orchestra.run.smithi097.stdout:(193/286): poppler-data-0.4.9-9.el9.noarch.rpm 7.5 MB/s | 1.9 MB 00:00 2024-09-14T10:42:03.030 INFO:teuthology.orchestra.run.smithi097.stdout:(194/286): poppler-glib-21.01.0-21.el9.x86_64.r 1.0 MB/s | 152 kB 00:00 2024-09-14T10:42:03.139 INFO:teuthology.orchestra.run.smithi097.stdout:(195/286): protobuf-3.14.0-13.el9.x86_64.rpm 7.6 MB/s | 1.0 MB 00:00 2024-09-14T10:42:03.166 INFO:teuthology.orchestra.run.smithi152.stdout:(160/286): java-11-openjdk-headless-11.0.20.1.1 18 MB/s | 39 MB 00:02 2024-09-14T10:42:03.172 INFO:teuthology.orchestra.run.smithi097.stdout:(196/286): publicsuffix-list-20210518-3.el9.noa 582 kB/s | 83 kB 00:00 2024-09-14T10:42:03.208 INFO:teuthology.orchestra.run.smithi152.stdout:(161/286): maven-lib-3.6.3-15.el9.noarch.rpm 3.2 MB/s | 1.5 MB 00:00 2024-09-14T10:42:03.242 INFO:teuthology.orchestra.run.smithi152.stdout:(162/286): maven-resolver-1.6.1-10.el9.noarch.r 1.2 MB/s | 517 kB 00:00 2024-09-14T10:42:03.267 INFO:teuthology.orchestra.run.smithi152.stdout:(163/286): maven-shared-utils-3.3.4-3.el9.noarc 1.5 MB/s | 151 kB 00:00 2024-09-14T10:42:03.272 INFO:teuthology.orchestra.run.smithi097.stdout:(197/286): pulseaudio-libs-15.0-2.el9.x86_64.rp 5.0 MB/s | 679 kB 00:00 2024-09-14T10:42:03.309 INFO:teuthology.orchestra.run.smithi152.stdout:(164/286): maven-wagon-3.4.2-7.el9.noarch.rpm 1.1 MB/s | 112 kB 00:00 2024-09-14T10:42:03.335 INFO:teuthology.orchestra.run.smithi152.stdout:(165/286): mesa-filesystem-24.1.2-3.el9.x86_64. 168 kB/s | 11 kB 00:00 2024-09-14T10:42:03.360 INFO:teuthology.orchestra.run.smithi152.stdout:(166/286): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 2.7 MB/s | 139 kB 00:00 2024-09-14T10:42:03.385 INFO:teuthology.orchestra.run.smithi152.stdout:(167/286): mesa-libGL-24.1.2-3.el9.x86_64.rpm 3.3 MB/s | 171 kB 00:00 2024-09-14T10:42:03.390 INFO:teuthology.orchestra.run.smithi097.stdout:(198/286): python3-devel-3.9.19-8.el9.x86_64.rp 2.0 MB/s | 245 kB 00:00 2024-09-14T10:42:03.410 INFO:teuthology.orchestra.run.smithi152.stdout:(168/286): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 721 kB/s | 36 kB 00:00 2024-09-14T10:42:03.435 INFO:teuthology.orchestra.run.smithi152.stdout:(169/286): mesa-libglapi-24.1.2-3.el9.x86_64.rp 918 kB/s | 46 kB 00:00 2024-09-14T10:42:03.461 INFO:teuthology.orchestra.run.smithi152.stdout:(170/286): mkfontscale-1.2.1-3.el9.x86_64.rpm 642 kB/s | 32 kB 00:00 2024-09-14T10:42:03.477 INFO:teuthology.orchestra.run.smithi152.stdout:(171/286): openblas-0.3.26-2.el9.x86_64.rpm 922 kB/s | 38 kB 00:00 2024-09-14T10:42:03.515 INFO:teuthology.orchestra.run.smithi097.stdout:(199/286): python3-jinja2-2.11.3-6.el9.noarch.r 1.9 MB/s | 248 kB 00:00 2024-09-14T10:42:03.528 INFO:teuthology.orchestra.run.smithi152.stdout:(172/286): openjpeg2-2.4.0-7.el9.x86_64.rpm 3.2 MB/s | 163 kB 00:00 2024-09-14T10:42:03.578 INFO:teuthology.orchestra.run.smithi152.stdout:(173/286): opus-1.3.1-10.el9.x86_64.rpm 3.9 MB/s | 200 kB 00:00 2024-09-14T10:42:03.678 INFO:teuthology.orchestra.run.smithi152.stdout:(174/286): mesa-dri-drivers-24.1.2-3.el9.x86_64 20 MB/s | 8.8 MB 00:00 2024-09-14T10:42:03.745 INFO:teuthology.orchestra.run.smithi152.stdout:(175/286): openblas-openmp-0.3.26-2.el9.x86_64. 17 MB/s | 4.9 MB 00:00 2024-09-14T10:42:03.757 INFO:teuthology.orchestra.run.smithi097.stdout:(200/286): python3-jsonpatch-1.21-16.el9.noarch 106 kB/s | 26 kB 00:00 2024-09-14T10:42:03.771 INFO:teuthology.orchestra.run.smithi152.stdout:(176/286): orc-0.4.31-8.el9.x86_64.rpm 956 kB/s | 183 kB 00:00 2024-09-14T10:42:03.796 INFO:teuthology.orchestra.run.smithi152.stdout:(177/286): osinfo-db-tools-1.10.0-1.el9.x86_64. 1.4 MB/s | 74 kB 00:00 2024-09-14T10:42:03.821 INFO:teuthology.orchestra.run.smithi152.stdout:(178/286): osinfo-db-20240701-2.el9.noarch.rpm 3.6 MB/s | 531 kB 00:00 2024-09-14T10:42:03.846 INFO:teuthology.orchestra.run.smithi152.stdout:(179/286): p11-kit-server-0.25.3-2.el9.x86_64.r 4.8 MB/s | 246 kB 00:00 2024-09-14T10:42:03.866 INFO:teuthology.orchestra.run.smithi097.stdout:(201/286): python3-jsonpointer-2.0-4.el9.noarch 177 kB/s | 19 kB 00:00 2024-09-14T10:42:03.881 INFO:teuthology.orchestra.run.smithi152.stdout:(180/286): ostree-libs-2024.7-2.el9.x86_64.rpm 4.2 MB/s | 468 kB 00:00 2024-09-14T10:42:03.905 INFO:teuthology.orchestra.run.smithi152.stdout:(181/286): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 978 kB/s | 57 kB 00:00 2024-09-14T10:42:03.939 INFO:teuthology.orchestra.run.smithi152.stdout:(182/286): pipewire-jack-audio-connection-kit-1 156 kB/s | 9.1 kB 00:00 2024-09-14T10:42:03.965 INFO:teuthology.orchestra.run.smithi152.stdout:(183/286): pipewire-1.0.1-1.el9.x86_64.rpm 748 kB/s | 107 kB 00:00 2024-09-14T10:42:03.990 INFO:teuthology.orchestra.run.smithi152.stdout:(184/286): pipewire-jack-audio-connection-kit-l 1.6 MB/s | 135 kB 00:00 2024-09-14T10:42:03.991 INFO:teuthology.orchestra.run.smithi097.stdout:(202/286): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-14T10:42:04.032 INFO:teuthology.orchestra.run.smithi152.stdout:(185/286): pipewire-libs-1.0.1-1.el9.x86_64.rpm 21 MB/s | 1.9 MB 00:00 2024-09-14T10:42:04.057 INFO:teuthology.orchestra.run.smithi152.stdout:(186/286): plexus-cipher-1.7-27.el9.noarch.rpm 387 kB/s | 26 kB 00:00 2024-09-14T10:42:04.082 INFO:teuthology.orchestra.run.smithi152.stdout:(187/286): plexus-classworlds-2.6.0-11.el9.noar 1.2 MB/s | 60 kB 00:00 2024-09-14T10:42:04.099 INFO:teuthology.orchestra.run.smithi097.stdout:(203/286): python3-markupsafe-1.1.1-12.el9.x86_ 321 kB/s | 35 kB 00:00 2024-09-14T10:42:04.109 INFO:teuthology.orchestra.run.smithi152.stdout:(188/286): plexus-containers-component-annotati 367 kB/s | 18 kB 00:00 2024-09-14T10:42:04.132 INFO:teuthology.orchestra.run.smithi152.stdout:(189/286): pipewire-pulseaudio-1.0.1-1.el9.x86_ 1.1 MB/s | 192 kB 00:00 2024-09-14T10:42:04.157 INFO:teuthology.orchestra.run.smithi152.stdout:(190/286): plexus-interpolation-1.26-11.el9.noa 1.0 MB/s | 80 kB 00:00 2024-09-14T10:42:04.183 INFO:teuthology.orchestra.run.smithi152.stdout:(191/286): plexus-sec-dispatcher-1.4-37.el9.noa 446 kB/s | 34 kB 00:00 2024-09-14T10:42:04.208 INFO:teuthology.orchestra.run.smithi152.stdout:(192/286): plexus-utils-3.3.0-10.el9.noarch.rpm 5.0 MB/s | 254 kB 00:00 2024-09-14T10:42:04.275 INFO:teuthology.orchestra.run.smithi152.stdout:(193/286): poppler-data-0.4.9-9.el9.noarch.rpm 20 MB/s | 1.9 MB 00:00 2024-09-14T10:42:04.309 INFO:teuthology.orchestra.run.smithi152.stdout:(194/286): poppler-21.01.0-21.el9.x86_64.rpm 7.0 MB/s | 1.1 MB 00:00 2024-09-14T10:42:04.334 INFO:teuthology.orchestra.run.smithi152.stdout:(195/286): poppler-glib-21.01.0-21.el9.x86_64.r 1.2 MB/s | 152 kB 00:00 2024-09-14T10:42:04.358 INFO:teuthology.orchestra.run.smithi097.stdout:(204/286): python3-babel-2.9.1-2.el9.noarch.rpm 5.0 MB/s | 6.0 MB 00:01 2024-09-14T10:42:04.359 INFO:teuthology.orchestra.run.smithi152.stdout:(196/286): publicsuffix-list-20210518-3.el9.noa 1.6 MB/s | 83 kB 00:00 2024-09-14T10:42:04.393 INFO:teuthology.orchestra.run.smithi152.stdout:(197/286): pulseaudio-libs-15.0-2.el9.x86_64.rp 11 MB/s | 679 kB 00:00 2024-09-14T10:42:04.427 INFO:teuthology.orchestra.run.smithi152.stdout:(198/286): protobuf-3.14.0-13.el9.x86_64.rpm 6.7 MB/s | 1.0 MB 00:00 2024-09-14T10:42:04.460 INFO:teuthology.orchestra.run.smithi152.stdout:(199/286): python3-devel-3.9.19-8.el9.x86_64.rp 3.6 MB/s | 245 kB 00:00 2024-09-14T10:42:04.485 INFO:teuthology.orchestra.run.smithi152.stdout:(200/286): python3-jinja2-2.11.3-6.el9.noarch.r 4.2 MB/s | 248 kB 00:00 2024-09-14T10:42:04.511 INFO:teuthology.orchestra.run.smithi152.stdout:(201/286): python3-jsonpatch-1.21-16.el9.noarch 511 kB/s | 26 kB 00:00 2024-09-14T10:42:04.521 INFO:teuthology.orchestra.run.smithi097.stdout:(205/286): python3-numpy-1.20.1-5.el9.x86_64.rp 12 MB/s | 5.1 MB 00:00 2024-09-14T10:42:04.536 INFO:teuthology.orchestra.run.smithi152.stdout:(202/286): python3-jsonpointer-2.0-4.el9.noarch 381 kB/s | 19 kB 00:00 2024-09-14T10:42:04.542 INFO:teuthology.orchestra.run.smithi097.stdout:(206/286): python3-numpy-f2py-1.20.1-5.el9.x86_ 1.3 MB/s | 250 kB 00:00 2024-09-14T10:42:04.561 INFO:teuthology.orchestra.run.smithi152.stdout:(203/286): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-14T10:42:04.586 INFO:teuthology.orchestra.run.smithi152.stdout:(204/286): python3-markupsafe-1.1.1-12.el9.x86_ 694 kB/s | 35 kB 00:00 2024-09-14T10:42:04.645 INFO:teuthology.orchestra.run.smithi152.stdout:(205/286): python3-numpy-f2py-1.20.1-5.el9.x86_ 4.2 MB/s | 250 kB 00:00 2024-09-14T10:42:04.659 INFO:teuthology.orchestra.run.smithi097.stdout:(207/286): python3-oauthlib-3.1.1-5.el9.noarch. 1.5 MB/s | 222 kB 00:00 2024-09-14T10:42:04.685 INFO:teuthology.orchestra.run.smithi097.stdout:(208/286): python3-packaging-20.9-5.el9.noarch. 544 kB/s | 77 kB 00:00 2024-09-14T10:42:04.696 INFO:teuthology.orchestra.run.smithi152.stdout:(206/286): python3-oauthlib-3.1.1-5.el9.noarch. 4.4 MB/s | 222 kB 00:00 2024-09-14T10:42:04.762 INFO:teuthology.orchestra.run.smithi152.stdout:(207/286): python3-numpy-1.20.1-5.el9.x86_64.rp 25 MB/s | 5.1 MB 00:00 2024-09-14T10:42:04.785 INFO:teuthology.orchestra.run.smithi097.stdout:(209/286): python3-prettytable-0.7.2-27.el9.noa 337 kB/s | 42 kB 00:00 2024-09-14T10:42:04.787 INFO:teuthology.orchestra.run.smithi152.stdout:(208/286): python3-packaging-20.9-5.el9.noarch. 842 kB/s | 77 kB 00:00 2024-09-14T10:42:04.813 INFO:teuthology.orchestra.run.smithi152.stdout:(209/286): python3-prettytable-0.7.2-27.el9.noa 842 kB/s | 42 kB 00:00 2024-09-14T10:42:04.818 INFO:teuthology.orchestra.run.smithi097.stdout:(210/286): python3-protobuf-3.14.0-13.el9.noarc 2.0 MB/s | 269 kB 00:00 2024-09-14T10:42:04.838 INFO:teuthology.orchestra.run.smithi152.stdout:(210/286): python3-protobuf-3.14.0-13.el9.noarc 5.2 MB/s | 269 kB 00:00 2024-09-14T10:42:04.902 INFO:teuthology.orchestra.run.smithi097.stdout:(211/286): python3-pyasn1-0.4.8-6.el9.noarch.rp 1.3 MB/s | 159 kB 00:00 2024-09-14T10:42:04.913 INFO:teuthology.orchestra.run.smithi152.stdout:(211/286): python3-babel-2.9.1-2.el9.noarch.rpm 11 MB/s | 6.0 MB 00:00 2024-09-14T10:42:04.939 INFO:teuthology.orchestra.run.smithi152.stdout:(212/286): python3-pyasn1-0.4.8-6.el9.noarch.rp 1.2 MB/s | 159 kB 00:00 2024-09-14T10:42:04.944 INFO:teuthology.orchestra.run.smithi097.stdout:(212/286): python3-pyasn1-modules-0.4.8-6.el9.n 2.2 MB/s | 279 kB 00:00 2024-09-14T10:42:04.964 INFO:teuthology.orchestra.run.smithi152.stdout:(213/286): python3-pyasn1-modules-0.4.8-6.el9.n 2.2 MB/s | 279 kB 00:00 2024-09-14T10:42:04.989 INFO:teuthology.orchestra.run.smithi152.stdout:(214/286): python3-pytz-2021.1-5.el9.noarch.rpm 675 kB/s | 51 kB 00:00 2024-09-14T10:42:05.014 INFO:teuthology.orchestra.run.smithi152.stdout:(215/286): python3-requests-oauthlib-1.3.0-12.e 713 kB/s | 54 kB 00:00 2024-09-14T10:42:05.036 INFO:teuthology.orchestra.run.smithi097.stdout:(213/286): python3-pytz-2021.1-5.el9.noarch.rpm 381 kB/s | 51 kB 00:00 2024-09-14T10:42:05.048 INFO:teuthology.orchestra.run.smithi152.stdout:(216/286): python3-toml-0.10.2-6.el9.noarch.rpm 712 kB/s | 42 kB 00:00 2024-09-14T10:42:05.073 INFO:teuthology.orchestra.run.smithi152.stdout:(217/286): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-14T10:42:05.078 INFO:teuthology.orchestra.run.smithi097.stdout:(214/286): python3-requests-oauthlib-1.3.0-12.e 401 kB/s | 54 kB 00:00 2024-09-14T10:42:05.115 INFO:teuthology.orchestra.run.smithi152.stdout:(218/286): qatlib-service-24.02.0-1.el9.x86_64. 538 kB/s | 36 kB 00:00 2024-09-14T10:42:05.148 INFO:teuthology.orchestra.run.smithi152.stdout:(219/286): qatzip-libs-1.2.0-1.el9.x86_64.rpm 630 kB/s | 47 kB 00:00 2024-09-14T10:42:05.240 INFO:teuthology.orchestra.run.smithi152.stdout:(220/286): sisu-0.3.4-10.el9.noarch.rpm 5.4 MB/s | 510 kB 00:00 2024-09-14T10:42:05.291 INFO:teuthology.orchestra.run.smithi152.stdout:(221/286): slf4j-1.7.30-13.el9.noarch.rpm 1.3 MB/s | 69 kB 00:00 2024-09-14T10:42:05.341 INFO:teuthology.orchestra.run.smithi152.stdout:(222/286): socat-1.7.4.1-6.el9.x86_64.rpm 6.0 MB/s | 304 kB 00:00 2024-09-14T10:42:05.399 INFO:teuthology.orchestra.run.smithi152.stdout:(223/286): sound-theme-freedesktop-0.8-17.el9.n 6.4 MB/s | 383 kB 00:00 2024-09-14T10:42:05.558 INFO:teuthology.orchestra.run.smithi152.stdout:(224/286): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-09-14T10:42:05.583 INFO:teuthology.orchestra.run.smithi152.stdout:(225/286): rtkit-0.11-29.el9.x86_64.rpm 120 kB/s | 56 kB 00:00 2024-09-14T10:42:05.617 INFO:teuthology.orchestra.run.smithi152.stdout:(226/286): totem-pl-parser-3.26.6-2.el9.x86_64. 701 kB/s | 152 kB 00:00 2024-09-14T10:42:05.642 INFO:teuthology.orchestra.run.smithi152.stdout:(227/286): tracker-3.1.2-3.el9.x86_64.rpm 6.5 MB/s | 555 kB 00:00 2024-09-14T10:42:05.668 INFO:teuthology.orchestra.run.smithi152.stdout:(228/286): ttmkfdir-3.0.9-65.el9.x86_64.rpm 1.0 MB/s | 53 kB 00:00 2024-09-14T10:42:05.693 INFO:teuthology.orchestra.run.smithi152.stdout:(229/286): tzdata-java-2024a-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-14T10:42:05.719 INFO:teuthology.orchestra.run.smithi152.stdout:(230/286): upower-0.99.11-11.el9.x86_64.rpm 3.4 MB/s | 173 kB 00:00 2024-09-14T10:42:05.752 INFO:teuthology.orchestra.run.smithi152.stdout:(231/286): tracker-miners-3.1.2-4.el9.x86_64.rp 5.5 MB/s | 944 kB 00:00 2024-09-14T10:42:05.777 INFO:teuthology.orchestra.run.smithi152.stdout:(232/286): wireplumber-0.4.14-1.el9.x86_64.rpm 1.6 MB/s | 96 kB 00:00 2024-09-14T10:42:05.802 INFO:teuthology.orchestra.run.smithi152.stdout:(233/286): webrtc-audio-processing-0.3.1-8.el9. 2.7 MB/s | 306 kB 00:00 2024-09-14T10:42:05.828 INFO:teuthology.orchestra.run.smithi152.stdout:(234/286): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 846 kB/s | 42 kB 00:00 2024-09-14T10:42:05.870 INFO:teuthology.orchestra.run.smithi152.stdout:(235/286): wireplumber-libs-0.4.14-1.el9.x86_64 3.0 MB/s | 358 kB 00:00 2024-09-14T10:42:05.895 INFO:teuthology.orchestra.run.smithi152.stdout:(236/286): xdg-desktop-portal-gtk-1.12.0-3.el9. 2.0 MB/s | 134 kB 00:00 2024-09-14T10:42:05.920 INFO:teuthology.orchestra.run.smithi152.stdout:(237/286): xdg-desktop-portal-1.12.6-1.el9.x86_ 3.2 MB/s | 385 kB 00:00 2024-09-14T10:42:05.945 INFO:teuthology.orchestra.run.smithi152.stdout:(238/286): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-14T10:42:05.971 INFO:teuthology.orchestra.run.smithi152.stdout:(239/286): xorg-x11-fonts-Type1-7.5-33.el9.noar 9.8 MB/s | 505 kB 00:00 2024-09-14T10:42:05.996 INFO:teuthology.orchestra.run.smithi152.stdout:(240/286): xkeyboard-config-2.33-2.el9.noarch.r 6.7 MB/s | 859 kB 00:00 2024-09-14T10:42:06.037 INFO:teuthology.orchestra.run.smithi097.stdout:(215/286): python3-toml-0.10.2-6.el9.noarch.rpm 43 kB/s | 42 kB 00:00 2024-09-14T10:42:06.038 INFO:teuthology.orchestra.run.smithi152.stdout:(241/286): lua-devel-5.4.4-4.el9.x86_64.rpm 242 kB/s | 22 kB 00:00 2024-09-14T10:42:06.096 INFO:teuthology.orchestra.run.smithi152.stdout:(242/286): abseil-cpp-20211102.0-3.el9.x86_64.r 5.3 MB/s | 548 kB 00:00 2024-09-14T10:42:06.122 INFO:teuthology.orchestra.run.smithi152.stdout:(243/286): grpc-data-1.46.7-10.el9.noarch.rpm 793 kB/s | 19 kB 00:00 2024-09-14T10:42:06.157 INFO:teuthology.orchestra.run.smithi152.stdout:(244/286): gperftools-libs-2.9.1-3.el9.x86_64.r 2.6 MB/s | 308 kB 00:00 2024-09-14T10:42:06.181 INFO:teuthology.orchestra.run.smithi152.stdout:(245/286): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-14T10:42:06.195 INFO:teuthology.orchestra.run.smithi097.stdout:(216/286): python3-scipy-1.6.2-8.el9.x86_64.rpm 14 MB/s | 16 MB 00:01 2024-09-14T10:42:06.206 INFO:teuthology.orchestra.run.smithi152.stdout:(246/286): protobuf-compiler-3.14.0-13.el9.x86_ 3.6 MB/s | 863 kB 00:00 2024-09-14T10:42:06.221 INFO:teuthology.orchestra.run.smithi097.stdout:(217/286): qatlib-24.02.0-1.el9.x86_64.rpm 1.2 MB/s | 221 kB 00:00 2024-09-14T10:42:06.232 INFO:teuthology.orchestra.run.smithi152.stdout:(247/286): liboath-2.6.7-2.el9.x86_64.rpm 969 kB/s | 49 kB 00:00 2024-09-14T10:42:06.273 INFO:teuthology.orchestra.run.smithi152.stdout:(248/286): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-09-14T10:42:06.307 INFO:teuthology.orchestra.run.smithi152.stdout:(249/286): libunwind-1.6.2-1.el9.x86_64.rpm 671 kB/s | 67 kB 00:00 2024-09-14T10:42:06.312 INFO:teuthology.orchestra.run.smithi097.stdout:(218/286): qatlib-service-24.02.0-1.el9.x86_64. 308 kB/s | 36 kB 00:00 2024-09-14T10:42:06.338 INFO:teuthology.orchestra.run.smithi097.stdout:(219/286): qatzip-libs-1.2.0-1.el9.x86_64.rpm 405 kB/s | 47 kB 00:00 2024-09-14T10:42:06.348 INFO:teuthology.orchestra.run.smithi152.stdout:(250/286): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-14T10:42:06.382 INFO:teuthology.orchestra.run.smithi152.stdout:(251/286): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.7 MB/s | 839 kB 00:00 2024-09-14T10:42:06.399 INFO:teuthology.orchestra.run.smithi152.stdout:(252/286): python3-bcrypt-3.2.2-1.el9.x86_64.rp 867 kB/s | 43 kB 00:00 2024-09-14T10:42:06.416 INFO:teuthology.orchestra.run.smithi152.stdout:(253/286): python3-cachetools-4.2.4-1.el9.noarc 969 kB/s | 32 kB 00:00 2024-09-14T10:42:06.421 INFO:teuthology.orchestra.run.smithi097.stdout:(220/286): rtkit-0.11-29.el9.x86_64.rpm 515 kB/s | 56 kB 00:00 2024-09-14T10:42:06.433 INFO:teuthology.orchestra.run.smithi152.stdout:(254/286): python3-certifi-2023.05.07-4.el9.noa 423 kB/s | 14 kB 00:00 2024-09-14T10:42:06.463 INFO:teuthology.orchestra.run.smithi097.stdout:(221/286): sisu-0.3.4-10.el9.noarch.rpm 4.0 MB/s | 510 kB 00:00 2024-09-14T10:42:06.492 INFO:teuthology.orchestra.run.smithi152.stdout:(255/286): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-14T10:42:06.517 INFO:teuthology.orchestra.run.smithi152.stdout:(256/286): python3-cheroot-8.6.0-4.el9.noarch.r 1.7 MB/s | 172 kB 00:00 2024-09-14T10:42:06.530 INFO:teuthology.orchestra.run.smithi097.stdout:(222/286): slf4j-1.7.30-13.el9.noarch.rpm 634 kB/s | 69 kB 00:00 2024-09-14T10:42:06.542 INFO:teuthology.orchestra.run.smithi152.stdout:(257/286): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-14T10:42:06.576 INFO:teuthology.orchestra.run.smithi152.stdout:(258/286): python3-cherrypy-18.6.1-2.el9.noarch 2.5 MB/s | 358 kB 00:00 2024-09-14T10:42:06.581 INFO:teuthology.orchestra.run.smithi097.stdout:(223/286): socat-1.7.4.1-6.el9.x86_64.rpm 2.5 MB/s | 304 kB 00:00 2024-09-14T10:42:06.601 INFO:teuthology.orchestra.run.smithi152.stdout:(259/286): python3-jaraco-8.2.1-3.el9.noarch.rp 434 kB/s | 11 kB 00:00 2024-09-14T10:42:06.627 INFO:teuthology.orchestra.run.smithi152.stdout:(260/286): python3-grpcio-tools-1.46.7-10.el9.x 1.7 MB/s | 144 kB 00:00 2024-09-14T10:42:06.651 INFO:teuthology.orchestra.run.smithi152.stdout:(261/286): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-14T10:42:06.656 INFO:teuthology.orchestra.run.smithi097.stdout:(224/286): sound-theme-freedesktop-0.8-17.el9.n 3.0 MB/s | 383 kB 00:00 2024-09-14T10:42:06.677 INFO:teuthology.orchestra.run.smithi152.stdout:(262/286): python3-jaraco-collections-3.0.0-8.e 464 kB/s | 23 kB 00:00 2024-09-14T10:42:06.690 INFO:teuthology.orchestra.run.smithi097.stdout:(225/286): totem-pl-parser-3.26.6-2.el9.x86_64. 1.4 MB/s | 152 kB 00:00 2024-09-14T10:42:06.702 INFO:teuthology.orchestra.run.smithi152.stdout:(263/286): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-14T10:42:06.727 INFO:teuthology.orchestra.run.smithi152.stdout:(264/286): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-14T10:42:06.753 INFO:teuthology.orchestra.run.smithi152.stdout:(265/286): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-14T10:42:06.782 INFO:teuthology.orchestra.run.smithi097.stdout:(226/286): tracker-3.1.2-3.el9.x86_64.rpm 4.3 MB/s | 555 kB 00:00 2024-09-14T10:42:06.786 INFO:teuthology.orchestra.run.smithi152.stdout:(266/286): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-14T10:42:06.812 INFO:teuthology.orchestra.run.smithi152.stdout:(267/286): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-14T10:42:06.845 INFO:teuthology.orchestra.run.smithi152.stdout:(268/286): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2024-09-14T10:42:06.871 INFO:teuthology.orchestra.run.smithi152.stdout:(269/286): python3-portend-3.1.0-2.el9.noarch.r 661 kB/s | 16 kB 00:00 2024-09-14T10:42:06.890 INFO:teuthology.orchestra.run.smithi097.stdout:(227/286): ttmkfdir-3.0.9-65.el9.x86_64.rpm 492 kB/s | 53 kB 00:00 2024-09-14T10:42:06.896 INFO:teuthology.orchestra.run.smithi152.stdout:(270/286): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-14T10:42:06.921 INFO:teuthology.orchestra.run.smithi152.stdout:(271/286): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2024-09-14T10:42:06.946 INFO:teuthology.orchestra.run.smithi152.stdout:(272/286): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-14T10:42:06.971 INFO:teuthology.orchestra.run.smithi152.stdout:(273/286): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-14T10:42:06.990 INFO:teuthology.orchestra.run.smithi097.stdout:(228/286): tracker-miners-3.1.2-4.el9.x86_64.rp 3.1 MB/s | 944 kB 00:00 2024-09-14T10:42:06.997 INFO:teuthology.orchestra.run.smithi152.stdout:(274/286): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-14T10:42:07.015 INFO:teuthology.orchestra.run.smithi097.stdout:(229/286): tzdata-java-2024a-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-14T10:42:07.022 INFO:teuthology.orchestra.run.smithi152.stdout:(275/286): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-09-14T10:42:07.072 INFO:teuthology.orchestra.run.smithi152.stdout:(276/286): python3-grpcio-1.46.7-10.el9.x86_64. 3.7 MB/s | 2.0 MB 00:00 2024-09-14T10:42:07.098 INFO:teuthology.orchestra.run.smithi152.stdout:(277/286): python3-typing-extensions-4.12.2-2.e 991 kB/s | 74 kB 00:00 2024-09-14T10:42:07.099 INFO:teuthology.orchestra.run.smithi097.stdout:(230/286): upower-0.99.11-11.el9.x86_64.rpm 1.6 MB/s | 173 kB 00:00 2024-09-14T10:42:07.123 INFO:teuthology.orchestra.run.smithi152.stdout:(278/286): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-14T10:42:07.133 INFO:teuthology.orchestra.run.smithi097.stdout:(231/286): webrtc-audio-processing-0.3.1-8.el9. 2.6 MB/s | 306 kB 00:00 2024-09-14T10:42:07.148 INFO:teuthology.orchestra.run.smithi152.stdout:(279/286): python3-zc-lockfile-2.0-10.el9.noarc 802 kB/s | 20 kB 00:00 2024-09-14T10:42:07.190 INFO:teuthology.orchestra.run.smithi152.stdout:(280/286): python3-webob-1.8.8-2.el9.noarch.rpm 1.3 MB/s | 230 kB 00:00 2024-09-14T10:42:07.215 INFO:teuthology.orchestra.run.smithi152.stdout:(281/286): re2-20211101-20.el9.x86_64.rpm 2.8 MB/s | 191 kB 00:00 2024-09-14T10:42:07.217 INFO:teuthology.orchestra.run.smithi097.stdout:(232/286): wireplumber-0.4.14-1.el9.x86_64.rpm 824 kB/s | 96 kB 00:00 2024-09-14T10:42:07.241 INFO:teuthology.orchestra.run.smithi152.stdout:(282/286): s3cmd-2.4.0-1.el9.noarch.rpm 4.0 MB/s | 206 kB 00:00 2024-09-14T10:42:07.250 INFO:teuthology.orchestra.run.smithi097.stdout:(233/286): wireplumber-libs-0.4.14-1.el9.x86_64 3.0 MB/s | 358 kB 00:00 2024-09-14T10:42:07.265 INFO:teuthology.orchestra.run.smithi152.stdout:(283/286): python3-werkzeug-2.0.3-3.el9.1.noarc 2.5 MB/s | 427 kB 00:00 2024-09-14T10:42:07.316 INFO:teuthology.orchestra.run.smithi152.stdout:(284/286): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-14T10:42:07.326 INFO:teuthology.orchestra.run.smithi097.stdout:(234/286): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 390 kB/s | 42 kB 00:00 2024-09-14T10:42:07.376 INFO:teuthology.orchestra.run.smithi097.stdout:(235/286): xdg-desktop-portal-1.12.6-1.el9.x86_ 3.0 MB/s | 385 kB 00:00 2024-09-14T10:42:07.435 INFO:teuthology.orchestra.run.smithi097.stdout:(236/286): xdg-desktop-portal-gtk-1.12.0-3.el9. 1.2 MB/s | 134 kB 00:00 2024-09-14T10:42:07.483 INFO:teuthology.orchestra.run.smithi152.stdout:(285/286): librados2-19.3.0-4907.ga2782315.el9. 14 MB/s | 3.5 MB 00:00 2024-09-14T10:42:07.510 INFO:teuthology.orchestra.run.smithi097.stdout:(237/286): xkeyboard-config-2.33-2.el9.noarch.r 6.3 MB/s | 859 kB 00:00 2024-09-14T10:42:07.627 INFO:teuthology.orchestra.run.smithi097.stdout:(238/286): xorg-x11-fonts-Type1-7.5-33.el9.noar 4.2 MB/s | 505 kB 00:00 2024-09-14T10:42:07.658 INFO:teuthology.orchestra.run.smithi152.stdout:(286/286): librbd1-19.3.0-4907.ga2782315.el9.x8 8.3 MB/s | 3.2 MB 00:00 2024-09-14T10:42:07.665 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-14T10:42:07.665 INFO:teuthology.orchestra.run.smithi152.stdout:Total 22 MB/s | 327 MB 00:14 2024-09-14T10:42:07.702 INFO:teuthology.orchestra.run.smithi097.stdout:(239/286): lua-devel-5.4.4-4.el9.x86_64.rpm 297 kB/s | 22 kB 00:00 2024-09-14T10:42:07.803 INFO:teuthology.orchestra.run.smithi097.stdout:(240/286): xmlstarlet-1.6.1-20.el9.x86_64.rpm 173 kB/s | 64 kB 00:00 2024-09-14T10:42:07.861 INFO:teuthology.orchestra.run.smithi097.stdout:(241/286): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-14T10:42:07.887 INFO:teuthology.orchestra.run.smithi097.stdout:(242/286): gperftools-libs-2.9.1-3.el9.x86_64.r 12 MB/s | 308 kB 00:00 2024-09-14T10:42:07.912 INFO:teuthology.orchestra.run.smithi097.stdout:(243/286): grpc-data-1.46.7-10.el9.noarch.rpm 784 kB/s | 19 kB 00:00 2024-09-14T10:42:08.020 INFO:teuthology.orchestra.run.smithi097.stdout:(244/286): libarrow-9.0.0-11.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2024-09-14T10:42:08.054 INFO:teuthology.orchestra.run.smithi097.stdout:(245/286): protobuf-compiler-3.14.0-13.el9.x86_ 2.4 MB/s | 863 kB 00:00 2024-09-14T10:42:08.079 INFO:teuthology.orchestra.run.smithi097.stdout:(246/286): libarrow-doc-9.0.0-11.el9.noarch.rpm 444 kB/s | 26 kB 00:00 2024-09-14T10:42:08.113 INFO:teuthology.orchestra.run.smithi097.stdout:(247/286): libunwind-1.6.2-1.el9.x86_64.rpm 2.5 MB/s | 67 kB 00:00 2024-09-14T10:42:08.138 INFO:teuthology.orchestra.run.smithi097.stdout:(248/286): luarocks-3.9.2-5.el9.noarch.rpm 6.4 MB/s | 151 kB 00:00 2024-09-14T10:42:08.172 INFO:teuthology.orchestra.run.smithi097.stdout:(249/286): liboath-2.6.7-2.el9.x86_64.rpm 413 kB/s | 49 kB 00:00 2024-09-14T10:42:08.214 INFO:teuthology.orchestra.run.smithi097.stdout:(250/286): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-14T10:42:08.239 INFO:teuthology.orchestra.run.smithi097.stdout:(251/286): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-14T10:42:08.264 INFO:teuthology.orchestra.run.smithi097.stdout:(252/286): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-14T10:42:08.290 INFO:teuthology.orchestra.run.smithi097.stdout:(253/286): python3-certifi-2023.05.07-4.el9.noa 564 kB/s | 14 kB 00:00 2024-09-14T10:42:08.315 INFO:teuthology.orchestra.run.smithi097.stdout:(254/286): python3-asyncssh-2.13.2-5.el9.noarch 3.7 MB/s | 548 kB 00:00 2024-09-14T10:42:08.340 INFO:teuthology.orchestra.run.smithi097.stdout:(255/286): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-14T10:42:08.366 INFO:teuthology.orchestra.run.smithi097.stdout:(256/286): python3-google-auth-2.34.0-1.el9.noa 8.6 MB/s | 220 kB 00:00 2024-09-14T10:42:08.399 INFO:teuthology.orchestra.run.smithi097.stdout:(257/286): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-09-14T10:42:08.433 INFO:teuthology.orchestra.run.smithi097.stdout:(258/286): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-14T10:42:08.458 INFO:teuthology.orchestra.run.smithi097.stdout:(259/286): python3-jaraco-8.2.1-3.el9.noarch.rp 427 kB/s | 11 kB 00:00 2024-09-14T10:42:08.484 INFO:teuthology.orchestra.run.smithi097.stdout:(260/286): python3-jaraco-classes-3.2.1-5.el9.n 699 kB/s | 18 kB 00:00 2024-09-14T10:42:08.509 INFO:teuthology.orchestra.run.smithi097.stdout:(261/286): python3-jaraco-collections-3.0.0-8.e 923 kB/s | 23 kB 00:00 2024-09-14T10:42:08.534 INFO:teuthology.orchestra.run.smithi097.stdout:(262/286): python3-jaraco-functools-3.5.0-2.el9 783 kB/s | 19 kB 00:00 2024-09-14T10:42:08.576 INFO:teuthology.orchestra.run.smithi097.stdout:(263/286): python3-grpcio-1.46.7-10.el9.x86_64. 9.7 MB/s | 2.0 MB 00:00 2024-09-14T10:42:08.601 INFO:teuthology.orchestra.run.smithi097.stdout:(264/286): python3-jaraco-text-3.2.0-6.el9.noar 293 kB/s | 20 kB 00:00 2024-09-14T10:42:08.627 INFO:teuthology.orchestra.run.smithi097.stdout:(265/286): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-14T10:42:08.660 INFO:teuthology.orchestra.run.smithi097.stdout:(266/286): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-14T10:42:08.686 INFO:teuthology.orchestra.run.smithi097.stdout:(267/286): python3-natsort-7.1.1-5.el9.noarch.r 2.2 MB/s | 58 kB 00:00 2024-09-14T10:42:08.728 INFO:teuthology.orchestra.run.smithi097.stdout:(268/286): python3-kubernetes-26.1.0-2.el9.noar 6.7 MB/s | 1.0 MB 00:00 2024-09-14T10:42:08.753 INFO:teuthology.orchestra.run.smithi097.stdout:(269/286): python3-portend-3.1.0-2.el9.noarch.r 663 kB/s | 16 kB 00:00 2024-09-14T10:42:08.778 INFO:teuthology.orchestra.run.smithi097.stdout:(270/286): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-09-14T10:42:08.804 INFO:teuthology.orchestra.run.smithi097.stdout:(271/286): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-14T10:42:08.829 INFO:teuthology.orchestra.run.smithi097.stdout:(272/286): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-14T10:42:08.854 INFO:teuthology.orchestra.run.smithi097.stdout:(273/286): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-14T10:42:08.879 INFO:teuthology.orchestra.run.smithi097.stdout:(274/286): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-14T10:42:08.905 INFO:teuthology.orchestra.run.smithi097.stdout:(275/286): python3-tempora-5.0.0-2.el9.noarch.r 709 kB/s | 36 kB 00:00 2024-09-14T10:42:08.930 INFO:teuthology.orchestra.run.smithi097.stdout:(276/286): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-14T10:42:08.964 INFO:teuthology.orchestra.run.smithi097.stdout:(277/286): python3-webob-1.8.8-2.el9.noarch.rpm 3.8 MB/s | 230 kB 00:00 2024-09-14T10:42:08.989 INFO:teuthology.orchestra.run.smithi097.stdout:(278/286): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-09-14T10:42:09.006 INFO:teuthology.orchestra.run.smithi097.stdout:(279/286): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-09-14T10:42:09.040 INFO:teuthology.orchestra.run.smithi097.stdout:(280/286): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-14T10:42:09.065 INFO:teuthology.orchestra.run.smithi097.stdout:(281/286): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-09-14T10:42:09.090 INFO:teuthology.orchestra.run.smithi097.stdout:(282/286): s3cmd-2.4.0-1.el9.noarch.rpm 4.0 MB/s | 206 kB 00:00 2024-09-14T10:42:09.140 INFO:teuthology.orchestra.run.smithi097.stdout:(283/286): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-14T10:42:09.474 INFO:teuthology.orchestra.run.smithi097.stdout:(284/286): librbd1-19.3.0-4907.ga2782315.el9.x8 9.8 MB/s | 3.2 MB 00:00 2024-09-14T10:42:09.574 INFO:teuthology.orchestra.run.smithi097.stdout:(285/286): librados2-19.3.0-4907.ga2782315.el9. 7.2 MB/s | 3.5 MB 00:00 2024-09-14T10:42:10.778 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-14T10:42:10.964 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-14T10:42:10.965 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-14T10:42:14.415 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-14T10:42:14.416 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-14T10:42:24.522 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-14T10:42:24.674 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-14T10:42:24.828 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-14T10:42:24.898 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/288 2024-09-14T10:42:24.928 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/288 2024-09-14T10:42:25.010 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/288 2024-09-14T10:42:25.070 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/288 2024-09-14T10:42:25.122 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/288 2024-09-14T10:42:25.155 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/288 2024-09-14T10:42:25.180 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/288 2024-09-14T10:42:25.233 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/288 2024-09-14T10:42:25.574 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/288 2024-09-14T10:42:25.690 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : librados2-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T10:42:25.812 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librados2-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T10:42:25.841 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T10:42:25.932 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T10:42:25.962 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 12/288 2024-09-14T10:42:26.001 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/288 2024-09-14T10:42:26.038 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/288 2024-09-14T10:42:26.079 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/288 2024-09-14T10:42:26.106 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/288 2024-09-14T10:42:26.138 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/288 2024-09-14T10:42:26.170 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/288 2024-09-14T10:42:26.198 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 19/288 2024-09-14T10:42:26.225 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 20/288 2024-09-14T10:42:26.393 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : lcms2-2.12-3.el9.x86_64 21/288 2024-09-14T10:42:26.512 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 22/288 2024-09-14T10:42:26.554 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : atk-2.36.0-5.el9.x86_64 23/288 2024-09-14T10:42:26.597 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 24/288 2024-09-14T10:42:26.625 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T10:42:26.729 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T10:42:26.759 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 26/288 2024-09-14T10:42:26.813 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 26/288 2024-09-14T10:42:26.838 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 27/288 2024-09-14T10:42:26.861 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-14T10:42:26.887 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-14T10:42:27.080 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-14T10:42:27.127 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-14T10:42:27.244 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : re2-1:20211101-20.el9.x86_64 30/288 2024-09-14T10:42:27.275 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 31/288 2024-09-14T10:42:27.310 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : liboath-2.6.7-2.el9.x86_64 32/288 2024-09-14T10:42:27.384 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/288 2024-09-14T10:42:27.437 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/288 2024-09-14T10:42:27.493 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-packaging-20.9-5.el9.noarch 35/288 2024-09-14T10:42:27.544 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 36/288 2024-09-14T10:42:27.569 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 37/288 2024-09-14T10:42:27.595 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 38/288 2024-09-14T10:42:27.620 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 39/288 2024-09-14T10:42:27.646 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 40/288 2024-09-14T10:42:27.675 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 41/288 2024-09-14T10:42:27.707 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 42/288 2024-09-14T10:42:27.732 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 43/288 2024-09-14T10:42:27.787 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 44/288 2024-09-14T10:42:27.838 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : dconf-0.40.0-6.el9.x86_64 45/288 2024-09-14T10:42:27.906 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 45/288 2024-09-14T10:42:27.982 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 46/288 2024-09-14T10:42:28.011 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 47/288 2024-09-14T10:42:28.055 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 48/288 2024-09-14T10:42:28.091 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 49/288 2024-09-14T10:42:28.123 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : fuse-2.9.9-16.el9.x86_64 50/288 2024-09-14T10:42:28.201 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 51/288 2024-09-14T10:42:28.242 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-ceph-common-2:19.3.0-4907.ga2782315.el9. 52/288 2024-09-14T10:42:28.294 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-ceph-argparse-2:19.3.0-4907.ga2782315.el 53/288 2024-09-14T10:42:28.335 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_6 54/288 2024-09-14T10:42:28.412 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 55/288 2024-09-14T10:42:28.555 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 56/288 2024-09-14T10:42:28.614 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 57/288 2024-09-14T10:42:29.163 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rsa-4.9-2.el9.noarch 58/288 2024-09-14T10:42:29.251 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 59/288 2024-09-14T10:42:29.297 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 60/288 2024-09-14T10:42:29.366 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 61/288 2024-09-14T10:42:29.409 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 62/288 2024-09-14T10:42:29.445 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 63/288 2024-09-14T10:42:29.474 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 64/288 2024-09-14T10:42:29.547 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 65/288 2024-09-14T10:42:29.585 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : luarocks-3.9.2-5.el9.noarch 66/288 2024-09-14T10:42:29.626 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 67/288 2024-09-14T10:42:29.661 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 68/288 2024-09-14T10:42:29.700 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librados-devel-2:19.3.0-4907.ga2782315.el9.x86_6 69/288 2024-09-14T10:42:29.733 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 70/288 2024-09-14T10:42:29.764 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 71/288 2024-09-14T10:42:29.806 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 72/288 2024-09-14T10:42:29.865 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 73/288 2024-09-14T10:42:29.900 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 74/288 2024-09-14T10:42:29.936 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 75/288 2024-09-14T10:42:30.039 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 76/288 2024-09-14T10:42:30.102 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 77/288 2024-09-14T10:42:30.176 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 78/288 2024-09-14T10:42:30.213 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 79/288 2024-09-14T10:42:30.249 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 80/288 2024-09-14T10:42:30.306 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 81/288 2024-09-14T10:42:30.358 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 82/288 2024-09-14T10:42:30.400 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 83/288 2024-09-14T10:42:30.541 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 84/288 2024-09-14T10:42:30.577 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 85/288 2024-09-14T10:42:30.618 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 86/288 2024-09-14T10:42:30.733 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 87/288 2024-09-14T10:42:30.768 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 88/288 2024-09-14T10:42:30.810 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 89/288 2024-09-14T10:42:30.842 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 90/288 2024-09-14T10:42:30.866 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 91/288 2024-09-14T10:42:30.957 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 92/288 2024-09-14T10:42:31.086 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 93/288 2024-09-14T10:42:31.127 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 94/288 2024-09-14T10:42:31.396 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 95/288 2024-09-14T10:42:31.561 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 96/288 2024-09-14T10:42:31.592 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 97/288 2024-09-14T10:42:31.622 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 98/288 2024-09-14T10:42:31.672 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 99/288 2024-09-14T10:42:31.700 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : upower-0.99.11-11.el9.x86_64 100/288 2024-09-14T10:42:31.714 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 100/288 2024-09-14T10:42:31.714 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-14T10:42:31.714 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:42:31.904 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : tzdata-java-2024a-2.el9.noarch 101/288 2024-09-14T10:42:31.992 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 102/288 2024-09-14T10:42:32.040 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 103/288 2024-09-14T10:42:32.065 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-14T10:42:32.089 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-14T10:42:32.116 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 105/288 2024-09-14T10:42:32.526 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T10:42:32.553 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T10:42:32.568 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T10:42:32.568 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-14T10:42:32.568 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:42:32.609 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 107/288 2024-09-14T10:42:32.644 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 108/288 2024-09-14T10:42:32.677 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 109/288 2024-09-14T10:42:32.727 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 110/288 2024-09-14T10:42:32.761 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 111/288 2024-09-14T10:42:32.849 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 112/288 2024-09-14T10:42:32.900 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 113/288 2024-09-14T10:42:32.931 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 114/288 2024-09-14T10:42:33.036 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 115/288 2024-09-14T10:42:33.099 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 116/288 2024-09-14T10:42:33.851 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 117/288 2024-09-14T10:42:33.904 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 118/288 2024-09-14T10:42:33.937 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 119/288 2024-09-14T10:42:34.048 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 120/288 2024-09-14T10:42:34.114 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 121/288 2024-09-14T10:42:34.308 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 122/288 2024-09-14T10:42:34.352 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 123/288 2024-09-14T10:42:34.396 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 124/288 2024-09-14T10:42:34.921 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 125/288 2024-09-14T10:42:34.985 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : osinfo-db-20240701-2.el9.noarch 126/288 2024-09-14T10:42:35.022 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 127/288 2024-09-14T10:42:35.056 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : orc-0.4.31-8.el9.x86_64 128/288 2024-09-14T10:42:35.089 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 129/288 2024-09-14T10:42:35.272 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openblas-0.3.26-2.el9.x86_64 130/288 2024-09-14T10:42:35.303 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 131/288 2024-09-14T10:42:35.381 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 132/288 2024-09-14T10:42:36.054 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 133/288 2024-09-14T10:42:36.169 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 134/288 2024-09-14T10:42:37.455 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 135/288 2024-09-14T10:42:37.555 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 136/288 2024-09-14T10:42:37.606 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 137/288 2024-09-14T10:42:37.648 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : lua-posix-35.0-8.el9.x86_64 138/288 2024-09-14T10:42:37.684 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 139/288 2024-09-14T10:42:37.713 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-14T10:42:37.725 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-14T10:42:37.725 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-14T10:42:37.726 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:42:37.780 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 141/288 2024-09-14T10:42:37.809 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 142/288 2024-09-14T10:42:37.855 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libsbc-1.4-9.el9.x86_64 143/288 2024-09-14T10:42:38.173 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 144/288 2024-09-14T10:42:38.225 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 145/288 2024-09-14T10:42:38.325 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 145/288 2024-09-14T10:42:38.359 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 146/288 2024-09-14T10:42:38.389 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 147/288 2024-09-14T10:42:38.422 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 148/288 2024-09-14T10:42:38.487 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 149/288 2024-09-14T10:42:38.526 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 150/288 2024-09-14T10:42:38.551 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 151/288 2024-09-14T10:42:38.599 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 152/288 2024-09-14T10:42:38.616 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-14T10:42:38.894 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-14T10:42:38.942 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libexif-0.6.22-6.el9.x86_64 154/288 2024-09-14T10:42:38.971 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 155/288 2024-09-14T10:42:38.996 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libasyncns-0.8-22.el9.x86_64 156/288 2024-09-14T10:42:39.021 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 157/288 2024-09-14T10:42:39.047 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libXv-1.0.11-16.el9.x86_64 158/288 2024-09-14T10:42:39.072 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 159/288 2024-09-14T10:42:39.100 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 160/288 2024-09-14T10:42:39.144 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 161/288 2024-09-14T10:42:39.192 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 162/288 2024-09-14T10:42:39.228 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 163/288 2024-09-14T10:42:39.277 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 164/288 2024-09-14T10:42:39.311 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : poppler-21.01.0-21.el9.x86_64 165/288 2024-09-14T10:42:39.770 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 166/288 2024-09-14T10:42:39.913 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 167/288 2024-09-14T10:42:39.967 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 168/288 2024-09-14T10:42:40.001 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 169/288 2024-09-14T10:42:40.029 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : gsm-1.0.19-6.el9.x86_64 170/288 2024-09-14T10:42:40.098 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 171/288 2024-09-14T10:42:40.149 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 172/288 2024-09-14T10:42:40.184 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcanberra-0.30-27.el9.x86_64 173/288 2024-09-14T10:42:40.204 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 173/288 2024-09-14T10:42:40.239 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : graphene-1.10.6-2.el9.x86_64 174/288 2024-09-14T10:42:40.265 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : giflib-5.2.1-9.el9.x86_64 175/288 2024-09-14T10:42:40.304 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 176/288 2024-09-14T10:42:40.353 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-14T10:42:52.283 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-14T10:42:52.326 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 178/288 2024-09-14T10:42:52.362 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 179/288 2024-09-14T10:42:52.409 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 180/288 2024-09-14T10:42:52.437 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 181/288 2024-09-14T10:42:52.473 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 182/288 2024-09-14T10:42:52.963 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 183/288 2024-09-14T10:42:52.994 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 184/288 2024-09-14T10:42:53.073 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 184/288 2024-09-14T10:42:53.103 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 185/288 2024-09-14T10:42:53.229 INFO:teuthology.orchestra.run.smithi097.stdout:(286/286): java-11-openjdk-headless-11.0.20.1.1 677 kB/s | 39 MB 00:59 2024-09-14T10:42:53.235 INFO:teuthology.orchestra.run.smithi097.stdout:-------------------------------------------------------------------------------- 2024-09-14T10:42:53.235 INFO:teuthology.orchestra.run.smithi097.stdout:Total 4.1 MB/s | 327 MB 01:20 2024-09-14T10:42:55.543 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T10:42:55.578 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T10:42:56.146 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T10:42:56.170 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction check 2024-09-14T10:42:56.189 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 187/288 2024-09-14T10:42:56.283 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 187/288 2024-09-14T10:42:56.283 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-14T10:42:56.283 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-14T10:42:56.283 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:42:56.316 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 188/288 2024-09-14T10:42:56.352 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction check succeeded. 2024-09-14T10:42:56.352 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction test 2024-09-14T10:42:59.578 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction test succeeded. 2024-09-14T10:42:59.579 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction 2024-09-14T10:43:05.641 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 188/288 2024-09-14T10:43:05.641 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /sys 2024-09-14T10:43:05.641 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /proc 2024-09-14T10:43:05.641 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /mnt 2024-09-14T10:43:05.642 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /var/tmp 2024-09-14T10:43:05.642 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /home 2024-09-14T10:43:05.642 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /root 2024-09-14T10:43:05.642 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /tmp 2024-09-14T10:43:05.642 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:43:05.812 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 189/288 2024-09-14T10:43:05.829 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 189/288 2024-09-14T10:43:05.829 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:43:05.829 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-14T10:43:05.829 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:43:07.296 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 190/288 2024-09-14T10:43:07.324 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 190/288 2024-09-14T10:43:07.324 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:43:07.324 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-14T10:43:07.324 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T10:43:07.325 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T10:43:07.325 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:43:07.555 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 191/288 2024-09-14T10:43:07.579 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 191/288 2024-09-14T10:43:07.579 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:43:07.579 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-14T10:43:07.580 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T10:43:07.580 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T10:43:07.580 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:43:08.031 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 192/288 2024-09-14T10:43:08.055 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 192/288 2024-09-14T10:43:08.055 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:43:08.055 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-14T10:43:08.055 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T10:43:08.055 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T10:43:08.055 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:43:08.158 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 193/288 2024-09-14T10:43:09.561 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-14T10:43:09.708 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-14T10:43:09.860 INFO:teuthology.orchestra.run.smithi097.stdout: Preparing : 1/1 2024-09-14T10:43:09.934 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/288 2024-09-14T10:43:09.974 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/288 2024-09-14T10:43:10.049 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/288 2024-09-14T10:43:10.113 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/288 2024-09-14T10:43:10.177 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/288 2024-09-14T10:43:10.226 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/288 2024-09-14T10:43:10.253 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/288 2024-09-14T10:43:10.298 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/288 2024-09-14T10:43:10.646 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/288 2024-09-14T10:43:10.761 INFO:teuthology.orchestra.run.smithi097.stdout: Upgrading : librados2-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T10:43:10.883 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: librados2-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T10:43:10.921 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T10:43:11.012 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T10:43:11.042 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 12/288 2024-09-14T10:43:11.086 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/288 2024-09-14T10:43:11.107 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 194/288 2024-09-14T10:43:11.118 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/288 2024-09-14T10:43:11.143 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/288 2024-09-14T10:43:11.170 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/288 2024-09-14T10:43:11.201 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/288 2024-09-14T10:43:11.201 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 195/288 2024-09-14T10:43:11.234 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/288 2024-09-14T10:43:11.261 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 19/288 2024-09-14T10:43:11.266 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-ply-3.11-14.el9.noarch 196/288 2024-09-14T10:43:11.290 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 20/288 2024-09-14T10:43:11.331 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 197/288 2024-09-14T10:43:11.437 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : lcms2-2.12-3.el9.x86_64 21/288 2024-09-14T10:43:11.518 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 198/288 2024-09-14T10:43:11.571 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 199/288 2024-09-14T10:43:11.574 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 22/288 2024-09-14T10:43:11.625 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : atk-2.36.0-5.el9.x86_64 23/288 2024-09-14T10:43:11.650 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 200/288 2024-09-14T10:43:11.661 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 24/288 2024-09-14T10:43:11.698 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T10:43:11.739 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 201/288 2024-09-14T10:43:11.806 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T10:43:11.832 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 26/288 2024-09-14T10:43:11.880 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 202/288 2024-09-14T10:43:11.890 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 26/288 2024-09-14T10:43:11.911 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 27/288 2024-09-14T10:43:11.926 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 203/288 2024-09-14T10:43:11.933 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-14T10:43:11.959 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-14T10:43:11.964 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 204/288 2024-09-14T10:43:12.154 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-14T10:43:12.184 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-14T10:43:12.301 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : re2-1:20211101-20.el9.x86_64 30/288 2024-09-14T10:43:12.332 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 31/288 2024-09-14T10:43:12.367 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : liboath-2.6.7-2.el9.x86_64 32/288 2024-09-14T10:43:12.448 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/288 2024-09-14T10:43:12.502 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/288 2024-09-14T10:43:12.550 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-packaging-20.9-5.el9.noarch 35/288 2024-09-14T10:43:12.593 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 36/288 2024-09-14T10:43:12.618 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 37/288 2024-09-14T10:43:12.645 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 38/288 2024-09-14T10:43:12.670 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 39/288 2024-09-14T10:43:12.696 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 40/288 2024-09-14T10:43:12.724 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 41/288 2024-09-14T10:43:12.757 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 42/288 2024-09-14T10:43:12.781 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 43/288 2024-09-14T10:43:12.819 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 44/288 2024-09-14T10:43:12.825 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 205/288 2024-09-14T10:43:12.847 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : dconf-0.40.0-6.el9.x86_64 45/288 2024-09-14T10:43:12.879 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-14T10:43:12.914 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 45/288 2024-09-14T10:43:12.967 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 46/288 2024-09-14T10:43:13.006 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 47/288 2024-09-14T10:43:13.059 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 48/288 2024-09-14T10:43:13.101 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 49/288 2024-09-14T10:43:13.135 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : fuse-2.9.9-16.el9.x86_64 50/288 2024-09-14T10:43:13.215 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 51/288 2024-09-14T10:43:13.255 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-ceph-common-2:19.3.0-4907.ga2782315.el9. 52/288 2024-09-14T10:43:13.259 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-14T10:43:13.300 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-ceph-argparse-2:19.3.0-4907.ga2782315.el 53/288 2024-09-14T10:43:13.302 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 207/288 2024-09-14T10:43:13.333 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : slf4j-1.7.30-13.el9.noarch 208/288 2024-09-14T10:43:13.341 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_6 54/288 2024-09-14T10:43:13.361 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : atinject-1.0.3-6.el9.noarch 209/288 2024-09-14T10:43:13.404 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 210/288 2024-09-14T10:43:13.418 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 55/288 2024-09-14T10:43:13.449 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 211/288 2024-09-14T10:43:13.477 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 212/288 2024-09-14T10:43:13.503 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 213/288 2024-09-14T10:43:13.528 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 214/288 2024-09-14T10:43:13.553 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 215/288 2024-09-14T10:43:13.563 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 56/288 2024-09-14T10:43:13.580 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 216/288 2024-09-14T10:43:13.605 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 217/288 2024-09-14T10:43:13.620 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 57/288 2024-09-14T10:43:13.632 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 218/288 2024-09-14T10:43:13.662 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 219/288 2024-09-14T10:43:13.690 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 220/288 2024-09-14T10:43:13.734 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 221/288 2024-09-14T10:43:13.778 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 222/288 2024-09-14T10:43:13.809 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 223/288 2024-09-14T10:43:13.844 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 224/288 2024-09-14T10:43:13.878 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : jansi-2.3.3-6.el9.x86_64 225/288 2024-09-14T10:43:13.915 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : jsoup-1.13.1-10.el9.noarch 226/288 2024-09-14T10:43:13.953 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 227/288 2024-09-14T10:43:13.996 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 228/288 2024-09-14T10:43:14.040 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 229/288 2024-09-14T10:43:14.072 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : guava-30.1-6.el9.noarch 230/288 2024-09-14T10:43:14.112 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : google-guice-4.2.3-9.el9.noarch 231/288 2024-09-14T10:43:14.165 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 232/288 2024-09-14T10:43:14.179 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-rsa-4.9-2.el9.noarch 58/288 2024-09-14T10:43:14.206 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 233/288 2024-09-14T10:43:14.236 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 234/288 2024-09-14T10:43:14.265 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 235/288 2024-09-14T10:43:14.266 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 59/288 2024-09-14T10:43:14.299 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 236/288 2024-09-14T10:43:14.301 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 60/288 2024-09-14T10:43:14.372 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 61/288 2024-09-14T10:43:14.408 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 62/288 2024-09-14T10:43:14.444 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 63/288 2024-09-14T10:43:14.469 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 237/288 2024-09-14T10:43:14.473 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 64/288 2024-09-14T10:43:14.500 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 238/288 2024-09-14T10:43:14.527 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 239/288 2024-09-14T10:43:14.545 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 65/288 2024-09-14T10:43:14.562 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 240/288 2024-09-14T10:43:14.584 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : luarocks-3.9.2-5.el9.noarch 66/288 2024-09-14T10:43:14.594 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 241/288 2024-09-14T10:43:14.617 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 67/288 2024-09-14T10:43:14.652 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 68/288 2024-09-14T10:43:14.690 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : librados-devel-2:19.3.0-4907.ga2782315.el9.x86_6 69/288 2024-09-14T10:43:14.723 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 242/288 2024-09-14T10:43:14.723 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 70/288 2024-09-14T10:43:14.756 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 71/288 2024-09-14T10:43:14.786 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 243/288 2024-09-14T10:43:14.816 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 72/288 2024-09-14T10:43:14.855 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 244/288 2024-09-14T10:43:14.872 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 73/288 2024-09-14T10:43:14.891 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : tracker-3.1.2-3.el9.x86_64 245/288 2024-09-14T10:43:14.907 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 74/288 2024-09-14T10:43:14.944 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 75/288 2024-09-14T10:43:15.020 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 245/288 2024-09-14T10:43:15.053 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 76/288 2024-09-14T10:43:15.072 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-14T10:43:15.087 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-14T10:43:15.126 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 77/288 2024-09-14T10:43:15.126 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 247/288 2024-09-14T10:43:15.149 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 248/288 2024-09-14T10:43:15.199 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 78/288 2024-09-14T10:43:15.255 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 79/288 2024-09-14T10:43:15.291 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 80/288 2024-09-14T10:43:15.338 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 81/288 2024-09-14T10:43:15.383 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 82/288 2024-09-14T10:43:15.425 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 83/288 2024-09-14T10:43:15.539 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T10:43:15.564 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 84/288 2024-09-14T10:43:15.570 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T10:43:15.586 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T10:43:15.586 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-14T10:43:15.586 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:43:15.610 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 85/288 2024-09-14T10:43:15.651 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 86/288 2024-09-14T10:43:15.755 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 87/288 2024-09-14T10:43:15.794 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 88/288 2024-09-14T10:43:15.806 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 250/288 2024-09-14T10:43:15.834 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 89/288 2024-09-14T10:43:15.875 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 251/288 2024-09-14T10:43:15.875 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 90/288 2024-09-14T10:43:15.900 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 91/288 2024-09-14T10:43:15.930 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 252/288 2024-09-14T10:43:15.966 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 253/288 2024-09-14T10:43:15.985 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 92/288 2024-09-14T10:43:15.991 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 254/288 2024-09-14T10:43:16.113 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 93/288 2024-09-14T10:43:16.161 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 94/288 2024-09-14T10:43:16.375 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 95/288 2024-09-14T10:43:16.382 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T10:43:16.412 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T10:43:16.421 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 96/288 2024-09-14T10:43:16.428 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T10:43:16.452 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 97/288 2024-09-14T10:43:16.482 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 98/288 2024-09-14T10:43:16.526 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 99/288 2024-09-14T10:43:16.552 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : upower-0.99.11-11.el9.x86_64 100/288 2024-09-14T10:43:16.566 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 100/288 2024-09-14T10:43:16.566 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-14T10:43:16.566 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:43:16.756 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : tzdata-java-2024a-2.el9.noarch 101/288 2024-09-14T10:43:16.844 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 102/288 2024-09-14T10:43:16.892 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 103/288 2024-09-14T10:43:16.917 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-14T10:43:16.932 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-14T10:43:16.941 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-14T10:43:16.977 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 105/288 2024-09-14T10:43:17.018 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-14T10:43:17.063 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-14T10:43:17.092 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-14T10:43:17.299 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 258/288 2024-09-14T10:43:17.362 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 259/288 2024-09-14T10:43:17.417 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T10:43:17.421 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-14T10:43:17.443 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-14T10:43:17.448 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T10:43:17.461 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T10:43:17.461 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-14T10:43:17.462 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:43:17.472 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-14T10:43:17.504 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 107/288 2024-09-14T10:43:17.538 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 108/288 2024-09-14T10:43:17.541 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-14T10:43:17.572 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 109/288 2024-09-14T10:43:17.575 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-14T10:43:17.587 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-14T10:43:17.617 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : maven-1:3.6.3-15.el9.noarch 263/288 2024-09-14T10:43:17.622 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 110/288 2024-09-14T10:43:17.639 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 263/288 2024-09-14T10:43:17.664 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 111/288 2024-09-14T10:43:17.668 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 264/288 2024-09-14T10:43:17.753 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 112/288 2024-09-14T10:43:17.803 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 113/288 2024-09-14T10:43:17.834 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 114/288 2024-09-14T10:43:17.939 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 115/288 2024-09-14T10:43:17.994 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 116/288 2024-09-14T10:43:18.131 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: cephadm-2:19.3.0-4907.ga2782315.el9.noarch 265/288 2024-09-14T10:43:18.158 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cephadm-2:19.3.0-4907.ga2782315.el9.noarch 265/288 2024-09-14T10:43:18.191 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.e 266/288 2024-09-14T10:43:18.258 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4907.ga2782315. 267/288 2024-09-14T10:43:18.282 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 268/288 2024-09-14T10:43:18.747 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 117/288 2024-09-14T10:43:18.791 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 118/288 2024-09-14T10:43:18.825 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 119/288 2024-09-14T10:43:18.926 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 120/288 2024-09-14T10:43:18.975 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 121/288 2024-09-14T10:43:19.167 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 122/288 2024-09-14T10:43:19.215 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 123/288 2024-09-14T10:43:19.269 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 124/288 2024-09-14T10:43:19.780 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 125/288 2024-09-14T10:43:19.848 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : osinfo-db-20240701-2.el9.noarch 126/288 2024-09-14T10:43:19.886 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 127/288 2024-09-14T10:43:19.919 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : orc-0.4.31-8.el9.x86_64 128/288 2024-09-14T10:43:19.952 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 129/288 2024-09-14T10:43:20.137 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : openblas-0.3.26-2.el9.x86_64 130/288 2024-09-14T10:43:20.167 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 131/288 2024-09-14T10:43:20.255 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 132/288 2024-09-14T10:43:20.937 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 133/288 2024-09-14T10:43:21.050 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 134/288 2024-09-14T10:43:21.498 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 268/288 2024-09-14T10:43:21.556 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 269/288 2024-09-14T10:43:22.341 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 135/288 2024-09-14T10:43:22.421 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 136/288 2024-09-14T10:43:22.480 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 137/288 2024-09-14T10:43:22.515 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : lua-posix-35.0-8.el9.x86_64 138/288 2024-09-14T10:43:22.521 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 269/288 2024-09-14T10:43:22.543 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 139/288 2024-09-14T10:43:22.556 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 270/288 2024-09-14T10:43:22.571 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-14T10:43:22.582 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-14T10:43:22.582 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-14T10:43:22.583 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:43:22.636 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 141/288 2024-09-14T10:43:22.667 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 142/288 2024-09-14T10:43:22.673 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 270/288 2024-09-14T10:43:22.696 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libsbc-1.4-9.el9.x86_64 143/288 2024-09-14T10:43:22.844 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el 271/288 2024-09-14T10:43:22.875 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 272/288 2024-09-14T10:43:22.899 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 272/288 2024-09-14T10:43:22.899 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:43:22.899 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-14T10:43:22.899 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T10:43:22.899 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T10:43:22.899 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:43:22.951 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 273/288 2024-09-14T10:43:22.963 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 273/288 2024-09-14T10:43:22.985 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-2:19.3.0-4907.ga2782315.el9.x86_64 274/288 2024-09-14T10:43:23.014 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 275/288 2024-09-14T10:43:23.018 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 144/288 2024-09-14T10:43:23.064 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 276/288 2024-09-14T10:43:23.075 INFO:teuthology.orchestra.run.smithi097.stdout: Upgrading : librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 145/288 2024-09-14T10:43:23.103 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-14T10:43:23.119 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-14T10:43:23.119 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-14T10:43:23.119 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:43:23.176 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 145/288 2024-09-14T10:43:23.207 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 146/288 2024-09-14T10:43:23.239 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 147/288 2024-09-14T10:43:23.277 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 148/288 2024-09-14T10:43:23.347 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 149/288 2024-09-14T10:43:23.385 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 150/288 2024-09-14T10:43:23.411 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 151/288 2024-09-14T10:43:23.455 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 152/288 2024-09-14T10:43:23.484 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-14T10:43:23.742 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-14T10:43:23.785 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libexif-0.6.22-6.el9.x86_64 154/288 2024-09-14T10:43:23.814 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 155/288 2024-09-14T10:43:23.839 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libasyncns-0.8-22.el9.x86_64 156/288 2024-09-14T10:43:23.865 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 157/288 2024-09-14T10:43:23.891 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libXv-1.0.11-16.el9.x86_64 158/288 2024-09-14T10:43:23.915 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 159/288 2024-09-14T10:43:23.943 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 160/288 2024-09-14T10:43:23.979 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 161/288 2024-09-14T10:43:24.027 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 162/288 2024-09-14T10:43:24.063 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 163/288 2024-09-14T10:43:24.111 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 164/288 2024-09-14T10:43:24.121 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 278/288 2024-09-14T10:43:24.146 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : poppler-21.01.0-21.el9.x86_64 165/288 2024-09-14T10:43:24.147 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 278/288 2024-09-14T10:43:24.147 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:43:24.148 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-14T10:43:24.148 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T10:43:24.148 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T10:43:24.148 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:43:24.189 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4907.ga2782 279/288 2024-09-14T10:43:24.213 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4907.ga2782 279/288 2024-09-14T10:43:24.213 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:43:24.213 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-14T10:43:24.213 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:43:24.541 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 280/288 2024-09-14T10:43:24.566 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 280/288 2024-09-14T10:43:24.566 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:43:24.566 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-14T10:43:24.566 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T10:43:24.566 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T10:43:24.566 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:43:24.608 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 166/288 2024-09-14T10:43:24.739 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 167/288 2024-09-14T10:43:24.805 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 168/288 2024-09-14T10:43:24.830 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 169/288 2024-09-14T10:43:24.859 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : gsm-1.0.19-6.el9.x86_64 170/288 2024-09-14T10:43:24.933 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 171/288 2024-09-14T10:43:24.982 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 172/288 2024-09-14T10:43:25.015 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libcanberra-0.30-27.el9.x86_64 173/288 2024-09-14T10:43:25.034 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 173/288 2024-09-14T10:43:25.061 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : graphene-1.10.6-2.el9.x86_64 174/288 2024-09-14T10:43:25.087 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : giflib-5.2.1-9.el9.x86_64 175/288 2024-09-14T10:43:25.122 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 176/288 2024-09-14T10:43:25.151 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-14T10:43:29.287 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 281/288 2024-09-14T10:43:29.328 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 282/288 2024-09-14T10:43:29.360 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 283/288 2024-09-14T10:43:29.465 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_ 284/288 2024-09-14T10:43:29.521 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 285/288 2024-09-14T10:43:29.560 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 286/288 2024-09-14T10:43:29.560 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-14T10:43:29.661 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-14T10:43:29.661 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T10:43:29.752 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T10:43:29.776 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 288/288 2024-09-14T10:43:29.783 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 288/288 2024-09-14T10:43:29.792 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 288/288 2024-09-14T10:43:29.803 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 288/288 2024-09-14T10:43:29.803 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-14T10:43:29.803 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-14T10:43:29.803 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:43:29.856 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-14T10:43:29.926 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-14T10:43:36.730 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-14T10:43:36.770 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 178/288 2024-09-14T10:43:36.798 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 179/288 2024-09-14T10:43:36.838 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 180/288 2024-09-14T10:43:36.873 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 181/288 2024-09-14T10:43:36.908 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 182/288 2024-09-14T10:43:37.413 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 183/288 2024-09-14T10:43:37.447 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 184/288 2024-09-14T10:43:37.519 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 184/288 2024-09-14T10:43:37.549 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 185/288 2024-09-14T10:43:39.941 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T10:43:39.973 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T10:43:40.530 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T10:43:40.569 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 187/288 2024-09-14T10:43:40.659 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 187/288 2024-09-14T10:43:40.660 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-14T10:43:40.660 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-14T10:43:40.660 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:43:40.686 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 188/288 2024-09-14T10:43:40.944 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T10:43:40.944 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-2:19.3.0-4907.ga2782315.el9.x86_64 1/288 2024-09-14T10:43:40.944 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 2/288 2024-09-14T10:43:40.944 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 3/288 2024-09-14T10:43:40.944 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 4/288 2024-09-14T10:43:40.944 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4907.ga2782 5/288 2024-09-14T10:43:40.945 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 6/288 2024-09-14T10:43:40.945 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 7/288 2024-09-14T10:43:40.945 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 8/288 2024-09-14T10:43:40.945 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 9/288 2024-09-14T10:43:40.945 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T10:43:40.945 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T10:43:40.945 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 12/288 2024-09-14T10:43:40.945 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_ 13/288 2024-09-14T10:43:40.946 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 14/288 2024-09-14T10:43:40.946 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 15/288 2024-09-14T10:43:40.946 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados-devel-2:19.3.0-4907.ga2782315.el9.x86_6 16/288 2024-09-14T10:43:40.946 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 17/288 2024-09-14T10:43:40.946 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 18/288 2024-09-14T10:43:40.946 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4907.ga2782315.el 19/288 2024-09-14T10:43:40.946 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-ceph-common-2:19.3.0-4907.ga2782315.el9. 20/288 2024-09-14T10:43:40.946 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_6 21/288 2024-09-14T10:43:40.946 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 22/288 2024-09-14T10:43:40.946 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 23/288 2024-09-14T10:43:40.947 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 24/288 2024-09-14T10:43:40.947 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T10:43:40.947 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 26/288 2024-09-14T10:43:40.947 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 27/288 2024-09-14T10:43:40.947 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4907.ga2782315. 28/288 2024-09-14T10:43:40.947 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 29/288 2024-09-14T10:43:40.947 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 30/288 2024-09-14T10:43:40.947 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 31/288 2024-09-14T10:43:40.947 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el 32/288 2024-09-14T10:43:40.947 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 33/288 2024-09-14T10:43:40.947 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.e 34/288 2024-09-14T10:43:40.947 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 35/288 2024-09-14T10:43:40.948 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cephadm-2:19.3.0-4907.ga2782315.el9.noarch 36/288 2024-09-14T10:43:40.948 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/288 2024-09-14T10:43:40.948 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/288 2024-09-14T10:43:40.948 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/288 2024-09-14T10:43:40.948 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/288 2024-09-14T10:43:40.948 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/288 2024-09-14T10:43:40.948 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/288 2024-09-14T10:43:40.948 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/288 2024-09-14T10:43:40.948 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/288 2024-09-14T10:43:40.948 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/288 2024-09-14T10:43:40.948 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/288 2024-09-14T10:43:40.948 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/288 2024-09-14T10:43:40.948 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/288 2024-09-14T10:43:40.949 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/288 2024-09-14T10:43:40.949 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/288 2024-09-14T10:43:40.949 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/288 2024-09-14T10:43:40.949 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/288 2024-09-14T10:43:40.949 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/288 2024-09-14T10:43:40.949 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/288 2024-09-14T10:43:40.949 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/288 2024-09-14T10:43:40.949 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/288 2024-09-14T10:43:40.949 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/288 2024-09-14T10:43:40.949 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/288 2024-09-14T10:43:40.949 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/288 2024-09-14T10:43:40.949 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/288 2024-09-14T10:43:40.950 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/288 2024-09-14T10:43:40.950 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/288 2024-09-14T10:43:40.950 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/288 2024-09-14T10:43:40.950 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/288 2024-09-14T10:43:40.950 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/288 2024-09-14T10:43:40.950 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/288 2024-09-14T10:43:40.950 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/288 2024-09-14T10:43:40.950 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/288 2024-09-14T10:43:40.950 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/288 2024-09-14T10:43:40.950 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/288 2024-09-14T10:43:40.950 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/288 2024-09-14T10:43:40.950 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/288 2024-09-14T10:43:40.950 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/288 2024-09-14T10:43:40.951 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/288 2024-09-14T10:43:40.951 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/288 2024-09-14T10:43:40.951 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/288 2024-09-14T10:43:40.951 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/288 2024-09-14T10:43:40.951 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/288 2024-09-14T10:43:40.951 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/288 2024-09-14T10:43:40.951 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/288 2024-09-14T10:43:40.951 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/288 2024-09-14T10:43:40.951 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/288 2024-09-14T10:43:40.951 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/288 2024-09-14T10:43:40.951 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/288 2024-09-14T10:43:40.951 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/288 2024-09-14T10:43:40.951 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/288 2024-09-14T10:43:40.952 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/288 2024-09-14T10:43:40.952 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/288 2024-09-14T10:43:40.952 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/288 2024-09-14T10:43:40.952 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/288 2024-09-14T10:43:40.952 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : guava-30.1-6.el9.noarch 91/288 2024-09-14T10:43:40.952 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/288 2024-09-14T10:43:40.952 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/288 2024-09-14T10:43:40.952 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/288 2024-09-14T10:43:40.952 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/288 2024-09-14T10:43:40.952 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/288 2024-09-14T10:43:40.952 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/288 2024-09-14T10:43:40.952 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/288 2024-09-14T10:43:40.953 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/288 2024-09-14T10:43:40.953 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/288 2024-09-14T10:43:40.953 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/288 2024-09-14T10:43:40.953 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/288 2024-09-14T10:43:40.953 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/288 2024-09-14T10:43:40.953 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/288 2024-09-14T10:43:40.953 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/288 2024-09-14T10:43:40.953 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/288 2024-09-14T10:43:40.953 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/288 2024-09-14T10:43:40.953 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/288 2024-09-14T10:43:40.953 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/288 2024-09-14T10:43:40.953 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/288 2024-09-14T10:43:40.954 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/288 2024-09-14T10:43:40.954 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/288 2024-09-14T10:43:40.954 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/288 2024-09-14T10:43:40.954 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/288 2024-09-14T10:43:40.954 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/288 2024-09-14T10:43:40.954 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/288 2024-09-14T10:43:40.954 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/288 2024-09-14T10:43:40.954 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/288 2024-09-14T10:43:40.954 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/288 2024-09-14T10:43:40.954 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/288 2024-09-14T10:43:40.954 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/288 2024-09-14T10:43:40.954 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/288 2024-09-14T10:43:40.954 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/288 2024-09-14T10:43:40.955 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/288 2024-09-14T10:43:40.955 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/288 2024-09-14T10:43:40.955 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/288 2024-09-14T10:43:40.955 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/288 2024-09-14T10:43:40.955 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/288 2024-09-14T10:43:40.955 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/288 2024-09-14T10:43:40.955 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/288 2024-09-14T10:43:40.955 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/288 2024-09-14T10:43:40.955 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/288 2024-09-14T10:43:40.955 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 133/288 2024-09-14T10:43:40.955 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 134/288 2024-09-14T10:43:40.955 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 135/288 2024-09-14T10:43:40.955 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 136/288 2024-09-14T10:43:40.956 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 137/288 2024-09-14T10:43:40.956 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 138/288 2024-09-14T10:43:40.956 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 139/288 2024-09-14T10:43:40.956 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libsbc-1.4-9.el9.x86_64 140/288 2024-09-14T10:43:40.956 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 141/288 2024-09-14T10:43:40.956 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 142/288 2024-09-14T10:43:40.956 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 143/288 2024-09-14T10:43:40.956 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 144/288 2024-09-14T10:43:40.956 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 145/288 2024-09-14T10:43:40.956 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 146/288 2024-09-14T10:43:40.956 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 147/288 2024-09-14T10:43:40.956 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 148/288 2024-09-14T10:43:40.956 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 149/288 2024-09-14T10:43:40.957 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 150/288 2024-09-14T10:43:40.957 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 151/288 2024-09-14T10:43:40.957 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 152/288 2024-09-14T10:43:40.957 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 153/288 2024-09-14T10:43:40.957 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 154/288 2024-09-14T10:43:40.957 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 155/288 2024-09-14T10:43:40.957 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 156/288 2024-09-14T10:43:40.957 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : lua-5.4.4-4.el9.x86_64 157/288 2024-09-14T10:43:40.957 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 158/288 2024-09-14T10:43:40.957 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 159/288 2024-09-14T10:43:40.957 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 160/288 2024-09-14T10:43:40.957 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 161/288 2024-09-14T10:43:40.957 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 162/288 2024-09-14T10:43:40.958 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 163/288 2024-09-14T10:43:40.958 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 164/288 2024-09-14T10:43:40.958 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 165/288 2024-09-14T10:43:40.958 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 166/288 2024-09-14T10:43:40.958 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 167/288 2024-09-14T10:43:40.958 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 168/288 2024-09-14T10:43:40.958 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 169/288 2024-09-14T10:43:40.958 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 170/288 2024-09-14T10:43:40.958 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 171/288 2024-09-14T10:43:40.958 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 172/288 2024-09-14T10:43:40.958 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 173/288 2024-09-14T10:43:40.959 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 174/288 2024-09-14T10:43:40.959 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : opus-1.3.1-10.el9.x86_64 175/288 2024-09-14T10:43:40.959 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : orc-0.4.31-8.el9.x86_64 176/288 2024-09-14T10:43:40.959 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 177/288 2024-09-14T10:43:40.959 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 178/288 2024-09-14T10:43:40.959 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 179/288 2024-09-14T10:43:40.959 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 180/288 2024-09-14T10:43:40.959 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 181/288 2024-09-14T10:43:40.959 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 182/288 2024-09-14T10:43:40.959 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 183/288 2024-09-14T10:43:40.959 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 184/288 2024-09-14T10:43:40.959 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 185/288 2024-09-14T10:43:40.959 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 186/288 2024-09-14T10:43:40.959 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 187/288 2024-09-14T10:43:40.960 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 188/288 2024-09-14T10:43:40.960 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 189/288 2024-09-14T10:43:40.960 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 190/288 2024-09-14T10:43:40.960 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 191/288 2024-09-14T10:43:40.960 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 192/288 2024-09-14T10:43:40.960 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 193/288 2024-09-14T10:43:40.960 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 194/288 2024-09-14T10:43:40.960 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 195/288 2024-09-14T10:43:40.960 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 196/288 2024-09-14T10:43:40.960 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 197/288 2024-09-14T10:43:40.960 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 198/288 2024-09-14T10:43:40.960 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 199/288 2024-09-14T10:43:40.961 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 200/288 2024-09-14T10:43:40.961 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 201/288 2024-09-14T10:43:40.961 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 202/288 2024-09-14T10:43:40.961 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 203/288 2024-09-14T10:43:40.961 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 204/288 2024-09-14T10:43:40.961 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 205/288 2024-09-14T10:43:40.961 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 206/288 2024-09-14T10:43:40.961 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 207/288 2024-09-14T10:43:40.961 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 208/288 2024-09-14T10:43:40.961 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 209/288 2024-09-14T10:43:40.961 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 210/288 2024-09-14T10:43:40.961 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 211/288 2024-09-14T10:43:40.961 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 212/288 2024-09-14T10:43:40.962 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 213/288 2024-09-14T10:43:40.962 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 214/288 2024-09-14T10:43:40.962 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 215/288 2024-09-14T10:43:40.962 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 216/288 2024-09-14T10:43:40.962 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 217/288 2024-09-14T10:43:40.962 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 218/288 2024-09-14T10:43:40.962 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 219/288 2024-09-14T10:43:40.962 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 220/288 2024-09-14T10:43:40.963 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rtkit-0.11-29.el9.x86_64 221/288 2024-09-14T10:43:40.963 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 222/288 2024-09-14T10:43:40.963 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 223/288 2024-09-14T10:43:40.963 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 224/288 2024-09-14T10:43:40.963 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 225/288 2024-09-14T10:43:40.963 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 226/288 2024-09-14T10:43:40.963 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 227/288 2024-09-14T10:43:40.963 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 228/288 2024-09-14T10:43:40.963 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 229/288 2024-09-14T10:43:40.964 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 230/288 2024-09-14T10:43:40.964 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : upower-0.99.11-11.el9.x86_64 231/288 2024-09-14T10:43:40.964 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 232/288 2024-09-14T10:43:40.964 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 233/288 2024-09-14T10:43:40.964 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 234/288 2024-09-14T10:43:40.964 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 235/288 2024-09-14T10:43:40.964 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 236/288 2024-09-14T10:43:40.964 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 237/288 2024-09-14T10:43:40.965 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 238/288 2024-09-14T10:43:40.965 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 239/288 2024-09-14T10:43:40.965 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 240/288 2024-09-14T10:43:40.965 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 241/288 2024-09-14T10:43:40.965 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 242/288 2024-09-14T10:43:40.965 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 243/288 2024-09-14T10:43:40.965 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 244/288 2024-09-14T10:43:40.965 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 245/288 2024-09-14T10:43:40.965 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 246/288 2024-09-14T10:43:40.966 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 247/288 2024-09-14T10:43:40.966 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 248/288 2024-09-14T10:43:40.966 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 249/288 2024-09-14T10:43:40.966 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 250/288 2024-09-14T10:43:40.966 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 251/288 2024-09-14T10:43:40.966 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 252/288 2024-09-14T10:43:40.966 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 253/288 2024-09-14T10:43:40.966 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 254/288 2024-09-14T10:43:40.966 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 255/288 2024-09-14T10:43:40.966 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 256/288 2024-09-14T10:43:40.966 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 257/288 2024-09-14T10:43:40.967 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 258/288 2024-09-14T10:43:40.967 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 259/288 2024-09-14T10:43:40.967 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 260/288 2024-09-14T10:43:40.967 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 261/288 2024-09-14T10:43:40.967 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 262/288 2024-09-14T10:43:40.967 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 263/288 2024-09-14T10:43:40.967 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 264/288 2024-09-14T10:43:40.967 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 265/288 2024-09-14T10:43:40.967 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 266/288 2024-09-14T10:43:40.968 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 267/288 2024-09-14T10:43:40.968 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 268/288 2024-09-14T10:43:40.968 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 269/288 2024-09-14T10:43:40.968 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 270/288 2024-09-14T10:43:40.968 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 271/288 2024-09-14T10:43:40.968 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 272/288 2024-09-14T10:43:40.968 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 273/288 2024-09-14T10:43:40.968 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 274/288 2024-09-14T10:43:40.969 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 275/288 2024-09-14T10:43:40.969 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 276/288 2024-09-14T10:43:40.969 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 277/288 2024-09-14T10:43:40.969 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 278/288 2024-09-14T10:43:40.969 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 279/288 2024-09-14T10:43:40.969 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 280/288 2024-09-14T10:43:40.969 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 281/288 2024-09-14T10:43:40.969 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : re2-1:20211101-20.el9.x86_64 282/288 2024-09-14T10:43:40.970 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 283/288 2024-09-14T10:43:40.970 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 284/288 2024-09-14T10:43:40.970 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados2-2:19.3.0-4907.ga2782315.el9.x86_64 285/288 2024-09-14T10:43:40.970 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 286/288 2024-09-14T10:43:40.970 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 287/288 2024-09-14T10:43:44.377 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T10:43:44.377 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:43:44.378 INFO:teuthology.orchestra.run.smithi152.stdout:Upgraded: 2024-09-14T10:43:44.378 INFO:teuthology.orchestra.run.smithi152.stdout: librados2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:43:44.378 INFO:teuthology.orchestra.run.smithi152.stdout: librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:43:44.379 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-14T10:43:44.379 INFO:teuthology.orchestra.run.smithi152.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-14T10:43:44.379 INFO:teuthology.orchestra.run.smithi152.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-14T10:43:44.379 INFO:teuthology.orchestra.run.smithi152.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-14T10:43:44.380 INFO:teuthology.orchestra.run.smithi152.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-14T10:43:44.380 INFO:teuthology.orchestra.run.smithi152.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-14T10:43:44.380 INFO:teuthology.orchestra.run.smithi152.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-14T10:43:44.381 INFO:teuthology.orchestra.run.smithi152.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-14T10:43:44.381 INFO:teuthology.orchestra.run.smithi152.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-14T10:43:44.381 INFO:teuthology.orchestra.run.smithi152.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-14T10:43:44.381 INFO:teuthology.orchestra.run.smithi152.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-14T10:43:44.381 INFO:teuthology.orchestra.run.smithi152.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-14T10:43:44.382 INFO:teuthology.orchestra.run.smithi152.stdout: atinject-1.0.3-6.el9.noarch 2024-09-14T10:43:44.382 INFO:teuthology.orchestra.run.smithi152.stdout: atk-2.36.0-5.el9.x86_64 2024-09-14T10:43:44.382 INFO:teuthology.orchestra.run.smithi152.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-14T10:43:44.382 INFO:teuthology.orchestra.run.smithi152.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-14T10:43:44.383 INFO:teuthology.orchestra.run.smithi152.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-14T10:43:44.383 INFO:teuthology.orchestra.run.smithi152.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-14T10:43:44.383 INFO:teuthology.orchestra.run.smithi152.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-14T10:43:44.383 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:43:44.384 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:43:44.384 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:43:44.384 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:43:44.384 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-grafana-dashboards-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:43:44.385 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-immutable-object-cache-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:43:44.385 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:43:44.385 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:43:44.385 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:43:44.385 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:43:44.386 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:43:44.386 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:43:44.386 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:43:44.386 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:43:44.386 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:43:44.386 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:43:44.386 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:43:44.387 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:43:44.387 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:43:44.387 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:43:44.387 INFO:teuthology.orchestra.run.smithi152.stdout: cephadm-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:43:44.387 INFO:teuthology.orchestra.run.smithi152.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-14T10:43:44.387 INFO:teuthology.orchestra.run.smithi152.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-14T10:43:44.388 INFO:teuthology.orchestra.run.smithi152.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-14T10:43:44.388 INFO:teuthology.orchestra.run.smithi152.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-14T10:43:44.388 INFO:teuthology.orchestra.run.smithi152.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-14T10:43:44.388 INFO:teuthology.orchestra.run.smithi152.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-14T10:43:44.388 INFO:teuthology.orchestra.run.smithi152.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-14T10:43:44.388 INFO:teuthology.orchestra.run.smithi152.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-14T10:43:44.389 INFO:teuthology.orchestra.run.smithi152.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-14T10:43:44.389 INFO:teuthology.orchestra.run.smithi152.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-14T10:43:44.389 INFO:teuthology.orchestra.run.smithi152.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-14T10:43:44.389 INFO:teuthology.orchestra.run.smithi152.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-14T10:43:44.389 INFO:teuthology.orchestra.run.smithi152.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-14T10:43:44.390 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-14T10:43:44.390 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-14T10:43:44.390 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-14T10:43:44.390 INFO:teuthology.orchestra.run.smithi152.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-14T10:43:44.390 INFO:teuthology.orchestra.run.smithi152.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-14T10:43:44.390 INFO:teuthology.orchestra.run.smithi152.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-14T10:43:44.390 INFO:teuthology.orchestra.run.smithi152.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-14T10:43:44.391 INFO:teuthology.orchestra.run.smithi152.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-14T10:43:44.391 INFO:teuthology.orchestra.run.smithi152.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-14T10:43:44.391 INFO:teuthology.orchestra.run.smithi152.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-14T10:43:44.391 INFO:teuthology.orchestra.run.smithi152.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-14T10:43:44.391 INFO:teuthology.orchestra.run.smithi152.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-14T10:43:44.391 INFO:teuthology.orchestra.run.smithi152.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-14T10:43:44.392 INFO:teuthology.orchestra.run.smithi152.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-14T10:43:44.392 INFO:teuthology.orchestra.run.smithi152.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-14T10:43:44.392 INFO:teuthology.orchestra.run.smithi152.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-14T10:43:44.392 INFO:teuthology.orchestra.run.smithi152.stdout: guava-30.1-6.el9.noarch 2024-09-14T10:43:44.392 INFO:teuthology.orchestra.run.smithi152.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-14T10:43:44.393 INFO:teuthology.orchestra.run.smithi152.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-14T10:43:44.393 INFO:teuthology.orchestra.run.smithi152.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-14T10:43:44.393 INFO:teuthology.orchestra.run.smithi152.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-14T10:43:44.393 INFO:teuthology.orchestra.run.smithi152.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-14T10:43:44.394 INFO:teuthology.orchestra.run.smithi152.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-14T10:43:44.394 INFO:teuthology.orchestra.run.smithi152.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T10:43:44.394 INFO:teuthology.orchestra.run.smithi152.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T10:43:44.394 INFO:teuthology.orchestra.run.smithi152.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T10:43:44.394 INFO:teuthology.orchestra.run.smithi152.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-14T10:43:44.394 INFO:teuthology.orchestra.run.smithi152.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-14T10:43:44.395 INFO:teuthology.orchestra.run.smithi152.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-14T10:43:44.395 INFO:teuthology.orchestra.run.smithi152.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-14T10:43:44.395 INFO:teuthology.orchestra.run.smithi152.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-14T10:43:44.395 INFO:teuthology.orchestra.run.smithi152.stdout: lcms2-2.12-3.el9.x86_64 2024-09-14T10:43:44.396 INFO:teuthology.orchestra.run.smithi152.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-14T10:43:44.396 INFO:teuthology.orchestra.run.smithi152.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-14T10:43:44.396 INFO:teuthology.orchestra.run.smithi152.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-14T10:43:44.396 INFO:teuthology.orchestra.run.smithi152.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-14T10:43:44.396 INFO:teuthology.orchestra.run.smithi152.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-14T10:43:44.397 INFO:teuthology.orchestra.run.smithi152.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-14T10:43:44.397 INFO:teuthology.orchestra.run.smithi152.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-14T10:43:44.397 INFO:teuthology.orchestra.run.smithi152.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-14T10:43:44.397 INFO:teuthology.orchestra.run.smithi152.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-14T10:43:44.397 INFO:teuthology.orchestra.run.smithi152.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-14T10:43:44.397 INFO:teuthology.orchestra.run.smithi152.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-14T10:43:44.398 INFO:teuthology.orchestra.run.smithi152.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-14T10:43:44.398 INFO:teuthology.orchestra.run.smithi152.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-14T10:43:44.398 INFO:teuthology.orchestra.run.smithi152.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-14T10:43:44.398 INFO:teuthology.orchestra.run.smithi152.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-14T10:43:44.398 INFO:teuthology.orchestra.run.smithi152.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-14T10:43:44.398 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:43:44.399 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:43:44.399 INFO:teuthology.orchestra.run.smithi152.stdout: libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:43:44.399 INFO:teuthology.orchestra.run.smithi152.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-14T10:43:44.399 INFO:teuthology.orchestra.run.smithi152.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-14T10:43:44.399 INFO:teuthology.orchestra.run.smithi152.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-14T10:43:44.399 INFO:teuthology.orchestra.run.smithi152.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-14T10:43:44.400 INFO:teuthology.orchestra.run.smithi152.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-14T10:43:44.400 INFO:teuthology.orchestra.run.smithi152.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-14T10:43:44.400 INFO:teuthology.orchestra.run.smithi152.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-14T10:43:44.400 INFO:teuthology.orchestra.run.smithi152.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-14T10:43:44.400 INFO:teuthology.orchestra.run.smithi152.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-14T10:43:44.400 INFO:teuthology.orchestra.run.smithi152.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-14T10:43:44.401 INFO:teuthology.orchestra.run.smithi152.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-14T10:43:44.401 INFO:teuthology.orchestra.run.smithi152.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-14T10:43:44.401 INFO:teuthology.orchestra.run.smithi152.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-14T10:43:44.401 INFO:teuthology.orchestra.run.smithi152.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-14T10:43:44.401 INFO:teuthology.orchestra.run.smithi152.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-14T10:43:44.401 INFO:teuthology.orchestra.run.smithi152.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-14T10:43:44.402 INFO:teuthology.orchestra.run.smithi152.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-14T10:43:44.402 INFO:teuthology.orchestra.run.smithi152.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-14T10:43:44.402 INFO:teuthology.orchestra.run.smithi152.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-14T10:43:44.402 INFO:teuthology.orchestra.run.smithi152.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-14T10:43:44.402 INFO:teuthology.orchestra.run.smithi152.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-14T10:43:44.402 INFO:teuthology.orchestra.run.smithi152.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-14T10:43:44.403 INFO:teuthology.orchestra.run.smithi152.stdout: librados-devel-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:43:44.403 INFO:teuthology.orchestra.run.smithi152.stdout: libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:43:44.403 INFO:teuthology.orchestra.run.smithi152.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-14T10:43:44.403 INFO:teuthology.orchestra.run.smithi152.stdout: librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:43:44.403 INFO:teuthology.orchestra.run.smithi152.stdout: libsbc-1.4-9.el9.x86_64 2024-09-14T10:43:44.403 INFO:teuthology.orchestra.run.smithi152.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-14T10:43:44.404 INFO:teuthology.orchestra.run.smithi152.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-14T10:43:44.404 INFO:teuthology.orchestra.run.smithi152.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-14T10:43:44.404 INFO:teuthology.orchestra.run.smithi152.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-14T10:43:44.404 INFO:teuthology.orchestra.run.smithi152.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-14T10:43:44.404 INFO:teuthology.orchestra.run.smithi152.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-14T10:43:44.404 INFO:teuthology.orchestra.run.smithi152.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-14T10:43:44.405 INFO:teuthology.orchestra.run.smithi152.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-14T10:43:44.405 INFO:teuthology.orchestra.run.smithi152.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-14T10:43:44.405 INFO:teuthology.orchestra.run.smithi152.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-14T10:43:44.405 INFO:teuthology.orchestra.run.smithi152.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-14T10:43:44.405 INFO:teuthology.orchestra.run.smithi152.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-14T10:43:44.405 INFO:teuthology.orchestra.run.smithi152.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-14T10:43:44.406 INFO:teuthology.orchestra.run.smithi152.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-14T10:43:44.406 INFO:teuthology.orchestra.run.smithi152.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-14T10:43:44.406 INFO:teuthology.orchestra.run.smithi152.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-14T10:43:44.406 INFO:teuthology.orchestra.run.smithi152.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-14T10:43:44.406 INFO:teuthology.orchestra.run.smithi152.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-14T10:43:44.406 INFO:teuthology.orchestra.run.smithi152.stdout: lua-5.4.4-4.el9.x86_64 2024-09-14T10:43:44.407 INFO:teuthology.orchestra.run.smithi152.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-14T10:43:44.407 INFO:teuthology.orchestra.run.smithi152.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-14T10:43:44.407 INFO:teuthology.orchestra.run.smithi152.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-14T10:43:44.407 INFO:teuthology.orchestra.run.smithi152.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-14T10:43:44.407 INFO:teuthology.orchestra.run.smithi152.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-14T10:43:44.408 INFO:teuthology.orchestra.run.smithi152.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-14T10:43:44.408 INFO:teuthology.orchestra.run.smithi152.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-14T10:43:44.408 INFO:teuthology.orchestra.run.smithi152.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-14T10:43:44.408 INFO:teuthology.orchestra.run.smithi152.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-14T10:43:44.408 INFO:teuthology.orchestra.run.smithi152.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-14T10:43:44.408 INFO:teuthology.orchestra.run.smithi152.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-14T10:43:44.409 INFO:teuthology.orchestra.run.smithi152.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-14T10:43:44.409 INFO:teuthology.orchestra.run.smithi152.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-14T10:43:44.409 INFO:teuthology.orchestra.run.smithi152.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-14T10:43:44.409 INFO:teuthology.orchestra.run.smithi152.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-14T10:43:44.409 INFO:teuthology.orchestra.run.smithi152.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-14T10:43:44.409 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-14T10:43:44.410 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-14T10:43:44.410 INFO:teuthology.orchestra.run.smithi152.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-14T10:43:44.410 INFO:teuthology.orchestra.run.smithi152.stdout: opus-1.3.1-10.el9.x86_64 2024-09-14T10:43:44.410 INFO:teuthology.orchestra.run.smithi152.stdout: orc-0.4.31-8.el9.x86_64 2024-09-14T10:43:44.410 INFO:teuthology.orchestra.run.smithi152.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-14T10:43:44.410 INFO:teuthology.orchestra.run.smithi152.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-14T10:43:44.411 INFO:teuthology.orchestra.run.smithi152.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-14T10:43:44.411 INFO:teuthology.orchestra.run.smithi152.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-14T10:43:44.411 INFO:teuthology.orchestra.run.smithi152.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-14T10:43:44.411 INFO:teuthology.orchestra.run.smithi152.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-14T10:43:44.411 INFO:teuthology.orchestra.run.smithi152.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-14T10:43:44.411 INFO:teuthology.orchestra.run.smithi152.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-14T10:43:44.412 INFO:teuthology.orchestra.run.smithi152.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-14T10:43:44.412 INFO:teuthology.orchestra.run.smithi152.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-14T10:43:44.412 INFO:teuthology.orchestra.run.smithi152.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-14T10:43:44.412 INFO:teuthology.orchestra.run.smithi152.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-14T10:43:44.412 INFO:teuthology.orchestra.run.smithi152.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-14T10:43:44.412 INFO:teuthology.orchestra.run.smithi152.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-14T10:43:44.413 INFO:teuthology.orchestra.run.smithi152.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-14T10:43:44.413 INFO:teuthology.orchestra.run.smithi152.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-14T10:43:44.413 INFO:teuthology.orchestra.run.smithi152.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-14T10:43:44.413 INFO:teuthology.orchestra.run.smithi152.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-14T10:43:44.413 INFO:teuthology.orchestra.run.smithi152.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-14T10:43:44.413 INFO:teuthology.orchestra.run.smithi152.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-14T10:43:44.414 INFO:teuthology.orchestra.run.smithi152.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-14T10:43:44.414 INFO:teuthology.orchestra.run.smithi152.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-14T10:43:44.414 INFO:teuthology.orchestra.run.smithi152.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-14T10:43:44.414 INFO:teuthology.orchestra.run.smithi152.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-14T10:43:44.414 INFO:teuthology.orchestra.run.smithi152.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-14T10:43:44.414 INFO:teuthology.orchestra.run.smithi152.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-14T10:43:44.415 INFO:teuthology.orchestra.run.smithi152.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-14T10:43:44.415 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-14T10:43:44.415 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-argparse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:43:44.415 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:43:44.415 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:43:44.415 INFO:teuthology.orchestra.run.smithi152.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-14T10:43:44.416 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-14T10:43:44.416 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-14T10:43:44.416 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-14T10:43:44.416 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-14T10:43:44.416 INFO:teuthology.orchestra.run.smithi152.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-14T10:43:44.417 INFO:teuthology.orchestra.run.smithi152.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-14T10:43:44.417 INFO:teuthology.orchestra.run.smithi152.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-14T10:43:44.417 INFO:teuthology.orchestra.run.smithi152.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-14T10:43:44.417 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-14T10:43:44.418 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-14T10:43:44.418 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-14T10:43:44.418 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-14T10:43:44.418 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-14T10:43:44.418 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-14T10:43:44.419 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-14T10:43:44.419 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-14T10:43:44.419 INFO:teuthology.orchestra.run.smithi152.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-14T10:43:44.419 INFO:teuthology.orchestra.run.smithi152.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-14T10:43:44.419 INFO:teuthology.orchestra.run.smithi152.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-14T10:43:44.419 INFO:teuthology.orchestra.run.smithi152.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-14T10:43:44.419 INFO:teuthology.orchestra.run.smithi152.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-14T10:43:44.419 INFO:teuthology.orchestra.run.smithi152.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-14T10:43:44.419 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-14T10:43:44.419 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-14T10:43:44.419 INFO:teuthology.orchestra.run.smithi152.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-14T10:43:44.419 INFO:teuthology.orchestra.run.smithi152.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-14T10:43:44.420 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-14T10:43:44.420 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ply-3.11-14.el9.noarch 2024-09-14T10:43:44.420 INFO:teuthology.orchestra.run.smithi152.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-14T10:43:44.420 INFO:teuthology.orchestra.run.smithi152.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-14T10:43:44.420 INFO:teuthology.orchestra.run.smithi152.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-14T10:43:44.420 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-14T10:43:44.420 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-14T10:43:44.420 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-14T10:43:44.420 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-14T10:43:44.420 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-14T10:43:44.421 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:43:44.421 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:43:44.421 INFO:teuthology.orchestra.run.smithi152.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-14T10:43:44.421 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-14T10:43:44.421 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-14T10:43:44.421 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:43:44.421 INFO:teuthology.orchestra.run.smithi152.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-14T10:43:44.421 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-14T10:43:44.421 INFO:teuthology.orchestra.run.smithi152.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-14T10:43:44.421 INFO:teuthology.orchestra.run.smithi152.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-14T10:43:44.421 INFO:teuthology.orchestra.run.smithi152.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-14T10:43:44.421 INFO:teuthology.orchestra.run.smithi152.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-14T10:43:44.422 INFO:teuthology.orchestra.run.smithi152.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-14T10:43:44.422 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-14T10:43:44.422 INFO:teuthology.orchestra.run.smithi152.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-14T10:43:44.422 INFO:teuthology.orchestra.run.smithi152.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-14T10:43:44.422 INFO:teuthology.orchestra.run.smithi152.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-14T10:43:44.422 INFO:teuthology.orchestra.run.smithi152.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-14T10:43:44.422 INFO:teuthology.orchestra.run.smithi152.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-14T10:43:44.423 INFO:teuthology.orchestra.run.smithi152.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-14T10:43:44.423 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:43:44.423 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:43:44.423 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:43:44.423 INFO:teuthology.orchestra.run.smithi152.stdout: re2-1:20211101-20.el9.x86_64 2024-09-14T10:43:44.423 INFO:teuthology.orchestra.run.smithi152.stdout: rtkit-0.11-29.el9.x86_64 2024-09-14T10:43:44.424 INFO:teuthology.orchestra.run.smithi152.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-14T10:43:44.424 INFO:teuthology.orchestra.run.smithi152.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-14T10:43:44.424 INFO:teuthology.orchestra.run.smithi152.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-14T10:43:44.424 INFO:teuthology.orchestra.run.smithi152.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-14T10:43:44.424 INFO:teuthology.orchestra.run.smithi152.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-14T10:43:44.424 INFO:teuthology.orchestra.run.smithi152.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-14T10:43:44.425 INFO:teuthology.orchestra.run.smithi152.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-14T10:43:44.425 INFO:teuthology.orchestra.run.smithi152.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-14T10:43:44.425 INFO:teuthology.orchestra.run.smithi152.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-14T10:43:44.425 INFO:teuthology.orchestra.run.smithi152.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-14T10:43:44.425 INFO:teuthology.orchestra.run.smithi152.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-14T10:43:44.425 INFO:teuthology.orchestra.run.smithi152.stdout: upower-0.99.11-11.el9.x86_64 2024-09-14T10:43:44.426 INFO:teuthology.orchestra.run.smithi152.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-14T10:43:44.426 INFO:teuthology.orchestra.run.smithi152.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-14T10:43:44.426 INFO:teuthology.orchestra.run.smithi152.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-14T10:43:44.426 INFO:teuthology.orchestra.run.smithi152.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-14T10:43:44.426 INFO:teuthology.orchestra.run.smithi152.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-14T10:43:44.426 INFO:teuthology.orchestra.run.smithi152.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-14T10:43:44.427 INFO:teuthology.orchestra.run.smithi152.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-14T10:43:44.427 INFO:teuthology.orchestra.run.smithi152.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-14T10:43:44.427 INFO:teuthology.orchestra.run.smithi152.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-14T10:43:44.427 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:43:44.427 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-14T10:43:44.820 DEBUG:teuthology.parallel:result is None 2024-09-14T10:43:50.081 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 188/288 2024-09-14T10:43:50.081 INFO:teuthology.orchestra.run.smithi097.stdout:skipping the directory /sys 2024-09-14T10:43:50.082 INFO:teuthology.orchestra.run.smithi097.stdout:skipping the directory /proc 2024-09-14T10:43:50.082 INFO:teuthology.orchestra.run.smithi097.stdout:skipping the directory /mnt 2024-09-14T10:43:50.082 INFO:teuthology.orchestra.run.smithi097.stdout:skipping the directory /var/tmp 2024-09-14T10:43:50.082 INFO:teuthology.orchestra.run.smithi097.stdout:skipping the directory /home 2024-09-14T10:43:50.082 INFO:teuthology.orchestra.run.smithi097.stdout:skipping the directory /root 2024-09-14T10:43:50.082 INFO:teuthology.orchestra.run.smithi097.stdout:skipping the directory /tmp 2024-09-14T10:43:50.082 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:43:50.263 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 189/288 2024-09-14T10:43:50.278 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 189/288 2024-09-14T10:43:50.278 INFO:teuthology.orchestra.run.smithi097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:43:50.278 INFO:teuthology.orchestra.run.smithi097.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-14T10:43:50.278 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:43:51.755 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 190/288 2024-09-14T10:43:51.781 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 190/288 2024-09-14T10:43:51.782 INFO:teuthology.orchestra.run.smithi097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:43:51.782 INFO:teuthology.orchestra.run.smithi097.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-14T10:43:51.782 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T10:43:51.782 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T10:43:51.782 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:43:52.006 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 191/288 2024-09-14T10:43:52.028 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 191/288 2024-09-14T10:43:52.028 INFO:teuthology.orchestra.run.smithi097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:43:52.029 INFO:teuthology.orchestra.run.smithi097.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-14T10:43:52.029 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T10:43:52.029 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T10:43:52.029 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:43:52.481 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 192/288 2024-09-14T10:43:52.504 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 192/288 2024-09-14T10:43:52.504 INFO:teuthology.orchestra.run.smithi097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:43:52.504 INFO:teuthology.orchestra.run.smithi097.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-14T10:43:52.504 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T10:43:52.505 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T10:43:52.505 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:43:52.609 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 193/288 2024-09-14T10:43:55.471 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 194/288 2024-09-14T10:43:55.583 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 195/288 2024-09-14T10:43:55.649 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-ply-3.11-14.el9.noarch 196/288 2024-09-14T10:43:55.714 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 197/288 2024-09-14T10:43:55.898 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 198/288 2024-09-14T10:43:55.953 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 199/288 2024-09-14T10:43:56.032 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 200/288 2024-09-14T10:43:56.120 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 201/288 2024-09-14T10:43:56.261 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 202/288 2024-09-14T10:43:56.295 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 203/288 2024-09-14T10:43:56.337 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 204/288 2024-09-14T10:43:57.203 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 205/288 2024-09-14T10:43:57.262 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-14T10:43:57.614 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-14T10:43:57.660 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 207/288 2024-09-14T10:43:57.691 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : slf4j-1.7.30-13.el9.noarch 208/288 2024-09-14T10:43:57.719 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : atinject-1.0.3-6.el9.noarch 209/288 2024-09-14T10:43:57.754 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 210/288 2024-09-14T10:43:57.791 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 211/288 2024-09-14T10:43:57.818 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 212/288 2024-09-14T10:43:57.844 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 213/288 2024-09-14T10:43:57.869 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 214/288 2024-09-14T10:43:57.894 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 215/288 2024-09-14T10:43:57.920 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 216/288 2024-09-14T10:43:57.946 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 217/288 2024-09-14T10:43:57.973 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 218/288 2024-09-14T10:43:58.004 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 219/288 2024-09-14T10:43:58.047 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 220/288 2024-09-14T10:43:58.083 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 221/288 2024-09-14T10:43:58.119 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 222/288 2024-09-14T10:43:58.150 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 223/288 2024-09-14T10:43:58.184 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 224/288 2024-09-14T10:43:58.218 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : jansi-2.3.3-6.el9.x86_64 225/288 2024-09-14T10:43:58.255 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : jsoup-1.13.1-10.el9.noarch 226/288 2024-09-14T10:43:58.302 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 227/288 2024-09-14T10:43:58.352 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 228/288 2024-09-14T10:43:58.397 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 229/288 2024-09-14T10:43:58.429 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : guava-30.1-6.el9.noarch 230/288 2024-09-14T10:43:58.452 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : google-guice-4.2.3-9.el9.noarch 231/288 2024-09-14T10:43:58.505 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 232/288 2024-09-14T10:43:58.537 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 233/288 2024-09-14T10:43:58.567 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 234/288 2024-09-14T10:43:58.605 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 235/288 2024-09-14T10:43:58.630 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 236/288 2024-09-14T10:43:58.799 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 237/288 2024-09-14T10:43:58.831 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 238/288 2024-09-14T10:43:58.858 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 239/288 2024-09-14T10:43:58.884 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 240/288 2024-09-14T10:43:58.918 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 241/288 2024-09-14T10:43:59.056 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 242/288 2024-09-14T10:43:59.125 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 243/288 2024-09-14T10:43:59.194 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 244/288 2024-09-14T10:43:59.230 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : tracker-3.1.2-3.el9.x86_64 245/288 2024-09-14T10:43:59.346 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 245/288 2024-09-14T10:43:59.385 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-14T10:43:59.403 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-14T10:43:59.439 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 247/288 2024-09-14T10:43:59.462 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 248/288 2024-09-14T10:43:59.926 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T10:43:59.966 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T10:43:59.982 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T10:43:59.982 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-14T10:43:59.982 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:44:00.217 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 250/288 2024-09-14T10:44:00.285 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 251/288 2024-09-14T10:44:00.325 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 252/288 2024-09-14T10:44:00.361 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 253/288 2024-09-14T10:44:00.386 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 254/288 2024-09-14T10:44:00.829 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T10:44:00.857 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T10:44:00.873 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T10:44:01.413 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-14T10:44:01.502 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-14T10:44:01.540 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-14T10:44:01.567 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-14T10:44:01.762 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 258/288 2024-09-14T10:44:01.830 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 259/288 2024-09-14T10:44:01.856 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-14T10:44:01.876 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-14T10:44:01.915 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-14T10:44:01.982 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-14T10:44:02.018 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-14T10:44:02.028 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-14T10:44:02.060 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : maven-1:3.6.3-15.el9.noarch 263/288 2024-09-14T10:44:02.080 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 263/288 2024-09-14T10:44:02.102 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 264/288 2024-09-14T10:44:02.531 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: cephadm-2:19.3.0-4907.ga2782315.el9.noarch 265/288 2024-09-14T10:44:02.558 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : cephadm-2:19.3.0-4907.ga2782315.el9.noarch 265/288 2024-09-14T10:44:02.592 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.e 266/288 2024-09-14T10:44:02.658 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4907.ga2782315. 267/288 2024-09-14T10:44:02.682 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 268/288 2024-09-14T10:44:05.878 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 268/288 2024-09-14T10:44:05.939 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 269/288 2024-09-14T10:44:06.900 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 269/288 2024-09-14T10:44:06.931 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 270/288 2024-09-14T10:44:07.045 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 270/288 2024-09-14T10:44:07.210 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el 271/288 2024-09-14T10:44:07.241 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 272/288 2024-09-14T10:44:07.264 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 272/288 2024-09-14T10:44:07.265 INFO:teuthology.orchestra.run.smithi097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:44:07.265 INFO:teuthology.orchestra.run.smithi097.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-14T10:44:07.265 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T10:44:07.265 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T10:44:07.265 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:44:07.308 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 273/288 2024-09-14T10:44:07.319 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 273/288 2024-09-14T10:44:07.343 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-2:19.3.0-4907.ga2782315.el9.x86_64 274/288 2024-09-14T10:44:07.372 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 275/288 2024-09-14T10:44:07.420 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 276/288 2024-09-14T10:44:07.444 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-14T10:44:07.459 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-14T10:44:07.459 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-14T10:44:07.459 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:44:08.412 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 278/288 2024-09-14T10:44:08.434 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 278/288 2024-09-14T10:44:08.434 INFO:teuthology.orchestra.run.smithi097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:44:08.435 INFO:teuthology.orchestra.run.smithi097.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-14T10:44:08.435 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T10:44:08.435 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T10:44:08.435 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:44:08.479 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4907.ga2782 279/288 2024-09-14T10:44:08.504 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4907.ga2782 279/288 2024-09-14T10:44:08.505 INFO:teuthology.orchestra.run.smithi097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:44:08.505 INFO:teuthology.orchestra.run.smithi097.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-14T10:44:08.505 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:44:08.822 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 280/288 2024-09-14T10:44:08.844 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 280/288 2024-09-14T10:44:08.844 INFO:teuthology.orchestra.run.smithi097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:44:08.844 INFO:teuthology.orchestra.run.smithi097.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-14T10:44:08.844 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T10:44:08.844 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T10:44:08.844 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:44:13.525 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 281/288 2024-09-14T10:44:13.566 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 282/288 2024-09-14T10:44:13.597 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 283/288 2024-09-14T10:44:13.702 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_ 284/288 2024-09-14T10:44:13.766 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 285/288 2024-09-14T10:44:13.797 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 286/288 2024-09-14T10:44:13.797 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-14T10:44:13.890 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-14T10:44:13.890 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T10:44:13.972 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T10:44:13.993 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 288/288 2024-09-14T10:44:13.998 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 288/288 2024-09-14T10:44:14.007 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 288/288 2024-09-14T10:44:14.016 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 288/288 2024-09-14T10:44:14.017 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-14T10:44:14.017 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-14T10:44:14.017 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:44:14.077 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-14T10:44:14.145 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-14T10:44:24.179 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T10:44:24.179 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-2:19.3.0-4907.ga2782315.el9.x86_64 1/288 2024-09-14T10:44:24.179 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 2/288 2024-09-14T10:44:24.179 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 3/288 2024-09-14T10:44:24.179 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 4/288 2024-09-14T10:44:24.179 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4907.ga2782 5/288 2024-09-14T10:44:24.179 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 6/288 2024-09-14T10:44:24.180 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 7/288 2024-09-14T10:44:24.180 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 8/288 2024-09-14T10:44:24.180 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 9/288 2024-09-14T10:44:24.180 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T10:44:24.180 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T10:44:24.180 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 12/288 2024-09-14T10:44:24.180 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_ 13/288 2024-09-14T10:44:24.180 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 14/288 2024-09-14T10:44:24.180 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 15/288 2024-09-14T10:44:24.180 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : librados-devel-2:19.3.0-4907.ga2782315.el9.x86_6 16/288 2024-09-14T10:44:24.180 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 17/288 2024-09-14T10:44:24.180 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 18/288 2024-09-14T10:44:24.181 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4907.ga2782315.el 19/288 2024-09-14T10:44:24.181 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-ceph-common-2:19.3.0-4907.ga2782315.el9. 20/288 2024-09-14T10:44:24.181 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_6 21/288 2024-09-14T10:44:24.181 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 22/288 2024-09-14T10:44:24.181 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 23/288 2024-09-14T10:44:24.181 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 24/288 2024-09-14T10:44:24.181 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T10:44:24.181 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 26/288 2024-09-14T10:44:24.181 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 27/288 2024-09-14T10:44:24.181 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4907.ga2782315. 28/288 2024-09-14T10:44:24.182 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 29/288 2024-09-14T10:44:24.182 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 30/288 2024-09-14T10:44:24.182 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 31/288 2024-09-14T10:44:24.182 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el 32/288 2024-09-14T10:44:24.182 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 33/288 2024-09-14T10:44:24.182 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.e 34/288 2024-09-14T10:44:24.182 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 35/288 2024-09-14T10:44:24.182 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : cephadm-2:19.3.0-4907.ga2782315.el9.noarch 36/288 2024-09-14T10:44:24.182 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/288 2024-09-14T10:44:24.182 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/288 2024-09-14T10:44:24.182 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/288 2024-09-14T10:44:24.183 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/288 2024-09-14T10:44:24.183 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/288 2024-09-14T10:44:24.183 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/288 2024-09-14T10:44:24.183 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/288 2024-09-14T10:44:24.183 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/288 2024-09-14T10:44:24.183 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/288 2024-09-14T10:44:24.183 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/288 2024-09-14T10:44:24.183 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/288 2024-09-14T10:44:24.183 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/288 2024-09-14T10:44:24.183 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/288 2024-09-14T10:44:24.183 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/288 2024-09-14T10:44:24.183 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/288 2024-09-14T10:44:24.183 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/288 2024-09-14T10:44:24.184 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/288 2024-09-14T10:44:24.184 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/288 2024-09-14T10:44:24.184 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/288 2024-09-14T10:44:24.184 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/288 2024-09-14T10:44:24.184 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/288 2024-09-14T10:44:24.184 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/288 2024-09-14T10:44:24.184 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/288 2024-09-14T10:44:24.184 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/288 2024-09-14T10:44:24.184 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/288 2024-09-14T10:44:24.184 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/288 2024-09-14T10:44:24.184 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/288 2024-09-14T10:44:24.184 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/288 2024-09-14T10:44:24.184 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/288 2024-09-14T10:44:24.185 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/288 2024-09-14T10:44:24.185 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/288 2024-09-14T10:44:24.185 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/288 2024-09-14T10:44:24.185 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/288 2024-09-14T10:44:24.185 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/288 2024-09-14T10:44:24.185 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/288 2024-09-14T10:44:24.185 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/288 2024-09-14T10:44:24.185 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/288 2024-09-14T10:44:24.185 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/288 2024-09-14T10:44:24.185 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/288 2024-09-14T10:44:24.185 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/288 2024-09-14T10:44:24.185 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/288 2024-09-14T10:44:24.185 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/288 2024-09-14T10:44:24.186 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/288 2024-09-14T10:44:24.186 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/288 2024-09-14T10:44:24.186 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/288 2024-09-14T10:44:24.186 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/288 2024-09-14T10:44:24.186 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/288 2024-09-14T10:44:24.186 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/288 2024-09-14T10:44:24.186 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/288 2024-09-14T10:44:24.186 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/288 2024-09-14T10:44:24.186 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/288 2024-09-14T10:44:24.186 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/288 2024-09-14T10:44:24.186 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/288 2024-09-14T10:44:24.186 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/288 2024-09-14T10:44:24.186 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : guava-30.1-6.el9.noarch 91/288 2024-09-14T10:44:24.187 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/288 2024-09-14T10:44:24.187 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/288 2024-09-14T10:44:24.187 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/288 2024-09-14T10:44:24.187 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/288 2024-09-14T10:44:24.187 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/288 2024-09-14T10:44:24.187 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/288 2024-09-14T10:44:24.187 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/288 2024-09-14T10:44:24.187 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/288 2024-09-14T10:44:24.187 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/288 2024-09-14T10:44:24.187 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/288 2024-09-14T10:44:24.187 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/288 2024-09-14T10:44:24.187 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/288 2024-09-14T10:44:24.187 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/288 2024-09-14T10:44:24.187 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/288 2024-09-14T10:44:24.188 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/288 2024-09-14T10:44:24.188 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/288 2024-09-14T10:44:24.188 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/288 2024-09-14T10:44:24.188 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/288 2024-09-14T10:44:24.188 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/288 2024-09-14T10:44:24.188 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/288 2024-09-14T10:44:24.188 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/288 2024-09-14T10:44:24.188 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/288 2024-09-14T10:44:24.188 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/288 2024-09-14T10:44:24.188 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/288 2024-09-14T10:44:24.188 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/288 2024-09-14T10:44:24.188 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/288 2024-09-14T10:44:24.188 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/288 2024-09-14T10:44:24.189 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/288 2024-09-14T10:44:24.189 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/288 2024-09-14T10:44:24.189 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/288 2024-09-14T10:44:24.189 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/288 2024-09-14T10:44:24.189 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/288 2024-09-14T10:44:24.189 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/288 2024-09-14T10:44:24.189 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/288 2024-09-14T10:44:24.189 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/288 2024-09-14T10:44:24.189 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/288 2024-09-14T10:44:24.189 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/288 2024-09-14T10:44:24.189 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/288 2024-09-14T10:44:24.189 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/288 2024-09-14T10:44:24.189 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/288 2024-09-14T10:44:24.190 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/288 2024-09-14T10:44:24.190 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 133/288 2024-09-14T10:44:24.190 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 134/288 2024-09-14T10:44:24.190 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 135/288 2024-09-14T10:44:24.190 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 136/288 2024-09-14T10:44:24.190 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 137/288 2024-09-14T10:44:24.190 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 138/288 2024-09-14T10:44:24.190 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 139/288 2024-09-14T10:44:24.190 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libsbc-1.4-9.el9.x86_64 140/288 2024-09-14T10:44:24.190 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 141/288 2024-09-14T10:44:24.190 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 142/288 2024-09-14T10:44:24.190 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 143/288 2024-09-14T10:44:24.190 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 144/288 2024-09-14T10:44:24.190 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 145/288 2024-09-14T10:44:24.191 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 146/288 2024-09-14T10:44:24.191 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 147/288 2024-09-14T10:44:24.191 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 148/288 2024-09-14T10:44:24.191 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 149/288 2024-09-14T10:44:24.191 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 150/288 2024-09-14T10:44:24.191 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 151/288 2024-09-14T10:44:24.191 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 152/288 2024-09-14T10:44:24.191 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 153/288 2024-09-14T10:44:24.191 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 154/288 2024-09-14T10:44:24.191 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 155/288 2024-09-14T10:44:24.191 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 156/288 2024-09-14T10:44:24.191 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : lua-5.4.4-4.el9.x86_64 157/288 2024-09-14T10:44:24.191 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 158/288 2024-09-14T10:44:24.192 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 159/288 2024-09-14T10:44:24.192 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 160/288 2024-09-14T10:44:24.192 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 161/288 2024-09-14T10:44:24.192 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 162/288 2024-09-14T10:44:24.192 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 163/288 2024-09-14T10:44:24.192 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 164/288 2024-09-14T10:44:24.192 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 165/288 2024-09-14T10:44:24.192 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 166/288 2024-09-14T10:44:24.192 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 167/288 2024-09-14T10:44:24.192 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 168/288 2024-09-14T10:44:24.192 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 169/288 2024-09-14T10:44:24.192 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 170/288 2024-09-14T10:44:24.192 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 171/288 2024-09-14T10:44:24.193 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 172/288 2024-09-14T10:44:24.193 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 173/288 2024-09-14T10:44:24.193 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 174/288 2024-09-14T10:44:24.193 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : opus-1.3.1-10.el9.x86_64 175/288 2024-09-14T10:44:24.193 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : orc-0.4.31-8.el9.x86_64 176/288 2024-09-14T10:44:24.193 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 177/288 2024-09-14T10:44:24.193 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 178/288 2024-09-14T10:44:24.193 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 179/288 2024-09-14T10:44:24.193 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 180/288 2024-09-14T10:44:24.193 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 181/288 2024-09-14T10:44:24.193 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 182/288 2024-09-14T10:44:24.193 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 183/288 2024-09-14T10:44:24.193 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 184/288 2024-09-14T10:44:24.194 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 185/288 2024-09-14T10:44:24.194 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 186/288 2024-09-14T10:44:24.194 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 187/288 2024-09-14T10:44:24.194 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 188/288 2024-09-14T10:44:24.194 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 189/288 2024-09-14T10:44:24.194 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 190/288 2024-09-14T10:44:24.194 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 191/288 2024-09-14T10:44:24.194 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 192/288 2024-09-14T10:44:24.194 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 193/288 2024-09-14T10:44:24.194 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 194/288 2024-09-14T10:44:24.194 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 195/288 2024-09-14T10:44:24.194 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 196/288 2024-09-14T10:44:24.194 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 197/288 2024-09-14T10:44:24.194 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 198/288 2024-09-14T10:44:24.194 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 199/288 2024-09-14T10:44:24.195 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 200/288 2024-09-14T10:44:24.195 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 201/288 2024-09-14T10:44:24.195 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 202/288 2024-09-14T10:44:24.195 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 203/288 2024-09-14T10:44:24.195 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 204/288 2024-09-14T10:44:24.195 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 205/288 2024-09-14T10:44:24.195 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 206/288 2024-09-14T10:44:24.195 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 207/288 2024-09-14T10:44:24.195 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 208/288 2024-09-14T10:44:24.195 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 209/288 2024-09-14T10:44:24.195 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 210/288 2024-09-14T10:44:24.195 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 211/288 2024-09-14T10:44:24.195 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 212/288 2024-09-14T10:44:24.195 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 213/288 2024-09-14T10:44:24.196 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 214/288 2024-09-14T10:44:24.196 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 215/288 2024-09-14T10:44:24.196 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 216/288 2024-09-14T10:44:24.196 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 217/288 2024-09-14T10:44:24.196 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 218/288 2024-09-14T10:44:24.196 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 219/288 2024-09-14T10:44:24.196 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 220/288 2024-09-14T10:44:24.196 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : rtkit-0.11-29.el9.x86_64 221/288 2024-09-14T10:44:24.196 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 222/288 2024-09-14T10:44:24.196 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 223/288 2024-09-14T10:44:24.196 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 224/288 2024-09-14T10:44:24.196 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 225/288 2024-09-14T10:44:24.197 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 226/288 2024-09-14T10:44:24.197 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 227/288 2024-09-14T10:44:24.197 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 228/288 2024-09-14T10:44:24.197 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 229/288 2024-09-14T10:44:24.197 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 230/288 2024-09-14T10:44:24.197 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : upower-0.99.11-11.el9.x86_64 231/288 2024-09-14T10:44:24.197 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 232/288 2024-09-14T10:44:24.197 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 233/288 2024-09-14T10:44:24.197 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 234/288 2024-09-14T10:44:24.197 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 235/288 2024-09-14T10:44:24.197 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 236/288 2024-09-14T10:44:24.197 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 237/288 2024-09-14T10:44:24.197 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 238/288 2024-09-14T10:44:24.198 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 239/288 2024-09-14T10:44:24.198 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 240/288 2024-09-14T10:44:24.198 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 241/288 2024-09-14T10:44:24.198 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 242/288 2024-09-14T10:44:24.198 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 243/288 2024-09-14T10:44:24.198 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 244/288 2024-09-14T10:44:24.198 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 245/288 2024-09-14T10:44:24.198 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 246/288 2024-09-14T10:44:24.198 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 247/288 2024-09-14T10:44:24.198 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 248/288 2024-09-14T10:44:24.198 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 249/288 2024-09-14T10:44:24.198 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 250/288 2024-09-14T10:44:24.198 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 251/288 2024-09-14T10:44:24.199 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 252/288 2024-09-14T10:44:24.199 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 253/288 2024-09-14T10:44:24.199 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 254/288 2024-09-14T10:44:24.199 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 255/288 2024-09-14T10:44:24.199 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 256/288 2024-09-14T10:44:24.199 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 257/288 2024-09-14T10:44:24.199 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 258/288 2024-09-14T10:44:24.199 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 259/288 2024-09-14T10:44:24.199 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 260/288 2024-09-14T10:44:24.199 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 261/288 2024-09-14T10:44:24.199 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 262/288 2024-09-14T10:44:24.199 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 263/288 2024-09-14T10:44:24.199 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 264/288 2024-09-14T10:44:24.199 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 265/288 2024-09-14T10:44:24.199 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 266/288 2024-09-14T10:44:24.200 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 267/288 2024-09-14T10:44:24.200 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 268/288 2024-09-14T10:44:24.200 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 269/288 2024-09-14T10:44:24.200 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 270/288 2024-09-14T10:44:24.200 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 271/288 2024-09-14T10:44:24.200 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 272/288 2024-09-14T10:44:24.200 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 273/288 2024-09-14T10:44:24.200 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 274/288 2024-09-14T10:44:24.200 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 275/288 2024-09-14T10:44:24.200 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 276/288 2024-09-14T10:44:24.200 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 277/288 2024-09-14T10:44:24.200 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 278/288 2024-09-14T10:44:24.200 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 279/288 2024-09-14T10:44:24.201 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 280/288 2024-09-14T10:44:24.201 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 281/288 2024-09-14T10:44:24.201 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : re2-1:20211101-20.el9.x86_64 282/288 2024-09-14T10:44:24.201 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 283/288 2024-09-14T10:44:24.201 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 284/288 2024-09-14T10:44:24.201 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : librados2-2:19.3.0-4907.ga2782315.el9.x86_64 285/288 2024-09-14T10:44:24.201 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 286/288 2024-09-14T10:44:24.201 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 287/288 2024-09-14T10:44:27.809 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T10:44:27.809 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:44:27.809 INFO:teuthology.orchestra.run.smithi097.stdout:Upgraded: 2024-09-14T10:44:27.809 INFO:teuthology.orchestra.run.smithi097.stdout: librados2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:44:27.809 INFO:teuthology.orchestra.run.smithi097.stdout: librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:44:27.809 INFO:teuthology.orchestra.run.smithi097.stdout:Installed: 2024-09-14T10:44:27.809 INFO:teuthology.orchestra.run.smithi097.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-14T10:44:27.809 INFO:teuthology.orchestra.run.smithi097.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-14T10:44:27.809 INFO:teuthology.orchestra.run.smithi097.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-14T10:44:27.810 INFO:teuthology.orchestra.run.smithi097.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-14T10:44:27.810 INFO:teuthology.orchestra.run.smithi097.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-14T10:44:27.810 INFO:teuthology.orchestra.run.smithi097.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-14T10:44:27.810 INFO:teuthology.orchestra.run.smithi097.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-14T10:44:27.810 INFO:teuthology.orchestra.run.smithi097.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-14T10:44:27.810 INFO:teuthology.orchestra.run.smithi097.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-14T10:44:27.810 INFO:teuthology.orchestra.run.smithi097.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-14T10:44:27.810 INFO:teuthology.orchestra.run.smithi097.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-14T10:44:27.810 INFO:teuthology.orchestra.run.smithi097.stdout: atinject-1.0.3-6.el9.noarch 2024-09-14T10:44:27.810 INFO:teuthology.orchestra.run.smithi097.stdout: atk-2.36.0-5.el9.x86_64 2024-09-14T10:44:27.810 INFO:teuthology.orchestra.run.smithi097.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-14T10:44:27.810 INFO:teuthology.orchestra.run.smithi097.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-14T10:44:27.810 INFO:teuthology.orchestra.run.smithi097.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-14T10:44:27.810 INFO:teuthology.orchestra.run.smithi097.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-14T10:44:27.811 INFO:teuthology.orchestra.run.smithi097.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-14T10:44:27.811 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:44:27.811 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:44:27.811 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:44:27.811 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:44:27.811 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-grafana-dashboards-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:44:27.811 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-immutable-object-cache-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:44:27.811 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:44:27.811 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:44:27.811 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:44:27.811 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:44:27.811 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:44:27.811 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:44:27.812 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:44:27.812 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:44:27.812 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:44:27.812 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:44:27.812 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:44:27.812 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:44:27.812 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:44:27.812 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:44:27.812 INFO:teuthology.orchestra.run.smithi097.stdout: cephadm-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:44:27.812 INFO:teuthology.orchestra.run.smithi097.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-14T10:44:27.812 INFO:teuthology.orchestra.run.smithi097.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-14T10:44:27.812 INFO:teuthology.orchestra.run.smithi097.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-14T10:44:27.812 INFO:teuthology.orchestra.run.smithi097.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-14T10:44:27.812 INFO:teuthology.orchestra.run.smithi097.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-14T10:44:27.813 INFO:teuthology.orchestra.run.smithi097.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-14T10:44:27.813 INFO:teuthology.orchestra.run.smithi097.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-14T10:44:27.813 INFO:teuthology.orchestra.run.smithi097.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-14T10:44:27.813 INFO:teuthology.orchestra.run.smithi097.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-14T10:44:27.813 INFO:teuthology.orchestra.run.smithi097.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-14T10:44:27.813 INFO:teuthology.orchestra.run.smithi097.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-14T10:44:27.813 INFO:teuthology.orchestra.run.smithi097.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-14T10:44:27.813 INFO:teuthology.orchestra.run.smithi097.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-14T10:44:27.813 INFO:teuthology.orchestra.run.smithi097.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-14T10:44:27.813 INFO:teuthology.orchestra.run.smithi097.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-14T10:44:27.813 INFO:teuthology.orchestra.run.smithi097.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-14T10:44:27.814 INFO:teuthology.orchestra.run.smithi097.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-14T10:44:27.814 INFO:teuthology.orchestra.run.smithi097.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-14T10:44:27.814 INFO:teuthology.orchestra.run.smithi097.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-14T10:44:27.814 INFO:teuthology.orchestra.run.smithi097.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-14T10:44:27.814 INFO:teuthology.orchestra.run.smithi097.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-14T10:44:27.814 INFO:teuthology.orchestra.run.smithi097.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-14T10:44:27.814 INFO:teuthology.orchestra.run.smithi097.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-14T10:44:27.814 INFO:teuthology.orchestra.run.smithi097.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-14T10:44:27.814 INFO:teuthology.orchestra.run.smithi097.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-14T10:44:27.814 INFO:teuthology.orchestra.run.smithi097.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-14T10:44:27.814 INFO:teuthology.orchestra.run.smithi097.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-14T10:44:27.814 INFO:teuthology.orchestra.run.smithi097.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-14T10:44:27.815 INFO:teuthology.orchestra.run.smithi097.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-14T10:44:27.815 INFO:teuthology.orchestra.run.smithi097.stdout: guava-30.1-6.el9.noarch 2024-09-14T10:44:27.815 INFO:teuthology.orchestra.run.smithi097.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-14T10:44:27.815 INFO:teuthology.orchestra.run.smithi097.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-14T10:44:27.815 INFO:teuthology.orchestra.run.smithi097.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-14T10:44:27.815 INFO:teuthology.orchestra.run.smithi097.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-14T10:44:27.815 INFO:teuthology.orchestra.run.smithi097.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-14T10:44:27.815 INFO:teuthology.orchestra.run.smithi097.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-14T10:44:27.815 INFO:teuthology.orchestra.run.smithi097.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T10:44:27.815 INFO:teuthology.orchestra.run.smithi097.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T10:44:27.815 INFO:teuthology.orchestra.run.smithi097.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T10:44:27.815 INFO:teuthology.orchestra.run.smithi097.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-14T10:44:27.815 INFO:teuthology.orchestra.run.smithi097.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-14T10:44:27.815 INFO:teuthology.orchestra.run.smithi097.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-14T10:44:27.816 INFO:teuthology.orchestra.run.smithi097.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-14T10:44:27.816 INFO:teuthology.orchestra.run.smithi097.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-14T10:44:27.816 INFO:teuthology.orchestra.run.smithi097.stdout: lcms2-2.12-3.el9.x86_64 2024-09-14T10:44:27.816 INFO:teuthology.orchestra.run.smithi097.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-14T10:44:27.816 INFO:teuthology.orchestra.run.smithi097.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-14T10:44:27.816 INFO:teuthology.orchestra.run.smithi097.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-14T10:44:27.816 INFO:teuthology.orchestra.run.smithi097.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-14T10:44:27.816 INFO:teuthology.orchestra.run.smithi097.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-14T10:44:27.816 INFO:teuthology.orchestra.run.smithi097.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-14T10:44:27.816 INFO:teuthology.orchestra.run.smithi097.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-14T10:44:27.816 INFO:teuthology.orchestra.run.smithi097.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-14T10:44:27.816 INFO:teuthology.orchestra.run.smithi097.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-14T10:44:27.816 INFO:teuthology.orchestra.run.smithi097.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-14T10:44:27.816 INFO:teuthology.orchestra.run.smithi097.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-14T10:44:27.817 INFO:teuthology.orchestra.run.smithi097.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-14T10:44:27.817 INFO:teuthology.orchestra.run.smithi097.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-14T10:44:27.817 INFO:teuthology.orchestra.run.smithi097.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-14T10:44:27.817 INFO:teuthology.orchestra.run.smithi097.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-14T10:44:27.817 INFO:teuthology.orchestra.run.smithi097.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-14T10:44:27.817 INFO:teuthology.orchestra.run.smithi097.stdout: libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:44:27.817 INFO:teuthology.orchestra.run.smithi097.stdout: libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:44:27.817 INFO:teuthology.orchestra.run.smithi097.stdout: libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:44:27.817 INFO:teuthology.orchestra.run.smithi097.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-14T10:44:27.817 INFO:teuthology.orchestra.run.smithi097.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-14T10:44:27.817 INFO:teuthology.orchestra.run.smithi097.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-14T10:44:27.817 INFO:teuthology.orchestra.run.smithi097.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-14T10:44:27.817 INFO:teuthology.orchestra.run.smithi097.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-14T10:44:27.817 INFO:teuthology.orchestra.run.smithi097.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-14T10:44:27.818 INFO:teuthology.orchestra.run.smithi097.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-14T10:44:27.818 INFO:teuthology.orchestra.run.smithi097.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-14T10:44:27.818 INFO:teuthology.orchestra.run.smithi097.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-14T10:44:27.818 INFO:teuthology.orchestra.run.smithi097.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-14T10:44:27.818 INFO:teuthology.orchestra.run.smithi097.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-14T10:44:27.818 INFO:teuthology.orchestra.run.smithi097.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-14T10:44:27.818 INFO:teuthology.orchestra.run.smithi097.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-14T10:44:27.818 INFO:teuthology.orchestra.run.smithi097.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-14T10:44:27.818 INFO:teuthology.orchestra.run.smithi097.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-14T10:44:27.818 INFO:teuthology.orchestra.run.smithi097.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-14T10:44:27.818 INFO:teuthology.orchestra.run.smithi097.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-14T10:44:27.818 INFO:teuthology.orchestra.run.smithi097.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-14T10:44:27.818 INFO:teuthology.orchestra.run.smithi097.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-14T10:44:27.819 INFO:teuthology.orchestra.run.smithi097.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-14T10:44:27.819 INFO:teuthology.orchestra.run.smithi097.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-14T10:44:27.819 INFO:teuthology.orchestra.run.smithi097.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-14T10:44:27.819 INFO:teuthology.orchestra.run.smithi097.stdout: librados-devel-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:44:27.819 INFO:teuthology.orchestra.run.smithi097.stdout: libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:44:27.819 INFO:teuthology.orchestra.run.smithi097.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-14T10:44:27.819 INFO:teuthology.orchestra.run.smithi097.stdout: librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:44:27.819 INFO:teuthology.orchestra.run.smithi097.stdout: libsbc-1.4-9.el9.x86_64 2024-09-14T10:44:27.819 INFO:teuthology.orchestra.run.smithi097.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-14T10:44:27.819 INFO:teuthology.orchestra.run.smithi097.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-14T10:44:27.819 INFO:teuthology.orchestra.run.smithi097.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-14T10:44:27.819 INFO:teuthology.orchestra.run.smithi097.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-14T10:44:27.820 INFO:teuthology.orchestra.run.smithi097.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-14T10:44:27.820 INFO:teuthology.orchestra.run.smithi097.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-14T10:44:27.820 INFO:teuthology.orchestra.run.smithi097.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-14T10:44:27.820 INFO:teuthology.orchestra.run.smithi097.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-14T10:44:27.820 INFO:teuthology.orchestra.run.smithi097.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-14T10:44:27.820 INFO:teuthology.orchestra.run.smithi097.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-14T10:44:27.820 INFO:teuthology.orchestra.run.smithi097.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-14T10:44:27.820 INFO:teuthology.orchestra.run.smithi097.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-14T10:44:27.820 INFO:teuthology.orchestra.run.smithi097.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-14T10:44:27.820 INFO:teuthology.orchestra.run.smithi097.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-14T10:44:27.820 INFO:teuthology.orchestra.run.smithi097.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-14T10:44:27.820 INFO:teuthology.orchestra.run.smithi097.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-14T10:44:27.820 INFO:teuthology.orchestra.run.smithi097.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-14T10:44:27.821 INFO:teuthology.orchestra.run.smithi097.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-14T10:44:27.821 INFO:teuthology.orchestra.run.smithi097.stdout: lua-5.4.4-4.el9.x86_64 2024-09-14T10:44:27.821 INFO:teuthology.orchestra.run.smithi097.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-14T10:44:27.821 INFO:teuthology.orchestra.run.smithi097.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-14T10:44:27.821 INFO:teuthology.orchestra.run.smithi097.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-14T10:44:27.821 INFO:teuthology.orchestra.run.smithi097.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-14T10:44:27.821 INFO:teuthology.orchestra.run.smithi097.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-14T10:44:27.821 INFO:teuthology.orchestra.run.smithi097.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-14T10:44:27.821 INFO:teuthology.orchestra.run.smithi097.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-14T10:44:27.821 INFO:teuthology.orchestra.run.smithi097.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-14T10:44:27.821 INFO:teuthology.orchestra.run.smithi097.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-14T10:44:27.821 INFO:teuthology.orchestra.run.smithi097.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-14T10:44:27.821 INFO:teuthology.orchestra.run.smithi097.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-14T10:44:27.821 INFO:teuthology.orchestra.run.smithi097.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-14T10:44:27.822 INFO:teuthology.orchestra.run.smithi097.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-14T10:44:27.822 INFO:teuthology.orchestra.run.smithi097.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-14T10:44:27.822 INFO:teuthology.orchestra.run.smithi097.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-14T10:44:27.822 INFO:teuthology.orchestra.run.smithi097.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-14T10:44:27.822 INFO:teuthology.orchestra.run.smithi097.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-14T10:44:27.822 INFO:teuthology.orchestra.run.smithi097.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-14T10:44:27.822 INFO:teuthology.orchestra.run.smithi097.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-14T10:44:27.822 INFO:teuthology.orchestra.run.smithi097.stdout: opus-1.3.1-10.el9.x86_64 2024-09-14T10:44:27.822 INFO:teuthology.orchestra.run.smithi097.stdout: orc-0.4.31-8.el9.x86_64 2024-09-14T10:44:27.822 INFO:teuthology.orchestra.run.smithi097.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-14T10:44:27.822 INFO:teuthology.orchestra.run.smithi097.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-14T10:44:27.822 INFO:teuthology.orchestra.run.smithi097.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-14T10:44:27.822 INFO:teuthology.orchestra.run.smithi097.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-14T10:44:27.823 INFO:teuthology.orchestra.run.smithi097.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-14T10:44:27.823 INFO:teuthology.orchestra.run.smithi097.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-14T10:44:27.823 INFO:teuthology.orchestra.run.smithi097.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-14T10:44:27.823 INFO:teuthology.orchestra.run.smithi097.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-14T10:44:27.823 INFO:teuthology.orchestra.run.smithi097.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-14T10:44:27.823 INFO:teuthology.orchestra.run.smithi097.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-14T10:44:27.823 INFO:teuthology.orchestra.run.smithi097.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-14T10:44:27.823 INFO:teuthology.orchestra.run.smithi097.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-14T10:44:27.823 INFO:teuthology.orchestra.run.smithi097.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-14T10:44:27.823 INFO:teuthology.orchestra.run.smithi097.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-14T10:44:27.823 INFO:teuthology.orchestra.run.smithi097.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-14T10:44:27.823 INFO:teuthology.orchestra.run.smithi097.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-14T10:44:27.823 INFO:teuthology.orchestra.run.smithi097.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-14T10:44:27.823 INFO:teuthology.orchestra.run.smithi097.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-14T10:44:27.824 INFO:teuthology.orchestra.run.smithi097.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-14T10:44:27.824 INFO:teuthology.orchestra.run.smithi097.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-14T10:44:27.824 INFO:teuthology.orchestra.run.smithi097.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-14T10:44:27.824 INFO:teuthology.orchestra.run.smithi097.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-14T10:44:27.824 INFO:teuthology.orchestra.run.smithi097.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-14T10:44:27.824 INFO:teuthology.orchestra.run.smithi097.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-14T10:44:27.824 INFO:teuthology.orchestra.run.smithi097.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-14T10:44:27.824 INFO:teuthology.orchestra.run.smithi097.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-14T10:44:27.824 INFO:teuthology.orchestra.run.smithi097.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-14T10:44:27.824 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-14T10:44:27.824 INFO:teuthology.orchestra.run.smithi097.stdout: python3-ceph-argparse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:44:27.824 INFO:teuthology.orchestra.run.smithi097.stdout: python3-ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:44:27.824 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:44:27.825 INFO:teuthology.orchestra.run.smithi097.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-14T10:44:27.825 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-14T10:44:27.825 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-14T10:44:27.825 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-14T10:44:27.825 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-14T10:44:27.825 INFO:teuthology.orchestra.run.smithi097.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-14T10:44:27.825 INFO:teuthology.orchestra.run.smithi097.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-14T10:44:27.825 INFO:teuthology.orchestra.run.smithi097.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-14T10:44:27.825 INFO:teuthology.orchestra.run.smithi097.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-14T10:44:27.825 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-14T10:44:27.825 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-14T10:44:27.825 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-14T10:44:27.825 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-14T10:44:27.825 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-14T10:44:27.826 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-14T10:44:27.826 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-14T10:44:27.826 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-14T10:44:27.826 INFO:teuthology.orchestra.run.smithi097.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-14T10:44:27.826 INFO:teuthology.orchestra.run.smithi097.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-14T10:44:27.826 INFO:teuthology.orchestra.run.smithi097.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-14T10:44:27.826 INFO:teuthology.orchestra.run.smithi097.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-14T10:44:27.826 INFO:teuthology.orchestra.run.smithi097.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-14T10:44:27.826 INFO:teuthology.orchestra.run.smithi097.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-14T10:44:27.826 INFO:teuthology.orchestra.run.smithi097.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-14T10:44:27.826 INFO:teuthology.orchestra.run.smithi097.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-14T10:44:27.826 INFO:teuthology.orchestra.run.smithi097.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-14T10:44:27.826 INFO:teuthology.orchestra.run.smithi097.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-14T10:44:27.827 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-14T10:44:27.827 INFO:teuthology.orchestra.run.smithi097.stdout: python3-ply-3.11-14.el9.noarch 2024-09-14T10:44:27.827 INFO:teuthology.orchestra.run.smithi097.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-14T10:44:27.827 INFO:teuthology.orchestra.run.smithi097.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-14T10:44:27.827 INFO:teuthology.orchestra.run.smithi097.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-14T10:44:27.827 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-14T10:44:27.827 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-14T10:44:27.827 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-14T10:44:27.827 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-14T10:44:27.827 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-14T10:44:27.827 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:44:27.827 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:44:27.827 INFO:teuthology.orchestra.run.smithi097.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-14T10:44:27.828 INFO:teuthology.orchestra.run.smithi097.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-14T10:44:27.828 INFO:teuthology.orchestra.run.smithi097.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-14T10:44:27.828 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:44:27.828 INFO:teuthology.orchestra.run.smithi097.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-14T10:44:27.828 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-14T10:44:27.828 INFO:teuthology.orchestra.run.smithi097.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-14T10:44:27.828 INFO:teuthology.orchestra.run.smithi097.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-14T10:44:27.828 INFO:teuthology.orchestra.run.smithi097.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-14T10:44:27.828 INFO:teuthology.orchestra.run.smithi097.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-14T10:44:27.828 INFO:teuthology.orchestra.run.smithi097.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-14T10:44:27.828 INFO:teuthology.orchestra.run.smithi097.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-14T10:44:27.828 INFO:teuthology.orchestra.run.smithi097.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-14T10:44:27.828 INFO:teuthology.orchestra.run.smithi097.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-14T10:44:27.829 INFO:teuthology.orchestra.run.smithi097.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-14T10:44:27.829 INFO:teuthology.orchestra.run.smithi097.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-14T10:44:27.829 INFO:teuthology.orchestra.run.smithi097.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-14T10:44:27.829 INFO:teuthology.orchestra.run.smithi097.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-14T10:44:27.829 INFO:teuthology.orchestra.run.smithi097.stdout: rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:44:27.829 INFO:teuthology.orchestra.run.smithi097.stdout: rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:44:27.829 INFO:teuthology.orchestra.run.smithi097.stdout: rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:44:27.829 INFO:teuthology.orchestra.run.smithi097.stdout: re2-1:20211101-20.el9.x86_64 2024-09-14T10:44:27.829 INFO:teuthology.orchestra.run.smithi097.stdout: rtkit-0.11-29.el9.x86_64 2024-09-14T10:44:27.829 INFO:teuthology.orchestra.run.smithi097.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-14T10:44:27.829 INFO:teuthology.orchestra.run.smithi097.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-14T10:44:27.829 INFO:teuthology.orchestra.run.smithi097.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-14T10:44:27.829 INFO:teuthology.orchestra.run.smithi097.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-14T10:44:27.830 INFO:teuthology.orchestra.run.smithi097.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-14T10:44:27.830 INFO:teuthology.orchestra.run.smithi097.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-14T10:44:27.830 INFO:teuthology.orchestra.run.smithi097.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-14T10:44:27.830 INFO:teuthology.orchestra.run.smithi097.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-14T10:44:27.830 INFO:teuthology.orchestra.run.smithi097.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-14T10:44:27.830 INFO:teuthology.orchestra.run.smithi097.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-14T10:44:27.830 INFO:teuthology.orchestra.run.smithi097.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-14T10:44:27.830 INFO:teuthology.orchestra.run.smithi097.stdout: upower-0.99.11-11.el9.x86_64 2024-09-14T10:44:27.830 INFO:teuthology.orchestra.run.smithi097.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-14T10:44:27.830 INFO:teuthology.orchestra.run.smithi097.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-14T10:44:27.830 INFO:teuthology.orchestra.run.smithi097.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-14T10:44:27.830 INFO:teuthology.orchestra.run.smithi097.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-14T10:44:27.831 INFO:teuthology.orchestra.run.smithi097.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-14T10:44:27.831 INFO:teuthology.orchestra.run.smithi097.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-14T10:44:27.831 INFO:teuthology.orchestra.run.smithi097.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-14T10:44:27.831 INFO:teuthology.orchestra.run.smithi097.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-14T10:44:27.831 INFO:teuthology.orchestra.run.smithi097.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-14T10:44:27.831 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:44:27.831 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2024-09-14T10:44:28.259 DEBUG:teuthology.parallel:result is None 2024-09-14T10:44:28.260 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T10:44:28.402 DEBUG:teuthology.orchestra.run.smithi097:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-14T10:44:28.465 INFO:teuthology.orchestra.run.smithi097.stdout:19.3.0-4907.ga2782315.el9 2024-09-14T10:44:28.465 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4907.ga2782315.el9 2024-09-14T10:44:28.466 INFO:teuthology.task.install:The correct ceph version 19.3.0-4907.ga2782315 is installed. 2024-09-14T10:44:28.467 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T10:44:28.605 DEBUG:teuthology.orchestra.run.smithi152:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-14T10:44:28.762 INFO:teuthology.orchestra.run.smithi152.stdout:19.3.0-4907.ga2782315.el9 2024-09-14T10:44:28.762 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4907.ga2782315.el9 2024-09-14T10:44:28.762 INFO:teuthology.task.install:The correct ceph version 19.3.0-4907.ga2782315 is installed. 2024-09-14T10:44:28.764 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-14T10:44:28.764 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-14T10:44:28.765 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-14T10:44:28.806 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-14T10:44:28.807 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-14T10:44:28.855 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-14T10:44:28.855 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-14T10:44:28.855 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/usr/bin/daemon-helper 2024-09-14T10:44:28.895 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-14T10:44:28.973 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-14T10:44:28.974 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/daemon-helper 2024-09-14T10:44:29.018 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-14T10:44:29.100 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-14T10:44:29.100 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-14T10:44:29.100 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-14T10:44:29.138 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-14T10:44:29.217 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-14T10:44:29.217 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-14T10:44:29.256 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-14T10:44:29.335 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-14T10:44:29.335 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-14T10:44:29.335 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/usr/bin/stdin-killer 2024-09-14T10:44:29.374 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-14T10:44:29.453 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-14T10:44:29.453 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/stdin-killer 2024-09-14T10:44:29.495 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-14T10:44:29.574 INFO:teuthology.run_tasks:Running task ceph... 2024-09-14T10:44:29.657 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-14T10:44:29.657 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 777 /var/log/ceph 2024-09-14T10:44:29.660 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 777 /var/log/ceph 2024-09-14T10:44:29.700 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-14T10:44:29.700 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-14T10:44:29.739 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-14T10:44:29.778 INFO:tasks.ceph:Creating extra log directories... 2024-09-14T10:44:29.779 DEBUG:teuthology.orchestra.run.smithi097:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-14T10:44:29.818 DEBUG:teuthology.orchestra.run.smithi152:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-14T10:44:29.867 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-14T10:44:29.867 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-14T10:44:29.867 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904126', 'branch': 'main', 'description': 'rgw/verify/{0-install accounts$/{main} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7904126', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}}, 'rgw': {'compression type': 'random', 'ec-data-pool': False, 'frontend': 'beast', 'inline data': False, 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111'}, 'force-branch': 'ceph-master', 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '1c941a66c1b420259b8fc5ac19e792dbbf60aded'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 950, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 9419, 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8', 'sleep_before_teardown': 0, 'subset': '0/1', 'suite': 'rgw', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '1c941a66c1b420259b8fc5ac19e792dbbf60aded', 'targets': {'smithi097.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFCq7tK2fcMtQz4LadMdB5Xxun5ICmaNUIeWZDNviIeHNbFgiHjhwl3vc2qrjWYYXsM2TzHcaB/1+YuOBQsMLR0=', 'smithi152.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCOo+mddRKiYVyCETY4tqiHNZ5ASjRH4qNaTXBUev8ca1fvwWCnG71a1pY2RfHogabVRdPiWZ0MTHQT2FxnNKJI='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-13_20:40:18', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-14T10:44:29.868 DEBUG:teuthology.orchestra.run.smithi097:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-14T10:44:29.897 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-14T10:44:29.926 DEBUG:teuthology.orchestra.run.smithi097:> sudo install -d -m0777 -- /var/run/ceph 2024-09-14T10:44:29.965 DEBUG:teuthology.orchestra.run.smithi152:> sudo install -d -m0777 -- /var/run/ceph 2024-09-14T10:44:30.005 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-14T10:44:30.005 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/scratch_devs of=/dev/stdout 2024-09-14T10:44:30.072 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-14T10:44:30.072 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_1 2024-09-14T10:44:30.140 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-14T10:44:30.141 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:44:30.141 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-14T10:44:30.141 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:44:30.141 INFO:teuthology.orchestra.run.smithi097.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T10:44:30.141 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2024-09-14 10:44:15.114044484 +0000 2024-09-14T10:44:30.141 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2024-09-14 10:40:52.722080475 +0000 2024-09-14T10:44:30.141 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2024-09-14 10:40:52.722080475 +0000 2024-09-14T10:44:30.141 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: 2024-09-14 10:40:52.722080475 +0000 2024-09-14T10:44:30.141 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-14T10:44:30.219 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2024-09-14T10:44:30.219 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2024-09-14T10:44:30.219 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.000260041 s, 2.0 MB/s 2024-09-14T10:44:30.220 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-14T10:44:30.289 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_2 2024-09-14T10:44:30.358 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-14T10:44:30.358 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:44:30.358 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-14T10:44:30.358 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:44:30.359 INFO:teuthology.orchestra.run.smithi097.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T10:44:30.359 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2024-09-14 10:44:15.115044468 +0000 2024-09-14T10:44:30.359 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2024-09-14 10:40:53.045075226 +0000 2024-09-14T10:44:30.359 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2024-09-14 10:40:53.045075226 +0000 2024-09-14T10:44:30.359 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: 2024-09-14 10:40:53.045075226 +0000 2024-09-14T10:44:30.359 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-14T10:44:30.435 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2024-09-14T10:44:30.435 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2024-09-14T10:44:30.435 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.00021937 s, 2.3 MB/s 2024-09-14T10:44:30.436 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-14T10:44:30.506 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_3 2024-09-14T10:44:30.574 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-14T10:44:30.574 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:44:30.574 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-14T10:44:30.574 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:44:30.575 INFO:teuthology.orchestra.run.smithi097.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T10:44:30.575 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2024-09-14 10:44:15.115044468 +0000 2024-09-14T10:44:30.575 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2024-09-14 10:40:53.376069847 +0000 2024-09-14T10:44:30.575 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2024-09-14 10:40:53.376069847 +0000 2024-09-14T10:44:30.575 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: 2024-09-14 10:40:53.376069847 +0000 2024-09-14T10:44:30.575 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-14T10:44:30.651 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2024-09-14T10:44:30.651 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2024-09-14T10:44:30.652 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.000242098 s, 2.1 MB/s 2024-09-14T10:44:30.653 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-14T10:44:30.724 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_4 2024-09-14T10:44:30.793 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-14T10:44:30.794 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:44:30.794 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-14T10:44:30.794 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:44:30.794 INFO:teuthology.orchestra.run.smithi097.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T10:44:30.794 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2024-09-14 10:44:15.115044468 +0000 2024-09-14T10:44:30.794 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2024-09-14 10:40:53.730064095 +0000 2024-09-14T10:44:30.794 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2024-09-14 10:40:53.730064095 +0000 2024-09-14T10:44:30.794 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: 2024-09-14 10:40:53.730064095 +0000 2024-09-14T10:44:30.795 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-14T10:44:30.871 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2024-09-14T10:44:30.871 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2024-09-14T10:44:30.871 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.000163248 s, 3.1 MB/s 2024-09-14T10:44:30.872 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-14T10:44:30.942 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T10:44:30.942 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-14T10:44:30.942 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/scratch_devs of=/dev/stdout 2024-09-14T10:44:30.973 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-14T10:44:30.973 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_1 2024-09-14T10:44:31.044 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-14T10:44:31.044 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:44:31.044 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-14T10:44:31.044 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:44:31.045 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T10:44:31.045 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-09-14 10:43:31.065692094 +0000 2024-09-14T10:44:31.045 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-09-14 10:40:51.600371815 +0000 2024-09-14T10:44:31.045 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-09-14 10:40:51.600371815 +0000 2024-09-14T10:44:31.045 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2024-09-14 10:40:51.600371815 +0000 2024-09-14T10:44:31.045 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-14T10:44:31.122 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-09-14T10:44:31.123 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-09-14T10:44:31.123 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000209024 s, 2.4 MB/s 2024-09-14T10:44:31.124 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-14T10:44:31.194 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_2 2024-09-14T10:44:31.264 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-14T10:44:31.265 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:44:31.265 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-14T10:44:31.265 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:44:31.265 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T10:44:31.265 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-09-14 10:43:31.066692082 +0000 2024-09-14T10:44:31.265 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-09-14 10:40:51.922367952 +0000 2024-09-14T10:44:31.265 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-09-14 10:40:51.922367952 +0000 2024-09-14T10:44:31.265 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2024-09-14 10:40:51.922367952 +0000 2024-09-14T10:44:31.265 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-14T10:44:31.342 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-09-14T10:44:31.342 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-09-14T10:44:31.342 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000217736 s, 2.4 MB/s 2024-09-14T10:44:31.343 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-14T10:44:31.412 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_3 2024-09-14T10:44:31.483 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-14T10:44:31.483 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:44:31.483 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-14T10:44:31.483 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:44:31.483 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T10:44:31.484 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-09-14 10:43:31.066692082 +0000 2024-09-14T10:44:31.484 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-09-14 10:40:52.232364233 +0000 2024-09-14T10:44:31.484 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-09-14 10:40:52.232364233 +0000 2024-09-14T10:44:31.484 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2024-09-14 10:40:52.232364233 +0000 2024-09-14T10:44:31.484 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-14T10:44:31.560 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-09-14T10:44:31.561 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-09-14T10:44:31.561 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000216259 s, 2.4 MB/s 2024-09-14T10:44:31.562 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-14T10:44:31.631 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_4 2024-09-14T10:44:31.700 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-14T10:44:31.700 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:44:31.700 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-14T10:44:31.700 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:44:31.700 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T10:44:31.700 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-09-14 10:43:31.066692082 +0000 2024-09-14T10:44:31.700 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-09-14 10:40:52.549360430 +0000 2024-09-14T10:44:31.700 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-09-14 10:40:52.549360430 +0000 2024-09-14T10:44:31.700 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2024-09-14 10:40:52.549360430 +0000 2024-09-14T10:44:31.701 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-14T10:44:31.777 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-09-14T10:44:31.777 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-09-14T10:44:31.777 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000188843 s, 2.7 MB/s 2024-09-14T10:44:31.779 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-14T10:44:31.848 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T10:44:31.848 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi097.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi152.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-14T10:44:31.848 INFO:tasks.ceph:Generating config... 2024-09-14T10:44:31.850 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-14T10:44:31.850 INFO:tasks.ceph:[client] debug rgw notification = 20 2024-09-14T10:44:31.850 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-09-14T10:44:31.850 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-09-14T10:44:31.850 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-09-14T10:44:31.850 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-14T10:44:31.850 INFO:tasks.ceph:[client] rgw max chunk size = 4194304 2024-09-14T10:44:31.850 INFO:tasks.ceph:[client] rgw obj stripe size = 6291456 2024-09-14T10:44:31.850 INFO:tasks.ceph:[client] rgw reshard progress judge interval = 10 2024-09-14T10:44:31.850 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2024-09-14T10:44:31.850 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2024-09-14T10:44:31.850 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-09-14T10:44:31.851 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-09-14T10:44:31.851 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-14T10:44:31.851 INFO:tasks.ceph:[client] setuser = ceph 2024-09-14T10:44:31.851 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-14T10:44:31.851 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-14T10:44:31.851 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-09-14T10:44:31.851 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-09-14T10:44:31.851 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-14T10:44:31.851 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-14T10:44:31.851 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-14T10:44:31.851 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-14T10:44:31.851 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-14T10:44:31.851 INFO:tasks.ceph:[mon] lockdep = True 2024-09-14T10:44:31.852 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-14T10:44:31.852 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-14T10:44:31.852 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-14T10:44:31.852 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-14T10:44:31.852 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-14T10:44:31.852 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-14T10:44:31.852 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-14T10:44:31.852 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-14T10:44:31.852 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-14T10:44:31.853 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-14T10:44:31.853 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-14T10:44:31.853 INFO:tasks.ceph:[osd] lockdep = True 2024-09-14T10:44:31.853 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-14T10:44:31.853 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-14T10:44:31.853 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-14T10:44:31.853 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-14T10:44:31.853 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-14T10:44:31.853 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-14T10:44:31.853 INFO:tasks.ceph:Setting up mon.a... 2024-09-14T10:44:31.853 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-14T10:44:31.919 INFO:teuthology.orchestra.run.smithi097.stdout:creating /etc/ceph/ceph.keyring 2024-09-14T10:44:31.922 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-14T10:44:31.981 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T10:44:32.020 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.97'), ('mon.c', '[v2:172.21.15.97:3301,v1:172.21.15.97:6790]'), ('mon.b', '172.21.15.152')] 2024-09-14T10:44:32.020 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.97,[v2:172.21.15.97:3301,v1:172.21.15.97:6790],172.21.15.152', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'lockdep': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-14T10:44:32.021 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-14T10:44:32.021 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-14T10:44:32.089 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.97 --addv c '[v2:172.21.15.97:3301,v1:172.21.15.97:6790]' --add b 172.21.15.152 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:44:32.189 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:44:32.189 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:44:32.190 INFO:teuthology.orchestra.run.smithi097.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:44:32.190 INFO:teuthology.orchestra.run.smithi097.stdout:monmaptool: generated fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T10:44:32.190 INFO:teuthology.orchestra.run.smithi097.stdout:setting min_mon_release = quincy 2024-09-14T10:44:32.190 INFO:teuthology.orchestra.run.smithi097.stdout:epoch 0 2024-09-14T10:44:32.190 INFO:teuthology.orchestra.run.smithi097.stdout:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T10:44:32.190 INFO:teuthology.orchestra.run.smithi097.stdout:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T10:44:32.190 INFO:teuthology.orchestra.run.smithi097.stdout:created 2024-09-14T10:44:32.192460+0000 2024-09-14T10:44:32.190 INFO:teuthology.orchestra.run.smithi097.stdout:min_mon_release 17 (quincy) 2024-09-14T10:44:32.190 INFO:teuthology.orchestra.run.smithi097.stdout:election_strategy: 1 2024-09-14T10:44:32.190 INFO:teuthology.orchestra.run.smithi097.stdout:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T10:44:32.191 INFO:teuthology.orchestra.run.smithi097.stdout:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T10:44:32.191 INFO:teuthology.orchestra.run.smithi097.stdout:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T10:44:32.191 INFO:teuthology.orchestra.run.smithi097.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-14T10:44:32.192 DEBUG:teuthology.orchestra.run.smithi097:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-14T10:44:32.221 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9... 2024-09-14T10:44:32.222 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-14T10:44:32.263 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-14T10:44:32.318 INFO:teuthology.orchestra.run.smithi097.stdout:[global] 2024-09-14T10:44:32.318 INFO:teuthology.orchestra.run.smithi097.stdout: chdir = "" 2024-09-14T10:44:32.318 INFO:teuthology.orchestra.run.smithi097.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-14T10:44:32.318 INFO:teuthology.orchestra.run.smithi097.stdout: auth supported = cephx 2024-09-14T10:44:32.319 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:44:32.319 INFO:teuthology.orchestra.run.smithi097.stdout: filestore xattr use omap = true 2024-09-14T10:44:32.319 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:44:32.319 INFO:teuthology.orchestra.run.smithi097.stdout: mon clock drift allowed = 1.000 2024-09-14T10:44:32.319 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:44:32.319 INFO:teuthology.orchestra.run.smithi097.stdout: osd crush chooseleaf type = 0 2024-09-14T10:44:32.319 INFO:teuthology.orchestra.run.smithi097.stdout: auth debug = true 2024-09-14T10:44:32.319 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:44:32.319 INFO:teuthology.orchestra.run.smithi097.stdout: ms die on old message = true 2024-09-14T10:44:32.319 INFO:teuthology.orchestra.run.smithi097.stdout: ms die on bug = true 2024-09-14T10:44:32.319 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:44:32.319 INFO:teuthology.orchestra.run.smithi097.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-14T10:44:32.319 INFO:teuthology.orchestra.run.smithi097.stdout: mon pg warn max object skew = 0 2024-09-14T10:44:32.320 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:44:32.320 INFO:teuthology.orchestra.run.smithi097.stdout: # disable pg_autoscaler by default for new pools 2024-09-14T10:44:32.320 INFO:teuthology.orchestra.run.smithi097.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-14T10:44:32.320 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:44:32.320 INFO:teuthology.orchestra.run.smithi097.stdout: osd pool default size = 2 2024-09-14T10:44:32.320 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:44:32.320 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd allow primary affinity = true 2024-09-14T10:44:32.320 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd allow pg remap = true 2024-09-14T10:44:32.320 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on legacy crush tunables = false 2024-09-14T10:44:32.320 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on crush straw calc version zero = false 2024-09-14T10:44:32.320 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on no sortbitwise = false 2024-09-14T10:44:32.320 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on osd down out interval zero = false 2024-09-14T10:44:32.320 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on too few osds = false 2024-09-14T10:44:32.321 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-14T10:44:32.321 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-14T10:44:32.321 INFO:teuthology.orchestra.run.smithi097.stdout: mon_allow_pool_size_one = true 2024-09-14T10:44:32.321 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:44:32.321 INFO:teuthology.orchestra.run.smithi097.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-14T10:44:32.321 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:44:32.321 INFO:teuthology.orchestra.run.smithi097.stdout: osd default data pool replay window = 5 2024-09-14T10:44:32.321 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:44:32.321 INFO:teuthology.orchestra.run.smithi097.stdout: mon allow pool delete = true 2024-09-14T10:44:32.321 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:44:32.321 INFO:teuthology.orchestra.run.smithi097.stdout: mon cluster log file level = debug 2024-09-14T10:44:32.321 INFO:teuthology.orchestra.run.smithi097.stdout: debug asserts on shutdown = true 2024-09-14T10:44:32.321 INFO:teuthology.orchestra.run.smithi097.stdout: mon health detail to clog = false 2024-09-14T10:44:32.322 INFO:teuthology.orchestra.run.smithi097.stdout: mon host = "172.21.15.97,[v2:172.21.15.97:3301,v1:172.21.15.97:6790],172.21.15.152" 2024-09-14T10:44:32.322 INFO:teuthology.orchestra.run.smithi097.stdout: mon client directed command retry = 5 2024-09-14T10:44:32.322 INFO:teuthology.orchestra.run.smithi097.stdout: ms inject socket failures = 5000 2024-09-14T10:44:32.322 INFO:teuthology.orchestra.run.smithi097.stdout: osd_max_pg_log_entries = 10 2024-09-14T10:44:32.322 INFO:teuthology.orchestra.run.smithi097.stdout: osd_min_pg_log_entries = 10 2024-09-14T10:44:32.322 INFO:teuthology.orchestra.run.smithi097.stdout: fsid = 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T10:44:32.322 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:44:32.322 INFO:teuthology.orchestra.run.smithi097.stdout:[osd] 2024-09-14T10:44:32.322 INFO:teuthology.orchestra.run.smithi097.stdout: osd journal size = 100 2024-09-14T10:44:32.322 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:44:32.323 INFO:teuthology.orchestra.run.smithi097.stdout: osd scrub load threshold = 5.0 2024-09-14T10:44:32.323 INFO:teuthology.orchestra.run.smithi097.stdout: osd scrub max interval = 600 2024-09-14T10:44:32.323 INFO:teuthology.orchestra.run.smithi097.stdout: osd mclock profile = high_recovery_ops 2024-09-14T10:44:32.323 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:44:32.323 INFO:teuthology.orchestra.run.smithi097.stdout: osd recover clone overlap = true 2024-09-14T10:44:32.323 INFO:teuthology.orchestra.run.smithi097.stdout: osd recovery max chunk = 1048576 2024-09-14T10:44:32.323 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:44:32.323 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug shutdown = true 2024-09-14T10:44:32.323 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug op order = true 2024-09-14T10:44:32.323 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug verify stray on activate = true 2024-09-14T10:44:32.323 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug trim objects = true 2024-09-14T10:44:32.323 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:44:32.324 INFO:teuthology.orchestra.run.smithi097.stdout: osd open classes on start = true 2024-09-14T10:44:32.324 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug pg log writeout = true 2024-09-14T10:44:32.324 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:44:32.324 INFO:teuthology.orchestra.run.smithi097.stdout: osd deep scrub update digest min age = 30 2024-09-14T10:44:32.324 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:44:32.324 INFO:teuthology.orchestra.run.smithi097.stdout: osd map max advance = 10 2024-09-14T10:44:32.324 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:44:32.324 INFO:teuthology.orchestra.run.smithi097.stdout: journal zero on create = true 2024-09-14T10:44:32.324 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:44:32.324 INFO:teuthology.orchestra.run.smithi097.stdout: filestore ondisk finisher threads = 3 2024-09-14T10:44:32.324 INFO:teuthology.orchestra.run.smithi097.stdout: filestore apply finisher threads = 3 2024-09-14T10:44:32.324 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:44:32.324 INFO:teuthology.orchestra.run.smithi097.stdout: bdev debug aio = true 2024-09-14T10:44:32.325 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug misdirected ops = true 2024-09-14T10:44:32.325 INFO:teuthology.orchestra.run.smithi097.stdout: bdev async discard = True 2024-09-14T10:44:32.325 INFO:teuthology.orchestra.run.smithi097.stdout: bdev enable discard = True 2024-09-14T10:44:32.325 INFO:teuthology.orchestra.run.smithi097.stdout: bluestore allocator = bitmap 2024-09-14T10:44:32.325 INFO:teuthology.orchestra.run.smithi097.stdout: bluestore block size = 96636764160 2024-09-14T10:44:32.325 INFO:teuthology.orchestra.run.smithi097.stdout: bluestore fsck on mount = True 2024-09-14T10:44:32.325 INFO:teuthology.orchestra.run.smithi097.stdout: debug bluefs = 1/20 2024-09-14T10:44:32.325 INFO:teuthology.orchestra.run.smithi097.stdout: debug bluestore = 1/20 2024-09-14T10:44:32.325 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2024-09-14T10:44:32.325 INFO:teuthology.orchestra.run.smithi097.stdout: debug objclass = 20 2024-09-14T10:44:32.325 INFO:teuthology.orchestra.run.smithi097.stdout: debug osd = 20 2024-09-14T10:44:32.325 INFO:teuthology.orchestra.run.smithi097.stdout: debug rocksdb = 4/10 2024-09-14T10:44:32.325 INFO:teuthology.orchestra.run.smithi097.stdout: lockdep = True 2024-09-14T10:44:32.326 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd backfillfull_ratio = 0.85 2024-09-14T10:44:32.326 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd full ratio = 0.9 2024-09-14T10:44:32.326 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd nearfull ratio = 0.8 2024-09-14T10:44:32.326 INFO:teuthology.orchestra.run.smithi097.stdout: osd failsafe full ratio = 0.95 2024-09-14T10:44:32.326 INFO:teuthology.orchestra.run.smithi097.stdout: osd objectstore = bluestore 2024-09-14T10:44:32.326 INFO:teuthology.orchestra.run.smithi097.stdout: osd shutdown pgref assert = True 2024-09-14T10:44:32.326 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:44:32.326 INFO:teuthology.orchestra.run.smithi097.stdout:[mgr] 2024-09-14T10:44:32.326 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2024-09-14T10:44:32.326 INFO:teuthology.orchestra.run.smithi097.stdout: debug mgr = 20 2024-09-14T10:44:32.326 INFO:teuthology.orchestra.run.smithi097.stdout: debug mon = 20 2024-09-14T10:44:32.326 INFO:teuthology.orchestra.run.smithi097.stdout: debug auth = 20 2024-09-14T10:44:32.326 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min pgs per osd = 4 2024-09-14T10:44:32.326 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min bytes per osd = 10 2024-09-14T10:44:32.327 INFO:teuthology.orchestra.run.smithi097.stdout: mgr/telemetry/nag = false 2024-09-14T10:44:32.327 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:44:32.327 INFO:teuthology.orchestra.run.smithi097.stdout:[mon] 2024-09-14T10:44:32.327 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2024-09-14T10:44:32.327 INFO:teuthology.orchestra.run.smithi097.stdout: debug mon = 20 2024-09-14T10:44:32.327 INFO:teuthology.orchestra.run.smithi097.stdout: debug paxos = 20 2024-09-14T10:44:32.327 INFO:teuthology.orchestra.run.smithi097.stdout: debug auth = 20 2024-09-14T10:44:32.327 INFO:teuthology.orchestra.run.smithi097.stdout: mon data avail warn = 5 2024-09-14T10:44:32.327 INFO:teuthology.orchestra.run.smithi097.stdout: mon mgr mkfs grace = 240 2024-09-14T10:44:32.327 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min pgs per osd = 4 2024-09-14T10:44:32.327 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd reporter subtree level = osd 2024-09-14T10:44:32.327 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd prime pg temp = true 2024-09-14T10:44:32.327 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min bytes per osd = 10 2024-09-14T10:44:32.327 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:44:32.328 INFO:teuthology.orchestra.run.smithi097.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-14T10:44:32.328 INFO:teuthology.orchestra.run.smithi097.stdout: auth mon ticket ttl = 660 # 11m 2024-09-14T10:44:32.328 INFO:teuthology.orchestra.run.smithi097.stdout: auth service ticket ttl = 240 # 4m 2024-09-14T10:44:32.328 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:44:32.328 INFO:teuthology.orchestra.run.smithi097.stdout: # don't complain about insecure global_id in the test suite 2024-09-14T10:44:32.328 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-14T10:44:32.328 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-14T10:44:32.328 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:44:32.328 INFO:teuthology.orchestra.run.smithi097.stdout: # 1m isn't quite enough 2024-09-14T10:44:32.328 INFO:teuthology.orchestra.run.smithi097.stdout: mon_down_mkfs_grace = 2m 2024-09-14T10:44:32.328 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:44:32.328 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_filestore_osds = false 2024-09-14T10:44:32.328 INFO:teuthology.orchestra.run.smithi097.stdout: lockdep = True 2024-09-14T10:44:32.329 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:44:32.329 INFO:teuthology.orchestra.run.smithi097.stdout:[client] 2024-09-14T10:44:32.329 INFO:teuthology.orchestra.run.smithi097.stdout: rgw cache enabled = true 2024-09-14T10:44:32.329 INFO:teuthology.orchestra.run.smithi097.stdout: rgw enable ops log = true 2024-09-14T10:44:32.329 INFO:teuthology.orchestra.run.smithi097.stdout: rgw enable usage log = true 2024-09-14T10:44:32.329 INFO:teuthology.orchestra.run.smithi097.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-14T10:44:32.329 INFO:teuthology.orchestra.run.smithi097.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-14T10:44:32.329 INFO:teuthology.orchestra.run.smithi097.stdout: debug rgw = 20 2024-09-14T10:44:32.329 INFO:teuthology.orchestra.run.smithi097.stdout: debug rgw notification = 20 2024-09-14T10:44:32.329 INFO:teuthology.orchestra.run.smithi097.stdout: rgw bucket counters cache = True 2024-09-14T10:44:32.329 INFO:teuthology.orchestra.run.smithi097.stdout: rgw crypt require ssl = False 2024-09-14T10:44:32.329 INFO:teuthology.orchestra.run.smithi097.stdout: rgw crypt s3 kms backend = testing 2024-09-14T10:44:32.329 INFO:teuthology.orchestra.run.smithi097.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-14T10:44:32.329 INFO:teuthology.orchestra.run.smithi097.stdout: rgw max chunk size = 4194304 2024-09-14T10:44:32.330 INFO:teuthology.orchestra.run.smithi097.stdout: rgw obj stripe size = 6291456 2024-09-14T10:44:32.330 INFO:teuthology.orchestra.run.smithi097.stdout: rgw reshard progress judge interval = 10 2024-09-14T10:44:32.330 INFO:teuthology.orchestra.run.smithi097.stdout: rgw s3 auth use sts = True 2024-09-14T10:44:32.330 INFO:teuthology.orchestra.run.smithi097.stdout: rgw sts key = abcdefghijklmnop 2024-09-14T10:44:32.330 INFO:teuthology.orchestra.run.smithi097.stdout: rgw torrent flag = True 2024-09-14T10:44:32.330 INFO:teuthology.orchestra.run.smithi097.stdout: rgw user counters cache = True 2024-09-14T10:44:32.330 INFO:teuthology.orchestra.run.smithi097.stdout: setgroup = ceph 2024-09-14T10:44:32.330 INFO:teuthology.orchestra.run.smithi097.stdout: setuser = ceph 2024-09-14T10:44:32.330 INFO:teuthology.orchestra.run.smithi097.stdout:[mon.a] 2024-09-14T10:44:32.330 INFO:teuthology.orchestra.run.smithi097.stdout:[mon.c] 2024-09-14T10:44:32.330 INFO:teuthology.orchestra.run.smithi097.stdout:[mon.b] 2024-09-14T10:44:32.331 INFO:teuthology.orchestra.run.smithi152.stdout:[global] 2024-09-14T10:44:32.331 INFO:teuthology.orchestra.run.smithi152.stdout: chdir = "" 2024-09-14T10:44:32.331 INFO:teuthology.orchestra.run.smithi152.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-14T10:44:32.331 INFO:teuthology.orchestra.run.smithi152.stdout: auth supported = cephx 2024-09-14T10:44:32.331 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:44:32.331 INFO:teuthology.orchestra.run.smithi152.stdout: filestore xattr use omap = true 2024-09-14T10:44:32.331 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:44:32.331 INFO:teuthology.orchestra.run.smithi152.stdout: mon clock drift allowed = 1.000 2024-09-14T10:44:32.331 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:44:32.332 INFO:teuthology.orchestra.run.smithi152.stdout: osd crush chooseleaf type = 0 2024-09-14T10:44:32.332 INFO:teuthology.orchestra.run.smithi152.stdout: auth debug = true 2024-09-14T10:44:32.332 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:44:32.332 INFO:teuthology.orchestra.run.smithi152.stdout: ms die on old message = true 2024-09-14T10:44:32.332 INFO:teuthology.orchestra.run.smithi152.stdout: ms die on bug = true 2024-09-14T10:44:32.332 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:44:32.332 INFO:teuthology.orchestra.run.smithi152.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-14T10:44:32.332 INFO:teuthology.orchestra.run.smithi152.stdout: mon pg warn max object skew = 0 2024-09-14T10:44:32.332 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:44:32.332 INFO:teuthology.orchestra.run.smithi152.stdout: # disable pg_autoscaler by default for new pools 2024-09-14T10:44:32.332 INFO:teuthology.orchestra.run.smithi152.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-14T10:44:32.332 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:44:32.332 INFO:teuthology.orchestra.run.smithi152.stdout: osd pool default size = 2 2024-09-14T10:44:32.332 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:44:32.333 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd allow primary affinity = true 2024-09-14T10:44:32.333 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd allow pg remap = true 2024-09-14T10:44:32.333 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on legacy crush tunables = false 2024-09-14T10:44:32.333 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on crush straw calc version zero = false 2024-09-14T10:44:32.333 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on no sortbitwise = false 2024-09-14T10:44:32.333 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on osd down out interval zero = false 2024-09-14T10:44:32.333 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on too few osds = false 2024-09-14T10:44:32.333 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-14T10:44:32.333 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-14T10:44:32.333 INFO:teuthology.orchestra.run.smithi152.stdout: mon_allow_pool_size_one = true 2024-09-14T10:44:32.333 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:44:32.333 INFO:teuthology.orchestra.run.smithi152.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-14T10:44:32.333 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:44:32.334 INFO:teuthology.orchestra.run.smithi152.stdout: osd default data pool replay window = 5 2024-09-14T10:44:32.334 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:44:32.334 INFO:teuthology.orchestra.run.smithi152.stdout: mon allow pool delete = true 2024-09-14T10:44:32.334 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:44:32.334 INFO:teuthology.orchestra.run.smithi152.stdout: mon cluster log file level = debug 2024-09-14T10:44:32.334 INFO:teuthology.orchestra.run.smithi152.stdout: debug asserts on shutdown = true 2024-09-14T10:44:32.334 INFO:teuthology.orchestra.run.smithi152.stdout: mon health detail to clog = false 2024-09-14T10:44:32.334 INFO:teuthology.orchestra.run.smithi152.stdout: mon host = "172.21.15.97,[v2:172.21.15.97:3301,v1:172.21.15.97:6790],172.21.15.152" 2024-09-14T10:44:32.334 INFO:teuthology.orchestra.run.smithi152.stdout: mon client directed command retry = 5 2024-09-14T10:44:32.334 INFO:teuthology.orchestra.run.smithi152.stdout: ms inject socket failures = 5000 2024-09-14T10:44:32.334 INFO:teuthology.orchestra.run.smithi152.stdout: osd_max_pg_log_entries = 10 2024-09-14T10:44:32.334 INFO:teuthology.orchestra.run.smithi152.stdout: osd_min_pg_log_entries = 10 2024-09-14T10:44:32.334 INFO:teuthology.orchestra.run.smithi152.stdout: fsid = 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T10:44:32.335 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:44:32.335 INFO:teuthology.orchestra.run.smithi152.stdout:[osd] 2024-09-14T10:44:32.335 INFO:teuthology.orchestra.run.smithi152.stdout: osd journal size = 100 2024-09-14T10:44:32.335 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:44:32.335 INFO:teuthology.orchestra.run.smithi152.stdout: osd scrub load threshold = 5.0 2024-09-14T10:44:32.335 INFO:teuthology.orchestra.run.smithi152.stdout: osd scrub max interval = 600 2024-09-14T10:44:32.335 INFO:teuthology.orchestra.run.smithi152.stdout: osd mclock profile = high_recovery_ops 2024-09-14T10:44:32.335 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:44:32.335 INFO:teuthology.orchestra.run.smithi152.stdout: osd recover clone overlap = true 2024-09-14T10:44:32.335 INFO:teuthology.orchestra.run.smithi152.stdout: osd recovery max chunk = 1048576 2024-09-14T10:44:32.335 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:44:32.335 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug shutdown = true 2024-09-14T10:44:32.335 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug op order = true 2024-09-14T10:44:32.336 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug verify stray on activate = true 2024-09-14T10:44:32.336 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug trim objects = true 2024-09-14T10:44:32.336 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:44:32.336 INFO:teuthology.orchestra.run.smithi152.stdout: osd open classes on start = true 2024-09-14T10:44:32.336 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug pg log writeout = true 2024-09-14T10:44:32.336 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:44:32.336 INFO:teuthology.orchestra.run.smithi152.stdout: osd deep scrub update digest min age = 30 2024-09-14T10:44:32.336 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:44:32.336 INFO:teuthology.orchestra.run.smithi152.stdout: osd map max advance = 10 2024-09-14T10:44:32.336 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:44:32.336 INFO:teuthology.orchestra.run.smithi152.stdout: journal zero on create = true 2024-09-14T10:44:32.336 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:44:32.336 INFO:teuthology.orchestra.run.smithi152.stdout: filestore ondisk finisher threads = 3 2024-09-14T10:44:32.336 INFO:teuthology.orchestra.run.smithi152.stdout: filestore apply finisher threads = 3 2024-09-14T10:44:32.337 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:44:32.337 INFO:teuthology.orchestra.run.smithi152.stdout: bdev debug aio = true 2024-09-14T10:44:32.337 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug misdirected ops = true 2024-09-14T10:44:32.337 INFO:teuthology.orchestra.run.smithi152.stdout: bdev async discard = True 2024-09-14T10:44:32.337 INFO:teuthology.orchestra.run.smithi152.stdout: bdev enable discard = True 2024-09-14T10:44:32.337 INFO:teuthology.orchestra.run.smithi152.stdout: bluestore allocator = bitmap 2024-09-14T10:44:32.337 INFO:teuthology.orchestra.run.smithi152.stdout: bluestore block size = 96636764160 2024-09-14T10:44:32.337 INFO:teuthology.orchestra.run.smithi152.stdout: bluestore fsck on mount = True 2024-09-14T10:44:32.337 INFO:teuthology.orchestra.run.smithi152.stdout: debug bluefs = 1/20 2024-09-14T10:44:32.337 INFO:teuthology.orchestra.run.smithi152.stdout: debug bluestore = 1/20 2024-09-14T10:44:32.337 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2024-09-14T10:44:32.337 INFO:teuthology.orchestra.run.smithi152.stdout: debug objclass = 20 2024-09-14T10:44:32.338 INFO:teuthology.orchestra.run.smithi152.stdout: debug osd = 20 2024-09-14T10:44:32.338 INFO:teuthology.orchestra.run.smithi152.stdout: debug rocksdb = 4/10 2024-09-14T10:44:32.338 INFO:teuthology.orchestra.run.smithi152.stdout: lockdep = True 2024-09-14T10:44:32.338 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd backfillfull_ratio = 0.85 2024-09-14T10:44:32.338 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd full ratio = 0.9 2024-09-14T10:44:32.338 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd nearfull ratio = 0.8 2024-09-14T10:44:32.338 INFO:teuthology.orchestra.run.smithi152.stdout: osd failsafe full ratio = 0.95 2024-09-14T10:44:32.338 INFO:teuthology.orchestra.run.smithi152.stdout: osd objectstore = bluestore 2024-09-14T10:44:32.338 INFO:teuthology.orchestra.run.smithi152.stdout: osd shutdown pgref assert = True 2024-09-14T10:44:32.338 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:44:32.338 INFO:teuthology.orchestra.run.smithi152.stdout:[mgr] 2024-09-14T10:44:32.338 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2024-09-14T10:44:32.338 INFO:teuthology.orchestra.run.smithi152.stdout: debug mgr = 20 2024-09-14T10:44:32.338 INFO:teuthology.orchestra.run.smithi152.stdout: debug mon = 20 2024-09-14T10:44:32.339 INFO:teuthology.orchestra.run.smithi152.stdout: debug auth = 20 2024-09-14T10:44:32.339 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min pgs per osd = 4 2024-09-14T10:44:32.339 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min bytes per osd = 10 2024-09-14T10:44:32.339 INFO:teuthology.orchestra.run.smithi152.stdout: mgr/telemetry/nag = false 2024-09-14T10:44:32.339 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:44:32.339 INFO:teuthology.orchestra.run.smithi152.stdout:[mon] 2024-09-14T10:44:32.339 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2024-09-14T10:44:32.339 INFO:teuthology.orchestra.run.smithi152.stdout: debug mon = 20 2024-09-14T10:44:32.339 INFO:teuthology.orchestra.run.smithi152.stdout: debug paxos = 20 2024-09-14T10:44:32.339 INFO:teuthology.orchestra.run.smithi152.stdout: debug auth = 20 2024-09-14T10:44:32.339 INFO:teuthology.orchestra.run.smithi152.stdout: mon data avail warn = 5 2024-09-14T10:44:32.339 INFO:teuthology.orchestra.run.smithi152.stdout: mon mgr mkfs grace = 240 2024-09-14T10:44:32.339 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min pgs per osd = 4 2024-09-14T10:44:32.340 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd reporter subtree level = osd 2024-09-14T10:44:32.340 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd prime pg temp = true 2024-09-14T10:44:32.340 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min bytes per osd = 10 2024-09-14T10:44:32.340 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:44:32.340 INFO:teuthology.orchestra.run.smithi152.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-14T10:44:32.340 INFO:teuthology.orchestra.run.smithi152.stdout: auth mon ticket ttl = 660 # 11m 2024-09-14T10:44:32.340 INFO:teuthology.orchestra.run.smithi152.stdout: auth service ticket ttl = 240 # 4m 2024-09-14T10:44:32.340 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:44:32.340 INFO:teuthology.orchestra.run.smithi152.stdout: # don't complain about insecure global_id in the test suite 2024-09-14T10:44:32.340 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-14T10:44:32.340 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-14T10:44:32.340 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:44:32.340 INFO:teuthology.orchestra.run.smithi152.stdout: # 1m isn't quite enough 2024-09-14T10:44:32.341 INFO:teuthology.orchestra.run.smithi152.stdout: mon_down_mkfs_grace = 2m 2024-09-14T10:44:32.341 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:44:32.341 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_filestore_osds = false 2024-09-14T10:44:32.341 INFO:teuthology.orchestra.run.smithi152.stdout: lockdep = True 2024-09-14T10:44:32.341 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-14T10:44:32.341 INFO:teuthology.orchestra.run.smithi152.stdout:[client] 2024-09-14T10:44:32.341 INFO:teuthology.orchestra.run.smithi152.stdout: rgw cache enabled = true 2024-09-14T10:44:32.341 INFO:teuthology.orchestra.run.smithi152.stdout: rgw enable ops log = true 2024-09-14T10:44:32.341 INFO:teuthology.orchestra.run.smithi152.stdout: rgw enable usage log = true 2024-09-14T10:44:32.341 INFO:teuthology.orchestra.run.smithi152.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-14T10:44:32.341 INFO:teuthology.orchestra.run.smithi152.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-14T10:44:32.341 INFO:teuthology.orchestra.run.smithi152.stdout: debug rgw = 20 2024-09-14T10:44:32.341 INFO:teuthology.orchestra.run.smithi152.stdout: debug rgw notification = 20 2024-09-14T10:44:32.342 INFO:teuthology.orchestra.run.smithi152.stdout: rgw bucket counters cache = True 2024-09-14T10:44:32.342 INFO:teuthology.orchestra.run.smithi152.stdout: rgw crypt require ssl = False 2024-09-14T10:44:32.342 INFO:teuthology.orchestra.run.smithi152.stdout: rgw crypt s3 kms backend = testing 2024-09-14T10:44:32.342 INFO:teuthology.orchestra.run.smithi152.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-14T10:44:32.342 INFO:teuthology.orchestra.run.smithi152.stdout: rgw max chunk size = 4194304 2024-09-14T10:44:32.342 INFO:teuthology.orchestra.run.smithi152.stdout: rgw obj stripe size = 6291456 2024-09-14T10:44:32.342 INFO:teuthology.orchestra.run.smithi152.stdout: rgw reshard progress judge interval = 10 2024-09-14T10:44:32.342 INFO:teuthology.orchestra.run.smithi152.stdout: rgw s3 auth use sts = True 2024-09-14T10:44:32.342 INFO:teuthology.orchestra.run.smithi152.stdout: rgw sts key = abcdefghijklmnop 2024-09-14T10:44:32.342 INFO:teuthology.orchestra.run.smithi152.stdout: rgw torrent flag = True 2024-09-14T10:44:32.342 INFO:teuthology.orchestra.run.smithi152.stdout: rgw user counters cache = True 2024-09-14T10:44:32.342 INFO:teuthology.orchestra.run.smithi152.stdout: setgroup = ceph 2024-09-14T10:44:32.342 INFO:teuthology.orchestra.run.smithi152.stdout: setuser = ceph 2024-09-14T10:44:32.342 INFO:teuthology.orchestra.run.smithi152.stdout:[mon.a] 2024-09-14T10:44:32.343 INFO:teuthology.orchestra.run.smithi152.stdout:[mon.c] 2024-09-14T10:44:32.343 INFO:teuthology.orchestra.run.smithi152.stdout:[mon.b] 2024-09-14T10:44:32.344 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-14T10:44:32.344 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-14T10:44:32.455 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-14T10:44:32.455 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-14T10:44:32.455 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-14T10:44:32.484 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-14T10:44:32.484 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-14T10:44:32.553 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi097.front.sepia.ceph.com 2024-09-14T10:44:32.554 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-14T10:44:32.554 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-14T10:44:32.554 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T10:44:32.643 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-14T10:44:32.643 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:44:32.712 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi152.front.sepia.ceph.com 2024-09-14T10:44:32.712 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-14T10:44:32.713 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-14T10:44:32.713 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T10:44:32.763 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-14T10:44:32.763 DEBUG:teuthology.orchestra.run.smithi152:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:44:32.832 INFO:tasks.ceph:Setting up mon nodes... 2024-09-14T10:44:32.832 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-14T10:44:32.833 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-14T10:44:32.897 INFO:teuthology.orchestra.run.smithi097.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-14T10:44:32.899 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-14T10:44:32.991 INFO:teuthology.orchestra.run.smithi152.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-14T10:44:32.993 INFO:tasks.ceph:Setting up mds nodes... 2024-09-14T10:44:32.994 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-14T10:44:32.994 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-14T10:44:33.049 INFO:teuthology.orchestra.run.smithi097.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-14T10:44:33.062 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-14T10:44:33.118 INFO:teuthology.orchestra.run.smithi152.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-14T10:44:33.130 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-14T10:44:33.131 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi097.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi152.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-14T10:44:33.131 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-14T10:44:33.169 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T10:44:33.169 INFO:tasks.ceph:role: osd.0 2024-09-14T10:44:33.169 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi097.front.sepia.ceph.com 2024-09-14T10:44:33.169 DEBUG:teuthology.orchestra.run.smithi097:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-14T10:44:33.255 INFO:teuthology.orchestra.run.smithi097.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T10:44:33.256 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T10:44:33.256 INFO:teuthology.orchestra.run.smithi097.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T10:44:33.256 INFO:teuthology.orchestra.run.smithi097.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T10:44:33.256 INFO:teuthology.orchestra.run.smithi097.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T10:44:33.256 INFO:teuthology.orchestra.run.smithi097.stdout: = sunit=0 swidth=0 blks 2024-09-14T10:44:33.256 INFO:teuthology.orchestra.run.smithi097.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T10:44:33.256 INFO:teuthology.orchestra.run.smithi097.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T10:44:33.256 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T10:44:33.256 INFO:teuthology.orchestra.run.smithi097.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T10:44:33.737 INFO:teuthology.orchestra.run.smithi097.stdout:Discarding blocks...Done. 2024-09-14T10:44:33.739 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi097.front.sepia.ceph.com -o noatime 2024-09-14T10:44:33.740 DEBUG:teuthology.orchestra.run.smithi097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-14T10:44:33.813 DEBUG:teuthology.orchestra.run.smithi097:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-14T10:44:33.858 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-14T10:44:33.896 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T10:44:33.896 INFO:tasks.ceph:role: osd.1 2024-09-14T10:44:33.896 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi097.front.sepia.ceph.com 2024-09-14T10:44:33.896 DEBUG:teuthology.orchestra.run.smithi097:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-14T10:44:33.983 INFO:teuthology.orchestra.run.smithi097.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T10:44:33.983 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T10:44:33.983 INFO:teuthology.orchestra.run.smithi097.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T10:44:33.983 INFO:teuthology.orchestra.run.smithi097.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T10:44:33.983 INFO:teuthology.orchestra.run.smithi097.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T10:44:33.984 INFO:teuthology.orchestra.run.smithi097.stdout: = sunit=0 swidth=0 blks 2024-09-14T10:44:33.984 INFO:teuthology.orchestra.run.smithi097.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T10:44:33.984 INFO:teuthology.orchestra.run.smithi097.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T10:44:33.984 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T10:44:33.984 INFO:teuthology.orchestra.run.smithi097.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T10:44:34.443 INFO:teuthology.orchestra.run.smithi097.stdout:Discarding blocks...Done. 2024-09-14T10:44:34.446 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi097.front.sepia.ceph.com -o noatime 2024-09-14T10:44:34.446 DEBUG:teuthology.orchestra.run.smithi097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-14T10:44:34.500 DEBUG:teuthology.orchestra.run.smithi097:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-14T10:44:34.542 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-14T10:44:34.620 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T10:44:34.620 INFO:tasks.ceph:role: osd.2 2024-09-14T10:44:34.620 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi097.front.sepia.ceph.com 2024-09-14T10:44:34.620 DEBUG:teuthology.orchestra.run.smithi097:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-14T10:44:34.706 INFO:teuthology.orchestra.run.smithi097.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T10:44:34.706 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T10:44:34.706 INFO:teuthology.orchestra.run.smithi097.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T10:44:34.706 INFO:teuthology.orchestra.run.smithi097.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T10:44:34.706 INFO:teuthology.orchestra.run.smithi097.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T10:44:34.706 INFO:teuthology.orchestra.run.smithi097.stdout: = sunit=0 swidth=0 blks 2024-09-14T10:44:34.706 INFO:teuthology.orchestra.run.smithi097.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T10:44:34.706 INFO:teuthology.orchestra.run.smithi097.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T10:44:34.707 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T10:44:34.707 INFO:teuthology.orchestra.run.smithi097.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T10:44:35.192 INFO:teuthology.orchestra.run.smithi097.stdout:Discarding blocks...Done. 2024-09-14T10:44:35.194 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi097.front.sepia.ceph.com -o noatime 2024-09-14T10:44:35.194 DEBUG:teuthology.orchestra.run.smithi097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-14T10:44:35.268 DEBUG:teuthology.orchestra.run.smithi097:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-14T10:44:35.313 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-14T10:44:35.352 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T10:44:35.352 INFO:tasks.ceph:role: osd.3 2024-09-14T10:44:35.353 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi097.front.sepia.ceph.com 2024-09-14T10:44:35.353 DEBUG:teuthology.orchestra.run.smithi097:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-14T10:44:35.439 INFO:teuthology.orchestra.run.smithi097.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T10:44:35.439 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T10:44:35.439 INFO:teuthology.orchestra.run.smithi097.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T10:44:35.439 INFO:teuthology.orchestra.run.smithi097.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T10:44:35.440 INFO:teuthology.orchestra.run.smithi097.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T10:44:35.440 INFO:teuthology.orchestra.run.smithi097.stdout: = sunit=0 swidth=0 blks 2024-09-14T10:44:35.440 INFO:teuthology.orchestra.run.smithi097.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T10:44:35.440 INFO:teuthology.orchestra.run.smithi097.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T10:44:35.440 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T10:44:35.440 INFO:teuthology.orchestra.run.smithi097.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T10:44:35.921 INFO:teuthology.orchestra.run.smithi097.stdout:Discarding blocks...Done. 2024-09-14T10:44:35.923 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi097.front.sepia.ceph.com -o noatime 2024-09-14T10:44:35.923 DEBUG:teuthology.orchestra.run.smithi097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-14T10:44:36.034 DEBUG:teuthology.orchestra.run.smithi097:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-14T10:44:36.081 DEBUG:teuthology.orchestra.run.smithi097:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:44:36.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:44:36.156+0000 7f5ac2830640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-14T10:44:36.157 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:44:36.158+0000 7f5ac2830640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-14T10:44:36.157 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:44:36.158+0000 7f5ac2830640 -1 bdev(0x5652b18a7800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-14T10:44:36.157 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:44:36.158+0000 7f5ac2830640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-14T10:44:39.561 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-14T10:44:39.602 DEBUG:teuthology.orchestra.run.smithi097:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:44:39.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:44:39.705+0000 7f224742a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-14T10:44:39.704 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:44:39.705+0000 7f224742a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-14T10:44:39.704 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:44:39.705+0000 7f224742a640 -1 bdev(0x5643612f5800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-14T10:44:39.704 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:44:39.705+0000 7f224742a640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-14T10:44:42.859 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-14T10:44:42.900 DEBUG:teuthology.orchestra.run.smithi097:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:44:43.002 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:44:43.003+0000 7fe6240f1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-14T10:44:43.002 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:44:43.003+0000 7fe6240f1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-14T10:44:43.002 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:44:43.003+0000 7fe6240f1640 -1 bdev(0x55ca0bd4b800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-14T10:44:43.002 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:44:43.003+0000 7fe6240f1640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-14T10:44:45.910 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-14T10:44:45.953 DEBUG:teuthology.orchestra.run.smithi097:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:44:46.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:44:46.056+0000 7f1c7441a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-14T10:44:46.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:44:46.056+0000 7f1c7441a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-14T10:44:46.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:44:46.056+0000 7f1c7441a640 -1 bdev(0x556df1a75800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-14T10:44:46.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:44:46.056+0000 7f1c7441a640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-14T10:44:49.205 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-14T10:44:49.248 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-14T10:44:49.295 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T10:44:49.295 INFO:tasks.ceph:role: osd.4 2024-09-14T10:44:49.295 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi152.front.sepia.ceph.com 2024-09-14T10:44:49.295 DEBUG:teuthology.orchestra.run.smithi152:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-14T10:44:49.344 INFO:teuthology.orchestra.run.smithi152.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T10:44:49.344 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T10:44:49.344 INFO:teuthology.orchestra.run.smithi152.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T10:44:49.344 INFO:teuthology.orchestra.run.smithi152.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T10:44:49.344 INFO:teuthology.orchestra.run.smithi152.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T10:44:49.344 INFO:teuthology.orchestra.run.smithi152.stdout: = sunit=0 swidth=0 blks 2024-09-14T10:44:49.345 INFO:teuthology.orchestra.run.smithi152.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T10:44:49.345 INFO:teuthology.orchestra.run.smithi152.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T10:44:49.345 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T10:44:49.345 INFO:teuthology.orchestra.run.smithi152.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T10:44:49.860 INFO:teuthology.orchestra.run.smithi152.stdout:Discarding blocks...Done. 2024-09-14T10:44:49.862 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi152.front.sepia.ceph.com -o noatime 2024-09-14T10:44:49.862 DEBUG:teuthology.orchestra.run.smithi152:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-14T10:44:49.994 DEBUG:teuthology.orchestra.run.smithi152:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-14T10:44:50.043 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-14T10:44:50.084 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T10:44:50.084 INFO:tasks.ceph:role: osd.5 2024-09-14T10:44:50.084 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi152.front.sepia.ceph.com 2024-09-14T10:44:50.084 DEBUG:teuthology.orchestra.run.smithi152:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-14T10:44:50.171 INFO:teuthology.orchestra.run.smithi152.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T10:44:50.171 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T10:44:50.171 INFO:teuthology.orchestra.run.smithi152.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T10:44:50.171 INFO:teuthology.orchestra.run.smithi152.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T10:44:50.171 INFO:teuthology.orchestra.run.smithi152.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T10:44:50.172 INFO:teuthology.orchestra.run.smithi152.stdout: = sunit=0 swidth=0 blks 2024-09-14T10:44:50.172 INFO:teuthology.orchestra.run.smithi152.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T10:44:50.172 INFO:teuthology.orchestra.run.smithi152.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T10:44:50.172 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T10:44:50.172 INFO:teuthology.orchestra.run.smithi152.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T10:44:50.622 INFO:teuthology.orchestra.run.smithi152.stdout:Discarding blocks...Done. 2024-09-14T10:44:50.964 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi152.front.sepia.ceph.com -o noatime 2024-09-14T10:44:50.964 DEBUG:teuthology.orchestra.run.smithi152:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-14T10:44:51.034 DEBUG:teuthology.orchestra.run.smithi152:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-14T10:44:51.076 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-14T10:44:51.155 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T10:44:51.155 INFO:tasks.ceph:role: osd.6 2024-09-14T10:44:51.156 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi152.front.sepia.ceph.com 2024-09-14T10:44:51.156 DEBUG:teuthology.orchestra.run.smithi152:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-14T10:44:51.242 INFO:teuthology.orchestra.run.smithi152.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T10:44:51.242 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T10:44:51.242 INFO:teuthology.orchestra.run.smithi152.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T10:44:51.242 INFO:teuthology.orchestra.run.smithi152.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T10:44:51.242 INFO:teuthology.orchestra.run.smithi152.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T10:44:51.242 INFO:teuthology.orchestra.run.smithi152.stdout: = sunit=0 swidth=0 blks 2024-09-14T10:44:51.243 INFO:teuthology.orchestra.run.smithi152.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T10:44:51.243 INFO:teuthology.orchestra.run.smithi152.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T10:44:51.243 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T10:44:51.243 INFO:teuthology.orchestra.run.smithi152.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T10:44:51.745 INFO:teuthology.orchestra.run.smithi152.stdout:Discarding blocks...Done. 2024-09-14T10:44:51.747 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi152.front.sepia.ceph.com -o noatime 2024-09-14T10:44:51.748 DEBUG:teuthology.orchestra.run.smithi152:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-14T10:44:51.878 DEBUG:teuthology.orchestra.run.smithi152:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-14T10:44:51.923 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-14T10:44:52.001 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T10:44:52.002 INFO:tasks.ceph:role: osd.7 2024-09-14T10:44:52.002 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi152.front.sepia.ceph.com 2024-09-14T10:44:52.002 DEBUG:teuthology.orchestra.run.smithi152:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-14T10:44:52.089 INFO:teuthology.orchestra.run.smithi152.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T10:44:52.089 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T10:44:52.089 INFO:teuthology.orchestra.run.smithi152.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T10:44:52.089 INFO:teuthology.orchestra.run.smithi152.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T10:44:52.089 INFO:teuthology.orchestra.run.smithi152.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T10:44:52.089 INFO:teuthology.orchestra.run.smithi152.stdout: = sunit=0 swidth=0 blks 2024-09-14T10:44:52.089 INFO:teuthology.orchestra.run.smithi152.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T10:44:52.089 INFO:teuthology.orchestra.run.smithi152.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T10:44:52.089 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T10:44:52.089 INFO:teuthology.orchestra.run.smithi152.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T10:44:52.558 INFO:teuthology.orchestra.run.smithi152.stdout:Discarding blocks...Done. 2024-09-14T10:44:52.560 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi152.front.sepia.ceph.com -o noatime 2024-09-14T10:44:52.560 DEBUG:teuthology.orchestra.run.smithi152:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-14T10:44:52.648 DEBUG:teuthology.orchestra.run.smithi152:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-14T10:44:52.693 DEBUG:teuthology.orchestra.run.smithi152:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:44:52.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-14T10:44:52.763+0000 7f7bb8b25640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-14T10:44:52.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-14T10:44:52.763+0000 7f7bb8b25640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-14T10:44:52.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-14T10:44:52.763+0000 7f7bb8b25640 -1 bdev(0x56006ef25800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-14T10:44:52.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-14T10:44:52.763+0000 7f7bb8b25640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-14T10:44:56.179 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-14T10:44:56.224 DEBUG:teuthology.orchestra.run.smithi152:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:44:56.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-14T10:44:56.288+0000 7fe28d60d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-14T10:44:56.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-14T10:44:56.288+0000 7fe28d60d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-14T10:44:56.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-14T10:44:56.289+0000 7fe28d60d640 -1 bdev(0x55cedeca7800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-14T10:44:56.287 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-14T10:44:56.289+0000 7fe28d60d640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-14T10:44:59.457 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-14T10:44:59.502 DEBUG:teuthology.orchestra.run.smithi152:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:44:59.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-14T10:44:59.609+0000 7ff6e8ab2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-14T10:44:59.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-14T10:44:59.609+0000 7ff6e8ab2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-14T10:44:59.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-14T10:44:59.609+0000 7ff6e8ab2640 -1 bdev(0x564f59b53800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-14T10:44:59.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-14T10:44:59.609+0000 7ff6e8ab2640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-14T10:45:02.762 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-14T10:45:02.803 DEBUG:teuthology.orchestra.run.smithi152:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:45:02.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-14T10:45:02.904+0000 7f84d11c5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-14T10:45:02.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-14T10:45:02.904+0000 7f84d11c5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-14T10:45:02.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-14T10:45:02.904+0000 7f84d11c5640 -1 bdev(0x555a969ed800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-14T10:45:02.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-14T10:45:02.905+0000 7f84d11c5640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-14T10:45:05.811 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-14T10:45:05.850 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-14T10:45:05.851 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-14T10:45:05.851 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-14T10:45:05.897 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-14T10:45:05.897 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-14T10:45:05.980 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-14T10:45:05.980 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-14T10:45:06.062 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-14T10:45:06.062 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-14T10:45:06.143 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-14T10:45:06.143 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-14T10:45:06.222 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-14T10:45:06.222 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-14T10:45:06.263 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-14T10:45:06.263 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-14T10:45:06.343 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-14T10:45:06.343 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-14T10:45:06.423 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-14T10:45:06.423 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-14T10:45:06.503 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-14T10:45:06.503 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-14T10:45:06.582 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-14T10:45:06.582 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-14T10:45:06.612 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-14T10:45:06.612 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-14T10:45:06.651 INFO:tasks.ceph:Adding keys to all mons... 2024-09-14T10:45:06.651 DEBUG:teuthology.orchestra.run.smithi097:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-14T10:45:06.655 DEBUG:teuthology.orchestra.run.smithi152:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-14T10:45:06.696 INFO:teuthology.orchestra.run.smithi097.stdout:[mgr.y] 2024-09-14T10:45:06.696 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQAQaeVmtV6iNRAAUYcwXgqaBH881NbyHYTDQw== 2024-09-14T10:45:06.696 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.0] 2024-09-14T10:45:06.696 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQAUaeVmKVJeCRAA5O4DCG4tjDdQ3BlbD9SLIA== 2024-09-14T10:45:06.696 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.1] 2024-09-14T10:45:06.696 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQAXaeVmdygWKhAAalqe2i/T7U6yvjOHrJgbeA== 2024-09-14T10:45:06.696 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.2] 2024-09-14T10:45:06.696 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQAbaeVmDrtEABAA2nbylfAXwPZP/N1rucXZcA== 2024-09-14T10:45:06.697 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.3] 2024-09-14T10:45:06.697 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQAeaeVme9FsAxAAyBU4Y0dSAZADzMbmCOtGQw== 2024-09-14T10:45:06.697 INFO:teuthology.orchestra.run.smithi097.stdout:[mgr.x] 2024-09-14T10:45:06.697 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQAQaeVmUJY8OxAAy9xNMTfEwxHn12S4RUOrEQ== 2024-09-14T10:45:06.697 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.4] 2024-09-14T10:45:06.698 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQAkaeVm/5aLLRAAW41BWX2cQrtInG8o/1lzFg== 2024-09-14T10:45:06.698 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.5] 2024-09-14T10:45:06.698 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQAoaeVmKfpAERAAl3jmwY9XmQIhJeucfTud6Q== 2024-09-14T10:45:06.698 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.6] 2024-09-14T10:45:06.698 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQAraeVmpylhJBAAcDIchEhCLeJs62lZXGjkiQ== 2024-09-14T10:45:06.698 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.7] 2024-09-14T10:45:06.698 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQAuaeVmLaD3NRAAwaFCMrHCg6kz5jzBxS+Wrg== 2024-09-14T10:45:06.698 INFO:teuthology.orchestra.run.smithi097.stdout:[client.0] 2024-09-14T10:45:06.698 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQARaeVmsykgAxAAhGZdrEn0i2T+loXSwPELhA== 2024-09-14T10:45:06.698 INFO:teuthology.orchestra.run.smithi097.stdout:[client.1] 2024-09-14T10:45:06.698 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQARaeVmjYAxBxAAkWkiGDPhmJjSuAXmxxCPuA== 2024-09-14T10:45:06.729 INFO:teuthology.orchestra.run.smithi152.stdout:[mgr.y] 2024-09-14T10:45:06.729 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQAQaeVmtV6iNRAAUYcwXgqaBH881NbyHYTDQw== 2024-09-14T10:45:06.729 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.0] 2024-09-14T10:45:06.729 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQAUaeVmKVJeCRAA5O4DCG4tjDdQ3BlbD9SLIA== 2024-09-14T10:45:06.729 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.1] 2024-09-14T10:45:06.729 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQAXaeVmdygWKhAAalqe2i/T7U6yvjOHrJgbeA== 2024-09-14T10:45:06.729 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.2] 2024-09-14T10:45:06.729 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQAbaeVmDrtEABAA2nbylfAXwPZP/N1rucXZcA== 2024-09-14T10:45:06.729 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.3] 2024-09-14T10:45:06.729 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQAeaeVme9FsAxAAyBU4Y0dSAZADzMbmCOtGQw== 2024-09-14T10:45:06.730 INFO:teuthology.orchestra.run.smithi152.stdout:[mgr.x] 2024-09-14T10:45:06.730 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQAQaeVmUJY8OxAAy9xNMTfEwxHn12S4RUOrEQ== 2024-09-14T10:45:06.730 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.4] 2024-09-14T10:45:06.730 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQAkaeVm/5aLLRAAW41BWX2cQrtInG8o/1lzFg== 2024-09-14T10:45:06.730 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.5] 2024-09-14T10:45:06.730 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQAoaeVmKfpAERAAl3jmwY9XmQIhJeucfTud6Q== 2024-09-14T10:45:06.730 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.6] 2024-09-14T10:45:06.730 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQAraeVmpylhJBAAcDIchEhCLeJs62lZXGjkiQ== 2024-09-14T10:45:06.730 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.7] 2024-09-14T10:45:06.730 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQAuaeVmLaD3NRAAwaFCMrHCg6kz5jzBxS+Wrg== 2024-09-14T10:45:06.730 INFO:teuthology.orchestra.run.smithi152.stdout:[client.0] 2024-09-14T10:45:06.730 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQARaeVmsykgAxAAhGZdrEn0i2T+loXSwPELhA== 2024-09-14T10:45:06.730 INFO:teuthology.orchestra.run.smithi152.stdout:[client.1] 2024-09-14T10:45:06.731 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQARaeVmjYAxBxAAkWkiGDPhmJjSuAXmxxCPuA== 2024-09-14T10:45:06.732 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T10:45:06.742 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T10:45:06.838 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:45:06.840 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:45:06.905 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:45:06.908 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:45:06.972 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:45:06.975 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:45:07.039 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:45:07.041 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:45:07.106 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T10:45:07.108 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T10:45:07.172 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:45:07.175 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:45:07.240 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:45:07.242 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:45:07.306 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:45:07.309 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:45:07.374 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:45:07.377 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:45:07.442 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T10:45:07.444 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T10:45:07.512 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T10:45:07.517 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T10:45:07.592 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-14T10:45:07.654 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-14T10:45:07.920 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T10:45:08.039 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-14T10:45:08.077 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-14T10:45:08.161 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T10:45:08.278 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-14T10:45:08.316 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-14T10:45:08.358 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T10:45:08.471 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-14T10:45:08.511 DEBUG:teuthology.orchestra.run.smithi097:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:45:08.515 DEBUG:teuthology.orchestra.run.smithi152:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:45:08.583 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-14T10:45:08.584 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-14T10:45:08.584 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-14T10:45:08.587 INFO:tasks.ceph.mon.a:Started 2024-09-14T10:45:08.587 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-14T10:45:08.587 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-14T10:45:08.589 INFO:tasks.ceph.mon.c:Started 2024-09-14T10:45:08.589 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-14T10:45:08.589 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-14T10:45:08.627 INFO:tasks.ceph.mon.b:Started 2024-09-14T10:45:08.628 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-14T10:45:08.628 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-14T10:45:08.628 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-14T10:45:08.632 INFO:tasks.ceph.mgr.y:Started 2024-09-14T10:45:08.632 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-14T10:45:08.632 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-14T10:45:08.634 INFO:tasks.ceph.mgr.x:Started 2024-09-14T10:45:08.635 DEBUG:tasks.ceph:set 0 configs 2024-09-14T10:45:08.635 INFO:tasks.ceph:Setting crush tunables to default 2024-09-14T10:45:08.635 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd crush tunables default 2024-09-14T10:45:13.999 INFO:teuthology.orchestra.run.smithi097.stderr:adjusted tunables profile to default 2024-09-14T10:45:14.010 INFO:tasks.ceph:check_enable_crimson: False 2024-09-14T10:45:14.010 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-14T10:45:14.011 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-14T10:45:14.011 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-14T10:45:14.050 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-14T10:45:14.050 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-14T10:45:14.128 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-14T10:45:14.128 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-14T10:45:14.206 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-14T10:45:14.206 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-14T10:45:14.285 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-14T10:45:14.285 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-14T10:45:14.332 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-14T10:45:14.332 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-14T10:45:14.416 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-14T10:45:14.416 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-14T10:45:14.497 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-14T10:45:14.497 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-14T10:45:14.577 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd new cdfc5a56-a482-40e7-af02-5d9af12dd4ef 0 2024-09-14T10:45:14.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-14T10:45:14.934+0000 7f7393fff640 0 --2- 172.21.15.152:0/2729340604 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f739c0b4bb0 0x7f739c13a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T10:45:15.017 INFO:teuthology.orchestra.run.smithi152.stdout:0 2024-09-14T10:45:15.029 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd new c0fe1ede-ef7f-4181-8112-6fde8460b61b 1 2024-09-14T10:45:15.226 INFO:teuthology.orchestra.run.smithi152.stdout:1 2024-09-14T10:45:15.238 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd new 976dd4fa-681e-42f9-b02b-6667894d9c56 2 2024-09-14T10:45:15.439 INFO:teuthology.orchestra.run.smithi152.stdout:2 2024-09-14T10:45:15.450 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd new 995c66eb-223f-4f55-923c-f011e5ea02ec 3 2024-09-14T10:45:15.650 INFO:teuthology.orchestra.run.smithi152.stdout:3 2024-09-14T10:45:15.662 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd new 66b0bec0-8bf3-4f2b-8ee5-5c6cfbea4b66 4 2024-09-14T10:45:15.855 INFO:teuthology.orchestra.run.smithi152.stdout:4 2024-09-14T10:45:15.867 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd new dfcb9f2f-d1fa-44c2-9408-ae3354291069 5 2024-09-14T10:45:16.061 INFO:teuthology.orchestra.run.smithi152.stdout:5 2024-09-14T10:45:16.073 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd new e42c37d5-26d2-492a-9fcd-46c1e405017b 6 2024-09-14T10:45:16.266 INFO:teuthology.orchestra.run.smithi152.stdout:6 2024-09-14T10:45:16.278 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd new 0f7d6f9a-cde8-4a3e-82b3-f3e0ef67e0b3 7 2024-09-14T10:45:16.473 INFO:teuthology.orchestra.run.smithi152.stdout:7 2024-09-14T10:45:16.484 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-14T10:45:16.484 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-14T10:45:16.487 INFO:tasks.ceph.osd.0:Started 2024-09-14T10:45:16.487 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-14T10:45:16.487 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-14T10:45:16.489 INFO:tasks.ceph.osd.1:Started 2024-09-14T10:45:16.489 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-14T10:45:16.489 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-14T10:45:16.491 INFO:tasks.ceph.osd.2:Started 2024-09-14T10:45:16.491 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-14T10:45:16.491 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-14T10:45:16.493 INFO:tasks.ceph.osd.3:Started 2024-09-14T10:45:16.493 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-14T10:45:16.494 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-14T10:45:16.496 INFO:tasks.ceph.osd.4:Started 2024-09-14T10:45:16.496 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-14T10:45:16.496 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-14T10:45:16.498 INFO:tasks.ceph.osd.5:Started 2024-09-14T10:45:16.498 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-14T10:45:16.498 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-14T10:45:16.502 INFO:tasks.ceph.osd.6:Started 2024-09-14T10:45:16.503 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-14T10:45:16.503 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-14T10:45:16.505 INFO:tasks.ceph.osd.7:Started 2024-09-14T10:45:16.505 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T10:45:16.716 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:45:16.717 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":10,"fsid":"60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9","created":"2024-09-14T10:45:13.908654+0000","modified":"2024-09-14T10:45:16.472549+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T10:45:16.472549+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"cdfc5a56-a482-40e7-af02-5d9af12dd4ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c0fe1ede-ef7f-4181-8112-6fde8460b61b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"976dd4fa-681e-42f9-b02b-6667894d9c56","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"995c66eb-223f-4f55-923c-f011e5ea02ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"66b0bec0-8bf3-4f2b-8ee5-5c6cfbea4b66","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dfcb9f2f-d1fa-44c2-9408-ae3354291069","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e42c37d5-26d2-492a-9fcd-46c1e405017b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0f7d6f9a-cde8-4a3e-82b3-f3e0ef67e0b3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T10:45:16.728 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-14T10:45:16.729 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-14T10:45:17.509 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-14T10:45:17.511+0000 7fc01080b640 -1 Falling back to public interface 2024-09-14T10:45:17.535 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T10:45:17.708 INFO:teuthology.misc.health.smithi097.stdout: 2024-09-14T10:45:17.709 INFO:teuthology.misc.health.smithi097.stdout:{"epoch":10,"fsid":"60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9","created":"2024-09-14T10:45:13.908654+0000","modified":"2024-09-14T10:45:16.472549+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T10:45:16.472549+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"cdfc5a56-a482-40e7-af02-5d9af12dd4ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c0fe1ede-ef7f-4181-8112-6fde8460b61b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"976dd4fa-681e-42f9-b02b-6667894d9c56","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"995c66eb-223f-4f55-923c-f011e5ea02ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"66b0bec0-8bf3-4f2b-8ee5-5c6cfbea4b66","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dfcb9f2f-d1fa-44c2-9408-ae3354291069","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e42c37d5-26d2-492a-9fcd-46c1e405017b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0f7d6f9a-cde8-4a3e-82b3-f3e0ef67e0b3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T10:45:17.718 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-14T10:45:17.961 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-14T10:45:17.962+0000 7ff106a1d640 -1 Falling back to public interface 2024-09-14T10:45:17.970 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-14T10:45:17.972+0000 7fc6e6b20640 -1 Falling back to public interface 2024-09-14T10:45:17.973 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-09-14T10:45:17.975+0000 7fefda334640 -1 Falling back to public interface 2024-09-14T10:45:17.980 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-09-14T10:45:17.982+0000 7ff082e10640 -1 Falling back to public interface 2024-09-14T10:45:18.219 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-09-14T10:45:18.220+0000 7f61a341a640 -1 Falling back to public interface 2024-09-14T10:45:18.246 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-14T10:45:18.248+0000 7f4c409db640 -1 Falling back to public interface 2024-09-14T10:45:18.476 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-09-14T10:45:18.476+0000 7f9d801ae640 -1 Falling back to public interface 2024-09-14T10:45:19.940 INFO:tasks.ceph.mgr.y.smithi097.stderr:2024-09-14T10:45:19.940+0000 7f46db93a640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-14T10:45:19.940 INFO:tasks.ceph.mgr.y.smithi097.stderr:2024-09-14T10:45:19.940+0000 7f46db93a640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-14T10:45:21.311 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-14T10:45:21.312+0000 7fc01080b640 -1 osd.6 0 log_to_monitors true 2024-09-14T10:45:21.571 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-09-14T10:45:21.571+0000 7ff082e10640 -1 osd.2 0 log_to_monitors true 2024-09-14T10:45:21.715 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-14T10:45:21.716+0000 7ff106a1d640 -1 osd.4 0 log_to_monitors true 2024-09-14T10:45:22.023 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-14T10:45:22.025+0000 7fc6e6b20640 -1 osd.7 0 log_to_monitors true 2024-09-14T10:45:22.034 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-09-14T10:45:22.035+0000 7fefda334640 -1 osd.0 0 log_to_monitors true 2024-09-14T10:45:22.077 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-14T10:45:22.079+0000 7f4c409db640 -1 osd.5 0 log_to_monitors true 2024-09-14T10:45:22.502 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-09-14T10:45:22.502+0000 7f61a341a640 -1 osd.1 0 log_to_monitors true 2024-09-14T10:45:22.725 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-09-14T10:45:22.726+0000 7f9d801ae640 -1 osd.3 0 log_to_monitors true 2024-09-14T10:45:23.814 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-09-14T10:45:23.816+0000 7ff07e69c640 -1 osd.2 0 waiting for initial osdmap 2024-09-14T10:45:23.827 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-09-14T10:45:23.829+0000 7ff0764bb640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T10:45:24.380 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-14T10:45:24.382+0000 7ff1023e8640 -1 osd.4 0 waiting for initial osdmap 2024-09-14T10:45:24.436 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-14T10:45:24.438+0000 7fc00ca64640 -1 osd.6 0 waiting for initial osdmap 2024-09-14T10:45:24.503 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-14T10:45:24.505+0000 7ff0fa218640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T10:45:24.525 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T10:45:24.566 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-14T10:45:24.568+0000 7fc00406f640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T10:45:24.871 INFO:teuthology.misc.health.smithi097.stdout: 2024-09-14T10:45:24.871 INFO:teuthology.misc.health.smithi097.stdout:{"epoch":13,"fsid":"60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9","created":"2024-09-14T10:45:13.908654+0000","modified":"2024-09-14T10:45:23.942845+0000","last_up_change":"2024-09-14T10:45:23.942845+0000","last_in_change":"2024-09-14T10:45:16.472549+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"cdfc5a56-a482-40e7-af02-5d9af12dd4ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c0fe1ede-ef7f-4181-8112-6fde8460b61b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"976dd4fa-681e-42f9-b02b-6667894d9c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":2081705332},{"type":"v1","addr":"172.21.15.97:6809","nonce":2081705332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":2081705332},{"type":"v1","addr":"172.21.15.97:6811","nonce":2081705332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":2081705332},{"type":"v1","addr":"172.21.15.97:6815","nonce":2081705332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2081705332},{"type":"v1","addr":"172.21.15.97:6813","nonce":2081705332}]},"public_addr":"172.21.15.97:6809/2081705332","cluster_addr":"172.21.15.97:6811/2081705332","heartbeat_back_addr":"172.21.15.97:6815/2081705332","heartbeat_front_addr":"172.21.15.97:6813/2081705332","state":["exists","up"]},{"osd":3,"uuid":"995c66eb-223f-4f55-923c-f011e5ea02ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"66b0bec0-8bf3-4f2b-8ee5-5c6cfbea4b66","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dfcb9f2f-d1fa-44c2-9408-ae3354291069","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e42c37d5-26d2-492a-9fcd-46c1e405017b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0f7d6f9a-cde8-4a3e-82b3-f3e0ef67e0b3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T10:45:24.883 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-09-14T10:45:25.242 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-14T10:45:25.244+0000 7fc6e32c8640 -1 osd.7 0 waiting for initial osdmap 2024-09-14T10:45:25.259 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-14T10:45:25.261+0000 7f4c3c96f640 -1 osd.5 0 waiting for initial osdmap 2024-09-14T10:45:25.262 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-14T10:45:25.264+0000 7fc6da8d3640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T10:45:25.275 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-14T10:45:25.277+0000 7f4c3478e640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T10:45:25.515 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-09-14T10:45:25.516+0000 7f619f5fc640 -1 osd.1 0 waiting for initial osdmap 2024-09-14T10:45:25.534 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-09-14T10:45:25.536+0000 7f6196c07640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T10:45:25.658 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-09-14T10:45:25.660+0000 7fefd62c8640 -1 osd.0 0 waiting for initial osdmap 2024-09-14T10:45:25.673 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-09-14T10:45:25.675+0000 7fefce0e7640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T10:45:25.678 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-09-14T10:45:25.680+0000 7f9d7c142640 -1 osd.3 0 waiting for initial osdmap 2024-09-14T10:45:25.688 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-09-14T10:45:25.690+0000 7f9d73f61640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T10:45:31.690 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T10:45:31.990 INFO:teuthology.misc.health.smithi097.stdout: 2024-09-14T10:45:31.991 INFO:teuthology.misc.health.smithi097.stdout:{"epoch":18,"fsid":"60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9","created":"2024-09-14T10:45:13.908654+0000","modified":"2024-09-14T10:45:29.535711+0000","last_up_change":"2024-09-14T10:45:26.523342+0000","last_in_change":"2024-09-14T10:45:16.472549+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T10:45:26.951609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdfc5a56-a482-40e7-af02-5d9af12dd4ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2189588316},{"type":"v1","addr":"172.21.15.97:6801","nonce":2189588316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2189588316},{"type":"v1","addr":"172.21.15.97:6803","nonce":2189588316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":2189588316},{"type":"v1","addr":"172.21.15.97:6807","nonce":2189588316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":2189588316},{"type":"v1","addr":"172.21.15.97:6805","nonce":2189588316}]},"public_addr":"172.21.15.97:6801/2189588316","cluster_addr":"172.21.15.97:6803/2189588316","heartbeat_back_addr":"172.21.15.97:6807/2189588316","heartbeat_front_addr":"172.21.15.97:6805/2189588316","state":["exists","up"]},{"osd":1,"uuid":"c0fe1ede-ef7f-4181-8112-6fde8460b61b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":4093696477},{"type":"v1","addr":"172.21.15.97:6817","nonce":4093696477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":4093696477},{"type":"v1","addr":"172.21.15.97:6819","nonce":4093696477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":4093696477},{"type":"v1","addr":"172.21.15.97:6823","nonce":4093696477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":4093696477},{"type":"v1","addr":"172.21.15.97:6821","nonce":4093696477}]},"public_addr":"172.21.15.97:6817/4093696477","cluster_addr":"172.21.15.97:6819/4093696477","heartbeat_back_addr":"172.21.15.97:6823/4093696477","heartbeat_front_addr":"172.21.15.97:6821/4093696477","state":["exists","up"]},{"osd":2,"uuid":"976dd4fa-681e-42f9-b02b-6667894d9c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":2081705332},{"type":"v1","addr":"172.21.15.97:6809","nonce":2081705332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":2081705332},{"type":"v1","addr":"172.21.15.97:6811","nonce":2081705332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":2081705332},{"type":"v1","addr":"172.21.15.97:6815","nonce":2081705332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2081705332},{"type":"v1","addr":"172.21.15.97:6813","nonce":2081705332}]},"public_addr":"172.21.15.97:6809/2081705332","cluster_addr":"172.21.15.97:6811/2081705332","heartbeat_back_addr":"172.21.15.97:6815/2081705332","heartbeat_front_addr":"172.21.15.97:6813/2081705332","state":["exists","up"]},{"osd":3,"uuid":"995c66eb-223f-4f55-923c-f011e5ea02ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2606963136},{"type":"v1","addr":"172.21.15.97:6825","nonce":2606963136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2606963136},{"type":"v1","addr":"172.21.15.97:6827","nonce":2606963136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2606963136},{"type":"v1","addr":"172.21.15.97:6831","nonce":2606963136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2606963136},{"type":"v1","addr":"172.21.15.97:6829","nonce":2606963136}]},"public_addr":"172.21.15.97:6825/2606963136","cluster_addr":"172.21.15.97:6827/2606963136","heartbeat_back_addr":"172.21.15.97:6831/2606963136","heartbeat_front_addr":"172.21.15.97:6829/2606963136","state":["exists","up"]},{"osd":4,"uuid":"66b0bec0-8bf3-4f2b-8ee5-5c6cfbea4b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1010851305},{"type":"v1","addr":"172.21.15.152:6809","nonce":1010851305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1010851305},{"type":"v1","addr":"172.21.15.152:6811","nonce":1010851305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1010851305},{"type":"v1","addr":"172.21.15.152:6815","nonce":1010851305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1010851305},{"type":"v1","addr":"172.21.15.152:6813","nonce":1010851305}]},"public_addr":"172.21.15.152:6809/1010851305","cluster_addr":"172.21.15.152:6811/1010851305","heartbeat_back_addr":"172.21.15.152:6815/1010851305","heartbeat_front_addr":"172.21.15.152:6813/1010851305","state":["exists","up"]},{"osd":5,"uuid":"dfcb9f2f-d1fa-44c2-9408-ae3354291069","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3767355481},{"type":"v1","addr":"172.21.15.152:6825","nonce":3767355481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":3767355481},{"type":"v1","addr":"172.21.15.152:6827","nonce":3767355481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":3767355481},{"type":"v1","addr":"172.21.15.152:6831","nonce":3767355481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3767355481},{"type":"v1","addr":"172.21.15.152:6829","nonce":3767355481}]},"public_addr":"172.21.15.152:6825/3767355481","cluster_addr":"172.21.15.152:6827/3767355481","heartbeat_back_addr":"172.21.15.152:6831/3767355481","heartbeat_front_addr":"172.21.15.152:6829/3767355481","state":["exists","up"]},{"osd":6,"uuid":"e42c37d5-26d2-492a-9fcd-46c1e405017b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":410517460},{"type":"v1","addr":"172.21.15.152:6801","nonce":410517460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":410517460},{"type":"v1","addr":"172.21.15.152:6803","nonce":410517460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":410517460},{"type":"v1","addr":"172.21.15.152:6807","nonce":410517460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":410517460},{"type":"v1","addr":"172.21.15.152:6805","nonce":410517460}]},"public_addr":"172.21.15.152:6801/410517460","cluster_addr":"172.21.15.152:6803/410517460","heartbeat_back_addr":"172.21.15.152:6807/410517460","heartbeat_front_addr":"172.21.15.152:6805/410517460","state":["exists","up"]},{"osd":7,"uuid":"0f7d6f9a-cde8-4a3e-82b3-f3e0ef67e0b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3781551304},{"type":"v1","addr":"172.21.15.152:6817","nonce":3781551304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":3781551304},{"type":"v1","addr":"172.21.15.152:6819","nonce":3781551304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":3781551304},{"type":"v1","addr":"172.21.15.152:6823","nonce":3781551304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3781551304},{"type":"v1","addr":"172.21.15.152:6821","nonce":3781551304}]},"public_addr":"172.21.15.152:6817/3781551304","cluster_addr":"172.21.15.152:6819/3781551304","heartbeat_back_addr":"172.21.15.152:6823/3781551304","heartbeat_front_addr":"172.21.15.152:6821/3781551304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:45:23.025497+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:45:23.458517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:45:22.565887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:45:23.726820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:45:22.671680+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:45:23.107369+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:45:22.326483+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:45:23.034557+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T10:45:32.002 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-14T10:45:32.002 INFO:tasks.ceph:Creating RBD pool 2024-09-14T10:45:32.002 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-14T10:45:32.555 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'rbd' created 2024-09-14T10:45:32.569 DEBUG:teuthology.orchestra.run.smithi097:> rbd --cluster ceph pool init rbd 2024-09-14T10:45:32.630 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:45:32.630 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:45:35.588 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-14T10:45:35.589 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-14T10:45:35.589 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-14T10:45:35.895 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:45:35.907 INFO:teuthology.orchestra.run.smithi097.stdout:[{"version":9,"timestamp":"2024-09-14T10:45:25.681372+0000","name":"","changes":[{"name":"osd.3/osd_mclock_max_capacity_iops_ssd","new_value":"5725.974162"}]}] 2024-09-14T10:45:35.908 INFO:tasks.ceph_manager:config epoch is 9 2024-09-14T10:45:35.908 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-14T10:45:35.908 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-14T10:45:35.908 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-14T10:45:36.254 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:45:36.264 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":5,"flags":0,"active_gid":4110,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":3343919203},{"type":"v1","addr":"172.21.15.97:6833","nonce":3343919203}]},"active_addr":"172.21.15.97:6833/3343919203","active_change":"2024-09-14T10:45:18.929248+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4113,"name":"x","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.97:0","nonce":1491529488}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.97:0","nonce":3535111375}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.97:0","nonce":2008532191}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.97:0","nonce":195272892}]}]} 2024-09-14T10:45:36.269 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-14T10:45:36.269 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-14T10:45:36.269 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T10:45:36.566 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:45:36.566 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":22,"fsid":"60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9","created":"2024-09-14T10:45:13.908654+0000","modified":"2024-09-14T10:45:35.568116+0000","last_up_change":"2024-09-14T10:45:26.523342+0000","last_in_change":"2024-09-14T10:45:16.472549+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T10:45:26.951609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T10:45:32.306341+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdfc5a56-a482-40e7-af02-5d9af12dd4ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2189588316},{"type":"v1","addr":"172.21.15.97:6801","nonce":2189588316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2189588316},{"type":"v1","addr":"172.21.15.97:6803","nonce":2189588316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":2189588316},{"type":"v1","addr":"172.21.15.97:6807","nonce":2189588316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":2189588316},{"type":"v1","addr":"172.21.15.97:6805","nonce":2189588316}]},"public_addr":"172.21.15.97:6801/2189588316","cluster_addr":"172.21.15.97:6803/2189588316","heartbeat_back_addr":"172.21.15.97:6807/2189588316","heartbeat_front_addr":"172.21.15.97:6805/2189588316","state":["exists","up"]},{"osd":1,"uuid":"c0fe1ede-ef7f-4181-8112-6fde8460b61b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":4093696477},{"type":"v1","addr":"172.21.15.97:6817","nonce":4093696477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":4093696477},{"type":"v1","addr":"172.21.15.97:6819","nonce":4093696477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":4093696477},{"type":"v1","addr":"172.21.15.97:6823","nonce":4093696477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":4093696477},{"type":"v1","addr":"172.21.15.97:6821","nonce":4093696477}]},"public_addr":"172.21.15.97:6817/4093696477","cluster_addr":"172.21.15.97:6819/4093696477","heartbeat_back_addr":"172.21.15.97:6823/4093696477","heartbeat_front_addr":"172.21.15.97:6821/4093696477","state":["exists","up"]},{"osd":2,"uuid":"976dd4fa-681e-42f9-b02b-6667894d9c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":2081705332},{"type":"v1","addr":"172.21.15.97:6809","nonce":2081705332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":2081705332},{"type":"v1","addr":"172.21.15.97:6811","nonce":2081705332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":2081705332},{"type":"v1","addr":"172.21.15.97:6815","nonce":2081705332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2081705332},{"type":"v1","addr":"172.21.15.97:6813","nonce":2081705332}]},"public_addr":"172.21.15.97:6809/2081705332","cluster_addr":"172.21.15.97:6811/2081705332","heartbeat_back_addr":"172.21.15.97:6815/2081705332","heartbeat_front_addr":"172.21.15.97:6813/2081705332","state":["exists","up"]},{"osd":3,"uuid":"995c66eb-223f-4f55-923c-f011e5ea02ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2606963136},{"type":"v1","addr":"172.21.15.97:6825","nonce":2606963136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2606963136},{"type":"v1","addr":"172.21.15.97:6827","nonce":2606963136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2606963136},{"type":"v1","addr":"172.21.15.97:6831","nonce":2606963136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2606963136},{"type":"v1","addr":"172.21.15.97:6829","nonce":2606963136}]},"public_addr":"172.21.15.97:6825/2606963136","cluster_addr":"172.21.15.97:6827/2606963136","heartbeat_back_addr":"172.21.15.97:6831/2606963136","heartbeat_front_addr":"172.21.15.97:6829/2606963136","state":["exists","up"]},{"osd":4,"uuid":"66b0bec0-8bf3-4f2b-8ee5-5c6cfbea4b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1010851305},{"type":"v1","addr":"172.21.15.152:6809","nonce":1010851305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1010851305},{"type":"v1","addr":"172.21.15.152:6811","nonce":1010851305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1010851305},{"type":"v1","addr":"172.21.15.152:6815","nonce":1010851305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1010851305},{"type":"v1","addr":"172.21.15.152:6813","nonce":1010851305}]},"public_addr":"172.21.15.152:6809/1010851305","cluster_addr":"172.21.15.152:6811/1010851305","heartbeat_back_addr":"172.21.15.152:6815/1010851305","heartbeat_front_addr":"172.21.15.152:6813/1010851305","state":["exists","up"]},{"osd":5,"uuid":"dfcb9f2f-d1fa-44c2-9408-ae3354291069","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3767355481},{"type":"v1","addr":"172.21.15.152:6825","nonce":3767355481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":3767355481},{"type":"v1","addr":"172.21.15.152:6827","nonce":3767355481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":3767355481},{"type":"v1","addr":"172.21.15.152:6831","nonce":3767355481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3767355481},{"type":"v1","addr":"172.21.15.152:6829","nonce":3767355481}]},"public_addr":"172.21.15.152:6825/3767355481","cluster_addr":"172.21.15.152:6827/3767355481","heartbeat_back_addr":"172.21.15.152:6831/3767355481","heartbeat_front_addr":"172.21.15.152:6829/3767355481","state":["exists","up"]},{"osd":6,"uuid":"e42c37d5-26d2-492a-9fcd-46c1e405017b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":410517460},{"type":"v1","addr":"172.21.15.152:6801","nonce":410517460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":410517460},{"type":"v1","addr":"172.21.15.152:6803","nonce":410517460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":410517460},{"type":"v1","addr":"172.21.15.152:6807","nonce":410517460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":410517460},{"type":"v1","addr":"172.21.15.152:6805","nonce":410517460}]},"public_addr":"172.21.15.152:6801/410517460","cluster_addr":"172.21.15.152:6803/410517460","heartbeat_back_addr":"172.21.15.152:6807/410517460","heartbeat_front_addr":"172.21.15.152:6805/410517460","state":["exists","up"]},{"osd":7,"uuid":"0f7d6f9a-cde8-4a3e-82b3-f3e0ef67e0b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3781551304},{"type":"v1","addr":"172.21.15.152:6817","nonce":3781551304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":3781551304},{"type":"v1","addr":"172.21.15.152:6819","nonce":3781551304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":3781551304},{"type":"v1","addr":"172.21.15.152:6823","nonce":3781551304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3781551304},{"type":"v1","addr":"172.21.15.152:6821","nonce":3781551304}]},"public_addr":"172.21.15.152:6817/3781551304","cluster_addr":"172.21.15.152:6819/3781551304","heartbeat_back_addr":"172.21.15.152:6823/3781551304","heartbeat_front_addr":"172.21.15.152:6821/3781551304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:45:23.025497+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:45:23.458517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:45:22.565887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:45:23.726820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:45:22.671680+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:45:23.107369+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:45:22.326483+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:45:23.034557+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T10:45:36.579 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-14T10:45:36.579 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T10:45:36.876 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:45:36.877 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":22,"fsid":"60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9","created":"2024-09-14T10:45:13.908654+0000","modified":"2024-09-14T10:45:35.568116+0000","last_up_change":"2024-09-14T10:45:26.523342+0000","last_in_change":"2024-09-14T10:45:16.472549+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T10:45:26.951609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T10:45:32.306341+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdfc5a56-a482-40e7-af02-5d9af12dd4ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2189588316},{"type":"v1","addr":"172.21.15.97:6801","nonce":2189588316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2189588316},{"type":"v1","addr":"172.21.15.97:6803","nonce":2189588316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":2189588316},{"type":"v1","addr":"172.21.15.97:6807","nonce":2189588316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":2189588316},{"type":"v1","addr":"172.21.15.97:6805","nonce":2189588316}]},"public_addr":"172.21.15.97:6801/2189588316","cluster_addr":"172.21.15.97:6803/2189588316","heartbeat_back_addr":"172.21.15.97:6807/2189588316","heartbeat_front_addr":"172.21.15.97:6805/2189588316","state":["exists","up"]},{"osd":1,"uuid":"c0fe1ede-ef7f-4181-8112-6fde8460b61b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":4093696477},{"type":"v1","addr":"172.21.15.97:6817","nonce":4093696477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":4093696477},{"type":"v1","addr":"172.21.15.97:6819","nonce":4093696477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":4093696477},{"type":"v1","addr":"172.21.15.97:6823","nonce":4093696477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":4093696477},{"type":"v1","addr":"172.21.15.97:6821","nonce":4093696477}]},"public_addr":"172.21.15.97:6817/4093696477","cluster_addr":"172.21.15.97:6819/4093696477","heartbeat_back_addr":"172.21.15.97:6823/4093696477","heartbeat_front_addr":"172.21.15.97:6821/4093696477","state":["exists","up"]},{"osd":2,"uuid":"976dd4fa-681e-42f9-b02b-6667894d9c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":2081705332},{"type":"v1","addr":"172.21.15.97:6809","nonce":2081705332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":2081705332},{"type":"v1","addr":"172.21.15.97:6811","nonce":2081705332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":2081705332},{"type":"v1","addr":"172.21.15.97:6815","nonce":2081705332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2081705332},{"type":"v1","addr":"172.21.15.97:6813","nonce":2081705332}]},"public_addr":"172.21.15.97:6809/2081705332","cluster_addr":"172.21.15.97:6811/2081705332","heartbeat_back_addr":"172.21.15.97:6815/2081705332","heartbeat_front_addr":"172.21.15.97:6813/2081705332","state":["exists","up"]},{"osd":3,"uuid":"995c66eb-223f-4f55-923c-f011e5ea02ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2606963136},{"type":"v1","addr":"172.21.15.97:6825","nonce":2606963136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2606963136},{"type":"v1","addr":"172.21.15.97:6827","nonce":2606963136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2606963136},{"type":"v1","addr":"172.21.15.97:6831","nonce":2606963136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2606963136},{"type":"v1","addr":"172.21.15.97:6829","nonce":2606963136}]},"public_addr":"172.21.15.97:6825/2606963136","cluster_addr":"172.21.15.97:6827/2606963136","heartbeat_back_addr":"172.21.15.97:6831/2606963136","heartbeat_front_addr":"172.21.15.97:6829/2606963136","state":["exists","up"]},{"osd":4,"uuid":"66b0bec0-8bf3-4f2b-8ee5-5c6cfbea4b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1010851305},{"type":"v1","addr":"172.21.15.152:6809","nonce":1010851305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1010851305},{"type":"v1","addr":"172.21.15.152:6811","nonce":1010851305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1010851305},{"type":"v1","addr":"172.21.15.152:6815","nonce":1010851305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1010851305},{"type":"v1","addr":"172.21.15.152:6813","nonce":1010851305}]},"public_addr":"172.21.15.152:6809/1010851305","cluster_addr":"172.21.15.152:6811/1010851305","heartbeat_back_addr":"172.21.15.152:6815/1010851305","heartbeat_front_addr":"172.21.15.152:6813/1010851305","state":["exists","up"]},{"osd":5,"uuid":"dfcb9f2f-d1fa-44c2-9408-ae3354291069","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3767355481},{"type":"v1","addr":"172.21.15.152:6825","nonce":3767355481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":3767355481},{"type":"v1","addr":"172.21.15.152:6827","nonce":3767355481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":3767355481},{"type":"v1","addr":"172.21.15.152:6831","nonce":3767355481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3767355481},{"type":"v1","addr":"172.21.15.152:6829","nonce":3767355481}]},"public_addr":"172.21.15.152:6825/3767355481","cluster_addr":"172.21.15.152:6827/3767355481","heartbeat_back_addr":"172.21.15.152:6831/3767355481","heartbeat_front_addr":"172.21.15.152:6829/3767355481","state":["exists","up"]},{"osd":6,"uuid":"e42c37d5-26d2-492a-9fcd-46c1e405017b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":410517460},{"type":"v1","addr":"172.21.15.152:6801","nonce":410517460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":410517460},{"type":"v1","addr":"172.21.15.152:6803","nonce":410517460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":410517460},{"type":"v1","addr":"172.21.15.152:6807","nonce":410517460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":410517460},{"type":"v1","addr":"172.21.15.152:6805","nonce":410517460}]},"public_addr":"172.21.15.152:6801/410517460","cluster_addr":"172.21.15.152:6803/410517460","heartbeat_back_addr":"172.21.15.152:6807/410517460","heartbeat_front_addr":"172.21.15.152:6805/410517460","state":["exists","up"]},{"osd":7,"uuid":"0f7d6f9a-cde8-4a3e-82b3-f3e0ef67e0b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3781551304},{"type":"v1","addr":"172.21.15.152:6817","nonce":3781551304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":3781551304},{"type":"v1","addr":"172.21.15.152:6819","nonce":3781551304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":3781551304},{"type":"v1","addr":"172.21.15.152:6823","nonce":3781551304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3781551304},{"type":"v1","addr":"172.21.15.152:6821","nonce":3781551304}]},"public_addr":"172.21.15.152:6817/3781551304","cluster_addr":"172.21.15.152:6819/3781551304","heartbeat_back_addr":"172.21.15.152:6823/3781551304","heartbeat_front_addr":"172.21.15.152:6821/3781551304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:45:23.025497+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:45:23.458517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:45:22.565887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:45:23.726820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:45:22.671680+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:45:23.107369+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:45:22.326483+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:45:23.034557+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T10:45:36.890 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-14T10:45:36.890 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-14T10:45:36.890 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-14T10:45:36.891 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-14T10:45:36.891 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-14T10:45:36.892 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-14T10:45:36.892 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-14T10:45:36.893 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-14T10:45:37.137 INFO:teuthology.orchestra.run.smithi097.stdout:60129542151 2024-09-14T10:45:37.138 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-14T10:45:37.150 INFO:teuthology.orchestra.run.smithi097.stdout:64424509445 2024-09-14T10:45:37.150 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-14T10:45:37.152 INFO:teuthology.orchestra.run.smithi097.stdout:64424509444 2024-09-14T10:45:37.152 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-14T10:45:37.155 INFO:teuthology.orchestra.run.smithi097.stdout:64424509446 2024-09-14T10:45:37.155 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-14T10:45:37.157 INFO:teuthology.orchestra.run.smithi097.stdout:60129542150 2024-09-14T10:45:37.157 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-14T10:45:37.159 INFO:teuthology.orchestra.run.smithi097.stdout:55834574853 2024-09-14T10:45:37.160 INFO:teuthology.orchestra.run.smithi097.stdout:60129542150 2024-09-14T10:45:37.160 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-14T10:45:37.161 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-14T10:45:37.164 INFO:teuthology.orchestra.run.smithi097.stdout:60129542150 2024-09-14T10:45:37.164 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-14T10:45:37.765 INFO:teuthology.orchestra.run.smithi097.stdout:60129542150 2024-09-14T10:45:37.779 INFO:teuthology.orchestra.run.smithi097.stdout:60129542149 2024-09-14T10:45:37.785 INFO:teuthology.orchestra.run.smithi097.stdout:60129542149 2024-09-14T10:45:37.786 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.4 2024-09-14T10:45:37.793 INFO:teuthology.orchestra.run.smithi097.stdout:64424509442 2024-09-14T10:45:37.798 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.7 2024-09-14T10:45:37.805 INFO:teuthology.orchestra.run.smithi097.stdout:64424509444 2024-09-14T10:45:37.806 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.6 2024-09-14T10:45:37.806 INFO:teuthology.orchestra.run.smithi097.stdout:60129542149 2024-09-14T10:45:37.808 INFO:teuthology.orchestra.run.smithi097.stdout:55834574852 2024-09-14T10:45:37.809 INFO:teuthology.orchestra.run.smithi097.stdout:64424509443 2024-09-14T10:45:37.809 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509442 for osd.0 2024-09-14T10:45:37.824 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.5 2024-09-14T10:45:37.824 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.1 2024-09-14T10:45:37.827 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.3 2024-09-14T10:45:37.829 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.2 2024-09-14T10:45:38.787 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-14T10:45:38.799 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-14T10:45:38.807 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-14T10:45:38.811 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-14T10:45:38.824 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-14T10:45:38.825 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-14T10:45:38.827 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-14T10:45:38.830 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-14T10:45:39.381 INFO:teuthology.orchestra.run.smithi097.stdout:60129542150 2024-09-14T10:45:39.401 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.4 2024-09-14T10:45:39.426 INFO:teuthology.orchestra.run.smithi097.stdout:55834574852 2024-09-14T10:45:39.439 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.2 2024-09-14T10:45:39.454 INFO:teuthology.orchestra.run.smithi097.stdout:60129542149 2024-09-14T10:45:39.467 INFO:teuthology.orchestra.run.smithi097.stdout:60129542149 2024-09-14T10:45:39.467 INFO:teuthology.orchestra.run.smithi097.stdout:64424509442 2024-09-14T10:45:39.472 INFO:teuthology.orchestra.run.smithi097.stdout:64424509443 2024-09-14T10:45:39.473 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.5 2024-09-14T10:45:39.476 INFO:teuthology.orchestra.run.smithi097.stdout:60129542149 2024-09-14T10:45:39.484 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.6 2024-09-14T10:45:39.484 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509442 for osd.0 2024-09-14T10:45:39.490 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.1 2024-09-14T10:45:39.491 INFO:teuthology.orchestra.run.smithi097.stdout:64424509444 2024-09-14T10:45:39.496 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.7 2024-09-14T10:45:39.505 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.3 2024-09-14T10:45:40.402 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-14T10:45:40.440 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-14T10:45:40.474 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-14T10:45:40.485 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-14T10:45:40.485 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-14T10:45:40.491 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-14T10:45:40.496 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-14T10:45:40.505 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-14T10:45:40.971 INFO:teuthology.orchestra.run.smithi097.stdout:60129542151 2024-09-14T10:45:40.991 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.4 2024-09-14T10:45:40.991 DEBUG:teuthology.parallel:result is None 2024-09-14T10:45:41.043 INFO:teuthology.orchestra.run.smithi097.stdout:60129542150 2024-09-14T10:45:41.056 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.5 2024-09-14T10:45:41.056 INFO:teuthology.orchestra.run.smithi097.stdout:55834574853 2024-09-14T10:45:41.056 DEBUG:teuthology.parallel:result is None 2024-09-14T10:45:41.074 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.2 2024-09-14T10:45:41.074 DEBUG:teuthology.parallel:result is None 2024-09-14T10:45:41.091 INFO:teuthology.orchestra.run.smithi097.stdout:64424509445 2024-09-14T10:45:41.102 INFO:teuthology.orchestra.run.smithi097.stdout:60129542150 2024-09-14T10:45:41.104 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.1 2024-09-14T10:45:41.104 DEBUG:teuthology.parallel:result is None 2024-09-14T10:45:41.119 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.6 2024-09-14T10:45:41.119 DEBUG:teuthology.parallel:result is None 2024-09-14T10:45:41.137 INFO:teuthology.orchestra.run.smithi097.stdout:64424509444 2024-09-14T10:45:41.138 INFO:teuthology.orchestra.run.smithi097.stdout:60129542150 2024-09-14T10:45:41.151 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509444 for osd.0 2024-09-14T10:45:41.151 DEBUG:teuthology.parallel:result is None 2024-09-14T10:45:41.151 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.7 2024-09-14T10:45:41.152 DEBUG:teuthology.parallel:result is None 2024-09-14T10:45:41.152 INFO:teuthology.orchestra.run.smithi097.stdout:64424509446 2024-09-14T10:45:41.166 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.3 2024-09-14T10:45:41.166 DEBUG:teuthology.parallel:result is None 2024-09-14T10:45:41.166 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-14T10:45:41.166 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T10:45:41.500 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:45:41.500 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-09-14T10:45:41.512 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-14T10:45:40.938499+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219156,"kb_used_data":2896,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755564,"statfs":{"total":773094113280,"available":772869697536,"internally_reserved":0,"allocated":2965504,"data_stored":1788822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.382494"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.580545+0000","last_change":"2024-09-14T10:45:35.580545+0000","last_active":"2024-09-14T10:45:35.580545+0000","last_peered":"2024-09-14T10:45:35.580545+0000","last_clean":"2024-09-14T10:45:35.580545+0000","last_became_active":"2024-09-14T10:45:33.610689+0000","last_became_peered":"2024-09-14T10:45:33.610689+0000","last_unstale":"2024-09-14T10:45:35.580545+0000","last_undegraded":"2024-09-14T10:45:35.580545+0000","last_fullsized":"2024-09-14T10:45:35.580545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_clean_scrub_stamp":"2024-09-14T10:45:32.551765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:59.821398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011461920000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.575588+0000","last_change":"2024-09-14T10:45:35.575588+0000","last_active":"2024-09-14T10:45:35.575588+0000","last_peered":"2024-09-14T10:45:35.575588+0000","last_clean":"2024-09-14T10:45:35.575588+0000","last_became_active":"2024-09-14T10:45:33.610909+0000","last_became_peered":"2024-09-14T10:45:33.610909+0000","last_unstale":"2024-09-14T10:45:35.575588+0000","last_undegraded":"2024-09-14T10:45:35.575588+0000","last_fullsized":"2024-09-14T10:45:35.575588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_clean_scrub_stamp":"2024-09-14T10:45:32.551765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:45.821025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038435900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.580399+0000","last_change":"2024-09-14T10:45:35.580399+0000","last_active":"2024-09-14T10:45:35.580399+0000","last_peered":"2024-09-14T10:45:35.580399+0000","last_clean":"2024-09-14T10:45:35.580399+0000","last_became_active":"2024-09-14T10:45:33.564407+0000","last_became_peered":"2024-09-14T10:45:33.564407+0000","last_unstale":"2024-09-14T10:45:35.580399+0000","last_undegraded":"2024-09-14T10:45:35.580399+0000","last_fullsized":"2024-09-14T10:45:35.580399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_clean_scrub_stamp":"2024-09-14T10:45:32.551765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:15:28.496118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099134599999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:45:36.078547+0000","last_change":"2024-09-14T10:45:36.078834+0000","last_active":"2024-09-14T10:45:36.078547+0000","last_peered":"2024-09-14T10:45:36.078547+0000","last_clean":"2024-09-14T10:45:36.078547+0000","last_became_active":"2024-09-14T10:45:33.612983+0000","last_became_peered":"2024-09-14T10:45:33.612983+0000","last_unstale":"2024-09-14T10:45:36.078547+0000","last_undegraded":"2024-09-14T10:45:36.078547+0000","last_fullsized":"2024-09-14T10:45:36.078547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_clean_scrub_stamp":"2024-09-14T10:45:32.551765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:00.753079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053773700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.585918+0000","last_change":"2024-09-14T10:45:35.580322+0000","last_active":"2024-09-14T10:45:35.585918+0000","last_peered":"2024-09-14T10:45:35.585918+0000","last_clean":"2024-09-14T10:45:35.585918+0000","last_became_active":"2024-09-14T10:45:33.612919+0000","last_became_peered":"2024-09-14T10:45:33.612919+0000","last_unstale":"2024-09-14T10:45:35.585918+0000","last_undegraded":"2024-09-14T10:45:35.585918+0000","last_fullsized":"2024-09-14T10:45:35.585918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_clean_scrub_stamp":"2024-09-14T10:45:32.551765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:57.073763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094497699999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:45:36.078548+0000","last_change":"2024-09-14T10:45:36.078832+0000","last_active":"2024-09-14T10:45:36.078548+0000","last_peered":"2024-09-14T10:45:36.078548+0000","last_clean":"2024-09-14T10:45:36.078548+0000","last_became_active":"2024-09-14T10:45:33.569944+0000","last_became_peered":"2024-09-14T10:45:33.569944+0000","last_unstale":"2024-09-14T10:45:36.078548+0000","last_undegraded":"2024-09-14T10:45:36.078548+0000","last_fullsized":"2024-09-14T10:45:36.078548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_clean_scrub_stamp":"2024-09-14T10:45:32.551765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:29.610279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055355599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.580149+0000","last_change":"2024-09-14T10:45:35.580149+0000","last_active":"2024-09-14T10:45:35.580149+0000","last_peered":"2024-09-14T10:45:35.580149+0000","last_clean":"2024-09-14T10:45:35.580149+0000","last_became_active":"2024-09-14T10:45:33.569860+0000","last_became_peered":"2024-09-14T10:45:33.569860+0000","last_unstale":"2024-09-14T10:45:35.580149+0000","last_undegraded":"2024-09-14T10:45:35.580149+0000","last_fullsized":"2024-09-14T10:45:35.580149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_clean_scrub_stamp":"2024-09-14T10:45:32.551765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:19.845227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074400599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.579820+0000","last_change":"2024-09-14T10:45:35.579820+0000","last_active":"2024-09-14T10:45:35.579820+0000","last_peered":"2024-09-14T10:45:35.579820+0000","last_clean":"2024-09-14T10:45:35.579820+0000","last_became_active":"2024-09-14T10:45:33.610592+0000","last_became_peered":"2024-09-14T10:45:33.610592+0000","last_unstale":"2024-09-14T10:45:35.579820+0000","last_undegraded":"2024-09-14T10:45:35.579820+0000","last_fullsized":"2024-09-14T10:45:35.579820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_clean_scrub_stamp":"2024-09-14T10:45:32.551765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:46:36.542821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043055799999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.576643+0000","last_change":"2024-09-14T10:45:28.986498+0000","last_active":"2024-09-14T10:45:35.576643+0000","last_peered":"2024-09-14T10:45:35.576643+0000","last_clean":"2024-09-14T10:45:35.576643+0000","last_became_active":"2024-09-14T10:45:28.985499+0000","last_became_peered":"2024-09-14T10:45:28.985499+0000","last_unstale":"2024-09-14T10:45:35.576643+0000","last_undegraded":"2024-09-14T10:45:35.576643+0000","last_fullsized":"2024-09-14T10:45:35.576643+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:27.525313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:27.525313+0000","last_clean_scrub_stamp":"2024-09-14T10:45:27.525313+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:42:06.434476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":76025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":815104,"data_stored":666374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":76006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":76006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":76025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":815104,"data_stored":666374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":76006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":76006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T10:45:41.513 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T10:45:41.809 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:45:41.809 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-09-14T10:45:41.821 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-14T10:45:40.938499+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219156,"kb_used_data":2896,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755564,"statfs":{"total":773094113280,"available":772869697536,"internally_reserved":0,"allocated":2965504,"data_stored":1788822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.382494"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.580545+0000","last_change":"2024-09-14T10:45:35.580545+0000","last_active":"2024-09-14T10:45:35.580545+0000","last_peered":"2024-09-14T10:45:35.580545+0000","last_clean":"2024-09-14T10:45:35.580545+0000","last_became_active":"2024-09-14T10:45:33.610689+0000","last_became_peered":"2024-09-14T10:45:33.610689+0000","last_unstale":"2024-09-14T10:45:35.580545+0000","last_undegraded":"2024-09-14T10:45:35.580545+0000","last_fullsized":"2024-09-14T10:45:35.580545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_clean_scrub_stamp":"2024-09-14T10:45:32.551765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:59.821398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011461920000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.575588+0000","last_change":"2024-09-14T10:45:35.575588+0000","last_active":"2024-09-14T10:45:35.575588+0000","last_peered":"2024-09-14T10:45:35.575588+0000","last_clean":"2024-09-14T10:45:35.575588+0000","last_became_active":"2024-09-14T10:45:33.610909+0000","last_became_peered":"2024-09-14T10:45:33.610909+0000","last_unstale":"2024-09-14T10:45:35.575588+0000","last_undegraded":"2024-09-14T10:45:35.575588+0000","last_fullsized":"2024-09-14T10:45:35.575588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_clean_scrub_stamp":"2024-09-14T10:45:32.551765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:45.821025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038435900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.580399+0000","last_change":"2024-09-14T10:45:35.580399+0000","last_active":"2024-09-14T10:45:35.580399+0000","last_peered":"2024-09-14T10:45:35.580399+0000","last_clean":"2024-09-14T10:45:35.580399+0000","last_became_active":"2024-09-14T10:45:33.564407+0000","last_became_peered":"2024-09-14T10:45:33.564407+0000","last_unstale":"2024-09-14T10:45:35.580399+0000","last_undegraded":"2024-09-14T10:45:35.580399+0000","last_fullsized":"2024-09-14T10:45:35.580399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_clean_scrub_stamp":"2024-09-14T10:45:32.551765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:15:28.496118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099134599999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:45:36.078547+0000","last_change":"2024-09-14T10:45:36.078834+0000","last_active":"2024-09-14T10:45:36.078547+0000","last_peered":"2024-09-14T10:45:36.078547+0000","last_clean":"2024-09-14T10:45:36.078547+0000","last_became_active":"2024-09-14T10:45:33.612983+0000","last_became_peered":"2024-09-14T10:45:33.612983+0000","last_unstale":"2024-09-14T10:45:36.078547+0000","last_undegraded":"2024-09-14T10:45:36.078547+0000","last_fullsized":"2024-09-14T10:45:36.078547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_clean_scrub_stamp":"2024-09-14T10:45:32.551765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:00.753079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053773700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.585918+0000","last_change":"2024-09-14T10:45:35.580322+0000","last_active":"2024-09-14T10:45:35.585918+0000","last_peered":"2024-09-14T10:45:35.585918+0000","last_clean":"2024-09-14T10:45:35.585918+0000","last_became_active":"2024-09-14T10:45:33.612919+0000","last_became_peered":"2024-09-14T10:45:33.612919+0000","last_unstale":"2024-09-14T10:45:35.585918+0000","last_undegraded":"2024-09-14T10:45:35.585918+0000","last_fullsized":"2024-09-14T10:45:35.585918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_clean_scrub_stamp":"2024-09-14T10:45:32.551765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:57.073763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094497699999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:45:36.078548+0000","last_change":"2024-09-14T10:45:36.078832+0000","last_active":"2024-09-14T10:45:36.078548+0000","last_peered":"2024-09-14T10:45:36.078548+0000","last_clean":"2024-09-14T10:45:36.078548+0000","last_became_active":"2024-09-14T10:45:33.569944+0000","last_became_peered":"2024-09-14T10:45:33.569944+0000","last_unstale":"2024-09-14T10:45:36.078548+0000","last_undegraded":"2024-09-14T10:45:36.078548+0000","last_fullsized":"2024-09-14T10:45:36.078548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_clean_scrub_stamp":"2024-09-14T10:45:32.551765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:29.610279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055355599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.580149+0000","last_change":"2024-09-14T10:45:35.580149+0000","last_active":"2024-09-14T10:45:35.580149+0000","last_peered":"2024-09-14T10:45:35.580149+0000","last_clean":"2024-09-14T10:45:35.580149+0000","last_became_active":"2024-09-14T10:45:33.569860+0000","last_became_peered":"2024-09-14T10:45:33.569860+0000","last_unstale":"2024-09-14T10:45:35.580149+0000","last_undegraded":"2024-09-14T10:45:35.580149+0000","last_fullsized":"2024-09-14T10:45:35.580149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_clean_scrub_stamp":"2024-09-14T10:45:32.551765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:19.845227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074400599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.579820+0000","last_change":"2024-09-14T10:45:35.579820+0000","last_active":"2024-09-14T10:45:35.579820+0000","last_peered":"2024-09-14T10:45:35.579820+0000","last_clean":"2024-09-14T10:45:35.579820+0000","last_became_active":"2024-09-14T10:45:33.610592+0000","last_became_peered":"2024-09-14T10:45:33.610592+0000","last_unstale":"2024-09-14T10:45:35.579820+0000","last_undegraded":"2024-09-14T10:45:35.579820+0000","last_fullsized":"2024-09-14T10:45:35.579820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_clean_scrub_stamp":"2024-09-14T10:45:32.551765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:46:36.542821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043055799999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-14T10:45:35.576643+0000","last_change":"2024-09-14T10:45:28.986498+0000","last_active":"2024-09-14T10:45:35.576643+0000","last_peered":"2024-09-14T10:45:35.576643+0000","last_clean":"2024-09-14T10:45:35.576643+0000","last_became_active":"2024-09-14T10:45:28.985499+0000","last_became_peered":"2024-09-14T10:45:28.985499+0000","last_unstale":"2024-09-14T10:45:35.576643+0000","last_undegraded":"2024-09-14T10:45:35.576643+0000","last_fullsized":"2024-09-14T10:45:35.576643+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:27.525313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:27.525313+0000","last_clean_scrub_stamp":"2024-09-14T10:45:27.525313+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:42:06.434476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":76025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":815104,"data_stored":666374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":76006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":76006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":76025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":815104,"data_stored":666374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":76006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":76006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T10:45:41.822 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-14T10:45:41.822 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-14T10:45:41.822 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-14T10:45:41.822 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-14T10:45:42.157 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T10:45:42.157 INFO:teuthology.orchestra.run.smithi097.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-14T10:45:42.170 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-14T10:45:42.170 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-09-14T10:45:42.183 INFO:teuthology.run_tasks:Running task rgw... 2024-09-14T10:45:42.200 DEBUG:tasks.rgw:config is {'client.0': None} 2024-09-14T10:45:42.201 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-14T10:45:42.201 INFO:tasks.rgw:Creating data pools 2024-09-14T10:45:42.201 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-14T10:45:42.201 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-09-14T10:45:42.657 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'default.rgw.buckets.data' created 2024-09-14T10:45:42.676 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-14T10:45:43.659 INFO:teuthology.orchestra.run.smithi097.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-14T10:45:43.689 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-14T10:45:44.691 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'default.rgw.buckets.index' created 2024-09-14T10:45:44.714 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-14T10:45:45.704 INFO:teuthology.orchestra.run.smithi097.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-14T10:45:45.730 DEBUG:tasks.rgw:Pools created 2024-09-14T10:45:45.731 INFO:tasks.rgw:Configuring compression type = random 2024-09-14T10:45:45.731 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-14T10:45:45.731 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-14T10:45:45.731 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-14T10:45:45.834 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:45:45.835 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:45:47.755 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:47.757+0000 7fdbe8e38640 0 -- 172.21.15.97:0/1348322775 >> [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] conn(0x7fdac4077140 msgr2=0x7fdac4079600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:45:47.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:47.761+0000 7fdbeab46800 20 rados->read ofs=0 len=0 2024-09-14T10:45:47.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:47.762+0000 7fdbe8e38640 0 -- 172.21.15.97:0/769523173 >> [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] conn(0x7fdab4077230 msgr2=0x7fdab40796f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:45:47.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:47.763+0000 7fdbeab46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:47.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:47.763+0000 7fdbeab46800 20 realm 2024-09-14T10:45:47.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:47.763+0000 7fdbeab46800 20 rados->read ofs=0 len=0 2024-09-14T10:45:47.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:47.763+0000 7fdbeab46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:47.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:47.763+0000 7fdbeab46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:45:47.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:47.763+0000 7fdbeab46800 20 rados->read ofs=0 len=0 2024-09-14T10:45:47.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:47.763+0000 7fdbeab46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:47.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:47.763+0000 7fdbeab46800 20 rados->read ofs=0 len=0 2024-09-14T10:45:47.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:47.764+0000 7fdbeab46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:45:47.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:47.764+0000 7fdbeab46800 20 rados->read ofs=0 len=0 2024-09-14T10:45:47.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:47.766+0000 7fdbeab46800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:45:47.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:47.766+0000 7fdbeab46800 20 searching for the correct realm 2024-09-14T10:45:47.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:47.776+0000 7fdbeab46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:45:47.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:47.776+0000 7fdbeab46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:45:47.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:47.776+0000 7fdbeab46800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T10:45:47.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:47.776+0000 7fdbeab46800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T10:45:47.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:47.776+0000 7fdbeab46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:45:47.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:47.776+0000 7fdbeab46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:45:47.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:47.776+0000 7fdbeab46800 20 rados->read ofs=0 len=0 2024-09-14T10:45:47.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:47.777+0000 7fdbeab46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:47.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:47.777+0000 7fdbeab46800 20 rados->read ofs=0 len=0 2024-09-14T10:45:47.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:47.777+0000 7fdbeab46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:45:47.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:47.777+0000 7fdbeab46800 20 rados->read ofs=0 len=0 2024-09-14T10:45:47.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:47.780+0000 7fdbeab46800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:45:47.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:47.780+0000 7fdbeab46800 20 zone default found 2024-09-14T10:45:47.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:47.780+0000 7fdbeab46800 4 Realm: () 2024-09-14T10:45:47.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:47.780+0000 7fdbeab46800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T10:45:47.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:47.780+0000 7fdbeab46800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T10:45:47.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:47.780+0000 7fdbeab46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:45:47.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:47.780+0000 7fdbeab46800 20 zonegroup default 2024-09-14T10:45:47.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:47.780+0000 7fdbeab46800 20 rados->read ofs=0 len=0 2024-09-14T10:45:47.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:47.780+0000 7fdbeab46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:47.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:47.780+0000 7fdbeab46800 20 rados->read ofs=0 len=0 2024-09-14T10:45:49.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:49.735+0000 7fdbeab46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:49.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:49.735+0000 7fdbeab46800 20 rados->read ofs=0 len=0 2024-09-14T10:45:49.734 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:49.735+0000 7fdbeab46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:49.734 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:49.735+0000 7fdbeab46800 20 started sync module instance, tier type = 2024-09-14T10:45:49.734 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:49.735+0000 7fdbeab46800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T10:45:51.773 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.775+0000 7fdbeab46800 20 add_watcher() i=0 2024-09-14T10:45:51.773 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.775+0000 7fdbeab46800 20 add_watcher() i=1 2024-09-14T10:45:51.773 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.775+0000 7fdbeab46800 20 add_watcher() i=2 2024-09-14T10:45:51.773 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.775+0000 7fdbeab46800 20 add_watcher() i=3 2024-09-14T10:45:51.773 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.775+0000 7fdbeab46800 20 add_watcher() i=4 2024-09-14T10:45:51.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.775+0000 7fdbeab46800 20 add_watcher() i=5 2024-09-14T10:45:51.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.777+0000 7fdbeab46800 20 add_watcher() i=6 2024-09-14T10:45:51.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.780+0000 7fdbeab46800 20 add_watcher() i=7 2024-09-14T10:45:51.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.780+0000 7fdbeab46800 2 all 8 watchers are set, enabling cache 2024-09-14T10:45:51.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.780+0000 7fdbeab46800 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-09-14T10:45:51.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.780+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-09-14T10:45:51.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.780+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.781+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-09-14T10:45:51.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.781+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-09-14T10:45:51.780 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.781+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.780 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.781+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-09-14T10:45:51.780 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.781+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-09-14T10:45:51.780 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.781+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.780 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.781+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-09-14T10:45:51.780 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.781+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-09-14T10:45:51.780 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.781+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.782+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-09-14T10:45:51.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.782+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-09-14T10:45:51.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.782+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.782+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-09-14T10:45:51.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.782+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-09-14T10:45:51.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.782+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.782+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-09-14T10:45:51.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.782+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-09-14T10:45:51.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.782+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.782+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-09-14T10:45:51.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.782+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-09-14T10:45:51.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.782+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.783+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-09-14T10:45:51.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.783+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-09-14T10:45:51.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.783+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.783+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-09-14T10:45:51.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.783+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-09-14T10:45:51.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.783+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.783+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-09-14T10:45:51.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.783+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-09-14T10:45:51.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.783+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.783+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-09-14T10:45:51.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.783+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-09-14T10:45:51.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.783+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.784+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-09-14T10:45:51.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.784+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-09-14T10:45:51.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.784+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.784+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-09-14T10:45:51.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.784+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-09-14T10:45:51.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.784+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.784+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-09-14T10:45:51.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.784+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-09-14T10:45:51.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.784+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.785+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-09-14T10:45:51.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.785+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-09-14T10:45:51.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.785+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.785+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-09-14T10:45:51.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.785+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-09-14T10:45:51.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.785+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.785+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-09-14T10:45:51.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.785+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-09-14T10:45:51.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.785+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.785+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-09-14T10:45:51.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.785+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-09-14T10:45:51.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.785+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.787 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.786+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-09-14T10:45:51.787 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.786+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-09-14T10:45:51.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.786+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.786+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-09-14T10:45:51.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.786+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-09-14T10:45:51.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.786+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.786+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-09-14T10:45:51.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.786+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-09-14T10:45:51.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.786+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.786+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-09-14T10:45:51.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.786+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-09-14T10:45:51.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.786+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.786+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-09-14T10:45:51.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.786+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-09-14T10:45:51.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.786+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.787+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-09-14T10:45:51.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.787+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-09-14T10:45:51.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.787+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.787+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-09-14T10:45:51.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.787+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-09-14T10:45:51.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.787+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.787+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-09-14T10:45:51.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.787+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-09-14T10:45:51.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.787+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.788+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-09-14T10:45:51.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.788+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-09-14T10:45:51.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.788+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.788+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-09-14T10:45:51.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.788+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-09-14T10:45:51.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.788+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.788+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-09-14T10:45:51.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.788+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-09-14T10:45:51.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.788+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.788+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-09-14T10:45:51.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.788+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-09-14T10:45:51.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.788+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.789+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-09-14T10:45:51.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.789+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-09-14T10:45:51.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.789+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.789+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-09-14T10:45:51.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.789+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-09-14T10:45:51.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.789+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.789+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-09-14T10:45:51.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.789+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-09-14T10:45:51.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.789+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.789+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-09-14T10:45:51.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.789+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-09-14T10:45:51.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.789+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.790+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-09-14T10:45:51.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.790+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-09-14T10:45:51.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.790+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.790+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-09-14T10:45:51.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.790+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-09-14T10:45:51.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.790+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.790+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-09-14T10:45:51.795 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.790+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-09-14T10:45:51.795 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.790+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.795 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.790+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-09-14T10:45:51.795 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.790+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-09-14T10:45:51.795 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.790+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.795 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.791+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-09-14T10:45:51.795 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.791+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-09-14T10:45:51.795 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.791+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.795 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.791+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-09-14T10:45:51.795 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.791+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-09-14T10:45:51.795 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.791+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.795 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.791+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-09-14T10:45:51.795 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.791+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-09-14T10:45:51.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.791+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.791+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-09-14T10:45:51.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.791+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-09-14T10:45:51.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.791+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.792+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-09-14T10:45:51.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.792+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-09-14T10:45:51.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.792+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.792+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-09-14T10:45:51.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.792+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-09-14T10:45:51.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.792+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.792+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-09-14T10:45:51.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.792+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-09-14T10:45:51.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.792+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.792+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-09-14T10:45:51.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.792+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-09-14T10:45:51.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.792+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.793+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-09-14T10:45:51.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.793+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-09-14T10:45:51.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.793+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.793+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-09-14T10:45:51.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.793+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-09-14T10:45:51.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.793+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.793+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-09-14T10:45:51.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.793+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-09-14T10:45:51.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.793+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.794+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-09-14T10:45:51.798 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.794+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-09-14T10:45:51.798 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.794+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.798 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.794+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-09-14T10:45:51.798 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.794+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-09-14T10:45:51.798 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.794+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.798 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.794+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-09-14T10:45:51.798 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.794+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-09-14T10:45:51.798 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.794+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.798 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.794+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-09-14T10:45:51.798 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.794+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-09-14T10:45:51.798 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.794+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.798 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.795+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-09-14T10:45:51.798 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.795+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-09-14T10:45:51.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.795+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.795+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-09-14T10:45:51.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.795+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-09-14T10:45:51.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.795+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.795+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-09-14T10:45:51.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.795+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-09-14T10:45:51.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.795+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.795+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-09-14T10:45:51.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.795+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-09-14T10:45:51.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.795+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.796+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-09-14T10:45:51.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.796+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-09-14T10:45:51.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.796+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.800 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.796+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-09-14T10:45:51.800 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.796+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-09-14T10:45:51.800 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.796+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.800 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.796+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-09-14T10:45:51.800 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.796+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-09-14T10:45:51.800 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.796+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.805 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.796+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-09-14T10:45:51.805 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.796+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-09-14T10:45:51.805 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.796+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.805 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.796+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-09-14T10:45:51.805 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.796+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-09-14T10:45:51.805 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.796+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.805 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.797+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-09-14T10:45:51.805 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.797+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-09-14T10:45:51.806 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.797+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.806 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.797+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-09-14T10:45:51.806 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.797+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-09-14T10:45:51.806 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.797+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.806 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.797+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-09-14T10:45:51.806 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.797+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-09-14T10:45:51.806 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.797+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.806 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.797+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-09-14T10:45:51.806 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.797+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-09-14T10:45:51.806 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.797+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.806 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.798+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-09-14T10:45:51.806 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.798+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-09-14T10:45:51.806 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.798+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.807 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.798+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-09-14T10:45:51.807 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.798+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-09-14T10:45:51.807 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.798+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.807 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.798+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-09-14T10:45:51.807 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.798+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-09-14T10:45:51.807 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.798+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.807 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.798+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-09-14T10:45:51.807 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.798+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-09-14T10:45:51.807 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.798+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.807 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.799+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-09-14T10:45:51.807 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.799+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-09-14T10:45:51.807 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.799+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.807 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.799+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-09-14T10:45:51.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.799+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-09-14T10:45:51.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.799+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.799+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-09-14T10:45:51.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.799+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-09-14T10:45:51.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.799+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.799+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-09-14T10:45:51.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.799+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-09-14T10:45:51.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.799+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.799+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-09-14T10:45:51.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.799+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-09-14T10:45:51.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.799+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.800+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-09-14T10:45:51.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.800+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-09-14T10:45:51.809 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.800+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.809 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.800+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-09-14T10:45:51.809 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.800+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-09-14T10:45:51.809 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.800+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.809 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.800+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-09-14T10:45:51.809 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.800+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-09-14T10:45:51.809 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.800+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.809 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.800+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-09-14T10:45:51.809 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.800+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-09-14T10:45:51.809 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.800+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.809 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.801+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-09-14T10:45:51.809 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.801+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-09-14T10:45:51.809 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.801+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.801+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-09-14T10:45:51.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.801+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-09-14T10:45:51.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.801+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.801+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-09-14T10:45:51.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.801+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-09-14T10:45:51.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.801+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.801+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-09-14T10:45:51.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.801+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-09-14T10:45:51.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.801+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.802+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-09-14T10:45:51.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.802+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-09-14T10:45:51.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.802+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.802+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-09-14T10:45:51.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.802+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-09-14T10:45:51.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.802+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.802+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-09-14T10:45:51.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.802+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-09-14T10:45:51.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.802+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.802+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-09-14T10:45:51.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.802+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-09-14T10:45:51.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.802+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.803+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-09-14T10:45:51.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.803+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-09-14T10:45:51.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.803+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.803+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-09-14T10:45:51.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.803+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-09-14T10:45:51.812 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.803+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.812 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.803+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-09-14T10:45:51.812 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.803+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-09-14T10:45:51.812 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.803+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.812 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.803+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-09-14T10:45:51.812 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.803+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-09-14T10:45:51.812 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.803+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.812 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.804+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-09-14T10:45:51.812 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.804+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-09-14T10:45:51.812 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.804+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.812 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.804+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-09-14T10:45:51.812 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.804+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-09-14T10:45:51.812 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.804+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.804+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-09-14T10:45:51.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.804+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-09-14T10:45:51.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.804+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.804+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-09-14T10:45:51.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.804+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-09-14T10:45:51.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.804+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.804+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-09-14T10:45:51.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.804+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-09-14T10:45:51.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.804+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.805+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-09-14T10:45:51.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.805+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-09-14T10:45:51.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.805+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.805+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-09-14T10:45:51.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.805+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-09-14T10:45:51.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.805+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.805+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-09-14T10:45:51.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.805+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-09-14T10:45:51.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.805+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.805+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-09-14T10:45:51.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.805+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-09-14T10:45:51.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.805+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.806+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-09-14T10:45:51.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.806+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-09-14T10:45:51.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.806+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.806+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-09-14T10:45:51.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.806+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-09-14T10:45:51.815 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.806+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.815 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.806+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-09-14T10:45:51.815 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.806+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-09-14T10:45:51.815 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.806+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.815 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.807+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-09-14T10:45:51.815 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.807+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-09-14T10:45:51.815 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.807+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.815 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.807+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-09-14T10:45:51.815 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.807+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-09-14T10:45:51.815 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.807+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.818 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.807+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-09-14T10:45:51.818 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.807+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-09-14T10:45:51.818 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.807+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.818 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.807+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-09-14T10:45:51.818 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.807+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-09-14T10:45:51.818 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.807+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.818 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.808+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-09-14T10:45:51.818 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.808+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-09-14T10:45:51.818 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.808+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.808+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-09-14T10:45:51.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.808+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-09-14T10:45:51.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.808+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.808+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-09-14T10:45:51.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.808+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-09-14T10:45:51.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.808+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.808+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-09-14T10:45:51.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.808+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-09-14T10:45:51.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.808+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.808+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-09-14T10:45:51.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.808+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-09-14T10:45:51.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.808+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.809+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-09-14T10:45:51.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.809+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-09-14T10:45:51.820 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.809+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.820 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.809+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-09-14T10:45:51.820 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.809+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-09-14T10:45:51.820 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.809+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.820 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.809+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-09-14T10:45:51.820 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.809+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-09-14T10:45:51.820 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.809+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.820 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.810+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-09-14T10:45:51.820 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.810+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-09-14T10:45:51.820 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.810+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.820 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.810+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-09-14T10:45:51.820 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.810+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-09-14T10:45:51.820 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.810+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.821 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.810+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-09-14T10:45:51.821 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.810+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-09-14T10:45:51.821 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.810+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.821 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.810+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-09-14T10:45:51.821 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.810+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-09-14T10:45:51.821 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.810+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.821 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.811+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-09-14T10:45:51.821 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.811+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-09-14T10:45:51.821 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.811+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.821 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.811+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-09-14T10:45:51.821 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.811+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-09-14T10:45:51.821 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.811+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.821 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.811+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-09-14T10:45:51.822 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.811+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-09-14T10:45:51.822 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.811+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.822 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.811+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-09-14T10:45:51.822 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.811+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-09-14T10:45:51.822 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.811+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.822 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.812+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-09-14T10:45:51.822 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.812+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-09-14T10:45:51.822 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.812+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.822 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.812+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-09-14T10:45:51.822 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.812+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-09-14T10:45:51.822 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.812+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.822 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.812+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-09-14T10:45:51.822 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.812+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-09-14T10:45:51.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.812+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.812+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-09-14T10:45:51.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.812+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-09-14T10:45:51.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.812+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.812+0000 7fdbeab46800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-09-14T10:45:51.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.812+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-09-14T10:45:51.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.814+0000 7fdbeab46800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:45:51.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.822+0000 7fda9a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:45:51.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.822+0000 7fdbeab46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:45:51.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:51.822+0000 7fdbeab46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:45:54.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:54.741+0000 7fdbeab46800 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-09-14T10:45:54.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:54.741+0000 7fdbeab46800 5 note: GC not initialized 2024-09-14T10:45:54.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:54.741+0000 7fda997e2640 20 reqs_thread_entry: start 2024-09-14T10:45:54.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:54.741+0000 7fdbeab46800 20 init_complete bucket index max shards: 11 2024-09-14T10:45:54.742 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:54.742+0000 7fdbeab46800 20 Filter name: none 2024-09-14T10:45:54.742 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:54.742+0000 7fd9faffd640 20 reqs_thread_entry: start 2024-09-14T10:45:54.770 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:54.771+0000 7fda9a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:45:54.773 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:54.774+0000 7fdbeab46800 20 remove_watcher() i=0 2024-09-14T10:45:54.773 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:54.774+0000 7fdbeab46800 2 removed watcher, disabling cache 2024-09-14T10:45:54.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:54.776+0000 7fdbeab46800 20 remove_watcher() i=1 2024-09-14T10:45:54.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:54.777+0000 7fdbeab46800 20 remove_watcher() i=2 2024-09-14T10:45:54.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:54.778+0000 7fdbeab46800 20 remove_watcher() i=3 2024-09-14T10:45:54.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:54.779+0000 7fdbeab46800 20 remove_watcher() i=4 2024-09-14T10:45:54.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:54.781+0000 7fdbeab46800 20 remove_watcher() i=5 2024-09-14T10:45:54.780 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:54.782+0000 7fdbeab46800 20 remove_watcher() i=6 2024-09-14T10:45:54.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:54.785+0000 7fdbeab46800 20 remove_watcher() i=7 2024-09-14T10:45:54.933 INFO:teuthology.orchestra.run.smithi097.stdout:[] 2024-09-14T10:45:54.934 DEBUG:tasks.util.rgw: json result: [] 2024-09-14T10:45:54.934 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-14T10:45:54.934 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-14T10:45:54.934 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-09-14T10:45:55.003 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:45:55.003 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:45:55.030 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.031+0000 7f1862924800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:45:55.030 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.031+0000 7f1862924800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:45:55.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.035+0000 7f1720fe1640 20 reqs_thread_entry: start 2024-09-14T10:45:55.050 INFO:teuthology.orchestra.run.smithi097.stdout:{"id":"428283c8-3a45-44a8-bd53-0ab34f1e0563","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-14T10:45:55.051 DEBUG:tasks.util.rgw: json result: {'id': '428283c8-3a45-44a8-bd53-0ab34f1e0563', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-14T10:45:55.051 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-14T10:45:55.051 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-14T10:45:55.051 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-14T10:45:55.107 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:45:55.107 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:45:55.140 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.142+0000 7f0890c92800 20 rados->read ofs=0 len=0 2024-09-14T10:45:55.143 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.144+0000 7f0890c92800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:55.143 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.144+0000 7f0890c92800 20 realm 2024-09-14T10:45:55.143 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.144+0000 7f0890c92800 20 rados->read ofs=0 len=0 2024-09-14T10:45:55.143 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.144+0000 7f0890c92800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:55.143 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.144+0000 7f0890c92800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:45:55.143 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.144+0000 7f0890c92800 20 rados->read ofs=0 len=0 2024-09-14T10:45:55.143 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.145+0000 7f0890c92800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:55.143 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.145+0000 7f0890c92800 20 rados->read ofs=0 len=0 2024-09-14T10:45:55.144 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.145+0000 7f0890c92800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:45:55.144 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.145+0000 7f0890c92800 20 rados->read ofs=0 len=0 2024-09-14T10:45:55.145 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.146+0000 7f0890c92800 20 rados_obj.operate() r=0 bl.length=1009 2024-09-14T10:45:55.145 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.146+0000 7f0890c92800 20 searching for the correct realm 2024-09-14T10:45:55.147 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.149+0000 7f088ef7d640 0 -- 172.21.15.97:0/1569738154 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f088406b070 msgr2=0x7f0884084920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T10:45:55.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.355+0000 7f088df7b640 0 -- 172.21.15.97:0/1569738154 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f0880045080 msgr2=0x7f08800870c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:45:55.359 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.360+0000 7f0890c92800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:45:55.359 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.360+0000 7f0890c92800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:45:55.359 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.360+0000 7f0890c92800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T10:45:55.359 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.360+0000 7f0890c92800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T10:45:55.359 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.360+0000 7f0890c92800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:45:55.359 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.360+0000 7f0890c92800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:45:55.359 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.360+0000 7f0890c92800 20 rados->read ofs=0 len=0 2024-09-14T10:45:55.359 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.361+0000 7f0890c92800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:55.359 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.361+0000 7f0890c92800 20 rados->read ofs=0 len=0 2024-09-14T10:45:55.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.361+0000 7f0890c92800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:45:55.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.361+0000 7f0890c92800 20 rados->read ofs=0 len=0 2024-09-14T10:45:55.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.361+0000 7f0890c92800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:45:55.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.361+0000 7f0890c92800 20 zone default found 2024-09-14T10:45:55.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.361+0000 7f0890c92800 4 Realm: () 2024-09-14T10:45:55.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.361+0000 7f0890c92800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T10:45:55.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.361+0000 7f0890c92800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T10:45:55.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.361+0000 7f0890c92800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:45:55.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.361+0000 7f0890c92800 20 zonegroup default 2024-09-14T10:45:55.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.361+0000 7f0890c92800 20 rados->read ofs=0 len=0 2024-09-14T10:45:55.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.362+0000 7f0890c92800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:55.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.362+0000 7f0890c92800 20 rados->read ofs=0 len=0 2024-09-14T10:45:55.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.362+0000 7f0890c92800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:55.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.362+0000 7f0890c92800 20 rados->read ofs=0 len=0 2024-09-14T10:45:55.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.362+0000 7f0890c92800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:55.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.362+0000 7f0890c92800 20 started sync module instance, tier type = 2024-09-14T10:45:55.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.362+0000 7f0890c92800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T10:45:55.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.386+0000 7f0890c92800 20 add_watcher() i=0 2024-09-14T10:45:55.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.386+0000 7f0890c92800 20 add_watcher() i=1 2024-09-14T10:45:55.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.386+0000 7f0890c92800 20 add_watcher() i=2 2024-09-14T10:45:55.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.386+0000 7f0890c92800 20 add_watcher() i=3 2024-09-14T10:45:55.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.386+0000 7f0890c92800 20 add_watcher() i=4 2024-09-14T10:45:55.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.386+0000 7f0890c92800 20 add_watcher() i=5 2024-09-14T10:45:55.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.386+0000 7f0890c92800 20 add_watcher() i=6 2024-09-14T10:45:55.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.387+0000 7f0890c92800 20 add_watcher() i=7 2024-09-14T10:45:55.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.387+0000 7f0890c92800 2 all 8 watchers are set, enabling cache 2024-09-14T10:45:55.389 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.390+0000 7f0744fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:45:55.389 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.390+0000 7f0890c92800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:45:55.389 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.390+0000 7f0890c92800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:45:55.389 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.390+0000 7f0890c92800 5 note: GC not initialized 2024-09-14T10:45:55.389 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.390+0000 7f06bf7fe640 20 reqs_thread_entry: start 2024-09-14T10:45:55.389 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.390+0000 7f0890c92800 20 init_complete bucket index max shards: 11 2024-09-14T10:45:55.389 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.390+0000 7f0890c92800 20 Filter name: none 2024-09-14T10:45:55.389 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.390+0000 7f06bd7fa640 20 reqs_thread_entry: start 2024-09-14T10:45:55.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.400+0000 7f0744fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:45:55.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.402+0000 7f0890c92800 20 remove_watcher() i=0 2024-09-14T10:45:55.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.402+0000 7f0890c92800 2 removed watcher, disabling cache 2024-09-14T10:45:55.401 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.403+0000 7f0890c92800 20 remove_watcher() i=1 2024-09-14T10:45:55.402 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.404+0000 7f0890c92800 20 remove_watcher() i=2 2024-09-14T10:45:55.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.405+0000 7f0890c92800 20 remove_watcher() i=3 2024-09-14T10:45:55.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.406+0000 7f0890c92800 20 remove_watcher() i=4 2024-09-14T10:45:55.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.407+0000 7f0890c92800 20 remove_watcher() i=5 2024-09-14T10:45:55.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.408+0000 7f0890c92800 20 remove_watcher() i=6 2024-09-14T10:45:55.408 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.410+0000 7f0890c92800 20 remove_watcher() i=7 2024-09-14T10:45:55.419 INFO:teuthology.orchestra.run.smithi097.stdout:[] 2024-09-14T10:45:55.419 DEBUG:tasks.util.rgw: json result: [] 2024-09-14T10:45:55.419 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-14T10:45:55.419 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-14T10:45:55.419 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --placement-inline-data false 2024-09-14T10:45:55.481 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:45:55.481 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:45:55.506 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.507+0000 7f01f7326800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:45:55.506 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.507+0000 7f01f7326800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:45:55.510 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.511+0000 7f00b57e2640 20 reqs_thread_entry: start 2024-09-14T10:45:55.526 INFO:teuthology.orchestra.run.smithi097.stdout:{"id":"428283c8-3a45-44a8-bd53-0ab34f1e0563","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-14T10:45:55.527 DEBUG:tasks.util.rgw: json result: {'id': '428283c8-3a45-44a8-bd53-0ab34f1e0563', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-14T10:45:55.527 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-14T10:45:55.527 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-14T10:45:55.527 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-14T10:45:55.583 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:45:55.583 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:45:55.617 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.619+0000 7efe2720f800 20 rados->read ofs=0 len=0 2024-09-14T10:45:55.619 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.621+0000 7efe2720f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:55.620 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.621+0000 7efe2720f800 20 realm 2024-09-14T10:45:55.620 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.621+0000 7efe2720f800 20 rados->read ofs=0 len=0 2024-09-14T10:45:55.620 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.621+0000 7efe2720f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:55.620 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.621+0000 7efe2720f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:45:55.620 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.621+0000 7efe2720f800 20 rados->read ofs=0 len=0 2024-09-14T10:45:55.620 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.621+0000 7efe2720f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:55.620 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.621+0000 7efe2720f800 20 rados->read ofs=0 len=0 2024-09-14T10:45:55.620 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.622+0000 7efe2720f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:45:55.621 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.622+0000 7efe2720f800 20 rados->read ofs=0 len=0 2024-09-14T10:45:55.621 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.623+0000 7efe2720f800 20 rados_obj.operate() r=0 bl.length=1009 2024-09-14T10:45:55.621 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.623+0000 7efe2720f800 20 searching for the correct realm 2024-09-14T10:45:55.622 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.624+0000 7efe22121640 0 -- 172.21.15.97:0/1836796279 >> [v2:172.21.15.97:6808/2081705332,v1:172.21.15.97:6809/2081705332] conn(0x7efe14069410 msgr2=0x7efe14069870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:45:55.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:55.829+0000 7efe22922640 0 -- 172.21.15.97:0/1836796279 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7efe0c093270 msgr2=0x7efe0c095450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:45:56.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.037+0000 7efe2720f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:45:56.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.037+0000 7efe2720f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:45:56.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.037+0000 7efe2720f800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T10:45:56.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.037+0000 7efe2720f800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T10:45:56.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.037+0000 7efe2720f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:45:56.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.037+0000 7efe2720f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:45:56.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.037+0000 7efe2720f800 20 rados->read ofs=0 len=0 2024-09-14T10:45:56.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.038+0000 7efe2720f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:56.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.038+0000 7efe2720f800 20 rados->read ofs=0 len=0 2024-09-14T10:45:56.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.038+0000 7efe2720f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:45:56.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.038+0000 7efe2720f800 20 rados->read ofs=0 len=0 2024-09-14T10:45:56.038 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.039+0000 7efe2720f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:45:56.038 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.039+0000 7efe2720f800 20 zone default found 2024-09-14T10:45:56.038 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.039+0000 7efe2720f800 4 Realm: () 2024-09-14T10:45:56.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.039+0000 7efe2720f800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T10:45:56.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.039+0000 7efe2720f800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T10:45:56.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.039+0000 7efe2720f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:45:56.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.039+0000 7efe2720f800 20 zonegroup default 2024-09-14T10:45:56.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.039+0000 7efe2720f800 20 rados->read ofs=0 len=0 2024-09-14T10:45:56.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.039+0000 7efe2720f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:56.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.039+0000 7efe2720f800 20 rados->read ofs=0 len=0 2024-09-14T10:45:56.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.039+0000 7efe2720f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:56.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.039+0000 7efe2720f800 20 rados->read ofs=0 len=0 2024-09-14T10:45:56.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.040+0000 7efe2720f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:45:56.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.040+0000 7efe2720f800 20 started sync module instance, tier type = 2024-09-14T10:45:56.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.040+0000 7efe2720f800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T10:45:56.051 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.053+0000 7efe2720f800 20 add_watcher() i=0 2024-09-14T10:45:56.051 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.053+0000 7efe2720f800 20 add_watcher() i=1 2024-09-14T10:45:56.051 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.053+0000 7efe2720f800 20 add_watcher() i=2 2024-09-14T10:45:56.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.053+0000 7efe2720f800 20 add_watcher() i=3 2024-09-14T10:45:56.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.053+0000 7efe2720f800 20 add_watcher() i=4 2024-09-14T10:45:56.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.053+0000 7efe2720f800 20 add_watcher() i=5 2024-09-14T10:45:56.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.056+0000 7efe2720f800 20 add_watcher() i=6 2024-09-14T10:45:56.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.056+0000 7efe2720f800 20 add_watcher() i=7 2024-09-14T10:45:56.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.056+0000 7efe2720f800 2 all 8 watchers are set, enabling cache 2024-09-14T10:45:56.057 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.058+0000 7efcd97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:45:56.057 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.058+0000 7efe2720f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:45:56.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.058+0000 7efe2720f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:45:56.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.058+0000 7efe2720f800 5 note: GC not initialized 2024-09-14T10:45:56.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.059+0000 7efc53fff640 20 reqs_thread_entry: start 2024-09-14T10:45:56.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.059+0000 7efe2720f800 20 init_complete bucket index max shards: 11 2024-09-14T10:45:56.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.059+0000 7efe2720f800 20 Filter name: none 2024-09-14T10:45:56.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.059+0000 7efc51ffb640 20 reqs_thread_entry: start 2024-09-14T10:45:56.066 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.068+0000 7efcd97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:45:56.069 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.070+0000 7efe2720f800 20 remove_watcher() i=0 2024-09-14T10:45:56.069 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.070+0000 7efe2720f800 2 removed watcher, disabling cache 2024-09-14T10:45:56.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.072+0000 7efe2720f800 20 remove_watcher() i=1 2024-09-14T10:45:56.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.073+0000 7efe2720f800 20 remove_watcher() i=2 2024-09-14T10:45:56.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.074+0000 7efe2720f800 20 remove_watcher() i=3 2024-09-14T10:45:56.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.076+0000 7efe2720f800 20 remove_watcher() i=4 2024-09-14T10:45:56.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.077+0000 7efe2720f800 20 remove_watcher() i=5 2024-09-14T10:45:56.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.078+0000 7efe2720f800 20 remove_watcher() i=6 2024-09-14T10:45:56.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.079+0000 7efe2720f800 20 remove_watcher() i=7 2024-09-14T10:45:56.088 INFO:teuthology.orchestra.run.smithi097.stdout:[] 2024-09-14T10:45:56.088 DEBUG:tasks.util.rgw: json result: [] 2024-09-14T10:45:56.088 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-09-14T10:45:56.088 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-14T10:45:56.088 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-14T10:45:56.088 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-09-14T10:45:56.150 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:45:56.150 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:45:56.175 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.176+0000 7fedfea0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:45:56.175 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.176+0000 7fedfea0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:45:56.178 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.180+0000 7fecbcfe1640 20 reqs_thread_entry: start 2024-09-14T10:45:56.193 INFO:teuthology.orchestra.run.smithi097.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-09-14T10:45:56.194 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-09-14T10:45:56.194 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-14T10:45:56.194 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-14T10:45:56.194 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-09-14T10:45:56.257 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:45:56.258 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:45:56.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.284+0000 7fc9ec523800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:45:56.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.284+0000 7fc9ec523800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:45:56.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.288+0000 7fc8a67fc640 20 reqs_thread_entry: start 2024-09-14T10:45:56.303 INFO:teuthology.orchestra.run.smithi097.stdout:{"id":"428283c8-3a45-44a8-bd53-0ab34f1e0563","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-14T10:45:56.304 DEBUG:tasks.util.rgw: json result: {'id': '428283c8-3a45-44a8-bd53-0ab34f1e0563', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-14T10:45:56.304 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-09-14T10:45:56.304 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-14T10:45:56.304 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-14T10:45:56.304 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-09-14T10:45:56.367 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:45:56.367 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:45:56.392 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.394+0000 7f7df6932800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:45:56.392 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.394+0000 7f7df6932800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:45:56.396 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.397+0000 7f7cb4fe1640 20 reqs_thread_entry: start 2024-09-14T10:45:56.411 INFO:teuthology.orchestra.run.smithi097.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-09-14T10:45:56.411 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-09-14T10:45:56.411 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-14T10:45:56.411 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-14T10:45:56.412 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-09-14T10:45:56.475 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:45:56.475 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:45:56.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.502+0000 7f111c016800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:45:56.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.502+0000 7f111c016800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:45:56.504 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T10:45:56.506+0000 7f0f8dffb640 20 reqs_thread_entry: start 2024-09-14T10:45:56.520 INFO:teuthology.orchestra.run.smithi097.stdout:{"id":"428283c8-3a45-44a8-bd53-0ab34f1e0563","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-14T10:45:56.520 DEBUG:tasks.util.rgw: json result: {'id': '428283c8-3a45-44a8-bd53-0ab34f1e0563', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-14T10:45:56.521 INFO:tasks.rgw:Starting rgw... 2024-09-14T10:45:56.521 INFO:tasks.rgw:rgw client.0 config is {} 2024-09-14T10:45:56.521 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-14T10:45:56.521 DEBUG:teuthology.orchestra.run.smithi097:> sudo echo -n http://smithi097.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-14T10:45:56.560 INFO:teuthology.orchestra.run.smithi097.stdout:http://smithi097.front.sepia.ceph.com:80 2024-09-14T10:45:56.561 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-14T10:45:56.640 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-14T10:45:56.640 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-14T10:45:56.683 INFO:tasks.rgw.client.0:Started 2024-09-14T10:45:56.683 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi097.front.sepia.ceph.com:80/ 2024-09-14T10:45:56.683 DEBUG:teuthology.orchestra.run.smithi097:> curl http://smithi097.front.sepia.ceph.com:80/ 2024-09-14T10:45:56.818 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-14T10:45:56.818 INFO:teuthology.orchestra.run.smithi097.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T10:45:56.818 INFO:teuthology.orchestra.run.smithi097.stderr: Dload Upload Total Spent Left Speed 2024-09-14T10:45:56.818 INFO:teuthology.orchestra.run.smithi097.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-14T10:45:56.818 INFO:teuthology.orchestra.run.smithi097.stderr:curl: (7) Failed to connect to smithi097.front.sepia.ceph.com port 80: Connection refused 2024-09-14T10:45:57.819 DEBUG:teuthology.orchestra.run.smithi097:> curl http://smithi097.front.sepia.ceph.com:80/ 2024-09-14T10:45:57.851 INFO:teuthology.orchestra.run.smithi097.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T10:45:57.851 INFO:teuthology.orchestra.run.smithi097.stderr: Dload Upload Total Spent Left Speed 2024-09-14T10:45:57.852 INFO:teuthology.orchestra.run.smithi097.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 93500 0 --:--:-- --:--:-- --:--:-- 182k 2024-09-14T10:45:57.853 INFO:teuthology.orchestra.run.smithi097.stdout:anonymous 2024-09-14T10:45:57.853 INFO:teuthology.run_tasks:Running task tox... 2024-09-14T10:45:57.865 INFO:tasks.tox:Deploying tox from pip... 2024-09-14T10:45:57.865 DEBUG:teuthology.orchestra.run.smithi097:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-09-14T10:46:00.189 DEBUG:teuthology.orchestra.run.smithi097:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-09-14T10:46:00.693 INFO:teuthology.orchestra.run.smithi097.stdout:Collecting tox==3.15.0 2024-09-14T10:46:00.741 INFO:teuthology.orchestra.run.smithi097.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-09-14T10:46:00.900 INFO:teuthology.orchestra.run.smithi097.stdout:Collecting packaging>=14 2024-09-14T10:46:00.913 INFO:teuthology.orchestra.run.smithi097.stdout: Downloading packaging-24.1-py3-none-any.whl (53 kB) 2024-09-14T10:46:01.002 INFO:teuthology.orchestra.run.smithi097.stdout:Collecting six<2,>=1.14.0 2024-09-14T10:46:01.015 INFO:teuthology.orchestra.run.smithi097.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T10:46:01.096 INFO:teuthology.orchestra.run.smithi097.stdout:Collecting pluggy<1,>=0.12.0 2024-09-14T10:46:01.110 INFO:teuthology.orchestra.run.smithi097.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-09-14T10:46:01.356 INFO:teuthology.orchestra.run.smithi097.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-09-14T10:46:01.370 INFO:teuthology.orchestra.run.smithi097.stdout: Downloading virtualenv-20.26.4-py3-none-any.whl (6.0 MB) 2024-09-14T10:46:01.595 INFO:teuthology.orchestra.run.smithi097.stdout:Collecting py<2,>=1.4.17 2024-09-14T10:46:01.609 INFO:teuthology.orchestra.run.smithi097.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-09-14T10:46:01.722 INFO:teuthology.orchestra.run.smithi097.stdout:Collecting filelock<4,>=3.0.0 2024-09-14T10:46:01.736 INFO:teuthology.orchestra.run.smithi097.stdout: Downloading filelock-3.16.0-py3-none-any.whl (16 kB) 2024-09-14T10:46:01.813 INFO:teuthology.orchestra.run.smithi097.stdout:Collecting toml>=0.9.4 2024-09-14T10:46:01.826 INFO:teuthology.orchestra.run.smithi097.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-09-14T10:46:01.972 INFO:teuthology.orchestra.run.smithi097.stdout:Collecting platformdirs<5,>=3.9.1 2024-09-14T10:46:01.986 INFO:teuthology.orchestra.run.smithi097.stdout: Downloading platformdirs-4.3.3-py3-none-any.whl (18 kB) 2024-09-14T10:46:02.067 INFO:teuthology.orchestra.run.smithi097.stdout:Collecting distlib<1,>=0.3.7 2024-09-14T10:46:02.081 INFO:teuthology.orchestra.run.smithi097.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-09-14T10:46:02.201 INFO:teuthology.orchestra.run.smithi097.stdout:Installing collected packages: platformdirs, filelock, distlib, virtualenv, toml, six, py, pluggy, packaging, tox 2024-09-14T10:46:02.991 INFO:teuthology.orchestra.run.smithi097.stdout:Successfully installed distlib-0.3.8 filelock-3.16.0 packaging-24.1 platformdirs-4.3.3 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.26.4 2024-09-14T10:46:03.188 INFO:teuthology.orchestra.run.smithi097.stderr:WARNING: You are using pip version 21.3.1; however, version 24.2 is available. 2024-09-14T10:46:03.189 INFO:teuthology.orchestra.run.smithi097.stderr:You should consider upgrading via the '/home/ubuntu/cephtest/tox-venv/bin/python3 -m pip install --upgrade pip' command. 2024-09-14T10:46:03.250 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T10:46:03.264 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T10:46:03.264 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T10:46:03.264 DEBUG:teuthology.orchestra.run.smithi097:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T10:46:03.292 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:46:03.293 INFO:teuthology.orchestra.run.smithi097.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T10:46:03.293 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T10:46:03.361 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T10:46:03.362 DEBUG:teuthology.orchestra.run.smithi097:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T10:46:03.430 INFO:tasks.workunit:timeout=3h 2024-09-14T10:46:03.430 INFO:tasks.workunit:cleanup=True 2024-09-14T10:46:03.430 DEBUG:teuthology.orchestra.run.smithi097:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T10:46:03.499 INFO:tasks.workunit.client.0.smithi097.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T10:47:00.153 INFO:tasks.workunit.client.0.smithi097.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T10:47:00.154 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T10:47:00.154 INFO:tasks.workunit.client.0.smithi097.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T10:47:00.154 INFO:tasks.workunit.client.0.smithi097.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T10:47:00.154 INFO:tasks.workunit.client.0.smithi097.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T10:47:00.154 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T10:47:00.154 INFO:tasks.workunit.client.0.smithi097.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T10:47:00.154 INFO:tasks.workunit.client.0.smithi097.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T10:47:00.154 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T10:47:00.155 INFO:tasks.workunit.client.0.smithi097.stderr: git switch -c 2024-09-14T10:47:00.155 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T10:47:00.155 INFO:tasks.workunit.client.0.smithi097.stderr:Or undo this operation with: 2024-09-14T10:47:00.155 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T10:47:00.155 INFO:tasks.workunit.client.0.smithi097.stderr: git switch - 2024-09-14T10:47:00.155 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T10:47:00.155 INFO:tasks.workunit.client.0.smithi097.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T10:47:00.155 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T10:47:00.155 INFO:tasks.workunit.client.0.smithi097.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T10:47:00.156 DEBUG:teuthology.orchestra.run.smithi097:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T10:47:00.271 INFO:tasks.workunit.client.0.smithi097.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T10:47:00.273 INFO:tasks.workunit.client.0.smithi097.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T10:47:00.274 INFO:tasks.workunit.client.0.smithi097.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T10:47:00.851 INFO:tasks.workunit.client.0.smithi097.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T10:47:00.921 INFO:tasks.workunit.client.0.smithi097.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T10:47:00.962 INFO:tasks.workunit.client.0.smithi097.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T10:47:00.964 INFO:tasks.workunit.client.0.smithi097.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T10:47:00.964 INFO:tasks.workunit.client.0.smithi097.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T10:47:01.003 INFO:tasks.workunit.client.0.smithi097.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T10:47:01.006 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-14T10:47:01.006 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T10:47:01.035 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-09-14T10:47:01.036 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-09-14T10:47:01.036 DEBUG:teuthology.orchestra.run.smithi097:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-14T10:47:01.109 INFO:tasks.workunit.client.0.smithi097.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-14T10:47:01.110 INFO:tasks.workunit.client.0.smithi097.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T10:47:01.110 INFO:tasks.workunit.client.0.smithi097.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T10:47:03.370 INFO:tasks.workunit.client.0.smithi097.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-14T10:47:03.370 INFO:tasks.workunit.client.0.smithi097.stderr:++ deactivate nondestructive 2024-09-14T10:47:03.370 INFO:tasks.workunit.client.0.smithi097.stderr:++ '[' -n '' ']' 2024-09-14T10:47:03.370 INFO:tasks.workunit.client.0.smithi097.stderr:++ '[' -n '' ']' 2024-09-14T10:47:03.371 INFO:tasks.workunit.client.0.smithi097.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T10:47:03.371 INFO:tasks.workunit.client.0.smithi097.stderr:++ hash -r 2024-09-14T10:47:03.371 INFO:tasks.workunit.client.0.smithi097.stderr:++ '[' -n '' ']' 2024-09-14T10:47:03.371 INFO:tasks.workunit.client.0.smithi097.stderr:++ unset VIRTUAL_ENV 2024-09-14T10:47:03.371 INFO:tasks.workunit.client.0.smithi097.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-14T10:47:03.371 INFO:tasks.workunit.client.0.smithi097.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T10:47:03.372 INFO:tasks.workunit.client.0.smithi097.stderr:++ export VIRTUAL_ENV 2024-09-14T10:47:03.372 INFO:tasks.workunit.client.0.smithi097.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T10:47:03.372 INFO:tasks.workunit.client.0.smithi097.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T10:47:03.372 INFO:tasks.workunit.client.0.smithi097.stderr:++ export PATH 2024-09-14T10:47:03.372 INFO:tasks.workunit.client.0.smithi097.stderr:++ '[' -n '' ']' 2024-09-14T10:47:03.372 INFO:tasks.workunit.client.0.smithi097.stderr:++ '[' -z '' ']' 2024-09-14T10:47:03.373 INFO:tasks.workunit.client.0.smithi097.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-14T10:47:03.373 INFO:tasks.workunit.client.0.smithi097.stderr:++ PS1='(rgw) ' 2024-09-14T10:47:03.373 INFO:tasks.workunit.client.0.smithi097.stderr:++ export PS1 2024-09-14T10:47:03.373 INFO:tasks.workunit.client.0.smithi097.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T10:47:03.373 INFO:tasks.workunit.client.0.smithi097.stderr:++ hash -r 2024-09-14T10:47:03.373 INFO:tasks.workunit.client.0.smithi097.stderr:+ pip install pip --upgrade 2024-09-14T10:47:03.591 INFO:tasks.workunit.client.0.smithi097.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-14T10:47:03.780 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting pip 2024-09-14T10:47:03.831 INFO:tasks.workunit.client.0.smithi097.stdout: Downloading pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T10:47:03.984 INFO:tasks.workunit.client.0.smithi097.stdout:Installing collected packages: pip 2024-09-14T10:47:03.984 INFO:tasks.workunit.client.0.smithi097.stdout: Attempting uninstall: pip 2024-09-14T10:47:03.984 INFO:tasks.workunit.client.0.smithi097.stdout: Found existing installation: pip 21.3.1 2024-09-14T10:47:04.135 INFO:tasks.workunit.client.0.smithi097.stdout: Uninstalling pip-21.3.1: 2024-09-14T10:47:04.140 INFO:tasks.workunit.client.0.smithi097.stdout: Successfully uninstalled pip-21.3.1 2024-09-14T10:47:04.853 INFO:tasks.workunit.client.0.smithi097.stdout:Successfully installed pip-24.2 2024-09-14T10:47:05.090 INFO:tasks.workunit.client.0.smithi097.stderr:+ pip install boto3 2024-09-14T10:47:05.930 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting boto3 2024-09-14T10:47:05.972 INFO:tasks.workunit.client.0.smithi097.stdout: Downloading boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T10:47:06.632 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T10:47:06.646 INFO:tasks.workunit.client.0.smithi097.stdout: Downloading botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T10:47:06.741 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T10:47:06.754 INFO:tasks.workunit.client.0.smithi097.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T10:47:06.872 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T10:47:06.885 INFO:tasks.workunit.client.0.smithi097.stdout: Downloading s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T10:47:07.015 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T10:47:07.029 INFO:tasks.workunit.client.0.smithi097.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T10:47:07.192 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T10:47:07.206 INFO:tasks.workunit.client.0.smithi097.stdout: Downloading urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-14T10:47:07.456 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T10:47:07.469 INFO:tasks.workunit.client.0.smithi097.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T10:47:07.532 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T10:47:07.623 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T10:47:07.846 INFO:tasks.workunit.client.0.smithi097.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.5/12.5 MB 58.6 MB/s eta 0:00:00 2024-09-14T10:47:07.860 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T10:47:07.923 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T10:47:07.991 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T10:47:08.049 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-14T10:47:08.108 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T10:47:08.227 INFO:tasks.workunit.client.0.smithi097.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T10:47:09.248 INFO:tasks.workunit.client.0.smithi097.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-14T10:47:09.363 INFO:tasks.workunit.client.0.smithi097.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-09-14T10:47:09.496 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-09-14T10:47:09.531 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:47:09.531 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:47:09.569 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.571+0000 7f6bf3640800 20 rados->read ofs=0 len=0 2024-09-14T10:47:09.571 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.572+0000 7f6bf3640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:09.571 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.572+0000 7f6bf3640800 20 realm 2024-09-14T10:47:09.571 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.572+0000 7f6bf3640800 20 rados->read ofs=0 len=0 2024-09-14T10:47:09.571 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.572+0000 7f6bf3640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:09.571 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.572+0000 7f6bf3640800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:47:09.571 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.572+0000 7f6bf3640800 20 rados->read ofs=0 len=0 2024-09-14T10:47:09.571 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.573+0000 7f6bf3640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:09.571 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.573+0000 7f6bf3640800 20 rados->read ofs=0 len=0 2024-09-14T10:47:09.572 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.573+0000 7f6bf3640800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:09.572 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.573+0000 7f6bf3640800 20 rados->read ofs=0 len=0 2024-09-14T10:47:09.572 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.574+0000 7f6bf3640800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:47:09.573 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.574+0000 7f6bf3640800 20 searching for the correct realm 2024-09-14T10:47:09.575 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.577+0000 7f6bf192b640 0 -- 172.21.15.97:0/1748083777 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f6bdc06b020 msgr2=0x7f6bdc0d1500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:47:09.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.581+0000 7f6bebfff640 0 -- 172.21.15.97:0/1748083777 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f6be401c040 msgr2=0x7f6be403d960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:47:09.584 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.586+0000 7f6bf3640800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:47:09.585 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.586+0000 7f6bf3640800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:47:09.585 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.586+0000 7f6bf3640800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T10:47:09.585 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.586+0000 7f6bf3640800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T10:47:09.585 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.586+0000 7f6bf3640800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:47:09.585 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.586+0000 7f6bf3640800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:47:09.585 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.586+0000 7f6bf3640800 20 rados->read ofs=0 len=0 2024-09-14T10:47:09.585 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.586+0000 7f6bf3640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:09.585 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.586+0000 7f6bf3640800 20 rados->read ofs=0 len=0 2024-09-14T10:47:09.585 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.586+0000 7f6bf3640800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:09.585 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.586+0000 7f6bf3640800 20 rados->read ofs=0 len=0 2024-09-14T10:47:09.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.587+0000 7f6bf3640800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:47:09.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.587+0000 7f6bf3640800 20 zone default found 2024-09-14T10:47:09.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.587+0000 7f6bf3640800 4 Realm: () 2024-09-14T10:47:09.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.587+0000 7f6bf3640800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T10:47:09.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.587+0000 7f6bf3640800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T10:47:09.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.587+0000 7f6bf3640800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:47:09.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.587+0000 7f6bf3640800 20 zonegroup default 2024-09-14T10:47:09.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.587+0000 7f6bf3640800 20 rados->read ofs=0 len=0 2024-09-14T10:47:09.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.587+0000 7f6bf3640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:09.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.587+0000 7f6bf3640800 20 rados->read ofs=0 len=0 2024-09-14T10:47:09.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.587+0000 7f6bf3640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:09.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.587+0000 7f6bf3640800 20 rados->read ofs=0 len=0 2024-09-14T10:47:09.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.588+0000 7f6bf3640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:09.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.588+0000 7f6bf3640800 20 started sync module instance, tier type = 2024-09-14T10:47:09.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.588+0000 7f6bf3640800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T10:47:09.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.605+0000 7f6bf3640800 20 add_watcher() i=0 2024-09-14T10:47:09.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.605+0000 7f6bf3640800 20 add_watcher() i=1 2024-09-14T10:47:09.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.605+0000 7f6bf3640800 20 add_watcher() i=2 2024-09-14T10:47:09.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.605+0000 7f6bf3640800 20 add_watcher() i=3 2024-09-14T10:47:09.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.605+0000 7f6bf3640800 20 add_watcher() i=4 2024-09-14T10:47:09.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.605+0000 7f6bf3640800 20 add_watcher() i=5 2024-09-14T10:47:09.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.605+0000 7f6bf3640800 20 add_watcher() i=6 2024-09-14T10:47:09.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.607+0000 7f6bf3640800 20 add_watcher() i=7 2024-09-14T10:47:09.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.607+0000 7f6bf3640800 2 all 8 watchers are set, enabling cache 2024-09-14T10:47:09.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.609+0000 7f6aa77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:09.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.610+0000 7f6bf3640800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:47:09.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.610+0000 7f6bf3640800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:47:09.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.610+0000 7f6bf3640800 5 note: GC not initialized 2024-09-14T10:47:09.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.610+0000 7f6aa67e4640 20 reqs_thread_entry: start 2024-09-14T10:47:09.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.610+0000 7f6bf3640800 20 init_complete bucket index max shards: 11 2024-09-14T10:47:09.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.610+0000 7f6bf3640800 20 Filter name: none 2024-09-14T10:47:09.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.610+0000 7f6a17fff640 20 reqs_thread_entry: start 2024-09-14T10:47:09.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.610+0000 7f6bf3640800 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-09-14T10:47:09.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.610+0000 7f6bf3640800 20 rados->read ofs=0 len=0 2024-09-14T10:47:09.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.610+0000 7f6bf3640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:09.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.610+0000 7f6bf3640800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-09-14T10:47:09.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.610+0000 7f6bf3640800 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-14T10:47:09.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.610+0000 7f6bf3640800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-09-14T10:47:09.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.610+0000 7f6bf3640800 20 rados->read ofs=0 len=0 2024-09-14T10:47:09.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.611+0000 7f6bf3640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:09.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.611+0000 7f6bf3640800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-09-14T10:47:09.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.611+0000 7f6bf3640800 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-14T10:47:09.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.611+0000 7f6bf3640800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-14T10:47:09.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.611+0000 7f6bf3640800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-14T10:47:09.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.612+0000 7f6bf3640800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-14T10:47:09.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.612+0000 7f6bf3640800 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-14T10:47:09.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.612+0000 7f6bf3640800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-09-14T10:47:09.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.612+0000 7f6ad4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 163208757248 cookie 93968545639200 notifier 4674 bl.length()=593 2024-09-14T10:47:09.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.612+0000 7f6ad4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-14T10:47:09.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.612+0000 7f6ad4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-14T10:47:09.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.614+0000 7f6bf3640800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-14T10:47:09.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.614+0000 7f6bf3640800 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-14T10:47:09.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.614+0000 7f6bf3640800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-09-14T10:47:09.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.614+0000 7f6ac3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 163208757248 cookie 93968545631680 notifier 4674 bl.length()=186 2024-09-14T10:47:09.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.614+0000 7f6ac3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-14T10:47:09.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.614+0000 7f6ac3fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-14T10:47:09.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.615+0000 7f6aa77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:09.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.618+0000 7f6bf3640800 20 remove_watcher() i=0 2024-09-14T10:47:09.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.618+0000 7f6bf3640800 2 removed watcher, disabling cache 2024-09-14T10:47:09.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.619+0000 7f6bf3640800 20 remove_watcher() i=1 2024-09-14T10:47:09.618 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.620+0000 7f6bf3640800 20 remove_watcher() i=2 2024-09-14T10:47:09.619 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.621+0000 7f6bf3640800 20 remove_watcher() i=3 2024-09-14T10:47:09.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.622+0000 7f6bf3640800 20 remove_watcher() i=4 2024-09-14T10:47:09.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.623+0000 7f6bf3640800 20 remove_watcher() i=5 2024-09-14T10:47:09.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.625+0000 7f6bf3640800 20 remove_watcher() i=6 2024-09-14T10:47:09.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.627+0000 7f6bf3640800 20 remove_watcher() i=7 2024-09-14T10:47:09.924 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: recalculated bucket check stats are correct 2024-09-14T10:47:09.924 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T10:47:09.925 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-14T10:47:09.955 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:47:09.955 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:47:09.992 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.994+0000 7f7c2f919800 20 rados->read ofs=0 len=0 2024-09-14T10:47:09.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.995+0000 7f7c2f919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:09.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.995+0000 7f7c2f919800 20 realm 2024-09-14T10:47:09.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.995+0000 7f7c2f919800 20 rados->read ofs=0 len=0 2024-09-14T10:47:09.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.995+0000 7f7c2f919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:09.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.995+0000 7f7c2f919800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:47:09.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.995+0000 7f7c2f919800 20 rados->read ofs=0 len=0 2024-09-14T10:47:09.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.996+0000 7f7c2f919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:09.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.996+0000 7f7c2f919800 20 rados->read ofs=0 len=0 2024-09-14T10:47:09.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.996+0000 7f7c2f919800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:09.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.996+0000 7f7c2f919800 20 rados->read ofs=0 len=0 2024-09-14T10:47:09.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.997+0000 7f7c2f919800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:47:09.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.997+0000 7f7c2f919800 20 searching for the correct realm 2024-09-14T10:47:09.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:09.999+0000 7f7c2cc02640 0 -- 172.21.15.97:0/2062034363 >> [v2:172.21.15.97:6816/4093696477,v1:172.21.15.97:6817/4093696477] conn(0x55620ab9a530 msgr2=0x55620ab9c920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:47:10.000 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.002+0000 7f7c2cc02640 0 -- 172.21.15.97:0/2062034363 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f7c200a6140 msgr2=0x7f7c200afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:47:10.209 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.210+0000 7f7c2f919800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:47:10.209 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.210+0000 7f7c2f919800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:47:10.209 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.210+0000 7f7c2f919800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T10:47:10.209 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.210+0000 7f7c2f919800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T10:47:10.209 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.210+0000 7f7c2f919800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:47:10.209 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.210+0000 7f7c2f919800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:47:10.210 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.210+0000 7f7c2f919800 20 rados->read ofs=0 len=0 2024-09-14T10:47:10.210 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.210+0000 7f7c2f919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:10.210 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.210+0000 7f7c2f919800 20 rados->read ofs=0 len=0 2024-09-14T10:47:10.210 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.211+0000 7f7c2f919800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:10.210 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.211+0000 7f7c2f919800 20 rados->read ofs=0 len=0 2024-09-14T10:47:10.211 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.211+0000 7f7c2f919800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:47:10.211 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.211+0000 7f7c2f919800 20 zone default found 2024-09-14T10:47:10.211 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.211+0000 7f7c2f919800 4 Realm: () 2024-09-14T10:47:10.211 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.211+0000 7f7c2f919800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T10:47:10.211 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.211+0000 7f7c2f919800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T10:47:10.211 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.211+0000 7f7c2f919800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:47:10.211 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.211+0000 7f7c2f919800 20 zonegroup default 2024-09-14T10:47:10.211 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.211+0000 7f7c2f919800 20 rados->read ofs=0 len=0 2024-09-14T10:47:10.211 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.211+0000 7f7c2f919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:10.212 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.211+0000 7f7c2f919800 20 rados->read ofs=0 len=0 2024-09-14T10:47:10.212 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.212+0000 7f7c2f919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:10.212 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.212+0000 7f7c2f919800 20 rados->read ofs=0 len=0 2024-09-14T10:47:10.212 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.212+0000 7f7c2f919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:10.212 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.212+0000 7f7c2f919800 20 started sync module instance, tier type = 2024-09-14T10:47:10.212 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.212+0000 7f7c2f919800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T10:47:10.222 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.223+0000 7f7c2f919800 20 add_watcher() i=0 2024-09-14T10:47:10.222 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.223+0000 7f7c2f919800 20 add_watcher() i=1 2024-09-14T10:47:10.222 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.223+0000 7f7c2f919800 20 add_watcher() i=2 2024-09-14T10:47:10.222 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.223+0000 7f7c2f919800 20 add_watcher() i=3 2024-09-14T10:47:10.222 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.223+0000 7f7c2f919800 20 add_watcher() i=4 2024-09-14T10:47:10.222 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.223+0000 7f7c2f919800 20 add_watcher() i=5 2024-09-14T10:47:10.222 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.223+0000 7f7c2f919800 20 add_watcher() i=6 2024-09-14T10:47:10.223 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.225+0000 7f7c2f919800 20 add_watcher() i=7 2024-09-14T10:47:10.223 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.225+0000 7f7c2f919800 2 all 8 watchers are set, enabling cache 2024-09-14T10:47:10.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.226+0000 7f7ae37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:10.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.227+0000 7f7c2f919800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:47:10.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.227+0000 7f7c2f919800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:47:10.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.227+0000 7f7c2f919800 5 note: GC not initialized 2024-09-14T10:47:10.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.227+0000 7f7ae27e4640 20 reqs_thread_entry: start 2024-09-14T10:47:10.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.227+0000 7f7c2f919800 20 init_complete bucket index max shards: 11 2024-09-14T10:47:10.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.227+0000 7f7c2f919800 20 Filter name: none 2024-09-14T10:47:10.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.227+0000 7f7a53fff640 20 reqs_thread_entry: start 2024-09-14T10:47:10.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.227+0000 7f7c2f919800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T10:47:10.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.227+0000 7f7c2f919800 20 rados->read ofs=0 len=0 2024-09-14T10:47:10.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.228+0000 7f7c2f919800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:47:10.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.228+0000 7f7c2f919800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T10:47:10.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.228+0000 7f7c2f919800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T10:47:10.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.228+0000 7f7c2f919800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1 : miss 2024-09-14T10:47:10.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.228+0000 7f7c2f919800 20 rados->read ofs=0 len=0 2024-09-14T10:47:10.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.228+0000 7f7c2f919800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:47:10.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.228+0000 7f7c2f919800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1 info.flags=0x17 2024-09-14T10:47:10.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.228+0000 7f7c2f919800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1 to cache LRU end 2024-09-14T10:47:10.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.228+0000 7f7c2f919800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:47:10.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.228+0000 7f7c2f919800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T10:47:10.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.228+0000 7f7c2f919800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1 2024-09-14T10:47:10.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.229+0000 7f7c2f919800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.0 2024-09-14T10:47:10.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.229+0000 7f7c2f919800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.1 2024-09-14T10:47:10.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.229+0000 7f7c2f919800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.2 2024-09-14T10:47:10.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.230+0000 7f7c2f919800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.3 2024-09-14T10:47:10.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.231+0000 7f7c2f919800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.4 2024-09-14T10:47:10.230 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.231+0000 7f7c2f919800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.5 2024-09-14T10:47:10.230 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.232+0000 7f7c2f919800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.6 2024-09-14T10:47:10.230 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.232+0000 7f7c2f919800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.7 2024-09-14T10:47:10.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.233+0000 7f7c2f919800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.8 2024-09-14T10:47:10.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.233+0000 7f7c2f919800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.9 2024-09-14T10:47:10.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.234+0000 7f7c2f919800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.10 2024-09-14T10:47:10.237 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.238+0000 7f7ae37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:10.239 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.241+0000 7f7c2f919800 20 remove_watcher() i=0 2024-09-14T10:47:10.239 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.241+0000 7f7c2f919800 2 removed watcher, disabling cache 2024-09-14T10:47:10.240 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.242+0000 7f7c2f919800 20 remove_watcher() i=1 2024-09-14T10:47:10.241 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.243+0000 7f7c2f919800 20 remove_watcher() i=2 2024-09-14T10:47:10.242 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.244+0000 7f7c2f919800 20 remove_watcher() i=3 2024-09-14T10:47:10.243 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.245+0000 7f7c2f919800 20 remove_watcher() i=4 2024-09-14T10:47:10.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.246+0000 7f7c2f919800 20 remove_watcher() i=5 2024-09-14T10:47:10.247 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.249+0000 7f7c2f919800 20 remove_watcher() i=6 2024-09-14T10:47:10.248 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.250+0000 7f7c2f919800 20 remove_watcher() i=7 2024-09-14T10:47:10.259 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-14T10:47:10.288 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:47:10.288 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:47:10.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.327+0000 7f81fab3c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:10.327 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.329+0000 7f81fab3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:10.327 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.329+0000 7f81fab3c800 20 realm 2024-09-14T10:47:10.327 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.329+0000 7f81fab3c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:10.327 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.329+0000 7f81fab3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:10.327 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.329+0000 7f81fab3c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:47:10.327 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.329+0000 7f81fab3c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:10.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.329+0000 7f81fab3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:10.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.329+0000 7f81fab3c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:10.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.330+0000 7f81fab3c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:10.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.330+0000 7f81fab3c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:10.329 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.330+0000 7f81fab3c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:47:10.329 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.330+0000 7f81fab3c800 20 searching for the correct realm 2024-09-14T10:47:10.329 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.331+0000 7f81f6881640 0 -- 172.21.15.97:0/2782345044 >> [v2:172.21.15.152:6808/1010851305,v1:172.21.15.152:6809/1010851305] conn(0x55bde0323930 msgr2=0x55bde0325df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:47:10.534 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.535+0000 7f81f6881640 0 -- 172.21.15.97:0/2782345044 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x55bde0317200 msgr2=0x55bde03196a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:47:10.541 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.543+0000 7f81fab3c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:47:10.541 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.543+0000 7f81fab3c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:47:10.541 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.543+0000 7f81fab3c800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T10:47:10.541 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.543+0000 7f81fab3c800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T10:47:10.542 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.543+0000 7f81fab3c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:47:10.542 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.543+0000 7f81fab3c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:47:10.542 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.543+0000 7f81fab3c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:10.542 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.543+0000 7f81fab3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:10.542 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.543+0000 7f81fab3c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:10.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.543+0000 7f81fab3c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:10.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.543+0000 7f81fab3c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:10.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.544+0000 7f81fab3c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:47:10.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.544+0000 7f81fab3c800 20 zone default found 2024-09-14T10:47:10.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.544+0000 7f81fab3c800 4 Realm: () 2024-09-14T10:47:10.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.544+0000 7f81fab3c800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T10:47:10.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.544+0000 7f81fab3c800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T10:47:10.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.544+0000 7f81fab3c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:47:10.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.544+0000 7f81fab3c800 20 zonegroup default 2024-09-14T10:47:10.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.544+0000 7f81fab3c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:10.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.544+0000 7f81fab3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:10.544 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.544+0000 7f81fab3c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:10.544 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.545+0000 7f81fab3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:10.544 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.545+0000 7f81fab3c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:10.544 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.545+0000 7f81fab3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:10.544 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.545+0000 7f81fab3c800 20 started sync module instance, tier type = 2024-09-14T10:47:10.544 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.545+0000 7f81fab3c800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T10:47:10.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.566+0000 7f81fab3c800 20 add_watcher() i=0 2024-09-14T10:47:10.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.566+0000 7f81fab3c800 20 add_watcher() i=1 2024-09-14T10:47:10.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.566+0000 7f81fab3c800 20 add_watcher() i=2 2024-09-14T10:47:10.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.566+0000 7f81fab3c800 20 add_watcher() i=3 2024-09-14T10:47:10.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.566+0000 7f81fab3c800 20 add_watcher() i=4 2024-09-14T10:47:10.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.566+0000 7f81fab3c800 20 add_watcher() i=5 2024-09-14T10:47:10.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.566+0000 7f81fab3c800 20 add_watcher() i=6 2024-09-14T10:47:10.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.567+0000 7f81fab3c800 20 add_watcher() i=7 2024-09-14T10:47:10.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.567+0000 7f81fab3c800 2 all 8 watchers are set, enabling cache 2024-09-14T10:47:10.568 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.569+0000 7f80ad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:10.569 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.570+0000 7f81fab3c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:47:10.569 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.570+0000 7f81fab3c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:47:10.569 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.570+0000 7f81fab3c800 5 note: GC not initialized 2024-09-14T10:47:10.569 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.570+0000 7f8027fff640 20 reqs_thread_entry: start 2024-09-14T10:47:10.569 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.570+0000 7f81fab3c800 20 init_complete bucket index max shards: 11 2024-09-14T10:47:10.569 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.570+0000 7f81fab3c800 20 Filter name: none 2024-09-14T10:47:10.569 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.570+0000 7f8025ffb640 20 reqs_thread_entry: start 2024-09-14T10:47:10.569 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.570+0000 7f81fab3c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:10.570 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.571+0000 7f81fab3c800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:47:10.570 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.571+0000 7f81fab3c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:10.570 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.571+0000 7f81fab3c800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:47:10.570 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.571+0000 7f81fab3c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:47:10.571 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.571+0000 7f81fab3c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:10.571 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.572+0000 7f81fab3c800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:47:10.571 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.572+0000 7f81fab3c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:10.571 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.572+0000 7f81fab3c800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:47:10.571 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.572+0000 7f81fab3c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:47:10.572 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.574+0000 7f80ad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:10.574 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.576+0000 7f81fab3c800 20 remove_watcher() i=0 2024-09-14T10:47:10.574 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.576+0000 7f81fab3c800 2 removed watcher, disabling cache 2024-09-14T10:47:10.575 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.577+0000 7f81fab3c800 20 remove_watcher() i=1 2024-09-14T10:47:10.576 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.578+0000 7f81fab3c800 20 remove_watcher() i=2 2024-09-14T10:47:10.577 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.579+0000 7f81fab3c800 20 remove_watcher() i=3 2024-09-14T10:47:10.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.581+0000 7f81fab3c800 20 remove_watcher() i=4 2024-09-14T10:47:10.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.582+0000 7f81fab3c800 20 remove_watcher() i=5 2024-09-14T10:47:10.581 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.583+0000 7f81fab3c800 20 remove_watcher() i=6 2024-09-14T10:47:10.582 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.583+0000 7f81fab3c800 20 remove_watcher() i=7 2024-09-14T10:47:10.592 INFO:tasks.workunit.client.0.smithi097.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 82, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-09-14T10:47:10.592 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: bucket check unlinked does not report normal entries 2024-09-14T10:47:10.592 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T10:47:10.593 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-14T10:47:10.626 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:47:10.626 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:47:10.663 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.664+0000 7fc67e33c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:10.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.666+0000 7fc67e33c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:10.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.666+0000 7fc67e33c800 20 realm 2024-09-14T10:47:10.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.666+0000 7fc67e33c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:10.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.666+0000 7fc67e33c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:10.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.666+0000 7fc67e33c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:47:10.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.666+0000 7fc67e33c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:10.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.667+0000 7fc67e33c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:10.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.667+0000 7fc67e33c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:10.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.667+0000 7fc67e33c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:10.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.667+0000 7fc67e33c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:10.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.668+0000 7fc67e33c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:47:10.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.668+0000 7fc67e33c800 20 searching for the correct realm 2024-09-14T10:47:10.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.670+0000 7fc67a882640 0 -- 172.21.15.97:0/31287388 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7fc664009040 msgr2=0x7fc66406a5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T10:47:10.873 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.875+0000 7fc679880640 0 -- 172.21.15.97:0/31287388 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7fc674052930 msgr2=0x7fc674032420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:47:10.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.880+0000 7fc67e33c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:47:10.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.880+0000 7fc67e33c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:47:10.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.880+0000 7fc67e33c800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T10:47:10.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.880+0000 7fc67e33c800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T10:47:10.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.880+0000 7fc67e33c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:47:10.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.880+0000 7fc67e33c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:47:10.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.880+0000 7fc67e33c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:10.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.880+0000 7fc67e33c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:10.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.880+0000 7fc67e33c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:10.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.881+0000 7fc67e33c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:10.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.881+0000 7fc67e33c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:10.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.881+0000 7fc67e33c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:47:10.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.881+0000 7fc67e33c800 20 zone default found 2024-09-14T10:47:10.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.881+0000 7fc67e33c800 4 Realm: () 2024-09-14T10:47:10.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.881+0000 7fc67e33c800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T10:47:10.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.881+0000 7fc67e33c800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T10:47:10.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.881+0000 7fc67e33c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:47:10.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.881+0000 7fc67e33c800 20 zonegroup default 2024-09-14T10:47:10.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.881+0000 7fc67e33c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:10.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.882+0000 7fc67e33c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:10.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.882+0000 7fc67e33c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:10.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.882+0000 7fc67e33c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:10.882 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.882+0000 7fc67e33c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:10.882 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.882+0000 7fc67e33c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:10.882 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.882+0000 7fc67e33c800 20 started sync module instance, tier type = 2024-09-14T10:47:10.882 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.882+0000 7fc67e33c800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T10:47:10.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.892+0000 7fc67e33c800 20 add_watcher() i=0 2024-09-14T10:47:10.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.892+0000 7fc67e33c800 20 add_watcher() i=1 2024-09-14T10:47:10.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.892+0000 7fc67e33c800 20 add_watcher() i=2 2024-09-14T10:47:10.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.892+0000 7fc67e33c800 20 add_watcher() i=3 2024-09-14T10:47:10.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.892+0000 7fc67e33c800 20 add_watcher() i=4 2024-09-14T10:47:10.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.892+0000 7fc67e33c800 20 add_watcher() i=5 2024-09-14T10:47:10.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.893+0000 7fc67e33c800 20 add_watcher() i=6 2024-09-14T10:47:10.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.894+0000 7fc67e33c800 20 add_watcher() i=7 2024-09-14T10:47:10.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.894+0000 7fc67e33c800 2 all 8 watchers are set, enabling cache 2024-09-14T10:47:10.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.896+0000 7fc530fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:10.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.896+0000 7fc67e33c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:47:10.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.896+0000 7fc67e33c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:47:10.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.896+0000 7fc67e33c800 5 note: GC not initialized 2024-09-14T10:47:10.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.896+0000 7fc4ab7fe640 20 reqs_thread_entry: start 2024-09-14T10:47:10.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.896+0000 7fc67e33c800 20 init_complete bucket index max shards: 11 2024-09-14T10:47:10.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.897+0000 7fc67e33c800 20 Filter name: none 2024-09-14T10:47:10.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.897+0000 7fc4a97fa640 20 reqs_thread_entry: start 2024-09-14T10:47:10.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.897+0000 7fc67e33c800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T10:47:10.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.897+0000 7fc67e33c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:10.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.897+0000 7fc67e33c800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:47:10.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.897+0000 7fc67e33c800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T10:47:10.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.897+0000 7fc67e33c800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T10:47:10.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.897+0000 7fc67e33c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1 : miss 2024-09-14T10:47:10.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.897+0000 7fc67e33c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:10.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.897+0000 7fc67e33c800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:47:10.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.898+0000 7fc67e33c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1 info.flags=0x17 2024-09-14T10:47:10.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.898+0000 7fc67e33c800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1 to cache LRU end 2024-09-14T10:47:10.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.898+0000 7fc67e33c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:47:10.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.898+0000 7fc67e33c800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T10:47:10.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.898+0000 7fc67e33c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1 2024-09-14T10:47:10.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.898+0000 7fc67e33c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.0 2024-09-14T10:47:10.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.898+0000 7fc67e33c800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T10:47:10.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.898+0000 7fc67e33c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.1 2024-09-14T10:47:10.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.898+0000 7fc67e33c800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T10:47:10.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.899+0000 7fc67e33c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.2 2024-09-14T10:47:10.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.899+0000 7fc67e33c800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T10:47:10.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.899+0000 7fc67e33c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.3 2024-09-14T10:47:10.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.900+0000 7fc67e33c800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T10:47:10.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.900+0000 7fc67e33c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.4 2024-09-14T10:47:10.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.900+0000 7fc67e33c800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T10:47:10.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.900+0000 7fc67e33c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.5 2024-09-14T10:47:10.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.901+0000 7fc67e33c800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-14T10:47:10.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.901+0000 7fc67e33c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.6 2024-09-14T10:47:10.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.901+0000 7fc67e33c800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T10:47:10.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.901+0000 7fc67e33c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.7 2024-09-14T10:47:10.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.902+0000 7fc67e33c800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T10:47:10.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.902+0000 7fc67e33c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.8 2024-09-14T10:47:10.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.902+0000 7fc67e33c800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-14T10:47:10.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.902+0000 7fc67e33c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.9 2024-09-14T10:47:10.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.903+0000 7fc67e33c800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T10:47:10.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.903+0000 7fc67e33c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.10 2024-09-14T10:47:10.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.903+0000 7fc67e33c800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T10:47:10.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.903+0000 7fc67e33c800 1 NOTICE: finished all shards (0 entries found) 2024-09-14T10:47:10.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.904+0000 7fc530fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:10.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.906+0000 7fc67e33c800 20 remove_watcher() i=0 2024-09-14T10:47:10.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.906+0000 7fc67e33c800 2 removed watcher, disabling cache 2024-09-14T10:47:10.905 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.907+0000 7fc67e33c800 20 remove_watcher() i=1 2024-09-14T10:47:10.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.908+0000 7fc67e33c800 20 remove_watcher() i=2 2024-09-14T10:47:10.907 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.909+0000 7fc67e33c800 20 remove_watcher() i=3 2024-09-14T10:47:10.908 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.910+0000 7fc67e33c800 20 remove_watcher() i=4 2024-09-14T10:47:10.909 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.911+0000 7fc67e33c800 20 remove_watcher() i=5 2024-09-14T10:47:10.910 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.912+0000 7fc67e33c800 20 remove_watcher() i=6 2024-09-14T10:47:10.912 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:10.913+0000 7fc67e33c800 20 remove_watcher() i=7 2024-09-14T10:47:10.923 INFO:tasks.workunit.client.0.smithi097.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T10:47:11.313 INFO:tasks.workunit.client.0.smithi097.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-14T10:47:12.762 INFO:tasks.workunit.client.0.smithi097.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T10:47:12.763 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T10:47:12.798 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:47:12.798 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:47:12.840 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.842+0000 7f749c020800 20 rados->read ofs=0 len=0 2024-09-14T10:47:12.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.844+0000 7f749c020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:12.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.844+0000 7f749c020800 20 realm 2024-09-14T10:47:12.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.844+0000 7f749c020800 20 rados->read ofs=0 len=0 2024-09-14T10:47:12.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.844+0000 7f749c020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:12.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.844+0000 7f749c020800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:47:12.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.844+0000 7f749c020800 20 rados->read ofs=0 len=0 2024-09-14T10:47:12.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.844+0000 7f749c020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:12.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.844+0000 7f749c020800 20 rados->read ofs=0 len=0 2024-09-14T10:47:12.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.845+0000 7f749c020800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:12.844 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.845+0000 7f749c020800 20 rados->read ofs=0 len=0 2024-09-14T10:47:12.844 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.846+0000 7f749c020800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:47:12.844 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.846+0000 7f749c020800 20 searching for the correct realm 2024-09-14T10:47:12.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.848+0000 7f749a30b640 0 -- 172.21.15.97:0/3027135982 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x559f98bbc410 msgr2=0x559f98bbe820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:47:12.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.852+0000 7f7499b0a640 0 -- 172.21.15.97:0/3027135982 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7f74900c13e0 msgr2=0x7f74900b4040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:47:12.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.857+0000 7f749c020800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:47:12.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.857+0000 7f749c020800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:47:12.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.857+0000 7f749c020800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T10:47:12.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.857+0000 7f749c020800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T10:47:12.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.857+0000 7f749c020800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:47:12.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.857+0000 7f749c020800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:47:12.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.857+0000 7f749c020800 20 rados->read ofs=0 len=0 2024-09-14T10:47:12.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.857+0000 7f749c020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:12.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.857+0000 7f749c020800 20 rados->read ofs=0 len=0 2024-09-14T10:47:12.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.857+0000 7f749c020800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:12.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.857+0000 7f749c020800 20 rados->read ofs=0 len=0 2024-09-14T10:47:12.858 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.858+0000 7f749c020800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:47:12.858 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.858+0000 7f749c020800 20 zone default found 2024-09-14T10:47:12.858 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.858+0000 7f749c020800 4 Realm: () 2024-09-14T10:47:12.858 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.858+0000 7f749c020800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T10:47:12.858 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.858+0000 7f749c020800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T10:47:12.858 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.858+0000 7f749c020800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:47:12.858 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.858+0000 7f749c020800 20 zonegroup default 2024-09-14T10:47:12.858 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.858+0000 7f749c020800 20 rados->read ofs=0 len=0 2024-09-14T10:47:12.858 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.858+0000 7f749c020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:12.858 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.858+0000 7f749c020800 20 rados->read ofs=0 len=0 2024-09-14T10:47:12.858 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.858+0000 7f749c020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:12.859 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.859+0000 7f749c020800 20 rados->read ofs=0 len=0 2024-09-14T10:47:12.859 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.859+0000 7f749c020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:12.859 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.859+0000 7f749c020800 20 started sync module instance, tier type = 2024-09-14T10:47:12.859 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.859+0000 7f749c020800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T10:47:12.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.870+0000 7f749c020800 20 add_watcher() i=0 2024-09-14T10:47:12.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.870+0000 7f749c020800 20 add_watcher() i=1 2024-09-14T10:47:12.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.870+0000 7f749c020800 20 add_watcher() i=2 2024-09-14T10:47:12.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.870+0000 7f749c020800 20 add_watcher() i=3 2024-09-14T10:47:12.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.870+0000 7f749c020800 20 add_watcher() i=4 2024-09-14T10:47:12.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.870+0000 7f749c020800 20 add_watcher() i=5 2024-09-14T10:47:12.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.870+0000 7f749c020800 20 add_watcher() i=6 2024-09-14T10:47:12.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.871+0000 7f749c020800 20 add_watcher() i=7 2024-09-14T10:47:12.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.871+0000 7f749c020800 2 all 8 watchers are set, enabling cache 2024-09-14T10:47:12.871 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.873+0000 7f733b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:12.873 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.873+0000 7f749c020800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:47:12.873 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.873+0000 7f749c020800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:47:12.873 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.873+0000 7f749c020800 5 note: GC not initialized 2024-09-14T10:47:12.873 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.874+0000 7f733a7fc640 20 reqs_thread_entry: start 2024-09-14T10:47:12.873 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.874+0000 7f749c020800 20 init_complete bucket index max shards: 11 2024-09-14T10:47:12.873 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.874+0000 7f749c020800 20 Filter name: none 2024-09-14T10:47:12.873 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.874+0000 7f72bffff640 20 reqs_thread_entry: start 2024-09-14T10:47:12.873 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.874+0000 7f749c020800 20 rados->read ofs=0 len=0 2024-09-14T10:47:12.873 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.874+0000 7f749c020800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:47:12.873 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.874+0000 7f749c020800 20 rados->read ofs=0 len=0 2024-09-14T10:47:12.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.875+0000 7f749c020800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:47:12.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.875+0000 7f749c020800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:47:12.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.875+0000 7f749c020800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T10:47:12.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.875+0000 7f749c020800 20 INFO: main: starting shard=0 2024-09-14T10:47:12.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.875+0000 7f749c020800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.0 2024-09-14T10:47:12.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.875+0000 7f749c020800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:12.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.875+0000 7f749c020800 20 INFO: main: starting shard=1 2024-09-14T10:47:12.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.875+0000 7f749c020800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.1 2024-09-14T10:47:12.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.876+0000 7f749c020800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:12.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.876+0000 7f749c020800 20 INFO: main: starting shard=2 2024-09-14T10:47:12.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.876+0000 7f749c020800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.2 2024-09-14T10:47:12.876 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.876+0000 7f749c020800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:12.876 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.876+0000 7f749c020800 20 INFO: main: starting shard=3 2024-09-14T10:47:12.876 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.876+0000 7f749c020800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.3 2024-09-14T10:47:12.876 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.877+0000 7f749c020800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:12.876 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.877+0000 7f749c020800 20 INFO: main: starting shard=4 2024-09-14T10:47:12.876 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.877+0000 7f749c020800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.4 2024-09-14T10:47:12.876 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.877+0000 7f749c020800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:12.876 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.877+0000 7f749c020800 20 INFO: main: starting shard=5 2024-09-14T10:47:12.876 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.877+0000 7f749c020800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.5 2024-09-14T10:47:12.877 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.878+0000 7f749c020800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:12.877 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.878+0000 7f749c020800 20 INFO: main: starting shard=6 2024-09-14T10:47:12.877 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.878+0000 7f749c020800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.6 2024-09-14T10:47:12.877 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.878+0000 7f749c020800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:12.877 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.878+0000 7f749c020800 20 INFO: main: starting shard=7 2024-09-14T10:47:12.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.878+0000 7f749c020800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.7 2024-09-14T10:47:12.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.879+0000 7f749c020800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:12.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.879+0000 7f749c020800 20 INFO: main: starting shard=8 2024-09-14T10:47:12.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.879+0000 7f749c020800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.8 2024-09-14T10:47:12.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.880+0000 7f749c020800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T10:47:12.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.880+0000 7f749c020800 20 INFO: main: starting shard=9 2024-09-14T10:47:12.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.880+0000 7f749c020800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.9 2024-09-14T10:47:12.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.880+0000 7f749c020800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:12.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.880+0000 7f749c020800 20 INFO: main: starting shard=10 2024-09-14T10:47:12.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.880+0000 7f749c020800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.10 2024-09-14T10:47:12.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.881+0000 7f749c020800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:12.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.881+0000 7f749c020800 20 INFO: main: done 2024-09-14T10:47:12.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.882+0000 7f733b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:12.883 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.885+0000 7f749c020800 20 remove_watcher() i=0 2024-09-14T10:47:12.884 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.885+0000 7f749c020800 2 removed watcher, disabling cache 2024-09-14T10:47:12.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.886+0000 7f749c020800 20 remove_watcher() i=1 2024-09-14T10:47:12.886 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.887+0000 7f749c020800 20 remove_watcher() i=2 2024-09-14T10:47:12.887 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.889+0000 7f749c020800 20 remove_watcher() i=3 2024-09-14T10:47:12.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.890+0000 7f749c020800 20 remove_watcher() i=4 2024-09-14T10:47:12.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.891+0000 7f749c020800 20 remove_watcher() i=5 2024-09-14T10:47:12.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.892+0000 7f749c020800 20 remove_watcher() i=6 2024-09-14T10:47:12.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:12.894+0000 7f749c020800 20 remove_watcher() i=7 2024-09-14T10:47:12.958 INFO:tasks.workunit.client.0.smithi097.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T10:47:12.959 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T10:47:12.993 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:47:12.993 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:47:13.026 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.028+0000 7fd3b3b25800 20 rados->read ofs=0 len=0 2024-09-14T10:47:13.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.030+0000 7fd3b3b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:13.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.030+0000 7fd3b3b25800 20 realm 2024-09-14T10:47:13.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.030+0000 7fd3b3b25800 20 rados->read ofs=0 len=0 2024-09-14T10:47:13.031 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.030+0000 7fd3b3b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:13.031 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.030+0000 7fd3b3b25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:47:13.031 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.030+0000 7fd3b3b25800 20 rados->read ofs=0 len=0 2024-09-14T10:47:13.031 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.030+0000 7fd3b3b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:13.031 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.030+0000 7fd3b3b25800 20 rados->read ofs=0 len=0 2024-09-14T10:47:13.031 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.031+0000 7fd3b3b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:13.031 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.031+0000 7fd3b3b25800 20 rados->read ofs=0 len=0 2024-09-14T10:47:13.031 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.032+0000 7fd3b3b25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:47:13.031 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.032+0000 7fd3b3b25800 20 searching for the correct realm 2024-09-14T10:47:13.033 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.034+0000 7fd3aff34640 0 -- 172.21.15.97:0/726200179 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7fd398097120 msgr2=0x7fd3980a7720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:47:13.238 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.239+0000 7fd3a6f32640 0 -- 172.21.15.97:0/726200179 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7fd3a00313f0 msgr2=0x7fd3a0031870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:47:13.243 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.244+0000 7fd3b3b25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:47:13.243 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.244+0000 7fd3b3b25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:47:13.243 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.244+0000 7fd3b3b25800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T10:47:13.243 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.244+0000 7fd3b3b25800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T10:47:13.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.244+0000 7fd3b3b25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:47:13.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.244+0000 7fd3b3b25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:47:13.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.244+0000 7fd3b3b25800 20 rados->read ofs=0 len=0 2024-09-14T10:47:13.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.245+0000 7fd3b3b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:13.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.245+0000 7fd3b3b25800 20 rados->read ofs=0 len=0 2024-09-14T10:47:13.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.245+0000 7fd3b3b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:13.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.245+0000 7fd3b3b25800 20 rados->read ofs=0 len=0 2024-09-14T10:47:13.245 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.245+0000 7fd3b3b25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:47:13.245 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.245+0000 7fd3b3b25800 20 zone default found 2024-09-14T10:47:13.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.245+0000 7fd3b3b25800 4 Realm: () 2024-09-14T10:47:13.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.245+0000 7fd3b3b25800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T10:47:13.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.245+0000 7fd3b3b25800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T10:47:13.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.245+0000 7fd3b3b25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:47:13.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.245+0000 7fd3b3b25800 20 zonegroup default 2024-09-14T10:47:13.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.245+0000 7fd3b3b25800 20 rados->read ofs=0 len=0 2024-09-14T10:47:13.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.246+0000 7fd3b3b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:13.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.246+0000 7fd3b3b25800 20 rados->read ofs=0 len=0 2024-09-14T10:47:13.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.246+0000 7fd3b3b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:13.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.246+0000 7fd3b3b25800 20 rados->read ofs=0 len=0 2024-09-14T10:47:13.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.246+0000 7fd3b3b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:13.247 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.246+0000 7fd3b3b25800 20 started sync module instance, tier type = 2024-09-14T10:47:13.247 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.246+0000 7fd3b3b25800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T10:47:13.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.263+0000 7fd3b3b25800 20 add_watcher() i=0 2024-09-14T10:47:13.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.263+0000 7fd3b3b25800 20 add_watcher() i=1 2024-09-14T10:47:13.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.263+0000 7fd3b3b25800 20 add_watcher() i=2 2024-09-14T10:47:13.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.263+0000 7fd3b3b25800 20 add_watcher() i=3 2024-09-14T10:47:13.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.263+0000 7fd3b3b25800 20 add_watcher() i=4 2024-09-14T10:47:13.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.263+0000 7fd3b3b25800 20 add_watcher() i=5 2024-09-14T10:47:13.264 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.265+0000 7fd3b3b25800 20 add_watcher() i=6 2024-09-14T10:47:13.266 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.268+0000 7fd3b3b25800 20 add_watcher() i=7 2024-09-14T10:47:13.266 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.268+0000 7fd3b3b25800 2 all 8 watchers are set, enabling cache 2024-09-14T10:47:13.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.270+0000 7fd265fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:13.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.270+0000 7fd3b3b25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:47:13.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.270+0000 7fd3b3b25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:47:13.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.270+0000 7fd3b3b25800 5 note: GC not initialized 2024-09-14T10:47:13.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.270+0000 7fd264fe1640 20 reqs_thread_entry: start 2024-09-14T10:47:13.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.270+0000 7fd3b3b25800 20 init_complete bucket index max shards: 11 2024-09-14T10:47:13.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.270+0000 7fd3b3b25800 20 Filter name: none 2024-09-14T10:47:13.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.271+0000 7fd1de7fc640 20 reqs_thread_entry: start 2024-09-14T10:47:13.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.271+0000 7fd3b3b25800 20 rados->read ofs=0 len=0 2024-09-14T10:47:13.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.271+0000 7fd3b3b25800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:47:13.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.271+0000 7fd3b3b25800 20 rados->read ofs=0 len=0 2024-09-14T10:47:13.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.271+0000 7fd3b3b25800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:47:13.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.271+0000 7fd3b3b25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:47:13.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.271+0000 7fd3b3b25800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T10:47:13.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.271+0000 7fd3b3b25800 20 INFO: main: starting shard=0 2024-09-14T10:47:13.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.271+0000 7fd3b3b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.0 2024-09-14T10:47:13.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.272+0000 7fd3b3b25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:13.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.272+0000 7fd3b3b25800 20 INFO: main: starting shard=1 2024-09-14T10:47:13.272 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.272+0000 7fd3b3b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.1 2024-09-14T10:47:13.272 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.272+0000 7fd3b3b25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:13.272 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.272+0000 7fd3b3b25800 20 INFO: main: starting shard=2 2024-09-14T10:47:13.272 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.272+0000 7fd3b3b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.2 2024-09-14T10:47:13.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.273+0000 7fd3b3b25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:13.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.273+0000 7fd3b3b25800 20 INFO: main: starting shard=3 2024-09-14T10:47:13.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.273+0000 7fd3b3b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.3 2024-09-14T10:47:13.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.273+0000 7fd3b3b25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:13.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.273+0000 7fd3b3b25800 20 INFO: main: starting shard=4 2024-09-14T10:47:13.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.273+0000 7fd3b3b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.4 2024-09-14T10:47:13.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.274+0000 7fd3b3b25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:13.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.274+0000 7fd3b3b25800 20 INFO: main: starting shard=5 2024-09-14T10:47:13.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.274+0000 7fd3b3b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.5 2024-09-14T10:47:13.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.274+0000 7fd3b3b25800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T10:47:13.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.274+0000 7fd3b3b25800 20 INFO: main: starting shard=6 2024-09-14T10:47:13.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.274+0000 7fd3b3b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.6 2024-09-14T10:47:13.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.275+0000 7fd3b3b25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:13.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.275+0000 7fd3b3b25800 20 INFO: main: starting shard=7 2024-09-14T10:47:13.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.275+0000 7fd3b3b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.7 2024-09-14T10:47:13.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.275+0000 7fd3b3b25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:13.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.275+0000 7fd3b3b25800 20 INFO: main: starting shard=8 2024-09-14T10:47:13.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.275+0000 7fd3b3b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.8 2024-09-14T10:47:13.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.276+0000 7fd3b3b25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:13.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.276+0000 7fd3b3b25800 20 INFO: main: starting shard=9 2024-09-14T10:47:13.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.276+0000 7fd3b3b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.9 2024-09-14T10:47:13.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.276+0000 7fd3b3b25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:13.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.276+0000 7fd3b3b25800 20 INFO: main: starting shard=10 2024-09-14T10:47:13.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.276+0000 7fd3b3b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.10 2024-09-14T10:47:13.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.277+0000 7fd3b3b25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:13.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.277+0000 7fd3b3b25800 20 INFO: main: done 2024-09-14T10:47:13.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.277+0000 7fd265fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:13.278 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.280+0000 7fd3b3b25800 20 remove_watcher() i=0 2024-09-14T10:47:13.278 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.280+0000 7fd3b3b25800 2 removed watcher, disabling cache 2024-09-14T10:47:13.279 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.281+0000 7fd3b3b25800 20 remove_watcher() i=1 2024-09-14T10:47:13.281 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.282+0000 7fd3b3b25800 20 remove_watcher() i=2 2024-09-14T10:47:13.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.284+0000 7fd3b3b25800 20 remove_watcher() i=3 2024-09-14T10:47:13.284 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.285+0000 7fd3b3b25800 20 remove_watcher() i=4 2024-09-14T10:47:13.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.286+0000 7fd3b3b25800 20 remove_watcher() i=5 2024-09-14T10:47:13.286 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.288+0000 7fd3b3b25800 20 remove_watcher() i=6 2024-09-14T10:47:13.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.290+0000 7fd3b3b25800 20 remove_watcher() i=7 2024-09-14T10:47:13.358 INFO:tasks.workunit.client.0.smithi097.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T10:47:13.360 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-14T10:47:13.390 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:47:13.390 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:47:13.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.429+0000 7f31cc698800 20 rados->read ofs=0 len=0 2024-09-14T10:47:13.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.431+0000 7f31cc698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:13.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.431+0000 7f31cc698800 20 realm 2024-09-14T10:47:13.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.431+0000 7f31cc698800 20 rados->read ofs=0 len=0 2024-09-14T10:47:13.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.431+0000 7f31cc698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:13.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.431+0000 7f31cc698800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:47:13.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.431+0000 7f31cc698800 20 rados->read ofs=0 len=0 2024-09-14T10:47:13.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.431+0000 7f31cc698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:13.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.431+0000 7f31cc698800 20 rados->read ofs=0 len=0 2024-09-14T10:47:13.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.432+0000 7f31cc698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:13.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.432+0000 7f31cc698800 20 rados->read ofs=0 len=0 2024-09-14T10:47:13.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.433+0000 7f31cc698800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:47:13.433 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.433+0000 7f31cc698800 20 searching for the correct realm 2024-09-14T10:47:13.433 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.435+0000 7f31ca983640 0 -- 172.21.15.97:0/1901838817 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f31b4016020 msgr2=0x7f31b4048ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:47:13.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.639+0000 7f31c3fff640 0 -- 172.21.15.97:0/1901838817 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f31bc009040 msgr2=0x7f31bc01f8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:47:13.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.645+0000 7f31cc698800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:47:13.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.645+0000 7f31cc698800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:47:13.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.645+0000 7f31cc698800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T10:47:13.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.645+0000 7f31cc698800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T10:47:13.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.645+0000 7f31cc698800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:47:13.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.645+0000 7f31cc698800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:47:13.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.645+0000 7f31cc698800 20 rados->read ofs=0 len=0 2024-09-14T10:47:13.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.645+0000 7f31cc698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:13.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.645+0000 7f31cc698800 20 rados->read ofs=0 len=0 2024-09-14T10:47:13.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.645+0000 7f31cc698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:13.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.645+0000 7f31cc698800 20 rados->read ofs=0 len=0 2024-09-14T10:47:13.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.646+0000 7f31cc698800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:47:13.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.646+0000 7f31cc698800 20 zone default found 2024-09-14T10:47:13.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.646+0000 7f31cc698800 4 Realm: () 2024-09-14T10:47:13.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.646+0000 7f31cc698800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T10:47:13.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.646+0000 7f31cc698800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T10:47:13.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.646+0000 7f31cc698800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:47:13.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.646+0000 7f31cc698800 20 zonegroup default 2024-09-14T10:47:13.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.646+0000 7f31cc698800 20 rados->read ofs=0 len=0 2024-09-14T10:47:13.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.646+0000 7f31cc698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:13.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.646+0000 7f31cc698800 20 rados->read ofs=0 len=0 2024-09-14T10:47:13.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.646+0000 7f31cc698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:13.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.646+0000 7f31cc698800 20 rados->read ofs=0 len=0 2024-09-14T10:47:13.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.647+0000 7f31cc698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:13.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.647+0000 7f31cc698800 20 started sync module instance, tier type = 2024-09-14T10:47:13.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.647+0000 7f31cc698800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T10:47:13.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.659+0000 7f31cc698800 20 add_watcher() i=0 2024-09-14T10:47:13.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.659+0000 7f31cc698800 20 add_watcher() i=1 2024-09-14T10:47:13.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.659+0000 7f31cc698800 20 add_watcher() i=2 2024-09-14T10:47:13.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.659+0000 7f31cc698800 20 add_watcher() i=3 2024-09-14T10:47:13.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.659+0000 7f31cc698800 20 add_watcher() i=4 2024-09-14T10:47:13.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.659+0000 7f31cc698800 20 add_watcher() i=5 2024-09-14T10:47:13.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.659+0000 7f31cc698800 20 add_watcher() i=6 2024-09-14T10:47:13.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.662+0000 7f31cc698800 20 add_watcher() i=7 2024-09-14T10:47:13.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.662+0000 7f31cc698800 2 all 8 watchers are set, enabling cache 2024-09-14T10:47:13.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.663+0000 7f3080fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:13.663 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.664+0000 7f31cc698800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:47:13.663 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.664+0000 7f31cc698800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:47:13.663 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.664+0000 7f31cc698800 5 note: GC not initialized 2024-09-14T10:47:13.663 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.664+0000 7f2ffb7fe640 20 reqs_thread_entry: start 2024-09-14T10:47:13.663 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.664+0000 7f31cc698800 20 init_complete bucket index max shards: 11 2024-09-14T10:47:13.663 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.664+0000 7f31cc698800 20 Filter name: none 2024-09-14T10:47:13.663 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.664+0000 7f2ff97fa640 20 reqs_thread_entry: start 2024-09-14T10:47:13.663 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.664+0000 7f31cc698800 20 rados->read ofs=0 len=0 2024-09-14T10:47:13.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.665+0000 7f31cc698800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:47:13.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.665+0000 7f31cc698800 20 rados->read ofs=0 len=0 2024-09-14T10:47:13.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.665+0000 7f31cc698800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:47:13.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.665+0000 7f31cc698800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:47:13.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.665+0000 7f31cc698800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T10:47:13.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.665+0000 7f31cc698800 20 INFO: main: starting shard=0 2024-09-14T10:47:13.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.665+0000 7f31cc698800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.0 2024-09-14T10:47:13.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.666+0000 7f31cc698800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:13.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.666+0000 7f31cc698800 20 INFO: main: starting shard=1 2024-09-14T10:47:13.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.666+0000 7f31cc698800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.1 2024-09-14T10:47:13.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.666+0000 7f31cc698800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T10:47:13.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.666+0000 7f31cc698800 20 INFO: main: starting shard=2 2024-09-14T10:47:13.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.666+0000 7f31cc698800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.2 2024-09-14T10:47:13.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.667+0000 7f31cc698800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:13.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.667+0000 7f31cc698800 20 INFO: main: starting shard=3 2024-09-14T10:47:13.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.667+0000 7f31cc698800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.3 2024-09-14T10:47:13.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.668+0000 7f31cc698800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:13.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.668+0000 7f31cc698800 20 INFO: main: starting shard=4 2024-09-14T10:47:13.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.668+0000 7f31cc698800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.4 2024-09-14T10:47:13.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.668+0000 7f31cc698800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:13.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.668+0000 7f31cc698800 20 INFO: main: starting shard=5 2024-09-14T10:47:13.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.668+0000 7f31cc698800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.5 2024-09-14T10:47:13.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.669+0000 7f31cc698800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:13.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.669+0000 7f31cc698800 20 INFO: main: starting shard=6 2024-09-14T10:47:13.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.669+0000 7f31cc698800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.6 2024-09-14T10:47:13.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.669+0000 7f31cc698800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:13.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.669+0000 7f31cc698800 20 INFO: main: starting shard=7 2024-09-14T10:47:13.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.669+0000 7f31cc698800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.7 2024-09-14T10:47:13.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.670+0000 7f31cc698800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:13.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.670+0000 7f31cc698800 20 INFO: main: starting shard=8 2024-09-14T10:47:13.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.670+0000 7f31cc698800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.8 2024-09-14T10:47:13.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.670+0000 7f31cc698800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:13.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.670+0000 7f31cc698800 20 INFO: main: starting shard=9 2024-09-14T10:47:13.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.670+0000 7f31cc698800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.9 2024-09-14T10:47:13.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.671+0000 7f31cc698800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:13.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.671+0000 7f31cc698800 20 INFO: main: starting shard=10 2024-09-14T10:47:13.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.671+0000 7f31cc698800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.10 2024-09-14T10:47:13.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.671+0000 7f31cc698800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:13.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.671+0000 7f31cc698800 20 INFO: main: done 2024-09-14T10:47:13.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.672+0000 7f3080fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:13.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.674+0000 7f31cc698800 20 remove_watcher() i=0 2024-09-14T10:47:13.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.674+0000 7f31cc698800 2 removed watcher, disabling cache 2024-09-14T10:47:13.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.676+0000 7f31cc698800 20 remove_watcher() i=1 2024-09-14T10:47:13.675 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.677+0000 7f31cc698800 20 remove_watcher() i=2 2024-09-14T10:47:13.676 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.678+0000 7f31cc698800 20 remove_watcher() i=3 2024-09-14T10:47:13.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.679+0000 7f31cc698800 20 remove_watcher() i=4 2024-09-14T10:47:13.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.680+0000 7f31cc698800 20 remove_watcher() i=5 2024-09-14T10:47:13.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.681+0000 7f31cc698800 20 remove_watcher() i=6 2024-09-14T10:47:13.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.684+0000 7f31cc698800 20 remove_watcher() i=7 2024-09-14T10:47:13.749 INFO:tasks.workunit.client.0.smithi097.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T10:47:13.750 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-14T10:47:13.780 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:47:13.781 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:47:13.817 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.819+0000 7fb048d0c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:13.819 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.821+0000 7fb048d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:13.819 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.821+0000 7fb048d0c800 20 realm 2024-09-14T10:47:13.820 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.821+0000 7fb048d0c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:13.820 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.821+0000 7fb048d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:13.820 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.821+0000 7fb048d0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:47:13.820 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.821+0000 7fb048d0c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:13.820 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.821+0000 7fb048d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:13.820 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.821+0000 7fb048d0c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:13.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.822+0000 7fb048d0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:13.822 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.822+0000 7fb048d0c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:13.822 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.823+0000 7fb048d0c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:47:13.822 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.823+0000 7fb048d0c800 20 searching for the correct realm 2024-09-14T10:47:13.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.825+0000 7fb046ff7640 0 -- 172.21.15.97:0/2856710690 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7fb03007b040 msgr2=0x7fb030065930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T10:47:13.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.829+0000 7fb03ffff640 0 -- 172.21.15.97:0/2856710690 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7fb0380736d0 msgr2=0x7fb0380730a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:47:13.833 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.834+0000 7fb048d0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:47:13.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.834+0000 7fb048d0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:47:13.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.834+0000 7fb048d0c800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T10:47:13.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.834+0000 7fb048d0c800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T10:47:13.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.834+0000 7fb048d0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:47:13.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.834+0000 7fb048d0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:47:13.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.834+0000 7fb048d0c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:13.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.834+0000 7fb048d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:13.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.834+0000 7fb048d0c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:13.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.834+0000 7fb048d0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:13.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.834+0000 7fb048d0c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:13.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.835+0000 7fb048d0c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:47:13.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.835+0000 7fb048d0c800 20 zone default found 2024-09-14T10:47:13.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.835+0000 7fb048d0c800 4 Realm: () 2024-09-14T10:47:13.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.835+0000 7fb048d0c800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T10:47:13.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.835+0000 7fb048d0c800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T10:47:13.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.835+0000 7fb048d0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:47:13.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.835+0000 7fb048d0c800 20 zonegroup default 2024-09-14T10:47:13.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.835+0000 7fb048d0c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:13.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.835+0000 7fb048d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:13.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.835+0000 7fb048d0c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:13.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.835+0000 7fb048d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:13.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.835+0000 7fb048d0c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:13.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.836+0000 7fb048d0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:13.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.836+0000 7fb048d0c800 20 started sync module instance, tier type = 2024-09-14T10:47:13.837 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.836+0000 7fb048d0c800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T10:47:13.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.848+0000 7fb048d0c800 20 add_watcher() i=0 2024-09-14T10:47:13.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.848+0000 7fb048d0c800 20 add_watcher() i=1 2024-09-14T10:47:13.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.848+0000 7fb048d0c800 20 add_watcher() i=2 2024-09-14T10:47:13.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.848+0000 7fb048d0c800 20 add_watcher() i=3 2024-09-14T10:47:13.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.848+0000 7fb048d0c800 20 add_watcher() i=4 2024-09-14T10:47:13.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.848+0000 7fb048d0c800 20 add_watcher() i=5 2024-09-14T10:47:13.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.848+0000 7fb048d0c800 20 add_watcher() i=6 2024-09-14T10:47:13.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.849+0000 7fb048d0c800 20 add_watcher() i=7 2024-09-14T10:47:13.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.849+0000 7fb048d0c800 2 all 8 watchers are set, enabling cache 2024-09-14T10:47:13.849 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.851+0000 7faefcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:13.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.851+0000 7fb048d0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:47:13.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.851+0000 7fb048d0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:47:13.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.851+0000 7fb048d0c800 5 note: GC not initialized 2024-09-14T10:47:13.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.851+0000 7fae777fe640 20 reqs_thread_entry: start 2024-09-14T10:47:13.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.851+0000 7fb048d0c800 20 init_complete bucket index max shards: 11 2024-09-14T10:47:13.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.851+0000 7fb048d0c800 20 Filter name: none 2024-09-14T10:47:13.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.851+0000 7fae757fa640 20 reqs_thread_entry: start 2024-09-14T10:47:13.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.852+0000 7fb048d0c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:13.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.852+0000 7fb048d0c800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:47:13.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.852+0000 7fb048d0c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:13.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.852+0000 7fb048d0c800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:47:13.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.852+0000 7fb048d0c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:47:13.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.852+0000 7fb048d0c800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T10:47:13.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.852+0000 7fb048d0c800 20 INFO: main: starting shard=0 2024-09-14T10:47:13.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.852+0000 7fb048d0c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.0 2024-09-14T10:47:13.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.853+0000 7fb048d0c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:13.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.853+0000 7fb048d0c800 20 INFO: main: starting shard=1 2024-09-14T10:47:13.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.853+0000 7fb048d0c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.1 2024-09-14T10:47:13.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.853+0000 7fb048d0c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:13.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.853+0000 7fb048d0c800 20 INFO: main: starting shard=2 2024-09-14T10:47:13.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.853+0000 7fb048d0c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.2 2024-09-14T10:47:13.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.854+0000 7fb048d0c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:13.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.854+0000 7fb048d0c800 20 INFO: main: starting shard=3 2024-09-14T10:47:13.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.854+0000 7fb048d0c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.3 2024-09-14T10:47:13.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.854+0000 7fb048d0c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:13.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.854+0000 7fb048d0c800 20 INFO: main: starting shard=4 2024-09-14T10:47:13.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.854+0000 7fb048d0c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.4 2024-09-14T10:47:13.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.854+0000 7fb048d0c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:13.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.854+0000 7fb048d0c800 20 INFO: main: starting shard=5 2024-09-14T10:47:13.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.854+0000 7fb048d0c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.5 2024-09-14T10:47:13.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.855+0000 7fb048d0c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:13.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.855+0000 7fb048d0c800 20 INFO: main: starting shard=6 2024-09-14T10:47:13.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.855+0000 7fb048d0c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.6 2024-09-14T10:47:13.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.855+0000 7fb048d0c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:13.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.855+0000 7fb048d0c800 20 INFO: main: starting shard=7 2024-09-14T10:47:13.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.855+0000 7fb048d0c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.7 2024-09-14T10:47:13.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.856+0000 7fb048d0c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:13.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.856+0000 7fb048d0c800 20 INFO: main: starting shard=8 2024-09-14T10:47:13.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.856+0000 7fb048d0c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.8 2024-09-14T10:47:13.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.856+0000 7fb048d0c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:13.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.856+0000 7fb048d0c800 20 INFO: main: starting shard=9 2024-09-14T10:47:13.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.856+0000 7fb048d0c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.9 2024-09-14T10:47:13.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.857+0000 7fb048d0c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:13.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.857+0000 7fb048d0c800 20 INFO: main: starting shard=10 2024-09-14T10:47:13.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.857+0000 7fb048d0c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.10 2024-09-14T10:47:13.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.858+0000 7fb048d0c800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T10:47:13.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.858+0000 7fb048d0c800 20 INFO: main: done 2024-09-14T10:47:13.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.858+0000 7faefcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:13.859 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.861+0000 7fb048d0c800 20 remove_watcher() i=0 2024-09-14T10:47:13.859 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.861+0000 7fb048d0c800 2 removed watcher, disabling cache 2024-09-14T10:47:13.860 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.862+0000 7fb048d0c800 20 remove_watcher() i=1 2024-09-14T10:47:13.861 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.863+0000 7fb048d0c800 20 remove_watcher() i=2 2024-09-14T10:47:13.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.864+0000 7fb048d0c800 20 remove_watcher() i=3 2024-09-14T10:47:13.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.865+0000 7fb048d0c800 20 remove_watcher() i=4 2024-09-14T10:47:13.864 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.866+0000 7fb048d0c800 20 remove_watcher() i=5 2024-09-14T10:47:13.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.867+0000 7fb048d0c800 20 remove_watcher() i=6 2024-09-14T10:47:13.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:13.868+0000 7fb048d0c800 20 remove_watcher() i=7 2024-09-14T10:47:13.883 INFO:tasks.workunit.client.0.smithi097.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T10:47:14.277 INFO:tasks.workunit.client.0.smithi097.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-14T10:47:14.664 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: bucket check unlinked finds unlistable entries 2024-09-14T10:47:14.664 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T10:47:14.665 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-14T10:47:14.697 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:47:14.697 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:47:14.735 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.736+0000 7fc75832e800 20 rados->read ofs=0 len=0 2024-09-14T10:47:14.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.738+0000 7fc75832e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:14.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.738+0000 7fc75832e800 20 realm 2024-09-14T10:47:14.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.738+0000 7fc75832e800 20 rados->read ofs=0 len=0 2024-09-14T10:47:14.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.738+0000 7fc75832e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:14.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.738+0000 7fc75832e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:47:14.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.738+0000 7fc75832e800 20 rados->read ofs=0 len=0 2024-09-14T10:47:14.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.739+0000 7fc75832e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:14.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.739+0000 7fc75832e800 20 rados->read ofs=0 len=0 2024-09-14T10:47:14.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.739+0000 7fc75832e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:14.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.739+0000 7fc75832e800 20 rados->read ofs=0 len=0 2024-09-14T10:47:14.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.740+0000 7fc75832e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:47:14.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.740+0000 7fc75832e800 20 searching for the correct realm 2024-09-14T10:47:14.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.743+0000 7fc7548de640 0 -- 172.21.15.97:0/548822753 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7fc748039040 msgr2=0x7fc748020940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T10:47:14.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.949+0000 7fc7538dc640 0 -- 172.21.15.97:0/548822753 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7fc7440e60b0 msgr2=0x7fc7440aeda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:47:14.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.954+0000 7fc75832e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:47:14.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.954+0000 7fc75832e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:47:14.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.954+0000 7fc75832e800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T10:47:14.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.954+0000 7fc75832e800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T10:47:14.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.954+0000 7fc75832e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:47:14.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.954+0000 7fc75832e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:47:14.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.954+0000 7fc75832e800 20 rados->read ofs=0 len=0 2024-09-14T10:47:14.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.954+0000 7fc75832e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:14.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.954+0000 7fc75832e800 20 rados->read ofs=0 len=0 2024-09-14T10:47:14.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.955+0000 7fc75832e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:14.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.955+0000 7fc75832e800 20 rados->read ofs=0 len=0 2024-09-14T10:47:14.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.955+0000 7fc75832e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:47:14.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.955+0000 7fc75832e800 20 zone default found 2024-09-14T10:47:14.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.955+0000 7fc75832e800 4 Realm: () 2024-09-14T10:47:14.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.955+0000 7fc75832e800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T10:47:14.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.955+0000 7fc75832e800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T10:47:14.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.955+0000 7fc75832e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:47:14.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.955+0000 7fc75832e800 20 zonegroup default 2024-09-14T10:47:14.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.955+0000 7fc75832e800 20 rados->read ofs=0 len=0 2024-09-14T10:47:14.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.955+0000 7fc75832e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:14.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.955+0000 7fc75832e800 20 rados->read ofs=0 len=0 2024-09-14T10:47:14.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.956+0000 7fc75832e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:14.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.956+0000 7fc75832e800 20 rados->read ofs=0 len=0 2024-09-14T10:47:14.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.956+0000 7fc75832e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:14.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.956+0000 7fc75832e800 20 started sync module instance, tier type = 2024-09-14T10:47:14.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.956+0000 7fc75832e800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T10:47:14.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.970+0000 7fc75832e800 20 add_watcher() i=0 2024-09-14T10:47:14.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.970+0000 7fc75832e800 20 add_watcher() i=1 2024-09-14T10:47:14.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.970+0000 7fc75832e800 20 add_watcher() i=2 2024-09-14T10:47:14.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.970+0000 7fc75832e800 20 add_watcher() i=3 2024-09-14T10:47:14.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.970+0000 7fc75832e800 20 add_watcher() i=4 2024-09-14T10:47:14.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.970+0000 7fc75832e800 20 add_watcher() i=5 2024-09-14T10:47:14.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.970+0000 7fc75832e800 20 add_watcher() i=6 2024-09-14T10:47:14.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.971+0000 7fc75832e800 20 add_watcher() i=7 2024-09-14T10:47:14.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.971+0000 7fc75832e800 2 all 8 watchers are set, enabling cache 2024-09-14T10:47:14.971 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.973+0000 7fc60afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:14.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.973+0000 7fc75832e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:47:14.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.973+0000 7fc75832e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:47:14.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.973+0000 7fc75832e800 5 note: GC not initialized 2024-09-14T10:47:14.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.974+0000 7fc609fdb640 20 reqs_thread_entry: start 2024-09-14T10:47:14.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.974+0000 7fc75832e800 20 init_complete bucket index max shards: 11 2024-09-14T10:47:14.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.974+0000 7fc75832e800 20 Filter name: none 2024-09-14T10:47:14.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.974+0000 7fc57b7fe640 20 reqs_thread_entry: start 2024-09-14T10:47:14.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.974+0000 7fc75832e800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T10:47:14.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.974+0000 7fc75832e800 20 rados->read ofs=0 len=0 2024-09-14T10:47:14.974 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.974+0000 7fc75832e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:47:14.974 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.974+0000 7fc75832e800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T10:47:14.974 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.974+0000 7fc75832e800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T10:47:14.974 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.974+0000 7fc75832e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1 : miss 2024-09-14T10:47:14.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.974+0000 7fc75832e800 20 rados->read ofs=0 len=0 2024-09-14T10:47:14.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.975+0000 7fc75832e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:47:14.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.975+0000 7fc75832e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1 info.flags=0x17 2024-09-14T10:47:14.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.975+0000 7fc75832e800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1 to cache LRU end 2024-09-14T10:47:14.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.975+0000 7fc75832e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:47:14.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.975+0000 7fc75832e800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T10:47:14.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.975+0000 7fc75832e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1 2024-09-14T10:47:14.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.975+0000 7fc75832e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.0 2024-09-14T10:47:14.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.975+0000 7fc75832e800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T10:47:14.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.975+0000 7fc75832e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.1 2024-09-14T10:47:14.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.976+0000 7fc75832e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.2 2024-09-14T10:47:14.976 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.976+0000 7fc75832e800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T10:47:14.976 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.976+0000 7fc75832e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.3 2024-09-14T10:47:14.976 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.977+0000 7fc75832e800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T10:47:14.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.977+0000 7fc75832e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.4 2024-09-14T10:47:14.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.977+0000 7fc75832e800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T10:47:14.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.977+0000 7fc75832e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.5 2024-09-14T10:47:14.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.978+0000 7fc75832e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.6 2024-09-14T10:47:14.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.978+0000 7fc75832e800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T10:47:14.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.978+0000 7fc75832e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.7 2024-09-14T10:47:14.978 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.979+0000 7fc75832e800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T10:47:14.978 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.979+0000 7fc75832e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.8 2024-09-14T10:47:14.978 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.979+0000 7fc75832e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.9 2024-09-14T10:47:14.979 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.980+0000 7fc75832e800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T10:47:14.979 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.980+0000 7fc75832e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.10 2024-09-14T10:47:14.979 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.980+0000 7fc75832e800 1 NOTICE: finished shard 1 (1 entries found) 2024-09-14T10:47:14.979 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.980+0000 7fc75832e800 1 NOTICE: finished shard 5 (1 entries found) 2024-09-14T10:47:14.980 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.980+0000 7fc75832e800 1 NOTICE: finished shard 8 (1 entries found) 2024-09-14T10:47:14.980 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.981+0000 7fc75832e800 1 NOTICE: finished shard 10 (1 entries found) 2024-09-14T10:47:14.980 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.981+0000 7fc75832e800 1 NOTICE: finished all shards (4 entries found) 2024-09-14T10:47:14.980 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.982+0000 7fc60afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:14.982 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.984+0000 7fc75832e800 20 remove_watcher() i=0 2024-09-14T10:47:14.982 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.984+0000 7fc75832e800 2 removed watcher, disabling cache 2024-09-14T10:47:14.983 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.985+0000 7fc75832e800 20 remove_watcher() i=1 2024-09-14T10:47:14.984 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.986+0000 7fc75832e800 20 remove_watcher() i=2 2024-09-14T10:47:14.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.987+0000 7fc75832e800 20 remove_watcher() i=3 2024-09-14T10:47:14.986 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.988+0000 7fc75832e800 20 remove_watcher() i=4 2024-09-14T10:47:14.987 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.989+0000 7fc75832e800 20 remove_watcher() i=5 2024-09-14T10:47:14.989 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.991+0000 7fc75832e800 20 remove_watcher() i=6 2024-09-14T10:47:14.990 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:14.992+0000 7fc75832e800 20 remove_watcher() i=7 2024-09-14T10:47:15.001 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: unlinked entries are not listable 2024-09-14T10:47:15.001 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T10:47:15.008 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-09-14T10:47:15.008 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T10:47:15.097 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-09-14T10:47:15.097 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T10:47:15.098 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T10:47:15.134 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:47:15.134 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:47:15.171 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.173+0000 7f664320f800 20 rados->read ofs=0 len=0 2024-09-14T10:47:15.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.174+0000 7f664320f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:15.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.174+0000 7f664320f800 20 realm 2024-09-14T10:47:15.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.174+0000 7f664320f800 20 rados->read ofs=0 len=0 2024-09-14T10:47:15.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.174+0000 7f664320f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:15.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.174+0000 7f664320f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:47:15.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.174+0000 7f664320f800 20 rados->read ofs=0 len=0 2024-09-14T10:47:15.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.175+0000 7f664320f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:15.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.175+0000 7f664320f800 20 rados->read ofs=0 len=0 2024-09-14T10:47:15.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.175+0000 7f664320f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:15.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.175+0000 7f664320f800 20 rados->read ofs=0 len=0 2024-09-14T10:47:15.175 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.176+0000 7f664320f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:47:15.175 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.176+0000 7f664320f800 20 searching for the correct realm 2024-09-14T10:47:15.175 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.177+0000 7f66384f8640 0 -- 172.21.15.97:0/965189265 >> [v2:172.21.15.97:6808/2081705332,v1:172.21.15.97:6809/2081705332] conn(0x7f6630017950 msgr2=0x7f6630039410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:47:15.582 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.584+0000 7f6640cf9640 0 -- 172.21.15.97:0/965189265 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7f6628097450 msgr2=0x7f66280978b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T10:47:15.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.793+0000 7f664320f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:47:15.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.793+0000 7f664320f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:47:15.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.793+0000 7f664320f800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T10:47:15.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.793+0000 7f664320f800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T10:47:15.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.793+0000 7f664320f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:47:15.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.793+0000 7f664320f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:47:15.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.793+0000 7f664320f800 20 rados->read ofs=0 len=0 2024-09-14T10:47:15.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.793+0000 7f664320f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:15.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.793+0000 7f664320f800 20 rados->read ofs=0 len=0 2024-09-14T10:47:15.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.793+0000 7f664320f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:15.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.793+0000 7f664320f800 20 rados->read ofs=0 len=0 2024-09-14T10:47:15.793 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.794+0000 7f664320f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:47:15.793 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.794+0000 7f664320f800 20 zone default found 2024-09-14T10:47:15.793 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.794+0000 7f664320f800 4 Realm: () 2024-09-14T10:47:15.793 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.794+0000 7f664320f800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T10:47:15.793 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.794+0000 7f664320f800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T10:47:15.793 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.794+0000 7f664320f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:47:15.794 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.794+0000 7f664320f800 20 zonegroup default 2024-09-14T10:47:15.794 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.794+0000 7f664320f800 20 rados->read ofs=0 len=0 2024-09-14T10:47:15.794 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.794+0000 7f664320f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:15.794 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.794+0000 7f664320f800 20 rados->read ofs=0 len=0 2024-09-14T10:47:15.794 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.794+0000 7f664320f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:15.794 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.794+0000 7f664320f800 20 rados->read ofs=0 len=0 2024-09-14T10:47:15.794 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.795+0000 7f664320f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:15.794 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.795+0000 7f664320f800 20 started sync module instance, tier type = 2024-09-14T10:47:15.794 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.795+0000 7f664320f800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T10:47:15.810 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.812+0000 7f664320f800 20 add_watcher() i=0 2024-09-14T10:47:15.810 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.812+0000 7f664320f800 20 add_watcher() i=1 2024-09-14T10:47:15.810 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.812+0000 7f664320f800 20 add_watcher() i=2 2024-09-14T10:47:15.810 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.812+0000 7f664320f800 20 add_watcher() i=3 2024-09-14T10:47:15.810 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.812+0000 7f664320f800 20 add_watcher() i=4 2024-09-14T10:47:15.810 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.812+0000 7f664320f800 20 add_watcher() i=5 2024-09-14T10:47:15.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.812+0000 7f664320f800 20 add_watcher() i=6 2024-09-14T10:47:15.813 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.815+0000 7f664320f800 20 add_watcher() i=7 2024-09-14T10:47:15.813 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.815+0000 7f664320f800 2 all 8 watchers are set, enabling cache 2024-09-14T10:47:15.815 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.817+0000 7f64f77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:15.816 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.817+0000 7f664320f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:47:15.816 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.817+0000 7f664320f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:47:15.816 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.817+0000 7f664320f800 5 note: GC not initialized 2024-09-14T10:47:15.816 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.817+0000 7f64f67e4640 20 reqs_thread_entry: start 2024-09-14T10:47:15.816 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.817+0000 7f664320f800 20 init_complete bucket index max shards: 11 2024-09-14T10:47:15.816 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.817+0000 7f664320f800 20 Filter name: none 2024-09-14T10:47:15.816 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.817+0000 7f64ef7fe640 20 reqs_thread_entry: start 2024-09-14T10:47:15.816 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.818+0000 7f664320f800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T10:47:15.816 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.818+0000 7f664320f800 20 rados->read ofs=0 len=0 2024-09-14T10:47:15.817 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.818+0000 7f664320f800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:47:15.817 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.818+0000 7f664320f800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T10:47:15.818 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.818+0000 7f664320f800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T10:47:15.818 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.818+0000 7f664320f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1 : miss 2024-09-14T10:47:15.818 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.818+0000 7f664320f800 20 rados->read ofs=0 len=0 2024-09-14T10:47:15.818 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.818+0000 7f664320f800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:47:15.818 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.818+0000 7f664320f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1 info.flags=0x17 2024-09-14T10:47:15.818 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.818+0000 7f664320f800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1 to cache LRU end 2024-09-14T10:47:15.818 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.818+0000 7f664320f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:47:15.818 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.818+0000 7f664320f800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T10:47:15.818 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.818+0000 7f664320f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1 2024-09-14T10:47:15.818 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.819+0000 7f664320f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.0 2024-09-14T10:47:15.818 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.819+0000 7f664320f800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-14T10:47:15.818 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.819+0000 7f664320f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.1 2024-09-14T10:47:15.819 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.820+0000 7f664320f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.2 2024-09-14T10:47:15.819 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.820+0000 7f664320f800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-14T10:47:15.819 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.820+0000 7f664320f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.3 2024-09-14T10:47:15.819 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.821+0000 7f664320f800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-14T10:47:15.819 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.821+0000 7f664320f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.4 2024-09-14T10:47:15.819 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.821+0000 7f664320f800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-14T10:47:15.819 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.821+0000 7f664320f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.5 2024-09-14T10:47:15.820 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.821+0000 7f664320f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.6 2024-09-14T10:47:15.820 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.822+0000 7f664320f800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-14T10:47:15.820 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.822+0000 7f664320f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.7 2024-09-14T10:47:15.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.823+0000 7f664320f800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-14T10:47:15.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.823+0000 7f664320f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.8 2024-09-14T10:47:15.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.823+0000 7f664320f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.9 2024-09-14T10:47:15.822 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.824+0000 7f664320f800 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-14T10:47:15.822 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.824+0000 7f664320f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.10 2024-09-14T10:47:15.822 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.824+0000 7f664320f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.1 2024-09-14T10:47:15.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.825+0000 7f664320f800 20 get_obj_state: octx=0x5559ffaef380 obj=check-bucket:e state=0x5559ffdbb638 s->prefetch_data=0 2024-09-14T10:47:15.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.825+0000 7f664320f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.5 2024-09-14T10:47:15.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.825+0000 7f664320f800 20 get_obj_state: octx=0x5559ffb17550 obj=check-bucket:d state=0x5559ffdbddd8 s->prefetch_data=0 2024-09-14T10:47:15.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.825+0000 7f664320f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.8 2024-09-14T10:47:15.825 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.825+0000 7f664320f800 20 get_obj_state: octx=0x5559ffdbb320 obj=check-bucket:c state=0x5559ffdb9f28 s->prefetch_data=0 2024-09-14T10:47:15.825 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.825+0000 7f664320f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.10 2024-09-14T10:47:15.825 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.826+0000 7f664320f800 20 get_obj_state: octx=0x5559ffe58930 obj=check-bucket:f state=0x5559ffe590a8 s->prefetch_data=0 2024-09-14T10:47:15.825 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.826+0000 7f664320f800 20 get_obj_state: setting s->obj_tag to urmftbo4r5noozaenty1m0m4d8w55uac 2024-09-14T10:47:15.825 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.826+0000 7f664320f800 20 get_obj_state_impl: setting s->olh_tag to fo2yhtgh4l19oe7e4s9qktb3vouv3z6n 2024-09-14T10:47:15.825 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.826+0000 7f664320f800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=fo2yhtgh4l19oe7e4s9qktb3vouv3z6n 2024-09-14T10:47:15.825 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.826+0000 7f664320f800 20 get_obj_state: setting s->obj_tag to arro1pt8m1dkun1y4tvklewgk82i77y4 2024-09-14T10:47:15.825 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.826+0000 7f664320f800 20 get_obj_state_impl: setting s->olh_tag to nx6x5wbs95rvzhwr1fj3khphwq92suy5 2024-09-14T10:47:15.825 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.826+0000 7f664320f800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=nx6x5wbs95rvzhwr1fj3khphwq92suy5 2024-09-14T10:47:15.825 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.826+0000 7f664320f800 20 get_obj_state: setting s->obj_tag to bk1g7xtoaey439j3sscv8o1rj69zq3bd 2024-09-14T10:47:15.825 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.826+0000 7f664320f800 20 get_obj_state_impl: setting s->olh_tag to dby70psvt6oizaw2gz56n6h9k4ugilhk 2024-09-14T10:47:15.825 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.826+0000 7f664320f800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=dby70psvt6oizaw2gz56n6h9k4ugilhk 2024-09-14T10:47:15.825 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.826+0000 7f664320f800 20 get_obj_state: setting s->obj_tag to ghc506xt8pzxis0fbicl0pvbpvfnohf7 2024-09-14T10:47:15.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.826+0000 7f664320f800 20 get_obj_state_impl: setting s->olh_tag to 068zz1r40zhw1r2e9b62p4hnaampxcvy 2024-09-14T10:47:15.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.826+0000 7f664320f800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=068zz1r40zhw1r2e9b62p4hnaampxcvy 2024-09-14T10:47:15.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.827+0000 7f664320f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.1 2024-09-14T10:47:15.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.827+0000 7f664320f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.8 2024-09-14T10:47:15.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.827+0000 7f664320f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.5 2024-09-14T10:47:15.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.827+0000 7f664320f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.10 2024-09-14T10:47:15.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.829+0000 7f664320f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.5 2024-09-14T10:47:15.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.829+0000 7f664320f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.8 2024-09-14T10:47:15.829 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.830+0000 7f664320f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.1 2024-09-14T10:47:15.829 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.830+0000 7f664320f800 20 olh_log_entry: epoch=3 op=3 key=d[rqfjzRGf.gPuRpIqZ6BdyAP.tgHRRW0] 2024-09-14T10:47:15.829 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.830+0000 7f664320f800 20 get_obj_state: octx=0x5559ffb17550 obj=check-bucket:_:rqfjzRGf.gPuRpIqZ6BdyAP.tgHRRW0_d state=0x5559ffe5a0f8 s->prefetch_data=0 2024-09-14T10:47:15.830 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.830+0000 7f664320f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.10 2024-09-14T10:47:15.830 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.830+0000 7f664320f800 20 olh_log_entry: epoch=3 op=3 key=c[Y438JroVsmDYUnr.Szt7-uasMUUYL77] 2024-09-14T10:47:15.830 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.830+0000 7f664320f800 20 get_obj_state: octx=0x5559ffdbb320 obj=check-bucket:_:Y438JroVsmDYUnr.Szt7-uasMUUYL77_c state=0x5559ffe75d68 s->prefetch_data=0 2024-09-14T10:47:15.830 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.830+0000 7f664320f800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-14T10:47:15.830 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.830+0000 7f664320f800 20 olh_log_entry: epoch=2 op=3 key=e[3OLeuMnznBgMWSFrTyF9ugTfTDN6TU3] 2024-09-14T10:47:15.830 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.830+0000 7f664320f800 20 get_obj_state: octx=0x5559ffaef380 obj=check-bucket:_:3OLeuMnznBgMWSFrTyF9ugTfTDN6TU3_e state=0x5559ffe7cc08 s->prefetch_data=0 2024-09-14T10:47:15.830 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.830+0000 7f664320f800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-14T10:47:15.830 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.830+0000 7f664320f800 20 olh_log_entry: epoch=2 op=3 key=f[CBvF6Xs6LJ9h1mA1FVDIIh3hA-p0Osq] 2024-09-14T10:47:15.830 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.830+0000 7f664320f800 20 get_obj_state: octx=0x5559ffe58930 obj=check-bucket:_:CBvF6Xs6LJ9h1mA1FVDIIh3hA-p0Osq_f state=0x5559ffe84fd8 s->prefetch_data=0 2024-09-14T10:47:15.830 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.830+0000 7f664320f800 10 manifest: total_size = 9 2024-09-14T10:47:15.830 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.830+0000 7f664320f800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13719642788781757604 2024-09-14T10:47:15.830 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.830+0000 7f664320f800 20 get_obj_state: octx=0x5559ffb17550 obj=check-bucket:_:rqfjzRGf.gPuRpIqZ6BdyAP.tgHRRW0_d state=0x5559ffe5a0f8 s->prefetch_data=0 2024-09-14T10:47:15.830 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.830+0000 7f664320f800 20 prepare_atomic_modification: state is not atomic. state=0x5559ffe5a0f8 2024-09-14T10:47:15.831 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.830+0000 7f664320f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.5 2024-09-14T10:47:15.831 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.830+0000 7f664320f800 10 manifest: total_size = 12 2024-09-14T10:47:15.831 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.830+0000 7f664320f800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1147407651700294471 2024-09-14T10:47:15.831 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.830+0000 7f664320f800 20 get_obj_state: octx=0x5559ffdbb320 obj=check-bucket:_:Y438JroVsmDYUnr.Szt7-uasMUUYL77_c state=0x5559ffe75d68 s->prefetch_data=0 2024-09-14T10:47:15.831 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.830+0000 7f664320f800 20 prepare_atomic_modification: state is not atomic. state=0x5559ffe75d68 2024-09-14T10:47:15.831 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.830+0000 7f664320f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.8 2024-09-14T10:47:15.831 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.831+0000 7f664320f800 10 manifest: total_size = 9 2024-09-14T10:47:15.831 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.831+0000 7f664320f800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6411773982306017001 2024-09-14T10:47:15.831 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.831+0000 7f664320f800 20 get_obj_state: octx=0x5559ffaef380 obj=check-bucket:_:3OLeuMnznBgMWSFrTyF9ugTfTDN6TU3_e state=0x5559ffe7cc08 s->prefetch_data=0 2024-09-14T10:47:15.831 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.831+0000 7f664320f800 20 prepare_atomic_modification: state is not atomic. state=0x5559ffe7cc08 2024-09-14T10:47:15.831 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.831+0000 7f664320f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.1 2024-09-14T10:47:15.831 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.831+0000 7f664320f800 10 manifest: total_size = 22 2024-09-14T10:47:15.831 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.831+0000 7f664320f800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7587583817864281872 2024-09-14T10:47:15.831 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.831+0000 7f664320f800 20 get_obj_state: octx=0x5559ffe58930 obj=check-bucket:_:CBvF6Xs6LJ9h1mA1FVDIIh3hA-p0Osq_f state=0x5559ffe84fd8 s->prefetch_data=0 2024-09-14T10:47:15.832 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.831+0000 7f664320f800 20 prepare_atomic_modification: state is not atomic. state=0x5559ffe84fd8 2024-09-14T10:47:15.832 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.831+0000 7f664320f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.10 2024-09-14T10:47:15.832 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.833+0000 7f664320f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T10:47:15.832 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.833+0000 7f664320f800 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-14T10:47:15.833 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.833+0000 7f664320f800 0 deleting objects inline since gc isn't initialized 2024-09-14T10:47:15.833 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.833+0000 7f664320f800 5 delete_objs_inline: removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1__shadow:rqfjzRGf.gPuRpIqZ6BdyAP.tgHRRW0_.GB1aaQz4t0YIDriRkTIAxGsgLDB3gDF_0 2024-09-14T10:47:15.833 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.834+0000 7f664320f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T10:47:15.833 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.834+0000 7f664320f800 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-14T10:47:15.833 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.834+0000 7f664320f800 0 deleting objects inline since gc isn't initialized 2024-09-14T10:47:15.833 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.834+0000 7f664320f800 5 delete_objs_inline: removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1__shadow:3OLeuMnznBgMWSFrTyF9ugTfTDN6TU3_.t6sWlsD2BxN74xyFU1pcj2LMUj0M881_0 2024-09-14T10:47:15.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.835+0000 7f664320f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T10:47:15.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.835+0000 7f664320f800 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-14T10:47:15.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.835+0000 7f664320f800 0 deleting objects inline since gc isn't initialized 2024-09-14T10:47:15.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.835+0000 7f664320f800 5 delete_objs_inline: removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1__shadow:Y438JroVsmDYUnr.Szt7-uasMUUYL77_.PlVhCb76jn8h9463D2HMrbNQiR7fLZQ_0 2024-09-14T10:47:15.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.835+0000 7f664320f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T10:47:15.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.835+0000 7f664320f800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-14T10:47:15.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.835+0000 7f664320f800 0 deleting objects inline since gc isn't initialized 2024-09-14T10:47:15.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.835+0000 7f664320f800 5 delete_objs_inline: removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1__shadow:CBvF6Xs6LJ9h1mA1FVDIIh3hA-p0Osq_.yicS80HDxBeMKYCY5UGhTWfDZ2Ybw3d_0 2024-09-14T10:47:15.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.835+0000 7f664320f800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T10:47:15.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.835+0000 7f65177fe640 20 handle_completion(): completion ok for obj=d[rqfjzRGf.gPuRpIqZ6BdyAP.tgHRRW0] 2024-09-14T10:47:15.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.836+0000 7f6517fff640 20 handle_completion(): completion ok for obj=e[3OLeuMnznBgMWSFrTyF9ugTfTDN6TU3] 2024-09-14T10:47:15.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.836+0000 7f664320f800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T10:47:15.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.837+0000 7f664320f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.8 2024-09-14T10:47:15.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.837+0000 7f664320f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.8 2024-09-14T10:47:15.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.837+0000 7f664320f800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T10:47:15.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.841+0000 7f6517fff640 20 handle_completion(): completion ok for obj=c[Y438JroVsmDYUnr.Szt7-uasMUUYL77] 2024-09-14T10:47:15.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.841+0000 7f664320f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.5 2024-09-14T10:47:15.840 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.841+0000 7f664320f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.5 2024-09-14T10:47:15.841 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.842+0000 7f664320f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.5 2024-09-14T10:47:15.841 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.842+0000 7f664320f800 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-14T10:47:15.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.844+0000 7f664320f800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T10:47:15.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.844+0000 7f6517fff640 20 handle_completion(): completion ok for obj=f[CBvF6Xs6LJ9h1mA1FVDIIh3hA-p0Osq] 2024-09-14T10:47:15.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.844+0000 7f664320f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.8 2024-09-14T10:47:15.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.844+0000 7f664320f800 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-14T10:47:15.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.844+0000 7f664320f800 20 get_obj_state: octx=0x5559ffaef380 obj=check-bucket:e state=0x5559ffdbb638 s->prefetch_data=0 2024-09-14T10:47:15.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.844+0000 7f664320f800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=fo2yhtgh4l19oe7e4s9qktb3vouv3z6n 2024-09-14T10:47:15.844 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.845+0000 7f664320f800 20 get_obj_state: octx=0x5559ffe58930 obj=check-bucket:f state=0x5559ffe590a8 s->prefetch_data=0 2024-09-14T10:47:15.844 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.845+0000 7f664320f800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=068zz1r40zhw1r2e9b62p4hnaampxcvy 2024-09-14T10:47:15.845 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.846+0000 7f664320f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.1 2024-09-14T10:47:15.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.848+0000 7f664320f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.1 2024-09-14T10:47:15.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.848+0000 7f664320f800 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-14T10:47:15.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.848+0000 7f664320f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.10 2024-09-14T10:47:15.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.849+0000 7f664320f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.10 2024-09-14T10:47:15.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.849+0000 7f664320f800 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-14T10:47:15.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.849+0000 7f664320f800 1 NOTICE: finished all shards (4 entries removed) 2024-09-14T10:47:15.848 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.850+0000 7f64f77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:15.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.852+0000 7f664320f800 20 remove_watcher() i=0 2024-09-14T10:47:15.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.852+0000 7f664320f800 2 removed watcher, disabling cache 2024-09-14T10:47:15.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.853+0000 7f664320f800 20 remove_watcher() i=1 2024-09-14T10:47:15.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.856+0000 7f664320f800 20 remove_watcher() i=2 2024-09-14T10:47:15.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.857+0000 7f664320f800 20 remove_watcher() i=3 2024-09-14T10:47:15.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.858+0000 7f664320f800 20 remove_watcher() i=4 2024-09-14T10:47:15.858 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.860+0000 7f664320f800 20 remove_watcher() i=5 2024-09-14T10:47:15.861 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.862+0000 7f664320f800 20 remove_watcher() i=6 2024-09-14T10:47:15.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:15.866+0000 7f664320f800 20 remove_watcher() i=7 2024-09-14T10:47:15.886 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: bucket check unlinked does not affect normal entries 2024-09-14T10:47:15.886 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T10:47:15.943 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-09-14T10:47:15.943 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T10:47:15.944 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-14T10:47:15.979 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:47:15.979 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:47:16.016 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.017+0000 7f4e9b125800 20 rados->read ofs=0 len=0 2024-09-14T10:47:16.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.019+0000 7f4e9b125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:16.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.019+0000 7f4e9b125800 20 realm 2024-09-14T10:47:16.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.019+0000 7f4e9b125800 20 rados->read ofs=0 len=0 2024-09-14T10:47:16.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.019+0000 7f4e9b125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:16.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.019+0000 7f4e9b125800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:47:16.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.019+0000 7f4e9b125800 20 rados->read ofs=0 len=0 2024-09-14T10:47:16.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.019+0000 7f4e9b125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:16.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.019+0000 7f4e9b125800 20 rados->read ofs=0 len=0 2024-09-14T10:47:16.019 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.020+0000 7f4e9b125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:16.019 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.020+0000 7f4e9b125800 20 rados->read ofs=0 len=0 2024-09-14T10:47:16.019 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.021+0000 7f4e9b125800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:47:16.019 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.021+0000 7f4e9b125800 20 searching for the correct realm 2024-09-14T10:47:16.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.023+0000 7f4e976a3640 0 -- 172.21.15.97:0/200073632 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f4e8c0db9d0 msgr2=0x7f4e8c0569c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T10:47:16.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.229+0000 7f4e966a1640 0 -- 172.21.15.97:0/200073632 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f4e8804a940 msgr2=0x7f4e88029440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:47:16.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.234+0000 7f4e9b125800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:47:16.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.234+0000 7f4e9b125800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:47:16.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.234+0000 7f4e9b125800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T10:47:16.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.234+0000 7f4e9b125800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T10:47:16.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.234+0000 7f4e9b125800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:47:16.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.234+0000 7f4e9b125800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:47:16.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.234+0000 7f4e9b125800 20 rados->read ofs=0 len=0 2024-09-14T10:47:16.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.234+0000 7f4e9b125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:16.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.234+0000 7f4e9b125800 20 rados->read ofs=0 len=0 2024-09-14T10:47:16.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.234+0000 7f4e9b125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:16.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.234+0000 7f4e9b125800 20 rados->read ofs=0 len=0 2024-09-14T10:47:16.234 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.235+0000 7f4e9b125800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:47:16.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.235+0000 7f4e9b125800 20 zone default found 2024-09-14T10:47:16.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.235+0000 7f4e9b125800 4 Realm: () 2024-09-14T10:47:16.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.235+0000 7f4e9b125800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T10:47:16.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.235+0000 7f4e9b125800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T10:47:16.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.235+0000 7f4e9b125800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:47:16.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.235+0000 7f4e9b125800 20 zonegroup default 2024-09-14T10:47:16.236 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.235+0000 7f4e9b125800 20 rados->read ofs=0 len=0 2024-09-14T10:47:16.236 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.235+0000 7f4e9b125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:16.236 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.235+0000 7f4e9b125800 20 rados->read ofs=0 len=0 2024-09-14T10:47:16.236 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.235+0000 7f4e9b125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:16.236 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.235+0000 7f4e9b125800 20 rados->read ofs=0 len=0 2024-09-14T10:47:16.236 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.235+0000 7f4e9b125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:16.237 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.235+0000 7f4e9b125800 20 started sync module instance, tier type = 2024-09-14T10:47:16.237 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.235+0000 7f4e9b125800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T10:47:16.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.251+0000 7f4e9b125800 20 add_watcher() i=0 2024-09-14T10:47:16.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.251+0000 7f4e9b125800 20 add_watcher() i=1 2024-09-14T10:47:16.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.251+0000 7f4e9b125800 20 add_watcher() i=2 2024-09-14T10:47:16.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.251+0000 7f4e9b125800 20 add_watcher() i=3 2024-09-14T10:47:16.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.251+0000 7f4e9b125800 20 add_watcher() i=4 2024-09-14T10:47:16.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.251+0000 7f4e9b125800 20 add_watcher() i=5 2024-09-14T10:47:16.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.251+0000 7f4e9b125800 20 add_watcher() i=6 2024-09-14T10:47:16.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.252+0000 7f4e9b125800 20 add_watcher() i=7 2024-09-14T10:47:16.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.252+0000 7f4e9b125800 2 all 8 watchers are set, enabling cache 2024-09-14T10:47:16.253 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.253+0000 7f4d4dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:16.256 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.254+0000 7f4e9b125800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:47:16.256 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.254+0000 7f4e9b125800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:47:16.256 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.254+0000 7f4e9b125800 5 note: GC not initialized 2024-09-14T10:47:16.256 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.254+0000 7f4d4cfe1640 20 reqs_thread_entry: start 2024-09-14T10:47:16.257 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.254+0000 7f4e9b125800 20 init_complete bucket index max shards: 11 2024-09-14T10:47:16.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.254+0000 7f4e9b125800 20 Filter name: none 2024-09-14T10:47:16.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.254+0000 7f4d45ffb640 20 reqs_thread_entry: start 2024-09-14T10:47:16.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.254+0000 7f4e9b125800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T10:47:16.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.254+0000 7f4e9b125800 20 rados->read ofs=0 len=0 2024-09-14T10:47:16.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.255+0000 7f4e9b125800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:47:16.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.255+0000 7f4e9b125800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T10:47:16.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.255+0000 7f4e9b125800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T10:47:16.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.255+0000 7f4e9b125800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1 : miss 2024-09-14T10:47:16.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.255+0000 7f4e9b125800 20 rados->read ofs=0 len=0 2024-09-14T10:47:16.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.255+0000 7f4e9b125800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:47:16.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.255+0000 7f4e9b125800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1 info.flags=0x17 2024-09-14T10:47:16.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.255+0000 7f4e9b125800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1 to cache LRU end 2024-09-14T10:47:16.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.255+0000 7f4e9b125800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:47:16.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.255+0000 7f4e9b125800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T10:47:16.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.255+0000 7f4e9b125800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1 2024-09-14T10:47:16.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.255+0000 7f4e9b125800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.0 2024-09-14T10:47:16.264 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.256+0000 7f4e9b125800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T10:47:16.264 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.256+0000 7f4e9b125800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.1 2024-09-14T10:47:16.267 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.256+0000 7f4e9b125800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T10:47:16.268 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.256+0000 7f4e9b125800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.2 2024-09-14T10:47:16.268 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.257+0000 7f4e9b125800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T10:47:16.268 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.257+0000 7f4e9b125800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.3 2024-09-14T10:47:16.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.257+0000 7f4e9b125800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T10:47:16.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.257+0000 7f4e9b125800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.4 2024-09-14T10:47:16.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.258+0000 7f4e9b125800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T10:47:16.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.258+0000 7f4e9b125800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.5 2024-09-14T10:47:16.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.258+0000 7f4e9b125800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-14T10:47:16.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.258+0000 7f4e9b125800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.6 2024-09-14T10:47:16.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.258+0000 7f4e9b125800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T10:47:16.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.258+0000 7f4e9b125800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.7 2024-09-14T10:47:16.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.259+0000 7f4e9b125800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T10:47:16.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.259+0000 7f4e9b125800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.8 2024-09-14T10:47:16.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.259+0000 7f4e9b125800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-14T10:47:16.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.259+0000 7f4e9b125800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.9 2024-09-14T10:47:16.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.260+0000 7f4e9b125800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T10:47:16.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.260+0000 7f4e9b125800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.10 2024-09-14T10:47:16.272 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.260+0000 7f4e9b125800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T10:47:16.272 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.260+0000 7f4e9b125800 1 NOTICE: finished all shards (0 entries found) 2024-09-14T10:47:16.272 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.261+0000 7f4d4dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:16.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.263+0000 7f4e9b125800 20 remove_watcher() i=0 2024-09-14T10:47:16.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.263+0000 7f4e9b125800 2 removed watcher, disabling cache 2024-09-14T10:47:16.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.264+0000 7f4e9b125800 20 remove_watcher() i=1 2024-09-14T10:47:16.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.266+0000 7f4e9b125800 20 remove_watcher() i=2 2024-09-14T10:47:16.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.267+0000 7f4e9b125800 20 remove_watcher() i=3 2024-09-14T10:47:16.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.268+0000 7f4e9b125800 20 remove_watcher() i=4 2024-09-14T10:47:16.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.269+0000 7f4e9b125800 20 remove_watcher() i=5 2024-09-14T10:47:16.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.270+0000 7f4e9b125800 20 remove_watcher() i=6 2024-09-14T10:47:16.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.271+0000 7f4e9b125800 20 remove_watcher() i=7 2024-09-14T10:47:16.318 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T10:47:16.343 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:47:16.343 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:47:16.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.382+0000 7f1f75ab9800 20 rados->read ofs=0 len=0 2024-09-14T10:47:16.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.384+0000 7f1f75ab9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:16.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.384+0000 7f1f75ab9800 20 realm 2024-09-14T10:47:16.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.384+0000 7f1f75ab9800 20 rados->read ofs=0 len=0 2024-09-14T10:47:16.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.384+0000 7f1f75ab9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:16.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.384+0000 7f1f75ab9800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:47:16.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.384+0000 7f1f75ab9800 20 rados->read ofs=0 len=0 2024-09-14T10:47:16.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.384+0000 7f1f75ab9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:16.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.384+0000 7f1f75ab9800 20 rados->read ofs=0 len=0 2024-09-14T10:47:16.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.385+0000 7f1f75ab9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:16.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.385+0000 7f1f75ab9800 20 rados->read ofs=0 len=0 2024-09-14T10:47:16.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.386+0000 7f1f75ab9800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:47:16.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.386+0000 7f1f75ab9800 20 searching for the correct realm 2024-09-14T10:47:16.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.388+0000 7f1f73da4640 0 -- 172.21.15.97:0/1721529281 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f1f5c065040 msgr2=0x7f1f5c0b5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:47:16.592 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.593+0000 7f1f6ada2640 0 -- 172.21.15.97:0/1721529281 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f1f6409f9d0 msgr2=0x7f1f640a10b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:47:16.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.598+0000 7f1f75ab9800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:47:16.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.598+0000 7f1f75ab9800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:47:16.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.598+0000 7f1f75ab9800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T10:47:16.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.598+0000 7f1f75ab9800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T10:47:16.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.598+0000 7f1f75ab9800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:47:16.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.598+0000 7f1f75ab9800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:47:16.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.598+0000 7f1f75ab9800 20 rados->read ofs=0 len=0 2024-09-14T10:47:16.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.598+0000 7f1f75ab9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:16.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.598+0000 7f1f75ab9800 20 rados->read ofs=0 len=0 2024-09-14T10:47:16.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.598+0000 7f1f75ab9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:16.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.598+0000 7f1f75ab9800 20 rados->read ofs=0 len=0 2024-09-14T10:47:16.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.599+0000 7f1f75ab9800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:47:16.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.599+0000 7f1f75ab9800 20 zone default found 2024-09-14T10:47:16.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.599+0000 7f1f75ab9800 4 Realm: () 2024-09-14T10:47:16.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.599+0000 7f1f75ab9800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T10:47:16.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.599+0000 7f1f75ab9800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T10:47:16.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.599+0000 7f1f75ab9800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:47:16.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.599+0000 7f1f75ab9800 20 zonegroup default 2024-09-14T10:47:16.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.599+0000 7f1f75ab9800 20 rados->read ofs=0 len=0 2024-09-14T10:47:16.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.599+0000 7f1f75ab9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:16.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.599+0000 7f1f75ab9800 20 rados->read ofs=0 len=0 2024-09-14T10:47:16.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.599+0000 7f1f75ab9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:16.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.599+0000 7f1f75ab9800 20 rados->read ofs=0 len=0 2024-09-14T10:47:16.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.599+0000 7f1f75ab9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:16.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.599+0000 7f1f75ab9800 20 started sync module instance, tier type = 2024-09-14T10:47:16.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.599+0000 7f1f75ab9800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T10:47:16.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.618+0000 7f1f75ab9800 20 add_watcher() i=0 2024-09-14T10:47:16.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.618+0000 7f1f75ab9800 20 add_watcher() i=1 2024-09-14T10:47:16.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.618+0000 7f1f75ab9800 20 add_watcher() i=2 2024-09-14T10:47:16.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.618+0000 7f1f75ab9800 20 add_watcher() i=3 2024-09-14T10:47:16.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.618+0000 7f1f75ab9800 20 add_watcher() i=4 2024-09-14T10:47:16.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.618+0000 7f1f75ab9800 20 add_watcher() i=5 2024-09-14T10:47:16.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.618+0000 7f1f75ab9800 20 add_watcher() i=6 2024-09-14T10:47:16.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.619+0000 7f1f75ab9800 20 add_watcher() i=7 2024-09-14T10:47:16.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.619+0000 7f1f75ab9800 2 all 8 watchers are set, enabling cache 2024-09-14T10:47:16.619 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.621+0000 7f1e29fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:16.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.621+0000 7f1f75ab9800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:47:16.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.621+0000 7f1f75ab9800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:47:16.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.621+0000 7f1f75ab9800 5 note: GC not initialized 2024-09-14T10:47:16.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.621+0000 7f1e28fe1640 20 reqs_thread_entry: start 2024-09-14T10:47:16.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.621+0000 7f1f75ab9800 20 init_complete bucket index max shards: 11 2024-09-14T10:47:16.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.621+0000 7f1f75ab9800 20 Filter name: none 2024-09-14T10:47:16.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.621+0000 7f1da27fc640 20 reqs_thread_entry: start 2024-09-14T10:47:16.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.621+0000 7f1f75ab9800 20 rados->read ofs=0 len=0 2024-09-14T10:47:16.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.622+0000 7f1f75ab9800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:47:16.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.622+0000 7f1f75ab9800 20 rados->read ofs=0 len=0 2024-09-14T10:47:16.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.622+0000 7f1f75ab9800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:47:16.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.622+0000 7f1f75ab9800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:47:16.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.622+0000 7f1f75ab9800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T10:47:16.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.622+0000 7f1f75ab9800 20 INFO: main: starting shard=0 2024-09-14T10:47:16.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.622+0000 7f1f75ab9800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.0 2024-09-14T10:47:16.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.623+0000 7f1f75ab9800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:16.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.623+0000 7f1f75ab9800 20 INFO: main: starting shard=1 2024-09-14T10:47:16.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.623+0000 7f1f75ab9800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.1 2024-09-14T10:47:16.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.623+0000 7f1f75ab9800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:16.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.623+0000 7f1f75ab9800 20 INFO: main: starting shard=2 2024-09-14T10:47:16.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.623+0000 7f1f75ab9800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.2 2024-09-14T10:47:16.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.624+0000 7f1f75ab9800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:16.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.624+0000 7f1f75ab9800 20 INFO: main: starting shard=3 2024-09-14T10:47:16.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.624+0000 7f1f75ab9800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.3 2024-09-14T10:47:16.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.624+0000 7f1f75ab9800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:16.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.624+0000 7f1f75ab9800 20 INFO: main: starting shard=4 2024-09-14T10:47:16.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.624+0000 7f1f75ab9800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.4 2024-09-14T10:47:16.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.624+0000 7f1f75ab9800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:16.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.624+0000 7f1f75ab9800 20 INFO: main: starting shard=5 2024-09-14T10:47:16.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.624+0000 7f1f75ab9800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.5 2024-09-14T10:47:16.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.625+0000 7f1f75ab9800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-14T10:47:16.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.625+0000 7f1f75ab9800 20 INFO: main: starting shard=6 2024-09-14T10:47:16.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.625+0000 7f1f75ab9800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.6 2024-09-14T10:47:16.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.625+0000 7f1f75ab9800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:16.626 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.625+0000 7f1f75ab9800 20 INFO: main: starting shard=7 2024-09-14T10:47:16.626 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.625+0000 7f1f75ab9800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.7 2024-09-14T10:47:16.626 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.626+0000 7f1f75ab9800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:16.626 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.626+0000 7f1f75ab9800 20 INFO: main: starting shard=8 2024-09-14T10:47:16.626 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.626+0000 7f1f75ab9800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.8 2024-09-14T10:47:16.626 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.626+0000 7f1f75ab9800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:16.626 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.626+0000 7f1f75ab9800 20 INFO: main: starting shard=9 2024-09-14T10:47:16.626 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.626+0000 7f1f75ab9800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.9 2024-09-14T10:47:16.626 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.627+0000 7f1f75ab9800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:16.626 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.627+0000 7f1f75ab9800 20 INFO: main: starting shard=10 2024-09-14T10:47:16.626 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.627+0000 7f1f75ab9800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.10 2024-09-14T10:47:16.626 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.627+0000 7f1f75ab9800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:16.626 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.627+0000 7f1f75ab9800 20 INFO: main: done 2024-09-14T10:47:16.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.628+0000 7f1e29fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:16.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.630+0000 7f1f75ab9800 20 remove_watcher() i=0 2024-09-14T10:47:16.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.630+0000 7f1f75ab9800 2 removed watcher, disabling cache 2024-09-14T10:47:16.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.631+0000 7f1f75ab9800 20 remove_watcher() i=1 2024-09-14T10:47:16.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.632+0000 7f1f75ab9800 20 remove_watcher() i=2 2024-09-14T10:47:16.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.634+0000 7f1f75ab9800 20 remove_watcher() i=3 2024-09-14T10:47:16.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.637+0000 7f1f75ab9800 20 remove_watcher() i=4 2024-09-14T10:47:16.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.638+0000 7f1f75ab9800 20 remove_watcher() i=5 2024-09-14T10:47:16.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.639+0000 7f1f75ab9800 20 remove_watcher() i=6 2024-09-14T10:47:16.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.640+0000 7f1f75ab9800 20 remove_watcher() i=7 2024-09-14T10:47:16.650 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T10:47:16.681 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:47:16.681 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:47:16.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.718+0000 7f9653d3e800 20 rados->read ofs=0 len=0 2024-09-14T10:47:16.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.720+0000 7f9653d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:16.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.720+0000 7f9653d3e800 20 realm 2024-09-14T10:47:16.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.720+0000 7f9653d3e800 20 rados->read ofs=0 len=0 2024-09-14T10:47:16.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.720+0000 7f9653d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:16.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.720+0000 7f9653d3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:47:16.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.720+0000 7f9653d3e800 20 rados->read ofs=0 len=0 2024-09-14T10:47:16.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.721+0000 7f9653d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:16.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.721+0000 7f9653d3e800 20 rados->read ofs=0 len=0 2024-09-14T10:47:16.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.721+0000 7f9653d3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:16.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.721+0000 7f9653d3e800 20 rados->read ofs=0 len=0 2024-09-14T10:47:16.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.722+0000 7f9653d3e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:47:16.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.722+0000 7f9653d3e800 20 searching for the correct realm 2024-09-14T10:47:16.723 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.724+0000 7f96502c1640 0 -- 172.21.15.97:0/2472349089 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f9638032060 msgr2=0x7f9638067810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:47:16.927 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.928+0000 7f96472bf640 0 -- 172.21.15.97:0/2472349089 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f9640076c50 msgr2=0x7f9640075020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:47:16.932 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.934+0000 7f9653d3e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:47:16.932 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.934+0000 7f9653d3e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:47:16.932 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.934+0000 7f9653d3e800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T10:47:16.932 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.934+0000 7f9653d3e800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T10:47:16.933 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.934+0000 7f9653d3e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:47:16.933 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.934+0000 7f9653d3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:47:16.933 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.934+0000 7f9653d3e800 20 rados->read ofs=0 len=0 2024-09-14T10:47:16.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.934+0000 7f9653d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:16.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.934+0000 7f9653d3e800 20 rados->read ofs=0 len=0 2024-09-14T10:47:16.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.934+0000 7f9653d3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:16.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.934+0000 7f9653d3e800 20 rados->read ofs=0 len=0 2024-09-14T10:47:16.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.935+0000 7f9653d3e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:47:16.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.935+0000 7f9653d3e800 20 zone default found 2024-09-14T10:47:16.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.935+0000 7f9653d3e800 4 Realm: () 2024-09-14T10:47:16.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.935+0000 7f9653d3e800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T10:47:16.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.935+0000 7f9653d3e800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T10:47:16.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.935+0000 7f9653d3e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:47:16.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.935+0000 7f9653d3e800 20 zonegroup default 2024-09-14T10:47:16.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.935+0000 7f9653d3e800 20 rados->read ofs=0 len=0 2024-09-14T10:47:16.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.935+0000 7f9653d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:16.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.935+0000 7f9653d3e800 20 rados->read ofs=0 len=0 2024-09-14T10:47:16.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.935+0000 7f9653d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:16.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.935+0000 7f9653d3e800 20 rados->read ofs=0 len=0 2024-09-14T10:47:16.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.935+0000 7f9653d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:16.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.935+0000 7f9653d3e800 20 started sync module instance, tier type = 2024-09-14T10:47:16.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.935+0000 7f9653d3e800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T10:47:16.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.953+0000 7f9653d3e800 20 add_watcher() i=0 2024-09-14T10:47:16.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.953+0000 7f9653d3e800 20 add_watcher() i=1 2024-09-14T10:47:16.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.953+0000 7f9653d3e800 20 add_watcher() i=2 2024-09-14T10:47:16.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.953+0000 7f9653d3e800 20 add_watcher() i=3 2024-09-14T10:47:16.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.953+0000 7f9653d3e800 20 add_watcher() i=4 2024-09-14T10:47:16.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.953+0000 7f9653d3e800 20 add_watcher() i=5 2024-09-14T10:47:16.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.953+0000 7f9653d3e800 20 add_watcher() i=6 2024-09-14T10:47:16.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.954+0000 7f9653d3e800 20 add_watcher() i=7 2024-09-14T10:47:16.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.954+0000 7f9653d3e800 2 all 8 watchers are set, enabling cache 2024-09-14T10:47:16.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.956+0000 7f9505fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:16.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.956+0000 7f9653d3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:47:16.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.956+0000 7f9653d3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:47:16.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.956+0000 7f9653d3e800 5 note: GC not initialized 2024-09-14T10:47:16.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.957+0000 7f9504fe1640 20 reqs_thread_entry: start 2024-09-14T10:47:16.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.957+0000 7f9653d3e800 20 init_complete bucket index max shards: 11 2024-09-14T10:47:16.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.957+0000 7f9653d3e800 20 Filter name: none 2024-09-14T10:47:16.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.957+0000 7f947e7fc640 20 reqs_thread_entry: start 2024-09-14T10:47:16.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.957+0000 7f9653d3e800 20 rados->read ofs=0 len=0 2024-09-14T10:47:16.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.957+0000 7f9653d3e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:47:16.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.957+0000 7f9653d3e800 20 rados->read ofs=0 len=0 2024-09-14T10:47:16.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.958+0000 7f9653d3e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:47:16.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.958+0000 7f9653d3e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:47:16.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.958+0000 7f9653d3e800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T10:47:16.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.958+0000 7f9653d3e800 20 INFO: main: starting shard=0 2024-09-14T10:47:16.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.958+0000 7f9653d3e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.0 2024-09-14T10:47:16.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.958+0000 7f9653d3e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:16.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.958+0000 7f9653d3e800 20 INFO: main: starting shard=1 2024-09-14T10:47:16.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.958+0000 7f9653d3e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.1 2024-09-14T10:47:16.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.959+0000 7f9653d3e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:16.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.959+0000 7f9653d3e800 20 INFO: main: starting shard=2 2024-09-14T10:47:16.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.959+0000 7f9653d3e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.2 2024-09-14T10:47:16.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.959+0000 7f9653d3e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:16.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.960+0000 7f9653d3e800 20 INFO: main: starting shard=3 2024-09-14T10:47:16.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.960+0000 7f9653d3e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.3 2024-09-14T10:47:16.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.960+0000 7f9653d3e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:16.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.960+0000 7f9653d3e800 20 INFO: main: starting shard=4 2024-09-14T10:47:16.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.960+0000 7f9653d3e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.4 2024-09-14T10:47:16.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.960+0000 7f9653d3e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:16.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.960+0000 7f9653d3e800 20 INFO: main: starting shard=5 2024-09-14T10:47:16.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.960+0000 7f9653d3e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.5 2024-09-14T10:47:16.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.961+0000 7f9653d3e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:16.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.961+0000 7f9653d3e800 20 INFO: main: starting shard=6 2024-09-14T10:47:16.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.961+0000 7f9653d3e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.6 2024-09-14T10:47:16.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.961+0000 7f9653d3e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:16.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.961+0000 7f9653d3e800 20 INFO: main: starting shard=7 2024-09-14T10:47:16.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.961+0000 7f9653d3e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.7 2024-09-14T10:47:16.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.962+0000 7f9653d3e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:16.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.962+0000 7f9653d3e800 20 INFO: main: starting shard=8 2024-09-14T10:47:16.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.962+0000 7f9653d3e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.8 2024-09-14T10:47:16.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.962+0000 7f9653d3e800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-14T10:47:16.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.962+0000 7f9653d3e800 20 INFO: main: starting shard=9 2024-09-14T10:47:16.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.962+0000 7f9653d3e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.9 2024-09-14T10:47:16.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.963+0000 7f9653d3e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:16.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.963+0000 7f9653d3e800 20 INFO: main: starting shard=10 2024-09-14T10:47:16.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.963+0000 7f9653d3e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.10 2024-09-14T10:47:16.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.963+0000 7f9653d3e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:16.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.963+0000 7f9653d3e800 20 INFO: main: done 2024-09-14T10:47:16.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.964+0000 7f9505fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:16.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.967+0000 7f9653d3e800 20 remove_watcher() i=0 2024-09-14T10:47:16.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.967+0000 7f9653d3e800 2 removed watcher, disabling cache 2024-09-14T10:47:16.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.968+0000 7f9653d3e800 20 remove_watcher() i=1 2024-09-14T10:47:16.967 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.969+0000 7f9653d3e800 20 remove_watcher() i=2 2024-09-14T10:47:16.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.971+0000 7f9653d3e800 20 remove_watcher() i=3 2024-09-14T10:47:16.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.972+0000 7f9653d3e800 20 remove_watcher() i=4 2024-09-14T10:47:16.971 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.973+0000 7f9653d3e800 20 remove_watcher() i=5 2024-09-14T10:47:16.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.975+0000 7f9653d3e800 20 remove_watcher() i=6 2024-09-14T10:47:16.976 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:16.977+0000 7f9653d3e800 20 remove_watcher() i=7 2024-09-14T10:47:16.986 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: bucket check olh finds leftover OLH entries 2024-09-14T10:47:16.986 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T10:47:16.987 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-14T10:47:17.018 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:47:17.019 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:47:17.257 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.258+0000 7fde11375800 20 rados->read ofs=0 len=0 2024-09-14T10:47:17.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.260+0000 7fde11375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:17.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.260+0000 7fde11375800 20 realm 2024-09-14T10:47:17.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.260+0000 7fde11375800 20 rados->read ofs=0 len=0 2024-09-14T10:47:17.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.260+0000 7fde11375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:17.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.260+0000 7fde11375800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:47:17.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.260+0000 7fde11375800 20 rados->read ofs=0 len=0 2024-09-14T10:47:17.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.260+0000 7fde11375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:17.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.260+0000 7fde11375800 20 rados->read ofs=0 len=0 2024-09-14T10:47:17.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.261+0000 7fde11375800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:17.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.261+0000 7fde11375800 20 rados->read ofs=0 len=0 2024-09-14T10:47:17.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.262+0000 7fde11375800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:47:17.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.262+0000 7fde11375800 20 searching for the correct realm 2024-09-14T10:47:17.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.264+0000 7fde0f660640 0 -- 172.21.15.97:0/865557382 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7fde04045040 msgr2=0x7fde040363f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:47:17.467 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.469+0000 7fde0e65e640 0 -- 172.21.15.97:0/865557382 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7fde0008e960 msgr2=0x7fde00063450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:47:17.472 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.474+0000 7fde11375800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:47:17.472 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.474+0000 7fde11375800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:47:17.472 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.474+0000 7fde11375800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T10:47:17.472 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.474+0000 7fde11375800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T10:47:17.472 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.474+0000 7fde11375800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:47:17.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.474+0000 7fde11375800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:47:17.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.474+0000 7fde11375800 20 rados->read ofs=0 len=0 2024-09-14T10:47:17.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.474+0000 7fde11375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:17.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.474+0000 7fde11375800 20 rados->read ofs=0 len=0 2024-09-14T10:47:17.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.475+0000 7fde11375800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:17.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.475+0000 7fde11375800 20 rados->read ofs=0 len=0 2024-09-14T10:47:17.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.475+0000 7fde11375800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:47:17.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.475+0000 7fde11375800 20 zone default found 2024-09-14T10:47:17.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.475+0000 7fde11375800 4 Realm: () 2024-09-14T10:47:17.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.475+0000 7fde11375800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T10:47:17.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.475+0000 7fde11375800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T10:47:17.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.475+0000 7fde11375800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:47:17.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.475+0000 7fde11375800 20 zonegroup default 2024-09-14T10:47:17.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.475+0000 7fde11375800 20 rados->read ofs=0 len=0 2024-09-14T10:47:17.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.475+0000 7fde11375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:17.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.475+0000 7fde11375800 20 rados->read ofs=0 len=0 2024-09-14T10:47:17.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.476+0000 7fde11375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:17.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.476+0000 7fde11375800 20 rados->read ofs=0 len=0 2024-09-14T10:47:17.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.476+0000 7fde11375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:17.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.476+0000 7fde11375800 20 started sync module instance, tier type = 2024-09-14T10:47:17.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.476+0000 7fde11375800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T10:47:17.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.492+0000 7fde11375800 20 add_watcher() i=0 2024-09-14T10:47:17.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.492+0000 7fde11375800 20 add_watcher() i=1 2024-09-14T10:47:17.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.492+0000 7fde11375800 20 add_watcher() i=2 2024-09-14T10:47:17.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.492+0000 7fde11375800 20 add_watcher() i=3 2024-09-14T10:47:17.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.492+0000 7fde11375800 20 add_watcher() i=4 2024-09-14T10:47:17.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.492+0000 7fde11375800 20 add_watcher() i=5 2024-09-14T10:47:17.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.492+0000 7fde11375800 20 add_watcher() i=6 2024-09-14T10:47:17.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.493+0000 7fde11375800 20 add_watcher() i=7 2024-09-14T10:47:17.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.493+0000 7fde11375800 2 all 8 watchers are set, enabling cache 2024-09-14T10:47:17.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.496+0000 7fdcc57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:17.495 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.496+0000 7fde11375800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:47:17.495 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.496+0000 7fde11375800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:47:17.495 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.496+0000 7fde11375800 5 note: GC not initialized 2024-09-14T10:47:17.495 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.496+0000 7fdc3ffff640 20 reqs_thread_entry: start 2024-09-14T10:47:17.495 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.496+0000 7fde11375800 20 init_complete bucket index max shards: 11 2024-09-14T10:47:17.495 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.496+0000 7fde11375800 20 Filter name: none 2024-09-14T10:47:17.495 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.496+0000 7fdc3dffb640 20 reqs_thread_entry: start 2024-09-14T10:47:17.495 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.497+0000 7fde11375800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T10:47:17.495 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.497+0000 7fde11375800 20 rados->read ofs=0 len=0 2024-09-14T10:47:17.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.497+0000 7fde11375800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:47:17.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.497+0000 7fde11375800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T10:47:17.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.497+0000 7fde11375800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T10:47:17.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.497+0000 7fde11375800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1 : miss 2024-09-14T10:47:17.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.497+0000 7fde11375800 20 rados->read ofs=0 len=0 2024-09-14T10:47:17.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.497+0000 7fde11375800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:47:17.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.497+0000 7fde11375800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1 info.flags=0x17 2024-09-14T10:47:17.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.497+0000 7fde11375800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1 to cache LRU end 2024-09-14T10:47:17.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.497+0000 7fde11375800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:47:17.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.497+0000 7fde11375800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T10:47:17.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.497+0000 7fde11375800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1 2024-09-14T10:47:17.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.497+0000 7fde11375800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.0 2024-09-14T10:47:17.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.498+0000 7fde11375800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T10:47:17.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.498+0000 7fde11375800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.1 2024-09-14T10:47:17.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.498+0000 7fde11375800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T10:47:17.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.498+0000 7fde11375800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.2 2024-09-14T10:47:17.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.499+0000 7fde11375800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T10:47:17.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.499+0000 7fde11375800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.3 2024-09-14T10:47:17.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.500+0000 7fde11375800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T10:47:17.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.500+0000 7fde11375800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.4 2024-09-14T10:47:17.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.500+0000 7fde11375800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T10:47:17.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.500+0000 7fde11375800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.5 2024-09-14T10:47:17.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.501+0000 7fde11375800 1 NOTICE: finished shard 5 (1 entries found) 2024-09-14T10:47:17.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.501+0000 7fde11375800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.6 2024-09-14T10:47:17.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.501+0000 7fde11375800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T10:47:17.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.501+0000 7fde11375800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.7 2024-09-14T10:47:17.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.502+0000 7fde11375800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T10:47:17.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.502+0000 7fde11375800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.8 2024-09-14T10:47:17.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.502+0000 7fde11375800 1 NOTICE: finished shard 8 (1 entries found) 2024-09-14T10:47:17.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.502+0000 7fde11375800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.9 2024-09-14T10:47:17.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.503+0000 7fde11375800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T10:47:17.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.503+0000 7fde11375800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.10 2024-09-14T10:47:17.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.503+0000 7fde11375800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T10:47:17.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.503+0000 7fde11375800 1 NOTICE: finished all shards (2 entries found) 2024-09-14T10:47:17.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.504+0000 7fdcc57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:17.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.506+0000 7fde11375800 20 remove_watcher() i=0 2024-09-14T10:47:17.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.506+0000 7fde11375800 2 removed watcher, disabling cache 2024-09-14T10:47:17.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.508+0000 7fde11375800 20 remove_watcher() i=1 2024-09-14T10:47:17.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.509+0000 7fde11375800 20 remove_watcher() i=2 2024-09-14T10:47:17.508 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.510+0000 7fde11375800 20 remove_watcher() i=3 2024-09-14T10:47:17.509 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.511+0000 7fde11375800 20 remove_watcher() i=4 2024-09-14T10:47:17.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.512+0000 7fde11375800 20 remove_watcher() i=5 2024-09-14T10:47:17.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.513+0000 7fde11375800 20 remove_watcher() i=6 2024-09-14T10:47:17.513 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.514+0000 7fde11375800 20 remove_watcher() i=7 2024-09-14T10:47:17.523 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-09-14T10:47:17.523 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T10:47:17.525 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T10:47:17.558 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:47:17.558 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:47:17.796 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.798+0000 7f3ba9132800 20 rados->read ofs=0 len=0 2024-09-14T10:47:17.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.799+0000 7f3ba9132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:17.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.799+0000 7f3ba9132800 20 realm 2024-09-14T10:47:17.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.799+0000 7f3ba9132800 20 rados->read ofs=0 len=0 2024-09-14T10:47:17.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.799+0000 7f3ba9132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:17.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.799+0000 7f3ba9132800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:47:17.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.799+0000 7f3ba9132800 20 rados->read ofs=0 len=0 2024-09-14T10:47:17.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.799+0000 7f3ba9132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:17.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.799+0000 7f3ba9132800 20 rados->read ofs=0 len=0 2024-09-14T10:47:17.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.800+0000 7f3ba9132800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:17.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.800+0000 7f3ba9132800 20 rados->read ofs=0 len=0 2024-09-14T10:47:17.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.801+0000 7f3ba9132800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:47:17.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.801+0000 7f3ba9132800 20 searching for the correct realm 2024-09-14T10:47:17.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:17.803+0000 7f3ba55bd640 0 -- 172.21.15.97:0/2145559633 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f3b8c043040 msgr2=0x7f3b8c042410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:47:18.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.007+0000 7f3b9c5bb640 0 -- 172.21.15.97:0/2145559633 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f3b94002500 msgr2=0x7f3b940ad4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:47:18.011 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.013+0000 7f3ba9132800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:47:18.011 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.013+0000 7f3ba9132800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:47:18.012 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.013+0000 7f3ba9132800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T10:47:18.012 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.013+0000 7f3ba9132800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T10:47:18.012 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.013+0000 7f3ba9132800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:47:18.012 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.013+0000 7f3ba9132800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:47:18.012 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.013+0000 7f3ba9132800 20 rados->read ofs=0 len=0 2024-09-14T10:47:18.012 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.013+0000 7f3ba9132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:18.012 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.013+0000 7f3ba9132800 20 rados->read ofs=0 len=0 2024-09-14T10:47:18.014 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.013+0000 7f3ba9132800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:18.014 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.013+0000 7f3ba9132800 20 rados->read ofs=0 len=0 2024-09-14T10:47:18.014 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.014+0000 7f3ba9132800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:47:18.014 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.014+0000 7f3ba9132800 20 zone default found 2024-09-14T10:47:18.014 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.014+0000 7f3ba9132800 4 Realm: () 2024-09-14T10:47:18.014 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.014+0000 7f3ba9132800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T10:47:18.014 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.014+0000 7f3ba9132800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T10:47:18.014 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.014+0000 7f3ba9132800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:47:18.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.014+0000 7f3ba9132800 20 zonegroup default 2024-09-14T10:47:18.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.014+0000 7f3ba9132800 20 rados->read ofs=0 len=0 2024-09-14T10:47:18.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.014+0000 7f3ba9132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:18.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.014+0000 7f3ba9132800 20 rados->read ofs=0 len=0 2024-09-14T10:47:18.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.014+0000 7f3ba9132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:18.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.014+0000 7f3ba9132800 20 rados->read ofs=0 len=0 2024-09-14T10:47:18.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.015+0000 7f3ba9132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:18.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.015+0000 7f3ba9132800 20 started sync module instance, tier type = 2024-09-14T10:47:18.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.015+0000 7f3ba9132800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T10:47:18.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.024+0000 7f3ba9132800 20 add_watcher() i=0 2024-09-14T10:47:18.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.024+0000 7f3ba9132800 20 add_watcher() i=1 2024-09-14T10:47:18.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.024+0000 7f3ba9132800 20 add_watcher() i=2 2024-09-14T10:47:18.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.024+0000 7f3ba9132800 20 add_watcher() i=3 2024-09-14T10:47:18.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.024+0000 7f3ba9132800 20 add_watcher() i=4 2024-09-14T10:47:18.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.024+0000 7f3ba9132800 20 add_watcher() i=5 2024-09-14T10:47:18.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.024+0000 7f3ba9132800 20 add_watcher() i=6 2024-09-14T10:47:18.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.025+0000 7f3ba9132800 20 add_watcher() i=7 2024-09-14T10:47:18.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.025+0000 7f3ba9132800 2 all 8 watchers are set, enabling cache 2024-09-14T10:47:18.025 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.027+0000 7f3a5afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:18.026 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.027+0000 7f3ba9132800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:47:18.026 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.027+0000 7f3ba9132800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:47:18.026 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.027+0000 7f3ba9132800 5 note: GC not initialized 2024-09-14T10:47:18.026 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.028+0000 7f3a59fe3640 20 reqs_thread_entry: start 2024-09-14T10:47:18.026 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.028+0000 7f3ba9132800 20 init_complete bucket index max shards: 11 2024-09-14T10:47:18.027 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.028+0000 7f3ba9132800 20 Filter name: none 2024-09-14T10:47:18.027 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.028+0000 7f39cb7fe640 20 reqs_thread_entry: start 2024-09-14T10:47:18.027 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.028+0000 7f3ba9132800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T10:47:18.027 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.028+0000 7f3ba9132800 20 rados->read ofs=0 len=0 2024-09-14T10:47:18.028 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.028+0000 7f3ba9132800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:47:18.028 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.028+0000 7f3ba9132800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T10:47:18.028 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.028+0000 7f3ba9132800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T10:47:18.028 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.028+0000 7f3ba9132800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1 : miss 2024-09-14T10:47:18.028 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.028+0000 7f3ba9132800 20 rados->read ofs=0 len=0 2024-09-14T10:47:18.028 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.029+0000 7f3ba9132800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:47:18.028 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.029+0000 7f3ba9132800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1 info.flags=0x17 2024-09-14T10:47:18.028 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.029+0000 7f3ba9132800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1 to cache LRU end 2024-09-14T10:47:18.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.029+0000 7f3ba9132800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:47:18.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.029+0000 7f3ba9132800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T10:47:18.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.029+0000 7f3ba9132800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1 2024-09-14T10:47:18.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.029+0000 7f3ba9132800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.0 2024-09-14T10:47:18.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.029+0000 7f3ba9132800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-14T10:47:18.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.029+0000 7f3ba9132800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.1 2024-09-14T10:47:18.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.030+0000 7f3ba9132800 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-14T10:47:18.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.030+0000 7f3ba9132800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.2 2024-09-14T10:47:18.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.030+0000 7f3ba9132800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-14T10:47:18.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.030+0000 7f3ba9132800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.3 2024-09-14T10:47:18.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.031+0000 7f3ba9132800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-14T10:47:18.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.031+0000 7f3ba9132800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.4 2024-09-14T10:47:18.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.031+0000 7f3ba9132800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-14T10:47:18.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.031+0000 7f3ba9132800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.5 2024-09-14T10:47:18.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.031+0000 7f3ba9132800 20 get_obj_state: octx=0x55fe95134360 obj=check-bucket:d state=0x55fe954024e8 s->prefetch_data=0 2024-09-14T10:47:18.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.031+0000 7f3ba9132800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.6 2024-09-14T10:47:18.031 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.032+0000 7f3ba9132800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-14T10:47:18.031 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.032+0000 7f3ba9132800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.7 2024-09-14T10:47:18.031 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.033+0000 7f3ba9132800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-14T10:47:18.031 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.033+0000 7f3ba9132800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.8 2024-09-14T10:47:18.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.033+0000 7f3ba9132800 20 get_obj_state: octx=0x55fe9515c530 obj=check-bucket:c state=0x55fe953fd7f8 s->prefetch_data=0 2024-09-14T10:47:18.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.033+0000 7f3ba9132800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.9 2024-09-14T10:47:18.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.034+0000 7f3ba9132800 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-14T10:47:18.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.034+0000 7f3ba9132800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.10 2024-09-14T10:47:18.033 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.034+0000 7f3ba9132800 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-14T10:47:18.033 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.034+0000 7f3ba9132800 20 get_obj_state: setting s->obj_tag to arro1pt8m1dkun1y4tvklewgk82i77y4 2024-09-14T10:47:18.033 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.034+0000 7f3ba9132800 20 get_obj_state_impl: setting s->olh_tag to nx6x5wbs95rvzhwr1fj3khphwq92suy5 2024-09-14T10:47:18.033 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.034+0000 7f3ba9132800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.5 2024-09-14T10:47:18.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.034+0000 7f3ba9132800 20 get_obj_state: setting s->obj_tag to bk1g7xtoaey439j3sscv8o1rj69zq3bd 2024-09-14T10:47:18.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.034+0000 7f3ba9132800 20 get_obj_state_impl: setting s->olh_tag to dby70psvt6oizaw2gz56n6h9k4ugilhk 2024-09-14T10:47:18.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.034+0000 7f3ba9132800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.8 2024-09-14T10:47:18.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.034+0000 7f3ba9132800 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-09-14T10:47:18.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.034+0000 7f3ba9132800 20 olh_log_entry: epoch=4 op=3 key=c[ayEpDJ8Xt8FNtjozNoiv4YViTajYAGB] 2024-09-14T10:47:18.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.034+0000 7f3ba9132800 20 get_obj_state: octx=0x55fe9545c5b0 obj=check-bucket:_:ayEpDJ8Xt8FNtjozNoiv4YViTajYAGB_c state=0x55fe953fe358 s->prefetch_data=0 2024-09-14T10:47:18.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.034+0000 7f3ba9132800 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-09-14T10:47:18.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.034+0000 7f3ba9132800 20 olh_log_entry: epoch=4 op=3 key=d[KqN6OIGTSf6Bu3YRVYxvJmQ51tnjfjr] 2024-09-14T10:47:18.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.034+0000 7f3ba9132800 20 get_obj_state: octx=0x55fe9543c5b0 obj=check-bucket:_:KqN6OIGTSf6Bu3YRVYxvJmQ51tnjfjr_d state=0x55fe9546aab8 s->prefetch_data=0 2024-09-14T10:47:18.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.036+0000 7f3ba9132800 20 get_obj_state: octx=0x55fe9543c5b0 obj=check-bucket:d state=0x55fe953fe358 s->prefetch_data=0 2024-09-14T10:47:18.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.036+0000 7f3ba9132800 20 get_obj_state: octx=0x55fe9545c5b0 obj=check-bucket:c state=0x55fe9546bb78 s->prefetch_data=0 2024-09-14T10:47:18.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.036+0000 7f3ba9132800 20 get_obj_state: setting s->obj_tag to arro1pt8m1dkun1y4tvklewgk82i77y4 2024-09-14T10:47:18.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.036+0000 7f3ba9132800 20 get_obj_state_impl: setting s->olh_tag to nx6x5wbs95rvzhwr1fj3khphwq92suy5 2024-09-14T10:47:18.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.036+0000 7f3ba9132800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=nx6x5wbs95rvzhwr1fj3khphwq92suy5 2024-09-14T10:47:18.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.036+0000 7f3ba9132800 20 get_obj_state: setting s->obj_tag to bk1g7xtoaey439j3sscv8o1rj69zq3bd 2024-09-14T10:47:18.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.036+0000 7f3ba9132800 20 get_obj_state_impl: setting s->olh_tag to dby70psvt6oizaw2gz56n6h9k4ugilhk 2024-09-14T10:47:18.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.036+0000 7f3ba9132800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=dby70psvt6oizaw2gz56n6h9k4ugilhk 2024-09-14T10:47:18.036 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.038+0000 7f3ba9132800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.5 2024-09-14T10:47:18.039 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.041+0000 7f3ba9132800 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-14T10:47:18.042 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.044+0000 7f3ba9132800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.8 2024-09-14T10:47:18.044 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.045+0000 7f3ba9132800 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-14T10:47:18.044 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.045+0000 7f3ba9132800 1 NOTICE: finished all shards (2 entries removed) 2024-09-14T10:47:18.045 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.046+0000 7f3a5afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:18.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.049+0000 7f3ba9132800 20 remove_watcher() i=0 2024-09-14T10:47:18.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.049+0000 7f3ba9132800 2 removed watcher, disabling cache 2024-09-14T10:47:18.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.050+0000 7f3ba9132800 20 remove_watcher() i=1 2024-09-14T10:47:18.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.051+0000 7f3ba9132800 20 remove_watcher() i=2 2024-09-14T10:47:18.050 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.052+0000 7f3ba9132800 20 remove_watcher() i=3 2024-09-14T10:47:18.051 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.053+0000 7f3ba9132800 20 remove_watcher() i=4 2024-09-14T10:47:18.052 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.054+0000 7f3ba9132800 20 remove_watcher() i=5 2024-09-14T10:47:18.053 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.055+0000 7f3ba9132800 20 remove_watcher() i=6 2024-09-14T10:47:18.054 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.056+0000 7f3ba9132800 20 remove_watcher() i=7 2024-09-14T10:47:18.066 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T10:47:18.097 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:47:18.097 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:47:18.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.135+0000 7f7201926800 20 rados->read ofs=0 len=0 2024-09-14T10:47:18.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.137+0000 7f7201926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:18.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.137+0000 7f7201926800 20 realm 2024-09-14T10:47:18.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.137+0000 7f7201926800 20 rados->read ofs=0 len=0 2024-09-14T10:47:18.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.137+0000 7f7201926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:18.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.137+0000 7f7201926800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:47:18.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.137+0000 7f7201926800 20 rados->read ofs=0 len=0 2024-09-14T10:47:18.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.137+0000 7f7201926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:18.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.137+0000 7f7201926800 20 rados->read ofs=0 len=0 2024-09-14T10:47:18.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.138+0000 7f7201926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:18.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.138+0000 7f7201926800 20 rados->read ofs=0 len=0 2024-09-14T10:47:18.137 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.139+0000 7f7201926800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:47:18.137 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.139+0000 7f7201926800 20 searching for the correct realm 2024-09-14T10:47:18.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.141+0000 7f71f7fff640 0 -- 172.21.15.97:0/3320668972 >> [v2:172.21.15.97:6816/4093696477,v1:172.21.15.97:6817/4093696477] conn(0x5641fac2ca70 msgr2=0x5641fac2ee60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:47:18.142 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.144+0000 7f71f7fff640 0 -- 172.21.15.97:0/3320668972 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f71f0093b70 msgr2=0x7f71f004ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:47:18.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.350+0000 7f7201926800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:47:18.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.350+0000 7f7201926800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:47:18.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.350+0000 7f7201926800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T10:47:18.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.350+0000 7f7201926800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T10:47:18.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.350+0000 7f7201926800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:47:18.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.350+0000 7f7201926800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:47:18.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.350+0000 7f7201926800 20 rados->read ofs=0 len=0 2024-09-14T10:47:18.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.350+0000 7f7201926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:18.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.350+0000 7f7201926800 20 rados->read ofs=0 len=0 2024-09-14T10:47:18.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.350+0000 7f7201926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:18.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.350+0000 7f7201926800 20 rados->read ofs=0 len=0 2024-09-14T10:47:18.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.351+0000 7f7201926800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:47:18.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.351+0000 7f7201926800 20 zone default found 2024-09-14T10:47:18.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.351+0000 7f7201926800 4 Realm: () 2024-09-14T10:47:18.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.351+0000 7f7201926800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T10:47:18.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.351+0000 7f7201926800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T10:47:18.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.351+0000 7f7201926800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:47:18.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.351+0000 7f7201926800 20 zonegroup default 2024-09-14T10:47:18.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.351+0000 7f7201926800 20 rados->read ofs=0 len=0 2024-09-14T10:47:18.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.351+0000 7f7201926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:18.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.351+0000 7f7201926800 20 rados->read ofs=0 len=0 2024-09-14T10:47:18.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.351+0000 7f7201926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:18.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.351+0000 7f7201926800 20 rados->read ofs=0 len=0 2024-09-14T10:47:18.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.352+0000 7f7201926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:18.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.352+0000 7f7201926800 20 started sync module instance, tier type = 2024-09-14T10:47:18.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.352+0000 7f7201926800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T10:47:18.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.369+0000 7f7201926800 20 add_watcher() i=0 2024-09-14T10:47:18.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.369+0000 7f7201926800 20 add_watcher() i=1 2024-09-14T10:47:18.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.369+0000 7f7201926800 20 add_watcher() i=2 2024-09-14T10:47:18.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.369+0000 7f7201926800 20 add_watcher() i=3 2024-09-14T10:47:18.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.369+0000 7f7201926800 20 add_watcher() i=4 2024-09-14T10:47:18.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.369+0000 7f7201926800 20 add_watcher() i=5 2024-09-14T10:47:18.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.369+0000 7f7201926800 20 add_watcher() i=6 2024-09-14T10:47:18.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.372+0000 7f7201926800 20 add_watcher() i=7 2024-09-14T10:47:18.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.372+0000 7f7201926800 2 all 8 watchers are set, enabling cache 2024-09-14T10:47:18.372 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.373+0000 7f70b3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:18.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.374+0000 7f7201926800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:47:18.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.374+0000 7f7201926800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:47:18.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.374+0000 7f7201926800 5 note: GC not initialized 2024-09-14T10:47:18.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.374+0000 7f70b2fe5640 20 reqs_thread_entry: start 2024-09-14T10:47:18.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.374+0000 7f7201926800 20 init_complete bucket index max shards: 11 2024-09-14T10:47:18.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.374+0000 7f7201926800 20 Filter name: none 2024-09-14T10:47:18.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.374+0000 7f70b0fe1640 20 reqs_thread_entry: start 2024-09-14T10:47:18.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.374+0000 7f7201926800 20 rados->read ofs=0 len=0 2024-09-14T10:47:18.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.375+0000 7f7201926800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:47:18.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.375+0000 7f7201926800 20 rados->read ofs=0 len=0 2024-09-14T10:47:18.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.375+0000 7f7201926800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:47:18.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.376+0000 7f7201926800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:47:18.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.376+0000 7f7201926800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T10:47:18.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.376+0000 7f7201926800 20 INFO: main: starting shard=0 2024-09-14T10:47:18.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.376+0000 7f7201926800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.0 2024-09-14T10:47:18.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.376+0000 7f7201926800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:18.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.376+0000 7f7201926800 20 INFO: main: starting shard=1 2024-09-14T10:47:18.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.376+0000 7f7201926800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.1 2024-09-14T10:47:18.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.376+0000 7f7201926800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:18.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.376+0000 7f7201926800 20 INFO: main: starting shard=2 2024-09-14T10:47:18.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.376+0000 7f7201926800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.2 2024-09-14T10:47:18.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.377+0000 7f7201926800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:18.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.377+0000 7f7201926800 20 INFO: main: starting shard=3 2024-09-14T10:47:18.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.377+0000 7f7201926800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.3 2024-09-14T10:47:18.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.378+0000 7f7201926800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:18.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.378+0000 7f7201926800 20 INFO: main: starting shard=4 2024-09-14T10:47:18.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.378+0000 7f7201926800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.4 2024-09-14T10:47:18.379 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.378+0000 7f7201926800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:18.379 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.378+0000 7f7201926800 20 INFO: main: starting shard=5 2024-09-14T10:47:18.379 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.378+0000 7f7201926800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.5 2024-09-14T10:47:18.379 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.379+0000 7f7201926800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:18.379 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.379+0000 7f7201926800 20 INFO: main: starting shard=6 2024-09-14T10:47:18.379 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.379+0000 7f7201926800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.6 2024-09-14T10:47:18.379 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.379+0000 7f7201926800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:18.379 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.379+0000 7f7201926800 20 INFO: main: starting shard=7 2024-09-14T10:47:18.379 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.379+0000 7f7201926800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.7 2024-09-14T10:47:18.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.380+0000 7f7201926800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:18.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.380+0000 7f7201926800 20 INFO: main: starting shard=8 2024-09-14T10:47:18.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.380+0000 7f7201926800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.8 2024-09-14T10:47:18.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.380+0000 7f7201926800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:18.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.380+0000 7f7201926800 20 INFO: main: starting shard=9 2024-09-14T10:47:18.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.380+0000 7f7201926800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.9 2024-09-14T10:47:18.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.381+0000 7f7201926800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:18.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.381+0000 7f7201926800 20 INFO: main: starting shard=10 2024-09-14T10:47:18.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.381+0000 7f7201926800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.10 2024-09-14T10:47:18.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.382+0000 7f7201926800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:18.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.382+0000 7f7201926800 20 INFO: main: done 2024-09-14T10:47:18.382 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.382+0000 7f70b3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:18.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.385+0000 7f7201926800 20 remove_watcher() i=0 2024-09-14T10:47:18.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.385+0000 7f7201926800 2 removed watcher, disabling cache 2024-09-14T10:47:18.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.386+0000 7f7201926800 20 remove_watcher() i=1 2024-09-14T10:47:18.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.387+0000 7f7201926800 20 remove_watcher() i=2 2024-09-14T10:47:18.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.388+0000 7f7201926800 20 remove_watcher() i=3 2024-09-14T10:47:18.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.389+0000 7f7201926800 20 remove_watcher() i=4 2024-09-14T10:47:18.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.390+0000 7f7201926800 20 remove_watcher() i=5 2024-09-14T10:47:18.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.391+0000 7f7201926800 20 remove_watcher() i=6 2024-09-14T10:47:18.391 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.392+0000 7f7201926800 20 remove_watcher() i=7 2024-09-14T10:47:18.402 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T10:47:18.433 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:47:18.433 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:47:18.471 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.471+0000 7fa07e53e800 20 rados->read ofs=0 len=0 2024-09-14T10:47:18.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.474+0000 7fa07e53e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:18.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.474+0000 7fa07e53e800 20 realm 2024-09-14T10:47:18.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.474+0000 7fa07e53e800 20 rados->read ofs=0 len=0 2024-09-14T10:47:18.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.474+0000 7fa07e53e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:18.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.474+0000 7fa07e53e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:47:18.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.474+0000 7fa07e53e800 20 rados->read ofs=0 len=0 2024-09-14T10:47:18.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.474+0000 7fa07e53e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:18.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.474+0000 7fa07e53e800 20 rados->read ofs=0 len=0 2024-09-14T10:47:18.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.475+0000 7fa07e53e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:18.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.475+0000 7fa07e53e800 20 rados->read ofs=0 len=0 2024-09-14T10:47:18.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.476+0000 7fa07e53e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:47:18.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.476+0000 7fa07e53e800 20 searching for the correct realm 2024-09-14T10:47:18.476 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.477+0000 7fa079aec640 0 -- 172.21.15.97:0/1436901914 >> [v2:172.21.15.97:6816/4093696477,v1:172.21.15.97:6817/4093696477] conn(0x55be45053560 msgr2=0x55be45055950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:47:18.479 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.480+0000 7fa07a2ed640 0 -- 172.21.15.97:0/1436901914 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7fa070020070 msgr2=0x7fa07005a940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:47:18.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.485+0000 7fa07e53e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:47:18.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.485+0000 7fa07e53e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:47:18.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.485+0000 7fa07e53e800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T10:47:18.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.485+0000 7fa07e53e800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T10:47:18.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.485+0000 7fa07e53e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:47:18.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.485+0000 7fa07e53e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:47:18.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.485+0000 7fa07e53e800 20 rados->read ofs=0 len=0 2024-09-14T10:47:18.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.485+0000 7fa07e53e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:18.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.485+0000 7fa07e53e800 20 rados->read ofs=0 len=0 2024-09-14T10:47:18.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.485+0000 7fa07e53e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:18.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.485+0000 7fa07e53e800 20 rados->read ofs=0 len=0 2024-09-14T10:47:18.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.486+0000 7fa07e53e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:47:18.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.486+0000 7fa07e53e800 20 zone default found 2024-09-14T10:47:18.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.486+0000 7fa07e53e800 4 Realm: () 2024-09-14T10:47:18.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.486+0000 7fa07e53e800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T10:47:18.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.486+0000 7fa07e53e800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T10:47:18.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.486+0000 7fa07e53e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:47:18.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.486+0000 7fa07e53e800 20 zonegroup default 2024-09-14T10:47:18.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.486+0000 7fa07e53e800 20 rados->read ofs=0 len=0 2024-09-14T10:47:18.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.486+0000 7fa07e53e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:18.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.486+0000 7fa07e53e800 20 rados->read ofs=0 len=0 2024-09-14T10:47:18.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.487+0000 7fa07e53e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:18.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.487+0000 7fa07e53e800 20 rados->read ofs=0 len=0 2024-09-14T10:47:18.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.487+0000 7fa07e53e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:18.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.487+0000 7fa07e53e800 20 started sync module instance, tier type = 2024-09-14T10:47:18.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.487+0000 7fa07e53e800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T10:47:18.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.497+0000 7fa07e53e800 20 add_watcher() i=0 2024-09-14T10:47:18.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.497+0000 7fa07e53e800 20 add_watcher() i=1 2024-09-14T10:47:18.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.497+0000 7fa07e53e800 20 add_watcher() i=2 2024-09-14T10:47:18.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.497+0000 7fa07e53e800 20 add_watcher() i=3 2024-09-14T10:47:18.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.497+0000 7fa07e53e800 20 add_watcher() i=4 2024-09-14T10:47:18.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.497+0000 7fa07e53e800 20 add_watcher() i=5 2024-09-14T10:47:18.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.497+0000 7fa07e53e800 20 add_watcher() i=6 2024-09-14T10:47:18.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.498+0000 7fa07e53e800 20 add_watcher() i=7 2024-09-14T10:47:18.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.498+0000 7fa07e53e800 2 all 8 watchers are set, enabling cache 2024-09-14T10:47:18.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.500+0000 7f9f30fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:18.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.501+0000 7fa07e53e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:47:18.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.501+0000 7fa07e53e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:47:18.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.501+0000 7fa07e53e800 5 note: GC not initialized 2024-09-14T10:47:18.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.501+0000 7f9eab7fe640 20 reqs_thread_entry: start 2024-09-14T10:47:18.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.501+0000 7fa07e53e800 20 init_complete bucket index max shards: 11 2024-09-14T10:47:18.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.501+0000 7fa07e53e800 20 Filter name: none 2024-09-14T10:47:18.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.501+0000 7f9ea97fa640 20 reqs_thread_entry: start 2024-09-14T10:47:18.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.501+0000 7fa07e53e800 20 rados->read ofs=0 len=0 2024-09-14T10:47:18.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.502+0000 7fa07e53e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:47:18.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.502+0000 7fa07e53e800 20 rados->read ofs=0 len=0 2024-09-14T10:47:18.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.503+0000 7fa07e53e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:47:18.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.503+0000 7fa07e53e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:47:18.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.503+0000 7fa07e53e800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T10:47:18.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.503+0000 7fa07e53e800 20 INFO: main: starting shard=0 2024-09-14T10:47:18.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.503+0000 7fa07e53e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.0 2024-09-14T10:47:18.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.503+0000 7fa07e53e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:18.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.503+0000 7fa07e53e800 20 INFO: main: starting shard=1 2024-09-14T10:47:18.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.503+0000 7fa07e53e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.1 2024-09-14T10:47:18.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.504+0000 7fa07e53e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:18.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.504+0000 7fa07e53e800 20 INFO: main: starting shard=2 2024-09-14T10:47:18.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.504+0000 7fa07e53e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.2 2024-09-14T10:47:18.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.504+0000 7fa07e53e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:18.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.504+0000 7fa07e53e800 20 INFO: main: starting shard=3 2024-09-14T10:47:18.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.504+0000 7fa07e53e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.3 2024-09-14T10:47:18.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.504+0000 7fa07e53e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:18.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.504+0000 7fa07e53e800 20 INFO: main: starting shard=4 2024-09-14T10:47:18.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.504+0000 7fa07e53e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.4 2024-09-14T10:47:18.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.505+0000 7fa07e53e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:18.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.505+0000 7fa07e53e800 20 INFO: main: starting shard=5 2024-09-14T10:47:18.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.505+0000 7fa07e53e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.5 2024-09-14T10:47:18.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.505+0000 7fa07e53e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:18.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.505+0000 7fa07e53e800 20 INFO: main: starting shard=6 2024-09-14T10:47:18.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.505+0000 7fa07e53e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.6 2024-09-14T10:47:18.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.506+0000 7fa07e53e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:18.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.506+0000 7fa07e53e800 20 INFO: main: starting shard=7 2024-09-14T10:47:18.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.506+0000 7fa07e53e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.7 2024-09-14T10:47:18.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.506+0000 7fa07e53e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:18.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.506+0000 7fa07e53e800 20 INFO: main: starting shard=8 2024-09-14T10:47:18.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.506+0000 7fa07e53e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.8 2024-09-14T10:47:18.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.507+0000 7fa07e53e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:18.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.507+0000 7fa07e53e800 20 INFO: main: starting shard=9 2024-09-14T10:47:18.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.507+0000 7fa07e53e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.9 2024-09-14T10:47:18.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.507+0000 7fa07e53e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:18.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.507+0000 7fa07e53e800 20 INFO: main: starting shard=10 2024-09-14T10:47:18.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.507+0000 7fa07e53e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.10 2024-09-14T10:47:18.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.508+0000 7fa07e53e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:18.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.508+0000 7fa07e53e800 20 INFO: main: done 2024-09-14T10:47:18.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.509+0000 7f9f30fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:18.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.511+0000 7fa07e53e800 20 remove_watcher() i=0 2024-09-14T10:47:18.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.511+0000 7fa07e53e800 2 removed watcher, disabling cache 2024-09-14T10:47:18.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.512+0000 7fa07e53e800 20 remove_watcher() i=1 2024-09-14T10:47:18.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.513+0000 7fa07e53e800 20 remove_watcher() i=2 2024-09-14T10:47:18.513 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.513+0000 7fa07e53e800 20 remove_watcher() i=3 2024-09-14T10:47:18.513 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.515+0000 7fa07e53e800 20 remove_watcher() i=4 2024-09-14T10:47:18.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.516+0000 7fa07e53e800 20 remove_watcher() i=5 2024-09-14T10:47:18.515 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.517+0000 7fa07e53e800 20 remove_watcher() i=6 2024-09-14T10:47:18.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.518+0000 7fa07e53e800 20 remove_watcher() i=7 2024-09-14T10:47:18.526 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-09-14T10:47:18.526 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T10:47:18.527 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-14T10:47:18.558 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:47:18.559 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:47:18.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.597+0000 7f51a0f46800 20 rados->read ofs=0 len=0 2024-09-14T10:47:18.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.598+0000 7f51a0f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:18.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.598+0000 7f51a0f46800 20 realm 2024-09-14T10:47:18.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.598+0000 7f51a0f46800 20 rados->read ofs=0 len=0 2024-09-14T10:47:18.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.598+0000 7f51a0f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:18.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.598+0000 7f51a0f46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:47:18.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.598+0000 7f51a0f46800 20 rados->read ofs=0 len=0 2024-09-14T10:47:18.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.598+0000 7f51a0f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:18.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.598+0000 7f51a0f46800 20 rados->read ofs=0 len=0 2024-09-14T10:47:18.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.599+0000 7f51a0f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:18.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.599+0000 7f51a0f46800 20 rados->read ofs=0 len=0 2024-09-14T10:47:18.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.600+0000 7f51a0f46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:47:18.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.600+0000 7f51a0f46800 20 searching for the correct realm 2024-09-14T10:47:18.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.602+0000 7f519f231640 0 -- 172.21.15.97:0/3740075110 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f5188030060 msgr2=0x7f5188066480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:47:18.804 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.806+0000 7f5197fff640 0 -- 172.21.15.97:0/3740075110 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f519001a040 msgr2=0x7f519001a930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:47:18.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.811+0000 7f51a0f46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:47:18.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.811+0000 7f51a0f46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:47:18.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.811+0000 7f51a0f46800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T10:47:18.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.811+0000 7f51a0f46800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T10:47:18.810 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.811+0000 7f51a0f46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:47:18.810 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.811+0000 7f51a0f46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:47:18.810 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.811+0000 7f51a0f46800 20 rados->read ofs=0 len=0 2024-09-14T10:47:18.810 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.811+0000 7f51a0f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:18.810 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.811+0000 7f51a0f46800 20 rados->read ofs=0 len=0 2024-09-14T10:47:18.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.811+0000 7f51a0f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:18.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.811+0000 7f51a0f46800 20 rados->read ofs=0 len=0 2024-09-14T10:47:18.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.812+0000 7f51a0f46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:47:18.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.812+0000 7f51a0f46800 20 zone default found 2024-09-14T10:47:18.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.812+0000 7f51a0f46800 4 Realm: () 2024-09-14T10:47:18.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.812+0000 7f51a0f46800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T10:47:18.812 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.812+0000 7f51a0f46800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T10:47:18.812 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.812+0000 7f51a0f46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:47:18.812 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.812+0000 7f51a0f46800 20 zonegroup default 2024-09-14T10:47:18.812 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.812+0000 7f51a0f46800 20 rados->read ofs=0 len=0 2024-09-14T10:47:18.812 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.812+0000 7f51a0f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:18.812 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.812+0000 7f51a0f46800 20 rados->read ofs=0 len=0 2024-09-14T10:47:18.812 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.812+0000 7f51a0f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:18.812 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.812+0000 7f51a0f46800 20 rados->read ofs=0 len=0 2024-09-14T10:47:18.812 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.812+0000 7f51a0f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:18.812 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.813+0000 7f51a0f46800 20 started sync module instance, tier type = 2024-09-14T10:47:18.812 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.813+0000 7f51a0f46800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T10:47:18.820 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.821+0000 7f51a0f46800 20 add_watcher() i=0 2024-09-14T10:47:18.820 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.821+0000 7f51a0f46800 20 add_watcher() i=1 2024-09-14T10:47:18.820 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.821+0000 7f51a0f46800 20 add_watcher() i=2 2024-09-14T10:47:18.820 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.821+0000 7f51a0f46800 20 add_watcher() i=3 2024-09-14T10:47:18.820 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.821+0000 7f51a0f46800 20 add_watcher() i=4 2024-09-14T10:47:18.820 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.821+0000 7f51a0f46800 20 add_watcher() i=5 2024-09-14T10:47:18.820 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.821+0000 7f51a0f46800 20 add_watcher() i=6 2024-09-14T10:47:18.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.822+0000 7f51a0f46800 20 add_watcher() i=7 2024-09-14T10:47:18.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.822+0000 7f51a0f46800 2 all 8 watchers are set, enabling cache 2024-09-14T10:47:18.822 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.824+0000 7f50557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:18.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.824+0000 7f51a0f46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:47:18.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.824+0000 7f51a0f46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:47:18.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.824+0000 7f51a0f46800 5 note: GC not initialized 2024-09-14T10:47:18.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.825+0000 7f4fcffff640 20 reqs_thread_entry: start 2024-09-14T10:47:18.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.825+0000 7f51a0f46800 20 init_complete bucket index max shards: 11 2024-09-14T10:47:18.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.825+0000 7f51a0f46800 20 Filter name: none 2024-09-14T10:47:18.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.825+0000 7f4fcdffb640 20 reqs_thread_entry: start 2024-09-14T10:47:18.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.825+0000 7f51a0f46800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T10:47:18.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.825+0000 7f51a0f46800 20 rados->read ofs=0 len=0 2024-09-14T10:47:18.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.825+0000 7f51a0f46800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:47:18.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.825+0000 7f51a0f46800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T10:47:18.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.825+0000 7f51a0f46800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T10:47:18.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.825+0000 7f51a0f46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1 : miss 2024-09-14T10:47:18.825 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.825+0000 7f51a0f46800 20 rados->read ofs=0 len=0 2024-09-14T10:47:18.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.826+0000 7f51a0f46800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:47:18.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.826+0000 7f51a0f46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1 info.flags=0x17 2024-09-14T10:47:18.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.826+0000 7f51a0f46800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1 to cache LRU end 2024-09-14T10:47:18.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.826+0000 7f51a0f46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:47:18.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.826+0000 7f51a0f46800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T10:47:18.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.826+0000 7f51a0f46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1 2024-09-14T10:47:18.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.826+0000 7f51a0f46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.0 2024-09-14T10:47:18.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.826+0000 7f51a0f46800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T10:47:18.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.826+0000 7f51a0f46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.1 2024-09-14T10:47:18.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.827+0000 7f51a0f46800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T10:47:18.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.827+0000 7f51a0f46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.2 2024-09-14T10:47:18.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.827+0000 7f51a0f46800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T10:47:18.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.827+0000 7f51a0f46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.3 2024-09-14T10:47:18.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.827+0000 7f51a0f46800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T10:47:18.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.827+0000 7f51a0f46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.4 2024-09-14T10:47:18.828 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.828+0000 7f51a0f46800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T10:47:18.828 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.828+0000 7f51a0f46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.5 2024-09-14T10:47:18.828 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.828+0000 7f51a0f46800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-14T10:47:18.828 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.828+0000 7f51a0f46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.6 2024-09-14T10:47:18.828 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.829+0000 7f51a0f46800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T10:47:18.828 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.829+0000 7f51a0f46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.7 2024-09-14T10:47:18.828 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.829+0000 7f51a0f46800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T10:47:18.828 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.829+0000 7f51a0f46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.8 2024-09-14T10:47:18.828 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.830+0000 7f51a0f46800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-14T10:47:18.828 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.830+0000 7f51a0f46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.9 2024-09-14T10:47:18.829 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.830+0000 7f51a0f46800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T10:47:18.829 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.830+0000 7f51a0f46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.10 2024-09-14T10:47:18.829 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.830+0000 7f51a0f46800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T10:47:18.829 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.830+0000 7f51a0f46800 1 NOTICE: finished all shards (0 entries found) 2024-09-14T10:47:18.829 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.831+0000 7f50557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:18.832 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.834+0000 7f51a0f46800 20 remove_watcher() i=0 2024-09-14T10:47:18.832 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.834+0000 7f51a0f46800 2 removed watcher, disabling cache 2024-09-14T10:47:18.833 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.835+0000 7f51a0f46800 20 remove_watcher() i=1 2024-09-14T10:47:18.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.836+0000 7f51a0f46800 20 remove_watcher() i=2 2024-09-14T10:47:18.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.837+0000 7f51a0f46800 20 remove_watcher() i=3 2024-09-14T10:47:18.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.837+0000 7f51a0f46800 20 remove_watcher() i=4 2024-09-14T10:47:18.837 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.838+0000 7f51a0f46800 20 remove_watcher() i=5 2024-09-14T10:47:18.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.839+0000 7f51a0f46800 20 remove_watcher() i=6 2024-09-14T10:47:18.841 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:18.842+0000 7f51a0f46800 20 remove_watcher() i=7 2024-09-14T10:47:18.851 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-09-14T10:47:18.851 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T10:47:18.903 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-09-14T10:47:18.904 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T10:47:19.093 INFO:tasks.workunit.client.0.smithi097.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T10:47:19.483 INFO:tasks.workunit.client.0.smithi097.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-14T10:47:20.928 INFO:tasks.workunit.client.0.smithi097.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T10:47:20.930 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T10:47:20.964 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:47:20.964 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:47:21.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.005+0000 7f9839a13800 20 rados->read ofs=0 len=0 2024-09-14T10:47:21.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.007+0000 7f9839a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:21.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.007+0000 7f9839a13800 20 realm 2024-09-14T10:47:21.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.007+0000 7f9839a13800 20 rados->read ofs=0 len=0 2024-09-14T10:47:21.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.007+0000 7f9839a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:21.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.007+0000 7f9839a13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:47:21.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.007+0000 7f9839a13800 20 rados->read ofs=0 len=0 2024-09-14T10:47:21.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.008+0000 7f9839a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:21.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.008+0000 7f9839a13800 20 rados->read ofs=0 len=0 2024-09-14T10:47:21.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.008+0000 7f9839a13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:21.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.008+0000 7f9839a13800 20 rados->read ofs=0 len=0 2024-09-14T10:47:21.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.009+0000 7f9839a13800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:47:21.009 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.009+0000 7f9839a13800 20 searching for the correct realm 2024-09-14T10:47:21.009 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.010+0000 7f9835148640 0 -- 172.21.15.97:0/2360279153 >> [v2:172.21.15.152:6808/1010851305,v1:172.21.15.152:6809/1010851305] conn(0x55e4cf73e650 msgr2=0x55e4cf740af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:47:21.013 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.014+0000 7f9835949640 0 -- 172.21.15.97:0/2360279153 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x55e4cf732260 msgr2=0x55e4cf734690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:47:21.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.225+0000 7f9839a13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:47:21.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.225+0000 7f9839a13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:47:21.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.225+0000 7f9839a13800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T10:47:21.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.225+0000 7f9839a13800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T10:47:21.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.225+0000 7f9839a13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:47:21.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.225+0000 7f9839a13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:47:21.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.225+0000 7f9839a13800 20 rados->read ofs=0 len=0 2024-09-14T10:47:21.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.225+0000 7f9839a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:21.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.225+0000 7f9839a13800 20 rados->read ofs=0 len=0 2024-09-14T10:47:21.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.226+0000 7f9839a13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:21.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.226+0000 7f9839a13800 20 rados->read ofs=0 len=0 2024-09-14T10:47:21.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.226+0000 7f9839a13800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:47:21.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.226+0000 7f9839a13800 20 zone default found 2024-09-14T10:47:21.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.226+0000 7f9839a13800 4 Realm: () 2024-09-14T10:47:21.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.226+0000 7f9839a13800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T10:47:21.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.226+0000 7f9839a13800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T10:47:21.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.226+0000 7f9839a13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:47:21.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.226+0000 7f9839a13800 20 zonegroup default 2024-09-14T10:47:21.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.226+0000 7f9839a13800 20 rados->read ofs=0 len=0 2024-09-14T10:47:21.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.226+0000 7f9839a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:21.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.226+0000 7f9839a13800 20 rados->read ofs=0 len=0 2024-09-14T10:47:21.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.227+0000 7f9839a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:21.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.227+0000 7f9839a13800 20 rados->read ofs=0 len=0 2024-09-14T10:47:21.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.227+0000 7f9839a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:21.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.227+0000 7f9839a13800 20 started sync module instance, tier type = 2024-09-14T10:47:21.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.227+0000 7f9839a13800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T10:47:21.237 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.238+0000 7f9839a13800 20 add_watcher() i=0 2024-09-14T10:47:21.237 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.238+0000 7f9839a13800 20 add_watcher() i=1 2024-09-14T10:47:21.237 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.238+0000 7f9839a13800 20 add_watcher() i=2 2024-09-14T10:47:21.238 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.238+0000 7f9839a13800 20 add_watcher() i=3 2024-09-14T10:47:21.238 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.238+0000 7f9839a13800 20 add_watcher() i=4 2024-09-14T10:47:21.238 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.238+0000 7f9839a13800 20 add_watcher() i=5 2024-09-14T10:47:21.238 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.238+0000 7f9839a13800 20 add_watcher() i=6 2024-09-14T10:47:21.238 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.240+0000 7f9839a13800 20 add_watcher() i=7 2024-09-14T10:47:21.238 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.240+0000 7f9839a13800 2 all 8 watchers are set, enabling cache 2024-09-14T10:47:21.240 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.241+0000 7f96ebfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:21.241 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.241+0000 7f9839a13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:47:21.241 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.241+0000 7f9839a13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:47:21.242 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.241+0000 7f9839a13800 5 note: GC not initialized 2024-09-14T10:47:21.242 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.242+0000 7f96eafe5640 20 reqs_thread_entry: start 2024-09-14T10:47:21.242 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.242+0000 7f9839a13800 20 init_complete bucket index max shards: 11 2024-09-14T10:47:21.242 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.242+0000 7f9839a13800 20 Filter name: none 2024-09-14T10:47:21.242 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.242+0000 7f96e8fe1640 20 reqs_thread_entry: start 2024-09-14T10:47:21.242 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.242+0000 7f9839a13800 20 rados->read ofs=0 len=0 2024-09-14T10:47:21.243 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.242+0000 7f9839a13800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:47:21.243 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.243+0000 7f9839a13800 20 rados->read ofs=0 len=0 2024-09-14T10:47:21.243 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.243+0000 7f9839a13800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:47:21.243 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.243+0000 7f9839a13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:47:21.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.243+0000 7f9839a13800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T10:47:21.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.243+0000 7f9839a13800 20 INFO: main: starting shard=0 2024-09-14T10:47:21.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.243+0000 7f9839a13800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.0 2024-09-14T10:47:21.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.243+0000 7f9839a13800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:21.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.243+0000 7f9839a13800 20 INFO: main: starting shard=1 2024-09-14T10:47:21.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.243+0000 7f9839a13800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.1 2024-09-14T10:47:21.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.244+0000 7f9839a13800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:21.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.244+0000 7f9839a13800 20 INFO: main: starting shard=2 2024-09-14T10:47:21.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.244+0000 7f9839a13800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.2 2024-09-14T10:47:21.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.244+0000 7f9839a13800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:21.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.244+0000 7f9839a13800 20 INFO: main: starting shard=3 2024-09-14T10:47:21.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.244+0000 7f9839a13800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.3 2024-09-14T10:47:21.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.245+0000 7f9839a13800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:21.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.245+0000 7f9839a13800 20 INFO: main: starting shard=4 2024-09-14T10:47:21.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.245+0000 7f9839a13800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.4 2024-09-14T10:47:21.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.245+0000 7f9839a13800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:21.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.245+0000 7f9839a13800 20 INFO: main: starting shard=5 2024-09-14T10:47:21.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.245+0000 7f9839a13800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.5 2024-09-14T10:47:21.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.246+0000 7f9839a13800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:21.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.246+0000 7f9839a13800 20 INFO: main: starting shard=6 2024-09-14T10:47:21.247 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.246+0000 7f9839a13800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.6 2024-09-14T10:47:21.247 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.246+0000 7f9839a13800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:21.247 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.246+0000 7f9839a13800 20 INFO: main: starting shard=7 2024-09-14T10:47:21.247 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.246+0000 7f9839a13800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.7 2024-09-14T10:47:21.248 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.247+0000 7f9839a13800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:21.248 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.247+0000 7f9839a13800 20 INFO: main: starting shard=8 2024-09-14T10:47:21.248 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.247+0000 7f9839a13800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.8 2024-09-14T10:47:21.248 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.248+0000 7f9839a13800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T10:47:21.248 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.248+0000 7f9839a13800 20 INFO: main: starting shard=9 2024-09-14T10:47:21.248 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.248+0000 7f9839a13800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.9 2024-09-14T10:47:21.249 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.248+0000 7f9839a13800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:21.249 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.248+0000 7f9839a13800 20 INFO: main: starting shard=10 2024-09-14T10:47:21.249 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.248+0000 7f9839a13800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.10 2024-09-14T10:47:21.249 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.249+0000 7f9839a13800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:21.249 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.249+0000 7f9839a13800 20 INFO: main: done 2024-09-14T10:47:21.249 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.249+0000 7f96ebfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:21.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.252+0000 7f9839a13800 20 remove_watcher() i=0 2024-09-14T10:47:21.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.252+0000 7f9839a13800 2 removed watcher, disabling cache 2024-09-14T10:47:21.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.253+0000 7f9839a13800 20 remove_watcher() i=1 2024-09-14T10:47:21.253 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.254+0000 7f9839a13800 20 remove_watcher() i=2 2024-09-14T10:47:21.254 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.255+0000 7f9839a13800 20 remove_watcher() i=3 2024-09-14T10:47:21.256 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.256+0000 7f9839a13800 20 remove_watcher() i=4 2024-09-14T10:47:21.257 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.257+0000 7f9839a13800 20 remove_watcher() i=5 2024-09-14T10:47:21.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.259+0000 7f9839a13800 20 remove_watcher() i=6 2024-09-14T10:47:21.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.261+0000 7f9839a13800 20 remove_watcher() i=7 2024-09-14T10:47:21.325 INFO:tasks.workunit.client.0.smithi097.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T10:47:21.326 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T10:47:21.356 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:47:21.356 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:47:21.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.393+0000 7fc14bd26800 20 rados->read ofs=0 len=0 2024-09-14T10:47:21.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.395+0000 7fc14bd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:21.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.395+0000 7fc14bd26800 20 realm 2024-09-14T10:47:21.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.395+0000 7fc14bd26800 20 rados->read ofs=0 len=0 2024-09-14T10:47:21.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.395+0000 7fc14bd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:21.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.395+0000 7fc14bd26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:47:21.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.395+0000 7fc14bd26800 20 rados->read ofs=0 len=0 2024-09-14T10:47:21.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.396+0000 7fc14bd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:21.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.396+0000 7fc14bd26800 20 rados->read ofs=0 len=0 2024-09-14T10:47:21.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.396+0000 7fc14bd26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:21.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.396+0000 7fc14bd26800 20 rados->read ofs=0 len=0 2024-09-14T10:47:21.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.397+0000 7fc14bd26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:47:21.397 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.397+0000 7fc14bd26800 20 searching for the correct realm 2024-09-14T10:47:21.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.400+0000 7fc14824c640 0 -- 172.21.15.97:0/3861953531 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7fc130080070 msgr2=0x7fc13008f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T10:47:21.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.606+0000 7fc13f24a640 0 -- 172.21.15.97:0/3861953531 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7fc138018920 msgr2=0x7fc13804a400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:47:21.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.612+0000 7fc14bd26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:47:21.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.612+0000 7fc14bd26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:47:21.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.612+0000 7fc14bd26800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T10:47:21.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.612+0000 7fc14bd26800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T10:47:21.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.612+0000 7fc14bd26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:47:21.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.612+0000 7fc14bd26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:47:21.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.612+0000 7fc14bd26800 20 rados->read ofs=0 len=0 2024-09-14T10:47:21.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.612+0000 7fc14bd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:21.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.612+0000 7fc14bd26800 20 rados->read ofs=0 len=0 2024-09-14T10:47:21.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.613+0000 7fc14bd26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:21.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.613+0000 7fc14bd26800 20 rados->read ofs=0 len=0 2024-09-14T10:47:21.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.613+0000 7fc14bd26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:47:21.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.613+0000 7fc14bd26800 20 zone default found 2024-09-14T10:47:21.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.613+0000 7fc14bd26800 4 Realm: () 2024-09-14T10:47:21.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.613+0000 7fc14bd26800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T10:47:21.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.613+0000 7fc14bd26800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T10:47:21.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.613+0000 7fc14bd26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:47:21.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.613+0000 7fc14bd26800 20 zonegroup default 2024-09-14T10:47:21.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.613+0000 7fc14bd26800 20 rados->read ofs=0 len=0 2024-09-14T10:47:21.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.613+0000 7fc14bd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:21.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.614+0000 7fc14bd26800 20 rados->read ofs=0 len=0 2024-09-14T10:47:21.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.614+0000 7fc14bd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:21.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.614+0000 7fc14bd26800 20 rados->read ofs=0 len=0 2024-09-14T10:47:21.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.614+0000 7fc14bd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:21.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.614+0000 7fc14bd26800 20 started sync module instance, tier type = 2024-09-14T10:47:21.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.614+0000 7fc14bd26800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T10:47:21.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.627+0000 7fc14bd26800 20 add_watcher() i=0 2024-09-14T10:47:21.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.627+0000 7fc14bd26800 20 add_watcher() i=1 2024-09-14T10:47:21.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.627+0000 7fc14bd26800 20 add_watcher() i=2 2024-09-14T10:47:21.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.627+0000 7fc14bd26800 20 add_watcher() i=3 2024-09-14T10:47:21.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.627+0000 7fc14bd26800 20 add_watcher() i=4 2024-09-14T10:47:21.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.627+0000 7fc14bd26800 20 add_watcher() i=5 2024-09-14T10:47:21.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.627+0000 7fc14bd26800 20 add_watcher() i=6 2024-09-14T10:47:21.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.629+0000 7fc14bd26800 20 add_watcher() i=7 2024-09-14T10:47:21.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.629+0000 7fc14bd26800 2 all 8 watchers are set, enabling cache 2024-09-14T10:47:21.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.630+0000 7fbffdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:21.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.631+0000 7fc14bd26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:47:21.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.631+0000 7fc14bd26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:47:21.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.631+0000 7fc14bd26800 5 note: GC not initialized 2024-09-14T10:47:21.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.631+0000 7fbffcfe1640 20 reqs_thread_entry: start 2024-09-14T10:47:21.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.631+0000 7fc14bd26800 20 init_complete bucket index max shards: 11 2024-09-14T10:47:21.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.631+0000 7fc14bd26800 20 Filter name: none 2024-09-14T10:47:21.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.631+0000 7fbf767fc640 20 reqs_thread_entry: start 2024-09-14T10:47:21.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.631+0000 7fc14bd26800 20 rados->read ofs=0 len=0 2024-09-14T10:47:21.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.632+0000 7fc14bd26800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:47:21.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.632+0000 7fc14bd26800 20 rados->read ofs=0 len=0 2024-09-14T10:47:21.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.632+0000 7fc14bd26800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:47:21.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.632+0000 7fc14bd26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:47:21.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.632+0000 7fc14bd26800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T10:47:21.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.632+0000 7fc14bd26800 20 INFO: main: starting shard=0 2024-09-14T10:47:21.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.632+0000 7fc14bd26800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.0 2024-09-14T10:47:21.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.633+0000 7fc14bd26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:21.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.633+0000 7fc14bd26800 20 INFO: main: starting shard=1 2024-09-14T10:47:21.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.633+0000 7fc14bd26800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.1 2024-09-14T10:47:21.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.633+0000 7fc14bd26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:21.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.633+0000 7fc14bd26800 20 INFO: main: starting shard=2 2024-09-14T10:47:21.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.633+0000 7fc14bd26800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.2 2024-09-14T10:47:21.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.634+0000 7fc14bd26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:21.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.634+0000 7fc14bd26800 20 INFO: main: starting shard=3 2024-09-14T10:47:21.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.634+0000 7fc14bd26800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.3 2024-09-14T10:47:21.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.634+0000 7fc14bd26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:21.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.634+0000 7fc14bd26800 20 INFO: main: starting shard=4 2024-09-14T10:47:21.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.634+0000 7fc14bd26800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.4 2024-09-14T10:47:21.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.635+0000 7fc14bd26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:21.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.635+0000 7fc14bd26800 20 INFO: main: starting shard=5 2024-09-14T10:47:21.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.635+0000 7fc14bd26800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.5 2024-09-14T10:47:21.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.635+0000 7fc14bd26800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T10:47:21.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.635+0000 7fc14bd26800 20 INFO: main: starting shard=6 2024-09-14T10:47:21.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.635+0000 7fc14bd26800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.6 2024-09-14T10:47:21.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.636+0000 7fc14bd26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:21.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.636+0000 7fc14bd26800 20 INFO: main: starting shard=7 2024-09-14T10:47:21.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.636+0000 7fc14bd26800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.7 2024-09-14T10:47:21.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.637+0000 7fc14bd26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:21.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.637+0000 7fc14bd26800 20 INFO: main: starting shard=8 2024-09-14T10:47:21.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.637+0000 7fc14bd26800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.8 2024-09-14T10:47:21.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.637+0000 7fc14bd26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:21.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.637+0000 7fc14bd26800 20 INFO: main: starting shard=9 2024-09-14T10:47:21.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.637+0000 7fc14bd26800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.9 2024-09-14T10:47:21.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.638+0000 7fc14bd26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:21.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.638+0000 7fc14bd26800 20 INFO: main: starting shard=10 2024-09-14T10:47:21.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.638+0000 7fc14bd26800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.10 2024-09-14T10:47:21.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.638+0000 7fc14bd26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:21.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.638+0000 7fc14bd26800 20 INFO: main: done 2024-09-14T10:47:21.639 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.639+0000 7fbffdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:21.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.641+0000 7fc14bd26800 20 remove_watcher() i=0 2024-09-14T10:47:21.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.641+0000 7fc14bd26800 2 removed watcher, disabling cache 2024-09-14T10:47:21.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.642+0000 7fc14bd26800 20 remove_watcher() i=1 2024-09-14T10:47:21.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.643+0000 7fc14bd26800 20 remove_watcher() i=2 2024-09-14T10:47:21.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.645+0000 7fc14bd26800 20 remove_watcher() i=3 2024-09-14T10:47:21.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.646+0000 7fc14bd26800 20 remove_watcher() i=4 2024-09-14T10:47:21.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.647+0000 7fc14bd26800 20 remove_watcher() i=5 2024-09-14T10:47:21.647 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.648+0000 7fc14bd26800 20 remove_watcher() i=6 2024-09-14T10:47:21.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.649+0000 7fc14bd26800 20 remove_watcher() i=7 2024-09-14T10:47:21.719 INFO:tasks.workunit.client.0.smithi097.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T10:47:21.721 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-14T10:47:21.752 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:47:21.752 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:47:21.789 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.790+0000 7fb499d2c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:21.791 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.792+0000 7fb499d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:21.791 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.792+0000 7fb499d2c800 20 realm 2024-09-14T10:47:21.791 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.792+0000 7fb499d2c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:21.791 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.792+0000 7fb499d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:21.791 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.792+0000 7fb499d2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:47:21.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.792+0000 7fb499d2c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:21.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.792+0000 7fb499d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:21.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.792+0000 7fb499d2c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:21.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.793+0000 7fb499d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:21.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.793+0000 7fb499d2c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:21.793 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.793+0000 7fb499d2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:47:21.793 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.793+0000 7fb499d2c800 20 searching for the correct realm 2024-09-14T10:47:21.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:21.796+0000 7fb49513d640 0 -- 172.21.15.97:0/135026480 >> [v2:172.21.15.97:6816/4093696477,v1:172.21.15.97:6817/4093696477] conn(0x7fb3600842b0 msgr2=0x7fb3600866a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:47:22.000 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.001+0000 7fb49593e640 0 -- 172.21.15.97:0/135026480 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7fb48c0ab4f0 msgr2=0x7fb48c0b4160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:47:22.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.006+0000 7fb499d2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:47:22.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.006+0000 7fb499d2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:47:22.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.006+0000 7fb499d2c800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T10:47:22.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.006+0000 7fb499d2c800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T10:47:22.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.006+0000 7fb499d2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:47:22.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.006+0000 7fb499d2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:47:22.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.006+0000 7fb499d2c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:22.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.007+0000 7fb499d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:22.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.007+0000 7fb499d2c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:22.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.007+0000 7fb499d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:22.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.007+0000 7fb499d2c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:22.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.007+0000 7fb499d2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:47:22.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.007+0000 7fb499d2c800 20 zone default found 2024-09-14T10:47:22.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.007+0000 7fb499d2c800 4 Realm: () 2024-09-14T10:47:22.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.007+0000 7fb499d2c800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T10:47:22.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.007+0000 7fb499d2c800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T10:47:22.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.007+0000 7fb499d2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:47:22.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.007+0000 7fb499d2c800 20 zonegroup default 2024-09-14T10:47:22.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.007+0000 7fb499d2c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:22.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.008+0000 7fb499d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:22.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.008+0000 7fb499d2c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:22.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.008+0000 7fb499d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:22.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.008+0000 7fb499d2c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:22.009 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.008+0000 7fb499d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:22.009 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.008+0000 7fb499d2c800 20 started sync module instance, tier type = 2024-09-14T10:47:22.009 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.008+0000 7fb499d2c800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T10:47:22.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.019+0000 7fb499d2c800 20 add_watcher() i=0 2024-09-14T10:47:22.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.019+0000 7fb499d2c800 20 add_watcher() i=1 2024-09-14T10:47:22.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.019+0000 7fb499d2c800 20 add_watcher() i=2 2024-09-14T10:47:22.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.019+0000 7fb499d2c800 20 add_watcher() i=3 2024-09-14T10:47:22.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.019+0000 7fb499d2c800 20 add_watcher() i=4 2024-09-14T10:47:22.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.019+0000 7fb499d2c800 20 add_watcher() i=5 2024-09-14T10:47:22.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.019+0000 7fb499d2c800 20 add_watcher() i=6 2024-09-14T10:47:22.019 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.020+0000 7fb499d2c800 20 add_watcher() i=7 2024-09-14T10:47:22.019 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.020+0000 7fb499d2c800 2 all 8 watchers are set, enabling cache 2024-09-14T10:47:22.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.022+0000 7fb3477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:22.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.022+0000 7fb499d2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:47:22.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.022+0000 7fb499d2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:47:22.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.022+0000 7fb499d2c800 5 note: GC not initialized 2024-09-14T10:47:22.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.022+0000 7fb3467fc640 20 reqs_thread_entry: start 2024-09-14T10:47:22.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.022+0000 7fb499d2c800 20 init_complete bucket index max shards: 11 2024-09-14T10:47:22.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.022+0000 7fb499d2c800 20 Filter name: none 2024-09-14T10:47:22.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.023+0000 7fb2b7fff640 20 reqs_thread_entry: start 2024-09-14T10:47:22.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.023+0000 7fb499d2c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:22.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.023+0000 7fb499d2c800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:47:22.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.023+0000 7fb499d2c800 20 rados->read ofs=0 len=0 2024-09-14T10:47:22.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.023+0000 7fb499d2c800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:47:22.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.023+0000 7fb499d2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:47:22.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.023+0000 7fb499d2c800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T10:47:22.024 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.023+0000 7fb499d2c800 20 INFO: main: starting shard=0 2024-09-14T10:47:22.024 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.023+0000 7fb499d2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.0 2024-09-14T10:47:22.024 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.024+0000 7fb499d2c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:22.024 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.024+0000 7fb499d2c800 20 INFO: main: starting shard=1 2024-09-14T10:47:22.024 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.024+0000 7fb499d2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.1 2024-09-14T10:47:22.025 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.024+0000 7fb499d2c800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T10:47:22.025 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.024+0000 7fb499d2c800 20 INFO: main: starting shard=2 2024-09-14T10:47:22.025 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.024+0000 7fb499d2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.2 2024-09-14T10:47:22.025 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.025+0000 7fb499d2c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:22.025 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.025+0000 7fb499d2c800 20 INFO: main: starting shard=3 2024-09-14T10:47:22.025 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.025+0000 7fb499d2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.3 2024-09-14T10:47:22.025 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.025+0000 7fb499d2c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:22.025 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.025+0000 7fb499d2c800 20 INFO: main: starting shard=4 2024-09-14T10:47:22.025 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.025+0000 7fb499d2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.4 2024-09-14T10:47:22.026 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.026+0000 7fb499d2c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:22.026 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.026+0000 7fb499d2c800 20 INFO: main: starting shard=5 2024-09-14T10:47:22.026 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.026+0000 7fb499d2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.5 2024-09-14T10:47:22.026 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.026+0000 7fb499d2c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:22.026 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.026+0000 7fb499d2c800 20 INFO: main: starting shard=6 2024-09-14T10:47:22.026 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.026+0000 7fb499d2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.6 2024-09-14T10:47:22.026 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.027+0000 7fb499d2c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:22.026 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.027+0000 7fb499d2c800 20 INFO: main: starting shard=7 2024-09-14T10:47:22.026 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.027+0000 7fb499d2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.7 2024-09-14T10:47:22.027 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.027+0000 7fb499d2c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:22.027 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.027+0000 7fb499d2c800 20 INFO: main: starting shard=8 2024-09-14T10:47:22.027 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.027+0000 7fb499d2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.8 2024-09-14T10:47:22.027 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.028+0000 7fb499d2c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:22.027 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.028+0000 7fb499d2c800 20 INFO: main: starting shard=9 2024-09-14T10:47:22.028 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.028+0000 7fb499d2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.9 2024-09-14T10:47:22.028 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.029+0000 7fb499d2c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:22.028 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.029+0000 7fb499d2c800 20 INFO: main: starting shard=10 2024-09-14T10:47:22.028 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.029+0000 7fb499d2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.10 2024-09-14T10:47:22.028 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.029+0000 7fb499d2c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:22.028 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.029+0000 7fb499d2c800 20 INFO: main: done 2024-09-14T10:47:22.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.030+0000 7fb3477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:22.031 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.032+0000 7fb499d2c800 20 remove_watcher() i=0 2024-09-14T10:47:22.031 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.032+0000 7fb499d2c800 2 removed watcher, disabling cache 2024-09-14T10:47:22.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.033+0000 7fb499d2c800 20 remove_watcher() i=1 2024-09-14T10:47:22.033 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.034+0000 7fb499d2c800 20 remove_watcher() i=2 2024-09-14T10:47:22.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.036+0000 7fb499d2c800 20 remove_watcher() i=3 2024-09-14T10:47:22.036 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.037+0000 7fb499d2c800 20 remove_watcher() i=4 2024-09-14T10:47:22.037 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.038+0000 7fb499d2c800 20 remove_watcher() i=5 2024-09-14T10:47:22.038 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.039+0000 7fb499d2c800 20 remove_watcher() i=6 2024-09-14T10:47:22.040 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.041+0000 7fb499d2c800 20 remove_watcher() i=7 2024-09-14T10:47:22.106 INFO:tasks.workunit.client.0.smithi097.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T10:47:22.107 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-14T10:47:22.138 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:47:22.138 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:47:22.175 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.176+0000 7fad3c840800 20 rados->read ofs=0 len=0 2024-09-14T10:47:22.177 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.177+0000 7fad3c840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:22.177 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.177+0000 7fad3c840800 20 realm 2024-09-14T10:47:22.177 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.177+0000 7fad3c840800 20 rados->read ofs=0 len=0 2024-09-14T10:47:22.177 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.178+0000 7fad3c840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:22.177 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.178+0000 7fad3c840800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:47:22.177 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.178+0000 7fad3c840800 20 rados->read ofs=0 len=0 2024-09-14T10:47:22.178 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.178+0000 7fad3c840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:22.178 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.178+0000 7fad3c840800 20 rados->read ofs=0 len=0 2024-09-14T10:47:22.178 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.178+0000 7fad3c840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:22.178 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.178+0000 7fad3c840800 20 rados->read ofs=0 len=0 2024-09-14T10:47:22.179 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.179+0000 7fad3c840800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:47:22.179 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.179+0000 7fad3c840800 20 searching for the correct realm 2024-09-14T10:47:22.180 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.181+0000 7fad39b29640 0 -- 172.21.15.97:0/44218135 >> [v2:172.21.15.97:6816/4093696477,v1:172.21.15.97:6817/4093696477] conn(0x55a3c2381d20 msgr2=0x55a3c2384110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:47:22.184 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.184+0000 7fad39b29640 0 -- 172.21.15.97:0/44218135 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7fad2c03d6a0 msgr2=0x7fad2c0763f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:47:22.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.391+0000 7fad3c840800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:47:22.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.391+0000 7fad3c840800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:47:22.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.391+0000 7fad3c840800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T10:47:22.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.391+0000 7fad3c840800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T10:47:22.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.391+0000 7fad3c840800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:47:22.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.391+0000 7fad3c840800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:47:22.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.391+0000 7fad3c840800 20 rados->read ofs=0 len=0 2024-09-14T10:47:22.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.391+0000 7fad3c840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:22.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.391+0000 7fad3c840800 20 rados->read ofs=0 len=0 2024-09-14T10:47:22.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.391+0000 7fad3c840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:22.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.391+0000 7fad3c840800 20 rados->read ofs=0 len=0 2024-09-14T10:47:22.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.392+0000 7fad3c840800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:47:22.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.392+0000 7fad3c840800 20 zone default found 2024-09-14T10:47:22.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.392+0000 7fad3c840800 4 Realm: () 2024-09-14T10:47:22.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.392+0000 7fad3c840800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T10:47:22.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.392+0000 7fad3c840800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T10:47:22.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.392+0000 7fad3c840800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:47:22.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.392+0000 7fad3c840800 20 zonegroup default 2024-09-14T10:47:22.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.392+0000 7fad3c840800 20 rados->read ofs=0 len=0 2024-09-14T10:47:22.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.392+0000 7fad3c840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:22.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.392+0000 7fad3c840800 20 rados->read ofs=0 len=0 2024-09-14T10:47:22.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.392+0000 7fad3c840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:22.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.392+0000 7fad3c840800 20 rados->read ofs=0 len=0 2024-09-14T10:47:22.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.393+0000 7fad3c840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:22.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.393+0000 7fad3c840800 20 started sync module instance, tier type = 2024-09-14T10:47:22.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.393+0000 7fad3c840800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T10:47:22.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.408+0000 7fad3c840800 20 add_watcher() i=0 2024-09-14T10:47:22.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.408+0000 7fad3c840800 20 add_watcher() i=1 2024-09-14T10:47:22.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.408+0000 7fad3c840800 20 add_watcher() i=2 2024-09-14T10:47:22.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.408+0000 7fad3c840800 20 add_watcher() i=3 2024-09-14T10:47:22.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.408+0000 7fad3c840800 20 add_watcher() i=4 2024-09-14T10:47:22.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.408+0000 7fad3c840800 20 add_watcher() i=5 2024-09-14T10:47:22.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.408+0000 7fad3c840800 20 add_watcher() i=6 2024-09-14T10:47:22.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.413+0000 7fad3c840800 20 add_watcher() i=7 2024-09-14T10:47:22.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.413+0000 7fad3c840800 2 all 8 watchers are set, enabling cache 2024-09-14T10:47:22.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.415+0000 7fabf0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:22.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.415+0000 7fad3c840800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:47:22.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.415+0000 7fad3c840800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:47:22.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.415+0000 7fad3c840800 5 note: GC not initialized 2024-09-14T10:47:22.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.416+0000 7fab6b7fe640 20 reqs_thread_entry: start 2024-09-14T10:47:22.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.416+0000 7fad3c840800 20 init_complete bucket index max shards: 11 2024-09-14T10:47:22.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.416+0000 7fad3c840800 20 Filter name: none 2024-09-14T10:47:22.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.416+0000 7fab697fa640 20 reqs_thread_entry: start 2024-09-14T10:47:22.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.416+0000 7fad3c840800 20 rados->read ofs=0 len=0 2024-09-14T10:47:22.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.416+0000 7fad3c840800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:47:22.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.416+0000 7fad3c840800 20 rados->read ofs=0 len=0 2024-09-14T10:47:22.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.417+0000 7fad3c840800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:47:22.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.417+0000 7fad3c840800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:47:22.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.417+0000 7fad3c840800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T10:47:22.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.417+0000 7fad3c840800 20 INFO: main: starting shard=0 2024-09-14T10:47:22.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.417+0000 7fad3c840800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.0 2024-09-14T10:47:22.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.417+0000 7fad3c840800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:22.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.417+0000 7fad3c840800 20 INFO: main: starting shard=1 2024-09-14T10:47:22.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.417+0000 7fad3c840800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.1 2024-09-14T10:47:22.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.418+0000 7fad3c840800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:22.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.418+0000 7fad3c840800 20 INFO: main: starting shard=2 2024-09-14T10:47:22.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.418+0000 7fad3c840800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.2 2024-09-14T10:47:22.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.418+0000 7fad3c840800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:22.419 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.418+0000 7fad3c840800 20 INFO: main: starting shard=3 2024-09-14T10:47:22.419 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.418+0000 7fad3c840800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.3 2024-09-14T10:47:22.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.419+0000 7fad3c840800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:22.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.419+0000 7fad3c840800 20 INFO: main: starting shard=4 2024-09-14T10:47:22.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.419+0000 7fad3c840800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.4 2024-09-14T10:47:22.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.419+0000 7fad3c840800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:22.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.419+0000 7fad3c840800 20 INFO: main: starting shard=5 2024-09-14T10:47:22.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.419+0000 7fad3c840800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.5 2024-09-14T10:47:22.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.420+0000 7fad3c840800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:22.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.420+0000 7fad3c840800 20 INFO: main: starting shard=6 2024-09-14T10:47:22.421 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.420+0000 7fad3c840800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.6 2024-09-14T10:47:22.421 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.420+0000 7fad3c840800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:22.421 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.420+0000 7fad3c840800 20 INFO: main: starting shard=7 2024-09-14T10:47:22.421 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.420+0000 7fad3c840800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.7 2024-09-14T10:47:22.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.421+0000 7fad3c840800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:22.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.421+0000 7fad3c840800 20 INFO: main: starting shard=8 2024-09-14T10:47:22.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.421+0000 7fad3c840800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.8 2024-09-14T10:47:22.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.421+0000 7fad3c840800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:22.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.421+0000 7fad3c840800 20 INFO: main: starting shard=9 2024-09-14T10:47:22.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.421+0000 7fad3c840800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.9 2024-09-14T10:47:22.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.422+0000 7fad3c840800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:47:22.423 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.422+0000 7fad3c840800 20 INFO: main: starting shard=10 2024-09-14T10:47:22.423 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.422+0000 7fad3c840800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.10 2024-09-14T10:47:22.423 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.422+0000 7fad3c840800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T10:47:22.423 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.422+0000 7fad3c840800 20 INFO: main: done 2024-09-14T10:47:22.423 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.423+0000 7fabf0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:22.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.426+0000 7fad3c840800 20 remove_watcher() i=0 2024-09-14T10:47:22.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.426+0000 7fad3c840800 2 removed watcher, disabling cache 2024-09-14T10:47:22.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.427+0000 7fad3c840800 20 remove_watcher() i=1 2024-09-14T10:47:22.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.428+0000 7fad3c840800 20 remove_watcher() i=2 2024-09-14T10:47:22.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.429+0000 7fad3c840800 20 remove_watcher() i=3 2024-09-14T10:47:22.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.430+0000 7fad3c840800 20 remove_watcher() i=4 2024-09-14T10:47:22.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.431+0000 7fad3c840800 20 remove_watcher() i=5 2024-09-14T10:47:22.431 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.432+0000 7fad3c840800 20 remove_watcher() i=6 2024-09-14T10:47:22.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:22.433+0000 7fad3c840800 20 remove_watcher() i=7 2024-09-14T10:47:22.449 INFO:tasks.workunit.client.0.smithi097.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T10:47:22.835 INFO:tasks.workunit.client.0.smithi097.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-14T10:47:23.229 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-14T10:47:23.258 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:47:23.259 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:47:23.296 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.296+0000 7ff18d719800 20 rados->read ofs=0 len=0 2024-09-14T10:47:23.298 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.298+0000 7ff18d719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:23.298 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.298+0000 7ff18d719800 20 realm 2024-09-14T10:47:23.298 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.298+0000 7ff18d719800 20 rados->read ofs=0 len=0 2024-09-14T10:47:23.298 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.298+0000 7ff18d719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:23.298 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.298+0000 7ff18d719800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:47:23.298 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.298+0000 7ff18d719800 20 rados->read ofs=0 len=0 2024-09-14T10:47:23.298 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.299+0000 7ff18d719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:23.298 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.299+0000 7ff18d719800 20 rados->read ofs=0 len=0 2024-09-14T10:47:23.299 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.299+0000 7ff18d719800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:23.299 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.299+0000 7ff18d719800 20 rados->read ofs=0 len=0 2024-09-14T10:47:23.299 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.300+0000 7ff18d719800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:47:23.299 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.300+0000 7ff18d719800 20 searching for the correct realm 2024-09-14T10:47:23.303 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.303+0000 7ff18b203640 0 -- 172.21.15.97:0/3648113433 >> [v2:172.21.15.152:6808/1010851305,v1:172.21.15.152:6809/1010851305] conn(0x564b29e4f1e0 msgr2=0x564b29e516a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:47:23.306 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.306+0000 7ff18ba04640 0 -- 172.21.15.97:0/3648113433 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x564b29e42a10 msgr2=0x564b29e44e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T10:47:23.311 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.311+0000 7ff18d719800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:47:23.311 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.311+0000 7ff18d719800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:47:23.311 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.311+0000 7ff18d719800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T10:47:23.311 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.311+0000 7ff18d719800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T10:47:23.311 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.311+0000 7ff18d719800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:47:23.311 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.311+0000 7ff18d719800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:47:23.311 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.311+0000 7ff18d719800 20 rados->read ofs=0 len=0 2024-09-14T10:47:23.311 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.311+0000 7ff18d719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:23.311 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.311+0000 7ff18d719800 20 rados->read ofs=0 len=0 2024-09-14T10:47:23.311 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.312+0000 7ff18d719800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:23.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.312+0000 7ff18d719800 20 rados->read ofs=0 len=0 2024-09-14T10:47:23.313 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.312+0000 7ff18d719800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:47:23.313 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.312+0000 7ff18d719800 20 zone default found 2024-09-14T10:47:23.313 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.312+0000 7ff18d719800 4 Realm: () 2024-09-14T10:47:23.313 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.312+0000 7ff18d719800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T10:47:23.313 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.312+0000 7ff18d719800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T10:47:23.313 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.312+0000 7ff18d719800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:47:23.313 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.312+0000 7ff18d719800 20 zonegroup default 2024-09-14T10:47:23.313 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.312+0000 7ff18d719800 20 rados->read ofs=0 len=0 2024-09-14T10:47:23.313 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.312+0000 7ff18d719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:23.314 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.312+0000 7ff18d719800 20 rados->read ofs=0 len=0 2024-09-14T10:47:23.314 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.313+0000 7ff18d719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:23.314 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.313+0000 7ff18d719800 20 rados->read ofs=0 len=0 2024-09-14T10:47:23.314 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.313+0000 7ff18d719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:23.314 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.313+0000 7ff18d719800 20 started sync module instance, tier type = 2024-09-14T10:47:23.314 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.313+0000 7ff18d719800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T10:47:23.327 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.328+0000 7ff18d719800 20 add_watcher() i=0 2024-09-14T10:47:23.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.328+0000 7ff18d719800 20 add_watcher() i=1 2024-09-14T10:47:23.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.328+0000 7ff18d719800 20 add_watcher() i=2 2024-09-14T10:47:23.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.328+0000 7ff18d719800 20 add_watcher() i=3 2024-09-14T10:47:23.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.328+0000 7ff18d719800 20 add_watcher() i=4 2024-09-14T10:47:23.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.328+0000 7ff18d719800 20 add_watcher() i=5 2024-09-14T10:47:23.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.328+0000 7ff18d719800 20 add_watcher() i=6 2024-09-14T10:47:23.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.329+0000 7ff18d719800 20 add_watcher() i=7 2024-09-14T10:47:23.329 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.329+0000 7ff18d719800 2 all 8 watchers are set, enabling cache 2024-09-14T10:47:23.330 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.331+0000 7ff041fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:23.331 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.331+0000 7ff18d719800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:47:23.331 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.331+0000 7ff18d719800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:47:23.331 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.332+0000 7ff18d719800 5 note: GC not initialized 2024-09-14T10:47:23.332 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.332+0000 7ff040fe1640 20 reqs_thread_entry: start 2024-09-14T10:47:23.332 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.332+0000 7ff18d719800 20 init_complete bucket index max shards: 11 2024-09-14T10:47:23.332 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.332+0000 7ff18d719800 20 Filter name: none 2024-09-14T10:47:23.332 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.332+0000 7fefba7fc640 20 reqs_thread_entry: start 2024-09-14T10:47:23.332 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.332+0000 7ff18d719800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T10:47:23.332 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.332+0000 7ff18d719800 20 rados->read ofs=0 len=0 2024-09-14T10:47:23.333 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.332+0000 7ff18d719800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:47:23.333 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.332+0000 7ff18d719800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T10:47:23.333 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.332+0000 7ff18d719800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T10:47:23.333 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.332+0000 7ff18d719800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1 : miss 2024-09-14T10:47:23.333 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.332+0000 7ff18d719800 20 rados->read ofs=0 len=0 2024-09-14T10:47:23.333 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.333+0000 7ff18d719800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:47:23.333 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.333+0000 7ff18d719800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1 info.flags=0x17 2024-09-14T10:47:23.333 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.333+0000 7ff18d719800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1 to cache LRU end 2024-09-14T10:47:23.333 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.333+0000 7ff18d719800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:47:23.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.333+0000 7ff18d719800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T10:47:23.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.333+0000 7ff18d719800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1 2024-09-14T10:47:23.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.333+0000 7ff18d719800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.0 2024-09-14T10:47:23.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.333+0000 7ff18d719800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.1 2024-09-14T10:47:23.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.334+0000 7ff18d719800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.2 2024-09-14T10:47:23.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.335+0000 7ff18d719800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.3 2024-09-14T10:47:23.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.335+0000 7ff18d719800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.4 2024-09-14T10:47:23.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.335+0000 7ff18d719800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.5 2024-09-14T10:47:23.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.336+0000 7ff18d719800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.6 2024-09-14T10:47:23.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.336+0000 7ff18d719800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.7 2024-09-14T10:47:23.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.337+0000 7ff18d719800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.8 2024-09-14T10:47:23.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.337+0000 7ff18d719800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.9 2024-09-14T10:47:23.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.338+0000 7ff18d719800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.10 2024-09-14T10:47:23.346 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.347+0000 7ff041fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:23.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.349+0000 7ff18d719800 20 remove_watcher() i=0 2024-09-14T10:47:23.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.349+0000 7ff18d719800 2 removed watcher, disabling cache 2024-09-14T10:47:23.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.351+0000 7ff18d719800 20 remove_watcher() i=1 2024-09-14T10:47:23.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.352+0000 7ff18d719800 20 remove_watcher() i=2 2024-09-14T10:47:23.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.354+0000 7ff18d719800 20 remove_watcher() i=3 2024-09-14T10:47:23.355 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.356+0000 7ff18d719800 20 remove_watcher() i=4 2024-09-14T10:47:23.357 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.357+0000 7ff18d719800 20 remove_watcher() i=5 2024-09-14T10:47:23.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.359+0000 7ff18d719800 20 remove_watcher() i=6 2024-09-14T10:47:23.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.361+0000 7ff18d719800 20 remove_watcher() i=7 2024-09-14T10:47:23.371 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T10:47:23.406 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:47:23.406 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:47:23.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.443+0000 7fea3f922800 20 rados->read ofs=0 len=0 2024-09-14T10:47:23.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.445+0000 7fea3f922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:23.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.445+0000 7fea3f922800 20 realm 2024-09-14T10:47:23.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.445+0000 7fea3f922800 20 rados->read ofs=0 len=0 2024-09-14T10:47:23.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.445+0000 7fea3f922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:23.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.445+0000 7fea3f922800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:47:23.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.445+0000 7fea3f922800 20 rados->read ofs=0 len=0 2024-09-14T10:47:23.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.446+0000 7fea3f922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:23.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.446+0000 7fea3f922800 20 rados->read ofs=0 len=0 2024-09-14T10:47:23.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.446+0000 7fea3f922800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:23.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.446+0000 7fea3f922800 20 rados->read ofs=0 len=0 2024-09-14T10:47:23.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.447+0000 7fea3f922800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:47:23.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.447+0000 7fea3f922800 20 searching for the correct realm 2024-09-14T10:47:23.448 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.449+0000 7fea3bdd3640 0 -- 172.21.15.97:0/1332929407 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7fea2404a060 msgr2=0x7fea24076ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:47:23.654 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.654+0000 7fea33fff640 0 -- 172.21.15.97:0/1332929407 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7fea2c0aead0 msgr2=0x7fea2c0ae4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:47:23.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.659+0000 7fea3f922800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:47:23.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.659+0000 7fea3f922800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:47:23.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.659+0000 7fea3f922800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T10:47:23.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.659+0000 7fea3f922800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T10:47:23.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.659+0000 7fea3f922800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:47:23.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.659+0000 7fea3f922800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:47:23.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.659+0000 7fea3f922800 20 rados->read ofs=0 len=0 2024-09-14T10:47:23.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.659+0000 7fea3f922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:23.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.659+0000 7fea3f922800 20 rados->read ofs=0 len=0 2024-09-14T10:47:23.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.660+0000 7fea3f922800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:23.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.660+0000 7fea3f922800 20 rados->read ofs=0 len=0 2024-09-14T10:47:23.661 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.660+0000 7fea3f922800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:47:23.661 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.660+0000 7fea3f922800 20 zone default found 2024-09-14T10:47:23.661 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.660+0000 7fea3f922800 4 Realm: () 2024-09-14T10:47:23.661 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.660+0000 7fea3f922800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T10:47:23.661 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.660+0000 7fea3f922800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T10:47:23.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.660+0000 7fea3f922800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:47:23.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.660+0000 7fea3f922800 20 zonegroup default 2024-09-14T10:47:23.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.660+0000 7fea3f922800 20 rados->read ofs=0 len=0 2024-09-14T10:47:23.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.660+0000 7fea3f922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:23.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.660+0000 7fea3f922800 20 rados->read ofs=0 len=0 2024-09-14T10:47:23.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.661+0000 7fea3f922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:23.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.661+0000 7fea3f922800 20 rados->read ofs=0 len=0 2024-09-14T10:47:23.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.661+0000 7fea3f922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:23.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.661+0000 7fea3f922800 20 started sync module instance, tier type = 2024-09-14T10:47:23.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.661+0000 7fea3f922800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T10:47:23.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.675+0000 7fea3f922800 20 add_watcher() i=0 2024-09-14T10:47:23.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.675+0000 7fea3f922800 20 add_watcher() i=1 2024-09-14T10:47:23.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.675+0000 7fea3f922800 20 add_watcher() i=2 2024-09-14T10:47:23.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.675+0000 7fea3f922800 20 add_watcher() i=3 2024-09-14T10:47:23.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.675+0000 7fea3f922800 20 add_watcher() i=4 2024-09-14T10:47:23.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.675+0000 7fea3f922800 20 add_watcher() i=5 2024-09-14T10:47:23.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.675+0000 7fea3f922800 20 add_watcher() i=6 2024-09-14T10:47:23.675 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.677+0000 7fea3f922800 20 add_watcher() i=7 2024-09-14T10:47:23.675 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.677+0000 7fea3f922800 2 all 8 watchers are set, enabling cache 2024-09-14T10:47:23.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.678+0000 7fe8f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:23.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.678+0000 7fea3f922800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:47:23.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.678+0000 7fea3f922800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:47:23.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.678+0000 7fea3f922800 5 note: GC not initialized 2024-09-14T10:47:23.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.678+0000 7fe8f0fe1640 20 reqs_thread_entry: start 2024-09-14T10:47:23.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.678+0000 7fea3f922800 20 init_complete bucket index max shards: 11 2024-09-14T10:47:23.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.678+0000 7fea3f922800 20 Filter name: none 2024-09-14T10:47:23.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.679+0000 7fe86a7fc640 20 reqs_thread_entry: start 2024-09-14T10:47:23.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.679+0000 7fea3f922800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T10:47:23.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.679+0000 7fea3f922800 20 rados->read ofs=0 len=0 2024-09-14T10:47:23.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.679+0000 7fea3f922800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:47:23.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.679+0000 7fea3f922800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T10:47:23.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.679+0000 7fea3f922800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T10:47:23.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.679+0000 7fea3f922800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1 : miss 2024-09-14T10:47:23.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.679+0000 7fea3f922800 20 rados->read ofs=0 len=0 2024-09-14T10:47:23.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.679+0000 7fea3f922800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:47:23.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.679+0000 7fea3f922800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1 info.flags=0x17 2024-09-14T10:47:23.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.679+0000 7fea3f922800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1 to cache LRU end 2024-09-14T10:47:23.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.679+0000 7fea3f922800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:47:23.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.679+0000 7fea3f922800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T10:47:23.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.679+0000 7fea3f922800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1 2024-09-14T10:47:23.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.680+0000 7fea3f922800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.0 2024-09-14T10:47:23.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.680+0000 7fea3f922800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-14T10:47:23.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.680+0000 7fea3f922800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.1 2024-09-14T10:47:23.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.681+0000 7fea3f922800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.2 2024-09-14T10:47:23.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.681+0000 7fea3f922800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-14T10:47:23.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.681+0000 7fea3f922800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.3 2024-09-14T10:47:23.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.682+0000 7fea3f922800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-14T10:47:23.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.682+0000 7fea3f922800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.4 2024-09-14T10:47:23.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.682+0000 7fea3f922800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-14T10:47:23.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.682+0000 7fea3f922800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.5 2024-09-14T10:47:23.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.682+0000 7fea3f922800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.6 2024-09-14T10:47:23.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.683+0000 7fea3f922800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-14T10:47:23.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.683+0000 7fea3f922800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.7 2024-09-14T10:47:23.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.684+0000 7fea3f922800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-14T10:47:23.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.684+0000 7fea3f922800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.8 2024-09-14T10:47:23.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.684+0000 7fea3f922800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.9 2024-09-14T10:47:23.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.684+0000 7fea3f922800 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-14T10:47:23.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.684+0000 7fea3f922800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.10 2024-09-14T10:47:23.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.685+0000 7fea3f922800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.1 2024-09-14T10:47:23.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.685+0000 7fea3f922800 20 get_obj_state: octx=0x555f81447380 obj=check-bucket:e state=0x555f81716ed8 s->prefetch_data=0 2024-09-14T10:47:23.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.685+0000 7fea3f922800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.5 2024-09-14T10:47:23.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.686+0000 7fea3f922800 20 get_obj_state: octx=0x555f8146f550 obj=check-bucket:d state=0x555f81714168 s->prefetch_data=0 2024-09-14T10:47:23.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.686+0000 7fea3f922800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.8 2024-09-14T10:47:23.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.686+0000 7fea3f922800 20 get_obj_state: octx=0x555f81712a10 obj=check-bucket:c state=0x555f817110a8 s->prefetch_data=0 2024-09-14T10:47:23.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.686+0000 7fea3f922800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.10 2024-09-14T10:47:23.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.686+0000 7fea3f922800 20 get_obj_state: octx=0x555f81714ef0 obj=check-bucket:f state=0x555f81715ab8 s->prefetch_data=0 2024-09-14T10:47:23.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.686+0000 7fea3f922800 20 get_obj_state: setting s->obj_tag to 0ggd64wrta3guau6vgq7rk4brzefhhg5 2024-09-14T10:47:23.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.686+0000 7fea3f922800 20 get_obj_state_impl: setting s->olh_tag to 8u71rmcozg9w1isz9vqtpj1jvhe5uu7y 2024-09-14T10:47:23.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.686+0000 7fea3f922800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=8u71rmcozg9w1isz9vqtpj1jvhe5uu7y 2024-09-14T10:47:23.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.686+0000 7fea3f922800 20 get_obj_state: setting s->obj_tag to sqiz81or9wgwnhk8s2aqw0rz4wfo3m8n 2024-09-14T10:47:23.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.686+0000 7fea3f922800 20 get_obj_state_impl: setting s->olh_tag to 9le8u51c3m711oan8zs0p7h3hdv0ol15 2024-09-14T10:47:23.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.686+0000 7fea3f922800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=9le8u51c3m711oan8zs0p7h3hdv0ol15 2024-09-14T10:47:23.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.686+0000 7fea3f922800 20 get_obj_state: setting s->obj_tag to tt0oxz9bkyxotf6oi9o354x0kiiikazi 2024-09-14T10:47:23.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.686+0000 7fea3f922800 20 get_obj_state_impl: setting s->olh_tag to zzbhlq737xctqokueqr1pwgcowepqaaw 2024-09-14T10:47:23.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.686+0000 7fea3f922800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=zzbhlq737xctqokueqr1pwgcowepqaaw 2024-09-14T10:47:23.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.687+0000 7fea3f922800 20 get_obj_state: setting s->obj_tag to hoipb56ah3x43pbh2zo1ikgujlkg6zec 2024-09-14T10:47:23.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.687+0000 7fea3f922800 20 get_obj_state_impl: setting s->olh_tag to qmxzveuve1g93d360w31rvpfif4t2a41 2024-09-14T10:47:23.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.687+0000 7fea3f922800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=qmxzveuve1g93d360w31rvpfif4t2a41 2024-09-14T10:47:23.688 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.688+0000 7fea3f922800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.5 2024-09-14T10:47:23.688 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.688+0000 7fea3f922800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.8 2024-09-14T10:47:23.690 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.691+0000 7fea3f922800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.1 2024-09-14T10:47:23.690 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.691+0000 7fea3f922800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.10 2024-09-14T10:47:23.692 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.693+0000 7fea3f922800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.8 2024-09-14T10:47:23.692 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.693+0000 7fea3f922800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.5 2024-09-14T10:47:23.694 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.693+0000 7fea3f922800 20 olh_log_entry: epoch=3 op=3 key=c[1AMDN2GIGeVNrLCGKal6Bb694mq9QDQ] 2024-09-14T10:47:23.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.693+0000 7fea3f922800 20 get_obj_state: octx=0x555f81712a10 obj=check-bucket:_:1AMDN2GIGeVNrLCGKal6Bb694mq9QDQ_c state=0x555f817c42d8 s->prefetch_data=0 2024-09-14T10:47:23.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.694+0000 7fea3f922800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.10 2024-09-14T10:47:23.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.694+0000 7fea3f922800 20 olh_log_entry: epoch=3 op=3 key=d[BxzpxwwzncDXS6Qs3Sjzs8DDfhI-6nf] 2024-09-14T10:47:23.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.694+0000 7fea3f922800 20 get_obj_state: octx=0x555f8146f550 obj=check-bucket:_:BxzpxwwzncDXS6Qs3Sjzs8DDfhI-6nf_d state=0x555f817cad58 s->prefetch_data=0 2024-09-14T10:47:23.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.694+0000 7fea3f922800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.1 2024-09-14T10:47:23.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.694+0000 7fea3f922800 10 manifest: total_size = 22 2024-09-14T10:47:23.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.694+0000 7fea3f922800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8797912861323746548 2024-09-14T10:47:23.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.694+0000 7fea3f922800 20 get_obj_state: octx=0x555f81712a10 obj=check-bucket:_:1AMDN2GIGeVNrLCGKal6Bb694mq9QDQ_c state=0x555f817c42d8 s->prefetch_data=0 2024-09-14T10:47:23.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.694+0000 7fea3f922800 20 prepare_atomic_modification: state is not atomic. state=0x555f817c42d8 2024-09-14T10:47:23.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.694+0000 7fea3f922800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.8 2024-09-14T10:47:23.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.694+0000 7fea3f922800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-14T10:47:23.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.694+0000 7fea3f922800 20 olh_log_entry: epoch=2 op=3 key=f[ZxtPY9KePgRCLqixLk.Pop-JIDlMw-n] 2024-09-14T10:47:23.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.694+0000 7fea3f922800 20 get_obj_state: octx=0x555f81714ef0 obj=check-bucket:_:ZxtPY9KePgRCLqixLk.Pop-JIDlMw-n_f state=0x555f817d50e8 s->prefetch_data=0 2024-09-14T10:47:23.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.694+0000 7fea3f922800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-14T10:47:23.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.694+0000 7fea3f922800 20 olh_log_entry: epoch=2 op=3 key=e[LZ3vc7Vhxlxma07rGCseFzS5NAbPtfQ] 2024-09-14T10:47:23.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.694+0000 7fea3f922800 20 get_obj_state: octx=0x555f81447380 obj=check-bucket:_:LZ3vc7Vhxlxma07rGCseFzS5NAbPtfQ_e state=0x555f817dee38 s->prefetch_data=0 2024-09-14T10:47:23.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.694+0000 7fea3f922800 10 manifest: total_size = 22 2024-09-14T10:47:23.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.694+0000 7fea3f922800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15152196282946524789 2024-09-14T10:47:23.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.694+0000 7fea3f922800 20 get_obj_state: octx=0x555f8146f550 obj=check-bucket:_:BxzpxwwzncDXS6Qs3Sjzs8DDfhI-6nf_d state=0x555f817cad58 s->prefetch_data=0 2024-09-14T10:47:23.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.694+0000 7fea3f922800 20 prepare_atomic_modification: state is not atomic. state=0x555f817cad58 2024-09-14T10:47:23.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.694+0000 7fea3f922800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.5 2024-09-14T10:47:23.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.695+0000 7fea3f922800 10 manifest: total_size = 12 2024-09-14T10:47:23.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.695+0000 7fea3f922800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6550459263066681064 2024-09-14T10:47:23.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.695+0000 7fea3f922800 20 get_obj_state: octx=0x555f81447380 obj=check-bucket:_:LZ3vc7Vhxlxma07rGCseFzS5NAbPtfQ_e state=0x555f817dee38 s->prefetch_data=0 2024-09-14T10:47:23.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.695+0000 7fea3f922800 20 prepare_atomic_modification: state is not atomic. state=0x555f817dee38 2024-09-14T10:47:23.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.695+0000 7fea3f922800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.1 2024-09-14T10:47:23.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.695+0000 7fea3f922800 10 manifest: total_size = 22 2024-09-14T10:47:23.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.695+0000 7fea3f922800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4579057862917777063 2024-09-14T10:47:23.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.695+0000 7fea3f922800 20 get_obj_state: octx=0x555f81714ef0 obj=check-bucket:_:ZxtPY9KePgRCLqixLk.Pop-JIDlMw-n_f state=0x555f817d50e8 s->prefetch_data=0 2024-09-14T10:47:23.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.695+0000 7fea3f922800 20 prepare_atomic_modification: state is not atomic. state=0x555f817d50e8 2024-09-14T10:47:23.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.695+0000 7fea3f922800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.10 2024-09-14T10:47:23.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.701+0000 7fea3f922800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T10:47:23.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.701+0000 7fea3f922800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-14T10:47:23.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.701+0000 7fea3f922800 0 deleting objects inline since gc isn't initialized 2024-09-14T10:47:23.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.701+0000 7fea3f922800 5 delete_objs_inline: removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1__shadow:1AMDN2GIGeVNrLCGKal6Bb694mq9QDQ_.vMuBEZtLbA0yooZwPq3MvYffTr_DXSo_0 2024-09-14T10:47:23.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.701+0000 7fea3f922800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T10:47:23.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.701+0000 7fea3f922800 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-14T10:47:23.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.701+0000 7fea3f922800 0 deleting objects inline since gc isn't initialized 2024-09-14T10:47:23.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.701+0000 7fea3f922800 5 delete_objs_inline: removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1__shadow:LZ3vc7Vhxlxma07rGCseFzS5NAbPtfQ_.J9tFQeSuJtSyXVBaUI_SBgfU87bZ7xk_0 2024-09-14T10:47:23.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.701+0000 7fea3f922800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T10:47:23.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.701+0000 7fea3f922800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-14T10:47:23.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.701+0000 7fea3f922800 0 deleting objects inline since gc isn't initialized 2024-09-14T10:47:23.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.701+0000 7fea3f922800 5 delete_objs_inline: removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1__shadow:BxzpxwwzncDXS6Qs3Sjzs8DDfhI-6nf_.c-PlHteK91n6_qMWAAxsHExF4prgmRI_0 2024-09-14T10:47:23.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.703+0000 7fea3f922800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T10:47:23.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.704+0000 7fea3f922800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T10:47:23.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.704+0000 7fea3f922800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T10:47:23.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.704+0000 7fea3f922800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-14T10:47:23.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.704+0000 7fea3f922800 0 deleting objects inline since gc isn't initialized 2024-09-14T10:47:23.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.704+0000 7fea3f922800 5 delete_objs_inline: removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1__shadow:ZxtPY9KePgRCLqixLk.Pop-JIDlMw-n_.t4Yr0QgFBlGZWjUHy88xLrcNN7iceBa_0 2024-09-14T10:47:23.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.706+0000 7fe91e7fc640 20 handle_completion(): completion ok for obj=c[1AMDN2GIGeVNrLCGKal6Bb694mq9QDQ] 2024-09-14T10:47:23.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.706+0000 7fea3f922800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T10:47:23.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.707+0000 7fe91effd640 20 handle_completion(): completion ok for obj=e[LZ3vc7Vhxlxma07rGCseFzS5NAbPtfQ] 2024-09-14T10:47:23.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.707+0000 7fea3f922800 20 get_obj_state: octx=0x555f81447380 obj=check-bucket:e state=0x555f81716ed8 s->prefetch_data=0 2024-09-14T10:47:23.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.707+0000 7fea3f922800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=8u71rmcozg9w1isz9vqtpj1jvhe5uu7y 2024-09-14T10:47:23.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.707+0000 7fe91effd640 20 handle_completion(): completion ok for obj=d[BxzpxwwzncDXS6Qs3Sjzs8DDfhI-6nf] 2024-09-14T10:47:23.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.708+0000 7fe91e7fc640 20 handle_completion(): completion ok for obj=f[ZxtPY9KePgRCLqixLk.Pop-JIDlMw-n] 2024-09-14T10:47:23.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.708+0000 7fea3f922800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.8 2024-09-14T10:47:23.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.708+0000 7fea3f922800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.8 2024-09-14T10:47:23.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.708+0000 7fea3f922800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T10:47:23.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.708+0000 7fea3f922800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.5 2024-09-14T10:47:23.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.708+0000 7fea3f922800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.5 2024-09-14T10:47:23.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.709+0000 7fea3f922800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.8 2024-09-14T10:47:23.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.709+0000 7fea3f922800 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-14T10:47:23.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.711+0000 7fea3f922800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.5 2024-09-14T10:47:23.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.711+0000 7fea3f922800 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-14T10:47:23.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.712+0000 7fea3f922800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.1 2024-09-14T10:47:23.712 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.712+0000 7fea3f922800 20 get_obj_state: octx=0x555f81714ef0 obj=check-bucket:f state=0x555f81715ab8 s->prefetch_data=0 2024-09-14T10:47:23.712 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.712+0000 7fea3f922800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=qmxzveuve1g93d360w31rvpfif4t2a41 2024-09-14T10:47:23.714 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.715+0000 7fea3f922800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.1 2024-09-14T10:47:23.714 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.715+0000 7fea3f922800 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-14T10:47:23.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.716+0000 7fea3f922800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.10 2024-09-14T10:47:23.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.717+0000 7fea3f922800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1.10 2024-09-14T10:47:23.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.717+0000 7fea3f922800 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-14T10:47:23.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.717+0000 7fea3f922800 1 NOTICE: finished all shards (4 entries removed) 2024-09-14T10:47:23.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.718+0000 7fe8f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:23.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.722+0000 7fea3f922800 20 remove_watcher() i=0 2024-09-14T10:47:23.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.722+0000 7fea3f922800 2 removed watcher, disabling cache 2024-09-14T10:47:23.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.723+0000 7fea3f922800 20 remove_watcher() i=1 2024-09-14T10:47:23.724 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.724+0000 7fea3f922800 20 remove_watcher() i=2 2024-09-14T10:47:23.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.726+0000 7fea3f922800 20 remove_watcher() i=3 2024-09-14T10:47:23.726 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.727+0000 7fea3f922800 20 remove_watcher() i=4 2024-09-14T10:47:23.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.728+0000 7fea3f922800 20 remove_watcher() i=5 2024-09-14T10:47:23.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.729+0000 7fea3f922800 20 remove_watcher() i=6 2024-09-14T10:47:23.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.730+0000 7fea3f922800 20 remove_watcher() i=7 2024-09-14T10:47:23.790 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-14T10:47:23.818 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:47:23.819 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:47:23.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.855+0000 7f2a43128800 20 rados->read ofs=0 len=0 2024-09-14T10:47:23.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.857+0000 7f2a43128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:23.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.857+0000 7f2a43128800 20 realm 2024-09-14T10:47:23.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.857+0000 7f2a43128800 20 rados->read ofs=0 len=0 2024-09-14T10:47:23.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.857+0000 7f2a43128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:23.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.857+0000 7f2a43128800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:47:23.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.857+0000 7f2a43128800 20 rados->read ofs=0 len=0 2024-09-14T10:47:23.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.857+0000 7f2a43128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:23.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.857+0000 7f2a43128800 20 rados->read ofs=0 len=0 2024-09-14T10:47:23.858 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.858+0000 7f2a43128800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:23.858 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.858+0000 7f2a43128800 20 rados->read ofs=0 len=0 2024-09-14T10:47:23.858 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.859+0000 7f2a43128800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:47:23.859 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.859+0000 7f2a43128800 20 searching for the correct realm 2024-09-14T10:47:23.860 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.861+0000 7f2a3e55c640 0 -- 172.21.15.97:0/3068598426 >> [v2:172.21.15.97:6816/4093696477,v1:172.21.15.97:6817/4093696477] conn(0x55b5be3d4e90 msgr2=0x55b5be3d7280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:47:23.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:23.864+0000 7f2a3e55c640 0 -- 172.21.15.97:0/3068598426 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f2a30042950 msgr2=0x7f2a300413d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:47:24.070 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.070+0000 7f2a43128800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:47:24.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.070+0000 7f2a43128800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:47:24.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.070+0000 7f2a43128800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T10:47:24.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.070+0000 7f2a43128800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T10:47:24.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.070+0000 7f2a43128800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:47:24.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.070+0000 7f2a43128800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:47:24.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.070+0000 7f2a43128800 20 rados->read ofs=0 len=0 2024-09-14T10:47:24.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.071+0000 7f2a43128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:24.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.071+0000 7f2a43128800 20 rados->read ofs=0 len=0 2024-09-14T10:47:24.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.071+0000 7f2a43128800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:47:24.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.071+0000 7f2a43128800 20 rados->read ofs=0 len=0 2024-09-14T10:47:24.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.071+0000 7f2a43128800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:47:24.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.071+0000 7f2a43128800 20 zone default found 2024-09-14T10:47:24.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.071+0000 7f2a43128800 4 Realm: () 2024-09-14T10:47:24.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.071+0000 7f2a43128800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T10:47:24.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.071+0000 7f2a43128800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T10:47:24.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.071+0000 7f2a43128800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:47:24.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.071+0000 7f2a43128800 20 zonegroup default 2024-09-14T10:47:24.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.071+0000 7f2a43128800 20 rados->read ofs=0 len=0 2024-09-14T10:47:24.074 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.072+0000 7f2a43128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:24.074 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.072+0000 7f2a43128800 20 rados->read ofs=0 len=0 2024-09-14T10:47:24.074 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.072+0000 7f2a43128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:24.074 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.072+0000 7f2a43128800 20 rados->read ofs=0 len=0 2024-09-14T10:47:24.074 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.073+0000 7f2a43128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:47:24.074 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.073+0000 7f2a43128800 20 started sync module instance, tier type = 2024-09-14T10:47:24.075 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.073+0000 7f2a43128800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T10:47:24.082 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.083+0000 7f2a43128800 20 add_watcher() i=0 2024-09-14T10:47:24.082 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.083+0000 7f2a43128800 20 add_watcher() i=1 2024-09-14T10:47:24.082 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.083+0000 7f2a43128800 20 add_watcher() i=2 2024-09-14T10:47:24.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.083+0000 7f2a43128800 20 add_watcher() i=3 2024-09-14T10:47:24.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.083+0000 7f2a43128800 20 add_watcher() i=4 2024-09-14T10:47:24.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.083+0000 7f2a43128800 20 add_watcher() i=5 2024-09-14T10:47:24.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.083+0000 7f2a43128800 20 add_watcher() i=6 2024-09-14T10:47:24.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.085+0000 7f2a43128800 20 add_watcher() i=7 2024-09-14T10:47:24.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.085+0000 7f2a43128800 2 all 8 watchers are set, enabling cache 2024-09-14T10:47:24.085 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.086+0000 7f28f57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:24.086 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.086+0000 7f2a43128800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:47:24.086 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.086+0000 7f2a43128800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:47:24.086 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.086+0000 7f2a43128800 5 note: GC not initialized 2024-09-14T10:47:24.086 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.086+0000 7f286ffff640 20 reqs_thread_entry: start 2024-09-14T10:47:24.086 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.086+0000 7f2a43128800 20 init_complete bucket index max shards: 11 2024-09-14T10:47:24.086 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.087+0000 7f2a43128800 20 Filter name: none 2024-09-14T10:47:24.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.087+0000 7f286dffb640 20 reqs_thread_entry: start 2024-09-14T10:47:24.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.087+0000 7f2a43128800 20 rados->read ofs=0 len=0 2024-09-14T10:47:24.088 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.087+0000 7f2a43128800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:47:24.088 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.087+0000 7f2a43128800 20 rados->read ofs=0 len=0 2024-09-14T10:47:24.088 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.088+0000 7f2a43128800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:47:24.088 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.088+0000 7f2a43128800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:47:24.088 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.088+0000 7f2a43128800 20 rados->read ofs=0 len=0 2024-09-14T10:47:24.088 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.088+0000 7f2a43128800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:47:24.088 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.088+0000 7f2a43128800 20 rados->read ofs=0 len=0 2024-09-14T10:47:24.089 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.089+0000 7f2a43128800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:47:24.089 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.089+0000 7f2a43128800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:47:24.089 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.090+0000 7f28f57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:47:24.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.093+0000 7f2a43128800 20 remove_watcher() i=0 2024-09-14T10:47:24.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.093+0000 7f2a43128800 2 removed watcher, disabling cache 2024-09-14T10:47:24.093 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.094+0000 7f2a43128800 20 remove_watcher() i=1 2024-09-14T10:47:24.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.095+0000 7f2a43128800 20 remove_watcher() i=2 2024-09-14T10:47:24.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.096+0000 7f2a43128800 20 remove_watcher() i=3 2024-09-14T10:47:24.097 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.098+0000 7f2a43128800 20 remove_watcher() i=4 2024-09-14T10:47:24.098 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.099+0000 7f2a43128800 20 remove_watcher() i=5 2024-09-14T10:47:24.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.100+0000 7f2a43128800 20 remove_watcher() i=6 2024-09-14T10:47:24.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:47:24.102+0000 7f2a43128800 20 remove_watcher() i=7 2024-09-14T10:47:24.110 INFO:tasks.workunit.client.0.smithi097.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-14T10:47:24.111 INFO:tasks.workunit.client.0.smithi097.stderr:Deleting bucket check-bucket 2024-09-14T10:47:24.148 INFO:tasks.workunit.client.0.smithi097.stderr:Completed bucket check tests 2024-09-14T10:47:24.149 INFO:tasks.workunit.client.0.smithi097.stdout:connected to http://localhost:80 2024-09-14T10:47:24.206 INFO:tasks.workunit.client.0.smithi097.stderr:+ deactivate 2024-09-14T10:47:24.206 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-14T10:47:24.206 INFO:tasks.workunit.client.0.smithi097.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T10:47:24.206 INFO:tasks.workunit.client.0.smithi097.stderr:+ export PATH 2024-09-14T10:47:24.207 INFO:tasks.workunit.client.0.smithi097.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-14T10:47:24.207 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' -n '' ']' 2024-09-14T10:47:24.207 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T10:47:24.207 INFO:tasks.workunit.client.0.smithi097.stderr:+ hash -r 2024-09-14T10:47:24.207 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' -n '' ']' 2024-09-14T10:47:24.207 INFO:tasks.workunit.client.0.smithi097.stderr:+ unset VIRTUAL_ENV 2024-09-14T10:47:24.207 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-14T10:47:24.207 INFO:tasks.workunit.client.0.smithi097.stderr:+ unset -f deactivate 2024-09-14T10:47:24.207 INFO:tasks.workunit.client.0.smithi097.stderr:+ echo OK. 2024-09-14T10:47:24.208 INFO:tasks.workunit.client.0.smithi097.stdout:OK. 2024-09-14T10:47:24.209 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T10:47:24.209 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T10:47:24.286 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-09-14T10:47:24.286 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T10:47:24.650 DEBUG:teuthology.parallel:result is None 2024-09-14T10:47:24.650 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T10:47:24.688 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T10:47:24.689 DEBUG:teuthology.orchestra.run.smithi097:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T10:47:24.764 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T10:47:24.764 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T10:47:24.778 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T10:47:24.778 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T10:47:24.779 DEBUG:teuthology.orchestra.run.smithi097:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T10:47:24.832 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:47:24.833 INFO:teuthology.orchestra.run.smithi097.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T10:47:24.833 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T10:47:24.903 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T10:47:24.903 DEBUG:teuthology.orchestra.run.smithi097:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T10:47:24.972 INFO:tasks.workunit:timeout=3h 2024-09-14T10:47:24.972 INFO:tasks.workunit:cleanup=True 2024-09-14T10:47:24.973 DEBUG:teuthology.orchestra.run.smithi097:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T10:47:25.042 INFO:tasks.workunit.client.0.smithi097.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T10:48:20.933 INFO:tasks.workunit.client.0.smithi097.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T10:48:20.934 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T10:48:20.934 INFO:tasks.workunit.client.0.smithi097.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T10:48:20.934 INFO:tasks.workunit.client.0.smithi097.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T10:48:20.934 INFO:tasks.workunit.client.0.smithi097.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T10:48:20.934 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T10:48:20.934 INFO:tasks.workunit.client.0.smithi097.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T10:48:20.934 INFO:tasks.workunit.client.0.smithi097.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T10:48:20.934 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T10:48:20.935 INFO:tasks.workunit.client.0.smithi097.stderr: git switch -c 2024-09-14T10:48:20.935 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T10:48:20.935 INFO:tasks.workunit.client.0.smithi097.stderr:Or undo this operation with: 2024-09-14T10:48:20.935 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T10:48:20.935 INFO:tasks.workunit.client.0.smithi097.stderr: git switch - 2024-09-14T10:48:20.935 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T10:48:20.935 INFO:tasks.workunit.client.0.smithi097.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T10:48:20.935 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T10:48:20.935 INFO:tasks.workunit.client.0.smithi097.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T10:48:20.936 DEBUG:teuthology.orchestra.run.smithi097:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T10:48:21.004 INFO:tasks.workunit.client.0.smithi097.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T10:48:21.006 INFO:tasks.workunit.client.0.smithi097.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T10:48:21.007 INFO:tasks.workunit.client.0.smithi097.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T10:48:21.054 INFO:tasks.workunit.client.0.smithi097.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T10:48:21.104 INFO:tasks.workunit.client.0.smithi097.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T10:48:21.142 INFO:tasks.workunit.client.0.smithi097.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T10:48:21.144 INFO:tasks.workunit.client.0.smithi097.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T10:48:21.144 INFO:tasks.workunit.client.0.smithi097.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T10:48:21.182 INFO:tasks.workunit.client.0.smithi097.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T10:48:21.185 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-14T10:48:21.185 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T10:48:21.255 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-09-14T10:48:21.256 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-09-14T10:48:21.257 DEBUG:teuthology.orchestra.run.smithi097:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-09-14T10:48:21.338 INFO:tasks.workunit.client.0.smithi097.stdout:Running main() from gmock_main.cc 2024-09-14T10:48:21.338 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-14T10:48:21.338 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-14T10:48:21.338 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 11 tests from ClsLock 2024-09-14T10:48:21.338 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-09-14T10:48:23.137 INFO:tasks.workunit.client.0.smithi097.stdout:lock: mylock 2024-09-14T10:48:23.137 INFO:tasks.workunit.client.0.smithi097.stdout: lock_type: exclusive 2024-09-14T10:48:23.137 INFO:tasks.workunit.client.0.smithi097.stdout: tag: 2024-09-14T10:48:23.137 INFO:tasks.workunit.client.0.smithi097.stdout: lockers: 2024-09-14T10:48:23.137 INFO:tasks.workunit.client.0.smithi097.stdout: client.5027 expiration=2024-09-14T10:50:23.132352+0000 addr=v1:172.21.15.97:0/1677277318 cookie= 2024-09-14T10:48:23.144 INFO:tasks.workunit.client.0.smithi097.stdout:lock: mylock 2024-09-14T10:48:23.144 INFO:tasks.workunit.client.0.smithi097.stdout: lock_type: shared 2024-09-14T10:48:23.144 INFO:tasks.workunit.client.0.smithi097.stdout: tag: 2024-09-14T10:48:23.144 INFO:tasks.workunit.client.0.smithi097.stdout: lockers: 2024-09-14T10:48:23.144 INFO:tasks.workunit.client.0.smithi097.stdout: client.5027 expiration=2024-09-14T10:50:23.144842+0000 addr=v1:172.21.15.97:0/1677277318 cookie= 2024-09-14T10:48:23.144 INFO:tasks.workunit.client.0.smithi097.stdout: client.5190 expiration=0.000000 addr=v1:172.21.15.97:0/2916118042 cookie= 2024-09-14T10:48:23.145 INFO:tasks.workunit.client.0.smithi097.stdout:lock: mylock 2024-09-14T10:48:23.145 INFO:tasks.workunit.client.0.smithi097.stdout: lock_type: shared 2024-09-14T10:48:23.145 INFO:tasks.workunit.client.0.smithi097.stdout: tag: 2024-09-14T10:48:23.145 INFO:tasks.workunit.client.0.smithi097.stdout: lockers: 2024-09-14T10:48:23.145 INFO:tasks.workunit.client.0.smithi097.stdout: client.5190 expiration=0.000000 addr=v1:172.21.15.97:0/2916118042 cookie= 2024-09-14T10:48:24.115 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] ClsLock.TestMultiLocking (2777 ms) 2024-09-14T10:48:24.115 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] ClsLock.TestMeta 2024-09-14T10:48:26.358 INFO:tasks.workunit.client.0.smithi097.stdout:lock: mylock 2024-09-14T10:48:26.358 INFO:tasks.workunit.client.0.smithi097.stdout: lock_type: shared 2024-09-14T10:48:26.359 INFO:tasks.workunit.client.0.smithi097.stdout: tag: 2024-09-14T10:48:26.359 INFO:tasks.workunit.client.0.smithi097.stdout: lockers: 2024-09-14T10:48:26.359 INFO:tasks.workunit.client.0.smithi097.stdout: client.5042 expiration=0.000000 addr=v1:172.21.15.97:0/228280903 cookie= 2024-09-14T10:48:26.362 INFO:tasks.workunit.client.0.smithi097.stdout:lock: mylock 2024-09-14T10:48:26.362 INFO:tasks.workunit.client.0.smithi097.stdout: lock_type: exclusive 2024-09-14T10:48:26.362 INFO:tasks.workunit.client.0.smithi097.stdout: tag: new_tag 2024-09-14T10:48:26.363 INFO:tasks.workunit.client.0.smithi097.stdout: lockers: 2024-09-14T10:48:26.363 INFO:tasks.workunit.client.0.smithi097.stdout: client.5196 expiration=0.000000 addr=v1:172.21.15.97:0/920403348 cookie= 2024-09-14T10:48:27.136 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] ClsLock.TestMeta (3022 ms) 2024-09-14T10:48:27.137 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] ClsLock.TestCookie 2024-09-14T10:48:29.168 INFO:tasks.workunit.client.0.smithi097.stdout:lock: mylock 2024-09-14T10:48:29.168 INFO:tasks.workunit.client.0.smithi097.stdout: lock_type: exclusive 2024-09-14T10:48:29.168 INFO:tasks.workunit.client.0.smithi097.stdout: tag: 2024-09-14T10:48:29.168 INFO:tasks.workunit.client.0.smithi097.stdout: lockers: 2024-09-14T10:48:29.173 INFO:tasks.workunit.client.0.smithi097.stdout:lock: mylock 2024-09-14T10:48:29.173 INFO:tasks.workunit.client.0.smithi097.stdout: lock_type: shared 2024-09-14T10:48:29.173 INFO:tasks.workunit.client.0.smithi097.stdout: tag: 2024-09-14T10:48:29.173 INFO:tasks.workunit.client.0.smithi097.stdout: lockers: 2024-09-14T10:48:29.173 INFO:tasks.workunit.client.0.smithi097.stdout: client.5214 expiration=0.000000 addr=v1:172.21.15.97:0/1257415801 cookie= 2024-09-14T10:48:29.173 INFO:tasks.workunit.client.0.smithi097.stdout: client.5214 expiration=0.000000 addr=v1:172.21.15.97:0/1257415801 cookie=new cookie 2024-09-14T10:48:30.152 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] ClsLock.TestCookie (3015 ms) 2024-09-14T10:48:30.152 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-09-14T10:48:33.176 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] ClsLock.TestMultipleLocks (3025 ms) 2024-09-14T10:48:33.177 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] ClsLock.TestLockDuration 2024-09-14T10:48:41.214 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] ClsLock.TestLockDuration (8037 ms) 2024-09-14T10:48:41.214 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-09-14T10:48:44.235 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] ClsLock.TestAssertLocked (3017 ms) 2024-09-14T10:48:44.235 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] ClsLock.TestSetCookie 2024-09-14T10:48:47.253 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] ClsLock.TestSetCookie (3022 ms) 2024-09-14T10:48:47.253 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] ClsLock.TestRenew 2024-09-14T10:49:08.306 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] ClsLock.TestRenew (21051 ms) 2024-09-14T10:49:08.306 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-09-14T10:49:15.345 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (7040 ms) 2024-09-14T10:49:15.345 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-09-14T10:49:23.389 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (8045 ms) 2024-09-14T10:49:23.389 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-09-14T10:49:31.476 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8088 ms) 2024-09-14T10:49:31.477 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 11 tests from ClsLock (70139 ms total) 2024-09-14T10:49:31.477 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-14T10:49:31.477 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-14T10:49:31.477 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 11 tests from 1 test suite ran. (70139 ms total) 2024-09-14T10:49:31.477 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 11 tests. 2024-09-14T10:49:31.479 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T10:49:31.480 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T10:49:31.564 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-09-14T10:49:31.566 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-09-14T10:49:31.567 DEBUG:teuthology.orchestra.run.smithi097:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-09-14T10:49:31.653 INFO:tasks.workunit.client.0.smithi097.stdout:Running main() from gmock_main.cc 2024-09-14T10:49:31.653 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-14T10:49:31.653 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-14T10:49:31.653 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 4 tests from cls_log 2024-09-14T10:49:31.653 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-09-14T10:49:34.493 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_log.test_log_add_same_time (2840 ms) 2024-09-14T10:49:34.493 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-09-14T10:49:37.521 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_log.test_log_add_different_time (3028 ms) 2024-09-14T10:49:37.521 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_log.trim_by_time 2024-09-14T10:49:40.537 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_log.trim_by_time (3017 ms) 2024-09-14T10:49:40.537 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_log.trim_by_marker 2024-09-14T10:49:43.555 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_log.trim_by_marker (3016 ms) 2024-09-14T10:49:43.555 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 4 tests from cls_log (11901 ms total) 2024-09-14T10:49:43.555 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-14T10:49:43.555 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-14T10:49:43.555 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 4 tests from 1 test suite ran. (11901 ms total) 2024-09-14T10:49:43.555 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 4 tests. 2024-09-14T10:49:43.557 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T10:49:43.558 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T10:49:43.602 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-09-14T10:49:43.603 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-09-14T10:49:43.604 DEBUG:teuthology.orchestra.run.smithi097:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-09-14T10:49:43.691 INFO:tasks.workunit.client.0.smithi097.stdout:Running main() from gmock_main.cc 2024-09-14T10:49:43.691 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-14T10:49:43.691 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-14T10:49:43.692 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 10 tests from cls_refcount 2024-09-14T10:49:43.692 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_refcount.test_implicit 2024-09-14T10:49:46.611 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_refcount.test_implicit (2920 ms) 2024-09-14T10:49:46.612 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-09-14T10:49:49.637 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3026 ms) 2024-09-14T10:49:49.637 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_refcount.test_put_snap 2024-09-14T10:49:58.677 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_refcount.test_put_snap (9039 ms) 2024-09-14T10:49:58.678 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_refcount.test_explicit 2024-09-14T10:50:01.729 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_refcount.test_explicit (3052 ms) 2024-09-14T10:50:01.729 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_refcount.set 2024-09-14T10:50:04.741 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_refcount.set (3012 ms) 2024-09-14T10:50:04.741 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-09-14T10:50:11.775 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_refcount.test_implicit_ec (7034 ms) 2024-09-14T10:50:11.775 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-09-14T10:50:18.816 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7041 ms) 2024-09-14T10:50:18.816 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-09-14T10:50:31.885 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_refcount.test_put_snap_ec (13069 ms) 2024-09-14T10:50:31.886 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-09-14T10:50:38.897 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_refcount.test_explicit_ec (7012 ms) 2024-09-14T10:50:38.897 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_refcount.set_ec 2024-09-14T10:50:45.935 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_refcount.set_ec (7038 ms) 2024-09-14T10:50:45.935 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 10 tests from cls_refcount (62243 ms total) 2024-09-14T10:50:45.935 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-14T10:50:45.935 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-14T10:50:45.935 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 10 tests from 1 test suite ran. (62243 ms total) 2024-09-14T10:50:45.935 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 10 tests. 2024-09-14T10:50:45.938 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T10:50:45.938 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T10:50:45.981 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-09-14T10:50:45.983 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-09-14T10:50:45.983 DEBUG:teuthology.orchestra.run.smithi097:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-09-14T10:50:46.068 INFO:tasks.workunit.client.0.smithi097.stdout:Running main() from gmock_main.cc 2024-09-14T10:50:46.068 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 18 tests from 1 test suite. 2024-09-14T10:50:46.068 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-14T10:50:46.068 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 18 tests from cls_rgw 2024-09-14T10:50:47.957 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw.index_basic 2024-09-14T10:50:48.007 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw.index_basic (50 ms) 2024-09-14T10:50:48.007 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-09-14T10:50:48.036 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (30 ms) 2024-09-14T10:50:48.036 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw.index_remove_object 2024-09-14T10:50:48.075 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw.index_remove_object (38 ms) 2024-09-14T10:50:48.075 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw.index_suggest 2024-09-14T10:50:49.547 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw.index_suggest (1472 ms) 2024-09-14T10:50:49.547 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-09-14T10:50:49.556 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw.index_suggest_complete (9 ms) 2024-09-14T10:50:49.556 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw.index_list 2024-09-14T10:50:49.580 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw.index_list (24 ms) 2024-09-14T10:50:49.580 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-09-14T10:51:13.000 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw.index_list_delimited (23420 ms) 2024-09-14T10:51:13.000 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw.bi_list 2024-09-14T10:51:13.294 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw.bi_list (294 ms) 2024-09-14T10:51:13.294 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw.gc_set 2024-09-14T10:51:13.308 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw.gc_set (13 ms) 2024-09-14T10:51:13.308 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw.gc_list 2024-09-14T10:51:13.317 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw.gc_list (11 ms) 2024-09-14T10:51:13.317 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw.gc_defer 2024-09-14T10:51:21.153 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw.gc_defer (7835 ms) 2024-09-14T10:51:21.154 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw.usage_basic 2024-09-14T10:51:21.234 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw.usage_basic (82 ms) 2024-09-14T10:51:21.234 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-09-14T10:51:21.239 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw.usage_clear_no_obj (5 ms) 2024-09-14T10:51:21.239 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw.usage_clear 2024-09-14T10:51:21.330 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw.usage_clear (90 ms) 2024-09-14T10:51:21.330 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-09-14T10:51:21.382 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw.bi_log_trim (53 ms) 2024-09-14T10:51:21.382 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-09-14T10:51:21.397 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw.index_racing_removes (14 ms) 2024-09-14T10:51:21.397 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw.reshardlog_list 2024-09-14T10:51:21.414 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw.reshardlog_list (17 ms) 2024-09-14T10:51:21.414 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw.reshardlog_num 2024-09-14T10:51:21.424 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw.reshardlog_num (10 ms) 2024-09-14T10:51:22.158 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 18 tests from cls_rgw (33467 ms total) 2024-09-14T10:51:22.158 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-14T10:51:22.158 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-14T10:51:22.158 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 18 tests from 1 test suite ran. (36089 ms total) 2024-09-14T10:51:22.158 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 18 tests. 2024-09-14T10:51:22.160 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T10:51:22.160 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T10:51:22.203 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-09-14T10:51:22.204 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-09-14T10:51:22.205 DEBUG:teuthology.orchestra.run.smithi097:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-09-14T10:51:22.290 INFO:tasks.workunit.client.0.smithi097.stdout:Running main() from gmock_main.cc 2024-09-14T10:51:22.290 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-14T10:51:22.290 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-14T10:51:22.290 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 9 tests from cls_rgw_gc 2024-09-14T10:51:22.290 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw_gc.init 2024-09-14T10:51:24.178 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw_gc.init (1888 ms) 2024-09-14T10:51:24.178 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-09-14T10:51:24.201 INFO:tasks.workunit.client.0.smithi097.stderr:[ ] list info tag = chain-0 2024-09-14T10:51:24.202 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (23 ms) 2024-09-14T10:51:24.202 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-09-14T10:51:24.208 INFO:tasks.workunit.client.0.smithi097.stderr:[ ] next_marker is: = 0/4263 2024-09-14T10:51:24.209 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (8 ms) 2024-09-14T10:51:24.209 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-09-14T10:51:24.217 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (8 ms) 2024-09-14T10:51:24.217 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-09-14T10:51:24.224 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (8 ms) 2024-09-14T10:51:24.224 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-09-14T10:51:24.231 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (7 ms) 2024-09-14T10:51:24.232 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-09-14T10:51:24.242 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (11 ms) 2024-09-14T10:51:24.243 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-09-14T10:51:24.250 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (7 ms) 2024-09-14T10:51:24.250 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw_gc.finalize 2024-09-14T10:51:25.176 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw_gc.finalize (926 ms) 2024-09-14T10:51:25.176 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 9 tests from cls_rgw_gc (2886 ms total) 2024-09-14T10:51:25.176 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-14T10:51:25.176 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-14T10:51:25.176 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 9 tests from 1 test suite ran. (2886 ms total) 2024-09-14T10:51:25.176 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 9 tests. 2024-09-14T10:51:25.179 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T10:51:25.179 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T10:51:25.222 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-09-14T10:51:25.223 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-09-14T10:51:25.223 DEBUG:teuthology.orchestra.run.smithi097:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-09-14T10:51:25.316 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:51:25.316 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:51:25.317 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 1 test from 1 test suite. 2024-09-14T10:51:25.317 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-14T10:51:27.209 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 1 test from cls_rgw_stats 2024-09-14T10:51:27.209 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] cls_rgw_stats.simulate 2024-09-14T10:51:27.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.226+0000 7f19187cc780 1 > prepared operation key=OVOPGTYUF3F3 tag=KL0A4NOVVM2U type=del size=1840021 2024-09-14T10:51:27.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.230+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~EN6O4TL5TC6V.0 size=1048576 2024-09-14T10:51:27.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.231+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~EN6O4TL5TC6V.1 size=1048576 2024-09-14T10:51:27.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.232+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~EN6O4TL5TC6V.2 size=156460 2024-09-14T10:51:27.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.232+0000 7f19187cc780 1 > prepared multipart upload key=OVOPGTYUF3F3 upload=EN6O4TL5TC6V tag=R0Z9UPZB8WUQ type=write size=3302188 2024-09-14T10:51:27.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.234+0000 7f19187cc780 1 > prepared operation key=W1K1IU13J0CZ tag=Y9IQNLVNXF7C type=del size=3299783 2024-09-14T10:51:27.237 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.235+0000 7f19187cc780 1 > prepared operation key=OVOPGTYUF3F3 tag=2VWFY2FZN0IC type=del size=1993045 2024-09-14T10:51:27.237 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.237+0000 7f19187cc780 1 > prepared operation key=OVOPGTYUF3F3 tag=7MJ7IL72BV4G type=write size=45580 2024-09-14T10:51:27.238 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.240+0000 7f19187cc780 1 > prepared part key=_multipart_EL00Y4Z7DTAT.2~TGULHLAUGTNR.0 size=538328 2024-09-14T10:51:27.238 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.240+0000 7f19187cc780 1 > prepared multipart upload key=EL00Y4Z7DTAT upload=TGULHLAUGTNR tag=2RJYZW6MMT4M type=write size=1586904 2024-09-14T10:51:27.240 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.242+0000 7f19187cc780 1 > prepared operation key=INJQTKXHBUV2 tag=5KCDXQTV1VWZ type=write size=860285 2024-09-14T10:51:27.242 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.243+0000 7f19187cc780 1 > prepared operation key=6BNN842ZTWG5 tag=5B7CMNJKCLQR type=del size=1045225 2024-09-14T10:51:27.245 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.247+0000 7f19187cc780 1 > prepared part key=_multipart_RTGE7ISETJWW.2~QS8EWUP3WTEM.0 size=575595 2024-09-14T10:51:27.245 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.247+0000 7f19187cc780 1 > prepared multipart upload key=RTGE7ISETJWW upload=QS8EWUP3WTEM tag=U48H9DWZR10E type=write size=1624171 2024-09-14T10:51:27.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.248+0000 7f19187cc780 1 > prepared operation key=6BNN842ZTWG5 tag=GQI33YPFJ95U type=del size=2812176 2024-09-14T10:51:27.248 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.250+0000 7f19187cc780 1 > prepared operation key=AGNUE76X8XCJ tag=C428TVAF4PPQ type=del size=1242576 2024-09-14T10:51:27.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.253+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~I4AD5SOI1B92.0 size=1048576 2024-09-14T10:51:27.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.254+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~I4AD5SOI1B92.1 size=1048576 2024-09-14T10:51:27.254 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.256+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~I4AD5SOI1B92.2 size=566861 2024-09-14T10:51:27.254 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.256+0000 7f19187cc780 1 > prepared multipart upload key=VW6U36JN2DBX upload=I4AD5SOI1B92 tag=YYI4TQOZGDH9 type=write size=3712589 2024-09-14T10:51:27.257 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.258+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~2AF6J13EOLAL.0 size=1048576 2024-09-14T10:51:27.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.260+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~2AF6J13EOLAL.1 size=969725 2024-09-14T10:51:27.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.260+0000 7f19187cc780 1 > prepared multipart upload key=AGNUE76X8XCJ upload=2AF6J13EOLAL tag=PV3AOR0K1CAB type=write size=3066877 2024-09-14T10:51:27.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.261+0000 7f19187cc780 1 > prepared operation key=EL00Y4Z7DTAT tag=H9G3SCCJ3ZY0 type=del size=864369 2024-09-14T10:51:27.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.263+0000 7f19187cc780 1 > prepared operation key=QFEI6H4EQ9ZR tag=TEO603GAB4GL type=del size=3675260 2024-09-14T10:51:27.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.264+0000 7f19187cc780 1 > prepared operation key=W1K1IU13J0CZ tag=UASKZ7YYF72Y type=del size=2187773 2024-09-14T10:51:27.264 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.266+0000 7f19187cc780 1 < completed delete operation key=OVOPGTYUF3F3 tag=KL0A4NOVVM2U type=del 2024-09-14T10:51:27.267 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.268+0000 7f19187cc780 1 > prepared part key=_multipart_MFA30GSMCSKP.2~IE5G137SK2FA.0 size=331111 2024-09-14T10:51:27.267 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.268+0000 7f19187cc780 1 > prepared multipart upload key=MFA30GSMCSKP upload=IE5G137SK2FA tag=7VI67H99WL25 type=write size=1379687 2024-09-14T10:51:27.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.270+0000 7f19187cc780 1 < completed part key=_multipart_OVOPGTYUF3F3.2~EN6O4TL5TC6V.0 size=1048576 2024-09-14T10:51:27.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.272+0000 7f19187cc780 1 < completed part key=_multipart_OVOPGTYUF3F3.2~EN6O4TL5TC6V.1 size=1048576 2024-09-14T10:51:27.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.273+0000 7f19187cc780 1 < completed part key=_multipart_OVOPGTYUF3F3.2~EN6O4TL5TC6V.2 size=156460 2024-09-14T10:51:27.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.276+0000 7f19187cc780 1 < completed multipart upload key=OVOPGTYUF3F3 upload=EN6O4TL5TC6V tag=R0Z9UPZB8WUQ type=write size=3302188 2024-09-14T10:51:27.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.277+0000 7f19187cc780 1 > prepared operation key=B9FQYIX19AEP tag=1RF4324Y40AO type=write size=235979 2024-09-14T10:51:27.277 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.279+0000 7f19187cc780 1 < completed delete operation key=W1K1IU13J0CZ tag=Y9IQNLVNXF7C type=del 2024-09-14T10:51:27.279 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.281+0000 7f19187cc780 1 > prepared operation key=54BSD3DEHNK6 tag=ER7ZEE6FXXFB type=del size=1229271 2024-09-14T10:51:27.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.284+0000 7f19187cc780 1 < suggested update operation key=OVOPGTYUF3F3 tag=2VWFY2FZN0IC type=del size=1993045 2024-09-14T10:51:27.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.287+0000 7f19187cc780 1 > prepared part key=_multipart_INJQTKXHBUV2.2~4S6G4HH42W63.0 size=1048576 2024-09-14T10:51:27.287 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.288+0000 7f19187cc780 1 > prepared part key=_multipart_INJQTKXHBUV2.2~4S6G4HH42W63.1 size=878594 2024-09-14T10:51:27.287 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.288+0000 7f19187cc780 1 > prepared multipart upload key=INJQTKXHBUV2 upload=4S6G4HH42W63 tag=5S02PMCYO8M1 type=write size=2975746 2024-09-14T10:51:27.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.290+0000 7f19187cc780 -1 < failed to complete operation key=OVOPGTYUF3F3 tag=7MJ7IL72BV4G type=write size=45580: (22) Invalid argument 2024-09-14T10:51:27.290 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.291+0000 7f19187cc780 1 > prepared operation key=19P3WE6HKJH2 tag=CQU3ZH8RWS8F type=del size=848066 2024-09-14T10:51:27.291 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.293+0000 7f19187cc780 1 < completed part key=_multipart_EL00Y4Z7DTAT.2~TGULHLAUGTNR.0 size=538328 2024-09-14T10:51:27.294 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.295+0000 7f19187cc780 1 < completed multipart upload key=EL00Y4Z7DTAT upload=TGULHLAUGTNR tag=2RJYZW6MMT4M type=write size=1586904 2024-09-14T10:51:27.295 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.297+0000 7f19187cc780 1 > prepared operation key=KP3WOGIF30PZ tag=RD4GFHRWD946 type=del size=1652325 2024-09-14T10:51:27.298 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.300+0000 7f19187cc780 1 < suggested update operation key=INJQTKXHBUV2 tag=5KCDXQTV1VWZ type=write size=860285 2024-09-14T10:51:27.300 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.302+0000 7f19187cc780 1 > prepared operation key=5AIAYJMRZGFQ tag=5WGG2PWPUYR9 type=del size=2676725 2024-09-14T10:51:27.302 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.303+0000 7f19187cc780 1 < completed delete operation key=6BNN842ZTWG5 tag=5B7CMNJKCLQR type=del 2024-09-14T10:51:27.304 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.306+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~B1DQF2ZDD6DN.0 size=1048576 2024-09-14T10:51:27.306 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.307+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~B1DQF2ZDD6DN.1 size=1048576 2024-09-14T10:51:27.307 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.308+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~B1DQF2ZDD6DN.2 size=741811 2024-09-14T10:51:27.307 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.308+0000 7f19187cc780 1 > prepared multipart upload key=6BNN842ZTWG5 upload=B1DQF2ZDD6DN tag=V4J7POZSXUAI type=write size=3887539 2024-09-14T10:51:27.309 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.311+0000 7f19187cc780 1 < completed part key=_multipart_RTGE7ISETJWW.2~QS8EWUP3WTEM.0 size=575595 2024-09-14T10:51:27.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.314+0000 7f19187cc780 1 < completed multipart upload key=RTGE7ISETJWW upload=QS8EWUP3WTEM tag=U48H9DWZR10E type=write size=1624171 2024-09-14T10:51:27.313 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.315+0000 7f19187cc780 1 > prepared operation key=QFEI6H4EQ9ZR tag=JHCV5I4JLG04 type=del size=2965668 2024-09-14T10:51:27.315 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.316+0000 7f19187cc780 1 < completed delete operation key=6BNN842ZTWG5 tag=GQI33YPFJ95U type=del 2024-09-14T10:51:27.316 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.318+0000 7f19187cc780 1 > prepared operation key=INJQTKXHBUV2 tag=96UJW3CSBQRQ type=write size=98041 2024-09-14T10:51:27.318 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.319+0000 7f19187cc780 1 < canceled operation key=AGNUE76X8XCJ tag=C428TVAF4PPQ type=del size=1242576 2024-09-14T10:51:27.319 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.321+0000 7f19187cc780 1 > prepared operation key=617QQI921HB4 tag=XR9761EJ220O type=del size=2854844 2024-09-14T10:51:27.321 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.322+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~I4AD5SOI1B92.0 size=1048576 2024-09-14T10:51:27.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.323+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~I4AD5SOI1B92.1 size=1048576 2024-09-14T10:51:27.323 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.325+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~I4AD5SOI1B92.2 size=566861 2024-09-14T10:51:27.326 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.327+0000 7f19187cc780 1 < completed multipart upload key=VW6U36JN2DBX upload=I4AD5SOI1B92 tag=YYI4TQOZGDH9 type=write size=3712589 2024-09-14T10:51:27.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.330+0000 7f19187cc780 1 > prepared part key=_multipart_9EBD5ZT6MT45.2~8802UNK7JJHN.0 size=333687 2024-09-14T10:51:27.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.330+0000 7f19187cc780 1 > prepared multipart upload key=9EBD5ZT6MT45 upload=8802UNK7JJHN tag=W0CPH2X2JIBS type=write size=1382263 2024-09-14T10:51:27.329 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.330+0000 7f19187cc780 1 < canceled part key=_multipart_AGNUE76X8XCJ.2~2AF6J13EOLAL.0 size=1048576 2024-09-14T10:51:27.330 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.331+0000 7f19187cc780 1 < completed part key=_multipart_AGNUE76X8XCJ.2~2AF6J13EOLAL.1 size=969725 2024-09-14T10:51:27.332 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.334+0000 7f19187cc780 1 < canceled multipart upload key=AGNUE76X8XCJ upload=2AF6J13EOLAL tag=PV3AOR0K1CAB type=write size=3066877 2024-09-14T10:51:27.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.339+0000 7f19187cc780 1 > prepared part key=_multipart_54BSD3DEHNK6.2~226EZD8QDMLZ.0 size=259902 2024-09-14T10:51:27.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.339+0000 7f19187cc780 1 > prepared multipart upload key=54BSD3DEHNK6 upload=226EZD8QDMLZ tag=JHECRN7VC3DX type=write size=1308478 2024-09-14T10:51:27.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.340+0000 7f19187cc780 1 < completed delete operation key=EL00Y4Z7DTAT tag=H9G3SCCJ3ZY0 type=del 2024-09-14T10:51:27.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.342+0000 7f19187cc780 1 > prepared operation key=MFA30GSMCSKP tag=IKYD3QFMWIX9 type=del size=827543 2024-09-14T10:51:27.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.343+0000 7f19187cc780 1 < completed delete operation key=QFEI6H4EQ9ZR tag=TEO603GAB4GL type=del 2024-09-14T10:51:27.344 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.346+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~GLXVO43C6Q9T.0 size=1048576 2024-09-14T10:51:27.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.347+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~GLXVO43C6Q9T.1 size=1048576 2024-09-14T10:51:27.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.348+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~GLXVO43C6Q9T.2 size=304140 2024-09-14T10:51:27.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.348+0000 7f19187cc780 1 > prepared multipart upload key=AGNUE76X8XCJ upload=GLXVO43C6Q9T tag=HZ795L40BQVQ type=write size=3449868 2024-09-14T10:51:27.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.350+0000 7f19187cc780 1 < completed delete operation key=W1K1IU13J0CZ tag=UASKZ7YYF72Y type=del 2024-09-14T10:51:27.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.351+0000 7f19187cc780 1 > prepared operation key=61O2VU0SB379 tag=6DOB0OKEXP2K type=write size=383401 2024-09-14T10:51:27.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.353+0000 7f19187cc780 1 < completed part key=_multipart_MFA30GSMCSKP.2~IE5G137SK2FA.0 size=331111 2024-09-14T10:51:27.354 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.355+0000 7f19187cc780 1 < completed multipart upload key=MFA30GSMCSKP upload=IE5G137SK2FA tag=7VI67H99WL25 type=write size=1379687 2024-09-14T10:51:27.355 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.357+0000 7f19187cc780 1 > prepared operation key=W1K1IU13J0CZ tag=X5KXERBTJXJX type=del size=587576 2024-09-14T10:51:27.357 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.359+0000 7f19187cc780 1 < completed write operation key=B9FQYIX19AEP tag=1RF4324Y40AO type=write size=235979 2024-09-14T10:51:27.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.361+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~L0RQ07O5JQAL.0 size=597970 2024-09-14T10:51:27.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.361+0000 7f19187cc780 1 > prepared multipart upload key=IKVYA4KEALFF upload=L0RQ07O5JQAL tag=W114NSCLYKTS type=write size=1646546 2024-09-14T10:51:27.361 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.363+0000 7f19187cc780 1 < completed delete operation key=54BSD3DEHNK6 tag=ER7ZEE6FXXFB type=del 2024-09-14T10:51:27.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.365+0000 7f19187cc780 1 > prepared part key=_multipart_61O2VU0SB379.2~HCWY32WQWAA1.0 size=466803 2024-09-14T10:51:27.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.365+0000 7f19187cc780 1 > prepared multipart upload key=61O2VU0SB379 upload=HCWY32WQWAA1 tag=TAVFTCS6NROI type=write size=1515379 2024-09-14T10:51:27.366 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.367+0000 7f19187cc780 1 < completed part key=_multipart_INJQTKXHBUV2.2~4S6G4HH42W63.0 size=1048576 2024-09-14T10:51:27.368 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.370+0000 7f19187cc780 1 < completed part key=_multipart_INJQTKXHBUV2.2~4S6G4HH42W63.1 size=878594 2024-09-14T10:51:27.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.372+0000 7f19187cc780 1 < completed multipart upload key=INJQTKXHBUV2 upload=4S6G4HH42W63 tag=5S02PMCYO8M1 type=write size=2975746 2024-09-14T10:51:27.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.375+0000 7f19187cc780 1 > prepared part key=_multipart_617QQI921HB4.2~HU76LWVEQOIU.0 size=1048576 2024-09-14T10:51:27.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.376+0000 7f19187cc780 1 > prepared part key=_multipart_617QQI921HB4.2~HU76LWVEQOIU.1 size=364916 2024-09-14T10:51:27.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.376+0000 7f19187cc780 1 > prepared multipart upload key=617QQI921HB4 upload=HU76LWVEQOIU tag=G7RKKBQ0BUD0 type=write size=2462068 2024-09-14T10:51:27.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.377+0000 7f19187cc780 1 < completed delete operation key=19P3WE6HKJH2 tag=CQU3ZH8RWS8F type=del 2024-09-14T10:51:27.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.379+0000 7f19187cc780 1 > prepared operation key=6BNN842ZTWG5 tag=1JJM4MOHUJL4 type=del size=3415437 2024-09-14T10:51:27.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.381+0000 7f19187cc780 1 < suggested remove operation key=KP3WOGIF30PZ tag=RD4GFHRWD946 type=del 2024-09-14T10:51:27.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.383+0000 7f19187cc780 1 > prepared operation key=H40763V7HMBC tag=VY5D303A7EFT type=write size=353585 2024-09-14T10:51:27.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.384+0000 7f19187cc780 1 < canceled operation key=5AIAYJMRZGFQ tag=5WGG2PWPUYR9 type=del size=2676725 2024-09-14T10:51:27.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.386+0000 7f19187cc780 1 > prepared operation key=W1K1IU13J0CZ tag=EQFT780KH4VV type=del size=3410735 2024-09-14T10:51:27.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.388+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~B1DQF2ZDD6DN.0 size=1048576 2024-09-14T10:51:27.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.389+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~B1DQF2ZDD6DN.1 size=1048576 2024-09-14T10:51:27.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.389+0000 7f19187cc780 1 < canceled part key=_multipart_6BNN842ZTWG5.2~B1DQF2ZDD6DN.2 size=741811 2024-09-14T10:51:27.392 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.393+0000 7f19187cc780 1 < canceled multipart upload key=6BNN842ZTWG5 upload=B1DQF2ZDD6DN tag=V4J7POZSXUAI type=write size=3887539 2024-09-14T10:51:27.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.395+0000 7f19187cc780 1 > prepared operation key=AST81B9QWORT tag=T3BXOA0Y8XF2 type=del size=3328759 2024-09-14T10:51:27.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.396+0000 7f19187cc780 1 < completed delete operation key=QFEI6H4EQ9ZR tag=JHCV5I4JLG04 type=del 2024-09-14T10:51:27.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.397+0000 7f19187cc780 1 > prepared operation key=EL00Y4Z7DTAT tag=9ISTJYMHL8VM type=del size=1623676 2024-09-14T10:51:27.397 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.399+0000 7f19187cc780 1 < completed write operation key=INJQTKXHBUV2 tag=96UJW3CSBQRQ type=write size=98041 2024-09-14T10:51:27.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.400+0000 7f19187cc780 1 > prepared operation key=75O00VMLJJ1X tag=JV6NX9015ZVC type=del size=3596377 2024-09-14T10:51:27.400 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.402+0000 7f19187cc780 1 < completed delete operation key=617QQI921HB4 tag=XR9761EJ220O type=del 2024-09-14T10:51:27.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.403+0000 7f19187cc780 1 > prepared operation key=AST81B9QWORT tag=D1EEKU7PZPMW type=del size=710787 2024-09-14T10:51:27.403 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.404+0000 7f19187cc780 1 < completed part key=_multipart_9EBD5ZT6MT45.2~8802UNK7JJHN.0 size=333687 2024-09-14T10:51:27.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.407+0000 7f19187cc780 1 < completed multipart upload key=9EBD5ZT6MT45 upload=8802UNK7JJHN tag=W0CPH2X2JIBS type=write size=1382263 2024-09-14T10:51:27.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.408+0000 7f19187cc780 1 > prepared operation key=61O2VU0SB379 tag=6JMFU2CJCBUL type=del size=37668 2024-09-14T10:51:27.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.410+0000 7f19187cc780 1 < completed part key=_multipart_54BSD3DEHNK6.2~226EZD8QDMLZ.0 size=259902 2024-09-14T10:51:27.410 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.412+0000 7f19187cc780 1 < completed multipart upload key=54BSD3DEHNK6 upload=226EZD8QDMLZ tag=JHECRN7VC3DX type=write size=1308478 2024-09-14T10:51:27.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.414+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~CULDXYK0ZPDR.0 size=1048576 2024-09-14T10:51:27.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.415+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~CULDXYK0ZPDR.1 size=628144 2024-09-14T10:51:27.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.415+0000 7f19187cc780 1 > prepared multipart upload key=7IWUW2HC3ULI upload=CULDXYK0ZPDR tag=98QPTI71UCIS type=write size=2725296 2024-09-14T10:51:27.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.418+0000 7f19187cc780 1 < suggested remove operation key=MFA30GSMCSKP tag=IKYD3QFMWIX9 type=del 2024-09-14T10:51:27.419 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.421+0000 7f19187cc780 1 > prepared part key=_multipart_9EBD5ZT6MT45.2~HIOIATWCS7AA.0 size=1048576 2024-09-14T10:51:27.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.422+0000 7f19187cc780 1 > prepared part key=_multipart_9EBD5ZT6MT45.2~HIOIATWCS7AA.1 size=1048576 2024-09-14T10:51:27.421 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.423+0000 7f19187cc780 1 > prepared part key=_multipart_9EBD5ZT6MT45.2~HIOIATWCS7AA.2 size=410650 2024-09-14T10:51:27.421 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.423+0000 7f19187cc780 1 > prepared multipart upload key=9EBD5ZT6MT45 upload=HIOIATWCS7AA tag=J7ULE6QCIE8T type=write size=3556378 2024-09-14T10:51:27.423 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.424+0000 7f19187cc780 1 < completed part key=_multipart_AGNUE76X8XCJ.2~GLXVO43C6Q9T.0 size=1048576 2024-09-14T10:51:27.424 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.425+0000 7f19187cc780 1 < completed part key=_multipart_AGNUE76X8XCJ.2~GLXVO43C6Q9T.1 size=1048576 2024-09-14T10:51:27.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.427+0000 7f19187cc780 1 < completed part key=_multipart_AGNUE76X8XCJ.2~GLXVO43C6Q9T.2 size=304140 2024-09-14T10:51:27.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.429+0000 7f19187cc780 1 < completed multipart upload key=AGNUE76X8XCJ upload=GLXVO43C6Q9T tag=HZ795L40BQVQ type=write size=3449868 2024-09-14T10:51:27.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.431+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~66R375DIU3BZ.0 size=1048576 2024-09-14T10:51:27.431 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.432+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~66R375DIU3BZ.1 size=528391 2024-09-14T10:51:27.431 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.432+0000 7f19187cc780 1 > prepared multipart upload key=B9FQYIX19AEP upload=66R375DIU3BZ tag=LWF48A7SIJYA type=write size=2625543 2024-09-14T10:51:27.434 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.435+0000 7f19187cc780 1 < suggested remove operation key=61O2VU0SB379 tag=6DOB0OKEXP2K type=write 2024-09-14T10:51:27.436 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.438+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~KVPHEMYHF122.0 size=1031556 2024-09-14T10:51:27.436 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.438+0000 7f19187cc780 1 > prepared multipart upload key=IKVYA4KEALFF upload=KVPHEMYHF122 tag=FOW6XU2F0SMQ type=write size=2080132 2024-09-14T10:51:27.440 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.440+0000 7f19187cc780 1 < canceled operation key=W1K1IU13J0CZ tag=X5KXERBTJXJX type=del size=587576 2024-09-14T10:51:27.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.442+0000 7f19187cc780 1 > prepared part key=_multipart_E6UO1LUWOC44.2~WVWCDY9MI2LA.0 size=1048576 2024-09-14T10:51:27.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.444+0000 7f19187cc780 1 > prepared part key=_multipart_E6UO1LUWOC44.2~WVWCDY9MI2LA.1 size=919178 2024-09-14T10:51:27.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.444+0000 7f19187cc780 1 > prepared multipart upload key=E6UO1LUWOC44 upload=WVWCDY9MI2LA tag=396TACEXWJJJ type=write size=3016330 2024-09-14T10:51:27.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.445+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~L0RQ07O5JQAL.0 size=597970 2024-09-14T10:51:27.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.447+0000 7f19187cc780 1 < completed multipart upload key=IKVYA4KEALFF upload=L0RQ07O5JQAL tag=W114NSCLYKTS type=write size=1646546 2024-09-14T10:51:27.448 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.450+0000 7f19187cc780 1 > prepared part key=_multipart_N0L67LS2KHR1.2~ZQT5NHET729E.0 size=787998 2024-09-14T10:51:27.448 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.450+0000 7f19187cc780 1 > prepared multipart upload key=N0L67LS2KHR1 upload=ZQT5NHET729E tag=VFWPPI757LYO type=write size=1836574 2024-09-14T10:51:27.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.451+0000 7f19187cc780 1 < completed part key=_multipart_61O2VU0SB379.2~HCWY32WQWAA1.0 size=466803 2024-09-14T10:51:27.452 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.454+0000 7f19187cc780 1 < completed multipart upload key=61O2VU0SB379 upload=HCWY32WQWAA1 tag=TAVFTCS6NROI type=write size=1515379 2024-09-14T10:51:27.455 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.457+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~OXFCINRXK55T.0 size=1048576 2024-09-14T10:51:27.456 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.458+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~OXFCINRXK55T.1 size=1048576 2024-09-14T10:51:27.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.459+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~OXFCINRXK55T.2 size=541252 2024-09-14T10:51:27.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.459+0000 7f19187cc780 1 > prepared multipart upload key=B9FQYIX19AEP upload=OXFCINRXK55T tag=KE3SIMDNH2LS type=write size=3686980 2024-09-14T10:51:27.459 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.460+0000 7f19187cc780 1 < completed part key=_multipart_617QQI921HB4.2~HU76LWVEQOIU.0 size=1048576 2024-09-14T10:51:27.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.461+0000 7f19187cc780 1 < completed part key=_multipart_617QQI921HB4.2~HU76LWVEQOIU.1 size=364916 2024-09-14T10:51:27.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.464+0000 7f19187cc780 1 < completed multipart upload key=617QQI921HB4 upload=HU76LWVEQOIU tag=G7RKKBQ0BUD0 type=write size=2462068 2024-09-14T10:51:27.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.465+0000 7f19187cc780 1 > prepared operation key=54BSD3DEHNK6 tag=RXHYU38G99WT type=del size=91644 2024-09-14T10:51:27.466 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.467+0000 7f19187cc780 1 < completed delete operation key=6BNN842ZTWG5 tag=1JJM4MOHUJL4 type=del 2024-09-14T10:51:27.467 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.469+0000 7f19187cc780 1 > prepared operation key=KOJ7QB7M6A35 tag=YN4ZUVTKL982 type=del size=4143528 2024-09-14T10:51:27.470 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.472+0000 7f19187cc780 1 < suggested update operation key=H40763V7HMBC tag=VY5D303A7EFT type=write size=353585 2024-09-14T10:51:27.471 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.473+0000 7f19187cc780 1 > prepared operation key=CADC2BY888V1 tag=GXODL30XGXKO type=del size=1604377 2024-09-14T10:51:27.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.475+0000 7f19187cc780 1 < completed delete operation key=W1K1IU13J0CZ tag=EQFT780KH4VV type=del 2024-09-14T10:51:27.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.476+0000 7f19187cc780 1 > prepared operation key=54BSD3DEHNK6 tag=GSZ6XQRZ9HKL type=del size=633036 2024-09-14T10:51:27.476 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.478+0000 7f19187cc780 1 < completed delete operation key=AST81B9QWORT tag=T3BXOA0Y8XF2 type=del 2024-09-14T10:51:27.479 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.481+0000 7f19187cc780 1 > prepared part key=_multipart_CADC2BY888V1.2~DFK3U8JPTOB0.0 size=1048576 2024-09-14T10:51:27.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.482+0000 7f19187cc780 1 > prepared part key=_multipart_CADC2BY888V1.2~DFK3U8JPTOB0.1 size=751606 2024-09-14T10:51:27.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.482+0000 7f19187cc780 1 > prepared multipart upload key=CADC2BY888V1 upload=DFK3U8JPTOB0 tag=ZG83D9LKT8SN type=write size=2848758 2024-09-14T10:51:27.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.483+0000 7f19187cc780 1 < completed delete operation key=EL00Y4Z7DTAT tag=9ISTJYMHL8VM type=del 2024-09-14T10:51:27.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.486+0000 7f19187cc780 1 > prepared part key=_multipart_INJQTKXHBUV2.2~RKPKD3RGA8AJ.0 size=1048576 2024-09-14T10:51:27.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.487+0000 7f19187cc780 1 > prepared part key=_multipart_INJQTKXHBUV2.2~RKPKD3RGA8AJ.1 size=574029 2024-09-14T10:51:27.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.487+0000 7f19187cc780 1 > prepared multipart upload key=INJQTKXHBUV2 upload=RKPKD3RGA8AJ tag=7KMYBKGED26I type=write size=2671181 2024-09-14T10:51:27.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.488+0000 7f19187cc780 1 < completed delete operation key=75O00VMLJJ1X tag=JV6NX9015ZVC type=del 2024-09-14T10:51:27.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.491+0000 7f19187cc780 1 > prepared part key=_multipart_CADC2BY888V1.2~GIER94B4ZIVV.0 size=1048576 2024-09-14T10:51:27.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.492+0000 7f19187cc780 1 > prepared part key=_multipart_CADC2BY888V1.2~GIER94B4ZIVV.1 size=479763 2024-09-14T10:51:27.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.492+0000 7f19187cc780 1 > prepared multipart upload key=CADC2BY888V1 upload=GIER94B4ZIVV tag=BVZVZ5LKXHQ2 type=write size=2576915 2024-09-14T10:51:27.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.493+0000 7f19187cc780 1 < completed delete operation key=AST81B9QWORT tag=D1EEKU7PZPMW type=del 2024-09-14T10:51:27.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.496+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~2H1RR19DMUT0.0 size=1048576 2024-09-14T10:51:27.495 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.497+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~2H1RR19DMUT0.1 size=806525 2024-09-14T10:51:27.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.497+0000 7f19187cc780 1 > prepared multipart upload key=6BNN842ZTWG5 upload=2H1RR19DMUT0 tag=J3M0F5C3OM7V type=write size=2903677 2024-09-14T10:51:27.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.499+0000 7f19187cc780 -1 < failed to complete operation key=61O2VU0SB379 tag=6JMFU2CJCBUL type=del size=37668: (22) Invalid argument 2024-09-14T10:51:27.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.500+0000 7f19187cc780 1 > prepared operation key=INJQTKXHBUV2 tag=4F914GZ999LX type=del size=935594 2024-09-14T10:51:27.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.502+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~CULDXYK0ZPDR.0 size=1048576 2024-09-14T10:51:27.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.503+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~CULDXYK0ZPDR.1 size=628144 2024-09-14T10:51:27.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.505+0000 7f19187cc780 1 < completed multipart upload key=7IWUW2HC3ULI upload=CULDXYK0ZPDR tag=98QPTI71UCIS type=write size=2725296 2024-09-14T10:51:27.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.507+0000 7f19187cc780 1 > prepared operation key=M73CER01XHDY tag=TRRM3N44BRWP type=del size=2198285 2024-09-14T10:51:27.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.508+0000 7f19187cc780 1 < completed part key=_multipart_9EBD5ZT6MT45.2~HIOIATWCS7AA.0 size=1048576 2024-09-14T10:51:27.508 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.509+0000 7f19187cc780 1 < completed part key=_multipart_9EBD5ZT6MT45.2~HIOIATWCS7AA.1 size=1048576 2024-09-14T10:51:27.509 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.510+0000 7f19187cc780 1 < completed part key=_multipart_9EBD5ZT6MT45.2~HIOIATWCS7AA.2 size=410650 2024-09-14T10:51:27.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.513+0000 7f19187cc780 1 < completed multipart upload key=9EBD5ZT6MT45 upload=HIOIATWCS7AA tag=J7ULE6QCIE8T type=write size=3556378 2024-09-14T10:51:27.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.516+0000 7f19187cc780 1 > prepared part key=_multipart_EZLSMEK89N2G.2~EGILUPSA2H33.0 size=1048576 2024-09-14T10:51:27.515 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.517+0000 7f19187cc780 1 > prepared part key=_multipart_EZLSMEK89N2G.2~EGILUPSA2H33.1 size=1048576 2024-09-14T10:51:27.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.518+0000 7f19187cc780 1 > prepared part key=_multipart_EZLSMEK89N2G.2~EGILUPSA2H33.2 size=29219 2024-09-14T10:51:27.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.518+0000 7f19187cc780 1 > prepared multipart upload key=EZLSMEK89N2G upload=EGILUPSA2H33 tag=ERUAR2PRUN3A type=write size=3174947 2024-09-14T10:51:27.518 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.519+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~66R375DIU3BZ.0 size=1048576 2024-09-14T10:51:27.519 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.521+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~66R375DIU3BZ.1 size=528391 2024-09-14T10:51:27.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.523+0000 7f19187cc780 1 < completed multipart upload key=B9FQYIX19AEP upload=66R375DIU3BZ tag=LWF48A7SIJYA type=write size=2625543 2024-09-14T10:51:27.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.525+0000 7f19187cc780 1 > prepared operation key=19P3WE6HKJH2 tag=EKERD885D4AV type=write size=229524 2024-09-14T10:51:27.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.526+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~KVPHEMYHF122.0 size=1031556 2024-09-14T10:51:27.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.529+0000 7f19187cc780 1 < completed multipart upload key=IKVYA4KEALFF upload=KVPHEMYHF122 tag=FOW6XU2F0SMQ type=write size=2080132 2024-09-14T10:51:27.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.531+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~CNJV42AOO19M.0 size=366108 2024-09-14T10:51:27.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.531+0000 7f19187cc780 1 > prepared multipart upload key=IKVYA4KEALFF upload=CNJV42AOO19M tag=VILYOGKXR6GP type=write size=1414684 2024-09-14T10:51:27.531 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.533+0000 7f19187cc780 1 < completed part key=_multipart_E6UO1LUWOC44.2~WVWCDY9MI2LA.0 size=1048576 2024-09-14T10:51:27.532 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.534+0000 7f19187cc780 1 < completed part key=_multipart_E6UO1LUWOC44.2~WVWCDY9MI2LA.1 size=919178 2024-09-14T10:51:27.534 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.536+0000 7f19187cc780 1 < completed multipart upload key=E6UO1LUWOC44 upload=WVWCDY9MI2LA tag=396TACEXWJJJ type=write size=3016330 2024-09-14T10:51:27.536 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.537+0000 7f19187cc780 1 > prepared operation key=EZLSMEK89N2G tag=V3QQ0RBFC7TD type=del size=525618 2024-09-14T10:51:27.536 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.538+0000 7f19187cc780 1 < canceled part key=_multipart_N0L67LS2KHR1.2~ZQT5NHET729E.0 size=787998 2024-09-14T10:51:27.539 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.540+0000 7f19187cc780 1 < canceled multipart upload key=N0L67LS2KHR1 upload=ZQT5NHET729E tag=VFWPPI757LYO type=write size=1836574 2024-09-14T10:51:27.540 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.542+0000 7f19187cc780 1 > prepared operation key=AGNUE76X8XCJ tag=1FG28PV4DB8N type=del size=3958168 2024-09-14T10:51:27.541 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.543+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~OXFCINRXK55T.0 size=1048576 2024-09-14T10:51:27.542 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.544+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~OXFCINRXK55T.1 size=1048576 2024-09-14T10:51:27.544 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.545+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~OXFCINRXK55T.2 size=541252 2024-09-14T10:51:27.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.548+0000 7f19187cc780 1 < completed multipart upload key=B9FQYIX19AEP upload=OXFCINRXK55T tag=KE3SIMDNH2LS type=write size=3686980 2024-09-14T10:51:27.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.549+0000 7f19187cc780 1 > prepared operation key=CADC2BY888V1 tag=6K0AIA5GOR7Y type=del size=4125551 2024-09-14T10:51:27.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.552+0000 7f19187cc780 1 < suggested remove operation key=54BSD3DEHNK6 tag=RXHYU38G99WT type=del 2024-09-14T10:51:27.552 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.553+0000 7f19187cc780 1 > prepared operation key=E6UO1LUWOC44 tag=A2MYQNMJZYKQ type=write size=808912 2024-09-14T10:51:27.553 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.555+0000 7f19187cc780 1 < canceled operation key=KOJ7QB7M6A35 tag=YN4ZUVTKL982 type=del size=4143528 2024-09-14T10:51:27.555 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.556+0000 7f19187cc780 1 > prepared operation key=54BSD3DEHNK6 tag=FCOGSLZSSP0E type=del size=281258 2024-09-14T10:51:27.557 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.558+0000 7f19187cc780 1 < completed delete operation key=CADC2BY888V1 tag=GXODL30XGXKO type=del 2024-09-14T10:51:27.558 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.560+0000 7f19187cc780 1 > prepared operation key=7IWUW2HC3ULI tag=0FZPTGXO2NE9 type=del size=4105822 2024-09-14T10:51:27.559 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.561+0000 7f19187cc780 -1 < failed to complete operation key=54BSD3DEHNK6 tag=GSZ6XQRZ9HKL type=del size=633036: (22) Invalid argument 2024-09-14T10:51:27.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.562+0000 7f19187cc780 1 > prepared operation key=7IWUW2HC3ULI tag=6II9VX91QNAO type=del size=761558 2024-09-14T10:51:27.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.564+0000 7f19187cc780 1 < completed part key=_multipart_CADC2BY888V1.2~DFK3U8JPTOB0.0 size=1048576 2024-09-14T10:51:27.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.565+0000 7f19187cc780 1 < completed part key=_multipart_CADC2BY888V1.2~DFK3U8JPTOB0.1 size=751606 2024-09-14T10:51:27.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.567+0000 7f19187cc780 1 < completed multipart upload key=CADC2BY888V1 upload=DFK3U8JPTOB0 tag=ZG83D9LKT8SN type=write size=2848758 2024-09-14T10:51:27.568 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.570+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~6M57S8WER7HK.0 size=1048576 2024-09-14T10:51:27.569 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.571+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~6M57S8WER7HK.1 size=1048576 2024-09-14T10:51:27.570 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.572+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~6M57S8WER7HK.2 size=444303 2024-09-14T10:51:27.570 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.572+0000 7f19187cc780 1 > prepared multipart upload key=KP3WOGIF30PZ upload=6M57S8WER7HK tag=W2CVH77YMI92 type=write size=3590031 2024-09-14T10:51:27.572 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.573+0000 7f19187cc780 1 < completed part key=_multipart_INJQTKXHBUV2.2~RKPKD3RGA8AJ.0 size=1048576 2024-09-14T10:51:27.573 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.574+0000 7f19187cc780 1 < completed part key=_multipart_INJQTKXHBUV2.2~RKPKD3RGA8AJ.1 size=574029 2024-09-14T10:51:27.575 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.577+0000 7f19187cc780 1 < completed multipart upload key=INJQTKXHBUV2 upload=RKPKD3RGA8AJ tag=7KMYBKGED26I type=write size=2671181 2024-09-14T10:51:27.576 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.578+0000 7f19187cc780 1 > prepared operation key=6BNN842ZTWG5 tag=M3J6D960BSNX type=del size=4136104 2024-09-14T10:51:27.578 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.579+0000 7f19187cc780 1 < completed part key=_multipart_CADC2BY888V1.2~GIER94B4ZIVV.0 size=1048576 2024-09-14T10:51:27.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.581+0000 7f19187cc780 1 < completed part key=_multipart_CADC2BY888V1.2~GIER94B4ZIVV.1 size=479763 2024-09-14T10:51:27.581 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.583+0000 7f19187cc780 1 < completed multipart upload key=CADC2BY888V1 upload=GIER94B4ZIVV tag=BVZVZ5LKXHQ2 type=write size=2576915 2024-09-14T10:51:27.582 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.584+0000 7f19187cc780 1 > prepared operation key=MFA30GSMCSKP tag=HSERO35487LJ type=del size=3886034 2024-09-14T10:51:27.584 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.585+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~2H1RR19DMUT0.0 size=1048576 2024-09-14T10:51:27.585 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.587+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~2H1RR19DMUT0.1 size=806525 2024-09-14T10:51:27.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.589+0000 7f19187cc780 1 < completed multipart upload key=6BNN842ZTWG5 upload=2H1RR19DMUT0 tag=J3M0F5C3OM7V type=write size=2903677 2024-09-14T10:51:27.589 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.590+0000 7f19187cc780 1 > prepared operation key=IKVYA4KEALFF tag=WLJ6EZBMAAME type=del size=1597317 2024-09-14T10:51:27.591 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.593+0000 7f19187cc780 1 < suggested update operation key=INJQTKXHBUV2 tag=4F914GZ999LX type=del size=935594 2024-09-14T10:51:27.593 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.595+0000 7f19187cc780 1 > prepared operation key=EZLSMEK89N2G tag=QCEM8LWXWNJP type=write size=13171 2024-09-14T10:51:27.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.596+0000 7f19187cc780 1 < completed delete operation key=M73CER01XHDY tag=TRRM3N44BRWP type=del 2024-09-14T10:51:27.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.600+0000 7f19187cc780 1 > prepared part key=_multipart_EL00Y4Z7DTAT.2~MMC18R4YFU4B.0 size=1048576 2024-09-14T10:51:27.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.601+0000 7f19187cc780 1 > prepared part key=_multipart_EL00Y4Z7DTAT.2~MMC18R4YFU4B.1 size=1048576 2024-09-14T10:51:27.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.602+0000 7f19187cc780 1 > prepared part key=_multipart_EL00Y4Z7DTAT.2~MMC18R4YFU4B.2 size=888999 2024-09-14T10:51:27.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.602+0000 7f19187cc780 1 > prepared multipart upload key=EL00Y4Z7DTAT upload=MMC18R4YFU4B tag=0TUMJA86U55Q type=write size=4034727 2024-09-14T10:51:27.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.603+0000 7f19187cc780 1 < completed part key=_multipart_EZLSMEK89N2G.2~EGILUPSA2H33.0 size=1048576 2024-09-14T10:51:27.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.604+0000 7f19187cc780 1 < completed part key=_multipart_EZLSMEK89N2G.2~EGILUPSA2H33.1 size=1048576 2024-09-14T10:51:27.604 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.606+0000 7f19187cc780 1 < completed part key=_multipart_EZLSMEK89N2G.2~EGILUPSA2H33.2 size=29219 2024-09-14T10:51:27.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.608+0000 7f19187cc780 1 < completed multipart upload key=EZLSMEK89N2G upload=EGILUPSA2H33 tag=ERUAR2PRUN3A type=write size=3174947 2024-09-14T10:51:27.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.609+0000 7f19187cc780 1 > prepared operation key=617QQI921HB4 tag=OJYPWL05DAF5 type=del size=1259334 2024-09-14T10:51:27.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.610+0000 7f19187cc780 1 < completed write operation key=19P3WE6HKJH2 tag=EKERD885D4AV type=write size=229524 2024-09-14T10:51:27.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.612+0000 7f19187cc780 1 > prepared operation key=H40763V7HMBC tag=XBHQHV2NJTFO type=write size=782891 2024-09-14T10:51:27.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.613+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~CNJV42AOO19M.0 size=366108 2024-09-14T10:51:27.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.615+0000 7f19187cc780 1 < completed multipart upload key=IKVYA4KEALFF upload=CNJV42AOO19M tag=VILYOGKXR6GP type=write size=1414684 2024-09-14T10:51:27.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.618+0000 7f19187cc780 1 > prepared part key=_multipart_19P3WE6HKJH2.2~0FRIOGOTFSP1.0 size=1048576 2024-09-14T10:51:27.619 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.621+0000 7f19187cc780 1 > prepared part key=_multipart_19P3WE6HKJH2.2~0FRIOGOTFSP1.1 size=207453 2024-09-14T10:51:27.619 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.621+0000 7f19187cc780 1 > prepared multipart upload key=19P3WE6HKJH2 upload=0FRIOGOTFSP1 tag=L6BXM7V3S6RD type=write size=2304605 2024-09-14T10:51:27.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.622+0000 7f19187cc780 1 < completed delete operation key=EZLSMEK89N2G tag=V3QQ0RBFC7TD type=del 2024-09-14T10:51:27.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.623+0000 7f19187cc780 1 > prepared operation key=9EBD5ZT6MT45 tag=VMO7ZG7IXF8N type=del size=3943489 2024-09-14T10:51:27.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.625+0000 7f19187cc780 1 < canceled operation key=AGNUE76X8XCJ tag=1FG28PV4DB8N type=del size=3958168 2024-09-14T10:51:27.626 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.628+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~7PYZ48KL2X37.0 size=1048576 2024-09-14T10:51:27.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.629+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~7PYZ48KL2X37.1 size=1048576 2024-09-14T10:51:27.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.630+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~7PYZ48KL2X37.2 size=270563 2024-09-14T10:51:27.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.630+0000 7f19187cc780 1 > prepared multipart upload key=OVOPGTYUF3F3 upload=7PYZ48KL2X37 tag=TL3D972CP3SJ type=write size=3416291 2024-09-14T10:51:27.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.631+0000 7f19187cc780 1 < completed delete operation key=CADC2BY888V1 tag=6K0AIA5GOR7Y type=del 2024-09-14T10:51:27.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.632+0000 7f19187cc780 1 > prepared operation key=QBMNYNWOLK4I tag=YLAAT0BUS507 type=del size=2404122 2024-09-14T10:51:27.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.634+0000 7f19187cc780 1 < completed write operation key=E6UO1LUWOC44 tag=A2MYQNMJZYKQ type=write size=808912 2024-09-14T10:51:27.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.636+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~WH64QM2VMYXS.0 size=1048576 2024-09-14T10:51:27.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.637+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~WH64QM2VMYXS.1 size=1048576 2024-09-14T10:51:27.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.639+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~WH64QM2VMYXS.2 size=678261 2024-09-14T10:51:27.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.639+0000 7f19187cc780 1 > prepared multipart upload key=XCVE2F2JJK4X upload=WH64QM2VMYXS tag=TJAD1FWBZDZ6 type=write size=3823989 2024-09-14T10:51:27.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.641+0000 7f19187cc780 1 < suggested update operation key=54BSD3DEHNK6 tag=FCOGSLZSSP0E type=del size=281258 2024-09-14T10:51:27.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.644+0000 7f19187cc780 1 > prepared part key=_multipart_MFA30GSMCSKP.2~A6E8KEZF2QQ5.0 size=1048576 2024-09-14T10:51:27.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.645+0000 7f19187cc780 1 > prepared part key=_multipart_MFA30GSMCSKP.2~A6E8KEZF2QQ5.1 size=261164 2024-09-14T10:51:27.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.645+0000 7f19187cc780 1 > prepared multipart upload key=MFA30GSMCSKP upload=A6E8KEZF2QQ5 tag=AU3KDU67PPUD type=write size=2358316 2024-09-14T10:51:27.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.646+0000 7f19187cc780 1 < completed delete operation key=7IWUW2HC3ULI tag=0FZPTGXO2NE9 type=del 2024-09-14T10:51:27.647 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.649+0000 7f19187cc780 1 > prepared part key=_multipart_E6UO1LUWOC44.2~4TBABWFSZ9MF.0 size=60009 2024-09-14T10:51:27.647 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.649+0000 7f19187cc780 1 > prepared multipart upload key=E6UO1LUWOC44 upload=4TBABWFSZ9MF tag=393U60GNGMJR type=write size=1108585 2024-09-14T10:51:27.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.650+0000 7f19187cc780 1 < completed delete operation key=7IWUW2HC3ULI tag=6II9VX91QNAO type=del 2024-09-14T10:51:27.651 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.653+0000 7f19187cc780 1 > prepared operation key=54BSD3DEHNK6 tag=8BVJSI62AZBX type=del size=2796930 2024-09-14T10:51:27.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.654+0000 7f19187cc780 1 < completed part key=_multipart_KP3WOGIF30PZ.2~6M57S8WER7HK.0 size=1048576 2024-09-14T10:51:27.654 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.655+0000 7f19187cc780 1 < completed part key=_multipart_KP3WOGIF30PZ.2~6M57S8WER7HK.1 size=1048576 2024-09-14T10:51:27.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.657+0000 7f19187cc780 1 < completed part key=_multipart_KP3WOGIF30PZ.2~6M57S8WER7HK.2 size=444303 2024-09-14T10:51:27.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.659+0000 7f19187cc780 1 < completed multipart upload key=KP3WOGIF30PZ upload=6M57S8WER7HK tag=W2CVH77YMI92 type=write size=3590031 2024-09-14T10:51:27.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.660+0000 7f19187cc780 1 > prepared operation key=H40763V7HMBC tag=8AXOUJPBYCN5 type=del size=635544 2024-09-14T10:51:27.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.662+0000 7f19187cc780 1 < completed delete operation key=6BNN842ZTWG5 tag=M3J6D960BSNX type=del 2024-09-14T10:51:27.663 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.664+0000 7f19187cc780 1 > prepared part key=_multipart_EZLSMEK89N2G.2~C4QHKO14HVVV.0 size=1048576 2024-09-14T10:51:27.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.666+0000 7f19187cc780 1 > prepared part key=_multipart_EZLSMEK89N2G.2~C4QHKO14HVVV.1 size=1048576 2024-09-14T10:51:27.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.667+0000 7f19187cc780 1 > prepared part key=_multipart_EZLSMEK89N2G.2~C4QHKO14HVVV.2 size=693837 2024-09-14T10:51:27.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.667+0000 7f19187cc780 1 > prepared multipart upload key=EZLSMEK89N2G upload=C4QHKO14HVVV tag=QJUF7P8T992F type=write size=3839565 2024-09-14T10:51:27.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.668+0000 7f19187cc780 1 < completed delete operation key=MFA30GSMCSKP tag=HSERO35487LJ type=del 2024-09-14T10:51:27.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.669+0000 7f19187cc780 1 > prepared operation key=B9FQYIX19AEP tag=MV4V3J976YKV type=del size=2405215 2024-09-14T10:51:27.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.672+0000 7f19187cc780 1 < suggested update operation key=IKVYA4KEALFF tag=WLJ6EZBMAAME type=del size=1597317 2024-09-14T10:51:27.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.675+0000 7f19187cc780 1 > prepared part key=_multipart_AST81B9QWORT.2~QE5NBX9Z68DQ.0 size=499134 2024-09-14T10:51:27.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.675+0000 7f19187cc780 1 > prepared multipart upload key=AST81B9QWORT upload=QE5NBX9Z68DQ tag=T2PM0L7IDBSH type=write size=1547710 2024-09-14T10:51:27.675 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.676+0000 7f19187cc780 1 < completed write operation key=EZLSMEK89N2G tag=QCEM8LWXWNJP type=write size=13171 2024-09-14T10:51:27.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.679+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~YMHV6QLJTWF7.0 size=1021073 2024-09-14T10:51:27.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.679+0000 7f19187cc780 1 > prepared multipart upload key=IKVYA4KEALFF upload=YMHV6QLJTWF7 tag=5W53F0T1AJW6 type=write size=2069649 2024-09-14T10:51:27.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.679+0000 7f19187cc780 1 < canceled part key=_multipart_EL00Y4Z7DTAT.2~MMC18R4YFU4B.0 size=1048576 2024-09-14T10:51:27.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.680+0000 7f19187cc780 1 < completed part key=_multipart_EL00Y4Z7DTAT.2~MMC18R4YFU4B.1 size=1048576 2024-09-14T10:51:27.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.681+0000 7f19187cc780 1 < completed part key=_multipart_EL00Y4Z7DTAT.2~MMC18R4YFU4B.2 size=888999 2024-09-14T10:51:27.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.683+0000 7f19187cc780 1 < canceled multipart upload key=EL00Y4Z7DTAT upload=MMC18R4YFU4B tag=0TUMJA86U55Q type=write size=4034727 2024-09-14T10:51:27.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.685+0000 7f19187cc780 1 > prepared operation key=QBMNYNWOLK4I tag=GOFW00N98P2U type=del size=3118140 2024-09-14T10:51:27.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.687+0000 7f19187cc780 1 < suggested remove operation key=617QQI921HB4 tag=OJYPWL05DAF5 type=del 2024-09-14T10:51:27.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.689+0000 7f19187cc780 1 > prepared operation key=AST81B9QWORT tag=3WLUBCBYC563 type=del size=2562517 2024-09-14T10:51:27.690 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.691+0000 7f19187cc780 1 < suggested remove operation key=H40763V7HMBC tag=XBHQHV2NJTFO type=write 2024-09-14T10:51:27.691 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.693+0000 7f19187cc780 1 > prepared operation key=CADC2BY888V1 tag=EPUQUO6OCZ6R type=del size=1039725 2024-09-14T10:51:27.693 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.694+0000 7f19187cc780 1 < completed part key=_multipart_19P3WE6HKJH2.2~0FRIOGOTFSP1.0 size=1048576 2024-09-14T10:51:27.694 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.695+0000 7f19187cc780 1 < completed part key=_multipart_19P3WE6HKJH2.2~0FRIOGOTFSP1.1 size=207453 2024-09-14T10:51:27.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.698+0000 7f19187cc780 1 < completed multipart upload key=19P3WE6HKJH2 upload=0FRIOGOTFSP1 tag=L6BXM7V3S6RD type=write size=2304605 2024-09-14T10:51:27.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.699+0000 7f19187cc780 1 > prepared operation key=OVOPGTYUF3F3 tag=HJOTVQIL1X3K type=del size=602960 2024-09-14T10:51:27.698 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.700+0000 7f19187cc780 1 < completed delete operation key=9EBD5ZT6MT45 tag=VMO7ZG7IXF8N type=del 2024-09-14T10:51:27.700 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.701+0000 7f19187cc780 1 > prepared operation key=XCVE2F2JJK4X tag=J5UJVDBJHAAD type=del size=3213496 2024-09-14T10:51:27.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.703+0000 7f19187cc780 1 < completed part key=_multipart_OVOPGTYUF3F3.2~7PYZ48KL2X37.0 size=1048576 2024-09-14T10:51:27.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.703+0000 7f19187cc780 1 < canceled part key=_multipart_OVOPGTYUF3F3.2~7PYZ48KL2X37.1 size=1048576 2024-09-14T10:51:27.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.704+0000 7f19187cc780 1 < completed part key=_multipart_OVOPGTYUF3F3.2~7PYZ48KL2X37.2 size=270563 2024-09-14T10:51:27.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.706+0000 7f19187cc780 1 < canceled multipart upload key=OVOPGTYUF3F3 upload=7PYZ48KL2X37 tag=TL3D972CP3SJ type=write size=3416291 2024-09-14T10:51:27.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.708+0000 7f19187cc780 1 > prepared operation key=MFA30GSMCSKP tag=RFUGYD2LVYGY type=del size=1966519 2024-09-14T10:51:27.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.709+0000 7f19187cc780 1 < completed delete operation key=QBMNYNWOLK4I tag=YLAAT0BUS507 type=del 2024-09-14T10:51:27.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.712+0000 7f19187cc780 1 > prepared part key=_multipart_9EBD5ZT6MT45.2~KOCG6RTNRGWP.0 size=1048576 2024-09-14T10:51:27.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.713+0000 7f19187cc780 1 > prepared part key=_multipart_9EBD5ZT6MT45.2~KOCG6RTNRGWP.1 size=319973 2024-09-14T10:51:27.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.713+0000 7f19187cc780 1 > prepared multipart upload key=9EBD5ZT6MT45 upload=KOCG6RTNRGWP tag=J605PM02O6ZL type=write size=2417125 2024-09-14T10:51:27.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.714+0000 7f19187cc780 1 < completed part key=_multipart_XCVE2F2JJK4X.2~WH64QM2VMYXS.0 size=1048576 2024-09-14T10:51:27.714 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.716+0000 7f19187cc780 1 < completed part key=_multipart_XCVE2F2JJK4X.2~WH64QM2VMYXS.1 size=1048576 2024-09-14T10:51:27.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.717+0000 7f19187cc780 1 < completed part key=_multipart_XCVE2F2JJK4X.2~WH64QM2VMYXS.2 size=678261 2024-09-14T10:51:27.718 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.719+0000 7f19187cc780 1 < completed multipart upload key=XCVE2F2JJK4X upload=WH64QM2VMYXS tag=TJAD1FWBZDZ6 type=write size=3823989 2024-09-14T10:51:27.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.722+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~0W5Y66GCP70W.0 size=225727 2024-09-14T10:51:27.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.722+0000 7f19187cc780 1 > prepared multipart upload key=IKVYA4KEALFF upload=0W5Y66GCP70W tag=5WYP4USE2LW7 type=write size=1274303 2024-09-14T10:51:27.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.723+0000 7f19187cc780 1 < completed part key=_multipart_MFA30GSMCSKP.2~A6E8KEZF2QQ5.0 size=1048576 2024-09-14T10:51:27.723 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.725+0000 7f19187cc780 1 < completed part key=_multipart_MFA30GSMCSKP.2~A6E8KEZF2QQ5.1 size=261164 2024-09-14T10:51:27.726 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.727+0000 7f19187cc780 1 < completed multipart upload key=MFA30GSMCSKP upload=A6E8KEZF2QQ5 tag=AU3KDU67PPUD type=write size=2358316 2024-09-14T10:51:27.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.729+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~X013A2186N6A.0 size=1048576 2024-09-14T10:51:27.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.731+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~X013A2186N6A.1 size=1028750 2024-09-14T10:51:27.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.731+0000 7f19187cc780 1 > prepared multipart upload key=OVOPGTYUF3F3 upload=X013A2186N6A tag=DZ5NB3BJRYGT type=write size=3125902 2024-09-14T10:51:27.731 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.732+0000 7f19187cc780 1 < completed part key=_multipart_E6UO1LUWOC44.2~4TBABWFSZ9MF.0 size=60009 2024-09-14T10:51:27.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.735+0000 7f19187cc780 1 < completed multipart upload key=E6UO1LUWOC44 upload=4TBABWFSZ9MF tag=393U60GNGMJR type=write size=1108585 2024-09-14T10:51:27.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.736+0000 7f19187cc780 1 > prepared operation key=IKVYA4KEALFF tag=MSZJNTM98I27 type=del size=3587952 2024-09-14T10:51:27.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.739+0000 7f19187cc780 1 < suggested remove operation key=54BSD3DEHNK6 tag=8BVJSI62AZBX type=del 2024-09-14T10:51:27.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.741+0000 7f19187cc780 1 > prepared part key=_multipart_YA3DI7N4DG5K.2~7HBXK0IYNAY1.0 size=1048576 2024-09-14T10:51:27.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.743+0000 7f19187cc780 1 > prepared part key=_multipart_YA3DI7N4DG5K.2~7HBXK0IYNAY1.1 size=892851 2024-09-14T10:51:27.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.743+0000 7f19187cc780 1 > prepared multipart upload key=YA3DI7N4DG5K upload=7HBXK0IYNAY1 tag=8GH5YHAV6MIO type=write size=2990003 2024-09-14T10:51:27.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.744+0000 7f19187cc780 -1 < failed to complete operation key=H40763V7HMBC tag=8AXOUJPBYCN5 type=del size=635544: (22) Invalid argument 2024-09-14T10:51:27.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.747+0000 7f19187cc780 1 > prepared part key=_multipart_5AIAYJMRZGFQ.2~4E74J9U4LFYL.0 size=1048576 2024-09-14T10:51:27.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.748+0000 7f19187cc780 1 > prepared part key=_multipart_5AIAYJMRZGFQ.2~4E74J9U4LFYL.1 size=276954 2024-09-14T10:51:27.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.748+0000 7f19187cc780 1 > prepared multipart upload key=5AIAYJMRZGFQ upload=4E74J9U4LFYL tag=UL30DQ6Q2E4I type=write size=2374106 2024-09-14T10:51:27.748 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.749+0000 7f19187cc780 1 < completed part key=_multipart_EZLSMEK89N2G.2~C4QHKO14HVVV.0 size=1048576 2024-09-14T10:51:27.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.751+0000 7f19187cc780 1 < completed part key=_multipart_EZLSMEK89N2G.2~C4QHKO14HVVV.1 size=1048576 2024-09-14T10:51:27.750 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.752+0000 7f19187cc780 1 < completed part key=_multipart_EZLSMEK89N2G.2~C4QHKO14HVVV.2 size=693837 2024-09-14T10:51:27.752 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.754+0000 7f19187cc780 1 < completed multipart upload key=EZLSMEK89N2G upload=C4QHKO14HVVV tag=QJUF7P8T992F type=write size=3839565 2024-09-14T10:51:27.755 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.756+0000 7f19187cc780 1 > prepared part key=_multipart_QBMNYNWOLK4I.2~LGIU7W4W1JF9.0 size=590878 2024-09-14T10:51:27.756 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.756+0000 7f19187cc780 1 > prepared multipart upload key=QBMNYNWOLK4I upload=LGIU7W4W1JF9 tag=SY3009N5CMCZ type=write size=1639454 2024-09-14T10:51:27.756 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.758+0000 7f19187cc780 1 < completed delete operation key=B9FQYIX19AEP tag=MV4V3J976YKV type=del 2024-09-14T10:51:27.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.760+0000 7f19187cc780 1 > prepared part key=_multipart_EZLSMEK89N2G.2~C50D0A2XRQVX.0 size=1048576 2024-09-14T10:51:27.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.761+0000 7f19187cc780 1 > prepared part key=_multipart_EZLSMEK89N2G.2~C50D0A2XRQVX.1 size=1048576 2024-09-14T10:51:27.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.762+0000 7f19187cc780 1 > prepared part key=_multipart_EZLSMEK89N2G.2~C50D0A2XRQVX.2 size=727955 2024-09-14T10:51:27.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.762+0000 7f19187cc780 1 > prepared multipart upload key=EZLSMEK89N2G upload=C50D0A2XRQVX tag=8WC42V4G9OX8 type=write size=3873683 2024-09-14T10:51:27.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.764+0000 7f19187cc780 1 < completed part key=_multipart_AST81B9QWORT.2~QE5NBX9Z68DQ.0 size=499134 2024-09-14T10:51:27.764 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.766+0000 7f19187cc780 1 < completed multipart upload key=AST81B9QWORT upload=QE5NBX9Z68DQ tag=T2PM0L7IDBSH type=write size=1547710 2024-09-14T10:51:27.766 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.768+0000 7f19187cc780 1 > prepared operation key=19P3WE6HKJH2 tag=67571EB6BHR4 type=del size=3582645 2024-09-14T10:51:27.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.769+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~YMHV6QLJTWF7.0 size=1021073 2024-09-14T10:51:27.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.771+0000 7f19187cc780 1 < completed multipart upload key=IKVYA4KEALFF upload=YMHV6QLJTWF7 tag=5W53F0T1AJW6 type=write size=2069649 2024-09-14T10:51:27.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.773+0000 7f19187cc780 1 > prepared part key=_multipart_9EBD5ZT6MT45.2~KLAAS7WXOFP3.0 size=271612 2024-09-14T10:51:27.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.773+0000 7f19187cc780 1 > prepared multipart upload key=9EBD5ZT6MT45 upload=KLAAS7WXOFP3 tag=UIXC01JYHRKB type=write size=1320188 2024-09-14T10:51:27.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.775+0000 7f19187cc780 1 < completed delete operation key=QBMNYNWOLK4I tag=GOFW00N98P2U type=del 2024-09-14T10:51:27.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.778+0000 7f19187cc780 1 > prepared part key=_multipart_9EBD5ZT6MT45.2~JM1PKBN3RC0Z.0 size=618706 2024-09-14T10:51:27.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.778+0000 7f19187cc780 1 > prepared multipart upload key=9EBD5ZT6MT45 upload=JM1PKBN3RC0Z tag=SWNLQ0DECND1 type=write size=1667282 2024-09-14T10:51:27.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.779+0000 7f19187cc780 1 < completed delete operation key=AST81B9QWORT tag=3WLUBCBYC563 type=del 2024-09-14T10:51:27.781 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.782+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~2AEPUWGM5JI2.0 size=30727 2024-09-14T10:51:27.781 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.782+0000 7f19187cc780 1 > prepared multipart upload key=IKVYA4KEALFF upload=2AEPUWGM5JI2 tag=6P00YVZ0NL53 type=write size=1079303 2024-09-14T10:51:27.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.784+0000 7f19187cc780 1 < completed delete operation key=CADC2BY888V1 tag=EPUQUO6OCZ6R type=del 2024-09-14T10:51:27.784 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.786+0000 7f19187cc780 1 > prepared operation key=YA3DI7N4DG5K tag=LR8YLL34JY15 type=write size=396046 2024-09-14T10:51:27.785 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.787+0000 7f19187cc780 1 < completed delete operation key=OVOPGTYUF3F3 tag=HJOTVQIL1X3K type=del 2024-09-14T10:51:27.788 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.790+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~HJJS5ISU2AK4.0 size=1048576 2024-09-14T10:51:27.789 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.791+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~HJJS5ISU2AK4.1 size=956993 2024-09-14T10:51:27.789 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.791+0000 7f19187cc780 1 > prepared multipart upload key=OVOPGTYUF3F3 upload=HJJS5ISU2AK4 tag=PJ2QIWMQQDGY type=write size=3054145 2024-09-14T10:51:27.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.792+0000 7f19187cc780 1 < completed delete operation key=XCVE2F2JJK4X tag=J5UJVDBJHAAD type=del 2024-09-14T10:51:27.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.793+0000 7f19187cc780 1 > prepared operation key=54BSD3DEHNK6 tag=IJAYRW6ER7KP type=del size=528620 2024-09-14T10:51:27.793 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.795+0000 7f19187cc780 1 < canceled operation key=MFA30GSMCSKP tag=RFUGYD2LVYGY type=del size=1966519 2024-09-14T10:51:27.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.797+0000 7f19187cc780 1 > prepared part key=_multipart_INJQTKXHBUV2.2~BMWHJ2JD2EZR.0 size=1048576 2024-09-14T10:51:27.797 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.798+0000 7f19187cc780 1 > prepared part key=_multipart_INJQTKXHBUV2.2~BMWHJ2JD2EZR.1 size=1048576 2024-09-14T10:51:27.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.800+0000 7f19187cc780 1 > prepared part key=_multipart_INJQTKXHBUV2.2~BMWHJ2JD2EZR.2 size=347388 2024-09-14T10:51:27.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.800+0000 7f19187cc780 1 > prepared multipart upload key=INJQTKXHBUV2 upload=BMWHJ2JD2EZR tag=T629Y715CVY7 type=write size=3493116 2024-09-14T10:51:27.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.801+0000 7f19187cc780 1 < completed part key=_multipart_9EBD5ZT6MT45.2~KOCG6RTNRGWP.0 size=1048576 2024-09-14T10:51:27.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.801+0000 7f19187cc780 1 < canceled part key=_multipart_9EBD5ZT6MT45.2~KOCG6RTNRGWP.1 size=319973 2024-09-14T10:51:27.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.803+0000 7f19187cc780 1 < canceled multipart upload key=9EBD5ZT6MT45 upload=KOCG6RTNRGWP tag=J605PM02O6ZL type=write size=2417125 2024-09-14T10:51:27.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.805+0000 7f19187cc780 1 > prepared operation key=61O2VU0SB379 tag=JWYZFN81GDE0 type=del size=1956492 2024-09-14T10:51:27.805 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.806+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~0W5Y66GCP70W.0 size=225727 2024-09-14T10:51:27.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.809+0000 7f19187cc780 1 < completed multipart upload key=IKVYA4KEALFF upload=0W5Y66GCP70W tag=5WYP4USE2LW7 type=write size=1274303 2024-09-14T10:51:27.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.810+0000 7f19187cc780 1 > prepared operation key=EZLSMEK89N2G tag=FNQMPYY95SIN type=del size=4039671 2024-09-14T10:51:27.810 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.811+0000 7f19187cc780 1 < completed part key=_multipart_OVOPGTYUF3F3.2~X013A2186N6A.0 size=1048576 2024-09-14T10:51:27.812 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.813+0000 7f19187cc780 1 < completed part key=_multipart_OVOPGTYUF3F3.2~X013A2186N6A.1 size=1028750 2024-09-14T10:51:27.814 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.815+0000 7f19187cc780 1 < completed multipart upload key=OVOPGTYUF3F3 upload=X013A2186N6A tag=DZ5NB3BJRYGT type=write size=3125902 2024-09-14T10:51:27.815 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.817+0000 7f19187cc780 1 > prepared operation key=VW6U36JN2DBX tag=JUWWPW7BLXHH type=del size=779208 2024-09-14T10:51:27.818 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.819+0000 7f19187cc780 1 < suggested remove operation key=IKVYA4KEALFF tag=MSZJNTM98I27 type=del 2024-09-14T10:51:27.820 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.822+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~F2F3JRQKGVYV.0 size=1048576 2024-09-14T10:51:27.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.823+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~F2F3JRQKGVYV.1 size=114425 2024-09-14T10:51:27.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.823+0000 7f19187cc780 1 > prepared multipart upload key=6BNN842ZTWG5 upload=F2F3JRQKGVYV tag=1C30MORCWT9R type=write size=2211577 2024-09-14T10:51:27.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.824+0000 7f19187cc780 1 < completed part key=_multipart_YA3DI7N4DG5K.2~7HBXK0IYNAY1.0 size=1048576 2024-09-14T10:51:27.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.826+0000 7f19187cc780 1 < completed part key=_multipart_YA3DI7N4DG5K.2~7HBXK0IYNAY1.1 size=892851 2024-09-14T10:51:27.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.828+0000 7f19187cc780 1 < completed multipart upload key=YA3DI7N4DG5K upload=7HBXK0IYNAY1 tag=8GH5YHAV6MIO type=write size=2990003 2024-09-14T10:51:27.829 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.830+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~S060ZCCMYO61.0 size=1048576 2024-09-14T10:51:27.830 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.831+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~S060ZCCMYO61.1 size=1048576 2024-09-14T10:51:27.831 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.832+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~S060ZCCMYO61.2 size=938243 2024-09-14T10:51:27.831 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.832+0000 7f19187cc780 1 > prepared multipart upload key=6BNN842ZTWG5 upload=S060ZCCMYO61 tag=IEN4WTKQEQQV type=write size=4083971 2024-09-14T10:51:27.833 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.834+0000 7f19187cc780 1 < completed part key=_multipart_5AIAYJMRZGFQ.2~4E74J9U4LFYL.0 size=1048576 2024-09-14T10:51:27.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.836+0000 7f19187cc780 1 < completed part key=_multipart_5AIAYJMRZGFQ.2~4E74J9U4LFYL.1 size=276954 2024-09-14T10:51:27.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.838+0000 7f19187cc780 1 < completed multipart upload key=5AIAYJMRZGFQ upload=4E74J9U4LFYL tag=UL30DQ6Q2E4I type=write size=2374106 2024-09-14T10:51:27.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.840+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~5F6Q8N0HJLB5.0 size=227932 2024-09-14T10:51:27.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.840+0000 7f19187cc780 1 > prepared multipart upload key=OVOPGTYUF3F3 upload=5F6Q8N0HJLB5 tag=JR66RFGTE2CH type=write size=1276508 2024-09-14T10:51:27.840 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.842+0000 7f19187cc780 1 < completed part key=_multipart_QBMNYNWOLK4I.2~LGIU7W4W1JF9.0 size=590878 2024-09-14T10:51:27.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.844+0000 7f19187cc780 1 < completed multipart upload key=QBMNYNWOLK4I upload=LGIU7W4W1JF9 tag=SY3009N5CMCZ type=write size=1639454 2024-09-14T10:51:27.844 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.846+0000 7f19187cc780 1 > prepared operation key=QFEI6H4EQ9ZR tag=4TUEAGNM34N7 type=del size=943783 2024-09-14T10:51:27.848 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.847+0000 7f19187cc780 1 < completed part key=_multipart_EZLSMEK89N2G.2~C50D0A2XRQVX.0 size=1048576 2024-09-14T10:51:27.849 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.848+0000 7f19187cc780 1 < completed part key=_multipart_EZLSMEK89N2G.2~C50D0A2XRQVX.1 size=1048576 2024-09-14T10:51:27.849 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.850+0000 7f19187cc780 1 < completed part key=_multipart_EZLSMEK89N2G.2~C50D0A2XRQVX.2 size=727955 2024-09-14T10:51:27.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.852+0000 7f19187cc780 1 < completed multipart upload key=EZLSMEK89N2G upload=C50D0A2XRQVX tag=8WC42V4G9OX8 type=write size=3873683 2024-09-14T10:51:27.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.854+0000 7f19187cc780 1 > prepared operation key=EL00Y4Z7DTAT tag=RSWAZYIPHXAG type=del size=4024233 2024-09-14T10:51:27.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.855+0000 7f19187cc780 1 < canceled operation key=19P3WE6HKJH2 tag=67571EB6BHR4 type=del size=3582645 2024-09-14T10:51:27.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.856+0000 7f19187cc780 1 > prepared operation key=M73CER01XHDY tag=4G43HEMZ29UJ type=del size=3860473 2024-09-14T10:51:27.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.856+0000 7f19187cc780 1 < canceled part key=_multipart_9EBD5ZT6MT45.2~KLAAS7WXOFP3.0 size=271612 2024-09-14T10:51:27.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.858+0000 7f19187cc780 1 < canceled multipart upload key=9EBD5ZT6MT45 upload=KLAAS7WXOFP3 tag=UIXC01JYHRKB type=write size=1320188 2024-09-14T10:51:27.859 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.861+0000 7f19187cc780 1 > prepared part key=_multipart_9EBD5ZT6MT45.2~FIJ2OPGMLBLZ.0 size=1048576 2024-09-14T10:51:27.861 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.862+0000 7f19187cc780 1 > prepared part key=_multipart_9EBD5ZT6MT45.2~FIJ2OPGMLBLZ.1 size=30302 2024-09-14T10:51:27.861 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.862+0000 7f19187cc780 1 > prepared multipart upload key=9EBD5ZT6MT45 upload=FIJ2OPGMLBLZ tag=6GZD3UY07O8A type=write size=2127454 2024-09-14T10:51:27.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.863+0000 7f19187cc780 1 < completed part key=_multipart_9EBD5ZT6MT45.2~JM1PKBN3RC0Z.0 size=618706 2024-09-14T10:51:27.864 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.866+0000 7f19187cc780 1 < completed multipart upload key=9EBD5ZT6MT45 upload=JM1PKBN3RC0Z tag=SWNLQ0DECND1 type=write size=1667282 2024-09-14T10:51:27.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.868+0000 7f19187cc780 1 > prepared part key=_multipart_RTGE7ISETJWW.2~XM1HUQ0IGXU1.0 size=484410 2024-09-14T10:51:27.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.868+0000 7f19187cc780 1 > prepared multipart upload key=RTGE7ISETJWW upload=XM1HUQ0IGXU1 tag=P9AUS3QJ1GFZ type=write size=1532986 2024-09-14T10:51:27.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.870+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~2AEPUWGM5JI2.0 size=30727 2024-09-14T10:51:27.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.872+0000 7f19187cc780 1 < completed multipart upload key=IKVYA4KEALFF upload=2AEPUWGM5JI2 tag=6P00YVZ0NL53 type=write size=1079303 2024-09-14T10:51:27.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.876+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~7DLAMPBQUYF2.0 size=775739 2024-09-14T10:51:27.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.876+0000 7f19187cc780 1 > prepared multipart upload key=KOJ7QB7M6A35 upload=7DLAMPBQUYF2 tag=Q2YU4VX2SOLG type=write size=1824315 2024-09-14T10:51:27.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.877+0000 7f19187cc780 1 < completed write operation key=YA3DI7N4DG5K tag=LR8YLL34JY15 type=write size=396046 2024-09-14T10:51:27.877 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.878+0000 7f19187cc780 1 > prepared operation key=AST81B9QWORT tag=P1P70AGDHWG3 type=del size=3690905 2024-09-14T10:51:27.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.880+0000 7f19187cc780 1 < completed part key=_multipart_OVOPGTYUF3F3.2~HJJS5ISU2AK4.0 size=1048576 2024-09-14T10:51:27.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.881+0000 7f19187cc780 1 < completed part key=_multipart_OVOPGTYUF3F3.2~HJJS5ISU2AK4.1 size=956993 2024-09-14T10:51:27.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.883+0000 7f19187cc780 1 < completed multipart upload key=OVOPGTYUF3F3 upload=HJJS5ISU2AK4 tag=PJ2QIWMQQDGY type=write size=3054145 2024-09-14T10:51:27.883 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.884+0000 7f19187cc780 1 > prepared operation key=19P3WE6HKJH2 tag=3R3AHVB8F0DD type=del size=460780 2024-09-14T10:51:27.884 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.886+0000 7f19187cc780 1 < completed delete operation key=54BSD3DEHNK6 tag=IJAYRW6ER7KP type=del 2024-09-14T10:51:27.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.887+0000 7f19187cc780 1 > prepared operation key=AST81B9QWORT tag=EO5C2KL8NMWM type=write size=333792 2024-09-14T10:51:27.887 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.888+0000 7f19187cc780 1 < completed part key=_multipart_INJQTKXHBUV2.2~BMWHJ2JD2EZR.0 size=1048576 2024-09-14T10:51:27.888 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.890+0000 7f19187cc780 1 < completed part key=_multipart_INJQTKXHBUV2.2~BMWHJ2JD2EZR.1 size=1048576 2024-09-14T10:51:27.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.891+0000 7f19187cc780 1 < completed part key=_multipart_INJQTKXHBUV2.2~BMWHJ2JD2EZR.2 size=347388 2024-09-14T10:51:27.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.893+0000 7f19187cc780 1 < completed multipart upload key=INJQTKXHBUV2 upload=BMWHJ2JD2EZR tag=T629Y715CVY7 type=write size=3493116 2024-09-14T10:51:27.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.895+0000 7f19187cc780 1 > prepared part key=_multipart_W1K1IU13J0CZ.2~L13SUO83ZP9W.0 size=1019475 2024-09-14T10:51:27.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.895+0000 7f19187cc780 1 > prepared multipart upload key=W1K1IU13J0CZ upload=L13SUO83ZP9W tag=O7D0OT03SLBK type=write size=2068051 2024-09-14T10:51:27.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.897+0000 7f19187cc780 1 < completed delete operation key=61O2VU0SB379 tag=JWYZFN81GDE0 type=del 2024-09-14T10:51:27.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.899+0000 7f19187cc780 1 > prepared part key=_multipart_EL00Y4Z7DTAT.2~6UNHAOLZ11IL.0 size=1048576 2024-09-14T10:51:27.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.900+0000 7f19187cc780 1 > prepared part key=_multipart_EL00Y4Z7DTAT.2~6UNHAOLZ11IL.1 size=1048576 2024-09-14T10:51:27.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.901+0000 7f19187cc780 1 > prepared part key=_multipart_EL00Y4Z7DTAT.2~6UNHAOLZ11IL.2 size=463427 2024-09-14T10:51:27.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.901+0000 7f19187cc780 1 > prepared multipart upload key=EL00Y4Z7DTAT upload=6UNHAOLZ11IL tag=TC1AURTY975U type=write size=3609155 2024-09-14T10:51:27.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.903+0000 7f19187cc780 1 < canceled operation key=EZLSMEK89N2G tag=FNQMPYY95SIN type=del size=4039671 2024-09-14T10:51:27.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.904+0000 7f19187cc780 1 > prepared operation key=MFA30GSMCSKP tag=20J64JJG0KVS type=del size=711831 2024-09-14T10:51:27.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.906+0000 7f19187cc780 1 < completed delete operation key=VW6U36JN2DBX tag=JUWWPW7BLXHH type=del 2024-09-14T10:51:27.905 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.907+0000 7f19187cc780 1 > prepared operation key=9EBD5ZT6MT45 tag=XPX2YIUOCKTH type=del size=3656262 2024-09-14T10:51:27.907 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.908+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~F2F3JRQKGVYV.0 size=1048576 2024-09-14T10:51:27.908 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.910+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~F2F3JRQKGVYV.1 size=114425 2024-09-14T10:51:27.911 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.913+0000 7f19187cc780 1 < completed multipart upload key=6BNN842ZTWG5 upload=F2F3JRQKGVYV tag=1C30MORCWT9R type=write size=2211577 2024-09-14T10:51:27.913 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.914+0000 7f19187cc780 1 > prepared operation key=7IWUW2HC3ULI tag=3IZ2FPUQB4G9 type=del size=3328184 2024-09-14T10:51:27.914 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.916+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~S060ZCCMYO61.0 size=1048576 2024-09-14T10:51:27.915 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.917+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~S060ZCCMYO61.1 size=1048576 2024-09-14T10:51:27.916 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.918+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~S060ZCCMYO61.2 size=938243 2024-09-14T10:51:27.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.921+0000 7f19187cc780 1 < completed multipart upload key=6BNN842ZTWG5 upload=S060ZCCMYO61 tag=IEN4WTKQEQQV type=write size=4083971 2024-09-14T10:51:27.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.922+0000 7f19187cc780 1 > prepared operation key=W1K1IU13J0CZ tag=YX1W3C5VH8AJ type=write size=14940 2024-09-14T10:51:27.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.924+0000 7f19187cc780 1 < completed part key=_multipart_OVOPGTYUF3F3.2~5F6Q8N0HJLB5.0 size=227932 2024-09-14T10:51:27.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.926+0000 7f19187cc780 1 < completed multipart upload key=OVOPGTYUF3F3 upload=5F6Q8N0HJLB5 tag=JR66RFGTE2CH type=write size=1276508 2024-09-14T10:51:27.927 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.929+0000 7f19187cc780 1 > prepared part key=_multipart_QFEI6H4EQ9ZR.2~PQ5IZYOXP7NW.0 size=1048576 2024-09-14T10:51:27.928 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.930+0000 7f19187cc780 1 > prepared part key=_multipart_QFEI6H4EQ9ZR.2~PQ5IZYOXP7NW.1 size=1048576 2024-09-14T10:51:27.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.931+0000 7f19187cc780 1 > prepared part key=_multipart_QFEI6H4EQ9ZR.2~PQ5IZYOXP7NW.2 size=689880 2024-09-14T10:51:27.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.931+0000 7f19187cc780 1 > prepared multipart upload key=QFEI6H4EQ9ZR upload=PQ5IZYOXP7NW tag=1REV0TEZR4FQ type=write size=3835608 2024-09-14T10:51:27.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.933+0000 7f19187cc780 1 < completed delete operation key=QFEI6H4EQ9ZR tag=4TUEAGNM34N7 type=del 2024-09-14T10:51:27.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.936+0000 7f19187cc780 1 > prepared part key=_multipart_AST81B9QWORT.2~Q8KJTFR2DAW7.0 size=1048576 2024-09-14T10:51:27.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.937+0000 7f19187cc780 1 > prepared part key=_multipart_AST81B9QWORT.2~Q8KJTFR2DAW7.1 size=676678 2024-09-14T10:51:27.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.937+0000 7f19187cc780 1 > prepared multipart upload key=AST81B9QWORT upload=Q8KJTFR2DAW7 tag=VJNEDFTO1DY2 type=write size=2773830 2024-09-14T10:51:27.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.938+0000 7f19187cc780 1 < completed delete operation key=EL00Y4Z7DTAT tag=RSWAZYIPHXAG type=del 2024-09-14T10:51:27.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.940+0000 7f19187cc780 1 > prepared operation key=6BNN842ZTWG5 tag=RZDWT7OR09EF type=del size=189925 2024-09-14T10:51:27.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.941+0000 7f19187cc780 1 < completed delete operation key=M73CER01XHDY tag=4G43HEMZ29UJ type=del 2024-09-14T10:51:27.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.943+0000 7f19187cc780 1 > prepared operation key=KOJ7QB7M6A35 tag=MESDISVFKMHG type=del size=3756542 2024-09-14T10:51:27.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.944+0000 7f19187cc780 1 < completed part key=_multipart_9EBD5ZT6MT45.2~FIJ2OPGMLBLZ.0 size=1048576 2024-09-14T10:51:27.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.946+0000 7f19187cc780 1 < completed part key=_multipart_9EBD5ZT6MT45.2~FIJ2OPGMLBLZ.1 size=30302 2024-09-14T10:51:27.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.950+0000 7f19187cc780 1 < completed multipart upload key=9EBD5ZT6MT45 upload=FIJ2OPGMLBLZ tag=6GZD3UY07O8A type=write size=2127454 2024-09-14T10:51:27.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.953+0000 7f19187cc780 1 > prepared operation key=MFA30GSMCSKP tag=36IOQ46FZE21 type=write size=408506 2024-09-14T10:51:27.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.954+0000 7f19187cc780 1 < completed part key=_multipart_RTGE7ISETJWW.2~XM1HUQ0IGXU1.0 size=484410 2024-09-14T10:51:27.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.956+0000 7f19187cc780 1 < completed multipart upload key=RTGE7ISETJWW upload=XM1HUQ0IGXU1 tag=P9AUS3QJ1GFZ type=write size=1532986 2024-09-14T10:51:27.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.958+0000 7f19187cc780 1 > prepared operation key=6BNN842ZTWG5 tag=MHFYBHYRVKOP type=del size=3426636 2024-09-14T10:51:27.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.958+0000 7f19187cc780 1 < canceled part key=_multipart_KOJ7QB7M6A35.2~7DLAMPBQUYF2.0 size=775739 2024-09-14T10:51:27.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.960+0000 7f19187cc780 1 < canceled multipart upload key=KOJ7QB7M6A35 upload=7DLAMPBQUYF2 tag=Q2YU4VX2SOLG type=write size=1824315 2024-09-14T10:51:27.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.963+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~IR0FURA2LINP.0 size=1048576 2024-09-14T10:51:27.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.964+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~IR0FURA2LINP.1 size=1048576 2024-09-14T10:51:27.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.965+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~IR0FURA2LINP.2 size=224700 2024-09-14T10:51:27.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.965+0000 7f19187cc780 1 > prepared multipart upload key=IKVYA4KEALFF upload=IR0FURA2LINP tag=H3F0Y37VO15H type=write size=3370428 2024-09-14T10:51:27.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.968+0000 7f19187cc780 1 < suggested remove operation key=AST81B9QWORT tag=P1P70AGDHWG3 type=del 2024-09-14T10:51:27.967 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.969+0000 7f19187cc780 1 > prepared operation key=QBMNYNWOLK4I tag=RP1PW62YXEJ1 type=del size=3053972 2024-09-14T10:51:27.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.971+0000 7f19187cc780 1 < completed delete operation key=19P3WE6HKJH2 tag=3R3AHVB8F0DD type=del 2024-09-14T10:51:27.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.972+0000 7f19187cc780 1 > prepared operation key=19P3WE6HKJH2 tag=UM5TOLJH431D type=del size=198753 2024-09-14T10:51:27.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.973+0000 7f19187cc780 -1 < failed to complete operation key=AST81B9QWORT tag=EO5C2KL8NMWM type=write size=333792: (22) Invalid argument 2024-09-14T10:51:27.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.975+0000 7f19187cc780 1 > prepared operation key=AST81B9QWORT tag=C6M30AMTS1N6 type=del size=2914911 2024-09-14T10:51:27.974 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.976+0000 7f19187cc780 1 < completed part key=_multipart_W1K1IU13J0CZ.2~L13SUO83ZP9W.0 size=1019475 2024-09-14T10:51:27.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.978+0000 7f19187cc780 1 < completed multipart upload key=W1K1IU13J0CZ upload=L13SUO83ZP9W tag=O7D0OT03SLBK type=write size=2068051 2024-09-14T10:51:27.978 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.980+0000 7f19187cc780 1 > prepared operation key=W1K1IU13J0CZ tag=R9Z9Z0T5NWG0 type=del size=3428708 2024-09-14T10:51:27.980 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.981+0000 7f19187cc780 1 < completed part key=_multipart_EL00Y4Z7DTAT.2~6UNHAOLZ11IL.0 size=1048576 2024-09-14T10:51:27.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.982+0000 7f19187cc780 1 < completed part key=_multipart_EL00Y4Z7DTAT.2~6UNHAOLZ11IL.1 size=1048576 2024-09-14T10:51:27.982 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.984+0000 7f19187cc780 1 < completed part key=_multipart_EL00Y4Z7DTAT.2~6UNHAOLZ11IL.2 size=463427 2024-09-14T10:51:27.984 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.986+0000 7f19187cc780 1 < completed multipart upload key=EL00Y4Z7DTAT upload=6UNHAOLZ11IL tag=TC1AURTY975U type=write size=3609155 2024-09-14T10:51:27.986 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.988+0000 7f19187cc780 1 > prepared operation key=H40763V7HMBC tag=EJJVRE00BHGY type=del size=1883581 2024-09-14T10:51:27.988 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.989+0000 7f19187cc780 1 < completed delete operation key=MFA30GSMCSKP tag=20J64JJG0KVS type=del 2024-09-14T10:51:27.989 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.991+0000 7f19187cc780 1 > prepared operation key=E6UO1LUWOC44 tag=FV1PA3KD7IVA type=write size=615133 2024-09-14T10:51:27.991 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.992+0000 7f19187cc780 1 < canceled operation key=9EBD5ZT6MT45 tag=XPX2YIUOCKTH type=del size=3656262 2024-09-14T10:51:27.992 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.994+0000 7f19187cc780 1 > prepared operation key=19P3WE6HKJH2 tag=3S7V2A9PNI14 type=del size=3256258 2024-09-14T10:51:27.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.996+0000 7f19187cc780 1 < completed delete operation key=7IWUW2HC3ULI tag=3IZ2FPUQB4G9 type=del 2024-09-14T10:51:27.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.997+0000 7f19187cc780 1 > prepared operation key=N0L67LS2KHR1 tag=RZNCRYAXR6PB type=del size=1479623 2024-09-14T10:51:27.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:27.999+0000 7f19187cc780 1 < completed write operation key=W1K1IU13J0CZ tag=YX1W3C5VH8AJ type=write size=14940 2024-09-14T10:51:27.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.000+0000 7f19187cc780 1 > prepared operation key=MFA30GSMCSKP tag=GK1Q9F4UZ2QO type=del size=3675111 2024-09-14T10:51:28.000 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.002+0000 7f19187cc780 1 < completed part key=_multipart_QFEI6H4EQ9ZR.2~PQ5IZYOXP7NW.0 size=1048576 2024-09-14T10:51:28.001 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.003+0000 7f19187cc780 1 < completed part key=_multipart_QFEI6H4EQ9ZR.2~PQ5IZYOXP7NW.1 size=1048576 2024-09-14T10:51:28.002 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.003+0000 7f19187cc780 1 < canceled part key=_multipart_QFEI6H4EQ9ZR.2~PQ5IZYOXP7NW.2 size=689880 2024-09-14T10:51:28.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.005+0000 7f19187cc780 1 < canceled multipart upload key=QFEI6H4EQ9ZR upload=PQ5IZYOXP7NW tag=1REV0TEZR4FQ type=write size=3835608 2024-09-14T10:51:28.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.009+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~WBAJHD2D2GVE.0 size=1048576 2024-09-14T10:51:28.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.010+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~WBAJHD2D2GVE.1 size=119724 2024-09-14T10:51:28.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.010+0000 7f19187cc780 1 > prepared multipart upload key=AGNUE76X8XCJ upload=WBAJHD2D2GVE tag=MDATAD9YWL42 type=write size=2216876 2024-09-14T10:51:28.010 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.011+0000 7f19187cc780 1 < completed part key=_multipart_AST81B9QWORT.2~Q8KJTFR2DAW7.0 size=1048576 2024-09-14T10:51:28.011 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.013+0000 7f19187cc780 1 < completed part key=_multipart_AST81B9QWORT.2~Q8KJTFR2DAW7.1 size=676678 2024-09-14T10:51:28.014 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.015+0000 7f19187cc780 1 < completed multipart upload key=AST81B9QWORT upload=Q8KJTFR2DAW7 tag=VJNEDFTO1DY2 type=write size=2773830 2024-09-14T10:51:28.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.017+0000 7f19187cc780 1 > prepared operation key=E6UO1LUWOC44 tag=PDVE2V15MAVK type=del size=2132553 2024-09-14T10:51:28.017 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.018+0000 7f19187cc780 1 < completed delete operation key=6BNN842ZTWG5 tag=RZDWT7OR09EF type=del 2024-09-14T10:51:28.019 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.021+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~TPIJZGI2H0L0.0 size=1048576 2024-09-14T10:51:28.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.022+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~TPIJZGI2H0L0.1 size=1048576 2024-09-14T10:51:28.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.023+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~TPIJZGI2H0L0.2 size=67081 2024-09-14T10:51:28.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.023+0000 7f19187cc780 1 > prepared multipart upload key=7IWUW2HC3ULI upload=TPIJZGI2H0L0 tag=JGT8551PO73K type=write size=3212809 2024-09-14T10:51:28.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.024+0000 7f19187cc780 1 < completed delete operation key=KOJ7QB7M6A35 tag=MESDISVFKMHG type=del 2024-09-14T10:51:28.025 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.027+0000 7f19187cc780 1 > prepared part key=_multipart_RTGE7ISETJWW.2~07IY69GHIYQY.0 size=1048576 2024-09-14T10:51:28.026 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.028+0000 7f19187cc780 1 > prepared part key=_multipart_RTGE7ISETJWW.2~07IY69GHIYQY.1 size=937139 2024-09-14T10:51:28.026 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.028+0000 7f19187cc780 1 > prepared multipart upload key=RTGE7ISETJWW upload=07IY69GHIYQY tag=FHS1EZTTC53K type=write size=3034291 2024-09-14T10:51:28.028 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.029+0000 7f19187cc780 1 < completed write operation key=MFA30GSMCSKP tag=36IOQ46FZE21 type=write size=408506 2024-09-14T10:51:28.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.031+0000 7f19187cc780 1 > prepared operation key=KP3WOGIF30PZ tag=HMWBE6QV6Z6B type=write size=297128 2024-09-14T10:51:28.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.034+0000 7f19187cc780 1 < suggested remove operation key=6BNN842ZTWG5 tag=MHFYBHYRVKOP type=del 2024-09-14T10:51:28.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.035+0000 7f19187cc780 1 > prepared operation key=KP3WOGIF30PZ tag=ZIPC4OU4IZR9 type=write size=75404 2024-09-14T10:51:28.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.037+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~IR0FURA2LINP.0 size=1048576 2024-09-14T10:51:28.036 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.038+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~IR0FURA2LINP.1 size=1048576 2024-09-14T10:51:28.037 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.039+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~IR0FURA2LINP.2 size=224700 2024-09-14T10:51:28.040 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.041+0000 7f19187cc780 1 < completed multipart upload key=IKVYA4KEALFF upload=IR0FURA2LINP tag=H3F0Y37VO15H type=write size=3370428 2024-09-14T10:51:28.041 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.043+0000 7f19187cc780 1 > prepared operation key=XCVE2F2JJK4X tag=4IBTOI8DIVVL type=del size=90142 2024-09-14T10:51:28.042 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.044+0000 7f19187cc780 1 < completed delete operation key=QBMNYNWOLK4I tag=RP1PW62YXEJ1 type=del 2024-09-14T10:51:28.045 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.047+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~7TG7A4XTHUEL.0 size=793883 2024-09-14T10:51:28.045 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.047+0000 7f19187cc780 1 > prepared multipart upload key=B9FQYIX19AEP upload=7TG7A4XTHUEL tag=48ZF36H30IH5 type=write size=1842459 2024-09-14T10:51:28.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.049+0000 7f19187cc780 1 < completed delete operation key=19P3WE6HKJH2 tag=UM5TOLJH431D type=del 2024-09-14T10:51:28.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.050+0000 7f19187cc780 1 > prepared operation key=617QQI921HB4 tag=31XUYGWZ1M5T type=del size=2136679 2024-09-14T10:51:28.053 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.053+0000 7f19187cc780 1 < suggested update operation key=AST81B9QWORT tag=C6M30AMTS1N6 type=del size=2914911 2024-09-14T10:51:28.054 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.056+0000 7f19187cc780 1 > prepared part key=_multipart_61O2VU0SB379.2~ZTUBJT2VFN0A.0 size=1048576 2024-09-14T10:51:28.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.057+0000 7f19187cc780 1 > prepared part key=_multipart_61O2VU0SB379.2~ZTUBJT2VFN0A.1 size=1048576 2024-09-14T10:51:28.057 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.059+0000 7f19187cc780 1 > prepared part key=_multipart_61O2VU0SB379.2~ZTUBJT2VFN0A.2 size=312488 2024-09-14T10:51:28.057 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.059+0000 7f19187cc780 1 > prepared multipart upload key=61O2VU0SB379 upload=ZTUBJT2VFN0A tag=CJAXYWO1AZW9 type=write size=3458216 2024-09-14T10:51:28.059 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.060+0000 7f19187cc780 1 < completed delete operation key=W1K1IU13J0CZ tag=R9Z9Z0T5NWG0 type=del 2024-09-14T10:51:28.061 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.063+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~Q9M61X9XM1GO.0 size=1048576 2024-09-14T10:51:28.062 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.064+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~Q9M61X9XM1GO.1 size=1048576 2024-09-14T10:51:28.063 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.065+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~Q9M61X9XM1GO.2 size=670543 2024-09-14T10:51:28.063 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.065+0000 7f19187cc780 1 > prepared multipart upload key=VW6U36JN2DBX upload=Q9M61X9XM1GO tag=LRVR0O4MSZGC type=write size=3816271 2024-09-14T10:51:28.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.066+0000 7f19187cc780 1 < completed delete operation key=H40763V7HMBC tag=EJJVRE00BHGY type=del 2024-09-14T10:51:28.067 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.069+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~ZGCUVCT5TQTD.0 size=1048576 2024-09-14T10:51:28.068 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.070+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~ZGCUVCT5TQTD.1 size=1048576 2024-09-14T10:51:28.069 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.071+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~ZGCUVCT5TQTD.2 size=41141 2024-09-14T10:51:28.069 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.071+0000 7f19187cc780 1 > prepared multipart upload key=VW6U36JN2DBX upload=ZGCUVCT5TQTD tag=FYF7G1Z6W5IO type=write size=3186869 2024-09-14T10:51:28.072 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.074+0000 7f19187cc780 1 < suggested update operation key=E6UO1LUWOC44 tag=FV1PA3KD7IVA type=write size=615133 2024-09-14T10:51:28.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.075+0000 7f19187cc780 1 > prepared operation key=IKVYA4KEALFF tag=T2JRVCDIOO9P type=del size=4034696 2024-09-14T10:51:28.075 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.077+0000 7f19187cc780 1 < completed delete operation key=19P3WE6HKJH2 tag=3S7V2A9PNI14 type=del 2024-09-14T10:51:28.076 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.078+0000 7f19187cc780 1 > prepared operation key=AGNUE76X8XCJ tag=TBY2LS9M1MUM type=del size=3094287 2024-09-14T10:51:28.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.079+0000 7f19187cc780 1 < completed delete operation key=N0L67LS2KHR1 tag=RZNCRYAXR6PB type=del 2024-09-14T10:51:28.079 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.081+0000 7f19187cc780 1 > prepared operation key=EL00Y4Z7DTAT tag=2BKB51NV0BBU type=write size=801395 2024-09-14T10:51:28.081 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.082+0000 7f19187cc780 1 < completed delete operation key=MFA30GSMCSKP tag=GK1Q9F4UZ2QO type=del 2024-09-14T10:51:28.082 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.083+0000 7f19187cc780 1 > prepared operation key=CADC2BY888V1 tag=T76B91MX4G6H type=del size=1072811 2024-09-14T10:51:28.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.085+0000 7f19187cc780 1 < completed part key=_multipart_AGNUE76X8XCJ.2~WBAJHD2D2GVE.0 size=1048576 2024-09-14T10:51:28.084 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.086+0000 7f19187cc780 1 < completed part key=_multipart_AGNUE76X8XCJ.2~WBAJHD2D2GVE.1 size=119724 2024-09-14T10:51:28.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.088+0000 7f19187cc780 1 < completed multipart upload key=AGNUE76X8XCJ upload=WBAJHD2D2GVE tag=MDATAD9YWL42 type=write size=2216876 2024-09-14T10:51:28.089 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.091+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~IF207FX3JKQK.0 size=179970 2024-09-14T10:51:28.089 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.091+0000 7f19187cc780 1 > prepared multipart upload key=7IWUW2HC3ULI upload=IF207FX3JKQK tag=K7X0DWPIZUIP type=write size=1228546 2024-09-14T10:51:28.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.094+0000 7f19187cc780 1 < suggested remove operation key=E6UO1LUWOC44 tag=PDVE2V15MAVK type=del 2024-09-14T10:51:28.093 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.095+0000 7f19187cc780 1 > prepared operation key=W1K1IU13J0CZ tag=O2EJNC1VJAPO type=del size=4142859 2024-09-14T10:51:28.095 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.096+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~TPIJZGI2H0L0.0 size=1048576 2024-09-14T10:51:28.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.098+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~TPIJZGI2H0L0.1 size=1048576 2024-09-14T10:51:28.097 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.099+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~TPIJZGI2H0L0.2 size=67081 2024-09-14T10:51:28.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.101+0000 7f19187cc780 1 < completed multipart upload key=7IWUW2HC3ULI upload=TPIJZGI2H0L0 tag=JGT8551PO73K type=write size=3212809 2024-09-14T10:51:28.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.104+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~6PJTH5SUANO0.0 size=1048576 2024-09-14T10:51:28.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.105+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~6PJTH5SUANO0.1 size=59330 2024-09-14T10:51:28.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.105+0000 7f19187cc780 1 > prepared multipart upload key=VW6U36JN2DBX upload=6PJTH5SUANO0 tag=33LQY1ZJJ2ML type=write size=2156482 2024-09-14T10:51:28.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.106+0000 7f19187cc780 1 < completed part key=_multipart_RTGE7ISETJWW.2~07IY69GHIYQY.0 size=1048576 2024-09-14T10:51:28.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.108+0000 7f19187cc780 1 < completed part key=_multipart_RTGE7ISETJWW.2~07IY69GHIYQY.1 size=937139 2024-09-14T10:51:28.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.110+0000 7f19187cc780 1 < completed multipart upload key=RTGE7ISETJWW upload=07IY69GHIYQY tag=FHS1EZTTC53K type=write size=3034291 2024-09-14T10:51:28.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.112+0000 7f19187cc780 1 > prepared part key=_multipart_MFA30GSMCSKP.2~CQ0P4MC3F6JR.0 size=1048576 2024-09-14T10:51:28.112 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.113+0000 7f19187cc780 1 > prepared part key=_multipart_MFA30GSMCSKP.2~CQ0P4MC3F6JR.1 size=1048576 2024-09-14T10:51:28.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.115+0000 7f19187cc780 1 > prepared part key=_multipart_MFA30GSMCSKP.2~CQ0P4MC3F6JR.2 size=745108 2024-09-14T10:51:28.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.115+0000 7f19187cc780 1 > prepared multipart upload key=MFA30GSMCSKP upload=CQ0P4MC3F6JR tag=PG23BU36LKUC type=write size=3890836 2024-09-14T10:51:28.115 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.116+0000 7f19187cc780 1 < completed write operation key=KP3WOGIF30PZ tag=HMWBE6QV6Z6B type=write size=297128 2024-09-14T10:51:28.116 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.118+0000 7f19187cc780 1 > prepared operation key=5AIAYJMRZGFQ tag=0NPU9H2FTIHX type=del size=3336623 2024-09-14T10:51:28.117 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.119+0000 7f19187cc780 1 < canceled operation key=KP3WOGIF30PZ tag=ZIPC4OU4IZR9 type=write size=75404 2024-09-14T10:51:28.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.120+0000 7f19187cc780 1 > prepared operation key=AST81B9QWORT tag=U7QVWFN3K31M type=del size=1903307 2024-09-14T10:51:28.120 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.122+0000 7f19187cc780 1 < completed delete operation key=XCVE2F2JJK4X tag=4IBTOI8DIVVL type=del 2024-09-14T10:51:28.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.123+0000 7f19187cc780 1 > prepared operation key=EL00Y4Z7DTAT tag=YUX6V5Y7MXM7 type=write size=670862 2024-09-14T10:51:28.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.125+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~7TG7A4XTHUEL.0 size=793883 2024-09-14T10:51:28.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.127+0000 7f19187cc780 1 < completed multipart upload key=B9FQYIX19AEP upload=7TG7A4XTHUEL tag=48ZF36H30IH5 type=write size=1842459 2024-09-14T10:51:28.127 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.128+0000 7f19187cc780 1 > prepared operation key=AGNUE76X8XCJ tag=TSDNN3XF6S6A type=del size=2350374 2024-09-14T10:51:28.128 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.130+0000 7f19187cc780 1 < completed delete operation key=617QQI921HB4 tag=31XUYGWZ1M5T type=del 2024-09-14T10:51:28.131 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.132+0000 7f19187cc780 1 > prepared part key=_multipart_54BSD3DEHNK6.2~SS2JQPP44Q16.0 size=233557 2024-09-14T10:51:28.131 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.132+0000 7f19187cc780 1 > prepared multipart upload key=54BSD3DEHNK6 upload=SS2JQPP44Q16 tag=T1VJJD5EVM38 type=write size=1282133 2024-09-14T10:51:28.132 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.134+0000 7f19187cc780 1 < completed part key=_multipart_61O2VU0SB379.2~ZTUBJT2VFN0A.0 size=1048576 2024-09-14T10:51:28.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.135+0000 7f19187cc780 1 < completed part key=_multipart_61O2VU0SB379.2~ZTUBJT2VFN0A.1 size=1048576 2024-09-14T10:51:28.134 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.136+0000 7f19187cc780 1 < completed part key=_multipart_61O2VU0SB379.2~ZTUBJT2VFN0A.2 size=312488 2024-09-14T10:51:28.137 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.139+0000 7f19187cc780 1 < completed multipart upload key=61O2VU0SB379 upload=ZTUBJT2VFN0A tag=CJAXYWO1AZW9 type=write size=3458216 2024-09-14T10:51:28.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.140+0000 7f19187cc780 1 > prepared operation key=XCVE2F2JJK4X tag=X5BOISPYZ2JL type=del size=1463347 2024-09-14T10:51:28.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.143+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~Q9M61X9XM1GO.0 size=1048576 2024-09-14T10:51:28.142 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.144+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~Q9M61X9XM1GO.1 size=1048576 2024-09-14T10:51:28.142 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.144+0000 7f19187cc780 1 < canceled part key=_multipart_VW6U36JN2DBX.2~Q9M61X9XM1GO.2 size=670543 2024-09-14T10:51:28.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.147+0000 7f19187cc780 1 < canceled multipart upload key=VW6U36JN2DBX upload=Q9M61X9XM1GO tag=LRVR0O4MSZGC type=write size=3816271 2024-09-14T10:51:28.147 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.148+0000 7f19187cc780 1 > prepared operation key=EZLSMEK89N2G tag=03R2HVR55GCB type=del size=2988436 2024-09-14T10:51:28.148 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.150+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~ZGCUVCT5TQTD.0 size=1048576 2024-09-14T10:51:28.150 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.151+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~ZGCUVCT5TQTD.1 size=1048576 2024-09-14T10:51:28.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.153+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~ZGCUVCT5TQTD.2 size=41141 2024-09-14T10:51:28.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.156+0000 7f19187cc780 1 < completed multipart upload key=VW6U36JN2DBX upload=ZGCUVCT5TQTD tag=FYF7G1Z6W5IO type=write size=3186869 2024-09-14T10:51:28.156 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.158+0000 7f19187cc780 1 > prepared part key=_multipart_9EBD5ZT6MT45.2~KFAI3CQB98HJ.0 size=430835 2024-09-14T10:51:28.157 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.158+0000 7f19187cc780 1 > prepared multipart upload key=9EBD5ZT6MT45 upload=KFAI3CQB98HJ tag=QMCDLI25M4NO type=write size=1479411 2024-09-14T10:51:28.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.160+0000 7f19187cc780 1 < completed delete operation key=IKVYA4KEALFF tag=T2JRVCDIOO9P type=del 2024-09-14T10:51:28.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.162+0000 7f19187cc780 1 > prepared part key=_multipart_19P3WE6HKJH2.2~FUYYIOT45V9O.0 size=995180 2024-09-14T10:51:28.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.162+0000 7f19187cc780 1 > prepared multipart upload key=19P3WE6HKJH2 upload=FUYYIOT45V9O tag=020VHNSKY8Z6 type=write size=2043756 2024-09-14T10:51:28.162 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.164+0000 7f19187cc780 1 < completed delete operation key=AGNUE76X8XCJ tag=TBY2LS9M1MUM type=del 2024-09-14T10:51:28.164 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.166+0000 7f19187cc780 1 > prepared operation key=YA3DI7N4DG5K tag=0VVJYFNXSEK3 type=del size=563052 2024-09-14T10:51:28.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.167+0000 7f19187cc780 1 < completed write operation key=EL00Y4Z7DTAT tag=2BKB51NV0BBU type=write size=801395 2024-09-14T10:51:28.167 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.169+0000 7f19187cc780 1 > prepared operation key=W1K1IU13J0CZ tag=3ZRUAMGG3AJI type=del size=3003320 2024-09-14T10:51:28.169 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.170+0000 7f19187cc780 1 < canceled operation key=CADC2BY888V1 tag=T76B91MX4G6H type=del size=1072811 2024-09-14T10:51:28.172 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.173+0000 7f19187cc780 1 > prepared part key=_multipart_CADC2BY888V1.2~4SZMIMVHDAXF.0 size=1048576 2024-09-14T10:51:28.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.174+0000 7f19187cc780 1 > prepared part key=_multipart_CADC2BY888V1.2~4SZMIMVHDAXF.1 size=202736 2024-09-14T10:51:28.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.174+0000 7f19187cc780 1 > prepared multipart upload key=CADC2BY888V1 upload=4SZMIMVHDAXF tag=CPN2XQ6DAZR1 type=write size=2299888 2024-09-14T10:51:28.175 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.176+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~IF207FX3JKQK.0 size=179970 2024-09-14T10:51:28.177 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.179+0000 7f19187cc780 1 < completed multipart upload key=7IWUW2HC3ULI upload=IF207FX3JKQK tag=K7X0DWPIZUIP type=write size=1228546 2024-09-14T10:51:28.180 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.181+0000 7f19187cc780 1 > prepared part key=_multipart_MFA30GSMCSKP.2~EBUS4GBZM5U1.0 size=1048576 2024-09-14T10:51:28.181 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.183+0000 7f19187cc780 1 > prepared part key=_multipart_MFA30GSMCSKP.2~EBUS4GBZM5U1.1 size=1048576 2024-09-14T10:51:28.183 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.185+0000 7f19187cc780 1 > prepared part key=_multipart_MFA30GSMCSKP.2~EBUS4GBZM5U1.2 size=318710 2024-09-14T10:51:28.183 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.185+0000 7f19187cc780 1 > prepared multipart upload key=MFA30GSMCSKP upload=EBUS4GBZM5U1 tag=ZLFPDA0742RJ type=write size=3464438 2024-09-14T10:51:28.186 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.188+0000 7f19187cc780 1 < suggested remove operation key=W1K1IU13J0CZ tag=O2EJNC1VJAPO type=del 2024-09-14T10:51:28.188 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.190+0000 7f19187cc780 1 > prepared operation key=EL00Y4Z7DTAT tag=JIE0RECKM4LJ type=del size=3012764 2024-09-14T10:51:28.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.191+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~6PJTH5SUANO0.0 size=1048576 2024-09-14T10:51:28.191 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.192+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~6PJTH5SUANO0.1 size=59330 2024-09-14T10:51:28.193 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.195+0000 7f19187cc780 1 < completed multipart upload key=VW6U36JN2DBX upload=6PJTH5SUANO0 tag=33LQY1ZJJ2ML type=write size=2156482 2024-09-14T10:51:28.196 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.198+0000 7f19187cc780 1 > prepared part key=_multipart_54BSD3DEHNK6.2~RV4JDE2JRO56.0 size=1048576 2024-09-14T10:51:28.197 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.199+0000 7f19187cc780 1 > prepared part key=_multipart_54BSD3DEHNK6.2~RV4JDE2JRO56.1 size=1048576 2024-09-14T10:51:28.198 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.200+0000 7f19187cc780 1 > prepared part key=_multipart_54BSD3DEHNK6.2~RV4JDE2JRO56.2 size=1027539 2024-09-14T10:51:28.199 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.200+0000 7f19187cc780 1 > prepared multipart upload key=54BSD3DEHNK6 upload=RV4JDE2JRO56 tag=6Q3T3EDW3C3C type=write size=4173267 2024-09-14T10:51:28.199 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.200+0000 7f19187cc780 1 < canceled part key=_multipart_MFA30GSMCSKP.2~CQ0P4MC3F6JR.0 size=1048576 2024-09-14T10:51:28.199 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.200+0000 7f19187cc780 1 < canceled part key=_multipart_MFA30GSMCSKP.2~CQ0P4MC3F6JR.1 size=1048576 2024-09-14T10:51:28.200 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.201+0000 7f19187cc780 1 < completed part key=_multipart_MFA30GSMCSKP.2~CQ0P4MC3F6JR.2 size=745108 2024-09-14T10:51:28.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.204+0000 7f19187cc780 1 < canceled multipart upload key=MFA30GSMCSKP upload=CQ0P4MC3F6JR tag=PG23BU36LKUC type=write size=3890836 2024-09-14T10:51:28.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.205+0000 7f19187cc780 1 > prepared operation key=7IWUW2HC3ULI tag=ANI7L0B5B7IE type=write size=850546 2024-09-14T10:51:28.205 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.207+0000 7f19187cc780 1 < completed delete operation key=5AIAYJMRZGFQ tag=0NPU9H2FTIHX type=del 2024-09-14T10:51:28.206 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.208+0000 7f19187cc780 1 > prepared operation key=KOJ7QB7M6A35 tag=OVJS00J1Y324 type=del size=1544119 2024-09-14T10:51:28.208 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.210+0000 7f19187cc780 1 < completed delete operation key=AST81B9QWORT tag=U7QVWFN3K31M type=del 2024-09-14T10:51:28.212 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.214+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~UEUOQW39D0J1.0 size=295360 2024-09-14T10:51:28.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.214+0000 7f19187cc780 1 > prepared multipart upload key=XCVE2F2JJK4X upload=UEUOQW39D0J1 tag=22JOXSWR9K2Y type=write size=1343936 2024-09-14T10:51:28.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.216+0000 7f19187cc780 1 < completed write operation key=EL00Y4Z7DTAT tag=YUX6V5Y7MXM7 type=write size=670862 2024-09-14T10:51:28.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.217+0000 7f19187cc780 1 > prepared operation key=CADC2BY888V1 tag=0VQEPWHTE72X type=write size=273535 2024-09-14T10:51:28.217 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.218+0000 7f19187cc780 1 < completed delete operation key=AGNUE76X8XCJ tag=TSDNN3XF6S6A type=del 2024-09-14T10:51:28.219 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.221+0000 7f19187cc780 1 > prepared part key=_multipart_RTGE7ISETJWW.2~PYST4OWAX1N3.0 size=1048576 2024-09-14T10:51:28.220 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.222+0000 7f19187cc780 1 > prepared part key=_multipart_RTGE7ISETJWW.2~PYST4OWAX1N3.1 size=994323 2024-09-14T10:51:28.220 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.222+0000 7f19187cc780 1 > prepared multipart upload key=RTGE7ISETJWW upload=PYST4OWAX1N3 tag=CXPYBIWAB67Q type=write size=3091475 2024-09-14T10:51:28.221 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.223+0000 7f19187cc780 1 < completed part key=_multipart_54BSD3DEHNK6.2~SS2JQPP44Q16.0 size=233557 2024-09-14T10:51:28.224 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.225+0000 7f19187cc780 1 < completed multipart upload key=54BSD3DEHNK6 upload=SS2JQPP44Q16 tag=T1VJJD5EVM38 type=write size=1282133 2024-09-14T10:51:28.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.227+0000 7f19187cc780 1 > prepared operation key=61O2VU0SB379 tag=FN5AJNVKF9IR type=del size=48237 2024-09-14T10:51:28.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.228+0000 7f19187cc780 1 < completed delete operation key=XCVE2F2JJK4X tag=X5BOISPYZ2JL type=del 2024-09-14T10:51:28.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.229+0000 7f19187cc780 1 > prepared operation key=OVOPGTYUF3F3 tag=J22QBS072NHT type=del size=2984443 2024-09-14T10:51:28.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.230+0000 7f19187cc780 1 < completed delete operation key=EZLSMEK89N2G tag=03R2HVR55GCB type=del 2024-09-14T10:51:28.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.233+0000 7f19187cc780 1 > prepared part key=_multipart_QBMNYNWOLK4I.2~QPQLVVQS2UTV.0 size=1031581 2024-09-14T10:51:28.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.233+0000 7f19187cc780 1 > prepared multipart upload key=QBMNYNWOLK4I upload=QPQLVVQS2UTV tag=PEIUZ9THZ2WX type=write size=2080157 2024-09-14T10:51:28.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.234+0000 7f19187cc780 1 < completed part key=_multipart_9EBD5ZT6MT45.2~KFAI3CQB98HJ.0 size=430835 2024-09-14T10:51:28.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.237+0000 7f19187cc780 1 < completed multipart upload key=9EBD5ZT6MT45 upload=KFAI3CQB98HJ tag=QMCDLI25M4NO type=write size=1479411 2024-09-14T10:51:28.237 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.239+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~3S3E7KAC3RVV.0 size=1048576 2024-09-14T10:51:28.238 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.240+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~3S3E7KAC3RVV.1 size=350772 2024-09-14T10:51:28.238 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.240+0000 7f19187cc780 1 > prepared multipart upload key=IKVYA4KEALFF upload=3S3E7KAC3RVV tag=X0OEYTARSA6E type=write size=2447924 2024-09-14T10:51:28.240 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.241+0000 7f19187cc780 1 < completed part key=_multipart_19P3WE6HKJH2.2~FUYYIOT45V9O.0 size=995180 2024-09-14T10:51:28.242 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.244+0000 7f19187cc780 1 < completed multipart upload key=19P3WE6HKJH2 upload=FUYYIOT45V9O tag=020VHNSKY8Z6 type=write size=2043756 2024-09-14T10:51:28.245 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.246+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~PHCHSU8PI3GQ.0 size=1048576 2024-09-14T10:51:28.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.247+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~PHCHSU8PI3GQ.1 size=427225 2024-09-14T10:51:28.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.247+0000 7f19187cc780 1 > prepared multipart upload key=XCVE2F2JJK4X upload=PHCHSU8PI3GQ tag=ZO6GQZ84WQYB type=write size=2524377 2024-09-14T10:51:28.247 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.249+0000 7f19187cc780 1 < completed delete operation key=YA3DI7N4DG5K tag=0VVJYFNXSEK3 type=del 2024-09-14T10:51:28.248 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.250+0000 7f19187cc780 1 > prepared operation key=CADC2BY888V1 tag=R2C1G7EG5D6V type=del size=57253 2024-09-14T10:51:28.250 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.251+0000 7f19187cc780 -1 < failed to complete operation key=W1K1IU13J0CZ tag=3ZRUAMGG3AJI type=del size=3003320: (22) Invalid argument 2024-09-14T10:51:28.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.253+0000 7f19187cc780 1 > prepared operation key=EZLSMEK89N2G tag=0FEY9F34PNXU type=del size=4026978 2024-09-14T10:51:28.253 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.254+0000 7f19187cc780 1 < completed part key=_multipart_CADC2BY888V1.2~4SZMIMVHDAXF.0 size=1048576 2024-09-14T10:51:28.256 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.255+0000 7f19187cc780 1 < completed part key=_multipart_CADC2BY888V1.2~4SZMIMVHDAXF.1 size=202736 2024-09-14T10:51:28.257 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.258+0000 7f19187cc780 1 < completed multipart upload key=CADC2BY888V1 upload=4SZMIMVHDAXF tag=CPN2XQ6DAZR1 type=write size=2299888 2024-09-14T10:51:28.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.261+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~CQ189T0OXC0B.0 size=1048576 2024-09-14T10:51:28.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.262+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~CQ189T0OXC0B.1 size=437544 2024-09-14T10:51:28.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.262+0000 7f19187cc780 1 > prepared multipart upload key=AGNUE76X8XCJ upload=CQ189T0OXC0B tag=3QQRPH6TR6JY type=write size=2534696 2024-09-14T10:51:28.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.263+0000 7f19187cc780 1 < completed part key=_multipart_MFA30GSMCSKP.2~EBUS4GBZM5U1.0 size=1048576 2024-09-14T10:51:28.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.264+0000 7f19187cc780 1 < completed part key=_multipart_MFA30GSMCSKP.2~EBUS4GBZM5U1.1 size=1048576 2024-09-14T10:51:28.264 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.266+0000 7f19187cc780 1 < completed part key=_multipart_MFA30GSMCSKP.2~EBUS4GBZM5U1.2 size=318710 2024-09-14T10:51:28.266 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.268+0000 7f19187cc780 1 < completed multipart upload key=MFA30GSMCSKP upload=EBUS4GBZM5U1 tag=ZLFPDA0742RJ type=write size=3464438 2024-09-14T10:51:28.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.271+0000 7f19187cc780 1 > prepared part key=_multipart_54BSD3DEHNK6.2~KTFJGRARWHZK.0 size=1048576 2024-09-14T10:51:28.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.272+0000 7f19187cc780 1 > prepared part key=_multipart_54BSD3DEHNK6.2~KTFJGRARWHZK.1 size=1048576 2024-09-14T10:51:28.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.273+0000 7f19187cc780 1 > prepared part key=_multipart_54BSD3DEHNK6.2~KTFJGRARWHZK.2 size=779745 2024-09-14T10:51:28.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.273+0000 7f19187cc780 1 > prepared multipart upload key=54BSD3DEHNK6 upload=KTFJGRARWHZK tag=U4H1Q979V961 type=write size=3925473 2024-09-14T10:51:28.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.274+0000 7f19187cc780 1 < canceled operation key=EL00Y4Z7DTAT tag=JIE0RECKM4LJ type=del size=3012764 2024-09-14T10:51:28.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.276+0000 7f19187cc780 1 > prepared operation key=AST81B9QWORT tag=TIHDFI8B6P8E type=del size=694044 2024-09-14T10:51:28.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.277+0000 7f19187cc780 1 < completed part key=_multipart_54BSD3DEHNK6.2~RV4JDE2JRO56.0 size=1048576 2024-09-14T10:51:28.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.277+0000 7f19187cc780 1 < canceled part key=_multipart_54BSD3DEHNK6.2~RV4JDE2JRO56.1 size=1048576 2024-09-14T10:51:28.277 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.278+0000 7f19187cc780 1 < completed part key=_multipart_54BSD3DEHNK6.2~RV4JDE2JRO56.2 size=1027539 2024-09-14T10:51:28.279 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.281+0000 7f19187cc780 1 < canceled multipart upload key=54BSD3DEHNK6 upload=RV4JDE2JRO56 tag=6Q3T3EDW3C3C type=write size=4173267 2024-09-14T10:51:28.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.283+0000 7f19187cc780 1 > prepared part key=_multipart_EZLSMEK89N2G.2~BC6L02IWWX2N.0 size=925271 2024-09-14T10:51:28.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.283+0000 7f19187cc780 1 > prepared multipart upload key=EZLSMEK89N2G upload=BC6L02IWWX2N tag=9OLFBUR2LS87 type=write size=1973847 2024-09-14T10:51:28.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.285+0000 7f19187cc780 1 < completed write operation key=7IWUW2HC3ULI tag=ANI7L0B5B7IE type=write size=850546 2024-09-14T10:51:28.286 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.287+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~11W7F5ZV2VP3.0 size=1048576 2024-09-14T10:51:28.287 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.289+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~11W7F5ZV2VP3.1 size=1048576 2024-09-14T10:51:28.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.290+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~11W7F5ZV2VP3.2 size=183236 2024-09-14T10:51:28.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.290+0000 7f19187cc780 1 > prepared multipart upload key=7IWUW2HC3ULI upload=11W7F5ZV2VP3 tag=66UUNFKSQCCA type=write size=3328964 2024-09-14T10:51:28.290 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.291+0000 7f19187cc780 1 < completed delete operation key=KOJ7QB7M6A35 tag=OVJS00J1Y324 type=del 2024-09-14T10:51:28.292 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.294+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~AYMBV2QRJBU7.0 size=66158 2024-09-14T10:51:28.292 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.294+0000 7f19187cc780 1 > prepared multipart upload key=OVOPGTYUF3F3 upload=AYMBV2QRJBU7 tag=3YWL0ZEFHXG5 type=write size=1114734 2024-09-14T10:51:28.293 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.295+0000 7f19187cc780 1 < completed part key=_multipart_XCVE2F2JJK4X.2~UEUOQW39D0J1.0 size=295360 2024-09-14T10:51:28.296 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.297+0000 7f19187cc780 1 < completed multipart upload key=XCVE2F2JJK4X upload=UEUOQW39D0J1 tag=22JOXSWR9K2Y type=write size=1343936 2024-09-14T10:51:28.299 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.300+0000 7f19187cc780 1 > prepared part key=_multipart_W1K1IU13J0CZ.2~59H22HDJGQAZ.0 size=862181 2024-09-14T10:51:28.299 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.300+0000 7f19187cc780 1 > prepared multipart upload key=W1K1IU13J0CZ upload=59H22HDJGQAZ tag=J5E6Q0MHDIA3 type=write size=1910757 2024-09-14T10:51:28.300 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.301+0000 7f19187cc780 1 < completed write operation key=CADC2BY888V1 tag=0VQEPWHTE72X type=write size=273535 2024-09-14T10:51:28.302 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.303+0000 7f19187cc780 1 > prepared operation key=IKVYA4KEALFF tag=160XPH367VSQ type=del size=2592221 2024-09-14T10:51:28.302 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.303+0000 7f19187cc780 1 < canceled part key=_multipart_RTGE7ISETJWW.2~PYST4OWAX1N3.0 size=1048576 2024-09-14T10:51:28.303 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.304+0000 7f19187cc780 1 < completed part key=_multipart_RTGE7ISETJWW.2~PYST4OWAX1N3.1 size=994323 2024-09-14T10:51:28.305 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.307+0000 7f19187cc780 1 < canceled multipart upload key=RTGE7ISETJWW upload=PYST4OWAX1N3 tag=CXPYBIWAB67Q type=write size=3091475 2024-09-14T10:51:28.306 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.308+0000 7f19187cc780 1 > prepared operation key=61O2VU0SB379 tag=1A1W0Q2TQK8A type=del size=1750065 2024-09-14T10:51:28.308 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.309+0000 7f19187cc780 1 < completed delete operation key=61O2VU0SB379 tag=FN5AJNVKF9IR type=del 2024-09-14T10:51:28.309 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.311+0000 7f19187cc780 1 > prepared operation key=N0L67LS2KHR1 tag=X83V5TTTXO3W type=del size=1618306 2024-09-14T10:51:28.311 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.312+0000 7f19187cc780 1 < canceled operation key=OVOPGTYUF3F3 tag=J22QBS072NHT type=del size=2984443 2024-09-14T10:51:28.313 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.315+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~M9YMHYB1IJLW.0 size=1048576 2024-09-14T10:51:28.315 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.317+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~M9YMHYB1IJLW.1 size=1048576 2024-09-14T10:51:28.316 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.318+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~M9YMHYB1IJLW.2 size=993782 2024-09-14T10:51:28.316 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.318+0000 7f19187cc780 1 > prepared multipart upload key=KOJ7QB7M6A35 upload=M9YMHYB1IJLW tag=JTTMUVCKMLR0 type=write size=4139510 2024-09-14T10:51:28.317 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.318+0000 7f19187cc780 1 < canceled part key=_multipart_QBMNYNWOLK4I.2~QPQLVVQS2UTV.0 size=1031581 2024-09-14T10:51:28.319 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.320+0000 7f19187cc780 1 < canceled multipart upload key=QBMNYNWOLK4I upload=QPQLVVQS2UTV tag=PEIUZ9THZ2WX type=write size=2080157 2024-09-14T10:51:28.320 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.322+0000 7f19187cc780 1 > prepared operation key=AGNUE76X8XCJ tag=FD7YBWIFT6RN type=del size=3778418 2024-09-14T10:51:28.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.323+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~3S3E7KAC3RVV.0 size=1048576 2024-09-14T10:51:28.323 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.324+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~3S3E7KAC3RVV.1 size=350772 2024-09-14T10:51:28.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.327+0000 7f19187cc780 1 < completed multipart upload key=IKVYA4KEALFF upload=3S3E7KAC3RVV tag=X0OEYTARSA6E type=write size=2447924 2024-09-14T10:51:28.327 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.328+0000 7f19187cc780 1 > prepared operation key=617QQI921HB4 tag=IAFKCEYMXO92 type=write size=206049 2024-09-14T10:51:28.327 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.329+0000 7f19187cc780 1 < canceled part key=_multipart_XCVE2F2JJK4X.2~PHCHSU8PI3GQ.0 size=1048576 2024-09-14T10:51:28.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.330+0000 7f19187cc780 1 < completed part key=_multipart_XCVE2F2JJK4X.2~PHCHSU8PI3GQ.1 size=427225 2024-09-14T10:51:28.330 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.332+0000 7f19187cc780 1 < canceled multipart upload key=XCVE2F2JJK4X upload=PHCHSU8PI3GQ tag=ZO6GQZ84WQYB type=write size=2524377 2024-09-14T10:51:28.332 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.333+0000 7f19187cc780 1 > prepared operation key=QFEI6H4EQ9ZR tag=M5NCAG25NCXT type=del size=3672506 2024-09-14T10:51:28.333 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.335+0000 7f19187cc780 1 < completed delete operation key=CADC2BY888V1 tag=R2C1G7EG5D6V type=del 2024-09-14T10:51:28.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.336+0000 7f19187cc780 1 > prepared operation key=5AIAYJMRZGFQ tag=ZGMCL2A6YCHP type=del size=1897410 2024-09-14T10:51:28.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.339+0000 7f19187cc780 1 < suggested remove operation key=EZLSMEK89N2G tag=0FEY9F34PNXU type=del 2024-09-14T10:51:28.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.340+0000 7f19187cc780 1 > prepared operation key=YA3DI7N4DG5K tag=ENZXQ2UIJL8U type=del size=3423144 2024-09-14T10:51:28.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.340+0000 7f19187cc780 1 < canceled part key=_multipart_AGNUE76X8XCJ.2~CQ189T0OXC0B.0 size=1048576 2024-09-14T10:51:28.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.341+0000 7f19187cc780 1 < completed part key=_multipart_AGNUE76X8XCJ.2~CQ189T0OXC0B.1 size=437544 2024-09-14T10:51:28.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.344+0000 7f19187cc780 1 < canceled multipart upload key=AGNUE76X8XCJ upload=CQ189T0OXC0B tag=3QQRPH6TR6JY type=write size=2534696 2024-09-14T10:51:28.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.347+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~NCVYGBCY0C5S.0 size=1048576 2024-09-14T10:51:28.346 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.348+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~NCVYGBCY0C5S.1 size=1048576 2024-09-14T10:51:28.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.351+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~NCVYGBCY0C5S.2 size=341685 2024-09-14T10:51:28.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.351+0000 7f19187cc780 1 > prepared multipart upload key=KP3WOGIF30PZ upload=NCVYGBCY0C5S tag=C1AVLRTSWZ82 type=write size=3487413 2024-09-14T10:51:28.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.352+0000 7f19187cc780 1 < completed part key=_multipart_54BSD3DEHNK6.2~KTFJGRARWHZK.0 size=1048576 2024-09-14T10:51:28.352 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.353+0000 7f19187cc780 1 < completed part key=_multipart_54BSD3DEHNK6.2~KTFJGRARWHZK.1 size=1048576 2024-09-14T10:51:28.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.355+0000 7f19187cc780 1 < completed part key=_multipart_54BSD3DEHNK6.2~KTFJGRARWHZK.2 size=779745 2024-09-14T10:51:28.356 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.357+0000 7f19187cc780 1 < completed multipart upload key=54BSD3DEHNK6 upload=KTFJGRARWHZK tag=U4H1Q979V961 type=write size=3925473 2024-09-14T10:51:28.357 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.359+0000 7f19187cc780 1 > prepared operation key=N0L67LS2KHR1 tag=BSRP7F3JAYL7 type=write size=513821 2024-09-14T10:51:28.359 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.360+0000 7f19187cc780 1 < completed delete operation key=AST81B9QWORT tag=TIHDFI8B6P8E type=del 2024-09-14T10:51:28.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.362+0000 7f19187cc780 1 > prepared operation key=MFA30GSMCSKP tag=OJP9FQU9G665 type=del size=2462164 2024-09-14T10:51:28.361 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.363+0000 7f19187cc780 1 < completed part key=_multipart_EZLSMEK89N2G.2~BC6L02IWWX2N.0 size=925271 2024-09-14T10:51:28.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.365+0000 7f19187cc780 1 < completed multipart upload key=EZLSMEK89N2G upload=BC6L02IWWX2N tag=9OLFBUR2LS87 type=write size=1973847 2024-09-14T10:51:28.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.367+0000 7f19187cc780 1 > prepared operation key=EZLSMEK89N2G tag=P5XGFWCPSTB5 type=write size=882779 2024-09-14T10:51:28.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.368+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~11W7F5ZV2VP3.0 size=1048576 2024-09-14T10:51:28.368 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.369+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~11W7F5ZV2VP3.1 size=1048576 2024-09-14T10:51:28.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.371+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~11W7F5ZV2VP3.2 size=183236 2024-09-14T10:51:28.372 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.373+0000 7f19187cc780 1 < completed multipart upload key=7IWUW2HC3ULI upload=11W7F5ZV2VP3 tag=66UUNFKSQCCA type=write size=3328964 2024-09-14T10:51:28.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.375+0000 7f19187cc780 1 > prepared operation key=9EBD5ZT6MT45 tag=DX3ZALBMO6B9 type=del size=277233 2024-09-14T10:51:28.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.376+0000 7f19187cc780 1 < completed part key=_multipart_OVOPGTYUF3F3.2~AYMBV2QRJBU7.0 size=66158 2024-09-14T10:51:28.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.379+0000 7f19187cc780 1 < completed multipart upload key=OVOPGTYUF3F3 upload=AYMBV2QRJBU7 tag=3YWL0ZEFHXG5 type=write size=1114734 2024-09-14T10:51:28.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.382+0000 7f19187cc780 1 > prepared part key=_multipart_H40763V7HMBC.2~3RHE060Q9W7X.0 size=1048576 2024-09-14T10:51:28.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.383+0000 7f19187cc780 1 > prepared part key=_multipart_H40763V7HMBC.2~3RHE060Q9W7X.1 size=1041552 2024-09-14T10:51:28.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.383+0000 7f19187cc780 1 > prepared multipart upload key=H40763V7HMBC upload=3RHE060Q9W7X tag=2LSE2XY558RO type=write size=3138704 2024-09-14T10:51:28.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.384+0000 7f19187cc780 1 < completed part key=_multipart_W1K1IU13J0CZ.2~59H22HDJGQAZ.0 size=862181 2024-09-14T10:51:28.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.387+0000 7f19187cc780 1 < completed multipart upload key=W1K1IU13J0CZ upload=59H22HDJGQAZ tag=J5E6Q0MHDIA3 type=write size=1910757 2024-09-14T10:51:28.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.389+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~BKY9S4MKVRSQ.0 size=1048576 2024-09-14T10:51:28.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.390+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~BKY9S4MKVRSQ.1 size=1048576 2024-09-14T10:51:28.390 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.391+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~BKY9S4MKVRSQ.2 size=937665 2024-09-14T10:51:28.390 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.391+0000 7f19187cc780 1 > prepared multipart upload key=7IWUW2HC3ULI upload=BKY9S4MKVRSQ tag=9T24104F62K7 type=write size=4083393 2024-09-14T10:51:28.391 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.393+0000 7f19187cc780 1 < completed delete operation key=IKVYA4KEALFF tag=160XPH367VSQ type=del 2024-09-14T10:51:28.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.394+0000 7f19187cc780 1 > prepared operation key=H40763V7HMBC tag=JUKDZJRTO24K type=del size=931783 2024-09-14T10:51:28.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.396+0000 7f19187cc780 1 < completed delete operation key=61O2VU0SB379 tag=1A1W0Q2TQK8A type=del 2024-09-14T10:51:28.397 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.398+0000 7f19187cc780 1 > prepared part key=_multipart_AST81B9QWORT.2~DSIBIS5KJAMC.0 size=1048576 2024-09-14T10:51:28.398 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.399+0000 7f19187cc780 1 > prepared part key=_multipart_AST81B9QWORT.2~DSIBIS5KJAMC.1 size=1048576 2024-09-14T10:51:28.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.400+0000 7f19187cc780 1 > prepared part key=_multipart_AST81B9QWORT.2~DSIBIS5KJAMC.2 size=37313 2024-09-14T10:51:28.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.400+0000 7f19187cc780 1 > prepared multipart upload key=AST81B9QWORT upload=DSIBIS5KJAMC tag=5STG4FF5UQQL type=write size=3183041 2024-09-14T10:51:28.400 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.402+0000 7f19187cc780 1 < completed delete operation key=N0L67LS2KHR1 tag=X83V5TTTXO3W type=del 2024-09-14T10:51:28.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.403+0000 7f19187cc780 1 > prepared operation key=YA3DI7N4DG5K tag=0CRPNWYJW4VF type=del size=2306011 2024-09-14T10:51:28.403 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.405+0000 7f19187cc780 1 < completed part key=_multipart_KOJ7QB7M6A35.2~M9YMHYB1IJLW.0 size=1048576 2024-09-14T10:51:28.404 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.406+0000 7f19187cc780 1 < completed part key=_multipart_KOJ7QB7M6A35.2~M9YMHYB1IJLW.1 size=1048576 2024-09-14T10:51:28.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.407+0000 7f19187cc780 1 < completed part key=_multipart_KOJ7QB7M6A35.2~M9YMHYB1IJLW.2 size=993782 2024-09-14T10:51:28.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.409+0000 7f19187cc780 1 < completed multipart upload key=KOJ7QB7M6A35 upload=M9YMHYB1IJLW tag=JTTMUVCKMLR0 type=write size=4139510 2024-09-14T10:51:28.410 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.412+0000 7f19187cc780 1 > prepared part key=_multipart_N0L67LS2KHR1.2~OQBLD1F6BUM0.0 size=848928 2024-09-14T10:51:28.410 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.412+0000 7f19187cc780 1 > prepared multipart upload key=N0L67LS2KHR1 upload=OQBLD1F6BUM0 tag=3EU3Y0OYXQIP type=write size=1897504 2024-09-14T10:51:28.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.413+0000 7f19187cc780 1 < completed delete operation key=AGNUE76X8XCJ tag=FD7YBWIFT6RN type=del 2024-09-14T10:51:28.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.415+0000 7f19187cc780 1 > prepared operation key=VW6U36JN2DBX tag=GGX0HHL9X110 type=write size=501162 2024-09-14T10:51:28.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.417+0000 7f19187cc780 1 < suggested remove operation key=617QQI921HB4 tag=IAFKCEYMXO92 type=write 2024-09-14T10:51:28.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.420+0000 7f19187cc780 1 > prepared part key=_multipart_RTGE7ISETJWW.2~V6F97L0J8P2V.0 size=926195 2024-09-14T10:51:28.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.420+0000 7f19187cc780 1 > prepared multipart upload key=RTGE7ISETJWW upload=V6F97L0J8P2V tag=KCDX7YFE2QLP type=write size=1974771 2024-09-14T10:51:28.419 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.421+0000 7f19187cc780 1 < completed delete operation key=QFEI6H4EQ9ZR tag=M5NCAG25NCXT type=del 2024-09-14T10:51:28.421 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.422+0000 7f19187cc780 1 > prepared operation key=QBMNYNWOLK4I tag=4XDFSQVO8JGP type=del size=3039679 2024-09-14T10:51:28.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.424+0000 7f19187cc780 1 < completed delete operation key=5AIAYJMRZGFQ tag=ZGMCL2A6YCHP type=del 2024-09-14T10:51:28.424 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.425+0000 7f19187cc780 1 > prepared operation key=KP3WOGIF30PZ tag=IS3Q83HL7X36 type=del size=1409532 2024-09-14T10:51:28.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.429+0000 7f19187cc780 1 < suggested update operation key=YA3DI7N4DG5K tag=ENZXQ2UIJL8U type=del size=3423144 2024-09-14T10:51:28.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.432+0000 7f19187cc780 1 > prepared part key=_multipart_H40763V7HMBC.2~GIG6LBK6H2CL.0 size=38194 2024-09-14T10:51:28.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.432+0000 7f19187cc780 1 > prepared multipart upload key=H40763V7HMBC upload=GIG6LBK6H2CL tag=5DWRWHQHNC5W type=write size=1086770 2024-09-14T10:51:28.431 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.433+0000 7f19187cc780 1 < completed part key=_multipart_KP3WOGIF30PZ.2~NCVYGBCY0C5S.0 size=1048576 2024-09-14T10:51:28.433 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.434+0000 7f19187cc780 1 < completed part key=_multipart_KP3WOGIF30PZ.2~NCVYGBCY0C5S.1 size=1048576 2024-09-14T10:51:28.434 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.435+0000 7f19187cc780 1 < completed part key=_multipart_KP3WOGIF30PZ.2~NCVYGBCY0C5S.2 size=341685 2024-09-14T10:51:28.436 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.438+0000 7f19187cc780 1 < completed multipart upload key=KP3WOGIF30PZ upload=NCVYGBCY0C5S tag=C1AVLRTSWZ82 type=write size=3487413 2024-09-14T10:51:28.438 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.439+0000 7f19187cc780 1 > prepared operation key=5AIAYJMRZGFQ tag=I4DHW70LJ0LQ type=del size=3549710 2024-09-14T10:51:28.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.442+0000 7f19187cc780 1 < suggested remove operation key=N0L67LS2KHR1 tag=BSRP7F3JAYL7 type=write 2024-09-14T10:51:28.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.445+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~ZKSX76LBFA0E.0 size=598213 2024-09-14T10:51:28.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.445+0000 7f19187cc780 1 > prepared multipart upload key=OVOPGTYUF3F3 upload=ZKSX76LBFA0E tag=TYHRK2NOBH74 type=write size=1646789 2024-09-14T10:51:28.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.446+0000 7f19187cc780 1 < completed delete operation key=MFA30GSMCSKP tag=OJP9FQU9G665 type=del 2024-09-14T10:51:28.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.449+0000 7f19187cc780 1 > prepared part key=_multipart_W1K1IU13J0CZ.2~CJZHRL2U17ZT.0 size=340589 2024-09-14T10:51:28.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.449+0000 7f19187cc780 1 > prepared multipart upload key=W1K1IU13J0CZ upload=CJZHRL2U17ZT tag=HE3N1V2WLYZ0 type=write size=1389165 2024-09-14T10:51:28.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.451+0000 7f19187cc780 1 < completed write operation key=EZLSMEK89N2G tag=P5XGFWCPSTB5 type=write size=882779 2024-09-14T10:51:28.452 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.453+0000 7f19187cc780 1 > prepared operation key=61O2VU0SB379 tag=N1BY1D7TJGS0 type=del size=2982745 2024-09-14T10:51:28.453 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.455+0000 7f19187cc780 1 < completed delete operation key=9EBD5ZT6MT45 tag=DX3ZALBMO6B9 type=del 2024-09-14T10:51:28.456 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.458+0000 7f19187cc780 1 > prepared part key=_multipart_EZLSMEK89N2G.2~EQKQK0I2HK2O.0 size=1048576 2024-09-14T10:51:28.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.459+0000 7f19187cc780 1 > prepared part key=_multipart_EZLSMEK89N2G.2~EQKQK0I2HK2O.1 size=1036091 2024-09-14T10:51:28.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.459+0000 7f19187cc780 1 > prepared multipart upload key=EZLSMEK89N2G upload=EQKQK0I2HK2O tag=V0CYFERRT3MN type=write size=3133243 2024-09-14T10:51:28.459 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.460+0000 7f19187cc780 1 < completed part key=_multipart_H40763V7HMBC.2~3RHE060Q9W7X.0 size=1048576 2024-09-14T10:51:28.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.462+0000 7f19187cc780 1 < completed part key=_multipart_H40763V7HMBC.2~3RHE060Q9W7X.1 size=1041552 2024-09-14T10:51:28.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.464+0000 7f19187cc780 1 < completed multipart upload key=H40763V7HMBC upload=3RHE060Q9W7X tag=2LSE2XY558RO type=write size=3138704 2024-09-14T10:51:28.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.465+0000 7f19187cc780 1 > prepared operation key=61O2VU0SB379 tag=5B6DK951LD42 type=del size=2358965 2024-09-14T10:51:28.466 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.467+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~BKY9S4MKVRSQ.0 size=1048576 2024-09-14T10:51:28.467 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.468+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~BKY9S4MKVRSQ.1 size=1048576 2024-09-14T10:51:28.468 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.470+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~BKY9S4MKVRSQ.2 size=937665 2024-09-14T10:51:28.470 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.472+0000 7f19187cc780 1 < completed multipart upload key=7IWUW2HC3ULI upload=BKY9S4MKVRSQ tag=9T24104F62K7 type=write size=4083393 2024-09-14T10:51:28.472 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.474+0000 7f19187cc780 1 > prepared operation key=MFA30GSMCSKP tag=L38R80AI7WOZ type=write size=606549 2024-09-14T10:51:28.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.475+0000 7f19187cc780 1 < completed delete operation key=H40763V7HMBC tag=JUKDZJRTO24K type=del 2024-09-14T10:51:28.476 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.477+0000 7f19187cc780 1 > prepared operation key=9EBD5ZT6MT45 tag=AMRQZYKQI19Y type=del size=1362853 2024-09-14T10:51:28.477 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.479+0000 7f19187cc780 1 < completed part key=_multipart_AST81B9QWORT.2~DSIBIS5KJAMC.0 size=1048576 2024-09-14T10:51:28.478 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.480+0000 7f19187cc780 1 < completed part key=_multipart_AST81B9QWORT.2~DSIBIS5KJAMC.1 size=1048576 2024-09-14T10:51:28.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.481+0000 7f19187cc780 1 < completed part key=_multipart_AST81B9QWORT.2~DSIBIS5KJAMC.2 size=37313 2024-09-14T10:51:28.482 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.484+0000 7f19187cc780 1 < completed multipart upload key=AST81B9QWORT upload=DSIBIS5KJAMC tag=5STG4FF5UQQL type=write size=3183041 2024-09-14T10:51:28.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.486+0000 7f19187cc780 1 > prepared operation key=N0L67LS2KHR1 tag=AX3EGC1L390B type=del size=3784022 2024-09-14T10:51:28.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.487+0000 7f19187cc780 -1 < failed to complete operation key=YA3DI7N4DG5K tag=0CRPNWYJW4VF type=del size=2306011: (22) Invalid argument 2024-09-14T10:51:28.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.489+0000 7f19187cc780 1 > prepared operation key=KOJ7QB7M6A35 tag=CMKLWCTHLL58 type=del size=1258711 2024-09-14T10:51:28.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.490+0000 7f19187cc780 1 < completed part key=_multipart_N0L67LS2KHR1.2~OQBLD1F6BUM0.0 size=848928 2024-09-14T10:51:28.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.492+0000 7f19187cc780 1 < completed multipart upload key=N0L67LS2KHR1 upload=OQBLD1F6BUM0 tag=3EU3Y0OYXQIP type=write size=1897504 2024-09-14T10:51:28.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.495+0000 7f19187cc780 1 > prepared part key=_multipart_EZLSMEK89N2G.2~ID9V26QK9014.0 size=1048576 2024-09-14T10:51:28.495 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.496+0000 7f19187cc780 1 > prepared part key=_multipart_EZLSMEK89N2G.2~ID9V26QK9014.1 size=1048576 2024-09-14T10:51:28.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.497+0000 7f19187cc780 1 > prepared part key=_multipart_EZLSMEK89N2G.2~ID9V26QK9014.2 size=647132 2024-09-14T10:51:28.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.497+0000 7f19187cc780 1 > prepared multipart upload key=EZLSMEK89N2G upload=ID9V26QK9014 tag=P0AD1XRPCWSQ type=write size=3792860 2024-09-14T10:51:28.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.499+0000 7f19187cc780 1 < completed write operation key=VW6U36JN2DBX tag=GGX0HHL9X110 type=write size=501162 2024-09-14T10:51:28.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.501+0000 7f19187cc780 1 > prepared operation key=RTGE7ISETJWW tag=6KCFHAPWJ10M type=del size=4027187 2024-09-14T10:51:28.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.502+0000 7f19187cc780 1 < completed part key=_multipart_RTGE7ISETJWW.2~V6F97L0J8P2V.0 size=926195 2024-09-14T10:51:28.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.505+0000 7f19187cc780 1 < completed multipart upload key=RTGE7ISETJWW upload=V6F97L0J8P2V tag=KCDX7YFE2QLP type=write size=1974771 2024-09-14T10:51:28.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.506+0000 7f19187cc780 1 > prepared operation key=M73CER01XHDY tag=5RP52W8Z792A type=del size=4072595 2024-09-14T10:51:28.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.508+0000 7f19187cc780 1 < completed delete operation key=QBMNYNWOLK4I tag=4XDFSQVO8JGP type=del 2024-09-14T10:51:28.508 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.509+0000 7f19187cc780 1 > prepared operation key=61O2VU0SB379 tag=RLFKDZ6ZIIYQ type=write size=970823 2024-09-14T10:51:28.509 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.511+0000 7f19187cc780 1 < completed delete operation key=KP3WOGIF30PZ tag=IS3Q83HL7X36 type=del 2024-09-14T10:51:28.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.512+0000 7f19187cc780 1 > prepared operation key=AGNUE76X8XCJ tag=0WJUWW4VUZTV type=del size=3855223 2024-09-14T10:51:28.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.513+0000 7f19187cc780 1 < canceled part key=_multipart_H40763V7HMBC.2~GIG6LBK6H2CL.0 size=38194 2024-09-14T10:51:28.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.515+0000 7f19187cc780 1 < canceled multipart upload key=H40763V7HMBC upload=GIG6LBK6H2CL tag=5DWRWHQHNC5W type=write size=1086770 2024-09-14T10:51:28.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.518+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~LXUZI4PCKMM9.0 size=532497 2024-09-14T10:51:28.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.518+0000 7f19187cc780 1 > prepared multipart upload key=IKVYA4KEALFF upload=LXUZI4PCKMM9 tag=KC4OK0Y6X0SD type=write size=1581073 2024-09-14T10:51:28.519 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.521+0000 7f19187cc780 1 < suggested update operation key=5AIAYJMRZGFQ tag=I4DHW70LJ0LQ type=del size=3549710 2024-09-14T10:51:28.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.522+0000 7f19187cc780 1 > prepared operation key=61O2VU0SB379 tag=EQTONJJYTN0A type=del size=2037083 2024-09-14T10:51:28.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.524+0000 7f19187cc780 1 < completed part key=_multipart_OVOPGTYUF3F3.2~ZKSX76LBFA0E.0 size=598213 2024-09-14T10:51:28.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.526+0000 7f19187cc780 1 < completed multipart upload key=OVOPGTYUF3F3 upload=ZKSX76LBFA0E tag=TYHRK2NOBH74 type=write size=1646789 2024-09-14T10:51:28.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.528+0000 7f19187cc780 1 > prepared operation key=VW6U36JN2DBX tag=ASLHQ3SEFJ5O type=del size=3618049 2024-09-14T10:51:28.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.530+0000 7f19187cc780 1 < completed part key=_multipart_W1K1IU13J0CZ.2~CJZHRL2U17ZT.0 size=340589 2024-09-14T10:51:28.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.532+0000 7f19187cc780 1 < completed multipart upload key=W1K1IU13J0CZ upload=CJZHRL2U17ZT tag=HE3N1V2WLYZ0 type=write size=1389165 2024-09-14T10:51:28.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.535+0000 7f19187cc780 1 > prepared part key=_multipart_54BSD3DEHNK6.2~YTSKJCAS9OK5.0 size=1048576 2024-09-14T10:51:28.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.536+0000 7f19187cc780 1 > prepared part key=_multipart_54BSD3DEHNK6.2~YTSKJCAS9OK5.1 size=1048576 2024-09-14T10:51:28.536 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.538+0000 7f19187cc780 1 > prepared part key=_multipart_54BSD3DEHNK6.2~YTSKJCAS9OK5.2 size=22120 2024-09-14T10:51:28.536 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.538+0000 7f19187cc780 1 > prepared multipart upload key=54BSD3DEHNK6 upload=YTSKJCAS9OK5 tag=PV2WF3FOU5T5 type=write size=3167848 2024-09-14T10:51:28.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.539+0000 7f19187cc780 1 < canceled operation key=61O2VU0SB379 tag=N1BY1D7TJGS0 type=del size=2982745 2024-09-14T10:51:28.539 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.541+0000 7f19187cc780 1 > prepared operation key=EL00Y4Z7DTAT tag=GL14LE0UZD5M type=del size=1428170 2024-09-14T10:51:28.541 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.543+0000 7f19187cc780 1 < completed part key=_multipart_EZLSMEK89N2G.2~EQKQK0I2HK2O.0 size=1048576 2024-09-14T10:51:28.541 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.543+0000 7f19187cc780 1 < canceled part key=_multipart_EZLSMEK89N2G.2~EQKQK0I2HK2O.1 size=1036091 2024-09-14T10:51:28.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.545+0000 7f19187cc780 1 < canceled multipart upload key=EZLSMEK89N2G upload=EQKQK0I2HK2O tag=V0CYFERRT3MN type=write size=3133243 2024-09-14T10:51:28.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.548+0000 7f19187cc780 1 > prepared part key=_multipart_M73CER01XHDY.2~XUDQ6TX3O23J.0 size=279095 2024-09-14T10:51:28.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.548+0000 7f19187cc780 1 > prepared multipart upload key=M73CER01XHDY upload=XUDQ6TX3O23J tag=1O038KM3SVK7 type=write size=1327671 2024-09-14T10:51:28.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.549+0000 7f19187cc780 1 < completed delete operation key=61O2VU0SB379 tag=5B6DK951LD42 type=del 2024-09-14T10:51:28.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.551+0000 7f19187cc780 1 > prepared operation key=QBMNYNWOLK4I tag=NELC8SR6RBQL type=del size=236868 2024-09-14T10:51:28.552 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.554+0000 7f19187cc780 1 < suggested remove operation key=MFA30GSMCSKP tag=L38R80AI7WOZ type=write 2024-09-14T10:51:28.555 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.557+0000 7f19187cc780 1 > prepared part key=_multipart_YA3DI7N4DG5K.2~5PXU12Z1RQXW.0 size=1048576 2024-09-14T10:51:28.556 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.558+0000 7f19187cc780 1 > prepared part key=_multipart_YA3DI7N4DG5K.2~5PXU12Z1RQXW.1 size=1048576 2024-09-14T10:51:28.557 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.559+0000 7f19187cc780 1 > prepared part key=_multipart_YA3DI7N4DG5K.2~5PXU12Z1RQXW.2 size=946457 2024-09-14T10:51:28.558 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.559+0000 7f19187cc780 1 > prepared multipart upload key=YA3DI7N4DG5K upload=5PXU12Z1RQXW tag=YIVOP4O33D1A type=write size=4092185 2024-09-14T10:51:28.559 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.561+0000 7f19187cc780 1 < completed delete operation key=9EBD5ZT6MT45 tag=AMRQZYKQI19Y type=del 2024-09-14T10:51:28.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.564+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~3S83XFFYUMUJ.0 size=911750 2024-09-14T10:51:28.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.564+0000 7f19187cc780 1 > prepared multipart upload key=AGNUE76X8XCJ upload=3S83XFFYUMUJ tag=CRU8FV4V6688 type=write size=1960326 2024-09-14T10:51:28.564 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.565+0000 7f19187cc780 1 < completed delete operation key=N0L67LS2KHR1 tag=AX3EGC1L390B type=del 2024-09-14T10:51:28.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.567+0000 7f19187cc780 1 > prepared operation key=EL00Y4Z7DTAT tag=JSOK8M8LLFWU type=del size=3410710 2024-09-14T10:51:28.567 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.569+0000 7f19187cc780 1 < completed delete operation key=KOJ7QB7M6A35 tag=CMKLWCTHLL58 type=del 2024-09-14T10:51:28.570 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.572+0000 7f19187cc780 1 > prepared part key=_multipart_QBMNYNWOLK4I.2~A9OI3CH8HPQP.0 size=269290 2024-09-14T10:51:28.570 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.572+0000 7f19187cc780 1 > prepared multipart upload key=QBMNYNWOLK4I upload=A9OI3CH8HPQP tag=R3D0VGHMWG8F type=write size=1317866 2024-09-14T10:51:28.572 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.573+0000 7f19187cc780 1 < completed part key=_multipart_EZLSMEK89N2G.2~ID9V26QK9014.0 size=1048576 2024-09-14T10:51:28.573 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.575+0000 7f19187cc780 1 < completed part key=_multipart_EZLSMEK89N2G.2~ID9V26QK9014.1 size=1048576 2024-09-14T10:51:28.574 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.576+0000 7f19187cc780 1 < completed part key=_multipart_EZLSMEK89N2G.2~ID9V26QK9014.2 size=647132 2024-09-14T10:51:28.577 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.578+0000 7f19187cc780 1 < completed multipart upload key=EZLSMEK89N2G upload=ID9V26QK9014 tag=P0AD1XRPCWSQ type=write size=3792860 2024-09-14T10:51:28.578 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.580+0000 7f19187cc780 1 > prepared operation key=9EBD5ZT6MT45 tag=D6AGCLDZVN9K type=write size=939584 2024-09-14T10:51:28.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.582+0000 7f19187cc780 1 < completed delete operation key=RTGE7ISETJWW tag=6KCFHAPWJ10M type=del 2024-09-14T10:51:28.582 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.583+0000 7f19187cc780 1 > prepared operation key=AGNUE76X8XCJ tag=ZYBSFMQSWXLD type=del size=2350091 2024-09-14T10:51:28.583 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.585+0000 7f19187cc780 1 < completed delete operation key=M73CER01XHDY tag=5RP52W8Z792A type=del 2024-09-14T10:51:28.585 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.587+0000 7f19187cc780 1 > prepared operation key=E6UO1LUWOC44 tag=RE9A48SWN22D type=del size=1457235 2024-09-14T10:51:28.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.588+0000 7f19187cc780 1 < completed write operation key=61O2VU0SB379 tag=RLFKDZ6ZIIYQ type=write size=970823 2024-09-14T10:51:28.589 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.591+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~G90DX9OL534M.0 size=1048576 2024-09-14T10:51:28.590 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.592+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~G90DX9OL534M.1 size=538672 2024-09-14T10:51:28.590 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.592+0000 7f19187cc780 1 > prepared multipart upload key=6BNN842ZTWG5 upload=G90DX9OL534M tag=N5I4XXE0Y6K1 type=write size=2635824 2024-09-14T10:51:28.592 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.593+0000 7f19187cc780 1 < completed delete operation key=AGNUE76X8XCJ tag=0WJUWW4VUZTV type=del 2024-09-14T10:51:28.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.595+0000 7f19187cc780 1 > prepared operation key=5AIAYJMRZGFQ tag=G7I4KLK5S433 type=del size=4047159 2024-09-14T10:51:28.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.597+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~LXUZI4PCKMM9.0 size=532497 2024-09-14T10:51:28.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.599+0000 7f19187cc780 1 < completed multipart upload key=IKVYA4KEALFF upload=LXUZI4PCKMM9 tag=KC4OK0Y6X0SD type=write size=1581073 2024-09-14T10:51:28.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.602+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~QFYMRJ1JQZJU.0 size=1048576 2024-09-14T10:51:28.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.603+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~QFYMRJ1JQZJU.1 size=36935 2024-09-14T10:51:28.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.603+0000 7f19187cc780 1 > prepared multipart upload key=KOJ7QB7M6A35 upload=QFYMRJ1JQZJU tag=ZYRQNXNA6VV2 type=write size=2134087 2024-09-14T10:51:28.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.604+0000 7f19187cc780 1 < completed delete operation key=61O2VU0SB379 tag=EQTONJJYTN0A type=del 2024-09-14T10:51:28.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.607+0000 7f19187cc780 1 > prepared part key=_multipart_54BSD3DEHNK6.2~Z9HBUEHLMVA7.0 size=412542 2024-09-14T10:51:28.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.607+0000 7f19187cc780 1 > prepared multipart upload key=54BSD3DEHNK6 upload=Z9HBUEHLMVA7 tag=XSH13EJUTD0D type=write size=1461118 2024-09-14T10:51:28.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.608+0000 7f19187cc780 1 < completed delete operation key=VW6U36JN2DBX tag=ASLHQ3SEFJ5O type=del 2024-09-14T10:51:28.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.610+0000 7f19187cc780 1 > prepared operation key=N0L67LS2KHR1 tag=4K81CCL1Q71B type=del size=3542777 2024-09-14T10:51:28.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.611+0000 7f19187cc780 1 < completed part key=_multipart_54BSD3DEHNK6.2~YTSKJCAS9OK5.0 size=1048576 2024-09-14T10:51:28.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.612+0000 7f19187cc780 1 < completed part key=_multipart_54BSD3DEHNK6.2~YTSKJCAS9OK5.1 size=1048576 2024-09-14T10:51:28.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.613+0000 7f19187cc780 1 < completed part key=_multipart_54BSD3DEHNK6.2~YTSKJCAS9OK5.2 size=22120 2024-09-14T10:51:28.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.616+0000 7f19187cc780 1 < completed multipart upload key=54BSD3DEHNK6 upload=YTSKJCAS9OK5 tag=PV2WF3FOU5T5 type=write size=3167848 2024-09-14T10:51:28.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.618+0000 7f19187cc780 1 > prepared operation key=EL00Y4Z7DTAT tag=W2NVK68LICOH type=del size=4003449 2024-09-14T10:51:28.618 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.619+0000 7f19187cc780 1 < completed delete operation key=EL00Y4Z7DTAT tag=GL14LE0UZD5M type=del 2024-09-14T10:51:28.619 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.621+0000 7f19187cc780 1 > prepared operation key=75O00VMLJJ1X tag=CGKV5HEIM8I1 type=del size=1847769 2024-09-14T10:51:28.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.623+0000 7f19187cc780 1 < completed part key=_multipart_M73CER01XHDY.2~XUDQ6TX3O23J.0 size=279095 2024-09-14T10:51:28.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.625+0000 7f19187cc780 1 < completed multipart upload key=M73CER01XHDY upload=XUDQ6TX3O23J tag=1O038KM3SVK7 type=write size=1327671 2024-09-14T10:51:28.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.626+0000 7f19187cc780 1 > prepared operation key=KP3WOGIF30PZ tag=7X1SH0QVXHHT type=write size=544355 2024-09-14T10:51:28.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.628+0000 7f19187cc780 1 < canceled operation key=QBMNYNWOLK4I tag=NELC8SR6RBQL type=del size=236868 2024-09-14T10:51:28.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.630+0000 7f19187cc780 1 > prepared operation key=E6UO1LUWOC44 tag=AD8SH4YMOLWU type=del size=2117972 2024-09-14T10:51:28.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.631+0000 7f19187cc780 1 < completed part key=_multipart_YA3DI7N4DG5K.2~5PXU12Z1RQXW.0 size=1048576 2024-09-14T10:51:28.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.633+0000 7f19187cc780 1 < completed part key=_multipart_YA3DI7N4DG5K.2~5PXU12Z1RQXW.1 size=1048576 2024-09-14T10:51:28.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.634+0000 7f19187cc780 1 < completed part key=_multipart_YA3DI7N4DG5K.2~5PXU12Z1RQXW.2 size=946457 2024-09-14T10:51:28.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.637+0000 7f19187cc780 1 < completed multipart upload key=YA3DI7N4DG5K upload=5PXU12Z1RQXW tag=YIVOP4O33D1A type=write size=4092185 2024-09-14T10:51:28.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.640+0000 7f19187cc780 1 > prepared part key=_multipart_INJQTKXHBUV2.2~GQFSJCDDCNXO.0 size=1048576 2024-09-14T10:51:28.639 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.641+0000 7f19187cc780 1 > prepared part key=_multipart_INJQTKXHBUV2.2~GQFSJCDDCNXO.1 size=1048576 2024-09-14T10:51:28.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.642+0000 7f19187cc780 1 > prepared part key=_multipart_INJQTKXHBUV2.2~GQFSJCDDCNXO.2 size=881358 2024-09-14T10:51:28.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.642+0000 7f19187cc780 1 > prepared multipart upload key=INJQTKXHBUV2 upload=GQFSJCDDCNXO tag=XT1D9GE0R99S type=write size=4027086 2024-09-14T10:51:28.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.644+0000 7f19187cc780 1 < completed part key=_multipart_AGNUE76X8XCJ.2~3S83XFFYUMUJ.0 size=911750 2024-09-14T10:51:28.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.646+0000 7f19187cc780 1 < completed multipart upload key=AGNUE76X8XCJ upload=3S83XFFYUMUJ tag=CRU8FV4V6688 type=write size=1960326 2024-09-14T10:51:28.647 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.648+0000 7f19187cc780 1 > prepared operation key=QBMNYNWOLK4I tag=D30ZCCIFTOCU type=del size=3975333 2024-09-14T10:51:28.648 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.650+0000 7f19187cc780 1 < completed delete operation key=EL00Y4Z7DTAT tag=JSOK8M8LLFWU type=del 2024-09-14T10:51:28.651 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.653+0000 7f19187cc780 1 > prepared part key=_multipart_19P3WE6HKJH2.2~FV7E1RWBZ13J.0 size=535587 2024-09-14T10:51:28.651 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.653+0000 7f19187cc780 1 > prepared multipart upload key=19P3WE6HKJH2 upload=FV7E1RWBZ13J tag=DNEB9VN5X322 type=write size=1584163 2024-09-14T10:51:28.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.654+0000 7f19187cc780 1 < completed part key=_multipart_QBMNYNWOLK4I.2~A9OI3CH8HPQP.0 size=269290 2024-09-14T10:51:28.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.656+0000 7f19187cc780 1 < completed multipart upload key=QBMNYNWOLK4I upload=A9OI3CH8HPQP tag=R3D0VGHMWG8F type=write size=1317866 2024-09-14T10:51:28.656 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.658+0000 7f19187cc780 1 > prepared operation key=75O00VMLJJ1X tag=0SMXVSCFMIH8 type=del size=2074429 2024-09-14T10:51:28.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.661+0000 7f19187cc780 1 < suggested remove operation key=9EBD5ZT6MT45 tag=D6AGCLDZVN9K type=write 2024-09-14T10:51:28.661 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.662+0000 7f19187cc780 1 > prepared operation key=MFA30GSMCSKP tag=OKH6ZF9YXKPU type=del size=1453920 2024-09-14T10:51:28.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.664+0000 7f19187cc780 1 < completed delete operation key=AGNUE76X8XCJ tag=ZYBSFMQSWXLD type=del 2024-09-14T10:51:28.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.665+0000 7f19187cc780 1 > prepared operation key=B9FQYIX19AEP tag=HAQ6EJYC3INR type=write size=741071 2024-09-14T10:51:28.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.666+0000 7f19187cc780 1 < completed delete operation key=E6UO1LUWOC44 tag=RE9A48SWN22D type=del 2024-09-14T10:51:28.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.669+0000 7f19187cc780 1 > prepared part key=_multipart_61O2VU0SB379.2~KLLSIS065CTH.0 size=262117 2024-09-14T10:51:28.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.669+0000 7f19187cc780 1 > prepared multipart upload key=61O2VU0SB379 upload=KLLSIS065CTH tag=QVNLCZ38HMAP type=write size=1310693 2024-09-14T10:51:28.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.670+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~G90DX9OL534M.0 size=1048576 2024-09-14T10:51:28.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.671+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~G90DX9OL534M.1 size=538672 2024-09-14T10:51:28.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.674+0000 7f19187cc780 1 < completed multipart upload key=6BNN842ZTWG5 upload=G90DX9OL534M tag=N5I4XXE0Y6K1 type=write size=2635824 2024-09-14T10:51:28.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.675+0000 7f19187cc780 1 > prepared operation key=61O2VU0SB379 tag=G9LQDRAXD8LU type=del size=2276837 2024-09-14T10:51:28.675 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.676+0000 7f19187cc780 1 < completed delete operation key=5AIAYJMRZGFQ tag=G7I4KLK5S433 type=del 2024-09-14T10:51:28.676 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.678+0000 7f19187cc780 1 > prepared operation key=75O00VMLJJ1X tag=REATMWG6Q57D type=del size=2414098 2024-09-14T10:51:28.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.679+0000 7f19187cc780 1 < completed part key=_multipart_KOJ7QB7M6A35.2~QFYMRJ1JQZJU.0 size=1048576 2024-09-14T10:51:28.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.681+0000 7f19187cc780 1 < completed part key=_multipart_KOJ7QB7M6A35.2~QFYMRJ1JQZJU.1 size=36935 2024-09-14T10:51:28.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.683+0000 7f19187cc780 1 < completed multipart upload key=KOJ7QB7M6A35 upload=QFYMRJ1JQZJU tag=ZYRQNXNA6VV2 type=write size=2134087 2024-09-14T10:51:28.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.685+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~XLLU6VKNML2S.0 size=352994 2024-09-14T10:51:28.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.685+0000 7f19187cc780 1 > prepared multipart upload key=VW6U36JN2DBX upload=XLLU6VKNML2S tag=0HRNX3QAKLJ1 type=write size=1401570 2024-09-14T10:51:28.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.687+0000 7f19187cc780 1 < completed part key=_multipart_54BSD3DEHNK6.2~Z9HBUEHLMVA7.0 size=412542 2024-09-14T10:51:28.688 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.689+0000 7f19187cc780 1 < completed multipart upload key=54BSD3DEHNK6 upload=Z9HBUEHLMVA7 tag=XSH13EJUTD0D type=write size=1461118 2024-09-14T10:51:28.689 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.691+0000 7f19187cc780 1 > prepared operation key=EZLSMEK89N2G tag=J2XSNC7RR56S type=del size=3961161 2024-09-14T10:51:28.690 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.692+0000 7f19187cc780 1 < completed delete operation key=N0L67LS2KHR1 tag=4K81CCL1Q71B type=del 2024-09-14T10:51:28.693 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.695+0000 7f19187cc780 1 > prepared part key=_multipart_61O2VU0SB379.2~EV9INZU1HXPK.0 size=1048576 2024-09-14T10:51:28.694 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.696+0000 7f19187cc780 1 > prepared part key=_multipart_61O2VU0SB379.2~EV9INZU1HXPK.1 size=89526 2024-09-14T10:51:28.694 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.696+0000 7f19187cc780 1 > prepared multipart upload key=61O2VU0SB379 upload=EV9INZU1HXPK tag=Y1UZBIXH1VKX type=write size=2186678 2024-09-14T10:51:28.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.698+0000 7f19187cc780 1 < suggested update operation key=EL00Y4Z7DTAT tag=W2NVK68LICOH type=del size=4003449 2024-09-14T10:51:28.698 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.700+0000 7f19187cc780 1 > prepared operation key=75O00VMLJJ1X tag=2GW3NBFA1FVV type=write size=541745 2024-09-14T10:51:28.699 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.701+0000 7f19187cc780 1 < completed delete operation key=75O00VMLJJ1X tag=CGKV5HEIM8I1 type=del 2024-09-14T10:51:28.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.702+0000 7f19187cc780 1 > prepared operation key=75O00VMLJJ1X tag=DT8ZO0Y3EBTP type=del size=3932191 2024-09-14T10:51:28.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.704+0000 7f19187cc780 1 < completed write operation key=KP3WOGIF30PZ tag=7X1SH0QVXHHT type=write size=544355 2024-09-14T10:51:28.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.705+0000 7f19187cc780 1 > prepared operation key=IKVYA4KEALFF tag=ZOTW22B6BL39 type=write size=435890 2024-09-14T10:51:28.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.708+0000 7f19187cc780 1 < suggested remove operation key=E6UO1LUWOC44 tag=AD8SH4YMOLWU type=del 2024-09-14T10:51:28.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.710+0000 7f19187cc780 1 > prepared operation key=XCVE2F2JJK4X tag=M329BMW9WA9V type=del size=3534067 2024-09-14T10:51:28.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.711+0000 7f19187cc780 1 < completed part key=_multipart_INJQTKXHBUV2.2~GQFSJCDDCNXO.0 size=1048576 2024-09-14T10:51:28.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.712+0000 7f19187cc780 1 < completed part key=_multipart_INJQTKXHBUV2.2~GQFSJCDDCNXO.1 size=1048576 2024-09-14T10:51:28.712 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.713+0000 7f19187cc780 1 < completed part key=_multipart_INJQTKXHBUV2.2~GQFSJCDDCNXO.2 size=881358 2024-09-14T10:51:28.714 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.716+0000 7f19187cc780 1 < completed multipart upload key=INJQTKXHBUV2 upload=GQFSJCDDCNXO tag=XT1D9GE0R99S type=write size=4027086 2024-09-14T10:51:28.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.717+0000 7f19187cc780 1 > prepared operation key=61O2VU0SB379 tag=1HPU2FYBHA22 type=write size=24279 2024-09-14T10:51:28.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.719+0000 7f19187cc780 1 < canceled operation key=QBMNYNWOLK4I tag=D30ZCCIFTOCU type=del size=3975333 2024-09-14T10:51:28.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.721+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~I9XDZDDC8YWZ.0 size=1048576 2024-09-14T10:51:28.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.723+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~I9XDZDDC8YWZ.1 size=1048576 2024-09-14T10:51:28.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.724+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~I9XDZDDC8YWZ.2 size=817264 2024-09-14T10:51:28.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.724+0000 7f19187cc780 1 > prepared multipart upload key=B9FQYIX19AEP upload=I9XDZDDC8YWZ tag=PPJ147GBGSDS type=write size=3962992 2024-09-14T10:51:28.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.724+0000 7f19187cc780 1 < canceled part key=_multipart_19P3WE6HKJH2.2~FV7E1RWBZ13J.0 size=535587 2024-09-14T10:51:28.726 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.727+0000 7f19187cc780 1 < canceled multipart upload key=19P3WE6HKJH2 upload=FV7E1RWBZ13J tag=DNEB9VN5X322 type=write size=1584163 2024-09-14T10:51:28.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.730+0000 7f19187cc780 1 > prepared part key=_multipart_617QQI921HB4.2~1YXRVOYBOINJ.0 size=1048576 2024-09-14T10:51:28.730 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.732+0000 7f19187cc780 1 > prepared part key=_multipart_617QQI921HB4.2~1YXRVOYBOINJ.1 size=1048576 2024-09-14T10:51:28.731 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.733+0000 7f19187cc780 1 > prepared part key=_multipart_617QQI921HB4.2~1YXRVOYBOINJ.2 size=573812 2024-09-14T10:51:28.731 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.733+0000 7f19187cc780 1 > prepared multipart upload key=617QQI921HB4 upload=1YXRVOYBOINJ tag=96QB5T9XOI0Q type=write size=3719540 2024-09-14T10:51:28.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.735+0000 7f19187cc780 1 < completed delete operation key=75O00VMLJJ1X tag=0SMXVSCFMIH8 type=del 2024-09-14T10:51:28.735 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.736+0000 7f19187cc780 1 > prepared operation key=H40763V7HMBC tag=FFN1Z0NPF47U type=del size=3925550 2024-09-14T10:51:28.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.738+0000 7f19187cc780 1 < completed delete operation key=MFA30GSMCSKP tag=OKH6ZF9YXKPU type=del 2024-09-14T10:51:28.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.739+0000 7f19187cc780 1 > prepared operation key=E6UO1LUWOC44 tag=RMR7X1W9FQB5 type=write size=163206 2024-09-14T10:51:28.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.741+0000 7f19187cc780 1 < completed write operation key=B9FQYIX19AEP tag=HAQ6EJYC3INR type=write size=741071 2024-09-14T10:51:28.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.743+0000 7f19187cc780 1 > prepared operation key=INJQTKXHBUV2 tag=9XGMESI1AMSK type=del size=1748400 2024-09-14T10:51:28.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.744+0000 7f19187cc780 1 < completed part key=_multipart_61O2VU0SB379.2~KLLSIS065CTH.0 size=262117 2024-09-14T10:51:28.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.746+0000 7f19187cc780 1 < completed multipart upload key=61O2VU0SB379 upload=KLLSIS065CTH tag=QVNLCZ38HMAP type=write size=1310693 2024-09-14T10:51:28.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.748+0000 7f19187cc780 1 > prepared operation key=61O2VU0SB379 tag=QYLVH55T7KDC type=del size=1121257 2024-09-14T10:51:28.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.750+0000 7f19187cc780 1 < suggested remove operation key=61O2VU0SB379 tag=G9LQDRAXD8LU type=del 2024-09-14T10:51:28.750 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.752+0000 7f19187cc780 1 > prepared operation key=XCVE2F2JJK4X tag=Y8QW4RZYAUV3 type=del size=1614845 2024-09-14T10:51:28.753 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.755+0000 7f19187cc780 1 < suggested remove operation key=75O00VMLJJ1X tag=REATMWG6Q57D type=del 2024-09-14T10:51:28.756 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.758+0000 7f19187cc780 1 > prepared part key=_multipart_75O00VMLJJ1X.2~TQ0G45BSTDWM.0 size=371638 2024-09-14T10:51:28.756 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.758+0000 7f19187cc780 1 > prepared multipart upload key=75O00VMLJJ1X upload=TQ0G45BSTDWM tag=GLXL1WICX7PW type=write size=1420214 2024-09-14T10:51:28.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.759+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~XLLU6VKNML2S.0 size=352994 2024-09-14T10:51:28.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.761+0000 7f19187cc780 1 < completed multipart upload key=VW6U36JN2DBX upload=XLLU6VKNML2S tag=0HRNX3QAKLJ1 type=write size=1401570 2024-09-14T10:51:28.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.763+0000 7f19187cc780 1 > prepared operation key=INJQTKXHBUV2 tag=M2Z2O5HRFYCJ type=del size=1279909 2024-09-14T10:51:28.763 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.764+0000 7f19187cc780 1 < completed delete operation key=EZLSMEK89N2G tag=J2XSNC7RR56S type=del 2024-09-14T10:51:28.764 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.766+0000 7f19187cc780 1 > prepared operation key=W1K1IU13J0CZ tag=XQPSXFU36NB9 type=del size=3015515 2024-09-14T10:51:28.766 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.767+0000 7f19187cc780 1 < completed part key=_multipart_61O2VU0SB379.2~EV9INZU1HXPK.0 size=1048576 2024-09-14T10:51:28.766 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.768+0000 7f19187cc780 1 < completed part key=_multipart_61O2VU0SB379.2~EV9INZU1HXPK.1 size=89526 2024-09-14T10:51:28.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.770+0000 7f19187cc780 1 < completed multipart upload key=61O2VU0SB379 upload=EV9INZU1HXPK tag=Y1UZBIXH1VKX type=write size=2186678 2024-09-14T10:51:28.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.773+0000 7f19187cc780 1 > prepared part key=_multipart_9EBD5ZT6MT45.2~KN53ZAPIKVNQ.0 size=1048576 2024-09-14T10:51:28.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.774+0000 7f19187cc780 1 > prepared part key=_multipart_9EBD5ZT6MT45.2~KN53ZAPIKVNQ.1 size=1048576 2024-09-14T10:51:28.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.775+0000 7f19187cc780 1 > prepared part key=_multipart_9EBD5ZT6MT45.2~KN53ZAPIKVNQ.2 size=799303 2024-09-14T10:51:28.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.775+0000 7f19187cc780 1 > prepared multipart upload key=9EBD5ZT6MT45 upload=KN53ZAPIKVNQ tag=E0AM9JWVIBPI type=write size=3945031 2024-09-14T10:51:28.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.776+0000 7f19187cc780 -1 < no bi entry to suggest for operation key=75O00VMLJJ1X tag=2GW3NBFA1FVV type=write size=541745: (2) No such file or directory 2024-09-14T10:51:28.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.779+0000 7f19187cc780 1 > prepared part key=_multipart_QFEI6H4EQ9ZR.2~ZTEN9XJ0XJZS.0 size=1048576 2024-09-14T10:51:28.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.780+0000 7f19187cc780 1 > prepared part key=_multipart_QFEI6H4EQ9ZR.2~ZTEN9XJ0XJZS.1 size=1048576 2024-09-14T10:51:28.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.781+0000 7f19187cc780 1 > prepared part key=_multipart_QFEI6H4EQ9ZR.2~ZTEN9XJ0XJZS.2 size=409443 2024-09-14T10:51:28.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.781+0000 7f19187cc780 1 > prepared multipart upload key=QFEI6H4EQ9ZR upload=ZTEN9XJ0XJZS tag=2VVXX120G39T type=write size=3555171 2024-09-14T10:51:28.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.781+0000 7f19187cc780 -1 < no bi entry to suggest for operation key=75O00VMLJJ1X tag=DT8ZO0Y3EBTP type=del size=3932191: (2) No such file or directory 2024-09-14T10:51:28.781 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.783+0000 7f19187cc780 1 > prepared operation key=KOJ7QB7M6A35 tag=EG2GH6SFIR3G type=del size=688745 2024-09-14T10:51:28.783 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.784+0000 7f19187cc780 1 < completed write operation key=IKVYA4KEALFF tag=ZOTW22B6BL39 type=write size=435890 2024-09-14T10:51:28.784 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.786+0000 7f19187cc780 1 > prepared operation key=KP3WOGIF30PZ tag=2CTDWHETLNMO type=del size=3441314 2024-09-14T10:51:28.786 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.787+0000 7f19187cc780 1 < completed delete operation key=XCVE2F2JJK4X tag=M329BMW9WA9V type=del 2024-09-14T10:51:28.788 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.790+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~AVK5JOFM0K6G.0 size=1048576 2024-09-14T10:51:28.789 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.791+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~AVK5JOFM0K6G.1 size=1048576 2024-09-14T10:51:28.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.792+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~AVK5JOFM0K6G.2 size=317896 2024-09-14T10:51:28.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.792+0000 7f19187cc780 1 > prepared multipart upload key=OVOPGTYUF3F3 upload=AVK5JOFM0K6G tag=UJTKZJS6H7KU type=write size=3463624 2024-09-14T10:51:28.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.793+0000 7f19187cc780 -1 < failed to complete operation key=61O2VU0SB379 tag=1HPU2FYBHA22 type=write size=24279: (22) Invalid argument 2024-09-14T10:51:28.794 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.796+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~LRUPPA2FJC3W.0 size=1048576 2024-09-14T10:51:28.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.797+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~LRUPPA2FJC3W.1 size=925561 2024-09-14T10:51:28.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.797+0000 7f19187cc780 1 > prepared multipart upload key=IKVYA4KEALFF upload=LRUPPA2FJC3W tag=5XUG9W0NUVG3 type=write size=3022713 2024-09-14T10:51:28.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.800+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~I9XDZDDC8YWZ.0 size=1048576 2024-09-14T10:51:28.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.801+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~I9XDZDDC8YWZ.1 size=1048576 2024-09-14T10:51:28.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.802+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~I9XDZDDC8YWZ.2 size=817264 2024-09-14T10:51:28.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.804+0000 7f19187cc780 1 < completed multipart upload key=B9FQYIX19AEP upload=I9XDZDDC8YWZ tag=PPJ147GBGSDS type=write size=3962992 2024-09-14T10:51:28.805 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.807+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~GYOKT63KUBR2.0 size=1048576 2024-09-14T10:51:28.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.808+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~GYOKT63KUBR2.1 size=1048576 2024-09-14T10:51:28.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.809+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~GYOKT63KUBR2.2 size=165753 2024-09-14T10:51:28.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.809+0000 7f19187cc780 1 > prepared multipart upload key=KOJ7QB7M6A35 upload=GYOKT63KUBR2 tag=44CVR55MER0Z type=write size=3311481 2024-09-14T10:51:28.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.811+0000 7f19187cc780 1 < completed part key=_multipart_617QQI921HB4.2~1YXRVOYBOINJ.0 size=1048576 2024-09-14T10:51:28.810 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.812+0000 7f19187cc780 1 < completed part key=_multipart_617QQI921HB4.2~1YXRVOYBOINJ.1 size=1048576 2024-09-14T10:51:28.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.813+0000 7f19187cc780 1 < completed part key=_multipart_617QQI921HB4.2~1YXRVOYBOINJ.2 size=573812 2024-09-14T10:51:28.814 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.815+0000 7f19187cc780 1 < completed multipart upload key=617QQI921HB4 upload=1YXRVOYBOINJ tag=96QB5T9XOI0Q type=write size=3719540 2024-09-14T10:51:28.815 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.817+0000 7f19187cc780 1 > prepared operation key=H40763V7HMBC tag=RC7KJ6LQLWQY type=del size=1950819 2024-09-14T10:51:28.817 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.818+0000 7f19187cc780 1 < completed delete operation key=H40763V7HMBC tag=FFN1Z0NPF47U type=del 2024-09-14T10:51:28.818 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.820+0000 7f19187cc780 1 > prepared operation key=617QQI921HB4 tag=KO88X1SOROGS type=del size=1600606 2024-09-14T10:51:28.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.823+0000 7f19187cc780 1 < suggested remove operation key=E6UO1LUWOC44 tag=RMR7X1W9FQB5 type=write 2024-09-14T10:51:28.822 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.824+0000 7f19187cc780 1 > prepared operation key=61O2VU0SB379 tag=6SP6BRHW32AF type=del size=3668908 2024-09-14T10:51:28.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.826+0000 7f19187cc780 1 < completed delete operation key=INJQTKXHBUV2 tag=9XGMESI1AMSK type=del 2024-09-14T10:51:28.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.828+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~6VC2HPPBC06T.0 size=603437 2024-09-14T10:51:28.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.828+0000 7f19187cc780 1 > prepared multipart upload key=IKVYA4KEALFF upload=6VC2HPPBC06T tag=LZO1K5HXVKLL type=write size=1652013 2024-09-14T10:51:28.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.829+0000 7f19187cc780 -1 < failed to complete operation key=61O2VU0SB379 tag=QYLVH55T7KDC type=del size=1121257: (22) Invalid argument 2024-09-14T10:51:28.829 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.830+0000 7f19187cc780 1 > prepared operation key=OVOPGTYUF3F3 tag=KAX6WPOBBUXX type=del size=3856291 2024-09-14T10:51:28.830 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.832+0000 7f19187cc780 1 < completed delete operation key=XCVE2F2JJK4X tag=Y8QW4RZYAUV3 type=del 2024-09-14T10:51:28.832 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.833+0000 7f19187cc780 1 > prepared operation key=AST81B9QWORT tag=E7NZE3RCB1HC type=del size=3510963 2024-09-14T10:51:28.833 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.835+0000 7f19187cc780 1 < completed part key=_multipart_75O00VMLJJ1X.2~TQ0G45BSTDWM.0 size=371638 2024-09-14T10:51:28.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.837+0000 7f19187cc780 1 < completed multipart upload key=75O00VMLJJ1X upload=TQ0G45BSTDWM tag=GLXL1WICX7PW type=write size=1420214 2024-09-14T10:51:28.837 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.838+0000 7f19187cc780 1 > prepared operation key=OVOPGTYUF3F3 tag=F912KIDY5QQG type=del size=1319539 2024-09-14T10:51:28.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.841+0000 7f19187cc780 1 < suggested update operation key=INJQTKXHBUV2 tag=M2Z2O5HRFYCJ type=del size=1279909 2024-09-14T10:51:28.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.843+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~8Y7XOU3Q2C82.0 size=18662 2024-09-14T10:51:28.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.843+0000 7f19187cc780 1 > prepared multipart upload key=KOJ7QB7M6A35 upload=8Y7XOU3Q2C82 tag=3DJRQGQN5M1F type=write size=1067238 2024-09-14T10:51:28.844 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.846+0000 7f19187cc780 1 < suggested update operation key=W1K1IU13J0CZ tag=XQPSXFU36NB9 type=del size=3015515 2024-09-14T10:51:28.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.848+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~K5BY4L1AIK11.0 size=1048576 2024-09-14T10:51:28.848 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.850+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~K5BY4L1AIK11.1 size=591513 2024-09-14T10:51:28.848 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.850+0000 7f19187cc780 1 > prepared multipart upload key=KP3WOGIF30PZ upload=K5BY4L1AIK11 tag=GFJXEONAX6E8 type=write size=2688665 2024-09-14T10:51:28.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.851+0000 7f19187cc780 1 < completed part key=_multipart_9EBD5ZT6MT45.2~KN53ZAPIKVNQ.0 size=1048576 2024-09-14T10:51:28.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.853+0000 7f19187cc780 1 < completed part key=_multipart_9EBD5ZT6MT45.2~KN53ZAPIKVNQ.1 size=1048576 2024-09-14T10:51:28.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.854+0000 7f19187cc780 1 < completed part key=_multipart_9EBD5ZT6MT45.2~KN53ZAPIKVNQ.2 size=799303 2024-09-14T10:51:28.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.856+0000 7f19187cc780 1 < completed multipart upload key=9EBD5ZT6MT45 upload=KN53ZAPIKVNQ tag=E0AM9JWVIBPI type=write size=3945031 2024-09-14T10:51:28.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.858+0000 7f19187cc780 1 > prepared operation key=RTGE7ISETJWW tag=RSUICSPZQA5K type=write size=708078 2024-09-14T10:51:28.858 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.860+0000 7f19187cc780 1 < completed part key=_multipart_QFEI6H4EQ9ZR.2~ZTEN9XJ0XJZS.0 size=1048576 2024-09-14T10:51:28.859 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.861+0000 7f19187cc780 1 < completed part key=_multipart_QFEI6H4EQ9ZR.2~ZTEN9XJ0XJZS.1 size=1048576 2024-09-14T10:51:28.861 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.862+0000 7f19187cc780 1 < completed part key=_multipart_QFEI6H4EQ9ZR.2~ZTEN9XJ0XJZS.2 size=409443 2024-09-14T10:51:28.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.865+0000 7f19187cc780 1 < completed multipart upload key=QFEI6H4EQ9ZR upload=ZTEN9XJ0XJZS tag=2VVXX120G39T type=write size=3555171 2024-09-14T10:51:28.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.867+0000 7f19187cc780 1 > prepared operation key=H40763V7HMBC tag=9QQR446C770G type=del size=523532 2024-09-14T10:51:28.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.869+0000 7f19187cc780 1 < completed delete operation key=KOJ7QB7M6A35 tag=EG2GH6SFIR3G type=del 2024-09-14T10:51:28.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.872+0000 7f19187cc780 1 > prepared part key=_multipart_W1K1IU13J0CZ.2~C6ALC99J6F4R.0 size=1048576 2024-09-14T10:51:28.871 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.873+0000 7f19187cc780 1 > prepared part key=_multipart_W1K1IU13J0CZ.2~C6ALC99J6F4R.1 size=1048576 2024-09-14T10:51:28.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.874+0000 7f19187cc780 1 > prepared part key=_multipart_W1K1IU13J0CZ.2~C6ALC99J6F4R.2 size=739512 2024-09-14T10:51:28.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.874+0000 7f19187cc780 1 > prepared multipart upload key=W1K1IU13J0CZ upload=C6ALC99J6F4R tag=0A3Y96IVKIA9 type=write size=3885240 2024-09-14T10:51:28.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.877+0000 7f19187cc780 1 < suggested update operation key=KP3WOGIF30PZ tag=2CTDWHETLNMO type=del size=3441314 2024-09-14T10:51:28.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.879+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~QAV3KPQR2HOG.0 size=1048576 2024-09-14T10:51:28.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.880+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~QAV3KPQR2HOG.1 size=229002 2024-09-14T10:51:28.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.880+0000 7f19187cc780 1 > prepared multipart upload key=OVOPGTYUF3F3 upload=QAV3KPQR2HOG tag=EZCGPM4AIHKS type=write size=2326154 2024-09-14T10:51:28.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.882+0000 7f19187cc780 1 < completed part key=_multipart_OVOPGTYUF3F3.2~AVK5JOFM0K6G.0 size=1048576 2024-09-14T10:51:28.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.883+0000 7f19187cc780 1 < completed part key=_multipart_OVOPGTYUF3F3.2~AVK5JOFM0K6G.1 size=1048576 2024-09-14T10:51:28.883 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.884+0000 7f19187cc780 1 < completed part key=_multipart_OVOPGTYUF3F3.2~AVK5JOFM0K6G.2 size=317896 2024-09-14T10:51:28.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.887+0000 7f19187cc780 1 < completed multipart upload key=OVOPGTYUF3F3 upload=AVK5JOFM0K6G tag=UJTKZJS6H7KU type=write size=3463624 2024-09-14T10:51:28.886 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.888+0000 7f19187cc780 1 > prepared operation key=AST81B9QWORT tag=JFUK37MBV7OB type=del size=1722792 2024-09-14T10:51:28.888 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.890+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~LRUPPA2FJC3W.0 size=1048576 2024-09-14T10:51:28.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.891+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~LRUPPA2FJC3W.1 size=925561 2024-09-14T10:51:28.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.893+0000 7f19187cc780 1 < completed multipart upload key=IKVYA4KEALFF upload=LRUPPA2FJC3W tag=5XUG9W0NUVG3 type=write size=3022713 2024-09-14T10:51:28.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.896+0000 7f19187cc780 1 > prepared part key=_multipart_YA3DI7N4DG5K.2~8P8YXZK533YI.0 size=394145 2024-09-14T10:51:28.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.896+0000 7f19187cc780 1 > prepared multipart upload key=YA3DI7N4DG5K upload=8P8YXZK533YI tag=KET91LHWMM9B type=write size=1442721 2024-09-14T10:51:28.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.897+0000 7f19187cc780 1 < completed part key=_multipart_KOJ7QB7M6A35.2~GYOKT63KUBR2.0 size=1048576 2024-09-14T10:51:28.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.898+0000 7f19187cc780 1 < completed part key=_multipart_KOJ7QB7M6A35.2~GYOKT63KUBR2.1 size=1048576 2024-09-14T10:51:28.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.898+0000 7f19187cc780 1 < canceled part key=_multipart_KOJ7QB7M6A35.2~GYOKT63KUBR2.2 size=165753 2024-09-14T10:51:28.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.901+0000 7f19187cc780 1 < canceled multipart upload key=KOJ7QB7M6A35 upload=GYOKT63KUBR2 tag=44CVR55MER0Z type=write size=3311481 2024-09-14T10:51:28.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.902+0000 7f19187cc780 1 > prepared operation key=7IWUW2HC3ULI tag=SG7XMI0U4LDK type=write size=290084 2024-09-14T10:51:28.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.905+0000 7f19187cc780 1 < suggested update operation key=H40763V7HMBC tag=RC7KJ6LQLWQY type=del size=1950819 2024-09-14T10:51:28.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.908+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~8KHLLZ1ETK28.0 size=1048576 2024-09-14T10:51:28.907 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.909+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~8KHLLZ1ETK28.1 size=1048576 2024-09-14T10:51:28.908 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.910+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~8KHLLZ1ETK28.2 size=476349 2024-09-14T10:51:28.908 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.910+0000 7f19187cc780 1 > prepared multipart upload key=7IWUW2HC3ULI upload=8KHLLZ1ETK28 tag=I3HENC071E9K type=write size=3622077 2024-09-14T10:51:28.910 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.911+0000 7f19187cc780 1 < completed delete operation key=617QQI921HB4 tag=KO88X1SOROGS type=del 2024-09-14T10:51:28.911 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.913+0000 7f19187cc780 1 > prepared operation key=INJQTKXHBUV2 tag=SVT0KBF0EGZU type=del size=2484716 2024-09-14T10:51:28.913 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.914+0000 7f19187cc780 1 < canceled operation key=61O2VU0SB379 tag=6SP6BRHW32AF type=del size=3668908 2024-09-14T10:51:28.914 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.916+0000 7f19187cc780 1 > prepared operation key=INJQTKXHBUV2 tag=2EKYLH6V52FF type=del size=1645866 2024-09-14T10:51:28.916 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.917+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~6VC2HPPBC06T.0 size=603437 2024-09-14T10:51:28.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.920+0000 7f19187cc780 1 < completed multipart upload key=IKVYA4KEALFF upload=6VC2HPPBC06T tag=LZO1K5HXVKLL type=write size=1652013 2024-09-14T10:51:28.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.921+0000 7f19187cc780 1 > prepared operation key=19P3WE6HKJH2 tag=CK4V1FCEJNVE type=write size=485871 2024-09-14T10:51:28.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.924+0000 7f19187cc780 1 < suggested update operation key=OVOPGTYUF3F3 tag=KAX6WPOBBUXX type=del size=3856291 2024-09-14T10:51:28.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.926+0000 7f19187cc780 1 > prepared part key=_multipart_M73CER01XHDY.2~5ELG34ZYMVAC.0 size=1048576 2024-09-14T10:51:28.926 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.928+0000 7f19187cc780 1 > prepared part key=_multipart_M73CER01XHDY.2~5ELG34ZYMVAC.1 size=819660 2024-09-14T10:51:28.926 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.928+0000 7f19187cc780 1 > prepared multipart upload key=M73CER01XHDY upload=5ELG34ZYMVAC tag=2HRNR0MQQ7LL type=write size=2916812 2024-09-14T10:51:28.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.931+0000 7f19187cc780 1 < suggested update operation key=AST81B9QWORT tag=E7NZE3RCB1HC type=del size=3510963 2024-09-14T10:51:28.930 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.932+0000 7f19187cc780 1 > prepared operation key=5AIAYJMRZGFQ tag=MFMNW8JJCMVZ type=del size=588584 2024-09-14T10:51:28.932 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.933+0000 7f19187cc780 -1 < failed to complete operation key=OVOPGTYUF3F3 tag=F912KIDY5QQG type=del size=1319539: (22) Invalid argument 2024-09-14T10:51:28.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.936+0000 7f19187cc780 1 > prepared part key=_multipart_W1K1IU13J0CZ.2~H1A561LU1M2H.0 size=186304 2024-09-14T10:51:28.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.936+0000 7f19187cc780 1 > prepared multipart upload key=W1K1IU13J0CZ upload=H1A561LU1M2H tag=UUG0VPXIKQWT type=write size=1234880 2024-09-14T10:51:28.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.937+0000 7f19187cc780 1 < completed part key=_multipart_KOJ7QB7M6A35.2~8Y7XOU3Q2C82.0 size=18662 2024-09-14T10:51:28.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.939+0000 7f19187cc780 1 < completed multipart upload key=KOJ7QB7M6A35 upload=8Y7XOU3Q2C82 tag=3DJRQGQN5M1F type=write size=1067238 2024-09-14T10:51:28.939 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.941+0000 7f19187cc780 1 > prepared operation key=CADC2BY888V1 tag=BTJ5NW5TLWWI type=del size=836588 2024-09-14T10:51:28.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.942+0000 7f19187cc780 1 < completed part key=_multipart_KP3WOGIF30PZ.2~K5BY4L1AIK11.0 size=1048576 2024-09-14T10:51:28.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.943+0000 7f19187cc780 1 < completed part key=_multipart_KP3WOGIF30PZ.2~K5BY4L1AIK11.1 size=591513 2024-09-14T10:51:28.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.946+0000 7f19187cc780 1 < completed multipart upload key=KP3WOGIF30PZ upload=K5BY4L1AIK11 tag=GFJXEONAX6E8 type=write size=2688665 2024-09-14T10:51:28.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.948+0000 7f19187cc780 1 > prepared operation key=RTGE7ISETJWW tag=5M8VYWPA51WJ type=del size=2657444 2024-09-14T10:51:28.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.949+0000 7f19187cc780 1 < completed write operation key=RTGE7ISETJWW tag=RSUICSPZQA5K type=write size=708078 2024-09-14T10:51:28.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.951+0000 7f19187cc780 1 > prepared operation key=9EBD5ZT6MT45 tag=181YYFFISE0V type=del size=806120 2024-09-14T10:51:28.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.952+0000 7f19187cc780 -1 < failed to complete operation key=H40763V7HMBC tag=9QQR446C770G type=del size=523532: (22) Invalid argument 2024-09-14T10:51:28.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.954+0000 7f19187cc780 1 > prepared operation key=KP3WOGIF30PZ tag=SXNVZIEC04XE type=write size=432498 2024-09-14T10:51:28.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.955+0000 7f19187cc780 1 < completed part key=_multipart_W1K1IU13J0CZ.2~C6ALC99J6F4R.0 size=1048576 2024-09-14T10:51:28.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.956+0000 7f19187cc780 1 < completed part key=_multipart_W1K1IU13J0CZ.2~C6ALC99J6F4R.1 size=1048576 2024-09-14T10:51:28.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.963+0000 7f19187cc780 1 < completed part key=_multipart_W1K1IU13J0CZ.2~C6ALC99J6F4R.2 size=739512 2024-09-14T10:51:28.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.966+0000 7f19187cc780 1 < completed multipart upload key=W1K1IU13J0CZ upload=C6ALC99J6F4R tag=0A3Y96IVKIA9 type=write size=3885240 2024-09-14T10:51:28.967 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.969+0000 7f19187cc780 1 > prepared operation key=QBMNYNWOLK4I tag=EPA6RUVTUE5P type=del size=3256579 2024-09-14T10:51:28.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.970+0000 7f19187cc780 1 < completed part key=_multipart_OVOPGTYUF3F3.2~QAV3KPQR2HOG.0 size=1048576 2024-09-14T10:51:28.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.971+0000 7f19187cc780 1 < completed part key=_multipart_OVOPGTYUF3F3.2~QAV3KPQR2HOG.1 size=229002 2024-09-14T10:51:28.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.974+0000 7f19187cc780 1 < completed multipart upload key=OVOPGTYUF3F3 upload=QAV3KPQR2HOG tag=EZCGPM4AIHKS type=write size=2326154 2024-09-14T10:51:28.974 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.976+0000 7f19187cc780 1 > prepared operation key=N0L67LS2KHR1 tag=B0Z2WK49IGA7 type=write size=852354 2024-09-14T10:51:28.976 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.977+0000 7f19187cc780 -1 < failed to complete operation key=AST81B9QWORT tag=JFUK37MBV7OB type=del size=1722792: (22) Invalid argument 2024-09-14T10:51:28.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.979+0000 7f19187cc780 1 > prepared operation key=M73CER01XHDY tag=EB99Z0P3QZU6 type=del size=1925338 2024-09-14T10:51:28.978 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.980+0000 7f19187cc780 1 < completed part key=_multipart_YA3DI7N4DG5K.2~8P8YXZK533YI.0 size=394145 2024-09-14T10:51:28.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.982+0000 7f19187cc780 1 < completed multipart upload key=YA3DI7N4DG5K upload=8P8YXZK533YI tag=KET91LHWMM9B type=write size=1442721 2024-09-14T10:51:28.983 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.984+0000 7f19187cc780 1 > prepared operation key=VW6U36JN2DBX tag=E485Z6FVDYF4 type=del size=1475200 2024-09-14T10:51:28.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.986+0000 7f19187cc780 1 < completed write operation key=7IWUW2HC3ULI tag=SG7XMI0U4LDK type=write size=290084 2024-09-14T10:51:28.987 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.989+0000 7f19187cc780 1 > prepared part key=_multipart_19P3WE6HKJH2.2~LITVLFR0HLUZ.0 size=1048576 2024-09-14T10:51:28.991 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.992+0000 7f19187cc780 1 > prepared part key=_multipart_19P3WE6HKJH2.2~LITVLFR0HLUZ.1 size=1048576 2024-09-14T10:51:28.992 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.994+0000 7f19187cc780 1 > prepared part key=_multipart_19P3WE6HKJH2.2~LITVLFR0HLUZ.2 size=920257 2024-09-14T10:51:28.992 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.994+0000 7f19187cc780 1 > prepared multipart upload key=19P3WE6HKJH2 upload=LITVLFR0HLUZ tag=ZQDLRV8YUB5J type=write size=4065985 2024-09-14T10:51:28.993 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.995+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~8KHLLZ1ETK28.0 size=1048576 2024-09-14T10:51:28.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.996+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~8KHLLZ1ETK28.1 size=1048576 2024-09-14T10:51:28.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:28.997+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~8KHLLZ1ETK28.2 size=476349 2024-09-14T10:51:28.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.000+0000 7f19187cc780 1 < completed multipart upload key=7IWUW2HC3ULI upload=8KHLLZ1ETK28 tag=I3HENC071E9K type=write size=3622077 2024-09-14T10:51:29.000 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.001+0000 7f19187cc780 1 > prepared operation key=YA3DI7N4DG5K tag=LYO4AHYZCO3Y type=del size=1059132 2024-09-14T10:51:29.001 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.003+0000 7f19187cc780 1 < completed delete operation key=INJQTKXHBUV2 tag=SVT0KBF0EGZU type=del 2024-09-14T10:51:29.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.005+0000 7f19187cc780 1 > prepared operation key=OVOPGTYUF3F3 tag=543P2JPY99RR type=del size=2696974 2024-09-14T10:51:29.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.006+0000 7f19187cc780 1 < completed delete operation key=INJQTKXHBUV2 tag=2EKYLH6V52FF type=del 2024-09-14T10:51:29.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.007+0000 7f19187cc780 1 > prepared operation key=EZLSMEK89N2G tag=4WC9S0FWJ3CZ type=del size=3789925 2024-09-14T10:51:29.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.009+0000 7f19187cc780 1 < completed write operation key=19P3WE6HKJH2 tag=CK4V1FCEJNVE type=write size=485871 2024-09-14T10:51:29.011 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.013+0000 7f19187cc780 1 > prepared part key=_multipart_QFEI6H4EQ9ZR.2~WYR8YXAN02PY.0 size=1048576 2024-09-14T10:51:29.012 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.014+0000 7f19187cc780 1 > prepared part key=_multipart_QFEI6H4EQ9ZR.2~WYR8YXAN02PY.1 size=1048576 2024-09-14T10:51:29.013 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.015+0000 7f19187cc780 1 > prepared part key=_multipart_QFEI6H4EQ9ZR.2~WYR8YXAN02PY.2 size=431308 2024-09-14T10:51:29.013 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.015+0000 7f19187cc780 1 > prepared multipart upload key=QFEI6H4EQ9ZR upload=WYR8YXAN02PY tag=VHBE42Y2MPQ1 type=write size=3577036 2024-09-14T10:51:29.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.016+0000 7f19187cc780 1 < completed part key=_multipart_M73CER01XHDY.2~5ELG34ZYMVAC.0 size=1048576 2024-09-14T10:51:29.016 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.018+0000 7f19187cc780 1 < completed part key=_multipart_M73CER01XHDY.2~5ELG34ZYMVAC.1 size=819660 2024-09-14T10:51:29.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.020+0000 7f19187cc780 1 < completed multipart upload key=M73CER01XHDY upload=5ELG34ZYMVAC tag=2HRNR0MQQ7LL type=write size=2916812 2024-09-14T10:51:29.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.021+0000 7f19187cc780 1 > prepared operation key=KP3WOGIF30PZ tag=20SWK7PPCW4M type=write size=453030 2024-09-14T10:51:29.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.023+0000 7f19187cc780 1 < completed delete operation key=5AIAYJMRZGFQ tag=MFMNW8JJCMVZ type=del 2024-09-14T10:51:29.024 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.026+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~UEUF88PCIKJG.0 size=495420 2024-09-14T10:51:29.024 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.026+0000 7f19187cc780 1 > prepared multipart upload key=XCVE2F2JJK4X upload=UEUF88PCIKJG tag=ZIZ74PQOIOYV type=write size=1543996 2024-09-14T10:51:29.026 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.027+0000 7f19187cc780 1 < completed part key=_multipart_W1K1IU13J0CZ.2~H1A561LU1M2H.0 size=186304 2024-09-14T10:51:29.028 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.030+0000 7f19187cc780 1 < completed multipart upload key=W1K1IU13J0CZ upload=H1A561LU1M2H tag=UUG0VPXIKQWT type=write size=1234880 2024-09-14T10:51:29.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.031+0000 7f19187cc780 1 > prepared operation key=XCVE2F2JJK4X tag=TR9Z9YDRSPJU type=del size=194817 2024-09-14T10:51:29.033 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.035+0000 7f19187cc780 1 < suggested update operation key=CADC2BY888V1 tag=BTJ5NW5TLWWI type=del size=836588 2024-09-14T10:51:29.036 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.038+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~M6680W3DGDD6.0 size=1048576 2024-09-14T10:51:29.038 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.039+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~M6680W3DGDD6.1 size=1048576 2024-09-14T10:51:29.039 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.040+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~M6680W3DGDD6.2 size=608617 2024-09-14T10:51:29.039 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.040+0000 7f19187cc780 1 > prepared multipart upload key=KOJ7QB7M6A35 upload=M6680W3DGDD6 tag=WSSVR45MM1W0 type=write size=3754345 2024-09-14T10:51:29.040 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.042+0000 7f19187cc780 1 < completed delete operation key=RTGE7ISETJWW tag=5M8VYWPA51WJ type=del 2024-09-14T10:51:29.042 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.043+0000 7f19187cc780 1 > prepared operation key=RTGE7ISETJWW tag=8UHS08S4BS5K type=del size=2831987 2024-09-14T10:51:29.043 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.045+0000 7f19187cc780 1 < completed delete operation key=9EBD5ZT6MT45 tag=181YYFFISE0V type=del 2024-09-14T10:51:29.044 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.046+0000 7f19187cc780 1 > prepared operation key=M73CER01XHDY tag=G6D7FFV9P239 type=del size=53097 2024-09-14T10:51:29.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.048+0000 7f19187cc780 1 < completed write operation key=KP3WOGIF30PZ tag=SXNVZIEC04XE type=write size=432498 2024-09-14T10:51:29.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.049+0000 7f19187cc780 1 > prepared operation key=IKVYA4KEALFF tag=KAT4JB1360ZS type=del size=1186689 2024-09-14T10:51:29.050 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.051+0000 7f19187cc780 1 < completed delete operation key=QBMNYNWOLK4I tag=EPA6RUVTUE5P type=del 2024-09-14T10:51:29.051 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.053+0000 7f19187cc780 1 > prepared operation key=B9FQYIX19AEP tag=OCOR4QUIC7BU type=del size=3565029 2024-09-14T10:51:29.053 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.055+0000 7f19187cc780 1 < completed write operation key=N0L67LS2KHR1 tag=B0Z2WK49IGA7 type=write size=852354 2024-09-14T10:51:29.055 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.056+0000 7f19187cc780 1 > prepared operation key=EL00Y4Z7DTAT tag=9HC1DEJERGNK type=del size=1170609 2024-09-14T10:51:29.057 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.058+0000 7f19187cc780 1 < completed delete operation key=M73CER01XHDY tag=EB99Z0P3QZU6 type=del 2024-09-14T10:51:29.059 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.060+0000 7f19187cc780 1 > prepared operation key=KOJ7QB7M6A35 tag=0W32IQ9OADTZ type=del size=754823 2024-09-14T10:51:29.060 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.062+0000 7f19187cc780 1 < completed delete operation key=VW6U36JN2DBX tag=E485Z6FVDYF4 type=del 2024-09-14T10:51:29.062 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.063+0000 7f19187cc780 1 > prepared operation key=KP3WOGIF30PZ tag=9QBWUWJQSYEU type=del size=1234051 2024-09-14T10:51:29.063 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.065+0000 7f19187cc780 1 < completed part key=_multipart_19P3WE6HKJH2.2~LITVLFR0HLUZ.0 size=1048576 2024-09-14T10:51:29.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.066+0000 7f19187cc780 1 < completed part key=_multipart_19P3WE6HKJH2.2~LITVLFR0HLUZ.1 size=1048576 2024-09-14T10:51:29.066 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.068+0000 7f19187cc780 1 < completed part key=_multipart_19P3WE6HKJH2.2~LITVLFR0HLUZ.2 size=920257 2024-09-14T10:51:29.069 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.070+0000 7f19187cc780 1 < completed multipart upload key=19P3WE6HKJH2 upload=LITVLFR0HLUZ tag=ZQDLRV8YUB5J type=write size=4065985 2024-09-14T10:51:29.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.073+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~OD8JZ1TAD4Z2.0 size=1048576 2024-09-14T10:51:29.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.074+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~OD8JZ1TAD4Z2.1 size=78905 2024-09-14T10:51:29.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.074+0000 7f19187cc780 1 > prepared multipart upload key=AGNUE76X8XCJ upload=OD8JZ1TAD4Z2 tag=3U87UR9PV05X type=write size=2176057 2024-09-14T10:51:29.074 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.075+0000 7f19187cc780 1 < completed delete operation key=YA3DI7N4DG5K tag=LYO4AHYZCO3Y type=del 2024-09-14T10:51:29.076 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.078+0000 7f19187cc780 1 > prepared part key=_multipart_RTGE7ISETJWW.2~QSJZCZYZY3IJ.0 size=928294 2024-09-14T10:51:29.076 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.078+0000 7f19187cc780 1 > prepared multipart upload key=RTGE7ISETJWW upload=QSJZCZYZY3IJ tag=02HEGS3QBQW0 type=write size=1976870 2024-09-14T10:51:29.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.079+0000 7f19187cc780 1 < canceled operation key=OVOPGTYUF3F3 tag=543P2JPY99RR type=del size=2696974 2024-09-14T10:51:29.080 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.082+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~12DZBSCA35B0.0 size=1048576 2024-09-14T10:51:29.081 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.083+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~12DZBSCA35B0.1 size=542485 2024-09-14T10:51:29.081 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.083+0000 7f19187cc780 1 > prepared multipart upload key=KP3WOGIF30PZ upload=12DZBSCA35B0 tag=IYC1CWW9GWUS type=write size=2639637 2024-09-14T10:51:29.082 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.084+0000 7f19187cc780 1 < completed delete operation key=EZLSMEK89N2G tag=4WC9S0FWJ3CZ type=del 2024-09-14T10:51:29.084 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.085+0000 7f19187cc780 1 > prepared operation key=EZLSMEK89N2G tag=ZV7FV014IIBJ type=del size=3005389 2024-09-14T10:51:29.085 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.087+0000 7f19187cc780 1 < completed part key=_multipart_QFEI6H4EQ9ZR.2~WYR8YXAN02PY.0 size=1048576 2024-09-14T10:51:29.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.089+0000 7f19187cc780 1 < completed part key=_multipart_QFEI6H4EQ9ZR.2~WYR8YXAN02PY.1 size=1048576 2024-09-14T10:51:29.088 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.090+0000 7f19187cc780 1 < completed part key=_multipart_QFEI6H4EQ9ZR.2~WYR8YXAN02PY.2 size=431308 2024-09-14T10:51:29.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.092+0000 7f19187cc780 1 < completed multipart upload key=QFEI6H4EQ9ZR upload=WYR8YXAN02PY tag=VHBE42Y2MPQ1 type=write size=3577036 2024-09-14T10:51:29.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.094+0000 7f19187cc780 1 > prepared operation key=6BNN842ZTWG5 tag=C8W3GV014O6W type=del size=1063519 2024-09-14T10:51:29.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.095+0000 7f19187cc780 1 < completed write operation key=KP3WOGIF30PZ tag=20SWK7PPCW4M type=write size=453030 2024-09-14T10:51:29.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.098+0000 7f19187cc780 1 > prepared part key=_multipart_W1K1IU13J0CZ.2~AZS8RO8Z6YAI.0 size=834470 2024-09-14T10:51:29.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.098+0000 7f19187cc780 1 > prepared multipart upload key=W1K1IU13J0CZ upload=AZS8RO8Z6YAI tag=XQKTIC5LB85C type=write size=1883046 2024-09-14T10:51:29.098 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.100+0000 7f19187cc780 1 < completed part key=_multipart_XCVE2F2JJK4X.2~UEUF88PCIKJG.0 size=495420 2024-09-14T10:51:29.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.102+0000 7f19187cc780 1 < completed multipart upload key=XCVE2F2JJK4X upload=UEUF88PCIKJG tag=ZIZ74PQOIOYV type=write size=1543996 2024-09-14T10:51:29.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.103+0000 7f19187cc780 1 > prepared operation key=61O2VU0SB379 tag=08I1FY0274HL type=del size=1467078 2024-09-14T10:51:29.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.106+0000 7f19187cc780 1 < suggested remove operation key=XCVE2F2JJK4X tag=TR9Z9YDRSPJU type=del 2024-09-14T10:51:29.107 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.109+0000 7f19187cc780 1 > prepared part key=_multipart_QFEI6H4EQ9ZR.2~CWPWSO25JPOO.0 size=1048576 2024-09-14T10:51:29.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.110+0000 7f19187cc780 1 > prepared part key=_multipart_QFEI6H4EQ9ZR.2~CWPWSO25JPOO.1 size=1048576 2024-09-14T10:51:29.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.111+0000 7f19187cc780 1 > prepared part key=_multipart_QFEI6H4EQ9ZR.2~CWPWSO25JPOO.2 size=1028447 2024-09-14T10:51:29.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.111+0000 7f19187cc780 1 > prepared multipart upload key=QFEI6H4EQ9ZR upload=CWPWSO25JPOO tag=KSD4Z9CER2BO type=write size=4174175 2024-09-14T10:51:29.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.113+0000 7f19187cc780 1 < completed part key=_multipart_KOJ7QB7M6A35.2~M6680W3DGDD6.0 size=1048576 2024-09-14T10:51:29.112 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.114+0000 7f19187cc780 1 < completed part key=_multipart_KOJ7QB7M6A35.2~M6680W3DGDD6.1 size=1048576 2024-09-14T10:51:29.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.115+0000 7f19187cc780 1 < completed part key=_multipart_KOJ7QB7M6A35.2~M6680W3DGDD6.2 size=608617 2024-09-14T10:51:29.116 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.117+0000 7f19187cc780 1 < completed multipart upload key=KOJ7QB7M6A35 upload=M6680W3DGDD6 tag=WSSVR45MM1W0 type=write size=3754345 2024-09-14T10:51:29.117 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.119+0000 7f19187cc780 1 > prepared operation key=AGNUE76X8XCJ tag=4IAMWIIFTRMK type=del size=736419 2024-09-14T10:51:29.120 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.122+0000 7f19187cc780 1 < suggested update operation key=RTGE7ISETJWW tag=8UHS08S4BS5K type=del size=2831987 2024-09-14T10:51:29.122 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.123+0000 7f19187cc780 1 > prepared operation key=7IWUW2HC3ULI tag=UXE3IAZ5J8HT type=del size=385901 2024-09-14T10:51:29.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.125+0000 7f19187cc780 1 < completed delete operation key=M73CER01XHDY tag=G6D7FFV9P239 type=del 2024-09-14T10:51:29.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.126+0000 7f19187cc780 1 > prepared operation key=QFEI6H4EQ9ZR tag=FURL7LF50CCT type=write size=560865 2024-09-14T10:51:29.126 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.128+0000 7f19187cc780 1 < canceled operation key=IKVYA4KEALFF tag=KAT4JB1360ZS type=del size=1186689 2024-09-14T10:51:29.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.130+0000 7f19187cc780 1 > prepared part key=_multipart_61O2VU0SB379.2~4Y18MUXKSTL6.0 size=1048576 2024-09-14T10:51:29.130 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.131+0000 7f19187cc780 1 > prepared part key=_multipart_61O2VU0SB379.2~4Y18MUXKSTL6.1 size=1048576 2024-09-14T10:51:29.131 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.133+0000 7f19187cc780 1 > prepared part key=_multipart_61O2VU0SB379.2~4Y18MUXKSTL6.2 size=534397 2024-09-14T10:51:29.131 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.133+0000 7f19187cc780 1 > prepared multipart upload key=61O2VU0SB379 upload=4Y18MUXKSTL6 tag=SUSJVZF4DDW0 type=write size=3680125 2024-09-14T10:51:29.132 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.134+0000 7f19187cc780 1 < completed delete operation key=B9FQYIX19AEP tag=OCOR4QUIC7BU type=del 2024-09-14T10:51:29.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.139+0000 7f19187cc780 1 > prepared part key=_multipart_EL00Y4Z7DTAT.2~5P2JGMILRR31.0 size=1048576 2024-09-14T10:51:29.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.141+0000 7f19187cc780 1 > prepared part key=_multipart_EL00Y4Z7DTAT.2~5P2JGMILRR31.1 size=695729 2024-09-14T10:51:29.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.141+0000 7f19187cc780 1 > prepared multipart upload key=EL00Y4Z7DTAT upload=5P2JGMILRR31 tag=AQM3PRT7QYET type=write size=2792881 2024-09-14T10:51:29.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.142+0000 7f19187cc780 1 < completed delete operation key=EL00Y4Z7DTAT tag=9HC1DEJERGNK type=del 2024-09-14T10:51:29.143 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.145+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~Y0C8G4HRSZRW.0 size=1048576 2024-09-14T10:51:29.144 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.146+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~Y0C8G4HRSZRW.1 size=1048576 2024-09-14T10:51:29.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.147+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~Y0C8G4HRSZRW.2 size=851488 2024-09-14T10:51:29.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.147+0000 7f19187cc780 1 > prepared multipart upload key=IKVYA4KEALFF upload=Y0C8G4HRSZRW tag=6N8ZH5ZJZ97B type=write size=3997216 2024-09-14T10:51:29.147 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.149+0000 7f19187cc780 1 < completed delete operation key=KOJ7QB7M6A35 tag=0W32IQ9OADTZ type=del 2024-09-14T10:51:29.150 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.151+0000 7f19187cc780 1 > prepared part key=_multipart_QBMNYNWOLK4I.2~25NMFF2W8J9S.0 size=1048576 2024-09-14T10:51:29.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.152+0000 7f19187cc780 1 > prepared part key=_multipart_QBMNYNWOLK4I.2~25NMFF2W8J9S.1 size=62113 2024-09-14T10:51:29.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.153+0000 7f19187cc780 1 > prepared multipart upload key=QBMNYNWOLK4I upload=25NMFF2W8J9S tag=4X2X7N393PY1 type=write size=2159265 2024-09-14T10:51:29.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.155+0000 7f19187cc780 1 < completed delete operation key=KP3WOGIF30PZ tag=9QBWUWJQSYEU type=del 2024-09-14T10:51:29.155 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.157+0000 7f19187cc780 1 > prepared part key=_multipart_75O00VMLJJ1X.2~NAAV445CCWAS.0 size=1048576 2024-09-14T10:51:29.157 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.158+0000 7f19187cc780 1 > prepared part key=_multipart_75O00VMLJJ1X.2~NAAV445CCWAS.1 size=1048576 2024-09-14T10:51:29.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.159+0000 7f19187cc780 1 > prepared part key=_multipart_75O00VMLJJ1X.2~NAAV445CCWAS.2 size=160558 2024-09-14T10:51:29.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.159+0000 7f19187cc780 1 > prepared multipart upload key=75O00VMLJJ1X upload=NAAV445CCWAS tag=391JHIUV6Y2N type=write size=3306286 2024-09-14T10:51:29.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.161+0000 7f19187cc780 1 < completed part key=_multipart_AGNUE76X8XCJ.2~OD8JZ1TAD4Z2.0 size=1048576 2024-09-14T10:51:29.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.162+0000 7f19187cc780 1 < completed part key=_multipart_AGNUE76X8XCJ.2~OD8JZ1TAD4Z2.1 size=78905 2024-09-14T10:51:29.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.165+0000 7f19187cc780 1 < completed multipart upload key=AGNUE76X8XCJ upload=OD8JZ1TAD4Z2 tag=3U87UR9PV05X type=write size=2176057 2024-09-14T10:51:29.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.168+0000 7f19187cc780 1 > prepared part key=_multipart_75O00VMLJJ1X.2~9BHB87YH1O62.0 size=1048576 2024-09-14T10:51:29.167 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.169+0000 7f19187cc780 1 > prepared part key=_multipart_75O00VMLJJ1X.2~9BHB87YH1O62.1 size=1048576 2024-09-14T10:51:29.168 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.170+0000 7f19187cc780 1 > prepared part key=_multipart_75O00VMLJJ1X.2~9BHB87YH1O62.2 size=74058 2024-09-14T10:51:29.168 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.170+0000 7f19187cc780 1 > prepared multipart upload key=75O00VMLJJ1X upload=9BHB87YH1O62 tag=T97U0SZ7S6OW type=write size=3219786 2024-09-14T10:51:29.169 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.171+0000 7f19187cc780 1 < completed part key=_multipart_RTGE7ISETJWW.2~QSJZCZYZY3IJ.0 size=928294 2024-09-14T10:51:29.172 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.174+0000 7f19187cc780 1 < completed multipart upload key=RTGE7ISETJWW upload=QSJZCZYZY3IJ tag=02HEGS3QBQW0 type=write size=1976870 2024-09-14T10:51:29.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.175+0000 7f19187cc780 1 > prepared operation key=KOJ7QB7M6A35 tag=VN1RW96BZ2PO type=del size=2018641 2024-09-14T10:51:29.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.176+0000 7f19187cc780 1 < canceled part key=_multipart_KP3WOGIF30PZ.2~12DZBSCA35B0.0 size=1048576 2024-09-14T10:51:29.175 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.177+0000 7f19187cc780 1 < completed part key=_multipart_KP3WOGIF30PZ.2~12DZBSCA35B0.1 size=542485 2024-09-14T10:51:29.178 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.180+0000 7f19187cc780 1 < canceled multipart upload key=KP3WOGIF30PZ upload=12DZBSCA35B0 tag=IYC1CWW9GWUS type=write size=2639637 2024-09-14T10:51:29.181 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.182+0000 7f19187cc780 1 > prepared part key=_multipart_5AIAYJMRZGFQ.2~3ASBH3SKX5NV.0 size=1032361 2024-09-14T10:51:29.181 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.182+0000 7f19187cc780 1 > prepared multipart upload key=5AIAYJMRZGFQ upload=3ASBH3SKX5NV tag=TERQ6YQRLX69 type=write size=2080937 2024-09-14T10:51:29.184 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.185+0000 7f19187cc780 1 < suggested remove operation key=EZLSMEK89N2G tag=ZV7FV014IIBJ type=del 2024-09-14T10:51:29.186 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.187+0000 7f19187cc780 1 > prepared operation key=19P3WE6HKJH2 tag=B7NBURU8JCZQ type=del size=3091478 2024-09-14T10:51:29.187 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.189+0000 7f19187cc780 1 < completed delete operation key=6BNN842ZTWG5 tag=C8W3GV014O6W type=del 2024-09-14T10:51:29.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.192+0000 7f19187cc780 1 > prepared part key=_multipart_61O2VU0SB379.2~G1K2ZAXCMFJV.0 size=1048576 2024-09-14T10:51:29.191 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.193+0000 7f19187cc780 1 > prepared part key=_multipart_61O2VU0SB379.2~G1K2ZAXCMFJV.1 size=1048576 2024-09-14T10:51:29.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.194+0000 7f19187cc780 1 > prepared part key=_multipart_61O2VU0SB379.2~G1K2ZAXCMFJV.2 size=337649 2024-09-14T10:51:29.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.194+0000 7f19187cc780 1 > prepared multipart upload key=61O2VU0SB379 upload=G1K2ZAXCMFJV tag=RZFDFMT64O43 type=write size=3483377 2024-09-14T10:51:29.194 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.195+0000 7f19187cc780 1 < completed part key=_multipart_W1K1IU13J0CZ.2~AZS8RO8Z6YAI.0 size=834470 2024-09-14T10:51:29.196 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.197+0000 7f19187cc780 1 < completed multipart upload key=W1K1IU13J0CZ upload=AZS8RO8Z6YAI tag=XQKTIC5LB85C type=write size=1883046 2024-09-14T10:51:29.197 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.199+0000 7f19187cc780 1 > prepared operation key=EL00Y4Z7DTAT tag=K558VDCVU46D type=write size=64905 2024-09-14T10:51:29.199 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.201+0000 7f19187cc780 1 < completed delete operation key=61O2VU0SB379 tag=08I1FY0274HL type=del 2024-09-14T10:51:29.201 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.202+0000 7f19187cc780 1 > prepared operation key=KP3WOGIF30PZ tag=UJDAMBGVQN50 type=write size=685833 2024-09-14T10:51:29.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.204+0000 7f19187cc780 1 < completed part key=_multipart_QFEI6H4EQ9ZR.2~CWPWSO25JPOO.0 size=1048576 2024-09-14T10:51:29.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.204+0000 7f19187cc780 1 < canceled part key=_multipart_QFEI6H4EQ9ZR.2~CWPWSO25JPOO.1 size=1048576 2024-09-14T10:51:29.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.205+0000 7f19187cc780 1 < completed part key=_multipart_QFEI6H4EQ9ZR.2~CWPWSO25JPOO.2 size=1028447 2024-09-14T10:51:29.206 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.207+0000 7f19187cc780 1 < canceled multipart upload key=QFEI6H4EQ9ZR upload=CWPWSO25JPOO tag=KSD4Z9CER2BO type=write size=4174175 2024-09-14T10:51:29.208 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.210+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~JHUFYQVI8QDQ.0 size=438910 2024-09-14T10:51:29.208 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.210+0000 7f19187cc780 1 > prepared multipart upload key=7IWUW2HC3ULI upload=JHUFYQVI8QDQ tag=8EBWE4OT4X08 type=write size=1487486 2024-09-14T10:51:29.210 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.211+0000 7f19187cc780 1 < completed delete operation key=AGNUE76X8XCJ tag=4IAMWIIFTRMK type=del 2024-09-14T10:51:29.211 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.213+0000 7f19187cc780 1 > prepared operation key=OVOPGTYUF3F3 tag=RXKKTU33QBAZ type=del size=2370876 2024-09-14T10:51:29.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.214+0000 7f19187cc780 1 < completed delete operation key=7IWUW2HC3ULI tag=UXE3IAZ5J8HT type=del 2024-09-14T10:51:29.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.216+0000 7f19187cc780 1 > prepared operation key=OVOPGTYUF3F3 tag=TFKHCAUK1IB8 type=del size=1546386 2024-09-14T10:51:29.216 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.217+0000 7f19187cc780 1 < completed write operation key=QFEI6H4EQ9ZR tag=FURL7LF50CCT type=write size=560865 2024-09-14T10:51:29.217 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.219+0000 7f19187cc780 1 > prepared operation key=RTGE7ISETJWW tag=6TITVTACYUJM type=del size=3795099 2024-09-14T10:51:29.218 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.220+0000 7f19187cc780 1 < completed part key=_multipart_61O2VU0SB379.2~4Y18MUXKSTL6.0 size=1048576 2024-09-14T10:51:29.219 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.221+0000 7f19187cc780 1 < completed part key=_multipart_61O2VU0SB379.2~4Y18MUXKSTL6.1 size=1048576 2024-09-14T10:51:29.221 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.222+0000 7f19187cc780 1 < completed part key=_multipart_61O2VU0SB379.2~4Y18MUXKSTL6.2 size=534397 2024-09-14T10:51:29.223 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.224+0000 7f19187cc780 1 < completed multipart upload key=61O2VU0SB379 upload=4Y18MUXKSTL6 tag=SUSJVZF4DDW0 type=write size=3680125 2024-09-14T10:51:29.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.227+0000 7f19187cc780 1 > prepared part key=_multipart_9EBD5ZT6MT45.2~YB8MLR0U5DOI.0 size=1048576 2024-09-14T10:51:29.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.228+0000 7f19187cc780 1 > prepared part key=_multipart_9EBD5ZT6MT45.2~YB8MLR0U5DOI.1 size=1048576 2024-09-14T10:51:29.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.229+0000 7f19187cc780 1 > prepared part key=_multipart_9EBD5ZT6MT45.2~YB8MLR0U5DOI.2 size=122420 2024-09-14T10:51:29.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.229+0000 7f19187cc780 1 > prepared multipart upload key=9EBD5ZT6MT45 upload=YB8MLR0U5DOI tag=5B05XCQZ5WDK type=write size=3268148 2024-09-14T10:51:29.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.230+0000 7f19187cc780 1 < completed part key=_multipart_EL00Y4Z7DTAT.2~5P2JGMILRR31.0 size=1048576 2024-09-14T10:51:29.230 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.231+0000 7f19187cc780 1 < completed part key=_multipart_EL00Y4Z7DTAT.2~5P2JGMILRR31.1 size=695729 2024-09-14T10:51:29.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.234+0000 7f19187cc780 1 < completed multipart upload key=EL00Y4Z7DTAT upload=5P2JGMILRR31 tag=AQM3PRT7QYET type=write size=2792881 2024-09-14T10:51:29.234 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.236+0000 7f19187cc780 1 > prepared operation key=EZLSMEK89N2G tag=20NCBDVJCRJJ type=write size=545406 2024-09-14T10:51:29.236 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.237+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~Y0C8G4HRSZRW.0 size=1048576 2024-09-14T10:51:29.237 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.238+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~Y0C8G4HRSZRW.1 size=1048576 2024-09-14T10:51:29.238 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.240+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~Y0C8G4HRSZRW.2 size=851488 2024-09-14T10:51:29.240 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.242+0000 7f19187cc780 1 < completed multipart upload key=IKVYA4KEALFF upload=Y0C8G4HRSZRW tag=6N8ZH5ZJZ97B type=write size=3997216 2024-09-14T10:51:29.243 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.245+0000 7f19187cc780 1 > prepared part key=_multipart_54BSD3DEHNK6.2~4LFB1U6TOL5Y.0 size=578017 2024-09-14T10:51:29.243 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.245+0000 7f19187cc780 1 > prepared multipart upload key=54BSD3DEHNK6 upload=4LFB1U6TOL5Y tag=4T96IHEHLM61 type=write size=1626593 2024-09-14T10:51:29.245 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.246+0000 7f19187cc780 1 < completed part key=_multipart_QBMNYNWOLK4I.2~25NMFF2W8J9S.0 size=1048576 2024-09-14T10:51:29.245 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.247+0000 7f19187cc780 1 < completed part key=_multipart_QBMNYNWOLK4I.2~25NMFF2W8J9S.1 size=62113 2024-09-14T10:51:29.248 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.249+0000 7f19187cc780 1 < completed multipart upload key=QBMNYNWOLK4I upload=25NMFF2W8J9S tag=4X2X7N393PY1 type=write size=2159265 2024-09-14T10:51:29.249 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.251+0000 7f19187cc780 1 > prepared operation key=MFA30GSMCSKP tag=0DSSR66P3WEB type=write size=841681 2024-09-14T10:51:29.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.252+0000 7f19187cc780 1 < completed part key=_multipart_75O00VMLJJ1X.2~NAAV445CCWAS.0 size=1048576 2024-09-14T10:51:29.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.253+0000 7f19187cc780 1 < completed part key=_multipart_75O00VMLJJ1X.2~NAAV445CCWAS.1 size=1048576 2024-09-14T10:51:29.253 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.254+0000 7f19187cc780 1 < completed part key=_multipart_75O00VMLJJ1X.2~NAAV445CCWAS.2 size=160558 2024-09-14T10:51:29.255 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.257+0000 7f19187cc780 1 < completed multipart upload key=75O00VMLJJ1X upload=NAAV445CCWAS tag=391JHIUV6Y2N type=write size=3306286 2024-09-14T10:51:29.256 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.258+0000 7f19187cc780 1 > prepared operation key=MFA30GSMCSKP tag=K2JXJXTOQ2IK type=del size=3120726 2024-09-14T10:51:29.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.260+0000 7f19187cc780 1 < completed part key=_multipart_75O00VMLJJ1X.2~9BHB87YH1O62.0 size=1048576 2024-09-14T10:51:29.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.261+0000 7f19187cc780 1 < completed part key=_multipart_75O00VMLJJ1X.2~9BHB87YH1O62.1 size=1048576 2024-09-14T10:51:29.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.262+0000 7f19187cc780 1 < completed part key=_multipart_75O00VMLJJ1X.2~9BHB87YH1O62.2 size=74058 2024-09-14T10:51:29.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.265+0000 7f19187cc780 1 < completed multipart upload key=75O00VMLJJ1X upload=9BHB87YH1O62 tag=T97U0SZ7S6OW type=write size=3219786 2024-09-14T10:51:29.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.267+0000 7f19187cc780 1 > prepared part key=_multipart_54BSD3DEHNK6.2~OV98M5GHCEQE.0 size=835068 2024-09-14T10:51:29.266 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.267+0000 7f19187cc780 1 > prepared multipart upload key=54BSD3DEHNK6 upload=OV98M5GHCEQE tag=5PS4L0SC2CJ2 type=write size=1883644 2024-09-14T10:51:29.268 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.270+0000 7f19187cc780 1 < suggested remove operation key=KOJ7QB7M6A35 tag=VN1RW96BZ2PO type=del 2024-09-14T10:51:29.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.272+0000 7f19187cc780 1 > prepared part key=_multipart_MFA30GSMCSKP.2~HXDGEBMFU8AS.0 size=1048576 2024-09-14T10:51:29.272 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.274+0000 7f19187cc780 1 > prepared part key=_multipart_MFA30GSMCSKP.2~HXDGEBMFU8AS.1 size=1048576 2024-09-14T10:51:29.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.275+0000 7f19187cc780 1 > prepared part key=_multipart_MFA30GSMCSKP.2~HXDGEBMFU8AS.2 size=655477 2024-09-14T10:51:29.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.275+0000 7f19187cc780 1 > prepared multipart upload key=MFA30GSMCSKP upload=HXDGEBMFU8AS tag=PXU9SQ249YBS type=write size=3801205 2024-09-14T10:51:29.277 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.275+0000 7f19187cc780 1 < canceled part key=_multipart_5AIAYJMRZGFQ.2~3ASBH3SKX5NV.0 size=1032361 2024-09-14T10:51:29.277 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.277+0000 7f19187cc780 1 < canceled multipart upload key=5AIAYJMRZGFQ upload=3ASBH3SKX5NV tag=TERQ6YQRLX69 type=write size=2080937 2024-09-14T10:51:29.278 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.280+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~IH2RSXV8BD9P.0 size=633477 2024-09-14T10:51:29.278 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.280+0000 7f19187cc780 1 > prepared multipart upload key=KOJ7QB7M6A35 upload=IH2RSXV8BD9P tag=C74B6SYZ8JZE type=write size=1682053 2024-09-14T10:51:29.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.281+0000 7f19187cc780 1 < completed delete operation key=19P3WE6HKJH2 tag=B7NBURU8JCZQ type=del 2024-09-14T10:51:29.281 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.283+0000 7f19187cc780 1 > prepared operation key=QBMNYNWOLK4I tag=62SONAX8MDWE type=del size=3352141 2024-09-14T10:51:29.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.284+0000 7f19187cc780 1 < completed part key=_multipart_61O2VU0SB379.2~G1K2ZAXCMFJV.0 size=1048576 2024-09-14T10:51:29.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.286+0000 7f19187cc780 1 < completed part key=_multipart_61O2VU0SB379.2~G1K2ZAXCMFJV.1 size=1048576 2024-09-14T10:51:29.286 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.288+0000 7f19187cc780 1 < completed part key=_multipart_61O2VU0SB379.2~G1K2ZAXCMFJV.2 size=337649 2024-09-14T10:51:29.288 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.290+0000 7f19187cc780 1 < completed multipart upload key=61O2VU0SB379 upload=G1K2ZAXCMFJV tag=RZFDFMT64O43 type=write size=3483377 2024-09-14T10:51:29.290 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.291+0000 7f19187cc780 1 > prepared operation key=54BSD3DEHNK6 tag=8GP5O8U4OCP6 type=del size=1922143 2024-09-14T10:51:29.293 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.294+0000 7f19187cc780 1 < suggested update operation key=EL00Y4Z7DTAT tag=K558VDCVU46D type=write size=64905 2024-09-14T10:51:29.294 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.296+0000 7f19187cc780 1 > prepared operation key=KOJ7QB7M6A35 tag=EKV45ZG0N9MH type=del size=76764 2024-09-14T10:51:29.296 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.297+0000 7f19187cc780 1 < canceled operation key=KP3WOGIF30PZ tag=UJDAMBGVQN50 type=write size=685833 2024-09-14T10:51:29.297 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.299+0000 7f19187cc780 1 > prepared operation key=9EBD5ZT6MT45 tag=OCQOV3ZX0R0Q type=del size=2563443 2024-09-14T10:51:29.298 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.300+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~JHUFYQVI8QDQ.0 size=438910 2024-09-14T10:51:29.301 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.302+0000 7f19187cc780 1 < completed multipart upload key=7IWUW2HC3ULI upload=JHUFYQVI8QDQ tag=8EBWE4OT4X08 type=write size=1487486 2024-09-14T10:51:29.302 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.304+0000 7f19187cc780 1 > prepared operation key=75O00VMLJJ1X tag=0W7O2FFZBS5W type=del size=1173681 2024-09-14T10:51:29.304 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.305+0000 7f19187cc780 1 < completed delete operation key=OVOPGTYUF3F3 tag=RXKKTU33QBAZ type=del 2024-09-14T10:51:29.305 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.307+0000 7f19187cc780 1 > prepared operation key=KOJ7QB7M6A35 tag=584JPUXLHZTF type=del size=3666527 2024-09-14T10:51:29.306 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.308+0000 7f19187cc780 1 < completed delete operation key=OVOPGTYUF3F3 tag=TFKHCAUK1IB8 type=del 2024-09-14T10:51:29.309 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.310+0000 7f19187cc780 1 > prepared part key=_multipart_54BSD3DEHNK6.2~Q4V0Y74B3NU8.0 size=1048576 2024-09-14T10:51:29.310 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.311+0000 7f19187cc780 1 > prepared part key=_multipart_54BSD3DEHNK6.2~Q4V0Y74B3NU8.1 size=1048576 2024-09-14T10:51:29.311 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.312+0000 7f19187cc780 1 > prepared part key=_multipart_54BSD3DEHNK6.2~Q4V0Y74B3NU8.2 size=601389 2024-09-14T10:51:29.311 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.312+0000 7f19187cc780 1 > prepared multipart upload key=54BSD3DEHNK6 upload=Q4V0Y74B3NU8 tag=CHOLX0VZO3YH type=write size=3747117 2024-09-14T10:51:29.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.314+0000 7f19187cc780 1 < completed delete operation key=RTGE7ISETJWW tag=6TITVTACYUJM type=del 2024-09-14T10:51:29.313 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.315+0000 7f19187cc780 1 > prepared operation key=75O00VMLJJ1X tag=QM2RZCA139N5 type=del size=2554707 2024-09-14T10:51:29.315 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.316+0000 7f19187cc780 1 < completed part key=_multipart_9EBD5ZT6MT45.2~YB8MLR0U5DOI.0 size=1048576 2024-09-14T10:51:29.316 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.318+0000 7f19187cc780 1 < completed part key=_multipart_9EBD5ZT6MT45.2~YB8MLR0U5DOI.1 size=1048576 2024-09-14T10:51:29.316 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.318+0000 7f19187cc780 1 < canceled part key=_multipart_9EBD5ZT6MT45.2~YB8MLR0U5DOI.2 size=122420 2024-09-14T10:51:29.318 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.320+0000 7f19187cc780 1 < canceled multipart upload key=9EBD5ZT6MT45 upload=YB8MLR0U5DOI tag=5B05XCQZ5WDK type=write size=3268148 2024-09-14T10:51:29.320 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.321+0000 7f19187cc780 1 > prepared operation key=75O00VMLJJ1X tag=Q1UFBA854O23 type=del size=1264780 2024-09-14T10:51:29.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.324+0000 7f19187cc780 1 < suggested update operation key=EZLSMEK89N2G tag=20NCBDVJCRJJ type=write size=545406 2024-09-14T10:51:29.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.326+0000 7f19187cc780 1 > prepared part key=_multipart_M73CER01XHDY.2~0Y5WXQS8REV1.0 size=1048576 2024-09-14T10:51:29.326 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.328+0000 7f19187cc780 1 > prepared part key=_multipart_M73CER01XHDY.2~0Y5WXQS8REV1.1 size=16571 2024-09-14T10:51:29.326 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.328+0000 7f19187cc780 1 > prepared multipart upload key=M73CER01XHDY upload=0Y5WXQS8REV1 tag=7G7NJ3MW7BZ4 type=write size=2113723 2024-09-14T10:51:29.327 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.329+0000 7f19187cc780 1 < completed part key=_multipart_54BSD3DEHNK6.2~4LFB1U6TOL5Y.0 size=578017 2024-09-14T10:51:29.330 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.331+0000 7f19187cc780 1 < completed multipart upload key=54BSD3DEHNK6 upload=4LFB1U6TOL5Y tag=4T96IHEHLM61 type=write size=1626593 2024-09-14T10:51:29.333 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.334+0000 7f19187cc780 1 > prepared part key=_multipart_W1K1IU13J0CZ.2~R5H1PDP82B8O.0 size=1048576 2024-09-14T10:51:29.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.335+0000 7f19187cc780 1 > prepared part key=_multipart_W1K1IU13J0CZ.2~R5H1PDP82B8O.1 size=1048576 2024-09-14T10:51:29.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.337+0000 7f19187cc780 1 > prepared part key=_multipart_W1K1IU13J0CZ.2~R5H1PDP82B8O.2 size=75181 2024-09-14T10:51:29.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.337+0000 7f19187cc780 1 > prepared multipart upload key=W1K1IU13J0CZ upload=R5H1PDP82B8O tag=EJPP28FUIDE7 type=write size=3220909 2024-09-14T10:51:29.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.340+0000 7f19187cc780 1 < suggested remove operation key=MFA30GSMCSKP tag=0DSSR66P3WEB type=write 2024-09-14T10:51:29.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.342+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~SN7SG09H4I9J.0 size=1048576 2024-09-14T10:51:29.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.344+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~SN7SG09H4I9J.1 size=506104 2024-09-14T10:51:29.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.344+0000 7f19187cc780 1 > prepared multipart upload key=6BNN842ZTWG5 upload=SN7SG09H4I9J tag=S08CQ4RNLN5A type=write size=2603256 2024-09-14T10:51:29.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.344+0000 7f19187cc780 -1 < no bi entry to suggest for operation key=MFA30GSMCSKP tag=K2JXJXTOQ2IK type=del size=3120726: (2) No such file or directory 2024-09-14T10:51:29.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.346+0000 7f19187cc780 1 > prepared operation key=617QQI921HB4 tag=BH90FWJD6WLI type=del size=3540 2024-09-14T10:51:29.346 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.348+0000 7f19187cc780 1 < completed part key=_multipart_54BSD3DEHNK6.2~OV98M5GHCEQE.0 size=835068 2024-09-14T10:51:29.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.350+0000 7f19187cc780 1 < completed multipart upload key=54BSD3DEHNK6 upload=OV98M5GHCEQE tag=5PS4L0SC2CJ2 type=write size=1883644 2024-09-14T10:51:29.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.353+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~1Z4OAL65FFEP.0 size=1048576 2024-09-14T10:51:29.352 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.354+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~1Z4OAL65FFEP.1 size=546499 2024-09-14T10:51:29.352 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.354+0000 7f19187cc780 1 > prepared multipart upload key=OVOPGTYUF3F3 upload=1Z4OAL65FFEP tag=VNX4ESOVYJKO type=write size=2643651 2024-09-14T10:51:29.354 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.355+0000 7f19187cc780 1 < completed part key=_multipart_MFA30GSMCSKP.2~HXDGEBMFU8AS.0 size=1048576 2024-09-14T10:51:29.355 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.356+0000 7f19187cc780 1 < completed part key=_multipart_MFA30GSMCSKP.2~HXDGEBMFU8AS.1 size=1048576 2024-09-14T10:51:29.356 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.358+0000 7f19187cc780 1 < completed part key=_multipart_MFA30GSMCSKP.2~HXDGEBMFU8AS.2 size=655477 2024-09-14T10:51:29.358 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.360+0000 7f19187cc780 1 < completed multipart upload key=MFA30GSMCSKP upload=HXDGEBMFU8AS tag=PXU9SQ249YBS type=write size=3801205 2024-09-14T10:51:29.359 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.361+0000 7f19187cc780 1 > prepared operation key=E6UO1LUWOC44 tag=UIFQSZ34KJ1P type=del size=3722391 2024-09-14T10:51:29.361 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.362+0000 7f19187cc780 1 < completed part key=_multipart_KOJ7QB7M6A35.2~IH2RSXV8BD9P.0 size=633477 2024-09-14T10:51:29.363 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.365+0000 7f19187cc780 1 < completed multipart upload key=KOJ7QB7M6A35 upload=IH2RSXV8BD9P tag=C74B6SYZ8JZE type=write size=1682053 2024-09-14T10:51:29.366 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.367+0000 7f19187cc780 1 > prepared part key=_multipart_54BSD3DEHNK6.2~S08TEZBSOCCQ.0 size=1048576 2024-09-14T10:51:29.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.369+0000 7f19187cc780 1 > prepared part key=_multipart_54BSD3DEHNK6.2~S08TEZBSOCCQ.1 size=916851 2024-09-14T10:51:29.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.369+0000 7f19187cc780 1 > prepared multipart upload key=54BSD3DEHNK6 upload=S08TEZBSOCCQ tag=FGMG34CX8RME type=write size=3014003 2024-09-14T10:51:29.368 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.370+0000 7f19187cc780 1 < completed delete operation key=QBMNYNWOLK4I tag=62SONAX8MDWE type=del 2024-09-14T10:51:29.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.373+0000 7f19187cc780 1 > prepared part key=_multipart_EZLSMEK89N2G.2~935P39TCO9VL.0 size=1048576 2024-09-14T10:51:29.372 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.374+0000 7f19187cc780 1 > prepared part key=_multipart_EZLSMEK89N2G.2~935P39TCO9VL.1 size=1048576 2024-09-14T10:51:29.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.375+0000 7f19187cc780 1 > prepared part key=_multipart_EZLSMEK89N2G.2~935P39TCO9VL.2 size=903142 2024-09-14T10:51:29.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.375+0000 7f19187cc780 1 > prepared multipart upload key=EZLSMEK89N2G upload=935P39TCO9VL tag=BJBOV4Y9ULDP type=write size=4048870 2024-09-14T10:51:29.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.377+0000 7f19187cc780 1 < completed delete operation key=54BSD3DEHNK6 tag=8GP5O8U4OCP6 type=del 2024-09-14T10:51:29.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.378+0000 7f19187cc780 1 > prepared operation key=M73CER01XHDY tag=UED81SEEBO72 type=del size=1968230 2024-09-14T10:51:29.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.380+0000 7f19187cc780 1 < completed delete operation key=KOJ7QB7M6A35 tag=EKV45ZG0N9MH type=del 2024-09-14T10:51:29.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.382+0000 7f19187cc780 1 > prepared operation key=IKVYA4KEALFF tag=U9YOOGYBIKTH type=del size=1969591 2024-09-14T10:51:29.382 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.383+0000 7f19187cc780 1 < completed delete operation key=9EBD5ZT6MT45 tag=OCQOV3ZX0R0Q type=del 2024-09-14T10:51:29.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.385+0000 7f19187cc780 1 > prepared operation key=MFA30GSMCSKP tag=QCEZ1PJ0JCK5 type=del size=2384765 2024-09-14T10:51:29.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.387+0000 7f19187cc780 1 < completed delete operation key=75O00VMLJJ1X tag=0W7O2FFZBS5W type=del 2024-09-14T10:51:29.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.389+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~CSGE2EAVGZJD.0 size=1048576 2024-09-14T10:51:29.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.391+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~CSGE2EAVGZJD.1 size=559979 2024-09-14T10:51:29.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.391+0000 7f19187cc780 1 > prepared multipart upload key=OVOPGTYUF3F3 upload=CSGE2EAVGZJD tag=H65T8S8UIWCE type=write size=2657131 2024-09-14T10:51:29.391 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.392+0000 7f19187cc780 1 < completed delete operation key=KOJ7QB7M6A35 tag=584JPUXLHZTF type=del 2024-09-14T10:51:29.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.395+0000 7f19187cc780 1 > prepared part key=_multipart_19P3WE6HKJH2.2~XRDJJAAMS49K.0 size=1048576 2024-09-14T10:51:29.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.397+0000 7f19187cc780 1 > prepared part key=_multipart_19P3WE6HKJH2.2~XRDJJAAMS49K.1 size=455817 2024-09-14T10:51:29.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.397+0000 7f19187cc780 1 > prepared multipart upload key=19P3WE6HKJH2 upload=XRDJJAAMS49K tag=8EZ6GW2Z9UN6 type=write size=2552969 2024-09-14T10:51:29.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.397+0000 7f19187cc780 1 < canceled part key=_multipart_54BSD3DEHNK6.2~Q4V0Y74B3NU8.0 size=1048576 2024-09-14T10:51:29.397 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.398+0000 7f19187cc780 1 < completed part key=_multipart_54BSD3DEHNK6.2~Q4V0Y74B3NU8.1 size=1048576 2024-09-14T10:51:29.398 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.400+0000 7f19187cc780 1 < completed part key=_multipart_54BSD3DEHNK6.2~Q4V0Y74B3NU8.2 size=601389 2024-09-14T10:51:29.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.402+0000 7f19187cc780 1 < canceled multipart upload key=54BSD3DEHNK6 upload=Q4V0Y74B3NU8 tag=CHOLX0VZO3YH type=write size=3747117 2024-09-14T10:51:29.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.404+0000 7f19187cc780 1 > prepared operation key=RTGE7ISETJWW tag=XQPREY06ZRBF type=del size=2351213 2024-09-14T10:51:29.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.407+0000 7f19187cc780 1 < suggested update operation key=75O00VMLJJ1X tag=QM2RZCA139N5 type=del size=2554707 2024-09-14T10:51:29.406 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.408+0000 7f19187cc780 1 > prepared operation key=W1K1IU13J0CZ tag=Z5QTUGNWU0MI type=del size=4113375 2024-09-14T10:51:29.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.410+0000 7f19187cc780 -1 < failed to complete operation key=75O00VMLJJ1X tag=Q1UFBA854O23 type=del size=1264780: (22) Invalid argument 2024-09-14T10:51:29.410 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.411+0000 7f19187cc780 1 > prepared operation key=QBMNYNWOLK4I tag=2DDRFGX80BAT type=write size=876276 2024-09-14T10:51:29.411 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.413+0000 7f19187cc780 1 < completed part key=_multipart_M73CER01XHDY.2~0Y5WXQS8REV1.0 size=1048576 2024-09-14T10:51:29.411 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.413+0000 7f19187cc780 1 < canceled part key=_multipart_M73CER01XHDY.2~0Y5WXQS8REV1.1 size=16571 2024-09-14T10:51:29.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.415+0000 7f19187cc780 1 < canceled multipart upload key=M73CER01XHDY upload=0Y5WXQS8REV1 tag=7G7NJ3MW7BZ4 type=write size=2113723 2024-09-14T10:51:29.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.416+0000 7f19187cc780 1 > prepared operation key=N0L67LS2KHR1 tag=V2OJ6DPIS1IQ type=write size=192172 2024-09-14T10:51:29.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.418+0000 7f19187cc780 1 < completed part key=_multipart_W1K1IU13J0CZ.2~R5H1PDP82B8O.0 size=1048576 2024-09-14T10:51:29.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.419+0000 7f19187cc780 1 < completed part key=_multipart_W1K1IU13J0CZ.2~R5H1PDP82B8O.1 size=1048576 2024-09-14T10:51:29.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.420+0000 7f19187cc780 1 < completed part key=_multipart_W1K1IU13J0CZ.2~R5H1PDP82B8O.2 size=75181 2024-09-14T10:51:29.421 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.423+0000 7f19187cc780 1 < completed multipart upload key=W1K1IU13J0CZ upload=R5H1PDP82B8O tag=EJPP28FUIDE7 type=write size=3220909 2024-09-14T10:51:29.424 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.426+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~G0OKAI5ZTI21.0 size=263765 2024-09-14T10:51:29.424 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.426+0000 7f19187cc780 1 > prepared multipart upload key=KP3WOGIF30PZ upload=G0OKAI5ZTI21 tag=8DM0EZME8CBP type=write size=1312341 2024-09-14T10:51:29.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.427+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~SN7SG09H4I9J.0 size=1048576 2024-09-14T10:51:29.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.428+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~SN7SG09H4I9J.1 size=506104 2024-09-14T10:51:29.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.431+0000 7f19187cc780 1 < completed multipart upload key=6BNN842ZTWG5 upload=SN7SG09H4I9J tag=S08CQ4RNLN5A type=write size=2603256 2024-09-14T10:51:29.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.433+0000 7f19187cc780 1 > prepared part key=_multipart_75O00VMLJJ1X.2~74R1D7HIBRNO.0 size=1048576 2024-09-14T10:51:29.433 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.434+0000 7f19187cc780 1 > prepared part key=_multipart_75O00VMLJJ1X.2~74R1D7HIBRNO.1 size=345160 2024-09-14T10:51:29.433 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.434+0000 7f19187cc780 1 > prepared multipart upload key=75O00VMLJJ1X upload=74R1D7HIBRNO tag=YA7FEH5RW5HJ type=write size=2442312 2024-09-14T10:51:29.435 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.436+0000 7f19187cc780 1 < completed delete operation key=617QQI921HB4 tag=BH90FWJD6WLI type=del 2024-09-14T10:51:29.438 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.439+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~USV8WF5FR61S.0 size=1048576 2024-09-14T10:51:29.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.440+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~USV8WF5FR61S.1 size=339539 2024-09-14T10:51:29.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.440+0000 7f19187cc780 1 > prepared multipart upload key=VW6U36JN2DBX upload=USV8WF5FR61S tag=0WMNU1TC9A1W type=write size=2436691 2024-09-14T10:51:29.440 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.442+0000 7f19187cc780 1 < completed part key=_multipart_OVOPGTYUF3F3.2~1Z4OAL65FFEP.0 size=1048576 2024-09-14T10:51:29.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.443+0000 7f19187cc780 1 < completed part key=_multipart_OVOPGTYUF3F3.2~1Z4OAL65FFEP.1 size=546499 2024-09-14T10:51:29.444 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.445+0000 7f19187cc780 1 < completed multipart upload key=OVOPGTYUF3F3 upload=1Z4OAL65FFEP tag=VNX4ESOVYJKO type=write size=2643651 2024-09-14T10:51:29.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.448+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~1RYCL1L8A5SI.0 size=1030940 2024-09-14T10:51:29.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.448+0000 7f19187cc780 1 > prepared multipart upload key=XCVE2F2JJK4X upload=1RYCL1L8A5SI tag=TD3JOBDRZNPF type=write size=2079516 2024-09-14T10:51:29.448 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.450+0000 7f19187cc780 1 < completed delete operation key=E6UO1LUWOC44 tag=UIFQSZ34KJ1P type=del 2024-09-14T10:51:29.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.452+0000 7f19187cc780 1 > prepared part key=_multipart_5AIAYJMRZGFQ.2~30WZ0OOCIPK5.0 size=922155 2024-09-14T10:51:29.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.452+0000 7f19187cc780 1 > prepared multipart upload key=5AIAYJMRZGFQ upload=30WZ0OOCIPK5 tag=8QUWE2VUYBCB type=write size=1970731 2024-09-14T10:51:29.452 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.454+0000 7f19187cc780 1 < completed part key=_multipart_54BSD3DEHNK6.2~S08TEZBSOCCQ.0 size=1048576 2024-09-14T10:51:29.453 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.455+0000 7f19187cc780 1 < completed part key=_multipart_54BSD3DEHNK6.2~S08TEZBSOCCQ.1 size=916851 2024-09-14T10:51:29.455 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.457+0000 7f19187cc780 1 < completed multipart upload key=54BSD3DEHNK6 upload=S08TEZBSOCCQ tag=FGMG34CX8RME type=write size=3014003 2024-09-14T10:51:29.458 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.459+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~H3KSYUACBW0L.0 size=1048576 2024-09-14T10:51:29.459 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.460+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~H3KSYUACBW0L.1 size=1048576 2024-09-14T10:51:29.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.462+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~H3KSYUACBW0L.2 size=867144 2024-09-14T10:51:29.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.462+0000 7f19187cc780 1 > prepared multipart upload key=B9FQYIX19AEP upload=H3KSYUACBW0L tag=C11ZNR7Z3LY2 type=write size=4012872 2024-09-14T10:51:29.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.463+0000 7f19187cc780 1 < completed part key=_multipart_EZLSMEK89N2G.2~935P39TCO9VL.0 size=1048576 2024-09-14T10:51:29.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.464+0000 7f19187cc780 1 < completed part key=_multipart_EZLSMEK89N2G.2~935P39TCO9VL.1 size=1048576 2024-09-14T10:51:29.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.465+0000 7f19187cc780 1 < completed part key=_multipart_EZLSMEK89N2G.2~935P39TCO9VL.2 size=903142 2024-09-14T10:51:29.466 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.468+0000 7f19187cc780 1 < completed multipart upload key=EZLSMEK89N2G upload=935P39TCO9VL tag=BJBOV4Y9ULDP type=write size=4048870 2024-09-14T10:51:29.470 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.472+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~8QQO397PE4WF.0 size=651448 2024-09-14T10:51:29.470 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.472+0000 7f19187cc780 1 > prepared multipart upload key=KP3WOGIF30PZ upload=8QQO397PE4WF tag=A4HVNDLDETH5 type=write size=1700024 2024-09-14T10:51:29.471 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.473+0000 7f19187cc780 1 < completed delete operation key=M73CER01XHDY tag=UED81SEEBO72 type=del 2024-09-14T10:51:29.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.475+0000 7f19187cc780 1 > prepared operation key=19P3WE6HKJH2 tag=64KT4PEXATYS type=del size=3215606 2024-09-14T10:51:29.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.476+0000 7f19187cc780 1 < canceled operation key=IKVYA4KEALFF tag=U9YOOGYBIKTH type=del size=1969591 2024-09-14T10:51:29.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.479+0000 7f19187cc780 1 > prepared part key=_multipart_19P3WE6HKJH2.2~KYNJQVGP5MSZ.0 size=1048576 2024-09-14T10:51:29.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.480+0000 7f19187cc780 1 > prepared part key=_multipart_19P3WE6HKJH2.2~KYNJQVGP5MSZ.1 size=1048576 2024-09-14T10:51:29.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.481+0000 7f19187cc780 1 > prepared part key=_multipart_19P3WE6HKJH2.2~KYNJQVGP5MSZ.2 size=843354 2024-09-14T10:51:29.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.481+0000 7f19187cc780 1 > prepared multipart upload key=19P3WE6HKJH2 upload=KYNJQVGP5MSZ tag=TLHIQAC4DV7N type=write size=3989082 2024-09-14T10:51:29.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.483+0000 7f19187cc780 1 < completed delete operation key=MFA30GSMCSKP tag=QCEZ1PJ0JCK5 type=del 2024-09-14T10:51:29.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.484+0000 7f19187cc780 1 > prepared operation key=XCVE2F2JJK4X tag=S3ITD8Q0EE4T type=write size=852754 2024-09-14T10:51:29.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.486+0000 7f19187cc780 1 < completed part key=_multipart_OVOPGTYUF3F3.2~CSGE2EAVGZJD.0 size=1048576 2024-09-14T10:51:29.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.487+0000 7f19187cc780 1 < completed part key=_multipart_OVOPGTYUF3F3.2~CSGE2EAVGZJD.1 size=559979 2024-09-14T10:51:29.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.489+0000 7f19187cc780 1 < completed multipart upload key=OVOPGTYUF3F3 upload=CSGE2EAVGZJD tag=H65T8S8UIWCE type=write size=2657131 2024-09-14T10:51:29.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.490+0000 7f19187cc780 1 > prepared operation key=QBMNYNWOLK4I tag=LY6W4AFN79OD type=write size=271160 2024-09-14T10:51:29.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.492+0000 7f19187cc780 1 < completed part key=_multipart_19P3WE6HKJH2.2~XRDJJAAMS49K.0 size=1048576 2024-09-14T10:51:29.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.493+0000 7f19187cc780 1 < completed part key=_multipart_19P3WE6HKJH2.2~XRDJJAAMS49K.1 size=455817 2024-09-14T10:51:29.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.495+0000 7f19187cc780 1 < completed multipart upload key=19P3WE6HKJH2 upload=XRDJJAAMS49K tag=8EZ6GW2Z9UN6 type=write size=2552969 2024-09-14T10:51:29.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.498+0000 7f19187cc780 1 > prepared part key=_multipart_H40763V7HMBC.2~0NMNL71SWMZO.0 size=115019 2024-09-14T10:51:29.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.498+0000 7f19187cc780 1 > prepared multipart upload key=H40763V7HMBC upload=0NMNL71SWMZO tag=ZBZ1JZSUNN37 type=write size=1163595 2024-09-14T10:51:29.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.499+0000 7f19187cc780 1 < completed delete operation key=RTGE7ISETJWW tag=XQPREY06ZRBF type=del 2024-09-14T10:51:29.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.501+0000 7f19187cc780 1 > prepared operation key=B9FQYIX19AEP tag=CRMSUFJ4982V type=del size=2881649 2024-09-14T10:51:29.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.503+0000 7f19187cc780 1 < completed delete operation key=W1K1IU13J0CZ tag=Z5QTUGNWU0MI type=del 2024-09-14T10:51:29.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.505+0000 7f19187cc780 1 > prepared part key=_multipart_19P3WE6HKJH2.2~ADCJI5FGVMVY.0 size=1048576 2024-09-14T10:51:29.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.507+0000 7f19187cc780 1 > prepared part key=_multipart_19P3WE6HKJH2.2~ADCJI5FGVMVY.1 size=610459 2024-09-14T10:51:29.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.507+0000 7f19187cc780 1 > prepared multipart upload key=19P3WE6HKJH2 upload=ADCJI5FGVMVY tag=AUKIPCMJACY8 type=write size=2707611 2024-09-14T10:51:29.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.508+0000 7f19187cc780 1 < completed write operation key=QBMNYNWOLK4I tag=2DDRFGX80BAT type=write size=876276 2024-09-14T10:51:29.508 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.510+0000 7f19187cc780 1 > prepared operation key=KP3WOGIF30PZ tag=RFHLCJBGFM41 type=write size=511292 2024-09-14T10:51:29.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.511+0000 7f19187cc780 1 < completed write operation key=N0L67LS2KHR1 tag=V2OJ6DPIS1IQ type=write size=192172 2024-09-14T10:51:29.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.513+0000 7f19187cc780 1 > prepared operation key=XCVE2F2JJK4X tag=PNU9277N1IGR type=write size=1002503 2024-09-14T10:51:29.513 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.514+0000 7f19187cc780 1 < completed part key=_multipart_KP3WOGIF30PZ.2~G0OKAI5ZTI21.0 size=263765 2024-09-14T10:51:29.515 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.517+0000 7f19187cc780 1 < completed multipart upload key=KP3WOGIF30PZ upload=G0OKAI5ZTI21 tag=8DM0EZME8CBP type=write size=1312341 2024-09-14T10:51:29.517 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.518+0000 7f19187cc780 1 > prepared operation key=19P3WE6HKJH2 tag=WWZHT0V1C1FB type=del size=1602238 2024-09-14T10:51:29.518 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.520+0000 7f19187cc780 1 < completed part key=_multipart_75O00VMLJJ1X.2~74R1D7HIBRNO.0 size=1048576 2024-09-14T10:51:29.519 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.521+0000 7f19187cc780 1 < completed part key=_multipart_75O00VMLJJ1X.2~74R1D7HIBRNO.1 size=345160 2024-09-14T10:51:29.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.523+0000 7f19187cc780 1 < completed multipart upload key=75O00VMLJJ1X upload=74R1D7HIBRNO tag=YA7FEH5RW5HJ type=write size=2442312 2024-09-14T10:51:29.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.525+0000 7f19187cc780 1 > prepared operation key=KOJ7QB7M6A35 tag=LWYOTKTY0GOL type=del size=3456527 2024-09-14T10:51:29.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.526+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~USV8WF5FR61S.0 size=1048576 2024-09-14T10:51:29.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.527+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~USV8WF5FR61S.1 size=339539 2024-09-14T10:51:29.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.529+0000 7f19187cc780 1 < completed multipart upload key=VW6U36JN2DBX upload=USV8WF5FR61S tag=0WMNU1TC9A1W type=write size=2436691 2024-09-14T10:51:29.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.531+0000 7f19187cc780 1 > prepared operation key=9EBD5ZT6MT45 tag=Q1QX5ZAIDAL7 type=del size=2603317 2024-09-14T10:51:29.531 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.533+0000 7f19187cc780 1 < completed part key=_multipart_XCVE2F2JJK4X.2~1RYCL1L8A5SI.0 size=1030940 2024-09-14T10:51:29.534 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.535+0000 7f19187cc780 1 < completed multipart upload key=XCVE2F2JJK4X upload=1RYCL1L8A5SI tag=TD3JOBDRZNPF type=write size=2079516 2024-09-14T10:51:29.536 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.538+0000 7f19187cc780 1 > prepared part key=_multipart_MFA30GSMCSKP.2~GWFDF84Y2DHK.0 size=1048576 2024-09-14T10:51:29.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.539+0000 7f19187cc780 1 > prepared part key=_multipart_MFA30GSMCSKP.2~GWFDF84Y2DHK.1 size=1048576 2024-09-14T10:51:29.539 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.540+0000 7f19187cc780 1 > prepared part key=_multipart_MFA30GSMCSKP.2~GWFDF84Y2DHK.2 size=575285 2024-09-14T10:51:29.539 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.540+0000 7f19187cc780 1 > prepared multipart upload key=MFA30GSMCSKP upload=GWFDF84Y2DHK tag=YKHE2EVBAZPF type=write size=3721013 2024-09-14T10:51:29.540 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.542+0000 7f19187cc780 1 < completed part key=_multipart_5AIAYJMRZGFQ.2~30WZ0OOCIPK5.0 size=922155 2024-09-14T10:51:29.542 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.544+0000 7f19187cc780 1 < completed multipart upload key=5AIAYJMRZGFQ upload=30WZ0OOCIPK5 tag=8QUWE2VUYBCB type=write size=1970731 2024-09-14T10:51:29.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.547+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~4C1ALD14Q26Z.0 size=1041073 2024-09-14T10:51:29.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.547+0000 7f19187cc780 1 > prepared multipart upload key=VW6U36JN2DBX upload=4C1ALD14Q26Z tag=B2I3GRQ2S4ZG type=write size=2089649 2024-09-14T10:51:29.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.547+0000 7f19187cc780 1 < canceled part key=_multipart_B9FQYIX19AEP.2~H3KSYUACBW0L.0 size=1048576 2024-09-14T10:51:29.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.548+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~H3KSYUACBW0L.1 size=1048576 2024-09-14T10:51:29.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.549+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~H3KSYUACBW0L.2 size=867144 2024-09-14T10:51:29.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.552+0000 7f19187cc780 1 < canceled multipart upload key=B9FQYIX19AEP upload=H3KSYUACBW0L tag=C11ZNR7Z3LY2 type=write size=4012872 2024-09-14T10:51:29.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.553+0000 7f19187cc780 1 > prepared operation key=KP3WOGIF30PZ tag=JCFW84LQU9RG type=write size=561847 2024-09-14T10:51:29.554 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.555+0000 7f19187cc780 1 < completed part key=_multipart_KP3WOGIF30PZ.2~8QQO397PE4WF.0 size=651448 2024-09-14T10:51:29.556 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.557+0000 7f19187cc780 1 < completed multipart upload key=KP3WOGIF30PZ upload=8QQO397PE4WF tag=A4HVNDLDETH5 type=write size=1700024 2024-09-14T10:51:29.557 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.559+0000 7f19187cc780 1 > prepared operation key=AST81B9QWORT tag=NZWR01GADQ8W type=del size=3885051 2024-09-14T10:51:29.559 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.560+0000 7f19187cc780 1 < completed delete operation key=19P3WE6HKJH2 tag=64KT4PEXATYS type=del 2024-09-14T10:51:29.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.564+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~L44ZS7W0O5XX.0 size=1048576 2024-09-14T10:51:29.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.565+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~L44ZS7W0O5XX.1 size=478302 2024-09-14T10:51:29.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.565+0000 7f19187cc780 1 > prepared multipart upload key=XCVE2F2JJK4X upload=L44ZS7W0O5XX tag=08MTO5BM0TFG type=write size=2575454 2024-09-14T10:51:29.564 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.566+0000 7f19187cc780 1 < completed part key=_multipart_19P3WE6HKJH2.2~KYNJQVGP5MSZ.0 size=1048576 2024-09-14T10:51:29.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.567+0000 7f19187cc780 1 < completed part key=_multipart_19P3WE6HKJH2.2~KYNJQVGP5MSZ.1 size=1048576 2024-09-14T10:51:29.567 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.568+0000 7f19187cc780 1 < completed part key=_multipart_19P3WE6HKJH2.2~KYNJQVGP5MSZ.2 size=843354 2024-09-14T10:51:29.569 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.570+0000 7f19187cc780 1 < completed multipart upload key=19P3WE6HKJH2 upload=KYNJQVGP5MSZ tag=TLHIQAC4DV7N type=write size=3989082 2024-09-14T10:51:29.571 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.573+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~B1O61JVE8X3Q.0 size=780628 2024-09-14T10:51:29.571 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.573+0000 7f19187cc780 1 > prepared multipart upload key=OVOPGTYUF3F3 upload=B1O61JVE8X3Q tag=J88R60C4M5U0 type=write size=1829204 2024-09-14T10:51:29.572 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.574+0000 7f19187cc780 1 < completed write operation key=XCVE2F2JJK4X tag=S3ITD8Q0EE4T type=write size=852754 2024-09-14T10:51:29.575 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.577+0000 7f19187cc780 1 > prepared part key=_multipart_QFEI6H4EQ9ZR.2~MNGLSD2PFIBH.0 size=1048576 2024-09-14T10:51:29.576 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.578+0000 7f19187cc780 1 > prepared part key=_multipart_QFEI6H4EQ9ZR.2~MNGLSD2PFIBH.1 size=1048576 2024-09-14T10:51:29.577 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.579+0000 7f19187cc780 1 > prepared part key=_multipart_QFEI6H4EQ9ZR.2~MNGLSD2PFIBH.2 size=38151 2024-09-14T10:51:29.577 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.579+0000 7f19187cc780 1 > prepared multipart upload key=QFEI6H4EQ9ZR upload=MNGLSD2PFIBH tag=9MI2AUY1ZTM6 type=write size=3183879 2024-09-14T10:51:29.581 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.582+0000 7f19187cc780 1 < suggested remove operation key=QBMNYNWOLK4I tag=LY6W4AFN79OD type=write 2024-09-14T10:51:29.583 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.584+0000 7f19187cc780 1 > prepared operation key=M73CER01XHDY tag=6MMX0GZWW5JE type=del size=1302450 2024-09-14T10:51:29.584 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.586+0000 7f19187cc780 1 < completed part key=_multipart_H40763V7HMBC.2~0NMNL71SWMZO.0 size=115019 2024-09-14T10:51:29.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.588+0000 7f19187cc780 1 < completed multipart upload key=H40763V7HMBC upload=0NMNL71SWMZO tag=ZBZ1JZSUNN37 type=write size=1163595 2024-09-14T10:51:29.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.590+0000 7f19187cc780 1 > prepared operation key=EZLSMEK89N2G tag=8QGTJ5U4PGM3 type=del size=979609 2024-09-14T10:51:29.590 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.591+0000 7f19187cc780 1 < completed delete operation key=B9FQYIX19AEP tag=CRMSUFJ4982V type=del 2024-09-14T10:51:29.591 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.593+0000 7f19187cc780 1 > prepared operation key=QFEI6H4EQ9ZR tag=C8Y1GVRMOJEP type=write size=34861 2024-09-14T10:51:29.593 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.594+0000 7f19187cc780 1 < completed part key=_multipart_19P3WE6HKJH2.2~ADCJI5FGVMVY.0 size=1048576 2024-09-14T10:51:29.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.596+0000 7f19187cc780 1 < completed part key=_multipart_19P3WE6HKJH2.2~ADCJI5FGVMVY.1 size=610459 2024-09-14T10:51:29.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.598+0000 7f19187cc780 1 < completed multipart upload key=19P3WE6HKJH2 upload=ADCJI5FGVMVY tag=AUKIPCMJACY8 type=write size=2707611 2024-09-14T10:51:29.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.601+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~IMDRUU61MIZ2.0 size=1048576 2024-09-14T10:51:29.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.602+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~IMDRUU61MIZ2.1 size=1048576 2024-09-14T10:51:29.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.604+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~IMDRUU61MIZ2.2 size=920868 2024-09-14T10:51:29.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.604+0000 7f19187cc780 1 > prepared multipart upload key=OVOPGTYUF3F3 upload=IMDRUU61MIZ2 tag=KNJ5L5457BG9 type=write size=4066596 2024-09-14T10:51:29.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.605+0000 7f19187cc780 1 < completed write operation key=KP3WOGIF30PZ tag=RFHLCJBGFM41 type=write size=511292 2024-09-14T10:51:29.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.607+0000 7f19187cc780 1 > prepared operation key=RTGE7ISETJWW tag=DLIW6UNG444G type=del size=2952878 2024-09-14T10:51:29.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.608+0000 7f19187cc780 1 < completed write operation key=XCVE2F2JJK4X tag=PNU9277N1IGR type=write size=1002503 2024-09-14T10:51:29.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.611+0000 7f19187cc780 1 > prepared part key=_multipart_EZLSMEK89N2G.2~O3PV32UU1LCL.0 size=1048576 2024-09-14T10:51:29.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.612+0000 7f19187cc780 1 > prepared part key=_multipart_EZLSMEK89N2G.2~O3PV32UU1LCL.1 size=62575 2024-09-14T10:51:29.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.612+0000 7f19187cc780 1 > prepared multipart upload key=EZLSMEK89N2G upload=O3PV32UU1LCL tag=IZLBRPIRY54X type=write size=2159727 2024-09-14T10:51:29.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.614+0000 7f19187cc780 1 < completed delete operation key=19P3WE6HKJH2 tag=WWZHT0V1C1FB type=del 2024-09-14T10:51:29.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.616+0000 7f19187cc780 1 > prepared operation key=AST81B9QWORT tag=CRPOWZZ09RMX type=del size=2273854 2024-09-14T10:51:29.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.618+0000 7f19187cc780 1 < completed delete operation key=KOJ7QB7M6A35 tag=LWYOTKTY0GOL type=del 2024-09-14T10:51:29.618 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.619+0000 7f19187cc780 1 > prepared operation key=AGNUE76X8XCJ tag=0961MV60CMCL type=del size=1508519 2024-09-14T10:51:29.619 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.621+0000 7f19187cc780 1 < completed delete operation key=9EBD5ZT6MT45 tag=Q1QX5ZAIDAL7 type=del 2024-09-14T10:51:29.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.624+0000 7f19187cc780 1 > prepared part key=_multipart_N0L67LS2KHR1.2~S88IV3BA8F4D.0 size=819191 2024-09-14T10:51:29.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.624+0000 7f19187cc780 1 > prepared multipart upload key=N0L67LS2KHR1 upload=S88IV3BA8F4D tag=02Q9UT84402L type=write size=1867767 2024-09-14T10:51:29.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.625+0000 7f19187cc780 1 < completed part key=_multipart_MFA30GSMCSKP.2~GWFDF84Y2DHK.0 size=1048576 2024-09-14T10:51:29.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.625+0000 7f19187cc780 1 < canceled part key=_multipart_MFA30GSMCSKP.2~GWFDF84Y2DHK.1 size=1048576 2024-09-14T10:51:29.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.627+0000 7f19187cc780 1 < completed part key=_multipart_MFA30GSMCSKP.2~GWFDF84Y2DHK.2 size=575285 2024-09-14T10:51:29.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.629+0000 7f19187cc780 1 < canceled multipart upload key=MFA30GSMCSKP upload=GWFDF84Y2DHK tag=YKHE2EVBAZPF type=write size=3721013 2024-09-14T10:51:29.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.631+0000 7f19187cc780 1 > prepared operation key=61O2VU0SB379 tag=3IE2YL6HRDZ5 type=write size=87282 2024-09-14T10:51:29.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.631+0000 7f19187cc780 1 < canceled part key=_multipart_VW6U36JN2DBX.2~4C1ALD14Q26Z.0 size=1041073 2024-09-14T10:51:29.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.633+0000 7f19187cc780 1 < canceled multipart upload key=VW6U36JN2DBX upload=4C1ALD14Q26Z tag=B2I3GRQ2S4ZG type=write size=2089649 2024-09-14T10:51:29.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.635+0000 7f19187cc780 1 > prepared operation key=OVOPGTYUF3F3 tag=3JUF3RVATS64 type=write size=500169 2024-09-14T10:51:29.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.637+0000 7f19187cc780 1 < completed write operation key=KP3WOGIF30PZ tag=JCFW84LQU9RG type=write size=561847 2024-09-14T10:51:29.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.639+0000 7f19187cc780 1 > prepared operation key=9EBD5ZT6MT45 tag=DM8DKW722R3M type=del size=666809 2024-09-14T10:51:29.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.640+0000 7f19187cc780 1 < completed delete operation key=AST81B9QWORT tag=NZWR01GADQ8W type=del 2024-09-14T10:51:29.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.642+0000 7f19187cc780 1 > prepared operation key=61O2VU0SB379 tag=XI4SNLM2JWXT type=del size=2343465 2024-09-14T10:51:29.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.643+0000 7f19187cc780 1 < completed part key=_multipart_XCVE2F2JJK4X.2~L44ZS7W0O5XX.0 size=1048576 2024-09-14T10:51:29.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.645+0000 7f19187cc780 1 < completed part key=_multipart_XCVE2F2JJK4X.2~L44ZS7W0O5XX.1 size=478302 2024-09-14T10:51:29.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.647+0000 7f19187cc780 1 < completed multipart upload key=XCVE2F2JJK4X upload=L44ZS7W0O5XX tag=08MTO5BM0TFG type=write size=2575454 2024-09-14T10:51:29.648 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.650+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~WAR6RUDCXMT1.0 size=1048576 2024-09-14T10:51:29.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.651+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~WAR6RUDCXMT1.1 size=433259 2024-09-14T10:51:29.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.651+0000 7f19187cc780 1 > prepared multipart upload key=XCVE2F2JJK4X upload=WAR6RUDCXMT1 tag=EGLOXLYBOEH1 type=write size=2530411 2024-09-14T10:51:29.651 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.652+0000 7f19187cc780 1 < completed part key=_multipart_OVOPGTYUF3F3.2~B1O61JVE8X3Q.0 size=780628 2024-09-14T10:51:29.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.655+0000 7f19187cc780 1 < completed multipart upload key=OVOPGTYUF3F3 upload=B1O61JVE8X3Q tag=J88R60C4M5U0 type=write size=1829204 2024-09-14T10:51:29.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.657+0000 7f19187cc780 1 > prepared operation key=EL00Y4Z7DTAT tag=FU6P3R8IOVT6 type=del size=2289313 2024-09-14T10:51:29.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.658+0000 7f19187cc780 1 < completed part key=_multipart_QFEI6H4EQ9ZR.2~MNGLSD2PFIBH.0 size=1048576 2024-09-14T10:51:29.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.659+0000 7f19187cc780 1 < completed part key=_multipart_QFEI6H4EQ9ZR.2~MNGLSD2PFIBH.1 size=1048576 2024-09-14T10:51:29.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.661+0000 7f19187cc780 1 < completed part key=_multipart_QFEI6H4EQ9ZR.2~MNGLSD2PFIBH.2 size=38151 2024-09-14T10:51:29.661 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.663+0000 7f19187cc780 1 < completed multipart upload key=QFEI6H4EQ9ZR upload=MNGLSD2PFIBH tag=9MI2AUY1ZTM6 type=write size=3183879 2024-09-14T10:51:29.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.665+0000 7f19187cc780 1 > prepared part key=_multipart_617QQI921HB4.2~2QEWXCWLQ8BP.0 size=289233 2024-09-14T10:51:29.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.665+0000 7f19187cc780 1 > prepared multipart upload key=617QQI921HB4 upload=2QEWXCWLQ8BP tag=9ZDQV9V24COQ type=write size=1337809 2024-09-14T10:51:29.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.669+0000 7f19187cc780 1 < suggested remove operation key=M73CER01XHDY tag=6MMX0GZWW5JE type=del 2024-09-14T10:51:29.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.670+0000 7f19187cc780 1 > prepared operation key=9EBD5ZT6MT45 tag=HHMTXV9OONDG type=del size=1033256 2024-09-14T10:51:29.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.674+0000 7f19187cc780 1 < suggested remove operation key=EZLSMEK89N2G tag=8QGTJ5U4PGM3 type=del 2024-09-14T10:51:29.675 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.677+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~76I3RI5KT621.0 size=1048576 2024-09-14T10:51:29.676 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.678+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~76I3RI5KT621.1 size=1048576 2024-09-14T10:51:29.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.679+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~76I3RI5KT621.2 size=210140 2024-09-14T10:51:29.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.679+0000 7f19187cc780 1 > prepared multipart upload key=KP3WOGIF30PZ upload=76I3RI5KT621 tag=J984OR9JZFZ9 type=write size=3355868 2024-09-14T10:51:29.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.680+0000 7f19187cc780 1 < canceled operation key=QFEI6H4EQ9ZR tag=C8Y1GVRMOJEP type=write size=34861 2024-09-14T10:51:29.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.682+0000 7f19187cc780 1 > prepared operation key=AGNUE76X8XCJ tag=KC6IVJEGJ8BL type=del size=3860685 2024-09-14T10:51:29.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.684+0000 7f19187cc780 1 < completed part key=_multipart_OVOPGTYUF3F3.2~IMDRUU61MIZ2.0 size=1048576 2024-09-14T10:51:29.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.685+0000 7f19187cc780 1 < completed part key=_multipart_OVOPGTYUF3F3.2~IMDRUU61MIZ2.1 size=1048576 2024-09-14T10:51:29.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.686+0000 7f19187cc780 1 < completed part key=_multipart_OVOPGTYUF3F3.2~IMDRUU61MIZ2.2 size=920868 2024-09-14T10:51:29.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.688+0000 7f19187cc780 1 < completed multipart upload key=OVOPGTYUF3F3 upload=IMDRUU61MIZ2 tag=KNJ5L5457BG9 type=write size=4066596 2024-09-14T10:51:29.688 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.690+0000 7f19187cc780 1 > prepared operation key=N0L67LS2KHR1 tag=H1MTIZFZFHFW type=del size=2151088 2024-09-14T10:51:29.690 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.691+0000 7f19187cc780 1 < completed delete operation key=RTGE7ISETJWW tag=DLIW6UNG444G type=del 2024-09-14T10:51:29.691 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.693+0000 7f19187cc780 1 > prepared operation key=W1K1IU13J0CZ tag=YUK8VQ7AP80N type=write size=602945 2024-09-14T10:51:29.692 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.694+0000 7f19187cc780 1 < completed part key=_multipart_EZLSMEK89N2G.2~O3PV32UU1LCL.0 size=1048576 2024-09-14T10:51:29.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.696+0000 7f19187cc780 1 < completed part key=_multipart_EZLSMEK89N2G.2~O3PV32UU1LCL.1 size=62575 2024-09-14T10:51:29.698 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.699+0000 7f19187cc780 1 < completed multipart upload key=EZLSMEK89N2G upload=O3PV32UU1LCL tag=IZLBRPIRY54X type=write size=2159727 2024-09-14T10:51:29.699 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.701+0000 7f19187cc780 1 > prepared operation key=H40763V7HMBC tag=BRF9VRCBVU53 type=write size=191682 2024-09-14T10:51:29.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.703+0000 7f19187cc780 1 < completed delete operation key=AST81B9QWORT tag=CRPOWZZ09RMX type=del 2024-09-14T10:51:29.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.704+0000 7f19187cc780 1 > prepared operation key=QFEI6H4EQ9ZR tag=S861TQLU1DIN type=del size=3564862 2024-09-14T10:51:29.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.706+0000 7f19187cc780 1 < completed delete operation key=AGNUE76X8XCJ tag=0961MV60CMCL type=del 2024-09-14T10:51:29.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.707+0000 7f19187cc780 1 > prepared operation key=E6UO1LUWOC44 tag=7TDMEJT3VW3S type=del size=1551040 2024-09-14T10:51:29.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.708+0000 7f19187cc780 1 < canceled part key=_multipart_N0L67LS2KHR1.2~S88IV3BA8F4D.0 size=819191 2024-09-14T10:51:29.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.710+0000 7f19187cc780 1 < canceled multipart upload key=N0L67LS2KHR1 upload=S88IV3BA8F4D tag=02Q9UT84402L type=write size=1867767 2024-09-14T10:51:29.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.713+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~GRD98XI0W4XG.0 size=1048576 2024-09-14T10:51:29.712 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.714+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~GRD98XI0W4XG.1 size=1048576 2024-09-14T10:51:29.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.715+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~GRD98XI0W4XG.2 size=930671 2024-09-14T10:51:29.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.715+0000 7f19187cc780 1 > prepared multipart upload key=KOJ7QB7M6A35 upload=GRD98XI0W4XG tag=AZ8LGWX9AK0J type=write size=4076399 2024-09-14T10:51:29.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.716+0000 7f19187cc780 1 < completed write operation key=61O2VU0SB379 tag=3IE2YL6HRDZ5 type=write size=87282 2024-09-14T10:51:29.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.718+0000 7f19187cc780 1 > prepared operation key=54BSD3DEHNK6 tag=M1VF2MA8I19H type=del size=3425712 2024-09-14T10:51:29.718 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.719+0000 7f19187cc780 1 < completed write operation key=OVOPGTYUF3F3 tag=3JUF3RVATS64 type=write size=500169 2024-09-14T10:51:29.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.721+0000 7f19187cc780 1 > prepared operation key=6BNN842ZTWG5 tag=VT3U1H1PCTS5 type=del size=1071053 2024-09-14T10:51:29.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.722+0000 7f19187cc780 1 < completed delete operation key=9EBD5ZT6MT45 tag=DM8DKW722R3M type=del 2024-09-14T10:51:29.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.724+0000 7f19187cc780 1 > prepared operation key=XCVE2F2JJK4X tag=MC7FLPBBC14K type=del size=1155305 2024-09-14T10:51:29.724 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.725+0000 7f19187cc780 1 < completed delete operation key=61O2VU0SB379 tag=XI4SNLM2JWXT type=del 2024-09-14T10:51:29.726 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.728+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~7DFWGMY215M9.0 size=422234 2024-09-14T10:51:29.726 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.728+0000 7f19187cc780 1 > prepared multipart upload key=VW6U36JN2DBX upload=7DFWGMY215M9 tag=GI5QPC2N70MV type=write size=1470810 2024-09-14T10:51:29.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.729+0000 7f19187cc780 1 < completed part key=_multipart_XCVE2F2JJK4X.2~WAR6RUDCXMT1.0 size=1048576 2024-09-14T10:51:29.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.729+0000 7f19187cc780 1 < canceled part key=_multipart_XCVE2F2JJK4X.2~WAR6RUDCXMT1.1 size=433259 2024-09-14T10:51:29.730 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.731+0000 7f19187cc780 1 < canceled multipart upload key=XCVE2F2JJK4X upload=WAR6RUDCXMT1 tag=EGLOXLYBOEH1 type=write size=2530411 2024-09-14T10:51:29.731 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.733+0000 7f19187cc780 1 > prepared operation key=XCVE2F2JJK4X tag=OYN9K3UFGY8F type=write size=720220 2024-09-14T10:51:29.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.734+0000 7f19187cc780 1 < completed delete operation key=EL00Y4Z7DTAT tag=FU6P3R8IOVT6 type=del 2024-09-14T10:51:29.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.736+0000 7f19187cc780 1 > prepared operation key=19P3WE6HKJH2 tag=5DB33ZFE16A2 type=del size=253004 2024-09-14T10:51:29.735 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.737+0000 7f19187cc780 1 < completed part key=_multipart_617QQI921HB4.2~2QEWXCWLQ8BP.0 size=289233 2024-09-14T10:51:29.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.739+0000 7f19187cc780 1 < completed multipart upload key=617QQI921HB4 upload=2QEWXCWLQ8BP tag=9ZDQV9V24COQ type=write size=1337809 2024-09-14T10:51:29.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.741+0000 7f19187cc780 1 > prepared operation key=54BSD3DEHNK6 tag=L7DV9HCDI58P type=del size=3997344 2024-09-14T10:51:29.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.742+0000 7f19187cc780 1 < completed delete operation key=9EBD5ZT6MT45 tag=HHMTXV9OONDG type=del 2024-09-14T10:51:29.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.744+0000 7f19187cc780 1 > prepared operation key=RTGE7ISETJWW tag=3NZXLF30A1W3 type=del size=3761098 2024-09-14T10:51:29.744 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.746+0000 7f19187cc780 1 < completed part key=_multipart_KP3WOGIF30PZ.2~76I3RI5KT621.0 size=1048576 2024-09-14T10:51:29.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.747+0000 7f19187cc780 1 < completed part key=_multipart_KP3WOGIF30PZ.2~76I3RI5KT621.1 size=1048576 2024-09-14T10:51:29.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.748+0000 7f19187cc780 1 < completed part key=_multipart_KP3WOGIF30PZ.2~76I3RI5KT621.2 size=210140 2024-09-14T10:51:29.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.751+0000 7f19187cc780 1 < completed multipart upload key=KP3WOGIF30PZ upload=76I3RI5KT621 tag=J984OR9JZFZ9 type=write size=3355868 2024-09-14T10:51:29.750 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.752+0000 7f19187cc780 1 > prepared operation key=61O2VU0SB379 tag=00FFS1E9W5JX type=del size=3785398 2024-09-14T10:51:29.752 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.753+0000 7f19187cc780 1 < completed delete operation key=AGNUE76X8XCJ tag=KC6IVJEGJ8BL type=del 2024-09-14T10:51:29.753 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.755+0000 7f19187cc780 1 > prepared operation key=QBMNYNWOLK4I tag=62PPV603UOKH type=del size=1949574 2024-09-14T10:51:29.755 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.756+0000 7f19187cc780 1 < completed delete operation key=N0L67LS2KHR1 tag=H1MTIZFZFHFW type=del 2024-09-14T10:51:29.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.759+0000 7f19187cc780 1 > prepared part key=_multipart_H40763V7HMBC.2~S1RER8TPSCV9.0 size=979270 2024-09-14T10:51:29.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.759+0000 7f19187cc780 1 > prepared multipart upload key=H40763V7HMBC upload=S1RER8TPSCV9 tag=T353BG3PEPHW type=write size=2027846 2024-09-14T10:51:29.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.760+0000 7f19187cc780 1 < completed write operation key=W1K1IU13J0CZ tag=YUK8VQ7AP80N type=write size=602945 2024-09-14T10:51:29.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.762+0000 7f19187cc780 1 > prepared operation key=CADC2BY888V1 tag=GZ36YQPOD3DD type=write size=519983 2024-09-14T10:51:29.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.763+0000 7f19187cc780 1 < completed write operation key=H40763V7HMBC tag=BRF9VRCBVU53 type=write size=191682 2024-09-14T10:51:29.763 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.765+0000 7f19187cc780 1 > prepared operation key=EZLSMEK89N2G tag=263O4XT6XJQL type=del size=2563006 2024-09-14T10:51:29.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.769+0000 7f19187cc780 1 < suggested update operation key=QFEI6H4EQ9ZR tag=S861TQLU1DIN type=del size=3564862 2024-09-14T10:51:29.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.770+0000 7f19187cc780 1 > prepared operation key=YA3DI7N4DG5K tag=AN14RWYEXDP4 type=del size=4166391 2024-09-14T10:51:29.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.772+0000 7f19187cc780 1 < completed delete operation key=E6UO1LUWOC44 tag=7TDMEJT3VW3S type=del 2024-09-14T10:51:29.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.773+0000 7f19187cc780 1 > prepared operation key=H40763V7HMBC tag=RS6VF8Q8SBHG type=write size=255383 2024-09-14T10:51:29.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.775+0000 7f19187cc780 1 < completed part key=_multipart_KOJ7QB7M6A35.2~GRD98XI0W4XG.0 size=1048576 2024-09-14T10:51:29.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.776+0000 7f19187cc780 1 < completed part key=_multipart_KOJ7QB7M6A35.2~GRD98XI0W4XG.1 size=1048576 2024-09-14T10:51:29.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.777+0000 7f19187cc780 1 < completed part key=_multipart_KOJ7QB7M6A35.2~GRD98XI0W4XG.2 size=930671 2024-09-14T10:51:29.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.779+0000 7f19187cc780 1 < completed multipart upload key=KOJ7QB7M6A35 upload=GRD98XI0W4XG tag=AZ8LGWX9AK0J type=write size=4076399 2024-09-14T10:51:29.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.781+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~NN2IFF1NNHN1.0 size=1048576 2024-09-14T10:51:29.781 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.783+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~NN2IFF1NNHN1.1 size=81728 2024-09-14T10:51:29.781 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.783+0000 7f19187cc780 1 > prepared multipart upload key=6BNN842ZTWG5 upload=NN2IFF1NNHN1 tag=5ZS1HFEW26AJ type=write size=2178880 2024-09-14T10:51:29.783 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.784+0000 7f19187cc780 1 < completed delete operation key=54BSD3DEHNK6 tag=M1VF2MA8I19H type=del 2024-09-14T10:51:29.784 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.786+0000 7f19187cc780 1 > prepared operation key=VW6U36JN2DBX tag=GFXHCWRTPL2A type=write size=691391 2024-09-14T10:51:29.786 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.788+0000 7f19187cc780 1 < canceled operation key=6BNN842ZTWG5 tag=VT3U1H1PCTS5 type=del size=1071053 2024-09-14T10:51:29.789 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.790+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~QXRHZCW1GWFV.0 size=1048576 2024-09-14T10:51:29.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.791+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~QXRHZCW1GWFV.1 size=370344 2024-09-14T10:51:29.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.791+0000 7f19187cc780 1 > prepared multipart upload key=XCVE2F2JJK4X upload=QXRHZCW1GWFV tag=KV27112XGX0K type=write size=2467496 2024-09-14T10:51:29.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.794+0000 7f19187cc780 1 < suggested update operation key=XCVE2F2JJK4X tag=MC7FLPBBC14K type=del size=1155305 2024-09-14T10:51:29.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.797+0000 7f19187cc780 1 > prepared part key=_multipart_RTGE7ISETJWW.2~7ZR0T6UUWDVT.0 size=877602 2024-09-14T10:51:29.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.797+0000 7f19187cc780 1 > prepared multipart upload key=RTGE7ISETJWW upload=7ZR0T6UUWDVT tag=BRGRF79VSRIH type=write size=1926178 2024-09-14T10:51:29.796 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.798+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~7DFWGMY215M9.0 size=422234 2024-09-14T10:51:29.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.800+0000 7f19187cc780 1 < completed multipart upload key=VW6U36JN2DBX upload=7DFWGMY215M9 tag=GI5QPC2N70MV type=write size=1470810 2024-09-14T10:51:29.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.802+0000 7f19187cc780 1 > prepared operation key=M73CER01XHDY tag=69034B7IAURK type=write size=423454 2024-09-14T10:51:29.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.803+0000 7f19187cc780 -1 < failed to complete operation key=XCVE2F2JJK4X tag=OYN9K3UFGY8F type=write size=720220: (22) Invalid argument 2024-09-14T10:51:29.804 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.806+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~N7ZA65CJ0NAK.0 size=1048576 2024-09-14T10:51:29.805 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.807+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~N7ZA65CJ0NAK.1 size=76708 2024-09-14T10:51:29.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.807+0000 7f19187cc780 1 > prepared multipart upload key=7IWUW2HC3ULI upload=N7ZA65CJ0NAK tag=NISK9GCLFG66 type=write size=2173860 2024-09-14T10:51:29.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.809+0000 7f19187cc780 1 < completed delete operation key=19P3WE6HKJH2 tag=5DB33ZFE16A2 type=del 2024-09-14T10:51:29.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.810+0000 7f19187cc780 1 > prepared operation key=QBMNYNWOLK4I tag=RVNEZ0HKX7NF type=del size=1566358 2024-09-14T10:51:29.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.813+0000 7f19187cc780 1 < suggested remove operation key=54BSD3DEHNK6 tag=L7DV9HCDI58P type=del 2024-09-14T10:51:29.813 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.814+0000 7f19187cc780 1 > prepared operation key=QFEI6H4EQ9ZR tag=5PQK0L4TXJKB type=del size=3530419 2024-09-14T10:51:29.816 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.817+0000 7f19187cc780 1 < suggested update operation key=RTGE7ISETJWW tag=3NZXLF30A1W3 type=del size=3761098 2024-09-14T10:51:29.817 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.819+0000 7f19187cc780 1 > prepared operation key=N0L67LS2KHR1 tag=73VBLQH19JLX type=del size=889614 2024-09-14T10:51:29.819 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.820+0000 7f19187cc780 1 < completed delete operation key=61O2VU0SB379 tag=00FFS1E9W5JX type=del 2024-09-14T10:51:29.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.823+0000 7f19187cc780 1 > prepared part key=_multipart_EL00Y4Z7DTAT.2~T3A963B3XTCJ.0 size=1048576 2024-09-14T10:51:29.822 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.824+0000 7f19187cc780 1 > prepared part key=_multipart_EL00Y4Z7DTAT.2~T3A963B3XTCJ.1 size=674972 2024-09-14T10:51:29.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.824+0000 7f19187cc780 1 > prepared multipart upload key=EL00Y4Z7DTAT upload=T3A963B3XTCJ tag=XY5ER1BTI953 type=write size=2772124 2024-09-14T10:51:29.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.826+0000 7f19187cc780 1 < completed delete operation key=QBMNYNWOLK4I tag=62PPV603UOKH type=del 2024-09-14T10:51:29.825 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.827+0000 7f19187cc780 1 > prepared operation key=IKVYA4KEALFF tag=G3L6S2HHPOAN type=del size=1783301 2024-09-14T10:51:29.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.828+0000 7f19187cc780 1 < completed part key=_multipart_H40763V7HMBC.2~S1RER8TPSCV9.0 size=979270 2024-09-14T10:51:29.828 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.830+0000 7f19187cc780 1 < completed multipart upload key=H40763V7HMBC upload=S1RER8TPSCV9 tag=T353BG3PEPHW type=write size=2027846 2024-09-14T10:51:29.831 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.833+0000 7f19187cc780 1 > prepared part key=_multipart_YA3DI7N4DG5K.2~8UL3CKFRWLZL.0 size=1048576 2024-09-14T10:51:29.833 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.834+0000 7f19187cc780 1 > prepared part key=_multipart_YA3DI7N4DG5K.2~8UL3CKFRWLZL.1 size=1048576 2024-09-14T10:51:29.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.836+0000 7f19187cc780 1 > prepared part key=_multipart_YA3DI7N4DG5K.2~8UL3CKFRWLZL.2 size=355423 2024-09-14T10:51:29.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.836+0000 7f19187cc780 1 > prepared multipart upload key=YA3DI7N4DG5K upload=8UL3CKFRWLZL tag=40ESZF5L7J98 type=write size=3501151 2024-09-14T10:51:29.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.837+0000 7f19187cc780 1 < canceled operation key=CADC2BY888V1 tag=GZ36YQPOD3DD type=write size=519983 2024-09-14T10:51:29.837 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.838+0000 7f19187cc780 1 > prepared operation key=N0L67LS2KHR1 tag=40MVY08PDUWL type=del size=3560273 2024-09-14T10:51:29.840 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.841+0000 7f19187cc780 1 < completed delete operation key=EZLSMEK89N2G tag=263O4XT6XJQL type=del 2024-09-14T10:51:29.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.844+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~W0PGABOHCZQL.0 size=1048576 2024-09-14T10:51:29.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.845+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~W0PGABOHCZQL.1 size=1048576 2024-09-14T10:51:29.845 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.846+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~W0PGABOHCZQL.2 size=321010 2024-09-14T10:51:29.845 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.846+0000 7f19187cc780 1 > prepared multipart upload key=IKVYA4KEALFF upload=W0PGABOHCZQL tag=TUEHS4T0AZQ5 type=write size=3466738 2024-09-14T10:51:29.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.848+0000 7f19187cc780 1 < completed delete operation key=YA3DI7N4DG5K tag=AN14RWYEXDP4 type=del 2024-09-14T10:51:29.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.849+0000 7f19187cc780 1 > prepared operation key=617QQI921HB4 tag=01UYIT13ZVKR type=del size=3338649 2024-09-14T10:51:29.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.852+0000 7f19187cc780 1 < suggested update operation key=H40763V7HMBC tag=RS6VF8Q8SBHG type=write size=255383 2024-09-14T10:51:29.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.854+0000 7f19187cc780 1 > prepared operation key=XCVE2F2JJK4X tag=3RHL65V0MJ83 type=del size=1490398 2024-09-14T10:51:29.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.855+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~NN2IFF1NNHN1.0 size=1048576 2024-09-14T10:51:29.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.856+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~NN2IFF1NNHN1.1 size=81728 2024-09-14T10:51:29.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.859+0000 7f19187cc780 1 < completed multipart upload key=6BNN842ZTWG5 upload=NN2IFF1NNHN1 tag=5ZS1HFEW26AJ type=write size=2178880 2024-09-14T10:51:29.859 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.860+0000 7f19187cc780 1 > prepared operation key=H40763V7HMBC tag=FUVAR1DTKEGK type=del size=1445436 2024-09-14T10:51:29.860 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.862+0000 7f19187cc780 1 < completed write operation key=VW6U36JN2DBX tag=GFXHCWRTPL2A type=write size=691391 2024-09-14T10:51:29.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.864+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~V6O6926OOIAK.0 size=1048576 2024-09-14T10:51:29.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.865+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~V6O6926OOIAK.1 size=1048576 2024-09-14T10:51:29.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.866+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~V6O6926OOIAK.2 size=249472 2024-09-14T10:51:29.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.866+0000 7f19187cc780 1 > prepared multipart upload key=XCVE2F2JJK4X upload=V6O6926OOIAK tag=IK1H9WZJD142 type=write size=3395200 2024-09-14T10:51:29.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.868+0000 7f19187cc780 1 < completed part key=_multipart_XCVE2F2JJK4X.2~QXRHZCW1GWFV.0 size=1048576 2024-09-14T10:51:29.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.869+0000 7f19187cc780 1 < completed part key=_multipart_XCVE2F2JJK4X.2~QXRHZCW1GWFV.1 size=370344 2024-09-14T10:51:29.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.871+0000 7f19187cc780 1 < completed multipart upload key=XCVE2F2JJK4X upload=QXRHZCW1GWFV tag=KV27112XGX0K type=write size=2467496 2024-09-14T10:51:29.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.874+0000 7f19187cc780 1 > prepared part key=_multipart_N0L67LS2KHR1.2~CG8M6MYRJWXE.0 size=584051 2024-09-14T10:51:29.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.874+0000 7f19187cc780 1 > prepared multipart upload key=N0L67LS2KHR1 upload=CG8M6MYRJWXE tag=9EZNHXIBOFUQ type=write size=1632627 2024-09-14T10:51:29.873 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.875+0000 7f19187cc780 1 < completed part key=_multipart_RTGE7ISETJWW.2~7ZR0T6UUWDVT.0 size=877602 2024-09-14T10:51:29.876 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.877+0000 7f19187cc780 1 < completed multipart upload key=RTGE7ISETJWW upload=7ZR0T6UUWDVT tag=BRGRF79VSRIH type=write size=1926178 2024-09-14T10:51:29.877 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.879+0000 7f19187cc780 1 > prepared operation key=6BNN842ZTWG5 tag=EWFSD8Y313GP type=del size=296659 2024-09-14T10:51:29.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.880+0000 7f19187cc780 1 < completed write operation key=M73CER01XHDY tag=69034B7IAURK type=write size=423454 2024-09-14T10:51:29.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.883+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~R6CLUBHJ2JFQ.0 size=1048576 2024-09-14T10:51:29.882 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.884+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~R6CLUBHJ2JFQ.1 size=1048576 2024-09-14T10:51:29.883 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.885+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~R6CLUBHJ2JFQ.2 size=313861 2024-09-14T10:51:29.884 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.885+0000 7f19187cc780 1 > prepared multipart upload key=B9FQYIX19AEP upload=R6CLUBHJ2JFQ tag=XZYMJIN1XB6S type=write size=3459589 2024-09-14T10:51:29.888 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.887+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~N7ZA65CJ0NAK.0 size=1048576 2024-09-14T10:51:29.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.888+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~N7ZA65CJ0NAK.1 size=76708 2024-09-14T10:51:29.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.890+0000 7f19187cc780 1 < completed multipart upload key=7IWUW2HC3ULI upload=N7ZA65CJ0NAK tag=NISK9GCLFG66 type=write size=2173860 2024-09-14T10:51:29.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.891+0000 7f19187cc780 1 > prepared operation key=KP3WOGIF30PZ tag=DD4NQKJN8G94 type=write size=204297 2024-09-14T10:51:29.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.892+0000 7f19187cc780 1 < canceled operation key=QBMNYNWOLK4I tag=RVNEZ0HKX7NF type=del size=1566358 2024-09-14T10:51:29.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.895+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~13YSRQZFCNAL.0 size=1048576 2024-09-14T10:51:29.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.896+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~13YSRQZFCNAL.1 size=638410 2024-09-14T10:51:29.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.896+0000 7f19187cc780 1 > prepared multipart upload key=XCVE2F2JJK4X upload=13YSRQZFCNAL tag=AHAZLIIWVMEI type=write size=2735562 2024-09-14T10:51:29.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.898+0000 7f19187cc780 1 < suggested remove operation key=QFEI6H4EQ9ZR tag=5PQK0L4TXJKB type=del 2024-09-14T10:51:29.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.900+0000 7f19187cc780 1 > prepared operation key=9EBD5ZT6MT45 tag=4QCO1852R6UV type=del size=3384138 2024-09-14T10:51:29.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.901+0000 7f19187cc780 1 < canceled operation key=N0L67LS2KHR1 tag=73VBLQH19JLX type=del size=889614 2024-09-14T10:51:29.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.902+0000 7f19187cc780 1 > prepared operation key=75O00VMLJJ1X tag=XJXK8VF7ODEA type=del size=6457 2024-09-14T10:51:29.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.904+0000 7f19187cc780 1 < completed part key=_multipart_EL00Y4Z7DTAT.2~T3A963B3XTCJ.0 size=1048576 2024-09-14T10:51:29.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.905+0000 7f19187cc780 1 < completed part key=_multipart_EL00Y4Z7DTAT.2~T3A963B3XTCJ.1 size=674972 2024-09-14T10:51:29.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.907+0000 7f19187cc780 1 < completed multipart upload key=EL00Y4Z7DTAT upload=T3A963B3XTCJ tag=XY5ER1BTI953 type=write size=2772124 2024-09-14T10:51:29.908 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.910+0000 7f19187cc780 1 > prepared part key=_multipart_19P3WE6HKJH2.2~KN5PK9WE3KLF.0 size=1048576 2024-09-14T10:51:29.909 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.911+0000 7f19187cc780 1 > prepared part key=_multipart_19P3WE6HKJH2.2~KN5PK9WE3KLF.1 size=74809 2024-09-14T10:51:29.909 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.911+0000 7f19187cc780 1 > prepared multipart upload key=19P3WE6HKJH2 upload=KN5PK9WE3KLF tag=D30SR5HQDX12 type=write size=2171961 2024-09-14T10:51:29.912 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.913+0000 7f19187cc780 1 < suggested remove operation key=IKVYA4KEALFF tag=G3L6S2HHPOAN type=del 2024-09-14T10:51:29.913 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.915+0000 7f19187cc780 1 > prepared operation key=EL00Y4Z7DTAT tag=X299PD0JKZKL type=del size=471378 2024-09-14T10:51:29.914 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.916+0000 7f19187cc780 1 < completed part key=_multipart_YA3DI7N4DG5K.2~8UL3CKFRWLZL.0 size=1048576 2024-09-14T10:51:29.915 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.917+0000 7f19187cc780 1 < completed part key=_multipart_YA3DI7N4DG5K.2~8UL3CKFRWLZL.1 size=1048576 2024-09-14T10:51:29.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.918+0000 7f19187cc780 1 < completed part key=_multipart_YA3DI7N4DG5K.2~8UL3CKFRWLZL.2 size=355423 2024-09-14T10:51:29.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.920+0000 7f19187cc780 1 < completed multipart upload key=YA3DI7N4DG5K upload=8UL3CKFRWLZL tag=40ESZF5L7J98 type=write size=3501151 2024-09-14T10:51:29.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.922+0000 7f19187cc780 1 > prepared operation key=EZLSMEK89N2G tag=766TFYLJQDB9 type=del size=256271 2024-09-14T10:51:29.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.923+0000 7f19187cc780 1 < completed delete operation key=N0L67LS2KHR1 tag=40MVY08PDUWL type=del 2024-09-14T10:51:29.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.925+0000 7f19187cc780 1 > prepared operation key=61O2VU0SB379 tag=9SM4DM91ZE6G type=del size=1837323 2024-09-14T10:51:29.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.926+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~W0PGABOHCZQL.0 size=1048576 2024-09-14T10:51:29.926 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.927+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~W0PGABOHCZQL.1 size=1048576 2024-09-14T10:51:29.927 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.929+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~W0PGABOHCZQL.2 size=321010 2024-09-14T10:51:29.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.931+0000 7f19187cc780 1 < completed multipart upload key=IKVYA4KEALFF upload=W0PGABOHCZQL tag=TUEHS4T0AZQ5 type=write size=3466738 2024-09-14T10:51:29.932 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.933+0000 7f19187cc780 1 > prepared part key=_multipart_M73CER01XHDY.2~Q3SC0T049P35.0 size=87054 2024-09-14T10:51:29.932 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.933+0000 7f19187cc780 1 > prepared multipart upload key=M73CER01XHDY upload=Q3SC0T049P35 tag=A1DLNFMK70D6 type=write size=1135630 2024-09-14T10:51:29.933 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.935+0000 7f19187cc780 1 < completed delete operation key=617QQI921HB4 tag=01UYIT13ZVKR type=del 2024-09-14T10:51:29.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.937+0000 7f19187cc780 1 > prepared operation key=VW6U36JN2DBX tag=HT8VXHYWZ1DK type=del size=1672386 2024-09-14T10:51:29.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.938+0000 7f19187cc780 1 < completed delete operation key=XCVE2F2JJK4X tag=3RHL65V0MJ83 type=del 2024-09-14T10:51:29.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.940+0000 7f19187cc780 1 > prepared operation key=61O2VU0SB379 tag=PEVFPVKTNUC8 type=del size=3273779 2024-09-14T10:51:29.939 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.941+0000 7f19187cc780 1 < completed delete operation key=H40763V7HMBC tag=FUVAR1DTKEGK type=del 2024-09-14T10:51:29.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.943+0000 7f19187cc780 1 > prepared operation key=KOJ7QB7M6A35 tag=G52KX6MUK7AZ type=del size=4099920 2024-09-14T10:51:29.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.944+0000 7f19187cc780 1 < completed part key=_multipart_XCVE2F2JJK4X.2~V6O6926OOIAK.0 size=1048576 2024-09-14T10:51:29.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.945+0000 7f19187cc780 1 < completed part key=_multipart_XCVE2F2JJK4X.2~V6O6926OOIAK.1 size=1048576 2024-09-14T10:51:29.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.946+0000 7f19187cc780 1 < completed part key=_multipart_XCVE2F2JJK4X.2~V6O6926OOIAK.2 size=249472 2024-09-14T10:51:29.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.949+0000 7f19187cc780 1 < completed multipart upload key=XCVE2F2JJK4X upload=V6O6926OOIAK tag=IK1H9WZJD142 type=write size=3395200 2024-09-14T10:51:29.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.952+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~ESSTYTYCBR3E.0 size=264907 2024-09-14T10:51:29.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.952+0000 7f19187cc780 1 > prepared multipart upload key=VW6U36JN2DBX upload=ESSTYTYCBR3E tag=G207FDIRR21Q type=write size=1313483 2024-09-14T10:51:29.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.953+0000 7f19187cc780 1 < completed part key=_multipart_N0L67LS2KHR1.2~CG8M6MYRJWXE.0 size=584051 2024-09-14T10:51:29.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.955+0000 7f19187cc780 1 < completed multipart upload key=N0L67LS2KHR1 upload=CG8M6MYRJWXE tag=9EZNHXIBOFUQ type=write size=1632627 2024-09-14T10:51:29.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.957+0000 7f19187cc780 1 > prepared operation key=5AIAYJMRZGFQ tag=25JBH6I8BTRA type=del size=3376020 2024-09-14T10:51:29.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.958+0000 7f19187cc780 1 < completed delete operation key=6BNN842ZTWG5 tag=EWFSD8Y313GP type=del 2024-09-14T10:51:29.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.961+0000 7f19187cc780 1 > prepared part key=_multipart_W1K1IU13J0CZ.2~OW39QBLHH9ZZ.0 size=1048576 2024-09-14T10:51:29.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.962+0000 7f19187cc780 1 > prepared part key=_multipart_W1K1IU13J0CZ.2~OW39QBLHH9ZZ.1 size=108155 2024-09-14T10:51:29.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.962+0000 7f19187cc780 1 > prepared multipart upload key=W1K1IU13J0CZ upload=OW39QBLHH9ZZ tag=6K8KZBVJ0V37 type=write size=2205307 2024-09-14T10:51:29.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.963+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~R6CLUBHJ2JFQ.0 size=1048576 2024-09-14T10:51:29.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.965+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~R6CLUBHJ2JFQ.1 size=1048576 2024-09-14T10:51:29.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.966+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~R6CLUBHJ2JFQ.2 size=313861 2024-09-14T10:51:29.967 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.969+0000 7f19187cc780 1 < completed multipart upload key=B9FQYIX19AEP upload=R6CLUBHJ2JFQ tag=XZYMJIN1XB6S type=write size=3459589 2024-09-14T10:51:29.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.970+0000 7f19187cc780 1 > prepared operation key=E6UO1LUWOC44 tag=HKYO6LY01IOD type=del size=2142136 2024-09-14T10:51:29.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.971+0000 7f19187cc780 1 < completed write operation key=KP3WOGIF30PZ tag=DD4NQKJN8G94 type=write size=204297 2024-09-14T10:51:29.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.973+0000 7f19187cc780 1 > prepared part key=_multipart_QFEI6H4EQ9ZR.2~87CU4MOH94DE.0 size=1048576 2024-09-14T10:51:29.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.974+0000 7f19187cc780 1 > prepared part key=_multipart_QFEI6H4EQ9ZR.2~87CU4MOH94DE.1 size=1006700 2024-09-14T10:51:29.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.974+0000 7f19187cc780 1 > prepared multipart upload key=QFEI6H4EQ9ZR upload=87CU4MOH94DE tag=R6QVSZF3ZJGZ type=write size=3103852 2024-09-14T10:51:29.974 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.976+0000 7f19187cc780 1 < completed part key=_multipart_XCVE2F2JJK4X.2~13YSRQZFCNAL.0 size=1048576 2024-09-14T10:51:29.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.977+0000 7f19187cc780 1 < completed part key=_multipart_XCVE2F2JJK4X.2~13YSRQZFCNAL.1 size=638410 2024-09-14T10:51:29.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.979+0000 7f19187cc780 1 < completed multipart upload key=XCVE2F2JJK4X upload=13YSRQZFCNAL tag=AHAZLIIWVMEI type=write size=2735562 2024-09-14T10:51:29.979 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.981+0000 7f19187cc780 1 > prepared part key=_multipart_H40763V7HMBC.2~2UJ2S32MQNQC.0 size=13821 2024-09-14T10:51:29.979 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.981+0000 7f19187cc780 1 > prepared multipart upload key=H40763V7HMBC upload=2UJ2S32MQNQC tag=545FO0CPXR1C type=write size=1062397 2024-09-14T10:51:29.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.982+0000 7f19187cc780 1 < completed delete operation key=9EBD5ZT6MT45 tag=4QCO1852R6UV type=del 2024-09-14T10:51:29.982 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.984+0000 7f19187cc780 1 > prepared operation key=INJQTKXHBUV2 tag=9JMSACH4SEOU type=del size=3619166 2024-09-14T10:51:29.983 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.985+0000 7f19187cc780 1 < canceled operation key=75O00VMLJJ1X tag=XJXK8VF7ODEA type=del size=6457 2024-09-14T10:51:29.984 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.986+0000 7f19187cc780 1 > prepared operation key=9EBD5ZT6MT45 tag=UAVI9M5K5NGK type=write size=988838 2024-09-14T10:51:29.986 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.987+0000 7f19187cc780 1 < completed part key=_multipart_19P3WE6HKJH2.2~KN5PK9WE3KLF.0 size=1048576 2024-09-14T10:51:29.986 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.987+0000 7f19187cc780 1 < canceled part key=_multipart_19P3WE6HKJH2.2~KN5PK9WE3KLF.1 size=74809 2024-09-14T10:51:29.988 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.990+0000 7f19187cc780 1 < canceled multipart upload key=19P3WE6HKJH2 upload=KN5PK9WE3KLF tag=D30SR5HQDX12 type=write size=2171961 2024-09-14T10:51:29.989 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.991+0000 7f19187cc780 1 > prepared operation key=RTGE7ISETJWW tag=U3MFMID05GTW type=del size=1944302 2024-09-14T10:51:29.991 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.992+0000 7f19187cc780 1 < completed delete operation key=EL00Y4Z7DTAT tag=X299PD0JKZKL type=del 2024-09-14T10:51:29.992 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.993+0000 7f19187cc780 1 > prepared operation key=W1K1IU13J0CZ tag=BJ096M1J2PZL type=write size=18157 2024-09-14T10:51:29.993 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.995+0000 7f19187cc780 1 < completed delete operation key=EZLSMEK89N2G tag=766TFYLJQDB9 type=del 2024-09-14T10:51:29.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.996+0000 7f19187cc780 1 > prepared operation key=W1K1IU13J0CZ tag=IYWSHGR44A2W type=del size=2934314 2024-09-14T10:51:29.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:29.999+0000 7f19187cc780 1 < suggested update operation key=61O2VU0SB379 tag=9SM4DM91ZE6G type=del size=1837323 2024-09-14T10:51:30.000 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.002+0000 7f19187cc780 1 > prepared part key=_multipart_EL00Y4Z7DTAT.2~9Y4RHKSIW1MY.0 size=1048576 2024-09-14T10:51:30.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.004+0000 7f19187cc780 1 > prepared part key=_multipart_EL00Y4Z7DTAT.2~9Y4RHKSIW1MY.1 size=27407 2024-09-14T10:51:30.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.004+0000 7f19187cc780 1 > prepared multipart upload key=EL00Y4Z7DTAT upload=9Y4RHKSIW1MY tag=ZE6X044DP9SB type=write size=2124559 2024-09-14T10:51:30.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.006+0000 7f19187cc780 1 < completed part key=_multipart_M73CER01XHDY.2~Q3SC0T049P35.0 size=87054 2024-09-14T10:51:30.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.008+0000 7f19187cc780 1 < completed multipart upload key=M73CER01XHDY upload=Q3SC0T049P35 tag=A1DLNFMK70D6 type=write size=1135630 2024-09-14T10:51:30.009 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.011+0000 7f19187cc780 1 > prepared part key=_multipart_61O2VU0SB379.2~DS4KJKJLXSJ4.0 size=1048576 2024-09-14T10:51:30.010 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.012+0000 7f19187cc780 1 > prepared part key=_multipart_61O2VU0SB379.2~DS4KJKJLXSJ4.1 size=139199 2024-09-14T10:51:30.010 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.012+0000 7f19187cc780 1 > prepared multipart upload key=61O2VU0SB379 upload=DS4KJKJLXSJ4 tag=BKJ1RN2W5T0U type=write size=2236351 2024-09-14T10:51:30.012 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.013+0000 7f19187cc780 1 < completed delete operation key=VW6U36JN2DBX tag=HT8VXHYWZ1DK type=del 2024-09-14T10:51:30.014 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.016+0000 7f19187cc780 1 > prepared part key=_multipart_RTGE7ISETJWW.2~E2QER8CYCADU.0 size=45141 2024-09-14T10:51:30.014 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.016+0000 7f19187cc780 1 > prepared multipart upload key=RTGE7ISETJWW upload=E2QER8CYCADU tag=PXIZ9X3W9W0U type=write size=1093717 2024-09-14T10:51:30.016 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.017+0000 7f19187cc780 -1 < failed to complete operation key=61O2VU0SB379 tag=PEVFPVKTNUC8 type=del size=3273779: (22) Invalid argument 2024-09-14T10:51:30.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.020+0000 7f19187cc780 1 > prepared part key=_multipart_W1K1IU13J0CZ.2~6ANWUXYUMVV0.0 size=1048576 2024-09-14T10:51:30.019 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.021+0000 7f19187cc780 1 > prepared part key=_multipart_W1K1IU13J0CZ.2~6ANWUXYUMVV0.1 size=438536 2024-09-14T10:51:30.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.021+0000 7f19187cc780 1 > prepared multipart upload key=W1K1IU13J0CZ upload=6ANWUXYUMVV0 tag=HBPT0YPAEJO5 type=write size=2535688 2024-09-14T10:51:30.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.023+0000 7f19187cc780 1 < completed delete operation key=KOJ7QB7M6A35 tag=G52KX6MUK7AZ type=del 2024-09-14T10:51:30.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.024+0000 7f19187cc780 1 > prepared operation key=INJQTKXHBUV2 tag=D52O2CNTM6A7 type=del size=2622694 2024-09-14T10:51:30.024 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.025+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~ESSTYTYCBR3E.0 size=264907 2024-09-14T10:51:30.026 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.028+0000 7f19187cc780 1 < completed multipart upload key=VW6U36JN2DBX upload=ESSTYTYCBR3E tag=G207FDIRR21Q type=write size=1313483 2024-09-14T10:51:30.027 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.029+0000 7f19187cc780 1 > prepared operation key=IKVYA4KEALFF tag=9A0MKOJBHQQK type=write size=700416 2024-09-14T10:51:30.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.032+0000 7f19187cc780 1 < suggested update operation key=5AIAYJMRZGFQ tag=25JBH6I8BTRA type=del size=3376020 2024-09-14T10:51:30.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.033+0000 7f19187cc780 1 > prepared operation key=M73CER01XHDY tag=04UZI5GYXV03 type=del size=2064735 2024-09-14T10:51:30.033 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.035+0000 7f19187cc780 1 < completed part key=_multipart_W1K1IU13J0CZ.2~OW39QBLHH9ZZ.0 size=1048576 2024-09-14T10:51:30.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.036+0000 7f19187cc780 1 < completed part key=_multipart_W1K1IU13J0CZ.2~OW39QBLHH9ZZ.1 size=108155 2024-09-14T10:51:30.037 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.038+0000 7f19187cc780 1 < completed multipart upload key=W1K1IU13J0CZ upload=OW39QBLHH9ZZ tag=6K8KZBVJ0V37 type=write size=2205307 2024-09-14T10:51:30.039 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.041+0000 7f19187cc780 1 > prepared part key=_multipart_EZLSMEK89N2G.2~QBQ8WV8SHP6Y.0 size=1048576 2024-09-14T10:51:30.040 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.042+0000 7f19187cc780 1 > prepared part key=_multipart_EZLSMEK89N2G.2~QBQ8WV8SHP6Y.1 size=1048576 2024-09-14T10:51:30.041 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.043+0000 7f19187cc780 1 > prepared part key=_multipart_EZLSMEK89N2G.2~QBQ8WV8SHP6Y.2 size=374882 2024-09-14T10:51:30.042 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.043+0000 7f19187cc780 1 > prepared multipart upload key=EZLSMEK89N2G upload=QBQ8WV8SHP6Y tag=I8VC5M4XAH5D type=write size=3520610 2024-09-14T10:51:30.043 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.044+0000 7f19187cc780 1 < completed delete operation key=E6UO1LUWOC44 tag=HKYO6LY01IOD type=del 2024-09-14T10:51:30.044 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.046+0000 7f19187cc780 1 > prepared operation key=W1K1IU13J0CZ tag=AFXFJBPR1ERW type=write size=813027 2024-09-14T10:51:30.045 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.047+0000 7f19187cc780 1 < completed part key=_multipart_QFEI6H4EQ9ZR.2~87CU4MOH94DE.0 size=1048576 2024-09-14T10:51:30.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.048+0000 7f19187cc780 1 < completed part key=_multipart_QFEI6H4EQ9ZR.2~87CU4MOH94DE.1 size=1006700 2024-09-14T10:51:30.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.050+0000 7f19187cc780 1 < completed multipart upload key=QFEI6H4EQ9ZR upload=87CU4MOH94DE tag=R6QVSZF3ZJGZ type=write size=3103852 2024-09-14T10:51:30.050 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.052+0000 7f19187cc780 1 > prepared operation key=E6UO1LUWOC44 tag=V4JRX1US7XBL type=del size=2623520 2024-09-14T10:51:30.052 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.053+0000 7f19187cc780 1 < completed part key=_multipart_H40763V7HMBC.2~2UJ2S32MQNQC.0 size=13821 2024-09-14T10:51:30.054 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.056+0000 7f19187cc780 1 < completed multipart upload key=H40763V7HMBC upload=2UJ2S32MQNQC tag=545FO0CPXR1C type=write size=1062397 2024-09-14T10:51:30.055 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.057+0000 7f19187cc780 1 > prepared operation key=19P3WE6HKJH2 tag=4C058GA57SC4 type=write size=79863 2024-09-14T10:51:30.057 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.058+0000 7f19187cc780 1 < completed delete operation key=INJQTKXHBUV2 tag=9JMSACH4SEOU type=del 2024-09-14T10:51:30.059 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.061+0000 7f19187cc780 1 > prepared part key=_multipart_YA3DI7N4DG5K.2~DBT2ATM6BY3L.0 size=1048576 2024-09-14T10:51:30.060 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.062+0000 7f19187cc780 1 > prepared part key=_multipart_YA3DI7N4DG5K.2~DBT2ATM6BY3L.1 size=190943 2024-09-14T10:51:30.060 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.062+0000 7f19187cc780 1 > prepared multipart upload key=YA3DI7N4DG5K upload=DBT2ATM6BY3L tag=KPTS80FF7RBU type=write size=2288095 2024-09-14T10:51:30.062 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.063+0000 7f19187cc780 1 < completed write operation key=9EBD5ZT6MT45 tag=UAVI9M5K5NGK type=write size=988838 2024-09-14T10:51:30.063 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.065+0000 7f19187cc780 1 > prepared operation key=AST81B9QWORT tag=V8NFM8ITCX9Y type=del size=2754940 2024-09-14T10:51:30.064 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.066+0000 7f19187cc780 1 < completed delete operation key=RTGE7ISETJWW tag=U3MFMID05GTW type=del 2024-09-14T10:51:30.066 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.067+0000 7f19187cc780 1 > prepared operation key=9EBD5ZT6MT45 tag=74AWH4NZ202W type=del size=2810121 2024-09-14T10:51:30.067 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.069+0000 7f19187cc780 1 < completed write operation key=W1K1IU13J0CZ tag=BJ096M1J2PZL type=write size=18157 2024-09-14T10:51:30.070 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.072+0000 7f19187cc780 1 > prepared part key=_multipart_19P3WE6HKJH2.2~OGD2RGVRLRI0.0 size=1048576 2024-09-14T10:51:30.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.073+0000 7f19187cc780 1 > prepared part key=_multipart_19P3WE6HKJH2.2~OGD2RGVRLRI0.1 size=65266 2024-09-14T10:51:30.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.073+0000 7f19187cc780 1 > prepared multipart upload key=19P3WE6HKJH2 upload=OGD2RGVRLRI0 tag=NO88Z2HVPQGT type=write size=2162418 2024-09-14T10:51:30.074 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.075+0000 7f19187cc780 1 < suggested update operation key=W1K1IU13J0CZ tag=IYWSHGR44A2W type=del size=2934314 2024-09-14T10:51:30.076 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.077+0000 7f19187cc780 1 > prepared operation key=MFA30GSMCSKP tag=CEYG925LO7ZM type=del size=3629380 2024-09-14T10:51:30.077 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.079+0000 7f19187cc780 1 < completed part key=_multipart_EL00Y4Z7DTAT.2~9Y4RHKSIW1MY.0 size=1048576 2024-09-14T10:51:30.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.080+0000 7f19187cc780 1 < completed part key=_multipart_EL00Y4Z7DTAT.2~9Y4RHKSIW1MY.1 size=27407 2024-09-14T10:51:30.081 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.083+0000 7f19187cc780 1 < completed multipart upload key=EL00Y4Z7DTAT upload=9Y4RHKSIW1MY tag=ZE6X044DP9SB type=write size=2124559 2024-09-14T10:51:30.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.084+0000 7f19187cc780 1 > prepared operation key=QBMNYNWOLK4I tag=NYK9M17FXK6N type=del size=767344 2024-09-14T10:51:30.085 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.086+0000 7f19187cc780 1 < completed part key=_multipart_61O2VU0SB379.2~DS4KJKJLXSJ4.0 size=1048576 2024-09-14T10:51:30.086 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.087+0000 7f19187cc780 1 < completed part key=_multipart_61O2VU0SB379.2~DS4KJKJLXSJ4.1 size=139199 2024-09-14T10:51:30.089 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.090+0000 7f19187cc780 1 < completed multipart upload key=61O2VU0SB379 upload=DS4KJKJLXSJ4 tag=BKJ1RN2W5T0U type=write size=2236351 2024-09-14T10:51:30.093 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.093+0000 7f19187cc780 1 > prepared part key=_multipart_INJQTKXHBUV2.2~ZS15USZK9I5Y.0 size=731343 2024-09-14T10:51:30.093 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.093+0000 7f19187cc780 1 > prepared multipart upload key=INJQTKXHBUV2 upload=ZS15USZK9I5Y tag=SPVFUD7PM0DX type=write size=1779919 2024-09-14T10:51:30.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.095+0000 7f19187cc780 1 < completed part key=_multipart_RTGE7ISETJWW.2~E2QER8CYCADU.0 size=45141 2024-09-14T10:51:30.097 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.098+0000 7f19187cc780 1 < completed multipart upload key=RTGE7ISETJWW upload=E2QER8CYCADU tag=PXIZ9X3W9W0U type=write size=1093717 2024-09-14T10:51:30.098 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.100+0000 7f19187cc780 1 > prepared operation key=YA3DI7N4DG5K tag=81TU74KI9DVQ type=del size=1762604 2024-09-14T10:51:30.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.102+0000 7f19187cc780 1 < completed part key=_multipart_W1K1IU13J0CZ.2~6ANWUXYUMVV0.0 size=1048576 2024-09-14T10:51:30.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.103+0000 7f19187cc780 1 < completed part key=_multipart_W1K1IU13J0CZ.2~6ANWUXYUMVV0.1 size=438536 2024-09-14T10:51:30.104 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.106+0000 7f19187cc780 1 < completed multipart upload key=W1K1IU13J0CZ upload=6ANWUXYUMVV0 tag=HBPT0YPAEJO5 type=write size=2535688 2024-09-14T10:51:30.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.107+0000 7f19187cc780 1 > prepared operation key=54BSD3DEHNK6 tag=04PLBVP578MX type=del size=971208 2024-09-14T10:51:30.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.110+0000 7f19187cc780 1 < suggested update operation key=INJQTKXHBUV2 tag=D52O2CNTM6A7 type=del size=2622694 2024-09-14T10:51:30.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.112+0000 7f19187cc780 1 > prepared operation key=61O2VU0SB379 tag=7I1WHN4VJIKG type=write size=695171 2024-09-14T10:51:30.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.115+0000 7f19187cc780 1 < suggested update operation key=IKVYA4KEALFF tag=9A0MKOJBHQQK type=write size=700416 2024-09-14T10:51:30.116 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.118+0000 7f19187cc780 1 > prepared part key=_multipart_EL00Y4Z7DTAT.2~A53VPHGWDZ21.0 size=1048576 2024-09-14T10:51:30.117 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.119+0000 7f19187cc780 1 > prepared part key=_multipart_EL00Y4Z7DTAT.2~A53VPHGWDZ21.1 size=948508 2024-09-14T10:51:30.117 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.119+0000 7f19187cc780 1 > prepared multipart upload key=EL00Y4Z7DTAT upload=A53VPHGWDZ21 tag=3D1X9JE1X4C1 type=write size=3045660 2024-09-14T10:51:30.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.120+0000 7f19187cc780 1 < completed delete operation key=M73CER01XHDY tag=04UZI5GYXV03 type=del 2024-09-14T10:51:30.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.123+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~3U9QKGQQEII6.0 size=1048576 2024-09-14T10:51:30.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.124+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~3U9QKGQQEII6.1 size=985810 2024-09-14T10:51:30.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.124+0000 7f19187cc780 1 > prepared multipart upload key=B9FQYIX19AEP upload=3U9QKGQQEII6 tag=UPX4AQ9G10SQ type=write size=3082962 2024-09-14T10:51:30.124 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.126+0000 7f19187cc780 1 < completed part key=_multipart_EZLSMEK89N2G.2~QBQ8WV8SHP6Y.0 size=1048576 2024-09-14T10:51:30.126 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.127+0000 7f19187cc780 1 < completed part key=_multipart_EZLSMEK89N2G.2~QBQ8WV8SHP6Y.1 size=1048576 2024-09-14T10:51:30.127 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.128+0000 7f19187cc780 1 < completed part key=_multipart_EZLSMEK89N2G.2~QBQ8WV8SHP6Y.2 size=374882 2024-09-14T10:51:30.130 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.131+0000 7f19187cc780 1 < completed multipart upload key=EZLSMEK89N2G upload=QBQ8WV8SHP6Y tag=I8VC5M4XAH5D type=write size=3520610 2024-09-14T10:51:30.131 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.133+0000 7f19187cc780 1 > prepared operation key=9EBD5ZT6MT45 tag=60S36KHBWYF7 type=del size=852384 2024-09-14T10:51:30.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.134+0000 7f19187cc780 -1 < failed to complete operation key=W1K1IU13J0CZ tag=AFXFJBPR1ERW type=write size=813027: (22) Invalid argument 2024-09-14T10:51:30.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.137+0000 7f19187cc780 1 > prepared part key=_multipart_EZLSMEK89N2G.2~0VFV2ZLVLJK4.0 size=1048576 2024-09-14T10:51:30.137 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.138+0000 7f19187cc780 1 > prepared part key=_multipart_EZLSMEK89N2G.2~0VFV2ZLVLJK4.1 size=365810 2024-09-14T10:51:30.137 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.138+0000 7f19187cc780 1 > prepared multipart upload key=EZLSMEK89N2G upload=0VFV2ZLVLJK4 tag=EVUWQDY2D8T4 type=write size=2462962 2024-09-14T10:51:30.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.141+0000 7f19187cc780 1 < canceled operation key=E6UO1LUWOC44 tag=V4JRX1US7XBL type=del size=2623520 2024-09-14T10:51:30.142 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.144+0000 7f19187cc780 1 > prepared part key=_multipart_INJQTKXHBUV2.2~XA6M2XC25A77.0 size=457501 2024-09-14T10:51:30.142 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.144+0000 7f19187cc780 1 > prepared multipart upload key=INJQTKXHBUV2 upload=XA6M2XC25A77 tag=B9BGN7B6Q3AO type=write size=1506077 2024-09-14T10:51:30.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.147+0000 7f19187cc780 1 < suggested remove operation key=19P3WE6HKJH2 tag=4C058GA57SC4 type=write 2024-09-14T10:51:30.147 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.149+0000 7f19187cc780 1 > prepared operation key=EL00Y4Z7DTAT tag=3OB2O45AHO2V type=del size=3241579 2024-09-14T10:51:30.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.150+0000 7f19187cc780 1 < completed part key=_multipart_YA3DI7N4DG5K.2~DBT2ATM6BY3L.0 size=1048576 2024-09-14T10:51:30.150 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.152+0000 7f19187cc780 1 < completed part key=_multipart_YA3DI7N4DG5K.2~DBT2ATM6BY3L.1 size=190943 2024-09-14T10:51:30.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.154+0000 7f19187cc780 1 < completed multipart upload key=YA3DI7N4DG5K upload=DBT2ATM6BY3L tag=KPTS80FF7RBU type=write size=2288095 2024-09-14T10:51:30.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.156+0000 7f19187cc780 1 > prepared operation key=OVOPGTYUF3F3 tag=U94IFLRB5OSO type=write size=465522 2024-09-14T10:51:30.156 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.157+0000 7f19187cc780 1 < completed delete operation key=AST81B9QWORT tag=V8NFM8ITCX9Y type=del 2024-09-14T10:51:30.157 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.159+0000 7f19187cc780 1 > prepared operation key=RTGE7ISETJWW tag=W4TGPZ4GD4WS type=del size=1057515 2024-09-14T10:51:30.160 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.161+0000 7f19187cc780 1 < suggested remove operation key=9EBD5ZT6MT45 tag=74AWH4NZ202W type=del 2024-09-14T10:51:30.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.163+0000 7f19187cc780 1 > prepared operation key=W1K1IU13J0CZ tag=4GHUGANO1I6O type=del size=2627330 2024-09-14T10:51:30.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.164+0000 7f19187cc780 1 < completed part key=_multipart_19P3WE6HKJH2.2~OGD2RGVRLRI0.0 size=1048576 2024-09-14T10:51:30.164 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.166+0000 7f19187cc780 1 < completed part key=_multipart_19P3WE6HKJH2.2~OGD2RGVRLRI0.1 size=65266 2024-09-14T10:51:30.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.168+0000 7f19187cc780 1 < completed multipart upload key=19P3WE6HKJH2 upload=OGD2RGVRLRI0 tag=NO88Z2HVPQGT type=write size=2162418 2024-09-14T10:51:30.169 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.171+0000 7f19187cc780 1 > prepared part key=_multipart_H40763V7HMBC.2~SUVQP5WROJQH.0 size=1048576 2024-09-14T10:51:30.170 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.172+0000 7f19187cc780 1 > prepared part key=_multipart_H40763V7HMBC.2~SUVQP5WROJQH.1 size=1048576 2024-09-14T10:51:30.171 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.173+0000 7f19187cc780 1 > prepared part key=_multipart_H40763V7HMBC.2~SUVQP5WROJQH.2 size=273665 2024-09-14T10:51:30.171 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.173+0000 7f19187cc780 1 > prepared multipart upload key=H40763V7HMBC upload=SUVQP5WROJQH tag=U5J5M5JUESZL type=write size=3419393 2024-09-14T10:51:30.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.174+0000 7f19187cc780 1 < canceled operation key=MFA30GSMCSKP tag=CEYG925LO7ZM type=del size=3629380 2024-09-14T10:51:30.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.176+0000 7f19187cc780 1 > prepared operation key=IKVYA4KEALFF tag=B4CPEWRMYVQW type=write size=957810 2024-09-14T10:51:30.175 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.177+0000 7f19187cc780 1 < completed delete operation key=QBMNYNWOLK4I tag=NYK9M17FXK6N type=del 2024-09-14T10:51:30.178 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.180+0000 7f19187cc780 1 > prepared part key=_multipart_EL00Y4Z7DTAT.2~5DB47R44AS66.0 size=1048576 2024-09-14T10:51:30.179 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.181+0000 7f19187cc780 1 > prepared part key=_multipart_EL00Y4Z7DTAT.2~5DB47R44AS66.1 size=462038 2024-09-14T10:51:30.179 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.181+0000 7f19187cc780 1 > prepared multipart upload key=EL00Y4Z7DTAT upload=5DB47R44AS66 tag=KM4Q5RMTL45M type=write size=2559190 2024-09-14T10:51:30.181 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.182+0000 7f19187cc780 1 < completed part key=_multipart_INJQTKXHBUV2.2~ZS15USZK9I5Y.0 size=731343 2024-09-14T10:51:30.184 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.185+0000 7f19187cc780 1 < completed multipart upload key=INJQTKXHBUV2 upload=ZS15USZK9I5Y tag=SPVFUD7PM0DX type=write size=1779919 2024-09-14T10:51:30.185 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.187+0000 7f19187cc780 1 > prepared operation key=YA3DI7N4DG5K tag=WEGEHT6EA2FX type=del size=3920241 2024-09-14T10:51:30.189 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.190+0000 7f19187cc780 1 < suggested update operation key=YA3DI7N4DG5K tag=81TU74KI9DVQ type=del size=1762604 2024-09-14T10:51:30.191 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.192+0000 7f19187cc780 1 > prepared operation key=OVOPGTYUF3F3 tag=9WMA3Q4UYWF6 type=del size=3726754 2024-09-14T10:51:30.193 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.194+0000 7f19187cc780 1 < completed delete operation key=54BSD3DEHNK6 tag=04PLBVP578MX type=del 2024-09-14T10:51:30.194 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.196+0000 7f19187cc780 1 > prepared operation key=75O00VMLJJ1X tag=PKZSV1OQHH4X type=del size=1851685 2024-09-14T10:51:30.196 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.197+0000 7f19187cc780 1 < completed write operation key=61O2VU0SB379 tag=7I1WHN4VJIKG type=write size=695171 2024-09-14T10:51:30.197 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.199+0000 7f19187cc780 1 > prepared operation key=EL00Y4Z7DTAT tag=4JBKE09O52NQ type=write size=849921 2024-09-14T10:51:30.197 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.199+0000 7f19187cc780 1 < canceled part key=_multipart_EL00Y4Z7DTAT.2~A53VPHGWDZ21.0 size=1048576 2024-09-14T10:51:30.199 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.200+0000 7f19187cc780 1 < completed part key=_multipart_EL00Y4Z7DTAT.2~A53VPHGWDZ21.1 size=948508 2024-09-14T10:51:30.201 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.203+0000 7f19187cc780 1 < canceled multipart upload key=EL00Y4Z7DTAT upload=A53VPHGWDZ21 tag=3D1X9JE1X4C1 type=write size=3045660 2024-09-14T10:51:30.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.204+0000 7f19187cc780 1 > prepared operation key=N0L67LS2KHR1 tag=O2IBFWPTVRA4 type=write size=552736 2024-09-14T10:51:30.204 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.206+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~3U9QKGQQEII6.0 size=1048576 2024-09-14T10:51:30.205 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.207+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~3U9QKGQQEII6.1 size=985810 2024-09-14T10:51:30.208 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.209+0000 7f19187cc780 1 < completed multipart upload key=B9FQYIX19AEP upload=3U9QKGQQEII6 tag=UPX4AQ9G10SQ type=write size=3082962 2024-09-14T10:51:30.209 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.211+0000 7f19187cc780 1 > prepared operation key=EZLSMEK89N2G tag=H675PLBA1LUG type=del size=4116716 2024-09-14T10:51:30.211 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.212+0000 7f19187cc780 -1 < failed to complete operation key=9EBD5ZT6MT45 tag=60S36KHBWYF7 type=del size=852384: (22) Invalid argument 2024-09-14T10:51:30.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.215+0000 7f19187cc780 1 > prepared part key=_multipart_QFEI6H4EQ9ZR.2~5IU50C7HSNAB.0 size=1048576 2024-09-14T10:51:30.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.216+0000 7f19187cc780 1 > prepared part key=_multipart_QFEI6H4EQ9ZR.2~5IU50C7HSNAB.1 size=1048576 2024-09-14T10:51:30.216 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.218+0000 7f19187cc780 1 > prepared part key=_multipart_QFEI6H4EQ9ZR.2~5IU50C7HSNAB.2 size=421023 2024-09-14T10:51:30.216 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.218+0000 7f19187cc780 1 > prepared multipart upload key=QFEI6H4EQ9ZR upload=5IU50C7HSNAB tag=TIRUL2IIBEE9 type=write size=3566751 2024-09-14T10:51:30.218 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.219+0000 7f19187cc780 1 < completed part key=_multipart_EZLSMEK89N2G.2~0VFV2ZLVLJK4.0 size=1048576 2024-09-14T10:51:30.219 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.220+0000 7f19187cc780 1 < completed part key=_multipart_EZLSMEK89N2G.2~0VFV2ZLVLJK4.1 size=365810 2024-09-14T10:51:30.221 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.223+0000 7f19187cc780 1 < completed multipart upload key=EZLSMEK89N2G upload=0VFV2ZLVLJK4 tag=EVUWQDY2D8T4 type=write size=2462962 2024-09-14T10:51:30.224 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.225+0000 7f19187cc780 1 > prepared part key=_multipart_EL00Y4Z7DTAT.2~CDHCE1ENI39U.0 size=1048576 2024-09-14T10:51:30.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.226+0000 7f19187cc780 1 > prepared part key=_multipart_EL00Y4Z7DTAT.2~CDHCE1ENI39U.1 size=1048576 2024-09-14T10:51:30.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.228+0000 7f19187cc780 1 > prepared part key=_multipart_EL00Y4Z7DTAT.2~CDHCE1ENI39U.2 size=805187 2024-09-14T10:51:30.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.228+0000 7f19187cc780 1 > prepared multipart upload key=EL00Y4Z7DTAT upload=CDHCE1ENI39U tag=NEDZWUS9SN40 type=write size=3950915 2024-09-14T10:51:30.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.229+0000 7f19187cc780 1 < completed part key=_multipart_INJQTKXHBUV2.2~XA6M2XC25A77.0 size=457501 2024-09-14T10:51:30.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.231+0000 7f19187cc780 1 < completed multipart upload key=INJQTKXHBUV2 upload=XA6M2XC25A77 tag=B9BGN7B6Q3AO type=write size=1506077 2024-09-14T10:51:30.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.234+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~5YQVCF2TFNQG.0 size=1048576 2024-09-14T10:51:30.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.235+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~5YQVCF2TFNQG.1 size=1048576 2024-09-14T10:51:30.234 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.236+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~5YQVCF2TFNQG.2 size=401230 2024-09-14T10:51:30.234 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.236+0000 7f19187cc780 1 > prepared multipart upload key=KOJ7QB7M6A35 upload=5YQVCF2TFNQG tag=26S2HTB3EUSP type=write size=3546958 2024-09-14T10:51:30.238 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.240+0000 7f19187cc780 1 < suggested remove operation key=EL00Y4Z7DTAT tag=3OB2O45AHO2V type=del 2024-09-14T10:51:30.239 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.241+0000 7f19187cc780 1 > prepared operation key=AGNUE76X8XCJ tag=CPZVTVTZUK5R type=del size=1095825 2024-09-14T10:51:30.241 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.243+0000 7f19187cc780 1 < completed write operation key=OVOPGTYUF3F3 tag=U94IFLRB5OSO type=write size=465522 2024-09-14T10:51:30.242 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.244+0000 7f19187cc780 1 > prepared operation key=IKVYA4KEALFF tag=42FB7O8CPYTJ type=del size=3286867 2024-09-14T10:51:30.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.246+0000 7f19187cc780 1 < canceled operation key=RTGE7ISETJWW tag=W4TGPZ4GD4WS type=del size=1057515 2024-09-14T10:51:30.245 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.247+0000 7f19187cc780 1 > prepared operation key=9EBD5ZT6MT45 tag=GZ7FC923HRQK type=del size=2078847 2024-09-14T10:51:30.247 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.248+0000 7f19187cc780 1 < completed delete operation key=W1K1IU13J0CZ tag=4GHUGANO1I6O type=del 2024-09-14T10:51:30.248 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.250+0000 7f19187cc780 1 > prepared operation key=QFEI6H4EQ9ZR tag=G2RXPLV2Y19G type=del size=4189515 2024-09-14T10:51:30.249 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.250+0000 7f19187cc780 1 < canceled part key=_multipart_H40763V7HMBC.2~SUVQP5WROJQH.0 size=1048576 2024-09-14T10:51:30.250 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.251+0000 7f19187cc780 1 < completed part key=_multipart_H40763V7HMBC.2~SUVQP5WROJQH.1 size=1048576 2024-09-14T10:51:30.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.253+0000 7f19187cc780 1 < completed part key=_multipart_H40763V7HMBC.2~SUVQP5WROJQH.2 size=273665 2024-09-14T10:51:30.253 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.255+0000 7f19187cc780 1 < canceled multipart upload key=H40763V7HMBC upload=SUVQP5WROJQH tag=U5J5M5JUESZL type=write size=3419393 2024-09-14T10:51:30.256 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.258+0000 7f19187cc780 1 > prepared part key=_multipart_5AIAYJMRZGFQ.2~M8A02BTR9L1I.0 size=1048576 2024-09-14T10:51:30.257 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.259+0000 7f19187cc780 1 > prepared part key=_multipart_5AIAYJMRZGFQ.2~M8A02BTR9L1I.1 size=1048576 2024-09-14T10:51:30.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.260+0000 7f19187cc780 1 > prepared part key=_multipart_5AIAYJMRZGFQ.2~M8A02BTR9L1I.2 size=300765 2024-09-14T10:51:30.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.260+0000 7f19187cc780 1 > prepared multipart upload key=5AIAYJMRZGFQ upload=M8A02BTR9L1I tag=KTESOK1SQEOZ type=write size=3446493 2024-09-14T10:51:30.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.262+0000 7f19187cc780 1 < completed write operation key=IKVYA4KEALFF tag=B4CPEWRMYVQW type=write size=957810 2024-09-14T10:51:30.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.265+0000 7f19187cc780 1 > prepared part key=_multipart_54BSD3DEHNK6.2~0RTYPVSRX2Q7.0 size=1032868 2024-09-14T10:51:30.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.265+0000 7f19187cc780 1 > prepared multipart upload key=54BSD3DEHNK6 upload=0RTYPVSRX2Q7 tag=SEZ6MGNMQS53 type=write size=2081444 2024-09-14T10:51:30.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.266+0000 7f19187cc780 1 < completed part key=_multipart_EL00Y4Z7DTAT.2~5DB47R44AS66.0 size=1048576 2024-09-14T10:51:30.266 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.267+0000 7f19187cc780 1 < completed part key=_multipart_EL00Y4Z7DTAT.2~5DB47R44AS66.1 size=462038 2024-09-14T10:51:30.268 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.270+0000 7f19187cc780 1 < completed multipart upload key=EL00Y4Z7DTAT upload=5DB47R44AS66 tag=KM4Q5RMTL45M type=write size=2559190 2024-09-14T10:51:30.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.271+0000 7f19187cc780 1 > prepared operation key=9EBD5ZT6MT45 tag=KD0XLT4M1A6Q type=del size=632171 2024-09-14T10:51:30.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.274+0000 7f19187cc780 1 < suggested remove operation key=YA3DI7N4DG5K tag=WEGEHT6EA2FX type=del 2024-09-14T10:51:30.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.277+0000 7f19187cc780 1 > prepared part key=_multipart_RTGE7ISETJWW.2~7TZDEYZ9E13M.0 size=230475 2024-09-14T10:51:30.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.277+0000 7f19187cc780 1 > prepared multipart upload key=RTGE7ISETJWW upload=7TZDEYZ9E13M tag=T1B8ZGRSKBBJ type=write size=1279051 2024-09-14T10:51:30.279 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.281+0000 7f19187cc780 1 < suggested remove operation key=OVOPGTYUF3F3 tag=9WMA3Q4UYWF6 type=del 2024-09-14T10:51:30.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.283+0000 7f19187cc780 1 > prepared part key=_multipart_5AIAYJMRZGFQ.2~L45P3NEAFDU2.0 size=1048576 2024-09-14T10:51:30.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.285+0000 7f19187cc780 1 > prepared part key=_multipart_5AIAYJMRZGFQ.2~L45P3NEAFDU2.1 size=1048576 2024-09-14T10:51:30.284 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.286+0000 7f19187cc780 1 > prepared part key=_multipart_5AIAYJMRZGFQ.2~L45P3NEAFDU2.2 size=406458 2024-09-14T10:51:30.284 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.286+0000 7f19187cc780 1 > prepared multipart upload key=5AIAYJMRZGFQ upload=L45P3NEAFDU2 tag=6W4PNGV6CWE9 type=write size=3552186 2024-09-14T10:51:30.287 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.289+0000 7f19187cc780 1 < suggested update operation key=75O00VMLJJ1X tag=PKZSV1OQHH4X type=del size=1851685 2024-09-14T10:51:30.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.290+0000 7f19187cc780 1 > prepared operation key=YA3DI7N4DG5K tag=831M8E1KVRBY type=del size=2709547 2024-09-14T10:51:30.291 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.293+0000 7f19187cc780 1 < suggested remove operation key=EL00Y4Z7DTAT tag=4JBKE09O52NQ type=write 2024-09-14T10:51:30.293 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.294+0000 7f19187cc780 1 > prepared operation key=7IWUW2HC3ULI tag=7SIGSAL91KH8 type=del size=3277434 2024-09-14T10:51:30.294 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.296+0000 7f19187cc780 1 < completed write operation key=N0L67LS2KHR1 tag=O2IBFWPTVRA4 type=write size=552736 2024-09-14T10:51:30.295 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.297+0000 7f19187cc780 1 > prepared operation key=9EBD5ZT6MT45 tag=HRH3NOXOOV9V type=del size=3131783 2024-09-14T10:51:30.300 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.299+0000 7f19187cc780 1 < completed delete operation key=EZLSMEK89N2G tag=H675PLBA1LUG type=del 2024-09-14T10:51:30.301 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.300+0000 7f19187cc780 1 > prepared operation key=KP3WOGIF30PZ tag=C78BM4Z3TH0Z type=del size=4031517 2024-09-14T10:51:30.301 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.302+0000 7f19187cc780 1 < completed part key=_multipart_QFEI6H4EQ9ZR.2~5IU50C7HSNAB.0 size=1048576 2024-09-14T10:51:30.301 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.303+0000 7f19187cc780 1 < completed part key=_multipart_QFEI6H4EQ9ZR.2~5IU50C7HSNAB.1 size=1048576 2024-09-14T10:51:30.303 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.304+0000 7f19187cc780 1 < completed part key=_multipart_QFEI6H4EQ9ZR.2~5IU50C7HSNAB.2 size=421023 2024-09-14T10:51:30.305 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.307+0000 7f19187cc780 1 < completed multipart upload key=QFEI6H4EQ9ZR upload=5IU50C7HSNAB tag=TIRUL2IIBEE9 type=write size=3566751 2024-09-14T10:51:30.307 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.309+0000 7f19187cc780 1 > prepared operation key=RTGE7ISETJWW tag=OAV32FPCY8JJ type=del size=1678868 2024-09-14T10:51:30.309 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.310+0000 7f19187cc780 1 < completed part key=_multipart_EL00Y4Z7DTAT.2~CDHCE1ENI39U.0 size=1048576 2024-09-14T10:51:30.310 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.312+0000 7f19187cc780 1 < completed part key=_multipart_EL00Y4Z7DTAT.2~CDHCE1ENI39U.1 size=1048576 2024-09-14T10:51:30.311 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.313+0000 7f19187cc780 1 < completed part key=_multipart_EL00Y4Z7DTAT.2~CDHCE1ENI39U.2 size=805187 2024-09-14T10:51:30.314 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.315+0000 7f19187cc780 1 < completed multipart upload key=EL00Y4Z7DTAT upload=CDHCE1ENI39U tag=NEDZWUS9SN40 type=write size=3950915 2024-09-14T10:51:30.315 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.317+0000 7f19187cc780 1 > prepared operation key=9EBD5ZT6MT45 tag=XKT4FP563ZLV type=del size=3241917 2024-09-14T10:51:30.316 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.318+0000 7f19187cc780 1 < completed part key=_multipart_KOJ7QB7M6A35.2~5YQVCF2TFNQG.0 size=1048576 2024-09-14T10:51:30.317 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.319+0000 7f19187cc780 1 < completed part key=_multipart_KOJ7QB7M6A35.2~5YQVCF2TFNQG.1 size=1048576 2024-09-14T10:51:30.318 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.319+0000 7f19187cc780 1 < canceled part key=_multipart_KOJ7QB7M6A35.2~5YQVCF2TFNQG.2 size=401230 2024-09-14T10:51:30.320 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.321+0000 7f19187cc780 1 < canceled multipart upload key=KOJ7QB7M6A35 upload=5YQVCF2TFNQG tag=26S2HTB3EUSP type=write size=3546958 2024-09-14T10:51:30.321 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.323+0000 7f19187cc780 1 > prepared operation key=KOJ7QB7M6A35 tag=PPMPVV0Q6D0S type=del size=3992138 2024-09-14T10:51:30.323 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.324+0000 7f19187cc780 1 < completed delete operation key=AGNUE76X8XCJ tag=CPZVTVTZUK5R type=del 2024-09-14T10:51:30.324 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.326+0000 7f19187cc780 1 > prepared operation key=N0L67LS2KHR1 tag=EEO7NXFQT8UW type=del size=1839034 2024-09-14T10:51:30.326 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.327+0000 7f19187cc780 1 < completed delete operation key=IKVYA4KEALFF tag=42FB7O8CPYTJ type=del 2024-09-14T10:51:30.327 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.329+0000 7f19187cc780 1 > prepared operation key=H40763V7HMBC tag=76REPTNS0J5K type=write size=41976 2024-09-14T10:51:30.329 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.330+0000 7f19187cc780 1 < completed delete operation key=9EBD5ZT6MT45 tag=GZ7FC923HRQK type=del 2024-09-14T10:51:30.331 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.333+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~Q1C12JBDT569.0 size=1048576 2024-09-14T10:51:30.332 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.334+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~Q1C12JBDT569.1 size=511225 2024-09-14T10:51:30.332 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.334+0000 7f19187cc780 1 > prepared multipart upload key=OVOPGTYUF3F3 upload=Q1C12JBDT569 tag=U0N9O6KIU5N5 type=write size=2608377 2024-09-14T10:51:30.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.336+0000 7f19187cc780 1 < completed delete operation key=QFEI6H4EQ9ZR tag=G2RXPLV2Y19G type=del 2024-09-14T10:51:30.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.337+0000 7f19187cc780 1 > prepared operation key=YA3DI7N4DG5K tag=GCHX5OBJ4CFX type=del size=529989 2024-09-14T10:51:30.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.339+0000 7f19187cc780 1 < completed part key=_multipart_5AIAYJMRZGFQ.2~M8A02BTR9L1I.0 size=1048576 2024-09-14T10:51:30.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.340+0000 7f19187cc780 1 < completed part key=_multipart_5AIAYJMRZGFQ.2~M8A02BTR9L1I.1 size=1048576 2024-09-14T10:51:30.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.341+0000 7f19187cc780 1 < completed part key=_multipart_5AIAYJMRZGFQ.2~M8A02BTR9L1I.2 size=300765 2024-09-14T10:51:30.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.344+0000 7f19187cc780 1 < completed multipart upload key=5AIAYJMRZGFQ upload=M8A02BTR9L1I tag=KTESOK1SQEOZ type=write size=3446493 2024-09-14T10:51:30.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.347+0000 7f19187cc780 1 > prepared part key=_multipart_W1K1IU13J0CZ.2~6MD09X5VAE7L.0 size=1048576 2024-09-14T10:51:30.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.348+0000 7f19187cc780 1 > prepared part key=_multipart_W1K1IU13J0CZ.2~6MD09X5VAE7L.1 size=1048576 2024-09-14T10:51:30.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.349+0000 7f19187cc780 1 > prepared part key=_multipart_W1K1IU13J0CZ.2~6MD09X5VAE7L.2 size=860196 2024-09-14T10:51:30.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.349+0000 7f19187cc780 1 > prepared multipart upload key=W1K1IU13J0CZ upload=6MD09X5VAE7L tag=EFV5U60TY40P type=write size=4005924 2024-09-14T10:51:30.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.351+0000 7f19187cc780 1 < completed part key=_multipart_54BSD3DEHNK6.2~0RTYPVSRX2Q7.0 size=1032868 2024-09-14T10:51:30.352 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.353+0000 7f19187cc780 1 < completed multipart upload key=54BSD3DEHNK6 upload=0RTYPVSRX2Q7 tag=SEZ6MGNMQS53 type=write size=2081444 2024-09-14T10:51:30.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.355+0000 7f19187cc780 1 > prepared operation key=54BSD3DEHNK6 tag=Z693YYQRQ3PJ type=write size=56424 2024-09-14T10:51:30.355 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.357+0000 7f19187cc780 1 < completed delete operation key=9EBD5ZT6MT45 tag=KD0XLT4M1A6Q type=del 2024-09-14T10:51:30.357 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.358+0000 7f19187cc780 1 > prepared operation key=KP3WOGIF30PZ tag=8E6BI6Y2TKJL type=del size=1723629 2024-09-14T10:51:30.358 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.360+0000 7f19187cc780 1 < completed part key=_multipart_RTGE7ISETJWW.2~7TZDEYZ9E13M.0 size=230475 2024-09-14T10:51:30.361 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.362+0000 7f19187cc780 1 < completed multipart upload key=RTGE7ISETJWW upload=7TZDEYZ9E13M tag=T1B8ZGRSKBBJ type=write size=1279051 2024-09-14T10:51:30.363 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.365+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~9AOD8TSLGOO9.0 size=1048576 2024-09-14T10:51:30.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.366+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~9AOD8TSLGOO9.1 size=30287 2024-09-14T10:51:30.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.366+0000 7f19187cc780 1 > prepared multipart upload key=OVOPGTYUF3F3 upload=9AOD8TSLGOO9 tag=ASLEYIBKKT5B type=write size=2127439 2024-09-14T10:51:30.366 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.368+0000 7f19187cc780 1 < completed part key=_multipart_5AIAYJMRZGFQ.2~L45P3NEAFDU2.0 size=1048576 2024-09-14T10:51:30.368 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.369+0000 7f19187cc780 1 < completed part key=_multipart_5AIAYJMRZGFQ.2~L45P3NEAFDU2.1 size=1048576 2024-09-14T10:51:30.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.371+0000 7f19187cc780 1 < completed part key=_multipart_5AIAYJMRZGFQ.2~L45P3NEAFDU2.2 size=406458 2024-09-14T10:51:30.372 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.373+0000 7f19187cc780 1 < completed multipart upload key=5AIAYJMRZGFQ upload=L45P3NEAFDU2 tag=6W4PNGV6CWE9 type=write size=3552186 2024-09-14T10:51:30.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.376+0000 7f19187cc780 1 > prepared part key=_multipart_INJQTKXHBUV2.2~SERD9GL6518T.0 size=1048576 2024-09-14T10:51:30.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.378+0000 7f19187cc780 1 > prepared part key=_multipart_INJQTKXHBUV2.2~SERD9GL6518T.1 size=1048576 2024-09-14T10:51:30.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.379+0000 7f19187cc780 1 > prepared part key=_multipart_INJQTKXHBUV2.2~SERD9GL6518T.2 size=638833 2024-09-14T10:51:30.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.379+0000 7f19187cc780 1 > prepared multipart upload key=INJQTKXHBUV2 upload=SERD9GL6518T tag=6AZ5BGFVAUYW type=write size=3784561 2024-09-14T10:51:30.379 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.380+0000 7f19187cc780 1 < completed delete operation key=YA3DI7N4DG5K tag=831M8E1KVRBY type=del 2024-09-14T10:51:30.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.382+0000 7f19187cc780 1 > prepared operation key=9EBD5ZT6MT45 tag=T2981HP803E2 type=del size=2168079 2024-09-14T10:51:30.382 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.383+0000 7f19187cc780 1 < completed delete operation key=7IWUW2HC3ULI tag=7SIGSAL91KH8 type=del 2024-09-14T10:51:30.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.385+0000 7f19187cc780 1 > prepared operation key=QBMNYNWOLK4I tag=L31H5B4GVYOR type=del size=1527790 2024-09-14T10:51:30.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.386+0000 7f19187cc780 1 < canceled operation key=9EBD5ZT6MT45 tag=HRH3NOXOOV9V type=del size=3131783 2024-09-14T10:51:30.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.387+0000 7f19187cc780 1 > prepared operation key=RTGE7ISETJWW tag=S47M11A5KXDV type=del size=1872447 2024-09-14T10:51:30.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.389+0000 7f19187cc780 1 < completed delete operation key=KP3WOGIF30PZ tag=C78BM4Z3TH0Z type=del 2024-09-14T10:51:30.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.390+0000 7f19187cc780 1 > prepared operation key=IKVYA4KEALFF tag=E985TGZXLKTP type=del size=5201 2024-09-14T10:51:30.390 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.392+0000 7f19187cc780 1 < completed delete operation key=RTGE7ISETJWW tag=OAV32FPCY8JJ type=del 2024-09-14T10:51:30.391 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.393+0000 7f19187cc780 1 > prepared operation key=H40763V7HMBC tag=NKGBN914HED0 type=write size=236961 2024-09-14T10:51:30.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.394+0000 7f19187cc780 1 < completed delete operation key=9EBD5ZT6MT45 tag=XKT4FP563ZLV type=del 2024-09-14T10:51:30.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.396+0000 7f19187cc780 1 > prepared operation key=EL00Y4Z7DTAT tag=2WWC1Y0KWCBF type=del size=2328864 2024-09-14T10:51:30.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.397+0000 7f19187cc780 1 < completed delete operation key=KOJ7QB7M6A35 tag=PPMPVV0Q6D0S type=del 2024-09-14T10:51:30.397 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.399+0000 7f19187cc780 1 > prepared operation key=KP3WOGIF30PZ tag=W5MV1AXBHFU2 type=del size=3586591 2024-09-14T10:51:30.398 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.400+0000 7f19187cc780 1 < completed delete operation key=N0L67LS2KHR1 tag=EEO7NXFQT8UW type=del 2024-09-14T10:51:30.400 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.401+0000 7f19187cc780 1 > prepared operation key=KOJ7QB7M6A35 tag=FTTQP33V5WVP type=del size=110050 2024-09-14T10:51:30.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.404+0000 7f19187cc780 1 < suggested update operation key=H40763V7HMBC tag=76REPTNS0J5K type=write size=41976 2024-09-14T10:51:30.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.406+0000 7f19187cc780 1 > prepared part key=_multipart_QFEI6H4EQ9ZR.2~R2QLMGBPH8EQ.0 size=1048576 2024-09-14T10:51:30.406 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.408+0000 7f19187cc780 1 > prepared part key=_multipart_QFEI6H4EQ9ZR.2~R2QLMGBPH8EQ.1 size=892800 2024-09-14T10:51:30.406 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.408+0000 7f19187cc780 1 > prepared multipart upload key=QFEI6H4EQ9ZR upload=R2QLMGBPH8EQ tag=MKST2TX8A3B9 type=write size=2989952 2024-09-14T10:51:30.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.409+0000 7f19187cc780 1 < completed part key=_multipart_OVOPGTYUF3F3.2~Q1C12JBDT569.0 size=1048576 2024-09-14T10:51:30.409 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.410+0000 7f19187cc780 1 < completed part key=_multipart_OVOPGTYUF3F3.2~Q1C12JBDT569.1 size=511225 2024-09-14T10:51:30.411 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.413+0000 7f19187cc780 1 < completed multipart upload key=OVOPGTYUF3F3 upload=Q1C12JBDT569 tag=U0N9O6KIU5N5 type=write size=2608377 2024-09-14T10:51:30.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.414+0000 7f19187cc780 1 > prepared operation key=QBMNYNWOLK4I tag=WNM48C1JGB4L type=del size=3119069 2024-09-14T10:51:30.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.416+0000 7f19187cc780 1 < canceled operation key=YA3DI7N4DG5K tag=GCHX5OBJ4CFX type=del size=529989 2024-09-14T10:51:30.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.418+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~OISUYSUH13P0.0 size=1048576 2024-09-14T10:51:30.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.420+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~OISUYSUH13P0.1 size=1048576 2024-09-14T10:51:30.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.421+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~OISUYSUH13P0.2 size=900605 2024-09-14T10:51:30.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.421+0000 7f19187cc780 1 > prepared multipart upload key=7IWUW2HC3ULI upload=OISUYSUH13P0 tag=HYNUIHHLKH7K type=write size=4046333 2024-09-14T10:51:30.421 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.423+0000 7f19187cc780 1 < completed part key=_multipart_W1K1IU13J0CZ.2~6MD09X5VAE7L.0 size=1048576 2024-09-14T10:51:30.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.424+0000 7f19187cc780 1 < completed part key=_multipart_W1K1IU13J0CZ.2~6MD09X5VAE7L.1 size=1048576 2024-09-14T10:51:30.423 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.425+0000 7f19187cc780 1 < completed part key=_multipart_W1K1IU13J0CZ.2~6MD09X5VAE7L.2 size=860196 2024-09-14T10:51:30.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.427+0000 7f19187cc780 1 < completed multipart upload key=W1K1IU13J0CZ upload=6MD09X5VAE7L tag=EFV5U60TY40P type=write size=4005924 2024-09-14T10:51:30.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.429+0000 7f19187cc780 1 > prepared operation key=OVOPGTYUF3F3 tag=67EIHUP0POIJ type=del size=3024256 2024-09-14T10:51:30.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.430+0000 7f19187cc780 1 < completed write operation key=54BSD3DEHNK6 tag=Z693YYQRQ3PJ type=write size=56424 2024-09-14T10:51:30.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.432+0000 7f19187cc780 1 > prepared operation key=75O00VMLJJ1X tag=U2AK937FVFGW type=del size=3882103 2024-09-14T10:51:30.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.433+0000 7f19187cc780 1 < completed delete operation key=KP3WOGIF30PZ tag=8E6BI6Y2TKJL type=del 2024-09-14T10:51:30.433 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.435+0000 7f19187cc780 1 > prepared operation key=QFEI6H4EQ9ZR tag=S802U04ZA4LR type=del size=982455 2024-09-14T10:51:30.435 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.436+0000 7f19187cc780 1 < completed part key=_multipart_OVOPGTYUF3F3.2~9AOD8TSLGOO9.0 size=1048576 2024-09-14T10:51:30.436 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.437+0000 7f19187cc780 1 < completed part key=_multipart_OVOPGTYUF3F3.2~9AOD8TSLGOO9.1 size=30287 2024-09-14T10:51:30.438 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.440+0000 7f19187cc780 1 < completed multipart upload key=OVOPGTYUF3F3 upload=9AOD8TSLGOO9 tag=ASLEYIBKKT5B type=write size=2127439 2024-09-14T10:51:30.440 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.441+0000 7f19187cc780 1 > prepared operation key=RTGE7ISETJWW tag=2NKOS0ASYXPJ type=write size=489728 2024-09-14T10:51:30.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.443+0000 7f19187cc780 1 < completed part key=_multipart_INJQTKXHBUV2.2~SERD9GL6518T.0 size=1048576 2024-09-14T10:51:30.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.444+0000 7f19187cc780 1 < completed part key=_multipart_INJQTKXHBUV2.2~SERD9GL6518T.1 size=1048576 2024-09-14T10:51:30.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.445+0000 7f19187cc780 1 < completed part key=_multipart_INJQTKXHBUV2.2~SERD9GL6518T.2 size=638833 2024-09-14T10:51:30.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.448+0000 7f19187cc780 1 < completed multipart upload key=INJQTKXHBUV2 upload=SERD9GL6518T tag=6AZ5BGFVAUYW type=write size=3784561 2024-09-14T10:51:30.448 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.449+0000 7f19187cc780 1 > prepared operation key=617QQI921HB4 tag=38JSH443CE2T type=del size=3063008 2024-09-14T10:51:30.449 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.451+0000 7f19187cc780 1 < completed delete operation key=9EBD5ZT6MT45 tag=T2981HP803E2 type=del 2024-09-14T10:51:30.452 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.453+0000 7f19187cc780 1 > prepared part key=_multipart_54BSD3DEHNK6.2~A86NF2K62CZM.0 size=633544 2024-09-14T10:51:30.452 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.453+0000 7f19187cc780 1 > prepared multipart upload key=54BSD3DEHNK6 upload=A86NF2K62CZM tag=3KWRPHYR4XVZ type=write size=1682120 2024-09-14T10:51:30.455 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.456+0000 7f19187cc780 1 < suggested remove operation key=QBMNYNWOLK4I tag=L31H5B4GVYOR type=del 2024-09-14T10:51:30.458 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.459+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~1T247Q0QMNEC.0 size=1048576 2024-09-14T10:51:30.459 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.461+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~1T247Q0QMNEC.1 size=241963 2024-09-14T10:51:30.459 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.461+0000 7f19187cc780 1 > prepared multipart upload key=IKVYA4KEALFF upload=1T247Q0QMNEC tag=I3EIFVSSROPC type=write size=2339115 2024-09-14T10:51:30.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.462+0000 7f19187cc780 1 < completed delete operation key=RTGE7ISETJWW tag=S47M11A5KXDV type=del 2024-09-14T10:51:30.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.464+0000 7f19187cc780 1 > prepared operation key=9EBD5ZT6MT45 tag=ISCFJJ91OMFD type=del size=372043 2024-09-14T10:51:30.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.466+0000 7f19187cc780 1 < completed delete operation key=IKVYA4KEALFF tag=E985TGZXLKTP type=del 2024-09-14T10:51:30.466 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.467+0000 7f19187cc780 1 > prepared operation key=7IWUW2HC3ULI tag=JFXP87BW6NZQ type=del size=2426465 2024-09-14T10:51:30.467 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.469+0000 7f19187cc780 -1 < failed to complete operation key=H40763V7HMBC tag=NKGBN914HED0 type=write size=236961: (22) Invalid argument 2024-09-14T10:51:30.469 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.471+0000 7f19187cc780 1 > prepared operation key=AGNUE76X8XCJ tag=G4BJU1D57ZY0 type=del size=2275778 2024-09-14T10:51:30.470 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.472+0000 7f19187cc780 1 < completed delete operation key=EL00Y4Z7DTAT tag=2WWC1Y0KWCBF type=del 2024-09-14T10:51:30.472 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.474+0000 7f19187cc780 1 > prepared operation key=19P3WE6HKJH2 tag=AUT5MZV1ANDW type=del size=3303364 2024-09-14T10:51:30.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.475+0000 7f19187cc780 1 < canceled operation key=KP3WOGIF30PZ tag=W5MV1AXBHFU2 type=del size=3586591 2024-09-14T10:51:30.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.477+0000 7f19187cc780 1 > prepared operation key=N0L67LS2KHR1 tag=CX2SSLW2TIY3 type=del size=2028691 2024-09-14T10:51:30.478 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.479+0000 7f19187cc780 1 < suggested remove operation key=KOJ7QB7M6A35 tag=FTTQP33V5WVP type=del 2024-09-14T10:51:30.479 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.481+0000 7f19187cc780 1 > prepared operation key=INJQTKXHBUV2 tag=I3GKBD0KZ7P9 type=del size=2507644 2024-09-14T10:51:30.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.482+0000 7f19187cc780 1 < completed part key=_multipart_QFEI6H4EQ9ZR.2~R2QLMGBPH8EQ.0 size=1048576 2024-09-14T10:51:30.482 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.483+0000 7f19187cc780 1 < completed part key=_multipart_QFEI6H4EQ9ZR.2~R2QLMGBPH8EQ.1 size=892800 2024-09-14T10:51:30.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.486+0000 7f19187cc780 1 < completed multipart upload key=QFEI6H4EQ9ZR upload=R2QLMGBPH8EQ tag=MKST2TX8A3B9 type=write size=2989952 2024-09-14T10:51:30.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.487+0000 7f19187cc780 1 > prepared operation key=617QQI921HB4 tag=K5QMO2ZHDKH3 type=del size=2201604 2024-09-14T10:51:30.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.489+0000 7f19187cc780 -1 < failed to complete operation key=QBMNYNWOLK4I tag=WNM48C1JGB4L type=del size=3119069: (22) Invalid argument 2024-09-14T10:51:30.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.490+0000 7f19187cc780 1 > prepared operation key=IKVYA4KEALFF tag=DZFD8TO3LAN4 type=del size=2591527 2024-09-14T10:51:30.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.492+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~OISUYSUH13P0.0 size=1048576 2024-09-14T10:51:30.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.493+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~OISUYSUH13P0.1 size=1048576 2024-09-14T10:51:30.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.494+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~OISUYSUH13P0.2 size=900605 2024-09-14T10:51:30.495 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.497+0000 7f19187cc780 1 < completed multipart upload key=7IWUW2HC3ULI upload=OISUYSUH13P0 tag=HYNUIHHLKH7K type=write size=4046333 2024-09-14T10:51:30.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.498+0000 7f19187cc780 1 > prepared operation key=9EBD5ZT6MT45 tag=PV85YECRMZDR type=del size=69929 2024-09-14T10:51:30.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.500+0000 7f19187cc780 1 < completed delete operation key=OVOPGTYUF3F3 tag=67EIHUP0POIJ type=del 2024-09-14T10:51:30.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.502+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~UW58G9ADW8YA.0 size=1048576 2024-09-14T10:51:30.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.504+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~UW58G9ADW8YA.1 size=463584 2024-09-14T10:51:30.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.504+0000 7f19187cc780 1 > prepared multipart upload key=XCVE2F2JJK4X upload=UW58G9ADW8YA tag=03RI58G89KND type=write size=2560736 2024-09-14T10:51:30.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.505+0000 7f19187cc780 1 < canceled operation key=75O00VMLJJ1X tag=U2AK937FVFGW type=del size=3882103 2024-09-14T10:51:30.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.507+0000 7f19187cc780 1 > prepared operation key=MFA30GSMCSKP tag=PF2YRPZ9WD55 type=write size=744868 2024-09-14T10:51:30.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.509+0000 7f19187cc780 1 < completed delete operation key=QFEI6H4EQ9ZR tag=S802U04ZA4LR type=del 2024-09-14T10:51:30.508 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.510+0000 7f19187cc780 1 > prepared operation key=XCVE2F2JJK4X tag=68QSJWKR4E80 type=del size=588540 2024-09-14T10:51:30.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.512+0000 7f19187cc780 1 < completed write operation key=RTGE7ISETJWW tag=2NKOS0ASYXPJ type=write size=489728 2024-09-14T10:51:30.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.513+0000 7f19187cc780 1 > prepared operation key=5AIAYJMRZGFQ tag=Z5XZH1ZIJVH8 type=del size=3837058 2024-09-14T10:51:30.513 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.515+0000 7f19187cc780 1 < completed delete operation key=617QQI921HB4 tag=38JSH443CE2T type=del 2024-09-14T10:51:30.515 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.516+0000 7f19187cc780 1 > prepared operation key=E6UO1LUWOC44 tag=908RFJR56NRX type=write size=385522 2024-09-14T10:51:30.517 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.519+0000 7f19187cc780 1 < completed part key=_multipart_54BSD3DEHNK6.2~A86NF2K62CZM.0 size=633544 2024-09-14T10:51:30.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.523+0000 7f19187cc780 1 < completed multipart upload key=54BSD3DEHNK6 upload=A86NF2K62CZM tag=3KWRPHYR4XVZ type=write size=1682120 2024-09-14T10:51:30.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.526+0000 7f19187cc780 1 > prepared part key=_multipart_N0L67LS2KHR1.2~SRPRK4TZHDLT.0 size=1048576 2024-09-14T10:51:30.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.527+0000 7f19187cc780 1 > prepared part key=_multipart_N0L67LS2KHR1.2~SRPRK4TZHDLT.1 size=120973 2024-09-14T10:51:30.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.527+0000 7f19187cc780 1 > prepared multipart upload key=N0L67LS2KHR1 upload=SRPRK4TZHDLT tag=9IY40WWKMT8W type=write size=2218125 2024-09-14T10:51:30.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.529+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~1T247Q0QMNEC.0 size=1048576 2024-09-14T10:51:30.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.530+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~1T247Q0QMNEC.1 size=241963 2024-09-14T10:51:30.531 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.532+0000 7f19187cc780 1 < completed multipart upload key=IKVYA4KEALFF upload=1T247Q0QMNEC tag=I3EIFVSSROPC type=write size=2339115 2024-09-14T10:51:30.534 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.535+0000 7f19187cc780 1 > prepared part key=_multipart_YA3DI7N4DG5K.2~SF4Q0UMODY76.0 size=1048576 2024-09-14T10:51:30.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.536+0000 7f19187cc780 1 > prepared part key=_multipart_YA3DI7N4DG5K.2~SF4Q0UMODY76.1 size=1048576 2024-09-14T10:51:30.536 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.538+0000 7f19187cc780 1 > prepared part key=_multipart_YA3DI7N4DG5K.2~SF4Q0UMODY76.2 size=124013 2024-09-14T10:51:30.536 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.538+0000 7f19187cc780 1 > prepared multipart upload key=YA3DI7N4DG5K upload=SF4Q0UMODY76 tag=VH3JBL37YB2Y type=write size=3269741 2024-09-14T10:51:30.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.539+0000 7f19187cc780 1 < completed delete operation key=9EBD5ZT6MT45 tag=ISCFJJ91OMFD type=del 2024-09-14T10:51:30.539 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.541+0000 7f19187cc780 1 > prepared operation key=OVOPGTYUF3F3 tag=TW81K1JT6FVI type=write size=471958 2024-09-14T10:51:30.540 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.542+0000 7f19187cc780 1 < completed delete operation key=7IWUW2HC3ULI tag=JFXP87BW6NZQ type=del 2024-09-14T10:51:30.542 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.543+0000 7f19187cc780 1 > prepared operation key=5AIAYJMRZGFQ tag=2CTON013KP76 type=del size=3261280 2024-09-14T10:51:30.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.545+0000 7f19187cc780 1 < completed delete operation key=AGNUE76X8XCJ tag=G4BJU1D57ZY0 type=del 2024-09-14T10:51:30.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.546+0000 7f19187cc780 1 > prepared operation key=54BSD3DEHNK6 tag=Y1AZZQUKTTTM type=del size=1315468 2024-09-14T10:51:30.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.548+0000 7f19187cc780 1 < completed delete operation key=19P3WE6HKJH2 tag=AUT5MZV1ANDW type=del 2024-09-14T10:51:30.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.549+0000 7f19187cc780 1 > prepared operation key=XCVE2F2JJK4X tag=5H40YB56SHGB type=write size=916894 2024-09-14T10:51:30.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.550+0000 7f19187cc780 1 < completed delete operation key=N0L67LS2KHR1 tag=CX2SSLW2TIY3 type=del 2024-09-14T10:51:30.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.552+0000 7f19187cc780 1 > prepared operation key=OVOPGTYUF3F3 tag=1KVNB54DY1HT type=del size=2129491 2024-09-14T10:51:30.552 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.553+0000 7f19187cc780 1 < completed delete operation key=INJQTKXHBUV2 tag=I3GKBD0KZ7P9 type=del 2024-09-14T10:51:30.553 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.555+0000 7f19187cc780 1 > prepared operation key=AST81B9QWORT tag=01D04VUH3DNB type=del size=669235 2024-09-14T10:51:30.555 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.556+0000 7f19187cc780 1 < completed delete operation key=617QQI921HB4 tag=K5QMO2ZHDKH3 type=del 2024-09-14T10:51:30.556 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.558+0000 7f19187cc780 1 > prepared operation key=OVOPGTYUF3F3 tag=ICY5QKCJBUAE type=del size=2555577 2024-09-14T10:51:30.558 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.559+0000 7f19187cc780 1 < completed delete operation key=IKVYA4KEALFF tag=DZFD8TO3LAN4 type=del 2024-09-14T10:51:30.560 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.562+0000 7f19187cc780 1 > prepared part key=_multipart_YA3DI7N4DG5K.2~329YR9AVLHPO.0 size=1048576 2024-09-14T10:51:30.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.563+0000 7f19187cc780 1 > prepared part key=_multipart_YA3DI7N4DG5K.2~329YR9AVLHPO.1 size=866459 2024-09-14T10:51:30.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.563+0000 7f19187cc780 1 > prepared multipart upload key=YA3DI7N4DG5K upload=329YR9AVLHPO tag=WXQ6BP96DISC type=write size=2963611 2024-09-14T10:51:30.564 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.566+0000 7f19187cc780 1 < suggested remove operation key=9EBD5ZT6MT45 tag=PV85YECRMZDR type=del 2024-09-14T10:51:30.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.568+0000 7f19187cc780 1 > prepared operation key=RTGE7ISETJWW tag=NIBHUI1Q657W type=del size=462950 2024-09-14T10:51:30.568 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.569+0000 7f19187cc780 1 < completed part key=_multipart_XCVE2F2JJK4X.2~UW58G9ADW8YA.0 size=1048576 2024-09-14T10:51:30.569 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.571+0000 7f19187cc780 1 < completed part key=_multipart_XCVE2F2JJK4X.2~UW58G9ADW8YA.1 size=463584 2024-09-14T10:51:30.572 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.573+0000 7f19187cc780 1 < completed multipart upload key=XCVE2F2JJK4X upload=UW58G9ADW8YA tag=03RI58G89KND type=write size=2560736 2024-09-14T10:51:30.573 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.575+0000 7f19187cc780 1 > prepared operation key=54BSD3DEHNK6 tag=TNZNE0RB444K type=del size=1987226 2024-09-14T10:51:30.574 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.576+0000 7f19187cc780 1 < completed write operation key=MFA30GSMCSKP tag=PF2YRPZ9WD55 type=write size=744868 2024-09-14T10:51:30.577 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.579+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~ZJCY80NJ59B2.0 size=1048576 2024-09-14T10:51:30.578 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.580+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~ZJCY80NJ59B2.1 size=1048576 2024-09-14T10:51:30.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.581+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~ZJCY80NJ59B2.2 size=450811 2024-09-14T10:51:30.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.581+0000 7f19187cc780 1 > prepared multipart upload key=AGNUE76X8XCJ upload=ZJCY80NJ59B2 tag=DSRRPS0USBX0 type=write size=3596539 2024-09-14T10:51:30.581 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.583+0000 7f19187cc780 1 < completed delete operation key=XCVE2F2JJK4X tag=68QSJWKR4E80 type=del 2024-09-14T10:51:30.584 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.585+0000 7f19187cc780 1 > prepared part key=_multipart_75O00VMLJJ1X.2~9U7ZUPEWHOV0.0 size=131255 2024-09-14T10:51:30.584 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.585+0000 7f19187cc780 1 > prepared multipart upload key=75O00VMLJJ1X upload=9U7ZUPEWHOV0 tag=379AOA312ALV type=write size=1179831 2024-09-14T10:51:30.585 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.587+0000 7f19187cc780 1 < completed delete operation key=5AIAYJMRZGFQ tag=Z5XZH1ZIJVH8 type=del 2024-09-14T10:51:30.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.590+0000 7f19187cc780 1 > prepared part key=_multipart_H40763V7HMBC.2~FKPYFX6VWUJB.0 size=1048576 2024-09-14T10:51:30.589 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.591+0000 7f19187cc780 1 > prepared part key=_multipart_H40763V7HMBC.2~FKPYFX6VWUJB.1 size=1048576 2024-09-14T10:51:30.590 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.592+0000 7f19187cc780 1 > prepared part key=_multipart_H40763V7HMBC.2~FKPYFX6VWUJB.2 size=83924 2024-09-14T10:51:30.590 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.592+0000 7f19187cc780 1 > prepared multipart upload key=H40763V7HMBC upload=FKPYFX6VWUJB tag=3N6XM2TZISHZ type=write size=3229652 2024-09-14T10:51:30.593 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.594+0000 7f19187cc780 1 < suggested remove operation key=E6UO1LUWOC44 tag=908RFJR56NRX type=write 2024-09-14T10:51:30.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.596+0000 7f19187cc780 1 > prepared operation key=CADC2BY888V1 tag=1IRXI6Z5H9X6 type=del size=1177124 2024-09-14T10:51:30.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.598+0000 7f19187cc780 1 < completed part key=_multipart_N0L67LS2KHR1.2~SRPRK4TZHDLT.0 size=1048576 2024-09-14T10:51:30.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.599+0000 7f19187cc780 1 < completed part key=_multipart_N0L67LS2KHR1.2~SRPRK4TZHDLT.1 size=120973 2024-09-14T10:51:30.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.601+0000 7f19187cc780 1 < completed multipart upload key=N0L67LS2KHR1 upload=SRPRK4TZHDLT tag=9IY40WWKMT8W type=write size=2218125 2024-09-14T10:51:30.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.603+0000 7f19187cc780 1 > prepared operation key=RTGE7ISETJWW tag=8YU8PZDQIMRX type=del size=2902166 2024-09-14T10:51:30.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.604+0000 7f19187cc780 1 < completed part key=_multipart_YA3DI7N4DG5K.2~SF4Q0UMODY76.0 size=1048576 2024-09-14T10:51:30.604 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.606+0000 7f19187cc780 1 < completed part key=_multipart_YA3DI7N4DG5K.2~SF4Q0UMODY76.1 size=1048576 2024-09-14T10:51:30.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.607+0000 7f19187cc780 1 < completed part key=_multipart_YA3DI7N4DG5K.2~SF4Q0UMODY76.2 size=124013 2024-09-14T10:51:30.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.610+0000 7f19187cc780 1 < completed multipart upload key=YA3DI7N4DG5K upload=SF4Q0UMODY76 tag=VH3JBL37YB2Y type=write size=3269741 2024-09-14T10:51:30.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.611+0000 7f19187cc780 1 > prepared operation key=617QQI921HB4 tag=JFUKIW4BHRL1 type=write size=139729 2024-09-14T10:51:30.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.613+0000 7f19187cc780 1 < completed write operation key=OVOPGTYUF3F3 tag=TW81K1JT6FVI type=write size=471958 2024-09-14T10:51:30.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.615+0000 7f19187cc780 1 > prepared part key=_multipart_QBMNYNWOLK4I.2~KAUB5NO4J18X.0 size=1048576 2024-09-14T10:51:30.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.616+0000 7f19187cc780 1 > prepared part key=_multipart_QBMNYNWOLK4I.2~KAUB5NO4J18X.1 size=220086 2024-09-14T10:51:30.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.616+0000 7f19187cc780 1 > prepared multipart upload key=QBMNYNWOLK4I upload=KAUB5NO4J18X tag=QGLNP2ZITXZC type=write size=2317238 2024-09-14T10:51:30.618 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.619+0000 7f19187cc780 1 < suggested remove operation key=5AIAYJMRZGFQ tag=2CTON013KP76 type=del 2024-09-14T10:51:30.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.622+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~60ZEIMGNCGHZ.0 size=1032704 2024-09-14T10:51:30.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.622+0000 7f19187cc780 1 > prepared multipart upload key=7IWUW2HC3ULI upload=60ZEIMGNCGHZ tag=GATV43CG5JLF type=write size=2081280 2024-09-14T10:51:30.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.623+0000 7f19187cc780 1 < completed delete operation key=54BSD3DEHNK6 tag=Y1AZZQUKTTTM type=del 2024-09-14T10:51:30.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.625+0000 7f19187cc780 1 > prepared operation key=E6UO1LUWOC44 tag=263K7I8CPRRC type=del size=1604506 2024-09-14T10:51:30.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.626+0000 7f19187cc780 1 < completed write operation key=XCVE2F2JJK4X tag=5H40YB56SHGB type=write size=916894 2024-09-14T10:51:30.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.630+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~MUFMPR2IHL8T.0 size=1048576 2024-09-14T10:51:30.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.631+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~MUFMPR2IHL8T.1 size=519180 2024-09-14T10:51:30.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.631+0000 7f19187cc780 1 > prepared multipart upload key=VW6U36JN2DBX upload=MUFMPR2IHL8T tag=0XG1H25UUTW6 type=write size=2616332 2024-09-14T10:51:30.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.632+0000 7f19187cc780 1 < completed delete operation key=OVOPGTYUF3F3 tag=1KVNB54DY1HT type=del 2024-09-14T10:51:30.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.634+0000 7f19187cc780 1 > prepared operation key=M73CER01XHDY tag=4M6HEGZMG33G type=del size=1557299 2024-09-14T10:51:30.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.635+0000 7f19187cc780 1 < canceled operation key=AST81B9QWORT tag=01D04VUH3DNB type=del size=669235 2024-09-14T10:51:30.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.637+0000 7f19187cc780 1 > prepared operation key=75O00VMLJJ1X tag=3XLGGVFOXDBR type=del size=3487998 2024-09-14T10:51:30.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.638+0000 7f19187cc780 1 < completed delete operation key=OVOPGTYUF3F3 tag=ICY5QKCJBUAE type=del 2024-09-14T10:51:30.639 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.641+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~FMODRWFYIGJM.0 size=1048576 2024-09-14T10:51:30.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.642+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~FMODRWFYIGJM.1 size=148699 2024-09-14T10:51:30.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.642+0000 7f19187cc780 1 > prepared multipart upload key=IKVYA4KEALFF upload=FMODRWFYIGJM tag=H1O6GNGMSD3G type=write size=2245851 2024-09-14T10:51:30.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.643+0000 7f19187cc780 1 < completed part key=_multipart_YA3DI7N4DG5K.2~329YR9AVLHPO.0 size=1048576 2024-09-14T10:51:30.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.643+0000 7f19187cc780 1 < canceled part key=_multipart_YA3DI7N4DG5K.2~329YR9AVLHPO.1 size=866459 2024-09-14T10:51:30.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.646+0000 7f19187cc780 1 < canceled multipart upload key=YA3DI7N4DG5K upload=329YR9AVLHPO tag=WXQ6BP96DISC type=write size=2963611 2024-09-14T10:51:30.647 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.649+0000 7f19187cc780 1 > prepared part key=_multipart_RTGE7ISETJWW.2~R7DCRR2AJ5UN.0 size=69007 2024-09-14T10:51:30.647 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.649+0000 7f19187cc780 1 > prepared multipart upload key=RTGE7ISETJWW upload=R7DCRR2AJ5UN tag=WESMEYYX23CV type=write size=1117583 2024-09-14T10:51:30.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.650+0000 7f19187cc780 1 < completed delete operation key=RTGE7ISETJWW tag=NIBHUI1Q657W type=del 2024-09-14T10:51:30.650 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.652+0000 7f19187cc780 1 > prepared operation key=61O2VU0SB379 tag=75KBYGPBNS5T type=del size=2980773 2024-09-14T10:51:30.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.653+0000 7f19187cc780 1 < completed delete operation key=54BSD3DEHNK6 tag=TNZNE0RB444K type=del 2024-09-14T10:51:30.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.655+0000 7f19187cc780 1 > prepared operation key=6BNN842ZTWG5 tag=5K222O9LSJXH type=del size=1516123 2024-09-14T10:51:30.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.656+0000 7f19187cc780 1 < completed part key=_multipart_AGNUE76X8XCJ.2~ZJCY80NJ59B2.0 size=1048576 2024-09-14T10:51:30.656 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.658+0000 7f19187cc780 1 < completed part key=_multipart_AGNUE76X8XCJ.2~ZJCY80NJ59B2.1 size=1048576 2024-09-14T10:51:30.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.660+0000 7f19187cc780 1 < completed part key=_multipart_AGNUE76X8XCJ.2~ZJCY80NJ59B2.2 size=450811 2024-09-14T10:51:30.661 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.662+0000 7f19187cc780 1 < completed multipart upload key=AGNUE76X8XCJ upload=ZJCY80NJ59B2 tag=DSRRPS0USBX0 type=write size=3596539 2024-09-14T10:51:30.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.664+0000 7f19187cc780 1 > prepared operation key=5AIAYJMRZGFQ tag=SGHGHIFKI07A type=del size=2621960 2024-09-14T10:51:30.663 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.665+0000 7f19187cc780 1 < completed part key=_multipart_75O00VMLJJ1X.2~9U7ZUPEWHOV0.0 size=131255 2024-09-14T10:51:30.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.667+0000 7f19187cc780 1 < completed multipart upload key=75O00VMLJJ1X upload=9U7ZUPEWHOV0 tag=379AOA312ALV type=write size=1179831 2024-09-14T10:51:30.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.669+0000 7f19187cc780 1 > prepared operation key=6BNN842ZTWG5 tag=6X6D1F3QW08I type=del size=2240198 2024-09-14T10:51:30.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.670+0000 7f19187cc780 1 < completed part key=_multipart_H40763V7HMBC.2~FKPYFX6VWUJB.0 size=1048576 2024-09-14T10:51:30.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.671+0000 7f19187cc780 1 < completed part key=_multipart_H40763V7HMBC.2~FKPYFX6VWUJB.1 size=1048576 2024-09-14T10:51:30.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.672+0000 7f19187cc780 1 < completed part key=_multipart_H40763V7HMBC.2~FKPYFX6VWUJB.2 size=83924 2024-09-14T10:51:30.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.675+0000 7f19187cc780 1 < completed multipart upload key=H40763V7HMBC upload=FKPYFX6VWUJB tag=3N6XM2TZISHZ type=write size=3229652 2024-09-14T10:51:30.675 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.676+0000 7f19187cc780 1 > prepared operation key=MFA30GSMCSKP tag=S0UPZCW12THZ type=del size=3727785 2024-09-14T10:51:30.676 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.678+0000 7f19187cc780 1 < completed delete operation key=CADC2BY888V1 tag=1IRXI6Z5H9X6 type=del 2024-09-14T10:51:30.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.680+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~HEK1BVNXPV5E.0 size=1048576 2024-09-14T10:51:30.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.682+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~HEK1BVNXPV5E.1 size=1048576 2024-09-14T10:51:30.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.683+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~HEK1BVNXPV5E.2 size=234920 2024-09-14T10:51:30.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.683+0000 7f19187cc780 1 > prepared multipart upload key=7IWUW2HC3ULI upload=HEK1BVNXPV5E tag=O8X2R7OD0QCW type=write size=3380648 2024-09-14T10:51:30.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.686+0000 7f19187cc780 1 < suggested update operation key=RTGE7ISETJWW tag=8YU8PZDQIMRX type=del size=2902166 2024-09-14T10:51:30.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.687+0000 7f19187cc780 1 > prepared operation key=QFEI6H4EQ9ZR tag=68L3SB313WZH type=del size=2893286 2024-09-14T10:51:30.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.689+0000 7f19187cc780 1 < canceled operation key=617QQI921HB4 tag=JFUKIW4BHRL1 type=write size=139729 2024-09-14T10:51:30.690 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.691+0000 7f19187cc780 1 > prepared part key=_multipart_MFA30GSMCSKP.2~DTLUOS2XD59G.0 size=845996 2024-09-14T10:51:30.690 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.691+0000 7f19187cc780 1 > prepared multipart upload key=MFA30GSMCSKP upload=DTLUOS2XD59G tag=VN049VCP57MK type=write size=1894572 2024-09-14T10:51:30.692 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.693+0000 7f19187cc780 1 < completed part key=_multipart_QBMNYNWOLK4I.2~KAUB5NO4J18X.0 size=1048576 2024-09-14T10:51:30.693 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.694+0000 7f19187cc780 1 < completed part key=_multipart_QBMNYNWOLK4I.2~KAUB5NO4J18X.1 size=220086 2024-09-14T10:51:30.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.697+0000 7f19187cc780 1 < completed multipart upload key=QBMNYNWOLK4I upload=KAUB5NO4J18X tag=QGLNP2ZITXZC type=write size=2317238 2024-09-14T10:51:30.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.698+0000 7f19187cc780 1 > prepared operation key=AST81B9QWORT tag=YDBNMSK7H76N type=del size=1770768 2024-09-14T10:51:30.698 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.700+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~60ZEIMGNCGHZ.0 size=1032704 2024-09-14T10:51:30.700 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.702+0000 7f19187cc780 1 < completed multipart upload key=7IWUW2HC3ULI upload=60ZEIMGNCGHZ tag=GATV43CG5JLF type=write size=2081280 2024-09-14T10:51:30.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.704+0000 7f19187cc780 1 > prepared operation key=E6UO1LUWOC44 tag=F00TDVMT41O0 type=del size=3523316 2024-09-14T10:51:30.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.705+0000 7f19187cc780 1 < completed delete operation key=E6UO1LUWOC44 tag=263K7I8CPRRC type=del 2024-09-14T10:51:30.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.707+0000 7f19187cc780 1 > prepared operation key=6BNN842ZTWG5 tag=58KZXTH7SQMR type=del size=35509 2024-09-14T10:51:30.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.707+0000 7f19187cc780 1 < canceled part key=_multipart_VW6U36JN2DBX.2~MUFMPR2IHL8T.0 size=1048576 2024-09-14T10:51:30.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.708+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~MUFMPR2IHL8T.1 size=519180 2024-09-14T10:51:30.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.710+0000 7f19187cc780 1 < canceled multipart upload key=VW6U36JN2DBX upload=MUFMPR2IHL8T tag=0XG1H25UUTW6 type=write size=2616332 2024-09-14T10:51:30.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.712+0000 7f19187cc780 1 > prepared operation key=617QQI921HB4 tag=CDST9QOD466M type=write size=876043 2024-09-14T10:51:30.712 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.713+0000 7f19187cc780 1 < completed delete operation key=M73CER01XHDY tag=4M6HEGZMG33G type=del 2024-09-14T10:51:30.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.715+0000 7f19187cc780 1 > prepared operation key=KP3WOGIF30PZ tag=12H6LLMIM7XJ type=del size=2324713 2024-09-14T10:51:30.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.718+0000 7f19187cc780 1 < suggested update operation key=75O00VMLJJ1X tag=3XLGGVFOXDBR type=del size=3487998 2024-09-14T10:51:30.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.720+0000 7f19187cc780 1 > prepared part key=_multipart_YA3DI7N4DG5K.2~Y3B9NZ9OF1ZH.0 size=1048576 2024-09-14T10:51:30.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.721+0000 7f19187cc780 1 > prepared part key=_multipart_YA3DI7N4DG5K.2~Y3B9NZ9OF1ZH.1 size=741775 2024-09-14T10:51:30.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.721+0000 7f19187cc780 1 > prepared multipart upload key=YA3DI7N4DG5K upload=Y3B9NZ9OF1ZH tag=NSO1J2Y6D3UR type=write size=2838927 2024-09-14T10:51:30.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.723+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~FMODRWFYIGJM.0 size=1048576 2024-09-14T10:51:30.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.724+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~FMODRWFYIGJM.1 size=148699 2024-09-14T10:51:30.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.726+0000 7f19187cc780 1 < completed multipart upload key=IKVYA4KEALFF upload=FMODRWFYIGJM tag=H1O6GNGMSD3G type=write size=2245851 2024-09-14T10:51:30.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.729+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~Z2KVFE70OP7Z.0 size=1048576 2024-09-14T10:51:30.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.730+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~Z2KVFE70OP7Z.1 size=79704 2024-09-14T10:51:30.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.730+0000 7f19187cc780 1 > prepared multipart upload key=6BNN842ZTWG5 upload=Z2KVFE70OP7Z tag=VF94CBU67NBP type=write size=2176856 2024-09-14T10:51:30.730 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.732+0000 7f19187cc780 1 < completed part key=_multipart_RTGE7ISETJWW.2~R7DCRR2AJ5UN.0 size=69007 2024-09-14T10:51:30.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.734+0000 7f19187cc780 1 < completed multipart upload key=RTGE7ISETJWW upload=R7DCRR2AJ5UN tag=WESMEYYX23CV type=write size=1117583 2024-09-14T10:51:30.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.736+0000 7f19187cc780 1 > prepared operation key=N0L67LS2KHR1 tag=FNOXWI7PY2BC type=del size=520782 2024-09-14T10:51:30.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.737+0000 7f19187cc780 1 < completed delete operation key=61O2VU0SB379 tag=75KBYGPBNS5T type=del 2024-09-14T10:51:30.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.739+0000 7f19187cc780 1 > prepared operation key=75O00VMLJJ1X tag=044AH7GP1CWS type=del size=3889257 2024-09-14T10:51:30.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.741+0000 7f19187cc780 1 < suggested remove operation key=6BNN842ZTWG5 tag=5K222O9LSJXH type=del 2024-09-14T10:51:30.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.744+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~7LJ7I36X7ZPX.0 size=1048576 2024-09-14T10:51:30.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.745+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~7LJ7I36X7ZPX.1 size=911542 2024-09-14T10:51:30.744 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.745+0000 7f19187cc780 1 > prepared multipart upload key=AGNUE76X8XCJ upload=7LJ7I36X7ZPX tag=LGKZ97A7KU3O type=write size=3008694 2024-09-14T10:51:30.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.747+0000 7f19187cc780 1 < completed delete operation key=5AIAYJMRZGFQ tag=SGHGHIFKI07A type=del 2024-09-14T10:51:30.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.748+0000 7f19187cc780 1 > prepared operation key=VW6U36JN2DBX tag=PHQQ35KVDTU4 type=del size=3501833 2024-09-14T10:51:30.748 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.750+0000 7f19187cc780 -1 < failed to complete operation key=6BNN842ZTWG5 tag=6X6D1F3QW08I type=del size=2240198: (22) Invalid argument 2024-09-14T10:51:30.750 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.751+0000 7f19187cc780 1 > prepared operation key=OVOPGTYUF3F3 tag=Y9GR773E7CPZ type=del size=3333298 2024-09-14T10:51:30.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.753+0000 7f19187cc780 1 < completed delete operation key=MFA30GSMCSKP tag=S0UPZCW12THZ type=del 2024-09-14T10:51:30.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.756+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~F8P3GVUZHVY9.0 size=1048576 2024-09-14T10:51:30.755 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.757+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~F8P3GVUZHVY9.1 size=581228 2024-09-14T10:51:30.755 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.757+0000 7f19187cc780 1 > prepared multipart upload key=KP3WOGIF30PZ upload=F8P3GVUZHVY9 tag=A1K16D2TOGIV type=write size=2678380 2024-09-14T10:51:30.756 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.758+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~HEK1BVNXPV5E.0 size=1048576 2024-09-14T10:51:30.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.759+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~HEK1BVNXPV5E.1 size=1048576 2024-09-14T10:51:30.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.761+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~HEK1BVNXPV5E.2 size=234920 2024-09-14T10:51:30.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.763+0000 7f19187cc780 1 < completed multipart upload key=7IWUW2HC3ULI upload=HEK1BVNXPV5E tag=O8X2R7OD0QCW type=write size=3380648 2024-09-14T10:51:30.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.766+0000 7f19187cc780 1 > prepared part key=_multipart_MFA30GSMCSKP.2~A7L06C6EV5IH.0 size=1048576 2024-09-14T10:51:30.766 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.767+0000 7f19187cc780 1 > prepared part key=_multipart_MFA30GSMCSKP.2~A7L06C6EV5IH.1 size=1048576 2024-09-14T10:51:30.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.769+0000 7f19187cc780 1 > prepared part key=_multipart_MFA30GSMCSKP.2~A7L06C6EV5IH.2 size=475926 2024-09-14T10:51:30.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.769+0000 7f19187cc780 1 > prepared multipart upload key=MFA30GSMCSKP upload=A7L06C6EV5IH tag=61QQQR1GEM23 type=write size=3621654 2024-09-14T10:51:30.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.771+0000 7f19187cc780 1 < completed delete operation key=QFEI6H4EQ9ZR tag=68L3SB313WZH type=del 2024-09-14T10:51:30.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.772+0000 7f19187cc780 1 > prepared operation key=54BSD3DEHNK6 tag=BNN8LL5R6VIH type=del size=1538814 2024-09-14T10:51:30.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.774+0000 7f19187cc780 1 < completed part key=_multipart_MFA30GSMCSKP.2~DTLUOS2XD59G.0 size=845996 2024-09-14T10:51:30.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.776+0000 7f19187cc780 1 < completed multipart upload key=MFA30GSMCSKP upload=DTLUOS2XD59G tag=VN049VCP57MK type=write size=1894572 2024-09-14T10:51:30.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.779+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~YB581HNZ0M9F.0 size=468960 2024-09-14T10:51:30.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.779+0000 7f19187cc780 1 > prepared multipart upload key=AGNUE76X8XCJ upload=YB581HNZ0M9F tag=XCZ5SE5G8NO0 type=write size=1517536 2024-09-14T10:51:30.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.780+0000 7f19187cc780 1 < canceled operation key=AST81B9QWORT tag=YDBNMSK7H76N type=del size=1770768 2024-09-14T10:51:30.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.783+0000 7f19187cc780 1 > prepared part key=_multipart_QFEI6H4EQ9ZR.2~V66QDFKP8NLP.0 size=765006 2024-09-14T10:51:30.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.783+0000 7f19187cc780 1 > prepared multipart upload key=QFEI6H4EQ9ZR upload=V66QDFKP8NLP tag=QJGKMOYL2HMB type=write size=1813582 2024-09-14T10:51:30.783 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.785+0000 7f19187cc780 1 < canceled operation key=E6UO1LUWOC44 tag=F00TDVMT41O0 type=del size=3523316 2024-09-14T10:51:30.785 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.786+0000 7f19187cc780 1 > prepared operation key=IKVYA4KEALFF tag=OG43KIA4BPVA type=del size=3771863 2024-09-14T10:51:30.786 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.788+0000 7f19187cc780 -1 < failed to complete operation key=6BNN842ZTWG5 tag=58KZXTH7SQMR type=del size=35509: (22) Invalid argument 2024-09-14T10:51:30.789 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.790+0000 7f19187cc780 1 > prepared part key=_multipart_19P3WE6HKJH2.2~IHUPJME4CADF.0 size=1048576 2024-09-14T10:51:30.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.791+0000 7f19187cc780 1 > prepared part key=_multipart_19P3WE6HKJH2.2~IHUPJME4CADF.1 size=1048576 2024-09-14T10:51:30.791 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.793+0000 7f19187cc780 1 > prepared part key=_multipart_19P3WE6HKJH2.2~IHUPJME4CADF.2 size=932604 2024-09-14T10:51:30.791 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.793+0000 7f19187cc780 1 > prepared multipart upload key=19P3WE6HKJH2 upload=IHUPJME4CADF tag=EEZ0FQSYFX2S type=write size=4078332 2024-09-14T10:51:30.793 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.794+0000 7f19187cc780 1 < completed write operation key=617QQI921HB4 tag=CDST9QOD466M type=write size=876043 2024-09-14T10:51:30.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.796+0000 7f19187cc780 1 > prepared operation key=RTGE7ISETJWW tag=R34UGTMESC79 type=del size=3957151 2024-09-14T10:51:30.796 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.798+0000 7f19187cc780 1 < completed delete operation key=KP3WOGIF30PZ tag=12H6LLMIM7XJ type=del 2024-09-14T10:51:30.797 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.799+0000 7f19187cc780 1 > prepared operation key=AGNUE76X8XCJ tag=XQ5ZO79QZFMK type=del size=2344210 2024-09-14T10:51:30.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.800+0000 7f19187cc780 1 < completed part key=_multipart_YA3DI7N4DG5K.2~Y3B9NZ9OF1ZH.0 size=1048576 2024-09-14T10:51:30.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.802+0000 7f19187cc780 1 < completed part key=_multipart_YA3DI7N4DG5K.2~Y3B9NZ9OF1ZH.1 size=741775 2024-09-14T10:51:30.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.804+0000 7f19187cc780 1 < completed multipart upload key=YA3DI7N4DG5K upload=Y3B9NZ9OF1ZH tag=NSO1J2Y6D3UR type=write size=2838927 2024-09-14T10:51:30.804 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.805+0000 7f19187cc780 1 > prepared operation key=INJQTKXHBUV2 tag=2J8WLGVXOGA7 type=write size=967680 2024-09-14T10:51:30.804 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.806+0000 7f19187cc780 1 < canceled part key=_multipart_6BNN842ZTWG5.2~Z2KVFE70OP7Z.0 size=1048576 2024-09-14T10:51:30.805 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.807+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~Z2KVFE70OP7Z.1 size=79704 2024-09-14T10:51:30.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.809+0000 7f19187cc780 1 < canceled multipart upload key=6BNN842ZTWG5 upload=Z2KVFE70OP7Z tag=VF94CBU67NBP type=write size=2176856 2024-09-14T10:51:30.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.810+0000 7f19187cc780 1 > prepared operation key=EZLSMEK89N2G tag=8CBVUHNO66D3 type=del size=4078432 2024-09-14T10:51:30.810 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.812+0000 7f19187cc780 1 < completed delete operation key=N0L67LS2KHR1 tag=FNOXWI7PY2BC type=del 2024-09-14T10:51:30.813 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.814+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~NIBCMFGPKJQ0.0 size=1048576 2024-09-14T10:51:30.814 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.815+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~NIBCMFGPKJQ0.1 size=1048576 2024-09-14T10:51:30.815 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.816+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~NIBCMFGPKJQ0.2 size=177710 2024-09-14T10:51:30.815 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.816+0000 7f19187cc780 1 > prepared multipart upload key=XCVE2F2JJK4X upload=NIBCMFGPKJQ0 tag=KHWTL5UINMZU type=write size=3323438 2024-09-14T10:51:30.816 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.818+0000 7f19187cc780 1 < completed delete operation key=75O00VMLJJ1X tag=044AH7GP1CWS type=del 2024-09-14T10:51:30.818 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.820+0000 7f19187cc780 1 > prepared part key=_multipart_EZLSMEK89N2G.2~FFJRZSIJLG3K.0 size=29606 2024-09-14T10:51:30.818 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.820+0000 7f19187cc780 1 > prepared multipart upload key=EZLSMEK89N2G upload=FFJRZSIJLG3K tag=8WMA6EC5PF7F type=write size=1078182 2024-09-14T10:51:30.820 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.821+0000 7f19187cc780 1 < completed part key=_multipart_AGNUE76X8XCJ.2~7LJ7I36X7ZPX.0 size=1048576 2024-09-14T10:51:30.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.823+0000 7f19187cc780 1 < completed part key=_multipart_AGNUE76X8XCJ.2~7LJ7I36X7ZPX.1 size=911542 2024-09-14T10:51:30.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.825+0000 7f19187cc780 1 < completed multipart upload key=AGNUE76X8XCJ upload=7LJ7I36X7ZPX tag=LGKZ97A7KU3O type=write size=3008694 2024-09-14T10:51:30.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.828+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~09BX2MPRPG7O.0 size=878414 2024-09-14T10:51:30.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.828+0000 7f19187cc780 1 > prepared multipart upload key=OVOPGTYUF3F3 upload=09BX2MPRPG7O tag=7OZA2OBMHIQ4 type=write size=1926990 2024-09-14T10:51:30.828 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.829+0000 7f19187cc780 1 < completed delete operation key=VW6U36JN2DBX tag=PHQQ35KVDTU4 type=del 2024-09-14T10:51:30.829 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.831+0000 7f19187cc780 1 > prepared operation key=KOJ7QB7M6A35 tag=2KI56RR3LRYH type=del size=927223 2024-09-14T10:51:30.832 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.833+0000 7f19187cc780 1 < suggested remove operation key=OVOPGTYUF3F3 tag=Y9GR773E7CPZ type=del 2024-09-14T10:51:30.833 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.835+0000 7f19187cc780 1 > prepared operation key=AST81B9QWORT tag=DZ4MO31Y3O3P type=del size=291424 2024-09-14T10:51:30.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.836+0000 7f19187cc780 1 < completed part key=_multipart_KP3WOGIF30PZ.2~F8P3GVUZHVY9.0 size=1048576 2024-09-14T10:51:30.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.837+0000 7f19187cc780 1 < completed part key=_multipart_KP3WOGIF30PZ.2~F8P3GVUZHVY9.1 size=581228 2024-09-14T10:51:30.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.839+0000 7f19187cc780 1 < completed multipart upload key=KP3WOGIF30PZ upload=F8P3GVUZHVY9 tag=A1K16D2TOGIV type=write size=2678380 2024-09-14T10:51:30.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.841+0000 7f19187cc780 1 > prepared operation key=AGNUE76X8XCJ tag=HD8ULEYWZEOP type=del size=3614342 2024-09-14T10:51:30.841 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.842+0000 7f19187cc780 1 < completed part key=_multipart_MFA30GSMCSKP.2~A7L06C6EV5IH.0 size=1048576 2024-09-14T10:51:30.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.844+0000 7f19187cc780 1 < completed part key=_multipart_MFA30GSMCSKP.2~A7L06C6EV5IH.1 size=1048576 2024-09-14T10:51:30.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.845+0000 7f19187cc780 1 < completed part key=_multipart_MFA30GSMCSKP.2~A7L06C6EV5IH.2 size=475926 2024-09-14T10:51:30.845 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.847+0000 7f19187cc780 1 < completed multipart upload key=MFA30GSMCSKP upload=A7L06C6EV5IH tag=61QQQR1GEM23 type=write size=3621654 2024-09-14T10:51:30.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.849+0000 7f19187cc780 1 > prepared operation key=61O2VU0SB379 tag=S7R99B1YG7TW type=del size=28032 2024-09-14T10:51:30.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.852+0000 7f19187cc780 1 < suggested update operation key=54BSD3DEHNK6 tag=BNN8LL5R6VIH type=del size=1538814 2024-09-14T10:51:30.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.853+0000 7f19187cc780 1 > prepared operation key=XCVE2F2JJK4X tag=LEXYGJIPJFFR type=write size=324047 2024-09-14T10:51:30.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.854+0000 7f19187cc780 1 < completed part key=_multipart_AGNUE76X8XCJ.2~YB581HNZ0M9F.0 size=468960 2024-09-14T10:51:30.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.857+0000 7f19187cc780 1 < completed multipart upload key=AGNUE76X8XCJ upload=YB581HNZ0M9F tag=XCZ5SE5G8NO0 type=write size=1517536 2024-09-14T10:51:30.858 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.859+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~WNY0272JPJB6.0 size=1048576 2024-09-14T10:51:30.859 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.860+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~WNY0272JPJB6.1 size=302834 2024-09-14T10:51:30.859 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.861+0000 7f19187cc780 1 > prepared multipart upload key=B9FQYIX19AEP upload=WNY0272JPJB6 tag=OIU9NBXP4YKZ type=write size=2399986 2024-09-14T10:51:30.860 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.862+0000 7f19187cc780 1 < completed part key=_multipart_QFEI6H4EQ9ZR.2~V66QDFKP8NLP.0 size=765006 2024-09-14T10:51:30.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.864+0000 7f19187cc780 1 < completed multipart upload key=QFEI6H4EQ9ZR upload=V66QDFKP8NLP tag=QJGKMOYL2HMB type=write size=1813582 2024-09-14T10:51:30.864 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.866+0000 7f19187cc780 1 > prepared operation key=E6UO1LUWOC44 tag=Z020X95VB6A7 type=del size=1985352 2024-09-14T10:51:30.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.867+0000 7f19187cc780 1 < completed delete operation key=IKVYA4KEALFF tag=OG43KIA4BPVA type=del 2024-09-14T10:51:30.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.869+0000 7f19187cc780 1 > prepared part key=_multipart_INJQTKXHBUV2.2~EJOJZ3QGFYK3.0 size=1048576 2024-09-14T10:51:30.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.870+0000 7f19187cc780 1 > prepared part key=_multipart_INJQTKXHBUV2.2~EJOJZ3QGFYK3.1 size=1048576 2024-09-14T10:51:30.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.872+0000 7f19187cc780 1 > prepared part key=_multipart_INJQTKXHBUV2.2~EJOJZ3QGFYK3.2 size=75860 2024-09-14T10:51:30.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.872+0000 7f19187cc780 1 > prepared multipart upload key=INJQTKXHBUV2 upload=EJOJZ3QGFYK3 tag=FHC5VQ9DDFA1 type=write size=3221588 2024-09-14T10:51:30.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.872+0000 7f19187cc780 1 < canceled part key=_multipart_19P3WE6HKJH2.2~IHUPJME4CADF.0 size=1048576 2024-09-14T10:51:30.871 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.873+0000 7f19187cc780 1 < completed part key=_multipart_19P3WE6HKJH2.2~IHUPJME4CADF.1 size=1048576 2024-09-14T10:51:30.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.874+0000 7f19187cc780 1 < completed part key=_multipart_19P3WE6HKJH2.2~IHUPJME4CADF.2 size=932604 2024-09-14T10:51:30.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.876+0000 7f19187cc780 1 < canceled multipart upload key=19P3WE6HKJH2 upload=IHUPJME4CADF tag=EEZ0FQSYFX2S type=write size=4078332 2024-09-14T10:51:30.877 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.879+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~2BJOPKO91N9K.0 size=1048576 2024-09-14T10:51:30.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.880+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~2BJOPKO91N9K.1 size=1048576 2024-09-14T10:51:30.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.881+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~2BJOPKO91N9K.2 size=557191 2024-09-14T10:51:30.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.881+0000 7f19187cc780 1 > prepared multipart upload key=AGNUE76X8XCJ upload=2BJOPKO91N9K tag=UFLU67H9DZOB type=write size=3702919 2024-09-14T10:51:30.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.882+0000 7f19187cc780 1 < completed delete operation key=RTGE7ISETJWW tag=R34UGTMESC79 type=del 2024-09-14T10:51:30.882 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.884+0000 7f19187cc780 1 > prepared operation key=RTGE7ISETJWW tag=04T1LNIF7SJI type=write size=1019055 2024-09-14T10:51:30.884 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.885+0000 7f19187cc780 1 < completed delete operation key=AGNUE76X8XCJ tag=XQ5ZO79QZFMK type=del 2024-09-14T10:51:30.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.887+0000 7f19187cc780 1 > prepared operation key=QBMNYNWOLK4I tag=SGADBR2XCEZC type=del size=2535916 2024-09-14T10:51:30.886 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.888+0000 7f19187cc780 1 < completed write operation key=INJQTKXHBUV2 tag=2J8WLGVXOGA7 type=write size=967680 2024-09-14T10:51:30.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.891+0000 7f19187cc780 1 > prepared part key=_multipart_19P3WE6HKJH2.2~56RPTB3TR7MM.0 size=1048576 2024-09-14T10:51:30.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.892+0000 7f19187cc780 1 > prepared part key=_multipart_19P3WE6HKJH2.2~56RPTB3TR7MM.1 size=1048576 2024-09-14T10:51:30.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.893+0000 7f19187cc780 1 > prepared part key=_multipart_19P3WE6HKJH2.2~56RPTB3TR7MM.2 size=193396 2024-09-14T10:51:30.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.893+0000 7f19187cc780 1 > prepared multipart upload key=19P3WE6HKJH2 upload=56RPTB3TR7MM tag=07039NE6OVUY type=write size=3339124 2024-09-14T10:51:30.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.894+0000 7f19187cc780 1 < canceled operation key=EZLSMEK89N2G tag=8CBVUHNO66D3 type=del size=4078432 2024-09-14T10:51:30.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.897+0000 7f19187cc780 1 > prepared part key=_multipart_AST81B9QWORT.2~35P7QNBYICGI.0 size=1048576 2024-09-14T10:51:30.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.898+0000 7f19187cc780 1 > prepared part key=_multipart_AST81B9QWORT.2~35P7QNBYICGI.1 size=298542 2024-09-14T10:51:30.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.898+0000 7f19187cc780 1 > prepared multipart upload key=AST81B9QWORT upload=35P7QNBYICGI tag=H8Y0F2UVFVIM type=write size=2395694 2024-09-14T10:51:30.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.898+0000 7f19187cc780 1 < canceled part key=_multipart_XCVE2F2JJK4X.2~NIBCMFGPKJQ0.0 size=1048576 2024-09-14T10:51:30.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.899+0000 7f19187cc780 1 < completed part key=_multipart_XCVE2F2JJK4X.2~NIBCMFGPKJQ0.1 size=1048576 2024-09-14T10:51:30.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.900+0000 7f19187cc780 1 < completed part key=_multipart_XCVE2F2JJK4X.2~NIBCMFGPKJQ0.2 size=177710 2024-09-14T10:51:30.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.902+0000 7f19187cc780 1 < canceled multipart upload key=XCVE2F2JJK4X upload=NIBCMFGPKJQ0 tag=KHWTL5UINMZU type=write size=3323438 2024-09-14T10:51:30.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.905+0000 7f19187cc780 1 > prepared part key=_multipart_9EBD5ZT6MT45.2~531ZTA79YSS0.0 size=1048576 2024-09-14T10:51:30.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.906+0000 7f19187cc780 1 > prepared part key=_multipart_9EBD5ZT6MT45.2~531ZTA79YSS0.1 size=1048576 2024-09-14T10:51:30.905 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.907+0000 7f19187cc780 1 > prepared part key=_multipart_9EBD5ZT6MT45.2~531ZTA79YSS0.2 size=663934 2024-09-14T10:51:30.905 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.907+0000 7f19187cc780 1 > prepared multipart upload key=9EBD5ZT6MT45 upload=531ZTA79YSS0 tag=KBSPUS3NBAT9 type=write size=3809662 2024-09-14T10:51:30.907 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.908+0000 7f19187cc780 1 < completed part key=_multipart_EZLSMEK89N2G.2~FFJRZSIJLG3K.0 size=29606 2024-09-14T10:51:30.909 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.911+0000 7f19187cc780 1 < completed multipart upload key=EZLSMEK89N2G upload=FFJRZSIJLG3K tag=8WMA6EC5PF7F type=write size=1078182 2024-09-14T10:51:30.911 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.912+0000 7f19187cc780 1 > prepared operation key=AST81B9QWORT tag=T2V6E5R5BCWG type=write size=373526 2024-09-14T10:51:30.912 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.914+0000 7f19187cc780 1 < completed part key=_multipart_OVOPGTYUF3F3.2~09BX2MPRPG7O.0 size=878414 2024-09-14T10:51:30.914 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.916+0000 7f19187cc780 1 < completed multipart upload key=OVOPGTYUF3F3 upload=09BX2MPRPG7O tag=7OZA2OBMHIQ4 type=write size=1926990 2024-09-14T10:51:30.915 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.917+0000 7f19187cc780 1 > prepared operation key=N0L67LS2KHR1 tag=4Q2PU1L9JTZ4 type=del size=2756404 2024-09-14T10:51:30.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.918+0000 7f19187cc780 1 < completed delete operation key=KOJ7QB7M6A35 tag=2KI56RR3LRYH type=del 2024-09-14T10:51:30.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.920+0000 7f19187cc780 1 > prepared operation key=INJQTKXHBUV2 tag=9UM2859ONVLM type=del size=398141 2024-09-14T10:51:30.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.923+0000 7f19187cc780 1 < suggested remove operation key=AST81B9QWORT tag=DZ4MO31Y3O3P type=del 2024-09-14T10:51:30.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.924+0000 7f19187cc780 1 > prepared operation key=VW6U36JN2DBX tag=0P6RPX9YTUH7 type=del size=603255 2024-09-14T10:51:30.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.925+0000 7f19187cc780 1 < completed delete operation key=AGNUE76X8XCJ tag=HD8ULEYWZEOP type=del 2024-09-14T10:51:30.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.927+0000 7f19187cc780 1 > prepared operation key=IKVYA4KEALFF tag=OGTA4L646CLI type=del size=3791920 2024-09-14T10:51:30.927 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.928+0000 7f19187cc780 1 < completed delete operation key=61O2VU0SB379 tag=S7R99B1YG7TW type=del 2024-09-14T10:51:30.928 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.930+0000 7f19187cc780 1 > prepared operation key=W1K1IU13J0CZ tag=2WF8Y6DQA6XL type=write size=119947 2024-09-14T10:51:30.930 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.931+0000 7f19187cc780 1 < completed write operation key=XCVE2F2JJK4X tag=LEXYGJIPJFFR type=write size=324047 2024-09-14T10:51:30.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.933+0000 7f19187cc780 1 > prepared operation key=KOJ7QB7M6A35 tag=2LYUQ1BVDQF7 type=del size=636661 2024-09-14T10:51:30.933 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.934+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~WNY0272JPJB6.0 size=1048576 2024-09-14T10:51:30.933 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.935+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~WNY0272JPJB6.1 size=302834 2024-09-14T10:51:30.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.938+0000 7f19187cc780 1 < completed multipart upload key=B9FQYIX19AEP upload=WNY0272JPJB6 tag=OIU9NBXP4YKZ type=write size=2399986 2024-09-14T10:51:30.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.940+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~NCY4CV2MW93V.0 size=1048576 2024-09-14T10:51:30.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.941+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~NCY4CV2MW93V.1 size=294484 2024-09-14T10:51:30.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.941+0000 7f19187cc780 1 > prepared multipart upload key=KP3WOGIF30PZ upload=NCY4CV2MW93V tag=ASUU26VBTFL7 type=write size=2391636 2024-09-14T10:51:30.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.943+0000 7f19187cc780 1 < completed delete operation key=E6UO1LUWOC44 tag=Z020X95VB6A7 type=del 2024-09-14T10:51:30.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.944+0000 7f19187cc780 1 > prepared operation key=9EBD5ZT6MT45 tag=6U6J0GBDNYSS type=del size=2044181 2024-09-14T10:51:30.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.946+0000 7f19187cc780 1 < completed part key=_multipart_INJQTKXHBUV2.2~EJOJZ3QGFYK3.0 size=1048576 2024-09-14T10:51:30.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.947+0000 7f19187cc780 1 < completed part key=_multipart_INJQTKXHBUV2.2~EJOJZ3QGFYK3.1 size=1048576 2024-09-14T10:51:30.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.948+0000 7f19187cc780 1 < completed part key=_multipart_INJQTKXHBUV2.2~EJOJZ3QGFYK3.2 size=75860 2024-09-14T10:51:30.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.950+0000 7f19187cc780 1 < completed multipart upload key=INJQTKXHBUV2 upload=EJOJZ3QGFYK3 tag=FHC5VQ9DDFA1 type=write size=3221588 2024-09-14T10:51:30.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.952+0000 7f19187cc780 1 > prepared operation key=54BSD3DEHNK6 tag=OV17WKSD6FVF type=del size=592278 2024-09-14T10:51:30.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.954+0000 7f19187cc780 1 < completed part key=_multipart_AGNUE76X8XCJ.2~2BJOPKO91N9K.0 size=1048576 2024-09-14T10:51:30.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.955+0000 7f19187cc780 1 < completed part key=_multipart_AGNUE76X8XCJ.2~2BJOPKO91N9K.1 size=1048576 2024-09-14T10:51:30.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.956+0000 7f19187cc780 1 < completed part key=_multipart_AGNUE76X8XCJ.2~2BJOPKO91N9K.2 size=557191 2024-09-14T10:51:31.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.958+0000 7f19187cc780 1 < completed multipart upload key=AGNUE76X8XCJ upload=2BJOPKO91N9K tag=UFLU67H9DZOB type=write size=3702919 2024-09-14T10:51:31.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.961+0000 7f19187cc780 1 > prepared part key=_multipart_MFA30GSMCSKP.2~V00B4IO37RMN.0 size=182941 2024-09-14T10:51:31.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.961+0000 7f19187cc780 1 > prepared multipart upload key=MFA30GSMCSKP upload=V00B4IO37RMN tag=HD057YDPU5SS type=write size=1231517 2024-09-14T10:51:31.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.964+0000 7f19187cc780 1 < suggested update operation key=RTGE7ISETJWW tag=04T1LNIF7SJI type=write size=1019055 2024-09-14T10:51:31.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.966+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~9JBUMXKCPPKA.0 size=1048576 2024-09-14T10:51:31.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.967+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~9JBUMXKCPPKA.1 size=809540 2024-09-14T10:51:31.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.967+0000 7f19187cc780 1 > prepared multipart upload key=KOJ7QB7M6A35 upload=9JBUMXKCPPKA tag=KHQECUDVQOQ0 type=write size=2906692 2024-09-14T10:51:31.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.969+0000 7f19187cc780 1 < completed delete operation key=QBMNYNWOLK4I tag=SGADBR2XCEZC type=del 2024-09-14T10:51:31.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.971+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~0RB3KH6RGZFP.0 size=808644 2024-09-14T10:51:31.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.971+0000 7f19187cc780 1 > prepared multipart upload key=7IWUW2HC3ULI upload=0RB3KH6RGZFP tag=A06AGYZQ6HKS type=write size=1857220 2024-09-14T10:51:31.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.973+0000 7f19187cc780 1 < completed part key=_multipart_19P3WE6HKJH2.2~56RPTB3TR7MM.0 size=1048576 2024-09-14T10:51:31.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.974+0000 7f19187cc780 1 < completed part key=_multipart_19P3WE6HKJH2.2~56RPTB3TR7MM.1 size=1048576 2024-09-14T10:51:31.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.975+0000 7f19187cc780 1 < completed part key=_multipart_19P3WE6HKJH2.2~56RPTB3TR7MM.2 size=193396 2024-09-14T10:51:31.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.978+0000 7f19187cc780 1 < completed multipart upload key=19P3WE6HKJH2 upload=56RPTB3TR7MM tag=07039NE6OVUY type=write size=3339124 2024-09-14T10:51:31.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.979+0000 7f19187cc780 1 > prepared operation key=VW6U36JN2DBX tag=75N5IMLN5O2Y type=write size=410100 2024-09-14T10:51:31.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.981+0000 7f19187cc780 1 < completed part key=_multipart_AST81B9QWORT.2~35P7QNBYICGI.0 size=1048576 2024-09-14T10:51:31.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.981+0000 7f19187cc780 1 < canceled part key=_multipart_AST81B9QWORT.2~35P7QNBYICGI.1 size=298542 2024-09-14T10:51:31.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.983+0000 7f19187cc780 1 < canceled multipart upload key=AST81B9QWORT upload=35P7QNBYICGI tag=H8Y0F2UVFVIM type=write size=2395694 2024-09-14T10:51:31.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.986+0000 7f19187cc780 1 > prepared part key=_multipart_MFA30GSMCSKP.2~IF3ZLZD713FL.0 size=886302 2024-09-14T10:51:31.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.986+0000 7f19187cc780 1 > prepared multipart upload key=MFA30GSMCSKP upload=IF3ZLZD713FL tag=W6HVU2J5KEGS type=write size=1934878 2024-09-14T10:51:31.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.987+0000 7f19187cc780 1 < completed part key=_multipart_9EBD5ZT6MT45.2~531ZTA79YSS0.0 size=1048576 2024-09-14T10:51:31.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.988+0000 7f19187cc780 1 < completed part key=_multipart_9EBD5ZT6MT45.2~531ZTA79YSS0.1 size=1048576 2024-09-14T10:51:31.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.989+0000 7f19187cc780 1 < completed part key=_multipart_9EBD5ZT6MT45.2~531ZTA79YSS0.2 size=663934 2024-09-14T10:51:31.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.992+0000 7f19187cc780 1 < completed multipart upload key=9EBD5ZT6MT45 upload=531ZTA79YSS0 tag=KBSPUS3NBAT9 type=write size=3809662 2024-09-14T10:51:31.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.994+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~Y8JAVZ2DOBAY.0 size=708202 2024-09-14T10:51:31.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.994+0000 7f19187cc780 1 > prepared multipart upload key=B9FQYIX19AEP upload=Y8JAVZ2DOBAY tag=01AL4B0WR81C type=write size=1756778 2024-09-14T10:51:31.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.996+0000 7f19187cc780 -1 < failed to complete operation key=AST81B9QWORT tag=T2V6E5R5BCWG type=write size=373526: (22) Invalid argument 2024-09-14T10:51:31.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:30.997+0000 7f19187cc780 1 > prepared operation key=KOJ7QB7M6A35 tag=FT2Y0DPTX4MT type=del size=1744095 2024-09-14T10:51:31.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.000+0000 7f19187cc780 1 < suggested update operation key=N0L67LS2KHR1 tag=4Q2PU1L9JTZ4 type=del size=2756404 2024-09-14T10:51:31.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.003+0000 7f19187cc780 1 > prepared part key=_multipart_YA3DI7N4DG5K.2~1EFAXC68662C.0 size=1048576 2024-09-14T10:51:31.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.004+0000 7f19187cc780 1 > prepared part key=_multipart_YA3DI7N4DG5K.2~1EFAXC68662C.1 size=1048576 2024-09-14T10:51:31.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.005+0000 7f19187cc780 1 > prepared part key=_multipart_YA3DI7N4DG5K.2~1EFAXC68662C.2 size=41544 2024-09-14T10:51:31.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.005+0000 7f19187cc780 1 > prepared multipart upload key=YA3DI7N4DG5K upload=1EFAXC68662C tag=8IL090ZYD8T8 type=write size=3187272 2024-09-14T10:51:31.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.007+0000 7f19187cc780 1 < completed delete operation key=INJQTKXHBUV2 tag=9UM2859ONVLM type=del 2024-09-14T10:51:31.009 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.008+0000 7f19187cc780 1 > prepared operation key=XCVE2F2JJK4X tag=3N4CC1JS76XL type=del size=4044247 2024-09-14T10:51:31.009 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.010+0000 7f19187cc780 1 < canceled operation key=VW6U36JN2DBX tag=0P6RPX9YTUH7 type=del size=603255 2024-09-14T10:51:31.009 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.011+0000 7f19187cc780 1 > prepared operation key=XCVE2F2JJK4X tag=PRDGTV18NZJL type=del size=913991 2024-09-14T10:51:31.011 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.012+0000 7f19187cc780 1 < completed delete operation key=IKVYA4KEALFF tag=OGTA4L646CLI type=del 2024-09-14T10:51:31.013 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.015+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~P9DEODN33OG2.0 size=878337 2024-09-14T10:51:31.013 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.015+0000 7f19187cc780 1 > prepared multipart upload key=OVOPGTYUF3F3 upload=P9DEODN33OG2 tag=KOUL2QNIJV6L type=write size=1926913 2024-09-14T10:51:31.016 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.018+0000 7f19187cc780 1 < suggested remove operation key=W1K1IU13J0CZ tag=2WF8Y6DQA6XL type=write 2024-09-14T10:51:31.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.019+0000 7f19187cc780 1 > prepared operation key=RTGE7ISETJWW tag=08OMEEAS929D type=del size=3037998 2024-09-14T10:51:31.019 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.021+0000 7f19187cc780 1 < completed delete operation key=KOJ7QB7M6A35 tag=2LYUQ1BVDQF7 type=del 2024-09-14T10:51:31.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.022+0000 7f19187cc780 1 > prepared operation key=QFEI6H4EQ9ZR tag=7W0CF28GY309 type=del size=3946603 2024-09-14T10:51:31.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.024+0000 7f19187cc780 1 < completed part key=_multipart_KP3WOGIF30PZ.2~NCY4CV2MW93V.0 size=1048576 2024-09-14T10:51:31.024 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.025+0000 7f19187cc780 1 < completed part key=_multipart_KP3WOGIF30PZ.2~NCY4CV2MW93V.1 size=294484 2024-09-14T10:51:31.027 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.029+0000 7f19187cc780 1 < completed multipart upload key=KP3WOGIF30PZ upload=NCY4CV2MW93V tag=ASUU26VBTFL7 type=write size=2391636 2024-09-14T10:51:31.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.032+0000 7f19187cc780 1 > prepared part key=_multipart_EZLSMEK89N2G.2~C1ZFX3EVQNT6.0 size=484967 2024-09-14T10:51:31.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.032+0000 7f19187cc780 1 > prepared multipart upload key=EZLSMEK89N2G upload=C1ZFX3EVQNT6 tag=U2EM3HJCXCE6 type=write size=1533543 2024-09-14T10:51:31.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.033+0000 7f19187cc780 1 < canceled operation key=9EBD5ZT6MT45 tag=6U6J0GBDNYSS type=del size=2044181 2024-09-14T10:51:31.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.036+0000 7f19187cc780 1 > prepared part key=_multipart_YA3DI7N4DG5K.2~6E59FU8289KK.0 size=808030 2024-09-14T10:51:31.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.036+0000 7f19187cc780 1 > prepared multipart upload key=YA3DI7N4DG5K upload=6E59FU8289KK tag=7BCEZR4IGBHP type=write size=1856606 2024-09-14T10:51:31.036 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.037+0000 7f19187cc780 1 < canceled operation key=54BSD3DEHNK6 tag=OV17WKSD6FVF type=del size=592278 2024-09-14T10:51:31.038 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.040+0000 7f19187cc780 1 > prepared part key=_multipart_75O00VMLJJ1X.2~AYG23HR4Z2VI.0 size=454757 2024-09-14T10:51:31.038 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.040+0000 7f19187cc780 1 > prepared multipart upload key=75O00VMLJJ1X upload=AYG23HR4Z2VI tag=43L38V5TGH6N type=write size=1503333 2024-09-14T10:51:31.040 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.041+0000 7f19187cc780 1 < completed part key=_multipart_MFA30GSMCSKP.2~V00B4IO37RMN.0 size=182941 2024-09-14T10:51:31.042 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.044+0000 7f19187cc780 1 < completed multipart upload key=MFA30GSMCSKP upload=V00B4IO37RMN tag=HD057YDPU5SS type=write size=1231517 2024-09-14T10:51:31.044 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.045+0000 7f19187cc780 1 > prepared operation key=M73CER01XHDY tag=JAXV9I1FWKTF type=del size=2595694 2024-09-14T10:51:31.045 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.047+0000 7f19187cc780 1 < completed part key=_multipart_KOJ7QB7M6A35.2~9JBUMXKCPPKA.0 size=1048576 2024-09-14T10:51:31.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.048+0000 7f19187cc780 1 < completed part key=_multipart_KOJ7QB7M6A35.2~9JBUMXKCPPKA.1 size=809540 2024-09-14T10:51:31.051 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.052+0000 7f19187cc780 1 < completed multipart upload key=KOJ7QB7M6A35 upload=9JBUMXKCPPKA tag=KHQECUDVQOQ0 type=write size=2906692 2024-09-14T10:51:31.052 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.054+0000 7f19187cc780 1 > prepared operation key=YA3DI7N4DG5K tag=SYVV64DMS6QB type=del size=1940889 2024-09-14T10:51:31.054 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.055+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~0RB3KH6RGZFP.0 size=808644 2024-09-14T10:51:31.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.058+0000 7f19187cc780 1 < completed multipart upload key=7IWUW2HC3ULI upload=0RB3KH6RGZFP tag=A06AGYZQ6HKS type=write size=1857220 2024-09-14T10:51:31.059 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.060+0000 7f19187cc780 1 > prepared operation key=CADC2BY888V1 tag=J5355CQH5O3Z type=del size=2971418 2024-09-14T10:51:31.061 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.062+0000 7f19187cc780 1 < completed write operation key=VW6U36JN2DBX tag=75N5IMLN5O2Y type=write size=410100 2024-09-14T10:51:31.063 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.065+0000 7f19187cc780 1 > prepared operation key=B9FQYIX19AEP tag=M35KT3NFASQR type=write size=346193 2024-09-14T10:51:31.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.066+0000 7f19187cc780 1 < completed part key=_multipart_MFA30GSMCSKP.2~IF3ZLZD713FL.0 size=886302 2024-09-14T10:51:31.067 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.069+0000 7f19187cc780 1 < completed multipart upload key=MFA30GSMCSKP upload=IF3ZLZD713FL tag=W6HVU2J5KEGS type=write size=1934878 2024-09-14T10:51:31.068 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.070+0000 7f19187cc780 1 > prepared operation key=KP3WOGIF30PZ tag=K74ARXO87NOB type=write size=850984 2024-09-14T10:51:31.070 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.072+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~Y8JAVZ2DOBAY.0 size=708202 2024-09-14T10:51:31.072 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.074+0000 7f19187cc780 1 < completed multipart upload key=B9FQYIX19AEP upload=Y8JAVZ2DOBAY tag=01AL4B0WR81C type=write size=1756778 2024-09-14T10:51:31.074 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.075+0000 7f19187cc780 1 > prepared operation key=INJQTKXHBUV2 tag=75QAXDUFZ76T type=del size=1059930 2024-09-14T10:51:31.075 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.077+0000 7f19187cc780 1 < completed delete operation key=KOJ7QB7M6A35 tag=FT2Y0DPTX4MT type=del 2024-09-14T10:51:31.077 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.078+0000 7f19187cc780 1 > prepared operation key=61O2VU0SB379 tag=4PYH55W2DQ1J type=del size=3979483 2024-09-14T10:51:31.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.079+0000 7f19187cc780 1 < canceled part key=_multipart_YA3DI7N4DG5K.2~1EFAXC68662C.0 size=1048576 2024-09-14T10:51:31.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.080+0000 7f19187cc780 1 < completed part key=_multipart_YA3DI7N4DG5K.2~1EFAXC68662C.1 size=1048576 2024-09-14T10:51:31.080 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.081+0000 7f19187cc780 1 < completed part key=_multipart_YA3DI7N4DG5K.2~1EFAXC68662C.2 size=41544 2024-09-14T10:51:31.082 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.083+0000 7f19187cc780 1 < canceled multipart upload key=YA3DI7N4DG5K upload=1EFAXC68662C tag=8IL090ZYD8T8 type=write size=3187272 2024-09-14T10:51:31.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.085+0000 7f19187cc780 1 > prepared operation key=H40763V7HMBC tag=N6CKBUBGO0MI type=del size=1380093 2024-09-14T10:51:31.085 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.086+0000 7f19187cc780 1 < completed delete operation key=XCVE2F2JJK4X tag=3N4CC1JS76XL type=del 2024-09-14T10:51:31.086 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.088+0000 7f19187cc780 1 > prepared operation key=AGNUE76X8XCJ tag=34EO7EHTPJMJ type=del size=3253532 2024-09-14T10:51:31.088 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.089+0000 7f19187cc780 1 < completed delete operation key=XCVE2F2JJK4X tag=PRDGTV18NZJL type=del 2024-09-14T10:51:31.089 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.091+0000 7f19187cc780 1 > prepared operation key=5AIAYJMRZGFQ tag=68FPZUJ1O9C8 type=del size=3554043 2024-09-14T10:51:31.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.093+0000 7f19187cc780 1 < completed part key=_multipart_OVOPGTYUF3F3.2~P9DEODN33OG2.0 size=878337 2024-09-14T10:51:31.093 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.095+0000 7f19187cc780 1 < completed multipart upload key=OVOPGTYUF3F3 upload=P9DEODN33OG2 tag=KOUL2QNIJV6L type=write size=1926913 2024-09-14T10:51:31.095 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.096+0000 7f19187cc780 1 > prepared operation key=9EBD5ZT6MT45 tag=VNLAG6JM35CB type=del size=608023 2024-09-14T10:51:31.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.098+0000 7f19187cc780 1 < completed delete operation key=RTGE7ISETJWW tag=08OMEEAS929D type=del 2024-09-14T10:51:31.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.101+0000 7f19187cc780 1 > prepared part key=_multipart_RTGE7ISETJWW.2~QIX5CTXJNAAX.0 size=64207 2024-09-14T10:51:31.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.101+0000 7f19187cc780 1 > prepared multipart upload key=RTGE7ISETJWW upload=QIX5CTXJNAAX tag=4SP5OXFCBK02 type=write size=1112783 2024-09-14T10:51:31.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.102+0000 7f19187cc780 1 < completed delete operation key=QFEI6H4EQ9ZR tag=7W0CF28GY309 type=del 2024-09-14T10:51:31.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.104+0000 7f19187cc780 1 > prepared operation key=EL00Y4Z7DTAT tag=YTTXSDDE80DW type=write size=772315 2024-09-14T10:51:31.104 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.106+0000 7f19187cc780 1 < completed part key=_multipart_EZLSMEK89N2G.2~C1ZFX3EVQNT6.0 size=484967 2024-09-14T10:51:31.107 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.109+0000 7f19187cc780 1 < completed multipart upload key=EZLSMEK89N2G upload=C1ZFX3EVQNT6 tag=U2EM3HJCXCE6 type=write size=1533543 2024-09-14T10:51:31.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.111+0000 7f19187cc780 1 > prepared operation key=617QQI921HB4 tag=UUFWVG9PZMAE type=del size=576163 2024-09-14T10:51:31.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.112+0000 7f19187cc780 1 < completed part key=_multipart_YA3DI7N4DG5K.2~6E59FU8289KK.0 size=808030 2024-09-14T10:51:31.118 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.115+0000 7f19187cc780 1 < completed multipart upload key=YA3DI7N4DG5K upload=6E59FU8289KK tag=7BCEZR4IGBHP type=write size=1856606 2024-09-14T10:51:31.118 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.118+0000 7f19187cc780 1 > prepared part key=_multipart_QFEI6H4EQ9ZR.2~IBKWULMP1VE1.0 size=1017480 2024-09-14T10:51:31.118 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.118+0000 7f19187cc780 1 > prepared multipart upload key=QFEI6H4EQ9ZR upload=IBKWULMP1VE1 tag=XK1DIXTVV086 type=write size=2066056 2024-09-14T10:51:31.118 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.119+0000 7f19187cc780 1 < completed part key=_multipart_75O00VMLJJ1X.2~AYG23HR4Z2VI.0 size=454757 2024-09-14T10:51:31.120 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.122+0000 7f19187cc780 1 < completed multipart upload key=75O00VMLJJ1X upload=AYG23HR4Z2VI tag=43L38V5TGH6N type=write size=1503333 2024-09-14T10:51:31.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.124+0000 7f19187cc780 1 > prepared part key=_multipart_E6UO1LUWOC44.2~WZA8EBOKQ36I.0 size=1048576 2024-09-14T10:51:31.124 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.125+0000 7f19187cc780 1 > prepared part key=_multipart_E6UO1LUWOC44.2~WZA8EBOKQ36I.1 size=1048576 2024-09-14T10:51:31.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.126+0000 7f19187cc780 1 > prepared part key=_multipart_E6UO1LUWOC44.2~WZA8EBOKQ36I.2 size=59656 2024-09-14T10:51:31.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.126+0000 7f19187cc780 1 > prepared multipart upload key=E6UO1LUWOC44 upload=WZA8EBOKQ36I tag=AWVQBW5V8UXZ type=write size=3205384 2024-09-14T10:51:31.127 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.129+0000 7f19187cc780 1 < suggested remove operation key=M73CER01XHDY tag=JAXV9I1FWKTF type=del 2024-09-14T10:51:31.130 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.132+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~AJT2CO3VZYI1.0 size=1048576 2024-09-14T10:51:31.131 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.133+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~AJT2CO3VZYI1.1 size=1048576 2024-09-14T10:51:31.132 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.134+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~AJT2CO3VZYI1.2 size=682550 2024-09-14T10:51:31.132 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.134+0000 7f19187cc780 1 > prepared multipart upload key=B9FQYIX19AEP upload=AJT2CO3VZYI1 tag=RGNA6PFC96MQ type=write size=3828278 2024-09-14T10:51:31.134 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.135+0000 7f19187cc780 1 < completed delete operation key=YA3DI7N4DG5K tag=SYVV64DMS6QB type=del 2024-09-14T10:51:31.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.137+0000 7f19187cc780 1 > prepared operation key=IKVYA4KEALFF tag=NL154UBNH8EY type=del size=2449438 2024-09-14T10:51:31.137 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.139+0000 7f19187cc780 1 < completed delete operation key=CADC2BY888V1 tag=J5355CQH5O3Z type=del 2024-09-14T10:51:31.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.141+0000 7f19187cc780 1 > prepared operation key=6BNN842ZTWG5 tag=6I7SK0BEC9ZM type=del size=2800564 2024-09-14T10:51:31.142 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.143+0000 7f19187cc780 1 < suggested remove operation key=B9FQYIX19AEP tag=M35KT3NFASQR type=write 2024-09-14T10:51:31.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.146+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~2DOAUFX1XJPV.0 size=312740 2024-09-14T10:51:31.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.146+0000 7f19187cc780 1 > prepared multipart upload key=KOJ7QB7M6A35 upload=2DOAUFX1XJPV tag=5MKIQZ4XTFF2 type=write size=1361316 2024-09-14T10:51:31.147 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.149+0000 7f19187cc780 1 < suggested remove operation key=KP3WOGIF30PZ tag=K74ARXO87NOB type=write 2024-09-14T10:51:31.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.150+0000 7f19187cc780 1 > prepared operation key=YA3DI7N4DG5K tag=BB82W7IH7XWP type=del size=3886132 2024-09-14T10:51:31.150 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.152+0000 7f19187cc780 1 < completed delete operation key=INJQTKXHBUV2 tag=75QAXDUFZ76T type=del 2024-09-14T10:51:31.152 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.153+0000 7f19187cc780 1 > prepared operation key=7IWUW2HC3ULI tag=MFPFPG52LRTB type=del size=3151460 2024-09-14T10:51:31.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.155+0000 7f19187cc780 1 < completed delete operation key=61O2VU0SB379 tag=4PYH55W2DQ1J type=del 2024-09-14T10:51:31.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.156+0000 7f19187cc780 1 > prepared operation key=YA3DI7N4DG5K tag=W7G6D6SRBWRN type=del size=595825 2024-09-14T10:51:31.156 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.158+0000 7f19187cc780 1 < completed delete operation key=H40763V7HMBC tag=N6CKBUBGO0MI type=del 2024-09-14T10:51:31.157 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.159+0000 7f19187cc780 1 > prepared operation key=MFA30GSMCSKP tag=ZRWRO326CBQX type=del size=2904733 2024-09-14T10:51:31.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.161+0000 7f19187cc780 1 < completed delete operation key=AGNUE76X8XCJ tag=34EO7EHTPJMJ type=del 2024-09-14T10:51:31.162 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.163+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~LKE6XEAH004J.0 size=747789 2024-09-14T10:51:31.162 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.163+0000 7f19187cc780 1 > prepared multipart upload key=IKVYA4KEALFF upload=LKE6XEAH004J tag=QNW265FJWBWG type=write size=1796365 2024-09-14T10:51:31.164 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.166+0000 7f19187cc780 1 < suggested update operation key=5AIAYJMRZGFQ tag=68FPZUJ1O9C8 type=del size=3554043 2024-09-14T10:51:31.167 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.169+0000 7f19187cc780 1 > prepared part key=_multipart_19P3WE6HKJH2.2~QT9RBF6CSJW4.0 size=1048576 2024-09-14T10:51:31.168 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.170+0000 7f19187cc780 1 > prepared part key=_multipart_19P3WE6HKJH2.2~QT9RBF6CSJW4.1 size=1031819 2024-09-14T10:51:31.168 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.170+0000 7f19187cc780 1 > prepared multipart upload key=19P3WE6HKJH2 upload=QT9RBF6CSJW4 tag=KNY28RUAKT23 type=write size=3128971 2024-09-14T10:51:31.170 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.171+0000 7f19187cc780 1 < completed delete operation key=9EBD5ZT6MT45 tag=VNLAG6JM35CB type=del 2024-09-14T10:51:31.172 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.174+0000 7f19187cc780 1 > prepared part key=_multipart_EL00Y4Z7DTAT.2~030M92HVR6DB.0 size=527932 2024-09-14T10:51:31.172 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.174+0000 7f19187cc780 1 > prepared multipart upload key=EL00Y4Z7DTAT upload=030M92HVR6DB tag=BP3L700C5VV8 type=write size=1576508 2024-09-14T10:51:31.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.175+0000 7f19187cc780 1 < completed part key=_multipart_RTGE7ISETJWW.2~QIX5CTXJNAAX.0 size=64207 2024-09-14T10:51:31.176 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.178+0000 7f19187cc780 1 < completed multipart upload key=RTGE7ISETJWW upload=QIX5CTXJNAAX tag=4SP5OXFCBK02 type=write size=1112783 2024-09-14T10:51:31.179 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.180+0000 7f19187cc780 1 > prepared part key=_multipart_5AIAYJMRZGFQ.2~OZG8UYKOJVHK.0 size=77003 2024-09-14T10:51:31.179 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.180+0000 7f19187cc780 1 > prepared multipart upload key=5AIAYJMRZGFQ upload=OZG8UYKOJVHK tag=Q7H9HGUW73UK type=write size=1125579 2024-09-14T10:51:31.180 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.182+0000 7f19187cc780 1 < completed write operation key=EL00Y4Z7DTAT tag=YTTXSDDE80DW type=write size=772315 2024-09-14T10:51:31.183 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.184+0000 7f19187cc780 1 > prepared part key=_multipart_61O2VU0SB379.2~RKV7PHHT2XD9.0 size=1048576 2024-09-14T10:51:31.184 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.185+0000 7f19187cc780 1 > prepared part key=_multipart_61O2VU0SB379.2~RKV7PHHT2XD9.1 size=40243 2024-09-14T10:51:31.184 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.185+0000 7f19187cc780 1 > prepared multipart upload key=61O2VU0SB379 upload=RKV7PHHT2XD9 tag=A7BQR2TBWEFA type=write size=2137395 2024-09-14T10:51:31.185 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.187+0000 7f19187cc780 1 < canceled operation key=617QQI921HB4 tag=UUFWVG9PZMAE type=del size=576163 2024-09-14T10:51:31.187 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.188+0000 7f19187cc780 1 > prepared operation key=M73CER01XHDY tag=S17PFWYYJ20M type=del size=3176974 2024-09-14T10:51:31.189 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.190+0000 7f19187cc780 1 < completed part key=_multipart_QFEI6H4EQ9ZR.2~IBKWULMP1VE1.0 size=1017480 2024-09-14T10:51:31.191 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.192+0000 7f19187cc780 1 < completed multipart upload key=QFEI6H4EQ9ZR upload=IBKWULMP1VE1 tag=XK1DIXTVV086 type=write size=2066056 2024-09-14T10:51:31.193 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.195+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~2JQLXT70KBPF.0 size=1048576 2024-09-14T10:51:31.194 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.196+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~2JQLXT70KBPF.1 size=1048576 2024-09-14T10:51:31.195 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.197+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~2JQLXT70KBPF.2 size=253937 2024-09-14T10:51:31.195 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.197+0000 7f19187cc780 1 > prepared multipart upload key=7IWUW2HC3ULI upload=2JQLXT70KBPF tag=GTIJXG1A1ZIA type=write size=3399665 2024-09-14T10:51:31.197 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.199+0000 7f19187cc780 1 < completed part key=_multipart_E6UO1LUWOC44.2~WZA8EBOKQ36I.0 size=1048576 2024-09-14T10:51:31.199 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.201+0000 7f19187cc780 1 < completed part key=_multipart_E6UO1LUWOC44.2~WZA8EBOKQ36I.1 size=1048576 2024-09-14T10:51:31.200 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.202+0000 7f19187cc780 1 < completed part key=_multipart_E6UO1LUWOC44.2~WZA8EBOKQ36I.2 size=59656 2024-09-14T10:51:31.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.204+0000 7f19187cc780 1 < completed multipart upload key=E6UO1LUWOC44 upload=WZA8EBOKQ36I tag=AWVQBW5V8UXZ type=write size=3205384 2024-09-14T10:51:31.204 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.206+0000 7f19187cc780 1 > prepared operation key=IKVYA4KEALFF tag=6WY03JPB6WQW type=del size=3999292 2024-09-14T10:51:31.205 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.207+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~AJT2CO3VZYI1.0 size=1048576 2024-09-14T10:51:31.206 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.208+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~AJT2CO3VZYI1.1 size=1048576 2024-09-14T10:51:31.207 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.209+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~AJT2CO3VZYI1.2 size=682550 2024-09-14T10:51:31.210 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.212+0000 7f19187cc780 1 < completed multipart upload key=B9FQYIX19AEP upload=AJT2CO3VZYI1 tag=RGNA6PFC96MQ type=write size=3828278 2024-09-14T10:51:31.211 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.213+0000 7f19187cc780 1 > prepared operation key=QFEI6H4EQ9ZR tag=REK2XDHXYIT6 type=del size=3306533 2024-09-14T10:51:31.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.214+0000 7f19187cc780 1 < completed delete operation key=IKVYA4KEALFF tag=NL154UBNH8EY type=del 2024-09-14T10:51:31.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.217+0000 7f19187cc780 1 > prepared part key=_multipart_RTGE7ISETJWW.2~E0RSCD5XQGT9.0 size=156759 2024-09-14T10:51:31.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.217+0000 7f19187cc780 1 > prepared multipart upload key=RTGE7ISETJWW upload=E0RSCD5XQGT9 tag=QEJ2DLRMEPZM type=write size=1205335 2024-09-14T10:51:31.217 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.218+0000 7f19187cc780 1 < completed delete operation key=6BNN842ZTWG5 tag=6I7SK0BEC9ZM type=del 2024-09-14T10:51:31.218 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.220+0000 7f19187cc780 1 > prepared operation key=MFA30GSMCSKP tag=5YD3WV4QQH5S type=del size=871473 2024-09-14T10:51:31.219 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.221+0000 7f19187cc780 1 < completed part key=_multipart_KOJ7QB7M6A35.2~2DOAUFX1XJPV.0 size=312740 2024-09-14T10:51:31.222 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.223+0000 7f19187cc780 1 < completed multipart upload key=KOJ7QB7M6A35 upload=2DOAUFX1XJPV tag=5MKIQZ4XTFF2 type=write size=1361316 2024-09-14T10:51:31.223 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.225+0000 7f19187cc780 1 > prepared operation key=617QQI921HB4 tag=I665IBTYJ0J9 type=del size=307179 2024-09-14T10:51:31.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.226+0000 7f19187cc780 1 < completed delete operation key=YA3DI7N4DG5K tag=BB82W7IH7XWP type=del 2024-09-14T10:51:31.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.228+0000 7f19187cc780 1 > prepared operation key=E6UO1LUWOC44 tag=A04RDR0NRVHJ type=del size=2015200 2024-09-14T10:51:31.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.229+0000 7f19187cc780 1 < completed delete operation key=7IWUW2HC3ULI tag=MFPFPG52LRTB type=del 2024-09-14T10:51:31.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.231+0000 7f19187cc780 1 > prepared operation key=W1K1IU13J0CZ tag=6H4WR614JNQZ type=del size=1552973 2024-09-14T10:51:31.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.232+0000 7f19187cc780 1 < completed delete operation key=YA3DI7N4DG5K tag=W7G6D6SRBWRN type=del 2024-09-14T10:51:31.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.234+0000 7f19187cc780 1 > prepared operation key=EL00Y4Z7DTAT tag=MU8F7ZMDMRZF type=del size=1829430 2024-09-14T10:51:31.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.235+0000 7f19187cc780 1 < completed delete operation key=MFA30GSMCSKP tag=ZRWRO326CBQX type=del 2024-09-14T10:51:31.236 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.238+0000 7f19187cc780 1 > prepared part key=_multipart_617QQI921HB4.2~Y4UOHN670872.0 size=81699 2024-09-14T10:51:31.236 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.238+0000 7f19187cc780 1 > prepared multipart upload key=617QQI921HB4 upload=Y4UOHN670872 tag=605WW5W3SI3D type=write size=1130275 2024-09-14T10:51:31.238 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.239+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~LKE6XEAH004J.0 size=747789 2024-09-14T10:51:31.240 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.242+0000 7f19187cc780 1 < completed multipart upload key=IKVYA4KEALFF upload=LKE6XEAH004J tag=QNW265FJWBWG type=write size=1796365 2024-09-14T10:51:31.242 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.244+0000 7f19187cc780 1 > prepared part key=_multipart_H40763V7HMBC.2~8P7IEE8T07AO.0 size=1048576 2024-09-14T10:51:31.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.245+0000 7f19187cc780 1 > prepared part key=_multipart_H40763V7HMBC.2~8P7IEE8T07AO.1 size=797648 2024-09-14T10:51:31.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.245+0000 7f19187cc780 1 > prepared multipart upload key=H40763V7HMBC upload=8P7IEE8T07AO tag=90BYT6QMU8Z9 type=write size=2894800 2024-09-14T10:51:31.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.246+0000 7f19187cc780 1 < canceled part key=_multipart_19P3WE6HKJH2.2~QT9RBF6CSJW4.0 size=1048576 2024-09-14T10:51:31.245 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.247+0000 7f19187cc780 1 < completed part key=_multipart_19P3WE6HKJH2.2~QT9RBF6CSJW4.1 size=1031819 2024-09-14T10:51:31.247 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.249+0000 7f19187cc780 1 < canceled multipart upload key=19P3WE6HKJH2 upload=QT9RBF6CSJW4 tag=KNY28RUAKT23 type=write size=3128971 2024-09-14T10:51:31.250 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.251+0000 7f19187cc780 1 > prepared part key=_multipart_AST81B9QWORT.2~3DKQ7N4KLWRF.0 size=1048576 2024-09-14T10:51:31.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.253+0000 7f19187cc780 1 > prepared part key=_multipart_AST81B9QWORT.2~3DKQ7N4KLWRF.1 size=1048576 2024-09-14T10:51:31.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.254+0000 7f19187cc780 1 > prepared part key=_multipart_AST81B9QWORT.2~3DKQ7N4KLWRF.2 size=448279 2024-09-14T10:51:31.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.254+0000 7f19187cc780 1 > prepared multipart upload key=AST81B9QWORT upload=3DKQ7N4KLWRF tag=U1TK171Q0G36 type=write size=3594007 2024-09-14T10:51:31.254 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.255+0000 7f19187cc780 1 < completed part key=_multipart_EL00Y4Z7DTAT.2~030M92HVR6DB.0 size=527932 2024-09-14T10:51:31.256 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.258+0000 7f19187cc780 1 < completed multipart upload key=EL00Y4Z7DTAT upload=030M92HVR6DB tag=BP3L700C5VV8 type=write size=1576508 2024-09-14T10:51:31.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.259+0000 7f19187cc780 1 > prepared operation key=QBMNYNWOLK4I tag=5X2QV9B2WAOY type=del size=2379142 2024-09-14T10:51:31.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.261+0000 7f19187cc780 1 < completed part key=_multipart_5AIAYJMRZGFQ.2~OZG8UYKOJVHK.0 size=77003 2024-09-14T10:51:31.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.263+0000 7f19187cc780 1 < completed multipart upload key=5AIAYJMRZGFQ upload=OZG8UYKOJVHK tag=Q7H9HGUW73UK type=write size=1125579 2024-09-14T10:51:31.264 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.266+0000 7f19187cc780 1 > prepared part key=_multipart_H40763V7HMBC.2~QIKPIB5DUQQ9.0 size=811086 2024-09-14T10:51:31.264 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.266+0000 7f19187cc780 1 > prepared multipart upload key=H40763V7HMBC upload=QIKPIB5DUQQ9 tag=X90FBLO9FEEO type=write size=1859662 2024-09-14T10:51:31.266 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.267+0000 7f19187cc780 1 < completed part key=_multipart_61O2VU0SB379.2~RKV7PHHT2XD9.0 size=1048576 2024-09-14T10:51:31.267 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.268+0000 7f19187cc780 1 < completed part key=_multipart_61O2VU0SB379.2~RKV7PHHT2XD9.1 size=40243 2024-09-14T10:51:31.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.271+0000 7f19187cc780 1 < completed multipart upload key=61O2VU0SB379 upload=RKV7PHHT2XD9 tag=A7BQR2TBWEFA type=write size=2137395 2024-09-14T10:51:31.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.272+0000 7f19187cc780 1 > prepared operation key=IKVYA4KEALFF tag=QT48MKH3P9T9 type=del size=74884 2024-09-14T10:51:31.272 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.274+0000 7f19187cc780 1 < completed delete operation key=M73CER01XHDY tag=S17PFWYYJ20M type=del 2024-09-14T10:51:31.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.276+0000 7f19187cc780 1 > prepared part key=_multipart_CADC2BY888V1.2~PMAP91330KXF.0 size=1048576 2024-09-14T10:51:31.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.278+0000 7f19187cc780 1 > prepared part key=_multipart_CADC2BY888V1.2~PMAP91330KXF.1 size=713219 2024-09-14T10:51:31.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.278+0000 7f19187cc780 1 > prepared multipart upload key=CADC2BY888V1 upload=PMAP91330KXF tag=DEQVNTZHFPUI type=write size=2810371 2024-09-14T10:51:31.278 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.279+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~2JQLXT70KBPF.0 size=1048576 2024-09-14T10:51:31.279 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.280+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~2JQLXT70KBPF.1 size=1048576 2024-09-14T10:51:31.281 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.283+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~2JQLXT70KBPF.2 size=253937 2024-09-14T10:51:31.284 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.286+0000 7f19187cc780 1 < completed multipart upload key=7IWUW2HC3ULI upload=2JQLXT70KBPF tag=GTIJXG1A1ZIA type=write size=3399665 2024-09-14T10:51:31.286 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.288+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~18NBYTW936UJ.0 size=1048576 2024-09-14T10:51:31.288 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.289+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~18NBYTW936UJ.1 size=447052 2024-09-14T10:51:31.288 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.289+0000 7f19187cc780 1 > prepared multipart upload key=XCVE2F2JJK4X upload=18NBYTW936UJ tag=XMC38I23PO4N type=write size=2544204 2024-09-14T10:51:31.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.291+0000 7f19187cc780 1 < completed delete operation key=IKVYA4KEALFF tag=6WY03JPB6WQW type=del 2024-09-14T10:51:31.291 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.292+0000 7f19187cc780 1 > prepared operation key=5AIAYJMRZGFQ tag=KO5ADEEW27SY type=write size=310030 2024-09-14T10:51:31.292 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.294+0000 7f19187cc780 1 < completed delete operation key=QFEI6H4EQ9ZR tag=REK2XDHXYIT6 type=del 2024-09-14T10:51:31.294 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.296+0000 7f19187cc780 1 > prepared operation key=E6UO1LUWOC44 tag=NUNBZFRGXVBN type=write size=222740 2024-09-14T10:51:31.295 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.297+0000 7f19187cc780 1 < completed part key=_multipart_RTGE7ISETJWW.2~E0RSCD5XQGT9.0 size=156759 2024-09-14T10:51:31.298 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.299+0000 7f19187cc780 1 < completed multipart upload key=RTGE7ISETJWW upload=E0RSCD5XQGT9 tag=QEJ2DLRMEPZM type=write size=1205335 2024-09-14T10:51:31.299 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.301+0000 7f19187cc780 1 > prepared operation key=61O2VU0SB379 tag=1EWYVCC7LJPH type=del size=504727 2024-09-14T10:51:31.301 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.302+0000 7f19187cc780 1 < completed delete operation key=MFA30GSMCSKP tag=5YD3WV4QQH5S type=del 2024-09-14T10:51:31.302 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.304+0000 7f19187cc780 1 > prepared operation key=AGNUE76X8XCJ tag=Y34G7Q27V4SG type=del size=69206 2024-09-14T10:51:31.304 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.305+0000 7f19187cc780 1 < completed delete operation key=617QQI921HB4 tag=I665IBTYJ0J9 type=del 2024-09-14T10:51:31.306 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.308+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~O0528TDI2P3U.0 size=1048576 2024-09-14T10:51:31.307 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.309+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~O0528TDI2P3U.1 size=689810 2024-09-14T10:51:31.308 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.309+0000 7f19187cc780 1 > prepared multipart upload key=IKVYA4KEALFF upload=O0528TDI2P3U tag=P6XEYZY3D08T type=write size=2786962 2024-09-14T10:51:31.309 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.310+0000 7f19187cc780 1 < completed delete operation key=E6UO1LUWOC44 tag=A04RDR0NRVHJ type=del 2024-09-14T10:51:31.310 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.312+0000 7f19187cc780 1 > prepared operation key=QFEI6H4EQ9ZR tag=6PPNZ1MGOLKH type=del size=773978 2024-09-14T10:51:31.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.313+0000 7f19187cc780 1 < completed delete operation key=W1K1IU13J0CZ tag=6H4WR614JNQZ type=del 2024-09-14T10:51:31.314 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.316+0000 7f19187cc780 1 > prepared part key=_multipart_YA3DI7N4DG5K.2~X6YE7SLHU9PQ.0 size=520155 2024-09-14T10:51:31.315 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.316+0000 7f19187cc780 1 > prepared multipart upload key=YA3DI7N4DG5K upload=X6YE7SLHU9PQ tag=TEIKLXWPXMFH type=write size=1568731 2024-09-14T10:51:31.316 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.318+0000 7f19187cc780 1 < completed delete operation key=EL00Y4Z7DTAT tag=MU8F7ZMDMRZF type=del 2024-09-14T10:51:31.321 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.320+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~37S6007D3CXT.0 size=902936 2024-09-14T10:51:31.321 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.320+0000 7f19187cc780 1 > prepared multipart upload key=6BNN842ZTWG5 upload=37S6007D3CXT tag=FKWYE0DTF0P9 type=write size=1951512 2024-09-14T10:51:31.321 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.322+0000 7f19187cc780 1 < completed part key=_multipart_617QQI921HB4.2~Y4UOHN670872.0 size=81699 2024-09-14T10:51:31.323 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.325+0000 7f19187cc780 1 < completed multipart upload key=617QQI921HB4 upload=Y4UOHN670872 tag=605WW5W3SI3D type=write size=1130275 2024-09-14T10:51:31.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.326+0000 7f19187cc780 1 > prepared operation key=CADC2BY888V1 tag=MGXZ7BLW6N5H type=del size=507408 2024-09-14T10:51:31.326 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.327+0000 7f19187cc780 1 < completed part key=_multipart_H40763V7HMBC.2~8P7IEE8T07AO.0 size=1048576 2024-09-14T10:51:31.326 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.327+0000 7f19187cc780 1 < canceled part key=_multipart_H40763V7HMBC.2~8P7IEE8T07AO.1 size=797648 2024-09-14T10:51:31.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.330+0000 7f19187cc780 1 < canceled multipart upload key=H40763V7HMBC upload=8P7IEE8T07AO tag=90BYT6QMU8Z9 type=write size=2894800 2024-09-14T10:51:31.331 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.332+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~A2E2EY7249TH.0 size=204063 2024-09-14T10:51:31.331 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.332+0000 7f19187cc780 1 > prepared multipart upload key=6BNN842ZTWG5 upload=A2E2EY7249TH tag=82AU0ENGF0CB type=write size=1252639 2024-09-14T10:51:31.332 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.334+0000 7f19187cc780 1 < completed part key=_multipart_AST81B9QWORT.2~3DKQ7N4KLWRF.0 size=1048576 2024-09-14T10:51:31.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.336+0000 7f19187cc780 1 < completed part key=_multipart_AST81B9QWORT.2~3DKQ7N4KLWRF.1 size=1048576 2024-09-14T10:51:31.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.337+0000 7f19187cc780 1 < completed part key=_multipart_AST81B9QWORT.2~3DKQ7N4KLWRF.2 size=448279 2024-09-14T10:51:31.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.339+0000 7f19187cc780 1 < completed multipart upload key=AST81B9QWORT upload=3DKQ7N4KLWRF tag=U1TK171Q0G36 type=write size=3594007 2024-09-14T10:51:31.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.342+0000 7f19187cc780 1 > prepared part key=_multipart_MFA30GSMCSKP.2~0OD3GQUJFCQG.0 size=1048576 2024-09-14T10:51:31.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.343+0000 7f19187cc780 1 > prepared part key=_multipart_MFA30GSMCSKP.2~0OD3GQUJFCQG.1 size=1048576 2024-09-14T10:51:31.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.344+0000 7f19187cc780 1 > prepared part key=_multipart_MFA30GSMCSKP.2~0OD3GQUJFCQG.2 size=964992 2024-09-14T10:51:31.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.344+0000 7f19187cc780 1 > prepared multipart upload key=MFA30GSMCSKP upload=0OD3GQUJFCQG tag=40YQOM13LEO1 type=write size=4110720 2024-09-14T10:51:31.344 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.345+0000 7f19187cc780 1 < completed delete operation key=QBMNYNWOLK4I tag=5X2QV9B2WAOY type=del 2024-09-14T10:51:31.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.347+0000 7f19187cc780 1 > prepared operation key=54BSD3DEHNK6 tag=1J27V66CQTJ7 type=del size=734754 2024-09-14T10:51:31.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.348+0000 7f19187cc780 1 < completed part key=_multipart_H40763V7HMBC.2~QIKPIB5DUQQ9.0 size=811086 2024-09-14T10:51:31.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.351+0000 7f19187cc780 1 < completed multipart upload key=H40763V7HMBC upload=QIKPIB5DUQQ9 tag=X90FBLO9FEEO type=write size=1859662 2024-09-14T10:51:31.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.352+0000 7f19187cc780 1 > prepared operation key=9EBD5ZT6MT45 tag=S8D2WEOOQWFA type=del size=3420364 2024-09-14T10:51:31.352 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.353+0000 7f19187cc780 1 < completed delete operation key=IKVYA4KEALFF tag=QT48MKH3P9T9 type=del 2024-09-14T10:51:31.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.355+0000 7f19187cc780 1 > prepared operation key=7IWUW2HC3ULI tag=VI3JREM0JP5W type=del size=1617508 2024-09-14T10:51:31.355 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.356+0000 7f19187cc780 1 < completed part key=_multipart_CADC2BY888V1.2~PMAP91330KXF.0 size=1048576 2024-09-14T10:51:31.356 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.358+0000 7f19187cc780 1 < completed part key=_multipart_CADC2BY888V1.2~PMAP91330KXF.1 size=713219 2024-09-14T10:51:31.358 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.360+0000 7f19187cc780 1 < completed multipart upload key=CADC2BY888V1 upload=PMAP91330KXF tag=DEQVNTZHFPUI type=write size=2810371 2024-09-14T10:51:31.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.362+0000 7f19187cc780 1 > prepared operation key=AGNUE76X8XCJ tag=LXZ3UTR6PU89 type=del size=3848993 2024-09-14T10:51:31.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.363+0000 7f19187cc780 1 < completed part key=_multipart_XCVE2F2JJK4X.2~18NBYTW936UJ.0 size=1048576 2024-09-14T10:51:31.363 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.364+0000 7f19187cc780 1 < completed part key=_multipart_XCVE2F2JJK4X.2~18NBYTW936UJ.1 size=447052 2024-09-14T10:51:31.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.367+0000 7f19187cc780 1 < completed multipart upload key=XCVE2F2JJK4X upload=18NBYTW936UJ tag=XMC38I23PO4N type=write size=2544204 2024-09-14T10:51:31.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.368+0000 7f19187cc780 1 > prepared operation key=75O00VMLJJ1X tag=4TMFNN3F7JL1 type=del size=2764000 2024-09-14T10:51:31.368 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.370+0000 7f19187cc780 1 < completed write operation key=5AIAYJMRZGFQ tag=KO5ADEEW27SY type=write size=310030 2024-09-14T10:51:31.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.371+0000 7f19187cc780 1 > prepared operation key=KOJ7QB7M6A35 tag=HTF9PA7SX85H type=del size=3395733 2024-09-14T10:51:31.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.372+0000 7f19187cc780 1 < completed write operation key=E6UO1LUWOC44 tag=NUNBZFRGXVBN type=write size=222740 2024-09-14T10:51:31.372 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.374+0000 7f19187cc780 1 > prepared operation key=AST81B9QWORT tag=N53UQLDC3R0T type=write size=708700 2024-09-14T10:51:31.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.377+0000 7f19187cc780 1 < suggested remove operation key=61O2VU0SB379 tag=1EWYVCC7LJPH type=del 2024-09-14T10:51:31.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.378+0000 7f19187cc780 1 > prepared operation key=VW6U36JN2DBX tag=Q4EUYL15ES3Y type=del size=843688 2024-09-14T10:51:31.379 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.381+0000 7f19187cc780 1 < suggested update operation key=AGNUE76X8XCJ tag=Y34G7Q27V4SG type=del size=69206 2024-09-14T10:51:31.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.382+0000 7f19187cc780 1 > prepared operation key=6BNN842ZTWG5 tag=90RXQ7QTCXNU type=del size=3835248 2024-09-14T10:51:31.382 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.384+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~O0528TDI2P3U.0 size=1048576 2024-09-14T10:51:31.382 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.384+0000 7f19187cc780 1 < canceled part key=_multipart_IKVYA4KEALFF.2~O0528TDI2P3U.1 size=689810 2024-09-14T10:51:31.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.386+0000 7f19187cc780 1 < canceled multipart upload key=IKVYA4KEALFF upload=O0528TDI2P3U tag=P6XEYZY3D08T type=write size=2786962 2024-09-14T10:51:31.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.387+0000 7f19187cc780 1 > prepared operation key=54BSD3DEHNK6 tag=05FMC21GWG0H type=del size=2013528 2024-09-14T10:51:31.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.389+0000 7f19187cc780 1 < completed delete operation key=QFEI6H4EQ9ZR tag=6PPNZ1MGOLKH type=del 2024-09-14T10:51:31.390 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.391+0000 7f19187cc780 1 > prepared part key=_multipart_INJQTKXHBUV2.2~EGLM3IJEZ8W3.0 size=775235 2024-09-14T10:51:31.390 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.391+0000 7f19187cc780 1 > prepared multipart upload key=INJQTKXHBUV2 upload=EGLM3IJEZ8W3 tag=64TE97NRCC1X type=write size=1823811 2024-09-14T10:51:31.391 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.393+0000 7f19187cc780 1 < completed part key=_multipart_YA3DI7N4DG5K.2~X6YE7SLHU9PQ.0 size=520155 2024-09-14T10:51:31.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.395+0000 7f19187cc780 1 < completed multipart upload key=YA3DI7N4DG5K upload=X6YE7SLHU9PQ tag=TEIKLXWPXMFH type=write size=1568731 2024-09-14T10:51:31.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.397+0000 7f19187cc780 1 > prepared operation key=9EBD5ZT6MT45 tag=5U5YHFFENCPG type=del size=831741 2024-09-14T10:51:31.397 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.398+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~37S6007D3CXT.0 size=902936 2024-09-14T10:51:31.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.400+0000 7f19187cc780 1 < completed multipart upload key=6BNN842ZTWG5 upload=37S6007D3CXT tag=FKWYE0DTF0P9 type=write size=1951512 2024-09-14T10:51:31.400 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.402+0000 7f19187cc780 1 > prepared operation key=M73CER01XHDY tag=YHC6BTV1N4RH type=del size=788170 2024-09-14T10:51:31.403 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.404+0000 7f19187cc780 1 < suggested update operation key=CADC2BY888V1 tag=MGXZ7BLW6N5H type=del size=507408 2024-09-14T10:51:31.404 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.406+0000 7f19187cc780 1 > prepared operation key=W1K1IU13J0CZ tag=0RD5N8XM50FK type=del size=194821 2024-09-14T10:51:31.406 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.407+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~A2E2EY7249TH.0 size=204063 2024-09-14T10:51:31.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.410+0000 7f19187cc780 1 < completed multipart upload key=6BNN842ZTWG5 upload=A2E2EY7249TH tag=82AU0ENGF0CB type=write size=1252639 2024-09-14T10:51:31.410 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.411+0000 7f19187cc780 1 > prepared operation key=OVOPGTYUF3F3 tag=QSM1CBLIV2M7 type=write size=717838 2024-09-14T10:51:31.411 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.413+0000 7f19187cc780 1 < completed part key=_multipart_MFA30GSMCSKP.2~0OD3GQUJFCQG.0 size=1048576 2024-09-14T10:51:31.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.414+0000 7f19187cc780 1 < completed part key=_multipart_MFA30GSMCSKP.2~0OD3GQUJFCQG.1 size=1048576 2024-09-14T10:51:31.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.415+0000 7f19187cc780 1 < completed part key=_multipart_MFA30GSMCSKP.2~0OD3GQUJFCQG.2 size=964992 2024-09-14T10:51:31.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.417+0000 7f19187cc780 1 < completed multipart upload key=MFA30GSMCSKP upload=0OD3GQUJFCQG tag=40YQOM13LEO1 type=write size=4110720 2024-09-14T10:51:31.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.419+0000 7f19187cc780 1 > prepared operation key=6BNN842ZTWG5 tag=NOVIQSN93GQI type=del size=3550436 2024-09-14T10:51:31.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.422+0000 7f19187cc780 1 < suggested update operation key=54BSD3DEHNK6 tag=1J27V66CQTJ7 type=del size=734754 2024-09-14T10:51:31.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.424+0000 7f19187cc780 1 > prepared part key=_multipart_INJQTKXHBUV2.2~KAK4ACLISTO1.0 size=1048576 2024-09-14T10:51:31.423 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.425+0000 7f19187cc780 1 > prepared part key=_multipart_INJQTKXHBUV2.2~KAK4ACLISTO1.1 size=1048576 2024-09-14T10:51:31.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.426+0000 7f19187cc780 1 > prepared part key=_multipart_INJQTKXHBUV2.2~KAK4ACLISTO1.2 size=473656 2024-09-14T10:51:31.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.426+0000 7f19187cc780 1 > prepared multipart upload key=INJQTKXHBUV2 upload=KAK4ACLISTO1 tag=QGOL6ICCE90I type=write size=3619384 2024-09-14T10:51:31.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.427+0000 7f19187cc780 1 < completed delete operation key=9EBD5ZT6MT45 tag=S8D2WEOOQWFA type=del 2024-09-14T10:51:31.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.429+0000 7f19187cc780 1 > prepared operation key=54BSD3DEHNK6 tag=BZ6Q4WJFQKA8 type=del size=2759276 2024-09-14T10:51:31.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.432+0000 7f19187cc780 1 < suggested update operation key=7IWUW2HC3ULI tag=VI3JREM0JP5W type=del size=1617508 2024-09-14T10:51:31.433 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.434+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~SREE48C4TD5J.0 size=560537 2024-09-14T10:51:31.433 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.434+0000 7f19187cc780 1 > prepared multipart upload key=OVOPGTYUF3F3 upload=SREE48C4TD5J tag=AWUYHTA6URCB type=write size=1609113 2024-09-14T10:51:31.436 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.438+0000 7f19187cc780 1 < suggested remove operation key=AGNUE76X8XCJ tag=LXZ3UTR6PU89 type=del 2024-09-14T10:51:31.438 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.439+0000 7f19187cc780 1 > prepared operation key=CADC2BY888V1 tag=GLKE3M2V9EYC type=del size=115059 2024-09-14T10:51:31.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.442+0000 7f19187cc780 1 < suggested update operation key=75O00VMLJJ1X tag=4TMFNN3F7JL1 type=del size=2764000 2024-09-14T10:51:31.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.444+0000 7f19187cc780 1 > prepared operation key=75O00VMLJJ1X tag=PL39TKSZAUHF type=del size=3266814 2024-09-14T10:51:31.444 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.445+0000 7f19187cc780 1 < completed delete operation key=KOJ7QB7M6A35 tag=HTF9PA7SX85H type=del 2024-09-14T10:51:31.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.448+0000 7f19187cc780 1 > prepared part key=_multipart_MFA30GSMCSKP.2~NU6KJHMY78S7.0 size=1048576 2024-09-14T10:51:31.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.449+0000 7f19187cc780 1 > prepared part key=_multipart_MFA30GSMCSKP.2~NU6KJHMY78S7.1 size=1048576 2024-09-14T10:51:31.448 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.450+0000 7f19187cc780 1 > prepared part key=_multipart_MFA30GSMCSKP.2~NU6KJHMY78S7.2 size=356411 2024-09-14T10:51:31.448 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.450+0000 7f19187cc780 1 > prepared multipart upload key=MFA30GSMCSKP upload=NU6KJHMY78S7 tag=2UDAQV2V2V9B type=write size=3502139 2024-09-14T10:51:31.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.451+0000 7f19187cc780 1 < canceled operation key=AST81B9QWORT tag=N53UQLDC3R0T type=write size=708700 2024-09-14T10:51:31.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.453+0000 7f19187cc780 1 > prepared operation key=6BNN842ZTWG5 tag=9RKU8YXHAYHU type=del size=3686511 2024-09-14T10:51:31.453 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.454+0000 7f19187cc780 1 < completed delete operation key=VW6U36JN2DBX tag=Q4EUYL15ES3Y type=del 2024-09-14T10:51:31.455 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.457+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~Z65QWBTM8HOY.0 size=1048576 2024-09-14T10:51:31.456 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.458+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~Z65QWBTM8HOY.1 size=1048576 2024-09-14T10:51:31.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.459+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~Z65QWBTM8HOY.2 size=331236 2024-09-14T10:51:31.458 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.459+0000 7f19187cc780 1 > prepared multipart upload key=6BNN842ZTWG5 upload=Z65QWBTM8HOY tag=C4F32UZ8IYLC type=write size=3476964 2024-09-14T10:51:31.459 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.461+0000 7f19187cc780 1 < completed delete operation key=6BNN842ZTWG5 tag=90RXQ7QTCXNU type=del 2024-09-14T10:51:31.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.463+0000 7f19187cc780 1 > prepared part key=_multipart_W1K1IU13J0CZ.2~MNWMP7S41U9S.0 size=1048576 2024-09-14T10:51:31.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.465+0000 7f19187cc780 1 > prepared part key=_multipart_W1K1IU13J0CZ.2~MNWMP7S41U9S.1 size=1048576 2024-09-14T10:51:31.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.466+0000 7f19187cc780 1 > prepared part key=_multipart_W1K1IU13J0CZ.2~MNWMP7S41U9S.2 size=75462 2024-09-14T10:51:31.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.466+0000 7f19187cc780 1 > prepared multipart upload key=W1K1IU13J0CZ upload=MNWMP7S41U9S tag=Z5D7VA48697G type=write size=3221190 2024-09-14T10:51:31.466 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.467+0000 7f19187cc780 -1 < failed to complete operation key=54BSD3DEHNK6 tag=05FMC21GWG0H type=del size=2013528: (22) Invalid argument 2024-09-14T10:51:31.468 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.470+0000 7f19187cc780 1 > prepared operation key=7IWUW2HC3ULI tag=ND5Z9SRGPGTL type=del size=488883 2024-09-14T10:51:31.470 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.471+0000 7f19187cc780 1 < completed part key=_multipart_INJQTKXHBUV2.2~EGLM3IJEZ8W3.0 size=775235 2024-09-14T10:51:31.472 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.474+0000 7f19187cc780 1 < completed multipart upload key=INJQTKXHBUV2 upload=EGLM3IJEZ8W3 tag=64TE97NRCC1X type=write size=1823811 2024-09-14T10:51:31.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.475+0000 7f19187cc780 1 > prepared operation key=61O2VU0SB379 tag=Q106017GRDAF type=del size=2298828 2024-09-14T10:51:31.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.477+0000 7f19187cc780 1 < completed delete operation key=9EBD5ZT6MT45 tag=5U5YHFFENCPG type=del 2024-09-14T10:51:31.476 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.478+0000 7f19187cc780 1 > prepared operation key=61O2VU0SB379 tag=9VSTA2219W0S type=write size=203308 2024-09-14T10:51:31.478 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.479+0000 7f19187cc780 1 < canceled operation key=M73CER01XHDY tag=YHC6BTV1N4RH type=del size=788170 2024-09-14T10:51:31.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.481+0000 7f19187cc780 1 > prepared operation key=IKVYA4KEALFF tag=KTMVEVLNQMT8 type=del size=4155342 2024-09-14T10:51:31.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.483+0000 7f19187cc780 1 < completed delete operation key=W1K1IU13J0CZ tag=0RD5N8XM50FK type=del 2024-09-14T10:51:31.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.485+0000 7f19187cc780 1 > prepared part key=_multipart_INJQTKXHBUV2.2~0VUYDERFC4B1.0 size=34267 2024-09-14T10:51:31.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.485+0000 7f19187cc780 1 > prepared multipart upload key=INJQTKXHBUV2 upload=0VUYDERFC4B1 tag=6GT69NL2DEHS type=write size=1082843 2024-09-14T10:51:31.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.487+0000 7f19187cc780 1 < completed write operation key=OVOPGTYUF3F3 tag=QSM1CBLIV2M7 type=write size=717838 2024-09-14T10:51:31.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.488+0000 7f19187cc780 1 > prepared operation key=75O00VMLJJ1X tag=XQDNRT3FGV64 type=del size=165431 2024-09-14T10:51:31.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.490+0000 7f19187cc780 1 < completed delete operation key=6BNN842ZTWG5 tag=NOVIQSN93GQI type=del 2024-09-14T10:51:31.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.491+0000 7f19187cc780 1 > prepared operation key=EL00Y4Z7DTAT tag=4AR9086L8EDN type=del size=64136 2024-09-14T10:51:31.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.492+0000 7f19187cc780 1 < completed part key=_multipart_INJQTKXHBUV2.2~KAK4ACLISTO1.0 size=1048576 2024-09-14T10:51:31.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.494+0000 7f19187cc780 1 < completed part key=_multipart_INJQTKXHBUV2.2~KAK4ACLISTO1.1 size=1048576 2024-09-14T10:51:31.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.494+0000 7f19187cc780 1 < canceled part key=_multipart_INJQTKXHBUV2.2~KAK4ACLISTO1.2 size=473656 2024-09-14T10:51:31.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.496+0000 7f19187cc780 1 < canceled multipart upload key=INJQTKXHBUV2 upload=KAK4ACLISTO1 tag=QGOL6ICCE90I type=write size=3619384 2024-09-14T10:51:31.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.497+0000 7f19187cc780 1 > prepared operation key=AST81B9QWORT tag=U12LT3E3AIQ6 type=del size=3443917 2024-09-14T10:51:31.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.501+0000 7f19187cc780 1 < suggested update operation key=54BSD3DEHNK6 tag=BZ6Q4WJFQKA8 type=del size=2759276 2024-09-14T10:51:31.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.502+0000 7f19187cc780 1 > prepared operation key=B9FQYIX19AEP tag=RINGCES7O4DR type=del size=2577054 2024-09-14T10:51:31.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.503+0000 7f19187cc780 1 < completed part key=_multipart_OVOPGTYUF3F3.2~SREE48C4TD5J.0 size=560537 2024-09-14T10:51:31.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.506+0000 7f19187cc780 1 < completed multipart upload key=OVOPGTYUF3F3 upload=SREE48C4TD5J tag=AWUYHTA6URCB type=write size=1609113 2024-09-14T10:51:31.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.509+0000 7f19187cc780 1 > prepared part key=_multipart_AST81B9QWORT.2~L6JMPKL5ZSUZ.0 size=1048576 2024-09-14T10:51:31.508 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.510+0000 7f19187cc780 1 > prepared part key=_multipart_AST81B9QWORT.2~L6JMPKL5ZSUZ.1 size=1048576 2024-09-14T10:51:31.509 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.511+0000 7f19187cc780 1 > prepared part key=_multipart_AST81B9QWORT.2~L6JMPKL5ZSUZ.2 size=615474 2024-09-14T10:51:31.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.511+0000 7f19187cc780 1 > prepared multipart upload key=AST81B9QWORT upload=L6JMPKL5ZSUZ tag=WMW46SM0QN2A type=write size=3761202 2024-09-14T10:51:31.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.513+0000 7f19187cc780 1 < canceled operation key=CADC2BY888V1 tag=GLKE3M2V9EYC type=del size=115059 2024-09-14T10:51:31.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.515+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~C4D796KRR1ES.0 size=1048576 2024-09-14T10:51:31.515 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.517+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~C4D796KRR1ES.1 size=1048576 2024-09-14T10:51:31.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.518+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~C4D796KRR1ES.2 size=199596 2024-09-14T10:51:31.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.518+0000 7f19187cc780 1 > prepared multipart upload key=B9FQYIX19AEP upload=C4D796KRR1ES tag=8KTGZTJH4PIH type=write size=3345324 2024-09-14T10:51:31.518 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.519+0000 7f19187cc780 1 < completed delete operation key=75O00VMLJJ1X tag=PL39TKSZAUHF type=del 2024-09-14T10:51:31.519 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.521+0000 7f19187cc780 1 > prepared operation key=54BSD3DEHNK6 tag=SOQR46W9QSWX type=del size=3128989 2024-09-14T10:51:31.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.522+0000 7f19187cc780 1 < completed part key=_multipart_MFA30GSMCSKP.2~NU6KJHMY78S7.0 size=1048576 2024-09-14T10:51:31.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.524+0000 7f19187cc780 1 < completed part key=_multipart_MFA30GSMCSKP.2~NU6KJHMY78S7.1 size=1048576 2024-09-14T10:51:31.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.525+0000 7f19187cc780 1 < completed part key=_multipart_MFA30GSMCSKP.2~NU6KJHMY78S7.2 size=356411 2024-09-14T10:51:31.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.527+0000 7f19187cc780 1 < completed multipart upload key=MFA30GSMCSKP upload=NU6KJHMY78S7 tag=2UDAQV2V2V9B type=write size=3502139 2024-09-14T10:51:31.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.529+0000 7f19187cc780 1 > prepared operation key=B9FQYIX19AEP tag=A6NRVI4YBITM type=del size=3914333 2024-09-14T10:51:31.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.530+0000 7f19187cc780 1 < completed delete operation key=6BNN842ZTWG5 tag=9RKU8YXHAYHU type=del 2024-09-14T10:51:31.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.532+0000 7f19187cc780 1 > prepared operation key=RTGE7ISETJWW tag=9JD53GKMTQIV type=write size=672073 2024-09-14T10:51:31.532 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.533+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~Z65QWBTM8HOY.0 size=1048576 2024-09-14T10:51:31.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.534+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~Z65QWBTM8HOY.1 size=1048576 2024-09-14T10:51:31.534 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.536+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~Z65QWBTM8HOY.2 size=331236 2024-09-14T10:51:31.536 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.538+0000 7f19187cc780 1 < completed multipart upload key=6BNN842ZTWG5 upload=Z65QWBTM8HOY tag=C4F32UZ8IYLC type=write size=3476964 2024-09-14T10:51:31.539 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.541+0000 7f19187cc780 1 > prepared part key=_multipart_QFEI6H4EQ9ZR.2~J9KCSRVIPLFM.0 size=1048576 2024-09-14T10:51:31.540 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.542+0000 7f19187cc780 1 > prepared part key=_multipart_QFEI6H4EQ9ZR.2~J9KCSRVIPLFM.1 size=1048576 2024-09-14T10:51:31.541 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.543+0000 7f19187cc780 1 > prepared part key=_multipart_QFEI6H4EQ9ZR.2~J9KCSRVIPLFM.2 size=236613 2024-09-14T10:51:31.541 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.543+0000 7f19187cc780 1 > prepared multipart upload key=QFEI6H4EQ9ZR upload=J9KCSRVIPLFM tag=I1XF7WCI4AJ3 type=write size=3382341 2024-09-14T10:51:31.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.544+0000 7f19187cc780 1 < completed part key=_multipart_W1K1IU13J0CZ.2~MNWMP7S41U9S.0 size=1048576 2024-09-14T10:51:31.544 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.546+0000 7f19187cc780 1 < completed part key=_multipart_W1K1IU13J0CZ.2~MNWMP7S41U9S.1 size=1048576 2024-09-14T10:51:31.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.547+0000 7f19187cc780 1 < completed part key=_multipart_W1K1IU13J0CZ.2~MNWMP7S41U9S.2 size=75462 2024-09-14T10:51:31.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.549+0000 7f19187cc780 1 < completed multipart upload key=W1K1IU13J0CZ upload=MNWMP7S41U9S tag=Z5D7VA48697G type=write size=3221190 2024-09-14T10:51:31.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.552+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~3GGI1RFM2VTL.0 size=113804 2024-09-14T10:51:31.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.552+0000 7f19187cc780 1 > prepared multipart upload key=7IWUW2HC3ULI upload=3GGI1RFM2VTL tag=5S73L630MMMD type=write size=1162380 2024-09-14T10:51:31.552 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.554+0000 7f19187cc780 1 < completed delete operation key=7IWUW2HC3ULI tag=ND5Z9SRGPGTL type=del 2024-09-14T10:51:31.555 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.556+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~D0IRS9XILL2E.0 size=1048576 2024-09-14T10:51:31.556 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.558+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~D0IRS9XILL2E.1 size=682628 2024-09-14T10:51:31.556 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.558+0000 7f19187cc780 1 > prepared multipart upload key=IKVYA4KEALFF upload=D0IRS9XILL2E tag=7PA2AQPSOX1L type=write size=2779780 2024-09-14T10:51:31.559 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.560+0000 7f19187cc780 1 < suggested update operation key=61O2VU0SB379 tag=Q106017GRDAF type=del size=2298828 2024-09-14T10:51:31.560 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.562+0000 7f19187cc780 1 > prepared operation key=XCVE2F2JJK4X tag=SYM10TZKSG89 type=del size=3525066 2024-09-14T10:51:31.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.563+0000 7f19187cc780 -1 < failed to complete operation key=61O2VU0SB379 tag=9VSTA2219W0S type=write size=203308: (22) Invalid argument 2024-09-14T10:51:31.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.565+0000 7f19187cc780 1 > prepared operation key=XCVE2F2JJK4X tag=U03LMAF88G1U type=write size=513893 2024-09-14T10:51:31.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.568+0000 7f19187cc780 1 < suggested update operation key=IKVYA4KEALFF tag=KTMVEVLNQMT8 type=del size=4155342 2024-09-14T10:51:31.568 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.569+0000 7f19187cc780 1 > prepared operation key=617QQI921HB4 tag=53VIWQBXV1NB type=del size=2816682 2024-09-14T10:51:31.569 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.570+0000 7f19187cc780 1 < completed part key=_multipart_INJQTKXHBUV2.2~0VUYDERFC4B1.0 size=34267 2024-09-14T10:51:31.571 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.573+0000 7f19187cc780 1 < completed multipart upload key=INJQTKXHBUV2 upload=0VUYDERFC4B1 tag=6GT69NL2DEHS type=write size=1082843 2024-09-14T10:51:31.573 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.574+0000 7f19187cc780 1 > prepared operation key=9EBD5ZT6MT45 tag=5LCVNAGPMH2F type=del size=3351848 2024-09-14T10:51:31.574 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.576+0000 7f19187cc780 1 < completed delete operation key=75O00VMLJJ1X tag=XQDNRT3FGV64 type=del 2024-09-14T10:51:31.578 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.579+0000 7f19187cc780 1 > prepared part key=_multipart_E6UO1LUWOC44.2~2NJV9WL3DW1M.0 size=1048576 2024-09-14T10:51:31.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.580+0000 7f19187cc780 1 > prepared part key=_multipart_E6UO1LUWOC44.2~2NJV9WL3DW1M.1 size=392308 2024-09-14T10:51:31.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.580+0000 7f19187cc780 1 > prepared multipart upload key=E6UO1LUWOC44 upload=2NJV9WL3DW1M tag=9XIK8HXIS84G type=write size=2489460 2024-09-14T10:51:31.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.582+0000 7f19187cc780 1 < canceled operation key=EL00Y4Z7DTAT tag=4AR9086L8EDN type=del size=64136 2024-09-14T10:51:31.582 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.583+0000 7f19187cc780 1 > prepared operation key=W1K1IU13J0CZ tag=GGG4ZX30JEKI type=del size=1975821 2024-09-14T10:51:31.583 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.585+0000 7f19187cc780 1 < completed delete operation key=AST81B9QWORT tag=U12LT3E3AIQ6 type=del 2024-09-14T10:51:31.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.588+0000 7f19187cc780 1 > prepared operation key=61O2VU0SB379 tag=NJQ91M39P8KN type=del size=3190152 2024-09-14T10:51:31.589 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.591+0000 7f19187cc780 1 < suggested remove operation key=B9FQYIX19AEP tag=RINGCES7O4DR type=del 2024-09-14T10:51:31.591 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.592+0000 7f19187cc780 1 > prepared operation key=MFA30GSMCSKP tag=KSSCG8P0CZ7Q type=del size=2525933 2024-09-14T10:51:31.592 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.594+0000 7f19187cc780 1 < completed part key=_multipart_AST81B9QWORT.2~L6JMPKL5ZSUZ.0 size=1048576 2024-09-14T10:51:31.592 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.594+0000 7f19187cc780 1 < canceled part key=_multipart_AST81B9QWORT.2~L6JMPKL5ZSUZ.1 size=1048576 2024-09-14T10:51:31.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.595+0000 7f19187cc780 1 < completed part key=_multipart_AST81B9QWORT.2~L6JMPKL5ZSUZ.2 size=615474 2024-09-14T10:51:31.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.598+0000 7f19187cc780 1 < canceled multipart upload key=AST81B9QWORT upload=L6JMPKL5ZSUZ tag=WMW46SM0QN2A type=write size=3761202 2024-09-14T10:51:31.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.599+0000 7f19187cc780 1 > prepared operation key=9EBD5ZT6MT45 tag=UMKO1BXWPA0R type=del size=2550955 2024-09-14T10:51:31.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.601+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~C4D796KRR1ES.0 size=1048576 2024-09-14T10:51:31.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.602+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~C4D796KRR1ES.1 size=1048576 2024-09-14T10:51:31.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.603+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~C4D796KRR1ES.2 size=199596 2024-09-14T10:51:31.604 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.605+0000 7f19187cc780 1 < completed multipart upload key=B9FQYIX19AEP upload=C4D796KRR1ES tag=8KTGZTJH4PIH type=write size=3345324 2024-09-14T10:51:31.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.609+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~VA40JH11J0PV.0 size=1048576 2024-09-14T10:51:31.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.610+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~VA40JH11J0PV.1 size=870555 2024-09-14T10:51:31.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.610+0000 7f19187cc780 1 > prepared multipart upload key=AGNUE76X8XCJ upload=VA40JH11J0PV tag=AP05NPNI39GV type=write size=2967707 2024-09-14T10:51:31.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.613+0000 7f19187cc780 1 < completed delete operation key=54BSD3DEHNK6 tag=SOQR46W9QSWX type=del 2024-09-14T10:51:31.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.614+0000 7f19187cc780 1 > prepared operation key=E6UO1LUWOC44 tag=NGCX3POXWVBA type=del size=3676187 2024-09-14T10:51:31.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.616+0000 7f19187cc780 -1 < failed to complete operation key=B9FQYIX19AEP tag=A6NRVI4YBITM type=del size=3914333: (22) Invalid argument 2024-09-14T10:51:31.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.617+0000 7f19187cc780 1 > prepared operation key=OVOPGTYUF3F3 tag=OQMJ7YPVLJ2O type=del size=902092 2024-09-14T10:51:31.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.619+0000 7f19187cc780 1 < completed write operation key=RTGE7ISETJWW tag=9JD53GKMTQIV type=write size=672073 2024-09-14T10:51:31.619 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.620+0000 7f19187cc780 1 > prepared operation key=CADC2BY888V1 tag=Q72897D1W50Y type=del size=981068 2024-09-14T10:51:31.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.622+0000 7f19187cc780 1 < completed part key=_multipart_QFEI6H4EQ9ZR.2~J9KCSRVIPLFM.0 size=1048576 2024-09-14T10:51:31.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.624+0000 7f19187cc780 1 < completed part key=_multipart_QFEI6H4EQ9ZR.2~J9KCSRVIPLFM.1 size=1048576 2024-09-14T10:51:31.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.625+0000 7f19187cc780 1 < completed part key=_multipart_QFEI6H4EQ9ZR.2~J9KCSRVIPLFM.2 size=236613 2024-09-14T10:51:31.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.627+0000 7f19187cc780 1 < completed multipart upload key=QFEI6H4EQ9ZR upload=J9KCSRVIPLFM tag=I1XF7WCI4AJ3 type=write size=3382341 2024-09-14T10:51:31.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.629+0000 7f19187cc780 1 > prepared operation key=XCVE2F2JJK4X tag=DUBGBVARKLFJ type=del size=3010941 2024-09-14T10:51:31.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.630+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~3GGI1RFM2VTL.0 size=113804 2024-09-14T10:51:31.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.632+0000 7f19187cc780 1 < completed multipart upload key=7IWUW2HC3ULI upload=3GGI1RFM2VTL tag=5S73L630MMMD type=write size=1162380 2024-09-14T10:51:31.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.634+0000 7f19187cc780 1 > prepared operation key=MFA30GSMCSKP tag=5352X0JEAC34 type=del size=1285559 2024-09-14T10:51:31.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.636+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~D0IRS9XILL2E.0 size=1048576 2024-09-14T10:51:31.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.637+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~D0IRS9XILL2E.1 size=682628 2024-09-14T10:51:31.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.639+0000 7f19187cc780 1 < completed multipart upload key=IKVYA4KEALFF upload=D0IRS9XILL2E tag=7PA2AQPSOX1L type=write size=2779780 2024-09-14T10:51:31.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.640+0000 7f19187cc780 1 > prepared operation key=AGNUE76X8XCJ tag=OQAQQAQNERGO type=del size=2306158 2024-09-14T10:51:31.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.641+0000 7f19187cc780 1 < completed delete operation key=XCVE2F2JJK4X tag=SYM10TZKSG89 type=del 2024-09-14T10:51:31.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.644+0000 7f19187cc780 1 > prepared part key=_multipart_M73CER01XHDY.2~084CUSM1V48Z.0 size=489812 2024-09-14T10:51:31.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.644+0000 7f19187cc780 1 > prepared multipart upload key=M73CER01XHDY upload=084CUSM1V48Z tag=BGI547YZSZWJ type=write size=1538388 2024-09-14T10:51:31.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.645+0000 7f19187cc780 1 < completed write operation key=XCVE2F2JJK4X tag=U03LMAF88G1U type=write size=513893 2024-09-14T10:51:31.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.647+0000 7f19187cc780 1 > prepared operation key=AGNUE76X8XCJ tag=4TX5CXKKF4TX type=del size=6830 2024-09-14T10:51:31.647 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.648+0000 7f19187cc780 1 < completed delete operation key=617QQI921HB4 tag=53VIWQBXV1NB type=del 2024-09-14T10:51:31.648 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.650+0000 7f19187cc780 1 > prepared operation key=VW6U36JN2DBX tag=0RAKIGVIQ0WH type=write size=1030142 2024-09-14T10:51:31.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.651+0000 7f19187cc780 1 < completed delete operation key=9EBD5ZT6MT45 tag=5LCVNAGPMH2F type=del 2024-09-14T10:51:31.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.654+0000 7f19187cc780 1 > prepared part key=_multipart_CADC2BY888V1.2~08CJK3Q4Q9SF.0 size=571182 2024-09-14T10:51:31.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.654+0000 7f19187cc780 1 > prepared multipart upload key=CADC2BY888V1 upload=08CJK3Q4Q9SF tag=KWDETM3TMNVU type=write size=1619758 2024-09-14T10:51:31.654 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.655+0000 7f19187cc780 1 < completed part key=_multipart_E6UO1LUWOC44.2~2NJV9WL3DW1M.0 size=1048576 2024-09-14T10:51:31.654 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.656+0000 7f19187cc780 1 < completed part key=_multipart_E6UO1LUWOC44.2~2NJV9WL3DW1M.1 size=392308 2024-09-14T10:51:31.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.658+0000 7f19187cc780 1 < completed multipart upload key=E6UO1LUWOC44 upload=2NJV9WL3DW1M tag=9XIK8HXIS84G type=write size=2489460 2024-09-14T10:51:31.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.660+0000 7f19187cc780 1 > prepared operation key=7IWUW2HC3ULI tag=60LB2KU5T03D type=write size=978381 2024-09-14T10:51:31.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.661+0000 7f19187cc780 1 < completed delete operation key=W1K1IU13J0CZ tag=GGG4ZX30JEKI type=del 2024-09-14T10:51:31.661 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.663+0000 7f19187cc780 1 > prepared operation key=QFEI6H4EQ9ZR tag=9HHIYN1HGWSP type=del size=306175 2024-09-14T10:51:31.663 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.664+0000 7f19187cc780 1 < completed delete operation key=61O2VU0SB379 tag=NJQ91M39P8KN type=del 2024-09-14T10:51:31.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.666+0000 7f19187cc780 1 > prepared operation key=W1K1IU13J0CZ tag=P8Y7PZ5BHQR8 type=write size=283061 2024-09-14T10:51:31.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.667+0000 7f19187cc780 1 < canceled operation key=MFA30GSMCSKP tag=KSSCG8P0CZ7Q type=del size=2525933 2024-09-14T10:51:31.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.670+0000 7f19187cc780 1 > prepared part key=_multipart_AST81B9QWORT.2~KYPBLPJRI576.0 size=171460 2024-09-14T10:51:31.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.670+0000 7f19187cc780 1 > prepared multipart upload key=AST81B9QWORT upload=KYPBLPJRI576 tag=5RR37UWJCPRP type=write size=1220036 2024-09-14T10:51:31.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.673+0000 7f19187cc780 1 < suggested remove operation key=9EBD5ZT6MT45 tag=UMKO1BXWPA0R type=del 2024-09-14T10:51:31.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.674+0000 7f19187cc780 1 > prepared operation key=61O2VU0SB379 tag=M3AWQ1VLKW32 type=del size=821983 2024-09-14T10:51:31.675 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.675+0000 7f19187cc780 1 < completed part key=_multipart_AGNUE76X8XCJ.2~VA40JH11J0PV.0 size=1048576 2024-09-14T10:51:31.675 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.677+0000 7f19187cc780 1 < completed part key=_multipart_AGNUE76X8XCJ.2~VA40JH11J0PV.1 size=870555 2024-09-14T10:51:31.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.679+0000 7f19187cc780 1 < completed multipart upload key=AGNUE76X8XCJ upload=VA40JH11J0PV tag=AP05NPNI39GV type=write size=2967707 2024-09-14T10:51:31.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.681+0000 7f19187cc780 1 > prepared part key=_multipart_75O00VMLJJ1X.2~YNMMU6QYZVO2.0 size=1048576 2024-09-14T10:51:31.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.683+0000 7f19187cc780 1 > prepared part key=_multipart_75O00VMLJJ1X.2~YNMMU6QYZVO2.1 size=531324 2024-09-14T10:51:31.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.683+0000 7f19187cc780 1 > prepared multipart upload key=75O00VMLJJ1X upload=YNMMU6QYZVO2 tag=LCM6LSVNSAR8 type=write size=2628476 2024-09-14T10:51:31.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.684+0000 7f19187cc780 1 < completed delete operation key=E6UO1LUWOC44 tag=NGCX3POXWVBA type=del 2024-09-14T10:51:31.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.686+0000 7f19187cc780 1 > prepared operation key=KP3WOGIF30PZ tag=I9J30MAIAZF2 type=write size=79772 2024-09-14T10:51:31.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.687+0000 7f19187cc780 1 < canceled operation key=OVOPGTYUF3F3 tag=OQMJ7YPVLJ2O type=del size=902092 2024-09-14T10:51:31.689 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.690+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~FIMMEVN0YJFD.0 size=935244 2024-09-14T10:51:31.689 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.690+0000 7f19187cc780 1 > prepared multipart upload key=B9FQYIX19AEP upload=FIMMEVN0YJFD tag=FHSY7UCZAHJ7 type=write size=1983820 2024-09-14T10:51:31.690 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.692+0000 7f19187cc780 1 < completed delete operation key=CADC2BY888V1 tag=Q72897D1W50Y type=del 2024-09-14T10:51:31.692 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.693+0000 7f19187cc780 1 > prepared operation key=CADC2BY888V1 tag=IJZ0CE491E6E type=write size=67300 2024-09-14T10:51:31.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.696+0000 7f19187cc780 1 < suggested update operation key=XCVE2F2JJK4X tag=DUBGBVARKLFJ type=del size=3010941 2024-09-14T10:51:31.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.699+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~GKZQ6D58XMLA.0 size=752082 2024-09-14T10:51:31.698 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.699+0000 7f19187cc780 1 > prepared multipart upload key=OVOPGTYUF3F3 upload=GKZQ6D58XMLA tag=7V1B50FL7CJ2 type=write size=1800658 2024-09-14T10:51:31.699 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.701+0000 7f19187cc780 1 < completed delete operation key=MFA30GSMCSKP tag=5352X0JEAC34 type=del 2024-09-14T10:51:31.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.703+0000 7f19187cc780 1 > prepared part key=_multipart_QBMNYNWOLK4I.2~817DLMW2ES7P.0 size=1048576 2024-09-14T10:51:31.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.705+0000 7f19187cc780 1 > prepared part key=_multipart_QBMNYNWOLK4I.2~817DLMW2ES7P.1 size=105845 2024-09-14T10:51:31.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.705+0000 7f19187cc780 1 > prepared multipart upload key=QBMNYNWOLK4I upload=817DLMW2ES7P tag=G6JF9QDQTIL6 type=write size=2202997 2024-09-14T10:51:31.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.706+0000 7f19187cc780 1 < completed delete operation key=AGNUE76X8XCJ tag=OQAQQAQNERGO type=del 2024-09-14T10:51:31.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.709+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~3NHQNIN5VJAL.0 size=1048576 2024-09-14T10:51:31.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.710+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~3NHQNIN5VJAL.1 size=458099 2024-09-14T10:51:31.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.710+0000 7f19187cc780 1 > prepared multipart upload key=AGNUE76X8XCJ upload=3NHQNIN5VJAL tag=4UDHFZEIF2PH type=write size=2555251 2024-09-14T10:51:31.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.711+0000 7f19187cc780 1 < completed part key=_multipart_M73CER01XHDY.2~084CUSM1V48Z.0 size=489812 2024-09-14T10:51:31.712 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.713+0000 7f19187cc780 1 < completed multipart upload key=M73CER01XHDY upload=084CUSM1V48Z tag=BGI547YZSZWJ type=write size=1538388 2024-09-14T10:51:31.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.715+0000 7f19187cc780 1 > prepared operation key=EZLSMEK89N2G tag=26M5TGTL2IXU type=write size=477540 2024-09-14T10:51:31.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.717+0000 7f19187cc780 1 < completed delete operation key=AGNUE76X8XCJ tag=4TX5CXKKF4TX type=del 2024-09-14T10:51:31.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.718+0000 7f19187cc780 1 > prepared operation key=YA3DI7N4DG5K tag=F8WGDLPP3GEC type=del size=3560516 2024-09-14T10:51:31.718 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.720+0000 7f19187cc780 1 < completed write operation key=VW6U36JN2DBX tag=0RAKIGVIQ0WH type=write size=1030142 2024-09-14T10:51:31.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.722+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~7IB0NG8SWAVR.0 size=18883 2024-09-14T10:51:31.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.722+0000 7f19187cc780 1 > prepared multipart upload key=7IWUW2HC3ULI upload=7IB0NG8SWAVR tag=QK10EM1HL22C type=write size=1067459 2024-09-14T10:51:31.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.723+0000 7f19187cc780 1 < canceled part key=_multipart_CADC2BY888V1.2~08CJK3Q4Q9SF.0 size=571182 2024-09-14T10:51:31.724 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.725+0000 7f19187cc780 1 < canceled multipart upload key=CADC2BY888V1 upload=08CJK3Q4Q9SF tag=KWDETM3TMNVU type=write size=1619758 2024-09-14T10:51:31.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.727+0000 7f19187cc780 1 > prepared operation key=H40763V7HMBC tag=I7R1WXMP5S7V type=del size=1826188 2024-09-14T10:51:31.726 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.728+0000 7f19187cc780 1 < completed write operation key=7IWUW2HC3ULI tag=60LB2KU5T03D type=write size=978381 2024-09-14T10:51:31.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.729+0000 7f19187cc780 1 > prepared operation key=54BSD3DEHNK6 tag=LL1Y8NVXGCO8 type=del size=3484818 2024-09-14T10:51:31.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.731+0000 7f19187cc780 1 < completed delete operation key=QFEI6H4EQ9ZR tag=9HHIYN1HGWSP type=del 2024-09-14T10:51:31.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.734+0000 7f19187cc780 1 > prepared part key=_multipart_W1K1IU13J0CZ.2~RGEI1P4L54VJ.0 size=765692 2024-09-14T10:51:31.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.734+0000 7f19187cc780 1 > prepared multipart upload key=W1K1IU13J0CZ upload=RGEI1P4L54VJ tag=PB99C9AJ1875 type=write size=1814268 2024-09-14T10:51:31.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.735+0000 7f19187cc780 1 < completed write operation key=W1K1IU13J0CZ tag=P8Y7PZ5BHQR8 type=write size=283061 2024-09-14T10:51:31.735 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.736+0000 7f19187cc780 1 > prepared operation key=MFA30GSMCSKP tag=QMJFNIRWTDJK type=write size=456266 2024-09-14T10:51:31.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.738+0000 7f19187cc780 1 < completed part key=_multipart_AST81B9QWORT.2~KYPBLPJRI576.0 size=171460 2024-09-14T10:51:31.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.740+0000 7f19187cc780 1 < completed multipart upload key=AST81B9QWORT upload=KYPBLPJRI576 tag=5RR37UWJCPRP type=write size=1220036 2024-09-14T10:51:31.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.742+0000 7f19187cc780 1 > prepared part key=_multipart_RTGE7ISETJWW.2~R8HZPKLAEXCH.0 size=1048576 2024-09-14T10:51:31.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.743+0000 7f19187cc780 1 > prepared part key=_multipart_RTGE7ISETJWW.2~R8HZPKLAEXCH.1 size=1048576 2024-09-14T10:51:31.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.744+0000 7f19187cc780 1 > prepared part key=_multipart_RTGE7ISETJWW.2~R8HZPKLAEXCH.2 size=143035 2024-09-14T10:51:31.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.744+0000 7f19187cc780 1 > prepared multipart upload key=RTGE7ISETJWW upload=R8HZPKLAEXCH tag=W3VU4VUPOPUL type=write size=3288763 2024-09-14T10:51:31.744 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.746+0000 7f19187cc780 1 < completed delete operation key=61O2VU0SB379 tag=M3AWQ1VLKW32 type=del 2024-09-14T10:51:31.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.749+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~J8TSI53L7G9D.0 size=1048576 2024-09-14T10:51:31.748 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.750+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~J8TSI53L7G9D.1 size=1048576 2024-09-14T10:51:31.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.751+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~J8TSI53L7G9D.2 size=795471 2024-09-14T10:51:31.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.751+0000 7f19187cc780 1 > prepared multipart upload key=KP3WOGIF30PZ upload=J8TSI53L7G9D tag=QJALM1ECNLP6 type=write size=3941199 2024-09-14T10:51:31.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.752+0000 7f19187cc780 1 < completed part key=_multipart_75O00VMLJJ1X.2~YNMMU6QYZVO2.0 size=1048576 2024-09-14T10:51:31.752 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.754+0000 7f19187cc780 1 < completed part key=_multipart_75O00VMLJJ1X.2~YNMMU6QYZVO2.1 size=531324 2024-09-14T10:51:31.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.756+0000 7f19187cc780 1 < completed multipart upload key=75O00VMLJJ1X upload=YNMMU6QYZVO2 tag=LCM6LSVNSAR8 type=write size=2628476 2024-09-14T10:51:31.756 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.758+0000 7f19187cc780 1 > prepared part key=_multipart_INJQTKXHBUV2.2~5PXDA3895EIY.0 size=1048576 2024-09-14T10:51:31.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.759+0000 7f19187cc780 1 > prepared part key=_multipart_INJQTKXHBUV2.2~5PXDA3895EIY.1 size=107954 2024-09-14T10:51:31.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.759+0000 7f19187cc780 1 > prepared multipart upload key=INJQTKXHBUV2 upload=5PXDA3895EIY tag=3D2FWMTNEMK9 type=write size=2205106 2024-09-14T10:51:31.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.761+0000 7f19187cc780 1 < completed write operation key=KP3WOGIF30PZ tag=I9J30MAIAZF2 type=write size=79772 2024-09-14T10:51:31.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.763+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~4IBHG4LIE8JY.0 size=300385 2024-09-14T10:51:31.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.763+0000 7f19187cc780 1 > prepared multipart upload key=OVOPGTYUF3F3 upload=4IBHG4LIE8JY tag=CMORD6HD0TIT type=write size=1348961 2024-09-14T10:51:31.763 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.764+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~FIMMEVN0YJFD.0 size=935244 2024-09-14T10:51:31.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.767+0000 7f19187cc780 1 < completed multipart upload key=B9FQYIX19AEP upload=FIMMEVN0YJFD tag=FHSY7UCZAHJ7 type=write size=1983820 2024-09-14T10:51:31.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.769+0000 7f19187cc780 1 > prepared part key=_multipart_75O00VMLJJ1X.2~8S1WB67L73WG.0 size=218950 2024-09-14T10:51:31.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.769+0000 7f19187cc780 1 > prepared multipart upload key=75O00VMLJJ1X upload=8S1WB67L73WG tag=1X8S7AP0D8Q0 type=write size=1267526 2024-09-14T10:51:31.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.772+0000 7f19187cc780 1 < suggested update operation key=CADC2BY888V1 tag=IJZ0CE491E6E type=write size=67300 2024-09-14T10:51:31.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.773+0000 7f19187cc780 1 > prepared operation key=AST81B9QWORT tag=3JV4KJAE683U type=del size=3254613 2024-09-14T10:51:31.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.774+0000 7f19187cc780 1 < canceled part key=_multipart_OVOPGTYUF3F3.2~GKZQ6D58XMLA.0 size=752082 2024-09-14T10:51:31.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.776+0000 7f19187cc780 1 < canceled multipart upload key=OVOPGTYUF3F3 upload=GKZQ6D58XMLA tag=7V1B50FL7CJ2 type=write size=1800658 2024-09-14T10:51:31.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.777+0000 7f19187cc780 1 > prepared operation key=XCVE2F2JJK4X tag=W4GMJYSLDQUQ type=del size=3970287 2024-09-14T10:51:31.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.779+0000 7f19187cc780 1 < completed part key=_multipart_QBMNYNWOLK4I.2~817DLMW2ES7P.0 size=1048576 2024-09-14T10:51:31.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.780+0000 7f19187cc780 1 < completed part key=_multipart_QBMNYNWOLK4I.2~817DLMW2ES7P.1 size=105845 2024-09-14T10:51:31.781 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.782+0000 7f19187cc780 1 < completed multipart upload key=QBMNYNWOLK4I upload=817DLMW2ES7P tag=G6JF9QDQTIL6 type=write size=2202997 2024-09-14T10:51:31.783 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.784+0000 7f19187cc780 1 > prepared part key=_multipart_RTGE7ISETJWW.2~H6YGWQ52CUP4.0 size=1048576 2024-09-14T10:51:31.784 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.786+0000 7f19187cc780 1 > prepared part key=_multipart_RTGE7ISETJWW.2~H6YGWQ52CUP4.1 size=1048576 2024-09-14T10:51:31.785 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.787+0000 7f19187cc780 1 > prepared part key=_multipart_RTGE7ISETJWW.2~H6YGWQ52CUP4.2 size=939849 2024-09-14T10:51:31.785 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.787+0000 7f19187cc780 1 > prepared multipart upload key=RTGE7ISETJWW upload=H6YGWQ52CUP4 tag=X6KHMISR5E6A type=write size=4085577 2024-09-14T10:51:31.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.788+0000 7f19187cc780 1 < completed part key=_multipart_AGNUE76X8XCJ.2~3NHQNIN5VJAL.0 size=1048576 2024-09-14T10:51:31.788 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.790+0000 7f19187cc780 1 < completed part key=_multipart_AGNUE76X8XCJ.2~3NHQNIN5VJAL.1 size=458099 2024-09-14T10:51:31.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.792+0000 7f19187cc780 1 < completed multipart upload key=AGNUE76X8XCJ upload=3NHQNIN5VJAL tag=4UDHFZEIF2PH type=write size=2555251 2024-09-14T10:51:31.793 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.794+0000 7f19187cc780 1 > prepared part key=_multipart_M73CER01XHDY.2~2LR8A3CVJTE7.0 size=1048576 2024-09-14T10:51:31.794 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.795+0000 7f19187cc780 1 > prepared part key=_multipart_M73CER01XHDY.2~2LR8A3CVJTE7.1 size=404072 2024-09-14T10:51:31.794 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.795+0000 7f19187cc780 1 > prepared multipart upload key=M73CER01XHDY upload=2LR8A3CVJTE7 tag=GYD5PHEWNP4V type=write size=2501224 2024-09-14T10:51:31.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.797+0000 7f19187cc780 1 < canceled operation key=EZLSMEK89N2G tag=26M5TGTL2IXU type=write size=477540 2024-09-14T10:51:31.797 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.798+0000 7f19187cc780 1 > prepared operation key=61O2VU0SB379 tag=X7UKN35OFPLT type=write size=699498 2024-09-14T10:51:31.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.800+0000 7f19187cc780 1 < completed delete operation key=YA3DI7N4DG5K tag=F8WGDLPP3GEC type=del 2024-09-14T10:51:31.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.801+0000 7f19187cc780 1 > prepared operation key=H40763V7HMBC tag=J6954ZHP1C3C type=del size=2153417 2024-09-14T10:51:31.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.802+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~7IB0NG8SWAVR.0 size=18883 2024-09-14T10:51:31.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.805+0000 7f19187cc780 1 < completed multipart upload key=7IWUW2HC3ULI upload=7IB0NG8SWAVR tag=QK10EM1HL22C type=write size=1067459 2024-09-14T10:51:31.804 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.806+0000 7f19187cc780 1 > prepared operation key=W1K1IU13J0CZ tag=T0N9UEJNBZ1Z type=del size=3266126 2024-09-14T10:51:31.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.809+0000 7f19187cc780 1 < suggested update operation key=H40763V7HMBC tag=I7R1WXMP5S7V type=del size=1826188 2024-09-14T10:51:31.810 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.811+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~J92LY6PNWZEZ.0 size=1048576 2024-09-14T10:51:31.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.813+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~J92LY6PNWZEZ.1 size=1048576 2024-09-14T10:51:31.812 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.814+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~J92LY6PNWZEZ.2 size=502312 2024-09-14T10:51:31.812 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.814+0000 7f19187cc780 1 > prepared multipart upload key=7IWUW2HC3ULI upload=J92LY6PNWZEZ tag=QCQ4OW7K8H8F type=write size=3648040 2024-09-14T10:51:31.813 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.815+0000 7f19187cc780 1 < completed delete operation key=54BSD3DEHNK6 tag=LL1Y8NVXGCO8 type=del 2024-09-14T10:51:31.815 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.817+0000 7f19187cc780 1 > prepared operation key=6BNN842ZTWG5 tag=07ONYXA9BN9I type=del size=2298233 2024-09-14T10:51:31.817 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.818+0000 7f19187cc780 1 < completed part key=_multipart_W1K1IU13J0CZ.2~RGEI1P4L54VJ.0 size=765692 2024-09-14T10:51:31.819 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.821+0000 7f19187cc780 1 < completed multipart upload key=W1K1IU13J0CZ upload=RGEI1P4L54VJ tag=PB99C9AJ1875 type=write size=1814268 2024-09-14T10:51:31.822 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.824+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~JPTJXYY2HK5Z.0 size=223793 2024-09-14T10:51:31.822 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.824+0000 7f19187cc780 1 > prepared multipart upload key=XCVE2F2JJK4X upload=JPTJXYY2HK5Z tag=NW8XGV91600P type=write size=1272369 2024-09-14T10:51:31.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.825+0000 7f19187cc780 1 < completed write operation key=MFA30GSMCSKP tag=QMJFNIRWTDJK type=write size=456266 2024-09-14T10:51:31.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.828+0000 7f19187cc780 1 > prepared part key=_multipart_EL00Y4Z7DTAT.2~VG2N72J0JC2N.0 size=1048576 2024-09-14T10:51:31.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.829+0000 7f19187cc780 1 > prepared part key=_multipart_EL00Y4Z7DTAT.2~VG2N72J0JC2N.1 size=400475 2024-09-14T10:51:31.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.829+0000 7f19187cc780 1 > prepared multipart upload key=EL00Y4Z7DTAT upload=VG2N72J0JC2N tag=Q86RARIDQCIL type=write size=2497627 2024-09-14T10:51:31.829 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.831+0000 7f19187cc780 1 < completed part key=_multipart_RTGE7ISETJWW.2~R8HZPKLAEXCH.0 size=1048576 2024-09-14T10:51:31.830 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.832+0000 7f19187cc780 1 < completed part key=_multipart_RTGE7ISETJWW.2~R8HZPKLAEXCH.1 size=1048576 2024-09-14T10:51:31.830 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.832+0000 7f19187cc780 1 < canceled part key=_multipart_RTGE7ISETJWW.2~R8HZPKLAEXCH.2 size=143035 2024-09-14T10:51:31.833 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.835+0000 7f19187cc780 1 < canceled multipart upload key=RTGE7ISETJWW upload=R8HZPKLAEXCH tag=W3VU4VUPOPUL type=write size=3288763 2024-09-14T10:51:31.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.836+0000 7f19187cc780 1 > prepared operation key=617QQI921HB4 tag=RVTP6C8IF0Q5 type=del size=2456916 2024-09-14T10:51:31.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.838+0000 7f19187cc780 1 < completed part key=_multipart_KP3WOGIF30PZ.2~J8TSI53L7G9D.0 size=1048576 2024-09-14T10:51:31.837 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.839+0000 7f19187cc780 1 < completed part key=_multipart_KP3WOGIF30PZ.2~J8TSI53L7G9D.1 size=1048576 2024-09-14T10:51:31.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.840+0000 7f19187cc780 1 < completed part key=_multipart_KP3WOGIF30PZ.2~J8TSI53L7G9D.2 size=795471 2024-09-14T10:51:31.841 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.843+0000 7f19187cc780 1 < completed multipart upload key=KP3WOGIF30PZ upload=J8TSI53L7G9D tag=QJALM1ECNLP6 type=write size=3941199 2024-09-14T10:51:31.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.844+0000 7f19187cc780 1 > prepared operation key=9EBD5ZT6MT45 tag=S5SFHKSVGWIN type=del size=1244360 2024-09-14T10:51:31.844 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.846+0000 7f19187cc780 1 < completed part key=_multipart_INJQTKXHBUV2.2~5PXDA3895EIY.0 size=1048576 2024-09-14T10:51:31.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.847+0000 7f19187cc780 1 < completed part key=_multipart_INJQTKXHBUV2.2~5PXDA3895EIY.1 size=107954 2024-09-14T10:51:31.848 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.850+0000 7f19187cc780 1 < completed multipart upload key=INJQTKXHBUV2 upload=5PXDA3895EIY tag=3D2FWMTNEMK9 type=write size=2205106 2024-09-14T10:51:31.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.852+0000 7f19187cc780 1 > prepared operation key=75O00VMLJJ1X tag=H6LQUWHEJRQE type=del size=2331820 2024-09-14T10:51:31.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.853+0000 7f19187cc780 1 < completed part key=_multipart_OVOPGTYUF3F3.2~4IBHG4LIE8JY.0 size=300385 2024-09-14T10:51:31.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.856+0000 7f19187cc780 1 < completed multipart upload key=OVOPGTYUF3F3 upload=4IBHG4LIE8JY tag=CMORD6HD0TIT type=write size=1348961 2024-09-14T10:51:31.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.857+0000 7f19187cc780 1 > prepared operation key=VW6U36JN2DBX tag=485QXUVCDEDC type=del size=3025446 2024-09-14T10:51:31.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.859+0000 7f19187cc780 1 < completed part key=_multipart_75O00VMLJJ1X.2~8S1WB67L73WG.0 size=218950 2024-09-14T10:51:31.859 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.861+0000 7f19187cc780 1 < completed multipart upload key=75O00VMLJJ1X upload=8S1WB67L73WG tag=1X8S7AP0D8Q0 type=write size=1267526 2024-09-14T10:51:31.861 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.862+0000 7f19187cc780 1 > prepared operation key=19P3WE6HKJH2 tag=DNX0UZ68G6FA type=write size=795235 2024-09-14T10:51:31.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.864+0000 7f19187cc780 1 < completed delete operation key=AST81B9QWORT tag=3JV4KJAE683U type=del 2024-09-14T10:51:31.864 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.865+0000 7f19187cc780 1 > prepared operation key=AGNUE76X8XCJ tag=GSFXDBT69JUZ type=del size=2879287 2024-09-14T10:51:31.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.867+0000 7f19187cc780 1 < canceled operation key=XCVE2F2JJK4X tag=W4GMJYSLDQUQ type=del size=3970287 2024-09-14T10:51:31.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.869+0000 7f19187cc780 1 > prepared part key=_multipart_RTGE7ISETJWW.2~DH92CAS9F0OY.0 size=1048576 2024-09-14T10:51:31.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.871+0000 7f19187cc780 1 > prepared part key=_multipart_RTGE7ISETJWW.2~DH92CAS9F0OY.1 size=66661 2024-09-14T10:51:31.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.871+0000 7f19187cc780 1 > prepared multipart upload key=RTGE7ISETJWW upload=DH92CAS9F0OY tag=7JFXJIUVLI3P type=write size=2163813 2024-09-14T10:51:31.871 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.872+0000 7f19187cc780 1 < completed part key=_multipart_RTGE7ISETJWW.2~H6YGWQ52CUP4.0 size=1048576 2024-09-14T10:51:31.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.873+0000 7f19187cc780 1 < completed part key=_multipart_RTGE7ISETJWW.2~H6YGWQ52CUP4.1 size=1048576 2024-09-14T10:51:31.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.874+0000 7f19187cc780 1 < canceled part key=_multipart_RTGE7ISETJWW.2~H6YGWQ52CUP4.2 size=939849 2024-09-14T10:51:31.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.876+0000 7f19187cc780 1 < canceled multipart upload key=RTGE7ISETJWW upload=H6YGWQ52CUP4 tag=X6KHMISR5E6A type=write size=4085577 2024-09-14T10:51:31.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.880+0000 7f19187cc780 1 > prepared part key=_multipart_9EBD5ZT6MT45.2~SBS3KSS4A4GC.0 size=1048576 2024-09-14T10:51:31.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.882+0000 7f19187cc780 1 > prepared part key=_multipart_9EBD5ZT6MT45.2~SBS3KSS4A4GC.1 size=1048576 2024-09-14T10:51:31.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.883+0000 7f19187cc780 1 > prepared part key=_multipart_9EBD5ZT6MT45.2~SBS3KSS4A4GC.2 size=245146 2024-09-14T10:51:31.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.883+0000 7f19187cc780 1 > prepared multipart upload key=9EBD5ZT6MT45 upload=SBS3KSS4A4GC tag=33Z3YTFZT743 type=write size=3390874 2024-09-14T10:51:31.882 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.883+0000 7f19187cc780 1 < canceled part key=_multipart_M73CER01XHDY.2~2LR8A3CVJTE7.0 size=1048576 2024-09-14T10:51:31.883 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.884+0000 7f19187cc780 1 < completed part key=_multipart_M73CER01XHDY.2~2LR8A3CVJTE7.1 size=404072 2024-09-14T10:51:31.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.887+0000 7f19187cc780 1 < canceled multipart upload key=M73CER01XHDY upload=2LR8A3CVJTE7 tag=GYD5PHEWNP4V type=write size=2501224 2024-09-14T10:51:31.888 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.889+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~5DTD4SY7FWS8.0 size=53057 2024-09-14T10:51:31.888 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.889+0000 7f19187cc780 1 > prepared multipart upload key=6BNN842ZTWG5 upload=5DTD4SY7FWS8 tag=X7T3DMEK1G3P type=write size=1101633 2024-09-14T10:51:31.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.891+0000 7f19187cc780 1 < completed write operation key=61O2VU0SB379 tag=X7UKN35OFPLT type=write size=699498 2024-09-14T10:51:31.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.893+0000 7f19187cc780 1 > prepared operation key=H40763V7HMBC tag=MK7GE1OO9HXM type=del size=114290 2024-09-14T10:51:31.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.894+0000 7f19187cc780 -1 < failed to complete operation key=H40763V7HMBC tag=J6954ZHP1C3C type=del size=2153417: (22) Invalid argument 2024-09-14T10:51:31.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.897+0000 7f19187cc780 1 > prepared part key=_multipart_INJQTKXHBUV2.2~X3J2S7BVHGFV.0 size=1048576 2024-09-14T10:51:31.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.898+0000 7f19187cc780 1 > prepared part key=_multipart_INJQTKXHBUV2.2~X3J2S7BVHGFV.1 size=133276 2024-09-14T10:51:31.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.898+0000 7f19187cc780 1 > prepared multipart upload key=INJQTKXHBUV2 upload=X3J2S7BVHGFV tag=YZF8SK3QEBNK type=write size=2230428 2024-09-14T10:51:31.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.900+0000 7f19187cc780 1 < canceled operation key=W1K1IU13J0CZ tag=T0N9UEJNBZ1Z type=del size=3266126 2024-09-14T10:51:31.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.902+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~W2ETYOS9DRJ6.0 size=1048576 2024-09-14T10:51:31.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.904+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~W2ETYOS9DRJ6.1 size=1048576 2024-09-14T10:51:31.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.905+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~W2ETYOS9DRJ6.2 size=763333 2024-09-14T10:51:31.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.905+0000 7f19187cc780 1 > prepared multipart upload key=AGNUE76X8XCJ upload=W2ETYOS9DRJ6 tag=SHA2HYX65373 type=write size=3909061 2024-09-14T10:51:31.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.906+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~J92LY6PNWZEZ.0 size=1048576 2024-09-14T10:51:31.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.907+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~J92LY6PNWZEZ.1 size=1048576 2024-09-14T10:51:31.907 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.908+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~J92LY6PNWZEZ.2 size=502312 2024-09-14T10:51:31.909 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.910+0000 7f19187cc780 1 < completed multipart upload key=7IWUW2HC3ULI upload=J92LY6PNWZEZ tag=QCQ4OW7K8H8F type=write size=3648040 2024-09-14T10:51:31.911 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.913+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~JJYYS4D65NMY.0 size=1048576 2024-09-14T10:51:31.912 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.914+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~JJYYS4D65NMY.1 size=865583 2024-09-14T10:51:31.912 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.914+0000 7f19187cc780 1 > prepared multipart upload key=6BNN842ZTWG5 upload=JJYYS4D65NMY tag=KVTSWUI2JLZ9 type=write size=2962735 2024-09-14T10:51:31.914 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.915+0000 7f19187cc780 1 < completed delete operation key=6BNN842ZTWG5 tag=07ONYXA9BN9I type=del 2024-09-14T10:51:31.915 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.917+0000 7f19187cc780 1 > prepared operation key=OVOPGTYUF3F3 tag=JASEWFJVE1WV type=write size=394584 2024-09-14T10:51:31.915 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.917+0000 7f19187cc780 1 < canceled part key=_multipart_XCVE2F2JJK4X.2~JPTJXYY2HK5Z.0 size=223793 2024-09-14T10:51:31.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.919+0000 7f19187cc780 1 < canceled multipart upload key=XCVE2F2JJK4X upload=JPTJXYY2HK5Z tag=NW8XGV91600P type=write size=1272369 2024-09-14T10:51:31.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.922+0000 7f19187cc780 1 > prepared part key=_multipart_19P3WE6HKJH2.2~OUVOVW82XBU6.0 size=192909 2024-09-14T10:51:31.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.922+0000 7f19187cc780 1 > prepared multipart upload key=19P3WE6HKJH2 upload=OUVOVW82XBU6 tag=4IOQJTE7XWLT type=write size=1241485 2024-09-14T10:51:31.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.922+0000 7f19187cc780 1 < canceled part key=_multipart_EL00Y4Z7DTAT.2~VG2N72J0JC2N.0 size=1048576 2024-09-14T10:51:31.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.923+0000 7f19187cc780 1 < completed part key=_multipart_EL00Y4Z7DTAT.2~VG2N72J0JC2N.1 size=400475 2024-09-14T10:51:31.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.926+0000 7f19187cc780 1 < canceled multipart upload key=EL00Y4Z7DTAT upload=VG2N72J0JC2N tag=Q86RARIDQCIL type=write size=2497627 2024-09-14T10:51:31.926 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.927+0000 7f19187cc780 1 > prepared operation key=61O2VU0SB379 tag=V5RILL8MVMM9 type=del size=183832 2024-09-14T10:51:31.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.931+0000 7f19187cc780 1 < suggested update operation key=617QQI921HB4 tag=RVTP6C8IF0Q5 type=del size=2456916 2024-09-14T10:51:31.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.933+0000 7f19187cc780 1 > prepared operation key=YA3DI7N4DG5K tag=38391UIWTLZ0 type=del size=2254801 2024-09-14T10:51:31.933 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.934+0000 7f19187cc780 1 < completed delete operation key=9EBD5ZT6MT45 tag=S5SFHKSVGWIN type=del 2024-09-14T10:51:31.939 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.936+0000 7f19187cc780 1 > prepared operation key=KP3WOGIF30PZ tag=3LZIADDI7CBV type=write size=653667 2024-09-14T10:51:31.939 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.940+0000 7f19187cc780 1 < suggested update operation key=75O00VMLJJ1X tag=H6LQUWHEJRQE type=del size=2331820 2024-09-14T10:51:31.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.943+0000 7f19187cc780 1 > prepared part key=_multipart_AST81B9QWORT.2~JV8G1YOLZR9R.0 size=1048576 2024-09-14T10:51:31.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.944+0000 7f19187cc780 1 > prepared part key=_multipart_AST81B9QWORT.2~JV8G1YOLZR9R.1 size=1048576 2024-09-14T10:51:31.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.945+0000 7f19187cc780 1 > prepared part key=_multipart_AST81B9QWORT.2~JV8G1YOLZR9R.2 size=338691 2024-09-14T10:51:31.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.945+0000 7f19187cc780 1 > prepared multipart upload key=AST81B9QWORT upload=JV8G1YOLZR9R tag=AFL3EN2HY9DH type=write size=3484419 2024-09-14T10:51:31.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.948+0000 7f19187cc780 1 < suggested update operation key=VW6U36JN2DBX tag=485QXUVCDEDC type=del size=3025446 2024-09-14T10:51:31.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.950+0000 7f19187cc780 1 > prepared operation key=KP3WOGIF30PZ tag=MJ36IGR0ZD0L type=del size=1326881 2024-09-14T10:51:31.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.951+0000 7f19187cc780 1 < completed write operation key=19P3WE6HKJH2 tag=DNX0UZ68G6FA type=write size=795235 2024-09-14T10:51:31.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.954+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~2HVLN6L1H8X9.0 size=1048576 2024-09-14T10:51:31.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.955+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~2HVLN6L1H8X9.1 size=1048576 2024-09-14T10:51:31.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.956+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~2HVLN6L1H8X9.2 size=453518 2024-09-14T10:51:31.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.956+0000 7f19187cc780 1 > prepared multipart upload key=KP3WOGIF30PZ upload=2HVLN6L1H8X9 tag=40Y74NEML1TX type=write size=3599246 2024-09-14T10:51:31.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.958+0000 7f19187cc780 1 < completed delete operation key=AGNUE76X8XCJ tag=GSFXDBT69JUZ type=del 2024-09-14T10:51:31.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.959+0000 7f19187cc780 1 > prepared operation key=KOJ7QB7M6A35 tag=2SQTCWEAX1U1 type=del size=1930133 2024-09-14T10:51:31.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.960+0000 7f19187cc780 1 < completed part key=_multipart_RTGE7ISETJWW.2~DH92CAS9F0OY.0 size=1048576 2024-09-14T10:51:31.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.962+0000 7f19187cc780 1 < completed part key=_multipart_RTGE7ISETJWW.2~DH92CAS9F0OY.1 size=66661 2024-09-14T10:51:31.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.964+0000 7f19187cc780 1 < completed multipart upload key=RTGE7ISETJWW upload=DH92CAS9F0OY tag=7JFXJIUVLI3P type=write size=2163813 2024-09-14T10:51:31.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.965+0000 7f19187cc780 1 > prepared operation key=B9FQYIX19AEP tag=AYR0DA0NJKWO type=del size=1512116 2024-09-14T10:51:31.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.967+0000 7f19187cc780 1 < completed part key=_multipart_9EBD5ZT6MT45.2~SBS3KSS4A4GC.0 size=1048576 2024-09-14T10:51:31.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.968+0000 7f19187cc780 1 < completed part key=_multipart_9EBD5ZT6MT45.2~SBS3KSS4A4GC.1 size=1048576 2024-09-14T10:51:31.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.968+0000 7f19187cc780 1 < canceled part key=_multipart_9EBD5ZT6MT45.2~SBS3KSS4A4GC.2 size=245146 2024-09-14T10:51:31.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.970+0000 7f19187cc780 1 < canceled multipart upload key=9EBD5ZT6MT45 upload=SBS3KSS4A4GC tag=33Z3YTFZT743 type=write size=3390874 2024-09-14T10:51:31.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.972+0000 7f19187cc780 1 > prepared operation key=KP3WOGIF30PZ tag=31E43V8G6QSH type=del size=1585279 2024-09-14T10:51:31.971 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.973+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~5DTD4SY7FWS8.0 size=53057 2024-09-14T10:51:31.974 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.975+0000 7f19187cc780 1 < completed multipart upload key=6BNN842ZTWG5 upload=5DTD4SY7FWS8 tag=X7T3DMEK1G3P type=write size=1101633 2024-09-14T10:51:31.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.977+0000 7f19187cc780 1 > prepared operation key=IKVYA4KEALFF tag=Z32SR8X4XZBU type=write size=636733 2024-09-14T10:51:31.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.978+0000 7f19187cc780 1 < completed delete operation key=H40763V7HMBC tag=MK7GE1OO9HXM type=del 2024-09-14T10:51:31.980 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.981+0000 7f19187cc780 1 > prepared part key=_multipart_19P3WE6HKJH2.2~3M2DQH777Y9O.0 size=1048576 2024-09-14T10:51:31.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.983+0000 7f19187cc780 1 > prepared part key=_multipart_19P3WE6HKJH2.2~3M2DQH777Y9O.1 size=1048576 2024-09-14T10:51:31.982 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.984+0000 7f19187cc780 1 > prepared part key=_multipart_19P3WE6HKJH2.2~3M2DQH777Y9O.2 size=539245 2024-09-14T10:51:31.982 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.984+0000 7f19187cc780 1 > prepared multipart upload key=19P3WE6HKJH2 upload=3M2DQH777Y9O tag=YVJXNY9DH1IU type=write size=3684973 2024-09-14T10:51:31.984 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.985+0000 7f19187cc780 1 < completed part key=_multipart_INJQTKXHBUV2.2~X3J2S7BVHGFV.0 size=1048576 2024-09-14T10:51:31.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.987+0000 7f19187cc780 1 < completed part key=_multipart_INJQTKXHBUV2.2~X3J2S7BVHGFV.1 size=133276 2024-09-14T10:51:31.988 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.989+0000 7f19187cc780 1 < completed multipart upload key=INJQTKXHBUV2 upload=X3J2S7BVHGFV tag=YZF8SK3QEBNK type=write size=2230428 2024-09-14T10:51:31.991 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.993+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~CFFRGID64X0O.0 size=333753 2024-09-14T10:51:31.991 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.993+0000 7f19187cc780 1 > prepared multipart upload key=OVOPGTYUF3F3 upload=CFFRGID64X0O tag=J7MK6JHL1WYM type=write size=1382329 2024-09-14T10:51:31.992 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.994+0000 7f19187cc780 1 < completed part key=_multipart_AGNUE76X8XCJ.2~W2ETYOS9DRJ6.0 size=1048576 2024-09-14T10:51:31.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.995+0000 7f19187cc780 1 < completed part key=_multipart_AGNUE76X8XCJ.2~W2ETYOS9DRJ6.1 size=1048576 2024-09-14T10:51:31.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.996+0000 7f19187cc780 1 < completed part key=_multipart_AGNUE76X8XCJ.2~W2ETYOS9DRJ6.2 size=763333 2024-09-14T10:51:31.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:31.999+0000 7f19187cc780 1 < completed multipart upload key=AGNUE76X8XCJ upload=W2ETYOS9DRJ6 tag=SHA2HYX65373 type=write size=3909061 2024-09-14T10:51:32.000 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.001+0000 7f19187cc780 1 > prepared part key=_multipart_AST81B9QWORT.2~DGBTARPG3T1B.0 size=659365 2024-09-14T10:51:32.000 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.001+0000 7f19187cc780 1 > prepared multipart upload key=AST81B9QWORT upload=DGBTARPG3T1B tag=75NYJ1WC15FC type=write size=1707941 2024-09-14T10:51:32.001 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.003+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~JJYYS4D65NMY.0 size=1048576 2024-09-14T10:51:32.002 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.004+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~JJYYS4D65NMY.1 size=865583 2024-09-14T10:51:32.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.006+0000 7f19187cc780 1 < completed multipart upload key=6BNN842ZTWG5 upload=JJYYS4D65NMY tag=KVTSWUI2JLZ9 type=write size=2962735 2024-09-14T10:51:32.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.009+0000 7f19187cc780 1 > prepared part key=_multipart_M73CER01XHDY.2~K8182S2IP5UE.0 size=1048576 2024-09-14T10:51:32.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.010+0000 7f19187cc780 1 > prepared part key=_multipart_M73CER01XHDY.2~K8182S2IP5UE.1 size=1048576 2024-09-14T10:51:32.009 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.011+0000 7f19187cc780 1 > prepared part key=_multipart_M73CER01XHDY.2~K8182S2IP5UE.2 size=401668 2024-09-14T10:51:32.009 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.011+0000 7f19187cc780 1 > prepared multipart upload key=M73CER01XHDY upload=K8182S2IP5UE tag=CDOFFV0FAWNG type=write size=3547396 2024-09-14T10:51:32.011 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.012+0000 7f19187cc780 1 < canceled operation key=OVOPGTYUF3F3 tag=JASEWFJVE1WV type=write size=394584 2024-09-14T10:51:32.014 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.016+0000 7f19187cc780 1 > prepared part key=_multipart_5AIAYJMRZGFQ.2~YMEPMYC4RHD6.0 size=1048576 2024-09-14T10:51:32.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.017+0000 7f19187cc780 1 > prepared part key=_multipart_5AIAYJMRZGFQ.2~YMEPMYC4RHD6.1 size=1048576 2024-09-14T10:51:32.016 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.018+0000 7f19187cc780 1 > prepared part key=_multipart_5AIAYJMRZGFQ.2~YMEPMYC4RHD6.2 size=559910 2024-09-14T10:51:32.017 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.018+0000 7f19187cc780 1 > prepared multipart upload key=5AIAYJMRZGFQ upload=YMEPMYC4RHD6 tag=UMENYDY6YNIF type=write size=3705638 2024-09-14T10:51:32.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.019+0000 7f19187cc780 1 < completed part key=_multipart_19P3WE6HKJH2.2~OUVOVW82XBU6.0 size=192909 2024-09-14T10:51:32.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.022+0000 7f19187cc780 1 < completed multipart upload key=19P3WE6HKJH2 upload=OUVOVW82XBU6 tag=4IOQJTE7XWLT type=write size=1241485 2024-09-14T10:51:32.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.024+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~E2X3GF0D33GN.0 size=1048576 2024-09-14T10:51:32.024 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.026+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~E2X3GF0D33GN.1 size=457682 2024-09-14T10:51:32.024 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.026+0000 7f19187cc780 1 > prepared multipart upload key=XCVE2F2JJK4X upload=E2X3GF0D33GN tag=I3M6VI2ZXDYC type=write size=2554834 2024-09-14T10:51:32.026 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.027+0000 7f19187cc780 1 < completed delete operation key=61O2VU0SB379 tag=V5RILL8MVMM9 type=del 2024-09-14T10:51:32.027 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.029+0000 7f19187cc780 1 > prepared operation key=H40763V7HMBC tag=7D5079F3PIXV type=del size=551635 2024-09-14T10:51:32.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.032+0000 7f19187cc780 1 < suggested update operation key=YA3DI7N4DG5K tag=38391UIWTLZ0 type=del size=2254801 2024-09-14T10:51:32.031 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.033+0000 7f19187cc780 1 > prepared operation key=5AIAYJMRZGFQ tag=5N8I5CC8JNYI type=write size=954635 2024-09-14T10:51:32.033 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.034+0000 7f19187cc780 1 < completed write operation key=KP3WOGIF30PZ tag=3LZIADDI7CBV type=write size=653667 2024-09-14T10:51:32.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.036+0000 7f19187cc780 1 > prepared operation key=B9FQYIX19AEP tag=0WNJS4F4R1UD type=del size=1056430 2024-09-14T10:51:32.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.037+0000 7f19187cc780 1 < completed part key=_multipart_AST81B9QWORT.2~JV8G1YOLZR9R.0 size=1048576 2024-09-14T10:51:32.037 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.038+0000 7f19187cc780 1 < completed part key=_multipart_AST81B9QWORT.2~JV8G1YOLZR9R.1 size=1048576 2024-09-14T10:51:32.038 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.039+0000 7f19187cc780 1 < completed part key=_multipart_AST81B9QWORT.2~JV8G1YOLZR9R.2 size=338691 2024-09-14T10:51:32.040 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.042+0000 7f19187cc780 1 < completed multipart upload key=AST81B9QWORT upload=JV8G1YOLZR9R tag=AFL3EN2HY9DH type=write size=3484419 2024-09-14T10:51:32.043 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.044+0000 7f19187cc780 1 > prepared part key=_multipart_9EBD5ZT6MT45.2~1G8XH1H70OXT.0 size=1048576 2024-09-14T10:51:32.044 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.045+0000 7f19187cc780 1 > prepared part key=_multipart_9EBD5ZT6MT45.2~1G8XH1H70OXT.1 size=979589 2024-09-14T10:51:32.044 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.045+0000 7f19187cc780 1 > prepared multipart upload key=9EBD5ZT6MT45 upload=1G8XH1H70OXT tag=B4EF2F9KCD94 type=write size=3076741 2024-09-14T10:51:32.045 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.047+0000 7f19187cc780 1 < completed delete operation key=KP3WOGIF30PZ tag=MJ36IGR0ZD0L type=del 2024-09-14T10:51:32.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.048+0000 7f19187cc780 1 > prepared operation key=OVOPGTYUF3F3 tag=0YJ8CFG1WIMU type=del size=798901 2024-09-14T10:51:32.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.049+0000 7f19187cc780 1 < canceled part key=_multipart_KP3WOGIF30PZ.2~2HVLN6L1H8X9.0 size=1048576 2024-09-14T10:51:32.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.050+0000 7f19187cc780 1 < completed part key=_multipart_KP3WOGIF30PZ.2~2HVLN6L1H8X9.1 size=1048576 2024-09-14T10:51:32.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.051+0000 7f19187cc780 1 < completed part key=_multipart_KP3WOGIF30PZ.2~2HVLN6L1H8X9.2 size=453518 2024-09-14T10:51:32.052 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.053+0000 7f19187cc780 1 < canceled multipart upload key=KP3WOGIF30PZ upload=2HVLN6L1H8X9 tag=40Y74NEML1TX type=write size=3599246 2024-09-14T10:51:32.055 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.056+0000 7f19187cc780 1 > prepared part key=_multipart_54BSD3DEHNK6.2~O667JGIKRFG3.0 size=1048576 2024-09-14T10:51:32.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.057+0000 7f19187cc780 1 > prepared part key=_multipart_54BSD3DEHNK6.2~O667JGIKRFG3.1 size=219906 2024-09-14T10:51:32.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.057+0000 7f19187cc780 1 > prepared multipart upload key=54BSD3DEHNK6 upload=O667JGIKRFG3 tag=2IA8AX8B3G05 type=write size=2317058 2024-09-14T10:51:32.057 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.059+0000 7f19187cc780 1 < completed delete operation key=KOJ7QB7M6A35 tag=2SQTCWEAX1U1 type=del 2024-09-14T10:51:32.059 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.060+0000 7f19187cc780 1 > prepared operation key=QFEI6H4EQ9ZR tag=W7IXONAOHKVE type=del size=342093 2024-09-14T10:51:32.062 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.064+0000 7f19187cc780 1 < suggested update operation key=B9FQYIX19AEP tag=AYR0DA0NJKWO type=del size=1512116 2024-09-14T10:51:32.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.066+0000 7f19187cc780 1 > prepared part key=_multipart_19P3WE6HKJH2.2~VMGAZN3QV30K.0 size=858067 2024-09-14T10:51:32.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.066+0000 7f19187cc780 1 > prepared multipart upload key=19P3WE6HKJH2 upload=VMGAZN3QV30K tag=U1BOQJJGZXI6 type=write size=1906643 2024-09-14T10:51:32.068 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.070+0000 7f19187cc780 1 < suggested update operation key=KP3WOGIF30PZ tag=31E43V8G6QSH type=del size=1585279 2024-09-14T10:51:32.070 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.071+0000 7f19187cc780 1 > prepared operation key=N0L67LS2KHR1 tag=8BSTDOUV7T8J type=del size=799251 2024-09-14T10:51:32.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.073+0000 7f19187cc780 1 < completed write operation key=IKVYA4KEALFF tag=Z32SR8X4XZBU type=write size=636733 2024-09-14T10:51:32.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.074+0000 7f19187cc780 1 > prepared operation key=RTGE7ISETJWW tag=JUB0J0H90382 type=write size=967274 2024-09-14T10:51:32.074 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.076+0000 7f19187cc780 1 < completed part key=_multipart_19P3WE6HKJH2.2~3M2DQH777Y9O.0 size=1048576 2024-09-14T10:51:32.075 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.077+0000 7f19187cc780 1 < completed part key=_multipart_19P3WE6HKJH2.2~3M2DQH777Y9O.1 size=1048576 2024-09-14T10:51:32.076 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.078+0000 7f19187cc780 1 < completed part key=_multipart_19P3WE6HKJH2.2~3M2DQH777Y9O.2 size=539245 2024-09-14T10:51:32.079 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.080+0000 7f19187cc780 1 < completed multipart upload key=19P3WE6HKJH2 upload=3M2DQH777Y9O tag=YVJXNY9DH1IU type=write size=3684973 2024-09-14T10:51:32.080 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.082+0000 7f19187cc780 1 > prepared operation key=INJQTKXHBUV2 tag=NXH9IJH8XQTD type=del size=1148983 2024-09-14T10:51:32.080 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.082+0000 7f19187cc780 1 < canceled part key=_multipart_OVOPGTYUF3F3.2~CFFRGID64X0O.0 size=333753 2024-09-14T10:51:32.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.084+0000 7f19187cc780 1 < canceled multipart upload key=OVOPGTYUF3F3 upload=CFFRGID64X0O tag=J7MK6JHL1WYM type=write size=1382329 2024-09-14T10:51:32.084 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.086+0000 7f19187cc780 1 > prepared operation key=N0L67LS2KHR1 tag=YW037M2U4JQD type=write size=293314 2024-09-14T10:51:32.084 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.086+0000 7f19187cc780 1 < canceled part key=_multipart_AST81B9QWORT.2~DGBTARPG3T1B.0 size=659365 2024-09-14T10:51:32.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.088+0000 7f19187cc780 1 < canceled multipart upload key=AST81B9QWORT upload=DGBTARPG3T1B tag=75NYJ1WC15FC type=write size=1707941 2024-09-14T10:51:32.089 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.091+0000 7f19187cc780 1 > prepared part key=_multipart_M73CER01XHDY.2~R8H8IK0GKDHI.0 size=284406 2024-09-14T10:51:32.089 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.091+0000 7f19187cc780 1 > prepared multipart upload key=M73CER01XHDY upload=R8H8IK0GKDHI tag=GRT160U0VD8H type=write size=1332982 2024-09-14T10:51:32.090 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.092+0000 7f19187cc780 1 < completed part key=_multipart_M73CER01XHDY.2~K8182S2IP5UE.0 size=1048576 2024-09-14T10:51:32.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.093+0000 7f19187cc780 1 < completed part key=_multipart_M73CER01XHDY.2~K8182S2IP5UE.1 size=1048576 2024-09-14T10:51:32.093 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.094+0000 7f19187cc780 1 < completed part key=_multipart_M73CER01XHDY.2~K8182S2IP5UE.2 size=401668 2024-09-14T10:51:32.095 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.096+0000 7f19187cc780 1 < completed multipart upload key=M73CER01XHDY upload=K8182S2IP5UE tag=CDOFFV0FAWNG type=write size=3547396 2024-09-14T10:51:32.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.098+0000 7f19187cc780 1 > prepared operation key=INJQTKXHBUV2 tag=KDY7B0A7IPML type=write size=428058 2024-09-14T10:51:32.098 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.100+0000 7f19187cc780 1 < completed part key=_multipart_5AIAYJMRZGFQ.2~YMEPMYC4RHD6.0 size=1048576 2024-09-14T10:51:32.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.101+0000 7f19187cc780 1 < completed part key=_multipart_5AIAYJMRZGFQ.2~YMEPMYC4RHD6.1 size=1048576 2024-09-14T10:51:32.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.102+0000 7f19187cc780 1 < completed part key=_multipart_5AIAYJMRZGFQ.2~YMEPMYC4RHD6.2 size=559910 2024-09-14T10:51:32.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.104+0000 7f19187cc780 1 < completed multipart upload key=5AIAYJMRZGFQ upload=YMEPMYC4RHD6 tag=UMENYDY6YNIF type=write size=3705638 2024-09-14T10:51:32.104 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.106+0000 7f19187cc780 1 > prepared operation key=B9FQYIX19AEP tag=KK3ICY59RCCR type=write size=367555 2024-09-14T10:51:32.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.107+0000 7f19187cc780 1 < completed part key=_multipart_XCVE2F2JJK4X.2~E2X3GF0D33GN.0 size=1048576 2024-09-14T10:51:32.107 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.108+0000 7f19187cc780 1 < completed part key=_multipart_XCVE2F2JJK4X.2~E2X3GF0D33GN.1 size=457682 2024-09-14T10:51:32.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.110+0000 7f19187cc780 1 < completed multipart upload key=XCVE2F2JJK4X upload=E2X3GF0D33GN tag=I3M6VI2ZXDYC type=write size=2554834 2024-09-14T10:51:32.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.113+0000 7f19187cc780 1 > prepared part key=_multipart_E6UO1LUWOC44.2~924MA1O7SZ3H.0 size=1048576 2024-09-14T10:51:32.112 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.114+0000 7f19187cc780 1 > prepared part key=_multipart_E6UO1LUWOC44.2~924MA1O7SZ3H.1 size=21682 2024-09-14T10:51:32.112 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.114+0000 7f19187cc780 1 > prepared multipart upload key=E6UO1LUWOC44 upload=924MA1O7SZ3H tag=XWCPOG5TWQBI type=write size=2118834 2024-09-14T10:51:32.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.115+0000 7f19187cc780 1 < completed delete operation key=H40763V7HMBC tag=7D5079F3PIXV type=del 2024-09-14T10:51:32.115 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.117+0000 7f19187cc780 1 > prepared operation key=CADC2BY888V1 tag=4O4XTUIPEHEV type=del size=3445097 2024-09-14T10:51:32.117 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.118+0000 7f19187cc780 1 < completed write operation key=5AIAYJMRZGFQ tag=5N8I5CC8JNYI type=write size=954635 2024-09-14T10:51:32.120 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.121+0000 7f19187cc780 1 > prepared part key=_multipart_QFEI6H4EQ9ZR.2~ITTAY5AN79QR.0 size=1048576 2024-09-14T10:51:32.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.123+0000 7f19187cc780 1 > prepared part key=_multipart_QFEI6H4EQ9ZR.2~ITTAY5AN79QR.1 size=1041595 2024-09-14T10:51:32.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.123+0000 7f19187cc780 1 > prepared multipart upload key=QFEI6H4EQ9ZR upload=ITTAY5AN79QR tag=X1C6Z9EICYDI type=write size=3138747 2024-09-14T10:51:32.122 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.124+0000 7f19187cc780 -1 < failed to complete operation key=B9FQYIX19AEP tag=0WNJS4F4R1UD type=del size=1056430: (22) Invalid argument 2024-09-14T10:51:32.124 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.126+0000 7f19187cc780 1 > prepared operation key=5AIAYJMRZGFQ tag=LAGLX5IE6KK4 type=del size=4088072 2024-09-14T10:51:32.126 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.127+0000 7f19187cc780 1 < completed part key=_multipart_9EBD5ZT6MT45.2~1G8XH1H70OXT.0 size=1048576 2024-09-14T10:51:32.127 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.129+0000 7f19187cc780 1 < completed part key=_multipart_9EBD5ZT6MT45.2~1G8XH1H70OXT.1 size=979589 2024-09-14T10:51:32.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.131+0000 7f19187cc780 1 < completed multipart upload key=9EBD5ZT6MT45 upload=1G8XH1H70OXT tag=B4EF2F9KCD94 type=write size=3076741 2024-09-14T10:51:32.131 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.133+0000 7f19187cc780 1 > prepared operation key=AGNUE76X8XCJ tag=JC3ZR6Y4ZXL9 type=del size=2453483 2024-09-14T10:51:32.134 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.136+0000 7f19187cc780 1 < suggested update operation key=OVOPGTYUF3F3 tag=0YJ8CFG1WIMU type=del size=798901 2024-09-14T10:51:32.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.137+0000 7f19187cc780 1 > prepared operation key=VW6U36JN2DBX tag=EBZ7VLFE4URK type=del size=4014833 2024-09-14T10:51:32.137 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.139+0000 7f19187cc780 1 < completed part key=_multipart_54BSD3DEHNK6.2~O667JGIKRFG3.0 size=1048576 2024-09-14T10:51:32.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.140+0000 7f19187cc780 1 < completed part key=_multipart_54BSD3DEHNK6.2~O667JGIKRFG3.1 size=219906 2024-09-14T10:51:32.140 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.142+0000 7f19187cc780 1 < completed multipart upload key=54BSD3DEHNK6 upload=O667JGIKRFG3 tag=2IA8AX8B3G05 type=write size=2317058 2024-09-14T10:51:32.142 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.144+0000 7f19187cc780 1 > prepared operation key=QBMNYNWOLK4I tag=SL71BLGW91SJ type=del size=3903116 2024-09-14T10:51:32.144 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.145+0000 7f19187cc780 1 < completed delete operation key=QFEI6H4EQ9ZR tag=W7IXONAOHKVE type=del 2024-09-14T10:51:32.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.147+0000 7f19187cc780 1 > prepared operation key=EZLSMEK89N2G tag=QZYUT1CAIS5S type=del size=3585745 2024-09-14T10:51:32.148 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.150+0000 7f19187cc780 1 < completed part key=_multipart_19P3WE6HKJH2.2~VMGAZN3QV30K.0 size=858067 2024-09-14T10:51:32.150 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.152+0000 7f19187cc780 1 < completed multipart upload key=19P3WE6HKJH2 upload=VMGAZN3QV30K tag=U1BOQJJGZXI6 type=write size=1906643 2024-09-14T10:51:32.152 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.154+0000 7f19187cc780 1 > prepared operation key=6BNN842ZTWG5 tag=30XXIHI3Z1W3 type=write size=455428 2024-09-14T10:51:32.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.155+0000 7f19187cc780 1 < completed delete operation key=N0L67LS2KHR1 tag=8BSTDOUV7T8J type=del 2024-09-14T10:51:32.155 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.157+0000 7f19187cc780 1 > prepared operation key=INJQTKXHBUV2 tag=PRX1BF36UKYT type=del size=3411410 2024-09-14T10:51:32.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.160+0000 7f19187cc780 1 < suggested update operation key=RTGE7ISETJWW tag=JUB0J0H90382 type=write size=967274 2024-09-14T10:51:32.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.162+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~PZ4VAMN8D4FR.0 size=1048576 2024-09-14T10:51:32.162 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.164+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~PZ4VAMN8D4FR.1 size=1048576 2024-09-14T10:51:32.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.165+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~PZ4VAMN8D4FR.2 size=807031 2024-09-14T10:51:32.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.165+0000 7f19187cc780 1 > prepared multipart upload key=IKVYA4KEALFF upload=PZ4VAMN8D4FR tag=PI2X9U014059 type=write size=3952759 2024-09-14T10:51:32.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.167+0000 7f19187cc780 1 < suggested update operation key=INJQTKXHBUV2 tag=NXH9IJH8XQTD type=del size=1148983 2024-09-14T10:51:32.168 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.169+0000 7f19187cc780 1 > prepared operation key=EZLSMEK89N2G tag=I2S27HC04WXY type=write size=945564 2024-09-14T10:51:32.169 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.171+0000 7f19187cc780 1 < completed write operation key=N0L67LS2KHR1 tag=YW037M2U4JQD type=write size=293314 2024-09-14T10:51:32.171 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.173+0000 7f19187cc780 1 > prepared part key=_multipart_EL00Y4Z7DTAT.2~HLMMDQSEIJ5T.0 size=1048576 2024-09-14T10:51:32.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.174+0000 7f19187cc780 1 > prepared part key=_multipart_EL00Y4Z7DTAT.2~HLMMDQSEIJ5T.1 size=56897 2024-09-14T10:51:32.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.174+0000 7f19187cc780 1 > prepared multipart upload key=EL00Y4Z7DTAT upload=HLMMDQSEIJ5T tag=9R3M9G08TF30 type=write size=2154049 2024-09-14T10:51:32.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.176+0000 7f19187cc780 1 < completed part key=_multipart_M73CER01XHDY.2~R8H8IK0GKDHI.0 size=284406 2024-09-14T10:51:32.176 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.178+0000 7f19187cc780 1 < completed multipart upload key=M73CER01XHDY upload=R8H8IK0GKDHI tag=GRT160U0VD8H type=write size=1332982 2024-09-14T10:51:32.178 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.179+0000 7f19187cc780 1 > prepared operation key=KP3WOGIF30PZ tag=5P0OEFDJZU0E type=del size=2607816 2024-09-14T10:51:32.179 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.181+0000 7f19187cc780 -1 < failed to complete operation key=INJQTKXHBUV2 tag=KDY7B0A7IPML type=write size=428058: (22) Invalid argument 2024-09-14T10:51:32.181 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.182+0000 7f19187cc780 1 > prepared operation key=N0L67LS2KHR1 tag=I9DAIOR1POWW type=write size=212606 2024-09-14T10:51:32.183 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.185+0000 7f19187cc780 1 < suggested remove operation key=B9FQYIX19AEP tag=KK3ICY59RCCR type=write 2024-09-14T10:51:32.184 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.186+0000 7f19187cc780 1 > prepared operation key=54BSD3DEHNK6 tag=3F52EWMGWN75 type=del size=880239 2024-09-14T10:51:32.186 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.187+0000 7f19187cc780 1 < completed part key=_multipart_E6UO1LUWOC44.2~924MA1O7SZ3H.0 size=1048576 2024-09-14T10:51:32.187 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.189+0000 7f19187cc780 1 < completed part key=_multipart_E6UO1LUWOC44.2~924MA1O7SZ3H.1 size=21682 2024-09-14T10:51:32.189 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.191+0000 7f19187cc780 1 < completed multipart upload key=E6UO1LUWOC44 upload=924MA1O7SZ3H tag=XWCPOG5TWQBI type=write size=2118834 2024-09-14T10:51:32.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.192+0000 7f19187cc780 1 > prepared operation key=6BNN842ZTWG5 tag=BAAPW7WBRBWQ type=del size=954238 2024-09-14T10:51:32.193 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.195+0000 7f19187cc780 1 < suggested remove operation key=CADC2BY888V1 tag=4O4XTUIPEHEV type=del 2024-09-14T10:51:32.194 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.196+0000 7f19187cc780 1 > prepared operation key=EL00Y4Z7DTAT tag=MEQKJKVO9UAY type=del size=1787163 2024-09-14T10:51:32.196 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.197+0000 7f19187cc780 1 < completed part key=_multipart_QFEI6H4EQ9ZR.2~ITTAY5AN79QR.0 size=1048576 2024-09-14T10:51:32.197 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.199+0000 7f19187cc780 1 < completed part key=_multipart_QFEI6H4EQ9ZR.2~ITTAY5AN79QR.1 size=1041595 2024-09-14T10:51:32.199 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.201+0000 7f19187cc780 1 < completed multipart upload key=QFEI6H4EQ9ZR upload=ITTAY5AN79QR tag=X1C6Z9EICYDI type=write size=3138747 2024-09-14T10:51:32.201 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.202+0000 7f19187cc780 1 > prepared operation key=IKVYA4KEALFF tag=49PBBM3O5UZV type=del size=601556 2024-09-14T10:51:32.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.204+0000 7f19187cc780 1 < completed delete operation key=5AIAYJMRZGFQ tag=LAGLX5IE6KK4 type=del 2024-09-14T10:51:32.204 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.205+0000 7f19187cc780 1 > prepared operation key=QFEI6H4EQ9ZR tag=YYRGLU1IALS3 type=write size=161243 2024-09-14T10:51:32.205 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.207+0000 7f19187cc780 1 < completed delete operation key=AGNUE76X8XCJ tag=JC3ZR6Y4ZXL9 type=del 2024-09-14T10:51:32.207 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.209+0000 7f19187cc780 1 > prepared part key=_multipart_AST81B9QWORT.2~WZ1KD0NAD19I.0 size=1048576 2024-09-14T10:51:32.209 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.210+0000 7f19187cc780 1 > prepared part key=_multipart_AST81B9QWORT.2~WZ1KD0NAD19I.1 size=220131 2024-09-14T10:51:32.209 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.210+0000 7f19187cc780 1 > prepared multipart upload key=AST81B9QWORT upload=WZ1KD0NAD19I tag=CTLTWGIJW98E type=write size=2317283 2024-09-14T10:51:32.210 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.212+0000 7f19187cc780 1 < completed delete operation key=VW6U36JN2DBX tag=EBZ7VLFE4URK type=del 2024-09-14T10:51:32.212 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.213+0000 7f19187cc780 1 > prepared operation key=QFEI6H4EQ9ZR tag=J9HCGM61YRNW type=del size=2990450 2024-09-14T10:51:32.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.215+0000 7f19187cc780 1 < completed delete operation key=QBMNYNWOLK4I tag=SL71BLGW91SJ type=del 2024-09-14T10:51:32.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.216+0000 7f19187cc780 1 > prepared operation key=61O2VU0SB379 tag=FRNKGK1C0G12 type=del size=3288898 2024-09-14T10:51:32.217 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.219+0000 7f19187cc780 1 < suggested remove operation key=EZLSMEK89N2G tag=QZYUT1CAIS5S type=del 2024-09-14T10:51:32.218 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.220+0000 7f19187cc780 1 > prepared operation key=XCVE2F2JJK4X tag=P4UGFHEL0Z5G type=del size=61395 2024-09-14T10:51:32.220 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.221+0000 7f19187cc780 1 < completed write operation key=6BNN842ZTWG5 tag=30XXIHI3Z1W3 type=write size=455428 2024-09-14T10:51:32.221 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.223+0000 7f19187cc780 1 > prepared operation key=VW6U36JN2DBX tag=2MIH6OG6RIQR type=del size=3035973 2024-09-14T10:51:32.222 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.224+0000 7f19187cc780 -1 < failed to complete operation key=INJQTKXHBUV2 tag=PRX1BF36UKYT type=del size=3411410: (22) Invalid argument 2024-09-14T10:51:32.224 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.225+0000 7f19187cc780 1 > prepared operation key=EL00Y4Z7DTAT tag=D3BX4JFL0L14 type=write size=37050 2024-09-14T10:51:32.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.227+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~PZ4VAMN8D4FR.0 size=1048576 2024-09-14T10:51:32.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.228+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~PZ4VAMN8D4FR.1 size=1048576 2024-09-14T10:51:32.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.229+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~PZ4VAMN8D4FR.2 size=807031 2024-09-14T10:51:32.230 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.231+0000 7f19187cc780 1 < completed multipart upload key=IKVYA4KEALFF upload=PZ4VAMN8D4FR tag=PI2X9U014059 type=write size=3952759 2024-09-14T10:51:32.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.234+0000 7f19187cc780 1 > prepared part key=_multipart_AST81B9QWORT.2~3OZI0WDGUDNX.0 size=1048576 2024-09-14T10:51:32.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.235+0000 7f19187cc780 1 > prepared part key=_multipart_AST81B9QWORT.2~3OZI0WDGUDNX.1 size=307084 2024-09-14T10:51:32.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.235+0000 7f19187cc780 1 > prepared multipart upload key=AST81B9QWORT upload=3OZI0WDGUDNX tag=TBX34807CJV2 type=write size=2404236 2024-09-14T10:51:32.234 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.235+0000 7f19187cc780 -1 < no bi entry to suggest for operation key=EZLSMEK89N2G tag=I2S27HC04WXY type=write size=945564: (2) No such file or directory 2024-09-14T10:51:32.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.237+0000 7f19187cc780 1 > prepared operation key=QFEI6H4EQ9ZR tag=9YXAD8NA2SVQ type=del size=1490242 2024-09-14T10:51:32.237 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.238+0000 7f19187cc780 1 < completed part key=_multipart_EL00Y4Z7DTAT.2~HLMMDQSEIJ5T.0 size=1048576 2024-09-14T10:51:32.238 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.239+0000 7f19187cc780 1 < completed part key=_multipart_EL00Y4Z7DTAT.2~HLMMDQSEIJ5T.1 size=56897 2024-09-14T10:51:32.240 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.242+0000 7f19187cc780 1 < completed multipart upload key=EL00Y4Z7DTAT upload=HLMMDQSEIJ5T tag=9R3M9G08TF30 type=write size=2154049 2024-09-14T10:51:32.242 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.243+0000 7f19187cc780 1 > prepared operation key=RTGE7ISETJWW tag=4UMISQIAUTA8 type=del size=1332207 2024-09-14T10:51:32.243 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.245+0000 7f19187cc780 1 < completed delete operation key=KP3WOGIF30PZ tag=5P0OEFDJZU0E type=del 2024-09-14T10:51:32.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.246+0000 7f19187cc780 1 > prepared operation key=H40763V7HMBC tag=PRTO2QZWU9W9 type=del size=2636053 2024-09-14T10:51:32.247 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.249+0000 7f19187cc780 1 < suggested remove operation key=N0L67LS2KHR1 tag=I9DAIOR1POWW type=write 2024-09-14T10:51:32.248 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.250+0000 7f19187cc780 1 > prepared operation key=EZLSMEK89N2G tag=EIG9GPRHB56C type=del size=692817 2024-09-14T10:51:32.250 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.252+0000 7f19187cc780 1 < completed delete operation key=54BSD3DEHNK6 tag=3F52EWMGWN75 type=del 2024-09-14T10:51:32.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.253+0000 7f19187cc780 1 > prepared operation key=MFA30GSMCSKP tag=US8SC8FH6C0W type=del size=2774650 2024-09-14T10:51:32.253 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.255+0000 7f19187cc780 1 < completed delete operation key=6BNN842ZTWG5 tag=BAAPW7WBRBWQ type=del 2024-09-14T10:51:32.255 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.256+0000 7f19187cc780 1 > prepared operation key=KOJ7QB7M6A35 tag=E1F1NNN0G4NS type=del size=1549485 2024-09-14T10:51:32.256 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.258+0000 7f19187cc780 1 < completed delete operation key=EL00Y4Z7DTAT tag=MEQKJKVO9UAY type=del 2024-09-14T10:51:32.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.259+0000 7f19187cc780 1 > prepared operation key=AGNUE76X8XCJ tag=6NGEHWRYFNKK type=del size=613533 2024-09-14T10:51:32.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.261+0000 7f19187cc780 1 < completed delete operation key=IKVYA4KEALFF tag=49PBBM3O5UZV type=del 2024-09-14T10:51:32.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.262+0000 7f19187cc780 1 > prepared operation key=RTGE7ISETJWW tag=3YE7G2TTNLLF type=del size=3468198 2024-09-14T10:51:32.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.265+0000 7f19187cc780 1 < suggested remove operation key=QFEI6H4EQ9ZR tag=YYRGLU1IALS3 type=write 2024-09-14T10:51:32.264 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.266+0000 7f19187cc780 1 > prepared operation key=QBMNYNWOLK4I tag=ZTVW0S2CN99W type=write size=779211 2024-09-14T10:51:32.266 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.267+0000 7f19187cc780 1 < completed part key=_multipart_AST81B9QWORT.2~WZ1KD0NAD19I.0 size=1048576 2024-09-14T10:51:32.267 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.269+0000 7f19187cc780 1 < completed part key=_multipart_AST81B9QWORT.2~WZ1KD0NAD19I.1 size=220131 2024-09-14T10:51:32.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.271+0000 7f19187cc780 1 < completed multipart upload key=AST81B9QWORT upload=WZ1KD0NAD19I tag=CTLTWGIJW98E type=write size=2317283 2024-09-14T10:51:32.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.272+0000 7f19187cc780 1 > prepared operation key=KOJ7QB7M6A35 tag=CICMJF8DGOCJ type=del size=1309259 2024-09-14T10:51:32.272 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.274+0000 7f19187cc780 -1 < failed to complete operation key=QFEI6H4EQ9ZR tag=J9HCGM61YRNW type=del size=2990450: (22) Invalid argument 2024-09-14T10:51:32.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.276+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~R166F1NK8SIA.0 size=744011 2024-09-14T10:51:32.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.276+0000 7f19187cc780 1 > prepared multipart upload key=OVOPGTYUF3F3 upload=R166F1NK8SIA tag=MWJC4R8EN140 type=write size=1792587 2024-09-14T10:51:32.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.278+0000 7f19187cc780 1 < canceled operation key=61O2VU0SB379 tag=FRNKGK1C0G12 type=del size=3288898 2024-09-14T10:51:32.279 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.280+0000 7f19187cc780 1 > prepared part key=_multipart_E6UO1LUWOC44.2~7EIE0MOQ4DWV.0 size=67788 2024-09-14T10:51:32.279 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.280+0000 7f19187cc780 1 > prepared multipart upload key=E6UO1LUWOC44 upload=7EIE0MOQ4DWV tag=CS4YEMDF8MIE type=write size=1116364 2024-09-14T10:51:32.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.282+0000 7f19187cc780 1 < completed delete operation key=XCVE2F2JJK4X tag=P4UGFHEL0Z5G type=del 2024-09-14T10:51:32.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.284+0000 7f19187cc780 1 > prepared operation key=YA3DI7N4DG5K tag=OOG7YXOHBDRZ type=del size=3510607 2024-09-14T10:51:32.284 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.286+0000 7f19187cc780 1 < completed delete operation key=VW6U36JN2DBX tag=2MIH6OG6RIQR type=del 2024-09-14T10:51:32.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.287+0000 7f19187cc780 1 > prepared operation key=75O00VMLJJ1X tag=M23IRQESOYMB type=del size=3878718 2024-09-14T10:51:32.287 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.289+0000 7f19187cc780 1 < canceled operation key=EL00Y4Z7DTAT tag=D3BX4JFL0L14 type=write size=37050 2024-09-14T10:51:32.288 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.290+0000 7f19187cc780 1 > prepared operation key=H40763V7HMBC tag=IJ7T6F7NNTY8 type=del size=452718 2024-09-14T10:51:32.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.291+0000 7f19187cc780 1 < completed part key=_multipart_AST81B9QWORT.2~3OZI0WDGUDNX.0 size=1048576 2024-09-14T10:51:32.290 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.292+0000 7f19187cc780 1 < completed part key=_multipart_AST81B9QWORT.2~3OZI0WDGUDNX.1 size=307084 2024-09-14T10:51:32.293 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.294+0000 7f19187cc780 1 < completed multipart upload key=AST81B9QWORT upload=3OZI0WDGUDNX tag=TBX34807CJV2 type=write size=2404236 2024-09-14T10:51:32.294 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.296+0000 7f19187cc780 1 > prepared operation key=7IWUW2HC3ULI tag=WDFZDSI9JBMT type=del size=336404 2024-09-14T10:51:32.295 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.297+0000 7f19187cc780 -1 < failed to complete operation key=QFEI6H4EQ9ZR tag=9YXAD8NA2SVQ type=del size=1490242: (22) Invalid argument 2024-09-14T10:51:32.297 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.298+0000 7f19187cc780 1 > prepared operation key=9EBD5ZT6MT45 tag=0ATN90FL6JWX type=del size=38884 2024-09-14T10:51:32.298 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.300+0000 7f19187cc780 1 < completed delete operation key=RTGE7ISETJWW tag=4UMISQIAUTA8 type=del 2024-09-14T10:51:32.300 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.301+0000 7f19187cc780 1 > prepared operation key=EL00Y4Z7DTAT tag=F9Y3C7HQRF4X type=del size=1294901 2024-09-14T10:51:32.302 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.303+0000 7f19187cc780 1 < completed delete operation key=H40763V7HMBC tag=PRTO2QZWU9W9 type=del 2024-09-14T10:51:32.303 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.305+0000 7f19187cc780 1 > prepared operation key=54BSD3DEHNK6 tag=5478JCPXG0NV type=del size=924352 2024-09-14T10:51:32.304 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.306+0000 7f19187cc780 1 < completed delete operation key=EZLSMEK89N2G tag=EIG9GPRHB56C type=del 2024-09-14T10:51:32.307 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.308+0000 7f19187cc780 1 > prepared part key=_multipart_INJQTKXHBUV2.2~Z4WV29J1KRPE.0 size=574313 2024-09-14T10:51:32.307 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.308+0000 7f19187cc780 1 > prepared multipart upload key=INJQTKXHBUV2 upload=Z4WV29J1KRPE tag=TPIWX0J4JWUX type=write size=1622889 2024-09-14T10:51:32.308 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.310+0000 7f19187cc780 1 < completed delete operation key=MFA30GSMCSKP tag=US8SC8FH6C0W type=del 2024-09-14T10:51:32.309 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.311+0000 7f19187cc780 1 > prepared operation key=VW6U36JN2DBX tag=I0T9CE782655 type=del size=2146668 2024-09-14T10:51:32.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.314+0000 7f19187cc780 1 < suggested update operation key=KOJ7QB7M6A35 tag=E1F1NNN0G4NS type=del size=1549485 2024-09-14T10:51:32.314 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.315+0000 7f19187cc780 1 > prepared operation key=N0L67LS2KHR1 tag=JW0OY3JWGWCV type=write size=566134 2024-09-14T10:51:32.317 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.318+0000 7f19187cc780 1 < suggested update operation key=AGNUE76X8XCJ tag=6NGEHWRYFNKK type=del size=613533 2024-09-14T10:51:32.318 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.319+0000 7f19187cc780 1 > prepared operation key=9EBD5ZT6MT45 tag=KLI1ST897XHM type=del size=738643 2024-09-14T10:51:32.319 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.321+0000 7f19187cc780 1 < canceled operation key=RTGE7ISETJWW tag=3YE7G2TTNLLF type=del size=3468198 2024-09-14T10:51:32.320 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.322+0000 7f19187cc780 1 > prepared operation key=VW6U36JN2DBX tag=67UZVF4EPY12 type=del size=1402386 2024-09-14T10:51:32.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.324+0000 7f19187cc780 1 < completed write operation key=QBMNYNWOLK4I tag=ZTVW0S2CN99W type=write size=779211 2024-09-14T10:51:32.323 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.325+0000 7f19187cc780 1 > prepared operation key=E6UO1LUWOC44 tag=MZ34YWN2H21G type=del size=3198108 2024-09-14T10:51:32.326 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.328+0000 7f19187cc780 1 < suggested update operation key=KOJ7QB7M6A35 tag=CICMJF8DGOCJ type=del size=1309259 2024-09-14T10:51:32.329 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.330+0000 7f19187cc780 1 > prepared part key=_multipart_CADC2BY888V1.2~EADMD2TGD9JR.0 size=748736 2024-09-14T10:51:32.329 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.330+0000 7f19187cc780 1 > prepared multipart upload key=CADC2BY888V1 upload=EADMD2TGD9JR tag=0N04NA6JYVDF type=write size=1797312 2024-09-14T10:51:32.330 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.332+0000 7f19187cc780 1 < completed part key=_multipart_OVOPGTYUF3F3.2~R166F1NK8SIA.0 size=744011 2024-09-14T10:51:32.332 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.334+0000 7f19187cc780 1 < completed multipart upload key=OVOPGTYUF3F3 upload=R166F1NK8SIA tag=MWJC4R8EN140 type=write size=1792587 2024-09-14T10:51:32.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.335+0000 7f19187cc780 1 > prepared operation key=5AIAYJMRZGFQ tag=T5U0HAVYHWVI type=del size=1934073 2024-09-14T10:51:32.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.337+0000 7f19187cc780 1 < completed part key=_multipart_E6UO1LUWOC44.2~7EIE0MOQ4DWV.0 size=67788 2024-09-14T10:51:32.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.339+0000 7f19187cc780 1 < completed multipart upload key=E6UO1LUWOC44 upload=7EIE0MOQ4DWV tag=CS4YEMDF8MIE type=write size=1116364 2024-09-14T10:51:32.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.340+0000 7f19187cc780 1 > prepared operation key=7IWUW2HC3ULI tag=ONR4UVA597ET type=del size=337669 2024-09-14T10:51:32.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.342+0000 7f19187cc780 1 < completed delete operation key=YA3DI7N4DG5K tag=OOG7YXOHBDRZ type=del 2024-09-14T10:51:32.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.343+0000 7f19187cc780 1 > prepared operation key=N0L67LS2KHR1 tag=UDY3BUO8BLHG type=del size=3390308 2024-09-14T10:51:32.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.344+0000 7f19187cc780 1 < completed delete operation key=75O00VMLJJ1X tag=M23IRQESOYMB type=del 2024-09-14T10:51:32.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.346+0000 7f19187cc780 1 > prepared operation key=CADC2BY888V1 tag=6JLB05U590ES type=del size=174106 2024-09-14T10:51:32.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.348+0000 7f19187cc780 1 < suggested remove operation key=H40763V7HMBC tag=IJ7T6F7NNTY8 type=del 2024-09-14T10:51:32.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.351+0000 7f19187cc780 1 > prepared part key=_multipart_75O00VMLJJ1X.2~RFWJL8LVIAGF.0 size=1048576 2024-09-14T10:51:32.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.352+0000 7f19187cc780 1 > prepared part key=_multipart_75O00VMLJJ1X.2~RFWJL8LVIAGF.1 size=1048576 2024-09-14T10:51:32.352 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.353+0000 7f19187cc780 1 > prepared part key=_multipart_75O00VMLJJ1X.2~RFWJL8LVIAGF.2 size=881844 2024-09-14T10:51:32.352 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.353+0000 7f19187cc780 1 > prepared multipart upload key=75O00VMLJJ1X upload=RFWJL8LVIAGF tag=088JTZUSSHBO type=write size=4027572 2024-09-14T10:51:32.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.355+0000 7f19187cc780 1 < completed delete operation key=7IWUW2HC3ULI tag=WDFZDSI9JBMT type=del 2024-09-14T10:51:32.355 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.357+0000 7f19187cc780 1 > prepared operation key=EL00Y4Z7DTAT tag=7MZK2WGM19IA type=write size=594985 2024-09-14T10:51:32.357 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.358+0000 7f19187cc780 1 < completed delete operation key=9EBD5ZT6MT45 tag=0ATN90FL6JWX type=del 2024-09-14T10:51:32.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.361+0000 7f19187cc780 1 > prepared part key=_multipart_75O00VMLJJ1X.2~7VNGGVK318ZF.0 size=1048576 2024-09-14T10:51:32.361 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.362+0000 7f19187cc780 1 > prepared part key=_multipart_75O00VMLJJ1X.2~7VNGGVK318ZF.1 size=1048576 2024-09-14T10:51:32.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.363+0000 7f19187cc780 1 > prepared part key=_multipart_75O00VMLJJ1X.2~7VNGGVK318ZF.2 size=808786 2024-09-14T10:51:32.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.363+0000 7f19187cc780 1 > prepared multipart upload key=75O00VMLJJ1X upload=7VNGGVK318ZF tag=1M89I3ORAYO0 type=write size=3954514 2024-09-14T10:51:32.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.367+0000 7f19187cc780 1 < suggested update operation key=EL00Y4Z7DTAT tag=F9Y3C7HQRF4X type=del size=1294901 2024-09-14T10:51:32.368 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.369+0000 7f19187cc780 1 > prepared part key=_multipart_EZLSMEK89N2G.2~QMSYY0IR0H9A.0 size=1048576 2024-09-14T10:51:32.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.371+0000 7f19187cc780 1 > prepared part key=_multipart_EZLSMEK89N2G.2~QMSYY0IR0H9A.1 size=376781 2024-09-14T10:51:32.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.371+0000 7f19187cc780 1 > prepared multipart upload key=EZLSMEK89N2G upload=QMSYY0IR0H9A tag=31T0XWYKKA62 type=write size=2473933 2024-09-14T10:51:32.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.372+0000 7f19187cc780 1 < completed delete operation key=54BSD3DEHNK6 tag=5478JCPXG0NV type=del 2024-09-14T10:51:32.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.375+0000 7f19187cc780 1 > prepared part key=_multipart_QBMNYNWOLK4I.2~NJCS2Y78JBMF.0 size=338840 2024-09-14T10:51:32.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.375+0000 7f19187cc780 1 > prepared multipart upload key=QBMNYNWOLK4I upload=NJCS2Y78JBMF tag=CEG2YKRZAUKY type=write size=1387416 2024-09-14T10:51:32.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.377+0000 7f19187cc780 1 < completed part key=_multipart_INJQTKXHBUV2.2~Z4WV29J1KRPE.0 size=574313 2024-09-14T10:51:32.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.380+0000 7f19187cc780 1 < completed multipart upload key=INJQTKXHBUV2 upload=Z4WV29J1KRPE tag=TPIWX0J4JWUX type=write size=1622889 2024-09-14T10:51:32.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.383+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~01UK1AUXW35Z.0 size=1048576 2024-09-14T10:51:32.382 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.384+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~01UK1AUXW35Z.1 size=1048576 2024-09-14T10:51:32.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.385+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~01UK1AUXW35Z.2 size=259194 2024-09-14T10:51:32.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.385+0000 7f19187cc780 1 > prepared multipart upload key=KOJ7QB7M6A35 upload=01UK1AUXW35Z tag=BFC58HIJJRLJ type=write size=3404922 2024-09-14T10:51:32.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.388+0000 7f19187cc780 1 < suggested remove operation key=VW6U36JN2DBX tag=I0T9CE782655 type=del 2024-09-14T10:51:32.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.391+0000 7f19187cc780 1 > prepared part key=_multipart_CADC2BY888V1.2~V4XVCVARA3OK.0 size=658921 2024-09-14T10:51:32.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.391+0000 7f19187cc780 1 > prepared multipart upload key=CADC2BY888V1 upload=V4XVCVARA3OK tag=FX50HHCFVQKG type=write size=1707497 2024-09-14T10:51:32.391 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.392+0000 7f19187cc780 1 < completed write operation key=N0L67LS2KHR1 tag=JW0OY3JWGWCV type=write size=566134 2024-09-14T10:51:32.392 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.394+0000 7f19187cc780 1 > prepared operation key=6BNN842ZTWG5 tag=5R0E3FBNMM9Y type=del size=4017509 2024-09-14T10:51:32.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.397+0000 7f19187cc780 1 < suggested update operation key=9EBD5ZT6MT45 tag=KLI1ST897XHM type=del size=738643 2024-09-14T10:51:32.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.400+0000 7f19187cc780 1 > prepared part key=_multipart_617QQI921HB4.2~1NGQM1PDPYEV.0 size=202710 2024-09-14T10:51:32.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.400+0000 7f19187cc780 1 > prepared multipart upload key=617QQI921HB4 upload=1NGQM1PDPYEV tag=P4FO9ZWRXUFC type=write size=1251286 2024-09-14T10:51:32.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.401+0000 7f19187cc780 -1 < no bi entry to suggest for operation key=VW6U36JN2DBX tag=67UZVF4EPY12 type=del size=1402386: (2) No such file or directory 2024-09-14T10:51:32.403 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.404+0000 7f19187cc780 1 > prepared part key=_multipart_M73CER01XHDY.2~TWIIAZUKB56V.0 size=596171 2024-09-14T10:51:32.403 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.404+0000 7f19187cc780 1 > prepared multipart upload key=M73CER01XHDY upload=TWIIAZUKB56V tag=NWHFYTMUJ4IM type=write size=1644747 2024-09-14T10:51:32.404 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.406+0000 7f19187cc780 1 < completed delete operation key=E6UO1LUWOC44 tag=MZ34YWN2H21G type=del 2024-09-14T10:51:32.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.409+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~0V9R28TN857V.0 size=1048576 2024-09-14T10:51:32.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.410+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~0V9R28TN857V.1 size=338168 2024-09-14T10:51:32.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.410+0000 7f19187cc780 1 > prepared multipart upload key=XCVE2F2JJK4X upload=0V9R28TN857V tag=85SKXCPCJ132 type=write size=2435320 2024-09-14T10:51:32.410 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.412+0000 7f19187cc780 1 < completed part key=_multipart_CADC2BY888V1.2~EADMD2TGD9JR.0 size=748736 2024-09-14T10:51:32.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.414+0000 7f19187cc780 1 < completed multipart upload key=CADC2BY888V1 upload=EADMD2TGD9JR tag=0N04NA6JYVDF type=write size=1797312 2024-09-14T10:51:32.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.417+0000 7f19187cc780 1 > prepared part key=_multipart_QFEI6H4EQ9ZR.2~9PI0NEQHYV91.0 size=1048576 2024-09-14T10:51:32.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.418+0000 7f19187cc780 1 > prepared part key=_multipart_QFEI6H4EQ9ZR.2~9PI0NEQHYV91.1 size=70778 2024-09-14T10:51:32.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.418+0000 7f19187cc780 1 > prepared multipart upload key=QFEI6H4EQ9ZR upload=9PI0NEQHYV91 tag=7XYFDMK5DUXS type=write size=2167930 2024-09-14T10:51:32.419 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.421+0000 7f19187cc780 1 < suggested update operation key=5AIAYJMRZGFQ tag=T5U0HAVYHWVI type=del size=1934073 2024-09-14T10:51:32.421 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.423+0000 7f19187cc780 1 > prepared operation key=EZLSMEK89N2G tag=QGNAP7UH18K7 type=del size=1893860 2024-09-14T10:51:32.424 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.426+0000 7f19187cc780 1 < canceled operation key=7IWUW2HC3ULI tag=ONR4UVA597ET type=del size=337669 2024-09-14T10:51:32.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.427+0000 7f19187cc780 1 > prepared operation key=QFEI6H4EQ9ZR tag=0KMR5JTX9JY2 type=write size=666982 2024-09-14T10:51:32.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.429+0000 7f19187cc780 1 < completed delete operation key=N0L67LS2KHR1 tag=UDY3BUO8BLHG type=del 2024-09-14T10:51:32.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.432+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~R143685U5RI2.0 size=164769 2024-09-14T10:51:32.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.432+0000 7f19187cc780 1 > prepared multipart upload key=7IWUW2HC3ULI upload=R143685U5RI2 tag=ISD7UVUQQQ6H type=write size=1213345 2024-09-14T10:51:32.431 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.433+0000 7f19187cc780 1 < completed delete operation key=CADC2BY888V1 tag=6JLB05U590ES type=del 2024-09-14T10:51:32.433 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.434+0000 7f19187cc780 1 > prepared operation key=75O00VMLJJ1X tag=C7OGQHQBYY28 type=del size=1620242 2024-09-14T10:51:32.434 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.436+0000 7f19187cc780 1 < completed part key=_multipart_75O00VMLJJ1X.2~RFWJL8LVIAGF.0 size=1048576 2024-09-14T10:51:32.435 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.437+0000 7f19187cc780 1 < completed part key=_multipart_75O00VMLJJ1X.2~RFWJL8LVIAGF.1 size=1048576 2024-09-14T10:51:32.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.438+0000 7f19187cc780 1 < completed part key=_multipart_75O00VMLJJ1X.2~RFWJL8LVIAGF.2 size=881844 2024-09-14T10:51:32.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.441+0000 7f19187cc780 1 < completed multipart upload key=75O00VMLJJ1X upload=RFWJL8LVIAGF tag=088JTZUSSHBO type=write size=4027572 2024-09-14T10:51:32.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.443+0000 7f19187cc780 1 > prepared operation key=6BNN842ZTWG5 tag=OYQCSGICPHFP type=del size=2553233 2024-09-14T10:51:32.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.444+0000 7f19187cc780 -1 < failed to complete operation key=EL00Y4Z7DTAT tag=7MZK2WGM19IA type=write size=594985: (22) Invalid argument 2024-09-14T10:51:32.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.447+0000 7f19187cc780 1 > prepared part key=_multipart_E6UO1LUWOC44.2~XHNHJXUMJO4M.0 size=464173 2024-09-14T10:51:32.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.447+0000 7f19187cc780 1 > prepared multipart upload key=E6UO1LUWOC44 upload=XHNHJXUMJO4M tag=VGUC3U2F7A3E type=write size=1512749 2024-09-14T10:51:32.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.449+0000 7f19187cc780 1 < completed part key=_multipart_75O00VMLJJ1X.2~7VNGGVK318ZF.0 size=1048576 2024-09-14T10:51:32.448 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.450+0000 7f19187cc780 1 < completed part key=_multipart_75O00VMLJJ1X.2~7VNGGVK318ZF.1 size=1048576 2024-09-14T10:51:32.449 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.451+0000 7f19187cc780 1 < completed part key=_multipart_75O00VMLJJ1X.2~7VNGGVK318ZF.2 size=808786 2024-09-14T10:51:32.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.453+0000 7f19187cc780 1 < completed multipart upload key=75O00VMLJJ1X upload=7VNGGVK318ZF tag=1M89I3ORAYO0 type=write size=3954514 2024-09-14T10:51:32.453 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.455+0000 7f19187cc780 1 > prepared operation key=9EBD5ZT6MT45 tag=YZAKOHN56ARK type=del size=1087416 2024-09-14T10:51:32.454 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.456+0000 7f19187cc780 1 < completed part key=_multipart_EZLSMEK89N2G.2~QMSYY0IR0H9A.0 size=1048576 2024-09-14T10:51:32.456 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.457+0000 7f19187cc780 1 < completed part key=_multipart_EZLSMEK89N2G.2~QMSYY0IR0H9A.1 size=376781 2024-09-14T10:51:32.458 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.460+0000 7f19187cc780 1 < completed multipart upload key=EZLSMEK89N2G upload=QMSYY0IR0H9A tag=31T0XWYKKA62 type=write size=2473933 2024-09-14T10:51:32.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.462+0000 7f19187cc780 1 > prepared part key=_multipart_INJQTKXHBUV2.2~QXIMODHJ5XJN.0 size=1048576 2024-09-14T10:51:32.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.463+0000 7f19187cc780 1 > prepared part key=_multipart_INJQTKXHBUV2.2~QXIMODHJ5XJN.1 size=1048576 2024-09-14T10:51:32.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.464+0000 7f19187cc780 1 > prepared part key=_multipart_INJQTKXHBUV2.2~QXIMODHJ5XJN.2 size=641695 2024-09-14T10:51:32.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.464+0000 7f19187cc780 1 > prepared multipart upload key=INJQTKXHBUV2 upload=QXIMODHJ5XJN tag=21CUR6HK5BLL type=write size=3787423 2024-09-14T10:51:32.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.466+0000 7f19187cc780 1 < completed part key=_multipart_QBMNYNWOLK4I.2~NJCS2Y78JBMF.0 size=338840 2024-09-14T10:51:32.466 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.468+0000 7f19187cc780 1 < completed multipart upload key=QBMNYNWOLK4I upload=NJCS2Y78JBMF tag=CEG2YKRZAUKY type=write size=1387416 2024-09-14T10:51:32.469 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.471+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~G8H1J10GPWJB.0 size=1048576 2024-09-14T10:51:32.470 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.472+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~G8H1J10GPWJB.1 size=1048576 2024-09-14T10:51:32.471 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.473+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~G8H1J10GPWJB.2 size=28883 2024-09-14T10:51:32.471 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.473+0000 7f19187cc780 1 > prepared multipart upload key=B9FQYIX19AEP upload=G8H1J10GPWJB tag=Z9L18K7D8MGS type=write size=3174611 2024-09-14T10:51:32.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.474+0000 7f19187cc780 1 < completed part key=_multipart_KOJ7QB7M6A35.2~01UK1AUXW35Z.0 size=1048576 2024-09-14T10:51:32.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.476+0000 7f19187cc780 1 < completed part key=_multipart_KOJ7QB7M6A35.2~01UK1AUXW35Z.1 size=1048576 2024-09-14T10:51:32.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.477+0000 7f19187cc780 1 < completed part key=_multipart_KOJ7QB7M6A35.2~01UK1AUXW35Z.2 size=259194 2024-09-14T10:51:32.477 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.479+0000 7f19187cc780 1 < completed multipart upload key=KOJ7QB7M6A35 upload=01UK1AUXW35Z tag=BFC58HIJJRLJ type=write size=3404922 2024-09-14T10:51:32.479 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.481+0000 7f19187cc780 1 > prepared operation key=MFA30GSMCSKP tag=PUETMXCPU57Y type=del size=3850650 2024-09-14T10:51:32.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.482+0000 7f19187cc780 1 < completed part key=_multipart_CADC2BY888V1.2~V4XVCVARA3OK.0 size=658921 2024-09-14T10:51:32.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.484+0000 7f19187cc780 1 < completed multipart upload key=CADC2BY888V1 upload=V4XVCVARA3OK tag=FX50HHCFVQKG type=write size=1707497 2024-09-14T10:51:32.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.486+0000 7f19187cc780 1 > prepared operation key=EZLSMEK89N2G tag=SXQVCYSUTQK8 type=write size=43339 2024-09-14T10:51:32.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.489+0000 7f19187cc780 1 < completed delete operation key=6BNN842ZTWG5 tag=5R0E3FBNMM9Y type=del 2024-09-14T10:51:32.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.491+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~YJ5OZYN0K2DH.0 size=416653 2024-09-14T10:51:32.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.491+0000 7f19187cc780 1 > prepared multipart upload key=VW6U36JN2DBX upload=YJ5OZYN0K2DH tag=PZKCXE8UAOBQ type=write size=1465229 2024-09-14T10:51:32.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.493+0000 7f19187cc780 1 < completed part key=_multipart_617QQI921HB4.2~1NGQM1PDPYEV.0 size=202710 2024-09-14T10:51:32.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.495+0000 7f19187cc780 1 < completed multipart upload key=617QQI921HB4 upload=1NGQM1PDPYEV tag=P4FO9ZWRXUFC type=write size=1251286 2024-09-14T10:51:32.495 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.497+0000 7f19187cc780 1 > prepared part key=_multipart_AST81B9QWORT.2~Q2LBG27A25UD.0 size=352581 2024-09-14T10:51:32.495 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.497+0000 7f19187cc780 1 > prepared multipart upload key=AST81B9QWORT upload=Q2LBG27A25UD tag=49KGB1R9GCHP type=write size=1401157 2024-09-14T10:51:32.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.498+0000 7f19187cc780 1 < completed part key=_multipart_M73CER01XHDY.2~TWIIAZUKB56V.0 size=596171 2024-09-14T10:51:32.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.501+0000 7f19187cc780 1 < completed multipart upload key=M73CER01XHDY upload=TWIIAZUKB56V tag=NWHFYTMUJ4IM type=write size=1644747 2024-09-14T10:51:32.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.503+0000 7f19187cc780 1 > prepared part key=_multipart_QBMNYNWOLK4I.2~J3FENIN3ERSA.0 size=1048576 2024-09-14T10:51:32.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.504+0000 7f19187cc780 1 > prepared part key=_multipart_QBMNYNWOLK4I.2~J3FENIN3ERSA.1 size=799092 2024-09-14T10:51:32.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.504+0000 7f19187cc780 1 > prepared multipart upload key=QBMNYNWOLK4I upload=J3FENIN3ERSA tag=SI3QAE5HLZ3Q type=write size=2896244 2024-09-14T10:51:32.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.506+0000 7f19187cc780 1 < completed part key=_multipart_XCVE2F2JJK4X.2~0V9R28TN857V.0 size=1048576 2024-09-14T10:51:32.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.507+0000 7f19187cc780 1 < completed part key=_multipart_XCVE2F2JJK4X.2~0V9R28TN857V.1 size=338168 2024-09-14T10:51:32.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.511+0000 7f19187cc780 1 < completed multipart upload key=XCVE2F2JJK4X upload=0V9R28TN857V tag=85SKXCPCJ132 type=write size=2435320 2024-09-14T10:51:32.513 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.514+0000 7f19187cc780 1 > prepared part key=_multipart_5AIAYJMRZGFQ.2~CO5EUX9OQRM0.0 size=1048576 2024-09-14T10:51:32.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.516+0000 7f19187cc780 1 > prepared part key=_multipart_5AIAYJMRZGFQ.2~CO5EUX9OQRM0.1 size=1048576 2024-09-14T10:51:32.515 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.517+0000 7f19187cc780 1 > prepared part key=_multipart_5AIAYJMRZGFQ.2~CO5EUX9OQRM0.2 size=633133 2024-09-14T10:51:32.515 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.517+0000 7f19187cc780 1 > prepared multipart upload key=5AIAYJMRZGFQ upload=CO5EUX9OQRM0 tag=BMM140BBW126 type=write size=3778861 2024-09-14T10:51:32.517 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.518+0000 7f19187cc780 1 < completed part key=_multipart_QFEI6H4EQ9ZR.2~9PI0NEQHYV91.0 size=1048576 2024-09-14T10:51:32.518 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.520+0000 7f19187cc780 1 < completed part key=_multipart_QFEI6H4EQ9ZR.2~9PI0NEQHYV91.1 size=70778 2024-09-14T10:51:32.520 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.522+0000 7f19187cc780 1 < completed multipart upload key=QFEI6H4EQ9ZR upload=9PI0NEQHYV91 tag=7XYFDMK5DUXS type=write size=2167930 2024-09-14T10:51:32.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.524+0000 7f19187cc780 1 > prepared operation key=QBMNYNWOLK4I tag=22HTZTD1B698 type=del size=2175280 2024-09-14T10:51:32.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.526+0000 7f19187cc780 1 < completed delete operation key=EZLSMEK89N2G tag=QGNAP7UH18K7 type=del 2024-09-14T10:51:32.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.527+0000 7f19187cc780 1 > prepared operation key=6BNN842ZTWG5 tag=QBKPS1D7QOS9 type=del size=218397 2024-09-14T10:51:32.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.529+0000 7f19187cc780 1 < completed write operation key=QFEI6H4EQ9ZR tag=0KMR5JTX9JY2 type=write size=666982 2024-09-14T10:51:32.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.530+0000 7f19187cc780 1 > prepared operation key=EZLSMEK89N2G tag=9S1NBKL1VKOK type=write size=264461 2024-09-14T10:51:32.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.532+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~R143685U5RI2.0 size=164769 2024-09-14T10:51:32.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.534+0000 7f19187cc780 1 < completed multipart upload key=7IWUW2HC3ULI upload=R143685U5RI2 tag=ISD7UVUQQQ6H type=write size=1213345 2024-09-14T10:51:32.534 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.536+0000 7f19187cc780 1 > prepared operation key=CADC2BY888V1 tag=W7X5ORBM80NM type=del size=1766607 2024-09-14T10:51:32.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.539+0000 7f19187cc780 1 < suggested update operation key=75O00VMLJJ1X tag=C7OGQHQBYY28 type=del size=1620242 2024-09-14T10:51:32.540 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.542+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~G8Y2PAYKO5UF.0 size=1048576 2024-09-14T10:51:32.541 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.543+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~G8Y2PAYKO5UF.1 size=1048576 2024-09-14T10:51:32.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.544+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~G8Y2PAYKO5UF.2 size=60603 2024-09-14T10:51:32.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.544+0000 7f19187cc780 1 > prepared multipart upload key=VW6U36JN2DBX upload=G8Y2PAYKO5UF tag=MB6IZCWMY7JG type=write size=3206331 2024-09-14T10:51:32.544 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.546+0000 7f19187cc780 1 < completed delete operation key=6BNN842ZTWG5 tag=OYQCSGICPHFP type=del 2024-09-14T10:51:32.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.548+0000 7f19187cc780 1 > prepared operation key=9EBD5ZT6MT45 tag=O5NCFT7PVDZZ type=del size=3580163 2024-09-14T10:51:32.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.548+0000 7f19187cc780 1 < canceled part key=_multipart_E6UO1LUWOC44.2~XHNHJXUMJO4M.0 size=464173 2024-09-14T10:51:32.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.550+0000 7f19187cc780 1 < canceled multipart upload key=E6UO1LUWOC44 upload=XHNHJXUMJO4M tag=VGUC3U2F7A3E type=write size=1512749 2024-09-14T10:51:32.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.551+0000 7f19187cc780 1 > prepared operation key=MFA30GSMCSKP tag=SORRGGFGO4KF type=del size=1414640 2024-09-14T10:51:32.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.553+0000 7f19187cc780 1 < completed delete operation key=9EBD5ZT6MT45 tag=YZAKOHN56ARK type=del 2024-09-14T10:51:32.554 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.556+0000 7f19187cc780 1 > prepared part key=_multipart_YA3DI7N4DG5K.2~57QVJYTUB98H.0 size=1048576 2024-09-14T10:51:32.555 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.557+0000 7f19187cc780 1 > prepared part key=_multipart_YA3DI7N4DG5K.2~57QVJYTUB98H.1 size=806045 2024-09-14T10:51:32.555 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.557+0000 7f19187cc780 1 > prepared multipart upload key=YA3DI7N4DG5K upload=57QVJYTUB98H tag=ZVUXGE9BKLPN type=write size=2903197 2024-09-14T10:51:32.557 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.558+0000 7f19187cc780 1 < completed part key=_multipart_INJQTKXHBUV2.2~QXIMODHJ5XJN.0 size=1048576 2024-09-14T10:51:32.558 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.559+0000 7f19187cc780 1 < completed part key=_multipart_INJQTKXHBUV2.2~QXIMODHJ5XJN.1 size=1048576 2024-09-14T10:51:32.559 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.560+0000 7f19187cc780 1 < completed part key=_multipart_INJQTKXHBUV2.2~QXIMODHJ5XJN.2 size=641695 2024-09-14T10:51:32.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.564+0000 7f19187cc780 1 < completed multipart upload key=INJQTKXHBUV2 upload=QXIMODHJ5XJN tag=21CUR6HK5BLL type=write size=3787423 2024-09-14T10:51:32.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.568+0000 7f19187cc780 1 > prepared part key=_multipart_54BSD3DEHNK6.2~WK2H7N9U0ROW.0 size=1048576 2024-09-14T10:51:32.567 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.569+0000 7f19187cc780 1 > prepared part key=_multipart_54BSD3DEHNK6.2~WK2H7N9U0ROW.1 size=392685 2024-09-14T10:51:32.567 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.569+0000 7f19187cc780 1 > prepared multipart upload key=54BSD3DEHNK6 upload=WK2H7N9U0ROW tag=TYRVWRCAC195 type=write size=2489837 2024-09-14T10:51:32.569 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.570+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~G8H1J10GPWJB.0 size=1048576 2024-09-14T10:51:32.570 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.572+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~G8H1J10GPWJB.1 size=1048576 2024-09-14T10:51:32.571 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.573+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~G8H1J10GPWJB.2 size=28883 2024-09-14T10:51:32.574 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.575+0000 7f19187cc780 1 < completed multipart upload key=B9FQYIX19AEP upload=G8H1J10GPWJB tag=Z9L18K7D8MGS type=write size=3174611 2024-09-14T10:51:32.575 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.577+0000 7f19187cc780 1 > prepared operation key=OVOPGTYUF3F3 tag=39ET469WVEJA type=del size=2136854 2024-09-14T10:51:32.577 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.578+0000 7f19187cc780 1 < completed delete operation key=MFA30GSMCSKP tag=PUETMXCPU57Y type=del 2024-09-14T10:51:32.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.581+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~PSH78M61BTCR.0 size=1048576 2024-09-14T10:51:32.581 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.583+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~PSH78M61BTCR.1 size=1048576 2024-09-14T10:51:32.582 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.584+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~PSH78M61BTCR.2 size=462429 2024-09-14T10:51:32.582 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.584+0000 7f19187cc780 1 > prepared multipart upload key=OVOPGTYUF3F3 upload=PSH78M61BTCR tag=C2DBSF3CJDKU type=write size=3608157 2024-09-14T10:51:32.584 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.585+0000 7f19187cc780 1 < canceled operation key=EZLSMEK89N2G tag=SXQVCYSUTQK8 type=write size=43339 2024-09-14T10:51:32.585 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.587+0000 7f19187cc780 1 > prepared operation key=VW6U36JN2DBX tag=S6YFJT73F9EZ type=del size=97512 2024-09-14T10:51:32.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.588+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~YJ5OZYN0K2DH.0 size=416653 2024-09-14T10:51:32.589 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.591+0000 7f19187cc780 1 < completed multipart upload key=VW6U36JN2DBX upload=YJ5OZYN0K2DH tag=PZKCXE8UAOBQ type=write size=1465229 2024-09-14T10:51:32.591 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.592+0000 7f19187cc780 1 > prepared operation key=W1K1IU13J0CZ tag=X4R8BX612QKD type=del size=1548715 2024-09-14T10:51:32.592 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.594+0000 7f19187cc780 1 < completed part key=_multipart_AST81B9QWORT.2~Q2LBG27A25UD.0 size=352581 2024-09-14T10:51:32.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.596+0000 7f19187cc780 1 < completed multipart upload key=AST81B9QWORT upload=Q2LBG27A25UD tag=49KGB1R9GCHP type=write size=1401157 2024-09-14T10:51:32.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.599+0000 7f19187cc780 1 > prepared part key=_multipart_E6UO1LUWOC44.2~ZLND6C16RUTH.0 size=1048576 2024-09-14T10:51:32.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.600+0000 7f19187cc780 1 > prepared part key=_multipart_E6UO1LUWOC44.2~ZLND6C16RUTH.1 size=1048576 2024-09-14T10:51:32.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.601+0000 7f19187cc780 1 > prepared part key=_multipart_E6UO1LUWOC44.2~ZLND6C16RUTH.2 size=96635 2024-09-14T10:51:32.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.601+0000 7f19187cc780 1 > prepared multipart upload key=E6UO1LUWOC44 upload=ZLND6C16RUTH tag=Z4977V0GRMQY type=write size=3242363 2024-09-14T10:51:32.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.601+0000 7f19187cc780 1 < canceled part key=_multipart_QBMNYNWOLK4I.2~J3FENIN3ERSA.0 size=1048576 2024-09-14T10:51:32.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.601+0000 7f19187cc780 1 < canceled part key=_multipart_QBMNYNWOLK4I.2~J3FENIN3ERSA.1 size=799092 2024-09-14T10:51:32.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.604+0000 7f19187cc780 1 < canceled multipart upload key=QBMNYNWOLK4I upload=J3FENIN3ERSA tag=SI3QAE5HLZ3Q type=write size=2896244 2024-09-14T10:51:32.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.605+0000 7f19187cc780 1 > prepared operation key=XCVE2F2JJK4X tag=PE2YDQTYTNDP type=del size=2335298 2024-09-14T10:51:32.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.607+0000 7f19187cc780 1 < completed part key=_multipart_5AIAYJMRZGFQ.2~CO5EUX9OQRM0.0 size=1048576 2024-09-14T10:51:32.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.608+0000 7f19187cc780 1 < completed part key=_multipart_5AIAYJMRZGFQ.2~CO5EUX9OQRM0.1 size=1048576 2024-09-14T10:51:32.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.609+0000 7f19187cc780 1 < completed part key=_multipart_5AIAYJMRZGFQ.2~CO5EUX9OQRM0.2 size=633133 2024-09-14T10:51:32.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.611+0000 7f19187cc780 1 < completed multipart upload key=5AIAYJMRZGFQ upload=CO5EUX9OQRM0 tag=BMM140BBW126 type=write size=3778861 2024-09-14T10:51:32.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.613+0000 7f19187cc780 1 > prepared operation key=QFEI6H4EQ9ZR tag=3VTT0QECTP1Q type=del size=296320 2024-09-14T10:51:32.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.614+0000 7f19187cc780 1 < canceled operation key=QBMNYNWOLK4I tag=22HTZTD1B698 type=del size=2175280 2024-09-14T10:51:32.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.615+0000 7f19187cc780 1 > prepared operation key=VW6U36JN2DBX tag=HF40EOTEVHUB type=del size=3585848 2024-09-14T10:51:32.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.617+0000 7f19187cc780 1 < completed delete operation key=6BNN842ZTWG5 tag=QBKPS1D7QOS9 type=del 2024-09-14T10:51:32.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.618+0000 7f19187cc780 1 > prepared operation key=AGNUE76X8XCJ tag=CK7VE5N4EAUP type=write size=698184 2024-09-14T10:51:32.619 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.621+0000 7f19187cc780 1 < suggested remove operation key=EZLSMEK89N2G tag=9S1NBKL1VKOK type=write 2024-09-14T10:51:32.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.623+0000 7f19187cc780 1 > prepared part key=_multipart_M73CER01XHDY.2~MONGMO7S2EHD.0 size=791653 2024-09-14T10:51:32.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.623+0000 7f19187cc780 1 > prepared multipart upload key=M73CER01XHDY upload=MONGMO7S2EHD tag=MQB7U7CB0NWO type=write size=1840229 2024-09-14T10:51:32.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.625+0000 7f19187cc780 1 < completed delete operation key=CADC2BY888V1 tag=W7X5ORBM80NM type=del 2024-09-14T10:51:32.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.627+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~JO4QK9M2INQ9.0 size=1048576 2024-09-14T10:51:32.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.628+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~JO4QK9M2INQ9.1 size=1048576 2024-09-14T10:51:32.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.629+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~JO4QK9M2INQ9.2 size=929384 2024-09-14T10:51:32.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.630+0000 7f19187cc780 1 > prepared multipart upload key=6BNN842ZTWG5 upload=JO4QK9M2INQ9 tag=IU23SETAB3RD type=write size=4075112 2024-09-14T10:51:32.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.631+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~G8Y2PAYKO5UF.0 size=1048576 2024-09-14T10:51:32.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.633+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~G8Y2PAYKO5UF.1 size=1048576 2024-09-14T10:51:32.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.634+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~G8Y2PAYKO5UF.2 size=60603 2024-09-14T10:51:32.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.636+0000 7f19187cc780 1 < completed multipart upload key=VW6U36JN2DBX upload=G8Y2PAYKO5UF tag=MB6IZCWMY7JG type=write size=3206331 2024-09-14T10:51:32.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.638+0000 7f19187cc780 1 > prepared operation key=CADC2BY888V1 tag=8SSAQRKVUQNC type=del size=2955893 2024-09-14T10:51:32.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.639+0000 7f19187cc780 1 < completed delete operation key=9EBD5ZT6MT45 tag=O5NCFT7PVDZZ type=del 2024-09-14T10:51:32.639 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.640+0000 7f19187cc780 1 > prepared operation key=EZLSMEK89N2G tag=K1VZVIQQQYFU type=del size=4124054 2024-09-14T10:51:32.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.645+0000 7f19187cc780 1 < suggested remove operation key=MFA30GSMCSKP tag=SORRGGFGO4KF type=del 2024-09-14T10:51:32.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.648+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~1FJ5OQI0MWQ2.0 size=818198 2024-09-14T10:51:32.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.648+0000 7f19187cc780 1 > prepared multipart upload key=IKVYA4KEALFF upload=1FJ5OQI0MWQ2 tag=11VAXTFCXSP0 type=write size=1866774 2024-09-14T10:51:32.648 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.649+0000 7f19187cc780 1 < completed part key=_multipart_YA3DI7N4DG5K.2~57QVJYTUB98H.0 size=1048576 2024-09-14T10:51:32.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.650+0000 7f19187cc780 1 < completed part key=_multipart_YA3DI7N4DG5K.2~57QVJYTUB98H.1 size=806045 2024-09-14T10:51:32.651 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.653+0000 7f19187cc780 1 < completed multipart upload key=YA3DI7N4DG5K upload=57QVJYTUB98H tag=ZVUXGE9BKLPN type=write size=2903197 2024-09-14T10:51:32.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.654+0000 7f19187cc780 1 > prepared operation key=B9FQYIX19AEP tag=E0X9S5D0PDSZ type=del size=707562 2024-09-14T10:51:32.654 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.656+0000 7f19187cc780 1 < completed part key=_multipart_54BSD3DEHNK6.2~WK2H7N9U0ROW.0 size=1048576 2024-09-14T10:51:32.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.657+0000 7f19187cc780 1 < completed part key=_multipart_54BSD3DEHNK6.2~WK2H7N9U0ROW.1 size=392685 2024-09-14T10:51:32.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.659+0000 7f19187cc780 1 < completed multipart upload key=54BSD3DEHNK6 upload=WK2H7N9U0ROW tag=TYRVWRCAC195 type=write size=2489837 2024-09-14T10:51:32.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.662+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~7XSJ9XR2TP1J.0 size=978462 2024-09-14T10:51:32.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.662+0000 7f19187cc780 1 > prepared multipart upload key=OVOPGTYUF3F3 upload=7XSJ9XR2TP1J tag=1SB315HD6KV2 type=write size=2027038 2024-09-14T10:51:32.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.663+0000 7f19187cc780 1 < completed delete operation key=OVOPGTYUF3F3 tag=39ET469WVEJA type=del 2024-09-14T10:51:32.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.665+0000 7f19187cc780 1 > prepared operation key=RTGE7ISETJWW tag=6PGQVQ30Q4BQ type=del size=429116 2024-09-14T10:51:32.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.666+0000 7f19187cc780 1 < completed part key=_multipart_OVOPGTYUF3F3.2~PSH78M61BTCR.0 size=1048576 2024-09-14T10:51:32.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.668+0000 7f19187cc780 1 < completed part key=_multipart_OVOPGTYUF3F3.2~PSH78M61BTCR.1 size=1048576 2024-09-14T10:51:32.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.669+0000 7f19187cc780 1 < completed part key=_multipart_OVOPGTYUF3F3.2~PSH78M61BTCR.2 size=462429 2024-09-14T10:51:32.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.671+0000 7f19187cc780 1 < completed multipart upload key=OVOPGTYUF3F3 upload=PSH78M61BTCR tag=C2DBSF3CJDKU type=write size=3608157 2024-09-14T10:51:32.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.672+0000 7f19187cc780 1 > prepared operation key=KP3WOGIF30PZ tag=SPNM9R3X4UW7 type=write size=186617 2024-09-14T10:51:32.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.674+0000 7f19187cc780 1 < completed delete operation key=VW6U36JN2DBX tag=S6YFJT73F9EZ type=del 2024-09-14T10:51:32.675 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.676+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~QRFJFE5JKSJ0.0 size=1048576 2024-09-14T10:51:32.676 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.677+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~QRFJFE5JKSJ0.1 size=610604 2024-09-14T10:51:32.676 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.677+0000 7f19187cc780 1 > prepared multipart upload key=IKVYA4KEALFF upload=QRFJFE5JKSJ0 tag=HXZR7FXSSE6M type=write size=2707756 2024-09-14T10:51:32.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.679+0000 7f19187cc780 1 < canceled operation key=W1K1IU13J0CZ tag=X4R8BX612QKD type=del size=1548715 2024-09-14T10:51:32.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.682+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~P4VMWF306K3L.0 size=1048576 2024-09-14T10:51:32.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.683+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~P4VMWF306K3L.1 size=1048576 2024-09-14T10:51:32.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.684+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~P4VMWF306K3L.2 size=71884 2024-09-14T10:51:32.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.684+0000 7f19187cc780 1 > prepared multipart upload key=KP3WOGIF30PZ upload=P4VMWF306K3L tag=BZ74GHDYBGVH type=write size=3217612 2024-09-14T10:51:32.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.686+0000 7f19187cc780 1 < completed part key=_multipart_E6UO1LUWOC44.2~ZLND6C16RUTH.0 size=1048576 2024-09-14T10:51:32.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.687+0000 7f19187cc780 1 < completed part key=_multipart_E6UO1LUWOC44.2~ZLND6C16RUTH.1 size=1048576 2024-09-14T10:51:32.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.688+0000 7f19187cc780 1 < completed part key=_multipart_E6UO1LUWOC44.2~ZLND6C16RUTH.2 size=96635 2024-09-14T10:51:32.689 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.691+0000 7f19187cc780 1 < completed multipart upload key=E6UO1LUWOC44 upload=ZLND6C16RUTH tag=Z4977V0GRMQY type=write size=3242363 2024-09-14T10:51:32.691 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.692+0000 7f19187cc780 1 > prepared operation key=54BSD3DEHNK6 tag=XP56HIR6DS2L type=del size=1195106 2024-09-14T10:51:32.692 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.694+0000 7f19187cc780 1 < completed delete operation key=XCVE2F2JJK4X tag=PE2YDQTYTNDP type=del 2024-09-14T10:51:32.694 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.695+0000 7f19187cc780 1 > prepared operation key=EL00Y4Z7DTAT tag=PW0JX8IDX9TF type=del size=2866778 2024-09-14T10:51:32.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.697+0000 7f19187cc780 1 < canceled operation key=QFEI6H4EQ9ZR tag=3VTT0QECTP1Q type=del size=296320 2024-09-14T10:51:32.698 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.700+0000 7f19187cc780 1 > prepared operation key=B9FQYIX19AEP tag=65D4TOYQJBUV type=write size=405345 2024-09-14T10:51:32.700 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.702+0000 7f19187cc780 1 < canceled operation key=VW6U36JN2DBX tag=HF40EOTEVHUB type=del size=3585848 2024-09-14T10:51:32.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.703+0000 7f19187cc780 1 > prepared operation key=E6UO1LUWOC44 tag=QJE4X04M5O3F type=del size=4083306 2024-09-14T10:51:32.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.706+0000 7f19187cc780 1 < suggested remove operation key=AGNUE76X8XCJ tag=CK7VE5N4EAUP type=write 2024-09-14T10:51:32.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.708+0000 7f19187cc780 1 > prepared operation key=H40763V7HMBC tag=RIL403FD0P7U type=del size=2199071 2024-09-14T10:51:32.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.709+0000 7f19187cc780 1 < completed part key=_multipart_M73CER01XHDY.2~MONGMO7S2EHD.0 size=791653 2024-09-14T10:51:32.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.712+0000 7f19187cc780 1 < completed multipart upload key=M73CER01XHDY upload=MONGMO7S2EHD tag=MQB7U7CB0NWO type=write size=1840229 2024-09-14T10:51:32.712 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.714+0000 7f19187cc780 1 > prepared part key=_multipart_E6UO1LUWOC44.2~BMLEDPXFBQW6.0 size=337459 2024-09-14T10:51:32.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.714+0000 7f19187cc780 1 > prepared multipart upload key=E6UO1LUWOC44 upload=BMLEDPXFBQW6 tag=JZHN1Y9OAUDQ type=write size=1386035 2024-09-14T10:51:32.714 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.715+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~JO4QK9M2INQ9.0 size=1048576 2024-09-14T10:51:32.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.717+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~JO4QK9M2INQ9.1 size=1048576 2024-09-14T10:51:32.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.718+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~JO4QK9M2INQ9.2 size=929384 2024-09-14T10:51:32.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.720+0000 7f19187cc780 1 < completed multipart upload key=6BNN842ZTWG5 upload=JO4QK9M2INQ9 tag=IU23SETAB3RD type=write size=4075112 2024-09-14T10:51:32.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.723+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~73WW1LOIC94Q.0 size=1048576 2024-09-14T10:51:32.723 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.725+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~73WW1LOIC94Q.1 size=1048576 2024-09-14T10:51:32.724 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.726+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~73WW1LOIC94Q.2 size=702609 2024-09-14T10:51:32.724 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.726+0000 7f19187cc780 1 > prepared multipart upload key=VW6U36JN2DBX upload=73WW1LOIC94Q tag=1M5KLYR5NN52 type=write size=3848337 2024-09-14T10:51:32.726 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.727+0000 7f19187cc780 1 < completed delete operation key=CADC2BY888V1 tag=8SSAQRKVUQNC type=del 2024-09-14T10:51:32.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.730+0000 7f19187cc780 1 > prepared part key=_multipart_QBMNYNWOLK4I.2~XF0TKMFUZLTI.0 size=811748 2024-09-14T10:51:32.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.730+0000 7f19187cc780 1 > prepared multipart upload key=QBMNYNWOLK4I upload=XF0TKMFUZLTI tag=3S9J4SSA82PD type=write size=1860324 2024-09-14T10:51:32.730 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.731+0000 7f19187cc780 1 < completed delete operation key=EZLSMEK89N2G tag=K1VZVIQQQYFU type=del 2024-09-14T10:51:32.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.734+0000 7f19187cc780 1 > prepared part key=_multipart_N0L67LS2KHR1.2~XZZ0Q1O91C7M.0 size=241829 2024-09-14T10:51:32.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.734+0000 7f19187cc780 1 > prepared multipart upload key=N0L67LS2KHR1 upload=XZZ0Q1O91C7M tag=O320QOGJWJ2M type=write size=1290405 2024-09-14T10:51:32.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.736+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~1FJ5OQI0MWQ2.0 size=818198 2024-09-14T10:51:32.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.738+0000 7f19187cc780 1 < completed multipart upload key=IKVYA4KEALFF upload=1FJ5OQI0MWQ2 tag=11VAXTFCXSP0 type=write size=1866774 2024-09-14T10:51:32.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.739+0000 7f19187cc780 1 > prepared operation key=OVOPGTYUF3F3 tag=6YP5NCAW82NN type=del size=2536715 2024-09-14T10:51:32.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.741+0000 7f19187cc780 1 < canceled operation key=B9FQYIX19AEP tag=E0X9S5D0PDSZ type=del size=707562 2024-09-14T10:51:32.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.742+0000 7f19187cc780 1 > prepared operation key=E6UO1LUWOC44 tag=Z1XY2A745TK1 type=del size=2602223 2024-09-14T10:51:32.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.743+0000 7f19187cc780 1 < canceled part key=_multipart_OVOPGTYUF3F3.2~7XSJ9XR2TP1J.0 size=978462 2024-09-14T10:51:32.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.745+0000 7f19187cc780 1 < canceled multipart upload key=OVOPGTYUF3F3 upload=7XSJ9XR2TP1J tag=1SB315HD6KV2 type=write size=2027038 2024-09-14T10:51:32.744 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.746+0000 7f19187cc780 1 > prepared operation key=54BSD3DEHNK6 tag=5RYO0P60UKH0 type=del size=1213173 2024-09-14T10:51:32.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.747+0000 7f19187cc780 1 < completed delete operation key=RTGE7ISETJWW tag=6PGQVQ30Q4BQ type=del 2024-09-14T10:51:32.748 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.750+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~5H4B5BDNUYMC.0 size=1048576 2024-09-14T10:51:32.755 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.751+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~5H4B5BDNUYMC.1 size=185713 2024-09-14T10:51:32.755 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.751+0000 7f19187cc780 1 > prepared multipart upload key=B9FQYIX19AEP upload=5H4B5BDNUYMC tag=X2IJ3FDOTLCT type=write size=2282865 2024-09-14T10:51:32.755 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.753+0000 7f19187cc780 1 < completed write operation key=KP3WOGIF30PZ tag=SPNM9R3X4UW7 type=write size=186617 2024-09-14T10:51:32.755 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.755+0000 7f19187cc780 1 > prepared part key=_multipart_N0L67LS2KHR1.2~NCXW310XXKFV.0 size=1048576 2024-09-14T10:51:32.755 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.756+0000 7f19187cc780 1 > prepared part key=_multipart_N0L67LS2KHR1.2~NCXW310XXKFV.1 size=1048576 2024-09-14T10:51:32.756 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.758+0000 7f19187cc780 1 > prepared part key=_multipart_N0L67LS2KHR1.2~NCXW310XXKFV.2 size=1147 2024-09-14T10:51:32.756 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.758+0000 7f19187cc780 1 > prepared multipart upload key=N0L67LS2KHR1 upload=NCXW310XXKFV tag=8CLQ2NPI86S8 type=write size=3146875 2024-09-14T10:51:32.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.759+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~QRFJFE5JKSJ0.0 size=1048576 2024-09-14T10:51:32.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.761+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~QRFJFE5JKSJ0.1 size=610604 2024-09-14T10:51:32.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.763+0000 7f19187cc780 1 < completed multipart upload key=IKVYA4KEALFF upload=QRFJFE5JKSJ0 tag=HXZR7FXSSE6M type=write size=2707756 2024-09-14T10:51:32.763 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.765+0000 7f19187cc780 1 > prepared operation key=QFEI6H4EQ9ZR tag=IOQL6CAKA88H type=del size=2682608 2024-09-14T10:51:32.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.766+0000 7f19187cc780 1 < completed part key=_multipart_KP3WOGIF30PZ.2~P4VMWF306K3L.0 size=1048576 2024-09-14T10:51:32.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.767+0000 7f19187cc780 1 < completed part key=_multipart_KP3WOGIF30PZ.2~P4VMWF306K3L.1 size=1048576 2024-09-14T10:51:32.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.768+0000 7f19187cc780 1 < completed part key=_multipart_KP3WOGIF30PZ.2~P4VMWF306K3L.2 size=71884 2024-09-14T10:51:32.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.771+0000 7f19187cc780 1 < completed multipart upload key=KP3WOGIF30PZ upload=P4VMWF306K3L tag=BZ74GHDYBGVH type=write size=3217612 2024-09-14T10:51:32.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.772+0000 7f19187cc780 1 > prepared operation key=KOJ7QB7M6A35 tag=SV6D5DFTFYFN type=del size=935050 2024-09-14T10:51:32.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.774+0000 7f19187cc780 1 < completed delete operation key=54BSD3DEHNK6 tag=XP56HIR6DS2L type=del 2024-09-14T10:51:32.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.776+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~ACFVKD3UMBHW.0 size=1048576 2024-09-14T10:51:32.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.778+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~ACFVKD3UMBHW.1 size=1048576 2024-09-14T10:51:32.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.779+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~ACFVKD3UMBHW.2 size=270306 2024-09-14T10:51:32.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.779+0000 7f19187cc780 1 > prepared multipart upload key=VW6U36JN2DBX upload=ACFVKD3UMBHW tag=RFNLII2KQAVA type=write size=3416034 2024-09-14T10:51:32.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.780+0000 7f19187cc780 1 < completed delete operation key=EL00Y4Z7DTAT tag=PW0JX8IDX9TF type=del 2024-09-14T10:51:32.781 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.783+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~14LOD4PIL9AA.0 size=904231 2024-09-14T10:51:32.781 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.783+0000 7f19187cc780 1 > prepared multipart upload key=6BNN842ZTWG5 upload=14LOD4PIL9AA tag=LAYNB2UWEVX3 type=write size=1952807 2024-09-14T10:51:32.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.784+0000 7f19187cc780 1 < completed write operation key=B9FQYIX19AEP tag=65D4TOYQJBUV type=write size=405345 2024-09-14T10:51:32.785 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.787+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~WTGPA3KXT5Q8.0 size=990747 2024-09-14T10:51:32.785 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.787+0000 7f19187cc780 1 > prepared multipart upload key=OVOPGTYUF3F3 upload=WTGPA3KXT5Q8 tag=XZVT13KT2TDO type=write size=2039323 2024-09-14T10:51:32.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.788+0000 7f19187cc780 1 < completed delete operation key=E6UO1LUWOC44 tag=QJE4X04M5O3F type=del 2024-09-14T10:51:32.788 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.790+0000 7f19187cc780 1 > prepared operation key=EZLSMEK89N2G tag=U1RB3GBRHX8T type=del size=212191 2024-09-14T10:51:32.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.791+0000 7f19187cc780 1 < completed delete operation key=H40763V7HMBC tag=RIL403FD0P7U type=del 2024-09-14T10:51:32.791 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.793+0000 7f19187cc780 1 > prepared operation key=YA3DI7N4DG5K tag=4SUZ56KEIYDZ type=del size=2204408 2024-09-14T10:51:32.791 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.793+0000 7f19187cc780 1 < canceled part key=_multipart_E6UO1LUWOC44.2~BMLEDPXFBQW6.0 size=337459 2024-09-14T10:51:32.793 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.795+0000 7f19187cc780 1 < canceled multipart upload key=E6UO1LUWOC44 upload=BMLEDPXFBQW6 tag=JZHN1Y9OAUDQ type=write size=1386035 2024-09-14T10:51:32.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.796+0000 7f19187cc780 1 > prepared operation key=6BNN842ZTWG5 tag=T39SKJHLP0PW type=del size=1198495 2024-09-14T10:51:32.796 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.798+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~73WW1LOIC94Q.0 size=1048576 2024-09-14T10:51:32.797 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.799+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~73WW1LOIC94Q.1 size=1048576 2024-09-14T10:51:32.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.800+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~73WW1LOIC94Q.2 size=702609 2024-09-14T10:51:32.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.802+0000 7f19187cc780 1 < completed multipart upload key=VW6U36JN2DBX upload=73WW1LOIC94Q tag=1M5KLYR5NN52 type=write size=3848337 2024-09-14T10:51:32.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.803+0000 7f19187cc780 1 > prepared operation key=EZLSMEK89N2G tag=X81QP21VC5KK type=write size=162766 2024-09-14T10:51:32.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.805+0000 7f19187cc780 1 < completed part key=_multipart_QBMNYNWOLK4I.2~XF0TKMFUZLTI.0 size=811748 2024-09-14T10:51:32.805 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.807+0000 7f19187cc780 1 < completed multipart upload key=QBMNYNWOLK4I upload=XF0TKMFUZLTI tag=3S9J4SSA82PD type=write size=1860324 2024-09-14T10:51:32.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.808+0000 7f19187cc780 1 > prepared operation key=7IWUW2HC3ULI tag=8ZVC751H7YRX type=del size=2380562 2024-09-14T10:51:32.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.810+0000 7f19187cc780 1 < completed part key=_multipart_N0L67LS2KHR1.2~XZZ0Q1O91C7M.0 size=241829 2024-09-14T10:51:32.810 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.812+0000 7f19187cc780 1 < completed multipart upload key=N0L67LS2KHR1 upload=XZZ0Q1O91C7M tag=O320QOGJWJ2M type=write size=1290405 2024-09-14T10:51:32.813 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.814+0000 7f19187cc780 1 > prepared part key=_multipart_RTGE7ISETJWW.2~34EIBDMDJ7DS.0 size=503800 2024-09-14T10:51:32.813 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.814+0000 7f19187cc780 1 > prepared multipart upload key=RTGE7ISETJWW upload=34EIBDMDJ7DS tag=OCI65E6YBUYO type=write size=1552376 2024-09-14T10:51:32.814 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.816+0000 7f19187cc780 1 < completed delete operation key=OVOPGTYUF3F3 tag=6YP5NCAW82NN type=del 2024-09-14T10:51:32.817 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.818+0000 7f19187cc780 1 > prepared part key=_multipart_RTGE7ISETJWW.2~ZD458FMMQZ9H.0 size=1048576 2024-09-14T10:51:32.818 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.819+0000 7f19187cc780 1 > prepared part key=_multipart_RTGE7ISETJWW.2~ZD458FMMQZ9H.1 size=783654 2024-09-14T10:51:32.818 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.819+0000 7f19187cc780 1 > prepared multipart upload key=RTGE7ISETJWW upload=ZD458FMMQZ9H tag=B1R84USZC4NG type=write size=2880806 2024-09-14T10:51:32.820 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.822+0000 7f19187cc780 1 < suggested update operation key=E6UO1LUWOC44 tag=Z1XY2A745TK1 type=del size=2602223 2024-09-14T10:51:32.822 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.824+0000 7f19187cc780 1 > prepared operation key=617QQI921HB4 tag=HIQ4097JXBLG type=del size=1149085 2024-09-14T10:51:32.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.825+0000 7f19187cc780 1 < completed delete operation key=54BSD3DEHNK6 tag=5RYO0P60UKH0 type=del 2024-09-14T10:51:32.825 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.827+0000 7f19187cc780 1 > prepared operation key=OVOPGTYUF3F3 tag=5TYXNWMYXW2C type=del size=46959 2024-09-14T10:51:32.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.828+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~5H4B5BDNUYMC.0 size=1048576 2024-09-14T10:51:32.828 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.829+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~5H4B5BDNUYMC.1 size=185713 2024-09-14T10:51:32.831 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.833+0000 7f19187cc780 1 < completed multipart upload key=B9FQYIX19AEP upload=5H4B5BDNUYMC tag=X2IJ3FDOTLCT type=write size=2282865 2024-09-14T10:51:32.832 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.834+0000 7f19187cc780 1 > prepared operation key=54BSD3DEHNK6 tag=C49OZR5EN84V type=write size=404178 2024-09-14T10:51:32.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.835+0000 7f19187cc780 1 < completed part key=_multipart_N0L67LS2KHR1.2~NCXW310XXKFV.0 size=1048576 2024-09-14T10:51:32.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.837+0000 7f19187cc780 1 < completed part key=_multipart_N0L67LS2KHR1.2~NCXW310XXKFV.1 size=1048576 2024-09-14T10:51:32.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.837+0000 7f19187cc780 1 < canceled part key=_multipart_N0L67LS2KHR1.2~NCXW310XXKFV.2 size=1147 2024-09-14T10:51:32.837 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.839+0000 7f19187cc780 1 < canceled multipart upload key=N0L67LS2KHR1 upload=NCXW310XXKFV tag=8CLQ2NPI86S8 type=write size=3146875 2024-09-14T10:51:32.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.841+0000 7f19187cc780 1 > prepared operation key=KP3WOGIF30PZ tag=VF55RBIO3UVJ type=del size=1966543 2024-09-14T10:51:32.840 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.842+0000 7f19187cc780 1 < completed delete operation key=QFEI6H4EQ9ZR tag=IOQL6CAKA88H type=del 2024-09-14T10:51:32.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.845+0000 7f19187cc780 1 > prepared part key=_multipart_H40763V7HMBC.2~18O0Y1VRBRI7.0 size=384762 2024-09-14T10:51:32.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.845+0000 7f19187cc780 1 > prepared multipart upload key=H40763V7HMBC upload=18O0Y1VRBRI7 tag=Z6T7SP1JQHG6 type=write size=1433338 2024-09-14T10:51:32.845 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.846+0000 7f19187cc780 1 < completed delete operation key=KOJ7QB7M6A35 tag=SV6D5DFTFYFN type=del 2024-09-14T10:51:32.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.847+0000 7f19187cc780 1 > prepared operation key=7IWUW2HC3ULI tag=IW5CINR9YXON type=del size=2404253 2024-09-14T10:51:32.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.849+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~ACFVKD3UMBHW.0 size=1048576 2024-09-14T10:51:32.848 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.849+0000 7f19187cc780 1 < canceled part key=_multipart_VW6U36JN2DBX.2~ACFVKD3UMBHW.1 size=1048576 2024-09-14T10:51:32.849 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.850+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~ACFVKD3UMBHW.2 size=270306 2024-09-14T10:51:32.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.852+0000 7f19187cc780 1 < canceled multipart upload key=VW6U36JN2DBX upload=ACFVKD3UMBHW tag=RFNLII2KQAVA type=write size=3416034 2024-09-14T10:51:32.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.855+0000 7f19187cc780 1 > prepared part key=_multipart_75O00VMLJJ1X.2~B16PPOPH3331.0 size=1048576 2024-09-14T10:51:32.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.856+0000 7f19187cc780 1 > prepared part key=_multipart_75O00VMLJJ1X.2~B16PPOPH3331.1 size=1048576 2024-09-14T10:51:32.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.857+0000 7f19187cc780 1 > prepared part key=_multipart_75O00VMLJJ1X.2~B16PPOPH3331.2 size=462032 2024-09-14T10:51:32.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.857+0000 7f19187cc780 1 > prepared multipart upload key=75O00VMLJJ1X upload=B16PPOPH3331 tag=M5ZSPSHQIM06 type=write size=3607760 2024-09-14T10:51:32.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.859+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~14LOD4PIL9AA.0 size=904231 2024-09-14T10:51:32.859 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.861+0000 7f19187cc780 1 < completed multipart upload key=6BNN842ZTWG5 upload=14LOD4PIL9AA tag=LAYNB2UWEVX3 type=write size=1952807 2024-09-14T10:51:32.861 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.862+0000 7f19187cc780 1 > prepared operation key=N0L67LS2KHR1 tag=LQB98KDKLSXX type=del size=634566 2024-09-14T10:51:32.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.864+0000 7f19187cc780 1 < completed part key=_multipart_OVOPGTYUF3F3.2~WTGPA3KXT5Q8.0 size=990747 2024-09-14T10:51:32.864 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.866+0000 7f19187cc780 1 < completed multipart upload key=OVOPGTYUF3F3 upload=WTGPA3KXT5Q8 tag=XZVT13KT2TDO type=write size=2039323 2024-09-14T10:51:32.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.869+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~NKII0V3PXCBK.0 size=1048576 2024-09-14T10:51:32.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.870+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~NKII0V3PXCBK.1 size=1048576 2024-09-14T10:51:32.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.871+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~NKII0V3PXCBK.2 size=104968 2024-09-14T10:51:32.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.871+0000 7f19187cc780 1 > prepared multipart upload key=OVOPGTYUF3F3 upload=NKII0V3PXCBK tag=LT0KP1DQFJHJ type=write size=3250696 2024-09-14T10:51:32.871 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.873+0000 7f19187cc780 1 < completed delete operation key=EZLSMEK89N2G tag=U1RB3GBRHX8T type=del 2024-09-14T10:51:32.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.875+0000 7f19187cc780 1 > prepared part key=_multipart_CADC2BY888V1.2~AL75LWV7E52N.0 size=810578 2024-09-14T10:51:32.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.875+0000 7f19187cc780 1 > prepared multipart upload key=CADC2BY888V1 upload=AL75LWV7E52N tag=9BWXE6I9HSKM type=write size=1859154 2024-09-14T10:51:32.877 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.878+0000 7f19187cc780 1 < suggested remove operation key=YA3DI7N4DG5K tag=4SUZ56KEIYDZ type=del 2024-09-14T10:51:32.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.881+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~1ZRJ3WCOFB0U.0 size=1048576 2024-09-14T10:51:32.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.882+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~1ZRJ3WCOFB0U.1 size=1048576 2024-09-14T10:51:32.882 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.883+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~1ZRJ3WCOFB0U.2 size=434093 2024-09-14T10:51:32.882 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.883+0000 7f19187cc780 1 > prepared multipart upload key=KOJ7QB7M6A35 upload=1ZRJ3WCOFB0U tag=19B6XSS0ZMWV type=write size=3579821 2024-09-14T10:51:32.883 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.885+0000 7f19187cc780 1 < completed delete operation key=6BNN842ZTWG5 tag=T39SKJHLP0PW type=del 2024-09-14T10:51:32.884 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.886+0000 7f19187cc780 1 > prepared operation key=61O2VU0SB379 tag=OGTE2QH2K80K type=del size=286896 2024-09-14T10:51:32.886 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.888+0000 7f19187cc780 1 < completed write operation key=EZLSMEK89N2G tag=X81QP21VC5KK type=write size=162766 2024-09-14T10:51:32.887 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.889+0000 7f19187cc780 1 > prepared operation key=19P3WE6HKJH2 tag=CESM72A1O0K3 type=write size=377232 2024-09-14T10:51:32.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.891+0000 7f19187cc780 1 < completed delete operation key=7IWUW2HC3ULI tag=8ZVC751H7YRX type=del 2024-09-14T10:51:32.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.892+0000 7f19187cc780 1 > prepared operation key=75O00VMLJJ1X tag=Y1B1W6KKDTHU type=del size=305872 2024-09-14T10:51:32.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.893+0000 7f19187cc780 1 < completed part key=_multipart_RTGE7ISETJWW.2~34EIBDMDJ7DS.0 size=503800 2024-09-14T10:51:32.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.896+0000 7f19187cc780 1 < completed multipart upload key=RTGE7ISETJWW upload=34EIBDMDJ7DS tag=OCI65E6YBUYO type=write size=1552376 2024-09-14T10:51:32.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.897+0000 7f19187cc780 1 > prepared operation key=19P3WE6HKJH2 tag=4E8AOT6B7150 type=del size=2673824 2024-09-14T10:51:32.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.899+0000 7f19187cc780 1 < completed part key=_multipart_RTGE7ISETJWW.2~ZD458FMMQZ9H.0 size=1048576 2024-09-14T10:51:32.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.900+0000 7f19187cc780 1 < completed part key=_multipart_RTGE7ISETJWW.2~ZD458FMMQZ9H.1 size=783654 2024-09-14T10:51:32.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.902+0000 7f19187cc780 1 < completed multipart upload key=RTGE7ISETJWW upload=ZD458FMMQZ9H tag=B1R84USZC4NG type=write size=2880806 2024-09-14T10:51:32.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.904+0000 7f19187cc780 1 > prepared operation key=54BSD3DEHNK6 tag=L7D5UQBV8VBA type=del size=3688780 2024-09-14T10:51:32.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.905+0000 7f19187cc780 1 < completed delete operation key=617QQI921HB4 tag=HIQ4097JXBLG type=del 2024-09-14T10:51:32.905 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.907+0000 7f19187cc780 1 > prepared operation key=RTGE7ISETJWW tag=MSKA1PKBZM3L type=write size=163362 2024-09-14T10:51:32.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.908+0000 7f19187cc780 1 < completed delete operation key=OVOPGTYUF3F3 tag=5TYXNWMYXW2C type=del 2024-09-14T10:51:32.908 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.910+0000 7f19187cc780 1 > prepared operation key=INJQTKXHBUV2 tag=AQDQE0XSZQP8 type=del size=3089047 2024-09-14T10:51:32.909 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.911+0000 7f19187cc780 1 < completed write operation key=54BSD3DEHNK6 tag=C49OZR5EN84V type=write size=404178 2024-09-14T10:51:32.911 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.912+0000 7f19187cc780 1 > prepared operation key=H40763V7HMBC tag=ZVWJOW3CY323 type=del size=1781806 2024-09-14T10:51:32.912 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.914+0000 7f19187cc780 1 < completed delete operation key=KP3WOGIF30PZ tag=VF55RBIO3UVJ type=del 2024-09-14T10:51:32.914 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.915+0000 7f19187cc780 1 > prepared operation key=54BSD3DEHNK6 tag=AWT3FJ8SORG6 type=write size=937539 2024-09-14T10:51:32.915 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.917+0000 7f19187cc780 1 < completed part key=_multipart_H40763V7HMBC.2~18O0Y1VRBRI7.0 size=384762 2024-09-14T10:51:32.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.919+0000 7f19187cc780 1 < completed multipart upload key=H40763V7HMBC upload=18O0Y1VRBRI7 tag=Z6T7SP1JQHG6 type=write size=1433338 2024-09-14T10:51:32.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.922+0000 7f19187cc780 1 > prepared part key=_multipart_54BSD3DEHNK6.2~I4NL65ZXPBT3.0 size=748086 2024-09-14T10:51:32.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.922+0000 7f19187cc780 1 > prepared multipart upload key=54BSD3DEHNK6 upload=I4NL65ZXPBT3 tag=ELZX4HAQ4E9D type=write size=1796662 2024-09-14T10:51:32.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.923+0000 7f19187cc780 1 < completed delete operation key=7IWUW2HC3ULI tag=IW5CINR9YXON type=del 2024-09-14T10:51:32.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.925+0000 7f19187cc780 1 > prepared operation key=OVOPGTYUF3F3 tag=6ODMBJYLWA9J type=write size=950600 2024-09-14T10:51:32.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.926+0000 7f19187cc780 1 < completed part key=_multipart_75O00VMLJJ1X.2~B16PPOPH3331.0 size=1048576 2024-09-14T10:51:32.926 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.928+0000 7f19187cc780 1 < completed part key=_multipart_75O00VMLJJ1X.2~B16PPOPH3331.1 size=1048576 2024-09-14T10:51:32.927 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.929+0000 7f19187cc780 1 < completed part key=_multipart_75O00VMLJJ1X.2~B16PPOPH3331.2 size=462032 2024-09-14T10:51:32.930 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.932+0000 7f19187cc780 1 < completed multipart upload key=75O00VMLJJ1X upload=B16PPOPH3331 tag=M5ZSPSHQIM06 type=write size=3607760 2024-09-14T10:51:32.933 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.935+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~O2JZJ81FJB3G.0 size=433578 2024-09-14T10:51:32.933 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.935+0000 7f19187cc780 1 > prepared multipart upload key=7IWUW2HC3ULI upload=O2JZJ81FJB3G tag=JZROKJ7Q8KCH type=write size=1482154 2024-09-14T10:51:32.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.936+0000 7f19187cc780 1 < completed delete operation key=N0L67LS2KHR1 tag=LQB98KDKLSXX type=del 2024-09-14T10:51:32.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.938+0000 7f19187cc780 1 > prepared operation key=EZLSMEK89N2G tag=PMU3LDLDRUC3 type=del size=2817451 2024-09-14T10:51:32.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.939+0000 7f19187cc780 1 < completed part key=_multipart_OVOPGTYUF3F3.2~NKII0V3PXCBK.0 size=1048576 2024-09-14T10:51:32.939 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.941+0000 7f19187cc780 1 < completed part key=_multipart_OVOPGTYUF3F3.2~NKII0V3PXCBK.1 size=1048576 2024-09-14T10:51:32.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.942+0000 7f19187cc780 1 < completed part key=_multipart_OVOPGTYUF3F3.2~NKII0V3PXCBK.2 size=104968 2024-09-14T10:51:32.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.945+0000 7f19187cc780 1 < completed multipart upload key=OVOPGTYUF3F3 upload=NKII0V3PXCBK tag=LT0KP1DQFJHJ type=write size=3250696 2024-09-14T10:51:32.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.946+0000 7f19187cc780 1 > prepared operation key=M73CER01XHDY tag=74V9WAJMGHGP type=del size=2969484 2024-09-14T10:51:32.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.948+0000 7f19187cc780 1 < completed part key=_multipart_CADC2BY888V1.2~AL75LWV7E52N.0 size=810578 2024-09-14T10:51:32.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.950+0000 7f19187cc780 1 < completed multipart upload key=CADC2BY888V1 upload=AL75LWV7E52N tag=9BWXE6I9HSKM type=write size=1859154 2024-09-14T10:51:32.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.952+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~N8V13WA3F8FV.0 size=82635 2024-09-14T10:51:32.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.952+0000 7f19187cc780 1 > prepared multipart upload key=VW6U36JN2DBX upload=N8V13WA3F8FV tag=835XK5AEL6PK type=write size=1131211 2024-09-14T10:51:32.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.953+0000 7f19187cc780 1 < canceled part key=_multipart_KOJ7QB7M6A35.2~1ZRJ3WCOFB0U.0 size=1048576 2024-09-14T10:51:32.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.954+0000 7f19187cc780 1 < completed part key=_multipart_KOJ7QB7M6A35.2~1ZRJ3WCOFB0U.1 size=1048576 2024-09-14T10:51:32.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.955+0000 7f19187cc780 1 < completed part key=_multipart_KOJ7QB7M6A35.2~1ZRJ3WCOFB0U.2 size=434093 2024-09-14T10:51:32.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.957+0000 7f19187cc780 1 < canceled multipart upload key=KOJ7QB7M6A35 upload=1ZRJ3WCOFB0U tag=19B6XSS0ZMWV type=write size=3579821 2024-09-14T10:51:32.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.958+0000 7f19187cc780 1 > prepared operation key=INJQTKXHBUV2 tag=EO75PKYANQO1 type=del size=2954153 2024-09-14T10:51:32.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.960+0000 7f19187cc780 1 < completed delete operation key=61O2VU0SB379 tag=OGTE2QH2K80K type=del 2024-09-14T10:51:32.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.962+0000 7f19187cc780 1 > prepared operation key=QBMNYNWOLK4I tag=4JIGTORTXTBF type=del size=2941112 2024-09-14T10:51:32.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.963+0000 7f19187cc780 1 < completed write operation key=19P3WE6HKJH2 tag=CESM72A1O0K3 type=write size=377232 2024-09-14T10:51:32.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.964+0000 7f19187cc780 1 > prepared operation key=RTGE7ISETJWW tag=O3DQHH0Y597O type=del size=1872347 2024-09-14T10:51:32.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.966+0000 7f19187cc780 1 < canceled operation key=75O00VMLJJ1X tag=Y1B1W6KKDTHU type=del size=305872 2024-09-14T10:51:32.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.969+0000 7f19187cc780 1 > prepared part key=_multipart_75O00VMLJJ1X.2~KHR4BA9RKGF5.0 size=1048576 2024-09-14T10:51:32.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.971+0000 7f19187cc780 1 > prepared part key=_multipart_75O00VMLJJ1X.2~KHR4BA9RKGF5.1 size=978518 2024-09-14T10:51:32.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.971+0000 7f19187cc780 1 > prepared multipart upload key=75O00VMLJJ1X upload=KHR4BA9RKGF5 tag=ULS3DP3GBAFM type=write size=3075670 2024-09-14T10:51:32.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.972+0000 7f19187cc780 1 < completed delete operation key=19P3WE6HKJH2 tag=4E8AOT6B7150 type=del 2024-09-14T10:51:32.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.973+0000 7f19187cc780 1 > prepared operation key=EZLSMEK89N2G tag=RN99OM5STG60 type=del size=1813591 2024-09-14T10:51:32.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.975+0000 7f19187cc780 1 < canceled operation key=54BSD3DEHNK6 tag=L7D5UQBV8VBA type=del size=3688780 2024-09-14T10:51:32.976 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.978+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~9VKGYL149OO4.0 size=1048576 2024-09-14T10:51:32.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.979+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~9VKGYL149OO4.1 size=325273 2024-09-14T10:51:32.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.979+0000 7f19187cc780 1 > prepared multipart upload key=VW6U36JN2DBX upload=9VKGYL149OO4 tag=SDSRPRH3AM6Y type=write size=2422425 2024-09-14T10:51:32.979 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.980+0000 7f19187cc780 1 < completed write operation key=RTGE7ISETJWW tag=MSKA1PKBZM3L type=write size=163362 2024-09-14T10:51:32.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.983+0000 7f19187cc780 1 > prepared part key=_multipart_19P3WE6HKJH2.2~WLYKJ51XOY2H.0 size=1048576 2024-09-14T10:51:32.982 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.984+0000 7f19187cc780 1 > prepared part key=_multipart_19P3WE6HKJH2.2~WLYKJ51XOY2H.1 size=1048576 2024-09-14T10:51:32.983 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.985+0000 7f19187cc780 1 > prepared part key=_multipart_19P3WE6HKJH2.2~WLYKJ51XOY2H.2 size=224213 2024-09-14T10:51:32.983 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.985+0000 7f19187cc780 1 > prepared multipart upload key=19P3WE6HKJH2 upload=WLYKJ51XOY2H tag=HE04J21RTINV type=write size=3369941 2024-09-14T10:51:32.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.986+0000 7f19187cc780 1 < completed delete operation key=INJQTKXHBUV2 tag=AQDQE0XSZQP8 type=del 2024-09-14T10:51:32.986 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.988+0000 7f19187cc780 1 > prepared operation key=MFA30GSMCSKP tag=UFIW2ERXNPDP type=del size=2853172 2024-09-14T10:51:32.987 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.989+0000 7f19187cc780 1 < completed delete operation key=H40763V7HMBC tag=ZVWJOW3CY323 type=del 2024-09-14T10:51:32.990 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.992+0000 7f19187cc780 1 > prepared part key=_multipart_EZLSMEK89N2G.2~EC20WTBAVVXR.0 size=1048576 2024-09-14T10:51:32.991 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.993+0000 7f19187cc780 1 > prepared part key=_multipart_EZLSMEK89N2G.2~EC20WTBAVVXR.1 size=1001192 2024-09-14T10:51:32.991 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.993+0000 7f19187cc780 1 > prepared multipart upload key=EZLSMEK89N2G upload=EC20WTBAVVXR tag=064FM86BJHWV type=write size=3098344 2024-09-14T10:51:32.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.996+0000 7f19187cc780 1 < suggested update operation key=54BSD3DEHNK6 tag=AWT3FJ8SORG6 type=write size=937539 2024-09-14T10:51:32.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.997+0000 7f19187cc780 1 > prepared operation key=CADC2BY888V1 tag=68ULGWGJV7TY type=write size=743885 2024-09-14T10:51:32.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:32.998+0000 7f19187cc780 1 < completed part key=_multipart_54BSD3DEHNK6.2~I4NL65ZXPBT3.0 size=748086 2024-09-14T10:51:32.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.001+0000 7f19187cc780 1 < completed multipart upload key=54BSD3DEHNK6 upload=I4NL65ZXPBT3 tag=ELZX4HAQ4E9D type=write size=1796662 2024-09-14T10:51:33.001 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.002+0000 7f19187cc780 1 > prepared operation key=AST81B9QWORT tag=N88RWQQN306Z type=write size=154052 2024-09-14T10:51:33.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.005+0000 7f19187cc780 1 < canceled operation key=OVOPGTYUF3F3 tag=6ODMBJYLWA9J type=write size=950600 2024-09-14T10:51:33.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.006+0000 7f19187cc780 1 > prepared operation key=54BSD3DEHNK6 tag=S3WT0MTMEDFP type=del size=203747 2024-09-14T10:51:33.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.008+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~O2JZJ81FJB3G.0 size=433578 2024-09-14T10:51:33.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.010+0000 7f19187cc780 1 < completed multipart upload key=7IWUW2HC3ULI upload=O2JZJ81FJB3G tag=JZROKJ7Q8KCH type=write size=1482154 2024-09-14T10:51:33.011 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.013+0000 7f19187cc780 1 > prepared part key=_multipart_RTGE7ISETJWW.2~EG47P6Z7REOJ.0 size=1048576 2024-09-14T10:51:33.012 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.014+0000 7f19187cc780 1 > prepared part key=_multipart_RTGE7ISETJWW.2~EG47P6Z7REOJ.1 size=1048576 2024-09-14T10:51:33.013 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.015+0000 7f19187cc780 1 > prepared part key=_multipart_RTGE7ISETJWW.2~EG47P6Z7REOJ.2 size=241783 2024-09-14T10:51:33.013 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.015+0000 7f19187cc780 1 > prepared multipart upload key=RTGE7ISETJWW upload=EG47P6Z7REOJ tag=J3E7PRHKS78C type=write size=3387511 2024-09-14T10:51:33.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.016+0000 7f19187cc780 1 < completed delete operation key=EZLSMEK89N2G tag=PMU3LDLDRUC3 type=del 2024-09-14T10:51:33.017 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.019+0000 7f19187cc780 1 > prepared part key=_multipart_19P3WE6HKJH2.2~71529V2RHZ2P.0 size=1048576 2024-09-14T10:51:33.019 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.020+0000 7f19187cc780 1 > prepared part key=_multipart_19P3WE6HKJH2.2~71529V2RHZ2P.1 size=1048576 2024-09-14T10:51:33.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.022+0000 7f19187cc780 1 > prepared part key=_multipart_19P3WE6HKJH2.2~71529V2RHZ2P.2 size=334110 2024-09-14T10:51:33.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.022+0000 7f19187cc780 1 > prepared multipart upload key=19P3WE6HKJH2 upload=71529V2RHZ2P tag=9XMQHKFVLGMO type=write size=3479838 2024-09-14T10:51:33.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.023+0000 7f19187cc780 1 < completed delete operation key=M73CER01XHDY tag=74V9WAJMGHGP type=del 2024-09-14T10:51:33.024 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.026+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~1XOZQDVZBR81.0 size=1048576 2024-09-14T10:51:33.026 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.027+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~1XOZQDVZBR81.1 size=191720 2024-09-14T10:51:33.026 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.027+0000 7f19187cc780 1 > prepared multipart upload key=VW6U36JN2DBX upload=1XOZQDVZBR81 tag=D1RS29DUUCR5 type=write size=2288872 2024-09-14T10:51:33.028 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.030+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~N8V13WA3F8FV.0 size=82635 2024-09-14T10:51:33.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.032+0000 7f19187cc780 1 < completed multipart upload key=VW6U36JN2DBX upload=N8V13WA3F8FV tag=835XK5AEL6PK type=write size=1131211 2024-09-14T10:51:33.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.033+0000 7f19187cc780 1 > prepared operation key=IKVYA4KEALFF tag=J3B1PF3NZ9SJ type=del size=1798910 2024-09-14T10:51:33.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.035+0000 7f19187cc780 1 < completed delete operation key=INJQTKXHBUV2 tag=EO75PKYANQO1 type=del 2024-09-14T10:51:33.037 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.038+0000 7f19187cc780 1 > prepared part key=_multipart_EL00Y4Z7DTAT.2~YFBN9JI79YRB.0 size=1048576 2024-09-14T10:51:33.038 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.039+0000 7f19187cc780 1 > prepared part key=_multipart_EL00Y4Z7DTAT.2~YFBN9JI79YRB.1 size=1048576 2024-09-14T10:51:33.039 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.040+0000 7f19187cc780 1 > prepared part key=_multipart_EL00Y4Z7DTAT.2~YFBN9JI79YRB.2 size=931573 2024-09-14T10:51:33.039 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.040+0000 7f19187cc780 1 > prepared multipart upload key=EL00Y4Z7DTAT upload=YFBN9JI79YRB tag=SXBX3XHD745O type=write size=4077301 2024-09-14T10:51:33.042 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.044+0000 7f19187cc780 1 < suggested remove operation key=QBMNYNWOLK4I tag=4JIGTORTXTBF type=del 2024-09-14T10:51:33.044 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.045+0000 7f19187cc780 1 > prepared operation key=61O2VU0SB379 tag=60UDQJJXEJSJ type=del size=564610 2024-09-14T10:51:33.045 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.047+0000 7f19187cc780 1 < canceled operation key=RTGE7ISETJWW tag=O3DQHH0Y597O type=del size=1872347 2024-09-14T10:51:33.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.048+0000 7f19187cc780 1 > prepared operation key=N0L67LS2KHR1 tag=HL4RAKX9RSQ3 type=del size=4111018 2024-09-14T10:51:33.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.049+0000 7f19187cc780 1 < canceled part key=_multipart_75O00VMLJJ1X.2~KHR4BA9RKGF5.0 size=1048576 2024-09-14T10:51:33.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.049+0000 7f19187cc780 1 < canceled part key=_multipart_75O00VMLJJ1X.2~KHR4BA9RKGF5.1 size=978518 2024-09-14T10:51:33.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.051+0000 7f19187cc780 1 < canceled multipart upload key=75O00VMLJJ1X upload=KHR4BA9RKGF5 tag=ULS3DP3GBAFM type=write size=3075670 2024-09-14T10:51:33.051 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.052+0000 7f19187cc780 1 > prepared operation key=M73CER01XHDY tag=P4UIKEPTHAKI type=del size=2124826 2024-09-14T10:51:33.052 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.054+0000 7f19187cc780 1 < completed delete operation key=EZLSMEK89N2G tag=RN99OM5STG60 type=del 2024-09-14T10:51:33.053 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.055+0000 7f19187cc780 1 > prepared operation key=W1K1IU13J0CZ tag=BKM1H9ODSHHT type=del size=2296799 2024-09-14T10:51:33.055 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.057+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~9VKGYL149OO4.0 size=1048576 2024-09-14T10:51:33.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.058+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~9VKGYL149OO4.1 size=325273 2024-09-14T10:51:33.058 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.060+0000 7f19187cc780 1 < completed multipart upload key=VW6U36JN2DBX upload=9VKGYL149OO4 tag=SDSRPRH3AM6Y type=write size=2422425 2024-09-14T10:51:33.060 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.062+0000 7f19187cc780 1 > prepared operation key=YA3DI7N4DG5K tag=DCS3BLW3NZLM type=write size=889395 2024-09-14T10:51:33.062 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.063+0000 7f19187cc780 1 < completed part key=_multipart_19P3WE6HKJH2.2~WLYKJ51XOY2H.0 size=1048576 2024-09-14T10:51:33.063 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.064+0000 7f19187cc780 1 < completed part key=_multipart_19P3WE6HKJH2.2~WLYKJ51XOY2H.1 size=1048576 2024-09-14T10:51:33.064 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.066+0000 7f19187cc780 1 < completed part key=_multipart_19P3WE6HKJH2.2~WLYKJ51XOY2H.2 size=224213 2024-09-14T10:51:33.066 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.068+0000 7f19187cc780 1 < completed multipart upload key=19P3WE6HKJH2 upload=WLYKJ51XOY2H tag=HE04J21RTINV type=write size=3369941 2024-09-14T10:51:33.068 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.069+0000 7f19187cc780 1 > prepared operation key=YA3DI7N4DG5K tag=ZD23XARYPF04 type=write size=213317 2024-09-14T10:51:33.070 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.072+0000 7f19187cc780 1 < suggested update operation key=MFA30GSMCSKP tag=UFIW2ERXNPDP type=del size=2853172 2024-09-14T10:51:33.072 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.074+0000 7f19187cc780 1 > prepared operation key=617QQI921HB4 tag=9CSE00LSKWHW type=del size=3086419 2024-09-14T10:51:33.074 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.075+0000 7f19187cc780 1 < completed part key=_multipart_EZLSMEK89N2G.2~EC20WTBAVVXR.0 size=1048576 2024-09-14T10:51:33.074 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.075+0000 7f19187cc780 1 < canceled part key=_multipart_EZLSMEK89N2G.2~EC20WTBAVVXR.1 size=1001192 2024-09-14T10:51:33.076 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.078+0000 7f19187cc780 1 < canceled multipart upload key=EZLSMEK89N2G upload=EC20WTBAVVXR tag=064FM86BJHWV type=write size=3098344 2024-09-14T10:51:33.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.079+0000 7f19187cc780 1 > prepared operation key=75O00VMLJJ1X tag=HJBG3651VK7A type=write size=965328 2024-09-14T10:51:33.079 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.081+0000 7f19187cc780 1 < completed write operation key=CADC2BY888V1 tag=68ULGWGJV7TY type=write size=743885 2024-09-14T10:51:33.081 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.082+0000 7f19187cc780 1 > prepared operation key=MFA30GSMCSKP tag=Y581TV6V948T type=del size=695010 2024-09-14T10:51:33.082 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.084+0000 7f19187cc780 1 < completed write operation key=AST81B9QWORT tag=N88RWQQN306Z type=write size=154052 2024-09-14T10:51:33.086 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.087+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~U5TT2YJG26QU.0 size=1048576 2024-09-14T10:51:33.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.088+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~U5TT2YJG26QU.1 size=1048576 2024-09-14T10:51:33.088 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.089+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~U5TT2YJG26QU.2 size=229698 2024-09-14T10:51:33.088 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.089+0000 7f19187cc780 1 > prepared multipart upload key=7IWUW2HC3ULI upload=U5TT2YJG26QU tag=O81NOSPB83MD type=write size=3375426 2024-09-14T10:51:33.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.092+0000 7f19187cc780 1 < suggested remove operation key=54BSD3DEHNK6 tag=S3WT0MTMEDFP type=del 2024-09-14T10:51:33.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.095+0000 7f19187cc780 1 > prepared part key=_multipart_QFEI6H4EQ9ZR.2~XVECIE90WPYX.0 size=182288 2024-09-14T10:51:33.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.095+0000 7f19187cc780 1 > prepared multipart upload key=QFEI6H4EQ9ZR upload=XVECIE90WPYX tag=V1Y3DD4GHW6J type=write size=1230864 2024-09-14T10:51:33.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.097+0000 7f19187cc780 1 < completed part key=_multipart_RTGE7ISETJWW.2~EG47P6Z7REOJ.0 size=1048576 2024-09-14T10:51:33.097 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.098+0000 7f19187cc780 1 < completed part key=_multipart_RTGE7ISETJWW.2~EG47P6Z7REOJ.1 size=1048576 2024-09-14T10:51:33.098 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.099+0000 7f19187cc780 1 < completed part key=_multipart_RTGE7ISETJWW.2~EG47P6Z7REOJ.2 size=241783 2024-09-14T10:51:33.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.102+0000 7f19187cc780 1 < completed multipart upload key=RTGE7ISETJWW upload=EG47P6Z7REOJ tag=J3E7PRHKS78C type=write size=3387511 2024-09-14T10:51:33.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.104+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~A9TAOJARQ6KD.0 size=1048576 2024-09-14T10:51:33.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.107+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~A9TAOJARQ6KD.1 size=678938 2024-09-14T10:51:33.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.107+0000 7f19187cc780 1 > prepared multipart upload key=6BNN842ZTWG5 upload=A9TAOJARQ6KD tag=U67GF59F10JZ type=write size=2776090 2024-09-14T10:51:33.107 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.108+0000 7f19187cc780 1 < completed part key=_multipart_19P3WE6HKJH2.2~71529V2RHZ2P.0 size=1048576 2024-09-14T10:51:33.107 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.108+0000 7f19187cc780 1 < canceled part key=_multipart_19P3WE6HKJH2.2~71529V2RHZ2P.1 size=1048576 2024-09-14T10:51:33.107 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.108+0000 7f19187cc780 1 < canceled part key=_multipart_19P3WE6HKJH2.2~71529V2RHZ2P.2 size=334110 2024-09-14T10:51:33.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.111+0000 7f19187cc780 1 < canceled multipart upload key=19P3WE6HKJH2 upload=71529V2RHZ2P tag=9XMQHKFVLGMO type=write size=3479838 2024-09-14T10:51:33.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.112+0000 7f19187cc780 1 > prepared operation key=AST81B9QWORT tag=U0JQINCW00VD type=del size=955349 2024-09-14T10:51:33.112 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.114+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~1XOZQDVZBR81.0 size=1048576 2024-09-14T10:51:33.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.115+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~1XOZQDVZBR81.1 size=191720 2024-09-14T10:51:33.116 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.117+0000 7f19187cc780 1 < completed multipart upload key=VW6U36JN2DBX upload=1XOZQDVZBR81 tag=D1RS29DUUCR5 type=write size=2288872 2024-09-14T10:51:33.117 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.119+0000 7f19187cc780 1 > prepared operation key=B9FQYIX19AEP tag=7EHB19RC26WK type=del size=681164 2024-09-14T10:51:33.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.122+0000 7f19187cc780 1 < suggested update operation key=IKVYA4KEALFF tag=J3B1PF3NZ9SJ type=del size=1798910 2024-09-14T10:51:33.124 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.126+0000 7f19187cc780 1 > prepared part key=_multipart_H40763V7HMBC.2~Q32Z5KCPS0YR.0 size=1048576 2024-09-14T10:51:33.126 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.128+0000 7f19187cc780 1 > prepared part key=_multipart_H40763V7HMBC.2~Q32Z5KCPS0YR.1 size=801432 2024-09-14T10:51:33.126 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.128+0000 7f19187cc780 1 > prepared multipart upload key=H40763V7HMBC upload=Q32Z5KCPS0YR tag=XT95757HOJNP type=write size=2898584 2024-09-14T10:51:33.128 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.130+0000 7f19187cc780 1 < completed part key=_multipart_EL00Y4Z7DTAT.2~YFBN9JI79YRB.0 size=1048576 2024-09-14T10:51:33.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.131+0000 7f19187cc780 1 < completed part key=_multipart_EL00Y4Z7DTAT.2~YFBN9JI79YRB.1 size=1048576 2024-09-14T10:51:33.130 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.132+0000 7f19187cc780 1 < completed part key=_multipart_EL00Y4Z7DTAT.2~YFBN9JI79YRB.2 size=931573 2024-09-14T10:51:33.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.134+0000 7f19187cc780 1 < completed multipart upload key=EL00Y4Z7DTAT upload=YFBN9JI79YRB tag=SXBX3XHD745O type=write size=4077301 2024-09-14T10:51:33.134 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.136+0000 7f19187cc780 1 > prepared operation key=M73CER01XHDY tag=6GMNYES1TXIF type=del size=2024419 2024-09-14T10:51:33.137 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.139+0000 7f19187cc780 1 < suggested remove operation key=61O2VU0SB379 tag=60UDQJJXEJSJ type=del 2024-09-14T10:51:33.140 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.142+0000 7f19187cc780 1 > prepared part key=_multipart_QBMNYNWOLK4I.2~W0MMBT31BMHR.0 size=1048576 2024-09-14T10:51:33.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.143+0000 7f19187cc780 1 > prepared part key=_multipart_QBMNYNWOLK4I.2~W0MMBT31BMHR.1 size=1048576 2024-09-14T10:51:33.142 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.144+0000 7f19187cc780 1 > prepared part key=_multipart_QBMNYNWOLK4I.2~W0MMBT31BMHR.2 size=512915 2024-09-14T10:51:33.142 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.144+0000 7f19187cc780 1 > prepared multipart upload key=QBMNYNWOLK4I upload=W0MMBT31BMHR tag=KP9GHLN48FXQ type=write size=3658643 2024-09-14T10:51:33.144 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.145+0000 7f19187cc780 1 < completed delete operation key=N0L67LS2KHR1 tag=HL4RAKX9RSQ3 type=del 2024-09-14T10:51:33.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.147+0000 7f19187cc780 1 > prepared operation key=AGNUE76X8XCJ tag=0W5VASYREBQE type=del size=2523276 2024-09-14T10:51:33.148 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.150+0000 7f19187cc780 1 < suggested remove operation key=M73CER01XHDY tag=P4UIKEPTHAKI type=del 2024-09-14T10:51:33.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.151+0000 7f19187cc780 1 > prepared operation key=CADC2BY888V1 tag=SFMAURRR3XMS type=del size=2515882 2024-09-14T10:51:33.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.152+0000 7f19187cc780 1 < completed delete operation key=W1K1IU13J0CZ tag=BKM1H9ODSHHT type=del 2024-09-14T10:51:33.152 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.154+0000 7f19187cc780 1 > prepared operation key=RTGE7ISETJWW tag=PZFDQ3RT9N88 type=del size=3318056 2024-09-14T10:51:33.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.155+0000 7f19187cc780 1 < completed write operation key=YA3DI7N4DG5K tag=DCS3BLW3NZLM type=write size=889395 2024-09-14T10:51:33.156 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.158+0000 7f19187cc780 1 > prepared part key=_multipart_E6UO1LUWOC44.2~SBQLOA96TRCS.0 size=444508 2024-09-14T10:51:33.156 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.158+0000 7f19187cc780 1 > prepared multipart upload key=E6UO1LUWOC44 upload=SBQLOA96TRCS tag=9Q62NUWUVSMZ type=write size=1493084 2024-09-14T10:51:33.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.160+0000 7f19187cc780 1 < suggested remove operation key=YA3DI7N4DG5K tag=ZD23XARYPF04 type=write 2024-09-14T10:51:33.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.163+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~MT6DB30GNQGG.0 size=894397 2024-09-14T10:51:33.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.163+0000 7f19187cc780 1 > prepared multipart upload key=AGNUE76X8XCJ upload=MT6DB30GNQGG tag=EKPLY4H24RUL type=write size=1942973 2024-09-14T10:51:33.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.164+0000 7f19187cc780 1 < completed delete operation key=617QQI921HB4 tag=9CSE00LSKWHW type=del 2024-09-14T10:51:33.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.167+0000 7f19187cc780 1 > prepared part key=_multipart_H40763V7HMBC.2~9M6F0JT8CE59.0 size=406009 2024-09-14T10:51:33.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.167+0000 7f19187cc780 1 > prepared multipart upload key=H40763V7HMBC upload=9M6F0JT8CE59 tag=DEXRQX9FCR17 type=write size=1454585 2024-09-14T10:51:33.168 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.170+0000 7f19187cc780 1 < suggested remove operation key=75O00VMLJJ1X tag=HJBG3651VK7A type=write 2024-09-14T10:51:33.169 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.171+0000 7f19187cc780 1 > prepared operation key=CADC2BY888V1 tag=G51NRHYDEWZ7 type=del size=931535 2024-09-14T10:51:33.171 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.172+0000 7f19187cc780 1 < completed delete operation key=MFA30GSMCSKP tag=Y581TV6V948T type=del 2024-09-14T10:51:33.172 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.174+0000 7f19187cc780 1 > prepared operation key=6BNN842ZTWG5 tag=MJ2YDMTHITGJ type=del size=2540947 2024-09-14T10:51:33.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.175+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~U5TT2YJG26QU.0 size=1048576 2024-09-14T10:51:33.175 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.177+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~U5TT2YJG26QU.1 size=1048576 2024-09-14T10:51:33.176 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.178+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~U5TT2YJG26QU.2 size=229698 2024-09-14T10:51:33.178 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.180+0000 7f19187cc780 1 < completed multipart upload key=7IWUW2HC3ULI upload=U5TT2YJG26QU tag=O81NOSPB83MD type=write size=3375426 2024-09-14T10:51:33.181 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.183+0000 7f19187cc780 1 > prepared part key=_multipart_EZLSMEK89N2G.2~TH7AGHE0FIUY.0 size=1048576 2024-09-14T10:51:33.182 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.184+0000 7f19187cc780 1 > prepared part key=_multipart_EZLSMEK89N2G.2~TH7AGHE0FIUY.1 size=1048576 2024-09-14T10:51:33.183 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.185+0000 7f19187cc780 1 > prepared part key=_multipart_EZLSMEK89N2G.2~TH7AGHE0FIUY.2 size=254390 2024-09-14T10:51:33.184 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.185+0000 7f19187cc780 1 > prepared multipart upload key=EZLSMEK89N2G upload=TH7AGHE0FIUY tag=HKXWP22OJHKR type=write size=3400118 2024-09-14T10:51:33.184 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.185+0000 7f19187cc780 1 < canceled part key=_multipart_QFEI6H4EQ9ZR.2~XVECIE90WPYX.0 size=182288 2024-09-14T10:51:33.186 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.187+0000 7f19187cc780 1 < canceled multipart upload key=QFEI6H4EQ9ZR upload=XVECIE90WPYX tag=V1Y3DD4GHW6J type=write size=1230864 2024-09-14T10:51:33.187 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.189+0000 7f19187cc780 1 > prepared operation key=N0L67LS2KHR1 tag=XL8LIEQAXZAE type=del size=192682 2024-09-14T10:51:33.188 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.190+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~A9TAOJARQ6KD.0 size=1048576 2024-09-14T10:51:33.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.191+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~A9TAOJARQ6KD.1 size=678938 2024-09-14T10:51:33.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.193+0000 7f19187cc780 1 < completed multipart upload key=6BNN842ZTWG5 upload=A9TAOJARQ6KD tag=U67GF59F10JZ type=write size=2776090 2024-09-14T10:51:33.196 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.196+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~G7BNR6D0K0DM.0 size=1048576 2024-09-14T10:51:33.196 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.197+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~G7BNR6D0K0DM.1 size=658200 2024-09-14T10:51:33.196 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.197+0000 7f19187cc780 1 > prepared multipart upload key=B9FQYIX19AEP upload=G7BNR6D0K0DM tag=PJL2CBFDV6OB type=write size=2755352 2024-09-14T10:51:33.197 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.199+0000 7f19187cc780 1 < completed delete operation key=AST81B9QWORT tag=U0JQINCW00VD type=del 2024-09-14T10:51:33.199 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.200+0000 7f19187cc780 1 > prepared operation key=19P3WE6HKJH2 tag=Y26P9ZKPB5N4 type=del size=259972 2024-09-14T10:51:33.200 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.202+0000 7f19187cc780 1 < completed delete operation key=B9FQYIX19AEP tag=7EHB19RC26WK type=del 2024-09-14T10:51:33.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.203+0000 7f19187cc780 1 > prepared operation key=6BNN842ZTWG5 tag=G5JLYIV59GYD type=del size=1179120 2024-09-14T10:51:33.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.205+0000 7f19187cc780 1 < completed part key=_multipart_H40763V7HMBC.2~Q32Z5KCPS0YR.0 size=1048576 2024-09-14T10:51:33.204 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.205+0000 7f19187cc780 1 < canceled part key=_multipart_H40763V7HMBC.2~Q32Z5KCPS0YR.1 size=801432 2024-09-14T10:51:33.206 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.207+0000 7f19187cc780 1 < canceled multipart upload key=H40763V7HMBC upload=Q32Z5KCPS0YR tag=XT95757HOJNP type=write size=2898584 2024-09-14T10:51:33.207 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.209+0000 7f19187cc780 1 > prepared operation key=VW6U36JN2DBX tag=XSNHT4BMC5B3 type=write size=942151 2024-09-14T10:51:33.209 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.210+0000 7f19187cc780 -1 < failed to complete operation key=M73CER01XHDY tag=6GMNYES1TXIF type=del size=2024419: (22) Invalid argument 2024-09-14T10:51:33.211 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.213+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~MXYEXX1GS5F4.0 size=1048576 2024-09-14T10:51:33.212 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.214+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~MXYEXX1GS5F4.1 size=1048576 2024-09-14T10:51:33.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.215+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~MXYEXX1GS5F4.2 size=767040 2024-09-14T10:51:33.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.215+0000 7f19187cc780 1 > prepared multipart upload key=KOJ7QB7M6A35 upload=MXYEXX1GS5F4 tag=FT92DAL0QVKN type=write size=3912768 2024-09-14T10:51:33.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.217+0000 7f19187cc780 1 < completed part key=_multipart_QBMNYNWOLK4I.2~W0MMBT31BMHR.0 size=1048576 2024-09-14T10:51:33.216 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.218+0000 7f19187cc780 1 < completed part key=_multipart_QBMNYNWOLK4I.2~W0MMBT31BMHR.1 size=1048576 2024-09-14T10:51:33.217 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.219+0000 7f19187cc780 1 < completed part key=_multipart_QBMNYNWOLK4I.2~W0MMBT31BMHR.2 size=512915 2024-09-14T10:51:33.219 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.221+0000 7f19187cc780 1 < completed multipart upload key=QBMNYNWOLK4I upload=W0MMBT31BMHR tag=KP9GHLN48FXQ type=write size=3658643 2024-09-14T10:51:33.221 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.222+0000 7f19187cc780 1 > prepared operation key=M73CER01XHDY tag=MTHVZMF2GTW7 type=del size=2976919 2024-09-14T10:51:33.222 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.224+0000 7f19187cc780 1 < completed delete operation key=AGNUE76X8XCJ tag=0W5VASYREBQE type=del 2024-09-14T10:51:33.224 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.225+0000 7f19187cc780 1 > prepared operation key=QFEI6H4EQ9ZR tag=35NO4QRMHYNU type=write size=797283 2024-09-14T10:51:33.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.227+0000 7f19187cc780 1 < completed delete operation key=CADC2BY888V1 tag=SFMAURRR3XMS type=del 2024-09-14T10:51:33.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.231+0000 7f19187cc780 1 > prepared part key=_multipart_W1K1IU13J0CZ.2~U489712LKM55.0 size=1048576 2024-09-14T10:51:33.230 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.232+0000 7f19187cc780 1 > prepared part key=_multipart_W1K1IU13J0CZ.2~U489712LKM55.1 size=887717 2024-09-14T10:51:33.230 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.232+0000 7f19187cc780 1 > prepared multipart upload key=W1K1IU13J0CZ upload=U489712LKM55 tag=L7QDM149BVSR type=write size=2984869 2024-09-14T10:51:33.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.233+0000 7f19187cc780 1 < completed delete operation key=RTGE7ISETJWW tag=PZFDQ3RT9N88 type=del 2024-09-14T10:51:33.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.235+0000 7f19187cc780 1 > prepared operation key=54BSD3DEHNK6 tag=VD8WD5F2ZFPE type=del size=3648873 2024-09-14T10:51:33.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.237+0000 7f19187cc780 1 < completed part key=_multipart_E6UO1LUWOC44.2~SBQLOA96TRCS.0 size=444508 2024-09-14T10:51:33.237 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.239+0000 7f19187cc780 1 < completed multipart upload key=E6UO1LUWOC44 upload=SBQLOA96TRCS tag=9Q62NUWUVSMZ type=write size=1493084 2024-09-14T10:51:33.239 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.240+0000 7f19187cc780 1 > prepared operation key=MFA30GSMCSKP tag=TOTXWN1X5XCR type=del size=2048291 2024-09-14T10:51:33.240 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.242+0000 7f19187cc780 1 < completed part key=_multipart_AGNUE76X8XCJ.2~MT6DB30GNQGG.0 size=894397 2024-09-14T10:51:33.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.245+0000 7f19187cc780 1 < completed multipart upload key=AGNUE76X8XCJ upload=MT6DB30GNQGG tag=EKPLY4H24RUL type=write size=1942973 2024-09-14T10:51:33.247 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.248+0000 7f19187cc780 1 > prepared operation key=XCVE2F2JJK4X tag=148S7OM92CBZ type=del size=3352075 2024-09-14T10:51:33.248 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.250+0000 7f19187cc780 1 < completed part key=_multipart_H40763V7HMBC.2~9M6F0JT8CE59.0 size=406009 2024-09-14T10:51:33.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.252+0000 7f19187cc780 1 < completed multipart upload key=H40763V7HMBC upload=9M6F0JT8CE59 tag=DEXRQX9FCR17 type=write size=1454585 2024-09-14T10:51:33.253 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.254+0000 7f19187cc780 1 > prepared operation key=EL00Y4Z7DTAT tag=HTUKWH370JIX type=del size=4011110 2024-09-14T10:51:33.254 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.256+0000 7f19187cc780 1 < completed delete operation key=CADC2BY888V1 tag=G51NRHYDEWZ7 type=del 2024-09-14T10:51:33.255 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.257+0000 7f19187cc780 1 > prepared operation key=B9FQYIX19AEP tag=E1GA2S383BW0 type=del size=3059583 2024-09-14T10:51:33.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.260+0000 7f19187cc780 1 < suggested update operation key=6BNN842ZTWG5 tag=MJ2YDMTHITGJ type=del size=2540947 2024-09-14T10:51:33.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.261+0000 7f19187cc780 1 > prepared operation key=H40763V7HMBC tag=TGA4WIOTIRPU type=del size=3346525 2024-09-14T10:51:33.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.262+0000 7f19187cc780 1 < completed part key=_multipart_EZLSMEK89N2G.2~TH7AGHE0FIUY.0 size=1048576 2024-09-14T10:51:33.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.263+0000 7f19187cc780 1 < completed part key=_multipart_EZLSMEK89N2G.2~TH7AGHE0FIUY.1 size=1048576 2024-09-14T10:51:33.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.264+0000 7f19187cc780 1 < completed part key=_multipart_EZLSMEK89N2G.2~TH7AGHE0FIUY.2 size=254390 2024-09-14T10:51:33.267 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.268+0000 7f19187cc780 1 < completed multipart upload key=EZLSMEK89N2G upload=TH7AGHE0FIUY tag=HKXWP22OJHKR type=write size=3400118 2024-09-14T10:51:33.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.271+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~1NY139VG97NU.0 size=1048576 2024-09-14T10:51:33.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.272+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~1NY139VG97NU.1 size=865217 2024-09-14T10:51:33.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.272+0000 7f19187cc780 1 > prepared multipart upload key=B9FQYIX19AEP upload=1NY139VG97NU tag=MO7WVLRFE0ZA type=write size=2962369 2024-09-14T10:51:33.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.273+0000 7f19187cc780 1 < completed delete operation key=N0L67LS2KHR1 tag=XL8LIEQAXZAE type=del 2024-09-14T10:51:33.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.275+0000 7f19187cc780 1 > prepared operation key=7IWUW2HC3ULI tag=RIZDJ2VG0H8I type=del size=3630237 2024-09-14T10:51:33.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.276+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~G7BNR6D0K0DM.0 size=1048576 2024-09-14T10:51:33.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.277+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~G7BNR6D0K0DM.1 size=658200 2024-09-14T10:51:33.278 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.280+0000 7f19187cc780 1 < completed multipart upload key=B9FQYIX19AEP upload=G7BNR6D0K0DM tag=PJL2CBFDV6OB type=write size=2755352 2024-09-14T10:51:33.279 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.281+0000 7f19187cc780 1 > prepared operation key=IKVYA4KEALFF tag=4HJUJPUGB9R5 type=del size=3113927 2024-09-14T10:51:33.281 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.282+0000 7f19187cc780 1 < completed delete operation key=19P3WE6HKJH2 tag=Y26P9ZKPB5N4 type=del 2024-09-14T10:51:33.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.284+0000 7f19187cc780 1 > prepared operation key=QBMNYNWOLK4I tag=LKW6NA2PRK2O type=write size=871858 2024-09-14T10:51:33.284 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.285+0000 7f19187cc780 -1 < failed to complete operation key=6BNN842ZTWG5 tag=G5JLYIV59GYD type=del size=1179120: (22) Invalid argument 2024-09-14T10:51:33.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.287+0000 7f19187cc780 1 > prepared operation key=54BSD3DEHNK6 tag=RFVD8QE79Q6M type=del size=2769813 2024-09-14T10:51:33.288 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.289+0000 7f19187cc780 1 < suggested remove operation key=VW6U36JN2DBX tag=XSNHT4BMC5B3 type=write 2024-09-14T10:51:33.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.291+0000 7f19187cc780 1 > prepared operation key=6BNN842ZTWG5 tag=S6N5GL725ZD4 type=del size=1684592 2024-09-14T10:51:33.290 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.292+0000 7f19187cc780 1 < completed part key=_multipart_KOJ7QB7M6A35.2~MXYEXX1GS5F4.0 size=1048576 2024-09-14T10:51:33.292 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.293+0000 7f19187cc780 1 < completed part key=_multipart_KOJ7QB7M6A35.2~MXYEXX1GS5F4.1 size=1048576 2024-09-14T10:51:33.293 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.294+0000 7f19187cc780 1 < completed part key=_multipart_KOJ7QB7M6A35.2~MXYEXX1GS5F4.2 size=767040 2024-09-14T10:51:33.295 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.297+0000 7f19187cc780 1 < completed multipart upload key=KOJ7QB7M6A35 upload=MXYEXX1GS5F4 tag=FT92DAL0QVKN type=write size=3912768 2024-09-14T10:51:33.298 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.299+0000 7f19187cc780 1 > prepared part key=_multipart_QFEI6H4EQ9ZR.2~67E0NNG1SS61.0 size=808778 2024-09-14T10:51:33.298 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.299+0000 7f19187cc780 1 > prepared multipart upload key=QFEI6H4EQ9ZR upload=67E0NNG1SS61 tag=EETASWVQ3418 type=write size=1857354 2024-09-14T10:51:33.299 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.301+0000 7f19187cc780 1 < canceled operation key=M73CER01XHDY tag=MTHVZMF2GTW7 type=del size=2976919 2024-09-14T10:51:33.301 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.302+0000 7f19187cc780 1 > prepared operation key=19P3WE6HKJH2 tag=9XQYCMCIUJD3 type=write size=327238 2024-09-14T10:51:33.302 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.304+0000 7f19187cc780 1 < completed write operation key=QFEI6H4EQ9ZR tag=35NO4QRMHYNU type=write size=797283 2024-09-14T10:51:33.305 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.306+0000 7f19187cc780 1 > prepared part key=_multipart_75O00VMLJJ1X.2~27UFA04ZEUOU.0 size=1048576 2024-09-14T10:51:33.306 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.307+0000 7f19187cc780 1 > prepared part key=_multipart_75O00VMLJJ1X.2~27UFA04ZEUOU.1 size=215741 2024-09-14T10:51:33.306 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.307+0000 7f19187cc780 1 > prepared multipart upload key=75O00VMLJJ1X upload=27UFA04ZEUOU tag=D4JVIBD5OKNM type=write size=2312893 2024-09-14T10:51:33.307 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.309+0000 7f19187cc780 1 < completed part key=_multipart_W1K1IU13J0CZ.2~U489712LKM55.0 size=1048576 2024-09-14T10:51:33.308 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.310+0000 7f19187cc780 1 < completed part key=_multipart_W1K1IU13J0CZ.2~U489712LKM55.1 size=887717 2024-09-14T10:51:33.311 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.312+0000 7f19187cc780 1 < completed multipart upload key=W1K1IU13J0CZ upload=U489712LKM55 tag=L7QDM149BVSR type=write size=2984869 2024-09-14T10:51:33.313 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.315+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~9CO9WC4L7X1C.0 size=333865 2024-09-14T10:51:33.314 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.315+0000 7f19187cc780 1 > prepared multipart upload key=B9FQYIX19AEP upload=9CO9WC4L7X1C tag=MM2RV7B4OFC5 type=write size=1382441 2024-09-14T10:51:33.315 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.316+0000 7f19187cc780 1 < completed delete operation key=54BSD3DEHNK6 tag=VD8WD5F2ZFPE type=del 2024-09-14T10:51:33.317 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.319+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~EWEHKCGZYPHJ.0 size=910813 2024-09-14T10:51:33.317 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.319+0000 7f19187cc780 1 > prepared multipart upload key=OVOPGTYUF3F3 upload=EWEHKCGZYPHJ tag=EM32A3FCE5DP type=write size=1959389 2024-09-14T10:51:33.321 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.323+0000 7f19187cc780 1 < suggested update operation key=MFA30GSMCSKP tag=TOTXWN1X5XCR type=del size=2048291 2024-09-14T10:51:33.324 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.326+0000 7f19187cc780 1 > prepared part key=_multipart_54BSD3DEHNK6.2~CUPTQKC3PE7J.0 size=1048576 2024-09-14T10:51:33.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.327+0000 7f19187cc780 1 > prepared part key=_multipart_54BSD3DEHNK6.2~CUPTQKC3PE7J.1 size=148330 2024-09-14T10:51:33.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.327+0000 7f19187cc780 1 > prepared multipart upload key=54BSD3DEHNK6 upload=CUPTQKC3PE7J tag=1175JPONVB7E type=write size=2245482 2024-09-14T10:51:33.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.330+0000 7f19187cc780 1 < suggested remove operation key=XCVE2F2JJK4X tag=148S7OM92CBZ type=del 2024-09-14T10:51:33.329 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.331+0000 7f19187cc780 1 > prepared operation key=XCVE2F2JJK4X tag=8F3GAV8CRQOC type=del size=3386187 2024-09-14T10:51:33.332 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.334+0000 7f19187cc780 1 < suggested remove operation key=EL00Y4Z7DTAT tag=HTUKWH370JIX type=del 2024-09-14T10:51:33.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.335+0000 7f19187cc780 1 > prepared operation key=MFA30GSMCSKP tag=OP88FT4PSNJO type=del size=1068646 2024-09-14T10:51:33.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.337+0000 7f19187cc780 1 < completed delete operation key=B9FQYIX19AEP tag=E1GA2S383BW0 type=del 2024-09-14T10:51:33.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.338+0000 7f19187cc780 1 > prepared operation key=75O00VMLJJ1X tag=GL4VVUTSSWX6 type=write size=831009 2024-09-14T10:51:33.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.340+0000 7f19187cc780 1 < completed delete operation key=H40763V7HMBC tag=TGA4WIOTIRPU type=del 2024-09-14T10:51:33.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.342+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~RW8KECOFWII9.0 size=1048576 2024-09-14T10:51:33.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.343+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~RW8KECOFWII9.1 size=717946 2024-09-14T10:51:33.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.343+0000 7f19187cc780 1 > prepared multipart upload key=VW6U36JN2DBX upload=RW8KECOFWII9 tag=GMW5GA8HXVRJ type=write size=2815098 2024-09-14T10:51:33.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.345+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~1NY139VG97NU.0 size=1048576 2024-09-14T10:51:33.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.346+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~1NY139VG97NU.1 size=865217 2024-09-14T10:51:33.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.348+0000 7f19187cc780 1 < completed multipart upload key=B9FQYIX19AEP upload=1NY139VG97NU tag=MO7WVLRFE0ZA type=write size=2962369 2024-09-14T10:51:33.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.350+0000 7f19187cc780 1 > prepared operation key=B9FQYIX19AEP tag=MTCS9R1GO2MA type=del size=2311973 2024-09-14T10:51:33.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.353+0000 7f19187cc780 1 < suggested remove operation key=7IWUW2HC3ULI tag=RIZDJ2VG0H8I type=del 2024-09-14T10:51:33.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.354+0000 7f19187cc780 1 > prepared operation key=INJQTKXHBUV2 tag=PBZHN48HGUGK type=write size=1011450 2024-09-14T10:51:33.354 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.356+0000 7f19187cc780 1 < canceled operation key=IKVYA4KEALFF tag=4HJUJPUGB9R5 type=del size=3113927 2024-09-14T10:51:33.355 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.357+0000 7f19187cc780 1 > prepared operation key=RTGE7ISETJWW tag=ZGVIELQRZUD2 type=del size=3364332 2024-09-14T10:51:33.358 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.359+0000 7f19187cc780 1 < completed write operation key=QBMNYNWOLK4I tag=LKW6NA2PRK2O type=write size=871858 2024-09-14T10:51:33.359 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.360+0000 7f19187cc780 1 > prepared operation key=M73CER01XHDY tag=AFYGIH9YOD81 type=del size=1936174 2024-09-14T10:51:33.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.363+0000 7f19187cc780 1 < suggested remove operation key=54BSD3DEHNK6 tag=RFVD8QE79Q6M type=del 2024-09-14T10:51:33.363 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.365+0000 7f19187cc780 1 > prepared operation key=E6UO1LUWOC44 tag=OM6PJ776GIXM type=del size=936010 2024-09-14T10:51:33.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.366+0000 7f19187cc780 1 < completed delete operation key=6BNN842ZTWG5 tag=S6N5GL725ZD4 type=del 2024-09-14T10:51:33.366 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.368+0000 7f19187cc780 1 > prepared operation key=CADC2BY888V1 tag=N0JUO0O19WCX type=del size=1756025 2024-09-14T10:51:33.368 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.369+0000 7f19187cc780 1 < completed part key=_multipart_QFEI6H4EQ9ZR.2~67E0NNG1SS61.0 size=808778 2024-09-14T10:51:33.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.372+0000 7f19187cc780 1 < completed multipart upload key=QFEI6H4EQ9ZR upload=67E0NNG1SS61 tag=EETASWVQ3418 type=write size=1857354 2024-09-14T10:51:33.372 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.373+0000 7f19187cc780 1 > prepared operation key=N0L67LS2KHR1 tag=BUKRM277TIXJ type=write size=356139 2024-09-14T10:51:33.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.376+0000 7f19187cc780 1 < suggested remove operation key=19P3WE6HKJH2 tag=9XQYCMCIUJD3 type=write 2024-09-14T10:51:33.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.378+0000 7f19187cc780 1 > prepared operation key=5AIAYJMRZGFQ tag=EWV7816YKQIL type=write size=1048226 2024-09-14T10:51:33.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.379+0000 7f19187cc780 1 < completed part key=_multipart_75O00VMLJJ1X.2~27UFA04ZEUOU.0 size=1048576 2024-09-14T10:51:33.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.380+0000 7f19187cc780 1 < completed part key=_multipart_75O00VMLJJ1X.2~27UFA04ZEUOU.1 size=215741 2024-09-14T10:51:33.382 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.383+0000 7f19187cc780 1 < completed multipart upload key=75O00VMLJJ1X upload=27UFA04ZEUOU tag=D4JVIBD5OKNM type=write size=2312893 2024-09-14T10:51:33.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.385+0000 7f19187cc780 1 > prepared operation key=B9FQYIX19AEP tag=3S3ZAUQLEMNH type=del size=2773054 2024-09-14T10:51:33.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.386+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~9CO9WC4L7X1C.0 size=333865 2024-09-14T10:51:33.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.389+0000 7f19187cc780 1 < completed multipart upload key=B9FQYIX19AEP upload=9CO9WC4L7X1C tag=MM2RV7B4OFC5 type=write size=1382441 2024-09-14T10:51:33.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.390+0000 7f19187cc780 1 > prepared operation key=EZLSMEK89N2G tag=UHRWAMCRXMT4 type=del size=3712486 2024-09-14T10:51:33.390 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.392+0000 7f19187cc780 1 < completed part key=_multipart_OVOPGTYUF3F3.2~EWEHKCGZYPHJ.0 size=910813 2024-09-14T10:51:33.392 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.394+0000 7f19187cc780 1 < completed multipart upload key=OVOPGTYUF3F3 upload=EWEHKCGZYPHJ tag=EM32A3FCE5DP type=write size=1959389 2024-09-14T10:51:33.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.396+0000 7f19187cc780 1 > prepared operation key=AST81B9QWORT tag=CPANK4WI8E4M type=del size=530692 2024-09-14T10:51:33.397 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.399+0000 7f19187cc780 1 < completed part key=_multipart_54BSD3DEHNK6.2~CUPTQKC3PE7J.0 size=1048576 2024-09-14T10:51:33.398 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.400+0000 7f19187cc780 1 < completed part key=_multipart_54BSD3DEHNK6.2~CUPTQKC3PE7J.1 size=148330 2024-09-14T10:51:33.400 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.402+0000 7f19187cc780 1 < completed multipart upload key=54BSD3DEHNK6 upload=CUPTQKC3PE7J tag=1175JPONVB7E type=write size=2245482 2024-09-14T10:51:33.403 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.405+0000 7f19187cc780 1 > prepared part key=_multipart_QFEI6H4EQ9ZR.2~LPDBVF7I8TGY.0 size=1048576 2024-09-14T10:51:33.404 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.406+0000 7f19187cc780 1 > prepared part key=_multipart_QFEI6H4EQ9ZR.2~LPDBVF7I8TGY.1 size=1048576 2024-09-14T10:51:33.406 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.407+0000 7f19187cc780 1 > prepared part key=_multipart_QFEI6H4EQ9ZR.2~LPDBVF7I8TGY.2 size=487870 2024-09-14T10:51:33.406 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.407+0000 7f19187cc780 1 > prepared multipart upload key=QFEI6H4EQ9ZR upload=LPDBVF7I8TGY tag=7XW14481R6A8 type=write size=3633598 2024-09-14T10:51:33.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.409+0000 7f19187cc780 1 < completed delete operation key=XCVE2F2JJK4X tag=8F3GAV8CRQOC type=del 2024-09-14T10:51:33.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.410+0000 7f19187cc780 1 > prepared operation key=EL00Y4Z7DTAT tag=XGY236M2AGA7 type=del size=1839951 2024-09-14T10:51:33.410 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.412+0000 7f19187cc780 1 < completed delete operation key=MFA30GSMCSKP tag=OP88FT4PSNJO type=del 2024-09-14T10:51:33.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.413+0000 7f19187cc780 1 > prepared operation key=XCVE2F2JJK4X tag=HFBIICLPSU17 type=del size=1217636 2024-09-14T10:51:33.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.415+0000 7f19187cc780 1 < completed write operation key=75O00VMLJJ1X tag=GL4VVUTSSWX6 type=write size=831009 2024-09-14T10:51:33.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.418+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~5ZFWJXPLKF4X.0 size=1048576 2024-09-14T10:51:33.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.419+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~5ZFWJXPLKF4X.1 size=540832 2024-09-14T10:51:33.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.419+0000 7f19187cc780 1 > prepared multipart upload key=KP3WOGIF30PZ upload=5ZFWJXPLKF4X tag=SMZ2QUGDSIEX type=write size=2637984 2024-09-14T10:51:33.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.419+0000 7f19187cc780 1 < canceled part key=_multipart_VW6U36JN2DBX.2~RW8KECOFWII9.0 size=1048576 2024-09-14T10:51:33.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.419+0000 7f19187cc780 1 < canceled part key=_multipart_VW6U36JN2DBX.2~RW8KECOFWII9.1 size=717946 2024-09-14T10:51:33.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.422+0000 7f19187cc780 1 < canceled multipart upload key=VW6U36JN2DBX upload=RW8KECOFWII9 tag=GMW5GA8HXVRJ type=write size=2815098 2024-09-14T10:51:33.423 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.425+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~N4Q1CZS2T7UL.0 size=414869 2024-09-14T10:51:33.424 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.425+0000 7f19187cc780 1 > prepared multipart upload key=VW6U36JN2DBX upload=N4Q1CZS2T7UL tag=QK682M7GYYKH type=write size=1463445 2024-09-14T10:51:33.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.426+0000 7f19187cc780 1 < completed delete operation key=B9FQYIX19AEP tag=MTCS9R1GO2MA type=del 2024-09-14T10:51:33.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.429+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~Y8T0E0MY9Z7Z.0 size=1048576 2024-09-14T10:51:33.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.430+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~Y8T0E0MY9Z7Z.1 size=1048576 2024-09-14T10:51:33.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.431+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~Y8T0E0MY9Z7Z.2 size=809294 2024-09-14T10:51:33.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.431+0000 7f19187cc780 1 > prepared multipart upload key=OVOPGTYUF3F3 upload=Y8T0E0MY9Z7Z tag=EHAG6JAQI3B3 type=write size=3955022 2024-09-14T10:51:33.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.434+0000 7f19187cc780 1 < suggested remove operation key=INJQTKXHBUV2 tag=PBZHN48HGUGK type=write 2024-09-14T10:51:33.435 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.437+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~T0ZGLDCWZD32.0 size=1048576 2024-09-14T10:51:33.436 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.438+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~T0ZGLDCWZD32.1 size=1048576 2024-09-14T10:51:33.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.439+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~T0ZGLDCWZD32.2 size=884666 2024-09-14T10:51:33.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.439+0000 7f19187cc780 1 > prepared multipart upload key=AGNUE76X8XCJ upload=T0ZGLDCWZD32 tag=NZM3AR4Z29WQ type=write size=4030394 2024-09-14T10:51:33.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.440+0000 7f19187cc780 1 < completed delete operation key=RTGE7ISETJWW tag=ZGVIELQRZUD2 type=del 2024-09-14T10:51:33.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.443+0000 7f19187cc780 1 > prepared part key=_multipart_5AIAYJMRZGFQ.2~UZ06BR21BDAG.0 size=1048576 2024-09-14T10:51:33.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.444+0000 7f19187cc780 1 > prepared part key=_multipart_5AIAYJMRZGFQ.2~UZ06BR21BDAG.1 size=312250 2024-09-14T10:51:33.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.444+0000 7f19187cc780 1 > prepared multipart upload key=5AIAYJMRZGFQ upload=UZ06BR21BDAG tag=22816J84LQQ6 type=write size=2409402 2024-09-14T10:51:33.444 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.445+0000 7f19187cc780 1 < completed delete operation key=M73CER01XHDY tag=AFYGIH9YOD81 type=del 2024-09-14T10:51:33.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.448+0000 7f19187cc780 1 > prepared part key=_multipart_AST81B9QWORT.2~OLPG05JOWI08.0 size=1048576 2024-09-14T10:51:33.448 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.450+0000 7f19187cc780 1 > prepared part key=_multipart_AST81B9QWORT.2~OLPG05JOWI08.1 size=1048576 2024-09-14T10:51:33.449 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.451+0000 7f19187cc780 1 > prepared part key=_multipart_AST81B9QWORT.2~OLPG05JOWI08.2 size=912736 2024-09-14T10:51:33.449 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.451+0000 7f19187cc780 1 > prepared multipart upload key=AST81B9QWORT upload=OLPG05JOWI08 tag=7600JY0JBX6U type=write size=4058464 2024-09-14T10:51:33.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.452+0000 7f19187cc780 1 < completed delete operation key=E6UO1LUWOC44 tag=OM6PJ776GIXM type=del 2024-09-14T10:51:33.452 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.453+0000 7f19187cc780 1 > prepared operation key=9EBD5ZT6MT45 tag=PT5O3OEX87IV type=del size=2862523 2024-09-14T10:51:33.453 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.455+0000 7f19187cc780 1 < canceled operation key=CADC2BY888V1 tag=N0JUO0O19WCX type=del size=1756025 2024-09-14T10:51:33.456 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.457+0000 7f19187cc780 1 > prepared part key=_multipart_YA3DI7N4DG5K.2~BV4D0846HY96.0 size=1048576 2024-09-14T10:51:33.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.458+0000 7f19187cc780 1 > prepared part key=_multipart_YA3DI7N4DG5K.2~BV4D0846HY96.1 size=244154 2024-09-14T10:51:33.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.458+0000 7f19187cc780 1 > prepared multipart upload key=YA3DI7N4DG5K upload=BV4D0846HY96 tag=8Z2QAU5GXRPN type=write size=2341306 2024-09-14T10:51:33.459 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.460+0000 7f19187cc780 1 < completed write operation key=N0L67LS2KHR1 tag=BUKRM277TIXJ type=write size=356139 2024-09-14T10:51:33.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.463+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~OEUZDES2QL9J.0 size=1048576 2024-09-14T10:51:33.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.464+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~OEUZDES2QL9J.1 size=1048576 2024-09-14T10:51:33.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.465+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~OEUZDES2QL9J.2 size=775600 2024-09-14T10:51:33.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.465+0000 7f19187cc780 1 > prepared multipart upload key=6BNN842ZTWG5 upload=OEUZDES2QL9J tag=HTO6I1YHLL12 type=write size=3921328 2024-09-14T10:51:33.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.467+0000 7f19187cc780 1 < completed write operation key=5AIAYJMRZGFQ tag=EWV7816YKQIL type=write size=1048226 2024-09-14T10:51:33.468 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.469+0000 7f19187cc780 1 > prepared part key=_multipart_61O2VU0SB379.2~LA7H0RPXTCPE.0 size=1048576 2024-09-14T10:51:33.469 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.471+0000 7f19187cc780 1 > prepared part key=_multipart_61O2VU0SB379.2~LA7H0RPXTCPE.1 size=1048576 2024-09-14T10:51:33.470 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.472+0000 7f19187cc780 1 > prepared part key=_multipart_61O2VU0SB379.2~LA7H0RPXTCPE.2 size=754890 2024-09-14T10:51:33.470 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.472+0000 7f19187cc780 1 > prepared multipart upload key=61O2VU0SB379 upload=LA7H0RPXTCPE tag=67ZXKTRWX2OC type=write size=3900618 2024-09-14T10:51:33.472 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.473+0000 7f19187cc780 1 < completed delete operation key=B9FQYIX19AEP tag=3S3ZAUQLEMNH type=del 2024-09-14T10:51:33.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.475+0000 7f19187cc780 1 > prepared operation key=YA3DI7N4DG5K tag=CYWGR8RIP2QR type=del size=1694797 2024-09-14T10:51:33.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.476+0000 7f19187cc780 1 < completed delete operation key=EZLSMEK89N2G tag=UHRWAMCRXMT4 type=del 2024-09-14T10:51:33.476 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.478+0000 7f19187cc780 1 > prepared operation key=B9FQYIX19AEP tag=Y3AXJ53AY4NF type=del size=1641696 2024-09-14T10:51:33.478 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.479+0000 7f19187cc780 1 < completed delete operation key=AST81B9QWORT tag=CPANK4WI8E4M type=del 2024-09-14T10:51:33.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.482+0000 7f19187cc780 1 > prepared part key=_multipart_YA3DI7N4DG5K.2~XCKA4VTCL3P7.0 size=633441 2024-09-14T10:51:33.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.482+0000 7f19187cc780 1 > prepared multipart upload key=YA3DI7N4DG5K upload=XCKA4VTCL3P7 tag=8CTTY76D37W7 type=write size=1682017 2024-09-14T10:51:33.482 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.484+0000 7f19187cc780 1 < completed part key=_multipart_QFEI6H4EQ9ZR.2~LPDBVF7I8TGY.0 size=1048576 2024-09-14T10:51:33.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.485+0000 7f19187cc780 1 < completed part key=_multipart_QFEI6H4EQ9ZR.2~LPDBVF7I8TGY.1 size=1048576 2024-09-14T10:51:33.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.486+0000 7f19187cc780 1 < completed part key=_multipart_QFEI6H4EQ9ZR.2~LPDBVF7I8TGY.2 size=487870 2024-09-14T10:51:33.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.489+0000 7f19187cc780 1 < completed multipart upload key=QFEI6H4EQ9ZR upload=LPDBVF7I8TGY tag=7XW14481R6A8 type=write size=3633598 2024-09-14T10:51:33.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.490+0000 7f19187cc780 1 > prepared operation key=OVOPGTYUF3F3 tag=LQU9P1FAYMQJ type=write size=524889 2024-09-14T10:51:33.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.493+0000 7f19187cc780 1 < suggested update operation key=EL00Y4Z7DTAT tag=XGY236M2AGA7 type=del size=1839951 2024-09-14T10:51:33.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.495+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~PGEVBOU6L2YP.0 size=1048576 2024-09-14T10:51:33.495 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.497+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~PGEVBOU6L2YP.1 size=655793 2024-09-14T10:51:33.495 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.497+0000 7f19187cc780 1 > prepared multipart upload key=7IWUW2HC3ULI upload=PGEVBOU6L2YP tag=2HZUFR8B145B type=write size=2752945 2024-09-14T10:51:33.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.498+0000 7f19187cc780 1 < completed delete operation key=XCVE2F2JJK4X tag=HFBIICLPSU17 type=del 2024-09-14T10:51:33.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.500+0000 7f19187cc780 1 > prepared operation key=H40763V7HMBC tag=7TZ6TF5W404F type=del size=2282470 2024-09-14T10:51:33.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.501+0000 7f19187cc780 1 < completed part key=_multipart_KP3WOGIF30PZ.2~5ZFWJXPLKF4X.0 size=1048576 2024-09-14T10:51:33.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.502+0000 7f19187cc780 1 < completed part key=_multipart_KP3WOGIF30PZ.2~5ZFWJXPLKF4X.1 size=540832 2024-09-14T10:51:33.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.505+0000 7f19187cc780 1 < completed multipart upload key=KP3WOGIF30PZ upload=5ZFWJXPLKF4X tag=SMZ2QUGDSIEX type=write size=2637984 2024-09-14T10:51:33.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.506+0000 7f19187cc780 1 > prepared operation key=AST81B9QWORT tag=I10L537CVG1P type=del size=455941 2024-09-14T10:51:33.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.508+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~N4Q1CZS2T7UL.0 size=414869 2024-09-14T10:51:33.508 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.510+0000 7f19187cc780 1 < completed multipart upload key=VW6U36JN2DBX upload=N4Q1CZS2T7UL tag=QK682M7GYYKH type=write size=1463445 2024-09-14T10:51:33.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.511+0000 7f19187cc780 1 > prepared operation key=AGNUE76X8XCJ tag=CXGKEN2EQM1H type=del size=3075756 2024-09-14T10:51:33.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.513+0000 7f19187cc780 1 < completed part key=_multipart_OVOPGTYUF3F3.2~Y8T0E0MY9Z7Z.0 size=1048576 2024-09-14T10:51:33.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.514+0000 7f19187cc780 1 < completed part key=_multipart_OVOPGTYUF3F3.2~Y8T0E0MY9Z7Z.1 size=1048576 2024-09-14T10:51:33.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.515+0000 7f19187cc780 1 < completed part key=_multipart_OVOPGTYUF3F3.2~Y8T0E0MY9Z7Z.2 size=809294 2024-09-14T10:51:33.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.518+0000 7f19187cc780 1 < completed multipart upload key=OVOPGTYUF3F3 upload=Y8T0E0MY9Z7Z tag=EHAG6JAQI3B3 type=write size=3955022 2024-09-14T10:51:33.519 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.520+0000 7f19187cc780 1 > prepared operation key=QBMNYNWOLK4I tag=HLX9DW185PEI type=del size=2012025 2024-09-14T10:51:33.520 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.522+0000 7f19187cc780 1 < completed part key=_multipart_AGNUE76X8XCJ.2~T0ZGLDCWZD32.0 size=1048576 2024-09-14T10:51:33.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.523+0000 7f19187cc780 1 < completed part key=_multipart_AGNUE76X8XCJ.2~T0ZGLDCWZD32.1 size=1048576 2024-09-14T10:51:33.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.524+0000 7f19187cc780 1 < completed part key=_multipart_AGNUE76X8XCJ.2~T0ZGLDCWZD32.2 size=884666 2024-09-14T10:51:33.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.527+0000 7f19187cc780 1 < completed multipart upload key=AGNUE76X8XCJ upload=T0ZGLDCWZD32 tag=NZM3AR4Z29WQ type=write size=4030394 2024-09-14T10:51:33.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.530+0000 7f19187cc780 1 > prepared part key=_multipart_617QQI921HB4.2~N39OH5U44FE2.0 size=464188 2024-09-14T10:51:33.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.530+0000 7f19187cc780 1 > prepared multipart upload key=617QQI921HB4 upload=N39OH5U44FE2 tag=BKKGB996FJBS type=write size=1512764 2024-09-14T10:51:33.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.532+0000 7f19187cc780 1 < completed part key=_multipart_5AIAYJMRZGFQ.2~UZ06BR21BDAG.0 size=1048576 2024-09-14T10:51:33.531 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.533+0000 7f19187cc780 1 < completed part key=_multipart_5AIAYJMRZGFQ.2~UZ06BR21BDAG.1 size=312250 2024-09-14T10:51:33.536 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.537+0000 7f19187cc780 1 < completed multipart upload key=5AIAYJMRZGFQ upload=UZ06BR21BDAG tag=22816J84LQQ6 type=write size=2409402 2024-09-14T10:51:33.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.540+0000 7f19187cc780 1 > prepared part key=_multipart_9EBD5ZT6MT45.2~IB31ASJPUJV6.0 size=1048576 2024-09-14T10:51:33.540 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.541+0000 7f19187cc780 1 > prepared part key=_multipart_9EBD5ZT6MT45.2~IB31ASJPUJV6.1 size=1048576 2024-09-14T10:51:33.541 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.543+0000 7f19187cc780 1 > prepared part key=_multipart_9EBD5ZT6MT45.2~IB31ASJPUJV6.2 size=305411 2024-09-14T10:51:33.541 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.543+0000 7f19187cc780 1 > prepared multipart upload key=9EBD5ZT6MT45 upload=IB31ASJPUJV6 tag=GWMVX1JFM7NO type=write size=3451139 2024-09-14T10:51:33.541 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.543+0000 7f19187cc780 1 < canceled part key=_multipart_AST81B9QWORT.2~OLPG05JOWI08.0 size=1048576 2024-09-14T10:51:33.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.544+0000 7f19187cc780 1 < completed part key=_multipart_AST81B9QWORT.2~OLPG05JOWI08.1 size=1048576 2024-09-14T10:51:33.544 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.546+0000 7f19187cc780 1 < completed part key=_multipart_AST81B9QWORT.2~OLPG05JOWI08.2 size=912736 2024-09-14T10:51:33.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.548+0000 7f19187cc780 1 < canceled multipart upload key=AST81B9QWORT upload=OLPG05JOWI08 tag=7600JY0JBX6U type=write size=4058464 2024-09-14T10:51:33.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.550+0000 7f19187cc780 1 > prepared operation key=W1K1IU13J0CZ tag=X8PA0L7WG2VT type=write size=469729 2024-09-14T10:51:33.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.551+0000 7f19187cc780 1 < completed delete operation key=9EBD5ZT6MT45 tag=PT5O3OEX87IV type=del 2024-09-14T10:51:33.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.553+0000 7f19187cc780 1 > prepared operation key=AST81B9QWORT tag=Q479RFJWVFFX type=del size=2201568 2024-09-14T10:51:33.553 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.554+0000 7f19187cc780 1 < completed part key=_multipart_YA3DI7N4DG5K.2~BV4D0846HY96.0 size=1048576 2024-09-14T10:51:33.554 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.556+0000 7f19187cc780 1 < completed part key=_multipart_YA3DI7N4DG5K.2~BV4D0846HY96.1 size=244154 2024-09-14T10:51:33.556 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.558+0000 7f19187cc780 1 < completed multipart upload key=YA3DI7N4DG5K upload=BV4D0846HY96 tag=8Z2QAU5GXRPN type=write size=2341306 2024-09-14T10:51:33.558 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.559+0000 7f19187cc780 1 > prepared operation key=MFA30GSMCSKP tag=M5JLJM5ZCL5T type=write size=975621 2024-09-14T10:51:33.560 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.561+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~OEUZDES2QL9J.0 size=1048576 2024-09-14T10:51:33.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.562+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~OEUZDES2QL9J.1 size=1048576 2024-09-14T10:51:33.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.563+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~OEUZDES2QL9J.2 size=775600 2024-09-14T10:51:33.564 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.566+0000 7f19187cc780 1 < completed multipart upload key=6BNN842ZTWG5 upload=OEUZDES2QL9J tag=HTO6I1YHLL12 type=write size=3921328 2024-09-14T10:51:33.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.567+0000 7f19187cc780 1 > prepared operation key=VW6U36JN2DBX tag=5AD2KZ5NHTCF type=del size=3300051 2024-09-14T10:51:33.567 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.569+0000 7f19187cc780 1 < completed part key=_multipart_61O2VU0SB379.2~LA7H0RPXTCPE.0 size=1048576 2024-09-14T10:51:33.568 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.570+0000 7f19187cc780 1 < completed part key=_multipart_61O2VU0SB379.2~LA7H0RPXTCPE.1 size=1048576 2024-09-14T10:51:33.569 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.571+0000 7f19187cc780 1 < completed part key=_multipart_61O2VU0SB379.2~LA7H0RPXTCPE.2 size=754890 2024-09-14T10:51:33.572 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.573+0000 7f19187cc780 1 < completed multipart upload key=61O2VU0SB379 upload=LA7H0RPXTCPE tag=67ZXKTRWX2OC type=write size=3900618 2024-09-14T10:51:33.577 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.576+0000 7f19187cc780 1 > prepared part key=_multipart_RTGE7ISETJWW.2~CC1F1WNDW9EB.0 size=735625 2024-09-14T10:51:33.577 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.576+0000 7f19187cc780 1 > prepared multipart upload key=RTGE7ISETJWW upload=CC1F1WNDW9EB tag=0CCHGJ7OWI32 type=write size=1784201 2024-09-14T10:51:33.577 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.577+0000 7f19187cc780 1 < completed delete operation key=YA3DI7N4DG5K tag=CYWGR8RIP2QR type=del 2024-09-14T10:51:33.577 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.579+0000 7f19187cc780 1 > prepared operation key=H40763V7HMBC tag=MVCOEOWUJ31R type=del size=1199474 2024-09-14T10:51:33.578 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.580+0000 7f19187cc780 1 < canceled operation key=B9FQYIX19AEP tag=Y3AXJ53AY4NF type=del size=1641696 2024-09-14T10:51:33.581 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.582+0000 7f19187cc780 1 > prepared part key=_multipart_75O00VMLJJ1X.2~GI4CT2CHPIVW.0 size=1048576 2024-09-14T10:51:33.582 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.583+0000 7f19187cc780 1 > prepared part key=_multipart_75O00VMLJJ1X.2~GI4CT2CHPIVW.1 size=121962 2024-09-14T10:51:33.582 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.584+0000 7f19187cc780 1 > prepared multipart upload key=75O00VMLJJ1X upload=GI4CT2CHPIVW tag=RSWV9N04SY76 type=write size=2219114 2024-09-14T10:51:33.583 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.585+0000 7f19187cc780 1 < completed part key=_multipart_YA3DI7N4DG5K.2~XCKA4VTCL3P7.0 size=633441 2024-09-14T10:51:33.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.587+0000 7f19187cc780 1 < completed multipart upload key=YA3DI7N4DG5K upload=XCKA4VTCL3P7 tag=8CTTY76D37W7 type=write size=1682017 2024-09-14T10:51:33.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.589+0000 7f19187cc780 1 > prepared operation key=75O00VMLJJ1X tag=CXDZ0FBRQCXP type=del size=3902806 2024-09-14T10:51:33.589 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.590+0000 7f19187cc780 1 < completed write operation key=OVOPGTYUF3F3 tag=LQU9P1FAYMQJ type=write size=524889 2024-09-14T10:51:33.590 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.592+0000 7f19187cc780 1 > prepared operation key=QFEI6H4EQ9ZR tag=953ELGXABF7X type=del size=1463361 2024-09-14T10:51:33.591 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.593+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~PGEVBOU6L2YP.0 size=1048576 2024-09-14T10:51:33.592 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.594+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~PGEVBOU6L2YP.1 size=655793 2024-09-14T10:51:33.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.596+0000 7f19187cc780 1 < completed multipart upload key=7IWUW2HC3ULI upload=PGEVBOU6L2YP tag=2HZUFR8B145B type=write size=2752945 2024-09-14T10:51:33.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.599+0000 7f19187cc780 1 > prepared part key=_multipart_N0L67LS2KHR1.2~GGRYVYIA0EBL.0 size=1048576 2024-09-14T10:51:33.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.600+0000 7f19187cc780 1 > prepared part key=_multipart_N0L67LS2KHR1.2~GGRYVYIA0EBL.1 size=1048576 2024-09-14T10:51:33.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.601+0000 7f19187cc780 1 > prepared part key=_multipart_N0L67LS2KHR1.2~GGRYVYIA0EBL.2 size=531786 2024-09-14T10:51:33.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.601+0000 7f19187cc780 1 > prepared multipart upload key=N0L67LS2KHR1 upload=GGRYVYIA0EBL tag=3GVZ239TT1OI type=write size=3677514 2024-09-14T10:51:33.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.603+0000 7f19187cc780 1 < completed delete operation key=H40763V7HMBC tag=7TZ6TF5W404F type=del 2024-09-14T10:51:33.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.604+0000 7f19187cc780 1 > prepared operation key=EZLSMEK89N2G tag=8T2YXEWK283L type=del size=3396838 2024-09-14T10:51:33.604 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.606+0000 7f19187cc780 1 < completed delete operation key=AST81B9QWORT tag=I10L537CVG1P type=del 2024-09-14T10:51:33.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.607+0000 7f19187cc780 1 > prepared operation key=W1K1IU13J0CZ tag=YCC2A0DN6H4Z type=write size=235050 2024-09-14T10:51:33.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.608+0000 7f19187cc780 1 < canceled operation key=AGNUE76X8XCJ tag=CXGKEN2EQM1H type=del size=3075756 2024-09-14T10:51:33.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.610+0000 7f19187cc780 1 > prepared operation key=6BNN842ZTWG5 tag=2MW1EQDJVFV8 type=del size=412525 2024-09-14T10:51:33.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.611+0000 7f19187cc780 1 < completed delete operation key=QBMNYNWOLK4I tag=HLX9DW185PEI type=del 2024-09-14T10:51:33.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.613+0000 7f19187cc780 1 > prepared operation key=N0L67LS2KHR1 tag=WQGD1O88EUTU type=del size=3337874 2024-09-14T10:51:33.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.613+0000 7f19187cc780 1 < canceled part key=_multipart_617QQI921HB4.2~N39OH5U44FE2.0 size=464188 2024-09-14T10:51:33.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.615+0000 7f19187cc780 1 < canceled multipart upload key=617QQI921HB4 upload=N39OH5U44FE2 tag=BKKGB996FJBS type=write size=1512764 2024-09-14T10:51:33.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.617+0000 7f19187cc780 1 > prepared operation key=7IWUW2HC3ULI tag=8ZEHKYBAOR3T type=del size=3069243 2024-09-14T10:51:33.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.619+0000 7f19187cc780 1 < completed part key=_multipart_9EBD5ZT6MT45.2~IB31ASJPUJV6.0 size=1048576 2024-09-14T10:51:33.618 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.620+0000 7f19187cc780 1 < completed part key=_multipart_9EBD5ZT6MT45.2~IB31ASJPUJV6.1 size=1048576 2024-09-14T10:51:33.619 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.621+0000 7f19187cc780 1 < completed part key=_multipart_9EBD5ZT6MT45.2~IB31ASJPUJV6.2 size=305411 2024-09-14T10:51:33.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.623+0000 7f19187cc780 1 < completed multipart upload key=9EBD5ZT6MT45 upload=IB31ASJPUJV6 tag=GWMVX1JFM7NO type=write size=3451139 2024-09-14T10:51:33.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.624+0000 7f19187cc780 1 > prepared operation key=EL00Y4Z7DTAT tag=7UG9Z6HP0ETJ type=write size=1007458 2024-09-14T10:51:33.626 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.627+0000 7f19187cc780 1 < suggested update operation key=W1K1IU13J0CZ tag=X8PA0L7WG2VT type=write size=469729 2024-09-14T10:51:33.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.628+0000 7f19187cc780 1 > prepared operation key=617QQI921HB4 tag=WTEMPS7F89CW type=del size=1192661 2024-09-14T10:51:33.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.630+0000 7f19187cc780 1 < completed delete operation key=AST81B9QWORT tag=Q479RFJWVFFX type=del 2024-09-14T10:51:33.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.633+0000 7f19187cc780 1 > prepared part key=_multipart_INJQTKXHBUV2.2~K9AGBGTFHA3N.0 size=1048576 2024-09-14T10:51:33.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.634+0000 7f19187cc780 1 > prepared part key=_multipart_INJQTKXHBUV2.2~K9AGBGTFHA3N.1 size=1048576 2024-09-14T10:51:33.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.635+0000 7f19187cc780 1 > prepared part key=_multipart_INJQTKXHBUV2.2~K9AGBGTFHA3N.2 size=218393 2024-09-14T10:51:33.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.635+0000 7f19187cc780 1 > prepared multipart upload key=INJQTKXHBUV2 upload=K9AGBGTFHA3N tag=L2A26TBQZRC8 type=write size=3364121 2024-09-14T10:51:33.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.637+0000 7f19187cc780 1 < canceled operation key=MFA30GSMCSKP tag=M5JLJM5ZCL5T type=write size=975621 2024-09-14T10:51:33.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.638+0000 7f19187cc780 1 > prepared operation key=N0L67LS2KHR1 tag=0R444LRA72SU type=del size=94907 2024-09-14T10:51:33.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.640+0000 7f19187cc780 1 < completed delete operation key=VW6U36JN2DBX tag=5AD2KZ5NHTCF type=del 2024-09-14T10:51:33.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.642+0000 7f19187cc780 1 > prepared part key=_multipart_QFEI6H4EQ9ZR.2~QXT23HEVI33H.0 size=1048576 2024-09-14T10:51:33.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.643+0000 7f19187cc780 1 > prepared part key=_multipart_QFEI6H4EQ9ZR.2~QXT23HEVI33H.1 size=641938 2024-09-14T10:51:33.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.643+0000 7f19187cc780 1 > prepared multipart upload key=QFEI6H4EQ9ZR upload=QXT23HEVI33H tag=UQAZMZUK61NW type=write size=2739090 2024-09-14T10:51:33.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.645+0000 7f19187cc780 1 < completed part key=_multipart_RTGE7ISETJWW.2~CC1F1WNDW9EB.0 size=735625 2024-09-14T10:51:33.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.647+0000 7f19187cc780 1 < completed multipart upload key=RTGE7ISETJWW upload=CC1F1WNDW9EB tag=0CCHGJ7OWI32 type=write size=1784201 2024-09-14T10:51:33.647 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.649+0000 7f19187cc780 1 > prepared operation key=CADC2BY888V1 tag=HPK0981GFATZ type=write size=887896 2024-09-14T10:51:33.648 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.650+0000 7f19187cc780 1 < completed delete operation key=H40763V7HMBC tag=MVCOEOWUJ31R type=del 2024-09-14T10:51:33.650 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.652+0000 7f19187cc780 1 > prepared operation key=KOJ7QB7M6A35 tag=4OZFOL9G5FYD type=del size=549925 2024-09-14T10:51:33.651 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.653+0000 7f19187cc780 1 < completed part key=_multipart_75O00VMLJJ1X.2~GI4CT2CHPIVW.0 size=1048576 2024-09-14T10:51:33.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.654+0000 7f19187cc780 1 < completed part key=_multipart_75O00VMLJJ1X.2~GI4CT2CHPIVW.1 size=121962 2024-09-14T10:51:33.656 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.658+0000 7f19187cc780 1 < completed multipart upload key=75O00VMLJJ1X upload=GI4CT2CHPIVW tag=RSWV9N04SY76 type=write size=2219114 2024-09-14T10:51:33.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.660+0000 7f19187cc780 1 > prepared part key=_multipart_EZLSMEK89N2G.2~O3F9M9V01XA6.0 size=1048576 2024-09-14T10:51:33.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.662+0000 7f19187cc780 1 > prepared part key=_multipart_EZLSMEK89N2G.2~O3F9M9V01XA6.1 size=1048576 2024-09-14T10:51:33.661 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.663+0000 7f19187cc780 1 > prepared part key=_multipart_EZLSMEK89N2G.2~O3F9M9V01XA6.2 size=198592 2024-09-14T10:51:33.661 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.663+0000 7f19187cc780 1 > prepared multipart upload key=EZLSMEK89N2G upload=O3F9M9V01XA6 tag=9D03N581RIJC type=write size=3344320 2024-09-14T10:51:33.663 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.664+0000 7f19187cc780 1 < completed delete operation key=75O00VMLJJ1X tag=CXDZ0FBRQCXP type=del 2024-09-14T10:51:33.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.666+0000 7f19187cc780 1 > prepared operation key=EL00Y4Z7DTAT tag=Y446ZB4JQ8NA type=del size=1081256 2024-09-14T10:51:33.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.668+0000 7f19187cc780 1 < suggested remove operation key=QFEI6H4EQ9ZR tag=953ELGXABF7X type=del 2024-09-14T10:51:33.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.671+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~G92Q954UAQKY.0 size=567501 2024-09-14T10:51:33.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.671+0000 7f19187cc780 1 > prepared multipart upload key=KP3WOGIF30PZ upload=G92Q954UAQKY tag=EJSUBI29T2EX type=write size=1616077 2024-09-14T10:51:33.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.672+0000 7f19187cc780 1 < completed part key=_multipart_N0L67LS2KHR1.2~GGRYVYIA0EBL.0 size=1048576 2024-09-14T10:51:33.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.673+0000 7f19187cc780 1 < completed part key=_multipart_N0L67LS2KHR1.2~GGRYVYIA0EBL.1 size=1048576 2024-09-14T10:51:33.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.675+0000 7f19187cc780 1 < completed part key=_multipart_N0L67LS2KHR1.2~GGRYVYIA0EBL.2 size=531786 2024-09-14T10:51:33.676 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.677+0000 7f19187cc780 1 < completed multipart upload key=N0L67LS2KHR1 upload=GGRYVYIA0EBL tag=3GVZ239TT1OI type=write size=3677514 2024-09-14T10:51:33.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.679+0000 7f19187cc780 1 > prepared operation key=VW6U36JN2DBX tag=7Z639XOI9UDC type=del size=4144281 2024-09-14T10:51:33.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.683+0000 7f19187cc780 1 < suggested update operation key=EZLSMEK89N2G tag=8T2YXEWK283L type=del size=3396838 2024-09-14T10:51:33.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.686+0000 7f19187cc780 1 > prepared part key=_multipart_CADC2BY888V1.2~ZJIPSLZDEYHJ.0 size=805259 2024-09-14T10:51:33.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.686+0000 7f19187cc780 1 > prepared multipart upload key=CADC2BY888V1 upload=ZJIPSLZDEYHJ tag=SM4O3MERPO0V type=write size=1853835 2024-09-14T10:51:33.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.687+0000 7f19187cc780 -1 < failed to complete operation key=W1K1IU13J0CZ tag=YCC2A0DN6H4Z type=write size=235050: (22) Invalid argument 2024-09-14T10:51:33.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.689+0000 7f19187cc780 1 > prepared operation key=RTGE7ISETJWW tag=E4X62C91401R type=del size=3591273 2024-09-14T10:51:33.689 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.690+0000 7f19187cc780 1 < completed delete operation key=6BNN842ZTWG5 tag=2MW1EQDJVFV8 type=del 2024-09-14T10:51:33.690 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.692+0000 7f19187cc780 1 > prepared operation key=W1K1IU13J0CZ tag=LJBKLNDWZFLH type=del size=1676183 2024-09-14T10:51:33.692 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.694+0000 7f19187cc780 1 < completed delete operation key=N0L67LS2KHR1 tag=WQGD1O88EUTU type=del 2024-09-14T10:51:33.693 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.695+0000 7f19187cc780 1 > prepared operation key=54BSD3DEHNK6 tag=DNBEEQC3ZOY9 type=write size=843880 2024-09-14T10:51:33.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.697+0000 7f19187cc780 1 < completed delete operation key=7IWUW2HC3ULI tag=8ZEHKYBAOR3T type=del 2024-09-14T10:51:33.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.698+0000 7f19187cc780 1 > prepared operation key=CADC2BY888V1 tag=2NLFWFLSJ3MG type=del size=419667 2024-09-14T10:51:33.699 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.700+0000 7f19187cc780 1 < completed write operation key=EL00Y4Z7DTAT tag=7UG9Z6HP0ETJ type=write size=1007458 2024-09-14T10:51:33.700 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.702+0000 7f19187cc780 1 > prepared operation key=75O00VMLJJ1X tag=IH9T308SRRUG type=write size=665661 2024-09-14T10:51:33.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.705+0000 7f19187cc780 1 < suggested update operation key=617QQI921HB4 tag=WTEMPS7F89CW type=del size=1192661 2024-09-14T10:51:33.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.708+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~43CF48Q761UN.0 size=1048576 2024-09-14T10:51:33.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.709+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~43CF48Q761UN.1 size=837199 2024-09-14T10:51:33.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.709+0000 7f19187cc780 1 > prepared multipart upload key=AGNUE76X8XCJ upload=43CF48Q761UN tag=PB6IQLV99JAL type=write size=2934351 2024-09-14T10:51:33.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.711+0000 7f19187cc780 1 < completed part key=_multipart_INJQTKXHBUV2.2~K9AGBGTFHA3N.0 size=1048576 2024-09-14T10:51:33.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.712+0000 7f19187cc780 1 < completed part key=_multipart_INJQTKXHBUV2.2~K9AGBGTFHA3N.1 size=1048576 2024-09-14T10:51:33.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.713+0000 7f19187cc780 1 < completed part key=_multipart_INJQTKXHBUV2.2~K9AGBGTFHA3N.2 size=218393 2024-09-14T10:51:33.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.715+0000 7f19187cc780 1 < completed multipart upload key=INJQTKXHBUV2 upload=K9AGBGTFHA3N tag=L2A26TBQZRC8 type=write size=3364121 2024-09-14T10:51:33.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.717+0000 7f19187cc780 1 > prepared operation key=75O00VMLJJ1X tag=2P62JCVWRQ3A type=del size=758211 2024-09-14T10:51:33.718 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.720+0000 7f19187cc780 1 < suggested remove operation key=N0L67LS2KHR1 tag=0R444LRA72SU type=del 2024-09-14T10:51:33.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.722+0000 7f19187cc780 1 > prepared operation key=N0L67LS2KHR1 tag=D601MLFLHW71 type=del size=3461194 2024-09-14T10:51:33.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.723+0000 7f19187cc780 1 < completed part key=_multipart_QFEI6H4EQ9ZR.2~QXT23HEVI33H.0 size=1048576 2024-09-14T10:51:33.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.724+0000 7f19187cc780 1 < completed part key=_multipart_QFEI6H4EQ9ZR.2~QXT23HEVI33H.1 size=641938 2024-09-14T10:51:33.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.726+0000 7f19187cc780 1 < completed multipart upload key=QFEI6H4EQ9ZR upload=QXT23HEVI33H tag=UQAZMZUK61NW type=write size=2739090 2024-09-14T10:51:33.726 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.728+0000 7f19187cc780 1 > prepared operation key=VW6U36JN2DBX tag=IBPCJ82NXKSM type=write size=102334 2024-09-14T10:51:33.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.731+0000 7f19187cc780 1 < suggested remove operation key=CADC2BY888V1 tag=HPK0981GFATZ type=write 2024-09-14T10:51:33.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.734+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~SG8RUUD35QH8.0 size=754449 2024-09-14T10:51:33.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.734+0000 7f19187cc780 1 > prepared multipart upload key=B9FQYIX19AEP upload=SG8RUUD35QH8 tag=WEOMJ84J77TZ type=write size=1803025 2024-09-14T10:51:33.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.735+0000 7f19187cc780 1 < completed delete operation key=KOJ7QB7M6A35 tag=4OZFOL9G5FYD type=del 2024-09-14T10:51:33.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.738+0000 7f19187cc780 1 > prepared operation key=AGNUE76X8XCJ tag=ZZF4CDNC2INZ type=del size=3515103 2024-09-14T10:51:33.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.739+0000 7f19187cc780 1 < completed part key=_multipart_EZLSMEK89N2G.2~O3F9M9V01XA6.0 size=1048576 2024-09-14T10:51:33.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.740+0000 7f19187cc780 1 < completed part key=_multipart_EZLSMEK89N2G.2~O3F9M9V01XA6.1 size=1048576 2024-09-14T10:51:33.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.741+0000 7f19187cc780 1 < completed part key=_multipart_EZLSMEK89N2G.2~O3F9M9V01XA6.2 size=198592 2024-09-14T10:51:33.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.744+0000 7f19187cc780 1 < completed multipart upload key=EZLSMEK89N2G upload=O3F9M9V01XA6 tag=9D03N581RIJC type=write size=3344320 2024-09-14T10:51:33.744 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.745+0000 7f19187cc780 1 > prepared operation key=KP3WOGIF30PZ tag=ISPH8P63F3LK type=del size=1328897 2024-09-14T10:51:33.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.747+0000 7f19187cc780 1 < completed delete operation key=EL00Y4Z7DTAT tag=Y446ZB4JQ8NA type=del 2024-09-14T10:51:33.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.748+0000 7f19187cc780 1 > prepared operation key=KP3WOGIF30PZ tag=BLESHQKE7AG7 type=write size=491061 2024-09-14T10:51:33.748 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.749+0000 7f19187cc780 1 < completed part key=_multipart_KP3WOGIF30PZ.2~G92Q954UAQKY.0 size=567501 2024-09-14T10:51:33.750 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.752+0000 7f19187cc780 1 < completed multipart upload key=KP3WOGIF30PZ upload=G92Q954UAQKY tag=EJSUBI29T2EX type=write size=1616077 2024-09-14T10:51:33.752 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.753+0000 7f19187cc780 1 > prepared operation key=54BSD3DEHNK6 tag=GD8TWNO7Z064 type=del size=1555217 2024-09-14T10:51:33.753 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.755+0000 7f19187cc780 1 < completed delete operation key=VW6U36JN2DBX tag=7Z639XOI9UDC type=del 2024-09-14T10:51:33.755 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.757+0000 7f19187cc780 1 > prepared operation key=E6UO1LUWOC44 tag=PDEZ5JTWT2BJ type=del size=440503 2024-09-14T10:51:33.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.758+0000 7f19187cc780 1 < completed part key=_multipart_CADC2BY888V1.2~ZJIPSLZDEYHJ.0 size=805259 2024-09-14T10:51:33.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.761+0000 7f19187cc780 1 < completed multipart upload key=CADC2BY888V1 upload=ZJIPSLZDEYHJ tag=SM4O3MERPO0V type=write size=1853835 2024-09-14T10:51:33.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.762+0000 7f19187cc780 1 > prepared operation key=RTGE7ISETJWW tag=OHTVAYVLK4CE type=del size=257048 2024-09-14T10:51:33.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.764+0000 7f19187cc780 1 < canceled operation key=RTGE7ISETJWW tag=E4X62C91401R type=del size=3591273 2024-09-14T10:51:33.764 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.765+0000 7f19187cc780 1 > prepared operation key=QBMNYNWOLK4I tag=F7VAM16ECYUB type=write size=657626 2024-09-14T10:51:33.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.767+0000 7f19187cc780 1 < canceled operation key=W1K1IU13J0CZ tag=LJBKLNDWZFLH type=del size=1676183 2024-09-14T10:51:33.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.768+0000 7f19187cc780 1 > prepared operation key=INJQTKXHBUV2 tag=THUBW1PKBZHP type=del size=67508 2024-09-14T10:51:33.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.770+0000 7f19187cc780 1 < completed write operation key=54BSD3DEHNK6 tag=DNBEEQC3ZOY9 type=write size=843880 2024-09-14T10:51:33.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.772+0000 7f19187cc780 1 > prepared operation key=N0L67LS2KHR1 tag=6354FG53344B type=del size=3176907 2024-09-14T10:51:33.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.773+0000 7f19187cc780 -1 < failed to complete operation key=CADC2BY888V1 tag=2NLFWFLSJ3MG type=del size=419667: (22) Invalid argument 2024-09-14T10:51:33.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.776+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~0LP054Y5BE0Z.0 size=613729 2024-09-14T10:51:33.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.776+0000 7f19187cc780 1 > prepared multipart upload key=IKVYA4KEALFF upload=0LP054Y5BE0Z tag=Q7OYKXJ5BTXN type=write size=1662305 2024-09-14T10:51:33.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.778+0000 7f19187cc780 1 < canceled operation key=75O00VMLJJ1X tag=IH9T308SRRUG type=write size=665661 2024-09-14T10:51:33.781 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.781+0000 7f19187cc780 1 > prepared part key=_multipart_M73CER01XHDY.2~11080I9WR681.0 size=1048576 2024-09-14T10:51:33.781 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.782+0000 7f19187cc780 1 > prepared part key=_multipart_M73CER01XHDY.2~11080I9WR681.1 size=211309 2024-09-14T10:51:33.781 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.782+0000 7f19187cc780 1 > prepared multipart upload key=M73CER01XHDY upload=11080I9WR681 tag=OEORHHSNQIB0 type=write size=2308461 2024-09-14T10:51:33.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.783+0000 7f19187cc780 1 < completed part key=_multipart_AGNUE76X8XCJ.2~43CF48Q761UN.0 size=1048576 2024-09-14T10:51:33.783 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.785+0000 7f19187cc780 1 < completed part key=_multipart_AGNUE76X8XCJ.2~43CF48Q761UN.1 size=837199 2024-09-14T10:51:33.785 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.787+0000 7f19187cc780 1 < completed multipart upload key=AGNUE76X8XCJ upload=43CF48Q761UN tag=PB6IQLV99JAL type=write size=2934351 2024-09-14T10:51:33.788 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.790+0000 7f19187cc780 1 > prepared part key=_multipart_QFEI6H4EQ9ZR.2~LJJFA587N3MV.0 size=1048576 2024-09-14T10:51:33.789 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.791+0000 7f19187cc780 1 > prepared part key=_multipart_QFEI6H4EQ9ZR.2~LJJFA587N3MV.1 size=1048576 2024-09-14T10:51:33.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.792+0000 7f19187cc780 1 > prepared part key=_multipart_QFEI6H4EQ9ZR.2~LJJFA587N3MV.2 size=775726 2024-09-14T10:51:33.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.792+0000 7f19187cc780 1 > prepared multipart upload key=QFEI6H4EQ9ZR upload=LJJFA587N3MV tag=W5ZR57GXYZNQ type=write size=3921454 2024-09-14T10:51:33.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.793+0000 7f19187cc780 1 < completed delete operation key=75O00VMLJJ1X tag=2P62JCVWRQ3A type=del 2024-09-14T10:51:33.794 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.796+0000 7f19187cc780 1 > prepared part key=_multipart_E6UO1LUWOC44.2~UV6BL2CH4HV7.0 size=1048576 2024-09-14T10:51:33.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.797+0000 7f19187cc780 1 > prepared part key=_multipart_E6UO1LUWOC44.2~UV6BL2CH4HV7.1 size=1048576 2024-09-14T10:51:33.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.800+0000 7f19187cc780 1 > prepared part key=_multipart_E6UO1LUWOC44.2~UV6BL2CH4HV7.2 size=289641 2024-09-14T10:51:33.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.800+0000 7f19187cc780 1 > prepared multipart upload key=E6UO1LUWOC44 upload=UV6BL2CH4HV7 tag=BLXB22F3U73E type=write size=3435369 2024-09-14T10:51:33.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.801+0000 7f19187cc780 1 < completed delete operation key=N0L67LS2KHR1 tag=D601MLFLHW71 type=del 2024-09-14T10:51:33.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.804+0000 7f19187cc780 1 > prepared part key=_multipart_M73CER01XHDY.2~NBJ1EHBXUKF6.0 size=161843 2024-09-14T10:51:33.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.804+0000 7f19187cc780 1 > prepared multipart upload key=M73CER01XHDY upload=NBJ1EHBXUKF6 tag=2365EKQVVNW1 type=write size=1210419 2024-09-14T10:51:33.804 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.806+0000 7f19187cc780 1 < completed write operation key=VW6U36JN2DBX tag=IBPCJ82NXKSM type=write size=102334 2024-09-14T10:51:33.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.808+0000 7f19187cc780 1 > prepared operation key=QFEI6H4EQ9ZR tag=ZTXD60C6HDJN type=write size=831340 2024-09-14T10:51:33.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.809+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~SG8RUUD35QH8.0 size=754449 2024-09-14T10:51:33.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.812+0000 7f19187cc780 1 < completed multipart upload key=B9FQYIX19AEP upload=SG8RUUD35QH8 tag=WEOMJ84J77TZ type=write size=1803025 2024-09-14T10:51:33.812 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.814+0000 7f19187cc780 1 > prepared operation key=M73CER01XHDY tag=MCCXXL7YE6X6 type=write size=572635 2024-09-14T10:51:33.815 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.817+0000 7f19187cc780 1 < suggested update operation key=AGNUE76X8XCJ tag=ZZF4CDNC2INZ type=del size=3515103 2024-09-14T10:51:33.816 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.818+0000 7f19187cc780 1 > prepared operation key=M73CER01XHDY tag=UFSL8EWVS2CM type=del size=491524 2024-09-14T10:51:33.818 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.820+0000 7f19187cc780 1 < completed delete operation key=KP3WOGIF30PZ tag=ISPH8P63F3LK type=del 2024-09-14T10:51:33.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.823+0000 7f19187cc780 1 > prepared part key=_multipart_19P3WE6HKJH2.2~S734S1F5A5RF.0 size=558625 2024-09-14T10:51:33.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.823+0000 7f19187cc780 1 > prepared multipart upload key=19P3WE6HKJH2 upload=S734S1F5A5RF tag=2DWNS8JA1080 type=write size=1607201 2024-09-14T10:51:33.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.824+0000 7f19187cc780 1 < completed write operation key=KP3WOGIF30PZ tag=BLESHQKE7AG7 type=write size=491061 2024-09-14T10:51:33.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.826+0000 7f19187cc780 1 > prepared operation key=75O00VMLJJ1X tag=LQR2987A7C06 type=del size=499808 2024-09-14T10:51:33.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.827+0000 7f19187cc780 1 < completed delete operation key=54BSD3DEHNK6 tag=GD8TWNO7Z064 type=del 2024-09-14T10:51:33.828 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.830+0000 7f19187cc780 1 > prepared part key=_multipart_RTGE7ISETJWW.2~9E0U63GQM070.0 size=905725 2024-09-14T10:51:33.828 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.830+0000 7f19187cc780 1 > prepared multipart upload key=RTGE7ISETJWW upload=9E0U63GQM070 tag=X9MJOA4PO8HB type=write size=1954301 2024-09-14T10:51:33.830 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.831+0000 7f19187cc780 1 < completed delete operation key=E6UO1LUWOC44 tag=PDEZ5JTWT2BJ type=del 2024-09-14T10:51:33.831 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.833+0000 7f19187cc780 1 > prepared operation key=EZLSMEK89N2G tag=D1B6UTN6ELIP type=write size=995730 2024-09-14T10:51:33.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.836+0000 7f19187cc780 1 < suggested update operation key=RTGE7ISETJWW tag=OHTVAYVLK4CE type=del size=257048 2024-09-14T10:51:33.837 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.839+0000 7f19187cc780 1 > prepared part key=_multipart_EZLSMEK89N2G.2~ANDJ1NEJLUMO.0 size=205515 2024-09-14T10:51:33.837 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.839+0000 7f19187cc780 1 > prepared multipart upload key=EZLSMEK89N2G upload=ANDJ1NEJLUMO tag=YNWST9PKK2Y8 type=write size=1254091 2024-09-14T10:51:33.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.841+0000 7f19187cc780 1 < completed write operation key=QBMNYNWOLK4I tag=F7VAM16ECYUB type=write size=657626 2024-09-14T10:51:33.840 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.842+0000 7f19187cc780 1 > prepared operation key=KP3WOGIF30PZ tag=6PK90Y6H25J1 type=del size=2029259 2024-09-14T10:51:33.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.844+0000 7f19187cc780 1 < completed delete operation key=INJQTKXHBUV2 tag=THUBW1PKBZHP type=del 2024-09-14T10:51:33.844 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.845+0000 7f19187cc780 1 > prepared operation key=N0L67LS2KHR1 tag=A9LQGWS5W3BP type=del size=4084410 2024-09-14T10:51:33.845 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.847+0000 7f19187cc780 1 < completed delete operation key=N0L67LS2KHR1 tag=6354FG53344B type=del 2024-09-14T10:51:33.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.848+0000 7f19187cc780 1 > prepared operation key=EZLSMEK89N2G tag=I1FTDBGD7STK type=del size=2007097 2024-09-14T10:51:33.848 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.850+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~0LP054Y5BE0Z.0 size=613729 2024-09-14T10:51:33.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.852+0000 7f19187cc780 1 < completed multipart upload key=IKVYA4KEALFF upload=0LP054Y5BE0Z tag=Q7OYKXJ5BTXN type=write size=1662305 2024-09-14T10:51:33.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.855+0000 7f19187cc780 1 > prepared part key=_multipart_19P3WE6HKJH2.2~RL12P1VAD72B.0 size=1048576 2024-09-14T10:51:33.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.856+0000 7f19187cc780 1 > prepared part key=_multipart_19P3WE6HKJH2.2~RL12P1VAD72B.1 size=1048576 2024-09-14T10:51:33.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.858+0000 7f19187cc780 1 > prepared part key=_multipart_19P3WE6HKJH2.2~RL12P1VAD72B.2 size=1035651 2024-09-14T10:51:33.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.858+0000 7f19187cc780 1 > prepared multipart upload key=19P3WE6HKJH2 upload=RL12P1VAD72B tag=HPQ16B2KMKID type=write size=4181379 2024-09-14T10:51:33.858 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.859+0000 7f19187cc780 1 < completed part key=_multipart_M73CER01XHDY.2~11080I9WR681.0 size=1048576 2024-09-14T10:51:33.859 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.861+0000 7f19187cc780 1 < completed part key=_multipart_M73CER01XHDY.2~11080I9WR681.1 size=211309 2024-09-14T10:51:33.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.863+0000 7f19187cc780 1 < completed multipart upload key=M73CER01XHDY upload=11080I9WR681 tag=OEORHHSNQIB0 type=write size=2308461 2024-09-14T10:51:33.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.867+0000 7f19187cc780 1 > prepared part key=_multipart_5AIAYJMRZGFQ.2~QIYV2Y781EST.0 size=1048576 2024-09-14T10:51:33.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.868+0000 7f19187cc780 1 > prepared part key=_multipart_5AIAYJMRZGFQ.2~QIYV2Y781EST.1 size=1048576 2024-09-14T10:51:33.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.869+0000 7f19187cc780 1 > prepared part key=_multipart_5AIAYJMRZGFQ.2~QIYV2Y781EST.2 size=286768 2024-09-14T10:51:33.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.869+0000 7f19187cc780 1 > prepared multipart upload key=5AIAYJMRZGFQ upload=QIYV2Y781EST tag=WVLLVOJCPLPX type=write size=3432496 2024-09-14T10:51:33.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.871+0000 7f19187cc780 1 < completed part key=_multipart_QFEI6H4EQ9ZR.2~LJJFA587N3MV.0 size=1048576 2024-09-14T10:51:33.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.871+0000 7f19187cc780 1 < canceled part key=_multipart_QFEI6H4EQ9ZR.2~LJJFA587N3MV.1 size=1048576 2024-09-14T10:51:33.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.874+0000 7f19187cc780 1 < completed part key=_multipart_QFEI6H4EQ9ZR.2~LJJFA587N3MV.2 size=775726 2024-09-14T10:51:33.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.877+0000 7f19187cc780 1 < canceled multipart upload key=QFEI6H4EQ9ZR upload=LJJFA587N3MV tag=W5ZR57GXYZNQ type=write size=3921454 2024-09-14T10:51:33.876 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.878+0000 7f19187cc780 1 > prepared operation key=MFA30GSMCSKP tag=X7OFJ2XXN1V6 type=del size=3618940 2024-09-14T10:51:33.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.880+0000 7f19187cc780 1 < completed part key=_multipart_E6UO1LUWOC44.2~UV6BL2CH4HV7.0 size=1048576 2024-09-14T10:51:33.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.881+0000 7f19187cc780 1 < completed part key=_multipart_E6UO1LUWOC44.2~UV6BL2CH4HV7.1 size=1048576 2024-09-14T10:51:33.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.882+0000 7f19187cc780 1 < completed part key=_multipart_E6UO1LUWOC44.2~UV6BL2CH4HV7.2 size=289641 2024-09-14T10:51:33.883 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.885+0000 7f19187cc780 1 < completed multipart upload key=E6UO1LUWOC44 upload=UV6BL2CH4HV7 tag=BLXB22F3U73E type=write size=3435369 2024-09-14T10:51:33.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.886+0000 7f19187cc780 1 > prepared operation key=6BNN842ZTWG5 tag=AVESA50S18MM type=del size=2915555 2024-09-14T10:51:33.886 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.888+0000 7f19187cc780 1 < completed part key=_multipart_M73CER01XHDY.2~NBJ1EHBXUKF6.0 size=161843 2024-09-14T10:51:33.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.890+0000 7f19187cc780 1 < completed multipart upload key=M73CER01XHDY upload=NBJ1EHBXUKF6 tag=2365EKQVVNW1 type=write size=1210419 2024-09-14T10:51:33.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.894+0000 7f19187cc780 1 > prepared part key=_multipart_CADC2BY888V1.2~OQZSABRHGCTP.0 size=1048576 2024-09-14T10:51:33.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.895+0000 7f19187cc780 1 > prepared part key=_multipart_CADC2BY888V1.2~OQZSABRHGCTP.1 size=1048576 2024-09-14T10:51:33.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.896+0000 7f19187cc780 1 > prepared part key=_multipart_CADC2BY888V1.2~OQZSABRHGCTP.2 size=813740 2024-09-14T10:51:33.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.896+0000 7f19187cc780 1 > prepared multipart upload key=CADC2BY888V1 upload=OQZSABRHGCTP tag=F121VPL4S77E type=write size=3959468 2024-09-14T10:51:33.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.898+0000 7f19187cc780 1 < completed write operation key=QFEI6H4EQ9ZR tag=ZTXD60C6HDJN type=write size=831340 2024-09-14T10:51:33.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.899+0000 7f19187cc780 1 > prepared operation key=KOJ7QB7M6A35 tag=XHC42M780FUO type=del size=1854958 2024-09-14T10:51:33.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.901+0000 7f19187cc780 1 < completed write operation key=M73CER01XHDY tag=MCCXXL7YE6X6 type=write size=572635 2024-09-14T10:51:33.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.904+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~7SXVHTVRP275.0 size=1048576 2024-09-14T10:51:33.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.905+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~7SXVHTVRP275.1 size=1048576 2024-09-14T10:51:33.905 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.907+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~7SXVHTVRP275.2 size=894491 2024-09-14T10:51:33.905 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.907+0000 7f19187cc780 1 > prepared multipart upload key=7IWUW2HC3ULI upload=7SXVHTVRP275 tag=R57SPIR6PXOT type=write size=4040219 2024-09-14T10:51:33.907 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.908+0000 7f19187cc780 1 < completed delete operation key=M73CER01XHDY tag=UFSL8EWVS2CM type=del 2024-09-14T10:51:33.910 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.911+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~RXX7LOP5GJJU.0 size=1048576 2024-09-14T10:51:33.911 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.912+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~RXX7LOP5GJJU.1 size=1048576 2024-09-14T10:51:33.912 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.914+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~RXX7LOP5GJJU.2 size=311044 2024-09-14T10:51:33.912 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.914+0000 7f19187cc780 1 > prepared multipart upload key=6BNN842ZTWG5 upload=RXX7LOP5GJJU tag=GR2GGDR1HFCK type=write size=3456772 2024-09-14T10:51:33.914 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.915+0000 7f19187cc780 1 < completed part key=_multipart_19P3WE6HKJH2.2~S734S1F5A5RF.0 size=558625 2024-09-14T10:51:33.916 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.918+0000 7f19187cc780 1 < completed multipart upload key=19P3WE6HKJH2 upload=S734S1F5A5RF tag=2DWNS8JA1080 type=write size=1607201 2024-09-14T10:51:33.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.920+0000 7f19187cc780 1 > prepared operation key=YA3DI7N4DG5K tag=DJUG03M1NVFP type=del size=3874955 2024-09-14T10:51:33.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.921+0000 7f19187cc780 1 < canceled operation key=75O00VMLJJ1X tag=LQR2987A7C06 type=del size=499808 2024-09-14T10:51:33.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.923+0000 7f19187cc780 1 > prepared operation key=9EBD5ZT6MT45 tag=FENKM97Q0N2H type=del size=611331 2024-09-14T10:51:33.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.924+0000 7f19187cc780 1 < completed part key=_multipart_RTGE7ISETJWW.2~9E0U63GQM070.0 size=905725 2024-09-14T10:51:33.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.927+0000 7f19187cc780 1 < completed multipart upload key=RTGE7ISETJWW upload=9E0U63GQM070 tag=X9MJOA4PO8HB type=write size=1954301 2024-09-14T10:51:33.928 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.930+0000 7f19187cc780 1 > prepared part key=_multipart_5AIAYJMRZGFQ.2~50GYEQ4AWSLN.0 size=106235 2024-09-14T10:51:33.928 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.930+0000 7f19187cc780 1 > prepared multipart upload key=5AIAYJMRZGFQ upload=50GYEQ4AWSLN tag=W3BO9H1771LY type=write size=1154811 2024-09-14T10:51:33.930 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.931+0000 7f19187cc780 1 < completed write operation key=EZLSMEK89N2G tag=D1B6UTN6ELIP type=write size=995730 2024-09-14T10:51:33.933 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.934+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~KTMF9ZNZUQ2B.0 size=1048576 2024-09-14T10:51:33.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.935+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~KTMF9ZNZUQ2B.1 size=104437 2024-09-14T10:51:33.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.936+0000 7f19187cc780 1 > prepared multipart upload key=6BNN842ZTWG5 upload=KTMF9ZNZUQ2B tag=NDVNB5OOVLK0 type=write size=2201589 2024-09-14T10:51:33.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.937+0000 7f19187cc780 1 < completed part key=_multipart_EZLSMEK89N2G.2~ANDJ1NEJLUMO.0 size=205515 2024-09-14T10:51:33.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.940+0000 7f19187cc780 1 < completed multipart upload key=EZLSMEK89N2G upload=ANDJ1NEJLUMO tag=YNWST9PKK2Y8 type=write size=1254091 2024-09-14T10:51:33.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.942+0000 7f19187cc780 1 > prepared operation key=9EBD5ZT6MT45 tag=ZF9BQQWIY5M0 type=write size=773749 2024-09-14T10:51:33.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.943+0000 7f19187cc780 1 < completed delete operation key=KP3WOGIF30PZ tag=6PK90Y6H25J1 type=del 2024-09-14T10:51:33.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.945+0000 7f19187cc780 1 > prepared operation key=QFEI6H4EQ9ZR tag=MD26G1TKOYG6 type=del size=438885 2024-09-14T10:51:33.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.949+0000 7f19187cc780 1 < suggested remove operation key=N0L67LS2KHR1 tag=A9LQGWS5W3BP type=del 2024-09-14T10:51:33.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.952+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~5GFU1R4U7YW4.0 size=1048576 2024-09-14T10:51:33.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.953+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~5GFU1R4U7YW4.1 size=189801 2024-09-14T10:51:33.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.953+0000 7f19187cc780 1 > prepared multipart upload key=KP3WOGIF30PZ upload=5GFU1R4U7YW4 tag=YHE8P5813V6L type=write size=2286953 2024-09-14T10:51:33.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.956+0000 7f19187cc780 1 < suggested update operation key=EZLSMEK89N2G tag=I1FTDBGD7STK type=del size=2007097 2024-09-14T10:51:33.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.957+0000 7f19187cc780 1 > prepared operation key=QBMNYNWOLK4I tag=Q8XC56QB6J0Y type=del size=642598 2024-09-14T10:51:33.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.959+0000 7f19187cc780 1 < completed part key=_multipart_19P3WE6HKJH2.2~RL12P1VAD72B.0 size=1048576 2024-09-14T10:51:33.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.959+0000 7f19187cc780 1 < canceled part key=_multipart_19P3WE6HKJH2.2~RL12P1VAD72B.1 size=1048576 2024-09-14T10:51:33.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.960+0000 7f19187cc780 1 < completed part key=_multipart_19P3WE6HKJH2.2~RL12P1VAD72B.2 size=1035651 2024-09-14T10:51:33.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.963+0000 7f19187cc780 1 < canceled multipart upload key=19P3WE6HKJH2 upload=RL12P1VAD72B tag=HPQ16B2KMKID type=write size=4181379 2024-09-14T10:51:33.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.965+0000 7f19187cc780 1 > prepared operation key=KOJ7QB7M6A35 tag=VAO28IJN2ZH8 type=del size=278982 2024-09-14T10:51:33.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.966+0000 7f19187cc780 1 < completed part key=_multipart_5AIAYJMRZGFQ.2~QIYV2Y781EST.0 size=1048576 2024-09-14T10:51:33.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.968+0000 7f19187cc780 1 < completed part key=_multipart_5AIAYJMRZGFQ.2~QIYV2Y781EST.1 size=1048576 2024-09-14T10:51:33.967 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.969+0000 7f19187cc780 1 < completed part key=_multipart_5AIAYJMRZGFQ.2~QIYV2Y781EST.2 size=286768 2024-09-14T10:51:33.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.972+0000 7f19187cc780 1 < completed multipart upload key=5AIAYJMRZGFQ upload=QIYV2Y781EST tag=WVLLVOJCPLPX type=write size=3432496 2024-09-14T10:51:33.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.974+0000 7f19187cc780 1 > prepared part key=_multipart_CADC2BY888V1.2~A4WKH6I6JQ10.0 size=1048576 2024-09-14T10:51:33.974 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.975+0000 7f19187cc780 1 > prepared part key=_multipart_CADC2BY888V1.2~A4WKH6I6JQ10.1 size=1048576 2024-09-14T10:51:33.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.977+0000 7f19187cc780 1 > prepared part key=_multipart_CADC2BY888V1.2~A4WKH6I6JQ10.2 size=615919 2024-09-14T10:51:33.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.977+0000 7f19187cc780 1 > prepared multipart upload key=CADC2BY888V1 upload=A4WKH6I6JQ10 tag=O2CSLESCQDE2 type=write size=3761647 2024-09-14T10:51:33.976 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.978+0000 7f19187cc780 1 < completed delete operation key=MFA30GSMCSKP tag=X7OFJ2XXN1V6 type=del 2024-09-14T10:51:33.978 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.980+0000 7f19187cc780 1 > prepared operation key=IKVYA4KEALFF tag=ECAQV5FAIE8U type=del size=449407 2024-09-14T10:51:33.980 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.981+0000 7f19187cc780 1 < completed delete operation key=6BNN842ZTWG5 tag=AVESA50S18MM type=del 2024-09-14T10:51:33.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.983+0000 7f19187cc780 1 > prepared operation key=617QQI921HB4 tag=6F1QTSFHYMAA type=del size=1623175 2024-09-14T10:51:33.984 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.984+0000 7f19187cc780 1 < completed part key=_multipart_CADC2BY888V1.2~OQZSABRHGCTP.0 size=1048576 2024-09-14T10:51:33.984 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.986+0000 7f19187cc780 1 < completed part key=_multipart_CADC2BY888V1.2~OQZSABRHGCTP.1 size=1048576 2024-09-14T10:51:33.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.987+0000 7f19187cc780 1 < completed part key=_multipart_CADC2BY888V1.2~OQZSABRHGCTP.2 size=813740 2024-09-14T10:51:33.988 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.989+0000 7f19187cc780 1 < completed multipart upload key=CADC2BY888V1 upload=OQZSABRHGCTP tag=F121VPL4S77E type=write size=3959468 2024-09-14T10:51:33.990 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.992+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~95QPHDYPJZ8P.0 size=1048576 2024-09-14T10:51:33.991 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.993+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~95QPHDYPJZ8P.1 size=1048576 2024-09-14T10:51:33.993 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.994+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~95QPHDYPJZ8P.2 size=683265 2024-09-14T10:51:33.993 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.994+0000 7f19187cc780 1 > prepared multipart upload key=VW6U36JN2DBX upload=95QPHDYPJZ8P tag=G4B60LZNIFUJ type=write size=3828993 2024-09-14T10:51:33.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.997+0000 7f19187cc780 1 < suggested update operation key=KOJ7QB7M6A35 tag=XHC42M780FUO type=del size=1854958 2024-09-14T10:51:33.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:33.999+0000 7f19187cc780 1 > prepared operation key=75O00VMLJJ1X tag=585ZSMDGIFU2 type=del size=989887 2024-09-14T10:51:33.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.000+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~7SXVHTVRP275.0 size=1048576 2024-09-14T10:51:34.000 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.002+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~7SXVHTVRP275.1 size=1048576 2024-09-14T10:51:34.001 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.003+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~7SXVHTVRP275.2 size=894491 2024-09-14T10:51:34.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.005+0000 7f19187cc780 1 < completed multipart upload key=7IWUW2HC3ULI upload=7SXVHTVRP275 tag=R57SPIR6PXOT type=write size=4040219 2024-09-14T10:51:34.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.007+0000 7f19187cc780 1 > prepared operation key=617QQI921HB4 tag=A56C3NAHG4MC type=del size=1985887 2024-09-14T10:51:34.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.008+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~RXX7LOP5GJJU.0 size=1048576 2024-09-14T10:51:34.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.010+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~RXX7LOP5GJJU.1 size=1048576 2024-09-14T10:51:34.009 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.011+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~RXX7LOP5GJJU.2 size=311044 2024-09-14T10:51:34.012 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.013+0000 7f19187cc780 1 < completed multipart upload key=6BNN842ZTWG5 upload=RXX7LOP5GJJU tag=GR2GGDR1HFCK type=write size=3456772 2024-09-14T10:51:34.013 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.015+0000 7f19187cc780 1 > prepared operation key=61O2VU0SB379 tag=Q13F1RUZZRRB type=del size=1245405 2024-09-14T10:51:34.014 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.016+0000 7f19187cc780 1 < completed delete operation key=YA3DI7N4DG5K tag=DJUG03M1NVFP type=del 2024-09-14T10:51:34.016 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.017+0000 7f19187cc780 1 > prepared operation key=617QQI921HB4 tag=C3MKX5BHC191 type=write size=943598 2024-09-14T10:51:34.017 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.019+0000 7f19187cc780 1 < completed delete operation key=9EBD5ZT6MT45 tag=FENKM97Q0N2H type=del 2024-09-14T10:51:34.019 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.020+0000 7f19187cc780 1 > prepared operation key=QBMNYNWOLK4I tag=2TEQGPMZE3L0 type=del size=2128140 2024-09-14T10:51:34.019 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.020+0000 7f19187cc780 1 < canceled part key=_multipart_5AIAYJMRZGFQ.2~50GYEQ4AWSLN.0 size=106235 2024-09-14T10:51:34.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.023+0000 7f19187cc780 1 < canceled multipart upload key=5AIAYJMRZGFQ upload=50GYEQ4AWSLN tag=W3BO9H1771LY type=write size=1154811 2024-09-14T10:51:34.024 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.025+0000 7f19187cc780 1 > prepared part key=_multipart_QBMNYNWOLK4I.2~GNO1ZF4329Q1.0 size=1048576 2024-09-14T10:51:34.025 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.027+0000 7f19187cc780 1 > prepared part key=_multipart_QBMNYNWOLK4I.2~GNO1ZF4329Q1.1 size=1048576 2024-09-14T10:51:34.027 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.028+0000 7f19187cc780 1 > prepared part key=_multipart_QBMNYNWOLK4I.2~GNO1ZF4329Q1.2 size=660430 2024-09-14T10:51:34.027 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.028+0000 7f19187cc780 1 > prepared multipart upload key=QBMNYNWOLK4I upload=GNO1ZF4329Q1 tag=ZS6YD9IDUSC2 type=write size=3806158 2024-09-14T10:51:34.028 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.030+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~KTMF9ZNZUQ2B.0 size=1048576 2024-09-14T10:51:34.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.031+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~KTMF9ZNZUQ2B.1 size=104437 2024-09-14T10:51:34.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.033+0000 7f19187cc780 1 < completed multipart upload key=6BNN842ZTWG5 upload=KTMF9ZNZUQ2B tag=NDVNB5OOVLK0 type=write size=2201589 2024-09-14T10:51:34.033 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.035+0000 7f19187cc780 1 > prepared operation key=E6UO1LUWOC44 tag=8M9B1TUNFXJ7 type=write size=447904 2024-09-14T10:51:34.036 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.038+0000 7f19187cc780 1 < suggested remove operation key=9EBD5ZT6MT45 tag=ZF9BQQWIY5M0 type=write 2024-09-14T10:51:34.038 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.039+0000 7f19187cc780 1 > prepared operation key=CADC2BY888V1 tag=PFWFS0UFCWDQ type=del size=1938787 2024-09-14T10:51:34.039 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.041+0000 7f19187cc780 1 < completed delete operation key=QFEI6H4EQ9ZR tag=MD26G1TKOYG6 type=del 2024-09-14T10:51:34.041 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.043+0000 7f19187cc780 1 > prepared operation key=75O00VMLJJ1X tag=XL6Q0QWTS1CA type=del size=2524979 2024-09-14T10:51:34.042 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.043+0000 7f19187cc780 1 < canceled part key=_multipart_KP3WOGIF30PZ.2~5GFU1R4U7YW4.0 size=1048576 2024-09-14T10:51:34.044 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.044+0000 7f19187cc780 1 < completed part key=_multipart_KP3WOGIF30PZ.2~5GFU1R4U7YW4.1 size=189801 2024-09-14T10:51:34.045 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.047+0000 7f19187cc780 1 < canceled multipart upload key=KP3WOGIF30PZ upload=5GFU1R4U7YW4 tag=YHE8P5813V6L type=write size=2286953 2024-09-14T10:51:34.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.048+0000 7f19187cc780 1 > prepared operation key=M73CER01XHDY tag=6VL64B80WE9Z type=del size=2506344 2024-09-14T10:51:34.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.050+0000 7f19187cc780 1 < completed delete operation key=QBMNYNWOLK4I tag=Q8XC56QB6J0Y type=del 2024-09-14T10:51:34.051 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.052+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~Z39I28PWZPNT.0 size=1048576 2024-09-14T10:51:34.052 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.053+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~Z39I28PWZPNT.1 size=1048576 2024-09-14T10:51:34.053 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.054+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~Z39I28PWZPNT.2 size=878791 2024-09-14T10:51:34.053 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.054+0000 7f19187cc780 1 > prepared multipart upload key=XCVE2F2JJK4X upload=Z39I28PWZPNT tag=J037A71C284F type=write size=4024519 2024-09-14T10:51:34.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.058+0000 7f19187cc780 1 < suggested update operation key=KOJ7QB7M6A35 tag=VAO28IJN2ZH8 type=del size=278982 2024-09-14T10:51:34.057 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.059+0000 7f19187cc780 1 > prepared operation key=6BNN842ZTWG5 tag=NC9TKYXZJ1NJ type=del size=2762168 2024-09-14T10:51:34.059 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.061+0000 7f19187cc780 1 < completed part key=_multipart_CADC2BY888V1.2~A4WKH6I6JQ10.0 size=1048576 2024-09-14T10:51:34.060 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.062+0000 7f19187cc780 1 < completed part key=_multipart_CADC2BY888V1.2~A4WKH6I6JQ10.1 size=1048576 2024-09-14T10:51:34.062 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.063+0000 7f19187cc780 1 < completed part key=_multipart_CADC2BY888V1.2~A4WKH6I6JQ10.2 size=615919 2024-09-14T10:51:34.064 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.066+0000 7f19187cc780 1 < completed multipart upload key=CADC2BY888V1 upload=A4WKH6I6JQ10 tag=O2CSLESCQDE2 type=write size=3761647 2024-09-14T10:51:34.066 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.067+0000 7f19187cc780 1 > prepared operation key=KP3WOGIF30PZ tag=XWWI7DMSFQQU type=del size=774518 2024-09-14T10:51:34.068 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.070+0000 7f19187cc780 1 < completed delete operation key=IKVYA4KEALFF tag=ECAQV5FAIE8U type=del 2024-09-14T10:51:34.070 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.071+0000 7f19187cc780 1 > prepared operation key=EL00Y4Z7DTAT tag=6O6YSUKJ4ZAQ type=write size=460653 2024-09-14T10:51:34.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.075+0000 7f19187cc780 1 < suggested remove operation key=617QQI921HB4 tag=6F1QTSFHYMAA type=del 2024-09-14T10:51:34.075 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.077+0000 7f19187cc780 1 > prepared operation key=W1K1IU13J0CZ tag=H9VNK89AROWJ type=write size=988791 2024-09-14T10:51:34.077 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.078+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~95QPHDYPJZ8P.0 size=1048576 2024-09-14T10:51:34.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.080+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~95QPHDYPJZ8P.1 size=1048576 2024-09-14T10:51:34.079 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.081+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~95QPHDYPJZ8P.2 size=683265 2024-09-14T10:51:34.082 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.083+0000 7f19187cc780 1 < completed multipart upload key=VW6U36JN2DBX upload=95QPHDYPJZ8P tag=G4B60LZNIFUJ type=write size=3828993 2024-09-14T10:51:34.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.085+0000 7f19187cc780 1 > prepared operation key=7IWUW2HC3ULI tag=K6CV238ID3K8 type=del size=3089872 2024-09-14T10:51:34.086 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.088+0000 7f19187cc780 1 < suggested remove operation key=75O00VMLJJ1X tag=585ZSMDGIFU2 type=del 2024-09-14T10:51:34.090 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.091+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~CRPLGSPPJEHC.0 size=1048576 2024-09-14T10:51:34.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.093+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~CRPLGSPPJEHC.1 size=96917 2024-09-14T10:51:34.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.093+0000 7f19187cc780 1 > prepared multipart upload key=IKVYA4KEALFF upload=CRPLGSPPJEHC tag=FXC0Q655T0OS type=write size=2194069 2024-09-14T10:51:34.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.094+0000 7f19187cc780 -1 < failed to complete operation key=617QQI921HB4 tag=A56C3NAHG4MC type=del size=1985887: (22) Invalid argument 2024-09-14T10:51:34.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.096+0000 7f19187cc780 1 > prepared operation key=KP3WOGIF30PZ tag=N34EHO9PPVMI type=del size=3185564 2024-09-14T10:51:34.095 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.097+0000 7f19187cc780 1 < completed delete operation key=61O2VU0SB379 tag=Q13F1RUZZRRB type=del 2024-09-14T10:51:34.098 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.100+0000 7f19187cc780 1 > prepared part key=_multipart_QFEI6H4EQ9ZR.2~M5YARJ2VMHWU.0 size=874195 2024-09-14T10:51:34.098 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.100+0000 7f19187cc780 1 > prepared multipart upload key=QFEI6H4EQ9ZR upload=M5YARJ2VMHWU tag=XQNFBNPV3JUK type=write size=1922771 2024-09-14T10:51:34.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.101+0000 7f19187cc780 -1 < failed to complete operation key=617QQI921HB4 tag=C3MKX5BHC191 type=write size=943598: (22) Invalid argument 2024-09-14T10:51:34.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.102+0000 7f19187cc780 1 > prepared operation key=RTGE7ISETJWW tag=A1ME3IV8WH4X type=del size=1566189 2024-09-14T10:51:34.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.104+0000 7f19187cc780 1 < completed delete operation key=QBMNYNWOLK4I tag=2TEQGPMZE3L0 type=del 2024-09-14T10:51:34.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.105+0000 7f19187cc780 1 > prepared operation key=5AIAYJMRZGFQ tag=IL0LQO71F2RV type=del size=2568850 2024-09-14T10:51:34.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.106+0000 7f19187cc780 1 < completed part key=_multipart_QBMNYNWOLK4I.2~GNO1ZF4329Q1.0 size=1048576 2024-09-14T10:51:34.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.108+0000 7f19187cc780 1 < completed part key=_multipart_QBMNYNWOLK4I.2~GNO1ZF4329Q1.1 size=1048576 2024-09-14T10:51:34.107 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.109+0000 7f19187cc780 1 < completed part key=_multipart_QBMNYNWOLK4I.2~GNO1ZF4329Q1.2 size=660430 2024-09-14T10:51:34.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.111+0000 7f19187cc780 1 < completed multipart upload key=QBMNYNWOLK4I upload=GNO1ZF4329Q1 tag=ZS6YD9IDUSC2 type=write size=3806158 2024-09-14T10:51:34.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.112+0000 7f19187cc780 1 > prepared operation key=QBMNYNWOLK4I tag=7MTCIATA9I5C type=del size=3377703 2024-09-14T10:51:34.112 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.114+0000 7f19187cc780 1 < completed write operation key=E6UO1LUWOC44 tag=8M9B1TUNFXJ7 type=write size=447904 2024-09-14T10:51:34.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.115+0000 7f19187cc780 1 > prepared operation key=H40763V7HMBC tag=DHQNYYXLCQSD type=del size=2336518 2024-09-14T10:51:34.115 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.117+0000 7f19187cc780 1 < completed delete operation key=CADC2BY888V1 tag=PFWFS0UFCWDQ type=del 2024-09-14T10:51:34.116 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.118+0000 7f19187cc780 1 > prepared operation key=19P3WE6HKJH2 tag=S1C5PBSHQZCM type=del size=1363779 2024-09-14T10:51:34.117 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.119+0000 7f19187cc780 -1 < no bi entry to suggest for operation key=75O00VMLJJ1X tag=XL6Q0QWTS1CA type=del size=2524979: (2) No such file or directory 2024-09-14T10:51:34.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.121+0000 7f19187cc780 1 > prepared operation key=XCVE2F2JJK4X tag=1YD5MSJ27BR1 type=del size=236683 2024-09-14T10:51:34.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.122+0000 7f19187cc780 1 < completed delete operation key=M73CER01XHDY tag=6VL64B80WE9Z type=del 2024-09-14T10:51:34.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.125+0000 7f19187cc780 1 > prepared part key=_multipart_N0L67LS2KHR1.2~PNTMVHPD0CX6.0 size=1048576 2024-09-14T10:51:34.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.126+0000 7f19187cc780 1 > prepared part key=_multipart_N0L67LS2KHR1.2~PNTMVHPD0CX6.1 size=92669 2024-09-14T10:51:34.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.126+0000 7f19187cc780 1 > prepared multipart upload key=N0L67LS2KHR1 upload=PNTMVHPD0CX6 tag=91F0HNVVA02Q type=write size=2189821 2024-09-14T10:51:34.126 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.128+0000 7f19187cc780 1 < completed part key=_multipart_XCVE2F2JJK4X.2~Z39I28PWZPNT.0 size=1048576 2024-09-14T10:51:34.128 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.129+0000 7f19187cc780 1 < completed part key=_multipart_XCVE2F2JJK4X.2~Z39I28PWZPNT.1 size=1048576 2024-09-14T10:51:34.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.131+0000 7f19187cc780 1 < completed part key=_multipart_XCVE2F2JJK4X.2~Z39I28PWZPNT.2 size=878791 2024-09-14T10:51:34.132 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.134+0000 7f19187cc780 1 < completed multipart upload key=XCVE2F2JJK4X upload=Z39I28PWZPNT tag=J037A71C284F type=write size=4024519 2024-09-14T10:51:34.134 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.135+0000 7f19187cc780 1 > prepared operation key=CADC2BY888V1 tag=AV8FMK2O55CW type=del size=4020801 2024-09-14T10:51:34.137 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.138+0000 7f19187cc780 1 < suggested remove operation key=6BNN842ZTWG5 tag=NC9TKYXZJ1NJ type=del 2024-09-14T10:51:34.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.141+0000 7f19187cc780 1 > prepared part key=_multipart_YA3DI7N4DG5K.2~Z8HY7CQ9THA0.0 size=1048576 2024-09-14T10:51:34.140 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.142+0000 7f19187cc780 1 > prepared part key=_multipart_YA3DI7N4DG5K.2~Z8HY7CQ9THA0.1 size=1048576 2024-09-14T10:51:34.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.143+0000 7f19187cc780 1 > prepared part key=_multipart_YA3DI7N4DG5K.2~Z8HY7CQ9THA0.2 size=937877 2024-09-14T10:51:34.142 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.143+0000 7f19187cc780 1 > prepared multipart upload key=YA3DI7N4DG5K upload=Z8HY7CQ9THA0 tag=JKM60F82WCAL type=write size=4083605 2024-09-14T10:51:34.143 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.145+0000 7f19187cc780 1 < completed delete operation key=KP3WOGIF30PZ tag=XWWI7DMSFQQU type=del 2024-09-14T10:51:34.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.146+0000 7f19187cc780 1 > prepared operation key=EZLSMEK89N2G tag=T811PT0WTN42 type=del size=2942636 2024-09-14T10:51:34.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.148+0000 7f19187cc780 1 < completed write operation key=EL00Y4Z7DTAT tag=6O6YSUKJ4ZAQ type=write size=460653 2024-09-14T10:51:34.147 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.149+0000 7f19187cc780 1 > prepared operation key=AGNUE76X8XCJ tag=0E9W0TNG5OUH type=del size=996703 2024-09-14T10:51:34.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.151+0000 7f19187cc780 1 < canceled operation key=W1K1IU13J0CZ tag=H9VNK89AROWJ type=write size=988791 2024-09-14T10:51:34.152 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.154+0000 7f19187cc780 1 > prepared part key=_multipart_M73CER01XHDY.2~P9ZWCHCHHRFX.0 size=1040694 2024-09-14T10:51:34.152 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.154+0000 7f19187cc780 1 > prepared multipart upload key=M73CER01XHDY upload=P9ZWCHCHHRFX tag=5XLMVLLWKVYV type=write size=2089270 2024-09-14T10:51:34.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.156+0000 7f19187cc780 1 < completed delete operation key=7IWUW2HC3ULI tag=K6CV238ID3K8 type=del 2024-09-14T10:51:34.156 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.157+0000 7f19187cc780 1 > prepared operation key=61O2VU0SB379 tag=3SNDR1LEH47J type=del size=749853 2024-09-14T10:51:34.157 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.159+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~CRPLGSPPJEHC.0 size=1048576 2024-09-14T10:51:34.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.160+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~CRPLGSPPJEHC.1 size=96917 2024-09-14T10:51:34.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.162+0000 7f19187cc780 1 < completed multipart upload key=IKVYA4KEALFF upload=CRPLGSPPJEHC tag=FXC0Q655T0OS type=write size=2194069 2024-09-14T10:51:34.162 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.164+0000 7f19187cc780 1 > prepared operation key=H40763V7HMBC tag=QFL2OPZKPHW1 type=del size=1305262 2024-09-14T10:51:34.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.165+0000 7f19187cc780 1 < canceled operation key=KP3WOGIF30PZ tag=N34EHO9PPVMI type=del size=3185564 2024-09-14T10:51:34.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.167+0000 7f19187cc780 1 > prepared operation key=CADC2BY888V1 tag=JRBWU5I4S3EA type=del size=400591 2024-09-14T10:51:34.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.167+0000 7f19187cc780 1 < canceled part key=_multipart_QFEI6H4EQ9ZR.2~M5YARJ2VMHWU.0 size=874195 2024-09-14T10:51:34.168 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.169+0000 7f19187cc780 1 < canceled multipart upload key=QFEI6H4EQ9ZR upload=M5YARJ2VMHWU tag=XQNFBNPV3JUK type=write size=1922771 2024-09-14T10:51:34.170 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.172+0000 7f19187cc780 1 > prepared part key=_multipart_CADC2BY888V1.2~2J8D08BAZ87X.0 size=1048576 2024-09-14T10:51:34.171 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.173+0000 7f19187cc780 1 > prepared part key=_multipart_CADC2BY888V1.2~2J8D08BAZ87X.1 size=856453 2024-09-14T10:51:34.171 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.173+0000 7f19187cc780 1 > prepared multipart upload key=CADC2BY888V1 upload=2J8D08BAZ87X tag=0C3W6682I0WU type=write size=2953605 2024-09-14T10:51:34.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.176+0000 7f19187cc780 1 < suggested remove operation key=RTGE7ISETJWW tag=A1ME3IV8WH4X type=del 2024-09-14T10:51:34.177 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.178+0000 7f19187cc780 1 > prepared part key=_multipart_54BSD3DEHNK6.2~BNKS4MD9LX1I.0 size=1048576 2024-09-14T10:51:34.178 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.180+0000 7f19187cc780 1 > prepared part key=_multipart_54BSD3DEHNK6.2~BNKS4MD9LX1I.1 size=463093 2024-09-14T10:51:34.178 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.180+0000 7f19187cc780 1 > prepared multipart upload key=54BSD3DEHNK6 upload=BNKS4MD9LX1I tag=L4AJK71KTCWV type=write size=2560245 2024-09-14T10:51:34.181 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.183+0000 7f19187cc780 1 < suggested update operation key=5AIAYJMRZGFQ tag=IL0LQO71F2RV type=del size=2568850 2024-09-14T10:51:34.184 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.185+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~2I0ZZBW1R8QG.0 size=1048576 2024-09-14T10:51:34.185 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.187+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~2I0ZZBW1R8QG.1 size=1048576 2024-09-14T10:51:34.186 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.188+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~2I0ZZBW1R8QG.2 size=1000166 2024-09-14T10:51:34.186 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.188+0000 7f19187cc780 1 > prepared multipart upload key=AGNUE76X8XCJ upload=2I0ZZBW1R8QG tag=XTS7QJ90FSYB type=write size=4145894 2024-09-14T10:51:34.187 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.189+0000 7f19187cc780 1 < completed delete operation key=QBMNYNWOLK4I tag=7MTCIATA9I5C type=del 2024-09-14T10:51:34.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.192+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~YV4HD00L7WEB.0 size=1048576 2024-09-14T10:51:34.191 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.193+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~YV4HD00L7WEB.1 size=1048576 2024-09-14T10:51:34.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.194+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~YV4HD00L7WEB.2 size=230392 2024-09-14T10:51:34.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.194+0000 7f19187cc780 1 > prepared multipart upload key=XCVE2F2JJK4X upload=YV4HD00L7WEB tag=TJDJOFJIANNK type=write size=3376120 2024-09-14T10:51:34.193 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.195+0000 7f19187cc780 1 < canceled operation key=H40763V7HMBC tag=DHQNYYXLCQSD type=del size=2336518 2024-09-14T10:51:34.196 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.198+0000 7f19187cc780 1 > prepared part key=_multipart_AST81B9QWORT.2~VWNDMSIEOZUL.0 size=1048576 2024-09-14T10:51:34.197 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.199+0000 7f19187cc780 1 > prepared part key=_multipart_AST81B9QWORT.2~VWNDMSIEOZUL.1 size=1048576 2024-09-14T10:51:34.198 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.200+0000 7f19187cc780 1 > prepared part key=_multipart_AST81B9QWORT.2~VWNDMSIEOZUL.2 size=794788 2024-09-14T10:51:34.198 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.200+0000 7f19187cc780 1 > prepared multipart upload key=AST81B9QWORT upload=VWNDMSIEOZUL tag=EEREB6L1R3T0 type=write size=3940516 2024-09-14T10:51:34.201 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.203+0000 7f19187cc780 1 < suggested remove operation key=19P3WE6HKJH2 tag=S1C5PBSHQZCM type=del 2024-09-14T10:51:34.204 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.205+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~MS0D5AJBIPED.0 size=1048576 2024-09-14T10:51:34.205 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.206+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~MS0D5AJBIPED.1 size=552130 2024-09-14T10:51:34.205 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.206+0000 7f19187cc780 1 > prepared multipart upload key=XCVE2F2JJK4X upload=MS0D5AJBIPED tag=514HIMZTXWB9 type=write size=2649282 2024-09-14T10:51:34.208 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.209+0000 7f19187cc780 1 < suggested remove operation key=XCVE2F2JJK4X tag=1YD5MSJ27BR1 type=del 2024-09-14T10:51:34.209 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.211+0000 7f19187cc780 1 > prepared operation key=5AIAYJMRZGFQ tag=IBXNMGT3KUL2 type=del size=2193621 2024-09-14T10:51:34.211 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.212+0000 7f19187cc780 1 < completed part key=_multipart_N0L67LS2KHR1.2~PNTMVHPD0CX6.0 size=1048576 2024-09-14T10:51:34.212 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.213+0000 7f19187cc780 1 < completed part key=_multipart_N0L67LS2KHR1.2~PNTMVHPD0CX6.1 size=92669 2024-09-14T10:51:34.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.216+0000 7f19187cc780 1 < completed multipart upload key=N0L67LS2KHR1 upload=PNTMVHPD0CX6 tag=91F0HNVVA02Q type=write size=2189821 2024-09-14T10:51:34.216 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.217+0000 7f19187cc780 1 > prepared operation key=M73CER01XHDY tag=MEXXWN008IKC type=del size=2439648 2024-09-14T10:51:34.217 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.219+0000 7f19187cc780 1 < completed delete operation key=CADC2BY888V1 tag=AV8FMK2O55CW type=del 2024-09-14T10:51:34.218 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.220+0000 7f19187cc780 1 > prepared operation key=W1K1IU13J0CZ tag=BAPN3CDVCOVE type=del size=1217677 2024-09-14T10:51:34.220 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.222+0000 7f19187cc780 1 < completed part key=_multipart_YA3DI7N4DG5K.2~Z8HY7CQ9THA0.0 size=1048576 2024-09-14T10:51:34.221 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.223+0000 7f19187cc780 1 < completed part key=_multipart_YA3DI7N4DG5K.2~Z8HY7CQ9THA0.1 size=1048576 2024-09-14T10:51:34.222 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.224+0000 7f19187cc780 1 < completed part key=_multipart_YA3DI7N4DG5K.2~Z8HY7CQ9THA0.2 size=937877 2024-09-14T10:51:34.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.227+0000 7f19187cc780 1 < completed multipart upload key=YA3DI7N4DG5K upload=Z8HY7CQ9THA0 tag=JKM60F82WCAL type=write size=4083605 2024-09-14T10:51:34.230 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.231+0000 7f19187cc780 1 > prepared part key=_multipart_M73CER01XHDY.2~X5X6IVTN7UG1.0 size=344238 2024-09-14T10:51:34.230 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.231+0000 7f19187cc780 1 > prepared multipart upload key=M73CER01XHDY upload=X5X6IVTN7UG1 tag=3D0LKEL8STH8 type=write size=1392814 2024-09-14T10:51:34.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.234+0000 7f19187cc780 1 < suggested remove operation key=EZLSMEK89N2G tag=T811PT0WTN42 type=del 2024-09-14T10:51:34.234 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.235+0000 7f19187cc780 1 > prepared operation key=QFEI6H4EQ9ZR tag=KYKRIYP53FOF type=del size=1775736 2024-09-14T10:51:34.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.237+0000 7f19187cc780 1 < completed delete operation key=AGNUE76X8XCJ tag=0E9W0TNG5OUH type=del 2024-09-14T10:51:34.238 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.240+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~NCKCGQYQZENX.0 size=1048576 2024-09-14T10:51:34.240 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.241+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~NCKCGQYQZENX.1 size=509699 2024-09-14T10:51:34.240 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.241+0000 7f19187cc780 1 > prepared multipart upload key=6BNN842ZTWG5 upload=NCKCGQYQZENX tag=S092UPZ861J3 type=write size=2606851 2024-09-14T10:51:34.241 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.243+0000 7f19187cc780 1 < completed part key=_multipart_M73CER01XHDY.2~P9ZWCHCHHRFX.0 size=1040694 2024-09-14T10:51:34.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.245+0000 7f19187cc780 1 < completed multipart upload key=M73CER01XHDY upload=P9ZWCHCHHRFX tag=5XLMVLLWKVYV type=write size=2089270 2024-09-14T10:51:34.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.247+0000 7f19187cc780 1 > prepared operation key=QBMNYNWOLK4I tag=6Q2HP9Q7DNMJ type=del size=732667 2024-09-14T10:51:34.248 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.250+0000 7f19187cc780 1 < suggested update operation key=61O2VU0SB379 tag=3SNDR1LEH47J type=del size=749853 2024-09-14T10:51:34.249 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.251+0000 7f19187cc780 1 > prepared operation key=N0L67LS2KHR1 tag=CNWO1S3W7OJZ type=del size=688978 2024-09-14T10:51:34.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.252+0000 7f19187cc780 1 < completed delete operation key=H40763V7HMBC tag=QFL2OPZKPHW1 type=del 2024-09-14T10:51:34.253 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.255+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~DYCEPE3EZEHH.0 size=1048576 2024-09-14T10:51:34.254 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.256+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~DYCEPE3EZEHH.1 size=1048576 2024-09-14T10:51:34.255 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.257+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~DYCEPE3EZEHH.2 size=761778 2024-09-14T10:51:34.256 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.257+0000 7f19187cc780 1 > prepared multipart upload key=6BNN842ZTWG5 upload=DYCEPE3EZEHH tag=77SLX6DFS0ER type=write size=3907506 2024-09-14T10:51:34.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.260+0000 7f19187cc780 1 < suggested update operation key=CADC2BY888V1 tag=JRBWU5I4S3EA type=del size=400591 2024-09-14T10:51:34.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.261+0000 7f19187cc780 1 > prepared operation key=CADC2BY888V1 tag=GH7YH8QYFU2O type=write size=352744 2024-09-14T10:51:34.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.263+0000 7f19187cc780 1 < completed part key=_multipart_CADC2BY888V1.2~2J8D08BAZ87X.0 size=1048576 2024-09-14T10:51:34.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.264+0000 7f19187cc780 1 < completed part key=_multipart_CADC2BY888V1.2~2J8D08BAZ87X.1 size=856453 2024-09-14T10:51:34.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.266+0000 7f19187cc780 1 < completed multipart upload key=CADC2BY888V1 upload=2J8D08BAZ87X tag=0C3W6682I0WU type=write size=2953605 2024-09-14T10:51:34.268 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.269+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~P2E2SGMGXRM3.0 size=1048576 2024-09-14T10:51:34.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.271+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~P2E2SGMGXRM3.1 size=479756 2024-09-14T10:51:34.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.271+0000 7f19187cc780 1 > prepared multipart upload key=KOJ7QB7M6A35 upload=P2E2SGMGXRM3 tag=GXP8ULDKFV8J type=write size=2576908 2024-09-14T10:51:34.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.272+0000 7f19187cc780 1 < completed part key=_multipart_54BSD3DEHNK6.2~BNKS4MD9LX1I.0 size=1048576 2024-09-14T10:51:34.272 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.273+0000 7f19187cc780 1 < completed part key=_multipart_54BSD3DEHNK6.2~BNKS4MD9LX1I.1 size=463093 2024-09-14T10:51:34.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.276+0000 7f19187cc780 1 < completed multipart upload key=54BSD3DEHNK6 upload=BNKS4MD9LX1I tag=L4AJK71KTCWV type=write size=2560245 2024-09-14T10:51:34.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.277+0000 7f19187cc780 1 > prepared operation key=MFA30GSMCSKP tag=NCI61WZOJ14B type=del size=3283363 2024-09-14T10:51:34.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.278+0000 7f19187cc780 1 < canceled part key=_multipart_AGNUE76X8XCJ.2~2I0ZZBW1R8QG.0 size=1048576 2024-09-14T10:51:34.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.278+0000 7f19187cc780 1 < canceled part key=_multipart_AGNUE76X8XCJ.2~2I0ZZBW1R8QG.1 size=1048576 2024-09-14T10:51:34.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.278+0000 7f19187cc780 1 < canceled part key=_multipart_AGNUE76X8XCJ.2~2I0ZZBW1R8QG.2 size=1000166 2024-09-14T10:51:34.278 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.280+0000 7f19187cc780 1 < canceled multipart upload key=AGNUE76X8XCJ upload=2I0ZZBW1R8QG tag=XTS7QJ90FSYB type=write size=4145894 2024-09-14T10:51:34.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.282+0000 7f19187cc780 1 > prepared operation key=KP3WOGIF30PZ tag=NKMQF5Y0POYV type=write size=652761 2024-09-14T10:51:34.281 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.283+0000 7f19187cc780 1 < completed part key=_multipart_XCVE2F2JJK4X.2~YV4HD00L7WEB.0 size=1048576 2024-09-14T10:51:34.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.284+0000 7f19187cc780 1 < completed part key=_multipart_XCVE2F2JJK4X.2~YV4HD00L7WEB.1 size=1048576 2024-09-14T10:51:34.284 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.285+0000 7f19187cc780 1 < completed part key=_multipart_XCVE2F2JJK4X.2~YV4HD00L7WEB.2 size=230392 2024-09-14T10:51:34.286 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.288+0000 7f19187cc780 1 < completed multipart upload key=XCVE2F2JJK4X upload=YV4HD00L7WEB tag=TJDJOFJIANNK type=write size=3376120 2024-09-14T10:51:34.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.291+0000 7f19187cc780 1 > prepared part key=_multipart_75O00VMLJJ1X.2~TVYOLOBWKWSJ.0 size=1048576 2024-09-14T10:51:34.290 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.292+0000 7f19187cc780 1 > prepared part key=_multipart_75O00VMLJJ1X.2~TVYOLOBWKWSJ.1 size=1048576 2024-09-14T10:51:34.292 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.293+0000 7f19187cc780 1 > prepared part key=_multipart_75O00VMLJJ1X.2~TVYOLOBWKWSJ.2 size=421810 2024-09-14T10:51:34.292 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.293+0000 7f19187cc780 1 > prepared multipart upload key=75O00VMLJJ1X upload=TVYOLOBWKWSJ tag=75RZVLJAV9M6 type=write size=3567538 2024-09-14T10:51:34.293 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.295+0000 7f19187cc780 1 < completed part key=_multipart_AST81B9QWORT.2~VWNDMSIEOZUL.0 size=1048576 2024-09-14T10:51:34.294 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.296+0000 7f19187cc780 1 < completed part key=_multipart_AST81B9QWORT.2~VWNDMSIEOZUL.1 size=1048576 2024-09-14T10:51:34.295 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.297+0000 7f19187cc780 1 < completed part key=_multipart_AST81B9QWORT.2~VWNDMSIEOZUL.2 size=794788 2024-09-14T10:51:34.298 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.300+0000 7f19187cc780 1 < completed multipart upload key=AST81B9QWORT upload=VWNDMSIEOZUL tag=EEREB6L1R3T0 type=write size=3940516 2024-09-14T10:51:34.301 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.302+0000 7f19187cc780 1 > prepared part key=_multipart_61O2VU0SB379.2~JGY31A4VU8VB.0 size=1048576 2024-09-14T10:51:34.302 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.303+0000 7f19187cc780 1 > prepared part key=_multipart_61O2VU0SB379.2~JGY31A4VU8VB.1 size=710541 2024-09-14T10:51:34.302 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.303+0000 7f19187cc780 1 > prepared multipart upload key=61O2VU0SB379 upload=JGY31A4VU8VB tag=1T0AG1HKNXKM type=write size=2807693 2024-09-14T10:51:34.303 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.305+0000 7f19187cc780 1 < completed part key=_multipart_XCVE2F2JJK4X.2~MS0D5AJBIPED.0 size=1048576 2024-09-14T10:51:34.304 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.306+0000 7f19187cc780 1 < completed part key=_multipart_XCVE2F2JJK4X.2~MS0D5AJBIPED.1 size=552130 2024-09-14T10:51:34.307 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.309+0000 7f19187cc780 1 < completed multipart upload key=XCVE2F2JJK4X upload=MS0D5AJBIPED tag=514HIMZTXWB9 type=write size=2649282 2024-09-14T10:51:34.309 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.310+0000 7f19187cc780 1 > prepared operation key=IKVYA4KEALFF tag=NRSHR60DVDSE type=del size=1080642 2024-09-14T10:51:34.310 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.312+0000 7f19187cc780 1 < completed delete operation key=5AIAYJMRZGFQ tag=IBXNMGT3KUL2 type=del 2024-09-14T10:51:34.313 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.314+0000 7f19187cc780 1 > prepared part key=_multipart_MFA30GSMCSKP.2~0AQM5VK0N885.0 size=1048576 2024-09-14T10:51:34.314 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.316+0000 7f19187cc780 1 > prepared part key=_multipart_MFA30GSMCSKP.2~0AQM5VK0N885.1 size=380645 2024-09-14T10:51:34.314 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.316+0000 7f19187cc780 1 > prepared multipart upload key=MFA30GSMCSKP upload=0AQM5VK0N885 tag=ZDVV5O7RSN49 type=write size=2477797 2024-09-14T10:51:34.315 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.317+0000 7f19187cc780 1 < completed delete operation key=M73CER01XHDY tag=MEXXWN008IKC type=del 2024-09-14T10:51:34.317 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.319+0000 7f19187cc780 1 > prepared operation key=KP3WOGIF30PZ tag=2KF9C4O0UK98 type=del size=1326066 2024-09-14T10:51:34.319 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.320+0000 7f19187cc780 1 < completed delete operation key=W1K1IU13J0CZ tag=BAPN3CDVCOVE type=del 2024-09-14T10:51:34.320 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.322+0000 7f19187cc780 1 > prepared operation key=KOJ7QB7M6A35 tag=7EIRMAAIL88X type=del size=1272226 2024-09-14T10:51:34.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.324+0000 7f19187cc780 1 < completed part key=_multipart_M73CER01XHDY.2~X5X6IVTN7UG1.0 size=344238 2024-09-14T10:51:34.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.326+0000 7f19187cc780 1 < completed multipart upload key=M73CER01XHDY upload=X5X6IVTN7UG1 tag=3D0LKEL8STH8 type=write size=1392814 2024-09-14T10:51:34.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.329+0000 7f19187cc780 1 > prepared part key=_multipart_M73CER01XHDY.2~6PAKL5WDMMCK.0 size=1048576 2024-09-14T10:51:34.329 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.330+0000 7f19187cc780 1 > prepared part key=_multipart_M73CER01XHDY.2~6PAKL5WDMMCK.1 size=1048576 2024-09-14T10:51:34.330 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.332+0000 7f19187cc780 1 > prepared part key=_multipart_M73CER01XHDY.2~6PAKL5WDMMCK.2 size=767954 2024-09-14T10:51:34.330 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.332+0000 7f19187cc780 1 > prepared multipart upload key=M73CER01XHDY upload=6PAKL5WDMMCK tag=NII05RZ8MRIN type=write size=3913682 2024-09-14T10:51:34.332 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.333+0000 7f19187cc780 1 < completed delete operation key=QFEI6H4EQ9ZR tag=KYKRIYP53FOF type=del 2024-09-14T10:51:34.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.336+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~H2749V0ZJ0PU.0 size=837395 2024-09-14T10:51:34.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.336+0000 7f19187cc780 1 > prepared multipart upload key=7IWUW2HC3ULI upload=H2749V0ZJ0PU tag=CV8WT5F3L1HO type=write size=1885971 2024-09-14T10:51:34.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.338+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~NCKCGQYQZENX.0 size=1048576 2024-09-14T10:51:34.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.339+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~NCKCGQYQZENX.1 size=509699 2024-09-14T10:51:34.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.341+0000 7f19187cc780 1 < completed multipart upload key=6BNN842ZTWG5 upload=NCKCGQYQZENX tag=S092UPZ861J3 type=write size=2606851 2024-09-14T10:51:34.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.344+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~EOWRJYZ7MPUQ.0 size=411370 2024-09-14T10:51:34.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.344+0000 7f19187cc780 1 > prepared multipart upload key=OVOPGTYUF3F3 upload=EOWRJYZ7MPUQ tag=NIUNXEO1QMRN type=write size=1459946 2024-09-14T10:51:34.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.346+0000 7f19187cc780 1 < completed delete operation key=QBMNYNWOLK4I tag=6Q2HP9Q7DNMJ type=del 2024-09-14T10:51:34.346 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.348+0000 7f19187cc780 1 > prepared operation key=B9FQYIX19AEP tag=CL8772PPPIVE type=del size=3261732 2024-09-14T10:51:34.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.350+0000 7f19187cc780 1 < completed delete operation key=N0L67LS2KHR1 tag=CNWO1S3W7OJZ type=del 2024-09-14T10:51:34.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.351+0000 7f19187cc780 1 > prepared operation key=KOJ7QB7M6A35 tag=W6BRX8E5HOZB type=del size=2733124 2024-09-14T10:51:34.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.353+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~DYCEPE3EZEHH.0 size=1048576 2024-09-14T10:51:34.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.354+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~DYCEPE3EZEHH.1 size=1048576 2024-09-14T10:51:34.354 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.356+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~DYCEPE3EZEHH.2 size=761778 2024-09-14T10:51:34.357 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.358+0000 7f19187cc780 1 < completed multipart upload key=6BNN842ZTWG5 upload=DYCEPE3EZEHH tag=77SLX6DFS0ER type=write size=3907506 2024-09-14T10:51:34.359 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.360+0000 7f19187cc780 1 > prepared operation key=VW6U36JN2DBX tag=IQXY6WFS0LVJ type=del size=4135285 2024-09-14T10:51:34.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.364+0000 7f19187cc780 1 < suggested update operation key=CADC2BY888V1 tag=GH7YH8QYFU2O type=write size=352744 2024-09-14T10:51:34.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.367+0000 7f19187cc780 1 > prepared part key=_multipart_5AIAYJMRZGFQ.2~UN6XOAUJGOKH.0 size=1048576 2024-09-14T10:51:34.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.369+0000 7f19187cc780 1 > prepared part key=_multipart_5AIAYJMRZGFQ.2~UN6XOAUJGOKH.1 size=597282 2024-09-14T10:51:34.368 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.369+0000 7f19187cc780 1 > prepared multipart upload key=5AIAYJMRZGFQ upload=UN6XOAUJGOKH tag=F0OJZC7FGQE2 type=write size=2694434 2024-09-14T10:51:34.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.371+0000 7f19187cc780 1 < completed part key=_multipart_KOJ7QB7M6A35.2~P2E2SGMGXRM3.0 size=1048576 2024-09-14T10:51:34.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.372+0000 7f19187cc780 1 < completed part key=_multipart_KOJ7QB7M6A35.2~P2E2SGMGXRM3.1 size=479756 2024-09-14T10:51:34.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.375+0000 7f19187cc780 1 < completed multipart upload key=KOJ7QB7M6A35 upload=P2E2SGMGXRM3 tag=GXP8ULDKFV8J type=write size=2576908 2024-09-14T10:51:34.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.377+0000 7f19187cc780 1 > prepared operation key=AST81B9QWORT tag=K5C979BYV138 type=del size=3528269 2024-09-14T10:51:34.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.378+0000 7f19187cc780 1 < completed delete operation key=MFA30GSMCSKP tag=NCI61WZOJ14B type=del 2024-09-14T10:51:34.379 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.380+0000 7f19187cc780 1 > prepared operation key=5AIAYJMRZGFQ tag=MEY1LNFKR4M7 type=del size=3930710 2024-09-14T10:51:34.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.382+0000 7f19187cc780 1 < completed write operation key=KP3WOGIF30PZ tag=NKMQF5Y0POYV type=write size=652761 2024-09-14T10:51:34.382 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.384+0000 7f19187cc780 1 > prepared operation key=19P3WE6HKJH2 tag=UAB3CUPLVATS type=del size=2814045 2024-09-14T10:51:34.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.386+0000 7f19187cc780 1 < completed part key=_multipart_75O00VMLJJ1X.2~TVYOLOBWKWSJ.0 size=1048576 2024-09-14T10:51:34.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.386+0000 7f19187cc780 1 < canceled part key=_multipart_75O00VMLJJ1X.2~TVYOLOBWKWSJ.1 size=1048576 2024-09-14T10:51:34.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.387+0000 7f19187cc780 1 < completed part key=_multipart_75O00VMLJJ1X.2~TVYOLOBWKWSJ.2 size=421810 2024-09-14T10:51:34.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.390+0000 7f19187cc780 1 < canceled multipart upload key=75O00VMLJJ1X upload=TVYOLOBWKWSJ tag=75RZVLJAV9M6 type=write size=3567538 2024-09-14T10:51:34.391 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.392+0000 7f19187cc780 1 > prepared part key=_multipart_E6UO1LUWOC44.2~YRZU2BAVGTQA.0 size=1048576 2024-09-14T10:51:34.392 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.393+0000 7f19187cc780 1 > prepared part key=_multipart_E6UO1LUWOC44.2~YRZU2BAVGTQA.1 size=1048576 2024-09-14T10:51:34.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.395+0000 7f19187cc780 1 > prepared part key=_multipart_E6UO1LUWOC44.2~YRZU2BAVGTQA.2 size=860201 2024-09-14T10:51:34.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.395+0000 7f19187cc780 1 > prepared multipart upload key=E6UO1LUWOC44 upload=YRZU2BAVGTQA tag=3NRSPEFQO9XP type=write size=4005929 2024-09-14T10:51:34.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.396+0000 7f19187cc780 1 < completed part key=_multipart_61O2VU0SB379.2~JGY31A4VU8VB.0 size=1048576 2024-09-14T10:51:34.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.397+0000 7f19187cc780 1 < completed part key=_multipart_61O2VU0SB379.2~JGY31A4VU8VB.1 size=710541 2024-09-14T10:51:34.398 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.400+0000 7f19187cc780 1 < completed multipart upload key=61O2VU0SB379 upload=JGY31A4VU8VB tag=1T0AG1HKNXKM type=write size=2807693 2024-09-14T10:51:34.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.402+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~SA1IIZPO2XL9.0 size=1048576 2024-09-14T10:51:34.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.404+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~SA1IIZPO2XL9.1 size=1048576 2024-09-14T10:51:34.403 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.405+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~SA1IIZPO2XL9.2 size=989320 2024-09-14T10:51:34.403 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.405+0000 7f19187cc780 1 > prepared multipart upload key=7IWUW2HC3ULI upload=SA1IIZPO2XL9 tag=7XD1G3O02EIG type=write size=4135048 2024-09-14T10:51:34.406 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.408+0000 7f19187cc780 1 < suggested update operation key=IKVYA4KEALFF tag=NRSHR60DVDSE type=del size=1080642 2024-09-14T10:51:34.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.409+0000 7f19187cc780 1 > prepared operation key=KP3WOGIF30PZ tag=3TIWHPF6PL66 type=del size=2989720 2024-09-14T10:51:34.409 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.411+0000 7f19187cc780 1 < completed part key=_multipart_MFA30GSMCSKP.2~0AQM5VK0N885.0 size=1048576 2024-09-14T10:51:34.410 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.412+0000 7f19187cc780 1 < completed part key=_multipart_MFA30GSMCSKP.2~0AQM5VK0N885.1 size=380645 2024-09-14T10:51:34.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.414+0000 7f19187cc780 1 < completed multipart upload key=MFA30GSMCSKP upload=0AQM5VK0N885 tag=ZDVV5O7RSN49 type=write size=2477797 2024-09-14T10:51:34.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.416+0000 7f19187cc780 1 > prepared operation key=E6UO1LUWOC44 tag=C1NO1MW2IXJ2 type=write size=410100 2024-09-14T10:51:34.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.419+0000 7f19187cc780 1 < suggested update operation key=KP3WOGIF30PZ tag=2KF9C4O0UK98 type=del size=1326066 2024-09-14T10:51:34.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.421+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~O2ZSON2ZLVZI.0 size=1048576 2024-09-14T10:51:34.421 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.422+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~O2ZSON2ZLVZI.1 size=884567 2024-09-14T10:51:34.421 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.422+0000 7f19187cc780 1 > prepared multipart upload key=KOJ7QB7M6A35 upload=O2ZSON2ZLVZI tag=8CBA24PS2TW4 type=write size=2981719 2024-09-14T10:51:34.423 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.425+0000 7f19187cc780 1 < completed delete operation key=KOJ7QB7M6A35 tag=7EIRMAAIL88X type=del 2024-09-14T10:51:34.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.427+0000 7f19187cc780 1 > prepared operation key=QFEI6H4EQ9ZR tag=WZZ42TO7PEEV type=write size=600937 2024-09-14T10:51:34.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.429+0000 7f19187cc780 1 < completed part key=_multipart_M73CER01XHDY.2~6PAKL5WDMMCK.0 size=1048576 2024-09-14T10:51:34.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.430+0000 7f19187cc780 1 < completed part key=_multipart_M73CER01XHDY.2~6PAKL5WDMMCK.1 size=1048576 2024-09-14T10:51:34.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.430+0000 7f19187cc780 1 < canceled part key=_multipart_M73CER01XHDY.2~6PAKL5WDMMCK.2 size=767954 2024-09-14T10:51:34.431 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.433+0000 7f19187cc780 1 < canceled multipart upload key=M73CER01XHDY upload=6PAKL5WDMMCK tag=NII05RZ8MRIN type=write size=3913682 2024-09-14T10:51:34.433 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.434+0000 7f19187cc780 1 > prepared operation key=RTGE7ISETJWW tag=Y9TU6O0ZP1ZL type=del size=2977582 2024-09-14T10:51:34.434 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.436+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~H2749V0ZJ0PU.0 size=837395 2024-09-14T10:51:34.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.438+0000 7f19187cc780 1 < completed multipart upload key=7IWUW2HC3ULI upload=H2749V0ZJ0PU tag=CV8WT5F3L1HO type=write size=1885971 2024-09-14T10:51:34.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.441+0000 7f19187cc780 1 > prepared part key=_multipart_75O00VMLJJ1X.2~RKBMB148S37C.0 size=1048576 2024-09-14T10:51:34.440 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.442+0000 7f19187cc780 1 > prepared part key=_multipart_75O00VMLJJ1X.2~RKBMB148S37C.1 size=103336 2024-09-14T10:51:34.440 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.442+0000 7f19187cc780 1 > prepared multipart upload key=75O00VMLJJ1X upload=RKBMB148S37C tag=8HGK8OYV5DRO type=write size=2200488 2024-09-14T10:51:34.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.443+0000 7f19187cc780 1 < completed part key=_multipart_OVOPGTYUF3F3.2~EOWRJYZ7MPUQ.0 size=411370 2024-09-14T10:51:34.444 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.445+0000 7f19187cc780 1 < completed multipart upload key=OVOPGTYUF3F3 upload=EOWRJYZ7MPUQ tag=NIUNXEO1QMRN type=write size=1459946 2024-09-14T10:51:34.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.448+0000 7f19187cc780 1 > prepared part key=_multipart_INJQTKXHBUV2.2~4WGTOF20YX3M.0 size=1048576 2024-09-14T10:51:34.448 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.449+0000 7f19187cc780 1 > prepared part key=_multipart_INJQTKXHBUV2.2~4WGTOF20YX3M.1 size=34576 2024-09-14T10:51:34.448 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.450+0000 7f19187cc780 1 > prepared multipart upload key=INJQTKXHBUV2 upload=4WGTOF20YX3M tag=NQ370SX21U0P type=write size=2131728 2024-09-14T10:51:34.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.451+0000 7f19187cc780 1 < completed delete operation key=B9FQYIX19AEP tag=CL8772PPPIVE type=del 2024-09-14T10:51:34.452 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.454+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~CJ2TLSH62SUQ.0 size=172034 2024-09-14T10:51:34.452 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.454+0000 7f19187cc780 1 > prepared multipart upload key=7IWUW2HC3ULI upload=CJ2TLSH62SUQ tag=K69N7KGX7VI9 type=write size=1220610 2024-09-14T10:51:34.454 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.455+0000 7f19187cc780 1 < completed delete operation key=KOJ7QB7M6A35 tag=W6BRX8E5HOZB type=del 2024-09-14T10:51:34.455 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.457+0000 7f19187cc780 1 > prepared operation key=KOJ7QB7M6A35 tag=XL9ILOVN5A5K type=write size=632479 2024-09-14T10:51:34.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.458+0000 7f19187cc780 1 < completed delete operation key=VW6U36JN2DBX tag=IQXY6WFS0LVJ type=del 2024-09-14T10:51:34.459 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.461+0000 7f19187cc780 1 > prepared part key=_multipart_M73CER01XHDY.2~EXPIET15U0FL.0 size=978906 2024-09-14T10:51:34.459 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.461+0000 7f19187cc780 1 > prepared multipart upload key=M73CER01XHDY upload=EXPIET15U0FL tag=B2QG21SNPV9Z type=write size=2027482 2024-09-14T10:51:34.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.462+0000 7f19187cc780 1 < completed part key=_multipart_5AIAYJMRZGFQ.2~UN6XOAUJGOKH.0 size=1048576 2024-09-14T10:51:34.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.464+0000 7f19187cc780 1 < completed part key=_multipart_5AIAYJMRZGFQ.2~UN6XOAUJGOKH.1 size=597282 2024-09-14T10:51:34.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.466+0000 7f19187cc780 1 < completed multipart upload key=5AIAYJMRZGFQ upload=UN6XOAUJGOKH tag=F0OJZC7FGQE2 type=write size=2694434 2024-09-14T10:51:34.467 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.469+0000 7f19187cc780 1 > prepared part key=_multipart_H40763V7HMBC.2~CWL616S9H597.0 size=1048576 2024-09-14T10:51:34.468 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.470+0000 7f19187cc780 1 > prepared part key=_multipart_H40763V7HMBC.2~CWL616S9H597.1 size=590466 2024-09-14T10:51:34.468 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.470+0000 7f19187cc780 1 > prepared multipart upload key=H40763V7HMBC upload=CWL616S9H597 tag=6KVLULFMSOE4 type=write size=2687618 2024-09-14T10:51:34.470 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.471+0000 7f19187cc780 1 < completed delete operation key=AST81B9QWORT tag=K5C979BYV138 type=del 2024-09-14T10:51:34.471 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.473+0000 7f19187cc780 1 > prepared operation key=N0L67LS2KHR1 tag=LWF3Y2CT48QK type=del size=85416 2024-09-14T10:51:34.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.474+0000 7f19187cc780 1 < completed delete operation key=5AIAYJMRZGFQ tag=MEY1LNFKR4M7 type=del 2024-09-14T10:51:34.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.476+0000 7f19187cc780 1 > prepared operation key=6BNN842ZTWG5 tag=CENNYMDU47PB type=del size=3545574 2024-09-14T10:51:34.476 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.477+0000 7f19187cc780 1 < completed delete operation key=19P3WE6HKJH2 tag=UAB3CUPLVATS type=del 2024-09-14T10:51:34.478 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.480+0000 7f19187cc780 1 > prepared part key=_multipart_H40763V7HMBC.2~TH567G0OWG4N.0 size=975199 2024-09-14T10:51:34.478 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.480+0000 7f19187cc780 1 > prepared multipart upload key=H40763V7HMBC upload=TH567G0OWG4N tag=QGKX8CLQLMW0 type=write size=2023775 2024-09-14T10:51:34.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.482+0000 7f19187cc780 1 < completed part key=_multipart_E6UO1LUWOC44.2~YRZU2BAVGTQA.0 size=1048576 2024-09-14T10:51:34.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.483+0000 7f19187cc780 1 < completed part key=_multipart_E6UO1LUWOC44.2~YRZU2BAVGTQA.1 size=1048576 2024-09-14T10:51:34.482 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.484+0000 7f19187cc780 1 < completed part key=_multipart_E6UO1LUWOC44.2~YRZU2BAVGTQA.2 size=860201 2024-09-14T10:51:34.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.486+0000 7f19187cc780 1 < completed multipart upload key=E6UO1LUWOC44 upload=YRZU2BAVGTQA tag=3NRSPEFQO9XP type=write size=4005929 2024-09-14T10:51:34.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.488+0000 7f19187cc780 1 > prepared operation key=OVOPGTYUF3F3 tag=MK6DY30YVW9D type=del size=1833355 2024-09-14T10:51:34.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.488+0000 7f19187cc780 1 < canceled part key=_multipart_7IWUW2HC3ULI.2~SA1IIZPO2XL9.0 size=1048576 2024-09-14T10:51:34.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.489+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~SA1IIZPO2XL9.1 size=1048576 2024-09-14T10:51:34.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.490+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~SA1IIZPO2XL9.2 size=989320 2024-09-14T10:51:34.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.493+0000 7f19187cc780 1 < canceled multipart upload key=7IWUW2HC3ULI upload=SA1IIZPO2XL9 tag=7XD1G3O02EIG type=write size=4135048 2024-09-14T10:51:34.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.494+0000 7f19187cc780 1 > prepared operation key=AST81B9QWORT tag=1QKHIRR2W7IJ type=write size=126021 2024-09-14T10:51:34.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.496+0000 7f19187cc780 -1 < failed to complete operation key=KP3WOGIF30PZ tag=3TIWHPF6PL66 type=del size=2989720: (22) Invalid argument 2024-09-14T10:51:34.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.498+0000 7f19187cc780 1 > prepared part key=_multipart_M73CER01XHDY.2~6ZUFNN7JK37B.0 size=702561 2024-09-14T10:51:34.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.498+0000 7f19187cc780 1 > prepared multipart upload key=M73CER01XHDY upload=6ZUFNN7JK37B tag=9R8FI2L9FY2C type=write size=1751137 2024-09-14T10:51:34.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.501+0000 7f19187cc780 1 < suggested remove operation key=E6UO1LUWOC44 tag=C1NO1MW2IXJ2 type=write 2024-09-14T10:51:34.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.504+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~8Y52A1J2HVNQ.0 size=987004 2024-09-14T10:51:34.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.504+0000 7f19187cc780 1 > prepared multipart upload key=6BNN842ZTWG5 upload=8Y52A1J2HVNQ tag=BJIOQ54B1DEP type=write size=2035580 2024-09-14T10:51:34.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.506+0000 7f19187cc780 1 < completed part key=_multipart_KOJ7QB7M6A35.2~O2ZSON2ZLVZI.0 size=1048576 2024-09-14T10:51:34.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.507+0000 7f19187cc780 1 < completed part key=_multipart_KOJ7QB7M6A35.2~O2ZSON2ZLVZI.1 size=884567 2024-09-14T10:51:34.508 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.510+0000 7f19187cc780 1 < completed multipart upload key=KOJ7QB7M6A35 upload=O2ZSON2ZLVZI tag=8CBA24PS2TW4 type=write size=2981719 2024-09-14T10:51:34.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.513+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~DVYRYJ0MRNAN.0 size=1048576 2024-09-14T10:51:34.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.514+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~DVYRYJ0MRNAN.1 size=1048576 2024-09-14T10:51:34.513 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.515+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~DVYRYJ0MRNAN.2 size=544615 2024-09-14T10:51:34.513 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.515+0000 7f19187cc780 1 > prepared multipart upload key=B9FQYIX19AEP upload=DVYRYJ0MRNAN tag=3VZXOVSL88BV type=write size=3690343 2024-09-14T10:51:34.515 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.516+0000 7f19187cc780 1 < completed write operation key=QFEI6H4EQ9ZR tag=WZZ42TO7PEEV type=write size=600937 2024-09-14T10:51:34.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.518+0000 7f19187cc780 1 > prepared operation key=IKVYA4KEALFF tag=MCTV219CVAE6 type=del size=1346240 2024-09-14T10:51:34.518 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.520+0000 7f19187cc780 1 < completed delete operation key=RTGE7ISETJWW tag=Y9TU6O0ZP1ZL type=del 2024-09-14T10:51:34.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.522+0000 7f19187cc780 1 > prepared part key=_multipart_EZLSMEK89N2G.2~FS6N2FNN38WC.0 size=1004421 2024-09-14T10:51:34.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.522+0000 7f19187cc780 1 > prepared multipart upload key=EZLSMEK89N2G upload=FS6N2FNN38WC tag=FWGJG78GBISR type=write size=2052997 2024-09-14T10:51:34.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.524+0000 7f19187cc780 1 < completed part key=_multipart_75O00VMLJJ1X.2~RKBMB148S37C.0 size=1048576 2024-09-14T10:51:34.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.525+0000 7f19187cc780 1 < completed part key=_multipart_75O00VMLJJ1X.2~RKBMB148S37C.1 size=103336 2024-09-14T10:51:34.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.527+0000 7f19187cc780 1 < completed multipart upload key=75O00VMLJJ1X upload=RKBMB148S37C tag=8HGK8OYV5DRO type=write size=2200488 2024-09-14T10:51:34.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.529+0000 7f19187cc780 1 > prepared operation key=19P3WE6HKJH2 tag=4DZ7HEVQ8OP6 type=del size=2457641 2024-09-14T10:51:34.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.530+0000 7f19187cc780 1 < completed part key=_multipart_INJQTKXHBUV2.2~4WGTOF20YX3M.0 size=1048576 2024-09-14T10:51:34.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.532+0000 7f19187cc780 1 < completed part key=_multipart_INJQTKXHBUV2.2~4WGTOF20YX3M.1 size=34576 2024-09-14T10:51:34.532 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.534+0000 7f19187cc780 1 < completed multipart upload key=INJQTKXHBUV2 upload=4WGTOF20YX3M tag=NQ370SX21U0P type=write size=2131728 2024-09-14T10:51:34.534 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.536+0000 7f19187cc780 1 > prepared operation key=CADC2BY888V1 tag=FROQPNJAMMHF type=del size=768279 2024-09-14T10:51:34.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.537+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~CJ2TLSH62SUQ.0 size=172034 2024-09-14T10:51:34.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.540+0000 7f19187cc780 1 < completed multipart upload key=7IWUW2HC3ULI upload=CJ2TLSH62SUQ tag=K69N7KGX7VI9 type=write size=1220610 2024-09-14T10:51:34.541 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.542+0000 7f19187cc780 1 > prepared part key=_multipart_61O2VU0SB379.2~7378X65UH8LU.0 size=1048576 2024-09-14T10:51:34.542 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.543+0000 7f19187cc780 1 > prepared part key=_multipart_61O2VU0SB379.2~7378X65UH8LU.1 size=840930 2024-09-14T10:51:34.542 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.543+0000 7f19187cc780 1 > prepared multipart upload key=61O2VU0SB379 upload=7378X65UH8LU tag=ASCMRU74PUM3 type=write size=2938082 2024-09-14T10:51:34.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.546+0000 7f19187cc780 1 < suggested update operation key=KOJ7QB7M6A35 tag=XL9ILOVN5A5K type=write size=632479 2024-09-14T10:51:34.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.549+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~CBV9ODMG67KT.0 size=1048576 2024-09-14T10:51:34.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.550+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~CBV9ODMG67KT.1 size=1048576 2024-09-14T10:51:34.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.551+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~CBV9ODMG67KT.2 size=976748 2024-09-14T10:51:34.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.551+0000 7f19187cc780 1 > prepared multipart upload key=KP3WOGIF30PZ upload=CBV9ODMG67KT tag=8YFT8RZFNOI6 type=write size=4122476 2024-09-14T10:51:34.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.553+0000 7f19187cc780 1 < completed part key=_multipart_M73CER01XHDY.2~EXPIET15U0FL.0 size=978906 2024-09-14T10:51:34.553 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.555+0000 7f19187cc780 1 < completed multipart upload key=M73CER01XHDY upload=EXPIET15U0FL tag=B2QG21SNPV9Z type=write size=2027482 2024-09-14T10:51:34.555 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.556+0000 7f19187cc780 1 > prepared operation key=CADC2BY888V1 tag=UQA2134KSYH2 type=del size=408208 2024-09-14T10:51:34.556 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.558+0000 7f19187cc780 1 < completed part key=_multipart_H40763V7HMBC.2~CWL616S9H597.0 size=1048576 2024-09-14T10:51:34.557 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.559+0000 7f19187cc780 1 < completed part key=_multipart_H40763V7HMBC.2~CWL616S9H597.1 size=590466 2024-09-14T10:51:34.560 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.562+0000 7f19187cc780 1 < completed multipart upload key=H40763V7HMBC upload=CWL616S9H597 tag=6KVLULFMSOE4 type=write size=2687618 2024-09-14T10:51:34.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.564+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~CX9SZQTCN26Z.0 size=1048576 2024-09-14T10:51:34.564 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.566+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~CX9SZQTCN26Z.1 size=695038 2024-09-14T10:51:34.564 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.566+0000 7f19187cc780 1 > prepared multipart upload key=B9FQYIX19AEP upload=CX9SZQTCN26Z tag=Q5PY0WEBNQYS type=write size=2792190 2024-09-14T10:51:34.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.567+0000 7f19187cc780 1 < completed delete operation key=N0L67LS2KHR1 tag=LWF3Y2CT48QK type=del 2024-09-14T10:51:34.567 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.568+0000 7f19187cc780 1 > prepared operation key=61O2VU0SB379 tag=BLX5P95M1F11 type=write size=398277 2024-09-14T10:51:34.568 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.570+0000 7f19187cc780 1 < completed delete operation key=6BNN842ZTWG5 tag=CENNYMDU47PB type=del 2024-09-14T10:51:34.571 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.573+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~M4VUAFTB8YMG.0 size=614256 2024-09-14T10:51:34.571 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.573+0000 7f19187cc780 1 > prepared multipart upload key=IKVYA4KEALFF upload=M4VUAFTB8YMG tag=IDWCMHLD5M7M type=write size=1662832 2024-09-14T10:51:34.573 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.574+0000 7f19187cc780 1 < completed part key=_multipart_H40763V7HMBC.2~TH567G0OWG4N.0 size=975199 2024-09-14T10:51:34.575 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.577+0000 7f19187cc780 1 < completed multipart upload key=H40763V7HMBC upload=TH567G0OWG4N tag=QGKX8CLQLMW0 type=write size=2023775 2024-09-14T10:51:34.577 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.579+0000 7f19187cc780 1 > prepared part key=_multipart_E6UO1LUWOC44.2~H66NV9SU9YP8.0 size=405040 2024-09-14T10:51:34.578 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.579+0000 7f19187cc780 1 > prepared multipart upload key=E6UO1LUWOC44 upload=H66NV9SU9YP8 tag=1OSMI9SCPQZW type=write size=1453616 2024-09-14T10:51:34.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.581+0000 7f19187cc780 1 < completed delete operation key=OVOPGTYUF3F3 tag=MK6DY30YVW9D type=del 2024-09-14T10:51:34.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.582+0000 7f19187cc780 1 > prepared operation key=KOJ7QB7M6A35 tag=0XPOWHQUHFKX type=del size=2428881 2024-09-14T10:51:34.582 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.583+0000 7f19187cc780 1 < completed write operation key=AST81B9QWORT tag=1QKHIRR2W7IJ type=write size=126021 2024-09-14T10:51:34.583 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.585+0000 7f19187cc780 1 > prepared operation key=OVOPGTYUF3F3 tag=V9TDBPWLCNWL type=del size=1176906 2024-09-14T10:51:34.584 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.586+0000 7f19187cc780 1 < completed part key=_multipart_M73CER01XHDY.2~6ZUFNN7JK37B.0 size=702561 2024-09-14T10:51:34.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.589+0000 7f19187cc780 1 < completed multipart upload key=M73CER01XHDY upload=6ZUFNN7JK37B tag=9R8FI2L9FY2C type=write size=1751137 2024-09-14T10:51:34.590 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.591+0000 7f19187cc780 1 > prepared part key=_multipart_75O00VMLJJ1X.2~0JC6TN6LJ99I.0 size=73752 2024-09-14T10:51:34.590 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.591+0000 7f19187cc780 1 > prepared multipart upload key=75O00VMLJJ1X upload=0JC6TN6LJ99I tag=74G3C3UQON5L type=write size=1122328 2024-09-14T10:51:34.591 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.593+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~8Y52A1J2HVNQ.0 size=987004 2024-09-14T10:51:34.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.595+0000 7f19187cc780 1 < completed multipart upload key=6BNN842ZTWG5 upload=8Y52A1J2HVNQ tag=BJIOQ54B1DEP type=write size=2035580 2024-09-14T10:51:34.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.597+0000 7f19187cc780 1 > prepared operation key=6BNN842ZTWG5 tag=O1S1206DPU13 type=write size=280631 2024-09-14T10:51:34.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.598+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~DVYRYJ0MRNAN.0 size=1048576 2024-09-14T10:51:34.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.600+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~DVYRYJ0MRNAN.1 size=1048576 2024-09-14T10:51:34.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.601+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~DVYRYJ0MRNAN.2 size=544615 2024-09-14T10:51:34.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.603+0000 7f19187cc780 1 < completed multipart upload key=B9FQYIX19AEP upload=DVYRYJ0MRNAN tag=3VZXOVSL88BV type=write size=3690343 2024-09-14T10:51:34.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.606+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~EZ2OTM9TRQIA.0 size=1048576 2024-09-14T10:51:34.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.607+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~EZ2OTM9TRQIA.1 size=495817 2024-09-14T10:51:34.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.607+0000 7f19187cc780 1 > prepared multipart upload key=VW6U36JN2DBX upload=EZ2OTM9TRQIA tag=31THB8YNKYRL type=write size=2592969 2024-09-14T10:51:34.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.609+0000 7f19187cc780 1 < completed delete operation key=IKVYA4KEALFF tag=MCTV219CVAE6 type=del 2024-09-14T10:51:34.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.610+0000 7f19187cc780 1 > prepared operation key=QBMNYNWOLK4I tag=CLGIGQVWPV2T type=del size=1502670 2024-09-14T10:51:34.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.612+0000 7f19187cc780 1 < completed part key=_multipart_EZLSMEK89N2G.2~FS6N2FNN38WC.0 size=1004421 2024-09-14T10:51:34.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.614+0000 7f19187cc780 1 < completed multipart upload key=EZLSMEK89N2G upload=FS6N2FNN38WC tag=FWGJG78GBISR type=write size=2052997 2024-09-14T10:51:34.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.617+0000 7f19187cc780 1 > prepared part key=_multipart_5AIAYJMRZGFQ.2~1J4NYFFHB8V7.0 size=990909 2024-09-14T10:51:34.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.617+0000 7f19187cc780 1 > prepared multipart upload key=5AIAYJMRZGFQ upload=1J4NYFFHB8V7 tag=MPIYQJWVJLVL type=write size=2039485 2024-09-14T10:51:34.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.618+0000 7f19187cc780 1 < completed delete operation key=19P3WE6HKJH2 tag=4DZ7HEVQ8OP6 type=del 2024-09-14T10:51:34.619 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.621+0000 7f19187cc780 1 > prepared part key=_multipart_QBMNYNWOLK4I.2~CU2VC75Y0T18.0 size=855224 2024-09-14T10:51:34.619 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.621+0000 7f19187cc780 1 > prepared multipart upload key=QBMNYNWOLK4I upload=CU2VC75Y0T18 tag=3L78ZJ1U30CH type=write size=1903800 2024-09-14T10:51:34.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.622+0000 7f19187cc780 1 < completed delete operation key=CADC2BY888V1 tag=FROQPNJAMMHF type=del 2024-09-14T10:51:34.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.624+0000 7f19187cc780 1 > prepared operation key=KP3WOGIF30PZ tag=TR810Q2IXNWN type=write size=980758 2024-09-14T10:51:34.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.625+0000 7f19187cc780 1 < completed part key=_multipart_61O2VU0SB379.2~7378X65UH8LU.0 size=1048576 2024-09-14T10:51:34.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.626+0000 7f19187cc780 1 < completed part key=_multipart_61O2VU0SB379.2~7378X65UH8LU.1 size=840930 2024-09-14T10:51:34.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.629+0000 7f19187cc780 1 < completed multipart upload key=61O2VU0SB379 upload=7378X65UH8LU tag=ASCMRU74PUM3 type=write size=2938082 2024-09-14T10:51:34.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.630+0000 7f19187cc780 1 > prepared operation key=W1K1IU13J0CZ tag=L2VQQDBN6STW type=write size=435857 2024-09-14T10:51:34.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.631+0000 7f19187cc780 1 < completed part key=_multipart_KP3WOGIF30PZ.2~CBV9ODMG67KT.0 size=1048576 2024-09-14T10:51:34.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.632+0000 7f19187cc780 1 < canceled part key=_multipart_KP3WOGIF30PZ.2~CBV9ODMG67KT.1 size=1048576 2024-09-14T10:51:34.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.633+0000 7f19187cc780 1 < completed part key=_multipart_KP3WOGIF30PZ.2~CBV9ODMG67KT.2 size=976748 2024-09-14T10:51:34.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.635+0000 7f19187cc780 1 < canceled multipart upload key=KP3WOGIF30PZ upload=CBV9ODMG67KT tag=8YFT8RZFNOI6 type=write size=4122476 2024-09-14T10:51:34.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.636+0000 7f19187cc780 1 > prepared operation key=7IWUW2HC3ULI tag=KZ9CKYSA7QZM type=del size=1876377 2024-09-14T10:51:34.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.639+0000 7f19187cc780 1 < suggested update operation key=CADC2BY888V1 tag=UQA2134KSYH2 type=del size=408208 2024-09-14T10:51:34.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.643+0000 7f19187cc780 1 > prepared part key=_multipart_RTGE7ISETJWW.2~HLD2PIV3V40H.0 size=1048576 2024-09-14T10:51:34.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.644+0000 7f19187cc780 1 > prepared part key=_multipart_RTGE7ISETJWW.2~HLD2PIV3V40H.1 size=277188 2024-09-14T10:51:34.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.644+0000 7f19187cc780 1 > prepared multipart upload key=RTGE7ISETJWW upload=HLD2PIV3V40H tag=WJGU6XS8ZADZ type=write size=2374340 2024-09-14T10:51:34.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.645+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~CX9SZQTCN26Z.0 size=1048576 2024-09-14T10:51:34.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.648+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~CX9SZQTCN26Z.1 size=695038 2024-09-14T10:51:34.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.650+0000 7f19187cc780 1 < completed multipart upload key=B9FQYIX19AEP upload=CX9SZQTCN26Z tag=Q5PY0WEBNQYS type=write size=2792190 2024-09-14T10:51:34.651 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.653+0000 7f19187cc780 1 > prepared part key=_multipart_W1K1IU13J0CZ.2~X3II1787VIGB.0 size=1048576 2024-09-14T10:51:34.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.654+0000 7f19187cc780 1 > prepared part key=_multipart_W1K1IU13J0CZ.2~X3II1787VIGB.1 size=1048576 2024-09-14T10:51:34.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.655+0000 7f19187cc780 1 > prepared part key=_multipart_W1K1IU13J0CZ.2~X3II1787VIGB.2 size=193939 2024-09-14T10:51:34.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.655+0000 7f19187cc780 1 > prepared multipart upload key=W1K1IU13J0CZ upload=X3II1787VIGB tag=D09F57Q3JNZ0 type=write size=3339667 2024-09-14T10:51:34.656 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.658+0000 7f19187cc780 1 < suggested remove operation key=61O2VU0SB379 tag=BLX5P95M1F11 type=write 2024-09-14T10:51:34.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.660+0000 7f19187cc780 1 > prepared operation key=6BNN842ZTWG5 tag=9MTBF49XPCB9 type=del size=1850456 2024-09-14T10:51:34.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.661+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~M4VUAFTB8YMG.0 size=614256 2024-09-14T10:51:34.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.664+0000 7f19187cc780 1 < completed multipart upload key=IKVYA4KEALFF upload=M4VUAFTB8YMG tag=IDWCMHLD5M7M type=write size=1662832 2024-09-14T10:51:34.663 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.665+0000 7f19187cc780 1 > prepared operation key=W1K1IU13J0CZ tag=OT2KT12DP4XR type=write size=510210 2024-09-14T10:51:34.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.667+0000 7f19187cc780 1 < completed part key=_multipart_E6UO1LUWOC44.2~H66NV9SU9YP8.0 size=405040 2024-09-14T10:51:34.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.669+0000 7f19187cc780 1 < completed multipart upload key=E6UO1LUWOC44 upload=H66NV9SU9YP8 tag=1OSMI9SCPQZW type=write size=1453616 2024-09-14T10:51:34.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.670+0000 7f19187cc780 1 > prepared operation key=KOJ7QB7M6A35 tag=DZQ1KUYOIXDP type=write size=888098 2024-09-14T10:51:34.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.672+0000 7f19187cc780 1 < completed delete operation key=KOJ7QB7M6A35 tag=0XPOWHQUHFKX type=del 2024-09-14T10:51:34.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.675+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~JBZSG3IT3XH1.0 size=1048576 2024-09-14T10:51:34.675 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.676+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~JBZSG3IT3XH1.1 size=1048576 2024-09-14T10:51:34.676 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.677+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~JBZSG3IT3XH1.2 size=37444 2024-09-14T10:51:34.676 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.677+0000 7f19187cc780 1 > prepared multipart upload key=KP3WOGIF30PZ upload=JBZSG3IT3XH1 tag=LEMSLTS84E07 type=write size=3183172 2024-09-14T10:51:34.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.679+0000 7f19187cc780 1 < completed delete operation key=OVOPGTYUF3F3 tag=V9TDBPWLCNWL type=del 2024-09-14T10:51:34.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.680+0000 7f19187cc780 1 > prepared operation key=75O00VMLJJ1X tag=9QYIIZJV0UZ3 type=del size=1019309 2024-09-14T10:51:34.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.682+0000 7f19187cc780 1 < completed part key=_multipart_75O00VMLJJ1X.2~0JC6TN6LJ99I.0 size=73752 2024-09-14T10:51:34.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.684+0000 7f19187cc780 1 < completed multipart upload key=75O00VMLJJ1X upload=0JC6TN6LJ99I tag=74G3C3UQON5L type=write size=1122328 2024-09-14T10:51:34.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.686+0000 7f19187cc780 1 > prepared operation key=IKVYA4KEALFF tag=12IL0G0COAZ7 type=del size=1930838 2024-09-14T10:51:34.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.687+0000 7f19187cc780 1 < completed write operation key=6BNN842ZTWG5 tag=O1S1206DPU13 type=write size=280631 2024-09-14T10:51:34.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.689+0000 7f19187cc780 1 > prepared operation key=N0L67LS2KHR1 tag=NUQG7BT8NKPY type=del size=1506979 2024-09-14T10:51:34.689 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.690+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~EZ2OTM9TRQIA.0 size=1048576 2024-09-14T10:51:34.690 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.692+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~EZ2OTM9TRQIA.1 size=495817 2024-09-14T10:51:34.692 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.694+0000 7f19187cc780 1 < completed multipart upload key=VW6U36JN2DBX upload=EZ2OTM9TRQIA tag=31THB8YNKYRL type=write size=2592969 2024-09-14T10:51:34.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.697+0000 7f19187cc780 1 > prepared part key=_multipart_QFEI6H4EQ9ZR.2~AZ049MGBBAQR.0 size=403557 2024-09-14T10:51:34.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.697+0000 7f19187cc780 1 > prepared multipart upload key=QFEI6H4EQ9ZR upload=AZ049MGBBAQR tag=DC1QUF9K7J0B type=write size=1452133 2024-09-14T10:51:34.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.698+0000 7f19187cc780 1 < completed delete operation key=QBMNYNWOLK4I tag=CLGIGQVWPV2T type=del 2024-09-14T10:51:34.699 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.701+0000 7f19187cc780 1 > prepared part key=_multipart_CADC2BY888V1.2~RHRCH5KSJQAE.0 size=868477 2024-09-14T10:51:34.699 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.701+0000 7f19187cc780 1 > prepared multipart upload key=CADC2BY888V1 upload=RHRCH5KSJQAE tag=FJQK18M4IVIH type=write size=1917053 2024-09-14T10:51:34.700 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.702+0000 7f19187cc780 1 < completed part key=_multipart_5AIAYJMRZGFQ.2~1J4NYFFHB8V7.0 size=990909 2024-09-14T10:51:34.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.705+0000 7f19187cc780 1 < completed multipart upload key=5AIAYJMRZGFQ upload=1J4NYFFHB8V7 tag=MPIYQJWVJLVL type=write size=2039485 2024-09-14T10:51:34.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.707+0000 7f19187cc780 1 > prepared part key=_multipart_YA3DI7N4DG5K.2~FK18ZWCNFYLO.0 size=696959 2024-09-14T10:51:34.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.707+0000 7f19187cc780 1 > prepared multipart upload key=YA3DI7N4DG5K upload=FK18ZWCNFYLO tag=67NI9311J8BG type=write size=1745535 2024-09-14T10:51:34.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.709+0000 7f19187cc780 1 < completed part key=_multipart_QBMNYNWOLK4I.2~CU2VC75Y0T18.0 size=855224 2024-09-14T10:51:34.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.711+0000 7f19187cc780 1 < completed multipart upload key=QBMNYNWOLK4I upload=CU2VC75Y0T18 tag=3L78ZJ1U30CH type=write size=1903800 2024-09-14T10:51:34.712 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.714+0000 7f19187cc780 1 > prepared operation key=54BSD3DEHNK6 tag=YGHTYG5MG0OF type=del size=2208378 2024-09-14T10:51:34.714 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.715+0000 7f19187cc780 1 < completed write operation key=KP3WOGIF30PZ tag=TR810Q2IXNWN type=write size=980758 2024-09-14T10:51:34.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.718+0000 7f19187cc780 1 > prepared part key=_multipart_M73CER01XHDY.2~6J2X2S7T488R.0 size=1048576 2024-09-14T10:51:34.718 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.720+0000 7f19187cc780 1 > prepared part key=_multipart_M73CER01XHDY.2~6J2X2S7T488R.1 size=512659 2024-09-14T10:51:34.718 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.720+0000 7f19187cc780 1 > prepared multipart upload key=M73CER01XHDY upload=6J2X2S7T488R tag=OKII5ZO0GYK9 type=write size=2609811 2024-09-14T10:51:34.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.721+0000 7f19187cc780 1 < completed write operation key=W1K1IU13J0CZ tag=L2VQQDBN6STW type=write size=435857 2024-09-14T10:51:34.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.723+0000 7f19187cc780 1 > prepared operation key=H40763V7HMBC tag=YCEZKU0B6D4C type=del size=3294999 2024-09-14T10:51:34.723 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.724+0000 7f19187cc780 1 < completed delete operation key=7IWUW2HC3ULI tag=KZ9CKYSA7QZM type=del 2024-09-14T10:51:34.724 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.726+0000 7f19187cc780 1 > prepared operation key=KP3WOGIF30PZ tag=CJ9I7RHTFSJZ type=del size=3617399 2024-09-14T10:51:34.726 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.727+0000 7f19187cc780 1 < completed part key=_multipart_RTGE7ISETJWW.2~HLD2PIV3V40H.0 size=1048576 2024-09-14T10:51:34.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.728+0000 7f19187cc780 1 < completed part key=_multipart_RTGE7ISETJWW.2~HLD2PIV3V40H.1 size=277188 2024-09-14T10:51:34.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.731+0000 7f19187cc780 1 < completed multipart upload key=RTGE7ISETJWW upload=HLD2PIV3V40H tag=WJGU6XS8ZADZ type=write size=2374340 2024-09-14T10:51:34.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.733+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~2I7SILDAORPM.0 size=1048576 2024-09-14T10:51:34.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.734+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~2I7SILDAORPM.1 size=1048576 2024-09-14T10:51:34.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.736+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~2I7SILDAORPM.2 size=912815 2024-09-14T10:51:34.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.736+0000 7f19187cc780 1 > prepared multipart upload key=B9FQYIX19AEP upload=2I7SILDAORPM tag=AFTCZ5O4WC0K type=write size=4058543 2024-09-14T10:51:34.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.737+0000 7f19187cc780 1 < completed part key=_multipart_W1K1IU13J0CZ.2~X3II1787VIGB.0 size=1048576 2024-09-14T10:51:34.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.738+0000 7f19187cc780 1 < completed part key=_multipart_W1K1IU13J0CZ.2~X3II1787VIGB.1 size=1048576 2024-09-14T10:51:34.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.740+0000 7f19187cc780 1 < completed part key=_multipart_W1K1IU13J0CZ.2~X3II1787VIGB.2 size=193939 2024-09-14T10:51:34.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.742+0000 7f19187cc780 1 < completed multipart upload key=W1K1IU13J0CZ upload=X3II1787VIGB tag=D09F57Q3JNZ0 type=write size=3339667 2024-09-14T10:51:34.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.743+0000 7f19187cc780 1 > prepared operation key=RTGE7ISETJWW tag=U1KG5AOKCL82 type=del size=2703 2024-09-14T10:51:34.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.745+0000 7f19187cc780 1 < completed delete operation key=6BNN842ZTWG5 tag=9MTBF49XPCB9 type=del 2024-09-14T10:51:34.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.746+0000 7f19187cc780 1 > prepared operation key=QBMNYNWOLK4I tag=OJ87MC3ECMTU type=write size=493233 2024-09-14T10:51:34.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.748+0000 7f19187cc780 1 < completed write operation key=W1K1IU13J0CZ tag=OT2KT12DP4XR type=write size=510210 2024-09-14T10:51:34.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.751+0000 7f19187cc780 1 > prepared part key=_multipart_W1K1IU13J0CZ.2~6LGYXVBF7KGP.0 size=1048576 2024-09-14T10:51:34.750 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.752+0000 7f19187cc780 1 > prepared part key=_multipart_W1K1IU13J0CZ.2~6LGYXVBF7KGP.1 size=1048576 2024-09-14T10:51:34.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.753+0000 7f19187cc780 1 > prepared part key=_multipart_W1K1IU13J0CZ.2~6LGYXVBF7KGP.2 size=1000295 2024-09-14T10:51:34.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.753+0000 7f19187cc780 1 > prepared multipart upload key=W1K1IU13J0CZ upload=6LGYXVBF7KGP tag=JQU1LICG3FI5 type=write size=4146023 2024-09-14T10:51:34.753 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.755+0000 7f19187cc780 1 < canceled operation key=KOJ7QB7M6A35 tag=DZQ1KUYOIXDP type=write size=888098 2024-09-14T10:51:34.755 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.756+0000 7f19187cc780 1 > prepared operation key=B9FQYIX19AEP tag=LQYBX3Z61N9Z type=write size=246004 2024-09-14T10:51:34.756 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.758+0000 7f19187cc780 1 < completed part key=_multipart_KP3WOGIF30PZ.2~JBZSG3IT3XH1.0 size=1048576 2024-09-14T10:51:34.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.759+0000 7f19187cc780 1 < completed part key=_multipart_KP3WOGIF30PZ.2~JBZSG3IT3XH1.1 size=1048576 2024-09-14T10:51:34.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.760+0000 7f19187cc780 1 < completed part key=_multipart_KP3WOGIF30PZ.2~JBZSG3IT3XH1.2 size=37444 2024-09-14T10:51:34.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.763+0000 7f19187cc780 1 < completed multipart upload key=KP3WOGIF30PZ upload=JBZSG3IT3XH1 tag=LEMSLTS84E07 type=write size=3183172 2024-09-14T10:51:34.763 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.764+0000 7f19187cc780 1 > prepared operation key=INJQTKXHBUV2 tag=7FLE8FCHU5T4 type=write size=105203 2024-09-14T10:51:34.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.766+0000 7f19187cc780 1 < completed delete operation key=75O00VMLJJ1X tag=9QYIIZJV0UZ3 type=del 2024-09-14T10:51:34.766 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.768+0000 7f19187cc780 1 > prepared operation key=5AIAYJMRZGFQ tag=WBL0US0VGS2G type=del size=3052359 2024-09-14T10:51:34.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.771+0000 7f19187cc780 1 < suggested remove operation key=IKVYA4KEALFF tag=12IL0G0COAZ7 type=del 2024-09-14T10:51:34.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.772+0000 7f19187cc780 1 > prepared operation key=W1K1IU13J0CZ tag=QTAARM8SPYT5 type=del size=2305802 2024-09-14T10:51:34.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.774+0000 7f19187cc780 1 < completed delete operation key=N0L67LS2KHR1 tag=NUQG7BT8NKPY type=del 2024-09-14T10:51:34.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.775+0000 7f19187cc780 1 > prepared operation key=QBMNYNWOLK4I tag=KNXOW1PON2PP type=del size=2647405 2024-09-14T10:51:34.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.777+0000 7f19187cc780 1 < completed part key=_multipart_QFEI6H4EQ9ZR.2~AZ049MGBBAQR.0 size=403557 2024-09-14T10:51:34.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.779+0000 7f19187cc780 1 < completed multipart upload key=QFEI6H4EQ9ZR upload=AZ049MGBBAQR tag=DC1QUF9K7J0B type=write size=1452133 2024-09-14T10:51:34.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.781+0000 7f19187cc780 1 > prepared operation key=AST81B9QWORT tag=26ZM3JXCN51M type=del size=1171763 2024-09-14T10:51:34.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.784+0000 7f19187cc780 1 < completed part key=_multipart_CADC2BY888V1.2~RHRCH5KSJQAE.0 size=868477 2024-09-14T10:51:34.786 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.787+0000 7f19187cc780 1 < completed multipart upload key=CADC2BY888V1 upload=RHRCH5KSJQAE tag=FJQK18M4IVIH type=write size=1917053 2024-09-14T10:51:34.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.789+0000 7f19187cc780 1 > prepared operation key=XCVE2F2JJK4X tag=0KHL0JNCZIUY type=del size=3810439 2024-09-14T10:51:34.789 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.791+0000 7f19187cc780 1 < completed part key=_multipart_YA3DI7N4DG5K.2~FK18ZWCNFYLO.0 size=696959 2024-09-14T10:51:34.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.793+0000 7f19187cc780 1 < completed multipart upload key=YA3DI7N4DG5K upload=FK18ZWCNFYLO tag=67NI9311J8BG type=write size=1745535 2024-09-14T10:51:34.794 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.796+0000 7f19187cc780 1 > prepared part key=_multipart_CADC2BY888V1.2~ZX4OB3RAXVR9.0 size=1048576 2024-09-14T10:51:34.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.797+0000 7f19187cc780 1 > prepared part key=_multipart_CADC2BY888V1.2~ZX4OB3RAXVR9.1 size=414346 2024-09-14T10:51:34.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.797+0000 7f19187cc780 1 > prepared multipart upload key=CADC2BY888V1 upload=ZX4OB3RAXVR9 tag=0A8VS6Q5HAZ0 type=write size=2511498 2024-09-14T10:51:34.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.800+0000 7f19187cc780 1 < suggested update operation key=54BSD3DEHNK6 tag=YGHTYG5MG0OF type=del size=2208378 2024-09-14T10:51:34.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.801+0000 7f19187cc780 1 > prepared operation key=KP3WOGIF30PZ tag=TQ1N5MB0A42U type=write size=656004 2024-09-14T10:51:34.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.803+0000 7f19187cc780 1 < completed part key=_multipart_M73CER01XHDY.2~6J2X2S7T488R.0 size=1048576 2024-09-14T10:51:34.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.803+0000 7f19187cc780 1 < canceled part key=_multipart_M73CER01XHDY.2~6J2X2S7T488R.1 size=512659 2024-09-14T10:51:34.804 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.805+0000 7f19187cc780 1 < canceled multipart upload key=M73CER01XHDY upload=6J2X2S7T488R tag=OKII5ZO0GYK9 type=write size=2609811 2024-09-14T10:51:34.805 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.807+0000 7f19187cc780 1 > prepared operation key=E6UO1LUWOC44 tag=YPNARNPDBO8N type=del size=3282334 2024-09-14T10:51:34.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.808+0000 7f19187cc780 1 < completed delete operation key=H40763V7HMBC tag=YCEZKU0B6D4C type=del 2024-09-14T10:51:34.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.810+0000 7f19187cc780 1 > prepared operation key=W1K1IU13J0CZ tag=O4M33M0LGEUD type=del size=1379034 2024-09-14T10:51:34.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.813+0000 7f19187cc780 1 < suggested update operation key=KP3WOGIF30PZ tag=CJ9I7RHTFSJZ type=del size=3617399 2024-09-14T10:51:34.813 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.814+0000 7f19187cc780 1 > prepared operation key=54BSD3DEHNK6 tag=PY1NOH9D2SI6 type=del size=793177 2024-09-14T10:51:34.814 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.816+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~2I7SILDAORPM.0 size=1048576 2024-09-14T10:51:34.815 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.817+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~2I7SILDAORPM.1 size=1048576 2024-09-14T10:51:34.816 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.818+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~2I7SILDAORPM.2 size=912815 2024-09-14T10:51:34.818 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.820+0000 7f19187cc780 1 < completed multipart upload key=B9FQYIX19AEP upload=2I7SILDAORPM tag=AFTCZ5O4WC0K type=write size=4058543 2024-09-14T10:51:34.820 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.821+0000 7f19187cc780 1 > prepared operation key=OVOPGTYUF3F3 tag=SQE9ILOC15FS type=del size=3307780 2024-09-14T10:51:34.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.823+0000 7f19187cc780 1 < completed delete operation key=RTGE7ISETJWW tag=U1KG5AOKCL82 type=del 2024-09-14T10:51:34.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.826+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~0GSGF7VQ7I88.0 size=502271 2024-09-14T10:51:34.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.826+0000 7f19187cc780 1 > prepared multipart upload key=KOJ7QB7M6A35 upload=0GSGF7VQ7I88 tag=1AVXP32JR1VW type=write size=1550847 2024-09-14T10:51:34.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.828+0000 7f19187cc780 1 < suggested remove operation key=QBMNYNWOLK4I tag=OJ87MC3ECMTU type=write 2024-09-14T10:51:34.828 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.830+0000 7f19187cc780 1 > prepared operation key=VW6U36JN2DBX tag=V6KOAL7OO106 type=del size=3571145 2024-09-14T10:51:34.830 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.831+0000 7f19187cc780 1 < completed part key=_multipart_W1K1IU13J0CZ.2~6LGYXVBF7KGP.0 size=1048576 2024-09-14T10:51:34.831 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.833+0000 7f19187cc780 1 < completed part key=_multipart_W1K1IU13J0CZ.2~6LGYXVBF7KGP.1 size=1048576 2024-09-14T10:51:34.831 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.833+0000 7f19187cc780 1 < canceled part key=_multipart_W1K1IU13J0CZ.2~6LGYXVBF7KGP.2 size=1000295 2024-09-14T10:51:34.833 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.835+0000 7f19187cc780 1 < canceled multipart upload key=W1K1IU13J0CZ upload=6LGYXVBF7KGP tag=JQU1LICG3FI5 type=write size=4146023 2024-09-14T10:51:34.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.838+0000 7f19187cc780 1 > prepared part key=_multipart_EL00Y4Z7DTAT.2~AAI6G6JRZ1S0.0 size=825366 2024-09-14T10:51:34.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.838+0000 7f19187cc780 1 > prepared multipart upload key=EL00Y4Z7DTAT upload=AAI6G6JRZ1S0 tag=B5ZSG1EFCWM8 type=write size=1873942 2024-09-14T10:51:34.837 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.839+0000 7f19187cc780 1 < completed write operation key=B9FQYIX19AEP tag=LQYBX3Z61N9Z type=write size=246004 2024-09-14T10:51:34.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.841+0000 7f19187cc780 1 > prepared operation key=QFEI6H4EQ9ZR tag=QX8688ZW13W6 type=del size=3713205 2024-09-14T10:51:34.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.844+0000 7f19187cc780 1 < suggested update operation key=INJQTKXHBUV2 tag=7FLE8FCHU5T4 type=write size=105203 2024-09-14T10:51:34.844 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.846+0000 7f19187cc780 1 > prepared operation key=617QQI921HB4 tag=G9893D2HYYTY type=del size=622540 2024-09-14T10:51:34.845 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.847+0000 7f19187cc780 1 < completed delete operation key=5AIAYJMRZGFQ tag=WBL0US0VGS2G type=del 2024-09-14T10:51:34.848 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.850+0000 7f19187cc780 1 > prepared part key=_multipart_N0L67LS2KHR1.2~754IAA0FHX69.0 size=1048576 2024-09-14T10:51:34.849 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.851+0000 7f19187cc780 1 > prepared part key=_multipart_N0L67LS2KHR1.2~754IAA0FHX69.1 size=766840 2024-09-14T10:51:34.849 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.851+0000 7f19187cc780 1 > prepared multipart upload key=N0L67LS2KHR1 upload=754IAA0FHX69 tag=4SY023Z2DZNH type=write size=2863992 2024-09-14T10:51:34.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.853+0000 7f19187cc780 1 < completed delete operation key=W1K1IU13J0CZ tag=QTAARM8SPYT5 type=del 2024-09-14T10:51:34.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.854+0000 7f19187cc780 1 > prepared operation key=QBMNYNWOLK4I tag=H0NTI1WSLRJZ type=del size=34493 2024-09-14T10:51:34.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.856+0000 7f19187cc780 -1 < failed to complete operation key=QBMNYNWOLK4I tag=KNXOW1PON2PP type=del size=2647405: (22) Invalid argument 2024-09-14T10:51:34.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.857+0000 7f19187cc780 1 > prepared operation key=75O00VMLJJ1X tag=JK6FLA763PLV type=write size=910872 2024-09-14T10:51:34.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.859+0000 7f19187cc780 1 < completed delete operation key=AST81B9QWORT tag=26ZM3JXCN51M type=del 2024-09-14T10:51:34.859 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.861+0000 7f19187cc780 1 > prepared operation key=KOJ7QB7M6A35 tag=YCIG4TZG85Q9 type=del size=2642343 2024-09-14T10:51:34.861 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.862+0000 7f19187cc780 1 < completed delete operation key=XCVE2F2JJK4X tag=0KHL0JNCZIUY type=del 2024-09-14T10:51:34.864 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.865+0000 7f19187cc780 1 > prepared part key=_multipart_75O00VMLJJ1X.2~06WR10GP7RXS.0 size=394239 2024-09-14T10:51:34.864 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.865+0000 7f19187cc780 1 > prepared multipart upload key=75O00VMLJJ1X upload=06WR10GP7RXS tag=PGIJNBUBXMYN type=write size=1442815 2024-09-14T10:51:34.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.867+0000 7f19187cc780 1 < completed part key=_multipart_CADC2BY888V1.2~ZX4OB3RAXVR9.0 size=1048576 2024-09-14T10:51:34.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.868+0000 7f19187cc780 1 < completed part key=_multipart_CADC2BY888V1.2~ZX4OB3RAXVR9.1 size=414346 2024-09-14T10:51:34.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.871+0000 7f19187cc780 1 < completed multipart upload key=CADC2BY888V1 upload=ZX4OB3RAXVR9 tag=0A8VS6Q5HAZ0 type=write size=2511498 2024-09-14T10:51:34.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.872+0000 7f19187cc780 1 > prepared operation key=61O2VU0SB379 tag=TJ1FD2GBYJA1 type=del size=1724813 2024-09-14T10:51:34.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.874+0000 7f19187cc780 -1 < failed to complete operation key=KP3WOGIF30PZ tag=TQ1N5MB0A42U type=write size=656004: (22) Invalid argument 2024-09-14T10:51:34.873 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.875+0000 7f19187cc780 1 > prepared operation key=19P3WE6HKJH2 tag=6FMVW1LKK7KD type=del size=3004211 2024-09-14T10:51:34.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.877+0000 7f19187cc780 1 < completed delete operation key=E6UO1LUWOC44 tag=YPNARNPDBO8N type=del 2024-09-14T10:51:34.877 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.878+0000 7f19187cc780 1 > prepared operation key=6BNN842ZTWG5 tag=15CWIXARFANM type=del size=940127 2024-09-14T10:51:34.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.880+0000 7f19187cc780 1 < completed delete operation key=W1K1IU13J0CZ tag=O4M33M0LGEUD type=del 2024-09-14T10:51:34.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.881+0000 7f19187cc780 1 > prepared operation key=9EBD5ZT6MT45 tag=H2HUNDMU4XKI type=del size=101037 2024-09-14T10:51:34.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.883+0000 7f19187cc780 1 < canceled operation key=54BSD3DEHNK6 tag=PY1NOH9D2SI6 type=del size=793177 2024-09-14T10:51:34.883 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.884+0000 7f19187cc780 1 > prepared operation key=7IWUW2HC3ULI tag=8SL5UFPX5GC3 type=del size=1491709 2024-09-14T10:51:34.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.886+0000 7f19187cc780 1 < completed delete operation key=OVOPGTYUF3F3 tag=SQE9ILOC15FS type=del 2024-09-14T10:51:34.887 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.889+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~3VZLXV7AVJE2.0 size=1048576 2024-09-14T10:51:34.888 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.890+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~3VZLXV7AVJE2.1 size=1048576 2024-09-14T10:51:34.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.891+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~3VZLXV7AVJE2.2 size=772700 2024-09-14T10:51:34.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.891+0000 7f19187cc780 1 > prepared multipart upload key=B9FQYIX19AEP upload=3VZLXV7AVJE2 tag=MBVQYV5M19O2 type=write size=3918428 2024-09-14T10:51:34.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.893+0000 7f19187cc780 1 < completed part key=_multipart_KOJ7QB7M6A35.2~0GSGF7VQ7I88.0 size=502271 2024-09-14T10:51:34.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.895+0000 7f19187cc780 1 < completed multipart upload key=KOJ7QB7M6A35 upload=0GSGF7VQ7I88 tag=1AVXP32JR1VW type=write size=1550847 2024-09-14T10:51:34.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.898+0000 7f19187cc780 1 > prepared part key=_multipart_54BSD3DEHNK6.2~K3ZADI2HRQ53.0 size=1048576 2024-09-14T10:51:34.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.899+0000 7f19187cc780 1 > prepared part key=_multipart_54BSD3DEHNK6.2~K3ZADI2HRQ53.1 size=1048576 2024-09-14T10:51:34.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.900+0000 7f19187cc780 1 > prepared part key=_multipart_54BSD3DEHNK6.2~K3ZADI2HRQ53.2 size=32700 2024-09-14T10:51:34.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.900+0000 7f19187cc780 1 > prepared multipart upload key=54BSD3DEHNK6 upload=K3ZADI2HRQ53 tag=QOVTSF8KSKMS type=write size=3178428 2024-09-14T10:51:34.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.902+0000 7f19187cc780 1 < completed delete operation key=VW6U36JN2DBX tag=V6KOAL7OO106 type=del 2024-09-14T10:51:34.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.905+0000 7f19187cc780 1 > prepared part key=_multipart_AST81B9QWORT.2~5LP9DEZJOH3A.0 size=877097 2024-09-14T10:51:34.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.905+0000 7f19187cc780 1 > prepared multipart upload key=AST81B9QWORT upload=5LP9DEZJOH3A tag=Z44LA6TFPCUT type=write size=1925673 2024-09-14T10:51:34.905 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.907+0000 7f19187cc780 1 < completed part key=_multipart_EL00Y4Z7DTAT.2~AAI6G6JRZ1S0.0 size=825366 2024-09-14T10:51:34.908 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.910+0000 7f19187cc780 1 < completed multipart upload key=EL00Y4Z7DTAT upload=AAI6G6JRZ1S0 tag=B5ZSG1EFCWM8 type=write size=1873942 2024-09-14T10:51:34.911 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.913+0000 7f19187cc780 1 > prepared part key=_multipart_W1K1IU13J0CZ.2~7D07XBTJNI5V.0 size=1048576 2024-09-14T10:51:34.912 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.914+0000 7f19187cc780 1 > prepared part key=_multipart_W1K1IU13J0CZ.2~7D07XBTJNI5V.1 size=1048576 2024-09-14T10:51:34.913 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.915+0000 7f19187cc780 1 > prepared part key=_multipart_W1K1IU13J0CZ.2~7D07XBTJNI5V.2 size=167092 2024-09-14T10:51:34.914 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.915+0000 7f19187cc780 1 > prepared multipart upload key=W1K1IU13J0CZ upload=7D07XBTJNI5V tag=NMUS5SV7UEP9 type=write size=3312820 2024-09-14T10:51:34.915 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.917+0000 7f19187cc780 1 < completed delete operation key=QFEI6H4EQ9ZR tag=QX8688ZW13W6 type=del 2024-09-14T10:51:34.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.918+0000 7f19187cc780 1 > prepared operation key=AGNUE76X8XCJ tag=QXJKDADKHNMU type=del size=896974 2024-09-14T10:51:34.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.922+0000 7f19187cc780 1 < suggested remove operation key=617QQI921HB4 tag=G9893D2HYYTY type=del 2024-09-14T10:51:34.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.923+0000 7f19187cc780 1 > prepared operation key=617QQI921HB4 tag=XM5RZYTEPEK2 type=del size=1273078 2024-09-14T10:51:34.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.925+0000 7f19187cc780 1 < completed part key=_multipart_N0L67LS2KHR1.2~754IAA0FHX69.0 size=1048576 2024-09-14T10:51:34.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.926+0000 7f19187cc780 1 < completed part key=_multipart_N0L67LS2KHR1.2~754IAA0FHX69.1 size=766840 2024-09-14T10:51:34.928 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.930+0000 7f19187cc780 1 < completed multipart upload key=N0L67LS2KHR1 upload=754IAA0FHX69 tag=4SY023Z2DZNH type=write size=2863992 2024-09-14T10:51:34.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.933+0000 7f19187cc780 1 > prepared operation key=61O2VU0SB379 tag=SGBJG84CORYF type=write size=971283 2024-09-14T10:51:34.933 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.934+0000 7f19187cc780 1 < completed delete operation key=QBMNYNWOLK4I tag=H0NTI1WSLRJZ type=del 2024-09-14T10:51:34.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.936+0000 7f19187cc780 1 > prepared operation key=KOJ7QB7M6A35 tag=QPMZ1S4M6XIJ type=del size=3346333 2024-09-14T10:51:34.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.937+0000 7f19187cc780 1 < completed write operation key=75O00VMLJJ1X tag=JK6FLA763PLV type=write size=910872 2024-09-14T10:51:34.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.939+0000 7f19187cc780 1 > prepared operation key=QBMNYNWOLK4I tag=KQ8PNP3APNF9 type=del size=3414382 2024-09-14T10:51:34.939 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.941+0000 7f19187cc780 1 < canceled operation key=KOJ7QB7M6A35 tag=YCIG4TZG85Q9 type=del size=2642343 2024-09-14T10:51:34.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.943+0000 7f19187cc780 1 > prepared operation key=KOJ7QB7M6A35 tag=YN6LVYS5R454 type=write size=946906 2024-09-14T10:51:34.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.944+0000 7f19187cc780 1 < completed part key=_multipart_75O00VMLJJ1X.2~06WR10GP7RXS.0 size=394239 2024-09-14T10:51:34.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.947+0000 7f19187cc780 1 < completed multipart upload key=75O00VMLJJ1X upload=06WR10GP7RXS tag=PGIJNBUBXMYN type=write size=1442815 2024-09-14T10:51:34.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.949+0000 7f19187cc780 1 > prepared operation key=N0L67LS2KHR1 tag=FY6XJZ1EPPUN type=del size=3246726 2024-09-14T10:51:34.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.951+0000 7f19187cc780 1 < completed delete operation key=61O2VU0SB379 tag=TJ1FD2GBYJA1 type=del 2024-09-14T10:51:34.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.952+0000 7f19187cc780 1 > prepared operation key=5AIAYJMRZGFQ tag=2R2PWC1ZZRL2 type=del size=3170201 2024-09-14T10:51:34.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.954+0000 7f19187cc780 1 < completed delete operation key=19P3WE6HKJH2 tag=6FMVW1LKK7KD type=del 2024-09-14T10:51:34.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.956+0000 7f19187cc780 1 > prepared part key=_multipart_9EBD5ZT6MT45.2~SVWRLFR7KDF1.0 size=1048576 2024-09-14T10:51:34.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.958+0000 7f19187cc780 1 > prepared part key=_multipart_9EBD5ZT6MT45.2~SVWRLFR7KDF1.1 size=912590 2024-09-14T10:51:34.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.958+0000 7f19187cc780 1 > prepared multipart upload key=9EBD5ZT6MT45 upload=SVWRLFR7KDF1 tag=254SIG2BH2BT type=write size=3009742 2024-09-14T10:51:34.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.959+0000 7f19187cc780 1 < completed delete operation key=6BNN842ZTWG5 tag=15CWIXARFANM type=del 2024-09-14T10:51:34.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.961+0000 7f19187cc780 1 > prepared operation key=6BNN842ZTWG5 tag=3N1I0QYGVO6V type=del size=638441 2024-09-14T10:51:34.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.962+0000 7f19187cc780 1 < completed delete operation key=9EBD5ZT6MT45 tag=H2HUNDMU4XKI type=del 2024-09-14T10:51:34.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.964+0000 7f19187cc780 1 > prepared operation key=M73CER01XHDY tag=IO9Y3IOYUGCW type=del size=1791721 2024-09-14T10:51:34.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.967+0000 7f19187cc780 1 < completed delete operation key=7IWUW2HC3ULI tag=8SL5UFPX5GC3 type=del 2024-09-14T10:51:34.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.970+0000 7f19187cc780 1 > prepared part key=_multipart_AST81B9QWORT.2~KV5FGQBAKWIZ.0 size=1022835 2024-09-14T10:51:34.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.970+0000 7f19187cc780 1 > prepared multipart upload key=AST81B9QWORT upload=KV5FGQBAKWIZ tag=LCSQRNU8ABQ9 type=write size=2071411 2024-09-14T10:51:34.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.971+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~3VZLXV7AVJE2.0 size=1048576 2024-09-14T10:51:34.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.971+0000 7f19187cc780 1 < canceled part key=_multipart_B9FQYIX19AEP.2~3VZLXV7AVJE2.1 size=1048576 2024-09-14T10:51:34.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.971+0000 7f19187cc780 1 < canceled part key=_multipart_B9FQYIX19AEP.2~3VZLXV7AVJE2.2 size=772700 2024-09-14T10:51:34.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.974+0000 7f19187cc780 1 < canceled multipart upload key=B9FQYIX19AEP upload=3VZLXV7AVJE2 tag=MBVQYV5M19O2 type=write size=3918428 2024-09-14T10:51:34.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.975+0000 7f19187cc780 1 > prepared operation key=B9FQYIX19AEP tag=NNZEMIDKOWE3 type=del size=1657735 2024-09-14T10:51:34.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.976+0000 7f19187cc780 1 < completed part key=_multipart_54BSD3DEHNK6.2~K3ZADI2HRQ53.0 size=1048576 2024-09-14T10:51:34.976 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.977+0000 7f19187cc780 1 < completed part key=_multipart_54BSD3DEHNK6.2~K3ZADI2HRQ53.1 size=1048576 2024-09-14T10:51:34.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.979+0000 7f19187cc780 1 < completed part key=_multipart_54BSD3DEHNK6.2~K3ZADI2HRQ53.2 size=32700 2024-09-14T10:51:34.979 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.981+0000 7f19187cc780 1 < completed multipart upload key=54BSD3DEHNK6 upload=K3ZADI2HRQ53 tag=QOVTSF8KSKMS type=write size=3178428 2024-09-14T10:51:34.980 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.982+0000 7f19187cc780 1 > prepared operation key=KP3WOGIF30PZ tag=C72L4AECF0YK type=del size=79940 2024-09-14T10:51:34.982 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.984+0000 7f19187cc780 1 < completed part key=_multipart_AST81B9QWORT.2~5LP9DEZJOH3A.0 size=877097 2024-09-14T10:51:34.984 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.986+0000 7f19187cc780 1 < completed multipart upload key=AST81B9QWORT upload=5LP9DEZJOH3A tag=Z44LA6TFPCUT type=write size=1925673 2024-09-14T10:51:34.987 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.988+0000 7f19187cc780 1 > prepared part key=_multipart_61O2VU0SB379.2~3C1G71O96KC1.0 size=1048576 2024-09-14T10:51:34.988 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.989+0000 7f19187cc780 1 > prepared part key=_multipart_61O2VU0SB379.2~3C1G71O96KC1.1 size=141355 2024-09-14T10:51:34.988 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.989+0000 7f19187cc780 1 > prepared multipart upload key=61O2VU0SB379 upload=3C1G71O96KC1 tag=N0CONNZN5V89 type=write size=2238507 2024-09-14T10:51:34.989 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.991+0000 7f19187cc780 1 < completed part key=_multipart_W1K1IU13J0CZ.2~7D07XBTJNI5V.0 size=1048576 2024-09-14T10:51:34.989 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.991+0000 7f19187cc780 1 < canceled part key=_multipart_W1K1IU13J0CZ.2~7D07XBTJNI5V.1 size=1048576 2024-09-14T10:51:34.990 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.991+0000 7f19187cc780 1 < canceled part key=_multipart_W1K1IU13J0CZ.2~7D07XBTJNI5V.2 size=167092 2024-09-14T10:51:34.992 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.993+0000 7f19187cc780 1 < canceled multipart upload key=W1K1IU13J0CZ upload=7D07XBTJNI5V tag=NMUS5SV7UEP9 type=write size=3312820 2024-09-14T10:51:34.993 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.995+0000 7f19187cc780 1 > prepared operation key=6BNN842ZTWG5 tag=X0Z1DTP4LY02 type=del size=394644 2024-09-14T10:51:34.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:34.998+0000 7f19187cc780 1 < suggested remove operation key=AGNUE76X8XCJ tag=QXJKDADKHNMU type=del 2024-09-14T10:51:34.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.000+0000 7f19187cc780 1 > prepared part key=_multipart_YA3DI7N4DG5K.2~IWHZ1PK3AOFQ.0 size=1048576 2024-09-14T10:51:34.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.001+0000 7f19187cc780 1 > prepared part key=_multipart_YA3DI7N4DG5K.2~IWHZ1PK3AOFQ.1 size=1048576 2024-09-14T10:51:35.001 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.002+0000 7f19187cc780 1 > prepared part key=_multipart_YA3DI7N4DG5K.2~IWHZ1PK3AOFQ.2 size=694896 2024-09-14T10:51:35.001 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.002+0000 7f19187cc780 1 > prepared multipart upload key=YA3DI7N4DG5K upload=IWHZ1PK3AOFQ tag=OJCUW68P39TM type=write size=3840624 2024-09-14T10:51:35.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.004+0000 7f19187cc780 1 < completed delete operation key=617QQI921HB4 tag=XM5RZYTEPEK2 type=del 2024-09-14T10:51:35.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.005+0000 7f19187cc780 1 > prepared operation key=EL00Y4Z7DTAT tag=1TU7KYS5037P type=del size=1138414 2024-09-14T10:51:35.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.007+0000 7f19187cc780 1 < completed write operation key=61O2VU0SB379 tag=SGBJG84CORYF type=write size=971283 2024-09-14T10:51:35.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.009+0000 7f19187cc780 1 > prepared part key=_multipart_MFA30GSMCSKP.2~NVDDQHS819XJ.0 size=219945 2024-09-14T10:51:35.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.009+0000 7f19187cc780 1 > prepared multipart upload key=MFA30GSMCSKP upload=NVDDQHS819XJ tag=26XP9I1PTANO type=write size=1268521 2024-09-14T10:51:35.011 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.012+0000 7f19187cc780 1 < suggested update operation key=KOJ7QB7M6A35 tag=QPMZ1S4M6XIJ type=del size=3346333 2024-09-14T10:51:35.013 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.015+0000 7f19187cc780 1 > prepared part key=_multipart_M73CER01XHDY.2~73KE8A3AAH5Z.0 size=429821 2024-09-14T10:51:35.013 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.015+0000 7f19187cc780 1 > prepared multipart upload key=M73CER01XHDY upload=73KE8A3AAH5Z tag=HTZ0D735PWC8 type=write size=1478397 2024-09-14T10:51:35.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.016+0000 7f19187cc780 1 < completed delete operation key=QBMNYNWOLK4I tag=KQ8PNP3APNF9 type=del 2024-09-14T10:51:35.017 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.019+0000 7f19187cc780 1 > prepared part key=_multipart_75O00VMLJJ1X.2~ALNOEFQA0P5F.0 size=450754 2024-09-14T10:51:35.017 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.019+0000 7f19187cc780 1 > prepared multipart upload key=75O00VMLJJ1X upload=ALNOEFQA0P5F tag=JLC35LE5U023 type=write size=1499330 2024-09-14T10:51:35.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.022+0000 7f19187cc780 1 < suggested remove operation key=KOJ7QB7M6A35 tag=YN6LVYS5R454 type=write 2024-09-14T10:51:35.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.023+0000 7f19187cc780 1 > prepared operation key=75O00VMLJJ1X tag=DAULHRUT36GK type=del size=1977480 2024-09-14T10:51:35.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.025+0000 7f19187cc780 1 < completed delete operation key=N0L67LS2KHR1 tag=FY6XJZ1EPPUN type=del 2024-09-14T10:51:35.025 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.027+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~7LHHM1PL4RCZ.0 size=318404 2024-09-14T10:51:35.025 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.027+0000 7f19187cc780 1 > prepared multipart upload key=IKVYA4KEALFF upload=7LHHM1PL4RCZ tag=GGNBMMQNS8CH type=write size=1366980 2024-09-14T10:51:35.027 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.028+0000 7f19187cc780 1 < completed delete operation key=5AIAYJMRZGFQ tag=2R2PWC1ZZRL2 type=del 2024-09-14T10:51:35.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.030+0000 7f19187cc780 1 > prepared operation key=M73CER01XHDY tag=62WKHLGULT9D type=del size=981288 2024-09-14T10:51:35.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.032+0000 7f19187cc780 1 < completed part key=_multipart_9EBD5ZT6MT45.2~SVWRLFR7KDF1.0 size=1048576 2024-09-14T10:51:35.031 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.033+0000 7f19187cc780 1 < completed part key=_multipart_9EBD5ZT6MT45.2~SVWRLFR7KDF1.1 size=912590 2024-09-14T10:51:35.033 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.035+0000 7f19187cc780 1 < completed multipart upload key=9EBD5ZT6MT45 upload=SVWRLFR7KDF1 tag=254SIG2BH2BT type=write size=3009742 2024-09-14T10:51:35.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.036+0000 7f19187cc780 1 > prepared operation key=CADC2BY888V1 tag=JTBGMSX3UN1D type=del size=3216230 2024-09-14T10:51:35.036 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.038+0000 7f19187cc780 1 < completed delete operation key=6BNN842ZTWG5 tag=3N1I0QYGVO6V type=del 2024-09-14T10:51:35.037 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.039+0000 7f19187cc780 1 > prepared operation key=19P3WE6HKJH2 tag=2NBSHYP0F3TC type=del size=4024929 2024-09-14T10:51:35.039 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.040+0000 7f19187cc780 1 < completed delete operation key=M73CER01XHDY tag=IO9Y3IOYUGCW type=del 2024-09-14T10:51:35.041 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.043+0000 7f19187cc780 1 > prepared part key=_multipart_AST81B9QWORT.2~F0BK8G3FY8Y8.0 size=1048576 2024-09-14T10:51:35.042 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.044+0000 7f19187cc780 1 > prepared part key=_multipart_AST81B9QWORT.2~F0BK8G3FY8Y8.1 size=921298 2024-09-14T10:51:35.042 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.044+0000 7f19187cc780 1 > prepared multipart upload key=AST81B9QWORT upload=F0BK8G3FY8Y8 tag=B2VX0QPK5XR7 type=write size=3018450 2024-09-14T10:51:35.043 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.045+0000 7f19187cc780 1 < completed part key=_multipart_AST81B9QWORT.2~KV5FGQBAKWIZ.0 size=1022835 2024-09-14T10:51:35.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.047+0000 7f19187cc780 1 < completed multipart upload key=AST81B9QWORT upload=KV5FGQBAKWIZ tag=LCSQRNU8ABQ9 type=write size=2071411 2024-09-14T10:51:35.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.049+0000 7f19187cc780 1 > prepared operation key=QBMNYNWOLK4I tag=09E7JL0FOVHW type=del size=902558 2024-09-14T10:51:35.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.050+0000 7f19187cc780 1 < completed delete operation key=B9FQYIX19AEP tag=NNZEMIDKOWE3 type=del 2024-09-14T10:51:35.051 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.053+0000 7f19187cc780 1 > prepared part key=_multipart_E6UO1LUWOC44.2~BK4J6384U1WC.0 size=1048576 2024-09-14T10:51:35.052 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.054+0000 7f19187cc780 1 > prepared part key=_multipart_E6UO1LUWOC44.2~BK4J6384U1WC.1 size=723270 2024-09-14T10:51:35.052 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.054+0000 7f19187cc780 1 > prepared multipart upload key=E6UO1LUWOC44 upload=BK4J6384U1WC tag=VL6GWDTO8E2T type=write size=2820422 2024-09-14T10:51:35.053 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.055+0000 7f19187cc780 1 < completed delete operation key=KP3WOGIF30PZ tag=C72L4AECF0YK type=del 2024-09-14T10:51:35.055 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.056+0000 7f19187cc780 1 > prepared operation key=MFA30GSMCSKP tag=N9493PI4CBNV type=del size=2956423 2024-09-14T10:51:35.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.058+0000 7f19187cc780 1 < completed part key=_multipart_61O2VU0SB379.2~3C1G71O96KC1.0 size=1048576 2024-09-14T10:51:35.058 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.059+0000 7f19187cc780 1 < completed part key=_multipart_61O2VU0SB379.2~3C1G71O96KC1.1 size=141355 2024-09-14T10:51:35.060 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.062+0000 7f19187cc780 1 < completed multipart upload key=61O2VU0SB379 upload=3C1G71O96KC1 tag=N0CONNZN5V89 type=write size=2238507 2024-09-14T10:51:35.063 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.065+0000 7f19187cc780 1 > prepared part key=_multipart_RTGE7ISETJWW.2~BOW0S1UZYI32.0 size=1048576 2024-09-14T10:51:35.064 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.066+0000 7f19187cc780 1 > prepared part key=_multipart_RTGE7ISETJWW.2~BOW0S1UZYI32.1 size=492242 2024-09-14T10:51:35.064 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.066+0000 7f19187cc780 1 > prepared multipart upload key=RTGE7ISETJWW upload=BOW0S1UZYI32 tag=L9EK8NJY8L0B type=write size=2589394 2024-09-14T10:51:35.067 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.068+0000 7f19187cc780 1 < completed delete operation key=6BNN842ZTWG5 tag=X0Z1DTP4LY02 type=del 2024-09-14T10:51:35.070 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.071+0000 7f19187cc780 1 > prepared part key=_multipart_MFA30GSMCSKP.2~IEXMOGWTKEHD.0 size=1048576 2024-09-14T10:51:35.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.072+0000 7f19187cc780 1 > prepared part key=_multipart_MFA30GSMCSKP.2~IEXMOGWTKEHD.1 size=411551 2024-09-14T10:51:35.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.072+0000 7f19187cc780 1 > prepared multipart upload key=MFA30GSMCSKP upload=IEXMOGWTKEHD tag=RVQNZJDU2PEE type=write size=2508703 2024-09-14T10:51:35.072 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.074+0000 7f19187cc780 1 < completed part key=_multipart_YA3DI7N4DG5K.2~IWHZ1PK3AOFQ.0 size=1048576 2024-09-14T10:51:35.074 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.075+0000 7f19187cc780 1 < completed part key=_multipart_YA3DI7N4DG5K.2~IWHZ1PK3AOFQ.1 size=1048576 2024-09-14T10:51:35.075 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.076+0000 7f19187cc780 1 < completed part key=_multipart_YA3DI7N4DG5K.2~IWHZ1PK3AOFQ.2 size=694896 2024-09-14T10:51:35.077 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.079+0000 7f19187cc780 1 < completed multipart upload key=YA3DI7N4DG5K upload=IWHZ1PK3AOFQ tag=OJCUW68P39TM type=write size=3840624 2024-09-14T10:51:35.080 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.082+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~X2N3GK8KSRGR.0 size=1048576 2024-09-14T10:51:35.081 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.083+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~X2N3GK8KSRGR.1 size=122981 2024-09-14T10:51:35.082 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.083+0000 7f19187cc780 1 > prepared multipart upload key=B9FQYIX19AEP upload=X2N3GK8KSRGR tag=IRNXZF4E7173 type=write size=2220133 2024-09-14T10:51:35.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.085+0000 7f19187cc780 1 < completed delete operation key=EL00Y4Z7DTAT tag=1TU7KYS5037P type=del 2024-09-14T10:51:35.085 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.087+0000 7f19187cc780 1 > prepared operation key=H40763V7HMBC tag=PSEI5SI52ULL type=del size=4011174 2024-09-14T10:51:35.088 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.089+0000 7f19187cc780 1 < completed part key=_multipart_MFA30GSMCSKP.2~NVDDQHS819XJ.0 size=219945 2024-09-14T10:51:35.090 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.092+0000 7f19187cc780 1 < completed multipart upload key=MFA30GSMCSKP upload=NVDDQHS819XJ tag=26XP9I1PTANO type=write size=1268521 2024-09-14T10:51:35.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.094+0000 7f19187cc780 1 > prepared operation key=B9FQYIX19AEP tag=A21SSEJ19ESA type=del size=4112189 2024-09-14T10:51:35.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.096+0000 7f19187cc780 1 < completed part key=_multipart_M73CER01XHDY.2~73KE8A3AAH5Z.0 size=429821 2024-09-14T10:51:35.097 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.098+0000 7f19187cc780 1 < completed multipart upload key=M73CER01XHDY upload=73KE8A3AAH5Z tag=HTZ0D735PWC8 type=write size=1478397 2024-09-14T10:51:35.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.101+0000 7f19187cc780 1 > prepared part key=_multipart_M73CER01XHDY.2~5293GQEUL96I.0 size=189726 2024-09-14T10:51:35.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.101+0000 7f19187cc780 1 > prepared multipart upload key=M73CER01XHDY upload=5293GQEUL96I tag=T2PEGXE7IJEA type=write size=1238302 2024-09-14T10:51:35.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.103+0000 7f19187cc780 1 < completed part key=_multipart_75O00VMLJJ1X.2~ALNOEFQA0P5F.0 size=450754 2024-09-14T10:51:35.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.105+0000 7f19187cc780 1 < completed multipart upload key=75O00VMLJJ1X upload=ALNOEFQA0P5F tag=JLC35LE5U023 type=write size=1499330 2024-09-14T10:51:35.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.106+0000 7f19187cc780 1 > prepared operation key=9EBD5ZT6MT45 tag=8QOUZQCSKAN2 type=write size=1006288 2024-09-14T10:51:35.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.108+0000 7f19187cc780 1 < completed delete operation key=75O00VMLJJ1X tag=DAULHRUT36GK type=del 2024-09-14T10:51:35.107 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.109+0000 7f19187cc780 1 > prepared operation key=5AIAYJMRZGFQ tag=ZP6UX4PMC0S5 type=write size=665821 2024-09-14T10:51:35.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.111+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~7LHHM1PL4RCZ.0 size=318404 2024-09-14T10:51:35.112 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.113+0000 7f19187cc780 1 < completed multipart upload key=IKVYA4KEALFF upload=7LHHM1PL4RCZ tag=GGNBMMQNS8CH type=write size=1366980 2024-09-14T10:51:35.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.115+0000 7f19187cc780 1 > prepared operation key=5AIAYJMRZGFQ tag=L6ERHLWBL50V type=del size=1076764 2024-09-14T10:51:35.116 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.118+0000 7f19187cc780 1 < suggested remove operation key=M73CER01XHDY tag=62WKHLGULT9D type=del 2024-09-14T10:51:35.118 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.120+0000 7f19187cc780 1 > prepared operation key=W1K1IU13J0CZ tag=7NVM2M47HA2T type=write size=727263 2024-09-14T10:51:35.120 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.122+0000 7f19187cc780 1 < completed delete operation key=CADC2BY888V1 tag=JTBGMSX3UN1D type=del 2024-09-14T10:51:35.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.125+0000 7f19187cc780 1 > prepared part key=_multipart_M73CER01XHDY.2~9N93OP8L2V17.0 size=203884 2024-09-14T10:51:35.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.125+0000 7f19187cc780 1 > prepared multipart upload key=M73CER01XHDY upload=9N93OP8L2V17 tag=5JSSRO65X19G type=write size=1252460 2024-09-14T10:51:35.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.127+0000 7f19187cc780 1 < completed delete operation key=19P3WE6HKJH2 tag=2NBSHYP0F3TC type=del 2024-09-14T10:51:35.126 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.128+0000 7f19187cc780 1 > prepared operation key=617QQI921HB4 tag=7PV8TIUGMXNM type=del size=4158530 2024-09-14T10:51:35.128 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.130+0000 7f19187cc780 1 < completed part key=_multipart_AST81B9QWORT.2~F0BK8G3FY8Y8.0 size=1048576 2024-09-14T10:51:35.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.131+0000 7f19187cc780 1 < completed part key=_multipart_AST81B9QWORT.2~F0BK8G3FY8Y8.1 size=921298 2024-09-14T10:51:35.132 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.133+0000 7f19187cc780 1 < completed multipart upload key=AST81B9QWORT upload=F0BK8G3FY8Y8 tag=B2VX0QPK5XR7 type=write size=3018450 2024-09-14T10:51:35.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.135+0000 7f19187cc780 1 > prepared operation key=B9FQYIX19AEP tag=8PQQXYUWWQVS type=write size=476508 2024-09-14T10:51:35.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.136+0000 7f19187cc780 1 < completed delete operation key=QBMNYNWOLK4I tag=09E7JL0FOVHW type=del 2024-09-14T10:51:35.137 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.138+0000 7f19187cc780 1 > prepared operation key=EL00Y4Z7DTAT tag=16K9P9QKRA3A type=del size=893055 2024-09-14T10:51:35.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.139+0000 7f19187cc780 1 < completed part key=_multipart_E6UO1LUWOC44.2~BK4J6384U1WC.0 size=1048576 2024-09-14T10:51:35.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.141+0000 7f19187cc780 1 < completed part key=_multipart_E6UO1LUWOC44.2~BK4J6384U1WC.1 size=723270 2024-09-14T10:51:35.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.143+0000 7f19187cc780 1 < completed multipart upload key=E6UO1LUWOC44 upload=BK4J6384U1WC tag=VL6GWDTO8E2T type=write size=2820422 2024-09-14T10:51:35.143 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.145+0000 7f19187cc780 1 > prepared operation key=W1K1IU13J0CZ tag=SMD9SRT428XW type=del size=1038838 2024-09-14T10:51:35.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.146+0000 7f19187cc780 1 < completed delete operation key=MFA30GSMCSKP tag=N9493PI4CBNV type=del 2024-09-14T10:51:35.147 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.149+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~2ABUH1OCLGH7.0 size=1048576 2024-09-14T10:51:35.148 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.150+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~2ABUH1OCLGH7.1 size=1048576 2024-09-14T10:51:35.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.151+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~2ABUH1OCLGH7.2 size=225734 2024-09-14T10:51:35.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.151+0000 7f19187cc780 1 > prepared multipart upload key=6BNN842ZTWG5 upload=2ABUH1OCLGH7 tag=OZBKCN3VQRRS type=write size=3371462 2024-09-14T10:51:35.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.152+0000 7f19187cc780 1 < completed part key=_multipart_RTGE7ISETJWW.2~BOW0S1UZYI32.0 size=1048576 2024-09-14T10:51:35.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.152+0000 7f19187cc780 1 < canceled part key=_multipart_RTGE7ISETJWW.2~BOW0S1UZYI32.1 size=492242 2024-09-14T10:51:35.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.155+0000 7f19187cc780 1 < canceled multipart upload key=RTGE7ISETJWW upload=BOW0S1UZYI32 tag=L9EK8NJY8L0B type=write size=2589394 2024-09-14T10:51:35.155 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.156+0000 7f19187cc780 1 > prepared operation key=VW6U36JN2DBX tag=SEVYGV07569H type=del size=194285 2024-09-14T10:51:35.156 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.158+0000 7f19187cc780 1 < completed part key=_multipart_MFA30GSMCSKP.2~IEXMOGWTKEHD.0 size=1048576 2024-09-14T10:51:35.157 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.159+0000 7f19187cc780 1 < completed part key=_multipart_MFA30GSMCSKP.2~IEXMOGWTKEHD.1 size=411551 2024-09-14T10:51:35.160 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.161+0000 7f19187cc780 1 < completed multipart upload key=MFA30GSMCSKP upload=IEXMOGWTKEHD tag=RVQNZJDU2PEE type=write size=2508703 2024-09-14T10:51:35.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.163+0000 7f19187cc780 1 > prepared operation key=H40763V7HMBC tag=HKGU55G5X1VF type=del size=326663 2024-09-14T10:51:35.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.164+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~X2N3GK8KSRGR.0 size=1048576 2024-09-14T10:51:35.164 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.166+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~X2N3GK8KSRGR.1 size=122981 2024-09-14T10:51:35.167 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.168+0000 7f19187cc780 1 < completed multipart upload key=B9FQYIX19AEP upload=X2N3GK8KSRGR tag=IRNXZF4E7173 type=write size=2220133 2024-09-14T10:51:35.168 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.170+0000 7f19187cc780 1 > prepared operation key=W1K1IU13J0CZ tag=I2LNBT61ZX1M type=write size=425837 2024-09-14T10:51:35.170 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.171+0000 7f19187cc780 1 < canceled operation key=H40763V7HMBC tag=PSEI5SI52ULL type=del size=4011174 2024-09-14T10:51:35.172 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.174+0000 7f19187cc780 1 > prepared part key=_multipart_MFA30GSMCSKP.2~402PXX74PQD3.0 size=1048576 2024-09-14T10:51:35.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.175+0000 7f19187cc780 1 > prepared part key=_multipart_MFA30GSMCSKP.2~402PXX74PQD3.1 size=1048576 2024-09-14T10:51:35.175 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.176+0000 7f19187cc780 1 > prepared part key=_multipart_MFA30GSMCSKP.2~402PXX74PQD3.2 size=995426 2024-09-14T10:51:35.175 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.176+0000 7f19187cc780 1 > prepared multipart upload key=MFA30GSMCSKP upload=402PXX74PQD3 tag=HGX3J7AN395J type=write size=4141154 2024-09-14T10:51:35.176 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.178+0000 7f19187cc780 1 < completed delete operation key=B9FQYIX19AEP tag=A21SSEJ19ESA type=del 2024-09-14T10:51:35.178 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.179+0000 7f19187cc780 1 > prepared operation key=INJQTKXHBUV2 tag=577YSHJH7UEA type=del size=456992 2024-09-14T10:51:35.179 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.181+0000 7f19187cc780 1 < completed part key=_multipart_M73CER01XHDY.2~5293GQEUL96I.0 size=189726 2024-09-14T10:51:35.181 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.183+0000 7f19187cc780 1 < completed multipart upload key=M73CER01XHDY upload=5293GQEUL96I tag=T2PEGXE7IJEA type=write size=1238302 2024-09-14T10:51:35.183 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.185+0000 7f19187cc780 1 > prepared operation key=CADC2BY888V1 tag=E5T0RRE2DEYN type=write size=1024929 2024-09-14T10:51:35.185 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.186+0000 7f19187cc780 1 < completed write operation key=9EBD5ZT6MT45 tag=8QOUZQCSKAN2 type=write size=1006288 2024-09-14T10:51:35.187 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.189+0000 7f19187cc780 1 > prepared part key=_multipart_QBMNYNWOLK4I.2~K5NGD8CXP4BL.0 size=1048576 2024-09-14T10:51:35.189 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.190+0000 7f19187cc780 1 > prepared part key=_multipart_QBMNYNWOLK4I.2~K5NGD8CXP4BL.1 size=769303 2024-09-14T10:51:35.189 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.190+0000 7f19187cc780 1 > prepared multipart upload key=QBMNYNWOLK4I upload=K5NGD8CXP4BL tag=GY7QCSXZI7TS type=write size=2866455 2024-09-14T10:51:35.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.192+0000 7f19187cc780 1 < completed write operation key=5AIAYJMRZGFQ tag=ZP6UX4PMC0S5 type=write size=665821 2024-09-14T10:51:35.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.193+0000 7f19187cc780 1 > prepared operation key=EZLSMEK89N2G tag=3LMCBOINLE22 type=del size=1789958 2024-09-14T10:51:35.193 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.195+0000 7f19187cc780 1 < completed delete operation key=5AIAYJMRZGFQ tag=L6ERHLWBL50V type=del 2024-09-14T10:51:35.195 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.197+0000 7f19187cc780 1 > prepared part key=_multipart_617QQI921HB4.2~BDG1JO4IQV0I.0 size=542064 2024-09-14T10:51:35.195 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.197+0000 7f19187cc780 1 > prepared multipart upload key=617QQI921HB4 upload=BDG1JO4IQV0I tag=TLDNNXWRUR5F type=write size=1590640 2024-09-14T10:51:35.197 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.198+0000 7f19187cc780 1 < completed write operation key=W1K1IU13J0CZ tag=7NVM2M47HA2T type=write size=727263 2024-09-14T10:51:35.199 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.201+0000 7f19187cc780 1 > prepared part key=_multipart_CADC2BY888V1.2~CUM2AMM49MUY.0 size=1048576 2024-09-14T10:51:35.201 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.202+0000 7f19187cc780 1 > prepared part key=_multipart_CADC2BY888V1.2~CUM2AMM49MUY.1 size=1048576 2024-09-14T10:51:35.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.204+0000 7f19187cc780 1 > prepared part key=_multipart_CADC2BY888V1.2~CUM2AMM49MUY.2 size=492202 2024-09-14T10:51:35.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.204+0000 7f19187cc780 1 > prepared multipart upload key=CADC2BY888V1 upload=CUM2AMM49MUY tag=V9VS9SMXCICC type=write size=3637930 2024-09-14T10:51:35.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.204+0000 7f19187cc780 1 < canceled part key=_multipart_M73CER01XHDY.2~9N93OP8L2V17.0 size=203884 2024-09-14T10:51:35.205 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.206+0000 7f19187cc780 1 < canceled multipart upload key=M73CER01XHDY upload=9N93OP8L2V17 tag=5JSSRO65X19G type=write size=1252460 2024-09-14T10:51:35.206 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.208+0000 7f19187cc780 1 > prepared operation key=E6UO1LUWOC44 tag=EBN2SVS45ZST type=write size=295842 2024-09-14T10:51:35.210 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.212+0000 7f19187cc780 1 < suggested update operation key=617QQI921HB4 tag=7PV8TIUGMXNM type=del size=4158530 2024-09-14T10:51:35.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.215+0000 7f19187cc780 1 > prepared operation key=AST81B9QWORT tag=GU80UWSZI80G type=del size=1710191 2024-09-14T10:51:35.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.216+0000 7f19187cc780 1 < completed write operation key=B9FQYIX19AEP tag=8PQQXYUWWQVS type=write size=476508 2024-09-14T10:51:35.217 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.219+0000 7f19187cc780 1 > prepared part key=_multipart_75O00VMLJJ1X.2~2270G60YMSEJ.0 size=1048576 2024-09-14T10:51:35.218 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.220+0000 7f19187cc780 1 > prepared part key=_multipart_75O00VMLJJ1X.2~2270G60YMSEJ.1 size=1048576 2024-09-14T10:51:35.219 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.221+0000 7f19187cc780 1 > prepared part key=_multipart_75O00VMLJJ1X.2~2270G60YMSEJ.2 size=607045 2024-09-14T10:51:35.219 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.221+0000 7f19187cc780 1 > prepared multipart upload key=75O00VMLJJ1X upload=2270G60YMSEJ tag=ZAX75V6ICSOF type=write size=3752773 2024-09-14T10:51:35.221 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.222+0000 7f19187cc780 1 < completed delete operation key=EL00Y4Z7DTAT tag=16K9P9QKRA3A type=del 2024-09-14T10:51:35.222 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.224+0000 7f19187cc780 1 > prepared operation key=AGNUE76X8XCJ tag=DLX08E17Z1L8 type=del size=3158311 2024-09-14T10:51:35.224 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.226+0000 7f19187cc780 1 < completed delete operation key=W1K1IU13J0CZ tag=SMD9SRT428XW type=del 2024-09-14T10:51:35.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.228+0000 7f19187cc780 1 > prepared part key=_multipart_61O2VU0SB379.2~H3IAKFHKT0XW.0 size=1048576 2024-09-14T10:51:35.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.229+0000 7f19187cc780 1 > prepared part key=_multipart_61O2VU0SB379.2~H3IAKFHKT0XW.1 size=1048576 2024-09-14T10:51:35.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.230+0000 7f19187cc780 1 > prepared part key=_multipart_61O2VU0SB379.2~H3IAKFHKT0XW.2 size=600793 2024-09-14T10:51:35.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.230+0000 7f19187cc780 1 > prepared multipart upload key=61O2VU0SB379 upload=H3IAKFHKT0XW tag=A8XLDV0CJ07P type=write size=3746521 2024-09-14T10:51:35.230 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.232+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~2ABUH1OCLGH7.0 size=1048576 2024-09-14T10:51:35.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.233+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~2ABUH1OCLGH7.1 size=1048576 2024-09-14T10:51:35.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.234+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~2ABUH1OCLGH7.2 size=225734 2024-09-14T10:51:35.234 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.236+0000 7f19187cc780 1 < completed multipart upload key=6BNN842ZTWG5 upload=2ABUH1OCLGH7 tag=OZBKCN3VQRRS type=write size=3371462 2024-09-14T10:51:35.236 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.237+0000 7f19187cc780 1 > prepared operation key=OVOPGTYUF3F3 tag=S6KA9ZMJ26OK type=write size=664998 2024-09-14T10:51:35.237 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.239+0000 7f19187cc780 1 < completed delete operation key=VW6U36JN2DBX tag=SEVYGV07569H type=del 2024-09-14T10:51:35.238 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.240+0000 7f19187cc780 1 > prepared operation key=61O2VU0SB379 tag=O227OQ9F52ZK type=del size=3362771 2024-09-14T10:51:35.240 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.241+0000 7f19187cc780 1 < completed delete operation key=H40763V7HMBC tag=HKGU55G5X1VF type=del 2024-09-14T10:51:35.242 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.244+0000 7f19187cc780 1 > prepared part key=_multipart_H40763V7HMBC.2~56ST33GB74H8.0 size=1048576 2024-09-14T10:51:35.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.245+0000 7f19187cc780 1 > prepared part key=_multipart_H40763V7HMBC.2~56ST33GB74H8.1 size=1048576 2024-09-14T10:51:35.245 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.247+0000 7f19187cc780 1 > prepared part key=_multipart_H40763V7HMBC.2~56ST33GB74H8.2 size=725149 2024-09-14T10:51:35.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.247+0000 7f19187cc780 1 > prepared multipart upload key=H40763V7HMBC upload=56ST33GB74H8 tag=IG49FR9ALVOF type=write size=3870877 2024-09-14T10:51:35.247 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.248+0000 7f19187cc780 1 < completed write operation key=W1K1IU13J0CZ tag=I2LNBT61ZX1M type=write size=425837 2024-09-14T10:51:35.248 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.250+0000 7f19187cc780 1 > prepared operation key=VW6U36JN2DBX tag=X9E8OVYFHYO2 type=write size=571627 2024-09-14T10:51:35.248 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.250+0000 7f19187cc780 1 < canceled part key=_multipart_MFA30GSMCSKP.2~402PXX74PQD3.0 size=1048576 2024-09-14T10:51:35.249 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.250+0000 7f19187cc780 1 < canceled part key=_multipart_MFA30GSMCSKP.2~402PXX74PQD3.1 size=1048576 2024-09-14T10:51:35.250 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.251+0000 7f19187cc780 1 < completed part key=_multipart_MFA30GSMCSKP.2~402PXX74PQD3.2 size=995426 2024-09-14T10:51:35.254 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.256+0000 7f19187cc780 1 < canceled multipart upload key=MFA30GSMCSKP upload=402PXX74PQD3 tag=HGX3J7AN395J type=write size=4141154 2024-09-14T10:51:35.257 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.258+0000 7f19187cc780 1 > prepared operation key=VW6U36JN2DBX tag=B6XO10G0KV4Y type=del size=1295613 2024-09-14T10:51:35.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.261+0000 7f19187cc780 1 < completed delete operation key=INJQTKXHBUV2 tag=577YSHJH7UEA type=del 2024-09-14T10:51:35.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.262+0000 7f19187cc780 1 > prepared operation key=B9FQYIX19AEP tag=6DQ8W6LTV2K6 type=del size=1154863 2024-09-14T10:51:35.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.263+0000 7f19187cc780 1 < completed write operation key=CADC2BY888V1 tag=E5T0RRE2DEYN type=write size=1024929 2024-09-14T10:51:35.264 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.266+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~YT669ZYTXAIH.0 size=1048576 2024-09-14T10:51:35.266 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.267+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~YT669ZYTXAIH.1 size=591303 2024-09-14T10:51:35.266 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.267+0000 7f19187cc780 1 > prepared multipart upload key=VW6U36JN2DBX upload=YT669ZYTXAIH tag=C0TI6AM7G2OC type=write size=2688455 2024-09-14T10:51:35.267 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.269+0000 7f19187cc780 1 < completed part key=_multipart_QBMNYNWOLK4I.2~K5NGD8CXP4BL.0 size=1048576 2024-09-14T10:51:35.268 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.270+0000 7f19187cc780 1 < completed part key=_multipart_QBMNYNWOLK4I.2~K5NGD8CXP4BL.1 size=769303 2024-09-14T10:51:35.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.272+0000 7f19187cc780 1 < completed multipart upload key=QBMNYNWOLK4I upload=K5NGD8CXP4BL tag=GY7QCSXZI7TS type=write size=2866455 2024-09-14T10:51:35.272 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.274+0000 7f19187cc780 1 > prepared operation key=OVOPGTYUF3F3 tag=NPKYQJTABGUW type=del size=1181385 2024-09-14T10:51:35.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.275+0000 7f19187cc780 1 < completed delete operation key=EZLSMEK89N2G tag=3LMCBOINLE22 type=del 2024-09-14T10:51:35.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.277+0000 7f19187cc780 1 > prepared operation key=6BNN842ZTWG5 tag=9UEJUGJ9AIP9 type=del size=870258 2024-09-14T10:51:35.277 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.278+0000 7f19187cc780 1 < completed part key=_multipart_617QQI921HB4.2~BDG1JO4IQV0I.0 size=542064 2024-09-14T10:51:35.279 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.281+0000 7f19187cc780 1 < completed multipart upload key=617QQI921HB4 upload=BDG1JO4IQV0I tag=TLDNNXWRUR5F type=write size=1590640 2024-09-14T10:51:35.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.284+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~Y7WHKJYKNGFH.0 size=1048576 2024-09-14T10:51:35.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.285+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~Y7WHKJYKNGFH.1 size=1048576 2024-09-14T10:51:35.284 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.286+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~Y7WHKJYKNGFH.2 size=151619 2024-09-14T10:51:35.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.286+0000 7f19187cc780 1 > prepared multipart upload key=IKVYA4KEALFF upload=Y7WHKJYKNGFH tag=2LQH07N7K7IC type=write size=3297347 2024-09-14T10:51:35.286 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.288+0000 7f19187cc780 1 < completed part key=_multipart_CADC2BY888V1.2~CUM2AMM49MUY.0 size=1048576 2024-09-14T10:51:35.286 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.288+0000 7f19187cc780 1 < canceled part key=_multipart_CADC2BY888V1.2~CUM2AMM49MUY.1 size=1048576 2024-09-14T10:51:35.286 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.288+0000 7f19187cc780 1 < canceled part key=_multipart_CADC2BY888V1.2~CUM2AMM49MUY.2 size=492202 2024-09-14T10:51:35.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.290+0000 7f19187cc780 1 < canceled multipart upload key=CADC2BY888V1 upload=CUM2AMM49MUY tag=V9VS9SMXCICC type=write size=3637930 2024-09-14T10:51:35.290 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.292+0000 7f19187cc780 1 > prepared operation key=XCVE2F2JJK4X tag=DMAV647WSJIK type=write size=595602 2024-09-14T10:51:35.292 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.293+0000 7f19187cc780 1 < completed write operation key=E6UO1LUWOC44 tag=EBN2SVS45ZST type=write size=295842 2024-09-14T10:51:35.294 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.296+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~OQ9P5YG5B31N.0 size=549800 2024-09-14T10:51:35.294 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.296+0000 7f19187cc780 1 > prepared multipart upload key=VW6U36JN2DBX upload=OQ9P5YG5B31N tag=XM4Z0C7F5BRD type=write size=1598376 2024-09-14T10:51:35.296 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.297+0000 7f19187cc780 1 < completed delete operation key=AST81B9QWORT tag=GU80UWSZI80G type=del 2024-09-14T10:51:35.300 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.300+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~4RAFYL58BV96.0 size=607942 2024-09-14T10:51:35.300 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.300+0000 7f19187cc780 1 > prepared multipart upload key=OVOPGTYUF3F3 upload=4RAFYL58BV96 tag=T2BX0MH9550E type=write size=1656518 2024-09-14T10:51:35.301 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.302+0000 7f19187cc780 1 < completed part key=_multipart_75O00VMLJJ1X.2~2270G60YMSEJ.0 size=1048576 2024-09-14T10:51:35.301 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.302+0000 7f19187cc780 1 < canceled part key=_multipart_75O00VMLJJ1X.2~2270G60YMSEJ.1 size=1048576 2024-09-14T10:51:35.302 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.303+0000 7f19187cc780 1 < completed part key=_multipart_75O00VMLJJ1X.2~2270G60YMSEJ.2 size=607045 2024-09-14T10:51:35.304 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.306+0000 7f19187cc780 1 < canceled multipart upload key=75O00VMLJJ1X upload=2270G60YMSEJ tag=ZAX75V6ICSOF type=write size=3752773 2024-09-14T10:51:35.307 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.309+0000 7f19187cc780 1 > prepared part key=_multipart_9EBD5ZT6MT45.2~PHFVX55W3TI1.0 size=1048576 2024-09-14T10:51:35.309 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.310+0000 7f19187cc780 1 > prepared part key=_multipart_9EBD5ZT6MT45.2~PHFVX55W3TI1.1 size=1048576 2024-09-14T10:51:35.311 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.313+0000 7f19187cc780 1 > prepared part key=_multipart_9EBD5ZT6MT45.2~PHFVX55W3TI1.2 size=615877 2024-09-14T10:51:35.311 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.313+0000 7f19187cc780 1 > prepared multipart upload key=9EBD5ZT6MT45 upload=PHFVX55W3TI1 tag=8E0LP0CC8R1J type=write size=3761605 2024-09-14T10:51:35.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.314+0000 7f19187cc780 1 < completed delete operation key=AGNUE76X8XCJ tag=DLX08E17Z1L8 type=del 2024-09-14T10:51:35.315 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.317+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~Z1G5AX5ZZ5PS.0 size=1048576 2024-09-14T10:51:35.316 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.318+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~Z1G5AX5ZZ5PS.1 size=786297 2024-09-14T10:51:35.316 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.318+0000 7f19187cc780 1 > prepared multipart upload key=B9FQYIX19AEP upload=Z1G5AX5ZZ5PS tag=J2HQERHYZ5B4 type=write size=2883449 2024-09-14T10:51:35.317 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.319+0000 7f19187cc780 1 < completed part key=_multipart_61O2VU0SB379.2~H3IAKFHKT0XW.0 size=1048576 2024-09-14T10:51:35.319 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.320+0000 7f19187cc780 1 < completed part key=_multipart_61O2VU0SB379.2~H3IAKFHKT0XW.1 size=1048576 2024-09-14T10:51:35.320 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.321+0000 7f19187cc780 1 < completed part key=_multipart_61O2VU0SB379.2~H3IAKFHKT0XW.2 size=600793 2024-09-14T10:51:35.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.324+0000 7f19187cc780 1 < completed multipart upload key=61O2VU0SB379 upload=H3IAKFHKT0XW tag=A8XLDV0CJ07P type=write size=3746521 2024-09-14T10:51:35.324 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.325+0000 7f19187cc780 1 > prepared operation key=5AIAYJMRZGFQ tag=3L8D43HBEP69 type=del size=622152 2024-09-14T10:51:35.326 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.328+0000 7f19187cc780 1 < suggested update operation key=OVOPGTYUF3F3 tag=S6KA9ZMJ26OK type=write size=664998 2024-09-14T10:51:35.329 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.331+0000 7f19187cc780 1 > prepared part key=_multipart_N0L67LS2KHR1.2~NFMCST4H3SP3.0 size=1048576 2024-09-14T10:51:35.330 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.332+0000 7f19187cc780 1 > prepared part key=_multipart_N0L67LS2KHR1.2~NFMCST4H3SP3.1 size=1048576 2024-09-14T10:51:35.331 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.333+0000 7f19187cc780 1 > prepared part key=_multipart_N0L67LS2KHR1.2~NFMCST4H3SP3.2 size=358006 2024-09-14T10:51:35.331 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.333+0000 7f19187cc780 1 > prepared multipart upload key=N0L67LS2KHR1 upload=NFMCST4H3SP3 tag=2EETNT2NOFC3 type=write size=3503734 2024-09-14T10:51:35.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.335+0000 7f19187cc780 1 < completed delete operation key=61O2VU0SB379 tag=O227OQ9F52ZK type=del 2024-09-14T10:51:35.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.337+0000 7f19187cc780 1 > prepared operation key=QBMNYNWOLK4I tag=6ME18VRXW6J9 type=write size=463186 2024-09-14T10:51:35.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.338+0000 7f19187cc780 1 < completed part key=_multipart_H40763V7HMBC.2~56ST33GB74H8.0 size=1048576 2024-09-14T10:51:35.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.340+0000 7f19187cc780 1 < completed part key=_multipart_H40763V7HMBC.2~56ST33GB74H8.1 size=1048576 2024-09-14T10:51:35.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.341+0000 7f19187cc780 1 < completed part key=_multipart_H40763V7HMBC.2~56ST33GB74H8.2 size=725149 2024-09-14T10:51:35.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.343+0000 7f19187cc780 1 < completed multipart upload key=H40763V7HMBC upload=56ST33GB74H8 tag=IG49FR9ALVOF type=write size=3870877 2024-09-14T10:51:35.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.344+0000 7f19187cc780 1 > prepared operation key=617QQI921HB4 tag=SHYC9XBYTPRH type=del size=2380640 2024-09-14T10:51:35.344 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.346+0000 7f19187cc780 1 < completed write operation key=VW6U36JN2DBX tag=X9E8OVYFHYO2 type=write size=571627 2024-09-14T10:51:35.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.348+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~ETKUUII07KWR.0 size=1048576 2024-09-14T10:51:35.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.350+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~ETKUUII07KWR.1 size=953620 2024-09-14T10:51:35.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.350+0000 7f19187cc780 1 > prepared multipart upload key=XCVE2F2JJK4X upload=ETKUUII07KWR tag=FXRN34RJ83XI type=write size=3050772 2024-09-14T10:51:35.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.352+0000 7f19187cc780 1 < completed delete operation key=VW6U36JN2DBX tag=B6XO10G0KV4Y type=del 2024-09-14T10:51:35.352 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.353+0000 7f19187cc780 1 > prepared operation key=75O00VMLJJ1X tag=K9DJWZI5SYVZ type=del size=1161894 2024-09-14T10:51:35.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.355+0000 7f19187cc780 1 < completed delete operation key=B9FQYIX19AEP tag=6DQ8W6LTV2K6 type=del 2024-09-14T10:51:35.356 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.357+0000 7f19187cc780 1 > prepared part key=_multipart_61O2VU0SB379.2~JROXYL21G620.0 size=1048576 2024-09-14T10:51:35.357 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.359+0000 7f19187cc780 1 > prepared part key=_multipart_61O2VU0SB379.2~JROXYL21G620.1 size=1048576 2024-09-14T10:51:35.358 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.360+0000 7f19187cc780 1 > prepared part key=_multipart_61O2VU0SB379.2~JROXYL21G620.2 size=44278 2024-09-14T10:51:35.358 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.360+0000 7f19187cc780 1 > prepared multipart upload key=61O2VU0SB379 upload=JROXYL21G620 tag=HC4PG42V019Q type=write size=3190006 2024-09-14T10:51:35.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.362+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~YT669ZYTXAIH.0 size=1048576 2024-09-14T10:51:35.361 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.363+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~YT669ZYTXAIH.1 size=591303 2024-09-14T10:51:35.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.365+0000 7f19187cc780 1 < completed multipart upload key=VW6U36JN2DBX upload=YT669ZYTXAIH tag=C0TI6AM7G2OC type=write size=2688455 2024-09-14T10:51:35.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.367+0000 7f19187cc780 1 > prepared operation key=KOJ7QB7M6A35 tag=M3T8XZCKLN22 type=del size=1748801 2024-09-14T10:51:35.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.368+0000 7f19187cc780 -1 < failed to complete operation key=OVOPGTYUF3F3 tag=NPKYQJTABGUW type=del size=1181385: (22) Invalid argument 2024-09-14T10:51:35.368 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.370+0000 7f19187cc780 1 > prepared operation key=OVOPGTYUF3F3 tag=6F0KUI1IHLRE type=del size=2631121 2024-09-14T10:51:35.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.371+0000 7f19187cc780 1 < completed delete operation key=6BNN842ZTWG5 tag=9UEJUGJ9AIP9 type=del 2024-09-14T10:51:35.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.373+0000 7f19187cc780 1 > prepared operation key=AST81B9QWORT tag=N3LGDNM4LTAD type=write size=18820 2024-09-14T10:51:35.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.374+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~Y7WHKJYKNGFH.0 size=1048576 2024-09-14T10:51:35.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.375+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~Y7WHKJYKNGFH.1 size=1048576 2024-09-14T10:51:35.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.376+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~Y7WHKJYKNGFH.2 size=151619 2024-09-14T10:51:35.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.379+0000 7f19187cc780 1 < completed multipart upload key=IKVYA4KEALFF upload=Y7WHKJYKNGFH tag=2LQH07N7K7IC type=write size=3297347 2024-09-14T10:51:35.379 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.380+0000 7f19187cc780 1 > prepared operation key=XCVE2F2JJK4X tag=FXKR2KU013XU type=del size=300342 2024-09-14T10:51:35.382 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.384+0000 7f19187cc780 1 < suggested update operation key=XCVE2F2JJK4X tag=DMAV647WSJIK type=write size=595602 2024-09-14T10:51:35.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.385+0000 7f19187cc780 1 > prepared operation key=617QQI921HB4 tag=FGIX7KR87UYE type=del size=1942694 2024-09-14T10:51:35.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.387+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~OQ9P5YG5B31N.0 size=549800 2024-09-14T10:51:35.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.389+0000 7f19187cc780 1 < completed multipart upload key=VW6U36JN2DBX upload=OQ9P5YG5B31N tag=XM4Z0C7F5BRD type=write size=1598376 2024-09-14T10:51:35.390 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.391+0000 7f19187cc780 1 > prepared part key=_multipart_W1K1IU13J0CZ.2~06U95TJAJN6O.0 size=1048576 2024-09-14T10:51:35.391 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.393+0000 7f19187cc780 1 > prepared part key=_multipart_W1K1IU13J0CZ.2~06U95TJAJN6O.1 size=1048576 2024-09-14T10:51:35.392 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.394+0000 7f19187cc780 1 > prepared part key=_multipart_W1K1IU13J0CZ.2~06U95TJAJN6O.2 size=279187 2024-09-14T10:51:35.392 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.394+0000 7f19187cc780 1 > prepared multipart upload key=W1K1IU13J0CZ upload=06U95TJAJN6O tag=3H3D6OZ0XS3R type=write size=3424915 2024-09-14T10:51:35.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.395+0000 7f19187cc780 1 < completed part key=_multipart_OVOPGTYUF3F3.2~4RAFYL58BV96.0 size=607942 2024-09-14T10:51:35.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.398+0000 7f19187cc780 1 < completed multipart upload key=OVOPGTYUF3F3 upload=4RAFYL58BV96 tag=T2BX0MH9550E type=write size=1656518 2024-09-14T10:51:35.398 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.399+0000 7f19187cc780 1 > prepared operation key=7IWUW2HC3ULI tag=Y1CCQLS154GN type=del size=2201208 2024-09-14T10:51:35.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.401+0000 7f19187cc780 1 < completed part key=_multipart_9EBD5ZT6MT45.2~PHFVX55W3TI1.0 size=1048576 2024-09-14T10:51:35.400 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.402+0000 7f19187cc780 1 < completed part key=_multipart_9EBD5ZT6MT45.2~PHFVX55W3TI1.1 size=1048576 2024-09-14T10:51:35.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.403+0000 7f19187cc780 1 < completed part key=_multipart_9EBD5ZT6MT45.2~PHFVX55W3TI1.2 size=615877 2024-09-14T10:51:35.404 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.406+0000 7f19187cc780 1 < completed multipart upload key=9EBD5ZT6MT45 upload=PHFVX55W3TI1 tag=8E0LP0CC8R1J type=write size=3761605 2024-09-14T10:51:35.406 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.407+0000 7f19187cc780 1 > prepared operation key=6BNN842ZTWG5 tag=V5Y0HSABRADU type=del size=1149358 2024-09-14T10:51:35.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.408+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~Z1G5AX5ZZ5PS.0 size=1048576 2024-09-14T10:51:35.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.409+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~Z1G5AX5ZZ5PS.1 size=786297 2024-09-14T10:51:35.410 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.412+0000 7f19187cc780 1 < completed multipart upload key=B9FQYIX19AEP upload=Z1G5AX5ZZ5PS tag=J2HQERHYZ5B4 type=write size=2883449 2024-09-14T10:51:35.411 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.413+0000 7f19187cc780 1 > prepared operation key=617QQI921HB4 tag=FCFAHW6JBTVD type=del size=1340942 2024-09-14T10:51:35.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.415+0000 7f19187cc780 1 < completed delete operation key=5AIAYJMRZGFQ tag=3L8D43HBEP69 type=del 2024-09-14T10:51:35.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.417+0000 7f19187cc780 1 > prepared part key=_multipart_H40763V7HMBC.2~FTWZDNIYVAFJ.0 size=823550 2024-09-14T10:51:35.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.417+0000 7f19187cc780 1 > prepared multipart upload key=H40763V7HMBC upload=FTWZDNIYVAFJ tag=49F8ERJBJNR2 type=write size=1872126 2024-09-14T10:51:35.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.419+0000 7f19187cc780 1 < completed part key=_multipart_N0L67LS2KHR1.2~NFMCST4H3SP3.0 size=1048576 2024-09-14T10:51:35.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.419+0000 7f19187cc780 1 < canceled part key=_multipart_N0L67LS2KHR1.2~NFMCST4H3SP3.1 size=1048576 2024-09-14T10:51:35.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.420+0000 7f19187cc780 1 < completed part key=_multipart_N0L67LS2KHR1.2~NFMCST4H3SP3.2 size=358006 2024-09-14T10:51:35.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.422+0000 7f19187cc780 1 < canceled multipart upload key=N0L67LS2KHR1 upload=NFMCST4H3SP3 tag=2EETNT2NOFC3 type=write size=3503734 2024-09-14T10:51:35.423 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.424+0000 7f19187cc780 1 > prepared part key=_multipart_19P3WE6HKJH2.2~LRLK8F63A66K.0 size=1048576 2024-09-14T10:51:35.424 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.426+0000 7f19187cc780 1 > prepared part key=_multipart_19P3WE6HKJH2.2~LRLK8F63A66K.1 size=1048576 2024-09-14T10:51:35.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.427+0000 7f19187cc780 1 > prepared part key=_multipart_19P3WE6HKJH2.2~LRLK8F63A66K.2 size=852698 2024-09-14T10:51:35.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.427+0000 7f19187cc780 1 > prepared multipart upload key=19P3WE6HKJH2 upload=LRLK8F63A66K tag=3SQ6F4H0EZB9 type=write size=3998426 2024-09-14T10:51:35.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.428+0000 7f19187cc780 1 < completed write operation key=QBMNYNWOLK4I tag=6ME18VRXW6J9 type=write size=463186 2024-09-14T10:51:35.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.430+0000 7f19187cc780 1 > prepared operation key=B9FQYIX19AEP tag=LLJQ57PREMX5 type=del size=3112574 2024-09-14T10:51:35.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.431+0000 7f19187cc780 1 < canceled operation key=617QQI921HB4 tag=SHYC9XBYTPRH type=del size=2380640 2024-09-14T10:51:35.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.434+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~WRQ48XH6WYY2.0 size=763349 2024-09-14T10:51:35.433 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.434+0000 7f19187cc780 1 > prepared multipart upload key=KP3WOGIF30PZ upload=WRQ48XH6WYY2 tag=H7O2YCC11FE9 type=write size=1811925 2024-09-14T10:51:35.434 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.436+0000 7f19187cc780 1 < completed part key=_multipart_XCVE2F2JJK4X.2~ETKUUII07KWR.0 size=1048576 2024-09-14T10:51:35.435 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.437+0000 7f19187cc780 1 < completed part key=_multipart_XCVE2F2JJK4X.2~ETKUUII07KWR.1 size=953620 2024-09-14T10:51:35.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.439+0000 7f19187cc780 1 < completed multipart upload key=XCVE2F2JJK4X upload=ETKUUII07KWR tag=FXRN34RJ83XI type=write size=3050772 2024-09-14T10:51:35.440 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.442+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~33JCZ4H7MY2H.0 size=498989 2024-09-14T10:51:35.440 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.442+0000 7f19187cc780 1 > prepared multipart upload key=IKVYA4KEALFF upload=33JCZ4H7MY2H tag=Z56NO0XXL19S type=write size=1547565 2024-09-14T10:51:35.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.445+0000 7f19187cc780 1 < suggested update operation key=75O00VMLJJ1X tag=K9DJWZI5SYVZ type=del size=1161894 2024-09-14T10:51:35.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.448+0000 7f19187cc780 1 > prepared part key=_multipart_617QQI921HB4.2~IRR7UAWTCX02.0 size=242236 2024-09-14T10:51:35.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.448+0000 7f19187cc780 1 > prepared multipart upload key=617QQI921HB4 upload=IRR7UAWTCX02 tag=25JORVLRU8U5 type=write size=1290812 2024-09-14T10:51:35.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.449+0000 7f19187cc780 1 < completed part key=_multipart_61O2VU0SB379.2~JROXYL21G620.0 size=1048576 2024-09-14T10:51:35.448 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.450+0000 7f19187cc780 1 < completed part key=_multipart_61O2VU0SB379.2~JROXYL21G620.1 size=1048576 2024-09-14T10:51:35.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.451+0000 7f19187cc780 1 < completed part key=_multipart_61O2VU0SB379.2~JROXYL21G620.2 size=44278 2024-09-14T10:51:35.452 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.454+0000 7f19187cc780 1 < completed multipart upload key=61O2VU0SB379 upload=JROXYL21G620 tag=HC4PG42V019Q type=write size=3190006 2024-09-14T10:51:35.455 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.456+0000 7f19187cc780 1 > prepared part key=_multipart_19P3WE6HKJH2.2~W6HRVOMXUCM0.0 size=865798 2024-09-14T10:51:35.455 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.456+0000 7f19187cc780 1 > prepared multipart upload key=19P3WE6HKJH2 upload=W6HRVOMXUCM0 tag=XPD8H2X6SCIO type=write size=1914374 2024-09-14T10:51:35.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.459+0000 7f19187cc780 1 < suggested update operation key=KOJ7QB7M6A35 tag=M3T8XZCKLN22 type=del size=1748801 2024-09-14T10:51:35.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.462+0000 7f19187cc780 1 > prepared part key=_multipart_EZLSMEK89N2G.2~5IX1AE34DK00.0 size=1048576 2024-09-14T10:51:35.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.463+0000 7f19187cc780 1 > prepared part key=_multipart_EZLSMEK89N2G.2~5IX1AE34DK00.1 size=316617 2024-09-14T10:51:35.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.463+0000 7f19187cc780 1 > prepared multipart upload key=EZLSMEK89N2G upload=5IX1AE34DK00 tag=P1BCXQV3MIKY type=write size=2413769 2024-09-14T10:51:35.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.464+0000 7f19187cc780 1 < completed delete operation key=OVOPGTYUF3F3 tag=6F0KUI1IHLRE type=del 2024-09-14T10:51:35.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.466+0000 7f19187cc780 1 > prepared operation key=AGNUE76X8XCJ tag=6IX1CQIJ7CHS type=del size=3185168 2024-09-14T10:51:35.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.467+0000 7f19187cc780 1 < completed write operation key=AST81B9QWORT tag=N3LGDNM4LTAD type=write size=18820 2024-09-14T10:51:35.467 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.468+0000 7f19187cc780 1 > prepared operation key=AGNUE76X8XCJ tag=LINPM54D2TWY type=write size=735847 2024-09-14T10:51:35.468 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.470+0000 7f19187cc780 -1 < failed to complete operation key=XCVE2F2JJK4X tag=FXKR2KU013XU type=del size=300342: (22) Invalid argument 2024-09-14T10:51:35.469 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.471+0000 7f19187cc780 1 > prepared operation key=54BSD3DEHNK6 tag=KH3H3Z76QJ14 type=del size=2476830 2024-09-14T10:51:35.471 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.473+0000 7f19187cc780 1 < completed delete operation key=617QQI921HB4 tag=FGIX7KR87UYE type=del 2024-09-14T10:51:35.472 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.474+0000 7f19187cc780 1 > prepared operation key=AGNUE76X8XCJ tag=9U63RJEE4Y9F type=del size=222450 2024-09-14T10:51:35.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.476+0000 7f19187cc780 1 < completed part key=_multipart_W1K1IU13J0CZ.2~06U95TJAJN6O.0 size=1048576 2024-09-14T10:51:35.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.477+0000 7f19187cc780 1 < completed part key=_multipart_W1K1IU13J0CZ.2~06U95TJAJN6O.1 size=1048576 2024-09-14T10:51:35.476 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.478+0000 7f19187cc780 1 < completed part key=_multipart_W1K1IU13J0CZ.2~06U95TJAJN6O.2 size=279187 2024-09-14T10:51:35.479 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.480+0000 7f19187cc780 1 < completed multipart upload key=W1K1IU13J0CZ upload=06U95TJAJN6O tag=3H3D6OZ0XS3R type=write size=3424915 2024-09-14T10:51:35.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.482+0000 7f19187cc780 1 > prepared operation key=IKVYA4KEALFF tag=5XGRD83FDST2 type=del size=3391773 2024-09-14T10:51:35.482 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.483+0000 7f19187cc780 1 < completed delete operation key=7IWUW2HC3ULI tag=Y1CCQLS154GN type=del 2024-09-14T10:51:35.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.487+0000 7f19187cc780 1 > prepared part key=_multipart_N0L67LS2KHR1.2~SRQ9UHYFLSYB.0 size=384660 2024-09-14T10:51:35.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.487+0000 7f19187cc780 1 > prepared multipart upload key=N0L67LS2KHR1 upload=SRQ9UHYFLSYB tag=2OJCFOEYT84U type=write size=1433236 2024-09-14T10:51:35.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.488+0000 7f19187cc780 1 < completed delete operation key=6BNN842ZTWG5 tag=V5Y0HSABRADU type=del 2024-09-14T10:51:35.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.491+0000 7f19187cc780 1 > prepared part key=_multipart_AST81B9QWORT.2~APNPZILR9GM9.0 size=399629 2024-09-14T10:51:35.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.491+0000 7f19187cc780 1 > prepared multipart upload key=AST81B9QWORT upload=APNPZILR9GM9 tag=1RYIDUZ1760Z type=write size=1448205 2024-09-14T10:51:35.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.492+0000 7f19187cc780 1 < completed delete operation key=617QQI921HB4 tag=FCFAHW6JBTVD type=del 2024-09-14T10:51:35.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.494+0000 7f19187cc780 1 > prepared operation key=IKVYA4KEALFF tag=OI4DDL9AK3F9 type=del size=3162979 2024-09-14T10:51:35.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.495+0000 7f19187cc780 1 < completed part key=_multipart_H40763V7HMBC.2~FTWZDNIYVAFJ.0 size=823550 2024-09-14T10:51:35.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.498+0000 7f19187cc780 1 < completed multipart upload key=H40763V7HMBC upload=FTWZDNIYVAFJ tag=49F8ERJBJNR2 type=write size=1872126 2024-09-14T10:51:35.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.499+0000 7f19187cc780 1 > prepared operation key=YA3DI7N4DG5K tag=CBRCQ7U3GQ1Y type=del size=2462060 2024-09-14T10:51:35.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.501+0000 7f19187cc780 1 < completed part key=_multipart_19P3WE6HKJH2.2~LRLK8F63A66K.0 size=1048576 2024-09-14T10:51:35.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.502+0000 7f19187cc780 1 < completed part key=_multipart_19P3WE6HKJH2.2~LRLK8F63A66K.1 size=1048576 2024-09-14T10:51:35.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.503+0000 7f19187cc780 1 < completed part key=_multipart_19P3WE6HKJH2.2~LRLK8F63A66K.2 size=852698 2024-09-14T10:51:35.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.505+0000 7f19187cc780 1 < completed multipart upload key=19P3WE6HKJH2 upload=LRLK8F63A66K tag=3SQ6F4H0EZB9 type=write size=3998426 2024-09-14T10:51:35.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.508+0000 7f19187cc780 1 > prepared part key=_multipart_W1K1IU13J0CZ.2~RXS0WQ4PG9DK.0 size=564826 2024-09-14T10:51:35.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.508+0000 7f19187cc780 1 > prepared multipart upload key=W1K1IU13J0CZ upload=RXS0WQ4PG9DK tag=PBUY35D60BZN type=write size=1613402 2024-09-14T10:51:35.508 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.510+0000 7f19187cc780 1 < completed delete operation key=B9FQYIX19AEP tag=LLJQ57PREMX5 type=del 2024-09-14T10:51:35.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.511+0000 7f19187cc780 1 > prepared operation key=617QQI921HB4 tag=2ACJGNZTIURY type=del size=4149145 2024-09-14T10:51:35.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.513+0000 7f19187cc780 1 < completed part key=_multipart_KP3WOGIF30PZ.2~WRQ48XH6WYY2.0 size=763349 2024-09-14T10:51:35.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.515+0000 7f19187cc780 1 < completed multipart upload key=KP3WOGIF30PZ upload=WRQ48XH6WYY2 tag=H7O2YCC11FE9 type=write size=1811925 2024-09-14T10:51:35.517 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.518+0000 7f19187cc780 1 > prepared part key=_multipart_RTGE7ISETJWW.2~R7EMNEAJ9UJ9.0 size=43736 2024-09-14T10:51:35.517 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.518+0000 7f19187cc780 1 > prepared multipart upload key=RTGE7ISETJWW upload=R7EMNEAJ9UJ9 tag=U1LIUWMEWUWC type=write size=1092312 2024-09-14T10:51:35.518 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.520+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~33JCZ4H7MY2H.0 size=498989 2024-09-14T10:51:35.520 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.522+0000 7f19187cc780 1 < completed multipart upload key=IKVYA4KEALFF upload=33JCZ4H7MY2H tag=Z56NO0XXL19S type=write size=1547565 2024-09-14T10:51:35.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.525+0000 7f19187cc780 1 > prepared part key=_multipart_EL00Y4Z7DTAT.2~RPX17M5S6K86.0 size=1048576 2024-09-14T10:51:35.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.526+0000 7f19187cc780 1 > prepared part key=_multipart_EL00Y4Z7DTAT.2~RPX17M5S6K86.1 size=420310 2024-09-14T10:51:35.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.526+0000 7f19187cc780 1 > prepared multipart upload key=EL00Y4Z7DTAT upload=RPX17M5S6K86 tag=CX801HYF4H4J type=write size=2517462 2024-09-14T10:51:35.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.526+0000 7f19187cc780 1 < canceled part key=_multipart_617QQI921HB4.2~IRR7UAWTCX02.0 size=242236 2024-09-14T10:51:35.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.528+0000 7f19187cc780 1 < canceled multipart upload key=617QQI921HB4 upload=IRR7UAWTCX02 tag=25JORVLRU8U5 type=write size=1290812 2024-09-14T10:51:35.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.531+0000 7f19187cc780 1 > prepared part key=_multipart_INJQTKXHBUV2.2~CYUSOIMMFNEL.0 size=1048576 2024-09-14T10:51:35.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.532+0000 7f19187cc780 1 > prepared part key=_multipart_INJQTKXHBUV2.2~CYUSOIMMFNEL.1 size=354290 2024-09-14T10:51:35.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.532+0000 7f19187cc780 1 > prepared multipart upload key=INJQTKXHBUV2 upload=CYUSOIMMFNEL tag=H4O7N9LPA0L0 type=write size=2451442 2024-09-14T10:51:35.532 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.533+0000 7f19187cc780 1 < completed part key=_multipart_19P3WE6HKJH2.2~W6HRVOMXUCM0.0 size=865798 2024-09-14T10:51:35.534 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.535+0000 7f19187cc780 1 < completed multipart upload key=19P3WE6HKJH2 upload=W6HRVOMXUCM0 tag=XPD8H2X6SCIO type=write size=1914374 2024-09-14T10:51:35.536 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.538+0000 7f19187cc780 1 > prepared part key=_multipart_MFA30GSMCSKP.2~89HIKI5IA1VR.0 size=1048576 2024-09-14T10:51:35.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.539+0000 7f19187cc780 1 > prepared part key=_multipart_MFA30GSMCSKP.2~89HIKI5IA1VR.1 size=1014226 2024-09-14T10:51:35.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.539+0000 7f19187cc780 1 > prepared multipart upload key=MFA30GSMCSKP upload=89HIKI5IA1VR tag=YAE8BPPOAX0G type=write size=3111378 2024-09-14T10:51:35.539 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.541+0000 7f19187cc780 1 < completed part key=_multipart_EZLSMEK89N2G.2~5IX1AE34DK00.0 size=1048576 2024-09-14T10:51:35.540 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.542+0000 7f19187cc780 1 < completed part key=_multipart_EZLSMEK89N2G.2~5IX1AE34DK00.1 size=316617 2024-09-14T10:51:35.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.545+0000 7f19187cc780 1 < completed multipart upload key=EZLSMEK89N2G upload=5IX1AE34DK00 tag=P1BCXQV3MIKY type=write size=2413769 2024-09-14T10:51:35.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.753+0000 7f19187cc780 1 > prepared operation key=5AIAYJMRZGFQ tag=J5ODEHKTX9ND type=del size=42969 2024-09-14T10:51:35.752 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.754+0000 7f19187cc780 1 < completed delete operation key=AGNUE76X8XCJ tag=6IX1CQIJ7CHS type=del 2024-09-14T10:51:35.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.756+0000 7f19187cc780 1 > prepared operation key=KOJ7QB7M6A35 tag=6NG6QU68ZF1K type=del size=155267 2024-09-14T10:51:35.756 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.757+0000 7f19187cc780 1 < completed write operation key=AGNUE76X8XCJ tag=LINPM54D2TWY type=write size=735847 2024-09-14T10:51:35.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.759+0000 7f19187cc780 1 > prepared operation key=AGNUE76X8XCJ tag=2RX4MHTCPHID type=del size=2199181 2024-09-14T10:51:35.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.762+0000 7f19187cc780 1 < suggested update operation key=54BSD3DEHNK6 tag=KH3H3Z76QJ14 type=del size=2476830 2024-09-14T10:51:35.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.764+0000 7f19187cc780 1 > prepared operation key=9EBD5ZT6MT45 tag=T67L1TTBWXJT type=del size=2978137 2024-09-14T10:51:35.764 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.766+0000 7f19187cc780 1 < completed delete operation key=AGNUE76X8XCJ tag=9U63RJEE4Y9F type=del 2024-09-14T10:51:35.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.769+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~XAKJCO4WFHKU.0 size=1048576 2024-09-14T10:51:35.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.770+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~XAKJCO4WFHKU.1 size=1048576 2024-09-14T10:51:35.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.771+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~XAKJCO4WFHKU.2 size=209829 2024-09-14T10:51:35.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.771+0000 7f19187cc780 1 > prepared multipart upload key=XCVE2F2JJK4X upload=XAKJCO4WFHKU tag=TXXI72LN3SVG type=write size=3355557 2024-09-14T10:51:35.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.772+0000 7f19187cc780 1 < completed delete operation key=IKVYA4KEALFF tag=5XGRD83FDST2 type=del 2024-09-14T10:51:35.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.774+0000 7f19187cc780 1 > prepared operation key=EZLSMEK89N2G tag=FM8QN6C24QQG type=del size=2016048 2024-09-14T10:51:35.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.775+0000 7f19187cc780 1 < completed part key=_multipart_N0L67LS2KHR1.2~SRQ9UHYFLSYB.0 size=384660 2024-09-14T10:51:35.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.778+0000 7f19187cc780 1 < completed multipart upload key=N0L67LS2KHR1 upload=SRQ9UHYFLSYB tag=2OJCFOEYT84U type=write size=1433236 2024-09-14T10:51:35.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.780+0000 7f19187cc780 1 > prepared part key=_multipart_54BSD3DEHNK6.2~0ST7AY4VWDYX.0 size=1048576 2024-09-14T10:51:35.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.781+0000 7f19187cc780 1 > prepared part key=_multipart_54BSD3DEHNK6.2~0ST7AY4VWDYX.1 size=358551 2024-09-14T10:51:35.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.781+0000 7f19187cc780 1 > prepared multipart upload key=54BSD3DEHNK6 upload=0ST7AY4VWDYX tag=ZVL00HGNBM9G type=write size=2455703 2024-09-14T10:51:35.781 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.782+0000 7f19187cc780 1 < canceled part key=_multipart_AST81B9QWORT.2~APNPZILR9GM9.0 size=399629 2024-09-14T10:51:35.783 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.784+0000 7f19187cc780 1 < canceled multipart upload key=AST81B9QWORT upload=APNPZILR9GM9 tag=1RYIDUZ1760Z type=write size=1448205 2024-09-14T10:51:35.785 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.786+0000 7f19187cc780 1 > prepared operation key=M73CER01XHDY tag=JCATBM58CL74 type=write size=174040 2024-09-14T10:51:35.786 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.788+0000 7f19187cc780 1 < canceled operation key=IKVYA4KEALFF tag=OI4DDL9AK3F9 type=del size=3162979 2024-09-14T10:51:35.788 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.790+0000 7f19187cc780 1 > prepared operation key=EL00Y4Z7DTAT tag=QKPWIFF4AD32 type=del size=528385 2024-09-14T10:51:35.791 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.792+0000 7f19187cc780 1 < suggested update operation key=YA3DI7N4DG5K tag=CBRCQ7U3GQ1Y type=del size=2462060 2024-09-14T10:51:35.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.794+0000 7f19187cc780 1 > prepared operation key=W1K1IU13J0CZ tag=EOWTX2U390W3 type=write size=522334 2024-09-14T10:51:35.793 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.795+0000 7f19187cc780 1 < completed part key=_multipart_W1K1IU13J0CZ.2~RXS0WQ4PG9DK.0 size=564826 2024-09-14T10:51:35.796 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.798+0000 7f19187cc780 1 < completed multipart upload key=W1K1IU13J0CZ upload=RXS0WQ4PG9DK tag=PBUY35D60BZN type=write size=1613402 2024-09-14T10:51:35.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.799+0000 7f19187cc780 1 > prepared operation key=AGNUE76X8XCJ tag=BCPP2OWRPLSE type=del size=968988 2024-09-14T10:51:35.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.802+0000 7f19187cc780 1 < suggested remove operation key=617QQI921HB4 tag=2ACJGNZTIURY type=del 2024-09-14T10:51:35.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.805+0000 7f19187cc780 1 > prepared part key=_multipart_61O2VU0SB379.2~T4J25F6SN31H.0 size=1048576 2024-09-14T10:51:35.804 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.806+0000 7f19187cc780 1 > prepared part key=_multipart_61O2VU0SB379.2~T4J25F6SN31H.1 size=603258 2024-09-14T10:51:35.805 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.806+0000 7f19187cc780 1 > prepared multipart upload key=61O2VU0SB379 upload=T4J25F6SN31H tag=Q0YJPMLZYTKV type=write size=2700410 2024-09-14T10:51:35.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.808+0000 7f19187cc780 1 < completed part key=_multipart_RTGE7ISETJWW.2~R7EMNEAJ9UJ9.0 size=43736 2024-09-14T10:51:35.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.810+0000 7f19187cc780 1 < completed multipart upload key=RTGE7ISETJWW upload=R7EMNEAJ9UJ9 tag=U1LIUWMEWUWC type=write size=1092312 2024-09-14T10:51:35.812 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.813+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~NS4M5PN9EZPR.0 size=1048576 2024-09-14T10:51:35.812 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.814+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~NS4M5PN9EZPR.1 size=1048576 2024-09-14T10:51:35.813 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.815+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~NS4M5PN9EZPR.2 size=576382 2024-09-14T10:51:35.814 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.815+0000 7f19187cc780 1 > prepared multipart upload key=6BNN842ZTWG5 upload=NS4M5PN9EZPR tag=DGU8OMPB92J2 type=write size=3722110 2024-09-14T10:51:35.815 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.817+0000 7f19187cc780 1 < completed part key=_multipart_EL00Y4Z7DTAT.2~RPX17M5S6K86.0 size=1048576 2024-09-14T10:51:35.816 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.818+0000 7f19187cc780 1 < completed part key=_multipart_EL00Y4Z7DTAT.2~RPX17M5S6K86.1 size=420310 2024-09-14T10:51:35.819 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.820+0000 7f19187cc780 1 < completed multipart upload key=EL00Y4Z7DTAT upload=RPX17M5S6K86 tag=CX801HYF4H4J type=write size=2517462 2024-09-14T10:51:35.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.822+0000 7f19187cc780 1 > prepared operation key=QBMNYNWOLK4I tag=1PIZDZKU5PRD type=del size=1980745 2024-09-14T10:51:35.822 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.823+0000 7f19187cc780 1 < completed part key=_multipart_INJQTKXHBUV2.2~CYUSOIMMFNEL.0 size=1048576 2024-09-14T10:51:35.822 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.823+0000 7f19187cc780 1 < canceled part key=_multipart_INJQTKXHBUV2.2~CYUSOIMMFNEL.1 size=354290 2024-09-14T10:51:35.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.826+0000 7f19187cc780 1 < canceled multipart upload key=INJQTKXHBUV2 upload=CYUSOIMMFNEL tag=H4O7N9LPA0L0 type=write size=2451442 2024-09-14T10:51:35.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.828+0000 7f19187cc780 1 > prepared operation key=61O2VU0SB379 tag=C2H10GC12YYA type=del size=3497707 2024-09-14T10:51:35.829 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.831+0000 7f19187cc780 1 < completed part key=_multipart_MFA30GSMCSKP.2~89HIKI5IA1VR.0 size=1048576 2024-09-14T10:51:35.832 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.834+0000 7f19187cc780 1 < completed part key=_multipart_MFA30GSMCSKP.2~89HIKI5IA1VR.1 size=1014226 2024-09-14T10:51:35.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.836+0000 7f19187cc780 1 < completed multipart upload key=MFA30GSMCSKP upload=89HIKI5IA1VR tag=YAE8BPPOAX0G type=write size=3111378 2024-09-14T10:51:35.837 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.838+0000 7f19187cc780 1 > prepared operation key=QFEI6H4EQ9ZR tag=KQV4E4F7ROWU type=write size=17331 2024-09-14T10:51:35.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.840+0000 7f19187cc780 1 < completed delete operation key=5AIAYJMRZGFQ tag=J5ODEHKTX9ND type=del 2024-09-14T10:51:35.840 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.841+0000 7f19187cc780 1 > prepared operation key=54BSD3DEHNK6 tag=72RY75QSDYZC type=del size=3363153 2024-09-14T10:51:35.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.845+0000 7f19187cc780 1 < suggested update operation key=KOJ7QB7M6A35 tag=6NG6QU68ZF1K type=del size=155267 2024-09-14T10:51:35.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.848+0000 7f19187cc780 1 > prepared part key=_multipart_9EBD5ZT6MT45.2~8GNGHGNVT7V7.0 size=1048576 2024-09-14T10:51:35.848 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.850+0000 7f19187cc780 1 > prepared part key=_multipart_9EBD5ZT6MT45.2~8GNGHGNVT7V7.1 size=827278 2024-09-14T10:51:35.848 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.850+0000 7f19187cc780 1 > prepared multipart upload key=9EBD5ZT6MT45 upload=8GNGHGNVT7V7 tag=42UWHRYUGBPQ type=write size=2924430 2024-09-14T10:51:35.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.852+0000 7f19187cc780 1 < completed delete operation key=AGNUE76X8XCJ tag=2RX4MHTCPHID type=del 2024-09-14T10:51:35.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.853+0000 7f19187cc780 1 > prepared operation key=CADC2BY888V1 tag=XMOPV2F1PMAB type=del size=747185 2024-09-14T10:51:35.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.857+0000 7f19187cc780 1 < suggested update operation key=9EBD5ZT6MT45 tag=T67L1TTBWXJT type=del size=2978137 2024-09-14T10:51:35.858 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.859+0000 7f19187cc780 1 > prepared part key=_multipart_54BSD3DEHNK6.2~CC2SEQ4UN9WG.0 size=666530 2024-09-14T10:51:35.858 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.859+0000 7f19187cc780 1 > prepared multipart upload key=54BSD3DEHNK6 upload=CC2SEQ4UN9WG tag=6DBULDSJBL3Z type=write size=1715106 2024-09-14T10:51:35.859 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.861+0000 7f19187cc780 1 < completed part key=_multipart_XCVE2F2JJK4X.2~XAKJCO4WFHKU.0 size=1048576 2024-09-14T10:51:35.860 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.862+0000 7f19187cc780 1 < completed part key=_multipart_XCVE2F2JJK4X.2~XAKJCO4WFHKU.1 size=1048576 2024-09-14T10:51:35.861 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.863+0000 7f19187cc780 1 < completed part key=_multipart_XCVE2F2JJK4X.2~XAKJCO4WFHKU.2 size=209829 2024-09-14T10:51:35.864 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.866+0000 7f19187cc780 1 < completed multipart upload key=XCVE2F2JJK4X upload=XAKJCO4WFHKU tag=TXXI72LN3SVG type=write size=3355557 2024-09-14T10:51:35.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.869+0000 7f19187cc780 1 > prepared part key=_multipart_INJQTKXHBUV2.2~U35Y0AJIVP5V.0 size=520628 2024-09-14T10:51:35.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.869+0000 7f19187cc780 1 > prepared multipart upload key=INJQTKXHBUV2 upload=U35Y0AJIVP5V tag=B9UFE5M6UV30 type=write size=1569204 2024-09-14T10:51:35.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.871+0000 7f19187cc780 1 < completed delete operation key=EZLSMEK89N2G tag=FM8QN6C24QQG type=del 2024-09-14T10:51:35.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.874+0000 7f19187cc780 1 > prepared part key=_multipart_QFEI6H4EQ9ZR.2~IFGNUVIFLPFL.0 size=1048576 2024-09-14T10:51:35.873 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.875+0000 7f19187cc780 1 > prepared part key=_multipart_QFEI6H4EQ9ZR.2~IFGNUVIFLPFL.1 size=580245 2024-09-14T10:51:35.873 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.875+0000 7f19187cc780 1 > prepared multipart upload key=QFEI6H4EQ9ZR upload=IFGNUVIFLPFL tag=PTW7IAFKJIO3 type=write size=2677397 2024-09-14T10:51:35.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.877+0000 7f19187cc780 1 < completed part key=_multipart_54BSD3DEHNK6.2~0ST7AY4VWDYX.0 size=1048576 2024-09-14T10:51:35.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.877+0000 7f19187cc780 1 < canceled part key=_multipart_54BSD3DEHNK6.2~0ST7AY4VWDYX.1 size=358551 2024-09-14T10:51:35.877 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.879+0000 7f19187cc780 1 < canceled multipart upload key=54BSD3DEHNK6 upload=0ST7AY4VWDYX tag=ZVL00HGNBM9G type=write size=2455703 2024-09-14T10:51:35.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.880+0000 7f19187cc780 1 > prepared operation key=CADC2BY888V1 tag=6FC0SPUZP4MQ type=del size=4085475 2024-09-14T10:51:35.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.882+0000 7f19187cc780 1 < completed write operation key=M73CER01XHDY tag=JCATBM58CL74 type=write size=174040 2024-09-14T10:51:35.882 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.883+0000 7f19187cc780 1 > prepared operation key=OVOPGTYUF3F3 tag=RH2AYB1VGM0J type=del size=2621044 2024-09-14T10:51:35.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.886+0000 7f19187cc780 1 < suggested remove operation key=EL00Y4Z7DTAT tag=QKPWIFF4AD32 type=del 2024-09-14T10:51:35.887 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.889+0000 7f19187cc780 1 > prepared part key=_multipart_QBMNYNWOLK4I.2~PGYMP4E1GBKD.0 size=1048576 2024-09-14T10:51:35.888 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.890+0000 7f19187cc780 1 > prepared part key=_multipart_QBMNYNWOLK4I.2~PGYMP4E1GBKD.1 size=1048576 2024-09-14T10:51:35.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.891+0000 7f19187cc780 1 > prepared part key=_multipart_QBMNYNWOLK4I.2~PGYMP4E1GBKD.2 size=864840 2024-09-14T10:51:35.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.891+0000 7f19187cc780 1 > prepared multipart upload key=QBMNYNWOLK4I upload=PGYMP4E1GBKD tag=LWVMZANKGNGY type=write size=4010568 2024-09-14T10:51:35.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.893+0000 7f19187cc780 1 < completed write operation key=W1K1IU13J0CZ tag=EOWTX2U390W3 type=write size=522334 2024-09-14T10:51:35.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.895+0000 7f19187cc780 1 > prepared operation key=617QQI921HB4 tag=M3NNTSUMJAWO type=del size=1083997 2024-09-14T10:51:35.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.897+0000 7f19187cc780 1 < suggested remove operation key=AGNUE76X8XCJ tag=BCPP2OWRPLSE type=del 2024-09-14T10:51:35.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.899+0000 7f19187cc780 1 > prepared operation key=E6UO1LUWOC44 tag=TTENCSYVKDXZ type=del size=3952023 2024-09-14T10:51:35.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.900+0000 7f19187cc780 1 < completed part key=_multipart_61O2VU0SB379.2~T4J25F6SN31H.0 size=1048576 2024-09-14T10:51:35.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.901+0000 7f19187cc780 1 < completed part key=_multipart_61O2VU0SB379.2~T4J25F6SN31H.1 size=603258 2024-09-14T10:51:35.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.904+0000 7f19187cc780 1 < completed multipart upload key=61O2VU0SB379 upload=T4J25F6SN31H tag=Q0YJPMLZYTKV type=write size=2700410 2024-09-14T10:51:35.905 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.906+0000 7f19187cc780 1 > prepared part key=_multipart_M73CER01XHDY.2~2EILJ68YQND9.0 size=1048576 2024-09-14T10:51:35.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.907+0000 7f19187cc780 1 > prepared part key=_multipart_M73CER01XHDY.2~2EILJ68YQND9.1 size=578658 2024-09-14T10:51:35.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.907+0000 7f19187cc780 1 > prepared multipart upload key=M73CER01XHDY upload=2EILJ68YQND9 tag=0810KF1OGDU1 type=write size=2675810 2024-09-14T10:51:35.907 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.909+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~NS4M5PN9EZPR.0 size=1048576 2024-09-14T10:51:35.907 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.909+0000 7f19187cc780 1 < canceled part key=_multipart_6BNN842ZTWG5.2~NS4M5PN9EZPR.1 size=1048576 2024-09-14T10:51:35.908 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.910+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~NS4M5PN9EZPR.2 size=576382 2024-09-14T10:51:35.912 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.913+0000 7f19187cc780 1 < canceled multipart upload key=6BNN842ZTWG5 upload=NS4M5PN9EZPR tag=DGU8OMPB92J2 type=write size=3722110 2024-09-14T10:51:35.914 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.915+0000 7f19187cc780 1 > prepared part key=_multipart_9EBD5ZT6MT45.2~TSH0SQ2LAQX1.0 size=1048576 2024-09-14T10:51:35.915 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.917+0000 7f19187cc780 1 > prepared part key=_multipart_9EBD5ZT6MT45.2~TSH0SQ2LAQX1.1 size=1048576 2024-09-14T10:51:35.916 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.918+0000 7f19187cc780 1 > prepared part key=_multipart_9EBD5ZT6MT45.2~TSH0SQ2LAQX1.2 size=315901 2024-09-14T10:51:35.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.918+0000 7f19187cc780 1 > prepared multipart upload key=9EBD5ZT6MT45 upload=TSH0SQ2LAQX1 tag=HK2TSDJKCZ31 type=write size=3461629 2024-09-14T10:51:35.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.919+0000 7f19187cc780 1 < canceled operation key=QBMNYNWOLK4I tag=1PIZDZKU5PRD type=del size=1980745 2024-09-14T10:51:35.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.922+0000 7f19187cc780 1 > prepared part key=_multipart_EL00Y4Z7DTAT.2~8LZPB9HJU4AA.0 size=248014 2024-09-14T10:51:35.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.922+0000 7f19187cc780 1 > prepared multipart upload key=EL00Y4Z7DTAT upload=8LZPB9HJU4AA tag=IH6DZCWKNNLW type=write size=1296590 2024-09-14T10:51:35.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.924+0000 7f19187cc780 1 < completed delete operation key=61O2VU0SB379 tag=C2H10GC12YYA type=del 2024-09-14T10:51:35.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.925+0000 7f19187cc780 1 > prepared operation key=AST81B9QWORT tag=U2I3JVPH0S3Y type=del size=1889741 2024-09-14T10:51:35.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.927+0000 7f19187cc780 1 < completed write operation key=QFEI6H4EQ9ZR tag=KQV4E4F7ROWU type=write size=17331 2024-09-14T10:51:35.926 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.928+0000 7f19187cc780 1 > prepared operation key=9EBD5ZT6MT45 tag=KJ0SB9LSVYX5 type=del size=884112 2024-09-14T10:51:35.928 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.930+0000 7f19187cc780 1 < completed delete operation key=54BSD3DEHNK6 tag=72RY75QSDYZC type=del 2024-09-14T10:51:35.930 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.931+0000 7f19187cc780 1 > prepared operation key=75O00VMLJJ1X tag=UOVGRJ3FJCUC type=del size=3549494 2024-09-14T10:51:35.932 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.933+0000 7f19187cc780 1 < completed part key=_multipart_9EBD5ZT6MT45.2~8GNGHGNVT7V7.0 size=1048576 2024-09-14T10:51:35.933 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.934+0000 7f19187cc780 1 < completed part key=_multipart_9EBD5ZT6MT45.2~8GNGHGNVT7V7.1 size=827278 2024-09-14T10:51:35.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.937+0000 7f19187cc780 1 < completed multipart upload key=9EBD5ZT6MT45 upload=8GNGHGNVT7V7 tag=42UWHRYUGBPQ type=write size=2924430 2024-09-14T10:51:35.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.938+0000 7f19187cc780 1 > prepared operation key=W1K1IU13J0CZ tag=S9TRFJW8HQM6 type=del size=2611224 2024-09-14T10:51:35.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.940+0000 7f19187cc780 1 < canceled operation key=CADC2BY888V1 tag=XMOPV2F1PMAB type=del size=747185 2024-09-14T10:51:35.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.941+0000 7f19187cc780 1 > prepared operation key=KOJ7QB7M6A35 tag=9H1XXV39TOM1 type=del size=1196928 2024-09-14T10:51:35.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.943+0000 7f19187cc780 1 < completed part key=_multipart_54BSD3DEHNK6.2~CC2SEQ4UN9WG.0 size=666530 2024-09-14T10:51:35.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.946+0000 7f19187cc780 1 < completed multipart upload key=54BSD3DEHNK6 upload=CC2SEQ4UN9WG tag=6DBULDSJBL3Z type=write size=1715106 2024-09-14T10:51:35.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.948+0000 7f19187cc780 1 > prepared part key=_multipart_M73CER01XHDY.2~4S5TUR6UUN0L.0 size=1048576 2024-09-14T10:51:35.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.949+0000 7f19187cc780 1 > prepared part key=_multipart_M73CER01XHDY.2~4S5TUR6UUN0L.1 size=873519 2024-09-14T10:51:35.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.949+0000 7f19187cc780 1 > prepared multipart upload key=M73CER01XHDY upload=4S5TUR6UUN0L tag=UYFTMBYQJ5CY type=write size=2970671 2024-09-14T10:51:35.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.951+0000 7f19187cc780 1 < completed part key=_multipart_INJQTKXHBUV2.2~U35Y0AJIVP5V.0 size=520628 2024-09-14T10:51:35.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.953+0000 7f19187cc780 1 < completed multipart upload key=INJQTKXHBUV2 upload=U35Y0AJIVP5V tag=B9UFE5M6UV30 type=write size=1569204 2024-09-14T10:51:35.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.955+0000 7f19187cc780 1 > prepared operation key=RTGE7ISETJWW tag=FX1IUB8ONO92 type=write size=928947 2024-09-14T10:51:35.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.956+0000 7f19187cc780 1 < completed part key=_multipart_QFEI6H4EQ9ZR.2~IFGNUVIFLPFL.0 size=1048576 2024-09-14T10:51:35.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.957+0000 7f19187cc780 1 < completed part key=_multipart_QFEI6H4EQ9ZR.2~IFGNUVIFLPFL.1 size=580245 2024-09-14T10:51:35.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.960+0000 7f19187cc780 1 < completed multipart upload key=QFEI6H4EQ9ZR upload=IFGNUVIFLPFL tag=PTW7IAFKJIO3 type=write size=2677397 2024-09-14T10:51:35.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.961+0000 7f19187cc780 1 > prepared operation key=AGNUE76X8XCJ tag=M4UUCT7FEX9B type=del size=4127859 2024-09-14T10:51:35.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.962+0000 7f19187cc780 1 < completed delete operation key=CADC2BY888V1 tag=6FC0SPUZP4MQ type=del 2024-09-14T10:51:35.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.964+0000 7f19187cc780 1 > prepared operation key=7IWUW2HC3ULI tag=2CGJLRHLSJBZ type=del size=3316870 2024-09-14T10:51:35.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.965+0000 7f19187cc780 1 < canceled operation key=OVOPGTYUF3F3 tag=RH2AYB1VGM0J type=del size=2621044 2024-09-14T10:51:35.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.967+0000 7f19187cc780 1 > prepared operation key=9EBD5ZT6MT45 tag=6A3C805IGVV9 type=del size=341044 2024-09-14T10:51:35.967 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.968+0000 7f19187cc780 1 < completed part key=_multipart_QBMNYNWOLK4I.2~PGYMP4E1GBKD.0 size=1048576 2024-09-14T10:51:35.967 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.968+0000 7f19187cc780 1 < canceled part key=_multipart_QBMNYNWOLK4I.2~PGYMP4E1GBKD.1 size=1048576 2024-09-14T10:51:35.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.970+0000 7f19187cc780 1 < completed part key=_multipart_QBMNYNWOLK4I.2~PGYMP4E1GBKD.2 size=864840 2024-09-14T10:51:35.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.972+0000 7f19187cc780 1 < canceled multipart upload key=QBMNYNWOLK4I upload=PGYMP4E1GBKD tag=LWVMZANKGNGY type=write size=4010568 2024-09-14T10:51:35.974 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.975+0000 7f19187cc780 1 > prepared operation key=9EBD5ZT6MT45 tag=BVEPOTEH66LT type=del size=1767615 2024-09-14T10:51:35.976 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.977+0000 7f19187cc780 1 < suggested update operation key=617QQI921HB4 tag=M3NNTSUMJAWO type=del size=1083997 2024-09-14T10:51:35.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.979+0000 7f19187cc780 1 > prepared operation key=61O2VU0SB379 tag=7C25Z4XWOJXZ type=write size=415919 2024-09-14T10:51:35.979 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.980+0000 7f19187cc780 1 < completed delete operation key=E6UO1LUWOC44 tag=TTENCSYVKDXZ type=del 2024-09-14T10:51:35.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.983+0000 7f19187cc780 1 > prepared part key=_multipart_W1K1IU13J0CZ.2~O2U044K6X9D8.0 size=359121 2024-09-14T10:51:35.982 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.983+0000 7f19187cc780 1 > prepared multipart upload key=W1K1IU13J0CZ upload=O2U044K6X9D8 tag=XLVR13LVXPVL type=write size=1407697 2024-09-14T10:51:35.983 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.985+0000 7f19187cc780 1 < completed part key=_multipart_M73CER01XHDY.2~2EILJ68YQND9.0 size=1048576 2024-09-14T10:51:35.983 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.985+0000 7f19187cc780 1 < canceled part key=_multipart_M73CER01XHDY.2~2EILJ68YQND9.1 size=578658 2024-09-14T10:51:35.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.987+0000 7f19187cc780 1 < canceled multipart upload key=M73CER01XHDY upload=2EILJ68YQND9 tag=0810KF1OGDU1 type=write size=2675810 2024-09-14T10:51:35.987 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.988+0000 7f19187cc780 1 > prepared operation key=EL00Y4Z7DTAT tag=ZRBIL7ACVN9B type=del size=2127278 2024-09-14T10:51:35.988 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.990+0000 7f19187cc780 1 < completed part key=_multipart_9EBD5ZT6MT45.2~TSH0SQ2LAQX1.0 size=1048576 2024-09-14T10:51:35.989 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.991+0000 7f19187cc780 1 < completed part key=_multipart_9EBD5ZT6MT45.2~TSH0SQ2LAQX1.1 size=1048576 2024-09-14T10:51:35.990 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.992+0000 7f19187cc780 1 < completed part key=_multipart_9EBD5ZT6MT45.2~TSH0SQ2LAQX1.2 size=315901 2024-09-14T10:51:35.993 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.995+0000 7f19187cc780 1 < completed multipart upload key=9EBD5ZT6MT45 upload=TSH0SQ2LAQX1 tag=HK2TSDJKCZ31 type=write size=3461629 2024-09-14T10:51:35.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.998+0000 7f19187cc780 1 > prepared part key=_multipart_W1K1IU13J0CZ.2~NQECJQ3ZH4FF.0 size=135770 2024-09-14T10:51:35.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.998+0000 7f19187cc780 1 > prepared multipart upload key=W1K1IU13J0CZ upload=NQECJQ3ZH4FF tag=OKGR85441KA3 type=write size=1184346 2024-09-14T10:51:35.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:35.999+0000 7f19187cc780 1 < completed part key=_multipart_EL00Y4Z7DTAT.2~8LZPB9HJU4AA.0 size=248014 2024-09-14T10:51:36.000 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.002+0000 7f19187cc780 1 < completed multipart upload key=EL00Y4Z7DTAT upload=8LZPB9HJU4AA tag=IH6DZCWKNNLW type=write size=1296590 2024-09-14T10:51:36.002 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.003+0000 7f19187cc780 1 > prepared operation key=INJQTKXHBUV2 tag=D800ZVB67QAI type=write size=757897 2024-09-14T10:51:36.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.005+0000 7f19187cc780 1 < canceled operation key=AST81B9QWORT tag=U2I3JVPH0S3Y type=del size=1889741 2024-09-14T10:51:36.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.006+0000 7f19187cc780 1 > prepared operation key=54BSD3DEHNK6 tag=LJIVEUFPU95E type=del size=2801275 2024-09-14T10:51:36.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.007+0000 7f19187cc780 1 < canceled operation key=9EBD5ZT6MT45 tag=KJ0SB9LSVYX5 type=del size=884112 2024-09-14T10:51:36.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.009+0000 7f19187cc780 1 > prepared operation key=B9FQYIX19AEP tag=1AHPND6AXDQK type=write size=65972 2024-09-14T10:51:36.009 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.011+0000 7f19187cc780 1 < completed delete operation key=75O00VMLJJ1X tag=UOVGRJ3FJCUC type=del 2024-09-14T10:51:36.011 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.012+0000 7f19187cc780 1 > prepared operation key=EZLSMEK89N2G tag=YD3AZY1EA0ZX type=del size=1185724 2024-09-14T10:51:36.012 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.014+0000 7f19187cc780 1 < canceled operation key=W1K1IU13J0CZ tag=S9TRFJW8HQM6 type=del size=2611224 2024-09-14T10:51:36.014 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.015+0000 7f19187cc780 1 > prepared operation key=6BNN842ZTWG5 tag=HNJQSPDRQCAV type=del size=3260223 2024-09-14T10:51:36.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.017+0000 7f19187cc780 1 < completed delete operation key=KOJ7QB7M6A35 tag=9H1XXV39TOM1 type=del 2024-09-14T10:51:36.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.020+0000 7f19187cc780 1 > prepared part key=_multipart_QFEI6H4EQ9ZR.2~85ROZBT2A7DF.0 size=1004256 2024-09-14T10:51:36.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.020+0000 7f19187cc780 1 > prepared multipart upload key=QFEI6H4EQ9ZR upload=85ROZBT2A7DF tag=F03GSM01V2VZ type=write size=2052832 2024-09-14T10:51:36.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.021+0000 7f19187cc780 1 < completed part key=_multipart_M73CER01XHDY.2~4S5TUR6UUN0L.0 size=1048576 2024-09-14T10:51:36.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.022+0000 7f19187cc780 1 < completed part key=_multipart_M73CER01XHDY.2~4S5TUR6UUN0L.1 size=873519 2024-09-14T10:51:36.024 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.024+0000 7f19187cc780 1 < completed multipart upload key=M73CER01XHDY upload=4S5TUR6UUN0L tag=UYFTMBYQJ5CY type=write size=2970671 2024-09-14T10:51:36.025 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.027+0000 7f19187cc780 1 > prepared part key=_multipart_EL00Y4Z7DTAT.2~3AN18G2GGUV1.0 size=1048576 2024-09-14T10:51:36.026 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.028+0000 7f19187cc780 1 > prepared part key=_multipart_EL00Y4Z7DTAT.2~3AN18G2GGUV1.1 size=986910 2024-09-14T10:51:36.027 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.028+0000 7f19187cc780 1 > prepared multipart upload key=EL00Y4Z7DTAT upload=3AN18G2GGUV1 tag=RYVG5FJN1RGK type=write size=3084062 2024-09-14T10:51:36.028 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.030+0000 7f19187cc780 1 < canceled operation key=RTGE7ISETJWW tag=FX1IUB8ONO92 type=write size=928947 2024-09-14T10:51:36.031 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.032+0000 7f19187cc780 1 > prepared part key=_multipart_INJQTKXHBUV2.2~G3HK18E7Y8VG.0 size=1048576 2024-09-14T10:51:36.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.034+0000 7f19187cc780 1 > prepared part key=_multipart_INJQTKXHBUV2.2~G3HK18E7Y8VG.1 size=381475 2024-09-14T10:51:36.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.034+0000 7f19187cc780 1 > prepared multipart upload key=INJQTKXHBUV2 upload=G3HK18E7Y8VG tag=VQ6O4YTVU8W1 type=write size=2478627 2024-09-14T10:51:36.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.035+0000 7f19187cc780 1 < completed delete operation key=AGNUE76X8XCJ tag=M4UUCT7FEX9B type=del 2024-09-14T10:51:36.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.037+0000 7f19187cc780 1 > prepared operation key=75O00VMLJJ1X tag=I1JJ2KE1T1X3 type=del size=4082643 2024-09-14T10:51:36.037 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.038+0000 7f19187cc780 1 < completed delete operation key=7IWUW2HC3ULI tag=2CGJLRHLSJBZ type=del 2024-09-14T10:51:36.038 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.040+0000 7f19187cc780 1 > prepared operation key=B9FQYIX19AEP tag=KB4J6U9GFPV8 type=del size=3961632 2024-09-14T10:51:36.040 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.041+0000 7f19187cc780 1 < completed delete operation key=9EBD5ZT6MT45 tag=6A3C805IGVV9 type=del 2024-09-14T10:51:36.043 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.044+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~RWG5VB42NUN4.0 size=939333 2024-09-14T10:51:36.043 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.044+0000 7f19187cc780 1 > prepared multipart upload key=XCVE2F2JJK4X upload=RWG5VB42NUN4 tag=LK6J4IA72E4Z type=write size=1987909 2024-09-14T10:51:36.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.047+0000 7f19187cc780 1 < suggested update operation key=9EBD5ZT6MT45 tag=BVEPOTEH66LT type=del size=1767615 2024-09-14T10:51:36.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.050+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~PE79T08J6P28.0 size=341390 2024-09-14T10:51:36.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.050+0000 7f19187cc780 1 > prepared multipart upload key=6BNN842ZTWG5 upload=PE79T08J6P28 tag=99DXP6O8MSUX type=write size=1389966 2024-09-14T10:51:36.050 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.052+0000 7f19187cc780 1 < completed write operation key=61O2VU0SB379 tag=7C25Z4XWOJXZ type=write size=415919 2024-09-14T10:51:36.052 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.053+0000 7f19187cc780 1 > prepared operation key=H40763V7HMBC tag=JNKO85S17TV4 type=del size=2365280 2024-09-14T10:51:36.054 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.055+0000 7f19187cc780 1 < completed part key=_multipart_W1K1IU13J0CZ.2~O2U044K6X9D8.0 size=359121 2024-09-14T10:51:36.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.057+0000 7f19187cc780 1 < completed multipart upload key=W1K1IU13J0CZ upload=O2U044K6X9D8 tag=XLVR13LVXPVL type=write size=1407697 2024-09-14T10:51:36.057 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.059+0000 7f19187cc780 1 > prepared operation key=W1K1IU13J0CZ tag=OREF58PMD6PS type=del size=3406253 2024-09-14T10:51:36.059 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.060+0000 7f19187cc780 1 < completed delete operation key=EL00Y4Z7DTAT tag=ZRBIL7ACVN9B type=del 2024-09-14T10:51:36.061 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.062+0000 7f19187cc780 1 > prepared operation key=W1K1IU13J0CZ tag=VRPY99OU7IPE type=write size=974022 2024-09-14T10:51:36.062 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.064+0000 7f19187cc780 1 < completed part key=_multipart_W1K1IU13J0CZ.2~NQECJQ3ZH4FF.0 size=135770 2024-09-14T10:51:36.064 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.066+0000 7f19187cc780 1 < completed multipart upload key=W1K1IU13J0CZ upload=NQECJQ3ZH4FF tag=OKGR85441KA3 type=write size=1184346 2024-09-14T10:51:36.066 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.067+0000 7f19187cc780 1 > prepared operation key=617QQI921HB4 tag=SEMCA7S2QS44 type=del size=3669279 2024-09-14T10:51:36.067 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.069+0000 7f19187cc780 1 < completed write operation key=INJQTKXHBUV2 tag=D800ZVB67QAI type=write size=757897 2024-09-14T10:51:36.069 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.070+0000 7f19187cc780 1 > prepared operation key=H40763V7HMBC tag=SASAI74WCM34 type=del size=1893277 2024-09-14T10:51:36.070 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.072+0000 7f19187cc780 1 < completed delete operation key=54BSD3DEHNK6 tag=LJIVEUFPU95E type=del 2024-09-14T10:51:36.072 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.074+0000 7f19187cc780 1 > prepared part key=_multipart_RTGE7ISETJWW.2~CFJNZ12ZGFCH.0 size=528125 2024-09-14T10:51:36.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.074+0000 7f19187cc780 1 > prepared multipart upload key=RTGE7ISETJWW upload=CFJNZ12ZGFCH tag=EYHNH9Y4EGNB type=write size=1576701 2024-09-14T10:51:36.074 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.076+0000 7f19187cc780 1 < completed write operation key=B9FQYIX19AEP tag=1AHPND6AXDQK type=write size=65972 2024-09-14T10:51:36.076 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.077+0000 7f19187cc780 1 > prepared operation key=7IWUW2HC3ULI tag=LF5L2U1KC6XO type=del size=2998892 2024-09-14T10:51:36.077 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.079+0000 7f19187cc780 1 < completed delete operation key=EZLSMEK89N2G tag=YD3AZY1EA0ZX type=del 2024-09-14T10:51:36.079 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.080+0000 7f19187cc780 1 > prepared operation key=MFA30GSMCSKP tag=DY9RZ8H3AJGC type=del size=3184831 2024-09-14T10:51:36.080 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.082+0000 7f19187cc780 1 < canceled operation key=6BNN842ZTWG5 tag=HNJQSPDRQCAV type=del size=3260223 2024-09-14T10:51:36.082 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.084+0000 7f19187cc780 1 > prepared operation key=6BNN842ZTWG5 tag=Q9MUEMOHU6RW type=del size=3941840 2024-09-14T10:51:36.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.085+0000 7f19187cc780 1 < completed part key=_multipart_QFEI6H4EQ9ZR.2~85ROZBT2A7DF.0 size=1004256 2024-09-14T10:51:36.086 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.087+0000 7f19187cc780 1 < completed multipart upload key=QFEI6H4EQ9ZR upload=85ROZBT2A7DF tag=F03GSM01V2VZ type=write size=2052832 2024-09-14T10:51:36.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.089+0000 7f19187cc780 1 > prepared operation key=6BNN842ZTWG5 tag=93IMUN7VBFLH type=del size=288713 2024-09-14T10:51:36.089 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.091+0000 7f19187cc780 1 < completed part key=_multipart_EL00Y4Z7DTAT.2~3AN18G2GGUV1.0 size=1048576 2024-09-14T10:51:36.090 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.092+0000 7f19187cc780 1 < completed part key=_multipart_EL00Y4Z7DTAT.2~3AN18G2GGUV1.1 size=986910 2024-09-14T10:51:36.093 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.094+0000 7f19187cc780 1 < completed multipart upload key=EL00Y4Z7DTAT upload=3AN18G2GGUV1 tag=RYVG5FJN1RGK type=write size=3084062 2024-09-14T10:51:36.095 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.097+0000 7f19187cc780 1 > prepared part key=_multipart_YA3DI7N4DG5K.2~241Y8H5QPVB0.0 size=1048576 2024-09-14T10:51:36.097 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.098+0000 7f19187cc780 1 > prepared part key=_multipart_YA3DI7N4DG5K.2~241Y8H5QPVB0.1 size=1048576 2024-09-14T10:51:36.098 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.099+0000 7f19187cc780 1 > prepared part key=_multipart_YA3DI7N4DG5K.2~241Y8H5QPVB0.2 size=514205 2024-09-14T10:51:36.098 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.099+0000 7f19187cc780 1 > prepared multipart upload key=YA3DI7N4DG5K upload=241Y8H5QPVB0 tag=NBVK0PP9RJHI type=write size=3659933 2024-09-14T10:51:36.098 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.100+0000 7f19187cc780 1 < canceled part key=_multipart_INJQTKXHBUV2.2~G3HK18E7Y8VG.0 size=1048576 2024-09-14T10:51:36.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.101+0000 7f19187cc780 1 < completed part key=_multipart_INJQTKXHBUV2.2~G3HK18E7Y8VG.1 size=381475 2024-09-14T10:51:36.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.104+0000 7f19187cc780 1 < canceled multipart upload key=INJQTKXHBUV2 upload=G3HK18E7Y8VG tag=VQ6O4YTVU8W1 type=write size=2478627 2024-09-14T10:51:36.104 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.106+0000 7f19187cc780 1 > prepared part key=_multipart_CADC2BY888V1.2~MS9E698PD86R.0 size=1048576 2024-09-14T10:51:36.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.107+0000 7f19187cc780 1 > prepared part key=_multipart_CADC2BY888V1.2~MS9E698PD86R.1 size=1047664 2024-09-14T10:51:36.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.107+0000 7f19187cc780 1 > prepared multipart upload key=CADC2BY888V1 upload=MS9E698PD86R tag=78MZNBGA0SWS type=write size=3144816 2024-09-14T10:51:36.107 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.109+0000 7f19187cc780 1 < completed delete operation key=75O00VMLJJ1X tag=I1JJ2KE1T1X3 type=del 2024-09-14T10:51:36.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.110+0000 7f19187cc780 1 > prepared operation key=INJQTKXHBUV2 tag=TXHH2N5FLPMD type=del size=2608509 2024-09-14T10:51:36.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.113+0000 7f19187cc780 1 < suggested update operation key=B9FQYIX19AEP tag=KB4J6U9GFPV8 type=del size=3961632 2024-09-14T10:51:36.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.115+0000 7f19187cc780 1 > prepared operation key=W1K1IU13J0CZ tag=X5JQ1X92IK1P type=del size=2946351 2024-09-14T10:51:36.115 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.117+0000 7f19187cc780 1 < completed part key=_multipart_XCVE2F2JJK4X.2~RWG5VB42NUN4.0 size=939333 2024-09-14T10:51:36.117 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.119+0000 7f19187cc780 1 < completed multipart upload key=XCVE2F2JJK4X upload=RWG5VB42NUN4 tag=LK6J4IA72E4Z type=write size=1987909 2024-09-14T10:51:36.120 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.122+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~LE82RM77C57P.0 size=908128 2024-09-14T10:51:36.120 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.122+0000 7f19187cc780 1 > prepared multipart upload key=OVOPGTYUF3F3 upload=LE82RM77C57P tag=FEAOEBYMSH56 type=write size=1956704 2024-09-14T10:51:36.122 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.123+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~PE79T08J6P28.0 size=341390 2024-09-14T10:51:36.124 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.126+0000 7f19187cc780 1 < completed multipart upload key=6BNN842ZTWG5 upload=PE79T08J6P28 tag=99DXP6O8MSUX type=write size=1389966 2024-09-14T10:51:36.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.127+0000 7f19187cc780 1 > prepared operation key=QFEI6H4EQ9ZR tag=OTJLTOZ4H8CU type=del size=2263394 2024-09-14T10:51:36.127 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.129+0000 7f19187cc780 1 < completed delete operation key=H40763V7HMBC tag=JNKO85S17TV4 type=del 2024-09-14T10:51:36.128 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.130+0000 7f19187cc780 1 > prepared operation key=IKVYA4KEALFF tag=Z98Q72WPRO1T type=write size=494680 2024-09-14T10:51:36.130 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.132+0000 7f19187cc780 1 < completed delete operation key=W1K1IU13J0CZ tag=OREF58PMD6PS type=del 2024-09-14T10:51:36.131 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.133+0000 7f19187cc780 1 > prepared operation key=H40763V7HMBC tag=WVZQA6GCUCX5 type=del size=597604 2024-09-14T10:51:36.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.135+0000 7f19187cc780 1 < completed write operation key=W1K1IU13J0CZ tag=VRPY99OU7IPE type=write size=974022 2024-09-14T10:51:36.134 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.136+0000 7f19187cc780 1 > prepared operation key=75O00VMLJJ1X tag=BLXQUDAL3XB2 type=del size=2340806 2024-09-14T10:51:36.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.138+0000 7f19187cc780 1 < completed delete operation key=617QQI921HB4 tag=SEMCA7S2QS44 type=del 2024-09-14T10:51:36.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.139+0000 7f19187cc780 1 > prepared operation key=RTGE7ISETJWW tag=XYX94TH3MNFN type=del size=3368630 2024-09-14T10:51:36.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.141+0000 7f19187cc780 1 < canceled operation key=H40763V7HMBC tag=SASAI74WCM34 type=del size=1893277 2024-09-14T10:51:36.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.142+0000 7f19187cc780 1 > prepared operation key=N0L67LS2KHR1 tag=LNTX56VM0TPL type=del size=482213 2024-09-14T10:51:36.142 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.144+0000 7f19187cc780 1 < completed part key=_multipart_RTGE7ISETJWW.2~CFJNZ12ZGFCH.0 size=528125 2024-09-14T10:51:36.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.146+0000 7f19187cc780 1 < completed multipart upload key=RTGE7ISETJWW upload=CFJNZ12ZGFCH tag=EYHNH9Y4EGNB type=write size=1576701 2024-09-14T10:51:36.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.148+0000 7f19187cc780 1 > prepared operation key=OVOPGTYUF3F3 tag=B89RXRH0CETL type=write size=513714 2024-09-14T10:51:36.148 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.149+0000 7f19187cc780 1 < completed delete operation key=7IWUW2HC3ULI tag=LF5L2U1KC6XO type=del 2024-09-14T10:51:36.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.152+0000 7f19187cc780 1 > prepared part key=_multipart_CADC2BY888V1.2~OTOJM7OUPZ83.0 size=1048576 2024-09-14T10:51:36.152 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.153+0000 7f19187cc780 1 > prepared part key=_multipart_CADC2BY888V1.2~OTOJM7OUPZ83.1 size=1048576 2024-09-14T10:51:36.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.155+0000 7f19187cc780 1 > prepared part key=_multipart_CADC2BY888V1.2~OTOJM7OUPZ83.2 size=438323 2024-09-14T10:51:36.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.155+0000 7f19187cc780 1 > prepared multipart upload key=CADC2BY888V1 upload=OTOJM7OUPZ83 tag=B09E1UTUS2WZ type=write size=3584051 2024-09-14T10:51:36.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.156+0000 7f19187cc780 1 < completed delete operation key=MFA30GSMCSKP tag=DY9RZ8H3AJGC type=del 2024-09-14T10:51:36.156 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.158+0000 7f19187cc780 1 > prepared operation key=H40763V7HMBC tag=0IHHZSIYHFH2 type=del size=1663832 2024-09-14T10:51:36.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.160+0000 7f19187cc780 1 < suggested update operation key=6BNN842ZTWG5 tag=Q9MUEMOHU6RW type=del size=3941840 2024-09-14T10:51:36.160 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.162+0000 7f19187cc780 1 > prepared operation key=VW6U36JN2DBX tag=D85VFW5UGUS3 type=del size=975145 2024-09-14T10:51:36.162 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.163+0000 7f19187cc780 -1 < failed to complete operation key=6BNN842ZTWG5 tag=93IMUN7VBFLH type=del size=288713: (22) Invalid argument 2024-09-14T10:51:36.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.165+0000 7f19187cc780 1 > prepared operation key=KP3WOGIF30PZ tag=P1JR6XJ57LUQ type=del size=2480278 2024-09-14T10:51:36.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.166+0000 7f19187cc780 1 < completed part key=_multipart_YA3DI7N4DG5K.2~241Y8H5QPVB0.0 size=1048576 2024-09-14T10:51:36.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.167+0000 7f19187cc780 1 < completed part key=_multipart_YA3DI7N4DG5K.2~241Y8H5QPVB0.1 size=1048576 2024-09-14T10:51:36.167 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.169+0000 7f19187cc780 1 < completed part key=_multipart_YA3DI7N4DG5K.2~241Y8H5QPVB0.2 size=514205 2024-09-14T10:51:36.169 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.171+0000 7f19187cc780 1 < completed multipart upload key=YA3DI7N4DG5K upload=241Y8H5QPVB0 tag=NBVK0PP9RJHI type=write size=3659933 2024-09-14T10:51:36.172 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.173+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~0U96X5UZT76W.0 size=1048576 2024-09-14T10:51:36.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.175+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~0U96X5UZT76W.1 size=1048576 2024-09-14T10:51:36.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.176+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~0U96X5UZT76W.2 size=814816 2024-09-14T10:51:36.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.176+0000 7f19187cc780 1 > prepared multipart upload key=KOJ7QB7M6A35 upload=0U96X5UZT76W tag=53PGK1L7HU2L type=write size=3960544 2024-09-14T10:51:36.177 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.178+0000 7f19187cc780 1 < completed part key=_multipart_CADC2BY888V1.2~MS9E698PD86R.0 size=1048576 2024-09-14T10:51:36.178 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.179+0000 7f19187cc780 1 < completed part key=_multipart_CADC2BY888V1.2~MS9E698PD86R.1 size=1047664 2024-09-14T10:51:36.180 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.182+0000 7f19187cc780 1 < completed multipart upload key=CADC2BY888V1 upload=MS9E698PD86R tag=78MZNBGA0SWS type=write size=3144816 2024-09-14T10:51:36.183 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.185+0000 7f19187cc780 1 > prepared part key=_multipart_75O00VMLJJ1X.2~U234VBH8KQSG.0 size=1048576 2024-09-14T10:51:36.184 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.186+0000 7f19187cc780 1 > prepared part key=_multipart_75O00VMLJJ1X.2~U234VBH8KQSG.1 size=852157 2024-09-14T10:51:36.184 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.186+0000 7f19187cc780 1 > prepared multipart upload key=75O00VMLJJ1X upload=U234VBH8KQSG tag=0BJH1BBQW2EL type=write size=2949309 2024-09-14T10:51:36.185 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.187+0000 7f19187cc780 1 < canceled operation key=INJQTKXHBUV2 tag=TXHH2N5FLPMD type=del size=2608509 2024-09-14T10:51:36.187 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.189+0000 7f19187cc780 1 > prepared operation key=INJQTKXHBUV2 tag=5GF4OBWE621I type=del size=4067772 2024-09-14T10:51:36.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.192+0000 7f19187cc780 1 < suggested update operation key=W1K1IU13J0CZ tag=X5JQ1X92IK1P type=del size=2946351 2024-09-14T10:51:36.193 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.195+0000 7f19187cc780 1 > prepared part key=_multipart_54BSD3DEHNK6.2~3GGJD08ULQ2T.0 size=1048576 2024-09-14T10:51:36.194 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.196+0000 7f19187cc780 1 > prepared part key=_multipart_54BSD3DEHNK6.2~3GGJD08ULQ2T.1 size=251413 2024-09-14T10:51:36.194 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.196+0000 7f19187cc780 1 > prepared multipart upload key=54BSD3DEHNK6 upload=3GGJD08ULQ2T tag=0K464OBTG3CZ type=write size=2348565 2024-09-14T10:51:36.195 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.197+0000 7f19187cc780 1 < completed part key=_multipart_OVOPGTYUF3F3.2~LE82RM77C57P.0 size=908128 2024-09-14T10:51:36.198 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.200+0000 7f19187cc780 1 < completed multipart upload key=OVOPGTYUF3F3 upload=LE82RM77C57P tag=FEAOEBYMSH56 type=write size=1956704 2024-09-14T10:51:36.200 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.202+0000 7f19187cc780 1 > prepared part key=_multipart_INJQTKXHBUV2.2~0ZQV5TPBKHB3.0 size=1048576 2024-09-14T10:51:36.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.203+0000 7f19187cc780 1 > prepared part key=_multipart_INJQTKXHBUV2.2~0ZQV5TPBKHB3.1 size=1014888 2024-09-14T10:51:36.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.203+0000 7f19187cc780 1 > prepared multipart upload key=INJQTKXHBUV2 upload=0ZQV5TPBKHB3 tag=T2C0QCNJEJII type=write size=3112040 2024-09-14T10:51:36.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.205+0000 7f19187cc780 1 < completed delete operation key=QFEI6H4EQ9ZR tag=OTJLTOZ4H8CU type=del 2024-09-14T10:51:36.204 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.206+0000 7f19187cc780 1 > prepared operation key=QFEI6H4EQ9ZR tag=6HW7WBM6G36V type=del size=1221567 2024-09-14T10:51:36.206 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.208+0000 7f19187cc780 1 < completed write operation key=IKVYA4KEALFF tag=Z98Q72WPRO1T type=write size=494680 2024-09-14T10:51:36.207 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.209+0000 7f19187cc780 1 > prepared operation key=AST81B9QWORT tag=RJMYOQ73EEET type=del size=177351 2024-09-14T10:51:36.210 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.212+0000 7f19187cc780 1 < suggested remove operation key=H40763V7HMBC tag=WVZQA6GCUCX5 type=del 2024-09-14T10:51:36.211 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.213+0000 7f19187cc780 1 > prepared operation key=YA3DI7N4DG5K tag=UVYHZC8L1O2E type=del size=1894216 2024-09-14T10:51:36.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.215+0000 7f19187cc780 1 < completed delete operation key=75O00VMLJJ1X tag=BLXQUDAL3XB2 type=del 2024-09-14T10:51:36.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.216+0000 7f19187cc780 1 > prepared operation key=75O00VMLJJ1X tag=UAW1NSSC7A2E type=del size=2060590 2024-09-14T10:51:36.216 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.218+0000 7f19187cc780 1 < completed delete operation key=RTGE7ISETJWW tag=XYX94TH3MNFN type=del 2024-09-14T10:51:36.219 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.220+0000 7f19187cc780 1 > prepared part key=_multipart_MFA30GSMCSKP.2~B6XPS868CZYY.0 size=1048576 2024-09-14T10:51:36.220 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.221+0000 7f19187cc780 1 > prepared part key=_multipart_MFA30GSMCSKP.2~B6XPS868CZYY.1 size=1048576 2024-09-14T10:51:36.221 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.222+0000 7f19187cc780 1 > prepared part key=_multipart_MFA30GSMCSKP.2~B6XPS868CZYY.2 size=888441 2024-09-14T10:51:36.221 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.222+0000 7f19187cc780 1 > prepared multipart upload key=MFA30GSMCSKP upload=B6XPS868CZYY tag=EXDXQJU953HB type=write size=4034169 2024-09-14T10:51:36.224 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.225+0000 7f19187cc780 1 < completed delete operation key=N0L67LS2KHR1 tag=LNTX56VM0TPL type=del 2024-09-14T10:51:36.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.229+0000 7f19187cc780 1 > prepared part key=_multipart_INJQTKXHBUV2.2~6A47JHTID4O7.0 size=1048576 2024-09-14T10:51:36.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.230+0000 7f19187cc780 1 > prepared part key=_multipart_INJQTKXHBUV2.2~6A47JHTID4O7.1 size=555686 2024-09-14T10:51:36.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.230+0000 7f19187cc780 1 > prepared multipart upload key=INJQTKXHBUV2 upload=6A47JHTID4O7 tag=HAGH0EYUTR8A type=write size=2652838 2024-09-14T10:51:36.230 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.232+0000 7f19187cc780 1 < completed write operation key=OVOPGTYUF3F3 tag=B89RXRH0CETL type=write size=513714 2024-09-14T10:51:36.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.233+0000 7f19187cc780 1 > prepared operation key=RTGE7ISETJWW tag=WA6ANSPFOS9V type=del size=2815803 2024-09-14T10:51:36.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.235+0000 7f19187cc780 1 < completed part key=_multipart_CADC2BY888V1.2~OTOJM7OUPZ83.0 size=1048576 2024-09-14T10:51:36.234 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.236+0000 7f19187cc780 1 < completed part key=_multipart_CADC2BY888V1.2~OTOJM7OUPZ83.1 size=1048576 2024-09-14T10:51:36.236 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.237+0000 7f19187cc780 1 < completed part key=_multipart_CADC2BY888V1.2~OTOJM7OUPZ83.2 size=438323 2024-09-14T10:51:36.238 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.240+0000 7f19187cc780 1 < completed multipart upload key=CADC2BY888V1 upload=OTOJM7OUPZ83 tag=B09E1UTUS2WZ type=write size=3584051 2024-09-14T10:51:36.241 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.243+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~GX4ABB4F0H59.0 size=952482 2024-09-14T10:51:36.241 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.243+0000 7f19187cc780 1 > prepared multipart upload key=KP3WOGIF30PZ upload=GX4ABB4F0H59 tag=QS15I0NY1Q6J type=write size=2001058 2024-09-14T10:51:36.243 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.244+0000 7f19187cc780 -1 < failed to complete operation key=H40763V7HMBC tag=0IHHZSIYHFH2 type=del size=1663832: (22) Invalid argument 2024-09-14T10:51:36.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.246+0000 7f19187cc780 1 > prepared operation key=YA3DI7N4DG5K tag=HZMWK1TGNPAL type=del size=711550 2024-09-14T10:51:36.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.247+0000 7f19187cc780 1 < completed delete operation key=VW6U36JN2DBX tag=D85VFW5UGUS3 type=del 2024-09-14T10:51:36.248 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.249+0000 7f19187cc780 1 > prepared operation key=IKVYA4KEALFF tag=1OIQ92ZEGIKH type=del size=1086872 2024-09-14T10:51:36.249 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.251+0000 7f19187cc780 1 < completed delete operation key=KP3WOGIF30PZ tag=P1JR6XJ57LUQ type=del 2024-09-14T10:51:36.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.252+0000 7f19187cc780 1 > prepared operation key=INJQTKXHBUV2 tag=DSWTE45X6TWR type=del size=2618078 2024-09-14T10:51:36.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.254+0000 7f19187cc780 1 < completed part key=_multipart_KOJ7QB7M6A35.2~0U96X5UZT76W.0 size=1048576 2024-09-14T10:51:36.254 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.255+0000 7f19187cc780 1 < completed part key=_multipart_KOJ7QB7M6A35.2~0U96X5UZT76W.1 size=1048576 2024-09-14T10:51:36.257 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.258+0000 7f19187cc780 1 < completed part key=_multipart_KOJ7QB7M6A35.2~0U96X5UZT76W.2 size=814816 2024-09-14T10:51:36.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.261+0000 7f19187cc780 1 < completed multipart upload key=KOJ7QB7M6A35 upload=0U96X5UZT76W tag=53PGK1L7HU2L type=write size=3960544 2024-09-14T10:51:36.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.264+0000 7f19187cc780 1 > prepared part key=_multipart_E6UO1LUWOC44.2~HU7I9LT1JQVE.0 size=1048576 2024-09-14T10:51:36.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.265+0000 7f19187cc780 1 > prepared part key=_multipart_E6UO1LUWOC44.2~HU7I9LT1JQVE.1 size=1048576 2024-09-14T10:51:36.264 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.266+0000 7f19187cc780 1 > prepared part key=_multipart_E6UO1LUWOC44.2~HU7I9LT1JQVE.2 size=670167 2024-09-14T10:51:36.264 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.266+0000 7f19187cc780 1 > prepared multipart upload key=E6UO1LUWOC44 upload=HU7I9LT1JQVE tag=JIDXXGT43JPS type=write size=3815895 2024-09-14T10:51:36.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.267+0000 7f19187cc780 1 < completed part key=_multipart_75O00VMLJJ1X.2~U234VBH8KQSG.0 size=1048576 2024-09-14T10:51:36.267 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.268+0000 7f19187cc780 1 < completed part key=_multipart_75O00VMLJJ1X.2~U234VBH8KQSG.1 size=852157 2024-09-14T10:51:36.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.272+0000 7f19187cc780 1 < completed multipart upload key=75O00VMLJJ1X upload=U234VBH8KQSG tag=0BJH1BBQW2EL type=write size=2949309 2024-09-14T10:51:36.272 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.274+0000 7f19187cc780 1 > prepared operation key=INJQTKXHBUV2 tag=NKEDDD710Y22 type=del size=1096692 2024-09-14T10:51:36.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.275+0000 7f19187cc780 1 < completed delete operation key=INJQTKXHBUV2 tag=5GF4OBWE621I type=del 2024-09-14T10:51:36.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.276+0000 7f19187cc780 1 > prepared operation key=QBMNYNWOLK4I tag=E11FEOK7ZIXN type=write size=667817 2024-09-14T10:51:36.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.278+0000 7f19187cc780 1 < completed part key=_multipart_54BSD3DEHNK6.2~3GGJD08ULQ2T.0 size=1048576 2024-09-14T10:51:36.277 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.279+0000 7f19187cc780 1 < completed part key=_multipart_54BSD3DEHNK6.2~3GGJD08ULQ2T.1 size=251413 2024-09-14T10:51:36.279 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.281+0000 7f19187cc780 1 < completed multipart upload key=54BSD3DEHNK6 upload=3GGJD08ULQ2T tag=0K464OBTG3CZ type=write size=2348565 2024-09-14T10:51:36.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.283+0000 7f19187cc780 1 > prepared part key=_multipart_9EBD5ZT6MT45.2~D07KT1ARJXHB.0 size=1048576 2024-09-14T10:51:36.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.285+0000 7f19187cc780 1 > prepared part key=_multipart_9EBD5ZT6MT45.2~D07KT1ARJXHB.1 size=1048576 2024-09-14T10:51:36.284 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.286+0000 7f19187cc780 1 > prepared part key=_multipart_9EBD5ZT6MT45.2~D07KT1ARJXHB.2 size=729271 2024-09-14T10:51:36.284 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.286+0000 7f19187cc780 1 > prepared multipart upload key=9EBD5ZT6MT45 upload=D07KT1ARJXHB tag=2VO923489J91 type=write size=3874999 2024-09-14T10:51:36.286 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.287+0000 7f19187cc780 1 < completed part key=_multipart_INJQTKXHBUV2.2~0ZQV5TPBKHB3.0 size=1048576 2024-09-14T10:51:36.287 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.288+0000 7f19187cc780 1 < completed part key=_multipart_INJQTKXHBUV2.2~0ZQV5TPBKHB3.1 size=1014888 2024-09-14T10:51:36.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.291+0000 7f19187cc780 1 < completed multipart upload key=INJQTKXHBUV2 upload=0ZQV5TPBKHB3 tag=T2C0QCNJEJII type=write size=3112040 2024-09-14T10:51:36.292 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.294+0000 7f19187cc780 1 > prepared part key=_multipart_54BSD3DEHNK6.2~3Z4QVQT5WUTH.0 size=567977 2024-09-14T10:51:36.292 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.294+0000 7f19187cc780 1 > prepared multipart upload key=54BSD3DEHNK6 upload=3Z4QVQT5WUTH tag=IV3D6WL2YF3J type=write size=1616553 2024-09-14T10:51:36.294 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.295+0000 7f19187cc780 1 < canceled operation key=QFEI6H4EQ9ZR tag=6HW7WBM6G36V type=del size=1221567 2024-09-14T10:51:36.296 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.298+0000 7f19187cc780 1 > prepared part key=_multipart_YA3DI7N4DG5K.2~S8J5K18BFK4N.0 size=1048576 2024-09-14T10:51:36.297 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.299+0000 7f19187cc780 1 > prepared part key=_multipart_YA3DI7N4DG5K.2~S8J5K18BFK4N.1 size=1048576 2024-09-14T10:51:36.299 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.300+0000 7f19187cc780 1 > prepared part key=_multipart_YA3DI7N4DG5K.2~S8J5K18BFK4N.2 size=867388 2024-09-14T10:51:36.299 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.300+0000 7f19187cc780 1 > prepared multipart upload key=YA3DI7N4DG5K upload=S8J5K18BFK4N tag=TG0Y7EDZE3RI type=write size=4013116 2024-09-14T10:51:36.300 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.302+0000 7f19187cc780 1 < completed delete operation key=AST81B9QWORT tag=RJMYOQ73EEET type=del 2024-09-14T10:51:36.302 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.303+0000 7f19187cc780 1 > prepared operation key=EZLSMEK89N2G tag=VBRF70B0AKA3 type=del size=1616431 2024-09-14T10:51:36.303 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.305+0000 7f19187cc780 1 < completed delete operation key=YA3DI7N4DG5K tag=UVYHZC8L1O2E type=del 2024-09-14T10:51:36.305 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.306+0000 7f19187cc780 1 > prepared operation key=W1K1IU13J0CZ tag=T4LXBM9TB6S1 type=del size=946339 2024-09-14T10:51:36.306 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.308+0000 7f19187cc780 1 < completed delete operation key=75O00VMLJJ1X tag=UAW1NSSC7A2E type=del 2024-09-14T10:51:36.309 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.311+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~VQWHDZUOKET6.0 size=1048576 2024-09-14T10:51:36.310 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.312+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~VQWHDZUOKET6.1 size=1048576 2024-09-14T10:51:36.311 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.313+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~VQWHDZUOKET6.2 size=968847 2024-09-14T10:51:36.311 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.313+0000 7f19187cc780 1 > prepared multipart upload key=XCVE2F2JJK4X upload=VQWHDZUOKET6 tag=HUX136QAUDSY type=write size=4114575 2024-09-14T10:51:36.313 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.315+0000 7f19187cc780 1 < completed part key=_multipart_MFA30GSMCSKP.2~B6XPS868CZYY.0 size=1048576 2024-09-14T10:51:36.314 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.316+0000 7f19187cc780 1 < completed part key=_multipart_MFA30GSMCSKP.2~B6XPS868CZYY.1 size=1048576 2024-09-14T10:51:36.315 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.317+0000 7f19187cc780 1 < completed part key=_multipart_MFA30GSMCSKP.2~B6XPS868CZYY.2 size=888441 2024-09-14T10:51:36.317 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.319+0000 7f19187cc780 1 < completed multipart upload key=MFA30GSMCSKP upload=B6XPS868CZYY tag=EXDXQJU953HB type=write size=4034169 2024-09-14T10:51:36.319 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.321+0000 7f19187cc780 1 > prepared operation key=YA3DI7N4DG5K tag=EZOGNQMXJDOG type=del size=153942 2024-09-14T10:51:36.321 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.322+0000 7f19187cc780 1 < completed part key=_multipart_INJQTKXHBUV2.2~6A47JHTID4O7.0 size=1048576 2024-09-14T10:51:36.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.323+0000 7f19187cc780 1 < completed part key=_multipart_INJQTKXHBUV2.2~6A47JHTID4O7.1 size=555686 2024-09-14T10:51:36.324 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.326+0000 7f19187cc780 1 < completed multipart upload key=INJQTKXHBUV2 upload=6A47JHTID4O7 tag=HAGH0EYUTR8A type=write size=2652838 2024-09-14T10:51:36.326 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.327+0000 7f19187cc780 1 > prepared operation key=VW6U36JN2DBX tag=YJUVV27G7NTS type=del size=26258 2024-09-14T10:51:36.327 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.329+0000 7f19187cc780 1 < canceled operation key=RTGE7ISETJWW tag=WA6ANSPFOS9V type=del size=2815803 2024-09-14T10:51:36.330 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.332+0000 7f19187cc780 1 > prepared part key=_multipart_CADC2BY888V1.2~ZD5V6CA5QMP4.0 size=1048576 2024-09-14T10:51:36.331 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.333+0000 7f19187cc780 1 > prepared part key=_multipart_CADC2BY888V1.2~ZD5V6CA5QMP4.1 size=94462 2024-09-14T10:51:36.331 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.333+0000 7f19187cc780 1 > prepared multipart upload key=CADC2BY888V1 upload=ZD5V6CA5QMP4 tag=IC7DUGITTIS6 type=write size=2191614 2024-09-14T10:51:36.333 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.334+0000 7f19187cc780 1 < completed part key=_multipart_KP3WOGIF30PZ.2~GX4ABB4F0H59.0 size=952482 2024-09-14T10:51:36.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.337+0000 7f19187cc780 1 < completed multipart upload key=KP3WOGIF30PZ upload=GX4ABB4F0H59 tag=QS15I0NY1Q6J type=write size=2001058 2024-09-14T10:51:36.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.338+0000 7f19187cc780 1 > prepared operation key=AGNUE76X8XCJ tag=NLIRYCCGMMJ3 type=del size=2791234 2024-09-14T10:51:36.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.339+0000 7f19187cc780 1 < completed delete operation key=YA3DI7N4DG5K tag=HZMWK1TGNPAL type=del 2024-09-14T10:51:36.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.342+0000 7f19187cc780 1 > prepared part key=_multipart_YA3DI7N4DG5K.2~TX6OYOFO3CKZ.0 size=1048576 2024-09-14T10:51:36.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.343+0000 7f19187cc780 1 > prepared part key=_multipart_YA3DI7N4DG5K.2~TX6OYOFO3CKZ.1 size=1048576 2024-09-14T10:51:36.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.345+0000 7f19187cc780 1 > prepared part key=_multipart_YA3DI7N4DG5K.2~TX6OYOFO3CKZ.2 size=270278 2024-09-14T10:51:36.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.345+0000 7f19187cc780 1 > prepared multipart upload key=YA3DI7N4DG5K upload=TX6OYOFO3CKZ tag=FP1YSP09AGBR type=write size=3416006 2024-09-14T10:51:36.344 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.346+0000 7f19187cc780 1 < completed delete operation key=IKVYA4KEALFF tag=1OIQ92ZEGIKH type=del 2024-09-14T10:51:36.346 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.348+0000 7f19187cc780 1 > prepared operation key=5AIAYJMRZGFQ tag=PZ6IU7XGFOL7 type=del size=1610827 2024-09-14T10:51:36.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.351+0000 7f19187cc780 1 < suggested update operation key=INJQTKXHBUV2 tag=DSWTE45X6TWR type=del size=2618078 2024-09-14T10:51:36.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.352+0000 7f19187cc780 1 > prepared operation key=INJQTKXHBUV2 tag=8AFF2785PZ3L type=del size=3414330 2024-09-14T10:51:36.352 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.354+0000 7f19187cc780 1 < completed part key=_multipart_E6UO1LUWOC44.2~HU7I9LT1JQVE.0 size=1048576 2024-09-14T10:51:36.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.355+0000 7f19187cc780 1 < completed part key=_multipart_E6UO1LUWOC44.2~HU7I9LT1JQVE.1 size=1048576 2024-09-14T10:51:36.355 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.356+0000 7f19187cc780 1 < completed part key=_multipart_E6UO1LUWOC44.2~HU7I9LT1JQVE.2 size=670167 2024-09-14T10:51:36.357 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.359+0000 7f19187cc780 1 < completed multipart upload key=E6UO1LUWOC44 upload=HU7I9LT1JQVE tag=JIDXXGT43JPS type=write size=3815895 2024-09-14T10:51:36.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.361+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~RH36QAJHBBUX.0 size=1048576 2024-09-14T10:51:36.361 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.362+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~RH36QAJHBBUX.1 size=153614 2024-09-14T10:51:36.361 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.362+0000 7f19187cc780 1 > prepared multipart upload key=IKVYA4KEALFF upload=RH36QAJHBBUX tag=IAWTUAQDISC0 type=write size=2250766 2024-09-14T10:51:36.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.364+0000 7f19187cc780 -1 < failed to complete operation key=INJQTKXHBUV2 tag=NKEDDD710Y22 type=del size=1096692: (22) Invalid argument 2024-09-14T10:51:36.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.366+0000 7f19187cc780 1 > prepared operation key=H40763V7HMBC tag=SLYZ61DI10QU type=del size=684511 2024-09-14T10:51:36.366 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.367+0000 7f19187cc780 1 < completed write operation key=QBMNYNWOLK4I tag=E11FEOK7ZIXN type=write size=667817 2024-09-14T10:51:36.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.369+0000 7f19187cc780 1 > prepared operation key=QFEI6H4EQ9ZR tag=O0SU46VU81PJ type=del size=2386382 2024-09-14T10:51:36.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.371+0000 7f19187cc780 1 < completed part key=_multipart_9EBD5ZT6MT45.2~D07KT1ARJXHB.0 size=1048576 2024-09-14T10:51:36.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.372+0000 7f19187cc780 1 < completed part key=_multipart_9EBD5ZT6MT45.2~D07KT1ARJXHB.1 size=1048576 2024-09-14T10:51:36.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.372+0000 7f19187cc780 1 < canceled part key=_multipart_9EBD5ZT6MT45.2~D07KT1ARJXHB.2 size=729271 2024-09-14T10:51:36.372 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.374+0000 7f19187cc780 1 < canceled multipart upload key=9EBD5ZT6MT45 upload=D07KT1ARJXHB tag=2VO923489J91 type=write size=3874999 2024-09-14T10:51:36.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.376+0000 7f19187cc780 1 > prepared operation key=XCVE2F2JJK4X tag=MGOG28GIZ6PW type=del size=1262941 2024-09-14T10:51:36.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.377+0000 7f19187cc780 1 < completed part key=_multipart_54BSD3DEHNK6.2~3Z4QVQT5WUTH.0 size=567977 2024-09-14T10:51:36.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.380+0000 7f19187cc780 1 < completed multipart upload key=54BSD3DEHNK6 upload=3Z4QVQT5WUTH tag=IV3D6WL2YF3J type=write size=1616553 2024-09-14T10:51:36.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.382+0000 7f19187cc780 1 > prepared part key=_multipart_19P3WE6HKJH2.2~O5J7366J7Y81.0 size=515979 2024-09-14T10:51:36.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.382+0000 7f19187cc780 1 > prepared multipart upload key=19P3WE6HKJH2 upload=O5J7366J7Y81 tag=Z4R1PTH0TI9K type=write size=1564555 2024-09-14T10:51:36.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.383+0000 7f19187cc780 1 < canceled part key=_multipart_YA3DI7N4DG5K.2~S8J5K18BFK4N.0 size=1048576 2024-09-14T10:51:36.382 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.384+0000 7f19187cc780 1 < completed part key=_multipart_YA3DI7N4DG5K.2~S8J5K18BFK4N.1 size=1048576 2024-09-14T10:51:36.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.385+0000 7f19187cc780 1 < completed part key=_multipart_YA3DI7N4DG5K.2~S8J5K18BFK4N.2 size=867388 2024-09-14T10:51:36.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.388+0000 7f19187cc780 1 < canceled multipart upload key=YA3DI7N4DG5K upload=S8J5K18BFK4N tag=TG0Y7EDZE3RI type=write size=4013116 2024-09-14T10:51:36.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.390+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~602H37DFYVMS.0 size=578951 2024-09-14T10:51:36.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.390+0000 7f19187cc780 1 > prepared multipart upload key=IKVYA4KEALFF upload=602H37DFYVMS tag=Y488HLNWLST1 type=write size=1627527 2024-09-14T10:51:36.390 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.392+0000 7f19187cc780 1 < completed delete operation key=EZLSMEK89N2G tag=VBRF70B0AKA3 type=del 2024-09-14T10:51:36.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.395+0000 7f19187cc780 1 > prepared operation key=75O00VMLJJ1X tag=93V5C6JJ9YBN type=del size=3854129 2024-09-14T10:51:36.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.396+0000 7f19187cc780 1 < completed delete operation key=W1K1IU13J0CZ tag=T4LXBM9TB6S1 type=del 2024-09-14T10:51:36.397 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.399+0000 7f19187cc780 1 > prepared part key=_multipart_E6UO1LUWOC44.2~UWXED9V3PRNW.0 size=237747 2024-09-14T10:51:36.397 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.399+0000 7f19187cc780 1 > prepared multipart upload key=E6UO1LUWOC44 upload=UWXED9V3PRNW tag=SI9PCCC81ZN6 type=write size=1286323 2024-09-14T10:51:36.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.401+0000 7f19187cc780 1 < completed part key=_multipart_XCVE2F2JJK4X.2~VQWHDZUOKET6.0 size=1048576 2024-09-14T10:51:36.400 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.402+0000 7f19187cc780 1 < completed part key=_multipart_XCVE2F2JJK4X.2~VQWHDZUOKET6.1 size=1048576 2024-09-14T10:51:36.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.403+0000 7f19187cc780 1 < completed part key=_multipart_XCVE2F2JJK4X.2~VQWHDZUOKET6.2 size=968847 2024-09-14T10:51:36.404 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.405+0000 7f19187cc780 1 < completed multipart upload key=XCVE2F2JJK4X upload=VQWHDZUOKET6 tag=HUX136QAUDSY type=write size=4114575 2024-09-14T10:51:36.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.407+0000 7f19187cc780 1 > prepared operation key=54BSD3DEHNK6 tag=9X62APVLN27B type=del size=3683599 2024-09-14T10:51:36.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.408+0000 7f19187cc780 1 < completed delete operation key=YA3DI7N4DG5K tag=EZOGNQMXJDOG type=del 2024-09-14T10:51:36.409 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.411+0000 7f19187cc780 1 > prepared part key=_multipart_W1K1IU13J0CZ.2~FQ3WSHTZF7UY.0 size=1048576 2024-09-14T10:51:36.410 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.412+0000 7f19187cc780 1 > prepared part key=_multipart_W1K1IU13J0CZ.2~FQ3WSHTZF7UY.1 size=1048576 2024-09-14T10:51:36.411 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.413+0000 7f19187cc780 1 > prepared part key=_multipart_W1K1IU13J0CZ.2~FQ3WSHTZF7UY.2 size=874931 2024-09-14T10:51:36.411 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.413+0000 7f19187cc780 1 > prepared multipart upload key=W1K1IU13J0CZ upload=FQ3WSHTZF7UY tag=YQ74KV1TOMBX type=write size=4020659 2024-09-14T10:51:36.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.414+0000 7f19187cc780 1 < completed delete operation key=VW6U36JN2DBX tag=YJUVV27G7NTS type=del 2024-09-14T10:51:36.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.416+0000 7f19187cc780 1 > prepared operation key=EZLSMEK89N2G tag=YMTDZNJIR4W2 type=del size=2161827 2024-09-14T10:51:36.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.418+0000 7f19187cc780 1 < completed part key=_multipart_CADC2BY888V1.2~ZD5V6CA5QMP4.0 size=1048576 2024-09-14T10:51:36.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.419+0000 7f19187cc780 1 < completed part key=_multipart_CADC2BY888V1.2~ZD5V6CA5QMP4.1 size=94462 2024-09-14T10:51:36.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.421+0000 7f19187cc780 1 < completed multipart upload key=CADC2BY888V1 upload=ZD5V6CA5QMP4 tag=IC7DUGITTIS6 type=write size=2191614 2024-09-14T10:51:36.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.424+0000 7f19187cc780 1 > prepared part key=_multipart_QBMNYNWOLK4I.2~RK8DN2UDY0G9.0 size=1048576 2024-09-14T10:51:36.423 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.425+0000 7f19187cc780 1 > prepared part key=_multipart_QBMNYNWOLK4I.2~RK8DN2UDY0G9.1 size=19898 2024-09-14T10:51:36.424 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.425+0000 7f19187cc780 1 > prepared multipart upload key=QBMNYNWOLK4I upload=RK8DN2UDY0G9 tag=0GTHNZKQHFTW type=write size=2117050 2024-09-14T10:51:36.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.427+0000 7f19187cc780 1 < completed delete operation key=AGNUE76X8XCJ tag=NLIRYCCGMMJ3 type=del 2024-09-14T10:51:36.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.428+0000 7f19187cc780 1 > prepared operation key=CADC2BY888V1 tag=F2W3I77D2FJE type=write size=879654 2024-09-14T10:51:36.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.430+0000 7f19187cc780 1 < completed part key=_multipart_YA3DI7N4DG5K.2~TX6OYOFO3CKZ.0 size=1048576 2024-09-14T10:51:36.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.430+0000 7f19187cc780 1 < canceled part key=_multipart_YA3DI7N4DG5K.2~TX6OYOFO3CKZ.1 size=1048576 2024-09-14T10:51:36.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.431+0000 7f19187cc780 1 < completed part key=_multipart_YA3DI7N4DG5K.2~TX6OYOFO3CKZ.2 size=270278 2024-09-14T10:51:36.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.433+0000 7f19187cc780 1 < canceled multipart upload key=YA3DI7N4DG5K upload=TX6OYOFO3CKZ tag=FP1YSP09AGBR type=write size=3416006 2024-09-14T10:51:36.434 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.436+0000 7f19187cc780 1 > prepared part key=_multipart_5AIAYJMRZGFQ.2~4CKJ8KJ3BOBQ.0 size=1048576 2024-09-14T10:51:36.435 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.437+0000 7f19187cc780 1 > prepared part key=_multipart_5AIAYJMRZGFQ.2~4CKJ8KJ3BOBQ.1 size=202802 2024-09-14T10:51:36.435 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.437+0000 7f19187cc780 1 > prepared multipart upload key=5AIAYJMRZGFQ upload=4CKJ8KJ3BOBQ tag=D4HHZW96VJ7B type=write size=2299954 2024-09-14T10:51:36.438 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.439+0000 7f19187cc780 1 < suggested update operation key=5AIAYJMRZGFQ tag=PZ6IU7XGFOL7 type=del size=1610827 2024-09-14T10:51:36.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.441+0000 7f19187cc780 1 > prepared operation key=E6UO1LUWOC44 tag=4CY8N03A188X type=del size=4185217 2024-09-14T10:51:36.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.442+0000 7f19187cc780 1 < completed delete operation key=INJQTKXHBUV2 tag=8AFF2785PZ3L type=del 2024-09-14T10:51:36.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.444+0000 7f19187cc780 1 > prepared operation key=B9FQYIX19AEP tag=HAFROEKE8AY6 type=del size=3719334 2024-09-14T10:51:36.444 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.445+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~RH36QAJHBBUX.0 size=1048576 2024-09-14T10:51:36.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.446+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~RH36QAJHBBUX.1 size=153614 2024-09-14T10:51:36.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.449+0000 7f19187cc780 1 < completed multipart upload key=IKVYA4KEALFF upload=RH36QAJHBBUX tag=IAWTUAQDISC0 type=write size=2250766 2024-09-14T10:51:36.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.451+0000 7f19187cc780 1 > prepared part key=_multipart_INJQTKXHBUV2.2~C6W72XYVJCER.0 size=1048576 2024-09-14T10:51:36.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.453+0000 7f19187cc780 1 > prepared part key=_multipart_INJQTKXHBUV2.2~C6W72XYVJCER.1 size=1046960 2024-09-14T10:51:36.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.453+0000 7f19187cc780 1 > prepared multipart upload key=INJQTKXHBUV2 upload=C6W72XYVJCER tag=O1EQERHTSQH7 type=write size=3144112 2024-09-14T10:51:36.454 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.455+0000 7f19187cc780 1 < suggested update operation key=H40763V7HMBC tag=SLYZ61DI10QU type=del size=684511 2024-09-14T10:51:36.455 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.457+0000 7f19187cc780 1 > prepared operation key=75O00VMLJJ1X tag=RJLFPDDA3RGR type=write size=924843 2024-09-14T10:51:36.456 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.458+0000 7f19187cc780 1 < completed delete operation key=QFEI6H4EQ9ZR tag=O0SU46VU81PJ type=del 2024-09-14T10:51:36.458 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.460+0000 7f19187cc780 1 > prepared operation key=CADC2BY888V1 tag=NT975A4P62IU type=del size=1028294 2024-09-14T10:51:36.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.461+0000 7f19187cc780 1 < completed delete operation key=XCVE2F2JJK4X tag=MGOG28GIZ6PW type=del 2024-09-14T10:51:36.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.463+0000 7f19187cc780 1 > prepared operation key=MFA30GSMCSKP tag=90GCCIF6ARTB type=del size=1728866 2024-09-14T10:51:36.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.464+0000 7f19187cc780 1 < completed part key=_multipart_19P3WE6HKJH2.2~O5J7366J7Y81.0 size=515979 2024-09-14T10:51:36.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.467+0000 7f19187cc780 1 < completed multipart upload key=19P3WE6HKJH2 upload=O5J7366J7Y81 tag=Z4R1PTH0TI9K type=write size=1564555 2024-09-14T10:51:36.467 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.468+0000 7f19187cc780 1 > prepared operation key=EL00Y4Z7DTAT tag=8RPFO8RK4MXJ type=write size=76880 2024-09-14T10:51:36.468 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.470+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~602H37DFYVMS.0 size=578951 2024-09-14T10:51:36.470 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.472+0000 7f19187cc780 1 < completed multipart upload key=IKVYA4KEALFF upload=602H37DFYVMS tag=Y488HLNWLST1 type=write size=1627527 2024-09-14T10:51:36.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.475+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~HBRK9QW1X1MK.0 size=1048576 2024-09-14T10:51:36.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.476+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~HBRK9QW1X1MK.1 size=106302 2024-09-14T10:51:36.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.476+0000 7f19187cc780 1 > prepared multipart upload key=VW6U36JN2DBX upload=HBRK9QW1X1MK tag=MTBO5K0UM9LY type=write size=2203454 2024-09-14T10:51:36.477 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.479+0000 7f19187cc780 1 < suggested remove operation key=75O00VMLJJ1X tag=93V5C6JJ9YBN type=del 2024-09-14T10:51:36.479 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.480+0000 7f19187cc780 1 > prepared operation key=B9FQYIX19AEP tag=C3U7UEPMO2G4 type=del size=858228 2024-09-14T10:51:36.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.482+0000 7f19187cc780 1 < completed part key=_multipart_E6UO1LUWOC44.2~UWXED9V3PRNW.0 size=237747 2024-09-14T10:51:36.482 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.484+0000 7f19187cc780 1 < completed multipart upload key=E6UO1LUWOC44 upload=UWXED9V3PRNW tag=SI9PCCC81ZN6 type=write size=1286323 2024-09-14T10:51:36.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.486+0000 7f19187cc780 1 > prepared operation key=75O00VMLJJ1X tag=W0OT5749TCZU type=del size=3576264 2024-09-14T10:51:36.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.487+0000 7f19187cc780 1 < completed delete operation key=54BSD3DEHNK6 tag=9X62APVLN27B type=del 2024-09-14T10:51:36.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.488+0000 7f19187cc780 1 > prepared operation key=75O00VMLJJ1X tag=MA6DNO3KHMOF type=del size=415853 2024-09-14T10:51:36.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.490+0000 7f19187cc780 1 < completed part key=_multipart_W1K1IU13J0CZ.2~FQ3WSHTZF7UY.0 size=1048576 2024-09-14T10:51:36.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.491+0000 7f19187cc780 1 < completed part key=_multipart_W1K1IU13J0CZ.2~FQ3WSHTZF7UY.1 size=1048576 2024-09-14T10:51:36.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.492+0000 7f19187cc780 1 < completed part key=_multipart_W1K1IU13J0CZ.2~FQ3WSHTZF7UY.2 size=874931 2024-09-14T10:51:36.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.494+0000 7f19187cc780 1 < completed multipart upload key=W1K1IU13J0CZ upload=FQ3WSHTZF7UY tag=YQ74KV1TOMBX type=write size=4020659 2024-09-14T10:51:36.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.496+0000 7f19187cc780 1 > prepared operation key=INJQTKXHBUV2 tag=X88J14D8HRTW type=write size=573198 2024-09-14T10:51:36.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.497+0000 7f19187cc780 1 < completed delete operation key=EZLSMEK89N2G tag=YMTDZNJIR4W2 type=del 2024-09-14T10:51:36.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.499+0000 7f19187cc780 1 > prepared operation key=N0L67LS2KHR1 tag=27TJOWDAHWFX type=del size=3633022 2024-09-14T10:51:36.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.500+0000 7f19187cc780 1 < completed part key=_multipart_QBMNYNWOLK4I.2~RK8DN2UDY0G9.0 size=1048576 2024-09-14T10:51:36.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.501+0000 7f19187cc780 1 < completed part key=_multipart_QBMNYNWOLK4I.2~RK8DN2UDY0G9.1 size=19898 2024-09-14T10:51:36.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.504+0000 7f19187cc780 1 < completed multipart upload key=QBMNYNWOLK4I upload=RK8DN2UDY0G9 tag=0GTHNZKQHFTW type=write size=2117050 2024-09-14T10:51:36.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.505+0000 7f19187cc780 1 > prepared operation key=QFEI6H4EQ9ZR tag=DO5OUJMJO1PD type=del size=297773 2024-09-14T10:51:36.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.507+0000 7f19187cc780 1 < completed write operation key=CADC2BY888V1 tag=F2W3I77D2FJE type=write size=879654 2024-09-14T10:51:36.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.509+0000 7f19187cc780 1 > prepared part key=_multipart_W1K1IU13J0CZ.2~21WS4M2A9LGX.0 size=1048576 2024-09-14T10:51:36.509 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.510+0000 7f19187cc780 1 > prepared part key=_multipart_W1K1IU13J0CZ.2~21WS4M2A9LGX.1 size=955592 2024-09-14T10:51:36.509 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.510+0000 7f19187cc780 1 > prepared multipart upload key=W1K1IU13J0CZ upload=21WS4M2A9LGX tag=3CKFZOSOEH0U type=write size=3052744 2024-09-14T10:51:36.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.512+0000 7f19187cc780 1 < completed part key=_multipart_5AIAYJMRZGFQ.2~4CKJ8KJ3BOBQ.0 size=1048576 2024-09-14T10:51:36.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.513+0000 7f19187cc780 1 < completed part key=_multipart_5AIAYJMRZGFQ.2~4CKJ8KJ3BOBQ.1 size=202802 2024-09-14T10:51:36.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.516+0000 7f19187cc780 1 < completed multipart upload key=5AIAYJMRZGFQ upload=4CKJ8KJ3BOBQ tag=D4HHZW96VJ7B type=write size=2299954 2024-09-14T10:51:36.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.517+0000 7f19187cc780 1 > prepared operation key=VW6U36JN2DBX tag=M2J3Y2KO5G9H type=del size=2046778 2024-09-14T10:51:36.517 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.519+0000 7f19187cc780 1 < completed delete operation key=E6UO1LUWOC44 tag=4CY8N03A188X type=del 2024-09-14T10:51:36.519 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.520+0000 7f19187cc780 1 > prepared operation key=AST81B9QWORT tag=WYKJ19B651DZ type=write size=588982 2024-09-14T10:51:36.520 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.522+0000 7f19187cc780 1 < completed delete operation key=B9FQYIX19AEP tag=HAFROEKE8AY6 type=del 2024-09-14T10:51:36.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.524+0000 7f19187cc780 1 > prepared operation key=6BNN842ZTWG5 tag=MGV7RB6E2104 type=del size=32720 2024-09-14T10:51:36.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.525+0000 7f19187cc780 1 < completed part key=_multipart_INJQTKXHBUV2.2~C6W72XYVJCER.0 size=1048576 2024-09-14T10:51:36.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.526+0000 7f19187cc780 1 < completed part key=_multipart_INJQTKXHBUV2.2~C6W72XYVJCER.1 size=1046960 2024-09-14T10:51:36.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.531+0000 7f19187cc780 1 < completed multipart upload key=INJQTKXHBUV2 upload=C6W72XYVJCER tag=O1EQERHTSQH7 type=write size=3144112 2024-09-14T10:51:36.531 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.532+0000 7f19187cc780 1 > prepared operation key=YA3DI7N4DG5K tag=N5P8GDWX8ZI3 type=del size=3068296 2024-09-14T10:51:36.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.535+0000 7f19187cc780 -1 < failed to complete operation key=75O00VMLJJ1X tag=RJLFPDDA3RGR type=write size=924843: (22) Invalid argument 2024-09-14T10:51:36.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.536+0000 7f19187cc780 1 > prepared operation key=7IWUW2HC3ULI tag=O38T5HVDX0CG type=write size=905447 2024-09-14T10:51:36.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.540+0000 7f19187cc780 1 < suggested update operation key=CADC2BY888V1 tag=NT975A4P62IU type=del size=1028294 2024-09-14T10:51:36.541 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.542+0000 7f19187cc780 1 > prepared part key=_multipart_YA3DI7N4DG5K.2~AIASBCDVDR31.0 size=1048576 2024-09-14T10:51:36.542 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.544+0000 7f19187cc780 1 > prepared part key=_multipart_YA3DI7N4DG5K.2~AIASBCDVDR31.1 size=388130 2024-09-14T10:51:36.542 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.544+0000 7f19187cc780 1 > prepared multipart upload key=YA3DI7N4DG5K upload=AIASBCDVDR31 tag=F51K88LHI9BH type=write size=2485282 2024-09-14T10:51:36.544 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.545+0000 7f19187cc780 1 < completed delete operation key=MFA30GSMCSKP tag=90GCCIF6ARTB type=del 2024-09-14T10:51:36.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.548+0000 7f19187cc780 1 > prepared part key=_multipart_RTGE7ISETJWW.2~WHNNCI8CWLF0.0 size=1048576 2024-09-14T10:51:36.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.549+0000 7f19187cc780 1 > prepared part key=_multipart_RTGE7ISETJWW.2~WHNNCI8CWLF0.1 size=1041926 2024-09-14T10:51:36.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.549+0000 7f19187cc780 1 > prepared multipart upload key=RTGE7ISETJWW upload=WHNNCI8CWLF0 tag=3UJ9SNNB9PEK type=write size=3139078 2024-09-14T10:51:36.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.550+0000 7f19187cc780 1 < canceled operation key=EL00Y4Z7DTAT tag=8RPFO8RK4MXJ type=write size=76880 2024-09-14T10:51:36.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.552+0000 7f19187cc780 1 > prepared operation key=E6UO1LUWOC44 tag=OYTAKUFNJJ1E type=del size=2388801 2024-09-14T10:51:36.552 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.553+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~HBRK9QW1X1MK.0 size=1048576 2024-09-14T10:51:36.552 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.553+0000 7f19187cc780 1 < canceled part key=_multipart_VW6U36JN2DBX.2~HBRK9QW1X1MK.1 size=106302 2024-09-14T10:51:36.554 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.556+0000 7f19187cc780 1 < canceled multipart upload key=VW6U36JN2DBX upload=HBRK9QW1X1MK tag=MTBO5K0UM9LY type=write size=2203454 2024-09-14T10:51:36.557 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.558+0000 7f19187cc780 1 > prepared part key=_multipart_E6UO1LUWOC44.2~CJYKJKDZY2HR.0 size=1048576 2024-09-14T10:51:36.558 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.559+0000 7f19187cc780 1 > prepared part key=_multipart_E6UO1LUWOC44.2~CJYKJKDZY2HR.1 size=1048576 2024-09-14T10:51:36.559 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.561+0000 7f19187cc780 1 > prepared part key=_multipart_E6UO1LUWOC44.2~CJYKJKDZY2HR.2 size=743324 2024-09-14T10:51:36.559 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.561+0000 7f19187cc780 1 > prepared multipart upload key=E6UO1LUWOC44 upload=CJYKJKDZY2HR tag=CFFUNZVWL2C6 type=write size=3889052 2024-09-14T10:51:36.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.563+0000 7f19187cc780 1 < completed delete operation key=B9FQYIX19AEP tag=C3U7UEPMO2G4 type=del 2024-09-14T10:51:36.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.565+0000 7f19187cc780 1 > prepared operation key=M73CER01XHDY tag=BWZ4BW1X3AXC type=del size=1620141 2024-09-14T10:51:36.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.567+0000 7f19187cc780 1 < completed delete operation key=75O00VMLJJ1X tag=W0OT5749TCZU type=del 2024-09-14T10:51:36.568 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.569+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~46B91BSAEIJF.0 size=1048576 2024-09-14T10:51:36.569 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.570+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~46B91BSAEIJF.1 size=253106 2024-09-14T10:51:36.569 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.570+0000 7f19187cc780 1 > prepared multipart upload key=KP3WOGIF30PZ upload=46B91BSAEIJF tag=028P79UQKXHZ type=write size=2350258 2024-09-14T10:51:36.570 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.572+0000 7f19187cc780 1 < completed delete operation key=75O00VMLJJ1X tag=MA6DNO3KHMOF type=del 2024-09-14T10:51:36.572 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.574+0000 7f19187cc780 1 > prepared operation key=W1K1IU13J0CZ tag=GRCE41K8VLW9 type=write size=881159 2024-09-14T10:51:36.573 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.575+0000 7f19187cc780 1 < completed write operation key=INJQTKXHBUV2 tag=X88J14D8HRTW type=write size=573198 2024-09-14T10:51:36.575 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.576+0000 7f19187cc780 1 > prepared operation key=M73CER01XHDY tag=OKNCYB5227DE type=del size=2110877 2024-09-14T10:51:36.576 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.578+0000 7f19187cc780 1 < completed delete operation key=N0L67LS2KHR1 tag=27TJOWDAHWFX type=del 2024-09-14T10:51:36.578 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.579+0000 7f19187cc780 1 > prepared operation key=KOJ7QB7M6A35 tag=Z36E7L44AWBY type=del size=2020604 2024-09-14T10:51:36.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.581+0000 7f19187cc780 1 < completed delete operation key=QFEI6H4EQ9ZR tag=DO5OUJMJO1PD type=del 2024-09-14T10:51:36.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.582+0000 7f19187cc780 1 > prepared operation key=OVOPGTYUF3F3 tag=EN2IOWBXU1IV type=del size=3138675 2024-09-14T10:51:36.582 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.584+0000 7f19187cc780 1 < completed part key=_multipart_W1K1IU13J0CZ.2~21WS4M2A9LGX.0 size=1048576 2024-09-14T10:51:36.583 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.585+0000 7f19187cc780 1 < completed part key=_multipart_W1K1IU13J0CZ.2~21WS4M2A9LGX.1 size=955592 2024-09-14T10:51:36.585 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.587+0000 7f19187cc780 1 < completed multipart upload key=W1K1IU13J0CZ upload=21WS4M2A9LGX tag=3CKFZOSOEH0U type=write size=3052744 2024-09-14T10:51:36.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.588+0000 7f19187cc780 1 > prepared operation key=KP3WOGIF30PZ tag=KVSAABUQBYLD type=del size=3910691 2024-09-14T10:51:36.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.590+0000 7f19187cc780 1 < completed delete operation key=VW6U36JN2DBX tag=M2J3Y2KO5G9H type=del 2024-09-14T10:51:36.590 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.591+0000 7f19187cc780 1 > prepared operation key=E6UO1LUWOC44 tag=RTGEOFGRBG06 type=del size=3354273 2024-09-14T10:51:36.591 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.593+0000 7f19187cc780 1 < completed write operation key=AST81B9QWORT tag=WYKJ19B651DZ type=write size=588982 2024-09-14T10:51:36.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.596+0000 7f19187cc780 1 > prepared part key=_multipart_E6UO1LUWOC44.2~26VC27GHH09T.0 size=1048576 2024-09-14T10:51:36.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.597+0000 7f19187cc780 1 > prepared part key=_multipart_E6UO1LUWOC44.2~26VC27GHH09T.1 size=684558 2024-09-14T10:51:36.595 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.597+0000 7f19187cc780 1 > prepared multipart upload key=E6UO1LUWOC44 upload=26VC27GHH09T tag=REVNASRSQEVO type=write size=2781710 2024-09-14T10:51:36.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.598+0000 7f19187cc780 1 < completed delete operation key=6BNN842ZTWG5 tag=MGV7RB6E2104 type=del 2024-09-14T10:51:36.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.600+0000 7f19187cc780 1 > prepared operation key=7IWUW2HC3ULI tag=6J6XP3GSHKN3 type=del size=1983529 2024-09-14T10:51:36.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.602+0000 7f19187cc780 1 < completed delete operation key=YA3DI7N4DG5K tag=N5P8GDWX8ZI3 type=del 2024-09-14T10:51:36.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.603+0000 7f19187cc780 1 > prepared operation key=VW6U36JN2DBX tag=QCNH1L4U7VAR type=del size=4094466 2024-09-14T10:51:36.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.604+0000 7f19187cc780 1 < completed write operation key=7IWUW2HC3ULI tag=O38T5HVDX0CG type=write size=905447 2024-09-14T10:51:36.604 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.606+0000 7f19187cc780 1 > prepared operation key=AGNUE76X8XCJ tag=01ELUZN2X0G6 type=del size=2464264 2024-09-14T10:51:36.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.607+0000 7f19187cc780 1 < completed part key=_multipart_YA3DI7N4DG5K.2~AIASBCDVDR31.0 size=1048576 2024-09-14T10:51:36.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.608+0000 7f19187cc780 1 < completed part key=_multipart_YA3DI7N4DG5K.2~AIASBCDVDR31.1 size=388130 2024-09-14T10:51:36.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.611+0000 7f19187cc780 1 < completed multipart upload key=YA3DI7N4DG5K upload=AIASBCDVDR31 tag=F51K88LHI9BH type=write size=2485282 2024-09-14T10:51:36.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.613+0000 7f19187cc780 1 > prepared part key=_multipart_54BSD3DEHNK6.2~W5DT73D5SGM2.0 size=1048576 2024-09-14T10:51:36.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.615+0000 7f19187cc780 1 > prepared part key=_multipart_54BSD3DEHNK6.2~W5DT73D5SGM2.1 size=1048576 2024-09-14T10:51:36.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.616+0000 7f19187cc780 1 > prepared part key=_multipart_54BSD3DEHNK6.2~W5DT73D5SGM2.2 size=922994 2024-09-14T10:51:36.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.616+0000 7f19187cc780 1 > prepared multipart upload key=54BSD3DEHNK6 upload=W5DT73D5SGM2 tag=C1GTYRW4JFEI type=write size=4068722 2024-09-14T10:51:36.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.617+0000 7f19187cc780 1 < completed part key=_multipart_RTGE7ISETJWW.2~WHNNCI8CWLF0.0 size=1048576 2024-09-14T10:51:36.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.618+0000 7f19187cc780 1 < completed part key=_multipart_RTGE7ISETJWW.2~WHNNCI8CWLF0.1 size=1041926 2024-09-14T10:51:36.619 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.621+0000 7f19187cc780 1 < completed multipart upload key=RTGE7ISETJWW upload=WHNNCI8CWLF0 tag=3UJ9SNNB9PEK type=write size=3139078 2024-09-14T10:51:36.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.622+0000 7f19187cc780 1 > prepared operation key=XCVE2F2JJK4X tag=0OJFWV0VIDLN type=del size=446795 2024-09-14T10:51:36.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.623+0000 7f19187cc780 1 < completed delete operation key=E6UO1LUWOC44 tag=OYTAKUFNJJ1E type=del 2024-09-14T10:51:36.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.626+0000 7f19187cc780 1 > prepared part key=_multipart_19P3WE6HKJH2.2~BILJ6PUA6PRB.0 size=1048576 2024-09-14T10:51:36.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.627+0000 7f19187cc780 1 > prepared part key=_multipart_19P3WE6HKJH2.2~BILJ6PUA6PRB.1 size=1048576 2024-09-14T10:51:36.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.628+0000 7f19187cc780 1 > prepared part key=_multipart_19P3WE6HKJH2.2~BILJ6PUA6PRB.2 size=435709 2024-09-14T10:51:36.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.628+0000 7f19187cc780 1 > prepared multipart upload key=19P3WE6HKJH2 upload=BILJ6PUA6PRB tag=1NYQQAIK51CK type=write size=3581437 2024-09-14T10:51:36.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.630+0000 7f19187cc780 1 < completed part key=_multipart_E6UO1LUWOC44.2~CJYKJKDZY2HR.0 size=1048576 2024-09-14T10:51:36.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.631+0000 7f19187cc780 1 < completed part key=_multipart_E6UO1LUWOC44.2~CJYKJKDZY2HR.1 size=1048576 2024-09-14T10:51:36.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.632+0000 7f19187cc780 1 < completed part key=_multipart_E6UO1LUWOC44.2~CJYKJKDZY2HR.2 size=743324 2024-09-14T10:51:36.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.634+0000 7f19187cc780 1 < completed multipart upload key=E6UO1LUWOC44 upload=CJYKJKDZY2HR tag=CFFUNZVWL2C6 type=write size=3889052 2024-09-14T10:51:36.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.636+0000 7f19187cc780 1 > prepared operation key=CADC2BY888V1 tag=BW0MBLZDFYZA type=del size=809770 2024-09-14T10:51:36.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.637+0000 7f19187cc780 1 < completed delete operation key=M73CER01XHDY tag=BWZ4BW1X3AXC type=del 2024-09-14T10:51:36.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.639+0000 7f19187cc780 1 > prepared operation key=QBMNYNWOLK4I tag=4WX4W2HSQ3U9 type=del size=1795949 2024-09-14T10:51:36.639 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.640+0000 7f19187cc780 1 < completed part key=_multipart_KP3WOGIF30PZ.2~46B91BSAEIJF.0 size=1048576 2024-09-14T10:51:36.639 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.640+0000 7f19187cc780 1 < canceled part key=_multipart_KP3WOGIF30PZ.2~46B91BSAEIJF.1 size=253106 2024-09-14T10:51:36.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.643+0000 7f19187cc780 1 < canceled multipart upload key=KP3WOGIF30PZ upload=46B91BSAEIJF tag=028P79UQKXHZ type=write size=2350258 2024-09-14T10:51:36.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.644+0000 7f19187cc780 1 > prepared operation key=OVOPGTYUF3F3 tag=PCR2MBXLAUZ3 type=del size=949491 2024-09-14T10:51:36.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.648+0000 7f19187cc780 1 < suggested remove operation key=W1K1IU13J0CZ tag=GRCE41K8VLW9 type=write 2024-09-14T10:51:36.647 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.649+0000 7f19187cc780 1 > prepared operation key=AGNUE76X8XCJ tag=ERY3M53JTAOI type=del size=3079435 2024-09-14T10:51:36.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.650+0000 7f19187cc780 1 < completed delete operation key=M73CER01XHDY tag=OKNCYB5227DE type=del 2024-09-14T10:51:36.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.653+0000 7f19187cc780 1 > prepared part key=_multipart_N0L67LS2KHR1.2~Y9O92ASXSJ3D.0 size=1048576 2024-09-14T10:51:36.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.655+0000 7f19187cc780 1 > prepared part key=_multipart_N0L67LS2KHR1.2~Y9O92ASXSJ3D.1 size=999614 2024-09-14T10:51:36.654 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.655+0000 7f19187cc780 1 > prepared multipart upload key=N0L67LS2KHR1 upload=Y9O92ASXSJ3D tag=XC4V48X6WPF3 type=write size=3096766 2024-09-14T10:51:36.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.657+0000 7f19187cc780 1 < completed delete operation key=KOJ7QB7M6A35 tag=Z36E7L44AWBY type=del 2024-09-14T10:51:36.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.659+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~TUHPZQK18EZE.0 size=1048576 2024-09-14T10:51:36.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.661+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~TUHPZQK18EZE.1 size=1048576 2024-09-14T10:51:36.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.662+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~TUHPZQK18EZE.2 size=917246 2024-09-14T10:51:36.661 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.662+0000 7f19187cc780 1 > prepared multipart upload key=7IWUW2HC3ULI upload=TUHPZQK18EZE tag=8WQLY3X9JEC6 type=write size=4062974 2024-09-14T10:51:36.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.664+0000 7f19187cc780 1 < completed delete operation key=OVOPGTYUF3F3 tag=EN2IOWBXU1IV type=del 2024-09-14T10:51:36.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.665+0000 7f19187cc780 1 > prepared operation key=E6UO1LUWOC44 tag=A5XCP3P213GK type=write size=157791 2024-09-14T10:51:36.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.667+0000 7f19187cc780 1 < canceled operation key=KP3WOGIF30PZ tag=KVSAABUQBYLD type=del size=3910691 2024-09-14T10:51:36.667 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.669+0000 7f19187cc780 1 > prepared operation key=617QQI921HB4 tag=XV6SN4W26MEQ type=del size=495555 2024-09-14T10:51:36.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.670+0000 7f19187cc780 1 < completed delete operation key=E6UO1LUWOC44 tag=RTGEOFGRBG06 type=del 2024-09-14T10:51:36.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.675+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~S9VQ9XZW7NV7.0 size=1048576 2024-09-14T10:51:36.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.678+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~S9VQ9XZW7NV7.1 size=234788 2024-09-14T10:51:36.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.678+0000 7f19187cc780 1 > prepared multipart upload key=VW6U36JN2DBX upload=S9VQ9XZW7NV7 tag=DZWZ26I4NZBP type=write size=2331940 2024-09-14T10:51:36.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.679+0000 7f19187cc780 1 < canceled part key=_multipart_E6UO1LUWOC44.2~26VC27GHH09T.0 size=1048576 2024-09-14T10:51:36.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.680+0000 7f19187cc780 1 < completed part key=_multipart_E6UO1LUWOC44.2~26VC27GHH09T.1 size=684558 2024-09-14T10:51:36.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.682+0000 7f19187cc780 1 < canceled multipart upload key=E6UO1LUWOC44 upload=26VC27GHH09T tag=REVNASRSQEVO type=write size=2781710 2024-09-14T10:51:36.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.684+0000 7f19187cc780 1 > prepared operation key=7IWUW2HC3ULI tag=FFSVXIHWZ73S type=write size=734025 2024-09-14T10:51:36.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.685+0000 7f19187cc780 1 < completed delete operation key=7IWUW2HC3ULI tag=6J6XP3GSHKN3 type=del 2024-09-14T10:51:36.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.688+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~V3VLWRTQO1C3.0 size=1048576 2024-09-14T10:51:36.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.689+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~V3VLWRTQO1C3.1 size=501417 2024-09-14T10:51:36.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.689+0000 7f19187cc780 1 > prepared multipart upload key=AGNUE76X8XCJ upload=V3VLWRTQO1C3 tag=ZNAJRXBI29K0 type=write size=2598569 2024-09-14T10:51:36.689 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.690+0000 7f19187cc780 1 < completed delete operation key=VW6U36JN2DBX tag=QCNH1L4U7VAR type=del 2024-09-14T10:51:36.690 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.692+0000 7f19187cc780 1 > prepared operation key=61O2VU0SB379 tag=O6Y8SFOI9VD0 type=del size=1120473 2024-09-14T10:51:36.691 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.693+0000 7f19187cc780 1 < canceled operation key=AGNUE76X8XCJ tag=01ELUZN2X0G6 type=del size=2464264 2024-09-14T10:51:36.693 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.695+0000 7f19187cc780 1 > prepared operation key=5AIAYJMRZGFQ tag=0HN6RZZHORVG type=del size=3274857 2024-09-14T10:51:36.694 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.695+0000 7f19187cc780 1 < canceled part key=_multipart_54BSD3DEHNK6.2~W5DT73D5SGM2.0 size=1048576 2024-09-14T10:51:36.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.696+0000 7f19187cc780 1 < completed part key=_multipart_54BSD3DEHNK6.2~W5DT73D5SGM2.1 size=1048576 2024-09-14T10:51:36.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.697+0000 7f19187cc780 1 < completed part key=_multipart_54BSD3DEHNK6.2~W5DT73D5SGM2.2 size=922994 2024-09-14T10:51:36.698 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.700+0000 7f19187cc780 1 < canceled multipart upload key=54BSD3DEHNK6 upload=W5DT73D5SGM2 tag=C1GTYRW4JFEI type=write size=4068722 2024-09-14T10:51:36.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.702+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~HO0F29HH834G.0 size=1048576 2024-09-14T10:51:36.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.703+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~HO0F29HH834G.1 size=427066 2024-09-14T10:51:36.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.703+0000 7f19187cc780 1 > prepared multipart upload key=B9FQYIX19AEP upload=HO0F29HH834G tag=E5826JKFG88I type=write size=2524218 2024-09-14T10:51:36.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.705+0000 7f19187cc780 1 < canceled operation key=XCVE2F2JJK4X tag=0OJFWV0VIDLN type=del size=446795 2024-09-14T10:51:36.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.707+0000 7f19187cc780 1 > prepared operation key=EZLSMEK89N2G tag=ZB3AHUAPR9Y8 type=del size=2300233 2024-09-14T10:51:36.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.708+0000 7f19187cc780 1 < completed part key=_multipart_19P3WE6HKJH2.2~BILJ6PUA6PRB.0 size=1048576 2024-09-14T10:51:36.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.709+0000 7f19187cc780 1 < completed part key=_multipart_19P3WE6HKJH2.2~BILJ6PUA6PRB.1 size=1048576 2024-09-14T10:51:36.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.711+0000 7f19187cc780 1 < completed part key=_multipart_19P3WE6HKJH2.2~BILJ6PUA6PRB.2 size=435709 2024-09-14T10:51:36.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.713+0000 7f19187cc780 1 < completed multipart upload key=19P3WE6HKJH2 upload=BILJ6PUA6PRB tag=1NYQQAIK51CK type=write size=3581437 2024-09-14T10:51:36.714 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.716+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~K3F61B56LB7C.0 size=668303 2024-09-14T10:51:36.714 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.716+0000 7f19187cc780 1 > prepared multipart upload key=6BNN842ZTWG5 upload=K3F61B56LB7C tag=KYTH259HLOTS type=write size=1716879 2024-09-14T10:51:36.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.719+0000 7f19187cc780 1 < suggested remove operation key=CADC2BY888V1 tag=BW0MBLZDFYZA type=del 2024-09-14T10:51:36.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.721+0000 7f19187cc780 1 > prepared part key=_multipart_5AIAYJMRZGFQ.2~ZB562L8NELPN.0 size=1048576 2024-09-14T10:51:36.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.722+0000 7f19187cc780 1 > prepared part key=_multipart_5AIAYJMRZGFQ.2~ZB562L8NELPN.1 size=1048576 2024-09-14T10:51:36.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.723+0000 7f19187cc780 1 > prepared part key=_multipart_5AIAYJMRZGFQ.2~ZB562L8NELPN.2 size=1009738 2024-09-14T10:51:36.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.723+0000 7f19187cc780 1 > prepared multipart upload key=5AIAYJMRZGFQ upload=ZB562L8NELPN tag=XSU1EWEA2RS9 type=write size=4155466 2024-09-14T10:51:36.723 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.725+0000 7f19187cc780 1 < completed delete operation key=QBMNYNWOLK4I tag=4WX4W2HSQ3U9 type=del 2024-09-14T10:51:36.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.726+0000 7f19187cc780 1 > prepared operation key=KP3WOGIF30PZ tag=9W9MJSXGG3WS type=write size=624003 2024-09-14T10:51:36.726 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.728+0000 7f19187cc780 1 < completed delete operation key=OVOPGTYUF3F3 tag=PCR2MBXLAUZ3 type=del 2024-09-14T10:51:36.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.730+0000 7f19187cc780 1 > prepared part key=_multipart_EL00Y4Z7DTAT.2~S4DYW565ZKP9.0 size=883585 2024-09-14T10:51:36.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.730+0000 7f19187cc780 1 > prepared multipart upload key=EL00Y4Z7DTAT upload=S4DYW565ZKP9 tag=DY96R6K5ZP8C type=write size=1932161 2024-09-14T10:51:36.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.733+0000 7f19187cc780 1 < suggested remove operation key=AGNUE76X8XCJ tag=ERY3M53JTAOI type=del 2024-09-14T10:51:36.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.735+0000 7f19187cc780 1 > prepared operation key=AGNUE76X8XCJ tag=LSZLKHON21V0 type=del size=914131 2024-09-14T10:51:36.735 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.736+0000 7f19187cc780 1 < completed part key=_multipart_N0L67LS2KHR1.2~Y9O92ASXSJ3D.0 size=1048576 2024-09-14T10:51:36.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.738+0000 7f19187cc780 1 < completed part key=_multipart_N0L67LS2KHR1.2~Y9O92ASXSJ3D.1 size=999614 2024-09-14T10:51:36.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.740+0000 7f19187cc780 1 < completed multipart upload key=N0L67LS2KHR1 upload=Y9O92ASXSJ3D tag=XC4V48X6WPF3 type=write size=3096766 2024-09-14T10:51:36.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.743+0000 7f19187cc780 1 > prepared part key=_multipart_MFA30GSMCSKP.2~0C12EJPPBH86.0 size=1010345 2024-09-14T10:51:36.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.743+0000 7f19187cc780 1 > prepared multipart upload key=MFA30GSMCSKP upload=0C12EJPPBH86 tag=9VDGMOSDWG9J type=write size=2058921 2024-09-14T10:51:36.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.744+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~TUHPZQK18EZE.0 size=1048576 2024-09-14T10:51:36.744 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.746+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~TUHPZQK18EZE.1 size=1048576 2024-09-14T10:51:36.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.747+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~TUHPZQK18EZE.2 size=917246 2024-09-14T10:51:36.748 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.749+0000 7f19187cc780 1 < completed multipart upload key=7IWUW2HC3ULI upload=TUHPZQK18EZE tag=8WQLY3X9JEC6 type=write size=4062974 2024-09-14T10:51:36.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.751+0000 7f19187cc780 1 > prepared operation key=RTGE7ISETJWW tag=7EL0YKIUQHFI type=del size=1349909 2024-09-14T10:51:36.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.752+0000 7f19187cc780 1 < completed write operation key=E6UO1LUWOC44 tag=A5XCP3P213GK type=write size=157791 2024-09-14T10:51:36.752 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.754+0000 7f19187cc780 1 > prepared operation key=19P3WE6HKJH2 tag=UG73VX1D722M type=del size=1949960 2024-09-14T10:51:36.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.755+0000 7f19187cc780 1 < completed delete operation key=617QQI921HB4 tag=XV6SN4W26MEQ type=del 2024-09-14T10:51:36.755 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.757+0000 7f19187cc780 1 > prepared operation key=QFEI6H4EQ9ZR tag=I0SZBE1GP0K1 type=del size=2504987 2024-09-14T10:51:36.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.758+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~S9VQ9XZW7NV7.0 size=1048576 2024-09-14T10:51:36.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.759+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~S9VQ9XZW7NV7.1 size=234788 2024-09-14T10:51:36.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.762+0000 7f19187cc780 1 < completed multipart upload key=VW6U36JN2DBX upload=S9VQ9XZW7NV7 tag=DZWZ26I4NZBP type=write size=2331940 2024-09-14T10:51:36.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.763+0000 7f19187cc780 1 > prepared operation key=VW6U36JN2DBX tag=OAI1TS00I0O0 type=del size=480237 2024-09-14T10:51:36.763 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.765+0000 7f19187cc780 1 < completed write operation key=7IWUW2HC3ULI tag=FFSVXIHWZ73S type=write size=734025 2024-09-14T10:51:36.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.766+0000 7f19187cc780 1 > prepared operation key=9EBD5ZT6MT45 tag=VI11RGODL9X0 type=del size=2246731 2024-09-14T10:51:36.766 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.768+0000 7f19187cc780 1 < completed part key=_multipart_AGNUE76X8XCJ.2~V3VLWRTQO1C3.0 size=1048576 2024-09-14T10:51:36.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.769+0000 7f19187cc780 1 < completed part key=_multipart_AGNUE76X8XCJ.2~V3VLWRTQO1C3.1 size=501417 2024-09-14T10:51:36.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.771+0000 7f19187cc780 1 < completed multipart upload key=AGNUE76X8XCJ upload=V3VLWRTQO1C3 tag=ZNAJRXBI29K0 type=write size=2598569 2024-09-14T10:51:36.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.773+0000 7f19187cc780 1 > prepared operation key=YA3DI7N4DG5K tag=90ZFBH7KPS9H type=write size=212383 2024-09-14T10:51:36.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.774+0000 7f19187cc780 1 < completed delete operation key=61O2VU0SB379 tag=O6Y8SFOI9VD0 type=del 2024-09-14T10:51:36.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.775+0000 7f19187cc780 1 > prepared operation key=KOJ7QB7M6A35 tag=TS3P7E8F9DAQ type=del size=3274980 2024-09-14T10:51:36.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.777+0000 7f19187cc780 1 < completed delete operation key=5AIAYJMRZGFQ tag=0HN6RZZHORVG type=del 2024-09-14T10:51:36.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.780+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~16LR4I3YXBCF.0 size=1048576 2024-09-14T10:51:36.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.781+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~16LR4I3YXBCF.1 size=582290 2024-09-14T10:51:36.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.781+0000 7f19187cc780 1 > prepared multipart upload key=VW6U36JN2DBX upload=16LR4I3YXBCF tag=40BH5Q1XCOVN type=write size=2679442 2024-09-14T10:51:36.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.782+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~HO0F29HH834G.0 size=1048576 2024-09-14T10:51:36.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.783+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~HO0F29HH834G.1 size=427066 2024-09-14T10:51:36.784 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.786+0000 7f19187cc780 1 < completed multipart upload key=B9FQYIX19AEP upload=HO0F29HH834G tag=E5826JKFG88I type=write size=2524218 2024-09-14T10:51:36.786 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.787+0000 7f19187cc780 1 > prepared operation key=54BSD3DEHNK6 tag=3QH789LXXGKR type=del size=1799744 2024-09-14T10:51:36.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.789+0000 7f19187cc780 1 < completed delete operation key=EZLSMEK89N2G tag=ZB3AHUAPR9Y8 type=del 2024-09-14T10:51:36.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.791+0000 7f19187cc780 1 > prepared part key=_multipart_EZLSMEK89N2G.2~27MBMBFEN4YW.0 size=1048576 2024-09-14T10:51:36.791 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.792+0000 7f19187cc780 1 > prepared part key=_multipart_EZLSMEK89N2G.2~27MBMBFEN4YW.1 size=1048576 2024-09-14T10:51:36.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.794+0000 7f19187cc780 1 > prepared part key=_multipart_EZLSMEK89N2G.2~27MBMBFEN4YW.2 size=26349 2024-09-14T10:51:36.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.794+0000 7f19187cc780 1 > prepared multipart upload key=EZLSMEK89N2G upload=27MBMBFEN4YW tag=54DB41YMUDVH type=write size=3172077 2024-09-14T10:51:36.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.794+0000 7f19187cc780 1 < canceled part key=_multipart_6BNN842ZTWG5.2~K3F61B56LB7C.0 size=668303 2024-09-14T10:51:36.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.796+0000 7f19187cc780 1 < canceled multipart upload key=6BNN842ZTWG5 upload=K3F61B56LB7C tag=KYTH259HLOTS type=write size=1716879 2024-09-14T10:51:36.797 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.799+0000 7f19187cc780 1 > prepared part key=_multipart_QFEI6H4EQ9ZR.2~377L3POA0FZG.0 size=1048576 2024-09-14T10:51:36.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.802+0000 7f19187cc780 1 > prepared part key=_multipart_QFEI6H4EQ9ZR.2~377L3POA0FZG.1 size=1048576 2024-09-14T10:51:36.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.803+0000 7f19187cc780 1 > prepared part key=_multipart_QFEI6H4EQ9ZR.2~377L3POA0FZG.2 size=188814 2024-09-14T10:51:36.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.803+0000 7f19187cc780 1 > prepared multipart upload key=QFEI6H4EQ9ZR upload=377L3POA0FZG tag=YNLTYMA14TM6 type=write size=3334542 2024-09-14T10:51:36.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.804+0000 7f19187cc780 1 < completed part key=_multipart_5AIAYJMRZGFQ.2~ZB562L8NELPN.0 size=1048576 2024-09-14T10:51:36.804 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.806+0000 7f19187cc780 1 < completed part key=_multipart_5AIAYJMRZGFQ.2~ZB562L8NELPN.1 size=1048576 2024-09-14T10:51:36.805 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.807+0000 7f19187cc780 1 < completed part key=_multipart_5AIAYJMRZGFQ.2~ZB562L8NELPN.2 size=1009738 2024-09-14T10:51:36.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.809+0000 7f19187cc780 1 < completed multipart upload key=5AIAYJMRZGFQ upload=ZB562L8NELPN tag=XSU1EWEA2RS9 type=write size=4155466 2024-09-14T10:51:36.813 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.815+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~XHPLJ056V5F6.0 size=1048576 2024-09-14T10:51:36.816 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.817+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~XHPLJ056V5F6.1 size=1048576 2024-09-14T10:51:36.817 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.819+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~XHPLJ056V5F6.2 size=353580 2024-09-14T10:51:36.817 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.819+0000 7f19187cc780 1 > prepared multipart upload key=IKVYA4KEALFF upload=XHPLJ056V5F6 tag=RQ8NHXFJAXFG type=write size=3499308 2024-09-14T10:51:36.819 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.820+0000 7f19187cc780 1 < completed write operation key=KP3WOGIF30PZ tag=9W9MJSXGG3WS type=write size=624003 2024-09-14T10:51:36.820 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.822+0000 7f19187cc780 1 > prepared operation key=QBMNYNWOLK4I tag=98KI84SSKOXE type=del size=449018 2024-09-14T10:51:36.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.823+0000 7f19187cc780 1 < completed part key=_multipart_EL00Y4Z7DTAT.2~S4DYW565ZKP9.0 size=883585 2024-09-14T10:51:36.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.825+0000 7f19187cc780 1 < completed multipart upload key=EL00Y4Z7DTAT upload=S4DYW565ZKP9 tag=DY96R6K5ZP8C type=write size=1932161 2024-09-14T10:51:36.825 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.827+0000 7f19187cc780 1 > prepared operation key=MFA30GSMCSKP tag=I1FEP2AY4NFC type=del size=4156483 2024-09-14T10:51:36.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.828+0000 7f19187cc780 1 < completed delete operation key=AGNUE76X8XCJ tag=LSZLKHON21V0 type=del 2024-09-14T10:51:36.829 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.831+0000 7f19187cc780 1 > prepared part key=_multipart_AST81B9QWORT.2~3WNG5RPLPETD.0 size=1048576 2024-09-14T10:51:36.830 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.832+0000 7f19187cc780 1 > prepared part key=_multipart_AST81B9QWORT.2~3WNG5RPLPETD.1 size=327246 2024-09-14T10:51:36.830 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.832+0000 7f19187cc780 1 > prepared multipart upload key=AST81B9QWORT upload=3WNG5RPLPETD tag=A9ZKV4NTWV5X type=write size=2424398 2024-09-14T10:51:36.832 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.833+0000 7f19187cc780 1 < completed part key=_multipart_MFA30GSMCSKP.2~0C12EJPPBH86.0 size=1010345 2024-09-14T10:51:36.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.836+0000 7f19187cc780 1 < completed multipart upload key=MFA30GSMCSKP upload=0C12EJPPBH86 tag=9VDGMOSDWG9J type=write size=2058921 2024-09-14T10:51:36.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.837+0000 7f19187cc780 1 > prepared operation key=5AIAYJMRZGFQ tag=2UE9Q7TBCOCV type=del size=4142029 2024-09-14T10:51:36.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.840+0000 7f19187cc780 1 < suggested update operation key=RTGE7ISETJWW tag=7EL0YKIUQHFI type=del size=1349909 2024-09-14T10:51:36.840 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.842+0000 7f19187cc780 1 > prepared operation key=EL00Y4Z7DTAT tag=Q77SV317KDK3 type=del size=809000 2024-09-14T10:51:36.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.843+0000 7f19187cc780 1 < completed delete operation key=19P3WE6HKJH2 tag=UG73VX1D722M type=del 2024-09-14T10:51:36.844 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.846+0000 7f19187cc780 1 > prepared part key=_multipart_75O00VMLJJ1X.2~8F9WPPRDP9DA.0 size=1048576 2024-09-14T10:51:36.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.847+0000 7f19187cc780 1 > prepared part key=_multipart_75O00VMLJJ1X.2~8F9WPPRDP9DA.1 size=486177 2024-09-14T10:51:36.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.847+0000 7f19187cc780 1 > prepared multipart upload key=75O00VMLJJ1X upload=8F9WPPRDP9DA tag=ZMQF6XC514R8 type=write size=2583329 2024-09-14T10:51:36.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.849+0000 7f19187cc780 1 < completed delete operation key=QFEI6H4EQ9ZR tag=I0SZBE1GP0K1 type=del 2024-09-14T10:51:36.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.851+0000 7f19187cc780 1 > prepared part key=_multipart_QFEI6H4EQ9ZR.2~EUW5LAVM2M0G.0 size=701993 2024-09-14T10:51:36.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.851+0000 7f19187cc780 1 > prepared multipart upload key=QFEI6H4EQ9ZR upload=EUW5LAVM2M0G tag=JJTSJ7OLC42B type=write size=1750569 2024-09-14T10:51:36.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.853+0000 7f19187cc780 1 < canceled operation key=VW6U36JN2DBX tag=OAI1TS00I0O0 type=del size=480237 2024-09-14T10:51:36.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.855+0000 7f19187cc780 1 > prepared part key=_multipart_QFEI6H4EQ9ZR.2~A8VN2NQJBE00.0 size=77308 2024-09-14T10:51:36.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.855+0000 7f19187cc780 1 > prepared multipart upload key=QFEI6H4EQ9ZR upload=A8VN2NQJBE00 tag=55O7HR3QUJBP type=write size=1125884 2024-09-14T10:51:36.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.857+0000 7f19187cc780 1 < completed delete operation key=9EBD5ZT6MT45 tag=VI11RGODL9X0 type=del 2024-09-14T10:51:36.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.859+0000 7f19187cc780 1 > prepared operation key=QFEI6H4EQ9ZR tag=K630PRGKGKG6 type=del size=3840983 2024-09-14T10:51:36.860 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.862+0000 7f19187cc780 1 < suggested update operation key=YA3DI7N4DG5K tag=90ZFBH7KPS9H type=write size=212383 2024-09-14T10:51:36.861 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.863+0000 7f19187cc780 1 > prepared operation key=KP3WOGIF30PZ tag=8JITBCIGF4IX type=write size=278607 2024-09-14T10:51:36.864 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.866+0000 7f19187cc780 1 < suggested remove operation key=KOJ7QB7M6A35 tag=TS3P7E8F9DAQ type=del 2024-09-14T10:51:36.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.868+0000 7f19187cc780 1 > prepared part key=_multipart_CADC2BY888V1.2~A6NBAI51VZ5T.0 size=1048576 2024-09-14T10:51:36.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.870+0000 7f19187cc780 1 > prepared part key=_multipart_CADC2BY888V1.2~A6NBAI51VZ5T.1 size=1048576 2024-09-14T10:51:36.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.871+0000 7f19187cc780 1 > prepared part key=_multipart_CADC2BY888V1.2~A6NBAI51VZ5T.2 size=346631 2024-09-14T10:51:36.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.871+0000 7f19187cc780 1 > prepared multipart upload key=CADC2BY888V1 upload=A6NBAI51VZ5T tag=1RY4M5AEJ5G6 type=write size=3492359 2024-09-14T10:51:36.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.872+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~16LR4I3YXBCF.0 size=1048576 2024-09-14T10:51:36.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.873+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~16LR4I3YXBCF.1 size=582290 2024-09-14T10:51:36.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.876+0000 7f19187cc780 1 < completed multipart upload key=VW6U36JN2DBX upload=16LR4I3YXBCF tag=40BH5Q1XCOVN type=write size=2679442 2024-09-14T10:51:36.877 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.878+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~CE84WURVJOPM.0 size=1048576 2024-09-14T10:51:36.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.880+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~CE84WURVJOPM.1 size=773744 2024-09-14T10:51:36.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.880+0000 7f19187cc780 1 > prepared multipart upload key=KOJ7QB7M6A35 upload=CE84WURVJOPM tag=6E3IUJJF1O6M type=write size=2870896 2024-09-14T10:51:36.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.881+0000 7f19187cc780 1 < completed delete operation key=54BSD3DEHNK6 tag=3QH789LXXGKR type=del 2024-09-14T10:51:36.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.883+0000 7f19187cc780 1 > prepared operation key=QBMNYNWOLK4I tag=S1KUQWC6Q1CA type=del size=366175 2024-09-14T10:51:36.882 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.884+0000 7f19187cc780 1 < completed part key=_multipart_EZLSMEK89N2G.2~27MBMBFEN4YW.0 size=1048576 2024-09-14T10:51:36.884 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.885+0000 7f19187cc780 1 < completed part key=_multipart_EZLSMEK89N2G.2~27MBMBFEN4YW.1 size=1048576 2024-09-14T10:51:36.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.886+0000 7f19187cc780 1 < completed part key=_multipart_EZLSMEK89N2G.2~27MBMBFEN4YW.2 size=26349 2024-09-14T10:51:36.887 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.889+0000 7f19187cc780 1 < completed multipart upload key=EZLSMEK89N2G upload=27MBMBFEN4YW tag=54DB41YMUDVH type=write size=3172077 2024-09-14T10:51:36.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.891+0000 7f19187cc780 1 > prepared operation key=RTGE7ISETJWW tag=E446SJS2TTFX type=del size=1302801 2024-09-14T10:51:36.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.892+0000 7f19187cc780 1 < completed part key=_multipart_QFEI6H4EQ9ZR.2~377L3POA0FZG.0 size=1048576 2024-09-14T10:51:36.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.894+0000 7f19187cc780 1 < completed part key=_multipart_QFEI6H4EQ9ZR.2~377L3POA0FZG.1 size=1048576 2024-09-14T10:51:36.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.895+0000 7f19187cc780 1 < completed part key=_multipart_QFEI6H4EQ9ZR.2~377L3POA0FZG.2 size=188814 2024-09-14T10:51:36.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.897+0000 7f19187cc780 1 < completed multipart upload key=QFEI6H4EQ9ZR upload=377L3POA0FZG tag=YNLTYMA14TM6 type=write size=3334542 2024-09-14T10:51:36.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.899+0000 7f19187cc780 1 > prepared operation key=5AIAYJMRZGFQ tag=MFPRGF13Q150 type=del size=1380132 2024-09-14T10:51:36.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.901+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~XHPLJ056V5F6.0 size=1048576 2024-09-14T10:51:36.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.902+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~XHPLJ056V5F6.1 size=1048576 2024-09-14T10:51:36.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.903+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~XHPLJ056V5F6.2 size=353580 2024-09-14T10:51:36.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.906+0000 7f19187cc780 1 < completed multipart upload key=IKVYA4KEALFF upload=XHPLJ056V5F6 tag=RQ8NHXFJAXFG type=write size=3499308 2024-09-14T10:51:36.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.907+0000 7f19187cc780 1 > prepared operation key=OVOPGTYUF3F3 tag=RQJHLJQ2CCO1 type=del size=1089142 2024-09-14T10:51:36.907 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.909+0000 7f19187cc780 1 < completed delete operation key=QBMNYNWOLK4I tag=98KI84SSKOXE type=del 2024-09-14T10:51:36.909 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.911+0000 7f19187cc780 1 > prepared operation key=54BSD3DEHNK6 tag=5NJB0I1HA93E type=write size=512773 2024-09-14T10:51:36.911 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.912+0000 7f19187cc780 1 < completed delete operation key=MFA30GSMCSKP tag=I1FEP2AY4NFC type=del 2024-09-14T10:51:36.912 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.914+0000 7f19187cc780 1 > prepared operation key=VW6U36JN2DBX tag=S5RAIJ71D1ES type=del size=965246 2024-09-14T10:51:36.914 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.915+0000 7f19187cc780 1 < completed part key=_multipart_AST81B9QWORT.2~3WNG5RPLPETD.0 size=1048576 2024-09-14T10:51:36.914 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.916+0000 7f19187cc780 1 < canceled part key=_multipart_AST81B9QWORT.2~3WNG5RPLPETD.1 size=327246 2024-09-14T10:51:36.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.918+0000 7f19187cc780 1 < canceled multipart upload key=AST81B9QWORT upload=3WNG5RPLPETD tag=A9ZKV4NTWV5X type=write size=2424398 2024-09-14T10:51:36.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.921+0000 7f19187cc780 1 > prepared part key=_multipart_54BSD3DEHNK6.2~N8C2E7IG0PGC.0 size=1023970 2024-09-14T10:51:36.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.921+0000 7f19187cc780 1 > prepared multipart upload key=54BSD3DEHNK6 upload=N8C2E7IG0PGC tag=LPJHWRGY2FW3 type=write size=2072546 2024-09-14T10:51:36.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.922+0000 7f19187cc780 1 < completed delete operation key=5AIAYJMRZGFQ tag=2UE9Q7TBCOCV type=del 2024-09-14T10:51:36.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.925+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~997WM2KUDCAV.0 size=1048576 2024-09-14T10:51:36.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.926+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~997WM2KUDCAV.1 size=1048576 2024-09-14T10:51:36.928 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.929+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~997WM2KUDCAV.2 size=299262 2024-09-14T10:51:36.928 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.929+0000 7f19187cc780 1 > prepared multipart upload key=KP3WOGIF30PZ upload=997WM2KUDCAV tag=2RHA5JVIW7P4 type=write size=3444990 2024-09-14T10:51:36.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.931+0000 7f19187cc780 1 < completed delete operation key=EL00Y4Z7DTAT tag=Q77SV317KDK3 type=del 2024-09-14T10:51:36.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.932+0000 7f19187cc780 1 > prepared operation key=AST81B9QWORT tag=STB056W8RCOB type=write size=941000 2024-09-14T10:51:36.933 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.934+0000 7f19187cc780 1 < completed part key=_multipart_75O00VMLJJ1X.2~8F9WPPRDP9DA.0 size=1048576 2024-09-14T10:51:36.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.936+0000 7f19187cc780 1 < completed part key=_multipart_75O00VMLJJ1X.2~8F9WPPRDP9DA.1 size=486177 2024-09-14T10:51:36.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.938+0000 7f19187cc780 1 < completed multipart upload key=75O00VMLJJ1X upload=8F9WPPRDP9DA tag=ZMQF6XC514R8 type=write size=2583329 2024-09-14T10:51:36.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.940+0000 7f19187cc780 1 > prepared operation key=9EBD5ZT6MT45 tag=3A4P87YBEMU4 type=del size=1583411 2024-09-14T10:51:36.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.942+0000 7f19187cc780 1 < completed part key=_multipart_QFEI6H4EQ9ZR.2~EUW5LAVM2M0G.0 size=701993 2024-09-14T10:51:36.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.944+0000 7f19187cc780 1 < completed multipart upload key=QFEI6H4EQ9ZR upload=EUW5LAVM2M0G tag=JJTSJ7OLC42B type=write size=1750569 2024-09-14T10:51:36.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.946+0000 7f19187cc780 1 > prepared operation key=W1K1IU13J0CZ tag=XFEDTSZAVOI9 type=write size=726285 2024-09-14T10:51:36.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.947+0000 7f19187cc780 1 < completed part key=_multipart_QFEI6H4EQ9ZR.2~A8VN2NQJBE00.0 size=77308 2024-09-14T10:51:36.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.950+0000 7f19187cc780 1 < completed multipart upload key=QFEI6H4EQ9ZR upload=A8VN2NQJBE00 tag=55O7HR3QUJBP type=write size=1125884 2024-09-14T10:51:36.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.951+0000 7f19187cc780 1 > prepared operation key=INJQTKXHBUV2 tag=EDMF6KNPSOA7 type=del size=1200887 2024-09-14T10:51:36.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.952+0000 7f19187cc780 1 < completed delete operation key=QFEI6H4EQ9ZR tag=K630PRGKGKG6 type=del 2024-09-14T10:51:36.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.956+0000 7f19187cc780 1 > prepared part key=_multipart_AST81B9QWORT.2~QBU115E9OFKR.0 size=1048576 2024-09-14T10:51:36.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.958+0000 7f19187cc780 1 > prepared part key=_multipart_AST81B9QWORT.2~QBU115E9OFKR.1 size=1048576 2024-09-14T10:51:36.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.959+0000 7f19187cc780 1 > prepared part key=_multipart_AST81B9QWORT.2~QBU115E9OFKR.2 size=928103 2024-09-14T10:51:36.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.959+0000 7f19187cc780 1 > prepared multipart upload key=AST81B9QWORT upload=QBU115E9OFKR tag=CDPBHK9U68RP type=write size=4073831 2024-09-14T10:51:36.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.960+0000 7f19187cc780 1 < completed write operation key=KP3WOGIF30PZ tag=8JITBCIGF4IX type=write size=278607 2024-09-14T10:51:36.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.963+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~QAQMXNJFE1E4.0 size=211293 2024-09-14T10:51:36.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.963+0000 7f19187cc780 1 > prepared multipart upload key=KOJ7QB7M6A35 upload=QAQMXNJFE1E4 tag=8VK1FTREMODL type=write size=1259869 2024-09-14T10:51:36.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.964+0000 7f19187cc780 1 < completed part key=_multipart_CADC2BY888V1.2~A6NBAI51VZ5T.0 size=1048576 2024-09-14T10:51:36.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.964+0000 7f19187cc780 1 < canceled part key=_multipart_CADC2BY888V1.2~A6NBAI51VZ5T.1 size=1048576 2024-09-14T10:51:36.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.965+0000 7f19187cc780 1 < completed part key=_multipart_CADC2BY888V1.2~A6NBAI51VZ5T.2 size=346631 2024-09-14T10:51:36.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.968+0000 7f19187cc780 1 < canceled multipart upload key=CADC2BY888V1 upload=A6NBAI51VZ5T tag=1RY4M5AEJ5G6 type=write size=3492359 2024-09-14T10:51:36.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.969+0000 7f19187cc780 1 > prepared operation key=QFEI6H4EQ9ZR tag=DRZ7C3SYIA2D type=del size=3345739 2024-09-14T10:51:36.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.971+0000 7f19187cc780 1 < completed part key=_multipart_KOJ7QB7M6A35.2~CE84WURVJOPM.0 size=1048576 2024-09-14T10:51:36.971 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.972+0000 7f19187cc780 1 < completed part key=_multipart_KOJ7QB7M6A35.2~CE84WURVJOPM.1 size=773744 2024-09-14T10:51:36.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.974+0000 7f19187cc780 1 < completed multipart upload key=KOJ7QB7M6A35 upload=CE84WURVJOPM tag=6E3IUJJF1O6M type=write size=2870896 2024-09-14T10:51:36.974 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.976+0000 7f19187cc780 1 > prepared operation key=AST81B9QWORT tag=6Z01PUOT67V4 type=del size=2333255 2024-09-14T10:51:36.976 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.977+0000 7f19187cc780 1 < completed delete operation key=QBMNYNWOLK4I tag=S1KUQWC6Q1CA type=del 2024-09-14T10:51:36.978 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.980+0000 7f19187cc780 1 > prepared part key=_multipart_617QQI921HB4.2~KSGWV7KFB8GS.0 size=1048576 2024-09-14T10:51:36.979 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.981+0000 7f19187cc780 1 > prepared part key=_multipart_617QQI921HB4.2~KSGWV7KFB8GS.1 size=577173 2024-09-14T10:51:36.979 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.981+0000 7f19187cc780 1 > prepared multipart upload key=617QQI921HB4 upload=KSGWV7KFB8GS tag=N5CQFWJ0A9V7 type=write size=2674325 2024-09-14T10:51:36.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.982+0000 7f19187cc780 1 < completed delete operation key=RTGE7ISETJWW tag=E446SJS2TTFX type=del 2024-09-14T10:51:36.982 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.984+0000 7f19187cc780 1 > prepared operation key=7IWUW2HC3ULI tag=RFKJH8ZKMXG4 type=del size=2679336 2024-09-14T10:51:36.983 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.985+0000 7f19187cc780 1 < completed delete operation key=5AIAYJMRZGFQ tag=MFPRGF13Q150 type=del 2024-09-14T10:51:36.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.986+0000 7f19187cc780 1 > prepared operation key=QFEI6H4EQ9ZR tag=BH0YZMID4Q29 type=del size=946613 2024-09-14T10:51:36.986 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.988+0000 7f19187cc780 1 < completed delete operation key=OVOPGTYUF3F3 tag=RQJHLJQ2CCO1 type=del 2024-09-14T10:51:36.988 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.989+0000 7f19187cc780 1 > prepared operation key=54BSD3DEHNK6 tag=3PQW4BOS8T74 type=del size=4132218 2024-09-14T10:51:36.989 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.991+0000 7f19187cc780 1 < completed write operation key=54BSD3DEHNK6 tag=5NJB0I1HA93E type=write size=512773 2024-09-14T10:51:36.990 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.992+0000 7f19187cc780 1 > prepared operation key=E6UO1LUWOC44 tag=R75CHA9AQI47 type=del size=457145 2024-09-14T10:51:36.993 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.995+0000 7f19187cc780 1 < suggested remove operation key=VW6U36JN2DBX tag=S5RAIJ71D1ES type=del 2024-09-14T10:51:36.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.996+0000 7f19187cc780 1 > prepared operation key=MFA30GSMCSKP tag=5FYJH0W6XXZ1 type=del size=949846 2024-09-14T10:51:36.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:36.997+0000 7f19187cc780 1 < completed part key=_multipart_54BSD3DEHNK6.2~N8C2E7IG0PGC.0 size=1023970 2024-09-14T10:51:36.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.000+0000 7f19187cc780 1 < completed multipart upload key=54BSD3DEHNK6 upload=N8C2E7IG0PGC tag=LPJHWRGY2FW3 type=write size=2072546 2024-09-14T10:51:37.001 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.002+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~PIQCAMXCCN3A.0 size=1048576 2024-09-14T10:51:37.002 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.003+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~PIQCAMXCCN3A.1 size=59086 2024-09-14T10:51:37.002 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.003+0000 7f19187cc780 1 > prepared multipart upload key=IKVYA4KEALFF upload=PIQCAMXCCN3A tag=V3SI8I9QPEWW type=write size=2156238 2024-09-14T10:51:37.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.005+0000 7f19187cc780 1 < completed part key=_multipart_KP3WOGIF30PZ.2~997WM2KUDCAV.0 size=1048576 2024-09-14T10:51:37.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.006+0000 7f19187cc780 1 < completed part key=_multipart_KP3WOGIF30PZ.2~997WM2KUDCAV.1 size=1048576 2024-09-14T10:51:37.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.007+0000 7f19187cc780 1 < completed part key=_multipart_KP3WOGIF30PZ.2~997WM2KUDCAV.2 size=299262 2024-09-14T10:51:37.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.009+0000 7f19187cc780 1 < completed multipart upload key=KP3WOGIF30PZ upload=997WM2KUDCAV tag=2RHA5JVIW7P4 type=write size=3444990 2024-09-14T10:51:37.009 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.011+0000 7f19187cc780 1 > prepared operation key=W1K1IU13J0CZ tag=H48ADUZRXJ9O type=del size=1816778 2024-09-14T10:51:37.010 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.012+0000 7f19187cc780 1 < completed write operation key=AST81B9QWORT tag=STB056W8RCOB type=write size=941000 2024-09-14T10:51:37.012 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.014+0000 7f19187cc780 1 > prepared operation key=QFEI6H4EQ9ZR tag=DTAJP1F8B5W0 type=del size=757874 2024-09-14T10:51:37.014 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.015+0000 7f19187cc780 1 < completed delete operation key=9EBD5ZT6MT45 tag=3A4P87YBEMU4 type=del 2024-09-14T10:51:37.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.017+0000 7f19187cc780 1 > prepared operation key=M73CER01XHDY tag=SV8QARHK0FPQ type=del size=1268168 2024-09-14T10:51:37.017 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.018+0000 7f19187cc780 1 < completed write operation key=W1K1IU13J0CZ tag=XFEDTSZAVOI9 type=write size=726285 2024-09-14T10:51:37.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.020+0000 7f19187cc780 1 > prepared operation key=E6UO1LUWOC44 tag=QOLO0IT1PL7L type=write size=74450 2024-09-14T10:51:37.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.022+0000 7f19187cc780 1 < completed delete operation key=INJQTKXHBUV2 tag=EDMF6KNPSOA7 type=del 2024-09-14T10:51:37.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.023+0000 7f19187cc780 1 > prepared operation key=CADC2BY888V1 tag=ANW41YNW7L00 type=del size=2403308 2024-09-14T10:51:37.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.024+0000 7f19187cc780 1 < completed part key=_multipart_AST81B9QWORT.2~QBU115E9OFKR.0 size=1048576 2024-09-14T10:51:37.024 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.026+0000 7f19187cc780 1 < completed part key=_multipart_AST81B9QWORT.2~QBU115E9OFKR.1 size=1048576 2024-09-14T10:51:37.025 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.027+0000 7f19187cc780 1 < completed part key=_multipart_AST81B9QWORT.2~QBU115E9OFKR.2 size=928103 2024-09-14T10:51:37.027 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.029+0000 7f19187cc780 1 < completed multipart upload key=AST81B9QWORT upload=QBU115E9OFKR tag=CDPBHK9U68RP type=write size=4073831 2024-09-14T10:51:37.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.030+0000 7f19187cc780 1 > prepared operation key=AGNUE76X8XCJ tag=6XM655ZUXXYH type=del size=4181207 2024-09-14T10:51:37.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.032+0000 7f19187cc780 1 < completed part key=_multipart_KOJ7QB7M6A35.2~QAQMXNJFE1E4.0 size=211293 2024-09-14T10:51:37.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.034+0000 7f19187cc780 1 < completed multipart upload key=KOJ7QB7M6A35 upload=QAQMXNJFE1E4 tag=8VK1FTREMODL type=write size=1259869 2024-09-14T10:51:37.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.036+0000 7f19187cc780 1 > prepared part key=_multipart_N0L67LS2KHR1.2~C0MPWBECLAAM.0 size=1048576 2024-09-14T10:51:37.036 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.038+0000 7f19187cc780 1 > prepared part key=_multipart_N0L67LS2KHR1.2~C0MPWBECLAAM.1 size=425409 2024-09-14T10:51:37.036 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.038+0000 7f19187cc780 1 > prepared multipart upload key=N0L67LS2KHR1 upload=C0MPWBECLAAM tag=UN8QR34D79UR type=write size=2522561 2024-09-14T10:51:37.037 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.039+0000 7f19187cc780 1 < completed delete operation key=QFEI6H4EQ9ZR tag=DRZ7C3SYIA2D type=del 2024-09-14T10:51:37.039 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.040+0000 7f19187cc780 1 > prepared operation key=6BNN842ZTWG5 tag=QT68WVWO1P4C type=del size=2589176 2024-09-14T10:51:37.040 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.042+0000 7f19187cc780 1 < completed delete operation key=AST81B9QWORT tag=6Z01PUOT67V4 type=del 2024-09-14T10:51:37.044 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.043+0000 7f19187cc780 1 > prepared operation key=MFA30GSMCSKP tag=UW393C8U271E type=del size=636513 2024-09-14T10:51:37.044 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.045+0000 7f19187cc780 1 < completed part key=_multipart_617QQI921HB4.2~KSGWV7KFB8GS.0 size=1048576 2024-09-14T10:51:37.044 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.046+0000 7f19187cc780 1 < completed part key=_multipart_617QQI921HB4.2~KSGWV7KFB8GS.1 size=577173 2024-09-14T10:51:37.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.048+0000 7f19187cc780 1 < completed multipart upload key=617QQI921HB4 upload=KSGWV7KFB8GS tag=N5CQFWJ0A9V7 type=write size=2674325 2024-09-14T10:51:37.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.051+0000 7f19187cc780 1 > prepared part key=_multipart_QBMNYNWOLK4I.2~SD9Q3F91QGW5.0 size=493935 2024-09-14T10:51:37.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.051+0000 7f19187cc780 1 > prepared multipart upload key=QBMNYNWOLK4I upload=SD9Q3F91QGW5 tag=KBPOC3DKI47C type=write size=1542511 2024-09-14T10:51:37.051 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.052+0000 7f19187cc780 1 < completed delete operation key=7IWUW2HC3ULI tag=RFKJH8ZKMXG4 type=del 2024-09-14T10:51:37.053 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.055+0000 7f19187cc780 1 > prepared part key=_multipart_AST81B9QWORT.2~4GDUS9Y10Y4Z.0 size=510294 2024-09-14T10:51:37.053 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.055+0000 7f19187cc780 1 > prepared multipart upload key=AST81B9QWORT upload=4GDUS9Y10Y4Z tag=SRK7UXJUK4FN type=write size=1558870 2024-09-14T10:51:37.054 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.056+0000 7f19187cc780 1 < completed delete operation key=QFEI6H4EQ9ZR tag=BH0YZMID4Q29 type=del 2024-09-14T10:51:37.059 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.061+0000 7f19187cc780 1 > prepared part key=_multipart_CADC2BY888V1.2~0VAQ89IDVNOE.0 size=1048576 2024-09-14T10:51:37.060 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.062+0000 7f19187cc780 1 > prepared part key=_multipart_CADC2BY888V1.2~0VAQ89IDVNOE.1 size=107915 2024-09-14T10:51:37.060 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.062+0000 7f19187cc780 1 > prepared multipart upload key=CADC2BY888V1 upload=0VAQ89IDVNOE tag=Q9V7GN9XGA58 type=write size=2205067 2024-09-14T10:51:37.062 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.063+0000 7f19187cc780 1 < completed delete operation key=54BSD3DEHNK6 tag=3PQW4BOS8T74 type=del 2024-09-14T10:51:37.063 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.065+0000 7f19187cc780 1 > prepared operation key=RTGE7ISETJWW tag=U8V1ONRCYS8S type=del size=680626 2024-09-14T10:51:37.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.066+0000 7f19187cc780 1 < canceled operation key=E6UO1LUWOC44 tag=R75CHA9AQI47 type=del size=457145 2024-09-14T10:51:37.066 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.068+0000 7f19187cc780 1 > prepared operation key=EZLSMEK89N2G tag=XD5AB6DKQTNH type=del size=3708751 2024-09-14T10:51:37.068 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.069+0000 7f19187cc780 1 < completed delete operation key=MFA30GSMCSKP tag=5FYJH0W6XXZ1 type=del 2024-09-14T10:51:37.069 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.071+0000 7f19187cc780 1 > prepared operation key=KP3WOGIF30PZ tag=2857MZHFZBPQ type=write size=999333 2024-09-14T10:51:37.070 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.072+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~PIQCAMXCCN3A.0 size=1048576 2024-09-14T10:51:37.072 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.073+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~PIQCAMXCCN3A.1 size=59086 2024-09-14T10:51:37.074 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.076+0000 7f19187cc780 1 < completed multipart upload key=IKVYA4KEALFF upload=PIQCAMXCCN3A tag=V3SI8I9QPEWW type=write size=2156238 2024-09-14T10:51:37.077 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.078+0000 7f19187cc780 1 > prepared part key=_multipart_54BSD3DEHNK6.2~A0IV1XD80JFA.0 size=1048576 2024-09-14T10:51:37.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.079+0000 7f19187cc780 1 > prepared part key=_multipart_54BSD3DEHNK6.2~A0IV1XD80JFA.1 size=1048576 2024-09-14T10:51:37.079 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.081+0000 7f19187cc780 1 > prepared part key=_multipart_54BSD3DEHNK6.2~A0IV1XD80JFA.2 size=466288 2024-09-14T10:51:37.079 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.081+0000 7f19187cc780 1 > prepared multipart upload key=54BSD3DEHNK6 upload=A0IV1XD80JFA tag=P53J9U4JXUFJ type=write size=3612016 2024-09-14T10:51:37.080 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.082+0000 7f19187cc780 1 < completed delete operation key=W1K1IU13J0CZ tag=H48ADUZRXJ9O type=del 2024-09-14T10:51:37.084 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.085+0000 7f19187cc780 1 > prepared operation key=54BSD3DEHNK6 tag=X0UREFHDKDM9 type=del size=2181931 2024-09-14T10:51:37.086 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.088+0000 7f19187cc780 1 < suggested update operation key=QFEI6H4EQ9ZR tag=DTAJP1F8B5W0 type=del size=757874 2024-09-14T10:51:37.089 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.091+0000 7f19187cc780 1 > prepared part key=_multipart_617QQI921HB4.2~963U6LUPHLCQ.0 size=593727 2024-09-14T10:51:37.089 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.091+0000 7f19187cc780 1 > prepared multipart upload key=617QQI921HB4 upload=963U6LUPHLCQ tag=5VT7SZHRPNOJ type=write size=1642303 2024-09-14T10:51:37.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.094+0000 7f19187cc780 1 < canceled operation key=M73CER01XHDY tag=SV8QARHK0FPQ type=del size=1268168 2024-09-14T10:51:37.095 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.096+0000 7f19187cc780 1 > prepared part key=_multipart_YA3DI7N4DG5K.2~HRLEQGMN0H6O.0 size=1048576 2024-09-14T10:51:37.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.098+0000 7f19187cc780 1 > prepared part key=_multipart_YA3DI7N4DG5K.2~HRLEQGMN0H6O.1 size=1048576 2024-09-14T10:51:37.097 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.099+0000 7f19187cc780 1 > prepared part key=_multipart_YA3DI7N4DG5K.2~HRLEQGMN0H6O.2 size=967209 2024-09-14T10:51:37.097 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.099+0000 7f19187cc780 1 > prepared multipart upload key=YA3DI7N4DG5K upload=HRLEQGMN0H6O tag=S7DKZBJHCI8H type=write size=4112937 2024-09-14T10:51:37.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.100+0000 7f19187cc780 1 < completed write operation key=E6UO1LUWOC44 tag=QOLO0IT1PL7L type=write size=74450 2024-09-14T10:51:37.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.104+0000 7f19187cc780 1 > prepared part key=_multipart_M73CER01XHDY.2~XRVGC4CRMSJ0.0 size=1048576 2024-09-14T10:51:37.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.105+0000 7f19187cc780 1 > prepared part key=_multipart_M73CER01XHDY.2~XRVGC4CRMSJ0.1 size=1048576 2024-09-14T10:51:37.104 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.106+0000 7f19187cc780 1 > prepared part key=_multipart_M73CER01XHDY.2~XRVGC4CRMSJ0.2 size=993145 2024-09-14T10:51:37.104 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.106+0000 7f19187cc780 1 > prepared multipart upload key=M73CER01XHDY upload=XRVGC4CRMSJ0 tag=M88ECKQT86VW type=write size=4138873 2024-09-14T10:51:37.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.107+0000 7f19187cc780 1 < completed delete operation key=CADC2BY888V1 tag=ANW41YNW7L00 type=del 2024-09-14T10:51:37.107 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.109+0000 7f19187cc780 1 > prepared operation key=M73CER01XHDY tag=34UO0QTFYU2O type=del size=1219360 2024-09-14T10:51:37.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.110+0000 7f19187cc780 1 < completed delete operation key=AGNUE76X8XCJ tag=6XM655ZUXXYH type=del 2024-09-14T10:51:37.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.113+0000 7f19187cc780 1 > prepared part key=_multipart_54BSD3DEHNK6.2~NJID40SC8THV.0 size=1048576 2024-09-14T10:51:37.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.114+0000 7f19187cc780 1 > prepared part key=_multipart_54BSD3DEHNK6.2~NJID40SC8THV.1 size=1048576 2024-09-14T10:51:37.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.115+0000 7f19187cc780 1 > prepared part key=_multipart_54BSD3DEHNK6.2~NJID40SC8THV.2 size=91712 2024-09-14T10:51:37.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.115+0000 7f19187cc780 1 > prepared multipart upload key=54BSD3DEHNK6 upload=NJID40SC8THV tag=7JBT0F9R0PMI type=write size=3237440 2024-09-14T10:51:37.115 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.117+0000 7f19187cc780 1 < completed part key=_multipart_N0L67LS2KHR1.2~C0MPWBECLAAM.0 size=1048576 2024-09-14T10:51:37.117 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.118+0000 7f19187cc780 1 < completed part key=_multipart_N0L67LS2KHR1.2~C0MPWBECLAAM.1 size=425409 2024-09-14T10:51:37.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.121+0000 7f19187cc780 1 < completed multipart upload key=N0L67LS2KHR1 upload=C0MPWBECLAAM tag=UN8QR34D79UR type=write size=2522561 2024-09-14T10:51:37.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.123+0000 7f19187cc780 1 > prepared operation key=19P3WE6HKJH2 tag=5ZAOYS97A4DI type=del size=3639729 2024-09-14T10:51:37.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.127+0000 7f19187cc780 1 < suggested remove operation key=6BNN842ZTWG5 tag=QT68WVWO1P4C type=del 2024-09-14T10:51:37.127 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.128+0000 7f19187cc780 1 > prepared operation key=IKVYA4KEALFF tag=B6V62N5AB43H type=del size=1774809 2024-09-14T10:51:37.128 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.130+0000 7f19187cc780 1 < completed delete operation key=MFA30GSMCSKP tag=UW393C8U271E type=del 2024-09-14T10:51:37.131 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.133+0000 7f19187cc780 1 > prepared part key=_multipart_AST81B9QWORT.2~U26952FI2LDA.0 size=1048576 2024-09-14T10:51:37.132 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.134+0000 7f19187cc780 1 > prepared part key=_multipart_AST81B9QWORT.2~U26952FI2LDA.1 size=1048576 2024-09-14T10:51:37.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.135+0000 7f19187cc780 1 > prepared part key=_multipart_AST81B9QWORT.2~U26952FI2LDA.2 size=395865 2024-09-14T10:51:37.134 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.135+0000 7f19187cc780 1 > prepared multipart upload key=AST81B9QWORT upload=U26952FI2LDA tag=DF1CSZOFDV0F type=write size=3541593 2024-09-14T10:51:37.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.137+0000 7f19187cc780 1 < completed part key=_multipart_QBMNYNWOLK4I.2~SD9Q3F91QGW5.0 size=493935 2024-09-14T10:51:37.137 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.139+0000 7f19187cc780 1 < completed multipart upload key=QBMNYNWOLK4I upload=SD9Q3F91QGW5 tag=KBPOC3DKI47C type=write size=1542511 2024-09-14T10:51:37.140 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.142+0000 7f19187cc780 1 > prepared part key=_multipart_617QQI921HB4.2~278PGLJU3KS3.0 size=1031307 2024-09-14T10:51:37.140 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.142+0000 7f19187cc780 1 > prepared multipart upload key=617QQI921HB4 upload=278PGLJU3KS3 tag=0HVP25RCISSJ type=write size=2079883 2024-09-14T10:51:37.140 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.142+0000 7f19187cc780 1 < canceled part key=_multipart_AST81B9QWORT.2~4GDUS9Y10Y4Z.0 size=510294 2024-09-14T10:51:37.143 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.144+0000 7f19187cc780 1 < canceled multipart upload key=AST81B9QWORT upload=4GDUS9Y10Y4Z tag=SRK7UXJUK4FN type=write size=1558870 2024-09-14T10:51:37.144 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.146+0000 7f19187cc780 1 > prepared operation key=CADC2BY888V1 tag=5ZVMDV1RPR0I type=write size=315014 2024-09-14T10:51:37.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.148+0000 7f19187cc780 1 < completed part key=_multipart_CADC2BY888V1.2~0VAQ89IDVNOE.0 size=1048576 2024-09-14T10:51:37.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.148+0000 7f19187cc780 1 < canceled part key=_multipart_CADC2BY888V1.2~0VAQ89IDVNOE.1 size=107915 2024-09-14T10:51:37.148 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.150+0000 7f19187cc780 1 < canceled multipart upload key=CADC2BY888V1 upload=0VAQ89IDVNOE tag=Q9V7GN9XGA58 type=write size=2205067 2024-09-14T10:51:37.150 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.152+0000 7f19187cc780 1 > prepared operation key=IKVYA4KEALFF tag=DZ20Z2JCDAB0 type=del size=1210596 2024-09-14T10:51:37.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.153+0000 7f19187cc780 1 < completed delete operation key=RTGE7ISETJWW tag=U8V1ONRCYS8S type=del 2024-09-14T10:51:37.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.154+0000 7f19187cc780 1 > prepared operation key=617QQI921HB4 tag=U0HJXYGN7JPQ type=write size=903107 2024-09-14T10:51:37.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.156+0000 7f19187cc780 1 < completed delete operation key=EZLSMEK89N2G tag=XD5AB6DKQTNH type=del 2024-09-14T10:51:37.156 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.157+0000 7f19187cc780 1 > prepared operation key=19P3WE6HKJH2 tag=GHGS961XZNGJ type=del size=4093991 2024-09-14T10:51:37.157 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.159+0000 7f19187cc780 1 < completed write operation key=KP3WOGIF30PZ tag=2857MZHFZBPQ type=write size=999333 2024-09-14T10:51:37.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.160+0000 7f19187cc780 1 > prepared operation key=EL00Y4Z7DTAT tag=FBQ56YMZ0XRQ type=del size=296591 2024-09-14T10:51:37.160 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.162+0000 7f19187cc780 1 < completed part key=_multipart_54BSD3DEHNK6.2~A0IV1XD80JFA.0 size=1048576 2024-09-14T10:51:37.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.163+0000 7f19187cc780 1 < completed part key=_multipart_54BSD3DEHNK6.2~A0IV1XD80JFA.1 size=1048576 2024-09-14T10:51:37.162 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.164+0000 7f19187cc780 1 < completed part key=_multipart_54BSD3DEHNK6.2~A0IV1XD80JFA.2 size=466288 2024-09-14T10:51:37.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.166+0000 7f19187cc780 1 < completed multipart upload key=54BSD3DEHNK6 upload=A0IV1XD80JFA tag=P53J9U4JXUFJ type=write size=3612016 2024-09-14T10:51:37.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.168+0000 7f19187cc780 1 > prepared operation key=KOJ7QB7M6A35 tag=R1CKCQ0235WP type=del size=3903198 2024-09-14T10:51:37.168 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.169+0000 7f19187cc780 1 < completed delete operation key=54BSD3DEHNK6 tag=X0UREFHDKDM9 type=del 2024-09-14T10:51:37.171 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.172+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~S8JOKREUNU53.0 size=1048576 2024-09-14T10:51:37.172 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.173+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~S8JOKREUNU53.1 size=1048576 2024-09-14T10:51:37.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.175+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~S8JOKREUNU53.2 size=837248 2024-09-14T10:51:37.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.175+0000 7f19187cc780 1 > prepared multipart upload key=VW6U36JN2DBX upload=S8JOKREUNU53 tag=KHMQR8PGJ0DH type=write size=3982976 2024-09-14T10:51:37.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.175+0000 7f19187cc780 1 < canceled part key=_multipart_617QQI921HB4.2~963U6LUPHLCQ.0 size=593727 2024-09-14T10:51:37.176 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.177+0000 7f19187cc780 1 < canceled multipart upload key=617QQI921HB4 upload=963U6LUPHLCQ tag=5VT7SZHRPNOJ type=write size=1642303 2024-09-14T10:51:37.177 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.179+0000 7f19187cc780 1 > prepared operation key=CADC2BY888V1 tag=L2GRJTK1YBNF type=del size=1619726 2024-09-14T10:51:37.179 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.181+0000 7f19187cc780 1 < completed part key=_multipart_YA3DI7N4DG5K.2~HRLEQGMN0H6O.0 size=1048576 2024-09-14T10:51:37.180 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.182+0000 7f19187cc780 1 < completed part key=_multipart_YA3DI7N4DG5K.2~HRLEQGMN0H6O.1 size=1048576 2024-09-14T10:51:37.182 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.183+0000 7f19187cc780 1 < completed part key=_multipart_YA3DI7N4DG5K.2~HRLEQGMN0H6O.2 size=967209 2024-09-14T10:51:37.184 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.186+0000 7f19187cc780 1 < completed multipart upload key=YA3DI7N4DG5K upload=HRLEQGMN0H6O tag=S7DKZBJHCI8H type=write size=4112937 2024-09-14T10:51:37.187 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.188+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~WH626G1KPQJ3.0 size=570991 2024-09-14T10:51:37.187 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.188+0000 7f19187cc780 1 > prepared multipart upload key=XCVE2F2JJK4X upload=WH626G1KPQJ3 tag=7M0UI3NQK3PU type=write size=1619567 2024-09-14T10:51:37.187 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.189+0000 7f19187cc780 1 < canceled part key=_multipart_M73CER01XHDY.2~XRVGC4CRMSJ0.0 size=1048576 2024-09-14T10:51:37.188 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.190+0000 7f19187cc780 1 < completed part key=_multipart_M73CER01XHDY.2~XRVGC4CRMSJ0.1 size=1048576 2024-09-14T10:51:37.189 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.191+0000 7f19187cc780 1 < completed part key=_multipart_M73CER01XHDY.2~XRVGC4CRMSJ0.2 size=993145 2024-09-14T10:51:37.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.193+0000 7f19187cc780 1 < canceled multipart upload key=M73CER01XHDY upload=XRVGC4CRMSJ0 tag=M88ECKQT86VW type=write size=4138873 2024-09-14T10:51:37.193 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.195+0000 7f19187cc780 1 > prepared operation key=INJQTKXHBUV2 tag=4UFT60YZJSW3 type=write size=1013067 2024-09-14T10:51:37.195 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.196+0000 7f19187cc780 1 < completed delete operation key=M73CER01XHDY tag=34UO0QTFYU2O type=del 2024-09-14T10:51:37.196 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.198+0000 7f19187cc780 1 > prepared operation key=H40763V7HMBC tag=JPZ29V5NDLAY type=del size=2455240 2024-09-14T10:51:37.198 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.199+0000 7f19187cc780 1 < completed part key=_multipart_54BSD3DEHNK6.2~NJID40SC8THV.0 size=1048576 2024-09-14T10:51:37.199 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.200+0000 7f19187cc780 1 < completed part key=_multipart_54BSD3DEHNK6.2~NJID40SC8THV.1 size=1048576 2024-09-14T10:51:37.200 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.201+0000 7f19187cc780 1 < completed part key=_multipart_54BSD3DEHNK6.2~NJID40SC8THV.2 size=91712 2024-09-14T10:51:37.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.204+0000 7f19187cc780 1 < completed multipart upload key=54BSD3DEHNK6 upload=NJID40SC8THV tag=7JBT0F9R0PMI type=write size=3237440 2024-09-14T10:51:37.205 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.207+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~4PFNLK243WVG.0 size=6982 2024-09-14T10:51:37.205 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.207+0000 7f19187cc780 1 > prepared multipart upload key=AGNUE76X8XCJ upload=4PFNLK243WVG tag=FX17GGN9IIIY type=write size=1055558 2024-09-14T10:51:37.207 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.208+0000 7f19187cc780 1 < completed delete operation key=19P3WE6HKJH2 tag=5ZAOYS97A4DI type=del 2024-09-14T10:51:37.208 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.210+0000 7f19187cc780 1 > prepared operation key=AGNUE76X8XCJ tag=N4388GJ5EWJY type=del size=1783384 2024-09-14T10:51:37.211 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.212+0000 7f19187cc780 1 < suggested remove operation key=IKVYA4KEALFF tag=B6V62N5AB43H type=del 2024-09-14T10:51:37.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.214+0000 7f19187cc780 1 > prepared operation key=KOJ7QB7M6A35 tag=VAYEU4IAWND5 type=del size=2993377 2024-09-14T10:51:37.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.217+0000 7f19187cc780 1 < completed part key=_multipart_AST81B9QWORT.2~U26952FI2LDA.0 size=1048576 2024-09-14T10:51:37.217 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.218+0000 7f19187cc780 1 < completed part key=_multipart_AST81B9QWORT.2~U26952FI2LDA.1 size=1048576 2024-09-14T10:51:37.218 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.219+0000 7f19187cc780 1 < completed part key=_multipart_AST81B9QWORT.2~U26952FI2LDA.2 size=395865 2024-09-14T10:51:37.220 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.222+0000 7f19187cc780 1 < completed multipart upload key=AST81B9QWORT upload=U26952FI2LDA tag=DF1CSZOFDV0F type=write size=3541593 2024-09-14T10:51:37.222 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.223+0000 7f19187cc780 1 > prepared operation key=B9FQYIX19AEP tag=2WJVLHOFKUPT type=del size=1547029 2024-09-14T10:51:37.223 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.225+0000 7f19187cc780 1 < completed part key=_multipart_617QQI921HB4.2~278PGLJU3KS3.0 size=1031307 2024-09-14T10:51:37.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.228+0000 7f19187cc780 1 < completed multipart upload key=617QQI921HB4 upload=278PGLJU3KS3 tag=0HVP25RCISSJ type=write size=2079883 2024-09-14T10:51:37.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.229+0000 7f19187cc780 1 > prepared operation key=5AIAYJMRZGFQ tag=FJZTIDIBBW3A type=del size=119416 2024-09-14T10:51:37.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.231+0000 7f19187cc780 1 < completed write operation key=CADC2BY888V1 tag=5ZVMDV1RPR0I type=write size=315014 2024-09-14T10:51:37.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.234+0000 7f19187cc780 1 > prepared part key=_multipart_617QQI921HB4.2~R8BDK41HSG6D.0 size=1048576 2024-09-14T10:51:37.234 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.235+0000 7f19187cc780 1 > prepared part key=_multipart_617QQI921HB4.2~R8BDK41HSG6D.1 size=946782 2024-09-14T10:51:37.234 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.235+0000 7f19187cc780 1 > prepared multipart upload key=617QQI921HB4 upload=R8BDK41HSG6D tag=K01FL5WQFIHK type=write size=3043934 2024-09-14T10:51:37.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.237+0000 7f19187cc780 -1 < failed to complete operation key=IKVYA4KEALFF tag=DZ20Z2JCDAB0 type=del size=1210596: (22) Invalid argument 2024-09-14T10:51:37.236 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.238+0000 7f19187cc780 1 > prepared operation key=AST81B9QWORT tag=O6HGUL91QQMX type=del size=2661465 2024-09-14T10:51:37.238 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.240+0000 7f19187cc780 1 < completed write operation key=617QQI921HB4 tag=U0HJXYGN7JPQ type=write size=903107 2024-09-14T10:51:37.239 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.241+0000 7f19187cc780 1 > prepared operation key=INJQTKXHBUV2 tag=5ODF7UYTPSS5 type=del size=357508 2024-09-14T10:51:37.241 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.242+0000 7f19187cc780 1 < completed delete operation key=19P3WE6HKJH2 tag=GHGS961XZNGJ type=del 2024-09-14T10:51:37.242 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.244+0000 7f19187cc780 1 > prepared operation key=YA3DI7N4DG5K tag=48SLG1241YF7 type=del size=4144921 2024-09-14T10:51:37.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.245+0000 7f19187cc780 1 < completed delete operation key=EL00Y4Z7DTAT tag=FBQ56YMZ0XRQ type=del 2024-09-14T10:51:37.248 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.248+0000 7f19187cc780 1 > prepared part key=_multipart_AST81B9QWORT.2~V0V5VJOZKEGO.0 size=1048576 2024-09-14T10:51:37.248 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.249+0000 7f19187cc780 1 > prepared part key=_multipart_AST81B9QWORT.2~V0V5VJOZKEGO.1 size=669421 2024-09-14T10:51:37.248 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.249+0000 7f19187cc780 1 > prepared multipart upload key=AST81B9QWORT upload=V0V5VJOZKEGO tag=E37F41NHT1A3 type=write size=2766573 2024-09-14T10:51:37.250 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.252+0000 7f19187cc780 1 < suggested remove operation key=KOJ7QB7M6A35 tag=R1CKCQ0235WP type=del 2024-09-14T10:51:37.253 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.254+0000 7f19187cc780 1 > prepared part key=_multipart_RTGE7ISETJWW.2~8ST2IL1A5CPK.0 size=1048576 2024-09-14T10:51:37.254 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.256+0000 7f19187cc780 1 > prepared part key=_multipart_RTGE7ISETJWW.2~8ST2IL1A5CPK.1 size=341883 2024-09-14T10:51:37.254 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.256+0000 7f19187cc780 1 > prepared multipart upload key=RTGE7ISETJWW upload=8ST2IL1A5CPK tag=E700FLBVI8QR type=write size=2439035 2024-09-14T10:51:37.255 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.257+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~S8JOKREUNU53.0 size=1048576 2024-09-14T10:51:37.257 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.258+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~S8JOKREUNU53.1 size=1048576 2024-09-14T10:51:37.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.259+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~S8JOKREUNU53.2 size=837248 2024-09-14T10:51:37.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.262+0000 7f19187cc780 1 < completed multipart upload key=VW6U36JN2DBX upload=S8JOKREUNU53 tag=KHMQR8PGJ0DH type=write size=3982976 2024-09-14T10:51:37.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.263+0000 7f19187cc780 1 > prepared operation key=5AIAYJMRZGFQ tag=Y6YPQHK02DHM type=del size=2203690 2024-09-14T10:51:37.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.266+0000 7f19187cc780 1 < suggested update operation key=CADC2BY888V1 tag=L2GRJTK1YBNF type=del size=1619726 2024-09-14T10:51:37.266 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.268+0000 7f19187cc780 1 > prepared operation key=XCVE2F2JJK4X tag=NH8RHCZH45RH type=del size=1877434 2024-09-14T10:51:37.268 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.269+0000 7f19187cc780 1 < completed part key=_multipart_XCVE2F2JJK4X.2~WH626G1KPQJ3.0 size=570991 2024-09-14T10:51:37.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.272+0000 7f19187cc780 1 < completed multipart upload key=XCVE2F2JJK4X upload=WH626G1KPQJ3 tag=7M0UI3NQK3PU type=write size=1619567 2024-09-14T10:51:37.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.274+0000 7f19187cc780 1 > prepared part key=_multipart_EL00Y4Z7DTAT.2~1L5U5FIULJTP.0 size=1048576 2024-09-14T10:51:37.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.275+0000 7f19187cc780 1 > prepared part key=_multipart_EL00Y4Z7DTAT.2~1L5U5FIULJTP.1 size=141025 2024-09-14T10:51:37.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.275+0000 7f19187cc780 1 > prepared multipart upload key=EL00Y4Z7DTAT upload=1L5U5FIULJTP tag=X71KZHIQ45JM type=write size=2238177 2024-09-14T10:51:37.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.277+0000 7f19187cc780 1 < canceled operation key=INJQTKXHBUV2 tag=4UFT60YZJSW3 type=write size=1013067 2024-09-14T10:51:37.278 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.279+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~FYBH5HJ6DRSY.0 size=1048576 2024-09-14T10:51:37.279 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.280+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~FYBH5HJ6DRSY.1 size=1048576 2024-09-14T10:51:37.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.282+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~FYBH5HJ6DRSY.2 size=200551 2024-09-14T10:51:37.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.282+0000 7f19187cc780 1 > prepared multipart upload key=KOJ7QB7M6A35 upload=FYBH5HJ6DRSY tag=IXOKKC5MYDNQ type=write size=3346279 2024-09-14T10:51:37.281 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.283+0000 7f19187cc780 1 < completed delete operation key=H40763V7HMBC tag=JPZ29V5NDLAY type=del 2024-09-14T10:51:37.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.284+0000 7f19187cc780 1 > prepared operation key=EZLSMEK89N2G tag=DD3N1GWZXT8F type=del size=2094789 2024-09-14T10:51:37.284 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.286+0000 7f19187cc780 1 < completed part key=_multipart_AGNUE76X8XCJ.2~4PFNLK243WVG.0 size=6982 2024-09-14T10:51:37.286 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.288+0000 7f19187cc780 1 < completed multipart upload key=AGNUE76X8XCJ upload=4PFNLK243WVG tag=FX17GGN9IIIY type=write size=1055558 2024-09-14T10:51:37.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.291+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~AOHV95CDSP0M.0 size=1048576 2024-09-14T10:51:37.290 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.292+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~AOHV95CDSP0M.1 size=1048576 2024-09-14T10:51:37.291 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.293+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~AOHV95CDSP0M.2 size=779449 2024-09-14T10:51:37.291 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.293+0000 7f19187cc780 1 > prepared multipart upload key=VW6U36JN2DBX upload=AOHV95CDSP0M tag=W0MW83OSIOGR type=write size=3925177 2024-09-14T10:51:37.292 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.294+0000 7f19187cc780 1 < completed delete operation key=AGNUE76X8XCJ tag=N4388GJ5EWJY type=del 2024-09-14T10:51:37.294 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.295+0000 7f19187cc780 1 > prepared operation key=YA3DI7N4DG5K tag=Y4IE8XQ9X47I type=del size=3291726 2024-09-14T10:51:37.295 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.297+0000 7f19187cc780 -1 < failed to complete operation key=KOJ7QB7M6A35 tag=VAYEU4IAWND5 type=del size=2993377: (22) Invalid argument 2024-09-14T10:51:37.296 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.298+0000 7f19187cc780 1 > prepared operation key=EL00Y4Z7DTAT tag=XNQ34294LFOW type=write size=243246 2024-09-14T10:51:37.298 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.299+0000 7f19187cc780 1 < completed delete operation key=B9FQYIX19AEP tag=2WJVLHOFKUPT type=del 2024-09-14T10:51:37.299 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.301+0000 7f19187cc780 1 > prepared operation key=W1K1IU13J0CZ tag=A4LXFDGYR0GA type=write size=800417 2024-09-14T10:51:37.300 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.302+0000 7f19187cc780 1 < canceled operation key=5AIAYJMRZGFQ tag=FJZTIDIBBW3A type=del size=119416 2024-09-14T10:51:37.303 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.305+0000 7f19187cc780 1 > prepared part key=_multipart_W1K1IU13J0CZ.2~8HYG8MNGZ243.0 size=1048576 2024-09-14T10:51:37.304 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.306+0000 7f19187cc780 1 > prepared part key=_multipart_W1K1IU13J0CZ.2~8HYG8MNGZ243.1 size=1048576 2024-09-14T10:51:37.305 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.307+0000 7f19187cc780 1 > prepared part key=_multipart_W1K1IU13J0CZ.2~8HYG8MNGZ243.2 size=877584 2024-09-14T10:51:37.305 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.307+0000 7f19187cc780 1 > prepared multipart upload key=W1K1IU13J0CZ upload=8HYG8MNGZ243 tag=2CL3N2FJR79C type=write size=4023312 2024-09-14T10:51:37.307 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.308+0000 7f19187cc780 1 < completed part key=_multipart_617QQI921HB4.2~R8BDK41HSG6D.0 size=1048576 2024-09-14T10:51:37.308 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.310+0000 7f19187cc780 1 < completed part key=_multipart_617QQI921HB4.2~R8BDK41HSG6D.1 size=946782 2024-09-14T10:51:37.311 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.312+0000 7f19187cc780 1 < completed multipart upload key=617QQI921HB4 upload=R8BDK41HSG6D tag=K01FL5WQFIHK type=write size=3043934 2024-09-14T10:51:37.313 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.315+0000 7f19187cc780 1 > prepared part key=_multipart_QBMNYNWOLK4I.2~8BV2Z7FNARP6.0 size=902515 2024-09-14T10:51:37.314 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.315+0000 7f19187cc780 1 > prepared multipart upload key=QBMNYNWOLK4I upload=8BV2Z7FNARP6 tag=PXQS6QISNHLB type=write size=1951091 2024-09-14T10:51:37.315 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.317+0000 7f19187cc780 1 < completed delete operation key=AST81B9QWORT tag=O6HGUL91QQMX type=del 2024-09-14T10:51:37.316 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.318+0000 7f19187cc780 1 > prepared operation key=YA3DI7N4DG5K tag=UEPF33O1455L type=del size=931529 2024-09-14T10:51:37.318 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.320+0000 7f19187cc780 1 < completed delete operation key=INJQTKXHBUV2 tag=5ODF7UYTPSS5 type=del 2024-09-14T10:51:37.320 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.322+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~BYLTT8SXW6R8.0 size=909883 2024-09-14T10:51:37.321 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.322+0000 7f19187cc780 1 > prepared multipart upload key=7IWUW2HC3ULI upload=BYLTT8SXW6R8 tag=S8K1W5PV2PA9 type=write size=1958459 2024-09-14T10:51:37.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.324+0000 7f19187cc780 1 < completed delete operation key=YA3DI7N4DG5K tag=48SLG1241YF7 type=del 2024-09-14T10:51:37.324 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.325+0000 7f19187cc780 1 > prepared operation key=VW6U36JN2DBX tag=FJ63BONKHRLX type=del size=1988160 2024-09-14T10:51:37.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.327+0000 7f19187cc780 1 < completed part key=_multipart_AST81B9QWORT.2~V0V5VJOZKEGO.0 size=1048576 2024-09-14T10:51:37.326 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.328+0000 7f19187cc780 1 < completed part key=_multipart_AST81B9QWORT.2~V0V5VJOZKEGO.1 size=669421 2024-09-14T10:51:37.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.330+0000 7f19187cc780 1 < completed multipart upload key=AST81B9QWORT upload=V0V5VJOZKEGO tag=E37F41NHT1A3 type=write size=2766573 2024-09-14T10:51:37.330 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.331+0000 7f19187cc780 1 > prepared operation key=N0L67LS2KHR1 tag=BVQSKV108D2L type=del size=950668 2024-09-14T10:51:37.331 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.333+0000 7f19187cc780 1 < completed part key=_multipart_RTGE7ISETJWW.2~8ST2IL1A5CPK.0 size=1048576 2024-09-14T10:51:37.332 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.334+0000 7f19187cc780 1 < completed part key=_multipart_RTGE7ISETJWW.2~8ST2IL1A5CPK.1 size=341883 2024-09-14T10:51:37.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.336+0000 7f19187cc780 1 < completed multipart upload key=RTGE7ISETJWW upload=8ST2IL1A5CPK tag=E700FLBVI8QR type=write size=2439035 2024-09-14T10:51:37.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.338+0000 7f19187cc780 1 > prepared operation key=6BNN842ZTWG5 tag=L2Y02ZJSNI00 type=del size=3271428 2024-09-14T10:51:37.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.339+0000 7f19187cc780 1 < completed delete operation key=5AIAYJMRZGFQ tag=Y6YPQHK02DHM type=del 2024-09-14T10:51:37.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.342+0000 7f19187cc780 1 > prepared part key=_multipart_617QQI921HB4.2~QBXMFL4QJTG5.0 size=1048576 2024-09-14T10:51:37.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.343+0000 7f19187cc780 1 > prepared part key=_multipart_617QQI921HB4.2~QBXMFL4QJTG5.1 size=1048576 2024-09-14T10:51:37.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.344+0000 7f19187cc780 1 > prepared part key=_multipart_617QQI921HB4.2~QBXMFL4QJTG5.2 size=173395 2024-09-14T10:51:37.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.344+0000 7f19187cc780 1 > prepared multipart upload key=617QQI921HB4 upload=QBXMFL4QJTG5 tag=UNI2E5QCFX88 type=write size=3319123 2024-09-14T10:51:37.344 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.346+0000 7f19187cc780 1 < canceled operation key=XCVE2F2JJK4X tag=NH8RHCZH45RH type=del size=1877434 2024-09-14T10:51:37.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.348+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~CZ47V9QXADAB.0 size=1048576 2024-09-14T10:51:37.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.349+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~CZ47V9QXADAB.1 size=1048576 2024-09-14T10:51:37.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.351+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~CZ47V9QXADAB.2 size=902540 2024-09-14T10:51:37.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.351+0000 7f19187cc780 1 > prepared multipart upload key=KOJ7QB7M6A35 upload=CZ47V9QXADAB tag=FB3ZPYB4OUYK type=write size=4048268 2024-09-14T10:51:37.352 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.354+0000 7f19187cc780 1 < completed part key=_multipart_EL00Y4Z7DTAT.2~1L5U5FIULJTP.0 size=1048576 2024-09-14T10:51:37.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.355+0000 7f19187cc780 1 < completed part key=_multipart_EL00Y4Z7DTAT.2~1L5U5FIULJTP.1 size=141025 2024-09-14T10:51:37.356 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.357+0000 7f19187cc780 1 < completed multipart upload key=EL00Y4Z7DTAT upload=1L5U5FIULJTP tag=X71KZHIQ45JM type=write size=2238177 2024-09-14T10:51:37.358 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.360+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~JWOXZI2VJWWN.0 size=890726 2024-09-14T10:51:37.359 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.360+0000 7f19187cc780 1 > prepared multipart upload key=B9FQYIX19AEP upload=JWOXZI2VJWWN tag=BLM518S5MMTG type=write size=1939302 2024-09-14T10:51:37.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.362+0000 7f19187cc780 1 < completed part key=_multipart_KOJ7QB7M6A35.2~FYBH5HJ6DRSY.0 size=1048576 2024-09-14T10:51:37.361 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.363+0000 7f19187cc780 1 < completed part key=_multipart_KOJ7QB7M6A35.2~FYBH5HJ6DRSY.1 size=1048576 2024-09-14T10:51:37.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.364+0000 7f19187cc780 1 < completed part key=_multipart_KOJ7QB7M6A35.2~FYBH5HJ6DRSY.2 size=200551 2024-09-14T10:51:37.366 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.368+0000 7f19187cc780 1 < completed multipart upload key=KOJ7QB7M6A35 upload=FYBH5HJ6DRSY tag=IXOKKC5MYDNQ type=write size=3346279 2024-09-14T10:51:37.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.369+0000 7f19187cc780 1 > prepared operation key=RTGE7ISETJWW tag=8T1ZUIO75HYC type=del size=1248280 2024-09-14T10:51:37.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.372+0000 7f19187cc780 1 < suggested remove operation key=EZLSMEK89N2G tag=DD3N1GWZXT8F type=del 2024-09-14T10:51:37.372 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.373+0000 7f19187cc780 1 > prepared operation key=VW6U36JN2DBX tag=4RC4VDCMOPTI type=del size=3344668 2024-09-14T10:51:37.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.375+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~AOHV95CDSP0M.0 size=1048576 2024-09-14T10:51:37.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.376+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~AOHV95CDSP0M.1 size=1048576 2024-09-14T10:51:37.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.377+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~AOHV95CDSP0M.2 size=779449 2024-09-14T10:51:37.379 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.381+0000 7f19187cc780 1 < completed multipart upload key=VW6U36JN2DBX upload=AOHV95CDSP0M tag=W0MW83OSIOGR type=write size=3925177 2024-09-14T10:51:37.382 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.383+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~UFQFYU48WE0V.0 size=1048576 2024-09-14T10:51:37.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.384+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~UFQFYU48WE0V.1 size=828645 2024-09-14T10:51:37.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.384+0000 7f19187cc780 1 > prepared multipart upload key=VW6U36JN2DBX upload=UFQFYU48WE0V tag=2ZD218TGRNIQ type=write size=2925797 2024-09-14T10:51:37.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.386+0000 7f19187cc780 1 < canceled operation key=YA3DI7N4DG5K tag=Y4IE8XQ9X47I type=del size=3291726 2024-09-14T10:51:37.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.387+0000 7f19187cc780 1 > prepared operation key=W1K1IU13J0CZ tag=R79PYE9W3EQN type=del size=2947249 2024-09-14T10:51:37.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.389+0000 7f19187cc780 1 < completed write operation key=EL00Y4Z7DTAT tag=XNQ34294LFOW type=write size=243246 2024-09-14T10:51:37.390 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.391+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~YIFV5YI4U7BA.0 size=1048576 2024-09-14T10:51:37.391 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.392+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~YIFV5YI4U7BA.1 size=510313 2024-09-14T10:51:37.391 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.392+0000 7f19187cc780 1 > prepared multipart upload key=IKVYA4KEALFF upload=YIFV5YI4U7BA tag=UXWUZ8ISBRKJ type=write size=2607465 2024-09-14T10:51:37.392 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.394+0000 7f19187cc780 1 < completed write operation key=W1K1IU13J0CZ tag=A4LXFDGYR0GA type=write size=800417 2024-09-14T10:51:37.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.395+0000 7f19187cc780 1 > prepared operation key=IKVYA4KEALFF tag=DZFLBJTS183P type=write size=941610 2024-09-14T10:51:37.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.397+0000 7f19187cc780 1 < completed part key=_multipart_W1K1IU13J0CZ.2~8HYG8MNGZ243.0 size=1048576 2024-09-14T10:51:37.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.398+0000 7f19187cc780 1 < completed part key=_multipart_W1K1IU13J0CZ.2~8HYG8MNGZ243.1 size=1048576 2024-09-14T10:51:37.397 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.399+0000 7f19187cc780 1 < completed part key=_multipart_W1K1IU13J0CZ.2~8HYG8MNGZ243.2 size=877584 2024-09-14T10:51:37.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.401+0000 7f19187cc780 1 < completed multipart upload key=W1K1IU13J0CZ upload=8HYG8MNGZ243 tag=2CL3N2FJR79C type=write size=4023312 2024-09-14T10:51:37.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.404+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~6FEFXI1ZD4ZM.0 size=1048576 2024-09-14T10:51:37.403 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.405+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~6FEFXI1ZD4ZM.1 size=349901 2024-09-14T10:51:37.403 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.405+0000 7f19187cc780 1 > prepared multipart upload key=KP3WOGIF30PZ upload=6FEFXI1ZD4ZM tag=TKV2MSHUXQVE type=write size=2447053 2024-09-14T10:51:37.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.406+0000 7f19187cc780 1 < completed part key=_multipart_QBMNYNWOLK4I.2~8BV2Z7FNARP6.0 size=902515 2024-09-14T10:51:37.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.408+0000 7f19187cc780 1 < completed multipart upload key=QBMNYNWOLK4I upload=8BV2Z7FNARP6 tag=PXQS6QISNHLB type=write size=1951091 2024-09-14T10:51:37.410 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.411+0000 7f19187cc780 1 > prepared part key=_multipart_5AIAYJMRZGFQ.2~QSOFC6T89K3C.0 size=16734 2024-09-14T10:51:37.410 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.411+0000 7f19187cc780 1 > prepared multipart upload key=5AIAYJMRZGFQ upload=QSOFC6T89K3C tag=Z9SOG5HT1U4O type=write size=1065310 2024-09-14T10:51:37.411 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.413+0000 7f19187cc780 1 < completed delete operation key=YA3DI7N4DG5K tag=UEPF33O1455L type=del 2024-09-14T10:51:37.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.415+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~HHPCN9LZ51SK.0 size=892328 2024-09-14T10:51:37.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.415+0000 7f19187cc780 1 > prepared multipart upload key=7IWUW2HC3ULI upload=HHPCN9LZ51SK tag=813Q5C52ZFEV type=write size=1940904 2024-09-14T10:51:37.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.416+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~BYLTT8SXW6R8.0 size=909883 2024-09-14T10:51:37.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.419+0000 7f19187cc780 1 < completed multipart upload key=7IWUW2HC3ULI upload=BYLTT8SXW6R8 tag=S8K1W5PV2PA9 type=write size=1958459 2024-09-14T10:51:37.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.421+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~QSTVILBGP0MH.0 size=45417 2024-09-14T10:51:37.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.421+0000 7f19187cc780 1 > prepared multipart upload key=VW6U36JN2DBX upload=QSTVILBGP0MH tag=DOC3FIATCIV0 type=write size=1093993 2024-09-14T10:51:37.423 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.424+0000 7f19187cc780 1 < suggested update operation key=VW6U36JN2DBX tag=FJ63BONKHRLX type=del size=1988160 2024-09-14T10:51:37.424 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.426+0000 7f19187cc780 1 > prepared operation key=RTGE7ISETJWW tag=KM8GI3ZGN0GT type=del size=2439274 2024-09-14T10:51:37.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.427+0000 7f19187cc780 1 < completed delete operation key=N0L67LS2KHR1 tag=BVQSKV108D2L type=del 2024-09-14T10:51:37.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.429+0000 7f19187cc780 1 > prepared operation key=EL00Y4Z7DTAT tag=XK86UDAPJT9K type=del size=2223070 2024-09-14T10:51:37.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.430+0000 7f19187cc780 1 < completed delete operation key=6BNN842ZTWG5 tag=L2Y02ZJSNI00 type=del 2024-09-14T10:51:37.431 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.433+0000 7f19187cc780 1 > prepared part key=_multipart_INJQTKXHBUV2.2~N2094EBSY2NI.0 size=650059 2024-09-14T10:51:37.431 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.433+0000 7f19187cc780 1 > prepared multipart upload key=INJQTKXHBUV2 upload=N2094EBSY2NI tag=TC6W8BCK5ZPF type=write size=1698635 2024-09-14T10:51:37.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.434+0000 7f19187cc780 1 < completed part key=_multipart_617QQI921HB4.2~QBXMFL4QJTG5.0 size=1048576 2024-09-14T10:51:37.433 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.435+0000 7f19187cc780 1 < completed part key=_multipart_617QQI921HB4.2~QBXMFL4QJTG5.1 size=1048576 2024-09-14T10:51:37.435 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.436+0000 7f19187cc780 1 < completed part key=_multipart_617QQI921HB4.2~QBXMFL4QJTG5.2 size=173395 2024-09-14T10:51:37.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.439+0000 7f19187cc780 1 < completed multipart upload key=617QQI921HB4 upload=QBXMFL4QJTG5 tag=UNI2E5QCFX88 type=write size=3319123 2024-09-14T10:51:37.438 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.440+0000 7f19187cc780 1 > prepared operation key=EL00Y4Z7DTAT tag=UCH2227N88P5 type=write size=707978 2024-09-14T10:51:37.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.442+0000 7f19187cc780 1 < completed part key=_multipart_KOJ7QB7M6A35.2~CZ47V9QXADAB.0 size=1048576 2024-09-14T10:51:37.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.443+0000 7f19187cc780 1 < completed part key=_multipart_KOJ7QB7M6A35.2~CZ47V9QXADAB.1 size=1048576 2024-09-14T10:51:37.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.445+0000 7f19187cc780 1 < completed part key=_multipart_KOJ7QB7M6A35.2~CZ47V9QXADAB.2 size=902540 2024-09-14T10:51:37.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.447+0000 7f19187cc780 1 < completed multipart upload key=KOJ7QB7M6A35 upload=CZ47V9QXADAB tag=FB3ZPYB4OUYK type=write size=4048268 2024-09-14T10:51:37.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.449+0000 7f19187cc780 1 > prepared operation key=61O2VU0SB379 tag=BA3WVE3SCITH type=del size=2403286 2024-09-14T10:51:37.449 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.451+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~JWOXZI2VJWWN.0 size=890726 2024-09-14T10:51:37.452 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.453+0000 7f19187cc780 1 < completed multipart upload key=B9FQYIX19AEP upload=JWOXZI2VJWWN tag=BLM518S5MMTG type=write size=1939302 2024-09-14T10:51:37.454 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.456+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~S07064PHAOZM.0 size=885941 2024-09-14T10:51:37.454 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.456+0000 7f19187cc780 1 > prepared multipart upload key=VW6U36JN2DBX upload=S07064PHAOZM tag=B0AC1T9BQ8QM type=write size=1934517 2024-09-14T10:51:37.455 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.457+0000 7f19187cc780 1 < completed delete operation key=RTGE7ISETJWW tag=8T1ZUIO75HYC type=del 2024-09-14T10:51:37.458 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.460+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~Y67XVF0ALT24.0 size=1048576 2024-09-14T10:51:37.459 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.461+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~Y67XVF0ALT24.1 size=1048576 2024-09-14T10:51:37.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.462+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~Y67XVF0ALT24.2 size=446182 2024-09-14T10:51:37.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.462+0000 7f19187cc780 1 > prepared multipart upload key=AGNUE76X8XCJ upload=Y67XVF0ALT24 tag=810YFLN6JCSC type=write size=3591910 2024-09-14T10:51:37.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.463+0000 7f19187cc780 -1 < failed to complete operation key=VW6U36JN2DBX tag=4RC4VDCMOPTI type=del size=3344668: (22) Invalid argument 2024-09-14T10:51:37.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.466+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~NTNLRUDUDO5L.0 size=1048576 2024-09-14T10:51:37.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.467+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~NTNLRUDUDO5L.1 size=785749 2024-09-14T10:51:37.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.467+0000 7f19187cc780 1 > prepared multipart upload key=7IWUW2HC3ULI upload=NTNLRUDUDO5L tag=IXJE05XNE9HF type=write size=2882901 2024-09-14T10:51:37.467 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.469+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~UFQFYU48WE0V.0 size=1048576 2024-09-14T10:51:37.468 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.470+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~UFQFYU48WE0V.1 size=828645 2024-09-14T10:51:37.470 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.472+0000 7f19187cc780 1 < completed multipart upload key=VW6U36JN2DBX upload=UFQFYU48WE0V tag=2ZD218TGRNIQ type=write size=2925797 2024-09-14T10:51:37.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.475+0000 7f19187cc780 1 > prepared part key=_multipart_M73CER01XHDY.2~US7TKQYY9DB5.0 size=300714 2024-09-14T10:51:37.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.475+0000 7f19187cc780 1 > prepared multipart upload key=M73CER01XHDY upload=US7TKQYY9DB5 tag=6I322NEEM6RL type=write size=1349290 2024-09-14T10:51:37.477 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.478+0000 7f19187cc780 1 < suggested update operation key=W1K1IU13J0CZ tag=R79PYE9W3EQN type=del size=2947249 2024-09-14T10:51:37.478 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.480+0000 7f19187cc780 1 > prepared operation key=H40763V7HMBC tag=0LZJI2JME9BS type=write size=968780 2024-09-14T10:51:37.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.481+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~YIFV5YI4U7BA.0 size=1048576 2024-09-14T10:51:37.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.482+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~YIFV5YI4U7BA.1 size=510313 2024-09-14T10:51:37.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.485+0000 7f19187cc780 1 < completed multipart upload key=IKVYA4KEALFF upload=YIFV5YI4U7BA tag=UXWUZ8ISBRKJ type=write size=2607465 2024-09-14T10:51:37.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.487+0000 7f19187cc780 1 > prepared operation key=MFA30GSMCSKP tag=0MC5WADWHRS8 type=del size=2050699 2024-09-14T10:51:37.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.488+0000 7f19187cc780 1 < completed write operation key=IKVYA4KEALFF tag=DZFLBJTS183P type=write size=941610 2024-09-14T10:51:37.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.492+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~OBVBRFN1VH0N.0 size=168911 2024-09-14T10:51:37.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.492+0000 7f19187cc780 1 > prepared multipart upload key=VW6U36JN2DBX upload=OBVBRFN1VH0N tag=11RJ17WKKWSI type=write size=1217487 2024-09-14T10:51:37.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.492+0000 7f19187cc780 1 < canceled part key=_multipart_KP3WOGIF30PZ.2~6FEFXI1ZD4ZM.0 size=1048576 2024-09-14T10:51:37.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.493+0000 7f19187cc780 1 < completed part key=_multipart_KP3WOGIF30PZ.2~6FEFXI1ZD4ZM.1 size=349901 2024-09-14T10:51:37.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.496+0000 7f19187cc780 1 < canceled multipart upload key=KP3WOGIF30PZ upload=6FEFXI1ZD4ZM tag=TKV2MSHUXQVE type=write size=2447053 2024-09-14T10:51:37.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.497+0000 7f19187cc780 1 > prepared operation key=19P3WE6HKJH2 tag=UM8II3KFC1P6 type=del size=2519280 2024-09-14T10:51:37.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.499+0000 7f19187cc780 1 < completed part key=_multipart_5AIAYJMRZGFQ.2~QSOFC6T89K3C.0 size=16734 2024-09-14T10:51:37.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.502+0000 7f19187cc780 1 < completed multipart upload key=5AIAYJMRZGFQ upload=QSOFC6T89K3C tag=Z9SOG5HT1U4O type=write size=1065310 2024-09-14T10:51:37.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.504+0000 7f19187cc780 1 > prepared operation key=75O00VMLJJ1X tag=9KBADFZ5OCII type=del size=4105798 2024-09-14T10:51:37.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.506+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~HHPCN9LZ51SK.0 size=892328 2024-09-14T10:51:37.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.508+0000 7f19187cc780 1 < completed multipart upload key=7IWUW2HC3ULI upload=HHPCN9LZ51SK tag=813Q5C52ZFEV type=write size=1940904 2024-09-14T10:51:37.509 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.511+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~A1XE8DFUBOK8.0 size=1048576 2024-09-14T10:51:37.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.512+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~A1XE8DFUBOK8.1 size=283312 2024-09-14T10:51:37.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.512+0000 7f19187cc780 1 > prepared multipart upload key=7IWUW2HC3ULI upload=A1XE8DFUBOK8 tag=N8CSJ9W5XVV1 type=write size=2380464 2024-09-14T10:51:37.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.513+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~QSTVILBGP0MH.0 size=45417 2024-09-14T10:51:37.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.516+0000 7f19187cc780 1 < completed multipart upload key=VW6U36JN2DBX upload=QSTVILBGP0MH tag=DOC3FIATCIV0 type=write size=1093993 2024-09-14T10:51:37.515 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.517+0000 7f19187cc780 1 > prepared operation key=OVOPGTYUF3F3 tag=81135GJ4DLOO type=del size=110633 2024-09-14T10:51:37.517 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.519+0000 7f19187cc780 1 < completed delete operation key=RTGE7ISETJWW tag=KM8GI3ZGN0GT type=del 2024-09-14T10:51:37.518 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.520+0000 7f19187cc780 1 > prepared operation key=B9FQYIX19AEP tag=KMF494K77P65 type=del size=2429744 2024-09-14T10:51:37.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.523+0000 7f19187cc780 1 < suggested remove operation key=EL00Y4Z7DTAT tag=XK86UDAPJT9K type=del 2024-09-14T10:51:37.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.524+0000 7f19187cc780 1 > prepared operation key=AGNUE76X8XCJ tag=IWT9K6SBKORF type=write size=200246 2024-09-14T10:51:37.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.525+0000 7f19187cc780 1 < completed part key=_multipart_INJQTKXHBUV2.2~N2094EBSY2NI.0 size=650059 2024-09-14T10:51:37.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.528+0000 7f19187cc780 1 < completed multipart upload key=INJQTKXHBUV2 upload=N2094EBSY2NI tag=TC6W8BCK5ZPF type=write size=1698635 2024-09-14T10:51:37.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.529+0000 7f19187cc780 1 > prepared operation key=XCVE2F2JJK4X tag=LSPM888L7KKH type=write size=345462 2024-09-14T10:51:37.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.530+0000 7f19187cc780 -1 < failed to complete operation key=EL00Y4Z7DTAT tag=UCH2227N88P5 type=write size=707978: (22) Invalid argument 2024-09-14T10:51:37.531 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.532+0000 7f19187cc780 1 > prepared operation key=H40763V7HMBC tag=8JUT0UUAG53U type=write size=704635 2024-09-14T10:51:37.532 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.534+0000 7f19187cc780 1 < canceled operation key=61O2VU0SB379 tag=BA3WVE3SCITH type=del size=2403286 2024-09-14T10:51:37.534 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.536+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~K61NOP91V021.0 size=1048576 2024-09-14T10:51:37.536 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.537+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~K61NOP91V021.1 size=123497 2024-09-14T10:51:37.536 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.537+0000 7f19187cc780 1 > prepared multipart upload key=AGNUE76X8XCJ upload=K61NOP91V021 tag=YNK6IWR1NTRA type=write size=2220649 2024-09-14T10:51:37.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.538+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~S07064PHAOZM.0 size=885941 2024-09-14T10:51:37.539 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.541+0000 7f19187cc780 1 < completed multipart upload key=VW6U36JN2DBX upload=S07064PHAOZM tag=B0AC1T9BQ8QM type=write size=1934517 2024-09-14T10:51:37.541 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.542+0000 7f19187cc780 1 > prepared operation key=75O00VMLJJ1X tag=1ILI7E2BRXT0 type=del size=1244144 2024-09-14T10:51:37.542 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.544+0000 7f19187cc780 1 < completed part key=_multipart_AGNUE76X8XCJ.2~Y67XVF0ALT24.0 size=1048576 2024-09-14T10:51:37.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.545+0000 7f19187cc780 1 < completed part key=_multipart_AGNUE76X8XCJ.2~Y67XVF0ALT24.1 size=1048576 2024-09-14T10:51:37.544 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.546+0000 7f19187cc780 1 < completed part key=_multipart_AGNUE76X8XCJ.2~Y67XVF0ALT24.2 size=446182 2024-09-14T10:51:37.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.549+0000 7f19187cc780 1 < completed multipart upload key=AGNUE76X8XCJ upload=Y67XVF0ALT24 tag=810YFLN6JCSC type=write size=3591910 2024-09-14T10:51:37.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.550+0000 7f19187cc780 1 > prepared operation key=QFEI6H4EQ9ZR tag=AXIAWD31H6IH type=del size=8236 2024-09-14T10:51:37.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.551+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~NTNLRUDUDO5L.0 size=1048576 2024-09-14T10:51:37.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.552+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~NTNLRUDUDO5L.1 size=785749 2024-09-14T10:51:37.553 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.555+0000 7f19187cc780 1 < completed multipart upload key=7IWUW2HC3ULI upload=NTNLRUDUDO5L tag=IXJE05XNE9HF type=write size=2882901 2024-09-14T10:51:37.556 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.558+0000 7f19187cc780 1 > prepared part key=_multipart_E6UO1LUWOC44.2~4DWKVSB9OYAH.0 size=1048576 2024-09-14T10:51:37.557 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.559+0000 7f19187cc780 1 > prepared part key=_multipart_E6UO1LUWOC44.2~4DWKVSB9OYAH.1 size=1048576 2024-09-14T10:51:37.558 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.560+0000 7f19187cc780 1 > prepared part key=_multipart_E6UO1LUWOC44.2~4DWKVSB9OYAH.2 size=500794 2024-09-14T10:51:37.558 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.560+0000 7f19187cc780 1 > prepared multipart upload key=E6UO1LUWOC44 upload=4DWKVSB9OYAH tag=ZFFZZ7583JJ2 type=write size=3646522 2024-09-14T10:51:37.560 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.561+0000 7f19187cc780 1 < completed part key=_multipart_M73CER01XHDY.2~US7TKQYY9DB5.0 size=300714 2024-09-14T10:51:37.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.564+0000 7f19187cc780 1 < completed multipart upload key=M73CER01XHDY upload=US7TKQYY9DB5 tag=6I322NEEM6RL type=write size=1349290 2024-09-14T10:51:37.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.565+0000 7f19187cc780 1 > prepared operation key=6BNN842ZTWG5 tag=NBFE2YF3OT7E type=write size=254840 2024-09-14T10:51:37.567 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.568+0000 7f19187cc780 1 < suggested update operation key=H40763V7HMBC tag=0LZJI2JME9BS type=write size=968780 2024-09-14T10:51:37.568 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.569+0000 7f19187cc780 1 > prepared operation key=E6UO1LUWOC44 tag=CQKWLN62ATGD type=del size=1874300 2024-09-14T10:51:37.569 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.571+0000 7f19187cc780 1 < completed delete operation key=MFA30GSMCSKP tag=0MC5WADWHRS8 type=del 2024-09-14T10:51:37.571 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.573+0000 7f19187cc780 1 > prepared operation key=KOJ7QB7M6A35 tag=CGU3I3P1HL0P type=del size=2464075 2024-09-14T10:51:37.572 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.574+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~OBVBRFN1VH0N.0 size=168911 2024-09-14T10:51:37.575 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.576+0000 7f19187cc780 1 < completed multipart upload key=VW6U36JN2DBX upload=OBVBRFN1VH0N tag=11RJ17WKKWSI type=write size=1217487 2024-09-14T10:51:37.576 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.578+0000 7f19187cc780 1 > prepared operation key=61O2VU0SB379 tag=6KK6T2I02BW8 type=del size=1249169 2024-09-14T10:51:37.578 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.579+0000 7f19187cc780 1 < completed delete operation key=19P3WE6HKJH2 tag=UM8II3KFC1P6 type=del 2024-09-14T10:51:37.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.581+0000 7f19187cc780 1 > prepared operation key=IKVYA4KEALFF tag=FUGFXWA14NCT type=del size=2158938 2024-09-14T10:51:37.582 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.584+0000 7f19187cc780 1 < suggested update operation key=75O00VMLJJ1X tag=9KBADFZ5OCII type=del size=4105798 2024-09-14T10:51:37.585 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.586+0000 7f19187cc780 1 > prepared operation key=6BNN842ZTWG5 tag=JSH8OPUH39QV type=del size=3081490 2024-09-14T10:51:37.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.588+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~A1XE8DFUBOK8.0 size=1048576 2024-09-14T10:51:37.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.589+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~A1XE8DFUBOK8.1 size=283312 2024-09-14T10:51:37.589 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.591+0000 7f19187cc780 1 < completed multipart upload key=7IWUW2HC3ULI upload=A1XE8DFUBOK8 tag=N8CSJ9W5XVV1 type=write size=2380464 2024-09-14T10:51:37.591 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.593+0000 7f19187cc780 1 > prepared part key=_multipart_YA3DI7N4DG5K.2~9QWF5TIWGTEK.0 size=1048576 2024-09-14T10:51:37.593 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.594+0000 7f19187cc780 1 > prepared part key=_multipart_YA3DI7N4DG5K.2~9QWF5TIWGTEK.1 size=751080 2024-09-14T10:51:37.593 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.594+0000 7f19187cc780 1 > prepared multipart upload key=YA3DI7N4DG5K upload=9QWF5TIWGTEK tag=78WB3NM27UST type=write size=2848232 2024-09-14T10:51:37.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.596+0000 7f19187cc780 1 < completed delete operation key=OVOPGTYUF3F3 tag=81135GJ4DLOO type=del 2024-09-14T10:51:37.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.599+0000 7f19187cc780 1 > prepared part key=_multipart_EL00Y4Z7DTAT.2~RJ1EXMZXH1EJ.0 size=1048576 2024-09-14T10:51:37.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.600+0000 7f19187cc780 1 > prepared part key=_multipart_EL00Y4Z7DTAT.2~RJ1EXMZXH1EJ.1 size=454069 2024-09-14T10:51:37.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.600+0000 7f19187cc780 1 > prepared multipart upload key=EL00Y4Z7DTAT upload=RJ1EXMZXH1EJ tag=RLF0DHU6BUT2 type=write size=2551221 2024-09-14T10:51:37.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.601+0000 7f19187cc780 1 < canceled operation key=B9FQYIX19AEP tag=KMF494K77P65 type=del size=2429744 2024-09-14T10:51:37.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.604+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~KVD7ALOJOJ4F.0 size=250244 2024-09-14T10:51:37.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.604+0000 7f19187cc780 1 > prepared multipart upload key=AGNUE76X8XCJ upload=KVD7ALOJOJ4F tag=12HMVC45SYP4 type=write size=1298820 2024-09-14T10:51:37.604 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.605+0000 7f19187cc780 1 < completed write operation key=AGNUE76X8XCJ tag=IWT9K6SBKORF type=write size=200246 2024-09-14T10:51:37.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.607+0000 7f19187cc780 1 > prepared operation key=B9FQYIX19AEP tag=VYROPO7214BV type=del size=336701 2024-09-14T10:51:37.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.610+0000 7f19187cc780 1 < completed write operation key=XCVE2F2JJK4X tag=LSPM888L7KKH type=write size=345462 2024-09-14T10:51:37.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.612+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~8KCY4BSUBMFC.0 size=1048576 2024-09-14T10:51:37.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.613+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~8KCY4BSUBMFC.1 size=750929 2024-09-14T10:51:37.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.613+0000 7f19187cc780 1 > prepared multipart upload key=XCVE2F2JJK4X upload=8KCY4BSUBMFC tag=ODEANLLIJPEM type=write size=2848081 2024-09-14T10:51:37.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.616+0000 7f19187cc780 1 < suggested remove operation key=H40763V7HMBC tag=8JUT0UUAG53U type=write 2024-09-14T10:51:37.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.617+0000 7f19187cc780 1 > prepared operation key=RTGE7ISETJWW tag=2LS4P39TYBVF type=write size=752387 2024-09-14T10:51:37.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.619+0000 7f19187cc780 1 < completed part key=_multipart_AGNUE76X8XCJ.2~K61NOP91V021.0 size=1048576 2024-09-14T10:51:37.619 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.620+0000 7f19187cc780 1 < completed part key=_multipart_AGNUE76X8XCJ.2~K61NOP91V021.1 size=123497 2024-09-14T10:51:37.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.622+0000 7f19187cc780 1 < completed multipart upload key=AGNUE76X8XCJ upload=K61NOP91V021 tag=YNK6IWR1NTRA type=write size=2220649 2024-09-14T10:51:37.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.624+0000 7f19187cc780 1 > prepared operation key=IKVYA4KEALFF tag=M0ATDJBUHKFF type=write size=523201 2024-09-14T10:51:37.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.625+0000 7f19187cc780 -1 < failed to complete operation key=75O00VMLJJ1X tag=1ILI7E2BRXT0 type=del size=1244144: (22) Invalid argument 2024-09-14T10:51:37.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.626+0000 7f19187cc780 1 > prepared operation key=7IWUW2HC3ULI tag=ZRSX21SZV1ZS type=write size=820611 2024-09-14T10:51:37.626 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.628+0000 7f19187cc780 1 < completed delete operation key=QFEI6H4EQ9ZR tag=AXIAWD31H6IH type=del 2024-09-14T10:51:37.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.629+0000 7f19187cc780 1 > prepared operation key=RTGE7ISETJWW tag=AN219L3NNC98 type=write size=469224 2024-09-14T10:51:37.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.631+0000 7f19187cc780 1 < completed part key=_multipart_E6UO1LUWOC44.2~4DWKVSB9OYAH.0 size=1048576 2024-09-14T10:51:37.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.632+0000 7f19187cc780 1 < completed part key=_multipart_E6UO1LUWOC44.2~4DWKVSB9OYAH.1 size=1048576 2024-09-14T10:51:37.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.633+0000 7f19187cc780 1 < completed part key=_multipart_E6UO1LUWOC44.2~4DWKVSB9OYAH.2 size=500794 2024-09-14T10:51:37.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.635+0000 7f19187cc780 1 < completed multipart upload key=E6UO1LUWOC44 upload=4DWKVSB9OYAH tag=ZFFZZ7583JJ2 type=write size=3646522 2024-09-14T10:51:37.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.636+0000 7f19187cc780 1 > prepared operation key=QFEI6H4EQ9ZR tag=AP0Q361JGCIU type=del size=2916016 2024-09-14T10:51:37.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.639+0000 7f19187cc780 1 < completed write operation key=6BNN842ZTWG5 tag=NBFE2YF3OT7E type=write size=254840 2024-09-14T10:51:37.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.643+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~DN0ME0WESEMT.0 size=1048576 2024-09-14T10:51:37.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.644+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~DN0ME0WESEMT.1 size=1048576 2024-09-14T10:51:37.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.646+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~DN0ME0WESEMT.2 size=316639 2024-09-14T10:51:37.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.646+0000 7f19187cc780 1 > prepared multipart upload key=XCVE2F2JJK4X upload=DN0ME0WESEMT tag=2D5VWEYY5UB0 type=write size=3462367 2024-09-14T10:51:37.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.647+0000 7f19187cc780 1 < completed delete operation key=E6UO1LUWOC44 tag=CQKWLN62ATGD type=del 2024-09-14T10:51:37.648 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.650+0000 7f19187cc780 1 > prepared part key=_multipart_EL00Y4Z7DTAT.2~PCLHCRWW86OD.0 size=1048576 2024-09-14T10:51:37.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.651+0000 7f19187cc780 1 > prepared part key=_multipart_EL00Y4Z7DTAT.2~PCLHCRWW86OD.1 size=473431 2024-09-14T10:51:37.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.651+0000 7f19187cc780 1 > prepared multipart upload key=EL00Y4Z7DTAT upload=PCLHCRWW86OD tag=GVU7GDGIOM3K type=write size=2570583 2024-09-14T10:51:37.651 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.652+0000 7f19187cc780 1 < completed delete operation key=KOJ7QB7M6A35 tag=CGU3I3P1HL0P type=del 2024-09-14T10:51:37.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.653+0000 7f19187cc780 1 > prepared operation key=AST81B9QWORT tag=C0N3YQ6APQOO type=write size=824683 2024-09-14T10:51:37.654 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.656+0000 7f19187cc780 1 < suggested update operation key=61O2VU0SB379 tag=6KK6T2I02BW8 type=del size=1249169 2024-09-14T10:51:37.656 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.657+0000 7f19187cc780 1 > prepared operation key=RTGE7ISETJWW tag=TFZHR7LK3F9J type=del size=1827865 2024-09-14T10:51:37.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.660+0000 7f19187cc780 1 < suggested update operation key=IKVYA4KEALFF tag=FUGFXWA14NCT type=del size=2158938 2024-09-14T10:51:37.661 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.662+0000 7f19187cc780 1 > prepared operation key=AST81B9QWORT tag=F48NY0JUVFLM type=del size=1104093 2024-09-14T10:51:37.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.663+0000 7f19187cc780 1 < completed delete operation key=6BNN842ZTWG5 tag=JSH8OPUH39QV type=del 2024-09-14T10:51:37.663 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.664+0000 7f19187cc780 1 > prepared operation key=QBMNYNWOLK4I tag=HSJZKSHKDD7V type=del size=42574 2024-09-14T10:51:37.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.666+0000 7f19187cc780 1 < completed part key=_multipart_YA3DI7N4DG5K.2~9QWF5TIWGTEK.0 size=1048576 2024-09-14T10:51:37.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.667+0000 7f19187cc780 1 < completed part key=_multipart_YA3DI7N4DG5K.2~9QWF5TIWGTEK.1 size=751080 2024-09-14T10:51:37.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.669+0000 7f19187cc780 1 < completed multipart upload key=YA3DI7N4DG5K upload=9QWF5TIWGTEK tag=78WB3NM27UST type=write size=2848232 2024-09-14T10:51:37.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.672+0000 7f19187cc780 1 > prepared part key=_multipart_AST81B9QWORT.2~8Z1UEMZAZQ5D.0 size=455476 2024-09-14T10:51:37.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.672+0000 7f19187cc780 1 > prepared multipart upload key=AST81B9QWORT upload=8Z1UEMZAZQ5D tag=S9J6P16QEY15 type=write size=1504052 2024-09-14T10:51:37.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.674+0000 7f19187cc780 1 < completed part key=_multipart_EL00Y4Z7DTAT.2~RJ1EXMZXH1EJ.0 size=1048576 2024-09-14T10:51:37.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.675+0000 7f19187cc780 1 < completed part key=_multipart_EL00Y4Z7DTAT.2~RJ1EXMZXH1EJ.1 size=454069 2024-09-14T10:51:37.675 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.677+0000 7f19187cc780 1 < completed multipart upload key=EL00Y4Z7DTAT upload=RJ1EXMZXH1EJ tag=RLF0DHU6BUT2 type=write size=2551221 2024-09-14T10:51:37.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.678+0000 7f19187cc780 1 > prepared operation key=W1K1IU13J0CZ tag=R98KQIFAVH0W type=del size=3019973 2024-09-14T10:51:37.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.680+0000 7f19187cc780 1 < completed part key=_multipart_AGNUE76X8XCJ.2~KVD7ALOJOJ4F.0 size=250244 2024-09-14T10:51:37.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.682+0000 7f19187cc780 1 < completed multipart upload key=AGNUE76X8XCJ upload=KVD7ALOJOJ4F tag=12HMVC45SYP4 type=write size=1298820 2024-09-14T10:51:37.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.684+0000 7f19187cc780 1 > prepared part key=_multipart_61O2VU0SB379.2~MCBFT9IOX6V9.0 size=1048576 2024-09-14T10:51:37.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.686+0000 7f19187cc780 1 > prepared part key=_multipart_61O2VU0SB379.2~MCBFT9IOX6V9.1 size=1015905 2024-09-14T10:51:37.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.686+0000 7f19187cc780 1 > prepared multipart upload key=61O2VU0SB379 upload=MCBFT9IOX6V9 tag=SXY1ONR2UGW4 type=write size=3113057 2024-09-14T10:51:37.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.687+0000 7f19187cc780 1 < completed delete operation key=B9FQYIX19AEP tag=VYROPO7214BV type=del 2024-09-14T10:51:37.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.688+0000 7f19187cc780 1 > prepared operation key=YA3DI7N4DG5K tag=756TBGTGH7B5 type=del size=2013239 2024-09-14T10:51:37.688 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.690+0000 7f19187cc780 1 < completed part key=_multipart_XCVE2F2JJK4X.2~8KCY4BSUBMFC.0 size=1048576 2024-09-14T10:51:37.689 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.691+0000 7f19187cc780 1 < completed part key=_multipart_XCVE2F2JJK4X.2~8KCY4BSUBMFC.1 size=750929 2024-09-14T10:51:37.692 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.693+0000 7f19187cc780 1 < completed multipart upload key=XCVE2F2JJK4X upload=8KCY4BSUBMFC tag=ODEANLLIJPEM type=write size=2848081 2024-09-14T10:51:37.694 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.696+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~9OGC298BGUSW.0 size=1048576 2024-09-14T10:51:37.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.697+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~9OGC298BGUSW.1 size=1048576 2024-09-14T10:51:37.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.698+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~9OGC298BGUSW.2 size=510691 2024-09-14T10:51:37.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.698+0000 7f19187cc780 1 > prepared multipart upload key=KP3WOGIF30PZ upload=9OGC298BGUSW tag=5HRFV53S3CK5 type=write size=3656419 2024-09-14T10:51:37.698 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.700+0000 7f19187cc780 1 < canceled operation key=RTGE7ISETJWW tag=2LS4P39TYBVF type=write size=752387 2024-09-14T10:51:37.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.703+0000 7f19187cc780 1 > prepared part key=_multipart_75O00VMLJJ1X.2~414Q146B7Y42.0 size=989616 2024-09-14T10:51:37.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.703+0000 7f19187cc780 1 > prepared multipart upload key=75O00VMLJJ1X upload=414Q146B7Y42 tag=0UTTH73AHUG4 type=write size=2038192 2024-09-14T10:51:37.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.706+0000 7f19187cc780 1 < suggested remove operation key=IKVYA4KEALFF tag=M0ATDJBUHKFF type=write 2024-09-14T10:51:37.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.707+0000 7f19187cc780 1 > prepared operation key=AST81B9QWORT tag=DAGEKH3DUN50 type=write size=898842 2024-09-14T10:51:37.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.709+0000 7f19187cc780 1 < completed write operation key=7IWUW2HC3ULI tag=ZRSX21SZV1ZS type=write size=820611 2024-09-14T10:51:37.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.712+0000 7f19187cc780 1 > prepared part key=_multipart_QBMNYNWOLK4I.2~59U2Z1R6PSBH.0 size=1048576 2024-09-14T10:51:37.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.713+0000 7f19187cc780 1 > prepared part key=_multipart_QBMNYNWOLK4I.2~59U2Z1R6PSBH.1 size=698262 2024-09-14T10:51:37.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.713+0000 7f19187cc780 1 > prepared multipart upload key=QBMNYNWOLK4I upload=59U2Z1R6PSBH tag=M30K3WQGY8CT type=write size=2795414 2024-09-14T10:51:37.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.714+0000 7f19187cc780 1 < completed write operation key=RTGE7ISETJWW tag=AN219L3NNC98 type=write size=469224 2024-09-14T10:51:37.714 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.716+0000 7f19187cc780 1 > prepared operation key=QFEI6H4EQ9ZR tag=C8TCUW1KXGE4 type=del size=4104023 2024-09-14T10:51:37.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.719+0000 7f19187cc780 1 < suggested update operation key=QFEI6H4EQ9ZR tag=AP0Q361JGCIU type=del size=2916016 2024-09-14T10:51:37.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.720+0000 7f19187cc780 1 > prepared operation key=75O00VMLJJ1X tag=RMBF1GPR5V5K type=del size=1112251 2024-09-14T10:51:37.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.721+0000 7f19187cc780 1 < completed part key=_multipart_XCVE2F2JJK4X.2~DN0ME0WESEMT.0 size=1048576 2024-09-14T10:51:37.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.722+0000 7f19187cc780 1 < canceled part key=_multipart_XCVE2F2JJK4X.2~DN0ME0WESEMT.1 size=1048576 2024-09-14T10:51:37.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.722+0000 7f19187cc780 1 < canceled part key=_multipart_XCVE2F2JJK4X.2~DN0ME0WESEMT.2 size=316639 2024-09-14T10:51:37.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.724+0000 7f19187cc780 1 < canceled multipart upload key=XCVE2F2JJK4X upload=DN0ME0WESEMT tag=2D5VWEYY5UB0 type=write size=3462367 2024-09-14T10:51:37.724 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.725+0000 7f19187cc780 1 > prepared operation key=CADC2BY888V1 tag=KQQFX895T8JW type=del size=1761388 2024-09-14T10:51:37.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.727+0000 7f19187cc780 1 < completed part key=_multipart_EL00Y4Z7DTAT.2~PCLHCRWW86OD.0 size=1048576 2024-09-14T10:51:37.726 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.728+0000 7f19187cc780 1 < completed part key=_multipart_EL00Y4Z7DTAT.2~PCLHCRWW86OD.1 size=473431 2024-09-14T10:51:37.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.730+0000 7f19187cc780 1 < completed multipart upload key=EL00Y4Z7DTAT upload=PCLHCRWW86OD tag=GVU7GDGIOM3K type=write size=2570583 2024-09-14T10:51:37.730 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.731+0000 7f19187cc780 1 > prepared operation key=AGNUE76X8XCJ tag=OOJ76QVH6L33 type=write size=1019535 2024-09-14T10:51:37.731 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.733+0000 7f19187cc780 1 < completed write operation key=AST81B9QWORT tag=C0N3YQ6APQOO type=write size=824683 2024-09-14T10:51:37.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.736+0000 7f19187cc780 1 > prepared part key=_multipart_5AIAYJMRZGFQ.2~7HOMXNIEKQ6V.0 size=1048576 2024-09-14T10:51:37.735 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.737+0000 7f19187cc780 1 > prepared part key=_multipart_5AIAYJMRZGFQ.2~7HOMXNIEKQ6V.1 size=1048576 2024-09-14T10:51:37.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.738+0000 7f19187cc780 1 > prepared part key=_multipart_5AIAYJMRZGFQ.2~7HOMXNIEKQ6V.2 size=993993 2024-09-14T10:51:37.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.738+0000 7f19187cc780 1 > prepared multipart upload key=5AIAYJMRZGFQ upload=7HOMXNIEKQ6V tag=OX5U6OQ569KI type=write size=4139721 2024-09-14T10:51:37.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.741+0000 7f19187cc780 1 < completed delete operation key=RTGE7ISETJWW tag=TFZHR7LK3F9J type=del 2024-09-14T10:51:37.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.742+0000 7f19187cc780 1 > prepared operation key=6BNN842ZTWG5 tag=6ZRZTCWQBMWA type=del size=3130813 2024-09-14T10:51:37.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.744+0000 7f19187cc780 1 < completed delete operation key=AST81B9QWORT tag=F48NY0JUVFLM type=del 2024-09-14T10:51:37.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.746+0000 7f19187cc780 1 > prepared part key=_multipart_W1K1IU13J0CZ.2~XDCVR7CH5PDR.0 size=1048576 2024-09-14T10:51:37.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.747+0000 7f19187cc780 1 > prepared part key=_multipart_W1K1IU13J0CZ.2~XDCVR7CH5PDR.1 size=934980 2024-09-14T10:51:37.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.747+0000 7f19187cc780 1 > prepared multipart upload key=W1K1IU13J0CZ upload=XDCVR7CH5PDR tag=XO6G5KF37RD2 type=write size=3032132 2024-09-14T10:51:37.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.749+0000 7f19187cc780 1 < completed delete operation key=QBMNYNWOLK4I tag=HSJZKSHKDD7V type=del 2024-09-14T10:51:37.750 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.751+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~IP00T9CNXPWO.0 size=1048576 2024-09-14T10:51:37.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.753+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~IP00T9CNXPWO.1 size=1044492 2024-09-14T10:51:37.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.753+0000 7f19187cc780 1 > prepared multipart upload key=6BNN842ZTWG5 upload=IP00T9CNXPWO tag=7FMMEV08RKWG type=write size=3141644 2024-09-14T10:51:37.752 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.754+0000 7f19187cc780 1 < completed part key=_multipart_AST81B9QWORT.2~8Z1UEMZAZQ5D.0 size=455476 2024-09-14T10:51:37.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.756+0000 7f19187cc780 1 < completed multipart upload key=AST81B9QWORT upload=8Z1UEMZAZQ5D tag=S9J6P16QEY15 type=write size=1504052 2024-09-14T10:51:37.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.759+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~8QUNTBEUKCR1.0 size=1048576 2024-09-14T10:51:37.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.760+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~8QUNTBEUKCR1.1 size=1019633 2024-09-14T10:51:37.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.760+0000 7f19187cc780 1 > prepared multipart upload key=VW6U36JN2DBX upload=8QUNTBEUKCR1 tag=FJ6SOOUUFWZR type=write size=3116785 2024-09-14T10:51:37.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.761+0000 7f19187cc780 1 < completed delete operation key=W1K1IU13J0CZ tag=R98KQIFAVH0W type=del 2024-09-14T10:51:37.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.764+0000 7f19187cc780 1 > prepared part key=_multipart_E6UO1LUWOC44.2~QHM35SY4YYC7.0 size=672532 2024-09-14T10:51:37.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.764+0000 7f19187cc780 1 > prepared multipart upload key=E6UO1LUWOC44 upload=QHM35SY4YYC7 tag=INO5BD3GXTV8 type=write size=1721108 2024-09-14T10:51:37.763 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.765+0000 7f19187cc780 1 < completed part key=_multipart_61O2VU0SB379.2~MCBFT9IOX6V9.0 size=1048576 2024-09-14T10:51:37.764 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.766+0000 7f19187cc780 1 < completed part key=_multipart_61O2VU0SB379.2~MCBFT9IOX6V9.1 size=1015905 2024-09-14T10:51:37.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.769+0000 7f19187cc780 1 < completed multipart upload key=61O2VU0SB379 upload=MCBFT9IOX6V9 tag=SXY1ONR2UGW4 type=write size=3113057 2024-09-14T10:51:37.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.770+0000 7f19187cc780 1 > prepared operation key=75O00VMLJJ1X tag=01HWGJEYL1JC type=del size=2869726 2024-09-14T10:51:37.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.771+0000 7f19187cc780 1 < completed delete operation key=YA3DI7N4DG5K tag=756TBGTGH7B5 type=del 2024-09-14T10:51:37.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.775+0000 7f19187cc780 1 > prepared part key=_multipart_5AIAYJMRZGFQ.2~9X5TEL1CRO02.0 size=1048576 2024-09-14T10:51:37.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.776+0000 7f19187cc780 1 > prepared part key=_multipart_5AIAYJMRZGFQ.2~9X5TEL1CRO02.1 size=274796 2024-09-14T10:51:37.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.776+0000 7f19187cc780 1 > prepared multipart upload key=5AIAYJMRZGFQ upload=9X5TEL1CRO02 tag=PZXD44KCVC2I type=write size=2371948 2024-09-14T10:51:37.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.776+0000 7f19187cc780 1 < canceled part key=_multipart_KP3WOGIF30PZ.2~9OGC298BGUSW.0 size=1048576 2024-09-14T10:51:37.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.777+0000 7f19187cc780 1 < completed part key=_multipart_KP3WOGIF30PZ.2~9OGC298BGUSW.1 size=1048576 2024-09-14T10:51:37.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.779+0000 7f19187cc780 1 < completed part key=_multipart_KP3WOGIF30PZ.2~9OGC298BGUSW.2 size=510691 2024-09-14T10:51:37.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.781+0000 7f19187cc780 1 < canceled multipart upload key=KP3WOGIF30PZ upload=9OGC298BGUSW tag=5HRFV53S3CK5 type=write size=3656419 2024-09-14T10:51:37.781 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.782+0000 7f19187cc780 1 > prepared operation key=54BSD3DEHNK6 tag=I6PTUWWWYTA5 type=write size=407055 2024-09-14T10:51:37.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.784+0000 7f19187cc780 1 < completed part key=_multipart_75O00VMLJJ1X.2~414Q146B7Y42.0 size=989616 2024-09-14T10:51:37.784 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.786+0000 7f19187cc780 1 < completed multipart upload key=75O00VMLJJ1X upload=414Q146B7Y42 tag=0UTTH73AHUG4 type=write size=2038192 2024-09-14T10:51:37.786 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.788+0000 7f19187cc780 1 > prepared operation key=B9FQYIX19AEP tag=GWOCZUXP6AXG type=write size=342195 2024-09-14T10:51:37.788 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.790+0000 7f19187cc780 1 < completed write operation key=AST81B9QWORT tag=DAGEKH3DUN50 type=write size=898842 2024-09-14T10:51:37.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.791+0000 7f19187cc780 1 > prepared operation key=H40763V7HMBC tag=QK5EVH416QOC type=del size=3216132 2024-09-14T10:51:37.791 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.793+0000 7f19187cc780 1 < completed part key=_multipart_QBMNYNWOLK4I.2~59U2Z1R6PSBH.0 size=1048576 2024-09-14T10:51:37.793 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.794+0000 7f19187cc780 1 < completed part key=_multipart_QBMNYNWOLK4I.2~59U2Z1R6PSBH.1 size=698262 2024-09-14T10:51:37.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.797+0000 7f19187cc780 1 < completed multipart upload key=QBMNYNWOLK4I upload=59U2Z1R6PSBH tag=M30K3WQGY8CT type=write size=2795414 2024-09-14T10:51:37.796 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.798+0000 7f19187cc780 1 > prepared operation key=CADC2BY888V1 tag=OMFHA83WBI80 type=del size=2853272 2024-09-14T10:51:37.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.799+0000 7f19187cc780 -1 < failed to complete operation key=QFEI6H4EQ9ZR tag=C8TCUW1KXGE4 type=del size=4104023: (22) Invalid argument 2024-09-14T10:51:37.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.802+0000 7f19187cc780 1 > prepared part key=_multipart_E6UO1LUWOC44.2~4ROLWFQPK9X8.0 size=1048576 2024-09-14T10:51:37.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.804+0000 7f19187cc780 1 > prepared part key=_multipart_E6UO1LUWOC44.2~4ROLWFQPK9X8.1 size=427454 2024-09-14T10:51:37.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.804+0000 7f19187cc780 1 > prepared multipart upload key=E6UO1LUWOC44 upload=4ROLWFQPK9X8 tag=RAGF9GU9YYGC type=write size=2524606 2024-09-14T10:51:37.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.805+0000 7f19187cc780 1 < completed delete operation key=75O00VMLJJ1X tag=RMBF1GPR5V5K type=del 2024-09-14T10:51:37.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.808+0000 7f19187cc780 1 > prepared part key=_multipart_5AIAYJMRZGFQ.2~Z657503U2P32.0 size=1048576 2024-09-14T10:51:37.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.809+0000 7f19187cc780 1 > prepared part key=_multipart_5AIAYJMRZGFQ.2~Z657503U2P32.1 size=1048576 2024-09-14T10:51:37.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.810+0000 7f19187cc780 1 > prepared part key=_multipart_5AIAYJMRZGFQ.2~Z657503U2P32.2 size=566125 2024-09-14T10:51:37.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.810+0000 7f19187cc780 1 > prepared multipart upload key=5AIAYJMRZGFQ upload=Z657503U2P32 tag=H5QS6D2ZRLJK type=write size=3711853 2024-09-14T10:51:37.810 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.811+0000 7f19187cc780 1 < completed delete operation key=CADC2BY888V1 tag=KQQFX895T8JW type=del 2024-09-14T10:51:37.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.813+0000 7f19187cc780 1 > prepared operation key=EL00Y4Z7DTAT tag=WTL3WT81Q33V type=del size=2834808 2024-09-14T10:51:37.814 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.816+0000 7f19187cc780 1 < suggested update operation key=AGNUE76X8XCJ tag=OOJ76QVH6L33 type=write size=1019535 2024-09-14T10:51:37.816 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.817+0000 7f19187cc780 1 > prepared operation key=54BSD3DEHNK6 tag=PEY98F63BPTA type=write size=461609 2024-09-14T10:51:37.816 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.818+0000 7f19187cc780 1 < canceled part key=_multipart_5AIAYJMRZGFQ.2~7HOMXNIEKQ6V.0 size=1048576 2024-09-14T10:51:37.818 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.819+0000 7f19187cc780 1 < completed part key=_multipart_5AIAYJMRZGFQ.2~7HOMXNIEKQ6V.1 size=1048576 2024-09-14T10:51:37.819 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.820+0000 7f19187cc780 1 < completed part key=_multipart_5AIAYJMRZGFQ.2~7HOMXNIEKQ6V.2 size=993993 2024-09-14T10:51:37.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.823+0000 7f19187cc780 1 < canceled multipart upload key=5AIAYJMRZGFQ upload=7HOMXNIEKQ6V tag=OX5U6OQ569KI type=write size=4139721 2024-09-14T10:51:37.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.825+0000 7f19187cc780 1 > prepared operation key=N0L67LS2KHR1 tag=7QFSENKVUSCY type=write size=186857 2024-09-14T10:51:37.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.828+0000 7f19187cc780 1 < suggested remove operation key=6BNN842ZTWG5 tag=6ZRZTCWQBMWA type=del 2024-09-14T10:51:37.828 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.829+0000 7f19187cc780 1 > prepared operation key=N0L67LS2KHR1 tag=8EOLLVPLHTFE type=write size=474648 2024-09-14T10:51:37.829 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.831+0000 7f19187cc780 1 < completed part key=_multipart_W1K1IU13J0CZ.2~XDCVR7CH5PDR.0 size=1048576 2024-09-14T10:51:37.831 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.832+0000 7f19187cc780 1 < completed part key=_multipart_W1K1IU13J0CZ.2~XDCVR7CH5PDR.1 size=934980 2024-09-14T10:51:37.833 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.835+0000 7f19187cc780 1 < completed multipart upload key=W1K1IU13J0CZ upload=XDCVR7CH5PDR tag=XO6G5KF37RD2 type=write size=3032132 2024-09-14T10:51:37.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.838+0000 7f19187cc780 1 > prepared part key=_multipart_QBMNYNWOLK4I.2~KWLSIX2LX7Z2.0 size=1048576 2024-09-14T10:51:37.837 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.839+0000 7f19187cc780 1 > prepared part key=_multipart_QBMNYNWOLK4I.2~KWLSIX2LX7Z2.1 size=763296 2024-09-14T10:51:37.837 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.839+0000 7f19187cc780 1 > prepared multipart upload key=QBMNYNWOLK4I upload=KWLSIX2LX7Z2 tag=EA10O4J8KMNR type=write size=2860448 2024-09-14T10:51:37.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.840+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~IP00T9CNXPWO.0 size=1048576 2024-09-14T10:51:37.840 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.841+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~IP00T9CNXPWO.1 size=1044492 2024-09-14T10:51:37.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.844+0000 7f19187cc780 1 < completed multipart upload key=6BNN842ZTWG5 upload=IP00T9CNXPWO tag=7FMMEV08RKWG type=write size=3141644 2024-09-14T10:51:37.844 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.846+0000 7f19187cc780 1 > prepared operation key=OVOPGTYUF3F3 tag=THHKSEZ33L58 type=del size=1153871 2024-09-14T10:51:37.845 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.847+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~8QUNTBEUKCR1.0 size=1048576 2024-09-14T10:51:37.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.848+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~8QUNTBEUKCR1.1 size=1019633 2024-09-14T10:51:37.849 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.851+0000 7f19187cc780 1 < completed multipart upload key=VW6U36JN2DBX upload=8QUNTBEUKCR1 tag=FJ6SOOUUFWZR type=write size=3116785 2024-09-14T10:51:37.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.852+0000 7f19187cc780 1 > prepared operation key=H40763V7HMBC tag=NMSVTN3D7EUN type=del size=3256731 2024-09-14T10:51:37.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.854+0000 7f19187cc780 1 < completed part key=_multipart_E6UO1LUWOC44.2~QHM35SY4YYC7.0 size=672532 2024-09-14T10:51:37.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.856+0000 7f19187cc780 1 < completed multipart upload key=E6UO1LUWOC44 upload=QHM35SY4YYC7 tag=INO5BD3GXTV8 type=write size=1721108 2024-09-14T10:51:37.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.859+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~M6PKYOABZEIE.0 size=114292 2024-09-14T10:51:37.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.859+0000 7f19187cc780 1 > prepared multipart upload key=XCVE2F2JJK4X upload=M6PKYOABZEIE tag=9K42JGE5GWY9 type=write size=1162868 2024-09-14T10:51:37.859 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.861+0000 7f19187cc780 1 < completed delete operation key=75O00VMLJJ1X tag=01HWGJEYL1JC type=del 2024-09-14T10:51:37.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.864+0000 7f19187cc780 1 > prepared part key=_multipart_5AIAYJMRZGFQ.2~LLKKQVD0MKSW.0 size=423832 2024-09-14T10:51:37.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.864+0000 7f19187cc780 1 > prepared multipart upload key=5AIAYJMRZGFQ upload=LLKKQVD0MKSW tag=94P5DA3E0QX1 type=write size=1472408 2024-09-14T10:51:37.864 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.865+0000 7f19187cc780 1 < completed part key=_multipart_5AIAYJMRZGFQ.2~9X5TEL1CRO02.0 size=1048576 2024-09-14T10:51:37.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.866+0000 7f19187cc780 1 < completed part key=_multipart_5AIAYJMRZGFQ.2~9X5TEL1CRO02.1 size=274796 2024-09-14T10:51:37.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.869+0000 7f19187cc780 1 < completed multipart upload key=5AIAYJMRZGFQ upload=9X5TEL1CRO02 tag=PZXD44KCVC2I type=write size=2371948 2024-09-14T10:51:37.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.871+0000 7f19187cc780 1 > prepared operation key=H40763V7HMBC tag=GSWT0E6K89OY type=del size=1685396 2024-09-14T10:51:37.871 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.873+0000 7f19187cc780 1 < completed write operation key=54BSD3DEHNK6 tag=I6PTUWWWYTA5 type=write size=407055 2024-09-14T10:51:37.873 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.874+0000 7f19187cc780 1 > prepared operation key=KOJ7QB7M6A35 tag=HGAM5LGK0T5V type=write size=815148 2024-09-14T10:51:37.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.876+0000 7f19187cc780 1 < completed write operation key=B9FQYIX19AEP tag=GWOCZUXP6AXG type=write size=342195 2024-09-14T10:51:37.876 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.878+0000 7f19187cc780 1 > prepared operation key=RTGE7ISETJWW tag=G9NWFIBKNOZN type=write size=782326 2024-09-14T10:51:37.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.880+0000 7f19187cc780 1 < completed delete operation key=H40763V7HMBC tag=QK5EVH416QOC type=del 2024-09-14T10:51:37.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.881+0000 7f19187cc780 1 > prepared operation key=RTGE7ISETJWW tag=XHOBZX4Z0DVZ type=del size=2780652 2024-09-14T10:51:37.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.883+0000 7f19187cc780 1 < completed delete operation key=CADC2BY888V1 tag=OMFHA83WBI80 type=del 2024-09-14T10:51:37.883 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.885+0000 7f19187cc780 1 > prepared operation key=AGNUE76X8XCJ tag=UNNPZ533WEN0 type=del size=3791556 2024-09-14T10:51:37.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.886+0000 7f19187cc780 1 < completed part key=_multipart_E6UO1LUWOC44.2~4ROLWFQPK9X8.0 size=1048576 2024-09-14T10:51:37.886 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.888+0000 7f19187cc780 1 < completed part key=_multipart_E6UO1LUWOC44.2~4ROLWFQPK9X8.1 size=427454 2024-09-14T10:51:37.888 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.890+0000 7f19187cc780 1 < completed multipart upload key=E6UO1LUWOC44 upload=4ROLWFQPK9X8 tag=RAGF9GU9YYGC type=write size=2524606 2024-09-14T10:51:37.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.892+0000 7f19187cc780 1 > prepared operation key=E6UO1LUWOC44 tag=LZ8TXQPU4F13 type=del size=1062984 2024-09-14T10:51:37.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.894+0000 7f19187cc780 1 < completed part key=_multipart_5AIAYJMRZGFQ.2~Z657503U2P32.0 size=1048576 2024-09-14T10:51:37.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.895+0000 7f19187cc780 1 < completed part key=_multipart_5AIAYJMRZGFQ.2~Z657503U2P32.1 size=1048576 2024-09-14T10:51:37.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.896+0000 7f19187cc780 1 < completed part key=_multipart_5AIAYJMRZGFQ.2~Z657503U2P32.2 size=566125 2024-09-14T10:51:37.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.899+0000 7f19187cc780 1 < completed multipart upload key=5AIAYJMRZGFQ upload=Z657503U2P32 tag=H5QS6D2ZRLJK type=write size=3711853 2024-09-14T10:51:37.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.900+0000 7f19187cc780 1 > prepared operation key=W1K1IU13J0CZ tag=52PY6E9OT36S type=del size=1455830 2024-09-14T10:51:37.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.905+0000 7f19187cc780 1 < suggested remove operation key=EL00Y4Z7DTAT tag=WTL3WT81Q33V type=del 2024-09-14T10:51:37.905 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.906+0000 7f19187cc780 1 > prepared operation key=YA3DI7N4DG5K tag=JHWXTBAJWEYU type=del size=2333956 2024-09-14T10:51:37.907 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.909+0000 7f19187cc780 1 < suggested update operation key=54BSD3DEHNK6 tag=PEY98F63BPTA type=write size=461609 2024-09-14T10:51:37.910 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.912+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~I5U9ZPQ9KAWW.0 size=1048576 2024-09-14T10:51:37.911 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.913+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~I5U9ZPQ9KAWW.1 size=1048576 2024-09-14T10:51:37.913 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.914+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~I5U9ZPQ9KAWW.2 size=491627 2024-09-14T10:51:37.913 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.914+0000 7f19187cc780 1 > prepared multipart upload key=7IWUW2HC3ULI upload=I5U9ZPQ9KAWW tag=TP7KFTKWVEFQ type=write size=3637355 2024-09-14T10:51:37.914 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.916+0000 7f19187cc780 1 < completed write operation key=N0L67LS2KHR1 tag=7QFSENKVUSCY type=write size=186857 2024-09-14T10:51:37.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.918+0000 7f19187cc780 1 > prepared operation key=N0L67LS2KHR1 tag=5V3GDPZXYH6Z type=write size=219902 2024-09-14T10:51:37.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.920+0000 7f19187cc780 1 < completed write operation key=N0L67LS2KHR1 tag=8EOLLVPLHTFE type=write size=474648 2024-09-14T10:51:37.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.922+0000 7f19187cc780 1 > prepared part key=_multipart_9EBD5ZT6MT45.2~KYU7F5FDHP32.0 size=154277 2024-09-14T10:51:37.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.922+0000 7f19187cc780 1 > prepared multipart upload key=9EBD5ZT6MT45 upload=KYU7F5FDHP32 tag=UNAX91375P41 type=write size=1202853 2024-09-14T10:51:37.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.924+0000 7f19187cc780 1 < completed part key=_multipart_QBMNYNWOLK4I.2~KWLSIX2LX7Z2.0 size=1048576 2024-09-14T10:51:37.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.925+0000 7f19187cc780 1 < completed part key=_multipart_QBMNYNWOLK4I.2~KWLSIX2LX7Z2.1 size=763296 2024-09-14T10:51:37.926 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.927+0000 7f19187cc780 1 < completed multipart upload key=QBMNYNWOLK4I upload=KWLSIX2LX7Z2 tag=EA10O4J8KMNR type=write size=2860448 2024-09-14T10:51:37.927 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.929+0000 7f19187cc780 1 > prepared operation key=KP3WOGIF30PZ tag=1RCBJEGAUVV2 type=del size=2556352 2024-09-14T10:51:37.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.930+0000 7f19187cc780 1 < completed delete operation key=OVOPGTYUF3F3 tag=THHKSEZ33L58 type=del 2024-09-14T10:51:37.930 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.932+0000 7f19187cc780 1 > prepared operation key=N0L67LS2KHR1 tag=4WE2PYSCORQY type=write size=953151 2024-09-14T10:51:37.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.933+0000 7f19187cc780 1 < completed delete operation key=H40763V7HMBC tag=NMSVTN3D7EUN type=del 2024-09-14T10:51:37.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.936+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~LEPLSO898PRG.0 size=1048576 2024-09-14T10:51:37.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.937+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~LEPLSO898PRG.1 size=1048576 2024-09-14T10:51:37.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.938+0000 7f19187cc780 1 > prepared part key=_multipart_6BNN842ZTWG5.2~LEPLSO898PRG.2 size=9660 2024-09-14T10:51:37.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.938+0000 7f19187cc780 1 > prepared multipart upload key=6BNN842ZTWG5 upload=LEPLSO898PRG tag=T6DOFHO5IVLG type=write size=3155388 2024-09-14T10:51:37.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.939+0000 7f19187cc780 1 < completed part key=_multipart_XCVE2F2JJK4X.2~M6PKYOABZEIE.0 size=114292 2024-09-14T10:51:37.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.942+0000 7f19187cc780 1 < completed multipart upload key=XCVE2F2JJK4X upload=M6PKYOABZEIE tag=9K42JGE5GWY9 type=write size=1162868 2024-09-14T10:51:37.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.945+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~NX6C1M4X8XK4.0 size=1048576 2024-09-14T10:51:37.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.946+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~NX6C1M4X8XK4.1 size=1048576 2024-09-14T10:51:37.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.947+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~NX6C1M4X8XK4.2 size=432740 2024-09-14T10:51:37.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.947+0000 7f19187cc780 1 > prepared multipart upload key=AGNUE76X8XCJ upload=NX6C1M4X8XK4 tag=STMEVRQP4V1K type=write size=3578468 2024-09-14T10:51:37.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.949+0000 7f19187cc780 1 < completed part key=_multipart_5AIAYJMRZGFQ.2~LLKKQVD0MKSW.0 size=423832 2024-09-14T10:51:37.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.951+0000 7f19187cc780 1 < completed multipart upload key=5AIAYJMRZGFQ upload=LLKKQVD0MKSW tag=94P5DA3E0QX1 type=write size=1472408 2024-09-14T10:51:37.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.954+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~U2M7KS7KJFJQ.0 size=1048576 2024-09-14T10:51:37.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.955+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~U2M7KS7KJFJQ.1 size=1048576 2024-09-14T10:51:37.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.957+0000 7f19187cc780 1 > prepared part key=_multipart_AGNUE76X8XCJ.2~U2M7KS7KJFJQ.2 size=831620 2024-09-14T10:51:37.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.957+0000 7f19187cc780 1 > prepared multipart upload key=AGNUE76X8XCJ upload=U2M7KS7KJFJQ tag=2L3TNRSITQEW type=write size=3977348 2024-09-14T10:51:37.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.958+0000 7f19187cc780 1 < completed delete operation key=H40763V7HMBC tag=GSWT0E6K89OY type=del 2024-09-14T10:51:37.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.961+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~YHRNQVSTG233.0 size=1048576 2024-09-14T10:51:37.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.962+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~YHRNQVSTG233.1 size=1048576 2024-09-14T10:51:37.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.963+0000 7f19187cc780 1 > prepared part key=_multipart_OVOPGTYUF3F3.2~YHRNQVSTG233.2 size=255878 2024-09-14T10:51:37.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.963+0000 7f19187cc780 1 > prepared multipart upload key=OVOPGTYUF3F3 upload=YHRNQVSTG233 tag=1S9PH30DN5O5 type=write size=3401606 2024-09-14T10:51:37.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.964+0000 7f19187cc780 1 < completed write operation key=KOJ7QB7M6A35 tag=HGAM5LGK0T5V type=write size=815148 2024-09-14T10:51:37.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.967+0000 7f19187cc780 1 > prepared part key=_multipart_9EBD5ZT6MT45.2~6YFQJSXHEHMK.0 size=647910 2024-09-14T10:51:37.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.967+0000 7f19187cc780 1 > prepared multipart upload key=9EBD5ZT6MT45 upload=6YFQJSXHEHMK tag=6DH026ICPTVF type=write size=1696486 2024-09-14T10:51:37.967 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.969+0000 7f19187cc780 1 < completed write operation key=RTGE7ISETJWW tag=G9NWFIBKNOZN type=write size=782326 2024-09-14T10:51:37.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.970+0000 7f19187cc780 1 > prepared operation key=YA3DI7N4DG5K tag=TJXCFMG9KQDH type=del size=4021364 2024-09-14T10:51:37.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.972+0000 7f19187cc780 1 < completed delete operation key=RTGE7ISETJWW tag=XHOBZX4Z0DVZ type=del 2024-09-14T10:51:37.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.973+0000 7f19187cc780 1 > prepared operation key=19P3WE6HKJH2 tag=A5RS4LM0CRJB type=del size=3909398 2024-09-14T10:51:37.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.975+0000 7f19187cc780 1 < completed delete operation key=AGNUE76X8XCJ tag=UNNPZ533WEN0 type=del 2024-09-14T10:51:37.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.976+0000 7f19187cc780 1 > prepared operation key=6BNN842ZTWG5 tag=TSAEWQXAQK0Q type=del size=264035 2024-09-14T10:51:37.976 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.978+0000 7f19187cc780 1 < completed delete operation key=E6UO1LUWOC44 tag=LZ8TXQPU4F13 type=del 2024-09-14T10:51:37.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.979+0000 7f19187cc780 1 > prepared operation key=9EBD5ZT6MT45 tag=5ZPHMF1826XE type=del size=1009004 2024-09-14T10:51:37.980 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.982+0000 7f19187cc780 1 < suggested remove operation key=W1K1IU13J0CZ tag=52PY6E9OT36S type=del 2024-09-14T10:51:37.983 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.985+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~2OIVSX5I1CIZ.0 size=1048576 2024-09-14T10:51:37.984 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.986+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~2OIVSX5I1CIZ.1 size=338454 2024-09-14T10:51:37.984 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.986+0000 7f19187cc780 1 > prepared multipart upload key=IKVYA4KEALFF upload=2OIVSX5I1CIZ tag=R2U3LSENHWA8 type=write size=2435606 2024-09-14T10:51:37.986 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.987+0000 7f19187cc780 1 < completed delete operation key=YA3DI7N4DG5K tag=JHWXTBAJWEYU type=del 2024-09-14T10:51:37.988 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.990+0000 7f19187cc780 1 > prepared part key=_multipart_H40763V7HMBC.2~C8270NVYVFXN.0 size=1048576 2024-09-14T10:51:37.989 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.991+0000 7f19187cc780 1 > prepared part key=_multipart_H40763V7HMBC.2~C8270NVYVFXN.1 size=1048576 2024-09-14T10:51:37.990 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.992+0000 7f19187cc780 1 > prepared part key=_multipart_H40763V7HMBC.2~C8270NVYVFXN.2 size=834044 2024-09-14T10:51:37.990 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.992+0000 7f19187cc780 1 > prepared multipart upload key=H40763V7HMBC upload=C8270NVYVFXN tag=VMPADDM0YQ77 type=write size=3979772 2024-09-14T10:51:37.992 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.993+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~I5U9ZPQ9KAWW.0 size=1048576 2024-09-14T10:51:37.993 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.995+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~I5U9ZPQ9KAWW.1 size=1048576 2024-09-14T10:51:37.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.996+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~I5U9ZPQ9KAWW.2 size=491627 2024-09-14T10:51:37.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:37.998+0000 7f19187cc780 1 < completed multipart upload key=7IWUW2HC3ULI upload=I5U9ZPQ9KAWW tag=TP7KFTKWVEFQ type=write size=3637355 2024-09-14T10:51:37.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.000+0000 7f19187cc780 1 > prepared part key=_multipart_N0L67LS2KHR1.2~LA3G5WELDL4S.0 size=272847 2024-09-14T10:51:37.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.000+0000 7f19187cc780 1 > prepared multipart upload key=N0L67LS2KHR1 upload=LA3G5WELDL4S tag=WA0L6QNJL7ZT type=write size=1321423 2024-09-14T10:51:38.000 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.002+0000 7f19187cc780 1 < completed write operation key=N0L67LS2KHR1 tag=5V3GDPZXYH6Z type=write size=219902 2024-09-14T10:51:38.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.005+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~4EQH6QEFLW6Y.0 size=1048576 2024-09-14T10:51:38.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.006+0000 7f19187cc780 1 > prepared part key=_multipart_B9FQYIX19AEP.2~4EQH6QEFLW6Y.1 size=44996 2024-09-14T10:51:38.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.006+0000 7f19187cc780 1 > prepared multipart upload key=B9FQYIX19AEP upload=4EQH6QEFLW6Y tag=3QEFS87ZR7JQ type=write size=2142148 2024-09-14T10:51:38.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.006+0000 7f19187cc780 1 < canceled part key=_multipart_9EBD5ZT6MT45.2~KYU7F5FDHP32.0 size=154277 2024-09-14T10:51:38.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.009+0000 7f19187cc780 1 < canceled multipart upload key=9EBD5ZT6MT45 upload=KYU7F5FDHP32 tag=UNAX91375P41 type=write size=1202853 2024-09-14T10:51:38.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.010+0000 7f19187cc780 1 > prepared operation key=OVOPGTYUF3F3 tag=E5DSN0JV6VSD type=write size=319971 2024-09-14T10:51:38.010 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.012+0000 7f19187cc780 1 < completed delete operation key=KP3WOGIF30PZ tag=1RCBJEGAUVV2 type=del 2024-09-14T10:51:38.013 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.014+0000 7f19187cc780 1 > prepared part key=_multipart_EL00Y4Z7DTAT.2~UYXU6ZNB1DAC.0 size=1048576 2024-09-14T10:51:38.014 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.016+0000 7f19187cc780 1 > prepared part key=_multipart_EL00Y4Z7DTAT.2~UYXU6ZNB1DAC.1 size=492692 2024-09-14T10:51:38.014 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.016+0000 7f19187cc780 1 > prepared multipart upload key=EL00Y4Z7DTAT upload=UYXU6ZNB1DAC tag=D8UFH0PXJYZU type=write size=2589844 2024-09-14T10:51:38.016 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.017+0000 7f19187cc780 1 < completed write operation key=N0L67LS2KHR1 tag=4WE2PYSCORQY type=write size=953151 2024-09-14T10:51:38.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.020+0000 7f19187cc780 1 > prepared part key=_multipart_EZLSMEK89N2G.2~QNG64HXTBT14.0 size=1028474 2024-09-14T10:51:38.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.020+0000 7f19187cc780 1 > prepared multipart upload key=EZLSMEK89N2G upload=QNG64HXTBT14 tag=V90BZOLNUNXB type=write size=2077050 2024-09-14T10:51:38.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.022+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~LEPLSO898PRG.0 size=1048576 2024-09-14T10:51:38.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.023+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~LEPLSO898PRG.1 size=1048576 2024-09-14T10:51:38.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.024+0000 7f19187cc780 1 < completed part key=_multipart_6BNN842ZTWG5.2~LEPLSO898PRG.2 size=9660 2024-09-14T10:51:38.025 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.027+0000 7f19187cc780 1 < completed multipart upload key=6BNN842ZTWG5 upload=LEPLSO898PRG tag=T6DOFHO5IVLG type=write size=3155388 2024-09-14T10:51:38.028 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.029+0000 7f19187cc780 1 > prepared part key=_multipart_XCVE2F2JJK4X.2~RMA4EIFMN0X1.0 size=310252 2024-09-14T10:51:38.028 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.029+0000 7f19187cc780 1 > prepared multipart upload key=XCVE2F2JJK4X upload=RMA4EIFMN0X1 tag=EW9A6P5X6IF4 type=write size=1358828 2024-09-14T10:51:38.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.031+0000 7f19187cc780 1 < completed part key=_multipart_AGNUE76X8XCJ.2~NX6C1M4X8XK4.0 size=1048576 2024-09-14T10:51:38.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.032+0000 7f19187cc780 1 < completed part key=_multipart_AGNUE76X8XCJ.2~NX6C1M4X8XK4.1 size=1048576 2024-09-14T10:51:38.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.033+0000 7f19187cc780 1 < completed part key=_multipart_AGNUE76X8XCJ.2~NX6C1M4X8XK4.2 size=432740 2024-09-14T10:51:38.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.036+0000 7f19187cc780 1 < completed multipart upload key=AGNUE76X8XCJ upload=NX6C1M4X8XK4 tag=STMEVRQP4V1K type=write size=3578468 2024-09-14T10:51:38.036 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.037+0000 7f19187cc780 1 > prepared operation key=E6UO1LUWOC44 tag=722Z3JI2IGI1 type=del size=1688382 2024-09-14T10:51:38.037 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.039+0000 7f19187cc780 1 < completed part key=_multipart_AGNUE76X8XCJ.2~U2M7KS7KJFJQ.0 size=1048576 2024-09-14T10:51:38.038 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.040+0000 7f19187cc780 1 < completed part key=_multipart_AGNUE76X8XCJ.2~U2M7KS7KJFJQ.1 size=1048576 2024-09-14T10:51:38.039 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.041+0000 7f19187cc780 1 < completed part key=_multipart_AGNUE76X8XCJ.2~U2M7KS7KJFJQ.2 size=831620 2024-09-14T10:51:38.042 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.044+0000 7f19187cc780 1 < completed multipart upload key=AGNUE76X8XCJ upload=U2M7KS7KJFJQ tag=2L3TNRSITQEW type=write size=3977348 2024-09-14T10:51:38.044 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.045+0000 7f19187cc780 1 > prepared operation key=VW6U36JN2DBX tag=I1JHQGVB82RB type=del size=2412079 2024-09-14T10:51:38.045 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.047+0000 7f19187cc780 1 < completed part key=_multipart_OVOPGTYUF3F3.2~YHRNQVSTG233.0 size=1048576 2024-09-14T10:51:38.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.048+0000 7f19187cc780 1 < completed part key=_multipart_OVOPGTYUF3F3.2~YHRNQVSTG233.1 size=1048576 2024-09-14T10:51:38.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.049+0000 7f19187cc780 1 < completed part key=_multipart_OVOPGTYUF3F3.2~YHRNQVSTG233.2 size=255878 2024-09-14T10:51:38.051 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.053+0000 7f19187cc780 1 < completed multipart upload key=OVOPGTYUF3F3 upload=YHRNQVSTG233 tag=1S9PH30DN5O5 type=write size=3401606 2024-09-14T10:51:38.052 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.054+0000 7f19187cc780 1 > prepared operation key=54BSD3DEHNK6 tag=17TXRI9UDXEQ type=del size=2905872 2024-09-14T10:51:38.054 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.056+0000 7f19187cc780 1 < completed part key=_multipart_9EBD5ZT6MT45.2~6YFQJSXHEHMK.0 size=647910 2024-09-14T10:51:38.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.058+0000 7f19187cc780 1 < completed multipart upload key=9EBD5ZT6MT45 upload=6YFQJSXHEHMK tag=6DH026ICPTVF type=write size=1696486 2024-09-14T10:51:38.059 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.061+0000 7f19187cc780 1 > prepared part key=_multipart_9EBD5ZT6MT45.2~RVP56V9F9B4J.0 size=687368 2024-09-14T10:51:38.059 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.061+0000 7f19187cc780 1 > prepared multipart upload key=9EBD5ZT6MT45 upload=RVP56V9F9B4J tag=CD3F4ORNA8DS type=write size=1735944 2024-09-14T10:51:38.061 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.062+0000 7f19187cc780 1 < completed delete operation key=YA3DI7N4DG5K tag=TJXCFMG9KQDH type=del 2024-09-14T10:51:38.062 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.064+0000 7f19187cc780 1 > prepared operation key=CADC2BY888V1 tag=FZ2ULR14OM14 type=del size=1629165 2024-09-14T10:51:38.063 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.065+0000 7f19187cc780 1 < completed delete operation key=19P3WE6HKJH2 tag=A5RS4LM0CRJB type=del 2024-09-14T10:51:38.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.067+0000 7f19187cc780 1 > prepared operation key=KP3WOGIF30PZ tag=O18HGIBB3V1P type=del size=896997 2024-09-14T10:51:38.066 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.068+0000 7f19187cc780 1 < completed delete operation key=6BNN842ZTWG5 tag=TSAEWQXAQK0Q type=del 2024-09-14T10:51:38.069 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.071+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~0Y3IML0XUV98.0 size=1048576 2024-09-14T10:51:38.072 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.072+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~0Y3IML0XUV98.1 size=1048576 2024-09-14T10:51:38.072 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.073+0000 7f19187cc780 1 > prepared part key=_multipart_IKVYA4KEALFF.2~0Y3IML0XUV98.2 size=71909 2024-09-14T10:51:38.072 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.073+0000 7f19187cc780 1 > prepared multipart upload key=IKVYA4KEALFF upload=0Y3IML0XUV98 tag=U9EZ8DPPBVLZ type=write size=3217637 2024-09-14T10:51:38.074 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.076+0000 7f19187cc780 1 < suggested remove operation key=9EBD5ZT6MT45 tag=5ZPHMF1826XE type=del 2024-09-14T10:51:38.075 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.077+0000 7f19187cc780 1 > prepared operation key=IKVYA4KEALFF tag=VUSZ9QDB0I6E type=del size=1184609 2024-09-14T10:51:38.077 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.079+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~2OIVSX5I1CIZ.0 size=1048576 2024-09-14T10:51:38.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.080+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~2OIVSX5I1CIZ.1 size=338454 2024-09-14T10:51:38.080 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.082+0000 7f19187cc780 1 < completed multipart upload key=IKVYA4KEALFF upload=2OIVSX5I1CIZ tag=R2U3LSENHWA8 type=write size=2435606 2024-09-14T10:51:38.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.085+0000 7f19187cc780 1 > prepared part key=_multipart_5AIAYJMRZGFQ.2~CJRQND2N3S9A.0 size=1048576 2024-09-14T10:51:38.084 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.086+0000 7f19187cc780 1 > prepared part key=_multipart_5AIAYJMRZGFQ.2~CJRQND2N3S9A.1 size=283934 2024-09-14T10:51:38.084 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.086+0000 7f19187cc780 1 > prepared multipart upload key=5AIAYJMRZGFQ upload=CJRQND2N3S9A tag=JWNPI1L0KM60 type=write size=2381086 2024-09-14T10:51:38.086 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.087+0000 7f19187cc780 1 < completed part key=_multipart_H40763V7HMBC.2~C8270NVYVFXN.0 size=1048576 2024-09-14T10:51:38.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.088+0000 7f19187cc780 1 < completed part key=_multipart_H40763V7HMBC.2~C8270NVYVFXN.1 size=1048576 2024-09-14T10:51:38.088 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.090+0000 7f19187cc780 1 < completed part key=_multipart_H40763V7HMBC.2~C8270NVYVFXN.2 size=834044 2024-09-14T10:51:38.090 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.092+0000 7f19187cc780 1 < completed multipart upload key=H40763V7HMBC upload=C8270NVYVFXN tag=VMPADDM0YQ77 type=write size=3979772 2024-09-14T10:51:38.093 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.095+0000 7f19187cc780 1 > prepared part key=_multipart_H40763V7HMBC.2~27ODZXR5ZODS.0 size=1048576 2024-09-14T10:51:38.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.096+0000 7f19187cc780 1 > prepared part key=_multipart_H40763V7HMBC.2~27ODZXR5ZODS.1 size=1048576 2024-09-14T10:51:38.095 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.097+0000 7f19187cc780 1 > prepared part key=_multipart_H40763V7HMBC.2~27ODZXR5ZODS.2 size=883154 2024-09-14T10:51:38.095 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.097+0000 7f19187cc780 1 > prepared multipart upload key=H40763V7HMBC upload=27ODZXR5ZODS tag=O77X2UFWUNR1 type=write size=4028882 2024-09-14T10:51:38.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.098+0000 7f19187cc780 1 < completed part key=_multipart_N0L67LS2KHR1.2~LA3G5WELDL4S.0 size=272847 2024-09-14T10:51:38.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.100+0000 7f19187cc780 1 < completed multipart upload key=N0L67LS2KHR1 upload=LA3G5WELDL4S tag=WA0L6QNJL7ZT type=write size=1321423 2024-09-14T10:51:38.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.102+0000 7f19187cc780 1 > prepared operation key=QFEI6H4EQ9ZR tag=90F37BWATA0A type=del size=1611639 2024-09-14T10:51:38.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.103+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~4EQH6QEFLW6Y.0 size=1048576 2024-09-14T10:51:38.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.105+0000 7f19187cc780 1 < completed part key=_multipart_B9FQYIX19AEP.2~4EQH6QEFLW6Y.1 size=44996 2024-09-14T10:51:38.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.107+0000 7f19187cc780 1 < completed multipart upload key=B9FQYIX19AEP upload=4EQH6QEFLW6Y tag=3QEFS87ZR7JQ type=write size=2142148 2024-09-14T10:51:38.107 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.108+0000 7f19187cc780 1 > prepared operation key=CADC2BY888V1 tag=I1UGBXYZOCUC type=del size=1096390 2024-09-14T10:51:38.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.110+0000 7f19187cc780 1 < completed write operation key=OVOPGTYUF3F3 tag=E5DSN0JV6VSD type=write size=319971 2024-09-14T10:51:38.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.111+0000 7f19187cc780 1 > prepared operation key=EL00Y4Z7DTAT tag=SKZ4WR9DBWKN type=del size=4041245 2024-09-14T10:51:38.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.112+0000 7f19187cc780 1 < canceled part key=_multipart_EL00Y4Z7DTAT.2~UYXU6ZNB1DAC.0 size=1048576 2024-09-14T10:51:38.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.113+0000 7f19187cc780 1 < completed part key=_multipart_EL00Y4Z7DTAT.2~UYXU6ZNB1DAC.1 size=492692 2024-09-14T10:51:38.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.115+0000 7f19187cc780 1 < canceled multipart upload key=EL00Y4Z7DTAT upload=UYXU6ZNB1DAC tag=D8UFH0PXJYZU type=write size=2589844 2024-09-14T10:51:38.115 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.116+0000 7f19187cc780 1 > prepared operation key=B9FQYIX19AEP tag=5215P2XMWKAV type=del size=2318051 2024-09-14T10:51:38.116 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.118+0000 7f19187cc780 1 < completed part key=_multipart_EZLSMEK89N2G.2~QNG64HXTBT14.0 size=1028474 2024-09-14T10:51:38.118 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.120+0000 7f19187cc780 1 < completed multipart upload key=EZLSMEK89N2G upload=QNG64HXTBT14 tag=V90BZOLNUNXB type=write size=2077050 2024-09-14T10:51:38.120 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.121+0000 7f19187cc780 1 > prepared operation key=54BSD3DEHNK6 tag=M1VFHOH1CRSI type=del size=353761 2024-09-14T10:51:38.122 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.124+0000 7f19187cc780 1 < completed part key=_multipart_XCVE2F2JJK4X.2~RMA4EIFMN0X1.0 size=310252 2024-09-14T10:51:38.124 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.126+0000 7f19187cc780 1 < completed multipart upload key=XCVE2F2JJK4X upload=RMA4EIFMN0X1 tag=EW9A6P5X6IF4 type=write size=1358828 2024-09-14T10:51:38.127 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.129+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~BOSQ3GR0P1B7.0 size=1048576 2024-09-14T10:51:38.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.130+0000 7f19187cc780 1 > prepared part key=_multipart_KP3WOGIF30PZ.2~BOSQ3GR0P1B7.1 size=590471 2024-09-14T10:51:38.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.130+0000 7f19187cc780 1 > prepared multipart upload key=KP3WOGIF30PZ upload=BOSQ3GR0P1B7 tag=7X7AGRPIWNPJ type=write size=2687623 2024-09-14T10:51:38.130 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.132+0000 7f19187cc780 1 < completed delete operation key=E6UO1LUWOC44 tag=722Z3JI2IGI1 type=del 2024-09-14T10:51:38.132 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.133+0000 7f19187cc780 1 > prepared operation key=54BSD3DEHNK6 tag=L540ULYXZHTB type=del size=3055024 2024-09-14T10:51:38.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.135+0000 7f19187cc780 1 < completed delete operation key=VW6U36JN2DBX tag=I1JHQGVB82RB type=del 2024-09-14T10:51:38.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.137+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~GRIURGZ4PNII.0 size=1048576 2024-09-14T10:51:38.137 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.139+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~GRIURGZ4PNII.1 size=1048576 2024-09-14T10:51:38.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.140+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~GRIURGZ4PNII.2 size=135259 2024-09-14T10:51:38.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.140+0000 7f19187cc780 1 > prepared multipart upload key=KOJ7QB7M6A35 upload=GRIURGZ4PNII tag=3KO0BJI45Z0F type=write size=3280987 2024-09-14T10:51:38.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.141+0000 7f19187cc780 1 < completed delete operation key=54BSD3DEHNK6 tag=17TXRI9UDXEQ type=del 2024-09-14T10:51:38.142 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.144+0000 7f19187cc780 1 > prepared part key=_multipart_54BSD3DEHNK6.2~DDEY7UO8WBPV.0 size=1048576 2024-09-14T10:51:38.143 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.145+0000 7f19187cc780 1 > prepared part key=_multipart_54BSD3DEHNK6.2~DDEY7UO8WBPV.1 size=998116 2024-09-14T10:51:38.143 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.145+0000 7f19187cc780 1 > prepared multipart upload key=54BSD3DEHNK6 upload=DDEY7UO8WBPV tag=81E7U6USMQ1D type=write size=3095268 2024-09-14T10:51:38.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.146+0000 7f19187cc780 1 < completed part key=_multipart_9EBD5ZT6MT45.2~RVP56V9F9B4J.0 size=687368 2024-09-14T10:51:38.147 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.149+0000 7f19187cc780 1 < completed multipart upload key=9EBD5ZT6MT45 upload=RVP56V9F9B4J tag=CD3F4ORNA8DS type=write size=1735944 2024-09-14T10:51:38.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.150+0000 7f19187cc780 1 > prepared operation key=EL00Y4Z7DTAT tag=PS0OR8ZHIN9N type=del size=2422566 2024-09-14T10:51:38.150 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.152+0000 7f19187cc780 1 < completed delete operation key=CADC2BY888V1 tag=FZ2ULR14OM14 type=del 2024-09-14T10:51:38.152 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.153+0000 7f19187cc780 1 > prepared operation key=H40763V7HMBC tag=ZUF06W925WAK type=del size=833587 2024-09-14T10:51:38.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.155+0000 7f19187cc780 1 < completed delete operation key=KP3WOGIF30PZ tag=O18HGIBB3V1P type=del 2024-09-14T10:51:38.155 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.157+0000 7f19187cc780 1 > prepared operation key=CADC2BY888V1 tag=TN7UZNG76YGC type=del size=68037 2024-09-14T10:51:38.155 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.157+0000 7f19187cc780 1 < canceled part key=_multipart_IKVYA4KEALFF.2~0Y3IML0XUV98.0 size=1048576 2024-09-14T10:51:38.156 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.158+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~0Y3IML0XUV98.1 size=1048576 2024-09-14T10:51:38.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.159+0000 7f19187cc780 1 < completed part key=_multipart_IKVYA4KEALFF.2~0Y3IML0XUV98.2 size=71909 2024-09-14T10:51:38.160 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.162+0000 7f19187cc780 1 < canceled multipart upload key=IKVYA4KEALFF upload=0Y3IML0XUV98 tag=U9EZ8DPPBVLZ type=write size=3217637 2024-09-14T10:51:38.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.164+0000 7f19187cc780 1 > prepared part key=_multipart_5AIAYJMRZGFQ.2~E0TXMXTUKMHU.0 size=242653 2024-09-14T10:51:38.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.164+0000 7f19187cc780 1 > prepared multipart upload key=5AIAYJMRZGFQ upload=E0TXMXTUKMHU tag=1UUXMT7A5U2U type=write size=1291229 2024-09-14T10:51:38.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.166+0000 7f19187cc780 1 < completed delete operation key=IKVYA4KEALFF tag=VUSZ9QDB0I6E type=del 2024-09-14T10:51:38.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.168+0000 7f19187cc780 1 > prepared operation key=617QQI921HB4 tag=HPSURF02ICJP type=del size=30970 2024-09-14T10:51:38.167 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.169+0000 7f19187cc780 1 < completed part key=_multipart_5AIAYJMRZGFQ.2~CJRQND2N3S9A.0 size=1048576 2024-09-14T10:51:38.169 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.170+0000 7f19187cc780 1 < completed part key=_multipart_5AIAYJMRZGFQ.2~CJRQND2N3S9A.1 size=283934 2024-09-14T10:51:38.171 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.173+0000 7f19187cc780 1 < completed multipart upload key=5AIAYJMRZGFQ upload=CJRQND2N3S9A tag=JWNPI1L0KM60 type=write size=2381086 2024-09-14T10:51:38.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.175+0000 7f19187cc780 1 > prepared part key=_multipart_MFA30GSMCSKP.2~PSB560P1A3XR.0 size=621860 2024-09-14T10:51:38.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.175+0000 7f19187cc780 1 > prepared multipart upload key=MFA30GSMCSKP upload=PSB560P1A3XR tag=2W7VH8L6XTAA type=write size=1670436 2024-09-14T10:51:38.175 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.177+0000 7f19187cc780 1 < completed part key=_multipart_H40763V7HMBC.2~27ODZXR5ZODS.0 size=1048576 2024-09-14T10:51:38.176 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.178+0000 7f19187cc780 1 < completed part key=_multipart_H40763V7HMBC.2~27ODZXR5ZODS.1 size=1048576 2024-09-14T10:51:38.177 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.179+0000 7f19187cc780 1 < completed part key=_multipart_H40763V7HMBC.2~27ODZXR5ZODS.2 size=883154 2024-09-14T10:51:38.180 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.182+0000 7f19187cc780 1 < completed multipart upload key=H40763V7HMBC upload=27ODZXR5ZODS tag=O77X2UFWUNR1 type=write size=4028882 2024-09-14T10:51:38.181 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.183+0000 7f19187cc780 1 > prepared operation key=19P3WE6HKJH2 tag=290QZAO8XODF type=write size=109286 2024-09-14T10:51:38.183 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.184+0000 7f19187cc780 1 < canceled operation key=QFEI6H4EQ9ZR tag=90F37BWATA0A type=del size=1611639 2024-09-14T10:51:38.186 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.188+0000 7f19187cc780 1 > prepared part key=_multipart_QBMNYNWOLK4I.2~L09G3YG3W0NO.0 size=1048576 2024-09-14T10:51:38.189 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.191+0000 7f19187cc780 1 > prepared part key=_multipart_QBMNYNWOLK4I.2~L09G3YG3W0NO.1 size=1048576 2024-09-14T10:51:38.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.192+0000 7f19187cc780 1 > prepared part key=_multipart_QBMNYNWOLK4I.2~L09G3YG3W0NO.2 size=932415 2024-09-14T10:51:38.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.192+0000 7f19187cc780 1 > prepared multipart upload key=QBMNYNWOLK4I upload=L09G3YG3W0NO tag=1JNEDN0QQFNU type=write size=4078143 2024-09-14T10:51:38.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.193+0000 7f19187cc780 1 < completed delete operation key=CADC2BY888V1 tag=I1UGBXYZOCUC type=del 2024-09-14T10:51:38.194 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.195+0000 7f19187cc780 1 > prepared part key=_multipart_AST81B9QWORT.2~M873JULVD041.0 size=93860 2024-09-14T10:51:38.194 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.195+0000 7f19187cc780 1 > prepared multipart upload key=AST81B9QWORT upload=M873JULVD041 tag=PWBBYTS7ORC2 type=write size=1142436 2024-09-14T10:51:38.195 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.197+0000 7f19187cc780 1 < completed delete operation key=EL00Y4Z7DTAT tag=SKZ4WR9DBWKN type=del 2024-09-14T10:51:38.198 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.199+0000 7f19187cc780 1 > prepared part key=_multipart_61O2VU0SB379.2~4TGJ3JN4VUVT.0 size=877878 2024-09-14T10:51:38.198 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.199+0000 7f19187cc780 1 > prepared multipart upload key=61O2VU0SB379 upload=4TGJ3JN4VUVT tag=FAH8L3COB9EO type=write size=1926454 2024-09-14T10:51:38.199 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.201+0000 7f19187cc780 1 < completed delete operation key=B9FQYIX19AEP tag=5215P2XMWKAV type=del 2024-09-14T10:51:38.201 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.203+0000 7f19187cc780 1 > prepared part key=_multipart_RTGE7ISETJWW.2~Z13BVQXO0TV8.0 size=1048576 2024-09-14T10:51:38.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.204+0000 7f19187cc780 1 > prepared part key=_multipart_RTGE7ISETJWW.2~Z13BVQXO0TV8.1 size=1044179 2024-09-14T10:51:38.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.204+0000 7f19187cc780 1 > prepared multipart upload key=RTGE7ISETJWW upload=Z13BVQXO0TV8 tag=Y5RHU7FOID1R type=write size=3141331 2024-09-14T10:51:38.204 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.206+0000 7f19187cc780 1 < canceled operation key=54BSD3DEHNK6 tag=M1VFHOH1CRSI type=del size=353761 2024-09-14T10:51:38.206 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.207+0000 7f19187cc780 1 > prepared operation key=AGNUE76X8XCJ tag=13XPFOI2DH1Z type=del size=597218 2024-09-14T10:51:38.207 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.209+0000 7f19187cc780 1 < completed part key=_multipart_KP3WOGIF30PZ.2~BOSQ3GR0P1B7.0 size=1048576 2024-09-14T10:51:38.208 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.210+0000 7f19187cc780 1 < completed part key=_multipart_KP3WOGIF30PZ.2~BOSQ3GR0P1B7.1 size=590471 2024-09-14T10:51:38.210 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.212+0000 7f19187cc780 1 < completed multipart upload key=KP3WOGIF30PZ upload=BOSQ3GR0P1B7 tag=7X7AGRPIWNPJ type=write size=2687623 2024-09-14T10:51:38.211 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.213+0000 7f19187cc780 1 > prepared operation key=5AIAYJMRZGFQ tag=IC1FC7DXVYL9 type=del size=2584276 2024-09-14T10:51:38.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.216+0000 7f19187cc780 1 < suggested remove operation key=54BSD3DEHNK6 tag=L540ULYXZHTB type=del 2024-09-14T10:51:38.217 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.218+0000 7f19187cc780 1 > prepared part key=_multipart_5AIAYJMRZGFQ.2~HICE9JA2GYN9.0 size=545805 2024-09-14T10:51:38.217 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.218+0000 7f19187cc780 1 > prepared multipart upload key=5AIAYJMRZGFQ upload=HICE9JA2GYN9 tag=H3KOT0JL8QJQ type=write size=1594381 2024-09-14T10:51:38.218 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.220+0000 7f19187cc780 1 < completed part key=_multipart_KOJ7QB7M6A35.2~GRIURGZ4PNII.0 size=1048576 2024-09-14T10:51:38.219 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.221+0000 7f19187cc780 1 < completed part key=_multipart_KOJ7QB7M6A35.2~GRIURGZ4PNII.1 size=1048576 2024-09-14T10:51:38.220 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.222+0000 7f19187cc780 1 < completed part key=_multipart_KOJ7QB7M6A35.2~GRIURGZ4PNII.2 size=135259 2024-09-14T10:51:38.222 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.224+0000 7f19187cc780 1 < completed multipart upload key=KOJ7QB7M6A35 upload=GRIURGZ4PNII tag=3KO0BJI45Z0F type=write size=3280987 2024-09-14T10:51:38.224 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.226+0000 7f19187cc780 1 > prepared operation key=617QQI921HB4 tag=KLGLZQHB6TCZ type=write size=231220 2024-09-14T10:51:38.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.227+0000 7f19187cc780 1 < completed part key=_multipart_54BSD3DEHNK6.2~DDEY7UO8WBPV.0 size=1048576 2024-09-14T10:51:38.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.228+0000 7f19187cc780 1 < completed part key=_multipart_54BSD3DEHNK6.2~DDEY7UO8WBPV.1 size=998116 2024-09-14T10:51:38.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.230+0000 7f19187cc780 1 < completed multipart upload key=54BSD3DEHNK6 upload=DDEY7UO8WBPV tag=81E7U6USMQ1D type=write size=3095268 2024-09-14T10:51:38.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.233+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~JHHL934V90CQ.0 size=1048576 2024-09-14T10:51:38.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.234+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~JHHL934V90CQ.1 size=1048576 2024-09-14T10:51:38.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.234+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~JHHL934V90CQ.2 size=461307 2024-09-14T10:51:38.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.234+0000 7f19187cc780 1 > prepared multipart upload key=VW6U36JN2DBX upload=JHHL934V90CQ tag=J9X9D4P63HIC type=write size=3607035 2024-09-14T10:51:38.234 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.236+0000 7f19187cc780 1 < completed delete operation key=EL00Y4Z7DTAT tag=PS0OR8ZHIN9N type=del 2024-09-14T10:51:38.238 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.240+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~SUZZS9YSS0P1.0 size=1048576 2024-09-14T10:51:38.239 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.241+0000 7f19187cc780 1 > prepared part key=_multipart_7IWUW2HC3ULI.2~SUZZS9YSS0P1.1 size=521536 2024-09-14T10:51:38.239 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.241+0000 7f19187cc780 1 > prepared multipart upload key=7IWUW2HC3ULI upload=SUZZS9YSS0P1 tag=YK8PDHKDPZVG type=write size=2618688 2024-09-14T10:51:38.241 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.242+0000 7f19187cc780 1 < completed delete operation key=H40763V7HMBC tag=ZUF06W925WAK type=del 2024-09-14T10:51:38.243 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.245+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~E2XQZYOH7DGV.0 size=1048576 2024-09-14T10:51:38.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.246+0000 7f19187cc780 1 > prepared part key=_multipart_KOJ7QB7M6A35.2~E2XQZYOH7DGV.1 size=216337 2024-09-14T10:51:38.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.246+0000 7f19187cc780 1 > prepared multipart upload key=KOJ7QB7M6A35 upload=E2XQZYOH7DGV tag=QZIYR4S1HCQH type=write size=2313489 2024-09-14T10:51:38.247 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.248+0000 7f19187cc780 1 < suggested remove operation key=CADC2BY888V1 tag=TN7UZNG76YGC type=del 2024-09-14T10:51:38.248 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.250+0000 7f19187cc780 1 > prepared operation key=B9FQYIX19AEP tag=NNYOQLGULYHU type=del size=1904556 2024-09-14T10:51:38.250 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.251+0000 7f19187cc780 1 < completed part key=_multipart_5AIAYJMRZGFQ.2~E0TXMXTUKMHU.0 size=242653 2024-09-14T10:51:38.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.253+0000 7f19187cc780 1 < completed multipart upload key=5AIAYJMRZGFQ upload=E0TXMXTUKMHU tag=1UUXMT7A5U2U type=write size=1291229 2024-09-14T10:51:38.253 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.255+0000 7f19187cc780 1 > prepared operation key=6BNN842ZTWG5 tag=109QR3MJKZ3H type=del size=496762 2024-09-14T10:51:38.255 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.256+0000 7f19187cc780 1 < completed delete operation key=617QQI921HB4 tag=HPSURF02ICJP type=del 2024-09-14T10:51:38.256 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.257+0000 7f19187cc780 1 > prepared operation key=VW6U36JN2DBX tag=H1KQROS9B3DH type=del size=2912159 2024-09-14T10:51:38.257 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.259+0000 7f19187cc780 1 < completed part key=_multipart_MFA30GSMCSKP.2~PSB560P1A3XR.0 size=621860 2024-09-14T10:51:38.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.261+0000 7f19187cc780 1 < completed multipart upload key=MFA30GSMCSKP upload=PSB560P1A3XR tag=2W7VH8L6XTAA type=write size=1670436 2024-09-14T10:51:38.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.264+0000 7f19187cc780 1 > prepared part key=_multipart_EZLSMEK89N2G.2~0ZYAP218VRMU.0 size=1048576 2024-09-14T10:51:38.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.265+0000 7f19187cc780 1 > prepared part key=_multipart_EZLSMEK89N2G.2~0ZYAP218VRMU.1 size=365212 2024-09-14T10:51:38.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.265+0000 7f19187cc780 1 > prepared multipart upload key=EZLSMEK89N2G upload=0ZYAP218VRMU tag=TMEB2B91B2NA type=write size=2462364 2024-09-14T10:51:38.264 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.266+0000 7f19187cc780 1 < completed write operation key=19P3WE6HKJH2 tag=290QZAO8XODF type=write size=109286 2024-09-14T10:51:38.266 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.267+0000 7f19187cc780 1 > prepared operation key=KP3WOGIF30PZ tag=A5FDUFRVDG2I type=del size=1067480 2024-09-14T10:51:38.267 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.269+0000 7f19187cc780 1 < completed part key=_multipart_QBMNYNWOLK4I.2~L09G3YG3W0NO.0 size=1048576 2024-09-14T10:51:38.267 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.269+0000 7f19187cc780 1 < canceled part key=_multipart_QBMNYNWOLK4I.2~L09G3YG3W0NO.1 size=1048576 2024-09-14T10:51:38.268 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.270+0000 7f19187cc780 1 < completed part key=_multipart_QBMNYNWOLK4I.2~L09G3YG3W0NO.2 size=932415 2024-09-14T10:51:38.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.272+0000 7f19187cc780 1 < canceled multipart upload key=QBMNYNWOLK4I upload=L09G3YG3W0NO tag=1JNEDN0QQFNU type=write size=4078143 2024-09-14T10:51:38.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.274+0000 7f19187cc780 1 > prepared part key=_multipart_M73CER01XHDY.2~2W9NLQO9TUUM.0 size=1048576 2024-09-14T10:51:38.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.276+0000 7f19187cc780 1 > prepared part key=_multipart_M73CER01XHDY.2~2W9NLQO9TUUM.1 size=1048576 2024-09-14T10:51:38.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.277+0000 7f19187cc780 1 > prepared part key=_multipart_M73CER01XHDY.2~2W9NLQO9TUUM.2 size=1031942 2024-09-14T10:51:38.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.277+0000 7f19187cc780 1 > prepared multipart upload key=M73CER01XHDY upload=2W9NLQO9TUUM tag=FOTXQSGQQ5D1 type=write size=4177670 2024-09-14T10:51:38.277 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.278+0000 7f19187cc780 1 < completed part key=_multipart_AST81B9QWORT.2~M873JULVD041.0 size=93860 2024-09-14T10:51:38.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.282+0000 7f19187cc780 1 < completed multipart upload key=AST81B9QWORT upload=M873JULVD041 tag=PWBBYTS7ORC2 type=write size=1142436 2024-09-14T10:51:38.281 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.283+0000 7f19187cc780 1 > prepared operation key=YA3DI7N4DG5K tag=5P3EIDORLZ98 type=del size=2583076 2024-09-14T10:51:38.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.284+0000 7f19187cc780 1 < completed part key=_multipart_61O2VU0SB379.2~4TGJ3JN4VUVT.0 size=877878 2024-09-14T10:51:38.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.286+0000 7f19187cc780 1 < completed multipart upload key=61O2VU0SB379 upload=4TGJ3JN4VUVT tag=FAH8L3COB9EO type=write size=1926454 2024-09-14T10:51:38.287 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.289+0000 7f19187cc780 1 > prepared part key=_multipart_M73CER01XHDY.2~WNFVQHV2L11B.0 size=1048576 2024-09-14T10:51:38.288 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.290+0000 7f19187cc780 1 > prepared part key=_multipart_M73CER01XHDY.2~WNFVQHV2L11B.1 size=1048576 2024-09-14T10:51:38.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.291+0000 7f19187cc780 1 > prepared part key=_multipart_M73CER01XHDY.2~WNFVQHV2L11B.2 size=6765 2024-09-14T10:51:38.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.291+0000 7f19187cc780 1 > prepared multipart upload key=M73CER01XHDY upload=WNFVQHV2L11B tag=WVW9YBK0DQGX type=write size=3152493 2024-09-14T10:51:38.291 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.292+0000 7f19187cc780 1 < completed part key=_multipart_RTGE7ISETJWW.2~Z13BVQXO0TV8.0 size=1048576 2024-09-14T10:51:38.292 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.294+0000 7f19187cc780 1 < completed part key=_multipart_RTGE7ISETJWW.2~Z13BVQXO0TV8.1 size=1044179 2024-09-14T10:51:38.295 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.296+0000 7f19187cc780 1 < completed multipart upload key=RTGE7ISETJWW upload=Z13BVQXO0TV8 tag=Y5RHU7FOID1R type=write size=3141331 2024-09-14T10:51:38.296 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.298+0000 7f19187cc780 1 > prepared operation key=CADC2BY888V1 tag=D67ZIR4UWT64 type=del size=849404 2024-09-14T10:51:38.298 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.300+0000 7f19187cc780 1 < completed delete operation key=AGNUE76X8XCJ tag=13XPFOI2DH1Z type=del 2024-09-14T10:51:38.299 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.301+0000 7f19187cc780 1 > prepared operation key=EL00Y4Z7DTAT tag=ZKK405RJAKK3 type=del size=3764063 2024-09-14T10:51:38.301 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.303+0000 7f19187cc780 1 < completed delete operation key=5AIAYJMRZGFQ tag=IC1FC7DXVYL9 type=del 2024-09-14T10:51:38.303 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.304+0000 7f19187cc780 1 > prepared operation key=EL00Y4Z7DTAT tag=C8GU3H02IWY7 type=write size=964388 2024-09-14T10:51:38.304 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.306+0000 7f19187cc780 1 < completed part key=_multipart_5AIAYJMRZGFQ.2~HICE9JA2GYN9.0 size=545805 2024-09-14T10:51:38.306 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.308+0000 7f19187cc780 1 < completed multipart upload key=5AIAYJMRZGFQ upload=HICE9JA2GYN9 tag=H3KOT0JL8QJQ type=write size=1594381 2024-09-14T10:51:38.308 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.309+0000 7f19187cc780 1 > prepared operation key=IKVYA4KEALFF tag=S7K80CUOIY58 type=del size=2040782 2024-09-14T10:51:38.309 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.311+0000 7f19187cc780 1 < completed write operation key=617QQI921HB4 tag=KLGLZQHB6TCZ type=write size=231220 2024-09-14T10:51:38.311 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.312+0000 7f19187cc780 1 > prepared operation key=INJQTKXHBUV2 tag=17APIO2PXV14 type=write size=287633 2024-09-14T10:51:38.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.313+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~JHHL934V90CQ.0 size=1048576 2024-09-14T10:51:38.313 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.315+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~JHHL934V90CQ.1 size=1048576 2024-09-14T10:51:38.315 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.317+0000 7f19187cc780 1 < completed part key=_multipart_VW6U36JN2DBX.2~JHHL934V90CQ.2 size=461307 2024-09-14T10:51:38.319 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.321+0000 7f19187cc780 1 < completed multipart upload key=VW6U36JN2DBX upload=JHHL934V90CQ tag=J9X9D4P63HIC type=write size=3607035 2024-09-14T10:51:38.321 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.322+0000 7f19187cc780 1 > prepared operation key=INJQTKXHBUV2 tag=LEWVVEPVX5UE type=del size=2108346 2024-09-14T10:51:38.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.324+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~SUZZS9YSS0P1.0 size=1048576 2024-09-14T10:51:38.324 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.325+0000 7f19187cc780 1 < completed part key=_multipart_7IWUW2HC3ULI.2~SUZZS9YSS0P1.1 size=521536 2024-09-14T10:51:38.327 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.328+0000 7f19187cc780 1 < completed multipart upload key=7IWUW2HC3ULI upload=SUZZS9YSS0P1 tag=YK8PDHKDPZVG type=write size=2618688 2024-09-14T10:51:38.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.330+0000 7f19187cc780 1 > prepared operation key=INJQTKXHBUV2 tag=0LYJXX1Z1WB8 type=del size=781282 2024-09-14T10:51:38.330 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.331+0000 7f19187cc780 1 < completed part key=_multipart_KOJ7QB7M6A35.2~E2XQZYOH7DGV.0 size=1048576 2024-09-14T10:51:38.330 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.332+0000 7f19187cc780 1 < canceled part key=_multipart_KOJ7QB7M6A35.2~E2XQZYOH7DGV.1 size=216337 2024-09-14T10:51:38.332 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.334+0000 7f19187cc780 1 < canceled multipart upload key=KOJ7QB7M6A35 upload=E2XQZYOH7DGV tag=QZIYR4S1HCQH type=write size=2313489 2024-09-14T10:51:38.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.335+0000 7f19187cc780 1 > prepared operation key=61O2VU0SB379 tag=YU6VPI80GVZX type=del size=3494994 2024-09-14T10:51:38.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.337+0000 7f19187cc780 1 < completed delete operation key=B9FQYIX19AEP tag=NNYOQLGULYHU type=del 2024-09-14T10:51:38.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.339+0000 7f19187cc780 1 > prepared part key=_multipart_19P3WE6HKJH2.2~4KA4M6FVFZ3C.0 size=1048576 2024-09-14T10:51:38.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.341+0000 7f19187cc780 1 > prepared part key=_multipart_19P3WE6HKJH2.2~4KA4M6FVFZ3C.1 size=39412 2024-09-14T10:51:38.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.341+0000 7f19187cc780 1 > prepared multipart upload key=19P3WE6HKJH2 upload=4KA4M6FVFZ3C tag=MMGCLLBVZ9B2 type=write size=2136564 2024-09-14T10:51:38.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.342+0000 7f19187cc780 1 < completed delete operation key=6BNN842ZTWG5 tag=109QR3MJKZ3H type=del 2024-09-14T10:51:38.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.345+0000 7f19187cc780 1 > prepared part key=_multipart_H40763V7HMBC.2~7O67MM6STU5O.0 size=1048576 2024-09-14T10:51:38.344 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.346+0000 7f19187cc780 1 > prepared part key=_multipart_H40763V7HMBC.2~7O67MM6STU5O.1 size=1048576 2024-09-14T10:51:38.346 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.347+0000 7f19187cc780 1 > prepared part key=_multipart_H40763V7HMBC.2~7O67MM6STU5O.2 size=928096 2024-09-14T10:51:38.346 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.347+0000 7f19187cc780 1 > prepared multipart upload key=H40763V7HMBC upload=7O67MM6STU5O tag=LKI8PNRKRXZ9 type=write size=4073824 2024-09-14T10:51:38.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.349+0000 7f19187cc780 1 < completed delete operation key=VW6U36JN2DBX tag=H1KQROS9B3DH type=del 2024-09-14T10:51:38.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.350+0000 7f19187cc780 1 > prepared operation key=54BSD3DEHNK6 tag=FASSH41B9Y28 type=del size=1366580 2024-09-14T10:51:38.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.352+0000 7f19187cc780 1 < completed part key=_multipart_EZLSMEK89N2G.2~0ZYAP218VRMU.0 size=1048576 2024-09-14T10:51:38.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.352+0000 7f19187cc780 1 < canceled part key=_multipart_EZLSMEK89N2G.2~0ZYAP218VRMU.1 size=365212 2024-09-14T10:51:38.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.355+0000 7f19187cc780 1 < canceled multipart upload key=EZLSMEK89N2G upload=0ZYAP218VRMU tag=TMEB2B91B2NA type=write size=2462364 2024-09-14T10:51:38.355 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.357+0000 7f19187cc780 1 > prepared operation key=EL00Y4Z7DTAT tag=DCV7T7DJGLS1 type=del size=2935902 2024-09-14T10:51:38.357 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.358+0000 7f19187cc780 1 < completed delete operation key=KP3WOGIF30PZ tag=A5FDUFRVDG2I type=del 2024-09-14T10:51:38.359 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.361+0000 7f19187cc780 1 > prepared part key=_multipart_VW6U36JN2DBX.2~HW6HW0CYASOU.0 size=456100 2024-09-14T10:51:38.359 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.361+0000 7f19187cc780 1 > prepared multipart upload key=VW6U36JN2DBX upload=HW6HW0CYASOU tag=M3X2T1OPAB3Y type=write size=1504676 2024-09-14T10:51:38.361 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.363+0000 7f19187cc780 1 < completed part key=_multipart_M73CER01XHDY.2~2W9NLQO9TUUM.0 size=1048576 2024-09-14T10:51:38.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.364+0000 7f19187cc780 1 < completed part key=_multipart_M73CER01XHDY.2~2W9NLQO9TUUM.1 size=1048576 2024-09-14T10:51:38.363 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.365+0000 7f19187cc780 1 < completed part key=_multipart_M73CER01XHDY.2~2W9NLQO9TUUM.2 size=1031942 2024-09-14T10:51:38.366 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.367+0000 7f19187cc780 1 < completed multipart upload key=M73CER01XHDY upload=2W9NLQO9TUUM tag=FOTXQSGQQ5D1 type=write size=4177670 2024-09-14T10:51:38.368 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.370+0000 7f19187cc780 1 > prepared part key=_multipart_M73CER01XHDY.2~4FT9QIFTTCO0.0 size=1048576 2024-09-14T10:51:38.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.371+0000 7f19187cc780 1 > prepared part key=_multipart_M73CER01XHDY.2~4FT9QIFTTCO0.1 size=1048576 2024-09-14T10:51:38.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.372+0000 7f19187cc780 1 > prepared part key=_multipart_M73CER01XHDY.2~4FT9QIFTTCO0.2 size=218970 2024-09-14T10:51:38.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.372+0000 7f19187cc780 1 > prepared multipart upload key=M73CER01XHDY upload=4FT9QIFTTCO0 tag=9NKYRCB0WE9N type=write size=3364698 2024-09-14T10:51:38.372 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.374+0000 7f19187cc780 1 < completed delete operation key=YA3DI7N4DG5K tag=5P3EIDORLZ98 type=del 2024-09-14T10:51:38.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.375+0000 7f19187cc780 1 > prepared operation key=QFEI6H4EQ9ZR tag=XPEW223NEJL0 type=del size=1259193 2024-09-14T10:51:38.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.377+0000 7f19187cc780 1 < completed part key=_multipart_M73CER01XHDY.2~WNFVQHV2L11B.0 size=1048576 2024-09-14T10:51:38.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.378+0000 7f19187cc780 1 < completed part key=_multipart_M73CER01XHDY.2~WNFVQHV2L11B.1 size=1048576 2024-09-14T10:51:38.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.379+0000 7f19187cc780 1 < completed part key=_multipart_M73CER01XHDY.2~WNFVQHV2L11B.2 size=6765 2024-09-14T10:51:38.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.382+0000 7f19187cc780 1 < completed multipart upload key=M73CER01XHDY upload=WNFVQHV2L11B tag=WVW9YBK0DQGX type=write size=3152493 2024-09-14T10:51:38.382 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.384+0000 7f19187cc780 1 > prepared part key=_multipart_E6UO1LUWOC44.2~B72O2R6ZT5RZ.0 size=1048576 2024-09-14T10:51:38.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.385+0000 7f19187cc780 1 > prepared part key=_multipart_E6UO1LUWOC44.2~B72O2R6ZT5RZ.1 size=514264 2024-09-14T10:51:38.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.385+0000 7f19187cc780 1 > prepared multipart upload key=E6UO1LUWOC44 upload=B72O2R6ZT5RZ tag=KCC8YZM7WAZ3 type=write size=2611416 2024-09-14T10:51:38.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.387+0000 7f19187cc780 1 < completed delete operation key=CADC2BY888V1 tag=D67ZIR4UWT64 type=del 2024-09-14T10:51:38.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.388+0000 7f19187cc780 1 > prepared operation key=61O2VU0SB379 tag=GHL1LCFPLOWC type=write size=180256 2024-09-14T10:51:38.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.390+0000 7f19187cc780 1 < completed delete operation key=EL00Y4Z7DTAT tag=ZKK405RJAKK3 type=del 2024-09-14T10:51:38.390 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.391+0000 7f19187cc780 1 > prepared operation key=CADC2BY888V1 tag=PVSDVMZKZ1SI type=del size=3852211 2024-09-14T10:51:38.391 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.393+0000 7f19187cc780 1 < canceled operation key=EL00Y4Z7DTAT tag=C8GU3H02IWY7 type=write size=964388 2024-09-14T10:51:38.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.394+0000 7f19187cc780 1 > prepared operation key=617QQI921HB4 tag=8Q9KKJA00226 type=del size=3106028 2024-09-14T10:51:38.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.396+0000 7f19187cc780 1 < completed delete operation key=IKVYA4KEALFF tag=S7K80CUOIY58 type=del 2024-09-14T10:51:38.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.397+0000 7f19187cc780 1 > prepared operation key=CADC2BY888V1 tag=5XVRWPCPLRPF type=write size=740386 2024-09-14T10:51:38.397 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.399+0000 7f19187cc780 1 < canceled operation key=INJQTKXHBUV2 tag=17APIO2PXV14 type=write size=287633 2024-09-14T10:51:38.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.400+0000 7f19187cc780 1 > prepared operation key=7IWUW2HC3ULI tag=SP9FS7BCM7KT type=del size=3597405 2024-09-14T10:51:38.400 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.402+0000 7f19187cc780 1 < canceled operation key=INJQTKXHBUV2 tag=LEWVVEPVX5UE type=del size=2108346 2024-09-14T10:51:38.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.403+0000 7f19187cc780 1 > prepared operation key=W1K1IU13J0CZ tag=AUAEPD46VXL8 type=del size=3636346 2024-09-14T10:51:38.403 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.405+0000 7f19187cc780 1 < completed delete operation key=INJQTKXHBUV2 tag=0LYJXX1Z1WB8 type=del 2024-09-14T10:51:38.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:51:38.406+0000 7f19187cc780 1 > prepared operation key=OVOPGTYUF3F3 tag=06R73ZJUPBU1 type=del size=2521204 2024-09-14T10:51:38.405 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] cls_rgw_stats.simulate (11197 ms) 2024-09-14T10:51:38.406 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 1 test from cls_rgw_stats (11197 ms total) 2024-09-14T10:51:38.406 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-14T10:51:38.406 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-14T10:51:39.236 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 1 test from 1 test suite ran. (13920 ms total) 2024-09-14T10:51:39.236 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 1 test. 2024-09-14T10:51:39.240 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T10:51:39.240 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T10:51:39.323 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-09-14T10:51:39.324 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-09-14T10:51:39.324 DEBUG:teuthology.orchestra.run.smithi097:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-09-14T10:51:39.409 INFO:tasks.workunit.client.0.smithi097.stdout:Running main() from gmock_main.cc 2024-09-14T10:51:39.409 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 31 tests from 1 test suite. 2024-09-14T10:51:39.409 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-14T10:51:41.248 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 31 tests from CmpOmap 2024-09-14T10:51:41.248 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-09-14T10:51:41.263 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (16 ms) 2024-09-14T10:51:41.263 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-09-14T10:51:41.271 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (8 ms) 2024-09-14T10:51:41.271 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-09-14T10:51:41.274 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (3 ms) 2024-09-14T10:51:41.274 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-09-14T10:51:41.278 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (4 ms) 2024-09-14T10:51:41.278 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-09-14T10:51:41.285 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_vals_str (6 ms) 2024-09-14T10:51:41.285 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-09-14T10:51:41.293 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_vals_u64 (8 ms) 2024-09-14T10:51:41.293 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-09-14T10:51:41.295 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (3 ms) 2024-09-14T10:51:41.295 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-09-14T10:51:41.298 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (3 ms) 2024-09-14T10:51:41.298 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-09-14T10:51:41.301 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (3 ms) 2024-09-14T10:51:41.301 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-09-14T10:51:41.305 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (3 ms) 2024-09-14T10:51:41.305 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-09-14T10:51:41.305 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (1 ms) 2024-09-14T10:51:41.305 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-09-14T10:51:41.306 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (1 ms) 2024-09-14T10:51:41.306 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-09-14T10:51:41.313 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (6 ms) 2024-09-14T10:51:41.313 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-09-14T10:51:41.320 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (7 ms) 2024-09-14T10:51:41.320 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-09-14T10:51:41.326 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (7 ms) 2024-09-14T10:51:41.327 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-09-14T10:51:41.334 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (8 ms) 2024-09-14T10:51:41.334 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-09-14T10:51:41.345 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_set_vals_str (10 ms) 2024-09-14T10:51:41.345 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-09-14T10:51:41.352 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (8 ms) 2024-09-14T10:51:41.352 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-09-14T10:51:41.354 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (2 ms) 2024-09-14T10:51:41.354 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-09-14T10:51:41.357 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (3 ms) 2024-09-14T10:51:41.357 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-09-14T10:51:41.358 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (1 ms) 2024-09-14T10:51:41.358 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-09-14T10:51:41.359 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (1 ms) 2024-09-14T10:51:41.359 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-09-14T10:51:41.365 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (6 ms) 2024-09-14T10:51:41.366 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-09-14T10:51:41.372 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (7 ms) 2024-09-14T10:51:41.372 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-09-14T10:51:41.381 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (9 ms) 2024-09-14T10:51:41.381 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-09-14T10:51:41.388 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (7 ms) 2024-09-14T10:51:41.388 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-09-14T10:51:41.390 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (2 ms) 2024-09-14T10:51:41.390 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-09-14T10:51:41.393 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (3 ms) 2024-09-14T10:51:41.393 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-09-14T10:51:41.394 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (1 ms) 2024-09-14T10:51:41.394 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-09-14T10:51:41.395 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (0 ms) 2024-09-14T10:51:41.395 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-09-14T10:51:41.404 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (10 ms) 2024-09-14T10:51:41.404 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 31 tests from CmpOmap (157 ms total) 2024-09-14T10:51:41.404 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-14T10:51:41.404 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-14T10:51:42.257 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 31 tests from 1 test suite ran. (2847 ms total) 2024-09-14T10:51:42.257 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 31 tests. 2024-09-14T10:51:42.259 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T10:51:42.259 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T10:51:42.301 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-09-14T10:51:42.302 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-09-14T10:51:42.302 DEBUG:teuthology.orchestra.run.smithi097:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-09-14T10:51:42.386 INFO:tasks.workunit.client.0.smithi097.stdout:Running main() from gmock_main.cc 2024-09-14T10:51:42.386 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T10:51:42.387 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-14T10:51:42.387 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 24 tests from TestCls2PCQueue 2024-09-14T10:51:42.387 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-09-14T10:51:45.278 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2888 ms) 2024-09-14T10:51:45.278 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-09-14T10:51:48.294 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3019 ms) 2024-09-14T10:51:48.294 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-09-14T10:51:51.331 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestCls2PCQueue.Reserve (3037 ms) 2024-09-14T10:51:51.331 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-09-14T10:51:54.335 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3004 ms) 2024-09-14T10:51:54.335 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-09-14T10:51:57.370 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestCls2PCQueue.Commit (3035 ms) 2024-09-14T10:51:57.370 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-09-14T10:52:00.388 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestCls2PCQueue.Stats (3018 ms) 2024-09-14T10:52:00.388 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-09-14T10:52:04.420 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (4032 ms) 2024-09-14T10:52:04.420 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-09-14T10:52:07.459 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestCls2PCQueue.Abort (3039 ms) 2024-09-14T10:52:07.459 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-09-14T10:52:10.461 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestCls2PCQueue.ReserveError (3002 ms) 2024-09-14T10:52:10.461 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-09-14T10:52:13.489 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestCls2PCQueue.CommitError (3029 ms) 2024-09-14T10:52:13.490 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-09-14T10:52:16.516 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestCls2PCQueue.AbortError (3026 ms) 2024-09-14T10:52:16.516 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-09-14T10:52:19.529 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3012 ms) 2024-09-14T10:52:19.529 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-09-14T10:52:22.561 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3033 ms) 2024-09-14T10:52:22.561 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-09-14T10:52:25.577 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3016 ms) 2024-09-14T10:52:25.577 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-09-14T10:52:28.594 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3016 ms) 2024-09-14T10:52:28.595 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-09-14T10:52:31.618 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3023 ms) 2024-09-14T10:52:31.618 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-09-14T10:52:34.633 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3015 ms) 2024-09-14T10:52:34.633 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-09-14T10:52:37.654 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestCls2PCQueue.Cleanup (3021 ms) 2024-09-14T10:52:37.654 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-09-14T10:52:48.691 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestCls2PCQueue.MultiProducer (11037 ms) 2024-09-14T10:52:48.691 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-09-14T10:52:51.710 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (3018 ms) 2024-09-14T10:52:51.711 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-09-14T10:53:05.761 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (14050 ms) 2024-09-14T10:53:05.761 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-09-14T10:53:09.828 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (4068 ms) 2024-09-14T10:53:09.828 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-09-14T10:53:14.859 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (5032 ms) 2024-09-14T10:53:14.860 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-09-14T10:53:19.884 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (5024 ms) 2024-09-14T10:53:19.884 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 24 tests from TestCls2PCQueue (97497 ms total) 2024-09-14T10:53:19.884 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-14T10:53:19.885 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-14T10:53:19.885 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 24 tests from 1 test suite ran. (97497 ms total) 2024-09-14T10:53:19.885 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 24 tests. 2024-09-14T10:53:19.887 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T10:53:19.887 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T10:53:19.926 INFO:tasks.workunit:Running workunits matching cls/test_cls_user.sh on client.0... 2024-09-14T10:53:19.928 INFO:tasks.workunit:Running workunit cls/test_cls_user.sh... 2024-09-14T10:53:19.928 DEBUG:teuthology.orchestra.run.smithi097:workunit test cls/test_cls_user.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_user.sh 2024-09-14T10:53:20.018 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:53:20.018 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:53:20.018 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-14T10:53:20.019 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-14T10:53:21.896 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 4 tests from ClsAccount 2024-09-14T10:53:21.896 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] ClsAccount.add 2024-09-14T10:53:21.917 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] ClsAccount.add (21 ms) 2024-09-14T10:53:21.917 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] ClsAccount.get 2024-09-14T10:53:21.924 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] ClsAccount.get (7 ms) 2024-09-14T10:53:21.924 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] ClsAccount.rm 2024-09-14T10:53:21.932 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] ClsAccount.rm (8 ms) 2024-09-14T10:53:21.932 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] ClsAccount.list 2024-09-14T10:53:21.946 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] ClsAccount.list (15 ms) 2024-09-14T10:53:21.946 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 4 tests from ClsAccount (51 ms total) 2024-09-14T10:53:21.947 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-14T10:53:21.947 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-14T10:53:22.900 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 4 tests from 1 test suite ran. (2882 ms total) 2024-09-14T10:53:22.901 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 4 tests. 2024-09-14T10:53:22.904 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T10:53:22.904 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T10:53:22.945 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-09-14T10:53:22.947 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-09-14T10:53:22.947 DEBUG:teuthology.orchestra.run.smithi097:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-09-14T10:53:23.038 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:53:23.039 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:53:23.039 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-14T10:53:23.039 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-14T10:53:24.918 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 6 tests from rgw_gc_log 2024-09-14T10:53:24.918 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-09-14T10:53:24.932 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] rgw_gc_log.init_existing_queue (14 ms) 2024-09-14T10:53:24.932 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-09-14T10:53:24.936 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] rgw_gc_log.init_existing_omap (3 ms) 2024-09-14T10:53:24.936 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-09-14T10:53:24.990 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (54 ms) 2024-09-14T10:53:24.990 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-09-14T10:53:24.991 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (2 ms) 2024-09-14T10:53:24.991 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-09-14T10:53:24.994 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] rgw_gc_log.defer1_after_init (3 ms) 2024-09-14T10:53:24.994 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-09-14T10:53:24.996 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] rgw_gc_log.defer2_before_init (1 ms) 2024-09-14T10:53:24.996 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 6 tests from rgw_gc_log (77 ms total) 2024-09-14T10:53:24.996 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-14T10:53:24.996 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-14T10:53:25.927 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 6 tests from 1 test suite ran. (2888 ms total) 2024-09-14T10:53:25.927 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 6 tests. 2024-09-14T10:53:25.931 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T10:53:25.931 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T10:53:25.974 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-09-14T10:53:25.975 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-09-14T10:53:25.975 DEBUG:teuthology.orchestra.run.smithi097:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-09-14T10:53:26.072 INFO:tasks.workunit.client.0.smithi097.stdout:Running main() from gmock_main.cc 2024-09-14T10:53:26.072 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-14T10:53:26.072 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-14T10:53:26.072 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 4 tests from TestRGWObj 2024-09-14T10:53:26.072 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestRGWObj.underscore 2024-09-14T10:53:26.072 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: _obj 2024-09-14T10:53:26.072 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: _obj 2024-09-14T10:53:26.072 INFO:tasks.workunit.client.0.smithi097.stdout:stripped: _obj ns= i= 2024-09-14T10:53:26.072 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: _obj 2024-09-14T10:53:26.073 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: _obj 2024-09-14T10:53:26.073 INFO:tasks.workunit.client.0.smithi097.stdout:stripped: _obj ns= i= 2024-09-14T10:53:26.073 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: _obj 2024-09-14T10:53:26.073 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: _obj 2024-09-14T10:53:26.073 INFO:tasks.workunit.client.0.smithi097.stdout:stripped: _obj ns= i= 2024-09-14T10:53:26.073 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.073 INFO:tasks.workunit.client.0.smithi097.stdout: "obj1": { 2024-09-14T10:53:26.073 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.073 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.073 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.073 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.073 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.073 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.074 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.074 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.074 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.074 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.074 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.074 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.074 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_obj", 2024-09-14T10:53:26.074 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.074 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.074 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.074 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.074 INFO:tasks.workunit.client.0.smithi097.stdout: "obj2": { 2024-09-14T10:53:26.074 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.074 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.074 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.075 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.075 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.075 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.075 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.075 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.075 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.075 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.075 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.075 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.075 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_obj", 2024-09-14T10:53:26.075 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.075 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.075 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.075 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.076 INFO:tasks.workunit.client.0.smithi097.stdout: "obj3": { 2024-09-14T10:53:26.076 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.076 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.076 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.076 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.076 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.076 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.076 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.076 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.076 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.076 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.076 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.076 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.076 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_obj", 2024-09-14T10:53:26.077 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.077 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.077 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.077 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.077 INFO:tasks.workunit.client.0.smithi097.stdout: "obj3-2": { 2024-09-14T10:53:26.077 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.077 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.077 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.077 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.077 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.077 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.077 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.077 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.077 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.078 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.078 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.078 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.078 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_obj", 2024-09-14T10:53:26.078 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.078 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.078 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.078 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.078 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.078 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: _obj 2024-09-14T10:53:26.078 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: _obj 2024-09-14T10:53:26.078 INFO:tasks.workunit.client.0.smithi097.stdout:stripped: _obj ns=ns i= 2024-09-14T10:53:26.078 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: _obj 2024-09-14T10:53:26.078 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: _obj 2024-09-14T10:53:26.079 INFO:tasks.workunit.client.0.smithi097.stdout:stripped: _obj ns=ns i= 2024-09-14T10:53:26.079 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: _obj 2024-09-14T10:53:26.079 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: _obj 2024-09-14T10:53:26.079 INFO:tasks.workunit.client.0.smithi097.stdout:stripped: _obj ns=ns i= 2024-09-14T10:53:26.079 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.079 INFO:tasks.workunit.client.0.smithi097.stdout: "obj1": { 2024-09-14T10:53:26.079 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.079 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.079 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.079 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.079 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.079 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.079 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.079 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.079 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.080 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.080 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.080 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.080 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_obj", 2024-09-14T10:53:26.080 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.080 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-14T10:53:26.080 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.080 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.080 INFO:tasks.workunit.client.0.smithi097.stdout: "obj2": { 2024-09-14T10:53:26.080 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.080 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.080 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.080 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.081 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.081 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.081 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.081 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.081 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.081 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.081 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.081 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.081 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_obj", 2024-09-14T10:53:26.081 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.081 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-14T10:53:26.081 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.082 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.082 INFO:tasks.workunit.client.0.smithi097.stdout: "obj3": { 2024-09-14T10:53:26.082 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.082 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.082 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.082 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.082 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.082 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.082 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.082 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.082 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.082 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.082 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.082 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.083 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_obj", 2024-09-14T10:53:26.083 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.083 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.083 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.083 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.083 INFO:tasks.workunit.client.0.smithi097.stdout: "obj3-2": { 2024-09-14T10:53:26.083 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.083 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.083 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.083 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.083 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.083 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.083 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.084 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.084 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.084 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.084 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.084 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.084 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_obj", 2024-09-14T10:53:26.084 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.084 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-14T10:53:26.084 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.084 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.084 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.084 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: _obj[v1] 2024-09-14T10:53:26.084 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: _obj[v1] 2024-09-14T10:53:26.084 INFO:tasks.workunit.client.0.smithi097.stdout:stripped: _obj ns= i=v1 2024-09-14T10:53:26.085 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: _obj[v1] 2024-09-14T10:53:26.085 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: _obj[v1] 2024-09-14T10:53:26.085 INFO:tasks.workunit.client.0.smithi097.stdout:stripped: _obj ns= i=v1 2024-09-14T10:53:26.085 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: _obj[v1] 2024-09-14T10:53:26.085 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: _obj[v1] 2024-09-14T10:53:26.085 INFO:tasks.workunit.client.0.smithi097.stdout:stripped: _obj ns= i=v1 2024-09-14T10:53:26.085 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.085 INFO:tasks.workunit.client.0.smithi097.stdout: "obj1": { 2024-09-14T10:53:26.085 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.085 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.085 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.085 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.085 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.085 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.086 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.086 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.086 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.086 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.086 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.086 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.086 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_obj", 2024-09-14T10:53:26.086 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "v1", 2024-09-14T10:53:26.086 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.086 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.086 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.086 INFO:tasks.workunit.client.0.smithi097.stdout: "obj2": { 2024-09-14T10:53:26.086 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.087 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.087 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.087 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.087 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.087 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.087 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.087 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.087 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.087 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.087 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.087 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.087 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_obj", 2024-09-14T10:53:26.087 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "v1", 2024-09-14T10:53:26.087 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.088 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.088 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.088 INFO:tasks.workunit.client.0.smithi097.stdout: "obj3": { 2024-09-14T10:53:26.088 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.088 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.088 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.088 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.088 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.088 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.088 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.088 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.088 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.088 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.089 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.089 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.089 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_obj", 2024-09-14T10:53:26.089 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.089 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.089 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.089 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.089 INFO:tasks.workunit.client.0.smithi097.stdout: "obj3-2": { 2024-09-14T10:53:26.089 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.089 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.089 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.089 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.089 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.089 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.090 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.090 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.090 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.090 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.090 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.090 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.090 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_obj", 2024-09-14T10:53:26.090 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "v1", 2024-09-14T10:53:26.090 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.090 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.090 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.090 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.090 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: _obj[v1] 2024-09-14T10:53:26.091 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: _obj[v1] 2024-09-14T10:53:26.091 INFO:tasks.workunit.client.0.smithi097.stdout:stripped: _obj ns=ns i=v1 2024-09-14T10:53:26.091 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: _obj[v1] 2024-09-14T10:53:26.091 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: _obj[v1] 2024-09-14T10:53:26.091 INFO:tasks.workunit.client.0.smithi097.stdout:stripped: _obj ns=ns i=v1 2024-09-14T10:53:26.091 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: _obj[v1] 2024-09-14T10:53:26.091 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: _obj[v1] 2024-09-14T10:53:26.091 INFO:tasks.workunit.client.0.smithi097.stdout:stripped: _obj ns=ns i=v1 2024-09-14T10:53:26.091 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.091 INFO:tasks.workunit.client.0.smithi097.stdout: "obj1": { 2024-09-14T10:53:26.091 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.091 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.091 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.091 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.092 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.092 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.092 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.092 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.092 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.092 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.092 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.092 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.092 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_obj", 2024-09-14T10:53:26.092 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "v1", 2024-09-14T10:53:26.092 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-14T10:53:26.092 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.092 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.092 INFO:tasks.workunit.client.0.smithi097.stdout: "obj2": { 2024-09-14T10:53:26.093 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.093 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.093 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.093 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.093 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.093 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.093 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.093 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.093 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.093 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.093 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.093 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.093 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_obj", 2024-09-14T10:53:26.093 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "v1", 2024-09-14T10:53:26.094 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-14T10:53:26.094 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.094 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.094 INFO:tasks.workunit.client.0.smithi097.stdout: "obj3": { 2024-09-14T10:53:26.094 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.094 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.094 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.094 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.094 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.094 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.094 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.094 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.094 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.094 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.095 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.095 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.095 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_obj", 2024-09-14T10:53:26.095 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.095 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.095 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.095 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.095 INFO:tasks.workunit.client.0.smithi097.stdout: "obj3-2": { 2024-09-14T10:53:26.095 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.095 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.095 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.095 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.095 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.095 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.096 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.096 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.096 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.096 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.096 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.096 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.096 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_obj", 2024-09-14T10:53:26.096 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "v1", 2024-09-14T10:53:26.096 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-14T10:53:26.096 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.096 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.096 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.097 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2024-09-14T10:53:26.097 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestRGWObj.no_underscore 2024-09-14T10:53:26.097 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: obj 2024-09-14T10:53:26.097 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: obj 2024-09-14T10:53:26.097 INFO:tasks.workunit.client.0.smithi097.stdout:stripped: obj ns= i= 2024-09-14T10:53:26.097 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: obj 2024-09-14T10:53:26.097 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: obj 2024-09-14T10:53:26.097 INFO:tasks.workunit.client.0.smithi097.stdout:stripped: obj ns= i= 2024-09-14T10:53:26.097 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: obj 2024-09-14T10:53:26.097 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: obj 2024-09-14T10:53:26.097 INFO:tasks.workunit.client.0.smithi097.stdout:stripped: obj ns= i= 2024-09-14T10:53:26.097 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.097 INFO:tasks.workunit.client.0.smithi097.stdout: "obj1": { 2024-09-14T10:53:26.097 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.098 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.098 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.098 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.098 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.098 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.098 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.098 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.098 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.098 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.098 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.098 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.098 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "obj", 2024-09-14T10:53:26.098 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.098 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.099 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.099 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.099 INFO:tasks.workunit.client.0.smithi097.stdout: "obj2": { 2024-09-14T10:53:26.099 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.099 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.099 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.099 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.099 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.099 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.099 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.099 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.099 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.099 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.100 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.100 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.100 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "obj", 2024-09-14T10:53:26.100 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.100 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.100 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.100 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.100 INFO:tasks.workunit.client.0.smithi097.stdout: "obj3": { 2024-09-14T10:53:26.100 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.100 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.100 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.100 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.100 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.100 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.101 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.101 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.101 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.101 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.101 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.101 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.101 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "obj", 2024-09-14T10:53:26.101 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.101 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.101 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.101 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.101 INFO:tasks.workunit.client.0.smithi097.stdout: "obj3-2": { 2024-09-14T10:53:26.101 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.101 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.101 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.102 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.102 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.102 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.102 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.102 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.102 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.102 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.102 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.102 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.102 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "obj", 2024-09-14T10:53:26.102 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.102 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.102 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.103 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.103 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.103 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: obj 2024-09-14T10:53:26.103 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: obj 2024-09-14T10:53:26.103 INFO:tasks.workunit.client.0.smithi097.stdout:stripped: obj ns=ns i= 2024-09-14T10:53:26.103 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: obj 2024-09-14T10:53:26.103 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: obj 2024-09-14T10:53:26.103 INFO:tasks.workunit.client.0.smithi097.stdout:stripped: obj ns=ns i= 2024-09-14T10:53:26.103 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: obj 2024-09-14T10:53:26.103 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: obj 2024-09-14T10:53:26.103 INFO:tasks.workunit.client.0.smithi097.stdout:stripped: obj ns=ns i= 2024-09-14T10:53:26.103 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.103 INFO:tasks.workunit.client.0.smithi097.stdout: "obj1": { 2024-09-14T10:53:26.103 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.104 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.104 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.104 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.104 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.104 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.104 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.104 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.104 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.104 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.104 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.104 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.104 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "obj", 2024-09-14T10:53:26.104 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.104 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-14T10:53:26.105 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.105 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.105 INFO:tasks.workunit.client.0.smithi097.stdout: "obj2": { 2024-09-14T10:53:26.105 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.105 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.105 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.105 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.105 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.105 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.105 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.105 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.105 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.105 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.105 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.106 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.106 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "obj", 2024-09-14T10:53:26.106 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.106 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-14T10:53:26.106 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.106 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.106 INFO:tasks.workunit.client.0.smithi097.stdout: "obj3": { 2024-09-14T10:53:26.106 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.106 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.106 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.106 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.106 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.106 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.106 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.106 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.107 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.107 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.107 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.107 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.107 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "obj", 2024-09-14T10:53:26.107 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.107 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.107 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.107 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.107 INFO:tasks.workunit.client.0.smithi097.stdout: "obj3-2": { 2024-09-14T10:53:26.107 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.107 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.107 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.108 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.108 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.108 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.108 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.108 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.108 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.108 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.108 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.108 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.108 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "obj", 2024-09-14T10:53:26.108 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.108 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-14T10:53:26.108 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.108 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.109 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.109 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: obj[v1] 2024-09-14T10:53:26.109 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: obj[v1] 2024-09-14T10:53:26.109 INFO:tasks.workunit.client.0.smithi097.stdout:stripped: obj ns= i=v1 2024-09-14T10:53:26.109 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: obj[v1] 2024-09-14T10:53:26.109 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: obj[v1] 2024-09-14T10:53:26.109 INFO:tasks.workunit.client.0.smithi097.stdout:stripped: obj ns= i=v1 2024-09-14T10:53:26.109 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: obj[v1] 2024-09-14T10:53:26.109 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: obj[v1] 2024-09-14T10:53:26.109 INFO:tasks.workunit.client.0.smithi097.stdout:stripped: obj ns= i=v1 2024-09-14T10:53:26.109 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.109 INFO:tasks.workunit.client.0.smithi097.stdout: "obj1": { 2024-09-14T10:53:26.109 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.110 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.110 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.110 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.110 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.110 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.110 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.110 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.110 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.110 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.110 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.110 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.110 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "obj", 2024-09-14T10:53:26.110 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "v1", 2024-09-14T10:53:26.110 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.111 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.111 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.111 INFO:tasks.workunit.client.0.smithi097.stdout: "obj2": { 2024-09-14T10:53:26.111 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.111 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.111 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.111 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.111 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.111 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.111 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.111 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.111 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.111 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.111 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.112 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.112 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "obj", 2024-09-14T10:53:26.112 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "v1", 2024-09-14T10:53:26.112 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.112 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.112 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.112 INFO:tasks.workunit.client.0.smithi097.stdout: "obj3": { 2024-09-14T10:53:26.112 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.112 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.112 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.112 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.112 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.112 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.112 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.113 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.113 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.113 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.113 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.113 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.113 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "obj", 2024-09-14T10:53:26.113 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.113 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.113 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.113 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.113 INFO:tasks.workunit.client.0.smithi097.stdout: "obj3-2": { 2024-09-14T10:53:26.113 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.113 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.113 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.114 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.114 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.114 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.114 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.114 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.114 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.114 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.114 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.114 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.114 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "obj", 2024-09-14T10:53:26.114 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "v1", 2024-09-14T10:53:26.114 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.114 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.114 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.115 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.115 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: obj[v1] 2024-09-14T10:53:26.115 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: obj[v1] 2024-09-14T10:53:26.115 INFO:tasks.workunit.client.0.smithi097.stdout:stripped: obj ns=ns i=v1 2024-09-14T10:53:26.115 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: obj[v1] 2024-09-14T10:53:26.115 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: obj[v1] 2024-09-14T10:53:26.115 INFO:tasks.workunit.client.0.smithi097.stdout:stripped: obj ns=ns i=v1 2024-09-14T10:53:26.115 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: obj[v1] 2024-09-14T10:53:26.115 INFO:tasks.workunit.client.0.smithi097.stdout:parsed: obj[v1] 2024-09-14T10:53:26.115 INFO:tasks.workunit.client.0.smithi097.stdout:stripped: obj ns=ns i=v1 2024-09-14T10:53:26.115 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.115 INFO:tasks.workunit.client.0.smithi097.stdout: "obj1": { 2024-09-14T10:53:26.115 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.115 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.116 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.116 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.116 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.116 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.116 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.116 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.116 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.116 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.116 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.116 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.116 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "obj", 2024-09-14T10:53:26.116 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "v1", 2024-09-14T10:53:26.116 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-14T10:53:26.116 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.117 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.117 INFO:tasks.workunit.client.0.smithi097.stdout: "obj2": { 2024-09-14T10:53:26.117 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.117 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.117 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.117 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.117 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.117 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.117 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.117 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.117 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.117 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.117 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.117 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.118 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "obj", 2024-09-14T10:53:26.118 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "v1", 2024-09-14T10:53:26.118 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-14T10:53:26.118 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.118 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.118 INFO:tasks.workunit.client.0.smithi097.stdout: "obj3": { 2024-09-14T10:53:26.118 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.118 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.118 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.118 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.118 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.118 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.118 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.118 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.119 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.119 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.119 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.119 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.119 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "obj", 2024-09-14T10:53:26.119 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.119 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.119 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.119 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.119 INFO:tasks.workunit.client.0.smithi097.stdout: "obj3-2": { 2024-09-14T10:53:26.119 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.119 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.119 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.119 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.119 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.119 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.120 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.120 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.120 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.120 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.120 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.120 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.120 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "obj", 2024-09-14T10:53:26.120 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "v1", 2024-09-14T10:53:26.120 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-14T10:53:26.120 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.120 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.120 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.120 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestRGWObj.no_underscore (1 ms) 2024-09-14T10:53:26.120 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-09-14T10:53:26.121 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.121 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.121 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.121 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.121 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.121 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.121 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.121 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.121 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.121 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.121 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.121 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.121 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.121 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.121 INFO:tasks.workunit.client.0.smithi097.stdout: "obj": { 2024-09-14T10:53:26.122 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.122 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.122 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.122 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.122 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.122 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.122 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.122 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.122 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.122 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.122 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.122 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.122 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "myobj", 2024-09-14T10:53:26.122 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.123 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.123 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.123 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.123 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.123 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.123 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-14T10:53:26.123 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": "default-placement.data", 2024-09-14T10:53:26.123 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker_myobj", 2024-09-14T10:53:26.123 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-14T10:53:26.123 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.123 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.123 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.123 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-14T10:53:26.123 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.123 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.124 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.124 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.124 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.124 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.124 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.124 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.124 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.124 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.124 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.124 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.124 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "myobj", 2024-09-14T10:53:26.124 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.124 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.124 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.125 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.125 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.125 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.125 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.125 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.125 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.125 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.125 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.125 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.125 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.125 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.125 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.125 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.125 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.126 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.126 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.126 INFO:tasks.workunit.client.0.smithi097.stdout: "obj": { 2024-09-14T10:53:26.126 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.126 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.126 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.126 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.126 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.126 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.126 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.126 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.126 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.126 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.126 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.127 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.127 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "myobj", 2024-09-14T10:53:26.127 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.127 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.127 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.127 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.127 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.127 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.127 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-14T10:53:26.127 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-14T10:53:26.127 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker_myobj", 2024-09-14T10:53:26.127 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-14T10:53:26.127 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.127 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.127 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.128 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-14T10:53:26.128 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.128 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.128 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.128 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.128 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.128 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.128 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.128 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.128 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.128 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.128 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.128 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.128 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "myobj", 2024-09-14T10:53:26.129 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.129 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.129 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.129 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.129 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.129 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.129 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.129 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.129 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.129 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.129 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.129 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.129 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.129 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.130 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.130 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.130 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.130 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.130 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.130 INFO:tasks.workunit.client.0.smithi097.stdout: "obj": { 2024-09-14T10:53:26.130 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.130 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.130 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.130 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.130 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.130 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.130 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.130 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.130 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.131 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.131 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.131 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.131 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "myobj", 2024-09-14T10:53:26.131 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.131 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-14T10:53:26.131 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.131 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.131 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.131 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.131 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-14T10:53:26.131 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": "default-placement.data", 2024-09-14T10:53:26.131 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__ns_myobj", 2024-09-14T10:53:26.131 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-14T10:53:26.132 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.132 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.132 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.132 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-14T10:53:26.132 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.132 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.132 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.132 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.132 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.132 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.132 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.132 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.132 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.132 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.133 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.133 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.133 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "myobj", 2024-09-14T10:53:26.133 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.133 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-14T10:53:26.133 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.133 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.133 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.133 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.133 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.133 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.133 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.133 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.133 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.134 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.134 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.134 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.134 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.134 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.134 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.134 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.134 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.134 INFO:tasks.workunit.client.0.smithi097.stdout: "obj": { 2024-09-14T10:53:26.134 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.134 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.134 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.134 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.134 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.135 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.135 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.135 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.135 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.135 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.135 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.135 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.135 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "myobj", 2024-09-14T10:53:26.135 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.135 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-14T10:53:26.135 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.135 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.135 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.135 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.136 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-14T10:53:26.136 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-14T10:53:26.136 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__ns_myobj", 2024-09-14T10:53:26.136 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-14T10:53:26.136 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.136 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.136 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.136 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-14T10:53:26.136 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.136 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.136 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.136 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.136 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.136 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.137 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.137 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.137 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.137 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.137 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.137 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.137 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "myobj", 2024-09-14T10:53:26.137 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.137 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-14T10:53:26.137 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.137 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.137 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.137 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.137 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.137 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.138 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.138 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.138 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.138 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.138 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.138 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.138 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.138 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.138 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.138 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.138 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.138 INFO:tasks.workunit.client.0.smithi097.stdout: "obj": { 2024-09-14T10:53:26.138 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.138 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.139 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.139 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.139 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.139 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.139 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.139 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.139 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.139 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.139 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.139 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.139 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "myobj", 2024-09-14T10:53:26.139 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-14T10:53:26.139 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.139 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.140 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.140 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.140 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.140 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-14T10:53:26.140 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": "default-placement.data", 2024-09-14T10:53:26.140 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__:inst_myobj", 2024-09-14T10:53:26.140 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-14T10:53:26.140 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.140 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.140 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.140 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-14T10:53:26.140 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.140 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.140 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.141 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.141 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.141 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.141 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.141 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.141 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.141 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.141 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.141 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.141 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "myobj", 2024-09-14T10:53:26.141 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-14T10:53:26.141 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.141 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.141 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.142 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.142 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.142 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.142 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.142 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.142 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.142 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.142 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.142 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.142 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.142 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.142 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.142 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.142 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.142 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.143 INFO:tasks.workunit.client.0.smithi097.stdout: "obj": { 2024-09-14T10:53:26.143 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.143 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.143 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.143 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.143 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.143 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.143 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.143 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.143 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.143 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.143 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.143 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.143 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "myobj", 2024-09-14T10:53:26.143 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-14T10:53:26.144 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.144 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.144 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.144 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.144 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.144 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-14T10:53:26.144 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-14T10:53:26.144 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__:inst_myobj", 2024-09-14T10:53:26.144 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-14T10:53:26.144 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.144 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.144 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.144 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-14T10:53:26.144 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.145 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.145 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.145 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.145 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.145 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.145 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.145 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.145 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.145 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.145 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.145 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.145 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "myobj", 2024-09-14T10:53:26.145 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-14T10:53:26.145 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.146 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.146 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.146 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.146 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.146 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.146 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.146 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.146 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.146 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.146 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.146 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.146 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.146 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.146 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.146 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.147 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.147 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.147 INFO:tasks.workunit.client.0.smithi097.stdout: "obj": { 2024-09-14T10:53:26.147 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.147 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.147 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.147 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.147 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.147 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.147 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.147 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.147 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.147 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.147 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.148 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.148 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "myobj", 2024-09-14T10:53:26.148 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-14T10:53:26.148 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-14T10:53:26.148 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.148 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.148 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.148 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.148 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-14T10:53:26.148 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": "default-placement.data", 2024-09-14T10:53:26.148 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T10:53:26.148 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-14T10:53:26.148 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.148 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.149 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.149 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-14T10:53:26.149 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.149 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.149 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.149 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.149 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.149 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.149 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.149 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.149 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.149 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.149 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.149 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.150 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "myobj", 2024-09-14T10:53:26.150 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-14T10:53:26.150 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-14T10:53:26.150 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.150 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.150 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.150 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.150 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.150 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.150 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.150 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.150 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.150 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.150 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.151 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.151 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.151 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.151 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.151 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.151 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.151 INFO:tasks.workunit.client.0.smithi097.stdout: "obj": { 2024-09-14T10:53:26.151 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.151 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.151 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.151 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.151 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.151 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.151 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.152 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.152 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.152 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.152 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.152 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.152 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "myobj", 2024-09-14T10:53:26.152 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-14T10:53:26.152 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-14T10:53:26.152 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.152 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.152 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.152 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.152 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-14T10:53:26.152 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-14T10:53:26.153 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T10:53:26.153 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-14T10:53:26.153 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.153 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.153 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.153 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-14T10:53:26.153 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.153 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.153 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.153 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.153 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.153 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.153 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.153 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.154 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.154 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.154 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.154 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.154 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "myobj", 2024-09-14T10:53:26.154 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-14T10:53:26.154 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-14T10:53:26.154 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.154 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.154 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.154 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.154 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.154 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.154 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.154 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.155 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.155 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.155 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.155 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.155 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.155 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.155 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.155 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.155 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.155 INFO:tasks.workunit.client.0.smithi097.stdout: "obj": { 2024-09-14T10:53:26.155 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.155 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.155 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.155 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.156 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.156 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.156 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.156 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.156 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.156 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.156 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.156 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.156 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj", 2024-09-14T10:53:26.156 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.156 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.156 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.156 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.157 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.157 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.157 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-14T10:53:26.157 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": "default-placement.data", 2024-09-14T10:53:26.157 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker___myobj", 2024-09-14T10:53:26.157 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "marker__myobj" 2024-09-14T10:53:26.157 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.157 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.157 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.157 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-14T10:53:26.157 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.157 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.157 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.157 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.158 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.158 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.158 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.158 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.158 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.158 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.158 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.158 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.158 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj", 2024-09-14T10:53:26.158 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.158 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.158 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.158 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.158 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.158 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.159 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.159 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.159 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.159 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.159 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.159 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.159 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.159 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.159 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.159 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.159 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.159 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.159 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.159 INFO:tasks.workunit.client.0.smithi097.stdout: "obj": { 2024-09-14T10:53:26.160 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.160 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.160 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.160 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.160 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.160 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.160 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.160 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.160 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.160 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.160 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.160 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.160 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj", 2024-09-14T10:53:26.160 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.161 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.161 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.161 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.161 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.161 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.161 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-14T10:53:26.161 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-14T10:53:26.161 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker___myobj", 2024-09-14T10:53:26.161 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "marker__myobj" 2024-09-14T10:53:26.161 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.161 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.161 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.161 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-14T10:53:26.161 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.162 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.162 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.162 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.162 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.162 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.162 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.162 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.162 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.162 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.162 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.162 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.162 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj", 2024-09-14T10:53:26.162 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.162 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.163 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.163 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.163 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.163 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.163 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.163 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.163 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.163 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.163 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.163 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.163 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.163 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.163 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.163 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.163 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.164 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.164 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.164 INFO:tasks.workunit.client.0.smithi097.stdout: "obj": { 2024-09-14T10:53:26.164 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.164 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.164 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.164 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.164 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.164 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.164 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.164 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.164 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.164 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.165 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.165 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.165 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj", 2024-09-14T10:53:26.165 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.165 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-14T10:53:26.165 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.165 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.165 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.165 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.165 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-14T10:53:26.165 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": "default-placement.data", 2024-09-14T10:53:26.165 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__ns__myobj", 2024-09-14T10:53:26.165 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-14T10:53:26.165 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.165 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.166 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.166 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-14T10:53:26.166 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.166 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.166 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.166 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.166 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.166 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.166 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.166 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.166 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.166 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.166 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.166 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.167 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj", 2024-09-14T10:53:26.167 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.167 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-14T10:53:26.167 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.167 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.167 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.167 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.167 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.167 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.167 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.167 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.167 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.167 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.167 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.167 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.168 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.168 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.168 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.168 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.168 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.168 INFO:tasks.workunit.client.0.smithi097.stdout: "obj": { 2024-09-14T10:53:26.168 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.168 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.168 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.168 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.168 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.168 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.168 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.168 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.169 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.169 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.169 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.169 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.169 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj", 2024-09-14T10:53:26.169 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.169 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-14T10:53:26.169 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.169 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.169 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.169 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.169 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-14T10:53:26.169 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-14T10:53:26.169 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__ns__myobj", 2024-09-14T10:53:26.170 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-14T10:53:26.170 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.170 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.170 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.170 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-14T10:53:26.170 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.170 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.170 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.170 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.170 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.170 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.170 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.170 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.170 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.170 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.171 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.171 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.171 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj", 2024-09-14T10:53:26.171 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.171 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-14T10:53:26.171 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.171 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.171 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.171 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.171 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.171 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.171 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.171 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.171 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.172 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.172 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.172 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.172 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.172 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.172 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.172 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.172 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.172 INFO:tasks.workunit.client.0.smithi097.stdout: "obj": { 2024-09-14T10:53:26.172 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.172 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.172 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.172 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.172 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.172 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.173 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.173 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.173 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.173 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.173 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.173 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.173 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj", 2024-09-14T10:53:26.173 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-14T10:53:26.173 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.173 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.173 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.173 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.173 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.173 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-14T10:53:26.174 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": "default-placement.data", 2024-09-14T10:53:26.174 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__:inst__myobj", 2024-09-14T10:53:26.174 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "marker__myobj" 2024-09-14T10:53:26.174 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.174 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.174 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.174 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-14T10:53:26.174 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.174 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.174 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.174 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.174 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.174 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.174 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.174 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.175 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.175 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.175 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.175 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.175 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj", 2024-09-14T10:53:26.175 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-14T10:53:26.175 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.175 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.175 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.175 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.175 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.175 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.175 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.175 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.175 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.176 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.176 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.176 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.176 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.176 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.176 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.176 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.176 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.176 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.176 INFO:tasks.workunit.client.0.smithi097.stdout: "obj": { 2024-09-14T10:53:26.176 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.176 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.176 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.176 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.177 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.177 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.177 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.177 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.177 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.177 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.177 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.177 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.177 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj", 2024-09-14T10:53:26.177 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-14T10:53:26.177 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.177 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.177 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.177 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.178 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.178 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-14T10:53:26.178 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-14T10:53:26.178 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__:inst__myobj", 2024-09-14T10:53:26.178 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "marker__myobj" 2024-09-14T10:53:26.178 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.178 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.178 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.178 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-14T10:53:26.178 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.178 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.178 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.178 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.178 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.179 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.179 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.179 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.179 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.179 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.179 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.179 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.179 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj", 2024-09-14T10:53:26.179 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-14T10:53:26.179 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.179 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.179 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.179 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.179 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.180 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.180 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.180 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.180 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.180 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.180 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.180 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.180 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.180 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.180 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.180 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.180 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.180 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.180 INFO:tasks.workunit.client.0.smithi097.stdout: "obj": { 2024-09-14T10:53:26.181 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.181 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.181 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.181 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.181 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.181 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.181 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.181 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.181 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.181 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.181 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.181 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.181 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj", 2024-09-14T10:53:26.181 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-14T10:53:26.182 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-14T10:53:26.182 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.182 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.182 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.182 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.182 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-14T10:53:26.182 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": "default-placement.data", 2024-09-14T10:53:26.182 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T10:53:26.182 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-14T10:53:26.182 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.182 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.182 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.182 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-14T10:53:26.182 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.183 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.183 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.183 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.183 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.183 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.183 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.183 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.183 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.183 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.183 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.183 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.183 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj", 2024-09-14T10:53:26.183 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-14T10:53:26.183 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-14T10:53:26.184 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.184 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.184 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.184 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.184 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.184 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.184 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.184 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.184 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.184 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.184 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.184 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.184 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.184 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.185 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.185 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.185 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.185 INFO:tasks.workunit.client.0.smithi097.stdout: "obj": { 2024-09-14T10:53:26.185 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.185 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.185 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.185 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.185 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.185 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.185 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.185 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.185 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.185 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.186 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.186 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.186 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj", 2024-09-14T10:53:26.186 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-14T10:53:26.186 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-14T10:53:26.186 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.186 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.186 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.186 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.186 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-14T10:53:26.186 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-14T10:53:26.186 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T10:53:26.186 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-14T10:53:26.186 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.187 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.187 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.187 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-14T10:53:26.187 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.187 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.187 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.187 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.187 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.187 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.187 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.187 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.187 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.187 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.187 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.188 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.188 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj", 2024-09-14T10:53:26.188 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-14T10:53:26.188 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-14T10:53:26.188 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.188 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.188 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.188 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.188 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.188 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.188 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.188 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.188 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.188 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.189 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.189 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.189 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.189 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.189 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.189 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.189 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.189 INFO:tasks.workunit.client.0.smithi097.stdout: "obj": { 2024-09-14T10:53:26.189 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.189 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.189 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.189 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.189 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.189 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.190 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.190 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.190 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.190 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.190 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.190 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.190 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj_", 2024-09-14T10:53:26.190 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.190 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.190 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.190 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.190 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.190 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.190 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-14T10:53:26.191 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": "default-placement.data", 2024-09-14T10:53:26.191 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker___myobj_", 2024-09-14T10:53:26.191 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "marker__myobj_" 2024-09-14T10:53:26.191 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.191 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.191 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.191 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-14T10:53:26.191 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.191 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.191 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.191 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.191 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.191 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.191 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.192 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.192 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.192 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.192 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.192 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.192 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj_", 2024-09-14T10:53:26.192 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.192 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.192 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.192 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.192 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.192 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.192 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.192 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.193 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.193 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.193 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.193 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.193 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.193 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.193 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.193 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.193 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.193 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.193 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.193 INFO:tasks.workunit.client.0.smithi097.stdout: "obj": { 2024-09-14T10:53:26.193 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.193 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.194 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.194 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.194 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.194 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.194 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.194 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.194 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.194 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.194 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.194 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.194 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj_", 2024-09-14T10:53:26.194 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.194 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.194 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.194 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.195 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.195 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.195 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-14T10:53:26.195 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-14T10:53:26.195 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker___myobj_", 2024-09-14T10:53:26.195 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "marker__myobj_" 2024-09-14T10:53:26.195 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.195 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.195 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.195 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-14T10:53:26.195 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.195 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.195 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.195 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.196 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.196 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.196 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.196 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.196 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.196 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.196 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.196 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.196 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj_", 2024-09-14T10:53:26.196 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.196 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.196 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.196 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.196 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.197 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.197 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.197 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.197 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.197 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.197 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.197 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.197 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.197 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.197 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.197 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.197 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.197 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.197 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.197 INFO:tasks.workunit.client.0.smithi097.stdout: "obj": { 2024-09-14T10:53:26.198 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.198 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.198 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.198 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.198 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.198 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.198 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.198 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.198 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.198 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.198 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.198 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.198 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj_", 2024-09-14T10:53:26.198 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.199 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-14T10:53:26.199 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.199 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.199 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.199 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.199 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-14T10:53:26.199 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": "default-placement.data", 2024-09-14T10:53:26.199 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__ns__myobj_", 2024-09-14T10:53:26.199 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-14T10:53:26.199 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.199 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.199 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.199 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-14T10:53:26.199 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.199 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.200 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.200 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.200 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.200 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.200 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.200 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.200 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.200 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.200 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.200 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.200 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj_", 2024-09-14T10:53:26.200 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.200 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-14T10:53:26.201 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.201 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.201 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.201 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.201 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.201 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.201 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.201 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.201 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.201 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.201 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.201 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.201 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.201 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.202 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.202 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.202 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.202 INFO:tasks.workunit.client.0.smithi097.stdout: "obj": { 2024-09-14T10:53:26.202 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.202 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.202 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.202 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.202 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.202 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.202 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.202 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.202 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.202 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.202 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.203 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.203 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj_", 2024-09-14T10:53:26.203 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.203 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-14T10:53:26.203 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.203 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.203 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.203 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.203 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-14T10:53:26.203 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-14T10:53:26.203 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__ns__myobj_", 2024-09-14T10:53:26.203 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-14T10:53:26.203 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.204 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.204 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.204 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-14T10:53:26.204 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.204 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.204 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.204 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.204 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.204 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.204 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.204 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.204 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.204 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.204 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.204 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.205 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj_", 2024-09-14T10:53:26.205 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.205 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-14T10:53:26.205 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.205 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.205 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.205 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.205 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.205 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.205 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.205 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.205 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.205 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.205 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.206 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.206 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.206 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.206 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.206 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.206 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.206 INFO:tasks.workunit.client.0.smithi097.stdout: "obj": { 2024-09-14T10:53:26.206 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.206 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.206 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.206 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.206 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.206 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.206 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.207 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.207 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.207 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.207 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.207 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.207 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj_", 2024-09-14T10:53:26.207 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-14T10:53:26.207 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.207 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.207 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.207 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.207 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.207 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-14T10:53:26.207 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": "default-placement.data", 2024-09-14T10:53:26.208 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T10:53:26.208 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "marker__myobj_" 2024-09-14T10:53:26.208 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.208 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.208 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.208 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-14T10:53:26.208 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.208 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.208 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.208 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.208 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.208 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.208 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.209 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.209 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.209 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.209 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.209 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.209 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj_", 2024-09-14T10:53:26.209 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-14T10:53:26.209 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.209 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.209 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.209 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.209 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.209 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.209 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.210 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.210 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.210 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.210 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.210 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.210 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.210 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.210 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.210 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.210 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.210 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.210 INFO:tasks.workunit.client.0.smithi097.stdout: "obj": { 2024-09-14T10:53:26.210 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.210 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.210 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.211 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.211 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.211 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.211 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.211 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.211 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.211 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.211 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.211 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.211 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj_", 2024-09-14T10:53:26.211 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-14T10:53:26.211 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.211 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.211 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.212 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.212 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.212 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-14T10:53:26.212 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-14T10:53:26.212 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T10:53:26.212 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "marker__myobj_" 2024-09-14T10:53:26.212 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.212 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.212 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.212 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-14T10:53:26.212 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.212 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.212 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.212 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.213 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.213 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.213 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.213 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.213 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.213 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.213 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.213 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.213 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj_", 2024-09-14T10:53:26.213 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-14T10:53:26.213 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.213 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.213 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.213 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.213 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.214 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.214 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.214 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.214 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.214 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.214 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.214 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.214 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.214 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.214 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.214 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.214 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.214 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.214 INFO:tasks.workunit.client.0.smithi097.stdout: "obj": { 2024-09-14T10:53:26.215 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.215 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.215 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.215 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.215 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.215 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.215 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.215 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.215 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.215 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.215 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.215 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.215 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj_", 2024-09-14T10:53:26.215 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-14T10:53:26.216 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-14T10:53:26.216 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.216 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.216 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.216 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.216 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-14T10:53:26.216 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": "default-placement.data", 2024-09-14T10:53:26.216 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T10:53:26.216 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-14T10:53:26.216 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.216 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.216 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.216 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-14T10:53:26.216 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.217 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "test", 2024-09-14T10:53:26.217 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.217 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.217 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.217 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.217 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": "", 2024-09-14T10:53:26.217 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.217 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": "" 2024-09-14T10:53:26.217 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.217 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.217 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.217 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj_", 2024-09-14T10:53:26.217 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-14T10:53:26.217 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-14T10:53:26.218 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.218 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.218 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.218 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.218 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.218 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.218 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.218 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.218 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.218 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.218 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.218 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.218 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.218 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.218 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.219 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.219 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.219 INFO:tasks.workunit.client.0.smithi097.stdout: "obj": { 2024-09-14T10:53:26.219 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.219 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.219 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.219 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.219 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.219 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.219 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.219 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.219 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.219 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.219 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.220 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.220 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj_", 2024-09-14T10:53:26.220 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-14T10:53:26.220 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-14T10:53:26.220 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.220 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.220 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.220 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.220 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-14T10:53:26.220 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-14T10:53:26.220 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T10:53:26.220 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-14T10:53:26.220 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.220 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.221 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.221 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-14T10:53:26.221 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.221 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.221 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.221 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.221 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.221 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.221 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.221 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.221 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.221 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.221 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.221 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.222 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj_", 2024-09-14T10:53:26.222 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-14T10:53:26.222 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-14T10:53:26.222 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.222 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.222 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.222 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestRGWObj.obj_to_raw (0 ms) 2024-09-14T10:53:26.222 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-09-14T10:53:26.222 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.222 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-14T10:53:26.222 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-14T10:53:26.222 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker_myobj", 2024-09-14T10:53:26.222 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-14T10:53:26.222 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.223 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.223 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.223 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-14T10:53:26.223 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.223 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.223 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.223 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.223 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.223 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.223 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.223 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.223 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.223 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.223 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.224 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.224 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "myobj", 2024-09-14T10:53:26.224 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.224 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.224 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.224 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.224 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.224 INFO:tasks.workunit.client.0.smithi097.stdout:raw=.data-pool:marker_myobj 2024-09-14T10:53:26.224 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.224 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj2": { 2024-09-14T10:53:26.224 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-14T10:53:26.224 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker_myobj", 2024-09-14T10:53:26.224 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-14T10:53:26.225 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.225 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.225 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.225 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj2": { 2024-09-14T10:53:26.225 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.225 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.225 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.225 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.225 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.225 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.225 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.225 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.225 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.225 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.226 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.226 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.226 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "myobj", 2024-09-14T10:53:26.226 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.226 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.226 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.226 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.226 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.226 INFO:tasks.workunit.client.0.smithi097.stdout:raw2=.data-pool:marker_myobj 2024-09-14T10:53:26.226 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.226 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-14T10:53:26.226 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-14T10:53:26.226 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__ns_myobj", 2024-09-14T10:53:26.226 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-14T10:53:26.226 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.227 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.227 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.227 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-14T10:53:26.227 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.227 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.227 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.227 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.227 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.227 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.227 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.227 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.227 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.227 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.227 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.228 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.228 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "myobj", 2024-09-14T10:53:26.228 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.228 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-14T10:53:26.228 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.228 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.228 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.228 INFO:tasks.workunit.client.0.smithi097.stdout:raw=.data-pool:marker__ns_myobj 2024-09-14T10:53:26.228 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.228 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj2": { 2024-09-14T10:53:26.228 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-14T10:53:26.228 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__ns_myobj", 2024-09-14T10:53:26.228 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-14T10:53:26.228 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.229 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.229 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.229 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj2": { 2024-09-14T10:53:26.229 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.229 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.229 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.229 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.229 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.229 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.229 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.229 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.229 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.229 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.229 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.230 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.230 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "myobj", 2024-09-14T10:53:26.230 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.230 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-14T10:53:26.230 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.230 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.230 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.230 INFO:tasks.workunit.client.0.smithi097.stdout:raw2=.data-pool:marker__ns_myobj 2024-09-14T10:53:26.230 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.230 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-14T10:53:26.230 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-14T10:53:26.230 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__:inst_myobj", 2024-09-14T10:53:26.230 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-14T10:53:26.230 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.231 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.231 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.231 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-14T10:53:26.231 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.231 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.231 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.231 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.231 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.231 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.231 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.231 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.231 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.231 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.231 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.231 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.232 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "myobj", 2024-09-14T10:53:26.232 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-14T10:53:26.232 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.232 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.232 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.232 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.232 INFO:tasks.workunit.client.0.smithi097.stdout:raw=.data-pool:marker__:inst_myobj 2024-09-14T10:53:26.232 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.232 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj2": { 2024-09-14T10:53:26.232 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-14T10:53:26.232 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__:inst_myobj", 2024-09-14T10:53:26.232 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-14T10:53:26.232 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.232 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.233 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.233 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj2": { 2024-09-14T10:53:26.233 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.233 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.233 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.233 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.233 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.233 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.233 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.233 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.233 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.233 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.233 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.233 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.233 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "myobj", 2024-09-14T10:53:26.234 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-14T10:53:26.234 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.234 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.234 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.234 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.234 INFO:tasks.workunit.client.0.smithi097.stdout:raw2=.data-pool:marker__:inst_myobj 2024-09-14T10:53:26.234 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.234 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-14T10:53:26.234 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-14T10:53:26.234 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T10:53:26.234 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-14T10:53:26.234 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.234 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.234 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.235 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-14T10:53:26.235 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.235 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.235 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.235 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.235 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.235 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.235 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.235 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.235 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.235 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.235 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.235 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.235 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "myobj", 2024-09-14T10:53:26.235 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-14T10:53:26.236 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-14T10:53:26.236 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.236 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.236 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.236 INFO:tasks.workunit.client.0.smithi097.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-09-14T10:53:26.236 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.236 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj2": { 2024-09-14T10:53:26.236 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-14T10:53:26.236 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T10:53:26.236 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-14T10:53:26.236 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.236 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.236 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.236 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj2": { 2024-09-14T10:53:26.237 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.237 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.237 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.237 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.237 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.237 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.237 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.237 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.237 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.237 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.237 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.237 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.237 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "myobj", 2024-09-14T10:53:26.237 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-14T10:53:26.238 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-14T10:53:26.238 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.238 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.238 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.238 INFO:tasks.workunit.client.0.smithi097.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-09-14T10:53:26.238 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.238 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-14T10:53:26.238 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-14T10:53:26.238 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker___myobj", 2024-09-14T10:53:26.238 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "marker__myobj" 2024-09-14T10:53:26.238 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.238 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.238 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.238 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-14T10:53:26.238 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.239 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.239 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.239 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.239 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.239 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.239 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.239 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.239 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.239 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.239 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.239 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.239 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj", 2024-09-14T10:53:26.239 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.239 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.240 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.240 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.240 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.240 INFO:tasks.workunit.client.0.smithi097.stdout:raw=.data-pool:marker___myobj 2024-09-14T10:53:26.240 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.240 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj2": { 2024-09-14T10:53:26.240 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-14T10:53:26.240 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker___myobj", 2024-09-14T10:53:26.240 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "marker__myobj" 2024-09-14T10:53:26.240 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.240 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.240 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.240 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj2": { 2024-09-14T10:53:26.240 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.241 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.241 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.241 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.241 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.241 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.241 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.244 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.244 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.244 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.244 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.244 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.244 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj", 2024-09-14T10:53:26.245 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.245 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.245 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.245 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.245 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.245 INFO:tasks.workunit.client.0.smithi097.stdout:raw2=.data-pool:marker___myobj 2024-09-14T10:53:26.245 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.245 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-14T10:53:26.245 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-14T10:53:26.245 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__ns__myobj", 2024-09-14T10:53:26.245 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-14T10:53:26.245 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.245 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.245 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.246 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-14T10:53:26.246 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.246 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.246 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.246 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.246 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.246 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.246 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.246 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.246 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.246 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.246 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.246 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.246 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj", 2024-09-14T10:53:26.247 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.247 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-14T10:53:26.247 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.247 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.247 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.247 INFO:tasks.workunit.client.0.smithi097.stdout:raw=.data-pool:marker__ns__myobj 2024-09-14T10:53:26.247 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.247 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj2": { 2024-09-14T10:53:26.247 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-14T10:53:26.247 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__ns__myobj", 2024-09-14T10:53:26.247 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-14T10:53:26.247 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.247 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.248 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.248 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj2": { 2024-09-14T10:53:26.248 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.248 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.248 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.248 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.248 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.248 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.248 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.248 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.248 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.248 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.248 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.248 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.249 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj", 2024-09-14T10:53:26.249 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.249 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-14T10:53:26.249 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.249 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.249 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.249 INFO:tasks.workunit.client.0.smithi097.stdout:raw2=.data-pool:marker__ns__myobj 2024-09-14T10:53:26.249 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.249 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-14T10:53:26.249 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-14T10:53:26.249 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__:inst__myobj", 2024-09-14T10:53:26.249 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "marker__myobj" 2024-09-14T10:53:26.249 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.249 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.250 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.250 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-14T10:53:26.250 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.250 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.250 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.250 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.250 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.250 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.250 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.250 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.250 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.250 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.250 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.250 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.250 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj", 2024-09-14T10:53:26.251 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-14T10:53:26.251 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.251 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.251 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.251 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.251 INFO:tasks.workunit.client.0.smithi097.stdout:raw=.data-pool:marker__:inst__myobj 2024-09-14T10:53:26.251 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.251 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj2": { 2024-09-14T10:53:26.251 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-14T10:53:26.251 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__:inst__myobj", 2024-09-14T10:53:26.251 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "marker__myobj" 2024-09-14T10:53:26.251 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.251 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.252 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.252 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj2": { 2024-09-14T10:53:26.252 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.252 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.252 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.252 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.252 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.252 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.252 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.252 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.252 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.252 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.252 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.252 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.252 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj", 2024-09-14T10:53:26.253 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-14T10:53:26.253 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.253 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.253 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.253 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.253 INFO:tasks.workunit.client.0.smithi097.stdout:raw2=.data-pool:marker__:inst__myobj 2024-09-14T10:53:26.253 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.253 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-14T10:53:26.253 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-14T10:53:26.253 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T10:53:26.253 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-14T10:53:26.253 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.253 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.254 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.254 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-14T10:53:26.254 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.254 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.254 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.254 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.254 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.254 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.254 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.254 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.254 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.254 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.254 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.255 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.255 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj", 2024-09-14T10:53:26.255 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-14T10:53:26.255 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-14T10:53:26.255 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.255 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.255 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.255 INFO:tasks.workunit.client.0.smithi097.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-09-14T10:53:26.255 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.255 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj2": { 2024-09-14T10:53:26.255 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-14T10:53:26.255 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T10:53:26.255 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-14T10:53:26.255 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.256 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.256 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.256 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj2": { 2024-09-14T10:53:26.256 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.256 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.256 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.256 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.256 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.256 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.256 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.256 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.256 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.256 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.256 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.257 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.257 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj", 2024-09-14T10:53:26.257 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-14T10:53:26.257 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-14T10:53:26.257 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.257 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.257 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.257 INFO:tasks.workunit.client.0.smithi097.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-09-14T10:53:26.257 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.257 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-14T10:53:26.257 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-14T10:53:26.257 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker___myobj_", 2024-09-14T10:53:26.257 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "marker__myobj_" 2024-09-14T10:53:26.257 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.258 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.258 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.258 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-14T10:53:26.258 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.258 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.258 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.258 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.258 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.258 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.258 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.258 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.258 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.258 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.259 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.259 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.259 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj_", 2024-09-14T10:53:26.259 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.259 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.259 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.259 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.259 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.259 INFO:tasks.workunit.client.0.smithi097.stdout:raw=.data-pool:marker___myobj_ 2024-09-14T10:53:26.259 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.259 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj2": { 2024-09-14T10:53:26.259 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-14T10:53:26.259 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker___myobj_", 2024-09-14T10:53:26.259 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "marker__myobj_" 2024-09-14T10:53:26.260 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.260 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.260 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.260 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj2": { 2024-09-14T10:53:26.260 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.260 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.260 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.260 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.260 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.260 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.260 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.260 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.260 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.261 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.261 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.261 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.261 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj_", 2024-09-14T10:53:26.261 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.261 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.261 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.261 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.261 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.261 INFO:tasks.workunit.client.0.smithi097.stdout:raw2=.data-pool:marker___myobj_ 2024-09-14T10:53:26.261 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.261 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-14T10:53:26.261 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-14T10:53:26.261 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__ns__myobj_", 2024-09-14T10:53:26.262 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-14T10:53:26.262 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.262 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.262 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.262 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-14T10:53:26.262 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.262 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.262 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.262 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.262 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.262 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.262 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.262 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.263 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.263 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.263 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.263 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.263 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj_", 2024-09-14T10:53:26.263 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.263 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-14T10:53:26.263 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.263 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.263 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.263 INFO:tasks.workunit.client.0.smithi097.stdout:raw=.data-pool:marker__ns__myobj_ 2024-09-14T10:53:26.263 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.263 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj2": { 2024-09-14T10:53:26.263 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-14T10:53:26.264 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__ns__myobj_", 2024-09-14T10:53:26.264 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-14T10:53:26.264 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.264 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.264 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.264 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj2": { 2024-09-14T10:53:26.264 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.264 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.264 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.264 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.264 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.264 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.264 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.265 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.265 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.265 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.265 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.265 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.265 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj_", 2024-09-14T10:53:26.265 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "", 2024-09-14T10:53:26.265 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-14T10:53:26.265 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.265 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.265 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.265 INFO:tasks.workunit.client.0.smithi097.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-09-14T10:53:26.266 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.266 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-14T10:53:26.266 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-14T10:53:26.266 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T10:53:26.266 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "marker__myobj_" 2024-09-14T10:53:26.266 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.266 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.266 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.266 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-14T10:53:26.266 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.266 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.266 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.266 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.267 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.267 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.267 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.267 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.267 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.267 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.267 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.267 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.267 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj_", 2024-09-14T10:53:26.267 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-14T10:53:26.267 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.267 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.267 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.267 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.267 INFO:tasks.workunit.client.0.smithi097.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-09-14T10:53:26.268 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.268 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj2": { 2024-09-14T10:53:26.268 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-14T10:53:26.268 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T10:53:26.268 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "marker__myobj_" 2024-09-14T10:53:26.268 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.268 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.268 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.268 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj2": { 2024-09-14T10:53:26.268 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.268 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.268 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.268 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.268 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.269 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.269 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.269 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.269 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.269 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.269 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.269 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.269 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj_", 2024-09-14T10:53:26.269 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-14T10:53:26.269 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "" 2024-09-14T10:53:26.269 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.269 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.269 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.270 INFO:tasks.workunit.client.0.smithi097.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-09-14T10:53:26.270 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.270 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj": { 2024-09-14T10:53:26.270 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-14T10:53:26.270 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T10:53:26.270 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-14T10:53:26.270 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.270 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.270 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.270 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj": { 2024-09-14T10:53:26.270 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.270 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.270 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.270 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.270 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.271 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.271 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.271 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.271 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.271 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.271 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.271 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.271 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj_", 2024-09-14T10:53:26.271 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-14T10:53:26.271 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-14T10:53:26.271 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.271 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.271 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.271 INFO:tasks.workunit.client.0.smithi097.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-09-14T10:53:26.272 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.272 INFO:tasks.workunit.client.0.smithi097.stdout: "raw_obj2": { 2024-09-14T10:53:26.272 INFO:tasks.workunit.client.0.smithi097.stdout: "pool": ".data-pool", 2024-09-14T10:53:26.272 INFO:tasks.workunit.client.0.smithi097.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T10:53:26.272 INFO:tasks.workunit.client.0.smithi097.stdout: "loc": "" 2024-09-14T10:53:26.272 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.272 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.272 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.272 INFO:tasks.workunit.client.0.smithi097.stdout: "new_obj2": { 2024-09-14T10:53:26.272 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket": { 2024-09-14T10:53:26.272 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "ebtest", 2024-09-14T10:53:26.272 INFO:tasks.workunit.client.0.smithi097.stdout: "marker": "marker", 2024-09-14T10:53:26.272 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_id": "bucket-id", 2024-09-14T10:53:26.272 INFO:tasks.workunit.client.0.smithi097.stdout: "tenant": "", 2024-09-14T10:53:26.273 INFO:tasks.workunit.client.0.smithi097.stdout: "explicit_placement": { 2024-09-14T10:53:26.273 INFO:tasks.workunit.client.0.smithi097.stdout: "data_pool": ".data-pool", 2024-09-14T10:53:26.273 INFO:tasks.workunit.client.0.smithi097.stdout: "data_extra_pool": "", 2024-09-14T10:53:26.273 INFO:tasks.workunit.client.0.smithi097.stdout: "index_pool": ".index-pool" 2024-09-14T10:53:26.273 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.273 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.273 INFO:tasks.workunit.client.0.smithi097.stdout: "key": { 2024-09-14T10:53:26.273 INFO:tasks.workunit.client.0.smithi097.stdout: "name": "_myobj_", 2024-09-14T10:53:26.273 INFO:tasks.workunit.client.0.smithi097.stdout: "instance": "inst", 2024-09-14T10:53:26.273 INFO:tasks.workunit.client.0.smithi097.stdout: "ns": "ns" 2024-09-14T10:53:26.273 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.273 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.273 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.274 INFO:tasks.workunit.client.0.smithi097.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-09-14T10:53:26.274 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] TestRGWObj.old_to_raw (0 ms) 2024-09-14T10:53:26.274 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 4 tests from TestRGWObj (1 ms total) 2024-09-14T10:53:26.274 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-14T10:53:26.274 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-14T10:53:26.274 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 4 tests from 1 test suite ran. (1 ms total) 2024-09-14T10:53:26.274 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 4 tests. 2024-09-14T10:53:26.274 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T10:53:26.274 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T10:53:26.314 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-09-14T10:53:26.315 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-09-14T10:53:26.315 DEBUG:teuthology.orchestra.run.smithi097:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-09-14T10:53:26.457 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:53:26.457 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:53:26.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.507+0000 7fc255546800 20 rados->read ofs=0 len=0 2024-09-14T10:53:26.508 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.509+0000 7fc255546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:53:26.508 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.509+0000 7fc255546800 20 realm 2024-09-14T10:53:26.508 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.509+0000 7fc255546800 20 rados->read ofs=0 len=0 2024-09-14T10:53:26.508 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.509+0000 7fc255546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:53:26.508 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.509+0000 7fc255546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:53:26.508 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.509+0000 7fc255546800 20 rados->read ofs=0 len=0 2024-09-14T10:53:26.508 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.509+0000 7fc255546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:53:26.508 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.509+0000 7fc255546800 20 rados->read ofs=0 len=0 2024-09-14T10:53:26.509 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.510+0000 7fc255546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:53:26.509 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.510+0000 7fc255546800 20 rados->read ofs=0 len=0 2024-09-14T10:53:26.509 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.511+0000 7fc255546800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:53:26.509 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.511+0000 7fc255546800 20 searching for the correct realm 2024-09-14T10:53:26.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.514+0000 7fc253838640 0 -- 172.21.15.97:0/900613128 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7fc23c01a040 msgr2=0x7fc23c0662c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:53:26.520 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.521+0000 7fc24a836640 0 -- 172.21.15.97:0/900613128 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7fc244031040 msgr2=0x7fc244031420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:53:26.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.527+0000 7fc255546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:53:26.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.527+0000 7fc255546800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:53:26.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.527+0000 7fc255546800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T10:53:26.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.527+0000 7fc255546800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T10:53:26.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.527+0000 7fc255546800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:53:26.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.527+0000 7fc255546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:53:26.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.527+0000 7fc255546800 20 rados->read ofs=0 len=0 2024-09-14T10:53:26.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.527+0000 7fc255546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:53:26.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.527+0000 7fc255546800 20 rados->read ofs=0 len=0 2024-09-14T10:53:26.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.528+0000 7fc255546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:53:26.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.528+0000 7fc255546800 20 rados->read ofs=0 len=0 2024-09-14T10:53:26.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.528+0000 7fc255546800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:53:26.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.528+0000 7fc255546800 20 zone default found 2024-09-14T10:53:26.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.528+0000 7fc255546800 4 Realm: () 2024-09-14T10:53:26.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.528+0000 7fc255546800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T10:53:26.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.528+0000 7fc255546800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T10:53:26.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.528+0000 7fc255546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:53:26.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.528+0000 7fc255546800 20 zonegroup default 2024-09-14T10:53:26.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.528+0000 7fc255546800 20 rados->read ofs=0 len=0 2024-09-14T10:53:26.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.528+0000 7fc255546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:53:26.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.528+0000 7fc255546800 20 rados->read ofs=0 len=0 2024-09-14T10:53:26.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.528+0000 7fc255546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:53:26.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.528+0000 7fc255546800 20 rados->read ofs=0 len=0 2024-09-14T10:53:26.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.529+0000 7fc255546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:53:26.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.529+0000 7fc255546800 20 started sync module instance, tier type = 2024-09-14T10:53:26.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.529+0000 7fc255546800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T10:53:26.536 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.538+0000 7fc255546800 20 add_watcher() i=0 2024-09-14T10:53:26.536 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.538+0000 7fc255546800 20 add_watcher() i=1 2024-09-14T10:53:26.536 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.538+0000 7fc255546800 20 add_watcher() i=2 2024-09-14T10:53:26.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.538+0000 7fc255546800 20 add_watcher() i=3 2024-09-14T10:53:26.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.538+0000 7fc255546800 20 add_watcher() i=4 2024-09-14T10:53:26.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.538+0000 7fc255546800 20 add_watcher() i=5 2024-09-14T10:53:26.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.538+0000 7fc255546800 20 add_watcher() i=6 2024-09-14T10:53:26.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.539+0000 7fc255546800 20 add_watcher() i=7 2024-09-14T10:53:26.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.539+0000 7fc255546800 2 all 8 watchers are set, enabling cache 2024-09-14T10:53:26.539 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.541+0000 7fc109fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:53:26.539 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.541+0000 7fc255546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:53:26.539 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.541+0000 7fc255546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:53:26.540 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.541+0000 7fc255546800 5 note: GC not initialized 2024-09-14T10:53:26.540 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.541+0000 7fc108fe1640 20 reqs_thread_entry: start 2024-09-14T10:53:26.541 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.542+0000 7fc255546800 20 init_complete bucket index max shards: 11 2024-09-14T10:53:26.541 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.542+0000 7fc255546800 20 Filter name: none 2024-09-14T10:53:26.541 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.542+0000 7fc0827fc640 20 reqs_thread_entry: start 2024-09-14T10:53:26.541 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.542+0000 7fc255546800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-09-14T10:53:26.541 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.542+0000 7fc255546800 20 rados->read ofs=0 len=0 2024-09-14T10:53:26.541 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.542+0000 7fc255546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:53:26.541 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.542+0000 7fc255546800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-09-14T10:53:26.541 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.542+0000 7fc255546800 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-14T10:53:26.541 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.542+0000 7fc255546800 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-09-14T10:53:26.541 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.542+0000 7fc255546800 20 rados->read ofs=0 len=0 2024-09-14T10:53:26.542 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.542+0000 7fc255546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:53:26.542 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.542+0000 7fc255546800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-09-14T10:53:26.542 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.542+0000 7fc255546800 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-14T10:53:26.542 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.542+0000 7fc255546800 10 cache get: name=default.rgw.meta+users.keys+egziQ8cNsOzf3pvKpJT0exjsWGw= : miss 2024-09-14T10:53:26.542 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.542+0000 7fc255546800 20 rados->read ofs=0 len=0 2024-09-14T10:53:26.542 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.543+0000 7fc255546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:53:26.542 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.543+0000 7fc255546800 10 cache put: name=default.rgw.meta+users.keys+egziQ8cNsOzf3pvKpJT0exjsWGw= info.flags=0x0 2024-09-14T10:53:26.542 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.543+0000 7fc255546800 10 adding default.rgw.meta+users.keys+egziQ8cNsOzf3pvKpJT0exjsWGw= to cache LRU end 2024-09-14T10:53:26.542 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.543+0000 7fc255546800 10 cache get: name=default.rgw.meta+users.keys+egziQ8cNsOzf3pvKpJT0exjsWGw= : hit (negative entry) 2024-09-14T10:53:26.542 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.543+0000 7fc255546800 10 cache get: name=default.rgw.meta+users.keys+egziQ8cNsOzf3pvKpJT0exjsWGw= : hit (negative entry) 2024-09-14T10:53:26.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.544+0000 7fc255546800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-14T10:53:26.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.544+0000 7fc255546800 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-14T10:53:26.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.544+0000 7fc255546800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-09-14T10:53:26.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.544+0000 7fc136ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1065151889409 cookie 94896027627744 notifier 5324 bl.length()=697 2024-09-14T10:53:26.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.544+0000 7fc136ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-14T10:53:26.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.544+0000 7fc136ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-14T10:53:26.544 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.546+0000 7fc255546800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-14T10:53:26.544 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.546+0000 7fc255546800 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-14T10:53:26.544 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.546+0000 7fc255546800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-09-14T10:53:26.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.546+0000 7fc136ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1065151889411 cookie 94896027626688 notifier 5324 bl.length()=194 2024-09-14T10:53:26.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.546+0000 7fc136ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-14T10:53:26.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.546+0000 7fc136ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-14T10:53:26.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.548+0000 7fc255546800 10 cache put: name=default.rgw.meta+users.keys+egziQ8cNsOzf3pvKpJT0exjsWGw= info.flags=0x7 2024-09-14T10:53:26.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.548+0000 7fc255546800 10 moving default.rgw.meta+users.keys+egziQ8cNsOzf3pvKpJT0exjsWGw= to cache LRU end 2024-09-14T10:53:26.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.548+0000 7fc255546800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:egziQ8cNsOzf3pvKpJT0exjsWGw=, ofs0, ns] 2024-09-14T10:53:26.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.548+0000 7fc1367fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1065151889408 cookie 94896027628800 notifier 5324 bl.length()=203 2024-09-14T10:53:26.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.548+0000 7fc1367fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+egziQ8cNsOzf3pvKpJT0exjsWGw= info.flags=0x7 2024-09-14T10:53:26.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.548+0000 7fc1367fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+egziQ8cNsOzf3pvKpJT0exjsWGw= to cache LRU end 2024-09-14T10:53:26.547 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:53:26.547 INFO:tasks.workunit.client.0.smithi097.stdout: "user_id": "ceph-test-librgw-file", 2024-09-14T10:53:26.547 INFO:tasks.workunit.client.0.smithi097.stdout: "display_name": "librgw test user", 2024-09-14T10:53:26.547 INFO:tasks.workunit.client.0.smithi097.stdout: "email": "librgw@example.com", 2024-09-14T10:53:26.547 INFO:tasks.workunit.client.0.smithi097.stdout: "suspended": 0, 2024-09-14T10:53:26.547 INFO:tasks.workunit.client.0.smithi097.stdout: "max_buckets": 1000, 2024-09-14T10:53:26.547 INFO:tasks.workunit.client.0.smithi097.stdout: "subusers": [], 2024-09-14T10:53:26.548 INFO:tasks.workunit.client.0.smithi097.stdout: "keys": [ 2024-09-14T10:53:26.548 INFO:tasks.workunit.client.0.smithi097.stdout: { 2024-09-14T10:53:26.548 INFO:tasks.workunit.client.0.smithi097.stdout: "user": "ceph-test-librgw-file", 2024-09-14T10:53:26.548 INFO:tasks.workunit.client.0.smithi097.stdout: "access_key": "egziQ8cNsOzf3pvKpJT0exjsWGw=", 2024-09-14T10:53:26.548 INFO:tasks.workunit.client.0.smithi097.stdout: "secret_key": "DdjXgozRct6AQCQwErr7YX+ki5U10N2YEueX5vRpRYJmoMT8kIqZhw==", 2024-09-14T10:53:26.548 INFO:tasks.workunit.client.0.smithi097.stdout: "active": true, 2024-09-14T10:53:26.548 INFO:tasks.workunit.client.0.smithi097.stdout: "create_date": "2024-09-14T10:53:26.544121Z" 2024-09-14T10:53:26.548 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:53:26.548 INFO:tasks.workunit.client.0.smithi097.stdout: ], 2024-09-14T10:53:26.548 INFO:tasks.workunit.client.0.smithi097.stdout: "swift_keys": [], 2024-09-14T10:53:26.548 INFO:tasks.workunit.client.0.smithi097.stdout: "caps": [], 2024-09-14T10:53:26.548 INFO:tasks.workunit.client.0.smithi097.stdout: "op_mask": "read, write, delete", 2024-09-14T10:53:26.548 INFO:tasks.workunit.client.0.smithi097.stdout: "default_placement": "", 2024-09-14T10:53:26.549 INFO:tasks.workunit.client.0.smithi097.stdout: "default_storage_class": "", 2024-09-14T10:53:26.549 INFO:tasks.workunit.client.0.smithi097.stdout: "placement_tags": [], 2024-09-14T10:53:26.549 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_quota": { 2024-09-14T10:53:26.549 INFO:tasks.workunit.client.0.smithi097.stdout: "enabled": false, 2024-09-14T10:53:26.549 INFO:tasks.workunit.client.0.smithi097.stdout: "check_on_raw": false, 2024-09-14T10:53:26.549 INFO:tasks.workunit.client.0.smithi097.stdout: "max_size": -1, 2024-09-14T10:53:26.549 INFO:tasks.workunit.client.0.smithi097.stdout: "max_size_kb": 0, 2024-09-14T10:53:26.549 INFO:tasks.workunit.client.0.smithi097.stdout: "max_objects": -1 2024-09-14T10:53:26.549 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.549 INFO:tasks.workunit.client.0.smithi097.stdout: "user_quota": { 2024-09-14T10:53:26.549 INFO:tasks.workunit.client.0.smithi097.stdout: "enabled": false, 2024-09-14T10:53:26.549 INFO:tasks.workunit.client.0.smithi097.stdout: "check_on_raw": false, 2024-09-14T10:53:26.549 INFO:tasks.workunit.client.0.smithi097.stdout: "max_size": -1, 2024-09-14T10:53:26.549 INFO:tasks.workunit.client.0.smithi097.stdout: "max_size_kb": 0, 2024-09-14T10:53:26.550 INFO:tasks.workunit.client.0.smithi097.stdout: "max_objects": -1 2024-09-14T10:53:26.550 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:53:26.550 INFO:tasks.workunit.client.0.smithi097.stdout: "temp_url_keys": [], 2024-09-14T10:53:26.550 INFO:tasks.workunit.client.0.smithi097.stdout: "type": "rgw", 2024-09-14T10:53:26.550 INFO:tasks.workunit.client.0.smithi097.stdout: "mfa_ids": [], 2024-09-14T10:53:26.550 INFO:tasks.workunit.client.0.smithi097.stdout: "account_id": "", 2024-09-14T10:53:26.550 INFO:tasks.workunit.client.0.smithi097.stdout: "path": "/", 2024-09-14T10:53:26.550 INFO:tasks.workunit.client.0.smithi097.stdout: "create_date": "2024-09-14T10:53:26.544109Z", 2024-09-14T10:53:26.550 INFO:tasks.workunit.client.0.smithi097.stdout: "tags": [], 2024-09-14T10:53:26.550 INFO:tasks.workunit.client.0.smithi097.stdout: "group_ids": [] 2024-09-14T10:53:26.550 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:53:26.550 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-14T10:53:26.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.549+0000 7fc109fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:53:26.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.551+0000 7fc255546800 20 remove_watcher() i=0 2024-09-14T10:53:26.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.551+0000 7fc255546800 2 removed watcher, disabling cache 2024-09-14T10:53:26.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.552+0000 7fc255546800 20 remove_watcher() i=1 2024-09-14T10:53:26.552 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.554+0000 7fc255546800 20 remove_watcher() i=2 2024-09-14T10:53:26.553 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.555+0000 7fc255546800 20 remove_watcher() i=3 2024-09-14T10:53:26.554 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.556+0000 7fc255546800 20 remove_watcher() i=4 2024-09-14T10:53:26.555 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.557+0000 7fc255546800 20 remove_watcher() i=5 2024-09-14T10:53:26.556 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.558+0000 7fc255546800 20 remove_watcher() i=6 2024-09-14T10:53:26.558 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:26.559+0000 7fc255546800 20 remove_watcher() i=7 2024-09-14T10:53:26.568 INFO:tasks.workunit.client.0.smithi097.stdout:phase 1.1 2024-09-14T10:53:26.589 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T10:53:26.589 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-14T10:53:26.589 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 24 tests from LibRGW 2024-09-14T10:53:26.589 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.INIT 2024-09-14T10:53:26.599 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:53:26.600 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:53:26.977 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.INIT (388 ms) 2024-09-14T10:53:26.977 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-14T10:53:26.978 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-14T10:53:26.978 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T10:53:26.978 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-14T10:53:26.978 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-14T10:53:26.986 INFO:tasks.workunit.client.0.smithi097.stdout:creating: nfsroot:foo/bar/baz/quux 2024-09-14T10:53:26.991 INFO:tasks.workunit.client.0.smithi097.stdout:creating: nfsroot:foo/f1 2024-09-14T10:53:26.994 INFO:tasks.workunit.client.0.smithi097.stdout:creating: nfsroot:foo/f2 2024-09-14T10:53:26.996 INFO:tasks.workunit.client.0.smithi097.stdout:creating: nfsroot:foo/bar/f1 2024-09-14T10:53:26.999 INFO:tasks.workunit.client.0.smithi097.stdout:creating: nfsroot:foo/bar/d1/ 2024-09-14T10:53:27.001 INFO:tasks.workunit.client.0.smithi097.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-09-14T10:53:27.004 INFO:tasks.workunit.client.0.smithi097.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-09-14T10:53:27.007 INFO:tasks.workunit.client.0.smithi097.stdout:creating: nfsroot:foo/bar/baz/momma 2024-09-14T10:53:27.009 INFO:tasks.workunit.client.0.smithi097.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-09-14T10:53:27.012 INFO:tasks.workunit.client.0.smithi097.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-09-14T10:53:27.014 INFO:tasks.workunit.client.0.smithi097.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-09-14T10:53:27.016 INFO:tasks.workunit.client.0.smithi097.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-09-14T10:53:27.019 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.SETUP_HIER1 (41 ms) 2024-09-14T10:53:27.019 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-14T10:53:27.120 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.SETUP_DIRS1 (101 ms) 2024-09-14T10:53:27.120 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.SETATTR 2024-09-14T10:53:27.120 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-14T10:53:27.120 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-14T10:53:27.136 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (16 ms) 2024-09-14T10:53:27.136 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-14T10:53:27.178 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (43 ms) 2024-09-14T10:53:27.179 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-14T10:53:27.179 INFO:tasks.workunit.client.0.smithi097.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-09-14T10:53:27.185 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (6 ms) 2024-09-14T10:53:27.185 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-14T10:53:27.185 INFO:tasks.workunit.client.0.smithi097.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-09-14T10:53:27.190 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (6 ms) 2024-09-14T10:53:27.191 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-14T10:53:27.191 INFO:tasks.workunit.client.0.smithi097.stdout:scanning objects in /bdirs1/dir_0 2024-09-14T10:53:27.191 INFO:tasks.workunit.client.0.smithi097.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T10:53:27.191 INFO:tasks.workunit.client.0.smithi097.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T10:53:27.191 INFO:tasks.workunit.client.0.smithi097.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T10:53:27.191 INFO:tasks.workunit.client.0.smithi097.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T10:53:27.191 INFO:tasks.workunit.client.0.smithi097.stdout:scanning objects in /bdirs1/dir_1 2024-09-14T10:53:27.191 INFO:tasks.workunit.client.0.smithi097.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T10:53:27.191 INFO:tasks.workunit.client.0.smithi097.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T10:53:27.191 INFO:tasks.workunit.client.0.smithi097.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T10:53:27.191 INFO:tasks.workunit.client.0.smithi097.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T10:53:27.192 INFO:tasks.workunit.client.0.smithi097.stdout:scanning objects in /bdirs1/dir_2 2024-09-14T10:53:27.192 INFO:tasks.workunit.client.0.smithi097.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T10:53:27.192 INFO:tasks.workunit.client.0.smithi097.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T10:53:27.192 INFO:tasks.workunit.client.0.smithi097.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T10:53:27.192 INFO:tasks.workunit.client.0.smithi097.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T10:53:27.192 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-14T10:53:27.192 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-14T10:53:27.192 INFO:tasks.workunit.client.0.smithi097.stdout:read back objects in /bdirs1/dir_0 2024-09-14T10:53:27.192 INFO:tasks.workunit.client.0.smithi097.stdout:reading 0,256 dir_0/sfile_0 2024-09-14T10:53:27.193 INFO:tasks.workunit.client.0.smithi097.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T10:53:27.193 INFO:tasks.workunit.client.0.smithi097.stdout:reading 0,256 dir_0/sfile_1 2024-09-14T10:53:27.193 INFO:tasks.workunit.client.0.smithi097.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T10:53:27.193 INFO:tasks.workunit.client.0.smithi097.stdout:read back objects in /bdirs1/dir_1 2024-09-14T10:53:27.193 INFO:tasks.workunit.client.0.smithi097.stdout:reading 0,256 dir_1/sfile_0 2024-09-14T10:53:27.194 INFO:tasks.workunit.client.0.smithi097.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T10:53:27.194 INFO:tasks.workunit.client.0.smithi097.stdout:reading 0,256 dir_1/sfile_1 2024-09-14T10:53:27.195 INFO:tasks.workunit.client.0.smithi097.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T10:53:27.195 INFO:tasks.workunit.client.0.smithi097.stdout:read back objects in /bdirs1/dir_2 2024-09-14T10:53:27.195 INFO:tasks.workunit.client.0.smithi097.stdout:reading 0,256 dir_2/sfile_0 2024-09-14T10:53:27.196 INFO:tasks.workunit.client.0.smithi097.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T10:53:27.196 INFO:tasks.workunit.client.0.smithi097.stdout:reading 0,256 dir_2/sfile_1 2024-09-14T10:53:27.197 INFO:tasks.workunit.client.0.smithi097.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T10:53:27.197 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.READ_DIRS1 (7 ms) 2024-09-14T10:53:27.197 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-14T10:53:27.369 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.READF_SETUP1 (171 ms) 2024-09-14T10:53:27.369 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-14T10:53:27.369 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-14T10:53:27.369 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-14T10:53:27.369 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-14T10:53:27.369 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-14T10:53:27.370 INFO:tasks.workunit.client.0.smithi097.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T10:53:27.370 INFO:tasks.workunit.client.0.smithi097.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T10:53:27.370 INFO:tasks.workunit.client.0.smithi097.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T10:53:27.370 INFO:tasks.workunit.client.0.smithi097.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T10:53:27.370 INFO:tasks.workunit.client.0.smithi097.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T10:53:27.370 INFO:tasks.workunit.client.0.smithi097.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T10:53:27.370 INFO:tasks.workunit.client.0.smithi097.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T10:53:27.370 INFO:tasks.workunit.client.0.smithi097.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T10:53:27.370 INFO:tasks.workunit.client.0.smithi097.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T10:53:27.370 INFO:tasks.workunit.client.0.smithi097.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T10:53:27.370 INFO:tasks.workunit.client.0.smithi097.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T10:53:27.370 INFO:tasks.workunit.client.0.smithi097.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T10:53:27.370 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-14T10:53:27.371 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.HIER1 2024-09-14T10:53:27.376 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-14T10:53:27.377 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-14T10:53:27.380 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-14T10:53:27.382 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-14T10:53:27.385 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T10:53:27.386 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T10:53:27.386 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-14T10:53:27.387 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-14T10:53:27.387 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T10:53:27.388 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T10:53:27.388 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-14T10:53:27.391 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-14T10:53:27.391 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-14T10:53:27.391 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-14T10:53:27.391 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo (foo): DIR 2024-09-14T10:53:27.391 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot (nfsroot): DIR 2024-09-14T10:53:27.391 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.HIER1 (22 ms) 2024-09-14T10:53:27.391 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T10:53:27.391 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-14T10:53:27.391 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T10:53:27.392 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T10:53:27.392 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T10:53:27.392 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T10:53:27.392 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T10:53:27.392 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T10:53:27.392 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T10:53:27.392 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T10:53:27.392 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T10:53:27.392 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T10:53:27.392 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T10:53:27.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:27.392+0000 7fe3f83248c0 -1 shutting down 2024-09-14T10:53:27.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:27.393+0000 7fe2d029a640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 64597, si_uid : 1000, si_addr0x3e80000fc55, si_status0 2024-09-14T10:53:57.274 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.SHUTDOWN (29883 ms) 2024-09-14T10:53:57.274 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 24 tests from LibRGW (30685 ms total) 2024-09-14T10:53:57.274 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-14T10:53:57.274 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-14T10:53:57.274 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 24 tests from 1 test suite ran. (30685 ms total) 2024-09-14T10:53:57.274 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 24 tests. 2024-09-14T10:53:57.280 INFO:tasks.workunit.client.0.smithi097.stdout:phase 1.2 2024-09-14T10:53:57.304 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T10:53:57.304 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-14T10:53:57.304 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 24 tests from LibRGW 2024-09-14T10:53:57.304 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.INIT 2024-09-14T10:53:57.312 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:53:57.312 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:53:57.487 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.INIT (184 ms) 2024-09-14T10:53:57.488 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-14T10:53:57.489 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-14T10:53:57.489 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T10:53:57.489 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-14T10:53:57.489 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-14T10:53:57.489 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-09-14T10:53:57.489 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-14T10:53:57.490 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-09-14T10:53:57.490 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.SETATTR 2024-09-14T10:53:57.490 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-14T10:53:57.490 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-14T10:53:57.490 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-14T10:53:57.490 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-14T10:53:57.490 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-14T10:53:57.490 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-14T10:53:57.490 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-14T10:53:57.490 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-14T10:53:57.490 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-14T10:53:57.490 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-14T10:53:57.490 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-14T10:53:57.490 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-14T10:53:57.491 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-09-14T10:53:57.491 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-14T10:53:57.491 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-14T10:53:57.491 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-14T10:53:57.491 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-14T10:53:57.491 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-14T10:53:57.491 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-14T10:53:57.491 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-14T10:53:57.491 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-14T10:53:57.491 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.HIER1 2024-09-14T10:53:57.491 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-09-14T10:53:57.491 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T10:53:57.491 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-14T10:53:57.491 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T10:53:57.492 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T10:53:57.492 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T10:53:57.492 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T10:53:57.492 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T10:53:57.492 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T10:53:57.492 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T10:53:57.492 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T10:53:57.492 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T10:53:57.492 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T10:53:57.492 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T10:53:57.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:57.490+0000 7fab59d398c0 -1 shutting down 2024-09-14T10:53:57.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:53:57.491+0000 7faa31cd5640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 65216, si_uid : 1000, si_addr0x3e80000fec0, si_status0 2024-09-14T10:54:27.810 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.SHUTDOWN (30321 ms) 2024-09-14T10:54:27.811 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 24 tests from LibRGW (30506 ms total) 2024-09-14T10:54:27.811 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-14T10:54:27.811 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-14T10:54:27.811 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 24 tests from 1 test suite ran. (30506 ms total) 2024-09-14T10:54:27.811 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 24 tests. 2024-09-14T10:54:27.816 INFO:tasks.workunit.client.0.smithi097.stdout:phase 1.3 2024-09-14T10:54:27.839 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T10:54:27.839 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-14T10:54:27.839 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 24 tests from LibRGW 2024-09-14T10:54:27.839 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.INIT 2024-09-14T10:54:27.849 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:54:27.849 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:54:28.230 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.INIT (391 ms) 2024-09-14T10:54:28.230 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-14T10:54:28.230 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-14T10:54:28.230 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T10:54:28.230 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-14T10:54:28.231 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-14T10:54:28.236 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.SETUP_HIER1 (4 ms) 2024-09-14T10:54:28.236 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-14T10:54:28.291 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.SETUP_DIRS1 (56 ms) 2024-09-14T10:54:28.291 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.SETATTR 2024-09-14T10:54:28.291 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-14T10:54:28.291 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-14T10:54:28.292 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-14T10:54:28.292 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-14T10:54:28.292 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-14T10:54:28.292 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-14T10:54:28.292 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-14T10:54:28.293 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-14T10:54:28.293 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-14T10:54:28.293 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-14T10:54:28.293 INFO:tasks.workunit.client.0.smithi097.stdout:scanning objects in /bdirs1/dir_0 2024-09-14T10:54:28.293 INFO:tasks.workunit.client.0.smithi097.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T10:54:28.293 INFO:tasks.workunit.client.0.smithi097.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T10:54:28.294 INFO:tasks.workunit.client.0.smithi097.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T10:54:28.294 INFO:tasks.workunit.client.0.smithi097.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T10:54:28.294 INFO:tasks.workunit.client.0.smithi097.stdout:scanning objects in /bdirs1/dir_1 2024-09-14T10:54:28.294 INFO:tasks.workunit.client.0.smithi097.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T10:54:28.294 INFO:tasks.workunit.client.0.smithi097.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T10:54:28.295 INFO:tasks.workunit.client.0.smithi097.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T10:54:28.295 INFO:tasks.workunit.client.0.smithi097.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T10:54:28.295 INFO:tasks.workunit.client.0.smithi097.stdout:scanning objects in /bdirs1/dir_2 2024-09-14T10:54:28.295 INFO:tasks.workunit.client.0.smithi097.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T10:54:28.295 INFO:tasks.workunit.client.0.smithi097.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T10:54:28.295 INFO:tasks.workunit.client.0.smithi097.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T10:54:28.296 INFO:tasks.workunit.client.0.smithi097.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T10:54:28.296 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-14T10:54:28.296 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-14T10:54:28.296 INFO:tasks.workunit.client.0.smithi097.stdout:read back objects in /bdirs1/dir_0 2024-09-14T10:54:28.296 INFO:tasks.workunit.client.0.smithi097.stdout:reading 0,256 dir_0/sfile_0 2024-09-14T10:54:28.299 INFO:tasks.workunit.client.0.smithi097.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T10:54:28.299 INFO:tasks.workunit.client.0.smithi097.stdout:reading 0,256 dir_0/sfile_1 2024-09-14T10:54:28.299 INFO:tasks.workunit.client.0.smithi097.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T10:54:28.300 INFO:tasks.workunit.client.0.smithi097.stdout:read back objects in /bdirs1/dir_1 2024-09-14T10:54:28.300 INFO:tasks.workunit.client.0.smithi097.stdout:reading 0,256 dir_1/sfile_0 2024-09-14T10:54:28.300 INFO:tasks.workunit.client.0.smithi097.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T10:54:28.300 INFO:tasks.workunit.client.0.smithi097.stdout:reading 0,256 dir_1/sfile_1 2024-09-14T10:54:28.300 INFO:tasks.workunit.client.0.smithi097.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T10:54:28.301 INFO:tasks.workunit.client.0.smithi097.stdout:read back objects in /bdirs1/dir_2 2024-09-14T10:54:28.301 INFO:tasks.workunit.client.0.smithi097.stdout:reading 0,256 dir_2/sfile_0 2024-09-14T10:54:28.301 INFO:tasks.workunit.client.0.smithi097.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T10:54:28.301 INFO:tasks.workunit.client.0.smithi097.stdout:reading 0,256 dir_2/sfile_1 2024-09-14T10:54:28.301 INFO:tasks.workunit.client.0.smithi097.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T10:54:28.302 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.READ_DIRS1 (6 ms) 2024-09-14T10:54:28.302 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-14T10:54:28.302 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-14T10:54:28.302 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-14T10:54:28.302 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-14T10:54:28.302 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-14T10:54:28.303 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-14T10:54:28.303 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-14T10:54:28.303 INFO:tasks.workunit.client.0.smithi097.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T10:54:28.303 INFO:tasks.workunit.client.0.smithi097.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T10:54:28.303 INFO:tasks.workunit.client.0.smithi097.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T10:54:28.303 INFO:tasks.workunit.client.0.smithi097.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T10:54:28.304 INFO:tasks.workunit.client.0.smithi097.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T10:54:28.304 INFO:tasks.workunit.client.0.smithi097.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T10:54:28.304 INFO:tasks.workunit.client.0.smithi097.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T10:54:28.304 INFO:tasks.workunit.client.0.smithi097.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T10:54:28.304 INFO:tasks.workunit.client.0.smithi097.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T10:54:28.304 INFO:tasks.workunit.client.0.smithi097.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T10:54:28.304 INFO:tasks.workunit.client.0.smithi097.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T10:54:28.304 INFO:tasks.workunit.client.0.smithi097.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T10:54:28.305 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-14T10:54:28.305 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.HIER1 2024-09-14T10:54:28.305 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-14T10:54:28.305 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-14T10:54:28.307 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-14T10:54:28.308 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-14T10:54:28.311 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T10:54:28.312 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T10:54:28.312 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-14T10:54:28.313 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-14T10:54:28.313 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T10:54:28.313 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T10:54:28.314 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-14T10:54:28.316 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-14T10:54:28.316 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-14T10:54:28.316 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-14T10:54:28.316 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot/foo (foo): DIR 2024-09-14T10:54:28.317 INFO:tasks.workunit.client.0.smithi097.stdout:/nfsroot (nfsroot): DIR 2024-09-14T10:54:28.317 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.HIER1 (19 ms) 2024-09-14T10:54:28.317 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T10:54:28.317 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-14T10:54:28.317 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T10:54:28.317 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T10:54:28.317 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T10:54:28.317 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T10:54:28.317 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T10:54:28.317 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T10:54:28.317 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T10:54:28.317 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T10:54:28.318 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T10:54:28.318 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T10:54:28.318 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T10:54:28.318 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:54:28.317+0000 7f5f2f9238c0 -1 shutting down 2024-09-14T10:54:28.318 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:54:28.319+0000 7f5e077ac640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 65835, si_uid : 1000, si_addr0x3e80001012b, si_status0 2024-09-14T10:54:58.614 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.SHUTDOWN (30298 ms) 2024-09-14T10:54:58.614 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 24 tests from LibRGW (30775 ms total) 2024-09-14T10:54:58.614 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-14T10:54:58.614 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-14T10:54:58.614 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 24 tests from 1 test suite ran. (30775 ms total) 2024-09-14T10:54:58.614 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 24 tests. 2024-09-14T10:54:58.621 INFO:tasks.workunit.client.0.smithi097.stdout:phase 2.1 2024-09-14T10:54:58.646 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-14T10:54:58.646 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-14T10:54:58.646 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 9 tests from LibRGW 2024-09-14T10:54:58.646 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.INIT 2024-09-14T10:54:58.655 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:54:58.655 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:54:59.042 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.INIT (395 ms) 2024-09-14T10:54:59.042 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T10:54:59.043 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T10:54:59.043 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T10:54:59.051 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.CREATE_BUCKET (8 ms) 2024-09-14T10:54:59.051 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T10:54:59.051 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-14T10:54:59.051 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-14T10:54:59.058 INFO:tasks.workunit.client.0.smithi097.stdout:created: sorrydave0 2024-09-14T10:54:59.066 INFO:tasks.workunit.client.0.smithi097.stdout:created: sorrydave1 2024-09-14T10:54:59.075 INFO:tasks.workunit.client.0.smithi097.stdout:created: sorrydave2 2024-09-14T10:54:59.083 INFO:tasks.workunit.client.0.smithi097.stdout:created: sorrydave3 2024-09-14T10:54:59.091 INFO:tasks.workunit.client.0.smithi097.stdout:created: sorrydave4 2024-09-14T10:54:59.102 INFO:tasks.workunit.client.0.smithi097.stdout:created: sorrydave5 2024-09-14T10:54:59.110 INFO:tasks.workunit.client.0.smithi097.stdout:created: sorrydave6 2024-09-14T10:54:59.119 INFO:tasks.workunit.client.0.smithi097.stdout:created: sorrydave7 2024-09-14T10:54:59.127 INFO:tasks.workunit.client.0.smithi097.stdout:created: sorrydave8 2024-09-14T10:54:59.135 INFO:tasks.workunit.client.0.smithi097.stdout:created: sorrydave9 2024-09-14T10:54:59.135 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (85 ms) 2024-09-14T10:54:59.135 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-14T10:54:59.399 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (264 ms) 2024-09-14T10:54:59.399 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T10:54:59.400 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T10:54:59.400 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T10:54:59.400 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T10:54:59.400 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T10:54:59.400 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:54:59.401+0000 7fb13632f8c0 -1 shutting down 2024-09-14T10:54:59.400 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:54:59.402+0000 7fb00e2c7640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 66454, si_uid : 1000, si_addr0x3e800010396, si_status0 2024-09-14T10:55:29.418 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.SHUTDOWN (30018 ms) 2024-09-14T10:55:29.418 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 9 tests from LibRGW (30771 ms total) 2024-09-14T10:55:29.419 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-14T10:55:29.419 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-14T10:55:29.419 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 9 tests from 1 test suite ran. (30771 ms total) 2024-09-14T10:55:29.419 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 9 tests. 2024-09-14T10:55:29.424 INFO:tasks.workunit.client.0.smithi097.stdout:phase 2.2 2024-09-14T10:55:29.449 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-14T10:55:29.449 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-14T10:55:29.449 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 9 tests from LibRGW 2024-09-14T10:55:29.449 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.INIT 2024-09-14T10:55:29.458 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:29.458 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:29.836 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.INIT (387 ms) 2024-09-14T10:55:29.836 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T10:55:29.836 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T10:55:29.836 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T10:55:29.836 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-14T10:55:29.837 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T10:55:29.866 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.DELETE_BUCKET (29 ms) 2024-09-14T10:55:29.866 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-14T10:55:29.876 INFO:tasks.workunit.client.0.smithi097.stdout:created: sorrydave0 2024-09-14T10:55:29.885 INFO:tasks.workunit.client.0.smithi097.stdout:created: sorrydave1 2024-09-14T10:55:29.893 INFO:tasks.workunit.client.0.smithi097.stdout:created: sorrydave2 2024-09-14T10:55:29.902 INFO:tasks.workunit.client.0.smithi097.stdout:created: sorrydave3 2024-09-14T10:55:29.911 INFO:tasks.workunit.client.0.smithi097.stdout:created: sorrydave4 2024-09-14T10:55:29.919 INFO:tasks.workunit.client.0.smithi097.stdout:created: sorrydave5 2024-09-14T10:55:29.927 INFO:tasks.workunit.client.0.smithi097.stdout:created: sorrydave6 2024-09-14T10:55:29.937 INFO:tasks.workunit.client.0.smithi097.stdout:created: sorrydave7 2024-09-14T10:55:29.946 INFO:tasks.workunit.client.0.smithi097.stdout:created: sorrydave8 2024-09-14T10:55:29.954 INFO:tasks.workunit.client.0.smithi097.stdout:created: sorrydave9 2024-09-14T10:55:29.954 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (89 ms) 2024-09-14T10:55:29.955 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-14T10:55:30.213 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (258 ms) 2024-09-14T10:55:30.213 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T10:55:30.213 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T10:55:30.213 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T10:55:30.213 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T10:55:30.213 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T10:55:30.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:55:30.214+0000 7eff3ef2f8c0 -1 shutting down 2024-09-14T10:55:30.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:55:30.215+0000 7efe16ec7640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67073, si_uid : 1000, si_addr0x3e800010601, si_status0 2024-09-14T10:56:00.023 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.SHUTDOWN (29810 ms) 2024-09-14T10:56:00.023 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 9 tests from LibRGW (30574 ms total) 2024-09-14T10:56:00.023 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-14T10:56:00.023 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-14T10:56:00.023 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 9 tests from 1 test suite ran. (30574 ms total) 2024-09-14T10:56:00.023 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 9 tests. 2024-09-14T10:56:00.029 INFO:tasks.workunit.client.0.smithi097.stdout:phase 3.1 2024-09-14T10:56:00.349 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-14T10:56:00.349 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-14T10:56:00.349 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 13 tests from LibRGW 2024-09-14T10:56:00.349 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.INIT 2024-09-14T10:56:00.358 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:56:00.358 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:56:00.530 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.INIT (182 ms) 2024-09-14T10:56:00.530 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T10:56:00.531 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T10:56:00.531 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T10:56:00.539 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.CREATE_BUCKET (8 ms) 2024-09-14T10:56:00.540 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T10:56:00.542 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (3 ms) 2024-09-14T10:56:00.542 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T10:56:00.544 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-09-14T10:56:00.544 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.LARGE1 2024-09-14T10:56:00.600 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.LARGE1 (55 ms) 2024-09-14T10:56:00.600 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.LARGE2 2024-09-14T10:56:00.636 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.LARGE2 (36 ms) 2024-09-14T10:56:00.636 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T10:56:00.636 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T10:56:00.636 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T10:56:00.637 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-14T10:56:00.637 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T10:56:00.637 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-14T10:56:00.637 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T10:56:00.637 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T10:56:00.637 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T10:56:00.637 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T10:56:00.637 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T10:56:00.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:56:00.638+0000 7fb2df71f8c0 -1 shutting down 2024-09-14T10:56:00.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:56:00.639+0000 7fb1b7663640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67693, si_uid : 1000, si_addr0x3e80001086d, si_status0 2024-09-14T10:56:30.596 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.SHUTDOWN (29960 ms) 2024-09-14T10:56:30.596 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 13 tests from LibRGW (30247 ms total) 2024-09-14T10:56:30.596 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-14T10:56:30.596 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-14T10:56:30.596 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 13 tests from 1 test suite ran. (30247 ms total) 2024-09-14T10:56:30.596 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 13 tests. 2024-09-14T10:56:30.603 INFO:tasks.workunit.client.0.smithi097.stdout:phase 3.2 2024-09-14T10:56:30.919 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-14T10:56:30.919 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-14T10:56:30.919 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 13 tests from LibRGW 2024-09-14T10:56:30.919 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.INIT 2024-09-14T10:56:30.927 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:56:30.927 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:56:31.104 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.INIT (185 ms) 2024-09-14T10:56:31.104 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T10:56:31.104 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T10:56:31.105 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T10:56:31.105 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-14T10:56:31.105 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T10:56:31.109 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (5 ms) 2024-09-14T10:56:31.109 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T10:56:31.112 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (3 ms) 2024-09-14T10:56:31.113 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.LARGE1 2024-09-14T10:56:31.545 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.LARGE1 (432 ms) 2024-09-14T10:56:31.545 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.LARGE2 2024-09-14T10:56:31.545 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-09-14T10:56:31.545 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T10:56:31.545 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T10:56:31.545 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T10:56:31.549 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.DELETE_OBJECT (5 ms) 2024-09-14T10:56:31.550 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T10:56:31.578 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.DELETE_BUCKET (28 ms) 2024-09-14T10:56:31.578 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T10:56:31.578 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T10:56:31.578 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T10:56:31.579 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T10:56:31.579 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T10:56:31.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:56:31.579+0000 7f1111a318c0 -1 shutting down 2024-09-14T10:56:31.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:56:31.581+0000 7f0fe6f0f640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68313, si_uid : 1000, si_addr0x3e800010ad9, si_status0 2024-09-14T10:57:01.453 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.SHUTDOWN (29875 ms) 2024-09-14T10:57:01.453 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 13 tests from LibRGW (30534 ms total) 2024-09-14T10:57:01.453 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-14T10:57:01.453 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-14T10:57:01.453 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 13 tests from 1 test suite ran. (30534 ms total) 2024-09-14T10:57:01.453 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 13 tests. 2024-09-14T10:57:01.460 INFO:tasks.workunit.client.0.smithi097.stdout:phase 4.1 2024-09-14T10:57:01.488 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-14T10:57:01.489 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-14T10:57:01.489 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 11 tests from LibRGW 2024-09-14T10:57:01.489 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.TVAR 2024-09-14T10:57:01.489 INFO:tasks.workunit.client.0.smithi097.stdout:read i1: 64001 2024-09-14T10:57:01.489 INFO:tasks.workunit.client.0.smithi097.stdout:read s1: blunderbuss 2024-09-14T10:57:01.489 INFO:tasks.workunit.client.0.smithi097.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-14T10:57:01.489 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.INIT 2024-09-14T10:57:01.499 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:01.500 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:01.886 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.INIT (397 ms) 2024-09-14T10:57:01.886 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T10:57:01.888 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T10:57:01.888 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T10:57:01.902 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (15 ms) 2024-09-14T10:57:01.902 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T10:57:02.450 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_0 2024-09-14T10:57:02.450 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_1 2024-09-14T10:57:02.450 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_2 2024-09-14T10:57:02.450 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_3 2024-09-14T10:57:02.451 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_4 2024-09-14T10:57:02.451 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_5 2024-09-14T10:57:02.451 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_6 2024-09-14T10:57:02.451 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_7 2024-09-14T10:57:02.451 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_8 2024-09-14T10:57:02.451 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_9 2024-09-14T10:57:02.451 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_10 2024-09-14T10:57:02.451 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_11 2024-09-14T10:57:02.451 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_12 2024-09-14T10:57:02.451 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_13 2024-09-14T10:57:02.451 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_14 2024-09-14T10:57:02.451 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_15 2024-09-14T10:57:02.451 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_16 2024-09-14T10:57:02.452 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_17 2024-09-14T10:57:02.452 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_18 2024-09-14T10:57:02.452 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_19 2024-09-14T10:57:02.452 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_20 2024-09-14T10:57:02.452 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_21 2024-09-14T10:57:02.452 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_22 2024-09-14T10:57:02.452 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_23 2024-09-14T10:57:02.452 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_24 2024-09-14T10:57:02.452 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_25 2024-09-14T10:57:02.452 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_26 2024-09-14T10:57:02.452 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_27 2024-09-14T10:57:02.452 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_28 2024-09-14T10:57:02.452 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_29 2024-09-14T10:57:02.453 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_30 2024-09-14T10:57:02.453 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_31 2024-09-14T10:57:02.453 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_32 2024-09-14T10:57:02.453 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_33 2024-09-14T10:57:02.453 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_34 2024-09-14T10:57:02.453 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_35 2024-09-14T10:57:02.453 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_36 2024-09-14T10:57:02.453 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_37 2024-09-14T10:57:02.453 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_38 2024-09-14T10:57:02.453 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_39 2024-09-14T10:57:02.453 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_40 2024-09-14T10:57:02.453 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_41 2024-09-14T10:57:02.453 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_42 2024-09-14T10:57:02.453 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_43 2024-09-14T10:57:02.454 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_44 2024-09-14T10:57:02.454 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_45 2024-09-14T10:57:02.454 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_46 2024-09-14T10:57:02.454 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_47 2024-09-14T10:57:02.454 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_48 2024-09-14T10:57:02.454 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_49 2024-09-14T10:57:02.454 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_50 2024-09-14T10:57:02.454 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_51 2024-09-14T10:57:02.454 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_52 2024-09-14T10:57:02.454 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_53 2024-09-14T10:57:02.454 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_54 2024-09-14T10:57:02.454 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_55 2024-09-14T10:57:02.455 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_56 2024-09-14T10:57:02.455 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_57 2024-09-14T10:57:02.455 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_58 2024-09-14T10:57:02.455 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_59 2024-09-14T10:57:02.455 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_60 2024-09-14T10:57:02.455 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_61 2024-09-14T10:57:02.455 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_62 2024-09-14T10:57:02.455 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_63 2024-09-14T10:57:02.455 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_64 2024-09-14T10:57:02.455 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_65 2024-09-14T10:57:02.455 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_66 2024-09-14T10:57:02.455 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_67 2024-09-14T10:57:02.455 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_68 2024-09-14T10:57:02.455 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_69 2024-09-14T10:57:02.456 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_70 2024-09-14T10:57:02.456 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_71 2024-09-14T10:57:02.456 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_72 2024-09-14T10:57:02.456 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_73 2024-09-14T10:57:02.456 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_74 2024-09-14T10:57:02.456 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_75 2024-09-14T10:57:02.456 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_76 2024-09-14T10:57:02.456 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_77 2024-09-14T10:57:02.456 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_78 2024-09-14T10:57:02.456 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_79 2024-09-14T10:57:02.456 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_80 2024-09-14T10:57:02.456 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_81 2024-09-14T10:57:02.456 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_82 2024-09-14T10:57:02.457 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_83 2024-09-14T10:57:02.457 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_84 2024-09-14T10:57:02.457 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_85 2024-09-14T10:57:02.457 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_86 2024-09-14T10:57:02.457 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_87 2024-09-14T10:57:02.457 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_88 2024-09-14T10:57:02.457 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_89 2024-09-14T10:57:02.457 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_90 2024-09-14T10:57:02.457 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_91 2024-09-14T10:57:02.457 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_92 2024-09-14T10:57:02.457 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_93 2024-09-14T10:57:02.457 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_94 2024-09-14T10:57:02.457 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_95 2024-09-14T10:57:02.458 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_96 2024-09-14T10:57:02.458 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_97 2024-09-14T10:57:02.458 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_98 2024-09-14T10:57:02.458 INFO:tasks.workunit.client.0.smithi097.stdout:created: dmarker:f_99 2024-09-14T10:57:02.458 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (549 ms) 2024-09-14T10:57:02.458 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T10:57:02.459 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-09-14T10:57:02.459 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-09-14T10:57:02.459 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-14T10:57:02.460 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-14T10:57:02.460 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-14T10:57:02.460 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-14T10:57:02.460 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-14T10:57:02.460 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-14T10:57:02.460 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-14T10:57:02.460 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-14T10:57:02.460 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-14T10:57:02.460 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-14T10:57:02.461 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-14T10:57:02.461 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-14T10:57:02.461 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-14T10:57:02.461 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-14T10:57:02.461 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-14T10:57:02.461 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-14T10:57:02.461 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-14T10:57:02.461 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-14T10:57:02.461 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-14T10:57:02.461 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-14T10:57:02.461 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-14T10:57:02.461 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-14T10:57:02.461 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-14T10:57:02.462 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-14T10:57:02.462 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-14T10:57:02.462 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-14T10:57:02.462 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-14T10:57:02.462 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-14T10:57:02.462 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-14T10:57:02.462 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-14T10:57:02.462 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-14T10:57:02.463 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-14T10:57:02.463 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-14T10:57:02.463 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-14T10:57:02.463 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-14T10:57:02.463 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-14T10:57:02.463 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-14T10:57:02.463 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-14T10:57:02.463 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-14T10:57:02.463 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-14T10:57:02.463 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-14T10:57:02.463 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-14T10:57:02.463 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-14T10:57:02.463 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-14T10:57:02.464 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-14T10:57:02.464 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-14T10:57:02.464 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-14T10:57:02.464 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-14T10:57:02.464 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-14T10:57:02.464 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-14T10:57:02.464 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-14T10:57:02.464 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-14T10:57:02.464 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-14T10:57:02.464 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-14T10:57:02.464 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-14T10:57:02.464 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-14T10:57:02.465 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-14T10:57:02.465 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-14T10:57:02.465 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-14T10:57:02.465 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-14T10:57:02.465 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-14T10:57:02.465 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-14T10:57:02.465 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-14T10:57:02.465 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-14T10:57:02.465 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-14T10:57:02.465 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-14T10:57:02.466 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-14T10:57:02.466 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-14T10:57:02.466 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-14T10:57:02.466 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-14T10:57:02.466 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-14T10:57:02.466 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-14T10:57:02.466 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-14T10:57:02.466 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-14T10:57:02.466 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-14T10:57:02.466 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-14T10:57:02.466 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-14T10:57:02.466 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-14T10:57:02.466 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-14T10:57:02.467 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-14T10:57:02.467 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-14T10:57:02.467 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-14T10:57:02.467 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-14T10:57:02.467 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-14T10:57:02.467 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-14T10:57:02.467 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-14T10:57:02.467 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-14T10:57:02.467 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-14T10:57:02.467 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-14T10:57:02.467 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-14T10:57:02.468 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-14T10:57:02.468 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-14T10:57:02.468 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-14T10:57:02.468 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-14T10:57:02.468 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-14T10:57:02.468 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-14T10:57:02.468 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-14T10:57:02.468 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-14T10:57:02.468 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-14T10:57:02.469 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-14T10:57:02.469 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MARKER1_READDIR (2 ms) 2024-09-14T10:57:02.469 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-14T10:57:02.469 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-14T10:57:02.469 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-14T10:57:02.469 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-14T10:57:02.469 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-14T10:57:02.469 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-14T10:57:02.469 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-14T10:57:02.469 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-14T10:57:02.469 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-14T10:57:02.469 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-14T10:57:02.470 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-14T10:57:02.470 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-14T10:57:02.470 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-14T10:57:02.470 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-14T10:57:02.470 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-14T10:57:02.470 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-14T10:57:02.470 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-14T10:57:02.470 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-14T10:57:02.470 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-14T10:57:02.470 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-14T10:57:02.471 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-14T10:57:02.471 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-14T10:57:02.471 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-14T10:57:02.471 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-14T10:57:02.471 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-14T10:57:02.471 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-14T10:57:02.471 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-14T10:57:02.471 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-14T10:57:02.471 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-14T10:57:02.471 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-14T10:57:02.471 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-14T10:57:02.471 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-14T10:57:02.472 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-14T10:57:02.472 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-14T10:57:02.472 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-14T10:57:02.472 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-14T10:57:02.472 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-14T10:57:02.472 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-14T10:57:02.472 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-14T10:57:02.472 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-14T10:57:02.472 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-14T10:57:02.472 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-14T10:57:02.473 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-14T10:57:02.473 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-14T10:57:02.473 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-14T10:57:02.473 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-14T10:57:02.473 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-14T10:57:02.473 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-14T10:57:02.473 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-14T10:57:02.473 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-14T10:57:02.473 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-14T10:57:02.473 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-14T10:57:02.473 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-14T10:57:02.473 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-14T10:57:02.474 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-14T10:57:02.474 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-14T10:57:02.474 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-14T10:57:02.474 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-14T10:57:02.474 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-14T10:57:02.474 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-14T10:57:02.474 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-14T10:57:02.474 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-14T10:57:02.474 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-14T10:57:02.475 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-14T10:57:02.475 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-14T10:57:02.475 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-14T10:57:02.475 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-14T10:57:02.475 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-14T10:57:02.475 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-14T10:57:02.475 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-14T10:57:02.475 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-14T10:57:02.475 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-14T10:57:02.475 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-14T10:57:02.475 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-14T10:57:02.476 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-14T10:57:02.476 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-14T10:57:02.476 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-14T10:57:02.476 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-14T10:57:02.476 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-14T10:57:02.476 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-14T10:57:02.476 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-14T10:57:02.476 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-14T10:57:02.476 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-14T10:57:02.476 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-14T10:57:02.477 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-14T10:57:02.477 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-14T10:57:02.477 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-14T10:57:02.477 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-14T10:57:02.477 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-14T10:57:02.477 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-14T10:57:02.477 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-14T10:57:02.477 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-14T10:57:02.477 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-14T10:57:02.477 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-14T10:57:02.477 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-14T10:57:02.477 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-14T10:57:02.478 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-14T10:57:02.478 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-14T10:57:02.478 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-14T10:57:02.478 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-14T10:57:02.478 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-14T10:57:02.478 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MARKER2_READDIR (2 ms) 2024-09-14T10:57:02.478 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T10:57:02.478 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T10:57:02.478 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T10:57:02.478 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T10:57:02.478 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T10:57:02.478 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T10:57:02.478 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T10:57:02.479 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:57:02.457+0000 7fdb3f5358c0 -1 shutting down 2024-09-14T10:57:02.479 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:57:02.458+0000 7fda17419640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68933, si_uid : 1000, si_addr0x3e800010d45, si_status0 2024-09-14T10:57:32.052 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.SHUTDOWN (29597 ms) 2024-09-14T10:57:32.053 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 11 tests from LibRGW (30564 ms total) 2024-09-14T10:57:32.053 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-14T10:57:32.053 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-14T10:57:32.053 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 11 tests from 1 test suite ran. (30564 ms total) 2024-09-14T10:57:32.053 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 11 tests. 2024-09-14T10:57:32.059 INFO:tasks.workunit.client.0.smithi097.stdout:phase 4.2 2024-09-14T10:57:32.083 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-14T10:57:32.084 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-14T10:57:32.084 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 11 tests from LibRGW 2024-09-14T10:57:32.084 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.TVAR 2024-09-14T10:57:32.084 INFO:tasks.workunit.client.0.smithi097.stdout:read i1: 64001 2024-09-14T10:57:32.084 INFO:tasks.workunit.client.0.smithi097.stdout:read s1: blunderbuss 2024-09-14T10:57:32.084 INFO:tasks.workunit.client.0.smithi097.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-14T10:57:32.084 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.INIT 2024-09-14T10:57:32.092 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:32.092 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:32.682 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.INIT (599 ms) 2024-09-14T10:57:32.682 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T10:57:32.683 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T10:57:32.683 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T10:57:32.691 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (8 ms) 2024-09-14T10:57:32.691 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T10:57:32.691 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T10:57:32.691 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T10:57:32.691 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T10:57:32.692 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-14T10:57:32.694 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-14T10:57:32.695 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-14T10:57:32.695 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-14T10:57:32.695 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-14T10:57:32.695 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-14T10:57:32.695 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-14T10:57:32.695 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-14T10:57:32.695 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-14T10:57:32.695 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-14T10:57:32.696 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-14T10:57:32.696 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-14T10:57:32.696 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-14T10:57:32.696 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-14T10:57:32.696 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-14T10:57:32.696 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-14T10:57:32.696 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-14T10:57:32.696 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-14T10:57:32.696 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-14T10:57:32.696 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-14T10:57:32.696 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-14T10:57:32.696 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-14T10:57:32.697 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-14T10:57:32.697 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-14T10:57:32.697 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-14T10:57:32.697 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-14T10:57:32.697 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-14T10:57:32.697 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-14T10:57:32.697 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-14T10:57:32.697 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-14T10:57:32.697 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-14T10:57:32.697 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-14T10:57:32.697 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-14T10:57:32.697 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-14T10:57:32.697 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-14T10:57:32.698 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-14T10:57:32.698 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-14T10:57:32.698 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-14T10:57:32.698 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-14T10:57:32.698 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-14T10:57:32.698 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-14T10:57:32.698 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-14T10:57:32.698 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-14T10:57:32.698 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-14T10:57:32.698 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-14T10:57:32.698 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-14T10:57:32.698 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-14T10:57:32.698 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-14T10:57:32.699 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-14T10:57:32.699 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-14T10:57:32.699 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-14T10:57:32.699 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-14T10:57:32.699 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-14T10:57:32.699 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-14T10:57:32.699 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-14T10:57:32.699 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-14T10:57:32.699 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-14T10:57:32.700 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-14T10:57:32.700 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-14T10:57:32.700 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-14T10:57:32.700 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-14T10:57:32.700 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-14T10:57:32.700 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-14T10:57:32.700 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-14T10:57:32.700 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-14T10:57:32.700 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-14T10:57:32.700 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-14T10:57:32.700 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-14T10:57:32.700 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-14T10:57:32.701 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-14T10:57:32.701 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-14T10:57:32.701 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-14T10:57:32.701 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-14T10:57:32.702 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-14T10:57:32.702 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-14T10:57:32.702 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-14T10:57:32.703 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-14T10:57:32.703 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-14T10:57:32.703 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-14T10:57:32.703 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-14T10:57:32.703 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-14T10:57:32.703 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-14T10:57:32.703 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-14T10:57:32.703 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-14T10:57:32.703 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-14T10:57:32.703 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-14T10:57:32.703 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-14T10:57:32.704 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-14T10:57:32.704 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-14T10:57:32.704 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-14T10:57:32.704 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-14T10:57:32.704 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-14T10:57:32.704 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-14T10:57:32.704 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-14T10:57:32.704 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-14T10:57:32.704 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-14T10:57:32.704 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-14T10:57:32.704 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-14T10:57:32.704 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-14T10:57:32.704 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-14T10:57:32.705 INFO:tasks.workunit.client.0.smithi097.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-14T10:57:32.705 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MARKER2_READDIR (2 ms) 2024-09-14T10:57:32.705 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T10:57:32.705 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T10:57:32.705 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T10:57:32.705 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T10:57:32.705 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T10:57:32.705 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T10:57:32.705 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T10:57:32.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:57:32.695+0000 7f273602f8c0 -1 shutting down 2024-09-14T10:57:32.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:57:32.697+0000 7f260b55a640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 69552, si_uid : 1000, si_addr0x3e800010fb0, si_status0 2024-09-14T10:58:02.951 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.SHUTDOWN (30257 ms) 2024-09-14T10:58:02.951 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 11 tests from LibRGW (30867 ms total) 2024-09-14T10:58:02.951 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-14T10:58:02.951 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-14T10:58:02.951 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 11 tests from 1 test suite ran. (30867 ms total) 2024-09-14T10:58:02.951 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 11 tests. 2024-09-14T10:58:02.957 INFO:tasks.workunit.client.0.smithi097.stdout:phase 5.1 2024-09-14T10:58:02.991 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-14T10:58:02.991 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-14T10:58:02.991 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 19 tests from LibRGW 2024-09-14T10:58:02.991 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.INIT 2024-09-14T10:58:03.001 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:58:03.001 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:58:03.385 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.INIT (395 ms) 2024-09-14T10:58:03.385 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T10:58:03.386 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T10:58:03.386 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T10:58:03.397 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.CREATE_BUCKET (11 ms) 2024-09-14T10:58:03.397 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T10:58:03.401 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (4 ms) 2024-09-14T10:58:03.401 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-14T10:58:03.402 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-14T10:58:03.402 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T10:58:03.404 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-09-14T10:58:03.404 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-14T10:58:03.404 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-14T10:58:03.404 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-14T10:58:03.408 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.PUT_OBJECT (5 ms) 2024-09-14T10:58:03.408 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-14T10:58:03.410 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.GET_OBJECT (1 ms) 2024-09-14T10:58:03.410 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T10:58:03.410 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T10:58:03.410 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-14T10:58:03.410 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-14T10:58:03.410 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.WRITEV 2024-09-14T10:58:03.410 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-14T10:58:03.410 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.READV 2024-09-14T10:58:03.410 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-14T10:58:03.410 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-14T10:58:03.411 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-14T10:58:03.411 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T10:58:03.411 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-14T10:58:03.411 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T10:58:03.411 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-14T10:58:03.411 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T10:58:03.411 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T10:58:03.411 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T10:58:03.411 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T10:58:03.411 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T10:58:03.411 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:58:03.411+0000 7fb45951f8c0 -1 shutting down 2024-09-14T10:58:03.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:58:03.412+0000 7fb330ab2640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 70171, si_uid : 1000, si_addr0x3e80001121b, si_status0 2024-09-14T10:58:33.612 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.SHUTDOWN (30202 ms) 2024-09-14T10:58:33.612 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 19 tests from LibRGW (30621 ms total) 2024-09-14T10:58:33.612 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-14T10:58:33.612 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-14T10:58:33.612 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 19 tests from 1 test suite ran. (30621 ms total) 2024-09-14T10:58:33.612 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 19 tests. 2024-09-14T10:58:33.618 INFO:tasks.workunit.client.0.smithi097.stdout:phase 5.2 2024-09-14T10:58:33.650 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-14T10:58:33.650 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-14T10:58:33.650 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 19 tests from LibRGW 2024-09-14T10:58:33.650 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.INIT 2024-09-14T10:58:33.660 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:58:33.660 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:58:33.835 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.INIT (185 ms) 2024-09-14T10:58:33.835 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T10:58:33.836 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T10:58:33.836 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T10:58:33.836 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-14T10:58:33.836 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T10:58:33.841 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (5 ms) 2024-09-14T10:58:33.842 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-14T10:58:33.842 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-14T10:58:33.842 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T10:58:33.842 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-09-14T10:58:33.842 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-14T10:58:33.842 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-14T10:58:33.842 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-14T10:58:33.842 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-09-14T10:58:33.842 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-14T10:58:33.842 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-09-14T10:58:33.842 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T10:58:33.843 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T10:58:33.843 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-14T10:58:33.843 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-14T10:58:33.843 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.WRITEV 2024-09-14T10:58:33.843 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-14T10:58:33.843 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.READV 2024-09-14T10:58:33.843 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-14T10:58:33.843 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-14T10:58:33.843 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-14T10:58:33.843 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T10:58:33.846 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.DELETE_OBJECT (5 ms) 2024-09-14T10:58:33.846 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T10:58:33.873 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.DELETE_BUCKET (27 ms) 2024-09-14T10:58:33.874 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T10:58:33.874 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T10:58:33.874 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T10:58:33.874 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T10:58:33.874 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T10:58:33.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:58:33.875+0000 7f97950308c0 -1 shutting down 2024-09-14T10:58:33.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:58:33.876+0000 7f966a6e0640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 70790, si_uid : 1000, si_addr0x3e800011486, si_status0 2024-09-14T10:59:04.046 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.SHUTDOWN (30172 ms) 2024-09-14T10:59:04.046 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 19 tests from LibRGW (30395 ms total) 2024-09-14T10:59:04.046 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-14T10:59:04.046 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-14T10:59:04.046 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 19 tests from 1 test suite ran. (30396 ms total) 2024-09-14T10:59:04.046 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 19 tests. 2024-09-14T10:59:04.052 INFO:tasks.workunit.client.0.smithi097.stdout:phase 6.1 2024-09-14T10:59:04.077 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-14T10:59:04.077 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment set-up. 2024-09-14T10:59:04.077 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 10 tests from LibRGW 2024-09-14T10:59:04.077 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.INIT 2024-09-14T10:59:04.084 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:59:04.084 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:59:04.713 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.INIT (636 ms) 2024-09-14T10:59:04.713 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T10:59:04.714 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-14T10:59:04.714 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.CREATE_BUCKETS 2024-09-14T10:59:04.730 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.CREATE_BUCKETS (16 ms) 2024-09-14T10:59:04.730 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.LOOKUP_BUCKETS 2024-09-14T10:59:04.737 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.LOOKUP_BUCKETS (6 ms) 2024-09-14T10:59:04.737 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.TOPDIR_RENAME 2024-09-14T10:59:04.754 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.TOPDIR_RENAME (18 ms) 2024-09-14T10:59:04.754 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.SUBDIR_RENAME 2024-09-14T10:59:04.777 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.SUBDIR_RENAME (21 ms) 2024-09-14T10:59:04.777 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.CROSS_BUCKET_RENAME 2024-09-14T10:59:04.797 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.CROSS_BUCKET_RENAME (21 ms) 2024-09-14T10:59:04.797 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T10:59:04.797 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T10:59:04.797 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T10:59:04.797 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T10:59:04.797 INFO:tasks.workunit.client.0.smithi097.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T10:59:04.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:04.798+0000 7f43f32538c0 -1 shutting down 2024-09-14T10:59:04.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:04.799+0000 7f42ccf90640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 71410, si_uid : 1000, si_addr0x3e8000116f2, si_status0 2024-09-14T10:59:34.721 INFO:tasks.workunit.client.0.smithi097.stdout:[ OK ] LibRGW.SHUTDOWN (29924 ms) 2024-09-14T10:59:34.721 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] 10 tests from LibRGW (30644 ms total) 2024-09-14T10:59:34.721 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-14T10:59:34.722 INFO:tasks.workunit.client.0.smithi097.stdout:[----------] Global test environment tear-down 2024-09-14T10:59:34.722 INFO:tasks.workunit.client.0.smithi097.stdout:[==========] 10 tests from 1 test suite ran. (30644 ms total) 2024-09-14T10:59:34.722 INFO:tasks.workunit.client.0.smithi097.stdout:[ PASSED ] 10 tests. 2024-09-14T10:59:34.728 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T10:59:34.729 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T10:59:34.771 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-09-14T10:59:34.773 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-09-14T10:59:34.773 DEBUG:teuthology.orchestra.run.smithi097:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-09-14T10:59:34.847 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' -z ']' 2024-09-14T10:59:34.847 INFO:tasks.workunit.client.0.smithi097.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-14T10:59:34.847 INFO:tasks.workunit.client.0.smithi097.stderr:+ AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-14T10:59:34.847 INFO:tasks.workunit.client.0.smithi097.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-14T10:59:34.847 INFO:tasks.workunit.client.0.smithi097.stderr:+ AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-14T10:59:34.847 INFO:tasks.workunit.client.0.smithi097.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name 'maven test user' --email sigv4@example.com 2024-09-14T10:59:34.885 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:59:34.885 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:59:34.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:34.925+0000 7fc8ba922800 20 rados->read ofs=0 len=0 2024-09-14T10:59:34.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:34.926+0000 7fc8ba922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:34.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:34.926+0000 7fc8ba922800 20 realm 2024-09-14T10:59:34.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:34.926+0000 7fc8ba922800 20 rados->read ofs=0 len=0 2024-09-14T10:59:34.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:34.927+0000 7fc8ba922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:34.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:34.927+0000 7fc8ba922800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:59:34.926 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:34.927+0000 7fc8ba922800 20 rados->read ofs=0 len=0 2024-09-14T10:59:34.926 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:34.927+0000 7fc8ba922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:34.926 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:34.927+0000 7fc8ba922800 20 rados->read ofs=0 len=0 2024-09-14T10:59:34.926 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:34.928+0000 7fc8ba922800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:59:34.926 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:34.928+0000 7fc8ba922800 20 rados->read ofs=0 len=0 2024-09-14T10:59:34.927 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:34.929+0000 7fc8ba922800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:59:34.927 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:34.929+0000 7fc8ba922800 20 searching for the correct realm 2024-09-14T10:59:34.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:34.931+0000 7fc8b6e69640 0 -- 172.21.15.97:0/882868967 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7fc8ac05b040 msgr2=0x7fc8ac048990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:59:35.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.137+0000 7fc8b5e67640 0 -- 172.21.15.97:0/882868967 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7fc8a807f490 msgr2=0x7fc8a808d400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:59:35.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.142+0000 7fc8ba922800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:59:35.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.142+0000 7fc8ba922800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:59:35.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.142+0000 7fc8ba922800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T10:59:35.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.142+0000 7fc8ba922800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T10:59:35.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.142+0000 7fc8ba922800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:59:35.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.142+0000 7fc8ba922800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:59:35.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.142+0000 7fc8ba922800 20 rados->read ofs=0 len=0 2024-09-14T10:59:35.142 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.143+0000 7fc8ba922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:35.142 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.143+0000 7fc8ba922800 20 rados->read ofs=0 len=0 2024-09-14T10:59:35.143 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.143+0000 7fc8ba922800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:59:35.143 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.143+0000 7fc8ba922800 20 rados->read ofs=0 len=0 2024-09-14T10:59:35.143 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.143+0000 7fc8ba922800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:59:35.143 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.143+0000 7fc8ba922800 20 zone default found 2024-09-14T10:59:35.143 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.143+0000 7fc8ba922800 4 Realm: () 2024-09-14T10:59:35.143 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.143+0000 7fc8ba922800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T10:59:35.143 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.143+0000 7fc8ba922800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T10:59:35.143 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.143+0000 7fc8ba922800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:59:35.143 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.143+0000 7fc8ba922800 20 zonegroup default 2024-09-14T10:59:35.144 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.143+0000 7fc8ba922800 20 rados->read ofs=0 len=0 2024-09-14T10:59:35.144 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.144+0000 7fc8ba922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:35.144 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.144+0000 7fc8ba922800 20 rados->read ofs=0 len=0 2024-09-14T10:59:35.144 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.144+0000 7fc8ba922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:35.144 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.144+0000 7fc8ba922800 20 rados->read ofs=0 len=0 2024-09-14T10:59:35.144 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.144+0000 7fc8ba922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:35.144 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.144+0000 7fc8ba922800 20 started sync module instance, tier type = 2024-09-14T10:59:35.144 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.144+0000 7fc8ba922800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T10:59:35.152 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.154+0000 7fc8ba922800 20 add_watcher() i=0 2024-09-14T10:59:35.152 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.154+0000 7fc8ba922800 20 add_watcher() i=1 2024-09-14T10:59:35.152 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.154+0000 7fc8ba922800 20 add_watcher() i=2 2024-09-14T10:59:35.152 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.154+0000 7fc8ba922800 20 add_watcher() i=3 2024-09-14T10:59:35.152 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.154+0000 7fc8ba922800 20 add_watcher() i=4 2024-09-14T10:59:35.152 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.154+0000 7fc8ba922800 20 add_watcher() i=5 2024-09-14T10:59:35.152 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.154+0000 7fc8ba922800 20 add_watcher() i=6 2024-09-14T10:59:35.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.155+0000 7fc8ba922800 20 add_watcher() i=7 2024-09-14T10:59:35.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.155+0000 7fc8ba922800 2 all 8 watchers are set, enabling cache 2024-09-14T10:59:35.155 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.157+0000 7fc76cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:59:35.156 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.157+0000 7fc8ba922800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:59:35.156 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.157+0000 7fc8ba922800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:59:35.156 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.157+0000 7fc8ba922800 5 note: GC not initialized 2024-09-14T10:59:35.156 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.157+0000 7fc6e77fe640 20 reqs_thread_entry: start 2024-09-14T10:59:35.156 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.157+0000 7fc8ba922800 20 init_complete bucket index max shards: 11 2024-09-14T10:59:35.156 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.157+0000 7fc8ba922800 20 Filter name: none 2024-09-14T10:59:35.156 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.157+0000 7fc6e57fa640 20 reqs_thread_entry: start 2024-09-14T10:59:35.156 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.157+0000 7fc8ba922800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-09-14T10:59:35.156 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.157+0000 7fc8ba922800 20 rados->read ofs=0 len=0 2024-09-14T10:59:35.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.158+0000 7fc8ba922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:35.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.158+0000 7fc8ba922800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-09-14T10:59:35.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.158+0000 7fc8ba922800 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-14T10:59:35.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.158+0000 7fc8ba922800 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-09-14T10:59:35.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.158+0000 7fc8ba922800 20 rados->read ofs=0 len=0 2024-09-14T10:59:35.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.158+0000 7fc8ba922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:35.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.158+0000 7fc8ba922800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-09-14T10:59:35.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.158+0000 7fc8ba922800 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-14T10:59:35.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.158+0000 7fc8ba922800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-09-14T10:59:35.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.158+0000 7fc8ba922800 20 rados->read ofs=0 len=0 2024-09-14T10:59:35.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.158+0000 7fc8ba922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:35.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.158+0000 7fc8ba922800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-09-14T10:59:35.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.158+0000 7fc8ba922800 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-14T10:59:35.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.159+0000 7fc8ba922800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-14T10:59:35.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.159+0000 7fc8ba922800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-14T10:59:35.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.160+0000 7fc8ba922800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-14T10:59:35.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.160+0000 7fc8ba922800 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-14T10:59:35.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.160+0000 7fc8ba922800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-09-14T10:59:35.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.160+0000 7fc799ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1065151889474 cookie 94692154221024 notifier 5543 bl.length()=677 2024-09-14T10:59:35.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.160+0000 7fc799ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-14T10:59:35.160 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.160+0000 7fc799ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-14T10:59:35.160 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.162+0000 7fc8ba922800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-14T10:59:35.160 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.162+0000 7fc8ba922800 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-14T10:59:35.160 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.162+0000 7fc8ba922800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-09-14T10:59:35.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.162+0000 7fc799ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1065151889415 cookie 94692154207984 notifier 5543 bl.length()=187 2024-09-14T10:59:35.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.162+0000 7fc799ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-14T10:59:35.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.162+0000 7fc799ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-14T10:59:35.162 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.164+0000 7fc8ba922800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-14T10:59:35.162 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.164+0000 7fc8ba922800 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-14T10:59:35.162 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.164+0000 7fc8ba922800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-09-14T10:59:35.162 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.164+0000 7fc799ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1065151889416 cookie 94692154207984 notifier 5543 bl.length()=197 2024-09-14T10:59:35.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.164+0000 7fc799ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-14T10:59:35.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.164+0000 7fc799ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-14T10:59:35.163 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T10:59:35.163 INFO:tasks.workunit.client.0.smithi097.stdout: "user_id": "ceph-test-maven", 2024-09-14T10:59:35.163 INFO:tasks.workunit.client.0.smithi097.stdout: "display_name": "maven test user", 2024-09-14T10:59:35.163 INFO:tasks.workunit.client.0.smithi097.stdout: "email": "sigv4@example.com", 2024-09-14T10:59:35.163 INFO:tasks.workunit.client.0.smithi097.stdout: "suspended": 0, 2024-09-14T10:59:35.163 INFO:tasks.workunit.client.0.smithi097.stdout: "max_buckets": 1000, 2024-09-14T10:59:35.163 INFO:tasks.workunit.client.0.smithi097.stdout: "subusers": [], 2024-09-14T10:59:35.164 INFO:tasks.workunit.client.0.smithi097.stdout: "keys": [ 2024-09-14T10:59:35.164 INFO:tasks.workunit.client.0.smithi097.stdout: { 2024-09-14T10:59:35.164 INFO:tasks.workunit.client.0.smithi097.stdout: "user": "ceph-test-maven", 2024-09-14T10:59:35.164 INFO:tasks.workunit.client.0.smithi097.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-09-14T10:59:35.164 INFO:tasks.workunit.client.0.smithi097.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-09-14T10:59:35.164 INFO:tasks.workunit.client.0.smithi097.stdout: "active": true, 2024-09-14T10:59:35.164 INFO:tasks.workunit.client.0.smithi097.stdout: "create_date": "2024-09-14T10:59:35.159918Z" 2024-09-14T10:59:35.164 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T10:59:35.164 INFO:tasks.workunit.client.0.smithi097.stdout: ], 2024-09-14T10:59:35.164 INFO:tasks.workunit.client.0.smithi097.stdout: "swift_keys": [], 2024-09-14T10:59:35.164 INFO:tasks.workunit.client.0.smithi097.stdout: "caps": [], 2024-09-14T10:59:35.164 INFO:tasks.workunit.client.0.smithi097.stdout: "op_mask": "read, write, delete", 2024-09-14T10:59:35.164 INFO:tasks.workunit.client.0.smithi097.stdout: "default_placement": "", 2024-09-14T10:59:35.165 INFO:tasks.workunit.client.0.smithi097.stdout: "default_storage_class": "", 2024-09-14T10:59:35.165 INFO:tasks.workunit.client.0.smithi097.stdout: "placement_tags": [], 2024-09-14T10:59:35.165 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_quota": { 2024-09-14T10:59:35.165 INFO:tasks.workunit.client.0.smithi097.stdout: "enabled": false, 2024-09-14T10:59:35.165 INFO:tasks.workunit.client.0.smithi097.stdout: "check_on_raw": false, 2024-09-14T10:59:35.165 INFO:tasks.workunit.client.0.smithi097.stdout: "max_size": -1, 2024-09-14T10:59:35.165 INFO:tasks.workunit.client.0.smithi097.stdout: "max_size_kb": 0, 2024-09-14T10:59:35.165 INFO:tasks.workunit.client.0.smithi097.stdout: "max_objects": -1 2024-09-14T10:59:35.165 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:59:35.165 INFO:tasks.workunit.client.0.smithi097.stdout: "user_quota": { 2024-09-14T10:59:35.165 INFO:tasks.workunit.client.0.smithi097.stdout: "enabled": false, 2024-09-14T10:59:35.165 INFO:tasks.workunit.client.0.smithi097.stdout: "check_on_raw": false, 2024-09-14T10:59:35.165 INFO:tasks.workunit.client.0.smithi097.stdout: "max_size": -1, 2024-09-14T10:59:35.165 INFO:tasks.workunit.client.0.smithi097.stdout: "max_size_kb": 0, 2024-09-14T10:59:35.165 INFO:tasks.workunit.client.0.smithi097.stdout: "max_objects": -1 2024-09-14T10:59:35.166 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T10:59:35.166 INFO:tasks.workunit.client.0.smithi097.stdout: "temp_url_keys": [], 2024-09-14T10:59:35.166 INFO:tasks.workunit.client.0.smithi097.stdout: "type": "rgw", 2024-09-14T10:59:35.166 INFO:tasks.workunit.client.0.smithi097.stdout: "mfa_ids": [], 2024-09-14T10:59:35.166 INFO:tasks.workunit.client.0.smithi097.stdout: "account_id": "", 2024-09-14T10:59:35.166 INFO:tasks.workunit.client.0.smithi097.stdout: "path": "/", 2024-09-14T10:59:35.166 INFO:tasks.workunit.client.0.smithi097.stdout: "create_date": "2024-09-14T10:59:35.159898Z", 2024-09-14T10:59:35.166 INFO:tasks.workunit.client.0.smithi097.stdout: "tags": [], 2024-09-14T10:59:35.166 INFO:tasks.workunit.client.0.smithi097.stdout: "group_ids": [] 2024-09-14T10:59:35.166 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T10:59:35.166 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-14T10:59:35.167 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.165+0000 7fc76cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:59:35.167 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.167+0000 7fc8ba922800 20 remove_watcher() i=0 2024-09-14T10:59:35.167 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.167+0000 7fc8ba922800 2 removed watcher, disabling cache 2024-09-14T10:59:35.167 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.169+0000 7fc8ba922800 20 remove_watcher() i=1 2024-09-14T10:59:35.168 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.170+0000 7fc8ba922800 20 remove_watcher() i=2 2024-09-14T10:59:35.169 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.171+0000 7fc8ba922800 20 remove_watcher() i=3 2024-09-14T10:59:35.170 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.172+0000 7fc8ba922800 20 remove_watcher() i=4 2024-09-14T10:59:35.171 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.173+0000 7fc8ba922800 20 remove_watcher() i=5 2024-09-14T10:59:35.172 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.174+0000 7fc8ba922800 20 remove_watcher() i=6 2024-09-14T10:59:35.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T10:59:35.175+0000 7fc8ba922800 20 remove_watcher() i=7 2024-09-14T10:59:35.184 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' -z ']' 2024-09-14T10:59:35.184 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' -z /home/ubuntu/cephtest ']' 2024-09-14T10:59:35.184 INFO:tasks.workunit.client.0.smithi097.stderr:++ cat /home/ubuntu/cephtest/url_file 2024-09-14T10:59:35.185 INFO:tasks.workunit.client.0.smithi097.stderr:+ export RGW_HTTP_ENDPOINT_URL=http://smithi097.front.sepia.ceph.com:80 2024-09-14T10:59:35.186 INFO:tasks.workunit.client.0.smithi097.stderr:+ RGW_HTTP_ENDPOINT_URL=http://smithi097.front.sepia.ceph.com:80 2024-09-14T10:59:35.186 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' -z /home/ubuntu/cephtest/clone.client.0 ']' 2024-09-14T10:59:35.186 INFO:tasks.workunit.client.0.smithi097.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-09-14T10:59:35.186 INFO:tasks.workunit.client.0.smithi097.stderr:+ ./mvnw clean package 2024-09-14T10:59:35.201 INFO:tasks.workunit.client.0.smithi097.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-14T10:59:36.757 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] Scanning for projects... 2024-09-14T10:59:36.866 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-09-14T10:59:36.945 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 69 kB/s) 2024-09-14T10:59:36.956 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-09-14T10:59:36.996 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/83 kB Progress (1): 33/83 kB Progress (1): 49/83 kB Progress (1): 66/83 kB Progress (1): 82/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 2.1 MB/s) 2024-09-14T10:59:37.007 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-09-14T10:59:37.027 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/77 kB Progress (1): 33/77 kB Progress (1): 49/77 kB Progress (1): 66/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 3.7 MB/s) 2024-09-14T10:59:37.058 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] 2024-09-14T10:59:37.058 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-14T10:59:37.058 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] Building jcksum 1.0 2024-09-14T10:59:37.059 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] from pom.xml 2024-09-14T10:59:37.059 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-14T10:59:37.062 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-09-14T10:59:37.078 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 332 kB/s) 2024-09-14T10:59:37.084 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-09-14T10:59:37.100 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 660 kB/s) 2024-09-14T10:59:37.104 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-09-14T10:59:37.121 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 2.7 MB/s) 2024-09-14T10:59:37.128 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-09-14T10:59:37.143 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.3 MB/s) 2024-09-14T10:59:37.157 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-09-14T10:59:37.173 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 2.2 MB/s) 2024-09-14T10:59:37.179 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-09-14T10:59:37.195 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 544 kB/s) 2024-09-14T10:59:37.197 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-09-14T10:59:37.212 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 539 kB/s) 2024-09-14T10:59:37.214 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-09-14T10:59:37.232 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/48 kB Progress (1): 33/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 3.0 MB/s) 2024-09-14T10:59:37.236 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-09-14T10:59:37.252 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 1.4 MB/s) 2024-09-14T10:59:37.259 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-09-14T10:59:37.276 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 1.8 MB/s) 2024-09-14T10:59:37.281 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-09-14T10:59:37.296 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 613 kB/s) 2024-09-14T10:59:37.302 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-09-14T10:59:37.319 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/66 kB Progress (1): 33/66 kB Progress (1): 49/66 kB Progress (1): 66/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 3.9 MB/s) 2024-09-14T10:59:37.325 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-09-14T10:59:37.341 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 332 kB/s) 2024-09-14T10:59:37.344 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-09-14T10:59:37.358 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.5 MB/s) 2024-09-14T10:59:37.362 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-09-14T10:59:37.378 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/50 kB Progress (1): 33/50 kB Progress (1): 49/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 3.1 MB/s) 2024-09-14T10:59:37.383 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-09-14T10:59:37.399 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.6 MB/s) 2024-09-14T10:59:37.406 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-09-14T10:59:37.421 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 402 kB/s) 2024-09-14T10:59:37.424 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-09-14T10:59:37.440 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 2.8 MB/s) 2024-09-14T10:59:37.448 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-09-14T10:59:37.462 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 451 kB/s) 2024-09-14T10:59:37.465 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-09-14T10:59:37.481 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 660 kB/s) 2024-09-14T10:59:37.484 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-09-14T10:59:37.501 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/46 kB Progress (1): 33/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 2.9 MB/s) 2024-09-14T10:59:37.504 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-09-14T10:59:37.522 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.5 MB/s) 2024-09-14T10:59:37.525 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-09-14T10:59:37.541 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.7 MB/s) 2024-09-14T10:59:37.555 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-09-14T10:59:37.570 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 406 kB/s) 2024-09-14T10:59:37.572 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-09-14T10:59:37.587 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 1.5 MB/s) 2024-09-14T10:59:37.590 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-09-14T10:59:37.606 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.3 MB/s) 2024-09-14T10:59:37.614 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-09-14T10:59:37.631 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 222 kB/s) 2024-09-14T10:59:37.634 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-09-14T10:59:37.649 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 97 kB/s) 2024-09-14T10:59:37.652 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-09-14T10:59:37.667 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 149 kB/s) 2024-09-14T10:59:37.673 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-09-14T10:59:37.687 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 243 kB/s) 2024-09-14T10:59:37.693 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-09-14T10:59:37.709 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 215 kB/s) 2024-09-14T10:59:37.715 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-09-14T10:59:37.730 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 685 kB/s) 2024-09-14T10:59:37.737 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-09-14T10:59:37.753 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 112 kB/s) 2024-09-14T10:59:37.758 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-09-14T10:59:37.773 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 239 kB/s) 2024-09-14T10:59:37.778 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-09-14T10:59:37.793 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 327 kB/s) 2024-09-14T10:59:37.797 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-09-14T10:59:37.811 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 77 kB/s) 2024-09-14T10:59:37.813 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-09-14T10:59:37.827 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 274 kB/s) 2024-09-14T10:59:37.829 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-09-14T10:59:37.844 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 920 kB/s) 2024-09-14T10:59:37.847 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-09-14T10:59:37.861 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 245 kB/s) 2024-09-14T10:59:37.866 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-09-14T10:59:37.881 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 163 kB/s) 2024-09-14T10:59:37.884 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-09-14T10:59:37.899 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 208 kB/s) 2024-09-14T10:59:37.902 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-09-14T10:59:37.917 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 494 kB/s) 2024-09-14T10:59:37.921 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-09-14T10:59:37.937 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 390 kB/s) 2024-09-14T10:59:37.940 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-09-14T10:59:37.954 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 249 kB/s) 2024-09-14T10:59:37.958 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-09-14T10:59:37.974 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 275 kB/s) 2024-09-14T10:59:37.976 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-09-14T10:59:37.990 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 161 kB/s) 2024-09-14T10:59:37.994 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-09-14T10:59:38.008 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 429 kB/s) 2024-09-14T10:59:38.012 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-09-14T10:59:38.027 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 404 kB/s) 2024-09-14T10:59:38.031 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-09-14T10:59:38.045 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 198 kB/s) 2024-09-14T10:59:38.049 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-09-14T10:59:38.063 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 232 kB/s) 2024-09-14T10:59:38.067 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-09-14T10:59:38.082 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 272 kB/s) 2024-09-14T10:59:38.083 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-09-14T10:59:38.098 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 127 kB/s) 2024-09-14T10:59:38.101 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-09-14T10:59:38.116 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 441 kB/s) 2024-09-14T10:59:38.119 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-09-14T10:59:38.136 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 2.7/16 kB Progress (1): 8.2/16 kB Progress (1): 15/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 964 kB/s) 2024-09-14T10:59:38.138 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-09-14T10:59:38.157 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/35 kB Progress (1): 32/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 1.8 MB/s) 2024-09-14T10:59:38.161 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-09-14T10:59:38.174 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 1.2 MB/s) 2024-09-14T10:59:38.178 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-09-14T10:59:38.192 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 355 kB/s) 2024-09-14T10:59:38.194 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-09-14T10:59:38.208 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 940 kB/s) 2024-09-14T10:59:38.212 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-09-14T10:59:38.226 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 931 kB/s) 2024-09-14T10:59:38.229 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-09-14T10:59:38.244 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/68 kB Progress (1): 33/68 kB Progress (1): 49/68 kB Progress (1): 66/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 4.2 MB/s) 2024-09-14T10:59:38.250 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-09-14T10:59:38.264 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 1.1 MB/s) 2024-09-14T10:59:38.268 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-09-14T10:59:38.283 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 1.0 MB/s) 2024-09-14T10:59:38.284 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-09-14T10:59:38.300 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/79 kB Progress (1): 33/79 kB Progress (1): 49/79 kB Progress (1): 66/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 5.0 MB/s) 2024-09-14T10:59:38.304 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-09-14T10:59:38.318 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 1.3 MB/s) 2024-09-14T10:59:38.323 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-09-14T10:59:38.338 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 1.3 MB/s) 2024-09-14T10:59:38.340 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-09-14T10:59:38.357 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/78 kB Progress (1): 32/78 kB Progress (1): 49/78 kB Progress (1): 65/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 4.6 MB/s) 2024-09-14T10:59:38.364 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-09-14T10:59:38.378 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 274 kB/s) 2024-09-14T10:59:38.381 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-09-14T10:59:38.395 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 920 kB/s) 2024-09-14T10:59:38.398 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-09-14T10:59:38.412 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 229 kB/s) 2024-09-14T10:59:38.414 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-09-14T10:59:38.428 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 227 kB/s) 2024-09-14T10:59:38.431 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-09-14T10:59:38.445 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 145 kB/s) 2024-09-14T10:59:38.447 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-09-14T10:59:38.461 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 202 kB/s) 2024-09-14T10:59:38.463 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-09-14T10:59:38.477 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 109 kB/s) 2024-09-14T10:59:38.479 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-09-14T10:59:38.493 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 215 kB/s) 2024-09-14T10:59:38.495 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-09-14T10:59:38.510 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 229 kB/s) 2024-09-14T10:59:38.511 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-09-14T10:59:38.525 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 229 kB/s) 2024-09-14T10:59:38.528 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-09-14T10:59:38.542 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 73 kB/s) 2024-09-14T10:59:38.545 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-09-14T10:59:38.559 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 69 kB/s) 2024-09-14T10:59:38.562 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-09-14T10:59:38.576 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 218 kB/s) 2024-09-14T10:59:38.578 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-09-14T10:59:38.592 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 217 kB/s) 2024-09-14T10:59:38.594 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-09-14T10:59:38.608 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 246 kB/s) 2024-09-14T10:59:38.610 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-09-14T10:59:38.625 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 245 kB/s) 2024-09-14T10:59:38.627 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-09-14T10:59:38.641 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 202 kB/s) 2024-09-14T10:59:38.657 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-09-14T10:59:38.739 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 40 MB/s) 2024-09-14T10:59:38.741 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-09-14T10:59:38.741 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-09-14T10:59:38.741 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-09-14T10:59:38.741 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-09-14T10:59:38.741 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-09-14T10:59:38.759 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/98 kB Progress (1): 32/98 kB Progress (1): 49/98 kB Progress (1): 65/98 kB Progress (1): 81/98 kB Progress (1): 98/98 kB Progress (1): 98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 5.2 MB/s) 2024-09-14T10:59:38.759 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-09-14T10:59:38.773 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 517 kB/s) 2024-09-14T10:59:38.773 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-09-14T10:59:38.792 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.4/35 kB Progress (2): 1.4/35 kB | 1.4/16 kB Progress (2): 2.8/35 kB | 1.4/16 kB Progress (3): 2.8/35 kB | 1.4/16 kB | 1.4/49 kB Progress (3): 4.1/35 kB | 1.4/16 kB | 1.4/49 kB Progress (3): 4.1/35 kB | 2.8/16 kB | 1.4/49 kB Progress (3): 5.5/35 kB | 2.8/16 kB | 1.4/49 kB Progress (3): 5.5/35 kB | 2.8/16 kB | 2.8/49 kB Progress (3): 6.9/35 kB | 2.8/16 kB | 2.8/49 kB Progress (3): 6.9/35 kB | 4.1/16 kB | 2.8/49 kB Progress (3): 6.9/35 kB | 4.1/16 kB | 4.1/49 kB Progress (3): 6.9/35 kB | 5.5/16 kB | 4.1/49 kB Progress (3): 8.3/35 kB | 5.5/16 kB | 4.1/49 kB Progress (3): 8.3/35 kB | 6.9/16 kB | 4.1/49 kB Progress (3): 8.3/35 kB | 6.9/16 kB | 5.5/49 kB Progress (3): 8.3/35 kB | 8.3/16 kB | 5.5/49 kB Progress (3): 9.7/35 kB | 8.3/16 kB | 5.5/49 kB Progress (3): 9.7/35 kB | 8.3/16 kB | 6.9/49 kB Progress (3): 9.7/35 kB | 9.7/16 kB | 6.9/49 kB Progress (4): 9.7/35 kB | 9.7/16 kB | 6.9/49 kB | 16/71 kB Progress (4): 11/35 kB | 9.7/16 kB | 6.9/49 kB | 16/71 kB Progress (4): 11/35 kB | 11/16 kB | 6.9/49 kB | 16/71 kB Progress (4): 11/35 kB | 11/16 kB | 8.3/49 kB | 16/71 kB Progress (4): 11/35 kB | 12/16 kB | 8.3/49 kB | 16/71 kB Progress (4): 12/35 kB | 12/16 kB | 8.3/49 kB | 16/71 kB Progress (4): 12/35 kB | 12/16 kB | 9.7/49 kB | 16/71 kB Progress (4): 12/35 kB | 14/16 kB | 9.7/49 kB | 16/71 kB Progress (4): 14/35 kB | 14/16 kB | 9.7/49 kB | 16/71 kB Progress (4): 14/35 kB | 15/16 kB | 9.7/49 kB | 16/71 kB Progress (4): 14/35 kB | 15/16 kB | 11/49 kB | 16/71 kB Progress (4): 14/35 kB | 16 kB | 11/49 kB | 16/71 kB Progress (4): 15/35 kB | 16 kB | 11/49 kB | 16/71 kB Progress (4): 15/35 kB | 16 kB | 12/49 kB | 16/71 kB Progress (4): 17/35 kB | 16 kB | 12/49 kB | 16/71 kB Progress (4): 17/35 kB | 16 kB | 14/49 kB | 16/71 kB Progress (4): 18/35 kB | 16 kB | 14/49 kB | 16/71 kB Progress (4): 18/35 kB | 16 kB | 15/49 kB | 16/71 kB Progress (4): 19/35 kB | 16 kB | 15/49 kB | 16/71 kB Progress (4): 19/35 kB | 16 kB | 17/49 kB | 16/71 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 336 kB/s) 2024-09-14T10:59:38.792 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (3): 21/35 kB | 17/49 kB | 16/71 kB Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-09-14T10:59:38.805 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (3): 22/35 kB | 17/49 kB | 16/71 kB Progress (3): 22/35 kB | 18/49 kB | 16/71 kB Progress (3): 23/35 kB | 18/49 kB | 16/71 kB Progress (4): 23/35 kB | 18/49 kB | 16/71 kB | 16/782 kB Progress (4): 25/35 kB | 18/49 kB | 16/71 kB | 16/782 kB Progress (4): 25/35 kB | 19/49 kB | 16/71 kB | 16/782 kB Progress (4): 26/35 kB | 19/49 kB | 16/71 kB | 16/782 kB Progress (4): 26/35 kB | 21/49 kB | 16/71 kB | 16/782 kB Progress (4): 26/35 kB | 21/49 kB | 16/71 kB | 33/782 kB Progress (4): 28/35 kB | 21/49 kB | 16/71 kB | 33/782 kB Progress (4): 28/35 kB | 22/49 kB | 16/71 kB | 33/782 kB Progress (4): 29/35 kB | 22/49 kB | 16/71 kB | 33/782 kB Progress (4): 29/35 kB | 22/49 kB | 16/71 kB | 49/782 kB Progress (4): 30/35 kB | 22/49 kB | 16/71 kB | 49/782 kB Progress (4): 30/35 kB | 23/49 kB | 16/71 kB | 49/782 kB Progress (4): 30/35 kB | 23/49 kB | 16/71 kB | 66/782 kB Progress (4): 30/35 kB | 25/49 kB | 16/71 kB | 66/782 kB Progress (4): 30/35 kB | 26/49 kB | 16/71 kB | 66/782 kB Progress (4): 30/35 kB | 26/49 kB | 16/71 kB | 82/782 kB Progress (4): 30/35 kB | 28/49 kB | 16/71 kB | 82/782 kB Progress (4): 30/35 kB | 29/49 kB | 16/71 kB | 82/782 kB Progress (4): 30/35 kB | 29/49 kB | 16/71 kB | 98/782 kB Progress (4): 30/35 kB | 30/49 kB | 16/71 kB | 98/782 kB Progress (4): 30/35 kB | 30/49 kB | 16/71 kB | 115/782 kB Progress (4): 30/35 kB | 30/49 kB | 16/71 kB | 131/782 kB Progress (4): 30/35 kB | 30/49 kB | 16/71 kB | 147/782 kB Progress (4): 30/35 kB | 30/49 kB | 16/71 kB | 164/782 kB Progress (4): 30/35 kB | 30/49 kB | 16/71 kB | 180/782 kB Progress (4): 30/35 kB | 30/49 kB | 16/71 kB | 197/782 kB Progress (4): 30/35 kB | 30/49 kB | 16/71 kB | 213/782 kB Progress (4): 30/35 kB | 30/49 kB | 16/71 kB | 229/782 kB Progress (4): 30/35 kB | 30/49 kB | 16/71 kB | 246/782 kB Progress (4): 30/35 kB | 30/49 kB | 16/71 kB | 262/782 kB Progress (4): 30/35 kB | 30/49 kB | 16/71 kB | 279/782 kB Progress (4): 30/35 kB | 30/49 kB | 16/71 kB | 295/782 kB Progress (4): 30/35 kB | 30/49 kB | 16/71 kB | 311/782 kB Progress (4): 30/35 kB | 30/49 kB | 16/71 kB | 328/782 kB Progress (4): 30/35 kB | 30/49 kB | 16/71 kB | 344/782 kB Progress (4): 30/35 kB | 30/49 kB | 16/71 kB | 360/782 kB Progress (4): 32/35 kB | 30/49 kB | 16/71 kB | 360/782 kB Progress (4): 32/35 kB | 32/49 kB | 16/71 kB | 360/782 kB Progress (4): 33/35 kB | 32/49 kB | 16/71 kB | 360/782 kB Progress (4): 33/35 kB | 33/49 kB | 16/71 kB | 360/782 kB Progress (4): 34/35 kB | 33/49 kB | 16/71 kB | 360/782 kB Progress (4): 34/35 kB | 34/49 kB | 16/71 kB | 360/782 kB Progress (4): 34/35 kB | 34/49 kB | 16/71 kB | 377/782 kB Progress (4): 35 kB | 34/49 kB | 16/71 kB | 377/782 kB Progress (4): 35 kB | 36/49 kB | 16/71 kB | 377/782 kB Progress (4): 35 kB | 36/49 kB | 33/71 kB | 377/782 kB Progress (4): 35 kB | 37/49 kB | 33/71 kB | 377/782 kB Progress (4): 35 kB | 37/49 kB | 33/71 kB | 393/782 kB Progress (4): 35 kB | 39/49 kB | 33/71 kB | 393/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 628 kB/s) 2024-09-14T10:59:38.805 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (3): 40/49 kB | 33/71 kB | 393/782 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-09-14T10:59:38.806 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (3): 40/49 kB | 33/71 kB | 410/782 kB Progress (3): 41/49 kB | 33/71 kB | 410/782 kB Progress (3): 43/49 kB | 33/71 kB | 410/782 kB Progress (3): 44/49 kB | 33/71 kB | 410/782 kB Progress (3): 46/49 kB | 33/71 kB | 410/782 kB Progress (3): 46/49 kB | 33/71 kB | 426/782 kB Progress (3): 46/49 kB | 33/71 kB | 442/782 kB Progress (3): 46/49 kB | 49/71 kB | 442/782 kB Progress (3): 46/49 kB | 49/71 kB | 459/782 kB Progress (3): 46/49 kB | 49/71 kB | 475/782 kB Progress (3): 47/49 kB | 49/71 kB | 475/782 kB Progress (3): 48/49 kB | 49/71 kB | 475/782 kB Progress (3): 49 kB | 49/71 kB | 475/782 kB Progress (3): 49 kB | 49/71 kB | 492/782 kB Progress (3): 49 kB | 49/71 kB | 508/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 849 kB/s) 2024-09-14T10:59:38.806 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-09-14T10:59:38.806 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 49/71 kB | 524/782 kB Progress (2): 49/71 kB | 541/782 kB Progress (2): 49/71 kB | 557/782 kB Progress (2): 49/71 kB | 573/782 kB Progress (2): 49/71 kB | 585/782 kB Progress (2): 49/71 kB | 601/782 kB Progress (3): 49/71 kB | 601/782 kB | 1.4/11 kB Progress (3): 49/71 kB | 601/782 kB | 2.8/11 kB Progress (3): 49/71 kB | 601/782 kB | 4.1/11 kB Progress (3): 49/71 kB | 617/782 kB | 4.1/11 kB Progress (3): 49/71 kB | 617/782 kB | 5.5/11 kB Progress (3): 49/71 kB | 617/782 kB | 6.9/11 kB Progress (3): 49/71 kB | 617/782 kB | 8.3/11 kB Progress (3): 49/71 kB | 634/782 kB | 8.3/11 kB Progress (3): 49/71 kB | 634/782 kB | 9.7/11 kB Progress (3): 49/71 kB | 650/782 kB | 9.7/11 kB Progress (3): 49/71 kB | 667/782 kB | 9.7/11 kB Progress (3): 49/71 kB | 683/782 kB | 9.7/11 kB Progress (3): 49/71 kB | 683/782 kB | 11/11 kB Progress (3): 49/71 kB | 683/782 kB | 11 kB Progress (3): 49/71 kB | 699/782 kB | 11 kB Progress (3): 49/71 kB | 716/782 kB | 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 183 kB/s) 2024-09-14T10:59:38.806 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-09-14T10:59:38.806 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 49/71 kB | 732/782 kB Progress (2): 49/71 kB | 749/782 kB Progress (2): 49/71 kB | 765/782 kB Progress (2): 49/71 kB | 781/782 kB Progress (2): 49/71 kB | 782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 12 MB/s) 2024-09-14T10:59:38.806 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-09-14T10:59:38.809 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 66/71 kB Progress (1): 71 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 1.0 MB/s) 2024-09-14T10:59:38.809 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-09-14T10:59:38.815 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/205 kB Progress (2): 16/205 kB | 16/30 kB Progress (2): 16/205 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 419 kB/s) 2024-09-14T10:59:38.815 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-09-14T10:59:38.824 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 16/205 kB | 16/798 kB Progress (2): 16/205 kB | 33/798 kB Progress (3): 16/205 kB | 33/798 kB | 16/81 kB Progress (3): 16/205 kB | 48/798 kB | 16/81 kB Progress (3): 16/205 kB | 64/798 kB | 16/81 kB Progress (3): 16/205 kB | 81/798 kB | 16/81 kB Progress (3): 16/205 kB | 97/798 kB | 16/81 kB Progress (3): 16/205 kB | 114/798 kB | 16/81 kB Progress (3): 16/205 kB | 130/798 kB | 16/81 kB Progress (3): 16/205 kB | 146/798 kB | 16/81 kB Progress (3): 16/205 kB | 163/798 kB | 16/81 kB Progress (3): 16/205 kB | 179/798 kB | 16/81 kB Progress (3): 16/205 kB | 195/798 kB | 16/81 kB Progress (3): 16/205 kB | 212/798 kB | 16/81 kB Progress (3): 33/205 kB | 212/798 kB | 16/81 kB Progress (3): 33/205 kB | 228/798 kB | 16/81 kB Progress (3): 33/205 kB | 245/798 kB | 16/81 kB Progress (3): 33/205 kB | 261/798 kB | 16/81 kB Progress (3): 33/205 kB | 277/798 kB | 16/81 kB Progress (3): 49/205 kB | 277/798 kB | 16/81 kB Progress (3): 49/205 kB | 294/798 kB | 16/81 kB Progress (4): 49/205 kB | 294/798 kB | 16/81 kB | 13 kB Progress (4): 49/205 kB | 310/798 kB | 16/81 kB | 13 kB Progress (4): 49/205 kB | 327/798 kB | 16/81 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 163 kB/s) 2024-09-14T10:59:38.825 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-09-14T10:59:38.832 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (3): 49/205 kB | 343/798 kB | 16/81 kB Progress (3): 66/205 kB | 343/798 kB | 16/81 kB Progress (3): 66/205 kB | 359/798 kB | 16/81 kB Progress (3): 66/205 kB | 376/798 kB | 16/81 kB Progress (3): 66/205 kB | 392/798 kB | 16/81 kB Progress (3): 66/205 kB | 408/798 kB | 16/81 kB Progress (3): 66/205 kB | 425/798 kB | 16/81 kB Progress (3): 82/205 kB | 425/798 kB | 16/81 kB Progress (3): 82/205 kB | 441/798 kB | 16/81 kB Progress (3): 82/205 kB | 458/798 kB | 16/81 kB Progress (3): 82/205 kB | 474/798 kB | 16/81 kB Progress (3): 82/205 kB | 490/798 kB | 16/81 kB Progress (3): 98/205 kB | 490/798 kB | 16/81 kB Progress (3): 98/205 kB | 507/798 kB | 16/81 kB Progress (3): 98/205 kB | 523/798 kB | 16/81 kB Progress (3): 98/205 kB | 540/798 kB | 16/81 kB Progress (3): 115/205 kB | 540/798 kB | 16/81 kB Progress (3): 115/205 kB | 556/798 kB | 16/81 kB Progress (3): 115/205 kB | 572/798 kB | 16/81 kB Progress (3): 115/205 kB | 589/798 kB | 16/81 kB Progress (3): 115/205 kB | 605/798 kB | 16/81 kB Progress (3): 115/205 kB | 621/798 kB | 16/81 kB Progress (3): 115/205 kB | 638/798 kB | 16/81 kB Progress (3): 115/205 kB | 654/798 kB | 16/81 kB Progress (3): 115/205 kB | 654/798 kB | 33/81 kB Progress (3): 115/205 kB | 671/798 kB | 33/81 kB Progress (3): 115/205 kB | 687/798 kB | 33/81 kB Progress (4): 115/205 kB | 687/798 kB | 33/81 kB | 16/182 kB Progress (4): 115/205 kB | 703/798 kB | 33/81 kB | 16/182 kB Progress (4): 115/205 kB | 720/798 kB | 33/81 kB | 16/182 kB Progress (4): 115/205 kB | 736/798 kB | 33/81 kB | 16/182 kB Progress (4): 115/205 kB | 753/798 kB | 33/81 kB | 16/182 kB Progress (4): 115/205 kB | 753/798 kB | 33/81 kB | 33/182 kB Progress (4): 115/205 kB | 753/798 kB | 49/81 kB | 33/182 kB Progress (4): 115/205 kB | 769/798 kB | 49/81 kB | 33/182 kB Progress (4): 115/205 kB | 785/798 kB | 49/81 kB | 33/182 kB Progress (4): 115/205 kB | 798 kB | 49/81 kB | 33/182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 9.0 MB/s) 2024-09-14T10:59:38.832 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-09-14T10:59:38.835 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (3): 115/205 kB | 49/81 kB | 49/182 kB Progress (3): 115/205 kB | 66/81 kB | 49/182 kB Progress (3): 115/205 kB | 66/81 kB | 66/182 kB Progress (3): 131/205 kB | 66/81 kB | 66/182 kB Progress (3): 147/205 kB | 66/81 kB | 66/182 kB Progress (3): 147/205 kB | 81 kB | 66/182 kB Progress (3): 164/205 kB | 81 kB | 66/182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 883 kB/s) 2024-09-14T10:59:38.835 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-09-14T10:59:38.837 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 180/205 kB | 66/182 kB Progress (2): 197/205 kB | 66/182 kB Progress (2): 205 kB | 66/182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 2.2 MB/s) 2024-09-14T10:59:38.837 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-09-14T10:59:38.846 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 66/182 kB | 16/151 kB Progress (2): 66/182 kB | 33/151 kB Progress (2): 82/182 kB | 33/151 kB Progress (2): 82/182 kB | 49/151 kB Progress (2): 98/182 kB | 49/151 kB Progress (2): 115/182 kB | 49/151 kB Progress (2): 115/182 kB | 66/151 kB Progress (2): 131/182 kB | 66/151 kB Progress (2): 147/182 kB | 66/151 kB Progress (2): 164/182 kB | 66/151 kB Progress (2): 180/182 kB | 66/151 kB Progress (2): 182 kB | 66/151 kB Progress (3): 182 kB | 66/151 kB | 16/27 kB Progress (3): 182 kB | 66/151 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.8 MB/s) 2024-09-14T10:59:38.847 INFO:tasks.workunit.client.0.smithi097.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 262 kB/s) 2024-09-14T10:59:38.847 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-09-14T10:59:38.847 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-09-14T10:59:38.852 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 82/151 kB Progress (1): 98/151 kB Progress (2): 98/151 kB | 16/30 kB Progress (2): 98/151 kB | 30 kB Progress (2): 115/151 kB | 30 kB Progress (3): 115/151 kB | 30 kB | 16/385 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 276 kB/s) 2024-09-14T10:59:38.852 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-09-14T10:59:38.854 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 115/151 kB | 33/385 kB Progress (2): 131/151 kB | 33/385 kB Progress (2): 131/151 kB | 49/385 kB Progress (2): 131/151 kB | 66/385 kB Progress (2): 131/151 kB | 82/385 kB Progress (2): 147/151 kB | 82/385 kB Progress (2): 151 kB | 82/385 kB Progress (2): 151 kB | 98/385 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.4 MB/s) 2024-09-14T10:59:38.854 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 115/385 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-09-14T10:59:38.862 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 131/385 kB Progress (1): 147/385 kB Progress (1): 164/385 kB Progress (1): 180/385 kB Progress (1): 197/385 kB Progress (1): 213/385 kB Progress (1): 229/385 kB Progress (1): 246/385 kB Progress (1): 262/385 kB Progress (2): 262/385 kB | 13 kB Progress (3): 262/385 kB | 13 kB | 16/75 kB Progress (3): 262/385 kB | 13 kB | 33/75 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 111 kB/s) 2024-09-14T10:59:38.862 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-09-14T10:59:38.862 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 262/385 kB | 49/75 kB Progress (2): 262/385 kB | 66/75 kB Progress (2): 262/385 kB | 75 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 626 kB/s) 2024-09-14T10:59:38.862 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-09-14T10:59:38.866 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 279/385 kB Progress (1): 295/385 kB Progress (1): 311/385 kB Progress (1): 328/385 kB Progress (1): 344/385 kB Progress (1): 360/385 kB Progress (1): 377/385 kB Progress (1): 385 kB Progress (2): 385 kB | 16/780 kB Progress (2): 385 kB | 33/780 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 3.1 MB/s) 2024-09-14T10:59:38.866 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-09-14T10:59:38.883 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 49/780 kB Progress (2): 49/780 kB | 16/329 kB Progress (2): 49/780 kB | 33/329 kB Progress (2): 62/780 kB | 33/329 kB Progress (2): 62/780 kB | 49/329 kB Progress (2): 62/780 kB | 64/329 kB Progress (2): 62/780 kB | 81/329 kB Progress (2): 79/780 kB | 81/329 kB Progress (2): 79/780 kB | 97/329 kB Progress (2): 95/780 kB | 97/329 kB Progress (2): 95/780 kB | 113/329 kB Progress (2): 111/780 kB | 113/329 kB Progress (2): 111/780 kB | 130/329 kB Progress (2): 111/780 kB | 146/329 kB Progress (2): 111/780 kB | 162/329 kB Progress (2): 111/780 kB | 179/329 kB Progress (2): 111/780 kB | 195/329 kB Progress (2): 111/780 kB | 212/329 kB Progress (3): 111/780 kB | 212/329 kB | 16/354 kB Progress (3): 111/780 kB | 212/329 kB | 33/354 kB Progress (4): 111/780 kB | 212/329 kB | 33/354 kB | 16/501 kB Progress (4): 111/780 kB | 212/329 kB | 49/354 kB | 16/501 kB Progress (4): 111/780 kB | 212/329 kB | 49/354 kB | 33/501 kB Progress (4): 111/780 kB | 212/329 kB | 63/354 kB | 33/501 kB Progress (4): 111/780 kB | 212/329 kB | 63/354 kB | 49/501 kB Progress (4): 111/780 kB | 212/329 kB | 79/354 kB | 49/501 kB Progress (4): 111/780 kB | 212/329 kB | 79/354 kB | 66/501 kB Progress (4): 111/780 kB | 212/329 kB | 96/354 kB | 66/501 kB Progress (4): 111/780 kB | 212/329 kB | 96/354 kB | 82/501 kB Progress (4): 111/780 kB | 212/329 kB | 112/354 kB | 82/501 kB Progress (4): 111/780 kB | 212/329 kB | 116/354 kB | 82/501 kB Progress (4): 111/780 kB | 212/329 kB | 116/354 kB | 98/501 kB Progress (4): 111/780 kB | 212/329 kB | 128/354 kB | 98/501 kB Progress (4): 128/780 kB | 212/329 kB | 128/354 kB | 98/501 kB Progress (4): 128/780 kB | 212/329 kB | 145/354 kB | 98/501 kB Progress (4): 144/780 kB | 212/329 kB | 145/354 kB | 98/501 kB Progress (4): 144/780 kB | 212/329 kB | 161/354 kB | 98/501 kB Progress (4): 144/780 kB | 212/329 kB | 161/354 kB | 115/501 kB Progress (4): 144/780 kB | 212/329 kB | 177/354 kB | 115/501 kB Progress (4): 144/780 kB | 212/329 kB | 177/354 kB | 131/501 kB Progress (4): 160/780 kB | 212/329 kB | 177/354 kB | 131/501 kB Progress (4): 160/780 kB | 212/329 kB | 194/354 kB | 131/501 kB Progress (4): 160/780 kB | 212/329 kB | 194/354 kB | 147/501 kB Progress (4): 160/780 kB | 212/329 kB | 210/354 kB | 147/501 kB Progress (4): 177/780 kB | 212/329 kB | 210/354 kB | 147/501 kB Progress (4): 177/780 kB | 212/329 kB | 210/354 kB | 164/501 kB Progress (4): 177/780 kB | 212/329 kB | 227/354 kB | 164/501 kB Progress (4): 177/780 kB | 212/329 kB | 227/354 kB | 180/501 kB Progress (4): 177/780 kB | 212/329 kB | 243/354 kB | 180/501 kB Progress (4): 177/780 kB | 228/329 kB | 243/354 kB | 180/501 kB Progress (4): 177/780 kB | 228/329 kB | 259/354 kB | 180/501 kB Progress (4): 177/780 kB | 244/329 kB | 259/354 kB | 180/501 kB Progress (4): 193/780 kB | 244/329 kB | 259/354 kB | 180/501 kB Progress (4): 193/780 kB | 244/329 kB | 276/354 kB | 180/501 kB Progress (4): 193/780 kB | 244/329 kB | 276/354 kB | 197/501 kB Progress (4): 193/780 kB | 261/329 kB | 276/354 kB | 197/501 kB Progress (4): 193/780 kB | 261/329 kB | 292/354 kB | 197/501 kB Progress (4): 210/780 kB | 261/329 kB | 292/354 kB | 197/501 kB Progress (4): 210/780 kB | 261/329 kB | 292/354 kB | 213/501 kB Progress (4): 210/780 kB | 277/329 kB | 292/354 kB | 213/501 kB Progress (4): 210/780 kB | 277/329 kB | 309/354 kB | 213/501 kB Progress (5): 210/780 kB | 277/329 kB | 309/354 kB | 213/501 kB | 16/41 kB Progress (5): 226/780 kB | 277/329 kB | 309/354 kB | 213/501 kB | 16/41 kB Progress (5): 226/780 kB | 277/329 kB | 309/354 kB | 229/501 kB | 16/41 kB Progress (5): 226/780 kB | 277/329 kB | 325/354 kB | 229/501 kB | 16/41 kB Progress (5): 226/780 kB | 294/329 kB | 325/354 kB | 229/501 kB | 16/41 kB Progress (5): 226/780 kB | 294/329 kB | 325/354 kB | 229/501 kB | 32/41 kB Progress (5): 226/780 kB | 294/329 kB | 325/354 kB | 246/501 kB | 32/41 kB Progress (5): 226/780 kB | 294/329 kB | 341/354 kB | 246/501 kB | 32/41 kB Progress (5): 226/780 kB | 294/329 kB | 341/354 kB | 246/501 kB | 41 kB Progress (5): 242/780 kB | 294/329 kB | 341/354 kB | 246/501 kB | 41 kB Progress (5): 242/780 kB | 310/329 kB | 341/354 kB | 246/501 kB | 41 kB Progress (5): 242/780 kB | 310/329 kB | 354 kB | 246/501 kB | 41 kB Progress (5): 242/780 kB | 326/329 kB | 354 kB | 246/501 kB | 41 kB Progress (5): 259/780 kB | 326/329 kB | 354 kB | 246/501 kB | 41 kB Progress (5): 259/780 kB | 329 kB | 354 kB | 246/501 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 298 kB/s) 2024-09-14T10:59:38.883 INFO:tasks.workunit.client.0.smithi097.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 2.5 MB/s) 2024-09-14T10:59:38.883 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-09-14T10:59:38.883 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-09-14T10:59:38.883 INFO:tasks.workunit.client.0.smithi097.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 2.4 MB/s) 2024-09-14T10:59:38.883 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 275/780 kB | 246/501 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-09-14T10:59:38.893 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 292/780 kB | 246/501 kB Progress (2): 308/780 kB | 246/501 kB Progress (2): 324/780 kB | 246/501 kB Progress (2): 341/780 kB | 246/501 kB Progress (2): 357/780 kB | 246/501 kB Progress (2): 357/780 kB | 256/501 kB Progress (2): 357/780 kB | 272/501 kB Progress (2): 357/780 kB | 289/501 kB Progress (2): 357/780 kB | 305/501 kB Progress (2): 357/780 kB | 321/501 kB Progress (2): 357/780 kB | 338/501 kB Progress (2): 357/780 kB | 354/501 kB Progress (2): 373/780 kB | 354/501 kB Progress (2): 373/780 kB | 370/501 kB Progress (2): 390/780 kB | 370/501 kB Progress (2): 390/780 kB | 387/501 kB Progress (2): 406/780 kB | 387/501 kB Progress (2): 406/780 kB | 403/501 kB Progress (2): 423/780 kB | 403/501 kB Progress (2): 423/780 kB | 420/501 kB Progress (2): 439/780 kB | 420/501 kB Progress (2): 439/780 kB | 436/501 kB Progress (2): 455/780 kB | 436/501 kB Progress (2): 455/780 kB | 452/501 kB Progress (2): 455/780 kB | 469/501 kB Progress (2): 455/780 kB | 485/501 kB Progress (2): 472/780 kB | 485/501 kB Progress (2): 472/780 kB | 501 kB Progress (2): 488/780 kB | 501 kB Progress (2): 504/780 kB | 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 3.4 MB/s) 2024-09-14T10:59:38.893 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 521/780 kB Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-09-14T10:59:38.898 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 537/780 kB Progress (1): 554/780 kB Progress (1): 570/780 kB Progress (1): 586/780 kB Progress (1): 603/780 kB Progress (1): 619/780 kB Progress (1): 636/780 kB Progress (1): 652/780 kB Progress (1): 668/780 kB Progress (1): 685/780 kB Progress (1): 701/780 kB Progress (2): 701/780 kB | 6.4 kB Progress (2): 717/780 kB | 6.4 kB Progress (3): 717/780 kB | 6.4 kB | 16/211 kB Progress (3): 734/780 kB | 6.4 kB | 16/211 kB Progress (3): 734/780 kB | 6.4 kB | 32/211 kB Progress (3): 750/780 kB | 6.4 kB | 32/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 42 kB/s) 2024-09-14T10:59:38.898 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 750/780 kB | 49/211 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-09-14T10:59:38.898 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 767/780 kB | 49/211 kB Progress (2): 767/780 kB | 65/211 kB Progress (2): 780 kB | 65/211 kB Progress (3): 780 kB | 65/211 kB | 16/586 kB Progress (3): 780 kB | 81/211 kB | 16/586 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 5.0 MB/s) 2024-09-14T10:59:38.898 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 81/211 kB | 33/586 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-09-14T10:59:38.915 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 98/211 kB | 33/586 kB Progress (2): 98/211 kB | 49/586 kB Progress (2): 114/211 kB | 49/586 kB Progress (2): 114/211 kB | 66/586 kB Progress (2): 130/211 kB | 66/586 kB Progress (2): 130/211 kB | 82/586 kB Progress (3): 130/211 kB | 82/586 kB | 14 kB Progress (3): 147/211 kB | 82/586 kB | 14 kB Progress (3): 147/211 kB | 98/586 kB | 14 kB Progress (3): 163/211 kB | 98/586 kB | 14 kB Progress (3): 163/211 kB | 115/586 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 86 kB/s) 2024-09-14T10:59:38.915 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 180/211 kB | 115/586 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-09-14T10:59:38.915 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (3): 180/211 kB | 115/586 kB | 16/106 kB Progress (3): 180/211 kB | 131/586 kB | 16/106 kB Progress (3): 196/211 kB | 131/586 kB | 16/106 kB Progress (3): 196/211 kB | 131/586 kB | 33/106 kB Progress (3): 196/211 kB | 147/586 kB | 33/106 kB Progress (3): 211 kB | 147/586 kB | 33/106 kB Progress (3): 211 kB | 147/586 kB | 49/106 kB Progress (3): 211 kB | 164/586 kB | 49/106 kB Progress (3): 211 kB | 180/586 kB | 49/106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 1.2 MB/s) 2024-09-14T10:59:38.915 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 180/586 kB | 66/106 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-09-14T10:59:38.915 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 197/586 kB | 66/106 kB Progress (2): 197/586 kB | 82/106 kB Progress (2): 213/586 kB | 82/106 kB Progress (2): 229/586 kB | 82/106 kB Progress (2): 229/586 kB | 98/106 kB Progress (2): 229/586 kB | 106 kB Progress (2): 246/586 kB | 106 kB Progress (2): 262/586 kB | 106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 625 kB/s) 2024-09-14T10:59:38.915 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-09-14T10:59:38.919 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 279/586 kB Progress (1): 295/586 kB Progress (1): 311/586 kB Progress (1): 328/586 kB Progress (1): 344/586 kB Progress (1): 360/586 kB Progress (1): 377/586 kB Progress (1): 393/586 kB Progress (1): 410/586 kB Progress (1): 426/586 kB Progress (1): 442/586 kB Progress (1): 459/586 kB Progress (1): 475/586 kB Progress (1): 492/586 kB Progress (1): 508/586 kB Progress (1): 524/586 kB Progress (1): 541/586 kB Progress (1): 557/586 kB Progress (1): 573/586 kB Progress (1): 585/586 kB Progress (1): 586 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 3.3 MB/s) 2024-09-14T10:59:38.919 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-09-14T10:59:38.923 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 38 kB/s) 2024-09-14T10:59:38.923 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-09-14T10:59:38.928 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/245 kB Progress (1): 33/245 kB Progress (1): 49/245 kB Progress (1): 66/245 kB Progress (1): 82/245 kB Progress (1): 98/245 kB Progress (2): 98/245 kB | 16/205 kB Progress (2): 115/245 kB | 16/205 kB Progress (2): 115/245 kB | 33/205 kB Progress (2): 131/245 kB | 33/205 kB Progress (2): 131/245 kB | 49/205 kB Progress (2): 131/245 kB | 66/205 kB Progress (2): 147/245 kB | 66/205 kB Progress (2): 147/245 kB | 82/205 kB Progress (2): 164/245 kB | 82/205 kB Progress (2): 164/245 kB | 98/205 kB Progress (3): 164/245 kB | 98/205 kB | 15 kB Progress (3): 180/245 kB | 98/205 kB | 15 kB Progress (3): 180/245 kB | 115/205 kB | 15 kB Progress (3): 180/245 kB | 131/205 kB | 15 kB Progress (3): 197/245 kB | 131/205 kB | 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 82 kB/s) 2024-09-14T10:59:38.929 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-09-14T10:59:38.930 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 197/245 kB | 147/205 kB Progress (2): 213/245 kB | 147/205 kB Progress (2): 213/245 kB | 164/205 kB Progress (2): 213/245 kB | 180/205 kB Progress (2): 229/245 kB | 180/205 kB Progress (2): 229/245 kB | 197/205 kB Progress (2): 245 kB | 197/205 kB Progress (2): 245 kB | 205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 1.1 MB/s) 2024-09-14T10:59:38.930 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-09-14T10:59:38.930 INFO:tasks.workunit.client.0.smithi097.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 1.3 MB/s) 2024-09-14T10:59:38.930 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-09-14T10:59:38.933 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 87 kB/s) 2024-09-14T10:59:38.933 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-09-14T10:59:38.937 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 33 kB/s) 2024-09-14T10:59:38.943 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 113 kB/s) 2024-09-14T10:59:38.944 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Progress (2): 24 kB | 16/17 kB Progress (2): 24 kB | 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 121 kB/s) 2024-09-14T10:59:38.944 INFO:tasks.workunit.client.0.smithi097.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 86 kB/s) 2024-09-14T10:59:38.950 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/184 kB Progress (1): 33/184 kB Progress (1): 49/184 kB Progress (1): 66/184 kB Progress (1): 82/184 kB Progress (1): 98/184 kB Progress (1): 115/184 kB Progress (1): 131/184 kB Progress (1): 147/184 kB Progress (1): 164/184 kB Progress (1): 180/184 kB Progress (1): 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 888 kB/s) 2024-09-14T10:59:38.978 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] 2024-09-14T10:59:38.978 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-09-14T10:59:38.985 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-09-14T10:59:39.000 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 416 kB/s) 2024-09-14T10:59:39.002 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-09-14T10:59:39.016 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 340 kB/s) 2024-09-14T10:59:39.018 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-09-14T10:59:39.032 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/43 kB Progress (1): 33/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 2.9 MB/s) 2024-09-14T10:59:39.036 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-09-14T10:59:39.050 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 1.0 MB/s) 2024-09-14T10:59:39.055 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-09-14T10:59:39.071 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 15/153 kB Progress (1): 31/153 kB Progress (1): 48/153 kB Progress (1): 64/153 kB Progress (1): 81/153 kB Progress (1): 97/153 kB Progress (1): 113/153 kB Progress (1): 130/153 kB Progress (1): 146/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 9.0 MB/s) 2024-09-14T10:59:39.071 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-09-14T10:59:39.089 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/215 kB Progress (1): 33/215 kB Progress (1): 49/215 kB Progress (1): 66/215 kB Progress (1): 82/215 kB Progress (1): 98/215 kB Progress (1): 112/215 kB Progress (1): 129/215 kB Progress (1): 145/215 kB Progress (1): 161/215 kB Progress (1): 178/215 kB Progress (1): 194/215 kB Progress (1): 211/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 13 MB/s) 2024-09-14T10:59:39.125 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] 2024-09-14T10:59:39.125 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-14T10:59:39.128 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-09-14T10:59:39.141 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 190 kB/s) 2024-09-14T10:59:39.143 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-09-14T10:59:39.160 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 1.3 MB/s) 2024-09-14T10:59:39.163 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-09-14T10:59:39.177 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 626 kB/s) 2024-09-14T10:59:39.178 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-09-14T10:59:39.193 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.7 MB/s) 2024-09-14T10:59:39.196 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-09-14T10:59:39.209 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 431 kB/s) 2024-09-14T10:59:39.211 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-09-14T10:59:39.225 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 248 kB/s) 2024-09-14T10:59:39.227 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-09-14T10:59:39.241 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 44 kB/s) 2024-09-14T10:59:39.243 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-09-14T10:59:39.256 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 211 kB/s) 2024-09-14T10:59:39.258 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-09-14T10:59:39.271 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 1.1 MB/s) 2024-09-14T10:59:39.273 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-09-14T10:59:39.287 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 229 kB/s) 2024-09-14T10:59:39.289 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-09-14T10:59:39.304 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 557 kB/s) 2024-09-14T10:59:39.306 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-09-14T10:59:39.319 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 597 kB/s) 2024-09-14T10:59:39.322 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-09-14T10:59:39.337 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 534 kB/s) 2024-09-14T10:59:39.339 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-09-14T10:59:39.354 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.4 MB/s) 2024-09-14T10:59:39.359 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-09-14T10:59:39.374 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 340 kB/s) 2024-09-14T10:59:39.377 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-09-14T10:59:39.392 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 2.0 MB/s) 2024-09-14T10:59:39.397 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-09-14T10:59:39.411 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 340 kB/s) 2024-09-14T10:59:39.415 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-09-14T10:59:39.429 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/85 kB Progress (1): 33/85 kB Progress (1): 49/85 kB Progress (1): 66/85 kB Progress (1): 82/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 5.7 MB/s) 2024-09-14T10:59:39.430 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-09-14T10:59:39.430 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-09-14T10:59:39.430 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-09-14T10:59:39.430 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-09-14T10:59:39.430 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-09-14T10:59:39.445 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/55 kB Progress (2): 16/55 kB | 16/269 kB Progress (3): 16/55 kB | 16/269 kB | 2.5 kB Progress (3): 33/55 kB | 16/269 kB | 2.5 kB Progress (3): 33/55 kB | 33/269 kB | 2.5 kB Progress (3): 49/55 kB | 33/269 kB | 2.5 kB Progress (3): 49/55 kB | 49/269 kB | 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 178 kB/s) 2024-09-14T10:59:39.445 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-09-14T10:59:39.446 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 55 kB | 49/269 kB Progress (2): 55 kB | 63/269 kB Progress (3): 55 kB | 63/269 kB | 16/41 kB Progress (3): 55 kB | 80/269 kB | 16/41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 3.7 MB/s) 2024-09-14T10:59:39.446 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 80/269 kB | 33/41 kB Progress (2): 96/269 kB | 33/41 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-09-14T10:59:39.446 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (3): 96/269 kB | 33/41 kB | 8.5 kB Progress (3): 96/269 kB | 41 kB | 8.5 kB Progress (3): 112/269 kB | 41 kB | 8.5 kB Progress (3): 129/269 kB | 41 kB | 8.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 565 kB/s) 2024-09-14T10:59:39.446 INFO:tasks.workunit.client.0.smithi097.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 2.7 MB/s) 2024-09-14T10:59:39.447 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 145/269 kB Progress (1): 162/269 kB Progress (1): 178/269 kB Progress (1): 194/269 kB Progress (1): 211/269 kB Progress (1): 227/269 kB Progress (1): 243/269 kB Progress (1): 260/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 15 MB/s) 2024-09-14T10:59:39.462 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/587 kB Progress (2): 16/587 kB | 16/327 kB Progress (2): 33/587 kB | 16/327 kB Progress (2): 33/587 kB | 33/327 kB Progress (2): 49/587 kB | 33/327 kB Progress (2): 49/587 kB | 49/327 kB Progress (2): 64/587 kB | 49/327 kB Progress (2): 64/587 kB | 66/327 kB Progress (2): 81/587 kB | 66/327 kB Progress (2): 81/587 kB | 82/327 kB Progress (2): 97/587 kB | 82/327 kB Progress (2): 97/587 kB | 98/327 kB Progress (2): 109/587 kB | 98/327 kB Progress (2): 109/587 kB | 115/327 kB Progress (2): 126/587 kB | 115/327 kB Progress (2): 130/587 kB | 115/327 kB Progress (2): 130/587 kB | 131/327 kB Progress (2): 146/587 kB | 131/327 kB Progress (2): 146/587 kB | 147/327 kB Progress (2): 162/587 kB | 147/327 kB Progress (2): 162/587 kB | 164/327 kB Progress (2): 179/587 kB | 164/327 kB Progress (2): 179/587 kB | 180/327 kB Progress (2): 195/587 kB | 180/327 kB Progress (2): 195/587 kB | 197/327 kB Progress (2): 212/587 kB | 197/327 kB Progress (2): 212/587 kB | 213/327 kB Progress (2): 228/587 kB | 213/327 kB Progress (2): 228/587 kB | 229/327 kB Progress (2): 244/587 kB | 229/327 kB Progress (2): 244/587 kB | 246/327 kB Progress (2): 244/587 kB | 256/327 kB Progress (2): 261/587 kB | 256/327 kB Progress (2): 261/587 kB | 272/327 kB Progress (2): 277/587 kB | 272/327 kB Progress (2): 277/587 kB | 289/327 kB Progress (2): 294/587 kB | 289/327 kB Progress (2): 294/587 kB | 305/327 kB Progress (2): 310/587 kB | 305/327 kB Progress (2): 310/587 kB | 321/327 kB Progress (2): 326/587 kB | 321/327 kB Progress (2): 326/587 kB | 327 kB Progress (2): 343/587 kB | 327 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 11 MB/s) 2024-09-14T10:59:39.465 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 359/587 kB Progress (1): 375/587 kB Progress (1): 392/587 kB Progress (1): 408/587 kB Progress (1): 425/587 kB Progress (1): 441/587 kB Progress (1): 457/587 kB Progress (1): 474/587 kB Progress (1): 490/587 kB Progress (1): 507/587 kB Progress (1): 523/587 kB Progress (1): 539/587 kB Progress (1): 556/587 kB Progress (1): 572/587 kB Progress (1): 587 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 17 MB/s) 2024-09-14T10:59:39.496 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-14T10:59:39.497 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] 2024-09-14T10:59:39.497 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-14T10:59:39.502 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-09-14T10:59:39.516 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 316 kB/s) 2024-09-14T10:59:39.518 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-09-14T10:59:39.532 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 454 kB/s) 2024-09-14T10:59:39.534 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-09-14T10:59:39.548 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 2.3 MB/s) 2024-09-14T10:59:39.550 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-09-14T10:59:39.564 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 998 kB/s) 2024-09-14T10:59:39.568 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-09-14T10:59:39.583 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 54 kB/s) 2024-09-14T10:59:39.585 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-09-14T10:59:39.600 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 303 kB/s) 2024-09-14T10:59:39.601 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-09-14T10:59:39.615 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 1.2 MB/s) 2024-09-14T10:59:39.619 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-09-14T10:59:39.633 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 331 kB/s) 2024-09-14T10:59:39.635 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-09-14T10:59:39.649 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 296 kB/s) 2024-09-14T10:59:39.652 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-09-14T10:59:39.666 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 169 kB/s) 2024-09-14T10:59:39.668 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-09-14T10:59:39.683 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 806 kB/s) 2024-09-14T10:59:39.686 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-09-14T10:59:39.701 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 1.1 MB/s) 2024-09-14T10:59:39.704 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-09-14T10:59:39.718 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 469 kB/s) 2024-09-14T10:59:39.720 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-09-14T10:59:39.735 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 76 kB/s) 2024-09-14T10:59:39.736 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-09-14T10:59:39.751 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 599 kB/s) 2024-09-14T10:59:39.753 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-09-14T10:59:39.767 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 179 kB/s) 2024-09-14T10:59:39.770 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-09-14T10:59:39.784 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 402 kB/s) 2024-09-14T10:59:39.787 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-09-14T10:59:39.801 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 81 kB/s) 2024-09-14T10:59:39.804 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-09-14T10:59:39.820 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 48 kB/s) 2024-09-14T10:59:39.821 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-09-14T10:59:39.835 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 431 kB/s) 2024-09-14T10:59:39.837 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-09-14T10:59:39.851 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.8 MB/s) 2024-09-14T10:59:39.855 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-09-14T10:59:39.870 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 80 kB/s) 2024-09-14T10:59:39.872 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-09-14T10:59:39.886 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 94 kB/s) 2024-09-14T10:59:39.891 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-09-14T10:59:39.905 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 967 kB/s) 2024-09-14T10:59:39.906 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-09-14T10:59:39.906 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-09-14T10:59:39.906 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-09-14T10:59:39.906 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-09-14T10:59:39.906 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-09-14T10:59:39.919 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 324 kB/s) 2024-09-14T10:59:39.919 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-09-14T10:59:39.922 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/122 kB Progress (1): 33/122 kB Progress (1): 49/122 kB Progress (2): 49/122 kB | 16/55 kB Progress (2): 66/122 kB | 16/55 kB Progress (3): 66/122 kB | 16/55 kB | 16/27 kB Progress (3): 82/122 kB | 16/55 kB | 16/27 kB Progress (4): 82/122 kB | 16/55 kB | 16/27 kB | 16/334 kB Progress (4): 82/122 kB | 16/55 kB | 27 kB | 16/334 kB Progress (4): 82/122 kB | 33/55 kB | 27 kB | 16/334 kB Progress (4): 98/122 kB | 33/55 kB | 27 kB | 16/334 kB Progress (4): 98/122 kB | 33/55 kB | 27 kB | 33/334 kB Progress (4): 98/122 kB | 49/55 kB | 27 kB | 33/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.9 MB/s) 2024-09-14T10:59:39.922 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (3): 98/122 kB | 49/55 kB | 49/334 kB Progress (3): 115/122 kB | 49/55 kB | 49/334 kB Progress (3): 115/122 kB | 55 kB | 49/334 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-09-14T10:59:39.922 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (3): 122 kB | 55 kB | 49/334 kB Progress (3): 122 kB | 55 kB | 66/334 kB Progress (3): 122 kB | 55 kB | 82/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 3.6 MB/s) 2024-09-14T10:59:39.922 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-09-14T10:59:39.922 INFO:tasks.workunit.client.0.smithi097.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 8.2 MB/s) 2024-09-14T10:59:39.924 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 98/334 kB Progress (1): 115/334 kB Progress (1): 131/334 kB Progress (1): 147/334 kB Progress (1): 164/334 kB Progress (1): 180/334 kB Progress (1): 197/334 kB Progress (1): 213/334 kB Progress (1): 229/334 kB Progress (1): 246/334 kB Progress (1): 262/334 kB Progress (1): 279/334 kB Progress (1): 295/334 kB Progress (1): 311/334 kB Progress (1): 328/334 kB Progress (1): 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 18 MB/s) 2024-09-14T10:59:39.933 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/267 kB Progress (1): 33/267 kB Progress (1): 49/267 kB Progress (1): 66/267 kB Progress (1): 82/267 kB Progress (1): 98/267 kB Progress (2): 98/267 kB | 4.7 kB Progress (2): 115/267 kB | 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 166 kB/s) 2024-09-14T10:59:39.935 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 131/267 kB Progress (2): 131/267 kB | 16/23 kB Progress (2): 147/267 kB | 16/23 kB Progress (2): 147/267 kB | 23 kB Progress (2): 164/267 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 786 kB/s) 2024-09-14T10:59:39.936 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 180/267 kB Progress (1): 197/267 kB Progress (1): 213/267 kB Progress (1): 229/267 kB Progress (1): 246/267 kB Progress (1): 256/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 8.9 MB/s) 2024-09-14T10:59:39.982 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] Changes detected - recompiling the module! :source 2024-09-14T10:59:39.983 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-09-14T10:59:40.547 INFO:tasks.workunit.client.0.smithi097.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-14T10:59:40.547 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] 2024-09-14T10:59:40.547 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-14T10:59:40.549 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-14T10:59:40.549 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] 2024-09-14T10:59:40.550 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-14T10:59:40.554 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-09-14T10:59:40.554 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-09-14T10:59:40.695 INFO:tasks.workunit.client.0.smithi097.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-14T10:59:40.695 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] 2024-09-14T10:59:40.695 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-14T10:59:40.699 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-09-14T10:59:40.712 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 446 kB/s) 2024-09-14T10:59:40.716 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-09-14T10:59:40.731 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 221 kB/s) 2024-09-14T10:59:40.736 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-09-14T10:59:40.751 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 217 kB/s) 2024-09-14T10:59:40.755 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-09-14T10:59:40.770 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 271 kB/s) 2024-09-14T10:59:40.775 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-09-14T10:59:40.789 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 220 kB/s) 2024-09-14T10:59:40.797 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-09-14T10:59:40.809 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 318 kB/s) 2024-09-14T10:59:40.813 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-09-14T10:59:40.828 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 126 kB/s) 2024-09-14T10:59:40.832 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-09-14T10:59:40.847 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 157 kB/s) 2024-09-14T10:59:40.849 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-09-14T10:59:40.864 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 1.9 MB/s) 2024-09-14T10:59:40.868 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-09-14T10:59:40.883 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 126 kB/s) 2024-09-14T10:59:40.886 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-09-14T10:59:40.901 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 414 kB/s) 2024-09-14T10:59:40.905 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-09-14T10:59:40.919 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 157 kB/s) 2024-09-14T10:59:40.921 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-09-14T10:59:40.936 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.5 MB/s) 2024-09-14T10:59:40.939 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-09-14T10:59:40.954 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/37 kB Progress (1): 33/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.5 MB/s) 2024-09-14T10:59:40.957 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-09-14T10:59:40.972 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 1.1 MB/s) 2024-09-14T10:59:40.975 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-09-14T10:59:40.990 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 618 kB/s) 2024-09-14T10:59:40.992 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-09-14T10:59:41.007 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 1.8 MB/s) 2024-09-14T10:59:41.011 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-09-14T10:59:41.026 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 538 kB/s) 2024-09-14T10:59:41.030 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-09-14T10:59:41.044 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 155 kB/s) 2024-09-14T10:59:41.048 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-09-14T10:59:41.061 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 185 kB/s) 2024-09-14T10:59:41.064 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-09-14T10:59:41.078 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 110 kB/s) 2024-09-14T10:59:41.079 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-09-14T10:59:41.092 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 236 kB/s) 2024-09-14T10:59:41.094 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-09-14T10:59:41.107 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.5 MB/s) 2024-09-14T10:59:41.109 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-09-14T10:59:41.123 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 483 kB/s) 2024-09-14T10:59:41.125 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-09-14T10:59:41.139 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 969 kB/s) 2024-09-14T10:59:41.141 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-09-14T10:59:41.158 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 174 kB/s) 2024-09-14T10:59:41.160 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-09-14T10:59:41.173 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 486 kB/s) 2024-09-14T10:59:41.175 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-09-14T10:59:41.189 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 0.4/8.4 kB Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 600 kB/s) 2024-09-14T10:59:41.190 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-09-14T10:59:41.204 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 159 kB/s) 2024-09-14T10:59:41.206 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-09-14T10:59:41.220 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 159 kB/s) 2024-09-14T10:59:41.223 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-09-14T10:59:41.237 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 216 kB/s) 2024-09-14T10:59:41.241 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-09-14T10:59:41.255 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 998 kB/s) 2024-09-14T10:59:41.257 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-09-14T10:59:41.271 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 1.0 MB/s) 2024-09-14T10:59:41.274 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-09-14T10:59:41.288 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 959 kB/s) 2024-09-14T10:59:41.289 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-09-14T10:59:41.303 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 342 kB/s) 2024-09-14T10:59:41.306 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-09-14T10:59:41.320 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 448 kB/s) 2024-09-14T10:59:41.322 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-09-14T10:59:41.336 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 2.3 MB/s) 2024-09-14T10:59:41.339 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-09-14T10:59:41.353 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 1.2 MB/s) 2024-09-14T10:59:41.354 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-09-14T10:59:41.369 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 1.1 MB/s) 2024-09-14T10:59:41.372 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-09-14T10:59:41.386 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 58 kB/s) 2024-09-14T10:59:41.388 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-09-14T10:59:41.402 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 343 kB/s) 2024-09-14T10:59:41.404 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-09-14T10:59:41.417 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 565 kB/s) 2024-09-14T10:59:41.420 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-09-14T10:59:41.437 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 214 kB/s) 2024-09-14T10:59:41.437 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-09-14T10:59:41.450 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 304 kB/s) 2024-09-14T10:59:41.454 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-09-14T10:59:41.469 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 147 kB/s) 2024-09-14T10:59:41.472 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-09-14T10:59:41.486 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 248 kB/s) 2024-09-14T10:59:41.489 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-09-14T10:59:41.503 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 781 kB/s) 2024-09-14T10:59:41.505 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-09-14T10:59:41.520 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 962 kB/s) 2024-09-14T10:59:41.522 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-09-14T10:59:41.536 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 1.3 MB/s) 2024-09-14T10:59:41.540 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-09-14T10:59:41.554 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 26 kB/s) 2024-09-14T10:59:41.556 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-09-14T10:59:41.570 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 469 kB/s) 2024-09-14T10:59:41.572 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-09-14T10:59:41.586 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 489 kB/s) 2024-09-14T10:59:41.588 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-09-14T10:59:41.602 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 345 kB/s) 2024-09-14T10:59:41.605 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-09-14T10:59:41.619 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 522 kB/s) 2024-09-14T10:59:41.621 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-09-14T10:59:41.635 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.5 MB/s) 2024-09-14T10:59:41.637 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-09-14T10:59:41.652 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 5.2 MB/s) 2024-09-14T10:59:41.656 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-09-14T10:59:41.670 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.7 MB/s) 2024-09-14T10:59:41.673 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-09-14T10:59:41.686 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 404 kB/s) 2024-09-14T10:59:41.688 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-09-14T10:59:41.702 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 305 kB/s) 2024-09-14T10:59:41.704 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-09-14T10:59:41.718 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 246 kB/s) 2024-09-14T10:59:41.719 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-09-14T10:59:41.733 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 2.0 MB/s) 2024-09-14T10:59:41.735 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-09-14T10:59:41.749 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 169 kB/s) 2024-09-14T10:59:41.755 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-09-14T10:59:41.774 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/308 kB Progress (1): 33/308 kB Progress (1): 49/308 kB Progress (1): 66/308 kB Progress (1): 82/308 kB Progress (1): 98/308 kB Progress (1): 115/308 kB Progress (1): 131/308 kB Progress (1): 147/308 kB Progress (1): 164/308 kB Progress (1): 180/308 kB Progress (1): 197/308 kB Progress (1): 213/308 kB Progress (1): 229/308 kB Progress (1): 246/308 kB Progress (1): 256/308 kB Progress (1): 272/308 kB Progress (1): 289/308 kB Progress (1): 305/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 17 MB/s) 2024-09-14T10:59:41.775 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-09-14T10:59:41.775 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-09-14T10:59:41.775 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-09-14T10:59:41.775 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-09-14T10:59:41.775 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-09-14T10:59:41.793 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 8.2 kB Progress (2): 8.2 kB | 16/171 kB Progress (3): 8.2 kB | 16/171 kB | 16/26 kB Progress (4): 8.2 kB | 16/171 kB | 16/26 kB | 14 kB Progress (4): 8.2 kB | 16/171 kB | 26 kB | 14 kB Progress (5): 8.2 kB | 16/171 kB | 26 kB | 14 kB | 16/118 kB Progress (5): 8.2 kB | 33/171 kB | 26 kB | 14 kB | 16/118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 971 kB/s) 2024-09-14T10:59:41.793 INFO:tasks.workunit.client.0.smithi097.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 584 kB/s) 2024-09-14T10:59:41.793 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-09-14T10:59:41.793 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-09-14T10:59:41.793 INFO:tasks.workunit.client.0.smithi097.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.8 MB/s) 2024-09-14T10:59:41.793 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 33/171 kB | 32/118 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-09-14T10:59:41.793 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 49/171 kB | 32/118 kB Progress (2): 49/171 kB | 49/118 kB Progress (2): 66/171 kB | 49/118 kB Progress (2): 82/171 kB | 49/118 kB Progress (2): 82/171 kB | 65/118 kB Progress (2): 98/171 kB | 65/118 kB Progress (2): 98/171 kB | 81/118 kB Progress (2): 115/171 kB | 81/118 kB Progress (2): 131/171 kB | 81/118 kB Progress (2): 131/171 kB | 98/118 kB Progress (2): 147/171 kB | 98/118 kB Progress (2): 147/171 kB | 114/118 kB Progress (2): 164/171 kB | 114/118 kB Progress (2): 164/171 kB | 118 kB Progress (2): 171 kB | 118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 9.5 MB/s) 2024-09-14T10:59:41.793 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-09-14T10:59:41.794 INFO:tasks.workunit.client.0.smithi097.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 6.9 MB/s) 2024-09-14T10:59:41.794 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-09-14T10:59:41.811 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 15/61 kB Progress (2): 15/61 kB | 16/146 kB Progress (2): 31/61 kB | 16/146 kB Progress (3): 31/61 kB | 16/146 kB | 16/136 kB Progress (3): 48/61 kB | 16/146 kB | 16/136 kB Progress (3): 48/61 kB | 32/146 kB | 16/136 kB Progress (3): 48/61 kB | 32/146 kB | 33/136 kB Progress (3): 61 kB | 32/146 kB | 33/136 kB Progress (3): 61 kB | 49/146 kB | 33/136 kB Progress (3): 61 kB | 49/146 kB | 49/136 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 2.1 MB/s) 2024-09-14T10:59:41.812 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-09-14T10:59:41.812 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 62/146 kB | 49/136 kB Progress (2): 62/146 kB | 66/136 kB Progress (2): 79/146 kB | 66/136 kB Progress (2): 79/146 kB | 82/136 kB Progress (2): 95/146 kB | 82/136 kB Progress (2): 95/146 kB | 98/136 kB Progress (2): 112/146 kB | 98/136 kB Progress (3): 112/146 kB | 98/136 kB | 16/58 kB Progress (3): 112/146 kB | 115/136 kB | 16/58 kB Progress (4): 112/146 kB | 115/136 kB | 16/58 kB | 16/501 kB Progress (4): 112/146 kB | 115/136 kB | 33/58 kB | 16/501 kB Progress (4): 128/146 kB | 115/136 kB | 33/58 kB | 16/501 kB Progress (4): 128/146 kB | 131/136 kB | 33/58 kB | 16/501 kB Progress (4): 128/146 kB | 131/136 kB | 33/58 kB | 33/501 kB Progress (4): 128/146 kB | 131/136 kB | 49/58 kB | 33/501 kB Progress (4): 128/146 kB | 136 kB | 49/58 kB | 33/501 kB Progress (4): 128/146 kB | 136 kB | 58 kB | 33/501 kB Progress (4): 144/146 kB | 136 kB | 58 kB | 33/501 kB Progress (4): 144/146 kB | 136 kB | 58 kB | 49/501 kB Progress (4): 146 kB | 136 kB | 58 kB | 49/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.9 MB/s) 2024-09-14T10:59:41.812 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (3): 146 kB | 136 kB | 66/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 4.4 MB/s) 2024-09-14T10:59:41.813 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-09-14T10:59:41.813 INFO:tasks.workunit.client.0.smithi097.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 4.6 MB/s) 2024-09-14T10:59:41.813 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 82/501 kB Progress (1): 98/501 kB Progress (1): 115/501 kB Progress (1): 131/501 kB Progress (1): 147/501 kB Progress (1): 164/501 kB Progress (1): 180/501 kB Progress (1): 197/501 kB Progress (1): 213/501 kB Progress (1): 229/501 kB Progress (1): 246/501 kB Progress (1): 262/501 kB Progress (1): 279/501 kB Progress (1): 295/501 kB Progress (1): 311/501 kB Progress (1): 328/501 kB Progress (1): 344/501 kB Progress (1): 360/501 kB Progress (1): 377/501 kB Progress (1): 393/501 kB Progress (1): 410/501 kB Progress (1): 426/501 kB Progress (1): 442/501 kB Progress (1): 459/501 kB Progress (1): 475/501 kB Progress (1): 492/501 kB Progress (1): 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 14 MB/s) 2024-09-14T10:59:41.819 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/124 kB Progress (1): 33/124 kB Progress (1): 49/124 kB Progress (1): 66/124 kB Progress (1): 82/124 kB Progress (1): 98/124 kB Progress (1): 115/124 kB Progress (1): 124 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.8 MB/s) 2024-09-14T10:59:41.866 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 26 MB/s) 2024-09-14T10:59:41.932 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] 2024-09-14T10:59:41.932 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-09-14T10:59:41.934 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-09-14T10:59:41.950 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 320 kB/s) 2024-09-14T10:59:41.950 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-09-14T10:59:41.964 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 350 kB/s) 2024-09-14T10:59:41.966 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-09-14T10:59:41.981 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 3.0 MB/s) 2024-09-14T10:59:41.982 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-09-14T10:59:41.998 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 1.4 MB/s) 2024-09-14T10:59:42.000 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-09-14T10:59:42.014 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 370 kB/s) 2024-09-14T10:59:42.016 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-09-14T10:59:42.030 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 280 kB/s) 2024-09-14T10:59:42.032 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-09-14T10:59:42.046 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 430 kB/s) 2024-09-14T10:59:42.049 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-09-14T10:59:42.063 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 447 kB/s) 2024-09-14T10:59:42.065 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-09-14T10:59:42.079 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.4 MB/s) 2024-09-14T10:59:42.082 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-09-14T10:59:42.096 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 969 kB/s) 2024-09-14T10:59:42.098 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-09-14T10:59:42.113 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 146 kB/s) 2024-09-14T10:59:42.114 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-09-14T10:59:42.129 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 548 kB/s) 2024-09-14T10:59:42.131 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-09-14T10:59:42.146 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.6 MB/s) 2024-09-14T10:59:42.151 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-09-14T10:59:42.165 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 2.4 MB/s) 2024-09-14T10:59:42.166 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-09-14T10:59:42.166 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-09-14T10:59:42.166 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-09-14T10:59:42.166 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-09-14T10:59:42.166 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-09-14T10:59:42.184 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/79 kB Progress (2): 16/79 kB | 16/26 kB Progress (3): 16/79 kB | 16/26 kB | 0/1.0 MB Progress (3): 33/79 kB | 16/26 kB | 0/1.0 MB Progress (4): 33/79 kB | 16/26 kB | 0/1.0 MB | 16/211 kB Progress (4): 33/79 kB | 26 kB | 0/1.0 MB | 16/211 kB Progress (5): 33/79 kB | 26 kB | 0/1.0 MB | 16/211 kB | 16/58 kB Progress (5): 33/79 kB | 26 kB | 0/1.0 MB | 16/211 kB | 16/58 kB Progress (5): 49/79 kB | 26 kB | 0/1.0 MB | 16/211 kB | 16/58 kB Progress (5): 49/79 kB | 26 kB | 0/1.0 MB | 33/211 kB | 16/58 kB Progress (5): 49/79 kB | 26 kB | 0/1.0 MB | 33/211 kB | 33/58 kB Progress (5): 49/79 kB | 26 kB | 0/1.0 MB | 33/211 kB | 33/58 kB Progress (5): 49/79 kB | 26 kB | 0/1.0 MB | 33/211 kB | 49/58 kB Progress (5): 66/79 kB | 26 kB | 0/1.0 MB | 33/211 kB | 49/58 kB Progress (5): 66/79 kB | 26 kB | 0/1.0 MB | 49/211 kB | 49/58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.7 MB/s) 2024-09-14T10:59:42.184 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (4): 66/79 kB | 0/1.0 MB | 49/211 kB | 58 kB Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-09-14T10:59:42.185 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (4): 66/79 kB | 0.1/1.0 MB | 49/211 kB | 58 kB Progress (4): 79 kB | 0.1/1.0 MB | 49/211 kB | 58 kB Progress (4): 79 kB | 0.1/1.0 MB | 66/211 kB | 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 3.9 MB/s) 2024-09-14T10:59:42.185 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (3): 79 kB | 0.1/1.0 MB | 66/211 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-09-14T10:59:42.185 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (3): 79 kB | 0.1/1.0 MB | 82/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 5.3 MB/s) 2024-09-14T10:59:42.185 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 0.1/1.0 MB | 82/211 kB Progress (2): 0.1/1.0 MB | 98/211 kB Progress (2): 0.1/1.0 MB | 98/211 kB Progress (2): 0.1/1.0 MB | 115/211 kB Progress (2): 0.1/1.0 MB | 115/211 kB Progress (2): 0.1/1.0 MB | 131/211 kB Progress (2): 0.1/1.0 MB | 147/211 kB Progress (2): 0.1/1.0 MB | 147/211 kB Progress (2): 0.1/1.0 MB | 164/211 kB Progress (2): 0.2/1.0 MB | 164/211 kB Progress (2): 0.2/1.0 MB | 180/211 kB Progress (2): 0.2/1.0 MB | 180/211 kB Progress (2): 0.2/1.0 MB | 197/211 kB Progress (2): 0.2/1.0 MB | 197/211 kB Progress (2): 0.2/1.0 MB | 211 kB Progress (2): 0.2/1.0 MB | 211 kB Progress (2): 0.2/1.0 MB | 211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 12 MB/s) 2024-09-14T10:59:42.195 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 0.2/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (2): 1.0/1.0 MB | 16/116 kB Progress (2): 1.0/1.0 MB | 16/116 kB Progress (2): 1.0 MB | 16/116 kB Progress (2): 1.0 MB | 33/116 kB Progress (2): 1.0 MB | 49/116 kB Progress (2): 1.0 MB | 66/116 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 35 MB/s) 2024-09-14T10:59:42.195 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 82/116 kB Progress (1): 98/116 kB Progress (2): 98/116 kB | 16/267 kB Progress (2): 115/116 kB | 16/267 kB Progress (2): 116 kB | 16/267 kB Progress (2): 116 kB | 32/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 3.9 MB/s) 2024-09-14T10:59:42.199 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 49/267 kB Progress (1): 65/267 kB Progress (1): 81/267 kB Progress (1): 98/267 kB Progress (1): 114/267 kB Progress (1): 131/267 kB Progress (1): 147/267 kB Progress (1): 163/267 kB Progress (1): 180/267 kB Progress (1): 196/267 kB Progress (1): 212/267 kB Progress (1): 229/267 kB Progress (1): 245/267 kB Progress (1): 262/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 8.1 MB/s) 2024-09-14T10:59:42.330 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-09-14T10:59:42.365 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T10:59:42.366 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] BUILD SUCCESS 2024-09-14T10:59:42.366 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T10:59:42.366 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] Total time: 5.642 s 2024-09-14T10:59:42.366 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] Finished at: 2024-09-14T10:59:42Z 2024-09-14T10:59:42.366 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T10:59:42.379 INFO:tasks.workunit.client.0.smithi097.stderr:+ ./mvnw test -Dtest=PutObjects 2024-09-14T10:59:42.388 INFO:tasks.workunit.client.0.smithi097.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-14T10:59:43.347 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] Scanning for projects... 2024-09-14T10:59:43.421 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] 2024-09-14T10:59:43.421 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-14T10:59:43.421 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] Building jcksum 1.0 2024-09-14T10:59:43.422 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] from pom.xml 2024-09-14T10:59:43.422 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-14T10:59:43.653 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] 2024-09-14T10:59:43.653 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-14T10:59:43.739 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-14T10:59:43.740 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] 2024-09-14T10:59:43.740 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-14T10:59:43.831 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-14T10:59:43.831 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] 2024-09-14T10:59:43.831 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-14T10:59:43.833 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-14T10:59:43.833 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] 2024-09-14T10:59:43.833 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-14T10:59:43.838 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-14T10:59:43.838 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] 2024-09-14T10:59:43.838 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-14T10:59:44.010 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-09-14T10:59:44.201 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-09-14T10:59:44.388 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 25 kB/s) 2024-09-14T10:59:44.398 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-09-14T10:59:44.415 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 154 kB/s) 2024-09-14T10:59:44.420 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-09-14T10:59:44.437 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 166 kB/s) 2024-09-14T10:59:44.441 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-09-14T10:59:44.457 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 189 kB/s) 2024-09-14T10:59:44.459 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-09-14T10:59:44.475 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 200 kB/s) 2024-09-14T10:59:44.478 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-09-14T10:59:44.493 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 105 kB/s) 2024-09-14T10:59:44.496 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-09-14T10:59:44.511 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 177 kB/s) 2024-09-14T10:59:44.517 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-09-14T10:59:44.539 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 17/27 kB Progress (1): 18/27 kB Progress (1): 19/27 kB Progress (1): 21/27 kB Progress (1): 22/27 kB Progress (1): 23/27 kB Progress (1): 25/27 kB Progress (1): 26/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 1.3 MB/s) 2024-09-14T10:59:44.540 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-09-14T10:59:44.541 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-09-14T10:59:44.541 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-09-14T10:59:44.542 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-09-14T10:59:44.542 INFO:tasks.workunit.client.0.smithi097.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-09-14T10:59:44.575 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 16/169 kB Progress (1): 33/169 kB Progress (1): 49/169 kB Progress (1): 66/169 kB Progress (1): 82/169 kB Progress (1): 98/169 kB Progress (1): 111/169 kB Progress (1): 127/169 kB Progress (1): 143/169 kB Progress (1): 160/169 kB Progress (1): 169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 4.6 MB/s) 2024-09-14T10:59:44.593 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 1.4/7.7 kB Progress (2): 1.4/7.7 kB | 1.4/18 kB Progress (3): 1.4/7.7 kB | 1.4/18 kB | 1.4/189 kB Progress (3): 1.4/7.7 kB | 2.8/18 kB | 1.4/189 kB Progress (3): 2.8/7.7 kB | 2.8/18 kB | 1.4/189 kB Progress (4): 2.8/7.7 kB | 2.8/18 kB | 1.4/189 kB | 1.4/103 kB Progress (4): 4.1/7.7 kB | 2.8/18 kB | 1.4/189 kB | 1.4/103 kB Progress (4): 4.1/7.7 kB | 4.1/18 kB | 1.4/189 kB | 1.4/103 kB Progress (4): 4.1/7.7 kB | 4.1/18 kB | 2.8/189 kB | 1.4/103 kB Progress (4): 4.1/7.7 kB | 5.5/18 kB | 2.8/189 kB | 1.4/103 kB Progress (4): 5.5/7.7 kB | 5.5/18 kB | 2.8/189 kB | 1.4/103 kB Progress (4): 5.5/7.7 kB | 5.5/18 kB | 2.8/189 kB | 2.8/103 kB Progress (4): 6.9/7.7 kB | 5.5/18 kB | 2.8/189 kB | 2.8/103 kB Progress (4): 6.9/7.7 kB | 5.5/18 kB | 2.8/189 kB | 4.1/103 kB Progress (4): 6.9/7.7 kB | 6.9/18 kB | 2.8/189 kB | 4.1/103 kB Progress (4): 6.9/7.7 kB | 6.9/18 kB | 4.1/189 kB | 4.1/103 kB Progress (4): 6.9/7.7 kB | 8.3/18 kB | 4.1/189 kB | 4.1/103 kB Progress (4): 6.9/7.7 kB | 8.3/18 kB | 4.1/189 kB | 5.5/103 kB Progress (4): 7.7 kB | 8.3/18 kB | 4.1/189 kB | 5.5/103 kB Progress (4): 7.7 kB | 8.3/18 kB | 4.1/189 kB | 6.9/103 kB Progress (4): 7.7 kB | 9.7/18 kB | 4.1/189 kB | 6.9/103 kB Progress (4): 7.7 kB | 9.7/18 kB | 5.5/189 kB | 6.9/103 kB Progress (4): 7.7 kB | 11/18 kB | 5.5/189 kB | 6.9/103 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 142 kB/s) 2024-09-14T10:59:44.598 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (3): 11/18 kB | 5.5/189 kB | 8.3/103 kB Progress (3): 12/18 kB | 5.5/189 kB | 8.3/103 kB Progress (3): 12/18 kB | 6.9/189 kB | 8.3/103 kB Progress (3): 14/18 kB | 6.9/189 kB | 8.3/103 kB Progress (3): 14/18 kB | 6.9/189 kB | 9.7/103 kB Progress (3): 15/18 kB | 6.9/189 kB | 9.7/103 kB Progress (3): 15/18 kB | 8.3/189 kB | 9.7/103 kB Progress (3): 17/18 kB | 8.3/189 kB | 9.7/103 kB Progress (3): 17/18 kB | 8.3/189 kB | 11/103 kB Progress (3): 18 kB | 8.3/189 kB | 11/103 kB Progress (3): 18 kB | 9.7/189 kB | 11/103 kB Progress (3): 18 kB | 9.7/189 kB | 12/103 kB Progress (3): 18 kB | 11/189 kB | 12/103 kB Progress (3): 18 kB | 11/189 kB | 14/103 kB Progress (3): 18 kB | 12/189 kB | 14/103 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 293 kB/s) 2024-09-14T10:59:44.622 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (2): 12/189 kB | 15/103 kB Progress (2): 14/189 kB | 15/103 kB Progress (2): 14/189 kB | 16/103 kB Progress (2): 15/189 kB | 16/103 kB Progress (2): 16/189 kB | 16/103 kB Progress (2): 16/189 kB | 32/103 kB Progress (2): 32/189 kB | 32/103 kB Progress (2): 32/189 kB | 49/103 kB Progress (2): 49/189 kB | 49/103 kB Progress (2): 65/189 kB | 49/103 kB Progress (2): 65/189 kB | 65/103 kB Progress (2): 81/189 kB | 65/103 kB Progress (2): 81/189 kB | 81/103 kB Progress (2): 81/189 kB | 98/103 kB Progress (2): 81/189 kB | 103 kB Progress (2): 98/189 kB | 103 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.3 MB/s) 2024-09-14T10:59:44.635 INFO:tasks.workunit.client.0.smithi097.stdout:Progress (1): 114/189 kB Progress (1): 130/189 kB Progress (1): 147/189 kB Progress (1): 163/189 kB Progress (1): 180/189 kB Progress (1): 189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 2.0 MB/s) 2024-09-14T10:59:44.649 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] 2024-09-14T10:59:44.649 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] ------------------------------------------------------- 2024-09-14T10:59:44.649 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] T E S T S 2024-09-14T10:59:44.649 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] ------------------------------------------------------- 2024-09-14T10:59:45.118 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-09-14T10:59:45.210 INFO:tasks.workunit.client.0.smithi097.stdout:PutObjects.java: starting test run: 2024-09-14T10:59:45.211 INFO:tasks.workunit.client.0.smithi097.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-14T10:59:45.211 INFO:tasks.workunit.client.0.smithi097.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-14T10:59:45.211 INFO:tasks.workunit.client.0.smithi097.stdout: EndpointUrl=http://smithi097.front.sepia.ceph.com:80 2024-09-14T10:59:45.211 INFO:tasks.workunit.client.0.smithi097.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-09-14T10:59:45.308 INFO:tasks.workunit.client.0.smithi097.stdout:DEBUG: Environment Variables Read 2024-09-14T10:59:45.609 INFO:tasks.workunit.client.0.smithi097.stdout:DEBUG: S3 Client Initialized 2024-09-14T10:59:45.609 INFO:tasks.workunit.client.0.smithi097.stdout:DEBUG: Generating File 2024-09-14T10:59:45.609 INFO:tasks.workunit.client.0.smithi097.stdout:DEBUG: File Generated 2024-09-14T10:59:45.610 INFO:tasks.workunit.client.0.smithi097.stdout:DEBUG: Generating File 2024-09-14T10:59:45.610 INFO:tasks.workunit.client.0.smithi097.stdout:DEBUG: File Generated 2024-09-14T10:59:45.610 INFO:tasks.workunit.client.0.smithi097.stdout:DEBUG: Generating File 2024-09-14T10:59:45.710 INFO:tasks.workunit.client.0.smithi097.stdout:DEBUG: File Generated 2024-09-14T10:59:45.710 INFO:tasks.workunit.client.0.smithi097.stdout:DEBUG: Generating File 2024-09-14T10:59:45.711 INFO:tasks.workunit.client.0.smithi097.stdout:DEBUG: File Generated 2024-09-14T10:59:45.711 INFO:tasks.workunit.client.0.smithi097.stdout:DEBUG: Generating File 2024-09-14T10:59:45.711 INFO:tasks.workunit.client.0.smithi097.stdout:DEBUG: File Generated 2024-09-14T10:59:45.711 INFO:tasks.workunit.client.0.smithi097.stdout:DEBUG: Generating File 2024-09-14T10:59:45.711 INFO:tasks.workunit.client.0.smithi097.stdout:DEBUG: File Generated 2024-09-14T10:59:45.712 INFO:tasks.workunit.client.0.smithi097.stdout:DEBUG: Generated Big Files 2024-09-14T10:59:45.873 INFO:tasks.workunit.client.0.smithi097.stdout:HeadBucketResponse() 2024-09-14T10:59:45.873 INFO:tasks.workunit.client.0.smithi097.stdout:sheik is ready 2024-09-14T10:59:45.873 INFO:tasks.workunit.client.0.smithi097.stdout:DEBUG: Test Bucket Created 2024-09-14T10:59:45.909 INFO:tasks.workunit.client.0.smithi097.stdout:putObjectFromFileNoCksum called with file-0b 2024-09-14T10:59:46.009 INFO:tasks.workunit.client.0.smithi097.stdout:putObjectFromFileNoCksum called with file-8b 2024-09-14T10:59:46.105 INFO:tasks.workunit.client.0.smithi097.stdout:putObjectFromFileNoCksum called with file-200b 2024-09-14T10:59:46.109 INFO:tasks.workunit.client.0.smithi097.stdout:putObjectFromFileNoCksum called with file-21983b 2024-09-14T10:59:46.192 INFO:tasks.workunit.client.0.smithi097.stdout:putObjectFromFileNoCksum called with file-5519b 2024-09-14T10:59:46.209 INFO:tasks.workunit.client.0.smithi097.stdout:putObjectFromFileNoCksum called with file-204329b 2024-09-14T10:59:46.303 INFO:tasks.workunit.client.0.smithi097.stdout:putObjectFromFileNoCksum called with file-256k 2024-09-14T10:59:46.309 INFO:tasks.workunit.client.0.smithi097.stdout:putObjectFromFileNoCksum called with file-1m 2024-09-14T10:59:46.394 INFO:tasks.workunit.client.0.smithi097.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-09-14T10:59:46.409 INFO:tasks.workunit.client.0.smithi097.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-09-14T10:59:48.716 INFO:tasks.workunit.client.0.smithi097.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-09-14T10:59:49.216 INFO:tasks.workunit.client.0.smithi097.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-09-14T10:59:51.201 INFO:tasks.workunit.client.0.smithi097.stdout:arg: file-0b 2024-09-14T10:59:51.202 INFO:tasks.workunit.client.0.smithi097.stdout:arg: file-8b 2024-09-14T10:59:51.203 INFO:tasks.workunit.client.0.smithi097.stdout:arg: file-200b 2024-09-14T10:59:51.204 INFO:tasks.workunit.client.0.smithi097.stdout:arg: file-21983b 2024-09-14T10:59:51.205 INFO:tasks.workunit.client.0.smithi097.stdout:arg: file-5519b 2024-09-14T10:59:51.205 INFO:tasks.workunit.client.0.smithi097.stdout:arg: file-204329b 2024-09-14T10:59:51.206 INFO:tasks.workunit.client.0.smithi097.stdout:arg: file-256k 2024-09-14T10:59:51.207 INFO:tasks.workunit.client.0.smithi097.stdout:arg: file-1m 2024-09-14T10:59:51.208 INFO:tasks.workunit.client.0.smithi097.stdout:arg: file-1038757b 2024-09-14T10:59:51.219 INFO:tasks.workunit.client.0.smithi097.stdout:putObjectFromFileCksum called with file-0b 2024-09-14T10:59:51.239 INFO:tasks.workunit.client.0.smithi097.stdout:PutObjectResponse 2024-09-14T10:59:51.293 INFO:tasks.workunit.client.0.smithi097.stdout:putObjectFromFileCksum called with file-8b 2024-09-14T10:59:51.294 INFO:tasks.workunit.client.0.smithi097.stdout:PutObjectResponse 2024-09-14T10:59:51.319 INFO:tasks.workunit.client.0.smithi097.stdout:putObjectFromFileCksum called with file-200b 2024-09-14T10:59:51.319 INFO:tasks.workunit.client.0.smithi097.stdout:PutObjectResponse 2024-09-14T10:59:51.409 INFO:tasks.workunit.client.0.smithi097.stdout:putObjectFromFileCksum called with file-21983b 2024-09-14T10:59:51.409 INFO:tasks.workunit.client.0.smithi097.stdout:PutObjectResponse 2024-09-14T10:59:51.419 INFO:tasks.workunit.client.0.smithi097.stdout:putObjectFromFileCksum called with file-5519b 2024-09-14T10:59:51.468 INFO:tasks.workunit.client.0.smithi097.stdout:PutObjectResponse 2024-09-14T10:59:51.495 INFO:tasks.workunit.client.0.smithi097.stdout:putObjectFromFileCksum called with file-204329b 2024-09-14T10:59:51.495 INFO:tasks.workunit.client.0.smithi097.stdout:PutObjectResponse 2024-09-14T10:59:51.517 INFO:tasks.workunit.client.0.smithi097.stdout:putObjectFromFileCksum called with file-256k 2024-09-14T10:59:51.517 INFO:tasks.workunit.client.0.smithi097.stdout:PutObjectResponse 2024-09-14T10:59:51.519 INFO:tasks.workunit.client.0.smithi097.stdout:putObjectFromFileCksum called with file-1m 2024-09-14T10:59:51.555 INFO:tasks.workunit.client.0.smithi097.stdout:PutObjectResponse 2024-09-14T10:59:51.595 INFO:tasks.workunit.client.0.smithi097.stdout:putObjectFromFileCksum called with file-1038757b 2024-09-14T10:59:51.595 INFO:tasks.workunit.client.0.smithi097.stdout:PutObjectResponse 2024-09-14T10:59:51.620 INFO:tasks.workunit.client.0.smithi097.stdout:mpuObjectFromFileCksum called with file-5m 2024-09-14T10:59:51.920 INFO:tasks.workunit.client.0.smithi097.stdout:mpuObjectFromFileCksum called with file-10m 2024-09-14T10:59:52.220 INFO:tasks.workunit.client.0.smithi097.stdout:mpuObjectFromFileCksum called with file-100m 2024-09-14T10:59:54.549 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.425 s -- in io.ceph.jcksum.PutObjects 2024-09-14T10:59:54.562 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] 2024-09-14T10:59:54.562 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] Results: 2024-09-14T10:59:54.562 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] 2024-09-14T10:59:54.562 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-09-14T10:59:54.562 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] 2024-09-14T10:59:54.564 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T10:59:54.564 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] BUILD SUCCESS 2024-09-14T10:59:54.564 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T10:59:54.565 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] Total time: 11.237 s 2024-09-14T10:59:54.565 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] Finished at: 2024-09-14T10:59:54Z 2024-09-14T10:59:54.565 INFO:tasks.workunit.client.0.smithi097.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T10:59:54.577 INFO:tasks.workunit.client.0.smithi097.stderr:+ exit 2024-09-14T10:59:54.577 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T10:59:54.577 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T10:59:54.656 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-09-14T10:59:54.656 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T10:59:55.070 DEBUG:teuthology.parallel:result is None 2024-09-14T10:59:55.070 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T10:59:55.109 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T10:59:55.109 DEBUG:teuthology.orchestra.run.smithi097:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T10:59:55.178 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T10:59:55.178 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T10:59:55.188 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T10:59:55.188 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T10:59:55.189 DEBUG:teuthology.orchestra.run.smithi097:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T10:59:55.247 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:59:55.248 INFO:teuthology.orchestra.run.smithi097.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T10:59:55.248 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T10:59:55.316 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T10:59:55.317 DEBUG:teuthology.orchestra.run.smithi097:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T10:59:55.385 INFO:tasks.workunit:timeout=3h 2024-09-14T10:59:55.385 INFO:tasks.workunit:cleanup=True 2024-09-14T10:59:55.385 DEBUG:teuthology.orchestra.run.smithi097:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T10:59:55.455 INFO:tasks.workunit.client.0.smithi097.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:00:52.280 INFO:tasks.workunit.client.0.smithi097.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:00:52.280 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:00:52.280 INFO:tasks.workunit.client.0.smithi097.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:00:52.281 INFO:tasks.workunit.client.0.smithi097.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:00:52.281 INFO:tasks.workunit.client.0.smithi097.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:00:52.281 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:00:52.281 INFO:tasks.workunit.client.0.smithi097.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:00:52.281 INFO:tasks.workunit.client.0.smithi097.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:00:52.281 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:00:52.281 INFO:tasks.workunit.client.0.smithi097.stderr: git switch -c 2024-09-14T11:00:52.281 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:00:52.281 INFO:tasks.workunit.client.0.smithi097.stderr:Or undo this operation with: 2024-09-14T11:00:52.281 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:00:52.281 INFO:tasks.workunit.client.0.smithi097.stderr: git switch - 2024-09-14T11:00:52.281 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:00:52.281 INFO:tasks.workunit.client.0.smithi097.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:00:52.282 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:00:52.282 INFO:tasks.workunit.client.0.smithi097.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:00:52.283 DEBUG:teuthology.orchestra.run.smithi097:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:00:52.355 INFO:tasks.workunit.client.0.smithi097.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:00:52.357 INFO:tasks.workunit.client.0.smithi097.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:00:52.357 INFO:tasks.workunit.client.0.smithi097.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:00:52.404 INFO:tasks.workunit.client.0.smithi097.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:00:52.453 INFO:tasks.workunit.client.0.smithi097.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:00:52.537 INFO:tasks.workunit.client.0.smithi097.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:00:52.538 INFO:tasks.workunit.client.0.smithi097.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:00:52.538 INFO:tasks.workunit.client.0.smithi097.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:00:52.576 INFO:tasks.workunit.client.0.smithi097.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:00:52.580 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-14T11:00:52.580 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:00:52.650 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-09-14T11:00:52.651 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-09-14T11:00:52.651 DEBUG:teuthology.orchestra.run.smithi097:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-09-14T11:00:52.725 INFO:tasks.workunit.client.0.smithi097.stdout:INFO: fully qualified domain name: smithi097.front.sepia.ceph.com 2024-09-14T11:00:52.725 INFO:tasks.workunit.client.0.smithi097.stdout:== TESTING *COMPLETING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-09-14T11:00:52.725 INFO:tasks.workunit.client.0.smithi097.stdout:== TESTING VERSIONED BUCKET == 2024-09-14T11:00:55.271 INFO:tasks.workunit.client.0.smithi097.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-14T11:00:55.443 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting pip 2024-09-14T11:00:55.449 INFO:tasks.workunit.client.0.smithi097.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T11:00:55.492 INFO:tasks.workunit.client.0.smithi097.stdout:Installing collected packages: pip 2024-09-14T11:00:55.493 INFO:tasks.workunit.client.0.smithi097.stdout: Attempting uninstall: pip 2024-09-14T11:00:55.493 INFO:tasks.workunit.client.0.smithi097.stdout: Found existing installation: pip 21.3.1 2024-09-14T11:00:55.642 INFO:tasks.workunit.client.0.smithi097.stdout: Uninstalling pip-21.3.1: 2024-09-14T11:00:55.647 INFO:tasks.workunit.client.0.smithi097.stdout: Successfully uninstalled pip-21.3.1 2024-09-14T11:00:56.377 INFO:tasks.workunit.client.0.smithi097.stdout:Successfully installed pip-24.2 2024-09-14T11:00:57.196 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting boto3 2024-09-14T11:00:57.197 INFO:tasks.workunit.client.0.smithi097.stdout: Using cached boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T11:00:57.783 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T11:00:57.785 INFO:tasks.workunit.client.0.smithi097.stdout: Using cached botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T11:00:57.855 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T11:00:57.856 INFO:tasks.workunit.client.0.smithi097.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T11:00:57.902 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T11:00:57.903 INFO:tasks.workunit.client.0.smithi097.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T11:00:57.953 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:00:57.954 INFO:tasks.workunit.client.0.smithi097.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T11:00:58.029 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:00:58.030 INFO:tasks.workunit.client.0.smithi097.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-14T11:00:58.283 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:00:58.284 INFO:tasks.workunit.client.0.smithi097.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T11:00:58.288 INFO:tasks.workunit.client.0.smithi097.stdout:Using cached boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T11:00:58.290 INFO:tasks.workunit.client.0.smithi097.stdout:Using cached botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T11:00:58.300 INFO:tasks.workunit.client.0.smithi097.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T11:00:58.301 INFO:tasks.workunit.client.0.smithi097.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T11:00:58.302 INFO:tasks.workunit.client.0.smithi097.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T11:00:58.304 INFO:tasks.workunit.client.0.smithi097.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-14T11:00:58.305 INFO:tasks.workunit.client.0.smithi097.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:00:58.377 INFO:tasks.workunit.client.0.smithi097.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T11:00:59.412 INFO:tasks.workunit.client.0.smithi097.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-14T11:00:59.849 INFO:tasks.workunit.client.0.smithi097.stdout:INFO: creating user 2024-09-14T11:00:59.958 INFO:tasks.workunit.client.0.smithi097.stdout:{ 2024-09-14T11:00:59.958 INFO:tasks.workunit.client.0.smithi097.stdout: "user_id": "testid", 2024-09-14T11:00:59.958 INFO:tasks.workunit.client.0.smithi097.stdout: "display_name": "M. Tester", 2024-09-14T11:00:59.958 INFO:tasks.workunit.client.0.smithi097.stdout: "email": "tester@ceph.com", 2024-09-14T11:00:59.958 INFO:tasks.workunit.client.0.smithi097.stdout: "suspended": 0, 2024-09-14T11:00:59.958 INFO:tasks.workunit.client.0.smithi097.stdout: "max_buckets": 1000, 2024-09-14T11:00:59.958 INFO:tasks.workunit.client.0.smithi097.stdout: "subusers": [], 2024-09-14T11:00:59.958 INFO:tasks.workunit.client.0.smithi097.stdout: "keys": [ 2024-09-14T11:00:59.958 INFO:tasks.workunit.client.0.smithi097.stdout: { 2024-09-14T11:00:59.958 INFO:tasks.workunit.client.0.smithi097.stdout: "user": "testid", 2024-09-14T11:00:59.958 INFO:tasks.workunit.client.0.smithi097.stdout: "access_key": "0555b35654ad1656d804", 2024-09-14T11:00:59.959 INFO:tasks.workunit.client.0.smithi097.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-09-14T11:00:59.959 INFO:tasks.workunit.client.0.smithi097.stdout: "active": true, 2024-09-14T11:00:59.959 INFO:tasks.workunit.client.0.smithi097.stdout: "create_date": "2024-09-14T11:00:59.954781Z" 2024-09-14T11:00:59.959 INFO:tasks.workunit.client.0.smithi097.stdout: } 2024-09-14T11:00:59.959 INFO:tasks.workunit.client.0.smithi097.stdout: ], 2024-09-14T11:00:59.959 INFO:tasks.workunit.client.0.smithi097.stdout: "swift_keys": [], 2024-09-14T11:00:59.959 INFO:tasks.workunit.client.0.smithi097.stdout: "caps": [], 2024-09-14T11:00:59.959 INFO:tasks.workunit.client.0.smithi097.stdout: "op_mask": "read, write, delete", 2024-09-14T11:00:59.959 INFO:tasks.workunit.client.0.smithi097.stdout: "default_placement": "", 2024-09-14T11:00:59.959 INFO:tasks.workunit.client.0.smithi097.stdout: "default_storage_class": "", 2024-09-14T11:00:59.959 INFO:tasks.workunit.client.0.smithi097.stdout: "placement_tags": [], 2024-09-14T11:00:59.959 INFO:tasks.workunit.client.0.smithi097.stdout: "bucket_quota": { 2024-09-14T11:00:59.959 INFO:tasks.workunit.client.0.smithi097.stdout: "enabled": false, 2024-09-14T11:00:59.960 INFO:tasks.workunit.client.0.smithi097.stdout: "check_on_raw": false, 2024-09-14T11:00:59.960 INFO:tasks.workunit.client.0.smithi097.stdout: "max_size": -1, 2024-09-14T11:00:59.960 INFO:tasks.workunit.client.0.smithi097.stdout: "max_size_kb": 0, 2024-09-14T11:00:59.960 INFO:tasks.workunit.client.0.smithi097.stdout: "max_objects": -1 2024-09-14T11:00:59.960 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T11:00:59.960 INFO:tasks.workunit.client.0.smithi097.stdout: "user_quota": { 2024-09-14T11:00:59.960 INFO:tasks.workunit.client.0.smithi097.stdout: "enabled": false, 2024-09-14T11:00:59.960 INFO:tasks.workunit.client.0.smithi097.stdout: "check_on_raw": false, 2024-09-14T11:00:59.960 INFO:tasks.workunit.client.0.smithi097.stdout: "max_size": -1, 2024-09-14T11:00:59.960 INFO:tasks.workunit.client.0.smithi097.stdout: "max_size_kb": 0, 2024-09-14T11:00:59.960 INFO:tasks.workunit.client.0.smithi097.stdout: "max_objects": -1 2024-09-14T11:00:59.960 INFO:tasks.workunit.client.0.smithi097.stdout: }, 2024-09-14T11:00:59.960 INFO:tasks.workunit.client.0.smithi097.stdout: "temp_url_keys": [], 2024-09-14T11:00:59.961 INFO:tasks.workunit.client.0.smithi097.stdout: "type": "rgw", 2024-09-14T11:00:59.961 INFO:tasks.workunit.client.0.smithi097.stdout: "mfa_ids": [], 2024-09-14T11:00:59.961 INFO:tasks.workunit.client.0.smithi097.stdout: "account_id": "", 2024-09-14T11:00:59.961 INFO:tasks.workunit.client.0.smithi097.stdout: "path": "/", 2024-09-14T11:00:59.961 INFO:tasks.workunit.client.0.smithi097.stdout: "create_date": "2024-09-14T11:00:59.954770Z", 2024-09-14T11:00:59.961 INFO:tasks.workunit.client.0.smithi097.stdout: "tags": [], 2024-09-14T11:00:59.961 INFO:tasks.workunit.client.0.smithi097.stdout: "group_ids": [] 2024-09-14T11:00:59.961 INFO:tasks.workunit.client.0.smithi097.stdout:} 2024-09-14T11:00:59.961 INFO:tasks.workunit.client.0.smithi097.stdout: 2024-09-14T11:01:00.209 INFO:tasks.workunit.client.0.smithi097.stderr:5+0 records in 2024-09-14T11:01:00.209 INFO:tasks.workunit.client.0.smithi097.stderr:5+0 records out 2024-09-14T11:01:00.209 INFO:tasks.workunit.client.0.smithi097.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0148333 s, 353 MB/s 2024-09-14T11:01:02.886 INFO:tasks.workunit.client.0.smithi097.stdout:bucket nams is reupload-bkt-124127 2024-09-14T11:01:02.887 INFO:tasks.workunit.client.0.smithi097.stdout:endpoint is http://smithi097.front.sepia.ceph.com:80 2024-09-14T11:01:02.887 INFO:tasks.workunit.client.0.smithi097.stdout:start UploadId=2~eNo5yDzhIm-utZhiyYyxxyQ4bEH1rly 2024-09-14T11:01:02.887 INFO:tasks.workunit.client.0.smithi097.stdout:phase 1 uploaded part {'ETag': '"67c3ecc31cea131fed196c3eaf11fc1a"', 'PartNumber': 1} 2024-09-14T11:01:02.887 INFO:tasks.workunit.client.0.smithi097.stdout:phase 1 uploaded part {'ETag': '"67c3ecc31cea131fed196c3eaf11fc1a"', 'PartNumber': 2} 2024-09-14T11:01:02.887 INFO:tasks.workunit.client.0.smithi097.stdout:phase 2 uploaded part {'ETag': '"67c3ecc31cea131fed196c3eaf11fc1a"', 'PartNumber': 1} 2024-09-14T11:01:02.887 INFO:tasks.workunit.client.0.smithi097.stdout:phase 2 uploaded part {'ETag': '"67c3ecc31cea131fed196c3eaf11fc1a"', 'PartNumber': 1} 2024-09-14T11:01:02.887 INFO:tasks.workunit.client.0.smithi097.stdout:phase 2 uploaded part {'ETag': '"67c3ecc31cea131fed196c3eaf11fc1a"', 'PartNumber': 1} 2024-09-14T11:01:02.888 INFO:tasks.workunit.client.0.smithi097.stdout:phase 2 uploaded part {'ETag': '"67c3ecc31cea131fed196c3eaf11fc1a"', 'PartNumber': 1} 2024-09-14T11:01:02.888 INFO:tasks.workunit.client.0.smithi097.stdout:phase 2 uploaded part {'ETag': '"67c3ecc31cea131fed196c3eaf11fc1a"', 'PartNumber': 1} 2024-09-14T11:01:02.888 INFO:tasks.workunit.client.0.smithi097.stdout:phase 2 uploaded part {'ETag': '"67c3ecc31cea131fed196c3eaf11fc1a"', 'PartNumber': 1} 2024-09-14T11:01:02.888 INFO:tasks.workunit.client.0.smithi097.stdout:phase 2 uploaded part {'ETag': '"67c3ecc31cea131fed196c3eaf11fc1a"', 'PartNumber': 1} 2024-09-14T11:01:02.888 INFO:tasks.workunit.client.0.smithi097.stdout:phase 2 uploaded part {'ETag': '"67c3ecc31cea131fed196c3eaf11fc1a"', 'PartNumber': 1} 2024-09-14T11:01:02.888 INFO:tasks.workunit.client.0.smithi097.stdout:phase 2 uploaded part {'ETag': '"67c3ecc31cea131fed196c3eaf11fc1a"', 'PartNumber': 1} 2024-09-14T11:01:02.888 INFO:tasks.workunit.client.0.smithi097.stdout:phase 2 uploaded part {'ETag': '"67c3ecc31cea131fed196c3eaf11fc1a"', 'PartNumber': 1} 2024-09-14T11:01:02.888 INFO:tasks.workunit.client.0.smithi097.stdout:phase 2 uploaded part {'ETag': '"67c3ecc31cea131fed196c3eaf11fc1a"', 'PartNumber': 1} 2024-09-14T11:01:02.888 INFO:tasks.workunit.client.0.smithi097.stdout:completing multipart upload, parts=[{'ETag': '"67c3ecc31cea131fed196c3eaf11fc1a"', 'PartNumber': 1}, {'ETag': '"67c3ecc31cea131fed196c3eaf11fc1a"', 'PartNumber': 2}] 2024-09-14T11:01:03.912 INFO:tasks.workunit.client.0.smithi097.stdout:radosgw-admin bucket radoslist: 2024-09-14T11:01:03.913 INFO:tasks.workunit.client.0.smithi097.stdout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3_mpu_test4 2024-09-14T11:01:03.913 INFO:tasks.workunit.client.0.smithi097.stdout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3__multipart_mpu_test4.2~eNo5yDzhIm-utZhiyYyxxyQ4bEH1rly.2 2024-09-14T11:01:03.913 INFO:tasks.workunit.client.0.smithi097.stdout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3__multipart_mpu_test4.ufjqv40AFxEFkqf62MBm7fBDjYBJkex7.1 2024-09-14T11:01:03.913 INFO:tasks.workunit.client.0.smithi097.stdout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3__:RIc64Pty5T.ySq.73ktyoLFXg5xeHM1_mpu_test4 2024-09-14T11:01:03.971 INFO:tasks.workunit.client.0.smithi097.stdout:rados ls: 2024-09-14T11:01:03.972 INFO:tasks.workunit.client.0.smithi097.stdout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3_mpu_test4 2024-09-14T11:01:03.972 INFO:tasks.workunit.client.0.smithi097.stdout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3__multipart_mpu_test4.2~eNo5yDzhIm-utZhiyYyxxyQ4bEH1rly.2 2024-09-14T11:01:03.972 INFO:tasks.workunit.client.0.smithi097.stdout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3__multipart_mpu_test4.ufjqv40AFxEFkqf62MBm7fBDjYBJkex7.1 2024-09-14T11:01:03.972 INFO:tasks.workunit.client.0.smithi097.stdout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3__:RIc64Pty5T.ySq.73ktyoLFXg5xeHM1_mpu_test4 2024-09-14T11:01:04.055 INFO:tasks.workunit.client.0.smithi097.stdout:== PASSED == 2024-09-14T11:01:04.056 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:01:04.056 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:01:04.137 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-09-14T11:01:04.137 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:01:04.505 DEBUG:teuthology.parallel:result is None 2024-09-14T11:01:04.506 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:01:04.545 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:01:04.545 DEBUG:teuthology.orchestra.run.smithi097:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:01:04.615 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:01:04.615 INFO:teuthology.run_tasks:Running task ragweed... 2024-09-14T11:01:04.630 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-09-14T11:01:04.630 INFO:tasks.ragweed:Downloading ragweed... 2024-09-14T11:01:04.630 INFO:tasks.ragweed:Using branch 'main' for ragweed 2024-09-14T11:01:04.631 DEBUG:teuthology.orchestra.run.smithi097:> git clone -b main https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-14T11:01:04.683 INFO:teuthology.orchestra.run.smithi097.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-14T11:01:04.714 INFO:teuthology.orchestra.run.smithi097.stderr:fatal: Remote branch main not found in upstream origin 2024-09-14T11:01:04.714 DEBUG:teuthology.orchestra.run:got remote process result: 128 2024-09-14T11:01:04.715 INFO:tasks.ragweed:Using branch 'ceph-master' for ragweed 2024-09-14T11:01:04.716 DEBUG:teuthology.orchestra.run.smithi097:> git clone -b ceph-master https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-14T11:01:04.784 INFO:teuthology.orchestra.run.smithi097.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-14T11:01:04.957 INFO:tasks.ragweed:Creating rgw users... 2024-09-14T11:01:04.957 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-09-14T11:01:04.958 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key KPZXPGGMFVDNXQQNIZOZ --secret 2NtH99kN0JTZigzUkKxeCEBXSSS+6BRpyKgP3SULak6eJRCHckrsyQ== --email ragweed.client.0+test@test.test --system false 2024-09-14T11:01:05.065 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:01:05.065 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:01:05.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.101+0000 7f97c980f800 20 rados->read ofs=0 len=0 2024-09-14T11:01:05.101 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.102+0000 7f97c980f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:01:05.101 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.102+0000 7f97c980f800 20 realm 2024-09-14T11:01:05.101 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.102+0000 7f97c980f800 20 rados->read ofs=0 len=0 2024-09-14T11:01:05.101 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.102+0000 7f97c980f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:01:05.102 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.102+0000 7f97c980f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:01:05.102 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.102+0000 7f97c980f800 20 rados->read ofs=0 len=0 2024-09-14T11:01:05.102 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.103+0000 7f97c980f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:01:05.102 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.103+0000 7f97c980f800 20 rados->read ofs=0 len=0 2024-09-14T11:01:05.103 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.103+0000 7f97c980f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:01:05.103 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.103+0000 7f97c980f800 20 rados->read ofs=0 len=0 2024-09-14T11:01:05.103 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.104+0000 7f97c980f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:01:05.103 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.104+0000 7f97c980f800 20 searching for the correct realm 2024-09-14T11:01:05.103 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.104+0000 7f97c72f9640 0 -- 172.21.15.97:0/27917118 >> [v2:172.21.15.152:6808/1010851305,v1:172.21.15.152:6809/1010851305] conn(0x56301588e070 msgr2=0x563015890530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:01:05.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.311+0000 7f97c72f9640 0 -- 172.21.15.97:0/27917118 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x563015881580 msgr2=0x563015883a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:01:05.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.318+0000 7f97c980f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:01:05.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.318+0000 7f97c980f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:01:05.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.318+0000 7f97c980f800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:01:05.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.318+0000 7f97c980f800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:01:05.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.318+0000 7f97c980f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:01:05.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.318+0000 7f97c980f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:01:05.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.318+0000 7f97c980f800 20 rados->read ofs=0 len=0 2024-09-14T11:01:05.318 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.318+0000 7f97c980f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:01:05.318 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.318+0000 7f97c980f800 20 rados->read ofs=0 len=0 2024-09-14T11:01:05.318 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.319+0000 7f97c980f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:01:05.318 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.319+0000 7f97c980f800 20 rados->read ofs=0 len=0 2024-09-14T11:01:05.319 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.319+0000 7f97c980f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:01:05.319 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.319+0000 7f97c980f800 20 zone default found 2024-09-14T11:01:05.319 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.319+0000 7f97c980f800 4 Realm: () 2024-09-14T11:01:05.320 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.319+0000 7f97c980f800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:01:05.320 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.319+0000 7f97c980f800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:01:05.320 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.319+0000 7f97c980f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:01:05.320 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.319+0000 7f97c980f800 20 zonegroup default 2024-09-14T11:01:05.320 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.319+0000 7f97c980f800 20 rados->read ofs=0 len=0 2024-09-14T11:01:05.320 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.319+0000 7f97c980f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:01:05.320 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.319+0000 7f97c980f800 20 rados->read ofs=0 len=0 2024-09-14T11:01:05.320 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.320+0000 7f97c980f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:01:05.320 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.320+0000 7f97c980f800 20 rados->read ofs=0 len=0 2024-09-14T11:01:05.320 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.320+0000 7f97c980f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:01:05.321 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.320+0000 7f97c980f800 20 started sync module instance, tier type = 2024-09-14T11:01:05.321 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.320+0000 7f97c980f800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:01:05.328 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.330+0000 7f97c980f800 20 add_watcher() i=0 2024-09-14T11:01:05.328 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.330+0000 7f97c980f800 20 add_watcher() i=1 2024-09-14T11:01:05.328 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.330+0000 7f97c980f800 20 add_watcher() i=2 2024-09-14T11:01:05.328 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.330+0000 7f97c980f800 20 add_watcher() i=3 2024-09-14T11:01:05.329 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.330+0000 7f97c980f800 20 add_watcher() i=4 2024-09-14T11:01:05.329 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.330+0000 7f97c980f800 20 add_watcher() i=5 2024-09-14T11:01:05.329 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.330+0000 7f97c980f800 20 add_watcher() i=6 2024-09-14T11:01:05.329 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.331+0000 7f97c980f800 20 add_watcher() i=7 2024-09-14T11:01:05.329 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.331+0000 7f97c980f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:01:05.332 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.332+0000 7f967dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:01:05.332 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.332+0000 7f97c980f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:01:05.332 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.333+0000 7f97c980f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:01:05.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.333+0000 7f97c980f800 5 note: GC not initialized 2024-09-14T11:01:05.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.333+0000 7f967cfe1640 20 reqs_thread_entry: start 2024-09-14T11:01:05.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.333+0000 7f97c980f800 20 init_complete bucket index max shards: 11 2024-09-14T11:01:05.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.333+0000 7f97c980f800 20 Filter name: none 2024-09-14T11:01:05.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.333+0000 7f95f67fc640 20 reqs_thread_entry: start 2024-09-14T11:01:05.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.333+0000 7f97c980f800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-14T11:01:05.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.333+0000 7f97c980f800 20 rados->read ofs=0 len=0 2024-09-14T11:01:05.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.333+0000 7f97c980f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:01:05.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.333+0000 7f97c980f800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-09-14T11:01:05.334 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.333+0000 7f97c980f800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:01:05.334 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.333+0000 7f97c980f800 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-09-14T11:01:05.334 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.333+0000 7f97c980f800 20 rados->read ofs=0 len=0 2024-09-14T11:01:05.334 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.334+0000 7f97c980f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:01:05.334 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.334+0000 7f97c980f800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-09-14T11:01:05.334 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.334+0000 7f97c980f800 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-14T11:01:05.334 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.334+0000 7f97c980f800 10 cache get: name=default.rgw.meta+users.keys+KPZXPGGMFVDNXQQNIZOZ : miss 2024-09-14T11:01:05.335 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.334+0000 7f97c980f800 20 rados->read ofs=0 len=0 2024-09-14T11:01:05.335 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.334+0000 7f97c980f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:01:05.335 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.334+0000 7f97c980f800 10 cache put: name=default.rgw.meta+users.keys+KPZXPGGMFVDNXQQNIZOZ info.flags=0x0 2024-09-14T11:01:05.335 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.334+0000 7f97c980f800 10 adding default.rgw.meta+users.keys+KPZXPGGMFVDNXQQNIZOZ to cache LRU end 2024-09-14T11:01:05.335 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.334+0000 7f97c980f800 10 cache get: name=default.rgw.meta+users.keys+KPZXPGGMFVDNXQQNIZOZ : hit (negative entry) 2024-09-14T11:01:05.335 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.334+0000 7f97c980f800 10 cache get: name=default.rgw.meta+users.keys+KPZXPGGMFVDNXQQNIZOZ : hit (negative entry) 2024-09-14T11:01:05.337 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.335+0000 7f97c980f800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-14T11:01:05.337 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.335+0000 7f97c980f800 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:01:05.337 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.335+0000 7f97c980f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-14T11:01:05.337 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.335+0000 7f96aaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791355 cookie 94764519732032 notifier 5654 bl.length()=675 2024-09-14T11:01:05.337 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.335+0000 7f96aaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-14T11:01:05.337 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.335+0000 7f96aaffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:01:05.337 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.337+0000 7f97c980f800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-14T11:01:05.337 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.337+0000 7f97c980f800 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-14T11:01:05.337 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.337+0000 7f97c980f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-14T11:01:05.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.337+0000 7f96aaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791305 cookie 94764519727984 notifier 5654 bl.length()=202 2024-09-14T11:01:05.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.337+0000 7f96aaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-14T11:01:05.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.337+0000 7f96aaffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-14T11:01:05.339 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.339+0000 7f97c980f800 10 cache put: name=default.rgw.meta+users.keys+KPZXPGGMFVDNXQQNIZOZ info.flags=0x7 2024-09-14T11:01:05.339 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.339+0000 7f97c980f800 10 moving default.rgw.meta+users.keys+KPZXPGGMFVDNXQQNIZOZ to cache LRU end 2024-09-14T11:01:05.339 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.339+0000 7f97c980f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:KPZXPGGMFVDNXQQNIZOZ, ofs0, ns] 2024-09-14T11:01:05.339 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.339+0000 7f96aa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791306 cookie 94764519665824 notifier 5654 bl.length()=190 2024-09-14T11:01:05.339 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.339+0000 7f96aa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+KPZXPGGMFVDNXQQNIZOZ info.flags=0x7 2024-09-14T11:01:05.339 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.339+0000 7f96aa7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+KPZXPGGMFVDNXQQNIZOZ to cache LRU end 2024-09-14T11:01:05.339 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-14T11:01:05.340 INFO:teuthology.orchestra.run.smithi097.stdout: "user_id": "ragweed.client.0", 2024-09-14T11:01:05.340 INFO:teuthology.orchestra.run.smithi097.stdout: "display_name": "Mr. ragweed.client.0", 2024-09-14T11:01:05.340 INFO:teuthology.orchestra.run.smithi097.stdout: "email": "ragweed.client.0+test@test.test", 2024-09-14T11:01:05.340 INFO:teuthology.orchestra.run.smithi097.stdout: "suspended": 0, 2024-09-14T11:01:05.340 INFO:teuthology.orchestra.run.smithi097.stdout: "max_buckets": 1000, 2024-09-14T11:01:05.340 INFO:teuthology.orchestra.run.smithi097.stdout: "subusers": [], 2024-09-14T11:01:05.340 INFO:teuthology.orchestra.run.smithi097.stdout: "keys": [ 2024-09-14T11:01:05.340 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-09-14T11:01:05.340 INFO:teuthology.orchestra.run.smithi097.stdout: "user": "ragweed.client.0", 2024-09-14T11:01:05.341 INFO:teuthology.orchestra.run.smithi097.stdout: "access_key": "KPZXPGGMFVDNXQQNIZOZ", 2024-09-14T11:01:05.341 INFO:teuthology.orchestra.run.smithi097.stdout: "secret_key": "2NtH99kN0JTZigzUkKxeCEBXSSS+6BRpyKgP3SULak6eJRCHckrsyQ==", 2024-09-14T11:01:05.341 INFO:teuthology.orchestra.run.smithi097.stdout: "active": true, 2024-09-14T11:01:05.341 INFO:teuthology.orchestra.run.smithi097.stdout: "create_date": "2024-09-14T11:01:05.335314Z" 2024-09-14T11:01:05.341 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-14T11:01:05.341 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2024-09-14T11:01:05.341 INFO:teuthology.orchestra.run.smithi097.stdout: "swift_keys": [], 2024-09-14T11:01:05.341 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": [], 2024-09-14T11:01:05.341 INFO:teuthology.orchestra.run.smithi097.stdout: "op_mask": "read, write, delete", 2024-09-14T11:01:05.341 INFO:teuthology.orchestra.run.smithi097.stdout: "default_placement": "", 2024-09-14T11:01:05.341 INFO:teuthology.orchestra.run.smithi097.stdout: "default_storage_class": "", 2024-09-14T11:01:05.342 INFO:teuthology.orchestra.run.smithi097.stdout: "placement_tags": [], 2024-09-14T11:01:05.342 INFO:teuthology.orchestra.run.smithi097.stdout: "bucket_quota": { 2024-09-14T11:01:05.342 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-14T11:01:05.342 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-14T11:01:05.342 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-14T11:01:05.342 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-14T11:01:05.342 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-14T11:01:05.342 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-14T11:01:05.342 INFO:teuthology.orchestra.run.smithi097.stdout: "user_quota": { 2024-09-14T11:01:05.342 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-14T11:01:05.342 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-14T11:01:05.342 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-14T11:01:05.342 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-14T11:01:05.343 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-14T11:01:05.343 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-14T11:01:05.343 INFO:teuthology.orchestra.run.smithi097.stdout: "temp_url_keys": [], 2024-09-14T11:01:05.343 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "rgw", 2024-09-14T11:01:05.343 INFO:teuthology.orchestra.run.smithi097.stdout: "mfa_ids": [], 2024-09-14T11:01:05.343 INFO:teuthology.orchestra.run.smithi097.stdout: "account_id": "", 2024-09-14T11:01:05.343 INFO:teuthology.orchestra.run.smithi097.stdout: "path": "/", 2024-09-14T11:01:05.343 INFO:teuthology.orchestra.run.smithi097.stdout: "create_date": "2024-09-14T11:01:05.335303Z", 2024-09-14T11:01:05.343 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2024-09-14T11:01:05.343 INFO:teuthology.orchestra.run.smithi097.stdout: "group_ids": [] 2024-09-14T11:01:05.343 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-14T11:01:05.343 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:01:05.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.340+0000 7f967dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:01:05.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.342+0000 7f97c980f800 20 remove_watcher() i=0 2024-09-14T11:01:05.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.342+0000 7f97c980f800 2 removed watcher, disabling cache 2024-09-14T11:01:05.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.343+0000 7f97c980f800 20 remove_watcher() i=1 2024-09-14T11:01:05.345 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.344+0000 7f97c980f800 20 remove_watcher() i=2 2024-09-14T11:01:05.345 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.345+0000 7f97c980f800 20 remove_watcher() i=3 2024-09-14T11:01:05.345 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.346+0000 7f97c980f800 20 remove_watcher() i=4 2024-09-14T11:01:05.346 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.348+0000 7f97c980f800 20 remove_watcher() i=5 2024-09-14T11:01:05.347 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.349+0000 7f97c980f800 20 remove_watcher() i=6 2024-09-14T11:01:05.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.350+0000 7f97c980f800 20 remove_watcher() i=7 2024-09-14T11:01:05.359 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-09-14T11:01:05.360 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key ORWSJQLTLMTFGHDNJQIL --secret xg2PMMulSfWSaH+tJ9JI3xEp3bM7MRDUSOIYxrdGpeTn848xM/qGcQ== --email sysuser.client.0+test@test.test --system true 2024-09-14T11:01:05.425 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:01:05.426 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:01:05.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.461+0000 7fa73d42f800 20 rados->read ofs=0 len=0 2024-09-14T11:01:05.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.463+0000 7fa73d42f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:01:05.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.463+0000 7fa73d42f800 20 realm 2024-09-14T11:01:05.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.463+0000 7fa73d42f800 20 rados->read ofs=0 len=0 2024-09-14T11:01:05.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.463+0000 7fa73d42f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:01:05.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.463+0000 7fa73d42f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:01:05.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.463+0000 7fa73d42f800 20 rados->read ofs=0 len=0 2024-09-14T11:01:05.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.463+0000 7fa73d42f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:01:05.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.463+0000 7fa73d42f800 20 rados->read ofs=0 len=0 2024-09-14T11:01:05.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.464+0000 7fa73d42f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:01:05.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.464+0000 7fa73d42f800 20 rados->read ofs=0 len=0 2024-09-14T11:01:05.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.465+0000 7fa73d42f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:01:05.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.465+0000 7fa73d42f800 20 searching for the correct realm 2024-09-14T11:01:05.467 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.467+0000 7fa738fcd640 0 -- 172.21.15.97:0/3818331714 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7fa720028030 msgr2=0x7fa7200203b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:01:05.671 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.672+0000 7fa72ffff640 0 -- 172.21.15.97:0/3818331714 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7fa72803f440 msgr2=0x7fa72803f8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:01:05.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.678+0000 7fa73d42f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:01:05.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.678+0000 7fa73d42f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:01:05.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.678+0000 7fa73d42f800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:01:05.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.678+0000 7fa73d42f800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:01:05.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.678+0000 7fa73d42f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:01:05.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.678+0000 7fa73d42f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:01:05.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.678+0000 7fa73d42f800 20 rados->read ofs=0 len=0 2024-09-14T11:01:05.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.678+0000 7fa73d42f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:01:05.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.678+0000 7fa73d42f800 20 rados->read ofs=0 len=0 2024-09-14T11:01:05.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.678+0000 7fa73d42f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:01:05.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.678+0000 7fa73d42f800 20 rados->read ofs=0 len=0 2024-09-14T11:01:05.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.679+0000 7fa73d42f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:01:05.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.679+0000 7fa73d42f800 20 zone default found 2024-09-14T11:01:05.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.679+0000 7fa73d42f800 4 Realm: () 2024-09-14T11:01:05.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.679+0000 7fa73d42f800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:01:05.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.679+0000 7fa73d42f800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:01:05.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.679+0000 7fa73d42f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:01:05.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.679+0000 7fa73d42f800 20 zonegroup default 2024-09-14T11:01:05.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.679+0000 7fa73d42f800 20 rados->read ofs=0 len=0 2024-09-14T11:01:05.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.679+0000 7fa73d42f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:01:05.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.679+0000 7fa73d42f800 20 rados->read ofs=0 len=0 2024-09-14T11:01:05.680 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.679+0000 7fa73d42f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:01:05.680 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.679+0000 7fa73d42f800 20 rados->read ofs=0 len=0 2024-09-14T11:01:05.680 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.679+0000 7fa73d42f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:01:05.680 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.679+0000 7fa73d42f800 20 started sync module instance, tier type = 2024-09-14T11:01:05.680 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.679+0000 7fa73d42f800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:01:05.688 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.689+0000 7fa73d42f800 20 add_watcher() i=0 2024-09-14T11:01:05.688 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.689+0000 7fa73d42f800 20 add_watcher() i=1 2024-09-14T11:01:05.688 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.689+0000 7fa73d42f800 20 add_watcher() i=2 2024-09-14T11:01:05.688 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.689+0000 7fa73d42f800 20 add_watcher() i=3 2024-09-14T11:01:05.688 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.689+0000 7fa73d42f800 20 add_watcher() i=4 2024-09-14T11:01:05.688 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.689+0000 7fa73d42f800 20 add_watcher() i=5 2024-09-14T11:01:05.688 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.689+0000 7fa73d42f800 20 add_watcher() i=6 2024-09-14T11:01:05.689 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.690+0000 7fa73d42f800 20 add_watcher() i=7 2024-09-14T11:01:05.689 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.690+0000 7fa73d42f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:01:05.691 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.692+0000 7fa5ef7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:01:05.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.692+0000 7fa73d42f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:01:05.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.692+0000 7fa73d42f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:01:05.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.692+0000 7fa73d42f800 5 note: GC not initialized 2024-09-14T11:01:05.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.693+0000 7fa5ee7dc640 20 reqs_thread_entry: start 2024-09-14T11:01:05.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.693+0000 7fa73d42f800 20 init_complete bucket index max shards: 11 2024-09-14T11:01:05.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.693+0000 7fa73d42f800 20 Filter name: none 2024-09-14T11:01:05.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.693+0000 7fa5e77fe640 20 reqs_thread_entry: start 2024-09-14T11:01:05.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.693+0000 7fa73d42f800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-14T11:01:05.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.693+0000 7fa73d42f800 20 rados->read ofs=0 len=0 2024-09-14T11:01:05.694 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.693+0000 7fa73d42f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:01:05.694 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.693+0000 7fa73d42f800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-09-14T11:01:05.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.693+0000 7fa73d42f800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:01:05.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.693+0000 7fa73d42f800 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-09-14T11:01:05.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.693+0000 7fa73d42f800 20 rados->read ofs=0 len=0 2024-09-14T11:01:05.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.694+0000 7fa73d42f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:01:05.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.694+0000 7fa73d42f800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-09-14T11:01:05.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.694+0000 7fa73d42f800 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-14T11:01:05.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.694+0000 7fa73d42f800 10 cache get: name=default.rgw.meta+users.keys+ORWSJQLTLMTFGHDNJQIL : miss 2024-09-14T11:01:05.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.694+0000 7fa73d42f800 20 rados->read ofs=0 len=0 2024-09-14T11:01:05.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.694+0000 7fa73d42f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:01:05.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.694+0000 7fa73d42f800 10 cache put: name=default.rgw.meta+users.keys+ORWSJQLTLMTFGHDNJQIL info.flags=0x0 2024-09-14T11:01:05.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.694+0000 7fa73d42f800 10 adding default.rgw.meta+users.keys+ORWSJQLTLMTFGHDNJQIL to cache LRU end 2024-09-14T11:01:05.696 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.694+0000 7fa73d42f800 10 cache get: name=default.rgw.meta+users.keys+ORWSJQLTLMTFGHDNJQIL : hit (negative entry) 2024-09-14T11:01:05.696 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.694+0000 7fa73d42f800 10 cache get: name=default.rgw.meta+users.keys+ORWSJQLTLMTFGHDNJQIL : hit (negative entry) 2024-09-14T11:01:05.696 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.695+0000 7fa73d42f800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-14T11:01:05.696 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.695+0000 7fa73d42f800 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:01:05.696 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.695+0000 7fa73d42f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-14T11:01:05.696 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.696+0000 7fa60f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791306 cookie 94914643700528 notifier 5937 bl.length()=675 2024-09-14T11:01:05.696 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.696+0000 7fa60f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-14T11:01:05.696 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.696+0000 7fa60f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:01:05.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.697+0000 7fa73d42f800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-14T11:01:05.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.697+0000 7fa73d42f800 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-14T11:01:05.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.697+0000 7fa73d42f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-14T11:01:05.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.697+0000 7fa60effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791356 cookie 94914643708096 notifier 5937 bl.length()=202 2024-09-14T11:01:05.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.697+0000 7fa60effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-14T11:01:05.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.697+0000 7fa60effd640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-14T11:01:05.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.699+0000 7fa73d42f800 10 cache put: name=default.rgw.meta+users.keys+ORWSJQLTLMTFGHDNJQIL info.flags=0x7 2024-09-14T11:01:05.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.699+0000 7fa73d42f800 10 moving default.rgw.meta+users.keys+ORWSJQLTLMTFGHDNJQIL to cache LRU end 2024-09-14T11:01:05.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.699+0000 7fa73d42f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:ORWSJQLTLMTFGHDNJQIL, ofs0, ns] 2024-09-14T11:01:05.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.700+0000 7fa60effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791364 cookie 94914643714208 notifier 5937 bl.length()=190 2024-09-14T11:01:05.699 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.700+0000 7fa60effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+ORWSJQLTLMTFGHDNJQIL info.flags=0x7 2024-09-14T11:01:05.699 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.700+0000 7fa60effd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+ORWSJQLTLMTFGHDNJQIL to cache LRU end 2024-09-14T11:01:05.699 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-14T11:01:05.699 INFO:teuthology.orchestra.run.smithi097.stdout: "user_id": "sysuser.client.0", 2024-09-14T11:01:05.699 INFO:teuthology.orchestra.run.smithi097.stdout: "display_name": "Mr. sysuser.client.0", 2024-09-14T11:01:05.700 INFO:teuthology.orchestra.run.smithi097.stdout: "email": "sysuser.client.0+test@test.test", 2024-09-14T11:01:05.700 INFO:teuthology.orchestra.run.smithi097.stdout: "suspended": 0, 2024-09-14T11:01:05.700 INFO:teuthology.orchestra.run.smithi097.stdout: "max_buckets": 1000, 2024-09-14T11:01:05.700 INFO:teuthology.orchestra.run.smithi097.stdout: "subusers": [], 2024-09-14T11:01:05.700 INFO:teuthology.orchestra.run.smithi097.stdout: "keys": [ 2024-09-14T11:01:05.700 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-09-14T11:01:05.700 INFO:teuthology.orchestra.run.smithi097.stdout: "user": "sysuser.client.0", 2024-09-14T11:01:05.700 INFO:teuthology.orchestra.run.smithi097.stdout: "access_key": "ORWSJQLTLMTFGHDNJQIL", 2024-09-14T11:01:05.701 INFO:teuthology.orchestra.run.smithi097.stdout: "secret_key": "xg2PMMulSfWSaH+tJ9JI3xEp3bM7MRDUSOIYxrdGpeTn848xM/qGcQ==", 2024-09-14T11:01:05.701 INFO:teuthology.orchestra.run.smithi097.stdout: "active": true, 2024-09-14T11:01:05.701 INFO:teuthology.orchestra.run.smithi097.stdout: "create_date": "2024-09-14T11:01:05.695348Z" 2024-09-14T11:01:05.701 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-14T11:01:05.701 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2024-09-14T11:01:05.701 INFO:teuthology.orchestra.run.smithi097.stdout: "swift_keys": [], 2024-09-14T11:01:05.702 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": [], 2024-09-14T11:01:05.702 INFO:teuthology.orchestra.run.smithi097.stdout: "op_mask": "read, write, delete", 2024-09-14T11:01:05.702 INFO:teuthology.orchestra.run.smithi097.stdout: "system": true, 2024-09-14T11:01:05.702 INFO:teuthology.orchestra.run.smithi097.stdout: "default_placement": "", 2024-09-14T11:01:05.702 INFO:teuthology.orchestra.run.smithi097.stdout: "default_storage_class": "", 2024-09-14T11:01:05.702 INFO:teuthology.orchestra.run.smithi097.stdout: "placement_tags": [], 2024-09-14T11:01:05.703 INFO:teuthology.orchestra.run.smithi097.stdout: "bucket_quota": { 2024-09-14T11:01:05.703 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-14T11:01:05.703 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-14T11:01:05.703 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-14T11:01:05.703 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-14T11:01:05.703 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-14T11:01:05.703 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-14T11:01:05.703 INFO:teuthology.orchestra.run.smithi097.stdout: "user_quota": { 2024-09-14T11:01:05.703 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-14T11:01:05.703 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-14T11:01:05.703 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-14T11:01:05.703 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-14T11:01:05.704 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-14T11:01:05.704 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-14T11:01:05.704 INFO:teuthology.orchestra.run.smithi097.stdout: "temp_url_keys": [], 2024-09-14T11:01:05.704 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "rgw", 2024-09-14T11:01:05.704 INFO:teuthology.orchestra.run.smithi097.stdout: "mfa_ids": [], 2024-09-14T11:01:05.704 INFO:teuthology.orchestra.run.smithi097.stdout: "account_id": "", 2024-09-14T11:01:05.704 INFO:teuthology.orchestra.run.smithi097.stdout: "path": "/", 2024-09-14T11:01:05.704 INFO:teuthology.orchestra.run.smithi097.stdout: "create_date": "2024-09-14T11:01:05.695331Z", 2024-09-14T11:01:05.705 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2024-09-14T11:01:05.705 INFO:teuthology.orchestra.run.smithi097.stdout: "group_ids": [] 2024-09-14T11:01:05.705 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-14T11:01:05.705 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:01:05.705 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.701+0000 7fa5ef7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:01:05.705 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.703+0000 7fa73d42f800 20 remove_watcher() i=0 2024-09-14T11:01:05.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.703+0000 7fa73d42f800 2 removed watcher, disabling cache 2024-09-14T11:01:05.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.704+0000 7fa73d42f800 20 remove_watcher() i=1 2024-09-14T11:01:05.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.706+0000 7fa73d42f800 20 remove_watcher() i=2 2024-09-14T11:01:05.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.706+0000 7fa73d42f800 20 remove_watcher() i=3 2024-09-14T11:01:05.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.707+0000 7fa73d42f800 20 remove_watcher() i=4 2024-09-14T11:01:05.707 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.708+0000 7fa73d42f800 20 remove_watcher() i=5 2024-09-14T11:01:05.708 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.709+0000 7fa73d42f800 20 remove_watcher() i=6 2024-09-14T11:01:05.709 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:05.711+0000 7fa73d42f800 20 remove_watcher() i=7 2024-09-14T11:01:05.720 INFO:tasks.ragweed:Configuring ragweed... 2024-09-14T11:01:05.720 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-14T11:01:05.720 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-09-14T11:01:05.750 INFO:tasks.ragweed:Configuring boto... 2024-09-14T11:01:05.750 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-14T11:01:05.750 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-09-14T11:01:05.819 DEBUG:teuthology.orchestra.run.smithi097:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-09-14T11:01:06.009 INFO:teuthology.orchestra.run.smithi097.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-09-14T11:01:06.172 INFO:teuthology.orchestra.run.smithi097.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-09-14T11:01:06.749 INFO:teuthology.orchestra.run.smithi097.stdout:py installdeps: -rrequirements.txt 2024-09-14T11:01:12.752 INFO:teuthology.orchestra.run.smithi097.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-09-14T11:01:16.102 INFO:teuthology.orchestra.run.smithi097.stdout:py installed: asyncssh==2.13.2,Babel==2.9.1,bcrypt==3.2.2,boto==2.49.0,cachetools==4.2.4,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2023.5.7,cffi==1.14.5,chardet==4.0.0,cheroot==8.6.0,CherryPy==18.6.1,cockpit @ file:///builddir/build/BUILD/cockpit-323/tmp/wheel/cockpit-323-py3-none-any.whl,cryptography==36.0.1,dasbus==1.4,dbus-python==1.2.18,distro==1.5.0,docopt==0.6.2,exceptiongroup==1.2.2,execnet==2.1.1,file-magic==0.4.0,gevent==24.2.1,google-auth==2.34.0,gpg==1.15.1,greenlet==3.1.0,grpcio==1.46.7,grpcio-tools==1.46.7,httplib2==0.22.0,idna==2.10,iniconfig==2.0.0,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.0.0,jaraco.functools==3.5.0,jaraco.text==3.2.0,Jinja2==2.11.3,jsonpatch==1.21,jsonpointer==2.0,kubernetes==26.1.0,libcomps==0.1.18,logutils==0.3.5,lxml==4.6.5,Mako==1.1.4.dev0,MarkupSafe==1.1.1,more-itertools==8.12.0,munch==4.0.0,natsort==7.1.1,nftables==0.1,numpy==1.20.1,oauthlib==3.1.1,packaging==20.9,pecan==1.4.2,perf==0.1,pexpect==4.8.0,pluggy==1.5.0,ply==3.11,portend==3.1.0,prettytable==0.7.2,protobuf==3.14.0,psutil==5.8.0,ptyprocess==0.6.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.20,PyGObject==3.40.1,pyOpenSSL==21.0.0,pyparsing==2.4.7,PySocks==1.7.1,pytest==8.3.3,python-dateutil==2.8.1,python-linux-procfs==0.7.3,pytz==2021.1,pyudev==0.22.0,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=daee11f8b3d4387a0e1215b86e0d00728c63156f6f3fda61a83f0d9967b6e61d,rbd==2.0.0,registries-conf-ctl==1.0,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rpm==4.16.1.3,rsa==4.9,s3cmd==2.4.0,scipy==1.6.2,selinux==3.6,sepolicy==3.6,setools==4.4.4,setroubleshoot @ file:///builddir/build/BUILD/setroubleshoot-3.3.32/src,six==1.15.0,systemd-python==234,tempora==5.0.0,toml==0.10.2,tomli==2.0.1,typing_extensions==4.12.2,urllib3==1.26.5,WebOb==1.8.8,websocket-client==1.2.3,Werkzeug==2.0.3,zc.lockfile==2.0,zope.event==5.0,zope.interface==7.0.3 2024-09-14T11:01:16.102 INFO:teuthology.orchestra.run.smithi097.stdout:py run-test-pre: PYTHONHASHSEED='735498021' 2024-09-14T11:01:16.102 INFO:teuthology.orchestra.run.smithi097.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-09-14T11:01:16.291 INFO:teuthology.orchestra.run.smithi097.stdout:============================= test session starts ============================== 2024-09-14T11:01:16.291 INFO:teuthology.orchestra.run.smithi097.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-09-14T11:01:16.291 INFO:teuthology.orchestra.run.smithi097.stdout:cachedir: .tox/py/.pytest_cache 2024-09-14T11:01:16.292 INFO:teuthology.orchestra.run.smithi097.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0 2024-09-14T11:01:16.292 INFO:teuthology.orchestra.run.smithi097.stdout:configfile: pytest.ini 2024-09-14T11:01:16.386 INFO:teuthology.orchestra.run.smithi097.stdout:collecting ... collected 9 items 2024-09-14T11:01:16.386 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:01:16.866 INFO:teuthology.orchestra.run.smithi097.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-09-14T11:01:17.368 INFO:teuthology.orchestra.run.smithi097.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-09-14T11:01:17.799 INFO:teuthology.orchestra.run.smithi097.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-09-14T11:01:18.398 INFO:teuthology.orchestra.run.smithi097.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-09-14T11:01:18.995 INFO:teuthology.orchestra.run.smithi097.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-09-14T11:01:25.298 INFO:teuthology.orchestra.run.smithi097.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-09-14T11:01:26.534 INFO:teuthology.orchestra.run.smithi097.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-09-14T11:01:27.668 INFO:teuthology.orchestra.run.smithi097.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-09-14T11:01:29.809 INFO:teuthology.orchestra.run.smithi097.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-09-14T11:01:29.810 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:01:29.810 INFO:teuthology.orchestra.run.smithi097.stdout:=============================== warnings summary =============================== 2024-09-14T11:01:29.810 INFO:teuthology.orchestra.run.smithi097.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-14T11:01:29.810 INFO:teuthology.orchestra.run.smithi097.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-14T11:01:29.810 INFO:teuthology.orchestra.run.smithi097.stdout: import imp 2024-09-14T11:01:29.810 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:01:29.810 INFO:teuthology.orchestra.run.smithi097.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-14T11:01:29.810 INFO:teuthology.orchestra.run.smithi097.stdout:======================== 9 passed, 1 warning in 13.52s ========================= 2024-09-14T11:01:29.839 INFO:teuthology.orchestra.run.smithi097.stdout:___________________________________ summary ____________________________________ 2024-09-14T11:01:29.839 INFO:teuthology.orchestra.run.smithi097.stdout: py: commands succeeded 2024-09-14T11:01:29.839 INFO:teuthology.orchestra.run.smithi097.stdout: congratulations :) 2024-09-14T11:01:29.856 INFO:tasks.ragweed:Cleaning up boto... 2024-09-14T11:01:29.857 DEBUG:teuthology.orchestra.run.smithi097:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-09-14T11:01:29.886 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-09-14T11:01:29.983 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:01:29.983 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:01:30.017 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.018+0000 7fc98eb42800 20 rados->read ofs=0 len=0 2024-09-14T11:01:30.020 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.020+0000 7fc98eb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:01:30.020 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.020+0000 7fc98eb42800 20 realm 2024-09-14T11:01:30.020 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.020+0000 7fc98eb42800 20 rados->read ofs=0 len=0 2024-09-14T11:01:30.020 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.021+0000 7fc98eb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:01:30.020 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.021+0000 7fc98eb42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:01:30.020 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.021+0000 7fc98eb42800 20 rados->read ofs=0 len=0 2024-09-14T11:01:30.020 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.021+0000 7fc98eb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:01:30.020 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.021+0000 7fc98eb42800 20 rados->read ofs=0 len=0 2024-09-14T11:01:30.021 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.021+0000 7fc98eb42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:01:30.021 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.021+0000 7fc98eb42800 20 rados->read ofs=0 len=0 2024-09-14T11:01:30.223 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.225+0000 7fc98eb42800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:01:30.223 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.225+0000 7fc98eb42800 20 searching for the correct realm 2024-09-14T11:01:30.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.226+0000 7fc98a0ec640 0 -- 172.21.15.97:0/1292727890 >> [v2:172.21.15.97:6808/2081705332,v1:172.21.15.97:6809/2081705332] conn(0x7fc97c061040 msgr2=0x7fc97c055410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:01:30.228 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.230+0000 7fc98a8ed640 0 -- 172.21.15.97:0/1292727890 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7fc974088a60 msgr2=0x7fc974042ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:01:30.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.438+0000 7fc98eb42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:01:30.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.438+0000 7fc98eb42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:01:30.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.438+0000 7fc98eb42800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:01:30.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.438+0000 7fc98eb42800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:01:30.438 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.438+0000 7fc98eb42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:01:30.438 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.438+0000 7fc98eb42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:01:30.438 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.438+0000 7fc98eb42800 20 rados->read ofs=0 len=0 2024-09-14T11:01:30.438 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.438+0000 7fc98eb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:01:30.438 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.438+0000 7fc98eb42800 20 rados->read ofs=0 len=0 2024-09-14T11:01:30.438 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.439+0000 7fc98eb42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:01:30.438 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.439+0000 7fc98eb42800 20 rados->read ofs=0 len=0 2024-09-14T11:01:30.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.439+0000 7fc98eb42800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:01:30.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.439+0000 7fc98eb42800 20 zone default found 2024-09-14T11:01:30.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.439+0000 7fc98eb42800 4 Realm: () 2024-09-14T11:01:30.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.439+0000 7fc98eb42800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:01:30.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.439+0000 7fc98eb42800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:01:30.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.439+0000 7fc98eb42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:01:30.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.439+0000 7fc98eb42800 20 zonegroup default 2024-09-14T11:01:30.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.439+0000 7fc98eb42800 20 rados->read ofs=0 len=0 2024-09-14T11:01:30.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.439+0000 7fc98eb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:01:30.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.439+0000 7fc98eb42800 20 rados->read ofs=0 len=0 2024-09-14T11:01:30.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.440+0000 7fc98eb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:01:30.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.440+0000 7fc98eb42800 20 rados->read ofs=0 len=0 2024-09-14T11:01:30.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.440+0000 7fc98eb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:01:30.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.440+0000 7fc98eb42800 20 started sync module instance, tier type = 2024-09-14T11:01:30.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.440+0000 7fc98eb42800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:01:30.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.450+0000 7fc98eb42800 20 add_watcher() i=0 2024-09-14T11:01:30.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.450+0000 7fc98eb42800 20 add_watcher() i=1 2024-09-14T11:01:30.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.450+0000 7fc98eb42800 20 add_watcher() i=2 2024-09-14T11:01:30.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.450+0000 7fc98eb42800 20 add_watcher() i=3 2024-09-14T11:01:30.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.450+0000 7fc98eb42800 20 add_watcher() i=4 2024-09-14T11:01:30.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.450+0000 7fc98eb42800 20 add_watcher() i=5 2024-09-14T11:01:30.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.450+0000 7fc98eb42800 20 add_watcher() i=6 2024-09-14T11:01:30.450 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.452+0000 7fc98eb42800 20 add_watcher() i=7 2024-09-14T11:01:30.450 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.452+0000 7fc98eb42800 2 all 8 watchers are set, enabling cache 2024-09-14T11:01:30.452 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.454+0000 7fc8417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:01:30.452 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.454+0000 7fc98eb42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:01:30.452 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.454+0000 7fc98eb42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:01:30.490 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.491+0000 7fc7bbfff640 20 reqs_thread_entry: start 2024-09-14T11:01:30.490 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.491+0000 7fc98eb42800 20 init_complete bucket index max shards: 11 2024-09-14T11:01:30.490 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.491+0000 7fc98eb42800 20 Filter name: none 2024-09-14T11:01:30.491 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.491+0000 7fc7b9ffb640 20 reqs_thread_entry: start 2024-09-14T11:01:30.491 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.491+0000 7fc98eb42800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-14T11:01:30.491 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.491+0000 7fc98eb42800 20 rados->read ofs=0 len=0 2024-09-14T11:01:30.491 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.492+0000 7fc98eb42800 20 rados_obj.operate() r=0 bl.length=486 2024-09-14T11:01:30.491 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.492+0000 7fc98eb42800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-09-14T11:01:30.491 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.492+0000 7fc98eb42800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:01:30.491 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.492+0000 7fc98eb42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:01:30.492 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.492+0000 7fc98eb42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4 : miss 2024-09-14T11:01:30.492 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.492+0000 7fc98eb42800 20 rados->read ofs=0 len=0 2024-09-14T11:01:30.492 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.493+0000 7fc98eb42800 20 rados_obj.operate() r=0 bl.length=426 2024-09-14T11:01:30.492 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.493+0000 7fc98eb42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4 info.flags=0x17 2024-09-14T11:01:30.492 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.493+0000 7fc98eb42800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4 to cache LRU end 2024-09-14T11:01:30.492 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.493+0000 7fc98eb42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:01:30.492 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.493+0000 7fc98eb42800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:01:30.492 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.493+0000 7fc98eb42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4 2024-09-14T11:01:30.492 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.494+0000 7fc98eb42800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-09-14T11:01:30.493 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.494+0000 7fc98eb42800 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-09-14T11:01:30.493 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.494+0000 7fc98eb42800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-09-14T11:01:30.493 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.494+0000 7fc98eb42800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-09-14T11:01:30.493 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.495+0000 7fc98eb42800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-09-14T11:01:30.493 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.495+0000 7fc98eb42800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-09-14T11:01:30.494 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.495+0000 7fc98eb42800 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-09-14T11:01:30.494 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.496+0000 7fc98eb42800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-09-14T11:01:30.495 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.497+0000 7fc98eb42800 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-09-14T11:01:30.496 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.497+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc9840266d0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x563e4ab97ca8 s->prefetch_data=0 2024-09-14T11:01:30.496 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.498+0000 7fc98eb42800 10 manifest: total_size = 15939 2024-09-14T11:01:30.496 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.498+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5191357837158127895 2024-09-14T11:01:30.496 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.498+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc9840266d0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x563e4ab97ca8 s->prefetch_data=0 2024-09-14T11:01:30.497 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.498+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4ab97ca8 2024-09-14T11:01:30.497 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.498+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4.1 2024-09-14T11:01:30.499 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.500+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:01:30.499 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.500+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=15939 stripe_ofs=15939 part_ofs=0 rule->part_size=0 2024-09-14T11:01:30.499 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.500+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5191357837158127895 2024-09-14T11:01:30.499 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.500+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:01:30.499 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.500+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4__shadow_.OwpHdT2xQCO08IJnUozDkJ97pNWCf0f_0 2024-09-14T11:01:30.499 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.500+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:01:30.499 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.500+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:01:30.499 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.500+0000 7fc98eb42800 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5191357837158127895 2024-09-14T11:01:30.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.501+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc9840266d0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x563e4ab97c88 s->prefetch_data=0 2024-09-14T11:01:30.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.501+0000 7fc86e7fc640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-09-14T11:01:30.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.502+0000 7fc98eb42800 10 manifest: total_size = 7489 2024-09-14T11:01:30.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.502+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6230597089339443576 2024-09-14T11:01:30.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.502+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc9840266d0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x563e4ab97c88 s->prefetch_data=0 2024-09-14T11:01:30.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.502+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4ab97c88 2024-09-14T11:01:30.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.502+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4.2 2024-09-14T11:01:30.502 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.504+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:01:30.502 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.504+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=7489 stripe_ofs=7489 part_ofs=0 rule->part_size=0 2024-09-14T11:01:30.502 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.504+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6230597089339443576 2024-09-14T11:01:30.503 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.504+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:01:30.503 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.504+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4__shadow_.qZsRP7obGqd3vyh57Wvq8UuGqVONFO0_0 2024-09-14T11:01:30.503 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.504+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:01:30.503 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.504+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:01:30.503 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.504+0000 7fc98eb42800 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6230597089339443576 2024-09-14T11:01:30.503 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.505+0000 7fc86dffb640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-09-14T11:01:30.504 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.505+0000 7fc98eb42800 20 get_obj_state: octx=0x563e4ab17b40 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x563e4ab1d2e8 s->prefetch_data=0 2024-09-14T11:01:30.504 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.506+0000 7fc98eb42800 10 manifest: total_size = 7728 2024-09-14T11:01:30.504 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.506+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13499261806152956069 2024-09-14T11:01:30.505 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.506+0000 7fc98eb42800 20 get_obj_state: octx=0x563e4ab17b40 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x563e4ab1d2e8 s->prefetch_data=0 2024-09-14T11:01:30.505 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.506+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4ab1d2e8 2024-09-14T11:01:30.505 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.506+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4.2 2024-09-14T11:01:30.506 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.508+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:01:30.506 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.508+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=7728 stripe_ofs=7728 part_ofs=0 rule->part_size=0 2024-09-14T11:01:30.506 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.508+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13499261806152956069 2024-09-14T11:01:30.507 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.508+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:01:30.507 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.508+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4__shadow_.xx59Z-ydnMnmLdW7b_rYhwQQaMttRNv_0 2024-09-14T11:01:30.507 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.508+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:01:30.507 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.508+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:01:30.507 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.508+0000 7fc98eb42800 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13499261806152956069 2024-09-14T11:01:30.507 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.509+0000 7fc86e7fc640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-09-14T11:01:30.507 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.509+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc9840266d0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x563e4ab1d2e8 s->prefetch_data=0 2024-09-14T11:01:30.508 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.510+0000 7fc98eb42800 10 manifest: total_size = 7655 2024-09-14T11:01:30.508 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.510+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15731904942047451965 2024-09-14T11:01:30.508 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.510+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc9840266d0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x563e4ab1d2e8 s->prefetch_data=0 2024-09-14T11:01:30.508 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.510+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4ab1d2e8 2024-09-14T11:01:30.508 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.510+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4.3 2024-09-14T11:01:30.511 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.512+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:01:30.511 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.512+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=7655 stripe_ofs=7655 part_ofs=0 rule->part_size=0 2024-09-14T11:01:30.511 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.512+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15731904942047451965 2024-09-14T11:01:30.511 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.512+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:01:30.511 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.512+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4__shadow_.8fuldMuK5o3W1hBUCrCMW4BS-yF-66M_0 2024-09-14T11:01:30.511 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.512+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:01:30.511 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.512+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:01:30.511 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.512+0000 7fc98eb42800 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15731904942047451965 2024-09-14T11:01:30.512 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.513+0000 7fc86dffb640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-09-14T11:01:30.512 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.514+0000 7fc98eb42800 20 get_obj_state: octx=0x563e4ab99f20 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x563e4ab1d2e8 s->prefetch_data=0 2024-09-14T11:01:30.512 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.514+0000 7fc98eb42800 10 manifest: total_size = 13072 2024-09-14T11:01:30.512 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.514+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17164155466848276297 2024-09-14T11:01:30.512 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.514+0000 7fc98eb42800 20 get_obj_state: octx=0x563e4ab99f20 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x563e4ab1d2e8 s->prefetch_data=0 2024-09-14T11:01:30.513 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.514+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4ab1d2e8 2024-09-14T11:01:30.513 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.514+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4.4 2024-09-14T11:01:30.514 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.516+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:01:30.514 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.516+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=13072 stripe_ofs=13072 part_ofs=0 rule->part_size=0 2024-09-14T11:01:30.514 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.516+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17164155466848276297 2024-09-14T11:01:30.515 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.516+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:01:30.515 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.516+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4__shadow_.NnR-967UFyG52r1SiDhpT4ijkd95SdL_0 2024-09-14T11:01:30.515 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.516+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:01:30.515 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.516+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:01:30.515 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.516+0000 7fc98eb42800 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17164155466848276297 2024-09-14T11:01:30.515 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.517+0000 7fc86e7fc640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-09-14T11:01:30.515 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.517+0000 7fc98eb42800 20 get_obj_state: octx=0x563e4ab216b0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x563e4ab1d2e8 s->prefetch_data=0 2024-09-14T11:01:30.517 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.518+0000 7fc98eb42800 10 manifest: total_size = 5201 2024-09-14T11:01:30.517 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.518+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5429439615894379303 2024-09-14T11:01:30.517 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.518+0000 7fc98eb42800 20 get_obj_state: octx=0x563e4ab216b0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x563e4ab1d2e8 s->prefetch_data=0 2024-09-14T11:01:30.517 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.518+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4ab1d2e8 2024-09-14T11:01:30.517 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.518+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4.4 2024-09-14T11:01:30.519 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.521+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:01:30.519 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.521+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=5201 stripe_ofs=5201 part_ofs=0 rule->part_size=0 2024-09-14T11:01:30.519 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.521+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5429439615894379303 2024-09-14T11:01:30.519 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.521+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:01:30.519 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.521+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4__shadow_.tQFIAa6iqJXRycIcW3_92okuxmYjSc-_0 2024-09-14T11:01:30.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.521+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:01:30.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.521+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:01:30.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.521+0000 7fc98eb42800 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5429439615894379303 2024-09-14T11:01:30.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.521+0000 7fc86dffb640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-09-14T11:01:30.521 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.522+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc984078430 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x563e4ab1d2e8 s->prefetch_data=0 2024-09-14T11:01:30.521 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.523+0000 7fc98eb42800 10 manifest: total_size = 7414 2024-09-14T11:01:30.521 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.523+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1233803733840229549 2024-09-14T11:01:30.521 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.523+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc984078430 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x563e4ab1d2e8 s->prefetch_data=0 2024-09-14T11:01:30.521 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.523+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4ab1d2e8 2024-09-14T11:01:30.521 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.523+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4.5 2024-09-14T11:01:30.523 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.525+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:01:30.523 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.525+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=7414 stripe_ofs=7414 part_ofs=0 rule->part_size=0 2024-09-14T11:01:30.524 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.525+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1233803733840229549 2024-09-14T11:01:30.524 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.525+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:01:30.524 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.525+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4__shadow_.CZ_34ec1GPNYR-Ws0nzYDr0FNPJc2Ap_0 2024-09-14T11:01:30.524 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.525+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:01:30.524 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.525+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:01:30.524 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.525+0000 7fc98eb42800 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1233803733840229549 2024-09-14T11:01:30.524 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.526+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc974041260 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x563e4ab1d2e8 s->prefetch_data=0 2024-09-14T11:01:30.525 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.526+0000 7fc86e7fc640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-09-14T11:01:30.525 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.526+0000 7fc98eb42800 10 manifest: total_size = 5392 2024-09-14T11:01:30.525 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.526+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11726169462728092791 2024-09-14T11:01:30.525 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.526+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc974041260 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x563e4ab1d2e8 s->prefetch_data=0 2024-09-14T11:01:30.525 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.526+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4ab1d2e8 2024-09-14T11:01:30.525 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.526+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4.7 2024-09-14T11:01:30.527 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.529+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:01:30.527 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.529+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=5392 stripe_ofs=5392 part_ofs=0 rule->part_size=0 2024-09-14T11:01:30.527 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.529+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11726169462728092791 2024-09-14T11:01:30.527 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.529+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:01:30.527 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.529+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4__shadow_.BI28t_4qMUIbvMhTMxqx80rD7HEivpU_0 2024-09-14T11:01:30.527 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.529+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:01:30.527 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.529+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:01:30.528 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.529+0000 7fc98eb42800 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11726169462728092791 2024-09-14T11:01:30.528 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.530+0000 7fc86dffb640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-09-14T11:01:30.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.530+0000 7fc98eb42800 20 get_obj_state: octx=0x563e4ab22980 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x563e4ab1d2e8 s->prefetch_data=0 2024-09-14T11:01:30.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.530+0000 7fc98eb42800 10 manifest: total_size = 8739 2024-09-14T11:01:30.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.530+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1077532962713955348 2024-09-14T11:01:30.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.530+0000 7fc98eb42800 20 get_obj_state: octx=0x563e4ab22980 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x563e4ab1d2e8 s->prefetch_data=0 2024-09-14T11:01:30.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.530+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4ab1d2e8 2024-09-14T11:01:30.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.530+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4.8 2024-09-14T11:01:30.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.532+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:01:30.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.532+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=8739 stripe_ofs=8739 part_ofs=0 rule->part_size=0 2024-09-14T11:01:30.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.532+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1077532962713955348 2024-09-14T11:01:30.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.532+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:01:30.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.532+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4__shadow_.D4CBylkwfkfIRrqj4j0QQkD_qYpnyHH_0 2024-09-14T11:01:30.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.532+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:01:30.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.532+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:01:30.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.532+0000 7fc98eb42800 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1077532962713955348 2024-09-14T11:01:30.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.533+0000 7fc86e7fc640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-09-14T11:01:30.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.534+0000 7fc98eb42800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:01:30.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.534+0000 7fc98eb42800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:01:30.533 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.534+0000 7fc98eb42800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:01:30.533 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.534+0000 7fc98eb42800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:01:30.533 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.534+0000 7fc98eb42800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:01:30.533 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.534+0000 7fc98eb42800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:01:30.533 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.534+0000 7fc98eb42800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4])"; uploads.size()=0; is_truncated=0 2024-09-14T11:01:30.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.536+0000 7fc98eb42800 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-09-14T11:01:30.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.536+0000 7fc98eb42800 20 rados->read ofs=0 len=0 2024-09-14T11:01:30.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.537+0000 7fc98eb42800 20 rados_obj.operate() r=0 bl.length=204 2024-09-14T11:01:30.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.537+0000 7fc98eb42800 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-09-14T11:01:30.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.537+0000 7fc98eb42800 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-09-14T11:01:30.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.538+0000 7fc98eb42800 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-09-14T11:01:30.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.538+0000 7fc98eb42800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-09-14T11:01:30.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.538+0000 7fc86dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595089 cookie 94825540850432 notifier 5702 bl.length()=162 2024-09-14T11:01:30.537 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.539+0000 7fc98eb42800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4 from cache 2024-09-14T11:01:30.538 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.539+0000 7fc98eb42800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4, ofs0, ns] 2024-09-14T11:01:30.538 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.540+0000 7fc86e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595148 cookie 94825540873568 notifier 5702 bl.length()=219 2024-09-14T11:01:30.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.543+0000 7fc98eb42800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4 : miss 2024-09-14T11:01:30.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.543+0000 7fc98eb42800 20 rados->read ofs=0 len=0 2024-09-14T11:01:30.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.543+0000 7fc98eb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:01:30.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.543+0000 7fc98eb42800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4 info.flags=0x0 2024-09-14T11:01:30.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.543+0000 7fc98eb42800 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4 to cache LRU end 2024-09-14T11:01:30.545 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.546+0000 7fc98eb42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11 : miss 2024-09-14T11:01:30.545 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.546+0000 7fc98eb42800 20 rados->read ofs=0 len=0 2024-09-14T11:01:30.545 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.547+0000 7fc98eb42800 20 rados_obj.operate() r=0 bl.length=457 2024-09-14T11:01:30.545 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.547+0000 7fc98eb42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11 info.flags=0x17 2024-09-14T11:01:30.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.547+0000 7fc98eb42800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11 to cache LRU end 2024-09-14T11:01:30.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.547+0000 7fc98eb42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:01:30.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.547+0000 7fc98eb42800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:01:30.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.547+0000 7fc98eb42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11 2024-09-14T11:01:30.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.550+0000 7fc98eb42800 10 cls_bucket_list_unordered: got foo 2024-09-14T11:01:30.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.550+0000 7fc98eb42800 20 get_obj_state: octx=0x563e4ab97340 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x563e4ab1e888 s->prefetch_data=0 2024-09-14T11:01:30.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.551+0000 7fc98eb42800 10 manifest: total_size = 18874368 2024-09-14T11:01:30.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.551+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7553092282653919425 2024-09-14T11:01:30.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.551+0000 7fc98eb42800 20 get_obj_state: octx=0x563e4ab97340 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x563e4ab1e888 s->prefetch_data=0 2024-09-14T11:01:30.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.551+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4ab1e888 2024-09-14T11:01:30.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.551+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11.10 2024-09-14T11:01:30.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.554+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:01:30.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.554+0000 7fc98eb42800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-14T11:01:30.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.554+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:01:30.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.554+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:01:30.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.554+0000 7fc98eb42800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:01:30.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.554+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2024-09-14T11:01:30.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.554+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:01:30.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.554+0000 7fc98eb42800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=5242880 2024-09-14T11:01:30.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.554+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2024-09-14T11:01:30.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.554+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2024-09-14T11:01:30.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.554+0000 7fc98eb42800 20 RGWObjManifest::operator++(): stripe_ofs=22020096 part_ofs=15728640 rule->part_size=3145728 2024-09-14T11:01:30.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.554+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2024-09-14T11:01:30.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.554+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7553092282653919425 2024-09-14T11:01:30.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.554+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:01:30.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.554+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11__multipart_foo.2~Ie-GC1nIkaBIJIsl2QMEQ06gJBOBFac.1 2024-09-14T11:01:30.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.554+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-14T11:01:30.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.554+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11__multipart_foo.2~Ie-GC1nIkaBIJIsl2QMEQ06gJBOBFac.2 2024-09-14T11:01:30.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.554+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-14T11:01:30.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.554+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11__multipart_foo.2~Ie-GC1nIkaBIJIsl2QMEQ06gJBOBFac.3 2024-09-14T11:01:30.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.554+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-14T11:01:30.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.554+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11__multipart_foo.2~Ie-GC1nIkaBIJIsl2QMEQ06gJBOBFac.4 2024-09-14T11:01:30.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.554+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-14T11:01:30.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.554+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:01:30.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.554+0000 7fc98eb42800 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7553092282653919425 2024-09-14T11:01:30.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.555+0000 7fc86e7fc640 20 handle_completion(): completion ok for obj=foo 2024-09-14T11:01:30.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.555+0000 7fc98eb42800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:01:30.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.555+0000 7fc98eb42800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:01:30.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.556+0000 7fc98eb42800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:01:30.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.556+0000 7fc98eb42800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:01:30.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.556+0000 7fc98eb42800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:01:30.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.556+0000 7fc98eb42800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:01:30.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.556+0000 7fc98eb42800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11])"; uploads.size()=0; is_truncated=0 2024-09-14T11:01:30.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.558+0000 7fc98eb42800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-09-14T11:01:30.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.558+0000 7fc98eb42800 20 rados->read ofs=0 len=0 2024-09-14T11:01:30.557 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.558+0000 7fc98eb42800 20 rados_obj.operate() r=0 bl.length=235 2024-09-14T11:01:30.557 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.558+0000 7fc98eb42800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-09-14T11:01:30.557 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.558+0000 7fc98eb42800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-09-14T11:01:30.557 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.559+0000 7fc98eb42800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-09-14T11:01:30.557 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.559+0000 7fc98eb42800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-09-14T11:01:30.558 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.559+0000 7fc86dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595145 cookie 94825540852640 notifier 5702 bl.length()=191 2024-09-14T11:01:30.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.561+0000 7fc98eb42800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11 from cache 2024-09-14T11:01:30.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.561+0000 7fc98eb42800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11, ofs0, ns] 2024-09-14T11:01:30.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.561+0000 7fc86dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595146 cookie 94825540868848 notifier 5702 bl.length()=249 2024-09-14T11:01:30.562 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.563+0000 7fc98eb42800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11 : miss 2024-09-14T11:01:30.562 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.563+0000 7fc98eb42800 20 rados->read ofs=0 len=0 2024-09-14T11:01:30.562 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.564+0000 7fc98eb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:01:30.562 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.564+0000 7fc98eb42800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11 info.flags=0x0 2024-09-14T11:01:30.562 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.564+0000 7fc98eb42800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11 to cache LRU end 2024-09-14T11:01:30.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.565+0000 7fc98eb42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12 : miss 2024-09-14T11:01:30.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.566+0000 7fc98eb42800 20 rados->read ofs=0 len=0 2024-09-14T11:01:30.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.566+0000 7fc98eb42800 20 rados_obj.operate() r=0 bl.length=464 2024-09-14T11:01:30.565 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.566+0000 7fc98eb42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12 info.flags=0x17 2024-09-14T11:01:30.565 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.566+0000 7fc98eb42800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12 to cache LRU end 2024-09-14T11:01:30.565 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.566+0000 7fc98eb42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:01:30.565 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.566+0000 7fc98eb42800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:01:30.565 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.566+0000 7fc98eb42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12 2024-09-14T11:01:30.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.570+0000 7fc98eb42800 10 cls_bucket_list_unordered: got foo 2024-09-14T11:01:30.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.570+0000 7fc98eb42800 20 get_obj_state: octx=0x563e4ab99720 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x563e4ab39b08 s->prefetch_data=0 2024-09-14T11:01:30.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.570+0000 7fc98eb42800 10 manifest: total_size = 26083 2024-09-14T11:01:30.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.570+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12648715477331637722 2024-09-14T11:01:30.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.570+0000 7fc98eb42800 20 get_obj_state: octx=0x563e4ab99720 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x563e4ab39b08 s->prefetch_data=0 2024-09-14T11:01:30.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.570+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4ab39b08 2024-09-14T11:01:30.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.570+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12.10 2024-09-14T11:01:30.571 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.572+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=3 2024-09-14T11:01:30.571 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.572+0000 7fc98eb42800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7671 2024-09-14T11:01:30.571 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.572+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=7671 stripe_ofs=7671 part_ofs=7671 rule->part_size=7671 2024-09-14T11:01:30.571 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.573+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=3 2024-09-14T11:01:30.571 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.573+0000 7fc98eb42800 20 RGWObjManifest::operator++(): stripe_ofs=6299127 part_ofs=7671 rule->part_size=7671 2024-09-14T11:01:30.572 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.573+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=15342 stripe_ofs=15342 part_ofs=15342 rule->part_size=7674 2024-09-14T11:01:30.572 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.573+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=7674 rules.size()=3 2024-09-14T11:01:30.572 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.573+0000 7fc98eb42800 20 RGWObjManifest::operator++(): stripe_ofs=6306798 part_ofs=15342 rule->part_size=7674 2024-09-14T11:01:30.572 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.573+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=23016 stripe_ofs=23016 part_ofs=23016 rule->part_size=3067 2024-09-14T11:01:30.572 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.573+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=3 2024-09-14T11:01:30.572 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.573+0000 7fc98eb42800 20 RGWObjManifest::operator++(): stripe_ofs=6314472 part_ofs=23016 rule->part_size=3067 2024-09-14T11:01:30.572 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.573+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=26083 stripe_ofs=26083 part_ofs=26083 rule->part_size=3067 2024-09-14T11:01:30.572 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.573+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12648715477331637722 2024-09-14T11:01:30.572 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.573+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:01:30.572 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.573+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12__multipart_foo.2~qnvSR0SS3y6axNti6fX0vbWPxZEIFp6.1 2024-09-14T11:01:30.572 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.573+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-14T11:01:30.572 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.573+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12__multipart_foo.2~qnvSR0SS3y6axNti6fX0vbWPxZEIFp6.2 2024-09-14T11:01:30.572 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.573+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-14T11:01:30.573 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.573+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12__multipart_foo.2~qnvSR0SS3y6axNti6fX0vbWPxZEIFp6.3 2024-09-14T11:01:30.573 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.573+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-14T11:01:30.573 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.573+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12__multipart_foo.2~qnvSR0SS3y6axNti6fX0vbWPxZEIFp6.4 2024-09-14T11:01:30.573 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.573+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-14T11:01:30.573 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.573+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:01:30.573 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.573+0000 7fc98eb42800 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12648715477331637722 2024-09-14T11:01:30.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.574+0000 7fc86e7fc640 20 handle_completion(): completion ok for obj=foo 2024-09-14T11:01:30.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.574+0000 7fc98eb42800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:01:30.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.574+0000 7fc98eb42800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:01:30.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.574+0000 7fc98eb42800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:01:30.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.574+0000 7fc98eb42800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:01:30.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.574+0000 7fc98eb42800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:01:30.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.574+0000 7fc98eb42800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:01:30.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.574+0000 7fc98eb42800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12])"; uploads.size()=0; is_truncated=0 2024-09-14T11:01:30.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.576+0000 7fc98eb42800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-09-14T11:01:30.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.576+0000 7fc98eb42800 20 rados->read ofs=0 len=0 2024-09-14T11:01:30.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.577+0000 7fc98eb42800 20 rados_obj.operate() r=0 bl.length=242 2024-09-14T11:01:30.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.577+0000 7fc98eb42800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-09-14T11:01:30.576 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.577+0000 7fc98eb42800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-09-14T11:01:30.576 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.578+0000 7fc98eb42800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-09-14T11:01:30.576 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.578+0000 7fc98eb42800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-09-14T11:01:30.577 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.578+0000 7fc86e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595089 cookie 94825540862096 notifier 5702 bl.length()=198 2024-09-14T11:01:30.578 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.580+0000 7fc98eb42800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12 from cache 2024-09-14T11:01:30.578 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.580+0000 7fc98eb42800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12, ofs0, ns] 2024-09-14T11:01:30.578 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.580+0000 7fc86dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595147 cookie 94825540852640 notifier 5702 bl.length()=256 2024-09-14T11:01:30.581 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.583+0000 7fc98eb42800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12 : miss 2024-09-14T11:01:30.581 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.583+0000 7fc98eb42800 20 rados->read ofs=0 len=0 2024-09-14T11:01:30.581 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.583+0000 7fc98eb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:01:30.581 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.583+0000 7fc98eb42800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12 info.flags=0x0 2024-09-14T11:01:30.582 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.583+0000 7fc98eb42800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12 to cache LRU end 2024-09-14T11:01:30.583 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.585+0000 7fc98eb42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10 : miss 2024-09-14T11:01:30.583 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.585+0000 7fc98eb42800 20 rados->read ofs=0 len=0 2024-09-14T11:01:30.584 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.585+0000 7fc98eb42800 20 rados_obj.operate() r=0 bl.length=459 2024-09-14T11:01:30.584 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.585+0000 7fc98eb42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10 info.flags=0x17 2024-09-14T11:01:30.584 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.585+0000 7fc98eb42800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10 to cache LRU end 2024-09-14T11:01:30.584 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.585+0000 7fc98eb42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:01:30.584 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.585+0000 7fc98eb42800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:01:30.584 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.586+0000 7fc98eb42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10 2024-09-14T11:01:30.588 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.589+0000 7fc98eb42800 10 cls_bucket_list_unordered: got foo[GB7l.6LJ4JSTjVQCcPa19Xp-LENLJ8Y] 2024-09-14T11:01:30.588 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.589+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10.10 2024-09-14T11:01:30.588 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.590+0000 7fc98eb42800 20 get_obj_state: octx=0x563e4ab17c40 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x563e4ab39b08 s->prefetch_data=0 2024-09-14T11:01:30.588 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.590+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to 5h5tdlu3dnnvblyyht8aw9l81leibuwr 2024-09-14T11:01:30.589 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.590+0000 7fc98eb42800 20 get_obj_state_impl: setting s->olh_tag to kz3ze7wbtf4qo1ig0cepycy5pf1pobr3 2024-09-14T11:01:30.589 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.590+0000 7fc98eb42800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=kz3ze7wbtf4qo1ig0cepycy5pf1pobr3 2024-09-14T11:01:30.589 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.591+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10.10 2024-09-14T11:01:30.591 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.592+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10.10 2024-09-14T11:01:30.591 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.593+0000 7fc98eb42800 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-09-14T11:01:30.591 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.593+0000 7fc98eb42800 20 olh_log_entry: epoch=3 op=3 key=foo[GB7l.6LJ4JSTjVQCcPa19Xp-LENLJ8Y] 2024-09-14T11:01:30.591 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.593+0000 7fc98eb42800 20 get_obj_state: octx=0x563e4ab17c40 obj=test-client.0-r-test-multipart-index-versioning.1:_:GB7l.6LJ4JSTjVQCcPa19Xp-LENLJ8Y_foo state=0x563e4ab1e888 s->prefetch_data=0 2024-09-14T11:01:30.591 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.593+0000 7fc98eb42800 10 manifest: total_size = 74198 2024-09-14T11:01:30.591 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.593+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15065388726834758581 2024-09-14T11:01:30.592 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.593+0000 7fc98eb42800 20 get_obj_state: octx=0x563e4ab17c40 obj=test-client.0-r-test-multipart-index-versioning.1:_:GB7l.6LJ4JSTjVQCcPa19Xp-LENLJ8Y_foo state=0x563e4ab1e888 s->prefetch_data=0 2024-09-14T11:01:30.592 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.593+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4ab1e888 2024-09-14T11:01:30.592 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.593+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10.10 2024-09-14T11:01:30.594 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.595+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-14T11:01:30.594 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.595+0000 7fc98eb42800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=20613 2024-09-14T11:01:30.594 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.595+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-14T11:01:30.594 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.595+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-14T11:01:30.594 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.595+0000 7fc98eb42800 20 RGWObjManifest::operator++(): stripe_ofs=6312069 part_ofs=20613 rule->part_size=20613 2024-09-14T11:01:30.594 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.595+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2024-09-14T11:01:30.594 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.595+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-14T11:01:30.594 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.595+0000 7fc98eb42800 20 RGWObjManifest::operator++(): stripe_ofs=6332682 part_ofs=41226 rule->part_size=20613 2024-09-14T11:01:30.594 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.595+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2024-09-14T11:01:30.595 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.595+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2024-09-14T11:01:30.595 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.595+0000 7fc98eb42800 20 RGWObjManifest::operator++(): stripe_ofs=6353295 part_ofs=61839 rule->part_size=12359 2024-09-14T11:01:30.595 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.595+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2024-09-14T11:01:30.595 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.595+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15065388726834758581 2024-09-14T11:01:30.595 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.595+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:01:30.595 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.595+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10__multipart_foo.2~s3YtaT4QesIGCoFCR7FiqiYyqrWrsoT.1 2024-09-14T11:01:30.595 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.595+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-14T11:01:30.595 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.595+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10__multipart_foo.2~s3YtaT4QesIGCoFCR7FiqiYyqrWrsoT.2 2024-09-14T11:01:30.595 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.595+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-14T11:01:30.596 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.595+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10__multipart_foo.2~s3YtaT4QesIGCoFCR7FiqiYyqrWrsoT.3 2024-09-14T11:01:30.596 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.595+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-14T11:01:30.596 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.595+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10__multipart_foo.2~s3YtaT4QesIGCoFCR7FiqiYyqrWrsoT.4 2024-09-14T11:01:30.596 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.595+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-14T11:01:30.596 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.595+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:01:30.596 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.595+0000 7fc98eb42800 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15065388726834758581 2024-09-14T11:01:30.597 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.596+0000 7fc86e7fc640 20 handle_completion(): completion ok for obj=foo[GB7l.6LJ4JSTjVQCcPa19Xp-LENLJ8Y] 2024-09-14T11:01:30.597 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.598+0000 7fc98eb42800 20 get_obj_state: octx=0x563e4ab17c40 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x563e4ab39b08 s->prefetch_data=0 2024-09-14T11:01:30.597 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.599+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10.10 2024-09-14T11:01:30.598 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.600+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10.10 2024-09-14T11:01:30.599 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.600+0000 7fc98eb42800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:01:30.599 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.600+0000 7fc98eb42800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:01:30.599 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.601+0000 7fc98eb42800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:01:30.599 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.601+0000 7fc98eb42800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:01:30.599 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.601+0000 7fc98eb42800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:01:30.599 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.601+0000 7fc98eb42800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:01:30.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.601+0000 7fc98eb42800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10])"; uploads.size()=0; is_truncated=0 2024-09-14T11:01:30.601 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.602+0000 7fc98eb42800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-09-14T11:01:30.601 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.602+0000 7fc98eb42800 20 rados->read ofs=0 len=0 2024-09-14T11:01:30.603 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.605+0000 7fc98eb42800 20 rados_obj.operate() r=0 bl.length=237 2024-09-14T11:01:30.604 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.605+0000 7fc98eb42800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-09-14T11:01:30.604 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.605+0000 7fc98eb42800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-09-14T11:01:30.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.606+0000 7fc98eb42800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-09-14T11:01:30.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.606+0000 7fc98eb42800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-09-14T11:01:30.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.607+0000 7fc86e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595090 cookie 94825540862096 notifier 5702 bl.length()=193 2024-09-14T11:01:30.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.608+0000 7fc98eb42800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10 from cache 2024-09-14T11:01:30.607 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.608+0000 7fc98eb42800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10, ofs0, ns] 2024-09-14T11:01:30.607 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.609+0000 7fc86dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595149 cookie 94825540876224 notifier 5702 bl.length()=251 2024-09-14T11:01:30.609 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.611+0000 7fc98eb42800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10 : miss 2024-09-14T11:01:30.610 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.611+0000 7fc98eb42800 20 rados->read ofs=0 len=0 2024-09-14T11:01:30.610 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.611+0000 7fc98eb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:01:30.610 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.611+0000 7fc98eb42800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10 info.flags=0x0 2024-09-14T11:01:30.610 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.611+0000 7fc98eb42800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10 to cache LRU end 2024-09-14T11:01:30.611 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.613+0000 7fc98eb42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9 : miss 2024-09-14T11:01:30.611 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.613+0000 7fc98eb42800 20 rados->read ofs=0 len=0 2024-09-14T11:01:30.612 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.614+0000 7fc98eb42800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:01:30.612 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.614+0000 7fc98eb42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9 info.flags=0x17 2024-09-14T11:01:30.612 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.614+0000 7fc98eb42800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9 to cache LRU end 2024-09-14T11:01:30.612 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.614+0000 7fc98eb42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:01:30.612 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.614+0000 7fc98eb42800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:01:30.612 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.614+0000 7fc98eb42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9 2024-09-14T11:01:30.616 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.617+0000 7fc98eb42800 10 cls_bucket_list_unordered: got foo 2024-09-14T11:01:30.616 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.618+0000 7fc98eb42800 20 get_obj_state: octx=0x563e4ab19430 obj=test-client.0-r-test-multipart-simple.1:foo state=0x563e4ab1e858 s->prefetch_data=0 2024-09-14T11:01:30.616 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.618+0000 7fc98eb42800 10 manifest: total_size = 886297 2024-09-14T11:01:30.616 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.618+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7760621398495937674 2024-09-14T11:01:30.617 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.618+0000 7fc98eb42800 20 get_obj_state: octx=0x563e4ab19430 obj=test-client.0-r-test-multipart-simple.1:foo state=0x563e4ab1e858 s->prefetch_data=0 2024-09-14T11:01:30.617 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.618+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4ab1e858 2024-09-14T11:01:30.617 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.618+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9.10 2024-09-14T11:01:30.618 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.620+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:01:30.619 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.620+0000 7fc98eb42800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=246247 2024-09-14T11:01:30.619 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.620+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-14T11:01:30.619 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.620+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:01:30.619 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.620+0000 7fc98eb42800 20 RGWObjManifest::operator++(): stripe_ofs=6537703 part_ofs=246247 rule->part_size=246247 2024-09-14T11:01:30.619 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.620+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-09-14T11:01:30.619 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.620+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:01:30.619 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.620+0000 7fc98eb42800 20 RGWObjManifest::operator++(): stripe_ofs=6783950 part_ofs=492494 rule->part_size=246247 2024-09-14T11:01:30.619 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.620+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-09-14T11:01:30.619 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.620+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-09-14T11:01:30.619 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.620+0000 7fc98eb42800 20 RGWObjManifest::operator++(): stripe_ofs=7030197 part_ofs=738741 rule->part_size=147556 2024-09-14T11:01:30.619 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.620+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-09-14T11:01:30.619 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.620+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7760621398495937674 2024-09-14T11:01:30.620 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.620+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:01:30.620 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.620+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9__multipart_foo.2~sMpxUD-Jmwpb3iVymRjC1dmSbqnAWnu.1 2024-09-14T11:01:30.620 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.620+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 344 2024-09-14T11:01:30.620 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.620+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9__multipart_foo.2~sMpxUD-Jmwpb3iVymRjC1dmSbqnAWnu.2 2024-09-14T11:01:30.620 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.620+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 588 2024-09-14T11:01:30.620 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.620+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9__multipart_foo.2~sMpxUD-Jmwpb3iVymRjC1dmSbqnAWnu.3 2024-09-14T11:01:30.620 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.620+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 832 2024-09-14T11:01:30.620 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.620+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9__multipart_foo.2~sMpxUD-Jmwpb3iVymRjC1dmSbqnAWnu.4 2024-09-14T11:01:30.620 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.620+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1076 2024-09-14T11:01:30.620 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.620+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:01:30.620 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.620+0000 7fc98eb42800 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7760621398495937674 2024-09-14T11:01:30.621 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.621+0000 7fc86e7fc640 20 handle_completion(): completion ok for obj=foo 2024-09-14T11:01:30.621 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.621+0000 7fc98eb42800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:01:30.621 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.621+0000 7fc98eb42800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:01:30.621 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.622+0000 7fc98eb42800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:01:30.622 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.622+0000 7fc98eb42800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:01:30.622 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.622+0000 7fc98eb42800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:01:30.622 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.622+0000 7fc98eb42800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:01:30.622 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.622+0000 7fc98eb42800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9])"; uploads.size()=0; is_truncated=0 2024-09-14T11:01:30.622 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.624+0000 7fc98eb42800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-09-14T11:01:30.623 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.624+0000 7fc98eb42800 20 rados->read ofs=0 len=0 2024-09-14T11:01:30.623 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.624+0000 7fc98eb42800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:01:30.623 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.624+0000 7fc98eb42800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-09-14T11:01:30.623 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.624+0000 7fc98eb42800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-09-14T11:01:30.623 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.625+0000 7fc98eb42800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-09-14T11:01:30.624 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.625+0000 7fc98eb42800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-09-14T11:01:30.624 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.625+0000 7fc86dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595148 cookie 94825540868848 notifier 5702 bl.length()=183 2024-09-14T11:01:30.625 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.627+0000 7fc98eb42800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9 from cache 2024-09-14T11:01:30.625 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.627+0000 7fc98eb42800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9, ofs0, ns] 2024-09-14T11:01:30.625 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.627+0000 7fc86e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595149 cookie 94825540868848 notifier 5702 bl.length()=240 2024-09-14T11:01:30.628 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.629+0000 7fc98eb42800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9 : miss 2024-09-14T11:01:30.628 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.629+0000 7fc98eb42800 20 rados->read ofs=0 len=0 2024-09-14T11:01:30.628 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.630+0000 7fc98eb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:01:30.628 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.630+0000 7fc98eb42800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9 info.flags=0x0 2024-09-14T11:01:30.628 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.630+0000 7fc98eb42800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9 to cache LRU end 2024-09-14T11:01:30.630 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.632+0000 7fc98eb42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15 : miss 2024-09-14T11:01:30.630 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.632+0000 7fc98eb42800 20 rados->read ofs=0 len=0 2024-09-14T11:01:30.630 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.632+0000 7fc98eb42800 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:01:30.630 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.632+0000 7fc98eb42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15 info.flags=0x17 2024-09-14T11:01:30.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.632+0000 7fc98eb42800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15 to cache LRU end 2024-09-14T11:01:30.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.632+0000 7fc98eb42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:01:30.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.632+0000 7fc98eb42800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:01:30.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.632+0000 7fc98eb42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15 2024-09-14T11:01:30.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.633+0000 7fc98eb42800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-14T11:01:30.632 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.634+0000 7fc98eb42800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-14T11:01:30.633 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.634+0000 7fc98eb42800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:01:30.633 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.635+0000 7fc98eb42800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-14T11:01:30.633 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.635+0000 7fc98eb42800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-14T11:01:30.633 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.635+0000 7fc98eb42800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:01:30.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.636+0000 7fc98eb42800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-14T11:01:30.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.636+0000 7fc98eb42800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:01:30.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.636+0000 7fc98eb42800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-14T11:01:30.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.636+0000 7fc98eb42800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-14T11:01:30.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.636+0000 7fc98eb42800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-14T11:01:30.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.636+0000 7fc98eb42800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-14T11:01:30.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.637+0000 7fc98eb42800 20 get_obj_state: octx=0x563e4aae48e0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x563e4ab1e858 s->prefetch_data=0 2024-09-14T11:01:30.636 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.637+0000 7fc98eb42800 10 manifest: total_size = 2042 2024-09-14T11:01:30.636 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.637+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to _Mqh-VMTNZu_lDSfbf4kuKMiRlkGY3Ji 2024-09-14T11:01:30.636 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.637+0000 7fc98eb42800 20 get_obj_state: octx=0x563e4aae48e0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x563e4ab1e858 s->prefetch_data=0 2024-09-14T11:01:30.636 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.637+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4ab1e858 2024-09-14T11:01:30.636 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.637+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15.0 2024-09-14T11:01:30.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.640+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:01:30.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.640+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=2042 stripe_ofs=2042 part_ofs=0 rule->part_size=0 2024-09-14T11:01:30.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.640+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - tag is: _Mqh-VMTNZu_lDSfbf4kuKMiRlkGY3Ji 2024-09-14T11:01:30.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.640+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:01:30.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.640+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15__shadow_.h-IFGn3mhxInh2gqbr_89gYIjOa6oE5_0 2024-09-14T11:01:30.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.640+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:01:30.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.640+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:01:30.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.640+0000 7fc98eb42800 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: _Mqh-VMTNZu_lDSfbf4kuKMiRlkGY3Ji 2024-09-14T11:01:30.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.641+0000 7fc98eb42800 20 get_obj_state: octx=0x563e4aae48e0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x563e4ab1e858 s->prefetch_data=0 2024-09-14T11:01:30.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.641+0000 7fc86dffb640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-14T11:01:30.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.641+0000 7fc98eb42800 10 manifest: total_size = 5242880 2024-09-14T11:01:30.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.641+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to _jNg6hk7zDuCgBlfjX8K8rDjUjpTdhCE 2024-09-14T11:01:30.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.641+0000 7fc98eb42800 20 get_obj_state: octx=0x563e4aae48e0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x563e4ab1e858 s->prefetch_data=0 2024-09-14T11:01:30.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.641+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4ab1e858 2024-09-14T11:01:30.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.641+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15.2 2024-09-14T11:01:30.642 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.643+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:01:30.642 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.643+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:01:30.642 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.643+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - tag is: _jNg6hk7zDuCgBlfjX8K8rDjUjpTdhCE 2024-09-14T11:01:30.642 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.643+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:01:30.642 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.643+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15__shadow_.OpVHHB3IVd86vK4WmuXXy5mfSAwHhY9_0 2024-09-14T11:01:30.642 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.643+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:01:30.642 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.643+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:01:30.642 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.643+0000 7fc98eb42800 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: _jNg6hk7zDuCgBlfjX8K8rDjUjpTdhCE 2024-09-14T11:01:30.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.644+0000 7fc86e7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-14T11:01:30.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.645+0000 7fc98eb42800 20 get_obj_state: octx=0x563e4ab36970 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x563e4ab1e858 s->prefetch_data=0 2024-09-14T11:01:30.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.645+0000 7fc98eb42800 10 manifest: total_size = 5242880 2024-09-14T11:01:30.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.645+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4862595364982880933 2024-09-14T11:01:30.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.645+0000 7fc98eb42800 20 get_obj_state: octx=0x563e4ab36970 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x563e4ab1e858 s->prefetch_data=0 2024-09-14T11:01:30.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.645+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4ab1e858 2024-09-14T11:01:30.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.645+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15.3 2024-09-14T11:01:30.645 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.647+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:01:30.645 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.647+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:01:30.645 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.647+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4862595364982880933 2024-09-14T11:01:30.646 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.647+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:01:30.646 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.647+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15__shadow_.d49zgqSfhKEnIlV_poY-lqcXo4BzJW8_0 2024-09-14T11:01:30.646 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.647+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-14T11:01:30.646 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.647+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:01:30.646 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.647+0000 7fc98eb42800 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4862595364982880933 2024-09-14T11:01:30.646 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.648+0000 7fc86dffb640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:01:30.647 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.648+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc9840304a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x563e4ab1e858 s->prefetch_data=0 2024-09-14T11:01:30.647 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.649+0000 7fc98eb42800 10 manifest: total_size = 5242880 2024-09-14T11:01:30.647 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.649+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to _rzyqNbZ_Ui5e_rReIlh-FsKXs2x51T_ 2024-09-14T11:01:30.647 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.649+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc9840304a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x563e4ab1e858 s->prefetch_data=0 2024-09-14T11:01:30.647 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.649+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4ab1e858 2024-09-14T11:01:30.647 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.649+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15.5 2024-09-14T11:01:30.649 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.651+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:01:30.649 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.651+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:01:30.650 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.651+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - tag is: _rzyqNbZ_Ui5e_rReIlh-FsKXs2x51T_ 2024-09-14T11:01:30.650 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.651+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:01:30.650 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.651+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15__shadow_.UtWTOTZcjH7Nx5jtrh4u01A4rm7890f_0 2024-09-14T11:01:30.650 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.651+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:01:30.650 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.651+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:01:30.650 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.651+0000 7fc98eb42800 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: _rzyqNbZ_Ui5e_rReIlh-FsKXs2x51T_ 2024-09-14T11:01:30.650 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.652+0000 7fc86e7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-14T11:01:30.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.652+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc984078430 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x563e4ab1e858 s->prefetch_data=0 2024-09-14T11:01:30.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.653+0000 7fc98eb42800 10 manifest: total_size = 5242880 2024-09-14T11:01:30.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.653+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to _BsKheWE9dXgzioj1hXaGrGekxPJTTsg 2024-09-14T11:01:30.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.653+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc984078430 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x563e4ab1e858 s->prefetch_data=0 2024-09-14T11:01:30.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.653+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4ab1e858 2024-09-14T11:01:30.652 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.653+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15.5 2024-09-14T11:01:30.653 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.655+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:01:30.653 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.655+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:01:30.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.655+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - tag is: _BsKheWE9dXgzioj1hXaGrGekxPJTTsg 2024-09-14T11:01:30.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.655+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:01:30.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.655+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15__shadow_.Hr57S5_luop0gT5dU1PNfFYjK_snJJY_0 2024-09-14T11:01:30.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.655+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:01:30.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.655+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:01:30.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.655+0000 7fc98eb42800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: _BsKheWE9dXgzioj1hXaGrGekxPJTTsg 2024-09-14T11:01:30.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.656+0000 7fc86dffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-14T11:01:30.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.656+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc9840304a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x563e4ab1e858 s->prefetch_data=0 2024-09-14T11:01:30.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.656+0000 7fc98eb42800 10 manifest: total_size = 2042 2024-09-14T11:01:30.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.656+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4679937817698873138 2024-09-14T11:01:30.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.656+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc9840304a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x563e4ab1e858 s->prefetch_data=0 2024-09-14T11:01:30.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.656+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4ab1e858 2024-09-14T11:01:30.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.656+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15.5 2024-09-14T11:01:30.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.658+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:01:30.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.658+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=2042 stripe_ofs=2042 part_ofs=0 rule->part_size=0 2024-09-14T11:01:30.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.658+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4679937817698873138 2024-09-14T11:01:30.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.658+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:01:30.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.658+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15__shadow_.en3z6Z7Au1dtBuxbpUT78jZibuzvYRt_0 2024-09-14T11:01:30.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.658+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-14T11:01:30.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.658+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:01:30.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.658+0000 7fc98eb42800 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4679937817698873138 2024-09-14T11:01:30.658 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.659+0000 7fc86e7fc640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:01:30.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.659+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc97c04d960 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x563e4ab1e858 s->prefetch_data=0 2024-09-14T11:01:30.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.660+0000 7fc98eb42800 10 manifest: total_size = 5242880 2024-09-14T11:01:30.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.660+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to _O96ZkdykOVBpiZP6JcyQRvQpCYoBCwW 2024-09-14T11:01:30.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.660+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc97c04d960 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x563e4ab1e858 s->prefetch_data=0 2024-09-14T11:01:30.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.660+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4ab1e858 2024-09-14T11:01:30.661 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.660+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15.7 2024-09-14T11:01:30.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.662+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:01:30.663 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.662+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:01:30.663 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.662+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - tag is: _O96ZkdykOVBpiZP6JcyQRvQpCYoBCwW 2024-09-14T11:01:30.663 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.662+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:01:30.663 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.662+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15__shadow_.UHNJjoIRuor9eLrEoYLosPTNxKawc9g_0 2024-09-14T11:01:30.663 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.662+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:01:30.663 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.662+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:01:30.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.662+0000 7fc98eb42800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: _O96ZkdykOVBpiZP6JcyQRvQpCYoBCwW 2024-09-14T11:01:30.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.663+0000 7fc86dffb640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-14T11:01:30.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.663+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc9840304a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x563e4ab1e858 s->prefetch_data=0 2024-09-14T11:01:30.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.664+0000 7fc98eb42800 10 manifest: total_size = 5242880 2024-09-14T11:01:30.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.664+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.873592951494251759 2024-09-14T11:01:30.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.664+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc9840304a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x563e4ab1e858 s->prefetch_data=0 2024-09-14T11:01:30.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.664+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4ab1e858 2024-09-14T11:01:30.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.664+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15.7 2024-09-14T11:01:30.665 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.666+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:01:30.665 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.666+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:01:30.665 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.666+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.873592951494251759 2024-09-14T11:01:30.665 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.666+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:01:30.665 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.666+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15__shadow_.uLnFR-pKXcCUIXeRxj197s4c9bhfUMm_0 2024-09-14T11:01:30.665 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.666+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-14T11:01:30.666 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.666+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:01:30.666 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.666+0000 7fc98eb42800 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.873592951494251759 2024-09-14T11:01:30.666 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.667+0000 7fc86e7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:01:30.666 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.667+0000 7fc98eb42800 20 get_obj_state: octx=0x563e4ab20900 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x563e4ab1e858 s->prefetch_data=0 2024-09-14T11:01:30.666 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.667+0000 7fc98eb42800 10 manifest: total_size = 2042 2024-09-14T11:01:30.666 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.667+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17534820962157740316 2024-09-14T11:01:30.666 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.667+0000 7fc98eb42800 20 get_obj_state: octx=0x563e4ab20900 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x563e4ab1e858 s->prefetch_data=0 2024-09-14T11:01:30.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.667+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4ab1e858 2024-09-14T11:01:30.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.667+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15.7 2024-09-14T11:01:30.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.669+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:01:30.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.669+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=2042 stripe_ofs=2042 part_ofs=0 rule->part_size=0 2024-09-14T11:01:30.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.669+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17534820962157740316 2024-09-14T11:01:30.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.669+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:01:30.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.669+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15__shadow_.en3z6Z7Au1dtBuxbpUT78jZibuzvYRt_0 2024-09-14T11:01:30.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.669+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 331 2024-09-14T11:01:30.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.669+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:01:30.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.669+0000 7fc98eb42800 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17534820962157740316 2024-09-14T11:01:30.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.670+0000 7fc86dffb640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-14T11:01:30.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.670+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc97c04d960 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x563e4ab1e858 s->prefetch_data=0 2024-09-14T11:01:30.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.671+0000 7fc98eb42800 10 manifest: total_size = 5242880 2024-09-14T11:01:30.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.671+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4142416409859602121 2024-09-14T11:01:30.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.671+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc97c04d960 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x563e4ab1e858 s->prefetch_data=0 2024-09-14T11:01:30.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.671+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4ab1e858 2024-09-14T11:01:30.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.671+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15.8 2024-09-14T11:01:30.671 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.673+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:01:30.671 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.673+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:01:30.671 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.673+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4142416409859602121 2024-09-14T11:01:30.671 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.673+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:01:30.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.673+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15__shadow_.uLnFR-pKXcCUIXeRxj197s4c9bhfUMm_0 2024-09-14T11:01:30.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.673+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-14T11:01:30.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.673+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:01:30.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.673+0000 7fc98eb42800 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4142416409859602121 2024-09-14T11:01:30.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.674+0000 7fc86e7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-14T11:01:30.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.674+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc9840304a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x563e4ab1e858 s->prefetch_data=0 2024-09-14T11:01:30.673 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.674+0000 7fc98eb42800 10 manifest: total_size = 2042 2024-09-14T11:01:30.673 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.674+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to _xWHJqgBBTJt-leO_i_FPN7EgJDf1Sw3 2024-09-14T11:01:30.673 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.674+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc9840304a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x563e4ab1e858 s->prefetch_data=0 2024-09-14T11:01:30.673 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.674+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4ab1e858 2024-09-14T11:01:30.673 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.674+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15.8 2024-09-14T11:01:30.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.676+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:01:30.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.676+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=2042 stripe_ofs=2042 part_ofs=0 rule->part_size=0 2024-09-14T11:01:30.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.676+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - tag is: _xWHJqgBBTJt-leO_i_FPN7EgJDf1Sw3 2024-09-14T11:01:30.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.676+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:01:30.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.676+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15__shadow_.rrayXErQcsdeV70n8iwQxRRFjrFKJS8_0 2024-09-14T11:01:30.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.676+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:01:30.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.676+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:01:30.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.676+0000 7fc98eb42800 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: _xWHJqgBBTJt-leO_i_FPN7EgJDf1Sw3 2024-09-14T11:01:30.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.678+0000 7fc86dffb640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-14T11:01:30.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.678+0000 7fc98eb42800 20 get_obj_state: octx=0x563e4ab20900 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x563e4ab1e858 s->prefetch_data=0 2024-09-14T11:01:30.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.678+0000 7fc98eb42800 10 manifest: total_size = 5242880 2024-09-14T11:01:30.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.678+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8474790174166008383 2024-09-14T11:01:30.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.678+0000 7fc98eb42800 20 get_obj_state: octx=0x563e4ab20900 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x563e4ab1e858 s->prefetch_data=0 2024-09-14T11:01:30.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.678+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4ab1e858 2024-09-14T11:01:30.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.678+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15.9 2024-09-14T11:01:30.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.680+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:01:30.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.680+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:01:30.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.680+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8474790174166008383 2024-09-14T11:01:30.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.680+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:01:30.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.680+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15__shadow_.d49zgqSfhKEnIlV_poY-lqcXo4BzJW8_0 2024-09-14T11:01:30.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.680+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-14T11:01:30.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.680+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:01:30.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.680+0000 7fc98eb42800 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8474790174166008383 2024-09-14T11:01:30.680 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.681+0000 7fc86e7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-14T11:01:30.680 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.681+0000 7fc98eb42800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:01:30.680 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.681+0000 7fc98eb42800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:01:30.680 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.682+0000 7fc98eb42800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:01:30.681 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.682+0000 7fc98eb42800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:01:30.681 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.682+0000 7fc98eb42800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:01:30.681 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.682+0000 7fc98eb42800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:01:30.681 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.682+0000 7fc98eb42800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15])"; uploads.size()=0; is_truncated=0 2024-09-14T11:01:30.682 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.684+0000 7fc98eb42800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-09-14T11:01:30.682 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.684+0000 7fc98eb42800 20 rados->read ofs=0 len=0 2024-09-14T11:01:30.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.684+0000 7fc98eb42800 20 rados_obj.operate() r=0 bl.length=233 2024-09-14T11:01:30.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.684+0000 7fc98eb42800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-09-14T11:01:30.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.684+0000 7fc98eb42800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-09-14T11:01:30.684 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.685+0000 7fc98eb42800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-09-14T11:01:30.684 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.685+0000 7fc98eb42800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-09-14T11:01:30.685 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.686+0000 7fc86e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595091 cookie 94825540862096 notifier 5702 bl.length()=189 2024-09-14T11:01:30.685 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.687+0000 7fc98eb42800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15 from cache 2024-09-14T11:01:30.685 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.687+0000 7fc98eb42800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15, ofs0, ns] 2024-09-14T11:01:30.686 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.687+0000 7fc86e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595150 cookie 94825540876224 notifier 5702 bl.length()=247 2024-09-14T11:01:30.688 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.690+0000 7fc98eb42800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15 : miss 2024-09-14T11:01:30.688 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.690+0000 7fc98eb42800 20 rados->read ofs=0 len=0 2024-09-14T11:01:30.688 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.690+0000 7fc98eb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:01:30.688 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.690+0000 7fc98eb42800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15 info.flags=0x0 2024-09-14T11:01:30.688 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.690+0000 7fc98eb42800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15 to cache LRU end 2024-09-14T11:01:30.690 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.692+0000 7fc98eb42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16 : miss 2024-09-14T11:01:30.690 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.692+0000 7fc98eb42800 20 rados->read ofs=0 len=0 2024-09-14T11:01:30.691 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.692+0000 7fc98eb42800 20 rados_obj.operate() r=0 bl.length=465 2024-09-14T11:01:30.691 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.692+0000 7fc98eb42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16 info.flags=0x17 2024-09-14T11:01:30.691 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.692+0000 7fc98eb42800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16 to cache LRU end 2024-09-14T11:01:30.691 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.692+0000 7fc98eb42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:01:30.691 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.692+0000 7fc98eb42800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:01:30.691 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.692+0000 7fc98eb42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16 2024-09-14T11:01:30.691 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.693+0000 7fc98eb42800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-14T11:01:30.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.693+0000 7fc98eb42800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-14T11:01:30.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.694+0000 7fc98eb42800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:01:30.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.694+0000 7fc98eb42800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-14T11:01:30.693 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.694+0000 7fc98eb42800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-14T11:01:30.693 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.694+0000 7fc98eb42800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:01:30.693 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.695+0000 7fc98eb42800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-14T11:01:30.694 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.695+0000 7fc98eb42800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:01:30.694 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.695+0000 7fc98eb42800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-14T11:01:30.694 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.696+0000 7fc98eb42800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-14T11:01:30.694 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.696+0000 7fc98eb42800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-14T11:01:30.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.697+0000 7fc98eb42800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-14T11:01:30.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.697+0000 7fc98eb42800 20 get_obj_state: octx=0x563e4ab39170 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x563e4aad1878 s->prefetch_data=0 2024-09-14T11:01:30.696 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.697+0000 7fc98eb42800 10 manifest: total_size = 1087 2024-09-14T11:01:30.696 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.697+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to _Yo9kslKdJ5MS9YXMUmxbkWimrzLN9yV 2024-09-14T11:01:30.696 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.697+0000 7fc98eb42800 20 get_obj_state: octx=0x563e4ab39170 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x563e4aad1878 s->prefetch_data=0 2024-09-14T11:01:30.696 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.697+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4aad1878 2024-09-14T11:01:30.696 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.697+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16.0 2024-09-14T11:01:30.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.699+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:01:30.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.699+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=0 rule->part_size=0 2024-09-14T11:01:30.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.699+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - tag is: _Yo9kslKdJ5MS9YXMUmxbkWimrzLN9yV 2024-09-14T11:01:30.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.699+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:01:30.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.699+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__shadow_.OTBZgbyGDPzJ_z7zBBET90Tpf_6SZFe_0 2024-09-14T11:01:30.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.699+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:01:30.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.699+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:01:30.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.699+0000 7fc98eb42800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: _Yo9kslKdJ5MS9YXMUmxbkWimrzLN9yV 2024-09-14T11:01:30.699 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.701+0000 7fc86e7fc640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-14T11:01:30.699 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.701+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc984078430 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x563e4aad1878 s->prefetch_data=0 2024-09-14T11:01:30.700 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.701+0000 7fc98eb42800 10 manifest: total_size = 11534336 2024-09-14T11:01:30.700 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.701+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to _g6pf7ZCz_rRTVx5xrKQtYc0lmY7poL2 2024-09-14T11:01:30.700 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.701+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc984078430 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x563e4aad1878 s->prefetch_data=0 2024-09-14T11:01:30.700 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.701+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4aad1878 2024-09-14T11:01:30.700 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.701+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16.2 2024-09-14T11:01:30.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.703+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:01:30.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.703+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-14T11:01:30.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.703+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:01:30.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.703+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:01:30.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.703+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - tag is: _g6pf7ZCz_rRTVx5xrKQtYc0lmY7poL2 2024-09-14T11:01:30.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.703+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:01:30.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.703+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__shadow_.1Qv2hBKJMbs8asZFnHC7Vc0w6f72OR4_0 2024-09-14T11:01:30.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.703+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:01:30.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.703+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__shadow_.1Qv2hBKJMbs8asZFnHC7Vc0w6f72OR4_1 2024-09-14T11:01:30.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.703+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-14T11:01:30.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.703+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:01:30.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.703+0000 7fc98eb42800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: _g6pf7ZCz_rRTVx5xrKQtYc0lmY7poL2 2024-09-14T11:01:30.704 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.704+0000 7fc86dffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-14T11:01:30.704 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.705+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc97c004560 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x563e4aad1878 s->prefetch_data=0 2024-09-14T11:01:30.704 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.705+0000 7fc98eb42800 10 manifest: total_size = 11534336 2024-09-14T11:01:30.704 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.705+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11456701320619194599 2024-09-14T11:01:30.704 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.705+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc97c004560 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x563e4aad1878 s->prefetch_data=0 2024-09-14T11:01:30.704 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.705+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4aad1878 2024-09-14T11:01:30.704 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.705+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16.3 2024-09-14T11:01:30.705 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.707+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:01:30.705 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.707+0000 7fc98eb42800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-14T11:01:30.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.707+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:01:30.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.707+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:01:30.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.707+0000 7fc98eb42800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:01:30.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.707+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:01:30.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.707+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:01:30.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.707+0000 7fc98eb42800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:01:30.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.707+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:01:30.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.707+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11456701320619194599 2024-09-14T11:01:30.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.707+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:01:30.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.707+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__multipart_foo-FROZEN.2~NGM1mcc-nAFE3fd1norGwNsKhDQgmA_.1 2024-09-14T11:01:30.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.707+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-14T11:01:30.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.707+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__multipart_foo-FROZEN.2~NGM1mcc-nAFE3fd1norGwNsKhDQgmA_.2 2024-09-14T11:01:30.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.707+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 635 2024-09-14T11:01:30.707 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.707+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__multipart_foo-FROZEN.2~NGM1mcc-nAFE3fd1norGwNsKhDQgmA_.3 2024-09-14T11:01:30.707 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.707+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 902 2024-09-14T11:01:30.707 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.707+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:01:30.707 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.707+0000 7fc98eb42800 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11456701320619194599 2024-09-14T11:01:30.707 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.708+0000 7fc86e7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:01:30.707 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.708+0000 7fc98eb42800 20 get_obj_state: octx=0x563e4ab39170 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x563e4aad1878 s->prefetch_data=0 2024-09-14T11:01:30.708 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.709+0000 7fc98eb42800 10 manifest: total_size = 11534336 2024-09-14T11:01:30.708 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.709+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to _N67pcYV0kJUbFMBlc-tRbR5rDb1CMCL 2024-09-14T11:01:30.708 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.709+0000 7fc98eb42800 20 get_obj_state: octx=0x563e4ab39170 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x563e4aad1878 s->prefetch_data=0 2024-09-14T11:01:30.708 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.709+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4aad1878 2024-09-14T11:01:30.708 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.709+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16.5 2024-09-14T11:01:30.709 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.710+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:01:30.709 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.710+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-14T11:01:30.709 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.710+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:01:30.709 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.710+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:01:30.709 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.710+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - tag is: _N67pcYV0kJUbFMBlc-tRbR5rDb1CMCL 2024-09-14T11:01:30.709 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.710+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:01:30.710 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.710+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__shadow_.xf0Ct5m3bK8W4Vuq31UbRpIOH5eC36j_0 2024-09-14T11:01:30.710 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.710+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:01:30.710 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.710+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__shadow_.xf0Ct5m3bK8W4Vuq31UbRpIOH5eC36j_1 2024-09-14T11:01:30.710 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.710+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-14T11:01:30.710 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.710+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:01:30.710 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.710+0000 7fc98eb42800 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: _N67pcYV0kJUbFMBlc-tRbR5rDb1CMCL 2024-09-14T11:01:30.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.711+0000 7fc86dffb640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-14T11:01:30.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.712+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc9840049b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x563e4aad1878 s->prefetch_data=0 2024-09-14T11:01:30.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.712+0000 7fc98eb42800 10 manifest: total_size = 11534336 2024-09-14T11:01:30.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.712+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to _m3dIv5WouI97qol36_YOsPWpYPzu5HE 2024-09-14T11:01:30.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.712+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc9840049b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x563e4aad1878 s->prefetch_data=0 2024-09-14T11:01:30.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.712+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4aad1878 2024-09-14T11:01:30.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.712+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16.5 2024-09-14T11:01:30.712 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.714+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:01:30.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.714+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-14T11:01:30.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.714+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:01:30.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.714+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:01:30.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.714+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - tag is: _m3dIv5WouI97qol36_YOsPWpYPzu5HE 2024-09-14T11:01:30.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.714+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:01:30.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.714+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__shadow_.HrdhBujeMYmCXl6Jji9SFCDUSl13-8v_0 2024-09-14T11:01:30.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.714+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:01:30.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.714+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__shadow_.HrdhBujeMYmCXl6Jji9SFCDUSl13-8v_1 2024-09-14T11:01:30.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.714+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-14T11:01:30.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.714+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:01:30.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.714+0000 7fc98eb42800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: _m3dIv5WouI97qol36_YOsPWpYPzu5HE 2024-09-14T11:01:30.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.715+0000 7fc86e7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-14T11:01:30.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.715+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc9840049b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x563e4aad1878 s->prefetch_data=0 2024-09-14T11:01:30.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.715+0000 7fc98eb42800 10 manifest: total_size = 1087 2024-09-14T11:01:30.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.715+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13039448559062943704 2024-09-14T11:01:30.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.715+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc9840049b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x563e4aad1878 s->prefetch_data=0 2024-09-14T11:01:30.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.715+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4aad1878 2024-09-14T11:01:30.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.715+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16.5 2024-09-14T11:01:30.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.718+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-14T11:01:30.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.718+0000 7fc98eb42800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=516 2024-09-14T11:01:30.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.718+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-14T11:01:30.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.718+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-14T11:01:30.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.718+0000 7fc98eb42800 20 RGWObjManifest::operator++(): stripe_ofs=6291972 part_ofs=516 rule->part_size=516 2024-09-14T11:01:30.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.718+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=55 2024-09-14T11:01:30.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.718+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=55 rules.size()=2 2024-09-14T11:01:30.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.718+0000 7fc98eb42800 20 RGWObjManifest::operator++(): stripe_ofs=6292488 part_ofs=1032 rule->part_size=55 2024-09-14T11:01:30.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.718+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=1087 rule->part_size=55 2024-09-14T11:01:30.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.718+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13039448559062943704 2024-09-14T11:01:30.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.718+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:01:30.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.718+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__multipart_foo-STANDARD.2~Q_rKueWQEzTMXM5eiryaCuie6AsQ8M2.1 2024-09-14T11:01:30.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.718+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-14T11:01:30.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.718+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__multipart_foo-STANDARD.2~Q_rKueWQEzTMXM5eiryaCuie6AsQ8M2.2 2024-09-14T11:01:30.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.718+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-14T11:01:30.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.718+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__multipart_foo-STANDARD.2~Q_rKueWQEzTMXM5eiryaCuie6AsQ8M2.3 2024-09-14T11:01:30.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.718+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-14T11:01:30.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.718+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:01:30.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.718+0000 7fc98eb42800 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13039448559062943704 2024-09-14T11:01:30.719 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.719+0000 7fc86dffb640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:01:30.719 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.719+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc974097490 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x563e4aad1878 s->prefetch_data=0 2024-09-14T11:01:30.719 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.719+0000 7fc98eb42800 10 manifest: total_size = 11534336 2024-09-14T11:01:30.719 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.719+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to _xlQgopPlc9S7GaKdxdlsDY0bBy1ECZL 2024-09-14T11:01:30.719 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.719+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc974097490 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x563e4aad1878 s->prefetch_data=0 2024-09-14T11:01:30.719 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.719+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4aad1878 2024-09-14T11:01:30.719 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.719+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16.7 2024-09-14T11:01:30.720 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.722+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:01:30.720 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.722+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-14T11:01:30.720 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.722+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:01:30.720 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.722+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:01:30.721 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.722+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - tag is: _xlQgopPlc9S7GaKdxdlsDY0bBy1ECZL 2024-09-14T11:01:30.721 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.722+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:01:30.721 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.722+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__shadow_.YRj2Ptqfs8KJMVtLtjEnbI6-dNXppQt_0 2024-09-14T11:01:30.721 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.722+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:01:30.721 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.722+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__shadow_.YRj2Ptqfs8KJMVtLtjEnbI6-dNXppQt_1 2024-09-14T11:01:30.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.722+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-14T11:01:30.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.722+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:01:30.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.722+0000 7fc98eb42800 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: _xlQgopPlc9S7GaKdxdlsDY0bBy1ECZL 2024-09-14T11:01:30.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.723+0000 7fc86e7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-14T11:01:30.723 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.723+0000 7fc98eb42800 20 get_obj_state: octx=0x563e4ab1c700 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x563e4aad1878 s->prefetch_data=0 2024-09-14T11:01:30.723 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.723+0000 7fc98eb42800 10 manifest: total_size = 11534336 2024-09-14T11:01:30.723 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.723+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3641353035608146895 2024-09-14T11:01:30.723 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.723+0000 7fc98eb42800 20 get_obj_state: octx=0x563e4ab1c700 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x563e4aad1878 s->prefetch_data=0 2024-09-14T11:01:30.723 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.723+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4aad1878 2024-09-14T11:01:30.723 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.723+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16.7 2024-09-14T11:01:30.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.725+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:01:30.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.725+0000 7fc98eb42800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-14T11:01:30.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.725+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:01:30.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.725+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:01:30.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.725+0000 7fc98eb42800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:01:30.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.725+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:01:30.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.725+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:01:30.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.725+0000 7fc98eb42800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:01:30.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.725+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:01:30.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.725+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3641353035608146895 2024-09-14T11:01:30.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.725+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:01:30.725 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.725+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__multipart_foo-LUKEWARM.2~5lyvpszBcbiA6-AintwdqOM4swCDj8X.1 2024-09-14T11:01:30.725 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.725+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-14T11:01:30.725 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.725+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__multipart_foo-LUKEWARM.2~5lyvpszBcbiA6-AintwdqOM4swCDj8X.2 2024-09-14T11:01:30.725 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.725+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 646 2024-09-14T11:01:30.725 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.725+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__multipart_foo-LUKEWARM.2~5lyvpszBcbiA6-AintwdqOM4swCDj8X.3 2024-09-14T11:01:30.725 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.725+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 919 2024-09-14T11:01:30.725 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.725+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:01:30.725 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.725+0000 7fc98eb42800 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3641353035608146895 2024-09-14T11:01:30.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.726+0000 7fc86dffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:01:30.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.727+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc9840304a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x563e4ab1e858 s->prefetch_data=0 2024-09-14T11:01:30.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.727+0000 7fc98eb42800 10 manifest: total_size = 1087 2024-09-14T11:01:30.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.727+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6986826418039477963 2024-09-14T11:01:30.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.727+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc9840304a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x563e4ab1e858 s->prefetch_data=0 2024-09-14T11:01:30.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.727+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4ab1e858 2024-09-14T11:01:30.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.727+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16.7 2024-09-14T11:01:30.727 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.729+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-14T11:01:30.728 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.729+0000 7fc98eb42800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=516 2024-09-14T11:01:30.728 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.729+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-14T11:01:30.728 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.729+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-14T11:01:30.728 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.729+0000 7fc98eb42800 20 RGWObjManifest::operator++(): stripe_ofs=6291972 part_ofs=516 rule->part_size=516 2024-09-14T11:01:30.728 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.729+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=55 2024-09-14T11:01:30.728 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.729+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=55 rules.size()=2 2024-09-14T11:01:30.728 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.729+0000 7fc98eb42800 20 RGWObjManifest::operator++(): stripe_ofs=6292488 part_ofs=1032 rule->part_size=55 2024-09-14T11:01:30.728 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.729+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=1087 rule->part_size=55 2024-09-14T11:01:30.728 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.729+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6986826418039477963 2024-09-14T11:01:30.728 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.729+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:01:30.728 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.729+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__multipart_foo-STANDARD.2~Q_rKueWQEzTMXM5eiryaCuie6AsQ8M2.1 2024-09-14T11:01:30.728 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.729+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-14T11:01:30.729 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.729+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__multipart_foo-STANDARD.2~Q_rKueWQEzTMXM5eiryaCuie6AsQ8M2.2 2024-09-14T11:01:30.729 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.729+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-14T11:01:30.729 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.729+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__multipart_foo-STANDARD.2~Q_rKueWQEzTMXM5eiryaCuie6AsQ8M2.3 2024-09-14T11:01:30.729 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.729+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-14T11:01:30.729 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.729+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:01:30.729 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.729+0000 7fc98eb42800 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6986826418039477963 2024-09-14T11:01:30.730 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.730+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc984078430 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x563e4ab1e858 s->prefetch_data=0 2024-09-14T11:01:30.730 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.730+0000 7fc86e7fc640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-14T11:01:30.730 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.730+0000 7fc98eb42800 10 manifest: total_size = 11534336 2024-09-14T11:01:30.730 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.730+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14510598353016679615 2024-09-14T11:01:30.730 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.730+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc984078430 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x563e4ab1e858 s->prefetch_data=0 2024-09-14T11:01:30.730 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.730+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4ab1e858 2024-09-14T11:01:30.730 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.730+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16.8 2024-09-14T11:01:30.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.732+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:01:30.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.732+0000 7fc98eb42800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-14T11:01:30.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.732+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:01:30.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.732+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:01:30.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.732+0000 7fc98eb42800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:01:30.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.732+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:01:30.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.732+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:01:30.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.732+0000 7fc98eb42800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:01:30.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.732+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:01:30.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.732+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14510598353016679615 2024-09-14T11:01:30.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.732+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:01:30.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.732+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__multipart_foo-LUKEWARM.2~5lyvpszBcbiA6-AintwdqOM4swCDj8X.1 2024-09-14T11:01:30.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.732+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-14T11:01:30.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.732+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__multipart_foo-LUKEWARM.2~5lyvpszBcbiA6-AintwdqOM4swCDj8X.2 2024-09-14T11:01:30.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.732+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 647 2024-09-14T11:01:30.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.732+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__multipart_foo-LUKEWARM.2~5lyvpszBcbiA6-AintwdqOM4swCDj8X.3 2024-09-14T11:01:30.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.732+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 920 2024-09-14T11:01:30.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.732+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:01:30.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.732+0000 7fc98eb42800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14510598353016679615 2024-09-14T11:01:30.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.734+0000 7fc86dffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-14T11:01:30.734 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.734+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc97c004560 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x563e4ab1e858 s->prefetch_data=0 2024-09-14T11:01:30.734 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.734+0000 7fc98eb42800 10 manifest: total_size = 1087 2024-09-14T11:01:30.734 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.734+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to _PwcLat7rdyREvc7WzFHcHZjIp72DXX- 2024-09-14T11:01:30.734 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.734+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc97c004560 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x563e4ab1e858 s->prefetch_data=0 2024-09-14T11:01:30.734 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.734+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4ab1e858 2024-09-14T11:01:30.734 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.734+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16.8 2024-09-14T11:01:30.735 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.736+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:01:30.735 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.736+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=0 rule->part_size=0 2024-09-14T11:01:30.735 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.736+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - tag is: _PwcLat7rdyREvc7WzFHcHZjIp72DXX- 2024-09-14T11:01:30.735 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.736+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:01:30.735 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.736+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__shadow_.le95HA5lZroqCwnrMN9HS1tCp8rIqYM_0 2024-09-14T11:01:30.735 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.736+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:01:30.735 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.736+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:01:30.735 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.736+0000 7fc98eb42800 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: _PwcLat7rdyREvc7WzFHcHZjIp72DXX- 2024-09-14T11:01:30.736 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.737+0000 7fc86e7fc640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-14T11:01:30.736 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.738+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc9840049b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x563e4ab1e858 s->prefetch_data=0 2024-09-14T11:01:30.736 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.738+0000 7fc98eb42800 10 manifest: total_size = 11534336 2024-09-14T11:01:30.737 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.738+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4288891329751422723 2024-09-14T11:01:30.737 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.738+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc9840049b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x563e4ab1e858 s->prefetch_data=0 2024-09-14T11:01:30.737 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.738+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4ab1e858 2024-09-14T11:01:30.737 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.738+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16.9 2024-09-14T11:01:30.738 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.740+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:01:30.739 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.740+0000 7fc98eb42800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-14T11:01:30.739 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.740+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:01:30.739 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.740+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:01:30.739 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.740+0000 7fc98eb42800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:01:30.739 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.740+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:01:30.739 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.740+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:01:30.739 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.740+0000 7fc98eb42800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:01:30.739 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.740+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:01:30.739 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.740+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4288891329751422723 2024-09-14T11:01:30.739 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.740+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:01:30.739 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.740+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__multipart_foo-FROZEN.2~NGM1mcc-nAFE3fd1norGwNsKhDQgmA_.1 2024-09-14T11:01:30.739 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.740+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-14T11:01:30.739 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.740+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__multipart_foo-FROZEN.2~NGM1mcc-nAFE3fd1norGwNsKhDQgmA_.2 2024-09-14T11:01:30.740 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.740+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 634 2024-09-14T11:01:30.740 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.740+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__multipart_foo-FROZEN.2~NGM1mcc-nAFE3fd1norGwNsKhDQgmA_.3 2024-09-14T11:01:30.740 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.740+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 901 2024-09-14T11:01:30.740 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.740+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:01:30.740 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.740+0000 7fc98eb42800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4288891329751422723 2024-09-14T11:01:30.740 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.741+0000 7fc86dffb640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-14T11:01:30.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.741+0000 7fc98eb42800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:01:30.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.741+0000 7fc98eb42800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:01:30.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.742+0000 7fc98eb42800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:01:30.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.742+0000 7fc98eb42800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:01:30.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.742+0000 7fc98eb42800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:01:30.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.742+0000 7fc98eb42800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:01:30.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.742+0000 7fc98eb42800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16])"; uploads.size()=0; is_truncated=0 2024-09-14T11:01:30.742 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.744+0000 7fc98eb42800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-09-14T11:01:30.742 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.744+0000 7fc98eb42800 20 rados->read ofs=0 len=0 2024-09-14T11:01:30.742 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.744+0000 7fc98eb42800 20 rados_obj.operate() r=0 bl.length=243 2024-09-14T11:01:30.743 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.744+0000 7fc98eb42800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-09-14T11:01:30.743 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.744+0000 7fc98eb42800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-09-14T11:01:30.743 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.745+0000 7fc98eb42800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-09-14T11:01:30.743 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.745+0000 7fc98eb42800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-09-14T11:01:30.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.745+0000 7fc86dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595084 cookie 94825540864304 notifier 5702 bl.length()=199 2024-09-14T11:01:30.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.747+0000 7fc98eb42800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16 from cache 2024-09-14T11:01:30.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.747+0000 7fc98eb42800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16, ofs0, ns] 2024-09-14T11:01:30.746 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.747+0000 7fc86e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595092 cookie 94825540862096 notifier 5702 bl.length()=257 2024-09-14T11:01:30.748 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.750+0000 7fc98eb42800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16 : miss 2024-09-14T11:01:30.748 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.750+0000 7fc98eb42800 20 rados->read ofs=0 len=0 2024-09-14T11:01:30.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.750+0000 7fc98eb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:01:30.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.750+0000 7fc98eb42800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16 info.flags=0x0 2024-09-14T11:01:30.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.750+0000 7fc98eb42800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16 to cache LRU end 2024-09-14T11:01:30.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.752+0000 7fc98eb42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14 : miss 2024-09-14T11:01:30.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.752+0000 7fc98eb42800 20 rados->read ofs=0 len=0 2024-09-14T11:01:30.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.753+0000 7fc98eb42800 20 rados_obj.operate() r=0 bl.length=460 2024-09-14T11:01:30.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.753+0000 7fc98eb42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14 info.flags=0x17 2024-09-14T11:01:30.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.753+0000 7fc98eb42800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14 to cache LRU end 2024-09-14T11:01:30.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.753+0000 7fc98eb42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:01:30.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.753+0000 7fc98eb42800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:01:30.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.753+0000 7fc98eb42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14 2024-09-14T11:01:30.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.754+0000 7fc98eb42800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:01:30.753 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.755+0000 7fc98eb42800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:01:30.754 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.756+0000 7fc98eb42800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:01:30.755 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.757+0000 7fc98eb42800 20 get_obj_state: octx=0x563e4aad27e0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x563e4ab27938 s->prefetch_data=0 2024-09-14T11:01:30.755 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.757+0000 7fc98eb42800 10 manifest: total_size = 11534336 2024-09-14T11:01:30.755 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.757+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6349251770078567695 2024-09-14T11:01:30.755 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.757+0000 7fc98eb42800 20 get_obj_state: octx=0x563e4aad27e0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x563e4ab27938 s->prefetch_data=0 2024-09-14T11:01:30.755 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.757+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4ab27938 2024-09-14T11:01:30.755 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.757+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14.3 2024-09-14T11:01:30.757 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.759+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:01:30.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.759+0000 7fc98eb42800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-14T11:01:30.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.759+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:01:30.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.759+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:01:30.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.759+0000 7fc98eb42800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:01:30.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.759+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:01:30.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.759+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:01:30.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.759+0000 7fc98eb42800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:01:30.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.759+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:01:30.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.759+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6349251770078567695 2024-09-14T11:01:30.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.759+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:01:30.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.759+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14__multipart_foo-FROZEN.2~yUMH8vp5t8sQKs9Ji3zU52cw7ZUMWdY.1 2024-09-14T11:01:30.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.759+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-14T11:01:30.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.759+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14__multipart_foo-FROZEN.2~yUMH8vp5t8sQKs9Ji3zU52cw7ZUMWdY.2 2024-09-14T11:01:30.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.759+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 634 2024-09-14T11:01:30.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.759+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14__multipart_foo-FROZEN.2~yUMH8vp5t8sQKs9Ji3zU52cw7ZUMWdY.3 2024-09-14T11:01:30.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.759+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 901 2024-09-14T11:01:30.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.759+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:01:30.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.759+0000 7fc98eb42800 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6349251770078567695 2024-09-14T11:01:30.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.760+0000 7fc86e7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:01:30.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.761+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc9840a7e00 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x563e4ab1b3d8 s->prefetch_data=0 2024-09-14T11:01:30.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.761+0000 7fc98eb42800 10 manifest: total_size = 1087 2024-09-14T11:01:30.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.761+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3126078334440539068 2024-09-14T11:01:30.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.761+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc9840a7e00 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x563e4ab1b3d8 s->prefetch_data=0 2024-09-14T11:01:30.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.761+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4ab1b3d8 2024-09-14T11:01:30.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.761+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14.5 2024-09-14T11:01:30.761 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.763+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-14T11:01:30.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.763+0000 7fc98eb42800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=516 2024-09-14T11:01:30.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.763+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-14T11:01:30.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.763+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-14T11:01:30.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.763+0000 7fc98eb42800 20 RGWObjManifest::operator++(): stripe_ofs=6291972 part_ofs=516 rule->part_size=516 2024-09-14T11:01:30.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.763+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=55 2024-09-14T11:01:30.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.763+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=55 rules.size()=2 2024-09-14T11:01:30.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.763+0000 7fc98eb42800 20 RGWObjManifest::operator++(): stripe_ofs=6292488 part_ofs=1032 rule->part_size=55 2024-09-14T11:01:30.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.763+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=1087 rule->part_size=55 2024-09-14T11:01:30.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.763+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3126078334440539068 2024-09-14T11:01:30.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.763+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:01:30.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.763+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14__multipart_foo-STANDARD.2~vjAH0Dat9hswSo1QIsC9u1An1kPcWHU.1 2024-09-14T11:01:30.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.763+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-14T11:01:30.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.763+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14__multipart_foo-STANDARD.2~vjAH0Dat9hswSo1QIsC9u1An1kPcWHU.2 2024-09-14T11:01:30.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.763+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-14T11:01:30.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.763+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14__multipart_foo-STANDARD.2~vjAH0Dat9hswSo1QIsC9u1An1kPcWHU.3 2024-09-14T11:01:30.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.763+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-14T11:01:30.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.763+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:01:30.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.763+0000 7fc98eb42800 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3126078334440539068 2024-09-14T11:01:30.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.764+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc97409a0c0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x563e4ab1b3d8 s->prefetch_data=0 2024-09-14T11:01:30.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.764+0000 7fc86dffb640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:01:30.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.765+0000 7fc98eb42800 10 manifest: total_size = 11534336 2024-09-14T11:01:30.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.765+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6380888001571439194 2024-09-14T11:01:30.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.765+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc97409a0c0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x563e4ab1b3d8 s->prefetch_data=0 2024-09-14T11:01:30.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.765+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4ab1b3d8 2024-09-14T11:01:30.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.765+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14.7 2024-09-14T11:01:30.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.767+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:01:30.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.767+0000 7fc98eb42800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-14T11:01:30.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.767+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:01:30.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.767+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:01:30.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.767+0000 7fc98eb42800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:01:30.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.767+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:01:30.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.767+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:01:30.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.767+0000 7fc98eb42800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:01:30.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.767+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:01:30.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.767+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6380888001571439194 2024-09-14T11:01:30.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.767+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:01:30.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.767+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14__multipart_foo-LUKEWARM.2~nOB4IWZOZXVY8hPrYas-l7c7CLVFFiR.1 2024-09-14T11:01:30.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.767+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-14T11:01:30.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.767+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14__multipart_foo-LUKEWARM.2~nOB4IWZOZXVY8hPrYas-l7c7CLVFFiR.2 2024-09-14T11:01:30.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.767+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 646 2024-09-14T11:01:30.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.767+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14__multipart_foo-LUKEWARM.2~nOB4IWZOZXVY8hPrYas-l7c7CLVFFiR.3 2024-09-14T11:01:30.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.767+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 919 2024-09-14T11:01:30.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.767+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:01:30.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.767+0000 7fc98eb42800 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6380888001571439194 2024-09-14T11:01:30.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.768+0000 7fc86e7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:01:30.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.768+0000 7fc98eb42800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:01:30.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.768+0000 7fc98eb42800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:01:30.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.769+0000 7fc98eb42800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:01:30.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.769+0000 7fc98eb42800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:01:30.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.769+0000 7fc98eb42800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:01:30.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.769+0000 7fc98eb42800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:01:30.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.769+0000 7fc98eb42800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14])"; uploads.size()=0; is_truncated=0 2024-09-14T11:01:30.769 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.770+0000 7fc98eb42800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-09-14T11:01:30.769 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.770+0000 7fc98eb42800 20 rados->read ofs=0 len=0 2024-09-14T11:01:30.769 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.771+0000 7fc98eb42800 20 rados_obj.operate() r=0 bl.length=238 2024-09-14T11:01:30.769 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.771+0000 7fc98eb42800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-09-14T11:01:30.769 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.771+0000 7fc98eb42800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-09-14T11:01:30.770 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.772+0000 7fc98eb42800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-09-14T11:01:30.770 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.772+0000 7fc98eb42800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-09-14T11:01:30.770 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.772+0000 7fc86dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595151 cookie 94825540865872 notifier 5702 bl.length()=194 2024-09-14T11:01:30.772 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.773+0000 7fc98eb42800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14 from cache 2024-09-14T11:01:30.772 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.773+0000 7fc98eb42800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14, ofs0, ns] 2024-09-14T11:01:30.772 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.774+0000 7fc86e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595093 cookie 94825540862096 notifier 5702 bl.length()=252 2024-09-14T11:01:30.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.776+0000 7fc98eb42800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14 : miss 2024-09-14T11:01:30.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.776+0000 7fc98eb42800 20 rados->read ofs=0 len=0 2024-09-14T11:01:30.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.776+0000 7fc98eb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:01:30.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.776+0000 7fc98eb42800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14 info.flags=0x0 2024-09-14T11:01:30.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.776+0000 7fc98eb42800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14 to cache LRU end 2024-09-14T11:01:30.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.778+0000 7fc98eb42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13 : miss 2024-09-14T11:01:30.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.778+0000 7fc98eb42800 20 rados->read ofs=0 len=0 2024-09-14T11:01:30.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.779+0000 7fc98eb42800 20 rados_obj.operate() r=0 bl.length=450 2024-09-14T11:01:30.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.779+0000 7fc98eb42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13 info.flags=0x17 2024-09-14T11:01:30.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.779+0000 7fc98eb42800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13 to cache LRU end 2024-09-14T11:01:30.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.779+0000 7fc98eb42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:01:30.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.779+0000 7fc98eb42800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:01:30.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.779+0000 7fc98eb42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13 2024-09-14T11:01:30.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.780+0000 7fc98eb42800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:01:30.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.781+0000 7fc98eb42800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:01:30.780 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.782+0000 7fc98eb42800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:01:30.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.783+0000 7fc98eb42800 20 get_obj_state: octx=0x563e4ab28e60 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x563e4ab1e858 s->prefetch_data=0 2024-09-14T11:01:30.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.783+0000 7fc98eb42800 10 manifest: total_size = 10485760 2024-09-14T11:01:30.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.783+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5473358611521469111 2024-09-14T11:01:30.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.783+0000 7fc98eb42800 20 get_obj_state: octx=0x563e4ab28e60 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x563e4ab1e858 s->prefetch_data=0 2024-09-14T11:01:30.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.783+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4ab1e858 2024-09-14T11:01:30.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.783+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13.3 2024-09-14T11:01:30.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.785+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:01:30.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.785+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-14T11:01:30.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.785+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:01:30.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.785+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-14T11:01:30.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.785+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5473358611521469111 2024-09-14T11:01:30.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.785+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:01:30.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.785+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13__shadow_.WtPFw8GcYO3HlHJjUjEHWHEVS7P3428_0 2024-09-14T11:01:30.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.785+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-14T11:01:30.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.785+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13__shadow_.WtPFw8GcYO3HlHJjUjEHWHEVS7P3428_1 2024-09-14T11:01:30.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.785+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2024-09-14T11:01:30.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.785+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:01:30.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.785+0000 7fc98eb42800 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5473358611521469111 2024-09-14T11:01:30.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.786+0000 7fc86dffb640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:01:30.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.787+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc97409a0c0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x563e4ab1e858 s->prefetch_data=0 2024-09-14T11:01:30.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.787+0000 7fc98eb42800 10 manifest: total_size = 53499 2024-09-14T11:01:30.786 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.787+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5693304300103414840 2024-09-14T11:01:30.786 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.787+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc97409a0c0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x563e4ab1e858 s->prefetch_data=0 2024-09-14T11:01:30.786 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.787+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4ab1e858 2024-09-14T11:01:30.786 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.787+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13.5 2024-09-14T11:01:30.787 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.789+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:01:30.787 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.789+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=53499 stripe_ofs=53499 part_ofs=0 rule->part_size=0 2024-09-14T11:01:30.787 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.789+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5693304300103414840 2024-09-14T11:01:30.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.789+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:01:30.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.789+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13__shadow_.Mwb58S3jcGeFaU5-wYERiAocw2VEGzi_0 2024-09-14T11:01:30.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.789+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-14T11:01:30.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.789+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:01:30.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.789+0000 7fc98eb42800 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5693304300103414840 2024-09-14T11:01:30.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.790+0000 7fc86e7fc640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:01:30.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.790+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc9840a7e00 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x563e4ab1e858 s->prefetch_data=0 2024-09-14T11:01:30.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.790+0000 7fc98eb42800 10 manifest: total_size = 10485760 2024-09-14T11:01:30.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.790+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11030229602919375074 2024-09-14T11:01:30.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.790+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc9840a7e00 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x563e4ab1e858 s->prefetch_data=0 2024-09-14T11:01:30.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.790+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4ab1e858 2024-09-14T11:01:30.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.790+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13.7 2024-09-14T11:01:30.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.793+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:01:30.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.793+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-14T11:01:30.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.793+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:01:30.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.793+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-14T11:01:30.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.793+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11030229602919375074 2024-09-14T11:01:30.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.793+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:01:30.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.793+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13__shadow_.iWuyjnDp-b7bVENnx20sdXGZ5yeHWI__0 2024-09-14T11:01:30.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.793+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-09-14T11:01:30.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.793+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13__shadow_.iWuyjnDp-b7bVENnx20sdXGZ5yeHWI__1 2024-09-14T11:01:30.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.793+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 579 2024-09-14T11:01:30.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.793+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:01:30.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.793+0000 7fc98eb42800 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11030229602919375074 2024-09-14T11:01:30.793 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.794+0000 7fc86dffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:01:30.793 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.794+0000 7fc98eb42800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:01:30.793 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.794+0000 7fc98eb42800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:01:30.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.795+0000 7fc98eb42800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:01:30.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.795+0000 7fc98eb42800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:01:30.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.795+0000 7fc98eb42800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:01:30.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.795+0000 7fc98eb42800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:01:30.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.795+0000 7fc98eb42800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13])"; uploads.size()=0; is_truncated=0 2024-09-14T11:01:30.795 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.797+0000 7fc98eb42800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-09-14T11:01:30.795 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.797+0000 7fc98eb42800 20 rados->read ofs=0 len=0 2024-09-14T11:01:30.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.797+0000 7fc98eb42800 20 rados_obj.operate() r=0 bl.length=228 2024-09-14T11:01:30.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.797+0000 7fc98eb42800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-09-14T11:01:30.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.797+0000 7fc98eb42800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-09-14T11:01:30.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.798+0000 7fc98eb42800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-09-14T11:01:30.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.798+0000 7fc98eb42800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-09-14T11:01:30.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.798+0000 7fc86dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595094 cookie 94825540862096 notifier 5702 bl.length()=184 2024-09-14T11:01:30.798 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.800+0000 7fc98eb42800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13 from cache 2024-09-14T11:01:30.798 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.800+0000 7fc98eb42800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13, ofs0, ns] 2024-09-14T11:01:30.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.800+0000 7fc86e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595150 cookie 94825540852640 notifier 5702 bl.length()=242 2024-09-14T11:01:30.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.803+0000 7fc98eb42800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13 : miss 2024-09-14T11:01:30.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.803+0000 7fc98eb42800 20 rados->read ofs=0 len=0 2024-09-14T11:01:30.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.803+0000 7fc98eb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:01:30.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.803+0000 7fc98eb42800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13 info.flags=0x0 2024-09-14T11:01:30.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.803+0000 7fc98eb42800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13 to cache LRU end 2024-09-14T11:01:30.804 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.806+0000 7fc98eb42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6 : miss 2024-09-14T11:01:30.804 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.806+0000 7fc98eb42800 20 rados->read ofs=0 len=0 2024-09-14T11:01:30.805 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.807+0000 7fc98eb42800 20 rados_obj.operate() r=0 bl.length=445 2024-09-14T11:01:30.805 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.807+0000 7fc98eb42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6 info.flags=0x17 2024-09-14T11:01:30.805 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.807+0000 7fc98eb42800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6 to cache LRU end 2024-09-14T11:01:30.805 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.807+0000 7fc98eb42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:01:30.806 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.807+0000 7fc98eb42800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:01:30.806 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.807+0000 7fc98eb42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6 2024-09-14T11:01:30.806 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.808+0000 7fc98eb42800 10 cls_bucket_list_unordered: got ___ 2024-09-14T11:01:30.806 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.808+0000 7fc98eb42800 10 cls_bucket_list_unordered: got __ _ 2024-09-14T11:01:30.807 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.809+0000 7fc98eb42800 10 cls_bucket_list_unordered: got __ 2024-09-14T11:01:30.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.810+0000 7fc98eb42800 10 cls_bucket_list_unordered: got obj 2024-09-14T11:01:30.809 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.810+0000 7fc98eb42800 20 get_obj_state: octx=0x563e4aad27e0 obj=test-client.0-r-test-small-obj-data.1:___ state=0x563e4ab37d68 s->prefetch_data=0 2024-09-14T11:01:30.809 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.811+0000 7fc98eb42800 10 manifest: total_size = 0 2024-09-14T11:01:30.809 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.811+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15903457794553330862 2024-09-14T11:01:30.809 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.811+0000 7fc98eb42800 20 get_obj_state: octx=0x563e4aad27e0 obj=test-client.0-r-test-small-obj-data.1:___ state=0x563e4ab37d68 s->prefetch_data=0 2024-09-14T11:01:30.809 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.811+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4ab37d68 2024-09-14T11:01:30.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.811+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6.2 2024-09-14T11:01:30.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.815+0000 7fc98eb42800 20 get_obj_state: octx=0x563e4aad27e0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x563e4ab37d68 s->prefetch_data=0 2024-09-14T11:01:30.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.815+0000 7fc98eb42800 10 manifest: total_size = 0 2024-09-14T11:01:30.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.815+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15158088042782202694 2024-09-14T11:01:30.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.815+0000 7fc98eb42800 20 get_obj_state: octx=0x563e4aad27e0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x563e4ab37d68 s->prefetch_data=0 2024-09-14T11:01:30.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.815+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4ab37d68 2024-09-14T11:01:30.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.815+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6.3 2024-09-14T11:01:30.815 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.816+0000 7fc86e7fc640 20 handle_completion(): completion ok for obj=___ 2024-09-14T11:01:30.816 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.817+0000 7fc98eb42800 20 get_obj_state: octx=0x563e4ab1ff70 obj=test-client.0-r-test-small-obj-data.1:__ state=0x563e4ab25348 s->prefetch_data=0 2024-09-14T11:01:30.816 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.818+0000 7fc98eb42800 10 manifest: total_size = 0 2024-09-14T11:01:30.816 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.818+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7617519001363228517 2024-09-14T11:01:30.816 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.818+0000 7fc98eb42800 20 get_obj_state: octx=0x563e4ab1ff70 obj=test-client.0-r-test-small-obj-data.1:__ state=0x563e4ab25348 s->prefetch_data=0 2024-09-14T11:01:30.816 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.818+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4ab25348 2024-09-14T11:01:30.817 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.818+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6.6 2024-09-14T11:01:30.817 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.819+0000 7fc86dffb640 20 handle_completion(): completion ok for obj=__ _ 2024-09-14T11:01:30.818 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.820+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc97409a0c0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x563e4ab25348 s->prefetch_data=0 2024-09-14T11:01:30.818 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.820+0000 7fc98eb42800 10 manifest: total_size = 0 2024-09-14T11:01:30.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.820+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15705196369389337680 2024-09-14T11:01:30.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.820+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc97409a0c0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x563e4ab25348 s->prefetch_data=0 2024-09-14T11:01:30.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.820+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4ab25348 2024-09-14T11:01:30.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.820+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6.8 2024-09-14T11:01:30.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.821+0000 7fc86e7fc640 20 handle_completion(): completion ok for obj=__ 2024-09-14T11:01:30.821 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.822+0000 7fc98eb42800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:01:30.821 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.822+0000 7fc98eb42800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:01:30.822 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.824+0000 7fc86dffb640 20 handle_completion(): completion ok for obj=obj 2024-09-14T11:01:30.822 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.824+0000 7fc98eb42800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:01:30.822 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.824+0000 7fc98eb42800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:01:30.822 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.824+0000 7fc98eb42800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:01:30.822 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.824+0000 7fc98eb42800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:01:30.822 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.824+0000 7fc98eb42800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6])"; uploads.size()=0; is_truncated=0 2024-09-14T11:01:30.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.826+0000 7fc98eb42800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-09-14T11:01:30.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.826+0000 7fc98eb42800 20 rados->read ofs=0 len=0 2024-09-14T11:01:30.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.826+0000 7fc98eb42800 20 rados_obj.operate() r=0 bl.length=223 2024-09-14T11:01:30.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.826+0000 7fc98eb42800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-09-14T11:01:30.825 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.826+0000 7fc98eb42800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-09-14T11:01:30.825 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.827+0000 7fc98eb42800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-09-14T11:01:30.825 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.827+0000 7fc98eb42800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-09-14T11:01:30.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.827+0000 7fc86dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595151 cookie 94825540852640 notifier 5702 bl.length()=181 2024-09-14T11:01:30.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.829+0000 7fc98eb42800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6 from cache 2024-09-14T11:01:30.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.829+0000 7fc98eb42800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6, ofs0, ns] 2024-09-14T11:01:30.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.829+0000 7fc86e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595152 cookie 94825540852640 notifier 5702 bl.length()=238 2024-09-14T11:01:30.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.831+0000 7fc98eb42800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6 : miss 2024-09-14T11:01:30.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.831+0000 7fc98eb42800 20 rados->read ofs=0 len=0 2024-09-14T11:01:30.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.831+0000 7fc98eb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:01:30.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.831+0000 7fc98eb42800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6 info.flags=0x0 2024-09-14T11:01:30.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.831+0000 7fc98eb42800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6 to cache LRU end 2024-09-14T11:01:30.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.833+0000 7fc98eb42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7 : miss 2024-09-14T11:01:30.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.833+0000 7fc98eb42800 20 rados->read ofs=0 len=0 2024-09-14T11:01:30.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.834+0000 7fc98eb42800 20 rados_obj.operate() r=0 bl.length=445 2024-09-14T11:01:30.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.834+0000 7fc98eb42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7 info.flags=0x17 2024-09-14T11:01:30.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.834+0000 7fc98eb42800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7 to cache LRU end 2024-09-14T11:01:30.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.834+0000 7fc98eb42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:01:30.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.834+0000 7fc98eb42800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:01:30.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.834+0000 7fc98eb42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7 2024-09-14T11:01:30.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.835+0000 7fc98eb42800 10 cls_bucket_list_unordered: got ___ 2024-09-14T11:01:30.834 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.836+0000 7fc98eb42800 10 cls_bucket_list_unordered: got __ _ 2024-09-14T11:01:30.835 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.837+0000 7fc98eb42800 10 cls_bucket_list_unordered: got __ 2024-09-14T11:01:30.836 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.837+0000 7fc98eb42800 10 cls_bucket_list_unordered: got obj 2024-09-14T11:01:30.836 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.838+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc9840266d0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x563e4ab265d8 s->prefetch_data=0 2024-09-14T11:01:30.837 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.839+0000 7fc98eb42800 10 manifest: total_size = 527 2024-09-14T11:01:30.837 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.839+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18068589574300133588 2024-09-14T11:01:30.837 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.839+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc9840266d0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x563e4ab265d8 s->prefetch_data=0 2024-09-14T11:01:30.837 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.839+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4ab265d8 2024-09-14T11:01:30.837 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.839+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7.2 2024-09-14T11:01:30.839 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.841+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:01:30.839 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.841+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=527 stripe_ofs=527 part_ofs=0 rule->part_size=0 2024-09-14T11:01:30.840 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.841+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18068589574300133588 2024-09-14T11:01:30.840 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.841+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:01:30.840 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.841+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7__shadow_.uiMOsQ9_ZbEeJoOCGBwMmEFrwRG7dTX_0 2024-09-14T11:01:30.840 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.841+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:01:30.840 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.841+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:01:30.840 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.841+0000 7fc98eb42800 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18068589574300133588 2024-09-14T11:01:30.840 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.842+0000 7fc98eb42800 20 get_obj_state: octx=0x563e4ab99c80 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x563e4ab265d8 s->prefetch_data=0 2024-09-14T11:01:30.841 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.842+0000 7fc86dffb640 20 handle_completion(): completion ok for obj=___ 2024-09-14T11:01:30.841 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.843+0000 7fc98eb42800 10 manifest: total_size = 24595 2024-09-14T11:01:30.841 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.843+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6786044003438548673 2024-09-14T11:01:30.842 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.843+0000 7fc98eb42800 20 get_obj_state: octx=0x563e4ab99c80 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x563e4ab265d8 s->prefetch_data=0 2024-09-14T11:01:30.842 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.843+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4ab265d8 2024-09-14T11:01:30.842 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.843+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7.3 2024-09-14T11:01:30.843 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.845+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:01:30.844 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.845+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=24595 stripe_ofs=24595 part_ofs=0 rule->part_size=0 2024-09-14T11:01:30.844 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.845+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6786044003438548673 2024-09-14T11:01:30.844 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.845+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:01:30.844 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.845+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7__shadow_.3Ei_pOWaSjmfb5lH1zw2wda3zbfRGI9_0 2024-09-14T11:01:30.844 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.845+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:01:30.844 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.845+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:01:30.844 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.845+0000 7fc98eb42800 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6786044003438548673 2024-09-14T11:01:30.845 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.846+0000 7fc86e7fc640 20 handle_completion(): completion ok for obj=__ _ 2024-09-14T11:01:30.845 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.846+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc97409a0c0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x563e4ab265d8 s->prefetch_data=0 2024-09-14T11:01:30.845 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.846+0000 7fc98eb42800 10 manifest: total_size = 2078 2024-09-14T11:01:30.845 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.846+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10830963675828438912 2024-09-14T11:01:30.845 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.846+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc97409a0c0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x563e4ab265d8 s->prefetch_data=0 2024-09-14T11:01:30.845 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.846+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4ab265d8 2024-09-14T11:01:30.845 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.846+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7.6 2024-09-14T11:01:30.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.848+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:01:30.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.848+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=2078 stripe_ofs=2078 part_ofs=0 rule->part_size=0 2024-09-14T11:01:30.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.848+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10830963675828438912 2024-09-14T11:01:30.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.848+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:01:30.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.848+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7__shadow_.2-QpI1rnLLbUQltOBchsNPElJYW5F4g_0 2024-09-14T11:01:30.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.848+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:01:30.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.848+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:01:30.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.848+0000 7fc98eb42800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10830963675828438912 2024-09-14T11:01:30.848 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.849+0000 7fc86dffb640 20 handle_completion(): completion ok for obj=__ 2024-09-14T11:01:30.848 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.849+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc9840049b0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x563e4ab265d8 s->prefetch_data=0 2024-09-14T11:01:30.848 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.850+0000 7fc98eb42800 10 manifest: total_size = 2078 2024-09-14T11:01:30.848 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.850+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6919761892311074116 2024-09-14T11:01:30.848 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.850+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc9840049b0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x563e4ab265d8 s->prefetch_data=0 2024-09-14T11:01:30.848 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.850+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4ab265d8 2024-09-14T11:01:30.848 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.850+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7.8 2024-09-14T11:01:30.850 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.852+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:01:30.850 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.852+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=2078 stripe_ofs=2078 part_ofs=0 rule->part_size=0 2024-09-14T11:01:30.850 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.852+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6919761892311074116 2024-09-14T11:01:30.850 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.852+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:01:30.851 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.852+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7__shadow_.CRFDiQH4WGh0ZmkDEyL21FKgA1KRjaC_0 2024-09-14T11:01:30.851 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.852+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:01:30.851 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.852+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:01:30.851 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.852+0000 7fc98eb42800 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6919761892311074116 2024-09-14T11:01:30.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.853+0000 7fc86e7fc640 20 handle_completion(): completion ok for obj=obj 2024-09-14T11:01:30.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.853+0000 7fc98eb42800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:01:30.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.853+0000 7fc98eb42800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:01:30.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.854+0000 7fc98eb42800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:01:30.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.854+0000 7fc98eb42800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:01:30.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.854+0000 7fc98eb42800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:01:30.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.854+0000 7fc98eb42800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:01:30.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.854+0000 7fc98eb42800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7])"; uploads.size()=0; is_truncated=0 2024-09-14T11:01:30.854 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.855+0000 7fc98eb42800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-09-14T11:01:30.854 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.856+0000 7fc98eb42800 20 rados->read ofs=0 len=0 2024-09-14T11:01:30.854 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.856+0000 7fc98eb42800 20 rados_obj.operate() r=0 bl.length=223 2024-09-14T11:01:30.854 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.856+0000 7fc98eb42800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-09-14T11:01:30.854 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.856+0000 7fc98eb42800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-09-14T11:01:30.855 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.857+0000 7fc98eb42800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-09-14T11:01:30.855 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.857+0000 7fc98eb42800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-09-14T11:01:30.856 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.857+0000 7fc86dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595153 cookie 94825540852640 notifier 5702 bl.length()=181 2024-09-14T11:01:30.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.859+0000 7fc98eb42800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7 from cache 2024-09-14T11:01:30.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.859+0000 7fc98eb42800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7, ofs0, ns] 2024-09-14T11:01:30.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.859+0000 7fc86e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595154 cookie 94825540852640 notifier 5702 bl.length()=238 2024-09-14T11:01:30.860 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.862+0000 7fc98eb42800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7 : miss 2024-09-14T11:01:30.860 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.862+0000 7fc98eb42800 20 rados->read ofs=0 len=0 2024-09-14T11:01:30.860 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.862+0000 7fc98eb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:01:30.860 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.862+0000 7fc98eb42800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7 info.flags=0x0 2024-09-14T11:01:30.860 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.862+0000 7fc98eb42800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7 to cache LRU end 2024-09-14T11:01:30.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.864+0000 7fc98eb42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8 : miss 2024-09-14T11:01:30.864 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.864+0000 7fc98eb42800 20 rados->read ofs=0 len=0 2024-09-14T11:01:30.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.864+0000 7fc98eb42800 20 rados_obj.operate() r=0 bl.length=445 2024-09-14T11:01:30.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.864+0000 7fc98eb42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8 info.flags=0x17 2024-09-14T11:01:30.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.864+0000 7fc98eb42800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8 to cache LRU end 2024-09-14T11:01:30.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.864+0000 7fc98eb42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:01:30.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.864+0000 7fc98eb42800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:01:30.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.864+0000 7fc98eb42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8 2024-09-14T11:01:30.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.865+0000 7fc98eb42800 10 cls_bucket_list_unordered: got ___ 2024-09-14T11:01:30.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.866+0000 7fc98eb42800 10 cls_bucket_list_unordered: got __ _ 2024-09-14T11:01:30.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.867+0000 7fc98eb42800 10 cls_bucket_list_unordered: got __ 2024-09-14T11:01:30.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.867+0000 7fc98eb42800 10 cls_bucket_list_unordered: got obj 2024-09-14T11:01:30.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.868+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc97c004c90 obj=test-client.0-r-test-small-obj-data.3:___ state=0x563e4ab265d8 s->prefetch_data=0 2024-09-14T11:01:30.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.868+0000 7fc98eb42800 10 manifest: total_size = 4134 2024-09-14T11:01:30.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.868+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5043473179856349148 2024-09-14T11:01:30.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.868+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc97c004c90 obj=test-client.0-r-test-small-obj-data.3:___ state=0x563e4ab265d8 s->prefetch_data=0 2024-09-14T11:01:30.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.868+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4ab265d8 2024-09-14T11:01:30.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.868+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8.2 2024-09-14T11:01:30.869 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.870+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:01:30.869 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.870+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=4134 stripe_ofs=4134 part_ofs=0 rule->part_size=0 2024-09-14T11:01:30.869 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.870+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5043473179856349148 2024-09-14T11:01:30.869 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.870+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:01:30.869 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.870+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8__shadow_.lCIDlXGBbbzi4_Fap9QtJoqnraWIkBr_0 2024-09-14T11:01:30.869 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.870+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:01:30.869 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.870+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:01:30.869 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.870+0000 7fc98eb42800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5043473179856349148 2024-09-14T11:01:30.870 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.871+0000 7fc86e7fc640 20 handle_completion(): completion ok for obj=___ 2024-09-14T11:01:30.870 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.872+0000 7fc98eb42800 20 get_obj_state: octx=0x563e4ab223d0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x563e4ab265d8 s->prefetch_data=0 2024-09-14T11:01:30.871 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.872+0000 7fc98eb42800 10 manifest: total_size = 1035 2024-09-14T11:01:30.871 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.872+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5567579803057526123 2024-09-14T11:01:30.871 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.872+0000 7fc98eb42800 20 get_obj_state: octx=0x563e4ab223d0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x563e4ab265d8 s->prefetch_data=0 2024-09-14T11:01:30.871 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.872+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4ab265d8 2024-09-14T11:01:30.871 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.872+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8.3 2024-09-14T11:01:30.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.874+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:01:30.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.874+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=1035 stripe_ofs=1035 part_ofs=0 rule->part_size=0 2024-09-14T11:01:30.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.874+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5567579803057526123 2024-09-14T11:01:30.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.874+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:01:30.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.874+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8__shadow_.GyVlMJZmsr3nij29TzlmckID8w5JMOp_0 2024-09-14T11:01:30.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.874+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:01:30.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.874+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:01:30.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.874+0000 7fc98eb42800 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5567579803057526123 2024-09-14T11:01:30.874 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.875+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc97c04d960 obj=test-client.0-r-test-small-obj-data.3:__ state=0x563e4ab265d8 s->prefetch_data=0 2024-09-14T11:01:30.874 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.875+0000 7fc86dffb640 20 handle_completion(): completion ok for obj=__ _ 2024-09-14T11:01:30.874 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.876+0000 7fc98eb42800 10 manifest: total_size = 1035 2024-09-14T11:01:30.874 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.876+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5381023215295808090 2024-09-14T11:01:30.874 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.876+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc97c04d960 obj=test-client.0-r-test-small-obj-data.3:__ state=0x563e4ab265d8 s->prefetch_data=0 2024-09-14T11:01:30.874 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.876+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4ab265d8 2024-09-14T11:01:30.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.876+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8.6 2024-09-14T11:01:30.876 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.878+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:01:30.876 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.878+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=1035 stripe_ofs=1035 part_ofs=0 rule->part_size=0 2024-09-14T11:01:30.876 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.878+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5381023215295808090 2024-09-14T11:01:30.876 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.878+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:01:30.876 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.878+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8__shadow_.WRyb4Vo36FoYWQ27oZQIMD1ByFfkIOm_0 2024-09-14T11:01:30.877 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.878+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:01:30.877 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.878+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:01:30.877 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.878+0000 7fc98eb42800 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5381023215295808090 2024-09-14T11:01:30.877 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.879+0000 7fc86e7fc640 20 handle_completion(): completion ok for obj=__ 2024-09-14T11:01:30.877 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.879+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc97409a0c0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x563e4ab265d8 s->prefetch_data=0 2024-09-14T11:01:30.878 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.879+0000 7fc98eb42800 10 manifest: total_size = 1048576 2024-09-14T11:01:30.878 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.879+0000 7fc98eb42800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16577577958827977169 2024-09-14T11:01:30.878 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.879+0000 7fc98eb42800 20 get_obj_state: octx=0x7fc97409a0c0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x563e4ab265d8 s->prefetch_data=0 2024-09-14T11:01:30.878 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.879+0000 7fc98eb42800 20 prepare_atomic_modification: state is not atomic. state=0x563e4ab265d8 2024-09-14T11:01:30.878 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.879+0000 7fc98eb42800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8.8 2024-09-14T11:01:30.880 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.881+0000 7fc98eb42800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:01:30.880 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.881+0000 7fc98eb42800 20 RGWObjManifest::operator++(): result: ofs=1048576 stripe_ofs=1048576 part_ofs=0 rule->part_size=0 2024-09-14T11:01:30.880 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.881+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16577577958827977169 2024-09-14T11:01:30.880 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.881+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:01:30.880 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.881+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8__shadow_.ogbprFc4TFGrxXN1JoSqghCFchHqMWC_0 2024-09-14T11:01:30.880 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.881+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:01:30.880 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.881+0000 7fc98eb42800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:01:30.880 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.881+0000 7fc98eb42800 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16577577958827977169 2024-09-14T11:01:30.881 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.882+0000 7fc86dffb640 20 handle_completion(): completion ok for obj=obj 2024-09-14T11:01:30.881 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.883+0000 7fc98eb42800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:01:30.881 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.883+0000 7fc98eb42800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:01:30.882 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.883+0000 7fc98eb42800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:01:30.882 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.883+0000 7fc98eb42800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:01:30.882 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.883+0000 7fc98eb42800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:01:30.882 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.883+0000 7fc98eb42800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:01:30.882 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.883+0000 7fc98eb42800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8])"; uploads.size()=0; is_truncated=0 2024-09-14T11:01:30.884 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.885+0000 7fc98eb42800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-09-14T11:01:30.884 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.885+0000 7fc98eb42800 20 rados->read ofs=0 len=0 2024-09-14T11:01:30.884 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.886+0000 7fc98eb42800 20 rados_obj.operate() r=0 bl.length=223 2024-09-14T11:01:30.884 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.886+0000 7fc98eb42800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-09-14T11:01:30.884 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.886+0000 7fc98eb42800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-09-14T11:01:30.885 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.887+0000 7fc98eb42800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-09-14T11:01:30.885 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.887+0000 7fc98eb42800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-09-14T11:01:30.886 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.887+0000 7fc86e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595155 cookie 94825540852640 notifier 5702 bl.length()=181 2024-09-14T11:01:30.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.889+0000 7fc98eb42800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8 from cache 2024-09-14T11:01:30.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.889+0000 7fc98eb42800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8, ofs0, ns] 2024-09-14T11:01:30.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.889+0000 7fc86e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595156 cookie 94825540852640 notifier 5702 bl.length()=238 2024-09-14T11:01:30.890 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.892+0000 7fc98eb42800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8 : miss 2024-09-14T11:01:30.890 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.892+0000 7fc98eb42800 20 rados->read ofs=0 len=0 2024-09-14T11:01:30.891 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.892+0000 7fc98eb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:01:30.891 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.892+0000 7fc98eb42800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8 info.flags=0x0 2024-09-14T11:01:30.891 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.892+0000 7fc98eb42800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8 to cache LRU end 2024-09-14T11:01:30.892 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.894+0000 7fc98eb42800 10 removing key index: KPZXPGGMFVDNXQQNIZOZ 2024-09-14T11:01:30.894 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.895+0000 7fc98eb42800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:KPZXPGGMFVDNXQQNIZOZ, ofs0, ns] 2024-09-14T11:01:30.894 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.896+0000 7fc86e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595085 cookie 94825540864304 notifier 5702 bl.length()=170 2024-09-14T11:01:30.894 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.896+0000 7fc98eb42800 10 removing email index: ragweed.client.0+test@test.test 2024-09-14T11:01:30.895 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.897+0000 7fc98eb42800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-14T11:01:30.895 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.897+0000 7fc86dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595095 cookie 94825540862096 notifier 5702 bl.length()=182 2024-09-14T11:01:30.896 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.898+0000 7fc98eb42800 10 removing user buckets index 2024-09-14T11:01:30.897 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.898+0000 7fc98eb42800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-09-14T11:01:30.897 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.899+0000 7fc86dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595152 cookie 94825540865872 notifier 5702 bl.length()=173 2024-09-14T11:01:30.897 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.899+0000 7fc98eb42800 10 removing user index: ragweed.client.0 2024-09-14T11:01:30.898 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.900+0000 7fc98eb42800 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-09-14T11:01:30.899 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.900+0000 7fc98eb42800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-14T11:01:30.899 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.900+0000 7fc86e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595157 cookie 94825540868848 notifier 5702 bl.length()=165 2024-09-14T11:01:30.900 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.902+0000 7fc8417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:01:30.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.904+0000 7fc98eb42800 20 remove_watcher() i=0 2024-09-14T11:01:30.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.904+0000 7fc98eb42800 2 removed watcher, disabling cache 2024-09-14T11:01:30.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.905+0000 7fc98eb42800 20 remove_watcher() i=1 2024-09-14T11:01:30.904 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.906+0000 7fc98eb42800 20 remove_watcher() i=2 2024-09-14T11:01:30.905 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.907+0000 7fc98eb42800 20 remove_watcher() i=3 2024-09-14T11:01:30.906 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.907+0000 7fc98eb42800 20 remove_watcher() i=4 2024-09-14T11:01:30.907 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.908+0000 7fc98eb42800 20 remove_watcher() i=5 2024-09-14T11:01:30.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.909+0000 7fc98eb42800 20 remove_watcher() i=6 2024-09-14T11:01:30.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:30.910+0000 7fc98eb42800 20 remove_watcher() i=7 2024-09-14T11:01:30.920 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-09-14T11:01:30.976 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:01:30.976 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:01:31.009 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.011+0000 7f4ed742f800 20 rados->read ofs=0 len=0 2024-09-14T11:01:31.011 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.013+0000 7f4ed742f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:01:31.011 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.013+0000 7f4ed742f800 20 realm 2024-09-14T11:01:31.011 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.013+0000 7f4ed742f800 20 rados->read ofs=0 len=0 2024-09-14T11:01:31.011 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.013+0000 7f4ed742f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:01:31.012 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.013+0000 7f4ed742f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:01:31.012 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.013+0000 7f4ed742f800 20 rados->read ofs=0 len=0 2024-09-14T11:01:31.012 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.013+0000 7f4ed742f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:01:31.012 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.013+0000 7f4ed742f800 20 rados->read ofs=0 len=0 2024-09-14T11:01:31.012 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.014+0000 7f4ed742f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:01:31.012 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.014+0000 7f4ed742f800 20 rados->read ofs=0 len=0 2024-09-14T11:01:31.013 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.015+0000 7f4ed742f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:01:31.013 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.015+0000 7f4ed742f800 20 searching for the correct realm 2024-09-14T11:01:31.015 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.017+0000 7f4ecffff640 0 -- 172.21.15.97:0/3713719754 >> [v2:172.21.15.97:6816/4093696477,v1:172.21.15.97:6817/4093696477] conn(0x55a01b3cc650 msgr2=0x55a01b3cea40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:01:31.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.020+0000 7f4ecffff640 0 -- 172.21.15.97:0/3713719754 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f4ec8077060 msgr2=0x7f4ec80817a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:01:31.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.227+0000 7f4ed742f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:01:31.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.227+0000 7f4ed742f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:01:31.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.227+0000 7f4ed742f800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:01:31.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.227+0000 7f4ed742f800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:01:31.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.227+0000 7f4ed742f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:01:31.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.227+0000 7f4ed742f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:01:31.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.227+0000 7f4ed742f800 20 rados->read ofs=0 len=0 2024-09-14T11:01:31.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.227+0000 7f4ed742f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:01:31.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.227+0000 7f4ed742f800 20 rados->read ofs=0 len=0 2024-09-14T11:01:31.227 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.227+0000 7f4ed742f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:01:31.227 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.228+0000 7f4ed742f800 20 rados->read ofs=0 len=0 2024-09-14T11:01:31.227 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.228+0000 7f4ed742f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:01:31.227 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.228+0000 7f4ed742f800 20 zone default found 2024-09-14T11:01:31.228 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.228+0000 7f4ed742f800 4 Realm: () 2024-09-14T11:01:31.228 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.228+0000 7f4ed742f800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:01:31.228 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.228+0000 7f4ed742f800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:01:31.228 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.228+0000 7f4ed742f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:01:31.228 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.228+0000 7f4ed742f800 20 zonegroup default 2024-09-14T11:01:31.228 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.228+0000 7f4ed742f800 20 rados->read ofs=0 len=0 2024-09-14T11:01:31.228 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.229+0000 7f4ed742f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:01:31.228 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.229+0000 7f4ed742f800 20 rados->read ofs=0 len=0 2024-09-14T11:01:31.228 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.229+0000 7f4ed742f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:01:31.228 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.229+0000 7f4ed742f800 20 rados->read ofs=0 len=0 2024-09-14T11:01:31.229 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.229+0000 7f4ed742f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:01:31.229 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.229+0000 7f4ed742f800 20 started sync module instance, tier type = 2024-09-14T11:01:31.229 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.229+0000 7f4ed742f800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:01:31.236 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.238+0000 7f4ed742f800 20 add_watcher() i=0 2024-09-14T11:01:31.236 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.238+0000 7f4ed742f800 20 add_watcher() i=1 2024-09-14T11:01:31.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.238+0000 7f4ed742f800 20 add_watcher() i=2 2024-09-14T11:01:31.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.238+0000 7f4ed742f800 20 add_watcher() i=3 2024-09-14T11:01:31.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.238+0000 7f4ed742f800 20 add_watcher() i=4 2024-09-14T11:01:31.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.238+0000 7f4ed742f800 20 add_watcher() i=5 2024-09-14T11:01:31.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.238+0000 7f4ed742f800 20 add_watcher() i=6 2024-09-14T11:01:31.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.239+0000 7f4ed742f800 20 add_watcher() i=7 2024-09-14T11:01:31.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.239+0000 7f4ed742f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:01:31.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.241+0000 7f4d8b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:01:31.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.241+0000 7f4ed742f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:01:31.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.241+0000 7f4ed742f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:01:31.274 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.275+0000 7f4d8a7e4640 20 reqs_thread_entry: start 2024-09-14T11:01:31.275 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.275+0000 7f4ed742f800 20 init_complete bucket index max shards: 11 2024-09-14T11:01:31.275 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.275+0000 7f4ed742f800 20 Filter name: none 2024-09-14T11:01:31.275 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.275+0000 7f4d837fe640 20 reqs_thread_entry: start 2024-09-14T11:01:31.275 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.275+0000 7f4ed742f800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-14T11:01:31.275 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.275+0000 7f4ed742f800 20 rados->read ofs=0 len=0 2024-09-14T11:01:31.275 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.276+0000 7f4ed742f800 20 rados_obj.operate() r=0 bl.length=486 2024-09-14T11:01:31.275 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.276+0000 7f4ed742f800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-09-14T11:01:31.275 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.276+0000 7f4ed742f800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:01:31.275 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.276+0000 7f4ed742f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:01:31.275 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.276+0000 7f4ed742f800 10 removing key index: ORWSJQLTLMTFGHDNJQIL 2024-09-14T11:01:31.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.277+0000 7f4ed742f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.keys:ORWSJQLTLMTFGHDNJQIL, ofs0, ns] 2024-09-14T11:01:31.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.277+0000 7f4dabfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595153 cookie 94146140158272 notifier 5720 bl.length()=170 2024-09-14T11:01:31.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.278+0000 7f4ed742f800 10 removing email index: sysuser.client.0+test@test.test 2024-09-14T11:01:31.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.279+0000 7f4ed742f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-14T11:01:31.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.279+0000 7f4dab7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595158 cookie 94146140154464 notifier 5720 bl.length()=182 2024-09-14T11:01:31.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.279+0000 7f4ed742f800 10 removing user buckets index 2024-09-14T11:01:31.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.281+0000 7f4ed742f800 10 removing user index: sysuser.client.0 2024-09-14T11:01:31.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.282+0000 7f4ed742f800 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-09-14T11:01:31.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.282+0000 7f4ed742f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-14T11:01:31.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.282+0000 7f4dab7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595096 cookie 94146140148096 notifier 5720 bl.length()=165 2024-09-14T11:01:31.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.283+0000 7f4d8b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:01:31.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.285+0000 7f4ed742f800 20 remove_watcher() i=0 2024-09-14T11:01:31.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.285+0000 7f4ed742f800 2 removed watcher, disabling cache 2024-09-14T11:01:31.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.286+0000 7f4ed742f800 20 remove_watcher() i=1 2024-09-14T11:01:31.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.287+0000 7f4ed742f800 20 remove_watcher() i=2 2024-09-14T11:01:31.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.288+0000 7f4ed742f800 20 remove_watcher() i=3 2024-09-14T11:01:31.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.289+0000 7f4ed742f800 20 remove_watcher() i=4 2024-09-14T11:01:31.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.290+0000 7f4ed742f800 20 remove_watcher() i=5 2024-09-14T11:01:31.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.291+0000 7f4ed742f800 20 remove_watcher() i=6 2024-09-14T11:01:31.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:01:31.292+0000 7f4ed742f800 20 remove_watcher() i=7 2024-09-14T11:01:31.302 INFO:tasks.ragweed:Removing ragweed... 2024-09-14T11:01:31.302 DEBUG:teuthology.orchestra.run.smithi097:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-09-14T11:01:31.373 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:01:31.383 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:01:31.383 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:01:31.383 DEBUG:teuthology.orchestra.run.smithi097:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:01:31.413 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:01:31.413 INFO:teuthology.orchestra.run.smithi097.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:01:31.413 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:01:31.482 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:01:31.482 DEBUG:teuthology.orchestra.run.smithi097:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:01:31.551 INFO:tasks.workunit:timeout=3h 2024-09-14T11:01:31.551 INFO:tasks.workunit:cleanup=True 2024-09-14T11:01:31.551 DEBUG:teuthology.orchestra.run.smithi097:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:01:31.621 INFO:tasks.workunit.client.0.smithi097.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:02:28.635 INFO:tasks.workunit.client.0.smithi097.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:02:28.635 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:28.635 INFO:tasks.workunit.client.0.smithi097.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:02:28.635 INFO:tasks.workunit.client.0.smithi097.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:02:28.635 INFO:tasks.workunit.client.0.smithi097.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:02:28.635 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:28.635 INFO:tasks.workunit.client.0.smithi097.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:02:28.636 INFO:tasks.workunit.client.0.smithi097.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:02:28.636 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:28.636 INFO:tasks.workunit.client.0.smithi097.stderr: git switch -c 2024-09-14T11:02:28.636 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:28.636 INFO:tasks.workunit.client.0.smithi097.stderr:Or undo this operation with: 2024-09-14T11:02:28.636 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:28.636 INFO:tasks.workunit.client.0.smithi097.stderr: git switch - 2024-09-14T11:02:28.636 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:28.636 INFO:tasks.workunit.client.0.smithi097.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:02:28.636 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:28.637 INFO:tasks.workunit.client.0.smithi097.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:02:28.638 DEBUG:teuthology.orchestra.run.smithi097:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:02:28.707 INFO:tasks.workunit.client.0.smithi097.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:02:28.709 INFO:tasks.workunit.client.0.smithi097.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:02:28.709 INFO:tasks.workunit.client.0.smithi097.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:02:28.757 INFO:tasks.workunit.client.0.smithi097.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:02:28.805 INFO:tasks.workunit.client.0.smithi097.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:02:28.844 INFO:tasks.workunit.client.0.smithi097.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:02:28.846 INFO:tasks.workunit.client.0.smithi097.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:02:28.846 INFO:tasks.workunit.client.0.smithi097.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:02:28.884 INFO:tasks.workunit.client.0.smithi097.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:02:28.888 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-14T11:02:28.888 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:02:28.956 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-09-14T11:02:28.957 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-09-14T11:02:28.958 DEBUG:teuthology.orchestra.run.smithi097:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-14T11:02:29.031 INFO:tasks.workunit.client.0.smithi097.stderr:+ ulimit -c 0 2024-09-14T11:02:29.032 INFO:tasks.workunit.client.0.smithi097.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-14T11:02:29.032 INFO:tasks.workunit.client.0.smithi097.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:02:29.032 INFO:tasks.workunit.client.0.smithi097.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:02:31.273 INFO:tasks.workunit.client.0.smithi097.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-14T11:02:31.273 INFO:tasks.workunit.client.0.smithi097.stderr:++ deactivate nondestructive 2024-09-14T11:02:31.273 INFO:tasks.workunit.client.0.smithi097.stderr:++ '[' -n '' ']' 2024-09-14T11:02:31.273 INFO:tasks.workunit.client.0.smithi097.stderr:++ '[' -n '' ']' 2024-09-14T11:02:31.273 INFO:tasks.workunit.client.0.smithi097.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:02:31.273 INFO:tasks.workunit.client.0.smithi097.stderr:++ hash -r 2024-09-14T11:02:31.273 INFO:tasks.workunit.client.0.smithi097.stderr:++ '[' -n '' ']' 2024-09-14T11:02:31.273 INFO:tasks.workunit.client.0.smithi097.stderr:++ unset VIRTUAL_ENV 2024-09-14T11:02:31.273 INFO:tasks.workunit.client.0.smithi097.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-14T11:02:31.273 INFO:tasks.workunit.client.0.smithi097.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:02:31.274 INFO:tasks.workunit.client.0.smithi097.stderr:++ export VIRTUAL_ENV 2024-09-14T11:02:31.274 INFO:tasks.workunit.client.0.smithi097.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:02:31.274 INFO:tasks.workunit.client.0.smithi097.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:02:31.274 INFO:tasks.workunit.client.0.smithi097.stderr:++ export PATH 2024-09-14T11:02:31.274 INFO:tasks.workunit.client.0.smithi097.stderr:++ '[' -n '' ']' 2024-09-14T11:02:31.274 INFO:tasks.workunit.client.0.smithi097.stderr:++ '[' -z '' ']' 2024-09-14T11:02:31.274 INFO:tasks.workunit.client.0.smithi097.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-14T11:02:31.274 INFO:tasks.workunit.client.0.smithi097.stderr:++ PS1='(rgw) ' 2024-09-14T11:02:31.274 INFO:tasks.workunit.client.0.smithi097.stderr:++ export PS1 2024-09-14T11:02:31.274 INFO:tasks.workunit.client.0.smithi097.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:02:31.274 INFO:tasks.workunit.client.0.smithi097.stderr:++ hash -r 2024-09-14T11:02:31.274 INFO:tasks.workunit.client.0.smithi097.stderr:+ pip install pip --upgrade 2024-09-14T11:02:31.499 INFO:tasks.workunit.client.0.smithi097.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-14T11:02:31.682 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting pip 2024-09-14T11:02:31.688 INFO:tasks.workunit.client.0.smithi097.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T11:02:31.734 INFO:tasks.workunit.client.0.smithi097.stdout:Installing collected packages: pip 2024-09-14T11:02:31.734 INFO:tasks.workunit.client.0.smithi097.stdout: Attempting uninstall: pip 2024-09-14T11:02:31.734 INFO:tasks.workunit.client.0.smithi097.stdout: Found existing installation: pip 21.3.1 2024-09-14T11:02:31.885 INFO:tasks.workunit.client.0.smithi097.stdout: Uninstalling pip-21.3.1: 2024-09-14T11:02:31.891 INFO:tasks.workunit.client.0.smithi097.stdout: Successfully uninstalled pip-21.3.1 2024-09-14T11:02:32.617 INFO:tasks.workunit.client.0.smithi097.stdout:Successfully installed pip-24.2 2024-09-14T11:02:32.666 INFO:tasks.workunit.client.0.smithi097.stderr:+ pip install boto3 2024-09-14T11:02:33.436 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting boto3 2024-09-14T11:02:33.437 INFO:tasks.workunit.client.0.smithi097.stdout: Using cached boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T11:02:34.015 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T11:02:34.016 INFO:tasks.workunit.client.0.smithi097.stdout: Using cached botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T11:02:34.060 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T11:02:34.062 INFO:tasks.workunit.client.0.smithi097.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T11:02:34.106 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T11:02:34.107 INFO:tasks.workunit.client.0.smithi097.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T11:02:34.158 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:02:34.159 INFO:tasks.workunit.client.0.smithi097.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T11:02:34.234 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:02:34.235 INFO:tasks.workunit.client.0.smithi097.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-14T11:02:34.397 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:02:34.398 INFO:tasks.workunit.client.0.smithi097.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T11:02:34.402 INFO:tasks.workunit.client.0.smithi097.stdout:Using cached boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T11:02:34.403 INFO:tasks.workunit.client.0.smithi097.stdout:Using cached botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T11:02:34.413 INFO:tasks.workunit.client.0.smithi097.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T11:02:34.414 INFO:tasks.workunit.client.0.smithi097.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T11:02:34.415 INFO:tasks.workunit.client.0.smithi097.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T11:02:34.417 INFO:tasks.workunit.client.0.smithi097.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-14T11:02:34.418 INFO:tasks.workunit.client.0.smithi097.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:02:34.491 INFO:tasks.workunit.client.0.smithi097.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T11:02:35.509 INFO:tasks.workunit.client.0.smithi097.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-14T11:02:35.626 INFO:tasks.workunit.client.0.smithi097.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-09-14T11:02:35.748 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-09-14T11:02:35.783 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:02:35.783 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:02:35.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.822+0000 7f870d339800 20 rados->read ofs=0 len=0 2024-09-14T11:02:35.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.824+0000 7f870d339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:35.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.824+0000 7f870d339800 20 realm 2024-09-14T11:02:35.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.824+0000 7f870d339800 20 rados->read ofs=0 len=0 2024-09-14T11:02:35.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.824+0000 7f870d339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:35.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.824+0000 7f870d339800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:02:35.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.824+0000 7f870d339800 20 rados->read ofs=0 len=0 2024-09-14T11:02:35.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.824+0000 7f870d339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:35.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.824+0000 7f870d339800 20 rados->read ofs=0 len=0 2024-09-14T11:02:35.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.825+0000 7f870d339800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:35.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.825+0000 7f870d339800 20 rados->read ofs=0 len=0 2024-09-14T11:02:35.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.826+0000 7f870d339800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:02:35.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.826+0000 7f870d339800 20 searching for the correct realm 2024-09-14T11:02:35.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.829+0000 7f8708fc7640 0 -- 172.21.15.97:0/2445887911 >> [v2:172.21.15.152:6808/1010851305,v1:172.21.15.152:6809/1010851305] conn(0x55b2f1108980 msgr2=0x55b2f110ae40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:02:35.830 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.832+0000 7f8703fff640 0 -- 172.21.15.97:0/2445887911 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f86fc09d430 msgr2=0x7f86fc09d870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:02:35.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.836+0000 7f870d339800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:02:35.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.836+0000 7f870d339800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:02:35.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.836+0000 7f870d339800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:02:35.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.836+0000 7f870d339800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:02:35.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.836+0000 7f870d339800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:02:35.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.836+0000 7f870d339800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:02:35.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.836+0000 7f870d339800 20 rados->read ofs=0 len=0 2024-09-14T11:02:35.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.837+0000 7f870d339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:35.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.837+0000 7f870d339800 20 rados->read ofs=0 len=0 2024-09-14T11:02:35.837 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.837+0000 7f870d339800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:35.837 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.837+0000 7f870d339800 20 rados->read ofs=0 len=0 2024-09-14T11:02:35.837 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.837+0000 7f870d339800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:02:35.837 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.837+0000 7f870d339800 20 zone default found 2024-09-14T11:02:35.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.837+0000 7f870d339800 4 Realm: () 2024-09-14T11:02:35.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.837+0000 7f870d339800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:02:35.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.837+0000 7f870d339800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:02:35.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.837+0000 7f870d339800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:02:35.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.837+0000 7f870d339800 20 zonegroup default 2024-09-14T11:02:35.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.837+0000 7f870d339800 20 rados->read ofs=0 len=0 2024-09-14T11:02:35.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.838+0000 7f870d339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:35.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.838+0000 7f870d339800 20 rados->read ofs=0 len=0 2024-09-14T11:02:35.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.838+0000 7f870d339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:35.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.838+0000 7f870d339800 20 rados->read ofs=0 len=0 2024-09-14T11:02:35.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.838+0000 7f870d339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:35.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.838+0000 7f870d339800 20 started sync module instance, tier type = 2024-09-14T11:02:35.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.838+0000 7f870d339800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:02:35.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.848+0000 7f870d339800 20 add_watcher() i=0 2024-09-14T11:02:35.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.848+0000 7f870d339800 20 add_watcher() i=1 2024-09-14T11:02:35.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.848+0000 7f870d339800 20 add_watcher() i=2 2024-09-14T11:02:35.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.848+0000 7f870d339800 20 add_watcher() i=3 2024-09-14T11:02:35.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.848+0000 7f870d339800 20 add_watcher() i=4 2024-09-14T11:02:35.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.848+0000 7f870d339800 20 add_watcher() i=5 2024-09-14T11:02:35.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.848+0000 7f870d339800 20 add_watcher() i=6 2024-09-14T11:02:35.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.849+0000 7f870d339800 20 add_watcher() i=7 2024-09-14T11:02:35.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.849+0000 7f870d339800 2 all 8 watchers are set, enabling cache 2024-09-14T11:02:35.849 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.851+0000 7f85befe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:02:35.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.851+0000 7f870d339800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:02:35.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.851+0000 7f870d339800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:02:35.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.851+0000 7f870d339800 5 note: GC not initialized 2024-09-14T11:02:35.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.851+0000 7f85bdfe3640 20 reqs_thread_entry: start 2024-09-14T11:02:35.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.852+0000 7f870d339800 20 init_complete bucket index max shards: 11 2024-09-14T11:02:35.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.852+0000 7f870d339800 20 Filter name: none 2024-09-14T11:02:35.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.852+0000 7f852f7fe640 20 reqs_thread_entry: start 2024-09-14T11:02:35.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.852+0000 7f870d339800 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-09-14T11:02:35.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.852+0000 7f870d339800 20 rados->read ofs=0 len=0 2024-09-14T11:02:35.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.852+0000 7f870d339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:35.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.852+0000 7f870d339800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-09-14T11:02:35.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.852+0000 7f870d339800 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-09-14T11:02:35.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.852+0000 7f870d339800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-14T11:02:35.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.852+0000 7f870d339800 20 rados->read ofs=0 len=0 2024-09-14T11:02:35.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.852+0000 7f870d339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:35.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.852+0000 7f870d339800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-14T11:02:35.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.852+0000 7f870d339800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-14T11:02:35.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.852+0000 7f870d339800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-14T11:02:35.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.852+0000 7f870d339800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-14T11:02:35.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.854+0000 7f870d339800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-09-14T11:02:35.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.854+0000 7f870d339800 10 moving default.rgw.meta+users.uid+tester to cache LRU end 2024-09-14T11:02:35.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.854+0000 7f870d339800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester, ofs0, ns] 2024-09-14T11:02:35.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.854+0000 7f85dffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595154 cookie 94227036958944 notifier 5735 bl.length()=569 2024-09-14T11:02:35.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.854+0000 7f85dffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-09-14T11:02:35.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.854+0000 7f85dffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester to cache LRU end 2024-09-14T11:02:35.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.856+0000 7f870d339800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-14T11:02:35.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.856+0000 7f870d339800 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-14T11:02:35.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.856+0000 7f870d339800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-14T11:02:35.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.856+0000 7f85dffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595155 cookie 94227036955968 notifier 5735 bl.length()=180 2024-09-14T11:02:35.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.856+0000 7f85dffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-14T11:02:35.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.856+0000 7f85dffff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-14T11:02:35.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.858+0000 7f85befe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:02:35.859 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.861+0000 7f870d339800 20 remove_watcher() i=0 2024-09-14T11:02:35.859 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.861+0000 7f870d339800 2 removed watcher, disabling cache 2024-09-14T11:02:35.860 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.862+0000 7f870d339800 20 remove_watcher() i=1 2024-09-14T11:02:35.861 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.863+0000 7f870d339800 20 remove_watcher() i=2 2024-09-14T11:02:35.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.864+0000 7f870d339800 20 remove_watcher() i=3 2024-09-14T11:02:35.864 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.865+0000 7f870d339800 20 remove_watcher() i=4 2024-09-14T11:02:35.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.868+0000 7f870d339800 20 remove_watcher() i=5 2024-09-14T11:02:35.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.869+0000 7f870d339800 20 remove_watcher() i=6 2024-09-14T11:02:35.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:35.870+0000 7f870d339800 20 remove_watcher() i=7 2024-09-14T11:02:36.094 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: reshard add 2024-09-14T11:02:36.095 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:36.096 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:02:36.124 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:02:36.124 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:02:36.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.162+0000 7f7498924800 20 rados->read ofs=0 len=0 2024-09-14T11:02:36.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.164+0000 7f7498924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:36.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.164+0000 7f7498924800 20 realm 2024-09-14T11:02:36.164 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.164+0000 7f7498924800 20 rados->read ofs=0 len=0 2024-09-14T11:02:36.164 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.165+0000 7f7498924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:36.164 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.165+0000 7f7498924800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:02:36.164 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.165+0000 7f7498924800 20 rados->read ofs=0 len=0 2024-09-14T11:02:36.164 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.165+0000 7f7498924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:36.164 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.165+0000 7f7498924800 20 rados->read ofs=0 len=0 2024-09-14T11:02:36.164 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.166+0000 7f7498924800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:36.164 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.166+0000 7f7498924800 20 rados->read ofs=0 len=0 2024-09-14T11:02:36.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.166+0000 7f7498924800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:02:36.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.166+0000 7f7498924800 20 searching for the correct realm 2024-09-14T11:02:36.167 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.168+0000 7f748bd01640 0 -- 172.21.15.97:0/3368857545 >> [v2:172.21.15.97:6816/4093696477,v1:172.21.15.97:6817/4093696477] conn(0x5626e0e23690 msgr2=0x5626e0e25b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:02:36.170 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.171+0000 7f748bd01640 0 -- 172.21.15.97:0/3368857545 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f7484074be0 msgr2=0x7f7484073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:02:36.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.379+0000 7f7498924800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:02:36.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.379+0000 7f7498924800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:02:36.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.379+0000 7f7498924800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:02:36.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.379+0000 7f7498924800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:02:36.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.379+0000 7f7498924800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:02:36.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.379+0000 7f7498924800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:02:36.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.379+0000 7f7498924800 20 rados->read ofs=0 len=0 2024-09-14T11:02:36.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.379+0000 7f7498924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:36.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.379+0000 7f7498924800 20 rados->read ofs=0 len=0 2024-09-14T11:02:36.379 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.379+0000 7f7498924800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:36.379 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.379+0000 7f7498924800 20 rados->read ofs=0 len=0 2024-09-14T11:02:36.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.380+0000 7f7498924800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:02:36.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.380+0000 7f7498924800 20 zone default found 2024-09-14T11:02:36.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.380+0000 7f7498924800 4 Realm: () 2024-09-14T11:02:36.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.380+0000 7f7498924800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:02:36.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.380+0000 7f7498924800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:02:36.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.380+0000 7f7498924800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:02:36.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.380+0000 7f7498924800 20 zonegroup default 2024-09-14T11:02:36.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.380+0000 7f7498924800 20 rados->read ofs=0 len=0 2024-09-14T11:02:36.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.380+0000 7f7498924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:36.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.380+0000 7f7498924800 20 rados->read ofs=0 len=0 2024-09-14T11:02:36.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.380+0000 7f7498924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:36.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.380+0000 7f7498924800 20 rados->read ofs=0 len=0 2024-09-14T11:02:36.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.381+0000 7f7498924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:36.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.381+0000 7f7498924800 20 started sync module instance, tier type = 2024-09-14T11:02:36.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.381+0000 7f7498924800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:02:36.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.390+0000 7f7498924800 20 add_watcher() i=0 2024-09-14T11:02:36.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.390+0000 7f7498924800 20 add_watcher() i=1 2024-09-14T11:02:36.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.390+0000 7f7498924800 20 add_watcher() i=2 2024-09-14T11:02:36.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.390+0000 7f7498924800 20 add_watcher() i=3 2024-09-14T11:02:36.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.390+0000 7f7498924800 20 add_watcher() i=4 2024-09-14T11:02:36.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.390+0000 7f7498924800 20 add_watcher() i=5 2024-09-14T11:02:36.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.390+0000 7f7498924800 20 add_watcher() i=6 2024-09-14T11:02:36.390 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.391+0000 7f7498924800 20 add_watcher() i=7 2024-09-14T11:02:36.390 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.391+0000 7f7498924800 2 all 8 watchers are set, enabling cache 2024-09-14T11:02:36.392 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.393+0000 7f734afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:02:36.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.394+0000 7f7498924800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:02:36.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.394+0000 7f7498924800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:02:36.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.394+0000 7f7498924800 5 note: GC not initialized 2024-09-14T11:02:36.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.394+0000 7f7349fdb640 20 reqs_thread_entry: start 2024-09-14T11:02:36.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.394+0000 7f7498924800 20 init_complete bucket index max shards: 11 2024-09-14T11:02:36.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.394+0000 7f7498924800 20 Filter name: none 2024-09-14T11:02:36.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.394+0000 7f72bb7fe640 20 reqs_thread_entry: start 2024-09-14T11:02:36.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.394+0000 7f7498924800 20 rados->read ofs=0 len=0 2024-09-14T11:02:36.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.395+0000 7f7498924800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:02:36.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.395+0000 7f7498924800 20 rados->read ofs=0 len=0 2024-09-14T11:02:36.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.395+0000 7f7498924800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:02:36.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.395+0000 7f7498924800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:02:36.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.395+0000 7f7498924800 20 rados->read ofs=0 len=0 2024-09-14T11:02:36.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.396+0000 7f7498924800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:02:36.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.396+0000 7f7498924800 20 rados->read ofs=0 len=0 2024-09-14T11:02:36.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.396+0000 7f7498924800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:02:36.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.396+0000 7f7498924800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:02:36.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.397+0000 7f734afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:02:36.398 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.400+0000 7f7498924800 20 remove_watcher() i=0 2024-09-14T11:02:36.398 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.400+0000 7f7498924800 2 removed watcher, disabling cache 2024-09-14T11:02:36.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.401+0000 7f7498924800 20 remove_watcher() i=1 2024-09-14T11:02:36.400 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.402+0000 7f7498924800 20 remove_watcher() i=2 2024-09-14T11:02:36.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.403+0000 7f7498924800 20 remove_watcher() i=3 2024-09-14T11:02:36.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.404+0000 7f7498924800 20 remove_watcher() i=4 2024-09-14T11:02:36.403 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.405+0000 7f7498924800 20 remove_watcher() i=5 2024-09-14T11:02:36.404 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.406+0000 7f7498924800 20 remove_watcher() i=6 2024-09-14T11:02:36.406 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.407+0000 7f7498924800 20 remove_watcher() i=7 2024-09-14T11:02:36.416 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:36.416 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:02:36.416 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: a-bucket id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-14T11:02:36.416 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:36.417 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 12 2024-09-14T11:02:36.448 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:02:36.449 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:02:36.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.487+0000 7fafd9522800 20 rados->read ofs=0 len=0 2024-09-14T11:02:36.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.488+0000 7fafd9522800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:36.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.488+0000 7fafd9522800 20 realm 2024-09-14T11:02:36.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.488+0000 7fafd9522800 20 rados->read ofs=0 len=0 2024-09-14T11:02:36.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.488+0000 7fafd9522800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:36.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.488+0000 7fafd9522800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:02:36.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.488+0000 7fafd9522800 20 rados->read ofs=0 len=0 2024-09-14T11:02:36.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.489+0000 7fafd9522800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:36.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.489+0000 7fafd9522800 20 rados->read ofs=0 len=0 2024-09-14T11:02:36.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.489+0000 7fafd9522800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:36.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.489+0000 7fafd9522800 20 rados->read ofs=0 len=0 2024-09-14T11:02:36.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.490+0000 7fafd9522800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:02:36.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.490+0000 7fafd9522800 20 searching for the correct realm 2024-09-14T11:02:36.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.492+0000 7fafd59af640 0 -- 172.21.15.97:0/3103135259 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7fafcc036070 msgr2=0x7fafcc026920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:02:36.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.697+0000 7fafd49ad640 0 -- 172.21.15.97:0/3103135259 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7fafc8018070 msgr2=0x7fafc8094040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:02:36.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.702+0000 7fafd9522800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:02:36.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.702+0000 7fafd9522800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:02:36.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.702+0000 7fafd9522800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:02:36.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.702+0000 7fafd9522800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:02:36.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.702+0000 7fafd9522800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:02:36.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.702+0000 7fafd9522800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:02:36.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.702+0000 7fafd9522800 20 rados->read ofs=0 len=0 2024-09-14T11:02:36.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.703+0000 7fafd9522800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:36.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.703+0000 7fafd9522800 20 rados->read ofs=0 len=0 2024-09-14T11:02:36.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.703+0000 7fafd9522800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:36.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.703+0000 7fafd9522800 20 rados->read ofs=0 len=0 2024-09-14T11:02:36.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.703+0000 7fafd9522800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:02:36.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.703+0000 7fafd9522800 20 zone default found 2024-09-14T11:02:36.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.703+0000 7fafd9522800 4 Realm: () 2024-09-14T11:02:36.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.703+0000 7fafd9522800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:02:36.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.703+0000 7fafd9522800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:02:36.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.703+0000 7fafd9522800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:02:36.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.703+0000 7fafd9522800 20 zonegroup default 2024-09-14T11:02:36.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.703+0000 7fafd9522800 20 rados->read ofs=0 len=0 2024-09-14T11:02:36.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.703+0000 7fafd9522800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:36.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.703+0000 7fafd9522800 20 rados->read ofs=0 len=0 2024-09-14T11:02:36.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.704+0000 7fafd9522800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:36.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.704+0000 7fafd9522800 20 rados->read ofs=0 len=0 2024-09-14T11:02:36.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.704+0000 7fafd9522800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:36.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.704+0000 7fafd9522800 20 started sync module instance, tier type = 2024-09-14T11:02:36.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.704+0000 7fafd9522800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:02:36.712 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.714+0000 7fafd9522800 20 add_watcher() i=0 2024-09-14T11:02:36.712 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.714+0000 7fafd9522800 20 add_watcher() i=1 2024-09-14T11:02:36.712 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.714+0000 7fafd9522800 20 add_watcher() i=2 2024-09-14T11:02:36.712 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.714+0000 7fafd9522800 20 add_watcher() i=3 2024-09-14T11:02:36.712 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.714+0000 7fafd9522800 20 add_watcher() i=4 2024-09-14T11:02:36.712 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.714+0000 7fafd9522800 20 add_watcher() i=5 2024-09-14T11:02:36.712 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.714+0000 7fafd9522800 20 add_watcher() i=6 2024-09-14T11:02:36.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.715+0000 7fafd9522800 20 add_watcher() i=7 2024-09-14T11:02:36.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.715+0000 7fafd9522800 2 all 8 watchers are set, enabling cache 2024-09-14T11:02:36.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.717+0000 7fae8b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:02:36.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.717+0000 7fafd9522800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:02:36.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.717+0000 7fafd9522800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:02:36.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.717+0000 7fafd9522800 5 note: GC not initialized 2024-09-14T11:02:36.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.717+0000 7fae8a7e4640 20 reqs_thread_entry: start 2024-09-14T11:02:36.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.717+0000 7fafd9522800 20 init_complete bucket index max shards: 11 2024-09-14T11:02:36.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.717+0000 7fafd9522800 20 Filter name: none 2024-09-14T11:02:36.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.718+0000 7fadfbfff640 20 reqs_thread_entry: start 2024-09-14T11:02:36.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.718+0000 7fafd9522800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:02:36.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.718+0000 7fafd9522800 20 rados->read ofs=0 len=0 2024-09-14T11:02:36.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.718+0000 7fafd9522800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:02:36.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.718+0000 7fafd9522800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:02:36.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.718+0000 7fafd9522800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:02:36.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.718+0000 7fafd9522800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 : miss 2024-09-14T11:02:36.718 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.718+0000 7fafd9522800 20 rados->read ofs=0 len=0 2024-09-14T11:02:36.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.718+0000 7fafd9522800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:02:36.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.718+0000 7fafd9522800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:02:36.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.718+0000 7fafd9522800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:02:36.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.718+0000 7fafd9522800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:02:36.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.718+0000 7fafd9522800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:02:36.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.718+0000 7fafd9522800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 2024-09-14T11:02:36.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.720+0000 7fae8b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:02:36.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.722+0000 7fafd9522800 20 remove_watcher() i=0 2024-09-14T11:02:36.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.722+0000 7fafd9522800 2 removed watcher, disabling cache 2024-09-14T11:02:36.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.723+0000 7fafd9522800 20 remove_watcher() i=1 2024-09-14T11:02:36.723 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.725+0000 7fafd9522800 20 remove_watcher() i=2 2024-09-14T11:02:36.724 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.726+0000 7fafd9522800 20 remove_watcher() i=3 2024-09-14T11:02:36.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.727+0000 7fafd9522800 20 remove_watcher() i=4 2024-09-14T11:02:36.726 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.728+0000 7fafd9522800 20 remove_watcher() i=5 2024-09-14T11:02:36.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.729+0000 7fafd9522800 20 remove_watcher() i=6 2024-09-14T11:02:36.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.730+0000 7fafd9522800 20 remove_watcher() i=7 2024-09-14T11:02:36.740 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin reshard list 2024-09-14T11:02:36.767 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:02:36.767 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:02:36.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.805+0000 7f3ba5d26800 20 rados->read ofs=0 len=0 2024-09-14T11:02:36.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.807+0000 7f3ba5d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:36.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.807+0000 7f3ba5d26800 20 realm 2024-09-14T11:02:36.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.807+0000 7f3ba5d26800 20 rados->read ofs=0 len=0 2024-09-14T11:02:36.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.807+0000 7f3ba5d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:36.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.807+0000 7f3ba5d26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:02:36.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.807+0000 7f3ba5d26800 20 rados->read ofs=0 len=0 2024-09-14T11:02:36.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.808+0000 7f3ba5d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:36.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.808+0000 7f3ba5d26800 20 rados->read ofs=0 len=0 2024-09-14T11:02:36.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.808+0000 7f3ba5d26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:36.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.808+0000 7f3ba5d26800 20 rados->read ofs=0 len=0 2024-09-14T11:02:36.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.809+0000 7f3ba5d26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:02:36.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.809+0000 7f3ba5d26800 20 searching for the correct realm 2024-09-14T11:02:36.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:36.811+0000 7f3ba215e640 0 -- 172.21.15.97:0/2006766548 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f3b8c06d4c0 msgr2=0x7f3b8c0327c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:02:37.014 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.016+0000 7f3ba115c640 0 -- 172.21.15.97:0/2006766548 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f3b9c096960 msgr2=0x7f3b9c07c3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:02:37.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.022+0000 7f3ba5d26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:02:37.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.022+0000 7f3ba5d26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:02:37.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.022+0000 7f3ba5d26800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:02:37.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.022+0000 7f3ba5d26800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:02:37.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.022+0000 7f3ba5d26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:02:37.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.022+0000 7f3ba5d26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:02:37.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.022+0000 7f3ba5d26800 20 rados->read ofs=0 len=0 2024-09-14T11:02:37.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.022+0000 7f3ba5d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:37.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.022+0000 7f3ba5d26800 20 rados->read ofs=0 len=0 2024-09-14T11:02:37.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.022+0000 7f3ba5d26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:37.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.022+0000 7f3ba5d26800 20 rados->read ofs=0 len=0 2024-09-14T11:02:37.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.023+0000 7f3ba5d26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:02:37.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.023+0000 7f3ba5d26800 20 zone default found 2024-09-14T11:02:37.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.023+0000 7f3ba5d26800 4 Realm: () 2024-09-14T11:02:37.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.023+0000 7f3ba5d26800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:02:37.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.023+0000 7f3ba5d26800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:02:37.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.023+0000 7f3ba5d26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:02:37.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.023+0000 7f3ba5d26800 20 zonegroup default 2024-09-14T11:02:37.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.023+0000 7f3ba5d26800 20 rados->read ofs=0 len=0 2024-09-14T11:02:37.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.023+0000 7f3ba5d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:37.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.023+0000 7f3ba5d26800 20 rados->read ofs=0 len=0 2024-09-14T11:02:37.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.023+0000 7f3ba5d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:37.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.023+0000 7f3ba5d26800 20 rados->read ofs=0 len=0 2024-09-14T11:02:37.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.024+0000 7f3ba5d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:37.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.024+0000 7f3ba5d26800 20 started sync module instance, tier type = 2024-09-14T11:02:37.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.024+0000 7f3ba5d26800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:02:37.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.033+0000 7f3ba5d26800 20 add_watcher() i=0 2024-09-14T11:02:37.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.033+0000 7f3ba5d26800 20 add_watcher() i=1 2024-09-14T11:02:37.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.033+0000 7f3ba5d26800 20 add_watcher() i=2 2024-09-14T11:02:37.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.033+0000 7f3ba5d26800 20 add_watcher() i=3 2024-09-14T11:02:37.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.033+0000 7f3ba5d26800 20 add_watcher() i=4 2024-09-14T11:02:37.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.033+0000 7f3ba5d26800 20 add_watcher() i=5 2024-09-14T11:02:37.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.033+0000 7f3ba5d26800 20 add_watcher() i=6 2024-09-14T11:02:37.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.034+0000 7f3ba5d26800 20 add_watcher() i=7 2024-09-14T11:02:37.033 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.034+0000 7f3ba5d26800 2 all 8 watchers are set, enabling cache 2024-09-14T11:02:37.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.036+0000 7f3a537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:02:37.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.036+0000 7f3ba5d26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:02:37.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.036+0000 7f3ba5d26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:02:37.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.036+0000 7f3ba5d26800 5 note: GC not initialized 2024-09-14T11:02:37.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.036+0000 7f3a527fc640 20 reqs_thread_entry: start 2024-09-14T11:02:37.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.036+0000 7f3ba5d26800 20 init_complete bucket index max shards: 11 2024-09-14T11:02:37.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.036+0000 7f3ba5d26800 20 Filter name: none 2024-09-14T11:02:37.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.036+0000 7f39c3fff640 20 reqs_thread_entry: start 2024-09-14T11:02:37.041 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.043+0000 7f3a537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:02:37.045 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.045+0000 7f3ba5d26800 20 remove_watcher() i=0 2024-09-14T11:02:37.045 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.045+0000 7f3ba5d26800 2 removed watcher, disabling cache 2024-09-14T11:02:37.045 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.046+0000 7f3ba5d26800 20 remove_watcher() i=1 2024-09-14T11:02:37.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.047+0000 7f3ba5d26800 20 remove_watcher() i=2 2024-09-14T11:02:37.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.048+0000 7f3ba5d26800 20 remove_watcher() i=3 2024-09-14T11:02:37.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.049+0000 7f3ba5d26800 20 remove_watcher() i=4 2024-09-14T11:02:37.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.051+0000 7f3ba5d26800 20 remove_watcher() i=5 2024-09-14T11:02:37.050 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.052+0000 7f3ba5d26800 20 remove_watcher() i=6 2024-09-14T11:02:37.051 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.053+0000 7f3ba5d26800 20 remove_watcher() i=7 2024-09-14T11:02:37.061 INFO:tasks.workunit.client.0.smithi097.stderr:bucket name a-bucket 2024-09-14T11:02:37.061 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: reshard process 2024-09-14T11:02:37.062 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:37.062 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin reshard process 2024-09-14T11:02:37.089 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:02:37.089 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:02:37.127 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.128+0000 7f6096d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:02:37.128 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.130+0000 7f6096d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:37.128 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.130+0000 7f6096d2a800 20 realm 2024-09-14T11:02:37.128 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.130+0000 7f6096d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:02:37.128 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.130+0000 7f6096d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:37.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.130+0000 7f6096d2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:02:37.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.130+0000 7f6096d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:02:37.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.130+0000 7f6096d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:37.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.130+0000 7f6096d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:02:37.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.131+0000 7f6096d2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:37.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.131+0000 7f6096d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:02:37.130 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.131+0000 7f6096d2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:02:37.130 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.131+0000 7f6096d2a800 20 searching for the correct realm 2024-09-14T11:02:37.132 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.133+0000 7f609321f640 0 -- 172.21.15.97:0/2617832187 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f608806b030 msgr2=0x7f6088009e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:02:37.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.338+0000 7f609221d640 0 -- 172.21.15.97:0/2617832187 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f60840696b0 msgr2=0x7f608408b970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:02:37.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.343+0000 7f6096d2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:02:37.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.343+0000 7f6096d2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:02:37.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.343+0000 7f6096d2a800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:02:37.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.343+0000 7f6096d2a800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:02:37.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.343+0000 7f6096d2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:02:37.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.343+0000 7f6096d2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:02:37.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.343+0000 7f6096d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:02:37.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.343+0000 7f6096d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:37.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.343+0000 7f6096d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:02:37.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.343+0000 7f6096d2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:37.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.343+0000 7f6096d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:02:37.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.344+0000 7f6096d2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:02:37.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.344+0000 7f6096d2a800 20 zone default found 2024-09-14T11:02:37.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.344+0000 7f6096d2a800 4 Realm: () 2024-09-14T11:02:37.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.344+0000 7f6096d2a800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:02:37.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.344+0000 7f6096d2a800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:02:37.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.344+0000 7f6096d2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:02:37.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.344+0000 7f6096d2a800 20 zonegroup default 2024-09-14T11:02:37.344 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.344+0000 7f6096d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:02:37.344 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.344+0000 7f6096d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:37.344 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.344+0000 7f6096d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:02:37.344 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.344+0000 7f6096d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:37.344 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.344+0000 7f6096d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:02:37.344 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.345+0000 7f6096d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:37.344 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.345+0000 7f6096d2a800 20 started sync module instance, tier type = 2024-09-14T11:02:37.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.345+0000 7f6096d2a800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:02:37.352 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.354+0000 7f6096d2a800 20 add_watcher() i=0 2024-09-14T11:02:37.352 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.354+0000 7f6096d2a800 20 add_watcher() i=1 2024-09-14T11:02:37.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.354+0000 7f6096d2a800 20 add_watcher() i=2 2024-09-14T11:02:37.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.354+0000 7f6096d2a800 20 add_watcher() i=3 2024-09-14T11:02:37.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.354+0000 7f6096d2a800 20 add_watcher() i=4 2024-09-14T11:02:37.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.354+0000 7f6096d2a800 20 add_watcher() i=5 2024-09-14T11:02:37.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.354+0000 7f6096d2a800 20 add_watcher() i=6 2024-09-14T11:02:37.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.355+0000 7f6096d2a800 20 add_watcher() i=7 2024-09-14T11:02:37.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.355+0000 7f6096d2a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:02:37.355 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.357+0000 7f5f497e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:02:37.356 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.357+0000 7f6096d2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:02:37.356 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.357+0000 7f6096d2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:02:37.356 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.357+0000 7f6096d2a800 5 note: GC not initialized 2024-09-14T11:02:37.356 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.357+0000 7f5ec3fff640 20 reqs_thread_entry: start 2024-09-14T11:02:37.357 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.358+0000 7f6096d2a800 20 init_complete bucket index max shards: 11 2024-09-14T11:02:37.357 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.358+0000 7f6096d2a800 20 Filter name: none 2024-09-14T11:02:37.357 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.358+0000 7f5ec1ffb640 20 reqs_thread_entry: start 2024-09-14T11:02:37.357 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.358+0000 7f6096d2a800 20 processing logshard = reshard.0000000000 2024-09-14T11:02:37.359 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.360+0000 7f6096d2a800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-14T11:02:37.359 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.360+0000 7f6096d2a800 20 processing logshard = reshard.0000000001 2024-09-14T11:02:37.361 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.363+0000 7f6096d2a800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-14T11:02:37.361 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.363+0000 7f6096d2a800 20 processing logshard = reshard.0000000002 2024-09-14T11:02:37.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.365+0000 7f6096d2a800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-14T11:02:37.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.365+0000 7f6096d2a800 20 processing logshard = reshard.0000000003 2024-09-14T11:02:37.366 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.368+0000 7f6096d2a800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-14T11:02:37.366 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.368+0000 7f6096d2a800 20 processing logshard = reshard.0000000004 2024-09-14T11:02:37.368 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.370+0000 7f6096d2a800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-14T11:02:37.368 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.370+0000 7f6096d2a800 20 processing logshard = reshard.0000000005 2024-09-14T11:02:37.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.372+0000 7f6096d2a800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-14T11:02:37.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.372+0000 7f6096d2a800 20 processing logshard = reshard.0000000006 2024-09-14T11:02:37.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.374+0000 7f6096d2a800 20 process_entry resharding a-bucket 2024-09-14T11:02:37.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.374+0000 7f6096d2a800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:02:37.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.374+0000 7f6096d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:02:37.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.374+0000 7f6096d2a800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:02:37.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.374+0000 7f6096d2a800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-14T11:02:37.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.374+0000 7f6096d2a800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:02:37.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.374+0000 7f6096d2a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 : miss 2024-09-14T11:02:37.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.374+0000 7f6096d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:02:37.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.375+0000 7f6096d2a800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:02:37.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.375+0000 7f6096d2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:02:37.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.375+0000 7f6096d2a800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:02:37.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.375+0000 7f6096d2a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:02:37.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.375+0000 7f6096d2a800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:02:37.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.375+0000 7f6096d2a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 2024-09-14T11:02:37.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.383+0000 7f6096d2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:02:37.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.383+0000 7f6096d2a800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:02:37.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.383+0000 7f6096d2a800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:02:37.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.383+0000 7f6096d2a800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17, ofs0, ns] 2024-09-14T11:02:37.382 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.383+0000 7f5f767fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595161 cookie 94668685389936 notifier 5795 bl.length()=827 2024-09-14T11:02:37.382 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.383+0000 7f5f767fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:02:37.382 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.383+0000 7f5f767fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:02:37.382 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.383+0000 7f5f767fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:02:37.382 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.383+0000 7f6096d2a800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): orig_sources= new_sources= 2024-09-14T11:02:37.382 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.383+0000 7f6096d2a800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): potential sources added=[] removed=[] 2024-09-14T11:02:37.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.383+0000 7f6096d2a800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): orig_dests= new_dests= 2024-09-14T11:02:37.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.383+0000 7f6096d2a800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): potential dests added=[] removed=[] 2024-09-14T11:02:37.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.388+0000 7f6096d2a800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.0 2024-09-14T11:02:37.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.388+0000 7f6096d2a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.0 2024-09-14T11:02:37.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.388+0000 7f6096d2a800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.1 2024-09-14T11:02:37.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.388+0000 7f6096d2a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.1 2024-09-14T11:02:37.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.388+0000 7f6096d2a800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.2 2024-09-14T11:02:37.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.388+0000 7f6096d2a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.2 2024-09-14T11:02:37.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.388+0000 7f6096d2a800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.3 2024-09-14T11:02:37.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.388+0000 7f6096d2a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.3 2024-09-14T11:02:37.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.388+0000 7f6096d2a800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.4 2024-09-14T11:02:37.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.388+0000 7f6096d2a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.4 2024-09-14T11:02:37.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.388+0000 7f6096d2a800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.5 2024-09-14T11:02:37.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.388+0000 7f6096d2a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.5 2024-09-14T11:02:37.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.388+0000 7f6096d2a800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.6 2024-09-14T11:02:37.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.388+0000 7f6096d2a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.6 2024-09-14T11:02:37.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.388+0000 7f6096d2a800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.7 2024-09-14T11:02:37.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.388+0000 7f6096d2a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.7 2024-09-14T11:02:37.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.388+0000 7f6096d2a800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.8 2024-09-14T11:02:37.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.388+0000 7f6096d2a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.8 2024-09-14T11:02:37.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.388+0000 7f6096d2a800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.9 2024-09-14T11:02:37.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.388+0000 7f6096d2a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.9 2024-09-14T11:02:37.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.388+0000 7f6096d2a800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.10 2024-09-14T11:02:37.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.388+0000 7f6096d2a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.10 2024-09-14T11:02:37.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.388+0000 7f6096d2a800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.11 2024-09-14T11:02:37.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.388+0000 7f6096d2a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.11 2024-09-14T11:02:37.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.388+0000 7f6096d2a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.0 2024-09-14T11:02:37.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.388+0000 7f6096d2a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1 2024-09-14T11:02:37.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.388+0000 7f6096d2a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2 2024-09-14T11:02:37.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.389+0000 7f6096d2a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3 2024-09-14T11:02:37.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.389+0000 7f6096d2a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.4 2024-09-14T11:02:37.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.390+0000 7f6096d2a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.5 2024-09-14T11:02:37.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.390+0000 7f6096d2a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.6 2024-09-14T11:02:37.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.391+0000 7f6096d2a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.7 2024-09-14T11:02:37.390 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.391+0000 7f6096d2a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.8 2024-09-14T11:02:37.390 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.392+0000 7f6096d2a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.9 2024-09-14T11:02:37.390 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.392+0000 7f6096d2a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.10 2024-09-14T11:02:37.392 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.393+0000 7f6096d2a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 : hit (requested=0x17, cached=0x17) 2024-09-14T11:02:37.392 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.393+0000 7f6096d2a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 2024-09-14T11:02:37.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.394+0000 7f6096d2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:02:37.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.394+0000 7f6096d2a800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:02:37.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.394+0000 7f6096d2a800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:02:37.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.394+0000 7f6096d2a800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17, ofs0, ns] 2024-09-14T11:02:37.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.395+0000 7f5f75ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595162 cookie 94668685389936 notifier 5795 bl.length()=827 2024-09-14T11:02:37.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.395+0000 7f5f75ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:02:37.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.395+0000 7f5f75ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:02:37.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.395+0000 7f5f75ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:02:37.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.395+0000 7f6096d2a800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): orig_sources= new_sources= 2024-09-14T11:02:37.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.395+0000 7f6096d2a800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): potential sources added=[] removed=[] 2024-09-14T11:02:37.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.395+0000 7f6096d2a800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): orig_dests= new_dests= 2024-09-14T11:02:37.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.395+0000 7f6096d2a800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): potential dests added=[] removed=[] 2024-09-14T11:02:37.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.397+0000 7f6096d2a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.0 2024-09-14T11:02:37.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.397+0000 7f6096d2a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1 2024-09-14T11:02:37.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.398+0000 7f6096d2a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2 2024-09-14T11:02:37.397 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.398+0000 7f6096d2a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3 2024-09-14T11:02:37.397 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.398+0000 7f6096d2a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.4 2024-09-14T11:02:37.397 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.398+0000 7f6096d2a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.5 2024-09-14T11:02:37.398 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.399+0000 7f6096d2a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.6 2024-09-14T11:02:37.398 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.399+0000 7f6096d2a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.7 2024-09-14T11:02:37.398 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.399+0000 7f6096d2a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.8 2024-09-14T11:02:37.398 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.400+0000 7f6096d2a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.9 2024-09-14T11:02:37.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.400+0000 7f6096d2a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.10 2024-09-14T11:02:37.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.400+0000 7f6096d2a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 : hit (requested=0x17, cached=0x17) 2024-09-14T11:02:37.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.401+0000 7f6096d2a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 2024-09-14T11:02:37.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.402+0000 7f6096d2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:02:37.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.402+0000 7f6096d2a800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:02:37.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.402+0000 7f6096d2a800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:02:37.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.402+0000 7f6096d2a800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17, ofs0, ns] 2024-09-14T11:02:37.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.402+0000 7f5f75ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595163 cookie 94668685389936 notifier 5795 bl.length()=795 2024-09-14T11:02:37.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.402+0000 7f5f75ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:02:37.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.402+0000 7f5f75ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:02:37.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.402+0000 7f5f75ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:02:37.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.402+0000 7f6096d2a800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): orig_sources= new_sources= 2024-09-14T11:02:37.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.402+0000 7f6096d2a800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): potential sources added=[] removed=[] 2024-09-14T11:02:37.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.402+0000 7f6096d2a800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): orig_dests= new_dests= 2024-09-14T11:02:37.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.402+0000 7f6096d2a800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): potential dests added=[] removed=[] 2024-09-14T11:02:37.403 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.405+0000 7f6096d2a800 1 execute INFO: reshard of bucket "a-bucket" from 11 shards to 12 shards completed successfully 2024-09-14T11:02:37.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.405+0000 7f6096d2a800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-14T11:02:37.406 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.407+0000 7f6096d2a800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-14T11:02:37.406 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.407+0000 7f6096d2a800 20 processing logshard = reshard.0000000007 2024-09-14T11:02:37.409 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.409+0000 7f6096d2a800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-14T11:02:37.409 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.409+0000 7f6096d2a800 20 processing logshard = reshard.0000000008 2024-09-14T11:02:37.410 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.412+0000 7f6096d2a800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-14T11:02:37.410 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.412+0000 7f6096d2a800 20 processing logshard = reshard.0000000009 2024-09-14T11:02:37.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.414+0000 7f6096d2a800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-14T11:02:37.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.414+0000 7f6096d2a800 20 processing logshard = reshard.0000000010 2024-09-14T11:02:37.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.417+0000 7f6096d2a800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-14T11:02:37.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.417+0000 7f6096d2a800 20 processing logshard = reshard.0000000011 2024-09-14T11:02:37.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.419+0000 7f6096d2a800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-14T11:02:37.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.419+0000 7f6096d2a800 20 processing logshard = reshard.0000000012 2024-09-14T11:02:37.419 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.421+0000 7f6096d2a800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-14T11:02:37.419 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.421+0000 7f6096d2a800 20 processing logshard = reshard.0000000013 2024-09-14T11:02:37.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.423+0000 7f6096d2a800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-14T11:02:37.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.423+0000 7f6096d2a800 20 processing logshard = reshard.0000000014 2024-09-14T11:02:37.424 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.426+0000 7f6096d2a800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-14T11:02:37.424 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.426+0000 7f6096d2a800 20 processing logshard = reshard.0000000015 2024-09-14T11:02:37.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.428+0000 7f6096d2a800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-14T11:02:37.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.429+0000 7f5f497e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:02:37.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.431+0000 7f6096d2a800 20 remove_watcher() i=0 2024-09-14T11:02:37.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.431+0000 7f6096d2a800 2 removed watcher, disabling cache 2024-09-14T11:02:37.431 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.432+0000 7f6096d2a800 20 remove_watcher() i=1 2024-09-14T11:02:37.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.434+0000 7f6096d2a800 20 remove_watcher() i=2 2024-09-14T11:02:37.433 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.435+0000 7f6096d2a800 20 remove_watcher() i=3 2024-09-14T11:02:37.434 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.435+0000 7f6096d2a800 20 remove_watcher() i=4 2024-09-14T11:02:37.435 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.437+0000 7f6096d2a800 20 remove_watcher() i=5 2024-09-14T11:02:37.436 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.438+0000 7f6096d2a800 20 remove_watcher() i=6 2024-09-14T11:02:37.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:37.439+0000 7f6096d2a800 20 remove_watcher() i=7 2024-09-14T11:02:42.455 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:02:42.488 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:02:42.488 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:02:42.531 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.532+0000 7f2191b36800 20 rados->read ofs=0 len=0 2024-09-14T11:02:42.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.534+0000 7f2191b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:42.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.534+0000 7f2191b36800 20 realm 2024-09-14T11:02:42.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.534+0000 7f2191b36800 20 rados->read ofs=0 len=0 2024-09-14T11:02:42.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.535+0000 7f2191b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:42.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.535+0000 7f2191b36800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:02:42.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.535+0000 7f2191b36800 20 rados->read ofs=0 len=0 2024-09-14T11:02:42.534 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.535+0000 7f2191b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:42.534 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.535+0000 7f2191b36800 20 rados->read ofs=0 len=0 2024-09-14T11:02:42.534 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.536+0000 7f2191b36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:42.534 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.536+0000 7f2191b36800 20 rados->read ofs=0 len=0 2024-09-14T11:02:42.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.537+0000 7f2191b36800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:02:42.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.537+0000 7f2191b36800 20 searching for the correct realm 2024-09-14T11:02:42.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.539+0000 7f21850b6640 0 -- 172.21.15.97:0/3803334254 >> [v2:172.21.15.97:6816/4093696477,v1:172.21.15.97:6817/4093696477] conn(0x558b3cdaf550 msgr2=0x558b3cdb1940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:02:42.541 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.542+0000 7f21850b6640 0 -- 172.21.15.97:0/3803334254 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f218007a630 msgr2=0x7f21800813b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:02:42.748 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.749+0000 7f2191b36800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:02:42.748 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.749+0000 7f2191b36800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:02:42.748 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.749+0000 7f2191b36800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:02:42.748 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.749+0000 7f2191b36800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:02:42.748 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.749+0000 7f2191b36800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:02:42.748 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.749+0000 7f2191b36800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:02:42.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.749+0000 7f2191b36800 20 rados->read ofs=0 len=0 2024-09-14T11:02:42.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.750+0000 7f2191b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:42.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.750+0000 7f2191b36800 20 rados->read ofs=0 len=0 2024-09-14T11:02:42.750 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.750+0000 7f2191b36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:42.750 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.750+0000 7f2191b36800 20 rados->read ofs=0 len=0 2024-09-14T11:02:42.750 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.750+0000 7f2191b36800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:02:42.750 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.750+0000 7f2191b36800 20 zone default found 2024-09-14T11:02:42.750 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.750+0000 7f2191b36800 4 Realm: () 2024-09-14T11:02:42.750 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.750+0000 7f2191b36800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:02:42.750 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.750+0000 7f2191b36800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:02:42.750 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.750+0000 7f2191b36800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:02:42.750 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.750+0000 7f2191b36800 20 zonegroup default 2024-09-14T11:02:42.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.750+0000 7f2191b36800 20 rados->read ofs=0 len=0 2024-09-14T11:02:42.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.751+0000 7f2191b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:42.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.751+0000 7f2191b36800 20 rados->read ofs=0 len=0 2024-09-14T11:02:42.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.751+0000 7f2191b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:42.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.751+0000 7f2191b36800 20 rados->read ofs=0 len=0 2024-09-14T11:02:42.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.752+0000 7f2191b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:42.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.752+0000 7f2191b36800 20 started sync module instance, tier type = 2024-09-14T11:02:42.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.752+0000 7f2191b36800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:02:42.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.762+0000 7f2191b36800 20 add_watcher() i=0 2024-09-14T11:02:42.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.762+0000 7f2191b36800 20 add_watcher() i=1 2024-09-14T11:02:42.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.762+0000 7f2191b36800 20 add_watcher() i=2 2024-09-14T11:02:42.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.762+0000 7f2191b36800 20 add_watcher() i=3 2024-09-14T11:02:42.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.762+0000 7f2191b36800 20 add_watcher() i=4 2024-09-14T11:02:42.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.762+0000 7f2191b36800 20 add_watcher() i=5 2024-09-14T11:02:42.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.762+0000 7f2191b36800 20 add_watcher() i=6 2024-09-14T11:02:42.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.764+0000 7f2191b36800 20 add_watcher() i=7 2024-09-14T11:02:42.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.764+0000 7f2191b36800 2 all 8 watchers are set, enabling cache 2024-09-14T11:02:42.764 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.766+0000 7f203f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:02:42.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.766+0000 7f2191b36800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:02:42.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.766+0000 7f2191b36800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:02:42.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.766+0000 7f2191b36800 5 note: GC not initialized 2024-09-14T11:02:42.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.766+0000 7f203e7fc640 20 reqs_thread_entry: start 2024-09-14T11:02:42.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.766+0000 7f2191b36800 20 init_complete bucket index max shards: 11 2024-09-14T11:02:42.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.766+0000 7f2191b36800 20 Filter name: none 2024-09-14T11:02:42.766 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.767+0000 7f1faffff640 20 reqs_thread_entry: start 2024-09-14T11:02:42.766 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.767+0000 7f2191b36800 20 rados->read ofs=0 len=0 2024-09-14T11:02:42.766 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.767+0000 7f2191b36800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:02:42.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.767+0000 7f2191b36800 20 rados->read ofs=0 len=0 2024-09-14T11:02:42.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.768+0000 7f2191b36800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:02:42.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.768+0000 7f2191b36800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:02:42.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.768+0000 7f2191b36800 20 rados->read ofs=0 len=0 2024-09-14T11:02:42.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.768+0000 7f2191b36800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:02:42.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.768+0000 7f2191b36800 20 rados->read ofs=0 len=0 2024-09-14T11:02:42.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.769+0000 7f2191b36800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:02:42.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.769+0000 7f2191b36800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:02:42.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.771+0000 7f203f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:02:42.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.773+0000 7f2191b36800 20 remove_watcher() i=0 2024-09-14T11:02:42.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.773+0000 7f2191b36800 2 removed watcher, disabling cache 2024-09-14T11:02:42.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.774+0000 7f2191b36800 20 remove_watcher() i=1 2024-09-14T11:02:42.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.775+0000 7f2191b36800 20 remove_watcher() i=2 2024-09-14T11:02:42.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.776+0000 7f2191b36800 20 remove_watcher() i=3 2024-09-14T11:02:42.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.777+0000 7f2191b36800 20 remove_watcher() i=4 2024-09-14T11:02:42.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.778+0000 7f2191b36800 20 remove_watcher() i=5 2024-09-14T11:02:42.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.779+0000 7f2191b36800 20 remove_watcher() i=6 2024-09-14T11:02:42.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.781+0000 7f2191b36800 20 remove_watcher() i=7 2024-09-14T11:02:42.791 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:42.791 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:02:42.791 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: a-bucket id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-14T11:02:42.791 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:42.791 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: reshard add non empty bucket 2024-09-14T11:02:42.791 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:42.878 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:02:42.906 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:02:42.906 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:02:42.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.945+0000 7fa020a98800 20 rados->read ofs=0 len=0 2024-09-14T11:02:42.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.946+0000 7fa020a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:42.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.946+0000 7fa020a98800 20 realm 2024-09-14T11:02:42.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.946+0000 7fa020a98800 20 rados->read ofs=0 len=0 2024-09-14T11:02:42.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.947+0000 7fa020a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:42.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.947+0000 7fa020a98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:02:42.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.947+0000 7fa020a98800 20 rados->read ofs=0 len=0 2024-09-14T11:02:42.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.947+0000 7fa020a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:42.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.947+0000 7fa020a98800 20 rados->read ofs=0 len=0 2024-09-14T11:02:42.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.947+0000 7fa020a98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:42.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.947+0000 7fa020a98800 20 rados->read ofs=0 len=0 2024-09-14T11:02:42.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.948+0000 7fa020a98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:02:42.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.948+0000 7fa020a98800 20 searching for the correct realm 2024-09-14T11:02:42.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:42.950+0000 7fa01ed83640 0 -- 172.21.15.97:0/1004139351 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7fa0080b1030 msgr2=0x7fa0080b1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:02:43.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.155+0000 7fa015d81640 0 -- 172.21.15.97:0/1004139351 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7fa0100173e0 msgr2=0x7fa010017860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:02:43.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.160+0000 7fa020a98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:02:43.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.160+0000 7fa020a98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:02:43.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.160+0000 7fa020a98800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:02:43.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.160+0000 7fa020a98800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:02:43.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.160+0000 7fa020a98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:02:43.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.160+0000 7fa020a98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:02:43.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.160+0000 7fa020a98800 20 rados->read ofs=0 len=0 2024-09-14T11:02:43.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.160+0000 7fa020a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:43.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.160+0000 7fa020a98800 20 rados->read ofs=0 len=0 2024-09-14T11:02:43.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.161+0000 7fa020a98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:43.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.161+0000 7fa020a98800 20 rados->read ofs=0 len=0 2024-09-14T11:02:43.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.161+0000 7fa020a98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:02:43.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.161+0000 7fa020a98800 20 zone default found 2024-09-14T11:02:43.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.161+0000 7fa020a98800 4 Realm: () 2024-09-14T11:02:43.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.161+0000 7fa020a98800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:02:43.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.161+0000 7fa020a98800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:02:43.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.161+0000 7fa020a98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:02:43.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.161+0000 7fa020a98800 20 zonegroup default 2024-09-14T11:02:43.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.161+0000 7fa020a98800 20 rados->read ofs=0 len=0 2024-09-14T11:02:43.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.162+0000 7fa020a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:43.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.162+0000 7fa020a98800 20 rados->read ofs=0 len=0 2024-09-14T11:02:43.162 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.162+0000 7fa020a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:43.162 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.162+0000 7fa020a98800 20 rados->read ofs=0 len=0 2024-09-14T11:02:43.162 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.162+0000 7fa020a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:43.162 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.162+0000 7fa020a98800 20 started sync module instance, tier type = 2024-09-14T11:02:43.162 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.162+0000 7fa020a98800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:02:43.175 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.177+0000 7fa020a98800 20 add_watcher() i=0 2024-09-14T11:02:43.175 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.177+0000 7fa020a98800 20 add_watcher() i=1 2024-09-14T11:02:43.175 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.177+0000 7fa020a98800 20 add_watcher() i=2 2024-09-14T11:02:43.175 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.177+0000 7fa020a98800 20 add_watcher() i=3 2024-09-14T11:02:43.175 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.177+0000 7fa020a98800 20 add_watcher() i=4 2024-09-14T11:02:43.175 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.177+0000 7fa020a98800 20 add_watcher() i=5 2024-09-14T11:02:43.176 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.177+0000 7fa020a98800 20 add_watcher() i=6 2024-09-14T11:02:43.176 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.178+0000 7fa020a98800 20 add_watcher() i=7 2024-09-14T11:02:43.176 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.178+0000 7fa020a98800 2 all 8 watchers are set, enabling cache 2024-09-14T11:02:43.178 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.180+0000 7f9ed4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:02:43.179 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.180+0000 7fa020a98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:02:43.179 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.180+0000 7fa020a98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:02:43.179 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.180+0000 7fa020a98800 5 note: GC not initialized 2024-09-14T11:02:43.179 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.180+0000 7f9e4f7fe640 20 reqs_thread_entry: start 2024-09-14T11:02:43.179 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.180+0000 7fa020a98800 20 init_complete bucket index max shards: 11 2024-09-14T11:02:43.179 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.180+0000 7fa020a98800 20 Filter name: none 2024-09-14T11:02:43.179 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.180+0000 7f9e4d7fa640 20 reqs_thread_entry: start 2024-09-14T11:02:43.179 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.180+0000 7fa020a98800 20 rados->read ofs=0 len=0 2024-09-14T11:02:43.180 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.181+0000 7fa020a98800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:02:43.180 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.181+0000 7fa020a98800 20 rados->read ofs=0 len=0 2024-09-14T11:02:43.180 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.181+0000 7fa020a98800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:02:43.181 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.181+0000 7fa020a98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:02:43.181 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.181+0000 7fa020a98800 20 rados->read ofs=0 len=0 2024-09-14T11:02:43.181 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.181+0000 7fa020a98800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:02:43.181 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.181+0000 7fa020a98800 20 rados->read ofs=0 len=0 2024-09-14T11:02:43.181 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.182+0000 7fa020a98800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:02:43.181 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.182+0000 7fa020a98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:02:43.182 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.183+0000 7f9ed4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:02:43.184 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.186+0000 7fa020a98800 20 remove_watcher() i=0 2024-09-14T11:02:43.184 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.186+0000 7fa020a98800 2 removed watcher, disabling cache 2024-09-14T11:02:43.185 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.187+0000 7fa020a98800 20 remove_watcher() i=1 2024-09-14T11:02:43.186 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.188+0000 7fa020a98800 20 remove_watcher() i=2 2024-09-14T11:02:43.187 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.189+0000 7fa020a98800 20 remove_watcher() i=3 2024-09-14T11:02:43.189 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.190+0000 7fa020a98800 20 remove_watcher() i=4 2024-09-14T11:02:43.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.192+0000 7fa020a98800 20 remove_watcher() i=5 2024-09-14T11:02:43.191 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.193+0000 7fa020a98800 20 remove_watcher() i=6 2024-09-14T11:02:43.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.194+0000 7fa020a98800 20 remove_watcher() i=7 2024-09-14T11:02:43.203 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:43.203 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:02:43.203 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: a-bucket id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 num_objects: 8 size_kb: 1 num_shards: 12 2024-09-14T11:02:43.204 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:43.204 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 13 2024-09-14T11:02:43.235 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:02:43.235 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:02:43.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.274+0000 7f90ca21d800 20 rados->read ofs=0 len=0 2024-09-14T11:02:43.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.276+0000 7f90ca21d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:43.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.276+0000 7f90ca21d800 20 realm 2024-09-14T11:02:43.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.276+0000 7f90ca21d800 20 rados->read ofs=0 len=0 2024-09-14T11:02:43.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.276+0000 7f90ca21d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:43.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.276+0000 7f90ca21d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:02:43.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.276+0000 7f90ca21d800 20 rados->read ofs=0 len=0 2024-09-14T11:02:43.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.276+0000 7f90ca21d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:43.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.276+0000 7f90ca21d800 20 rados->read ofs=0 len=0 2024-09-14T11:02:43.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.277+0000 7f90ca21d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:43.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.277+0000 7f90ca21d800 20 rados->read ofs=0 len=0 2024-09-14T11:02:43.277 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.278+0000 7f90ca21d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:02:43.277 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.278+0000 7f90ca21d800 20 searching for the correct realm 2024-09-14T11:02:43.278 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.280+0000 7f90c61ec640 0 -- 172.21.15.97:0/3568471970 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f90b0047040 msgr2=0x7f90b0047420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:02:43.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.486+0000 7f90bd1ea640 0 -- 172.21.15.97:0/3568471970 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f90b80ae700 msgr2=0x7f90b80add60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:02:43.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.491+0000 7f90ca21d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:02:43.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.491+0000 7f90ca21d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:02:43.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.491+0000 7f90ca21d800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:02:43.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.491+0000 7f90ca21d800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:02:43.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.491+0000 7f90ca21d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:02:43.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.491+0000 7f90ca21d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:02:43.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.491+0000 7f90ca21d800 20 rados->read ofs=0 len=0 2024-09-14T11:02:43.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.492+0000 7f90ca21d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:43.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.492+0000 7f90ca21d800 20 rados->read ofs=0 len=0 2024-09-14T11:02:43.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.492+0000 7f90ca21d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:43.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.492+0000 7f90ca21d800 20 rados->read ofs=0 len=0 2024-09-14T11:02:43.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.493+0000 7f90ca21d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:02:43.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.493+0000 7f90ca21d800 20 zone default found 2024-09-14T11:02:43.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.493+0000 7f90ca21d800 4 Realm: () 2024-09-14T11:02:43.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.493+0000 7f90ca21d800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:02:43.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.493+0000 7f90ca21d800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:02:43.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.493+0000 7f90ca21d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:02:43.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.493+0000 7f90ca21d800 20 zonegroup default 2024-09-14T11:02:43.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.493+0000 7f90ca21d800 20 rados->read ofs=0 len=0 2024-09-14T11:02:43.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.493+0000 7f90ca21d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:43.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.493+0000 7f90ca21d800 20 rados->read ofs=0 len=0 2024-09-14T11:02:43.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.494+0000 7f90ca21d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:43.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.494+0000 7f90ca21d800 20 rados->read ofs=0 len=0 2024-09-14T11:02:43.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.494+0000 7f90ca21d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:43.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.494+0000 7f90ca21d800 20 started sync module instance, tier type = 2024-09-14T11:02:43.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.494+0000 7f90ca21d800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:02:43.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.504+0000 7f90ca21d800 20 add_watcher() i=0 2024-09-14T11:02:43.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.504+0000 7f90ca21d800 20 add_watcher() i=1 2024-09-14T11:02:43.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.504+0000 7f90ca21d800 20 add_watcher() i=2 2024-09-14T11:02:43.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.504+0000 7f90ca21d800 20 add_watcher() i=3 2024-09-14T11:02:43.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.504+0000 7f90ca21d800 20 add_watcher() i=4 2024-09-14T11:02:43.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.504+0000 7f90ca21d800 20 add_watcher() i=5 2024-09-14T11:02:43.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.504+0000 7f90ca21d800 20 add_watcher() i=6 2024-09-14T11:02:43.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.505+0000 7f90ca21d800 20 add_watcher() i=7 2024-09-14T11:02:43.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.505+0000 7f90ca21d800 2 all 8 watchers are set, enabling cache 2024-09-14T11:02:43.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.506+0000 7f8f777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:02:43.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.507+0000 7f90ca21d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:02:43.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.507+0000 7f90ca21d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:02:43.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.507+0000 7f90ca21d800 5 note: GC not initialized 2024-09-14T11:02:43.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.507+0000 7f8f767fc640 20 reqs_thread_entry: start 2024-09-14T11:02:43.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.507+0000 7f90ca21d800 20 init_complete bucket index max shards: 11 2024-09-14T11:02:43.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.507+0000 7f90ca21d800 20 Filter name: none 2024-09-14T11:02:43.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.507+0000 7f8ee7fff640 20 reqs_thread_entry: start 2024-09-14T11:02:43.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.508+0000 7f90ca21d800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:02:43.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.508+0000 7f90ca21d800 20 rados->read ofs=0 len=0 2024-09-14T11:02:43.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.508+0000 7f90ca21d800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:02:43.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.508+0000 7f90ca21d800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:02:43.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.508+0000 7f90ca21d800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:02:43.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.508+0000 7f90ca21d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 : miss 2024-09-14T11:02:43.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.508+0000 7f90ca21d800 20 rados->read ofs=0 len=0 2024-09-14T11:02:43.508 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.509+0000 7f90ca21d800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:02:43.508 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.509+0000 7f90ca21d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:02:43.508 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.509+0000 7f90ca21d800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:02:43.508 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.509+0000 7f90ca21d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:02:43.508 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.509+0000 7f90ca21d800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:02:43.508 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.509+0000 7f90ca21d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 2024-09-14T11:02:43.509 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.510+0000 7f8f777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:02:43.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.513+0000 7f90ca21d800 20 remove_watcher() i=0 2024-09-14T11:02:43.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.513+0000 7f90ca21d800 2 removed watcher, disabling cache 2024-09-14T11:02:43.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.514+0000 7f90ca21d800 20 remove_watcher() i=1 2024-09-14T11:02:43.513 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.515+0000 7f90ca21d800 20 remove_watcher() i=2 2024-09-14T11:02:43.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.516+0000 7f90ca21d800 20 remove_watcher() i=3 2024-09-14T11:02:43.515 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.517+0000 7f90ca21d800 20 remove_watcher() i=4 2024-09-14T11:02:43.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.518+0000 7f90ca21d800 20 remove_watcher() i=5 2024-09-14T11:02:43.518 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.519+0000 7f90ca21d800 20 remove_watcher() i=6 2024-09-14T11:02:43.519 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.520+0000 7f90ca21d800 20 remove_watcher() i=7 2024-09-14T11:02:43.531 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin reshard list 2024-09-14T11:02:43.557 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:02:43.557 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:02:43.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.595+0000 7f275b82f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:43.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.598+0000 7f275b82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:43.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.598+0000 7f275b82f800 20 realm 2024-09-14T11:02:43.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.598+0000 7f275b82f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:43.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.598+0000 7f275b82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:43.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.598+0000 7f275b82f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:02:43.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.598+0000 7f275b82f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:43.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.598+0000 7f275b82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:43.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.598+0000 7f275b82f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:43.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.599+0000 7f275b82f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:43.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.599+0000 7f275b82f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:43.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.600+0000 7f275b82f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:02:43.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.600+0000 7f275b82f800 20 searching for the correct realm 2024-09-14T11:02:43.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.602+0000 7f2759b1a640 0 -- 172.21.15.97:0/1050318992 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f2744018070 msgr2=0x7f2744092190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:02:43.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.807+0000 7f2750b18640 0 -- 172.21.15.97:0/1050318992 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f274c085400 msgr2=0x7f274c085860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:02:43.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.813+0000 7f275b82f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:02:43.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.813+0000 7f275b82f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:02:43.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.813+0000 7f275b82f800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:02:43.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.813+0000 7f275b82f800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:02:43.812 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.813+0000 7f275b82f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:02:43.812 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.813+0000 7f275b82f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:02:43.812 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.813+0000 7f275b82f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:43.812 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.813+0000 7f275b82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:43.812 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.813+0000 7f275b82f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:43.816 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.813+0000 7f275b82f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:43.817 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.813+0000 7f275b82f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:43.817 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.814+0000 7f275b82f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:02:43.817 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.814+0000 7f275b82f800 20 zone default found 2024-09-14T11:02:43.817 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.814+0000 7f275b82f800 4 Realm: () 2024-09-14T11:02:43.817 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.814+0000 7f275b82f800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:02:43.817 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.814+0000 7f275b82f800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:02:43.817 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.814+0000 7f275b82f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:02:43.817 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.814+0000 7f275b82f800 20 zonegroup default 2024-09-14T11:02:43.817 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.814+0000 7f275b82f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:43.817 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.814+0000 7f275b82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:43.817 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.814+0000 7f275b82f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:43.817 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.814+0000 7f275b82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:43.817 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.814+0000 7f275b82f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:43.818 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.815+0000 7f275b82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:43.818 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.815+0000 7f275b82f800 20 started sync module instance, tier type = 2024-09-14T11:02:43.818 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.815+0000 7f275b82f800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:02:43.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.825+0000 7f275b82f800 20 add_watcher() i=0 2024-09-14T11:02:43.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.825+0000 7f275b82f800 20 add_watcher() i=1 2024-09-14T11:02:43.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.825+0000 7f275b82f800 20 add_watcher() i=2 2024-09-14T11:02:43.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.825+0000 7f275b82f800 20 add_watcher() i=3 2024-09-14T11:02:43.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.825+0000 7f275b82f800 20 add_watcher() i=4 2024-09-14T11:02:43.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.825+0000 7f275b82f800 20 add_watcher() i=5 2024-09-14T11:02:43.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.825+0000 7f275b82f800 20 add_watcher() i=6 2024-09-14T11:02:43.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.826+0000 7f275b82f800 20 add_watcher() i=7 2024-09-14T11:02:43.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.826+0000 7f275b82f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:02:43.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.828+0000 7f260ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:02:43.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.828+0000 7f275b82f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:02:43.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.828+0000 7f275b82f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:02:43.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.828+0000 7f275b82f800 5 note: GC not initialized 2024-09-14T11:02:43.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.828+0000 7f260efe5640 20 reqs_thread_entry: start 2024-09-14T11:02:43.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.829+0000 7f275b82f800 20 init_complete bucket index max shards: 11 2024-09-14T11:02:43.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.829+0000 7f275b82f800 20 Filter name: none 2024-09-14T11:02:43.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.829+0000 7f260cfe1640 20 reqs_thread_entry: start 2024-09-14T11:02:43.833 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.834+0000 7f260ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:02:43.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.837+0000 7f275b82f800 20 remove_watcher() i=0 2024-09-14T11:02:43.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.837+0000 7f275b82f800 2 removed watcher, disabling cache 2024-09-14T11:02:43.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.838+0000 7f275b82f800 20 remove_watcher() i=1 2024-09-14T11:02:43.837 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.839+0000 7f275b82f800 20 remove_watcher() i=2 2024-09-14T11:02:43.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.840+0000 7f275b82f800 20 remove_watcher() i=3 2024-09-14T11:02:43.840 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.841+0000 7f275b82f800 20 remove_watcher() i=4 2024-09-14T11:02:43.841 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.842+0000 7f275b82f800 20 remove_watcher() i=5 2024-09-14T11:02:43.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.844+0000 7f275b82f800 20 remove_watcher() i=6 2024-09-14T11:02:43.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.845+0000 7f275b82f800 20 remove_watcher() i=7 2024-09-14T11:02:43.854 INFO:tasks.workunit.client.0.smithi097.stderr:bucket name a-bucket 2024-09-14T11:02:43.854 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: reshard process non empty bucket 2024-09-14T11:02:43.854 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:43.855 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin reshard process 2024-09-14T11:02:43.883 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:02:43.883 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:02:43.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.923+0000 7fde9b82f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:43.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.925+0000 7fde9b82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:43.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.925+0000 7fde9b82f800 20 realm 2024-09-14T11:02:43.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.925+0000 7fde9b82f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:43.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.925+0000 7fde9b82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:43.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.925+0000 7fde9b82f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:02:43.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.925+0000 7fde9b82f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:43.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.925+0000 7fde9b82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:43.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.925+0000 7fde9b82f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:43.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.926+0000 7fde9b82f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:43.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.926+0000 7fde9b82f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:43.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.927+0000 7fde9b82f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:02:43.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.927+0000 7fde9b82f800 20 searching for the correct realm 2024-09-14T11:02:43.928 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.930+0000 7fde99319640 0 -- 172.21.15.97:0/2950157952 >> [v2:172.21.15.152:6808/1010851305,v1:172.21.15.152:6809/1010851305] conn(0x5625ec1dea90 msgr2=0x5625ec1e0f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:02:43.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.933+0000 7fde99319640 0 -- 172.21.15.97:0/2950157952 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x5625ec1d2230 msgr2=0x5625ec1d46f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:02:43.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.937+0000 7fde9b82f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:02:43.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.937+0000 7fde9b82f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:02:43.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.937+0000 7fde9b82f800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:02:43.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.937+0000 7fde9b82f800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:02:43.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.937+0000 7fde9b82f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:02:43.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.937+0000 7fde9b82f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:02:43.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.937+0000 7fde9b82f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:43.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.937+0000 7fde9b82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:43.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.937+0000 7fde9b82f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:43.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.937+0000 7fde9b82f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:43.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.937+0000 7fde9b82f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:43.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.938+0000 7fde9b82f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:02:43.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.938+0000 7fde9b82f800 20 zone default found 2024-09-14T11:02:43.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.938+0000 7fde9b82f800 4 Realm: () 2024-09-14T11:02:43.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.938+0000 7fde9b82f800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:02:43.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.938+0000 7fde9b82f800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:02:43.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.938+0000 7fde9b82f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:02:43.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.938+0000 7fde9b82f800 20 zonegroup default 2024-09-14T11:02:43.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.938+0000 7fde9b82f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:43.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.938+0000 7fde9b82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:43.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.938+0000 7fde9b82f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:43.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.938+0000 7fde9b82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:43.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.938+0000 7fde9b82f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:43.939 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.939+0000 7fde9b82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:43.939 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.939+0000 7fde9b82f800 20 started sync module instance, tier type = 2024-09-14T11:02:43.939 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.939+0000 7fde9b82f800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:02:43.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.948+0000 7fde9b82f800 20 add_watcher() i=0 2024-09-14T11:02:43.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.948+0000 7fde9b82f800 20 add_watcher() i=1 2024-09-14T11:02:43.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.948+0000 7fde9b82f800 20 add_watcher() i=2 2024-09-14T11:02:43.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.948+0000 7fde9b82f800 20 add_watcher() i=3 2024-09-14T11:02:43.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.948+0000 7fde9b82f800 20 add_watcher() i=4 2024-09-14T11:02:43.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.948+0000 7fde9b82f800 20 add_watcher() i=5 2024-09-14T11:02:43.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.948+0000 7fde9b82f800 20 add_watcher() i=6 2024-09-14T11:02:43.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.949+0000 7fde9b82f800 20 add_watcher() i=7 2024-09-14T11:02:43.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.949+0000 7fde9b82f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:02:43.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.951+0000 7fdd4ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:02:43.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.951+0000 7fde9b82f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:02:43.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.951+0000 7fde9b82f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:02:43.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.951+0000 7fde9b82f800 5 note: GC not initialized 2024-09-14T11:02:43.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.951+0000 7fdd4efe5640 20 reqs_thread_entry: start 2024-09-14T11:02:43.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.951+0000 7fde9b82f800 20 init_complete bucket index max shards: 11 2024-09-14T11:02:43.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.951+0000 7fde9b82f800 20 Filter name: none 2024-09-14T11:02:43.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.952+0000 7fdd4cfe1640 20 reqs_thread_entry: start 2024-09-14T11:02:43.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.952+0000 7fde9b82f800 20 processing logshard = reshard.0000000000 2024-09-14T11:02:43.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.954+0000 7fde9b82f800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-14T11:02:43.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.954+0000 7fde9b82f800 20 processing logshard = reshard.0000000001 2024-09-14T11:02:43.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.957+0000 7fde9b82f800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-14T11:02:43.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.957+0000 7fde9b82f800 20 processing logshard = reshard.0000000002 2024-09-14T11:02:43.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.960+0000 7fde9b82f800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-14T11:02:43.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.960+0000 7fde9b82f800 20 processing logshard = reshard.0000000003 2024-09-14T11:02:43.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.962+0000 7fde9b82f800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-14T11:02:43.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.962+0000 7fde9b82f800 20 processing logshard = reshard.0000000004 2024-09-14T11:02:43.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.965+0000 7fde9b82f800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-14T11:02:43.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.965+0000 7fde9b82f800 20 processing logshard = reshard.0000000005 2024-09-14T11:02:43.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.967+0000 7fde9b82f800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-14T11:02:43.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.967+0000 7fde9b82f800 20 processing logshard = reshard.0000000006 2024-09-14T11:02:43.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.968+0000 7fde9b82f800 20 process_entry resharding a-bucket 2024-09-14T11:02:43.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.968+0000 7fde9b82f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:02:43.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.968+0000 7fde9b82f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:43.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.969+0000 7fde9b82f800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:02:43.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.969+0000 7fde9b82f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-14T11:02:43.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.969+0000 7fde9b82f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:02:43.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.969+0000 7fde9b82f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 : miss 2024-09-14T11:02:43.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.969+0000 7fde9b82f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:43.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.969+0000 7fde9b82f800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:02:43.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.969+0000 7fde9b82f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:02:43.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.969+0000 7fde9b82f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:02:43.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.969+0000 7fde9b82f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:02:43.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.969+0000 7fde9b82f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:02:43.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.969+0000 7fde9b82f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 2024-09-14T11:02:43.979 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.981+0000 7fde9b82f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:02:43.979 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.981+0000 7fde9b82f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:02:43.979 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.981+0000 7fde9b82f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:02:43.980 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.981+0000 7fde9b82f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17, ofs0, ns] 2024-09-14T11:02:43.980 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.981+0000 7fdd6bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595164 cookie 94720875174832 notifier 6183 bl.length()=827 2024-09-14T11:02:43.980 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.981+0000 7fdd6bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:02:43.980 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.981+0000 7fdd6bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:02:43.980 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.981+0000 7fdd6bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:02:43.980 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.981+0000 7fde9b82f800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): orig_sources= new_sources= 2024-09-14T11:02:43.980 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.981+0000 7fde9b82f800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): potential sources added=[] removed=[] 2024-09-14T11:02:43.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.981+0000 7fde9b82f800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): orig_dests= new_dests= 2024-09-14T11:02:43.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.981+0000 7fde9b82f800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): potential dests added=[] removed=[] 2024-09-14T11:02:43.986 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.986+0000 7fde9b82f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.0 2024-09-14T11:02:43.986 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.986+0000 7fde9b82f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.0 2024-09-14T11:02:43.986 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.986+0000 7fde9b82f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.1 2024-09-14T11:02:43.986 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.986+0000 7fde9b82f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.1 2024-09-14T11:02:43.986 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.986+0000 7fde9b82f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.2 2024-09-14T11:02:43.986 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.986+0000 7fde9b82f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.2 2024-09-14T11:02:43.986 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.986+0000 7fde9b82f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.3 2024-09-14T11:02:43.986 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.986+0000 7fde9b82f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.3 2024-09-14T11:02:43.987 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.986+0000 7fde9b82f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.4 2024-09-14T11:02:43.987 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.986+0000 7fde9b82f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.4 2024-09-14T11:02:43.987 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.986+0000 7fde9b82f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.5 2024-09-14T11:02:43.987 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.986+0000 7fde9b82f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.5 2024-09-14T11:02:43.987 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.986+0000 7fde9b82f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.6 2024-09-14T11:02:43.987 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.986+0000 7fde9b82f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.6 2024-09-14T11:02:43.987 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.986+0000 7fde9b82f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.7 2024-09-14T11:02:43.987 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.986+0000 7fde9b82f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.7 2024-09-14T11:02:43.987 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.986+0000 7fde9b82f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.8 2024-09-14T11:02:43.987 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.986+0000 7fde9b82f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.8 2024-09-14T11:02:43.987 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.986+0000 7fde9b82f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.9 2024-09-14T11:02:43.987 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.986+0000 7fde9b82f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.9 2024-09-14T11:02:43.987 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.986+0000 7fde9b82f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.10 2024-09-14T11:02:43.987 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.986+0000 7fde9b82f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.10 2024-09-14T11:02:43.988 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.986+0000 7fde9b82f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.11 2024-09-14T11:02:43.988 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.986+0000 7fde9b82f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.11 2024-09-14T11:02:43.988 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.986+0000 7fde9b82f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.12 2024-09-14T11:02:43.988 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.986+0000 7fde9b82f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.12 2024-09-14T11:02:43.988 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.986+0000 7fde9b82f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.0 2024-09-14T11:02:43.988 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.986+0000 7fde9b82f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.0 2024-09-14T11:02:43.988 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.987+0000 7fde9b82f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.1 2024-09-14T11:02:43.988 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.987+0000 7fde9b82f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.1 2024-09-14T11:02:43.988 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.987+0000 7fde9b82f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.2 2024-09-14T11:02:43.988 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.987+0000 7fde9b82f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.2 2024-09-14T11:02:43.988 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.988+0000 7fde9b82f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.3 2024-09-14T11:02:43.988 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.988+0000 7fde9b82f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.3 2024-09-14T11:02:43.989 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.988+0000 7fde9b82f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.4 2024-09-14T11:02:43.989 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.988+0000 7fde9b82f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.4 2024-09-14T11:02:43.989 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.989+0000 7fde9b82f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.5 2024-09-14T11:02:43.989 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.989+0000 7fde9b82f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.5 2024-09-14T11:02:43.989 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.989+0000 7fde9b82f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.6 2024-09-14T11:02:43.990 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.989+0000 7fde9b82f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.6 2024-09-14T11:02:43.990 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.989+0000 7fde9b82f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.7 2024-09-14T11:02:43.990 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.989+0000 7fde9b82f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.7 2024-09-14T11:02:43.990 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.990+0000 7fde9b82f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.8 2024-09-14T11:02:43.990 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.990+0000 7fde9b82f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.8 2024-09-14T11:02:43.990 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.990+0000 7fde9b82f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.9 2024-09-14T11:02:43.990 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.990+0000 7fde9b82f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.9 2024-09-14T11:02:43.991 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.991+0000 7fde9b82f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.10 2024-09-14T11:02:43.991 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.991+0000 7fde9b82f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.10 2024-09-14T11:02:43.991 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.992+0000 7fde9b82f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.11 2024-09-14T11:02:43.991 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.992+0000 7fde9b82f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.11 2024-09-14T11:02:43.992 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.994+0000 7fde9b82f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 : hit (requested=0x17, cached=0x17) 2024-09-14T11:02:43.992 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.994+0000 7fde9b82f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 2024-09-14T11:02:43.993 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.995+0000 7fde9b82f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:02:43.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.995+0000 7fde9b82f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:02:43.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.995+0000 7fde9b82f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:02:43.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.995+0000 7fde9b82f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17, ofs0, ns] 2024-09-14T11:02:43.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.995+0000 7fdd6bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595165 cookie 94720875174832 notifier 6183 bl.length()=827 2024-09-14T11:02:43.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.995+0000 7fdd6bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:02:43.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.995+0000 7fdd6bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:02:43.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.995+0000 7fdd6bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:02:43.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.996+0000 7fde9b82f800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): orig_sources= new_sources= 2024-09-14T11:02:43.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.996+0000 7fde9b82f800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): potential sources added=[] removed=[] 2024-09-14T11:02:43.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.996+0000 7fde9b82f800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): orig_dests= new_dests= 2024-09-14T11:02:43.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.996+0000 7fde9b82f800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): potential dests added=[] removed=[] 2024-09-14T11:02:43.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.998+0000 7fde9b82f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.0 2024-09-14T11:02:43.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.998+0000 7fde9b82f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.0 2024-09-14T11:02:43.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.999+0000 7fde9b82f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.1 2024-09-14T11:02:43.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.999+0000 7fde9b82f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.1 2024-09-14T11:02:43.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.999+0000 7fde9b82f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.2 2024-09-14T11:02:43.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.999+0000 7fde9b82f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.2 2024-09-14T11:02:43.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.999+0000 7fde9b82f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.3 2024-09-14T11:02:43.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:43.999+0000 7fde9b82f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.3 2024-09-14T11:02:43.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.000+0000 7fde9b82f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.4 2024-09-14T11:02:43.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.000+0000 7fde9b82f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.4 2024-09-14T11:02:43.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.000+0000 7fde9b82f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.5 2024-09-14T11:02:43.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.000+0000 7fde9b82f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.5 2024-09-14T11:02:43.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.000+0000 7fde9b82f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.6 2024-09-14T11:02:43.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.000+0000 7fde9b82f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.6 2024-09-14T11:02:43.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.001+0000 7fde9b82f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.7 2024-09-14T11:02:43.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.001+0000 7fde9b82f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.7 2024-09-14T11:02:43.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.001+0000 7fde9b82f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.8 2024-09-14T11:02:43.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.001+0000 7fde9b82f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.8 2024-09-14T11:02:44.000 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.001+0000 7fde9b82f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.9 2024-09-14T11:02:44.000 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.001+0000 7fde9b82f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.9 2024-09-14T11:02:44.000 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.002+0000 7fde9b82f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.10 2024-09-14T11:02:44.000 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.002+0000 7fde9b82f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.10 2024-09-14T11:02:44.001 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.002+0000 7fde9b82f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.11 2024-09-14T11:02:44.001 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.002+0000 7fde9b82f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.1.11 2024-09-14T11:02:44.001 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.003+0000 7fde9b82f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 : hit (requested=0x17, cached=0x17) 2024-09-14T11:02:44.001 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.003+0000 7fde9b82f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 2024-09-14T11:02:44.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.004+0000 7fde9b82f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:02:44.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.004+0000 7fde9b82f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:02:44.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.004+0000 7fde9b82f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:02:44.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.004+0000 7fde9b82f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17, ofs0, ns] 2024-09-14T11:02:44.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.004+0000 7fdd6bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595166 cookie 94720875174832 notifier 6183 bl.length()=795 2024-09-14T11:02:44.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.004+0000 7fdd6bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:02:44.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.004+0000 7fdd6bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:02:44.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.004+0000 7fdd6bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:02:44.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.005+0000 7fde9b82f800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): orig_sources= new_sources= 2024-09-14T11:02:44.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.005+0000 7fde9b82f800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): potential sources added=[] removed=[] 2024-09-14T11:02:44.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.005+0000 7fde9b82f800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): orig_dests= new_dests= 2024-09-14T11:02:44.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.005+0000 7fde9b82f800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): potential dests added=[] removed=[] 2024-09-14T11:02:44.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.007+0000 7fde9b82f800 1 execute INFO: reshard of bucket "a-bucket" from 12 shards to 13 shards completed successfully 2024-09-14T11:02:44.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.008+0000 7fde9b82f800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-14T11:02:44.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.010+0000 7fde9b82f800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-14T11:02:44.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.010+0000 7fde9b82f800 20 processing logshard = reshard.0000000007 2024-09-14T11:02:44.010 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.012+0000 7fde9b82f800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-14T11:02:44.010 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.012+0000 7fde9b82f800 20 processing logshard = reshard.0000000008 2024-09-14T11:02:44.017 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.015+0000 7fde9b82f800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-14T11:02:44.017 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.015+0000 7fde9b82f800 20 processing logshard = reshard.0000000009 2024-09-14T11:02:44.017 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.017+0000 7fde9b82f800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-14T11:02:44.017 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.017+0000 7fde9b82f800 20 processing logshard = reshard.0000000010 2024-09-14T11:02:44.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.019+0000 7fde9b82f800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-14T11:02:44.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.019+0000 7fde9b82f800 20 processing logshard = reshard.0000000011 2024-09-14T11:02:44.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.022+0000 7fde9b82f800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-14T11:02:44.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.022+0000 7fde9b82f800 20 processing logshard = reshard.0000000012 2024-09-14T11:02:44.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.024+0000 7fde9b82f800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-14T11:02:44.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.024+0000 7fde9b82f800 20 processing logshard = reshard.0000000013 2024-09-14T11:02:44.025 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.026+0000 7fde9b82f800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-14T11:02:44.025 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.026+0000 7fde9b82f800 20 processing logshard = reshard.0000000014 2024-09-14T11:02:44.027 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.029+0000 7fde9b82f800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-14T11:02:44.027 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.029+0000 7fde9b82f800 20 processing logshard = reshard.0000000015 2024-09-14T11:02:44.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.031+0000 7fde9b82f800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-14T11:02:44.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.032+0000 7fdd4ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:02:44.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.034+0000 7fde9b82f800 20 remove_watcher() i=0 2024-09-14T11:02:44.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.034+0000 7fde9b82f800 2 removed watcher, disabling cache 2024-09-14T11:02:44.033 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.035+0000 7fde9b82f800 20 remove_watcher() i=1 2024-09-14T11:02:44.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.036+0000 7fde9b82f800 20 remove_watcher() i=2 2024-09-14T11:02:44.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.037+0000 7fde9b82f800 20 remove_watcher() i=3 2024-09-14T11:02:44.036 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.037+0000 7fde9b82f800 20 remove_watcher() i=4 2024-09-14T11:02:44.037 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.039+0000 7fde9b82f800 20 remove_watcher() i=5 2024-09-14T11:02:44.038 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.040+0000 7fde9b82f800 20 remove_watcher() i=6 2024-09-14T11:02:44.039 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.041+0000 7fde9b82f800 20 remove_watcher() i=7 2024-09-14T11:02:44.051 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:02:44.079 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:02:44.080 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:02:44.117 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.118+0000 7f4acb20f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:44.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.120+0000 7f4acb20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:44.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.120+0000 7f4acb20f800 20 realm 2024-09-14T11:02:44.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.120+0000 7f4acb20f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:44.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.120+0000 7f4acb20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:44.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.120+0000 7f4acb20f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:02:44.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.120+0000 7f4acb20f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:44.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.120+0000 7f4acb20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:44.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.120+0000 7f4acb20f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:44.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.121+0000 7f4acb20f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:44.120 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.121+0000 7f4acb20f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:44.120 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.122+0000 7f4acb20f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:02:44.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.122+0000 7f4acb20f800 20 searching for the correct realm 2024-09-14T11:02:44.122 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.124+0000 7f4ac9501640 0 -- 172.21.15.97:0/1348926201 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f4ab0090020 msgr2=0x7f4ab0062ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:02:44.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.329+0000 7f4ac84ff640 0 -- 172.21.15.97:0/1348926201 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f4ac0048200 msgr2=0x7f4ac00604b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:02:44.333 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.334+0000 7f4acb20f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:02:44.333 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.334+0000 7f4acb20f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:02:44.333 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.334+0000 7f4acb20f800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:02:44.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.334+0000 7f4acb20f800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:02:44.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.334+0000 7f4acb20f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:02:44.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.334+0000 7f4acb20f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:02:44.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.334+0000 7f4acb20f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:44.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.335+0000 7f4acb20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:44.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.335+0000 7f4acb20f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:44.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.335+0000 7f4acb20f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:44.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.335+0000 7f4acb20f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:44.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.335+0000 7f4acb20f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:02:44.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.335+0000 7f4acb20f800 20 zone default found 2024-09-14T11:02:44.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.335+0000 7f4acb20f800 4 Realm: () 2024-09-14T11:02:44.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.335+0000 7f4acb20f800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:02:44.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.335+0000 7f4acb20f800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:02:44.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.335+0000 7f4acb20f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:02:44.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.335+0000 7f4acb20f800 20 zonegroup default 2024-09-14T11:02:44.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.335+0000 7f4acb20f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:44.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.336+0000 7f4acb20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:44.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.336+0000 7f4acb20f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:44.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.336+0000 7f4acb20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:44.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.336+0000 7f4acb20f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:44.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.336+0000 7f4acb20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:44.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.336+0000 7f4acb20f800 20 started sync module instance, tier type = 2024-09-14T11:02:44.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.336+0000 7f4acb20f800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:02:44.344 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.345+0000 7f4acb20f800 20 add_watcher() i=0 2024-09-14T11:02:44.344 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.345+0000 7f4acb20f800 20 add_watcher() i=1 2024-09-14T11:02:44.344 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.345+0000 7f4acb20f800 20 add_watcher() i=2 2024-09-14T11:02:44.344 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.345+0000 7f4acb20f800 20 add_watcher() i=3 2024-09-14T11:02:44.344 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.345+0000 7f4acb20f800 20 add_watcher() i=4 2024-09-14T11:02:44.344 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.345+0000 7f4acb20f800 20 add_watcher() i=5 2024-09-14T11:02:44.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.345+0000 7f4acb20f800 20 add_watcher() i=6 2024-09-14T11:02:44.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.346+0000 7f4acb20f800 20 add_watcher() i=7 2024-09-14T11:02:44.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.346+0000 7f4acb20f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:02:44.346 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.348+0000 7f497efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:02:44.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.348+0000 7f4acb20f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:02:44.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.348+0000 7f4acb20f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:02:44.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.348+0000 7f4acb20f800 5 note: GC not initialized 2024-09-14T11:02:44.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.348+0000 7f497dfe3640 20 reqs_thread_entry: start 2024-09-14T11:02:44.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.348+0000 7f4acb20f800 20 init_complete bucket index max shards: 11 2024-09-14T11:02:44.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.348+0000 7f4acb20f800 20 Filter name: none 2024-09-14T11:02:44.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.349+0000 7f48ef7fe640 20 reqs_thread_entry: start 2024-09-14T11:02:44.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.349+0000 7f4acb20f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:44.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.349+0000 7f4acb20f800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:02:44.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.349+0000 7f4acb20f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:44.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.350+0000 7f4acb20f800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:02:44.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.350+0000 7f4acb20f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:02:44.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.350+0000 7f4acb20f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:44.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.350+0000 7f4acb20f800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:02:44.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.350+0000 7f4acb20f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:44.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.350+0000 7f4acb20f800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:02:44.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.350+0000 7f4acb20f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:02:44.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.352+0000 7f497efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:02:44.352 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.354+0000 7f4acb20f800 20 remove_watcher() i=0 2024-09-14T11:02:44.352 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.354+0000 7f4acb20f800 2 removed watcher, disabling cache 2024-09-14T11:02:44.354 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.355+0000 7f4acb20f800 20 remove_watcher() i=1 2024-09-14T11:02:44.354 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.356+0000 7f4acb20f800 20 remove_watcher() i=2 2024-09-14T11:02:44.355 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.357+0000 7f4acb20f800 20 remove_watcher() i=3 2024-09-14T11:02:44.356 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.358+0000 7f4acb20f800 20 remove_watcher() i=4 2024-09-14T11:02:44.357 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.359+0000 7f4acb20f800 20 remove_watcher() i=5 2024-09-14T11:02:44.358 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.360+0000 7f4acb20f800 20 remove_watcher() i=6 2024-09-14T11:02:44.359 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.360+0000 7f4acb20f800 20 remove_watcher() i=7 2024-09-14T11:02:44.369 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:44.369 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:02:44.369 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: a-bucket id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-14T11:02:44.369 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:44.369 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: reshard bucket with EIO injected at init_index 2024-09-14T11:02:44.369 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:44.567 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:02:44.595 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:02:44.595 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:02:44.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.633+0000 7f3453c94800 20 rados->read ofs=0 len=0 2024-09-14T11:02:44.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.635+0000 7f3453c94800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:44.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.635+0000 7f3453c94800 20 realm 2024-09-14T11:02:44.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.635+0000 7f3453c94800 20 rados->read ofs=0 len=0 2024-09-14T11:02:44.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.635+0000 7f3453c94800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:44.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.635+0000 7f3453c94800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:02:44.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.635+0000 7f3453c94800 20 rados->read ofs=0 len=0 2024-09-14T11:02:44.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.635+0000 7f3453c94800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:44.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.635+0000 7f3453c94800 20 rados->read ofs=0 len=0 2024-09-14T11:02:44.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.636+0000 7f3453c94800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:44.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.636+0000 7f3453c94800 20 rados->read ofs=0 len=0 2024-09-14T11:02:44.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.637+0000 7f3453c94800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:02:44.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.637+0000 7f3453c94800 20 searching for the correct realm 2024-09-14T11:02:44.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.638+0000 7f3448f7d640 0 -- 172.21.15.97:0/3902989708 >> [v2:172.21.15.97:6808/2081705332,v1:172.21.15.97:6809/2081705332] conn(0x7f344403e820 msgr2=0x7f344403d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:02:44.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:44.843+0000 7f345177e640 0 -- 172.21.15.97:0/3902989708 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7f343c026040 msgr2=0x7f343c001c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:02:45.050 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.051+0000 7f3453c94800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:02:45.051 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.051+0000 7f3453c94800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:02:45.051 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.051+0000 7f3453c94800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:02:45.051 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.051+0000 7f3453c94800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:02:45.051 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.051+0000 7f3453c94800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:02:45.051 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.051+0000 7f3453c94800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:02:45.051 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.051+0000 7f3453c94800 20 rados->read ofs=0 len=0 2024-09-14T11:02:45.051 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.052+0000 7f3453c94800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:45.051 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.052+0000 7f3453c94800 20 rados->read ofs=0 len=0 2024-09-14T11:02:45.051 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.052+0000 7f3453c94800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:45.051 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.052+0000 7f3453c94800 20 rados->read ofs=0 len=0 2024-09-14T11:02:45.053 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.053+0000 7f3453c94800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:02:45.053 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.053+0000 7f3453c94800 20 zone default found 2024-09-14T11:02:45.053 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.053+0000 7f3453c94800 4 Realm: () 2024-09-14T11:02:45.053 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.053+0000 7f3453c94800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:02:45.053 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.053+0000 7f3453c94800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:02:45.053 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.053+0000 7f3453c94800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:02:45.053 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.053+0000 7f3453c94800 20 zonegroup default 2024-09-14T11:02:45.053 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.053+0000 7f3453c94800 20 rados->read ofs=0 len=0 2024-09-14T11:02:45.053 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.053+0000 7f3453c94800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:45.053 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.053+0000 7f3453c94800 20 rados->read ofs=0 len=0 2024-09-14T11:02:45.053 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.053+0000 7f3453c94800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:45.053 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.053+0000 7f3453c94800 20 rados->read ofs=0 len=0 2024-09-14T11:02:45.054 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.053+0000 7f3453c94800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:45.054 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.053+0000 7f3453c94800 20 started sync module instance, tier type = 2024-09-14T11:02:45.054 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.053+0000 7f3453c94800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:02:45.060 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.062+0000 7f3453c94800 20 add_watcher() i=0 2024-09-14T11:02:45.061 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.062+0000 7f3453c94800 20 add_watcher() i=1 2024-09-14T11:02:45.061 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.062+0000 7f3453c94800 20 add_watcher() i=2 2024-09-14T11:02:45.061 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.062+0000 7f3453c94800 20 add_watcher() i=3 2024-09-14T11:02:45.061 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.062+0000 7f3453c94800 20 add_watcher() i=4 2024-09-14T11:02:45.061 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.062+0000 7f3453c94800 20 add_watcher() i=5 2024-09-14T11:02:45.061 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.062+0000 7f3453c94800 20 add_watcher() i=6 2024-09-14T11:02:45.061 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.063+0000 7f3453c94800 20 add_watcher() i=7 2024-09-14T11:02:45.061 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.063+0000 7f3453c94800 2 all 8 watchers are set, enabling cache 2024-09-14T11:02:45.063 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.064+0000 7f3307fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:02:45.063 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.065+0000 7f3453c94800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:02:45.064 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.065+0000 7f3453c94800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:02:45.064 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.065+0000 7f3453c94800 5 note: GC not initialized 2024-09-14T11:02:45.064 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.065+0000 7f3306fe5640 20 reqs_thread_entry: start 2024-09-14T11:02:45.064 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.065+0000 7f3453c94800 20 init_complete bucket index max shards: 11 2024-09-14T11:02:45.064 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.065+0000 7f3453c94800 20 Filter name: none 2024-09-14T11:02:45.064 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.065+0000 7f3304fe1640 20 reqs_thread_entry: start 2024-09-14T11:02:45.064 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.065+0000 7f3453c94800 20 rados->read ofs=0 len=0 2024-09-14T11:02:45.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.066+0000 7f3453c94800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:02:45.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.066+0000 7f3453c94800 20 rados->read ofs=0 len=0 2024-09-14T11:02:45.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.066+0000 7f3453c94800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:02:45.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.066+0000 7f3453c94800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:02:45.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.066+0000 7f3453c94800 20 rados->read ofs=0 len=0 2024-09-14T11:02:45.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.067+0000 7f3453c94800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:02:45.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.067+0000 7f3453c94800 20 rados->read ofs=0 len=0 2024-09-14T11:02:45.066 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.067+0000 7f3453c94800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:02:45.066 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.067+0000 7f3453c94800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:02:45.067 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.069+0000 7f3307fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:02:45.069 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.071+0000 7f3453c94800 20 remove_watcher() i=0 2024-09-14T11:02:45.069 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.071+0000 7f3453c94800 2 removed watcher, disabling cache 2024-09-14T11:02:45.070 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.072+0000 7f3453c94800 20 remove_watcher() i=1 2024-09-14T11:02:45.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.072+0000 7f3453c94800 20 remove_watcher() i=2 2024-09-14T11:02:45.072 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.073+0000 7f3453c94800 20 remove_watcher() i=3 2024-09-14T11:02:45.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.074+0000 7f3453c94800 20 remove_watcher() i=4 2024-09-14T11:02:45.074 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.075+0000 7f3453c94800 20 remove_watcher() i=5 2024-09-14T11:02:45.074 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.076+0000 7f3453c94800 20 remove_watcher() i=6 2024-09-14T11:02:45.075 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.077+0000 7f3453c94800 20 remove_watcher() i=7 2024-09-14T11:02:45.086 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:45.086 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:02:45.086 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-init-index id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:02:45.086 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:45.087 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index 2024-09-14T11:02:45.121 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:02:45.121 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:02:45.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.160+0000 7fa8bc016800 20 rados->read ofs=0 len=0 2024-09-14T11:02:45.160 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.161+0000 7fa8bc016800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:45.160 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.161+0000 7fa8bc016800 20 realm 2024-09-14T11:02:45.160 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.161+0000 7fa8bc016800 20 rados->read ofs=0 len=0 2024-09-14T11:02:45.160 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.162+0000 7fa8bc016800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:45.160 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.162+0000 7fa8bc016800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:02:45.160 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.162+0000 7fa8bc016800 20 rados->read ofs=0 len=0 2024-09-14T11:02:45.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.162+0000 7fa8bc016800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:45.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.162+0000 7fa8bc016800 20 rados->read ofs=0 len=0 2024-09-14T11:02:45.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.163+0000 7fa8bc016800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:45.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.163+0000 7fa8bc016800 20 rados->read ofs=0 len=0 2024-09-14T11:02:45.162 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.163+0000 7fa8bc016800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:02:45.162 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.163+0000 7fa8bc016800 20 searching for the correct realm 2024-09-14T11:02:45.164 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.165+0000 7fa8b7fe8640 0 -- 172.21.15.97:0/1125763881 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7fa8a0033070 msgr2=0x7fa8a0067ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:02:45.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.370+0000 7fa8aefe6640 0 -- 172.21.15.97:0/1125763881 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7fa8a8063960 msgr2=0x7fa8a808c400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:02:45.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.375+0000 7fa8bc016800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:02:45.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.375+0000 7fa8bc016800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:02:45.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.375+0000 7fa8bc016800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:02:45.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.375+0000 7fa8bc016800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:02:45.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.375+0000 7fa8bc016800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:02:45.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.375+0000 7fa8bc016800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:02:45.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.375+0000 7fa8bc016800 20 rados->read ofs=0 len=0 2024-09-14T11:02:45.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.376+0000 7fa8bc016800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:45.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.376+0000 7fa8bc016800 20 rados->read ofs=0 len=0 2024-09-14T11:02:45.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.376+0000 7fa8bc016800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:45.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.376+0000 7fa8bc016800 20 rados->read ofs=0 len=0 2024-09-14T11:02:45.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.376+0000 7fa8bc016800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:02:45.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.376+0000 7fa8bc016800 20 zone default found 2024-09-14T11:02:45.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.376+0000 7fa8bc016800 4 Realm: () 2024-09-14T11:02:45.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.376+0000 7fa8bc016800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:02:45.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.376+0000 7fa8bc016800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:02:45.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.376+0000 7fa8bc016800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:02:45.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.376+0000 7fa8bc016800 20 zonegroup default 2024-09-14T11:02:45.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.376+0000 7fa8bc016800 20 rados->read ofs=0 len=0 2024-09-14T11:02:45.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.376+0000 7fa8bc016800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:45.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.377+0000 7fa8bc016800 20 rados->read ofs=0 len=0 2024-09-14T11:02:45.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.377+0000 7fa8bc016800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:45.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.377+0000 7fa8bc016800 20 rados->read ofs=0 len=0 2024-09-14T11:02:45.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.377+0000 7fa8bc016800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:45.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.377+0000 7fa8bc016800 20 started sync module instance, tier type = 2024-09-14T11:02:45.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.377+0000 7fa8bc016800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:02:45.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.386+0000 7fa8bc016800 20 add_watcher() i=0 2024-09-14T11:02:45.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.386+0000 7fa8bc016800 20 add_watcher() i=1 2024-09-14T11:02:45.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.386+0000 7fa8bc016800 20 add_watcher() i=2 2024-09-14T11:02:45.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.386+0000 7fa8bc016800 20 add_watcher() i=3 2024-09-14T11:02:45.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.386+0000 7fa8bc016800 20 add_watcher() i=4 2024-09-14T11:02:45.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.386+0000 7fa8bc016800 20 add_watcher() i=5 2024-09-14T11:02:45.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.386+0000 7fa8bc016800 20 add_watcher() i=6 2024-09-14T11:02:45.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.387+0000 7fa8bc016800 20 add_watcher() i=7 2024-09-14T11:02:45.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.387+0000 7fa8bc016800 2 all 8 watchers are set, enabling cache 2024-09-14T11:02:45.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.389+0000 7fa76dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:02:45.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.389+0000 7fa8bc016800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:02:45.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.389+0000 7fa8bc016800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:02:45.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.389+0000 7fa8bc016800 5 note: GC not initialized 2024-09-14T11:02:45.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.389+0000 7fa76cfe1640 20 reqs_thread_entry: start 2024-09-14T11:02:45.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.389+0000 7fa8bc016800 20 init_complete bucket index max shards: 11 2024-09-14T11:02:45.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.389+0000 7fa8bc016800 20 Filter name: none 2024-09-14T11:02:45.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.389+0000 7fa6e67fc640 20 reqs_thread_entry: start 2024-09-14T11:02:45.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.390+0000 7fa8bc016800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-14T11:02:45.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.390+0000 7fa8bc016800 20 rados->read ofs=0 len=0 2024-09-14T11:02:45.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.390+0000 7fa8bc016800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:02:45.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.390+0000 7fa8bc016800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-14T11:02:45.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.390+0000 7fa8bc016800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-14T11:02:45.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.390+0000 7fa8bc016800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19 : miss 2024-09-14T11:02:45.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.390+0000 7fa8bc016800 20 rados->read ofs=0 len=0 2024-09-14T11:02:45.390 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.390+0000 7fa8bc016800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:02:45.390 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.390+0000 7fa8bc016800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19 info.flags=0x17 2024-09-14T11:02:45.390 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.390+0000 7fa8bc016800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19 to cache LRU end 2024-09-14T11:02:45.390 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.390+0000 7fa8bc016800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:02:45.390 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.390+0000 7fa8bc016800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:02:45.390 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.390+0000 7fa8bc016800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19 2024-09-14T11:02:45.391 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.392+0000 7fa8bc016800 -1 Injecting error=-5 at location=init_index 2024-09-14T11:02:45.391 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.392+0000 7fa8bc016800 0 ERROR: init_target_index failed to initialize target index shard objects: (5) Input/output error 2024-09-14T11:02:45.391 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.393+0000 7fa76dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:02:45.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.395+0000 7fa8bc016800 20 remove_watcher() i=0 2024-09-14T11:02:45.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.395+0000 7fa8bc016800 2 removed watcher, disabling cache 2024-09-14T11:02:45.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.396+0000 7fa8bc016800 20 remove_watcher() i=1 2024-09-14T11:02:45.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.397+0000 7fa8bc016800 20 remove_watcher() i=2 2024-09-14T11:02:45.397 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.398+0000 7fa8bc016800 20 remove_watcher() i=3 2024-09-14T11:02:45.398 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.399+0000 7fa8bc016800 20 remove_watcher() i=4 2024-09-14T11:02:45.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.401+0000 7fa8bc016800 20 remove_watcher() i=5 2024-09-14T11:02:45.400 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.402+0000 7fa8bc016800 20 remove_watcher() i=6 2024-09-14T11:02:45.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.402+0000 7fa8bc016800 20 remove_watcher() i=7 2024-09-14T11:02:45.412 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:02:45.441 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:02:45.442 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:02:45.478 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.479+0000 7f177ad37800 20 rados->read ofs=0 len=0 2024-09-14T11:02:45.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.481+0000 7f177ad37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:45.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.481+0000 7f177ad37800 20 realm 2024-09-14T11:02:45.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.481+0000 7f177ad37800 20 rados->read ofs=0 len=0 2024-09-14T11:02:45.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.481+0000 7f177ad37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:45.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.481+0000 7f177ad37800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:02:45.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.481+0000 7f177ad37800 20 rados->read ofs=0 len=0 2024-09-14T11:02:45.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.482+0000 7f177ad37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:45.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.482+0000 7f177ad37800 20 rados->read ofs=0 len=0 2024-09-14T11:02:45.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.482+0000 7f177ad37800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:45.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.482+0000 7f177ad37800 20 rados->read ofs=0 len=0 2024-09-14T11:02:45.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.483+0000 7f177ad37800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:02:45.482 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.483+0000 7f177ad37800 20 searching for the correct realm 2024-09-14T11:02:45.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.486+0000 7f1776a7d640 0 -- 172.21.15.97:0/1921677188 >> [v2:172.21.15.152:6808/1010851305,v1:172.21.15.152:6809/1010851305] conn(0x55d69b8b5020 msgr2=0x55d69b8b74e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:02:45.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.489+0000 7f1776a7d640 0 -- 172.21.15.97:0/1921677188 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x55d69b8a8850 msgr2=0x55d69b8aac40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:02:45.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.493+0000 7f177ad37800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:02:45.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.493+0000 7f177ad37800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:02:45.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.493+0000 7f177ad37800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:02:45.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.493+0000 7f177ad37800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:02:45.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.493+0000 7f177ad37800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:02:45.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.493+0000 7f177ad37800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:02:45.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.493+0000 7f177ad37800 20 rados->read ofs=0 len=0 2024-09-14T11:02:45.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.493+0000 7f177ad37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:45.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.493+0000 7f177ad37800 20 rados->read ofs=0 len=0 2024-09-14T11:02:45.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.493+0000 7f177ad37800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:45.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.493+0000 7f177ad37800 20 rados->read ofs=0 len=0 2024-09-14T11:02:45.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.494+0000 7f177ad37800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:02:45.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.494+0000 7f177ad37800 20 zone default found 2024-09-14T11:02:45.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.494+0000 7f177ad37800 4 Realm: () 2024-09-14T11:02:45.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.494+0000 7f177ad37800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:02:45.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.494+0000 7f177ad37800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:02:45.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.494+0000 7f177ad37800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:02:45.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.494+0000 7f177ad37800 20 zonegroup default 2024-09-14T11:02:45.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.494+0000 7f177ad37800 20 rados->read ofs=0 len=0 2024-09-14T11:02:45.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.494+0000 7f177ad37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:45.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.494+0000 7f177ad37800 20 rados->read ofs=0 len=0 2024-09-14T11:02:45.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.494+0000 7f177ad37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:45.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.494+0000 7f177ad37800 20 rados->read ofs=0 len=0 2024-09-14T11:02:45.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.494+0000 7f177ad37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:45.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.494+0000 7f177ad37800 20 started sync module instance, tier type = 2024-09-14T11:02:45.495 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.494+0000 7f177ad37800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:02:45.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.502+0000 7f177ad37800 20 add_watcher() i=0 2024-09-14T11:02:45.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.502+0000 7f177ad37800 20 add_watcher() i=1 2024-09-14T11:02:45.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.502+0000 7f177ad37800 20 add_watcher() i=2 2024-09-14T11:02:45.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.502+0000 7f177ad37800 20 add_watcher() i=3 2024-09-14T11:02:45.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.502+0000 7f177ad37800 20 add_watcher() i=4 2024-09-14T11:02:45.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.502+0000 7f177ad37800 20 add_watcher() i=5 2024-09-14T11:02:45.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.502+0000 7f177ad37800 20 add_watcher() i=6 2024-09-14T11:02:45.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.503+0000 7f177ad37800 20 add_watcher() i=7 2024-09-14T11:02:45.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.503+0000 7f177ad37800 2 all 8 watchers are set, enabling cache 2024-09-14T11:02:45.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.505+0000 7f162d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:02:45.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.505+0000 7f177ad37800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:02:45.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.505+0000 7f177ad37800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:02:45.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.505+0000 7f177ad37800 5 note: GC not initialized 2024-09-14T11:02:45.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.506+0000 7f15a7fff640 20 reqs_thread_entry: start 2024-09-14T11:02:45.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.506+0000 7f177ad37800 20 init_complete bucket index max shards: 11 2024-09-14T11:02:45.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.506+0000 7f177ad37800 20 Filter name: none 2024-09-14T11:02:45.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.506+0000 7f15a5ffb640 20 reqs_thread_entry: start 2024-09-14T11:02:45.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.506+0000 7f177ad37800 20 rados->read ofs=0 len=0 2024-09-14T11:02:45.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.506+0000 7f177ad37800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:02:45.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.506+0000 7f177ad37800 20 rados->read ofs=0 len=0 2024-09-14T11:02:45.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.507+0000 7f177ad37800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:02:45.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.507+0000 7f177ad37800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:02:45.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.507+0000 7f177ad37800 20 rados->read ofs=0 len=0 2024-09-14T11:02:45.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.507+0000 7f177ad37800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:02:45.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.507+0000 7f177ad37800 20 rados->read ofs=0 len=0 2024-09-14T11:02:45.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.507+0000 7f177ad37800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:02:45.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.507+0000 7f177ad37800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:02:45.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.509+0000 7f162d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:02:45.509 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.511+0000 7f177ad37800 20 remove_watcher() i=0 2024-09-14T11:02:45.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.511+0000 7f177ad37800 2 removed watcher, disabling cache 2024-09-14T11:02:45.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.512+0000 7f177ad37800 20 remove_watcher() i=1 2024-09-14T11:02:45.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.513+0000 7f177ad37800 20 remove_watcher() i=2 2024-09-14T11:02:45.513 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.514+0000 7f177ad37800 20 remove_watcher() i=3 2024-09-14T11:02:45.513 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.515+0000 7f177ad37800 20 remove_watcher() i=4 2024-09-14T11:02:45.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.516+0000 7f177ad37800 20 remove_watcher() i=5 2024-09-14T11:02:45.515 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.517+0000 7f177ad37800 20 remove_watcher() i=6 2024-09-14T11:02:45.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.518+0000 7f177ad37800 20 remove_watcher() i=7 2024-09-14T11:02:45.527 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:45.527 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:02:45.527 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-init-index id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:02:45.527 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:45.580 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:02:45.612 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:02:45.612 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:02:45.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.650+0000 7ff1c0144800 20 rados->read ofs=0 len=0 2024-09-14T11:02:45.654 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.652+0000 7ff1c0144800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:45.654 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.652+0000 7ff1c0144800 20 realm 2024-09-14T11:02:45.654 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.652+0000 7ff1c0144800 20 rados->read ofs=0 len=0 2024-09-14T11:02:45.654 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.652+0000 7ff1c0144800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:45.654 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.652+0000 7ff1c0144800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:02:45.654 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.652+0000 7ff1c0144800 20 rados->read ofs=0 len=0 2024-09-14T11:02:45.654 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.652+0000 7ff1c0144800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:45.654 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.652+0000 7ff1c0144800 20 rados->read ofs=0 len=0 2024-09-14T11:02:45.654 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.653+0000 7ff1c0144800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:45.654 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.653+0000 7ff1c0144800 20 rados->read ofs=0 len=0 2024-09-14T11:02:45.654 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.653+0000 7ff1c0144800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:02:45.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.654+0000 7ff1c0144800 20 searching for the correct realm 2024-09-14T11:02:45.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.656+0000 7ff1be42f640 0 -- 172.21.15.97:0/1988771040 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7ff1b4018070 msgr2=0x7ff1b405ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:02:45.859 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.861+0000 7ff1bd42d640 0 -- 172.21.15.97:0/1988771040 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7ff1b0042950 msgr2=0x7ff1b00413d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:02:45.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.866+0000 7ff1c0144800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:02:45.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.866+0000 7ff1c0144800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:02:45.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.866+0000 7ff1c0144800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:02:45.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.866+0000 7ff1c0144800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:02:45.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.866+0000 7ff1c0144800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:02:45.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.866+0000 7ff1c0144800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:02:45.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.866+0000 7ff1c0144800 20 rados->read ofs=0 len=0 2024-09-14T11:02:45.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.867+0000 7ff1c0144800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:45.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.867+0000 7ff1c0144800 20 rados->read ofs=0 len=0 2024-09-14T11:02:45.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.867+0000 7ff1c0144800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:45.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.867+0000 7ff1c0144800 20 rados->read ofs=0 len=0 2024-09-14T11:02:45.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.867+0000 7ff1c0144800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:02:45.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.867+0000 7ff1c0144800 20 zone default found 2024-09-14T11:02:45.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.867+0000 7ff1c0144800 4 Realm: () 2024-09-14T11:02:45.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.867+0000 7ff1c0144800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:02:45.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.867+0000 7ff1c0144800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:02:45.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.867+0000 7ff1c0144800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:02:45.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.867+0000 7ff1c0144800 20 zonegroup default 2024-09-14T11:02:45.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.867+0000 7ff1c0144800 20 rados->read ofs=0 len=0 2024-09-14T11:02:45.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.867+0000 7ff1c0144800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:45.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.868+0000 7ff1c0144800 20 rados->read ofs=0 len=0 2024-09-14T11:02:45.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.868+0000 7ff1c0144800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:45.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.868+0000 7ff1c0144800 20 rados->read ofs=0 len=0 2024-09-14T11:02:45.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.868+0000 7ff1c0144800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:45.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.868+0000 7ff1c0144800 20 started sync module instance, tier type = 2024-09-14T11:02:45.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.868+0000 7ff1c0144800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:02:45.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.877+0000 7ff1c0144800 20 add_watcher() i=0 2024-09-14T11:02:45.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.877+0000 7ff1c0144800 20 add_watcher() i=1 2024-09-14T11:02:45.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.877+0000 7ff1c0144800 20 add_watcher() i=2 2024-09-14T11:02:45.876 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.877+0000 7ff1c0144800 20 add_watcher() i=3 2024-09-14T11:02:45.876 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.877+0000 7ff1c0144800 20 add_watcher() i=4 2024-09-14T11:02:45.876 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.877+0000 7ff1c0144800 20 add_watcher() i=5 2024-09-14T11:02:45.876 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.877+0000 7ff1c0144800 20 add_watcher() i=6 2024-09-14T11:02:45.876 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.878+0000 7ff1c0144800 20 add_watcher() i=7 2024-09-14T11:02:45.876 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.878+0000 7ff1c0144800 2 all 8 watchers are set, enabling cache 2024-09-14T11:02:45.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.879+0000 7ff06f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:02:45.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.880+0000 7ff1c0144800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:02:45.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.880+0000 7ff1c0144800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:02:45.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.880+0000 7ff1c0144800 5 note: GC not initialized 2024-09-14T11:02:45.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.880+0000 7ff06e7fc640 20 reqs_thread_entry: start 2024-09-14T11:02:45.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.880+0000 7ff1c0144800 20 init_complete bucket index max shards: 11 2024-09-14T11:02:45.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.880+0000 7ff1c0144800 20 Filter name: none 2024-09-14T11:02:45.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.880+0000 7fefdffff640 20 reqs_thread_entry: start 2024-09-14T11:02:45.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.880+0000 7ff1c0144800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-14T11:02:45.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.880+0000 7ff1c0144800 20 rados->read ofs=0 len=0 2024-09-14T11:02:45.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.881+0000 7ff1c0144800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:02:45.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.881+0000 7ff1c0144800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-14T11:02:45.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.881+0000 7ff1c0144800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-14T11:02:45.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.881+0000 7ff1c0144800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19 : miss 2024-09-14T11:02:45.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.881+0000 7ff1c0144800 20 rados->read ofs=0 len=0 2024-09-14T11:02:45.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.881+0000 7ff1c0144800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:02:45.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.881+0000 7ff1c0144800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19 info.flags=0x17 2024-09-14T11:02:45.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.881+0000 7ff1c0144800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19 to cache LRU end 2024-09-14T11:02:45.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.881+0000 7ff1c0144800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:02:45.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.881+0000 7ff1c0144800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:02:45.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.881+0000 7ff1c0144800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19 2024-09-14T11:02:45.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.886+0000 7ff1c0144800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19 info.flags=0x17 2024-09-14T11:02:45.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.886+0000 7ff1c0144800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19 to cache LRU end 2024-09-14T11:02:45.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.886+0000 7ff1c0144800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:02:45.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.886+0000 7ff1c0144800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19, ofs0, ns] 2024-09-14T11:02:45.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.887+0000 7ff0a17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595160 cookie 94200598019904 notifier 5966 bl.length()=911 2024-09-14T11:02:45.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.887+0000 7ff0a17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19 info.flags=0x17 2024-09-14T11:02:45.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.887+0000 7ff0a17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19 to cache LRU end 2024-09-14T11:02:45.886 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.887+0000 7ff0a17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:02:45.886 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.887+0000 7ff1c0144800 20 handle_bi_update(): bucket=:error-at-init-index[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19]): orig_sources= new_sources= 2024-09-14T11:02:45.886 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.887+0000 7ff1c0144800 20 handle_bi_update(): bucket=:error-at-init-index[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19]): potential sources added=[] removed=[] 2024-09-14T11:02:45.886 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.887+0000 7ff1c0144800 20 handle_bi_update(): bucket=:error-at-init-index[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19]): orig_dests= new_dests= 2024-09-14T11:02:45.886 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.887+0000 7ff1c0144800 20 handle_bi_update(): bucket=:error-at-init-index[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19]): potential dests added=[] removed=[] 2024-09-14T11:02:45.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.891+0000 7ff1c0144800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19.1.0 2024-09-14T11:02:45.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.891+0000 7ff1c0144800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19.1.0 2024-09-14T11:02:45.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.891+0000 7ff1c0144800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19.1.1 2024-09-14T11:02:45.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.891+0000 7ff1c0144800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19.1.1 2024-09-14T11:02:45.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.891+0000 7ff1c0144800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19.1.2 2024-09-14T11:02:45.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.891+0000 7ff1c0144800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19.1.2 2024-09-14T11:02:45.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.891+0000 7ff1c0144800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19.1.3 2024-09-14T11:02:45.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.891+0000 7ff1c0144800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19.1.3 2024-09-14T11:02:45.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.891+0000 7ff1c0144800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19.1.4 2024-09-14T11:02:45.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.891+0000 7ff1c0144800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19.1.4 2024-09-14T11:02:45.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.891+0000 7ff1c0144800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19.1.5 2024-09-14T11:02:45.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.891+0000 7ff1c0144800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19.1.5 2024-09-14T11:02:45.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.891+0000 7ff1c0144800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19.1.6 2024-09-14T11:02:45.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.891+0000 7ff1c0144800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19.1.6 2024-09-14T11:02:45.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.891+0000 7ff1c0144800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19.1.7 2024-09-14T11:02:45.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.891+0000 7ff1c0144800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19.1.7 2024-09-14T11:02:45.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.891+0000 7ff1c0144800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19.1.8 2024-09-14T11:02:45.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.891+0000 7ff1c0144800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19.1.8 2024-09-14T11:02:45.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.891+0000 7ff1c0144800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19.1.9 2024-09-14T11:02:45.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.891+0000 7ff1c0144800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19.1.9 2024-09-14T11:02:45.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.891+0000 7ff1c0144800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19.1.10 2024-09-14T11:02:45.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.891+0000 7ff1c0144800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19.1.10 2024-09-14T11:02:45.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.891+0000 7ff1c0144800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19.1.11 2024-09-14T11:02:45.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.891+0000 7ff1c0144800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19.1.11 2024-09-14T11:02:45.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.891+0000 7ff1c0144800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19.0 2024-09-14T11:02:45.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.892+0000 7ff1c0144800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19.1 2024-09-14T11:02:45.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.892+0000 7ff1c0144800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19.2 2024-09-14T11:02:45.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.893+0000 7ff1c0144800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19.3 2024-09-14T11:02:45.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.893+0000 7ff1c0144800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19.4 2024-09-14T11:02:45.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.893+0000 7ff1c0144800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19.5 2024-09-14T11:02:45.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.894+0000 7ff1c0144800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19.6 2024-09-14T11:02:45.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.894+0000 7ff1c0144800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19.7 2024-09-14T11:02:45.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.895+0000 7ff1c0144800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19.8 2024-09-14T11:02:45.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.895+0000 7ff1c0144800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19.9 2024-09-14T11:02:45.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.896+0000 7ff1c0144800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19.10 2024-09-14T11:02:45.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.899+0000 7ff1c0144800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:02:45.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.899+0000 7ff1c0144800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19 2024-09-14T11:02:45.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.900+0000 7ff1c0144800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19 info.flags=0x17 2024-09-14T11:02:45.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.900+0000 7ff1c0144800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19 to cache LRU end 2024-09-14T11:02:45.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.900+0000 7ff1c0144800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:02:45.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.900+0000 7ff1c0144800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19, ofs0, ns] 2024-09-14T11:02:45.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.901+0000 7ff0a17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595161 cookie 94200598019904 notifier 5966 bl.length()=911 2024-09-14T11:02:45.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.901+0000 7ff0a17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19 info.flags=0x17 2024-09-14T11:02:45.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.901+0000 7ff0a17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19 to cache LRU end 2024-09-14T11:02:45.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.901+0000 7ff0a17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:02:45.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.901+0000 7ff1c0144800 20 handle_bi_update(): bucket=:error-at-init-index[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19]): orig_sources= new_sources= 2024-09-14T11:02:45.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.901+0000 7ff1c0144800 20 handle_bi_update(): bucket=:error-at-init-index[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19]): potential sources added=[] removed=[] 2024-09-14T11:02:45.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.901+0000 7ff1c0144800 20 handle_bi_update(): bucket=:error-at-init-index[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19]): orig_dests= new_dests= 2024-09-14T11:02:45.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.901+0000 7ff1c0144800 20 handle_bi_update(): bucket=:error-at-init-index[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19]): potential dests added=[] removed=[] 2024-09-14T11:02:45.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.903+0000 7ff1c0144800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19.0 2024-09-14T11:02:45.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.904+0000 7ff1c0144800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19.1 2024-09-14T11:02:45.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.904+0000 7ff1c0144800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19.2 2024-09-14T11:02:45.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.904+0000 7ff1c0144800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19.3 2024-09-14T11:02:45.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.905+0000 7ff1c0144800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19.4 2024-09-14T11:02:45.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.905+0000 7ff1c0144800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19.5 2024-09-14T11:02:45.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.905+0000 7ff1c0144800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19.6 2024-09-14T11:02:45.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.906+0000 7ff1c0144800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19.7 2024-09-14T11:02:45.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.906+0000 7ff1c0144800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19.8 2024-09-14T11:02:45.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.906+0000 7ff1c0144800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19.9 2024-09-14T11:02:45.905 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.907+0000 7ff1c0144800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19.10 2024-09-14T11:02:45.905 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.907+0000 7ff1c0144800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:02:45.905 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.907+0000 7ff1c0144800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19 2024-09-14T11:02:45.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.908+0000 7ff1c0144800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19 info.flags=0x17 2024-09-14T11:02:45.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.908+0000 7ff1c0144800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19 to cache LRU end 2024-09-14T11:02:45.907 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.908+0000 7ff1c0144800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:02:45.907 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.908+0000 7ff1c0144800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19, ofs0, ns] 2024-09-14T11:02:45.907 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.908+0000 7ff0a0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595162 cookie 94200598019904 notifier 5966 bl.length()=879 2024-09-14T11:02:45.907 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.908+0000 7ff0a0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19 info.flags=0x17 2024-09-14T11:02:45.907 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.908+0000 7ff0a0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19 to cache LRU end 2024-09-14T11:02:45.907 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.908+0000 7ff0a0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:02:45.908 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.909+0000 7ff1c0144800 20 handle_bi_update(): bucket=:error-at-init-index[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19]): orig_sources= new_sources= 2024-09-14T11:02:45.908 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.909+0000 7ff1c0144800 20 handle_bi_update(): bucket=:error-at-init-index[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19]): potential sources added=[] removed=[] 2024-09-14T11:02:45.908 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.909+0000 7ff1c0144800 20 handle_bi_update(): bucket=:error-at-init-index[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19]): orig_dests= new_dests= 2024-09-14T11:02:45.908 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.909+0000 7ff1c0144800 20 handle_bi_update(): bucket=:error-at-init-index[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19]): potential dests added=[] removed=[] 2024-09-14T11:02:45.909 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.911+0000 7ff1c0144800 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-14T11:02:45.911 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.912+0000 7ff06f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:02:45.913 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.915+0000 7ff1c0144800 20 remove_watcher() i=0 2024-09-14T11:02:45.913 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.915+0000 7ff1c0144800 2 removed watcher, disabling cache 2024-09-14T11:02:45.914 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.916+0000 7ff1c0144800 20 remove_watcher() i=1 2024-09-14T11:02:45.915 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.917+0000 7ff1c0144800 20 remove_watcher() i=2 2024-09-14T11:02:45.916 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.918+0000 7ff1c0144800 20 remove_watcher() i=3 2024-09-14T11:02:45.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.919+0000 7ff1c0144800 20 remove_watcher() i=4 2024-09-14T11:02:45.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.920+0000 7ff1c0144800 20 remove_watcher() i=5 2024-09-14T11:02:45.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.921+0000 7ff1c0144800 20 remove_watcher() i=6 2024-09-14T11:02:45.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.922+0000 7ff1c0144800 20 remove_watcher() i=7 2024-09-14T11:02:45.932 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:02:45.961 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:02:45.961 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:02:45.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:45.999+0000 7f26dca20800 20 rados->read ofs=0 len=0 2024-09-14T11:02:46.000 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.001+0000 7f26dca20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:46.000 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.001+0000 7f26dca20800 20 realm 2024-09-14T11:02:46.000 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.001+0000 7f26dca20800 20 rados->read ofs=0 len=0 2024-09-14T11:02:46.000 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.001+0000 7f26dca20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:46.000 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.001+0000 7f26dca20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:02:46.000 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.001+0000 7f26dca20800 20 rados->read ofs=0 len=0 2024-09-14T11:02:46.000 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.001+0000 7f26dca20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:46.000 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.001+0000 7f26dca20800 20 rados->read ofs=0 len=0 2024-09-14T11:02:46.001 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.002+0000 7f26dca20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:46.001 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.002+0000 7f26dca20800 20 rados->read ofs=0 len=0 2024-09-14T11:02:46.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.204+0000 7f26dca20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:02:46.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.204+0000 7f26dca20800 20 searching for the correct realm 2024-09-14T11:02:46.204 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.205+0000 7f26da50a640 0 -- 172.21.15.97:0/2654867101 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x55dda31613a0 msgr2=0x55dda3163820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:02:46.207 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.209+0000 7f26da50a640 0 -- 172.21.15.97:0/2654867101 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7f26c4055bb0 msgr2=0x7f26c4044450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:02:46.212 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.214+0000 7f26dca20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:02:46.212 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.214+0000 7f26dca20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:02:46.212 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.214+0000 7f26dca20800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:02:46.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.214+0000 7f26dca20800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:02:46.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.214+0000 7f26dca20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:02:46.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.214+0000 7f26dca20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:02:46.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.214+0000 7f26dca20800 20 rados->read ofs=0 len=0 2024-09-14T11:02:46.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.214+0000 7f26dca20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:46.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.214+0000 7f26dca20800 20 rados->read ofs=0 len=0 2024-09-14T11:02:46.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.214+0000 7f26dca20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:46.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.214+0000 7f26dca20800 20 rados->read ofs=0 len=0 2024-09-14T11:02:46.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.215+0000 7f26dca20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:02:46.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.215+0000 7f26dca20800 20 zone default found 2024-09-14T11:02:46.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.215+0000 7f26dca20800 4 Realm: () 2024-09-14T11:02:46.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.215+0000 7f26dca20800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:02:46.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.215+0000 7f26dca20800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:02:46.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.215+0000 7f26dca20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:02:46.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.215+0000 7f26dca20800 20 zonegroup default 2024-09-14T11:02:46.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.215+0000 7f26dca20800 20 rados->read ofs=0 len=0 2024-09-14T11:02:46.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.215+0000 7f26dca20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:46.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.215+0000 7f26dca20800 20 rados->read ofs=0 len=0 2024-09-14T11:02:46.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.215+0000 7f26dca20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:46.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.215+0000 7f26dca20800 20 rados->read ofs=0 len=0 2024-09-14T11:02:46.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.215+0000 7f26dca20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:46.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.215+0000 7f26dca20800 20 started sync module instance, tier type = 2024-09-14T11:02:46.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.215+0000 7f26dca20800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:02:46.222 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.224+0000 7f26dca20800 20 add_watcher() i=0 2024-09-14T11:02:46.222 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.224+0000 7f26dca20800 20 add_watcher() i=1 2024-09-14T11:02:46.223 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.224+0000 7f26dca20800 20 add_watcher() i=2 2024-09-14T11:02:46.223 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.224+0000 7f26dca20800 20 add_watcher() i=3 2024-09-14T11:02:46.223 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.224+0000 7f26dca20800 20 add_watcher() i=4 2024-09-14T11:02:46.223 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.224+0000 7f26dca20800 20 add_watcher() i=5 2024-09-14T11:02:46.223 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.225+0000 7f26dca20800 20 add_watcher() i=6 2024-09-14T11:02:46.224 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.226+0000 7f26dca20800 20 add_watcher() i=7 2024-09-14T11:02:46.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.226+0000 7f26dca20800 2 all 8 watchers are set, enabling cache 2024-09-14T11:02:46.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.228+0000 7f2590fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:02:46.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.228+0000 7f26dca20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:02:46.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.228+0000 7f26dca20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:02:46.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.229+0000 7f26dca20800 5 note: GC not initialized 2024-09-14T11:02:46.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.229+0000 7f250b7fe640 20 reqs_thread_entry: start 2024-09-14T11:02:46.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.229+0000 7f26dca20800 20 init_complete bucket index max shards: 11 2024-09-14T11:02:46.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.229+0000 7f26dca20800 20 Filter name: none 2024-09-14T11:02:46.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.229+0000 7f25097fa640 20 reqs_thread_entry: start 2024-09-14T11:02:46.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.229+0000 7f26dca20800 20 rados->read ofs=0 len=0 2024-09-14T11:02:46.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.229+0000 7f26dca20800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:02:46.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.229+0000 7f26dca20800 20 rados->read ofs=0 len=0 2024-09-14T11:02:46.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.230+0000 7f26dca20800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:02:46.230 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.230+0000 7f26dca20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:02:46.230 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.230+0000 7f26dca20800 20 rados->read ofs=0 len=0 2024-09-14T11:02:46.230 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.230+0000 7f26dca20800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:02:46.230 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.230+0000 7f26dca20800 20 rados->read ofs=0 len=0 2024-09-14T11:02:46.230 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.231+0000 7f26dca20800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:02:46.230 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.231+0000 7f26dca20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:02:46.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.232+0000 7f2590fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:02:46.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.235+0000 7f26dca20800 20 remove_watcher() i=0 2024-09-14T11:02:46.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.235+0000 7f26dca20800 2 removed watcher, disabling cache 2024-09-14T11:02:46.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.236+0000 7f26dca20800 20 remove_watcher() i=1 2024-09-14T11:02:46.236 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.237+0000 7f26dca20800 20 remove_watcher() i=2 2024-09-14T11:02:46.237 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.238+0000 7f26dca20800 20 remove_watcher() i=3 2024-09-14T11:02:46.238 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.239+0000 7f26dca20800 20 remove_watcher() i=4 2024-09-14T11:02:46.238 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.240+0000 7f26dca20800 20 remove_watcher() i=5 2024-09-14T11:02:46.239 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.241+0000 7f26dca20800 20 remove_watcher() i=6 2024-09-14T11:02:46.240 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.242+0000 7f26dca20800 20 remove_watcher() i=7 2024-09-14T11:02:46.251 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:46.251 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:02:46.251 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-init-index id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:02:46.251 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:46.330 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: reshard bucket with EOPNOTSUPP injected at init_index 2024-09-14T11:02:46.330 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:46.519 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:02:46.547 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:02:46.547 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:02:46.584 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.585+0000 7f1d7530c800 20 rados->read ofs=0 len=0 2024-09-14T11:02:46.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.587+0000 7f1d7530c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:46.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.587+0000 7f1d7530c800 20 realm 2024-09-14T11:02:46.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.587+0000 7f1d7530c800 20 rados->read ofs=0 len=0 2024-09-14T11:02:46.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.587+0000 7f1d7530c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:46.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.587+0000 7f1d7530c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:02:46.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.587+0000 7f1d7530c800 20 rados->read ofs=0 len=0 2024-09-14T11:02:46.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.588+0000 7f1d7530c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:46.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.588+0000 7f1d7530c800 20 rados->read ofs=0 len=0 2024-09-14T11:02:46.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.588+0000 7f1d7530c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:46.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.588+0000 7f1d7530c800 20 rados->read ofs=0 len=0 2024-09-14T11:02:46.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.589+0000 7f1d7530c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:02:46.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.589+0000 7f1d7530c800 20 searching for the correct realm 2024-09-14T11:02:46.590 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.591+0000 7f1d735fe640 0 -- 172.21.15.97:0/3949743239 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f1d5c070040 msgr2=0x7f1d5c066360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:02:46.796 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.797+0000 7f1d6a5fc640 0 -- 172.21.15.97:0/3949743239 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f1d64026040 msgr2=0x7f1d64039420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:02:46.800 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.802+0000 7f1d7530c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:02:46.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.802+0000 7f1d7530c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:02:46.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.802+0000 7f1d7530c800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:02:46.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.802+0000 7f1d7530c800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:02:46.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.802+0000 7f1d7530c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:02:46.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.802+0000 7f1d7530c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:02:46.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.802+0000 7f1d7530c800 20 rados->read ofs=0 len=0 2024-09-14T11:02:46.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.802+0000 7f1d7530c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:46.801 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.802+0000 7f1d7530c800 20 rados->read ofs=0 len=0 2024-09-14T11:02:46.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.802+0000 7f1d7530c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:46.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.802+0000 7f1d7530c800 20 rados->read ofs=0 len=0 2024-09-14T11:02:46.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.803+0000 7f1d7530c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:02:46.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.803+0000 7f1d7530c800 20 zone default found 2024-09-14T11:02:46.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.803+0000 7f1d7530c800 4 Realm: () 2024-09-14T11:02:46.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.803+0000 7f1d7530c800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:02:46.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.803+0000 7f1d7530c800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:02:46.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.803+0000 7f1d7530c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:02:46.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.803+0000 7f1d7530c800 20 zonegroup default 2024-09-14T11:02:46.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.803+0000 7f1d7530c800 20 rados->read ofs=0 len=0 2024-09-14T11:02:46.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.803+0000 7f1d7530c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:46.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.803+0000 7f1d7530c800 20 rados->read ofs=0 len=0 2024-09-14T11:02:46.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.803+0000 7f1d7530c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:46.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.803+0000 7f1d7530c800 20 rados->read ofs=0 len=0 2024-09-14T11:02:46.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.804+0000 7f1d7530c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:46.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.804+0000 7f1d7530c800 20 started sync module instance, tier type = 2024-09-14T11:02:46.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.804+0000 7f1d7530c800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:02:46.810 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.812+0000 7f1d7530c800 20 add_watcher() i=0 2024-09-14T11:02:46.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.812+0000 7f1d7530c800 20 add_watcher() i=1 2024-09-14T11:02:46.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.812+0000 7f1d7530c800 20 add_watcher() i=2 2024-09-14T11:02:46.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.812+0000 7f1d7530c800 20 add_watcher() i=3 2024-09-14T11:02:46.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.812+0000 7f1d7530c800 20 add_watcher() i=4 2024-09-14T11:02:46.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.812+0000 7f1d7530c800 20 add_watcher() i=5 2024-09-14T11:02:46.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.812+0000 7f1d7530c800 20 add_watcher() i=6 2024-09-14T11:02:46.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.813+0000 7f1d7530c800 20 add_watcher() i=7 2024-09-14T11:02:46.812 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.813+0000 7f1d7530c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:02:46.813 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.815+0000 7f1c297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:02:46.814 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.815+0000 7f1d7530c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:02:46.814 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.815+0000 7f1d7530c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:02:46.814 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.815+0000 7f1d7530c800 5 note: GC not initialized 2024-09-14T11:02:46.814 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.815+0000 7f1ba3fff640 20 reqs_thread_entry: start 2024-09-14T11:02:46.814 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.816+0000 7f1d7530c800 20 init_complete bucket index max shards: 11 2024-09-14T11:02:46.815 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.816+0000 7f1d7530c800 20 Filter name: none 2024-09-14T11:02:46.815 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.816+0000 7f1ba1ffb640 20 reqs_thread_entry: start 2024-09-14T11:02:46.815 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.816+0000 7f1d7530c800 20 rados->read ofs=0 len=0 2024-09-14T11:02:46.815 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.816+0000 7f1d7530c800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:02:46.815 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.816+0000 7f1d7530c800 20 rados->read ofs=0 len=0 2024-09-14T11:02:46.816 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.817+0000 7f1d7530c800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:02:46.816 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.817+0000 7f1d7530c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:02:46.816 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.817+0000 7f1d7530c800 20 rados->read ofs=0 len=0 2024-09-14T11:02:46.816 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.817+0000 7f1d7530c800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:02:46.816 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.817+0000 7f1d7530c800 20 rados->read ofs=0 len=0 2024-09-14T11:02:46.816 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.818+0000 7f1d7530c800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:02:46.816 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.818+0000 7f1d7530c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:02:46.817 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.819+0000 7f1c297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:02:46.820 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.822+0000 7f1d7530c800 20 remove_watcher() i=0 2024-09-14T11:02:46.820 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.822+0000 7f1d7530c800 2 removed watcher, disabling cache 2024-09-14T11:02:46.822 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.823+0000 7f1d7530c800 20 remove_watcher() i=1 2024-09-14T11:02:46.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.825+0000 7f1d7530c800 20 remove_watcher() i=2 2024-09-14T11:02:46.825 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.826+0000 7f1d7530c800 20 remove_watcher() i=3 2024-09-14T11:02:46.825 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.827+0000 7f1d7530c800 20 remove_watcher() i=4 2024-09-14T11:02:46.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.828+0000 7f1d7530c800 20 remove_watcher() i=5 2024-09-14T11:02:46.828 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.829+0000 7f1d7530c800 20 remove_watcher() i=6 2024-09-14T11:02:46.829 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.830+0000 7f1d7530c800 20 remove_watcher() i=7 2024-09-14T11:02:46.839 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:46.839 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:02:46.839 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-init-index id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:02:46.839 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:46.840 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index --inject-error-code 95 2024-09-14T11:02:46.877 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:02:46.877 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:02:46.915 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.917+0000 7f4b2de87800 20 rados->read ofs=0 len=0 2024-09-14T11:02:46.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.918+0000 7f4b2de87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:46.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.918+0000 7f4b2de87800 20 realm 2024-09-14T11:02:46.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.918+0000 7f4b2de87800 20 rados->read ofs=0 len=0 2024-09-14T11:02:46.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.918+0000 7f4b2de87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:46.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.918+0000 7f4b2de87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:02:46.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.918+0000 7f4b2de87800 20 rados->read ofs=0 len=0 2024-09-14T11:02:46.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.918+0000 7f4b2de87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:46.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.918+0000 7f4b2de87800 20 rados->read ofs=0 len=0 2024-09-14T11:02:46.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.919+0000 7f4b2de87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:46.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.919+0000 7f4b2de87800 20 rados->read ofs=0 len=0 2024-09-14T11:02:46.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.920+0000 7f4b2de87800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:02:46.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.920+0000 7f4b2de87800 20 searching for the correct realm 2024-09-14T11:02:46.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:46.922+0000 7f4b2c172640 0 -- 172.21.15.97:0/4211668921 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f4b20017070 msgr2=0x7f4b2000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:02:47.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.127+0000 7f4b2b170640 0 -- 172.21.15.97:0/4211668921 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f4b1c049960 msgr2=0x7f4b1c008420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:02:47.130 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.131+0000 7f4b2de87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:02:47.130 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.131+0000 7f4b2de87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:02:47.130 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.131+0000 7f4b2de87800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:02:47.130 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.131+0000 7f4b2de87800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:02:47.131 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.131+0000 7f4b2de87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:02:47.131 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.131+0000 7f4b2de87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:02:47.131 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.131+0000 7f4b2de87800 20 rados->read ofs=0 len=0 2024-09-14T11:02:47.131 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.132+0000 7f4b2de87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:47.131 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.132+0000 7f4b2de87800 20 rados->read ofs=0 len=0 2024-09-14T11:02:47.131 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.132+0000 7f4b2de87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:47.131 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.132+0000 7f4b2de87800 20 rados->read ofs=0 len=0 2024-09-14T11:02:47.132 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.132+0000 7f4b2de87800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:02:47.132 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.132+0000 7f4b2de87800 20 zone default found 2024-09-14T11:02:47.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.132+0000 7f4b2de87800 4 Realm: () 2024-09-14T11:02:47.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.132+0000 7f4b2de87800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:02:47.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.132+0000 7f4b2de87800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:02:47.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.132+0000 7f4b2de87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:02:47.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.132+0000 7f4b2de87800 20 zonegroup default 2024-09-14T11:02:47.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.132+0000 7f4b2de87800 20 rados->read ofs=0 len=0 2024-09-14T11:02:47.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.132+0000 7f4b2de87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:47.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.132+0000 7f4b2de87800 20 rados->read ofs=0 len=0 2024-09-14T11:02:47.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.133+0000 7f4b2de87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:47.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.133+0000 7f4b2de87800 20 rados->read ofs=0 len=0 2024-09-14T11:02:47.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.133+0000 7f4b2de87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:47.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.133+0000 7f4b2de87800 20 started sync module instance, tier type = 2024-09-14T11:02:47.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.133+0000 7f4b2de87800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:02:47.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.143+0000 7f4b2de87800 20 add_watcher() i=0 2024-09-14T11:02:47.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.143+0000 7f4b2de87800 20 add_watcher() i=1 2024-09-14T11:02:47.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.143+0000 7f4b2de87800 20 add_watcher() i=2 2024-09-14T11:02:47.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.143+0000 7f4b2de87800 20 add_watcher() i=3 2024-09-14T11:02:47.142 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.143+0000 7f4b2de87800 20 add_watcher() i=4 2024-09-14T11:02:47.142 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.143+0000 7f4b2de87800 20 add_watcher() i=5 2024-09-14T11:02:47.142 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.143+0000 7f4b2de87800 20 add_watcher() i=6 2024-09-14T11:02:47.142 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.144+0000 7f4b2de87800 20 add_watcher() i=7 2024-09-14T11:02:47.142 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.144+0000 7f4b2de87800 2 all 8 watchers are set, enabling cache 2024-09-14T11:02:47.144 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.145+0000 7f49e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:02:47.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.146+0000 7f4b2de87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:02:47.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.146+0000 7f4b2de87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:02:47.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.146+0000 7f4b2de87800 5 note: GC not initialized 2024-09-14T11:02:47.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.146+0000 7f49e0fe1640 20 reqs_thread_entry: start 2024-09-14T11:02:47.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.146+0000 7f4b2de87800 20 init_complete bucket index max shards: 11 2024-09-14T11:02:47.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.146+0000 7f4b2de87800 20 Filter name: none 2024-09-14T11:02:47.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.146+0000 7f495a7fc640 20 reqs_thread_entry: start 2024-09-14T11:02:47.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.146+0000 7f4b2de87800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-14T11:02:47.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.146+0000 7f4b2de87800 20 rados->read ofs=0 len=0 2024-09-14T11:02:47.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.146+0000 7f4b2de87800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:02:47.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.146+0000 7f4b2de87800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-14T11:02:47.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.146+0000 7f4b2de87800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-14T11:02:47.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.146+0000 7f4b2de87800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20 : miss 2024-09-14T11:02:47.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.146+0000 7f4b2de87800 20 rados->read ofs=0 len=0 2024-09-14T11:02:47.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.147+0000 7f4b2de87800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:02:47.147 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.147+0000 7f4b2de87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20 info.flags=0x17 2024-09-14T11:02:47.147 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.147+0000 7f4b2de87800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20 to cache LRU end 2024-09-14T11:02:47.147 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.147+0000 7f4b2de87800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:02:47.147 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.147+0000 7f4b2de87800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:02:47.147 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.147+0000 7f4b2de87800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20 2024-09-14T11:02:47.147 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.148+0000 7f4b2de87800 -1 Injecting error=-95 at location=init_index 2024-09-14T11:02:47.147 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.148+0000 7f4b2de87800 0 WARNING: init_index() does not supported logrecord, falling back to block reshard mode. 2024-09-14T11:02:47.150 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.152+0000 7f4b2de87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20 info.flags=0x17 2024-09-14T11:02:47.150 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.152+0000 7f4b2de87800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20 to cache LRU end 2024-09-14T11:02:47.150 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.152+0000 7f4b2de87800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:02:47.150 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.152+0000 7f4b2de87800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20, ofs0, ns] 2024-09-14T11:02:47.150 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.152+0000 7f4a0a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595167 cookie 94618411328624 notifier 6327 bl.length()=911 2024-09-14T11:02:47.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.152+0000 7f4a0a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20 info.flags=0x17 2024-09-14T11:02:47.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.152+0000 7f4a0a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20 to cache LRU end 2024-09-14T11:02:47.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.152+0000 7f4a0a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:02:47.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.152+0000 7f4b2de87800 20 handle_bi_update(): bucket=:error-at-init-index[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20]): orig_sources= new_sources= 2024-09-14T11:02:47.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.152+0000 7f4b2de87800 20 handle_bi_update(): bucket=:error-at-init-index[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20]): potential sources added=[] removed=[] 2024-09-14T11:02:47.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.152+0000 7f4b2de87800 20 handle_bi_update(): bucket=:error-at-init-index[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20]): orig_dests= new_dests= 2024-09-14T11:02:47.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.152+0000 7f4b2de87800 20 handle_bi_update(): bucket=:error-at-init-index[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20]): potential dests added=[] removed=[] 2024-09-14T11:02:47.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.155+0000 7f4b2de87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20.1.0 2024-09-14T11:02:47.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.155+0000 7f4b2de87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20.1.0 2024-09-14T11:02:47.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.155+0000 7f4b2de87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20.1.1 2024-09-14T11:02:47.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.155+0000 7f4b2de87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20.1.1 2024-09-14T11:02:47.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.155+0000 7f4b2de87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20.1.2 2024-09-14T11:02:47.155 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.155+0000 7f4b2de87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20.1.2 2024-09-14T11:02:47.155 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.155+0000 7f4b2de87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20.1.3 2024-09-14T11:02:47.155 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.155+0000 7f4b2de87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20.1.3 2024-09-14T11:02:47.155 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.155+0000 7f4b2de87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20.1.4 2024-09-14T11:02:47.155 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.155+0000 7f4b2de87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20.1.4 2024-09-14T11:02:47.155 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.155+0000 7f4b2de87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20.1.5 2024-09-14T11:02:47.155 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.155+0000 7f4b2de87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20.1.5 2024-09-14T11:02:47.155 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.155+0000 7f4b2de87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20.1.6 2024-09-14T11:02:47.155 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.155+0000 7f4b2de87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20.1.6 2024-09-14T11:02:47.155 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.155+0000 7f4b2de87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20.1.7 2024-09-14T11:02:47.155 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.155+0000 7f4b2de87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20.1.7 2024-09-14T11:02:47.155 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.155+0000 7f4b2de87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20.1.8 2024-09-14T11:02:47.156 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.155+0000 7f4b2de87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20.1.8 2024-09-14T11:02:47.156 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.155+0000 7f4b2de87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20.1.9 2024-09-14T11:02:47.156 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.155+0000 7f4b2de87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20.1.9 2024-09-14T11:02:47.156 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.155+0000 7f4b2de87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20.1.10 2024-09-14T11:02:47.156 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.155+0000 7f4b2de87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20.1.10 2024-09-14T11:02:47.156 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.155+0000 7f4b2de87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20.1.11 2024-09-14T11:02:47.156 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.155+0000 7f4b2de87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20.1.11 2024-09-14T11:02:47.156 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.155+0000 7f4b2de87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20.0 2024-09-14T11:02:47.156 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.155+0000 7f4b2de87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20.1 2024-09-14T11:02:47.156 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.156+0000 7f4b2de87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20.2 2024-09-14T11:02:47.157 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.156+0000 7f4b2de87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20.3 2024-09-14T11:02:47.157 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.156+0000 7f4b2de87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20.4 2024-09-14T11:02:47.157 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.157+0000 7f4b2de87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20.5 2024-09-14T11:02:47.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.157+0000 7f4b2de87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20.6 2024-09-14T11:02:47.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.158+0000 7f4b2de87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20.7 2024-09-14T11:02:47.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.158+0000 7f4b2de87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20.8 2024-09-14T11:02:47.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.158+0000 7f4b2de87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20.9 2024-09-14T11:02:47.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.159+0000 7f4b2de87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20.10 2024-09-14T11:02:47.162 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.164+0000 7f4b2de87800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20 : hit (requested=0x17, cached=0x17) 2024-09-14T11:02:47.162 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.164+0000 7f4b2de87800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20 2024-09-14T11:02:47.164 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.165+0000 7f4b2de87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20 info.flags=0x17 2024-09-14T11:02:47.164 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.165+0000 7f4b2de87800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20 to cache LRU end 2024-09-14T11:02:47.164 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.165+0000 7f4b2de87800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:02:47.164 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.165+0000 7f4b2de87800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20, ofs0, ns] 2024-09-14T11:02:47.164 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.165+0000 7f4a0a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595168 cookie 94618411328624 notifier 6327 bl.length()=879 2024-09-14T11:02:47.164 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.165+0000 7f4a0a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20 info.flags=0x17 2024-09-14T11:02:47.164 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.165+0000 7f4a0a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20 to cache LRU end 2024-09-14T11:02:47.164 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.165+0000 7f4a0a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:02:47.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.166+0000 7f4b2de87800 20 handle_bi_update(): bucket=:error-at-init-index[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20]): orig_sources= new_sources= 2024-09-14T11:02:47.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.166+0000 7f4b2de87800 20 handle_bi_update(): bucket=:error-at-init-index[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20]): potential sources added=[] removed=[] 2024-09-14T11:02:47.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.166+0000 7f4b2de87800 20 handle_bi_update(): bucket=:error-at-init-index[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20]): orig_dests= new_dests= 2024-09-14T11:02:47.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.166+0000 7f4b2de87800 20 handle_bi_update(): bucket=:error-at-init-index[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20]): potential dests added=[] removed=[] 2024-09-14T11:02:47.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.168+0000 7f4b2de87800 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-14T11:02:47.168 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.169+0000 7f49e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:02:47.170 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.172+0000 7f4b2de87800 20 remove_watcher() i=0 2024-09-14T11:02:47.170 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.172+0000 7f4b2de87800 2 removed watcher, disabling cache 2024-09-14T11:02:47.171 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.173+0000 7f4b2de87800 20 remove_watcher() i=1 2024-09-14T11:02:47.172 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.174+0000 7f4b2de87800 20 remove_watcher() i=2 2024-09-14T11:02:47.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.175+0000 7f4b2de87800 20 remove_watcher() i=3 2024-09-14T11:02:47.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.176+0000 7f4b2de87800 20 remove_watcher() i=4 2024-09-14T11:02:47.175 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.177+0000 7f4b2de87800 20 remove_watcher() i=5 2024-09-14T11:02:47.176 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.178+0000 7f4b2de87800 20 remove_watcher() i=6 2024-09-14T11:02:47.177 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.179+0000 7f4b2de87800 20 remove_watcher() i=7 2024-09-14T11:02:47.189 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:02:47.218 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:02:47.218 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:02:47.255 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.256+0000 7f2d94f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:02:47.257 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.258+0000 7f2d94f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:47.257 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.258+0000 7f2d94f2a800 20 realm 2024-09-14T11:02:47.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.258+0000 7f2d94f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:02:47.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.258+0000 7f2d94f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:47.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.258+0000 7f2d94f2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:02:47.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.258+0000 7f2d94f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:02:47.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.258+0000 7f2d94f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:47.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.258+0000 7f2d94f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:02:47.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.259+0000 7f2d94f2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:47.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.259+0000 7f2d94f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:02:47.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.260+0000 7f2d94f2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:02:47.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.260+0000 7f2d94f2a800 20 searching for the correct realm 2024-09-14T11:02:47.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.262+0000 7f2d884ac640 0 -- 172.21.15.97:0/28460632 >> [v2:172.21.15.97:6816/4093696477,v1:172.21.15.97:6817/4093696477] conn(0x55848b2a77a0 msgr2=0x55848b2a9b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:02:47.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.265+0000 7f2d884ac640 0 -- 172.21.15.97:0/28460632 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f2d800ad3b0 msgr2=0x7f2d800a7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:02:47.470 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.471+0000 7f2d94f2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:02:47.471 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.471+0000 7f2d94f2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:02:47.471 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.471+0000 7f2d94f2a800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:02:47.471 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.471+0000 7f2d94f2a800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:02:47.471 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.471+0000 7f2d94f2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:02:47.471 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.471+0000 7f2d94f2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:02:47.471 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.471+0000 7f2d94f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:02:47.471 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.472+0000 7f2d94f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:47.471 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.472+0000 7f2d94f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:02:47.471 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.472+0000 7f2d94f2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:47.471 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.472+0000 7f2d94f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:02:47.472 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.472+0000 7f2d94f2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:02:47.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.472+0000 7f2d94f2a800 20 zone default found 2024-09-14T11:02:47.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.472+0000 7f2d94f2a800 4 Realm: () 2024-09-14T11:02:47.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.472+0000 7f2d94f2a800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:02:47.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.472+0000 7f2d94f2a800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:02:47.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.472+0000 7f2d94f2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:02:47.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.472+0000 7f2d94f2a800 20 zonegroup default 2024-09-14T11:02:47.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.472+0000 7f2d94f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:02:47.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.473+0000 7f2d94f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:47.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.473+0000 7f2d94f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:02:47.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.473+0000 7f2d94f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:47.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.473+0000 7f2d94f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:02:47.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.473+0000 7f2d94f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:47.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.473+0000 7f2d94f2a800 20 started sync module instance, tier type = 2024-09-14T11:02:47.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.473+0000 7f2d94f2a800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:02:47.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.482+0000 7f2d94f2a800 20 add_watcher() i=0 2024-09-14T11:02:47.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.482+0000 7f2d94f2a800 20 add_watcher() i=1 2024-09-14T11:02:47.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.482+0000 7f2d94f2a800 20 add_watcher() i=2 2024-09-14T11:02:47.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.482+0000 7f2d94f2a800 20 add_watcher() i=3 2024-09-14T11:02:47.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.482+0000 7f2d94f2a800 20 add_watcher() i=4 2024-09-14T11:02:47.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.482+0000 7f2d94f2a800 20 add_watcher() i=5 2024-09-14T11:02:47.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.482+0000 7f2d94f2a800 20 add_watcher() i=6 2024-09-14T11:02:47.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.483+0000 7f2d94f2a800 20 add_watcher() i=7 2024-09-14T11:02:47.482 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.483+0000 7f2d94f2a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:02:47.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.484+0000 7f2c46fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:02:47.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.485+0000 7f2d94f2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:02:47.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.485+0000 7f2d94f2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:02:47.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.485+0000 7f2d94f2a800 5 note: GC not initialized 2024-09-14T11:02:47.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.485+0000 7f2c45fe3640 20 reqs_thread_entry: start 2024-09-14T11:02:47.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.485+0000 7f2d94f2a800 20 init_complete bucket index max shards: 11 2024-09-14T11:02:47.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.485+0000 7f2d94f2a800 20 Filter name: none 2024-09-14T11:02:47.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.485+0000 7f2bb77fe640 20 reqs_thread_entry: start 2024-09-14T11:02:47.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.485+0000 7f2d94f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:02:47.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.486+0000 7f2d94f2a800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:02:47.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.486+0000 7f2d94f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:02:47.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.486+0000 7f2d94f2a800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:02:47.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.486+0000 7f2d94f2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:02:47.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.486+0000 7f2d94f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:02:47.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.487+0000 7f2d94f2a800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:02:47.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.487+0000 7f2d94f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:02:47.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.487+0000 7f2d94f2a800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:02:47.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.487+0000 7f2d94f2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:02:47.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.489+0000 7f2c46fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:02:47.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.491+0000 7f2d94f2a800 20 remove_watcher() i=0 2024-09-14T11:02:47.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.491+0000 7f2d94f2a800 2 removed watcher, disabling cache 2024-09-14T11:02:47.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.492+0000 7f2d94f2a800 20 remove_watcher() i=1 2024-09-14T11:02:47.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.493+0000 7f2d94f2a800 20 remove_watcher() i=2 2024-09-14T11:02:47.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.494+0000 7f2d94f2a800 20 remove_watcher() i=3 2024-09-14T11:02:47.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.494+0000 7f2d94f2a800 20 remove_watcher() i=4 2024-09-14T11:02:47.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.495+0000 7f2d94f2a800 20 remove_watcher() i=5 2024-09-14T11:02:47.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.496+0000 7f2d94f2a800 20 remove_watcher() i=6 2024-09-14T11:02:47.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.497+0000 7f2d94f2a800 20 remove_watcher() i=7 2024-09-14T11:02:47.506 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:47.506 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:02:47.507 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-init-index id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:02:47.507 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:47.580 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: reshard bucket with abort at init_index 2024-09-14T11:02:47.580 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:47.781 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-14T11:02:47.809 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:02:47.809 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:02:47.845 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.846+0000 7f62c2746800 20 rados->read ofs=0 len=0 2024-09-14T11:02:47.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.849+0000 7f62c2746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:47.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.849+0000 7f62c2746800 20 realm 2024-09-14T11:02:47.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.849+0000 7f62c2746800 20 rados->read ofs=0 len=0 2024-09-14T11:02:47.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.849+0000 7f62c2746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:47.848 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.849+0000 7f62c2746800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:02:47.848 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.849+0000 7f62c2746800 20 rados->read ofs=0 len=0 2024-09-14T11:02:47.848 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.849+0000 7f62c2746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:47.848 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.849+0000 7f62c2746800 20 rados->read ofs=0 len=0 2024-09-14T11:02:47.848 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.850+0000 7f62c2746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:47.848 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.850+0000 7f62c2746800 20 rados->read ofs=0 len=0 2024-09-14T11:02:47.849 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.850+0000 7f62c2746800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:02:47.849 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.850+0000 7f62c2746800 20 searching for the correct realm 2024-09-14T11:02:47.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:47.852+0000 7f62c0a38640 0 -- 172.21.15.97:0/1552002160 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f62b4091060 msgr2=0x7f62b40b8040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:02:48.057 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.058+0000 7f62bfa36640 0 -- 172.21.15.97:0/1552002160 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f62b0018920 msgr2=0x7f62b0040400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:02:48.063 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.064+0000 7f62c2746800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:02:48.063 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.064+0000 7f62c2746800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:02:48.063 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.064+0000 7f62c2746800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:02:48.063 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.064+0000 7f62c2746800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:02:48.063 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.064+0000 7f62c2746800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:02:48.063 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.064+0000 7f62c2746800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:02:48.063 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.064+0000 7f62c2746800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.063 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.064+0000 7f62c2746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:48.063 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.064+0000 7f62c2746800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.063 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.064+0000 7f62c2746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:48.063 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.064+0000 7f62c2746800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.065+0000 7f62c2746800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:02:48.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.065+0000 7f62c2746800 20 zone default found 2024-09-14T11:02:48.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.065+0000 7f62c2746800 4 Realm: () 2024-09-14T11:02:48.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.065+0000 7f62c2746800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:02:48.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.065+0000 7f62c2746800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:02:48.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.065+0000 7f62c2746800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:02:48.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.065+0000 7f62c2746800 20 zonegroup default 2024-09-14T11:02:48.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.065+0000 7f62c2746800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.065+0000 7f62c2746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:48.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.065+0000 7f62c2746800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.065+0000 7f62c2746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:48.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.065+0000 7f62c2746800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.066 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.065+0000 7f62c2746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:48.066 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.065+0000 7f62c2746800 20 started sync module instance, tier type = 2024-09-14T11:02:48.066 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.065+0000 7f62c2746800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:02:48.072 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.074+0000 7f62c2746800 20 add_watcher() i=0 2024-09-14T11:02:48.072 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.074+0000 7f62c2746800 20 add_watcher() i=1 2024-09-14T11:02:48.072 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.074+0000 7f62c2746800 20 add_watcher() i=2 2024-09-14T11:02:48.072 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.074+0000 7f62c2746800 20 add_watcher() i=3 2024-09-14T11:02:48.072 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.074+0000 7f62c2746800 20 add_watcher() i=4 2024-09-14T11:02:48.072 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.074+0000 7f62c2746800 20 add_watcher() i=5 2024-09-14T11:02:48.072 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.074+0000 7f62c2746800 20 add_watcher() i=6 2024-09-14T11:02:48.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.075+0000 7f62c2746800 20 add_watcher() i=7 2024-09-14T11:02:48.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.075+0000 7f62c2746800 2 all 8 watchers are set, enabling cache 2024-09-14T11:02:48.075 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.076+0000 7f6176fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:02:48.076 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.077+0000 7f62c2746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:02:48.076 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.077+0000 7f62c2746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:02:48.076 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.077+0000 7f62c2746800 5 note: GC not initialized 2024-09-14T11:02:48.076 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.077+0000 7f6175fdb640 20 reqs_thread_entry: start 2024-09-14T11:02:48.076 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.077+0000 7f62c2746800 20 init_complete bucket index max shards: 11 2024-09-14T11:02:48.076 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.077+0000 7f62c2746800 20 Filter name: none 2024-09-14T11:02:48.076 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.077+0000 7f60e77fe640 20 reqs_thread_entry: start 2024-09-14T11:02:48.076 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.077+0000 7f62c2746800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.077 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.078+0000 7f62c2746800 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:02:48.077 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.078+0000 7f62c2746800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.077 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.078+0000 7f62c2746800 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:02:48.077 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.078+0000 7f62c2746800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:02:48.077 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.078+0000 7f62c2746800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.077 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.079+0000 7f62c2746800 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:02:48.077 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.079+0000 7f62c2746800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.079+0000 7f62c2746800 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:02:48.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.079+0000 7f62c2746800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:02:48.079 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.081+0000 7f6176fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:02:48.081 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.083+0000 7f62c2746800 20 remove_watcher() i=0 2024-09-14T11:02:48.081 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.083+0000 7f62c2746800 2 removed watcher, disabling cache 2024-09-14T11:02:48.082 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.084+0000 7f62c2746800 20 remove_watcher() i=1 2024-09-14T11:02:48.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.085+0000 7f62c2746800 20 remove_watcher() i=2 2024-09-14T11:02:48.084 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.086+0000 7f62c2746800 20 remove_watcher() i=3 2024-09-14T11:02:48.085 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.087+0000 7f62c2746800 20 remove_watcher() i=4 2024-09-14T11:02:48.086 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.088+0000 7f62c2746800 20 remove_watcher() i=5 2024-09-14T11:02:48.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.089+0000 7f62c2746800 20 remove_watcher() i=6 2024-09-14T11:02:48.088 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.090+0000 7f62c2746800 20 remove_watcher() i=7 2024-09-14T11:02:48.099 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:48.099 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:02:48.099 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: abort-at-init-indext id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:02:48.099 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:48.100 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at init_index 2024-09-14T11:02:48.134 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:02:48.134 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:02:48.171 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.173+0000 7f3db652f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.174+0000 7f3db652f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:48.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.174+0000 7f3db652f800 20 realm 2024-09-14T11:02:48.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.174+0000 7f3db652f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.174+0000 7f3db652f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:48.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.174+0000 7f3db652f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:02:48.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.174+0000 7f3db652f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.175+0000 7f3db652f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:48.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.175+0000 7f3db652f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.175+0000 7f3db652f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:48.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.175+0000 7f3db652f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.176+0000 7f3db652f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:02:48.175 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.176+0000 7f3db652f800 20 searching for the correct realm 2024-09-14T11:02:48.176 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.178+0000 7f3db2a77640 0 -- 172.21.15.97:0/723309112 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f3da8040020 msgr2=0x7f3da8019920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:02:48.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.383+0000 7f3db1a75640 0 -- 172.21.15.97:0/723309112 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f3da4017070 msgr2=0x7f3da4027420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:02:48.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.387+0000 7f3db652f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:02:48.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.387+0000 7f3db652f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:02:48.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.387+0000 7f3db652f800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:02:48.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.387+0000 7f3db652f800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:02:48.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.387+0000 7f3db652f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:02:48.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.387+0000 7f3db652f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:02:48.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.387+0000 7f3db652f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.387+0000 7f3db652f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:48.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.387+0000 7f3db652f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.388+0000 7f3db652f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:48.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.388+0000 7f3db652f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.388+0000 7f3db652f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:02:48.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.388+0000 7f3db652f800 20 zone default found 2024-09-14T11:02:48.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.388+0000 7f3db652f800 4 Realm: () 2024-09-14T11:02:48.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.388+0000 7f3db652f800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:02:48.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.388+0000 7f3db652f800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:02:48.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.388+0000 7f3db652f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:02:48.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.388+0000 7f3db652f800 20 zonegroup default 2024-09-14T11:02:48.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.388+0000 7f3db652f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.388+0000 7f3db652f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:48.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.388+0000 7f3db652f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.389+0000 7f3db652f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:48.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.389+0000 7f3db652f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.389+0000 7f3db652f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:48.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.389+0000 7f3db652f800 20 started sync module instance, tier type = 2024-09-14T11:02:48.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.389+0000 7f3db652f800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:02:48.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.397+0000 7f3db652f800 20 add_watcher() i=0 2024-09-14T11:02:48.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.397+0000 7f3db652f800 20 add_watcher() i=1 2024-09-14T11:02:48.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.397+0000 7f3db652f800 20 add_watcher() i=2 2024-09-14T11:02:48.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.397+0000 7f3db652f800 20 add_watcher() i=3 2024-09-14T11:02:48.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.397+0000 7f3db652f800 20 add_watcher() i=4 2024-09-14T11:02:48.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.397+0000 7f3db652f800 20 add_watcher() i=5 2024-09-14T11:02:48.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.397+0000 7f3db652f800 20 add_watcher() i=6 2024-09-14T11:02:48.397 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.398+0000 7f3db652f800 20 add_watcher() i=7 2024-09-14T11:02:48.397 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.398+0000 7f3db652f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:02:48.400 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.400+0000 7f3c68fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:02:48.400 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.401+0000 7f3db652f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:02:48.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.401+0000 7f3db652f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:02:48.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.401+0000 7f3db652f800 5 note: GC not initialized 2024-09-14T11:02:48.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.401+0000 7f3be37fe640 20 reqs_thread_entry: start 2024-09-14T11:02:48.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.401+0000 7f3db652f800 20 init_complete bucket index max shards: 11 2024-09-14T11:02:48.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.401+0000 7f3db652f800 20 Filter name: none 2024-09-14T11:02:48.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.401+0000 7f3be17fa640 20 reqs_thread_entry: start 2024-09-14T11:02:48.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.401+0000 7f3db652f800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:02:48.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.401+0000 7f3db652f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.402+0000 7f3db652f800 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:02:48.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.402+0000 7f3db652f800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:02:48.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.402+0000 7f3db652f800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:02:48.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.402+0000 7f3db652f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21 : miss 2024-09-14T11:02:48.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.402+0000 7f3db652f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.402+0000 7f3db652f800 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:02:48.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.402+0000 7f3db652f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21 info.flags=0x17 2024-09-14T11:02:48.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.402+0000 7f3db652f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21 to cache LRU end 2024-09-14T11:02:48.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.402+0000 7f3db652f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:02:48.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.402+0000 7f3db652f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:02:48.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.402+0000 7f3db652f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21 2024-09-14T11:02:48.403 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3db652f800 time 2024-09-14T11:02:48.404944+0000 2024-09-14T11:02:48.403 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:02:48.403 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:02:48.403 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3db7d8c76a] 2024-09-14T11:02:48.403 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f3db7d8c928] 2024-09-14T11:02:48.403 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559316e040b1] 2024-09-14T11:02:48.404 INFO:tasks.workunit.client.0.smithi097.stderr: 4: radosgw-admin(+0xd882d4) [0x5593173172d4] 2024-09-14T11:02:48.404 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559316e13efd] 2024-09-14T11:02:48.404 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-14T11:02:48.404 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3db6a29590] 2024-09-14T11:02:48.404 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-14T11:02:48.404 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-14T11:02:48.404 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.404+0000 7f3db652f800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3db652f800 time 2024-09-14T11:02:48.404944+0000 2024-09-14T11:02:48.404 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:02:48.404 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:48.404 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:02:48.404 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3db7d8c76a] 2024-09-14T11:02:48.404 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f3db7d8c928] 2024-09-14T11:02:48.404 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559316e040b1] 2024-09-14T11:02:48.405 INFO:tasks.workunit.client.0.smithi097.stderr: 4: radosgw-admin(+0xd882d4) [0x5593173172d4] 2024-09-14T11:02:48.405 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559316e13efd] 2024-09-14T11:02:48.405 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-14T11:02:48.405 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3db6a29590] 2024-09-14T11:02:48.405 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-14T11:02:48.405 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-14T11:02:48.405 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:48.405 INFO:tasks.workunit.client.0.smithi097.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:02:48.405 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f3db652f800 thread_name:radosgw-admin 2024-09-14T11:02:48.424 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:02:48.424 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3db6a3e6f0] 2024-09-14T11:02:48.424 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3db6a8b99c] 2024-09-14T11:02:48.424 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-14T11:02:48.424 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-14T11:02:48.425 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3db7d8c7c4] 2024-09-14T11:02:48.425 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f3db7d8c928] 2024-09-14T11:02:48.425 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559316e040b1] 2024-09-14T11:02:48.425 INFO:tasks.workunit.client.0.smithi097.stderr: 8: radosgw-admin(+0xd882d4) [0x5593173172d4] 2024-09-14T11:02:48.425 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559316e13efd] 2024-09-14T11:02:48.425 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-14T11:02:48.425 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3db6a29590] 2024-09-14T11:02:48.425 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-14T11:02:48.425 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-14T11:02:48.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.405+0000 7f3db652f800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:02:48.425 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f3db652f800 thread_name:radosgw-admin 2024-09-14T11:02:48.425 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:48.425 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:02:48.425 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3db6a3e6f0] 2024-09-14T11:02:48.426 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3db6a8b99c] 2024-09-14T11:02:48.426 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-14T11:02:48.426 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-14T11:02:48.426 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3db7d8c7c4] 2024-09-14T11:02:48.426 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f3db7d8c928] 2024-09-14T11:02:48.426 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559316e040b1] 2024-09-14T11:02:48.426 INFO:tasks.workunit.client.0.smithi097.stderr: 8: radosgw-admin(+0xd882d4) [0x5593173172d4] 2024-09-14T11:02:48.426 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559316e13efd] 2024-09-14T11:02:48.426 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-14T11:02:48.426 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3db6a29590] 2024-09-14T11:02:48.426 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-14T11:02:48.426 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-14T11:02:48.426 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:02:48.427 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:48.427 INFO:tasks.workunit.client.0.smithi097.stderr:--- begin dump of recent events --- 2024-09-14T11:02:48.427 INFO:tasks.workunit.client.0.smithi097.stderr: -499> 2024-09-14T11:02:48.155+0000 7f3db2a77640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:02:48.427 INFO:tasks.workunit.client.0.smithi097.stderr: -498> 2024-09-14T11:02:48.155+0000 7f3db2a77640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:02:48.427 INFO:tasks.workunit.client.0.smithi097.stderr: -497> 2024-09-14T11:02:48.155+0000 7f3db2276640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:02:48.427 INFO:tasks.workunit.client.0.smithi097.stderr: -496> 2024-09-14T11:02:48.155+0000 7f3db2276640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:02:48.427 INFO:tasks.workunit.client.0.smithi097.stderr: -495> 2024-09-14T11:02:48.155+0000 7f3db2276640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:02:48.427 INFO:tasks.workunit.client.0.smithi097.stderr: -494> 2024-09-14T11:02:48.155+0000 7f3db1a75640 10 monclient(hunting): handle_auth_done global_id 6369 payload 274 2024-09-14T11:02:48.427 INFO:tasks.workunit.client.0.smithi097.stderr: -493> 2024-09-14T11:02:48.155+0000 7f3db1a75640 10 monclient: _finish_hunting 0 2024-09-14T11:02:48.427 INFO:tasks.workunit.client.0.smithi097.stderr: -492> 2024-09-14T11:02:48.155+0000 7f3db1a75640 1 monclient: found mon.noname-a 2024-09-14T11:02:48.427 INFO:tasks.workunit.client.0.smithi097.stderr: -491> 2024-09-14T11:02:48.155+0000 7f3db1a75640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-14T11:02:48.427 INFO:tasks.workunit.client.0.smithi097.stderr: -490> 2024-09-14T11:02:48.155+0000 7f3ca0608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:02:48.427 INFO:tasks.workunit.client.0.smithi097.stderr: -489> 2024-09-14T11:02:48.155+0000 7f3ca0608640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:02:48.428 INFO:tasks.workunit.client.0.smithi097.stderr: -488> 2024-09-14T11:02:48.155+0000 7f3ca0608640 10 monclient: dump: 2024-09-14T11:02:48.428 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:02:48.428 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:02:48.428 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:02:48.428 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:02:48.428 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:02:48.428 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:02:48.428 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:02:48.428 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:02:48.428 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:02:48.429 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:48.429 INFO:tasks.workunit.client.0.smithi097.stderr: -487> 2024-09-14T11:02:48.155+0000 7f3ca0608640 10 monclient: _finish_auth 0 2024-09-14T11:02:48.429 INFO:tasks.workunit.client.0.smithi097.stderr: -486> 2024-09-14T11:02:48.155+0000 7f3ca0608640 10 monclient: _check_auth_tickets 2024-09-14T11:02:48.429 INFO:tasks.workunit.client.0.smithi097.stderr: -485> 2024-09-14T11:02:48.155+0000 7f3ca0608640 10 monclient: handle_config config(0 keys) 2024-09-14T11:02:48.429 INFO:tasks.workunit.client.0.smithi097.stderr: -484> 2024-09-14T11:02:48.155+0000 7f3db652f800 5 monclient: authenticate success, global_id 6369 2024-09-14T11:02:48.429 INFO:tasks.workunit.client.0.smithi097.stderr: -483> 2024-09-14T11:02:48.155+0000 7f3db652f800 10 monclient: get_monmap_and_config success 2024-09-14T11:02:48.429 INFO:tasks.workunit.client.0.smithi097.stderr: -482> 2024-09-14T11:02:48.155+0000 7f3db652f800 4 set_mon_vals no callback set 2024-09-14T11:02:48.429 INFO:tasks.workunit.client.0.smithi097.stderr: -481> 2024-09-14T11:02:48.155+0000 7f3ca0608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:02:48.429 INFO:tasks.workunit.client.0.smithi097.stderr: -480> 2024-09-14T11:02:48.155+0000 7f3ca0608640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:02:48.429 INFO:tasks.workunit.client.0.smithi097.stderr: -479> 2024-09-14T11:02:48.155+0000 7f3ca0608640 10 monclient: dump: 2024-09-14T11:02:48.429 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:02:48.429 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:02:48.429 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:02:48.429 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:02:48.430 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:02:48.430 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:02:48.430 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:02:48.430 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:02:48.430 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:02:48.430 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:48.430 INFO:tasks.workunit.client.0.smithi097.stderr: -478> 2024-09-14T11:02:48.156+0000 7f3db652f800 10 monclient: shutdown 2024-09-14T11:02:48.430 INFO:tasks.workunit.client.0.smithi097.stderr: -477> 2024-09-14T11:02:48.156+0000 7f3db652f800 5 asok(0x559317d31270) unregister_commands rotate-key 2024-09-14T11:02:48.430 INFO:tasks.workunit.client.0.smithi097.stderr: -476> 2024-09-14T11:02:48.156+0000 7f3db652f800 10 monclient: build_initial_monmap 2024-09-14T11:02:48.430 INFO:tasks.workunit.client.0.smithi097.stderr: -475> 2024-09-14T11:02:48.156+0000 7f3db652f800 1 build_initial for_mkfs: 0 2024-09-14T11:02:48.430 INFO:tasks.workunit.client.0.smithi097.stderr: -474> 2024-09-14T11:02:48.156+0000 7f3db652f800 10 monclient: monmap: 2024-09-14T11:02:48.430 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:02:48.430 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:02:48.430 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:02:48.431 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:02:48.431 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:02:48.431 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:02:48.431 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:02:48.431 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:02:48.431 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:02:48.431 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:48.431 INFO:tasks.workunit.client.0.smithi097.stderr: -473> 2024-09-14T11:02:48.156+0000 7f3db652f800 5 AuthRegistry(0x559317f59290) adding auth protocol: cephx 2024-09-14T11:02:48.431 INFO:tasks.workunit.client.0.smithi097.stderr: -472> 2024-09-14T11:02:48.156+0000 7f3db652f800 5 AuthRegistry(0x559317f59290) adding auth protocol: cephx 2024-09-14T11:02:48.431 INFO:tasks.workunit.client.0.smithi097.stderr: -471> 2024-09-14T11:02:48.156+0000 7f3db652f800 5 AuthRegistry(0x559317f59290) adding auth protocol: cephx 2024-09-14T11:02:48.431 INFO:tasks.workunit.client.0.smithi097.stderr: -470> 2024-09-14T11:02:48.156+0000 7f3db652f800 5 AuthRegistry(0x559317f59290) adding con mode: secure 2024-09-14T11:02:48.431 INFO:tasks.workunit.client.0.smithi097.stderr: -469> 2024-09-14T11:02:48.156+0000 7f3db652f800 5 AuthRegistry(0x559317f59290) adding con mode: crc 2024-09-14T11:02:48.431 INFO:tasks.workunit.client.0.smithi097.stderr: -468> 2024-09-14T11:02:48.156+0000 7f3db652f800 5 AuthRegistry(0x559317f59290) adding con mode: secure 2024-09-14T11:02:48.431 INFO:tasks.workunit.client.0.smithi097.stderr: -467> 2024-09-14T11:02:48.156+0000 7f3db652f800 5 AuthRegistry(0x559317f59290) adding con mode: crc 2024-09-14T11:02:48.431 INFO:tasks.workunit.client.0.smithi097.stderr: -466> 2024-09-14T11:02:48.156+0000 7f3db652f800 5 AuthRegistry(0x559317f59290) adding con mode: secure 2024-09-14T11:02:48.432 INFO:tasks.workunit.client.0.smithi097.stderr: -465> 2024-09-14T11:02:48.156+0000 7f3db652f800 5 AuthRegistry(0x559317f59290) adding con mode: crc 2024-09-14T11:02:48.432 INFO:tasks.workunit.client.0.smithi097.stderr: -464> 2024-09-14T11:02:48.156+0000 7f3db652f800 5 AuthRegistry(0x559317f59290) adding con mode: crc 2024-09-14T11:02:48.432 INFO:tasks.workunit.client.0.smithi097.stderr: -463> 2024-09-14T11:02:48.156+0000 7f3db652f800 5 AuthRegistry(0x559317f59290) adding con mode: secure 2024-09-14T11:02:48.432 INFO:tasks.workunit.client.0.smithi097.stderr: -462> 2024-09-14T11:02:48.156+0000 7f3db652f800 5 AuthRegistry(0x559317f59290) adding con mode: crc 2024-09-14T11:02:48.432 INFO:tasks.workunit.client.0.smithi097.stderr: -461> 2024-09-14T11:02:48.156+0000 7f3db652f800 5 AuthRegistry(0x559317f59290) adding con mode: secure 2024-09-14T11:02:48.432 INFO:tasks.workunit.client.0.smithi097.stderr: -460> 2024-09-14T11:02:48.156+0000 7f3db652f800 5 AuthRegistry(0x559317f59290) adding con mode: crc 2024-09-14T11:02:48.432 INFO:tasks.workunit.client.0.smithi097.stderr: -459> 2024-09-14T11:02:48.156+0000 7f3db652f800 5 AuthRegistry(0x559317f59290) adding con mode: secure 2024-09-14T11:02:48.432 INFO:tasks.workunit.client.0.smithi097.stderr: -458> 2024-09-14T11:02:48.156+0000 7f3db652f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:02:48.432 INFO:tasks.workunit.client.0.smithi097.stderr: -457> 2024-09-14T11:02:48.156+0000 7f3db652f800 1 librados: starting msgr at 2024-09-14T11:02:48.432 INFO:tasks.workunit.client.0.smithi097.stderr: -456> 2024-09-14T11:02:48.156+0000 7f3db652f800 1 librados: starting objecter 2024-09-14T11:02:48.432 INFO:tasks.workunit.client.0.smithi097.stderr: -455> 2024-09-14T11:02:48.157+0000 7f3db652f800 5 asok(0x559317d31270) register_command objecter_requests hook 0x559317f5b4c0 2024-09-14T11:02:48.432 INFO:tasks.workunit.client.0.smithi097.stderr: -454> 2024-09-14T11:02:48.157+0000 7f3db652f800 1 librados: setting wanted keys 2024-09-14T11:02:48.432 INFO:tasks.workunit.client.0.smithi097.stderr: -453> 2024-09-14T11:02:48.157+0000 7f3db652f800 1 librados: calling monclient init 2024-09-14T11:02:48.433 INFO:tasks.workunit.client.0.smithi097.stderr: -452> 2024-09-14T11:02:48.157+0000 7f3db652f800 10 monclient: init 2024-09-14T11:02:48.433 INFO:tasks.workunit.client.0.smithi097.stderr: -451> 2024-09-14T11:02:48.157+0000 7f3db652f800 5 AuthRegistry(0x559317f535e0) adding auth protocol: cephx 2024-09-14T11:02:48.433 INFO:tasks.workunit.client.0.smithi097.stderr: -450> 2024-09-14T11:02:48.157+0000 7f3db652f800 5 AuthRegistry(0x559317f535e0) adding auth protocol: cephx 2024-09-14T11:02:48.433 INFO:tasks.workunit.client.0.smithi097.stderr: -449> 2024-09-14T11:02:48.157+0000 7f3db652f800 5 AuthRegistry(0x559317f535e0) adding auth protocol: cephx 2024-09-14T11:02:48.433 INFO:tasks.workunit.client.0.smithi097.stderr: -448> 2024-09-14T11:02:48.157+0000 7f3db652f800 5 AuthRegistry(0x559317f535e0) adding con mode: secure 2024-09-14T11:02:48.433 INFO:tasks.workunit.client.0.smithi097.stderr: -447> 2024-09-14T11:02:48.157+0000 7f3db652f800 5 AuthRegistry(0x559317f535e0) adding con mode: crc 2024-09-14T11:02:48.433 INFO:tasks.workunit.client.0.smithi097.stderr: -446> 2024-09-14T11:02:48.157+0000 7f3db652f800 5 AuthRegistry(0x559317f535e0) adding con mode: secure 2024-09-14T11:02:48.433 INFO:tasks.workunit.client.0.smithi097.stderr: -445> 2024-09-14T11:02:48.157+0000 7f3db652f800 5 AuthRegistry(0x559317f535e0) adding con mode: crc 2024-09-14T11:02:48.433 INFO:tasks.workunit.client.0.smithi097.stderr: -444> 2024-09-14T11:02:48.157+0000 7f3db652f800 5 AuthRegistry(0x559317f535e0) adding con mode: secure 2024-09-14T11:02:48.433 INFO:tasks.workunit.client.0.smithi097.stderr: -443> 2024-09-14T11:02:48.157+0000 7f3db652f800 5 AuthRegistry(0x559317f535e0) adding con mode: crc 2024-09-14T11:02:48.433 INFO:tasks.workunit.client.0.smithi097.stderr: -442> 2024-09-14T11:02:48.157+0000 7f3db652f800 5 AuthRegistry(0x559317f535e0) adding con mode: crc 2024-09-14T11:02:48.433 INFO:tasks.workunit.client.0.smithi097.stderr: -441> 2024-09-14T11:02:48.157+0000 7f3db652f800 5 AuthRegistry(0x559317f535e0) adding con mode: secure 2024-09-14T11:02:48.433 INFO:tasks.workunit.client.0.smithi097.stderr: -440> 2024-09-14T11:02:48.157+0000 7f3db652f800 5 AuthRegistry(0x559317f535e0) adding con mode: crc 2024-09-14T11:02:48.433 INFO:tasks.workunit.client.0.smithi097.stderr: -439> 2024-09-14T11:02:48.157+0000 7f3db652f800 5 AuthRegistry(0x559317f535e0) adding con mode: secure 2024-09-14T11:02:48.434 INFO:tasks.workunit.client.0.smithi097.stderr: -438> 2024-09-14T11:02:48.157+0000 7f3db652f800 5 AuthRegistry(0x559317f535e0) adding con mode: crc 2024-09-14T11:02:48.434 INFO:tasks.workunit.client.0.smithi097.stderr: -437> 2024-09-14T11:02:48.157+0000 7f3db652f800 5 AuthRegistry(0x559317f535e0) adding con mode: secure 2024-09-14T11:02:48.434 INFO:tasks.workunit.client.0.smithi097.stderr: -436> 2024-09-14T11:02:48.157+0000 7f3db652f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:02:48.434 INFO:tasks.workunit.client.0.smithi097.stderr: -435> 2024-09-14T11:02:48.157+0000 7f3db652f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:02:48.434 INFO:tasks.workunit.client.0.smithi097.stderr: -434> 2024-09-14T11:02:48.157+0000 7f3db652f800 5 asok(0x559317d31270) register_command rotate-key hook 0x559317f53728 2024-09-14T11:02:48.434 INFO:tasks.workunit.client.0.smithi097.stderr: -433> 2024-09-14T11:02:48.157+0000 7f3db652f800 10 monclient: _reopen_session rank -1 2024-09-14T11:02:48.434 INFO:tasks.workunit.client.0.smithi097.stderr: -432> 2024-09-14T11:02:48.157+0000 7f3db652f800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:02:48.434 INFO:tasks.workunit.client.0.smithi097.stderr: -431> 2024-09-14T11:02:48.157+0000 7f3db652f800 10 monclient(hunting): picked mon.noname-a con 0x559317e07fc0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:02:48.434 INFO:tasks.workunit.client.0.smithi097.stderr: -430> 2024-09-14T11:02:48.157+0000 7f3db652f800 10 monclient(hunting): picked mon.noname-b con 0x559317e966a0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:02:48.434 INFO:tasks.workunit.client.0.smithi097.stderr: -429> 2024-09-14T11:02:48.157+0000 7f3db652f800 10 monclient(hunting): picked mon.noname-c con 0x559317e9cdf0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:02:48.434 INFO:tasks.workunit.client.0.smithi097.stderr: -428> 2024-09-14T11:02:48.157+0000 7f3db652f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:02:48.434 INFO:tasks.workunit.client.0.smithi097.stderr: -427> 2024-09-14T11:02:48.157+0000 7f3db652f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:02:48.434 INFO:tasks.workunit.client.0.smithi097.stderr: -426> 2024-09-14T11:02:48.157+0000 7f3db652f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:02:48.434 INFO:tasks.workunit.client.0.smithi097.stderr: -425> 2024-09-14T11:02:48.157+0000 7f3db652f800 10 monclient(hunting): _renew_subs 2024-09-14T11:02:48.435 INFO:tasks.workunit.client.0.smithi097.stderr: -424> 2024-09-14T11:02:48.157+0000 7f3db652f800 10 monclient(hunting): authenticate will time out at 1849.810666s 2024-09-14T11:02:48.435 INFO:tasks.workunit.client.0.smithi097.stderr: -423> 2024-09-14T11:02:48.157+0000 7f3db2276640 10 monclient(hunting): get_auth_request con 0x559317e07fc0 auth_method 0 2024-09-14T11:02:48.435 INFO:tasks.workunit.client.0.smithi097.stderr: -422> 2024-09-14T11:02:48.157+0000 7f3db2276640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:02:48.435 INFO:tasks.workunit.client.0.smithi097.stderr: -421> 2024-09-14T11:02:48.157+0000 7f3db2276640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:02:48.435 INFO:tasks.workunit.client.0.smithi097.stderr: -420> 2024-09-14T11:02:48.157+0000 7f3db2276640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:02:48.435 INFO:tasks.workunit.client.0.smithi097.stderr: -419> 2024-09-14T11:02:48.157+0000 7f3db2a77640 10 monclient(hunting): get_auth_request con 0x559317e9cdf0 auth_method 0 2024-09-14T11:02:48.435 INFO:tasks.workunit.client.0.smithi097.stderr: -418> 2024-09-14T11:02:48.157+0000 7f3db2a77640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:02:48.435 INFO:tasks.workunit.client.0.smithi097.stderr: -417> 2024-09-14T11:02:48.157+0000 7f3db2a77640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:02:48.435 INFO:tasks.workunit.client.0.smithi097.stderr: -416> 2024-09-14T11:02:48.157+0000 7f3db2a77640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:02:48.435 INFO:tasks.workunit.client.0.smithi097.stderr: -415> 2024-09-14T11:02:48.157+0000 7f3db2276640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:02:48.436 INFO:tasks.workunit.client.0.smithi097.stderr: -414> 2024-09-14T11:02:48.157+0000 7f3db2276640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:02:48.436 INFO:tasks.workunit.client.0.smithi097.stderr: -413> 2024-09-14T11:02:48.157+0000 7f3db2276640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:02:48.436 INFO:tasks.workunit.client.0.smithi097.stderr: -412> 2024-09-14T11:02:48.157+0000 7f3db2a77640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:02:48.436 INFO:tasks.workunit.client.0.smithi097.stderr: -411> 2024-09-14T11:02:48.157+0000 7f3db2a77640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:02:48.436 INFO:tasks.workunit.client.0.smithi097.stderr: -410> 2024-09-14T11:02:48.157+0000 7f3db2a77640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:02:48.436 INFO:tasks.workunit.client.0.smithi097.stderr: -409> 2024-09-14T11:02:48.157+0000 7f3db1a75640 10 monclient(hunting): get_auth_request con 0x559317e966a0 auth_method 0 2024-09-14T11:02:48.436 INFO:tasks.workunit.client.0.smithi097.stderr: -408> 2024-09-14T11:02:48.157+0000 7f3db1a75640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:02:48.436 INFO:tasks.workunit.client.0.smithi097.stderr: -407> 2024-09-14T11:02:48.157+0000 7f3db1a75640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:02:48.436 INFO:tasks.workunit.client.0.smithi097.stderr: -406> 2024-09-14T11:02:48.157+0000 7f3db1a75640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:02:48.436 INFO:tasks.workunit.client.0.smithi097.stderr: -405> 2024-09-14T11:02:48.157+0000 7f3db1a75640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:02:48.436 INFO:tasks.workunit.client.0.smithi097.stderr: -404> 2024-09-14T11:02:48.157+0000 7f3db1a75640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:02:48.436 INFO:tasks.workunit.client.0.smithi097.stderr: -403> 2024-09-14T11:02:48.157+0000 7f3db1a75640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:02:48.436 INFO:tasks.workunit.client.0.smithi097.stderr: -402> 2024-09-14T11:02:48.157+0000 7f3db2a77640 10 monclient(hunting): handle_auth_done global_id 6059 payload 824 2024-09-14T11:02:48.437 INFO:tasks.workunit.client.0.smithi097.stderr: -401> 2024-09-14T11:02:48.158+0000 7f3db2a77640 10 monclient: _finish_hunting 0 2024-09-14T11:02:48.437 INFO:tasks.workunit.client.0.smithi097.stderr: -400> 2024-09-14T11:02:48.158+0000 7f3db2a77640 1 monclient: found mon.noname-c 2024-09-14T11:02:48.437 INFO:tasks.workunit.client.0.smithi097.stderr: -399> 2024-09-14T11:02:48.158+0000 7f3db2a77640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:02:48.437 INFO:tasks.workunit.client.0.smithi097.stderr: -398> 2024-09-14T11:02:48.158+0000 7f3c9ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:02:48.437 INFO:tasks.workunit.client.0.smithi097.stderr: -397> 2024-09-14T11:02:48.158+0000 7f3c9ee05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:02:48.437 INFO:tasks.workunit.client.0.smithi097.stderr: -396> 2024-09-14T11:02:48.158+0000 7f3c9ee05640 10 monclient: dump: 2024-09-14T11:02:48.437 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:02:48.437 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:02:48.437 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:02:48.437 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:02:48.437 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:02:48.437 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:02:48.437 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:02:48.438 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:02:48.438 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:02:48.438 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:48.438 INFO:tasks.workunit.client.0.smithi097.stderr: -395> 2024-09-14T11:02:48.158+0000 7f3c9ee05640 10 monclient: _finish_auth 0 2024-09-14T11:02:48.438 INFO:tasks.workunit.client.0.smithi097.stderr: -394> 2024-09-14T11:02:48.158+0000 7f3c9ee05640 10 monclient: _check_auth_tickets 2024-09-14T11:02:48.438 INFO:tasks.workunit.client.0.smithi097.stderr: -393> 2024-09-14T11:02:48.158+0000 7f3c9ee05640 10 monclient: handle_config config(0 keys) 2024-09-14T11:02:48.438 INFO:tasks.workunit.client.0.smithi097.stderr: -392> 2024-09-14T11:02:48.158+0000 7f3c9ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:02:48.438 INFO:tasks.workunit.client.0.smithi097.stderr: -391> 2024-09-14T11:02:48.158+0000 7f3c9ee05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:02:48.438 INFO:tasks.workunit.client.0.smithi097.stderr: -390> 2024-09-14T11:02:48.158+0000 7f3c9ee05640 10 monclient: dump: 2024-09-14T11:02:48.438 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:02:48.438 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:02:48.438 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:02:48.438 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:02:48.438 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:02:48.439 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:02:48.439 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:02:48.439 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:02:48.439 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:02:48.439 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:48.439 INFO:tasks.workunit.client.0.smithi097.stderr: -389> 2024-09-14T11:02:48.158+0000 7f3db652f800 5 monclient: authenticate success, global_id 6059 2024-09-14T11:02:48.439 INFO:tasks.workunit.client.0.smithi097.stderr: -388> 2024-09-14T11:02:48.158+0000 7f3db652f800 10 monclient: _renew_subs 2024-09-14T11:02:48.439 INFO:tasks.workunit.client.0.smithi097.stderr: -387> 2024-09-14T11:02:48.158+0000 7f3db652f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:02:48.439 INFO:tasks.workunit.client.0.smithi097.stderr: -386> 2024-09-14T11:02:48.158+0000 7f3ca0608640 4 set_mon_vals no callback set 2024-09-14T11:02:48.439 INFO:tasks.workunit.client.0.smithi097.stderr: -385> 2024-09-14T11:02:48.158+0000 7f3db652f800 10 monclient: _renew_subs 2024-09-14T11:02:48.439 INFO:tasks.workunit.client.0.smithi097.stderr: -384> 2024-09-14T11:02:48.158+0000 7f3db652f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:02:48.439 INFO:tasks.workunit.client.0.smithi097.stderr: -383> 2024-09-14T11:02:48.158+0000 7f3db652f800 1 librados: init done 2024-09-14T11:02:48.439 INFO:tasks.workunit.client.0.smithi097.stderr: -382> 2024-09-14T11:02:48.160+0000 7f3c9ee05640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:02:48.440 INFO:tasks.workunit.client.0.smithi097.stderr: -381> 2024-09-14T11:02:48.160+0000 7f3c9ee05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:02:48.440 INFO:tasks.workunit.client.0.smithi097.stderr: -380> 2024-09-14T11:02:48.160+0000 7f3c9ee05640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:02:48.440 INFO:tasks.workunit.client.0.smithi097.stderr: -379> 2024-09-14T11:02:48.160+0000 7f3db2276640 10 monclient: get_auth_request con 0x7f3c98077230 auth_method 0 2024-09-14T11:02:48.440 INFO:tasks.workunit.client.0.smithi097.stderr: -378> 2024-09-14T11:02:48.160+0000 7f3db1a75640 10 monclient: get_auth_request con 0x559317f7c550 auth_method 0 2024-09-14T11:02:48.440 INFO:tasks.workunit.client.0.smithi097.stderr: -377> 2024-09-14T11:02:48.161+0000 7f3db2276640 10 monclient: get_auth_request con 0x559317f9edc0 auth_method 0 2024-09-14T11:02:48.440 INFO:tasks.workunit.client.0.smithi097.stderr: -376> 2024-09-14T11:02:48.162+0000 7f3db1a75640 10 monclient: get_auth_request con 0x559317fa31b0 auth_method 0 2024-09-14T11:02:48.440 INFO:tasks.workunit.client.0.smithi097.stderr: -375> 2024-09-14T11:02:48.163+0000 7f3db2a77640 10 monclient: get_auth_request con 0x559317fa2660 auth_method 0 2024-09-14T11:02:48.440 INFO:tasks.workunit.client.0.smithi097.stderr: -374> 2024-09-14T11:02:48.163+0000 7f3db652f800 10 monclient: build_initial_monmap 2024-09-14T11:02:48.440 INFO:tasks.workunit.client.0.smithi097.stderr: -373> 2024-09-14T11:02:48.163+0000 7f3db652f800 1 build_initial for_mkfs: 0 2024-09-14T11:02:48.440 INFO:tasks.workunit.client.0.smithi097.stderr: -372> 2024-09-14T11:02:48.163+0000 7f3db652f800 10 monclient: monmap: 2024-09-14T11:02:48.440 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:02:48.440 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:02:48.440 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:02:48.441 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:02:48.441 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:02:48.441 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:02:48.441 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:02:48.441 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:02:48.441 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:02:48.441 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:48.441 INFO:tasks.workunit.client.0.smithi097.stderr: -371> 2024-09-14T11:02:48.163+0000 7f3db652f800 5 AuthRegistry(0x559317fab420) adding auth protocol: cephx 2024-09-14T11:02:48.441 INFO:tasks.workunit.client.0.smithi097.stderr: -370> 2024-09-14T11:02:48.163+0000 7f3db652f800 5 AuthRegistry(0x559317fab420) adding auth protocol: cephx 2024-09-14T11:02:48.441 INFO:tasks.workunit.client.0.smithi097.stderr: -369> 2024-09-14T11:02:48.163+0000 7f3db652f800 5 AuthRegistry(0x559317fab420) adding auth protocol: cephx 2024-09-14T11:02:48.441 INFO:tasks.workunit.client.0.smithi097.stderr: -368> 2024-09-14T11:02:48.163+0000 7f3db652f800 5 AuthRegistry(0x559317fab420) adding con mode: secure 2024-09-14T11:02:48.441 INFO:tasks.workunit.client.0.smithi097.stderr: -367> 2024-09-14T11:02:48.163+0000 7f3db652f800 5 AuthRegistry(0x559317fab420) adding con mode: crc 2024-09-14T11:02:48.441 INFO:tasks.workunit.client.0.smithi097.stderr: -366> 2024-09-14T11:02:48.163+0000 7f3db652f800 5 AuthRegistry(0x559317fab420) adding con mode: secure 2024-09-14T11:02:48.442 INFO:tasks.workunit.client.0.smithi097.stderr: -365> 2024-09-14T11:02:48.163+0000 7f3db652f800 5 AuthRegistry(0x559317fab420) adding con mode: crc 2024-09-14T11:02:48.442 INFO:tasks.workunit.client.0.smithi097.stderr: -364> 2024-09-14T11:02:48.163+0000 7f3db652f800 5 AuthRegistry(0x559317fab420) adding con mode: secure 2024-09-14T11:02:48.442 INFO:tasks.workunit.client.0.smithi097.stderr: -363> 2024-09-14T11:02:48.163+0000 7f3db652f800 5 AuthRegistry(0x559317fab420) adding con mode: crc 2024-09-14T11:02:48.442 INFO:tasks.workunit.client.0.smithi097.stderr: -362> 2024-09-14T11:02:48.163+0000 7f3db652f800 5 AuthRegistry(0x559317fab420) adding con mode: crc 2024-09-14T11:02:48.442 INFO:tasks.workunit.client.0.smithi097.stderr: -361> 2024-09-14T11:02:48.163+0000 7f3db652f800 5 AuthRegistry(0x559317fab420) adding con mode: secure 2024-09-14T11:02:48.442 INFO:tasks.workunit.client.0.smithi097.stderr: -360> 2024-09-14T11:02:48.163+0000 7f3db652f800 5 AuthRegistry(0x559317fab420) adding con mode: crc 2024-09-14T11:02:48.442 INFO:tasks.workunit.client.0.smithi097.stderr: -359> 2024-09-14T11:02:48.163+0000 7f3db652f800 5 AuthRegistry(0x559317fab420) adding con mode: secure 2024-09-14T11:02:48.442 INFO:tasks.workunit.client.0.smithi097.stderr: -358> 2024-09-14T11:02:48.163+0000 7f3db652f800 5 AuthRegistry(0x559317fab420) adding con mode: crc 2024-09-14T11:02:48.442 INFO:tasks.workunit.client.0.smithi097.stderr: -357> 2024-09-14T11:02:48.163+0000 7f3db652f800 5 AuthRegistry(0x559317fab420) adding con mode: secure 2024-09-14T11:02:48.442 INFO:tasks.workunit.client.0.smithi097.stderr: -356> 2024-09-14T11:02:48.164+0000 7f3db652f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:02:48.442 INFO:tasks.workunit.client.0.smithi097.stderr: -355> 2024-09-14T11:02:48.164+0000 7f3db652f800 5 asok(0x559317d31270) register_command objecter_requests cmddesc objecter_requests hook 0x559317fae840 EEXIST 2024-09-14T11:02:48.442 INFO:tasks.workunit.client.0.smithi097.stderr: -354> 2024-09-14T11:02:48.164+0000 7f3db652f800 10 monclient: init 2024-09-14T11:02:48.442 INFO:tasks.workunit.client.0.smithi097.stderr: -353> 2024-09-14T11:02:48.164+0000 7f3db652f800 5 AuthRegistry(0x559317faa278) adding auth protocol: cephx 2024-09-14T11:02:48.442 INFO:tasks.workunit.client.0.smithi097.stderr: -352> 2024-09-14T11:02:48.164+0000 7f3db652f800 5 AuthRegistry(0x559317faa278) adding auth protocol: cephx 2024-09-14T11:02:48.443 INFO:tasks.workunit.client.0.smithi097.stderr: -351> 2024-09-14T11:02:48.164+0000 7f3db652f800 5 AuthRegistry(0x559317faa278) adding auth protocol: cephx 2024-09-14T11:02:48.443 INFO:tasks.workunit.client.0.smithi097.stderr: -350> 2024-09-14T11:02:48.164+0000 7f3db652f800 5 AuthRegistry(0x559317faa278) adding con mode: secure 2024-09-14T11:02:48.443 INFO:tasks.workunit.client.0.smithi097.stderr: -349> 2024-09-14T11:02:48.164+0000 7f3db652f800 5 AuthRegistry(0x559317faa278) adding con mode: crc 2024-09-14T11:02:48.443 INFO:tasks.workunit.client.0.smithi097.stderr: -348> 2024-09-14T11:02:48.164+0000 7f3db652f800 5 AuthRegistry(0x559317faa278) adding con mode: secure 2024-09-14T11:02:48.443 INFO:tasks.workunit.client.0.smithi097.stderr: -347> 2024-09-14T11:02:48.164+0000 7f3db652f800 5 AuthRegistry(0x559317faa278) adding con mode: crc 2024-09-14T11:02:48.443 INFO:tasks.workunit.client.0.smithi097.stderr: -346> 2024-09-14T11:02:48.164+0000 7f3db652f800 5 AuthRegistry(0x559317faa278) adding con mode: secure 2024-09-14T11:02:48.443 INFO:tasks.workunit.client.0.smithi097.stderr: -345> 2024-09-14T11:02:48.164+0000 7f3db652f800 5 AuthRegistry(0x559317faa278) adding con mode: crc 2024-09-14T11:02:48.443 INFO:tasks.workunit.client.0.smithi097.stderr: -344> 2024-09-14T11:02:48.164+0000 7f3db652f800 5 AuthRegistry(0x559317faa278) adding con mode: crc 2024-09-14T11:02:48.443 INFO:tasks.workunit.client.0.smithi097.stderr: -343> 2024-09-14T11:02:48.164+0000 7f3db652f800 5 AuthRegistry(0x559317faa278) adding con mode: secure 2024-09-14T11:02:48.443 INFO:tasks.workunit.client.0.smithi097.stderr: -342> 2024-09-14T11:02:48.164+0000 7f3db652f800 5 AuthRegistry(0x559317faa278) adding con mode: crc 2024-09-14T11:02:48.443 INFO:tasks.workunit.client.0.smithi097.stderr: -341> 2024-09-14T11:02:48.164+0000 7f3db652f800 5 AuthRegistry(0x559317faa278) adding con mode: secure 2024-09-14T11:02:48.443 INFO:tasks.workunit.client.0.smithi097.stderr: -340> 2024-09-14T11:02:48.164+0000 7f3db652f800 5 AuthRegistry(0x559317faa278) adding con mode: crc 2024-09-14T11:02:48.443 INFO:tasks.workunit.client.0.smithi097.stderr: -339> 2024-09-14T11:02:48.164+0000 7f3db652f800 5 AuthRegistry(0x559317faa278) adding con mode: secure 2024-09-14T11:02:48.443 INFO:tasks.workunit.client.0.smithi097.stderr: -338> 2024-09-14T11:02:48.164+0000 7f3db652f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:02:48.444 INFO:tasks.workunit.client.0.smithi097.stderr: -337> 2024-09-14T11:02:48.164+0000 7f3db652f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:02:48.444 INFO:tasks.workunit.client.0.smithi097.stderr: -336> 2024-09-14T11:02:48.164+0000 7f3db652f800 5 asok(0x559317d31270) register_command rotate-key cmddesc rotate-key hook 0x559317faa3c0 EEXIST 2024-09-14T11:02:48.444 INFO:tasks.workunit.client.0.smithi097.stderr: -335> 2024-09-14T11:02:48.164+0000 7f3db652f800 10 monclient: _reopen_session rank -1 2024-09-14T11:02:48.444 INFO:tasks.workunit.client.0.smithi097.stderr: -334> 2024-09-14T11:02:48.164+0000 7f3db652f800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:02:48.444 INFO:tasks.workunit.client.0.smithi097.stderr: -333> 2024-09-14T11:02:48.165+0000 7f3db652f800 10 monclient(hunting): picked mon.noname-c con 0x559317fd2b60 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:02:48.444 INFO:tasks.workunit.client.0.smithi097.stderr: -332> 2024-09-14T11:02:48.165+0000 7f3db652f800 10 monclient(hunting): picked mon.noname-a con 0x559317fd2f40 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:02:48.444 INFO:tasks.workunit.client.0.smithi097.stderr: -331> 2024-09-14T11:02:48.165+0000 7f3db652f800 10 monclient(hunting): picked mon.noname-b con 0x559317fd1870 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:02:48.444 INFO:tasks.workunit.client.0.smithi097.stderr: -330> 2024-09-14T11:02:48.165+0000 7f3db652f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:02:48.444 INFO:tasks.workunit.client.0.smithi097.stderr: -329> 2024-09-14T11:02:48.165+0000 7f3db652f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:02:48.444 INFO:tasks.workunit.client.0.smithi097.stderr: -328> 2024-09-14T11:02:48.165+0000 7f3db652f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:02:48.444 INFO:tasks.workunit.client.0.smithi097.stderr: -327> 2024-09-14T11:02:48.165+0000 7f3db652f800 10 monclient(hunting): _renew_subs 2024-09-14T11:02:48.444 INFO:tasks.workunit.client.0.smithi097.stderr: -326> 2024-09-14T11:02:48.165+0000 7f3db652f800 10 monclient(hunting): authenticate will time out at 1849.818052s 2024-09-14T11:02:48.444 INFO:tasks.workunit.client.0.smithi097.stderr: -325> 2024-09-14T11:02:48.165+0000 7f3db2a77640 10 monclient(hunting): get_auth_request con 0x559317fd2f40 auth_method 0 2024-09-14T11:02:48.444 INFO:tasks.workunit.client.0.smithi097.stderr: -324> 2024-09-14T11:02:48.165+0000 7f3db2a77640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:02:48.445 INFO:tasks.workunit.client.0.smithi097.stderr: -323> 2024-09-14T11:02:48.165+0000 7f3db2a77640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:02:48.445 INFO:tasks.workunit.client.0.smithi097.stderr: -322> 2024-09-14T11:02:48.165+0000 7f3db2a77640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:02:48.445 INFO:tasks.workunit.client.0.smithi097.stderr: -321> 2024-09-14T11:02:48.165+0000 7f3db1a75640 10 monclient(hunting): get_auth_request con 0x559317fd2b60 auth_method 0 2024-09-14T11:02:48.445 INFO:tasks.workunit.client.0.smithi097.stderr: -320> 2024-09-14T11:02:48.165+0000 7f3db1a75640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:02:48.445 INFO:tasks.workunit.client.0.smithi097.stderr: -319> 2024-09-14T11:02:48.165+0000 7f3db1a75640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:02:48.445 INFO:tasks.workunit.client.0.smithi097.stderr: -318> 2024-09-14T11:02:48.165+0000 7f3db1a75640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:02:48.445 INFO:tasks.workunit.client.0.smithi097.stderr: -317> 2024-09-14T11:02:48.165+0000 7f3db2a77640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:02:48.445 INFO:tasks.workunit.client.0.smithi097.stderr: -316> 2024-09-14T11:02:48.165+0000 7f3db2a77640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:02:48.445 INFO:tasks.workunit.client.0.smithi097.stderr: -315> 2024-09-14T11:02:48.165+0000 7f3db2a77640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:02:48.445 INFO:tasks.workunit.client.0.smithi097.stderr: -314> 2024-09-14T11:02:48.165+0000 7f3db2276640 10 monclient(hunting): get_auth_request con 0x559317fd1870 auth_method 0 2024-09-14T11:02:48.445 INFO:tasks.workunit.client.0.smithi097.stderr: -313> 2024-09-14T11:02:48.165+0000 7f3db2276640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:02:48.445 INFO:tasks.workunit.client.0.smithi097.stderr: -312> 2024-09-14T11:02:48.165+0000 7f3db2276640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:02:48.445 INFO:tasks.workunit.client.0.smithi097.stderr: -311> 2024-09-14T11:02:48.165+0000 7f3db2276640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:02:48.446 INFO:tasks.workunit.client.0.smithi097.stderr: -310> 2024-09-14T11:02:48.165+0000 7f3db1a75640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:02:48.446 INFO:tasks.workunit.client.0.smithi097.stderr: -309> 2024-09-14T11:02:48.165+0000 7f3db1a75640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:02:48.446 INFO:tasks.workunit.client.0.smithi097.stderr: -308> 2024-09-14T11:02:48.165+0000 7f3db1a75640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:02:48.446 INFO:tasks.workunit.client.0.smithi097.stderr: -307> 2024-09-14T11:02:48.165+0000 7f3db2276640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:02:48.446 INFO:tasks.workunit.client.0.smithi097.stderr: -306> 2024-09-14T11:02:48.165+0000 7f3db2276640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:02:48.446 INFO:tasks.workunit.client.0.smithi097.stderr: -305> 2024-09-14T11:02:48.165+0000 7f3db2276640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:02:48.446 INFO:tasks.workunit.client.0.smithi097.stderr: -304> 2024-09-14T11:02:48.165+0000 7f3db2a77640 10 monclient(hunting): handle_auth_done global_id 6375 payload 824 2024-09-14T11:02:48.446 INFO:tasks.workunit.client.0.smithi097.stderr: -303> 2024-09-14T11:02:48.165+0000 7f3db2a77640 10 monclient: _finish_hunting 0 2024-09-14T11:02:48.446 INFO:tasks.workunit.client.0.smithi097.stderr: -302> 2024-09-14T11:02:48.165+0000 7f3db2a77640 1 monclient: found mon.noname-a 2024-09-14T11:02:48.446 INFO:tasks.workunit.client.0.smithi097.stderr: -301> 2024-09-14T11:02:48.165+0000 7f3db2a77640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-14T11:02:48.446 INFO:tasks.workunit.client.0.smithi097.stderr: -300> 2024-09-14T11:02:48.165+0000 7f3c97fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:02:48.446 INFO:tasks.workunit.client.0.smithi097.stderr: -299> 2024-09-14T11:02:48.165+0000 7f3c97fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:02:48.446 INFO:tasks.workunit.client.0.smithi097.stderr: -298> 2024-09-14T11:02:48.165+0000 7f3c97fff640 10 monclient: dump: 2024-09-14T11:02:48.447 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:02:48.447 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:02:48.447 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:02:48.447 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:02:48.447 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:02:48.447 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:02:48.447 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:02:48.447 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:02:48.448 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:02:48.448 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:48.448 INFO:tasks.workunit.client.0.smithi097.stderr: -297> 2024-09-14T11:02:48.165+0000 7f3c97fff640 10 monclient: _finish_auth 0 2024-09-14T11:02:48.448 INFO:tasks.workunit.client.0.smithi097.stderr: -296> 2024-09-14T11:02:48.165+0000 7f3c97fff640 10 monclient: _check_auth_tickets 2024-09-14T11:02:48.448 INFO:tasks.workunit.client.0.smithi097.stderr: -295> 2024-09-14T11:02:48.165+0000 7f3c97fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:02:48.448 INFO:tasks.workunit.client.0.smithi097.stderr: -294> 2024-09-14T11:02:48.165+0000 7f3c97fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:02:48.448 INFO:tasks.workunit.client.0.smithi097.stderr: -293> 2024-09-14T11:02:48.165+0000 7f3c97fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:02:48.448 INFO:tasks.workunit.client.0.smithi097.stderr: -292> 2024-09-14T11:02:48.165+0000 7f3c97fff640 10 monclient: dump: 2024-09-14T11:02:48.448 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:02:48.448 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:02:48.448 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:02:48.448 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:02:48.449 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:02:48.449 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:02:48.449 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:02:48.449 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:02:48.449 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:02:48.449 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:48.449 INFO:tasks.workunit.client.0.smithi097.stderr: -291> 2024-09-14T11:02:48.165+0000 7f3db652f800 5 monclient: authenticate success, global_id 6375 2024-09-14T11:02:48.449 INFO:tasks.workunit.client.0.smithi097.stderr: -290> 2024-09-14T11:02:48.165+0000 7f3db652f800 10 monclient: _renew_subs 2024-09-14T11:02:48.449 INFO:tasks.workunit.client.0.smithi097.stderr: -289> 2024-09-14T11:02:48.165+0000 7f3db652f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:02:48.449 INFO:tasks.workunit.client.0.smithi097.stderr: -288> 2024-09-14T11:02:48.165+0000 7f3db3278640 4 set_mon_vals no callback set 2024-09-14T11:02:48.449 INFO:tasks.workunit.client.0.smithi097.stderr: -287> 2024-09-14T11:02:48.165+0000 7f3db652f800 10 monclient: _renew_subs 2024-09-14T11:02:48.449 INFO:tasks.workunit.client.0.smithi097.stderr: -286> 2024-09-14T11:02:48.165+0000 7f3db652f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:02:48.450 INFO:tasks.workunit.client.0.smithi097.stderr: -285> 2024-09-14T11:02:48.167+0000 7f3c97fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:02:48.450 INFO:tasks.workunit.client.0.smithi097.stderr: -284> 2024-09-14T11:02:48.167+0000 7f3c97fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:02:48.450 INFO:tasks.workunit.client.0.smithi097.stderr: -283> 2024-09-14T11:02:48.167+0000 7f3c97fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:02:48.450 INFO:tasks.workunit.client.0.smithi097.stderr: -282> 2024-09-14T11:02:48.167+0000 7f3db1a75640 10 monclient: get_auth_request con 0x7f3c8c077140 auth_method 0 2024-09-14T11:02:48.450 INFO:tasks.workunit.client.0.smithi097.stderr: -281> 2024-09-14T11:02:48.167+0000 7f3db652f800 10 monclient: get_monmap_and_config 2024-09-14T11:02:48.450 INFO:tasks.workunit.client.0.smithi097.stderr: -280> 2024-09-14T11:02:48.167+0000 7f3db652f800 10 monclient: build_initial_monmap 2024-09-14T11:02:48.450 INFO:tasks.workunit.client.0.smithi097.stderr: -279> 2024-09-14T11:02:48.167+0000 7f3db652f800 1 build_initial for_mkfs: 0 2024-09-14T11:02:48.450 INFO:tasks.workunit.client.0.smithi097.stderr: -278> 2024-09-14T11:02:48.167+0000 7f3db652f800 10 monclient: monmap: 2024-09-14T11:02:48.450 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:02:48.450 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:02:48.450 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:02:48.450 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:02:48.450 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:02:48.450 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:02:48.451 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:02:48.451 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:02:48.451 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:02:48.451 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:48.451 INFO:tasks.workunit.client.0.smithi097.stderr: -277> 2024-09-14T11:02:48.167+0000 7f3db652f800 5 AuthRegistry(0x559317ff2960) adding auth protocol: cephx 2024-09-14T11:02:48.451 INFO:tasks.workunit.client.0.smithi097.stderr: -276> 2024-09-14T11:02:48.167+0000 7f3db652f800 5 AuthRegistry(0x559317ff2960) adding auth protocol: cephx 2024-09-14T11:02:48.451 INFO:tasks.workunit.client.0.smithi097.stderr: -275> 2024-09-14T11:02:48.167+0000 7f3db652f800 5 AuthRegistry(0x559317ff2960) adding auth protocol: cephx 2024-09-14T11:02:48.451 INFO:tasks.workunit.client.0.smithi097.stderr: -274> 2024-09-14T11:02:48.167+0000 7f3db652f800 5 AuthRegistry(0x559317ff2960) adding con mode: secure 2024-09-14T11:02:48.451 INFO:tasks.workunit.client.0.smithi097.stderr: -273> 2024-09-14T11:02:48.167+0000 7f3db652f800 5 AuthRegistry(0x559317ff2960) adding con mode: crc 2024-09-14T11:02:48.451 INFO:tasks.workunit.client.0.smithi097.stderr: -272> 2024-09-14T11:02:48.167+0000 7f3db652f800 5 AuthRegistry(0x559317ff2960) adding con mode: secure 2024-09-14T11:02:48.451 INFO:tasks.workunit.client.0.smithi097.stderr: -271> 2024-09-14T11:02:48.167+0000 7f3db652f800 5 AuthRegistry(0x559317ff2960) adding con mode: crc 2024-09-14T11:02:48.451 INFO:tasks.workunit.client.0.smithi097.stderr: -270> 2024-09-14T11:02:48.167+0000 7f3db652f800 5 AuthRegistry(0x559317ff2960) adding con mode: secure 2024-09-14T11:02:48.451 INFO:tasks.workunit.client.0.smithi097.stderr: -269> 2024-09-14T11:02:48.167+0000 7f3db652f800 5 AuthRegistry(0x559317ff2960) adding con mode: crc 2024-09-14T11:02:48.451 INFO:tasks.workunit.client.0.smithi097.stderr: -268> 2024-09-14T11:02:48.167+0000 7f3db652f800 5 AuthRegistry(0x559317ff2960) adding con mode: crc 2024-09-14T11:02:48.451 INFO:tasks.workunit.client.0.smithi097.stderr: -267> 2024-09-14T11:02:48.167+0000 7f3db652f800 5 AuthRegistry(0x559317ff2960) adding con mode: secure 2024-09-14T11:02:48.452 INFO:tasks.workunit.client.0.smithi097.stderr: -266> 2024-09-14T11:02:48.167+0000 7f3db652f800 5 AuthRegistry(0x559317ff2960) adding con mode: crc 2024-09-14T11:02:48.452 INFO:tasks.workunit.client.0.smithi097.stderr: -265> 2024-09-14T11:02:48.167+0000 7f3db652f800 5 AuthRegistry(0x559317ff2960) adding con mode: secure 2024-09-14T11:02:48.452 INFO:tasks.workunit.client.0.smithi097.stderr: -264> 2024-09-14T11:02:48.167+0000 7f3db652f800 5 AuthRegistry(0x559317ff2960) adding con mode: crc 2024-09-14T11:02:48.452 INFO:tasks.workunit.client.0.smithi097.stderr: -263> 2024-09-14T11:02:48.167+0000 7f3db652f800 5 AuthRegistry(0x559317ff2960) adding con mode: secure 2024-09-14T11:02:48.452 INFO:tasks.workunit.client.0.smithi097.stderr: -262> 2024-09-14T11:02:48.168+0000 7f3db652f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:02:48.452 INFO:tasks.workunit.client.0.smithi097.stderr: -261> 2024-09-14T11:02:48.168+0000 7f3db652f800 10 monclient: init 2024-09-14T11:02:48.452 INFO:tasks.workunit.client.0.smithi097.stderr: -260> 2024-09-14T11:02:48.168+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644e970) adding auth protocol: cephx 2024-09-14T11:02:48.452 INFO:tasks.workunit.client.0.smithi097.stderr: -259> 2024-09-14T11:02:48.168+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644e970) adding auth protocol: cephx 2024-09-14T11:02:48.452 INFO:tasks.workunit.client.0.smithi097.stderr: -258> 2024-09-14T11:02:48.168+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644e970) adding auth protocol: cephx 2024-09-14T11:02:48.452 INFO:tasks.workunit.client.0.smithi097.stderr: -257> 2024-09-14T11:02:48.168+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644e970) adding con mode: secure 2024-09-14T11:02:48.452 INFO:tasks.workunit.client.0.smithi097.stderr: -256> 2024-09-14T11:02:48.168+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644e970) adding con mode: crc 2024-09-14T11:02:48.452 INFO:tasks.workunit.client.0.smithi097.stderr: -255> 2024-09-14T11:02:48.168+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644e970) adding con mode: secure 2024-09-14T11:02:48.452 INFO:tasks.workunit.client.0.smithi097.stderr: -254> 2024-09-14T11:02:48.168+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644e970) adding con mode: crc 2024-09-14T11:02:48.452 INFO:tasks.workunit.client.0.smithi097.stderr: -253> 2024-09-14T11:02:48.168+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644e970) adding con mode: secure 2024-09-14T11:02:48.453 INFO:tasks.workunit.client.0.smithi097.stderr: -252> 2024-09-14T11:02:48.168+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644e970) adding con mode: crc 2024-09-14T11:02:48.453 INFO:tasks.workunit.client.0.smithi097.stderr: -251> 2024-09-14T11:02:48.168+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644e970) adding con mode: crc 2024-09-14T11:02:48.453 INFO:tasks.workunit.client.0.smithi097.stderr: -250> 2024-09-14T11:02:48.168+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644e970) adding con mode: secure 2024-09-14T11:02:48.453 INFO:tasks.workunit.client.0.smithi097.stderr: -249> 2024-09-14T11:02:48.168+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644e970) adding con mode: crc 2024-09-14T11:02:48.453 INFO:tasks.workunit.client.0.smithi097.stderr: -248> 2024-09-14T11:02:48.168+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644e970) adding con mode: secure 2024-09-14T11:02:48.453 INFO:tasks.workunit.client.0.smithi097.stderr: -247> 2024-09-14T11:02:48.168+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644e970) adding con mode: crc 2024-09-14T11:02:48.453 INFO:tasks.workunit.client.0.smithi097.stderr: -246> 2024-09-14T11:02:48.168+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644e970) adding con mode: secure 2024-09-14T11:02:48.453 INFO:tasks.workunit.client.0.smithi097.stderr: -245> 2024-09-14T11:02:48.168+0000 7f3db652f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:02:48.453 INFO:tasks.workunit.client.0.smithi097.stderr: -244> 2024-09-14T11:02:48.168+0000 7f3db652f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:02:48.453 INFO:tasks.workunit.client.0.smithi097.stderr: -243> 2024-09-14T11:02:48.168+0000 7f3db652f800 5 asok(0x559317d31270) register_command rotate-key cmddesc rotate-key hook 0x7ffd6644eab8 EEXIST 2024-09-14T11:02:48.453 INFO:tasks.workunit.client.0.smithi097.stderr: -242> 2024-09-14T11:02:48.168+0000 7f3db652f800 10 monclient: _reopen_session rank -1 2024-09-14T11:02:48.453 INFO:tasks.workunit.client.0.smithi097.stderr: -241> 2024-09-14T11:02:48.168+0000 7f3db652f800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:02:48.453 INFO:tasks.workunit.client.0.smithi097.stderr: -240> 2024-09-14T11:02:48.168+0000 7f3db652f800 10 monclient(hunting): picked mon.noname-c con 0x559317ff6ad0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:02:48.454 INFO:tasks.workunit.client.0.smithi097.stderr: -239> 2024-09-14T11:02:48.168+0000 7f3db652f800 10 monclient(hunting): picked mon.noname-a con 0x559318021540 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:02:48.454 INFO:tasks.workunit.client.0.smithi097.stderr: -238> 2024-09-14T11:02:48.168+0000 7f3db652f800 10 monclient(hunting): picked mon.noname-b con 0x5593180228f0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:02:48.454 INFO:tasks.workunit.client.0.smithi097.stderr: -237> 2024-09-14T11:02:48.168+0000 7f3db652f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:02:48.454 INFO:tasks.workunit.client.0.smithi097.stderr: -236> 2024-09-14T11:02:48.168+0000 7f3db652f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:02:48.454 INFO:tasks.workunit.client.0.smithi097.stderr: -235> 2024-09-14T11:02:48.168+0000 7f3db652f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:02:48.454 INFO:tasks.workunit.client.0.smithi097.stderr: -234> 2024-09-14T11:02:48.168+0000 7f3db652f800 10 monclient(hunting): _renew_subs 2024-09-14T11:02:48.454 INFO:tasks.workunit.client.0.smithi097.stderr: -233> 2024-09-14T11:02:48.168+0000 7f3db652f800 10 monclient(hunting): authenticate will time out at 1849.821723s 2024-09-14T11:02:48.454 INFO:tasks.workunit.client.0.smithi097.stderr: -232> 2024-09-14T11:02:48.168+0000 7f3db1a75640 10 monclient(hunting): get_auth_request con 0x559317ff6ad0 auth_method 0 2024-09-14T11:02:48.454 INFO:tasks.workunit.client.0.smithi097.stderr: -231> 2024-09-14T11:02:48.168+0000 7f3db1a75640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:02:48.454 INFO:tasks.workunit.client.0.smithi097.stderr: -230> 2024-09-14T11:02:48.168+0000 7f3db1a75640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:02:48.454 INFO:tasks.workunit.client.0.smithi097.stderr: -229> 2024-09-14T11:02:48.168+0000 7f3db1a75640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:02:48.454 INFO:tasks.workunit.client.0.smithi097.stderr: -228> 2024-09-14T11:02:48.168+0000 7f3db2a77640 10 monclient(hunting): get_auth_request con 0x559318021540 auth_method 0 2024-09-14T11:02:48.454 INFO:tasks.workunit.client.0.smithi097.stderr: -227> 2024-09-14T11:02:48.168+0000 7f3db2a77640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:02:48.454 INFO:tasks.workunit.client.0.smithi097.stderr: -226> 2024-09-14T11:02:48.168+0000 7f3db2a77640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:02:48.455 INFO:tasks.workunit.client.0.smithi097.stderr: -225> 2024-09-14T11:02:48.168+0000 7f3db2a77640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:02:48.455 INFO:tasks.workunit.client.0.smithi097.stderr: -224> 2024-09-14T11:02:48.168+0000 7f3db1a75640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:02:48.455 INFO:tasks.workunit.client.0.smithi097.stderr: -223> 2024-09-14T11:02:48.168+0000 7f3db1a75640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:02:48.455 INFO:tasks.workunit.client.0.smithi097.stderr: -222> 2024-09-14T11:02:48.168+0000 7f3db1a75640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:02:48.455 INFO:tasks.workunit.client.0.smithi097.stderr: -221> 2024-09-14T11:02:48.168+0000 7f3db2a77640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:02:48.455 INFO:tasks.workunit.client.0.smithi097.stderr: -220> 2024-09-14T11:02:48.168+0000 7f3db2a77640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:02:48.455 INFO:tasks.workunit.client.0.smithi097.stderr: -219> 2024-09-14T11:02:48.168+0000 7f3db2a77640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:02:48.455 INFO:tasks.workunit.client.0.smithi097.stderr: -218> 2024-09-14T11:02:48.168+0000 7f3db1a75640 10 monclient(hunting): handle_auth_done global_id 6065 payload 274 2024-09-14T11:02:48.455 INFO:tasks.workunit.client.0.smithi097.stderr: -217> 2024-09-14T11:02:48.168+0000 7f3db1a75640 10 monclient: _finish_hunting 0 2024-09-14T11:02:48.455 INFO:tasks.workunit.client.0.smithi097.stderr: -216> 2024-09-14T11:02:48.168+0000 7f3db1a75640 1 monclient: found mon.noname-c 2024-09-14T11:02:48.455 INFO:tasks.workunit.client.0.smithi097.stderr: -215> 2024-09-14T11:02:48.169+0000 7f3db1a75640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:02:48.455 INFO:tasks.workunit.client.0.smithi097.stderr: -214> 2024-09-14T11:02:48.169+0000 7f3c95ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:02:48.455 INFO:tasks.workunit.client.0.smithi097.stderr: -213> 2024-09-14T11:02:48.169+0000 7f3c95ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:02:48.456 INFO:tasks.workunit.client.0.smithi097.stderr: -212> 2024-09-14T11:02:48.169+0000 7f3c95ffb640 10 monclient: dump: 2024-09-14T11:02:48.456 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:02:48.456 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:02:48.456 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:02:48.456 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:02:48.456 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:02:48.456 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:02:48.456 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:02:48.456 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:02:48.456 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:02:48.456 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:48.456 INFO:tasks.workunit.client.0.smithi097.stderr: -211> 2024-09-14T11:02:48.169+0000 7f3c95ffb640 10 monclient: _finish_auth 0 2024-09-14T11:02:48.456 INFO:tasks.workunit.client.0.smithi097.stderr: -210> 2024-09-14T11:02:48.169+0000 7f3c95ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:02:48.456 INFO:tasks.workunit.client.0.smithi097.stderr: -209> 2024-09-14T11:02:48.169+0000 7f3db652f800 5 monclient: authenticate success, global_id 6065 2024-09-14T11:02:48.457 INFO:tasks.workunit.client.0.smithi097.stderr: -208> 2024-09-14T11:02:48.169+0000 7f3c95ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:02:48.457 INFO:tasks.workunit.client.0.smithi097.stderr: -207> 2024-09-14T11:02:48.169+0000 7f3c95ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:02:48.457 INFO:tasks.workunit.client.0.smithi097.stderr: -206> 2024-09-14T11:02:48.169+0000 7f3c95ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:02:48.457 INFO:tasks.workunit.client.0.smithi097.stderr: -205> 2024-09-14T11:02:48.169+0000 7f3c95ffb640 10 monclient: dump: 2024-09-14T11:02:48.457 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:02:48.457 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:02:48.457 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:02:48.457 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:02:48.457 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:02:48.457 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:02:48.457 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:02:48.457 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:02:48.457 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:02:48.457 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:48.458 INFO:tasks.workunit.client.0.smithi097.stderr: -204> 2024-09-14T11:02:48.169+0000 7f3db652f800 10 monclient: get_monmap_and_config success 2024-09-14T11:02:48.458 INFO:tasks.workunit.client.0.smithi097.stderr: -203> 2024-09-14T11:02:48.169+0000 7f3db652f800 4 set_mon_vals no callback set 2024-09-14T11:02:48.458 INFO:tasks.workunit.client.0.smithi097.stderr: -202> 2024-09-14T11:02:48.169+0000 7f3db652f800 10 monclient: shutdown 2024-09-14T11:02:48.458 INFO:tasks.workunit.client.0.smithi097.stderr: -201> 2024-09-14T11:02:48.170+0000 7f3db652f800 10 monclient: build_initial_monmap 2024-09-14T11:02:48.458 INFO:tasks.workunit.client.0.smithi097.stderr: -200> 2024-09-14T11:02:48.170+0000 7f3db652f800 1 build_initial for_mkfs: 0 2024-09-14T11:02:48.458 INFO:tasks.workunit.client.0.smithi097.stderr: -199> 2024-09-14T11:02:48.170+0000 7f3db652f800 10 monclient: monmap: 2024-09-14T11:02:48.458 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:02:48.458 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:02:48.458 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:02:48.458 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:02:48.458 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:02:48.458 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:02:48.458 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:02:48.459 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:02:48.459 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:02:48.459 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:48.459 INFO:tasks.workunit.client.0.smithi097.stderr: -198> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317ff76b0) adding auth protocol: cephx 2024-09-14T11:02:48.459 INFO:tasks.workunit.client.0.smithi097.stderr: -197> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317ff76b0) adding auth protocol: cephx 2024-09-14T11:02:48.459 INFO:tasks.workunit.client.0.smithi097.stderr: -196> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317ff76b0) adding auth protocol: cephx 2024-09-14T11:02:48.459 INFO:tasks.workunit.client.0.smithi097.stderr: -195> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317ff76b0) adding con mode: secure 2024-09-14T11:02:48.459 INFO:tasks.workunit.client.0.smithi097.stderr: -194> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317ff76b0) adding con mode: crc 2024-09-14T11:02:48.459 INFO:tasks.workunit.client.0.smithi097.stderr: -193> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317ff76b0) adding con mode: secure 2024-09-14T11:02:48.459 INFO:tasks.workunit.client.0.smithi097.stderr: -192> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317ff76b0) adding con mode: crc 2024-09-14T11:02:48.459 INFO:tasks.workunit.client.0.smithi097.stderr: -191> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317ff76b0) adding con mode: secure 2024-09-14T11:02:48.459 INFO:tasks.workunit.client.0.smithi097.stderr: -190> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317ff76b0) adding con mode: crc 2024-09-14T11:02:48.459 INFO:tasks.workunit.client.0.smithi097.stderr: -189> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317ff76b0) adding con mode: crc 2024-09-14T11:02:48.459 INFO:tasks.workunit.client.0.smithi097.stderr: -188> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317ff76b0) adding con mode: secure 2024-09-14T11:02:48.460 INFO:tasks.workunit.client.0.smithi097.stderr: -187> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317ff76b0) adding con mode: crc 2024-09-14T11:02:48.460 INFO:tasks.workunit.client.0.smithi097.stderr: -186> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317ff76b0) adding con mode: secure 2024-09-14T11:02:48.460 INFO:tasks.workunit.client.0.smithi097.stderr: -185> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317ff76b0) adding con mode: crc 2024-09-14T11:02:48.460 INFO:tasks.workunit.client.0.smithi097.stderr: -184> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317ff76b0) adding con mode: secure 2024-09-14T11:02:48.460 INFO:tasks.workunit.client.0.smithi097.stderr: -183> 2024-09-14T11:02:48.170+0000 7f3db652f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:02:48.460 INFO:tasks.workunit.client.0.smithi097.stderr: -182> 2024-09-14T11:02:48.170+0000 7f3db652f800 1 librados: starting msgr at 2024-09-14T11:02:48.460 INFO:tasks.workunit.client.0.smithi097.stderr: -181> 2024-09-14T11:02:48.170+0000 7f3db652f800 1 librados: starting objecter 2024-09-14T11:02:48.460 INFO:tasks.workunit.client.0.smithi097.stderr: -180> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 asok(0x559317d31270) register_command objecter_requests cmddesc objecter_requests hook 0x559317ff61e0 EEXIST 2024-09-14T11:02:48.460 INFO:tasks.workunit.client.0.smithi097.stderr: -179> 2024-09-14T11:02:48.170+0000 7f3db652f800 1 librados: setting wanted keys 2024-09-14T11:02:48.460 INFO:tasks.workunit.client.0.smithi097.stderr: -178> 2024-09-14T11:02:48.170+0000 7f3db652f800 1 librados: calling monclient init 2024-09-14T11:02:48.460 INFO:tasks.workunit.client.0.smithi097.stderr: -177> 2024-09-14T11:02:48.170+0000 7f3db652f800 10 monclient: init 2024-09-14T11:02:48.460 INFO:tasks.workunit.client.0.smithi097.stderr: -176> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317fe7420) adding auth protocol: cephx 2024-09-14T11:02:48.460 INFO:tasks.workunit.client.0.smithi097.stderr: -175> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317fe7420) adding auth protocol: cephx 2024-09-14T11:02:48.460 INFO:tasks.workunit.client.0.smithi097.stderr: -174> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317fe7420) adding auth protocol: cephx 2024-09-14T11:02:48.461 INFO:tasks.workunit.client.0.smithi097.stderr: -173> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317fe7420) adding con mode: secure 2024-09-14T11:02:48.461 INFO:tasks.workunit.client.0.smithi097.stderr: -172> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317fe7420) adding con mode: crc 2024-09-14T11:02:48.461 INFO:tasks.workunit.client.0.smithi097.stderr: -171> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317fe7420) adding con mode: secure 2024-09-14T11:02:48.461 INFO:tasks.workunit.client.0.smithi097.stderr: -170> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317fe7420) adding con mode: crc 2024-09-14T11:02:48.461 INFO:tasks.workunit.client.0.smithi097.stderr: -169> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317fe7420) adding con mode: secure 2024-09-14T11:02:48.461 INFO:tasks.workunit.client.0.smithi097.stderr: -168> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317fe7420) adding con mode: crc 2024-09-14T11:02:48.461 INFO:tasks.workunit.client.0.smithi097.stderr: -167> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317fe7420) adding con mode: crc 2024-09-14T11:02:48.461 INFO:tasks.workunit.client.0.smithi097.stderr: -166> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317fe7420) adding con mode: secure 2024-09-14T11:02:48.461 INFO:tasks.workunit.client.0.smithi097.stderr: -165> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317fe7420) adding con mode: crc 2024-09-14T11:02:48.461 INFO:tasks.workunit.client.0.smithi097.stderr: -164> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317fe7420) adding con mode: secure 2024-09-14T11:02:48.461 INFO:tasks.workunit.client.0.smithi097.stderr: -163> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317fe7420) adding con mode: crc 2024-09-14T11:02:48.461 INFO:tasks.workunit.client.0.smithi097.stderr: -162> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317fe7420) adding con mode: secure 2024-09-14T11:02:48.461 INFO:tasks.workunit.client.0.smithi097.stderr: -161> 2024-09-14T11:02:48.170+0000 7f3db652f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:02:48.462 INFO:tasks.workunit.client.0.smithi097.stderr: -160> 2024-09-14T11:02:48.170+0000 7f3db652f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:02:48.462 INFO:tasks.workunit.client.0.smithi097.stderr: -159> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 asok(0x559317d31270) register_command rotate-key cmddesc rotate-key hook 0x559317fe7568 EEXIST 2024-09-14T11:02:48.462 INFO:tasks.workunit.client.0.smithi097.stderr: -158> 2024-09-14T11:02:48.170+0000 7f3db652f800 10 monclient: _reopen_session rank -1 2024-09-14T11:02:48.462 INFO:tasks.workunit.client.0.smithi097.stderr: -157> 2024-09-14T11:02:48.170+0000 7f3db652f800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:02:48.462 INFO:tasks.workunit.client.0.smithi097.stderr: -156> 2024-09-14T11:02:48.170+0000 7f3db652f800 10 monclient(hunting): picked mon.noname-c con 0x559317ff6ad0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:02:48.462 INFO:tasks.workunit.client.0.smithi097.stderr: -155> 2024-09-14T11:02:48.170+0000 7f3db652f800 10 monclient(hunting): picked mon.noname-a con 0x5593180228f0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:02:48.462 INFO:tasks.workunit.client.0.smithi097.stderr: -154> 2024-09-14T11:02:48.170+0000 7f3db652f800 10 monclient(hunting): picked mon.noname-b con 0x559318026270 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:02:48.462 INFO:tasks.workunit.client.0.smithi097.stderr: -153> 2024-09-14T11:02:48.170+0000 7f3db652f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:02:48.462 INFO:tasks.workunit.client.0.smithi097.stderr: -152> 2024-09-14T11:02:48.170+0000 7f3db652f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:02:48.462 INFO:tasks.workunit.client.0.smithi097.stderr: -151> 2024-09-14T11:02:48.170+0000 7f3db652f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:02:48.462 INFO:tasks.workunit.client.0.smithi097.stderr: -150> 2024-09-14T11:02:48.170+0000 7f3db652f800 10 monclient(hunting): _renew_subs 2024-09-14T11:02:48.462 INFO:tasks.workunit.client.0.smithi097.stderr: -149> 2024-09-14T11:02:48.170+0000 7f3db652f800 10 monclient(hunting): authenticate will time out at 1849.823953s 2024-09-14T11:02:48.462 INFO:tasks.workunit.client.0.smithi097.stderr: -148> 2024-09-14T11:02:48.171+0000 7f3db1a75640 10 monclient(hunting): get_auth_request con 0x559317ff6ad0 auth_method 0 2024-09-14T11:02:48.462 INFO:tasks.workunit.client.0.smithi097.stderr: -147> 2024-09-14T11:02:48.171+0000 7f3db1a75640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:02:48.463 INFO:tasks.workunit.client.0.smithi097.stderr: -146> 2024-09-14T11:02:48.171+0000 7f3db1a75640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:02:48.463 INFO:tasks.workunit.client.0.smithi097.stderr: -145> 2024-09-14T11:02:48.171+0000 7f3db1a75640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:02:48.463 INFO:tasks.workunit.client.0.smithi097.stderr: -144> 2024-09-14T11:02:48.171+0000 7f3db2a77640 10 monclient(hunting): get_auth_request con 0x5593180228f0 auth_method 0 2024-09-14T11:02:48.463 INFO:tasks.workunit.client.0.smithi097.stderr: -143> 2024-09-14T11:02:48.171+0000 7f3db2a77640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:02:48.463 INFO:tasks.workunit.client.0.smithi097.stderr: -142> 2024-09-14T11:02:48.171+0000 7f3db2a77640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:02:48.463 INFO:tasks.workunit.client.0.smithi097.stderr: -141> 2024-09-14T11:02:48.171+0000 7f3db2a77640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:02:48.463 INFO:tasks.workunit.client.0.smithi097.stderr: -140> 2024-09-14T11:02:48.171+0000 7f3db1a75640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:02:48.463 INFO:tasks.workunit.client.0.smithi097.stderr: -139> 2024-09-14T11:02:48.171+0000 7f3db1a75640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:02:48.463 INFO:tasks.workunit.client.0.smithi097.stderr: -138> 2024-09-14T11:02:48.171+0000 7f3db1a75640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:02:48.463 INFO:tasks.workunit.client.0.smithi097.stderr: -137> 2024-09-14T11:02:48.171+0000 7f3db2a77640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:02:48.463 INFO:tasks.workunit.client.0.smithi097.stderr: -136> 2024-09-14T11:02:48.171+0000 7f3db2a77640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:02:48.463 INFO:tasks.workunit.client.0.smithi097.stderr: -135> 2024-09-14T11:02:48.171+0000 7f3db2a77640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:02:48.463 INFO:tasks.workunit.client.0.smithi097.stderr: -134> 2024-09-14T11:02:48.171+0000 7f3db2a77640 10 monclient(hunting): handle_auth_done global_id 6381 payload 824 2024-09-14T11:02:48.463 INFO:tasks.workunit.client.0.smithi097.stderr: -133> 2024-09-14T11:02:48.171+0000 7f3db2a77640 10 monclient: _finish_hunting 0 2024-09-14T11:02:48.464 INFO:tasks.workunit.client.0.smithi097.stderr: -132> 2024-09-14T11:02:48.171+0000 7f3db2a77640 1 monclient: found mon.noname-a 2024-09-14T11:02:48.464 INFO:tasks.workunit.client.0.smithi097.stderr: -131> 2024-09-14T11:02:48.171+0000 7f3db2a77640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-14T11:02:48.464 INFO:tasks.workunit.client.0.smithi097.stderr: -130> 2024-09-14T11:02:48.171+0000 7f3db2276640 10 monclient: get_auth_request con 0x559318026270 auth_method 0 2024-09-14T11:02:48.464 INFO:tasks.workunit.client.0.smithi097.stderr: -129> 2024-09-14T11:02:48.171+0000 7f3c83fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:02:48.464 INFO:tasks.workunit.client.0.smithi097.stderr: -128> 2024-09-14T11:02:48.171+0000 7f3c83fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:02:48.464 INFO:tasks.workunit.client.0.smithi097.stderr: -127> 2024-09-14T11:02:48.171+0000 7f3c83fff640 10 monclient: dump: 2024-09-14T11:02:48.464 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:02:48.464 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:02:48.464 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:02:48.464 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:02:48.464 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:02:48.464 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:02:48.464 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:02:48.464 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:02:48.465 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:02:48.465 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:48.465 INFO:tasks.workunit.client.0.smithi097.stderr: -126> 2024-09-14T11:02:48.171+0000 7f3c83fff640 10 monclient: _finish_auth 0 2024-09-14T11:02:48.465 INFO:tasks.workunit.client.0.smithi097.stderr: -125> 2024-09-14T11:02:48.171+0000 7f3c83fff640 10 monclient: _check_auth_tickets 2024-09-14T11:02:48.465 INFO:tasks.workunit.client.0.smithi097.stderr: -124> 2024-09-14T11:02:48.171+0000 7f3c83fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:02:48.465 INFO:tasks.workunit.client.0.smithi097.stderr: -123> 2024-09-14T11:02:48.171+0000 7f3c83fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:02:48.465 INFO:tasks.workunit.client.0.smithi097.stderr: -122> 2024-09-14T11:02:48.171+0000 7f3c83fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:02:48.465 INFO:tasks.workunit.client.0.smithi097.stderr: -121> 2024-09-14T11:02:48.171+0000 7f3c83fff640 10 monclient: dump: 2024-09-14T11:02:48.465 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:02:48.465 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:02:48.465 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:02:48.465 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:02:48.465 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:02:48.465 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:02:48.466 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:02:48.466 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:02:48.466 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:02:48.466 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:48.466 INFO:tasks.workunit.client.0.smithi097.stderr: -120> 2024-09-14T11:02:48.171+0000 7f3db652f800 5 monclient: authenticate success, global_id 6381 2024-09-14T11:02:48.466 INFO:tasks.workunit.client.0.smithi097.stderr: -119> 2024-09-14T11:02:48.171+0000 7f3db652f800 10 monclient: _renew_subs 2024-09-14T11:02:48.466 INFO:tasks.workunit.client.0.smithi097.stderr: -118> 2024-09-14T11:02:48.171+0000 7f3c95ffb640 4 set_mon_vals no callback set 2024-09-14T11:02:48.466 INFO:tasks.workunit.client.0.smithi097.stderr: -117> 2024-09-14T11:02:48.171+0000 7f3db652f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:02:48.466 INFO:tasks.workunit.client.0.smithi097.stderr: -116> 2024-09-14T11:02:48.171+0000 7f3db652f800 10 monclient: _renew_subs 2024-09-14T11:02:48.466 INFO:tasks.workunit.client.0.smithi097.stderr: -115> 2024-09-14T11:02:48.171+0000 7f3db652f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:02:48.466 INFO:tasks.workunit.client.0.smithi097.stderr: -114> 2024-09-14T11:02:48.171+0000 7f3db652f800 1 librados: init done 2024-09-14T11:02:48.466 INFO:tasks.workunit.client.0.smithi097.stderr: -113> 2024-09-14T11:02:48.171+0000 7f3db652f800 5 asok(0x559317d31270) register_command cr dump hook 0x559318025828 2024-09-14T11:02:48.466 INFO:tasks.workunit.client.0.smithi097.stderr: -112> 2024-09-14T11:02:48.173+0000 7f3db652f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.466 INFO:tasks.workunit.client.0.smithi097.stderr: -111> 2024-09-14T11:02:48.173+0000 7f3c83fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:02:48.467 INFO:tasks.workunit.client.0.smithi097.stderr: -110> 2024-09-14T11:02:48.173+0000 7f3c83fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:02:48.467 INFO:tasks.workunit.client.0.smithi097.stderr: -109> 2024-09-14T11:02:48.173+0000 7f3c83fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:02:48.467 INFO:tasks.workunit.client.0.smithi097.stderr: -108> 2024-09-14T11:02:48.173+0000 7f3db1a75640 10 monclient: get_auth_request con 0x7f3c7c077230 auth_method 0 2024-09-14T11:02:48.467 INFO:tasks.workunit.client.0.smithi097.stderr: -107> 2024-09-14T11:02:48.174+0000 7f3db2276640 10 monclient: get_auth_request con 0x5593180411b0 auth_method 0 2024-09-14T11:02:48.467 INFO:tasks.workunit.client.0.smithi097.stderr: -106> 2024-09-14T11:02:48.174+0000 7f3db652f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:48.467 INFO:tasks.workunit.client.0.smithi097.stderr: -105> 2024-09-14T11:02:48.174+0000 7f3db652f800 20 realm 2024-09-14T11:02:48.467 INFO:tasks.workunit.client.0.smithi097.stderr: -104> 2024-09-14T11:02:48.174+0000 7f3db652f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.467 INFO:tasks.workunit.client.0.smithi097.stderr: -103> 2024-09-14T11:02:48.174+0000 7f3db652f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:48.467 INFO:tasks.workunit.client.0.smithi097.stderr: -102> 2024-09-14T11:02:48.174+0000 7f3db652f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:02:48.467 INFO:tasks.workunit.client.0.smithi097.stderr: -101> 2024-09-14T11:02:48.174+0000 7f3db652f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.467 INFO:tasks.workunit.client.0.smithi097.stderr: -100> 2024-09-14T11:02:48.175+0000 7f3db652f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:48.467 INFO:tasks.workunit.client.0.smithi097.stderr: -99> 2024-09-14T11:02:48.175+0000 7f3db652f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.467 INFO:tasks.workunit.client.0.smithi097.stderr: -98> 2024-09-14T11:02:48.175+0000 7f3db1a75640 10 monclient: get_auth_request con 0x5593180453e0 auth_method 0 2024-09-14T11:02:48.468 INFO:tasks.workunit.client.0.smithi097.stderr: -97> 2024-09-14T11:02:48.175+0000 7f3db652f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:48.468 INFO:tasks.workunit.client.0.smithi097.stderr: -96> 2024-09-14T11:02:48.175+0000 7f3db652f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.468 INFO:tasks.workunit.client.0.smithi097.stderr: -95> 2024-09-14T11:02:48.175+0000 7f3db2a77640 10 monclient: get_auth_request con 0x559318048c90 auth_method 0 2024-09-14T11:02:48.468 INFO:tasks.workunit.client.0.smithi097.stderr: -94> 2024-09-14T11:02:48.176+0000 7f3db652f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:02:48.468 INFO:tasks.workunit.client.0.smithi097.stderr: -93> 2024-09-14T11:02:48.176+0000 7f3db652f800 20 searching for the correct realm 2024-09-14T11:02:48.468 INFO:tasks.workunit.client.0.smithi097.stderr: -92> 2024-09-14T11:02:48.176+0000 7f3db2276640 10 monclient: get_auth_request con 0x55931804da30 auth_method 0 2024-09-14T11:02:48.468 INFO:tasks.workunit.client.0.smithi097.stderr: -91> 2024-09-14T11:02:48.177+0000 7f3db1a75640 10 monclient: get_auth_request con 0x7f3da4027040 auth_method 0 2024-09-14T11:02:48.468 INFO:tasks.workunit.client.0.smithi097.stderr: -90> 2024-09-14T11:02:48.178+0000 7f3db2a77640 0 -- 172.21.15.97:0/723309112 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f3da8040020 msgr2=0x7f3da8019920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:02:48.468 INFO:tasks.workunit.client.0.smithi097.stderr: -89> 2024-09-14T11:02:48.379+0000 7f3db2a77640 10 monclient: get_auth_request con 0x7f3da8040020 auth_method 0 2024-09-14T11:02:48.468 INFO:tasks.workunit.client.0.smithi097.stderr: -88> 2024-09-14T11:02:48.381+0000 7f3db2276640 10 monclient: get_auth_request con 0x7f3da8037040 auth_method 0 2024-09-14T11:02:48.468 INFO:tasks.workunit.client.0.smithi097.stderr: -87> 2024-09-14T11:02:48.382+0000 7f3db1a75640 10 monclient: get_auth_request con 0x7f3da4017070 auth_method 0 2024-09-14T11:02:48.468 INFO:tasks.workunit.client.0.smithi097.stderr: -86> 2024-09-14T11:02:48.383+0000 7f3db1a75640 0 -- 172.21.15.97:0/723309112 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f3da4017070 msgr2=0x7f3da4027420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:02:48.468 INFO:tasks.workunit.client.0.smithi097.stderr: -85> 2024-09-14T11:02:48.383+0000 7f3c83fff640 1 client.6381.objecter ms_handle_reset 0x7f3da4017070 session 0x7f3da400c510 osd.3 2024-09-14T11:02:48.469 INFO:tasks.workunit.client.0.smithi097.stderr: -84> 2024-09-14T11:02:48.383+0000 7f3c83fff640 10 monclient: _renew_subs 2024-09-14T11:02:48.469 INFO:tasks.workunit.client.0.smithi097.stderr: -83> 2024-09-14T11:02:48.383+0000 7f3c83fff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:02:48.469 INFO:tasks.workunit.client.0.smithi097.stderr: -82> 2024-09-14T11:02:48.383+0000 7f3db1a75640 10 monclient: get_auth_request con 0x7f3c7c086db0 auth_method 0 2024-09-14T11:02:48.469 INFO:tasks.workunit.client.0.smithi097.stderr: -81> 2024-09-14T11:02:48.387+0000 7f3db652f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:02:48.469 INFO:tasks.workunit.client.0.smithi097.stderr: -80> 2024-09-14T11:02:48.387+0000 7f3db652f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:02:48.469 INFO:tasks.workunit.client.0.smithi097.stderr: -79> 2024-09-14T11:02:48.387+0000 7f3db652f800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:02:48.469 INFO:tasks.workunit.client.0.smithi097.stderr: -78> 2024-09-14T11:02:48.387+0000 7f3db652f800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:02:48.469 INFO:tasks.workunit.client.0.smithi097.stderr: -77> 2024-09-14T11:02:48.387+0000 7f3db652f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:02:48.469 INFO:tasks.workunit.client.0.smithi097.stderr: -76> 2024-09-14T11:02:48.387+0000 7f3db652f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:02:48.469 INFO:tasks.workunit.client.0.smithi097.stderr: -75> 2024-09-14T11:02:48.387+0000 7f3db652f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.469 INFO:tasks.workunit.client.0.smithi097.stderr: -74> 2024-09-14T11:02:48.387+0000 7f3db652f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:48.469 INFO:tasks.workunit.client.0.smithi097.stderr: -73> 2024-09-14T11:02:48.387+0000 7f3db652f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.469 INFO:tasks.workunit.client.0.smithi097.stderr: -72> 2024-09-14T11:02:48.388+0000 7f3db652f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:48.469 INFO:tasks.workunit.client.0.smithi097.stderr: -71> 2024-09-14T11:02:48.388+0000 7f3db652f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.470 INFO:tasks.workunit.client.0.smithi097.stderr: -70> 2024-09-14T11:02:48.388+0000 7f3db652f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:02:48.470 INFO:tasks.workunit.client.0.smithi097.stderr: -69> 2024-09-14T11:02:48.388+0000 7f3db652f800 20 zone default found 2024-09-14T11:02:48.470 INFO:tasks.workunit.client.0.smithi097.stderr: -68> 2024-09-14T11:02:48.388+0000 7f3db652f800 4 Realm: () 2024-09-14T11:02:48.470 INFO:tasks.workunit.client.0.smithi097.stderr: -67> 2024-09-14T11:02:48.388+0000 7f3db652f800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:02:48.470 INFO:tasks.workunit.client.0.smithi097.stderr: -66> 2024-09-14T11:02:48.388+0000 7f3db652f800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:02:48.470 INFO:tasks.workunit.client.0.smithi097.stderr: -65> 2024-09-14T11:02:48.388+0000 7f3db652f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:02:48.470 INFO:tasks.workunit.client.0.smithi097.stderr: -64> 2024-09-14T11:02:48.388+0000 7f3db652f800 20 zonegroup default 2024-09-14T11:02:48.470 INFO:tasks.workunit.client.0.smithi097.stderr: -63> 2024-09-14T11:02:48.388+0000 7f3db652f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.470 INFO:tasks.workunit.client.0.smithi097.stderr: -62> 2024-09-14T11:02:48.388+0000 7f3db652f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:48.470 INFO:tasks.workunit.client.0.smithi097.stderr: -61> 2024-09-14T11:02:48.388+0000 7f3db652f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.470 INFO:tasks.workunit.client.0.smithi097.stderr: -60> 2024-09-14T11:02:48.389+0000 7f3db652f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:48.470 INFO:tasks.workunit.client.0.smithi097.stderr: -59> 2024-09-14T11:02:48.389+0000 7f3db652f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.470 INFO:tasks.workunit.client.0.smithi097.stderr: -58> 2024-09-14T11:02:48.389+0000 7f3db652f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:48.470 INFO:tasks.workunit.client.0.smithi097.stderr: -57> 2024-09-14T11:02:48.389+0000 7f3db652f800 20 started sync module instance, tier type = 2024-09-14T11:02:48.471 INFO:tasks.workunit.client.0.smithi097.stderr: -56> 2024-09-14T11:02:48.389+0000 7f3db652f800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:02:48.471 INFO:tasks.workunit.client.0.smithi097.stderr: -55> 2024-09-14T11:02:48.397+0000 7f3db652f800 20 add_watcher() i=0 2024-09-14T11:02:48.471 INFO:tasks.workunit.client.0.smithi097.stderr: -54> 2024-09-14T11:02:48.397+0000 7f3db652f800 20 add_watcher() i=1 2024-09-14T11:02:48.471 INFO:tasks.workunit.client.0.smithi097.stderr: -53> 2024-09-14T11:02:48.397+0000 7f3db652f800 20 add_watcher() i=2 2024-09-14T11:02:48.471 INFO:tasks.workunit.client.0.smithi097.stderr: -52> 2024-09-14T11:02:48.397+0000 7f3db652f800 20 add_watcher() i=3 2024-09-14T11:02:48.471 INFO:tasks.workunit.client.0.smithi097.stderr: -51> 2024-09-14T11:02:48.397+0000 7f3db652f800 20 add_watcher() i=4 2024-09-14T11:02:48.471 INFO:tasks.workunit.client.0.smithi097.stderr: -50> 2024-09-14T11:02:48.397+0000 7f3db652f800 20 add_watcher() i=5 2024-09-14T11:02:48.471 INFO:tasks.workunit.client.0.smithi097.stderr: -49> 2024-09-14T11:02:48.397+0000 7f3db652f800 20 add_watcher() i=6 2024-09-14T11:02:48.471 INFO:tasks.workunit.client.0.smithi097.stderr: -48> 2024-09-14T11:02:48.398+0000 7f3db652f800 20 add_watcher() i=7 2024-09-14T11:02:48.471 INFO:tasks.workunit.client.0.smithi097.stderr: -47> 2024-09-14T11:02:48.398+0000 7f3db652f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:02:48.472 INFO:tasks.workunit.client.0.smithi097.stderr: -46> 2024-09-14T11:02:48.400+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644ee50) adding auth protocol: cephx 2024-09-14T11:02:48.472 INFO:tasks.workunit.client.0.smithi097.stderr: -45> 2024-09-14T11:02:48.400+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644ee50) adding auth protocol: cephx 2024-09-14T11:02:48.472 INFO:tasks.workunit.client.0.smithi097.stderr: -44> 2024-09-14T11:02:48.400+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644ee50) adding auth protocol: cephx 2024-09-14T11:02:48.472 INFO:tasks.workunit.client.0.smithi097.stderr: -43> 2024-09-14T11:02:48.400+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644ee50) adding con mode: secure 2024-09-14T11:02:48.472 INFO:tasks.workunit.client.0.smithi097.stderr: -42> 2024-09-14T11:02:48.400+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644ee50) adding con mode: crc 2024-09-14T11:02:48.472 INFO:tasks.workunit.client.0.smithi097.stderr: -41> 2024-09-14T11:02:48.400+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644ee50) adding con mode: secure 2024-09-14T11:02:48.472 INFO:tasks.workunit.client.0.smithi097.stderr: -40> 2024-09-14T11:02:48.400+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644ee50) adding con mode: crc 2024-09-14T11:02:48.472 INFO:tasks.workunit.client.0.smithi097.stderr: -39> 2024-09-14T11:02:48.400+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644ee50) adding con mode: secure 2024-09-14T11:02:48.472 INFO:tasks.workunit.client.0.smithi097.stderr: -38> 2024-09-14T11:02:48.400+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644ee50) adding con mode: crc 2024-09-14T11:02:48.472 INFO:tasks.workunit.client.0.smithi097.stderr: -37> 2024-09-14T11:02:48.400+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644ee50) adding con mode: crc 2024-09-14T11:02:48.472 INFO:tasks.workunit.client.0.smithi097.stderr: -36> 2024-09-14T11:02:48.400+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644ee50) adding con mode: secure 2024-09-14T11:02:48.472 INFO:tasks.workunit.client.0.smithi097.stderr: -35> 2024-09-14T11:02:48.400+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644ee50) adding con mode: crc 2024-09-14T11:02:48.472 INFO:tasks.workunit.client.0.smithi097.stderr: -34> 2024-09-14T11:02:48.400+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644ee50) adding con mode: secure 2024-09-14T11:02:48.473 INFO:tasks.workunit.client.0.smithi097.stderr: -33> 2024-09-14T11:02:48.400+0000 7f3c68fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:02:48.473 INFO:tasks.workunit.client.0.smithi097.stderr: -32> 2024-09-14T11:02:48.400+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644ee50) adding con mode: crc 2024-09-14T11:02:48.473 INFO:tasks.workunit.client.0.smithi097.stderr: -31> 2024-09-14T11:02:48.400+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644ee50) adding con mode: secure 2024-09-14T11:02:48.473 INFO:tasks.workunit.client.0.smithi097.stderr: -30> 2024-09-14T11:02:48.401+0000 7f3db652f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:02:48.473 INFO:tasks.workunit.client.0.smithi097.stderr: -29> 2024-09-14T11:02:48.401+0000 7f3db652f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:02:48.473 INFO:tasks.workunit.client.0.smithi097.stderr: -28> 2024-09-14T11:02:48.401+0000 7f3db652f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:02:48.473 INFO:tasks.workunit.client.0.smithi097.stderr: -27> 2024-09-14T11:02:48.401+0000 7f3db652f800 5 asok(0x559317d31270) register_command cache list hook 0x55931801dd90 2024-09-14T11:02:48.473 INFO:tasks.workunit.client.0.smithi097.stderr: -26> 2024-09-14T11:02:48.401+0000 7f3db652f800 5 asok(0x559317d31270) register_command cache inspect hook 0x55931801dd90 2024-09-14T11:02:48.473 INFO:tasks.workunit.client.0.smithi097.stderr: -25> 2024-09-14T11:02:48.401+0000 7f3db652f800 5 asok(0x559317d31270) register_command cache erase hook 0x55931801dd90 2024-09-14T11:02:48.473 INFO:tasks.workunit.client.0.smithi097.stderr: -24> 2024-09-14T11:02:48.401+0000 7f3db652f800 5 asok(0x559317d31270) register_command cache zap hook 0x55931801dd90 2024-09-14T11:02:48.473 INFO:tasks.workunit.client.0.smithi097.stderr: -23> 2024-09-14T11:02:48.401+0000 7f3db652f800 5 note: GC not initialized 2024-09-14T11:02:48.473 INFO:tasks.workunit.client.0.smithi097.stderr: -22> 2024-09-14T11:02:48.401+0000 7f3be37fe640 20 reqs_thread_entry: start 2024-09-14T11:02:48.473 INFO:tasks.workunit.client.0.smithi097.stderr: -21> 2024-09-14T11:02:48.401+0000 7f3db652f800 5 asok(0x559317d31270) register_command sync trace show hook 0x7f3da800ee40 2024-09-14T11:02:48.473 INFO:tasks.workunit.client.0.smithi097.stderr: -20> 2024-09-14T11:02:48.401+0000 7f3db652f800 5 asok(0x559317d31270) register_command sync trace history hook 0x7f3da800ee40 2024-09-14T11:02:48.474 INFO:tasks.workunit.client.0.smithi097.stderr: -19> 2024-09-14T11:02:48.401+0000 7f3db652f800 5 asok(0x559317d31270) register_command sync trace active hook 0x7f3da800ee40 2024-09-14T11:02:48.474 INFO:tasks.workunit.client.0.smithi097.stderr: -18> 2024-09-14T11:02:48.401+0000 7f3db652f800 5 asok(0x559317d31270) register_command sync trace active_short hook 0x7f3da800ee40 2024-09-14T11:02:48.474 INFO:tasks.workunit.client.0.smithi097.stderr: -17> 2024-09-14T11:02:48.401+0000 7f3db652f800 20 init_complete bucket index max shards: 11 2024-09-14T11:02:48.474 INFO:tasks.workunit.client.0.smithi097.stderr: -16> 2024-09-14T11:02:48.401+0000 7f3db652f800 20 Filter name: none 2024-09-14T11:02:48.474 INFO:tasks.workunit.client.0.smithi097.stderr: -15> 2024-09-14T11:02:48.401+0000 7f3be17fa640 20 reqs_thread_entry: start 2024-09-14T11:02:48.474 INFO:tasks.workunit.client.0.smithi097.stderr: -14> 2024-09-14T11:02:48.401+0000 7f3db652f800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:02:48.474 INFO:tasks.workunit.client.0.smithi097.stderr: -13> 2024-09-14T11:02:48.401+0000 7f3db652f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.474 INFO:tasks.workunit.client.0.smithi097.stderr: -12> 2024-09-14T11:02:48.402+0000 7f3db652f800 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:02:48.474 INFO:tasks.workunit.client.0.smithi097.stderr: -11> 2024-09-14T11:02:48.402+0000 7f3db652f800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:02:48.474 INFO:tasks.workunit.client.0.smithi097.stderr: -10> 2024-09-14T11:02:48.402+0000 7f3db652f800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:02:48.474 INFO:tasks.workunit.client.0.smithi097.stderr: -9> 2024-09-14T11:02:48.402+0000 7f3db652f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21 : miss 2024-09-14T11:02:48.474 INFO:tasks.workunit.client.0.smithi097.stderr: -8> 2024-09-14T11:02:48.402+0000 7f3db652f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.474 INFO:tasks.workunit.client.0.smithi097.stderr: -7> 2024-09-14T11:02:48.402+0000 7f3db652f800 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:02:48.475 INFO:tasks.workunit.client.0.smithi097.stderr: -6> 2024-09-14T11:02:48.402+0000 7f3db652f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21 info.flags=0x17 2024-09-14T11:02:48.475 INFO:tasks.workunit.client.0.smithi097.stderr: -5> 2024-09-14T11:02:48.402+0000 7f3db652f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21 to cache LRU end 2024-09-14T11:02:48.475 INFO:tasks.workunit.client.0.smithi097.stderr: -4> 2024-09-14T11:02:48.402+0000 7f3db652f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:02:48.475 INFO:tasks.workunit.client.0.smithi097.stderr: -3> 2024-09-14T11:02:48.402+0000 7f3db652f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:02:48.475 INFO:tasks.workunit.client.0.smithi097.stderr: -2> 2024-09-14T11:02:48.402+0000 7f3db652f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21 2024-09-14T11:02:48.475 INFO:tasks.workunit.client.0.smithi097.stderr: -1> 2024-09-14T11:02:48.404+0000 7f3db652f800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3db652f800 time 2024-09-14T11:02:48.404944+0000 2024-09-14T11:02:48.475 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:02:48.475 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:48.475 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:02:48.475 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3db7d8c76a] 2024-09-14T11:02:48.475 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f3db7d8c928] 2024-09-14T11:02:48.475 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559316e040b1] 2024-09-14T11:02:48.475 INFO:tasks.workunit.client.0.smithi097.stderr: 4: radosgw-admin(+0xd882d4) [0x5593173172d4] 2024-09-14T11:02:48.475 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559316e13efd] 2024-09-14T11:02:48.476 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-14T11:02:48.476 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3db6a29590] 2024-09-14T11:02:48.476 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-14T11:02:48.476 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-14T11:02:48.476 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:48.476 INFO:tasks.workunit.client.0.smithi097.stderr: 0> 2024-09-14T11:02:48.405+0000 7f3db652f800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:02:48.476 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f3db652f800 thread_name:radosgw-admin 2024-09-14T11:02:48.476 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:48.476 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:02:48.476 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3db6a3e6f0] 2024-09-14T11:02:48.476 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3db6a8b99c] 2024-09-14T11:02:48.476 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-14T11:02:48.476 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-14T11:02:48.477 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3db7d8c7c4] 2024-09-14T11:02:48.477 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f3db7d8c928] 2024-09-14T11:02:48.477 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559316e040b1] 2024-09-14T11:02:48.477 INFO:tasks.workunit.client.0.smithi097.stderr: 8: radosgw-admin(+0xd882d4) [0x5593173172d4] 2024-09-14T11:02:48.477 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559316e13efd] 2024-09-14T11:02:48.477 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-14T11:02:48.477 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3db6a29590] 2024-09-14T11:02:48.477 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-14T11:02:48.477 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-14T11:02:48.477 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:02:48.477 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:48.477 INFO:tasks.workunit.client.0.smithi097.stderr:--- logging levels --- 2024-09-14T11:02:48.477 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 none 2024-09-14T11:02:48.477 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 lockdep 2024-09-14T11:02:48.478 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 context 2024-09-14T11:02:48.478 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 crush 2024-09-14T11:02:48.478 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds 2024-09-14T11:02:48.478 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_balancer 2024-09-14T11:02:48.478 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_locker 2024-09-14T11:02:48.478 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log 2024-09-14T11:02:48.478 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log_expire 2024-09-14T11:02:48.478 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_migrator 2024-09-14T11:02:48.478 INFO:tasks.workunit.client.0.smithi097.stderr: 3/ 5 mds_quiesce 2024-09-14T11:02:48.478 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 buffer 2024-09-14T11:02:48.478 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 timer 2024-09-14T11:02:48.478 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 filer 2024-09-14T11:02:48.478 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 striper 2024-09-14T11:02:48.479 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 objecter 2024-09-14T11:02:48.479 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rados 2024-09-14T11:02:48.479 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd 2024-09-14T11:02:48.479 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_mirror 2024-09-14T11:02:48.479 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_replay 2024-09-14T11:02:48.479 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_pwl 2024-09-14T11:02:48.479 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 journaler 2024-09-14T11:02:48.479 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objectcacher 2024-09-14T11:02:48.479 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:02:48.479 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 client 2024-09-14T11:02:48.479 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 osd 2024-09-14T11:02:48.479 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 optracker 2024-09-14T11:02:48.479 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objclass 2024-09-14T11:02:48.479 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 filestore 2024-09-14T11:02:48.479 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 journal 2024-09-14T11:02:48.480 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 ms 2024-09-14T11:02:48.480 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mon 2024-09-14T11:02:48.480 INFO:tasks.workunit.client.0.smithi097.stderr: 0/10 monc 2024-09-14T11:02:48.480 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 paxos 2024-09-14T11:02:48.480 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 tp 2024-09-14T11:02:48.480 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 auth 2024-09-14T11:02:48.480 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 crypto 2024-09-14T11:02:48.480 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 finisher 2024-09-14T11:02:48.480 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 reserver 2024-09-14T11:02:48.480 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 heartbeatmap 2024-09-14T11:02:48.480 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 perfcounter 2024-09-14T11:02:48.480 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw 2024-09-14T11:02:48.480 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_sync 2024-09-14T11:02:48.481 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_datacache 2024-09-14T11:02:48.481 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_access 2024-09-14T11:02:48.481 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:02:48.481 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_flight 2024-09-14T11:02:48.481 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:02:48.481 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw_notification 2024-09-14T11:02:48.481 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 javaclient 2024-09-14T11:02:48.481 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 asok 2024-09-14T11:02:48.481 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 throttle 2024-09-14T11:02:48.481 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 refs 2024-09-14T11:02:48.481 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 compressor 2024-09-14T11:02:48.481 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluestore 2024-09-14T11:02:48.481 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluefs 2024-09-14T11:02:48.482 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 bdev 2024-09-14T11:02:48.482 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 kstore 2024-09-14T11:02:48.482 INFO:tasks.workunit.client.0.smithi097.stderr: 4/ 5 rocksdb 2024-09-14T11:02:48.482 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 fuse 2024-09-14T11:02:48.482 INFO:tasks.workunit.client.0.smithi097.stderr: 2/ 5 mgr 2024-09-14T11:02:48.482 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mgrc 2024-09-14T11:02:48.482 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 dpdk 2024-09-14T11:02:48.482 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 eventtrace 2024-09-14T11:02:48.482 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 prioritycache 2024-09-14T11:02:48.482 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 test 2024-09-14T11:02:48.482 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:02:48.482 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephsqlite 2024-09-14T11:02:48.482 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:02:48.483 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore 2024-09-14T11:02:48.483 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_onode 2024-09-14T11:02:48.483 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_odata 2024-09-14T11:02:48.483 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_omap 2024-09-14T11:02:48.483 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_tm 2024-09-14T11:02:48.483 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_t 2024-09-14T11:02:48.483 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:02:48.483 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_epm 2024-09-14T11:02:48.483 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_lba 2024-09-14T11:02:48.483 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:02:48.483 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cache 2024-09-14T11:02:48.483 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_journal 2024-09-14T11:02:48.483 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_device 2024-09-14T11:02:48.484 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_backref 2024-09-14T11:02:48.484 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 alienstore 2024-09-14T11:02:48.484 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mclock 2024-09-14T11:02:48.484 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cyanstore 2024-09-14T11:02:48.484 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 ceph_exporter 2024-09-14T11:02:48.484 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 memstore 2024-09-14T11:02:48.484 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 trace 2024-09-14T11:02:48.484 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 ceph_dedup 2024-09-14T11:02:48.484 INFO:tasks.workunit.client.0.smithi097.stderr: -2/-2 (syslog threshold) 2024-09-14T11:02:48.484 INFO:tasks.workunit.client.0.smithi097.stderr: 99/99 (stderr threshold) 2024-09-14T11:02:48.484 INFO:tasks.workunit.client.0.smithi097.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:02:48.484 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3be17fa640 / http_manager 2024-09-14T11:02:48.484 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3be37fe640 / http_manager 2024-09-14T11:02:48.484 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3c68fe1640 / rgw_dt_lg_renew 2024-09-14T11:02:48.485 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3c83fff640 / ms_dispatch 2024-09-14T11:02:48.485 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3c95ffb640 / io_context_pool 2024-09-14T11:02:48.485 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3c97fff640 / ms_dispatch 2024-09-14T11:02:48.485 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3c9ee05640 / ms_dispatch 2024-09-14T11:02:48.485 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3ca0608640 / io_context_pool 2024-09-14T11:02:48.485 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3db1a75640 / msgr-worker-2 2024-09-14T11:02:48.485 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3db2276640 / msgr-worker-1 2024-09-14T11:02:48.485 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3db2a77640 / msgr-worker-0 2024-09-14T11:02:48.485 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3db3278640 / io_context_pool 2024-09-14T11:02:48.485 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3db652f800 / radosgw-admin 2024-09-14T11:02:48.485 INFO:tasks.workunit.client.0.smithi097.stderr: max_recent 500 2024-09-14T11:02:48.485 INFO:tasks.workunit.client.0.smithi097.stderr: max_new 1000 2024-09-14T11:02:48.485 INFO:tasks.workunit.client.0.smithi097.stderr: log_file /var/log/ceph/ceph-client.admin.90947.log 2024-09-14T11:02:48.485 INFO:tasks.workunit.client.0.smithi097.stderr:--- end dump of recent events --- 2024-09-14T11:02:48.486 INFO:tasks.workunit.client.0.smithi097.stderr:--- begin dump of recent events --- 2024-09-14T11:02:48.486 INFO:tasks.workunit.client.0.smithi097.stderr: -499> 2024-09-14T11:02:48.155+0000 7f3db2a77640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:02:48.486 INFO:tasks.workunit.client.0.smithi097.stderr: -498> 2024-09-14T11:02:48.155+0000 7f3db2a77640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:02:48.486 INFO:tasks.workunit.client.0.smithi097.stderr: -497> 2024-09-14T11:02:48.155+0000 7f3db2276640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:02:48.486 INFO:tasks.workunit.client.0.smithi097.stderr: -496> 2024-09-14T11:02:48.155+0000 7f3db2276640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:02:48.486 INFO:tasks.workunit.client.0.smithi097.stderr: -495> 2024-09-14T11:02:48.155+0000 7f3db2276640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:02:48.486 INFO:tasks.workunit.client.0.smithi097.stderr: -494> 2024-09-14T11:02:48.155+0000 7f3db1a75640 10 monclient(hunting): handle_auth_done global_id 6369 payload 274 2024-09-14T11:02:48.486 INFO:tasks.workunit.client.0.smithi097.stderr: -493> 2024-09-14T11:02:48.155+0000 7f3db1a75640 10 monclient: _finish_hunting 0 2024-09-14T11:02:48.486 INFO:tasks.workunit.client.0.smithi097.stderr: -492> 2024-09-14T11:02:48.155+0000 7f3db1a75640 1 monclient: found mon.noname-a 2024-09-14T11:02:48.486 INFO:tasks.workunit.client.0.smithi097.stderr: -491> 2024-09-14T11:02:48.155+0000 7f3db1a75640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-14T11:02:48.486 INFO:tasks.workunit.client.0.smithi097.stderr: -490> 2024-09-14T11:02:48.155+0000 7f3ca0608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:02:48.486 INFO:tasks.workunit.client.0.smithi097.stderr: -489> 2024-09-14T11:02:48.155+0000 7f3ca0608640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:02:48.486 INFO:tasks.workunit.client.0.smithi097.stderr: -488> 2024-09-14T11:02:48.155+0000 7f3ca0608640 10 monclient: dump: 2024-09-14T11:02:48.487 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:02:48.487 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:02:48.487 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:02:48.487 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:02:48.487 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:02:48.487 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:02:48.487 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:02:48.487 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:02:48.487 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:02:48.487 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:48.487 INFO:tasks.workunit.client.0.smithi097.stderr: -487> 2024-09-14T11:02:48.155+0000 7f3ca0608640 10 monclient: _finish_auth 0 2024-09-14T11:02:48.487 INFO:tasks.workunit.client.0.smithi097.stderr: -486> 2024-09-14T11:02:48.155+0000 7f3ca0608640 10 monclient: _check_auth_tickets 2024-09-14T11:02:48.487 INFO:tasks.workunit.client.0.smithi097.stderr: -485> 2024-09-14T11:02:48.155+0000 7f3ca0608640 10 monclient: handle_config config(0 keys) 2024-09-14T11:02:48.487 INFO:tasks.workunit.client.0.smithi097.stderr: -484> 2024-09-14T11:02:48.155+0000 7f3db652f800 5 monclient: authenticate success, global_id 6369 2024-09-14T11:02:48.488 INFO:tasks.workunit.client.0.smithi097.stderr: -483> 2024-09-14T11:02:48.155+0000 7f3db652f800 10 monclient: get_monmap_and_config success 2024-09-14T11:02:48.488 INFO:tasks.workunit.client.0.smithi097.stderr: -482> 2024-09-14T11:02:48.155+0000 7f3db652f800 4 set_mon_vals no callback set 2024-09-14T11:02:48.488 INFO:tasks.workunit.client.0.smithi097.stderr: -481> 2024-09-14T11:02:48.155+0000 7f3ca0608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:02:48.488 INFO:tasks.workunit.client.0.smithi097.stderr: -480> 2024-09-14T11:02:48.155+0000 7f3ca0608640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:02:48.488 INFO:tasks.workunit.client.0.smithi097.stderr: -479> 2024-09-14T11:02:48.155+0000 7f3ca0608640 10 monclient: dump: 2024-09-14T11:02:48.488 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:02:48.488 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:02:48.488 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:02:48.488 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:02:48.488 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:02:48.488 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:02:48.488 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:02:48.489 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:02:48.489 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:02:48.489 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:48.489 INFO:tasks.workunit.client.0.smithi097.stderr: -478> 2024-09-14T11:02:48.156+0000 7f3db652f800 10 monclient: shutdown 2024-09-14T11:02:48.489 INFO:tasks.workunit.client.0.smithi097.stderr: -477> 2024-09-14T11:02:48.156+0000 7f3db652f800 5 asok(0x559317d31270) unregister_commands rotate-key 2024-09-14T11:02:48.489 INFO:tasks.workunit.client.0.smithi097.stderr: -476> 2024-09-14T11:02:48.156+0000 7f3db652f800 10 monclient: build_initial_monmap 2024-09-14T11:02:48.489 INFO:tasks.workunit.client.0.smithi097.stderr: -475> 2024-09-14T11:02:48.156+0000 7f3db652f800 1 build_initial for_mkfs: 0 2024-09-14T11:02:48.489 INFO:tasks.workunit.client.0.smithi097.stderr: -474> 2024-09-14T11:02:48.156+0000 7f3db652f800 10 monclient: monmap: 2024-09-14T11:02:48.489 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:02:48.489 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:02:48.489 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:02:48.489 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:02:48.490 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:02:48.490 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:02:48.490 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:02:48.490 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:02:48.490 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:02:48.490 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:48.490 INFO:tasks.workunit.client.0.smithi097.stderr: -473> 2024-09-14T11:02:48.156+0000 7f3db652f800 5 AuthRegistry(0x559317f59290) adding auth protocol: cephx 2024-09-14T11:02:48.490 INFO:tasks.workunit.client.0.smithi097.stderr: -472> 2024-09-14T11:02:48.156+0000 7f3db652f800 5 AuthRegistry(0x559317f59290) adding auth protocol: cephx 2024-09-14T11:02:48.490 INFO:tasks.workunit.client.0.smithi097.stderr: -471> 2024-09-14T11:02:48.156+0000 7f3db652f800 5 AuthRegistry(0x559317f59290) adding auth protocol: cephx 2024-09-14T11:02:48.490 INFO:tasks.workunit.client.0.smithi097.stderr: -470> 2024-09-14T11:02:48.156+0000 7f3db652f800 5 AuthRegistry(0x559317f59290) adding con mode: secure 2024-09-14T11:02:48.490 INFO:tasks.workunit.client.0.smithi097.stderr: -469> 2024-09-14T11:02:48.156+0000 7f3db652f800 5 AuthRegistry(0x559317f59290) adding con mode: crc 2024-09-14T11:02:48.490 INFO:tasks.workunit.client.0.smithi097.stderr: -468> 2024-09-14T11:02:48.156+0000 7f3db652f800 5 AuthRegistry(0x559317f59290) adding con mode: secure 2024-09-14T11:02:48.490 INFO:tasks.workunit.client.0.smithi097.stderr: -467> 2024-09-14T11:02:48.156+0000 7f3db652f800 5 AuthRegistry(0x559317f59290) adding con mode: crc 2024-09-14T11:02:48.491 INFO:tasks.workunit.client.0.smithi097.stderr: -466> 2024-09-14T11:02:48.156+0000 7f3db652f800 5 AuthRegistry(0x559317f59290) adding con mode: secure 2024-09-14T11:02:48.491 INFO:tasks.workunit.client.0.smithi097.stderr: -465> 2024-09-14T11:02:48.156+0000 7f3db652f800 5 AuthRegistry(0x559317f59290) adding con mode: crc 2024-09-14T11:02:48.491 INFO:tasks.workunit.client.0.smithi097.stderr: -464> 2024-09-14T11:02:48.156+0000 7f3db652f800 5 AuthRegistry(0x559317f59290) adding con mode: crc 2024-09-14T11:02:48.491 INFO:tasks.workunit.client.0.smithi097.stderr: -463> 2024-09-14T11:02:48.156+0000 7f3db652f800 5 AuthRegistry(0x559317f59290) adding con mode: secure 2024-09-14T11:02:48.491 INFO:tasks.workunit.client.0.smithi097.stderr: -462> 2024-09-14T11:02:48.156+0000 7f3db652f800 5 AuthRegistry(0x559317f59290) adding con mode: crc 2024-09-14T11:02:48.491 INFO:tasks.workunit.client.0.smithi097.stderr: -461> 2024-09-14T11:02:48.156+0000 7f3db652f800 5 AuthRegistry(0x559317f59290) adding con mode: secure 2024-09-14T11:02:48.491 INFO:tasks.workunit.client.0.smithi097.stderr: -460> 2024-09-14T11:02:48.156+0000 7f3db652f800 5 AuthRegistry(0x559317f59290) adding con mode: crc 2024-09-14T11:02:48.491 INFO:tasks.workunit.client.0.smithi097.stderr: -459> 2024-09-14T11:02:48.156+0000 7f3db652f800 5 AuthRegistry(0x559317f59290) adding con mode: secure 2024-09-14T11:02:48.491 INFO:tasks.workunit.client.0.smithi097.stderr: -458> 2024-09-14T11:02:48.156+0000 7f3db652f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:02:48.491 INFO:tasks.workunit.client.0.smithi097.stderr: -457> 2024-09-14T11:02:48.156+0000 7f3db652f800 1 librados: starting msgr at 2024-09-14T11:02:48.491 INFO:tasks.workunit.client.0.smithi097.stderr: -456> 2024-09-14T11:02:48.156+0000 7f3db652f800 1 librados: starting objecter 2024-09-14T11:02:48.491 INFO:tasks.workunit.client.0.smithi097.stderr: -455> 2024-09-14T11:02:48.157+0000 7f3db652f800 5 asok(0x559317d31270) register_command objecter_requests hook 0x559317f5b4c0 2024-09-14T11:02:48.491 INFO:tasks.workunit.client.0.smithi097.stderr: -454> 2024-09-14T11:02:48.157+0000 7f3db652f800 1 librados: setting wanted keys 2024-09-14T11:02:48.492 INFO:tasks.workunit.client.0.smithi097.stderr: -453> 2024-09-14T11:02:48.157+0000 7f3db652f800 1 librados: calling monclient init 2024-09-14T11:02:48.492 INFO:tasks.workunit.client.0.smithi097.stderr: -452> 2024-09-14T11:02:48.157+0000 7f3db652f800 10 monclient: init 2024-09-14T11:02:48.492 INFO:tasks.workunit.client.0.smithi097.stderr: -451> 2024-09-14T11:02:48.157+0000 7f3db652f800 5 AuthRegistry(0x559317f535e0) adding auth protocol: cephx 2024-09-14T11:02:48.492 INFO:tasks.workunit.client.0.smithi097.stderr: -450> 2024-09-14T11:02:48.157+0000 7f3db652f800 5 AuthRegistry(0x559317f535e0) adding auth protocol: cephx 2024-09-14T11:02:48.492 INFO:tasks.workunit.client.0.smithi097.stderr: -449> 2024-09-14T11:02:48.157+0000 7f3db652f800 5 AuthRegistry(0x559317f535e0) adding auth protocol: cephx 2024-09-14T11:02:48.492 INFO:tasks.workunit.client.0.smithi097.stderr: -448> 2024-09-14T11:02:48.157+0000 7f3db652f800 5 AuthRegistry(0x559317f535e0) adding con mode: secure 2024-09-14T11:02:48.492 INFO:tasks.workunit.client.0.smithi097.stderr: -447> 2024-09-14T11:02:48.157+0000 7f3db652f800 5 AuthRegistry(0x559317f535e0) adding con mode: crc 2024-09-14T11:02:48.492 INFO:tasks.workunit.client.0.smithi097.stderr: -446> 2024-09-14T11:02:48.157+0000 7f3db652f800 5 AuthRegistry(0x559317f535e0) adding con mode: secure 2024-09-14T11:02:48.492 INFO:tasks.workunit.client.0.smithi097.stderr: -445> 2024-09-14T11:02:48.157+0000 7f3db652f800 5 AuthRegistry(0x559317f535e0) adding con mode: crc 2024-09-14T11:02:48.492 INFO:tasks.workunit.client.0.smithi097.stderr: -444> 2024-09-14T11:02:48.157+0000 7f3db652f800 5 AuthRegistry(0x559317f535e0) adding con mode: secure 2024-09-14T11:02:48.492 INFO:tasks.workunit.client.0.smithi097.stderr: -443> 2024-09-14T11:02:48.157+0000 7f3db652f800 5 AuthRegistry(0x559317f535e0) adding con mode: crc 2024-09-14T11:02:48.492 INFO:tasks.workunit.client.0.smithi097.stderr: -442> 2024-09-14T11:02:48.157+0000 7f3db652f800 5 AuthRegistry(0x559317f535e0) adding con mode: crc 2024-09-14T11:02:48.492 INFO:tasks.workunit.client.0.smithi097.stderr: -441> 2024-09-14T11:02:48.157+0000 7f3db652f800 5 AuthRegistry(0x559317f535e0) adding con mode: secure 2024-09-14T11:02:48.493 INFO:tasks.workunit.client.0.smithi097.stderr: -440> 2024-09-14T11:02:48.157+0000 7f3db652f800 5 AuthRegistry(0x559317f535e0) adding con mode: crc 2024-09-14T11:02:48.493 INFO:tasks.workunit.client.0.smithi097.stderr: -439> 2024-09-14T11:02:48.157+0000 7f3db652f800 5 AuthRegistry(0x559317f535e0) adding con mode: secure 2024-09-14T11:02:48.493 INFO:tasks.workunit.client.0.smithi097.stderr: -438> 2024-09-14T11:02:48.157+0000 7f3db652f800 5 AuthRegistry(0x559317f535e0) adding con mode: crc 2024-09-14T11:02:48.493 INFO:tasks.workunit.client.0.smithi097.stderr: -437> 2024-09-14T11:02:48.157+0000 7f3db652f800 5 AuthRegistry(0x559317f535e0) adding con mode: secure 2024-09-14T11:02:48.493 INFO:tasks.workunit.client.0.smithi097.stderr: -436> 2024-09-14T11:02:48.157+0000 7f3db652f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:02:48.493 INFO:tasks.workunit.client.0.smithi097.stderr: -435> 2024-09-14T11:02:48.157+0000 7f3db652f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:02:48.493 INFO:tasks.workunit.client.0.smithi097.stderr: -434> 2024-09-14T11:02:48.157+0000 7f3db652f800 5 asok(0x559317d31270) register_command rotate-key hook 0x559317f53728 2024-09-14T11:02:48.493 INFO:tasks.workunit.client.0.smithi097.stderr: -433> 2024-09-14T11:02:48.157+0000 7f3db652f800 10 monclient: _reopen_session rank -1 2024-09-14T11:02:48.493 INFO:tasks.workunit.client.0.smithi097.stderr: -432> 2024-09-14T11:02:48.157+0000 7f3db652f800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:02:48.493 INFO:tasks.workunit.client.0.smithi097.stderr: -431> 2024-09-14T11:02:48.157+0000 7f3db652f800 10 monclient(hunting): picked mon.noname-a con 0x559317e07fc0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:02:48.493 INFO:tasks.workunit.client.0.smithi097.stderr: -430> 2024-09-14T11:02:48.157+0000 7f3db652f800 10 monclient(hunting): picked mon.noname-b con 0x559317e966a0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:02:48.493 INFO:tasks.workunit.client.0.smithi097.stderr: -429> 2024-09-14T11:02:48.157+0000 7f3db652f800 10 monclient(hunting): picked mon.noname-c con 0x559317e9cdf0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:02:48.494 INFO:tasks.workunit.client.0.smithi097.stderr: -428> 2024-09-14T11:02:48.157+0000 7f3db652f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:02:48.494 INFO:tasks.workunit.client.0.smithi097.stderr: -427> 2024-09-14T11:02:48.157+0000 7f3db652f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:02:48.494 INFO:tasks.workunit.client.0.smithi097.stderr: -426> 2024-09-14T11:02:48.157+0000 7f3db652f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:02:48.494 INFO:tasks.workunit.client.0.smithi097.stderr: -425> 2024-09-14T11:02:48.157+0000 7f3db652f800 10 monclient(hunting): _renew_subs 2024-09-14T11:02:48.494 INFO:tasks.workunit.client.0.smithi097.stderr: -424> 2024-09-14T11:02:48.157+0000 7f3db652f800 10 monclient(hunting): authenticate will time out at 1849.810666s 2024-09-14T11:02:48.494 INFO:tasks.workunit.client.0.smithi097.stderr: -423> 2024-09-14T11:02:48.157+0000 7f3db2276640 10 monclient(hunting): get_auth_request con 0x559317e07fc0 auth_method 0 2024-09-14T11:02:48.494 INFO:tasks.workunit.client.0.smithi097.stderr: -422> 2024-09-14T11:02:48.157+0000 7f3db2276640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:02:48.494 INFO:tasks.workunit.client.0.smithi097.stderr: -421> 2024-09-14T11:02:48.157+0000 7f3db2276640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:02:48.494 INFO:tasks.workunit.client.0.smithi097.stderr: -420> 2024-09-14T11:02:48.157+0000 7f3db2276640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:02:48.494 INFO:tasks.workunit.client.0.smithi097.stderr: -419> 2024-09-14T11:02:48.157+0000 7f3db2a77640 10 monclient(hunting): get_auth_request con 0x559317e9cdf0 auth_method 0 2024-09-14T11:02:48.494 INFO:tasks.workunit.client.0.smithi097.stderr: -418> 2024-09-14T11:02:48.157+0000 7f3db2a77640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:02:48.494 INFO:tasks.workunit.client.0.smithi097.stderr: -417> 2024-09-14T11:02:48.157+0000 7f3db2a77640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:02:48.494 INFO:tasks.workunit.client.0.smithi097.stderr: -416> 2024-09-14T11:02:48.157+0000 7f3db2a77640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:02:48.495 INFO:tasks.workunit.client.0.smithi097.stderr: -415> 2024-09-14T11:02:48.157+0000 7f3db2276640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:02:48.495 INFO:tasks.workunit.client.0.smithi097.stderr: -414> 2024-09-14T11:02:48.157+0000 7f3db2276640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:02:48.495 INFO:tasks.workunit.client.0.smithi097.stderr: -413> 2024-09-14T11:02:48.157+0000 7f3db2276640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:02:48.495 INFO:tasks.workunit.client.0.smithi097.stderr: -412> 2024-09-14T11:02:48.157+0000 7f3db2a77640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:02:48.495 INFO:tasks.workunit.client.0.smithi097.stderr: -411> 2024-09-14T11:02:48.157+0000 7f3db2a77640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:02:48.495 INFO:tasks.workunit.client.0.smithi097.stderr: -410> 2024-09-14T11:02:48.157+0000 7f3db2a77640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:02:48.495 INFO:tasks.workunit.client.0.smithi097.stderr: -409> 2024-09-14T11:02:48.157+0000 7f3db1a75640 10 monclient(hunting): get_auth_request con 0x559317e966a0 auth_method 0 2024-09-14T11:02:48.495 INFO:tasks.workunit.client.0.smithi097.stderr: -408> 2024-09-14T11:02:48.157+0000 7f3db1a75640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:02:48.495 INFO:tasks.workunit.client.0.smithi097.stderr: -407> 2024-09-14T11:02:48.157+0000 7f3db1a75640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:02:48.495 INFO:tasks.workunit.client.0.smithi097.stderr: -406> 2024-09-14T11:02:48.157+0000 7f3db1a75640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:02:48.495 INFO:tasks.workunit.client.0.smithi097.stderr: -405> 2024-09-14T11:02:48.157+0000 7f3db1a75640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:02:48.495 INFO:tasks.workunit.client.0.smithi097.stderr: -404> 2024-09-14T11:02:48.157+0000 7f3db1a75640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:02:48.495 INFO:tasks.workunit.client.0.smithi097.stderr: -403> 2024-09-14T11:02:48.157+0000 7f3db1a75640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:02:48.496 INFO:tasks.workunit.client.0.smithi097.stderr: -402> 2024-09-14T11:02:48.157+0000 7f3db2a77640 10 monclient(hunting): handle_auth_done global_id 6059 payload 824 2024-09-14T11:02:48.496 INFO:tasks.workunit.client.0.smithi097.stderr: -401> 2024-09-14T11:02:48.158+0000 7f3db2a77640 10 monclient: _finish_hunting 0 2024-09-14T11:02:48.496 INFO:tasks.workunit.client.0.smithi097.stderr: -400> 2024-09-14T11:02:48.158+0000 7f3db2a77640 1 monclient: found mon.noname-c 2024-09-14T11:02:48.496 INFO:tasks.workunit.client.0.smithi097.stderr: -399> 2024-09-14T11:02:48.158+0000 7f3db2a77640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:02:48.496 INFO:tasks.workunit.client.0.smithi097.stderr: -398> 2024-09-14T11:02:48.158+0000 7f3c9ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:02:48.496 INFO:tasks.workunit.client.0.smithi097.stderr: -397> 2024-09-14T11:02:48.158+0000 7f3c9ee05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:02:48.496 INFO:tasks.workunit.client.0.smithi097.stderr: -396> 2024-09-14T11:02:48.158+0000 7f3c9ee05640 10 monclient: dump: 2024-09-14T11:02:48.496 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:02:48.496 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:02:48.496 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:02:48.496 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:02:48.496 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:02:48.496 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:02:48.497 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:02:48.497 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:02:48.497 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:02:48.497 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:48.497 INFO:tasks.workunit.client.0.smithi097.stderr: -395> 2024-09-14T11:02:48.158+0000 7f3c9ee05640 10 monclient: _finish_auth 0 2024-09-14T11:02:48.497 INFO:tasks.workunit.client.0.smithi097.stderr: -394> 2024-09-14T11:02:48.158+0000 7f3c9ee05640 10 monclient: _check_auth_tickets 2024-09-14T11:02:48.497 INFO:tasks.workunit.client.0.smithi097.stderr: -393> 2024-09-14T11:02:48.158+0000 7f3c9ee05640 10 monclient: handle_config config(0 keys) 2024-09-14T11:02:48.497 INFO:tasks.workunit.client.0.smithi097.stderr: -392> 2024-09-14T11:02:48.158+0000 7f3c9ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:02:48.497 INFO:tasks.workunit.client.0.smithi097.stderr: -391> 2024-09-14T11:02:48.158+0000 7f3c9ee05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:02:48.497 INFO:tasks.workunit.client.0.smithi097.stderr: -390> 2024-09-14T11:02:48.158+0000 7f3c9ee05640 10 monclient: dump: 2024-09-14T11:02:48.497 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:02:48.497 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:02:48.497 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:02:48.498 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:02:48.498 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:02:48.498 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:02:48.498 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:02:48.498 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:02:48.498 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:02:48.498 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:48.498 INFO:tasks.workunit.client.0.smithi097.stderr: -389> 2024-09-14T11:02:48.158+0000 7f3db652f800 5 monclient: authenticate success, global_id 6059 2024-09-14T11:02:48.498 INFO:tasks.workunit.client.0.smithi097.stderr: -388> 2024-09-14T11:02:48.158+0000 7f3db652f800 10 monclient: _renew_subs 2024-09-14T11:02:48.498 INFO:tasks.workunit.client.0.smithi097.stderr: -387> 2024-09-14T11:02:48.158+0000 7f3db652f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:02:48.498 INFO:tasks.workunit.client.0.smithi097.stderr: -386> 2024-09-14T11:02:48.158+0000 7f3ca0608640 4 set_mon_vals no callback set 2024-09-14T11:02:48.498 INFO:tasks.workunit.client.0.smithi097.stderr: -385> 2024-09-14T11:02:48.158+0000 7f3db652f800 10 monclient: _renew_subs 2024-09-14T11:02:48.498 INFO:tasks.workunit.client.0.smithi097.stderr: -384> 2024-09-14T11:02:48.158+0000 7f3db652f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:02:48.498 INFO:tasks.workunit.client.0.smithi097.stderr: -383> 2024-09-14T11:02:48.158+0000 7f3db652f800 1 librados: init done 2024-09-14T11:02:48.499 INFO:tasks.workunit.client.0.smithi097.stderr: -382> 2024-09-14T11:02:48.160+0000 7f3c9ee05640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:02:48.499 INFO:tasks.workunit.client.0.smithi097.stderr: -381> 2024-09-14T11:02:48.160+0000 7f3c9ee05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:02:48.499 INFO:tasks.workunit.client.0.smithi097.stderr: -380> 2024-09-14T11:02:48.160+0000 7f3c9ee05640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:02:48.499 INFO:tasks.workunit.client.0.smithi097.stderr: -379> 2024-09-14T11:02:48.160+0000 7f3db2276640 10 monclient: get_auth_request con 0x7f3c98077230 auth_method 0 2024-09-14T11:02:48.499 INFO:tasks.workunit.client.0.smithi097.stderr: -378> 2024-09-14T11:02:48.160+0000 7f3db1a75640 10 monclient: get_auth_request con 0x559317f7c550 auth_method 0 2024-09-14T11:02:48.499 INFO:tasks.workunit.client.0.smithi097.stderr: -377> 2024-09-14T11:02:48.161+0000 7f3db2276640 10 monclient: get_auth_request con 0x559317f9edc0 auth_method 0 2024-09-14T11:02:48.499 INFO:tasks.workunit.client.0.smithi097.stderr: -376> 2024-09-14T11:02:48.162+0000 7f3db1a75640 10 monclient: get_auth_request con 0x559317fa31b0 auth_method 0 2024-09-14T11:02:48.499 INFO:tasks.workunit.client.0.smithi097.stderr: -375> 2024-09-14T11:02:48.163+0000 7f3db2a77640 10 monclient: get_auth_request con 0x559317fa2660 auth_method 0 2024-09-14T11:02:48.499 INFO:tasks.workunit.client.0.smithi097.stderr: -374> 2024-09-14T11:02:48.163+0000 7f3db652f800 10 monclient: build_initial_monmap 2024-09-14T11:02:48.499 INFO:tasks.workunit.client.0.smithi097.stderr: -373> 2024-09-14T11:02:48.163+0000 7f3db652f800 1 build_initial for_mkfs: 0 2024-09-14T11:02:48.499 INFO:tasks.workunit.client.0.smithi097.stderr: -372> 2024-09-14T11:02:48.163+0000 7f3db652f800 10 monclient: monmap: 2024-09-14T11:02:48.499 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:02:48.499 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:02:48.500 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:02:48.500 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:02:48.500 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:02:48.500 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:02:48.500 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:02:48.500 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:02:48.500 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:02:48.500 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:48.500 INFO:tasks.workunit.client.0.smithi097.stderr: -371> 2024-09-14T11:02:48.163+0000 7f3db652f800 5 AuthRegistry(0x559317fab420) adding auth protocol: cephx 2024-09-14T11:02:48.500 INFO:tasks.workunit.client.0.smithi097.stderr: -370> 2024-09-14T11:02:48.163+0000 7f3db652f800 5 AuthRegistry(0x559317fab420) adding auth protocol: cephx 2024-09-14T11:02:48.500 INFO:tasks.workunit.client.0.smithi097.stderr: -369> 2024-09-14T11:02:48.163+0000 7f3db652f800 5 AuthRegistry(0x559317fab420) adding auth protocol: cephx 2024-09-14T11:02:48.500 INFO:tasks.workunit.client.0.smithi097.stderr: -368> 2024-09-14T11:02:48.163+0000 7f3db652f800 5 AuthRegistry(0x559317fab420) adding con mode: secure 2024-09-14T11:02:48.500 INFO:tasks.workunit.client.0.smithi097.stderr: -367> 2024-09-14T11:02:48.163+0000 7f3db652f800 5 AuthRegistry(0x559317fab420) adding con mode: crc 2024-09-14T11:02:48.501 INFO:tasks.workunit.client.0.smithi097.stderr: -366> 2024-09-14T11:02:48.163+0000 7f3db652f800 5 AuthRegistry(0x559317fab420) adding con mode: secure 2024-09-14T11:02:48.501 INFO:tasks.workunit.client.0.smithi097.stderr: -365> 2024-09-14T11:02:48.163+0000 7f3db652f800 5 AuthRegistry(0x559317fab420) adding con mode: crc 2024-09-14T11:02:48.501 INFO:tasks.workunit.client.0.smithi097.stderr: -364> 2024-09-14T11:02:48.163+0000 7f3db652f800 5 AuthRegistry(0x559317fab420) adding con mode: secure 2024-09-14T11:02:48.501 INFO:tasks.workunit.client.0.smithi097.stderr: -363> 2024-09-14T11:02:48.163+0000 7f3db652f800 5 AuthRegistry(0x559317fab420) adding con mode: crc 2024-09-14T11:02:48.501 INFO:tasks.workunit.client.0.smithi097.stderr: -362> 2024-09-14T11:02:48.163+0000 7f3db652f800 5 AuthRegistry(0x559317fab420) adding con mode: crc 2024-09-14T11:02:48.501 INFO:tasks.workunit.client.0.smithi097.stderr: -361> 2024-09-14T11:02:48.163+0000 7f3db652f800 5 AuthRegistry(0x559317fab420) adding con mode: secure 2024-09-14T11:02:48.501 INFO:tasks.workunit.client.0.smithi097.stderr: -360> 2024-09-14T11:02:48.163+0000 7f3db652f800 5 AuthRegistry(0x559317fab420) adding con mode: crc 2024-09-14T11:02:48.501 INFO:tasks.workunit.client.0.smithi097.stderr: -359> 2024-09-14T11:02:48.163+0000 7f3db652f800 5 AuthRegistry(0x559317fab420) adding con mode: secure 2024-09-14T11:02:48.501 INFO:tasks.workunit.client.0.smithi097.stderr: -358> 2024-09-14T11:02:48.163+0000 7f3db652f800 5 AuthRegistry(0x559317fab420) adding con mode: crc 2024-09-14T11:02:48.501 INFO:tasks.workunit.client.0.smithi097.stderr: -357> 2024-09-14T11:02:48.163+0000 7f3db652f800 5 AuthRegistry(0x559317fab420) adding con mode: secure 2024-09-14T11:02:48.501 INFO:tasks.workunit.client.0.smithi097.stderr: -356> 2024-09-14T11:02:48.164+0000 7f3db652f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:02:48.501 INFO:tasks.workunit.client.0.smithi097.stderr: -355> 2024-09-14T11:02:48.164+0000 7f3db652f800 5 asok(0x559317d31270) register_command objecter_requests cmddesc objecter_requests hook 0x559317fae840 EEXIST 2024-09-14T11:02:48.501 INFO:tasks.workunit.client.0.smithi097.stderr: -354> 2024-09-14T11:02:48.164+0000 7f3db652f800 10 monclient: init 2024-09-14T11:02:48.501 INFO:tasks.workunit.client.0.smithi097.stderr: -353> 2024-09-14T11:02:48.164+0000 7f3db652f800 5 AuthRegistry(0x559317faa278) adding auth protocol: cephx 2024-09-14T11:02:48.502 INFO:tasks.workunit.client.0.smithi097.stderr: -352> 2024-09-14T11:02:48.164+0000 7f3db652f800 5 AuthRegistry(0x559317faa278) adding auth protocol: cephx 2024-09-14T11:02:48.502 INFO:tasks.workunit.client.0.smithi097.stderr: -351> 2024-09-14T11:02:48.164+0000 7f3db652f800 5 AuthRegistry(0x559317faa278) adding auth protocol: cephx 2024-09-14T11:02:48.502 INFO:tasks.workunit.client.0.smithi097.stderr: -350> 2024-09-14T11:02:48.164+0000 7f3db652f800 5 AuthRegistry(0x559317faa278) adding con mode: secure 2024-09-14T11:02:48.502 INFO:tasks.workunit.client.0.smithi097.stderr: -349> 2024-09-14T11:02:48.164+0000 7f3db652f800 5 AuthRegistry(0x559317faa278) adding con mode: crc 2024-09-14T11:02:48.502 INFO:tasks.workunit.client.0.smithi097.stderr: -348> 2024-09-14T11:02:48.164+0000 7f3db652f800 5 AuthRegistry(0x559317faa278) adding con mode: secure 2024-09-14T11:02:48.502 INFO:tasks.workunit.client.0.smithi097.stderr: -347> 2024-09-14T11:02:48.164+0000 7f3db652f800 5 AuthRegistry(0x559317faa278) adding con mode: crc 2024-09-14T11:02:48.502 INFO:tasks.workunit.client.0.smithi097.stderr: -346> 2024-09-14T11:02:48.164+0000 7f3db652f800 5 AuthRegistry(0x559317faa278) adding con mode: secure 2024-09-14T11:02:48.502 INFO:tasks.workunit.client.0.smithi097.stderr: -345> 2024-09-14T11:02:48.164+0000 7f3db652f800 5 AuthRegistry(0x559317faa278) adding con mode: crc 2024-09-14T11:02:48.502 INFO:tasks.workunit.client.0.smithi097.stderr: -344> 2024-09-14T11:02:48.164+0000 7f3db652f800 5 AuthRegistry(0x559317faa278) adding con mode: crc 2024-09-14T11:02:48.502 INFO:tasks.workunit.client.0.smithi097.stderr: -343> 2024-09-14T11:02:48.164+0000 7f3db652f800 5 AuthRegistry(0x559317faa278) adding con mode: secure 2024-09-14T11:02:48.502 INFO:tasks.workunit.client.0.smithi097.stderr: -342> 2024-09-14T11:02:48.164+0000 7f3db652f800 5 AuthRegistry(0x559317faa278) adding con mode: crc 2024-09-14T11:02:48.502 INFO:tasks.workunit.client.0.smithi097.stderr: -341> 2024-09-14T11:02:48.164+0000 7f3db652f800 5 AuthRegistry(0x559317faa278) adding con mode: secure 2024-09-14T11:02:48.502 INFO:tasks.workunit.client.0.smithi097.stderr: -340> 2024-09-14T11:02:48.164+0000 7f3db652f800 5 AuthRegistry(0x559317faa278) adding con mode: crc 2024-09-14T11:02:48.503 INFO:tasks.workunit.client.0.smithi097.stderr: -339> 2024-09-14T11:02:48.164+0000 7f3db652f800 5 AuthRegistry(0x559317faa278) adding con mode: secure 2024-09-14T11:02:48.503 INFO:tasks.workunit.client.0.smithi097.stderr: -338> 2024-09-14T11:02:48.164+0000 7f3db652f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:02:48.503 INFO:tasks.workunit.client.0.smithi097.stderr: -337> 2024-09-14T11:02:48.164+0000 7f3db652f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:02:48.503 INFO:tasks.workunit.client.0.smithi097.stderr: -336> 2024-09-14T11:02:48.164+0000 7f3db652f800 5 asok(0x559317d31270) register_command rotate-key cmddesc rotate-key hook 0x559317faa3c0 EEXIST 2024-09-14T11:02:48.503 INFO:tasks.workunit.client.0.smithi097.stderr: -335> 2024-09-14T11:02:48.164+0000 7f3db652f800 10 monclient: _reopen_session rank -1 2024-09-14T11:02:48.503 INFO:tasks.workunit.client.0.smithi097.stderr: -334> 2024-09-14T11:02:48.164+0000 7f3db652f800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:02:48.503 INFO:tasks.workunit.client.0.smithi097.stderr: -333> 2024-09-14T11:02:48.165+0000 7f3db652f800 10 monclient(hunting): picked mon.noname-c con 0x559317fd2b60 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:02:48.503 INFO:tasks.workunit.client.0.smithi097.stderr: -332> 2024-09-14T11:02:48.165+0000 7f3db652f800 10 monclient(hunting): picked mon.noname-a con 0x559317fd2f40 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:02:48.503 INFO:tasks.workunit.client.0.smithi097.stderr: -331> 2024-09-14T11:02:48.165+0000 7f3db652f800 10 monclient(hunting): picked mon.noname-b con 0x559317fd1870 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:02:48.503 INFO:tasks.workunit.client.0.smithi097.stderr: -330> 2024-09-14T11:02:48.165+0000 7f3db652f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:02:48.503 INFO:tasks.workunit.client.0.smithi097.stderr: -329> 2024-09-14T11:02:48.165+0000 7f3db652f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:02:48.503 INFO:tasks.workunit.client.0.smithi097.stderr: -328> 2024-09-14T11:02:48.165+0000 7f3db652f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:02:48.503 INFO:tasks.workunit.client.0.smithi097.stderr: -327> 2024-09-14T11:02:48.165+0000 7f3db652f800 10 monclient(hunting): _renew_subs 2024-09-14T11:02:48.503 INFO:tasks.workunit.client.0.smithi097.stderr: -326> 2024-09-14T11:02:48.165+0000 7f3db652f800 10 monclient(hunting): authenticate will time out at 1849.818052s 2024-09-14T11:02:48.504 INFO:tasks.workunit.client.0.smithi097.stderr: -325> 2024-09-14T11:02:48.165+0000 7f3db2a77640 10 monclient(hunting): get_auth_request con 0x559317fd2f40 auth_method 0 2024-09-14T11:02:48.504 INFO:tasks.workunit.client.0.smithi097.stderr: -324> 2024-09-14T11:02:48.165+0000 7f3db2a77640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:02:48.504 INFO:tasks.workunit.client.0.smithi097.stderr: -323> 2024-09-14T11:02:48.165+0000 7f3db2a77640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:02:48.504 INFO:tasks.workunit.client.0.smithi097.stderr: -322> 2024-09-14T11:02:48.165+0000 7f3db2a77640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:02:48.504 INFO:tasks.workunit.client.0.smithi097.stderr: -321> 2024-09-14T11:02:48.165+0000 7f3db1a75640 10 monclient(hunting): get_auth_request con 0x559317fd2b60 auth_method 0 2024-09-14T11:02:48.504 INFO:tasks.workunit.client.0.smithi097.stderr: -320> 2024-09-14T11:02:48.165+0000 7f3db1a75640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:02:48.504 INFO:tasks.workunit.client.0.smithi097.stderr: -319> 2024-09-14T11:02:48.165+0000 7f3db1a75640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:02:48.504 INFO:tasks.workunit.client.0.smithi097.stderr: -318> 2024-09-14T11:02:48.165+0000 7f3db1a75640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:02:48.504 INFO:tasks.workunit.client.0.smithi097.stderr: -317> 2024-09-14T11:02:48.165+0000 7f3db2a77640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:02:48.504 INFO:tasks.workunit.client.0.smithi097.stderr: -316> 2024-09-14T11:02:48.165+0000 7f3db2a77640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:02:48.504 INFO:tasks.workunit.client.0.smithi097.stderr: -315> 2024-09-14T11:02:48.165+0000 7f3db2a77640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:02:48.504 INFO:tasks.workunit.client.0.smithi097.stderr: -314> 2024-09-14T11:02:48.165+0000 7f3db2276640 10 monclient(hunting): get_auth_request con 0x559317fd1870 auth_method 0 2024-09-14T11:02:48.504 INFO:tasks.workunit.client.0.smithi097.stderr: -313> 2024-09-14T11:02:48.165+0000 7f3db2276640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:02:48.504 INFO:tasks.workunit.client.0.smithi097.stderr: -312> 2024-09-14T11:02:48.165+0000 7f3db2276640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:02:48.505 INFO:tasks.workunit.client.0.smithi097.stderr: -311> 2024-09-14T11:02:48.165+0000 7f3db2276640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:02:48.505 INFO:tasks.workunit.client.0.smithi097.stderr: -310> 2024-09-14T11:02:48.165+0000 7f3db1a75640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:02:48.505 INFO:tasks.workunit.client.0.smithi097.stderr: -309> 2024-09-14T11:02:48.165+0000 7f3db1a75640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:02:48.505 INFO:tasks.workunit.client.0.smithi097.stderr: -308> 2024-09-14T11:02:48.165+0000 7f3db1a75640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:02:48.505 INFO:tasks.workunit.client.0.smithi097.stderr: -307> 2024-09-14T11:02:48.165+0000 7f3db2276640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:02:48.505 INFO:tasks.workunit.client.0.smithi097.stderr: -306> 2024-09-14T11:02:48.165+0000 7f3db2276640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:02:48.505 INFO:tasks.workunit.client.0.smithi097.stderr: -305> 2024-09-14T11:02:48.165+0000 7f3db2276640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:02:48.505 INFO:tasks.workunit.client.0.smithi097.stderr: -304> 2024-09-14T11:02:48.165+0000 7f3db2a77640 10 monclient(hunting): handle_auth_done global_id 6375 payload 824 2024-09-14T11:02:48.505 INFO:tasks.workunit.client.0.smithi097.stderr: -303> 2024-09-14T11:02:48.165+0000 7f3db2a77640 10 monclient: _finish_hunting 0 2024-09-14T11:02:48.505 INFO:tasks.workunit.client.0.smithi097.stderr: -302> 2024-09-14T11:02:48.165+0000 7f3db2a77640 1 monclient: found mon.noname-a 2024-09-14T11:02:48.505 INFO:tasks.workunit.client.0.smithi097.stderr: -301> 2024-09-14T11:02:48.165+0000 7f3db2a77640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-14T11:02:48.505 INFO:tasks.workunit.client.0.smithi097.stderr: -300> 2024-09-14T11:02:48.165+0000 7f3c97fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:02:48.505 INFO:tasks.workunit.client.0.smithi097.stderr: -299> 2024-09-14T11:02:48.165+0000 7f3c97fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:02:48.505 INFO:tasks.workunit.client.0.smithi097.stderr: -298> 2024-09-14T11:02:48.165+0000 7f3c97fff640 10 monclient: dump: 2024-09-14T11:02:48.506 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:02:48.506 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:02:48.506 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:02:48.506 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:02:48.506 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:02:48.506 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:02:48.506 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:02:48.506 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:02:48.506 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:02:48.506 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:48.506 INFO:tasks.workunit.client.0.smithi097.stderr: -297> 2024-09-14T11:02:48.165+0000 7f3c97fff640 10 monclient: _finish_auth 0 2024-09-14T11:02:48.506 INFO:tasks.workunit.client.0.smithi097.stderr: -296> 2024-09-14T11:02:48.165+0000 7f3c97fff640 10 monclient: _check_auth_tickets 2024-09-14T11:02:48.506 INFO:tasks.workunit.client.0.smithi097.stderr: -295> 2024-09-14T11:02:48.165+0000 7f3c97fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:02:48.507 INFO:tasks.workunit.client.0.smithi097.stderr: -294> 2024-09-14T11:02:48.165+0000 7f3c97fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:02:48.507 INFO:tasks.workunit.client.0.smithi097.stderr: -293> 2024-09-14T11:02:48.165+0000 7f3c97fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:02:48.507 INFO:tasks.workunit.client.0.smithi097.stderr: -292> 2024-09-14T11:02:48.165+0000 7f3c97fff640 10 monclient: dump: 2024-09-14T11:02:48.507 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:02:48.507 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:02:48.507 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:02:48.507 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:02:48.507 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:02:48.507 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:02:48.507 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:02:48.507 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:02:48.507 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:02:48.507 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:48.508 INFO:tasks.workunit.client.0.smithi097.stderr: -291> 2024-09-14T11:02:48.165+0000 7f3db652f800 5 monclient: authenticate success, global_id 6375 2024-09-14T11:02:48.508 INFO:tasks.workunit.client.0.smithi097.stderr: -290> 2024-09-14T11:02:48.165+0000 7f3db652f800 10 monclient: _renew_subs 2024-09-14T11:02:48.508 INFO:tasks.workunit.client.0.smithi097.stderr: -289> 2024-09-14T11:02:48.165+0000 7f3db652f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:02:48.508 INFO:tasks.workunit.client.0.smithi097.stderr: -288> 2024-09-14T11:02:48.165+0000 7f3db3278640 4 set_mon_vals no callback set 2024-09-14T11:02:48.508 INFO:tasks.workunit.client.0.smithi097.stderr: -287> 2024-09-14T11:02:48.165+0000 7f3db652f800 10 monclient: _renew_subs 2024-09-14T11:02:48.508 INFO:tasks.workunit.client.0.smithi097.stderr: -286> 2024-09-14T11:02:48.165+0000 7f3db652f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:02:48.508 INFO:tasks.workunit.client.0.smithi097.stderr: -285> 2024-09-14T11:02:48.167+0000 7f3c97fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:02:48.508 INFO:tasks.workunit.client.0.smithi097.stderr: -284> 2024-09-14T11:02:48.167+0000 7f3c97fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:02:48.508 INFO:tasks.workunit.client.0.smithi097.stderr: -283> 2024-09-14T11:02:48.167+0000 7f3c97fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:02:48.508 INFO:tasks.workunit.client.0.smithi097.stderr: -282> 2024-09-14T11:02:48.167+0000 7f3db1a75640 10 monclient: get_auth_request con 0x7f3c8c077140 auth_method 0 2024-09-14T11:02:48.508 INFO:tasks.workunit.client.0.smithi097.stderr: -281> 2024-09-14T11:02:48.167+0000 7f3db652f800 10 monclient: get_monmap_and_config 2024-09-14T11:02:48.508 INFO:tasks.workunit.client.0.smithi097.stderr: -280> 2024-09-14T11:02:48.167+0000 7f3db652f800 10 monclient: build_initial_monmap 2024-09-14T11:02:48.509 INFO:tasks.workunit.client.0.smithi097.stderr: -279> 2024-09-14T11:02:48.167+0000 7f3db652f800 1 build_initial for_mkfs: 0 2024-09-14T11:02:48.509 INFO:tasks.workunit.client.0.smithi097.stderr: -278> 2024-09-14T11:02:48.167+0000 7f3db652f800 10 monclient: monmap: 2024-09-14T11:02:48.509 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:02:48.509 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:02:48.509 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:02:48.509 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:02:48.509 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:02:48.509 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:02:48.509 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:02:48.509 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:02:48.509 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:02:48.509 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:48.509 INFO:tasks.workunit.client.0.smithi097.stderr: -277> 2024-09-14T11:02:48.167+0000 7f3db652f800 5 AuthRegistry(0x559317ff2960) adding auth protocol: cephx 2024-09-14T11:02:48.510 INFO:tasks.workunit.client.0.smithi097.stderr: -276> 2024-09-14T11:02:48.167+0000 7f3db652f800 5 AuthRegistry(0x559317ff2960) adding auth protocol: cephx 2024-09-14T11:02:48.510 INFO:tasks.workunit.client.0.smithi097.stderr: -275> 2024-09-14T11:02:48.167+0000 7f3db652f800 5 AuthRegistry(0x559317ff2960) adding auth protocol: cephx 2024-09-14T11:02:48.510 INFO:tasks.workunit.client.0.smithi097.stderr: -274> 2024-09-14T11:02:48.167+0000 7f3db652f800 5 AuthRegistry(0x559317ff2960) adding con mode: secure 2024-09-14T11:02:48.510 INFO:tasks.workunit.client.0.smithi097.stderr: -273> 2024-09-14T11:02:48.167+0000 7f3db652f800 5 AuthRegistry(0x559317ff2960) adding con mode: crc 2024-09-14T11:02:48.510 INFO:tasks.workunit.client.0.smithi097.stderr: -272> 2024-09-14T11:02:48.167+0000 7f3db652f800 5 AuthRegistry(0x559317ff2960) adding con mode: secure 2024-09-14T11:02:48.510 INFO:tasks.workunit.client.0.smithi097.stderr: -271> 2024-09-14T11:02:48.167+0000 7f3db652f800 5 AuthRegistry(0x559317ff2960) adding con mode: crc 2024-09-14T11:02:48.510 INFO:tasks.workunit.client.0.smithi097.stderr: -270> 2024-09-14T11:02:48.167+0000 7f3db652f800 5 AuthRegistry(0x559317ff2960) adding con mode: secure 2024-09-14T11:02:48.510 INFO:tasks.workunit.client.0.smithi097.stderr: -269> 2024-09-14T11:02:48.167+0000 7f3db652f800 5 AuthRegistry(0x559317ff2960) adding con mode: crc 2024-09-14T11:02:48.510 INFO:tasks.workunit.client.0.smithi097.stderr: -268> 2024-09-14T11:02:48.167+0000 7f3db652f800 5 AuthRegistry(0x559317ff2960) adding con mode: crc 2024-09-14T11:02:48.510 INFO:tasks.workunit.client.0.smithi097.stderr: -267> 2024-09-14T11:02:48.167+0000 7f3db652f800 5 AuthRegistry(0x559317ff2960) adding con mode: secure 2024-09-14T11:02:48.510 INFO:tasks.workunit.client.0.smithi097.stderr: -266> 2024-09-14T11:02:48.167+0000 7f3db652f800 5 AuthRegistry(0x559317ff2960) adding con mode: crc 2024-09-14T11:02:48.510 INFO:tasks.workunit.client.0.smithi097.stderr: -265> 2024-09-14T11:02:48.167+0000 7f3db652f800 5 AuthRegistry(0x559317ff2960) adding con mode: secure 2024-09-14T11:02:48.510 INFO:tasks.workunit.client.0.smithi097.stderr: -264> 2024-09-14T11:02:48.167+0000 7f3db652f800 5 AuthRegistry(0x559317ff2960) adding con mode: crc 2024-09-14T11:02:48.510 INFO:tasks.workunit.client.0.smithi097.stderr: -263> 2024-09-14T11:02:48.167+0000 7f3db652f800 5 AuthRegistry(0x559317ff2960) adding con mode: secure 2024-09-14T11:02:48.511 INFO:tasks.workunit.client.0.smithi097.stderr: -262> 2024-09-14T11:02:48.168+0000 7f3db652f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:02:48.511 INFO:tasks.workunit.client.0.smithi097.stderr: -261> 2024-09-14T11:02:48.168+0000 7f3db652f800 10 monclient: init 2024-09-14T11:02:48.511 INFO:tasks.workunit.client.0.smithi097.stderr: -260> 2024-09-14T11:02:48.168+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644e970) adding auth protocol: cephx 2024-09-14T11:02:48.511 INFO:tasks.workunit.client.0.smithi097.stderr: -259> 2024-09-14T11:02:48.168+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644e970) adding auth protocol: cephx 2024-09-14T11:02:48.511 INFO:tasks.workunit.client.0.smithi097.stderr: -258> 2024-09-14T11:02:48.168+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644e970) adding auth protocol: cephx 2024-09-14T11:02:48.511 INFO:tasks.workunit.client.0.smithi097.stderr: -257> 2024-09-14T11:02:48.168+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644e970) adding con mode: secure 2024-09-14T11:02:48.511 INFO:tasks.workunit.client.0.smithi097.stderr: -256> 2024-09-14T11:02:48.168+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644e970) adding con mode: crc 2024-09-14T11:02:48.511 INFO:tasks.workunit.client.0.smithi097.stderr: -255> 2024-09-14T11:02:48.168+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644e970) adding con mode: secure 2024-09-14T11:02:48.511 INFO:tasks.workunit.client.0.smithi097.stderr: -254> 2024-09-14T11:02:48.168+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644e970) adding con mode: crc 2024-09-14T11:02:48.511 INFO:tasks.workunit.client.0.smithi097.stderr: -253> 2024-09-14T11:02:48.168+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644e970) adding con mode: secure 2024-09-14T11:02:48.511 INFO:tasks.workunit.client.0.smithi097.stderr: -252> 2024-09-14T11:02:48.168+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644e970) adding con mode: crc 2024-09-14T11:02:48.511 INFO:tasks.workunit.client.0.smithi097.stderr: -251> 2024-09-14T11:02:48.168+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644e970) adding con mode: crc 2024-09-14T11:02:48.511 INFO:tasks.workunit.client.0.smithi097.stderr: -250> 2024-09-14T11:02:48.168+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644e970) adding con mode: secure 2024-09-14T11:02:48.512 INFO:tasks.workunit.client.0.smithi097.stderr: -249> 2024-09-14T11:02:48.168+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644e970) adding con mode: crc 2024-09-14T11:02:48.512 INFO:tasks.workunit.client.0.smithi097.stderr: -248> 2024-09-14T11:02:48.168+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644e970) adding con mode: secure 2024-09-14T11:02:48.512 INFO:tasks.workunit.client.0.smithi097.stderr: -247> 2024-09-14T11:02:48.168+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644e970) adding con mode: crc 2024-09-14T11:02:48.512 INFO:tasks.workunit.client.0.smithi097.stderr: -246> 2024-09-14T11:02:48.168+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644e970) adding con mode: secure 2024-09-14T11:02:48.512 INFO:tasks.workunit.client.0.smithi097.stderr: -245> 2024-09-14T11:02:48.168+0000 7f3db652f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:02:48.512 INFO:tasks.workunit.client.0.smithi097.stderr: -244> 2024-09-14T11:02:48.168+0000 7f3db652f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:02:48.512 INFO:tasks.workunit.client.0.smithi097.stderr: -243> 2024-09-14T11:02:48.168+0000 7f3db652f800 5 asok(0x559317d31270) register_command rotate-key cmddesc rotate-key hook 0x7ffd6644eab8 EEXIST 2024-09-14T11:02:48.512 INFO:tasks.workunit.client.0.smithi097.stderr: -242> 2024-09-14T11:02:48.168+0000 7f3db652f800 10 monclient: _reopen_session rank -1 2024-09-14T11:02:48.512 INFO:tasks.workunit.client.0.smithi097.stderr: -241> 2024-09-14T11:02:48.168+0000 7f3db652f800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:02:48.512 INFO:tasks.workunit.client.0.smithi097.stderr: -240> 2024-09-14T11:02:48.168+0000 7f3db652f800 10 monclient(hunting): picked mon.noname-c con 0x559317ff6ad0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:02:48.512 INFO:tasks.workunit.client.0.smithi097.stderr: -239> 2024-09-14T11:02:48.168+0000 7f3db652f800 10 monclient(hunting): picked mon.noname-a con 0x559318021540 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:02:48.512 INFO:tasks.workunit.client.0.smithi097.stderr: -238> 2024-09-14T11:02:48.168+0000 7f3db652f800 10 monclient(hunting): picked mon.noname-b con 0x5593180228f0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:02:48.512 INFO:tasks.workunit.client.0.smithi097.stderr: -237> 2024-09-14T11:02:48.168+0000 7f3db652f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:02:48.512 INFO:tasks.workunit.client.0.smithi097.stderr: -236> 2024-09-14T11:02:48.168+0000 7f3db652f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:02:48.513 INFO:tasks.workunit.client.0.smithi097.stderr: -235> 2024-09-14T11:02:48.168+0000 7f3db652f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:02:48.513 INFO:tasks.workunit.client.0.smithi097.stderr: -234> 2024-09-14T11:02:48.168+0000 7f3db652f800 10 monclient(hunting): _renew_subs 2024-09-14T11:02:48.513 INFO:tasks.workunit.client.0.smithi097.stderr: -233> 2024-09-14T11:02:48.168+0000 7f3db652f800 10 monclient(hunting): authenticate will time out at 1849.821723s 2024-09-14T11:02:48.513 INFO:tasks.workunit.client.0.smithi097.stderr: -232> 2024-09-14T11:02:48.168+0000 7f3db1a75640 10 monclient(hunting): get_auth_request con 0x559317ff6ad0 auth_method 0 2024-09-14T11:02:48.513 INFO:tasks.workunit.client.0.smithi097.stderr: -231> 2024-09-14T11:02:48.168+0000 7f3db1a75640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:02:48.513 INFO:tasks.workunit.client.0.smithi097.stderr: -230> 2024-09-14T11:02:48.168+0000 7f3db1a75640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:02:48.513 INFO:tasks.workunit.client.0.smithi097.stderr: -229> 2024-09-14T11:02:48.168+0000 7f3db1a75640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:02:48.513 INFO:tasks.workunit.client.0.smithi097.stderr: -228> 2024-09-14T11:02:48.168+0000 7f3db2a77640 10 monclient(hunting): get_auth_request con 0x559318021540 auth_method 0 2024-09-14T11:02:48.513 INFO:tasks.workunit.client.0.smithi097.stderr: -227> 2024-09-14T11:02:48.168+0000 7f3db2a77640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:02:48.513 INFO:tasks.workunit.client.0.smithi097.stderr: -226> 2024-09-14T11:02:48.168+0000 7f3db2a77640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:02:48.513 INFO:tasks.workunit.client.0.smithi097.stderr: -225> 2024-09-14T11:02:48.168+0000 7f3db2a77640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:02:48.513 INFO:tasks.workunit.client.0.smithi097.stderr: -224> 2024-09-14T11:02:48.168+0000 7f3db1a75640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:02:48.514 INFO:tasks.workunit.client.0.smithi097.stderr: -223> 2024-09-14T11:02:48.168+0000 7f3db1a75640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:02:48.514 INFO:tasks.workunit.client.0.smithi097.stderr: -222> 2024-09-14T11:02:48.168+0000 7f3db1a75640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:02:48.514 INFO:tasks.workunit.client.0.smithi097.stderr: -221> 2024-09-14T11:02:48.168+0000 7f3db2a77640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:02:48.514 INFO:tasks.workunit.client.0.smithi097.stderr: -220> 2024-09-14T11:02:48.168+0000 7f3db2a77640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:02:48.514 INFO:tasks.workunit.client.0.smithi097.stderr: -219> 2024-09-14T11:02:48.168+0000 7f3db2a77640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:02:48.514 INFO:tasks.workunit.client.0.smithi097.stderr: -218> 2024-09-14T11:02:48.168+0000 7f3db1a75640 10 monclient(hunting): handle_auth_done global_id 6065 payload 274 2024-09-14T11:02:48.514 INFO:tasks.workunit.client.0.smithi097.stderr: -217> 2024-09-14T11:02:48.168+0000 7f3db1a75640 10 monclient: _finish_hunting 0 2024-09-14T11:02:48.514 INFO:tasks.workunit.client.0.smithi097.stderr: -216> 2024-09-14T11:02:48.168+0000 7f3db1a75640 1 monclient: found mon.noname-c 2024-09-14T11:02:48.514 INFO:tasks.workunit.client.0.smithi097.stderr: -215> 2024-09-14T11:02:48.169+0000 7f3db1a75640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:02:48.514 INFO:tasks.workunit.client.0.smithi097.stderr: -214> 2024-09-14T11:02:48.169+0000 7f3c95ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:02:48.514 INFO:tasks.workunit.client.0.smithi097.stderr: -213> 2024-09-14T11:02:48.169+0000 7f3c95ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:02:48.514 INFO:tasks.workunit.client.0.smithi097.stderr: -212> 2024-09-14T11:02:48.169+0000 7f3c95ffb640 10 monclient: dump: 2024-09-14T11:02:48.514 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:02:48.515 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:02:48.515 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:02:48.515 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:02:48.515 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:02:48.515 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:02:48.515 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:02:48.515 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:02:48.515 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:02:48.515 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:48.515 INFO:tasks.workunit.client.0.smithi097.stderr: -211> 2024-09-14T11:02:48.169+0000 7f3c95ffb640 10 monclient: _finish_auth 0 2024-09-14T11:02:48.515 INFO:tasks.workunit.client.0.smithi097.stderr: -210> 2024-09-14T11:02:48.169+0000 7f3c95ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:02:48.515 INFO:tasks.workunit.client.0.smithi097.stderr: -209> 2024-09-14T11:02:48.169+0000 7f3db652f800 5 monclient: authenticate success, global_id 6065 2024-09-14T11:02:48.515 INFO:tasks.workunit.client.0.smithi097.stderr: -208> 2024-09-14T11:02:48.169+0000 7f3c95ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:02:48.516 INFO:tasks.workunit.client.0.smithi097.stderr: -207> 2024-09-14T11:02:48.169+0000 7f3c95ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:02:48.516 INFO:tasks.workunit.client.0.smithi097.stderr: -206> 2024-09-14T11:02:48.169+0000 7f3c95ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:02:48.516 INFO:tasks.workunit.client.0.smithi097.stderr: -205> 2024-09-14T11:02:48.169+0000 7f3c95ffb640 10 monclient: dump: 2024-09-14T11:02:48.516 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:02:48.516 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:02:48.516 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:02:48.516 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:02:48.516 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:02:48.516 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:02:48.516 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:02:48.516 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:02:48.516 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:02:48.516 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:48.517 INFO:tasks.workunit.client.0.smithi097.stderr: -204> 2024-09-14T11:02:48.169+0000 7f3db652f800 10 monclient: get_monmap_and_config success 2024-09-14T11:02:48.517 INFO:tasks.workunit.client.0.smithi097.stderr: -203> 2024-09-14T11:02:48.169+0000 7f3db652f800 4 set_mon_vals no callback set 2024-09-14T11:02:48.517 INFO:tasks.workunit.client.0.smithi097.stderr: -202> 2024-09-14T11:02:48.169+0000 7f3db652f800 10 monclient: shutdown 2024-09-14T11:02:48.517 INFO:tasks.workunit.client.0.smithi097.stderr: -201> 2024-09-14T11:02:48.170+0000 7f3db652f800 10 monclient: build_initial_monmap 2024-09-14T11:02:48.517 INFO:tasks.workunit.client.0.smithi097.stderr: -200> 2024-09-14T11:02:48.170+0000 7f3db652f800 1 build_initial for_mkfs: 0 2024-09-14T11:02:48.517 INFO:tasks.workunit.client.0.smithi097.stderr: -199> 2024-09-14T11:02:48.170+0000 7f3db652f800 10 monclient: monmap: 2024-09-14T11:02:48.517 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:02:48.517 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:02:48.517 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:02:48.517 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:02:48.517 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:02:48.517 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:02:48.517 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:02:48.518 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:02:48.518 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:02:48.518 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:48.518 INFO:tasks.workunit.client.0.smithi097.stderr: -198> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317ff76b0) adding auth protocol: cephx 2024-09-14T11:02:48.518 INFO:tasks.workunit.client.0.smithi097.stderr: -197> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317ff76b0) adding auth protocol: cephx 2024-09-14T11:02:48.518 INFO:tasks.workunit.client.0.smithi097.stderr: -196> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317ff76b0) adding auth protocol: cephx 2024-09-14T11:02:48.518 INFO:tasks.workunit.client.0.smithi097.stderr: -195> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317ff76b0) adding con mode: secure 2024-09-14T11:02:48.518 INFO:tasks.workunit.client.0.smithi097.stderr: -194> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317ff76b0) adding con mode: crc 2024-09-14T11:02:48.518 INFO:tasks.workunit.client.0.smithi097.stderr: -193> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317ff76b0) adding con mode: secure 2024-09-14T11:02:48.518 INFO:tasks.workunit.client.0.smithi097.stderr: -192> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317ff76b0) adding con mode: crc 2024-09-14T11:02:48.518 INFO:tasks.workunit.client.0.smithi097.stderr: -191> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317ff76b0) adding con mode: secure 2024-09-14T11:02:48.518 INFO:tasks.workunit.client.0.smithi097.stderr: -190> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317ff76b0) adding con mode: crc 2024-09-14T11:02:48.518 INFO:tasks.workunit.client.0.smithi097.stderr: -189> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317ff76b0) adding con mode: crc 2024-09-14T11:02:48.518 INFO:tasks.workunit.client.0.smithi097.stderr: -188> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317ff76b0) adding con mode: secure 2024-09-14T11:02:48.519 INFO:tasks.workunit.client.0.smithi097.stderr: -187> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317ff76b0) adding con mode: crc 2024-09-14T11:02:48.519 INFO:tasks.workunit.client.0.smithi097.stderr: -186> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317ff76b0) adding con mode: secure 2024-09-14T11:02:48.519 INFO:tasks.workunit.client.0.smithi097.stderr: -185> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317ff76b0) adding con mode: crc 2024-09-14T11:02:48.519 INFO:tasks.workunit.client.0.smithi097.stderr: -184> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317ff76b0) adding con mode: secure 2024-09-14T11:02:48.519 INFO:tasks.workunit.client.0.smithi097.stderr: -183> 2024-09-14T11:02:48.170+0000 7f3db652f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:02:48.519 INFO:tasks.workunit.client.0.smithi097.stderr: -182> 2024-09-14T11:02:48.170+0000 7f3db652f800 1 librados: starting msgr at 2024-09-14T11:02:48.519 INFO:tasks.workunit.client.0.smithi097.stderr: -181> 2024-09-14T11:02:48.170+0000 7f3db652f800 1 librados: starting objecter 2024-09-14T11:02:48.519 INFO:tasks.workunit.client.0.smithi097.stderr: -180> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 asok(0x559317d31270) register_command objecter_requests cmddesc objecter_requests hook 0x559317ff61e0 EEXIST 2024-09-14T11:02:48.519 INFO:tasks.workunit.client.0.smithi097.stderr: -179> 2024-09-14T11:02:48.170+0000 7f3db652f800 1 librados: setting wanted keys 2024-09-14T11:02:48.519 INFO:tasks.workunit.client.0.smithi097.stderr: -178> 2024-09-14T11:02:48.170+0000 7f3db652f800 1 librados: calling monclient init 2024-09-14T11:02:48.519 INFO:tasks.workunit.client.0.smithi097.stderr: -177> 2024-09-14T11:02:48.170+0000 7f3db652f800 10 monclient: init 2024-09-14T11:02:48.519 INFO:tasks.workunit.client.0.smithi097.stderr: -176> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317fe7420) adding auth protocol: cephx 2024-09-14T11:02:48.519 INFO:tasks.workunit.client.0.smithi097.stderr: -175> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317fe7420) adding auth protocol: cephx 2024-09-14T11:02:48.519 INFO:tasks.workunit.client.0.smithi097.stderr: -174> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317fe7420) adding auth protocol: cephx 2024-09-14T11:02:48.520 INFO:tasks.workunit.client.0.smithi097.stderr: -173> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317fe7420) adding con mode: secure 2024-09-14T11:02:48.520 INFO:tasks.workunit.client.0.smithi097.stderr: -172> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317fe7420) adding con mode: crc 2024-09-14T11:02:48.520 INFO:tasks.workunit.client.0.smithi097.stderr: -171> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317fe7420) adding con mode: secure 2024-09-14T11:02:48.520 INFO:tasks.workunit.client.0.smithi097.stderr: -170> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317fe7420) adding con mode: crc 2024-09-14T11:02:48.520 INFO:tasks.workunit.client.0.smithi097.stderr: -169> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317fe7420) adding con mode: secure 2024-09-14T11:02:48.520 INFO:tasks.workunit.client.0.smithi097.stderr: -168> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317fe7420) adding con mode: crc 2024-09-14T11:02:48.520 INFO:tasks.workunit.client.0.smithi097.stderr: -167> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317fe7420) adding con mode: crc 2024-09-14T11:02:48.520 INFO:tasks.workunit.client.0.smithi097.stderr: -166> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317fe7420) adding con mode: secure 2024-09-14T11:02:48.520 INFO:tasks.workunit.client.0.smithi097.stderr: -165> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317fe7420) adding con mode: crc 2024-09-14T11:02:48.520 INFO:tasks.workunit.client.0.smithi097.stderr: -164> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317fe7420) adding con mode: secure 2024-09-14T11:02:48.520 INFO:tasks.workunit.client.0.smithi097.stderr: -163> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317fe7420) adding con mode: crc 2024-09-14T11:02:48.520 INFO:tasks.workunit.client.0.smithi097.stderr: -162> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 AuthRegistry(0x559317fe7420) adding con mode: secure 2024-09-14T11:02:48.521 INFO:tasks.workunit.client.0.smithi097.stderr: -161> 2024-09-14T11:02:48.170+0000 7f3db652f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:02:48.521 INFO:tasks.workunit.client.0.smithi097.stderr: -160> 2024-09-14T11:02:48.170+0000 7f3db652f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:02:48.521 INFO:tasks.workunit.client.0.smithi097.stderr: -159> 2024-09-14T11:02:48.170+0000 7f3db652f800 5 asok(0x559317d31270) register_command rotate-key cmddesc rotate-key hook 0x559317fe7568 EEXIST 2024-09-14T11:02:48.521 INFO:tasks.workunit.client.0.smithi097.stderr: -158> 2024-09-14T11:02:48.170+0000 7f3db652f800 10 monclient: _reopen_session rank -1 2024-09-14T11:02:48.521 INFO:tasks.workunit.client.0.smithi097.stderr: -157> 2024-09-14T11:02:48.170+0000 7f3db652f800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:02:48.521 INFO:tasks.workunit.client.0.smithi097.stderr: -156> 2024-09-14T11:02:48.170+0000 7f3db652f800 10 monclient(hunting): picked mon.noname-c con 0x559317ff6ad0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:02:48.521 INFO:tasks.workunit.client.0.smithi097.stderr: -155> 2024-09-14T11:02:48.170+0000 7f3db652f800 10 monclient(hunting): picked mon.noname-a con 0x5593180228f0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:02:48.521 INFO:tasks.workunit.client.0.smithi097.stderr: -154> 2024-09-14T11:02:48.170+0000 7f3db652f800 10 monclient(hunting): picked mon.noname-b con 0x559318026270 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:02:48.521 INFO:tasks.workunit.client.0.smithi097.stderr: -153> 2024-09-14T11:02:48.170+0000 7f3db652f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:02:48.521 INFO:tasks.workunit.client.0.smithi097.stderr: -152> 2024-09-14T11:02:48.170+0000 7f3db652f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:02:48.521 INFO:tasks.workunit.client.0.smithi097.stderr: -151> 2024-09-14T11:02:48.170+0000 7f3db652f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:02:48.521 INFO:tasks.workunit.client.0.smithi097.stderr: -150> 2024-09-14T11:02:48.170+0000 7f3db652f800 10 monclient(hunting): _renew_subs 2024-09-14T11:02:48.521 INFO:tasks.workunit.client.0.smithi097.stderr: -149> 2024-09-14T11:02:48.170+0000 7f3db652f800 10 monclient(hunting): authenticate will time out at 1849.823953s 2024-09-14T11:02:48.522 INFO:tasks.workunit.client.0.smithi097.stderr: -148> 2024-09-14T11:02:48.171+0000 7f3db1a75640 10 monclient(hunting): get_auth_request con 0x559317ff6ad0 auth_method 0 2024-09-14T11:02:48.522 INFO:tasks.workunit.client.0.smithi097.stderr: -147> 2024-09-14T11:02:48.171+0000 7f3db1a75640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:02:48.522 INFO:tasks.workunit.client.0.smithi097.stderr: -146> 2024-09-14T11:02:48.171+0000 7f3db1a75640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:02:48.522 INFO:tasks.workunit.client.0.smithi097.stderr: -145> 2024-09-14T11:02:48.171+0000 7f3db1a75640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:02:48.522 INFO:tasks.workunit.client.0.smithi097.stderr: -144> 2024-09-14T11:02:48.171+0000 7f3db2a77640 10 monclient(hunting): get_auth_request con 0x5593180228f0 auth_method 0 2024-09-14T11:02:48.522 INFO:tasks.workunit.client.0.smithi097.stderr: -143> 2024-09-14T11:02:48.171+0000 7f3db2a77640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:02:48.522 INFO:tasks.workunit.client.0.smithi097.stderr: -142> 2024-09-14T11:02:48.171+0000 7f3db2a77640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:02:48.522 INFO:tasks.workunit.client.0.smithi097.stderr: -141> 2024-09-14T11:02:48.171+0000 7f3db2a77640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:02:48.522 INFO:tasks.workunit.client.0.smithi097.stderr: -140> 2024-09-14T11:02:48.171+0000 7f3db1a75640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:02:48.522 INFO:tasks.workunit.client.0.smithi097.stderr: -139> 2024-09-14T11:02:48.171+0000 7f3db1a75640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:02:48.522 INFO:tasks.workunit.client.0.smithi097.stderr: -138> 2024-09-14T11:02:48.171+0000 7f3db1a75640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:02:48.522 INFO:tasks.workunit.client.0.smithi097.stderr: -137> 2024-09-14T11:02:48.171+0000 7f3db2a77640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:02:48.522 INFO:tasks.workunit.client.0.smithi097.stderr: -136> 2024-09-14T11:02:48.171+0000 7f3db2a77640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:02:48.523 INFO:tasks.workunit.client.0.smithi097.stderr: -135> 2024-09-14T11:02:48.171+0000 7f3db2a77640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:02:48.523 INFO:tasks.workunit.client.0.smithi097.stderr: -134> 2024-09-14T11:02:48.171+0000 7f3db2a77640 10 monclient(hunting): handle_auth_done global_id 6381 payload 824 2024-09-14T11:02:48.523 INFO:tasks.workunit.client.0.smithi097.stderr: -133> 2024-09-14T11:02:48.171+0000 7f3db2a77640 10 monclient: _finish_hunting 0 2024-09-14T11:02:48.523 INFO:tasks.workunit.client.0.smithi097.stderr: -132> 2024-09-14T11:02:48.171+0000 7f3db2a77640 1 monclient: found mon.noname-a 2024-09-14T11:02:48.523 INFO:tasks.workunit.client.0.smithi097.stderr: -131> 2024-09-14T11:02:48.171+0000 7f3db2a77640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-14T11:02:48.523 INFO:tasks.workunit.client.0.smithi097.stderr: -130> 2024-09-14T11:02:48.171+0000 7f3db2276640 10 monclient: get_auth_request con 0x559318026270 auth_method 0 2024-09-14T11:02:48.523 INFO:tasks.workunit.client.0.smithi097.stderr: -129> 2024-09-14T11:02:48.171+0000 7f3c83fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:02:48.523 INFO:tasks.workunit.client.0.smithi097.stderr: -128> 2024-09-14T11:02:48.171+0000 7f3c83fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:02:48.523 INFO:tasks.workunit.client.0.smithi097.stderr: -127> 2024-09-14T11:02:48.171+0000 7f3c83fff640 10 monclient: dump: 2024-09-14T11:02:48.523 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:02:48.523 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:02:48.523 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:02:48.523 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:02:48.523 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:02:48.524 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:02:48.524 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:02:48.524 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:02:48.524 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:02:48.524 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:48.524 INFO:tasks.workunit.client.0.smithi097.stderr: -126> 2024-09-14T11:02:48.171+0000 7f3c83fff640 10 monclient: _finish_auth 0 2024-09-14T11:02:48.524 INFO:tasks.workunit.client.0.smithi097.stderr: -125> 2024-09-14T11:02:48.171+0000 7f3c83fff640 10 monclient: _check_auth_tickets 2024-09-14T11:02:48.524 INFO:tasks.workunit.client.0.smithi097.stderr: -124> 2024-09-14T11:02:48.171+0000 7f3c83fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:02:48.524 INFO:tasks.workunit.client.0.smithi097.stderr: -123> 2024-09-14T11:02:48.171+0000 7f3c83fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:02:48.524 INFO:tasks.workunit.client.0.smithi097.stderr: -122> 2024-09-14T11:02:48.171+0000 7f3c83fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:02:48.524 INFO:tasks.workunit.client.0.smithi097.stderr: -121> 2024-09-14T11:02:48.171+0000 7f3c83fff640 10 monclient: dump: 2024-09-14T11:02:48.524 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:02:48.525 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:02:48.525 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:02:48.525 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:02:48.525 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:02:48.525 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:02:48.525 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:02:48.525 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:02:48.525 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:02:48.525 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:48.525 INFO:tasks.workunit.client.0.smithi097.stderr: -120> 2024-09-14T11:02:48.171+0000 7f3db652f800 5 monclient: authenticate success, global_id 6381 2024-09-14T11:02:48.525 INFO:tasks.workunit.client.0.smithi097.stderr: -119> 2024-09-14T11:02:48.171+0000 7f3db652f800 10 monclient: _renew_subs 2024-09-14T11:02:48.525 INFO:tasks.workunit.client.0.smithi097.stderr: -118> 2024-09-14T11:02:48.171+0000 7f3c95ffb640 4 set_mon_vals no callback set 2024-09-14T11:02:48.525 INFO:tasks.workunit.client.0.smithi097.stderr: -117> 2024-09-14T11:02:48.171+0000 7f3db652f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:02:48.525 INFO:tasks.workunit.client.0.smithi097.stderr: -116> 2024-09-14T11:02:48.171+0000 7f3db652f800 10 monclient: _renew_subs 2024-09-14T11:02:48.526 INFO:tasks.workunit.client.0.smithi097.stderr: -115> 2024-09-14T11:02:48.171+0000 7f3db652f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:02:48.526 INFO:tasks.workunit.client.0.smithi097.stderr: -114> 2024-09-14T11:02:48.171+0000 7f3db652f800 1 librados: init done 2024-09-14T11:02:48.526 INFO:tasks.workunit.client.0.smithi097.stderr: -113> 2024-09-14T11:02:48.171+0000 7f3db652f800 5 asok(0x559317d31270) register_command cr dump hook 0x559318025828 2024-09-14T11:02:48.526 INFO:tasks.workunit.client.0.smithi097.stderr: -112> 2024-09-14T11:02:48.173+0000 7f3db652f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.526 INFO:tasks.workunit.client.0.smithi097.stderr: -111> 2024-09-14T11:02:48.173+0000 7f3c83fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:02:48.526 INFO:tasks.workunit.client.0.smithi097.stderr: -110> 2024-09-14T11:02:48.173+0000 7f3c83fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:02:48.526 INFO:tasks.workunit.client.0.smithi097.stderr: -109> 2024-09-14T11:02:48.173+0000 7f3c83fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:02:48.526 INFO:tasks.workunit.client.0.smithi097.stderr: -108> 2024-09-14T11:02:48.173+0000 7f3db1a75640 10 monclient: get_auth_request con 0x7f3c7c077230 auth_method 0 2024-09-14T11:02:48.526 INFO:tasks.workunit.client.0.smithi097.stderr: -107> 2024-09-14T11:02:48.174+0000 7f3db2276640 10 monclient: get_auth_request con 0x5593180411b0 auth_method 0 2024-09-14T11:02:48.526 INFO:tasks.workunit.client.0.smithi097.stderr: -106> 2024-09-14T11:02:48.174+0000 7f3db652f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:48.526 INFO:tasks.workunit.client.0.smithi097.stderr: -105> 2024-09-14T11:02:48.174+0000 7f3db652f800 20 realm 2024-09-14T11:02:48.526 INFO:tasks.workunit.client.0.smithi097.stderr: -104> 2024-09-14T11:02:48.174+0000 7f3db652f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.526 INFO:tasks.workunit.client.0.smithi097.stderr: -103> 2024-09-14T11:02:48.174+0000 7f3db652f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:48.527 INFO:tasks.workunit.client.0.smithi097.stderr: -102> 2024-09-14T11:02:48.174+0000 7f3db652f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:02:48.527 INFO:tasks.workunit.client.0.smithi097.stderr: -101> 2024-09-14T11:02:48.174+0000 7f3db652f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.527 INFO:tasks.workunit.client.0.smithi097.stderr: -100> 2024-09-14T11:02:48.175+0000 7f3db652f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:48.527 INFO:tasks.workunit.client.0.smithi097.stderr: -99> 2024-09-14T11:02:48.175+0000 7f3db652f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.527 INFO:tasks.workunit.client.0.smithi097.stderr: -98> 2024-09-14T11:02:48.175+0000 7f3db1a75640 10 monclient: get_auth_request con 0x5593180453e0 auth_method 0 2024-09-14T11:02:48.527 INFO:tasks.workunit.client.0.smithi097.stderr: -97> 2024-09-14T11:02:48.175+0000 7f3db652f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:48.527 INFO:tasks.workunit.client.0.smithi097.stderr: -96> 2024-09-14T11:02:48.175+0000 7f3db652f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.527 INFO:tasks.workunit.client.0.smithi097.stderr: -95> 2024-09-14T11:02:48.175+0000 7f3db2a77640 10 monclient: get_auth_request con 0x559318048c90 auth_method 0 2024-09-14T11:02:48.527 INFO:tasks.workunit.client.0.smithi097.stderr: -94> 2024-09-14T11:02:48.176+0000 7f3db652f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:02:48.527 INFO:tasks.workunit.client.0.smithi097.stderr: -93> 2024-09-14T11:02:48.176+0000 7f3db652f800 20 searching for the correct realm 2024-09-14T11:02:48.527 INFO:tasks.workunit.client.0.smithi097.stderr: -92> 2024-09-14T11:02:48.176+0000 7f3db2276640 10 monclient: get_auth_request con 0x55931804da30 auth_method 0 2024-09-14T11:02:48.527 INFO:tasks.workunit.client.0.smithi097.stderr: -91> 2024-09-14T11:02:48.177+0000 7f3db1a75640 10 monclient: get_auth_request con 0x7f3da4027040 auth_method 0 2024-09-14T11:02:48.527 INFO:tasks.workunit.client.0.smithi097.stderr: -90> 2024-09-14T11:02:48.178+0000 7f3db2a77640 0 -- 172.21.15.97:0/723309112 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f3da8040020 msgr2=0x7f3da8019920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:02:48.528 INFO:tasks.workunit.client.0.smithi097.stderr: -89> 2024-09-14T11:02:48.379+0000 7f3db2a77640 10 monclient: get_auth_request con 0x7f3da8040020 auth_method 0 2024-09-14T11:02:48.528 INFO:tasks.workunit.client.0.smithi097.stderr: -88> 2024-09-14T11:02:48.381+0000 7f3db2276640 10 monclient: get_auth_request con 0x7f3da8037040 auth_method 0 2024-09-14T11:02:48.528 INFO:tasks.workunit.client.0.smithi097.stderr: -87> 2024-09-14T11:02:48.382+0000 7f3db1a75640 10 monclient: get_auth_request con 0x7f3da4017070 auth_method 0 2024-09-14T11:02:48.528 INFO:tasks.workunit.client.0.smithi097.stderr: -86> 2024-09-14T11:02:48.383+0000 7f3db1a75640 0 -- 172.21.15.97:0/723309112 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f3da4017070 msgr2=0x7f3da4027420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:02:48.528 INFO:tasks.workunit.client.0.smithi097.stderr: -85> 2024-09-14T11:02:48.383+0000 7f3c83fff640 1 client.6381.objecter ms_handle_reset 0x7f3da4017070 session 0x7f3da400c510 osd.3 2024-09-14T11:02:48.528 INFO:tasks.workunit.client.0.smithi097.stderr: -84> 2024-09-14T11:02:48.383+0000 7f3c83fff640 10 monclient: _renew_subs 2024-09-14T11:02:48.528 INFO:tasks.workunit.client.0.smithi097.stderr: -83> 2024-09-14T11:02:48.383+0000 7f3c83fff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:02:48.528 INFO:tasks.workunit.client.0.smithi097.stderr: -82> 2024-09-14T11:02:48.383+0000 7f3db1a75640 10 monclient: get_auth_request con 0x7f3c7c086db0 auth_method 0 2024-09-14T11:02:48.528 INFO:tasks.workunit.client.0.smithi097.stderr: -81> 2024-09-14T11:02:48.387+0000 7f3db652f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:02:48.528 INFO:tasks.workunit.client.0.smithi097.stderr: -80> 2024-09-14T11:02:48.387+0000 7f3db652f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:02:48.528 INFO:tasks.workunit.client.0.smithi097.stderr: -79> 2024-09-14T11:02:48.387+0000 7f3db652f800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:02:48.528 INFO:tasks.workunit.client.0.smithi097.stderr: -78> 2024-09-14T11:02:48.387+0000 7f3db652f800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:02:48.528 INFO:tasks.workunit.client.0.smithi097.stderr: -77> 2024-09-14T11:02:48.387+0000 7f3db652f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:02:48.528 INFO:tasks.workunit.client.0.smithi097.stderr: -76> 2024-09-14T11:02:48.387+0000 7f3db652f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:02:48.529 INFO:tasks.workunit.client.0.smithi097.stderr: -75> 2024-09-14T11:02:48.387+0000 7f3db652f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.529 INFO:tasks.workunit.client.0.smithi097.stderr: -74> 2024-09-14T11:02:48.387+0000 7f3db652f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:48.529 INFO:tasks.workunit.client.0.smithi097.stderr: -73> 2024-09-14T11:02:48.387+0000 7f3db652f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.529 INFO:tasks.workunit.client.0.smithi097.stderr: -72> 2024-09-14T11:02:48.388+0000 7f3db652f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:48.529 INFO:tasks.workunit.client.0.smithi097.stderr: -71> 2024-09-14T11:02:48.388+0000 7f3db652f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.529 INFO:tasks.workunit.client.0.smithi097.stderr: -70> 2024-09-14T11:02:48.388+0000 7f3db652f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:02:48.529 INFO:tasks.workunit.client.0.smithi097.stderr: -69> 2024-09-14T11:02:48.388+0000 7f3db652f800 20 zone default found 2024-09-14T11:02:48.529 INFO:tasks.workunit.client.0.smithi097.stderr: -68> 2024-09-14T11:02:48.388+0000 7f3db652f800 4 Realm: () 2024-09-14T11:02:48.529 INFO:tasks.workunit.client.0.smithi097.stderr: -67> 2024-09-14T11:02:48.388+0000 7f3db652f800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:02:48.529 INFO:tasks.workunit.client.0.smithi097.stderr: -66> 2024-09-14T11:02:48.388+0000 7f3db652f800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:02:48.529 INFO:tasks.workunit.client.0.smithi097.stderr: -65> 2024-09-14T11:02:48.388+0000 7f3db652f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:02:48.529 INFO:tasks.workunit.client.0.smithi097.stderr: -64> 2024-09-14T11:02:48.388+0000 7f3db652f800 20 zonegroup default 2024-09-14T11:02:48.529 INFO:tasks.workunit.client.0.smithi097.stderr: -63> 2024-09-14T11:02:48.388+0000 7f3db652f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.530 INFO:tasks.workunit.client.0.smithi097.stderr: -62> 2024-09-14T11:02:48.388+0000 7f3db652f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:48.530 INFO:tasks.workunit.client.0.smithi097.stderr: -61> 2024-09-14T11:02:48.388+0000 7f3db652f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.530 INFO:tasks.workunit.client.0.smithi097.stderr: -60> 2024-09-14T11:02:48.389+0000 7f3db652f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:48.530 INFO:tasks.workunit.client.0.smithi097.stderr: -59> 2024-09-14T11:02:48.389+0000 7f3db652f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.530 INFO:tasks.workunit.client.0.smithi097.stderr: -58> 2024-09-14T11:02:48.389+0000 7f3db652f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:48.530 INFO:tasks.workunit.client.0.smithi097.stderr: -57> 2024-09-14T11:02:48.389+0000 7f3db652f800 20 started sync module instance, tier type = 2024-09-14T11:02:48.530 INFO:tasks.workunit.client.0.smithi097.stderr: -56> 2024-09-14T11:02:48.389+0000 7f3db652f800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:02:48.530 INFO:tasks.workunit.client.0.smithi097.stderr: -55> 2024-09-14T11:02:48.397+0000 7f3db652f800 20 add_watcher() i=0 2024-09-14T11:02:48.530 INFO:tasks.workunit.client.0.smithi097.stderr: -54> 2024-09-14T11:02:48.397+0000 7f3db652f800 20 add_watcher() i=1 2024-09-14T11:02:48.530 INFO:tasks.workunit.client.0.smithi097.stderr: -53> 2024-09-14T11:02:48.397+0000 7f3db652f800 20 add_watcher() i=2 2024-09-14T11:02:48.530 INFO:tasks.workunit.client.0.smithi097.stderr: -52> 2024-09-14T11:02:48.397+0000 7f3db652f800 20 add_watcher() i=3 2024-09-14T11:02:48.530 INFO:tasks.workunit.client.0.smithi097.stderr: -51> 2024-09-14T11:02:48.397+0000 7f3db652f800 20 add_watcher() i=4 2024-09-14T11:02:48.530 INFO:tasks.workunit.client.0.smithi097.stderr: -50> 2024-09-14T11:02:48.397+0000 7f3db652f800 20 add_watcher() i=5 2024-09-14T11:02:48.530 INFO:tasks.workunit.client.0.smithi097.stderr: -49> 2024-09-14T11:02:48.397+0000 7f3db652f800 20 add_watcher() i=6 2024-09-14T11:02:48.531 INFO:tasks.workunit.client.0.smithi097.stderr: -48> 2024-09-14T11:02:48.398+0000 7f3db652f800 20 add_watcher() i=7 2024-09-14T11:02:48.531 INFO:tasks.workunit.client.0.smithi097.stderr: -47> 2024-09-14T11:02:48.398+0000 7f3db652f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:02:48.531 INFO:tasks.workunit.client.0.smithi097.stderr: -46> 2024-09-14T11:02:48.400+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644ee50) adding auth protocol: cephx 2024-09-14T11:02:48.531 INFO:tasks.workunit.client.0.smithi097.stderr: -45> 2024-09-14T11:02:48.400+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644ee50) adding auth protocol: cephx 2024-09-14T11:02:48.531 INFO:tasks.workunit.client.0.smithi097.stderr: -44> 2024-09-14T11:02:48.400+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644ee50) adding auth protocol: cephx 2024-09-14T11:02:48.531 INFO:tasks.workunit.client.0.smithi097.stderr: -43> 2024-09-14T11:02:48.400+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644ee50) adding con mode: secure 2024-09-14T11:02:48.531 INFO:tasks.workunit.client.0.smithi097.stderr: -42> 2024-09-14T11:02:48.400+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644ee50) adding con mode: crc 2024-09-14T11:02:48.531 INFO:tasks.workunit.client.0.smithi097.stderr: -41> 2024-09-14T11:02:48.400+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644ee50) adding con mode: secure 2024-09-14T11:02:48.531 INFO:tasks.workunit.client.0.smithi097.stderr: -40> 2024-09-14T11:02:48.400+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644ee50) adding con mode: crc 2024-09-14T11:02:48.531 INFO:tasks.workunit.client.0.smithi097.stderr: -39> 2024-09-14T11:02:48.400+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644ee50) adding con mode: secure 2024-09-14T11:02:48.531 INFO:tasks.workunit.client.0.smithi097.stderr: -38> 2024-09-14T11:02:48.400+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644ee50) adding con mode: crc 2024-09-14T11:02:48.531 INFO:tasks.workunit.client.0.smithi097.stderr: -37> 2024-09-14T11:02:48.400+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644ee50) adding con mode: crc 2024-09-14T11:02:48.531 INFO:tasks.workunit.client.0.smithi097.stderr: -36> 2024-09-14T11:02:48.400+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644ee50) adding con mode: secure 2024-09-14T11:02:48.531 INFO:tasks.workunit.client.0.smithi097.stderr: -35> 2024-09-14T11:02:48.400+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644ee50) adding con mode: crc 2024-09-14T11:02:48.532 INFO:tasks.workunit.client.0.smithi097.stderr: -34> 2024-09-14T11:02:48.400+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644ee50) adding con mode: secure 2024-09-14T11:02:48.532 INFO:tasks.workunit.client.0.smithi097.stderr: -33> 2024-09-14T11:02:48.400+0000 7f3c68fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:02:48.532 INFO:tasks.workunit.client.0.smithi097.stderr: -32> 2024-09-14T11:02:48.400+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644ee50) adding con mode: crc 2024-09-14T11:02:48.532 INFO:tasks.workunit.client.0.smithi097.stderr: -31> 2024-09-14T11:02:48.400+0000 7f3db652f800 5 AuthRegistry(0x7ffd6644ee50) adding con mode: secure 2024-09-14T11:02:48.532 INFO:tasks.workunit.client.0.smithi097.stderr: -30> 2024-09-14T11:02:48.401+0000 7f3db652f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:02:48.532 INFO:tasks.workunit.client.0.smithi097.stderr: -29> 2024-09-14T11:02:48.401+0000 7f3db652f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:02:48.532 INFO:tasks.workunit.client.0.smithi097.stderr: -28> 2024-09-14T11:02:48.401+0000 7f3db652f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:02:48.532 INFO:tasks.workunit.client.0.smithi097.stderr: -27> 2024-09-14T11:02:48.401+0000 7f3db652f800 5 asok(0x559317d31270) register_command cache list hook 0x55931801dd90 2024-09-14T11:02:48.532 INFO:tasks.workunit.client.0.smithi097.stderr: -26> 2024-09-14T11:02:48.401+0000 7f3db652f800 5 asok(0x559317d31270) register_command cache inspect hook 0x55931801dd90 2024-09-14T11:02:48.532 INFO:tasks.workunit.client.0.smithi097.stderr: -25> 2024-09-14T11:02:48.401+0000 7f3db652f800 5 asok(0x559317d31270) register_command cache erase hook 0x55931801dd90 2024-09-14T11:02:48.532 INFO:tasks.workunit.client.0.smithi097.stderr: -24> 2024-09-14T11:02:48.401+0000 7f3db652f800 5 asok(0x559317d31270) register_command cache zap hook 0x55931801dd90 2024-09-14T11:02:48.532 INFO:tasks.workunit.client.0.smithi097.stderr: -23> 2024-09-14T11:02:48.401+0000 7f3db652f800 5 note: GC not initialized 2024-09-14T11:02:48.532 INFO:tasks.workunit.client.0.smithi097.stderr: -22> 2024-09-14T11:02:48.401+0000 7f3be37fe640 20 reqs_thread_entry: start 2024-09-14T11:02:48.532 INFO:tasks.workunit.client.0.smithi097.stderr: -21> 2024-09-14T11:02:48.401+0000 7f3db652f800 5 asok(0x559317d31270) register_command sync trace show hook 0x7f3da800ee40 2024-09-14T11:02:48.533 INFO:tasks.workunit.client.0.smithi097.stderr: -20> 2024-09-14T11:02:48.401+0000 7f3db652f800 5 asok(0x559317d31270) register_command sync trace history hook 0x7f3da800ee40 2024-09-14T11:02:48.533 INFO:tasks.workunit.client.0.smithi097.stderr: -19> 2024-09-14T11:02:48.401+0000 7f3db652f800 5 asok(0x559317d31270) register_command sync trace active hook 0x7f3da800ee40 2024-09-14T11:02:48.533 INFO:tasks.workunit.client.0.smithi097.stderr: -18> 2024-09-14T11:02:48.401+0000 7f3db652f800 5 asok(0x559317d31270) register_command sync trace active_short hook 0x7f3da800ee40 2024-09-14T11:02:48.533 INFO:tasks.workunit.client.0.smithi097.stderr: -17> 2024-09-14T11:02:48.401+0000 7f3db652f800 20 init_complete bucket index max shards: 11 2024-09-14T11:02:48.533 INFO:tasks.workunit.client.0.smithi097.stderr: -16> 2024-09-14T11:02:48.401+0000 7f3db652f800 20 Filter name: none 2024-09-14T11:02:48.533 INFO:tasks.workunit.client.0.smithi097.stderr: -15> 2024-09-14T11:02:48.401+0000 7f3be17fa640 20 reqs_thread_entry: start 2024-09-14T11:02:48.533 INFO:tasks.workunit.client.0.smithi097.stderr: -14> 2024-09-14T11:02:48.401+0000 7f3db652f800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:02:48.533 INFO:tasks.workunit.client.0.smithi097.stderr: -13> 2024-09-14T11:02:48.401+0000 7f3db652f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.533 INFO:tasks.workunit.client.0.smithi097.stderr: -12> 2024-09-14T11:02:48.402+0000 7f3db652f800 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:02:48.533 INFO:tasks.workunit.client.0.smithi097.stderr: -11> 2024-09-14T11:02:48.402+0000 7f3db652f800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:02:48.533 INFO:tasks.workunit.client.0.smithi097.stderr: -10> 2024-09-14T11:02:48.402+0000 7f3db652f800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:02:48.533 INFO:tasks.workunit.client.0.smithi097.stderr: -9> 2024-09-14T11:02:48.402+0000 7f3db652f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21 : miss 2024-09-14T11:02:48.533 INFO:tasks.workunit.client.0.smithi097.stderr: -8> 2024-09-14T11:02:48.402+0000 7f3db652f800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.534 INFO:tasks.workunit.client.0.smithi097.stderr: -7> 2024-09-14T11:02:48.402+0000 7f3db652f800 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:02:48.534 INFO:tasks.workunit.client.0.smithi097.stderr: -6> 2024-09-14T11:02:48.402+0000 7f3db652f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21 info.flags=0x17 2024-09-14T11:02:48.534 INFO:tasks.workunit.client.0.smithi097.stderr: -5> 2024-09-14T11:02:48.402+0000 7f3db652f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21 to cache LRU end 2024-09-14T11:02:48.534 INFO:tasks.workunit.client.0.smithi097.stderr: -4> 2024-09-14T11:02:48.402+0000 7f3db652f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:02:48.534 INFO:tasks.workunit.client.0.smithi097.stderr: -3> 2024-09-14T11:02:48.402+0000 7f3db652f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:02:48.534 INFO:tasks.workunit.client.0.smithi097.stderr: -2> 2024-09-14T11:02:48.402+0000 7f3db652f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21 2024-09-14T11:02:48.534 INFO:tasks.workunit.client.0.smithi097.stderr: -1> 2024-09-14T11:02:48.404+0000 7f3db652f800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3db652f800 time 2024-09-14T11:02:48.404944+0000 2024-09-14T11:02:48.534 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:02:48.534 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:48.534 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:02:48.534 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3db7d8c76a] 2024-09-14T11:02:48.534 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f3db7d8c928] 2024-09-14T11:02:48.534 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559316e040b1] 2024-09-14T11:02:48.535 INFO:tasks.workunit.client.0.smithi097.stderr: 4: radosgw-admin(+0xd882d4) [0x5593173172d4] 2024-09-14T11:02:48.535 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559316e13efd] 2024-09-14T11:02:48.535 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-14T11:02:48.535 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3db6a29590] 2024-09-14T11:02:48.535 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-14T11:02:48.535 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-14T11:02:48.535 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:48.535 INFO:tasks.workunit.client.0.smithi097.stderr: 0> 2024-09-14T11:02:48.405+0000 7f3db652f800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:02:48.535 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f3db652f800 thread_name:radosgw-admin 2024-09-14T11:02:48.535 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:48.535 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:02:48.535 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3db6a3e6f0] 2024-09-14T11:02:48.535 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3db6a8b99c] 2024-09-14T11:02:48.535 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-14T11:02:48.536 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-14T11:02:48.536 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3db7d8c7c4] 2024-09-14T11:02:48.536 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f3db7d8c928] 2024-09-14T11:02:48.536 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559316e040b1] 2024-09-14T11:02:48.536 INFO:tasks.workunit.client.0.smithi097.stderr: 8: radosgw-admin(+0xd882d4) [0x5593173172d4] 2024-09-14T11:02:48.536 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559316e13efd] 2024-09-14T11:02:48.536 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-14T11:02:48.536 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3db6a29590] 2024-09-14T11:02:48.536 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-14T11:02:48.536 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-14T11:02:48.536 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:02:48.536 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:48.536 INFO:tasks.workunit.client.0.smithi097.stderr:--- logging levels --- 2024-09-14T11:02:48.536 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 none 2024-09-14T11:02:48.537 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 lockdep 2024-09-14T11:02:48.537 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 context 2024-09-14T11:02:48.537 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 crush 2024-09-14T11:02:48.537 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds 2024-09-14T11:02:48.537 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_balancer 2024-09-14T11:02:48.537 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_locker 2024-09-14T11:02:48.537 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log 2024-09-14T11:02:48.537 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log_expire 2024-09-14T11:02:48.537 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_migrator 2024-09-14T11:02:48.537 INFO:tasks.workunit.client.0.smithi097.stderr: 3/ 5 mds_quiesce 2024-09-14T11:02:48.537 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 buffer 2024-09-14T11:02:48.537 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 timer 2024-09-14T11:02:48.537 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 filer 2024-09-14T11:02:48.537 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 striper 2024-09-14T11:02:48.538 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 objecter 2024-09-14T11:02:48.538 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rados 2024-09-14T11:02:48.538 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd 2024-09-14T11:02:48.538 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_mirror 2024-09-14T11:02:48.538 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_replay 2024-09-14T11:02:48.538 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_pwl 2024-09-14T11:02:48.538 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 journaler 2024-09-14T11:02:48.538 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objectcacher 2024-09-14T11:02:48.538 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:02:48.538 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 client 2024-09-14T11:02:48.538 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 osd 2024-09-14T11:02:48.538 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 optracker 2024-09-14T11:02:48.538 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objclass 2024-09-14T11:02:48.538 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 filestore 2024-09-14T11:02:48.539 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 journal 2024-09-14T11:02:48.539 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 ms 2024-09-14T11:02:48.539 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mon 2024-09-14T11:02:48.539 INFO:tasks.workunit.client.0.smithi097.stderr: 0/10 monc 2024-09-14T11:02:48.539 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 paxos 2024-09-14T11:02:48.539 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 tp 2024-09-14T11:02:48.539 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 auth 2024-09-14T11:02:48.539 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 crypto 2024-09-14T11:02:48.539 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 finisher 2024-09-14T11:02:48.539 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 reserver 2024-09-14T11:02:48.539 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 heartbeatmap 2024-09-14T11:02:48.539 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 perfcounter 2024-09-14T11:02:48.539 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw 2024-09-14T11:02:48.539 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_sync 2024-09-14T11:02:48.540 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_datacache 2024-09-14T11:02:48.540 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_access 2024-09-14T11:02:48.540 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:02:48.540 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_flight 2024-09-14T11:02:48.540 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:02:48.540 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw_notification 2024-09-14T11:02:48.540 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 javaclient 2024-09-14T11:02:48.540 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 asok 2024-09-14T11:02:48.540 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 throttle 2024-09-14T11:02:48.540 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 refs 2024-09-14T11:02:48.540 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 compressor 2024-09-14T11:02:48.540 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluestore 2024-09-14T11:02:48.540 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluefs 2024-09-14T11:02:48.540 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 bdev 2024-09-14T11:02:48.541 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 kstore 2024-09-14T11:02:48.541 INFO:tasks.workunit.client.0.smithi097.stderr: 4/ 5 rocksdb 2024-09-14T11:02:48.541 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 fuse 2024-09-14T11:02:48.541 INFO:tasks.workunit.client.0.smithi097.stderr: 2/ 5 mgr 2024-09-14T11:02:48.541 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mgrc 2024-09-14T11:02:48.541 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 dpdk 2024-09-14T11:02:48.541 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 eventtrace 2024-09-14T11:02:48.541 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 prioritycache 2024-09-14T11:02:48.541 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 test 2024-09-14T11:02:48.541 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:02:48.541 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephsqlite 2024-09-14T11:02:48.541 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:02:48.541 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore 2024-09-14T11:02:48.541 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_onode 2024-09-14T11:02:48.542 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_odata 2024-09-14T11:02:48.542 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_omap 2024-09-14T11:02:48.542 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_tm 2024-09-14T11:02:48.542 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_t 2024-09-14T11:02:48.542 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:02:48.542 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_epm 2024-09-14T11:02:48.542 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_lba 2024-09-14T11:02:48.542 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:02:48.542 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cache 2024-09-14T11:02:48.542 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_journal 2024-09-14T11:02:48.542 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_device 2024-09-14T11:02:48.542 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_backref 2024-09-14T11:02:48.542 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 alienstore 2024-09-14T11:02:48.543 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mclock 2024-09-14T11:02:48.543 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cyanstore 2024-09-14T11:02:48.543 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 ceph_exporter 2024-09-14T11:02:48.543 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 memstore 2024-09-14T11:02:48.543 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 trace 2024-09-14T11:02:48.543 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 ceph_dedup 2024-09-14T11:02:48.543 INFO:tasks.workunit.client.0.smithi097.stderr: -2/-2 (syslog threshold) 2024-09-14T11:02:48.543 INFO:tasks.workunit.client.0.smithi097.stderr: 99/99 (stderr threshold) 2024-09-14T11:02:48.543 INFO:tasks.workunit.client.0.smithi097.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:02:48.543 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3be17fa640 / http_manager 2024-09-14T11:02:48.543 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3be37fe640 / http_manager 2024-09-14T11:02:48.543 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3c68fe1640 / rgw_dt_lg_renew 2024-09-14T11:02:48.543 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3c83fff640 / ms_dispatch 2024-09-14T11:02:48.543 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3c95ffb640 / io_context_pool 2024-09-14T11:02:48.544 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3c97fff640 / ms_dispatch 2024-09-14T11:02:48.544 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3c9ee05640 / ms_dispatch 2024-09-14T11:02:48.544 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3ca0608640 / io_context_pool 2024-09-14T11:02:48.544 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3db1a75640 / msgr-worker-2 2024-09-14T11:02:48.544 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3db2276640 / msgr-worker-1 2024-09-14T11:02:48.544 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3db2a77640 / msgr-worker-0 2024-09-14T11:02:48.544 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3db3278640 / io_context_pool 2024-09-14T11:02:48.544 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3db652f800 / radosgw-admin 2024-09-14T11:02:48.544 INFO:tasks.workunit.client.0.smithi097.stderr: max_recent 500 2024-09-14T11:02:48.544 INFO:tasks.workunit.client.0.smithi097.stderr: max_new 1000 2024-09-14T11:02:48.544 INFO:tasks.workunit.client.0.smithi097.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:02:48.406609Z_c639bd93-f23a-4a56-bbf9-0518f67c3c83/log 2024-09-14T11:02:48.544 INFO:tasks.workunit.client.0.smithi097.stderr:--- end dump of recent events --- 2024-09-14T11:02:48.544 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-14T11:02:48.546 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:02:48.546 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:02:48.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.481+0000 7f2a1172a800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.483+0000 7f2a1172a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:48.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.483+0000 7f2a1172a800 20 realm 2024-09-14T11:02:48.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.483+0000 7f2a1172a800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.483+0000 7f2a1172a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:48.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.483+0000 7f2a1172a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:02:48.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.483+0000 7f2a1172a800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.483+0000 7f2a1172a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:48.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.483+0000 7f2a1172a800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.484+0000 7f2a1172a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:48.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.484+0000 7f2a1172a800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.485+0000 7f2a1172a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:02:48.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.485+0000 7f2a1172a800 20 searching for the correct realm 2024-09-14T11:02:48.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.486+0000 7f2a0db62640 0 -- 172.21.15.97:0/4098729149 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f2a04047040 msgr2=0x7f2a0402a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:02:48.690 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.691+0000 7f2a0cb60640 0 -- 172.21.15.97:0/4098729149 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f2a00007e00 msgr2=0x7f2a000649a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:02:48.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.696+0000 7f2a1172a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:02:48.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.696+0000 7f2a1172a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:02:48.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.696+0000 7f2a1172a800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:02:48.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.696+0000 7f2a1172a800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:02:48.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.696+0000 7f2a1172a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:02:48.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.696+0000 7f2a1172a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:02:48.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.696+0000 7f2a1172a800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.696+0000 7f2a1172a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:48.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.696+0000 7f2a1172a800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.696+0000 7f2a1172a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:48.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.696+0000 7f2a1172a800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.697+0000 7f2a1172a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:02:48.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.697+0000 7f2a1172a800 20 zone default found 2024-09-14T11:02:48.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.697+0000 7f2a1172a800 4 Realm: () 2024-09-14T11:02:48.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.697+0000 7f2a1172a800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:02:48.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.697+0000 7f2a1172a800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:02:48.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.697+0000 7f2a1172a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:02:48.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.697+0000 7f2a1172a800 20 zonegroup default 2024-09-14T11:02:48.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.697+0000 7f2a1172a800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.697+0000 7f2a1172a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:48.698 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.697+0000 7f2a1172a800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.698 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.697+0000 7f2a1172a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:48.698 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.697+0000 7f2a1172a800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.698 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.698+0000 7f2a1172a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:48.698 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.698+0000 7f2a1172a800 20 started sync module instance, tier type = 2024-09-14T11:02:48.698 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.698+0000 7f2a1172a800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:02:48.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.706+0000 7f2a1172a800 20 add_watcher() i=0 2024-09-14T11:02:48.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.706+0000 7f2a1172a800 20 add_watcher() i=1 2024-09-14T11:02:48.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.706+0000 7f2a1172a800 20 add_watcher() i=2 2024-09-14T11:02:48.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.706+0000 7f2a1172a800 20 add_watcher() i=3 2024-09-14T11:02:48.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.706+0000 7f2a1172a800 20 add_watcher() i=4 2024-09-14T11:02:48.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.706+0000 7f2a1172a800 20 add_watcher() i=5 2024-09-14T11:02:48.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.706+0000 7f2a1172a800 20 add_watcher() i=6 2024-09-14T11:02:48.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.707+0000 7f2a1172a800 20 add_watcher() i=7 2024-09-14T11:02:48.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.707+0000 7f2a1172a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:02:48.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.709+0000 7f28c37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:02:48.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.709+0000 7f2a1172a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:02:48.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.709+0000 7f2a1172a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:02:48.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.710+0000 7f2a1172a800 5 note: GC not initialized 2024-09-14T11:02:48.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.710+0000 7f28c27e4640 20 reqs_thread_entry: start 2024-09-14T11:02:48.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.710+0000 7f2a1172a800 20 init_complete bucket index max shards: 11 2024-09-14T11:02:48.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.710+0000 7f2a1172a800 20 Filter name: none 2024-09-14T11:02:48.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.710+0000 7f2833fff640 20 reqs_thread_entry: start 2024-09-14T11:02:48.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.710+0000 7f2a1172a800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.711+0000 7f2a1172a800 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:02:48.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.711+0000 7f2a1172a800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.711+0000 7f2a1172a800 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:02:48.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.712+0000 7f2a1172a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:02:48.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.712+0000 7f2a1172a800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.712+0000 7f2a1172a800 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:02:48.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.712+0000 7f2a1172a800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.713+0000 7f2a1172a800 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:02:48.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.713+0000 7f2a1172a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:02:48.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.714+0000 7f28c37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:02:48.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.717+0000 7f2a1172a800 20 remove_watcher() i=0 2024-09-14T11:02:48.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.717+0000 7f2a1172a800 2 removed watcher, disabling cache 2024-09-14T11:02:48.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.717+0000 7f2a1172a800 20 remove_watcher() i=1 2024-09-14T11:02:48.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.718+0000 7f2a1172a800 20 remove_watcher() i=2 2024-09-14T11:02:48.718 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.719+0000 7f2a1172a800 20 remove_watcher() i=3 2024-09-14T11:02:48.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.720+0000 7f2a1172a800 20 remove_watcher() i=4 2024-09-14T11:02:48.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.721+0000 7f2a1172a800 20 remove_watcher() i=5 2024-09-14T11:02:48.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.722+0000 7f2a1172a800 20 remove_watcher() i=6 2024-09-14T11:02:48.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.723+0000 7f2a1172a800 20 remove_watcher() i=7 2024-09-14T11:02:48.732 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:48.732 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:02:48.733 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: abort-at-init-indext id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:02:48.733 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:02:48.784 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:02:48.815 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:02:48.815 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:02:48.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.853+0000 7f3da13a7800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.855+0000 7f3da13a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:48.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.855+0000 7f3da13a7800 20 realm 2024-09-14T11:02:48.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.855+0000 7f3da13a7800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.855+0000 7f3da13a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:48.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.855+0000 7f3da13a7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:02:48.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.855+0000 7f3da13a7800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.855+0000 7f3da13a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:48.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.855+0000 7f3da13a7800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.856+0000 7f3da13a7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:48.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.856+0000 7f3da13a7800 20 rados->read ofs=0 len=0 2024-09-14T11:02:48.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.857+0000 7f3da13a7800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:02:48.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.857+0000 7f3da13a7800 20 searching for the correct realm 2024-09-14T11:02:48.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:48.859+0000 7f3d9f692640 0 -- 172.21.15.97:0/262114286 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f3d8801a040 msgr2=0x7f3d88067360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:02:49.063 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.064+0000 7f3d96690640 0 -- 172.21.15.97:0/262114286 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f3d90017040 msgr2=0x7f3d90085770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:02:49.067 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.069+0000 7f3da13a7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:02:49.068 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.069+0000 7f3da13a7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:02:49.068 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.069+0000 7f3da13a7800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:02:49.068 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.069+0000 7f3da13a7800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:02:49.068 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.069+0000 7f3da13a7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:02:49.068 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.069+0000 7f3da13a7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:02:49.068 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.069+0000 7f3da13a7800 20 rados->read ofs=0 len=0 2024-09-14T11:02:49.068 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.069+0000 7f3da13a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:49.068 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.069+0000 7f3da13a7800 20 rados->read ofs=0 len=0 2024-09-14T11:02:49.069 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.069+0000 7f3da13a7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:02:49.069 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.069+0000 7f3da13a7800 20 rados->read ofs=0 len=0 2024-09-14T11:02:49.070 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.070+0000 7f3da13a7800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:02:49.070 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.070+0000 7f3da13a7800 20 zone default found 2024-09-14T11:02:49.070 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.070+0000 7f3da13a7800 4 Realm: () 2024-09-14T11:02:49.070 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.070+0000 7f3da13a7800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:02:49.070 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.070+0000 7f3da13a7800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:02:49.070 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.070+0000 7f3da13a7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:02:49.070 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.070+0000 7f3da13a7800 20 zonegroup default 2024-09-14T11:02:49.070 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.070+0000 7f3da13a7800 20 rados->read ofs=0 len=0 2024-09-14T11:02:49.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.070+0000 7f3da13a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:49.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.070+0000 7f3da13a7800 20 rados->read ofs=0 len=0 2024-09-14T11:02:49.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.070+0000 7f3da13a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:49.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.070+0000 7f3da13a7800 20 rados->read ofs=0 len=0 2024-09-14T11:02:49.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.071+0000 7f3da13a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:02:49.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.071+0000 7f3da13a7800 20 started sync module instance, tier type = 2024-09-14T11:02:49.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.071+0000 7f3da13a7800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:02:49.077 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.079+0000 7f3da13a7800 20 add_watcher() i=0 2024-09-14T11:02:49.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.079+0000 7f3da13a7800 20 add_watcher() i=1 2024-09-14T11:02:49.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.079+0000 7f3da13a7800 20 add_watcher() i=2 2024-09-14T11:02:49.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.079+0000 7f3da13a7800 20 add_watcher() i=3 2024-09-14T11:02:49.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.079+0000 7f3da13a7800 20 add_watcher() i=4 2024-09-14T11:02:49.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.079+0000 7f3da13a7800 20 add_watcher() i=5 2024-09-14T11:02:49.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.079+0000 7f3da13a7800 20 add_watcher() i=6 2024-09-14T11:02:49.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.080+0000 7f3da13a7800 20 add_watcher() i=7 2024-09-14T11:02:49.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.080+0000 7f3da13a7800 2 all 8 watchers are set, enabling cache 2024-09-14T11:02:49.080 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.081+0000 7f3c557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:02:49.082 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.082+0000 7f3da13a7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:02:49.082 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.082+0000 7f3da13a7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:02:49.082 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.082+0000 7f3da13a7800 5 note: GC not initialized 2024-09-14T11:02:49.082 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.082+0000 7f3bcffff640 20 reqs_thread_entry: start 2024-09-14T11:02:49.082 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.082+0000 7f3da13a7800 20 init_complete bucket index max shards: 11 2024-09-14T11:02:49.082 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.082+0000 7f3da13a7800 20 Filter name: none 2024-09-14T11:02:49.082 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.082+0000 7f3bcdffb640 20 reqs_thread_entry: start 2024-09-14T11:02:49.082 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.082+0000 7f3da13a7800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:02:49.082 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.082+0000 7f3da13a7800 20 rados->read ofs=0 len=0 2024-09-14T11:02:49.082 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.083+0000 7f3da13a7800 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:02:49.082 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.083+0000 7f3da13a7800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:02:49.082 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.083+0000 7f3da13a7800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:02:49.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.083+0000 7f3da13a7800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21 : miss 2024-09-14T11:02:49.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.083+0000 7f3da13a7800 20 rados->read ofs=0 len=0 2024-09-14T11:02:49.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.083+0000 7f3da13a7800 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:02:49.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.083+0000 7f3da13a7800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21 info.flags=0x17 2024-09-14T11:02:49.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.083+0000 7f3da13a7800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21 to cache LRU end 2024-09-14T11:02:49.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.083+0000 7f3da13a7800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:02:49.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.083+0000 7f3da13a7800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:02:49.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.083+0000 7f3da13a7800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21 2024-09-14T11:02:49.084 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.084+0000 7f3da13a7800 0 INFO: RGWReshardLock::lock found lock on abort-at-init-indext:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21 to be held by another RGW process; skipping for now 2024-09-14T11:02:49.084 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.085+0000 7f3c557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:02:49.085 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.087+0000 7f3da13a7800 20 remove_watcher() i=0 2024-09-14T11:02:49.085 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.087+0000 7f3da13a7800 2 removed watcher, disabling cache 2024-09-14T11:02:49.086 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.088+0000 7f3da13a7800 20 remove_watcher() i=1 2024-09-14T11:02:49.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.089+0000 7f3da13a7800 20 remove_watcher() i=2 2024-09-14T11:02:49.088 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.090+0000 7f3da13a7800 20 remove_watcher() i=3 2024-09-14T11:02:49.089 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.090+0000 7f3da13a7800 20 remove_watcher() i=4 2024-09-14T11:02:49.090 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.091+0000 7f3da13a7800 20 remove_watcher() i=5 2024-09-14T11:02:49.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.092+0000 7f3da13a7800 20 remove_watcher() i=6 2024-09-14T11:02:49.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:02:49.093+0000 7f3da13a7800 20 remove_watcher() i=7 2024-09-14T11:02:49.102 INFO:tasks.workunit.client.0.smithi097.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:03:19.134 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:03:19.178 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:03:19.178 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:03:19.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.228+0000 7f113cc63800 20 rados->read ofs=0 len=0 2024-09-14T11:03:19.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.230+0000 7f113cc63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:19.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.230+0000 7f113cc63800 20 realm 2024-09-14T11:03:19.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.230+0000 7f113cc63800 20 rados->read ofs=0 len=0 2024-09-14T11:03:19.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.230+0000 7f113cc63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:19.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.230+0000 7f113cc63800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:03:19.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.230+0000 7f113cc63800 20 rados->read ofs=0 len=0 2024-09-14T11:03:19.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.230+0000 7f113cc63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:19.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.230+0000 7f113cc63800 20 rados->read ofs=0 len=0 2024-09-14T11:03:19.230 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.231+0000 7f113cc63800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:19.230 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.231+0000 7f113cc63800 20 rados->read ofs=0 len=0 2024-09-14T11:03:19.230 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.232+0000 7f113cc63800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:03:19.230 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.232+0000 7f113cc63800 20 searching for the correct realm 2024-09-14T11:03:19.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.234+0000 7f113af55640 0 -- 172.21.15.97:0/3972332436 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f113007c2c0 msgr2=0x7f1130086b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:03:19.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.440+0000 7f1139f53640 0 -- 172.21.15.97:0/3972332436 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f112c096910 msgr2=0x7f112c061400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:03:19.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.446+0000 7f113cc63800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:03:19.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.446+0000 7f113cc63800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:03:19.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.446+0000 7f113cc63800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:03:19.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.446+0000 7f113cc63800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:03:19.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.446+0000 7f113cc63800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:03:19.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.446+0000 7f113cc63800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:03:19.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.446+0000 7f113cc63800 20 rados->read ofs=0 len=0 2024-09-14T11:03:19.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.447+0000 7f113cc63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:19.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.447+0000 7f113cc63800 20 rados->read ofs=0 len=0 2024-09-14T11:03:19.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.447+0000 7f113cc63800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:19.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.447+0000 7f113cc63800 20 rados->read ofs=0 len=0 2024-09-14T11:03:19.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.447+0000 7f113cc63800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:03:19.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.447+0000 7f113cc63800 20 zone default found 2024-09-14T11:03:19.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.447+0000 7f113cc63800 4 Realm: () 2024-09-14T11:03:19.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.447+0000 7f113cc63800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:03:19.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.447+0000 7f113cc63800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:03:19.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.447+0000 7f113cc63800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:03:19.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.447+0000 7f113cc63800 20 zonegroup default 2024-09-14T11:03:19.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.447+0000 7f113cc63800 20 rados->read ofs=0 len=0 2024-09-14T11:03:19.448 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.448+0000 7f113cc63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:19.448 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.448+0000 7f113cc63800 20 rados->read ofs=0 len=0 2024-09-14T11:03:19.448 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.448+0000 7f113cc63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:19.448 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.448+0000 7f113cc63800 20 rados->read ofs=0 len=0 2024-09-14T11:03:19.448 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.448+0000 7f113cc63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:19.448 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.448+0000 7f113cc63800 20 started sync module instance, tier type = 2024-09-14T11:03:19.448 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.448+0000 7f113cc63800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:03:19.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.458+0000 7f113cc63800 20 add_watcher() i=0 2024-09-14T11:03:19.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.458+0000 7f113cc63800 20 add_watcher() i=1 2024-09-14T11:03:19.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.458+0000 7f113cc63800 20 add_watcher() i=2 2024-09-14T11:03:19.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.458+0000 7f113cc63800 20 add_watcher() i=3 2024-09-14T11:03:19.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.458+0000 7f113cc63800 20 add_watcher() i=4 2024-09-14T11:03:19.458 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.458+0000 7f113cc63800 20 add_watcher() i=5 2024-09-14T11:03:19.458 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.458+0000 7f113cc63800 20 add_watcher() i=6 2024-09-14T11:03:19.458 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.460+0000 7f113cc63800 20 add_watcher() i=7 2024-09-14T11:03:19.458 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.460+0000 7f113cc63800 2 all 8 watchers are set, enabling cache 2024-09-14T11:03:19.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.461+0000 7f0ff0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:19.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.462+0000 7f113cc63800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:03:19.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.462+0000 7f113cc63800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:03:19.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.462+0000 7f113cc63800 5 note: GC not initialized 2024-09-14T11:03:19.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.462+0000 7f0f6b7fe640 20 reqs_thread_entry: start 2024-09-14T11:03:19.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.462+0000 7f113cc63800 20 init_complete bucket index max shards: 11 2024-09-14T11:03:19.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.462+0000 7f113cc63800 20 Filter name: none 2024-09-14T11:03:19.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.462+0000 7f0f697fa640 20 reqs_thread_entry: start 2024-09-14T11:03:19.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.462+0000 7f113cc63800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:03:19.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.462+0000 7f113cc63800 20 rados->read ofs=0 len=0 2024-09-14T11:03:19.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.463+0000 7f113cc63800 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:03:19.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.463+0000 7f113cc63800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:03:19.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.463+0000 7f113cc63800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:03:19.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.463+0000 7f113cc63800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21 : miss 2024-09-14T11:03:19.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.463+0000 7f113cc63800 20 rados->read ofs=0 len=0 2024-09-14T11:03:19.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.464+0000 7f113cc63800 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:03:19.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.464+0000 7f113cc63800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21 info.flags=0x17 2024-09-14T11:03:19.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.464+0000 7f113cc63800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21 to cache LRU end 2024-09-14T11:03:19.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.464+0000 7f113cc63800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:03:19.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.464+0000 7f113cc63800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:19.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.464+0000 7f113cc63800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21 2024-09-14T11:03:19.469 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.470+0000 7f113cc63800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21 info.flags=0x17 2024-09-14T11:03:19.469 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.470+0000 7f113cc63800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21 to cache LRU end 2024-09-14T11:03:19.469 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.470+0000 7f113cc63800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:19.469 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.470+0000 7f113cc63800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21, ofs0, ns] 2024-09-14T11:03:19.469 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.470+0000 7f101dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595172 cookie 93825991799552 notifier 6119 bl.length()=913 2024-09-14T11:03:19.469 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.470+0000 7f101dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21 info.flags=0x17 2024-09-14T11:03:19.469 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.470+0000 7f101dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21 to cache LRU end 2024-09-14T11:03:19.469 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.470+0000 7f101dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:19.469 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.471+0000 7f113cc63800 20 handle_bi_update(): bucket=:abort-at-init-indext[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21]): orig_sources= new_sources= 2024-09-14T11:03:19.470 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.471+0000 7f113cc63800 20 handle_bi_update(): bucket=:abort-at-init-indext[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21]): potential sources added=[] removed=[] 2024-09-14T11:03:19.470 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.471+0000 7f113cc63800 20 handle_bi_update(): bucket=:abort-at-init-indext[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21]): orig_dests= new_dests= 2024-09-14T11:03:19.470 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.471+0000 7f113cc63800 20 handle_bi_update(): bucket=:abort-at-init-indext[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21]): potential dests added=[] removed=[] 2024-09-14T11:03:19.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.476+0000 7f113cc63800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21.1.0 2024-09-14T11:03:19.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.476+0000 7f113cc63800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21.1.0 2024-09-14T11:03:19.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.476+0000 7f113cc63800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21.1.1 2024-09-14T11:03:19.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.476+0000 7f113cc63800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21.1.1 2024-09-14T11:03:19.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.476+0000 7f113cc63800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21.1.2 2024-09-14T11:03:19.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.476+0000 7f113cc63800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21.1.2 2024-09-14T11:03:19.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.476+0000 7f113cc63800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21.1.3 2024-09-14T11:03:19.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.476+0000 7f113cc63800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21.1.3 2024-09-14T11:03:19.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.476+0000 7f113cc63800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21.1.4 2024-09-14T11:03:19.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.476+0000 7f113cc63800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21.1.4 2024-09-14T11:03:19.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.476+0000 7f113cc63800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21.1.5 2024-09-14T11:03:19.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.476+0000 7f113cc63800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21.1.5 2024-09-14T11:03:19.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.476+0000 7f113cc63800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21.1.6 2024-09-14T11:03:19.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.476+0000 7f113cc63800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21.1.6 2024-09-14T11:03:19.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.476+0000 7f113cc63800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21.1.7 2024-09-14T11:03:19.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.476+0000 7f113cc63800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21.1.7 2024-09-14T11:03:19.476 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.476+0000 7f113cc63800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21.1.8 2024-09-14T11:03:19.476 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.476+0000 7f113cc63800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21.1.8 2024-09-14T11:03:19.476 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.476+0000 7f113cc63800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21.1.9 2024-09-14T11:03:19.476 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.476+0000 7f113cc63800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21.1.9 2024-09-14T11:03:19.476 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.476+0000 7f113cc63800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21.1.10 2024-09-14T11:03:19.476 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.476+0000 7f113cc63800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21.1.10 2024-09-14T11:03:19.476 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.476+0000 7f113cc63800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21.1.11 2024-09-14T11:03:19.476 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.476+0000 7f113cc63800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21.1.11 2024-09-14T11:03:19.476 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.476+0000 7f113cc63800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21.0 2024-09-14T11:03:19.477 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.476+0000 7f113cc63800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21.1 2024-09-14T11:03:19.477 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.477+0000 7f113cc63800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21.2 2024-09-14T11:03:19.477 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.478+0000 7f113cc63800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21.3 2024-09-14T11:03:19.477 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.478+0000 7f113cc63800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21.4 2024-09-14T11:03:19.478 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.479+0000 7f113cc63800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21.5 2024-09-14T11:03:19.478 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.479+0000 7f113cc63800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21.6 2024-09-14T11:03:19.478 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.479+0000 7f113cc63800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21.7 2024-09-14T11:03:19.479 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.480+0000 7f113cc63800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21.8 2024-09-14T11:03:19.479 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.481+0000 7f113cc63800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21.9 2024-09-14T11:03:19.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.481+0000 7f113cc63800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21.10 2024-09-14T11:03:19.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.485+0000 7f113cc63800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21 : hit (requested=0x17, cached=0x17) 2024-09-14T11:03:19.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.485+0000 7f113cc63800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21 2024-09-14T11:03:19.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.486+0000 7f113cc63800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21 info.flags=0x17 2024-09-14T11:03:19.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.486+0000 7f113cc63800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21 to cache LRU end 2024-09-14T11:03:19.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.486+0000 7f113cc63800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:19.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.486+0000 7f113cc63800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21, ofs0, ns] 2024-09-14T11:03:19.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.486+0000 7f101d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595173 cookie 93825991799552 notifier 6119 bl.length()=913 2024-09-14T11:03:19.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.486+0000 7f101d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21 info.flags=0x17 2024-09-14T11:03:19.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.486+0000 7f101d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21 to cache LRU end 2024-09-14T11:03:19.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.486+0000 7f101d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:19.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.487+0000 7f113cc63800 20 handle_bi_update(): bucket=:abort-at-init-indext[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21]): orig_sources= new_sources= 2024-09-14T11:03:19.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.487+0000 7f113cc63800 20 handle_bi_update(): bucket=:abort-at-init-indext[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21]): potential sources added=[] removed=[] 2024-09-14T11:03:19.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.487+0000 7f113cc63800 20 handle_bi_update(): bucket=:abort-at-init-indext[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21]): orig_dests= new_dests= 2024-09-14T11:03:19.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.487+0000 7f113cc63800 20 handle_bi_update(): bucket=:abort-at-init-indext[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21]): potential dests added=[] removed=[] 2024-09-14T11:03:19.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.490+0000 7f113cc63800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21.0 2024-09-14T11:03:19.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.490+0000 7f113cc63800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21.1 2024-09-14T11:03:19.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.490+0000 7f113cc63800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21.2 2024-09-14T11:03:19.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.491+0000 7f113cc63800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21.3 2024-09-14T11:03:19.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.491+0000 7f113cc63800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21.4 2024-09-14T11:03:19.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.491+0000 7f113cc63800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21.5 2024-09-14T11:03:19.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.492+0000 7f113cc63800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21.6 2024-09-14T11:03:19.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.492+0000 7f113cc63800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21.7 2024-09-14T11:03:19.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.492+0000 7f113cc63800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21.8 2024-09-14T11:03:19.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.492+0000 7f113cc63800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21.9 2024-09-14T11:03:19.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.493+0000 7f113cc63800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21.10 2024-09-14T11:03:19.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.493+0000 7f113cc63800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21 : hit (requested=0x17, cached=0x17) 2024-09-14T11:03:19.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.493+0000 7f113cc63800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21 2024-09-14T11:03:19.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.495+0000 7f113cc63800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21 info.flags=0x17 2024-09-14T11:03:19.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.495+0000 7f113cc63800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21 to cache LRU end 2024-09-14T11:03:19.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.495+0000 7f113cc63800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:19.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.495+0000 7f113cc63800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21, ofs0, ns] 2024-09-14T11:03:19.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.495+0000 7f101dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595174 cookie 93825991799552 notifier 6119 bl.length()=881 2024-09-14T11:03:19.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.495+0000 7f101dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21 info.flags=0x17 2024-09-14T11:03:19.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.495+0000 7f101dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21 to cache LRU end 2024-09-14T11:03:19.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.495+0000 7f101dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:19.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.495+0000 7f113cc63800 20 handle_bi_update(): bucket=:abort-at-init-indext[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21]): orig_sources= new_sources= 2024-09-14T11:03:19.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.495+0000 7f113cc63800 20 handle_bi_update(): bucket=:abort-at-init-indext[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21]): potential sources added=[] removed=[] 2024-09-14T11:03:19.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.495+0000 7f113cc63800 20 handle_bi_update(): bucket=:abort-at-init-indext[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21]): orig_dests= new_dests= 2024-09-14T11:03:19.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.495+0000 7f113cc63800 20 handle_bi_update(): bucket=:abort-at-init-indext[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21]): potential dests added=[] removed=[] 2024-09-14T11:03:19.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.498+0000 7f113cc63800 1 execute INFO: reshard of bucket "abort-at-init-indext" from 11 shards to 12 shards completed successfully 2024-09-14T11:03:19.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.500+0000 7f0ff0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:19.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.502+0000 7f113cc63800 20 remove_watcher() i=0 2024-09-14T11:03:19.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.502+0000 7f113cc63800 2 removed watcher, disabling cache 2024-09-14T11:03:19.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.503+0000 7f113cc63800 20 remove_watcher() i=1 2024-09-14T11:03:19.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.504+0000 7f113cc63800 20 remove_watcher() i=2 2024-09-14T11:03:19.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.505+0000 7f113cc63800 20 remove_watcher() i=3 2024-09-14T11:03:19.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.506+0000 7f113cc63800 20 remove_watcher() i=4 2024-09-14T11:03:19.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.508+0000 7f113cc63800 20 remove_watcher() i=5 2024-09-14T11:03:19.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.509+0000 7f113cc63800 20 remove_watcher() i=6 2024-09-14T11:03:19.508 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.510+0000 7f113cc63800 20 remove_watcher() i=7 2024-09-14T11:03:19.521 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-14T11:03:19.549 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:03:19.549 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:03:19.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.781+0000 7f9373cca640 0 --2- 172.21.15.97:0/2278544471 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b33c77bac0 0x55b33c781d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:03:19.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.788+0000 7f9380e14800 20 rados->read ofs=0 len=0 2024-09-14T11:03:19.789 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.790+0000 7f9380e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:19.789 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.790+0000 7f9380e14800 20 realm 2024-09-14T11:03:19.789 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.790+0000 7f9380e14800 20 rados->read ofs=0 len=0 2024-09-14T11:03:19.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.791+0000 7f9380e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:19.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.791+0000 7f9380e14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:03:19.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.791+0000 7f9380e14800 20 rados->read ofs=0 len=0 2024-09-14T11:03:19.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.791+0000 7f9380e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:19.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.791+0000 7f9380e14800 20 rados->read ofs=0 len=0 2024-09-14T11:03:19.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.792+0000 7f9380e14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:19.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.792+0000 7f9380e14800 20 rados->read ofs=0 len=0 2024-09-14T11:03:19.791 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.793+0000 7f9380e14800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:03:19.791 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.793+0000 7f9380e14800 20 searching for the correct realm 2024-09-14T11:03:19.791 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.793+0000 7f937c4cb640 0 -- 172.21.15.97:0/2982084731 >> [v2:172.21.15.152:6808/1010851305,v1:172.21.15.152:6809/1010851305] conn(0x55b33c7ef750 msgr2=0x55b33c7f1c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:03:19.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:19.998+0000 7f937c4cb640 0 -- 172.21.15.97:0/2982084731 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x55b33c7e3080 msgr2=0x55b33c7e5470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:03:20.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.006+0000 7f9380e14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:03:20.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.006+0000 7f9380e14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:03:20.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.006+0000 7f9380e14800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:03:20.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.006+0000 7f9380e14800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:03:20.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.006+0000 7f9380e14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:03:20.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.006+0000 7f9380e14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:03:20.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.006+0000 7f9380e14800 20 rados->read ofs=0 len=0 2024-09-14T11:03:20.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.006+0000 7f9380e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:20.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.006+0000 7f9380e14800 20 rados->read ofs=0 len=0 2024-09-14T11:03:20.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.006+0000 7f9380e14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:20.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.006+0000 7f9380e14800 20 rados->read ofs=0 len=0 2024-09-14T11:03:20.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.007+0000 7f9380e14800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:03:20.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.007+0000 7f9380e14800 20 zone default found 2024-09-14T11:03:20.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.007+0000 7f9380e14800 4 Realm: () 2024-09-14T11:03:20.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.007+0000 7f9380e14800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:03:20.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.007+0000 7f9380e14800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:03:20.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.007+0000 7f9380e14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:03:20.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.007+0000 7f9380e14800 20 zonegroup default 2024-09-14T11:03:20.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.007+0000 7f9380e14800 20 rados->read ofs=0 len=0 2024-09-14T11:03:20.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.007+0000 7f9380e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:20.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.007+0000 7f9380e14800 20 rados->read ofs=0 len=0 2024-09-14T11:03:20.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.007+0000 7f9380e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:20.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.007+0000 7f9380e14800 20 rados->read ofs=0 len=0 2024-09-14T11:03:20.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.008+0000 7f9380e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:20.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.008+0000 7f9380e14800 20 started sync module instance, tier type = 2024-09-14T11:03:20.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.008+0000 7f9380e14800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:03:20.016 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.017+0000 7f9380e14800 20 add_watcher() i=0 2024-09-14T11:03:20.016 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.017+0000 7f9380e14800 20 add_watcher() i=1 2024-09-14T11:03:20.016 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.017+0000 7f9380e14800 20 add_watcher() i=2 2024-09-14T11:03:20.016 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.017+0000 7f9380e14800 20 add_watcher() i=3 2024-09-14T11:03:20.016 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.017+0000 7f9380e14800 20 add_watcher() i=4 2024-09-14T11:03:20.016 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.017+0000 7f9380e14800 20 add_watcher() i=5 2024-09-14T11:03:20.016 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.017+0000 7f9380e14800 20 add_watcher() i=6 2024-09-14T11:03:20.017 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.018+0000 7f9380e14800 20 add_watcher() i=7 2024-09-14T11:03:20.017 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.018+0000 7f9380e14800 2 all 8 watchers are set, enabling cache 2024-09-14T11:03:20.019 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.020+0000 7f9232fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:20.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.021+0000 7f9380e14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:03:20.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.021+0000 7f9380e14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:03:20.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.021+0000 7f9380e14800 5 note: GC not initialized 2024-09-14T11:03:20.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.021+0000 7f9231fdb640 20 reqs_thread_entry: start 2024-09-14T11:03:20.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.021+0000 7f9380e14800 20 init_complete bucket index max shards: 11 2024-09-14T11:03:20.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.021+0000 7f9380e14800 20 Filter name: none 2024-09-14T11:03:20.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.021+0000 7f91a37fe640 20 reqs_thread_entry: start 2024-09-14T11:03:20.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.021+0000 7f9380e14800 20 rados->read ofs=0 len=0 2024-09-14T11:03:20.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.022+0000 7f9380e14800 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:03:20.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.022+0000 7f9380e14800 20 rados->read ofs=0 len=0 2024-09-14T11:03:20.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.022+0000 7f9380e14800 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:03:20.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.022+0000 7f9380e14800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:03:20.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.022+0000 7f9380e14800 20 rados->read ofs=0 len=0 2024-09-14T11:03:20.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.023+0000 7f9380e14800 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:03:20.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.023+0000 7f9380e14800 20 rados->read ofs=0 len=0 2024-09-14T11:03:20.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.023+0000 7f9380e14800 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:03:20.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.023+0000 7f9380e14800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:03:20.024 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.025+0000 7f9232fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:20.026 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.027+0000 7f9380e14800 20 remove_watcher() i=0 2024-09-14T11:03:20.026 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.027+0000 7f9380e14800 2 removed watcher, disabling cache 2024-09-14T11:03:20.027 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.028+0000 7f9380e14800 20 remove_watcher() i=1 2024-09-14T11:03:20.028 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.029+0000 7f9380e14800 20 remove_watcher() i=2 2024-09-14T11:03:20.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.030+0000 7f9380e14800 20 remove_watcher() i=3 2024-09-14T11:03:20.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.031+0000 7f9380e14800 20 remove_watcher() i=4 2024-09-14T11:03:20.031 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.033+0000 7f9380e14800 20 remove_watcher() i=5 2024-09-14T11:03:20.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.034+0000 7f9380e14800 20 remove_watcher() i=6 2024-09-14T11:03:20.033 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.035+0000 7f9380e14800 20 remove_watcher() i=7 2024-09-14T11:03:20.044 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:20.044 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:03:20.044 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: abort-at-init-indext id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:03:20.044 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:20.120 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-09-14T11:03:20.121 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:20.321 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:03:20.349 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:03:20.349 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:03:20.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.387+0000 7fb9f2e63800 20 rados->read ofs=0 len=0 2024-09-14T11:03:20.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.389+0000 7fb9f2e63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:20.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.389+0000 7fb9f2e63800 20 realm 2024-09-14T11:03:20.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.389+0000 7fb9f2e63800 20 rados->read ofs=0 len=0 2024-09-14T11:03:20.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.389+0000 7fb9f2e63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:20.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.389+0000 7fb9f2e63800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:03:20.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.389+0000 7fb9f2e63800 20 rados->read ofs=0 len=0 2024-09-14T11:03:20.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.390+0000 7fb9f2e63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:20.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.390+0000 7fb9f2e63800 20 rados->read ofs=0 len=0 2024-09-14T11:03:20.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.390+0000 7fb9f2e63800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:20.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.390+0000 7fb9f2e63800 20 rados->read ofs=0 len=0 2024-09-14T11:03:20.390 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.391+0000 7fb9f2e63800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:03:20.390 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.391+0000 7fb9f2e63800 20 searching for the correct realm 2024-09-14T11:03:20.392 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.394+0000 7fb9f0954640 0 -- 172.21.15.97:0/992045506 >> [v2:172.21.15.152:6808/1010851305,v1:172.21.15.152:6809/1010851305] conn(0x55715bf1a600 msgr2=0x55715bf1caa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:03:20.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.397+0000 7fb9f1155640 0 -- 172.21.15.97:0/992045506 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x55715bf0de30 msgr2=0x55715bf102f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:03:20.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.401+0000 7fb9f2e63800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:03:20.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.401+0000 7fb9f2e63800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:03:20.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.401+0000 7fb9f2e63800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:03:20.400 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.401+0000 7fb9f2e63800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:03:20.400 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.401+0000 7fb9f2e63800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:03:20.400 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.401+0000 7fb9f2e63800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:03:20.400 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.401+0000 7fb9f2e63800 20 rados->read ofs=0 len=0 2024-09-14T11:03:20.400 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.401+0000 7fb9f2e63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:20.400 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.401+0000 7fb9f2e63800 20 rados->read ofs=0 len=0 2024-09-14T11:03:20.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.401+0000 7fb9f2e63800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:20.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.401+0000 7fb9f2e63800 20 rados->read ofs=0 len=0 2024-09-14T11:03:20.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.402+0000 7fb9f2e63800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:03:20.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.402+0000 7fb9f2e63800 20 zone default found 2024-09-14T11:03:20.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.402+0000 7fb9f2e63800 4 Realm: () 2024-09-14T11:03:20.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.402+0000 7fb9f2e63800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:03:20.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.402+0000 7fb9f2e63800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:03:20.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.402+0000 7fb9f2e63800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:03:20.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.402+0000 7fb9f2e63800 20 zonegroup default 2024-09-14T11:03:20.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.402+0000 7fb9f2e63800 20 rados->read ofs=0 len=0 2024-09-14T11:03:20.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.402+0000 7fb9f2e63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:20.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.402+0000 7fb9f2e63800 20 rados->read ofs=0 len=0 2024-09-14T11:03:20.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.402+0000 7fb9f2e63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:20.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.402+0000 7fb9f2e63800 20 rados->read ofs=0 len=0 2024-09-14T11:03:20.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.402+0000 7fb9f2e63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:20.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.402+0000 7fb9f2e63800 20 started sync module instance, tier type = 2024-09-14T11:03:20.403 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.402+0000 7fb9f2e63800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:03:20.409 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.411+0000 7fb9f2e63800 20 add_watcher() i=0 2024-09-14T11:03:20.409 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.411+0000 7fb9f2e63800 20 add_watcher() i=1 2024-09-14T11:03:20.409 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.411+0000 7fb9f2e63800 20 add_watcher() i=2 2024-09-14T11:03:20.409 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.411+0000 7fb9f2e63800 20 add_watcher() i=3 2024-09-14T11:03:20.410 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.411+0000 7fb9f2e63800 20 add_watcher() i=4 2024-09-14T11:03:20.410 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.411+0000 7fb9f2e63800 20 add_watcher() i=5 2024-09-14T11:03:20.410 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.411+0000 7fb9f2e63800 20 add_watcher() i=6 2024-09-14T11:03:20.410 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.412+0000 7fb9f2e63800 20 add_watcher() i=7 2024-09-14T11:03:20.410 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.412+0000 7fb9f2e63800 2 all 8 watchers are set, enabling cache 2024-09-14T11:03:20.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.414+0000 7fb8a6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:20.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.414+0000 7fb9f2e63800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:03:20.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.414+0000 7fb9f2e63800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:03:20.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.414+0000 7fb9f2e63800 5 note: GC not initialized 2024-09-14T11:03:20.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.414+0000 7fb8a5fe3640 20 reqs_thread_entry: start 2024-09-14T11:03:20.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.414+0000 7fb9f2e63800 20 init_complete bucket index max shards: 11 2024-09-14T11:03:20.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.414+0000 7fb9f2e63800 20 Filter name: none 2024-09-14T11:03:20.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.414+0000 7fb9f2e63800 20 rados->read ofs=0 len=0 2024-09-14T11:03:20.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.414+0000 7fb8177fe640 20 reqs_thread_entry: start 2024-09-14T11:03:20.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.415+0000 7fb9f2e63800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:03:20.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.415+0000 7fb9f2e63800 20 rados->read ofs=0 len=0 2024-09-14T11:03:20.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.415+0000 7fb9f2e63800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:03:20.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.415+0000 7fb9f2e63800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:03:20.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.415+0000 7fb9f2e63800 20 rados->read ofs=0 len=0 2024-09-14T11:03:20.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.416+0000 7fb9f2e63800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:03:20.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.416+0000 7fb9f2e63800 20 rados->read ofs=0 len=0 2024-09-14T11:03:20.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.416+0000 7fb9f2e63800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:03:20.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.416+0000 7fb9f2e63800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:03:20.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.418+0000 7fb8a6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:20.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.420+0000 7fb9f2e63800 20 remove_watcher() i=0 2024-09-14T11:03:20.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.420+0000 7fb9f2e63800 2 removed watcher, disabling cache 2024-09-14T11:03:20.419 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.421+0000 7fb9f2e63800 20 remove_watcher() i=1 2024-09-14T11:03:20.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.421+0000 7fb9f2e63800 20 remove_watcher() i=2 2024-09-14T11:03:20.421 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.422+0000 7fb9f2e63800 20 remove_watcher() i=3 2024-09-14T11:03:20.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.423+0000 7fb9f2e63800 20 remove_watcher() i=4 2024-09-14T11:03:20.423 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.424+0000 7fb9f2e63800 20 remove_watcher() i=5 2024-09-14T11:03:20.423 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.425+0000 7fb9f2e63800 20 remove_watcher() i=6 2024-09-14T11:03:20.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.426+0000 7fb9f2e63800 20 remove_watcher() i=7 2024-09-14T11:03:20.435 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:20.435 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:03:20.435 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-set-target-layout id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:03:20.435 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:20.436 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-09-14T11:03:20.471 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:03:20.471 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:03:20.508 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.509+0000 7f93eaa0f800 20 rados->read ofs=0 len=0 2024-09-14T11:03:20.509 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.511+0000 7f93eaa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:20.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.511+0000 7f93eaa0f800 20 realm 2024-09-14T11:03:20.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.511+0000 7f93eaa0f800 20 rados->read ofs=0 len=0 2024-09-14T11:03:20.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.511+0000 7f93eaa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:20.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.511+0000 7f93eaa0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:03:20.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.511+0000 7f93eaa0f800 20 rados->read ofs=0 len=0 2024-09-14T11:03:20.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.511+0000 7f93eaa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:20.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.511+0000 7f93eaa0f800 20 rados->read ofs=0 len=0 2024-09-14T11:03:20.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.512+0000 7f93eaa0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:20.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.512+0000 7f93eaa0f800 20 rados->read ofs=0 len=0 2024-09-14T11:03:20.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.513+0000 7f93eaa0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:03:20.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.513+0000 7f93eaa0f800 20 searching for the correct realm 2024-09-14T11:03:20.513 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.515+0000 7f93e6923640 0 -- 172.21.15.97:0/1593398787 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f93dc0c9040 msgr2=0x7f93dc0a4070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:03:20.718 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.720+0000 7f93e5921640 0 -- 172.21.15.97:0/1593398787 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f93d806a390 msgr2=0x7f93d8073000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:03:20.723 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.725+0000 7f93eaa0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:03:20.724 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.725+0000 7f93eaa0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:03:20.724 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.725+0000 7f93eaa0f800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:03:20.724 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.725+0000 7f93eaa0f800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:03:20.724 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.725+0000 7f93eaa0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:03:20.724 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.725+0000 7f93eaa0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:03:20.724 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.725+0000 7f93eaa0f800 20 rados->read ofs=0 len=0 2024-09-14T11:03:20.724 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.725+0000 7f93eaa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:20.724 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.725+0000 7f93eaa0f800 20 rados->read ofs=0 len=0 2024-09-14T11:03:20.724 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.725+0000 7f93eaa0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:20.724 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.725+0000 7f93eaa0f800 20 rados->read ofs=0 len=0 2024-09-14T11:03:20.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.725+0000 7f93eaa0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:03:20.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.725+0000 7f93eaa0f800 20 zone default found 2024-09-14T11:03:20.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.725+0000 7f93eaa0f800 4 Realm: () 2024-09-14T11:03:20.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.725+0000 7f93eaa0f800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:03:20.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.725+0000 7f93eaa0f800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:03:20.726 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.725+0000 7f93eaa0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:03:20.726 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.725+0000 7f93eaa0f800 20 zonegroup default 2024-09-14T11:03:20.726 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.725+0000 7f93eaa0f800 20 rados->read ofs=0 len=0 2024-09-14T11:03:20.726 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.726+0000 7f93eaa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:20.726 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.726+0000 7f93eaa0f800 20 rados->read ofs=0 len=0 2024-09-14T11:03:20.726 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.726+0000 7f93eaa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:20.726 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.726+0000 7f93eaa0f800 20 rados->read ofs=0 len=0 2024-09-14T11:03:20.726 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.726+0000 7f93eaa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:20.726 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.726+0000 7f93eaa0f800 20 started sync module instance, tier type = 2024-09-14T11:03:20.726 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.726+0000 7f93eaa0f800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:03:20.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.735+0000 7f93eaa0f800 20 add_watcher() i=0 2024-09-14T11:03:20.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.735+0000 7f93eaa0f800 20 add_watcher() i=1 2024-09-14T11:03:20.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.735+0000 7f93eaa0f800 20 add_watcher() i=2 2024-09-14T11:03:20.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.735+0000 7f93eaa0f800 20 add_watcher() i=3 2024-09-14T11:03:20.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.735+0000 7f93eaa0f800 20 add_watcher() i=4 2024-09-14T11:03:20.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.735+0000 7f93eaa0f800 20 add_watcher() i=5 2024-09-14T11:03:20.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.735+0000 7f93eaa0f800 20 add_watcher() i=6 2024-09-14T11:03:20.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.736+0000 7f93eaa0f800 20 add_watcher() i=7 2024-09-14T11:03:20.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.736+0000 7f93eaa0f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:03:20.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.738+0000 7f929d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:20.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.738+0000 7f93eaa0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:03:20.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.738+0000 7f93eaa0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:03:20.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.738+0000 7f93eaa0f800 5 note: GC not initialized 2024-09-14T11:03:20.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.739+0000 7f92977fe640 20 reqs_thread_entry: start 2024-09-14T11:03:20.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.739+0000 7f93eaa0f800 20 init_complete bucket index max shards: 11 2024-09-14T11:03:20.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.739+0000 7f93eaa0f800 20 Filter name: none 2024-09-14T11:03:20.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.739+0000 7f92957fa640 20 reqs_thread_entry: start 2024-09-14T11:03:20.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.739+0000 7f93eaa0f800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-14T11:03:20.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.739+0000 7f93eaa0f800 20 rados->read ofs=0 len=0 2024-09-14T11:03:20.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.739+0000 7f93eaa0f800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:03:20.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.739+0000 7f93eaa0f800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-14T11:03:20.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.739+0000 7f93eaa0f800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-14T11:03:20.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.739+0000 7f93eaa0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22 : miss 2024-09-14T11:03:20.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.739+0000 7f93eaa0f800 20 rados->read ofs=0 len=0 2024-09-14T11:03:20.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.740+0000 7f93eaa0f800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:03:20.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.740+0000 7f93eaa0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22 info.flags=0x17 2024-09-14T11:03:20.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.740+0000 7f93eaa0f800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22 to cache LRU end 2024-09-14T11:03:20.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.740+0000 7f93eaa0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:03:20.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.740+0000 7f93eaa0f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:20.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.740+0000 7f93eaa0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22 2024-09-14T11:03:20.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.743+0000 7f93eaa0f800 -1 Injecting error=-5 at location=set_target_layout 2024-09-14T11:03:20.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.743+0000 7f93eaa0f800 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-09-14T11:03:20.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.747+0000 7f929d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:20.748 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.749+0000 7f93eaa0f800 20 remove_watcher() i=0 2024-09-14T11:03:20.748 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.749+0000 7f93eaa0f800 2 removed watcher, disabling cache 2024-09-14T11:03:20.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.750+0000 7f93eaa0f800 20 remove_watcher() i=1 2024-09-14T11:03:20.750 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.752+0000 7f93eaa0f800 20 remove_watcher() i=2 2024-09-14T11:03:20.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.753+0000 7f93eaa0f800 20 remove_watcher() i=3 2024-09-14T11:03:20.752 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.753+0000 7f93eaa0f800 20 remove_watcher() i=4 2024-09-14T11:03:20.753 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.755+0000 7f93eaa0f800 20 remove_watcher() i=5 2024-09-14T11:03:20.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.756+0000 7f93eaa0f800 20 remove_watcher() i=6 2024-09-14T11:03:20.755 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.757+0000 7f93eaa0f800 20 remove_watcher() i=7 2024-09-14T11:03:20.766 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:03:20.794 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:03:20.795 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:03:20.831 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.833+0000 7f78c0323800 20 rados->read ofs=0 len=0 2024-09-14T11:03:20.833 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.834+0000 7f78c0323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:20.833 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.834+0000 7f78c0323800 20 realm 2024-09-14T11:03:20.833 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.834+0000 7f78c0323800 20 rados->read ofs=0 len=0 2024-09-14T11:03:20.833 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.835+0000 7f78c0323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:20.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.835+0000 7f78c0323800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:03:20.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.835+0000 7f78c0323800 20 rados->read ofs=0 len=0 2024-09-14T11:03:20.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.835+0000 7f78c0323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:20.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.835+0000 7f78c0323800 20 rados->read ofs=0 len=0 2024-09-14T11:03:20.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.836+0000 7f78c0323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:20.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.836+0000 7f78c0323800 20 rados->read ofs=0 len=0 2024-09-14T11:03:20.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.837+0000 7f78c0323800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:03:20.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.837+0000 7f78c0323800 20 searching for the correct realm 2024-09-14T11:03:20.837 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:20.839+0000 7f78bc80d640 0 -- 172.21.15.97:0/1700667240 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f78a4032070 msgr2=0x7f78a406b510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:03:21.043 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.044+0000 7f78bb80b640 0 -- 172.21.15.97:0/1700667240 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f78b40b53a0 msgr2=0x7f78b40b4d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:03:21.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.049+0000 7f78c0323800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:03:21.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.049+0000 7f78c0323800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:03:21.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.049+0000 7f78c0323800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:03:21.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.049+0000 7f78c0323800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:03:21.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.049+0000 7f78c0323800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:03:21.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.049+0000 7f78c0323800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:03:21.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.049+0000 7f78c0323800 20 rados->read ofs=0 len=0 2024-09-14T11:03:21.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.049+0000 7f78c0323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:21.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.049+0000 7f78c0323800 20 rados->read ofs=0 len=0 2024-09-14T11:03:21.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.049+0000 7f78c0323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:21.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.049+0000 7f78c0323800 20 rados->read ofs=0 len=0 2024-09-14T11:03:21.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.050+0000 7f78c0323800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:03:21.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.050+0000 7f78c0323800 20 zone default found 2024-09-14T11:03:21.050 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.050+0000 7f78c0323800 4 Realm: () 2024-09-14T11:03:21.050 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.050+0000 7f78c0323800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:03:21.050 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.050+0000 7f78c0323800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:03:21.050 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.050+0000 7f78c0323800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:03:21.050 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.050+0000 7f78c0323800 20 zonegroup default 2024-09-14T11:03:21.050 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.050+0000 7f78c0323800 20 rados->read ofs=0 len=0 2024-09-14T11:03:21.050 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.050+0000 7f78c0323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:21.050 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.050+0000 7f78c0323800 20 rados->read ofs=0 len=0 2024-09-14T11:03:21.050 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.051+0000 7f78c0323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:21.050 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.051+0000 7f78c0323800 20 rados->read ofs=0 len=0 2024-09-14T11:03:21.051 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.051+0000 7f78c0323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:21.051 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.051+0000 7f78c0323800 20 started sync module instance, tier type = 2024-09-14T11:03:21.051 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.051+0000 7f78c0323800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:03:21.058 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.059+0000 7f78c0323800 20 add_watcher() i=0 2024-09-14T11:03:21.058 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.059+0000 7f78c0323800 20 add_watcher() i=1 2024-09-14T11:03:21.058 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.059+0000 7f78c0323800 20 add_watcher() i=2 2024-09-14T11:03:21.058 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.059+0000 7f78c0323800 20 add_watcher() i=3 2024-09-14T11:03:21.059 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.059+0000 7f78c0323800 20 add_watcher() i=4 2024-09-14T11:03:21.059 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.059+0000 7f78c0323800 20 add_watcher() i=5 2024-09-14T11:03:21.059 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.059+0000 7f78c0323800 20 add_watcher() i=6 2024-09-14T11:03:21.059 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.060+0000 7f78c0323800 20 add_watcher() i=7 2024-09-14T11:03:21.059 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.060+0000 7f78c0323800 2 all 8 watchers are set, enabling cache 2024-09-14T11:03:21.061 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.062+0000 7f7772fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:21.061 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.062+0000 7f78c0323800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:03:21.062 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.062+0000 7f78c0323800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:03:21.062 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.062+0000 7f78c0323800 5 note: GC not initialized 2024-09-14T11:03:21.062 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.063+0000 7f7771fdb640 20 reqs_thread_entry: start 2024-09-14T11:03:21.062 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.063+0000 7f78c0323800 20 init_complete bucket index max shards: 11 2024-09-14T11:03:21.062 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.063+0000 7f78c0323800 20 Filter name: none 2024-09-14T11:03:21.062 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.063+0000 7f76e37fe640 20 reqs_thread_entry: start 2024-09-14T11:03:21.062 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.063+0000 7f78c0323800 20 rados->read ofs=0 len=0 2024-09-14T11:03:21.064 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.063+0000 7f78c0323800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:03:21.064 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.063+0000 7f78c0323800 20 rados->read ofs=0 len=0 2024-09-14T11:03:21.064 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.064+0000 7f78c0323800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:03:21.064 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.064+0000 7f78c0323800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:03:21.064 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.064+0000 7f78c0323800 20 rados->read ofs=0 len=0 2024-09-14T11:03:21.064 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.064+0000 7f78c0323800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:03:21.064 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.064+0000 7f78c0323800 20 rados->read ofs=0 len=0 2024-09-14T11:03:21.064 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.065+0000 7f78c0323800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:03:21.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.065+0000 7f78c0323800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:03:21.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.066+0000 7f7772fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:21.067 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.069+0000 7f78c0323800 20 remove_watcher() i=0 2024-09-14T11:03:21.067 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.069+0000 7f78c0323800 2 removed watcher, disabling cache 2024-09-14T11:03:21.068 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.070+0000 7f78c0323800 20 remove_watcher() i=1 2024-09-14T11:03:21.069 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.070+0000 7f78c0323800 20 remove_watcher() i=2 2024-09-14T11:03:21.070 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.071+0000 7f78c0323800 20 remove_watcher() i=3 2024-09-14T11:03:21.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.072+0000 7f78c0323800 20 remove_watcher() i=4 2024-09-14T11:03:21.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.073+0000 7f78c0323800 20 remove_watcher() i=5 2024-09-14T11:03:21.072 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.074+0000 7f78c0323800 20 remove_watcher() i=6 2024-09-14T11:03:21.077 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.075+0000 7f78c0323800 20 remove_watcher() i=7 2024-09-14T11:03:21.084 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:21.085 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:03:21.085 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-set-target-layout id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:03:21.085 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:21.138 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:03:21.168 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:03:21.168 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:03:21.406 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.407+0000 7fbbce542800 20 rados->read ofs=0 len=0 2024-09-14T11:03:21.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.409+0000 7fbbce542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:21.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.409+0000 7fbbce542800 20 realm 2024-09-14T11:03:21.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.409+0000 7fbbce542800 20 rados->read ofs=0 len=0 2024-09-14T11:03:21.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.409+0000 7fbbce542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:21.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.409+0000 7fbbce542800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:03:21.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.409+0000 7fbbce542800 20 rados->read ofs=0 len=0 2024-09-14T11:03:21.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.409+0000 7fbbce542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:21.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.409+0000 7fbbce542800 20 rados->read ofs=0 len=0 2024-09-14T11:03:21.409 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.410+0000 7fbbce542800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:21.409 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.410+0000 7fbbce542800 20 rados->read ofs=0 len=0 2024-09-14T11:03:21.409 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.411+0000 7fbbce542800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:03:21.409 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.411+0000 7fbbce542800 20 searching for the correct realm 2024-09-14T11:03:21.411 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.413+0000 7fbbcaa87640 0 -- 172.21.15.97:0/975226936 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7fbbc0079070 msgr2=0x7fbbc0084a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:03:21.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.617+0000 7fbbc9a85640 0 -- 172.21.15.97:0/975226936 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7fbbbc008070 msgr2=0x7fbbbc072df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:03:21.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.621+0000 7fbbce542800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:03:21.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.621+0000 7fbbce542800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:03:21.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.621+0000 7fbbce542800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:03:21.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.621+0000 7fbbce542800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:03:21.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.621+0000 7fbbce542800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:03:21.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.621+0000 7fbbce542800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:03:21.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.621+0000 7fbbce542800 20 rados->read ofs=0 len=0 2024-09-14T11:03:21.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.622+0000 7fbbce542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:21.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.622+0000 7fbbce542800 20 rados->read ofs=0 len=0 2024-09-14T11:03:21.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.622+0000 7fbbce542800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:21.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.622+0000 7fbbce542800 20 rados->read ofs=0 len=0 2024-09-14T11:03:21.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.622+0000 7fbbce542800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:03:21.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.622+0000 7fbbce542800 20 zone default found 2024-09-14T11:03:21.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.622+0000 7fbbce542800 4 Realm: () 2024-09-14T11:03:21.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.622+0000 7fbbce542800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:03:21.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.622+0000 7fbbce542800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:03:21.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.622+0000 7fbbce542800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:03:21.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.622+0000 7fbbce542800 20 zonegroup default 2024-09-14T11:03:21.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.622+0000 7fbbce542800 20 rados->read ofs=0 len=0 2024-09-14T11:03:21.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.623+0000 7fbbce542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:21.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.623+0000 7fbbce542800 20 rados->read ofs=0 len=0 2024-09-14T11:03:21.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.623+0000 7fbbce542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:21.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.623+0000 7fbbce542800 20 rados->read ofs=0 len=0 2024-09-14T11:03:21.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.623+0000 7fbbce542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:21.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.623+0000 7fbbce542800 20 started sync module instance, tier type = 2024-09-14T11:03:21.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.623+0000 7fbbce542800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:03:21.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.632+0000 7fbbce542800 20 add_watcher() i=0 2024-09-14T11:03:21.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.632+0000 7fbbce542800 20 add_watcher() i=1 2024-09-14T11:03:21.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.632+0000 7fbbce542800 20 add_watcher() i=2 2024-09-14T11:03:21.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.632+0000 7fbbce542800 20 add_watcher() i=3 2024-09-14T11:03:21.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.632+0000 7fbbce542800 20 add_watcher() i=4 2024-09-14T11:03:21.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.632+0000 7fbbce542800 20 add_watcher() i=5 2024-09-14T11:03:21.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.632+0000 7fbbce542800 20 add_watcher() i=6 2024-09-14T11:03:21.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.633+0000 7fbbce542800 20 add_watcher() i=7 2024-09-14T11:03:21.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.633+0000 7fbbce542800 2 all 8 watchers are set, enabling cache 2024-09-14T11:03:21.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.635+0000 7fba80fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:21.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.636+0000 7fbbce542800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:03:21.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.636+0000 7fbbce542800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:03:21.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.636+0000 7fbbce542800 5 note: GC not initialized 2024-09-14T11:03:21.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.636+0000 7fb9fb7fe640 20 reqs_thread_entry: start 2024-09-14T11:03:21.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.636+0000 7fbbce542800 20 init_complete bucket index max shards: 11 2024-09-14T11:03:21.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.636+0000 7fbbce542800 20 Filter name: none 2024-09-14T11:03:21.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.636+0000 7fb9f97fa640 20 reqs_thread_entry: start 2024-09-14T11:03:21.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.636+0000 7fbbce542800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-14T11:03:21.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.636+0000 7fbbce542800 20 rados->read ofs=0 len=0 2024-09-14T11:03:21.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.637+0000 7fbbce542800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:03:21.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.637+0000 7fbbce542800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-14T11:03:21.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.637+0000 7fbbce542800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-14T11:03:21.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.637+0000 7fbbce542800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22 : miss 2024-09-14T11:03:21.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.637+0000 7fbbce542800 20 rados->read ofs=0 len=0 2024-09-14T11:03:21.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.637+0000 7fbbce542800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:03:21.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.637+0000 7fbbce542800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22 info.flags=0x17 2024-09-14T11:03:21.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.637+0000 7fbbce542800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22 to cache LRU end 2024-09-14T11:03:21.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.637+0000 7fbbce542800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:03:21.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.637+0000 7fbbce542800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:21.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.637+0000 7fbbce542800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22 2024-09-14T11:03:21.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.642+0000 7fbbce542800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22 info.flags=0x17 2024-09-14T11:03:21.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.642+0000 7fbbce542800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22 to cache LRU end 2024-09-14T11:03:21.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.642+0000 7fbbce542800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:21.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.642+0000 7fbbce542800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22, ofs0, ns] 2024-09-14T11:03:21.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.643+0000 7fbaadffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595170 cookie 94666893330368 notifier 6203 bl.length()=925 2024-09-14T11:03:21.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.643+0000 7fbaadffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22 info.flags=0x17 2024-09-14T11:03:21.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.643+0000 7fbaadffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22 to cache LRU end 2024-09-14T11:03:21.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.643+0000 7fbaadffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:21.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.643+0000 7fbbce542800 20 handle_bi_update(): bucket=:error-at-set-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22]): orig_sources= new_sources= 2024-09-14T11:03:21.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.643+0000 7fbbce542800 20 handle_bi_update(): bucket=:error-at-set-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22]): potential sources added=[] removed=[] 2024-09-14T11:03:21.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.643+0000 7fbbce542800 20 handle_bi_update(): bucket=:error-at-set-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22]): orig_dests= new_dests= 2024-09-14T11:03:21.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.643+0000 7fbbce542800 20 handle_bi_update(): bucket=:error-at-set-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22]): potential dests added=[] removed=[] 2024-09-14T11:03:21.647 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.647+0000 7fbbce542800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22.1.0 2024-09-14T11:03:21.647 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.647+0000 7fbbce542800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22.1.0 2024-09-14T11:03:21.647 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.647+0000 7fbbce542800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22.1.1 2024-09-14T11:03:21.647 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.647+0000 7fbbce542800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22.1.1 2024-09-14T11:03:21.647 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.647+0000 7fbbce542800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22.1.2 2024-09-14T11:03:21.648 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.647+0000 7fbbce542800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22.1.2 2024-09-14T11:03:21.648 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.647+0000 7fbbce542800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22.1.3 2024-09-14T11:03:21.648 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.647+0000 7fbbce542800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22.1.3 2024-09-14T11:03:21.648 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.647+0000 7fbbce542800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22.1.4 2024-09-14T11:03:21.648 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.647+0000 7fbbce542800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22.1.4 2024-09-14T11:03:21.648 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.647+0000 7fbbce542800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22.1.5 2024-09-14T11:03:21.648 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.647+0000 7fbbce542800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22.1.5 2024-09-14T11:03:21.648 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.647+0000 7fbbce542800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22.1.6 2024-09-14T11:03:21.648 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.647+0000 7fbbce542800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22.1.6 2024-09-14T11:03:21.648 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.647+0000 7fbbce542800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22.1.7 2024-09-14T11:03:21.648 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.647+0000 7fbbce542800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22.1.7 2024-09-14T11:03:21.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.647+0000 7fbbce542800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22.1.8 2024-09-14T11:03:21.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.647+0000 7fbbce542800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22.1.8 2024-09-14T11:03:21.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.647+0000 7fbbce542800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22.1.9 2024-09-14T11:03:21.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.647+0000 7fbbce542800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22.1.9 2024-09-14T11:03:21.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.647+0000 7fbbce542800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22.1.10 2024-09-14T11:03:21.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.647+0000 7fbbce542800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22.1.10 2024-09-14T11:03:21.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.647+0000 7fbbce542800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22.1.11 2024-09-14T11:03:21.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.647+0000 7fbbce542800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22.1.11 2024-09-14T11:03:21.650 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.647+0000 7fbbce542800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22.0 2024-09-14T11:03:21.650 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.648+0000 7fbbce542800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22.1 2024-09-14T11:03:21.651 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.648+0000 7fbbce542800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22.2 2024-09-14T11:03:21.651 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.648+0000 7fbbce542800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22.3 2024-09-14T11:03:21.651 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.649+0000 7fbbce542800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22.4 2024-09-14T11:03:21.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.649+0000 7fbbce542800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22.5 2024-09-14T11:03:21.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.650+0000 7fbbce542800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22.6 2024-09-14T11:03:21.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.650+0000 7fbbce542800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22.7 2024-09-14T11:03:21.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.651+0000 7fbbce542800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22.8 2024-09-14T11:03:21.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.652+0000 7fbbce542800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22.9 2024-09-14T11:03:21.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.652+0000 7fbbce542800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22.10 2024-09-14T11:03:21.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.655+0000 7fbbce542800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22 : hit (requested=0x17, cached=0x17) 2024-09-14T11:03:21.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.655+0000 7fbbce542800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22 2024-09-14T11:03:21.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.657+0000 7fbbce542800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22 info.flags=0x17 2024-09-14T11:03:21.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.657+0000 7fbbce542800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22 to cache LRU end 2024-09-14T11:03:21.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.657+0000 7fbbce542800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:21.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.657+0000 7fbbce542800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22, ofs0, ns] 2024-09-14T11:03:21.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.657+0000 7fbaad7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595171 cookie 94666893330368 notifier 6203 bl.length()=925 2024-09-14T11:03:21.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.657+0000 7fbaad7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22 info.flags=0x17 2024-09-14T11:03:21.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.657+0000 7fbaad7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22 to cache LRU end 2024-09-14T11:03:21.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.657+0000 7fbaad7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:21.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.657+0000 7fbbce542800 20 handle_bi_update(): bucket=:error-at-set-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22]): orig_sources= new_sources= 2024-09-14T11:03:21.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.657+0000 7fbbce542800 20 handle_bi_update(): bucket=:error-at-set-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22]): potential sources added=[] removed=[] 2024-09-14T11:03:21.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.657+0000 7fbbce542800 20 handle_bi_update(): bucket=:error-at-set-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22]): orig_dests= new_dests= 2024-09-14T11:03:21.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.657+0000 7fbbce542800 20 handle_bi_update(): bucket=:error-at-set-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22]): potential dests added=[] removed=[] 2024-09-14T11:03:21.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.659+0000 7fbbce542800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22.0 2024-09-14T11:03:21.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.660+0000 7fbbce542800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22.1 2024-09-14T11:03:21.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.660+0000 7fbbce542800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22.2 2024-09-14T11:03:21.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.660+0000 7fbbce542800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22.3 2024-09-14T11:03:21.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.661+0000 7fbbce542800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22.4 2024-09-14T11:03:21.661 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.661+0000 7fbbce542800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22.5 2024-09-14T11:03:21.661 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.661+0000 7fbbce542800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22.6 2024-09-14T11:03:21.661 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.661+0000 7fbbce542800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22.7 2024-09-14T11:03:21.661 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.662+0000 7fbbce542800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22.8 2024-09-14T11:03:21.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.662+0000 7fbbce542800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22.9 2024-09-14T11:03:21.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.662+0000 7fbbce542800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22.10 2024-09-14T11:03:21.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.663+0000 7fbbce542800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22 : hit (requested=0x17, cached=0x17) 2024-09-14T11:03:21.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.663+0000 7fbbce542800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22 2024-09-14T11:03:21.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.664+0000 7fbbce542800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22 info.flags=0x17 2024-09-14T11:03:21.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.664+0000 7fbbce542800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22 to cache LRU end 2024-09-14T11:03:21.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.664+0000 7fbbce542800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:21.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.664+0000 7fbbce542800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22, ofs0, ns] 2024-09-14T11:03:21.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.665+0000 7fbaadffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595172 cookie 94666893330368 notifier 6203 bl.length()=893 2024-09-14T11:03:21.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.665+0000 7fbaadffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22 info.flags=0x17 2024-09-14T11:03:21.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.665+0000 7fbaadffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22 to cache LRU end 2024-09-14T11:03:21.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.665+0000 7fbaadffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:21.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.665+0000 7fbbce542800 20 handle_bi_update(): bucket=:error-at-set-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22]): orig_sources= new_sources= 2024-09-14T11:03:21.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.665+0000 7fbbce542800 20 handle_bi_update(): bucket=:error-at-set-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22]): potential sources added=[] removed=[] 2024-09-14T11:03:21.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.665+0000 7fbbce542800 20 handle_bi_update(): bucket=:error-at-set-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22]): orig_dests= new_dests= 2024-09-14T11:03:21.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.665+0000 7fbbce542800 20 handle_bi_update(): bucket=:error-at-set-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22]): potential dests added=[] removed=[] 2024-09-14T11:03:21.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.667+0000 7fbbce542800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:03:21.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.669+0000 7fba80fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:21.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.671+0000 7fbbce542800 20 remove_watcher() i=0 2024-09-14T11:03:21.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.671+0000 7fbbce542800 2 removed watcher, disabling cache 2024-09-14T11:03:21.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.672+0000 7fbbce542800 20 remove_watcher() i=1 2024-09-14T11:03:21.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.673+0000 7fbbce542800 20 remove_watcher() i=2 2024-09-14T11:03:21.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.673+0000 7fbbce542800 20 remove_watcher() i=3 2024-09-14T11:03:21.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.674+0000 7fbbce542800 20 remove_watcher() i=4 2024-09-14T11:03:21.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.675+0000 7fbbce542800 20 remove_watcher() i=5 2024-09-14T11:03:21.675 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.676+0000 7fbbce542800 20 remove_watcher() i=6 2024-09-14T11:03:21.676 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.677+0000 7fbbce542800 20 remove_watcher() i=7 2024-09-14T11:03:21.688 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:03:21.717 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:03:21.717 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:03:21.755 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.755+0000 7f33b212e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:21.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.757+0000 7f33b212e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:21.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.757+0000 7f33b212e800 20 realm 2024-09-14T11:03:21.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.757+0000 7f33b212e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:21.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.757+0000 7f33b212e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:21.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.757+0000 7f33b212e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:03:21.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.757+0000 7f33b212e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:21.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.758+0000 7f33b212e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:21.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.758+0000 7f33b212e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:21.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.758+0000 7f33b212e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:21.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.758+0000 7f33b212e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:21.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.759+0000 7f33b212e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:03:21.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.759+0000 7f33b212e800 20 searching for the correct realm 2024-09-14T11:03:21.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.761+0000 7f33ae565640 0 -- 172.21.15.97:0/939416457 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f33a408d290 msgr2=0x7f33a40732c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:03:21.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.965+0000 7f33ad563640 0 -- 172.21.15.97:0/939416457 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f33a0077930 msgr2=0x7f33a006a040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:03:21.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.970+0000 7f33b212e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:03:21.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.970+0000 7f33b212e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:03:21.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.970+0000 7f33b212e800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:03:21.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.970+0000 7f33b212e800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:03:21.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.970+0000 7f33b212e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:03:21.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.970+0000 7f33b212e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:03:21.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.970+0000 7f33b212e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:21.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.970+0000 7f33b212e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:21.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.970+0000 7f33b212e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:21.971 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.970+0000 7f33b212e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:21.971 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.970+0000 7f33b212e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:21.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.971+0000 7f33b212e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:03:21.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.971+0000 7f33b212e800 20 zone default found 2024-09-14T11:03:21.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.971+0000 7f33b212e800 4 Realm: () 2024-09-14T11:03:21.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.971+0000 7f33b212e800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:03:21.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.971+0000 7f33b212e800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:03:21.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.971+0000 7f33b212e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:03:21.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.971+0000 7f33b212e800 20 zonegroup default 2024-09-14T11:03:21.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.971+0000 7f33b212e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:21.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.971+0000 7f33b212e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:21.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.971+0000 7f33b212e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:21.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.971+0000 7f33b212e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:21.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.971+0000 7f33b212e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:21.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.972+0000 7f33b212e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:21.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.972+0000 7f33b212e800 20 started sync module instance, tier type = 2024-09-14T11:03:21.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.972+0000 7f33b212e800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:03:21.980 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.980+0000 7f33b212e800 20 add_watcher() i=0 2024-09-14T11:03:21.980 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.980+0000 7f33b212e800 20 add_watcher() i=1 2024-09-14T11:03:21.980 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.980+0000 7f33b212e800 20 add_watcher() i=2 2024-09-14T11:03:21.980 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.980+0000 7f33b212e800 20 add_watcher() i=3 2024-09-14T11:03:21.980 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.980+0000 7f33b212e800 20 add_watcher() i=4 2024-09-14T11:03:21.980 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.980+0000 7f33b212e800 20 add_watcher() i=5 2024-09-14T11:03:21.980 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.980+0000 7f33b212e800 20 add_watcher() i=6 2024-09-14T11:03:21.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.981+0000 7f33b212e800 20 add_watcher() i=7 2024-09-14T11:03:21.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.981+0000 7f33b212e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:03:21.982 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.983+0000 7f325f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:21.983 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.983+0000 7f33b212e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:03:21.983 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.983+0000 7f33b212e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:03:21.983 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.983+0000 7f33b212e800 5 note: GC not initialized 2024-09-14T11:03:21.984 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.984+0000 7f325e7fc640 20 reqs_thread_entry: start 2024-09-14T11:03:21.984 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.984+0000 7f33b212e800 20 init_complete bucket index max shards: 11 2024-09-14T11:03:21.984 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.984+0000 7f33b212e800 20 Filter name: none 2024-09-14T11:03:21.984 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.984+0000 7f31cffff640 20 reqs_thread_entry: start 2024-09-14T11:03:21.984 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.984+0000 7f33b212e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:21.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.984+0000 7f33b212e800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:03:21.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.984+0000 7f33b212e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:21.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.985+0000 7f33b212e800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:03:21.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.985+0000 7f33b212e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:03:21.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.985+0000 7f33b212e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:21.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.985+0000 7f33b212e800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:03:21.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.986+0000 7f33b212e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:21.986 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.986+0000 7f33b212e800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:03:21.986 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.986+0000 7f33b212e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:03:21.987 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.988+0000 7f325f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:21.989 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.990+0000 7f33b212e800 20 remove_watcher() i=0 2024-09-14T11:03:21.989 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.990+0000 7f33b212e800 2 removed watcher, disabling cache 2024-09-14T11:03:21.990 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.991+0000 7f33b212e800 20 remove_watcher() i=1 2024-09-14T11:03:21.991 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.992+0000 7f33b212e800 20 remove_watcher() i=2 2024-09-14T11:03:21.992 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.993+0000 7f33b212e800 20 remove_watcher() i=3 2024-09-14T11:03:21.993 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.993+0000 7f33b212e800 20 remove_watcher() i=4 2024-09-14T11:03:21.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.994+0000 7f33b212e800 20 remove_watcher() i=5 2024-09-14T11:03:21.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.995+0000 7f33b212e800 20 remove_watcher() i=6 2024-09-14T11:03:21.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:21.996+0000 7f33b212e800 20 remove_watcher() i=7 2024-09-14T11:03:22.006 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:22.006 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:03:22.006 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-set-target-layout id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:03:22.006 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:22.085 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-09-14T11:03:22.085 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:22.272 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:03:22.300 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:03:22.300 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:03:22.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.338+0000 7ffadf146800 20 rados->read ofs=0 len=0 2024-09-14T11:03:22.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.340+0000 7ffadf146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:22.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.340+0000 7ffadf146800 20 realm 2024-09-14T11:03:22.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.340+0000 7ffadf146800 20 rados->read ofs=0 len=0 2024-09-14T11:03:22.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.340+0000 7ffadf146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:22.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.340+0000 7ffadf146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:03:22.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.340+0000 7ffadf146800 20 rados->read ofs=0 len=0 2024-09-14T11:03:22.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.340+0000 7ffadf146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:22.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.340+0000 7ffadf146800 20 rados->read ofs=0 len=0 2024-09-14T11:03:22.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.341+0000 7ffadf146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:22.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.341+0000 7ffadf146800 20 rados->read ofs=0 len=0 2024-09-14T11:03:22.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.342+0000 7ffadf146800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:03:22.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.342+0000 7ffadf146800 20 searching for the correct realm 2024-09-14T11:03:22.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.342+0000 7ffadcc37640 0 -- 172.21.15.97:0/4118506446 >> [v2:172.21.15.152:6808/1010851305,v1:172.21.15.152:6809/1010851305] conn(0x560add550630 msgr2=0x560add552af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:03:22.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.345+0000 7ffadcc37640 0 -- 172.21.15.97:0/4118506446 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x560add543e30 msgr2=0x560add5462c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:03:22.352 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.352+0000 7ffadf146800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:03:22.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.352+0000 7ffadf146800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:03:22.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.352+0000 7ffadf146800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:03:22.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.352+0000 7ffadf146800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:03:22.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.352+0000 7ffadf146800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:03:22.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.352+0000 7ffadf146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:03:22.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.352+0000 7ffadf146800 20 rados->read ofs=0 len=0 2024-09-14T11:03:22.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.352+0000 7ffadf146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:22.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.352+0000 7ffadf146800 20 rados->read ofs=0 len=0 2024-09-14T11:03:22.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.352+0000 7ffadf146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:22.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.352+0000 7ffadf146800 20 rados->read ofs=0 len=0 2024-09-14T11:03:22.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.353+0000 7ffadf146800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:03:22.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.353+0000 7ffadf146800 20 zone default found 2024-09-14T11:03:22.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.353+0000 7ffadf146800 4 Realm: () 2024-09-14T11:03:22.354 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.353+0000 7ffadf146800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:03:22.354 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.353+0000 7ffadf146800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:03:22.354 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.353+0000 7ffadf146800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:03:22.354 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.353+0000 7ffadf146800 20 zonegroup default 2024-09-14T11:03:22.354 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.353+0000 7ffadf146800 20 rados->read ofs=0 len=0 2024-09-14T11:03:22.354 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.353+0000 7ffadf146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:22.354 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.353+0000 7ffadf146800 20 rados->read ofs=0 len=0 2024-09-14T11:03:22.354 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.353+0000 7ffadf146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:22.354 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.353+0000 7ffadf146800 20 rados->read ofs=0 len=0 2024-09-14T11:03:22.355 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.353+0000 7ffadf146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:22.355 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.353+0000 7ffadf146800 20 started sync module instance, tier type = 2024-09-14T11:03:22.355 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.353+0000 7ffadf146800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:03:22.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.362+0000 7ffadf146800 20 add_watcher() i=0 2024-09-14T11:03:22.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.362+0000 7ffadf146800 20 add_watcher() i=1 2024-09-14T11:03:22.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.362+0000 7ffadf146800 20 add_watcher() i=2 2024-09-14T11:03:22.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.362+0000 7ffadf146800 20 add_watcher() i=3 2024-09-14T11:03:22.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.362+0000 7ffadf146800 20 add_watcher() i=4 2024-09-14T11:03:22.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.362+0000 7ffadf146800 20 add_watcher() i=5 2024-09-14T11:03:22.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.362+0000 7ffadf146800 20 add_watcher() i=6 2024-09-14T11:03:22.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.363+0000 7ffadf146800 20 add_watcher() i=7 2024-09-14T11:03:22.363 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.363+0000 7ffadf146800 2 all 8 watchers are set, enabling cache 2024-09-14T11:03:22.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.365+0000 7ff992fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:22.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.365+0000 7ffadf146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:03:22.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.365+0000 7ffadf146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:03:22.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.365+0000 7ffadf146800 5 note: GC not initialized 2024-09-14T11:03:22.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.365+0000 7ff991fe3640 20 reqs_thread_entry: start 2024-09-14T11:03:22.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.365+0000 7ffadf146800 20 init_complete bucket index max shards: 11 2024-09-14T11:03:22.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.365+0000 7ffadf146800 20 Filter name: none 2024-09-14T11:03:22.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.365+0000 7ff9037fe640 20 reqs_thread_entry: start 2024-09-14T11:03:22.366 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.366+0000 7ffadf146800 20 rados->read ofs=0 len=0 2024-09-14T11:03:22.366 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.366+0000 7ffadf146800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:03:22.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.366+0000 7ffadf146800 20 rados->read ofs=0 len=0 2024-09-14T11:03:22.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.367+0000 7ffadf146800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:03:22.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.367+0000 7ffadf146800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:03:22.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.367+0000 7ffadf146800 20 rados->read ofs=0 len=0 2024-09-14T11:03:22.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.367+0000 7ffadf146800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:03:22.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.367+0000 7ffadf146800 20 rados->read ofs=0 len=0 2024-09-14T11:03:22.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.368+0000 7ffadf146800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:03:22.367 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.368+0000 7ffadf146800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:03:22.368 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.369+0000 7ff992fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:22.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.371+0000 7ffadf146800 20 remove_watcher() i=0 2024-09-14T11:03:22.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.371+0000 7ffadf146800 2 removed watcher, disabling cache 2024-09-14T11:03:22.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.372+0000 7ffadf146800 20 remove_watcher() i=1 2024-09-14T11:03:22.372 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.373+0000 7ffadf146800 20 remove_watcher() i=2 2024-09-14T11:03:22.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.374+0000 7ffadf146800 20 remove_watcher() i=3 2024-09-14T11:03:22.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.375+0000 7ffadf146800 20 remove_watcher() i=4 2024-09-14T11:03:22.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.376+0000 7ffadf146800 20 remove_watcher() i=5 2024-09-14T11:03:22.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.377+0000 7ffadf146800 20 remove_watcher() i=6 2024-09-14T11:03:22.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.377+0000 7ffadf146800 20 remove_watcher() i=7 2024-09-14T11:03:22.387 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:22.387 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:03:22.387 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-set-target-layout id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:03:22.387 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:22.388 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-09-14T11:03:22.424 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:03:22.424 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:03:22.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.461+0000 7f9fca533800 20 rados->read ofs=0 len=0 2024-09-14T11:03:22.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.463+0000 7f9fca533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:22.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.463+0000 7f9fca533800 20 realm 2024-09-14T11:03:22.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.463+0000 7f9fca533800 20 rados->read ofs=0 len=0 2024-09-14T11:03:22.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.463+0000 7f9fca533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:22.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.463+0000 7f9fca533800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:03:22.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.463+0000 7f9fca533800 20 rados->read ofs=0 len=0 2024-09-14T11:03:22.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.463+0000 7f9fca533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:22.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.463+0000 7f9fca533800 20 rados->read ofs=0 len=0 2024-09-14T11:03:22.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.464+0000 7f9fca533800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:22.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.464+0000 7f9fca533800 20 rados->read ofs=0 len=0 2024-09-14T11:03:22.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.465+0000 7f9fca533800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:03:22.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.465+0000 7f9fca533800 20 searching for the correct realm 2024-09-14T11:03:22.466 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.466+0000 7f9fc699a640 0 -- 172.21.15.97:0/466486799 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f9fb002e060 msgr2=0x7f9fb0065ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:03:22.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.671+0000 7f9fbd998640 0 -- 172.21.15.97:0/466486799 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f9fb8017040 msgr2=0x7f9fb8025420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:03:22.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.675+0000 7f9fca533800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:03:22.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.675+0000 7f9fca533800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:03:22.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.675+0000 7f9fca533800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:03:22.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.675+0000 7f9fca533800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:03:22.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.675+0000 7f9fca533800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:03:22.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.675+0000 7f9fca533800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:03:22.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.675+0000 7f9fca533800 20 rados->read ofs=0 len=0 2024-09-14T11:03:22.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.675+0000 7f9fca533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:22.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.675+0000 7f9fca533800 20 rados->read ofs=0 len=0 2024-09-14T11:03:22.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.676+0000 7f9fca533800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:22.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.676+0000 7f9fca533800 20 rados->read ofs=0 len=0 2024-09-14T11:03:22.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.676+0000 7f9fca533800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:03:22.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.676+0000 7f9fca533800 20 zone default found 2024-09-14T11:03:22.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.676+0000 7f9fca533800 4 Realm: () 2024-09-14T11:03:22.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.676+0000 7f9fca533800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:03:22.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.676+0000 7f9fca533800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:03:22.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.676+0000 7f9fca533800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:03:22.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.676+0000 7f9fca533800 20 zonegroup default 2024-09-14T11:03:22.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.676+0000 7f9fca533800 20 rados->read ofs=0 len=0 2024-09-14T11:03:22.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.676+0000 7f9fca533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:22.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.676+0000 7f9fca533800 20 rados->read ofs=0 len=0 2024-09-14T11:03:22.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.677+0000 7f9fca533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:22.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.677+0000 7f9fca533800 20 rados->read ofs=0 len=0 2024-09-14T11:03:22.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.677+0000 7f9fca533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:22.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.677+0000 7f9fca533800 20 started sync module instance, tier type = 2024-09-14T11:03:22.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.677+0000 7f9fca533800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:03:22.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.687+0000 7f9fca533800 20 add_watcher() i=0 2024-09-14T11:03:22.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.687+0000 7f9fca533800 20 add_watcher() i=1 2024-09-14T11:03:22.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.687+0000 7f9fca533800 20 add_watcher() i=2 2024-09-14T11:03:22.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.687+0000 7f9fca533800 20 add_watcher() i=3 2024-09-14T11:03:22.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.687+0000 7f9fca533800 20 add_watcher() i=4 2024-09-14T11:03:22.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.687+0000 7f9fca533800 20 add_watcher() i=5 2024-09-14T11:03:22.687 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.687+0000 7f9fca533800 20 add_watcher() i=6 2024-09-14T11:03:22.688 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.688+0000 7f9fca533800 20 add_watcher() i=7 2024-09-14T11:03:22.688 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.688+0000 7f9fca533800 2 all 8 watchers are set, enabling cache 2024-09-14T11:03:22.691 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.689+0000 7f9e7cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:22.691 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.689+0000 7f9fca533800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:03:22.692 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.689+0000 7f9fca533800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:03:22.692 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.690+0000 7f9fca533800 5 note: GC not initialized 2024-09-14T11:03:22.692 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.690+0000 7f9df77fe640 20 reqs_thread_entry: start 2024-09-14T11:03:22.692 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.690+0000 7f9fca533800 20 init_complete bucket index max shards: 11 2024-09-14T11:03:22.692 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.690+0000 7f9fca533800 20 Filter name: none 2024-09-14T11:03:22.692 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.690+0000 7f9df57fa640 20 reqs_thread_entry: start 2024-09-14T11:03:22.693 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.690+0000 7f9fca533800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-14T11:03:22.693 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.690+0000 7f9fca533800 20 rados->read ofs=0 len=0 2024-09-14T11:03:22.693 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.691+0000 7f9fca533800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:03:22.693 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.691+0000 7f9fca533800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-14T11:03:22.693 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.691+0000 7f9fca533800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-14T11:03:22.694 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.691+0000 7f9fca533800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23 : miss 2024-09-14T11:03:22.694 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.691+0000 7f9fca533800 20 rados->read ofs=0 len=0 2024-09-14T11:03:22.694 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.691+0000 7f9fca533800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:03:22.694 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.691+0000 7f9fca533800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23 info.flags=0x17 2024-09-14T11:03:22.694 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.691+0000 7f9fca533800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23 to cache LRU end 2024-09-14T11:03:22.694 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.691+0000 7f9fca533800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:03:22.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.691+0000 7f9fca533800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:22.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.691+0000 7f9fca533800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23 2024-09-14T11:03:22.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.694+0000 7f9fca533800 -1 Injecting error=-125 at location=set_target_layout 2024-09-14T11:03:22.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.696+0000 7f9fca533800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23 info.flags=0x17 2024-09-14T11:03:22.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.696+0000 7f9fca533800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23 to cache LRU end 2024-09-14T11:03:22.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.696+0000 7f9fca533800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:22.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.696+0000 7f9fca533800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23, ofs0, ns] 2024-09-14T11:03:22.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.696+0000 7f9ea97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595175 cookie 93859419092000 notifier 6251 bl.length()=925 2024-09-14T11:03:22.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.696+0000 7f9ea97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23 info.flags=0x17 2024-09-14T11:03:22.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.696+0000 7f9ea97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23 to cache LRU end 2024-09-14T11:03:22.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.696+0000 7f9ea97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:22.698 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.696+0000 7f9fca533800 20 handle_bi_update(): bucket=:error-at-set-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23]): orig_sources= new_sources= 2024-09-14T11:03:22.698 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.696+0000 7f9fca533800 20 handle_bi_update(): bucket=:error-at-set-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23]): potential sources added=[] removed=[] 2024-09-14T11:03:22.698 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.696+0000 7f9fca533800 20 handle_bi_update(): bucket=:error-at-set-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23]): orig_dests= new_dests= 2024-09-14T11:03:22.698 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.696+0000 7f9fca533800 20 handle_bi_update(): bucket=:error-at-set-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23]): potential dests added=[] removed=[] 2024-09-14T11:03:22.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.700+0000 7f9fca533800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23.1.0 2024-09-14T11:03:22.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.700+0000 7f9fca533800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23.1.0 2024-09-14T11:03:22.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.700+0000 7f9fca533800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23.1.1 2024-09-14T11:03:22.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.700+0000 7f9fca533800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23.1.1 2024-09-14T11:03:22.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.700+0000 7f9fca533800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23.1.2 2024-09-14T11:03:22.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.700+0000 7f9fca533800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23.1.2 2024-09-14T11:03:22.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.700+0000 7f9fca533800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23.1.3 2024-09-14T11:03:22.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.700+0000 7f9fca533800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23.1.3 2024-09-14T11:03:22.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.700+0000 7f9fca533800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23.1.4 2024-09-14T11:03:22.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.700+0000 7f9fca533800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23.1.4 2024-09-14T11:03:22.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.700+0000 7f9fca533800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23.1.5 2024-09-14T11:03:22.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.700+0000 7f9fca533800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23.1.5 2024-09-14T11:03:22.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.700+0000 7f9fca533800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23.1.6 2024-09-14T11:03:22.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.700+0000 7f9fca533800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23.1.6 2024-09-14T11:03:22.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.700+0000 7f9fca533800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23.1.7 2024-09-14T11:03:22.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.700+0000 7f9fca533800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23.1.7 2024-09-14T11:03:22.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.700+0000 7f9fca533800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23.1.8 2024-09-14T11:03:22.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.700+0000 7f9fca533800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23.1.8 2024-09-14T11:03:22.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.700+0000 7f9fca533800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23.1.9 2024-09-14T11:03:22.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.700+0000 7f9fca533800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23.1.9 2024-09-14T11:03:22.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.700+0000 7f9fca533800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23.1.10 2024-09-14T11:03:22.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.700+0000 7f9fca533800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23.1.10 2024-09-14T11:03:22.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.700+0000 7f9fca533800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23.1.11 2024-09-14T11:03:22.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.700+0000 7f9fca533800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23.1.11 2024-09-14T11:03:22.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.700+0000 7f9fca533800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23.0 2024-09-14T11:03:22.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.701+0000 7f9fca533800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23.1 2024-09-14T11:03:22.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.701+0000 7f9fca533800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23.2 2024-09-14T11:03:22.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.702+0000 7f9fca533800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23.3 2024-09-14T11:03:22.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.702+0000 7f9fca533800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23.4 2024-09-14T11:03:22.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.703+0000 7f9fca533800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23.5 2024-09-14T11:03:22.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.703+0000 7f9fca533800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23.6 2024-09-14T11:03:22.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.704+0000 7f9fca533800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23.7 2024-09-14T11:03:22.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.704+0000 7f9fca533800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23.8 2024-09-14T11:03:22.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.705+0000 7f9fca533800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23.9 2024-09-14T11:03:22.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.705+0000 7f9fca533800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23.10 2024-09-14T11:03:22.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.708+0000 7f9fca533800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23 : hit (requested=0x17, cached=0x17) 2024-09-14T11:03:22.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.708+0000 7f9fca533800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23 2024-09-14T11:03:22.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.709+0000 7f9fca533800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23 info.flags=0x17 2024-09-14T11:03:22.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.709+0000 7f9fca533800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23 to cache LRU end 2024-09-14T11:03:22.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.709+0000 7f9fca533800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:22.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.709+0000 7f9fca533800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23, ofs0, ns] 2024-09-14T11:03:22.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.710+0000 7f9ea9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595176 cookie 93859419092000 notifier 6251 bl.length()=925 2024-09-14T11:03:22.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.710+0000 7f9ea9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23 info.flags=0x17 2024-09-14T11:03:22.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.710+0000 7f9ea9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23 to cache LRU end 2024-09-14T11:03:22.712 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.710+0000 7f9ea9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:22.712 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.710+0000 7f9fca533800 20 handle_bi_update(): bucket=:error-at-set-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23]): orig_sources= new_sources= 2024-09-14T11:03:22.712 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.710+0000 7f9fca533800 20 handle_bi_update(): bucket=:error-at-set-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23]): potential sources added=[] removed=[] 2024-09-14T11:03:22.712 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.710+0000 7f9fca533800 20 handle_bi_update(): bucket=:error-at-set-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23]): orig_dests= new_dests= 2024-09-14T11:03:22.712 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.710+0000 7f9fca533800 20 handle_bi_update(): bucket=:error-at-set-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23]): potential dests added=[] removed=[] 2024-09-14T11:03:22.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.712+0000 7f9fca533800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23.0 2024-09-14T11:03:22.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.712+0000 7f9fca533800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23.1 2024-09-14T11:03:22.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.713+0000 7f9fca533800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23.2 2024-09-14T11:03:22.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.713+0000 7f9fca533800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23.3 2024-09-14T11:03:22.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.714+0000 7f9fca533800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23.4 2024-09-14T11:03:22.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.714+0000 7f9fca533800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23.5 2024-09-14T11:03:22.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.714+0000 7f9fca533800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23.6 2024-09-14T11:03:22.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.715+0000 7f9fca533800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23.7 2024-09-14T11:03:22.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.715+0000 7f9fca533800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23.8 2024-09-14T11:03:22.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.715+0000 7f9fca533800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23.9 2024-09-14T11:03:22.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.716+0000 7f9fca533800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23.10 2024-09-14T11:03:22.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.716+0000 7f9fca533800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23 : hit (requested=0x17, cached=0x17) 2024-09-14T11:03:22.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.716+0000 7f9fca533800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23 2024-09-14T11:03:22.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.717+0000 7f9fca533800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23 info.flags=0x17 2024-09-14T11:03:22.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.717+0000 7f9fca533800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23 to cache LRU end 2024-09-14T11:03:22.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.717+0000 7f9fca533800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:22.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.717+0000 7f9fca533800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23, ofs0, ns] 2024-09-14T11:03:22.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.717+0000 7f9ea9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595177 cookie 93859419092000 notifier 6251 bl.length()=893 2024-09-14T11:03:22.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.717+0000 7f9ea9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23 info.flags=0x17 2024-09-14T11:03:22.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.717+0000 7f9ea9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23 to cache LRU end 2024-09-14T11:03:22.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.717+0000 7f9ea9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:22.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.718+0000 7f9fca533800 20 handle_bi_update(): bucket=:error-at-set-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23]): orig_sources= new_sources= 2024-09-14T11:03:22.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.718+0000 7f9fca533800 20 handle_bi_update(): bucket=:error-at-set-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23]): potential sources added=[] removed=[] 2024-09-14T11:03:22.723 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.718+0000 7f9fca533800 20 handle_bi_update(): bucket=:error-at-set-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23]): orig_dests= new_dests= 2024-09-14T11:03:22.723 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.718+0000 7f9fca533800 20 handle_bi_update(): bucket=:error-at-set-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23]): potential dests added=[] removed=[] 2024-09-14T11:03:22.723 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.720+0000 7f9fca533800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:03:22.724 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.722+0000 7f9e7cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:22.724 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.724+0000 7f9fca533800 20 remove_watcher() i=0 2024-09-14T11:03:22.724 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.724+0000 7f9fca533800 2 removed watcher, disabling cache 2024-09-14T11:03:22.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.725+0000 7f9fca533800 20 remove_watcher() i=1 2024-09-14T11:03:22.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.726+0000 7f9fca533800 20 remove_watcher() i=2 2024-09-14T11:03:22.726 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.726+0000 7f9fca533800 20 remove_watcher() i=3 2024-09-14T11:03:22.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.727+0000 7f9fca533800 20 remove_watcher() i=4 2024-09-14T11:03:22.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.728+0000 7f9fca533800 20 remove_watcher() i=5 2024-09-14T11:03:22.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.729+0000 7f9fca533800 20 remove_watcher() i=6 2024-09-14T11:03:22.730 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.730+0000 7f9fca533800 20 remove_watcher() i=7 2024-09-14T11:03:22.741 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:03:22.770 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:03:22.770 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:03:22.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.807+0000 7f614cbaf800 20 rados->read ofs=0 len=0 2024-09-14T11:03:22.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.809+0000 7f614cbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:22.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.809+0000 7f614cbaf800 20 realm 2024-09-14T11:03:22.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.809+0000 7f614cbaf800 20 rados->read ofs=0 len=0 2024-09-14T11:03:22.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.809+0000 7f614cbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:22.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.809+0000 7f614cbaf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:03:22.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.809+0000 7f614cbaf800 20 rados->read ofs=0 len=0 2024-09-14T11:03:22.810 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.809+0000 7f614cbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:22.810 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.809+0000 7f614cbaf800 20 rados->read ofs=0 len=0 2024-09-14T11:03:22.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.810+0000 7f614cbaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:22.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.810+0000 7f614cbaf800 20 rados->read ofs=0 len=0 2024-09-14T11:03:22.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.810+0000 7f614cbaf800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:03:22.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.810+0000 7f614cbaf800 20 searching for the correct realm 2024-09-14T11:03:22.813 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.813+0000 7f614ae9a640 0 -- 172.21.15.97:0/409226725 >> [v2:172.21.15.152:6824/3767355481,v1:172.21.15.152:6825/3767355481] conn(0x561be0fb0cc0 msgr2=0x561be0fb30b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:03:22.816 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.816+0000 7f6149e98640 0 -- 172.21.15.97:0/409226725 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f613c0153c0 msgr2=0x7f613c015840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:03:22.820 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.820+0000 7f614cbaf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:03:22.820 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.820+0000 7f614cbaf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:03:22.820 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.820+0000 7f614cbaf800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:03:22.820 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.820+0000 7f614cbaf800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:03:22.820 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.820+0000 7f614cbaf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:03:22.820 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.820+0000 7f614cbaf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:03:22.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.820+0000 7f614cbaf800 20 rados->read ofs=0 len=0 2024-09-14T11:03:22.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.820+0000 7f614cbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:22.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.820+0000 7f614cbaf800 20 rados->read ofs=0 len=0 2024-09-14T11:03:22.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.821+0000 7f614cbaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:22.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.821+0000 7f614cbaf800 20 rados->read ofs=0 len=0 2024-09-14T11:03:22.822 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.821+0000 7f614cbaf800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:03:22.822 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.821+0000 7f614cbaf800 20 zone default found 2024-09-14T11:03:22.822 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.821+0000 7f614cbaf800 4 Realm: () 2024-09-14T11:03:22.822 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.821+0000 7f614cbaf800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:03:22.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.821+0000 7f614cbaf800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:03:22.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.821+0000 7f614cbaf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:03:22.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.821+0000 7f614cbaf800 20 zonegroup default 2024-09-14T11:03:22.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.821+0000 7f614cbaf800 20 rados->read ofs=0 len=0 2024-09-14T11:03:22.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.821+0000 7f614cbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:22.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.821+0000 7f614cbaf800 20 rados->read ofs=0 len=0 2024-09-14T11:03:22.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.821+0000 7f614cbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:22.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.822+0000 7f614cbaf800 20 rados->read ofs=0 len=0 2024-09-14T11:03:22.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.822+0000 7f614cbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:22.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.822+0000 7f614cbaf800 20 started sync module instance, tier type = 2024-09-14T11:03:22.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.822+0000 7f614cbaf800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:03:22.829 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.830+0000 7f614cbaf800 20 add_watcher() i=0 2024-09-14T11:03:22.829 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.830+0000 7f614cbaf800 20 add_watcher() i=1 2024-09-14T11:03:22.830 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.830+0000 7f614cbaf800 20 add_watcher() i=2 2024-09-14T11:03:22.830 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.830+0000 7f614cbaf800 20 add_watcher() i=3 2024-09-14T11:03:22.830 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.830+0000 7f614cbaf800 20 add_watcher() i=4 2024-09-14T11:03:22.830 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.830+0000 7f614cbaf800 20 add_watcher() i=5 2024-09-14T11:03:22.830 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.830+0000 7f614cbaf800 20 add_watcher() i=6 2024-09-14T11:03:22.831 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.831+0000 7f614cbaf800 20 add_watcher() i=7 2024-09-14T11:03:22.831 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.831+0000 7f614cbaf800 2 all 8 watchers are set, enabling cache 2024-09-14T11:03:22.833 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.832+0000 7f6000fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:22.833 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.833+0000 7f614cbaf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:03:22.833 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.833+0000 7f614cbaf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:03:22.833 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.833+0000 7f614cbaf800 5 note: GC not initialized 2024-09-14T11:03:22.833 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.833+0000 7f5f7b7fe640 20 reqs_thread_entry: start 2024-09-14T11:03:22.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.833+0000 7f614cbaf800 20 init_complete bucket index max shards: 11 2024-09-14T11:03:22.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.833+0000 7f614cbaf800 20 Filter name: none 2024-09-14T11:03:22.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.833+0000 7f5f797fa640 20 reqs_thread_entry: start 2024-09-14T11:03:22.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.833+0000 7f614cbaf800 20 rados->read ofs=0 len=0 2024-09-14T11:03:22.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.834+0000 7f614cbaf800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:03:22.834 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.834+0000 7f614cbaf800 20 rados->read ofs=0 len=0 2024-09-14T11:03:22.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.834+0000 7f614cbaf800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:03:22.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.834+0000 7f614cbaf800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:03:22.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.834+0000 7f614cbaf800 20 rados->read ofs=0 len=0 2024-09-14T11:03:22.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.835+0000 7f614cbaf800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:03:22.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.835+0000 7f614cbaf800 20 rados->read ofs=0 len=0 2024-09-14T11:03:22.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.835+0000 7f614cbaf800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:03:22.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.835+0000 7f614cbaf800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:03:22.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.836+0000 7f6000fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:22.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.838+0000 7f614cbaf800 20 remove_watcher() i=0 2024-09-14T11:03:22.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.838+0000 7f614cbaf800 2 removed watcher, disabling cache 2024-09-14T11:03:22.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.839+0000 7f614cbaf800 20 remove_watcher() i=1 2024-09-14T11:03:22.840 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.840+0000 7f614cbaf800 20 remove_watcher() i=2 2024-09-14T11:03:22.841 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.841+0000 7f614cbaf800 20 remove_watcher() i=3 2024-09-14T11:03:22.841 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.842+0000 7f614cbaf800 20 remove_watcher() i=4 2024-09-14T11:03:22.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.843+0000 7f614cbaf800 20 remove_watcher() i=5 2024-09-14T11:03:22.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.844+0000 7f614cbaf800 20 remove_watcher() i=6 2024-09-14T11:03:22.844 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:22.845+0000 7f614cbaf800 20 remove_watcher() i=7 2024-09-14T11:03:22.854 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:22.855 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:03:22.855 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-set-target-layout id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:03:22.855 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:22.930 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: reshard bucket with abort at set_target_layout 2024-09-14T11:03:22.930 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:23.125 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-14T11:03:23.153 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:03:23.153 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:03:23.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.190+0000 7fe918faf800 20 rados->read ofs=0 len=0 2024-09-14T11:03:23.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.192+0000 7fe918faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:23.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.192+0000 7fe918faf800 20 realm 2024-09-14T11:03:23.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.192+0000 7fe918faf800 20 rados->read ofs=0 len=0 2024-09-14T11:03:23.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.192+0000 7fe918faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:23.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.192+0000 7fe918faf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:03:23.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.192+0000 7fe918faf800 20 rados->read ofs=0 len=0 2024-09-14T11:03:23.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.193+0000 7fe918faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:23.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.193+0000 7fe918faf800 20 rados->read ofs=0 len=0 2024-09-14T11:03:23.193 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.193+0000 7fe918faf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:23.193 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.193+0000 7fe918faf800 20 rados->read ofs=0 len=0 2024-09-14T11:03:23.193 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.194+0000 7fe918faf800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:03:23.193 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.194+0000 7fe918faf800 20 searching for the correct realm 2024-09-14T11:03:23.195 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.196+0000 7fe91729a640 0 -- 172.21.15.97:0/3576452471 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7fe900044830 msgr2=0x7fe9000a3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:03:23.400 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.400+0000 7fe90e298640 0 -- 172.21.15.97:0/3576452471 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7fe908017070 msgr2=0x7fe908074ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:03:23.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.405+0000 7fe918faf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:03:23.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.405+0000 7fe918faf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:03:23.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.405+0000 7fe918faf800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:03:23.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.405+0000 7fe918faf800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:03:23.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.405+0000 7fe918faf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:03:23.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.405+0000 7fe918faf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:03:23.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.405+0000 7fe918faf800 20 rados->read ofs=0 len=0 2024-09-14T11:03:23.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.405+0000 7fe918faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:23.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.405+0000 7fe918faf800 20 rados->read ofs=0 len=0 2024-09-14T11:03:23.406 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.406+0000 7fe918faf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:23.406 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.406+0000 7fe918faf800 20 rados->read ofs=0 len=0 2024-09-14T11:03:23.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.406+0000 7fe918faf800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:03:23.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.406+0000 7fe918faf800 20 zone default found 2024-09-14T11:03:23.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.406+0000 7fe918faf800 4 Realm: () 2024-09-14T11:03:23.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.406+0000 7fe918faf800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:03:23.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.406+0000 7fe918faf800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:03:23.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.406+0000 7fe918faf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:03:23.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.406+0000 7fe918faf800 20 zonegroup default 2024-09-14T11:03:23.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.406+0000 7fe918faf800 20 rados->read ofs=0 len=0 2024-09-14T11:03:23.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.406+0000 7fe918faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:23.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.406+0000 7fe918faf800 20 rados->read ofs=0 len=0 2024-09-14T11:03:23.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.407+0000 7fe918faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:23.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.407+0000 7fe918faf800 20 rados->read ofs=0 len=0 2024-09-14T11:03:23.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.407+0000 7fe918faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:23.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.407+0000 7fe918faf800 20 started sync module instance, tier type = 2024-09-14T11:03:23.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.407+0000 7fe918faf800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:03:23.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.415+0000 7fe918faf800 20 add_watcher() i=0 2024-09-14T11:03:23.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.415+0000 7fe918faf800 20 add_watcher() i=1 2024-09-14T11:03:23.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.415+0000 7fe918faf800 20 add_watcher() i=2 2024-09-14T11:03:23.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.415+0000 7fe918faf800 20 add_watcher() i=3 2024-09-14T11:03:23.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.415+0000 7fe918faf800 20 add_watcher() i=4 2024-09-14T11:03:23.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.415+0000 7fe918faf800 20 add_watcher() i=5 2024-09-14T11:03:23.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.415+0000 7fe918faf800 20 add_watcher() i=6 2024-09-14T11:03:23.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.416+0000 7fe918faf800 20 add_watcher() i=7 2024-09-14T11:03:23.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.416+0000 7fe918faf800 2 all 8 watchers are set, enabling cache 2024-09-14T11:03:23.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.418+0000 7fe7cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:23.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.419+0000 7fe918faf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:03:23.419 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.419+0000 7fe918faf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:03:23.419 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.419+0000 7fe918faf800 5 note: GC not initialized 2024-09-14T11:03:23.419 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.419+0000 7fe747fff640 20 reqs_thread_entry: start 2024-09-14T11:03:23.419 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.419+0000 7fe918faf800 20 init_complete bucket index max shards: 11 2024-09-14T11:03:23.419 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.419+0000 7fe918faf800 20 Filter name: none 2024-09-14T11:03:23.419 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.419+0000 7fe745ffb640 20 reqs_thread_entry: start 2024-09-14T11:03:23.419 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.419+0000 7fe918faf800 20 rados->read ofs=0 len=0 2024-09-14T11:03:23.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.420+0000 7fe918faf800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:03:23.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.420+0000 7fe918faf800 20 rados->read ofs=0 len=0 2024-09-14T11:03:23.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.420+0000 7fe918faf800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:03:23.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.420+0000 7fe918faf800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:03:23.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.420+0000 7fe918faf800 20 rados->read ofs=0 len=0 2024-09-14T11:03:23.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.421+0000 7fe918faf800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:03:23.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.421+0000 7fe918faf800 20 rados->read ofs=0 len=0 2024-09-14T11:03:23.421 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.421+0000 7fe918faf800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:03:23.421 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.421+0000 7fe918faf800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:03:23.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.422+0000 7fe7cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:23.424 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.425+0000 7fe918faf800 20 remove_watcher() i=0 2024-09-14T11:03:23.424 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.425+0000 7fe918faf800 2 removed watcher, disabling cache 2024-09-14T11:03:23.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.426+0000 7fe918faf800 20 remove_watcher() i=1 2024-09-14T11:03:23.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.427+0000 7fe918faf800 20 remove_watcher() i=2 2024-09-14T11:03:23.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.428+0000 7fe918faf800 20 remove_watcher() i=3 2024-09-14T11:03:23.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.429+0000 7fe918faf800 20 remove_watcher() i=4 2024-09-14T11:03:23.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.430+0000 7fe918faf800 20 remove_watcher() i=5 2024-09-14T11:03:23.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.430+0000 7fe918faf800 20 remove_watcher() i=6 2024-09-14T11:03:23.431 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.431+0000 7fe918faf800 20 remove_watcher() i=7 2024-09-14T11:03:23.441 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:23.441 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:03:23.441 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: abort-at-set-target-layout id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:03:23.441 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:23.442 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-09-14T11:03:23.476 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:03:23.476 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:03:23.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.514+0000 7f62a3f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:23.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.516+0000 7f62a3f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:23.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.516+0000 7f62a3f2e800 20 realm 2024-09-14T11:03:23.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.516+0000 7f62a3f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:23.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.516+0000 7f62a3f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:23.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.516+0000 7f62a3f2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:03:23.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.516+0000 7f62a3f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:23.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.516+0000 7f62a3f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:23.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.516+0000 7f62a3f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:23.517 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.517+0000 7f62a3f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:23.517 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.517+0000 7f62a3f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:23.517 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.518+0000 7f62a3f2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:03:23.517 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.518+0000 7f62a3f2e800 20 searching for the correct realm 2024-09-14T11:03:23.518 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.519+0000 7f629f4dc640 0 -- 172.21.15.97:0/4101729106 >> [v2:172.21.15.97:6808/2081705332,v1:172.21.15.97:6809/2081705332] conn(0x7f629002b040 msgr2=0x7f629001c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:03:23.723 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.724+0000 7f629fcdd640 0 -- 172.21.15.97:0/4101729106 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7f6294027400 msgr2=0x7f6294068aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:03:23.930 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.931+0000 7f62a3f2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:03:23.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.931+0000 7f62a3f2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:03:23.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.931+0000 7f62a3f2e800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:03:23.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.931+0000 7f62a3f2e800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:03:23.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.931+0000 7f62a3f2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:03:23.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.931+0000 7f62a3f2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:03:23.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.931+0000 7f62a3f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:23.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.931+0000 7f62a3f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:23.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.931+0000 7f62a3f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:23.932 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.931+0000 7f62a3f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:23.932 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.931+0000 7f62a3f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:23.933 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.932+0000 7f62a3f2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:03:23.933 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.932+0000 7f62a3f2e800 20 zone default found 2024-09-14T11:03:23.933 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.932+0000 7f62a3f2e800 4 Realm: () 2024-09-14T11:03:23.933 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.932+0000 7f62a3f2e800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:03:23.933 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.932+0000 7f62a3f2e800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:03:23.933 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.932+0000 7f62a3f2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:03:23.933 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.932+0000 7f62a3f2e800 20 zonegroup default 2024-09-14T11:03:23.933 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.932+0000 7f62a3f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:23.933 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.932+0000 7f62a3f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:23.933 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.932+0000 7f62a3f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:23.933 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.932+0000 7f62a3f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:23.933 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.932+0000 7f62a3f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:23.933 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.932+0000 7f62a3f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:23.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.932+0000 7f62a3f2e800 20 started sync module instance, tier type = 2024-09-14T11:03:23.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.932+0000 7f62a3f2e800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:03:23.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.941+0000 7f62a3f2e800 20 add_watcher() i=0 2024-09-14T11:03:23.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.941+0000 7f62a3f2e800 20 add_watcher() i=1 2024-09-14T11:03:23.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.941+0000 7f62a3f2e800 20 add_watcher() i=2 2024-09-14T11:03:23.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.941+0000 7f62a3f2e800 20 add_watcher() i=3 2024-09-14T11:03:23.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.941+0000 7f62a3f2e800 20 add_watcher() i=4 2024-09-14T11:03:23.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.941+0000 7f62a3f2e800 20 add_watcher() i=5 2024-09-14T11:03:23.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.941+0000 7f62a3f2e800 20 add_watcher() i=6 2024-09-14T11:03:23.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.942+0000 7f62a3f2e800 20 add_watcher() i=7 2024-09-14T11:03:23.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.942+0000 7f62a3f2e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:03:23.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.943+0000 7f61567e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:23.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.944+0000 7f62a3f2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:03:23.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.944+0000 7f62a3f2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:03:23.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.944+0000 7f62a3f2e800 5 note: GC not initialized 2024-09-14T11:03:23.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.944+0000 7f61557e2640 20 reqs_thread_entry: start 2024-09-14T11:03:23.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.944+0000 7f62a3f2e800 20 init_complete bucket index max shards: 11 2024-09-14T11:03:23.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.944+0000 7f62a3f2e800 20 Filter name: none 2024-09-14T11:03:23.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.944+0000 7f614e7fc640 20 reqs_thread_entry: start 2024-09-14T11:03:23.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.944+0000 7f62a3f2e800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:03:23.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.944+0000 7f62a3f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:23.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.944+0000 7f62a3f2e800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:03:23.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.944+0000 7f62a3f2e800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:03:23.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.944+0000 7f62a3f2e800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:03:23.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.944+0000 7f62a3f2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24 : miss 2024-09-14T11:03:23.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.944+0000 7f62a3f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:23.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.945+0000 7f62a3f2e800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:03:23.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.945+0000 7f62a3f2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24 info.flags=0x17 2024-09-14T11:03:23.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.945+0000 7f62a3f2e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24 to cache LRU end 2024-09-14T11:03:23.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.945+0000 7f62a3f2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:03:23.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.945+0000 7f62a3f2e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:23.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.945+0000 7f62a3f2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24 2024-09-14T11:03:23.949 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f62a3f2e800 time 2024-09-14T11:03:23.951128+0000 2024-09-14T11:03:23.949 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:03:23.968 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:03:23.968 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f62a578c76a] 2024-09-14T11:03:23.968 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f62a578c928] 2024-09-14T11:03:23.969 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561cb47320b1] 2024-09-14T11:03:23.969 INFO:tasks.workunit.client.0.smithi097.stderr: 4: radosgw-admin(+0xd88418) [0x561cb4c45418] 2024-09-14T11:03:23.969 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561cb4741efd] 2024-09-14T11:03:23.969 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-14T11:03:23.969 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f62a4429590] 2024-09-14T11:03:23.969 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-14T11:03:23.969 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-14T11:03:23.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.950+0000 7f62a3f2e800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f62a3f2e800 time 2024-09-14T11:03:23.951128+0000 2024-09-14T11:03:23.969 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:03:23.969 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:23.969 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:03:23.969 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f62a578c76a] 2024-09-14T11:03:23.970 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f62a578c928] 2024-09-14T11:03:23.970 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561cb47320b1] 2024-09-14T11:03:23.970 INFO:tasks.workunit.client.0.smithi097.stderr: 4: radosgw-admin(+0xd88418) [0x561cb4c45418] 2024-09-14T11:03:23.970 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561cb4741efd] 2024-09-14T11:03:23.970 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-14T11:03:23.970 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f62a4429590] 2024-09-14T11:03:23.970 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-14T11:03:23.970 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-14T11:03:23.970 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:23.970 INFO:tasks.workunit.client.0.smithi097.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:03:23.970 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f62a3f2e800 thread_name:radosgw-admin 2024-09-14T11:03:23.970 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:03:23.970 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f62a443e6f0] 2024-09-14T11:03:23.971 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f62a448b99c] 2024-09-14T11:03:23.971 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-14T11:03:23.971 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-14T11:03:23.971 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f62a578c7c4] 2024-09-14T11:03:23.971 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f62a578c928] 2024-09-14T11:03:23.971 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561cb47320b1] 2024-09-14T11:03:23.971 INFO:tasks.workunit.client.0.smithi097.stderr: 8: radosgw-admin(+0xd88418) [0x561cb4c45418] 2024-09-14T11:03:23.971 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561cb4741efd] 2024-09-14T11:03:23.971 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-14T11:03:23.971 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f62a4429590] 2024-09-14T11:03:23.971 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-14T11:03:23.971 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-14T11:03:23.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:23.950+0000 7f62a3f2e800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:03:23.972 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f62a3f2e800 thread_name:radosgw-admin 2024-09-14T11:03:23.972 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:23.972 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:03:23.972 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f62a443e6f0] 2024-09-14T11:03:23.972 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f62a448b99c] 2024-09-14T11:03:23.972 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-14T11:03:23.972 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-14T11:03:23.972 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f62a578c7c4] 2024-09-14T11:03:23.972 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f62a578c928] 2024-09-14T11:03:23.972 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561cb47320b1] 2024-09-14T11:03:23.972 INFO:tasks.workunit.client.0.smithi097.stderr: 8: radosgw-admin(+0xd88418) [0x561cb4c45418] 2024-09-14T11:03:23.972 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561cb4741efd] 2024-09-14T11:03:23.972 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-14T11:03:23.973 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f62a4429590] 2024-09-14T11:03:23.973 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-14T11:03:23.973 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-14T11:03:23.973 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:03:23.973 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:23.973 INFO:tasks.workunit.client.0.smithi097.stderr:--- begin dump of recent events --- 2024-09-14T11:03:23.973 INFO:tasks.workunit.client.0.smithi097.stderr: -499> 2024-09-14T11:03:23.496+0000 7f629fcdd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:03:23.973 INFO:tasks.workunit.client.0.smithi097.stderr: -498> 2024-09-14T11:03:23.496+0000 7f629f4dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:03:23.973 INFO:tasks.workunit.client.0.smithi097.stderr: -497> 2024-09-14T11:03:23.496+0000 7f629f4dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:03:23.973 INFO:tasks.workunit.client.0.smithi097.stderr: -496> 2024-09-14T11:03:23.496+0000 7f629f4dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:03:23.973 INFO:tasks.workunit.client.0.smithi097.stderr: -495> 2024-09-14T11:03:23.497+0000 7f62a04de640 10 monclient(hunting): get_auth_request con 0x561cb7025140 auth_method 0 2024-09-14T11:03:23.973 INFO:tasks.workunit.client.0.smithi097.stderr: -494> 2024-09-14T11:03:23.497+0000 7f62a04de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:03:23.973 INFO:tasks.workunit.client.0.smithi097.stderr: -493> 2024-09-14T11:03:23.497+0000 7f62a04de640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:03:23.974 INFO:tasks.workunit.client.0.smithi097.stderr: -492> 2024-09-14T11:03:23.497+0000 7f62a04de640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:03:23.974 INFO:tasks.workunit.client.0.smithi097.stderr: -491> 2024-09-14T11:03:23.497+0000 7f62a04de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:03:23.974 INFO:tasks.workunit.client.0.smithi097.stderr: -490> 2024-09-14T11:03:23.497+0000 7f62a04de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:03:23.974 INFO:tasks.workunit.client.0.smithi097.stderr: -489> 2024-09-14T11:03:23.497+0000 7f62a04de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:03:23.974 INFO:tasks.workunit.client.0.smithi097.stderr: -488> 2024-09-14T11:03:23.497+0000 7f629f4dc640 10 monclient(hunting): handle_auth_done global_id 6630 payload 274 2024-09-14T11:03:23.974 INFO:tasks.workunit.client.0.smithi097.stderr: -487> 2024-09-14T11:03:23.497+0000 7f629f4dc640 10 monclient: _finish_hunting 0 2024-09-14T11:03:23.974 INFO:tasks.workunit.client.0.smithi097.stderr: -486> 2024-09-14T11:03:23.497+0000 7f629f4dc640 1 monclient: found mon.noname-a 2024-09-14T11:03:23.974 INFO:tasks.workunit.client.0.smithi097.stderr: -485> 2024-09-14T11:03:23.497+0000 7f629f4dc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-14T11:03:23.974 INFO:tasks.workunit.client.0.smithi097.stderr: -484> 2024-09-14T11:03:23.497+0000 7f618de0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:03:23.974 INFO:tasks.workunit.client.0.smithi097.stderr: -483> 2024-09-14T11:03:23.497+0000 7f618de0b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:03:23.974 INFO:tasks.workunit.client.0.smithi097.stderr: -482> 2024-09-14T11:03:23.497+0000 7f618de0b640 10 monclient: dump: 2024-09-14T11:03:23.974 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:03:23.974 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:03:23.975 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:23.975 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:23.975 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:03:23.975 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:03:23.975 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:03:23.975 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:03:23.975 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:03:23.975 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:23.975 INFO:tasks.workunit.client.0.smithi097.stderr: -481> 2024-09-14T11:03:23.497+0000 7f618de0b640 10 monclient: _finish_auth 0 2024-09-14T11:03:23.975 INFO:tasks.workunit.client.0.smithi097.stderr: -480> 2024-09-14T11:03:23.497+0000 7f618de0b640 10 monclient: _check_auth_tickets 2024-09-14T11:03:23.975 INFO:tasks.workunit.client.0.smithi097.stderr: -479> 2024-09-14T11:03:23.497+0000 7f618de0b640 10 monclient: handle_config config(0 keys) 2024-09-14T11:03:23.975 INFO:tasks.workunit.client.0.smithi097.stderr: -478> 2024-09-14T11:03:23.497+0000 7f618de0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:03:23.975 INFO:tasks.workunit.client.0.smithi097.stderr: -477> 2024-09-14T11:03:23.497+0000 7f618de0b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:03:23.975 INFO:tasks.workunit.client.0.smithi097.stderr: -476> 2024-09-14T11:03:23.497+0000 7f618de0b640 10 monclient: dump: 2024-09-14T11:03:23.976 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:03:23.976 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:03:23.976 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:23.976 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:23.976 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:03:23.976 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:03:23.976 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:03:23.976 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:03:23.976 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:03:23.976 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:23.976 INFO:tasks.workunit.client.0.smithi097.stderr: -475> 2024-09-14T11:03:23.497+0000 7f62a3f2e800 5 monclient: authenticate success, global_id 6630 2024-09-14T11:03:23.976 INFO:tasks.workunit.client.0.smithi097.stderr: -474> 2024-09-14T11:03:23.497+0000 7f62a3f2e800 10 monclient: get_monmap_and_config success 2024-09-14T11:03:23.976 INFO:tasks.workunit.client.0.smithi097.stderr: -473> 2024-09-14T11:03:23.497+0000 7f62a3f2e800 4 set_mon_vals no callback set 2024-09-14T11:03:23.977 INFO:tasks.workunit.client.0.smithi097.stderr: -472> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 10 monclient: shutdown 2024-09-14T11:03:23.977 INFO:tasks.workunit.client.0.smithi097.stderr: -471> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 asok(0x561cb6ddc270) unregister_commands rotate-key 2024-09-14T11:03:23.977 INFO:tasks.workunit.client.0.smithi097.stderr: -470> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 10 monclient: build_initial_monmap 2024-09-14T11:03:23.977 INFO:tasks.workunit.client.0.smithi097.stderr: -469> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 1 build_initial for_mkfs: 0 2024-09-14T11:03:23.977 INFO:tasks.workunit.client.0.smithi097.stderr: -468> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 10 monclient: monmap: 2024-09-14T11:03:23.977 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:03:23.977 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:03:23.977 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:03:23.977 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:03:23.978 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:03:23.978 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:03:23.978 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:03:23.978 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:03:23.978 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:03:23.978 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:23.978 INFO:tasks.workunit.client.0.smithi097.stderr: -467> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70010c0) adding auth protocol: cephx 2024-09-14T11:03:23.978 INFO:tasks.workunit.client.0.smithi097.stderr: -466> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70010c0) adding auth protocol: cephx 2024-09-14T11:03:23.978 INFO:tasks.workunit.client.0.smithi097.stderr: -465> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70010c0) adding auth protocol: cephx 2024-09-14T11:03:23.978 INFO:tasks.workunit.client.0.smithi097.stderr: -464> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70010c0) adding con mode: secure 2024-09-14T11:03:23.978 INFO:tasks.workunit.client.0.smithi097.stderr: -463> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70010c0) adding con mode: crc 2024-09-14T11:03:23.978 INFO:tasks.workunit.client.0.smithi097.stderr: -462> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70010c0) adding con mode: secure 2024-09-14T11:03:23.978 INFO:tasks.workunit.client.0.smithi097.stderr: -461> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70010c0) adding con mode: crc 2024-09-14T11:03:23.978 INFO:tasks.workunit.client.0.smithi097.stderr: -460> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70010c0) adding con mode: secure 2024-09-14T11:03:23.979 INFO:tasks.workunit.client.0.smithi097.stderr: -459> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70010c0) adding con mode: crc 2024-09-14T11:03:23.979 INFO:tasks.workunit.client.0.smithi097.stderr: -458> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70010c0) adding con mode: crc 2024-09-14T11:03:23.979 INFO:tasks.workunit.client.0.smithi097.stderr: -457> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70010c0) adding con mode: secure 2024-09-14T11:03:23.979 INFO:tasks.workunit.client.0.smithi097.stderr: -456> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70010c0) adding con mode: crc 2024-09-14T11:03:23.979 INFO:tasks.workunit.client.0.smithi097.stderr: -455> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70010c0) adding con mode: secure 2024-09-14T11:03:23.979 INFO:tasks.workunit.client.0.smithi097.stderr: -454> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70010c0) adding con mode: crc 2024-09-14T11:03:23.979 INFO:tasks.workunit.client.0.smithi097.stderr: -453> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70010c0) adding con mode: secure 2024-09-14T11:03:23.979 INFO:tasks.workunit.client.0.smithi097.stderr: -452> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:23.979 INFO:tasks.workunit.client.0.smithi097.stderr: -451> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 1 librados: starting msgr at 2024-09-14T11:03:23.979 INFO:tasks.workunit.client.0.smithi097.stderr: -450> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 1 librados: starting objecter 2024-09-14T11:03:23.979 INFO:tasks.workunit.client.0.smithi097.stderr: -449> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 asok(0x561cb6ddc270) register_command objecter_requests hook 0x561cb6ffcec0 2024-09-14T11:03:23.979 INFO:tasks.workunit.client.0.smithi097.stderr: -448> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 1 librados: setting wanted keys 2024-09-14T11:03:23.979 INFO:tasks.workunit.client.0.smithi097.stderr: -447> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 1 librados: calling monclient init 2024-09-14T11:03:23.980 INFO:tasks.workunit.client.0.smithi097.stderr: -446> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 10 monclient: init 2024-09-14T11:03:23.980 INFO:tasks.workunit.client.0.smithi097.stderr: -445> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb6ffb3b0) adding auth protocol: cephx 2024-09-14T11:03:23.980 INFO:tasks.workunit.client.0.smithi097.stderr: -444> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb6ffb3b0) adding auth protocol: cephx 2024-09-14T11:03:23.980 INFO:tasks.workunit.client.0.smithi097.stderr: -443> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb6ffb3b0) adding auth protocol: cephx 2024-09-14T11:03:23.980 INFO:tasks.workunit.client.0.smithi097.stderr: -442> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb6ffb3b0) adding con mode: secure 2024-09-14T11:03:23.980 INFO:tasks.workunit.client.0.smithi097.stderr: -441> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb6ffb3b0) adding con mode: crc 2024-09-14T11:03:23.980 INFO:tasks.workunit.client.0.smithi097.stderr: -440> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb6ffb3b0) adding con mode: secure 2024-09-14T11:03:23.980 INFO:tasks.workunit.client.0.smithi097.stderr: -439> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb6ffb3b0) adding con mode: crc 2024-09-14T11:03:23.980 INFO:tasks.workunit.client.0.smithi097.stderr: -438> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb6ffb3b0) adding con mode: secure 2024-09-14T11:03:23.980 INFO:tasks.workunit.client.0.smithi097.stderr: -437> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb6ffb3b0) adding con mode: crc 2024-09-14T11:03:23.980 INFO:tasks.workunit.client.0.smithi097.stderr: -436> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb6ffb3b0) adding con mode: crc 2024-09-14T11:03:23.980 INFO:tasks.workunit.client.0.smithi097.stderr: -435> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb6ffb3b0) adding con mode: secure 2024-09-14T11:03:23.980 INFO:tasks.workunit.client.0.smithi097.stderr: -434> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb6ffb3b0) adding con mode: crc 2024-09-14T11:03:23.981 INFO:tasks.workunit.client.0.smithi097.stderr: -433> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb6ffb3b0) adding con mode: secure 2024-09-14T11:03:23.981 INFO:tasks.workunit.client.0.smithi097.stderr: -432> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb6ffb3b0) adding con mode: crc 2024-09-14T11:03:23.981 INFO:tasks.workunit.client.0.smithi097.stderr: -431> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb6ffb3b0) adding con mode: secure 2024-09-14T11:03:23.981 INFO:tasks.workunit.client.0.smithi097.stderr: -430> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:23.981 INFO:tasks.workunit.client.0.smithi097.stderr: -429> 2024-09-14T11:03:23.499+0000 7f62a3f2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:23.981 INFO:tasks.workunit.client.0.smithi097.stderr: -428> 2024-09-14T11:03:23.499+0000 7f62a3f2e800 5 asok(0x561cb6ddc270) register_command rotate-key hook 0x561cb6ffb4f8 2024-09-14T11:03:23.981 INFO:tasks.workunit.client.0.smithi097.stderr: -427> 2024-09-14T11:03:23.499+0000 7f62a3f2e800 10 monclient: _reopen_session rank -1 2024-09-14T11:03:23.981 INFO:tasks.workunit.client.0.smithi097.stderr: -426> 2024-09-14T11:03:23.499+0000 7f62a3f2e800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:03:23.981 INFO:tasks.workunit.client.0.smithi097.stderr: -425> 2024-09-14T11:03:23.499+0000 7f62a3f2e800 10 monclient(hunting): picked mon.noname-b con 0x561cb7002400 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:03:23.981 INFO:tasks.workunit.client.0.smithi097.stderr: -424> 2024-09-14T11:03:23.499+0000 7f62a3f2e800 10 monclient(hunting): picked mon.noname-c con 0x561cb7025140 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:03:23.981 INFO:tasks.workunit.client.0.smithi097.stderr: -423> 2024-09-14T11:03:23.499+0000 7f62a3f2e800 10 monclient(hunting): picked mon.noname-a con 0x7f6288003c90 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:03:23.981 INFO:tasks.workunit.client.0.smithi097.stderr: -422> 2024-09-14T11:03:23.499+0000 7f62a3f2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:03:23.981 INFO:tasks.workunit.client.0.smithi097.stderr: -421> 2024-09-14T11:03:23.499+0000 7f62a3f2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:03:23.981 INFO:tasks.workunit.client.0.smithi097.stderr: -420> 2024-09-14T11:03:23.499+0000 7f62a3f2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:03:23.982 INFO:tasks.workunit.client.0.smithi097.stderr: -419> 2024-09-14T11:03:23.499+0000 7f62a3f2e800 10 monclient(hunting): _renew_subs 2024-09-14T11:03:23.982 INFO:tasks.workunit.client.0.smithi097.stderr: -418> 2024-09-14T11:03:23.499+0000 7f62a3f2e800 10 monclient(hunting): authenticate will time out at 1885.153185s 2024-09-14T11:03:23.982 INFO:tasks.workunit.client.0.smithi097.stderr: -417> 2024-09-14T11:03:23.499+0000 7f629f4dc640 10 monclient(hunting): get_auth_request con 0x561cb7025140 auth_method 0 2024-09-14T11:03:23.982 INFO:tasks.workunit.client.0.smithi097.stderr: -416> 2024-09-14T11:03:23.499+0000 7f629f4dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:03:23.982 INFO:tasks.workunit.client.0.smithi097.stderr: -415> 2024-09-14T11:03:23.499+0000 7f629f4dc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:03:23.982 INFO:tasks.workunit.client.0.smithi097.stderr: -414> 2024-09-14T11:03:23.499+0000 7f629f4dc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:03:23.982 INFO:tasks.workunit.client.0.smithi097.stderr: -413> 2024-09-14T11:03:23.499+0000 7f62a04de640 10 monclient(hunting): get_auth_request con 0x7f6288003c90 auth_method 0 2024-09-14T11:03:23.982 INFO:tasks.workunit.client.0.smithi097.stderr: -412> 2024-09-14T11:03:23.499+0000 7f62a04de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:03:23.982 INFO:tasks.workunit.client.0.smithi097.stderr: -411> 2024-09-14T11:03:23.499+0000 7f62a04de640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:03:23.982 INFO:tasks.workunit.client.0.smithi097.stderr: -410> 2024-09-14T11:03:23.499+0000 7f62a04de640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:03:23.982 INFO:tasks.workunit.client.0.smithi097.stderr: -409> 2024-09-14T11:03:23.499+0000 7f629f4dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:03:23.982 INFO:tasks.workunit.client.0.smithi097.stderr: -408> 2024-09-14T11:03:23.499+0000 7f629f4dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:03:23.982 INFO:tasks.workunit.client.0.smithi097.stderr: -407> 2024-09-14T11:03:23.499+0000 7f629f4dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:03:23.983 INFO:tasks.workunit.client.0.smithi097.stderr: -406> 2024-09-14T11:03:23.499+0000 7f62a04de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:03:23.983 INFO:tasks.workunit.client.0.smithi097.stderr: -405> 2024-09-14T11:03:23.499+0000 7f62a04de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:03:23.983 INFO:tasks.workunit.client.0.smithi097.stderr: -404> 2024-09-14T11:03:23.499+0000 7f62a04de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:03:23.983 INFO:tasks.workunit.client.0.smithi097.stderr: -403> 2024-09-14T11:03:23.499+0000 7f629fcdd640 10 monclient(hunting): get_auth_request con 0x561cb7002400 auth_method 0 2024-09-14T11:03:23.983 INFO:tasks.workunit.client.0.smithi097.stderr: -402> 2024-09-14T11:03:23.499+0000 7f629fcdd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:03:23.983 INFO:tasks.workunit.client.0.smithi097.stderr: -401> 2024-09-14T11:03:23.499+0000 7f629fcdd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:03:23.983 INFO:tasks.workunit.client.0.smithi097.stderr: -400> 2024-09-14T11:03:23.499+0000 7f629fcdd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:03:23.983 INFO:tasks.workunit.client.0.smithi097.stderr: -399> 2024-09-14T11:03:23.499+0000 7f629fcdd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:03:23.983 INFO:tasks.workunit.client.0.smithi097.stderr: -398> 2024-09-14T11:03:23.499+0000 7f629fcdd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:03:23.983 INFO:tasks.workunit.client.0.smithi097.stderr: -397> 2024-09-14T11:03:23.499+0000 7f629fcdd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:03:23.983 INFO:tasks.workunit.client.0.smithi097.stderr: -396> 2024-09-14T11:03:23.499+0000 7f629f4dc640 10 monclient(hunting): handle_auth_done global_id 6290 payload 824 2024-09-14T11:03:23.983 INFO:tasks.workunit.client.0.smithi097.stderr: -395> 2024-09-14T11:03:23.499+0000 7f629f4dc640 10 monclient: _finish_hunting 0 2024-09-14T11:03:23.983 INFO:tasks.workunit.client.0.smithi097.stderr: -394> 2024-09-14T11:03:23.499+0000 7f629f4dc640 1 monclient: found mon.noname-c 2024-09-14T11:03:23.984 INFO:tasks.workunit.client.0.smithi097.stderr: -393> 2024-09-14T11:03:23.499+0000 7f629f4dc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:03:23.984 INFO:tasks.workunit.client.0.smithi097.stderr: -392> 2024-09-14T11:03:23.499+0000 7f6187fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:03:23.984 INFO:tasks.workunit.client.0.smithi097.stderr: -391> 2024-09-14T11:03:23.499+0000 7f6187fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:03:23.984 INFO:tasks.workunit.client.0.smithi097.stderr: -390> 2024-09-14T11:03:23.499+0000 7f6187fff640 10 monclient: dump: 2024-09-14T11:03:23.984 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:03:23.984 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:03:23.984 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:23.984 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:23.984 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:03:23.984 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:03:23.984 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:03:23.984 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:03:23.984 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:03:23.985 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:23.985 INFO:tasks.workunit.client.0.smithi097.stderr: -389> 2024-09-14T11:03:23.499+0000 7f6187fff640 10 monclient: _finish_auth 0 2024-09-14T11:03:23.985 INFO:tasks.workunit.client.0.smithi097.stderr: -388> 2024-09-14T11:03:23.499+0000 7f6187fff640 10 monclient: _check_auth_tickets 2024-09-14T11:03:23.985 INFO:tasks.workunit.client.0.smithi097.stderr: -387> 2024-09-14T11:03:23.499+0000 7f6187fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:03:23.985 INFO:tasks.workunit.client.0.smithi097.stderr: -386> 2024-09-14T11:03:23.499+0000 7f6187fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:03:23.985 INFO:tasks.workunit.client.0.smithi097.stderr: -385> 2024-09-14T11:03:23.499+0000 7f6187fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:03:23.985 INFO:tasks.workunit.client.0.smithi097.stderr: -384> 2024-09-14T11:03:23.499+0000 7f6187fff640 10 monclient: dump: 2024-09-14T11:03:23.985 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:03:23.985 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:03:23.985 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:23.985 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:23.985 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:03:23.985 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:03:23.986 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:03:23.986 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:03:23.986 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:03:23.986 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:23.986 INFO:tasks.workunit.client.0.smithi097.stderr: -383> 2024-09-14T11:03:23.499+0000 7f62a3f2e800 5 monclient: authenticate success, global_id 6290 2024-09-14T11:03:23.986 INFO:tasks.workunit.client.0.smithi097.stderr: -382> 2024-09-14T11:03:23.499+0000 7f62a3f2e800 10 monclient: _renew_subs 2024-09-14T11:03:23.986 INFO:tasks.workunit.client.0.smithi097.stderr: -381> 2024-09-14T11:03:23.499+0000 7f62a3f2e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:03:23.986 INFO:tasks.workunit.client.0.smithi097.stderr: -380> 2024-09-14T11:03:23.499+0000 7f618de0b640 4 set_mon_vals no callback set 2024-09-14T11:03:23.986 INFO:tasks.workunit.client.0.smithi097.stderr: -379> 2024-09-14T11:03:23.499+0000 7f62a3f2e800 10 monclient: _renew_subs 2024-09-14T11:03:23.986 INFO:tasks.workunit.client.0.smithi097.stderr: -378> 2024-09-14T11:03:23.499+0000 7f62a3f2e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:03:23.986 INFO:tasks.workunit.client.0.smithi097.stderr: -377> 2024-09-14T11:03:23.499+0000 7f62a3f2e800 1 librados: init done 2024-09-14T11:03:23.986 INFO:tasks.workunit.client.0.smithi097.stderr: -376> 2024-09-14T11:03:23.501+0000 7f6187fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:03:23.986 INFO:tasks.workunit.client.0.smithi097.stderr: -375> 2024-09-14T11:03:23.501+0000 7f6187fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:03:23.986 INFO:tasks.workunit.client.0.smithi097.stderr: -374> 2024-09-14T11:03:23.501+0000 7f6187fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:03:23.987 INFO:tasks.workunit.client.0.smithi097.stderr: -373> 2024-09-14T11:03:23.501+0000 7f629fcdd640 10 monclient: get_auth_request con 0x7f6188077230 auth_method 0 2024-09-14T11:03:23.987 INFO:tasks.workunit.client.0.smithi097.stderr: -372> 2024-09-14T11:03:23.502+0000 7f62a04de640 10 monclient: get_auth_request con 0x561cb7024490 auth_method 0 2024-09-14T11:03:23.987 INFO:tasks.workunit.client.0.smithi097.stderr: -371> 2024-09-14T11:03:23.503+0000 7f629fcdd640 10 monclient: get_auth_request con 0x561cb7047600 auth_method 0 2024-09-14T11:03:23.987 INFO:tasks.workunit.client.0.smithi097.stderr: -370> 2024-09-14T11:03:23.503+0000 7f629f4dc640 10 monclient: get_auth_request con 0x561cb704b9f0 auth_method 0 2024-09-14T11:03:23.987 INFO:tasks.workunit.client.0.smithi097.stderr: -369> 2024-09-14T11:03:23.504+0000 7f62a04de640 10 monclient: get_auth_request con 0x561cb704fef0 auth_method 0 2024-09-14T11:03:23.987 INFO:tasks.workunit.client.0.smithi097.stderr: -368> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 10 monclient: build_initial_monmap 2024-09-14T11:03:23.987 INFO:tasks.workunit.client.0.smithi097.stderr: -367> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 1 build_initial for_mkfs: 0 2024-09-14T11:03:23.987 INFO:tasks.workunit.client.0.smithi097.stderr: -366> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 10 monclient: monmap: 2024-09-14T11:03:23.987 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:03:23.987 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:03:23.987 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:03:23.987 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:03:23.987 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:03:23.988 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:03:23.988 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:03:23.988 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:03:23.988 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:03:23.988 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:23.988 INFO:tasks.workunit.client.0.smithi097.stderr: -365> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7053c30) adding auth protocol: cephx 2024-09-14T11:03:23.988 INFO:tasks.workunit.client.0.smithi097.stderr: -364> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7053c30) adding auth protocol: cephx 2024-09-14T11:03:23.988 INFO:tasks.workunit.client.0.smithi097.stderr: -363> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7053c30) adding auth protocol: cephx 2024-09-14T11:03:23.988 INFO:tasks.workunit.client.0.smithi097.stderr: -362> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7053c30) adding con mode: secure 2024-09-14T11:03:23.989 INFO:tasks.workunit.client.0.smithi097.stderr: -361> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7053c30) adding con mode: crc 2024-09-14T11:03:23.989 INFO:tasks.workunit.client.0.smithi097.stderr: -360> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7053c30) adding con mode: secure 2024-09-14T11:03:23.989 INFO:tasks.workunit.client.0.smithi097.stderr: -359> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7053c30) adding con mode: crc 2024-09-14T11:03:23.989 INFO:tasks.workunit.client.0.smithi097.stderr: -358> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7053c30) adding con mode: secure 2024-09-14T11:03:23.989 INFO:tasks.workunit.client.0.smithi097.stderr: -357> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7053c30) adding con mode: crc 2024-09-14T11:03:23.989 INFO:tasks.workunit.client.0.smithi097.stderr: -356> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7053c30) adding con mode: crc 2024-09-14T11:03:23.989 INFO:tasks.workunit.client.0.smithi097.stderr: -355> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7053c30) adding con mode: secure 2024-09-14T11:03:23.989 INFO:tasks.workunit.client.0.smithi097.stderr: -354> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7053c30) adding con mode: crc 2024-09-14T11:03:23.989 INFO:tasks.workunit.client.0.smithi097.stderr: -353> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7053c30) adding con mode: secure 2024-09-14T11:03:23.989 INFO:tasks.workunit.client.0.smithi097.stderr: -352> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7053c30) adding con mode: crc 2024-09-14T11:03:23.989 INFO:tasks.workunit.client.0.smithi097.stderr: -351> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7053c30) adding con mode: secure 2024-09-14T11:03:23.989 INFO:tasks.workunit.client.0.smithi097.stderr: -350> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:23.989 INFO:tasks.workunit.client.0.smithi097.stderr: -349> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 asok(0x561cb6ddc270) register_command objecter_requests cmddesc objecter_requests hook 0x561cb7058850 EEXIST 2024-09-14T11:03:23.990 INFO:tasks.workunit.client.0.smithi097.stderr: -348> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 10 monclient: init 2024-09-14T11:03:23.990 INFO:tasks.workunit.client.0.smithi097.stderr: -347> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7052c38) adding auth protocol: cephx 2024-09-14T11:03:23.990 INFO:tasks.workunit.client.0.smithi097.stderr: -346> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7052c38) adding auth protocol: cephx 2024-09-14T11:03:23.990 INFO:tasks.workunit.client.0.smithi097.stderr: -345> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7052c38) adding auth protocol: cephx 2024-09-14T11:03:23.990 INFO:tasks.workunit.client.0.smithi097.stderr: -344> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7052c38) adding con mode: secure 2024-09-14T11:03:23.990 INFO:tasks.workunit.client.0.smithi097.stderr: -343> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7052c38) adding con mode: crc 2024-09-14T11:03:23.990 INFO:tasks.workunit.client.0.smithi097.stderr: -342> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7052c38) adding con mode: secure 2024-09-14T11:03:23.990 INFO:tasks.workunit.client.0.smithi097.stderr: -341> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7052c38) adding con mode: crc 2024-09-14T11:03:23.990 INFO:tasks.workunit.client.0.smithi097.stderr: -340> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7052c38) adding con mode: secure 2024-09-14T11:03:23.990 INFO:tasks.workunit.client.0.smithi097.stderr: -339> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7052c38) adding con mode: crc 2024-09-14T11:03:23.990 INFO:tasks.workunit.client.0.smithi097.stderr: -338> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7052c38) adding con mode: crc 2024-09-14T11:03:23.990 INFO:tasks.workunit.client.0.smithi097.stderr: -337> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7052c38) adding con mode: secure 2024-09-14T11:03:23.990 INFO:tasks.workunit.client.0.smithi097.stderr: -336> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7052c38) adding con mode: crc 2024-09-14T11:03:23.990 INFO:tasks.workunit.client.0.smithi097.stderr: -335> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7052c38) adding con mode: secure 2024-09-14T11:03:23.991 INFO:tasks.workunit.client.0.smithi097.stderr: -334> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7052c38) adding con mode: crc 2024-09-14T11:03:23.991 INFO:tasks.workunit.client.0.smithi097.stderr: -333> 2024-09-14T11:03:23.506+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7052c38) adding con mode: secure 2024-09-14T11:03:23.991 INFO:tasks.workunit.client.0.smithi097.stderr: -332> 2024-09-14T11:03:23.506+0000 7f62a3f2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:23.991 INFO:tasks.workunit.client.0.smithi097.stderr: -331> 2024-09-14T11:03:23.506+0000 7f62a3f2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:23.991 INFO:tasks.workunit.client.0.smithi097.stderr: -330> 2024-09-14T11:03:23.506+0000 7f62a3f2e800 5 asok(0x561cb6ddc270) register_command rotate-key cmddesc rotate-key hook 0x561cb7052d80 EEXIST 2024-09-14T11:03:23.991 INFO:tasks.workunit.client.0.smithi097.stderr: -329> 2024-09-14T11:03:23.506+0000 7f62a3f2e800 10 monclient: _reopen_session rank -1 2024-09-14T11:03:23.991 INFO:tasks.workunit.client.0.smithi097.stderr: -328> 2024-09-14T11:03:23.506+0000 7f62a3f2e800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:03:23.991 INFO:tasks.workunit.client.0.smithi097.stderr: -327> 2024-09-14T11:03:23.506+0000 7f62a3f2e800 10 monclient(hunting): picked mon.noname-a con 0x561cb707c540 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:03:23.991 INFO:tasks.workunit.client.0.smithi097.stderr: -326> 2024-09-14T11:03:23.506+0000 7f62a3f2e800 10 monclient(hunting): picked mon.noname-b con 0x561cb707c920 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:03:23.991 INFO:tasks.workunit.client.0.smithi097.stderr: -325> 2024-09-14T11:03:23.506+0000 7f62a3f2e800 10 monclient(hunting): picked mon.noname-c con 0x561cb707ebd0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:03:23.991 INFO:tasks.workunit.client.0.smithi097.stderr: -324> 2024-09-14T11:03:23.506+0000 7f62a3f2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:03:23.991 INFO:tasks.workunit.client.0.smithi097.stderr: -323> 2024-09-14T11:03:23.506+0000 7f62a3f2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:03:23.991 INFO:tasks.workunit.client.0.smithi097.stderr: -322> 2024-09-14T11:03:23.506+0000 7f62a3f2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:03:23.992 INFO:tasks.workunit.client.0.smithi097.stderr: -321> 2024-09-14T11:03:23.506+0000 7f62a3f2e800 10 monclient(hunting): _renew_subs 2024-09-14T11:03:23.992 INFO:tasks.workunit.client.0.smithi097.stderr: -320> 2024-09-14T11:03:23.506+0000 7f62a3f2e800 10 monclient(hunting): authenticate will time out at 1885.160505s 2024-09-14T11:03:23.992 INFO:tasks.workunit.client.0.smithi097.stderr: -319> 2024-09-14T11:03:23.506+0000 7f629f4dc640 10 monclient(hunting): get_auth_request con 0x561cb707c540 auth_method 0 2024-09-14T11:03:23.992 INFO:tasks.workunit.client.0.smithi097.stderr: -318> 2024-09-14T11:03:23.506+0000 7f629f4dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:03:23.992 INFO:tasks.workunit.client.0.smithi097.stderr: -317> 2024-09-14T11:03:23.506+0000 7f629f4dc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:03:23.992 INFO:tasks.workunit.client.0.smithi097.stderr: -316> 2024-09-14T11:03:23.506+0000 7f629f4dc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:03:23.992 INFO:tasks.workunit.client.0.smithi097.stderr: -315> 2024-09-14T11:03:23.506+0000 7f629fcdd640 10 monclient(hunting): get_auth_request con 0x561cb707ebd0 auth_method 0 2024-09-14T11:03:23.992 INFO:tasks.workunit.client.0.smithi097.stderr: -314> 2024-09-14T11:03:23.506+0000 7f629fcdd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:03:23.992 INFO:tasks.workunit.client.0.smithi097.stderr: -313> 2024-09-14T11:03:23.506+0000 7f629fcdd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:03:23.992 INFO:tasks.workunit.client.0.smithi097.stderr: -312> 2024-09-14T11:03:23.506+0000 7f629fcdd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:03:23.992 INFO:tasks.workunit.client.0.smithi097.stderr: -311> 2024-09-14T11:03:23.506+0000 7f629f4dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:03:23.992 INFO:tasks.workunit.client.0.smithi097.stderr: -310> 2024-09-14T11:03:23.506+0000 7f629f4dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:03:23.993 INFO:tasks.workunit.client.0.smithi097.stderr: -309> 2024-09-14T11:03:23.506+0000 7f629f4dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:03:23.993 INFO:tasks.workunit.client.0.smithi097.stderr: -308> 2024-09-14T11:03:23.506+0000 7f629fcdd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:03:23.993 INFO:tasks.workunit.client.0.smithi097.stderr: -307> 2024-09-14T11:03:23.506+0000 7f629fcdd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:03:23.993 INFO:tasks.workunit.client.0.smithi097.stderr: -306> 2024-09-14T11:03:23.506+0000 7f629fcdd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:03:23.993 INFO:tasks.workunit.client.0.smithi097.stderr: -305> 2024-09-14T11:03:23.506+0000 7f62a04de640 10 monclient(hunting): get_auth_request con 0x561cb707c920 auth_method 0 2024-09-14T11:03:23.993 INFO:tasks.workunit.client.0.smithi097.stderr: -304> 2024-09-14T11:03:23.506+0000 7f62a04de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:03:23.993 INFO:tasks.workunit.client.0.smithi097.stderr: -303> 2024-09-14T11:03:23.506+0000 7f62a04de640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:03:23.993 INFO:tasks.workunit.client.0.smithi097.stderr: -302> 2024-09-14T11:03:23.506+0000 7f62a04de640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:03:23.993 INFO:tasks.workunit.client.0.smithi097.stderr: -301> 2024-09-14T11:03:23.506+0000 7f629f4dc640 10 monclient(hunting): handle_auth_done global_id 6636 payload 824 2024-09-14T11:03:23.993 INFO:tasks.workunit.client.0.smithi097.stderr: -300> 2024-09-14T11:03:23.506+0000 7f629f4dc640 10 monclient: _finish_hunting 0 2024-09-14T11:03:23.993 INFO:tasks.workunit.client.0.smithi097.stderr: -299> 2024-09-14T11:03:23.506+0000 7f629f4dc640 1 monclient: found mon.noname-a 2024-09-14T11:03:23.993 INFO:tasks.workunit.client.0.smithi097.stderr: -298> 2024-09-14T11:03:23.506+0000 7f629f4dc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-14T11:03:23.993 INFO:tasks.workunit.client.0.smithi097.stderr: -297> 2024-09-14T11:03:23.507+0000 7f61857fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:03:23.993 INFO:tasks.workunit.client.0.smithi097.stderr: -296> 2024-09-14T11:03:23.507+0000 7f61857fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:03:23.994 INFO:tasks.workunit.client.0.smithi097.stderr: -295> 2024-09-14T11:03:23.507+0000 7f61857fa640 10 monclient: dump: 2024-09-14T11:03:23.994 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:03:23.994 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:03:23.994 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:23.994 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:23.994 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:03:23.994 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:03:23.994 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:03:23.994 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:03:23.994 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:03:23.994 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:23.994 INFO:tasks.workunit.client.0.smithi097.stderr: -294> 2024-09-14T11:03:23.507+0000 7f61857fa640 10 monclient: _finish_auth 0 2024-09-14T11:03:23.994 INFO:tasks.workunit.client.0.smithi097.stderr: -293> 2024-09-14T11:03:23.507+0000 7f61857fa640 10 monclient: _check_auth_tickets 2024-09-14T11:03:23.994 INFO:tasks.workunit.client.0.smithi097.stderr: -292> 2024-09-14T11:03:23.507+0000 7f61857fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:03:23.995 INFO:tasks.workunit.client.0.smithi097.stderr: -291> 2024-09-14T11:03:23.507+0000 7f61857fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:03:23.995 INFO:tasks.workunit.client.0.smithi097.stderr: -290> 2024-09-14T11:03:23.507+0000 7f61857fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:03:23.995 INFO:tasks.workunit.client.0.smithi097.stderr: -289> 2024-09-14T11:03:23.507+0000 7f61857fa640 10 monclient: dump: 2024-09-14T11:03:23.995 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:03:23.995 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:03:23.995 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:23.995 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:23.995 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:03:23.995 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:03:23.995 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:03:23.995 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:03:23.995 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:03:23.995 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:23.995 INFO:tasks.workunit.client.0.smithi097.stderr: -288> 2024-09-14T11:03:23.507+0000 7f62a3f2e800 5 monclient: authenticate success, global_id 6636 2024-09-14T11:03:23.996 INFO:tasks.workunit.client.0.smithi097.stderr: -287> 2024-09-14T11:03:23.507+0000 7f62a3f2e800 10 monclient: _renew_subs 2024-09-14T11:03:23.996 INFO:tasks.workunit.client.0.smithi097.stderr: -286> 2024-09-14T11:03:23.507+0000 7f62a3f2e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:03:23.996 INFO:tasks.workunit.client.0.smithi097.stderr: -285> 2024-09-14T11:03:23.507+0000 7f62a0cdf640 4 set_mon_vals no callback set 2024-09-14T11:03:23.996 INFO:tasks.workunit.client.0.smithi097.stderr: -284> 2024-09-14T11:03:23.507+0000 7f62a3f2e800 10 monclient: _renew_subs 2024-09-14T11:03:23.996 INFO:tasks.workunit.client.0.smithi097.stderr: -283> 2024-09-14T11:03:23.507+0000 7f62a3f2e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:03:23.996 INFO:tasks.workunit.client.0.smithi097.stderr: -282> 2024-09-14T11:03:23.508+0000 7f61857fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:03:23.996 INFO:tasks.workunit.client.0.smithi097.stderr: -281> 2024-09-14T11:03:23.508+0000 7f61857fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:03:23.996 INFO:tasks.workunit.client.0.smithi097.stderr: -280> 2024-09-14T11:03:23.508+0000 7f61857fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:03:23.996 INFO:tasks.workunit.client.0.smithi097.stderr: -279> 2024-09-14T11:03:23.509+0000 7f62a04de640 10 monclient: get_auth_request con 0x7f6178077140 auth_method 0 2024-09-14T11:03:23.996 INFO:tasks.workunit.client.0.smithi097.stderr: -278> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 10 monclient: get_monmap_and_config 2024-09-14T11:03:23.996 INFO:tasks.workunit.client.0.smithi097.stderr: -277> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 10 monclient: build_initial_monmap 2024-09-14T11:03:23.996 INFO:tasks.workunit.client.0.smithi097.stderr: -276> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 1 build_initial for_mkfs: 0 2024-09-14T11:03:23.996 INFO:tasks.workunit.client.0.smithi097.stderr: -275> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 10 monclient: monmap: 2024-09-14T11:03:23.997 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:03:23.997 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:03:23.997 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:03:23.997 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:03:23.997 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:03:23.997 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:03:23.997 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:03:23.997 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:03:23.997 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:03:23.997 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:23.997 INFO:tasks.workunit.client.0.smithi097.stderr: -274> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x561cb709c100) adding auth protocol: cephx 2024-09-14T11:03:23.997 INFO:tasks.workunit.client.0.smithi097.stderr: -273> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x561cb709c100) adding auth protocol: cephx 2024-09-14T11:03:23.997 INFO:tasks.workunit.client.0.smithi097.stderr: -272> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x561cb709c100) adding auth protocol: cephx 2024-09-14T11:03:23.998 INFO:tasks.workunit.client.0.smithi097.stderr: -271> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x561cb709c100) adding con mode: secure 2024-09-14T11:03:23.998 INFO:tasks.workunit.client.0.smithi097.stderr: -270> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x561cb709c100) adding con mode: crc 2024-09-14T11:03:23.998 INFO:tasks.workunit.client.0.smithi097.stderr: -269> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x561cb709c100) adding con mode: secure 2024-09-14T11:03:23.998 INFO:tasks.workunit.client.0.smithi097.stderr: -268> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x561cb709c100) adding con mode: crc 2024-09-14T11:03:23.998 INFO:tasks.workunit.client.0.smithi097.stderr: -267> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x561cb709c100) adding con mode: secure 2024-09-14T11:03:23.998 INFO:tasks.workunit.client.0.smithi097.stderr: -266> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x561cb709c100) adding con mode: crc 2024-09-14T11:03:23.998 INFO:tasks.workunit.client.0.smithi097.stderr: -265> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x561cb709c100) adding con mode: crc 2024-09-14T11:03:23.998 INFO:tasks.workunit.client.0.smithi097.stderr: -264> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x561cb709c100) adding con mode: secure 2024-09-14T11:03:23.998 INFO:tasks.workunit.client.0.smithi097.stderr: -263> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x561cb709c100) adding con mode: crc 2024-09-14T11:03:23.998 INFO:tasks.workunit.client.0.smithi097.stderr: -262> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x561cb709c100) adding con mode: secure 2024-09-14T11:03:23.998 INFO:tasks.workunit.client.0.smithi097.stderr: -261> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x561cb709c100) adding con mode: crc 2024-09-14T11:03:23.998 INFO:tasks.workunit.client.0.smithi097.stderr: -260> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x561cb709c100) adding con mode: secure 2024-09-14T11:03:23.998 INFO:tasks.workunit.client.0.smithi097.stderr: -259> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:23.998 INFO:tasks.workunit.client.0.smithi097.stderr: -258> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 10 monclient: init 2024-09-14T11:03:23.999 INFO:tasks.workunit.client.0.smithi097.stderr: -257> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f120) adding auth protocol: cephx 2024-09-14T11:03:23.999 INFO:tasks.workunit.client.0.smithi097.stderr: -256> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f120) adding auth protocol: cephx 2024-09-14T11:03:23.999 INFO:tasks.workunit.client.0.smithi097.stderr: -255> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f120) adding auth protocol: cephx 2024-09-14T11:03:23.999 INFO:tasks.workunit.client.0.smithi097.stderr: -254> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f120) adding con mode: secure 2024-09-14T11:03:23.999 INFO:tasks.workunit.client.0.smithi097.stderr: -253> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f120) adding con mode: crc 2024-09-14T11:03:23.999 INFO:tasks.workunit.client.0.smithi097.stderr: -252> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f120) adding con mode: secure 2024-09-14T11:03:23.999 INFO:tasks.workunit.client.0.smithi097.stderr: -251> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f120) adding con mode: crc 2024-09-14T11:03:23.999 INFO:tasks.workunit.client.0.smithi097.stderr: -250> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f120) adding con mode: secure 2024-09-14T11:03:23.999 INFO:tasks.workunit.client.0.smithi097.stderr: -249> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f120) adding con mode: crc 2024-09-14T11:03:23.999 INFO:tasks.workunit.client.0.smithi097.stderr: -248> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f120) adding con mode: crc 2024-09-14T11:03:23.999 INFO:tasks.workunit.client.0.smithi097.stderr: -247> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f120) adding con mode: secure 2024-09-14T11:03:23.999 INFO:tasks.workunit.client.0.smithi097.stderr: -246> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f120) adding con mode: crc 2024-09-14T11:03:23.999 INFO:tasks.workunit.client.0.smithi097.stderr: -245> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f120) adding con mode: secure 2024-09-14T11:03:24.000 INFO:tasks.workunit.client.0.smithi097.stderr: -244> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f120) adding con mode: crc 2024-09-14T11:03:24.000 INFO:tasks.workunit.client.0.smithi097.stderr: -243> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f120) adding con mode: secure 2024-09-14T11:03:24.000 INFO:tasks.workunit.client.0.smithi097.stderr: -242> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:24.000 INFO:tasks.workunit.client.0.smithi097.stderr: -241> 2024-09-14T11:03:23.510+0000 7f62a3f2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:24.000 INFO:tasks.workunit.client.0.smithi097.stderr: -240> 2024-09-14T11:03:23.510+0000 7f62a3f2e800 5 asok(0x561cb6ddc270) register_command rotate-key cmddesc rotate-key hook 0x7ffdce77f268 EEXIST 2024-09-14T11:03:24.000 INFO:tasks.workunit.client.0.smithi097.stderr: -239> 2024-09-14T11:03:23.510+0000 7f62a3f2e800 10 monclient: _reopen_session rank -1 2024-09-14T11:03:24.000 INFO:tasks.workunit.client.0.smithi097.stderr: -238> 2024-09-14T11:03:23.510+0000 7f62a3f2e800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:03:24.000 INFO:tasks.workunit.client.0.smithi097.stderr: -237> 2024-09-14T11:03:23.510+0000 7f62a3f2e800 10 monclient(hunting): picked mon.noname-b con 0x561cb70d06e0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:03:24.000 INFO:tasks.workunit.client.0.smithi097.stderr: -236> 2024-09-14T11:03:23.510+0000 7f62a3f2e800 10 monclient(hunting): picked mon.noname-a con 0x561cb70cac80 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:03:24.000 INFO:tasks.workunit.client.0.smithi097.stderr: -235> 2024-09-14T11:03:23.510+0000 7f62a3f2e800 10 monclient(hunting): picked mon.noname-c con 0x561cb70a0520 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:03:24.000 INFO:tasks.workunit.client.0.smithi097.stderr: -234> 2024-09-14T11:03:23.510+0000 7f62a3f2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:03:24.000 INFO:tasks.workunit.client.0.smithi097.stderr: -233> 2024-09-14T11:03:23.510+0000 7f62a3f2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:03:24.000 INFO:tasks.workunit.client.0.smithi097.stderr: -232> 2024-09-14T11:03:23.510+0000 7f62a3f2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:03:24.000 INFO:tasks.workunit.client.0.smithi097.stderr: -231> 2024-09-14T11:03:23.510+0000 7f62a3f2e800 10 monclient(hunting): _renew_subs 2024-09-14T11:03:24.001 INFO:tasks.workunit.client.0.smithi097.stderr: -230> 2024-09-14T11:03:23.510+0000 7f62a3f2e800 10 monclient(hunting): authenticate will time out at 1885.164192s 2024-09-14T11:03:24.001 INFO:tasks.workunit.client.0.smithi097.stderr: -229> 2024-09-14T11:03:23.510+0000 7f62a04de640 10 monclient(hunting): get_auth_request con 0x561cb70cac80 auth_method 0 2024-09-14T11:03:24.001 INFO:tasks.workunit.client.0.smithi097.stderr: -228> 2024-09-14T11:03:23.510+0000 7f62a04de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:03:24.001 INFO:tasks.workunit.client.0.smithi097.stderr: -227> 2024-09-14T11:03:23.510+0000 7f62a04de640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:03:24.001 INFO:tasks.workunit.client.0.smithi097.stderr: -226> 2024-09-14T11:03:23.510+0000 7f62a04de640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:03:24.001 INFO:tasks.workunit.client.0.smithi097.stderr: -225> 2024-09-14T11:03:23.510+0000 7f629fcdd640 10 monclient(hunting): get_auth_request con 0x561cb70a0520 auth_method 0 2024-09-14T11:03:24.001 INFO:tasks.workunit.client.0.smithi097.stderr: -224> 2024-09-14T11:03:23.510+0000 7f629fcdd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:03:24.001 INFO:tasks.workunit.client.0.smithi097.stderr: -223> 2024-09-14T11:03:23.510+0000 7f629fcdd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:03:24.001 INFO:tasks.workunit.client.0.smithi097.stderr: -222> 2024-09-14T11:03:23.510+0000 7f629fcdd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:03:24.001 INFO:tasks.workunit.client.0.smithi097.stderr: -221> 2024-09-14T11:03:23.510+0000 7f62a04de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:03:24.001 INFO:tasks.workunit.client.0.smithi097.stderr: -220> 2024-09-14T11:03:23.510+0000 7f62a04de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:03:24.001 INFO:tasks.workunit.client.0.smithi097.stderr: -219> 2024-09-14T11:03:23.510+0000 7f62a04de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:03:24.001 INFO:tasks.workunit.client.0.smithi097.stderr: -218> 2024-09-14T11:03:23.510+0000 7f629fcdd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:03:24.002 INFO:tasks.workunit.client.0.smithi097.stderr: -217> 2024-09-14T11:03:23.510+0000 7f629fcdd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:03:24.002 INFO:tasks.workunit.client.0.smithi097.stderr: -216> 2024-09-14T11:03:23.510+0000 7f629fcdd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:03:24.002 INFO:tasks.workunit.client.0.smithi097.stderr: -215> 2024-09-14T11:03:23.510+0000 7f62a04de640 10 monclient(hunting): handle_auth_done global_id 6639 payload 274 2024-09-14T11:03:24.002 INFO:tasks.workunit.client.0.smithi097.stderr: -214> 2024-09-14T11:03:23.510+0000 7f62a04de640 10 monclient: _finish_hunting 0 2024-09-14T11:03:24.002 INFO:tasks.workunit.client.0.smithi097.stderr: -213> 2024-09-14T11:03:23.510+0000 7f62a04de640 1 monclient: found mon.noname-a 2024-09-14T11:03:24.002 INFO:tasks.workunit.client.0.smithi097.stderr: -212> 2024-09-14T11:03:23.510+0000 7f62a04de640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-14T11:03:24.002 INFO:tasks.workunit.client.0.smithi097.stderr: -211> 2024-09-14T11:03:23.510+0000 7f629f4dc640 10 monclient: get_auth_request con 0x561cb70d06e0 auth_method 0 2024-09-14T11:03:24.002 INFO:tasks.workunit.client.0.smithi097.stderr: -210> 2024-09-14T11:03:23.510+0000 7f617effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:03:24.002 INFO:tasks.workunit.client.0.smithi097.stderr: -209> 2024-09-14T11:03:23.510+0000 7f617effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:03:24.002 INFO:tasks.workunit.client.0.smithi097.stderr: -208> 2024-09-14T11:03:23.510+0000 7f617effd640 10 monclient: dump: 2024-09-14T11:03:24.002 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:03:24.002 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:03:24.002 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:24.002 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:24.003 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:03:24.003 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:03:24.003 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:03:24.003 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:03:24.003 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:03:24.003 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:24.003 INFO:tasks.workunit.client.0.smithi097.stderr: -207> 2024-09-14T11:03:23.510+0000 7f617effd640 10 monclient: _finish_auth 0 2024-09-14T11:03:24.003 INFO:tasks.workunit.client.0.smithi097.stderr: -206> 2024-09-14T11:03:23.510+0000 7f617effd640 10 monclient: _check_auth_tickets 2024-09-14T11:03:24.003 INFO:tasks.workunit.client.0.smithi097.stderr: -205> 2024-09-14T11:03:23.510+0000 7f617effd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:03:24.003 INFO:tasks.workunit.client.0.smithi097.stderr: -204> 2024-09-14T11:03:23.510+0000 7f617effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:03:24.003 INFO:tasks.workunit.client.0.smithi097.stderr: -203> 2024-09-14T11:03:23.510+0000 7f617effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:03:24.003 INFO:tasks.workunit.client.0.smithi097.stderr: -202> 2024-09-14T11:03:23.510+0000 7f617effd640 10 monclient: dump: 2024-09-14T11:03:24.003 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:03:24.004 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:03:24.004 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:24.004 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:24.004 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:03:24.004 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:03:24.004 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:03:24.004 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:03:24.004 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:03:24.004 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:24.004 INFO:tasks.workunit.client.0.smithi097.stderr: -201> 2024-09-14T11:03:23.510+0000 7f62a3f2e800 5 monclient: authenticate success, global_id 6639 2024-09-14T11:03:24.004 INFO:tasks.workunit.client.0.smithi097.stderr: -200> 2024-09-14T11:03:23.510+0000 7f62a3f2e800 10 monclient: get_monmap_and_config success 2024-09-14T11:03:24.004 INFO:tasks.workunit.client.0.smithi097.stderr: -199> 2024-09-14T11:03:23.510+0000 7f62a3f2e800 4 set_mon_vals no callback set 2024-09-14T11:03:24.004 INFO:tasks.workunit.client.0.smithi097.stderr: -198> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 10 monclient: shutdown 2024-09-14T11:03:24.005 INFO:tasks.workunit.client.0.smithi097.stderr: -197> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 10 monclient: build_initial_monmap 2024-09-14T11:03:24.005 INFO:tasks.workunit.client.0.smithi097.stderr: -196> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 1 build_initial for_mkfs: 0 2024-09-14T11:03:24.005 INFO:tasks.workunit.client.0.smithi097.stderr: -195> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 10 monclient: monmap: 2024-09-14T11:03:24.005 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:03:24.005 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:03:24.005 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:03:24.005 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:03:24.005 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:03:24.005 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:03:24.005 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:03:24.005 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:03:24.005 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:03:24.005 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:24.005 INFO:tasks.workunit.client.0.smithi097.stderr: -194> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70cbc40) adding auth protocol: cephx 2024-09-14T11:03:24.006 INFO:tasks.workunit.client.0.smithi097.stderr: -193> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70cbc40) adding auth protocol: cephx 2024-09-14T11:03:24.006 INFO:tasks.workunit.client.0.smithi097.stderr: -192> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70cbc40) adding auth protocol: cephx 2024-09-14T11:03:24.006 INFO:tasks.workunit.client.0.smithi097.stderr: -191> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70cbc40) adding con mode: secure 2024-09-14T11:03:24.006 INFO:tasks.workunit.client.0.smithi097.stderr: -190> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70cbc40) adding con mode: crc 2024-09-14T11:03:24.006 INFO:tasks.workunit.client.0.smithi097.stderr: -189> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70cbc40) adding con mode: secure 2024-09-14T11:03:24.006 INFO:tasks.workunit.client.0.smithi097.stderr: -188> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70cbc40) adding con mode: crc 2024-09-14T11:03:24.006 INFO:tasks.workunit.client.0.smithi097.stderr: -187> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70cbc40) adding con mode: secure 2024-09-14T11:03:24.006 INFO:tasks.workunit.client.0.smithi097.stderr: -186> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70cbc40) adding con mode: crc 2024-09-14T11:03:24.006 INFO:tasks.workunit.client.0.smithi097.stderr: -185> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70cbc40) adding con mode: crc 2024-09-14T11:03:24.006 INFO:tasks.workunit.client.0.smithi097.stderr: -184> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70cbc40) adding con mode: secure 2024-09-14T11:03:24.006 INFO:tasks.workunit.client.0.smithi097.stderr: -183> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70cbc40) adding con mode: crc 2024-09-14T11:03:24.006 INFO:tasks.workunit.client.0.smithi097.stderr: -182> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70cbc40) adding con mode: secure 2024-09-14T11:03:24.006 INFO:tasks.workunit.client.0.smithi097.stderr: -181> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70cbc40) adding con mode: crc 2024-09-14T11:03:24.006 INFO:tasks.workunit.client.0.smithi097.stderr: -180> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70cbc40) adding con mode: secure 2024-09-14T11:03:24.007 INFO:tasks.workunit.client.0.smithi097.stderr: -179> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:24.007 INFO:tasks.workunit.client.0.smithi097.stderr: -178> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 1 librados: starting msgr at 2024-09-14T11:03:24.007 INFO:tasks.workunit.client.0.smithi097.stderr: -177> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 1 librados: starting objecter 2024-09-14T11:03:24.007 INFO:tasks.workunit.client.0.smithi097.stderr: -176> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 asok(0x561cb6ddc270) register_command objecter_requests cmddesc objecter_requests hook 0x561cb7027750 EEXIST 2024-09-14T11:03:24.007 INFO:tasks.workunit.client.0.smithi097.stderr: -175> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 1 librados: setting wanted keys 2024-09-14T11:03:24.007 INFO:tasks.workunit.client.0.smithi097.stderr: -174> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 1 librados: calling monclient init 2024-09-14T11:03:24.007 INFO:tasks.workunit.client.0.smithi097.stderr: -173> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 10 monclient: init 2024-09-14T11:03:24.007 INFO:tasks.workunit.client.0.smithi097.stderr: -172> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7094280) adding auth protocol: cephx 2024-09-14T11:03:24.007 INFO:tasks.workunit.client.0.smithi097.stderr: -171> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7094280) adding auth protocol: cephx 2024-09-14T11:03:24.007 INFO:tasks.workunit.client.0.smithi097.stderr: -170> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7094280) adding auth protocol: cephx 2024-09-14T11:03:24.007 INFO:tasks.workunit.client.0.smithi097.stderr: -169> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7094280) adding con mode: secure 2024-09-14T11:03:24.007 INFO:tasks.workunit.client.0.smithi097.stderr: -168> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7094280) adding con mode: crc 2024-09-14T11:03:24.007 INFO:tasks.workunit.client.0.smithi097.stderr: -167> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7094280) adding con mode: secure 2024-09-14T11:03:24.008 INFO:tasks.workunit.client.0.smithi097.stderr: -166> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7094280) adding con mode: crc 2024-09-14T11:03:24.008 INFO:tasks.workunit.client.0.smithi097.stderr: -165> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7094280) adding con mode: secure 2024-09-14T11:03:24.008 INFO:tasks.workunit.client.0.smithi097.stderr: -164> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7094280) adding con mode: crc 2024-09-14T11:03:24.008 INFO:tasks.workunit.client.0.smithi097.stderr: -163> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7094280) adding con mode: crc 2024-09-14T11:03:24.008 INFO:tasks.workunit.client.0.smithi097.stderr: -162> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7094280) adding con mode: secure 2024-09-14T11:03:24.008 INFO:tasks.workunit.client.0.smithi097.stderr: -161> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7094280) adding con mode: crc 2024-09-14T11:03:24.008 INFO:tasks.workunit.client.0.smithi097.stderr: -160> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7094280) adding con mode: secure 2024-09-14T11:03:24.008 INFO:tasks.workunit.client.0.smithi097.stderr: -159> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7094280) adding con mode: crc 2024-09-14T11:03:24.008 INFO:tasks.workunit.client.0.smithi097.stderr: -158> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7094280) adding con mode: secure 2024-09-14T11:03:24.008 INFO:tasks.workunit.client.0.smithi097.stderr: -157> 2024-09-14T11:03:23.512+0000 7f62a3f2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:24.008 INFO:tasks.workunit.client.0.smithi097.stderr: -156> 2024-09-14T11:03:23.512+0000 7f62a3f2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:24.008 INFO:tasks.workunit.client.0.smithi097.stderr: -155> 2024-09-14T11:03:23.512+0000 7f62a3f2e800 5 asok(0x561cb6ddc270) register_command rotate-key cmddesc rotate-key hook 0x561cb70943c8 EEXIST 2024-09-14T11:03:24.008 INFO:tasks.workunit.client.0.smithi097.stderr: -154> 2024-09-14T11:03:23.512+0000 7f62a3f2e800 10 monclient: _reopen_session rank -1 2024-09-14T11:03:24.009 INFO:tasks.workunit.client.0.smithi097.stderr: -153> 2024-09-14T11:03:23.512+0000 7f62a3f2e800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:03:24.009 INFO:tasks.workunit.client.0.smithi097.stderr: -152> 2024-09-14T11:03:23.512+0000 7f62a3f2e800 10 monclient(hunting): picked mon.noname-c con 0x561cb70a0520 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:03:24.009 INFO:tasks.workunit.client.0.smithi097.stderr: -151> 2024-09-14T11:03:23.512+0000 7f62a3f2e800 10 monclient(hunting): picked mon.noname-a con 0x561cb70cac80 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:03:24.009 INFO:tasks.workunit.client.0.smithi097.stderr: -150> 2024-09-14T11:03:23.512+0000 7f62a3f2e800 10 monclient(hunting): picked mon.noname-b con 0x561cb70d06e0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:03:24.009 INFO:tasks.workunit.client.0.smithi097.stderr: -149> 2024-09-14T11:03:23.512+0000 7f62a3f2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:03:24.009 INFO:tasks.workunit.client.0.smithi097.stderr: -148> 2024-09-14T11:03:23.512+0000 7f62a3f2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:03:24.009 INFO:tasks.workunit.client.0.smithi097.stderr: -147> 2024-09-14T11:03:23.512+0000 7f62a3f2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:03:24.009 INFO:tasks.workunit.client.0.smithi097.stderr: -146> 2024-09-14T11:03:23.512+0000 7f62a3f2e800 10 monclient(hunting): _renew_subs 2024-09-14T11:03:24.009 INFO:tasks.workunit.client.0.smithi097.stderr: -145> 2024-09-14T11:03:23.512+0000 7f62a3f2e800 10 monclient(hunting): authenticate will time out at 1885.166453s 2024-09-14T11:03:24.009 INFO:tasks.workunit.client.0.smithi097.stderr: -144> 2024-09-14T11:03:23.512+0000 7f629f4dc640 10 monclient(hunting): get_auth_request con 0x561cb70a0520 auth_method 0 2024-09-14T11:03:24.009 INFO:tasks.workunit.client.0.smithi097.stderr: -143> 2024-09-14T11:03:23.512+0000 7f629f4dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:03:24.009 INFO:tasks.workunit.client.0.smithi097.stderr: -142> 2024-09-14T11:03:23.512+0000 7f629f4dc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:03:24.009 INFO:tasks.workunit.client.0.smithi097.stderr: -141> 2024-09-14T11:03:23.512+0000 7f629f4dc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:03:24.009 INFO:tasks.workunit.client.0.smithi097.stderr: -140> 2024-09-14T11:03:23.512+0000 7f62a04de640 10 monclient(hunting): get_auth_request con 0x561cb70cac80 auth_method 0 2024-09-14T11:03:24.010 INFO:tasks.workunit.client.0.smithi097.stderr: -139> 2024-09-14T11:03:23.512+0000 7f62a04de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:03:24.010 INFO:tasks.workunit.client.0.smithi097.stderr: -138> 2024-09-14T11:03:23.512+0000 7f62a04de640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:03:24.010 INFO:tasks.workunit.client.0.smithi097.stderr: -137> 2024-09-14T11:03:23.512+0000 7f62a04de640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:03:24.010 INFO:tasks.workunit.client.0.smithi097.stderr: -136> 2024-09-14T11:03:23.512+0000 7f629f4dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:03:24.010 INFO:tasks.workunit.client.0.smithi097.stderr: -135> 2024-09-14T11:03:23.512+0000 7f629f4dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:03:24.010 INFO:tasks.workunit.client.0.smithi097.stderr: -134> 2024-09-14T11:03:23.512+0000 7f629f4dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:03:24.010 INFO:tasks.workunit.client.0.smithi097.stderr: -133> 2024-09-14T11:03:23.512+0000 7f62a04de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:03:24.010 INFO:tasks.workunit.client.0.smithi097.stderr: -132> 2024-09-14T11:03:23.512+0000 7f62a04de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:03:24.010 INFO:tasks.workunit.client.0.smithi097.stderr: -131> 2024-09-14T11:03:23.512+0000 7f62a04de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:03:24.010 INFO:tasks.workunit.client.0.smithi097.stderr: -130> 2024-09-14T11:03:23.512+0000 7f629f4dc640 10 monclient(hunting): handle_auth_done global_id 6299 payload 824 2024-09-14T11:03:24.010 INFO:tasks.workunit.client.0.smithi097.stderr: -129> 2024-09-14T11:03:23.512+0000 7f629f4dc640 10 monclient: _finish_hunting 0 2024-09-14T11:03:24.010 INFO:tasks.workunit.client.0.smithi097.stderr: -128> 2024-09-14T11:03:23.512+0000 7f629f4dc640 1 monclient: found mon.noname-c 2024-09-14T11:03:24.010 INFO:tasks.workunit.client.0.smithi097.stderr: -127> 2024-09-14T11:03:23.512+0000 7f629f4dc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:03:24.010 INFO:tasks.workunit.client.0.smithi097.stderr: -126> 2024-09-14T11:03:23.513+0000 7f617d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:03:24.011 INFO:tasks.workunit.client.0.smithi097.stderr: -125> 2024-09-14T11:03:23.513+0000 7f617d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:03:24.011 INFO:tasks.workunit.client.0.smithi097.stderr: -124> 2024-09-14T11:03:23.513+0000 7f617d7fa640 10 monclient: dump: 2024-09-14T11:03:24.011 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:03:24.011 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:03:24.011 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:24.011 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:24.011 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:03:24.011 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:03:24.011 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:03:24.011 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:03:24.011 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:03:24.011 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:24.011 INFO:tasks.workunit.client.0.smithi097.stderr: -123> 2024-09-14T11:03:23.513+0000 7f617d7fa640 10 monclient: _finish_auth 0 2024-09-14T11:03:24.012 INFO:tasks.workunit.client.0.smithi097.stderr: -122> 2024-09-14T11:03:23.513+0000 7f617d7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:03:24.012 INFO:tasks.workunit.client.0.smithi097.stderr: -121> 2024-09-14T11:03:23.513+0000 7f617d7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:03:24.012 INFO:tasks.workunit.client.0.smithi097.stderr: -120> 2024-09-14T11:03:23.513+0000 7f617d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:03:24.012 INFO:tasks.workunit.client.0.smithi097.stderr: -119> 2024-09-14T11:03:23.513+0000 7f617d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:03:24.012 INFO:tasks.workunit.client.0.smithi097.stderr: -118> 2024-09-14T11:03:23.513+0000 7f617d7fa640 10 monclient: dump: 2024-09-14T11:03:24.012 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:03:24.012 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:03:24.012 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:24.012 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:24.012 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:03:24.012 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:03:24.012 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:03:24.012 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:03:24.013 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:03:24.013 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:24.013 INFO:tasks.workunit.client.0.smithi097.stderr: -117> 2024-09-14T11:03:23.513+0000 7f62a3f2e800 5 monclient: authenticate success, global_id 6299 2024-09-14T11:03:24.013 INFO:tasks.workunit.client.0.smithi097.stderr: -116> 2024-09-14T11:03:23.513+0000 7f62a3f2e800 10 monclient: _renew_subs 2024-09-14T11:03:24.013 INFO:tasks.workunit.client.0.smithi097.stderr: -115> 2024-09-14T11:03:23.513+0000 7f617effd640 4 set_mon_vals no callback set 2024-09-14T11:03:24.013 INFO:tasks.workunit.client.0.smithi097.stderr: -114> 2024-09-14T11:03:23.513+0000 7f62a3f2e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:03:24.013 INFO:tasks.workunit.client.0.smithi097.stderr: -113> 2024-09-14T11:03:23.513+0000 7f62a3f2e800 10 monclient: _renew_subs 2024-09-14T11:03:24.013 INFO:tasks.workunit.client.0.smithi097.stderr: -112> 2024-09-14T11:03:23.513+0000 7f62a3f2e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:03:24.013 INFO:tasks.workunit.client.0.smithi097.stderr: -111> 2024-09-14T11:03:23.513+0000 7f62a3f2e800 1 librados: init done 2024-09-14T11:03:24.013 INFO:tasks.workunit.client.0.smithi097.stderr: -110> 2024-09-14T11:03:23.513+0000 7f62a3f2e800 5 asok(0x561cb6ddc270) register_command cr dump hook 0x561cb70bed68 2024-09-14T11:03:24.013 INFO:tasks.workunit.client.0.smithi097.stderr: -109> 2024-09-14T11:03:23.514+0000 7f62a3f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.013 INFO:tasks.workunit.client.0.smithi097.stderr: -108> 2024-09-14T11:03:23.515+0000 7f617d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:03:24.013 INFO:tasks.workunit.client.0.smithi097.stderr: -107> 2024-09-14T11:03:23.515+0000 7f617d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:03:24.013 INFO:tasks.workunit.client.0.smithi097.stderr: -106> 2024-09-14T11:03:23.515+0000 7f617d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:03:24.014 INFO:tasks.workunit.client.0.smithi097.stderr: -105> 2024-09-14T11:03:23.515+0000 7f62a04de640 10 monclient: get_auth_request con 0x7f6168077230 auth_method 0 2024-09-14T11:03:24.014 INFO:tasks.workunit.client.0.smithi097.stderr: -104> 2024-09-14T11:03:23.515+0000 7f629fcdd640 10 monclient: get_auth_request con 0x561cb70eaa20 auth_method 0 2024-09-14T11:03:24.014 INFO:tasks.workunit.client.0.smithi097.stderr: -103> 2024-09-14T11:03:23.516+0000 7f62a3f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:24.014 INFO:tasks.workunit.client.0.smithi097.stderr: -102> 2024-09-14T11:03:23.516+0000 7f62a3f2e800 20 realm 2024-09-14T11:03:24.014 INFO:tasks.workunit.client.0.smithi097.stderr: -101> 2024-09-14T11:03:23.516+0000 7f62a3f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.014 INFO:tasks.workunit.client.0.smithi097.stderr: -100> 2024-09-14T11:03:23.516+0000 7f62a3f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:24.014 INFO:tasks.workunit.client.0.smithi097.stderr: -99> 2024-09-14T11:03:23.516+0000 7f62a3f2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:03:24.014 INFO:tasks.workunit.client.0.smithi097.stderr: -98> 2024-09-14T11:03:23.516+0000 7f62a3f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.014 INFO:tasks.workunit.client.0.smithi097.stderr: -97> 2024-09-14T11:03:23.516+0000 7f62a3f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:24.014 INFO:tasks.workunit.client.0.smithi097.stderr: -96> 2024-09-14T11:03:23.516+0000 7f62a3f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.014 INFO:tasks.workunit.client.0.smithi097.stderr: -95> 2024-09-14T11:03:23.517+0000 7f629f4dc640 10 monclient: get_auth_request con 0x561cb70eee00 auth_method 0 2024-09-14T11:03:24.014 INFO:tasks.workunit.client.0.smithi097.stderr: -94> 2024-09-14T11:03:23.517+0000 7f62a3f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:24.014 INFO:tasks.workunit.client.0.smithi097.stderr: -93> 2024-09-14T11:03:23.517+0000 7f62a3f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.015 INFO:tasks.workunit.client.0.smithi097.stderr: -92> 2024-09-14T11:03:23.517+0000 7f62a04de640 10 monclient: get_auth_request con 0x561cb70f2500 auth_method 0 2024-09-14T11:03:24.015 INFO:tasks.workunit.client.0.smithi097.stderr: -91> 2024-09-14T11:03:23.518+0000 7f62a3f2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:03:24.015 INFO:tasks.workunit.client.0.smithi097.stderr: -90> 2024-09-14T11:03:23.518+0000 7f62a3f2e800 20 searching for the correct realm 2024-09-14T11:03:24.015 INFO:tasks.workunit.client.0.smithi097.stderr: -89> 2024-09-14T11:03:23.518+0000 7f629fcdd640 10 monclient: get_auth_request con 0x561cb70f7280 auth_method 0 2024-09-14T11:03:24.015 INFO:tasks.workunit.client.0.smithi097.stderr: -88> 2024-09-14T11:03:23.519+0000 7f629f4dc640 0 -- 172.21.15.97:0/4101729106 >> [v2:172.21.15.97:6808/2081705332,v1:172.21.15.97:6809/2081705332] conn(0x7f629002b040 msgr2=0x7f629001c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:03:24.015 INFO:tasks.workunit.client.0.smithi097.stderr: -87> 2024-09-14T11:03:23.720+0000 7f629f4dc640 10 monclient: get_auth_request con 0x7f629002b040 auth_method 0 2024-09-14T11:03:24.015 INFO:tasks.workunit.client.0.smithi097.stderr: -86> 2024-09-14T11:03:23.721+0000 7f62a04de640 10 monclient: get_auth_request con 0x7f629408c020 auth_method 0 2024-09-14T11:03:24.015 INFO:tasks.workunit.client.0.smithi097.stderr: -85> 2024-09-14T11:03:23.724+0000 7f629fcdd640 10 monclient: get_auth_request con 0x7f6294027400 auth_method 0 2024-09-14T11:03:24.015 INFO:tasks.workunit.client.0.smithi097.stderr: -84> 2024-09-14T11:03:23.724+0000 7f629fcdd640 0 -- 172.21.15.97:0/4101729106 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7f6294027400 msgr2=0x7f6294068aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:03:24.015 INFO:tasks.workunit.client.0.smithi097.stderr: -83> 2024-09-14T11:03:23.925+0000 7f629fcdd640 10 monclient: get_auth_request con 0x7f6294027400 auth_method 0 2024-09-14T11:03:24.015 INFO:tasks.workunit.client.0.smithi097.stderr: -82> 2024-09-14T11:03:23.926+0000 7f629f4dc640 10 monclient: get_auth_request con 0x7f629003d040 auth_method 0 2024-09-14T11:03:24.015 INFO:tasks.workunit.client.0.smithi097.stderr: -81> 2024-09-14T11:03:23.931+0000 7f62a3f2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:03:24.015 INFO:tasks.workunit.client.0.smithi097.stderr: -80> 2024-09-14T11:03:23.931+0000 7f62a3f2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:03:24.016 INFO:tasks.workunit.client.0.smithi097.stderr: -79> 2024-09-14T11:03:23.931+0000 7f62a3f2e800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:03:24.016 INFO:tasks.workunit.client.0.smithi097.stderr: -78> 2024-09-14T11:03:23.931+0000 7f62a3f2e800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:03:24.016 INFO:tasks.workunit.client.0.smithi097.stderr: -77> 2024-09-14T11:03:23.931+0000 7f62a3f2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:03:24.016 INFO:tasks.workunit.client.0.smithi097.stderr: -76> 2024-09-14T11:03:23.931+0000 7f62a3f2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:03:24.016 INFO:tasks.workunit.client.0.smithi097.stderr: -75> 2024-09-14T11:03:23.931+0000 7f62a3f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.016 INFO:tasks.workunit.client.0.smithi097.stderr: -74> 2024-09-14T11:03:23.931+0000 7f62a3f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:24.016 INFO:tasks.workunit.client.0.smithi097.stderr: -73> 2024-09-14T11:03:23.931+0000 7f62a3f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.016 INFO:tasks.workunit.client.0.smithi097.stderr: -72> 2024-09-14T11:03:23.931+0000 7f62a3f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:24.016 INFO:tasks.workunit.client.0.smithi097.stderr: -71> 2024-09-14T11:03:23.931+0000 7f62a3f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.016 INFO:tasks.workunit.client.0.smithi097.stderr: -70> 2024-09-14T11:03:23.932+0000 7f62a3f2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:03:24.016 INFO:tasks.workunit.client.0.smithi097.stderr: -69> 2024-09-14T11:03:23.932+0000 7f62a3f2e800 20 zone default found 2024-09-14T11:03:24.016 INFO:tasks.workunit.client.0.smithi097.stderr: -68> 2024-09-14T11:03:23.932+0000 7f62a3f2e800 4 Realm: () 2024-09-14T11:03:24.016 INFO:tasks.workunit.client.0.smithi097.stderr: -67> 2024-09-14T11:03:23.932+0000 7f62a3f2e800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:03:24.016 INFO:tasks.workunit.client.0.smithi097.stderr: -66> 2024-09-14T11:03:23.932+0000 7f62a3f2e800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:03:24.017 INFO:tasks.workunit.client.0.smithi097.stderr: -65> 2024-09-14T11:03:23.932+0000 7f62a3f2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:03:24.017 INFO:tasks.workunit.client.0.smithi097.stderr: -64> 2024-09-14T11:03:23.932+0000 7f62a3f2e800 20 zonegroup default 2024-09-14T11:03:24.017 INFO:tasks.workunit.client.0.smithi097.stderr: -63> 2024-09-14T11:03:23.932+0000 7f62a3f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.017 INFO:tasks.workunit.client.0.smithi097.stderr: -62> 2024-09-14T11:03:23.932+0000 7f62a3f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:24.017 INFO:tasks.workunit.client.0.smithi097.stderr: -61> 2024-09-14T11:03:23.932+0000 7f62a3f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.017 INFO:tasks.workunit.client.0.smithi097.stderr: -60> 2024-09-14T11:03:23.932+0000 7f62a3f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:24.017 INFO:tasks.workunit.client.0.smithi097.stderr: -59> 2024-09-14T11:03:23.932+0000 7f62a3f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.017 INFO:tasks.workunit.client.0.smithi097.stderr: -58> 2024-09-14T11:03:23.932+0000 7f62a3f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:24.017 INFO:tasks.workunit.client.0.smithi097.stderr: -57> 2024-09-14T11:03:23.932+0000 7f62a3f2e800 20 started sync module instance, tier type = 2024-09-14T11:03:24.017 INFO:tasks.workunit.client.0.smithi097.stderr: -56> 2024-09-14T11:03:23.932+0000 7f62a3f2e800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:03:24.017 INFO:tasks.workunit.client.0.smithi097.stderr: -55> 2024-09-14T11:03:23.941+0000 7f62a3f2e800 20 add_watcher() i=0 2024-09-14T11:03:24.017 INFO:tasks.workunit.client.0.smithi097.stderr: -54> 2024-09-14T11:03:23.941+0000 7f62a3f2e800 20 add_watcher() i=1 2024-09-14T11:03:24.017 INFO:tasks.workunit.client.0.smithi097.stderr: -53> 2024-09-14T11:03:23.941+0000 7f62a3f2e800 20 add_watcher() i=2 2024-09-14T11:03:24.018 INFO:tasks.workunit.client.0.smithi097.stderr: -52> 2024-09-14T11:03:23.941+0000 7f62a3f2e800 20 add_watcher() i=3 2024-09-14T11:03:24.018 INFO:tasks.workunit.client.0.smithi097.stderr: -51> 2024-09-14T11:03:23.941+0000 7f62a3f2e800 20 add_watcher() i=4 2024-09-14T11:03:24.018 INFO:tasks.workunit.client.0.smithi097.stderr: -50> 2024-09-14T11:03:23.941+0000 7f62a3f2e800 20 add_watcher() i=5 2024-09-14T11:03:24.018 INFO:tasks.workunit.client.0.smithi097.stderr: -49> 2024-09-14T11:03:23.941+0000 7f62a3f2e800 20 add_watcher() i=6 2024-09-14T11:03:24.018 INFO:tasks.workunit.client.0.smithi097.stderr: -48> 2024-09-14T11:03:23.942+0000 7f62a3f2e800 20 add_watcher() i=7 2024-09-14T11:03:24.018 INFO:tasks.workunit.client.0.smithi097.stderr: -47> 2024-09-14T11:03:23.942+0000 7f62a3f2e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:03:24.018 INFO:tasks.workunit.client.0.smithi097.stderr: -46> 2024-09-14T11:03:23.943+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f600) adding auth protocol: cephx 2024-09-14T11:03:24.018 INFO:tasks.workunit.client.0.smithi097.stderr: -45> 2024-09-14T11:03:23.943+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f600) adding auth protocol: cephx 2024-09-14T11:03:24.018 INFO:tasks.workunit.client.0.smithi097.stderr: -44> 2024-09-14T11:03:23.943+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f600) adding auth protocol: cephx 2024-09-14T11:03:24.018 INFO:tasks.workunit.client.0.smithi097.stderr: -43> 2024-09-14T11:03:23.943+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f600) adding con mode: secure 2024-09-14T11:03:24.018 INFO:tasks.workunit.client.0.smithi097.stderr: -42> 2024-09-14T11:03:23.943+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f600) adding con mode: crc 2024-09-14T11:03:24.018 INFO:tasks.workunit.client.0.smithi097.stderr: -41> 2024-09-14T11:03:23.943+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f600) adding con mode: secure 2024-09-14T11:03:24.018 INFO:tasks.workunit.client.0.smithi097.stderr: -40> 2024-09-14T11:03:23.943+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f600) adding con mode: crc 2024-09-14T11:03:24.018 INFO:tasks.workunit.client.0.smithi097.stderr: -39> 2024-09-14T11:03:23.943+0000 7f61567e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:24.019 INFO:tasks.workunit.client.0.smithi097.stderr: -38> 2024-09-14T11:03:23.943+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f600) adding con mode: secure 2024-09-14T11:03:24.019 INFO:tasks.workunit.client.0.smithi097.stderr: -37> 2024-09-14T11:03:23.943+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f600) adding con mode: crc 2024-09-14T11:03:24.019 INFO:tasks.workunit.client.0.smithi097.stderr: -36> 2024-09-14T11:03:23.943+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f600) adding con mode: crc 2024-09-14T11:03:24.019 INFO:tasks.workunit.client.0.smithi097.stderr: -35> 2024-09-14T11:03:23.943+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f600) adding con mode: secure 2024-09-14T11:03:24.019 INFO:tasks.workunit.client.0.smithi097.stderr: -34> 2024-09-14T11:03:23.943+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f600) adding con mode: crc 2024-09-14T11:03:24.019 INFO:tasks.workunit.client.0.smithi097.stderr: -33> 2024-09-14T11:03:23.943+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f600) adding con mode: secure 2024-09-14T11:03:24.019 INFO:tasks.workunit.client.0.smithi097.stderr: -32> 2024-09-14T11:03:23.943+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f600) adding con mode: crc 2024-09-14T11:03:24.019 INFO:tasks.workunit.client.0.smithi097.stderr: -31> 2024-09-14T11:03:23.943+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f600) adding con mode: secure 2024-09-14T11:03:24.019 INFO:tasks.workunit.client.0.smithi097.stderr: -30> 2024-09-14T11:03:23.944+0000 7f62a3f2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:24.019 INFO:tasks.workunit.client.0.smithi097.stderr: -29> 2024-09-14T11:03:23.944+0000 7f62a3f2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:03:24.019 INFO:tasks.workunit.client.0.smithi097.stderr: -28> 2024-09-14T11:03:23.944+0000 7f62a3f2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:03:24.019 INFO:tasks.workunit.client.0.smithi097.stderr: -27> 2024-09-14T11:03:23.944+0000 7f62a3f2e800 5 asok(0x561cb6ddc270) register_command cache list hook 0x561cb70c7a90 2024-09-14T11:03:24.019 INFO:tasks.workunit.client.0.smithi097.stderr: -26> 2024-09-14T11:03:23.944+0000 7f62a3f2e800 5 asok(0x561cb6ddc270) register_command cache inspect hook 0x561cb70c7a90 2024-09-14T11:03:24.020 INFO:tasks.workunit.client.0.smithi097.stderr: -25> 2024-09-14T11:03:23.944+0000 7f62a3f2e800 5 asok(0x561cb6ddc270) register_command cache erase hook 0x561cb70c7a90 2024-09-14T11:03:24.020 INFO:tasks.workunit.client.0.smithi097.stderr: -24> 2024-09-14T11:03:23.944+0000 7f62a3f2e800 5 asok(0x561cb6ddc270) register_command cache zap hook 0x561cb70c7a90 2024-09-14T11:03:24.020 INFO:tasks.workunit.client.0.smithi097.stderr: -23> 2024-09-14T11:03:23.944+0000 7f62a3f2e800 5 note: GC not initialized 2024-09-14T11:03:24.020 INFO:tasks.workunit.client.0.smithi097.stderr: -22> 2024-09-14T11:03:23.944+0000 7f61557e2640 20 reqs_thread_entry: start 2024-09-14T11:03:24.020 INFO:tasks.workunit.client.0.smithi097.stderr: -21> 2024-09-14T11:03:23.944+0000 7f62a3f2e800 5 asok(0x561cb6ddc270) register_command sync trace show hook 0x7f62940043a0 2024-09-14T11:03:24.020 INFO:tasks.workunit.client.0.smithi097.stderr: -20> 2024-09-14T11:03:23.944+0000 7f62a3f2e800 5 asok(0x561cb6ddc270) register_command sync trace history hook 0x7f62940043a0 2024-09-14T11:03:24.020 INFO:tasks.workunit.client.0.smithi097.stderr: -19> 2024-09-14T11:03:23.944+0000 7f62a3f2e800 5 asok(0x561cb6ddc270) register_command sync trace active hook 0x7f62940043a0 2024-09-14T11:03:24.020 INFO:tasks.workunit.client.0.smithi097.stderr: -18> 2024-09-14T11:03:23.944+0000 7f62a3f2e800 5 asok(0x561cb6ddc270) register_command sync trace active_short hook 0x7f62940043a0 2024-09-14T11:03:24.020 INFO:tasks.workunit.client.0.smithi097.stderr: -17> 2024-09-14T11:03:23.944+0000 7f62a3f2e800 20 init_complete bucket index max shards: 11 2024-09-14T11:03:24.020 INFO:tasks.workunit.client.0.smithi097.stderr: -16> 2024-09-14T11:03:23.944+0000 7f62a3f2e800 20 Filter name: none 2024-09-14T11:03:24.020 INFO:tasks.workunit.client.0.smithi097.stderr: -15> 2024-09-14T11:03:23.944+0000 7f614e7fc640 20 reqs_thread_entry: start 2024-09-14T11:03:24.020 INFO:tasks.workunit.client.0.smithi097.stderr: -14> 2024-09-14T11:03:23.944+0000 7f62a3f2e800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:03:24.020 INFO:tasks.workunit.client.0.smithi097.stderr: -13> 2024-09-14T11:03:23.944+0000 7f62a3f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.020 INFO:tasks.workunit.client.0.smithi097.stderr: -12> 2024-09-14T11:03:23.944+0000 7f62a3f2e800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:03:24.021 INFO:tasks.workunit.client.0.smithi097.stderr: -11> 2024-09-14T11:03:23.944+0000 7f62a3f2e800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:03:24.021 INFO:tasks.workunit.client.0.smithi097.stderr: -10> 2024-09-14T11:03:23.944+0000 7f62a3f2e800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:03:24.021 INFO:tasks.workunit.client.0.smithi097.stderr: -9> 2024-09-14T11:03:23.944+0000 7f62a3f2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24 : miss 2024-09-14T11:03:24.021 INFO:tasks.workunit.client.0.smithi097.stderr: -8> 2024-09-14T11:03:23.944+0000 7f62a3f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.021 INFO:tasks.workunit.client.0.smithi097.stderr: -7> 2024-09-14T11:03:23.945+0000 7f62a3f2e800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:03:24.021 INFO:tasks.workunit.client.0.smithi097.stderr: -6> 2024-09-14T11:03:23.945+0000 7f62a3f2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24 info.flags=0x17 2024-09-14T11:03:24.021 INFO:tasks.workunit.client.0.smithi097.stderr: -5> 2024-09-14T11:03:23.945+0000 7f62a3f2e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24 to cache LRU end 2024-09-14T11:03:24.021 INFO:tasks.workunit.client.0.smithi097.stderr: -4> 2024-09-14T11:03:23.945+0000 7f62a3f2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:03:24.021 INFO:tasks.workunit.client.0.smithi097.stderr: -3> 2024-09-14T11:03:23.945+0000 7f62a3f2e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:24.021 INFO:tasks.workunit.client.0.smithi097.stderr: -2> 2024-09-14T11:03:23.945+0000 7f62a3f2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24 2024-09-14T11:03:24.021 INFO:tasks.workunit.client.0.smithi097.stderr: -1> 2024-09-14T11:03:23.950+0000 7f62a3f2e800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f62a3f2e800 time 2024-09-14T11:03:23.951128+0000 2024-09-14T11:03:24.021 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:03:24.021 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:24.022 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:03:24.022 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f62a578c76a] 2024-09-14T11:03:24.022 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f62a578c928] 2024-09-14T11:03:24.022 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561cb47320b1] 2024-09-14T11:03:24.022 INFO:tasks.workunit.client.0.smithi097.stderr: 4: radosgw-admin(+0xd88418) [0x561cb4c45418] 2024-09-14T11:03:24.022 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561cb4741efd] 2024-09-14T11:03:24.022 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-14T11:03:24.022 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f62a4429590] 2024-09-14T11:03:24.022 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-14T11:03:24.023 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-14T11:03:24.023 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:24.023 INFO:tasks.workunit.client.0.smithi097.stderr: 0> 2024-09-14T11:03:23.950+0000 7f62a3f2e800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:03:24.023 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f62a3f2e800 thread_name:radosgw-admin 2024-09-14T11:03:24.023 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:24.023 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:03:24.023 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f62a443e6f0] 2024-09-14T11:03:24.023 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f62a448b99c] 2024-09-14T11:03:24.023 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-14T11:03:24.023 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-14T11:03:24.023 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f62a578c7c4] 2024-09-14T11:03:24.023 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f62a578c928] 2024-09-14T11:03:24.023 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561cb47320b1] 2024-09-14T11:03:24.024 INFO:tasks.workunit.client.0.smithi097.stderr: 8: radosgw-admin(+0xd88418) [0x561cb4c45418] 2024-09-14T11:03:24.024 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561cb4741efd] 2024-09-14T11:03:24.024 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-14T11:03:24.024 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f62a4429590] 2024-09-14T11:03:24.024 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-14T11:03:24.024 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-14T11:03:24.024 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:03:24.024 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:24.024 INFO:tasks.workunit.client.0.smithi097.stderr:--- logging levels --- 2024-09-14T11:03:24.024 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 none 2024-09-14T11:03:24.024 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 lockdep 2024-09-14T11:03:24.024 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 context 2024-09-14T11:03:24.024 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 crush 2024-09-14T11:03:24.024 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds 2024-09-14T11:03:24.025 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_balancer 2024-09-14T11:03:24.025 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_locker 2024-09-14T11:03:24.025 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log 2024-09-14T11:03:24.025 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log_expire 2024-09-14T11:03:24.025 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_migrator 2024-09-14T11:03:24.025 INFO:tasks.workunit.client.0.smithi097.stderr: 3/ 5 mds_quiesce 2024-09-14T11:03:24.025 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 buffer 2024-09-14T11:03:24.025 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 timer 2024-09-14T11:03:24.025 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 filer 2024-09-14T11:03:24.025 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 striper 2024-09-14T11:03:24.025 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 objecter 2024-09-14T11:03:24.025 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rados 2024-09-14T11:03:24.025 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd 2024-09-14T11:03:24.026 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_mirror 2024-09-14T11:03:24.026 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_replay 2024-09-14T11:03:24.026 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_pwl 2024-09-14T11:03:24.026 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 journaler 2024-09-14T11:03:24.026 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objectcacher 2024-09-14T11:03:24.026 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:03:24.026 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 client 2024-09-14T11:03:24.026 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 osd 2024-09-14T11:03:24.026 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 optracker 2024-09-14T11:03:24.026 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objclass 2024-09-14T11:03:24.026 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 filestore 2024-09-14T11:03:24.026 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 journal 2024-09-14T11:03:24.026 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 ms 2024-09-14T11:03:24.026 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mon 2024-09-14T11:03:24.027 INFO:tasks.workunit.client.0.smithi097.stderr: 0/10 monc 2024-09-14T11:03:24.027 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 paxos 2024-09-14T11:03:24.027 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 tp 2024-09-14T11:03:24.027 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 auth 2024-09-14T11:03:24.027 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 crypto 2024-09-14T11:03:24.027 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 finisher 2024-09-14T11:03:24.027 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 reserver 2024-09-14T11:03:24.027 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 heartbeatmap 2024-09-14T11:03:24.027 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 perfcounter 2024-09-14T11:03:24.027 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw 2024-09-14T11:03:24.027 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_sync 2024-09-14T11:03:24.027 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_datacache 2024-09-14T11:03:24.027 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_access 2024-09-14T11:03:24.027 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:03:24.028 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_flight 2024-09-14T11:03:24.028 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:03:24.028 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw_notification 2024-09-14T11:03:24.028 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 javaclient 2024-09-14T11:03:24.028 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 asok 2024-09-14T11:03:24.028 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 throttle 2024-09-14T11:03:24.028 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 refs 2024-09-14T11:03:24.028 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 compressor 2024-09-14T11:03:24.028 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluestore 2024-09-14T11:03:24.028 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluefs 2024-09-14T11:03:24.028 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 bdev 2024-09-14T11:03:24.028 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 kstore 2024-09-14T11:03:24.028 INFO:tasks.workunit.client.0.smithi097.stderr: 4/ 5 rocksdb 2024-09-14T11:03:24.029 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 fuse 2024-09-14T11:03:24.029 INFO:tasks.workunit.client.0.smithi097.stderr: 2/ 5 mgr 2024-09-14T11:03:24.029 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mgrc 2024-09-14T11:03:24.029 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 dpdk 2024-09-14T11:03:24.029 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 eventtrace 2024-09-14T11:03:24.029 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 prioritycache 2024-09-14T11:03:24.029 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 test 2024-09-14T11:03:24.029 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:03:24.029 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephsqlite 2024-09-14T11:03:24.029 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:03:24.029 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore 2024-09-14T11:03:24.029 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_onode 2024-09-14T11:03:24.029 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_odata 2024-09-14T11:03:24.029 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_omap 2024-09-14T11:03:24.030 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_tm 2024-09-14T11:03:24.030 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_t 2024-09-14T11:03:24.030 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:03:24.030 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_epm 2024-09-14T11:03:24.030 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_lba 2024-09-14T11:03:24.030 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:03:24.030 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cache 2024-09-14T11:03:24.030 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_journal 2024-09-14T11:03:24.030 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_device 2024-09-14T11:03:24.030 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_backref 2024-09-14T11:03:24.030 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 alienstore 2024-09-14T11:03:24.030 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mclock 2024-09-14T11:03:24.030 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cyanstore 2024-09-14T11:03:24.030 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 ceph_exporter 2024-09-14T11:03:24.031 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 memstore 2024-09-14T11:03:24.031 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 trace 2024-09-14T11:03:24.031 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 ceph_dedup 2024-09-14T11:03:24.031 INFO:tasks.workunit.client.0.smithi097.stderr: -2/-2 (syslog threshold) 2024-09-14T11:03:24.031 INFO:tasks.workunit.client.0.smithi097.stderr: 99/99 (stderr threshold) 2024-09-14T11:03:24.031 INFO:tasks.workunit.client.0.smithi097.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:03:24.031 INFO:tasks.workunit.client.0.smithi097.stderr: 7f614e7fc640 / http_manager 2024-09-14T11:03:24.031 INFO:tasks.workunit.client.0.smithi097.stderr: 7f61557e2640 / http_manager 2024-09-14T11:03:24.031 INFO:tasks.workunit.client.0.smithi097.stderr: 7f61567e4640 / rgw_dt_lg_renew 2024-09-14T11:03:24.031 INFO:tasks.workunit.client.0.smithi097.stderr: 7f617d7fa640 / ms_dispatch 2024-09-14T11:03:24.031 INFO:tasks.workunit.client.0.smithi097.stderr: 7f617effd640 / io_context_pool 2024-09-14T11:03:24.031 INFO:tasks.workunit.client.0.smithi097.stderr: 7f61857fa640 / ms_dispatch 2024-09-14T11:03:24.031 INFO:tasks.workunit.client.0.smithi097.stderr: 7f6187fff640 / ms_dispatch 2024-09-14T11:03:24.032 INFO:tasks.workunit.client.0.smithi097.stderr: 7f618de0b640 / io_context_pool 2024-09-14T11:03:24.032 INFO:tasks.workunit.client.0.smithi097.stderr: 7f629f4dc640 / msgr-worker-2 2024-09-14T11:03:24.032 INFO:tasks.workunit.client.0.smithi097.stderr: 7f629fcdd640 / msgr-worker-1 2024-09-14T11:03:24.032 INFO:tasks.workunit.client.0.smithi097.stderr: 7f62a04de640 / msgr-worker-0 2024-09-14T11:03:24.032 INFO:tasks.workunit.client.0.smithi097.stderr: 7f62a0cdf640 / io_context_pool 2024-09-14T11:03:24.032 INFO:tasks.workunit.client.0.smithi097.stderr: 7f62a3f2e800 / radosgw-admin 2024-09-14T11:03:24.032 INFO:tasks.workunit.client.0.smithi097.stderr: max_recent 500 2024-09-14T11:03:24.032 INFO:tasks.workunit.client.0.smithi097.stderr: max_new 1000 2024-09-14T11:03:24.032 INFO:tasks.workunit.client.0.smithi097.stderr: log_file /var/log/ceph/ceph-client.admin.99193.log 2024-09-14T11:03:24.032 INFO:tasks.workunit.client.0.smithi097.stderr:--- end dump of recent events --- 2024-09-14T11:03:24.032 INFO:tasks.workunit.client.0.smithi097.stderr:--- begin dump of recent events --- 2024-09-14T11:03:24.032 INFO:tasks.workunit.client.0.smithi097.stderr: -499> 2024-09-14T11:03:23.496+0000 7f629fcdd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:03:24.032 INFO:tasks.workunit.client.0.smithi097.stderr: -498> 2024-09-14T11:03:23.496+0000 7f629f4dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:03:24.032 INFO:tasks.workunit.client.0.smithi097.stderr: -497> 2024-09-14T11:03:23.496+0000 7f629f4dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:03:24.033 INFO:tasks.workunit.client.0.smithi097.stderr: -496> 2024-09-14T11:03:23.496+0000 7f629f4dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:03:24.033 INFO:tasks.workunit.client.0.smithi097.stderr: -495> 2024-09-14T11:03:23.497+0000 7f62a04de640 10 monclient(hunting): get_auth_request con 0x561cb7025140 auth_method 0 2024-09-14T11:03:24.033 INFO:tasks.workunit.client.0.smithi097.stderr: -494> 2024-09-14T11:03:23.497+0000 7f62a04de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:03:24.033 INFO:tasks.workunit.client.0.smithi097.stderr: -493> 2024-09-14T11:03:23.497+0000 7f62a04de640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:03:24.033 INFO:tasks.workunit.client.0.smithi097.stderr: -492> 2024-09-14T11:03:23.497+0000 7f62a04de640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:03:24.033 INFO:tasks.workunit.client.0.smithi097.stderr: -491> 2024-09-14T11:03:23.497+0000 7f62a04de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:03:24.033 INFO:tasks.workunit.client.0.smithi097.stderr: -490> 2024-09-14T11:03:23.497+0000 7f62a04de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:03:24.033 INFO:tasks.workunit.client.0.smithi097.stderr: -489> 2024-09-14T11:03:23.497+0000 7f62a04de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:03:24.033 INFO:tasks.workunit.client.0.smithi097.stderr: -488> 2024-09-14T11:03:23.497+0000 7f629f4dc640 10 monclient(hunting): handle_auth_done global_id 6630 payload 274 2024-09-14T11:03:24.033 INFO:tasks.workunit.client.0.smithi097.stderr: -487> 2024-09-14T11:03:23.497+0000 7f629f4dc640 10 monclient: _finish_hunting 0 2024-09-14T11:03:24.033 INFO:tasks.workunit.client.0.smithi097.stderr: -486> 2024-09-14T11:03:23.497+0000 7f629f4dc640 1 monclient: found mon.noname-a 2024-09-14T11:03:24.033 INFO:tasks.workunit.client.0.smithi097.stderr: -485> 2024-09-14T11:03:23.497+0000 7f629f4dc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-14T11:03:24.033 INFO:tasks.workunit.client.0.smithi097.stderr: -484> 2024-09-14T11:03:23.497+0000 7f618de0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:03:24.034 INFO:tasks.workunit.client.0.smithi097.stderr: -483> 2024-09-14T11:03:23.497+0000 7f618de0b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:03:24.034 INFO:tasks.workunit.client.0.smithi097.stderr: -482> 2024-09-14T11:03:23.497+0000 7f618de0b640 10 monclient: dump: 2024-09-14T11:03:24.034 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:03:24.034 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:03:24.034 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:24.034 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:24.034 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:03:24.034 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:03:24.034 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:03:24.034 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:03:24.034 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:03:24.034 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:24.034 INFO:tasks.workunit.client.0.smithi097.stderr: -481> 2024-09-14T11:03:23.497+0000 7f618de0b640 10 monclient: _finish_auth 0 2024-09-14T11:03:24.034 INFO:tasks.workunit.client.0.smithi097.stderr: -480> 2024-09-14T11:03:23.497+0000 7f618de0b640 10 monclient: _check_auth_tickets 2024-09-14T11:03:24.035 INFO:tasks.workunit.client.0.smithi097.stderr: -479> 2024-09-14T11:03:23.497+0000 7f618de0b640 10 monclient: handle_config config(0 keys) 2024-09-14T11:03:24.035 INFO:tasks.workunit.client.0.smithi097.stderr: -478> 2024-09-14T11:03:23.497+0000 7f618de0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:03:24.035 INFO:tasks.workunit.client.0.smithi097.stderr: -477> 2024-09-14T11:03:23.497+0000 7f618de0b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:03:24.035 INFO:tasks.workunit.client.0.smithi097.stderr: -476> 2024-09-14T11:03:23.497+0000 7f618de0b640 10 monclient: dump: 2024-09-14T11:03:24.035 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:03:24.035 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:03:24.035 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:24.035 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:24.035 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:03:24.035 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:03:24.036 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:03:24.036 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:03:24.036 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:03:24.036 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:24.036 INFO:tasks.workunit.client.0.smithi097.stderr: -475> 2024-09-14T11:03:23.497+0000 7f62a3f2e800 5 monclient: authenticate success, global_id 6630 2024-09-14T11:03:24.036 INFO:tasks.workunit.client.0.smithi097.stderr: -474> 2024-09-14T11:03:23.497+0000 7f62a3f2e800 10 monclient: get_monmap_and_config success 2024-09-14T11:03:24.036 INFO:tasks.workunit.client.0.smithi097.stderr: -473> 2024-09-14T11:03:23.497+0000 7f62a3f2e800 4 set_mon_vals no callback set 2024-09-14T11:03:24.036 INFO:tasks.workunit.client.0.smithi097.stderr: -472> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 10 monclient: shutdown 2024-09-14T11:03:24.037 INFO:tasks.workunit.client.0.smithi097.stderr: -471> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 asok(0x561cb6ddc270) unregister_commands rotate-key 2024-09-14T11:03:24.037 INFO:tasks.workunit.client.0.smithi097.stderr: -470> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 10 monclient: build_initial_monmap 2024-09-14T11:03:24.037 INFO:tasks.workunit.client.0.smithi097.stderr: -469> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 1 build_initial for_mkfs: 0 2024-09-14T11:03:24.037 INFO:tasks.workunit.client.0.smithi097.stderr: -468> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 10 monclient: monmap: 2024-09-14T11:03:24.037 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:03:24.037 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:03:24.037 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:03:24.037 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:03:24.038 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:03:24.038 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:03:24.038 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:03:24.038 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:03:24.038 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:03:24.038 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:24.038 INFO:tasks.workunit.client.0.smithi097.stderr: -467> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70010c0) adding auth protocol: cephx 2024-09-14T11:03:24.038 INFO:tasks.workunit.client.0.smithi097.stderr: -466> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70010c0) adding auth protocol: cephx 2024-09-14T11:03:24.038 INFO:tasks.workunit.client.0.smithi097.stderr: -465> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70010c0) adding auth protocol: cephx 2024-09-14T11:03:24.038 INFO:tasks.workunit.client.0.smithi097.stderr: -464> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70010c0) adding con mode: secure 2024-09-14T11:03:24.038 INFO:tasks.workunit.client.0.smithi097.stderr: -463> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70010c0) adding con mode: crc 2024-09-14T11:03:24.038 INFO:tasks.workunit.client.0.smithi097.stderr: -462> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70010c0) adding con mode: secure 2024-09-14T11:03:24.038 INFO:tasks.workunit.client.0.smithi097.stderr: -461> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70010c0) adding con mode: crc 2024-09-14T11:03:24.038 INFO:tasks.workunit.client.0.smithi097.stderr: -460> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70010c0) adding con mode: secure 2024-09-14T11:03:24.039 INFO:tasks.workunit.client.0.smithi097.stderr: -459> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70010c0) adding con mode: crc 2024-09-14T11:03:24.039 INFO:tasks.workunit.client.0.smithi097.stderr: -458> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70010c0) adding con mode: crc 2024-09-14T11:03:24.039 INFO:tasks.workunit.client.0.smithi097.stderr: -457> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70010c0) adding con mode: secure 2024-09-14T11:03:24.039 INFO:tasks.workunit.client.0.smithi097.stderr: -456> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70010c0) adding con mode: crc 2024-09-14T11:03:24.039 INFO:tasks.workunit.client.0.smithi097.stderr: -455> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70010c0) adding con mode: secure 2024-09-14T11:03:24.039 INFO:tasks.workunit.client.0.smithi097.stderr: -454> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70010c0) adding con mode: crc 2024-09-14T11:03:24.039 INFO:tasks.workunit.client.0.smithi097.stderr: -453> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70010c0) adding con mode: secure 2024-09-14T11:03:24.039 INFO:tasks.workunit.client.0.smithi097.stderr: -452> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:24.039 INFO:tasks.workunit.client.0.smithi097.stderr: -451> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 1 librados: starting msgr at 2024-09-14T11:03:24.039 INFO:tasks.workunit.client.0.smithi097.stderr: -450> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 1 librados: starting objecter 2024-09-14T11:03:24.039 INFO:tasks.workunit.client.0.smithi097.stderr: -449> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 asok(0x561cb6ddc270) register_command objecter_requests hook 0x561cb6ffcec0 2024-09-14T11:03:24.039 INFO:tasks.workunit.client.0.smithi097.stderr: -448> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 1 librados: setting wanted keys 2024-09-14T11:03:24.039 INFO:tasks.workunit.client.0.smithi097.stderr: -447> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 1 librados: calling monclient init 2024-09-14T11:03:24.040 INFO:tasks.workunit.client.0.smithi097.stderr: -446> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 10 monclient: init 2024-09-14T11:03:24.040 INFO:tasks.workunit.client.0.smithi097.stderr: -445> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb6ffb3b0) adding auth protocol: cephx 2024-09-14T11:03:24.040 INFO:tasks.workunit.client.0.smithi097.stderr: -444> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb6ffb3b0) adding auth protocol: cephx 2024-09-14T11:03:24.040 INFO:tasks.workunit.client.0.smithi097.stderr: -443> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb6ffb3b0) adding auth protocol: cephx 2024-09-14T11:03:24.040 INFO:tasks.workunit.client.0.smithi097.stderr: -442> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb6ffb3b0) adding con mode: secure 2024-09-14T11:03:24.040 INFO:tasks.workunit.client.0.smithi097.stderr: -441> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb6ffb3b0) adding con mode: crc 2024-09-14T11:03:24.040 INFO:tasks.workunit.client.0.smithi097.stderr: -440> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb6ffb3b0) adding con mode: secure 2024-09-14T11:03:24.040 INFO:tasks.workunit.client.0.smithi097.stderr: -439> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb6ffb3b0) adding con mode: crc 2024-09-14T11:03:24.040 INFO:tasks.workunit.client.0.smithi097.stderr: -438> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb6ffb3b0) adding con mode: secure 2024-09-14T11:03:24.040 INFO:tasks.workunit.client.0.smithi097.stderr: -437> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb6ffb3b0) adding con mode: crc 2024-09-14T11:03:24.040 INFO:tasks.workunit.client.0.smithi097.stderr: -436> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb6ffb3b0) adding con mode: crc 2024-09-14T11:03:24.040 INFO:tasks.workunit.client.0.smithi097.stderr: -435> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb6ffb3b0) adding con mode: secure 2024-09-14T11:03:24.040 INFO:tasks.workunit.client.0.smithi097.stderr: -434> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb6ffb3b0) adding con mode: crc 2024-09-14T11:03:24.041 INFO:tasks.workunit.client.0.smithi097.stderr: -433> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb6ffb3b0) adding con mode: secure 2024-09-14T11:03:24.041 INFO:tasks.workunit.client.0.smithi097.stderr: -432> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb6ffb3b0) adding con mode: crc 2024-09-14T11:03:24.041 INFO:tasks.workunit.client.0.smithi097.stderr: -431> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 5 AuthRegistry(0x561cb6ffb3b0) adding con mode: secure 2024-09-14T11:03:24.041 INFO:tasks.workunit.client.0.smithi097.stderr: -430> 2024-09-14T11:03:23.498+0000 7f62a3f2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:24.041 INFO:tasks.workunit.client.0.smithi097.stderr: -429> 2024-09-14T11:03:23.499+0000 7f62a3f2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:24.041 INFO:tasks.workunit.client.0.smithi097.stderr: -428> 2024-09-14T11:03:23.499+0000 7f62a3f2e800 5 asok(0x561cb6ddc270) register_command rotate-key hook 0x561cb6ffb4f8 2024-09-14T11:03:24.041 INFO:tasks.workunit.client.0.smithi097.stderr: -427> 2024-09-14T11:03:23.499+0000 7f62a3f2e800 10 monclient: _reopen_session rank -1 2024-09-14T11:03:24.041 INFO:tasks.workunit.client.0.smithi097.stderr: -426> 2024-09-14T11:03:23.499+0000 7f62a3f2e800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:03:24.041 INFO:tasks.workunit.client.0.smithi097.stderr: -425> 2024-09-14T11:03:23.499+0000 7f62a3f2e800 10 monclient(hunting): picked mon.noname-b con 0x561cb7002400 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:03:24.041 INFO:tasks.workunit.client.0.smithi097.stderr: -424> 2024-09-14T11:03:23.499+0000 7f62a3f2e800 10 monclient(hunting): picked mon.noname-c con 0x561cb7025140 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:03:24.041 INFO:tasks.workunit.client.0.smithi097.stderr: -423> 2024-09-14T11:03:23.499+0000 7f62a3f2e800 10 monclient(hunting): picked mon.noname-a con 0x7f6288003c90 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:03:24.041 INFO:tasks.workunit.client.0.smithi097.stderr: -422> 2024-09-14T11:03:23.499+0000 7f62a3f2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:03:24.041 INFO:tasks.workunit.client.0.smithi097.stderr: -421> 2024-09-14T11:03:23.499+0000 7f62a3f2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:03:24.041 INFO:tasks.workunit.client.0.smithi097.stderr: -420> 2024-09-14T11:03:23.499+0000 7f62a3f2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:03:24.042 INFO:tasks.workunit.client.0.smithi097.stderr: -419> 2024-09-14T11:03:23.499+0000 7f62a3f2e800 10 monclient(hunting): _renew_subs 2024-09-14T11:03:24.042 INFO:tasks.workunit.client.0.smithi097.stderr: -418> 2024-09-14T11:03:23.499+0000 7f62a3f2e800 10 monclient(hunting): authenticate will time out at 1885.153185s 2024-09-14T11:03:24.042 INFO:tasks.workunit.client.0.smithi097.stderr: -417> 2024-09-14T11:03:23.499+0000 7f629f4dc640 10 monclient(hunting): get_auth_request con 0x561cb7025140 auth_method 0 2024-09-14T11:03:24.042 INFO:tasks.workunit.client.0.smithi097.stderr: -416> 2024-09-14T11:03:23.499+0000 7f629f4dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:03:24.042 INFO:tasks.workunit.client.0.smithi097.stderr: -415> 2024-09-14T11:03:23.499+0000 7f629f4dc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:03:24.042 INFO:tasks.workunit.client.0.smithi097.stderr: -414> 2024-09-14T11:03:23.499+0000 7f629f4dc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:03:24.042 INFO:tasks.workunit.client.0.smithi097.stderr: -413> 2024-09-14T11:03:23.499+0000 7f62a04de640 10 monclient(hunting): get_auth_request con 0x7f6288003c90 auth_method 0 2024-09-14T11:03:24.042 INFO:tasks.workunit.client.0.smithi097.stderr: -412> 2024-09-14T11:03:23.499+0000 7f62a04de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:03:24.042 INFO:tasks.workunit.client.0.smithi097.stderr: -411> 2024-09-14T11:03:23.499+0000 7f62a04de640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:03:24.042 INFO:tasks.workunit.client.0.smithi097.stderr: -410> 2024-09-14T11:03:23.499+0000 7f62a04de640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:03:24.042 INFO:tasks.workunit.client.0.smithi097.stderr: -409> 2024-09-14T11:03:23.499+0000 7f629f4dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:03:24.042 INFO:tasks.workunit.client.0.smithi097.stderr: -408> 2024-09-14T11:03:23.499+0000 7f629f4dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:03:24.042 INFO:tasks.workunit.client.0.smithi097.stderr: -407> 2024-09-14T11:03:23.499+0000 7f629f4dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:03:24.042 INFO:tasks.workunit.client.0.smithi097.stderr: -406> 2024-09-14T11:03:23.499+0000 7f62a04de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:03:24.043 INFO:tasks.workunit.client.0.smithi097.stderr: -405> 2024-09-14T11:03:23.499+0000 7f62a04de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:03:24.043 INFO:tasks.workunit.client.0.smithi097.stderr: -404> 2024-09-14T11:03:23.499+0000 7f62a04de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:03:24.043 INFO:tasks.workunit.client.0.smithi097.stderr: -403> 2024-09-14T11:03:23.499+0000 7f629fcdd640 10 monclient(hunting): get_auth_request con 0x561cb7002400 auth_method 0 2024-09-14T11:03:24.043 INFO:tasks.workunit.client.0.smithi097.stderr: -402> 2024-09-14T11:03:23.499+0000 7f629fcdd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:03:24.043 INFO:tasks.workunit.client.0.smithi097.stderr: -401> 2024-09-14T11:03:23.499+0000 7f629fcdd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:03:24.043 INFO:tasks.workunit.client.0.smithi097.stderr: -400> 2024-09-14T11:03:23.499+0000 7f629fcdd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:03:24.043 INFO:tasks.workunit.client.0.smithi097.stderr: -399> 2024-09-14T11:03:23.499+0000 7f629fcdd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:03:24.043 INFO:tasks.workunit.client.0.smithi097.stderr: -398> 2024-09-14T11:03:23.499+0000 7f629fcdd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:03:24.043 INFO:tasks.workunit.client.0.smithi097.stderr: -397> 2024-09-14T11:03:23.499+0000 7f629fcdd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:03:24.043 INFO:tasks.workunit.client.0.smithi097.stderr: -396> 2024-09-14T11:03:23.499+0000 7f629f4dc640 10 monclient(hunting): handle_auth_done global_id 6290 payload 824 2024-09-14T11:03:24.043 INFO:tasks.workunit.client.0.smithi097.stderr: -395> 2024-09-14T11:03:23.499+0000 7f629f4dc640 10 monclient: _finish_hunting 0 2024-09-14T11:03:24.043 INFO:tasks.workunit.client.0.smithi097.stderr: -394> 2024-09-14T11:03:23.499+0000 7f629f4dc640 1 monclient: found mon.noname-c 2024-09-14T11:03:24.043 INFO:tasks.workunit.client.0.smithi097.stderr: -393> 2024-09-14T11:03:23.499+0000 7f629f4dc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:03:24.044 INFO:tasks.workunit.client.0.smithi097.stderr: -392> 2024-09-14T11:03:23.499+0000 7f6187fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:03:24.044 INFO:tasks.workunit.client.0.smithi097.stderr: -391> 2024-09-14T11:03:23.499+0000 7f6187fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:03:24.044 INFO:tasks.workunit.client.0.smithi097.stderr: -390> 2024-09-14T11:03:23.499+0000 7f6187fff640 10 monclient: dump: 2024-09-14T11:03:24.044 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:03:24.044 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:03:24.044 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:24.044 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:24.044 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:03:24.044 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:03:24.044 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:03:24.044 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:03:24.044 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:03:24.044 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:24.045 INFO:tasks.workunit.client.0.smithi097.stderr: -389> 2024-09-14T11:03:23.499+0000 7f6187fff640 10 monclient: _finish_auth 0 2024-09-14T11:03:24.045 INFO:tasks.workunit.client.0.smithi097.stderr: -388> 2024-09-14T11:03:23.499+0000 7f6187fff640 10 monclient: _check_auth_tickets 2024-09-14T11:03:24.045 INFO:tasks.workunit.client.0.smithi097.stderr: -387> 2024-09-14T11:03:23.499+0000 7f6187fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:03:24.045 INFO:tasks.workunit.client.0.smithi097.stderr: -386> 2024-09-14T11:03:23.499+0000 7f6187fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:03:24.045 INFO:tasks.workunit.client.0.smithi097.stderr: -385> 2024-09-14T11:03:23.499+0000 7f6187fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:03:24.045 INFO:tasks.workunit.client.0.smithi097.stderr: -384> 2024-09-14T11:03:23.499+0000 7f6187fff640 10 monclient: dump: 2024-09-14T11:03:24.045 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:03:24.045 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:03:24.045 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:24.045 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:24.045 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:03:24.045 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:03:24.045 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:03:24.046 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:03:24.046 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:03:24.046 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:24.046 INFO:tasks.workunit.client.0.smithi097.stderr: -383> 2024-09-14T11:03:23.499+0000 7f62a3f2e800 5 monclient: authenticate success, global_id 6290 2024-09-14T11:03:24.046 INFO:tasks.workunit.client.0.smithi097.stderr: -382> 2024-09-14T11:03:23.499+0000 7f62a3f2e800 10 monclient: _renew_subs 2024-09-14T11:03:24.046 INFO:tasks.workunit.client.0.smithi097.stderr: -381> 2024-09-14T11:03:23.499+0000 7f62a3f2e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:03:24.046 INFO:tasks.workunit.client.0.smithi097.stderr: -380> 2024-09-14T11:03:23.499+0000 7f618de0b640 4 set_mon_vals no callback set 2024-09-14T11:03:24.046 INFO:tasks.workunit.client.0.smithi097.stderr: -379> 2024-09-14T11:03:23.499+0000 7f62a3f2e800 10 monclient: _renew_subs 2024-09-14T11:03:24.046 INFO:tasks.workunit.client.0.smithi097.stderr: -378> 2024-09-14T11:03:23.499+0000 7f62a3f2e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:03:24.046 INFO:tasks.workunit.client.0.smithi097.stderr: -377> 2024-09-14T11:03:23.499+0000 7f62a3f2e800 1 librados: init done 2024-09-14T11:03:24.046 INFO:tasks.workunit.client.0.smithi097.stderr: -376> 2024-09-14T11:03:23.501+0000 7f6187fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:03:24.046 INFO:tasks.workunit.client.0.smithi097.stderr: -375> 2024-09-14T11:03:23.501+0000 7f6187fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:03:24.046 INFO:tasks.workunit.client.0.smithi097.stderr: -374> 2024-09-14T11:03:23.501+0000 7f6187fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:03:24.046 INFO:tasks.workunit.client.0.smithi097.stderr: -373> 2024-09-14T11:03:23.501+0000 7f629fcdd640 10 monclient: get_auth_request con 0x7f6188077230 auth_method 0 2024-09-14T11:03:24.047 INFO:tasks.workunit.client.0.smithi097.stderr: -372> 2024-09-14T11:03:23.502+0000 7f62a04de640 10 monclient: get_auth_request con 0x561cb7024490 auth_method 0 2024-09-14T11:03:24.047 INFO:tasks.workunit.client.0.smithi097.stderr: -371> 2024-09-14T11:03:23.503+0000 7f629fcdd640 10 monclient: get_auth_request con 0x561cb7047600 auth_method 0 2024-09-14T11:03:24.047 INFO:tasks.workunit.client.0.smithi097.stderr: -370> 2024-09-14T11:03:23.503+0000 7f629f4dc640 10 monclient: get_auth_request con 0x561cb704b9f0 auth_method 0 2024-09-14T11:03:24.047 INFO:tasks.workunit.client.0.smithi097.stderr: -369> 2024-09-14T11:03:23.504+0000 7f62a04de640 10 monclient: get_auth_request con 0x561cb704fef0 auth_method 0 2024-09-14T11:03:24.047 INFO:tasks.workunit.client.0.smithi097.stderr: -368> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 10 monclient: build_initial_monmap 2024-09-14T11:03:24.047 INFO:tasks.workunit.client.0.smithi097.stderr: -367> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 1 build_initial for_mkfs: 0 2024-09-14T11:03:24.047 INFO:tasks.workunit.client.0.smithi097.stderr: -366> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 10 monclient: monmap: 2024-09-14T11:03:24.047 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:03:24.047 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:03:24.047 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:03:24.047 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:03:24.047 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:03:24.047 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:03:24.047 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:03:24.048 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:03:24.048 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:03:24.048 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:24.048 INFO:tasks.workunit.client.0.smithi097.stderr: -365> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7053c30) adding auth protocol: cephx 2024-09-14T11:03:24.048 INFO:tasks.workunit.client.0.smithi097.stderr: -364> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7053c30) adding auth protocol: cephx 2024-09-14T11:03:24.048 INFO:tasks.workunit.client.0.smithi097.stderr: -363> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7053c30) adding auth protocol: cephx 2024-09-14T11:03:24.048 INFO:tasks.workunit.client.0.smithi097.stderr: -362> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7053c30) adding con mode: secure 2024-09-14T11:03:24.048 INFO:tasks.workunit.client.0.smithi097.stderr: -361> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7053c30) adding con mode: crc 2024-09-14T11:03:24.048 INFO:tasks.workunit.client.0.smithi097.stderr: -360> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7053c30) adding con mode: secure 2024-09-14T11:03:24.048 INFO:tasks.workunit.client.0.smithi097.stderr: -359> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7053c30) adding con mode: crc 2024-09-14T11:03:24.048 INFO:tasks.workunit.client.0.smithi097.stderr: -358> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7053c30) adding con mode: secure 2024-09-14T11:03:24.048 INFO:tasks.workunit.client.0.smithi097.stderr: -357> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7053c30) adding con mode: crc 2024-09-14T11:03:24.048 INFO:tasks.workunit.client.0.smithi097.stderr: -356> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7053c30) adding con mode: crc 2024-09-14T11:03:24.049 INFO:tasks.workunit.client.0.smithi097.stderr: -355> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7053c30) adding con mode: secure 2024-09-14T11:03:24.049 INFO:tasks.workunit.client.0.smithi097.stderr: -354> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7053c30) adding con mode: crc 2024-09-14T11:03:24.049 INFO:tasks.workunit.client.0.smithi097.stderr: -353> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7053c30) adding con mode: secure 2024-09-14T11:03:24.049 INFO:tasks.workunit.client.0.smithi097.stderr: -352> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7053c30) adding con mode: crc 2024-09-14T11:03:24.049 INFO:tasks.workunit.client.0.smithi097.stderr: -351> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7053c30) adding con mode: secure 2024-09-14T11:03:24.049 INFO:tasks.workunit.client.0.smithi097.stderr: -350> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:24.049 INFO:tasks.workunit.client.0.smithi097.stderr: -349> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 asok(0x561cb6ddc270) register_command objecter_requests cmddesc objecter_requests hook 0x561cb7058850 EEXIST 2024-09-14T11:03:24.049 INFO:tasks.workunit.client.0.smithi097.stderr: -348> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 10 monclient: init 2024-09-14T11:03:24.049 INFO:tasks.workunit.client.0.smithi097.stderr: -347> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7052c38) adding auth protocol: cephx 2024-09-14T11:03:24.049 INFO:tasks.workunit.client.0.smithi097.stderr: -346> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7052c38) adding auth protocol: cephx 2024-09-14T11:03:24.049 INFO:tasks.workunit.client.0.smithi097.stderr: -345> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7052c38) adding auth protocol: cephx 2024-09-14T11:03:24.049 INFO:tasks.workunit.client.0.smithi097.stderr: -344> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7052c38) adding con mode: secure 2024-09-14T11:03:24.049 INFO:tasks.workunit.client.0.smithi097.stderr: -343> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7052c38) adding con mode: crc 2024-09-14T11:03:24.049 INFO:tasks.workunit.client.0.smithi097.stderr: -342> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7052c38) adding con mode: secure 2024-09-14T11:03:24.050 INFO:tasks.workunit.client.0.smithi097.stderr: -341> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7052c38) adding con mode: crc 2024-09-14T11:03:24.050 INFO:tasks.workunit.client.0.smithi097.stderr: -340> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7052c38) adding con mode: secure 2024-09-14T11:03:24.050 INFO:tasks.workunit.client.0.smithi097.stderr: -339> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7052c38) adding con mode: crc 2024-09-14T11:03:24.050 INFO:tasks.workunit.client.0.smithi097.stderr: -338> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7052c38) adding con mode: crc 2024-09-14T11:03:24.050 INFO:tasks.workunit.client.0.smithi097.stderr: -337> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7052c38) adding con mode: secure 2024-09-14T11:03:24.050 INFO:tasks.workunit.client.0.smithi097.stderr: -336> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7052c38) adding con mode: crc 2024-09-14T11:03:24.050 INFO:tasks.workunit.client.0.smithi097.stderr: -335> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7052c38) adding con mode: secure 2024-09-14T11:03:24.050 INFO:tasks.workunit.client.0.smithi097.stderr: -334> 2024-09-14T11:03:23.505+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7052c38) adding con mode: crc 2024-09-14T11:03:24.050 INFO:tasks.workunit.client.0.smithi097.stderr: -333> 2024-09-14T11:03:23.506+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7052c38) adding con mode: secure 2024-09-14T11:03:24.050 INFO:tasks.workunit.client.0.smithi097.stderr: -332> 2024-09-14T11:03:23.506+0000 7f62a3f2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:24.050 INFO:tasks.workunit.client.0.smithi097.stderr: -331> 2024-09-14T11:03:23.506+0000 7f62a3f2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:24.050 INFO:tasks.workunit.client.0.smithi097.stderr: -330> 2024-09-14T11:03:23.506+0000 7f62a3f2e800 5 asok(0x561cb6ddc270) register_command rotate-key cmddesc rotate-key hook 0x561cb7052d80 EEXIST 2024-09-14T11:03:24.050 INFO:tasks.workunit.client.0.smithi097.stderr: -329> 2024-09-14T11:03:23.506+0000 7f62a3f2e800 10 monclient: _reopen_session rank -1 2024-09-14T11:03:24.051 INFO:tasks.workunit.client.0.smithi097.stderr: -328> 2024-09-14T11:03:23.506+0000 7f62a3f2e800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:03:24.051 INFO:tasks.workunit.client.0.smithi097.stderr: -327> 2024-09-14T11:03:23.506+0000 7f62a3f2e800 10 monclient(hunting): picked mon.noname-a con 0x561cb707c540 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:03:24.051 INFO:tasks.workunit.client.0.smithi097.stderr: -326> 2024-09-14T11:03:23.506+0000 7f62a3f2e800 10 monclient(hunting): picked mon.noname-b con 0x561cb707c920 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:03:24.051 INFO:tasks.workunit.client.0.smithi097.stderr: -325> 2024-09-14T11:03:23.506+0000 7f62a3f2e800 10 monclient(hunting): picked mon.noname-c con 0x561cb707ebd0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:03:24.051 INFO:tasks.workunit.client.0.smithi097.stderr: -324> 2024-09-14T11:03:23.506+0000 7f62a3f2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:03:24.051 INFO:tasks.workunit.client.0.smithi097.stderr: -323> 2024-09-14T11:03:23.506+0000 7f62a3f2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:03:24.051 INFO:tasks.workunit.client.0.smithi097.stderr: -322> 2024-09-14T11:03:23.506+0000 7f62a3f2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:03:24.051 INFO:tasks.workunit.client.0.smithi097.stderr: -321> 2024-09-14T11:03:23.506+0000 7f62a3f2e800 10 monclient(hunting): _renew_subs 2024-09-14T11:03:24.051 INFO:tasks.workunit.client.0.smithi097.stderr: -320> 2024-09-14T11:03:23.506+0000 7f62a3f2e800 10 monclient(hunting): authenticate will time out at 1885.160505s 2024-09-14T11:03:24.051 INFO:tasks.workunit.client.0.smithi097.stderr: -319> 2024-09-14T11:03:23.506+0000 7f629f4dc640 10 monclient(hunting): get_auth_request con 0x561cb707c540 auth_method 0 2024-09-14T11:03:24.051 INFO:tasks.workunit.client.0.smithi097.stderr: -318> 2024-09-14T11:03:23.506+0000 7f629f4dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:03:24.051 INFO:tasks.workunit.client.0.smithi097.stderr: -317> 2024-09-14T11:03:23.506+0000 7f629f4dc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:03:24.051 INFO:tasks.workunit.client.0.smithi097.stderr: -316> 2024-09-14T11:03:23.506+0000 7f629f4dc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:03:24.051 INFO:tasks.workunit.client.0.smithi097.stderr: -315> 2024-09-14T11:03:23.506+0000 7f629fcdd640 10 monclient(hunting): get_auth_request con 0x561cb707ebd0 auth_method 0 2024-09-14T11:03:24.052 INFO:tasks.workunit.client.0.smithi097.stderr: -314> 2024-09-14T11:03:23.506+0000 7f629fcdd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:03:24.052 INFO:tasks.workunit.client.0.smithi097.stderr: -313> 2024-09-14T11:03:23.506+0000 7f629fcdd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:03:24.052 INFO:tasks.workunit.client.0.smithi097.stderr: -312> 2024-09-14T11:03:23.506+0000 7f629fcdd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:03:24.052 INFO:tasks.workunit.client.0.smithi097.stderr: -311> 2024-09-14T11:03:23.506+0000 7f629f4dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:03:24.052 INFO:tasks.workunit.client.0.smithi097.stderr: -310> 2024-09-14T11:03:23.506+0000 7f629f4dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:03:24.052 INFO:tasks.workunit.client.0.smithi097.stderr: -309> 2024-09-14T11:03:23.506+0000 7f629f4dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:03:24.052 INFO:tasks.workunit.client.0.smithi097.stderr: -308> 2024-09-14T11:03:23.506+0000 7f629fcdd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:03:24.052 INFO:tasks.workunit.client.0.smithi097.stderr: -307> 2024-09-14T11:03:23.506+0000 7f629fcdd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:03:24.052 INFO:tasks.workunit.client.0.smithi097.stderr: -306> 2024-09-14T11:03:23.506+0000 7f629fcdd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:03:24.052 INFO:tasks.workunit.client.0.smithi097.stderr: -305> 2024-09-14T11:03:23.506+0000 7f62a04de640 10 monclient(hunting): get_auth_request con 0x561cb707c920 auth_method 0 2024-09-14T11:03:24.052 INFO:tasks.workunit.client.0.smithi097.stderr: -304> 2024-09-14T11:03:23.506+0000 7f62a04de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:03:24.052 INFO:tasks.workunit.client.0.smithi097.stderr: -303> 2024-09-14T11:03:23.506+0000 7f62a04de640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:03:24.052 INFO:tasks.workunit.client.0.smithi097.stderr: -302> 2024-09-14T11:03:23.506+0000 7f62a04de640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:03:24.053 INFO:tasks.workunit.client.0.smithi097.stderr: -301> 2024-09-14T11:03:23.506+0000 7f629f4dc640 10 monclient(hunting): handle_auth_done global_id 6636 payload 824 2024-09-14T11:03:24.053 INFO:tasks.workunit.client.0.smithi097.stderr: -300> 2024-09-14T11:03:23.506+0000 7f629f4dc640 10 monclient: _finish_hunting 0 2024-09-14T11:03:24.053 INFO:tasks.workunit.client.0.smithi097.stderr: -299> 2024-09-14T11:03:23.506+0000 7f629f4dc640 1 monclient: found mon.noname-a 2024-09-14T11:03:24.053 INFO:tasks.workunit.client.0.smithi097.stderr: -298> 2024-09-14T11:03:23.506+0000 7f629f4dc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-14T11:03:24.053 INFO:tasks.workunit.client.0.smithi097.stderr: -297> 2024-09-14T11:03:23.507+0000 7f61857fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:03:24.053 INFO:tasks.workunit.client.0.smithi097.stderr: -296> 2024-09-14T11:03:23.507+0000 7f61857fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:03:24.053 INFO:tasks.workunit.client.0.smithi097.stderr: -295> 2024-09-14T11:03:23.507+0000 7f61857fa640 10 monclient: dump: 2024-09-14T11:03:24.053 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:03:24.053 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:03:24.053 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:24.053 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:24.053 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:03:24.053 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:03:24.053 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:03:24.054 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:03:24.054 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:03:24.054 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:24.054 INFO:tasks.workunit.client.0.smithi097.stderr: -294> 2024-09-14T11:03:23.507+0000 7f61857fa640 10 monclient: _finish_auth 0 2024-09-14T11:03:24.054 INFO:tasks.workunit.client.0.smithi097.stderr: -293> 2024-09-14T11:03:23.507+0000 7f61857fa640 10 monclient: _check_auth_tickets 2024-09-14T11:03:24.054 INFO:tasks.workunit.client.0.smithi097.stderr: -292> 2024-09-14T11:03:23.507+0000 7f61857fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:03:24.054 INFO:tasks.workunit.client.0.smithi097.stderr: -291> 2024-09-14T11:03:23.507+0000 7f61857fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:03:24.054 INFO:tasks.workunit.client.0.smithi097.stderr: -290> 2024-09-14T11:03:23.507+0000 7f61857fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:03:24.054 INFO:tasks.workunit.client.0.smithi097.stderr: -289> 2024-09-14T11:03:23.507+0000 7f61857fa640 10 monclient: dump: 2024-09-14T11:03:24.054 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:03:24.054 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:03:24.054 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:24.054 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:24.054 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:03:24.055 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:03:24.055 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:03:24.055 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:03:24.055 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:03:24.055 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:24.055 INFO:tasks.workunit.client.0.smithi097.stderr: -288> 2024-09-14T11:03:23.507+0000 7f62a3f2e800 5 monclient: authenticate success, global_id 6636 2024-09-14T11:03:24.055 INFO:tasks.workunit.client.0.smithi097.stderr: -287> 2024-09-14T11:03:23.507+0000 7f62a3f2e800 10 monclient: _renew_subs 2024-09-14T11:03:24.055 INFO:tasks.workunit.client.0.smithi097.stderr: -286> 2024-09-14T11:03:23.507+0000 7f62a3f2e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:03:24.055 INFO:tasks.workunit.client.0.smithi097.stderr: -285> 2024-09-14T11:03:23.507+0000 7f62a0cdf640 4 set_mon_vals no callback set 2024-09-14T11:03:24.055 INFO:tasks.workunit.client.0.smithi097.stderr: -284> 2024-09-14T11:03:23.507+0000 7f62a3f2e800 10 monclient: _renew_subs 2024-09-14T11:03:24.055 INFO:tasks.workunit.client.0.smithi097.stderr: -283> 2024-09-14T11:03:23.507+0000 7f62a3f2e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:03:24.055 INFO:tasks.workunit.client.0.smithi097.stderr: -282> 2024-09-14T11:03:23.508+0000 7f61857fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:03:24.055 INFO:tasks.workunit.client.0.smithi097.stderr: -281> 2024-09-14T11:03:23.508+0000 7f61857fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:03:24.055 INFO:tasks.workunit.client.0.smithi097.stderr: -280> 2024-09-14T11:03:23.508+0000 7f61857fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:03:24.056 INFO:tasks.workunit.client.0.smithi097.stderr: -279> 2024-09-14T11:03:23.509+0000 7f62a04de640 10 monclient: get_auth_request con 0x7f6178077140 auth_method 0 2024-09-14T11:03:24.056 INFO:tasks.workunit.client.0.smithi097.stderr: -278> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 10 monclient: get_monmap_and_config 2024-09-14T11:03:24.056 INFO:tasks.workunit.client.0.smithi097.stderr: -277> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 10 monclient: build_initial_monmap 2024-09-14T11:03:24.056 INFO:tasks.workunit.client.0.smithi097.stderr: -276> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 1 build_initial for_mkfs: 0 2024-09-14T11:03:24.056 INFO:tasks.workunit.client.0.smithi097.stderr: -275> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 10 monclient: monmap: 2024-09-14T11:03:24.056 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:03:24.056 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:03:24.056 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:03:24.056 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:03:24.056 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:03:24.056 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:03:24.056 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:03:24.056 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:03:24.057 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:03:24.057 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:24.057 INFO:tasks.workunit.client.0.smithi097.stderr: -274> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x561cb709c100) adding auth protocol: cephx 2024-09-14T11:03:24.057 INFO:tasks.workunit.client.0.smithi097.stderr: -273> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x561cb709c100) adding auth protocol: cephx 2024-09-14T11:03:24.057 INFO:tasks.workunit.client.0.smithi097.stderr: -272> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x561cb709c100) adding auth protocol: cephx 2024-09-14T11:03:24.057 INFO:tasks.workunit.client.0.smithi097.stderr: -271> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x561cb709c100) adding con mode: secure 2024-09-14T11:03:24.057 INFO:tasks.workunit.client.0.smithi097.stderr: -270> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x561cb709c100) adding con mode: crc 2024-09-14T11:03:24.057 INFO:tasks.workunit.client.0.smithi097.stderr: -269> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x561cb709c100) adding con mode: secure 2024-09-14T11:03:24.057 INFO:tasks.workunit.client.0.smithi097.stderr: -268> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x561cb709c100) adding con mode: crc 2024-09-14T11:03:24.057 INFO:tasks.workunit.client.0.smithi097.stderr: -267> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x561cb709c100) adding con mode: secure 2024-09-14T11:03:24.057 INFO:tasks.workunit.client.0.smithi097.stderr: -266> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x561cb709c100) adding con mode: crc 2024-09-14T11:03:24.057 INFO:tasks.workunit.client.0.smithi097.stderr: -265> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x561cb709c100) adding con mode: crc 2024-09-14T11:03:24.057 INFO:tasks.workunit.client.0.smithi097.stderr: -264> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x561cb709c100) adding con mode: secure 2024-09-14T11:03:24.057 INFO:tasks.workunit.client.0.smithi097.stderr: -263> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x561cb709c100) adding con mode: crc 2024-09-14T11:03:24.058 INFO:tasks.workunit.client.0.smithi097.stderr: -262> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x561cb709c100) adding con mode: secure 2024-09-14T11:03:24.058 INFO:tasks.workunit.client.0.smithi097.stderr: -261> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x561cb709c100) adding con mode: crc 2024-09-14T11:03:24.058 INFO:tasks.workunit.client.0.smithi097.stderr: -260> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x561cb709c100) adding con mode: secure 2024-09-14T11:03:24.058 INFO:tasks.workunit.client.0.smithi097.stderr: -259> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:24.058 INFO:tasks.workunit.client.0.smithi097.stderr: -258> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 10 monclient: init 2024-09-14T11:03:24.058 INFO:tasks.workunit.client.0.smithi097.stderr: -257> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f120) adding auth protocol: cephx 2024-09-14T11:03:24.058 INFO:tasks.workunit.client.0.smithi097.stderr: -256> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f120) adding auth protocol: cephx 2024-09-14T11:03:24.058 INFO:tasks.workunit.client.0.smithi097.stderr: -255> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f120) adding auth protocol: cephx 2024-09-14T11:03:24.058 INFO:tasks.workunit.client.0.smithi097.stderr: -254> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f120) adding con mode: secure 2024-09-14T11:03:24.058 INFO:tasks.workunit.client.0.smithi097.stderr: -253> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f120) adding con mode: crc 2024-09-14T11:03:24.058 INFO:tasks.workunit.client.0.smithi097.stderr: -252> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f120) adding con mode: secure 2024-09-14T11:03:24.058 INFO:tasks.workunit.client.0.smithi097.stderr: -251> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f120) adding con mode: crc 2024-09-14T11:03:24.058 INFO:tasks.workunit.client.0.smithi097.stderr: -250> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f120) adding con mode: secure 2024-09-14T11:03:24.059 INFO:tasks.workunit.client.0.smithi097.stderr: -249> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f120) adding con mode: crc 2024-09-14T11:03:24.059 INFO:tasks.workunit.client.0.smithi097.stderr: -248> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f120) adding con mode: crc 2024-09-14T11:03:24.059 INFO:tasks.workunit.client.0.smithi097.stderr: -247> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f120) adding con mode: secure 2024-09-14T11:03:24.059 INFO:tasks.workunit.client.0.smithi097.stderr: -246> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f120) adding con mode: crc 2024-09-14T11:03:24.059 INFO:tasks.workunit.client.0.smithi097.stderr: -245> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f120) adding con mode: secure 2024-09-14T11:03:24.059 INFO:tasks.workunit.client.0.smithi097.stderr: -244> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f120) adding con mode: crc 2024-09-14T11:03:24.059 INFO:tasks.workunit.client.0.smithi097.stderr: -243> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f120) adding con mode: secure 2024-09-14T11:03:24.059 INFO:tasks.workunit.client.0.smithi097.stderr: -242> 2024-09-14T11:03:23.509+0000 7f62a3f2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:24.059 INFO:tasks.workunit.client.0.smithi097.stderr: -241> 2024-09-14T11:03:23.510+0000 7f62a3f2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:24.059 INFO:tasks.workunit.client.0.smithi097.stderr: -240> 2024-09-14T11:03:23.510+0000 7f62a3f2e800 5 asok(0x561cb6ddc270) register_command rotate-key cmddesc rotate-key hook 0x7ffdce77f268 EEXIST 2024-09-14T11:03:24.059 INFO:tasks.workunit.client.0.smithi097.stderr: -239> 2024-09-14T11:03:23.510+0000 7f62a3f2e800 10 monclient: _reopen_session rank -1 2024-09-14T11:03:24.059 INFO:tasks.workunit.client.0.smithi097.stderr: -238> 2024-09-14T11:03:23.510+0000 7f62a3f2e800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:03:24.059 INFO:tasks.workunit.client.0.smithi097.stderr: -237> 2024-09-14T11:03:23.510+0000 7f62a3f2e800 10 monclient(hunting): picked mon.noname-b con 0x561cb70d06e0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:03:24.059 INFO:tasks.workunit.client.0.smithi097.stderr: -236> 2024-09-14T11:03:23.510+0000 7f62a3f2e800 10 monclient(hunting): picked mon.noname-a con 0x561cb70cac80 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:03:24.060 INFO:tasks.workunit.client.0.smithi097.stderr: -235> 2024-09-14T11:03:23.510+0000 7f62a3f2e800 10 monclient(hunting): picked mon.noname-c con 0x561cb70a0520 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:03:24.060 INFO:tasks.workunit.client.0.smithi097.stderr: -234> 2024-09-14T11:03:23.510+0000 7f62a3f2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:03:24.060 INFO:tasks.workunit.client.0.smithi097.stderr: -233> 2024-09-14T11:03:23.510+0000 7f62a3f2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:03:24.060 INFO:tasks.workunit.client.0.smithi097.stderr: -232> 2024-09-14T11:03:23.510+0000 7f62a3f2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:03:24.060 INFO:tasks.workunit.client.0.smithi097.stderr: -231> 2024-09-14T11:03:23.510+0000 7f62a3f2e800 10 monclient(hunting): _renew_subs 2024-09-14T11:03:24.060 INFO:tasks.workunit.client.0.smithi097.stderr: -230> 2024-09-14T11:03:23.510+0000 7f62a3f2e800 10 monclient(hunting): authenticate will time out at 1885.164192s 2024-09-14T11:03:24.060 INFO:tasks.workunit.client.0.smithi097.stderr: -229> 2024-09-14T11:03:23.510+0000 7f62a04de640 10 monclient(hunting): get_auth_request con 0x561cb70cac80 auth_method 0 2024-09-14T11:03:24.060 INFO:tasks.workunit.client.0.smithi097.stderr: -228> 2024-09-14T11:03:23.510+0000 7f62a04de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:03:24.060 INFO:tasks.workunit.client.0.smithi097.stderr: -227> 2024-09-14T11:03:23.510+0000 7f62a04de640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:03:24.060 INFO:tasks.workunit.client.0.smithi097.stderr: -226> 2024-09-14T11:03:23.510+0000 7f62a04de640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:03:24.060 INFO:tasks.workunit.client.0.smithi097.stderr: -225> 2024-09-14T11:03:23.510+0000 7f629fcdd640 10 monclient(hunting): get_auth_request con 0x561cb70a0520 auth_method 0 2024-09-14T11:03:24.060 INFO:tasks.workunit.client.0.smithi097.stderr: -224> 2024-09-14T11:03:23.510+0000 7f629fcdd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:03:24.060 INFO:tasks.workunit.client.0.smithi097.stderr: -223> 2024-09-14T11:03:23.510+0000 7f629fcdd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:03:24.061 INFO:tasks.workunit.client.0.smithi097.stderr: -222> 2024-09-14T11:03:23.510+0000 7f629fcdd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:03:24.061 INFO:tasks.workunit.client.0.smithi097.stderr: -221> 2024-09-14T11:03:23.510+0000 7f62a04de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:03:24.061 INFO:tasks.workunit.client.0.smithi097.stderr: -220> 2024-09-14T11:03:23.510+0000 7f62a04de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:03:24.061 INFO:tasks.workunit.client.0.smithi097.stderr: -219> 2024-09-14T11:03:23.510+0000 7f62a04de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:03:24.061 INFO:tasks.workunit.client.0.smithi097.stderr: -218> 2024-09-14T11:03:23.510+0000 7f629fcdd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:03:24.061 INFO:tasks.workunit.client.0.smithi097.stderr: -217> 2024-09-14T11:03:23.510+0000 7f629fcdd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:03:24.061 INFO:tasks.workunit.client.0.smithi097.stderr: -216> 2024-09-14T11:03:23.510+0000 7f629fcdd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:03:24.061 INFO:tasks.workunit.client.0.smithi097.stderr: -215> 2024-09-14T11:03:23.510+0000 7f62a04de640 10 monclient(hunting): handle_auth_done global_id 6639 payload 274 2024-09-14T11:03:24.061 INFO:tasks.workunit.client.0.smithi097.stderr: -214> 2024-09-14T11:03:23.510+0000 7f62a04de640 10 monclient: _finish_hunting 0 2024-09-14T11:03:24.061 INFO:tasks.workunit.client.0.smithi097.stderr: -213> 2024-09-14T11:03:23.510+0000 7f62a04de640 1 monclient: found mon.noname-a 2024-09-14T11:03:24.061 INFO:tasks.workunit.client.0.smithi097.stderr: -212> 2024-09-14T11:03:23.510+0000 7f62a04de640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-14T11:03:24.061 INFO:tasks.workunit.client.0.smithi097.stderr: -211> 2024-09-14T11:03:23.510+0000 7f629f4dc640 10 monclient: get_auth_request con 0x561cb70d06e0 auth_method 0 2024-09-14T11:03:24.061 INFO:tasks.workunit.client.0.smithi097.stderr: -210> 2024-09-14T11:03:23.510+0000 7f617effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:03:24.061 INFO:tasks.workunit.client.0.smithi097.stderr: -209> 2024-09-14T11:03:23.510+0000 7f617effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:03:24.062 INFO:tasks.workunit.client.0.smithi097.stderr: -208> 2024-09-14T11:03:23.510+0000 7f617effd640 10 monclient: dump: 2024-09-14T11:03:24.062 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:03:24.062 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:03:24.062 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:24.062 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:24.062 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:03:24.062 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:03:24.062 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:03:24.062 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:03:24.062 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:03:24.063 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:24.063 INFO:tasks.workunit.client.0.smithi097.stderr: -207> 2024-09-14T11:03:23.510+0000 7f617effd640 10 monclient: _finish_auth 0 2024-09-14T11:03:24.063 INFO:tasks.workunit.client.0.smithi097.stderr: -206> 2024-09-14T11:03:23.510+0000 7f617effd640 10 monclient: _check_auth_tickets 2024-09-14T11:03:24.063 INFO:tasks.workunit.client.0.smithi097.stderr: -205> 2024-09-14T11:03:23.510+0000 7f617effd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:03:24.063 INFO:tasks.workunit.client.0.smithi097.stderr: -204> 2024-09-14T11:03:23.510+0000 7f617effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:03:24.063 INFO:tasks.workunit.client.0.smithi097.stderr: -203> 2024-09-14T11:03:23.510+0000 7f617effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:03:24.063 INFO:tasks.workunit.client.0.smithi097.stderr: -202> 2024-09-14T11:03:23.510+0000 7f617effd640 10 monclient: dump: 2024-09-14T11:03:24.063 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:03:24.063 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:03:24.063 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:24.063 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:24.063 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:03:24.063 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:03:24.064 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:03:24.064 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:03:24.064 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:03:24.064 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:24.064 INFO:tasks.workunit.client.0.smithi097.stderr: -201> 2024-09-14T11:03:23.510+0000 7f62a3f2e800 5 monclient: authenticate success, global_id 6639 2024-09-14T11:03:24.064 INFO:tasks.workunit.client.0.smithi097.stderr: -200> 2024-09-14T11:03:23.510+0000 7f62a3f2e800 10 monclient: get_monmap_and_config success 2024-09-14T11:03:24.064 INFO:tasks.workunit.client.0.smithi097.stderr: -199> 2024-09-14T11:03:23.510+0000 7f62a3f2e800 4 set_mon_vals no callback set 2024-09-14T11:03:24.064 INFO:tasks.workunit.client.0.smithi097.stderr: -198> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 10 monclient: shutdown 2024-09-14T11:03:24.064 INFO:tasks.workunit.client.0.smithi097.stderr: -197> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 10 monclient: build_initial_monmap 2024-09-14T11:03:24.064 INFO:tasks.workunit.client.0.smithi097.stderr: -196> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 1 build_initial for_mkfs: 0 2024-09-14T11:03:24.064 INFO:tasks.workunit.client.0.smithi097.stderr: -195> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 10 monclient: monmap: 2024-09-14T11:03:24.064 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:03:24.064 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:03:24.065 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:03:24.065 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:03:24.065 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:03:24.065 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:03:24.065 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:03:24.065 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:03:24.065 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:03:24.065 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:24.065 INFO:tasks.workunit.client.0.smithi097.stderr: -194> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70cbc40) adding auth protocol: cephx 2024-09-14T11:03:24.065 INFO:tasks.workunit.client.0.smithi097.stderr: -193> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70cbc40) adding auth protocol: cephx 2024-09-14T11:03:24.065 INFO:tasks.workunit.client.0.smithi097.stderr: -192> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70cbc40) adding auth protocol: cephx 2024-09-14T11:03:24.065 INFO:tasks.workunit.client.0.smithi097.stderr: -191> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70cbc40) adding con mode: secure 2024-09-14T11:03:24.065 INFO:tasks.workunit.client.0.smithi097.stderr: -190> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70cbc40) adding con mode: crc 2024-09-14T11:03:24.065 INFO:tasks.workunit.client.0.smithi097.stderr: -189> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70cbc40) adding con mode: secure 2024-09-14T11:03:24.066 INFO:tasks.workunit.client.0.smithi097.stderr: -188> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70cbc40) adding con mode: crc 2024-09-14T11:03:24.066 INFO:tasks.workunit.client.0.smithi097.stderr: -187> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70cbc40) adding con mode: secure 2024-09-14T11:03:24.066 INFO:tasks.workunit.client.0.smithi097.stderr: -186> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70cbc40) adding con mode: crc 2024-09-14T11:03:24.066 INFO:tasks.workunit.client.0.smithi097.stderr: -185> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70cbc40) adding con mode: crc 2024-09-14T11:03:24.066 INFO:tasks.workunit.client.0.smithi097.stderr: -184> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70cbc40) adding con mode: secure 2024-09-14T11:03:24.066 INFO:tasks.workunit.client.0.smithi097.stderr: -183> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70cbc40) adding con mode: crc 2024-09-14T11:03:24.066 INFO:tasks.workunit.client.0.smithi097.stderr: -182> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70cbc40) adding con mode: secure 2024-09-14T11:03:24.066 INFO:tasks.workunit.client.0.smithi097.stderr: -181> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70cbc40) adding con mode: crc 2024-09-14T11:03:24.066 INFO:tasks.workunit.client.0.smithi097.stderr: -180> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb70cbc40) adding con mode: secure 2024-09-14T11:03:24.066 INFO:tasks.workunit.client.0.smithi097.stderr: -179> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:24.066 INFO:tasks.workunit.client.0.smithi097.stderr: -178> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 1 librados: starting msgr at 2024-09-14T11:03:24.066 INFO:tasks.workunit.client.0.smithi097.stderr: -177> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 1 librados: starting objecter 2024-09-14T11:03:24.066 INFO:tasks.workunit.client.0.smithi097.stderr: -176> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 asok(0x561cb6ddc270) register_command objecter_requests cmddesc objecter_requests hook 0x561cb7027750 EEXIST 2024-09-14T11:03:24.067 INFO:tasks.workunit.client.0.smithi097.stderr: -175> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 1 librados: setting wanted keys 2024-09-14T11:03:24.067 INFO:tasks.workunit.client.0.smithi097.stderr: -174> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 1 librados: calling monclient init 2024-09-14T11:03:24.067 INFO:tasks.workunit.client.0.smithi097.stderr: -173> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 10 monclient: init 2024-09-14T11:03:24.067 INFO:tasks.workunit.client.0.smithi097.stderr: -172> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7094280) adding auth protocol: cephx 2024-09-14T11:03:24.067 INFO:tasks.workunit.client.0.smithi097.stderr: -171> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7094280) adding auth protocol: cephx 2024-09-14T11:03:24.067 INFO:tasks.workunit.client.0.smithi097.stderr: -170> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7094280) adding auth protocol: cephx 2024-09-14T11:03:24.067 INFO:tasks.workunit.client.0.smithi097.stderr: -169> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7094280) adding con mode: secure 2024-09-14T11:03:24.067 INFO:tasks.workunit.client.0.smithi097.stderr: -168> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7094280) adding con mode: crc 2024-09-14T11:03:24.067 INFO:tasks.workunit.client.0.smithi097.stderr: -167> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7094280) adding con mode: secure 2024-09-14T11:03:24.067 INFO:tasks.workunit.client.0.smithi097.stderr: -166> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7094280) adding con mode: crc 2024-09-14T11:03:24.067 INFO:tasks.workunit.client.0.smithi097.stderr: -165> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7094280) adding con mode: secure 2024-09-14T11:03:24.067 INFO:tasks.workunit.client.0.smithi097.stderr: -164> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7094280) adding con mode: crc 2024-09-14T11:03:24.067 INFO:tasks.workunit.client.0.smithi097.stderr: -163> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7094280) adding con mode: crc 2024-09-14T11:03:24.068 INFO:tasks.workunit.client.0.smithi097.stderr: -162> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7094280) adding con mode: secure 2024-09-14T11:03:24.068 INFO:tasks.workunit.client.0.smithi097.stderr: -161> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7094280) adding con mode: crc 2024-09-14T11:03:24.068 INFO:tasks.workunit.client.0.smithi097.stderr: -160> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7094280) adding con mode: secure 2024-09-14T11:03:24.068 INFO:tasks.workunit.client.0.smithi097.stderr: -159> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7094280) adding con mode: crc 2024-09-14T11:03:24.068 INFO:tasks.workunit.client.0.smithi097.stderr: -158> 2024-09-14T11:03:23.511+0000 7f62a3f2e800 5 AuthRegistry(0x561cb7094280) adding con mode: secure 2024-09-14T11:03:24.068 INFO:tasks.workunit.client.0.smithi097.stderr: -157> 2024-09-14T11:03:23.512+0000 7f62a3f2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:24.068 INFO:tasks.workunit.client.0.smithi097.stderr: -156> 2024-09-14T11:03:23.512+0000 7f62a3f2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:24.068 INFO:tasks.workunit.client.0.smithi097.stderr: -155> 2024-09-14T11:03:23.512+0000 7f62a3f2e800 5 asok(0x561cb6ddc270) register_command rotate-key cmddesc rotate-key hook 0x561cb70943c8 EEXIST 2024-09-14T11:03:24.068 INFO:tasks.workunit.client.0.smithi097.stderr: -154> 2024-09-14T11:03:23.512+0000 7f62a3f2e800 10 monclient: _reopen_session rank -1 2024-09-14T11:03:24.068 INFO:tasks.workunit.client.0.smithi097.stderr: -153> 2024-09-14T11:03:23.512+0000 7f62a3f2e800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:03:24.068 INFO:tasks.workunit.client.0.smithi097.stderr: -152> 2024-09-14T11:03:23.512+0000 7f62a3f2e800 10 monclient(hunting): picked mon.noname-c con 0x561cb70a0520 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:03:24.068 INFO:tasks.workunit.client.0.smithi097.stderr: -151> 2024-09-14T11:03:23.512+0000 7f62a3f2e800 10 monclient(hunting): picked mon.noname-a con 0x561cb70cac80 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:03:24.068 INFO:tasks.workunit.client.0.smithi097.stderr: -150> 2024-09-14T11:03:23.512+0000 7f62a3f2e800 10 monclient(hunting): picked mon.noname-b con 0x561cb70d06e0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:03:24.069 INFO:tasks.workunit.client.0.smithi097.stderr: -149> 2024-09-14T11:03:23.512+0000 7f62a3f2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:03:24.069 INFO:tasks.workunit.client.0.smithi097.stderr: -148> 2024-09-14T11:03:23.512+0000 7f62a3f2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:03:24.069 INFO:tasks.workunit.client.0.smithi097.stderr: -147> 2024-09-14T11:03:23.512+0000 7f62a3f2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:03:24.069 INFO:tasks.workunit.client.0.smithi097.stderr: -146> 2024-09-14T11:03:23.512+0000 7f62a3f2e800 10 monclient(hunting): _renew_subs 2024-09-14T11:03:24.069 INFO:tasks.workunit.client.0.smithi097.stderr: -145> 2024-09-14T11:03:23.512+0000 7f62a3f2e800 10 monclient(hunting): authenticate will time out at 1885.166453s 2024-09-14T11:03:24.069 INFO:tasks.workunit.client.0.smithi097.stderr: -144> 2024-09-14T11:03:23.512+0000 7f629f4dc640 10 monclient(hunting): get_auth_request con 0x561cb70a0520 auth_method 0 2024-09-14T11:03:24.069 INFO:tasks.workunit.client.0.smithi097.stderr: -143> 2024-09-14T11:03:23.512+0000 7f629f4dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:03:24.069 INFO:tasks.workunit.client.0.smithi097.stderr: -142> 2024-09-14T11:03:23.512+0000 7f629f4dc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:03:24.069 INFO:tasks.workunit.client.0.smithi097.stderr: -141> 2024-09-14T11:03:23.512+0000 7f629f4dc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:03:24.069 INFO:tasks.workunit.client.0.smithi097.stderr: -140> 2024-09-14T11:03:23.512+0000 7f62a04de640 10 monclient(hunting): get_auth_request con 0x561cb70cac80 auth_method 0 2024-09-14T11:03:24.069 INFO:tasks.workunit.client.0.smithi097.stderr: -139> 2024-09-14T11:03:23.512+0000 7f62a04de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:03:24.069 INFO:tasks.workunit.client.0.smithi097.stderr: -138> 2024-09-14T11:03:23.512+0000 7f62a04de640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:03:24.069 INFO:tasks.workunit.client.0.smithi097.stderr: -137> 2024-09-14T11:03:23.512+0000 7f62a04de640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:03:24.069 INFO:tasks.workunit.client.0.smithi097.stderr: -136> 2024-09-14T11:03:23.512+0000 7f629f4dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:03:24.070 INFO:tasks.workunit.client.0.smithi097.stderr: -135> 2024-09-14T11:03:23.512+0000 7f629f4dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:03:24.070 INFO:tasks.workunit.client.0.smithi097.stderr: -134> 2024-09-14T11:03:23.512+0000 7f629f4dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:03:24.070 INFO:tasks.workunit.client.0.smithi097.stderr: -133> 2024-09-14T11:03:23.512+0000 7f62a04de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:03:24.070 INFO:tasks.workunit.client.0.smithi097.stderr: -132> 2024-09-14T11:03:23.512+0000 7f62a04de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:03:24.070 INFO:tasks.workunit.client.0.smithi097.stderr: -131> 2024-09-14T11:03:23.512+0000 7f62a04de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:03:24.070 INFO:tasks.workunit.client.0.smithi097.stderr: -130> 2024-09-14T11:03:23.512+0000 7f629f4dc640 10 monclient(hunting): handle_auth_done global_id 6299 payload 824 2024-09-14T11:03:24.070 INFO:tasks.workunit.client.0.smithi097.stderr: -129> 2024-09-14T11:03:23.512+0000 7f629f4dc640 10 monclient: _finish_hunting 0 2024-09-14T11:03:24.070 INFO:tasks.workunit.client.0.smithi097.stderr: -128> 2024-09-14T11:03:23.512+0000 7f629f4dc640 1 monclient: found mon.noname-c 2024-09-14T11:03:24.070 INFO:tasks.workunit.client.0.smithi097.stderr: -127> 2024-09-14T11:03:23.512+0000 7f629f4dc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:03:24.070 INFO:tasks.workunit.client.0.smithi097.stderr: -126> 2024-09-14T11:03:23.513+0000 7f617d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:03:24.070 INFO:tasks.workunit.client.0.smithi097.stderr: -125> 2024-09-14T11:03:23.513+0000 7f617d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:03:24.070 INFO:tasks.workunit.client.0.smithi097.stderr: -124> 2024-09-14T11:03:23.513+0000 7f617d7fa640 10 monclient: dump: 2024-09-14T11:03:24.070 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:03:24.070 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:03:24.071 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:24.071 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:24.071 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:03:24.071 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:03:24.071 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:03:24.071 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:03:24.071 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:03:24.071 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:24.071 INFO:tasks.workunit.client.0.smithi097.stderr: -123> 2024-09-14T11:03:23.513+0000 7f617d7fa640 10 monclient: _finish_auth 0 2024-09-14T11:03:24.071 INFO:tasks.workunit.client.0.smithi097.stderr: -122> 2024-09-14T11:03:23.513+0000 7f617d7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:03:24.071 INFO:tasks.workunit.client.0.smithi097.stderr: -121> 2024-09-14T11:03:23.513+0000 7f617d7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:03:24.071 INFO:tasks.workunit.client.0.smithi097.stderr: -120> 2024-09-14T11:03:23.513+0000 7f617d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:03:24.071 INFO:tasks.workunit.client.0.smithi097.stderr: -119> 2024-09-14T11:03:23.513+0000 7f617d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:03:24.072 INFO:tasks.workunit.client.0.smithi097.stderr: -118> 2024-09-14T11:03:23.513+0000 7f617d7fa640 10 monclient: dump: 2024-09-14T11:03:24.072 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:03:24.072 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:03:24.072 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:24.072 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:24.072 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:03:24.072 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:03:24.072 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:03:24.072 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:03:24.072 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:03:24.072 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:24.072 INFO:tasks.workunit.client.0.smithi097.stderr: -117> 2024-09-14T11:03:23.513+0000 7f62a3f2e800 5 monclient: authenticate success, global_id 6299 2024-09-14T11:03:24.072 INFO:tasks.workunit.client.0.smithi097.stderr: -116> 2024-09-14T11:03:23.513+0000 7f62a3f2e800 10 monclient: _renew_subs 2024-09-14T11:03:24.073 INFO:tasks.workunit.client.0.smithi097.stderr: -115> 2024-09-14T11:03:23.513+0000 7f617effd640 4 set_mon_vals no callback set 2024-09-14T11:03:24.073 INFO:tasks.workunit.client.0.smithi097.stderr: -114> 2024-09-14T11:03:23.513+0000 7f62a3f2e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:03:24.073 INFO:tasks.workunit.client.0.smithi097.stderr: -113> 2024-09-14T11:03:23.513+0000 7f62a3f2e800 10 monclient: _renew_subs 2024-09-14T11:03:24.073 INFO:tasks.workunit.client.0.smithi097.stderr: -112> 2024-09-14T11:03:23.513+0000 7f62a3f2e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:03:24.073 INFO:tasks.workunit.client.0.smithi097.stderr: -111> 2024-09-14T11:03:23.513+0000 7f62a3f2e800 1 librados: init done 2024-09-14T11:03:24.073 INFO:tasks.workunit.client.0.smithi097.stderr: -110> 2024-09-14T11:03:23.513+0000 7f62a3f2e800 5 asok(0x561cb6ddc270) register_command cr dump hook 0x561cb70bed68 2024-09-14T11:03:24.073 INFO:tasks.workunit.client.0.smithi097.stderr: -109> 2024-09-14T11:03:23.514+0000 7f62a3f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.073 INFO:tasks.workunit.client.0.smithi097.stderr: -108> 2024-09-14T11:03:23.515+0000 7f617d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:03:24.073 INFO:tasks.workunit.client.0.smithi097.stderr: -107> 2024-09-14T11:03:23.515+0000 7f617d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:03:24.073 INFO:tasks.workunit.client.0.smithi097.stderr: -106> 2024-09-14T11:03:23.515+0000 7f617d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:03:24.073 INFO:tasks.workunit.client.0.smithi097.stderr: -105> 2024-09-14T11:03:23.515+0000 7f62a04de640 10 monclient: get_auth_request con 0x7f6168077230 auth_method 0 2024-09-14T11:03:24.073 INFO:tasks.workunit.client.0.smithi097.stderr: -104> 2024-09-14T11:03:23.515+0000 7f629fcdd640 10 monclient: get_auth_request con 0x561cb70eaa20 auth_method 0 2024-09-14T11:03:24.073 INFO:tasks.workunit.client.0.smithi097.stderr: -103> 2024-09-14T11:03:23.516+0000 7f62a3f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:24.074 INFO:tasks.workunit.client.0.smithi097.stderr: -102> 2024-09-14T11:03:23.516+0000 7f62a3f2e800 20 realm 2024-09-14T11:03:24.074 INFO:tasks.workunit.client.0.smithi097.stderr: -101> 2024-09-14T11:03:23.516+0000 7f62a3f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.074 INFO:tasks.workunit.client.0.smithi097.stderr: -100> 2024-09-14T11:03:23.516+0000 7f62a3f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:24.074 INFO:tasks.workunit.client.0.smithi097.stderr: -99> 2024-09-14T11:03:23.516+0000 7f62a3f2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:03:24.074 INFO:tasks.workunit.client.0.smithi097.stderr: -98> 2024-09-14T11:03:23.516+0000 7f62a3f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.074 INFO:tasks.workunit.client.0.smithi097.stderr: -97> 2024-09-14T11:03:23.516+0000 7f62a3f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:24.074 INFO:tasks.workunit.client.0.smithi097.stderr: -96> 2024-09-14T11:03:23.516+0000 7f62a3f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.074 INFO:tasks.workunit.client.0.smithi097.stderr: -95> 2024-09-14T11:03:23.517+0000 7f629f4dc640 10 monclient: get_auth_request con 0x561cb70eee00 auth_method 0 2024-09-14T11:03:24.074 INFO:tasks.workunit.client.0.smithi097.stderr: -94> 2024-09-14T11:03:23.517+0000 7f62a3f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:24.074 INFO:tasks.workunit.client.0.smithi097.stderr: -93> 2024-09-14T11:03:23.517+0000 7f62a3f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.074 INFO:tasks.workunit.client.0.smithi097.stderr: -92> 2024-09-14T11:03:23.517+0000 7f62a04de640 10 monclient: get_auth_request con 0x561cb70f2500 auth_method 0 2024-09-14T11:03:24.074 INFO:tasks.workunit.client.0.smithi097.stderr: -91> 2024-09-14T11:03:23.518+0000 7f62a3f2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:03:24.074 INFO:tasks.workunit.client.0.smithi097.stderr: -90> 2024-09-14T11:03:23.518+0000 7f62a3f2e800 20 searching for the correct realm 2024-09-14T11:03:24.074 INFO:tasks.workunit.client.0.smithi097.stderr: -89> 2024-09-14T11:03:23.518+0000 7f629fcdd640 10 monclient: get_auth_request con 0x561cb70f7280 auth_method 0 2024-09-14T11:03:24.075 INFO:tasks.workunit.client.0.smithi097.stderr: -88> 2024-09-14T11:03:23.519+0000 7f629f4dc640 0 -- 172.21.15.97:0/4101729106 >> [v2:172.21.15.97:6808/2081705332,v1:172.21.15.97:6809/2081705332] conn(0x7f629002b040 msgr2=0x7f629001c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:03:24.075 INFO:tasks.workunit.client.0.smithi097.stderr: -87> 2024-09-14T11:03:23.720+0000 7f629f4dc640 10 monclient: get_auth_request con 0x7f629002b040 auth_method 0 2024-09-14T11:03:24.075 INFO:tasks.workunit.client.0.smithi097.stderr: -86> 2024-09-14T11:03:23.721+0000 7f62a04de640 10 monclient: get_auth_request con 0x7f629408c020 auth_method 0 2024-09-14T11:03:24.075 INFO:tasks.workunit.client.0.smithi097.stderr: -85> 2024-09-14T11:03:23.724+0000 7f629fcdd640 10 monclient: get_auth_request con 0x7f6294027400 auth_method 0 2024-09-14T11:03:24.075 INFO:tasks.workunit.client.0.smithi097.stderr: -84> 2024-09-14T11:03:23.724+0000 7f629fcdd640 0 -- 172.21.15.97:0/4101729106 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7f6294027400 msgr2=0x7f6294068aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:03:24.075 INFO:tasks.workunit.client.0.smithi097.stderr: -83> 2024-09-14T11:03:23.925+0000 7f629fcdd640 10 monclient: get_auth_request con 0x7f6294027400 auth_method 0 2024-09-14T11:03:24.075 INFO:tasks.workunit.client.0.smithi097.stderr: -82> 2024-09-14T11:03:23.926+0000 7f629f4dc640 10 monclient: get_auth_request con 0x7f629003d040 auth_method 0 2024-09-14T11:03:24.075 INFO:tasks.workunit.client.0.smithi097.stderr: -81> 2024-09-14T11:03:23.931+0000 7f62a3f2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:03:24.075 INFO:tasks.workunit.client.0.smithi097.stderr: -80> 2024-09-14T11:03:23.931+0000 7f62a3f2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:03:24.075 INFO:tasks.workunit.client.0.smithi097.stderr: -79> 2024-09-14T11:03:23.931+0000 7f62a3f2e800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:03:24.075 INFO:tasks.workunit.client.0.smithi097.stderr: -78> 2024-09-14T11:03:23.931+0000 7f62a3f2e800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:03:24.075 INFO:tasks.workunit.client.0.smithi097.stderr: -77> 2024-09-14T11:03:23.931+0000 7f62a3f2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:03:24.075 INFO:tasks.workunit.client.0.smithi097.stderr: -76> 2024-09-14T11:03:23.931+0000 7f62a3f2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:03:24.076 INFO:tasks.workunit.client.0.smithi097.stderr: -75> 2024-09-14T11:03:23.931+0000 7f62a3f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.076 INFO:tasks.workunit.client.0.smithi097.stderr: -74> 2024-09-14T11:03:23.931+0000 7f62a3f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:24.076 INFO:tasks.workunit.client.0.smithi097.stderr: -73> 2024-09-14T11:03:23.931+0000 7f62a3f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.076 INFO:tasks.workunit.client.0.smithi097.stderr: -72> 2024-09-14T11:03:23.931+0000 7f62a3f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:24.076 INFO:tasks.workunit.client.0.smithi097.stderr: -71> 2024-09-14T11:03:23.931+0000 7f62a3f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.076 INFO:tasks.workunit.client.0.smithi097.stderr: -70> 2024-09-14T11:03:23.932+0000 7f62a3f2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:03:24.076 INFO:tasks.workunit.client.0.smithi097.stderr: -69> 2024-09-14T11:03:23.932+0000 7f62a3f2e800 20 zone default found 2024-09-14T11:03:24.076 INFO:tasks.workunit.client.0.smithi097.stderr: -68> 2024-09-14T11:03:23.932+0000 7f62a3f2e800 4 Realm: () 2024-09-14T11:03:24.076 INFO:tasks.workunit.client.0.smithi097.stderr: -67> 2024-09-14T11:03:23.932+0000 7f62a3f2e800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:03:24.076 INFO:tasks.workunit.client.0.smithi097.stderr: -66> 2024-09-14T11:03:23.932+0000 7f62a3f2e800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:03:24.076 INFO:tasks.workunit.client.0.smithi097.stderr: -65> 2024-09-14T11:03:23.932+0000 7f62a3f2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:03:24.076 INFO:tasks.workunit.client.0.smithi097.stderr: -64> 2024-09-14T11:03:23.932+0000 7f62a3f2e800 20 zonegroup default 2024-09-14T11:03:24.076 INFO:tasks.workunit.client.0.smithi097.stderr: -63> 2024-09-14T11:03:23.932+0000 7f62a3f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.077 INFO:tasks.workunit.client.0.smithi097.stderr: -62> 2024-09-14T11:03:23.932+0000 7f62a3f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:24.077 INFO:tasks.workunit.client.0.smithi097.stderr: -61> 2024-09-14T11:03:23.932+0000 7f62a3f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.077 INFO:tasks.workunit.client.0.smithi097.stderr: -60> 2024-09-14T11:03:23.932+0000 7f62a3f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:24.077 INFO:tasks.workunit.client.0.smithi097.stderr: -59> 2024-09-14T11:03:23.932+0000 7f62a3f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.077 INFO:tasks.workunit.client.0.smithi097.stderr: -58> 2024-09-14T11:03:23.932+0000 7f62a3f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:24.077 INFO:tasks.workunit.client.0.smithi097.stderr: -57> 2024-09-14T11:03:23.932+0000 7f62a3f2e800 20 started sync module instance, tier type = 2024-09-14T11:03:24.077 INFO:tasks.workunit.client.0.smithi097.stderr: -56> 2024-09-14T11:03:23.932+0000 7f62a3f2e800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:03:24.077 INFO:tasks.workunit.client.0.smithi097.stderr: -55> 2024-09-14T11:03:23.941+0000 7f62a3f2e800 20 add_watcher() i=0 2024-09-14T11:03:24.077 INFO:tasks.workunit.client.0.smithi097.stderr: -54> 2024-09-14T11:03:23.941+0000 7f62a3f2e800 20 add_watcher() i=1 2024-09-14T11:03:24.077 INFO:tasks.workunit.client.0.smithi097.stderr: -53> 2024-09-14T11:03:23.941+0000 7f62a3f2e800 20 add_watcher() i=2 2024-09-14T11:03:24.078 INFO:tasks.workunit.client.0.smithi097.stderr: -52> 2024-09-14T11:03:23.941+0000 7f62a3f2e800 20 add_watcher() i=3 2024-09-14T11:03:24.078 INFO:tasks.workunit.client.0.smithi097.stderr: -51> 2024-09-14T11:03:23.941+0000 7f62a3f2e800 20 add_watcher() i=4 2024-09-14T11:03:24.078 INFO:tasks.workunit.client.0.smithi097.stderr: -50> 2024-09-14T11:03:23.941+0000 7f62a3f2e800 20 add_watcher() i=5 2024-09-14T11:03:24.078 INFO:tasks.workunit.client.0.smithi097.stderr: -49> 2024-09-14T11:03:23.941+0000 7f62a3f2e800 20 add_watcher() i=6 2024-09-14T11:03:24.078 INFO:tasks.workunit.client.0.smithi097.stderr: -48> 2024-09-14T11:03:23.942+0000 7f62a3f2e800 20 add_watcher() i=7 2024-09-14T11:03:24.078 INFO:tasks.workunit.client.0.smithi097.stderr: -47> 2024-09-14T11:03:23.942+0000 7f62a3f2e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:03:24.078 INFO:tasks.workunit.client.0.smithi097.stderr: -46> 2024-09-14T11:03:23.943+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f600) adding auth protocol: cephx 2024-09-14T11:03:24.078 INFO:tasks.workunit.client.0.smithi097.stderr: -45> 2024-09-14T11:03:23.943+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f600) adding auth protocol: cephx 2024-09-14T11:03:24.078 INFO:tasks.workunit.client.0.smithi097.stderr: -44> 2024-09-14T11:03:23.943+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f600) adding auth protocol: cephx 2024-09-14T11:03:24.078 INFO:tasks.workunit.client.0.smithi097.stderr: -43> 2024-09-14T11:03:23.943+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f600) adding con mode: secure 2024-09-14T11:03:24.078 INFO:tasks.workunit.client.0.smithi097.stderr: -42> 2024-09-14T11:03:23.943+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f600) adding con mode: crc 2024-09-14T11:03:24.078 INFO:tasks.workunit.client.0.smithi097.stderr: -41> 2024-09-14T11:03:23.943+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f600) adding con mode: secure 2024-09-14T11:03:24.078 INFO:tasks.workunit.client.0.smithi097.stderr: -40> 2024-09-14T11:03:23.943+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f600) adding con mode: crc 2024-09-14T11:03:24.079 INFO:tasks.workunit.client.0.smithi097.stderr: -39> 2024-09-14T11:03:23.943+0000 7f61567e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:24.079 INFO:tasks.workunit.client.0.smithi097.stderr: -38> 2024-09-14T11:03:23.943+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f600) adding con mode: secure 2024-09-14T11:03:24.079 INFO:tasks.workunit.client.0.smithi097.stderr: -37> 2024-09-14T11:03:23.943+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f600) adding con mode: crc 2024-09-14T11:03:24.079 INFO:tasks.workunit.client.0.smithi097.stderr: -36> 2024-09-14T11:03:23.943+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f600) adding con mode: crc 2024-09-14T11:03:24.079 INFO:tasks.workunit.client.0.smithi097.stderr: -35> 2024-09-14T11:03:23.943+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f600) adding con mode: secure 2024-09-14T11:03:24.079 INFO:tasks.workunit.client.0.smithi097.stderr: -34> 2024-09-14T11:03:23.943+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f600) adding con mode: crc 2024-09-14T11:03:24.079 INFO:tasks.workunit.client.0.smithi097.stderr: -33> 2024-09-14T11:03:23.943+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f600) adding con mode: secure 2024-09-14T11:03:24.079 INFO:tasks.workunit.client.0.smithi097.stderr: -32> 2024-09-14T11:03:23.943+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f600) adding con mode: crc 2024-09-14T11:03:24.079 INFO:tasks.workunit.client.0.smithi097.stderr: -31> 2024-09-14T11:03:23.943+0000 7f62a3f2e800 5 AuthRegistry(0x7ffdce77f600) adding con mode: secure 2024-09-14T11:03:24.079 INFO:tasks.workunit.client.0.smithi097.stderr: -30> 2024-09-14T11:03:23.944+0000 7f62a3f2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:24.079 INFO:tasks.workunit.client.0.smithi097.stderr: -29> 2024-09-14T11:03:23.944+0000 7f62a3f2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:03:24.079 INFO:tasks.workunit.client.0.smithi097.stderr: -28> 2024-09-14T11:03:23.944+0000 7f62a3f2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:03:24.079 INFO:tasks.workunit.client.0.smithi097.stderr: -27> 2024-09-14T11:03:23.944+0000 7f62a3f2e800 5 asok(0x561cb6ddc270) register_command cache list hook 0x561cb70c7a90 2024-09-14T11:03:24.079 INFO:tasks.workunit.client.0.smithi097.stderr: -26> 2024-09-14T11:03:23.944+0000 7f62a3f2e800 5 asok(0x561cb6ddc270) register_command cache inspect hook 0x561cb70c7a90 2024-09-14T11:03:24.080 INFO:tasks.workunit.client.0.smithi097.stderr: -25> 2024-09-14T11:03:23.944+0000 7f62a3f2e800 5 asok(0x561cb6ddc270) register_command cache erase hook 0x561cb70c7a90 2024-09-14T11:03:24.080 INFO:tasks.workunit.client.0.smithi097.stderr: -24> 2024-09-14T11:03:23.944+0000 7f62a3f2e800 5 asok(0x561cb6ddc270) register_command cache zap hook 0x561cb70c7a90 2024-09-14T11:03:24.080 INFO:tasks.workunit.client.0.smithi097.stderr: -23> 2024-09-14T11:03:23.944+0000 7f62a3f2e800 5 note: GC not initialized 2024-09-14T11:03:24.080 INFO:tasks.workunit.client.0.smithi097.stderr: -22> 2024-09-14T11:03:23.944+0000 7f61557e2640 20 reqs_thread_entry: start 2024-09-14T11:03:24.080 INFO:tasks.workunit.client.0.smithi097.stderr: -21> 2024-09-14T11:03:23.944+0000 7f62a3f2e800 5 asok(0x561cb6ddc270) register_command sync trace show hook 0x7f62940043a0 2024-09-14T11:03:24.080 INFO:tasks.workunit.client.0.smithi097.stderr: -20> 2024-09-14T11:03:23.944+0000 7f62a3f2e800 5 asok(0x561cb6ddc270) register_command sync trace history hook 0x7f62940043a0 2024-09-14T11:03:24.080 INFO:tasks.workunit.client.0.smithi097.stderr: -19> 2024-09-14T11:03:23.944+0000 7f62a3f2e800 5 asok(0x561cb6ddc270) register_command sync trace active hook 0x7f62940043a0 2024-09-14T11:03:24.080 INFO:tasks.workunit.client.0.smithi097.stderr: -18> 2024-09-14T11:03:23.944+0000 7f62a3f2e800 5 asok(0x561cb6ddc270) register_command sync trace active_short hook 0x7f62940043a0 2024-09-14T11:03:24.080 INFO:tasks.workunit.client.0.smithi097.stderr: -17> 2024-09-14T11:03:23.944+0000 7f62a3f2e800 20 init_complete bucket index max shards: 11 2024-09-14T11:03:24.080 INFO:tasks.workunit.client.0.smithi097.stderr: -16> 2024-09-14T11:03:23.944+0000 7f62a3f2e800 20 Filter name: none 2024-09-14T11:03:24.080 INFO:tasks.workunit.client.0.smithi097.stderr: -15> 2024-09-14T11:03:23.944+0000 7f614e7fc640 20 reqs_thread_entry: start 2024-09-14T11:03:24.080 INFO:tasks.workunit.client.0.smithi097.stderr: -14> 2024-09-14T11:03:23.944+0000 7f62a3f2e800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:03:24.080 INFO:tasks.workunit.client.0.smithi097.stderr: -13> 2024-09-14T11:03:23.944+0000 7f62a3f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.081 INFO:tasks.workunit.client.0.smithi097.stderr: -12> 2024-09-14T11:03:23.944+0000 7f62a3f2e800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:03:24.081 INFO:tasks.workunit.client.0.smithi097.stderr: -11> 2024-09-14T11:03:23.944+0000 7f62a3f2e800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:03:24.081 INFO:tasks.workunit.client.0.smithi097.stderr: -10> 2024-09-14T11:03:23.944+0000 7f62a3f2e800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:03:24.081 INFO:tasks.workunit.client.0.smithi097.stderr: -9> 2024-09-14T11:03:23.944+0000 7f62a3f2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24 : miss 2024-09-14T11:03:24.081 INFO:tasks.workunit.client.0.smithi097.stderr: -8> 2024-09-14T11:03:23.944+0000 7f62a3f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.081 INFO:tasks.workunit.client.0.smithi097.stderr: -7> 2024-09-14T11:03:23.945+0000 7f62a3f2e800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:03:24.081 INFO:tasks.workunit.client.0.smithi097.stderr: -6> 2024-09-14T11:03:23.945+0000 7f62a3f2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24 info.flags=0x17 2024-09-14T11:03:24.081 INFO:tasks.workunit.client.0.smithi097.stderr: -5> 2024-09-14T11:03:23.945+0000 7f62a3f2e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24 to cache LRU end 2024-09-14T11:03:24.081 INFO:tasks.workunit.client.0.smithi097.stderr: -4> 2024-09-14T11:03:23.945+0000 7f62a3f2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:03:24.081 INFO:tasks.workunit.client.0.smithi097.stderr: -3> 2024-09-14T11:03:23.945+0000 7f62a3f2e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:24.081 INFO:tasks.workunit.client.0.smithi097.stderr: -2> 2024-09-14T11:03:23.945+0000 7f62a3f2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24 2024-09-14T11:03:24.081 INFO:tasks.workunit.client.0.smithi097.stderr: -1> 2024-09-14T11:03:23.950+0000 7f62a3f2e800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f62a3f2e800 time 2024-09-14T11:03:23.951128+0000 2024-09-14T11:03:24.081 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:03:24.082 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:24.082 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:03:24.082 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f62a578c76a] 2024-09-14T11:03:24.082 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f62a578c928] 2024-09-14T11:03:24.082 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561cb47320b1] 2024-09-14T11:03:24.082 INFO:tasks.workunit.client.0.smithi097.stderr: 4: radosgw-admin(+0xd88418) [0x561cb4c45418] 2024-09-14T11:03:24.082 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561cb4741efd] 2024-09-14T11:03:24.082 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-14T11:03:24.082 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f62a4429590] 2024-09-14T11:03:24.082 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-14T11:03:24.082 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-14T11:03:24.082 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:24.082 INFO:tasks.workunit.client.0.smithi097.stderr: 0> 2024-09-14T11:03:23.950+0000 7f62a3f2e800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:03:24.082 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f62a3f2e800 thread_name:radosgw-admin 2024-09-14T11:03:24.083 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:24.083 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:03:24.083 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f62a443e6f0] 2024-09-14T11:03:24.083 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f62a448b99c] 2024-09-14T11:03:24.083 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-14T11:03:24.083 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-14T11:03:24.083 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f62a578c7c4] 2024-09-14T11:03:24.083 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f62a578c928] 2024-09-14T11:03:24.083 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561cb47320b1] 2024-09-14T11:03:24.083 INFO:tasks.workunit.client.0.smithi097.stderr: 8: radosgw-admin(+0xd88418) [0x561cb4c45418] 2024-09-14T11:03:24.083 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561cb4741efd] 2024-09-14T11:03:24.083 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-14T11:03:24.083 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f62a4429590] 2024-09-14T11:03:24.084 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-14T11:03:24.084 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-14T11:03:24.084 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:03:24.084 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:24.084 INFO:tasks.workunit.client.0.smithi097.stderr:--- logging levels --- 2024-09-14T11:03:24.084 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 none 2024-09-14T11:03:24.084 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 lockdep 2024-09-14T11:03:24.084 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 context 2024-09-14T11:03:24.084 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 crush 2024-09-14T11:03:24.084 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds 2024-09-14T11:03:24.084 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_balancer 2024-09-14T11:03:24.084 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_locker 2024-09-14T11:03:24.084 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log 2024-09-14T11:03:24.084 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log_expire 2024-09-14T11:03:24.085 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_migrator 2024-09-14T11:03:24.085 INFO:tasks.workunit.client.0.smithi097.stderr: 3/ 5 mds_quiesce 2024-09-14T11:03:24.085 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 buffer 2024-09-14T11:03:24.085 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 timer 2024-09-14T11:03:24.085 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 filer 2024-09-14T11:03:24.085 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 striper 2024-09-14T11:03:24.085 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 objecter 2024-09-14T11:03:24.085 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rados 2024-09-14T11:03:24.085 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd 2024-09-14T11:03:24.085 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_mirror 2024-09-14T11:03:24.085 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_replay 2024-09-14T11:03:24.085 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_pwl 2024-09-14T11:03:24.085 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 journaler 2024-09-14T11:03:24.085 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objectcacher 2024-09-14T11:03:24.086 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:03:24.086 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 client 2024-09-14T11:03:24.086 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 osd 2024-09-14T11:03:24.086 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 optracker 2024-09-14T11:03:24.086 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objclass 2024-09-14T11:03:24.086 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 filestore 2024-09-14T11:03:24.086 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 journal 2024-09-14T11:03:24.086 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 ms 2024-09-14T11:03:24.086 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mon 2024-09-14T11:03:24.086 INFO:tasks.workunit.client.0.smithi097.stderr: 0/10 monc 2024-09-14T11:03:24.086 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 paxos 2024-09-14T11:03:24.086 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 tp 2024-09-14T11:03:24.086 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 auth 2024-09-14T11:03:24.086 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 crypto 2024-09-14T11:03:24.087 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 finisher 2024-09-14T11:03:24.087 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 reserver 2024-09-14T11:03:24.087 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 heartbeatmap 2024-09-14T11:03:24.087 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 perfcounter 2024-09-14T11:03:24.087 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw 2024-09-14T11:03:24.087 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_sync 2024-09-14T11:03:24.087 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_datacache 2024-09-14T11:03:24.087 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_access 2024-09-14T11:03:24.087 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:03:24.087 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_flight 2024-09-14T11:03:24.087 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:03:24.087 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw_notification 2024-09-14T11:03:24.087 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 javaclient 2024-09-14T11:03:24.087 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 asok 2024-09-14T11:03:24.088 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 throttle 2024-09-14T11:03:24.088 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 refs 2024-09-14T11:03:24.088 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 compressor 2024-09-14T11:03:24.088 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluestore 2024-09-14T11:03:24.088 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluefs 2024-09-14T11:03:24.088 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 bdev 2024-09-14T11:03:24.088 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 kstore 2024-09-14T11:03:24.088 INFO:tasks.workunit.client.0.smithi097.stderr: 4/ 5 rocksdb 2024-09-14T11:03:24.088 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 fuse 2024-09-14T11:03:24.089 INFO:tasks.workunit.client.0.smithi097.stderr: 2/ 5 mgr 2024-09-14T11:03:24.089 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mgrc 2024-09-14T11:03:24.089 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 dpdk 2024-09-14T11:03:24.089 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 eventtrace 2024-09-14T11:03:24.089 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 prioritycache 2024-09-14T11:03:24.089 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 test 2024-09-14T11:03:24.089 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:03:24.089 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephsqlite 2024-09-14T11:03:24.089 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:03:24.089 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore 2024-09-14T11:03:24.089 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_onode 2024-09-14T11:03:24.089 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_odata 2024-09-14T11:03:24.089 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_omap 2024-09-14T11:03:24.089 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_tm 2024-09-14T11:03:24.090 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_t 2024-09-14T11:03:24.090 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:03:24.090 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_epm 2024-09-14T11:03:24.090 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_lba 2024-09-14T11:03:24.090 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:03:24.090 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cache 2024-09-14T11:03:24.090 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_journal 2024-09-14T11:03:24.090 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_device 2024-09-14T11:03:24.090 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_backref 2024-09-14T11:03:24.090 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 alienstore 2024-09-14T11:03:24.090 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mclock 2024-09-14T11:03:24.090 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cyanstore 2024-09-14T11:03:24.090 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 ceph_exporter 2024-09-14T11:03:24.090 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 memstore 2024-09-14T11:03:24.091 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 trace 2024-09-14T11:03:24.091 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 ceph_dedup 2024-09-14T11:03:24.091 INFO:tasks.workunit.client.0.smithi097.stderr: -2/-2 (syslog threshold) 2024-09-14T11:03:24.091 INFO:tasks.workunit.client.0.smithi097.stderr: 99/99 (stderr threshold) 2024-09-14T11:03:24.091 INFO:tasks.workunit.client.0.smithi097.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:03:24.091 INFO:tasks.workunit.client.0.smithi097.stderr: 7f614e7fc640 / http_manager 2024-09-14T11:03:24.091 INFO:tasks.workunit.client.0.smithi097.stderr: 7f61557e2640 / http_manager 2024-09-14T11:03:24.091 INFO:tasks.workunit.client.0.smithi097.stderr: 7f61567e4640 / rgw_dt_lg_renew 2024-09-14T11:03:24.091 INFO:tasks.workunit.client.0.smithi097.stderr: 7f617d7fa640 / ms_dispatch 2024-09-14T11:03:24.091 INFO:tasks.workunit.client.0.smithi097.stderr: 7f617effd640 / io_context_pool 2024-09-14T11:03:24.091 INFO:tasks.workunit.client.0.smithi097.stderr: 7f61857fa640 / ms_dispatch 2024-09-14T11:03:24.091 INFO:tasks.workunit.client.0.smithi097.stderr: 7f6187fff640 / ms_dispatch 2024-09-14T11:03:24.091 INFO:tasks.workunit.client.0.smithi097.stderr: 7f618de0b640 / io_context_pool 2024-09-14T11:03:24.091 INFO:tasks.workunit.client.0.smithi097.stderr: 7f629f4dc640 / msgr-worker-2 2024-09-14T11:03:24.092 INFO:tasks.workunit.client.0.smithi097.stderr: 7f629fcdd640 / msgr-worker-1 2024-09-14T11:03:24.092 INFO:tasks.workunit.client.0.smithi097.stderr: 7f62a04de640 / msgr-worker-0 2024-09-14T11:03:24.092 INFO:tasks.workunit.client.0.smithi097.stderr: 7f62a0cdf640 / io_context_pool 2024-09-14T11:03:24.092 INFO:tasks.workunit.client.0.smithi097.stderr: 7f62a3f2e800 / radosgw-admin 2024-09-14T11:03:24.092 INFO:tasks.workunit.client.0.smithi097.stderr: max_recent 500 2024-09-14T11:03:24.092 INFO:tasks.workunit.client.0.smithi097.stderr: max_new 1000 2024-09-14T11:03:24.092 INFO:tasks.workunit.client.0.smithi097.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:03:23.952785Z_67055e27-7422-4dec-ab03-747ab46edf28/log 2024-09-14T11:03:24.092 INFO:tasks.workunit.client.0.smithi097.stderr:--- end dump of recent events --- 2024-09-14T11:03:24.092 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-14T11:03:24.098 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:03:24.098 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:03:24.098 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.025+0000 7f43b1539800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.098 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.027+0000 7f43b1539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:24.098 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.027+0000 7f43b1539800 20 realm 2024-09-14T11:03:24.098 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.027+0000 7f43b1539800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.098 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.027+0000 7f43b1539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:24.098 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.027+0000 7f43b1539800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:03:24.098 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.027+0000 7f43b1539800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.098 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.027+0000 7f43b1539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:24.098 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.027+0000 7f43b1539800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.028+0000 7f43b1539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:24.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.028+0000 7f43b1539800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.029+0000 7f43b1539800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:03:24.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.029+0000 7f43b1539800 20 searching for the correct realm 2024-09-14T11:03:24.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.031+0000 7f43ad9c8640 0 -- 172.21.15.97:0/4152395637 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x55d3ad892d90 msgr2=0x55d3ad895210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:03:24.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.034+0000 7f43ad1c7640 0 -- 172.21.15.97:0/4152395637 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7f4398035b30 msgr2=0x7f439804d970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:03:24.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.039+0000 7f43b1539800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:03:24.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.039+0000 7f43b1539800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:03:24.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.039+0000 7f43b1539800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:03:24.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.039+0000 7f43b1539800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:03:24.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.039+0000 7f43b1539800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:03:24.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.039+0000 7f43b1539800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:03:24.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.039+0000 7f43b1539800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.039+0000 7f43b1539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:24.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.039+0000 7f43b1539800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.039+0000 7f43b1539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:24.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.039+0000 7f43b1539800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.039+0000 7f43b1539800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:03:24.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.039+0000 7f43b1539800 20 zone default found 2024-09-14T11:03:24.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.039+0000 7f43b1539800 4 Realm: () 2024-09-14T11:03:24.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.039+0000 7f43b1539800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:03:24.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.039+0000 7f43b1539800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:03:24.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.039+0000 7f43b1539800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:03:24.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.039+0000 7f43b1539800 20 zonegroup default 2024-09-14T11:03:24.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.039+0000 7f43b1539800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.040+0000 7f43b1539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:24.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.040+0000 7f43b1539800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.040+0000 7f43b1539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:24.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.040+0000 7f43b1539800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.040+0000 7f43b1539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:24.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.040+0000 7f43b1539800 20 started sync module instance, tier type = 2024-09-14T11:03:24.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.040+0000 7f43b1539800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:03:24.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.049+0000 7f43b1539800 20 add_watcher() i=0 2024-09-14T11:03:24.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.049+0000 7f43b1539800 20 add_watcher() i=1 2024-09-14T11:03:24.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.049+0000 7f43b1539800 20 add_watcher() i=2 2024-09-14T11:03:24.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.049+0000 7f43b1539800 20 add_watcher() i=3 2024-09-14T11:03:24.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.049+0000 7f43b1539800 20 add_watcher() i=4 2024-09-14T11:03:24.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.049+0000 7f43b1539800 20 add_watcher() i=5 2024-09-14T11:03:24.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.049+0000 7f43b1539800 20 add_watcher() i=6 2024-09-14T11:03:24.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.050+0000 7f43b1539800 20 add_watcher() i=7 2024-09-14T11:03:24.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.050+0000 7f43b1539800 2 all 8 watchers are set, enabling cache 2024-09-14T11:03:24.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.052+0000 7f4263fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:24.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.052+0000 7f43b1539800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:03:24.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.052+0000 7f43b1539800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:03:24.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.052+0000 7f43b1539800 5 note: GC not initialized 2024-09-14T11:03:24.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.052+0000 7f4262fe5640 20 reqs_thread_entry: start 2024-09-14T11:03:24.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.052+0000 7f43b1539800 20 init_complete bucket index max shards: 11 2024-09-14T11:03:24.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.052+0000 7f43b1539800 20 Filter name: none 2024-09-14T11:03:24.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.052+0000 7f4260fe1640 20 reqs_thread_entry: start 2024-09-14T11:03:24.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.052+0000 7f43b1539800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.053+0000 7f43b1539800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:03:24.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.053+0000 7f43b1539800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.053+0000 7f43b1539800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:03:24.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.053+0000 7f43b1539800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:03:24.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.053+0000 7f43b1539800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.053+0000 7f43b1539800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:03:24.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.054+0000 7f43b1539800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.054+0000 7f43b1539800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:03:24.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.054+0000 7f43b1539800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:03:24.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.056+0000 7f4263fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:24.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.058+0000 7f43b1539800 20 remove_watcher() i=0 2024-09-14T11:03:24.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.058+0000 7f43b1539800 2 removed watcher, disabling cache 2024-09-14T11:03:24.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.059+0000 7f43b1539800 20 remove_watcher() i=1 2024-09-14T11:03:24.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.060+0000 7f43b1539800 20 remove_watcher() i=2 2024-09-14T11:03:24.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.061+0000 7f43b1539800 20 remove_watcher() i=3 2024-09-14T11:03:24.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.062+0000 7f43b1539800 20 remove_watcher() i=4 2024-09-14T11:03:24.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.063+0000 7f43b1539800 20 remove_watcher() i=5 2024-09-14T11:03:24.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.063+0000 7f43b1539800 20 remove_watcher() i=6 2024-09-14T11:03:24.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.064+0000 7f43b1539800 20 remove_watcher() i=7 2024-09-14T11:03:24.104 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:24.104 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:03:24.104 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: abort-at-set-target-layout id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:03:24.104 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:24.126 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:03:24.159 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:03:24.160 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:03:24.196 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.197+0000 7ff9defa7800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.198 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.198+0000 7ff9defa7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:24.198 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.198+0000 7ff9defa7800 20 realm 2024-09-14T11:03:24.198 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.198+0000 7ff9defa7800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.198 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.198+0000 7ff9defa7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:24.198 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.198+0000 7ff9defa7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:03:24.198 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.198+0000 7ff9defa7800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.198 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.199+0000 7ff9defa7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:24.199 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.199+0000 7ff9defa7800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.199 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.199+0000 7ff9defa7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:24.199 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.199+0000 7ff9defa7800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.199 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.200+0000 7ff9defa7800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:03:24.200 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.200+0000 7ff9defa7800 20 searching for the correct realm 2024-09-14T11:03:24.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.202+0000 7ff9d4290640 0 -- 172.21.15.97:0/2443075963 >> [v2:172.21.15.97:6816/4093696477,v1:172.21.15.97:6817/4093696477] conn(0x55aaba02b8b0 msgr2=0x55aaba02dce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:03:24.205 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.205+0000 7ff9d4290640 0 -- 172.21.15.97:0/2443075963 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7ff9cc07bb30 msgr2=0x7ff9cc06a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:03:24.411 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.411+0000 7ff9defa7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:03:24.411 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.411+0000 7ff9defa7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:03:24.411 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.411+0000 7ff9defa7800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:03:24.411 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.411+0000 7ff9defa7800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:03:24.411 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.411+0000 7ff9defa7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:03:24.411 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.411+0000 7ff9defa7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:03:24.411 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.411+0000 7ff9defa7800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.412+0000 7ff9defa7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:24.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.412+0000 7ff9defa7800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.412+0000 7ff9defa7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:24.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.412+0000 7ff9defa7800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.412+0000 7ff9defa7800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:03:24.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.412+0000 7ff9defa7800 20 zone default found 2024-09-14T11:03:24.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.412+0000 7ff9defa7800 4 Realm: () 2024-09-14T11:03:24.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.412+0000 7ff9defa7800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:03:24.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.412+0000 7ff9defa7800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:03:24.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.412+0000 7ff9defa7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:03:24.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.412+0000 7ff9defa7800 20 zonegroup default 2024-09-14T11:03:24.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.412+0000 7ff9defa7800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.413+0000 7ff9defa7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:24.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.413+0000 7ff9defa7800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.413+0000 7ff9defa7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:24.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.413+0000 7ff9defa7800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.413+0000 7ff9defa7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:24.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.413+0000 7ff9defa7800 20 started sync module instance, tier type = 2024-09-14T11:03:24.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.413+0000 7ff9defa7800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:03:24.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.422+0000 7ff9defa7800 20 add_watcher() i=0 2024-09-14T11:03:24.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.422+0000 7ff9defa7800 20 add_watcher() i=1 2024-09-14T11:03:24.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.422+0000 7ff9defa7800 20 add_watcher() i=2 2024-09-14T11:03:24.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.422+0000 7ff9defa7800 20 add_watcher() i=3 2024-09-14T11:03:24.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.422+0000 7ff9defa7800 20 add_watcher() i=4 2024-09-14T11:03:24.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.422+0000 7ff9defa7800 20 add_watcher() i=5 2024-09-14T11:03:24.422 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.422+0000 7ff9defa7800 20 add_watcher() i=6 2024-09-14T11:03:24.423 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.423+0000 7ff9defa7800 20 add_watcher() i=7 2024-09-14T11:03:24.423 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.423+0000 7ff9defa7800 2 all 8 watchers are set, enabling cache 2024-09-14T11:03:24.424 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.425+0000 7ff892fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:24.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.425+0000 7ff9defa7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:03:24.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.425+0000 7ff9defa7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:03:24.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.425+0000 7ff9defa7800 5 note: GC not initialized 2024-09-14T11:03:24.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.426+0000 7ff891fe3640 20 reqs_thread_entry: start 2024-09-14T11:03:24.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.426+0000 7ff9defa7800 20 init_complete bucket index max shards: 11 2024-09-14T11:03:24.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.426+0000 7ff9defa7800 20 Filter name: none 2024-09-14T11:03:24.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.426+0000 7ff8037fe640 20 reqs_thread_entry: start 2024-09-14T11:03:24.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.426+0000 7ff9defa7800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:03:24.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.426+0000 7ff9defa7800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.426+0000 7ff9defa7800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:03:24.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.426+0000 7ff9defa7800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:03:24.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.426+0000 7ff9defa7800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:03:24.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.426+0000 7ff9defa7800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24 : miss 2024-09-14T11:03:24.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.426+0000 7ff9defa7800 20 rados->read ofs=0 len=0 2024-09-14T11:03:24.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.427+0000 7ff9defa7800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:03:24.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.427+0000 7ff9defa7800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24 info.flags=0x17 2024-09-14T11:03:24.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.427+0000 7ff9defa7800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24 to cache LRU end 2024-09-14T11:03:24.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.427+0000 7ff9defa7800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:03:24.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.427+0000 7ff9defa7800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:24.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.427+0000 7ff9defa7800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24 2024-09-14T11:03:24.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.428+0000 7ff9defa7800 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24 to be held by another RGW process; skipping for now 2024-09-14T11:03:24.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.428+0000 7ff892fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:24.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.430+0000 7ff9defa7800 20 remove_watcher() i=0 2024-09-14T11:03:24.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.430+0000 7ff9defa7800 2 removed watcher, disabling cache 2024-09-14T11:03:24.431 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.431+0000 7ff9defa7800 20 remove_watcher() i=1 2024-09-14T11:03:24.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.432+0000 7ff9defa7800 20 remove_watcher() i=2 2024-09-14T11:03:24.433 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.433+0000 7ff9defa7800 20 remove_watcher() i=3 2024-09-14T11:03:24.434 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.434+0000 7ff9defa7800 20 remove_watcher() i=4 2024-09-14T11:03:24.434 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.435+0000 7ff9defa7800 20 remove_watcher() i=5 2024-09-14T11:03:24.435 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.436+0000 7ff9defa7800 20 remove_watcher() i=6 2024-09-14T11:03:24.436 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:24.437+0000 7ff9defa7800 20 remove_watcher() i=7 2024-09-14T11:03:24.447 INFO:tasks.workunit.client.0.smithi097.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:03:54.456 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:03:54.490 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:03:54.490 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:03:54.531 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.533+0000 7f9ab9ebb800 20 rados->read ofs=0 len=0 2024-09-14T11:03:54.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.534+0000 7f9ab9ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:54.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.534+0000 7f9ab9ebb800 20 realm 2024-09-14T11:03:54.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.534+0000 7f9ab9ebb800 20 rados->read ofs=0 len=0 2024-09-14T11:03:54.534 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.534+0000 7f9ab9ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:54.534 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.534+0000 7f9ab9ebb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:03:54.534 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.534+0000 7f9ab9ebb800 20 rados->read ofs=0 len=0 2024-09-14T11:03:54.534 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.535+0000 7f9ab9ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:54.534 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.535+0000 7f9ab9ebb800 20 rados->read ofs=0 len=0 2024-09-14T11:03:54.534 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.535+0000 7f9ab9ebb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:54.534 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.535+0000 7f9ab9ebb800 20 rados->read ofs=0 len=0 2024-09-14T11:03:54.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.536+0000 7f9ab9ebb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:03:54.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.536+0000 7f9ab9ebb800 20 searching for the correct realm 2024-09-14T11:03:54.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.539+0000 7f9ab81a6640 0 -- 172.21.15.97:0/1356905580 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f9aac09bc20 msgr2=0x7f9aac04da20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:03:54.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.744+0000 7f9ab71a4640 0 -- 172.21.15.97:0/1356905580 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f9aa80a6ae0 msgr2=0x7f9aa80af6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:03:54.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.750+0000 7f9ab9ebb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:03:54.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.750+0000 7f9ab9ebb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:03:54.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.750+0000 7f9ab9ebb800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:03:54.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.750+0000 7f9ab9ebb800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:03:54.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.750+0000 7f9ab9ebb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:03:54.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.750+0000 7f9ab9ebb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:03:54.750 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.750+0000 7f9ab9ebb800 20 rados->read ofs=0 len=0 2024-09-14T11:03:54.750 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.750+0000 7f9ab9ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:54.750 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.750+0000 7f9ab9ebb800 20 rados->read ofs=0 len=0 2024-09-14T11:03:54.750 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.750+0000 7f9ab9ebb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:54.750 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.750+0000 7f9ab9ebb800 20 rados->read ofs=0 len=0 2024-09-14T11:03:54.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.751+0000 7f9ab9ebb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:03:54.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.751+0000 7f9ab9ebb800 20 zone default found 2024-09-14T11:03:54.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.751+0000 7f9ab9ebb800 4 Realm: () 2024-09-14T11:03:54.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.751+0000 7f9ab9ebb800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:03:54.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.751+0000 7f9ab9ebb800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:03:54.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.751+0000 7f9ab9ebb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:03:54.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.751+0000 7f9ab9ebb800 20 zonegroup default 2024-09-14T11:03:54.752 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.751+0000 7f9ab9ebb800 20 rados->read ofs=0 len=0 2024-09-14T11:03:54.752 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.751+0000 7f9ab9ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:54.752 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.751+0000 7f9ab9ebb800 20 rados->read ofs=0 len=0 2024-09-14T11:03:54.752 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.751+0000 7f9ab9ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:54.752 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.751+0000 7f9ab9ebb800 20 rados->read ofs=0 len=0 2024-09-14T11:03:54.752 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.752+0000 7f9ab9ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:54.752 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.752+0000 7f9ab9ebb800 20 started sync module instance, tier type = 2024-09-14T11:03:54.752 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.752+0000 7f9ab9ebb800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:03:54.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.762+0000 7f9ab9ebb800 20 add_watcher() i=0 2024-09-14T11:03:54.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.762+0000 7f9ab9ebb800 20 add_watcher() i=1 2024-09-14T11:03:54.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.762+0000 7f9ab9ebb800 20 add_watcher() i=2 2024-09-14T11:03:54.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.762+0000 7f9ab9ebb800 20 add_watcher() i=3 2024-09-14T11:03:54.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.762+0000 7f9ab9ebb800 20 add_watcher() i=4 2024-09-14T11:03:54.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.762+0000 7f9ab9ebb800 20 add_watcher() i=5 2024-09-14T11:03:54.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.762+0000 7f9ab9ebb800 20 add_watcher() i=6 2024-09-14T11:03:54.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.764+0000 7f9ab9ebb800 20 add_watcher() i=7 2024-09-14T11:03:54.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.764+0000 7f9ab9ebb800 2 all 8 watchers are set, enabling cache 2024-09-14T11:03:54.764 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.765+0000 7f996dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:54.766 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.766+0000 7f9ab9ebb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:03:54.766 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.766+0000 7f9ab9ebb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:03:54.766 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.766+0000 7f9ab9ebb800 5 note: GC not initialized 2024-09-14T11:03:54.766 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.766+0000 7f996cfe1640 20 reqs_thread_entry: start 2024-09-14T11:03:54.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.766+0000 7f9ab9ebb800 20 init_complete bucket index max shards: 11 2024-09-14T11:03:54.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.766+0000 7f9ab9ebb800 20 Filter name: none 2024-09-14T11:03:54.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.766+0000 7f98e67fc640 20 reqs_thread_entry: start 2024-09-14T11:03:54.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.767+0000 7f9ab9ebb800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:03:54.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.767+0000 7f9ab9ebb800 20 rados->read ofs=0 len=0 2024-09-14T11:03:54.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.767+0000 7f9ab9ebb800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:03:54.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.767+0000 7f9ab9ebb800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:03:54.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.767+0000 7f9ab9ebb800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:03:54.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.767+0000 7f9ab9ebb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24 : miss 2024-09-14T11:03:54.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.767+0000 7f9ab9ebb800 20 rados->read ofs=0 len=0 2024-09-14T11:03:54.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.767+0000 7f9ab9ebb800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:03:54.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.767+0000 7f9ab9ebb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24 info.flags=0x17 2024-09-14T11:03:54.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.767+0000 7f9ab9ebb800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24 to cache LRU end 2024-09-14T11:03:54.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.767+0000 7f9ab9ebb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:03:54.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.767+0000 7f9ab9ebb800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:54.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.767+0000 7f9ab9ebb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24 2024-09-14T11:03:54.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.773+0000 7f9ab9ebb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24 info.flags=0x17 2024-09-14T11:03:54.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.773+0000 7f9ab9ebb800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24 to cache LRU end 2024-09-14T11:03:54.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.773+0000 7f9ab9ebb800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:54.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.773+0000 7f9ab9ebb800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24, ofs0, ns] 2024-09-14T11:03:54.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.773+0000 7f99967fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595180 cookie 94633129004880 notifier 6350 bl.length()=925 2024-09-14T11:03:54.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.773+0000 7f99967fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24 info.flags=0x17 2024-09-14T11:03:54.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.773+0000 7f99967fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24 to cache LRU end 2024-09-14T11:03:54.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.773+0000 7f99967fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:54.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.773+0000 7f9ab9ebb800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24]): orig_sources= new_sources= 2024-09-14T11:03:54.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.773+0000 7f9ab9ebb800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24]): potential sources added=[] removed=[] 2024-09-14T11:03:54.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.773+0000 7f9ab9ebb800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24]): orig_dests= new_dests= 2024-09-14T11:03:54.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.773+0000 7f9ab9ebb800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24]): potential dests added=[] removed=[] 2024-09-14T11:03:54.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.778+0000 7f9ab9ebb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24.1.0 2024-09-14T11:03:54.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.778+0000 7f9ab9ebb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24.1.0 2024-09-14T11:03:54.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.778+0000 7f9ab9ebb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24.1.1 2024-09-14T11:03:54.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.778+0000 7f9ab9ebb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24.1.1 2024-09-14T11:03:54.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.778+0000 7f9ab9ebb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24.1.2 2024-09-14T11:03:54.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.778+0000 7f9ab9ebb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24.1.2 2024-09-14T11:03:54.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.778+0000 7f9ab9ebb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24.1.3 2024-09-14T11:03:54.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.778+0000 7f9ab9ebb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24.1.3 2024-09-14T11:03:54.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.778+0000 7f9ab9ebb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24.1.4 2024-09-14T11:03:54.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.778+0000 7f9ab9ebb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24.1.4 2024-09-14T11:03:54.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.778+0000 7f9ab9ebb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24.1.5 2024-09-14T11:03:54.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.778+0000 7f9ab9ebb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24.1.5 2024-09-14T11:03:54.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.778+0000 7f9ab9ebb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24.1.6 2024-09-14T11:03:54.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.778+0000 7f9ab9ebb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24.1.6 2024-09-14T11:03:54.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.778+0000 7f9ab9ebb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24.1.7 2024-09-14T11:03:54.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.778+0000 7f9ab9ebb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24.1.7 2024-09-14T11:03:54.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.778+0000 7f9ab9ebb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24.1.8 2024-09-14T11:03:54.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.778+0000 7f9ab9ebb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24.1.8 2024-09-14T11:03:54.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.778+0000 7f9ab9ebb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24.1.9 2024-09-14T11:03:54.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.778+0000 7f9ab9ebb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24.1.9 2024-09-14T11:03:54.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.778+0000 7f9ab9ebb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24.1.10 2024-09-14T11:03:54.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.778+0000 7f9ab9ebb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24.1.10 2024-09-14T11:03:54.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.778+0000 7f9ab9ebb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24.1.11 2024-09-14T11:03:54.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.778+0000 7f9ab9ebb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24.1.11 2024-09-14T11:03:54.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.778+0000 7f9ab9ebb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24.0 2024-09-14T11:03:54.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.778+0000 7f9ab9ebb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24.1 2024-09-14T11:03:54.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.779+0000 7f9ab9ebb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24.2 2024-09-14T11:03:54.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.780+0000 7f9ab9ebb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24.3 2024-09-14T11:03:54.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.780+0000 7f9ab9ebb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24.4 2024-09-14T11:03:54.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.781+0000 7f9ab9ebb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24.5 2024-09-14T11:03:54.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.781+0000 7f9ab9ebb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24.6 2024-09-14T11:03:54.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.782+0000 7f9ab9ebb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24.7 2024-09-14T11:03:54.781 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.783+0000 7f9ab9ebb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24.8 2024-09-14T11:03:54.781 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.783+0000 7f9ab9ebb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24.9 2024-09-14T11:03:54.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.784+0000 7f9ab9ebb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24.10 2024-09-14T11:03:54.785 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.787+0000 7f9ab9ebb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24 : hit (requested=0x17, cached=0x17) 2024-09-14T11:03:54.785 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.787+0000 7f9ab9ebb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24 2024-09-14T11:03:54.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.788+0000 7f9ab9ebb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24 info.flags=0x17 2024-09-14T11:03:54.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.788+0000 7f9ab9ebb800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24 to cache LRU end 2024-09-14T11:03:54.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.788+0000 7f9ab9ebb800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:54.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.788+0000 7f9ab9ebb800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24, ofs0, ns] 2024-09-14T11:03:54.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.789+0000 7f99967fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595181 cookie 94633129004880 notifier 6350 bl.length()=925 2024-09-14T11:03:54.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.789+0000 7f99967fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24 info.flags=0x17 2024-09-14T11:03:54.788 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.789+0000 7f99967fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24 to cache LRU end 2024-09-14T11:03:54.788 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.789+0000 7f99967fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:54.788 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.789+0000 7f9ab9ebb800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24]): orig_sources= new_sources= 2024-09-14T11:03:54.788 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.789+0000 7f9ab9ebb800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24]): potential sources added=[] removed=[] 2024-09-14T11:03:54.788 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.789+0000 7f9ab9ebb800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24]): orig_dests= new_dests= 2024-09-14T11:03:54.788 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.789+0000 7f9ab9ebb800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24]): potential dests added=[] removed=[] 2024-09-14T11:03:54.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.791+0000 7f9ab9ebb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24.0 2024-09-14T11:03:54.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.792+0000 7f9ab9ebb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24.1 2024-09-14T11:03:54.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.792+0000 7f9ab9ebb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24.2 2024-09-14T11:03:54.791 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.792+0000 7f9ab9ebb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24.3 2024-09-14T11:03:54.791 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.793+0000 7f9ab9ebb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24.4 2024-09-14T11:03:54.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.793+0000 7f9ab9ebb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24.5 2024-09-14T11:03:54.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.793+0000 7f9ab9ebb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24.6 2024-09-14T11:03:54.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.794+0000 7f9ab9ebb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24.7 2024-09-14T11:03:54.793 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.794+0000 7f9ab9ebb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24.8 2024-09-14T11:03:54.793 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.794+0000 7f9ab9ebb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24.9 2024-09-14T11:03:54.793 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.795+0000 7f9ab9ebb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24.10 2024-09-14T11:03:54.794 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.795+0000 7f9ab9ebb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24 : hit (requested=0x17, cached=0x17) 2024-09-14T11:03:54.794 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.795+0000 7f9ab9ebb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24 2024-09-14T11:03:54.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.796+0000 7f9ab9ebb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24 info.flags=0x17 2024-09-14T11:03:54.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.796+0000 7f9ab9ebb800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24 to cache LRU end 2024-09-14T11:03:54.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.796+0000 7f9ab9ebb800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:54.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.796+0000 7f9ab9ebb800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24, ofs0, ns] 2024-09-14T11:03:54.796 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.797+0000 7f99967fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595182 cookie 94633129004880 notifier 6350 bl.length()=893 2024-09-14T11:03:54.796 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.797+0000 7f99967fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24 info.flags=0x17 2024-09-14T11:03:54.796 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.797+0000 7f99967fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24 to cache LRU end 2024-09-14T11:03:54.796 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.797+0000 7f99967fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:54.796 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.797+0000 7f9ab9ebb800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24]): orig_sources= new_sources= 2024-09-14T11:03:54.796 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.797+0000 7f9ab9ebb800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24]): potential sources added=[] removed=[] 2024-09-14T11:03:54.796 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.797+0000 7f9ab9ebb800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24]): orig_dests= new_dests= 2024-09-14T11:03:54.796 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.797+0000 7f9ab9ebb800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24]): potential dests added=[] removed=[] 2024-09-14T11:03:54.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.799+0000 7f9ab9ebb800 1 execute INFO: reshard of bucket "abort-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:03:54.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.801+0000 7f996dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:54.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.803+0000 7f9ab9ebb800 20 remove_watcher() i=0 2024-09-14T11:03:54.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.803+0000 7f9ab9ebb800 2 removed watcher, disabling cache 2024-09-14T11:03:54.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.805+0000 7f9ab9ebb800 20 remove_watcher() i=1 2024-09-14T11:03:54.804 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.806+0000 7f9ab9ebb800 20 remove_watcher() i=2 2024-09-14T11:03:54.805 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.807+0000 7f9ab9ebb800 20 remove_watcher() i=3 2024-09-14T11:03:54.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.808+0000 7f9ab9ebb800 20 remove_watcher() i=4 2024-09-14T11:03:54.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.809+0000 7f9ab9ebb800 20 remove_watcher() i=5 2024-09-14T11:03:54.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.810+0000 7f9ab9ebb800 20 remove_watcher() i=6 2024-09-14T11:03:54.810 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.811+0000 7f9ab9ebb800 20 remove_watcher() i=7 2024-09-14T11:03:54.823 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-14T11:03:54.851 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:03:54.851 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:03:54.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.890+0000 7f93c362f800 20 rados->read ofs=0 len=0 2024-09-14T11:03:54.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.893+0000 7f93c362f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:54.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.893+0000 7f93c362f800 20 realm 2024-09-14T11:03:54.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.893+0000 7f93c362f800 20 rados->read ofs=0 len=0 2024-09-14T11:03:54.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.893+0000 7f93c362f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:54.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.893+0000 7f93c362f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:03:54.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.893+0000 7f93c362f800 20 rados->read ofs=0 len=0 2024-09-14T11:03:54.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.893+0000 7f93c362f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:54.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.893+0000 7f93c362f800 20 rados->read ofs=0 len=0 2024-09-14T11:03:54.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.894+0000 7f93c362f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:54.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.894+0000 7f93c362f800 20 rados->read ofs=0 len=0 2024-09-14T11:03:54.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.894+0000 7f93c362f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:03:54.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.895+0000 7f93c362f800 20 searching for the correct realm 2024-09-14T11:03:54.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:54.897+0000 7f93bf1cd640 0 -- 172.21.15.97:0/1814024821 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f93a8008070 msgr2=0x7f93a805a400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:03:55.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.103+0000 7f93b61cb640 0 -- 172.21.15.97:0/1814024821 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f93b00c7da0 msgr2=0x7f93b00cbd50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:03:55.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.109+0000 7f93c362f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:03:55.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.109+0000 7f93c362f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:03:55.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.109+0000 7f93c362f800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:03:55.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.109+0000 7f93c362f800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:03:55.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.109+0000 7f93c362f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:03:55.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.109+0000 7f93c362f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:03:55.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.109+0000 7f93c362f800 20 rados->read ofs=0 len=0 2024-09-14T11:03:55.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.109+0000 7f93c362f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:55.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.109+0000 7f93c362f800 20 rados->read ofs=0 len=0 2024-09-14T11:03:55.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.109+0000 7f93c362f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:55.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.109+0000 7f93c362f800 20 rados->read ofs=0 len=0 2024-09-14T11:03:55.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.110+0000 7f93c362f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:03:55.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.110+0000 7f93c362f800 20 zone default found 2024-09-14T11:03:55.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.110+0000 7f93c362f800 4 Realm: () 2024-09-14T11:03:55.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.110+0000 7f93c362f800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:03:55.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.110+0000 7f93c362f800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:03:55.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.110+0000 7f93c362f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:03:55.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.110+0000 7f93c362f800 20 zonegroup default 2024-09-14T11:03:55.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.110+0000 7f93c362f800 20 rados->read ofs=0 len=0 2024-09-14T11:03:55.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.110+0000 7f93c362f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:55.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.110+0000 7f93c362f800 20 rados->read ofs=0 len=0 2024-09-14T11:03:55.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.110+0000 7f93c362f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:55.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.110+0000 7f93c362f800 20 rados->read ofs=0 len=0 2024-09-14T11:03:55.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.110+0000 7f93c362f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:55.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.110+0000 7f93c362f800 20 started sync module instance, tier type = 2024-09-14T11:03:55.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.110+0000 7f93c362f800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:03:55.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.120+0000 7f93c362f800 20 add_watcher() i=0 2024-09-14T11:03:55.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.120+0000 7f93c362f800 20 add_watcher() i=1 2024-09-14T11:03:55.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.120+0000 7f93c362f800 20 add_watcher() i=2 2024-09-14T11:03:55.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.120+0000 7f93c362f800 20 add_watcher() i=3 2024-09-14T11:03:55.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.120+0000 7f93c362f800 20 add_watcher() i=4 2024-09-14T11:03:55.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.120+0000 7f93c362f800 20 add_watcher() i=5 2024-09-14T11:03:55.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.120+0000 7f93c362f800 20 add_watcher() i=6 2024-09-14T11:03:55.120 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.121+0000 7f93c362f800 20 add_watcher() i=7 2024-09-14T11:03:55.120 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.121+0000 7f93c362f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:03:55.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.124+0000 7f92757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:55.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.124+0000 7f93c362f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:03:55.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.124+0000 7f93c362f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:03:55.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.124+0000 7f93c362f800 5 note: GC not initialized 2024-09-14T11:03:55.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.124+0000 7f91effff640 20 reqs_thread_entry: start 2024-09-14T11:03:55.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.124+0000 7f93c362f800 20 init_complete bucket index max shards: 11 2024-09-14T11:03:55.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.124+0000 7f93c362f800 20 Filter name: none 2024-09-14T11:03:55.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.124+0000 7f91edffb640 20 reqs_thread_entry: start 2024-09-14T11:03:55.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.124+0000 7f93c362f800 20 rados->read ofs=0 len=0 2024-09-14T11:03:55.124 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.125+0000 7f93c362f800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:03:55.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.125+0000 7f93c362f800 20 rados->read ofs=0 len=0 2024-09-14T11:03:55.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.126+0000 7f93c362f800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:03:55.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.126+0000 7f93c362f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:03:55.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.126+0000 7f93c362f800 20 rados->read ofs=0 len=0 2024-09-14T11:03:55.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.126+0000 7f93c362f800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:03:55.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.126+0000 7f93c362f800 20 rados->read ofs=0 len=0 2024-09-14T11:03:55.126 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.126+0000 7f93c362f800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:03:55.126 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.126+0000 7f93c362f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:03:55.126 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.128+0000 7f92757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:55.128 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.130+0000 7f93c362f800 20 remove_watcher() i=0 2024-09-14T11:03:55.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.130+0000 7f93c362f800 2 removed watcher, disabling cache 2024-09-14T11:03:55.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.131+0000 7f93c362f800 20 remove_watcher() i=1 2024-09-14T11:03:55.130 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.132+0000 7f93c362f800 20 remove_watcher() i=2 2024-09-14T11:03:55.132 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.133+0000 7f93c362f800 20 remove_watcher() i=3 2024-09-14T11:03:55.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.134+0000 7f93c362f800 20 remove_watcher() i=4 2024-09-14T11:03:55.134 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.136+0000 7f93c362f800 20 remove_watcher() i=5 2024-09-14T11:03:55.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.137+0000 7f93c362f800 20 remove_watcher() i=6 2024-09-14T11:03:55.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.138+0000 7f93c362f800 20 remove_watcher() i=7 2024-09-14T11:03:55.147 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:55.147 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:03:55.147 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: abort-at-set-target-layout id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:03:55.147 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:55.222 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: reshard bucket with EIO injected at trim_reshard_log_entries 2024-09-14T11:03:55.223 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:55.423 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:03:55.451 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:03:55.451 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:03:55.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.489+0000 7f0871213800 20 rados->read ofs=0 len=0 2024-09-14T11:03:55.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.491+0000 7f0871213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:55.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.491+0000 7f0871213800 20 realm 2024-09-14T11:03:55.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.491+0000 7f0871213800 20 rados->read ofs=0 len=0 2024-09-14T11:03:55.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.491+0000 7f0871213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:55.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.491+0000 7f0871213800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:03:55.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.491+0000 7f0871213800 20 rados->read ofs=0 len=0 2024-09-14T11:03:55.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.491+0000 7f0871213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:55.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.491+0000 7f0871213800 20 rados->read ofs=0 len=0 2024-09-14T11:03:55.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.492+0000 7f0871213800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:55.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.492+0000 7f0871213800 20 rados->read ofs=0 len=0 2024-09-14T11:03:55.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.493+0000 7f0871213800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:03:55.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.493+0000 7f0871213800 20 searching for the correct realm 2024-09-14T11:03:55.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.494+0000 7f0867fff640 0 -- 172.21.15.97:0/3008740627 >> [v2:172.21.15.97:6808/2081705332,v1:172.21.15.97:6809/2081705332] conn(0x7f08600d9150 msgr2=0x7f08600be720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:03:55.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.698+0000 7f086d149640 0 -- 172.21.15.97:0/3008740627 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x55e790a6e190 msgr2=0x55e790a70650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:03:55.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.704+0000 7f0871213800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:03:55.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.704+0000 7f0871213800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:03:55.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.704+0000 7f0871213800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:03:55.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.704+0000 7f0871213800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:03:55.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.704+0000 7f0871213800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:03:55.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.704+0000 7f0871213800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:03:55.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.704+0000 7f0871213800 20 rados->read ofs=0 len=0 2024-09-14T11:03:55.705 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.704+0000 7f0871213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:55.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.704+0000 7f0871213800 20 rados->read ofs=0 len=0 2024-09-14T11:03:55.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.704+0000 7f0871213800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:55.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.704+0000 7f0871213800 20 rados->read ofs=0 len=0 2024-09-14T11:03:55.706 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.705+0000 7f0871213800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:03:55.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.705+0000 7f0871213800 20 zone default found 2024-09-14T11:03:55.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.705+0000 7f0871213800 4 Realm: () 2024-09-14T11:03:55.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.705+0000 7f0871213800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:03:55.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.705+0000 7f0871213800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:03:55.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.705+0000 7f0871213800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:03:55.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.705+0000 7f0871213800 20 zonegroup default 2024-09-14T11:03:55.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.705+0000 7f0871213800 20 rados->read ofs=0 len=0 2024-09-14T11:03:55.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.705+0000 7f0871213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:55.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.705+0000 7f0871213800 20 rados->read ofs=0 len=0 2024-09-14T11:03:55.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.705+0000 7f0871213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:55.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.705+0000 7f0871213800 20 rados->read ofs=0 len=0 2024-09-14T11:03:55.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.705+0000 7f0871213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:55.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.705+0000 7f0871213800 20 started sync module instance, tier type = 2024-09-14T11:03:55.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.705+0000 7f0871213800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:03:55.712 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.714+0000 7f0871213800 20 add_watcher() i=0 2024-09-14T11:03:55.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.714+0000 7f0871213800 20 add_watcher() i=1 2024-09-14T11:03:55.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.714+0000 7f0871213800 20 add_watcher() i=2 2024-09-14T11:03:55.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.714+0000 7f0871213800 20 add_watcher() i=3 2024-09-14T11:03:55.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.714+0000 7f0871213800 20 add_watcher() i=4 2024-09-14T11:03:55.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.714+0000 7f0871213800 20 add_watcher() i=5 2024-09-14T11:03:55.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.714+0000 7f0871213800 20 add_watcher() i=6 2024-09-14T11:03:55.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.715+0000 7f0871213800 20 add_watcher() i=7 2024-09-14T11:03:55.714 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.715+0000 7f0871213800 2 all 8 watchers are set, enabling cache 2024-09-14T11:03:55.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.717+0000 7f0722fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:55.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.717+0000 7f0871213800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:03:55.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.717+0000 7f0871213800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:03:55.716 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.717+0000 7f0871213800 5 note: GC not initialized 2024-09-14T11:03:55.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.717+0000 7f0721fe3640 20 reqs_thread_entry: start 2024-09-14T11:03:55.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.717+0000 7f0871213800 20 init_complete bucket index max shards: 11 2024-09-14T11:03:55.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.718+0000 7f0871213800 20 Filter name: none 2024-09-14T11:03:55.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.718+0000 7f06937fe640 20 reqs_thread_entry: start 2024-09-14T11:03:55.717 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.718+0000 7f0871213800 20 rados->read ofs=0 len=0 2024-09-14T11:03:55.718 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.718+0000 7f0871213800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:03:55.718 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.718+0000 7f0871213800 20 rados->read ofs=0 len=0 2024-09-14T11:03:55.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.719+0000 7f0871213800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:03:55.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.719+0000 7f0871213800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:03:55.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.719+0000 7f0871213800 20 rados->read ofs=0 len=0 2024-09-14T11:03:55.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.719+0000 7f0871213800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:03:55.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.719+0000 7f0871213800 20 rados->read ofs=0 len=0 2024-09-14T11:03:55.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.719+0000 7f0871213800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:03:55.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.719+0000 7f0871213800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:03:55.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.721+0000 7f0722fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:55.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.723+0000 7f0871213800 20 remove_watcher() i=0 2024-09-14T11:03:55.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.723+0000 7f0871213800 2 removed watcher, disabling cache 2024-09-14T11:03:55.723 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.725+0000 7f0871213800 20 remove_watcher() i=1 2024-09-14T11:03:55.724 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.726+0000 7f0871213800 20 remove_watcher() i=2 2024-09-14T11:03:55.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.727+0000 7f0871213800 20 remove_watcher() i=3 2024-09-14T11:03:55.726 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.728+0000 7f0871213800 20 remove_watcher() i=4 2024-09-14T11:03:55.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.728+0000 7f0871213800 20 remove_watcher() i=5 2024-09-14T11:03:55.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.729+0000 7f0871213800 20 remove_watcher() i=6 2024-09-14T11:03:55.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.730+0000 7f0871213800 20 remove_watcher() i=7 2024-09-14T11:03:55.739 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:55.739 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:03:55.739 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-trim-reshard-log-entries id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:03:55.739 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:55.741 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries 2024-09-14T11:03:55.774 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:03:55.774 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:03:55.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.812+0000 7f97d6096800 20 rados->read ofs=0 len=0 2024-09-14T11:03:55.813 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.814+0000 7f97d6096800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:55.813 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.814+0000 7f97d6096800 20 realm 2024-09-14T11:03:55.813 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.814+0000 7f97d6096800 20 rados->read ofs=0 len=0 2024-09-14T11:03:55.813 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.814+0000 7f97d6096800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:55.813 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.814+0000 7f97d6096800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:03:55.813 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.814+0000 7f97d6096800 20 rados->read ofs=0 len=0 2024-09-14T11:03:55.813 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.814+0000 7f97d6096800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:55.813 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.814+0000 7f97d6096800 20 rados->read ofs=0 len=0 2024-09-14T11:03:55.814 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.815+0000 7f97d6096800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:55.814 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.815+0000 7f97d6096800 20 rados->read ofs=0 len=0 2024-09-14T11:03:55.814 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.816+0000 7f97d6096800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:03:55.815 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.816+0000 7f97d6096800 20 searching for the correct realm 2024-09-14T11:03:55.816 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.818+0000 7f97d4381640 0 -- 172.21.15.97:0/42469439 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x561646bb2e50 msgr2=0x561646bb5310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:03:55.819 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.821+0000 7f97d3b80640 0 -- 172.21.15.97:0/42469439 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7f97bc0e50b0 msgr2=0x7f97bc0b2840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:03:55.825 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.826+0000 7f97d6096800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:03:55.825 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.826+0000 7f97d6096800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:03:55.825 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.826+0000 7f97d6096800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:03:55.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.826+0000 7f97d6096800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:03:55.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.826+0000 7f97d6096800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:03:55.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.826+0000 7f97d6096800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:03:55.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.826+0000 7f97d6096800 20 rados->read ofs=0 len=0 2024-09-14T11:03:55.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.826+0000 7f97d6096800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:55.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.826+0000 7f97d6096800 20 rados->read ofs=0 len=0 2024-09-14T11:03:55.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.826+0000 7f97d6096800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:55.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.826+0000 7f97d6096800 20 rados->read ofs=0 len=0 2024-09-14T11:03:55.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.826+0000 7f97d6096800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:03:55.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.826+0000 7f97d6096800 20 zone default found 2024-09-14T11:03:55.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.826+0000 7f97d6096800 4 Realm: () 2024-09-14T11:03:55.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.826+0000 7f97d6096800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:03:55.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.826+0000 7f97d6096800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:03:55.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.826+0000 7f97d6096800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:03:55.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.826+0000 7f97d6096800 20 zonegroup default 2024-09-14T11:03:55.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.826+0000 7f97d6096800 20 rados->read ofs=0 len=0 2024-09-14T11:03:55.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.827+0000 7f97d6096800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:55.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.827+0000 7f97d6096800 20 rados->read ofs=0 len=0 2024-09-14T11:03:55.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.827+0000 7f97d6096800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:55.827 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.827+0000 7f97d6096800 20 rados->read ofs=0 len=0 2024-09-14T11:03:55.828 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.827+0000 7f97d6096800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:55.828 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.827+0000 7f97d6096800 20 started sync module instance, tier type = 2024-09-14T11:03:55.828 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.827+0000 7f97d6096800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:03:55.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.835+0000 7f97d6096800 20 add_watcher() i=0 2024-09-14T11:03:55.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.835+0000 7f97d6096800 20 add_watcher() i=1 2024-09-14T11:03:55.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.835+0000 7f97d6096800 20 add_watcher() i=2 2024-09-14T11:03:55.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.835+0000 7f97d6096800 20 add_watcher() i=3 2024-09-14T11:03:55.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.835+0000 7f97d6096800 20 add_watcher() i=4 2024-09-14T11:03:55.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.835+0000 7f97d6096800 20 add_watcher() i=5 2024-09-14T11:03:55.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.835+0000 7f97d6096800 20 add_watcher() i=6 2024-09-14T11:03:55.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.836+0000 7f97d6096800 20 add_watcher() i=7 2024-09-14T11:03:55.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.836+0000 7f97d6096800 2 all 8 watchers are set, enabling cache 2024-09-14T11:03:55.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.838+0000 7f9689fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:55.837 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.838+0000 7f97d6096800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:03:55.837 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.838+0000 7f97d6096800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:03:55.837 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.838+0000 7f97d6096800 5 note: GC not initialized 2024-09-14T11:03:55.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.839+0000 7f9688fe1640 20 reqs_thread_entry: start 2024-09-14T11:03:55.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.839+0000 7f97d6096800 20 init_complete bucket index max shards: 11 2024-09-14T11:03:55.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.839+0000 7f97d6096800 20 Filter name: none 2024-09-14T11:03:55.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.839+0000 7f96027fc640 20 reqs_thread_entry: start 2024-09-14T11:03:55.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.839+0000 7f97d6096800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-14T11:03:55.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.839+0000 7f97d6096800 20 rados->read ofs=0 len=0 2024-09-14T11:03:55.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.839+0000 7f97d6096800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:03:55.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.839+0000 7f97d6096800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:03:55.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.839+0000 7f97d6096800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:03:55.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.839+0000 7f97d6096800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25 : miss 2024-09-14T11:03:55.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.839+0000 7f97d6096800 20 rados->read ofs=0 len=0 2024-09-14T11:03:55.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.840+0000 7f97d6096800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:03:55.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.840+0000 7f97d6096800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25 info.flags=0x17 2024-09-14T11:03:55.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.840+0000 7f97d6096800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25 to cache LRU end 2024-09-14T11:03:55.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.840+0000 7f97d6096800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:03:55.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.840+0000 7f97d6096800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:55.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.840+0000 7f97d6096800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25 2024-09-14T11:03:55.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.845+0000 7f97d6096800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25 info.flags=0x17 2024-09-14T11:03:55.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.845+0000 7f97d6096800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25 to cache LRU end 2024-09-14T11:03:55.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.845+0000 7f97d6096800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:55.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.845+0000 7f97d6096800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25, ofs0, ns] 2024-09-14T11:03:55.844 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.845+0000 7f96b27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595100 cookie 94653676008960 notifier 6401 bl.length()=939 2024-09-14T11:03:55.844 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.845+0000 7f96b27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25 info.flags=0x17 2024-09-14T11:03:55.844 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.845+0000 7f96b27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25 to cache LRU end 2024-09-14T11:03:55.844 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.845+0000 7f96b27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:55.844 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.845+0000 7f97d6096800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25]): orig_sources= new_sources= 2024-09-14T11:03:55.844 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.845+0000 7f97d6096800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25]): potential sources added=[] removed=[] 2024-09-14T11:03:55.844 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.845+0000 7f97d6096800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25]): orig_dests= new_dests= 2024-09-14T11:03:55.844 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.845+0000 7f97d6096800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25]): potential dests added=[] removed=[] 2024-09-14T11:03:55.845 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.845+0000 7f97d6096800 -1 Injecting error=-5 at location=trim_reshard_log_entries 2024-09-14T11:03:55.845 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.845+0000 7f97d6096800 0 ERROR: init_reshard failed to trim reshard log entries: (5) Input/output error 2024-09-14T11:03:55.845 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.847+0000 7f9689fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:55.848 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.849+0000 7f97d6096800 20 remove_watcher() i=0 2024-09-14T11:03:55.848 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.849+0000 7f97d6096800 2 removed watcher, disabling cache 2024-09-14T11:03:55.849 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.850+0000 7f97d6096800 20 remove_watcher() i=1 2024-09-14T11:03:55.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.851+0000 7f97d6096800 20 remove_watcher() i=2 2024-09-14T11:03:55.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.852+0000 7f97d6096800 20 remove_watcher() i=3 2024-09-14T11:03:55.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.853+0000 7f97d6096800 20 remove_watcher() i=4 2024-09-14T11:03:55.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.854+0000 7f97d6096800 20 remove_watcher() i=5 2024-09-14T11:03:55.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.855+0000 7f97d6096800 20 remove_watcher() i=6 2024-09-14T11:03:55.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.856+0000 7f97d6096800 20 remove_watcher() i=7 2024-09-14T11:03:55.867 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:03:55.896 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:03:55.897 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:03:55.933 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.934+0000 7f8cc753a800 20 rados->read ofs=0 len=0 2024-09-14T11:03:55.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.936+0000 7f8cc753a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:55.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.936+0000 7f8cc753a800 20 realm 2024-09-14T11:03:55.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.936+0000 7f8cc753a800 20 rados->read ofs=0 len=0 2024-09-14T11:03:55.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.936+0000 7f8cc753a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:55.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.936+0000 7f8cc753a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:03:55.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.936+0000 7f8cc753a800 20 rados->read ofs=0 len=0 2024-09-14T11:03:55.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.936+0000 7f8cc753a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:55.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.936+0000 7f8cc753a800 20 rados->read ofs=0 len=0 2024-09-14T11:03:55.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.937+0000 7f8cc753a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:55.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.937+0000 7f8cc753a800 20 rados->read ofs=0 len=0 2024-09-14T11:03:55.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.938+0000 7f8cc753a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:03:55.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.938+0000 7f8cc753a800 20 searching for the correct realm 2024-09-14T11:03:55.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:55.940+0000 7f8cc3abc640 0 -- 172.21.15.97:0/2604509866 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f8cac028040 msgr2=0x7f8cac029940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:03:56.144 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.145+0000 7f8cbbfff640 0 -- 172.21.15.97:0/2604509866 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f8cb40ae840 msgr2=0x7f8cb4056900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:03:56.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.150+0000 7f8cc753a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:03:56.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.150+0000 7f8cc753a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:03:56.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.150+0000 7f8cc753a800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:03:56.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.150+0000 7f8cc753a800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:03:56.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.150+0000 7f8cc753a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:03:56.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.150+0000 7f8cc753a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:03:56.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.150+0000 7f8cc753a800 20 rados->read ofs=0 len=0 2024-09-14T11:03:56.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.150+0000 7f8cc753a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:56.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.150+0000 7f8cc753a800 20 rados->read ofs=0 len=0 2024-09-14T11:03:56.150 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.151+0000 7f8cc753a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:56.150 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.151+0000 7f8cc753a800 20 rados->read ofs=0 len=0 2024-09-14T11:03:56.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.151+0000 7f8cc753a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:03:56.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.151+0000 7f8cc753a800 20 zone default found 2024-09-14T11:03:56.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.151+0000 7f8cc753a800 4 Realm: () 2024-09-14T11:03:56.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.151+0000 7f8cc753a800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:03:56.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.151+0000 7f8cc753a800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:03:56.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.151+0000 7f8cc753a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:03:56.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.151+0000 7f8cc753a800 20 zonegroup default 2024-09-14T11:03:56.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.151+0000 7f8cc753a800 20 rados->read ofs=0 len=0 2024-09-14T11:03:56.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.151+0000 7f8cc753a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:56.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.151+0000 7f8cc753a800 20 rados->read ofs=0 len=0 2024-09-14T11:03:56.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.151+0000 7f8cc753a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:56.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.151+0000 7f8cc753a800 20 rados->read ofs=0 len=0 2024-09-14T11:03:56.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.152+0000 7f8cc753a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:56.152 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.152+0000 7f8cc753a800 20 started sync module instance, tier type = 2024-09-14T11:03:56.152 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.152+0000 7f8cc753a800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:03:56.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.161+0000 7f8cc753a800 20 add_watcher() i=0 2024-09-14T11:03:56.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.161+0000 7f8cc753a800 20 add_watcher() i=1 2024-09-14T11:03:56.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.161+0000 7f8cc753a800 20 add_watcher() i=2 2024-09-14T11:03:56.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.161+0000 7f8cc753a800 20 add_watcher() i=3 2024-09-14T11:03:56.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.161+0000 7f8cc753a800 20 add_watcher() i=4 2024-09-14T11:03:56.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.161+0000 7f8cc753a800 20 add_watcher() i=5 2024-09-14T11:03:56.160 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.161+0000 7f8cc753a800 20 add_watcher() i=6 2024-09-14T11:03:56.160 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.161+0000 7f8cc753a800 20 add_watcher() i=7 2024-09-14T11:03:56.160 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.161+0000 7f8cc753a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:03:56.162 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.163+0000 7f8b79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:56.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.164+0000 7f8cc753a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:03:56.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.164+0000 7f8cc753a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:03:56.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.164+0000 7f8cc753a800 5 note: GC not initialized 2024-09-14T11:03:56.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.164+0000 7f8b78fe1640 20 reqs_thread_entry: start 2024-09-14T11:03:56.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.164+0000 7f8cc753a800 20 init_complete bucket index max shards: 11 2024-09-14T11:03:56.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.164+0000 7f8cc753a800 20 Filter name: none 2024-09-14T11:03:56.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.164+0000 7f8af27fc640 20 reqs_thread_entry: start 2024-09-14T11:03:56.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.164+0000 7f8cc753a800 20 rados->read ofs=0 len=0 2024-09-14T11:03:56.164 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.164+0000 7f8cc753a800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:03:56.164 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.164+0000 7f8cc753a800 20 rados->read ofs=0 len=0 2024-09-14T11:03:56.164 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.165+0000 7f8cc753a800 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:03:56.164 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.165+0000 7f8cc753a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:03:56.164 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.165+0000 7f8cc753a800 20 rados->read ofs=0 len=0 2024-09-14T11:03:56.164 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.165+0000 7f8cc753a800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:03:56.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.165+0000 7f8cc753a800 20 rados->read ofs=0 len=0 2024-09-14T11:03:56.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.166+0000 7f8cc753a800 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:03:56.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.166+0000 7f8cc753a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:03:56.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.167+0000 7f8b79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:56.168 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.169+0000 7f8cc753a800 20 remove_watcher() i=0 2024-09-14T11:03:56.168 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.169+0000 7f8cc753a800 2 removed watcher, disabling cache 2024-09-14T11:03:56.169 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.170+0000 7f8cc753a800 20 remove_watcher() i=1 2024-09-14T11:03:56.170 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.171+0000 7f8cc753a800 20 remove_watcher() i=2 2024-09-14T11:03:56.171 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.172+0000 7f8cc753a800 20 remove_watcher() i=3 2024-09-14T11:03:56.172 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.173+0000 7f8cc753a800 20 remove_watcher() i=4 2024-09-14T11:03:56.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.174+0000 7f8cc753a800 20 remove_watcher() i=5 2024-09-14T11:03:56.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.175+0000 7f8cc753a800 20 remove_watcher() i=6 2024-09-14T11:03:56.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.176+0000 7f8cc753a800 20 remove_watcher() i=7 2024-09-14T11:03:56.184 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:56.184 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:03:56.184 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-trim-reshard-log-entries id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:03:56.185 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:56.236 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:03:56.267 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:03:56.267 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:03:56.304 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.306+0000 7f47074bb800 20 rados->read ofs=0 len=0 2024-09-14T11:03:56.307 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.308+0000 7f47074bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:56.307 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.308+0000 7f47074bb800 20 realm 2024-09-14T11:03:56.308 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.308+0000 7f47074bb800 20 rados->read ofs=0 len=0 2024-09-14T11:03:56.308 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.308+0000 7f47074bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:56.308 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.308+0000 7f47074bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:03:56.308 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.308+0000 7f47074bb800 20 rados->read ofs=0 len=0 2024-09-14T11:03:56.308 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.308+0000 7f47074bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:56.309 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.308+0000 7f47074bb800 20 rados->read ofs=0 len=0 2024-09-14T11:03:56.309 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.309+0000 7f47074bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:56.309 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.309+0000 7f47074bb800 20 rados->read ofs=0 len=0 2024-09-14T11:03:56.310 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.310+0000 7f47074bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:03:56.310 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.310+0000 7f47074bb800 20 searching for the correct realm 2024-09-14T11:03:56.310 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.312+0000 7f47057a6640 0 -- 172.21.15.97:0/494962666 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f46f8080020 msgr2=0x7f46f80733a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:03:56.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.517+0000 7f47047a4640 0 -- 172.21.15.97:0/494962666 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f46f4069400 msgr2=0x7f46f4069880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:03:56.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.522+0000 7f47074bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:03:56.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.522+0000 7f47074bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:03:56.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.522+0000 7f47074bb800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:03:56.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.522+0000 7f47074bb800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:03:56.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.522+0000 7f47074bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:03:56.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.522+0000 7f47074bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:03:56.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.522+0000 7f47074bb800 20 rados->read ofs=0 len=0 2024-09-14T11:03:56.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.523+0000 7f47074bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:56.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.523+0000 7f47074bb800 20 rados->read ofs=0 len=0 2024-09-14T11:03:56.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.523+0000 7f47074bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:56.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.523+0000 7f47074bb800 20 rados->read ofs=0 len=0 2024-09-14T11:03:56.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.523+0000 7f47074bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:03:56.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.523+0000 7f47074bb800 20 zone default found 2024-09-14T11:03:56.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.523+0000 7f47074bb800 4 Realm: () 2024-09-14T11:03:56.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.523+0000 7f47074bb800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:03:56.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.523+0000 7f47074bb800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:03:56.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.523+0000 7f47074bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:03:56.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.523+0000 7f47074bb800 20 zonegroup default 2024-09-14T11:03:56.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.523+0000 7f47074bb800 20 rados->read ofs=0 len=0 2024-09-14T11:03:56.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.523+0000 7f47074bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:56.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.523+0000 7f47074bb800 20 rados->read ofs=0 len=0 2024-09-14T11:03:56.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.524+0000 7f47074bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:56.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.524+0000 7f47074bb800 20 rados->read ofs=0 len=0 2024-09-14T11:03:56.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.524+0000 7f47074bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:56.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.524+0000 7f47074bb800 20 started sync module instance, tier type = 2024-09-14T11:03:56.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.524+0000 7f47074bb800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:03:56.531 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.532+0000 7f47074bb800 20 add_watcher() i=0 2024-09-14T11:03:56.531 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.532+0000 7f47074bb800 20 add_watcher() i=1 2024-09-14T11:03:56.531 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.532+0000 7f47074bb800 20 add_watcher() i=2 2024-09-14T11:03:56.531 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.532+0000 7f47074bb800 20 add_watcher() i=3 2024-09-14T11:03:56.532 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.532+0000 7f47074bb800 20 add_watcher() i=4 2024-09-14T11:03:56.532 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.532+0000 7f47074bb800 20 add_watcher() i=5 2024-09-14T11:03:56.532 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.532+0000 7f47074bb800 20 add_watcher() i=6 2024-09-14T11:03:56.532 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.533+0000 7f47074bb800 20 add_watcher() i=7 2024-09-14T11:03:56.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.533+0000 7f47074bb800 2 all 8 watchers are set, enabling cache 2024-09-14T11:03:56.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.535+0000 7f45bafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:56.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.535+0000 7f47074bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:03:56.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.535+0000 7f47074bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:03:56.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.535+0000 7f47074bb800 5 note: GC not initialized 2024-09-14T11:03:56.536 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.535+0000 7f45b9fe3640 20 reqs_thread_entry: start 2024-09-14T11:03:56.536 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.535+0000 7f47074bb800 20 init_complete bucket index max shards: 11 2024-09-14T11:03:56.536 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.535+0000 7f47074bb800 20 Filter name: none 2024-09-14T11:03:56.536 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.536+0000 7f452b7fe640 20 reqs_thread_entry: start 2024-09-14T11:03:56.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.536+0000 7f47074bb800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-14T11:03:56.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.536+0000 7f47074bb800 20 rados->read ofs=0 len=0 2024-09-14T11:03:56.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.536+0000 7f47074bb800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:03:56.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.536+0000 7f47074bb800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:03:56.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.536+0000 7f47074bb800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:03:56.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.536+0000 7f47074bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25 : miss 2024-09-14T11:03:56.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.536+0000 7f47074bb800 20 rados->read ofs=0 len=0 2024-09-14T11:03:56.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.536+0000 7f47074bb800 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:03:56.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.536+0000 7f47074bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25 info.flags=0x17 2024-09-14T11:03:56.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.536+0000 7f47074bb800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25 to cache LRU end 2024-09-14T11:03:56.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.536+0000 7f47074bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:03:56.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.536+0000 7f47074bb800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:56.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.536+0000 7f47074bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25 2024-09-14T11:03:56.539 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.537+0000 7f47074bb800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:03:56.541 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.543+0000 7f47074bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25 info.flags=0x17 2024-09-14T11:03:56.541 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.543+0000 7f47074bb800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25 to cache LRU end 2024-09-14T11:03:56.542 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.543+0000 7f47074bb800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:56.542 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.543+0000 7f47074bb800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25, ofs0, ns] 2024-09-14T11:03:56.542 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.543+0000 7f45dbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595101 cookie 94540456129712 notifier 6434 bl.length()=939 2024-09-14T11:03:56.542 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.543+0000 7f45dbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25 info.flags=0x17 2024-09-14T11:03:56.542 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.543+0000 7f45dbfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25 to cache LRU end 2024-09-14T11:03:56.542 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.543+0000 7f45dbfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:56.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.544+0000 7f47074bb800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25]): orig_sources= new_sources= 2024-09-14T11:03:56.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.544+0000 7f47074bb800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25]): potential sources added=[] removed=[] 2024-09-14T11:03:56.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.544+0000 7f47074bb800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25]): orig_dests= new_dests= 2024-09-14T11:03:56.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.544+0000 7f47074bb800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25]): potential dests added=[] removed=[] 2024-09-14T11:03:56.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.548+0000 7f47074bb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25.2.0 2024-09-14T11:03:56.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.548+0000 7f47074bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25.2.0 2024-09-14T11:03:56.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.548+0000 7f47074bb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25.2.1 2024-09-14T11:03:56.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.548+0000 7f47074bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25.2.1 2024-09-14T11:03:56.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.548+0000 7f47074bb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25.2.2 2024-09-14T11:03:56.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.548+0000 7f47074bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25.2.2 2024-09-14T11:03:56.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.548+0000 7f47074bb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25.2.3 2024-09-14T11:03:56.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.548+0000 7f47074bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25.2.3 2024-09-14T11:03:56.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.548+0000 7f47074bb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25.2.4 2024-09-14T11:03:56.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.548+0000 7f47074bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25.2.4 2024-09-14T11:03:56.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.548+0000 7f47074bb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25.2.5 2024-09-14T11:03:56.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.548+0000 7f47074bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25.2.5 2024-09-14T11:03:56.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.548+0000 7f47074bb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25.2.6 2024-09-14T11:03:56.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.548+0000 7f47074bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25.2.6 2024-09-14T11:03:56.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.548+0000 7f47074bb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25.2.7 2024-09-14T11:03:56.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.548+0000 7f47074bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25.2.7 2024-09-14T11:03:56.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.548+0000 7f47074bb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25.2.8 2024-09-14T11:03:56.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.548+0000 7f47074bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25.2.8 2024-09-14T11:03:56.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.548+0000 7f47074bb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25.2.9 2024-09-14T11:03:56.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.548+0000 7f47074bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25.2.9 2024-09-14T11:03:56.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.548+0000 7f47074bb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25.2.10 2024-09-14T11:03:56.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.548+0000 7f47074bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25.2.10 2024-09-14T11:03:56.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.548+0000 7f47074bb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25.2.11 2024-09-14T11:03:56.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.548+0000 7f47074bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25.2.11 2024-09-14T11:03:56.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.548+0000 7f47074bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25.0 2024-09-14T11:03:56.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.548+0000 7f47074bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25.1 2024-09-14T11:03:56.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.549+0000 7f47074bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25.2 2024-09-14T11:03:56.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.549+0000 7f47074bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25.3 2024-09-14T11:03:56.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.550+0000 7f47074bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25.4 2024-09-14T11:03:56.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.550+0000 7f47074bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25.5 2024-09-14T11:03:56.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.551+0000 7f47074bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25.6 2024-09-14T11:03:56.552 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.551+0000 7f47074bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25.7 2024-09-14T11:03:56.552 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.551+0000 7f47074bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25.8 2024-09-14T11:03:56.552 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.552+0000 7f47074bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25.9 2024-09-14T11:03:56.552 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.553+0000 7f47074bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25.10 2024-09-14T11:03:56.554 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.555+0000 7f47074bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25 : hit (requested=0x17, cached=0x17) 2024-09-14T11:03:56.554 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.555+0000 7f47074bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25 2024-09-14T11:03:56.555 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.556+0000 7f47074bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25 info.flags=0x17 2024-09-14T11:03:56.555 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.556+0000 7f47074bb800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25 to cache LRU end 2024-09-14T11:03:56.555 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.556+0000 7f47074bb800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:56.555 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.556+0000 7f47074bb800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25, ofs0, ns] 2024-09-14T11:03:56.556 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.557+0000 7f45dbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595102 cookie 94540456129712 notifier 6434 bl.length()=939 2024-09-14T11:03:56.556 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.557+0000 7f45dbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25 info.flags=0x17 2024-09-14T11:03:56.556 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.557+0000 7f45dbfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25 to cache LRU end 2024-09-14T11:03:56.556 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.557+0000 7f45dbfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:56.556 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.557+0000 7f47074bb800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25]): orig_sources= new_sources= 2024-09-14T11:03:56.556 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.557+0000 7f47074bb800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25]): potential sources added=[] removed=[] 2024-09-14T11:03:56.556 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.557+0000 7f47074bb800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25]): orig_dests= new_dests= 2024-09-14T11:03:56.556 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.557+0000 7f47074bb800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25]): potential dests added=[] removed=[] 2024-09-14T11:03:56.558 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.559+0000 7f47074bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25.0 2024-09-14T11:03:56.558 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.559+0000 7f47074bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25.1 2024-09-14T11:03:56.559 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.560+0000 7f47074bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25.2 2024-09-14T11:03:56.559 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.560+0000 7f47074bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25.3 2024-09-14T11:03:56.559 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.560+0000 7f47074bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25.4 2024-09-14T11:03:56.559 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.561+0000 7f47074bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25.5 2024-09-14T11:03:56.559 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.561+0000 7f47074bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25.6 2024-09-14T11:03:56.560 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.561+0000 7f47074bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25.7 2024-09-14T11:03:56.560 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.562+0000 7f47074bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25.8 2024-09-14T11:03:56.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.562+0000 7f47074bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25.9 2024-09-14T11:03:56.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.562+0000 7f47074bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25.10 2024-09-14T11:03:56.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.563+0000 7f47074bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25 : hit (requested=0x17, cached=0x17) 2024-09-14T11:03:56.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.563+0000 7f47074bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25 2024-09-14T11:03:56.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.564+0000 7f47074bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25 info.flags=0x17 2024-09-14T11:03:56.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.564+0000 7f47074bb800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25 to cache LRU end 2024-09-14T11:03:56.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.564+0000 7f47074bb800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:56.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.564+0000 7f47074bb800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25, ofs0, ns] 2024-09-14T11:03:56.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.564+0000 7f45db7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595103 cookie 94540456129712 notifier 6434 bl.length()=907 2024-09-14T11:03:56.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.564+0000 7f45db7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25 info.flags=0x17 2024-09-14T11:03:56.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.564+0000 7f45db7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25 to cache LRU end 2024-09-14T11:03:56.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.564+0000 7f45db7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:56.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.564+0000 7f47074bb800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25]): orig_sources= new_sources= 2024-09-14T11:03:56.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.564+0000 7f47074bb800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25]): potential sources added=[] removed=[] 2024-09-14T11:03:56.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.564+0000 7f47074bb800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25]): orig_dests= new_dests= 2024-09-14T11:03:56.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.564+0000 7f47074bb800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25]): potential dests added=[] removed=[] 2024-09-14T11:03:56.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.567+0000 7f47074bb800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-14T11:03:56.567 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.568+0000 7f45bafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:56.569 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.570+0000 7f47074bb800 20 remove_watcher() i=0 2024-09-14T11:03:56.569 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.570+0000 7f47074bb800 2 removed watcher, disabling cache 2024-09-14T11:03:56.570 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.571+0000 7f47074bb800 20 remove_watcher() i=1 2024-09-14T11:03:56.571 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.572+0000 7f47074bb800 20 remove_watcher() i=2 2024-09-14T11:03:56.571 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.573+0000 7f47074bb800 20 remove_watcher() i=3 2024-09-14T11:03:56.572 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.574+0000 7f47074bb800 20 remove_watcher() i=4 2024-09-14T11:03:56.573 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.575+0000 7f47074bb800 20 remove_watcher() i=5 2024-09-14T11:03:56.574 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.576+0000 7f47074bb800 20 remove_watcher() i=6 2024-09-14T11:03:56.575 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.577+0000 7f47074bb800 20 remove_watcher() i=7 2024-09-14T11:03:56.587 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:03:56.616 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:03:56.616 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:03:56.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.654+0000 7f7db331f800 20 rados->read ofs=0 len=0 2024-09-14T11:03:56.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.656+0000 7f7db331f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:56.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.656+0000 7f7db331f800 20 realm 2024-09-14T11:03:56.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.656+0000 7f7db331f800 20 rados->read ofs=0 len=0 2024-09-14T11:03:56.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.656+0000 7f7db331f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:56.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.656+0000 7f7db331f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:03:56.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.656+0000 7f7db331f800 20 rados->read ofs=0 len=0 2024-09-14T11:03:56.656 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.656+0000 7f7db331f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:56.656 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.656+0000 7f7db331f800 20 rados->read ofs=0 len=0 2024-09-14T11:03:56.656 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.657+0000 7f7db331f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:56.656 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.657+0000 7f7db331f800 20 rados->read ofs=0 len=0 2024-09-14T11:03:56.656 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.658+0000 7f7db331f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:03:56.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.658+0000 7f7db331f800 20 searching for the correct realm 2024-09-14T11:03:56.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.659+0000 7f7daf0a2640 0 -- 172.21.15.97:0/3729532280 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x55d2c6c60720 msgr2=0x55d2c6c62b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:03:56.661 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.663+0000 7f7daf0a2640 0 -- 172.21.15.97:0/3729532280 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7f7d98073d80 msgr2=0x7f7d98073040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:03:56.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.871+0000 7f7db331f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:03:56.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.871+0000 7f7db331f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:03:56.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.871+0000 7f7db331f800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:03:56.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.871+0000 7f7db331f800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:03:56.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.871+0000 7f7db331f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:03:56.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.871+0000 7f7db331f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:03:56.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.871+0000 7f7db331f800 20 rados->read ofs=0 len=0 2024-09-14T11:03:56.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.871+0000 7f7db331f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:56.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.871+0000 7f7db331f800 20 rados->read ofs=0 len=0 2024-09-14T11:03:56.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.871+0000 7f7db331f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:56.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.871+0000 7f7db331f800 20 rados->read ofs=0 len=0 2024-09-14T11:03:56.871 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.872+0000 7f7db331f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:03:56.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.872+0000 7f7db331f800 20 zone default found 2024-09-14T11:03:56.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.872+0000 7f7db331f800 4 Realm: () 2024-09-14T11:03:56.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.872+0000 7f7db331f800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:03:56.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.872+0000 7f7db331f800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:03:56.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.872+0000 7f7db331f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:03:56.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.872+0000 7f7db331f800 20 zonegroup default 2024-09-14T11:03:56.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.872+0000 7f7db331f800 20 rados->read ofs=0 len=0 2024-09-14T11:03:56.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.872+0000 7f7db331f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:56.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.872+0000 7f7db331f800 20 rados->read ofs=0 len=0 2024-09-14T11:03:56.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.872+0000 7f7db331f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:56.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.872+0000 7f7db331f800 20 rados->read ofs=0 len=0 2024-09-14T11:03:56.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.872+0000 7f7db331f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:56.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.872+0000 7f7db331f800 20 started sync module instance, tier type = 2024-09-14T11:03:56.873 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.872+0000 7f7db331f800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:03:56.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.880+0000 7f7db331f800 20 add_watcher() i=0 2024-09-14T11:03:56.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.880+0000 7f7db331f800 20 add_watcher() i=1 2024-09-14T11:03:56.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.880+0000 7f7db331f800 20 add_watcher() i=2 2024-09-14T11:03:56.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.880+0000 7f7db331f800 20 add_watcher() i=3 2024-09-14T11:03:56.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.880+0000 7f7db331f800 20 add_watcher() i=4 2024-09-14T11:03:56.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.880+0000 7f7db331f800 20 add_watcher() i=5 2024-09-14T11:03:56.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.880+0000 7f7db331f800 20 add_watcher() i=6 2024-09-14T11:03:56.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.881+0000 7f7db331f800 20 add_watcher() i=7 2024-09-14T11:03:56.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.881+0000 7f7db331f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:03:56.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.883+0000 7f7c65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:56.882 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.883+0000 7f7db331f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:03:56.882 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.883+0000 7f7db331f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:03:56.883 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.883+0000 7f7db331f800 5 note: GC not initialized 2024-09-14T11:03:56.883 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.884+0000 7f7c64fe1640 20 reqs_thread_entry: start 2024-09-14T11:03:56.883 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.884+0000 7f7db331f800 20 init_complete bucket index max shards: 11 2024-09-14T11:03:56.883 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.884+0000 7f7db331f800 20 Filter name: none 2024-09-14T11:03:56.883 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.884+0000 7f7bde7fc640 20 reqs_thread_entry: start 2024-09-14T11:03:56.884 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.884+0000 7f7db331f800 20 rados->read ofs=0 len=0 2024-09-14T11:03:56.884 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.884+0000 7f7db331f800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:03:56.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.884+0000 7f7db331f800 20 rados->read ofs=0 len=0 2024-09-14T11:03:56.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.885+0000 7f7db331f800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:03:56.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.885+0000 7f7db331f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:03:56.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.885+0000 7f7db331f800 20 rados->read ofs=0 len=0 2024-09-14T11:03:56.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.885+0000 7f7db331f800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:03:56.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.885+0000 7f7db331f800 20 rados->read ofs=0 len=0 2024-09-14T11:03:56.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.885+0000 7f7db331f800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:03:56.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.885+0000 7f7db331f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:03:56.886 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.887+0000 7f7c65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:56.887 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.889+0000 7f7db331f800 20 remove_watcher() i=0 2024-09-14T11:03:56.888 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.889+0000 7f7db331f800 2 removed watcher, disabling cache 2024-09-14T11:03:56.888 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.890+0000 7f7db331f800 20 remove_watcher() i=1 2024-09-14T11:03:56.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.891+0000 7f7db331f800 20 remove_watcher() i=2 2024-09-14T11:03:56.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.892+0000 7f7db331f800 20 remove_watcher() i=3 2024-09-14T11:03:56.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.893+0000 7f7db331f800 20 remove_watcher() i=4 2024-09-14T11:03:56.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.894+0000 7f7db331f800 20 remove_watcher() i=5 2024-09-14T11:03:56.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.895+0000 7f7db331f800 20 remove_watcher() i=6 2024-09-14T11:03:56.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:56.896+0000 7f7db331f800 20 remove_watcher() i=7 2024-09-14T11:03:56.905 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:56.905 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:03:56.905 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-trim-reshard-log-entries id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:03:56.905 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:56.979 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: reshard bucket with EOPNOTSUPP injected at trim_reshard_log_entries 2024-09-14T11:03:56.979 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:57.202 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:03:57.232 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:03:57.232 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:03:57.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.270+0000 7fe595723800 20 rados->read ofs=0 len=0 2024-09-14T11:03:57.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.272+0000 7fe595723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:57.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.272+0000 7fe595723800 20 realm 2024-09-14T11:03:57.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.272+0000 7fe595723800 20 rados->read ofs=0 len=0 2024-09-14T11:03:57.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.272+0000 7fe595723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:57.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.272+0000 7fe595723800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:03:57.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.272+0000 7fe595723800 20 rados->read ofs=0 len=0 2024-09-14T11:03:57.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.272+0000 7fe595723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:57.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.272+0000 7fe595723800 20 rados->read ofs=0 len=0 2024-09-14T11:03:57.272 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.273+0000 7fe595723800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:57.272 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.273+0000 7fe595723800 20 rados->read ofs=0 len=0 2024-09-14T11:03:57.272 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.273+0000 7fe595723800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:03:57.272 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.273+0000 7fe595723800 20 searching for the correct realm 2024-09-14T11:03:57.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.276+0000 7fe591baf640 0 -- 172.21.15.97:0/2072419857 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7fe57c01e060 msgr2=0x7fe57c0769e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:03:57.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.482+0000 7fe588bad640 0 -- 172.21.15.97:0/2072419857 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7fe584091960 msgr2=0x7fe5840743f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:03:57.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.487+0000 7fe595723800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:03:57.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.487+0000 7fe595723800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:03:57.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.487+0000 7fe595723800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:03:57.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.487+0000 7fe595723800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:03:57.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.487+0000 7fe595723800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:03:57.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.487+0000 7fe595723800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:03:57.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.487+0000 7fe595723800 20 rados->read ofs=0 len=0 2024-09-14T11:03:57.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.487+0000 7fe595723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:57.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.487+0000 7fe595723800 20 rados->read ofs=0 len=0 2024-09-14T11:03:57.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.487+0000 7fe595723800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:57.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.487+0000 7fe595723800 20 rados->read ofs=0 len=0 2024-09-14T11:03:57.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.488+0000 7fe595723800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:03:57.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.488+0000 7fe595723800 20 zone default found 2024-09-14T11:03:57.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.488+0000 7fe595723800 4 Realm: () 2024-09-14T11:03:57.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.488+0000 7fe595723800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:03:57.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.488+0000 7fe595723800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:03:57.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.488+0000 7fe595723800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:03:57.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.488+0000 7fe595723800 20 zonegroup default 2024-09-14T11:03:57.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.488+0000 7fe595723800 20 rados->read ofs=0 len=0 2024-09-14T11:03:57.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.488+0000 7fe595723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:57.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.488+0000 7fe595723800 20 rados->read ofs=0 len=0 2024-09-14T11:03:57.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.488+0000 7fe595723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:57.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.488+0000 7fe595723800 20 rados->read ofs=0 len=0 2024-09-14T11:03:57.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.488+0000 7fe595723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:57.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.488+0000 7fe595723800 20 started sync module instance, tier type = 2024-09-14T11:03:57.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.488+0000 7fe595723800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:03:57.495 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.497+0000 7fe595723800 20 add_watcher() i=0 2024-09-14T11:03:57.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.497+0000 7fe595723800 20 add_watcher() i=1 2024-09-14T11:03:57.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.497+0000 7fe595723800 20 add_watcher() i=2 2024-09-14T11:03:57.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.497+0000 7fe595723800 20 add_watcher() i=3 2024-09-14T11:03:57.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.497+0000 7fe595723800 20 add_watcher() i=4 2024-09-14T11:03:57.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.497+0000 7fe595723800 20 add_watcher() i=5 2024-09-14T11:03:57.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.497+0000 7fe595723800 20 add_watcher() i=6 2024-09-14T11:03:57.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.498+0000 7fe595723800 20 add_watcher() i=7 2024-09-14T11:03:57.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.498+0000 7fe595723800 2 all 8 watchers are set, enabling cache 2024-09-14T11:03:57.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.500+0000 7fe4477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:57.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.500+0000 7fe595723800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:03:57.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.500+0000 7fe595723800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:03:57.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.500+0000 7fe595723800 5 note: GC not initialized 2024-09-14T11:03:57.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.500+0000 7fe4467e4640 20 reqs_thread_entry: start 2024-09-14T11:03:57.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.501+0000 7fe595723800 20 init_complete bucket index max shards: 11 2024-09-14T11:03:57.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.501+0000 7fe595723800 20 Filter name: none 2024-09-14T11:03:57.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.501+0000 7fe3b7fff640 20 reqs_thread_entry: start 2024-09-14T11:03:57.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.501+0000 7fe595723800 20 rados->read ofs=0 len=0 2024-09-14T11:03:57.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.501+0000 7fe595723800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:03:57.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.501+0000 7fe595723800 20 rados->read ofs=0 len=0 2024-09-14T11:03:57.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.502+0000 7fe595723800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:03:57.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.502+0000 7fe595723800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:03:57.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.502+0000 7fe595723800 20 rados->read ofs=0 len=0 2024-09-14T11:03:57.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.502+0000 7fe595723800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:03:57.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.502+0000 7fe595723800 20 rados->read ofs=0 len=0 2024-09-14T11:03:57.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.503+0000 7fe595723800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:03:57.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.503+0000 7fe595723800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:03:57.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.505+0000 7fe4477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:57.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.507+0000 7fe595723800 20 remove_watcher() i=0 2024-09-14T11:03:57.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.507+0000 7fe595723800 2 removed watcher, disabling cache 2024-09-14T11:03:57.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.508+0000 7fe595723800 20 remove_watcher() i=1 2024-09-14T11:03:57.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.509+0000 7fe595723800 20 remove_watcher() i=2 2024-09-14T11:03:57.508 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.510+0000 7fe595723800 20 remove_watcher() i=3 2024-09-14T11:03:57.509 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.511+0000 7fe595723800 20 remove_watcher() i=4 2024-09-14T11:03:57.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.512+0000 7fe595723800 20 remove_watcher() i=5 2024-09-14T11:03:57.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.512+0000 7fe595723800 20 remove_watcher() i=6 2024-09-14T11:03:57.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.513+0000 7fe595723800 20 remove_watcher() i=7 2024-09-14T11:03:57.522 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:57.522 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:03:57.522 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-trim-reshard-log-entries id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:03:57.522 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:57.523 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries --inject-error-code 95 2024-09-14T11:03:57.560 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:03:57.560 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:03:57.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.598+0000 7ff2e732c800 20 rados->read ofs=0 len=0 2024-09-14T11:03:57.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.600+0000 7ff2e732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:57.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.600+0000 7ff2e732c800 20 realm 2024-09-14T11:03:57.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.600+0000 7ff2e732c800 20 rados->read ofs=0 len=0 2024-09-14T11:03:57.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.600+0000 7ff2e732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:57.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.600+0000 7ff2e732c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:03:57.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.600+0000 7ff2e732c800 20 rados->read ofs=0 len=0 2024-09-14T11:03:57.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.601+0000 7ff2e732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:57.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.601+0000 7ff2e732c800 20 rados->read ofs=0 len=0 2024-09-14T11:03:57.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.601+0000 7ff2e732c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:57.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.601+0000 7ff2e732c800 20 rados->read ofs=0 len=0 2024-09-14T11:03:57.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.602+0000 7ff2e732c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:03:57.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.602+0000 7ff2e732c800 20 searching for the correct realm 2024-09-14T11:03:57.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.603+0000 7ff2e3746640 0 -- 172.21.15.97:0/2249512993 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x555787b9f230 msgr2=0x555787ba16d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:03:57.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.606+0000 7ff2e2f45640 0 -- 172.21.15.97:0/2249512993 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7ff2d40832d0 msgr2=0x7ff2d405fb10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:03:57.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.612+0000 7ff2e732c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:03:57.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.612+0000 7ff2e732c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:03:57.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.612+0000 7ff2e732c800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:03:57.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.612+0000 7ff2e732c800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:03:57.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.612+0000 7ff2e732c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:03:57.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.612+0000 7ff2e732c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:03:57.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.612+0000 7ff2e732c800 20 rados->read ofs=0 len=0 2024-09-14T11:03:57.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.612+0000 7ff2e732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:57.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.612+0000 7ff2e732c800 20 rados->read ofs=0 len=0 2024-09-14T11:03:57.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.612+0000 7ff2e732c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:57.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.612+0000 7ff2e732c800 20 rados->read ofs=0 len=0 2024-09-14T11:03:57.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.612+0000 7ff2e732c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:03:57.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.612+0000 7ff2e732c800 20 zone default found 2024-09-14T11:03:57.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.612+0000 7ff2e732c800 4 Realm: () 2024-09-14T11:03:57.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.612+0000 7ff2e732c800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:03:57.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.612+0000 7ff2e732c800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:03:57.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.612+0000 7ff2e732c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:03:57.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.612+0000 7ff2e732c800 20 zonegroup default 2024-09-14T11:03:57.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.612+0000 7ff2e732c800 20 rados->read ofs=0 len=0 2024-09-14T11:03:57.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.613+0000 7ff2e732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:57.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.613+0000 7ff2e732c800 20 rados->read ofs=0 len=0 2024-09-14T11:03:57.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.613+0000 7ff2e732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:57.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.613+0000 7ff2e732c800 20 rados->read ofs=0 len=0 2024-09-14T11:03:57.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.613+0000 7ff2e732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:57.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.613+0000 7ff2e732c800 20 started sync module instance, tier type = 2024-09-14T11:03:57.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.613+0000 7ff2e732c800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:03:57.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.622+0000 7ff2e732c800 20 add_watcher() i=0 2024-09-14T11:03:57.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.622+0000 7ff2e732c800 20 add_watcher() i=1 2024-09-14T11:03:57.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.622+0000 7ff2e732c800 20 add_watcher() i=2 2024-09-14T11:03:57.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.622+0000 7ff2e732c800 20 add_watcher() i=3 2024-09-14T11:03:57.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.622+0000 7ff2e732c800 20 add_watcher() i=4 2024-09-14T11:03:57.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.622+0000 7ff2e732c800 20 add_watcher() i=5 2024-09-14T11:03:57.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.622+0000 7ff2e732c800 20 add_watcher() i=6 2024-09-14T11:03:57.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.623+0000 7ff2e732c800 20 add_watcher() i=7 2024-09-14T11:03:57.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.623+0000 7ff2e732c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:03:57.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.624+0000 7ff1997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:57.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.624+0000 7ff2e732c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:03:57.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.624+0000 7ff2e732c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:03:57.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.624+0000 7ff2e732c800 5 note: GC not initialized 2024-09-14T11:03:57.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.625+0000 7ff113fff640 20 reqs_thread_entry: start 2024-09-14T11:03:57.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.625+0000 7ff2e732c800 20 init_complete bucket index max shards: 11 2024-09-14T11:03:57.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.625+0000 7ff2e732c800 20 Filter name: none 2024-09-14T11:03:57.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.625+0000 7ff111ffb640 20 reqs_thread_entry: start 2024-09-14T11:03:57.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.625+0000 7ff2e732c800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-14T11:03:57.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.625+0000 7ff2e732c800 20 rados->read ofs=0 len=0 2024-09-14T11:03:57.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.625+0000 7ff2e732c800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:03:57.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.625+0000 7ff2e732c800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:03:57.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.625+0000 7ff2e732c800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:03:57.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.625+0000 7ff2e732c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26 : miss 2024-09-14T11:03:57.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.625+0000 7ff2e732c800 20 rados->read ofs=0 len=0 2024-09-14T11:03:57.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.626+0000 7ff2e732c800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:03:57.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.626+0000 7ff2e732c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26 info.flags=0x17 2024-09-14T11:03:57.626 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.626+0000 7ff2e732c800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26 to cache LRU end 2024-09-14T11:03:57.626 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.626+0000 7ff2e732c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:03:57.626 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.626+0000 7ff2e732c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:57.626 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.626+0000 7ff2e732c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26 2024-09-14T11:03:57.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.631+0000 7ff2e732c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26 info.flags=0x17 2024-09-14T11:03:57.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.631+0000 7ff2e732c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26 to cache LRU end 2024-09-14T11:03:57.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.631+0000 7ff2e732c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:57.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.631+0000 7ff2e732c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26, ofs0, ns] 2024-09-14T11:03:57.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.631+0000 7ff1c67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595106 cookie 93834427694096 notifier 6846 bl.length()=939 2024-09-14T11:03:57.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.631+0000 7ff1c67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26 info.flags=0x17 2024-09-14T11:03:57.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.631+0000 7ff1c67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26 to cache LRU end 2024-09-14T11:03:57.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.631+0000 7ff1c67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:57.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.631+0000 7ff2e732c800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26]): orig_sources= new_sources= 2024-09-14T11:03:57.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.631+0000 7ff2e732c800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26]): potential sources added=[] removed=[] 2024-09-14T11:03:57.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.631+0000 7ff2e732c800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26]): orig_dests= new_dests= 2024-09-14T11:03:57.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.631+0000 7ff2e732c800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26]): potential dests added=[] removed=[] 2024-09-14T11:03:57.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.631+0000 7ff2e732c800 -1 Injecting error=-95 at location=trim_reshard_log_entries 2024-09-14T11:03:57.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.631+0000 7ff2e732c800 0 WARNING: trim_reshard_log_entries() does not supported logrecord, falling back to block reshard mode. 2024-09-14T11:03:57.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.634+0000 7ff2e732c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26.1.0 2024-09-14T11:03:57.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.634+0000 7ff2e732c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26.1.0 2024-09-14T11:03:57.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.634+0000 7ff2e732c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26.1.1 2024-09-14T11:03:57.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.634+0000 7ff2e732c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26.1.1 2024-09-14T11:03:57.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.634+0000 7ff2e732c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26.1.2 2024-09-14T11:03:57.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.634+0000 7ff2e732c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26.1.2 2024-09-14T11:03:57.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.634+0000 7ff2e732c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26.1.3 2024-09-14T11:03:57.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.634+0000 7ff2e732c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26.1.3 2024-09-14T11:03:57.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.634+0000 7ff2e732c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26.1.4 2024-09-14T11:03:57.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.634+0000 7ff2e732c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26.1.4 2024-09-14T11:03:57.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.634+0000 7ff2e732c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26.1.5 2024-09-14T11:03:57.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.634+0000 7ff2e732c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26.1.5 2024-09-14T11:03:57.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.634+0000 7ff2e732c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26.1.6 2024-09-14T11:03:57.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.634+0000 7ff2e732c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26.1.6 2024-09-14T11:03:57.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.634+0000 7ff2e732c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26.1.7 2024-09-14T11:03:57.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.634+0000 7ff2e732c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26.1.7 2024-09-14T11:03:57.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.634+0000 7ff2e732c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26.1.8 2024-09-14T11:03:57.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.634+0000 7ff2e732c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26.1.8 2024-09-14T11:03:57.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.634+0000 7ff2e732c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26.1.9 2024-09-14T11:03:57.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.634+0000 7ff2e732c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26.1.9 2024-09-14T11:03:57.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.634+0000 7ff2e732c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26.1.10 2024-09-14T11:03:57.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.634+0000 7ff2e732c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26.1.10 2024-09-14T11:03:57.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.634+0000 7ff2e732c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26.1.11 2024-09-14T11:03:57.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.634+0000 7ff2e732c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26.1.11 2024-09-14T11:03:57.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.634+0000 7ff2e732c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26.0 2024-09-14T11:03:57.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.634+0000 7ff2e732c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26.1 2024-09-14T11:03:57.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.635+0000 7ff2e732c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26.2 2024-09-14T11:03:57.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.635+0000 7ff2e732c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26.3 2024-09-14T11:03:57.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.636+0000 7ff2e732c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26.4 2024-09-14T11:03:57.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.636+0000 7ff2e732c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26.5 2024-09-14T11:03:57.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.637+0000 7ff2e732c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26.6 2024-09-14T11:03:57.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.637+0000 7ff2e732c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26.7 2024-09-14T11:03:57.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.637+0000 7ff2e732c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26.8 2024-09-14T11:03:57.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.638+0000 7ff2e732c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26.9 2024-09-14T11:03:57.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.638+0000 7ff2e732c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26.10 2024-09-14T11:03:57.639 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.641+0000 7ff2e732c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26 : hit (requested=0x17, cached=0x17) 2024-09-14T11:03:57.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.641+0000 7ff2e732c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26 2024-09-14T11:03:57.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.642+0000 7ff2e732c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26 info.flags=0x17 2024-09-14T11:03:57.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.642+0000 7ff2e732c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26 to cache LRU end 2024-09-14T11:03:57.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.642+0000 7ff2e732c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:57.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.642+0000 7ff2e732c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26, ofs0, ns] 2024-09-14T11:03:57.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.643+0000 7ff1c5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595107 cookie 93834427694096 notifier 6846 bl.length()=907 2024-09-14T11:03:57.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.643+0000 7ff1c5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26 info.flags=0x17 2024-09-14T11:03:57.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.643+0000 7ff1c5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26 to cache LRU end 2024-09-14T11:03:57.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.643+0000 7ff1c5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:57.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.643+0000 7ff2e732c800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26]): orig_sources= new_sources= 2024-09-14T11:03:57.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.643+0000 7ff2e732c800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26]): potential sources added=[] removed=[] 2024-09-14T11:03:57.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.643+0000 7ff2e732c800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26]): orig_dests= new_dests= 2024-09-14T11:03:57.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.643+0000 7ff2e732c800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26]): potential dests added=[] removed=[] 2024-09-14T11:03:57.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.646+0000 7ff2e732c800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-14T11:03:57.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.647+0000 7ff1997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:57.648 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.650+0000 7ff2e732c800 20 remove_watcher() i=0 2024-09-14T11:03:57.648 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.650+0000 7ff2e732c800 2 removed watcher, disabling cache 2024-09-14T11:03:57.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.650+0000 7ff2e732c800 20 remove_watcher() i=1 2024-09-14T11:03:57.650 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.651+0000 7ff2e732c800 20 remove_watcher() i=2 2024-09-14T11:03:57.651 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.652+0000 7ff2e732c800 20 remove_watcher() i=3 2024-09-14T11:03:57.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.653+0000 7ff2e732c800 20 remove_watcher() i=4 2024-09-14T11:03:57.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.654+0000 7ff2e732c800 20 remove_watcher() i=5 2024-09-14T11:03:57.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.655+0000 7ff2e732c800 20 remove_watcher() i=6 2024-09-14T11:03:57.654 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.656+0000 7ff2e732c800 20 remove_watcher() i=7 2024-09-14T11:03:57.667 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:03:57.695 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:03:57.695 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:03:57.731 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.733+0000 7f6616326800 20 rados->read ofs=0 len=0 2024-09-14T11:03:57.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.735+0000 7f6616326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:57.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.735+0000 7f6616326800 20 realm 2024-09-14T11:03:57.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.735+0000 7f6616326800 20 rados->read ofs=0 len=0 2024-09-14T11:03:57.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.735+0000 7f6616326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:57.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.735+0000 7f6616326800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:03:57.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.735+0000 7f6616326800 20 rados->read ofs=0 len=0 2024-09-14T11:03:57.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.735+0000 7f6616326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:57.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.735+0000 7f6616326800 20 rados->read ofs=0 len=0 2024-09-14T11:03:57.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.736+0000 7f6616326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:57.735 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.736+0000 7f6616326800 20 rados->read ofs=0 len=0 2024-09-14T11:03:57.735 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.737+0000 7f6616326800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:03:57.735 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.737+0000 7f6616326800 20 searching for the correct realm 2024-09-14T11:03:57.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.739+0000 7f66127da640 0 -- 172.21.15.97:0/4086202495 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f6608029030 msgr2=0x7f6608038950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:03:57.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.943+0000 7f66117d8640 0 -- 172.21.15.97:0/4086202495 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f660406f040 msgr2=0x7f6604055410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:03:57.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.948+0000 7f6616326800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:03:57.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.948+0000 7f6616326800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:03:57.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.948+0000 7f6616326800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:03:57.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.948+0000 7f6616326800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:03:57.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.948+0000 7f6616326800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:03:57.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.948+0000 7f6616326800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:03:57.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.948+0000 7f6616326800 20 rados->read ofs=0 len=0 2024-09-14T11:03:57.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.948+0000 7f6616326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:57.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.948+0000 7f6616326800 20 rados->read ofs=0 len=0 2024-09-14T11:03:57.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.949+0000 7f6616326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:57.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.949+0000 7f6616326800 20 rados->read ofs=0 len=0 2024-09-14T11:03:57.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.949+0000 7f6616326800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:03:57.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.949+0000 7f6616326800 20 zone default found 2024-09-14T11:03:57.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.949+0000 7f6616326800 4 Realm: () 2024-09-14T11:03:57.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.949+0000 7f6616326800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:03:57.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.949+0000 7f6616326800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:03:57.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.949+0000 7f6616326800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:03:57.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.949+0000 7f6616326800 20 zonegroup default 2024-09-14T11:03:57.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.949+0000 7f6616326800 20 rados->read ofs=0 len=0 2024-09-14T11:03:57.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.949+0000 7f6616326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:57.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.949+0000 7f6616326800 20 rados->read ofs=0 len=0 2024-09-14T11:03:57.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.950+0000 7f6616326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:57.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.950+0000 7f6616326800 20 rados->read ofs=0 len=0 2024-09-14T11:03:57.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.950+0000 7f6616326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:57.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.950+0000 7f6616326800 20 started sync module instance, tier type = 2024-09-14T11:03:57.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.950+0000 7f6616326800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:03:57.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.959+0000 7f6616326800 20 add_watcher() i=0 2024-09-14T11:03:57.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.959+0000 7f6616326800 20 add_watcher() i=1 2024-09-14T11:03:57.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.959+0000 7f6616326800 20 add_watcher() i=2 2024-09-14T11:03:57.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.959+0000 7f6616326800 20 add_watcher() i=3 2024-09-14T11:03:57.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.959+0000 7f6616326800 20 add_watcher() i=4 2024-09-14T11:03:57.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.959+0000 7f6616326800 20 add_watcher() i=5 2024-09-14T11:03:57.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.959+0000 7f6616326800 20 add_watcher() i=6 2024-09-14T11:03:57.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.960+0000 7f6616326800 20 add_watcher() i=7 2024-09-14T11:03:57.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.960+0000 7f6616326800 2 all 8 watchers are set, enabling cache 2024-09-14T11:03:57.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.961+0000 7f64c37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:57.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.962+0000 7f6616326800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:03:57.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.962+0000 7f6616326800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:03:57.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.962+0000 7f6616326800 5 note: GC not initialized 2024-09-14T11:03:57.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.962+0000 7f64c27fc640 20 reqs_thread_entry: start 2024-09-14T11:03:57.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.962+0000 7f6616326800 20 init_complete bucket index max shards: 11 2024-09-14T11:03:57.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.962+0000 7f6616326800 20 Filter name: none 2024-09-14T11:03:57.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.962+0000 7f6433fff640 20 reqs_thread_entry: start 2024-09-14T11:03:57.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.962+0000 7f6616326800 20 rados->read ofs=0 len=0 2024-09-14T11:03:57.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.963+0000 7f6616326800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:03:57.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.963+0000 7f6616326800 20 rados->read ofs=0 len=0 2024-09-14T11:03:57.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.963+0000 7f6616326800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:03:57.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.963+0000 7f6616326800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:03:57.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.963+0000 7f6616326800 20 rados->read ofs=0 len=0 2024-09-14T11:03:57.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.964+0000 7f6616326800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:03:57.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.964+0000 7f6616326800 20 rados->read ofs=0 len=0 2024-09-14T11:03:57.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.964+0000 7f6616326800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:03:57.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.964+0000 7f6616326800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:03:57.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.966+0000 7f64c37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:57.967 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.968+0000 7f6616326800 20 remove_watcher() i=0 2024-09-14T11:03:57.967 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.968+0000 7f6616326800 2 removed watcher, disabling cache 2024-09-14T11:03:57.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.969+0000 7f6616326800 20 remove_watcher() i=1 2024-09-14T11:03:57.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.970+0000 7f6616326800 20 remove_watcher() i=2 2024-09-14T11:03:57.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.971+0000 7f6616326800 20 remove_watcher() i=3 2024-09-14T11:03:57.971 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.972+0000 7f6616326800 20 remove_watcher() i=4 2024-09-14T11:03:57.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.973+0000 7f6616326800 20 remove_watcher() i=5 2024-09-14T11:03:57.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.974+0000 7f6616326800 20 remove_watcher() i=6 2024-09-14T11:03:57.974 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:57.975+0000 7f6616326800 20 remove_watcher() i=7 2024-09-14T11:03:57.984 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:57.984 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:03:57.984 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-trim-reshard-log-entries id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:03:57.984 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:58.056 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: reshard bucket with abort at trim_reshard_log_entries 2024-09-14T11:03:58.056 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:58.459 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-14T11:03:58.489 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:03:58.489 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:03:58.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.527+0000 7fb7b28bb800 20 rados->read ofs=0 len=0 2024-09-14T11:03:58.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.531+0000 7fb7b28bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:58.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.531+0000 7fb7b28bb800 20 realm 2024-09-14T11:03:58.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.531+0000 7fb7b28bb800 20 rados->read ofs=0 len=0 2024-09-14T11:03:58.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.531+0000 7fb7b28bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:58.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.531+0000 7fb7b28bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:03:58.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.531+0000 7fb7b28bb800 20 rados->read ofs=0 len=0 2024-09-14T11:03:58.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.532+0000 7fb7b28bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:58.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.532+0000 7fb7b28bb800 20 rados->read ofs=0 len=0 2024-09-14T11:03:58.531 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.532+0000 7fb7b28bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:58.531 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.532+0000 7fb7b28bb800 20 rados->read ofs=0 len=0 2024-09-14T11:03:58.532 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.533+0000 7fb7b28bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:03:58.532 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.533+0000 7fb7b28bb800 20 searching for the correct realm 2024-09-14T11:03:58.532 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.534+0000 7fb7b03a5640 0 -- 172.21.15.97:0/1949879911 >> [v2:172.21.15.152:6808/1010851305,v1:172.21.15.152:6809/1010851305] conn(0x55ad3c313230 msgr2=0x55ad3c3156d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:03:58.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.740+0000 7fb7b0ba6640 0 -- 172.21.15.97:0/1949879911 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x55ad3c302670 msgr2=0x55ad3c304ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:03:58.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.747+0000 7fb7b28bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:03:58.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.747+0000 7fb7b28bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:03:58.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.747+0000 7fb7b28bb800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:03:58.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.747+0000 7fb7b28bb800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:03:58.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.747+0000 7fb7b28bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:03:58.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.747+0000 7fb7b28bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:03:58.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.747+0000 7fb7b28bb800 20 rados->read ofs=0 len=0 2024-09-14T11:03:58.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.747+0000 7fb7b28bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:58.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.747+0000 7fb7b28bb800 20 rados->read ofs=0 len=0 2024-09-14T11:03:58.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.748+0000 7fb7b28bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:58.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.748+0000 7fb7b28bb800 20 rados->read ofs=0 len=0 2024-09-14T11:03:58.748 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.748+0000 7fb7b28bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:03:58.748 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.748+0000 7fb7b28bb800 20 zone default found 2024-09-14T11:03:58.748 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.748+0000 7fb7b28bb800 4 Realm: () 2024-09-14T11:03:58.748 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.748+0000 7fb7b28bb800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:03:58.748 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.748+0000 7fb7b28bb800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:03:58.748 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.748+0000 7fb7b28bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:03:58.748 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.748+0000 7fb7b28bb800 20 zonegroup default 2024-09-14T11:03:58.748 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.748+0000 7fb7b28bb800 20 rados->read ofs=0 len=0 2024-09-14T11:03:58.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.748+0000 7fb7b28bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:58.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.748+0000 7fb7b28bb800 20 rados->read ofs=0 len=0 2024-09-14T11:03:58.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.748+0000 7fb7b28bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:58.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.748+0000 7fb7b28bb800 20 rados->read ofs=0 len=0 2024-09-14T11:03:58.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.749+0000 7fb7b28bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:58.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.749+0000 7fb7b28bb800 20 started sync module instance, tier type = 2024-09-14T11:03:58.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.749+0000 7fb7b28bb800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:03:58.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.758+0000 7fb7b28bb800 20 add_watcher() i=0 2024-09-14T11:03:58.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.758+0000 7fb7b28bb800 20 add_watcher() i=1 2024-09-14T11:03:58.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.758+0000 7fb7b28bb800 20 add_watcher() i=2 2024-09-14T11:03:58.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.758+0000 7fb7b28bb800 20 add_watcher() i=3 2024-09-14T11:03:58.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.758+0000 7fb7b28bb800 20 add_watcher() i=4 2024-09-14T11:03:58.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.758+0000 7fb7b28bb800 20 add_watcher() i=5 2024-09-14T11:03:58.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.758+0000 7fb7b28bb800 20 add_watcher() i=6 2024-09-14T11:03:58.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.759+0000 7fb7b28bb800 20 add_watcher() i=7 2024-09-14T11:03:58.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.759+0000 7fb7b28bb800 2 all 8 watchers are set, enabling cache 2024-09-14T11:03:58.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.761+0000 7fb666fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:58.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.761+0000 7fb7b28bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:03:58.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.761+0000 7fb7b28bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:03:58.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.761+0000 7fb7b28bb800 5 note: GC not initialized 2024-09-14T11:03:58.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.761+0000 7fb665fdb640 20 reqs_thread_entry: start 2024-09-14T11:03:58.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.761+0000 7fb7b28bb800 20 init_complete bucket index max shards: 11 2024-09-14T11:03:58.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.761+0000 7fb7b28bb800 20 Filter name: none 2024-09-14T11:03:58.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.762+0000 7fb5d77fe640 20 reqs_thread_entry: start 2024-09-14T11:03:58.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.762+0000 7fb7b28bb800 20 rados->read ofs=0 len=0 2024-09-14T11:03:58.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.762+0000 7fb7b28bb800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:03:58.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.762+0000 7fb7b28bb800 20 rados->read ofs=0 len=0 2024-09-14T11:03:58.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.763+0000 7fb7b28bb800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:03:58.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.763+0000 7fb7b28bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:03:58.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.763+0000 7fb7b28bb800 20 rados->read ofs=0 len=0 2024-09-14T11:03:58.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.763+0000 7fb7b28bb800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:03:58.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.763+0000 7fb7b28bb800 20 rados->read ofs=0 len=0 2024-09-14T11:03:58.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.763+0000 7fb7b28bb800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:03:58.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.763+0000 7fb7b28bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:03:58.763 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.765+0000 7fb666fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:58.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.767+0000 7fb7b28bb800 20 remove_watcher() i=0 2024-09-14T11:03:58.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.767+0000 7fb7b28bb800 2 removed watcher, disabling cache 2024-09-14T11:03:58.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.768+0000 7fb7b28bb800 20 remove_watcher() i=1 2024-09-14T11:03:58.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.769+0000 7fb7b28bb800 20 remove_watcher() i=2 2024-09-14T11:03:58.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.770+0000 7fb7b28bb800 20 remove_watcher() i=3 2024-09-14T11:03:58.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.771+0000 7fb7b28bb800 20 remove_watcher() i=4 2024-09-14T11:03:58.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.772+0000 7fb7b28bb800 20 remove_watcher() i=5 2024-09-14T11:03:58.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.773+0000 7fb7b28bb800 20 remove_watcher() i=6 2024-09-14T11:03:58.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.774+0000 7fb7b28bb800 20 remove_watcher() i=7 2024-09-14T11:03:58.782 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:58.782 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:03:58.783 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: abort-at-trim-reshard-log-entries id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:03:58.783 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:58.784 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at trim_reshard_log_entries 2024-09-14T11:03:58.818 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:03:58.818 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:03:58.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.857+0000 7efc2bf28800 20 rados->read ofs=0 len=0 2024-09-14T11:03:58.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.858+0000 7efc2bf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:58.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.858+0000 7efc2bf28800 20 realm 2024-09-14T11:03:58.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.858+0000 7efc2bf28800 20 rados->read ofs=0 len=0 2024-09-14T11:03:58.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.859+0000 7efc2bf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:58.858 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.859+0000 7efc2bf28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:03:58.858 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.859+0000 7efc2bf28800 20 rados->read ofs=0 len=0 2024-09-14T11:03:58.858 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.859+0000 7efc2bf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:58.858 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.859+0000 7efc2bf28800 20 rados->read ofs=0 len=0 2024-09-14T11:03:58.858 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.859+0000 7efc2bf28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:58.858 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.860+0000 7efc2bf28800 20 rados->read ofs=0 len=0 2024-09-14T11:03:58.859 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.860+0000 7efc2bf28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:03:58.859 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.860+0000 7efc2bf28800 20 searching for the correct realm 2024-09-14T11:03:58.859 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:58.861+0000 7efc27c4b640 0 -- 172.21.15.97:0/2385311258 >> [v2:172.21.15.152:6808/1010851305,v1:172.21.15.152:6809/1010851305] conn(0x5603c8f8fd80 msgr2=0x5603c8f92240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:03:59.064 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.065+0000 7efc27c4b640 0 -- 172.21.15.97:0/2385311258 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x5603c8f83510 msgr2=0x5603c8f859a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:03:59.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.072+0000 7efc2bf28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:03:59.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.072+0000 7efc2bf28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:03:59.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.072+0000 7efc2bf28800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:03:59.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.072+0000 7efc2bf28800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:03:59.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.072+0000 7efc2bf28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:03:59.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.072+0000 7efc2bf28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:03:59.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.072+0000 7efc2bf28800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.072+0000 7efc2bf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:59.071 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.072+0000 7efc2bf28800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.072 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.072+0000 7efc2bf28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:59.072 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.072+0000 7efc2bf28800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.073+0000 7efc2bf28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:03:59.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.073+0000 7efc2bf28800 20 zone default found 2024-09-14T11:03:59.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.073+0000 7efc2bf28800 4 Realm: () 2024-09-14T11:03:59.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.073+0000 7efc2bf28800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:03:59.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.073+0000 7efc2bf28800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:03:59.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.073+0000 7efc2bf28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:03:59.073 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.073+0000 7efc2bf28800 20 zonegroup default 2024-09-14T11:03:59.074 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.073+0000 7efc2bf28800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.074 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.073+0000 7efc2bf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:59.074 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.073+0000 7efc2bf28800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.074 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.073+0000 7efc2bf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:59.074 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.073+0000 7efc2bf28800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.074 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.073+0000 7efc2bf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:59.074 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.073+0000 7efc2bf28800 20 started sync module instance, tier type = 2024-09-14T11:03:59.074 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.073+0000 7efc2bf28800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:03:59.081 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.082+0000 7efc2bf28800 20 add_watcher() i=0 2024-09-14T11:03:59.081 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.082+0000 7efc2bf28800 20 add_watcher() i=1 2024-09-14T11:03:59.081 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.082+0000 7efc2bf28800 20 add_watcher() i=2 2024-09-14T11:03:59.081 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.082+0000 7efc2bf28800 20 add_watcher() i=3 2024-09-14T11:03:59.081 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.082+0000 7efc2bf28800 20 add_watcher() i=4 2024-09-14T11:03:59.081 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.082+0000 7efc2bf28800 20 add_watcher() i=5 2024-09-14T11:03:59.082 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.083+0000 7efc2bf28800 20 add_watcher() i=6 2024-09-14T11:03:59.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.084+0000 7efc2bf28800 20 add_watcher() i=7 2024-09-14T11:03:59.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.084+0000 7efc2bf28800 2 all 8 watchers are set, enabling cache 2024-09-14T11:03:59.084 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.086+0000 7efaddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:59.085 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.086+0000 7efc2bf28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:03:59.085 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.086+0000 7efc2bf28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:03:59.085 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.086+0000 7efc2bf28800 5 note: GC not initialized 2024-09-14T11:03:59.085 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.086+0000 7efadcfe1640 20 reqs_thread_entry: start 2024-09-14T11:03:59.085 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.086+0000 7efc2bf28800 20 init_complete bucket index max shards: 11 2024-09-14T11:03:59.085 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.086+0000 7efc2bf28800 20 Filter name: none 2024-09-14T11:03:59.086 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.087+0000 7efa567fc640 20 reqs_thread_entry: start 2024-09-14T11:03:59.086 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.087+0000 7efc2bf28800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:03:59.086 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.087+0000 7efc2bf28800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.087+0000 7efc2bf28800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:03:59.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.087+0000 7efc2bf28800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:03:59.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.087+0000 7efc2bf28800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:03:59.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.087+0000 7efc2bf28800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 : miss 2024-09-14T11:03:59.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.087+0000 7efc2bf28800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.087+0000 7efc2bf28800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:03:59.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.087+0000 7efc2bf28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 info.flags=0x17 2024-09-14T11:03:59.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.087+0000 7efc2bf28800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 to cache LRU end 2024-09-14T11:03:59.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.087+0000 7efc2bf28800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:03:59.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.087+0000 7efc2bf28800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:59.087 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.087+0000 7efc2bf28800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 2024-09-14T11:03:59.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.092+0000 7efc2bf28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 info.flags=0x17 2024-09-14T11:03:59.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.092+0000 7efc2bf28800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 to cache LRU end 2024-09-14T11:03:59.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.092+0000 7efc2bf28800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:59.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.092+0000 7efc2bf28800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27, ofs0, ns] 2024-09-14T11:03:59.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.092+0000 7efb067fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595185 cookie 94574256664736 notifier 6536 bl.length()=939 2024-09-14T11:03:59.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.092+0000 7efb067fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 info.flags=0x17 2024-09-14T11:03:59.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.092+0000 7efb067fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 to cache LRU end 2024-09-14T11:03:59.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.092+0000 7efb067fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:59.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.093+0000 7efc2bf28800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27]): orig_sources= new_sources= 2024-09-14T11:03:59.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.093+0000 7efc2bf28800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27]): potential sources added=[] removed=[] 2024-09-14T11:03:59.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.093+0000 7efc2bf28800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27]): orig_dests= new_dests= 2024-09-14T11:03:59.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.093+0000 7efc2bf28800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27]): potential dests added=[] removed=[] 2024-09-14T11:03:59.092 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7efc2bf28800 time 2024-09-14T11:03:59.094211+0000 2024-09-14T11:03:59.092 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:03:59.109 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:03:59.109 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7efc2d78c76a] 2024-09-14T11:03:59.109 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7efc2d78c928] 2024-09-14T11:03:59.109 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5603c79240b1] 2024-09-14T11:03:59.109 INFO:tasks.workunit.client.0.smithi097.stderr: 4: radosgw-admin(+0xd8900e) [0x5603c7e3800e] 2024-09-14T11:03:59.109 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5603c7933efd] 2024-09-14T11:03:59.109 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-14T11:03:59.109 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7efc2c429590] 2024-09-14T11:03:59.109 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-14T11:03:59.110 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-14T11:03:59.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.094+0000 7efc2bf28800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7efc2bf28800 time 2024-09-14T11:03:59.094211+0000 2024-09-14T11:03:59.110 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:03:59.110 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:59.110 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:03:59.110 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7efc2d78c76a] 2024-09-14T11:03:59.110 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7efc2d78c928] 2024-09-14T11:03:59.110 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5603c79240b1] 2024-09-14T11:03:59.110 INFO:tasks.workunit.client.0.smithi097.stderr: 4: radosgw-admin(+0xd8900e) [0x5603c7e3800e] 2024-09-14T11:03:59.110 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5603c7933efd] 2024-09-14T11:03:59.110 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-14T11:03:59.110 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7efc2c429590] 2024-09-14T11:03:59.110 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-14T11:03:59.111 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-14T11:03:59.111 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:59.111 INFO:tasks.workunit.client.0.smithi097.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:03:59.111 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7efc2bf28800 thread_name:radosgw-admin 2024-09-14T11:03:59.111 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:03:59.111 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7efc2c43e6f0] 2024-09-14T11:03:59.111 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7efc2c48b99c] 2024-09-14T11:03:59.111 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-14T11:03:59.111 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-14T11:03:59.111 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7efc2d78c7c4] 2024-09-14T11:03:59.111 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7efc2d78c928] 2024-09-14T11:03:59.111 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5603c79240b1] 2024-09-14T11:03:59.111 INFO:tasks.workunit.client.0.smithi097.stderr: 8: radosgw-admin(+0xd8900e) [0x5603c7e3800e] 2024-09-14T11:03:59.112 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5603c7933efd] 2024-09-14T11:03:59.112 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-14T11:03:59.112 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7efc2c429590] 2024-09-14T11:03:59.112 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-14T11:03:59.112 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-14T11:03:59.112 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.094+0000 7efc2bf28800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:03:59.112 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7efc2bf28800 thread_name:radosgw-admin 2024-09-14T11:03:59.112 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:59.112 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:03:59.112 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7efc2c43e6f0] 2024-09-14T11:03:59.112 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7efc2c48b99c] 2024-09-14T11:03:59.112 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-14T11:03:59.112 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-14T11:03:59.112 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7efc2d78c7c4] 2024-09-14T11:03:59.113 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7efc2d78c928] 2024-09-14T11:03:59.113 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5603c79240b1] 2024-09-14T11:03:59.113 INFO:tasks.workunit.client.0.smithi097.stderr: 8: radosgw-admin(+0xd8900e) [0x5603c7e3800e] 2024-09-14T11:03:59.113 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5603c7933efd] 2024-09-14T11:03:59.113 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-14T11:03:59.113 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7efc2c429590] 2024-09-14T11:03:59.113 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-14T11:03:59.113 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-14T11:03:59.113 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:03:59.113 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:59.113 INFO:tasks.workunit.client.0.smithi097.stderr:--- begin dump of recent events --- 2024-09-14T11:03:59.113 INFO:tasks.workunit.client.0.smithi097.stderr: -499> 2024-09-14T11:03:58.840+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e9ad40) adding auth protocol: cephx 2024-09-14T11:03:59.113 INFO:tasks.workunit.client.0.smithi097.stderr: -498> 2024-09-14T11:03:58.840+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e9ad40) adding auth protocol: cephx 2024-09-14T11:03:59.114 INFO:tasks.workunit.client.0.smithi097.stderr: -497> 2024-09-14T11:03:58.840+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e9ad40) adding auth protocol: cephx 2024-09-14T11:03:59.114 INFO:tasks.workunit.client.0.smithi097.stderr: -496> 2024-09-14T11:03:58.840+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e9ad40) adding con mode: secure 2024-09-14T11:03:59.114 INFO:tasks.workunit.client.0.smithi097.stderr: -495> 2024-09-14T11:03:58.840+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e9ad40) adding con mode: crc 2024-09-14T11:03:59.114 INFO:tasks.workunit.client.0.smithi097.stderr: -494> 2024-09-14T11:03:58.840+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e9ad40) adding con mode: secure 2024-09-14T11:03:59.114 INFO:tasks.workunit.client.0.smithi097.stderr: -493> 2024-09-14T11:03:58.840+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e9ad40) adding con mode: crc 2024-09-14T11:03:59.114 INFO:tasks.workunit.client.0.smithi097.stderr: -492> 2024-09-14T11:03:58.840+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e9ad40) adding con mode: secure 2024-09-14T11:03:59.114 INFO:tasks.workunit.client.0.smithi097.stderr: -491> 2024-09-14T11:03:58.840+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e9ad40) adding con mode: crc 2024-09-14T11:03:59.114 INFO:tasks.workunit.client.0.smithi097.stderr: -490> 2024-09-14T11:03:58.840+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e9ad40) adding con mode: crc 2024-09-14T11:03:59.114 INFO:tasks.workunit.client.0.smithi097.stderr: -489> 2024-09-14T11:03:58.840+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e9ad40) adding con mode: secure 2024-09-14T11:03:59.114 INFO:tasks.workunit.client.0.smithi097.stderr: -488> 2024-09-14T11:03:58.840+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e9ad40) adding con mode: crc 2024-09-14T11:03:59.114 INFO:tasks.workunit.client.0.smithi097.stderr: -487> 2024-09-14T11:03:58.840+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e9ad40) adding con mode: secure 2024-09-14T11:03:59.114 INFO:tasks.workunit.client.0.smithi097.stderr: -486> 2024-09-14T11:03:58.840+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e9ad40) adding con mode: crc 2024-09-14T11:03:59.114 INFO:tasks.workunit.client.0.smithi097.stderr: -485> 2024-09-14T11:03:58.840+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e9ad40) adding con mode: secure 2024-09-14T11:03:59.115 INFO:tasks.workunit.client.0.smithi097.stderr: -484> 2024-09-14T11:03:58.840+0000 7efc2bf28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:59.115 INFO:tasks.workunit.client.0.smithi097.stderr: -483> 2024-09-14T11:03:58.840+0000 7efc2bf28800 1 librados: starting msgr at 2024-09-14T11:03:59.115 INFO:tasks.workunit.client.0.smithi097.stderr: -482> 2024-09-14T11:03:58.840+0000 7efc2bf28800 1 librados: starting objecter 2024-09-14T11:03:59.115 INFO:tasks.workunit.client.0.smithi097.stderr: -481> 2024-09-14T11:03:58.841+0000 7efc2bf28800 5 asok(0x5603c8c77270) register_command objecter_requests hook 0x5603c8e9ba80 2024-09-14T11:03:59.115 INFO:tasks.workunit.client.0.smithi097.stderr: -480> 2024-09-14T11:03:58.841+0000 7efc2bf28800 1 librados: setting wanted keys 2024-09-14T11:03:59.115 INFO:tasks.workunit.client.0.smithi097.stderr: -479> 2024-09-14T11:03:58.841+0000 7efc2bf28800 1 librados: calling monclient init 2024-09-14T11:03:59.115 INFO:tasks.workunit.client.0.smithi097.stderr: -478> 2024-09-14T11:03:58.841+0000 7efc2bf28800 10 monclient: init 2024-09-14T11:03:59.115 INFO:tasks.workunit.client.0.smithi097.stderr: -477> 2024-09-14T11:03:58.841+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e94ff0) adding auth protocol: cephx 2024-09-14T11:03:59.115 INFO:tasks.workunit.client.0.smithi097.stderr: -476> 2024-09-14T11:03:58.841+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e94ff0) adding auth protocol: cephx 2024-09-14T11:03:59.115 INFO:tasks.workunit.client.0.smithi097.stderr: -475> 2024-09-14T11:03:58.841+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e94ff0) adding auth protocol: cephx 2024-09-14T11:03:59.115 INFO:tasks.workunit.client.0.smithi097.stderr: -474> 2024-09-14T11:03:58.841+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e94ff0) adding con mode: secure 2024-09-14T11:03:59.115 INFO:tasks.workunit.client.0.smithi097.stderr: -473> 2024-09-14T11:03:58.841+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e94ff0) adding con mode: crc 2024-09-14T11:03:59.115 INFO:tasks.workunit.client.0.smithi097.stderr: -472> 2024-09-14T11:03:58.841+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e94ff0) adding con mode: secure 2024-09-14T11:03:59.115 INFO:tasks.workunit.client.0.smithi097.stderr: -471> 2024-09-14T11:03:58.841+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e94ff0) adding con mode: crc 2024-09-14T11:03:59.116 INFO:tasks.workunit.client.0.smithi097.stderr: -470> 2024-09-14T11:03:58.841+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e94ff0) adding con mode: secure 2024-09-14T11:03:59.116 INFO:tasks.workunit.client.0.smithi097.stderr: -469> 2024-09-14T11:03:58.841+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e94ff0) adding con mode: crc 2024-09-14T11:03:59.116 INFO:tasks.workunit.client.0.smithi097.stderr: -468> 2024-09-14T11:03:58.841+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e94ff0) adding con mode: crc 2024-09-14T11:03:59.116 INFO:tasks.workunit.client.0.smithi097.stderr: -467> 2024-09-14T11:03:58.841+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e94ff0) adding con mode: secure 2024-09-14T11:03:59.116 INFO:tasks.workunit.client.0.smithi097.stderr: -466> 2024-09-14T11:03:58.841+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e94ff0) adding con mode: crc 2024-09-14T11:03:59.116 INFO:tasks.workunit.client.0.smithi097.stderr: -465> 2024-09-14T11:03:58.841+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e94ff0) adding con mode: secure 2024-09-14T11:03:59.116 INFO:tasks.workunit.client.0.smithi097.stderr: -464> 2024-09-14T11:03:58.841+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e94ff0) adding con mode: crc 2024-09-14T11:03:59.116 INFO:tasks.workunit.client.0.smithi097.stderr: -463> 2024-09-14T11:03:58.841+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e94ff0) adding con mode: secure 2024-09-14T11:03:59.116 INFO:tasks.workunit.client.0.smithi097.stderr: -462> 2024-09-14T11:03:58.841+0000 7efc2bf28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:59.116 INFO:tasks.workunit.client.0.smithi097.stderr: -461> 2024-09-14T11:03:58.841+0000 7efc2bf28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:59.116 INFO:tasks.workunit.client.0.smithi097.stderr: -460> 2024-09-14T11:03:58.841+0000 7efc2bf28800 5 asok(0x5603c8c77270) register_command rotate-key hook 0x5603c8e95138 2024-09-14T11:03:59.116 INFO:tasks.workunit.client.0.smithi097.stderr: -459> 2024-09-14T11:03:58.841+0000 7efc2bf28800 10 monclient: _reopen_session rank -1 2024-09-14T11:03:59.116 INFO:tasks.workunit.client.0.smithi097.stderr: -458> 2024-09-14T11:03:58.841+0000 7efc2bf28800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:03:59.117 INFO:tasks.workunit.client.0.smithi097.stderr: -457> 2024-09-14T11:03:58.841+0000 7efc2bf28800 10 monclient(hunting): picked mon.noname-b con 0x5603c8e9be40 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:03:59.117 INFO:tasks.workunit.client.0.smithi097.stderr: -456> 2024-09-14T11:03:58.841+0000 7efc2bf28800 10 monclient(hunting): picked mon.noname-c con 0x5603c8ebee00 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:03:59.117 INFO:tasks.workunit.client.0.smithi097.stderr: -455> 2024-09-14T11:03:58.841+0000 7efc2bf28800 10 monclient(hunting): picked mon.noname-a con 0x7efc14002340 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:03:59.117 INFO:tasks.workunit.client.0.smithi097.stderr: -454> 2024-09-14T11:03:58.841+0000 7efc2bf28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:03:59.117 INFO:tasks.workunit.client.0.smithi097.stderr: -453> 2024-09-14T11:03:58.841+0000 7efc2bf28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:03:59.117 INFO:tasks.workunit.client.0.smithi097.stderr: -452> 2024-09-14T11:03:58.841+0000 7efc2bf28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:03:59.117 INFO:tasks.workunit.client.0.smithi097.stderr: -451> 2024-09-14T11:03:58.841+0000 7efc2bf28800 10 monclient(hunting): _renew_subs 2024-09-14T11:03:59.117 INFO:tasks.workunit.client.0.smithi097.stderr: -450> 2024-09-14T11:03:58.841+0000 7efc2bf28800 10 monclient(hunting): authenticate will time out at 1920.494636s 2024-09-14T11:03:59.117 INFO:tasks.workunit.client.0.smithi097.stderr: -449> 2024-09-14T11:03:58.841+0000 7efc1f44a640 10 monclient(hunting): get_auth_request con 0x5603c8ebee00 auth_method 0 2024-09-14T11:03:59.117 INFO:tasks.workunit.client.0.smithi097.stderr: -448> 2024-09-14T11:03:58.841+0000 7efc1f44a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:03:59.117 INFO:tasks.workunit.client.0.smithi097.stderr: -447> 2024-09-14T11:03:58.841+0000 7efc1f44a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:03:59.117 INFO:tasks.workunit.client.0.smithi097.stderr: -446> 2024-09-14T11:03:58.841+0000 7efc1f44a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:03:59.117 INFO:tasks.workunit.client.0.smithi097.stderr: -445> 2024-09-14T11:03:58.841+0000 7efc2844c640 10 monclient(hunting): get_auth_request con 0x7efc14002340 auth_method 0 2024-09-14T11:03:59.117 INFO:tasks.workunit.client.0.smithi097.stderr: -444> 2024-09-14T11:03:58.841+0000 7efc2844c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:03:59.118 INFO:tasks.workunit.client.0.smithi097.stderr: -443> 2024-09-14T11:03:58.841+0000 7efc2844c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:03:59.118 INFO:tasks.workunit.client.0.smithi097.stderr: -442> 2024-09-14T11:03:58.841+0000 7efc2844c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:03:59.118 INFO:tasks.workunit.client.0.smithi097.stderr: -441> 2024-09-14T11:03:58.841+0000 7efc1f44a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:03:59.118 INFO:tasks.workunit.client.0.smithi097.stderr: -440> 2024-09-14T11:03:58.841+0000 7efc1f44a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:03:59.118 INFO:tasks.workunit.client.0.smithi097.stderr: -439> 2024-09-14T11:03:58.841+0000 7efc1f44a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:03:59.118 INFO:tasks.workunit.client.0.smithi097.stderr: -438> 2024-09-14T11:03:58.841+0000 7efc2844c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:03:59.118 INFO:tasks.workunit.client.0.smithi097.stderr: -437> 2024-09-14T11:03:58.841+0000 7efc2844c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:03:59.118 INFO:tasks.workunit.client.0.smithi097.stderr: -436> 2024-09-14T11:03:58.841+0000 7efc2844c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:03:59.118 INFO:tasks.workunit.client.0.smithi097.stderr: -435> 2024-09-14T11:03:58.841+0000 7efc27c4b640 10 monclient(hunting): get_auth_request con 0x5603c8e9be40 auth_method 0 2024-09-14T11:03:59.118 INFO:tasks.workunit.client.0.smithi097.stderr: -434> 2024-09-14T11:03:58.841+0000 7efc27c4b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:03:59.118 INFO:tasks.workunit.client.0.smithi097.stderr: -433> 2024-09-14T11:03:58.841+0000 7efc27c4b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:03:59.118 INFO:tasks.workunit.client.0.smithi097.stderr: -432> 2024-09-14T11:03:58.841+0000 7efc27c4b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:03:59.118 INFO:tasks.workunit.client.0.smithi097.stderr: -431> 2024-09-14T11:03:58.841+0000 7efc27c4b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:03:59.119 INFO:tasks.workunit.client.0.smithi097.stderr: -430> 2024-09-14T11:03:58.841+0000 7efc27c4b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:03:59.119 INFO:tasks.workunit.client.0.smithi097.stderr: -429> 2024-09-14T11:03:58.841+0000 7efc27c4b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:03:59.119 INFO:tasks.workunit.client.0.smithi097.stderr: -428> 2024-09-14T11:03:58.841+0000 7efc1f44a640 10 monclient(hunting): handle_auth_done global_id 6527 payload 824 2024-09-14T11:03:59.119 INFO:tasks.workunit.client.0.smithi097.stderr: -427> 2024-09-14T11:03:58.841+0000 7efc1f44a640 10 monclient: _finish_hunting 0 2024-09-14T11:03:59.119 INFO:tasks.workunit.client.0.smithi097.stderr: -426> 2024-09-14T11:03:58.841+0000 7efc1f44a640 1 monclient: found mon.noname-c 2024-09-14T11:03:59.119 INFO:tasks.workunit.client.0.smithi097.stderr: -425> 2024-09-14T11:03:58.841+0000 7efc1f44a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:03:59.119 INFO:tasks.workunit.client.0.smithi097.stderr: -424> 2024-09-14T11:03:58.842+0000 7efb0ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:03:59.119 INFO:tasks.workunit.client.0.smithi097.stderr: -423> 2024-09-14T11:03:58.842+0000 7efb0ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:03:59.119 INFO:tasks.workunit.client.0.smithi097.stderr: -422> 2024-09-14T11:03:58.842+0000 7efb0ffff640 10 monclient: dump: 2024-09-14T11:03:59.119 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:03:59.119 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:03:59.119 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:59.119 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:59.119 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:03:59.120 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:03:59.120 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:03:59.120 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:03:59.120 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:03:59.120 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:59.120 INFO:tasks.workunit.client.0.smithi097.stderr: -421> 2024-09-14T11:03:58.842+0000 7efb0ffff640 10 monclient: _finish_auth 0 2024-09-14T11:03:59.120 INFO:tasks.workunit.client.0.smithi097.stderr: -420> 2024-09-14T11:03:58.842+0000 7efb0ffff640 10 monclient: _check_auth_tickets 2024-09-14T11:03:59.120 INFO:tasks.workunit.client.0.smithi097.stderr: -419> 2024-09-14T11:03:58.842+0000 7efb0ffff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:03:59.120 INFO:tasks.workunit.client.0.smithi097.stderr: -418> 2024-09-14T11:03:58.842+0000 7efb0ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:03:59.120 INFO:tasks.workunit.client.0.smithi097.stderr: -417> 2024-09-14T11:03:58.842+0000 7efb0ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:03:59.120 INFO:tasks.workunit.client.0.smithi097.stderr: -416> 2024-09-14T11:03:58.842+0000 7efb0ffff640 10 monclient: dump: 2024-09-14T11:03:59.120 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:03:59.120 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:03:59.120 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:59.121 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:59.121 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:03:59.121 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:03:59.121 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:03:59.121 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:03:59.121 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:03:59.121 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:59.121 INFO:tasks.workunit.client.0.smithi097.stderr: -415> 2024-09-14T11:03:58.842+0000 7efc2bf28800 5 monclient: authenticate success, global_id 6527 2024-09-14T11:03:59.121 INFO:tasks.workunit.client.0.smithi097.stderr: -414> 2024-09-14T11:03:58.842+0000 7efc2bf28800 10 monclient: _renew_subs 2024-09-14T11:03:59.121 INFO:tasks.workunit.client.0.smithi097.stderr: -413> 2024-09-14T11:03:58.842+0000 7efc2bf28800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:03:59.121 INFO:tasks.workunit.client.0.smithi097.stderr: -412> 2024-09-14T11:03:58.842+0000 7efb15e0b640 4 set_mon_vals no callback set 2024-09-14T11:03:59.121 INFO:tasks.workunit.client.0.smithi097.stderr: -411> 2024-09-14T11:03:58.842+0000 7efc2bf28800 10 monclient: _renew_subs 2024-09-14T11:03:59.121 INFO:tasks.workunit.client.0.smithi097.stderr: -410> 2024-09-14T11:03:58.842+0000 7efc2bf28800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:03:59.122 INFO:tasks.workunit.client.0.smithi097.stderr: -409> 2024-09-14T11:03:58.842+0000 7efc2bf28800 1 librados: init done 2024-09-14T11:03:59.122 INFO:tasks.workunit.client.0.smithi097.stderr: -408> 2024-09-14T11:03:58.844+0000 7efb0ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:03:59.122 INFO:tasks.workunit.client.0.smithi097.stderr: -407> 2024-09-14T11:03:58.844+0000 7efb0ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:03:59.122 INFO:tasks.workunit.client.0.smithi097.stderr: -406> 2024-09-14T11:03:58.844+0000 7efb0ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:03:59.122 INFO:tasks.workunit.client.0.smithi097.stderr: -405> 2024-09-14T11:03:58.844+0000 7efc27c4b640 10 monclient: get_auth_request con 0x7efb10077260 auth_method 0 2024-09-14T11:03:59.122 INFO:tasks.workunit.client.0.smithi097.stderr: -404> 2024-09-14T11:03:58.844+0000 7efc2844c640 10 monclient: get_auth_request con 0x5603c8ec1830 auth_method 0 2024-09-14T11:03:59.122 INFO:tasks.workunit.client.0.smithi097.stderr: -403> 2024-09-14T11:03:58.845+0000 7efc27c4b640 10 monclient: get_auth_request con 0x5603c8ee1400 auth_method 0 2024-09-14T11:03:59.122 INFO:tasks.workunit.client.0.smithi097.stderr: -402> 2024-09-14T11:03:58.846+0000 7efc1f44a640 10 monclient: get_auth_request con 0x5603c8ee5760 auth_method 0 2024-09-14T11:03:59.122 INFO:tasks.workunit.client.0.smithi097.stderr: -401> 2024-09-14T11:03:58.847+0000 7efc2844c640 10 monclient: get_auth_request con 0x5603c8ee4cb0 auth_method 0 2024-09-14T11:03:59.122 INFO:tasks.workunit.client.0.smithi097.stderr: -400> 2024-09-14T11:03:58.847+0000 7efc2bf28800 10 monclient: build_initial_monmap 2024-09-14T11:03:59.122 INFO:tasks.workunit.client.0.smithi097.stderr: -399> 2024-09-14T11:03:58.847+0000 7efc2bf28800 1 build_initial for_mkfs: 0 2024-09-14T11:03:59.122 INFO:tasks.workunit.client.0.smithi097.stderr: -398> 2024-09-14T11:03:58.847+0000 7efc2bf28800 10 monclient: monmap: 2024-09-14T11:03:59.122 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:03:59.122 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:03:59.123 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:03:59.123 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:03:59.123 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:03:59.123 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:03:59.123 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:03:59.123 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:03:59.123 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:03:59.123 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:59.123 INFO:tasks.workunit.client.0.smithi097.stderr: -397> 2024-09-14T11:03:58.847+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eeda00) adding auth protocol: cephx 2024-09-14T11:03:59.123 INFO:tasks.workunit.client.0.smithi097.stderr: -396> 2024-09-14T11:03:58.847+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eeda00) adding auth protocol: cephx 2024-09-14T11:03:59.123 INFO:tasks.workunit.client.0.smithi097.stderr: -395> 2024-09-14T11:03:58.847+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eeda00) adding auth protocol: cephx 2024-09-14T11:03:59.123 INFO:tasks.workunit.client.0.smithi097.stderr: -394> 2024-09-14T11:03:58.847+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eeda00) adding con mode: secure 2024-09-14T11:03:59.123 INFO:tasks.workunit.client.0.smithi097.stderr: -393> 2024-09-14T11:03:58.847+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eeda00) adding con mode: crc 2024-09-14T11:03:59.124 INFO:tasks.workunit.client.0.smithi097.stderr: -392> 2024-09-14T11:03:58.847+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eeda00) adding con mode: secure 2024-09-14T11:03:59.124 INFO:tasks.workunit.client.0.smithi097.stderr: -391> 2024-09-14T11:03:58.847+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eeda00) adding con mode: crc 2024-09-14T11:03:59.124 INFO:tasks.workunit.client.0.smithi097.stderr: -390> 2024-09-14T11:03:58.847+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eeda00) adding con mode: secure 2024-09-14T11:03:59.124 INFO:tasks.workunit.client.0.smithi097.stderr: -389> 2024-09-14T11:03:58.847+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eeda00) adding con mode: crc 2024-09-14T11:03:59.124 INFO:tasks.workunit.client.0.smithi097.stderr: -388> 2024-09-14T11:03:58.847+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eeda00) adding con mode: crc 2024-09-14T11:03:59.124 INFO:tasks.workunit.client.0.smithi097.stderr: -387> 2024-09-14T11:03:58.847+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eeda00) adding con mode: secure 2024-09-14T11:03:59.124 INFO:tasks.workunit.client.0.smithi097.stderr: -386> 2024-09-14T11:03:58.847+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eeda00) adding con mode: crc 2024-09-14T11:03:59.124 INFO:tasks.workunit.client.0.smithi097.stderr: -385> 2024-09-14T11:03:58.847+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eeda00) adding con mode: secure 2024-09-14T11:03:59.124 INFO:tasks.workunit.client.0.smithi097.stderr: -384> 2024-09-14T11:03:58.847+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eeda00) adding con mode: crc 2024-09-14T11:03:59.124 INFO:tasks.workunit.client.0.smithi097.stderr: -383> 2024-09-14T11:03:58.847+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eeda00) adding con mode: secure 2024-09-14T11:03:59.124 INFO:tasks.workunit.client.0.smithi097.stderr: -382> 2024-09-14T11:03:58.848+0000 7efc2bf28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:59.124 INFO:tasks.workunit.client.0.smithi097.stderr: -381> 2024-09-14T11:03:58.848+0000 7efc2bf28800 5 asok(0x5603c8c77270) register_command objecter_requests cmddesc objecter_requests hook 0x5603c8ef0d70 EEXIST 2024-09-14T11:03:59.124 INFO:tasks.workunit.client.0.smithi097.stderr: -380> 2024-09-14T11:03:58.848+0000 7efc2bf28800 10 monclient: init 2024-09-14T11:03:59.125 INFO:tasks.workunit.client.0.smithi097.stderr: -379> 2024-09-14T11:03:58.848+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eec7d8) adding auth protocol: cephx 2024-09-14T11:03:59.125 INFO:tasks.workunit.client.0.smithi097.stderr: -378> 2024-09-14T11:03:58.848+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eec7d8) adding auth protocol: cephx 2024-09-14T11:03:59.125 INFO:tasks.workunit.client.0.smithi097.stderr: -377> 2024-09-14T11:03:58.848+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eec7d8) adding auth protocol: cephx 2024-09-14T11:03:59.125 INFO:tasks.workunit.client.0.smithi097.stderr: -376> 2024-09-14T11:03:58.848+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eec7d8) adding con mode: secure 2024-09-14T11:03:59.125 INFO:tasks.workunit.client.0.smithi097.stderr: -375> 2024-09-14T11:03:58.848+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eec7d8) adding con mode: crc 2024-09-14T11:03:59.125 INFO:tasks.workunit.client.0.smithi097.stderr: -374> 2024-09-14T11:03:58.848+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eec7d8) adding con mode: secure 2024-09-14T11:03:59.125 INFO:tasks.workunit.client.0.smithi097.stderr: -373> 2024-09-14T11:03:58.848+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eec7d8) adding con mode: crc 2024-09-14T11:03:59.125 INFO:tasks.workunit.client.0.smithi097.stderr: -372> 2024-09-14T11:03:58.848+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eec7d8) adding con mode: secure 2024-09-14T11:03:59.125 INFO:tasks.workunit.client.0.smithi097.stderr: -371> 2024-09-14T11:03:58.848+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eec7d8) adding con mode: crc 2024-09-14T11:03:59.125 INFO:tasks.workunit.client.0.smithi097.stderr: -370> 2024-09-14T11:03:58.848+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eec7d8) adding con mode: crc 2024-09-14T11:03:59.125 INFO:tasks.workunit.client.0.smithi097.stderr: -369> 2024-09-14T11:03:58.848+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eec7d8) adding con mode: secure 2024-09-14T11:03:59.125 INFO:tasks.workunit.client.0.smithi097.stderr: -368> 2024-09-14T11:03:58.848+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eec7d8) adding con mode: crc 2024-09-14T11:03:59.125 INFO:tasks.workunit.client.0.smithi097.stderr: -367> 2024-09-14T11:03:58.848+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eec7d8) adding con mode: secure 2024-09-14T11:03:59.125 INFO:tasks.workunit.client.0.smithi097.stderr: -366> 2024-09-14T11:03:58.848+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eec7d8) adding con mode: crc 2024-09-14T11:03:59.126 INFO:tasks.workunit.client.0.smithi097.stderr: -365> 2024-09-14T11:03:58.848+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eec7d8) adding con mode: secure 2024-09-14T11:03:59.126 INFO:tasks.workunit.client.0.smithi097.stderr: -364> 2024-09-14T11:03:58.848+0000 7efc2bf28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:59.126 INFO:tasks.workunit.client.0.smithi097.stderr: -363> 2024-09-14T11:03:58.848+0000 7efc2bf28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:59.126 INFO:tasks.workunit.client.0.smithi097.stderr: -362> 2024-09-14T11:03:58.848+0000 7efc2bf28800 5 asok(0x5603c8c77270) register_command rotate-key cmddesc rotate-key hook 0x5603c8eec920 EEXIST 2024-09-14T11:03:59.126 INFO:tasks.workunit.client.0.smithi097.stderr: -361> 2024-09-14T11:03:58.848+0000 7efc2bf28800 10 monclient: _reopen_session rank -1 2024-09-14T11:03:59.126 INFO:tasks.workunit.client.0.smithi097.stderr: -360> 2024-09-14T11:03:58.848+0000 7efc2bf28800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:03:59.126 INFO:tasks.workunit.client.0.smithi097.stderr: -359> 2024-09-14T11:03:58.848+0000 7efc2bf28800 10 monclient(hunting): picked mon.noname-b con 0x5603c8f15090 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:03:59.126 INFO:tasks.workunit.client.0.smithi097.stderr: -358> 2024-09-14T11:03:58.849+0000 7efc2bf28800 10 monclient(hunting): picked mon.noname-c con 0x5603c8f15470 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:03:59.126 INFO:tasks.workunit.client.0.smithi097.stderr: -357> 2024-09-14T11:03:58.849+0000 7efc2bf28800 10 monclient(hunting): picked mon.noname-a con 0x5603c8f13da0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:03:59.126 INFO:tasks.workunit.client.0.smithi097.stderr: -356> 2024-09-14T11:03:58.849+0000 7efc2bf28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:03:59.126 INFO:tasks.workunit.client.0.smithi097.stderr: -355> 2024-09-14T11:03:58.849+0000 7efc2bf28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:03:59.126 INFO:tasks.workunit.client.0.smithi097.stderr: -354> 2024-09-14T11:03:58.849+0000 7efc2bf28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:03:59.126 INFO:tasks.workunit.client.0.smithi097.stderr: -353> 2024-09-14T11:03:58.849+0000 7efc2bf28800 10 monclient(hunting): _renew_subs 2024-09-14T11:03:59.126 INFO:tasks.workunit.client.0.smithi097.stderr: -352> 2024-09-14T11:03:58.849+0000 7efc2bf28800 10 monclient(hunting): authenticate will time out at 1920.502038s 2024-09-14T11:03:59.127 INFO:tasks.workunit.client.0.smithi097.stderr: -351> 2024-09-14T11:03:58.849+0000 7efc27c4b640 10 monclient(hunting): get_auth_request con 0x5603c8f13da0 auth_method 0 2024-09-14T11:03:59.127 INFO:tasks.workunit.client.0.smithi097.stderr: -350> 2024-09-14T11:03:58.849+0000 7efc27c4b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:03:59.127 INFO:tasks.workunit.client.0.smithi097.stderr: -349> 2024-09-14T11:03:58.849+0000 7efc27c4b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:03:59.127 INFO:tasks.workunit.client.0.smithi097.stderr: -348> 2024-09-14T11:03:58.849+0000 7efc27c4b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:03:59.127 INFO:tasks.workunit.client.0.smithi097.stderr: -347> 2024-09-14T11:03:58.849+0000 7efc2844c640 10 monclient(hunting): get_auth_request con 0x5603c8f15470 auth_method 0 2024-09-14T11:03:59.127 INFO:tasks.workunit.client.0.smithi097.stderr: -346> 2024-09-14T11:03:58.849+0000 7efc2844c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:03:59.127 INFO:tasks.workunit.client.0.smithi097.stderr: -345> 2024-09-14T11:03:58.849+0000 7efc2844c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:03:59.127 INFO:tasks.workunit.client.0.smithi097.stderr: -344> 2024-09-14T11:03:58.849+0000 7efc2844c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:03:59.127 INFO:tasks.workunit.client.0.smithi097.stderr: -343> 2024-09-14T11:03:58.849+0000 7efc1f44a640 10 monclient(hunting): get_auth_request con 0x5603c8f15090 auth_method 0 2024-09-14T11:03:59.127 INFO:tasks.workunit.client.0.smithi097.stderr: -342> 2024-09-14T11:03:58.849+0000 7efc1f44a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:03:59.127 INFO:tasks.workunit.client.0.smithi097.stderr: -341> 2024-09-14T11:03:58.849+0000 7efc1f44a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:03:59.127 INFO:tasks.workunit.client.0.smithi097.stderr: -340> 2024-09-14T11:03:58.849+0000 7efc1f44a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:03:59.127 INFO:tasks.workunit.client.0.smithi097.stderr: -339> 2024-09-14T11:03:58.849+0000 7efc27c4b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:03:59.127 INFO:tasks.workunit.client.0.smithi097.stderr: -338> 2024-09-14T11:03:58.849+0000 7efc27c4b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:03:59.128 INFO:tasks.workunit.client.0.smithi097.stderr: -337> 2024-09-14T11:03:58.849+0000 7efc27c4b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:03:59.128 INFO:tasks.workunit.client.0.smithi097.stderr: -336> 2024-09-14T11:03:58.849+0000 7efc2844c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:03:59.128 INFO:tasks.workunit.client.0.smithi097.stderr: -335> 2024-09-14T11:03:58.849+0000 7efc2844c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:03:59.128 INFO:tasks.workunit.client.0.smithi097.stderr: -334> 2024-09-14T11:03:58.849+0000 7efc2844c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:03:59.128 INFO:tasks.workunit.client.0.smithi097.stderr: -333> 2024-09-14T11:03:58.849+0000 7efc1f44a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:03:59.128 INFO:tasks.workunit.client.0.smithi097.stderr: -332> 2024-09-14T11:03:58.849+0000 7efc1f44a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:03:59.128 INFO:tasks.workunit.client.0.smithi097.stderr: -331> 2024-09-14T11:03:58.849+0000 7efc1f44a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:03:59.128 INFO:tasks.workunit.client.0.smithi097.stderr: -330> 2024-09-14T11:03:58.849+0000 7efc27c4b640 10 monclient(hunting): handle_auth_done global_id 6897 payload 824 2024-09-14T11:03:59.128 INFO:tasks.workunit.client.0.smithi097.stderr: -329> 2024-09-14T11:03:58.849+0000 7efc27c4b640 10 monclient: _finish_hunting 0 2024-09-14T11:03:59.128 INFO:tasks.workunit.client.0.smithi097.stderr: -328> 2024-09-14T11:03:58.849+0000 7efc27c4b640 1 monclient: found mon.noname-a 2024-09-14T11:03:59.128 INFO:tasks.workunit.client.0.smithi097.stderr: -327> 2024-09-14T11:03:58.849+0000 7efc27c4b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-14T11:03:59.128 INFO:tasks.workunit.client.0.smithi097.stderr: -326> 2024-09-14T11:03:58.849+0000 7efb0d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:03:59.129 INFO:tasks.workunit.client.0.smithi097.stderr: -325> 2024-09-14T11:03:58.849+0000 7efb0d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:03:59.129 INFO:tasks.workunit.client.0.smithi097.stderr: -324> 2024-09-14T11:03:58.849+0000 7efb0d7fa640 10 monclient: dump: 2024-09-14T11:03:59.129 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:03:59.129 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:03:59.129 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:59.129 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:59.129 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:03:59.129 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:03:59.129 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:03:59.129 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:03:59.129 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:03:59.129 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:59.129 INFO:tasks.workunit.client.0.smithi097.stderr: -323> 2024-09-14T11:03:58.849+0000 7efb0d7fa640 10 monclient: _finish_auth 0 2024-09-14T11:03:59.129 INFO:tasks.workunit.client.0.smithi097.stderr: -322> 2024-09-14T11:03:58.849+0000 7efb0d7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:03:59.130 INFO:tasks.workunit.client.0.smithi097.stderr: -321> 2024-09-14T11:03:58.849+0000 7efb0d7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:03:59.130 INFO:tasks.workunit.client.0.smithi097.stderr: -320> 2024-09-14T11:03:58.849+0000 7efb0d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:03:59.130 INFO:tasks.workunit.client.0.smithi097.stderr: -319> 2024-09-14T11:03:58.849+0000 7efb0d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:03:59.130 INFO:tasks.workunit.client.0.smithi097.stderr: -318> 2024-09-14T11:03:58.849+0000 7efb0d7fa640 10 monclient: dump: 2024-09-14T11:03:59.130 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:03:59.130 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:03:59.130 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:59.130 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:59.130 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:03:59.130 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:03:59.130 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:03:59.130 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:03:59.130 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:03:59.131 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:59.131 INFO:tasks.workunit.client.0.smithi097.stderr: -317> 2024-09-14T11:03:58.849+0000 7efc2bf28800 5 monclient: authenticate success, global_id 6897 2024-09-14T11:03:59.131 INFO:tasks.workunit.client.0.smithi097.stderr: -316> 2024-09-14T11:03:58.849+0000 7efc2bf28800 10 monclient: _renew_subs 2024-09-14T11:03:59.131 INFO:tasks.workunit.client.0.smithi097.stderr: -315> 2024-09-14T11:03:58.849+0000 7efc2bf28800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:03:59.131 INFO:tasks.workunit.client.0.smithi097.stderr: -314> 2024-09-14T11:03:58.849+0000 7efc28c4d640 4 set_mon_vals no callback set 2024-09-14T11:03:59.131 INFO:tasks.workunit.client.0.smithi097.stderr: -313> 2024-09-14T11:03:58.849+0000 7efc2bf28800 10 monclient: _renew_subs 2024-09-14T11:03:59.131 INFO:tasks.workunit.client.0.smithi097.stderr: -312> 2024-09-14T11:03:58.849+0000 7efc2bf28800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:03:59.131 INFO:tasks.workunit.client.0.smithi097.stderr: -311> 2024-09-14T11:03:58.851+0000 7efb0d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:03:59.131 INFO:tasks.workunit.client.0.smithi097.stderr: -310> 2024-09-14T11:03:58.851+0000 7efb0d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:03:59.131 INFO:tasks.workunit.client.0.smithi097.stderr: -309> 2024-09-14T11:03:58.851+0000 7efb0d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:03:59.131 INFO:tasks.workunit.client.0.smithi097.stderr: -308> 2024-09-14T11:03:58.851+0000 7efc1f44a640 10 monclient: get_auth_request con 0x7efb00077140 auth_method 0 2024-09-14T11:03:59.131 INFO:tasks.workunit.client.0.smithi097.stderr: -307> 2024-09-14T11:03:58.852+0000 7efc2bf28800 10 monclient: get_monmap_and_config 2024-09-14T11:03:59.131 INFO:tasks.workunit.client.0.smithi097.stderr: -306> 2024-09-14T11:03:58.852+0000 7efc2bf28800 10 monclient: build_initial_monmap 2024-09-14T11:03:59.131 INFO:tasks.workunit.client.0.smithi097.stderr: -305> 2024-09-14T11:03:58.852+0000 7efc2bf28800 1 build_initial for_mkfs: 0 2024-09-14T11:03:59.132 INFO:tasks.workunit.client.0.smithi097.stderr: -304> 2024-09-14T11:03:58.852+0000 7efc2bf28800 10 monclient: monmap: 2024-09-14T11:03:59.132 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:03:59.132 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:03:59.132 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:03:59.132 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:03:59.132 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:03:59.132 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:03:59.132 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:03:59.132 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:03:59.132 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:03:59.132 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:59.132 INFO:tasks.workunit.client.0.smithi097.stderr: -303> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f34de0) adding auth protocol: cephx 2024-09-14T11:03:59.132 INFO:tasks.workunit.client.0.smithi097.stderr: -302> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f34de0) adding auth protocol: cephx 2024-09-14T11:03:59.133 INFO:tasks.workunit.client.0.smithi097.stderr: -301> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f34de0) adding auth protocol: cephx 2024-09-14T11:03:59.133 INFO:tasks.workunit.client.0.smithi097.stderr: -300> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f34de0) adding con mode: secure 2024-09-14T11:03:59.133 INFO:tasks.workunit.client.0.smithi097.stderr: -299> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f34de0) adding con mode: crc 2024-09-14T11:03:59.133 INFO:tasks.workunit.client.0.smithi097.stderr: -298> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f34de0) adding con mode: secure 2024-09-14T11:03:59.133 INFO:tasks.workunit.client.0.smithi097.stderr: -297> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f34de0) adding con mode: crc 2024-09-14T11:03:59.133 INFO:tasks.workunit.client.0.smithi097.stderr: -296> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f34de0) adding con mode: secure 2024-09-14T11:03:59.133 INFO:tasks.workunit.client.0.smithi097.stderr: -295> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f34de0) adding con mode: crc 2024-09-14T11:03:59.133 INFO:tasks.workunit.client.0.smithi097.stderr: -294> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f34de0) adding con mode: crc 2024-09-14T11:03:59.133 INFO:tasks.workunit.client.0.smithi097.stderr: -293> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f34de0) adding con mode: secure 2024-09-14T11:03:59.133 INFO:tasks.workunit.client.0.smithi097.stderr: -292> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f34de0) adding con mode: crc 2024-09-14T11:03:59.133 INFO:tasks.workunit.client.0.smithi097.stderr: -291> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f34de0) adding con mode: secure 2024-09-14T11:03:59.133 INFO:tasks.workunit.client.0.smithi097.stderr: -290> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f34de0) adding con mode: crc 2024-09-14T11:03:59.133 INFO:tasks.workunit.client.0.smithi097.stderr: -289> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f34de0) adding con mode: secure 2024-09-14T11:03:59.133 INFO:tasks.workunit.client.0.smithi097.stderr: -288> 2024-09-14T11:03:58.852+0000 7efc2bf28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:59.134 INFO:tasks.workunit.client.0.smithi097.stderr: -287> 2024-09-14T11:03:58.852+0000 7efc2bf28800 10 monclient: init 2024-09-14T11:03:59.134 INFO:tasks.workunit.client.0.smithi097.stderr: -286> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273603d0) adding auth protocol: cephx 2024-09-14T11:03:59.134 INFO:tasks.workunit.client.0.smithi097.stderr: -285> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273603d0) adding auth protocol: cephx 2024-09-14T11:03:59.134 INFO:tasks.workunit.client.0.smithi097.stderr: -284> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273603d0) adding auth protocol: cephx 2024-09-14T11:03:59.134 INFO:tasks.workunit.client.0.smithi097.stderr: -283> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273603d0) adding con mode: secure 2024-09-14T11:03:59.134 INFO:tasks.workunit.client.0.smithi097.stderr: -282> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273603d0) adding con mode: crc 2024-09-14T11:03:59.134 INFO:tasks.workunit.client.0.smithi097.stderr: -281> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273603d0) adding con mode: secure 2024-09-14T11:03:59.134 INFO:tasks.workunit.client.0.smithi097.stderr: -280> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273603d0) adding con mode: crc 2024-09-14T11:03:59.134 INFO:tasks.workunit.client.0.smithi097.stderr: -279> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273603d0) adding con mode: secure 2024-09-14T11:03:59.134 INFO:tasks.workunit.client.0.smithi097.stderr: -278> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273603d0) adding con mode: crc 2024-09-14T11:03:59.134 INFO:tasks.workunit.client.0.smithi097.stderr: -277> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273603d0) adding con mode: crc 2024-09-14T11:03:59.134 INFO:tasks.workunit.client.0.smithi097.stderr: -276> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273603d0) adding con mode: secure 2024-09-14T11:03:59.134 INFO:tasks.workunit.client.0.smithi097.stderr: -275> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273603d0) adding con mode: crc 2024-09-14T11:03:59.135 INFO:tasks.workunit.client.0.smithi097.stderr: -274> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273603d0) adding con mode: secure 2024-09-14T11:03:59.135 INFO:tasks.workunit.client.0.smithi097.stderr: -273> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273603d0) adding con mode: crc 2024-09-14T11:03:59.135 INFO:tasks.workunit.client.0.smithi097.stderr: -272> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273603d0) adding con mode: secure 2024-09-14T11:03:59.135 INFO:tasks.workunit.client.0.smithi097.stderr: -271> 2024-09-14T11:03:58.852+0000 7efc2bf28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:59.135 INFO:tasks.workunit.client.0.smithi097.stderr: -270> 2024-09-14T11:03:58.852+0000 7efc2bf28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:59.135 INFO:tasks.workunit.client.0.smithi097.stderr: -269> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 asok(0x5603c8c77270) register_command rotate-key cmddesc rotate-key hook 0x7ffe27360518 EEXIST 2024-09-14T11:03:59.135 INFO:tasks.workunit.client.0.smithi097.stderr: -268> 2024-09-14T11:03:58.853+0000 7efc2bf28800 10 monclient: _reopen_session rank -1 2024-09-14T11:03:59.135 INFO:tasks.workunit.client.0.smithi097.stderr: -267> 2024-09-14T11:03:58.853+0000 7efc2bf28800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:03:59.135 INFO:tasks.workunit.client.0.smithi097.stderr: -266> 2024-09-14T11:03:58.853+0000 7efc2bf28800 10 monclient(hunting): picked mon.noname-b con 0x5603c8f693e0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:03:59.135 INFO:tasks.workunit.client.0.smithi097.stderr: -265> 2024-09-14T11:03:58.853+0000 7efc2bf28800 10 monclient(hunting): picked mon.noname-c con 0x5603c8f59d30 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:03:59.135 INFO:tasks.workunit.client.0.smithi097.stderr: -264> 2024-09-14T11:03:58.853+0000 7efc2bf28800 10 monclient(hunting): picked mon.noname-a con 0x5603c8f64810 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:03:59.135 INFO:tasks.workunit.client.0.smithi097.stderr: -263> 2024-09-14T11:03:58.853+0000 7efc2bf28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:03:59.135 INFO:tasks.workunit.client.0.smithi097.stderr: -262> 2024-09-14T11:03:58.853+0000 7efc2bf28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:03:59.135 INFO:tasks.workunit.client.0.smithi097.stderr: -261> 2024-09-14T11:03:58.853+0000 7efc2bf28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:03:59.136 INFO:tasks.workunit.client.0.smithi097.stderr: -260> 2024-09-14T11:03:58.853+0000 7efc2bf28800 10 monclient(hunting): _renew_subs 2024-09-14T11:03:59.136 INFO:tasks.workunit.client.0.smithi097.stderr: -259> 2024-09-14T11:03:58.853+0000 7efc2bf28800 10 monclient(hunting): authenticate will time out at 1920.506069s 2024-09-14T11:03:59.136 INFO:tasks.workunit.client.0.smithi097.stderr: -258> 2024-09-14T11:03:58.853+0000 7efc2844c640 10 monclient(hunting): get_auth_request con 0x5603c8f59d30 auth_method 0 2024-09-14T11:03:59.136 INFO:tasks.workunit.client.0.smithi097.stderr: -257> 2024-09-14T11:03:58.853+0000 7efc2844c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:03:59.136 INFO:tasks.workunit.client.0.smithi097.stderr: -256> 2024-09-14T11:03:58.853+0000 7efc2844c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:03:59.136 INFO:tasks.workunit.client.0.smithi097.stderr: -255> 2024-09-14T11:03:58.853+0000 7efc2844c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:03:59.136 INFO:tasks.workunit.client.0.smithi097.stderr: -254> 2024-09-14T11:03:58.853+0000 7efc27c4b640 10 monclient(hunting): get_auth_request con 0x5603c8f64810 auth_method 0 2024-09-14T11:03:59.136 INFO:tasks.workunit.client.0.smithi097.stderr: -253> 2024-09-14T11:03:58.853+0000 7efc27c4b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:03:59.136 INFO:tasks.workunit.client.0.smithi097.stderr: -252> 2024-09-14T11:03:58.853+0000 7efc27c4b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:03:59.136 INFO:tasks.workunit.client.0.smithi097.stderr: -251> 2024-09-14T11:03:58.853+0000 7efc27c4b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:03:59.136 INFO:tasks.workunit.client.0.smithi097.stderr: -250> 2024-09-14T11:03:58.853+0000 7efc2844c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:03:59.136 INFO:tasks.workunit.client.0.smithi097.stderr: -249> 2024-09-14T11:03:58.853+0000 7efc2844c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:03:59.136 INFO:tasks.workunit.client.0.smithi097.stderr: -248> 2024-09-14T11:03:58.853+0000 7efc2844c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:03:59.137 INFO:tasks.workunit.client.0.smithi097.stderr: -247> 2024-09-14T11:03:58.853+0000 7efc27c4b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:03:59.137 INFO:tasks.workunit.client.0.smithi097.stderr: -246> 2024-09-14T11:03:58.853+0000 7efc27c4b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:03:59.137 INFO:tasks.workunit.client.0.smithi097.stderr: -245> 2024-09-14T11:03:58.853+0000 7efc27c4b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:03:59.137 INFO:tasks.workunit.client.0.smithi097.stderr: -244> 2024-09-14T11:03:58.853+0000 7efc1f44a640 10 monclient(hunting): get_auth_request con 0x5603c8f693e0 auth_method 0 2024-09-14T11:03:59.137 INFO:tasks.workunit.client.0.smithi097.stderr: -243> 2024-09-14T11:03:58.853+0000 7efc1f44a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:03:59.137 INFO:tasks.workunit.client.0.smithi097.stderr: -242> 2024-09-14T11:03:58.853+0000 7efc1f44a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:03:59.137 INFO:tasks.workunit.client.0.smithi097.stderr: -241> 2024-09-14T11:03:58.853+0000 7efc1f44a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:03:59.137 INFO:tasks.workunit.client.0.smithi097.stderr: -240> 2024-09-14T11:03:58.853+0000 7efc1f44a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:03:59.137 INFO:tasks.workunit.client.0.smithi097.stderr: -239> 2024-09-14T11:03:58.853+0000 7efc1f44a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:03:59.137 INFO:tasks.workunit.client.0.smithi097.stderr: -238> 2024-09-14T11:03:58.853+0000 7efc1f44a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:03:59.137 INFO:tasks.workunit.client.0.smithi097.stderr: -237> 2024-09-14T11:03:58.853+0000 7efc27c4b640 10 monclient(hunting): handle_auth_done global_id 6900 payload 274 2024-09-14T11:03:59.137 INFO:tasks.workunit.client.0.smithi097.stderr: -236> 2024-09-14T11:03:58.853+0000 7efc27c4b640 10 monclient: _finish_hunting 0 2024-09-14T11:03:59.137 INFO:tasks.workunit.client.0.smithi097.stderr: -235> 2024-09-14T11:03:58.853+0000 7efc27c4b640 1 monclient: found mon.noname-a 2024-09-14T11:03:59.137 INFO:tasks.workunit.client.0.smithi097.stderr: -234> 2024-09-14T11:03:58.853+0000 7efc27c4b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-14T11:03:59.138 INFO:tasks.workunit.client.0.smithi097.stderr: -233> 2024-09-14T11:03:58.853+0000 7efb06ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:03:59.138 INFO:tasks.workunit.client.0.smithi097.stderr: -232> 2024-09-14T11:03:58.853+0000 7efb06ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:03:59.138 INFO:tasks.workunit.client.0.smithi097.stderr: -231> 2024-09-14T11:03:58.853+0000 7efb06ffd640 10 monclient: dump: 2024-09-14T11:03:59.138 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:03:59.138 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:03:59.138 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:59.138 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:59.138 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:03:59.138 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:03:59.138 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:03:59.138 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:03:59.138 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:03:59.138 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:59.138 INFO:tasks.workunit.client.0.smithi097.stderr: -230> 2024-09-14T11:03:58.853+0000 7efb06ffd640 10 monclient: _finish_auth 0 2024-09-14T11:03:59.139 INFO:tasks.workunit.client.0.smithi097.stderr: -229> 2024-09-14T11:03:58.853+0000 7efb06ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:03:59.139 INFO:tasks.workunit.client.0.smithi097.stderr: -228> 2024-09-14T11:03:58.853+0000 7efb06ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:03:59.139 INFO:tasks.workunit.client.0.smithi097.stderr: -227> 2024-09-14T11:03:58.853+0000 7efc2bf28800 5 monclient: authenticate success, global_id 6900 2024-09-14T11:03:59.139 INFO:tasks.workunit.client.0.smithi097.stderr: -226> 2024-09-14T11:03:58.853+0000 7efc2bf28800 10 monclient: get_monmap_and_config success 2024-09-14T11:03:59.139 INFO:tasks.workunit.client.0.smithi097.stderr: -225> 2024-09-14T11:03:58.853+0000 7efc2bf28800 4 set_mon_vals no callback set 2024-09-14T11:03:59.139 INFO:tasks.workunit.client.0.smithi097.stderr: -224> 2024-09-14T11:03:58.853+0000 7efb06ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:03:59.139 INFO:tasks.workunit.client.0.smithi097.stderr: -223> 2024-09-14T11:03:58.853+0000 7efb06ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:03:59.139 INFO:tasks.workunit.client.0.smithi097.stderr: -222> 2024-09-14T11:03:58.853+0000 7efb06ffd640 10 monclient: dump: 2024-09-14T11:03:59.139 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:03:59.139 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:03:59.139 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:59.139 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:59.139 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:03:59.139 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:03:59.140 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:03:59.140 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:03:59.140 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:03:59.140 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:59.140 INFO:tasks.workunit.client.0.smithi097.stderr: -221> 2024-09-14T11:03:58.854+0000 7efc2bf28800 10 monclient: shutdown 2024-09-14T11:03:59.140 INFO:tasks.workunit.client.0.smithi097.stderr: -220> 2024-09-14T11:03:58.854+0000 7efc2bf28800 10 monclient: build_initial_monmap 2024-09-14T11:03:59.140 INFO:tasks.workunit.client.0.smithi097.stderr: -219> 2024-09-14T11:03:58.854+0000 7efc2bf28800 1 build_initial for_mkfs: 0 2024-09-14T11:03:59.140 INFO:tasks.workunit.client.0.smithi097.stderr: -218> 2024-09-14T11:03:58.854+0000 7efc2bf28800 10 monclient: monmap: 2024-09-14T11:03:59.140 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:03:59.140 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:03:59.140 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:03:59.140 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:03:59.140 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:03:59.141 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:03:59.141 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:03:59.141 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:03:59.141 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:03:59.141 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:59.141 INFO:tasks.workunit.client.0.smithi097.stderr: -217> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f38940) adding auth protocol: cephx 2024-09-14T11:03:59.141 INFO:tasks.workunit.client.0.smithi097.stderr: -216> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f38940) adding auth protocol: cephx 2024-09-14T11:03:59.141 INFO:tasks.workunit.client.0.smithi097.stderr: -215> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f38940) adding auth protocol: cephx 2024-09-14T11:03:59.141 INFO:tasks.workunit.client.0.smithi097.stderr: -214> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f38940) adding con mode: secure 2024-09-14T11:03:59.141 INFO:tasks.workunit.client.0.smithi097.stderr: -213> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f38940) adding con mode: crc 2024-09-14T11:03:59.141 INFO:tasks.workunit.client.0.smithi097.stderr: -212> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f38940) adding con mode: secure 2024-09-14T11:03:59.141 INFO:tasks.workunit.client.0.smithi097.stderr: -211> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f38940) adding con mode: crc 2024-09-14T11:03:59.141 INFO:tasks.workunit.client.0.smithi097.stderr: -210> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f38940) adding con mode: secure 2024-09-14T11:03:59.141 INFO:tasks.workunit.client.0.smithi097.stderr: -209> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f38940) adding con mode: crc 2024-09-14T11:03:59.142 INFO:tasks.workunit.client.0.smithi097.stderr: -208> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f38940) adding con mode: crc 2024-09-14T11:03:59.142 INFO:tasks.workunit.client.0.smithi097.stderr: -207> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f38940) adding con mode: secure 2024-09-14T11:03:59.142 INFO:tasks.workunit.client.0.smithi097.stderr: -206> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f38940) adding con mode: crc 2024-09-14T11:03:59.142 INFO:tasks.workunit.client.0.smithi097.stderr: -205> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f38940) adding con mode: secure 2024-09-14T11:03:59.142 INFO:tasks.workunit.client.0.smithi097.stderr: -204> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f38940) adding con mode: crc 2024-09-14T11:03:59.142 INFO:tasks.workunit.client.0.smithi097.stderr: -203> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f38940) adding con mode: secure 2024-09-14T11:03:59.142 INFO:tasks.workunit.client.0.smithi097.stderr: -202> 2024-09-14T11:03:58.854+0000 7efc2bf28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:59.142 INFO:tasks.workunit.client.0.smithi097.stderr: -201> 2024-09-14T11:03:58.854+0000 7efc2bf28800 1 librados: starting msgr at 2024-09-14T11:03:59.142 INFO:tasks.workunit.client.0.smithi097.stderr: -200> 2024-09-14T11:03:58.854+0000 7efc2bf28800 1 librados: starting objecter 2024-09-14T11:03:59.142 INFO:tasks.workunit.client.0.smithi097.stderr: -199> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 asok(0x5603c8c77270) register_command objecter_requests cmddesc objecter_requests hook 0x5603c8f38850 EEXIST 2024-09-14T11:03:59.142 INFO:tasks.workunit.client.0.smithi097.stderr: -198> 2024-09-14T11:03:58.854+0000 7efc2bf28800 1 librados: setting wanted keys 2024-09-14T11:03:59.142 INFO:tasks.workunit.client.0.smithi097.stderr: -197> 2024-09-14T11:03:58.854+0000 7efc2bf28800 1 librados: calling monclient init 2024-09-14T11:03:59.142 INFO:tasks.workunit.client.0.smithi097.stderr: -196> 2024-09-14T11:03:58.854+0000 7efc2bf28800 10 monclient: init 2024-09-14T11:03:59.142 INFO:tasks.workunit.client.0.smithi097.stderr: -195> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f29950) adding auth protocol: cephx 2024-09-14T11:03:59.143 INFO:tasks.workunit.client.0.smithi097.stderr: -194> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f29950) adding auth protocol: cephx 2024-09-14T11:03:59.143 INFO:tasks.workunit.client.0.smithi097.stderr: -193> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f29950) adding auth protocol: cephx 2024-09-14T11:03:59.143 INFO:tasks.workunit.client.0.smithi097.stderr: -192> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f29950) adding con mode: secure 2024-09-14T11:03:59.143 INFO:tasks.workunit.client.0.smithi097.stderr: -191> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f29950) adding con mode: crc 2024-09-14T11:03:59.143 INFO:tasks.workunit.client.0.smithi097.stderr: -190> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f29950) adding con mode: secure 2024-09-14T11:03:59.143 INFO:tasks.workunit.client.0.smithi097.stderr: -189> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f29950) adding con mode: crc 2024-09-14T11:03:59.143 INFO:tasks.workunit.client.0.smithi097.stderr: -188> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f29950) adding con mode: secure 2024-09-14T11:03:59.143 INFO:tasks.workunit.client.0.smithi097.stderr: -187> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f29950) adding con mode: crc 2024-09-14T11:03:59.143 INFO:tasks.workunit.client.0.smithi097.stderr: -186> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f29950) adding con mode: crc 2024-09-14T11:03:59.143 INFO:tasks.workunit.client.0.smithi097.stderr: -185> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f29950) adding con mode: secure 2024-09-14T11:03:59.143 INFO:tasks.workunit.client.0.smithi097.stderr: -184> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f29950) adding con mode: crc 2024-09-14T11:03:59.143 INFO:tasks.workunit.client.0.smithi097.stderr: -183> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f29950) adding con mode: secure 2024-09-14T11:03:59.143 INFO:tasks.workunit.client.0.smithi097.stderr: -182> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f29950) adding con mode: crc 2024-09-14T11:03:59.143 INFO:tasks.workunit.client.0.smithi097.stderr: -181> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f29950) adding con mode: secure 2024-09-14T11:03:59.144 INFO:tasks.workunit.client.0.smithi097.stderr: -180> 2024-09-14T11:03:58.854+0000 7efc2bf28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:59.144 INFO:tasks.workunit.client.0.smithi097.stderr: -179> 2024-09-14T11:03:58.855+0000 7efc2bf28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:59.144 INFO:tasks.workunit.client.0.smithi097.stderr: -178> 2024-09-14T11:03:58.855+0000 7efc2bf28800 5 asok(0x5603c8c77270) register_command rotate-key cmddesc rotate-key hook 0x5603c8f29a98 EEXIST 2024-09-14T11:03:59.144 INFO:tasks.workunit.client.0.smithi097.stderr: -177> 2024-09-14T11:03:58.855+0000 7efc2bf28800 10 monclient: _reopen_session rank -1 2024-09-14T11:03:59.144 INFO:tasks.workunit.client.0.smithi097.stderr: -176> 2024-09-14T11:03:58.855+0000 7efc2bf28800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:03:59.144 INFO:tasks.workunit.client.0.smithi097.stderr: -175> 2024-09-14T11:03:58.855+0000 7efc2bf28800 10 monclient(hunting): picked mon.noname-c con 0x5603c8f59d30 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:03:59.144 INFO:tasks.workunit.client.0.smithi097.stderr: -174> 2024-09-14T11:03:58.855+0000 7efc2bf28800 10 monclient(hunting): picked mon.noname-a con 0x5603c8f64810 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:03:59.144 INFO:tasks.workunit.client.0.smithi097.stderr: -173> 2024-09-14T11:03:58.855+0000 7efc2bf28800 10 monclient(hunting): picked mon.noname-b con 0x5603c8f693e0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:03:59.144 INFO:tasks.workunit.client.0.smithi097.stderr: -172> 2024-09-14T11:03:58.855+0000 7efc2bf28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:03:59.144 INFO:tasks.workunit.client.0.smithi097.stderr: -171> 2024-09-14T11:03:58.855+0000 7efc2bf28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:03:59.144 INFO:tasks.workunit.client.0.smithi097.stderr: -170> 2024-09-14T11:03:58.855+0000 7efc2bf28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:03:59.144 INFO:tasks.workunit.client.0.smithi097.stderr: -169> 2024-09-14T11:03:58.855+0000 7efc2bf28800 10 monclient(hunting): _renew_subs 2024-09-14T11:03:59.144 INFO:tasks.workunit.client.0.smithi097.stderr: -168> 2024-09-14T11:03:58.855+0000 7efc2bf28800 10 monclient(hunting): authenticate will time out at 1920.508244s 2024-09-14T11:03:59.144 INFO:tasks.workunit.client.0.smithi097.stderr: -167> 2024-09-14T11:03:58.855+0000 7efc1f44a640 10 monclient(hunting): get_auth_request con 0x5603c8f59d30 auth_method 0 2024-09-14T11:03:59.145 INFO:tasks.workunit.client.0.smithi097.stderr: -166> 2024-09-14T11:03:58.855+0000 7efc1f44a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:03:59.145 INFO:tasks.workunit.client.0.smithi097.stderr: -165> 2024-09-14T11:03:58.855+0000 7efc1f44a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:03:59.145 INFO:tasks.workunit.client.0.smithi097.stderr: -164> 2024-09-14T11:03:58.855+0000 7efc1f44a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:03:59.145 INFO:tasks.workunit.client.0.smithi097.stderr: -163> 2024-09-14T11:03:58.855+0000 7efc2844c640 10 monclient(hunting): get_auth_request con 0x5603c8f64810 auth_method 0 2024-09-14T11:03:59.145 INFO:tasks.workunit.client.0.smithi097.stderr: -162> 2024-09-14T11:03:58.855+0000 7efc2844c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:03:59.145 INFO:tasks.workunit.client.0.smithi097.stderr: -161> 2024-09-14T11:03:58.855+0000 7efc2844c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:03:59.145 INFO:tasks.workunit.client.0.smithi097.stderr: -160> 2024-09-14T11:03:58.855+0000 7efc2844c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:03:59.145 INFO:tasks.workunit.client.0.smithi097.stderr: -159> 2024-09-14T11:03:58.855+0000 7efc1f44a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:03:59.145 INFO:tasks.workunit.client.0.smithi097.stderr: -158> 2024-09-14T11:03:58.855+0000 7efc1f44a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:03:59.145 INFO:tasks.workunit.client.0.smithi097.stderr: -157> 2024-09-14T11:03:58.855+0000 7efc1f44a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:03:59.145 INFO:tasks.workunit.client.0.smithi097.stderr: -156> 2024-09-14T11:03:58.855+0000 7efc27c4b640 10 monclient(hunting): get_auth_request con 0x5603c8f693e0 auth_method 0 2024-09-14T11:03:59.145 INFO:tasks.workunit.client.0.smithi097.stderr: -155> 2024-09-14T11:03:58.855+0000 7efc27c4b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:03:59.145 INFO:tasks.workunit.client.0.smithi097.stderr: -154> 2024-09-14T11:03:58.855+0000 7efc27c4b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:03:59.145 INFO:tasks.workunit.client.0.smithi097.stderr: -153> 2024-09-14T11:03:58.855+0000 7efc27c4b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:03:59.146 INFO:tasks.workunit.client.0.smithi097.stderr: -152> 2024-09-14T11:03:58.855+0000 7efc2844c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:03:59.146 INFO:tasks.workunit.client.0.smithi097.stderr: -151> 2024-09-14T11:03:58.855+0000 7efc2844c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:03:59.146 INFO:tasks.workunit.client.0.smithi097.stderr: -150> 2024-09-14T11:03:58.855+0000 7efc2844c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:03:59.146 INFO:tasks.workunit.client.0.smithi097.stderr: -149> 2024-09-14T11:03:58.855+0000 7efc27c4b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:03:59.146 INFO:tasks.workunit.client.0.smithi097.stderr: -148> 2024-09-14T11:03:58.855+0000 7efc27c4b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:03:59.146 INFO:tasks.workunit.client.0.smithi097.stderr: -147> 2024-09-14T11:03:58.855+0000 7efc27c4b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:03:59.146 INFO:tasks.workunit.client.0.smithi097.stderr: -146> 2024-09-14T11:03:58.855+0000 7efc1f44a640 10 monclient(hunting): handle_auth_done global_id 6536 payload 824 2024-09-14T11:03:59.146 INFO:tasks.workunit.client.0.smithi097.stderr: -145> 2024-09-14T11:03:58.855+0000 7efc1f44a640 10 monclient: _finish_hunting 0 2024-09-14T11:03:59.146 INFO:tasks.workunit.client.0.smithi097.stderr: -144> 2024-09-14T11:03:58.855+0000 7efc1f44a640 1 monclient: found mon.noname-c 2024-09-14T11:03:59.146 INFO:tasks.workunit.client.0.smithi097.stderr: -143> 2024-09-14T11:03:58.855+0000 7efc1f44a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:03:59.146 INFO:tasks.workunit.client.0.smithi097.stderr: -142> 2024-09-14T11:03:58.855+0000 7efb057fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:03:59.146 INFO:tasks.workunit.client.0.smithi097.stderr: -141> 2024-09-14T11:03:58.855+0000 7efb057fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:03:59.146 INFO:tasks.workunit.client.0.smithi097.stderr: -140> 2024-09-14T11:03:58.855+0000 7efb057fa640 10 monclient: dump: 2024-09-14T11:03:59.146 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:03:59.147 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:03:59.147 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:59.147 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:59.147 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:03:59.147 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:03:59.147 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:03:59.147 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:03:59.147 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:03:59.147 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:59.147 INFO:tasks.workunit.client.0.smithi097.stderr: -139> 2024-09-14T11:03:58.855+0000 7efb057fa640 10 monclient: _finish_auth 0 2024-09-14T11:03:59.147 INFO:tasks.workunit.client.0.smithi097.stderr: -138> 2024-09-14T11:03:58.855+0000 7efb057fa640 10 monclient: _check_auth_tickets 2024-09-14T11:03:59.147 INFO:tasks.workunit.client.0.smithi097.stderr: -137> 2024-09-14T11:03:58.855+0000 7efb057fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:03:59.147 INFO:tasks.workunit.client.0.smithi097.stderr: -136> 2024-09-14T11:03:58.855+0000 7efb057fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:03:59.147 INFO:tasks.workunit.client.0.smithi097.stderr: -135> 2024-09-14T11:03:58.855+0000 7efb057fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:03:59.148 INFO:tasks.workunit.client.0.smithi097.stderr: -134> 2024-09-14T11:03:58.855+0000 7efb057fa640 10 monclient: dump: 2024-09-14T11:03:59.148 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:03:59.148 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:03:59.148 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:59.148 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:59.148 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:03:59.148 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:03:59.148 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:03:59.148 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:03:59.148 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:03:59.148 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:59.148 INFO:tasks.workunit.client.0.smithi097.stderr: -133> 2024-09-14T11:03:58.855+0000 7efc2bf28800 5 monclient: authenticate success, global_id 6536 2024-09-14T11:03:59.149 INFO:tasks.workunit.client.0.smithi097.stderr: -132> 2024-09-14T11:03:58.855+0000 7efc2bf28800 10 monclient: _renew_subs 2024-09-14T11:03:59.149 INFO:tasks.workunit.client.0.smithi097.stderr: -131> 2024-09-14T11:03:58.855+0000 7efb06ffd640 4 set_mon_vals no callback set 2024-09-14T11:03:59.149 INFO:tasks.workunit.client.0.smithi097.stderr: -130> 2024-09-14T11:03:58.855+0000 7efc2bf28800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:03:59.149 INFO:tasks.workunit.client.0.smithi097.stderr: -129> 2024-09-14T11:03:58.856+0000 7efc2bf28800 10 monclient: _renew_subs 2024-09-14T11:03:59.149 INFO:tasks.workunit.client.0.smithi097.stderr: -128> 2024-09-14T11:03:58.856+0000 7efc2bf28800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:03:59.149 INFO:tasks.workunit.client.0.smithi097.stderr: -127> 2024-09-14T11:03:58.856+0000 7efc2bf28800 1 librados: init done 2024-09-14T11:03:59.149 INFO:tasks.workunit.client.0.smithi097.stderr: -126> 2024-09-14T11:03:58.856+0000 7efc2bf28800 5 asok(0x5603c8c77270) register_command cr dump hook 0x5603c8f69838 2024-09-14T11:03:59.149 INFO:tasks.workunit.client.0.smithi097.stderr: -125> 2024-09-14T11:03:58.857+0000 7efc2bf28800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.149 INFO:tasks.workunit.client.0.smithi097.stderr: -124> 2024-09-14T11:03:58.857+0000 7efb057fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:03:59.149 INFO:tasks.workunit.client.0.smithi097.stderr: -123> 2024-09-14T11:03:58.857+0000 7efb057fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:03:59.149 INFO:tasks.workunit.client.0.smithi097.stderr: -122> 2024-09-14T11:03:58.857+0000 7efb057fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:03:59.149 INFO:tasks.workunit.client.0.smithi097.stderr: -121> 2024-09-14T11:03:58.858+0000 7efc2844c640 10 monclient: get_auth_request con 0x7efaf0077230 auth_method 0 2024-09-14T11:03:59.149 INFO:tasks.workunit.client.0.smithi097.stderr: -120> 2024-09-14T11:03:58.858+0000 7efc27c4b640 10 monclient: get_auth_request con 0x5603c8f83510 auth_method 0 2024-09-14T11:03:59.149 INFO:tasks.workunit.client.0.smithi097.stderr: -119> 2024-09-14T11:03:58.858+0000 7efc2bf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:59.150 INFO:tasks.workunit.client.0.smithi097.stderr: -118> 2024-09-14T11:03:58.858+0000 7efc2bf28800 20 realm 2024-09-14T11:03:59.150 INFO:tasks.workunit.client.0.smithi097.stderr: -117> 2024-09-14T11:03:58.858+0000 7efc2bf28800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.150 INFO:tasks.workunit.client.0.smithi097.stderr: -116> 2024-09-14T11:03:58.859+0000 7efc2bf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:59.150 INFO:tasks.workunit.client.0.smithi097.stderr: -115> 2024-09-14T11:03:58.859+0000 7efc2bf28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:03:59.150 INFO:tasks.workunit.client.0.smithi097.stderr: -114> 2024-09-14T11:03:58.859+0000 7efc2bf28800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.150 INFO:tasks.workunit.client.0.smithi097.stderr: -113> 2024-09-14T11:03:58.859+0000 7efc2bf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:59.150 INFO:tasks.workunit.client.0.smithi097.stderr: -112> 2024-09-14T11:03:58.859+0000 7efc2bf28800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.150 INFO:tasks.workunit.client.0.smithi097.stderr: -111> 2024-09-14T11:03:58.859+0000 7efc1f44a640 10 monclient: get_auth_request con 0x5603c8f87750 auth_method 0 2024-09-14T11:03:59.150 INFO:tasks.workunit.client.0.smithi097.stderr: -110> 2024-09-14T11:03:58.859+0000 7efc2bf28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:59.150 INFO:tasks.workunit.client.0.smithi097.stderr: -109> 2024-09-14T11:03:58.860+0000 7efc2bf28800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.150 INFO:tasks.workunit.client.0.smithi097.stderr: -108> 2024-09-14T11:03:58.860+0000 7efc2844c640 10 monclient: get_auth_request con 0x5603c8f8afb0 auth_method 0 2024-09-14T11:03:59.150 INFO:tasks.workunit.client.0.smithi097.stderr: -107> 2024-09-14T11:03:58.860+0000 7efc2bf28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:03:59.150 INFO:tasks.workunit.client.0.smithi097.stderr: -106> 2024-09-14T11:03:58.860+0000 7efc2bf28800 20 searching for the correct realm 2024-09-14T11:03:59.151 INFO:tasks.workunit.client.0.smithi097.stderr: -105> 2024-09-14T11:03:58.861+0000 7efc27c4b640 10 monclient: get_auth_request con 0x5603c8f8fd80 auth_method 0 2024-09-14T11:03:59.151 INFO:tasks.workunit.client.0.smithi097.stderr: -104> 2024-09-14T11:03:58.861+0000 7efc27c4b640 0 -- 172.21.15.97:0/2385311258 >> [v2:172.21.15.152:6808/1010851305,v1:172.21.15.152:6809/1010851305] conn(0x5603c8f8fd80 msgr2=0x5603c8f92240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:03:59.151 INFO:tasks.workunit.client.0.smithi097.stderr: -103> 2024-09-14T11:03:59.062+0000 7efc27c4b640 10 monclient: get_auth_request con 0x5603c8f8fd80 auth_method 0 2024-09-14T11:03:59.151 INFO:tasks.workunit.client.0.smithi097.stderr: -102> 2024-09-14T11:03:59.062+0000 7efc1f44a640 10 monclient: get_auth_request con 0x7efc180b00d0 auth_method 0 2024-09-14T11:03:59.151 INFO:tasks.workunit.client.0.smithi097.stderr: -101> 2024-09-14T11:03:59.063+0000 7efc2844c640 10 monclient: get_auth_request con 0x7efc1009a040 auth_method 0 2024-09-14T11:03:59.151 INFO:tasks.workunit.client.0.smithi097.stderr: -100> 2024-09-14T11:03:59.065+0000 7efc27c4b640 0 -- 172.21.15.97:0/2385311258 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x5603c8f83510 msgr2=0x5603c8f859a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:03:59.151 INFO:tasks.workunit.client.0.smithi097.stderr: -99> 2024-09-14T11:03:59.065+0000 7efb057fa640 1 client.6536.objecter ms_handle_reset 0x5603c8f83510 session 0x5603c8f82e00 osd.6 2024-09-14T11:03:59.151 INFO:tasks.workunit.client.0.smithi097.stderr: -98> 2024-09-14T11:03:59.065+0000 7efb057fa640 10 monclient: _renew_subs 2024-09-14T11:03:59.151 INFO:tasks.workunit.client.0.smithi097.stderr: -97> 2024-09-14T11:03:59.065+0000 7efb057fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:03:59.151 INFO:tasks.workunit.client.0.smithi097.stderr: -96> 2024-09-14T11:03:59.066+0000 7efc27c4b640 10 monclient: get_auth_request con 0x7efaf0086cd0 auth_method 0 2024-09-14T11:03:59.151 INFO:tasks.workunit.client.0.smithi097.stderr: -95> 2024-09-14T11:03:59.067+0000 7efc27c4b640 10 monclient: get_auth_request con 0x7efc10061fa0 auth_method 0 2024-09-14T11:03:59.151 INFO:tasks.workunit.client.0.smithi097.stderr: -94> 2024-09-14T11:03:59.067+0000 7efc1f44a640 10 monclient: get_auth_request con 0x7efc18079b90 auth_method 0 2024-09-14T11:03:59.151 INFO:tasks.workunit.client.0.smithi097.stderr: -93> 2024-09-14T11:03:59.072+0000 7efc2bf28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:03:59.151 INFO:tasks.workunit.client.0.smithi097.stderr: -92> 2024-09-14T11:03:59.072+0000 7efc2bf28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:03:59.152 INFO:tasks.workunit.client.0.smithi097.stderr: -91> 2024-09-14T11:03:59.072+0000 7efc2bf28800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:03:59.152 INFO:tasks.workunit.client.0.smithi097.stderr: -90> 2024-09-14T11:03:59.072+0000 7efc2bf28800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:03:59.152 INFO:tasks.workunit.client.0.smithi097.stderr: -89> 2024-09-14T11:03:59.072+0000 7efc2bf28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:03:59.152 INFO:tasks.workunit.client.0.smithi097.stderr: -88> 2024-09-14T11:03:59.072+0000 7efc2bf28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:03:59.152 INFO:tasks.workunit.client.0.smithi097.stderr: -87> 2024-09-14T11:03:59.072+0000 7efc2bf28800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.152 INFO:tasks.workunit.client.0.smithi097.stderr: -86> 2024-09-14T11:03:59.072+0000 7efc2bf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:59.152 INFO:tasks.workunit.client.0.smithi097.stderr: -85> 2024-09-14T11:03:59.072+0000 7efc2bf28800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.152 INFO:tasks.workunit.client.0.smithi097.stderr: -84> 2024-09-14T11:03:59.072+0000 7efc2bf28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:59.152 INFO:tasks.workunit.client.0.smithi097.stderr: -83> 2024-09-14T11:03:59.072+0000 7efc2bf28800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.152 INFO:tasks.workunit.client.0.smithi097.stderr: -82> 2024-09-14T11:03:59.073+0000 7efc2bf28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:03:59.152 INFO:tasks.workunit.client.0.smithi097.stderr: -81> 2024-09-14T11:03:59.073+0000 7efc2bf28800 20 zone default found 2024-09-14T11:03:59.152 INFO:tasks.workunit.client.0.smithi097.stderr: -80> 2024-09-14T11:03:59.073+0000 7efc2bf28800 4 Realm: () 2024-09-14T11:03:59.152 INFO:tasks.workunit.client.0.smithi097.stderr: -79> 2024-09-14T11:03:59.073+0000 7efc2bf28800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:03:59.152 INFO:tasks.workunit.client.0.smithi097.stderr: -78> 2024-09-14T11:03:59.073+0000 7efc2bf28800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:03:59.153 INFO:tasks.workunit.client.0.smithi097.stderr: -77> 2024-09-14T11:03:59.073+0000 7efc2bf28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:03:59.153 INFO:tasks.workunit.client.0.smithi097.stderr: -76> 2024-09-14T11:03:59.073+0000 7efc2bf28800 20 zonegroup default 2024-09-14T11:03:59.153 INFO:tasks.workunit.client.0.smithi097.stderr: -75> 2024-09-14T11:03:59.073+0000 7efc2bf28800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.153 INFO:tasks.workunit.client.0.smithi097.stderr: -74> 2024-09-14T11:03:59.073+0000 7efc2bf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:59.153 INFO:tasks.workunit.client.0.smithi097.stderr: -73> 2024-09-14T11:03:59.073+0000 7efc2bf28800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.153 INFO:tasks.workunit.client.0.smithi097.stderr: -72> 2024-09-14T11:03:59.073+0000 7efc2bf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:59.153 INFO:tasks.workunit.client.0.smithi097.stderr: -71> 2024-09-14T11:03:59.073+0000 7efc2bf28800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.153 INFO:tasks.workunit.client.0.smithi097.stderr: -70> 2024-09-14T11:03:59.073+0000 7efc2bf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:59.153 INFO:tasks.workunit.client.0.smithi097.stderr: -69> 2024-09-14T11:03:59.073+0000 7efc2bf28800 20 started sync module instance, tier type = 2024-09-14T11:03:59.153 INFO:tasks.workunit.client.0.smithi097.stderr: -68> 2024-09-14T11:03:59.073+0000 7efc2bf28800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:03:59.153 INFO:tasks.workunit.client.0.smithi097.stderr: -67> 2024-09-14T11:03:59.082+0000 7efc2bf28800 20 add_watcher() i=0 2024-09-14T11:03:59.153 INFO:tasks.workunit.client.0.smithi097.stderr: -66> 2024-09-14T11:03:59.082+0000 7efc2bf28800 20 add_watcher() i=1 2024-09-14T11:03:59.153 INFO:tasks.workunit.client.0.smithi097.stderr: -65> 2024-09-14T11:03:59.082+0000 7efc2bf28800 20 add_watcher() i=2 2024-09-14T11:03:59.154 INFO:tasks.workunit.client.0.smithi097.stderr: -64> 2024-09-14T11:03:59.082+0000 7efc2bf28800 20 add_watcher() i=3 2024-09-14T11:03:59.154 INFO:tasks.workunit.client.0.smithi097.stderr: -63> 2024-09-14T11:03:59.082+0000 7efc2bf28800 20 add_watcher() i=4 2024-09-14T11:03:59.154 INFO:tasks.workunit.client.0.smithi097.stderr: -62> 2024-09-14T11:03:59.082+0000 7efc2bf28800 20 add_watcher() i=5 2024-09-14T11:03:59.154 INFO:tasks.workunit.client.0.smithi097.stderr: -61> 2024-09-14T11:03:59.083+0000 7efc2bf28800 20 add_watcher() i=6 2024-09-14T11:03:59.154 INFO:tasks.workunit.client.0.smithi097.stderr: -60> 2024-09-14T11:03:59.084+0000 7efc2bf28800 20 add_watcher() i=7 2024-09-14T11:03:59.154 INFO:tasks.workunit.client.0.smithi097.stderr: -59> 2024-09-14T11:03:59.084+0000 7efc2bf28800 2 all 8 watchers are set, enabling cache 2024-09-14T11:03:59.154 INFO:tasks.workunit.client.0.smithi097.stderr: -58> 2024-09-14T11:03:59.086+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273608b0) adding auth protocol: cephx 2024-09-14T11:03:59.154 INFO:tasks.workunit.client.0.smithi097.stderr: -57> 2024-09-14T11:03:59.086+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273608b0) adding auth protocol: cephx 2024-09-14T11:03:59.154 INFO:tasks.workunit.client.0.smithi097.stderr: -56> 2024-09-14T11:03:59.086+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273608b0) adding auth protocol: cephx 2024-09-14T11:03:59.154 INFO:tasks.workunit.client.0.smithi097.stderr: -55> 2024-09-14T11:03:59.086+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273608b0) adding con mode: secure 2024-09-14T11:03:59.154 INFO:tasks.workunit.client.0.smithi097.stderr: -54> 2024-09-14T11:03:59.086+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273608b0) adding con mode: crc 2024-09-14T11:03:59.154 INFO:tasks.workunit.client.0.smithi097.stderr: -53> 2024-09-14T11:03:59.086+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273608b0) adding con mode: secure 2024-09-14T11:03:59.154 INFO:tasks.workunit.client.0.smithi097.stderr: -52> 2024-09-14T11:03:59.086+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273608b0) adding con mode: crc 2024-09-14T11:03:59.154 INFO:tasks.workunit.client.0.smithi097.stderr: -51> 2024-09-14T11:03:59.086+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273608b0) adding con mode: secure 2024-09-14T11:03:59.155 INFO:tasks.workunit.client.0.smithi097.stderr: -50> 2024-09-14T11:03:59.086+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273608b0) adding con mode: crc 2024-09-14T11:03:59.155 INFO:tasks.workunit.client.0.smithi097.stderr: -49> 2024-09-14T11:03:59.086+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273608b0) adding con mode: crc 2024-09-14T11:03:59.155 INFO:tasks.workunit.client.0.smithi097.stderr: -48> 2024-09-14T11:03:59.086+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273608b0) adding con mode: secure 2024-09-14T11:03:59.155 INFO:tasks.workunit.client.0.smithi097.stderr: -47> 2024-09-14T11:03:59.086+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273608b0) adding con mode: crc 2024-09-14T11:03:59.155 INFO:tasks.workunit.client.0.smithi097.stderr: -46> 2024-09-14T11:03:59.086+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273608b0) adding con mode: secure 2024-09-14T11:03:59.155 INFO:tasks.workunit.client.0.smithi097.stderr: -45> 2024-09-14T11:03:59.086+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273608b0) adding con mode: crc 2024-09-14T11:03:59.155 INFO:tasks.workunit.client.0.smithi097.stderr: -44> 2024-09-14T11:03:59.086+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273608b0) adding con mode: secure 2024-09-14T11:03:59.155 INFO:tasks.workunit.client.0.smithi097.stderr: -43> 2024-09-14T11:03:59.086+0000 7efaddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:59.155 INFO:tasks.workunit.client.0.smithi097.stderr: -42> 2024-09-14T11:03:59.086+0000 7efc2bf28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:59.155 INFO:tasks.workunit.client.0.smithi097.stderr: -41> 2024-09-14T11:03:59.086+0000 7efc2bf28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:03:59.155 INFO:tasks.workunit.client.0.smithi097.stderr: -40> 2024-09-14T11:03:59.086+0000 7efc2bf28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:03:59.155 INFO:tasks.workunit.client.0.smithi097.stderr: -39> 2024-09-14T11:03:59.086+0000 7efc2bf28800 5 asok(0x5603c8c77270) register_command cache list hook 0x5603c8f5e230 2024-09-14T11:03:59.155 INFO:tasks.workunit.client.0.smithi097.stderr: -38> 2024-09-14T11:03:59.086+0000 7efc2bf28800 5 asok(0x5603c8c77270) register_command cache inspect hook 0x5603c8f5e230 2024-09-14T11:03:59.155 INFO:tasks.workunit.client.0.smithi097.stderr: -37> 2024-09-14T11:03:59.086+0000 7efc2bf28800 5 asok(0x5603c8c77270) register_command cache erase hook 0x5603c8f5e230 2024-09-14T11:03:59.156 INFO:tasks.workunit.client.0.smithi097.stderr: -36> 2024-09-14T11:03:59.086+0000 7efc2bf28800 5 asok(0x5603c8c77270) register_command cache zap hook 0x5603c8f5e230 2024-09-14T11:03:59.156 INFO:tasks.workunit.client.0.smithi097.stderr: -35> 2024-09-14T11:03:59.086+0000 7efc2bf28800 5 note: GC not initialized 2024-09-14T11:03:59.156 INFO:tasks.workunit.client.0.smithi097.stderr: -34> 2024-09-14T11:03:59.086+0000 7efadcfe1640 20 reqs_thread_entry: start 2024-09-14T11:03:59.156 INFO:tasks.workunit.client.0.smithi097.stderr: -33> 2024-09-14T11:03:59.086+0000 7efc2bf28800 5 asok(0x5603c8c77270) register_command sync trace show hook 0x7efc1001e070 2024-09-14T11:03:59.156 INFO:tasks.workunit.client.0.smithi097.stderr: -32> 2024-09-14T11:03:59.086+0000 7efc2bf28800 5 asok(0x5603c8c77270) register_command sync trace history hook 0x7efc1001e070 2024-09-14T11:03:59.156 INFO:tasks.workunit.client.0.smithi097.stderr: -31> 2024-09-14T11:03:59.086+0000 7efc2bf28800 5 asok(0x5603c8c77270) register_command sync trace active hook 0x7efc1001e070 2024-09-14T11:03:59.156 INFO:tasks.workunit.client.0.smithi097.stderr: -30> 2024-09-14T11:03:59.086+0000 7efc2bf28800 5 asok(0x5603c8c77270) register_command sync trace active_short hook 0x7efc1001e070 2024-09-14T11:03:59.156 INFO:tasks.workunit.client.0.smithi097.stderr: -29> 2024-09-14T11:03:59.086+0000 7efc2bf28800 20 init_complete bucket index max shards: 11 2024-09-14T11:03:59.156 INFO:tasks.workunit.client.0.smithi097.stderr: -28> 2024-09-14T11:03:59.086+0000 7efc2bf28800 20 Filter name: none 2024-09-14T11:03:59.156 INFO:tasks.workunit.client.0.smithi097.stderr: -27> 2024-09-14T11:03:59.087+0000 7efa567fc640 20 reqs_thread_entry: start 2024-09-14T11:03:59.156 INFO:tasks.workunit.client.0.smithi097.stderr: -26> 2024-09-14T11:03:59.087+0000 7efc2bf28800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:03:59.156 INFO:tasks.workunit.client.0.smithi097.stderr: -25> 2024-09-14T11:03:59.087+0000 7efc2bf28800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.156 INFO:tasks.workunit.client.0.smithi097.stderr: -24> 2024-09-14T11:03:59.087+0000 7efc2bf28800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:03:59.156 INFO:tasks.workunit.client.0.smithi097.stderr: -23> 2024-09-14T11:03:59.087+0000 7efc2bf28800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:03:59.157 INFO:tasks.workunit.client.0.smithi097.stderr: -22> 2024-09-14T11:03:59.087+0000 7efc2bf28800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:03:59.157 INFO:tasks.workunit.client.0.smithi097.stderr: -21> 2024-09-14T11:03:59.087+0000 7efc2bf28800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 : miss 2024-09-14T11:03:59.157 INFO:tasks.workunit.client.0.smithi097.stderr: -20> 2024-09-14T11:03:59.087+0000 7efc2bf28800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.157 INFO:tasks.workunit.client.0.smithi097.stderr: -19> 2024-09-14T11:03:59.087+0000 7efc2bf28800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:03:59.157 INFO:tasks.workunit.client.0.smithi097.stderr: -18> 2024-09-14T11:03:59.087+0000 7efc2bf28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 info.flags=0x17 2024-09-14T11:03:59.157 INFO:tasks.workunit.client.0.smithi097.stderr: -17> 2024-09-14T11:03:59.087+0000 7efc2bf28800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 to cache LRU end 2024-09-14T11:03:59.157 INFO:tasks.workunit.client.0.smithi097.stderr: -16> 2024-09-14T11:03:59.087+0000 7efc2bf28800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:03:59.157 INFO:tasks.workunit.client.0.smithi097.stderr: -15> 2024-09-14T11:03:59.087+0000 7efc2bf28800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:59.157 INFO:tasks.workunit.client.0.smithi097.stderr: -14> 2024-09-14T11:03:59.087+0000 7efc2bf28800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 2024-09-14T11:03:59.157 INFO:tasks.workunit.client.0.smithi097.stderr: -13> 2024-09-14T11:03:59.092+0000 7efc2bf28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 info.flags=0x17 2024-09-14T11:03:59.157 INFO:tasks.workunit.client.0.smithi097.stderr: -12> 2024-09-14T11:03:59.092+0000 7efc2bf28800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 to cache LRU end 2024-09-14T11:03:59.157 INFO:tasks.workunit.client.0.smithi097.stderr: -11> 2024-09-14T11:03:59.092+0000 7efc2bf28800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:59.157 INFO:tasks.workunit.client.0.smithi097.stderr: -10> 2024-09-14T11:03:59.092+0000 7efc2bf28800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27, ofs0, ns] 2024-09-14T11:03:59.158 INFO:tasks.workunit.client.0.smithi097.stderr: -9> 2024-09-14T11:03:59.092+0000 7efb067fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595185 cookie 94574256664736 notifier 6536 bl.length()=939 2024-09-14T11:03:59.158 INFO:tasks.workunit.client.0.smithi097.stderr: -8> 2024-09-14T11:03:59.092+0000 7efb067fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 info.flags=0x17 2024-09-14T11:03:59.158 INFO:tasks.workunit.client.0.smithi097.stderr: -7> 2024-09-14T11:03:59.092+0000 7efb067fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 to cache LRU end 2024-09-14T11:03:59.158 INFO:tasks.workunit.client.0.smithi097.stderr: -6> 2024-09-14T11:03:59.092+0000 7efb067fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:59.158 INFO:tasks.workunit.client.0.smithi097.stderr: -5> 2024-09-14T11:03:59.093+0000 7efc2bf28800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27]): orig_sources= new_sources= 2024-09-14T11:03:59.158 INFO:tasks.workunit.client.0.smithi097.stderr: -4> 2024-09-14T11:03:59.093+0000 7efc2bf28800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27]): potential sources added=[] removed=[] 2024-09-14T11:03:59.158 INFO:tasks.workunit.client.0.smithi097.stderr: -3> 2024-09-14T11:03:59.093+0000 7efc2bf28800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27]): orig_dests= new_dests= 2024-09-14T11:03:59.158 INFO:tasks.workunit.client.0.smithi097.stderr: -2> 2024-09-14T11:03:59.093+0000 7efc2bf28800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27]): potential dests added=[] removed=[] 2024-09-14T11:03:59.158 INFO:tasks.workunit.client.0.smithi097.stderr: -1> 2024-09-14T11:03:59.094+0000 7efc2bf28800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7efc2bf28800 time 2024-09-14T11:03:59.094211+0000 2024-09-14T11:03:59.158 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:03:59.158 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:59.158 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:03:59.158 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7efc2d78c76a] 2024-09-14T11:03:59.158 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7efc2d78c928] 2024-09-14T11:03:59.159 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5603c79240b1] 2024-09-14T11:03:59.159 INFO:tasks.workunit.client.0.smithi097.stderr: 4: radosgw-admin(+0xd8900e) [0x5603c7e3800e] 2024-09-14T11:03:59.159 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5603c7933efd] 2024-09-14T11:03:59.159 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-14T11:03:59.159 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7efc2c429590] 2024-09-14T11:03:59.159 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-14T11:03:59.159 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-14T11:03:59.159 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:59.159 INFO:tasks.workunit.client.0.smithi097.stderr: 0> 2024-09-14T11:03:59.094+0000 7efc2bf28800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:03:59.159 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7efc2bf28800 thread_name:radosgw-admin 2024-09-14T11:03:59.159 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:59.159 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:03:59.159 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7efc2c43e6f0] 2024-09-14T11:03:59.160 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7efc2c48b99c] 2024-09-14T11:03:59.160 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-14T11:03:59.160 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-14T11:03:59.160 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7efc2d78c7c4] 2024-09-14T11:03:59.160 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7efc2d78c928] 2024-09-14T11:03:59.160 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5603c79240b1] 2024-09-14T11:03:59.160 INFO:tasks.workunit.client.0.smithi097.stderr: 8: radosgw-admin(+0xd8900e) [0x5603c7e3800e] 2024-09-14T11:03:59.160 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5603c7933efd] 2024-09-14T11:03:59.160 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-14T11:03:59.160 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7efc2c429590] 2024-09-14T11:03:59.160 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-14T11:03:59.160 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-14T11:03:59.160 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:03:59.160 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:59.161 INFO:tasks.workunit.client.0.smithi097.stderr:--- logging levels --- 2024-09-14T11:03:59.161 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 none 2024-09-14T11:03:59.161 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 lockdep 2024-09-14T11:03:59.161 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 context 2024-09-14T11:03:59.161 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 crush 2024-09-14T11:03:59.161 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds 2024-09-14T11:03:59.161 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_balancer 2024-09-14T11:03:59.161 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_locker 2024-09-14T11:03:59.161 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log 2024-09-14T11:03:59.161 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log_expire 2024-09-14T11:03:59.161 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_migrator 2024-09-14T11:03:59.161 INFO:tasks.workunit.client.0.smithi097.stderr: 3/ 5 mds_quiesce 2024-09-14T11:03:59.161 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 buffer 2024-09-14T11:03:59.161 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 timer 2024-09-14T11:03:59.162 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 filer 2024-09-14T11:03:59.162 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 striper 2024-09-14T11:03:59.162 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 objecter 2024-09-14T11:03:59.162 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rados 2024-09-14T11:03:59.162 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd 2024-09-14T11:03:59.162 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_mirror 2024-09-14T11:03:59.162 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_replay 2024-09-14T11:03:59.162 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_pwl 2024-09-14T11:03:59.162 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 journaler 2024-09-14T11:03:59.162 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objectcacher 2024-09-14T11:03:59.162 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:03:59.162 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 client 2024-09-14T11:03:59.162 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 osd 2024-09-14T11:03:59.162 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 optracker 2024-09-14T11:03:59.163 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objclass 2024-09-14T11:03:59.163 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 filestore 2024-09-14T11:03:59.163 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 journal 2024-09-14T11:03:59.163 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 ms 2024-09-14T11:03:59.163 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mon 2024-09-14T11:03:59.163 INFO:tasks.workunit.client.0.smithi097.stderr: 0/10 monc 2024-09-14T11:03:59.163 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 paxos 2024-09-14T11:03:59.163 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 tp 2024-09-14T11:03:59.163 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 auth 2024-09-14T11:03:59.163 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 crypto 2024-09-14T11:03:59.163 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 finisher 2024-09-14T11:03:59.163 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 reserver 2024-09-14T11:03:59.163 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 heartbeatmap 2024-09-14T11:03:59.163 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 perfcounter 2024-09-14T11:03:59.164 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw 2024-09-14T11:03:59.164 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_sync 2024-09-14T11:03:59.164 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_datacache 2024-09-14T11:03:59.164 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_access 2024-09-14T11:03:59.164 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:03:59.164 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_flight 2024-09-14T11:03:59.164 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:03:59.164 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw_notification 2024-09-14T11:03:59.164 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 javaclient 2024-09-14T11:03:59.164 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 asok 2024-09-14T11:03:59.164 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 throttle 2024-09-14T11:03:59.164 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 refs 2024-09-14T11:03:59.164 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 compressor 2024-09-14T11:03:59.164 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluestore 2024-09-14T11:03:59.165 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluefs 2024-09-14T11:03:59.165 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 bdev 2024-09-14T11:03:59.165 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 kstore 2024-09-14T11:03:59.165 INFO:tasks.workunit.client.0.smithi097.stderr: 4/ 5 rocksdb 2024-09-14T11:03:59.165 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 fuse 2024-09-14T11:03:59.165 INFO:tasks.workunit.client.0.smithi097.stderr: 2/ 5 mgr 2024-09-14T11:03:59.165 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mgrc 2024-09-14T11:03:59.165 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 dpdk 2024-09-14T11:03:59.165 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 eventtrace 2024-09-14T11:03:59.165 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 prioritycache 2024-09-14T11:03:59.165 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 test 2024-09-14T11:03:59.165 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:03:59.165 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephsqlite 2024-09-14T11:03:59.165 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:03:59.166 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore 2024-09-14T11:03:59.166 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_onode 2024-09-14T11:03:59.166 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_odata 2024-09-14T11:03:59.166 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_omap 2024-09-14T11:03:59.166 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_tm 2024-09-14T11:03:59.166 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_t 2024-09-14T11:03:59.166 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:03:59.166 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_epm 2024-09-14T11:03:59.166 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_lba 2024-09-14T11:03:59.166 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:03:59.166 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cache 2024-09-14T11:03:59.166 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_journal 2024-09-14T11:03:59.166 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_device 2024-09-14T11:03:59.166 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_backref 2024-09-14T11:03:59.166 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 alienstore 2024-09-14T11:03:59.167 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mclock 2024-09-14T11:03:59.167 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cyanstore 2024-09-14T11:03:59.167 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 ceph_exporter 2024-09-14T11:03:59.167 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 memstore 2024-09-14T11:03:59.167 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 trace 2024-09-14T11:03:59.167 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 ceph_dedup 2024-09-14T11:03:59.167 INFO:tasks.workunit.client.0.smithi097.stderr: -2/-2 (syslog threshold) 2024-09-14T11:03:59.167 INFO:tasks.workunit.client.0.smithi097.stderr: 99/99 (stderr threshold) 2024-09-14T11:03:59.167 INFO:tasks.workunit.client.0.smithi097.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:03:59.167 INFO:tasks.workunit.client.0.smithi097.stderr: 7efa567fc640 / http_manager 2024-09-14T11:03:59.167 INFO:tasks.workunit.client.0.smithi097.stderr: 7efadcfe1640 / http_manager 2024-09-14T11:03:59.167 INFO:tasks.workunit.client.0.smithi097.stderr: 7efaddfe3640 / rgw_dt_lg_renew 2024-09-14T11:03:59.167 INFO:tasks.workunit.client.0.smithi097.stderr: 7efb057fa640 / ms_dispatch 2024-09-14T11:03:59.167 INFO:tasks.workunit.client.0.smithi097.stderr: 7efb067fc640 / io_context_pool 2024-09-14T11:03:59.168 INFO:tasks.workunit.client.0.smithi097.stderr: 7efb06ffd640 / io_context_pool 2024-09-14T11:03:59.168 INFO:tasks.workunit.client.0.smithi097.stderr: 7efb0d7fa640 / ms_dispatch 2024-09-14T11:03:59.168 INFO:tasks.workunit.client.0.smithi097.stderr: 7efb0ffff640 / ms_dispatch 2024-09-14T11:03:59.168 INFO:tasks.workunit.client.0.smithi097.stderr: 7efb15e0b640 / io_context_pool 2024-09-14T11:03:59.168 INFO:tasks.workunit.client.0.smithi097.stderr: 7efc1f44a640 / msgr-worker-2 2024-09-14T11:03:59.168 INFO:tasks.workunit.client.0.smithi097.stderr: 7efc27c4b640 / msgr-worker-1 2024-09-14T11:03:59.168 INFO:tasks.workunit.client.0.smithi097.stderr: 7efc2844c640 / msgr-worker-0 2024-09-14T11:03:59.168 INFO:tasks.workunit.client.0.smithi097.stderr: 7efc28c4d640 / io_context_pool 2024-09-14T11:03:59.168 INFO:tasks.workunit.client.0.smithi097.stderr: 7efc2bf28800 / radosgw-admin 2024-09-14T11:03:59.168 INFO:tasks.workunit.client.0.smithi097.stderr: max_recent 500 2024-09-14T11:03:59.168 INFO:tasks.workunit.client.0.smithi097.stderr: max_new 1000 2024-09-14T11:03:59.168 INFO:tasks.workunit.client.0.smithi097.stderr: log_file /var/log/ceph/ceph-client.admin.107439.log 2024-09-14T11:03:59.168 INFO:tasks.workunit.client.0.smithi097.stderr:--- end dump of recent events --- 2024-09-14T11:03:59.168 INFO:tasks.workunit.client.0.smithi097.stderr:--- begin dump of recent events --- 2024-09-14T11:03:59.169 INFO:tasks.workunit.client.0.smithi097.stderr: -499> 2024-09-14T11:03:58.840+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e9ad40) adding auth protocol: cephx 2024-09-14T11:03:59.169 INFO:tasks.workunit.client.0.smithi097.stderr: -498> 2024-09-14T11:03:58.840+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e9ad40) adding auth protocol: cephx 2024-09-14T11:03:59.169 INFO:tasks.workunit.client.0.smithi097.stderr: -497> 2024-09-14T11:03:58.840+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e9ad40) adding auth protocol: cephx 2024-09-14T11:03:59.169 INFO:tasks.workunit.client.0.smithi097.stderr: -496> 2024-09-14T11:03:58.840+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e9ad40) adding con mode: secure 2024-09-14T11:03:59.169 INFO:tasks.workunit.client.0.smithi097.stderr: -495> 2024-09-14T11:03:58.840+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e9ad40) adding con mode: crc 2024-09-14T11:03:59.169 INFO:tasks.workunit.client.0.smithi097.stderr: -494> 2024-09-14T11:03:58.840+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e9ad40) adding con mode: secure 2024-09-14T11:03:59.169 INFO:tasks.workunit.client.0.smithi097.stderr: -493> 2024-09-14T11:03:58.840+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e9ad40) adding con mode: crc 2024-09-14T11:03:59.169 INFO:tasks.workunit.client.0.smithi097.stderr: -492> 2024-09-14T11:03:58.840+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e9ad40) adding con mode: secure 2024-09-14T11:03:59.169 INFO:tasks.workunit.client.0.smithi097.stderr: -491> 2024-09-14T11:03:58.840+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e9ad40) adding con mode: crc 2024-09-14T11:03:59.169 INFO:tasks.workunit.client.0.smithi097.stderr: -490> 2024-09-14T11:03:58.840+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e9ad40) adding con mode: crc 2024-09-14T11:03:59.169 INFO:tasks.workunit.client.0.smithi097.stderr: -489> 2024-09-14T11:03:58.840+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e9ad40) adding con mode: secure 2024-09-14T11:03:59.169 INFO:tasks.workunit.client.0.smithi097.stderr: -488> 2024-09-14T11:03:58.840+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e9ad40) adding con mode: crc 2024-09-14T11:03:59.169 INFO:tasks.workunit.client.0.smithi097.stderr: -487> 2024-09-14T11:03:58.840+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e9ad40) adding con mode: secure 2024-09-14T11:03:59.169 INFO:tasks.workunit.client.0.smithi097.stderr: -486> 2024-09-14T11:03:58.840+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e9ad40) adding con mode: crc 2024-09-14T11:03:59.170 INFO:tasks.workunit.client.0.smithi097.stderr: -485> 2024-09-14T11:03:58.840+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e9ad40) adding con mode: secure 2024-09-14T11:03:59.170 INFO:tasks.workunit.client.0.smithi097.stderr: -484> 2024-09-14T11:03:58.840+0000 7efc2bf28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:59.170 INFO:tasks.workunit.client.0.smithi097.stderr: -483> 2024-09-14T11:03:58.840+0000 7efc2bf28800 1 librados: starting msgr at 2024-09-14T11:03:59.170 INFO:tasks.workunit.client.0.smithi097.stderr: -482> 2024-09-14T11:03:58.840+0000 7efc2bf28800 1 librados: starting objecter 2024-09-14T11:03:59.170 INFO:tasks.workunit.client.0.smithi097.stderr: -481> 2024-09-14T11:03:58.841+0000 7efc2bf28800 5 asok(0x5603c8c77270) register_command objecter_requests hook 0x5603c8e9ba80 2024-09-14T11:03:59.170 INFO:tasks.workunit.client.0.smithi097.stderr: -480> 2024-09-14T11:03:58.841+0000 7efc2bf28800 1 librados: setting wanted keys 2024-09-14T11:03:59.170 INFO:tasks.workunit.client.0.smithi097.stderr: -479> 2024-09-14T11:03:58.841+0000 7efc2bf28800 1 librados: calling monclient init 2024-09-14T11:03:59.170 INFO:tasks.workunit.client.0.smithi097.stderr: -478> 2024-09-14T11:03:58.841+0000 7efc2bf28800 10 monclient: init 2024-09-14T11:03:59.170 INFO:tasks.workunit.client.0.smithi097.stderr: -477> 2024-09-14T11:03:58.841+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e94ff0) adding auth protocol: cephx 2024-09-14T11:03:59.170 INFO:tasks.workunit.client.0.smithi097.stderr: -476> 2024-09-14T11:03:58.841+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e94ff0) adding auth protocol: cephx 2024-09-14T11:03:59.170 INFO:tasks.workunit.client.0.smithi097.stderr: -475> 2024-09-14T11:03:58.841+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e94ff0) adding auth protocol: cephx 2024-09-14T11:03:59.170 INFO:tasks.workunit.client.0.smithi097.stderr: -474> 2024-09-14T11:03:58.841+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e94ff0) adding con mode: secure 2024-09-14T11:03:59.170 INFO:tasks.workunit.client.0.smithi097.stderr: -473> 2024-09-14T11:03:58.841+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e94ff0) adding con mode: crc 2024-09-14T11:03:59.170 INFO:tasks.workunit.client.0.smithi097.stderr: -472> 2024-09-14T11:03:58.841+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e94ff0) adding con mode: secure 2024-09-14T11:03:59.171 INFO:tasks.workunit.client.0.smithi097.stderr: -471> 2024-09-14T11:03:58.841+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e94ff0) adding con mode: crc 2024-09-14T11:03:59.171 INFO:tasks.workunit.client.0.smithi097.stderr: -470> 2024-09-14T11:03:58.841+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e94ff0) adding con mode: secure 2024-09-14T11:03:59.171 INFO:tasks.workunit.client.0.smithi097.stderr: -469> 2024-09-14T11:03:58.841+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e94ff0) adding con mode: crc 2024-09-14T11:03:59.171 INFO:tasks.workunit.client.0.smithi097.stderr: -468> 2024-09-14T11:03:58.841+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e94ff0) adding con mode: crc 2024-09-14T11:03:59.171 INFO:tasks.workunit.client.0.smithi097.stderr: -467> 2024-09-14T11:03:58.841+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e94ff0) adding con mode: secure 2024-09-14T11:03:59.171 INFO:tasks.workunit.client.0.smithi097.stderr: -466> 2024-09-14T11:03:58.841+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e94ff0) adding con mode: crc 2024-09-14T11:03:59.171 INFO:tasks.workunit.client.0.smithi097.stderr: -465> 2024-09-14T11:03:58.841+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e94ff0) adding con mode: secure 2024-09-14T11:03:59.171 INFO:tasks.workunit.client.0.smithi097.stderr: -464> 2024-09-14T11:03:58.841+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e94ff0) adding con mode: crc 2024-09-14T11:03:59.171 INFO:tasks.workunit.client.0.smithi097.stderr: -463> 2024-09-14T11:03:58.841+0000 7efc2bf28800 5 AuthRegistry(0x5603c8e94ff0) adding con mode: secure 2024-09-14T11:03:59.171 INFO:tasks.workunit.client.0.smithi097.stderr: -462> 2024-09-14T11:03:58.841+0000 7efc2bf28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:59.171 INFO:tasks.workunit.client.0.smithi097.stderr: -461> 2024-09-14T11:03:58.841+0000 7efc2bf28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:59.171 INFO:tasks.workunit.client.0.smithi097.stderr: -460> 2024-09-14T11:03:58.841+0000 7efc2bf28800 5 asok(0x5603c8c77270) register_command rotate-key hook 0x5603c8e95138 2024-09-14T11:03:59.171 INFO:tasks.workunit.client.0.smithi097.stderr: -459> 2024-09-14T11:03:58.841+0000 7efc2bf28800 10 monclient: _reopen_session rank -1 2024-09-14T11:03:59.171 INFO:tasks.workunit.client.0.smithi097.stderr: -458> 2024-09-14T11:03:58.841+0000 7efc2bf28800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:03:59.172 INFO:tasks.workunit.client.0.smithi097.stderr: -457> 2024-09-14T11:03:58.841+0000 7efc2bf28800 10 monclient(hunting): picked mon.noname-b con 0x5603c8e9be40 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:03:59.172 INFO:tasks.workunit.client.0.smithi097.stderr: -456> 2024-09-14T11:03:58.841+0000 7efc2bf28800 10 monclient(hunting): picked mon.noname-c con 0x5603c8ebee00 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:03:59.172 INFO:tasks.workunit.client.0.smithi097.stderr: -455> 2024-09-14T11:03:58.841+0000 7efc2bf28800 10 monclient(hunting): picked mon.noname-a con 0x7efc14002340 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:03:59.172 INFO:tasks.workunit.client.0.smithi097.stderr: -454> 2024-09-14T11:03:58.841+0000 7efc2bf28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:03:59.172 INFO:tasks.workunit.client.0.smithi097.stderr: -453> 2024-09-14T11:03:58.841+0000 7efc2bf28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:03:59.172 INFO:tasks.workunit.client.0.smithi097.stderr: -452> 2024-09-14T11:03:58.841+0000 7efc2bf28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:03:59.172 INFO:tasks.workunit.client.0.smithi097.stderr: -451> 2024-09-14T11:03:58.841+0000 7efc2bf28800 10 monclient(hunting): _renew_subs 2024-09-14T11:03:59.172 INFO:tasks.workunit.client.0.smithi097.stderr: -450> 2024-09-14T11:03:58.841+0000 7efc2bf28800 10 monclient(hunting): authenticate will time out at 1920.494636s 2024-09-14T11:03:59.172 INFO:tasks.workunit.client.0.smithi097.stderr: -449> 2024-09-14T11:03:58.841+0000 7efc1f44a640 10 monclient(hunting): get_auth_request con 0x5603c8ebee00 auth_method 0 2024-09-14T11:03:59.172 INFO:tasks.workunit.client.0.smithi097.stderr: -448> 2024-09-14T11:03:58.841+0000 7efc1f44a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:03:59.172 INFO:tasks.workunit.client.0.smithi097.stderr: -447> 2024-09-14T11:03:58.841+0000 7efc1f44a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:03:59.172 INFO:tasks.workunit.client.0.smithi097.stderr: -446> 2024-09-14T11:03:58.841+0000 7efc1f44a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:03:59.172 INFO:tasks.workunit.client.0.smithi097.stderr: -445> 2024-09-14T11:03:58.841+0000 7efc2844c640 10 monclient(hunting): get_auth_request con 0x7efc14002340 auth_method 0 2024-09-14T11:03:59.173 INFO:tasks.workunit.client.0.smithi097.stderr: -444> 2024-09-14T11:03:58.841+0000 7efc2844c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:03:59.173 INFO:tasks.workunit.client.0.smithi097.stderr: -443> 2024-09-14T11:03:58.841+0000 7efc2844c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:03:59.173 INFO:tasks.workunit.client.0.smithi097.stderr: -442> 2024-09-14T11:03:58.841+0000 7efc2844c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:03:59.173 INFO:tasks.workunit.client.0.smithi097.stderr: -441> 2024-09-14T11:03:58.841+0000 7efc1f44a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:03:59.173 INFO:tasks.workunit.client.0.smithi097.stderr: -440> 2024-09-14T11:03:58.841+0000 7efc1f44a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:03:59.173 INFO:tasks.workunit.client.0.smithi097.stderr: -439> 2024-09-14T11:03:58.841+0000 7efc1f44a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:03:59.173 INFO:tasks.workunit.client.0.smithi097.stderr: -438> 2024-09-14T11:03:58.841+0000 7efc2844c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:03:59.173 INFO:tasks.workunit.client.0.smithi097.stderr: -437> 2024-09-14T11:03:58.841+0000 7efc2844c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:03:59.173 INFO:tasks.workunit.client.0.smithi097.stderr: -436> 2024-09-14T11:03:58.841+0000 7efc2844c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:03:59.173 INFO:tasks.workunit.client.0.smithi097.stderr: -435> 2024-09-14T11:03:58.841+0000 7efc27c4b640 10 monclient(hunting): get_auth_request con 0x5603c8e9be40 auth_method 0 2024-09-14T11:03:59.173 INFO:tasks.workunit.client.0.smithi097.stderr: -434> 2024-09-14T11:03:58.841+0000 7efc27c4b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:03:59.173 INFO:tasks.workunit.client.0.smithi097.stderr: -433> 2024-09-14T11:03:58.841+0000 7efc27c4b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:03:59.173 INFO:tasks.workunit.client.0.smithi097.stderr: -432> 2024-09-14T11:03:58.841+0000 7efc27c4b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:03:59.174 INFO:tasks.workunit.client.0.smithi097.stderr: -431> 2024-09-14T11:03:58.841+0000 7efc27c4b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:03:59.174 INFO:tasks.workunit.client.0.smithi097.stderr: -430> 2024-09-14T11:03:58.841+0000 7efc27c4b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:03:59.174 INFO:tasks.workunit.client.0.smithi097.stderr: -429> 2024-09-14T11:03:58.841+0000 7efc27c4b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:03:59.174 INFO:tasks.workunit.client.0.smithi097.stderr: -428> 2024-09-14T11:03:58.841+0000 7efc1f44a640 10 monclient(hunting): handle_auth_done global_id 6527 payload 824 2024-09-14T11:03:59.174 INFO:tasks.workunit.client.0.smithi097.stderr: -427> 2024-09-14T11:03:58.841+0000 7efc1f44a640 10 monclient: _finish_hunting 0 2024-09-14T11:03:59.174 INFO:tasks.workunit.client.0.smithi097.stderr: -426> 2024-09-14T11:03:58.841+0000 7efc1f44a640 1 monclient: found mon.noname-c 2024-09-14T11:03:59.174 INFO:tasks.workunit.client.0.smithi097.stderr: -425> 2024-09-14T11:03:58.841+0000 7efc1f44a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:03:59.174 INFO:tasks.workunit.client.0.smithi097.stderr: -424> 2024-09-14T11:03:58.842+0000 7efb0ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:03:59.174 INFO:tasks.workunit.client.0.smithi097.stderr: -423> 2024-09-14T11:03:58.842+0000 7efb0ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:03:59.174 INFO:tasks.workunit.client.0.smithi097.stderr: -422> 2024-09-14T11:03:58.842+0000 7efb0ffff640 10 monclient: dump: 2024-09-14T11:03:59.174 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:03:59.174 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:03:59.174 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:59.174 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:59.175 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:03:59.175 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:03:59.175 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:03:59.175 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:03:59.175 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:03:59.175 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:59.175 INFO:tasks.workunit.client.0.smithi097.stderr: -421> 2024-09-14T11:03:58.842+0000 7efb0ffff640 10 monclient: _finish_auth 0 2024-09-14T11:03:59.175 INFO:tasks.workunit.client.0.smithi097.stderr: -420> 2024-09-14T11:03:58.842+0000 7efb0ffff640 10 monclient: _check_auth_tickets 2024-09-14T11:03:59.175 INFO:tasks.workunit.client.0.smithi097.stderr: -419> 2024-09-14T11:03:58.842+0000 7efb0ffff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:03:59.175 INFO:tasks.workunit.client.0.smithi097.stderr: -418> 2024-09-14T11:03:58.842+0000 7efb0ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:03:59.175 INFO:tasks.workunit.client.0.smithi097.stderr: -417> 2024-09-14T11:03:58.842+0000 7efb0ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:03:59.175 INFO:tasks.workunit.client.0.smithi097.stderr: -416> 2024-09-14T11:03:58.842+0000 7efb0ffff640 10 monclient: dump: 2024-09-14T11:03:59.175 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:03:59.175 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:03:59.176 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:59.176 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:59.176 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:03:59.176 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:03:59.176 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:03:59.176 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:03:59.176 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:03:59.176 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:59.176 INFO:tasks.workunit.client.0.smithi097.stderr: -415> 2024-09-14T11:03:58.842+0000 7efc2bf28800 5 monclient: authenticate success, global_id 6527 2024-09-14T11:03:59.176 INFO:tasks.workunit.client.0.smithi097.stderr: -414> 2024-09-14T11:03:58.842+0000 7efc2bf28800 10 monclient: _renew_subs 2024-09-14T11:03:59.176 INFO:tasks.workunit.client.0.smithi097.stderr: -413> 2024-09-14T11:03:58.842+0000 7efc2bf28800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:03:59.176 INFO:tasks.workunit.client.0.smithi097.stderr: -412> 2024-09-14T11:03:58.842+0000 7efb15e0b640 4 set_mon_vals no callback set 2024-09-14T11:03:59.176 INFO:tasks.workunit.client.0.smithi097.stderr: -411> 2024-09-14T11:03:58.842+0000 7efc2bf28800 10 monclient: _renew_subs 2024-09-14T11:03:59.176 INFO:tasks.workunit.client.0.smithi097.stderr: -410> 2024-09-14T11:03:58.842+0000 7efc2bf28800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:03:59.177 INFO:tasks.workunit.client.0.smithi097.stderr: -409> 2024-09-14T11:03:58.842+0000 7efc2bf28800 1 librados: init done 2024-09-14T11:03:59.177 INFO:tasks.workunit.client.0.smithi097.stderr: -408> 2024-09-14T11:03:58.844+0000 7efb0ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:03:59.177 INFO:tasks.workunit.client.0.smithi097.stderr: -407> 2024-09-14T11:03:58.844+0000 7efb0ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:03:59.177 INFO:tasks.workunit.client.0.smithi097.stderr: -406> 2024-09-14T11:03:58.844+0000 7efb0ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:03:59.177 INFO:tasks.workunit.client.0.smithi097.stderr: -405> 2024-09-14T11:03:58.844+0000 7efc27c4b640 10 monclient: get_auth_request con 0x7efb10077260 auth_method 0 2024-09-14T11:03:59.177 INFO:tasks.workunit.client.0.smithi097.stderr: -404> 2024-09-14T11:03:58.844+0000 7efc2844c640 10 monclient: get_auth_request con 0x5603c8ec1830 auth_method 0 2024-09-14T11:03:59.177 INFO:tasks.workunit.client.0.smithi097.stderr: -403> 2024-09-14T11:03:58.845+0000 7efc27c4b640 10 monclient: get_auth_request con 0x5603c8ee1400 auth_method 0 2024-09-14T11:03:59.177 INFO:tasks.workunit.client.0.smithi097.stderr: -402> 2024-09-14T11:03:58.846+0000 7efc1f44a640 10 monclient: get_auth_request con 0x5603c8ee5760 auth_method 0 2024-09-14T11:03:59.177 INFO:tasks.workunit.client.0.smithi097.stderr: -401> 2024-09-14T11:03:58.847+0000 7efc2844c640 10 monclient: get_auth_request con 0x5603c8ee4cb0 auth_method 0 2024-09-14T11:03:59.177 INFO:tasks.workunit.client.0.smithi097.stderr: -400> 2024-09-14T11:03:58.847+0000 7efc2bf28800 10 monclient: build_initial_monmap 2024-09-14T11:03:59.178 INFO:tasks.workunit.client.0.smithi097.stderr: -399> 2024-09-14T11:03:58.847+0000 7efc2bf28800 1 build_initial for_mkfs: 0 2024-09-14T11:03:59.178 INFO:tasks.workunit.client.0.smithi097.stderr: -398> 2024-09-14T11:03:58.847+0000 7efc2bf28800 10 monclient: monmap: 2024-09-14T11:03:59.178 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:03:59.178 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:03:59.178 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:03:59.178 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:03:59.178 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:03:59.178 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:03:59.178 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:03:59.178 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:03:59.178 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:03:59.178 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:59.178 INFO:tasks.workunit.client.0.smithi097.stderr: -397> 2024-09-14T11:03:58.847+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eeda00) adding auth protocol: cephx 2024-09-14T11:03:59.178 INFO:tasks.workunit.client.0.smithi097.stderr: -396> 2024-09-14T11:03:58.847+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eeda00) adding auth protocol: cephx 2024-09-14T11:03:59.179 INFO:tasks.workunit.client.0.smithi097.stderr: -395> 2024-09-14T11:03:58.847+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eeda00) adding auth protocol: cephx 2024-09-14T11:03:59.179 INFO:tasks.workunit.client.0.smithi097.stderr: -394> 2024-09-14T11:03:58.847+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eeda00) adding con mode: secure 2024-09-14T11:03:59.179 INFO:tasks.workunit.client.0.smithi097.stderr: -393> 2024-09-14T11:03:58.847+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eeda00) adding con mode: crc 2024-09-14T11:03:59.179 INFO:tasks.workunit.client.0.smithi097.stderr: -392> 2024-09-14T11:03:58.847+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eeda00) adding con mode: secure 2024-09-14T11:03:59.179 INFO:tasks.workunit.client.0.smithi097.stderr: -391> 2024-09-14T11:03:58.847+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eeda00) adding con mode: crc 2024-09-14T11:03:59.179 INFO:tasks.workunit.client.0.smithi097.stderr: -390> 2024-09-14T11:03:58.847+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eeda00) adding con mode: secure 2024-09-14T11:03:59.179 INFO:tasks.workunit.client.0.smithi097.stderr: -389> 2024-09-14T11:03:58.847+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eeda00) adding con mode: crc 2024-09-14T11:03:59.179 INFO:tasks.workunit.client.0.smithi097.stderr: -388> 2024-09-14T11:03:58.847+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eeda00) adding con mode: crc 2024-09-14T11:03:59.179 INFO:tasks.workunit.client.0.smithi097.stderr: -387> 2024-09-14T11:03:58.847+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eeda00) adding con mode: secure 2024-09-14T11:03:59.179 INFO:tasks.workunit.client.0.smithi097.stderr: -386> 2024-09-14T11:03:58.847+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eeda00) adding con mode: crc 2024-09-14T11:03:59.179 INFO:tasks.workunit.client.0.smithi097.stderr: -385> 2024-09-14T11:03:58.847+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eeda00) adding con mode: secure 2024-09-14T11:03:59.179 INFO:tasks.workunit.client.0.smithi097.stderr: -384> 2024-09-14T11:03:58.847+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eeda00) adding con mode: crc 2024-09-14T11:03:59.179 INFO:tasks.workunit.client.0.smithi097.stderr: -383> 2024-09-14T11:03:58.847+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eeda00) adding con mode: secure 2024-09-14T11:03:59.180 INFO:tasks.workunit.client.0.smithi097.stderr: -382> 2024-09-14T11:03:58.848+0000 7efc2bf28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:59.180 INFO:tasks.workunit.client.0.smithi097.stderr: -381> 2024-09-14T11:03:58.848+0000 7efc2bf28800 5 asok(0x5603c8c77270) register_command objecter_requests cmddesc objecter_requests hook 0x5603c8ef0d70 EEXIST 2024-09-14T11:03:59.180 INFO:tasks.workunit.client.0.smithi097.stderr: -380> 2024-09-14T11:03:58.848+0000 7efc2bf28800 10 monclient: init 2024-09-14T11:03:59.180 INFO:tasks.workunit.client.0.smithi097.stderr: -379> 2024-09-14T11:03:58.848+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eec7d8) adding auth protocol: cephx 2024-09-14T11:03:59.180 INFO:tasks.workunit.client.0.smithi097.stderr: -378> 2024-09-14T11:03:58.848+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eec7d8) adding auth protocol: cephx 2024-09-14T11:03:59.180 INFO:tasks.workunit.client.0.smithi097.stderr: -377> 2024-09-14T11:03:58.848+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eec7d8) adding auth protocol: cephx 2024-09-14T11:03:59.180 INFO:tasks.workunit.client.0.smithi097.stderr: -376> 2024-09-14T11:03:58.848+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eec7d8) adding con mode: secure 2024-09-14T11:03:59.180 INFO:tasks.workunit.client.0.smithi097.stderr: -375> 2024-09-14T11:03:58.848+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eec7d8) adding con mode: crc 2024-09-14T11:03:59.180 INFO:tasks.workunit.client.0.smithi097.stderr: -374> 2024-09-14T11:03:58.848+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eec7d8) adding con mode: secure 2024-09-14T11:03:59.180 INFO:tasks.workunit.client.0.smithi097.stderr: -373> 2024-09-14T11:03:58.848+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eec7d8) adding con mode: crc 2024-09-14T11:03:59.180 INFO:tasks.workunit.client.0.smithi097.stderr: -372> 2024-09-14T11:03:58.848+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eec7d8) adding con mode: secure 2024-09-14T11:03:59.180 INFO:tasks.workunit.client.0.smithi097.stderr: -371> 2024-09-14T11:03:58.848+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eec7d8) adding con mode: crc 2024-09-14T11:03:59.180 INFO:tasks.workunit.client.0.smithi097.stderr: -370> 2024-09-14T11:03:58.848+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eec7d8) adding con mode: crc 2024-09-14T11:03:59.180 INFO:tasks.workunit.client.0.smithi097.stderr: -369> 2024-09-14T11:03:58.848+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eec7d8) adding con mode: secure 2024-09-14T11:03:59.181 INFO:tasks.workunit.client.0.smithi097.stderr: -368> 2024-09-14T11:03:58.848+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eec7d8) adding con mode: crc 2024-09-14T11:03:59.181 INFO:tasks.workunit.client.0.smithi097.stderr: -367> 2024-09-14T11:03:58.848+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eec7d8) adding con mode: secure 2024-09-14T11:03:59.181 INFO:tasks.workunit.client.0.smithi097.stderr: -366> 2024-09-14T11:03:58.848+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eec7d8) adding con mode: crc 2024-09-14T11:03:59.181 INFO:tasks.workunit.client.0.smithi097.stderr: -365> 2024-09-14T11:03:58.848+0000 7efc2bf28800 5 AuthRegistry(0x5603c8eec7d8) adding con mode: secure 2024-09-14T11:03:59.181 INFO:tasks.workunit.client.0.smithi097.stderr: -364> 2024-09-14T11:03:58.848+0000 7efc2bf28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:59.181 INFO:tasks.workunit.client.0.smithi097.stderr: -363> 2024-09-14T11:03:58.848+0000 7efc2bf28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:59.181 INFO:tasks.workunit.client.0.smithi097.stderr: -362> 2024-09-14T11:03:58.848+0000 7efc2bf28800 5 asok(0x5603c8c77270) register_command rotate-key cmddesc rotate-key hook 0x5603c8eec920 EEXIST 2024-09-14T11:03:59.181 INFO:tasks.workunit.client.0.smithi097.stderr: -361> 2024-09-14T11:03:58.848+0000 7efc2bf28800 10 monclient: _reopen_session rank -1 2024-09-14T11:03:59.181 INFO:tasks.workunit.client.0.smithi097.stderr: -360> 2024-09-14T11:03:58.848+0000 7efc2bf28800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:03:59.181 INFO:tasks.workunit.client.0.smithi097.stderr: -359> 2024-09-14T11:03:58.848+0000 7efc2bf28800 10 monclient(hunting): picked mon.noname-b con 0x5603c8f15090 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:03:59.181 INFO:tasks.workunit.client.0.smithi097.stderr: -358> 2024-09-14T11:03:58.849+0000 7efc2bf28800 10 monclient(hunting): picked mon.noname-c con 0x5603c8f15470 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:03:59.181 INFO:tasks.workunit.client.0.smithi097.stderr: -357> 2024-09-14T11:03:58.849+0000 7efc2bf28800 10 monclient(hunting): picked mon.noname-a con 0x5603c8f13da0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:03:59.181 INFO:tasks.workunit.client.0.smithi097.stderr: -356> 2024-09-14T11:03:58.849+0000 7efc2bf28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:03:59.181 INFO:tasks.workunit.client.0.smithi097.stderr: -355> 2024-09-14T11:03:58.849+0000 7efc2bf28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:03:59.182 INFO:tasks.workunit.client.0.smithi097.stderr: -354> 2024-09-14T11:03:58.849+0000 7efc2bf28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:03:59.182 INFO:tasks.workunit.client.0.smithi097.stderr: -353> 2024-09-14T11:03:58.849+0000 7efc2bf28800 10 monclient(hunting): _renew_subs 2024-09-14T11:03:59.182 INFO:tasks.workunit.client.0.smithi097.stderr: -352> 2024-09-14T11:03:58.849+0000 7efc2bf28800 10 monclient(hunting): authenticate will time out at 1920.502038s 2024-09-14T11:03:59.182 INFO:tasks.workunit.client.0.smithi097.stderr: -351> 2024-09-14T11:03:58.849+0000 7efc27c4b640 10 monclient(hunting): get_auth_request con 0x5603c8f13da0 auth_method 0 2024-09-14T11:03:59.182 INFO:tasks.workunit.client.0.smithi097.stderr: -350> 2024-09-14T11:03:58.849+0000 7efc27c4b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:03:59.182 INFO:tasks.workunit.client.0.smithi097.stderr: -349> 2024-09-14T11:03:58.849+0000 7efc27c4b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:03:59.182 INFO:tasks.workunit.client.0.smithi097.stderr: -348> 2024-09-14T11:03:58.849+0000 7efc27c4b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:03:59.182 INFO:tasks.workunit.client.0.smithi097.stderr: -347> 2024-09-14T11:03:58.849+0000 7efc2844c640 10 monclient(hunting): get_auth_request con 0x5603c8f15470 auth_method 0 2024-09-14T11:03:59.182 INFO:tasks.workunit.client.0.smithi097.stderr: -346> 2024-09-14T11:03:58.849+0000 7efc2844c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:03:59.182 INFO:tasks.workunit.client.0.smithi097.stderr: -345> 2024-09-14T11:03:58.849+0000 7efc2844c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:03:59.182 INFO:tasks.workunit.client.0.smithi097.stderr: -344> 2024-09-14T11:03:58.849+0000 7efc2844c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:03:59.182 INFO:tasks.workunit.client.0.smithi097.stderr: -343> 2024-09-14T11:03:58.849+0000 7efc1f44a640 10 monclient(hunting): get_auth_request con 0x5603c8f15090 auth_method 0 2024-09-14T11:03:59.182 INFO:tasks.workunit.client.0.smithi097.stderr: -342> 2024-09-14T11:03:58.849+0000 7efc1f44a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:03:59.182 INFO:tasks.workunit.client.0.smithi097.stderr: -341> 2024-09-14T11:03:58.849+0000 7efc1f44a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:03:59.183 INFO:tasks.workunit.client.0.smithi097.stderr: -340> 2024-09-14T11:03:58.849+0000 7efc1f44a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:03:59.183 INFO:tasks.workunit.client.0.smithi097.stderr: -339> 2024-09-14T11:03:58.849+0000 7efc27c4b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:03:59.183 INFO:tasks.workunit.client.0.smithi097.stderr: -338> 2024-09-14T11:03:58.849+0000 7efc27c4b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:03:59.183 INFO:tasks.workunit.client.0.smithi097.stderr: -337> 2024-09-14T11:03:58.849+0000 7efc27c4b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:03:59.183 INFO:tasks.workunit.client.0.smithi097.stderr: -336> 2024-09-14T11:03:58.849+0000 7efc2844c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:03:59.183 INFO:tasks.workunit.client.0.smithi097.stderr: -335> 2024-09-14T11:03:58.849+0000 7efc2844c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:03:59.183 INFO:tasks.workunit.client.0.smithi097.stderr: -334> 2024-09-14T11:03:58.849+0000 7efc2844c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:03:59.183 INFO:tasks.workunit.client.0.smithi097.stderr: -333> 2024-09-14T11:03:58.849+0000 7efc1f44a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:03:59.183 INFO:tasks.workunit.client.0.smithi097.stderr: -332> 2024-09-14T11:03:58.849+0000 7efc1f44a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:03:59.183 INFO:tasks.workunit.client.0.smithi097.stderr: -331> 2024-09-14T11:03:58.849+0000 7efc1f44a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:03:59.183 INFO:tasks.workunit.client.0.smithi097.stderr: -330> 2024-09-14T11:03:58.849+0000 7efc27c4b640 10 monclient(hunting): handle_auth_done global_id 6897 payload 824 2024-09-14T11:03:59.183 INFO:tasks.workunit.client.0.smithi097.stderr: -329> 2024-09-14T11:03:58.849+0000 7efc27c4b640 10 monclient: _finish_hunting 0 2024-09-14T11:03:59.183 INFO:tasks.workunit.client.0.smithi097.stderr: -328> 2024-09-14T11:03:58.849+0000 7efc27c4b640 1 monclient: found mon.noname-a 2024-09-14T11:03:59.183 INFO:tasks.workunit.client.0.smithi097.stderr: -327> 2024-09-14T11:03:58.849+0000 7efc27c4b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-14T11:03:59.184 INFO:tasks.workunit.client.0.smithi097.stderr: -326> 2024-09-14T11:03:58.849+0000 7efb0d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:03:59.184 INFO:tasks.workunit.client.0.smithi097.stderr: -325> 2024-09-14T11:03:58.849+0000 7efb0d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:03:59.184 INFO:tasks.workunit.client.0.smithi097.stderr: -324> 2024-09-14T11:03:58.849+0000 7efb0d7fa640 10 monclient: dump: 2024-09-14T11:03:59.184 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:03:59.184 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:03:59.184 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:59.184 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:59.184 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:03:59.184 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:03:59.184 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:03:59.184 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:03:59.184 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:03:59.184 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:59.184 INFO:tasks.workunit.client.0.smithi097.stderr: -323> 2024-09-14T11:03:58.849+0000 7efb0d7fa640 10 monclient: _finish_auth 0 2024-09-14T11:03:59.185 INFO:tasks.workunit.client.0.smithi097.stderr: -322> 2024-09-14T11:03:58.849+0000 7efb0d7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:03:59.185 INFO:tasks.workunit.client.0.smithi097.stderr: -321> 2024-09-14T11:03:58.849+0000 7efb0d7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:03:59.185 INFO:tasks.workunit.client.0.smithi097.stderr: -320> 2024-09-14T11:03:58.849+0000 7efb0d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:03:59.185 INFO:tasks.workunit.client.0.smithi097.stderr: -319> 2024-09-14T11:03:58.849+0000 7efb0d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:03:59.185 INFO:tasks.workunit.client.0.smithi097.stderr: -318> 2024-09-14T11:03:58.849+0000 7efb0d7fa640 10 monclient: dump: 2024-09-14T11:03:59.185 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:03:59.185 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:03:59.185 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:59.185 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:59.185 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:03:59.185 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:03:59.185 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:03:59.185 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:03:59.185 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:03:59.186 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:59.186 INFO:tasks.workunit.client.0.smithi097.stderr: -317> 2024-09-14T11:03:58.849+0000 7efc2bf28800 5 monclient: authenticate success, global_id 6897 2024-09-14T11:03:59.186 INFO:tasks.workunit.client.0.smithi097.stderr: -316> 2024-09-14T11:03:58.849+0000 7efc2bf28800 10 monclient: _renew_subs 2024-09-14T11:03:59.186 INFO:tasks.workunit.client.0.smithi097.stderr: -315> 2024-09-14T11:03:58.849+0000 7efc2bf28800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:03:59.186 INFO:tasks.workunit.client.0.smithi097.stderr: -314> 2024-09-14T11:03:58.849+0000 7efc28c4d640 4 set_mon_vals no callback set 2024-09-14T11:03:59.186 INFO:tasks.workunit.client.0.smithi097.stderr: -313> 2024-09-14T11:03:58.849+0000 7efc2bf28800 10 monclient: _renew_subs 2024-09-14T11:03:59.186 INFO:tasks.workunit.client.0.smithi097.stderr: -312> 2024-09-14T11:03:58.849+0000 7efc2bf28800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:03:59.186 INFO:tasks.workunit.client.0.smithi097.stderr: -311> 2024-09-14T11:03:58.851+0000 7efb0d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:03:59.186 INFO:tasks.workunit.client.0.smithi097.stderr: -310> 2024-09-14T11:03:58.851+0000 7efb0d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:03:59.186 INFO:tasks.workunit.client.0.smithi097.stderr: -309> 2024-09-14T11:03:58.851+0000 7efb0d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:03:59.186 INFO:tasks.workunit.client.0.smithi097.stderr: -308> 2024-09-14T11:03:58.851+0000 7efc1f44a640 10 monclient: get_auth_request con 0x7efb00077140 auth_method 0 2024-09-14T11:03:59.186 INFO:tasks.workunit.client.0.smithi097.stderr: -307> 2024-09-14T11:03:58.852+0000 7efc2bf28800 10 monclient: get_monmap_and_config 2024-09-14T11:03:59.186 INFO:tasks.workunit.client.0.smithi097.stderr: -306> 2024-09-14T11:03:58.852+0000 7efc2bf28800 10 monclient: build_initial_monmap 2024-09-14T11:03:59.186 INFO:tasks.workunit.client.0.smithi097.stderr: -305> 2024-09-14T11:03:58.852+0000 7efc2bf28800 1 build_initial for_mkfs: 0 2024-09-14T11:03:59.187 INFO:tasks.workunit.client.0.smithi097.stderr: -304> 2024-09-14T11:03:58.852+0000 7efc2bf28800 10 monclient: monmap: 2024-09-14T11:03:59.187 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:03:59.187 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:03:59.187 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:03:59.187 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:03:59.187 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:03:59.187 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:03:59.187 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:03:59.187 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:03:59.187 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:03:59.187 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:59.187 INFO:tasks.workunit.client.0.smithi097.stderr: -303> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f34de0) adding auth protocol: cephx 2024-09-14T11:03:59.187 INFO:tasks.workunit.client.0.smithi097.stderr: -302> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f34de0) adding auth protocol: cephx 2024-09-14T11:03:59.187 INFO:tasks.workunit.client.0.smithi097.stderr: -301> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f34de0) adding auth protocol: cephx 2024-09-14T11:03:59.188 INFO:tasks.workunit.client.0.smithi097.stderr: -300> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f34de0) adding con mode: secure 2024-09-14T11:03:59.188 INFO:tasks.workunit.client.0.smithi097.stderr: -299> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f34de0) adding con mode: crc 2024-09-14T11:03:59.188 INFO:tasks.workunit.client.0.smithi097.stderr: -298> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f34de0) adding con mode: secure 2024-09-14T11:03:59.188 INFO:tasks.workunit.client.0.smithi097.stderr: -297> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f34de0) adding con mode: crc 2024-09-14T11:03:59.188 INFO:tasks.workunit.client.0.smithi097.stderr: -296> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f34de0) adding con mode: secure 2024-09-14T11:03:59.188 INFO:tasks.workunit.client.0.smithi097.stderr: -295> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f34de0) adding con mode: crc 2024-09-14T11:03:59.188 INFO:tasks.workunit.client.0.smithi097.stderr: -294> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f34de0) adding con mode: crc 2024-09-14T11:03:59.188 INFO:tasks.workunit.client.0.smithi097.stderr: -293> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f34de0) adding con mode: secure 2024-09-14T11:03:59.188 INFO:tasks.workunit.client.0.smithi097.stderr: -292> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f34de0) adding con mode: crc 2024-09-14T11:03:59.188 INFO:tasks.workunit.client.0.smithi097.stderr: -291> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f34de0) adding con mode: secure 2024-09-14T11:03:59.188 INFO:tasks.workunit.client.0.smithi097.stderr: -290> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f34de0) adding con mode: crc 2024-09-14T11:03:59.188 INFO:tasks.workunit.client.0.smithi097.stderr: -289> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f34de0) adding con mode: secure 2024-09-14T11:03:59.188 INFO:tasks.workunit.client.0.smithi097.stderr: -288> 2024-09-14T11:03:58.852+0000 7efc2bf28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:59.188 INFO:tasks.workunit.client.0.smithi097.stderr: -287> 2024-09-14T11:03:58.852+0000 7efc2bf28800 10 monclient: init 2024-09-14T11:03:59.189 INFO:tasks.workunit.client.0.smithi097.stderr: -286> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273603d0) adding auth protocol: cephx 2024-09-14T11:03:59.189 INFO:tasks.workunit.client.0.smithi097.stderr: -285> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273603d0) adding auth protocol: cephx 2024-09-14T11:03:59.189 INFO:tasks.workunit.client.0.smithi097.stderr: -284> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273603d0) adding auth protocol: cephx 2024-09-14T11:03:59.189 INFO:tasks.workunit.client.0.smithi097.stderr: -283> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273603d0) adding con mode: secure 2024-09-14T11:03:59.189 INFO:tasks.workunit.client.0.smithi097.stderr: -282> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273603d0) adding con mode: crc 2024-09-14T11:03:59.189 INFO:tasks.workunit.client.0.smithi097.stderr: -281> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273603d0) adding con mode: secure 2024-09-14T11:03:59.189 INFO:tasks.workunit.client.0.smithi097.stderr: -280> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273603d0) adding con mode: crc 2024-09-14T11:03:59.189 INFO:tasks.workunit.client.0.smithi097.stderr: -279> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273603d0) adding con mode: secure 2024-09-14T11:03:59.189 INFO:tasks.workunit.client.0.smithi097.stderr: -278> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273603d0) adding con mode: crc 2024-09-14T11:03:59.189 INFO:tasks.workunit.client.0.smithi097.stderr: -277> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273603d0) adding con mode: crc 2024-09-14T11:03:59.189 INFO:tasks.workunit.client.0.smithi097.stderr: -276> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273603d0) adding con mode: secure 2024-09-14T11:03:59.189 INFO:tasks.workunit.client.0.smithi097.stderr: -275> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273603d0) adding con mode: crc 2024-09-14T11:03:59.189 INFO:tasks.workunit.client.0.smithi097.stderr: -274> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273603d0) adding con mode: secure 2024-09-14T11:03:59.190 INFO:tasks.workunit.client.0.smithi097.stderr: -273> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273603d0) adding con mode: crc 2024-09-14T11:03:59.190 INFO:tasks.workunit.client.0.smithi097.stderr: -272> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273603d0) adding con mode: secure 2024-09-14T11:03:59.190 INFO:tasks.workunit.client.0.smithi097.stderr: -271> 2024-09-14T11:03:58.852+0000 7efc2bf28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:59.190 INFO:tasks.workunit.client.0.smithi097.stderr: -270> 2024-09-14T11:03:58.852+0000 7efc2bf28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:59.190 INFO:tasks.workunit.client.0.smithi097.stderr: -269> 2024-09-14T11:03:58.852+0000 7efc2bf28800 5 asok(0x5603c8c77270) register_command rotate-key cmddesc rotate-key hook 0x7ffe27360518 EEXIST 2024-09-14T11:03:59.190 INFO:tasks.workunit.client.0.smithi097.stderr: -268> 2024-09-14T11:03:58.853+0000 7efc2bf28800 10 monclient: _reopen_session rank -1 2024-09-14T11:03:59.190 INFO:tasks.workunit.client.0.smithi097.stderr: -267> 2024-09-14T11:03:58.853+0000 7efc2bf28800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:03:59.190 INFO:tasks.workunit.client.0.smithi097.stderr: -266> 2024-09-14T11:03:58.853+0000 7efc2bf28800 10 monclient(hunting): picked mon.noname-b con 0x5603c8f693e0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:03:59.190 INFO:tasks.workunit.client.0.smithi097.stderr: -265> 2024-09-14T11:03:58.853+0000 7efc2bf28800 10 monclient(hunting): picked mon.noname-c con 0x5603c8f59d30 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:03:59.190 INFO:tasks.workunit.client.0.smithi097.stderr: -264> 2024-09-14T11:03:58.853+0000 7efc2bf28800 10 monclient(hunting): picked mon.noname-a con 0x5603c8f64810 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:03:59.190 INFO:tasks.workunit.client.0.smithi097.stderr: -263> 2024-09-14T11:03:58.853+0000 7efc2bf28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:03:59.190 INFO:tasks.workunit.client.0.smithi097.stderr: -262> 2024-09-14T11:03:58.853+0000 7efc2bf28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:03:59.190 INFO:tasks.workunit.client.0.smithi097.stderr: -261> 2024-09-14T11:03:58.853+0000 7efc2bf28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:03:59.190 INFO:tasks.workunit.client.0.smithi097.stderr: -260> 2024-09-14T11:03:58.853+0000 7efc2bf28800 10 monclient(hunting): _renew_subs 2024-09-14T11:03:59.191 INFO:tasks.workunit.client.0.smithi097.stderr: -259> 2024-09-14T11:03:58.853+0000 7efc2bf28800 10 monclient(hunting): authenticate will time out at 1920.506069s 2024-09-14T11:03:59.191 INFO:tasks.workunit.client.0.smithi097.stderr: -258> 2024-09-14T11:03:58.853+0000 7efc2844c640 10 monclient(hunting): get_auth_request con 0x5603c8f59d30 auth_method 0 2024-09-14T11:03:59.191 INFO:tasks.workunit.client.0.smithi097.stderr: -257> 2024-09-14T11:03:58.853+0000 7efc2844c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:03:59.191 INFO:tasks.workunit.client.0.smithi097.stderr: -256> 2024-09-14T11:03:58.853+0000 7efc2844c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:03:59.191 INFO:tasks.workunit.client.0.smithi097.stderr: -255> 2024-09-14T11:03:58.853+0000 7efc2844c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:03:59.191 INFO:tasks.workunit.client.0.smithi097.stderr: -254> 2024-09-14T11:03:58.853+0000 7efc27c4b640 10 monclient(hunting): get_auth_request con 0x5603c8f64810 auth_method 0 2024-09-14T11:03:59.191 INFO:tasks.workunit.client.0.smithi097.stderr: -253> 2024-09-14T11:03:58.853+0000 7efc27c4b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:03:59.191 INFO:tasks.workunit.client.0.smithi097.stderr: -252> 2024-09-14T11:03:58.853+0000 7efc27c4b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:03:59.191 INFO:tasks.workunit.client.0.smithi097.stderr: -251> 2024-09-14T11:03:58.853+0000 7efc27c4b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:03:59.191 INFO:tasks.workunit.client.0.smithi097.stderr: -250> 2024-09-14T11:03:58.853+0000 7efc2844c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:03:59.191 INFO:tasks.workunit.client.0.smithi097.stderr: -249> 2024-09-14T11:03:58.853+0000 7efc2844c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:03:59.191 INFO:tasks.workunit.client.0.smithi097.stderr: -248> 2024-09-14T11:03:58.853+0000 7efc2844c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:03:59.191 INFO:tasks.workunit.client.0.smithi097.stderr: -247> 2024-09-14T11:03:58.853+0000 7efc27c4b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:03:59.192 INFO:tasks.workunit.client.0.smithi097.stderr: -246> 2024-09-14T11:03:58.853+0000 7efc27c4b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:03:59.192 INFO:tasks.workunit.client.0.smithi097.stderr: -245> 2024-09-14T11:03:58.853+0000 7efc27c4b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:03:59.192 INFO:tasks.workunit.client.0.smithi097.stderr: -244> 2024-09-14T11:03:58.853+0000 7efc1f44a640 10 monclient(hunting): get_auth_request con 0x5603c8f693e0 auth_method 0 2024-09-14T11:03:59.192 INFO:tasks.workunit.client.0.smithi097.stderr: -243> 2024-09-14T11:03:58.853+0000 7efc1f44a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:03:59.192 INFO:tasks.workunit.client.0.smithi097.stderr: -242> 2024-09-14T11:03:58.853+0000 7efc1f44a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:03:59.192 INFO:tasks.workunit.client.0.smithi097.stderr: -241> 2024-09-14T11:03:58.853+0000 7efc1f44a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:03:59.192 INFO:tasks.workunit.client.0.smithi097.stderr: -240> 2024-09-14T11:03:58.853+0000 7efc1f44a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:03:59.192 INFO:tasks.workunit.client.0.smithi097.stderr: -239> 2024-09-14T11:03:58.853+0000 7efc1f44a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:03:59.192 INFO:tasks.workunit.client.0.smithi097.stderr: -238> 2024-09-14T11:03:58.853+0000 7efc1f44a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:03:59.192 INFO:tasks.workunit.client.0.smithi097.stderr: -237> 2024-09-14T11:03:58.853+0000 7efc27c4b640 10 monclient(hunting): handle_auth_done global_id 6900 payload 274 2024-09-14T11:03:59.192 INFO:tasks.workunit.client.0.smithi097.stderr: -236> 2024-09-14T11:03:58.853+0000 7efc27c4b640 10 monclient: _finish_hunting 0 2024-09-14T11:03:59.192 INFO:tasks.workunit.client.0.smithi097.stderr: -235> 2024-09-14T11:03:58.853+0000 7efc27c4b640 1 monclient: found mon.noname-a 2024-09-14T11:03:59.192 INFO:tasks.workunit.client.0.smithi097.stderr: -234> 2024-09-14T11:03:58.853+0000 7efc27c4b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-14T11:03:59.192 INFO:tasks.workunit.client.0.smithi097.stderr: -233> 2024-09-14T11:03:58.853+0000 7efb06ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:03:59.193 INFO:tasks.workunit.client.0.smithi097.stderr: -232> 2024-09-14T11:03:58.853+0000 7efb06ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:03:59.193 INFO:tasks.workunit.client.0.smithi097.stderr: -231> 2024-09-14T11:03:58.853+0000 7efb06ffd640 10 monclient: dump: 2024-09-14T11:03:59.193 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:03:59.193 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:03:59.193 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:59.193 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:59.193 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:03:59.193 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:03:59.193 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:03:59.193 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:03:59.193 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:03:59.193 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:59.193 INFO:tasks.workunit.client.0.smithi097.stderr: -230> 2024-09-14T11:03:58.853+0000 7efb06ffd640 10 monclient: _finish_auth 0 2024-09-14T11:03:59.193 INFO:tasks.workunit.client.0.smithi097.stderr: -229> 2024-09-14T11:03:58.853+0000 7efb06ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:03:59.194 INFO:tasks.workunit.client.0.smithi097.stderr: -228> 2024-09-14T11:03:58.853+0000 7efb06ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:03:59.194 INFO:tasks.workunit.client.0.smithi097.stderr: -227> 2024-09-14T11:03:58.853+0000 7efc2bf28800 5 monclient: authenticate success, global_id 6900 2024-09-14T11:03:59.194 INFO:tasks.workunit.client.0.smithi097.stderr: -226> 2024-09-14T11:03:58.853+0000 7efc2bf28800 10 monclient: get_monmap_and_config success 2024-09-14T11:03:59.194 INFO:tasks.workunit.client.0.smithi097.stderr: -225> 2024-09-14T11:03:58.853+0000 7efc2bf28800 4 set_mon_vals no callback set 2024-09-14T11:03:59.194 INFO:tasks.workunit.client.0.smithi097.stderr: -224> 2024-09-14T11:03:58.853+0000 7efb06ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:03:59.194 INFO:tasks.workunit.client.0.smithi097.stderr: -223> 2024-09-14T11:03:58.853+0000 7efb06ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:03:59.194 INFO:tasks.workunit.client.0.smithi097.stderr: -222> 2024-09-14T11:03:58.853+0000 7efb06ffd640 10 monclient: dump: 2024-09-14T11:03:59.194 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:03:59.194 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:03:59.194 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:59.194 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:59.194 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:03:59.194 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:03:59.194 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:03:59.195 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:03:59.195 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:03:59.195 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:59.195 INFO:tasks.workunit.client.0.smithi097.stderr: -221> 2024-09-14T11:03:58.854+0000 7efc2bf28800 10 monclient: shutdown 2024-09-14T11:03:59.195 INFO:tasks.workunit.client.0.smithi097.stderr: -220> 2024-09-14T11:03:58.854+0000 7efc2bf28800 10 monclient: build_initial_monmap 2024-09-14T11:03:59.195 INFO:tasks.workunit.client.0.smithi097.stderr: -219> 2024-09-14T11:03:58.854+0000 7efc2bf28800 1 build_initial for_mkfs: 0 2024-09-14T11:03:59.195 INFO:tasks.workunit.client.0.smithi097.stderr: -218> 2024-09-14T11:03:58.854+0000 7efc2bf28800 10 monclient: monmap: 2024-09-14T11:03:59.195 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:03:59.195 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:03:59.195 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:03:59.195 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:03:59.195 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:03:59.195 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:03:59.195 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:03:59.196 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:03:59.196 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:03:59.196 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:59.196 INFO:tasks.workunit.client.0.smithi097.stderr: -217> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f38940) adding auth protocol: cephx 2024-09-14T11:03:59.196 INFO:tasks.workunit.client.0.smithi097.stderr: -216> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f38940) adding auth protocol: cephx 2024-09-14T11:03:59.196 INFO:tasks.workunit.client.0.smithi097.stderr: -215> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f38940) adding auth protocol: cephx 2024-09-14T11:03:59.196 INFO:tasks.workunit.client.0.smithi097.stderr: -214> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f38940) adding con mode: secure 2024-09-14T11:03:59.196 INFO:tasks.workunit.client.0.smithi097.stderr: -213> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f38940) adding con mode: crc 2024-09-14T11:03:59.196 INFO:tasks.workunit.client.0.smithi097.stderr: -212> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f38940) adding con mode: secure 2024-09-14T11:03:59.196 INFO:tasks.workunit.client.0.smithi097.stderr: -211> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f38940) adding con mode: crc 2024-09-14T11:03:59.196 INFO:tasks.workunit.client.0.smithi097.stderr: -210> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f38940) adding con mode: secure 2024-09-14T11:03:59.196 INFO:tasks.workunit.client.0.smithi097.stderr: -209> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f38940) adding con mode: crc 2024-09-14T11:03:59.196 INFO:tasks.workunit.client.0.smithi097.stderr: -208> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f38940) adding con mode: crc 2024-09-14T11:03:59.196 INFO:tasks.workunit.client.0.smithi097.stderr: -207> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f38940) adding con mode: secure 2024-09-14T11:03:59.197 INFO:tasks.workunit.client.0.smithi097.stderr: -206> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f38940) adding con mode: crc 2024-09-14T11:03:59.197 INFO:tasks.workunit.client.0.smithi097.stderr: -205> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f38940) adding con mode: secure 2024-09-14T11:03:59.197 INFO:tasks.workunit.client.0.smithi097.stderr: -204> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f38940) adding con mode: crc 2024-09-14T11:03:59.197 INFO:tasks.workunit.client.0.smithi097.stderr: -203> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f38940) adding con mode: secure 2024-09-14T11:03:59.197 INFO:tasks.workunit.client.0.smithi097.stderr: -202> 2024-09-14T11:03:58.854+0000 7efc2bf28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:59.197 INFO:tasks.workunit.client.0.smithi097.stderr: -201> 2024-09-14T11:03:58.854+0000 7efc2bf28800 1 librados: starting msgr at 2024-09-14T11:03:59.197 INFO:tasks.workunit.client.0.smithi097.stderr: -200> 2024-09-14T11:03:58.854+0000 7efc2bf28800 1 librados: starting objecter 2024-09-14T11:03:59.197 INFO:tasks.workunit.client.0.smithi097.stderr: -199> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 asok(0x5603c8c77270) register_command objecter_requests cmddesc objecter_requests hook 0x5603c8f38850 EEXIST 2024-09-14T11:03:59.197 INFO:tasks.workunit.client.0.smithi097.stderr: -198> 2024-09-14T11:03:58.854+0000 7efc2bf28800 1 librados: setting wanted keys 2024-09-14T11:03:59.197 INFO:tasks.workunit.client.0.smithi097.stderr: -197> 2024-09-14T11:03:58.854+0000 7efc2bf28800 1 librados: calling monclient init 2024-09-14T11:03:59.197 INFO:tasks.workunit.client.0.smithi097.stderr: -196> 2024-09-14T11:03:58.854+0000 7efc2bf28800 10 monclient: init 2024-09-14T11:03:59.197 INFO:tasks.workunit.client.0.smithi097.stderr: -195> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f29950) adding auth protocol: cephx 2024-09-14T11:03:59.197 INFO:tasks.workunit.client.0.smithi097.stderr: -194> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f29950) adding auth protocol: cephx 2024-09-14T11:03:59.197 INFO:tasks.workunit.client.0.smithi097.stderr: -193> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f29950) adding auth protocol: cephx 2024-09-14T11:03:59.198 INFO:tasks.workunit.client.0.smithi097.stderr: -192> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f29950) adding con mode: secure 2024-09-14T11:03:59.198 INFO:tasks.workunit.client.0.smithi097.stderr: -191> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f29950) adding con mode: crc 2024-09-14T11:03:59.198 INFO:tasks.workunit.client.0.smithi097.stderr: -190> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f29950) adding con mode: secure 2024-09-14T11:03:59.198 INFO:tasks.workunit.client.0.smithi097.stderr: -189> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f29950) adding con mode: crc 2024-09-14T11:03:59.198 INFO:tasks.workunit.client.0.smithi097.stderr: -188> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f29950) adding con mode: secure 2024-09-14T11:03:59.198 INFO:tasks.workunit.client.0.smithi097.stderr: -187> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f29950) adding con mode: crc 2024-09-14T11:03:59.198 INFO:tasks.workunit.client.0.smithi097.stderr: -186> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f29950) adding con mode: crc 2024-09-14T11:03:59.198 INFO:tasks.workunit.client.0.smithi097.stderr: -185> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f29950) adding con mode: secure 2024-09-14T11:03:59.198 INFO:tasks.workunit.client.0.smithi097.stderr: -184> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f29950) adding con mode: crc 2024-09-14T11:03:59.198 INFO:tasks.workunit.client.0.smithi097.stderr: -183> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f29950) adding con mode: secure 2024-09-14T11:03:59.198 INFO:tasks.workunit.client.0.smithi097.stderr: -182> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f29950) adding con mode: crc 2024-09-14T11:03:59.198 INFO:tasks.workunit.client.0.smithi097.stderr: -181> 2024-09-14T11:03:58.854+0000 7efc2bf28800 5 AuthRegistry(0x5603c8f29950) adding con mode: secure 2024-09-14T11:03:59.198 INFO:tasks.workunit.client.0.smithi097.stderr: -180> 2024-09-14T11:03:58.854+0000 7efc2bf28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:59.199 INFO:tasks.workunit.client.0.smithi097.stderr: -179> 2024-09-14T11:03:58.855+0000 7efc2bf28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:59.199 INFO:tasks.workunit.client.0.smithi097.stderr: -178> 2024-09-14T11:03:58.855+0000 7efc2bf28800 5 asok(0x5603c8c77270) register_command rotate-key cmddesc rotate-key hook 0x5603c8f29a98 EEXIST 2024-09-14T11:03:59.199 INFO:tasks.workunit.client.0.smithi097.stderr: -177> 2024-09-14T11:03:58.855+0000 7efc2bf28800 10 monclient: _reopen_session rank -1 2024-09-14T11:03:59.199 INFO:tasks.workunit.client.0.smithi097.stderr: -176> 2024-09-14T11:03:58.855+0000 7efc2bf28800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:03:59.199 INFO:tasks.workunit.client.0.smithi097.stderr: -175> 2024-09-14T11:03:58.855+0000 7efc2bf28800 10 monclient(hunting): picked mon.noname-c con 0x5603c8f59d30 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:03:59.199 INFO:tasks.workunit.client.0.smithi097.stderr: -174> 2024-09-14T11:03:58.855+0000 7efc2bf28800 10 monclient(hunting): picked mon.noname-a con 0x5603c8f64810 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:03:59.199 INFO:tasks.workunit.client.0.smithi097.stderr: -173> 2024-09-14T11:03:58.855+0000 7efc2bf28800 10 monclient(hunting): picked mon.noname-b con 0x5603c8f693e0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:03:59.199 INFO:tasks.workunit.client.0.smithi097.stderr: -172> 2024-09-14T11:03:58.855+0000 7efc2bf28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:03:59.199 INFO:tasks.workunit.client.0.smithi097.stderr: -171> 2024-09-14T11:03:58.855+0000 7efc2bf28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:03:59.199 INFO:tasks.workunit.client.0.smithi097.stderr: -170> 2024-09-14T11:03:58.855+0000 7efc2bf28800 10 monclient(hunting): start opening mon connection 2024-09-14T11:03:59.199 INFO:tasks.workunit.client.0.smithi097.stderr: -169> 2024-09-14T11:03:58.855+0000 7efc2bf28800 10 monclient(hunting): _renew_subs 2024-09-14T11:03:59.199 INFO:tasks.workunit.client.0.smithi097.stderr: -168> 2024-09-14T11:03:58.855+0000 7efc2bf28800 10 monclient(hunting): authenticate will time out at 1920.508244s 2024-09-14T11:03:59.199 INFO:tasks.workunit.client.0.smithi097.stderr: -167> 2024-09-14T11:03:58.855+0000 7efc1f44a640 10 monclient(hunting): get_auth_request con 0x5603c8f59d30 auth_method 0 2024-09-14T11:03:59.199 INFO:tasks.workunit.client.0.smithi097.stderr: -166> 2024-09-14T11:03:58.855+0000 7efc1f44a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:03:59.200 INFO:tasks.workunit.client.0.smithi097.stderr: -165> 2024-09-14T11:03:58.855+0000 7efc1f44a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:03:59.200 INFO:tasks.workunit.client.0.smithi097.stderr: -164> 2024-09-14T11:03:58.855+0000 7efc1f44a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:03:59.200 INFO:tasks.workunit.client.0.smithi097.stderr: -163> 2024-09-14T11:03:58.855+0000 7efc2844c640 10 monclient(hunting): get_auth_request con 0x5603c8f64810 auth_method 0 2024-09-14T11:03:59.200 INFO:tasks.workunit.client.0.smithi097.stderr: -162> 2024-09-14T11:03:58.855+0000 7efc2844c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:03:59.200 INFO:tasks.workunit.client.0.smithi097.stderr: -161> 2024-09-14T11:03:58.855+0000 7efc2844c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:03:59.200 INFO:tasks.workunit.client.0.smithi097.stderr: -160> 2024-09-14T11:03:58.855+0000 7efc2844c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:03:59.200 INFO:tasks.workunit.client.0.smithi097.stderr: -159> 2024-09-14T11:03:58.855+0000 7efc1f44a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:03:59.200 INFO:tasks.workunit.client.0.smithi097.stderr: -158> 2024-09-14T11:03:58.855+0000 7efc1f44a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:03:59.200 INFO:tasks.workunit.client.0.smithi097.stderr: -157> 2024-09-14T11:03:58.855+0000 7efc1f44a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:03:59.200 INFO:tasks.workunit.client.0.smithi097.stderr: -156> 2024-09-14T11:03:58.855+0000 7efc27c4b640 10 monclient(hunting): get_auth_request con 0x5603c8f693e0 auth_method 0 2024-09-14T11:03:59.200 INFO:tasks.workunit.client.0.smithi097.stderr: -155> 2024-09-14T11:03:58.855+0000 7efc27c4b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:03:59.200 INFO:tasks.workunit.client.0.smithi097.stderr: -154> 2024-09-14T11:03:58.855+0000 7efc27c4b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:03:59.200 INFO:tasks.workunit.client.0.smithi097.stderr: -153> 2024-09-14T11:03:58.855+0000 7efc27c4b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:03:59.200 INFO:tasks.workunit.client.0.smithi097.stderr: -152> 2024-09-14T11:03:58.855+0000 7efc2844c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:03:59.201 INFO:tasks.workunit.client.0.smithi097.stderr: -151> 2024-09-14T11:03:58.855+0000 7efc2844c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:03:59.201 INFO:tasks.workunit.client.0.smithi097.stderr: -150> 2024-09-14T11:03:58.855+0000 7efc2844c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:03:59.201 INFO:tasks.workunit.client.0.smithi097.stderr: -149> 2024-09-14T11:03:58.855+0000 7efc27c4b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:03:59.201 INFO:tasks.workunit.client.0.smithi097.stderr: -148> 2024-09-14T11:03:58.855+0000 7efc27c4b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:03:59.201 INFO:tasks.workunit.client.0.smithi097.stderr: -147> 2024-09-14T11:03:58.855+0000 7efc27c4b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:03:59.201 INFO:tasks.workunit.client.0.smithi097.stderr: -146> 2024-09-14T11:03:58.855+0000 7efc1f44a640 10 monclient(hunting): handle_auth_done global_id 6536 payload 824 2024-09-14T11:03:59.201 INFO:tasks.workunit.client.0.smithi097.stderr: -145> 2024-09-14T11:03:58.855+0000 7efc1f44a640 10 monclient: _finish_hunting 0 2024-09-14T11:03:59.201 INFO:tasks.workunit.client.0.smithi097.stderr: -144> 2024-09-14T11:03:58.855+0000 7efc1f44a640 1 monclient: found mon.noname-c 2024-09-14T11:03:59.201 INFO:tasks.workunit.client.0.smithi097.stderr: -143> 2024-09-14T11:03:58.855+0000 7efc1f44a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:03:59.201 INFO:tasks.workunit.client.0.smithi097.stderr: -142> 2024-09-14T11:03:58.855+0000 7efb057fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:03:59.201 INFO:tasks.workunit.client.0.smithi097.stderr: -141> 2024-09-14T11:03:58.855+0000 7efb057fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:03:59.201 INFO:tasks.workunit.client.0.smithi097.stderr: -140> 2024-09-14T11:03:58.855+0000 7efb057fa640 10 monclient: dump: 2024-09-14T11:03:59.201 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:03:59.201 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:03:59.202 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:59.202 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:59.202 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:03:59.202 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:03:59.202 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:03:59.202 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:03:59.202 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:03:59.202 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:59.202 INFO:tasks.workunit.client.0.smithi097.stderr: -139> 2024-09-14T11:03:58.855+0000 7efb057fa640 10 monclient: _finish_auth 0 2024-09-14T11:03:59.202 INFO:tasks.workunit.client.0.smithi097.stderr: -138> 2024-09-14T11:03:58.855+0000 7efb057fa640 10 monclient: _check_auth_tickets 2024-09-14T11:03:59.202 INFO:tasks.workunit.client.0.smithi097.stderr: -137> 2024-09-14T11:03:58.855+0000 7efb057fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:03:59.202 INFO:tasks.workunit.client.0.smithi097.stderr: -136> 2024-09-14T11:03:58.855+0000 7efb057fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:03:59.202 INFO:tasks.workunit.client.0.smithi097.stderr: -135> 2024-09-14T11:03:58.855+0000 7efb057fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:03:59.202 INFO:tasks.workunit.client.0.smithi097.stderr: -134> 2024-09-14T11:03:58.855+0000 7efb057fa640 10 monclient: dump: 2024-09-14T11:03:59.203 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:03:59.203 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:03:59.203 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:59.203 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:03:59.203 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:03:59.203 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:03:59.203 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:03:59.203 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:03:59.203 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:03:59.203 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:59.203 INFO:tasks.workunit.client.0.smithi097.stderr: -133> 2024-09-14T11:03:58.855+0000 7efc2bf28800 5 monclient: authenticate success, global_id 6536 2024-09-14T11:03:59.203 INFO:tasks.workunit.client.0.smithi097.stderr: -132> 2024-09-14T11:03:58.855+0000 7efc2bf28800 10 monclient: _renew_subs 2024-09-14T11:03:59.203 INFO:tasks.workunit.client.0.smithi097.stderr: -131> 2024-09-14T11:03:58.855+0000 7efb06ffd640 4 set_mon_vals no callback set 2024-09-14T11:03:59.203 INFO:tasks.workunit.client.0.smithi097.stderr: -130> 2024-09-14T11:03:58.855+0000 7efc2bf28800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:03:59.204 INFO:tasks.workunit.client.0.smithi097.stderr: -129> 2024-09-14T11:03:58.856+0000 7efc2bf28800 10 monclient: _renew_subs 2024-09-14T11:03:59.204 INFO:tasks.workunit.client.0.smithi097.stderr: -128> 2024-09-14T11:03:58.856+0000 7efc2bf28800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:03:59.204 INFO:tasks.workunit.client.0.smithi097.stderr: -127> 2024-09-14T11:03:58.856+0000 7efc2bf28800 1 librados: init done 2024-09-14T11:03:59.204 INFO:tasks.workunit.client.0.smithi097.stderr: -126> 2024-09-14T11:03:58.856+0000 7efc2bf28800 5 asok(0x5603c8c77270) register_command cr dump hook 0x5603c8f69838 2024-09-14T11:03:59.204 INFO:tasks.workunit.client.0.smithi097.stderr: -125> 2024-09-14T11:03:58.857+0000 7efc2bf28800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.204 INFO:tasks.workunit.client.0.smithi097.stderr: -124> 2024-09-14T11:03:58.857+0000 7efb057fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:03:59.204 INFO:tasks.workunit.client.0.smithi097.stderr: -123> 2024-09-14T11:03:58.857+0000 7efb057fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:03:59.204 INFO:tasks.workunit.client.0.smithi097.stderr: -122> 2024-09-14T11:03:58.857+0000 7efb057fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:03:59.204 INFO:tasks.workunit.client.0.smithi097.stderr: -121> 2024-09-14T11:03:58.858+0000 7efc2844c640 10 monclient: get_auth_request con 0x7efaf0077230 auth_method 0 2024-09-14T11:03:59.204 INFO:tasks.workunit.client.0.smithi097.stderr: -120> 2024-09-14T11:03:58.858+0000 7efc27c4b640 10 monclient: get_auth_request con 0x5603c8f83510 auth_method 0 2024-09-14T11:03:59.204 INFO:tasks.workunit.client.0.smithi097.stderr: -119> 2024-09-14T11:03:58.858+0000 7efc2bf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:59.204 INFO:tasks.workunit.client.0.smithi097.stderr: -118> 2024-09-14T11:03:58.858+0000 7efc2bf28800 20 realm 2024-09-14T11:03:59.204 INFO:tasks.workunit.client.0.smithi097.stderr: -117> 2024-09-14T11:03:58.858+0000 7efc2bf28800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.205 INFO:tasks.workunit.client.0.smithi097.stderr: -116> 2024-09-14T11:03:58.859+0000 7efc2bf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:59.205 INFO:tasks.workunit.client.0.smithi097.stderr: -115> 2024-09-14T11:03:58.859+0000 7efc2bf28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:03:59.205 INFO:tasks.workunit.client.0.smithi097.stderr: -114> 2024-09-14T11:03:58.859+0000 7efc2bf28800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.205 INFO:tasks.workunit.client.0.smithi097.stderr: -113> 2024-09-14T11:03:58.859+0000 7efc2bf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:59.205 INFO:tasks.workunit.client.0.smithi097.stderr: -112> 2024-09-14T11:03:58.859+0000 7efc2bf28800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.205 INFO:tasks.workunit.client.0.smithi097.stderr: -111> 2024-09-14T11:03:58.859+0000 7efc1f44a640 10 monclient: get_auth_request con 0x5603c8f87750 auth_method 0 2024-09-14T11:03:59.205 INFO:tasks.workunit.client.0.smithi097.stderr: -110> 2024-09-14T11:03:58.859+0000 7efc2bf28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:59.205 INFO:tasks.workunit.client.0.smithi097.stderr: -109> 2024-09-14T11:03:58.860+0000 7efc2bf28800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.205 INFO:tasks.workunit.client.0.smithi097.stderr: -108> 2024-09-14T11:03:58.860+0000 7efc2844c640 10 monclient: get_auth_request con 0x5603c8f8afb0 auth_method 0 2024-09-14T11:03:59.205 INFO:tasks.workunit.client.0.smithi097.stderr: -107> 2024-09-14T11:03:58.860+0000 7efc2bf28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:03:59.205 INFO:tasks.workunit.client.0.smithi097.stderr: -106> 2024-09-14T11:03:58.860+0000 7efc2bf28800 20 searching for the correct realm 2024-09-14T11:03:59.205 INFO:tasks.workunit.client.0.smithi097.stderr: -105> 2024-09-14T11:03:58.861+0000 7efc27c4b640 10 monclient: get_auth_request con 0x5603c8f8fd80 auth_method 0 2024-09-14T11:03:59.205 INFO:tasks.workunit.client.0.smithi097.stderr: -104> 2024-09-14T11:03:58.861+0000 7efc27c4b640 0 -- 172.21.15.97:0/2385311258 >> [v2:172.21.15.152:6808/1010851305,v1:172.21.15.152:6809/1010851305] conn(0x5603c8f8fd80 msgr2=0x5603c8f92240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:03:59.206 INFO:tasks.workunit.client.0.smithi097.stderr: -103> 2024-09-14T11:03:59.062+0000 7efc27c4b640 10 monclient: get_auth_request con 0x5603c8f8fd80 auth_method 0 2024-09-14T11:03:59.206 INFO:tasks.workunit.client.0.smithi097.stderr: -102> 2024-09-14T11:03:59.062+0000 7efc1f44a640 10 monclient: get_auth_request con 0x7efc180b00d0 auth_method 0 2024-09-14T11:03:59.206 INFO:tasks.workunit.client.0.smithi097.stderr: -101> 2024-09-14T11:03:59.063+0000 7efc2844c640 10 monclient: get_auth_request con 0x7efc1009a040 auth_method 0 2024-09-14T11:03:59.206 INFO:tasks.workunit.client.0.smithi097.stderr: -100> 2024-09-14T11:03:59.065+0000 7efc27c4b640 0 -- 172.21.15.97:0/2385311258 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x5603c8f83510 msgr2=0x5603c8f859a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:03:59.206 INFO:tasks.workunit.client.0.smithi097.stderr: -99> 2024-09-14T11:03:59.065+0000 7efb057fa640 1 client.6536.objecter ms_handle_reset 0x5603c8f83510 session 0x5603c8f82e00 osd.6 2024-09-14T11:03:59.206 INFO:tasks.workunit.client.0.smithi097.stderr: -98> 2024-09-14T11:03:59.065+0000 7efb057fa640 10 monclient: _renew_subs 2024-09-14T11:03:59.206 INFO:tasks.workunit.client.0.smithi097.stderr: -97> 2024-09-14T11:03:59.065+0000 7efb057fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:03:59.206 INFO:tasks.workunit.client.0.smithi097.stderr: -96> 2024-09-14T11:03:59.066+0000 7efc27c4b640 10 monclient: get_auth_request con 0x7efaf0086cd0 auth_method 0 2024-09-14T11:03:59.206 INFO:tasks.workunit.client.0.smithi097.stderr: -95> 2024-09-14T11:03:59.067+0000 7efc27c4b640 10 monclient: get_auth_request con 0x7efc10061fa0 auth_method 0 2024-09-14T11:03:59.206 INFO:tasks.workunit.client.0.smithi097.stderr: -94> 2024-09-14T11:03:59.067+0000 7efc1f44a640 10 monclient: get_auth_request con 0x7efc18079b90 auth_method 0 2024-09-14T11:03:59.206 INFO:tasks.workunit.client.0.smithi097.stderr: -93> 2024-09-14T11:03:59.072+0000 7efc2bf28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:03:59.206 INFO:tasks.workunit.client.0.smithi097.stderr: -92> 2024-09-14T11:03:59.072+0000 7efc2bf28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:03:59.206 INFO:tasks.workunit.client.0.smithi097.stderr: -91> 2024-09-14T11:03:59.072+0000 7efc2bf28800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:03:59.206 INFO:tasks.workunit.client.0.smithi097.stderr: -90> 2024-09-14T11:03:59.072+0000 7efc2bf28800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:03:59.207 INFO:tasks.workunit.client.0.smithi097.stderr: -89> 2024-09-14T11:03:59.072+0000 7efc2bf28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:03:59.207 INFO:tasks.workunit.client.0.smithi097.stderr: -88> 2024-09-14T11:03:59.072+0000 7efc2bf28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:03:59.207 INFO:tasks.workunit.client.0.smithi097.stderr: -87> 2024-09-14T11:03:59.072+0000 7efc2bf28800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.207 INFO:tasks.workunit.client.0.smithi097.stderr: -86> 2024-09-14T11:03:59.072+0000 7efc2bf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:59.207 INFO:tasks.workunit.client.0.smithi097.stderr: -85> 2024-09-14T11:03:59.072+0000 7efc2bf28800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.207 INFO:tasks.workunit.client.0.smithi097.stderr: -84> 2024-09-14T11:03:59.072+0000 7efc2bf28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:59.207 INFO:tasks.workunit.client.0.smithi097.stderr: -83> 2024-09-14T11:03:59.072+0000 7efc2bf28800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.207 INFO:tasks.workunit.client.0.smithi097.stderr: -82> 2024-09-14T11:03:59.073+0000 7efc2bf28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:03:59.207 INFO:tasks.workunit.client.0.smithi097.stderr: -81> 2024-09-14T11:03:59.073+0000 7efc2bf28800 20 zone default found 2024-09-14T11:03:59.207 INFO:tasks.workunit.client.0.smithi097.stderr: -80> 2024-09-14T11:03:59.073+0000 7efc2bf28800 4 Realm: () 2024-09-14T11:03:59.207 INFO:tasks.workunit.client.0.smithi097.stderr: -79> 2024-09-14T11:03:59.073+0000 7efc2bf28800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:03:59.207 INFO:tasks.workunit.client.0.smithi097.stderr: -78> 2024-09-14T11:03:59.073+0000 7efc2bf28800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:03:59.207 INFO:tasks.workunit.client.0.smithi097.stderr: -77> 2024-09-14T11:03:59.073+0000 7efc2bf28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:03:59.207 INFO:tasks.workunit.client.0.smithi097.stderr: -76> 2024-09-14T11:03:59.073+0000 7efc2bf28800 20 zonegroup default 2024-09-14T11:03:59.208 INFO:tasks.workunit.client.0.smithi097.stderr: -75> 2024-09-14T11:03:59.073+0000 7efc2bf28800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.208 INFO:tasks.workunit.client.0.smithi097.stderr: -74> 2024-09-14T11:03:59.073+0000 7efc2bf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:59.208 INFO:tasks.workunit.client.0.smithi097.stderr: -73> 2024-09-14T11:03:59.073+0000 7efc2bf28800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.208 INFO:tasks.workunit.client.0.smithi097.stderr: -72> 2024-09-14T11:03:59.073+0000 7efc2bf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:59.208 INFO:tasks.workunit.client.0.smithi097.stderr: -71> 2024-09-14T11:03:59.073+0000 7efc2bf28800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.208 INFO:tasks.workunit.client.0.smithi097.stderr: -70> 2024-09-14T11:03:59.073+0000 7efc2bf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:59.208 INFO:tasks.workunit.client.0.smithi097.stderr: -69> 2024-09-14T11:03:59.073+0000 7efc2bf28800 20 started sync module instance, tier type = 2024-09-14T11:03:59.208 INFO:tasks.workunit.client.0.smithi097.stderr: -68> 2024-09-14T11:03:59.073+0000 7efc2bf28800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:03:59.208 INFO:tasks.workunit.client.0.smithi097.stderr: -67> 2024-09-14T11:03:59.082+0000 7efc2bf28800 20 add_watcher() i=0 2024-09-14T11:03:59.208 INFO:tasks.workunit.client.0.smithi097.stderr: -66> 2024-09-14T11:03:59.082+0000 7efc2bf28800 20 add_watcher() i=1 2024-09-14T11:03:59.208 INFO:tasks.workunit.client.0.smithi097.stderr: -65> 2024-09-14T11:03:59.082+0000 7efc2bf28800 20 add_watcher() i=2 2024-09-14T11:03:59.208 INFO:tasks.workunit.client.0.smithi097.stderr: -64> 2024-09-14T11:03:59.082+0000 7efc2bf28800 20 add_watcher() i=3 2024-09-14T11:03:59.208 INFO:tasks.workunit.client.0.smithi097.stderr: -63> 2024-09-14T11:03:59.082+0000 7efc2bf28800 20 add_watcher() i=4 2024-09-14T11:03:59.208 INFO:tasks.workunit.client.0.smithi097.stderr: -62> 2024-09-14T11:03:59.082+0000 7efc2bf28800 20 add_watcher() i=5 2024-09-14T11:03:59.209 INFO:tasks.workunit.client.0.smithi097.stderr: -61> 2024-09-14T11:03:59.083+0000 7efc2bf28800 20 add_watcher() i=6 2024-09-14T11:03:59.209 INFO:tasks.workunit.client.0.smithi097.stderr: -60> 2024-09-14T11:03:59.084+0000 7efc2bf28800 20 add_watcher() i=7 2024-09-14T11:03:59.209 INFO:tasks.workunit.client.0.smithi097.stderr: -59> 2024-09-14T11:03:59.084+0000 7efc2bf28800 2 all 8 watchers are set, enabling cache 2024-09-14T11:03:59.209 INFO:tasks.workunit.client.0.smithi097.stderr: -58> 2024-09-14T11:03:59.086+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273608b0) adding auth protocol: cephx 2024-09-14T11:03:59.209 INFO:tasks.workunit.client.0.smithi097.stderr: -57> 2024-09-14T11:03:59.086+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273608b0) adding auth protocol: cephx 2024-09-14T11:03:59.209 INFO:tasks.workunit.client.0.smithi097.stderr: -56> 2024-09-14T11:03:59.086+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273608b0) adding auth protocol: cephx 2024-09-14T11:03:59.209 INFO:tasks.workunit.client.0.smithi097.stderr: -55> 2024-09-14T11:03:59.086+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273608b0) adding con mode: secure 2024-09-14T11:03:59.209 INFO:tasks.workunit.client.0.smithi097.stderr: -54> 2024-09-14T11:03:59.086+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273608b0) adding con mode: crc 2024-09-14T11:03:59.209 INFO:tasks.workunit.client.0.smithi097.stderr: -53> 2024-09-14T11:03:59.086+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273608b0) adding con mode: secure 2024-09-14T11:03:59.209 INFO:tasks.workunit.client.0.smithi097.stderr: -52> 2024-09-14T11:03:59.086+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273608b0) adding con mode: crc 2024-09-14T11:03:59.209 INFO:tasks.workunit.client.0.smithi097.stderr: -51> 2024-09-14T11:03:59.086+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273608b0) adding con mode: secure 2024-09-14T11:03:59.209 INFO:tasks.workunit.client.0.smithi097.stderr: -50> 2024-09-14T11:03:59.086+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273608b0) adding con mode: crc 2024-09-14T11:03:59.209 INFO:tasks.workunit.client.0.smithi097.stderr: -49> 2024-09-14T11:03:59.086+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273608b0) adding con mode: crc 2024-09-14T11:03:59.209 INFO:tasks.workunit.client.0.smithi097.stderr: -48> 2024-09-14T11:03:59.086+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273608b0) adding con mode: secure 2024-09-14T11:03:59.210 INFO:tasks.workunit.client.0.smithi097.stderr: -47> 2024-09-14T11:03:59.086+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273608b0) adding con mode: crc 2024-09-14T11:03:59.210 INFO:tasks.workunit.client.0.smithi097.stderr: -46> 2024-09-14T11:03:59.086+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273608b0) adding con mode: secure 2024-09-14T11:03:59.210 INFO:tasks.workunit.client.0.smithi097.stderr: -45> 2024-09-14T11:03:59.086+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273608b0) adding con mode: crc 2024-09-14T11:03:59.210 INFO:tasks.workunit.client.0.smithi097.stderr: -44> 2024-09-14T11:03:59.086+0000 7efc2bf28800 5 AuthRegistry(0x7ffe273608b0) adding con mode: secure 2024-09-14T11:03:59.210 INFO:tasks.workunit.client.0.smithi097.stderr: -43> 2024-09-14T11:03:59.086+0000 7efaddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:59.210 INFO:tasks.workunit.client.0.smithi097.stderr: -42> 2024-09-14T11:03:59.086+0000 7efc2bf28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:03:59.210 INFO:tasks.workunit.client.0.smithi097.stderr: -41> 2024-09-14T11:03:59.086+0000 7efc2bf28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:03:59.210 INFO:tasks.workunit.client.0.smithi097.stderr: -40> 2024-09-14T11:03:59.086+0000 7efc2bf28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:03:59.210 INFO:tasks.workunit.client.0.smithi097.stderr: -39> 2024-09-14T11:03:59.086+0000 7efc2bf28800 5 asok(0x5603c8c77270) register_command cache list hook 0x5603c8f5e230 2024-09-14T11:03:59.210 INFO:tasks.workunit.client.0.smithi097.stderr: -38> 2024-09-14T11:03:59.086+0000 7efc2bf28800 5 asok(0x5603c8c77270) register_command cache inspect hook 0x5603c8f5e230 2024-09-14T11:03:59.210 INFO:tasks.workunit.client.0.smithi097.stderr: -37> 2024-09-14T11:03:59.086+0000 7efc2bf28800 5 asok(0x5603c8c77270) register_command cache erase hook 0x5603c8f5e230 2024-09-14T11:03:59.210 INFO:tasks.workunit.client.0.smithi097.stderr: -36> 2024-09-14T11:03:59.086+0000 7efc2bf28800 5 asok(0x5603c8c77270) register_command cache zap hook 0x5603c8f5e230 2024-09-14T11:03:59.210 INFO:tasks.workunit.client.0.smithi097.stderr: -35> 2024-09-14T11:03:59.086+0000 7efc2bf28800 5 note: GC not initialized 2024-09-14T11:03:59.210 INFO:tasks.workunit.client.0.smithi097.stderr: -34> 2024-09-14T11:03:59.086+0000 7efadcfe1640 20 reqs_thread_entry: start 2024-09-14T11:03:59.211 INFO:tasks.workunit.client.0.smithi097.stderr: -33> 2024-09-14T11:03:59.086+0000 7efc2bf28800 5 asok(0x5603c8c77270) register_command sync trace show hook 0x7efc1001e070 2024-09-14T11:03:59.211 INFO:tasks.workunit.client.0.smithi097.stderr: -32> 2024-09-14T11:03:59.086+0000 7efc2bf28800 5 asok(0x5603c8c77270) register_command sync trace history hook 0x7efc1001e070 2024-09-14T11:03:59.211 INFO:tasks.workunit.client.0.smithi097.stderr: -31> 2024-09-14T11:03:59.086+0000 7efc2bf28800 5 asok(0x5603c8c77270) register_command sync trace active hook 0x7efc1001e070 2024-09-14T11:03:59.211 INFO:tasks.workunit.client.0.smithi097.stderr: -30> 2024-09-14T11:03:59.086+0000 7efc2bf28800 5 asok(0x5603c8c77270) register_command sync trace active_short hook 0x7efc1001e070 2024-09-14T11:03:59.211 INFO:tasks.workunit.client.0.smithi097.stderr: -29> 2024-09-14T11:03:59.086+0000 7efc2bf28800 20 init_complete bucket index max shards: 11 2024-09-14T11:03:59.211 INFO:tasks.workunit.client.0.smithi097.stderr: -28> 2024-09-14T11:03:59.086+0000 7efc2bf28800 20 Filter name: none 2024-09-14T11:03:59.211 INFO:tasks.workunit.client.0.smithi097.stderr: -27> 2024-09-14T11:03:59.087+0000 7efa567fc640 20 reqs_thread_entry: start 2024-09-14T11:03:59.211 INFO:tasks.workunit.client.0.smithi097.stderr: -26> 2024-09-14T11:03:59.087+0000 7efc2bf28800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:03:59.211 INFO:tasks.workunit.client.0.smithi097.stderr: -25> 2024-09-14T11:03:59.087+0000 7efc2bf28800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.211 INFO:tasks.workunit.client.0.smithi097.stderr: -24> 2024-09-14T11:03:59.087+0000 7efc2bf28800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:03:59.211 INFO:tasks.workunit.client.0.smithi097.stderr: -23> 2024-09-14T11:03:59.087+0000 7efc2bf28800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:03:59.211 INFO:tasks.workunit.client.0.smithi097.stderr: -22> 2024-09-14T11:03:59.087+0000 7efc2bf28800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:03:59.211 INFO:tasks.workunit.client.0.smithi097.stderr: -21> 2024-09-14T11:03:59.087+0000 7efc2bf28800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 : miss 2024-09-14T11:03:59.211 INFO:tasks.workunit.client.0.smithi097.stderr: -20> 2024-09-14T11:03:59.087+0000 7efc2bf28800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.212 INFO:tasks.workunit.client.0.smithi097.stderr: -19> 2024-09-14T11:03:59.087+0000 7efc2bf28800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:03:59.212 INFO:tasks.workunit.client.0.smithi097.stderr: -18> 2024-09-14T11:03:59.087+0000 7efc2bf28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 info.flags=0x17 2024-09-14T11:03:59.212 INFO:tasks.workunit.client.0.smithi097.stderr: -17> 2024-09-14T11:03:59.087+0000 7efc2bf28800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 to cache LRU end 2024-09-14T11:03:59.212 INFO:tasks.workunit.client.0.smithi097.stderr: -16> 2024-09-14T11:03:59.087+0000 7efc2bf28800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:03:59.212 INFO:tasks.workunit.client.0.smithi097.stderr: -15> 2024-09-14T11:03:59.087+0000 7efc2bf28800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:59.212 INFO:tasks.workunit.client.0.smithi097.stderr: -14> 2024-09-14T11:03:59.087+0000 7efc2bf28800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 2024-09-14T11:03:59.212 INFO:tasks.workunit.client.0.smithi097.stderr: -13> 2024-09-14T11:03:59.092+0000 7efc2bf28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 info.flags=0x17 2024-09-14T11:03:59.212 INFO:tasks.workunit.client.0.smithi097.stderr: -12> 2024-09-14T11:03:59.092+0000 7efc2bf28800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 to cache LRU end 2024-09-14T11:03:59.212 INFO:tasks.workunit.client.0.smithi097.stderr: -11> 2024-09-14T11:03:59.092+0000 7efc2bf28800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:59.212 INFO:tasks.workunit.client.0.smithi097.stderr: -10> 2024-09-14T11:03:59.092+0000 7efc2bf28800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27, ofs0, ns] 2024-09-14T11:03:59.212 INFO:tasks.workunit.client.0.smithi097.stderr: -9> 2024-09-14T11:03:59.092+0000 7efb067fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595185 cookie 94574256664736 notifier 6536 bl.length()=939 2024-09-14T11:03:59.212 INFO:tasks.workunit.client.0.smithi097.stderr: -8> 2024-09-14T11:03:59.092+0000 7efb067fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 info.flags=0x17 2024-09-14T11:03:59.212 INFO:tasks.workunit.client.0.smithi097.stderr: -7> 2024-09-14T11:03:59.092+0000 7efb067fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 to cache LRU end 2024-09-14T11:03:59.213 INFO:tasks.workunit.client.0.smithi097.stderr: -6> 2024-09-14T11:03:59.092+0000 7efb067fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:59.213 INFO:tasks.workunit.client.0.smithi097.stderr: -5> 2024-09-14T11:03:59.093+0000 7efc2bf28800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27]): orig_sources= new_sources= 2024-09-14T11:03:59.213 INFO:tasks.workunit.client.0.smithi097.stderr: -4> 2024-09-14T11:03:59.093+0000 7efc2bf28800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27]): potential sources added=[] removed=[] 2024-09-14T11:03:59.213 INFO:tasks.workunit.client.0.smithi097.stderr: -3> 2024-09-14T11:03:59.093+0000 7efc2bf28800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27]): orig_dests= new_dests= 2024-09-14T11:03:59.213 INFO:tasks.workunit.client.0.smithi097.stderr: -2> 2024-09-14T11:03:59.093+0000 7efc2bf28800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27]): potential dests added=[] removed=[] 2024-09-14T11:03:59.213 INFO:tasks.workunit.client.0.smithi097.stderr: -1> 2024-09-14T11:03:59.094+0000 7efc2bf28800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7efc2bf28800 time 2024-09-14T11:03:59.094211+0000 2024-09-14T11:03:59.213 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:03:59.213 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:59.213 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:03:59.213 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7efc2d78c76a] 2024-09-14T11:03:59.213 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7efc2d78c928] 2024-09-14T11:03:59.213 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5603c79240b1] 2024-09-14T11:03:59.213 INFO:tasks.workunit.client.0.smithi097.stderr: 4: radosgw-admin(+0xd8900e) [0x5603c7e3800e] 2024-09-14T11:03:59.213 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5603c7933efd] 2024-09-14T11:03:59.214 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-14T11:03:59.214 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7efc2c429590] 2024-09-14T11:03:59.214 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-14T11:03:59.214 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-14T11:03:59.214 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:59.214 INFO:tasks.workunit.client.0.smithi097.stderr: 0> 2024-09-14T11:03:59.094+0000 7efc2bf28800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:03:59.214 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7efc2bf28800 thread_name:radosgw-admin 2024-09-14T11:03:59.214 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:59.214 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:03:59.214 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7efc2c43e6f0] 2024-09-14T11:03:59.214 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7efc2c48b99c] 2024-09-14T11:03:59.214 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-14T11:03:59.214 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-14T11:03:59.214 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7efc2d78c7c4] 2024-09-14T11:03:59.215 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7efc2d78c928] 2024-09-14T11:03:59.215 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5603c79240b1] 2024-09-14T11:03:59.215 INFO:tasks.workunit.client.0.smithi097.stderr: 8: radosgw-admin(+0xd8900e) [0x5603c7e3800e] 2024-09-14T11:03:59.215 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5603c7933efd] 2024-09-14T11:03:59.215 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-14T11:03:59.215 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7efc2c429590] 2024-09-14T11:03:59.215 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-14T11:03:59.215 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-14T11:03:59.215 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:03:59.215 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:59.215 INFO:tasks.workunit.client.0.smithi097.stderr:--- logging levels --- 2024-09-14T11:03:59.215 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 none 2024-09-14T11:03:59.215 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 lockdep 2024-09-14T11:03:59.215 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 context 2024-09-14T11:03:59.216 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 crush 2024-09-14T11:03:59.216 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds 2024-09-14T11:03:59.216 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_balancer 2024-09-14T11:03:59.216 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_locker 2024-09-14T11:03:59.216 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log 2024-09-14T11:03:59.216 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log_expire 2024-09-14T11:03:59.216 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_migrator 2024-09-14T11:03:59.216 INFO:tasks.workunit.client.0.smithi097.stderr: 3/ 5 mds_quiesce 2024-09-14T11:03:59.216 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 buffer 2024-09-14T11:03:59.216 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 timer 2024-09-14T11:03:59.216 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 filer 2024-09-14T11:03:59.216 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 striper 2024-09-14T11:03:59.216 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 objecter 2024-09-14T11:03:59.217 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rados 2024-09-14T11:03:59.217 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd 2024-09-14T11:03:59.217 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_mirror 2024-09-14T11:03:59.217 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_replay 2024-09-14T11:03:59.217 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_pwl 2024-09-14T11:03:59.217 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 journaler 2024-09-14T11:03:59.217 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objectcacher 2024-09-14T11:03:59.217 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:03:59.217 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 client 2024-09-14T11:03:59.217 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 osd 2024-09-14T11:03:59.217 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 optracker 2024-09-14T11:03:59.217 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objclass 2024-09-14T11:03:59.217 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 filestore 2024-09-14T11:03:59.217 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 journal 2024-09-14T11:03:59.218 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 ms 2024-09-14T11:03:59.218 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mon 2024-09-14T11:03:59.218 INFO:tasks.workunit.client.0.smithi097.stderr: 0/10 monc 2024-09-14T11:03:59.220 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 paxos 2024-09-14T11:03:59.220 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 tp 2024-09-14T11:03:59.220 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 auth 2024-09-14T11:03:59.220 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 crypto 2024-09-14T11:03:59.220 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 finisher 2024-09-14T11:03:59.220 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 reserver 2024-09-14T11:03:59.220 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 heartbeatmap 2024-09-14T11:03:59.221 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 perfcounter 2024-09-14T11:03:59.221 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw 2024-09-14T11:03:59.221 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_sync 2024-09-14T11:03:59.221 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_datacache 2024-09-14T11:03:59.221 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_access 2024-09-14T11:03:59.221 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:03:59.221 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_flight 2024-09-14T11:03:59.221 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:03:59.221 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw_notification 2024-09-14T11:03:59.221 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 javaclient 2024-09-14T11:03:59.221 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 asok 2024-09-14T11:03:59.221 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 throttle 2024-09-14T11:03:59.221 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 refs 2024-09-14T11:03:59.221 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 compressor 2024-09-14T11:03:59.222 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluestore 2024-09-14T11:03:59.222 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluefs 2024-09-14T11:03:59.222 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 bdev 2024-09-14T11:03:59.222 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 kstore 2024-09-14T11:03:59.222 INFO:tasks.workunit.client.0.smithi097.stderr: 4/ 5 rocksdb 2024-09-14T11:03:59.222 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 fuse 2024-09-14T11:03:59.222 INFO:tasks.workunit.client.0.smithi097.stderr: 2/ 5 mgr 2024-09-14T11:03:59.222 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mgrc 2024-09-14T11:03:59.222 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 dpdk 2024-09-14T11:03:59.222 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 eventtrace 2024-09-14T11:03:59.222 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 prioritycache 2024-09-14T11:03:59.222 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 test 2024-09-14T11:03:59.222 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:03:59.222 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephsqlite 2024-09-14T11:03:59.222 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:03:59.223 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore 2024-09-14T11:03:59.223 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_onode 2024-09-14T11:03:59.223 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_odata 2024-09-14T11:03:59.223 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_omap 2024-09-14T11:03:59.223 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_tm 2024-09-14T11:03:59.223 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_t 2024-09-14T11:03:59.223 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:03:59.223 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_epm 2024-09-14T11:03:59.223 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_lba 2024-09-14T11:03:59.223 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:03:59.223 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cache 2024-09-14T11:03:59.223 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_journal 2024-09-14T11:03:59.223 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_device 2024-09-14T11:03:59.223 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_backref 2024-09-14T11:03:59.224 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 alienstore 2024-09-14T11:03:59.224 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mclock 2024-09-14T11:03:59.224 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cyanstore 2024-09-14T11:03:59.224 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 ceph_exporter 2024-09-14T11:03:59.224 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 memstore 2024-09-14T11:03:59.224 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 trace 2024-09-14T11:03:59.224 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 ceph_dedup 2024-09-14T11:03:59.224 INFO:tasks.workunit.client.0.smithi097.stderr: -2/-2 (syslog threshold) 2024-09-14T11:03:59.224 INFO:tasks.workunit.client.0.smithi097.stderr: 99/99 (stderr threshold) 2024-09-14T11:03:59.224 INFO:tasks.workunit.client.0.smithi097.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:03:59.224 INFO:tasks.workunit.client.0.smithi097.stderr: 7efa567fc640 / http_manager 2024-09-14T11:03:59.224 INFO:tasks.workunit.client.0.smithi097.stderr: 7efadcfe1640 / http_manager 2024-09-14T11:03:59.224 INFO:tasks.workunit.client.0.smithi097.stderr: 7efaddfe3640 / rgw_dt_lg_renew 2024-09-14T11:03:59.224 INFO:tasks.workunit.client.0.smithi097.stderr: 7efb057fa640 / ms_dispatch 2024-09-14T11:03:59.225 INFO:tasks.workunit.client.0.smithi097.stderr: 7efb067fc640 / io_context_pool 2024-09-14T11:03:59.225 INFO:tasks.workunit.client.0.smithi097.stderr: 7efb06ffd640 / io_context_pool 2024-09-14T11:03:59.225 INFO:tasks.workunit.client.0.smithi097.stderr: 7efb0d7fa640 / ms_dispatch 2024-09-14T11:03:59.225 INFO:tasks.workunit.client.0.smithi097.stderr: 7efb0ffff640 / ms_dispatch 2024-09-14T11:03:59.225 INFO:tasks.workunit.client.0.smithi097.stderr: 7efb15e0b640 / io_context_pool 2024-09-14T11:03:59.225 INFO:tasks.workunit.client.0.smithi097.stderr: 7efc1f44a640 / msgr-worker-2 2024-09-14T11:03:59.225 INFO:tasks.workunit.client.0.smithi097.stderr: 7efc27c4b640 / msgr-worker-1 2024-09-14T11:03:59.225 INFO:tasks.workunit.client.0.smithi097.stderr: 7efc2844c640 / msgr-worker-0 2024-09-14T11:03:59.225 INFO:tasks.workunit.client.0.smithi097.stderr: 7efc28c4d640 / io_context_pool 2024-09-14T11:03:59.225 INFO:tasks.workunit.client.0.smithi097.stderr: 7efc2bf28800 / radosgw-admin 2024-09-14T11:03:59.225 INFO:tasks.workunit.client.0.smithi097.stderr: max_recent 500 2024-09-14T11:03:59.225 INFO:tasks.workunit.client.0.smithi097.stderr: max_new 1000 2024-09-14T11:03:59.225 INFO:tasks.workunit.client.0.smithi097.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:03:59.095863Z_6975c75b-3c4e-4254-894a-d22ae59916f3/log 2024-09-14T11:03:59.225 INFO:tasks.workunit.client.0.smithi097.stderr:--- end dump of recent events --- 2024-09-14T11:03:59.226 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-14T11:03:59.227 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:03:59.227 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:03:59.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.170+0000 7fc392b44800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.172+0000 7fc392b44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:59.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.172+0000 7fc392b44800 20 realm 2024-09-14T11:03:59.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.172+0000 7fc392b44800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.172+0000 7fc392b44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:59.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.172+0000 7fc392b44800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:03:59.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.172+0000 7fc392b44800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.172+0000 7fc392b44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:59.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.172+0000 7fc392b44800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.173+0000 7fc392b44800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:59.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.173+0000 7fc392b44800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.174+0000 7fc392b44800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:03:59.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.174+0000 7fc392b44800 20 searching for the correct realm 2024-09-14T11:03:59.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.176+0000 7fc38f0f5640 0 -- 172.21.15.97:0/1530683241 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7fc3840b4d70 msgr2=0x7fc3840aa5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:03:59.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.381+0000 7fc38e0f3640 0 -- 172.21.15.97:0/1530683241 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7fc38000ac20 msgr2=0x7fc38004e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:03:59.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.386+0000 7fc392b44800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:03:59.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.386+0000 7fc392b44800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:03:59.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.386+0000 7fc392b44800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:03:59.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.386+0000 7fc392b44800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:03:59.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.386+0000 7fc392b44800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:03:59.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.386+0000 7fc392b44800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:03:59.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.386+0000 7fc392b44800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.386+0000 7fc392b44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:59.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.386+0000 7fc392b44800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.386+0000 7fc392b44800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:59.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.386+0000 7fc392b44800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.387+0000 7fc392b44800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:03:59.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.387+0000 7fc392b44800 20 zone default found 2024-09-14T11:03:59.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.387+0000 7fc392b44800 4 Realm: () 2024-09-14T11:03:59.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.387+0000 7fc392b44800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:03:59.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.387+0000 7fc392b44800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:03:59.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.387+0000 7fc392b44800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:03:59.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.387+0000 7fc392b44800 20 zonegroup default 2024-09-14T11:03:59.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.387+0000 7fc392b44800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.387+0000 7fc392b44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:59.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.387+0000 7fc392b44800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.388+0000 7fc392b44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:59.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.388+0000 7fc392b44800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.388+0000 7fc392b44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:59.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.388+0000 7fc392b44800 20 started sync module instance, tier type = 2024-09-14T11:03:59.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.388+0000 7fc392b44800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:03:59.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.397+0000 7fc392b44800 20 add_watcher() i=0 2024-09-14T11:03:59.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.397+0000 7fc392b44800 20 add_watcher() i=1 2024-09-14T11:03:59.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.397+0000 7fc392b44800 20 add_watcher() i=2 2024-09-14T11:03:59.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.397+0000 7fc392b44800 20 add_watcher() i=3 2024-09-14T11:03:59.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.397+0000 7fc392b44800 20 add_watcher() i=4 2024-09-14T11:03:59.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.397+0000 7fc392b44800 20 add_watcher() i=5 2024-09-14T11:03:59.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.397+0000 7fc392b44800 20 add_watcher() i=6 2024-09-14T11:03:59.397 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.398+0000 7fc392b44800 20 add_watcher() i=7 2024-09-14T11:03:59.397 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.398+0000 7fc392b44800 2 all 8 watchers are set, enabling cache 2024-09-14T11:03:59.398 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.399+0000 7fc2457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:59.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.400+0000 7fc392b44800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:03:59.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.400+0000 7fc392b44800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:03:59.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.400+0000 7fc392b44800 5 note: GC not initialized 2024-09-14T11:03:59.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.400+0000 7fc1bffff640 20 reqs_thread_entry: start 2024-09-14T11:03:59.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.400+0000 7fc392b44800 20 init_complete bucket index max shards: 11 2024-09-14T11:03:59.400 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.400+0000 7fc392b44800 20 Filter name: none 2024-09-14T11:03:59.400 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.400+0000 7fc1bdffb640 20 reqs_thread_entry: start 2024-09-14T11:03:59.400 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.400+0000 7fc392b44800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.401+0000 7fc392b44800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:03:59.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.401+0000 7fc392b44800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.401+0000 7fc392b44800 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:03:59.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.401+0000 7fc392b44800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:03:59.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.401+0000 7fc392b44800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.401+0000 7fc392b44800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:03:59.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.402+0000 7fc392b44800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.402+0000 7fc392b44800 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:03:59.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.402+0000 7fc392b44800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:03:59.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.403+0000 7fc2457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:59.404 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.406+0000 7fc392b44800 20 remove_watcher() i=0 2024-09-14T11:03:59.404 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.406+0000 7fc392b44800 2 removed watcher, disabling cache 2024-09-14T11:03:59.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.407+0000 7fc392b44800 20 remove_watcher() i=1 2024-09-14T11:03:59.406 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.408+0000 7fc392b44800 20 remove_watcher() i=2 2024-09-14T11:03:59.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.409+0000 7fc392b44800 20 remove_watcher() i=3 2024-09-14T11:03:59.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.410+0000 7fc392b44800 20 remove_watcher() i=4 2024-09-14T11:03:59.409 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.411+0000 7fc392b44800 20 remove_watcher() i=5 2024-09-14T11:03:59.410 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.411+0000 7fc392b44800 20 remove_watcher() i=6 2024-09-14T11:03:59.411 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.412+0000 7fc392b44800 20 remove_watcher() i=7 2024-09-14T11:03:59.422 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:59.422 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:03:59.422 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: abort-at-trim-reshard-log-entries id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:03:59.422 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:03:59.473 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:03:59.505 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:03:59.505 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:03:59.541 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.542+0000 7f8d31e14800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.544+0000 7f8d31e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:59.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.544+0000 7f8d31e14800 20 realm 2024-09-14T11:03:59.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.544+0000 7f8d31e14800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.544+0000 7f8d31e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:59.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.544+0000 7f8d31e14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:03:59.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.544+0000 7f8d31e14800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.544+0000 7f8d31e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:59.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.544+0000 7f8d31e14800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.544 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.545+0000 7f8d31e14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:59.544 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.545+0000 7f8d31e14800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.544 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.546+0000 7f8d31e14800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:03:59.544 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.546+0000 7f8d31e14800 20 searching for the correct realm 2024-09-14T11:03:59.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.548+0000 7f8d2dccc640 0 -- 172.21.15.97:0/3214047146 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f8d18045940 msgr2=0x7f8d18037410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:03:59.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.753+0000 7f8d24cca640 0 -- 172.21.15.97:0/3214047146 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f8d2001c390 msgr2=0x7f8d2001c810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:03:59.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.758+0000 7f8d31e14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:03:59.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.758+0000 7f8d31e14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:03:59.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.758+0000 7f8d31e14800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:03:59.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.758+0000 7f8d31e14800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:03:59.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.758+0000 7f8d31e14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:03:59.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.758+0000 7f8d31e14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:03:59.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.758+0000 7f8d31e14800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.758+0000 7f8d31e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:59.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.758+0000 7f8d31e14800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.758+0000 7f8d31e14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:59.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.758+0000 7f8d31e14800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.759+0000 7f8d31e14800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:03:59.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.759+0000 7f8d31e14800 20 zone default found 2024-09-14T11:03:59.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.759+0000 7f8d31e14800 4 Realm: () 2024-09-14T11:03:59.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.759+0000 7f8d31e14800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:03:59.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.759+0000 7f8d31e14800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:03:59.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.759+0000 7f8d31e14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:03:59.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.759+0000 7f8d31e14800 20 zonegroup default 2024-09-14T11:03:59.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.759+0000 7f8d31e14800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.759+0000 7f8d31e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:59.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.759+0000 7f8d31e14800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.759+0000 7f8d31e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:59.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.759+0000 7f8d31e14800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.759+0000 7f8d31e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:59.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.759+0000 7f8d31e14800 20 started sync module instance, tier type = 2024-09-14T11:03:59.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.759+0000 7f8d31e14800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:03:59.766 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.768+0000 7f8d31e14800 20 add_watcher() i=0 2024-09-14T11:03:59.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.768+0000 7f8d31e14800 20 add_watcher() i=1 2024-09-14T11:03:59.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.768+0000 7f8d31e14800 20 add_watcher() i=2 2024-09-14T11:03:59.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.768+0000 7f8d31e14800 20 add_watcher() i=3 2024-09-14T11:03:59.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.768+0000 7f8d31e14800 20 add_watcher() i=4 2024-09-14T11:03:59.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.768+0000 7f8d31e14800 20 add_watcher() i=5 2024-09-14T11:03:59.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.768+0000 7f8d31e14800 20 add_watcher() i=6 2024-09-14T11:03:59.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.769+0000 7f8d31e14800 20 add_watcher() i=7 2024-09-14T11:03:59.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.769+0000 7f8d31e14800 2 all 8 watchers are set, enabling cache 2024-09-14T11:03:59.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.771+0000 7f8be37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:59.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.771+0000 7f8d31e14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:03:59.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.771+0000 7f8d31e14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:03:59.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.771+0000 7f8d31e14800 5 note: GC not initialized 2024-09-14T11:03:59.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.771+0000 7f8be27e4640 20 reqs_thread_entry: start 2024-09-14T11:03:59.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.771+0000 7f8d31e14800 20 init_complete bucket index max shards: 11 2024-09-14T11:03:59.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.771+0000 7f8d31e14800 20 Filter name: none 2024-09-14T11:03:59.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.772+0000 7f8b53fff640 20 reqs_thread_entry: start 2024-09-14T11:03:59.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.772+0000 7f8d31e14800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:03:59.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.772+0000 7f8d31e14800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.772+0000 7f8d31e14800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:03:59.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.772+0000 7f8d31e14800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:03:59.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.772+0000 7f8d31e14800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:03:59.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.772+0000 7f8d31e14800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 : miss 2024-09-14T11:03:59.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.772+0000 7f8d31e14800 20 rados->read ofs=0 len=0 2024-09-14T11:03:59.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.772+0000 7f8d31e14800 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:03:59.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.772+0000 7f8d31e14800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 info.flags=0x17 2024-09-14T11:03:59.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.772+0000 7f8d31e14800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 to cache LRU end 2024-09-14T11:03:59.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.772+0000 7f8d31e14800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:03:59.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.772+0000 7f8d31e14800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:03:59.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.772+0000 7f8d31e14800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 2024-09-14T11:03:59.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.773+0000 7f8d31e14800 0 INFO: RGWReshardLock::lock found lock on abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 to be held by another RGW process; skipping for now 2024-09-14T11:03:59.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.775+0000 7f8be37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:59.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.777+0000 7f8d31e14800 20 remove_watcher() i=0 2024-09-14T11:03:59.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.777+0000 7f8d31e14800 2 removed watcher, disabling cache 2024-09-14T11:03:59.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.778+0000 7f8d31e14800 20 remove_watcher() i=1 2024-09-14T11:03:59.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.779+0000 7f8d31e14800 20 remove_watcher() i=2 2024-09-14T11:03:59.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.780+0000 7f8d31e14800 20 remove_watcher() i=3 2024-09-14T11:03:59.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.781+0000 7f8d31e14800 20 remove_watcher() i=4 2024-09-14T11:03:59.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.782+0000 7f8d31e14800 20 remove_watcher() i=5 2024-09-14T11:03:59.781 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.783+0000 7f8d31e14800 20 remove_watcher() i=6 2024-09-14T11:03:59.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:03:59.784+0000 7f8d31e14800 20 remove_watcher() i=7 2024-09-14T11:03:59.792 INFO:tasks.workunit.client.0.smithi097.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:04:29.819 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:04:29.856 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:04:29.856 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:04:29.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.900+0000 7fd7b3b75800 20 rados->read ofs=0 len=0 2024-09-14T11:04:29.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.902+0000 7fd7b3b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:29.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.902+0000 7fd7b3b75800 20 realm 2024-09-14T11:04:29.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.902+0000 7fd7b3b75800 20 rados->read ofs=0 len=0 2024-09-14T11:04:29.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.902+0000 7fd7b3b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:29.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.902+0000 7fd7b3b75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:04:29.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.902+0000 7fd7b3b75800 20 rados->read ofs=0 len=0 2024-09-14T11:04:29.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.902+0000 7fd7b3b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:29.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.902+0000 7fd7b3b75800 20 rados->read ofs=0 len=0 2024-09-14T11:04:29.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.903+0000 7fd7b3b75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:04:29.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.903+0000 7fd7b3b75800 20 rados->read ofs=0 len=0 2024-09-14T11:04:29.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.904+0000 7fd7b3b75800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:04:29.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.904+0000 7fd7b3b75800 20 searching for the correct realm 2024-09-14T11:04:29.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.906+0000 7fd7a8e5e640 0 -- 172.21.15.97:0/3128628243 >> [v2:172.21.15.97:6808/2081705332,v1:172.21.15.97:6809/2081705332] conn(0x7fd7a4022070 msgr2=0x7fd7a40379b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:04:29.908 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.910+0000 7fd7b165f640 0 -- 172.21.15.97:0/3128628243 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7fd79c0933c0 msgr2=0x7fd79c093840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:04:29.914 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.916+0000 7fd7b3b75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:04:29.915 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.916+0000 7fd7b3b75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:04:29.915 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.916+0000 7fd7b3b75800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:04:29.915 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.916+0000 7fd7b3b75800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:04:29.915 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.916+0000 7fd7b3b75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:04:29.915 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.916+0000 7fd7b3b75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:04:29.915 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.916+0000 7fd7b3b75800 20 rados->read ofs=0 len=0 2024-09-14T11:04:29.915 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.916+0000 7fd7b3b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:29.915 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.916+0000 7fd7b3b75800 20 rados->read ofs=0 len=0 2024-09-14T11:04:29.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.916+0000 7fd7b3b75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:04:29.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.916+0000 7fd7b3b75800 20 rados->read ofs=0 len=0 2024-09-14T11:04:29.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.917+0000 7fd7b3b75800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:04:29.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.917+0000 7fd7b3b75800 20 zone default found 2024-09-14T11:04:29.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.917+0000 7fd7b3b75800 4 Realm: () 2024-09-14T11:04:29.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.917+0000 7fd7b3b75800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:04:29.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.917+0000 7fd7b3b75800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:04:29.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.917+0000 7fd7b3b75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:04:29.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.917+0000 7fd7b3b75800 20 zonegroup default 2024-09-14T11:04:29.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.917+0000 7fd7b3b75800 20 rados->read ofs=0 len=0 2024-09-14T11:04:29.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.917+0000 7fd7b3b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:29.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.917+0000 7fd7b3b75800 20 rados->read ofs=0 len=0 2024-09-14T11:04:29.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.917+0000 7fd7b3b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:29.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.917+0000 7fd7b3b75800 20 rados->read ofs=0 len=0 2024-09-14T11:04:29.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.918+0000 7fd7b3b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:29.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.918+0000 7fd7b3b75800 20 started sync module instance, tier type = 2024-09-14T11:04:29.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.918+0000 7fd7b3b75800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:04:29.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.927+0000 7fd7b3b75800 20 add_watcher() i=0 2024-09-14T11:04:29.926 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.927+0000 7fd7b3b75800 20 add_watcher() i=1 2024-09-14T11:04:29.926 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.927+0000 7fd7b3b75800 20 add_watcher() i=2 2024-09-14T11:04:29.926 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.927+0000 7fd7b3b75800 20 add_watcher() i=3 2024-09-14T11:04:29.926 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.927+0000 7fd7b3b75800 20 add_watcher() i=4 2024-09-14T11:04:29.926 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.927+0000 7fd7b3b75800 20 add_watcher() i=5 2024-09-14T11:04:29.926 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.927+0000 7fd7b3b75800 20 add_watcher() i=6 2024-09-14T11:04:29.927 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.928+0000 7fd7b3b75800 20 add_watcher() i=7 2024-09-14T11:04:29.927 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.928+0000 7fd7b3b75800 2 all 8 watchers are set, enabling cache 2024-09-14T11:04:29.928 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.929+0000 7fd6677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:04:29.930 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.930+0000 7fd7b3b75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:04:29.930 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.930+0000 7fd7b3b75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:04:29.930 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.930+0000 7fd7b3b75800 5 note: GC not initialized 2024-09-14T11:04:29.930 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.930+0000 7fd6667e4640 20 reqs_thread_entry: start 2024-09-14T11:04:29.930 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.930+0000 7fd7b3b75800 20 init_complete bucket index max shards: 11 2024-09-14T11:04:29.930 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.930+0000 7fd7b3b75800 20 Filter name: none 2024-09-14T11:04:29.930 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.930+0000 7fd5d7fff640 20 reqs_thread_entry: start 2024-09-14T11:04:29.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.930+0000 7fd7b3b75800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:04:29.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.930+0000 7fd7b3b75800 20 rados->read ofs=0 len=0 2024-09-14T11:04:29.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.931+0000 7fd7b3b75800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:04:29.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.931+0000 7fd7b3b75800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:04:29.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.931+0000 7fd7b3b75800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:04:29.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.931+0000 7fd7b3b75800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 : miss 2024-09-14T11:04:29.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.931+0000 7fd7b3b75800 20 rados->read ofs=0 len=0 2024-09-14T11:04:29.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.931+0000 7fd7b3b75800 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:04:29.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.931+0000 7fd7b3b75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 info.flags=0x17 2024-09-14T11:04:29.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.931+0000 7fd7b3b75800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 to cache LRU end 2024-09-14T11:04:29.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.931+0000 7fd7b3b75800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:04:29.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.931+0000 7fd7b3b75800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:04:29.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.931+0000 7fd7b3b75800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 2024-09-14T11:04:29.932 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.933+0000 7fd7b3b75800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:04:29.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.939+0000 7fd7b3b75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 info.flags=0x17 2024-09-14T11:04:29.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.939+0000 7fd7b3b75800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 to cache LRU end 2024-09-14T11:04:29.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.939+0000 7fd7b3b75800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:04:29.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.939+0000 7fd7b3b75800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27, ofs0, ns] 2024-09-14T11:04:29.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.939+0000 7fd683fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595186 cookie 94427909647456 notifier 6584 bl.length()=939 2024-09-14T11:04:29.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.939+0000 7fd683fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 info.flags=0x17 2024-09-14T11:04:29.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.939+0000 7fd683fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 to cache LRU end 2024-09-14T11:04:29.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.939+0000 7fd683fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:04:29.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.939+0000 7fd7b3b75800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27]): orig_sources= new_sources= 2024-09-14T11:04:29.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.939+0000 7fd7b3b75800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27]): potential sources added=[] removed=[] 2024-09-14T11:04:29.939 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.939+0000 7fd7b3b75800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27]): orig_dests= new_dests= 2024-09-14T11:04:29.939 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.939+0000 7fd7b3b75800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27]): potential dests added=[] removed=[] 2024-09-14T11:04:29.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.944+0000 7fd7b3b75800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27.2.0 2024-09-14T11:04:29.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.944+0000 7fd7b3b75800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27.2.0 2024-09-14T11:04:29.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.944+0000 7fd7b3b75800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27.2.1 2024-09-14T11:04:29.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.944+0000 7fd7b3b75800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27.2.1 2024-09-14T11:04:29.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.944+0000 7fd7b3b75800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27.2.2 2024-09-14T11:04:29.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.944+0000 7fd7b3b75800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27.2.2 2024-09-14T11:04:29.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.944+0000 7fd7b3b75800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27.2.3 2024-09-14T11:04:29.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.944+0000 7fd7b3b75800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27.2.3 2024-09-14T11:04:29.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.944+0000 7fd7b3b75800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27.2.4 2024-09-14T11:04:29.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.944+0000 7fd7b3b75800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27.2.4 2024-09-14T11:04:29.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.944+0000 7fd7b3b75800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27.2.5 2024-09-14T11:04:29.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.944+0000 7fd7b3b75800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27.2.5 2024-09-14T11:04:29.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.944+0000 7fd7b3b75800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27.2.6 2024-09-14T11:04:29.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.944+0000 7fd7b3b75800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27.2.6 2024-09-14T11:04:29.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.944+0000 7fd7b3b75800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27.2.7 2024-09-14T11:04:29.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.944+0000 7fd7b3b75800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27.2.7 2024-09-14T11:04:29.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.944+0000 7fd7b3b75800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27.2.8 2024-09-14T11:04:29.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.944+0000 7fd7b3b75800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27.2.8 2024-09-14T11:04:29.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.944+0000 7fd7b3b75800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27.2.9 2024-09-14T11:04:29.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.944+0000 7fd7b3b75800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27.2.9 2024-09-14T11:04:29.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.944+0000 7fd7b3b75800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27.2.10 2024-09-14T11:04:29.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.944+0000 7fd7b3b75800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27.2.10 2024-09-14T11:04:29.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.944+0000 7fd7b3b75800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27.2.11 2024-09-14T11:04:29.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.944+0000 7fd7b3b75800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27.2.11 2024-09-14T11:04:29.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.944+0000 7fd7b3b75800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27.0 2024-09-14T11:04:29.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.944+0000 7fd7b3b75800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27.1 2024-09-14T11:04:29.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.945+0000 7fd7b3b75800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27.2 2024-09-14T11:04:29.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.946+0000 7fd7b3b75800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27.3 2024-09-14T11:04:29.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.946+0000 7fd7b3b75800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27.4 2024-09-14T11:04:29.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.946+0000 7fd7b3b75800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27.5 2024-09-14T11:04:29.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.947+0000 7fd7b3b75800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27.6 2024-09-14T11:04:29.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.947+0000 7fd7b3b75800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27.7 2024-09-14T11:04:29.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.948+0000 7fd7b3b75800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27.8 2024-09-14T11:04:29.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.948+0000 7fd7b3b75800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27.9 2024-09-14T11:04:29.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.949+0000 7fd7b3b75800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27.10 2024-09-14T11:04:29.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.952+0000 7fd7b3b75800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 : hit (requested=0x17, cached=0x17) 2024-09-14T11:04:29.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.952+0000 7fd7b3b75800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 2024-09-14T11:04:29.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.953+0000 7fd7b3b75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 info.flags=0x17 2024-09-14T11:04:29.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.953+0000 7fd7b3b75800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 to cache LRU end 2024-09-14T11:04:29.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.953+0000 7fd7b3b75800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:04:29.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.953+0000 7fd7b3b75800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27, ofs0, ns] 2024-09-14T11:04:29.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.953+0000 7fd683fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595187 cookie 94427909647456 notifier 6584 bl.length()=939 2024-09-14T11:04:29.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.953+0000 7fd683fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 info.flags=0x17 2024-09-14T11:04:29.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.953+0000 7fd683fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 to cache LRU end 2024-09-14T11:04:29.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.953+0000 7fd683fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:04:29.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.954+0000 7fd7b3b75800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27]): orig_sources= new_sources= 2024-09-14T11:04:29.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.954+0000 7fd7b3b75800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27]): potential sources added=[] removed=[] 2024-09-14T11:04:29.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.954+0000 7fd7b3b75800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27]): orig_dests= new_dests= 2024-09-14T11:04:29.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.954+0000 7fd7b3b75800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27]): potential dests added=[] removed=[] 2024-09-14T11:04:29.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.956+0000 7fd7b3b75800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27.0 2024-09-14T11:04:29.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.956+0000 7fd7b3b75800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27.1 2024-09-14T11:04:29.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.957+0000 7fd7b3b75800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27.2 2024-09-14T11:04:29.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.957+0000 7fd7b3b75800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27.3 2024-09-14T11:04:29.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.957+0000 7fd7b3b75800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27.4 2024-09-14T11:04:29.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.958+0000 7fd7b3b75800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27.5 2024-09-14T11:04:29.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.958+0000 7fd7b3b75800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27.6 2024-09-14T11:04:29.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.958+0000 7fd7b3b75800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27.7 2024-09-14T11:04:29.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.958+0000 7fd7b3b75800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27.8 2024-09-14T11:04:29.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.959+0000 7fd7b3b75800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27.9 2024-09-14T11:04:29.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.959+0000 7fd7b3b75800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27.10 2024-09-14T11:04:29.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.959+0000 7fd7b3b75800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 : hit (requested=0x17, cached=0x17) 2024-09-14T11:04:29.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.959+0000 7fd7b3b75800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 2024-09-14T11:04:29.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.960+0000 7fd7b3b75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 info.flags=0x17 2024-09-14T11:04:29.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.960+0000 7fd7b3b75800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 to cache LRU end 2024-09-14T11:04:29.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.960+0000 7fd7b3b75800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:04:29.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.960+0000 7fd7b3b75800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27, ofs0, ns] 2024-09-14T11:04:29.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.961+0000 7fd694ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595188 cookie 94427909647456 notifier 6584 bl.length()=907 2024-09-14T11:04:29.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.961+0000 7fd694ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 info.flags=0x17 2024-09-14T11:04:29.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.961+0000 7fd694ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 to cache LRU end 2024-09-14T11:04:29.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.961+0000 7fd694ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:04:29.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.961+0000 7fd7b3b75800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27]): orig_sources= new_sources= 2024-09-14T11:04:29.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.961+0000 7fd7b3b75800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27]): potential sources added=[] removed=[] 2024-09-14T11:04:29.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.961+0000 7fd7b3b75800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27]): orig_dests= new_dests= 2024-09-14T11:04:29.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.961+0000 7fd7b3b75800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27]): potential dests added=[] removed=[] 2024-09-14T11:04:29.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.963+0000 7fd7b3b75800 1 execute INFO: reshard of bucket "abort-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-14T11:04:29.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.965+0000 7fd6677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:04:29.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.967+0000 7fd7b3b75800 20 remove_watcher() i=0 2024-09-14T11:04:29.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.967+0000 7fd7b3b75800 2 removed watcher, disabling cache 2024-09-14T11:04:29.967 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.968+0000 7fd7b3b75800 20 remove_watcher() i=1 2024-09-14T11:04:29.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.969+0000 7fd7b3b75800 20 remove_watcher() i=2 2024-09-14T11:04:29.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.970+0000 7fd7b3b75800 20 remove_watcher() i=3 2024-09-14T11:04:29.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.971+0000 7fd7b3b75800 20 remove_watcher() i=4 2024-09-14T11:04:29.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.972+0000 7fd7b3b75800 20 remove_watcher() i=5 2024-09-14T11:04:29.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.973+0000 7fd7b3b75800 20 remove_watcher() i=6 2024-09-14T11:04:29.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:29.974+0000 7fd7b3b75800 20 remove_watcher() i=7 2024-09-14T11:04:29.985 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-14T11:04:30.013 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:04:30.013 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:04:30.050 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.051+0000 7ff293e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:04:30.052 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.053+0000 7ff293e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:30.052 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.053+0000 7ff293e2f800 20 realm 2024-09-14T11:04:30.052 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.053+0000 7ff293e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:04:30.052 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.053+0000 7ff293e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:30.053 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.053+0000 7ff293e2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:04:30.053 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.053+0000 7ff293e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:04:30.053 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.054+0000 7ff293e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:30.053 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.054+0000 7ff293e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:04:30.053 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.054+0000 7ff293e2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:04:30.053 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.054+0000 7ff293e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:04:30.054 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.055+0000 7ff293e2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:04:30.054 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.055+0000 7ff293e2f800 20 searching for the correct realm 2024-09-14T11:04:30.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.057+0000 7ff29211a640 0 -- 172.21.15.97:0/1244545684 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7ff288049880 msgr2=0x7ff288093ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:04:30.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.263+0000 7ff291118640 0 -- 172.21.15.97:0/1244545684 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7ff284090040 msgr2=0x7ff284066620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:04:30.267 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.268+0000 7ff293e2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:04:30.267 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.268+0000 7ff293e2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:04:30.267 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.268+0000 7ff293e2f800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:04:30.267 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.268+0000 7ff293e2f800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:04:30.267 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.268+0000 7ff293e2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:04:30.267 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.268+0000 7ff293e2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:04:30.267 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.268+0000 7ff293e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:04:30.267 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.268+0000 7ff293e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:30.268 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.268+0000 7ff293e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:04:30.268 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.269+0000 7ff293e2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:04:30.268 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.269+0000 7ff293e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:04:30.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.269+0000 7ff293e2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:04:30.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.269+0000 7ff293e2f800 20 zone default found 2024-09-14T11:04:30.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.269+0000 7ff293e2f800 4 Realm: () 2024-09-14T11:04:30.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.269+0000 7ff293e2f800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:04:30.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.269+0000 7ff293e2f800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:04:30.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.269+0000 7ff293e2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:04:30.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.269+0000 7ff293e2f800 20 zonegroup default 2024-09-14T11:04:30.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.269+0000 7ff293e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:04:30.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.269+0000 7ff293e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:30.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.269+0000 7ff293e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:04:30.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.270+0000 7ff293e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:30.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.270+0000 7ff293e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:04:30.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.270+0000 7ff293e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:30.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.270+0000 7ff293e2f800 20 started sync module instance, tier type = 2024-09-14T11:04:30.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.270+0000 7ff293e2f800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:04:30.278 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.279+0000 7ff293e2f800 20 add_watcher() i=0 2024-09-14T11:04:30.278 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.279+0000 7ff293e2f800 20 add_watcher() i=1 2024-09-14T11:04:30.278 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.279+0000 7ff293e2f800 20 add_watcher() i=2 2024-09-14T11:04:30.278 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.279+0000 7ff293e2f800 20 add_watcher() i=3 2024-09-14T11:04:30.278 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.279+0000 7ff293e2f800 20 add_watcher() i=4 2024-09-14T11:04:30.279 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.279+0000 7ff293e2f800 20 add_watcher() i=5 2024-09-14T11:04:30.279 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.280+0000 7ff293e2f800 20 add_watcher() i=6 2024-09-14T11:04:30.279 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.281+0000 7ff293e2f800 20 add_watcher() i=7 2024-09-14T11:04:30.279 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.281+0000 7ff293e2f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:04:30.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.283+0000 7ff1437fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:04:30.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.283+0000 7ff293e2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:04:30.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.283+0000 7ff293e2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:04:30.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.283+0000 7ff293e2f800 5 note: GC not initialized 2024-09-14T11:04:30.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.284+0000 7ff1427fc640 20 reqs_thread_entry: start 2024-09-14T11:04:30.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.284+0000 7ff293e2f800 20 init_complete bucket index max shards: 11 2024-09-14T11:04:30.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.284+0000 7ff293e2f800 20 Filter name: none 2024-09-14T11:04:30.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.284+0000 7ff0b3fff640 20 reqs_thread_entry: start 2024-09-14T11:04:30.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.284+0000 7ff293e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:04:30.284 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.284+0000 7ff293e2f800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:04:30.284 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.284+0000 7ff293e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:04:30.284 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.285+0000 7ff293e2f800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:04:30.284 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.285+0000 7ff293e2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:04:30.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.285+0000 7ff293e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:04:30.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.285+0000 7ff293e2f800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:04:30.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.285+0000 7ff293e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:04:30.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.285+0000 7ff293e2f800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:04:30.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.285+0000 7ff293e2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:04:30.286 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.287+0000 7ff1437fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:04:30.288 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.289+0000 7ff293e2f800 20 remove_watcher() i=0 2024-09-14T11:04:30.288 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.289+0000 7ff293e2f800 2 removed watcher, disabling cache 2024-09-14T11:04:30.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.290+0000 7ff293e2f800 20 remove_watcher() i=1 2024-09-14T11:04:30.290 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.291+0000 7ff293e2f800 20 remove_watcher() i=2 2024-09-14T11:04:30.291 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.292+0000 7ff293e2f800 20 remove_watcher() i=3 2024-09-14T11:04:30.292 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.294+0000 7ff293e2f800 20 remove_watcher() i=4 2024-09-14T11:04:30.293 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.295+0000 7ff293e2f800 20 remove_watcher() i=5 2024-09-14T11:04:30.294 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.296+0000 7ff293e2f800 20 remove_watcher() i=6 2024-09-14T11:04:30.295 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.297+0000 7ff293e2f800 20 remove_watcher() i=7 2024-09-14T11:04:30.306 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:04:30.306 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:04:30.306 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: abort-at-trim-reshard-log-entries id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:04:30.306 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:04:30.382 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-09-14T11:04:30.383 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:04:30.584 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-14T11:04:30.612 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:04:30.612 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:04:30.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.650+0000 7f3f0ed39800 20 rados->read ofs=0 len=0 2024-09-14T11:04:30.651 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.652+0000 7f3f0ed39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:30.651 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.652+0000 7f3f0ed39800 20 realm 2024-09-14T11:04:30.651 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.652+0000 7f3f0ed39800 20 rados->read ofs=0 len=0 2024-09-14T11:04:30.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.652+0000 7f3f0ed39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:30.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.652+0000 7f3f0ed39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:04:30.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.652+0000 7f3f0ed39800 20 rados->read ofs=0 len=0 2024-09-14T11:04:30.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.652+0000 7f3f0ed39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:30.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.652+0000 7f3f0ed39800 20 rados->read ofs=0 len=0 2024-09-14T11:04:30.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.653+0000 7f3f0ed39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:04:30.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.653+0000 7f3f0ed39800 20 rados->read ofs=0 len=0 2024-09-14T11:04:30.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.654+0000 7f3f0ed39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:04:30.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.654+0000 7f3f0ed39800 20 searching for the correct realm 2024-09-14T11:04:30.654 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.656+0000 7f3f0b1c8640 0 -- 172.21.15.97:0/3119779870 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f3ef407d040 msgr2=0x7f3ef40b9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:04:30.860 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.861+0000 7f3f03fff640 0 -- 172.21.15.97:0/3119779870 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f3efc071040 msgr2=0x7f3efc069960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:04:30.864 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.865+0000 7f3f0ed39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:04:30.864 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.865+0000 7f3f0ed39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:04:30.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.865+0000 7f3f0ed39800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:04:30.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.865+0000 7f3f0ed39800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:04:30.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.865+0000 7f3f0ed39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:04:30.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.865+0000 7f3f0ed39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:04:30.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.865+0000 7f3f0ed39800 20 rados->read ofs=0 len=0 2024-09-14T11:04:30.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.866+0000 7f3f0ed39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:30.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.866+0000 7f3f0ed39800 20 rados->read ofs=0 len=0 2024-09-14T11:04:30.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.866+0000 7f3f0ed39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:04:30.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.866+0000 7f3f0ed39800 20 rados->read ofs=0 len=0 2024-09-14T11:04:30.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.866+0000 7f3f0ed39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:04:30.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.866+0000 7f3f0ed39800 20 zone default found 2024-09-14T11:04:30.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.866+0000 7f3f0ed39800 4 Realm: () 2024-09-14T11:04:30.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.866+0000 7f3f0ed39800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:04:30.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.866+0000 7f3f0ed39800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:04:30.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.866+0000 7f3f0ed39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:04:30.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.866+0000 7f3f0ed39800 20 zonegroup default 2024-09-14T11:04:30.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.866+0000 7f3f0ed39800 20 rados->read ofs=0 len=0 2024-09-14T11:04:30.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.867+0000 7f3f0ed39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:30.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.867+0000 7f3f0ed39800 20 rados->read ofs=0 len=0 2024-09-14T11:04:30.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.867+0000 7f3f0ed39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:30.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.867+0000 7f3f0ed39800 20 rados->read ofs=0 len=0 2024-09-14T11:04:30.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.868+0000 7f3f0ed39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:30.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.868+0000 7f3f0ed39800 20 started sync module instance, tier type = 2024-09-14T11:04:30.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.868+0000 7f3f0ed39800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:04:30.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.876+0000 7f3f0ed39800 20 add_watcher() i=0 2024-09-14T11:04:30.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.876+0000 7f3f0ed39800 20 add_watcher() i=1 2024-09-14T11:04:30.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.876+0000 7f3f0ed39800 20 add_watcher() i=2 2024-09-14T11:04:30.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.876+0000 7f3f0ed39800 20 add_watcher() i=3 2024-09-14T11:04:30.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.876+0000 7f3f0ed39800 20 add_watcher() i=4 2024-09-14T11:04:30.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.876+0000 7f3f0ed39800 20 add_watcher() i=5 2024-09-14T11:04:30.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.876+0000 7f3f0ed39800 20 add_watcher() i=6 2024-09-14T11:04:30.876 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.877+0000 7f3f0ed39800 20 add_watcher() i=7 2024-09-14T11:04:30.876 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.877+0000 7f3f0ed39800 2 all 8 watchers are set, enabling cache 2024-09-14T11:04:30.877 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.878+0000 7f3dc17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:04:30.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.879+0000 7f3f0ed39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:04:30.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.879+0000 7f3f0ed39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:04:30.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.879+0000 7f3f0ed39800 5 note: GC not initialized 2024-09-14T11:04:30.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.879+0000 7f3d3bfff640 20 reqs_thread_entry: start 2024-09-14T11:04:30.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.879+0000 7f3f0ed39800 20 init_complete bucket index max shards: 11 2024-09-14T11:04:30.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.879+0000 7f3f0ed39800 20 Filter name: none 2024-09-14T11:04:30.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.879+0000 7f3d39ffb640 20 reqs_thread_entry: start 2024-09-14T11:04:30.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.879+0000 7f3f0ed39800 20 rados->read ofs=0 len=0 2024-09-14T11:04:30.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.880+0000 7f3f0ed39800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:04:30.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.880+0000 7f3f0ed39800 20 rados->read ofs=0 len=0 2024-09-14T11:04:30.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.880+0000 7f3f0ed39800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:04:30.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.880+0000 7f3f0ed39800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:04:30.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.880+0000 7f3f0ed39800 20 rados->read ofs=0 len=0 2024-09-14T11:04:30.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.881+0000 7f3f0ed39800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:04:30.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.881+0000 7f3f0ed39800 20 rados->read ofs=0 len=0 2024-09-14T11:04:30.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.881+0000 7f3f0ed39800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:04:30.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.881+0000 7f3f0ed39800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:04:30.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.883+0000 7f3dc17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:04:30.883 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.885+0000 7f3f0ed39800 20 remove_watcher() i=0 2024-09-14T11:04:30.883 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.885+0000 7f3f0ed39800 2 removed watcher, disabling cache 2024-09-14T11:04:30.884 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.885+0000 7f3f0ed39800 20 remove_watcher() i=1 2024-09-14T11:04:30.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.887+0000 7f3f0ed39800 20 remove_watcher() i=2 2024-09-14T11:04:30.886 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.887+0000 7f3f0ed39800 20 remove_watcher() i=3 2024-09-14T11:04:30.887 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.888+0000 7f3f0ed39800 20 remove_watcher() i=4 2024-09-14T11:04:30.888 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.889+0000 7f3f0ed39800 20 remove_watcher() i=5 2024-09-14T11:04:30.888 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.890+0000 7f3f0ed39800 20 remove_watcher() i=6 2024-09-14T11:04:30.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.891+0000 7f3f0ed39800 20 remove_watcher() i=7 2024-09-14T11:04:30.900 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:04:30.900 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:04:30.900 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-block-writes id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:04:30.900 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:04:30.901 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-09-14T11:04:30.935 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:04:30.935 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:04:30.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.974+0000 7fa0c752a800 20 rados->read ofs=0 len=0 2024-09-14T11:04:30.974 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.975+0000 7fa0c752a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:30.974 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.975+0000 7fa0c752a800 20 realm 2024-09-14T11:04:30.974 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.975+0000 7fa0c752a800 20 rados->read ofs=0 len=0 2024-09-14T11:04:30.974 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.976+0000 7fa0c752a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:30.974 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.976+0000 7fa0c752a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:04:30.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.976+0000 7fa0c752a800 20 rados->read ofs=0 len=0 2024-09-14T11:04:30.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.976+0000 7fa0c752a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:30.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.976+0000 7fa0c752a800 20 rados->read ofs=0 len=0 2024-09-14T11:04:30.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.976+0000 7fa0c752a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:04:30.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.976+0000 7fa0c752a800 20 rados->read ofs=0 len=0 2024-09-14T11:04:30.976 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.977+0000 7fa0c752a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:04:30.976 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.977+0000 7fa0c752a800 20 searching for the correct realm 2024-09-14T11:04:30.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.979+0000 7fa0c3161640 0 -- 172.21.15.97:0/4222130597 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x55b110576d20 msgr2=0x55b110579160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:04:30.980 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:30.982+0000 7fa0c3161640 0 -- 172.21.15.97:0/4222130597 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x7f9f8c086d00 msgr2=0x7f9f8c089130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:04:31.189 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.191+0000 7fa0c752a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:04:31.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.191+0000 7fa0c752a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:04:31.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.191+0000 7fa0c752a800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:04:31.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.191+0000 7fa0c752a800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:04:31.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.191+0000 7fa0c752a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:04:31.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.191+0000 7fa0c752a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:04:31.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.191+0000 7fa0c752a800 20 rados->read ofs=0 len=0 2024-09-14T11:04:31.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.191+0000 7fa0c752a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:31.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.191+0000 7fa0c752a800 20 rados->read ofs=0 len=0 2024-09-14T11:04:31.191 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.191+0000 7fa0c752a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:04:31.191 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.191+0000 7fa0c752a800 20 rados->read ofs=0 len=0 2024-09-14T11:04:31.191 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.192+0000 7fa0c752a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:04:31.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.192+0000 7fa0c752a800 20 zone default found 2024-09-14T11:04:31.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.192+0000 7fa0c752a800 4 Realm: () 2024-09-14T11:04:31.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.192+0000 7fa0c752a800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:04:31.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.192+0000 7fa0c752a800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:04:31.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.192+0000 7fa0c752a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:04:31.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.192+0000 7fa0c752a800 20 zonegroup default 2024-09-14T11:04:31.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.192+0000 7fa0c752a800 20 rados->read ofs=0 len=0 2024-09-14T11:04:31.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.192+0000 7fa0c752a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:31.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.192+0000 7fa0c752a800 20 rados->read ofs=0 len=0 2024-09-14T11:04:31.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.192+0000 7fa0c752a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:31.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.192+0000 7fa0c752a800 20 rados->read ofs=0 len=0 2024-09-14T11:04:31.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.193+0000 7fa0c752a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:31.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.193+0000 7fa0c752a800 20 started sync module instance, tier type = 2024-09-14T11:04:31.193 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.193+0000 7fa0c752a800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:04:31.199 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.201+0000 7fa0c752a800 20 add_watcher() i=0 2024-09-14T11:04:31.199 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.201+0000 7fa0c752a800 20 add_watcher() i=1 2024-09-14T11:04:31.199 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.201+0000 7fa0c752a800 20 add_watcher() i=2 2024-09-14T11:04:31.200 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.201+0000 7fa0c752a800 20 add_watcher() i=3 2024-09-14T11:04:31.200 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.201+0000 7fa0c752a800 20 add_watcher() i=4 2024-09-14T11:04:31.200 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.201+0000 7fa0c752a800 20 add_watcher() i=5 2024-09-14T11:04:31.200 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.201+0000 7fa0c752a800 20 add_watcher() i=6 2024-09-14T11:04:31.200 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.202+0000 7fa0c752a800 20 add_watcher() i=7 2024-09-14T11:04:31.200 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.202+0000 7fa0c752a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:04:31.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.203+0000 7f9f79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:04:31.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.204+0000 7fa0c752a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:04:31.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.204+0000 7fa0c752a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:04:31.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.204+0000 7fa0c752a800 5 note: GC not initialized 2024-09-14T11:04:31.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.204+0000 7f9f78fe1640 20 reqs_thread_entry: start 2024-09-14T11:04:31.204 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.204+0000 7fa0c752a800 20 init_complete bucket index max shards: 11 2024-09-14T11:04:31.204 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.204+0000 7fa0c752a800 20 Filter name: none 2024-09-14T11:04:31.204 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.204+0000 7f9ef27fc640 20 reqs_thread_entry: start 2024-09-14T11:04:31.204 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.204+0000 7fa0c752a800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-14T11:04:31.204 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.204+0000 7fa0c752a800 20 rados->read ofs=0 len=0 2024-09-14T11:04:31.204 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.205+0000 7fa0c752a800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:04:31.204 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.205+0000 7fa0c752a800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-14T11:04:31.204 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.205+0000 7fa0c752a800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-14T11:04:31.204 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.205+0000 7fa0c752a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28 : miss 2024-09-14T11:04:31.204 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.205+0000 7fa0c752a800 20 rados->read ofs=0 len=0 2024-09-14T11:04:31.205 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.205+0000 7fa0c752a800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:04:31.205 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.205+0000 7fa0c752a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28 info.flags=0x17 2024-09-14T11:04:31.205 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.205+0000 7fa0c752a800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28 to cache LRU end 2024-09-14T11:04:31.205 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.205+0000 7fa0c752a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:04:31.205 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.205+0000 7fa0c752a800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:04:31.205 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.205+0000 7fa0c752a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28 2024-09-14T11:04:31.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.211+0000 7fa0c752a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28 info.flags=0x17 2024-09-14T11:04:31.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.212+0000 7fa0c752a800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28 to cache LRU end 2024-09-14T11:04:31.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.212+0000 7fa0c752a800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:04:31.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.212+0000 7fa0c752a800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28, ofs0, ns] 2024-09-14T11:04:31.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.212+0000 7f9fa6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595110 cookie 94218971807680 notifier 7020 bl.length()=915 2024-09-14T11:04:31.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.212+0000 7f9fa6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28 info.flags=0x17 2024-09-14T11:04:31.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.212+0000 7f9fa6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28 to cache LRU end 2024-09-14T11:04:31.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.212+0000 7f9fa6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:04:31.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.212+0000 7fa0c752a800 20 handle_bi_update(): bucket=:error-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28]): orig_sources= new_sources= 2024-09-14T11:04:31.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.212+0000 7fa0c752a800 20 handle_bi_update(): bucket=:error-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28]): potential sources added=[] removed=[] 2024-09-14T11:04:31.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.212+0000 7fa0c752a800 20 handle_bi_update(): bucket=:error-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28]): orig_dests= new_dests= 2024-09-14T11:04:31.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.212+0000 7fa0c752a800 20 handle_bi_update(): bucket=:error-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28]): potential dests added=[] removed=[] 2024-09-14T11:04:31.216 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.217+0000 7fa0c752a800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.1.0 2024-09-14T11:04:31.216 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.217+0000 7fa0c752a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.1.0 2024-09-14T11:04:31.216 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.217+0000 7fa0c752a800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.1.1 2024-09-14T11:04:31.216 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.217+0000 7fa0c752a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.1.1 2024-09-14T11:04:31.216 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.217+0000 7fa0c752a800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.1.2 2024-09-14T11:04:31.216 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.217+0000 7fa0c752a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.1.2 2024-09-14T11:04:31.216 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.217+0000 7fa0c752a800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.1.3 2024-09-14T11:04:31.216 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.217+0000 7fa0c752a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.1.3 2024-09-14T11:04:31.216 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.217+0000 7fa0c752a800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.1.4 2024-09-14T11:04:31.216 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.217+0000 7fa0c752a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.1.4 2024-09-14T11:04:31.217 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.217+0000 7fa0c752a800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.1.5 2024-09-14T11:04:31.217 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.217+0000 7fa0c752a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.1.5 2024-09-14T11:04:31.217 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.217+0000 7fa0c752a800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.1.6 2024-09-14T11:04:31.217 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.217+0000 7fa0c752a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.1.6 2024-09-14T11:04:31.217 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.217+0000 7fa0c752a800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.1.7 2024-09-14T11:04:31.217 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.217+0000 7fa0c752a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.1.7 2024-09-14T11:04:31.217 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.217+0000 7fa0c752a800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.1.8 2024-09-14T11:04:31.217 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.217+0000 7fa0c752a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.1.8 2024-09-14T11:04:31.217 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.217+0000 7fa0c752a800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.1.9 2024-09-14T11:04:31.217 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.217+0000 7fa0c752a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.1.9 2024-09-14T11:04:31.217 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.217+0000 7fa0c752a800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.1.10 2024-09-14T11:04:31.217 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.217+0000 7fa0c752a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.1.10 2024-09-14T11:04:31.217 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.217+0000 7fa0c752a800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.1.11 2024-09-14T11:04:31.218 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.217+0000 7fa0c752a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.1.11 2024-09-14T11:04:31.218 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.217+0000 7fa0c752a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.0 2024-09-14T11:04:31.218 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.217+0000 7fa0c752a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.1 2024-09-14T11:04:31.218 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.218+0000 7fa0c752a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.2 2024-09-14T11:04:31.219 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.218+0000 7fa0c752a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.3 2024-09-14T11:04:31.219 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.219+0000 7fa0c752a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.4 2024-09-14T11:04:31.219 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.219+0000 7fa0c752a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.5 2024-09-14T11:04:31.219 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.220+0000 7fa0c752a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.6 2024-09-14T11:04:31.219 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.220+0000 7fa0c752a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.7 2024-09-14T11:04:31.219 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.221+0000 7fa0c752a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.8 2024-09-14T11:04:31.219 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.221+0000 7fa0c752a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.9 2024-09-14T11:04:31.220 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.221+0000 7fa0c752a800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.10 2024-09-14T11:04:31.223 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.225+0000 7fa0c752a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28 : hit (requested=0x17, cached=0x17) 2024-09-14T11:04:31.223 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.225+0000 7fa0c752a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28 2024-09-14T11:04:31.224 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.226+0000 7fa0c752a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28 info.flags=0x17 2024-09-14T11:04:31.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.226+0000 7fa0c752a800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28 to cache LRU end 2024-09-14T11:04:31.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.226+0000 7fa0c752a800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:04:31.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.226+0000 7fa0c752a800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28, ofs0, ns] 2024-09-14T11:04:31.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.226+0000 7f9fa6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595111 cookie 94218971807680 notifier 7020 bl.length()=915 2024-09-14T11:04:31.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.226+0000 7f9fa6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28 info.flags=0x17 2024-09-14T11:04:31.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.226+0000 7f9fa6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28 to cache LRU end 2024-09-14T11:04:31.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.226+0000 7f9fa6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:04:31.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.226+0000 7fa0c752a800 20 handle_bi_update(): bucket=:error-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28]): orig_sources= new_sources= 2024-09-14T11:04:31.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.226+0000 7fa0c752a800 20 handle_bi_update(): bucket=:error-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28]): potential sources added=[] removed=[] 2024-09-14T11:04:31.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.226+0000 7fa0c752a800 20 handle_bi_update(): bucket=:error-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28]): orig_dests= new_dests= 2024-09-14T11:04:31.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.226+0000 7fa0c752a800 20 handle_bi_update(): bucket=:error-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28]): potential dests added=[] removed=[] 2024-09-14T11:04:31.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.226+0000 7fa0c752a800 -1 Injecting error=-5 at location=block_writes 2024-09-14T11:04:31.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.226+0000 7fa0c752a800 0 ERROR: change_reshard_state failed to pause writes to the current index: (5) Input/output error 2024-09-14T11:04:31.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.231+0000 7fa0c752a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28 : hit (requested=0x17, cached=0x17) 2024-09-14T11:04:31.230 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.231+0000 7fa0c752a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28 2024-09-14T11:04:31.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.232+0000 7fa0c752a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28 info.flags=0x17 2024-09-14T11:04:31.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.232+0000 7fa0c752a800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28 to cache LRU end 2024-09-14T11:04:31.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.232+0000 7fa0c752a800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:04:31.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.232+0000 7fa0c752a800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28, ofs0, ns] 2024-09-14T11:04:31.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.232+0000 7f9fa67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595112 cookie 94218971807680 notifier 7020 bl.length()=883 2024-09-14T11:04:31.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.232+0000 7f9fa67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28 info.flags=0x17 2024-09-14T11:04:31.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.232+0000 7f9fa67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28 to cache LRU end 2024-09-14T11:04:31.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.232+0000 7f9fa67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:04:31.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.233+0000 7fa0c752a800 20 handle_bi_update(): bucket=:error-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28]): orig_sources= new_sources= 2024-09-14T11:04:31.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.233+0000 7fa0c752a800 20 handle_bi_update(): bucket=:error-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28]): potential sources added=[] removed=[] 2024-09-14T11:04:31.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.233+0000 7fa0c752a800 20 handle_bi_update(): bucket=:error-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28]): orig_dests= new_dests= 2024-09-14T11:04:31.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.233+0000 7fa0c752a800 20 handle_bi_update(): bucket=:error-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28]): potential dests added=[] removed=[] 2024-09-14T11:04:31.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.235+0000 7fa0c752a800 1 execute INFO: reshard of bucket "error-at-block-writes" canceled due to errors 2024-09-14T11:04:31.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.236+0000 7f9f79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:04:31.237 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.238+0000 7fa0c752a800 20 remove_watcher() i=0 2024-09-14T11:04:31.237 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.238+0000 7fa0c752a800 2 removed watcher, disabling cache 2024-09-14T11:04:31.238 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.239+0000 7fa0c752a800 20 remove_watcher() i=1 2024-09-14T11:04:31.239 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.240+0000 7fa0c752a800 20 remove_watcher() i=2 2024-09-14T11:04:31.240 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.241+0000 7fa0c752a800 20 remove_watcher() i=3 2024-09-14T11:04:31.241 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.242+0000 7fa0c752a800 20 remove_watcher() i=4 2024-09-14T11:04:31.241 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.243+0000 7fa0c752a800 20 remove_watcher() i=5 2024-09-14T11:04:31.243 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.244+0000 7fa0c752a800 20 remove_watcher() i=6 2024-09-14T11:04:31.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.245+0000 7fa0c752a800 20 remove_watcher() i=7 2024-09-14T11:04:31.255 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-14T11:04:31.283 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:04:31.283 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:04:31.321 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.323+0000 7fd1b6698800 20 rados->read ofs=0 len=0 2024-09-14T11:04:31.323 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.325+0000 7fd1b6698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:31.324 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.325+0000 7fd1b6698800 20 realm 2024-09-14T11:04:31.324 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.325+0000 7fd1b6698800 20 rados->read ofs=0 len=0 2024-09-14T11:04:31.324 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.325+0000 7fd1b6698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:31.324 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.325+0000 7fd1b6698800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:04:31.324 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.325+0000 7fd1b6698800 20 rados->read ofs=0 len=0 2024-09-14T11:04:31.324 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.325+0000 7fd1b6698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:31.324 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.325+0000 7fd1b6698800 20 rados->read ofs=0 len=0 2024-09-14T11:04:31.324 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.326+0000 7fd1b6698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:04:31.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.326+0000 7fd1b6698800 20 rados->read ofs=0 len=0 2024-09-14T11:04:31.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.327+0000 7fd1b6698800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:04:31.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.327+0000 7fd1b6698800 20 searching for the correct realm 2024-09-14T11:04:31.326 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.328+0000 7fd1b3981640 0 -- 172.21.15.97:0/1782084483 >> [v2:172.21.15.97:6808/2081705332,v1:172.21.15.97:6809/2081705332] conn(0x7fd1ac0be040 msgr2=0x7fd1ac0a3d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:04:31.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.534+0000 7fd1b4182640 0 -- 172.21.15.97:0/1782084483 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7fd19c08fe70 msgr2=0x7fd19c003970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:04:31.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.741+0000 7fd1b6698800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:04:31.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.741+0000 7fd1b6698800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:04:31.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.741+0000 7fd1b6698800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:04:31.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.741+0000 7fd1b6698800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:04:31.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.741+0000 7fd1b6698800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:04:31.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.741+0000 7fd1b6698800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:04:31.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.741+0000 7fd1b6698800 20 rados->read ofs=0 len=0 2024-09-14T11:04:31.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.742+0000 7fd1b6698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:31.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.742+0000 7fd1b6698800 20 rados->read ofs=0 len=0 2024-09-14T11:04:31.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.742+0000 7fd1b6698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:04:31.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.742+0000 7fd1b6698800 20 rados->read ofs=0 len=0 2024-09-14T11:04:31.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.742+0000 7fd1b6698800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:04:31.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.742+0000 7fd1b6698800 20 zone default found 2024-09-14T11:04:31.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.742+0000 7fd1b6698800 4 Realm: () 2024-09-14T11:04:31.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.742+0000 7fd1b6698800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:04:31.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.742+0000 7fd1b6698800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:04:31.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.742+0000 7fd1b6698800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:04:31.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.742+0000 7fd1b6698800 20 zonegroup default 2024-09-14T11:04:31.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.742+0000 7fd1b6698800 20 rados->read ofs=0 len=0 2024-09-14T11:04:31.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.742+0000 7fd1b6698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:31.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.742+0000 7fd1b6698800 20 rados->read ofs=0 len=0 2024-09-14T11:04:31.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.743+0000 7fd1b6698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:31.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.743+0000 7fd1b6698800 20 rados->read ofs=0 len=0 2024-09-14T11:04:31.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.743+0000 7fd1b6698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:31.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.743+0000 7fd1b6698800 20 started sync module instance, tier type = 2024-09-14T11:04:31.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.743+0000 7fd1b6698800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:04:31.750 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.752+0000 7fd1b6698800 20 add_watcher() i=0 2024-09-14T11:04:31.750 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.752+0000 7fd1b6698800 20 add_watcher() i=1 2024-09-14T11:04:31.750 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.752+0000 7fd1b6698800 20 add_watcher() i=2 2024-09-14T11:04:31.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.752+0000 7fd1b6698800 20 add_watcher() i=3 2024-09-14T11:04:31.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.752+0000 7fd1b6698800 20 add_watcher() i=4 2024-09-14T11:04:31.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.752+0000 7fd1b6698800 20 add_watcher() i=5 2024-09-14T11:04:31.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.752+0000 7fd1b6698800 20 add_watcher() i=6 2024-09-14T11:04:31.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.753+0000 7fd1b6698800 20 add_watcher() i=7 2024-09-14T11:04:31.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.753+0000 7fd1b6698800 2 all 8 watchers are set, enabling cache 2024-09-14T11:04:31.753 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.754+0000 7fd06a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:04:31.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.755+0000 7fd1b6698800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:04:31.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.755+0000 7fd1b6698800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:04:31.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.755+0000 7fd1b6698800 5 note: GC not initialized 2024-09-14T11:04:31.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.755+0000 7fd0697e2640 20 reqs_thread_entry: start 2024-09-14T11:04:31.755 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.755+0000 7fd1b6698800 20 init_complete bucket index max shards: 11 2024-09-14T11:04:31.755 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.755+0000 7fd1b6698800 20 Filter name: none 2024-09-14T11:04:31.755 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.755+0000 7fcfdaffd640 20 reqs_thread_entry: start 2024-09-14T11:04:31.755 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.755+0000 7fd1b6698800 20 rados->read ofs=0 len=0 2024-09-14T11:04:31.755 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.755+0000 7fd1b6698800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:04:31.755 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.755+0000 7fd1b6698800 20 rados->read ofs=0 len=0 2024-09-14T11:04:31.756 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.756+0000 7fd1b6698800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:04:31.756 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.756+0000 7fd1b6698800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:04:31.756 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.756+0000 7fd1b6698800 20 rados->read ofs=0 len=0 2024-09-14T11:04:31.756 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.757+0000 7fd1b6698800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:04:31.756 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.757+0000 7fd1b6698800 20 rados->read ofs=0 len=0 2024-09-14T11:04:31.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.757+0000 7fd1b6698800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:04:31.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.757+0000 7fd1b6698800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:04:31.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.759+0000 7fd06a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:04:31.759 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.761+0000 7fd1b6698800 20 remove_watcher() i=0 2024-09-14T11:04:31.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.761+0000 7fd1b6698800 2 removed watcher, disabling cache 2024-09-14T11:04:31.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.762+0000 7fd1b6698800 20 remove_watcher() i=1 2024-09-14T11:04:31.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.763+0000 7fd1b6698800 20 remove_watcher() i=2 2024-09-14T11:04:31.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.764+0000 7fd1b6698800 20 remove_watcher() i=3 2024-09-14T11:04:31.763 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.765+0000 7fd1b6698800 20 remove_watcher() i=4 2024-09-14T11:04:31.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.766+0000 7fd1b6698800 20 remove_watcher() i=5 2024-09-14T11:04:31.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.766+0000 7fd1b6698800 20 remove_watcher() i=6 2024-09-14T11:04:31.766 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.767+0000 7fd1b6698800 20 remove_watcher() i=7 2024-09-14T11:04:31.777 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:04:31.777 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:04:31.777 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-block-writes id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:04:31.777 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:04:31.828 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:04:31.859 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:04:31.859 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:04:31.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.897+0000 7fbc72f36800 20 rados->read ofs=0 len=0 2024-09-14T11:04:31.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.899+0000 7fbc72f36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:31.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.899+0000 7fbc72f36800 20 realm 2024-09-14T11:04:31.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.899+0000 7fbc72f36800 20 rados->read ofs=0 len=0 2024-09-14T11:04:31.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.899+0000 7fbc72f36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:31.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.899+0000 7fbc72f36800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:04:31.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.899+0000 7fbc72f36800 20 rados->read ofs=0 len=0 2024-09-14T11:04:31.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.899+0000 7fbc72f36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:31.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.899+0000 7fbc72f36800 20 rados->read ofs=0 len=0 2024-09-14T11:04:31.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.900+0000 7fbc72f36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:04:31.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.900+0000 7fbc72f36800 20 rados->read ofs=0 len=0 2024-09-14T11:04:31.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.901+0000 7fbc72f36800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:04:31.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.901+0000 7fbc72f36800 20 searching for the correct realm 2024-09-14T11:04:31.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.903+0000 7fbc6e4b6640 0 -- 172.21.15.97:0/1102026304 >> [v2:172.21.15.97:6816/4093696477,v1:172.21.15.97:6817/4093696477] conn(0x55d722621650 msgr2=0x55d722623a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:04:31.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:31.906+0000 7fbc6e4b6640 0 -- 172.21.15.97:0/1102026304 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7fbc6003ead0 msgr2=0x7fbc6006a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:04:32.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.112+0000 7fbc72f36800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:04:32.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.112+0000 7fbc72f36800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:04:32.112 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.112+0000 7fbc72f36800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:04:32.112 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.112+0000 7fbc72f36800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:04:32.112 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.112+0000 7fbc72f36800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:04:32.112 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.112+0000 7fbc72f36800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:04:32.112 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.112+0000 7fbc72f36800 20 rados->read ofs=0 len=0 2024-09-14T11:04:32.112 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.113+0000 7fbc72f36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:32.112 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.113+0000 7fbc72f36800 20 rados->read ofs=0 len=0 2024-09-14T11:04:32.112 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.113+0000 7fbc72f36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:04:32.112 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.113+0000 7fbc72f36800 20 rados->read ofs=0 len=0 2024-09-14T11:04:32.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.113+0000 7fbc72f36800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:04:32.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.113+0000 7fbc72f36800 20 zone default found 2024-09-14T11:04:32.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.113+0000 7fbc72f36800 4 Realm: () 2024-09-14T11:04:32.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.113+0000 7fbc72f36800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:04:32.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.113+0000 7fbc72f36800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:04:32.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.113+0000 7fbc72f36800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:04:32.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.113+0000 7fbc72f36800 20 zonegroup default 2024-09-14T11:04:32.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.113+0000 7fbc72f36800 20 rados->read ofs=0 len=0 2024-09-14T11:04:32.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.113+0000 7fbc72f36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:32.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.113+0000 7fbc72f36800 20 rados->read ofs=0 len=0 2024-09-14T11:04:32.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.114+0000 7fbc72f36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:32.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.114+0000 7fbc72f36800 20 rados->read ofs=0 len=0 2024-09-14T11:04:32.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.114+0000 7fbc72f36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:32.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.114+0000 7fbc72f36800 20 started sync module instance, tier type = 2024-09-14T11:04:32.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.114+0000 7fbc72f36800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:04:32.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.122+0000 7fbc72f36800 20 add_watcher() i=0 2024-09-14T11:04:32.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.122+0000 7fbc72f36800 20 add_watcher() i=1 2024-09-14T11:04:32.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.122+0000 7fbc72f36800 20 add_watcher() i=2 2024-09-14T11:04:32.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.122+0000 7fbc72f36800 20 add_watcher() i=3 2024-09-14T11:04:32.122 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.122+0000 7fbc72f36800 20 add_watcher() i=4 2024-09-14T11:04:32.122 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.122+0000 7fbc72f36800 20 add_watcher() i=5 2024-09-14T11:04:32.122 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.122+0000 7fbc72f36800 20 add_watcher() i=6 2024-09-14T11:04:32.122 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.123+0000 7fbc72f36800 20 add_watcher() i=7 2024-09-14T11:04:32.122 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.123+0000 7fbc72f36800 2 all 8 watchers are set, enabling cache 2024-09-14T11:04:32.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.125+0000 7fbb257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:04:32.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.125+0000 7fbc72f36800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:04:32.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.125+0000 7fbc72f36800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:04:32.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.125+0000 7fbc72f36800 5 note: GC not initialized 2024-09-14T11:04:32.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.125+0000 7fba9ffff640 20 reqs_thread_entry: start 2024-09-14T11:04:32.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.125+0000 7fbc72f36800 20 init_complete bucket index max shards: 11 2024-09-14T11:04:32.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.126+0000 7fbc72f36800 20 Filter name: none 2024-09-14T11:04:32.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.126+0000 7fba9dffb640 20 reqs_thread_entry: start 2024-09-14T11:04:32.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.126+0000 7fbc72f36800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-14T11:04:32.126 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.126+0000 7fbc72f36800 20 rados->read ofs=0 len=0 2024-09-14T11:04:32.126 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.126+0000 7fbc72f36800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:04:32.126 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.126+0000 7fbc72f36800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-14T11:04:32.126 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.126+0000 7fbc72f36800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-14T11:04:32.126 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.126+0000 7fbc72f36800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28 : miss 2024-09-14T11:04:32.126 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.126+0000 7fbc72f36800 20 rados->read ofs=0 len=0 2024-09-14T11:04:32.127 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.127+0000 7fbc72f36800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:04:32.127 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.127+0000 7fbc72f36800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28 info.flags=0x17 2024-09-14T11:04:32.127 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.127+0000 7fbc72f36800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28 to cache LRU end 2024-09-14T11:04:32.127 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.127+0000 7fbc72f36800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:04:32.127 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.127+0000 7fbc72f36800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:04:32.127 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.127+0000 7fbc72f36800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28 2024-09-14T11:04:32.130 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.132+0000 7fbc72f36800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28 info.flags=0x17 2024-09-14T11:04:32.131 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.132+0000 7fbc72f36800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28 to cache LRU end 2024-09-14T11:04:32.131 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.132+0000 7fbc72f36800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:04:32.131 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.132+0000 7fbc72f36800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28, ofs0, ns] 2024-09-14T11:04:32.132 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.133+0000 7fbb51ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595113 cookie 94382483236192 notifier 6662 bl.length()=915 2024-09-14T11:04:32.132 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.133+0000 7fbb51ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28 info.flags=0x17 2024-09-14T11:04:32.132 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.133+0000 7fbb51ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28 to cache LRU end 2024-09-14T11:04:32.132 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.133+0000 7fbb51ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:04:32.132 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.133+0000 7fbb527fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595114 cookie 94382483236192 notifier 6662 bl.length()=915 2024-09-14T11:04:32.132 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.133+0000 7fbb527fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28 info.flags=0x17 2024-09-14T11:04:32.132 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.133+0000 7fbb527fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28 to cache LRU end 2024-09-14T11:04:32.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.133+0000 7fbb527fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:04:32.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.134+0000 7fbc72f36800 20 handle_bi_update(): bucket=:error-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28]): orig_sources= new_sources= 2024-09-14T11:04:32.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.134+0000 7fbc72f36800 20 handle_bi_update(): bucket=:error-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28]): potential sources added=[] removed=[] 2024-09-14T11:04:32.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.134+0000 7fbc72f36800 20 handle_bi_update(): bucket=:error-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28]): orig_dests= new_dests= 2024-09-14T11:04:32.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.134+0000 7fbc72f36800 20 handle_bi_update(): bucket=:error-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28]): potential dests added=[] removed=[] 2024-09-14T11:04:32.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.139+0000 7fbc72f36800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.1.0 2024-09-14T11:04:32.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.139+0000 7fbc72f36800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.1.0 2024-09-14T11:04:32.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.139+0000 7fbc72f36800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.1.1 2024-09-14T11:04:32.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.139+0000 7fbc72f36800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.1.1 2024-09-14T11:04:32.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.139+0000 7fbc72f36800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.1.2 2024-09-14T11:04:32.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.139+0000 7fbc72f36800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.1.2 2024-09-14T11:04:32.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.139+0000 7fbc72f36800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.1.3 2024-09-14T11:04:32.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.139+0000 7fbc72f36800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.1.3 2024-09-14T11:04:32.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.139+0000 7fbc72f36800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.1.4 2024-09-14T11:04:32.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.139+0000 7fbc72f36800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.1.4 2024-09-14T11:04:32.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.139+0000 7fbc72f36800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.1.5 2024-09-14T11:04:32.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.139+0000 7fbc72f36800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.1.5 2024-09-14T11:04:32.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.139+0000 7fbc72f36800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.1.6 2024-09-14T11:04:32.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.139+0000 7fbc72f36800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.1.6 2024-09-14T11:04:32.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.139+0000 7fbc72f36800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.1.7 2024-09-14T11:04:32.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.139+0000 7fbc72f36800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.1.7 2024-09-14T11:04:32.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.139+0000 7fbc72f36800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.1.8 2024-09-14T11:04:32.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.139+0000 7fbc72f36800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.1.8 2024-09-14T11:04:32.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.139+0000 7fbc72f36800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.1.9 2024-09-14T11:04:32.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.139+0000 7fbc72f36800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.1.9 2024-09-14T11:04:32.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.139+0000 7fbc72f36800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.1.10 2024-09-14T11:04:32.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.139+0000 7fbc72f36800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.1.10 2024-09-14T11:04:32.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.139+0000 7fbc72f36800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.1.11 2024-09-14T11:04:32.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.139+0000 7fbc72f36800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.1.11 2024-09-14T11:04:32.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.139+0000 7fbc72f36800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.0 2024-09-14T11:04:32.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.139+0000 7fbc72f36800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.1 2024-09-14T11:04:32.143 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.140+0000 7fbc72f36800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.2 2024-09-14T11:04:32.143 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.140+0000 7fbc72f36800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.3 2024-09-14T11:04:32.143 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.141+0000 7fbc72f36800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.4 2024-09-14T11:04:32.143 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.141+0000 7fbc72f36800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.5 2024-09-14T11:04:32.143 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.142+0000 7fbc72f36800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.6 2024-09-14T11:04:32.143 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.142+0000 7fbc72f36800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.7 2024-09-14T11:04:32.143 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.143+0000 7fbc72f36800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.8 2024-09-14T11:04:32.143 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.143+0000 7fbc72f36800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.9 2024-09-14T11:04:32.143 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.144+0000 7fbc72f36800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.10 2024-09-14T11:04:32.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.147+0000 7fbc72f36800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28 : hit (requested=0x17, cached=0x17) 2024-09-14T11:04:32.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.147+0000 7fbc72f36800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28 2024-09-14T11:04:32.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.148+0000 7fbc72f36800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28 info.flags=0x17 2024-09-14T11:04:32.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.148+0000 7fbc72f36800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28 to cache LRU end 2024-09-14T11:04:32.147 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.148+0000 7fbc72f36800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:04:32.147 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.148+0000 7fbc72f36800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28, ofs0, ns] 2024-09-14T11:04:32.147 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.148+0000 7fbb527fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595115 cookie 94382483236192 notifier 6662 bl.length()=915 2024-09-14T11:04:32.147 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.148+0000 7fbb527fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28 info.flags=0x17 2024-09-14T11:04:32.147 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.148+0000 7fbb527fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28 to cache LRU end 2024-09-14T11:04:32.147 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.148+0000 7fbb527fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:04:32.147 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.148+0000 7fbc72f36800 20 handle_bi_update(): bucket=:error-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28]): orig_sources= new_sources= 2024-09-14T11:04:32.148 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.148+0000 7fbc72f36800 20 handle_bi_update(): bucket=:error-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28]): potential sources added=[] removed=[] 2024-09-14T11:04:32.148 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.148+0000 7fbc72f36800 20 handle_bi_update(): bucket=:error-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28]): orig_dests= new_dests= 2024-09-14T11:04:32.148 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.148+0000 7fbc72f36800 20 handle_bi_update(): bucket=:error-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28]): potential dests added=[] removed=[] 2024-09-14T11:04:32.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.151+0000 7fbc72f36800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.0 2024-09-14T11:04:32.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.151+0000 7fbc72f36800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.1 2024-09-14T11:04:32.150 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.151+0000 7fbc72f36800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.2 2024-09-14T11:04:32.150 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.151+0000 7fbc72f36800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.3 2024-09-14T11:04:32.150 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.152+0000 7fbc72f36800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.4 2024-09-14T11:04:32.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.152+0000 7fbc72f36800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.5 2024-09-14T11:04:32.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.152+0000 7fbc72f36800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.6 2024-09-14T11:04:32.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.153+0000 7fbc72f36800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.7 2024-09-14T11:04:32.152 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.153+0000 7fbc72f36800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.8 2024-09-14T11:04:32.152 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.153+0000 7fbc72f36800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.9 2024-09-14T11:04:32.152 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.153+0000 7fbc72f36800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28.10 2024-09-14T11:04:32.152 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.154+0000 7fbc72f36800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28 : hit (requested=0x17, cached=0x17) 2024-09-14T11:04:32.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.154+0000 7fbc72f36800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28 2024-09-14T11:04:32.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.155+0000 7fbc72f36800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28 info.flags=0x17 2024-09-14T11:04:32.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.155+0000 7fbc72f36800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28 to cache LRU end 2024-09-14T11:04:32.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.155+0000 7fbc72f36800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:04:32.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.155+0000 7fbc72f36800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28, ofs0, ns] 2024-09-14T11:04:32.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.155+0000 7fbb51ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595116 cookie 94382483236192 notifier 6662 bl.length()=883 2024-09-14T11:04:32.155 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.155+0000 7fbb51ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28 info.flags=0x17 2024-09-14T11:04:32.155 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.155+0000 7fbb51ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28 to cache LRU end 2024-09-14T11:04:32.155 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.155+0000 7fbb51ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:04:32.155 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.156+0000 7fbc72f36800 20 handle_bi_update(): bucket=:error-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28]): orig_sources= new_sources= 2024-09-14T11:04:32.155 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.156+0000 7fbc72f36800 20 handle_bi_update(): bucket=:error-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28]): potential sources added=[] removed=[] 2024-09-14T11:04:32.155 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.156+0000 7fbc72f36800 20 handle_bi_update(): bucket=:error-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28]): orig_dests= new_dests= 2024-09-14T11:04:32.155 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.156+0000 7fbc72f36800 20 handle_bi_update(): bucket=:error-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28]): potential dests added=[] removed=[] 2024-09-14T11:04:32.156 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.158+0000 7fbc72f36800 1 execute INFO: reshard of bucket "error-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-14T11:04:32.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.159+0000 7fbb257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:04:32.160 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.162+0000 7fbc72f36800 20 remove_watcher() i=0 2024-09-14T11:04:32.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.162+0000 7fbc72f36800 2 removed watcher, disabling cache 2024-09-14T11:04:32.161 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.163+0000 7fbc72f36800 20 remove_watcher() i=1 2024-09-14T11:04:32.162 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.164+0000 7fbc72f36800 20 remove_watcher() i=2 2024-09-14T11:04:32.163 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.165+0000 7fbc72f36800 20 remove_watcher() i=3 2024-09-14T11:04:32.164 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.166+0000 7fbc72f36800 20 remove_watcher() i=4 2024-09-14T11:04:32.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.167+0000 7fbc72f36800 20 remove_watcher() i=5 2024-09-14T11:04:32.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.168+0000 7fbc72f36800 20 remove_watcher() i=6 2024-09-14T11:04:32.167 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.169+0000 7fbc72f36800 20 remove_watcher() i=7 2024-09-14T11:04:32.179 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-14T11:04:32.208 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:04:32.208 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:04:32.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.245+0000 7fe450b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:04:32.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.247+0000 7fe450b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:32.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.247+0000 7fe450b2c800 20 realm 2024-09-14T11:04:32.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.247+0000 7fe450b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:04:32.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.248+0000 7fe450b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:32.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.248+0000 7fe450b2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:04:32.247 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.248+0000 7fe450b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:04:32.247 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.248+0000 7fe450b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:32.247 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.248+0000 7fe450b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:04:32.247 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.248+0000 7fe450b2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:04:32.247 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.248+0000 7fe450b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:04:32.248 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.249+0000 7fe450b2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:04:32.248 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.249+0000 7fe450b2c800 20 searching for the correct realm 2024-09-14T11:04:32.249 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.251+0000 7fe44bf3d640 0 -- 172.21.15.97:0/815182207 >> [v2:172.21.15.97:6808/2081705332,v1:172.21.15.97:6809/2081705332] conn(0x7fe444086030 msgr2=0x7fe4440b7760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:04:32.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.254+0000 7fe44c73e640 0 -- 172.21.15.97:0/815182207 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7fe43401f050 msgr2=0x7fe43404b440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:04:32.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.461+0000 7fe450b2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:04:32.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.461+0000 7fe450b2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:04:32.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.461+0000 7fe450b2c800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:04:32.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.461+0000 7fe450b2c800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:04:32.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.461+0000 7fe450b2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:04:32.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.461+0000 7fe450b2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:04:32.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.461+0000 7fe450b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:04:32.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.461+0000 7fe450b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:32.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.461+0000 7fe450b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:04:32.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.462+0000 7fe450b2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:04:32.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.462+0000 7fe450b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:04:32.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.462+0000 7fe450b2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:04:32.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.462+0000 7fe450b2c800 20 zone default found 2024-09-14T11:04:32.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.462+0000 7fe450b2c800 4 Realm: () 2024-09-14T11:04:32.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.462+0000 7fe450b2c800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:04:32.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.462+0000 7fe450b2c800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:04:32.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.462+0000 7fe450b2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:04:32.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.462+0000 7fe450b2c800 20 zonegroup default 2024-09-14T11:04:32.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.462+0000 7fe450b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:04:32.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.462+0000 7fe450b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:32.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.462+0000 7fe450b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:04:32.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.463+0000 7fe450b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:32.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.463+0000 7fe450b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:04:32.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.463+0000 7fe450b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:32.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.463+0000 7fe450b2c800 20 started sync module instance, tier type = 2024-09-14T11:04:32.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.463+0000 7fe450b2c800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:04:32.470 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.472+0000 7fe450b2c800 20 add_watcher() i=0 2024-09-14T11:04:32.470 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.472+0000 7fe450b2c800 20 add_watcher() i=1 2024-09-14T11:04:32.470 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.472+0000 7fe450b2c800 20 add_watcher() i=2 2024-09-14T11:04:32.470 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.472+0000 7fe450b2c800 20 add_watcher() i=3 2024-09-14T11:04:32.470 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.472+0000 7fe450b2c800 20 add_watcher() i=4 2024-09-14T11:04:32.471 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.472+0000 7fe450b2c800 20 add_watcher() i=5 2024-09-14T11:04:32.471 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.472+0000 7fe450b2c800 20 add_watcher() i=6 2024-09-14T11:04:32.471 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.472+0000 7fe450b2c800 20 add_watcher() i=7 2024-09-14T11:04:32.471 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.472+0000 7fe450b2c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:04:32.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.474+0000 7fe302fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:04:32.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.475+0000 7fe450b2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:04:32.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.475+0000 7fe450b2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:04:32.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.475+0000 7fe450b2c800 5 note: GC not initialized 2024-09-14T11:04:32.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.475+0000 7fe301fdb640 20 reqs_thread_entry: start 2024-09-14T11:04:32.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.475+0000 7fe450b2c800 20 init_complete bucket index max shards: 11 2024-09-14T11:04:32.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.475+0000 7fe450b2c800 20 Filter name: none 2024-09-14T11:04:32.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.475+0000 7fe2737fe640 20 reqs_thread_entry: start 2024-09-14T11:04:32.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.475+0000 7fe450b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:04:32.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.475+0000 7fe450b2c800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:04:32.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.475+0000 7fe450b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:04:32.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.476+0000 7fe450b2c800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:04:32.476 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.476+0000 7fe450b2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:04:32.476 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.476+0000 7fe450b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:04:32.476 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.476+0000 7fe450b2c800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:04:32.476 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.476+0000 7fe450b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:04:32.476 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.477+0000 7fe450b2c800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:04:32.476 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.477+0000 7fe450b2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:04:32.477 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.479+0000 7fe302fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:04:32.479 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.481+0000 7fe450b2c800 20 remove_watcher() i=0 2024-09-14T11:04:32.479 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.481+0000 7fe450b2c800 2 removed watcher, disabling cache 2024-09-14T11:04:32.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.482+0000 7fe450b2c800 20 remove_watcher() i=1 2024-09-14T11:04:32.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.482+0000 7fe450b2c800 20 remove_watcher() i=2 2024-09-14T11:04:32.482 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.483+0000 7fe450b2c800 20 remove_watcher() i=3 2024-09-14T11:04:32.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.484+0000 7fe450b2c800 20 remove_watcher() i=4 2024-09-14T11:04:32.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.485+0000 7fe450b2c800 20 remove_watcher() i=5 2024-09-14T11:04:32.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.486+0000 7fe450b2c800 20 remove_watcher() i=6 2024-09-14T11:04:32.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.487+0000 7fe450b2c800 20 remove_watcher() i=7 2024-09-14T11:04:32.495 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:04:32.496 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:04:32.496 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-block-writes id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:04:32.496 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:04:32.573 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: reshard bucket with abort at block_writes 2024-09-14T11:04:32.573 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:04:32.772 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-14T11:04:32.799 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:04:32.800 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:04:32.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.838+0000 7f697632c800 20 rados->read ofs=0 len=0 2024-09-14T11:04:32.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.840+0000 7f697632c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:32.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.840+0000 7f697632c800 20 realm 2024-09-14T11:04:32.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.840+0000 7f697632c800 20 rados->read ofs=0 len=0 2024-09-14T11:04:32.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.840+0000 7f697632c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:32.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.840+0000 7f697632c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:04:32.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.840+0000 7f697632c800 20 rados->read ofs=0 len=0 2024-09-14T11:04:32.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.840+0000 7f697632c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:32.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.840+0000 7f697632c800 20 rados->read ofs=0 len=0 2024-09-14T11:04:32.840 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.841+0000 7f697632c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:04:32.840 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.841+0000 7f697632c800 20 rados->read ofs=0 len=0 2024-09-14T11:04:32.840 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.842+0000 7f697632c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:04:32.840 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.842+0000 7f697632c800 20 searching for the correct realm 2024-09-14T11:04:32.842 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:32.844+0000 7f6972850640 0 -- 172.21.15.97:0/2182364647 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f69680aac30 msgr2=0x7f69680b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:04:33.448 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.450+0000 7f697184e640 0 -- 172.21.15.97:0/2182364647 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f69640970b0 msgr2=0x7f6964090e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:04:33.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.658+0000 7f697632c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:04:33.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.658+0000 7f697632c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:04:33.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.658+0000 7f697632c800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:04:33.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.658+0000 7f697632c800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:04:33.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.658+0000 7f697632c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:04:33.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.658+0000 7f697632c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:04:33.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.658+0000 7f697632c800 20 rados->read ofs=0 len=0 2024-09-14T11:04:33.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.659+0000 7f697632c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:33.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.659+0000 7f697632c800 20 rados->read ofs=0 len=0 2024-09-14T11:04:33.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.659+0000 7f697632c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:04:33.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.659+0000 7f697632c800 20 rados->read ofs=0 len=0 2024-09-14T11:04:33.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.660+0000 7f697632c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:04:33.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.660+0000 7f697632c800 20 zone default found 2024-09-14T11:04:33.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.660+0000 7f697632c800 4 Realm: () 2024-09-14T11:04:33.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.660+0000 7f697632c800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:04:33.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.660+0000 7f697632c800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:04:33.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.660+0000 7f697632c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:04:33.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.660+0000 7f697632c800 20 zonegroup default 2024-09-14T11:04:33.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.660+0000 7f697632c800 20 rados->read ofs=0 len=0 2024-09-14T11:04:33.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.660+0000 7f697632c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:33.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.660+0000 7f697632c800 20 rados->read ofs=0 len=0 2024-09-14T11:04:33.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.660+0000 7f697632c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:33.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.660+0000 7f697632c800 20 rados->read ofs=0 len=0 2024-09-14T11:04:33.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.660+0000 7f697632c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:33.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.660+0000 7f697632c800 20 started sync module instance, tier type = 2024-09-14T11:04:33.661 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.661+0000 7f697632c800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:04:33.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.670+0000 7f697632c800 20 add_watcher() i=0 2024-09-14T11:04:33.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.670+0000 7f697632c800 20 add_watcher() i=1 2024-09-14T11:04:33.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.670+0000 7f697632c800 20 add_watcher() i=2 2024-09-14T11:04:33.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.670+0000 7f697632c800 20 add_watcher() i=3 2024-09-14T11:04:33.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.670+0000 7f697632c800 20 add_watcher() i=4 2024-09-14T11:04:33.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.670+0000 7f697632c800 20 add_watcher() i=5 2024-09-14T11:04:33.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.670+0000 7f697632c800 20 add_watcher() i=6 2024-09-14T11:04:33.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.671+0000 7f697632c800 20 add_watcher() i=7 2024-09-14T11:04:33.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.671+0000 7f697632c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:04:33.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.673+0000 7f6828fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:04:33.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.674+0000 7f697632c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:04:33.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.674+0000 7f697632c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:04:33.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.674+0000 7f697632c800 5 note: GC not initialized 2024-09-14T11:04:33.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.674+0000 7f67a37fe640 20 reqs_thread_entry: start 2024-09-14T11:04:33.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.674+0000 7f697632c800 20 init_complete bucket index max shards: 11 2024-09-14T11:04:33.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.674+0000 7f697632c800 20 Filter name: none 2024-09-14T11:04:33.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.674+0000 7f67a17fa640 20 reqs_thread_entry: start 2024-09-14T11:04:33.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.674+0000 7f697632c800 20 rados->read ofs=0 len=0 2024-09-14T11:04:33.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.675+0000 7f697632c800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:04:33.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.675+0000 7f697632c800 20 rados->read ofs=0 len=0 2024-09-14T11:04:33.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.675+0000 7f697632c800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:04:33.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.675+0000 7f697632c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:04:33.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.676+0000 7f697632c800 20 rados->read ofs=0 len=0 2024-09-14T11:04:33.675 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.676+0000 7f697632c800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:04:33.675 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.676+0000 7f697632c800 20 rados->read ofs=0 len=0 2024-09-14T11:04:33.675 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.676+0000 7f697632c800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:04:33.675 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.676+0000 7f697632c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:04:33.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.678+0000 7f6828fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:04:33.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.681+0000 7f697632c800 20 remove_watcher() i=0 2024-09-14T11:04:33.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.681+0000 7f697632c800 2 removed watcher, disabling cache 2024-09-14T11:04:33.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.682+0000 7f697632c800 20 remove_watcher() i=1 2024-09-14T11:04:33.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.683+0000 7f697632c800 20 remove_watcher() i=2 2024-09-14T11:04:33.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.684+0000 7f697632c800 20 remove_watcher() i=3 2024-09-14T11:04:33.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.685+0000 7f697632c800 20 remove_watcher() i=4 2024-09-14T11:04:33.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.686+0000 7f697632c800 20 remove_watcher() i=5 2024-09-14T11:04:33.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.687+0000 7f697632c800 20 remove_watcher() i=6 2024-09-14T11:04:33.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.688+0000 7f697632c800 20 remove_watcher() i=7 2024-09-14T11:04:33.698 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:04:33.698 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:04:33.698 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: abort-at-block-writes id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:04:33.698 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:04:33.700 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-09-14T11:04:33.735 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:04:33.735 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:04:33.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.778+0000 7f6ebb013800 20 rados->read ofs=0 len=0 2024-09-14T11:04:33.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.780+0000 7f6ebb013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:33.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.780+0000 7f6ebb013800 20 realm 2024-09-14T11:04:33.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.780+0000 7f6ebb013800 20 rados->read ofs=0 len=0 2024-09-14T11:04:33.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.780+0000 7f6ebb013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:33.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.780+0000 7f6ebb013800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:04:33.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.780+0000 7f6ebb013800 20 rados->read ofs=0 len=0 2024-09-14T11:04:33.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.780+0000 7f6ebb013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:33.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.780+0000 7f6ebb013800 20 rados->read ofs=0 len=0 2024-09-14T11:04:33.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.781+0000 7f6ebb013800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:04:33.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.781+0000 7f6ebb013800 20 rados->read ofs=0 len=0 2024-09-14T11:04:33.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.782+0000 7f6ebb013800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:04:33.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.782+0000 7f6ebb013800 20 searching for the correct realm 2024-09-14T11:04:33.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.784+0000 7f6eb6f93640 0 -- 172.21.15.97:0/440857257 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f6ea0018070 msgr2=0x7f6ea007ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:04:33.988 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.989+0000 7f6eaffff640 0 -- 172.21.15.97:0/440857257 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f6ea80b7800 msgr2=0x7f6ea80b1640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:04:33.993 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.995+0000 7f6ebb013800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:04:33.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.995+0000 7f6ebb013800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:04:33.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.995+0000 7f6ebb013800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:04:33.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.995+0000 7f6ebb013800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:04:33.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.995+0000 7f6ebb013800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:04:33.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.995+0000 7f6ebb013800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:04:33.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.995+0000 7f6ebb013800 20 rados->read ofs=0 len=0 2024-09-14T11:04:33.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.995+0000 7f6ebb013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:33.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.995+0000 7f6ebb013800 20 rados->read ofs=0 len=0 2024-09-14T11:04:33.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.995+0000 7f6ebb013800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:04:33.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.995+0000 7f6ebb013800 20 rados->read ofs=0 len=0 2024-09-14T11:04:33.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.996+0000 7f6ebb013800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:04:33.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.996+0000 7f6ebb013800 20 zone default found 2024-09-14T11:04:33.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.996+0000 7f6ebb013800 4 Realm: () 2024-09-14T11:04:33.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.996+0000 7f6ebb013800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:04:33.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.996+0000 7f6ebb013800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:04:33.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.996+0000 7f6ebb013800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:04:33.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.996+0000 7f6ebb013800 20 zonegroup default 2024-09-14T11:04:33.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.996+0000 7f6ebb013800 20 rados->read ofs=0 len=0 2024-09-14T11:04:33.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.996+0000 7f6ebb013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:33.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.996+0000 7f6ebb013800 20 rados->read ofs=0 len=0 2024-09-14T11:04:33.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.996+0000 7f6ebb013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:33.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.996+0000 7f6ebb013800 20 rados->read ofs=0 len=0 2024-09-14T11:04:33.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.996+0000 7f6ebb013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:33.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.996+0000 7f6ebb013800 20 started sync module instance, tier type = 2024-09-14T11:04:33.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:33.996+0000 7f6ebb013800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:04:34.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.005+0000 7f6ebb013800 20 add_watcher() i=0 2024-09-14T11:04:34.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.005+0000 7f6ebb013800 20 add_watcher() i=1 2024-09-14T11:04:34.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.005+0000 7f6ebb013800 20 add_watcher() i=2 2024-09-14T11:04:34.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.005+0000 7f6ebb013800 20 add_watcher() i=3 2024-09-14T11:04:34.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.005+0000 7f6ebb013800 20 add_watcher() i=4 2024-09-14T11:04:34.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.005+0000 7f6ebb013800 20 add_watcher() i=5 2024-09-14T11:04:34.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.005+0000 7f6ebb013800 20 add_watcher() i=6 2024-09-14T11:04:34.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.006+0000 7f6ebb013800 20 add_watcher() i=7 2024-09-14T11:04:34.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.006+0000 7f6ebb013800 2 all 8 watchers are set, enabling cache 2024-09-14T11:04:34.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.008+0000 7f6d6cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:04:34.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.008+0000 7f6ebb013800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:04:34.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.008+0000 7f6ebb013800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:04:34.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.009+0000 7f6ebb013800 5 note: GC not initialized 2024-09-14T11:04:34.009 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.009+0000 7f6ce77fe640 20 reqs_thread_entry: start 2024-09-14T11:04:34.009 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.009+0000 7f6ebb013800 20 init_complete bucket index max shards: 11 2024-09-14T11:04:34.009 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.009+0000 7f6ebb013800 20 Filter name: none 2024-09-14T11:04:34.009 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.009+0000 7f6ce57fa640 20 reqs_thread_entry: start 2024-09-14T11:04:34.009 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.009+0000 7f6ebb013800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:04:34.009 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.009+0000 7f6ebb013800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.009 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.009+0000 7f6ebb013800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:04:34.009 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.009+0000 7f6ebb013800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:04:34.010 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.009+0000 7f6ebb013800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:04:34.010 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.009+0000 7f6ebb013800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 : miss 2024-09-14T11:04:34.010 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.009+0000 7f6ebb013800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.010 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.010+0000 7f6ebb013800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:04:34.010 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.010+0000 7f6ebb013800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 info.flags=0x17 2024-09-14T11:04:34.010 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.010+0000 7f6ebb013800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 to cache LRU end 2024-09-14T11:04:34.010 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.010+0000 7f6ebb013800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:04:34.010 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.010+0000 7f6ebb013800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:04:34.010 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.010+0000 7f6ebb013800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 2024-09-14T11:04:34.014 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.015+0000 7f6ebb013800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 info.flags=0x17 2024-09-14T11:04:34.014 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.015+0000 7f6ebb013800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 to cache LRU end 2024-09-14T11:04:34.014 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.015+0000 7f6ebb013800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:04:34.014 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.015+0000 7f6ebb013800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29, ofs0, ns] 2024-09-14T11:04:34.014 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.015+0000 7f6d997fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595191 cookie 94133264719408 notifier 7119 bl.length()=915 2024-09-14T11:04:34.014 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.015+0000 7f6d997fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 info.flags=0x17 2024-09-14T11:04:34.014 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.015+0000 7f6d997fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 to cache LRU end 2024-09-14T11:04:34.014 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.015+0000 7f6d997fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:04:34.014 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.016+0000 7f6ebb013800 20 handle_bi_update(): bucket=:abort-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29]): orig_sources= new_sources= 2024-09-14T11:04:34.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.016+0000 7f6ebb013800 20 handle_bi_update(): bucket=:abort-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29]): potential sources added=[] removed=[] 2024-09-14T11:04:34.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.016+0000 7f6ebb013800 20 handle_bi_update(): bucket=:abort-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29]): orig_dests= new_dests= 2024-09-14T11:04:34.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.016+0000 7f6ebb013800 20 handle_bi_update(): bucket=:abort-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29]): potential dests added=[] removed=[] 2024-09-14T11:04:34.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.021+0000 7f6ebb013800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.0 2024-09-14T11:04:34.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.021+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.0 2024-09-14T11:04:34.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.021+0000 7f6ebb013800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.1 2024-09-14T11:04:34.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.021+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.1 2024-09-14T11:04:34.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.021+0000 7f6ebb013800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.2 2024-09-14T11:04:34.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.021+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.2 2024-09-14T11:04:34.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.021+0000 7f6ebb013800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.3 2024-09-14T11:04:34.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.021+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.3 2024-09-14T11:04:34.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.021+0000 7f6ebb013800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.4 2024-09-14T11:04:34.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.021+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.4 2024-09-14T11:04:34.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.021+0000 7f6ebb013800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.5 2024-09-14T11:04:34.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.021+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.5 2024-09-14T11:04:34.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.021+0000 7f6ebb013800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.6 2024-09-14T11:04:34.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.021+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.6 2024-09-14T11:04:34.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.021+0000 7f6ebb013800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.7 2024-09-14T11:04:34.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.021+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.7 2024-09-14T11:04:34.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.021+0000 7f6ebb013800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.8 2024-09-14T11:04:34.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.021+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.8 2024-09-14T11:04:34.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.021+0000 7f6ebb013800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.9 2024-09-14T11:04:34.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.021+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.9 2024-09-14T11:04:34.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.021+0000 7f6ebb013800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.10 2024-09-14T11:04:34.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.021+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.10 2024-09-14T11:04:34.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.021+0000 7f6ebb013800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.11 2024-09-14T11:04:34.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.021+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.11 2024-09-14T11:04:34.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.021+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.0 2024-09-14T11:04:34.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.022+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1 2024-09-14T11:04:34.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.022+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.2 2024-09-14T11:04:34.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.023+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.3 2024-09-14T11:04:34.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.023+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.4 2024-09-14T11:04:34.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.023+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.5 2024-09-14T11:04:34.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.024+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.6 2024-09-14T11:04:34.023 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.024+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.7 2024-09-14T11:04:34.024 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.025+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.8 2024-09-14T11:04:34.024 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.025+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.9 2024-09-14T11:04:34.024 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.026+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.10 2024-09-14T11:04:34.027 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.029+0000 7f6ebb013800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:04:34.027 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.029+0000 7f6ebb013800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 2024-09-14T11:04:34.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.030+0000 7f6ebb013800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 info.flags=0x17 2024-09-14T11:04:34.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.030+0000 7f6ebb013800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 to cache LRU end 2024-09-14T11:04:34.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.030+0000 7f6ebb013800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:04:34.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.030+0000 7f6ebb013800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29, ofs0, ns] 2024-09-14T11:04:34.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.030+0000 7f6d997fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595192 cookie 94133264719408 notifier 7119 bl.length()=915 2024-09-14T11:04:34.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.030+0000 7f6d997fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 info.flags=0x17 2024-09-14T11:04:34.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.030+0000 7f6d997fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 to cache LRU end 2024-09-14T11:04:34.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.030+0000 7f6d997fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:04:34.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.031+0000 7f6ebb013800 20 handle_bi_update(): bucket=:abort-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29]): orig_sources= new_sources= 2024-09-14T11:04:34.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.031+0000 7f6ebb013800 20 handle_bi_update(): bucket=:abort-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29]): potential sources added=[] removed=[] 2024-09-14T11:04:34.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.031+0000 7f6ebb013800 20 handle_bi_update(): bucket=:abort-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29]): orig_dests= new_dests= 2024-09-14T11:04:34.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.031+0000 7f6ebb013800 20 handle_bi_update(): bucket=:abort-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29]): potential dests added=[] removed=[] 2024-09-14T11:04:34.030 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6ebb013800 time 2024-09-14T11:04:34.031965+0000 2024-09-14T11:04:34.030 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:04:34.030 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:04:34.031 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f6ebc18c76a] 2024-09-14T11:04:34.031 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f6ebc18c928] 2024-09-14T11:04:34.031 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559d19c900b1] 2024-09-14T11:04:34.031 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x559d19c9f18e] 2024-09-14T11:04:34.031 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x559d19c9ffc4] 2024-09-14T11:04:34.031 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-14T11:04:34.031 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f6ebae29590] 2024-09-14T11:04:34.031 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-14T11:04:34.031 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-14T11:04:34.031 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.031+0000 7f6ebb013800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6ebb013800 time 2024-09-14T11:04:34.031965+0000 2024-09-14T11:04:34.031 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:04:34.031 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:04:34.031 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:04:34.031 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f6ebc18c76a] 2024-09-14T11:04:34.032 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f6ebc18c928] 2024-09-14T11:04:34.032 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559d19c900b1] 2024-09-14T11:04:34.032 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x559d19c9f18e] 2024-09-14T11:04:34.032 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x559d19c9ffc4] 2024-09-14T11:04:34.032 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-14T11:04:34.032 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f6ebae29590] 2024-09-14T11:04:34.032 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-14T11:04:34.032 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-14T11:04:34.032 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:04:34.032 INFO:tasks.workunit.client.0.smithi097.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:04:34.032 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f6ebb013800 thread_name:radosgw-admin 2024-09-14T11:04:34.051 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:04:34.051 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f6ebae3e6f0] 2024-09-14T11:04:34.051 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f6ebae8b99c] 2024-09-14T11:04:34.052 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-14T11:04:34.052 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-14T11:04:34.052 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f6ebc18c7c4] 2024-09-14T11:04:34.052 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f6ebc18c928] 2024-09-14T11:04:34.052 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559d19c900b1] 2024-09-14T11:04:34.052 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x559d19c9f18e] 2024-09-14T11:04:34.052 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x559d19c9ffc4] 2024-09-14T11:04:34.052 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-14T11:04:34.052 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f6ebae29590] 2024-09-14T11:04:34.052 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-14T11:04:34.052 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-14T11:04:34.052 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.032+0000 7f6ebb013800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:04:34.053 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f6ebb013800 thread_name:radosgw-admin 2024-09-14T11:04:34.053 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:04:34.053 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:04:34.053 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f6ebae3e6f0] 2024-09-14T11:04:34.053 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f6ebae8b99c] 2024-09-14T11:04:34.053 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-14T11:04:34.053 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-14T11:04:34.053 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f6ebc18c7c4] 2024-09-14T11:04:34.053 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f6ebc18c928] 2024-09-14T11:04:34.053 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559d19c900b1] 2024-09-14T11:04:34.053 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x559d19c9f18e] 2024-09-14T11:04:34.053 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x559d19c9ffc4] 2024-09-14T11:04:34.053 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-14T11:04:34.054 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f6ebae29590] 2024-09-14T11:04:34.054 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-14T11:04:34.054 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-14T11:04:34.054 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:04:34.054 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:04:34.054 INFO:tasks.workunit.client.0.smithi097.stderr:--- begin dump of recent events --- 2024-09-14T11:04:34.054 INFO:tasks.workunit.client.0.smithi097.stderr: -499> 2024-09-14T11:04:33.761+0000 7f6ebb013800 10 monclient(hunting): picked mon.noname-b con 0x559d1ba8c190 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:04:34.054 INFO:tasks.workunit.client.0.smithi097.stderr: -498> 2024-09-14T11:04:33.761+0000 7f6ebb013800 10 monclient(hunting): picked mon.noname-c con 0x559d1ba96fe0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:04:34.054 INFO:tasks.workunit.client.0.smithi097.stderr: -497> 2024-09-14T11:04:33.761+0000 7f6ebb013800 10 monclient(hunting): picked mon.noname-a con 0x559d1bb2b6a0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:04:34.054 INFO:tasks.workunit.client.0.smithi097.stderr: -496> 2024-09-14T11:04:33.761+0000 7f6ebb013800 10 monclient(hunting): start opening mon connection 2024-09-14T11:04:34.054 INFO:tasks.workunit.client.0.smithi097.stderr: -495> 2024-09-14T11:04:33.761+0000 7f6ebb013800 10 monclient(hunting): start opening mon connection 2024-09-14T11:04:34.054 INFO:tasks.workunit.client.0.smithi097.stderr: -494> 2024-09-14T11:04:33.761+0000 7f6ebb013800 10 monclient(hunting): start opening mon connection 2024-09-14T11:04:34.054 INFO:tasks.workunit.client.0.smithi097.stderr: -493> 2024-09-14T11:04:33.761+0000 7f6ebb013800 10 monclient(hunting): _renew_subs 2024-09-14T11:04:34.054 INFO:tasks.workunit.client.0.smithi097.stderr: -492> 2024-09-14T11:04:33.761+0000 7f6ebb013800 10 monclient(hunting): authenticate will time out at 1955.414613s 2024-09-14T11:04:34.055 INFO:tasks.workunit.client.0.smithi097.stderr: -491> 2024-09-14T11:04:33.761+0000 7f6eaffff640 10 monclient(hunting): get_auth_request con 0x559d1ba96fe0 auth_method 0 2024-09-14T11:04:34.055 INFO:tasks.workunit.client.0.smithi097.stderr: -490> 2024-09-14T11:04:33.761+0000 7f6eaffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:04:34.055 INFO:tasks.workunit.client.0.smithi097.stderr: -489> 2024-09-14T11:04:33.761+0000 7f6eaffff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:04:34.055 INFO:tasks.workunit.client.0.smithi097.stderr: -488> 2024-09-14T11:04:33.761+0000 7f6eaffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:04:34.055 INFO:tasks.workunit.client.0.smithi097.stderr: -487> 2024-09-14T11:04:33.761+0000 7f6eb6f93640 10 monclient(hunting): get_auth_request con 0x559d1bb2b6a0 auth_method 0 2024-09-14T11:04:34.055 INFO:tasks.workunit.client.0.smithi097.stderr: -486> 2024-09-14T11:04:33.761+0000 7f6eb6f93640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:04:34.055 INFO:tasks.workunit.client.0.smithi097.stderr: -485> 2024-09-14T11:04:33.761+0000 7f6eb6f93640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:04:34.055 INFO:tasks.workunit.client.0.smithi097.stderr: -484> 2024-09-14T11:04:33.761+0000 7f6eb6f93640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:04:34.055 INFO:tasks.workunit.client.0.smithi097.stderr: -483> 2024-09-14T11:04:33.761+0000 7f6eb6792640 10 monclient(hunting): get_auth_request con 0x559d1ba8c190 auth_method 0 2024-09-14T11:04:34.055 INFO:tasks.workunit.client.0.smithi097.stderr: -482> 2024-09-14T11:04:33.761+0000 7f6eb6792640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:04:34.055 INFO:tasks.workunit.client.0.smithi097.stderr: -481> 2024-09-14T11:04:33.761+0000 7f6eb6792640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:04:34.055 INFO:tasks.workunit.client.0.smithi097.stderr: -480> 2024-09-14T11:04:33.761+0000 7f6eb6792640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:04:34.055 INFO:tasks.workunit.client.0.smithi097.stderr: -479> 2024-09-14T11:04:33.761+0000 7f6eaffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:04:34.055 INFO:tasks.workunit.client.0.smithi097.stderr: -478> 2024-09-14T11:04:33.761+0000 7f6eaffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:04:34.056 INFO:tasks.workunit.client.0.smithi097.stderr: -477> 2024-09-14T11:04:33.761+0000 7f6eaffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:04:34.056 INFO:tasks.workunit.client.0.smithi097.stderr: -476> 2024-09-14T11:04:33.761+0000 7f6eb6f93640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:04:34.056 INFO:tasks.workunit.client.0.smithi097.stderr: -475> 2024-09-14T11:04:33.761+0000 7f6eb6f93640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:04:34.056 INFO:tasks.workunit.client.0.smithi097.stderr: -474> 2024-09-14T11:04:33.761+0000 7f6eb6f93640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:04:34.056 INFO:tasks.workunit.client.0.smithi097.stderr: -473> 2024-09-14T11:04:33.761+0000 7f6eb6792640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:04:34.056 INFO:tasks.workunit.client.0.smithi097.stderr: -472> 2024-09-14T11:04:33.761+0000 7f6eb6792640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:04:34.056 INFO:tasks.workunit.client.0.smithi097.stderr: -471> 2024-09-14T11:04:33.761+0000 7f6eb6792640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:04:34.056 INFO:tasks.workunit.client.0.smithi097.stderr: -470> 2024-09-14T11:04:33.762+0000 7f6eaffff640 10 monclient(hunting): handle_auth_done global_id 6701 payload 824 2024-09-14T11:04:34.056 INFO:tasks.workunit.client.0.smithi097.stderr: -469> 2024-09-14T11:04:33.762+0000 7f6eaffff640 10 monclient: _finish_hunting 0 2024-09-14T11:04:34.056 INFO:tasks.workunit.client.0.smithi097.stderr: -468> 2024-09-14T11:04:33.762+0000 7f6eaffff640 1 monclient: found mon.noname-c 2024-09-14T11:04:34.056 INFO:tasks.workunit.client.0.smithi097.stderr: -467> 2024-09-14T11:04:33.762+0000 7f6eaffff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:04:34.056 INFO:tasks.workunit.client.0.smithi097.stderr: -466> 2024-09-14T11:04:33.762+0000 7f6da2e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:04:34.056 INFO:tasks.workunit.client.0.smithi097.stderr: -465> 2024-09-14T11:04:33.762+0000 7f6da2e05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:04:34.057 INFO:tasks.workunit.client.0.smithi097.stderr: -464> 2024-09-14T11:04:33.762+0000 7f6da2e05640 10 monclient: dump: 2024-09-14T11:04:34.057 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:04:34.057 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:04:34.057 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:04:34.057 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:04:34.057 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:04:34.057 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:04:34.057 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:04:34.057 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:04:34.057 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:04:34.057 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:04:34.057 INFO:tasks.workunit.client.0.smithi097.stderr: -463> 2024-09-14T11:04:33.762+0000 7f6da2e05640 10 monclient: _finish_auth 0 2024-09-14T11:04:34.057 INFO:tasks.workunit.client.0.smithi097.stderr: -462> 2024-09-14T11:04:33.762+0000 7f6da2e05640 10 monclient: _check_auth_tickets 2024-09-14T11:04:34.057 INFO:tasks.workunit.client.0.smithi097.stderr: -461> 2024-09-14T11:04:33.762+0000 7f6da2e05640 10 monclient: handle_config config(0 keys) 2024-09-14T11:04:34.058 INFO:tasks.workunit.client.0.smithi097.stderr: -460> 2024-09-14T11:04:33.762+0000 7f6da2e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:04:34.058 INFO:tasks.workunit.client.0.smithi097.stderr: -459> 2024-09-14T11:04:33.762+0000 7f6da2e05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:04:34.058 INFO:tasks.workunit.client.0.smithi097.stderr: -458> 2024-09-14T11:04:33.762+0000 7f6da2e05640 10 monclient: dump: 2024-09-14T11:04:34.058 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:04:34.058 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:04:34.058 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:04:34.058 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:04:34.058 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:04:34.058 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:04:34.058 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:04:34.058 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:04:34.058 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:04:34.058 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:04:34.058 INFO:tasks.workunit.client.0.smithi097.stderr: -457> 2024-09-14T11:04:33.762+0000 7f6ebb013800 5 monclient: authenticate success, global_id 6701 2024-09-14T11:04:34.059 INFO:tasks.workunit.client.0.smithi097.stderr: -456> 2024-09-14T11:04:33.762+0000 7f6ebb013800 10 monclient: _renew_subs 2024-09-14T11:04:34.059 INFO:tasks.workunit.client.0.smithi097.stderr: -455> 2024-09-14T11:04:33.762+0000 7f6da4608640 4 set_mon_vals no callback set 2024-09-14T11:04:34.059 INFO:tasks.workunit.client.0.smithi097.stderr: -454> 2024-09-14T11:04:33.762+0000 7f6ebb013800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:04:34.059 INFO:tasks.workunit.client.0.smithi097.stderr: -453> 2024-09-14T11:04:33.762+0000 7f6ebb013800 10 monclient: _renew_subs 2024-09-14T11:04:34.059 INFO:tasks.workunit.client.0.smithi097.stderr: -452> 2024-09-14T11:04:33.762+0000 7f6ebb013800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:04:34.059 INFO:tasks.workunit.client.0.smithi097.stderr: -451> 2024-09-14T11:04:33.762+0000 7f6ebb013800 1 librados: init done 2024-09-14T11:04:34.059 INFO:tasks.workunit.client.0.smithi097.stderr: -450> 2024-09-14T11:04:33.764+0000 7f6da2e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:04:34.059 INFO:tasks.workunit.client.0.smithi097.stderr: -449> 2024-09-14T11:04:33.764+0000 7f6da2e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:04:34.059 INFO:tasks.workunit.client.0.smithi097.stderr: -448> 2024-09-14T11:04:33.764+0000 7f6da2e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:04:34.059 INFO:tasks.workunit.client.0.smithi097.stderr: -447> 2024-09-14T11:04:33.764+0000 7f6eb6792640 10 monclient: get_auth_request con 0x7f6d9c077230 auth_method 0 2024-09-14T11:04:34.059 INFO:tasks.workunit.client.0.smithi097.stderr: -446> 2024-09-14T11:04:33.764+0000 7f6eb6f93640 10 monclient: get_auth_request con 0x559d1bc0ff70 auth_method 0 2024-09-14T11:04:34.059 INFO:tasks.workunit.client.0.smithi097.stderr: -445> 2024-09-14T11:04:33.765+0000 7f6eb6792640 10 monclient: get_auth_request con 0x559d1bc2dc40 auth_method 0 2024-09-14T11:04:34.059 INFO:tasks.workunit.client.0.smithi097.stderr: -444> 2024-09-14T11:04:33.766+0000 7f6eaffff640 10 monclient: get_auth_request con 0x559d1bc322e0 auth_method 0 2024-09-14T11:04:34.060 INFO:tasks.workunit.client.0.smithi097.stderr: -443> 2024-09-14T11:04:33.767+0000 7f6eb6f93640 10 monclient: get_auth_request con 0x559d1bc361d0 auth_method 0 2024-09-14T11:04:34.060 INFO:tasks.workunit.client.0.smithi097.stderr: -442> 2024-09-14T11:04:33.768+0000 7f6ebb013800 10 monclient: build_initial_monmap 2024-09-14T11:04:34.060 INFO:tasks.workunit.client.0.smithi097.stderr: -441> 2024-09-14T11:04:33.768+0000 7f6ebb013800 1 build_initial for_mkfs: 0 2024-09-14T11:04:34.060 INFO:tasks.workunit.client.0.smithi097.stderr: -440> 2024-09-14T11:04:33.768+0000 7f6ebb013800 10 monclient: monmap: 2024-09-14T11:04:34.060 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:04:34.060 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:04:34.060 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:04:34.060 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:04:34.060 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:04:34.060 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:04:34.060 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:04:34.060 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:04:34.060 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:04:34.060 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:04:34.061 INFO:tasks.workunit.client.0.smithi097.stderr: -439> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc3a470) adding auth protocol: cephx 2024-09-14T11:04:34.061 INFO:tasks.workunit.client.0.smithi097.stderr: -438> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc3a470) adding auth protocol: cephx 2024-09-14T11:04:34.061 INFO:tasks.workunit.client.0.smithi097.stderr: -437> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc3a470) adding auth protocol: cephx 2024-09-14T11:04:34.061 INFO:tasks.workunit.client.0.smithi097.stderr: -436> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc3a470) adding con mode: secure 2024-09-14T11:04:34.061 INFO:tasks.workunit.client.0.smithi097.stderr: -435> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc3a470) adding con mode: crc 2024-09-14T11:04:34.061 INFO:tasks.workunit.client.0.smithi097.stderr: -434> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc3a470) adding con mode: secure 2024-09-14T11:04:34.061 INFO:tasks.workunit.client.0.smithi097.stderr: -433> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc3a470) adding con mode: crc 2024-09-14T11:04:34.061 INFO:tasks.workunit.client.0.smithi097.stderr: -432> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc3a470) adding con mode: secure 2024-09-14T11:04:34.061 INFO:tasks.workunit.client.0.smithi097.stderr: -431> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc3a470) adding con mode: crc 2024-09-14T11:04:34.061 INFO:tasks.workunit.client.0.smithi097.stderr: -430> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc3a470) adding con mode: crc 2024-09-14T11:04:34.061 INFO:tasks.workunit.client.0.smithi097.stderr: -429> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc3a470) adding con mode: secure 2024-09-14T11:04:34.061 INFO:tasks.workunit.client.0.smithi097.stderr: -428> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc3a470) adding con mode: crc 2024-09-14T11:04:34.061 INFO:tasks.workunit.client.0.smithi097.stderr: -427> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc3a470) adding con mode: secure 2024-09-14T11:04:34.061 INFO:tasks.workunit.client.0.smithi097.stderr: -426> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc3a470) adding con mode: crc 2024-09-14T11:04:34.062 INFO:tasks.workunit.client.0.smithi097.stderr: -425> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc3a470) adding con mode: secure 2024-09-14T11:04:34.062 INFO:tasks.workunit.client.0.smithi097.stderr: -424> 2024-09-14T11:04:33.768+0000 7f6ebb013800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:04:34.062 INFO:tasks.workunit.client.0.smithi097.stderr: -423> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 asok(0x559d1b9c0270) register_command objecter_requests cmddesc objecter_requests hook 0x559d1bc3d940 EEXIST 2024-09-14T11:04:34.062 INFO:tasks.workunit.client.0.smithi097.stderr: -422> 2024-09-14T11:04:33.768+0000 7f6ebb013800 10 monclient: init 2024-09-14T11:04:34.062 INFO:tasks.workunit.client.0.smithi097.stderr: -421> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc39228) adding auth protocol: cephx 2024-09-14T11:04:34.062 INFO:tasks.workunit.client.0.smithi097.stderr: -420> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc39228) adding auth protocol: cephx 2024-09-14T11:04:34.062 INFO:tasks.workunit.client.0.smithi097.stderr: -419> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc39228) adding auth protocol: cephx 2024-09-14T11:04:34.062 INFO:tasks.workunit.client.0.smithi097.stderr: -418> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc39228) adding con mode: secure 2024-09-14T11:04:34.062 INFO:tasks.workunit.client.0.smithi097.stderr: -417> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc39228) adding con mode: crc 2024-09-14T11:04:34.062 INFO:tasks.workunit.client.0.smithi097.stderr: -416> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc39228) adding con mode: secure 2024-09-14T11:04:34.062 INFO:tasks.workunit.client.0.smithi097.stderr: -415> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc39228) adding con mode: crc 2024-09-14T11:04:34.062 INFO:tasks.workunit.client.0.smithi097.stderr: -414> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc39228) adding con mode: secure 2024-09-14T11:04:34.062 INFO:tasks.workunit.client.0.smithi097.stderr: -413> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc39228) adding con mode: crc 2024-09-14T11:04:34.063 INFO:tasks.workunit.client.0.smithi097.stderr: -412> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc39228) adding con mode: crc 2024-09-14T11:04:34.063 INFO:tasks.workunit.client.0.smithi097.stderr: -411> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc39228) adding con mode: secure 2024-09-14T11:04:34.063 INFO:tasks.workunit.client.0.smithi097.stderr: -410> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc39228) adding con mode: crc 2024-09-14T11:04:34.063 INFO:tasks.workunit.client.0.smithi097.stderr: -409> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc39228) adding con mode: secure 2024-09-14T11:04:34.063 INFO:tasks.workunit.client.0.smithi097.stderr: -408> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc39228) adding con mode: crc 2024-09-14T11:04:34.063 INFO:tasks.workunit.client.0.smithi097.stderr: -407> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc39228) adding con mode: secure 2024-09-14T11:04:34.063 INFO:tasks.workunit.client.0.smithi097.stderr: -406> 2024-09-14T11:04:33.768+0000 7f6ebb013800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:04:34.063 INFO:tasks.workunit.client.0.smithi097.stderr: -405> 2024-09-14T11:04:33.769+0000 7f6ebb013800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:04:34.063 INFO:tasks.workunit.client.0.smithi097.stderr: -404> 2024-09-14T11:04:33.769+0000 7f6ebb013800 5 asok(0x559d1b9c0270) register_command rotate-key cmddesc rotate-key hook 0x559d1bc39370 EEXIST 2024-09-14T11:04:34.063 INFO:tasks.workunit.client.0.smithi097.stderr: -403> 2024-09-14T11:04:33.769+0000 7f6ebb013800 10 monclient: _reopen_session rank -1 2024-09-14T11:04:34.063 INFO:tasks.workunit.client.0.smithi097.stderr: -402> 2024-09-14T11:04:33.769+0000 7f6ebb013800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:04:34.063 INFO:tasks.workunit.client.0.smithi097.stderr: -401> 2024-09-14T11:04:33.769+0000 7f6ebb013800 10 monclient(hunting): picked mon.noname-b con 0x559d1bc61c60 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:04:34.063 INFO:tasks.workunit.client.0.smithi097.stderr: -400> 2024-09-14T11:04:33.769+0000 7f6ebb013800 10 monclient(hunting): picked mon.noname-c con 0x559d1bc62040 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:04:34.063 INFO:tasks.workunit.client.0.smithi097.stderr: -399> 2024-09-14T11:04:33.769+0000 7f6ebb013800 10 monclient(hunting): picked mon.noname-a con 0x559d1bc60970 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:04:34.064 INFO:tasks.workunit.client.0.smithi097.stderr: -398> 2024-09-14T11:04:33.769+0000 7f6ebb013800 10 monclient(hunting): start opening mon connection 2024-09-14T11:04:34.064 INFO:tasks.workunit.client.0.smithi097.stderr: -397> 2024-09-14T11:04:33.769+0000 7f6ebb013800 10 monclient(hunting): start opening mon connection 2024-09-14T11:04:34.064 INFO:tasks.workunit.client.0.smithi097.stderr: -396> 2024-09-14T11:04:33.769+0000 7f6ebb013800 10 monclient(hunting): start opening mon connection 2024-09-14T11:04:34.064 INFO:tasks.workunit.client.0.smithi097.stderr: -395> 2024-09-14T11:04:33.769+0000 7f6ebb013800 10 monclient(hunting): _renew_subs 2024-09-14T11:04:34.064 INFO:tasks.workunit.client.0.smithi097.stderr: -394> 2024-09-14T11:04:33.769+0000 7f6ebb013800 10 monclient(hunting): authenticate will time out at 1955.422277s 2024-09-14T11:04:34.064 INFO:tasks.workunit.client.0.smithi097.stderr: -393> 2024-09-14T11:04:33.769+0000 7f6eb6792640 10 monclient(hunting): get_auth_request con 0x559d1bc60970 auth_method 0 2024-09-14T11:04:34.064 INFO:tasks.workunit.client.0.smithi097.stderr: -392> 2024-09-14T11:04:33.769+0000 7f6eb6792640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:04:34.064 INFO:tasks.workunit.client.0.smithi097.stderr: -391> 2024-09-14T11:04:33.769+0000 7f6eb6792640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:04:34.064 INFO:tasks.workunit.client.0.smithi097.stderr: -390> 2024-09-14T11:04:33.769+0000 7f6eb6792640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:04:34.064 INFO:tasks.workunit.client.0.smithi097.stderr: -389> 2024-09-14T11:04:33.769+0000 7f6eb6f93640 10 monclient(hunting): get_auth_request con 0x559d1bc62040 auth_method 0 2024-09-14T11:04:34.064 INFO:tasks.workunit.client.0.smithi097.stderr: -388> 2024-09-14T11:04:33.769+0000 7f6eb6f93640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:04:34.064 INFO:tasks.workunit.client.0.smithi097.stderr: -387> 2024-09-14T11:04:33.769+0000 7f6eb6f93640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:04:34.064 INFO:tasks.workunit.client.0.smithi097.stderr: -386> 2024-09-14T11:04:33.769+0000 7f6eb6f93640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:04:34.065 INFO:tasks.workunit.client.0.smithi097.stderr: -385> 2024-09-14T11:04:33.769+0000 7f6eaffff640 10 monclient(hunting): get_auth_request con 0x559d1bc61c60 auth_method 0 2024-09-14T11:04:34.065 INFO:tasks.workunit.client.0.smithi097.stderr: -384> 2024-09-14T11:04:33.769+0000 7f6eaffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:04:34.065 INFO:tasks.workunit.client.0.smithi097.stderr: -383> 2024-09-14T11:04:33.769+0000 7f6eaffff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:04:34.065 INFO:tasks.workunit.client.0.smithi097.stderr: -382> 2024-09-14T11:04:33.769+0000 7f6eaffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:04:34.065 INFO:tasks.workunit.client.0.smithi097.stderr: -381> 2024-09-14T11:04:33.769+0000 7f6eb6792640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:04:34.065 INFO:tasks.workunit.client.0.smithi097.stderr: -380> 2024-09-14T11:04:33.769+0000 7f6eb6792640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:04:34.065 INFO:tasks.workunit.client.0.smithi097.stderr: -379> 2024-09-14T11:04:33.769+0000 7f6eb6792640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:04:34.065 INFO:tasks.workunit.client.0.smithi097.stderr: -378> 2024-09-14T11:04:33.769+0000 7f6eb6f93640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:04:34.065 INFO:tasks.workunit.client.0.smithi097.stderr: -377> 2024-09-14T11:04:33.769+0000 7f6eb6f93640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:04:34.065 INFO:tasks.workunit.client.0.smithi097.stderr: -376> 2024-09-14T11:04:33.769+0000 7f6eb6f93640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:04:34.065 INFO:tasks.workunit.client.0.smithi097.stderr: -375> 2024-09-14T11:04:33.769+0000 7f6eaffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:04:34.065 INFO:tasks.workunit.client.0.smithi097.stderr: -374> 2024-09-14T11:04:33.769+0000 7f6eaffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:04:34.065 INFO:tasks.workunit.client.0.smithi097.stderr: -373> 2024-09-14T11:04:33.769+0000 7f6eaffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:04:34.066 INFO:tasks.workunit.client.0.smithi097.stderr: -372> 2024-09-14T11:04:33.769+0000 7f6eb6f93640 10 monclient(hunting): handle_auth_done global_id 6704 payload 824 2024-09-14T11:04:34.066 INFO:tasks.workunit.client.0.smithi097.stderr: -371> 2024-09-14T11:04:33.769+0000 7f6eb6f93640 10 monclient: _finish_hunting 0 2024-09-14T11:04:34.066 INFO:tasks.workunit.client.0.smithi097.stderr: -370> 2024-09-14T11:04:33.769+0000 7f6eb6f93640 1 monclient: found mon.noname-c 2024-09-14T11:04:34.066 INFO:tasks.workunit.client.0.smithi097.stderr: -369> 2024-09-14T11:04:33.769+0000 7f6eb6f93640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:04:34.066 INFO:tasks.workunit.client.0.smithi097.stderr: -368> 2024-09-14T11:04:33.769+0000 7f6d9bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:04:34.066 INFO:tasks.workunit.client.0.smithi097.stderr: -367> 2024-09-14T11:04:33.769+0000 7f6d9bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:04:34.066 INFO:tasks.workunit.client.0.smithi097.stderr: -366> 2024-09-14T11:04:33.769+0000 7f6d9bfff640 10 monclient: dump: 2024-09-14T11:04:34.066 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:04:34.066 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:04:34.066 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:04:34.066 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:04:34.066 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:04:34.066 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:04:34.067 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:04:34.067 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:04:34.067 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:04:34.067 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:04:34.067 INFO:tasks.workunit.client.0.smithi097.stderr: -365> 2024-09-14T11:04:33.770+0000 7f6d9bfff640 10 monclient: _finish_auth 0 2024-09-14T11:04:34.067 INFO:tasks.workunit.client.0.smithi097.stderr: -364> 2024-09-14T11:04:33.770+0000 7f6d9bfff640 10 monclient: _check_auth_tickets 2024-09-14T11:04:34.067 INFO:tasks.workunit.client.0.smithi097.stderr: -363> 2024-09-14T11:04:33.770+0000 7f6d9bfff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:04:34.067 INFO:tasks.workunit.client.0.smithi097.stderr: -362> 2024-09-14T11:04:33.770+0000 7f6d9bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:04:34.067 INFO:tasks.workunit.client.0.smithi097.stderr: -361> 2024-09-14T11:04:33.770+0000 7f6d9bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:04:34.067 INFO:tasks.workunit.client.0.smithi097.stderr: -360> 2024-09-14T11:04:33.770+0000 7f6d9bfff640 10 monclient: dump: 2024-09-14T11:04:34.067 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:04:34.067 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:04:34.067 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:04:34.068 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:04:34.068 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:04:34.068 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:04:34.068 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:04:34.068 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:04:34.068 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:04:34.068 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:04:34.068 INFO:tasks.workunit.client.0.smithi097.stderr: -359> 2024-09-14T11:04:33.770+0000 7f6ebb013800 5 monclient: authenticate success, global_id 6704 2024-09-14T11:04:34.068 INFO:tasks.workunit.client.0.smithi097.stderr: -358> 2024-09-14T11:04:33.770+0000 7f6ebb013800 10 monclient: _renew_subs 2024-09-14T11:04:34.068 INFO:tasks.workunit.client.0.smithi097.stderr: -357> 2024-09-14T11:04:33.770+0000 7f6ebb013800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:04:34.068 INFO:tasks.workunit.client.0.smithi097.stderr: -356> 2024-09-14T11:04:33.770+0000 7f6eb7794640 4 set_mon_vals no callback set 2024-09-14T11:04:34.068 INFO:tasks.workunit.client.0.smithi097.stderr: -355> 2024-09-14T11:04:33.770+0000 7f6ebb013800 10 monclient: _renew_subs 2024-09-14T11:04:34.068 INFO:tasks.workunit.client.0.smithi097.stderr: -354> 2024-09-14T11:04:33.770+0000 7f6ebb013800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:04:34.068 INFO:tasks.workunit.client.0.smithi097.stderr: -353> 2024-09-14T11:04:33.771+0000 7f6d9bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:04:34.069 INFO:tasks.workunit.client.0.smithi097.stderr: -352> 2024-09-14T11:04:33.771+0000 7f6d9bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:04:34.069 INFO:tasks.workunit.client.0.smithi097.stderr: -351> 2024-09-14T11:04:33.771+0000 7f6d9bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:04:34.069 INFO:tasks.workunit.client.0.smithi097.stderr: -350> 2024-09-14T11:04:33.772+0000 7f6eaffff640 10 monclient: get_auth_request con 0x7f6d90077140 auth_method 0 2024-09-14T11:04:34.069 INFO:tasks.workunit.client.0.smithi097.stderr: -349> 2024-09-14T11:04:33.772+0000 7f6ebb013800 10 monclient: get_monmap_and_config 2024-09-14T11:04:34.069 INFO:tasks.workunit.client.0.smithi097.stderr: -348> 2024-09-14T11:04:33.772+0000 7f6ebb013800 10 monclient: build_initial_monmap 2024-09-14T11:04:34.069 INFO:tasks.workunit.client.0.smithi097.stderr: -347> 2024-09-14T11:04:33.772+0000 7f6ebb013800 1 build_initial for_mkfs: 0 2024-09-14T11:04:34.069 INFO:tasks.workunit.client.0.smithi097.stderr: -346> 2024-09-14T11:04:33.772+0000 7f6ebb013800 10 monclient: monmap: 2024-09-14T11:04:34.069 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:04:34.069 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:04:34.069 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:04:34.069 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:04:34.069 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:04:34.069 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:04:34.070 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:04:34.070 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:04:34.070 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:04:34.070 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:04:34.070 INFO:tasks.workunit.client.0.smithi097.stderr: -345> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc81820) adding auth protocol: cephx 2024-09-14T11:04:34.070 INFO:tasks.workunit.client.0.smithi097.stderr: -344> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc81820) adding auth protocol: cephx 2024-09-14T11:04:34.070 INFO:tasks.workunit.client.0.smithi097.stderr: -343> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc81820) adding auth protocol: cephx 2024-09-14T11:04:34.070 INFO:tasks.workunit.client.0.smithi097.stderr: -342> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc81820) adding con mode: secure 2024-09-14T11:04:34.070 INFO:tasks.workunit.client.0.smithi097.stderr: -341> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc81820) adding con mode: crc 2024-09-14T11:04:34.070 INFO:tasks.workunit.client.0.smithi097.stderr: -340> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc81820) adding con mode: secure 2024-09-14T11:04:34.070 INFO:tasks.workunit.client.0.smithi097.stderr: -339> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc81820) adding con mode: crc 2024-09-14T11:04:34.070 INFO:tasks.workunit.client.0.smithi097.stderr: -338> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc81820) adding con mode: secure 2024-09-14T11:04:34.070 INFO:tasks.workunit.client.0.smithi097.stderr: -337> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc81820) adding con mode: crc 2024-09-14T11:04:34.071 INFO:tasks.workunit.client.0.smithi097.stderr: -336> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc81820) adding con mode: crc 2024-09-14T11:04:34.071 INFO:tasks.workunit.client.0.smithi097.stderr: -335> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc81820) adding con mode: secure 2024-09-14T11:04:34.071 INFO:tasks.workunit.client.0.smithi097.stderr: -334> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc81820) adding con mode: crc 2024-09-14T11:04:34.071 INFO:tasks.workunit.client.0.smithi097.stderr: -333> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc81820) adding con mode: secure 2024-09-14T11:04:34.071 INFO:tasks.workunit.client.0.smithi097.stderr: -332> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc81820) adding con mode: crc 2024-09-14T11:04:34.071 INFO:tasks.workunit.client.0.smithi097.stderr: -331> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc81820) adding con mode: secure 2024-09-14T11:04:34.071 INFO:tasks.workunit.client.0.smithi097.stderr: -330> 2024-09-14T11:04:33.772+0000 7f6ebb013800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:04:34.071 INFO:tasks.workunit.client.0.smithi097.stderr: -329> 2024-09-14T11:04:33.772+0000 7f6ebb013800 10 monclient: init 2024-09-14T11:04:34.071 INFO:tasks.workunit.client.0.smithi097.stderr: -328> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8c850) adding auth protocol: cephx 2024-09-14T11:04:34.071 INFO:tasks.workunit.client.0.smithi097.stderr: -327> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8c850) adding auth protocol: cephx 2024-09-14T11:04:34.071 INFO:tasks.workunit.client.0.smithi097.stderr: -326> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8c850) adding auth protocol: cephx 2024-09-14T11:04:34.071 INFO:tasks.workunit.client.0.smithi097.stderr: -325> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8c850) adding con mode: secure 2024-09-14T11:04:34.071 INFO:tasks.workunit.client.0.smithi097.stderr: -324> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8c850) adding con mode: crc 2024-09-14T11:04:34.072 INFO:tasks.workunit.client.0.smithi097.stderr: -323> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8c850) adding con mode: secure 2024-09-14T11:04:34.072 INFO:tasks.workunit.client.0.smithi097.stderr: -322> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8c850) adding con mode: crc 2024-09-14T11:04:34.072 INFO:tasks.workunit.client.0.smithi097.stderr: -321> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8c850) adding con mode: secure 2024-09-14T11:04:34.072 INFO:tasks.workunit.client.0.smithi097.stderr: -320> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8c850) adding con mode: crc 2024-09-14T11:04:34.072 INFO:tasks.workunit.client.0.smithi097.stderr: -319> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8c850) adding con mode: crc 2024-09-14T11:04:34.072 INFO:tasks.workunit.client.0.smithi097.stderr: -318> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8c850) adding con mode: secure 2024-09-14T11:04:34.072 INFO:tasks.workunit.client.0.smithi097.stderr: -317> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8c850) adding con mode: crc 2024-09-14T11:04:34.072 INFO:tasks.workunit.client.0.smithi097.stderr: -316> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8c850) adding con mode: secure 2024-09-14T11:04:34.072 INFO:tasks.workunit.client.0.smithi097.stderr: -315> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8c850) adding con mode: crc 2024-09-14T11:04:34.072 INFO:tasks.workunit.client.0.smithi097.stderr: -314> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8c850) adding con mode: secure 2024-09-14T11:04:34.072 INFO:tasks.workunit.client.0.smithi097.stderr: -313> 2024-09-14T11:04:33.772+0000 7f6ebb013800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:04:34.072 INFO:tasks.workunit.client.0.smithi097.stderr: -312> 2024-09-14T11:04:33.773+0000 7f6ebb013800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:04:34.072 INFO:tasks.workunit.client.0.smithi097.stderr: -311> 2024-09-14T11:04:33.773+0000 7f6ebb013800 5 asok(0x559d1b9c0270) register_command rotate-key cmddesc rotate-key hook 0x7fffd5f8c998 EEXIST 2024-09-14T11:04:34.073 INFO:tasks.workunit.client.0.smithi097.stderr: -310> 2024-09-14T11:04:33.773+0000 7f6ebb013800 10 monclient: _reopen_session rank -1 2024-09-14T11:04:34.073 INFO:tasks.workunit.client.0.smithi097.stderr: -309> 2024-09-14T11:04:33.773+0000 7f6ebb013800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:04:34.073 INFO:tasks.workunit.client.0.smithi097.stderr: -308> 2024-09-14T11:04:33.773+0000 7f6ebb013800 10 monclient(hunting): picked mon.noname-a con 0x559d1bcb5ee0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:04:34.073 INFO:tasks.workunit.client.0.smithi097.stderr: -307> 2024-09-14T11:04:33.773+0000 7f6ebb013800 10 monclient(hunting): picked mon.noname-b con 0x559d1bc85cf0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:04:34.073 INFO:tasks.workunit.client.0.smithi097.stderr: -306> 2024-09-14T11:04:33.773+0000 7f6ebb013800 10 monclient(hunting): picked mon.noname-c con 0x559d1bcb12a0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:04:34.073 INFO:tasks.workunit.client.0.smithi097.stderr: -305> 2024-09-14T11:04:33.773+0000 7f6ebb013800 10 monclient(hunting): start opening mon connection 2024-09-14T11:04:34.073 INFO:tasks.workunit.client.0.smithi097.stderr: -304> 2024-09-14T11:04:33.773+0000 7f6ebb013800 10 monclient(hunting): start opening mon connection 2024-09-14T11:04:34.073 INFO:tasks.workunit.client.0.smithi097.stderr: -303> 2024-09-14T11:04:33.773+0000 7f6ebb013800 10 monclient(hunting): start opening mon connection 2024-09-14T11:04:34.073 INFO:tasks.workunit.client.0.smithi097.stderr: -302> 2024-09-14T11:04:33.773+0000 7f6ebb013800 10 monclient(hunting): _renew_subs 2024-09-14T11:04:34.073 INFO:tasks.workunit.client.0.smithi097.stderr: -301> 2024-09-14T11:04:33.773+0000 7f6ebb013800 10 monclient(hunting): authenticate will time out at 1955.426197s 2024-09-14T11:04:34.073 INFO:tasks.workunit.client.0.smithi097.stderr: -300> 2024-09-14T11:04:33.773+0000 7f6eb6792640 10 monclient(hunting): get_auth_request con 0x559d1bcb12a0 auth_method 0 2024-09-14T11:04:34.073 INFO:tasks.workunit.client.0.smithi097.stderr: -299> 2024-09-14T11:04:33.773+0000 7f6eb6792640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:04:34.073 INFO:tasks.workunit.client.0.smithi097.stderr: -298> 2024-09-14T11:04:33.773+0000 7f6eb6792640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:04:34.074 INFO:tasks.workunit.client.0.smithi097.stderr: -297> 2024-09-14T11:04:33.773+0000 7f6eb6792640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:04:34.074 INFO:tasks.workunit.client.0.smithi097.stderr: -296> 2024-09-14T11:04:33.773+0000 7f6eaffff640 10 monclient(hunting): get_auth_request con 0x559d1bcb5ee0 auth_method 0 2024-09-14T11:04:34.074 INFO:tasks.workunit.client.0.smithi097.stderr: -295> 2024-09-14T11:04:33.773+0000 7f6eaffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:04:34.074 INFO:tasks.workunit.client.0.smithi097.stderr: -294> 2024-09-14T11:04:33.773+0000 7f6eaffff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:04:34.074 INFO:tasks.workunit.client.0.smithi097.stderr: -293> 2024-09-14T11:04:33.773+0000 7f6eaffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:04:34.074 INFO:tasks.workunit.client.0.smithi097.stderr: -292> 2024-09-14T11:04:33.773+0000 7f6eb6f93640 10 monclient(hunting): get_auth_request con 0x559d1bc85cf0 auth_method 0 2024-09-14T11:04:34.074 INFO:tasks.workunit.client.0.smithi097.stderr: -291> 2024-09-14T11:04:33.773+0000 7f6eb6f93640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:04:34.074 INFO:tasks.workunit.client.0.smithi097.stderr: -290> 2024-09-14T11:04:33.773+0000 7f6eb6f93640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:04:34.074 INFO:tasks.workunit.client.0.smithi097.stderr: -289> 2024-09-14T11:04:33.773+0000 7f6eb6f93640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:04:34.074 INFO:tasks.workunit.client.0.smithi097.stderr: -288> 2024-09-14T11:04:33.773+0000 7f6eb6792640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:04:34.074 INFO:tasks.workunit.client.0.smithi097.stderr: -287> 2024-09-14T11:04:33.773+0000 7f6eb6792640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:04:34.074 INFO:tasks.workunit.client.0.smithi097.stderr: -286> 2024-09-14T11:04:33.773+0000 7f6eb6792640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:04:34.074 INFO:tasks.workunit.client.0.smithi097.stderr: -285> 2024-09-14T11:04:33.773+0000 7f6eaffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:04:34.075 INFO:tasks.workunit.client.0.smithi097.stderr: -284> 2024-09-14T11:04:33.773+0000 7f6eaffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:04:34.075 INFO:tasks.workunit.client.0.smithi097.stderr: -283> 2024-09-14T11:04:33.773+0000 7f6eaffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:04:34.075 INFO:tasks.workunit.client.0.smithi097.stderr: -282> 2024-09-14T11:04:33.773+0000 7f6eb6f93640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:04:34.075 INFO:tasks.workunit.client.0.smithi097.stderr: -281> 2024-09-14T11:04:33.773+0000 7f6eb6f93640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:04:34.075 INFO:tasks.workunit.client.0.smithi097.stderr: -280> 2024-09-14T11:04:33.773+0000 7f6eb6f93640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:04:34.075 INFO:tasks.workunit.client.0.smithi097.stderr: -279> 2024-09-14T11:04:33.773+0000 7f6eb6792640 10 monclient(hunting): handle_auth_done global_id 6707 payload 274 2024-09-14T11:04:34.075 INFO:tasks.workunit.client.0.smithi097.stderr: -278> 2024-09-14T11:04:33.773+0000 7f6eb6792640 10 monclient: _finish_hunting 0 2024-09-14T11:04:34.075 INFO:tasks.workunit.client.0.smithi097.stderr: -277> 2024-09-14T11:04:33.773+0000 7f6eb6792640 1 monclient: found mon.noname-c 2024-09-14T11:04:34.075 INFO:tasks.workunit.client.0.smithi097.stderr: -276> 2024-09-14T11:04:33.773+0000 7f6eb6792640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:04:34.075 INFO:tasks.workunit.client.0.smithi097.stderr: -275> 2024-09-14T11:04:33.773+0000 7f6d99ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:04:34.075 INFO:tasks.workunit.client.0.smithi097.stderr: -274> 2024-09-14T11:04:33.773+0000 7f6d99ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:04:34.075 INFO:tasks.workunit.client.0.smithi097.stderr: -273> 2024-09-14T11:04:33.773+0000 7f6d99ffb640 10 monclient: dump: 2024-09-14T11:04:34.075 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:04:34.075 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:04:34.076 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:04:34.076 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:04:34.076 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:04:34.076 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:04:34.076 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:04:34.076 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:04:34.076 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:04:34.076 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:04:34.076 INFO:tasks.workunit.client.0.smithi097.stderr: -272> 2024-09-14T11:04:33.773+0000 7f6d99ffb640 10 monclient: _finish_auth 0 2024-09-14T11:04:34.076 INFO:tasks.workunit.client.0.smithi097.stderr: -271> 2024-09-14T11:04:33.773+0000 7f6d99ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:04:34.076 INFO:tasks.workunit.client.0.smithi097.stderr: -270> 2024-09-14T11:04:33.773+0000 7f6d99ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:04:34.076 INFO:tasks.workunit.client.0.smithi097.stderr: -269> 2024-09-14T11:04:33.773+0000 7f6d99ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:04:34.076 INFO:tasks.workunit.client.0.smithi097.stderr: -268> 2024-09-14T11:04:33.773+0000 7f6d99ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:04:34.076 INFO:tasks.workunit.client.0.smithi097.stderr: -267> 2024-09-14T11:04:33.773+0000 7f6d99ffb640 10 monclient: dump: 2024-09-14T11:04:34.077 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:04:34.077 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:04:34.077 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:04:34.077 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:04:34.077 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:04:34.077 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:04:34.077 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:04:34.077 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:04:34.077 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:04:34.077 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:04:34.077 INFO:tasks.workunit.client.0.smithi097.stderr: -266> 2024-09-14T11:04:33.773+0000 7f6ebb013800 5 monclient: authenticate success, global_id 6707 2024-09-14T11:04:34.077 INFO:tasks.workunit.client.0.smithi097.stderr: -265> 2024-09-14T11:04:33.773+0000 7f6ebb013800 10 monclient: get_monmap_and_config success 2024-09-14T11:04:34.077 INFO:tasks.workunit.client.0.smithi097.stderr: -264> 2024-09-14T11:04:33.773+0000 7f6ebb013800 4 set_mon_vals no callback set 2024-09-14T11:04:34.078 INFO:tasks.workunit.client.0.smithi097.stderr: -263> 2024-09-14T11:04:33.774+0000 7f6ebb013800 10 monclient: shutdown 2024-09-14T11:04:34.078 INFO:tasks.workunit.client.0.smithi097.stderr: -262> 2024-09-14T11:04:33.774+0000 7f6ebb013800 10 monclient: build_initial_monmap 2024-09-14T11:04:34.078 INFO:tasks.workunit.client.0.smithi097.stderr: -261> 2024-09-14T11:04:33.774+0000 7f6ebb013800 1 build_initial for_mkfs: 0 2024-09-14T11:04:34.078 INFO:tasks.workunit.client.0.smithi097.stderr: -260> 2024-09-14T11:04:33.774+0000 7f6ebb013800 10 monclient: monmap: 2024-09-14T11:04:34.078 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:04:34.078 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:04:34.078 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:04:34.078 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:04:34.078 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:04:34.078 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:04:34.078 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:04:34.078 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:04:34.078 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:04:34.078 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:04:34.079 INFO:tasks.workunit.client.0.smithi097.stderr: -259> 2024-09-14T11:04:33.774+0000 7f6ebb013800 5 AuthRegistry(0x559d1bcb1750) adding auth protocol: cephx 2024-09-14T11:04:34.079 INFO:tasks.workunit.client.0.smithi097.stderr: -258> 2024-09-14T11:04:33.774+0000 7f6ebb013800 5 AuthRegistry(0x559d1bcb1750) adding auth protocol: cephx 2024-09-14T11:04:34.079 INFO:tasks.workunit.client.0.smithi097.stderr: -257> 2024-09-14T11:04:33.774+0000 7f6ebb013800 5 AuthRegistry(0x559d1bcb1750) adding auth protocol: cephx 2024-09-14T11:04:34.079 INFO:tasks.workunit.client.0.smithi097.stderr: -256> 2024-09-14T11:04:33.774+0000 7f6ebb013800 5 AuthRegistry(0x559d1bcb1750) adding con mode: secure 2024-09-14T11:04:34.079 INFO:tasks.workunit.client.0.smithi097.stderr: -255> 2024-09-14T11:04:33.774+0000 7f6ebb013800 5 AuthRegistry(0x559d1bcb1750) adding con mode: crc 2024-09-14T11:04:34.079 INFO:tasks.workunit.client.0.smithi097.stderr: -254> 2024-09-14T11:04:33.774+0000 7f6ebb013800 5 AuthRegistry(0x559d1bcb1750) adding con mode: secure 2024-09-14T11:04:34.079 INFO:tasks.workunit.client.0.smithi097.stderr: -253> 2024-09-14T11:04:33.774+0000 7f6ebb013800 5 AuthRegistry(0x559d1bcb1750) adding con mode: crc 2024-09-14T11:04:34.079 INFO:tasks.workunit.client.0.smithi097.stderr: -252> 2024-09-14T11:04:33.774+0000 7f6ebb013800 5 AuthRegistry(0x559d1bcb1750) adding con mode: secure 2024-09-14T11:04:34.079 INFO:tasks.workunit.client.0.smithi097.stderr: -251> 2024-09-14T11:04:33.774+0000 7f6ebb013800 5 AuthRegistry(0x559d1bcb1750) adding con mode: crc 2024-09-14T11:04:34.079 INFO:tasks.workunit.client.0.smithi097.stderr: -250> 2024-09-14T11:04:33.774+0000 7f6ebb013800 5 AuthRegistry(0x559d1bcb1750) adding con mode: crc 2024-09-14T11:04:34.079 INFO:tasks.workunit.client.0.smithi097.stderr: -249> 2024-09-14T11:04:33.774+0000 7f6ebb013800 5 AuthRegistry(0x559d1bcb1750) adding con mode: secure 2024-09-14T11:04:34.080 INFO:tasks.workunit.client.0.smithi097.stderr: -248> 2024-09-14T11:04:33.774+0000 7f6ebb013800 5 AuthRegistry(0x559d1bcb1750) adding con mode: crc 2024-09-14T11:04:34.080 INFO:tasks.workunit.client.0.smithi097.stderr: -247> 2024-09-14T11:04:33.774+0000 7f6ebb013800 5 AuthRegistry(0x559d1bcb1750) adding con mode: secure 2024-09-14T11:04:34.080 INFO:tasks.workunit.client.0.smithi097.stderr: -246> 2024-09-14T11:04:33.774+0000 7f6ebb013800 5 AuthRegistry(0x559d1bcb1750) adding con mode: crc 2024-09-14T11:04:34.080 INFO:tasks.workunit.client.0.smithi097.stderr: -245> 2024-09-14T11:04:33.774+0000 7f6ebb013800 5 AuthRegistry(0x559d1bcb1750) adding con mode: secure 2024-09-14T11:04:34.080 INFO:tasks.workunit.client.0.smithi097.stderr: -244> 2024-09-14T11:04:33.774+0000 7f6ebb013800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:04:34.080 INFO:tasks.workunit.client.0.smithi097.stderr: -243> 2024-09-14T11:04:33.774+0000 7f6ebb013800 1 librados: starting msgr at 2024-09-14T11:04:34.080 INFO:tasks.workunit.client.0.smithi097.stderr: -242> 2024-09-14T11:04:33.774+0000 7f6ebb013800 1 librados: starting objecter 2024-09-14T11:04:34.080 INFO:tasks.workunit.client.0.smithi097.stderr: -241> 2024-09-14T11:04:33.774+0000 7f6ebb013800 5 asok(0x559d1b9c0270) register_command objecter_requests cmddesc objecter_requests hook 0x559d1bc83e80 EEXIST 2024-09-14T11:04:34.080 INFO:tasks.workunit.client.0.smithi097.stderr: -240> 2024-09-14T11:04:33.775+0000 7f6ebb013800 1 librados: setting wanted keys 2024-09-14T11:04:34.080 INFO:tasks.workunit.client.0.smithi097.stderr: -239> 2024-09-14T11:04:33.775+0000 7f6ebb013800 1 librados: calling monclient init 2024-09-14T11:04:34.080 INFO:tasks.workunit.client.0.smithi097.stderr: -238> 2024-09-14T11:04:33.775+0000 7f6ebb013800 10 monclient: init 2024-09-14T11:04:34.080 INFO:tasks.workunit.client.0.smithi097.stderr: -237> 2024-09-14T11:04:33.775+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc76520) adding auth protocol: cephx 2024-09-14T11:04:34.080 INFO:tasks.workunit.client.0.smithi097.stderr: -236> 2024-09-14T11:04:33.775+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc76520) adding auth protocol: cephx 2024-09-14T11:04:34.081 INFO:tasks.workunit.client.0.smithi097.stderr: -235> 2024-09-14T11:04:33.775+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc76520) adding auth protocol: cephx 2024-09-14T11:04:34.081 INFO:tasks.workunit.client.0.smithi097.stderr: -234> 2024-09-14T11:04:33.775+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc76520) adding con mode: secure 2024-09-14T11:04:34.081 INFO:tasks.workunit.client.0.smithi097.stderr: -233> 2024-09-14T11:04:33.775+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc76520) adding con mode: crc 2024-09-14T11:04:34.081 INFO:tasks.workunit.client.0.smithi097.stderr: -232> 2024-09-14T11:04:33.775+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc76520) adding con mode: secure 2024-09-14T11:04:34.081 INFO:tasks.workunit.client.0.smithi097.stderr: -231> 2024-09-14T11:04:33.775+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc76520) adding con mode: crc 2024-09-14T11:04:34.081 INFO:tasks.workunit.client.0.smithi097.stderr: -230> 2024-09-14T11:04:33.775+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc76520) adding con mode: secure 2024-09-14T11:04:34.081 INFO:tasks.workunit.client.0.smithi097.stderr: -229> 2024-09-14T11:04:33.775+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc76520) adding con mode: crc 2024-09-14T11:04:34.081 INFO:tasks.workunit.client.0.smithi097.stderr: -228> 2024-09-14T11:04:33.775+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc76520) adding con mode: crc 2024-09-14T11:04:34.081 INFO:tasks.workunit.client.0.smithi097.stderr: -227> 2024-09-14T11:04:33.775+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc76520) adding con mode: secure 2024-09-14T11:04:34.081 INFO:tasks.workunit.client.0.smithi097.stderr: -226> 2024-09-14T11:04:33.775+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc76520) adding con mode: crc 2024-09-14T11:04:34.081 INFO:tasks.workunit.client.0.smithi097.stderr: -225> 2024-09-14T11:04:33.775+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc76520) adding con mode: secure 2024-09-14T11:04:34.081 INFO:tasks.workunit.client.0.smithi097.stderr: -224> 2024-09-14T11:04:33.775+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc76520) adding con mode: crc 2024-09-14T11:04:34.081 INFO:tasks.workunit.client.0.smithi097.stderr: -223> 2024-09-14T11:04:33.775+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc76520) adding con mode: secure 2024-09-14T11:04:34.082 INFO:tasks.workunit.client.0.smithi097.stderr: -222> 2024-09-14T11:04:33.775+0000 7f6ebb013800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:04:34.082 INFO:tasks.workunit.client.0.smithi097.stderr: -221> 2024-09-14T11:04:33.775+0000 7f6ebb013800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:04:34.082 INFO:tasks.workunit.client.0.smithi097.stderr: -220> 2024-09-14T11:04:33.775+0000 7f6ebb013800 5 asok(0x559d1b9c0270) register_command rotate-key cmddesc rotate-key hook 0x559d1bc76668 EEXIST 2024-09-14T11:04:34.082 INFO:tasks.workunit.client.0.smithi097.stderr: -219> 2024-09-14T11:04:33.775+0000 7f6ebb013800 10 monclient: _reopen_session rank -1 2024-09-14T11:04:34.082 INFO:tasks.workunit.client.0.smithi097.stderr: -218> 2024-09-14T11:04:33.775+0000 7f6ebb013800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:04:34.082 INFO:tasks.workunit.client.0.smithi097.stderr: -217> 2024-09-14T11:04:33.775+0000 7f6ebb013800 10 monclient(hunting): picked mon.noname-b con 0x559d1bc85cf0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:04:34.082 INFO:tasks.workunit.client.0.smithi097.stderr: -216> 2024-09-14T11:04:33.775+0000 7f6ebb013800 10 monclient(hunting): picked mon.noname-c con 0x559d1bcb12a0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:04:34.082 INFO:tasks.workunit.client.0.smithi097.stderr: -215> 2024-09-14T11:04:33.775+0000 7f6ebb013800 10 monclient(hunting): picked mon.noname-a con 0x559d1bcb5ee0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:04:34.084 INFO:tasks.workunit.client.0.smithi097.stderr: -214> 2024-09-14T11:04:33.775+0000 7f6ebb013800 10 monclient(hunting): start opening mon connection 2024-09-14T11:04:34.084 INFO:tasks.workunit.client.0.smithi097.stderr: -213> 2024-09-14T11:04:33.775+0000 7f6ebb013800 10 monclient(hunting): start opening mon connection 2024-09-14T11:04:34.084 INFO:tasks.workunit.client.0.smithi097.stderr: -212> 2024-09-14T11:04:33.775+0000 7f6ebb013800 10 monclient(hunting): start opening mon connection 2024-09-14T11:04:34.084 INFO:tasks.workunit.client.0.smithi097.stderr: -211> 2024-09-14T11:04:33.775+0000 7f6ebb013800 10 monclient(hunting): _renew_subs 2024-09-14T11:04:34.084 INFO:tasks.workunit.client.0.smithi097.stderr: -210> 2024-09-14T11:04:33.775+0000 7f6ebb013800 10 monclient(hunting): authenticate will time out at 1955.428543s 2024-09-14T11:04:34.084 INFO:tasks.workunit.client.0.smithi097.stderr: -209> 2024-09-14T11:04:33.775+0000 7f6eb6792640 10 monclient(hunting): get_auth_request con 0x559d1bcb5ee0 auth_method 0 2024-09-14T11:04:34.084 INFO:tasks.workunit.client.0.smithi097.stderr: -208> 2024-09-14T11:04:33.775+0000 7f6eb6792640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:04:34.084 INFO:tasks.workunit.client.0.smithi097.stderr: -207> 2024-09-14T11:04:33.775+0000 7f6eb6792640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:04:34.084 INFO:tasks.workunit.client.0.smithi097.stderr: -206> 2024-09-14T11:04:33.775+0000 7f6eb6792640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:04:34.084 INFO:tasks.workunit.client.0.smithi097.stderr: -205> 2024-09-14T11:04:33.775+0000 7f6eb6f93640 10 monclient(hunting): get_auth_request con 0x559d1bcb12a0 auth_method 0 2024-09-14T11:04:34.084 INFO:tasks.workunit.client.0.smithi097.stderr: -204> 2024-09-14T11:04:33.775+0000 7f6eb6f93640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:04:34.084 INFO:tasks.workunit.client.0.smithi097.stderr: -203> 2024-09-14T11:04:33.775+0000 7f6eb6f93640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:04:34.084 INFO:tasks.workunit.client.0.smithi097.stderr: -202> 2024-09-14T11:04:33.775+0000 7f6eb6f93640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:04:34.085 INFO:tasks.workunit.client.0.smithi097.stderr: -201> 2024-09-14T11:04:33.775+0000 7f6eb6792640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:04:34.085 INFO:tasks.workunit.client.0.smithi097.stderr: -200> 2024-09-14T11:04:33.775+0000 7f6eb6792640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:04:34.085 INFO:tasks.workunit.client.0.smithi097.stderr: -199> 2024-09-14T11:04:33.775+0000 7f6eb6792640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:04:34.085 INFO:tasks.workunit.client.0.smithi097.stderr: -198> 2024-09-14T11:04:33.775+0000 7f6eb6f93640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:04:34.085 INFO:tasks.workunit.client.0.smithi097.stderr: -197> 2024-09-14T11:04:33.775+0000 7f6eb6f93640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:04:34.085 INFO:tasks.workunit.client.0.smithi097.stderr: -196> 2024-09-14T11:04:33.775+0000 7f6eb6f93640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:04:34.085 INFO:tasks.workunit.client.0.smithi097.stderr: -195> 2024-09-14T11:04:33.775+0000 7f6eb6792640 10 monclient(hunting): handle_auth_done global_id 7119 payload 824 2024-09-14T11:04:34.085 INFO:tasks.workunit.client.0.smithi097.stderr: -194> 2024-09-14T11:04:33.775+0000 7f6eb6792640 10 monclient: _finish_hunting 0 2024-09-14T11:04:34.085 INFO:tasks.workunit.client.0.smithi097.stderr: -193> 2024-09-14T11:04:33.775+0000 7f6eb6792640 1 monclient: found mon.noname-a 2024-09-14T11:04:34.085 INFO:tasks.workunit.client.0.smithi097.stderr: -192> 2024-09-14T11:04:33.775+0000 7f6eb6792640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-14T11:04:34.085 INFO:tasks.workunit.client.0.smithi097.stderr: -191> 2024-09-14T11:04:33.775+0000 7f6eaffff640 10 monclient: get_auth_request con 0x559d1bc85cf0 auth_method 0 2024-09-14T11:04:34.086 INFO:tasks.workunit.client.0.smithi097.stderr: -190> 2024-09-14T11:04:33.776+0000 7f6d87fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:04:34.086 INFO:tasks.workunit.client.0.smithi097.stderr: -189> 2024-09-14T11:04:33.776+0000 7f6d87fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:04:34.086 INFO:tasks.workunit.client.0.smithi097.stderr: -188> 2024-09-14T11:04:33.776+0000 7f6d87fff640 10 monclient: dump: 2024-09-14T11:04:34.086 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:04:34.086 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:04:34.086 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:04:34.086 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:04:34.086 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:04:34.086 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:04:34.086 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:04:34.086 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:04:34.086 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:04:34.086 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:04:34.087 INFO:tasks.workunit.client.0.smithi097.stderr: -187> 2024-09-14T11:04:33.776+0000 7f6d87fff640 10 monclient: _finish_auth 0 2024-09-14T11:04:34.087 INFO:tasks.workunit.client.0.smithi097.stderr: -186> 2024-09-14T11:04:33.776+0000 7f6d87fff640 10 monclient: _check_auth_tickets 2024-09-14T11:04:34.087 INFO:tasks.workunit.client.0.smithi097.stderr: -185> 2024-09-14T11:04:33.776+0000 7f6ebb013800 5 monclient: authenticate success, global_id 7119 2024-09-14T11:04:34.087 INFO:tasks.workunit.client.0.smithi097.stderr: -184> 2024-09-14T11:04:33.776+0000 7f6d87fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:04:34.087 INFO:tasks.workunit.client.0.smithi097.stderr: -183> 2024-09-14T11:04:33.776+0000 7f6d87fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:04:34.087 INFO:tasks.workunit.client.0.smithi097.stderr: -182> 2024-09-14T11:04:33.776+0000 7f6d87fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:04:34.087 INFO:tasks.workunit.client.0.smithi097.stderr: -181> 2024-09-14T11:04:33.776+0000 7f6d87fff640 10 monclient: dump: 2024-09-14T11:04:34.087 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:04:34.087 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:04:34.087 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:04:34.087 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:04:34.087 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:04:34.087 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:04:34.088 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:04:34.088 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:04:34.088 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:04:34.088 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:04:34.088 INFO:tasks.workunit.client.0.smithi097.stderr: -180> 2024-09-14T11:04:33.776+0000 7f6ebb013800 10 monclient: _renew_subs 2024-09-14T11:04:34.088 INFO:tasks.workunit.client.0.smithi097.stderr: -179> 2024-09-14T11:04:33.776+0000 7f6d99ffb640 4 set_mon_vals no callback set 2024-09-14T11:04:34.088 INFO:tasks.workunit.client.0.smithi097.stderr: -178> 2024-09-14T11:04:33.776+0000 7f6ebb013800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:04:34.088 INFO:tasks.workunit.client.0.smithi097.stderr: -177> 2024-09-14T11:04:33.776+0000 7f6ebb013800 10 monclient: _renew_subs 2024-09-14T11:04:34.088 INFO:tasks.workunit.client.0.smithi097.stderr: -176> 2024-09-14T11:04:33.776+0000 7f6ebb013800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:04:34.088 INFO:tasks.workunit.client.0.smithi097.stderr: -175> 2024-09-14T11:04:33.776+0000 7f6ebb013800 1 librados: init done 2024-09-14T11:04:34.088 INFO:tasks.workunit.client.0.smithi097.stderr: -174> 2024-09-14T11:04:33.776+0000 7f6ebb013800 5 asok(0x559d1b9c0270) register_command cr dump hook 0x559d1bcaa2e8 2024-09-14T11:04:34.088 INFO:tasks.workunit.client.0.smithi097.stderr: -173> 2024-09-14T11:04:33.778+0000 7f6ebb013800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.088 INFO:tasks.workunit.client.0.smithi097.stderr: -172> 2024-09-14T11:04:33.779+0000 7f6d87fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:04:34.088 INFO:tasks.workunit.client.0.smithi097.stderr: -171> 2024-09-14T11:04:33.779+0000 7f6d87fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:04:34.089 INFO:tasks.workunit.client.0.smithi097.stderr: -170> 2024-09-14T11:04:33.779+0000 7f6d87fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:04:34.089 INFO:tasks.workunit.client.0.smithi097.stderr: -169> 2024-09-14T11:04:33.779+0000 7f6eaffff640 10 monclient: get_auth_request con 0x7f6d80077230 auth_method 0 2024-09-14T11:04:34.089 INFO:tasks.workunit.client.0.smithi097.stderr: -168> 2024-09-14T11:04:33.779+0000 7f6eb6f93640 10 monclient: get_auth_request con 0x559d1bcd0530 auth_method 0 2024-09-14T11:04:34.089 INFO:tasks.workunit.client.0.smithi097.stderr: -167> 2024-09-14T11:04:33.780+0000 7f6ebb013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:34.089 INFO:tasks.workunit.client.0.smithi097.stderr: -166> 2024-09-14T11:04:33.780+0000 7f6ebb013800 20 realm 2024-09-14T11:04:34.089 INFO:tasks.workunit.client.0.smithi097.stderr: -165> 2024-09-14T11:04:33.780+0000 7f6ebb013800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.089 INFO:tasks.workunit.client.0.smithi097.stderr: -164> 2024-09-14T11:04:33.780+0000 7f6ebb013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:34.089 INFO:tasks.workunit.client.0.smithi097.stderr: -163> 2024-09-14T11:04:33.780+0000 7f6ebb013800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:04:34.089 INFO:tasks.workunit.client.0.smithi097.stderr: -162> 2024-09-14T11:04:33.780+0000 7f6ebb013800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.089 INFO:tasks.workunit.client.0.smithi097.stderr: -161> 2024-09-14T11:04:33.780+0000 7f6ebb013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:34.089 INFO:tasks.workunit.client.0.smithi097.stderr: -160> 2024-09-14T11:04:33.780+0000 7f6ebb013800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.089 INFO:tasks.workunit.client.0.smithi097.stderr: -159> 2024-09-14T11:04:33.781+0000 7f6eaffff640 10 monclient: get_auth_request con 0x559d1bcd4700 auth_method 0 2024-09-14T11:04:34.089 INFO:tasks.workunit.client.0.smithi097.stderr: -158> 2024-09-14T11:04:33.781+0000 7f6ebb013800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:04:34.090 INFO:tasks.workunit.client.0.smithi097.stderr: -157> 2024-09-14T11:04:33.781+0000 7f6ebb013800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.090 INFO:tasks.workunit.client.0.smithi097.stderr: -156> 2024-09-14T11:04:33.781+0000 7f6eb6f93640 10 monclient: get_auth_request con 0x559d1bcd7f60 auth_method 0 2024-09-14T11:04:34.090 INFO:tasks.workunit.client.0.smithi097.stderr: -155> 2024-09-14T11:04:33.782+0000 7f6ebb013800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:04:34.090 INFO:tasks.workunit.client.0.smithi097.stderr: -154> 2024-09-14T11:04:33.782+0000 7f6ebb013800 20 searching for the correct realm 2024-09-14T11:04:34.090 INFO:tasks.workunit.client.0.smithi097.stderr: -153> 2024-09-14T11:04:33.782+0000 7f6eb6792640 10 monclient: get_auth_request con 0x559d1bcdcc70 auth_method 0 2024-09-14T11:04:34.090 INFO:tasks.workunit.client.0.smithi097.stderr: -152> 2024-09-14T11:04:33.783+0000 7f6eaffff640 10 monclient: get_auth_request con 0x7f6ea80e4be0 auth_method 0 2024-09-14T11:04:34.090 INFO:tasks.workunit.client.0.smithi097.stderr: -151> 2024-09-14T11:04:33.784+0000 7f6eb6f93640 0 -- 172.21.15.97:0/440857257 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f6ea0018070 msgr2=0x7f6ea007ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:04:34.090 INFO:tasks.workunit.client.0.smithi097.stderr: -150> 2024-09-14T11:04:33.986+0000 7f6eb6f93640 10 monclient: get_auth_request con 0x7f6ea0018070 auth_method 0 2024-09-14T11:04:34.090 INFO:tasks.workunit.client.0.smithi097.stderr: -149> 2024-09-14T11:04:33.988+0000 7f6eb6792640 10 monclient: get_auth_request con 0x7f6ea0088bc0 auth_method 0 2024-09-14T11:04:34.090 INFO:tasks.workunit.client.0.smithi097.stderr: -148> 2024-09-14T11:04:33.989+0000 7f6eaffff640 10 monclient: get_auth_request con 0x7f6ea80b7800 auth_method 0 2024-09-14T11:04:34.090 INFO:tasks.workunit.client.0.smithi097.stderr: -147> 2024-09-14T11:04:33.989+0000 7f6eaffff640 0 -- 172.21.15.97:0/440857257 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f6ea80b7800 msgr2=0x7f6ea80b1640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:04:34.090 INFO:tasks.workunit.client.0.smithi097.stderr: -146> 2024-09-14T11:04:33.989+0000 7f6d87fff640 1 client.7119.objecter ms_handle_reset 0x7f6ea80b7800 session 0x7f6ea80bd040 osd.3 2024-09-14T11:04:34.090 INFO:tasks.workunit.client.0.smithi097.stderr: -145> 2024-09-14T11:04:33.989+0000 7f6d87fff640 10 monclient: _renew_subs 2024-09-14T11:04:34.090 INFO:tasks.workunit.client.0.smithi097.stderr: -144> 2024-09-14T11:04:33.989+0000 7f6d87fff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:04:34.091 INFO:tasks.workunit.client.0.smithi097.stderr: -143> 2024-09-14T11:04:33.989+0000 7f6eaffff640 10 monclient: get_auth_request con 0x7f6d80086d30 auth_method 0 2024-09-14T11:04:34.091 INFO:tasks.workunit.client.0.smithi097.stderr: -142> 2024-09-14T11:04:33.995+0000 7f6ebb013800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:04:34.091 INFO:tasks.workunit.client.0.smithi097.stderr: -141> 2024-09-14T11:04:33.995+0000 7f6ebb013800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:04:34.091 INFO:tasks.workunit.client.0.smithi097.stderr: -140> 2024-09-14T11:04:33.995+0000 7f6ebb013800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:04:34.091 INFO:tasks.workunit.client.0.smithi097.stderr: -139> 2024-09-14T11:04:33.995+0000 7f6ebb013800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:04:34.091 INFO:tasks.workunit.client.0.smithi097.stderr: -138> 2024-09-14T11:04:33.995+0000 7f6ebb013800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:04:34.091 INFO:tasks.workunit.client.0.smithi097.stderr: -137> 2024-09-14T11:04:33.995+0000 7f6ebb013800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:04:34.091 INFO:tasks.workunit.client.0.smithi097.stderr: -136> 2024-09-14T11:04:33.995+0000 7f6ebb013800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.091 INFO:tasks.workunit.client.0.smithi097.stderr: -135> 2024-09-14T11:04:33.995+0000 7f6ebb013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:34.091 INFO:tasks.workunit.client.0.smithi097.stderr: -134> 2024-09-14T11:04:33.995+0000 7f6ebb013800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.091 INFO:tasks.workunit.client.0.smithi097.stderr: -133> 2024-09-14T11:04:33.995+0000 7f6ebb013800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:04:34.091 INFO:tasks.workunit.client.0.smithi097.stderr: -132> 2024-09-14T11:04:33.995+0000 7f6ebb013800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.091 INFO:tasks.workunit.client.0.smithi097.stderr: -131> 2024-09-14T11:04:33.996+0000 7f6ebb013800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:04:34.091 INFO:tasks.workunit.client.0.smithi097.stderr: -130> 2024-09-14T11:04:33.996+0000 7f6ebb013800 20 zone default found 2024-09-14T11:04:34.091 INFO:tasks.workunit.client.0.smithi097.stderr: -129> 2024-09-14T11:04:33.996+0000 7f6ebb013800 4 Realm: () 2024-09-14T11:04:34.092 INFO:tasks.workunit.client.0.smithi097.stderr: -128> 2024-09-14T11:04:33.996+0000 7f6ebb013800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:04:34.092 INFO:tasks.workunit.client.0.smithi097.stderr: -127> 2024-09-14T11:04:33.996+0000 7f6ebb013800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:04:34.092 INFO:tasks.workunit.client.0.smithi097.stderr: -126> 2024-09-14T11:04:33.996+0000 7f6ebb013800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:04:34.092 INFO:tasks.workunit.client.0.smithi097.stderr: -125> 2024-09-14T11:04:33.996+0000 7f6ebb013800 20 zonegroup default 2024-09-14T11:04:34.092 INFO:tasks.workunit.client.0.smithi097.stderr: -124> 2024-09-14T11:04:33.996+0000 7f6ebb013800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.092 INFO:tasks.workunit.client.0.smithi097.stderr: -123> 2024-09-14T11:04:33.996+0000 7f6ebb013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:34.092 INFO:tasks.workunit.client.0.smithi097.stderr: -122> 2024-09-14T11:04:33.996+0000 7f6ebb013800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.092 INFO:tasks.workunit.client.0.smithi097.stderr: -121> 2024-09-14T11:04:33.996+0000 7f6ebb013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:34.092 INFO:tasks.workunit.client.0.smithi097.stderr: -120> 2024-09-14T11:04:33.996+0000 7f6ebb013800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.092 INFO:tasks.workunit.client.0.smithi097.stderr: -119> 2024-09-14T11:04:33.996+0000 7f6ebb013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:34.092 INFO:tasks.workunit.client.0.smithi097.stderr: -118> 2024-09-14T11:04:33.996+0000 7f6ebb013800 20 started sync module instance, tier type = 2024-09-14T11:04:34.092 INFO:tasks.workunit.client.0.smithi097.stderr: -117> 2024-09-14T11:04:33.996+0000 7f6ebb013800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:04:34.092 INFO:tasks.workunit.client.0.smithi097.stderr: -116> 2024-09-14T11:04:34.005+0000 7f6ebb013800 20 add_watcher() i=0 2024-09-14T11:04:34.092 INFO:tasks.workunit.client.0.smithi097.stderr: -115> 2024-09-14T11:04:34.005+0000 7f6ebb013800 20 add_watcher() i=1 2024-09-14T11:04:34.093 INFO:tasks.workunit.client.0.smithi097.stderr: -114> 2024-09-14T11:04:34.005+0000 7f6ebb013800 20 add_watcher() i=2 2024-09-14T11:04:34.093 INFO:tasks.workunit.client.0.smithi097.stderr: -113> 2024-09-14T11:04:34.005+0000 7f6ebb013800 20 add_watcher() i=3 2024-09-14T11:04:34.093 INFO:tasks.workunit.client.0.smithi097.stderr: -112> 2024-09-14T11:04:34.005+0000 7f6ebb013800 20 add_watcher() i=4 2024-09-14T11:04:34.093 INFO:tasks.workunit.client.0.smithi097.stderr: -111> 2024-09-14T11:04:34.005+0000 7f6ebb013800 20 add_watcher() i=5 2024-09-14T11:04:34.093 INFO:tasks.workunit.client.0.smithi097.stderr: -110> 2024-09-14T11:04:34.005+0000 7f6ebb013800 20 add_watcher() i=6 2024-09-14T11:04:34.093 INFO:tasks.workunit.client.0.smithi097.stderr: -109> 2024-09-14T11:04:34.006+0000 7f6ebb013800 20 add_watcher() i=7 2024-09-14T11:04:34.093 INFO:tasks.workunit.client.0.smithi097.stderr: -108> 2024-09-14T11:04:34.006+0000 7f6ebb013800 2 all 8 watchers are set, enabling cache 2024-09-14T11:04:34.093 INFO:tasks.workunit.client.0.smithi097.stderr: -107> 2024-09-14T11:04:34.008+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8cd30) adding auth protocol: cephx 2024-09-14T11:04:34.093 INFO:tasks.workunit.client.0.smithi097.stderr: -106> 2024-09-14T11:04:34.008+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8cd30) adding auth protocol: cephx 2024-09-14T11:04:34.093 INFO:tasks.workunit.client.0.smithi097.stderr: -105> 2024-09-14T11:04:34.008+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8cd30) adding auth protocol: cephx 2024-09-14T11:04:34.093 INFO:tasks.workunit.client.0.smithi097.stderr: -104> 2024-09-14T11:04:34.008+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8cd30) adding con mode: secure 2024-09-14T11:04:34.093 INFO:tasks.workunit.client.0.smithi097.stderr: -103> 2024-09-14T11:04:34.008+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8cd30) adding con mode: crc 2024-09-14T11:04:34.093 INFO:tasks.workunit.client.0.smithi097.stderr: -102> 2024-09-14T11:04:34.008+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8cd30) adding con mode: secure 2024-09-14T11:04:34.093 INFO:tasks.workunit.client.0.smithi097.stderr: -101> 2024-09-14T11:04:34.008+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8cd30) adding con mode: crc 2024-09-14T11:04:34.094 INFO:tasks.workunit.client.0.smithi097.stderr: -100> 2024-09-14T11:04:34.008+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8cd30) adding con mode: secure 2024-09-14T11:04:34.094 INFO:tasks.workunit.client.0.smithi097.stderr: -99> 2024-09-14T11:04:34.008+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8cd30) adding con mode: crc 2024-09-14T11:04:34.094 INFO:tasks.workunit.client.0.smithi097.stderr: -98> 2024-09-14T11:04:34.008+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8cd30) adding con mode: crc 2024-09-14T11:04:34.094 INFO:tasks.workunit.client.0.smithi097.stderr: -97> 2024-09-14T11:04:34.008+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8cd30) adding con mode: secure 2024-09-14T11:04:34.094 INFO:tasks.workunit.client.0.smithi097.stderr: -96> 2024-09-14T11:04:34.008+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8cd30) adding con mode: crc 2024-09-14T11:04:34.094 INFO:tasks.workunit.client.0.smithi097.stderr: -95> 2024-09-14T11:04:34.008+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8cd30) adding con mode: secure 2024-09-14T11:04:34.094 INFO:tasks.workunit.client.0.smithi097.stderr: -94> 2024-09-14T11:04:34.008+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8cd30) adding con mode: crc 2024-09-14T11:04:34.094 INFO:tasks.workunit.client.0.smithi097.stderr: -93> 2024-09-14T11:04:34.008+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8cd30) adding con mode: secure 2024-09-14T11:04:34.094 INFO:tasks.workunit.client.0.smithi097.stderr: -92> 2024-09-14T11:04:34.008+0000 7f6d6cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:04:34.094 INFO:tasks.workunit.client.0.smithi097.stderr: -91> 2024-09-14T11:04:34.008+0000 7f6ebb013800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:04:34.094 INFO:tasks.workunit.client.0.smithi097.stderr: -90> 2024-09-14T11:04:34.008+0000 7f6ebb013800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:04:34.094 INFO:tasks.workunit.client.0.smithi097.stderr: -89> 2024-09-14T11:04:34.008+0000 7f6ebb013800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:04:34.094 INFO:tasks.workunit.client.0.smithi097.stderr: -88> 2024-09-14T11:04:34.008+0000 7f6ebb013800 5 asok(0x559d1b9c0270) register_command cache list hook 0x559d1bcaef30 2024-09-14T11:04:34.094 INFO:tasks.workunit.client.0.smithi097.stderr: -87> 2024-09-14T11:04:34.008+0000 7f6ebb013800 5 asok(0x559d1b9c0270) register_command cache inspect hook 0x559d1bcaef30 2024-09-14T11:04:34.095 INFO:tasks.workunit.client.0.smithi097.stderr: -86> 2024-09-14T11:04:34.008+0000 7f6ebb013800 5 asok(0x559d1b9c0270) register_command cache erase hook 0x559d1bcaef30 2024-09-14T11:04:34.095 INFO:tasks.workunit.client.0.smithi097.stderr: -85> 2024-09-14T11:04:34.008+0000 7f6ebb013800 5 asok(0x559d1b9c0270) register_command cache zap hook 0x559d1bcaef30 2024-09-14T11:04:34.095 INFO:tasks.workunit.client.0.smithi097.stderr: -84> 2024-09-14T11:04:34.009+0000 7f6ebb013800 5 note: GC not initialized 2024-09-14T11:04:34.095 INFO:tasks.workunit.client.0.smithi097.stderr: -83> 2024-09-14T11:04:34.009+0000 7f6ce77fe640 20 reqs_thread_entry: start 2024-09-14T11:04:34.095 INFO:tasks.workunit.client.0.smithi097.stderr: -82> 2024-09-14T11:04:34.009+0000 7f6ebb013800 5 asok(0x559d1b9c0270) register_command sync trace show hook 0x7f6ea8004620 2024-09-14T11:04:34.095 INFO:tasks.workunit.client.0.smithi097.stderr: -81> 2024-09-14T11:04:34.009+0000 7f6ebb013800 5 asok(0x559d1b9c0270) register_command sync trace history hook 0x7f6ea8004620 2024-09-14T11:04:34.095 INFO:tasks.workunit.client.0.smithi097.stderr: -80> 2024-09-14T11:04:34.009+0000 7f6ebb013800 5 asok(0x559d1b9c0270) register_command sync trace active hook 0x7f6ea8004620 2024-09-14T11:04:34.095 INFO:tasks.workunit.client.0.smithi097.stderr: -79> 2024-09-14T11:04:34.009+0000 7f6ebb013800 5 asok(0x559d1b9c0270) register_command sync trace active_short hook 0x7f6ea8004620 2024-09-14T11:04:34.095 INFO:tasks.workunit.client.0.smithi097.stderr: -78> 2024-09-14T11:04:34.009+0000 7f6ebb013800 20 init_complete bucket index max shards: 11 2024-09-14T11:04:34.095 INFO:tasks.workunit.client.0.smithi097.stderr: -77> 2024-09-14T11:04:34.009+0000 7f6ebb013800 20 Filter name: none 2024-09-14T11:04:34.095 INFO:tasks.workunit.client.0.smithi097.stderr: -76> 2024-09-14T11:04:34.009+0000 7f6ce57fa640 20 reqs_thread_entry: start 2024-09-14T11:04:34.095 INFO:tasks.workunit.client.0.smithi097.stderr: -75> 2024-09-14T11:04:34.009+0000 7f6ebb013800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:04:34.095 INFO:tasks.workunit.client.0.smithi097.stderr: -74> 2024-09-14T11:04:34.009+0000 7f6ebb013800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.095 INFO:tasks.workunit.client.0.smithi097.stderr: -73> 2024-09-14T11:04:34.009+0000 7f6ebb013800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:04:34.096 INFO:tasks.workunit.client.0.smithi097.stderr: -72> 2024-09-14T11:04:34.009+0000 7f6ebb013800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:04:34.096 INFO:tasks.workunit.client.0.smithi097.stderr: -71> 2024-09-14T11:04:34.009+0000 7f6ebb013800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:04:34.096 INFO:tasks.workunit.client.0.smithi097.stderr: -70> 2024-09-14T11:04:34.009+0000 7f6ebb013800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 : miss 2024-09-14T11:04:34.096 INFO:tasks.workunit.client.0.smithi097.stderr: -69> 2024-09-14T11:04:34.009+0000 7f6ebb013800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.096 INFO:tasks.workunit.client.0.smithi097.stderr: -68> 2024-09-14T11:04:34.010+0000 7f6ebb013800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:04:34.096 INFO:tasks.workunit.client.0.smithi097.stderr: -67> 2024-09-14T11:04:34.010+0000 7f6ebb013800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 info.flags=0x17 2024-09-14T11:04:34.096 INFO:tasks.workunit.client.0.smithi097.stderr: -66> 2024-09-14T11:04:34.010+0000 7f6ebb013800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 to cache LRU end 2024-09-14T11:04:34.096 INFO:tasks.workunit.client.0.smithi097.stderr: -65> 2024-09-14T11:04:34.010+0000 7f6ebb013800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:04:34.096 INFO:tasks.workunit.client.0.smithi097.stderr: -64> 2024-09-14T11:04:34.010+0000 7f6ebb013800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:04:34.096 INFO:tasks.workunit.client.0.smithi097.stderr: -63> 2024-09-14T11:04:34.010+0000 7f6ebb013800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 2024-09-14T11:04:34.096 INFO:tasks.workunit.client.0.smithi097.stderr: -62> 2024-09-14T11:04:34.015+0000 7f6ebb013800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 info.flags=0x17 2024-09-14T11:04:34.096 INFO:tasks.workunit.client.0.smithi097.stderr: -61> 2024-09-14T11:04:34.015+0000 7f6ebb013800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 to cache LRU end 2024-09-14T11:04:34.096 INFO:tasks.workunit.client.0.smithi097.stderr: -60> 2024-09-14T11:04:34.015+0000 7f6ebb013800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:04:34.096 INFO:tasks.workunit.client.0.smithi097.stderr: -59> 2024-09-14T11:04:34.015+0000 7f6ebb013800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29, ofs0, ns] 2024-09-14T11:04:34.097 INFO:tasks.workunit.client.0.smithi097.stderr: -58> 2024-09-14T11:04:34.015+0000 7f6d997fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595191 cookie 94133264719408 notifier 7119 bl.length()=915 2024-09-14T11:04:34.097 INFO:tasks.workunit.client.0.smithi097.stderr: -57> 2024-09-14T11:04:34.015+0000 7f6d997fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 info.flags=0x17 2024-09-14T11:04:34.097 INFO:tasks.workunit.client.0.smithi097.stderr: -56> 2024-09-14T11:04:34.015+0000 7f6d997fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 to cache LRU end 2024-09-14T11:04:34.097 INFO:tasks.workunit.client.0.smithi097.stderr: -55> 2024-09-14T11:04:34.015+0000 7f6d997fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:04:34.097 INFO:tasks.workunit.client.0.smithi097.stderr: -54> 2024-09-14T11:04:34.016+0000 7f6ebb013800 20 handle_bi_update(): bucket=:abort-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29]): orig_sources= new_sources= 2024-09-14T11:04:34.097 INFO:tasks.workunit.client.0.smithi097.stderr: -53> 2024-09-14T11:04:34.016+0000 7f6ebb013800 20 handle_bi_update(): bucket=:abort-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29]): potential sources added=[] removed=[] 2024-09-14T11:04:34.097 INFO:tasks.workunit.client.0.smithi097.stderr: -52> 2024-09-14T11:04:34.016+0000 7f6ebb013800 20 handle_bi_update(): bucket=:abort-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29]): orig_dests= new_dests= 2024-09-14T11:04:34.097 INFO:tasks.workunit.client.0.smithi097.stderr: -51> 2024-09-14T11:04:34.016+0000 7f6ebb013800 20 handle_bi_update(): bucket=:abort-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29]): potential dests added=[] removed=[] 2024-09-14T11:04:34.097 INFO:tasks.workunit.client.0.smithi097.stderr: -50> 2024-09-14T11:04:34.021+0000 7f6ebb013800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.0 2024-09-14T11:04:34.097 INFO:tasks.workunit.client.0.smithi097.stderr: -49> 2024-09-14T11:04:34.021+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.0 2024-09-14T11:04:34.097 INFO:tasks.workunit.client.0.smithi097.stderr: -48> 2024-09-14T11:04:34.021+0000 7f6ebb013800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.1 2024-09-14T11:04:34.097 INFO:tasks.workunit.client.0.smithi097.stderr: -47> 2024-09-14T11:04:34.021+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.1 2024-09-14T11:04:34.097 INFO:tasks.workunit.client.0.smithi097.stderr: -46> 2024-09-14T11:04:34.021+0000 7f6ebb013800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.2 2024-09-14T11:04:34.097 INFO:tasks.workunit.client.0.smithi097.stderr: -45> 2024-09-14T11:04:34.021+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.2 2024-09-14T11:04:34.098 INFO:tasks.workunit.client.0.smithi097.stderr: -44> 2024-09-14T11:04:34.021+0000 7f6ebb013800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.3 2024-09-14T11:04:34.098 INFO:tasks.workunit.client.0.smithi097.stderr: -43> 2024-09-14T11:04:34.021+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.3 2024-09-14T11:04:34.098 INFO:tasks.workunit.client.0.smithi097.stderr: -42> 2024-09-14T11:04:34.021+0000 7f6ebb013800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.4 2024-09-14T11:04:34.098 INFO:tasks.workunit.client.0.smithi097.stderr: -41> 2024-09-14T11:04:34.021+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.4 2024-09-14T11:04:34.098 INFO:tasks.workunit.client.0.smithi097.stderr: -40> 2024-09-14T11:04:34.021+0000 7f6ebb013800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.5 2024-09-14T11:04:34.098 INFO:tasks.workunit.client.0.smithi097.stderr: -39> 2024-09-14T11:04:34.021+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.5 2024-09-14T11:04:34.098 INFO:tasks.workunit.client.0.smithi097.stderr: -38> 2024-09-14T11:04:34.021+0000 7f6ebb013800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.6 2024-09-14T11:04:34.098 INFO:tasks.workunit.client.0.smithi097.stderr: -37> 2024-09-14T11:04:34.021+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.6 2024-09-14T11:04:34.098 INFO:tasks.workunit.client.0.smithi097.stderr: -36> 2024-09-14T11:04:34.021+0000 7f6ebb013800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.7 2024-09-14T11:04:34.098 INFO:tasks.workunit.client.0.smithi097.stderr: -35> 2024-09-14T11:04:34.021+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.7 2024-09-14T11:04:34.098 INFO:tasks.workunit.client.0.smithi097.stderr: -34> 2024-09-14T11:04:34.021+0000 7f6ebb013800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.8 2024-09-14T11:04:34.098 INFO:tasks.workunit.client.0.smithi097.stderr: -33> 2024-09-14T11:04:34.021+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.8 2024-09-14T11:04:34.098 INFO:tasks.workunit.client.0.smithi097.stderr: -32> 2024-09-14T11:04:34.021+0000 7f6ebb013800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.9 2024-09-14T11:04:34.099 INFO:tasks.workunit.client.0.smithi097.stderr: -31> 2024-09-14T11:04:34.021+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.9 2024-09-14T11:04:34.099 INFO:tasks.workunit.client.0.smithi097.stderr: -30> 2024-09-14T11:04:34.021+0000 7f6ebb013800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.10 2024-09-14T11:04:34.099 INFO:tasks.workunit.client.0.smithi097.stderr: -29> 2024-09-14T11:04:34.021+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.10 2024-09-14T11:04:34.099 INFO:tasks.workunit.client.0.smithi097.stderr: -28> 2024-09-14T11:04:34.021+0000 7f6ebb013800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.11 2024-09-14T11:04:34.099 INFO:tasks.workunit.client.0.smithi097.stderr: -27> 2024-09-14T11:04:34.021+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.11 2024-09-14T11:04:34.099 INFO:tasks.workunit.client.0.smithi097.stderr: -26> 2024-09-14T11:04:34.021+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.0 2024-09-14T11:04:34.099 INFO:tasks.workunit.client.0.smithi097.stderr: -25> 2024-09-14T11:04:34.022+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1 2024-09-14T11:04:34.099 INFO:tasks.workunit.client.0.smithi097.stderr: -24> 2024-09-14T11:04:34.022+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.2 2024-09-14T11:04:34.099 INFO:tasks.workunit.client.0.smithi097.stderr: -23> 2024-09-14T11:04:34.023+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.3 2024-09-14T11:04:34.099 INFO:tasks.workunit.client.0.smithi097.stderr: -22> 2024-09-14T11:04:34.023+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.4 2024-09-14T11:04:34.099 INFO:tasks.workunit.client.0.smithi097.stderr: -21> 2024-09-14T11:04:34.023+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.5 2024-09-14T11:04:34.099 INFO:tasks.workunit.client.0.smithi097.stderr: -20> 2024-09-14T11:04:34.024+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.6 2024-09-14T11:04:34.099 INFO:tasks.workunit.client.0.smithi097.stderr: -19> 2024-09-14T11:04:34.024+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.7 2024-09-14T11:04:34.099 INFO:tasks.workunit.client.0.smithi097.stderr: -18> 2024-09-14T11:04:34.025+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.8 2024-09-14T11:04:34.100 INFO:tasks.workunit.client.0.smithi097.stderr: -17> 2024-09-14T11:04:34.025+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.9 2024-09-14T11:04:34.100 INFO:tasks.workunit.client.0.smithi097.stderr: -16> 2024-09-14T11:04:34.026+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.10 2024-09-14T11:04:34.100 INFO:tasks.workunit.client.0.smithi097.stderr: -15> 2024-09-14T11:04:34.029+0000 7f6ebb013800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:04:34.100 INFO:tasks.workunit.client.0.smithi097.stderr: -14> 2024-09-14T11:04:34.029+0000 7f6ebb013800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 2024-09-14T11:04:34.100 INFO:tasks.workunit.client.0.smithi097.stderr: -13> 2024-09-14T11:04:34.030+0000 7f6ebb013800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 info.flags=0x17 2024-09-14T11:04:34.100 INFO:tasks.workunit.client.0.smithi097.stderr: -12> 2024-09-14T11:04:34.030+0000 7f6ebb013800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 to cache LRU end 2024-09-14T11:04:34.100 INFO:tasks.workunit.client.0.smithi097.stderr: -11> 2024-09-14T11:04:34.030+0000 7f6ebb013800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:04:34.100 INFO:tasks.workunit.client.0.smithi097.stderr: -10> 2024-09-14T11:04:34.030+0000 7f6ebb013800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29, ofs0, ns] 2024-09-14T11:04:34.100 INFO:tasks.workunit.client.0.smithi097.stderr: -9> 2024-09-14T11:04:34.030+0000 7f6d997fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595192 cookie 94133264719408 notifier 7119 bl.length()=915 2024-09-14T11:04:34.100 INFO:tasks.workunit.client.0.smithi097.stderr: -8> 2024-09-14T11:04:34.030+0000 7f6d997fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 info.flags=0x17 2024-09-14T11:04:34.100 INFO:tasks.workunit.client.0.smithi097.stderr: -7> 2024-09-14T11:04:34.030+0000 7f6d997fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 to cache LRU end 2024-09-14T11:04:34.100 INFO:tasks.workunit.client.0.smithi097.stderr: -6> 2024-09-14T11:04:34.030+0000 7f6d997fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:04:34.100 INFO:tasks.workunit.client.0.smithi097.stderr: -5> 2024-09-14T11:04:34.031+0000 7f6ebb013800 20 handle_bi_update(): bucket=:abort-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29]): orig_sources= new_sources= 2024-09-14T11:04:34.101 INFO:tasks.workunit.client.0.smithi097.stderr: -4> 2024-09-14T11:04:34.031+0000 7f6ebb013800 20 handle_bi_update(): bucket=:abort-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29]): potential sources added=[] removed=[] 2024-09-14T11:04:34.101 INFO:tasks.workunit.client.0.smithi097.stderr: -3> 2024-09-14T11:04:34.031+0000 7f6ebb013800 20 handle_bi_update(): bucket=:abort-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29]): orig_dests= new_dests= 2024-09-14T11:04:34.101 INFO:tasks.workunit.client.0.smithi097.stderr: -2> 2024-09-14T11:04:34.031+0000 7f6ebb013800 20 handle_bi_update(): bucket=:abort-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29]): potential dests added=[] removed=[] 2024-09-14T11:04:34.101 INFO:tasks.workunit.client.0.smithi097.stderr: -1> 2024-09-14T11:04:34.031+0000 7f6ebb013800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6ebb013800 time 2024-09-14T11:04:34.031965+0000 2024-09-14T11:04:34.101 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:04:34.101 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:04:34.101 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:04:34.101 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f6ebc18c76a] 2024-09-14T11:04:34.101 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f6ebc18c928] 2024-09-14T11:04:34.101 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559d19c900b1] 2024-09-14T11:04:34.101 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x559d19c9f18e] 2024-09-14T11:04:34.101 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x559d19c9ffc4] 2024-09-14T11:04:34.101 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-14T11:04:34.101 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f6ebae29590] 2024-09-14T11:04:34.102 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-14T11:04:34.102 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-14T11:04:34.102 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:04:34.102 INFO:tasks.workunit.client.0.smithi097.stderr: 0> 2024-09-14T11:04:34.032+0000 7f6ebb013800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:04:34.102 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f6ebb013800 thread_name:radosgw-admin 2024-09-14T11:04:34.102 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:04:34.102 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:04:34.102 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f6ebae3e6f0] 2024-09-14T11:04:34.102 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f6ebae8b99c] 2024-09-14T11:04:34.102 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-14T11:04:34.102 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-14T11:04:34.102 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f6ebc18c7c4] 2024-09-14T11:04:34.102 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f6ebc18c928] 2024-09-14T11:04:34.103 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559d19c900b1] 2024-09-14T11:04:34.103 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x559d19c9f18e] 2024-09-14T11:04:34.103 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x559d19c9ffc4] 2024-09-14T11:04:34.103 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-14T11:04:34.103 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f6ebae29590] 2024-09-14T11:04:34.103 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-14T11:04:34.103 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-14T11:04:34.103 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:04:34.103 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:04:34.103 INFO:tasks.workunit.client.0.smithi097.stderr:--- logging levels --- 2024-09-14T11:04:34.103 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 none 2024-09-14T11:04:34.103 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 lockdep 2024-09-14T11:04:34.103 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 context 2024-09-14T11:04:34.103 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 crush 2024-09-14T11:04:34.104 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds 2024-09-14T11:04:34.104 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_balancer 2024-09-14T11:04:34.104 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_locker 2024-09-14T11:04:34.104 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log 2024-09-14T11:04:34.104 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log_expire 2024-09-14T11:04:34.104 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_migrator 2024-09-14T11:04:34.104 INFO:tasks.workunit.client.0.smithi097.stderr: 3/ 5 mds_quiesce 2024-09-14T11:04:34.104 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 buffer 2024-09-14T11:04:34.104 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 timer 2024-09-14T11:04:34.104 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 filer 2024-09-14T11:04:34.104 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 striper 2024-09-14T11:04:34.104 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 objecter 2024-09-14T11:04:34.104 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rados 2024-09-14T11:04:34.104 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd 2024-09-14T11:04:34.105 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_mirror 2024-09-14T11:04:34.105 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_replay 2024-09-14T11:04:34.105 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_pwl 2024-09-14T11:04:34.105 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 journaler 2024-09-14T11:04:34.105 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objectcacher 2024-09-14T11:04:34.105 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:04:34.105 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 client 2024-09-14T11:04:34.105 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 osd 2024-09-14T11:04:34.105 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 optracker 2024-09-14T11:04:34.105 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objclass 2024-09-14T11:04:34.105 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 filestore 2024-09-14T11:04:34.105 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 journal 2024-09-14T11:04:34.105 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 ms 2024-09-14T11:04:34.105 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mon 2024-09-14T11:04:34.106 INFO:tasks.workunit.client.0.smithi097.stderr: 0/10 monc 2024-09-14T11:04:34.106 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 paxos 2024-09-14T11:04:34.106 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 tp 2024-09-14T11:04:34.106 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 auth 2024-09-14T11:04:34.106 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 crypto 2024-09-14T11:04:34.106 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 finisher 2024-09-14T11:04:34.106 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 reserver 2024-09-14T11:04:34.106 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 heartbeatmap 2024-09-14T11:04:34.106 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 perfcounter 2024-09-14T11:04:34.106 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw 2024-09-14T11:04:34.106 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_sync 2024-09-14T11:04:34.106 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_datacache 2024-09-14T11:04:34.106 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_access 2024-09-14T11:04:34.106 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:04:34.107 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_flight 2024-09-14T11:04:34.107 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:04:34.107 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw_notification 2024-09-14T11:04:34.107 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 javaclient 2024-09-14T11:04:34.107 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 asok 2024-09-14T11:04:34.107 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 throttle 2024-09-14T11:04:34.107 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 refs 2024-09-14T11:04:34.107 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 compressor 2024-09-14T11:04:34.107 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluestore 2024-09-14T11:04:34.107 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluefs 2024-09-14T11:04:34.108 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 bdev 2024-09-14T11:04:34.108 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 kstore 2024-09-14T11:04:34.108 INFO:tasks.workunit.client.0.smithi097.stderr: 4/ 5 rocksdb 2024-09-14T11:04:34.108 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 fuse 2024-09-14T11:04:34.108 INFO:tasks.workunit.client.0.smithi097.stderr: 2/ 5 mgr 2024-09-14T11:04:34.108 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mgrc 2024-09-14T11:04:34.108 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 dpdk 2024-09-14T11:04:34.108 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 eventtrace 2024-09-14T11:04:34.108 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 prioritycache 2024-09-14T11:04:34.108 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 test 2024-09-14T11:04:34.108 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:04:34.108 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephsqlite 2024-09-14T11:04:34.108 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:04:34.109 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore 2024-09-14T11:04:34.109 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_onode 2024-09-14T11:04:34.109 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_odata 2024-09-14T11:04:34.109 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_omap 2024-09-14T11:04:34.109 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_tm 2024-09-14T11:04:34.109 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_t 2024-09-14T11:04:34.109 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:04:34.109 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_epm 2024-09-14T11:04:34.109 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_lba 2024-09-14T11:04:34.109 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:04:34.109 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cache 2024-09-14T11:04:34.109 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_journal 2024-09-14T11:04:34.109 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_device 2024-09-14T11:04:34.109 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_backref 2024-09-14T11:04:34.110 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 alienstore 2024-09-14T11:04:34.110 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mclock 2024-09-14T11:04:34.110 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cyanstore 2024-09-14T11:04:34.110 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 ceph_exporter 2024-09-14T11:04:34.110 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 memstore 2024-09-14T11:04:34.110 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 trace 2024-09-14T11:04:34.110 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 ceph_dedup 2024-09-14T11:04:34.110 INFO:tasks.workunit.client.0.smithi097.stderr: -2/-2 (syslog threshold) 2024-09-14T11:04:34.110 INFO:tasks.workunit.client.0.smithi097.stderr: 99/99 (stderr threshold) 2024-09-14T11:04:34.110 INFO:tasks.workunit.client.0.smithi097.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:04:34.110 INFO:tasks.workunit.client.0.smithi097.stderr: 7f6ce57fa640 / http_manager 2024-09-14T11:04:34.110 INFO:tasks.workunit.client.0.smithi097.stderr: 7f6ce77fe640 / http_manager 2024-09-14T11:04:34.110 INFO:tasks.workunit.client.0.smithi097.stderr: 7f6d6cfe1640 / rgw_dt_lg_renew 2024-09-14T11:04:34.110 INFO:tasks.workunit.client.0.smithi097.stderr: 7f6d87fff640 / ms_dispatch 2024-09-14T11:04:34.111 INFO:tasks.workunit.client.0.smithi097.stderr: 7f6d997fa640 / io_context_pool 2024-09-14T11:04:34.111 INFO:tasks.workunit.client.0.smithi097.stderr: 7f6d99ffb640 / io_context_pool 2024-09-14T11:04:34.111 INFO:tasks.workunit.client.0.smithi097.stderr: 7f6d9bfff640 / ms_dispatch 2024-09-14T11:04:34.111 INFO:tasks.workunit.client.0.smithi097.stderr: 7f6da2e05640 / ms_dispatch 2024-09-14T11:04:34.111 INFO:tasks.workunit.client.0.smithi097.stderr: 7f6da4608640 / io_context_pool 2024-09-14T11:04:34.111 INFO:tasks.workunit.client.0.smithi097.stderr: 7f6eaffff640 / msgr-worker-2 2024-09-14T11:04:34.111 INFO:tasks.workunit.client.0.smithi097.stderr: 7f6eb6792640 / msgr-worker-1 2024-09-14T11:04:34.111 INFO:tasks.workunit.client.0.smithi097.stderr: 7f6eb6f93640 / msgr-worker-0 2024-09-14T11:04:34.111 INFO:tasks.workunit.client.0.smithi097.stderr: 7f6eb7794640 / io_context_pool 2024-09-14T11:04:34.111 INFO:tasks.workunit.client.0.smithi097.stderr: 7f6ebb013800 / radosgw-admin 2024-09-14T11:04:34.111 INFO:tasks.workunit.client.0.smithi097.stderr: max_recent 500 2024-09-14T11:04:34.111 INFO:tasks.workunit.client.0.smithi097.stderr: max_new 1000 2024-09-14T11:04:34.111 INFO:tasks.workunit.client.0.smithi097.stderr: log_file /var/log/ceph/ceph-client.admin.113918.log 2024-09-14T11:04:34.111 INFO:tasks.workunit.client.0.smithi097.stderr:--- end dump of recent events --- 2024-09-14T11:04:34.111 INFO:tasks.workunit.client.0.smithi097.stderr:--- begin dump of recent events --- 2024-09-14T11:04:34.112 INFO:tasks.workunit.client.0.smithi097.stderr: -499> 2024-09-14T11:04:33.761+0000 7f6ebb013800 10 monclient(hunting): picked mon.noname-b con 0x559d1ba8c190 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:04:34.112 INFO:tasks.workunit.client.0.smithi097.stderr: -498> 2024-09-14T11:04:33.761+0000 7f6ebb013800 10 monclient(hunting): picked mon.noname-c con 0x559d1ba96fe0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:04:34.112 INFO:tasks.workunit.client.0.smithi097.stderr: -497> 2024-09-14T11:04:33.761+0000 7f6ebb013800 10 monclient(hunting): picked mon.noname-a con 0x559d1bb2b6a0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:04:34.112 INFO:tasks.workunit.client.0.smithi097.stderr: -496> 2024-09-14T11:04:33.761+0000 7f6ebb013800 10 monclient(hunting): start opening mon connection 2024-09-14T11:04:34.112 INFO:tasks.workunit.client.0.smithi097.stderr: -495> 2024-09-14T11:04:33.761+0000 7f6ebb013800 10 monclient(hunting): start opening mon connection 2024-09-14T11:04:34.112 INFO:tasks.workunit.client.0.smithi097.stderr: -494> 2024-09-14T11:04:33.761+0000 7f6ebb013800 10 monclient(hunting): start opening mon connection 2024-09-14T11:04:34.112 INFO:tasks.workunit.client.0.smithi097.stderr: -493> 2024-09-14T11:04:33.761+0000 7f6ebb013800 10 monclient(hunting): _renew_subs 2024-09-14T11:04:34.112 INFO:tasks.workunit.client.0.smithi097.stderr: -492> 2024-09-14T11:04:33.761+0000 7f6ebb013800 10 monclient(hunting): authenticate will time out at 1955.414613s 2024-09-14T11:04:34.112 INFO:tasks.workunit.client.0.smithi097.stderr: -491> 2024-09-14T11:04:33.761+0000 7f6eaffff640 10 monclient(hunting): get_auth_request con 0x559d1ba96fe0 auth_method 0 2024-09-14T11:04:34.112 INFO:tasks.workunit.client.0.smithi097.stderr: -490> 2024-09-14T11:04:33.761+0000 7f6eaffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:04:34.112 INFO:tasks.workunit.client.0.smithi097.stderr: -489> 2024-09-14T11:04:33.761+0000 7f6eaffff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:04:34.112 INFO:tasks.workunit.client.0.smithi097.stderr: -488> 2024-09-14T11:04:33.761+0000 7f6eaffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:04:34.112 INFO:tasks.workunit.client.0.smithi097.stderr: -487> 2024-09-14T11:04:33.761+0000 7f6eb6f93640 10 monclient(hunting): get_auth_request con 0x559d1bb2b6a0 auth_method 0 2024-09-14T11:04:34.113 INFO:tasks.workunit.client.0.smithi097.stderr: -486> 2024-09-14T11:04:33.761+0000 7f6eb6f93640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:04:34.113 INFO:tasks.workunit.client.0.smithi097.stderr: -485> 2024-09-14T11:04:33.761+0000 7f6eb6f93640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:04:34.113 INFO:tasks.workunit.client.0.smithi097.stderr: -484> 2024-09-14T11:04:33.761+0000 7f6eb6f93640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:04:34.113 INFO:tasks.workunit.client.0.smithi097.stderr: -483> 2024-09-14T11:04:33.761+0000 7f6eb6792640 10 monclient(hunting): get_auth_request con 0x559d1ba8c190 auth_method 0 2024-09-14T11:04:34.113 INFO:tasks.workunit.client.0.smithi097.stderr: -482> 2024-09-14T11:04:33.761+0000 7f6eb6792640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:04:34.113 INFO:tasks.workunit.client.0.smithi097.stderr: -481> 2024-09-14T11:04:33.761+0000 7f6eb6792640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:04:34.113 INFO:tasks.workunit.client.0.smithi097.stderr: -480> 2024-09-14T11:04:33.761+0000 7f6eb6792640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:04:34.113 INFO:tasks.workunit.client.0.smithi097.stderr: -479> 2024-09-14T11:04:33.761+0000 7f6eaffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:04:34.113 INFO:tasks.workunit.client.0.smithi097.stderr: -478> 2024-09-14T11:04:33.761+0000 7f6eaffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:04:34.113 INFO:tasks.workunit.client.0.smithi097.stderr: -477> 2024-09-14T11:04:33.761+0000 7f6eaffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:04:34.113 INFO:tasks.workunit.client.0.smithi097.stderr: -476> 2024-09-14T11:04:33.761+0000 7f6eb6f93640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:04:34.113 INFO:tasks.workunit.client.0.smithi097.stderr: -475> 2024-09-14T11:04:33.761+0000 7f6eb6f93640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:04:34.113 INFO:tasks.workunit.client.0.smithi097.stderr: -474> 2024-09-14T11:04:33.761+0000 7f6eb6f93640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:04:34.113 INFO:tasks.workunit.client.0.smithi097.stderr: -473> 2024-09-14T11:04:33.761+0000 7f6eb6792640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:04:34.114 INFO:tasks.workunit.client.0.smithi097.stderr: -472> 2024-09-14T11:04:33.761+0000 7f6eb6792640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:04:34.114 INFO:tasks.workunit.client.0.smithi097.stderr: -471> 2024-09-14T11:04:33.761+0000 7f6eb6792640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:04:34.114 INFO:tasks.workunit.client.0.smithi097.stderr: -470> 2024-09-14T11:04:33.762+0000 7f6eaffff640 10 monclient(hunting): handle_auth_done global_id 6701 payload 824 2024-09-14T11:04:34.114 INFO:tasks.workunit.client.0.smithi097.stderr: -469> 2024-09-14T11:04:33.762+0000 7f6eaffff640 10 monclient: _finish_hunting 0 2024-09-14T11:04:34.114 INFO:tasks.workunit.client.0.smithi097.stderr: -468> 2024-09-14T11:04:33.762+0000 7f6eaffff640 1 monclient: found mon.noname-c 2024-09-14T11:04:34.114 INFO:tasks.workunit.client.0.smithi097.stderr: -467> 2024-09-14T11:04:33.762+0000 7f6eaffff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:04:34.114 INFO:tasks.workunit.client.0.smithi097.stderr: -466> 2024-09-14T11:04:33.762+0000 7f6da2e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:04:34.114 INFO:tasks.workunit.client.0.smithi097.stderr: -465> 2024-09-14T11:04:33.762+0000 7f6da2e05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:04:34.114 INFO:tasks.workunit.client.0.smithi097.stderr: -464> 2024-09-14T11:04:33.762+0000 7f6da2e05640 10 monclient: dump: 2024-09-14T11:04:34.114 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:04:34.114 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:04:34.114 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:04:34.114 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:04:34.114 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:04:34.115 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:04:34.115 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:04:34.115 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:04:34.115 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:04:34.115 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:04:34.115 INFO:tasks.workunit.client.0.smithi097.stderr: -463> 2024-09-14T11:04:33.762+0000 7f6da2e05640 10 monclient: _finish_auth 0 2024-09-14T11:04:34.115 INFO:tasks.workunit.client.0.smithi097.stderr: -462> 2024-09-14T11:04:33.762+0000 7f6da2e05640 10 monclient: _check_auth_tickets 2024-09-14T11:04:34.115 INFO:tasks.workunit.client.0.smithi097.stderr: -461> 2024-09-14T11:04:33.762+0000 7f6da2e05640 10 monclient: handle_config config(0 keys) 2024-09-14T11:04:34.115 INFO:tasks.workunit.client.0.smithi097.stderr: -460> 2024-09-14T11:04:33.762+0000 7f6da2e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:04:34.115 INFO:tasks.workunit.client.0.smithi097.stderr: -459> 2024-09-14T11:04:33.762+0000 7f6da2e05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:04:34.115 INFO:tasks.workunit.client.0.smithi097.stderr: -458> 2024-09-14T11:04:33.762+0000 7f6da2e05640 10 monclient: dump: 2024-09-14T11:04:34.115 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:04:34.115 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:04:34.115 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:04:34.115 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:04:34.116 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:04:34.116 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:04:34.116 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:04:34.116 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:04:34.116 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:04:34.116 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:04:34.116 INFO:tasks.workunit.client.0.smithi097.stderr: -457> 2024-09-14T11:04:33.762+0000 7f6ebb013800 5 monclient: authenticate success, global_id 6701 2024-09-14T11:04:34.116 INFO:tasks.workunit.client.0.smithi097.stderr: -456> 2024-09-14T11:04:33.762+0000 7f6ebb013800 10 monclient: _renew_subs 2024-09-14T11:04:34.116 INFO:tasks.workunit.client.0.smithi097.stderr: -455> 2024-09-14T11:04:33.762+0000 7f6da4608640 4 set_mon_vals no callback set 2024-09-14T11:04:34.116 INFO:tasks.workunit.client.0.smithi097.stderr: -454> 2024-09-14T11:04:33.762+0000 7f6ebb013800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:04:34.116 INFO:tasks.workunit.client.0.smithi097.stderr: -453> 2024-09-14T11:04:33.762+0000 7f6ebb013800 10 monclient: _renew_subs 2024-09-14T11:04:34.116 INFO:tasks.workunit.client.0.smithi097.stderr: -452> 2024-09-14T11:04:33.762+0000 7f6ebb013800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:04:34.116 INFO:tasks.workunit.client.0.smithi097.stderr: -451> 2024-09-14T11:04:33.762+0000 7f6ebb013800 1 librados: init done 2024-09-14T11:04:34.116 INFO:tasks.workunit.client.0.smithi097.stderr: -450> 2024-09-14T11:04:33.764+0000 7f6da2e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:04:34.117 INFO:tasks.workunit.client.0.smithi097.stderr: -449> 2024-09-14T11:04:33.764+0000 7f6da2e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:04:34.117 INFO:tasks.workunit.client.0.smithi097.stderr: -448> 2024-09-14T11:04:33.764+0000 7f6da2e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:04:34.117 INFO:tasks.workunit.client.0.smithi097.stderr: -447> 2024-09-14T11:04:33.764+0000 7f6eb6792640 10 monclient: get_auth_request con 0x7f6d9c077230 auth_method 0 2024-09-14T11:04:34.117 INFO:tasks.workunit.client.0.smithi097.stderr: -446> 2024-09-14T11:04:33.764+0000 7f6eb6f93640 10 monclient: get_auth_request con 0x559d1bc0ff70 auth_method 0 2024-09-14T11:04:34.117 INFO:tasks.workunit.client.0.smithi097.stderr: -445> 2024-09-14T11:04:33.765+0000 7f6eb6792640 10 monclient: get_auth_request con 0x559d1bc2dc40 auth_method 0 2024-09-14T11:04:34.117 INFO:tasks.workunit.client.0.smithi097.stderr: -444> 2024-09-14T11:04:33.766+0000 7f6eaffff640 10 monclient: get_auth_request con 0x559d1bc322e0 auth_method 0 2024-09-14T11:04:34.117 INFO:tasks.workunit.client.0.smithi097.stderr: -443> 2024-09-14T11:04:33.767+0000 7f6eb6f93640 10 monclient: get_auth_request con 0x559d1bc361d0 auth_method 0 2024-09-14T11:04:34.117 INFO:tasks.workunit.client.0.smithi097.stderr: -442> 2024-09-14T11:04:33.768+0000 7f6ebb013800 10 monclient: build_initial_monmap 2024-09-14T11:04:34.117 INFO:tasks.workunit.client.0.smithi097.stderr: -441> 2024-09-14T11:04:33.768+0000 7f6ebb013800 1 build_initial for_mkfs: 0 2024-09-14T11:04:34.117 INFO:tasks.workunit.client.0.smithi097.stderr: -440> 2024-09-14T11:04:33.768+0000 7f6ebb013800 10 monclient: monmap: 2024-09-14T11:04:34.117 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:04:34.117 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:04:34.117 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:04:34.117 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:04:34.118 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:04:34.118 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:04:34.118 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:04:34.118 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:04:34.118 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:04:34.118 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:04:34.118 INFO:tasks.workunit.client.0.smithi097.stderr: -439> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc3a470) adding auth protocol: cephx 2024-09-14T11:04:34.118 INFO:tasks.workunit.client.0.smithi097.stderr: -438> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc3a470) adding auth protocol: cephx 2024-09-14T11:04:34.118 INFO:tasks.workunit.client.0.smithi097.stderr: -437> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc3a470) adding auth protocol: cephx 2024-09-14T11:04:34.118 INFO:tasks.workunit.client.0.smithi097.stderr: -436> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc3a470) adding con mode: secure 2024-09-14T11:04:34.118 INFO:tasks.workunit.client.0.smithi097.stderr: -435> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc3a470) adding con mode: crc 2024-09-14T11:04:34.118 INFO:tasks.workunit.client.0.smithi097.stderr: -434> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc3a470) adding con mode: secure 2024-09-14T11:04:34.118 INFO:tasks.workunit.client.0.smithi097.stderr: -433> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc3a470) adding con mode: crc 2024-09-14T11:04:34.118 INFO:tasks.workunit.client.0.smithi097.stderr: -432> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc3a470) adding con mode: secure 2024-09-14T11:04:34.118 INFO:tasks.workunit.client.0.smithi097.stderr: -431> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc3a470) adding con mode: crc 2024-09-14T11:04:34.119 INFO:tasks.workunit.client.0.smithi097.stderr: -430> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc3a470) adding con mode: crc 2024-09-14T11:04:34.119 INFO:tasks.workunit.client.0.smithi097.stderr: -429> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc3a470) adding con mode: secure 2024-09-14T11:04:34.119 INFO:tasks.workunit.client.0.smithi097.stderr: -428> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc3a470) adding con mode: crc 2024-09-14T11:04:34.119 INFO:tasks.workunit.client.0.smithi097.stderr: -427> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc3a470) adding con mode: secure 2024-09-14T11:04:34.119 INFO:tasks.workunit.client.0.smithi097.stderr: -426> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc3a470) adding con mode: crc 2024-09-14T11:04:34.119 INFO:tasks.workunit.client.0.smithi097.stderr: -425> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc3a470) adding con mode: secure 2024-09-14T11:04:34.119 INFO:tasks.workunit.client.0.smithi097.stderr: -424> 2024-09-14T11:04:33.768+0000 7f6ebb013800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:04:34.119 INFO:tasks.workunit.client.0.smithi097.stderr: -423> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 asok(0x559d1b9c0270) register_command objecter_requests cmddesc objecter_requests hook 0x559d1bc3d940 EEXIST 2024-09-14T11:04:34.119 INFO:tasks.workunit.client.0.smithi097.stderr: -422> 2024-09-14T11:04:33.768+0000 7f6ebb013800 10 monclient: init 2024-09-14T11:04:34.119 INFO:tasks.workunit.client.0.smithi097.stderr: -421> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc39228) adding auth protocol: cephx 2024-09-14T11:04:34.119 INFO:tasks.workunit.client.0.smithi097.stderr: -420> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc39228) adding auth protocol: cephx 2024-09-14T11:04:34.119 INFO:tasks.workunit.client.0.smithi097.stderr: -419> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc39228) adding auth protocol: cephx 2024-09-14T11:04:34.119 INFO:tasks.workunit.client.0.smithi097.stderr: -418> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc39228) adding con mode: secure 2024-09-14T11:04:34.119 INFO:tasks.workunit.client.0.smithi097.stderr: -417> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc39228) adding con mode: crc 2024-09-14T11:04:34.120 INFO:tasks.workunit.client.0.smithi097.stderr: -416> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc39228) adding con mode: secure 2024-09-14T11:04:34.120 INFO:tasks.workunit.client.0.smithi097.stderr: -415> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc39228) adding con mode: crc 2024-09-14T11:04:34.120 INFO:tasks.workunit.client.0.smithi097.stderr: -414> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc39228) adding con mode: secure 2024-09-14T11:04:34.120 INFO:tasks.workunit.client.0.smithi097.stderr: -413> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc39228) adding con mode: crc 2024-09-14T11:04:34.120 INFO:tasks.workunit.client.0.smithi097.stderr: -412> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc39228) adding con mode: crc 2024-09-14T11:04:34.120 INFO:tasks.workunit.client.0.smithi097.stderr: -411> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc39228) adding con mode: secure 2024-09-14T11:04:34.120 INFO:tasks.workunit.client.0.smithi097.stderr: -410> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc39228) adding con mode: crc 2024-09-14T11:04:34.120 INFO:tasks.workunit.client.0.smithi097.stderr: -409> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc39228) adding con mode: secure 2024-09-14T11:04:34.121 INFO:tasks.workunit.client.0.smithi097.stderr: -408> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc39228) adding con mode: crc 2024-09-14T11:04:34.121 INFO:tasks.workunit.client.0.smithi097.stderr: -407> 2024-09-14T11:04:33.768+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc39228) adding con mode: secure 2024-09-14T11:04:34.121 INFO:tasks.workunit.client.0.smithi097.stderr: -406> 2024-09-14T11:04:33.768+0000 7f6ebb013800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:04:34.121 INFO:tasks.workunit.client.0.smithi097.stderr: -405> 2024-09-14T11:04:33.769+0000 7f6ebb013800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:04:34.121 INFO:tasks.workunit.client.0.smithi097.stderr: -404> 2024-09-14T11:04:33.769+0000 7f6ebb013800 5 asok(0x559d1b9c0270) register_command rotate-key cmddesc rotate-key hook 0x559d1bc39370 EEXIST 2024-09-14T11:04:34.121 INFO:tasks.workunit.client.0.smithi097.stderr: -403> 2024-09-14T11:04:33.769+0000 7f6ebb013800 10 monclient: _reopen_session rank -1 2024-09-14T11:04:34.121 INFO:tasks.workunit.client.0.smithi097.stderr: -402> 2024-09-14T11:04:33.769+0000 7f6ebb013800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:04:34.121 INFO:tasks.workunit.client.0.smithi097.stderr: -401> 2024-09-14T11:04:33.769+0000 7f6ebb013800 10 monclient(hunting): picked mon.noname-b con 0x559d1bc61c60 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:04:34.121 INFO:tasks.workunit.client.0.smithi097.stderr: -400> 2024-09-14T11:04:33.769+0000 7f6ebb013800 10 monclient(hunting): picked mon.noname-c con 0x559d1bc62040 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:04:34.121 INFO:tasks.workunit.client.0.smithi097.stderr: -399> 2024-09-14T11:04:33.769+0000 7f6ebb013800 10 monclient(hunting): picked mon.noname-a con 0x559d1bc60970 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:04:34.121 INFO:tasks.workunit.client.0.smithi097.stderr: -398> 2024-09-14T11:04:33.769+0000 7f6ebb013800 10 monclient(hunting): start opening mon connection 2024-09-14T11:04:34.121 INFO:tasks.workunit.client.0.smithi097.stderr: -397> 2024-09-14T11:04:33.769+0000 7f6ebb013800 10 monclient(hunting): start opening mon connection 2024-09-14T11:04:34.122 INFO:tasks.workunit.client.0.smithi097.stderr: -396> 2024-09-14T11:04:33.769+0000 7f6ebb013800 10 monclient(hunting): start opening mon connection 2024-09-14T11:04:34.122 INFO:tasks.workunit.client.0.smithi097.stderr: -395> 2024-09-14T11:04:33.769+0000 7f6ebb013800 10 monclient(hunting): _renew_subs 2024-09-14T11:04:34.122 INFO:tasks.workunit.client.0.smithi097.stderr: -394> 2024-09-14T11:04:33.769+0000 7f6ebb013800 10 monclient(hunting): authenticate will time out at 1955.422277s 2024-09-14T11:04:34.122 INFO:tasks.workunit.client.0.smithi097.stderr: -393> 2024-09-14T11:04:33.769+0000 7f6eb6792640 10 monclient(hunting): get_auth_request con 0x559d1bc60970 auth_method 0 2024-09-14T11:04:34.122 INFO:tasks.workunit.client.0.smithi097.stderr: -392> 2024-09-14T11:04:33.769+0000 7f6eb6792640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:04:34.122 INFO:tasks.workunit.client.0.smithi097.stderr: -391> 2024-09-14T11:04:33.769+0000 7f6eb6792640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:04:34.122 INFO:tasks.workunit.client.0.smithi097.stderr: -390> 2024-09-14T11:04:33.769+0000 7f6eb6792640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:04:34.122 INFO:tasks.workunit.client.0.smithi097.stderr: -389> 2024-09-14T11:04:33.769+0000 7f6eb6f93640 10 monclient(hunting): get_auth_request con 0x559d1bc62040 auth_method 0 2024-09-14T11:04:34.122 INFO:tasks.workunit.client.0.smithi097.stderr: -388> 2024-09-14T11:04:33.769+0000 7f6eb6f93640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:04:34.122 INFO:tasks.workunit.client.0.smithi097.stderr: -387> 2024-09-14T11:04:33.769+0000 7f6eb6f93640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:04:34.122 INFO:tasks.workunit.client.0.smithi097.stderr: -386> 2024-09-14T11:04:33.769+0000 7f6eb6f93640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:04:34.122 INFO:tasks.workunit.client.0.smithi097.stderr: -385> 2024-09-14T11:04:33.769+0000 7f6eaffff640 10 monclient(hunting): get_auth_request con 0x559d1bc61c60 auth_method 0 2024-09-14T11:04:34.122 INFO:tasks.workunit.client.0.smithi097.stderr: -384> 2024-09-14T11:04:33.769+0000 7f6eaffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:04:34.122 INFO:tasks.workunit.client.0.smithi097.stderr: -383> 2024-09-14T11:04:33.769+0000 7f6eaffff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:04:34.123 INFO:tasks.workunit.client.0.smithi097.stderr: -382> 2024-09-14T11:04:33.769+0000 7f6eaffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:04:34.123 INFO:tasks.workunit.client.0.smithi097.stderr: -381> 2024-09-14T11:04:33.769+0000 7f6eb6792640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:04:34.123 INFO:tasks.workunit.client.0.smithi097.stderr: -380> 2024-09-14T11:04:33.769+0000 7f6eb6792640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:04:34.123 INFO:tasks.workunit.client.0.smithi097.stderr: -379> 2024-09-14T11:04:33.769+0000 7f6eb6792640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:04:34.123 INFO:tasks.workunit.client.0.smithi097.stderr: -378> 2024-09-14T11:04:33.769+0000 7f6eb6f93640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:04:34.123 INFO:tasks.workunit.client.0.smithi097.stderr: -377> 2024-09-14T11:04:33.769+0000 7f6eb6f93640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:04:34.123 INFO:tasks.workunit.client.0.smithi097.stderr: -376> 2024-09-14T11:04:33.769+0000 7f6eb6f93640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:04:34.123 INFO:tasks.workunit.client.0.smithi097.stderr: -375> 2024-09-14T11:04:33.769+0000 7f6eaffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:04:34.123 INFO:tasks.workunit.client.0.smithi097.stderr: -374> 2024-09-14T11:04:33.769+0000 7f6eaffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:04:34.123 INFO:tasks.workunit.client.0.smithi097.stderr: -373> 2024-09-14T11:04:33.769+0000 7f6eaffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:04:34.123 INFO:tasks.workunit.client.0.smithi097.stderr: -372> 2024-09-14T11:04:33.769+0000 7f6eb6f93640 10 monclient(hunting): handle_auth_done global_id 6704 payload 824 2024-09-14T11:04:34.123 INFO:tasks.workunit.client.0.smithi097.stderr: -371> 2024-09-14T11:04:33.769+0000 7f6eb6f93640 10 monclient: _finish_hunting 0 2024-09-14T11:04:34.123 INFO:tasks.workunit.client.0.smithi097.stderr: -370> 2024-09-14T11:04:33.769+0000 7f6eb6f93640 1 monclient: found mon.noname-c 2024-09-14T11:04:34.123 INFO:tasks.workunit.client.0.smithi097.stderr: -369> 2024-09-14T11:04:33.769+0000 7f6eb6f93640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:04:34.124 INFO:tasks.workunit.client.0.smithi097.stderr: -368> 2024-09-14T11:04:33.769+0000 7f6d9bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:04:34.124 INFO:tasks.workunit.client.0.smithi097.stderr: -367> 2024-09-14T11:04:33.769+0000 7f6d9bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:04:34.124 INFO:tasks.workunit.client.0.smithi097.stderr: -366> 2024-09-14T11:04:33.769+0000 7f6d9bfff640 10 monclient: dump: 2024-09-14T11:04:34.124 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:04:34.124 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:04:34.124 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:04:34.124 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:04:34.124 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:04:34.124 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:04:34.124 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:04:34.124 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:04:34.124 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:04:34.124 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:04:34.125 INFO:tasks.workunit.client.0.smithi097.stderr: -365> 2024-09-14T11:04:33.770+0000 7f6d9bfff640 10 monclient: _finish_auth 0 2024-09-14T11:04:34.125 INFO:tasks.workunit.client.0.smithi097.stderr: -364> 2024-09-14T11:04:33.770+0000 7f6d9bfff640 10 monclient: _check_auth_tickets 2024-09-14T11:04:34.125 INFO:tasks.workunit.client.0.smithi097.stderr: -363> 2024-09-14T11:04:33.770+0000 7f6d9bfff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:04:34.125 INFO:tasks.workunit.client.0.smithi097.stderr: -362> 2024-09-14T11:04:33.770+0000 7f6d9bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:04:34.125 INFO:tasks.workunit.client.0.smithi097.stderr: -361> 2024-09-14T11:04:33.770+0000 7f6d9bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:04:34.125 INFO:tasks.workunit.client.0.smithi097.stderr: -360> 2024-09-14T11:04:33.770+0000 7f6d9bfff640 10 monclient: dump: 2024-09-14T11:04:34.125 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:04:34.125 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:04:34.125 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:04:34.125 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:04:34.125 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:04:34.125 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:04:34.125 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:04:34.125 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:04:34.126 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:04:34.126 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:04:34.126 INFO:tasks.workunit.client.0.smithi097.stderr: -359> 2024-09-14T11:04:33.770+0000 7f6ebb013800 5 monclient: authenticate success, global_id 6704 2024-09-14T11:04:34.126 INFO:tasks.workunit.client.0.smithi097.stderr: -358> 2024-09-14T11:04:33.770+0000 7f6ebb013800 10 monclient: _renew_subs 2024-09-14T11:04:34.126 INFO:tasks.workunit.client.0.smithi097.stderr: -357> 2024-09-14T11:04:33.770+0000 7f6ebb013800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:04:34.126 INFO:tasks.workunit.client.0.smithi097.stderr: -356> 2024-09-14T11:04:33.770+0000 7f6eb7794640 4 set_mon_vals no callback set 2024-09-14T11:04:34.126 INFO:tasks.workunit.client.0.smithi097.stderr: -355> 2024-09-14T11:04:33.770+0000 7f6ebb013800 10 monclient: _renew_subs 2024-09-14T11:04:34.126 INFO:tasks.workunit.client.0.smithi097.stderr: -354> 2024-09-14T11:04:33.770+0000 7f6ebb013800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:04:34.126 INFO:tasks.workunit.client.0.smithi097.stderr: -353> 2024-09-14T11:04:33.771+0000 7f6d9bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:04:34.126 INFO:tasks.workunit.client.0.smithi097.stderr: -352> 2024-09-14T11:04:33.771+0000 7f6d9bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:04:34.126 INFO:tasks.workunit.client.0.smithi097.stderr: -351> 2024-09-14T11:04:33.771+0000 7f6d9bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:04:34.126 INFO:tasks.workunit.client.0.smithi097.stderr: -350> 2024-09-14T11:04:33.772+0000 7f6eaffff640 10 monclient: get_auth_request con 0x7f6d90077140 auth_method 0 2024-09-14T11:04:34.126 INFO:tasks.workunit.client.0.smithi097.stderr: -349> 2024-09-14T11:04:33.772+0000 7f6ebb013800 10 monclient: get_monmap_and_config 2024-09-14T11:04:34.126 INFO:tasks.workunit.client.0.smithi097.stderr: -348> 2024-09-14T11:04:33.772+0000 7f6ebb013800 10 monclient: build_initial_monmap 2024-09-14T11:04:34.127 INFO:tasks.workunit.client.0.smithi097.stderr: -347> 2024-09-14T11:04:33.772+0000 7f6ebb013800 1 build_initial for_mkfs: 0 2024-09-14T11:04:34.127 INFO:tasks.workunit.client.0.smithi097.stderr: -346> 2024-09-14T11:04:33.772+0000 7f6ebb013800 10 monclient: monmap: 2024-09-14T11:04:34.127 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:04:34.127 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:04:34.127 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:04:34.127 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:04:34.127 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:04:34.127 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:04:34.127 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:04:34.127 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:04:34.127 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:04:34.127 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:04:34.127 INFO:tasks.workunit.client.0.smithi097.stderr: -345> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc81820) adding auth protocol: cephx 2024-09-14T11:04:34.127 INFO:tasks.workunit.client.0.smithi097.stderr: -344> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc81820) adding auth protocol: cephx 2024-09-14T11:04:34.128 INFO:tasks.workunit.client.0.smithi097.stderr: -343> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc81820) adding auth protocol: cephx 2024-09-14T11:04:34.128 INFO:tasks.workunit.client.0.smithi097.stderr: -342> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc81820) adding con mode: secure 2024-09-14T11:04:34.128 INFO:tasks.workunit.client.0.smithi097.stderr: -341> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc81820) adding con mode: crc 2024-09-14T11:04:34.128 INFO:tasks.workunit.client.0.smithi097.stderr: -340> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc81820) adding con mode: secure 2024-09-14T11:04:34.128 INFO:tasks.workunit.client.0.smithi097.stderr: -339> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc81820) adding con mode: crc 2024-09-14T11:04:34.128 INFO:tasks.workunit.client.0.smithi097.stderr: -338> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc81820) adding con mode: secure 2024-09-14T11:04:34.128 INFO:tasks.workunit.client.0.smithi097.stderr: -337> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc81820) adding con mode: crc 2024-09-14T11:04:34.128 INFO:tasks.workunit.client.0.smithi097.stderr: -336> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc81820) adding con mode: crc 2024-09-14T11:04:34.128 INFO:tasks.workunit.client.0.smithi097.stderr: -335> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc81820) adding con mode: secure 2024-09-14T11:04:34.128 INFO:tasks.workunit.client.0.smithi097.stderr: -334> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc81820) adding con mode: crc 2024-09-14T11:04:34.128 INFO:tasks.workunit.client.0.smithi097.stderr: -333> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc81820) adding con mode: secure 2024-09-14T11:04:34.128 INFO:tasks.workunit.client.0.smithi097.stderr: -332> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc81820) adding con mode: crc 2024-09-14T11:04:34.128 INFO:tasks.workunit.client.0.smithi097.stderr: -331> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc81820) adding con mode: secure 2024-09-14T11:04:34.129 INFO:tasks.workunit.client.0.smithi097.stderr: -330> 2024-09-14T11:04:33.772+0000 7f6ebb013800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:04:34.129 INFO:tasks.workunit.client.0.smithi097.stderr: -329> 2024-09-14T11:04:33.772+0000 7f6ebb013800 10 monclient: init 2024-09-14T11:04:34.129 INFO:tasks.workunit.client.0.smithi097.stderr: -328> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8c850) adding auth protocol: cephx 2024-09-14T11:04:34.129 INFO:tasks.workunit.client.0.smithi097.stderr: -327> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8c850) adding auth protocol: cephx 2024-09-14T11:04:34.129 INFO:tasks.workunit.client.0.smithi097.stderr: -326> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8c850) adding auth protocol: cephx 2024-09-14T11:04:34.129 INFO:tasks.workunit.client.0.smithi097.stderr: -325> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8c850) adding con mode: secure 2024-09-14T11:04:34.129 INFO:tasks.workunit.client.0.smithi097.stderr: -324> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8c850) adding con mode: crc 2024-09-14T11:04:34.129 INFO:tasks.workunit.client.0.smithi097.stderr: -323> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8c850) adding con mode: secure 2024-09-14T11:04:34.129 INFO:tasks.workunit.client.0.smithi097.stderr: -322> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8c850) adding con mode: crc 2024-09-14T11:04:34.129 INFO:tasks.workunit.client.0.smithi097.stderr: -321> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8c850) adding con mode: secure 2024-09-14T11:04:34.129 INFO:tasks.workunit.client.0.smithi097.stderr: -320> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8c850) adding con mode: crc 2024-09-14T11:04:34.129 INFO:tasks.workunit.client.0.smithi097.stderr: -319> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8c850) adding con mode: crc 2024-09-14T11:04:34.129 INFO:tasks.workunit.client.0.smithi097.stderr: -318> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8c850) adding con mode: secure 2024-09-14T11:04:34.130 INFO:tasks.workunit.client.0.smithi097.stderr: -317> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8c850) adding con mode: crc 2024-09-14T11:04:34.130 INFO:tasks.workunit.client.0.smithi097.stderr: -316> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8c850) adding con mode: secure 2024-09-14T11:04:34.130 INFO:tasks.workunit.client.0.smithi097.stderr: -315> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8c850) adding con mode: crc 2024-09-14T11:04:34.130 INFO:tasks.workunit.client.0.smithi097.stderr: -314> 2024-09-14T11:04:33.772+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8c850) adding con mode: secure 2024-09-14T11:04:34.130 INFO:tasks.workunit.client.0.smithi097.stderr: -313> 2024-09-14T11:04:33.772+0000 7f6ebb013800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:04:34.130 INFO:tasks.workunit.client.0.smithi097.stderr: -312> 2024-09-14T11:04:33.773+0000 7f6ebb013800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:04:34.130 INFO:tasks.workunit.client.0.smithi097.stderr: -311> 2024-09-14T11:04:33.773+0000 7f6ebb013800 5 asok(0x559d1b9c0270) register_command rotate-key cmddesc rotate-key hook 0x7fffd5f8c998 EEXIST 2024-09-14T11:04:34.130 INFO:tasks.workunit.client.0.smithi097.stderr: -310> 2024-09-14T11:04:33.773+0000 7f6ebb013800 10 monclient: _reopen_session rank -1 2024-09-14T11:04:34.130 INFO:tasks.workunit.client.0.smithi097.stderr: -309> 2024-09-14T11:04:33.773+0000 7f6ebb013800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:04:34.130 INFO:tasks.workunit.client.0.smithi097.stderr: -308> 2024-09-14T11:04:33.773+0000 7f6ebb013800 10 monclient(hunting): picked mon.noname-a con 0x559d1bcb5ee0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:04:34.130 INFO:tasks.workunit.client.0.smithi097.stderr: -307> 2024-09-14T11:04:33.773+0000 7f6ebb013800 10 monclient(hunting): picked mon.noname-b con 0x559d1bc85cf0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:04:34.130 INFO:tasks.workunit.client.0.smithi097.stderr: -306> 2024-09-14T11:04:33.773+0000 7f6ebb013800 10 monclient(hunting): picked mon.noname-c con 0x559d1bcb12a0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:04:34.130 INFO:tasks.workunit.client.0.smithi097.stderr: -305> 2024-09-14T11:04:33.773+0000 7f6ebb013800 10 monclient(hunting): start opening mon connection 2024-09-14T11:04:34.131 INFO:tasks.workunit.client.0.smithi097.stderr: -304> 2024-09-14T11:04:33.773+0000 7f6ebb013800 10 monclient(hunting): start opening mon connection 2024-09-14T11:04:34.131 INFO:tasks.workunit.client.0.smithi097.stderr: -303> 2024-09-14T11:04:33.773+0000 7f6ebb013800 10 monclient(hunting): start opening mon connection 2024-09-14T11:04:34.131 INFO:tasks.workunit.client.0.smithi097.stderr: -302> 2024-09-14T11:04:33.773+0000 7f6ebb013800 10 monclient(hunting): _renew_subs 2024-09-14T11:04:34.131 INFO:tasks.workunit.client.0.smithi097.stderr: -301> 2024-09-14T11:04:33.773+0000 7f6ebb013800 10 monclient(hunting): authenticate will time out at 1955.426197s 2024-09-14T11:04:34.131 INFO:tasks.workunit.client.0.smithi097.stderr: -300> 2024-09-14T11:04:33.773+0000 7f6eb6792640 10 monclient(hunting): get_auth_request con 0x559d1bcb12a0 auth_method 0 2024-09-14T11:04:34.131 INFO:tasks.workunit.client.0.smithi097.stderr: -299> 2024-09-14T11:04:33.773+0000 7f6eb6792640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:04:34.131 INFO:tasks.workunit.client.0.smithi097.stderr: -298> 2024-09-14T11:04:33.773+0000 7f6eb6792640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:04:34.131 INFO:tasks.workunit.client.0.smithi097.stderr: -297> 2024-09-14T11:04:33.773+0000 7f6eb6792640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:04:34.131 INFO:tasks.workunit.client.0.smithi097.stderr: -296> 2024-09-14T11:04:33.773+0000 7f6eaffff640 10 monclient(hunting): get_auth_request con 0x559d1bcb5ee0 auth_method 0 2024-09-14T11:04:34.131 INFO:tasks.workunit.client.0.smithi097.stderr: -295> 2024-09-14T11:04:33.773+0000 7f6eaffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:04:34.131 INFO:tasks.workunit.client.0.smithi097.stderr: -294> 2024-09-14T11:04:33.773+0000 7f6eaffff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:04:34.131 INFO:tasks.workunit.client.0.smithi097.stderr: -293> 2024-09-14T11:04:33.773+0000 7f6eaffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:04:34.131 INFO:tasks.workunit.client.0.smithi097.stderr: -292> 2024-09-14T11:04:33.773+0000 7f6eb6f93640 10 monclient(hunting): get_auth_request con 0x559d1bc85cf0 auth_method 0 2024-09-14T11:04:34.131 INFO:tasks.workunit.client.0.smithi097.stderr: -291> 2024-09-14T11:04:33.773+0000 7f6eb6f93640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:04:34.132 INFO:tasks.workunit.client.0.smithi097.stderr: -290> 2024-09-14T11:04:33.773+0000 7f6eb6f93640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:04:34.132 INFO:tasks.workunit.client.0.smithi097.stderr: -289> 2024-09-14T11:04:33.773+0000 7f6eb6f93640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:04:34.132 INFO:tasks.workunit.client.0.smithi097.stderr: -288> 2024-09-14T11:04:33.773+0000 7f6eb6792640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:04:34.132 INFO:tasks.workunit.client.0.smithi097.stderr: -287> 2024-09-14T11:04:33.773+0000 7f6eb6792640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:04:34.132 INFO:tasks.workunit.client.0.smithi097.stderr: -286> 2024-09-14T11:04:33.773+0000 7f6eb6792640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:04:34.132 INFO:tasks.workunit.client.0.smithi097.stderr: -285> 2024-09-14T11:04:33.773+0000 7f6eaffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:04:34.132 INFO:tasks.workunit.client.0.smithi097.stderr: -284> 2024-09-14T11:04:33.773+0000 7f6eaffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:04:34.132 INFO:tasks.workunit.client.0.smithi097.stderr: -283> 2024-09-14T11:04:33.773+0000 7f6eaffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:04:34.132 INFO:tasks.workunit.client.0.smithi097.stderr: -282> 2024-09-14T11:04:33.773+0000 7f6eb6f93640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:04:34.132 INFO:tasks.workunit.client.0.smithi097.stderr: -281> 2024-09-14T11:04:33.773+0000 7f6eb6f93640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:04:34.132 INFO:tasks.workunit.client.0.smithi097.stderr: -280> 2024-09-14T11:04:33.773+0000 7f6eb6f93640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:04:34.132 INFO:tasks.workunit.client.0.smithi097.stderr: -279> 2024-09-14T11:04:33.773+0000 7f6eb6792640 10 monclient(hunting): handle_auth_done global_id 6707 payload 274 2024-09-14T11:04:34.132 INFO:tasks.workunit.client.0.smithi097.stderr: -278> 2024-09-14T11:04:33.773+0000 7f6eb6792640 10 monclient: _finish_hunting 0 2024-09-14T11:04:34.132 INFO:tasks.workunit.client.0.smithi097.stderr: -277> 2024-09-14T11:04:33.773+0000 7f6eb6792640 1 monclient: found mon.noname-c 2024-09-14T11:04:34.133 INFO:tasks.workunit.client.0.smithi097.stderr: -276> 2024-09-14T11:04:33.773+0000 7f6eb6792640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:04:34.133 INFO:tasks.workunit.client.0.smithi097.stderr: -275> 2024-09-14T11:04:33.773+0000 7f6d99ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:04:34.133 INFO:tasks.workunit.client.0.smithi097.stderr: -274> 2024-09-14T11:04:33.773+0000 7f6d99ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:04:34.133 INFO:tasks.workunit.client.0.smithi097.stderr: -273> 2024-09-14T11:04:33.773+0000 7f6d99ffb640 10 monclient: dump: 2024-09-14T11:04:34.133 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:04:34.133 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:04:34.133 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:04:34.133 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:04:34.133 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:04:34.133 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:04:34.133 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:04:34.133 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:04:34.133 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:04:34.133 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:04:34.134 INFO:tasks.workunit.client.0.smithi097.stderr: -272> 2024-09-14T11:04:33.773+0000 7f6d99ffb640 10 monclient: _finish_auth 0 2024-09-14T11:04:34.134 INFO:tasks.workunit.client.0.smithi097.stderr: -271> 2024-09-14T11:04:33.773+0000 7f6d99ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:04:34.134 INFO:tasks.workunit.client.0.smithi097.stderr: -270> 2024-09-14T11:04:33.773+0000 7f6d99ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:04:34.134 INFO:tasks.workunit.client.0.smithi097.stderr: -269> 2024-09-14T11:04:33.773+0000 7f6d99ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:04:34.134 INFO:tasks.workunit.client.0.smithi097.stderr: -268> 2024-09-14T11:04:33.773+0000 7f6d99ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:04:34.134 INFO:tasks.workunit.client.0.smithi097.stderr: -267> 2024-09-14T11:04:33.773+0000 7f6d99ffb640 10 monclient: dump: 2024-09-14T11:04:34.134 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:04:34.134 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:04:34.134 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:04:34.134 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:04:34.134 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:04:34.134 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:04:34.134 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:04:34.134 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:04:34.135 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:04:34.135 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:04:34.135 INFO:tasks.workunit.client.0.smithi097.stderr: -266> 2024-09-14T11:04:33.773+0000 7f6ebb013800 5 monclient: authenticate success, global_id 6707 2024-09-14T11:04:34.135 INFO:tasks.workunit.client.0.smithi097.stderr: -265> 2024-09-14T11:04:33.773+0000 7f6ebb013800 10 monclient: get_monmap_and_config success 2024-09-14T11:04:34.135 INFO:tasks.workunit.client.0.smithi097.stderr: -264> 2024-09-14T11:04:33.773+0000 7f6ebb013800 4 set_mon_vals no callback set 2024-09-14T11:04:34.135 INFO:tasks.workunit.client.0.smithi097.stderr: -263> 2024-09-14T11:04:33.774+0000 7f6ebb013800 10 monclient: shutdown 2024-09-14T11:04:34.135 INFO:tasks.workunit.client.0.smithi097.stderr: -262> 2024-09-14T11:04:33.774+0000 7f6ebb013800 10 monclient: build_initial_monmap 2024-09-14T11:04:34.135 INFO:tasks.workunit.client.0.smithi097.stderr: -261> 2024-09-14T11:04:33.774+0000 7f6ebb013800 1 build_initial for_mkfs: 0 2024-09-14T11:04:34.135 INFO:tasks.workunit.client.0.smithi097.stderr: -260> 2024-09-14T11:04:33.774+0000 7f6ebb013800 10 monclient: monmap: 2024-09-14T11:04:34.135 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:04:34.135 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:04:34.135 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:04:34.135 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:04:34.135 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:04:34.136 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:04:34.136 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:04:34.136 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:04:34.136 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:04:34.136 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:04:34.136 INFO:tasks.workunit.client.0.smithi097.stderr: -259> 2024-09-14T11:04:33.774+0000 7f6ebb013800 5 AuthRegistry(0x559d1bcb1750) adding auth protocol: cephx 2024-09-14T11:04:34.136 INFO:tasks.workunit.client.0.smithi097.stderr: -258> 2024-09-14T11:04:33.774+0000 7f6ebb013800 5 AuthRegistry(0x559d1bcb1750) adding auth protocol: cephx 2024-09-14T11:04:34.136 INFO:tasks.workunit.client.0.smithi097.stderr: -257> 2024-09-14T11:04:33.774+0000 7f6ebb013800 5 AuthRegistry(0x559d1bcb1750) adding auth protocol: cephx 2024-09-14T11:04:34.136 INFO:tasks.workunit.client.0.smithi097.stderr: -256> 2024-09-14T11:04:33.774+0000 7f6ebb013800 5 AuthRegistry(0x559d1bcb1750) adding con mode: secure 2024-09-14T11:04:34.136 INFO:tasks.workunit.client.0.smithi097.stderr: -255> 2024-09-14T11:04:33.774+0000 7f6ebb013800 5 AuthRegistry(0x559d1bcb1750) adding con mode: crc 2024-09-14T11:04:34.136 INFO:tasks.workunit.client.0.smithi097.stderr: -254> 2024-09-14T11:04:33.774+0000 7f6ebb013800 5 AuthRegistry(0x559d1bcb1750) adding con mode: secure 2024-09-14T11:04:34.136 INFO:tasks.workunit.client.0.smithi097.stderr: -253> 2024-09-14T11:04:33.774+0000 7f6ebb013800 5 AuthRegistry(0x559d1bcb1750) adding con mode: crc 2024-09-14T11:04:34.136 INFO:tasks.workunit.client.0.smithi097.stderr: -252> 2024-09-14T11:04:33.774+0000 7f6ebb013800 5 AuthRegistry(0x559d1bcb1750) adding con mode: secure 2024-09-14T11:04:34.137 INFO:tasks.workunit.client.0.smithi097.stderr: -251> 2024-09-14T11:04:33.774+0000 7f6ebb013800 5 AuthRegistry(0x559d1bcb1750) adding con mode: crc 2024-09-14T11:04:34.137 INFO:tasks.workunit.client.0.smithi097.stderr: -250> 2024-09-14T11:04:33.774+0000 7f6ebb013800 5 AuthRegistry(0x559d1bcb1750) adding con mode: crc 2024-09-14T11:04:34.137 INFO:tasks.workunit.client.0.smithi097.stderr: -249> 2024-09-14T11:04:33.774+0000 7f6ebb013800 5 AuthRegistry(0x559d1bcb1750) adding con mode: secure 2024-09-14T11:04:34.137 INFO:tasks.workunit.client.0.smithi097.stderr: -248> 2024-09-14T11:04:33.774+0000 7f6ebb013800 5 AuthRegistry(0x559d1bcb1750) adding con mode: crc 2024-09-14T11:04:34.137 INFO:tasks.workunit.client.0.smithi097.stderr: -247> 2024-09-14T11:04:33.774+0000 7f6ebb013800 5 AuthRegistry(0x559d1bcb1750) adding con mode: secure 2024-09-14T11:04:34.137 INFO:tasks.workunit.client.0.smithi097.stderr: -246> 2024-09-14T11:04:33.774+0000 7f6ebb013800 5 AuthRegistry(0x559d1bcb1750) adding con mode: crc 2024-09-14T11:04:34.137 INFO:tasks.workunit.client.0.smithi097.stderr: -245> 2024-09-14T11:04:33.774+0000 7f6ebb013800 5 AuthRegistry(0x559d1bcb1750) adding con mode: secure 2024-09-14T11:04:34.137 INFO:tasks.workunit.client.0.smithi097.stderr: -244> 2024-09-14T11:04:33.774+0000 7f6ebb013800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:04:34.137 INFO:tasks.workunit.client.0.smithi097.stderr: -243> 2024-09-14T11:04:33.774+0000 7f6ebb013800 1 librados: starting msgr at 2024-09-14T11:04:34.137 INFO:tasks.workunit.client.0.smithi097.stderr: -242> 2024-09-14T11:04:33.774+0000 7f6ebb013800 1 librados: starting objecter 2024-09-14T11:04:34.137 INFO:tasks.workunit.client.0.smithi097.stderr: -241> 2024-09-14T11:04:33.774+0000 7f6ebb013800 5 asok(0x559d1b9c0270) register_command objecter_requests cmddesc objecter_requests hook 0x559d1bc83e80 EEXIST 2024-09-14T11:04:34.137 INFO:tasks.workunit.client.0.smithi097.stderr: -240> 2024-09-14T11:04:33.775+0000 7f6ebb013800 1 librados: setting wanted keys 2024-09-14T11:04:34.137 INFO:tasks.workunit.client.0.smithi097.stderr: -239> 2024-09-14T11:04:33.775+0000 7f6ebb013800 1 librados: calling monclient init 2024-09-14T11:04:34.137 INFO:tasks.workunit.client.0.smithi097.stderr: -238> 2024-09-14T11:04:33.775+0000 7f6ebb013800 10 monclient: init 2024-09-14T11:04:34.138 INFO:tasks.workunit.client.0.smithi097.stderr: -237> 2024-09-14T11:04:33.775+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc76520) adding auth protocol: cephx 2024-09-14T11:04:34.138 INFO:tasks.workunit.client.0.smithi097.stderr: -236> 2024-09-14T11:04:33.775+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc76520) adding auth protocol: cephx 2024-09-14T11:04:34.138 INFO:tasks.workunit.client.0.smithi097.stderr: -235> 2024-09-14T11:04:33.775+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc76520) adding auth protocol: cephx 2024-09-14T11:04:34.138 INFO:tasks.workunit.client.0.smithi097.stderr: -234> 2024-09-14T11:04:33.775+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc76520) adding con mode: secure 2024-09-14T11:04:34.138 INFO:tasks.workunit.client.0.smithi097.stderr: -233> 2024-09-14T11:04:33.775+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc76520) adding con mode: crc 2024-09-14T11:04:34.138 INFO:tasks.workunit.client.0.smithi097.stderr: -232> 2024-09-14T11:04:33.775+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc76520) adding con mode: secure 2024-09-14T11:04:34.138 INFO:tasks.workunit.client.0.smithi097.stderr: -231> 2024-09-14T11:04:33.775+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc76520) adding con mode: crc 2024-09-14T11:04:34.138 INFO:tasks.workunit.client.0.smithi097.stderr: -230> 2024-09-14T11:04:33.775+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc76520) adding con mode: secure 2024-09-14T11:04:34.138 INFO:tasks.workunit.client.0.smithi097.stderr: -229> 2024-09-14T11:04:33.775+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc76520) adding con mode: crc 2024-09-14T11:04:34.138 INFO:tasks.workunit.client.0.smithi097.stderr: -228> 2024-09-14T11:04:33.775+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc76520) adding con mode: crc 2024-09-14T11:04:34.138 INFO:tasks.workunit.client.0.smithi097.stderr: -227> 2024-09-14T11:04:33.775+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc76520) adding con mode: secure 2024-09-14T11:04:34.138 INFO:tasks.workunit.client.0.smithi097.stderr: -226> 2024-09-14T11:04:33.775+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc76520) adding con mode: crc 2024-09-14T11:04:34.138 INFO:tasks.workunit.client.0.smithi097.stderr: -225> 2024-09-14T11:04:33.775+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc76520) adding con mode: secure 2024-09-14T11:04:34.138 INFO:tasks.workunit.client.0.smithi097.stderr: -224> 2024-09-14T11:04:33.775+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc76520) adding con mode: crc 2024-09-14T11:04:34.139 INFO:tasks.workunit.client.0.smithi097.stderr: -223> 2024-09-14T11:04:33.775+0000 7f6ebb013800 5 AuthRegistry(0x559d1bc76520) adding con mode: secure 2024-09-14T11:04:34.139 INFO:tasks.workunit.client.0.smithi097.stderr: -222> 2024-09-14T11:04:33.775+0000 7f6ebb013800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:04:34.139 INFO:tasks.workunit.client.0.smithi097.stderr: -221> 2024-09-14T11:04:33.775+0000 7f6ebb013800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:04:34.139 INFO:tasks.workunit.client.0.smithi097.stderr: -220> 2024-09-14T11:04:33.775+0000 7f6ebb013800 5 asok(0x559d1b9c0270) register_command rotate-key cmddesc rotate-key hook 0x559d1bc76668 EEXIST 2024-09-14T11:04:34.139 INFO:tasks.workunit.client.0.smithi097.stderr: -219> 2024-09-14T11:04:33.775+0000 7f6ebb013800 10 monclient: _reopen_session rank -1 2024-09-14T11:04:34.139 INFO:tasks.workunit.client.0.smithi097.stderr: -218> 2024-09-14T11:04:33.775+0000 7f6ebb013800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:04:34.139 INFO:tasks.workunit.client.0.smithi097.stderr: -217> 2024-09-14T11:04:33.775+0000 7f6ebb013800 10 monclient(hunting): picked mon.noname-b con 0x559d1bc85cf0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:04:34.139 INFO:tasks.workunit.client.0.smithi097.stderr: -216> 2024-09-14T11:04:33.775+0000 7f6ebb013800 10 monclient(hunting): picked mon.noname-c con 0x559d1bcb12a0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:04:34.139 INFO:tasks.workunit.client.0.smithi097.stderr: -215> 2024-09-14T11:04:33.775+0000 7f6ebb013800 10 monclient(hunting): picked mon.noname-a con 0x559d1bcb5ee0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:04:34.139 INFO:tasks.workunit.client.0.smithi097.stderr: -214> 2024-09-14T11:04:33.775+0000 7f6ebb013800 10 monclient(hunting): start opening mon connection 2024-09-14T11:04:34.139 INFO:tasks.workunit.client.0.smithi097.stderr: -213> 2024-09-14T11:04:33.775+0000 7f6ebb013800 10 monclient(hunting): start opening mon connection 2024-09-14T11:04:34.139 INFO:tasks.workunit.client.0.smithi097.stderr: -212> 2024-09-14T11:04:33.775+0000 7f6ebb013800 10 monclient(hunting): start opening mon connection 2024-09-14T11:04:34.139 INFO:tasks.workunit.client.0.smithi097.stderr: -211> 2024-09-14T11:04:33.775+0000 7f6ebb013800 10 monclient(hunting): _renew_subs 2024-09-14T11:04:34.139 INFO:tasks.workunit.client.0.smithi097.stderr: -210> 2024-09-14T11:04:33.775+0000 7f6ebb013800 10 monclient(hunting): authenticate will time out at 1955.428543s 2024-09-14T11:04:34.140 INFO:tasks.workunit.client.0.smithi097.stderr: -209> 2024-09-14T11:04:33.775+0000 7f6eb6792640 10 monclient(hunting): get_auth_request con 0x559d1bcb5ee0 auth_method 0 2024-09-14T11:04:34.140 INFO:tasks.workunit.client.0.smithi097.stderr: -208> 2024-09-14T11:04:33.775+0000 7f6eb6792640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:04:34.140 INFO:tasks.workunit.client.0.smithi097.stderr: -207> 2024-09-14T11:04:33.775+0000 7f6eb6792640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:04:34.140 INFO:tasks.workunit.client.0.smithi097.stderr: -206> 2024-09-14T11:04:33.775+0000 7f6eb6792640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:04:34.140 INFO:tasks.workunit.client.0.smithi097.stderr: -205> 2024-09-14T11:04:33.775+0000 7f6eb6f93640 10 monclient(hunting): get_auth_request con 0x559d1bcb12a0 auth_method 0 2024-09-14T11:04:34.140 INFO:tasks.workunit.client.0.smithi097.stderr: -204> 2024-09-14T11:04:33.775+0000 7f6eb6f93640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:04:34.140 INFO:tasks.workunit.client.0.smithi097.stderr: -203> 2024-09-14T11:04:33.775+0000 7f6eb6f93640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:04:34.140 INFO:tasks.workunit.client.0.smithi097.stderr: -202> 2024-09-14T11:04:33.775+0000 7f6eb6f93640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:04:34.140 INFO:tasks.workunit.client.0.smithi097.stderr: -201> 2024-09-14T11:04:33.775+0000 7f6eb6792640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:04:34.140 INFO:tasks.workunit.client.0.smithi097.stderr: -200> 2024-09-14T11:04:33.775+0000 7f6eb6792640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:04:34.140 INFO:tasks.workunit.client.0.smithi097.stderr: -199> 2024-09-14T11:04:33.775+0000 7f6eb6792640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:04:34.140 INFO:tasks.workunit.client.0.smithi097.stderr: -198> 2024-09-14T11:04:33.775+0000 7f6eb6f93640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:04:34.140 INFO:tasks.workunit.client.0.smithi097.stderr: -197> 2024-09-14T11:04:33.775+0000 7f6eb6f93640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:04:34.140 INFO:tasks.workunit.client.0.smithi097.stderr: -196> 2024-09-14T11:04:33.775+0000 7f6eb6f93640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:04:34.141 INFO:tasks.workunit.client.0.smithi097.stderr: -195> 2024-09-14T11:04:33.775+0000 7f6eb6792640 10 monclient(hunting): handle_auth_done global_id 7119 payload 824 2024-09-14T11:04:34.141 INFO:tasks.workunit.client.0.smithi097.stderr: -194> 2024-09-14T11:04:33.775+0000 7f6eb6792640 10 monclient: _finish_hunting 0 2024-09-14T11:04:34.141 INFO:tasks.workunit.client.0.smithi097.stderr: -193> 2024-09-14T11:04:33.775+0000 7f6eb6792640 1 monclient: found mon.noname-a 2024-09-14T11:04:34.141 INFO:tasks.workunit.client.0.smithi097.stderr: -192> 2024-09-14T11:04:33.775+0000 7f6eb6792640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-14T11:04:34.141 INFO:tasks.workunit.client.0.smithi097.stderr: -191> 2024-09-14T11:04:33.775+0000 7f6eaffff640 10 monclient: get_auth_request con 0x559d1bc85cf0 auth_method 0 2024-09-14T11:04:34.141 INFO:tasks.workunit.client.0.smithi097.stderr: -190> 2024-09-14T11:04:33.776+0000 7f6d87fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:04:34.141 INFO:tasks.workunit.client.0.smithi097.stderr: -189> 2024-09-14T11:04:33.776+0000 7f6d87fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:04:34.141 INFO:tasks.workunit.client.0.smithi097.stderr: -188> 2024-09-14T11:04:33.776+0000 7f6d87fff640 10 monclient: dump: 2024-09-14T11:04:34.141 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:04:34.141 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:04:34.141 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:04:34.141 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:04:34.141 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:04:34.141 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:04:34.142 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:04:34.142 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:04:34.142 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:04:34.142 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:04:34.142 INFO:tasks.workunit.client.0.smithi097.stderr: -187> 2024-09-14T11:04:33.776+0000 7f6d87fff640 10 monclient: _finish_auth 0 2024-09-14T11:04:34.142 INFO:tasks.workunit.client.0.smithi097.stderr: -186> 2024-09-14T11:04:33.776+0000 7f6d87fff640 10 monclient: _check_auth_tickets 2024-09-14T11:04:34.142 INFO:tasks.workunit.client.0.smithi097.stderr: -185> 2024-09-14T11:04:33.776+0000 7f6ebb013800 5 monclient: authenticate success, global_id 7119 2024-09-14T11:04:34.142 INFO:tasks.workunit.client.0.smithi097.stderr: -184> 2024-09-14T11:04:33.776+0000 7f6d87fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:04:34.142 INFO:tasks.workunit.client.0.smithi097.stderr: -183> 2024-09-14T11:04:33.776+0000 7f6d87fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:04:34.142 INFO:tasks.workunit.client.0.smithi097.stderr: -182> 2024-09-14T11:04:33.776+0000 7f6d87fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:04:34.142 INFO:tasks.workunit.client.0.smithi097.stderr: -181> 2024-09-14T11:04:33.776+0000 7f6d87fff640 10 monclient: dump: 2024-09-14T11:04:34.142 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:04:34.142 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:04:34.143 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:04:34.143 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:04:34.143 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:04:34.143 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:04:34.143 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:04:34.143 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:04:34.143 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:04:34.143 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:04:34.143 INFO:tasks.workunit.client.0.smithi097.stderr: -180> 2024-09-14T11:04:33.776+0000 7f6ebb013800 10 monclient: _renew_subs 2024-09-14T11:04:34.143 INFO:tasks.workunit.client.0.smithi097.stderr: -179> 2024-09-14T11:04:33.776+0000 7f6d99ffb640 4 set_mon_vals no callback set 2024-09-14T11:04:34.143 INFO:tasks.workunit.client.0.smithi097.stderr: -178> 2024-09-14T11:04:33.776+0000 7f6ebb013800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:04:34.143 INFO:tasks.workunit.client.0.smithi097.stderr: -177> 2024-09-14T11:04:33.776+0000 7f6ebb013800 10 monclient: _renew_subs 2024-09-14T11:04:34.143 INFO:tasks.workunit.client.0.smithi097.stderr: -176> 2024-09-14T11:04:33.776+0000 7f6ebb013800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:04:34.143 INFO:tasks.workunit.client.0.smithi097.stderr: -175> 2024-09-14T11:04:33.776+0000 7f6ebb013800 1 librados: init done 2024-09-14T11:04:34.144 INFO:tasks.workunit.client.0.smithi097.stderr: -174> 2024-09-14T11:04:33.776+0000 7f6ebb013800 5 asok(0x559d1b9c0270) register_command cr dump hook 0x559d1bcaa2e8 2024-09-14T11:04:34.144 INFO:tasks.workunit.client.0.smithi097.stderr: -173> 2024-09-14T11:04:33.778+0000 7f6ebb013800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.144 INFO:tasks.workunit.client.0.smithi097.stderr: -172> 2024-09-14T11:04:33.779+0000 7f6d87fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:04:34.144 INFO:tasks.workunit.client.0.smithi097.stderr: -171> 2024-09-14T11:04:33.779+0000 7f6d87fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:04:34.144 INFO:tasks.workunit.client.0.smithi097.stderr: -170> 2024-09-14T11:04:33.779+0000 7f6d87fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:04:34.144 INFO:tasks.workunit.client.0.smithi097.stderr: -169> 2024-09-14T11:04:33.779+0000 7f6eaffff640 10 monclient: get_auth_request con 0x7f6d80077230 auth_method 0 2024-09-14T11:04:34.144 INFO:tasks.workunit.client.0.smithi097.stderr: -168> 2024-09-14T11:04:33.779+0000 7f6eb6f93640 10 monclient: get_auth_request con 0x559d1bcd0530 auth_method 0 2024-09-14T11:04:34.144 INFO:tasks.workunit.client.0.smithi097.stderr: -167> 2024-09-14T11:04:33.780+0000 7f6ebb013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:34.144 INFO:tasks.workunit.client.0.smithi097.stderr: -166> 2024-09-14T11:04:33.780+0000 7f6ebb013800 20 realm 2024-09-14T11:04:34.144 INFO:tasks.workunit.client.0.smithi097.stderr: -165> 2024-09-14T11:04:33.780+0000 7f6ebb013800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.144 INFO:tasks.workunit.client.0.smithi097.stderr: -164> 2024-09-14T11:04:33.780+0000 7f6ebb013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:34.144 INFO:tasks.workunit.client.0.smithi097.stderr: -163> 2024-09-14T11:04:33.780+0000 7f6ebb013800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:04:34.144 INFO:tasks.workunit.client.0.smithi097.stderr: -162> 2024-09-14T11:04:33.780+0000 7f6ebb013800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.144 INFO:tasks.workunit.client.0.smithi097.stderr: -161> 2024-09-14T11:04:33.780+0000 7f6ebb013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:34.145 INFO:tasks.workunit.client.0.smithi097.stderr: -160> 2024-09-14T11:04:33.780+0000 7f6ebb013800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.145 INFO:tasks.workunit.client.0.smithi097.stderr: -159> 2024-09-14T11:04:33.781+0000 7f6eaffff640 10 monclient: get_auth_request con 0x559d1bcd4700 auth_method 0 2024-09-14T11:04:34.145 INFO:tasks.workunit.client.0.smithi097.stderr: -158> 2024-09-14T11:04:33.781+0000 7f6ebb013800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:04:34.145 INFO:tasks.workunit.client.0.smithi097.stderr: -157> 2024-09-14T11:04:33.781+0000 7f6ebb013800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.145 INFO:tasks.workunit.client.0.smithi097.stderr: -156> 2024-09-14T11:04:33.781+0000 7f6eb6f93640 10 monclient: get_auth_request con 0x559d1bcd7f60 auth_method 0 2024-09-14T11:04:34.145 INFO:tasks.workunit.client.0.smithi097.stderr: -155> 2024-09-14T11:04:33.782+0000 7f6ebb013800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:04:34.145 INFO:tasks.workunit.client.0.smithi097.stderr: -154> 2024-09-14T11:04:33.782+0000 7f6ebb013800 20 searching for the correct realm 2024-09-14T11:04:34.145 INFO:tasks.workunit.client.0.smithi097.stderr: -153> 2024-09-14T11:04:33.782+0000 7f6eb6792640 10 monclient: get_auth_request con 0x559d1bcdcc70 auth_method 0 2024-09-14T11:04:34.145 INFO:tasks.workunit.client.0.smithi097.stderr: -152> 2024-09-14T11:04:33.783+0000 7f6eaffff640 10 monclient: get_auth_request con 0x7f6ea80e4be0 auth_method 0 2024-09-14T11:04:34.145 INFO:tasks.workunit.client.0.smithi097.stderr: -151> 2024-09-14T11:04:33.784+0000 7f6eb6f93640 0 -- 172.21.15.97:0/440857257 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f6ea0018070 msgr2=0x7f6ea007ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:04:34.145 INFO:tasks.workunit.client.0.smithi097.stderr: -150> 2024-09-14T11:04:33.986+0000 7f6eb6f93640 10 monclient: get_auth_request con 0x7f6ea0018070 auth_method 0 2024-09-14T11:04:34.145 INFO:tasks.workunit.client.0.smithi097.stderr: -149> 2024-09-14T11:04:33.988+0000 7f6eb6792640 10 monclient: get_auth_request con 0x7f6ea0088bc0 auth_method 0 2024-09-14T11:04:34.145 INFO:tasks.workunit.client.0.smithi097.stderr: -148> 2024-09-14T11:04:33.989+0000 7f6eaffff640 10 monclient: get_auth_request con 0x7f6ea80b7800 auth_method 0 2024-09-14T11:04:34.145 INFO:tasks.workunit.client.0.smithi097.stderr: -147> 2024-09-14T11:04:33.989+0000 7f6eaffff640 0 -- 172.21.15.97:0/440857257 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f6ea80b7800 msgr2=0x7f6ea80b1640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:04:34.146 INFO:tasks.workunit.client.0.smithi097.stderr: -146> 2024-09-14T11:04:33.989+0000 7f6d87fff640 1 client.7119.objecter ms_handle_reset 0x7f6ea80b7800 session 0x7f6ea80bd040 osd.3 2024-09-14T11:04:34.146 INFO:tasks.workunit.client.0.smithi097.stderr: -145> 2024-09-14T11:04:33.989+0000 7f6d87fff640 10 monclient: _renew_subs 2024-09-14T11:04:34.146 INFO:tasks.workunit.client.0.smithi097.stderr: -144> 2024-09-14T11:04:33.989+0000 7f6d87fff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:04:34.146 INFO:tasks.workunit.client.0.smithi097.stderr: -143> 2024-09-14T11:04:33.989+0000 7f6eaffff640 10 monclient: get_auth_request con 0x7f6d80086d30 auth_method 0 2024-09-14T11:04:34.146 INFO:tasks.workunit.client.0.smithi097.stderr: -142> 2024-09-14T11:04:33.995+0000 7f6ebb013800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:04:34.146 INFO:tasks.workunit.client.0.smithi097.stderr: -141> 2024-09-14T11:04:33.995+0000 7f6ebb013800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:04:34.146 INFO:tasks.workunit.client.0.smithi097.stderr: -140> 2024-09-14T11:04:33.995+0000 7f6ebb013800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:04:34.146 INFO:tasks.workunit.client.0.smithi097.stderr: -139> 2024-09-14T11:04:33.995+0000 7f6ebb013800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:04:34.146 INFO:tasks.workunit.client.0.smithi097.stderr: -138> 2024-09-14T11:04:33.995+0000 7f6ebb013800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:04:34.146 INFO:tasks.workunit.client.0.smithi097.stderr: -137> 2024-09-14T11:04:33.995+0000 7f6ebb013800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:04:34.146 INFO:tasks.workunit.client.0.smithi097.stderr: -136> 2024-09-14T11:04:33.995+0000 7f6ebb013800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.146 INFO:tasks.workunit.client.0.smithi097.stderr: -135> 2024-09-14T11:04:33.995+0000 7f6ebb013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:34.146 INFO:tasks.workunit.client.0.smithi097.stderr: -134> 2024-09-14T11:04:33.995+0000 7f6ebb013800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.146 INFO:tasks.workunit.client.0.smithi097.stderr: -133> 2024-09-14T11:04:33.995+0000 7f6ebb013800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:04:34.147 INFO:tasks.workunit.client.0.smithi097.stderr: -132> 2024-09-14T11:04:33.995+0000 7f6ebb013800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.147 INFO:tasks.workunit.client.0.smithi097.stderr: -131> 2024-09-14T11:04:33.996+0000 7f6ebb013800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:04:34.147 INFO:tasks.workunit.client.0.smithi097.stderr: -130> 2024-09-14T11:04:33.996+0000 7f6ebb013800 20 zone default found 2024-09-14T11:04:34.147 INFO:tasks.workunit.client.0.smithi097.stderr: -129> 2024-09-14T11:04:33.996+0000 7f6ebb013800 4 Realm: () 2024-09-14T11:04:34.147 INFO:tasks.workunit.client.0.smithi097.stderr: -128> 2024-09-14T11:04:33.996+0000 7f6ebb013800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:04:34.147 INFO:tasks.workunit.client.0.smithi097.stderr: -127> 2024-09-14T11:04:33.996+0000 7f6ebb013800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:04:34.147 INFO:tasks.workunit.client.0.smithi097.stderr: -126> 2024-09-14T11:04:33.996+0000 7f6ebb013800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:04:34.147 INFO:tasks.workunit.client.0.smithi097.stderr: -125> 2024-09-14T11:04:33.996+0000 7f6ebb013800 20 zonegroup default 2024-09-14T11:04:34.147 INFO:tasks.workunit.client.0.smithi097.stderr: -124> 2024-09-14T11:04:33.996+0000 7f6ebb013800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.147 INFO:tasks.workunit.client.0.smithi097.stderr: -123> 2024-09-14T11:04:33.996+0000 7f6ebb013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:34.147 INFO:tasks.workunit.client.0.smithi097.stderr: -122> 2024-09-14T11:04:33.996+0000 7f6ebb013800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.147 INFO:tasks.workunit.client.0.smithi097.stderr: -121> 2024-09-14T11:04:33.996+0000 7f6ebb013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:34.147 INFO:tasks.workunit.client.0.smithi097.stderr: -120> 2024-09-14T11:04:33.996+0000 7f6ebb013800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.147 INFO:tasks.workunit.client.0.smithi097.stderr: -119> 2024-09-14T11:04:33.996+0000 7f6ebb013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:34.147 INFO:tasks.workunit.client.0.smithi097.stderr: -118> 2024-09-14T11:04:33.996+0000 7f6ebb013800 20 started sync module instance, tier type = 2024-09-14T11:04:34.148 INFO:tasks.workunit.client.0.smithi097.stderr: -117> 2024-09-14T11:04:33.996+0000 7f6ebb013800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:04:34.148 INFO:tasks.workunit.client.0.smithi097.stderr: -116> 2024-09-14T11:04:34.005+0000 7f6ebb013800 20 add_watcher() i=0 2024-09-14T11:04:34.148 INFO:tasks.workunit.client.0.smithi097.stderr: -115> 2024-09-14T11:04:34.005+0000 7f6ebb013800 20 add_watcher() i=1 2024-09-14T11:04:34.148 INFO:tasks.workunit.client.0.smithi097.stderr: -114> 2024-09-14T11:04:34.005+0000 7f6ebb013800 20 add_watcher() i=2 2024-09-14T11:04:34.148 INFO:tasks.workunit.client.0.smithi097.stderr: -113> 2024-09-14T11:04:34.005+0000 7f6ebb013800 20 add_watcher() i=3 2024-09-14T11:04:34.148 INFO:tasks.workunit.client.0.smithi097.stderr: -112> 2024-09-14T11:04:34.005+0000 7f6ebb013800 20 add_watcher() i=4 2024-09-14T11:04:34.148 INFO:tasks.workunit.client.0.smithi097.stderr: -111> 2024-09-14T11:04:34.005+0000 7f6ebb013800 20 add_watcher() i=5 2024-09-14T11:04:34.148 INFO:tasks.workunit.client.0.smithi097.stderr: -110> 2024-09-14T11:04:34.005+0000 7f6ebb013800 20 add_watcher() i=6 2024-09-14T11:04:34.148 INFO:tasks.workunit.client.0.smithi097.stderr: -109> 2024-09-14T11:04:34.006+0000 7f6ebb013800 20 add_watcher() i=7 2024-09-14T11:04:34.148 INFO:tasks.workunit.client.0.smithi097.stderr: -108> 2024-09-14T11:04:34.006+0000 7f6ebb013800 2 all 8 watchers are set, enabling cache 2024-09-14T11:04:34.148 INFO:tasks.workunit.client.0.smithi097.stderr: -107> 2024-09-14T11:04:34.008+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8cd30) adding auth protocol: cephx 2024-09-14T11:04:34.148 INFO:tasks.workunit.client.0.smithi097.stderr: -106> 2024-09-14T11:04:34.008+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8cd30) adding auth protocol: cephx 2024-09-14T11:04:34.148 INFO:tasks.workunit.client.0.smithi097.stderr: -105> 2024-09-14T11:04:34.008+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8cd30) adding auth protocol: cephx 2024-09-14T11:04:34.149 INFO:tasks.workunit.client.0.smithi097.stderr: -104> 2024-09-14T11:04:34.008+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8cd30) adding con mode: secure 2024-09-14T11:04:34.149 INFO:tasks.workunit.client.0.smithi097.stderr: -103> 2024-09-14T11:04:34.008+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8cd30) adding con mode: crc 2024-09-14T11:04:34.149 INFO:tasks.workunit.client.0.smithi097.stderr: -102> 2024-09-14T11:04:34.008+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8cd30) adding con mode: secure 2024-09-14T11:04:34.149 INFO:tasks.workunit.client.0.smithi097.stderr: -101> 2024-09-14T11:04:34.008+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8cd30) adding con mode: crc 2024-09-14T11:04:34.149 INFO:tasks.workunit.client.0.smithi097.stderr: -100> 2024-09-14T11:04:34.008+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8cd30) adding con mode: secure 2024-09-14T11:04:34.149 INFO:tasks.workunit.client.0.smithi097.stderr: -99> 2024-09-14T11:04:34.008+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8cd30) adding con mode: crc 2024-09-14T11:04:34.149 INFO:tasks.workunit.client.0.smithi097.stderr: -98> 2024-09-14T11:04:34.008+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8cd30) adding con mode: crc 2024-09-14T11:04:34.149 INFO:tasks.workunit.client.0.smithi097.stderr: -97> 2024-09-14T11:04:34.008+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8cd30) adding con mode: secure 2024-09-14T11:04:34.149 INFO:tasks.workunit.client.0.smithi097.stderr: -96> 2024-09-14T11:04:34.008+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8cd30) adding con mode: crc 2024-09-14T11:04:34.149 INFO:tasks.workunit.client.0.smithi097.stderr: -95> 2024-09-14T11:04:34.008+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8cd30) adding con mode: secure 2024-09-14T11:04:34.149 INFO:tasks.workunit.client.0.smithi097.stderr: -94> 2024-09-14T11:04:34.008+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8cd30) adding con mode: crc 2024-09-14T11:04:34.149 INFO:tasks.workunit.client.0.smithi097.stderr: -93> 2024-09-14T11:04:34.008+0000 7f6ebb013800 5 AuthRegistry(0x7fffd5f8cd30) adding con mode: secure 2024-09-14T11:04:34.149 INFO:tasks.workunit.client.0.smithi097.stderr: -92> 2024-09-14T11:04:34.008+0000 7f6d6cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:04:34.149 INFO:tasks.workunit.client.0.smithi097.stderr: -91> 2024-09-14T11:04:34.008+0000 7f6ebb013800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:04:34.150 INFO:tasks.workunit.client.0.smithi097.stderr: -90> 2024-09-14T11:04:34.008+0000 7f6ebb013800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:04:34.150 INFO:tasks.workunit.client.0.smithi097.stderr: -89> 2024-09-14T11:04:34.008+0000 7f6ebb013800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:04:34.150 INFO:tasks.workunit.client.0.smithi097.stderr: -88> 2024-09-14T11:04:34.008+0000 7f6ebb013800 5 asok(0x559d1b9c0270) register_command cache list hook 0x559d1bcaef30 2024-09-14T11:04:34.150 INFO:tasks.workunit.client.0.smithi097.stderr: -87> 2024-09-14T11:04:34.008+0000 7f6ebb013800 5 asok(0x559d1b9c0270) register_command cache inspect hook 0x559d1bcaef30 2024-09-14T11:04:34.150 INFO:tasks.workunit.client.0.smithi097.stderr: -86> 2024-09-14T11:04:34.008+0000 7f6ebb013800 5 asok(0x559d1b9c0270) register_command cache erase hook 0x559d1bcaef30 2024-09-14T11:04:34.150 INFO:tasks.workunit.client.0.smithi097.stderr: -85> 2024-09-14T11:04:34.008+0000 7f6ebb013800 5 asok(0x559d1b9c0270) register_command cache zap hook 0x559d1bcaef30 2024-09-14T11:04:34.150 INFO:tasks.workunit.client.0.smithi097.stderr: -84> 2024-09-14T11:04:34.009+0000 7f6ebb013800 5 note: GC not initialized 2024-09-14T11:04:34.150 INFO:tasks.workunit.client.0.smithi097.stderr: -83> 2024-09-14T11:04:34.009+0000 7f6ce77fe640 20 reqs_thread_entry: start 2024-09-14T11:04:34.150 INFO:tasks.workunit.client.0.smithi097.stderr: -82> 2024-09-14T11:04:34.009+0000 7f6ebb013800 5 asok(0x559d1b9c0270) register_command sync trace show hook 0x7f6ea8004620 2024-09-14T11:04:34.150 INFO:tasks.workunit.client.0.smithi097.stderr: -81> 2024-09-14T11:04:34.009+0000 7f6ebb013800 5 asok(0x559d1b9c0270) register_command sync trace history hook 0x7f6ea8004620 2024-09-14T11:04:34.150 INFO:tasks.workunit.client.0.smithi097.stderr: -80> 2024-09-14T11:04:34.009+0000 7f6ebb013800 5 asok(0x559d1b9c0270) register_command sync trace active hook 0x7f6ea8004620 2024-09-14T11:04:34.150 INFO:tasks.workunit.client.0.smithi097.stderr: -79> 2024-09-14T11:04:34.009+0000 7f6ebb013800 5 asok(0x559d1b9c0270) register_command sync trace active_short hook 0x7f6ea8004620 2024-09-14T11:04:34.150 INFO:tasks.workunit.client.0.smithi097.stderr: -78> 2024-09-14T11:04:34.009+0000 7f6ebb013800 20 init_complete bucket index max shards: 11 2024-09-14T11:04:34.150 INFO:tasks.workunit.client.0.smithi097.stderr: -77> 2024-09-14T11:04:34.009+0000 7f6ebb013800 20 Filter name: none 2024-09-14T11:04:34.151 INFO:tasks.workunit.client.0.smithi097.stderr: -76> 2024-09-14T11:04:34.009+0000 7f6ce57fa640 20 reqs_thread_entry: start 2024-09-14T11:04:34.151 INFO:tasks.workunit.client.0.smithi097.stderr: -75> 2024-09-14T11:04:34.009+0000 7f6ebb013800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:04:34.151 INFO:tasks.workunit.client.0.smithi097.stderr: -74> 2024-09-14T11:04:34.009+0000 7f6ebb013800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.151 INFO:tasks.workunit.client.0.smithi097.stderr: -73> 2024-09-14T11:04:34.009+0000 7f6ebb013800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:04:34.151 INFO:tasks.workunit.client.0.smithi097.stderr: -72> 2024-09-14T11:04:34.009+0000 7f6ebb013800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:04:34.151 INFO:tasks.workunit.client.0.smithi097.stderr: -71> 2024-09-14T11:04:34.009+0000 7f6ebb013800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:04:34.151 INFO:tasks.workunit.client.0.smithi097.stderr: -70> 2024-09-14T11:04:34.009+0000 7f6ebb013800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 : miss 2024-09-14T11:04:34.151 INFO:tasks.workunit.client.0.smithi097.stderr: -69> 2024-09-14T11:04:34.009+0000 7f6ebb013800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.151 INFO:tasks.workunit.client.0.smithi097.stderr: -68> 2024-09-14T11:04:34.010+0000 7f6ebb013800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:04:34.151 INFO:tasks.workunit.client.0.smithi097.stderr: -67> 2024-09-14T11:04:34.010+0000 7f6ebb013800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 info.flags=0x17 2024-09-14T11:04:34.151 INFO:tasks.workunit.client.0.smithi097.stderr: -66> 2024-09-14T11:04:34.010+0000 7f6ebb013800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 to cache LRU end 2024-09-14T11:04:34.151 INFO:tasks.workunit.client.0.smithi097.stderr: -65> 2024-09-14T11:04:34.010+0000 7f6ebb013800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:04:34.151 INFO:tasks.workunit.client.0.smithi097.stderr: -64> 2024-09-14T11:04:34.010+0000 7f6ebb013800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:04:34.151 INFO:tasks.workunit.client.0.smithi097.stderr: -63> 2024-09-14T11:04:34.010+0000 7f6ebb013800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 2024-09-14T11:04:34.152 INFO:tasks.workunit.client.0.smithi097.stderr: -62> 2024-09-14T11:04:34.015+0000 7f6ebb013800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 info.flags=0x17 2024-09-14T11:04:34.152 INFO:tasks.workunit.client.0.smithi097.stderr: -61> 2024-09-14T11:04:34.015+0000 7f6ebb013800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 to cache LRU end 2024-09-14T11:04:34.152 INFO:tasks.workunit.client.0.smithi097.stderr: -60> 2024-09-14T11:04:34.015+0000 7f6ebb013800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:04:34.152 INFO:tasks.workunit.client.0.smithi097.stderr: -59> 2024-09-14T11:04:34.015+0000 7f6ebb013800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29, ofs0, ns] 2024-09-14T11:04:34.152 INFO:tasks.workunit.client.0.smithi097.stderr: -58> 2024-09-14T11:04:34.015+0000 7f6d997fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595191 cookie 94133264719408 notifier 7119 bl.length()=915 2024-09-14T11:04:34.152 INFO:tasks.workunit.client.0.smithi097.stderr: -57> 2024-09-14T11:04:34.015+0000 7f6d997fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 info.flags=0x17 2024-09-14T11:04:34.152 INFO:tasks.workunit.client.0.smithi097.stderr: -56> 2024-09-14T11:04:34.015+0000 7f6d997fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 to cache LRU end 2024-09-14T11:04:34.152 INFO:tasks.workunit.client.0.smithi097.stderr: -55> 2024-09-14T11:04:34.015+0000 7f6d997fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:04:34.152 INFO:tasks.workunit.client.0.smithi097.stderr: -54> 2024-09-14T11:04:34.016+0000 7f6ebb013800 20 handle_bi_update(): bucket=:abort-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29]): orig_sources= new_sources= 2024-09-14T11:04:34.152 INFO:tasks.workunit.client.0.smithi097.stderr: -53> 2024-09-14T11:04:34.016+0000 7f6ebb013800 20 handle_bi_update(): bucket=:abort-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29]): potential sources added=[] removed=[] 2024-09-14T11:04:34.152 INFO:tasks.workunit.client.0.smithi097.stderr: -52> 2024-09-14T11:04:34.016+0000 7f6ebb013800 20 handle_bi_update(): bucket=:abort-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29]): orig_dests= new_dests= 2024-09-14T11:04:34.152 INFO:tasks.workunit.client.0.smithi097.stderr: -51> 2024-09-14T11:04:34.016+0000 7f6ebb013800 20 handle_bi_update(): bucket=:abort-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29]): potential dests added=[] removed=[] 2024-09-14T11:04:34.152 INFO:tasks.workunit.client.0.smithi097.stderr: -50> 2024-09-14T11:04:34.021+0000 7f6ebb013800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.0 2024-09-14T11:04:34.152 INFO:tasks.workunit.client.0.smithi097.stderr: -49> 2024-09-14T11:04:34.021+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.0 2024-09-14T11:04:34.153 INFO:tasks.workunit.client.0.smithi097.stderr: -48> 2024-09-14T11:04:34.021+0000 7f6ebb013800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.1 2024-09-14T11:04:34.153 INFO:tasks.workunit.client.0.smithi097.stderr: -47> 2024-09-14T11:04:34.021+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.1 2024-09-14T11:04:34.153 INFO:tasks.workunit.client.0.smithi097.stderr: -46> 2024-09-14T11:04:34.021+0000 7f6ebb013800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.2 2024-09-14T11:04:34.153 INFO:tasks.workunit.client.0.smithi097.stderr: -45> 2024-09-14T11:04:34.021+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.2 2024-09-14T11:04:34.153 INFO:tasks.workunit.client.0.smithi097.stderr: -44> 2024-09-14T11:04:34.021+0000 7f6ebb013800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.3 2024-09-14T11:04:34.153 INFO:tasks.workunit.client.0.smithi097.stderr: -43> 2024-09-14T11:04:34.021+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.3 2024-09-14T11:04:34.153 INFO:tasks.workunit.client.0.smithi097.stderr: -42> 2024-09-14T11:04:34.021+0000 7f6ebb013800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.4 2024-09-14T11:04:34.153 INFO:tasks.workunit.client.0.smithi097.stderr: -41> 2024-09-14T11:04:34.021+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.4 2024-09-14T11:04:34.153 INFO:tasks.workunit.client.0.smithi097.stderr: -40> 2024-09-14T11:04:34.021+0000 7f6ebb013800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.5 2024-09-14T11:04:34.153 INFO:tasks.workunit.client.0.smithi097.stderr: -39> 2024-09-14T11:04:34.021+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.5 2024-09-14T11:04:34.153 INFO:tasks.workunit.client.0.smithi097.stderr: -38> 2024-09-14T11:04:34.021+0000 7f6ebb013800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.6 2024-09-14T11:04:34.153 INFO:tasks.workunit.client.0.smithi097.stderr: -37> 2024-09-14T11:04:34.021+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.6 2024-09-14T11:04:34.153 INFO:tasks.workunit.client.0.smithi097.stderr: -36> 2024-09-14T11:04:34.021+0000 7f6ebb013800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.7 2024-09-14T11:04:34.154 INFO:tasks.workunit.client.0.smithi097.stderr: -35> 2024-09-14T11:04:34.021+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.7 2024-09-14T11:04:34.154 INFO:tasks.workunit.client.0.smithi097.stderr: -34> 2024-09-14T11:04:34.021+0000 7f6ebb013800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.8 2024-09-14T11:04:34.154 INFO:tasks.workunit.client.0.smithi097.stderr: -33> 2024-09-14T11:04:34.021+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.8 2024-09-14T11:04:34.154 INFO:tasks.workunit.client.0.smithi097.stderr: -32> 2024-09-14T11:04:34.021+0000 7f6ebb013800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.9 2024-09-14T11:04:34.154 INFO:tasks.workunit.client.0.smithi097.stderr: -31> 2024-09-14T11:04:34.021+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.9 2024-09-14T11:04:34.154 INFO:tasks.workunit.client.0.smithi097.stderr: -30> 2024-09-14T11:04:34.021+0000 7f6ebb013800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.10 2024-09-14T11:04:34.154 INFO:tasks.workunit.client.0.smithi097.stderr: -29> 2024-09-14T11:04:34.021+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.10 2024-09-14T11:04:34.154 INFO:tasks.workunit.client.0.smithi097.stderr: -28> 2024-09-14T11:04:34.021+0000 7f6ebb013800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.11 2024-09-14T11:04:34.154 INFO:tasks.workunit.client.0.smithi097.stderr: -27> 2024-09-14T11:04:34.021+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1.11 2024-09-14T11:04:34.154 INFO:tasks.workunit.client.0.smithi097.stderr: -26> 2024-09-14T11:04:34.021+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.0 2024-09-14T11:04:34.154 INFO:tasks.workunit.client.0.smithi097.stderr: -25> 2024-09-14T11:04:34.022+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1 2024-09-14T11:04:34.154 INFO:tasks.workunit.client.0.smithi097.stderr: -24> 2024-09-14T11:04:34.022+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.2 2024-09-14T11:04:34.154 INFO:tasks.workunit.client.0.smithi097.stderr: -23> 2024-09-14T11:04:34.023+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.3 2024-09-14T11:04:34.154 INFO:tasks.workunit.client.0.smithi097.stderr: -22> 2024-09-14T11:04:34.023+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.4 2024-09-14T11:04:34.155 INFO:tasks.workunit.client.0.smithi097.stderr: -21> 2024-09-14T11:04:34.023+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.5 2024-09-14T11:04:34.155 INFO:tasks.workunit.client.0.smithi097.stderr: -20> 2024-09-14T11:04:34.024+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.6 2024-09-14T11:04:34.155 INFO:tasks.workunit.client.0.smithi097.stderr: -19> 2024-09-14T11:04:34.024+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.7 2024-09-14T11:04:34.155 INFO:tasks.workunit.client.0.smithi097.stderr: -18> 2024-09-14T11:04:34.025+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.8 2024-09-14T11:04:34.155 INFO:tasks.workunit.client.0.smithi097.stderr: -17> 2024-09-14T11:04:34.025+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.9 2024-09-14T11:04:34.155 INFO:tasks.workunit.client.0.smithi097.stderr: -16> 2024-09-14T11:04:34.026+0000 7f6ebb013800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.10 2024-09-14T11:04:34.155 INFO:tasks.workunit.client.0.smithi097.stderr: -15> 2024-09-14T11:04:34.029+0000 7f6ebb013800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:04:34.155 INFO:tasks.workunit.client.0.smithi097.stderr: -14> 2024-09-14T11:04:34.029+0000 7f6ebb013800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 2024-09-14T11:04:34.155 INFO:tasks.workunit.client.0.smithi097.stderr: -13> 2024-09-14T11:04:34.030+0000 7f6ebb013800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 info.flags=0x17 2024-09-14T11:04:34.155 INFO:tasks.workunit.client.0.smithi097.stderr: -12> 2024-09-14T11:04:34.030+0000 7f6ebb013800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 to cache LRU end 2024-09-14T11:04:34.155 INFO:tasks.workunit.client.0.smithi097.stderr: -11> 2024-09-14T11:04:34.030+0000 7f6ebb013800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:04:34.155 INFO:tasks.workunit.client.0.smithi097.stderr: -10> 2024-09-14T11:04:34.030+0000 7f6ebb013800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29, ofs0, ns] 2024-09-14T11:04:34.155 INFO:tasks.workunit.client.0.smithi097.stderr: -9> 2024-09-14T11:04:34.030+0000 7f6d997fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595192 cookie 94133264719408 notifier 7119 bl.length()=915 2024-09-14T11:04:34.156 INFO:tasks.workunit.client.0.smithi097.stderr: -8> 2024-09-14T11:04:34.030+0000 7f6d997fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 info.flags=0x17 2024-09-14T11:04:34.156 INFO:tasks.workunit.client.0.smithi097.stderr: -7> 2024-09-14T11:04:34.030+0000 7f6d997fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 to cache LRU end 2024-09-14T11:04:34.156 INFO:tasks.workunit.client.0.smithi097.stderr: -6> 2024-09-14T11:04:34.030+0000 7f6d997fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:04:34.156 INFO:tasks.workunit.client.0.smithi097.stderr: -5> 2024-09-14T11:04:34.031+0000 7f6ebb013800 20 handle_bi_update(): bucket=:abort-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29]): orig_sources= new_sources= 2024-09-14T11:04:34.156 INFO:tasks.workunit.client.0.smithi097.stderr: -4> 2024-09-14T11:04:34.031+0000 7f6ebb013800 20 handle_bi_update(): bucket=:abort-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29]): potential sources added=[] removed=[] 2024-09-14T11:04:34.156 INFO:tasks.workunit.client.0.smithi097.stderr: -3> 2024-09-14T11:04:34.031+0000 7f6ebb013800 20 handle_bi_update(): bucket=:abort-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29]): orig_dests= new_dests= 2024-09-14T11:04:34.156 INFO:tasks.workunit.client.0.smithi097.stderr: -2> 2024-09-14T11:04:34.031+0000 7f6ebb013800 20 handle_bi_update(): bucket=:abort-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29]): potential dests added=[] removed=[] 2024-09-14T11:04:34.156 INFO:tasks.workunit.client.0.smithi097.stderr: -1> 2024-09-14T11:04:34.031+0000 7f6ebb013800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6ebb013800 time 2024-09-14T11:04:34.031965+0000 2024-09-14T11:04:34.156 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:04:34.156 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:04:34.156 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:04:34.156 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f6ebc18c76a] 2024-09-14T11:04:34.156 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f6ebc18c928] 2024-09-14T11:04:34.156 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559d19c900b1] 2024-09-14T11:04:34.157 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x559d19c9f18e] 2024-09-14T11:04:34.157 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x559d19c9ffc4] 2024-09-14T11:04:34.157 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-14T11:04:34.157 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f6ebae29590] 2024-09-14T11:04:34.157 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-14T11:04:34.157 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-14T11:04:34.157 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:04:34.157 INFO:tasks.workunit.client.0.smithi097.stderr: 0> 2024-09-14T11:04:34.032+0000 7f6ebb013800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:04:34.157 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f6ebb013800 thread_name:radosgw-admin 2024-09-14T11:04:34.157 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:04:34.157 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:04:34.157 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f6ebae3e6f0] 2024-09-14T11:04:34.157 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f6ebae8b99c] 2024-09-14T11:04:34.158 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-14T11:04:34.158 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-14T11:04:34.158 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f6ebc18c7c4] 2024-09-14T11:04:34.158 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f6ebc18c928] 2024-09-14T11:04:34.158 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559d19c900b1] 2024-09-14T11:04:34.158 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x559d19c9f18e] 2024-09-14T11:04:34.158 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x559d19c9ffc4] 2024-09-14T11:04:34.158 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-14T11:04:34.158 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f6ebae29590] 2024-09-14T11:04:34.158 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-14T11:04:34.158 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-14T11:04:34.158 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:04:34.158 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:04:34.158 INFO:tasks.workunit.client.0.smithi097.stderr:--- logging levels --- 2024-09-14T11:04:34.159 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 none 2024-09-14T11:04:34.159 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 lockdep 2024-09-14T11:04:34.159 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 context 2024-09-14T11:04:34.159 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 crush 2024-09-14T11:04:34.159 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds 2024-09-14T11:04:34.159 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_balancer 2024-09-14T11:04:34.159 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_locker 2024-09-14T11:04:34.159 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log 2024-09-14T11:04:34.159 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log_expire 2024-09-14T11:04:34.159 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_migrator 2024-09-14T11:04:34.159 INFO:tasks.workunit.client.0.smithi097.stderr: 3/ 5 mds_quiesce 2024-09-14T11:04:34.159 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 buffer 2024-09-14T11:04:34.159 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 timer 2024-09-14T11:04:34.159 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 filer 2024-09-14T11:04:34.160 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 striper 2024-09-14T11:04:34.160 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 objecter 2024-09-14T11:04:34.160 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rados 2024-09-14T11:04:34.160 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd 2024-09-14T11:04:34.160 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_mirror 2024-09-14T11:04:34.160 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_replay 2024-09-14T11:04:34.160 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_pwl 2024-09-14T11:04:34.160 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 journaler 2024-09-14T11:04:34.160 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objectcacher 2024-09-14T11:04:34.160 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:04:34.160 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 client 2024-09-14T11:04:34.160 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 osd 2024-09-14T11:04:34.160 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 optracker 2024-09-14T11:04:34.160 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objclass 2024-09-14T11:04:34.161 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 filestore 2024-09-14T11:04:34.161 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 journal 2024-09-14T11:04:34.161 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 ms 2024-09-14T11:04:34.161 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mon 2024-09-14T11:04:34.161 INFO:tasks.workunit.client.0.smithi097.stderr: 0/10 monc 2024-09-14T11:04:34.161 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 paxos 2024-09-14T11:04:34.161 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 tp 2024-09-14T11:04:34.161 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 auth 2024-09-14T11:04:34.161 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 crypto 2024-09-14T11:04:34.161 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 finisher 2024-09-14T11:04:34.161 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 reserver 2024-09-14T11:04:34.161 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 heartbeatmap 2024-09-14T11:04:34.161 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 perfcounter 2024-09-14T11:04:34.161 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw 2024-09-14T11:04:34.161 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_sync 2024-09-14T11:04:34.162 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_datacache 2024-09-14T11:04:34.162 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_access 2024-09-14T11:04:34.162 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:04:34.162 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_flight 2024-09-14T11:04:34.162 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:04:34.162 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw_notification 2024-09-14T11:04:34.162 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 javaclient 2024-09-14T11:04:34.162 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 asok 2024-09-14T11:04:34.162 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 throttle 2024-09-14T11:04:34.162 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 refs 2024-09-14T11:04:34.162 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 compressor 2024-09-14T11:04:34.162 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluestore 2024-09-14T11:04:34.162 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluefs 2024-09-14T11:04:34.162 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 bdev 2024-09-14T11:04:34.163 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 kstore 2024-09-14T11:04:34.163 INFO:tasks.workunit.client.0.smithi097.stderr: 4/ 5 rocksdb 2024-09-14T11:04:34.163 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 fuse 2024-09-14T11:04:34.163 INFO:tasks.workunit.client.0.smithi097.stderr: 2/ 5 mgr 2024-09-14T11:04:34.163 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mgrc 2024-09-14T11:04:34.163 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 dpdk 2024-09-14T11:04:34.163 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 eventtrace 2024-09-14T11:04:34.163 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 prioritycache 2024-09-14T11:04:34.163 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 test 2024-09-14T11:04:34.163 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:04:34.163 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephsqlite 2024-09-14T11:04:34.163 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:04:34.163 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore 2024-09-14T11:04:34.163 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_onode 2024-09-14T11:04:34.163 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_odata 2024-09-14T11:04:34.164 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_omap 2024-09-14T11:04:34.164 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_tm 2024-09-14T11:04:34.164 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_t 2024-09-14T11:04:34.164 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:04:34.164 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_epm 2024-09-14T11:04:34.164 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_lba 2024-09-14T11:04:34.164 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:04:34.164 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cache 2024-09-14T11:04:34.164 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_journal 2024-09-14T11:04:34.164 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_device 2024-09-14T11:04:34.164 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_backref 2024-09-14T11:04:34.164 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 alienstore 2024-09-14T11:04:34.164 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mclock 2024-09-14T11:04:34.164 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cyanstore 2024-09-14T11:04:34.165 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 ceph_exporter 2024-09-14T11:04:34.165 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 memstore 2024-09-14T11:04:34.165 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 trace 2024-09-14T11:04:34.165 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 ceph_dedup 2024-09-14T11:04:34.165 INFO:tasks.workunit.client.0.smithi097.stderr: -2/-2 (syslog threshold) 2024-09-14T11:04:34.165 INFO:tasks.workunit.client.0.smithi097.stderr: 99/99 (stderr threshold) 2024-09-14T11:04:34.165 INFO:tasks.workunit.client.0.smithi097.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:04:34.165 INFO:tasks.workunit.client.0.smithi097.stderr: 7f6ce57fa640 / http_manager 2024-09-14T11:04:34.165 INFO:tasks.workunit.client.0.smithi097.stderr: 7f6ce77fe640 / http_manager 2024-09-14T11:04:34.165 INFO:tasks.workunit.client.0.smithi097.stderr: 7f6d6cfe1640 / rgw_dt_lg_renew 2024-09-14T11:04:34.165 INFO:tasks.workunit.client.0.smithi097.stderr: 7f6d87fff640 / ms_dispatch 2024-09-14T11:04:34.165 INFO:tasks.workunit.client.0.smithi097.stderr: 7f6d997fa640 / io_context_pool 2024-09-14T11:04:34.165 INFO:tasks.workunit.client.0.smithi097.stderr: 7f6d99ffb640 / io_context_pool 2024-09-14T11:04:34.165 INFO:tasks.workunit.client.0.smithi097.stderr: 7f6d9bfff640 / ms_dispatch 2024-09-14T11:04:34.166 INFO:tasks.workunit.client.0.smithi097.stderr: 7f6da2e05640 / ms_dispatch 2024-09-14T11:04:34.166 INFO:tasks.workunit.client.0.smithi097.stderr: 7f6da4608640 / io_context_pool 2024-09-14T11:04:34.166 INFO:tasks.workunit.client.0.smithi097.stderr: 7f6eaffff640 / msgr-worker-2 2024-09-14T11:04:34.166 INFO:tasks.workunit.client.0.smithi097.stderr: 7f6eb6792640 / msgr-worker-1 2024-09-14T11:04:34.166 INFO:tasks.workunit.client.0.smithi097.stderr: 7f6eb6f93640 / msgr-worker-0 2024-09-14T11:04:34.166 INFO:tasks.workunit.client.0.smithi097.stderr: 7f6eb7794640 / io_context_pool 2024-09-14T11:04:34.166 INFO:tasks.workunit.client.0.smithi097.stderr: 7f6ebb013800 / radosgw-admin 2024-09-14T11:04:34.166 INFO:tasks.workunit.client.0.smithi097.stderr: max_recent 500 2024-09-14T11:04:34.166 INFO:tasks.workunit.client.0.smithi097.stderr: max_new 1000 2024-09-14T11:04:34.166 INFO:tasks.workunit.client.0.smithi097.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:04:34.033615Z_455b4dcf-5776-4fdf-a4ed-caf6c21a2c13/log 2024-09-14T11:04:34.166 INFO:tasks.workunit.client.0.smithi097.stderr:--- end dump of recent events --- 2024-09-14T11:04:34.166 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-14T11:04:34.172 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:04:34.172 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:04:34.172 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.109+0000 7efee7e40800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.172 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.111+0000 7efee7e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:34.172 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.111+0000 7efee7e40800 20 realm 2024-09-14T11:04:34.172 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.111+0000 7efee7e40800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.172 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.111+0000 7efee7e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:34.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.111+0000 7efee7e40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:04:34.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.111+0000 7efee7e40800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.111+0000 7efee7e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:34.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.111+0000 7efee7e40800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.112+0000 7efee7e40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:04:34.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.112+0000 7efee7e40800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.113+0000 7efee7e40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:04:34.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.113+0000 7efee7e40800 20 searching for the correct realm 2024-09-14T11:04:34.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.114+0000 7efee5129640 0 -- 172.21.15.97:0/2274514885 >> [v2:172.21.15.97:6816/4093696477,v1:172.21.15.97:6817/4093696477] conn(0x560f049ca8e0 msgr2=0x560f049cccd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:04:34.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.118+0000 7efee592a640 0 -- 172.21.15.97:0/2274514885 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7efed005e390 msgr2=0x7efed0094a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:04:34.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.123+0000 7efee7e40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:04:34.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.123+0000 7efee7e40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:04:34.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.123+0000 7efee7e40800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:04:34.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.123+0000 7efee7e40800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:04:34.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.123+0000 7efee7e40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:04:34.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.123+0000 7efee7e40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:04:34.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.123+0000 7efee7e40800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.123+0000 7efee7e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:34.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.123+0000 7efee7e40800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.123+0000 7efee7e40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:04:34.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.123+0000 7efee7e40800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.124+0000 7efee7e40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:04:34.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.124+0000 7efee7e40800 20 zone default found 2024-09-14T11:04:34.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.124+0000 7efee7e40800 4 Realm: () 2024-09-14T11:04:34.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.124+0000 7efee7e40800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:04:34.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.124+0000 7efee7e40800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:04:34.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.124+0000 7efee7e40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:04:34.175 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.124+0000 7efee7e40800 20 zonegroup default 2024-09-14T11:04:34.175 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.124+0000 7efee7e40800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.175 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.124+0000 7efee7e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:34.175 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.124+0000 7efee7e40800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.175 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.124+0000 7efee7e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:34.175 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.124+0000 7efee7e40800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.175 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.124+0000 7efee7e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:34.175 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.124+0000 7efee7e40800 20 started sync module instance, tier type = 2024-09-14T11:04:34.175 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.124+0000 7efee7e40800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:04:34.175 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.132+0000 7efee7e40800 20 add_watcher() i=0 2024-09-14T11:04:34.175 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.132+0000 7efee7e40800 20 add_watcher() i=1 2024-09-14T11:04:34.175 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.132+0000 7efee7e40800 20 add_watcher() i=2 2024-09-14T11:04:34.175 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.132+0000 7efee7e40800 20 add_watcher() i=3 2024-09-14T11:04:34.175 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.132+0000 7efee7e40800 20 add_watcher() i=4 2024-09-14T11:04:34.176 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.132+0000 7efee7e40800 20 add_watcher() i=5 2024-09-14T11:04:34.176 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.133+0000 7efee7e40800 20 add_watcher() i=6 2024-09-14T11:04:34.176 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.133+0000 7efee7e40800 20 add_watcher() i=7 2024-09-14T11:04:34.176 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.133+0000 7efee7e40800 2 all 8 watchers are set, enabling cache 2024-09-14T11:04:34.176 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.135+0000 7efd97fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:04:34.176 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.135+0000 7efee7e40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:04:34.176 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.135+0000 7efee7e40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:04:34.176 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.136+0000 7efee7e40800 5 note: GC not initialized 2024-09-14T11:04:34.176 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.136+0000 7efd96ffd640 20 reqs_thread_entry: start 2024-09-14T11:04:34.176 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.136+0000 7efee7e40800 20 init_complete bucket index max shards: 11 2024-09-14T11:04:34.176 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.136+0000 7efee7e40800 20 Filter name: none 2024-09-14T11:04:34.176 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.136+0000 7efd94ff9640 20 reqs_thread_entry: start 2024-09-14T11:04:34.176 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.136+0000 7efee7e40800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.177 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.136+0000 7efee7e40800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:04:34.177 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.137+0000 7efee7e40800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.177 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.137+0000 7efee7e40800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:04:34.177 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.137+0000 7efee7e40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:04:34.177 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.137+0000 7efee7e40800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.177 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.137+0000 7efee7e40800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:04:34.177 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.137+0000 7efee7e40800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.177 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.138+0000 7efee7e40800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:04:34.177 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.138+0000 7efee7e40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:04:34.177 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.139+0000 7efd97fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:04:34.177 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.142+0000 7efee7e40800 20 remove_watcher() i=0 2024-09-14T11:04:34.177 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.142+0000 7efee7e40800 2 removed watcher, disabling cache 2024-09-14T11:04:34.177 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.143+0000 7efee7e40800 20 remove_watcher() i=1 2024-09-14T11:04:34.177 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.144+0000 7efee7e40800 20 remove_watcher() i=2 2024-09-14T11:04:34.178 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.145+0000 7efee7e40800 20 remove_watcher() i=3 2024-09-14T11:04:34.178 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.146+0000 7efee7e40800 20 remove_watcher() i=4 2024-09-14T11:04:34.178 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.147+0000 7efee7e40800 20 remove_watcher() i=5 2024-09-14T11:04:34.178 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.148+0000 7efee7e40800 20 remove_watcher() i=6 2024-09-14T11:04:34.178 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.149+0000 7efee7e40800 20 remove_watcher() i=7 2024-09-14T11:04:34.178 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:04:34.178 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:04:34.178 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: abort-at-block-writes id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:04:34.178 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:04:34.210 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:04:34.241 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:04:34.241 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:04:34.278 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.279+0000 7f1d2b537800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.281+0000 7f1d2b537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:34.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.281+0000 7f1d2b537800 20 realm 2024-09-14T11:04:34.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.281+0000 7f1d2b537800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.281+0000 7f1d2b537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:34.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.281+0000 7f1d2b537800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:04:34.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.281+0000 7f1d2b537800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.281+0000 7f1d2b537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:34.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.281+0000 7f1d2b537800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.281 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.282+0000 7f1d2b537800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:04:34.281 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.282+0000 7f1d2b537800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.281 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.283+0000 7f1d2b537800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:04:34.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.283+0000 7f1d2b537800 20 searching for the correct realm 2024-09-14T11:04:34.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.285+0000 7f1d27a7e640 0 -- 172.21.15.97:0/235131431 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f1d100910d0 msgr2=0x7f1d100890c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:04:34.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.491+0000 7f1d1ffff640 0 -- 172.21.15.97:0/235131431 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f1d18072bb0 msgr2=0x7f1d1806f260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:04:34.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.496+0000 7f1d2b537800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:04:34.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.496+0000 7f1d2b537800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:04:34.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.496+0000 7f1d2b537800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:04:34.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.496+0000 7f1d2b537800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:04:34.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.496+0000 7f1d2b537800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:04:34.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.496+0000 7f1d2b537800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:04:34.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.496+0000 7f1d2b537800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.496+0000 7f1d2b537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:34.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.496+0000 7f1d2b537800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.497+0000 7f1d2b537800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:04:34.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.497+0000 7f1d2b537800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.497+0000 7f1d2b537800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:04:34.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.497+0000 7f1d2b537800 20 zone default found 2024-09-14T11:04:34.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.497+0000 7f1d2b537800 4 Realm: () 2024-09-14T11:04:34.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.497+0000 7f1d2b537800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:04:34.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.497+0000 7f1d2b537800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:04:34.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.497+0000 7f1d2b537800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:04:34.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.497+0000 7f1d2b537800 20 zonegroup default 2024-09-14T11:04:34.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.497+0000 7f1d2b537800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.497+0000 7f1d2b537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:34.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.497+0000 7f1d2b537800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.498+0000 7f1d2b537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:34.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.498+0000 7f1d2b537800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.498+0000 7f1d2b537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:04:34.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.498+0000 7f1d2b537800 20 started sync module instance, tier type = 2024-09-14T11:04:34.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.498+0000 7f1d2b537800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:04:34.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.507+0000 7f1d2b537800 20 add_watcher() i=0 2024-09-14T11:04:34.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.507+0000 7f1d2b537800 20 add_watcher() i=1 2024-09-14T11:04:34.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.507+0000 7f1d2b537800 20 add_watcher() i=2 2024-09-14T11:04:34.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.507+0000 7f1d2b537800 20 add_watcher() i=3 2024-09-14T11:04:34.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.507+0000 7f1d2b537800 20 add_watcher() i=4 2024-09-14T11:04:34.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.507+0000 7f1d2b537800 20 add_watcher() i=5 2024-09-14T11:04:34.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.507+0000 7f1d2b537800 20 add_watcher() i=6 2024-09-14T11:04:34.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.508+0000 7f1d2b537800 20 add_watcher() i=7 2024-09-14T11:04:34.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.508+0000 7f1d2b537800 2 all 8 watchers are set, enabling cache 2024-09-14T11:04:34.509 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.510+0000 7f1bddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:04:34.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.511+0000 7f1d2b537800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:04:34.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.511+0000 7f1d2b537800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:04:34.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.511+0000 7f1d2b537800 5 note: GC not initialized 2024-09-14T11:04:34.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.511+0000 7f1bdcfe1640 20 reqs_thread_entry: start 2024-09-14T11:04:34.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.511+0000 7f1d2b537800 20 init_complete bucket index max shards: 11 2024-09-14T11:04:34.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.511+0000 7f1d2b537800 20 Filter name: none 2024-09-14T11:04:34.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.511+0000 7f1b567fc640 20 reqs_thread_entry: start 2024-09-14T11:04:34.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.511+0000 7f1d2b537800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:04:34.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.511+0000 7f1d2b537800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.512+0000 7f1d2b537800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:04:34.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.512+0000 7f1d2b537800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:04:34.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.512+0000 7f1d2b537800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:04:34.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.512+0000 7f1d2b537800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 : miss 2024-09-14T11:04:34.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.512+0000 7f1d2b537800 20 rados->read ofs=0 len=0 2024-09-14T11:04:34.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.512+0000 7f1d2b537800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:04:34.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.512+0000 7f1d2b537800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 info.flags=0x17 2024-09-14T11:04:34.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.512+0000 7f1d2b537800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 to cache LRU end 2024-09-14T11:04:34.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.512+0000 7f1d2b537800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:04:34.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.512+0000 7f1d2b537800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:04:34.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.512+0000 7f1d2b537800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 2024-09-14T11:04:34.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.513+0000 7f1d2b537800 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 to be held by another RGW process; skipping for now 2024-09-14T11:04:34.513 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.514+0000 7f1bddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:04:34.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.516+0000 7f1d2b537800 20 remove_watcher() i=0 2024-09-14T11:04:34.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.516+0000 7f1d2b537800 2 removed watcher, disabling cache 2024-09-14T11:04:34.515 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.517+0000 7f1d2b537800 20 remove_watcher() i=1 2024-09-14T11:04:34.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.518+0000 7f1d2b537800 20 remove_watcher() i=2 2024-09-14T11:04:34.517 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.519+0000 7f1d2b537800 20 remove_watcher() i=3 2024-09-14T11:04:34.518 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.520+0000 7f1d2b537800 20 remove_watcher() i=4 2024-09-14T11:04:34.519 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.521+0000 7f1d2b537800 20 remove_watcher() i=5 2024-09-14T11:04:34.520 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.522+0000 7f1d2b537800 20 remove_watcher() i=6 2024-09-14T11:04:34.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:04:34.523+0000 7f1d2b537800 20 remove_watcher() i=7 2024-09-14T11:04:34.531 INFO:tasks.workunit.client.0.smithi097.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:05:04.557 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:05:04.592 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:05:04.626 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:05:04.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.636+0000 7f21ba332800 20 rados->read ofs=0 len=0 2024-09-14T11:05:04.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.638+0000 7f21ba332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:04.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.638+0000 7f21ba332800 20 realm 2024-09-14T11:05:04.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.638+0000 7f21ba332800 20 rados->read ofs=0 len=0 2024-09-14T11:05:04.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.638+0000 7f21ba332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:04.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.638+0000 7f21ba332800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:05:04.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.638+0000 7f21ba332800 20 rados->read ofs=0 len=0 2024-09-14T11:05:04.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.638+0000 7f21ba332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:04.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.638+0000 7f21ba332800 20 rados->read ofs=0 len=0 2024-09-14T11:05:04.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.639+0000 7f21ba332800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:04.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.639+0000 7f21ba332800 20 rados->read ofs=0 len=0 2024-09-14T11:05:04.639 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.640+0000 7f21ba332800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:05:04.639 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.640+0000 7f21ba332800 20 searching for the correct realm 2024-09-14T11:05:04.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.642+0000 7f21b67bd640 0 -- 172.21.15.97:0/3239197424 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f21a00d6060 msgr2=0x7f21a0001900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:05:04.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.847+0000 7f21ad7bb640 0 -- 172.21.15.97:0/3239197424 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f21a8050910 msgr2=0x7f21a8008420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:05:04.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.854+0000 7f21ba332800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:05:04.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.854+0000 7f21ba332800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:05:04.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.854+0000 7f21ba332800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:05:04.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.854+0000 7f21ba332800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:05:04.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.854+0000 7f21ba332800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:05:04.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.854+0000 7f21ba332800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:05:04.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.854+0000 7f21ba332800 20 rados->read ofs=0 len=0 2024-09-14T11:05:04.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.854+0000 7f21ba332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:04.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.854+0000 7f21ba332800 20 rados->read ofs=0 len=0 2024-09-14T11:05:04.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.854+0000 7f21ba332800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:04.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.854+0000 7f21ba332800 20 rados->read ofs=0 len=0 2024-09-14T11:05:04.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.855+0000 7f21ba332800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:05:04.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.855+0000 7f21ba332800 20 zone default found 2024-09-14T11:05:04.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.855+0000 7f21ba332800 4 Realm: () 2024-09-14T11:05:04.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.855+0000 7f21ba332800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:05:04.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.855+0000 7f21ba332800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:05:04.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.855+0000 7f21ba332800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:05:04.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.855+0000 7f21ba332800 20 zonegroup default 2024-09-14T11:05:04.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.855+0000 7f21ba332800 20 rados->read ofs=0 len=0 2024-09-14T11:05:04.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.855+0000 7f21ba332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:04.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.855+0000 7f21ba332800 20 rados->read ofs=0 len=0 2024-09-14T11:05:04.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.855+0000 7f21ba332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:04.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.855+0000 7f21ba332800 20 rados->read ofs=0 len=0 2024-09-14T11:05:04.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.856+0000 7f21ba332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:04.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.856+0000 7f21ba332800 20 started sync module instance, tier type = 2024-09-14T11:05:04.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.856+0000 7f21ba332800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:05:04.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.866+0000 7f21ba332800 20 add_watcher() i=0 2024-09-14T11:05:04.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.866+0000 7f21ba332800 20 add_watcher() i=1 2024-09-14T11:05:04.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.866+0000 7f21ba332800 20 add_watcher() i=2 2024-09-14T11:05:04.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.866+0000 7f21ba332800 20 add_watcher() i=3 2024-09-14T11:05:04.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.866+0000 7f21ba332800 20 add_watcher() i=4 2024-09-14T11:05:04.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.866+0000 7f21ba332800 20 add_watcher() i=5 2024-09-14T11:05:04.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.866+0000 7f21ba332800 20 add_watcher() i=6 2024-09-14T11:05:04.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.867+0000 7f21ba332800 20 add_watcher() i=7 2024-09-14T11:05:04.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.867+0000 7f21ba332800 2 all 8 watchers are set, enabling cache 2024-09-14T11:05:04.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.869+0000 7f20677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:04.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.870+0000 7f21ba332800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:05:04.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.870+0000 7f21ba332800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:05:04.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.870+0000 7f21ba332800 5 note: GC not initialized 2024-09-14T11:05:04.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.870+0000 7f20667fc640 20 reqs_thread_entry: start 2024-09-14T11:05:04.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.870+0000 7f21ba332800 20 init_complete bucket index max shards: 11 2024-09-14T11:05:04.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.870+0000 7f21ba332800 20 Filter name: none 2024-09-14T11:05:04.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.870+0000 7f1fd7fff640 20 reqs_thread_entry: start 2024-09-14T11:05:04.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.871+0000 7f21ba332800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:05:04.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.871+0000 7f21ba332800 20 rados->read ofs=0 len=0 2024-09-14T11:05:04.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.871+0000 7f21ba332800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:05:04.871 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.871+0000 7f21ba332800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:05:04.871 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.871+0000 7f21ba332800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:05:04.871 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.871+0000 7f21ba332800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 : miss 2024-09-14T11:05:04.871 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.871+0000 7f21ba332800 20 rados->read ofs=0 len=0 2024-09-14T11:05:04.871 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.871+0000 7f21ba332800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:05:04.871 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.871+0000 7f21ba332800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 info.flags=0x17 2024-09-14T11:05:04.871 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.871+0000 7f21ba332800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 to cache LRU end 2024-09-14T11:05:04.871 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.871+0000 7f21ba332800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:05:04.871 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.871+0000 7f21ba332800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:04.871 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.871+0000 7f21ba332800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 2024-09-14T11:05:04.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.873+0000 7f21ba332800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:05:04.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.882+0000 7f21ba332800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 info.flags=0x17 2024-09-14T11:05:04.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.882+0000 7f21ba332800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 to cache LRU end 2024-09-14T11:05:04.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.882+0000 7f21ba332800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:04.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.882+0000 7f21ba332800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29, ofs0, ns] 2024-09-14T11:05:04.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.882+0000 7f20997fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595193 cookie 94739819393504 notifier 6764 bl.length()=915 2024-09-14T11:05:04.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.882+0000 7f20997fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 info.flags=0x17 2024-09-14T11:05:04.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.882+0000 7f20997fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 to cache LRU end 2024-09-14T11:05:04.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.882+0000 7f20997fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:04.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.882+0000 7f21ba332800 20 handle_bi_update(): bucket=:abort-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29]): orig_sources= new_sources= 2024-09-14T11:05:04.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.882+0000 7f21ba332800 20 handle_bi_update(): bucket=:abort-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29]): potential sources added=[] removed=[] 2024-09-14T11:05:04.882 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.882+0000 7f21ba332800 20 handle_bi_update(): bucket=:abort-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29]): orig_dests= new_dests= 2024-09-14T11:05:04.882 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.882+0000 7f21ba332800 20 handle_bi_update(): bucket=:abort-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29]): potential dests added=[] removed=[] 2024-09-14T11:05:04.888 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.889+0000 7f21ba332800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.2.0 2024-09-14T11:05:04.888 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.889+0000 7f21ba332800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.2.0 2024-09-14T11:05:04.888 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.889+0000 7f21ba332800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.2.1 2024-09-14T11:05:04.888 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.889+0000 7f21ba332800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.2.1 2024-09-14T11:05:04.888 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.889+0000 7f21ba332800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.2.2 2024-09-14T11:05:04.888 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.889+0000 7f21ba332800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.2.2 2024-09-14T11:05:04.888 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.889+0000 7f21ba332800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.2.3 2024-09-14T11:05:04.888 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.889+0000 7f21ba332800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.2.3 2024-09-14T11:05:04.888 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.889+0000 7f21ba332800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.2.4 2024-09-14T11:05:04.888 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.889+0000 7f21ba332800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.2.4 2024-09-14T11:05:04.888 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.889+0000 7f21ba332800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.2.5 2024-09-14T11:05:04.888 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.889+0000 7f21ba332800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.2.5 2024-09-14T11:05:04.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.889+0000 7f21ba332800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.2.6 2024-09-14T11:05:04.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.889+0000 7f21ba332800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.2.6 2024-09-14T11:05:04.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.889+0000 7f21ba332800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.2.7 2024-09-14T11:05:04.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.889+0000 7f21ba332800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.2.7 2024-09-14T11:05:04.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.889+0000 7f21ba332800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.2.8 2024-09-14T11:05:04.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.889+0000 7f21ba332800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.2.8 2024-09-14T11:05:04.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.889+0000 7f21ba332800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.2.9 2024-09-14T11:05:04.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.889+0000 7f21ba332800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.2.9 2024-09-14T11:05:04.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.889+0000 7f21ba332800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.2.10 2024-09-14T11:05:04.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.889+0000 7f21ba332800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.2.10 2024-09-14T11:05:04.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.889+0000 7f21ba332800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.2.11 2024-09-14T11:05:04.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.889+0000 7f21ba332800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.2.11 2024-09-14T11:05:04.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.889+0000 7f21ba332800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.0 2024-09-14T11:05:04.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.889+0000 7f21ba332800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1 2024-09-14T11:05:04.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.890+0000 7f21ba332800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.2 2024-09-14T11:05:04.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.890+0000 7f21ba332800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.3 2024-09-14T11:05:04.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.890+0000 7f21ba332800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.4 2024-09-14T11:05:04.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.891+0000 7f21ba332800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.5 2024-09-14T11:05:04.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.892+0000 7f21ba332800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.6 2024-09-14T11:05:04.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.893+0000 7f21ba332800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.7 2024-09-14T11:05:04.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.893+0000 7f21ba332800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.8 2024-09-14T11:05:04.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.893+0000 7f21ba332800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.9 2024-09-14T11:05:04.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.894+0000 7f21ba332800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.10 2024-09-14T11:05:04.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.897+0000 7f21ba332800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:05:04.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.897+0000 7f21ba332800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 2024-09-14T11:05:04.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.898+0000 7f21ba332800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 info.flags=0x17 2024-09-14T11:05:04.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.898+0000 7f21ba332800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 to cache LRU end 2024-09-14T11:05:04.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.898+0000 7f21ba332800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:04.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.898+0000 7f21ba332800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29, ofs0, ns] 2024-09-14T11:05:04.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.899+0000 7f2098ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595194 cookie 94739819393504 notifier 6764 bl.length()=915 2024-09-14T11:05:04.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.899+0000 7f2098ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 info.flags=0x17 2024-09-14T11:05:04.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.899+0000 7f2098ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 to cache LRU end 2024-09-14T11:05:04.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.899+0000 7f2098ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:04.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.899+0000 7f21ba332800 20 handle_bi_update(): bucket=:abort-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29]): orig_sources= new_sources= 2024-09-14T11:05:04.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.899+0000 7f21ba332800 20 handle_bi_update(): bucket=:abort-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29]): potential sources added=[] removed=[] 2024-09-14T11:05:04.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.899+0000 7f21ba332800 20 handle_bi_update(): bucket=:abort-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29]): orig_dests= new_dests= 2024-09-14T11:05:04.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.899+0000 7f21ba332800 20 handle_bi_update(): bucket=:abort-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29]): potential dests added=[] removed=[] 2024-09-14T11:05:04.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.902+0000 7f21ba332800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.0 2024-09-14T11:05:04.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.902+0000 7f21ba332800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.1 2024-09-14T11:05:04.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.902+0000 7f21ba332800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.2 2024-09-14T11:05:04.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.903+0000 7f21ba332800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.3 2024-09-14T11:05:04.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.903+0000 7f21ba332800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.4 2024-09-14T11:05:04.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.903+0000 7f21ba332800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.5 2024-09-14T11:05:04.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.904+0000 7f21ba332800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.6 2024-09-14T11:05:04.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.904+0000 7f21ba332800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.7 2024-09-14T11:05:04.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.904+0000 7f21ba332800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.8 2024-09-14T11:05:04.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.905+0000 7f21ba332800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.9 2024-09-14T11:05:04.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.905+0000 7f21ba332800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29.10 2024-09-14T11:05:04.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.905+0000 7f21ba332800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:05:04.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.905+0000 7f21ba332800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 2024-09-14T11:05:04.905 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.907+0000 7f21ba332800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 info.flags=0x17 2024-09-14T11:05:04.905 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.907+0000 7f21ba332800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 to cache LRU end 2024-09-14T11:05:04.905 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.907+0000 7f21ba332800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:04.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.907+0000 7f21ba332800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29, ofs0, ns] 2024-09-14T11:05:04.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.907+0000 7f20997fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595195 cookie 94739819393504 notifier 6764 bl.length()=883 2024-09-14T11:05:04.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.907+0000 7f20997fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 info.flags=0x17 2024-09-14T11:05:04.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.907+0000 7f20997fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 to cache LRU end 2024-09-14T11:05:04.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.907+0000 7f20997fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:04.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.907+0000 7f21ba332800 20 handle_bi_update(): bucket=:abort-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29]): orig_sources= new_sources= 2024-09-14T11:05:04.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.907+0000 7f21ba332800 20 handle_bi_update(): bucket=:abort-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29]): potential sources added=[] removed=[] 2024-09-14T11:05:04.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.907+0000 7f21ba332800 20 handle_bi_update(): bucket=:abort-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29]): orig_dests= new_dests= 2024-09-14T11:05:04.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.907+0000 7f21ba332800 20 handle_bi_update(): bucket=:abort-at-block-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29]): potential dests added=[] removed=[] 2024-09-14T11:05:04.909 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.910+0000 7f21ba332800 1 execute INFO: reshard of bucket "abort-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-14T11:05:04.910 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.912+0000 7f20677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:04.913 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.914+0000 7f21ba332800 20 remove_watcher() i=0 2024-09-14T11:05:04.913 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.914+0000 7f21ba332800 2 removed watcher, disabling cache 2024-09-14T11:05:04.913 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.915+0000 7f21ba332800 20 remove_watcher() i=1 2024-09-14T11:05:04.914 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.916+0000 7f21ba332800 20 remove_watcher() i=2 2024-09-14T11:05:04.915 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.917+0000 7f21ba332800 20 remove_watcher() i=3 2024-09-14T11:05:04.916 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.918+0000 7f21ba332800 20 remove_watcher() i=4 2024-09-14T11:05:04.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.919+0000 7f21ba332800 20 remove_watcher() i=5 2024-09-14T11:05:04.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.920+0000 7f21ba332800 20 remove_watcher() i=6 2024-09-14T11:05:04.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:04.921+0000 7f21ba332800 20 remove_watcher() i=7 2024-09-14T11:05:04.932 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-14T11:05:04.961 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:05:04.961 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:05:04.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.000+0000 7f154e8bb800 20 rados->read ofs=0 len=0 2024-09-14T11:05:05.001 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.002+0000 7f154e8bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:05.002 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.002+0000 7f154e8bb800 20 realm 2024-09-14T11:05:05.002 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.003+0000 7f154e8bb800 20 rados->read ofs=0 len=0 2024-09-14T11:05:05.002 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.003+0000 7f154e8bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:05.002 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.003+0000 7f154e8bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:05:05.002 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.003+0000 7f154e8bb800 20 rados->read ofs=0 len=0 2024-09-14T11:05:05.002 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.003+0000 7f154e8bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:05.002 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.003+0000 7f154e8bb800 20 rados->read ofs=0 len=0 2024-09-14T11:05:05.002 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.004+0000 7f154e8bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:05.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.004+0000 7f154e8bb800 20 rados->read ofs=0 len=0 2024-09-14T11:05:05.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.004+0000 7f154e8bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:05:05.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.004+0000 7f154e8bb800 20 searching for the correct realm 2024-09-14T11:05:05.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.006+0000 7f154c3a5640 0 -- 172.21.15.97:0/3258784110 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x562f23a284b0 msgr2=0x562f23a2a8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:05:05.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.009+0000 7f154c3a5640 0 -- 172.21.15.97:0/3258784110 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7f1540098d10 msgr2=0x7f154006c160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:05:05.014 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.015+0000 7f154e8bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:05:05.014 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.015+0000 7f154e8bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:05:05.014 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.015+0000 7f154e8bb800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:05:05.014 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.015+0000 7f154e8bb800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:05:05.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.015+0000 7f154e8bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:05:05.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.015+0000 7f154e8bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:05:05.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.015+0000 7f154e8bb800 20 rados->read ofs=0 len=0 2024-09-14T11:05:05.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.015+0000 7f154e8bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:05.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.015+0000 7f154e8bb800 20 rados->read ofs=0 len=0 2024-09-14T11:05:05.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.015+0000 7f154e8bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:05.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.015+0000 7f154e8bb800 20 rados->read ofs=0 len=0 2024-09-14T11:05:05.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.015+0000 7f154e8bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:05:05.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.015+0000 7f154e8bb800 20 zone default found 2024-09-14T11:05:05.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.015+0000 7f154e8bb800 4 Realm: () 2024-09-14T11:05:05.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.015+0000 7f154e8bb800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:05:05.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.015+0000 7f154e8bb800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:05:05.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.015+0000 7f154e8bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:05:05.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.015+0000 7f154e8bb800 20 zonegroup default 2024-09-14T11:05:05.016 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.015+0000 7f154e8bb800 20 rados->read ofs=0 len=0 2024-09-14T11:05:05.016 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.016+0000 7f154e8bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:05.016 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.016+0000 7f154e8bb800 20 rados->read ofs=0 len=0 2024-09-14T11:05:05.016 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.016+0000 7f154e8bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:05.016 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.016+0000 7f154e8bb800 20 rados->read ofs=0 len=0 2024-09-14T11:05:05.016 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.016+0000 7f154e8bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:05.017 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.016+0000 7f154e8bb800 20 started sync module instance, tier type = 2024-09-14T11:05:05.017 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.016+0000 7f154e8bb800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:05:05.024 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.025+0000 7f154e8bb800 20 add_watcher() i=0 2024-09-14T11:05:05.024 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.025+0000 7f154e8bb800 20 add_watcher() i=1 2024-09-14T11:05:05.024 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.025+0000 7f154e8bb800 20 add_watcher() i=2 2024-09-14T11:05:05.024 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.025+0000 7f154e8bb800 20 add_watcher() i=3 2024-09-14T11:05:05.024 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.025+0000 7f154e8bb800 20 add_watcher() i=4 2024-09-14T11:05:05.024 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.025+0000 7f154e8bb800 20 add_watcher() i=5 2024-09-14T11:05:05.024 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.025+0000 7f154e8bb800 20 add_watcher() i=6 2024-09-14T11:05:05.025 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.026+0000 7f154e8bb800 20 add_watcher() i=7 2024-09-14T11:05:05.025 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.026+0000 7f154e8bb800 2 all 8 watchers are set, enabling cache 2024-09-14T11:05:05.026 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.028+0000 7f1402fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:05.027 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.028+0000 7f154e8bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:05:05.027 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.028+0000 7f154e8bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:05:05.027 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.028+0000 7f154e8bb800 5 note: GC not initialized 2024-09-14T11:05:05.027 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.028+0000 7f1401fdb640 20 reqs_thread_entry: start 2024-09-14T11:05:05.027 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.028+0000 7f154e8bb800 20 init_complete bucket index max shards: 11 2024-09-14T11:05:05.027 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.028+0000 7f154e8bb800 20 Filter name: none 2024-09-14T11:05:05.027 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.028+0000 7f13737fe640 20 reqs_thread_entry: start 2024-09-14T11:05:05.027 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.028+0000 7f154e8bb800 20 rados->read ofs=0 len=0 2024-09-14T11:05:05.028 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.029+0000 7f154e8bb800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:05:05.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.029+0000 7f154e8bb800 20 rados->read ofs=0 len=0 2024-09-14T11:05:05.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.029+0000 7f154e8bb800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:05:05.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.029+0000 7f154e8bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:05:05.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.029+0000 7f154e8bb800 20 rados->read ofs=0 len=0 2024-09-14T11:05:05.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.030+0000 7f154e8bb800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:05:05.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.030+0000 7f154e8bb800 20 rados->read ofs=0 len=0 2024-09-14T11:05:05.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.030+0000 7f154e8bb800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:05:05.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.030+0000 7f154e8bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:05:05.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.032+0000 7f1402fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:05.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.034+0000 7f154e8bb800 20 remove_watcher() i=0 2024-09-14T11:05:05.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.034+0000 7f154e8bb800 2 removed watcher, disabling cache 2024-09-14T11:05:05.033 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.035+0000 7f154e8bb800 20 remove_watcher() i=1 2024-09-14T11:05:05.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.036+0000 7f154e8bb800 20 remove_watcher() i=2 2024-09-14T11:05:05.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.037+0000 7f154e8bb800 20 remove_watcher() i=3 2024-09-14T11:05:05.036 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.037+0000 7f154e8bb800 20 remove_watcher() i=4 2024-09-14T11:05:05.037 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.038+0000 7f154e8bb800 20 remove_watcher() i=5 2024-09-14T11:05:05.038 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.039+0000 7f154e8bb800 20 remove_watcher() i=6 2024-09-14T11:05:05.039 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.040+0000 7f154e8bb800 20 remove_watcher() i=7 2024-09-14T11:05:05.049 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:05.049 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:05:05.050 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: abort-at-block-writes id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:05:05.050 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:05.125 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-09-14T11:05:05.125 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:05.328 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:05:05.356 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:05:05.356 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:05:05.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.394+0000 7fc8f1926800 20 rados->read ofs=0 len=0 2024-09-14T11:05:05.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.396+0000 7fc8f1926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:05.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.396+0000 7fc8f1926800 20 realm 2024-09-14T11:05:05.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.396+0000 7fc8f1926800 20 rados->read ofs=0 len=0 2024-09-14T11:05:05.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.396+0000 7fc8f1926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:05.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.396+0000 7fc8f1926800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:05:05.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.396+0000 7fc8f1926800 20 rados->read ofs=0 len=0 2024-09-14T11:05:05.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.396+0000 7fc8f1926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:05.397 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.396+0000 7fc8f1926800 20 rados->read ofs=0 len=0 2024-09-14T11:05:05.397 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.397+0000 7fc8f1926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:05.397 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.397+0000 7fc8f1926800 20 rados->read ofs=0 len=0 2024-09-14T11:05:05.397 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.398+0000 7fc8f1926800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:05:05.398 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.398+0000 7fc8f1926800 20 searching for the correct realm 2024-09-14T11:05:05.398 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.400+0000 7fc8e4dd8640 0 -- 172.21.15.97:0/995501200 >> [v2:172.21.15.97:6816/4093696477,v1:172.21.15.97:6817/4093696477] conn(0x559cae485ee0 msgr2=0x559cae4882d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:05:05.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.403+0000 7fc8e4dd8640 0 -- 172.21.15.97:0/995501200 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7fc8e0043910 msgr2=0x7fc8e0025400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:05:05.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.610+0000 7fc8f1926800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:05:05.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.610+0000 7fc8f1926800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:05:05.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.610+0000 7fc8f1926800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:05:05.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.610+0000 7fc8f1926800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:05:05.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.610+0000 7fc8f1926800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:05:05.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.610+0000 7fc8f1926800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:05:05.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.610+0000 7fc8f1926800 20 rados->read ofs=0 len=0 2024-09-14T11:05:05.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.610+0000 7fc8f1926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:05.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.610+0000 7fc8f1926800 20 rados->read ofs=0 len=0 2024-09-14T11:05:05.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.611+0000 7fc8f1926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:05.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.611+0000 7fc8f1926800 20 rados->read ofs=0 len=0 2024-09-14T11:05:05.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.611+0000 7fc8f1926800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:05:05.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.611+0000 7fc8f1926800 20 zone default found 2024-09-14T11:05:05.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.611+0000 7fc8f1926800 4 Realm: () 2024-09-14T11:05:05.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.611+0000 7fc8f1926800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:05:05.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.611+0000 7fc8f1926800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:05:05.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.611+0000 7fc8f1926800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:05:05.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.611+0000 7fc8f1926800 20 zonegroup default 2024-09-14T11:05:05.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.611+0000 7fc8f1926800 20 rados->read ofs=0 len=0 2024-09-14T11:05:05.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.611+0000 7fc8f1926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:05.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.611+0000 7fc8f1926800 20 rados->read ofs=0 len=0 2024-09-14T11:05:05.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.612+0000 7fc8f1926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:05.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.612+0000 7fc8f1926800 20 rados->read ofs=0 len=0 2024-09-14T11:05:05.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.612+0000 7fc8f1926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:05.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.612+0000 7fc8f1926800 20 started sync module instance, tier type = 2024-09-14T11:05:05.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.612+0000 7fc8f1926800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:05:05.619 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.621+0000 7fc8f1926800 20 add_watcher() i=0 2024-09-14T11:05:05.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.621+0000 7fc8f1926800 20 add_watcher() i=1 2024-09-14T11:05:05.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.621+0000 7fc8f1926800 20 add_watcher() i=2 2024-09-14T11:05:05.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.621+0000 7fc8f1926800 20 add_watcher() i=3 2024-09-14T11:05:05.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.621+0000 7fc8f1926800 20 add_watcher() i=4 2024-09-14T11:05:05.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.621+0000 7fc8f1926800 20 add_watcher() i=5 2024-09-14T11:05:05.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.621+0000 7fc8f1926800 20 add_watcher() i=6 2024-09-14T11:05:05.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.622+0000 7fc8f1926800 20 add_watcher() i=7 2024-09-14T11:05:05.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.622+0000 7fc8f1926800 2 all 8 watchers are set, enabling cache 2024-09-14T11:05:05.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.623+0000 7fc7a37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:05.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.624+0000 7fc8f1926800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:05:05.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.624+0000 7fc8f1926800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:05:05.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.624+0000 7fc8f1926800 5 note: GC not initialized 2024-09-14T11:05:05.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.624+0000 7fc7a27e4640 20 reqs_thread_entry: start 2024-09-14T11:05:05.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.624+0000 7fc8f1926800 20 init_complete bucket index max shards: 11 2024-09-14T11:05:05.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.624+0000 7fc8f1926800 20 Filter name: none 2024-09-14T11:05:05.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.624+0000 7fc713fff640 20 reqs_thread_entry: start 2024-09-14T11:05:05.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.624+0000 7fc8f1926800 20 rados->read ofs=0 len=0 2024-09-14T11:05:05.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.625+0000 7fc8f1926800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:05:05.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.625+0000 7fc8f1926800 20 rados->read ofs=0 len=0 2024-09-14T11:05:05.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.626+0000 7fc8f1926800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:05:05.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.626+0000 7fc8f1926800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:05:05.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.626+0000 7fc8f1926800 20 rados->read ofs=0 len=0 2024-09-14T11:05:05.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.626+0000 7fc8f1926800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:05:05.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.626+0000 7fc8f1926800 20 rados->read ofs=0 len=0 2024-09-14T11:05:05.626 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.627+0000 7fc8f1926800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:05:05.626 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.627+0000 7fc8f1926800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:05:05.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.629+0000 7fc7a37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:05.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.631+0000 7fc8f1926800 20 remove_watcher() i=0 2024-09-14T11:05:05.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.631+0000 7fc8f1926800 2 removed watcher, disabling cache 2024-09-14T11:05:05.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.632+0000 7fc8f1926800 20 remove_watcher() i=1 2024-09-14T11:05:05.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.633+0000 7fc8f1926800 20 remove_watcher() i=2 2024-09-14T11:05:05.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.633+0000 7fc8f1926800 20 remove_watcher() i=3 2024-09-14T11:05:05.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.634+0000 7fc8f1926800 20 remove_watcher() i=4 2024-09-14T11:05:05.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.635+0000 7fc8f1926800 20 remove_watcher() i=5 2024-09-14T11:05:05.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.636+0000 7fc8f1926800 20 remove_watcher() i=6 2024-09-14T11:05:05.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.637+0000 7fc8f1926800 20 remove_watcher() i=7 2024-09-14T11:05:05.646 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:05.646 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:05:05.646 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-commit-target-layout id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:05:05.646 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:05.647 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-09-14T11:05:05.682 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:05:05.682 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:05:05.913 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.914+0000 7f24857af640 0 --2- 172.21.15.97:0/1028905418 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x7f235c004790 0x7f235c006c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:05:05.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.923+0000 7f2489323800 20 rados->read ofs=0 len=0 2024-09-14T11:05:05.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.925+0000 7f2489323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:05.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.925+0000 7f2489323800 20 realm 2024-09-14T11:05:05.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.925+0000 7f2489323800 20 rados->read ofs=0 len=0 2024-09-14T11:05:05.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.925+0000 7f2489323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:05.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.925+0000 7f2489323800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:05:05.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.925+0000 7f2489323800 20 rados->read ofs=0 len=0 2024-09-14T11:05:05.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.925+0000 7f2489323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:05.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.925+0000 7f2489323800 20 rados->read ofs=0 len=0 2024-09-14T11:05:05.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.926+0000 7f2489323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:05.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.926+0000 7f2489323800 20 rados->read ofs=0 len=0 2024-09-14T11:05:05.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:05.926+0000 7f24857af640 0 -- 172.21.15.97:0/1494488234 >> [v2:172.21.15.152:6824/3767355481,v1:172.21.15.152:6825/3767355481] conn(0x561d23b552a0 msgr2=0x561d23b576b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:05:06.127 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.129+0000 7f2489323800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:05:06.128 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.129+0000 7f2489323800 20 searching for the correct realm 2024-09-14T11:05:06.130 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.131+0000 7f24857af640 0 -- 172.21.15.97:0/1494488234 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f2470065b30 msgr2=0x7f24700655a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:05:06.137 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.139+0000 7f2489323800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:05:06.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.139+0000 7f2489323800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:05:06.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.139+0000 7f2489323800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:05:06.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.139+0000 7f2489323800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:05:06.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.139+0000 7f2489323800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:05:06.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.139+0000 7f2489323800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:05:06.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.139+0000 7f2489323800 20 rados->read ofs=0 len=0 2024-09-14T11:05:06.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.139+0000 7f2489323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:06.140 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.139+0000 7f2489323800 20 rados->read ofs=0 len=0 2024-09-14T11:05:06.140 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.140+0000 7f2489323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:06.140 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.140+0000 7f2489323800 20 rados->read ofs=0 len=0 2024-09-14T11:05:06.140 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.140+0000 7f2489323800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:05:06.140 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.140+0000 7f2489323800 20 zone default found 2024-09-14T11:05:06.140 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.140+0000 7f2489323800 4 Realm: () 2024-09-14T11:05:06.140 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.140+0000 7f2489323800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:05:06.140 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.140+0000 7f2489323800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:05:06.140 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.140+0000 7f2489323800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:05:06.140 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.140+0000 7f2489323800 20 zonegroup default 2024-09-14T11:05:06.140 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.140+0000 7f2489323800 20 rados->read ofs=0 len=0 2024-09-14T11:05:06.140 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.140+0000 7f2489323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:06.140 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.140+0000 7f2489323800 20 rados->read ofs=0 len=0 2024-09-14T11:05:06.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.141+0000 7f2489323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:06.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.141+0000 7f2489323800 20 rados->read ofs=0 len=0 2024-09-14T11:05:06.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.141+0000 7f2489323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:06.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.141+0000 7f2489323800 20 started sync module instance, tier type = 2024-09-14T11:05:06.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.141+0000 7f2489323800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:05:06.148 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.150+0000 7f2489323800 20 add_watcher() i=0 2024-09-14T11:05:06.148 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.150+0000 7f2489323800 20 add_watcher() i=1 2024-09-14T11:05:06.148 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.150+0000 7f2489323800 20 add_watcher() i=2 2024-09-14T11:05:06.148 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.150+0000 7f2489323800 20 add_watcher() i=3 2024-09-14T11:05:06.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.150+0000 7f2489323800 20 add_watcher() i=4 2024-09-14T11:05:06.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.150+0000 7f2489323800 20 add_watcher() i=5 2024-09-14T11:05:06.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.150+0000 7f2489323800 20 add_watcher() i=6 2024-09-14T11:05:06.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.151+0000 7f2489323800 20 add_watcher() i=7 2024-09-14T11:05:06.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.151+0000 7f2489323800 2 all 8 watchers are set, enabling cache 2024-09-14T11:05:06.151 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.152+0000 7f233afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:06.152 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.153+0000 7f2489323800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:05:06.152 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.153+0000 7f2489323800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:05:06.152 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.153+0000 7f2489323800 5 note: GC not initialized 2024-09-14T11:05:06.152 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.153+0000 7f2339fe3640 20 reqs_thread_entry: start 2024-09-14T11:05:06.152 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.153+0000 7f2489323800 20 init_complete bucket index max shards: 11 2024-09-14T11:05:06.152 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.153+0000 7f2489323800 20 Filter name: none 2024-09-14T11:05:06.152 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.153+0000 7f22ab7fe640 20 reqs_thread_entry: start 2024-09-14T11:05:06.152 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.153+0000 7f2489323800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-14T11:05:06.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.153+0000 7f2489323800 20 rados->read ofs=0 len=0 2024-09-14T11:05:06.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.153+0000 7f2489323800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:05:06.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.153+0000 7f2489323800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-14T11:05:06.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.153+0000 7f2489323800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-14T11:05:06.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.153+0000 7f2489323800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30 : miss 2024-09-14T11:05:06.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.153+0000 7f2489323800 20 rados->read ofs=0 len=0 2024-09-14T11:05:06.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.154+0000 7f2489323800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:05:06.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.154+0000 7f2489323800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30 info.flags=0x17 2024-09-14T11:05:06.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.154+0000 7f2489323800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30 to cache LRU end 2024-09-14T11:05:06.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.154+0000 7f2489323800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:05:06.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.154+0000 7f2489323800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:06.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.154+0000 7f2489323800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30 2024-09-14T11:05:06.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.159+0000 7f2489323800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30 info.flags=0x17 2024-09-14T11:05:06.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.159+0000 7f2489323800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30 to cache LRU end 2024-09-14T11:05:06.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.159+0000 7f2489323800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:06.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.159+0000 7f2489323800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30, ofs0, ns] 2024-09-14T11:05:06.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.160+0000 7f235b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595177 cookie 94683153180080 notifier 7230 bl.length()=931 2024-09-14T11:05:06.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.160+0000 7f235b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30 info.flags=0x17 2024-09-14T11:05:06.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.160+0000 7f235b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30 to cache LRU end 2024-09-14T11:05:06.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.160+0000 7f235b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:06.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.160+0000 7f2489323800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30]): orig_sources= new_sources= 2024-09-14T11:05:06.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.160+0000 7f2489323800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30]): potential sources added=[] removed=[] 2024-09-14T11:05:06.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.160+0000 7f2489323800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30]): orig_dests= new_dests= 2024-09-14T11:05:06.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.160+0000 7f2489323800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30]): potential dests added=[] removed=[] 2024-09-14T11:05:06.164 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.166+0000 7f2489323800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.1.0 2024-09-14T11:05:06.164 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.166+0000 7f2489323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.1.0 2024-09-14T11:05:06.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.166+0000 7f2489323800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.1.1 2024-09-14T11:05:06.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.166+0000 7f2489323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.1.1 2024-09-14T11:05:06.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.166+0000 7f2489323800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.1.2 2024-09-14T11:05:06.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.166+0000 7f2489323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.1.2 2024-09-14T11:05:06.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.166+0000 7f2489323800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.1.3 2024-09-14T11:05:06.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.166+0000 7f2489323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.1.3 2024-09-14T11:05:06.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.166+0000 7f2489323800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.1.4 2024-09-14T11:05:06.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.166+0000 7f2489323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.1.4 2024-09-14T11:05:06.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.166+0000 7f2489323800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.1.5 2024-09-14T11:05:06.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.166+0000 7f2489323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.1.5 2024-09-14T11:05:06.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.166+0000 7f2489323800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.1.6 2024-09-14T11:05:06.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.166+0000 7f2489323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.1.6 2024-09-14T11:05:06.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.166+0000 7f2489323800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.1.7 2024-09-14T11:05:06.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.166+0000 7f2489323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.1.7 2024-09-14T11:05:06.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.166+0000 7f2489323800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.1.8 2024-09-14T11:05:06.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.166+0000 7f2489323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.1.8 2024-09-14T11:05:06.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.166+0000 7f2489323800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.1.9 2024-09-14T11:05:06.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.166+0000 7f2489323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.1.9 2024-09-14T11:05:06.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.166+0000 7f2489323800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.1.10 2024-09-14T11:05:06.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.166+0000 7f2489323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.1.10 2024-09-14T11:05:06.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.166+0000 7f2489323800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.1.11 2024-09-14T11:05:06.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.166+0000 7f2489323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.1.11 2024-09-14T11:05:06.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.166+0000 7f2489323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.0 2024-09-14T11:05:06.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.166+0000 7f2489323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.1 2024-09-14T11:05:06.167 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.166+0000 7f2489323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.2 2024-09-14T11:05:06.167 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.167+0000 7f2489323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.3 2024-09-14T11:05:06.167 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.167+0000 7f2489323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.4 2024-09-14T11:05:06.167 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.168+0000 7f2489323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.5 2024-09-14T11:05:06.167 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.168+0000 7f2489323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.6 2024-09-14T11:05:06.168 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.169+0000 7f2489323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.7 2024-09-14T11:05:06.168 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.169+0000 7f2489323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.8 2024-09-14T11:05:06.168 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.169+0000 7f2489323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.9 2024-09-14T11:05:06.168 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.170+0000 7f2489323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.10 2024-09-14T11:05:06.171 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.173+0000 7f2489323800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:05:06.171 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.173+0000 7f2489323800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30 2024-09-14T11:05:06.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.174+0000 7f2489323800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30 info.flags=0x17 2024-09-14T11:05:06.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.174+0000 7f2489323800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30 to cache LRU end 2024-09-14T11:05:06.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.174+0000 7f2489323800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:06.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.174+0000 7f2489323800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30, ofs0, ns] 2024-09-14T11:05:06.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.174+0000 7f235bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595178 cookie 94683153180080 notifier 7230 bl.length()=931 2024-09-14T11:05:06.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.174+0000 7f235bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30 info.flags=0x17 2024-09-14T11:05:06.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.174+0000 7f235bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30 to cache LRU end 2024-09-14T11:05:06.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.174+0000 7f235bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:06.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.175+0000 7f2489323800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30]): orig_sources= new_sources= 2024-09-14T11:05:06.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.175+0000 7f2489323800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30]): potential sources added=[] removed=[] 2024-09-14T11:05:06.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.175+0000 7f2489323800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30]): orig_dests= new_dests= 2024-09-14T11:05:06.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.175+0000 7f2489323800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30]): potential dests added=[] removed=[] 2024-09-14T11:05:06.176 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.178+0000 7f2489323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.0 2024-09-14T11:05:06.176 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.178+0000 7f2489323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.1 2024-09-14T11:05:06.177 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.179+0000 7f2489323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.2 2024-09-14T11:05:06.177 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.179+0000 7f2489323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.3 2024-09-14T11:05:06.178 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.179+0000 7f2489323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.4 2024-09-14T11:05:06.178 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.179+0000 7f2489323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.5 2024-09-14T11:05:06.178 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.180+0000 7f2489323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.6 2024-09-14T11:05:06.178 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.180+0000 7f2489323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.7 2024-09-14T11:05:06.179 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.180+0000 7f2489323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.8 2024-09-14T11:05:06.179 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.181+0000 7f2489323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.9 2024-09-14T11:05:06.179 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.181+0000 7f2489323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.10 2024-09-14T11:05:06.180 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.181+0000 7f2489323800 -1 Injecting error=-5 at location=commit_target_layout 2024-09-14T11:05:06.180 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.181+0000 7f2489323800 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-09-14T11:05:06.186 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.187+0000 7f233afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:06.188 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.189+0000 7f2489323800 20 remove_watcher() i=0 2024-09-14T11:05:06.188 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.189+0000 7f2489323800 2 removed watcher, disabling cache 2024-09-14T11:05:06.189 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.190+0000 7f2489323800 20 remove_watcher() i=1 2024-09-14T11:05:06.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.191+0000 7f2489323800 20 remove_watcher() i=2 2024-09-14T11:05:06.191 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.192+0000 7f2489323800 20 remove_watcher() i=3 2024-09-14T11:05:06.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.193+0000 7f2489323800 20 remove_watcher() i=4 2024-09-14T11:05:06.193 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.194+0000 7f2489323800 20 remove_watcher() i=5 2024-09-14T11:05:06.194 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.195+0000 7f2489323800 20 remove_watcher() i=6 2024-09-14T11:05:06.195 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.196+0000 7f2489323800 20 remove_watcher() i=7 2024-09-14T11:05:06.206 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:05:06.235 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:05:06.235 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:05:06.272 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.273+0000 7ff6c2f32800 20 rados->read ofs=0 len=0 2024-09-14T11:05:06.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.275+0000 7ff6c2f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:06.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.275+0000 7ff6c2f32800 20 realm 2024-09-14T11:05:06.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.275+0000 7ff6c2f32800 20 rados->read ofs=0 len=0 2024-09-14T11:05:06.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.275+0000 7ff6c2f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:06.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.275+0000 7ff6c2f32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:05:06.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.275+0000 7ff6c2f32800 20 rados->read ofs=0 len=0 2024-09-14T11:05:06.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.275+0000 7ff6c2f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:06.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.275+0000 7ff6c2f32800 20 rados->read ofs=0 len=0 2024-09-14T11:05:06.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.276+0000 7ff6c2f32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:06.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.276+0000 7ff6c2f32800 20 rados->read ofs=0 len=0 2024-09-14T11:05:06.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.276+0000 7ff6c2f32800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:05:06.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.277+0000 7ff6c2f32800 20 searching for the correct realm 2024-09-14T11:05:06.277 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.278+0000 7ff6bf3bd640 0 -- 172.21.15.97:0/1106426710 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7ff6a8036070 msgr2=0x7ff6a8087130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:05:06.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.482+0000 7ff6b63bb640 0 -- 172.21.15.97:0/1106426710 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7ff6b0077370 msgr2=0x7ff6b0076de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:05:06.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.487+0000 7ff6c2f32800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:05:06.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.487+0000 7ff6c2f32800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:05:06.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.487+0000 7ff6c2f32800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:05:06.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.487+0000 7ff6c2f32800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:05:06.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.487+0000 7ff6c2f32800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:05:06.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.487+0000 7ff6c2f32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:05:06.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.487+0000 7ff6c2f32800 20 rados->read ofs=0 len=0 2024-09-14T11:05:06.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.487+0000 7ff6c2f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:06.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.487+0000 7ff6c2f32800 20 rados->read ofs=0 len=0 2024-09-14T11:05:06.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.487+0000 7ff6c2f32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:06.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.487+0000 7ff6c2f32800 20 rados->read ofs=0 len=0 2024-09-14T11:05:06.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.488+0000 7ff6c2f32800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:05:06.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.488+0000 7ff6c2f32800 20 zone default found 2024-09-14T11:05:06.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.488+0000 7ff6c2f32800 4 Realm: () 2024-09-14T11:05:06.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.488+0000 7ff6c2f32800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:05:06.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.488+0000 7ff6c2f32800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:05:06.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.488+0000 7ff6c2f32800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:05:06.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.488+0000 7ff6c2f32800 20 zonegroup default 2024-09-14T11:05:06.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.488+0000 7ff6c2f32800 20 rados->read ofs=0 len=0 2024-09-14T11:05:06.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.488+0000 7ff6c2f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:06.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.488+0000 7ff6c2f32800 20 rados->read ofs=0 len=0 2024-09-14T11:05:06.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.488+0000 7ff6c2f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:06.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.488+0000 7ff6c2f32800 20 rados->read ofs=0 len=0 2024-09-14T11:05:06.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.488+0000 7ff6c2f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:06.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.488+0000 7ff6c2f32800 20 started sync module instance, tier type = 2024-09-14T11:05:06.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.488+0000 7ff6c2f32800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:05:06.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.497+0000 7ff6c2f32800 20 add_watcher() i=0 2024-09-14T11:05:06.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.497+0000 7ff6c2f32800 20 add_watcher() i=1 2024-09-14T11:05:06.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.497+0000 7ff6c2f32800 20 add_watcher() i=2 2024-09-14T11:05:06.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.497+0000 7ff6c2f32800 20 add_watcher() i=3 2024-09-14T11:05:06.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.497+0000 7ff6c2f32800 20 add_watcher() i=4 2024-09-14T11:05:06.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.497+0000 7ff6c2f32800 20 add_watcher() i=5 2024-09-14T11:05:06.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.497+0000 7ff6c2f32800 20 add_watcher() i=6 2024-09-14T11:05:06.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.498+0000 7ff6c2f32800 20 add_watcher() i=7 2024-09-14T11:05:06.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.498+0000 7ff6c2f32800 2 all 8 watchers are set, enabling cache 2024-09-14T11:05:06.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.499+0000 7ff5757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:06.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.500+0000 7ff6c2f32800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:05:06.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.500+0000 7ff6c2f32800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:05:06.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.500+0000 7ff6c2f32800 5 note: GC not initialized 2024-09-14T11:05:06.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.500+0000 7ff4effff640 20 reqs_thread_entry: start 2024-09-14T11:05:06.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.500+0000 7ff6c2f32800 20 init_complete bucket index max shards: 11 2024-09-14T11:05:06.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.500+0000 7ff6c2f32800 20 Filter name: none 2024-09-14T11:05:06.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.500+0000 7ff6c2f32800 20 rados->read ofs=0 len=0 2024-09-14T11:05:06.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.500+0000 7ff4edffb640 20 reqs_thread_entry: start 2024-09-14T11:05:06.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.501+0000 7ff6c2f32800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:05:06.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.501+0000 7ff6c2f32800 20 rados->read ofs=0 len=0 2024-09-14T11:05:06.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.501+0000 7ff6c2f32800 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:05:06.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.501+0000 7ff6c2f32800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:05:06.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.501+0000 7ff6c2f32800 20 rados->read ofs=0 len=0 2024-09-14T11:05:06.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.502+0000 7ff6c2f32800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:05:06.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.502+0000 7ff6c2f32800 20 rados->read ofs=0 len=0 2024-09-14T11:05:06.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.502+0000 7ff6c2f32800 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:05:06.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.502+0000 7ff6c2f32800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:05:06.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.504+0000 7ff5757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:06.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.506+0000 7ff6c2f32800 20 remove_watcher() i=0 2024-09-14T11:05:06.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.506+0000 7ff6c2f32800 2 removed watcher, disabling cache 2024-09-14T11:05:06.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.507+0000 7ff6c2f32800 20 remove_watcher() i=1 2024-09-14T11:05:06.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.508+0000 7ff6c2f32800 20 remove_watcher() i=2 2024-09-14T11:05:06.508 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.509+0000 7ff6c2f32800 20 remove_watcher() i=3 2024-09-14T11:05:06.509 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.510+0000 7ff6c2f32800 20 remove_watcher() i=4 2024-09-14T11:05:06.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.511+0000 7ff6c2f32800 20 remove_watcher() i=5 2024-09-14T11:05:06.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.512+0000 7ff6c2f32800 20 remove_watcher() i=6 2024-09-14T11:05:06.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.513+0000 7ff6c2f32800 20 remove_watcher() i=7 2024-09-14T11:05:06.523 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:06.523 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:05:06.523 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-commit-target-layout id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:05:06.523 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:06.575 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:05:06.606 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:05:06.606 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:05:06.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.645+0000 7f172c10c800 20 rados->read ofs=0 len=0 2024-09-14T11:05:06.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.647+0000 7f172c10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:06.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.647+0000 7f172c10c800 20 realm 2024-09-14T11:05:06.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.647+0000 7f172c10c800 20 rados->read ofs=0 len=0 2024-09-14T11:05:06.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.647+0000 7f172c10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:06.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.647+0000 7f172c10c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:05:06.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.647+0000 7f172c10c800 20 rados->read ofs=0 len=0 2024-09-14T11:05:06.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.647+0000 7f172c10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:06.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.647+0000 7f172c10c800 20 rados->read ofs=0 len=0 2024-09-14T11:05:06.647 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.648+0000 7f172c10c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:06.647 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.648+0000 7f172c10c800 20 rados->read ofs=0 len=0 2024-09-14T11:05:06.647 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.649+0000 7f172c10c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:05:06.647 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.649+0000 7f172c10c800 20 searching for the correct realm 2024-09-14T11:05:06.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.651+0000 7f172a3f7640 0 -- 172.21.15.97:0/1249379788 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f1714092020 msgr2=0x7f17140ea040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:05:06.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.856+0000 7f17213f5640 0 -- 172.21.15.97:0/1249379788 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f171c061b80 msgr2=0x7f171c06b040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:05:06.860 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.861+0000 7f172c10c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:05:06.860 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.861+0000 7f172c10c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:05:06.860 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.861+0000 7f172c10c800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:05:06.860 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.861+0000 7f172c10c800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:05:06.860 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.861+0000 7f172c10c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:05:06.860 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.861+0000 7f172c10c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:05:06.860 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.861+0000 7f172c10c800 20 rados->read ofs=0 len=0 2024-09-14T11:05:06.860 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.861+0000 7f172c10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:06.860 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.861+0000 7f172c10c800 20 rados->read ofs=0 len=0 2024-09-14T11:05:06.860 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.861+0000 7f172c10c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:06.860 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.861+0000 7f172c10c800 20 rados->read ofs=0 len=0 2024-09-14T11:05:06.861 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.862+0000 7f172c10c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:05:06.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.862+0000 7f172c10c800 20 zone default found 2024-09-14T11:05:06.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.862+0000 7f172c10c800 4 Realm: () 2024-09-14T11:05:06.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.862+0000 7f172c10c800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:05:06.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.862+0000 7f172c10c800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:05:06.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.862+0000 7f172c10c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:05:06.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.862+0000 7f172c10c800 20 zonegroup default 2024-09-14T11:05:06.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.862+0000 7f172c10c800 20 rados->read ofs=0 len=0 2024-09-14T11:05:06.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.862+0000 7f172c10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:06.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.862+0000 7f172c10c800 20 rados->read ofs=0 len=0 2024-09-14T11:05:06.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.862+0000 7f172c10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:06.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.862+0000 7f172c10c800 20 rados->read ofs=0 len=0 2024-09-14T11:05:06.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.862+0000 7f172c10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:06.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.862+0000 7f172c10c800 20 started sync module instance, tier type = 2024-09-14T11:05:06.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.862+0000 7f172c10c800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:05:06.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.871+0000 7f172c10c800 20 add_watcher() i=0 2024-09-14T11:05:06.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.871+0000 7f172c10c800 20 add_watcher() i=1 2024-09-14T11:05:06.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.871+0000 7f172c10c800 20 add_watcher() i=2 2024-09-14T11:05:06.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.871+0000 7f172c10c800 20 add_watcher() i=3 2024-09-14T11:05:06.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.871+0000 7f172c10c800 20 add_watcher() i=4 2024-09-14T11:05:06.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.871+0000 7f172c10c800 20 add_watcher() i=5 2024-09-14T11:05:06.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.871+0000 7f172c10c800 20 add_watcher() i=6 2024-09-14T11:05:06.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.872+0000 7f172c10c800 20 add_watcher() i=7 2024-09-14T11:05:06.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.872+0000 7f172c10c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:05:06.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.873+0000 7f15dbfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:06.873 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.874+0000 7f172c10c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:05:06.873 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.874+0000 7f172c10c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:05:06.873 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.874+0000 7f172c10c800 5 note: GC not initialized 2024-09-14T11:05:06.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.874+0000 7f15daffd640 20 reqs_thread_entry: start 2024-09-14T11:05:06.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.874+0000 7f172c10c800 20 init_complete bucket index max shards: 11 2024-09-14T11:05:06.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.874+0000 7f172c10c800 20 Filter name: none 2024-09-14T11:05:06.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.874+0000 7f15d8ff9640 20 reqs_thread_entry: start 2024-09-14T11:05:06.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.874+0000 7f172c10c800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-14T11:05:06.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.874+0000 7f172c10c800 20 rados->read ofs=0 len=0 2024-09-14T11:05:06.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.875+0000 7f172c10c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:05:06.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.875+0000 7f172c10c800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-14T11:05:06.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.875+0000 7f172c10c800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-14T11:05:06.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.875+0000 7f172c10c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30 : miss 2024-09-14T11:05:06.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.875+0000 7f172c10c800 20 rados->read ofs=0 len=0 2024-09-14T11:05:06.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.875+0000 7f172c10c800 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:05:06.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.875+0000 7f172c10c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30 info.flags=0x17 2024-09-14T11:05:06.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.875+0000 7f172c10c800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30 to cache LRU end 2024-09-14T11:05:06.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.875+0000 7f172c10c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:05:06.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.875+0000 7f172c10c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:06.876 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.875+0000 7f172c10c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30 2024-09-14T11:05:06.876 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.876+0000 7f172c10c800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:05:06.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.885+0000 7f172c10c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30 info.flags=0x17 2024-09-14T11:05:06.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.885+0000 7f172c10c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30 to cache LRU end 2024-09-14T11:05:06.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.885+0000 7f172c10c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:06.886 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.885+0000 7f172c10c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30, ofs0, ns] 2024-09-14T11:05:06.886 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.885+0000 7f160d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595179 cookie 94488877098704 notifier 7263 bl.length()=931 2024-09-14T11:05:06.886 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.885+0000 7f160d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30 info.flags=0x17 2024-09-14T11:05:06.886 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.885+0000 7f160d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30 to cache LRU end 2024-09-14T11:05:06.886 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.885+0000 7f160d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:06.886 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.885+0000 7f172c10c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30]): orig_sources= new_sources= 2024-09-14T11:05:06.886 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.885+0000 7f172c10c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30]): potential sources added=[] removed=[] 2024-09-14T11:05:06.886 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.885+0000 7f172c10c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30]): orig_dests= new_dests= 2024-09-14T11:05:06.886 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.885+0000 7f172c10c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30]): potential dests added=[] removed=[] 2024-09-14T11:05:06.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.890+0000 7f172c10c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.2.0 2024-09-14T11:05:06.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.890+0000 7f172c10c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.2.0 2024-09-14T11:05:06.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.890+0000 7f172c10c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.2.1 2024-09-14T11:05:06.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.890+0000 7f172c10c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.2.1 2024-09-14T11:05:06.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.890+0000 7f172c10c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.2.2 2024-09-14T11:05:06.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.890+0000 7f172c10c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.2.2 2024-09-14T11:05:06.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.890+0000 7f172c10c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.2.3 2024-09-14T11:05:06.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.890+0000 7f172c10c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.2.3 2024-09-14T11:05:06.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.890+0000 7f172c10c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.2.4 2024-09-14T11:05:06.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.890+0000 7f172c10c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.2.4 2024-09-14T11:05:06.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.890+0000 7f172c10c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.2.5 2024-09-14T11:05:06.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.890+0000 7f172c10c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.2.5 2024-09-14T11:05:06.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.890+0000 7f172c10c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.2.6 2024-09-14T11:05:06.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.890+0000 7f172c10c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.2.6 2024-09-14T11:05:06.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.890+0000 7f172c10c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.2.7 2024-09-14T11:05:06.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.890+0000 7f172c10c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.2.7 2024-09-14T11:05:06.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.890+0000 7f172c10c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.2.8 2024-09-14T11:05:06.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.890+0000 7f172c10c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.2.8 2024-09-14T11:05:06.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.890+0000 7f172c10c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.2.9 2024-09-14T11:05:06.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.890+0000 7f172c10c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.2.9 2024-09-14T11:05:06.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.890+0000 7f172c10c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.2.10 2024-09-14T11:05:06.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.890+0000 7f172c10c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.2.10 2024-09-14T11:05:06.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.890+0000 7f172c10c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.2.11 2024-09-14T11:05:06.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.890+0000 7f172c10c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.2.11 2024-09-14T11:05:06.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.890+0000 7f172c10c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.0 2024-09-14T11:05:06.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.891+0000 7f172c10c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.1 2024-09-14T11:05:06.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.891+0000 7f172c10c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.2 2024-09-14T11:05:06.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.892+0000 7f172c10c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.3 2024-09-14T11:05:06.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.892+0000 7f172c10c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.4 2024-09-14T11:05:06.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.892+0000 7f172c10c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.5 2024-09-14T11:05:06.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.893+0000 7f172c10c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.6 2024-09-14T11:05:06.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.893+0000 7f172c10c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.7 2024-09-14T11:05:06.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.894+0000 7f172c10c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.8 2024-09-14T11:05:06.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.894+0000 7f172c10c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.9 2024-09-14T11:05:06.893 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.895+0000 7f172c10c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.10 2024-09-14T11:05:06.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.897+0000 7f172c10c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:05:06.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.897+0000 7f172c10c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30 2024-09-14T11:05:06.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.899+0000 7f172c10c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30 info.flags=0x17 2024-09-14T11:05:06.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.899+0000 7f172c10c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30 to cache LRU end 2024-09-14T11:05:06.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.899+0000 7f172c10c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:06.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.899+0000 7f172c10c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30, ofs0, ns] 2024-09-14T11:05:06.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.899+0000 7f160cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595180 cookie 94488877098704 notifier 7263 bl.length()=931 2024-09-14T11:05:06.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.899+0000 7f160cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30 info.flags=0x17 2024-09-14T11:05:06.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.899+0000 7f160cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30 to cache LRU end 2024-09-14T11:05:06.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.899+0000 7f160cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:06.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.900+0000 7f172c10c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30]): orig_sources= new_sources= 2024-09-14T11:05:06.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.900+0000 7f172c10c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30]): potential sources added=[] removed=[] 2024-09-14T11:05:06.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.900+0000 7f172c10c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30]): orig_dests= new_dests= 2024-09-14T11:05:06.899 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.900+0000 7f172c10c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30]): potential dests added=[] removed=[] 2024-09-14T11:05:06.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.902+0000 7f172c10c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.0 2024-09-14T11:05:06.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.903+0000 7f172c10c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.1 2024-09-14T11:05:06.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.903+0000 7f172c10c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.2 2024-09-14T11:05:06.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.903+0000 7f172c10c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.3 2024-09-14T11:05:06.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.904+0000 7f172c10c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.4 2024-09-14T11:05:06.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.904+0000 7f172c10c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.5 2024-09-14T11:05:06.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.904+0000 7f172c10c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.6 2024-09-14T11:05:06.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.904+0000 7f172c10c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.7 2024-09-14T11:05:06.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.905+0000 7f172c10c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.8 2024-09-14T11:05:06.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.905+0000 7f172c10c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.9 2024-09-14T11:05:06.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.905+0000 7f172c10c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30.10 2024-09-14T11:05:06.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.905+0000 7f172c10c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:05:06.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.905+0000 7f172c10c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30 2024-09-14T11:05:06.905 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.907+0000 7f172c10c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30 info.flags=0x17 2024-09-14T11:05:06.905 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.907+0000 7f172c10c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30 to cache LRU end 2024-09-14T11:05:06.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.907+0000 7f172c10c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:06.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.907+0000 7f172c10c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30, ofs0, ns] 2024-09-14T11:05:06.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.907+0000 7f160cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595181 cookie 94488877098704 notifier 7263 bl.length()=899 2024-09-14T11:05:06.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.907+0000 7f160cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30 info.flags=0x17 2024-09-14T11:05:06.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.907+0000 7f160cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30 to cache LRU end 2024-09-14T11:05:06.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.907+0000 7f160cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:06.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.907+0000 7f172c10c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30]): orig_sources= new_sources= 2024-09-14T11:05:06.907 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.907+0000 7f172c10c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30]): potential sources added=[] removed=[] 2024-09-14T11:05:06.907 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.907+0000 7f172c10c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30]): orig_dests= new_dests= 2024-09-14T11:05:06.907 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.907+0000 7f172c10c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30]): potential dests added=[] removed=[] 2024-09-14T11:05:06.908 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.910+0000 7f172c10c800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:05:06.910 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.912+0000 7f15dbfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:06.912 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.914+0000 7f172c10c800 20 remove_watcher() i=0 2024-09-14T11:05:06.912 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.914+0000 7f172c10c800 2 removed watcher, disabling cache 2024-09-14T11:05:06.913 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.915+0000 7f172c10c800 20 remove_watcher() i=1 2024-09-14T11:05:06.914 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.916+0000 7f172c10c800 20 remove_watcher() i=2 2024-09-14T11:05:06.915 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.917+0000 7f172c10c800 20 remove_watcher() i=3 2024-09-14T11:05:06.916 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.918+0000 7f172c10c800 20 remove_watcher() i=4 2024-09-14T11:05:06.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.919+0000 7f172c10c800 20 remove_watcher() i=5 2024-09-14T11:05:06.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.920+0000 7f172c10c800 20 remove_watcher() i=6 2024-09-14T11:05:06.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.921+0000 7f172c10c800 20 remove_watcher() i=7 2024-09-14T11:05:06.931 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:05:06.959 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:05:06.959 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:05:06.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.997+0000 7fe04bcbb800 20 rados->read ofs=0 len=0 2024-09-14T11:05:06.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.999+0000 7fe04bcbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:06.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.999+0000 7fe04bcbb800 20 realm 2024-09-14T11:05:06.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.999+0000 7fe04bcbb800 20 rados->read ofs=0 len=0 2024-09-14T11:05:06.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.999+0000 7fe04bcbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:06.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.999+0000 7fe04bcbb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:05:06.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.999+0000 7fe04bcbb800 20 rados->read ofs=0 len=0 2024-09-14T11:05:06.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.999+0000 7fe04bcbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:06.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:06.999+0000 7fe04bcbb800 20 rados->read ofs=0 len=0 2024-09-14T11:05:06.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.000+0000 7fe04bcbb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:06.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.000+0000 7fe04bcbb800 20 rados->read ofs=0 len=0 2024-09-14T11:05:07.000 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.001+0000 7fe04bcbb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:05:07.000 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.001+0000 7fe04bcbb800 20 searching for the correct realm 2024-09-14T11:05:07.001 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.003+0000 7fe049fa6640 0 -- 172.21.15.97:0/145616126 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7fe03408dc20 msgr2=0x7fe034009750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:05:07.207 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.208+0000 7fe040fa4640 0 -- 172.21.15.97:0/145616126 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7fe03c047920 msgr2=0x7fe03c017400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:05:07.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.213+0000 7fe04bcbb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:05:07.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.213+0000 7fe04bcbb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:05:07.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.213+0000 7fe04bcbb800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:05:07.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.213+0000 7fe04bcbb800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:05:07.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.213+0000 7fe04bcbb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:05:07.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.213+0000 7fe04bcbb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:05:07.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.213+0000 7fe04bcbb800 20 rados->read ofs=0 len=0 2024-09-14T11:05:07.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.213+0000 7fe04bcbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:07.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.213+0000 7fe04bcbb800 20 rados->read ofs=0 len=0 2024-09-14T11:05:07.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.214+0000 7fe04bcbb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:07.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.214+0000 7fe04bcbb800 20 rados->read ofs=0 len=0 2024-09-14T11:05:07.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.214+0000 7fe04bcbb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:05:07.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.214+0000 7fe04bcbb800 20 zone default found 2024-09-14T11:05:07.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.214+0000 7fe04bcbb800 4 Realm: () 2024-09-14T11:05:07.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.214+0000 7fe04bcbb800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:05:07.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.214+0000 7fe04bcbb800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:05:07.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.214+0000 7fe04bcbb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:05:07.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.214+0000 7fe04bcbb800 20 zonegroup default 2024-09-14T11:05:07.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.214+0000 7fe04bcbb800 20 rados->read ofs=0 len=0 2024-09-14T11:05:07.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.214+0000 7fe04bcbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:07.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.214+0000 7fe04bcbb800 20 rados->read ofs=0 len=0 2024-09-14T11:05:07.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.214+0000 7fe04bcbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:07.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.214+0000 7fe04bcbb800 20 rados->read ofs=0 len=0 2024-09-14T11:05:07.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.215+0000 7fe04bcbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:07.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.215+0000 7fe04bcbb800 20 started sync module instance, tier type = 2024-09-14T11:05:07.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.215+0000 7fe04bcbb800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:05:07.222 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.224+0000 7fe04bcbb800 20 add_watcher() i=0 2024-09-14T11:05:07.222 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.224+0000 7fe04bcbb800 20 add_watcher() i=1 2024-09-14T11:05:07.222 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.224+0000 7fe04bcbb800 20 add_watcher() i=2 2024-09-14T11:05:07.222 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.224+0000 7fe04bcbb800 20 add_watcher() i=3 2024-09-14T11:05:07.223 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.224+0000 7fe04bcbb800 20 add_watcher() i=4 2024-09-14T11:05:07.223 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.224+0000 7fe04bcbb800 20 add_watcher() i=5 2024-09-14T11:05:07.223 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.224+0000 7fe04bcbb800 20 add_watcher() i=6 2024-09-14T11:05:07.223 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.224+0000 7fe04bcbb800 20 add_watcher() i=7 2024-09-14T11:05:07.223 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.224+0000 7fe04bcbb800 2 all 8 watchers are set, enabling cache 2024-09-14T11:05:07.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.227+0000 7fdefffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:07.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.227+0000 7fe04bcbb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:05:07.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.227+0000 7fe04bcbb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:05:07.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.227+0000 7fe04bcbb800 5 note: GC not initialized 2024-09-14T11:05:07.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.227+0000 7fdefefe5640 20 reqs_thread_entry: start 2024-09-14T11:05:07.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.227+0000 7fe04bcbb800 20 init_complete bucket index max shards: 11 2024-09-14T11:05:07.226 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.227+0000 7fe04bcbb800 20 Filter name: none 2024-09-14T11:05:07.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.227+0000 7fdefcfe1640 20 reqs_thread_entry: start 2024-09-14T11:05:07.227 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.227+0000 7fe04bcbb800 20 rados->read ofs=0 len=0 2024-09-14T11:05:07.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.228+0000 7fe04bcbb800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:05:07.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.228+0000 7fe04bcbb800 20 rados->read ofs=0 len=0 2024-09-14T11:05:07.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.228+0000 7fe04bcbb800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:05:07.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.228+0000 7fe04bcbb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:05:07.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.228+0000 7fe04bcbb800 20 rados->read ofs=0 len=0 2024-09-14T11:05:07.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.229+0000 7fe04bcbb800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:05:07.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.229+0000 7fe04bcbb800 20 rados->read ofs=0 len=0 2024-09-14T11:05:07.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.229+0000 7fe04bcbb800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:05:07.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.229+0000 7fe04bcbb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:05:07.230 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.232+0000 7fdefffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:07.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.233+0000 7fe04bcbb800 20 remove_watcher() i=0 2024-09-14T11:05:07.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.233+0000 7fe04bcbb800 2 removed watcher, disabling cache 2024-09-14T11:05:07.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.234+0000 7fe04bcbb800 20 remove_watcher() i=1 2024-09-14T11:05:07.234 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.236+0000 7fe04bcbb800 20 remove_watcher() i=2 2024-09-14T11:05:07.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.237+0000 7fe04bcbb800 20 remove_watcher() i=3 2024-09-14T11:05:07.236 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.237+0000 7fe04bcbb800 20 remove_watcher() i=4 2024-09-14T11:05:07.237 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.238+0000 7fe04bcbb800 20 remove_watcher() i=5 2024-09-14T11:05:07.238 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.239+0000 7fe04bcbb800 20 remove_watcher() i=6 2024-09-14T11:05:07.239 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.240+0000 7fe04bcbb800 20 remove_watcher() i=7 2024-09-14T11:05:07.249 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:07.249 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:05:07.249 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-commit-target-layout id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:05:07.249 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:07.323 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-09-14T11:05:07.323 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:07.512 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:05:07.541 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:05:07.541 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:05:07.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.781+0000 7f2d2b92c800 20 rados->read ofs=0 len=0 2024-09-14T11:05:07.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.782+0000 7f2d2b92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:07.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.782+0000 7f2d2b92c800 20 realm 2024-09-14T11:05:07.783 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.782+0000 7f2d2b92c800 20 rados->read ofs=0 len=0 2024-09-14T11:05:07.783 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.783+0000 7f2d2b92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:07.783 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.783+0000 7f2d2b92c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:05:07.783 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.783+0000 7f2d2b92c800 20 rados->read ofs=0 len=0 2024-09-14T11:05:07.783 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.783+0000 7f2d2b92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:07.783 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.783+0000 7f2d2b92c800 20 rados->read ofs=0 len=0 2024-09-14T11:05:07.784 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.783+0000 7f2d2b92c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:07.784 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.783+0000 7f2d2b92c800 20 rados->read ofs=0 len=0 2024-09-14T11:05:07.785 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.784+0000 7f2d2b92c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:05:07.785 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.784+0000 7f2d2b92c800 20 searching for the correct realm 2024-09-14T11:05:07.785 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.784+0000 7f2d2753e640 0 -- 172.21.15.97:0/3096407083 >> [v2:172.21.15.152:6808/1010851305,v1:172.21.15.152:6809/1010851305] conn(0x55dbb048aaf0 msgr2=0x55dbb048cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:05:07.987 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.989+0000 7f2d2753e640 0 -- 172.21.15.97:0/3096407083 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x55dbb047e2e0 msgr2=0x55dbb04806f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:05:07.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.995+0000 7f2d2b92c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:05:07.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.995+0000 7f2d2b92c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:05:07.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.995+0000 7f2d2b92c800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:05:07.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.995+0000 7f2d2b92c800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:05:07.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.995+0000 7f2d2b92c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:05:07.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.995+0000 7f2d2b92c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:05:07.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.995+0000 7f2d2b92c800 20 rados->read ofs=0 len=0 2024-09-14T11:05:07.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.995+0000 7f2d2b92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:07.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.995+0000 7f2d2b92c800 20 rados->read ofs=0 len=0 2024-09-14T11:05:07.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.995+0000 7f2d2b92c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:07.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.995+0000 7f2d2b92c800 20 rados->read ofs=0 len=0 2024-09-14T11:05:07.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.995+0000 7f2d2b92c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:05:07.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.995+0000 7f2d2b92c800 20 zone default found 2024-09-14T11:05:07.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.995+0000 7f2d2b92c800 4 Realm: () 2024-09-14T11:05:07.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.995+0000 7f2d2b92c800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:05:07.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.995+0000 7f2d2b92c800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:05:07.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.995+0000 7f2d2b92c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:05:07.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.995+0000 7f2d2b92c800 20 zonegroup default 2024-09-14T11:05:07.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.995+0000 7f2d2b92c800 20 rados->read ofs=0 len=0 2024-09-14T11:05:07.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.996+0000 7f2d2b92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:07.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.996+0000 7f2d2b92c800 20 rados->read ofs=0 len=0 2024-09-14T11:05:07.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.996+0000 7f2d2b92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:07.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.996+0000 7f2d2b92c800 20 rados->read ofs=0 len=0 2024-09-14T11:05:07.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.996+0000 7f2d2b92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:07.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.996+0000 7f2d2b92c800 20 started sync module instance, tier type = 2024-09-14T11:05:07.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:07.996+0000 7f2d2b92c800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:05:08.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.005+0000 7f2d2b92c800 20 add_watcher() i=0 2024-09-14T11:05:08.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.005+0000 7f2d2b92c800 20 add_watcher() i=1 2024-09-14T11:05:08.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.005+0000 7f2d2b92c800 20 add_watcher() i=2 2024-09-14T11:05:08.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.005+0000 7f2d2b92c800 20 add_watcher() i=3 2024-09-14T11:05:08.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.005+0000 7f2d2b92c800 20 add_watcher() i=4 2024-09-14T11:05:08.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.005+0000 7f2d2b92c800 20 add_watcher() i=5 2024-09-14T11:05:08.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.005+0000 7f2d2b92c800 20 add_watcher() i=6 2024-09-14T11:05:08.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.006+0000 7f2d2b92c800 20 add_watcher() i=7 2024-09-14T11:05:08.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.006+0000 7f2d2b92c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:05:08.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.008+0000 7f2bddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:08.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.008+0000 7f2d2b92c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:05:08.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.008+0000 7f2d2b92c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:05:08.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.008+0000 7f2d2b92c800 5 note: GC not initialized 2024-09-14T11:05:08.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.008+0000 7f2bdcfe1640 20 reqs_thread_entry: start 2024-09-14T11:05:08.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.008+0000 7f2d2b92c800 20 init_complete bucket index max shards: 11 2024-09-14T11:05:08.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.008+0000 7f2d2b92c800 20 Filter name: none 2024-09-14T11:05:08.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.008+0000 7f2b567fc640 20 reqs_thread_entry: start 2024-09-14T11:05:08.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.008+0000 7f2d2b92c800 20 rados->read ofs=0 len=0 2024-09-14T11:05:08.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.009+0000 7f2d2b92c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:05:08.009 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.009+0000 7f2d2b92c800 20 rados->read ofs=0 len=0 2024-09-14T11:05:08.009 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.009+0000 7f2d2b92c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:05:08.009 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.009+0000 7f2d2b92c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:05:08.009 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.009+0000 7f2d2b92c800 20 rados->read ofs=0 len=0 2024-09-14T11:05:08.009 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.010+0000 7f2d2b92c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:05:08.009 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.010+0000 7f2d2b92c800 20 rados->read ofs=0 len=0 2024-09-14T11:05:08.009 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.011+0000 7f2d2b92c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:05:08.009 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.011+0000 7f2d2b92c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:05:08.011 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.012+0000 7f2bddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:08.013 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.014+0000 7f2d2b92c800 20 remove_watcher() i=0 2024-09-14T11:05:08.013 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.014+0000 7f2d2b92c800 2 removed watcher, disabling cache 2024-09-14T11:05:08.014 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.015+0000 7f2d2b92c800 20 remove_watcher() i=1 2024-09-14T11:05:08.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.016+0000 7f2d2b92c800 20 remove_watcher() i=2 2024-09-14T11:05:08.016 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.017+0000 7f2d2b92c800 20 remove_watcher() i=3 2024-09-14T11:05:08.017 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.018+0000 7f2d2b92c800 20 remove_watcher() i=4 2024-09-14T11:05:08.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.019+0000 7f2d2b92c800 20 remove_watcher() i=5 2024-09-14T11:05:08.019 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.020+0000 7f2d2b92c800 20 remove_watcher() i=6 2024-09-14T11:05:08.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.021+0000 7f2d2b92c800 20 remove_watcher() i=7 2024-09-14T11:05:08.029 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:08.030 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:05:08.030 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-commit-target-layout id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:05:08.030 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:08.031 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-09-14T11:05:08.067 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:05:08.067 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:05:08.104 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.105+0000 7f386f420800 20 rados->read ofs=0 len=0 2024-09-14T11:05:08.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.107+0000 7f386f420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:08.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.107+0000 7f386f420800 20 realm 2024-09-14T11:05:08.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.107+0000 7f386f420800 20 rados->read ofs=0 len=0 2024-09-14T11:05:08.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.107+0000 7f386f420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:08.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.107+0000 7f386f420800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:05:08.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.107+0000 7f386f420800 20 rados->read ofs=0 len=0 2024-09-14T11:05:08.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.107+0000 7f386f420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:08.106 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.107+0000 7f386f420800 20 rados->read ofs=0 len=0 2024-09-14T11:05:08.107 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.108+0000 7f386f420800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:08.107 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.108+0000 7f386f420800 20 rados->read ofs=0 len=0 2024-09-14T11:05:08.107 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.109+0000 7f386f420800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:05:08.107 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.109+0000 7f386f420800 20 searching for the correct realm 2024-09-14T11:05:08.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.111+0000 7f386d70b640 0 -- 172.21.15.97:0/1439481671 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f3854046940 msgr2=0x7f3854056400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:05:08.315 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.316+0000 7f3864709640 0 -- 172.21.15.97:0/1439481671 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f385c018070 msgr2=0x7f385c06a710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:05:08.319 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.321+0000 7f386f420800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:05:08.319 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.321+0000 7f386f420800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:05:08.320 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.321+0000 7f386f420800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:05:08.320 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.321+0000 7f386f420800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:05:08.320 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.321+0000 7f386f420800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:05:08.320 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.321+0000 7f386f420800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:05:08.320 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.321+0000 7f386f420800 20 rados->read ofs=0 len=0 2024-09-14T11:05:08.321 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.321+0000 7f386f420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:08.321 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.321+0000 7f386f420800 20 rados->read ofs=0 len=0 2024-09-14T11:05:08.321 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.322+0000 7f386f420800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:08.321 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.322+0000 7f386f420800 20 rados->read ofs=0 len=0 2024-09-14T11:05:08.321 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.322+0000 7f386f420800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:05:08.321 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.322+0000 7f386f420800 20 zone default found 2024-09-14T11:05:08.321 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.322+0000 7f386f420800 4 Realm: () 2024-09-14T11:05:08.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.322+0000 7f386f420800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:05:08.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.322+0000 7f386f420800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:05:08.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.322+0000 7f386f420800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:05:08.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.322+0000 7f386f420800 20 zonegroup default 2024-09-14T11:05:08.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.322+0000 7f386f420800 20 rados->read ofs=0 len=0 2024-09-14T11:05:08.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.322+0000 7f386f420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:08.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.322+0000 7f386f420800 20 rados->read ofs=0 len=0 2024-09-14T11:05:08.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.322+0000 7f386f420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:08.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.322+0000 7f386f420800 20 rados->read ofs=0 len=0 2024-09-14T11:05:08.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.323+0000 7f386f420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:08.323 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.323+0000 7f386f420800 20 started sync module instance, tier type = 2024-09-14T11:05:08.323 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.323+0000 7f386f420800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:05:08.330 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.332+0000 7f386f420800 20 add_watcher() i=0 2024-09-14T11:05:08.330 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.332+0000 7f386f420800 20 add_watcher() i=1 2024-09-14T11:05:08.330 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.332+0000 7f386f420800 20 add_watcher() i=2 2024-09-14T11:05:08.330 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.332+0000 7f386f420800 20 add_watcher() i=3 2024-09-14T11:05:08.331 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.332+0000 7f386f420800 20 add_watcher() i=4 2024-09-14T11:05:08.331 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.332+0000 7f386f420800 20 add_watcher() i=5 2024-09-14T11:05:08.331 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.332+0000 7f386f420800 20 add_watcher() i=6 2024-09-14T11:05:08.331 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.332+0000 7f386f420800 20 add_watcher() i=7 2024-09-14T11:05:08.331 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.332+0000 7f386f420800 2 all 8 watchers are set, enabling cache 2024-09-14T11:05:08.333 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.334+0000 7f3722fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:08.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.335+0000 7f386f420800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:05:08.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.335+0000 7f386f420800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:05:08.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.335+0000 7f386f420800 5 note: GC not initialized 2024-09-14T11:05:08.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.335+0000 7f3721fe3640 20 reqs_thread_entry: start 2024-09-14T11:05:08.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.335+0000 7f386f420800 20 init_complete bucket index max shards: 11 2024-09-14T11:05:08.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.335+0000 7f386f420800 20 Filter name: none 2024-09-14T11:05:08.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.335+0000 7f36937fe640 20 reqs_thread_entry: start 2024-09-14T11:05:08.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.335+0000 7f386f420800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-14T11:05:08.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.335+0000 7f386f420800 20 rados->read ofs=0 len=0 2024-09-14T11:05:08.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.336+0000 7f386f420800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:05:08.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.336+0000 7f386f420800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-14T11:05:08.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.336+0000 7f386f420800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-14T11:05:08.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.336+0000 7f386f420800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31 : miss 2024-09-14T11:05:08.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.336+0000 7f386f420800 20 rados->read ofs=0 len=0 2024-09-14T11:05:08.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.336+0000 7f386f420800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:05:08.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.336+0000 7f386f420800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31 info.flags=0x17 2024-09-14T11:05:08.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.336+0000 7f386f420800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31 to cache LRU end 2024-09-14T11:05:08.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.336+0000 7f386f420800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:05:08.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.336+0000 7f386f420800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:08.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.336+0000 7f386f420800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31 2024-09-14T11:05:08.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.342+0000 7f386f420800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31 info.flags=0x17 2024-09-14T11:05:08.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.342+0000 7f386f420800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31 to cache LRU end 2024-09-14T11:05:08.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.342+0000 7f386f420800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:08.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.342+0000 7f386f420800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31, ofs0, ns] 2024-09-14T11:05:08.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.342+0000 7f3743fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595184 cookie 94348408378336 notifier 6902 bl.length()=931 2024-09-14T11:05:08.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.342+0000 7f3743fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31 info.flags=0x17 2024-09-14T11:05:08.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.342+0000 7f3743fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31 to cache LRU end 2024-09-14T11:05:08.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.342+0000 7f3743fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:08.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.343+0000 7f386f420800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31]): orig_sources= new_sources= 2024-09-14T11:05:08.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.343+0000 7f386f420800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31]): potential sources added=[] removed=[] 2024-09-14T11:05:08.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.343+0000 7f386f420800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31]): orig_dests= new_dests= 2024-09-14T11:05:08.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.343+0000 7f386f420800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31]): potential dests added=[] removed=[] 2024-09-14T11:05:08.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.346+0000 7f386f420800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31.1.0 2024-09-14T11:05:08.346 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.346+0000 7f386f420800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31.1.0 2024-09-14T11:05:08.346 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.346+0000 7f386f420800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31.1.1 2024-09-14T11:05:08.346 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.346+0000 7f386f420800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31.1.1 2024-09-14T11:05:08.346 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.346+0000 7f386f420800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31.1.2 2024-09-14T11:05:08.346 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.346+0000 7f386f420800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31.1.2 2024-09-14T11:05:08.346 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.346+0000 7f386f420800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31.1.3 2024-09-14T11:05:08.346 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.346+0000 7f386f420800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31.1.3 2024-09-14T11:05:08.346 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.346+0000 7f386f420800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31.1.4 2024-09-14T11:05:08.346 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.346+0000 7f386f420800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31.1.4 2024-09-14T11:05:08.346 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.346+0000 7f386f420800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31.1.5 2024-09-14T11:05:08.346 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.347+0000 7f386f420800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31.1.5 2024-09-14T11:05:08.346 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.347+0000 7f386f420800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31.1.6 2024-09-14T11:05:08.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.347+0000 7f386f420800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31.1.6 2024-09-14T11:05:08.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.347+0000 7f386f420800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31.1.7 2024-09-14T11:05:08.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.347+0000 7f386f420800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31.1.7 2024-09-14T11:05:08.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.347+0000 7f386f420800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31.1.8 2024-09-14T11:05:08.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.347+0000 7f386f420800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31.1.8 2024-09-14T11:05:08.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.347+0000 7f386f420800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31.1.9 2024-09-14T11:05:08.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.347+0000 7f386f420800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31.1.9 2024-09-14T11:05:08.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.347+0000 7f386f420800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31.1.10 2024-09-14T11:05:08.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.347+0000 7f386f420800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31.1.10 2024-09-14T11:05:08.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.347+0000 7f386f420800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31.1.11 2024-09-14T11:05:08.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.347+0000 7f386f420800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31.1.11 2024-09-14T11:05:08.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.347+0000 7f386f420800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31.0 2024-09-14T11:05:08.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.347+0000 7f386f420800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31.1 2024-09-14T11:05:08.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.348+0000 7f386f420800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31.2 2024-09-14T11:05:08.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.348+0000 7f386f420800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31.3 2024-09-14T11:05:08.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.348+0000 7f386f420800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31.4 2024-09-14T11:05:08.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.349+0000 7f386f420800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31.5 2024-09-14T11:05:08.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.349+0000 7f386f420800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31.6 2024-09-14T11:05:08.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.350+0000 7f386f420800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31.7 2024-09-14T11:05:08.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.351+0000 7f386f420800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31.8 2024-09-14T11:05:08.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.351+0000 7f386f420800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31.9 2024-09-14T11:05:08.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.352+0000 7f386f420800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31.10 2024-09-14T11:05:08.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.355+0000 7f386f420800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31 : hit (requested=0x17, cached=0x17) 2024-09-14T11:05:08.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.355+0000 7f386f420800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31 2024-09-14T11:05:08.354 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.356+0000 7f386f420800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31 info.flags=0x17 2024-09-14T11:05:08.355 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.356+0000 7f386f420800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31 to cache LRU end 2024-09-14T11:05:08.355 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.356+0000 7f386f420800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:08.355 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.356+0000 7f386f420800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31, ofs0, ns] 2024-09-14T11:05:08.355 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.356+0000 7f37437fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595185 cookie 94348408378336 notifier 6902 bl.length()=931 2024-09-14T11:05:08.355 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.356+0000 7f37437fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31 info.flags=0x17 2024-09-14T11:05:08.355 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.356+0000 7f37437fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31 to cache LRU end 2024-09-14T11:05:08.355 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.356+0000 7f37437fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:08.356 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.356+0000 7f386f420800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31]): orig_sources= new_sources= 2024-09-14T11:05:08.356 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.356+0000 7f386f420800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31]): potential sources added=[] removed=[] 2024-09-14T11:05:08.356 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.356+0000 7f386f420800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31]): orig_dests= new_dests= 2024-09-14T11:05:08.356 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.356+0000 7f386f420800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31]): potential dests added=[] removed=[] 2024-09-14T11:05:08.357 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.358+0000 7f386f420800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31.0 2024-09-14T11:05:08.357 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.359+0000 7f386f420800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31.1 2024-09-14T11:05:08.358 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.359+0000 7f386f420800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31.2 2024-09-14T11:05:08.358 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.359+0000 7f386f420800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31.3 2024-09-14T11:05:08.358 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.360+0000 7f386f420800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31.4 2024-09-14T11:05:08.358 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.360+0000 7f386f420800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31.5 2024-09-14T11:05:08.359 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.360+0000 7f386f420800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31.6 2024-09-14T11:05:08.359 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.360+0000 7f386f420800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31.7 2024-09-14T11:05:08.359 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.361+0000 7f386f420800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31.8 2024-09-14T11:05:08.359 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.361+0000 7f386f420800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31.9 2024-09-14T11:05:08.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.361+0000 7f386f420800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31.10 2024-09-14T11:05:08.361 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.362+0000 7f386f420800 -1 Injecting error=-125 at location=commit_target_layout 2024-09-14T11:05:08.361 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.362+0000 7f386f420800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31 : hit (requested=0x17, cached=0x17) 2024-09-14T11:05:08.361 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.362+0000 7f386f420800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31 2024-09-14T11:05:08.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.363+0000 7f386f420800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31 info.flags=0x17 2024-09-14T11:05:08.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.363+0000 7f386f420800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31 to cache LRU end 2024-09-14T11:05:08.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.363+0000 7f386f420800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:08.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.363+0000 7f386f420800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31, ofs0, ns] 2024-09-14T11:05:08.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.363+0000 7f37437fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595186 cookie 94348408378336 notifier 6902 bl.length()=899 2024-09-14T11:05:08.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.363+0000 7f37437fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31 info.flags=0x17 2024-09-14T11:05:08.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.363+0000 7f37437fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31 to cache LRU end 2024-09-14T11:05:08.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.363+0000 7f37437fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:08.363 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.364+0000 7f386f420800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31]): orig_sources= new_sources= 2024-09-14T11:05:08.363 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.364+0000 7f386f420800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31]): potential sources added=[] removed=[] 2024-09-14T11:05:08.363 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.364+0000 7f386f420800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31]): orig_dests= new_dests= 2024-09-14T11:05:08.363 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.364+0000 7f386f420800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31]): potential dests added=[] removed=[] 2024-09-14T11:05:08.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.366+0000 7f386f420800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:05:08.366 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.367+0000 7f3722fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:08.368 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.369+0000 7f386f420800 20 remove_watcher() i=0 2024-09-14T11:05:08.368 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.369+0000 7f386f420800 2 removed watcher, disabling cache 2024-09-14T11:05:08.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.370+0000 7f386f420800 20 remove_watcher() i=1 2024-09-14T11:05:08.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.372+0000 7f386f420800 20 remove_watcher() i=2 2024-09-14T11:05:08.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.373+0000 7f386f420800 20 remove_watcher() i=3 2024-09-14T11:05:08.372 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.374+0000 7f386f420800 20 remove_watcher() i=4 2024-09-14T11:05:08.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.374+0000 7f386f420800 20 remove_watcher() i=5 2024-09-14T11:05:08.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.375+0000 7f386f420800 20 remove_watcher() i=6 2024-09-14T11:05:08.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.376+0000 7f386f420800 20 remove_watcher() i=7 2024-09-14T11:05:08.387 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:05:08.415 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:05:08.415 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:05:08.453 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.455+0000 7f3d6352e800 20 rados->read ofs=0 len=0 2024-09-14T11:05:08.455 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.456+0000 7f3d6352e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:08.455 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.456+0000 7f3d6352e800 20 realm 2024-09-14T11:05:08.455 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.456+0000 7f3d6352e800 20 rados->read ofs=0 len=0 2024-09-14T11:05:08.455 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.456+0000 7f3d6352e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:08.456 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.456+0000 7f3d6352e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:05:08.456 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.456+0000 7f3d6352e800 20 rados->read ofs=0 len=0 2024-09-14T11:05:08.456 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.457+0000 7f3d6352e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:08.456 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.457+0000 7f3d6352e800 20 rados->read ofs=0 len=0 2024-09-14T11:05:08.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.457+0000 7f3d6352e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:08.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.457+0000 7f3d6352e800 20 rados->read ofs=0 len=0 2024-09-14T11:05:08.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.458+0000 7f3d6352e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:05:08.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.458+0000 7f3d6352e800 20 searching for the correct realm 2024-09-14T11:05:08.458 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.460+0000 7f3d5fade640 0 -- 172.21.15.97:0/2115317340 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f3d4809abb0 msgr2=0x7f3d4808bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:05:08.663 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.665+0000 7f3d56adc640 0 -- 172.21.15.97:0/2115317340 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f3d50071320 msgr2=0x7f3d50070cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:05:08.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.669+0000 7f3d6352e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:05:08.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.669+0000 7f3d6352e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:05:08.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.669+0000 7f3d6352e800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:05:08.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.669+0000 7f3d6352e800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:05:08.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.669+0000 7f3d6352e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:05:08.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.669+0000 7f3d6352e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:05:08.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.669+0000 7f3d6352e800 20 rados->read ofs=0 len=0 2024-09-14T11:05:08.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.670+0000 7f3d6352e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:08.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.670+0000 7f3d6352e800 20 rados->read ofs=0 len=0 2024-09-14T11:05:08.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.670+0000 7f3d6352e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:08.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.670+0000 7f3d6352e800 20 rados->read ofs=0 len=0 2024-09-14T11:05:08.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.670+0000 7f3d6352e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:05:08.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.670+0000 7f3d6352e800 20 zone default found 2024-09-14T11:05:08.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.670+0000 7f3d6352e800 4 Realm: () 2024-09-14T11:05:08.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.670+0000 7f3d6352e800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:05:08.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.670+0000 7f3d6352e800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:05:08.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.670+0000 7f3d6352e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:05:08.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.670+0000 7f3d6352e800 20 zonegroup default 2024-09-14T11:05:08.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.670+0000 7f3d6352e800 20 rados->read ofs=0 len=0 2024-09-14T11:05:08.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.671+0000 7f3d6352e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:08.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.671+0000 7f3d6352e800 20 rados->read ofs=0 len=0 2024-09-14T11:05:08.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.671+0000 7f3d6352e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:08.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.671+0000 7f3d6352e800 20 rados->read ofs=0 len=0 2024-09-14T11:05:08.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.671+0000 7f3d6352e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:08.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.671+0000 7f3d6352e800 20 started sync module instance, tier type = 2024-09-14T11:05:08.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.671+0000 7f3d6352e800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:05:08.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.680+0000 7f3d6352e800 20 add_watcher() i=0 2024-09-14T11:05:08.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.680+0000 7f3d6352e800 20 add_watcher() i=1 2024-09-14T11:05:08.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.680+0000 7f3d6352e800 20 add_watcher() i=2 2024-09-14T11:05:08.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.680+0000 7f3d6352e800 20 add_watcher() i=3 2024-09-14T11:05:08.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.680+0000 7f3d6352e800 20 add_watcher() i=4 2024-09-14T11:05:08.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.680+0000 7f3d6352e800 20 add_watcher() i=5 2024-09-14T11:05:08.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.680+0000 7f3d6352e800 20 add_watcher() i=6 2024-09-14T11:05:08.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.681+0000 7f3d6352e800 20 add_watcher() i=7 2024-09-14T11:05:08.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.681+0000 7f3d6352e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:05:08.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.683+0000 7f3c15fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:08.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.683+0000 7f3d6352e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:05:08.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.683+0000 7f3d6352e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:05:08.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.683+0000 7f3d6352e800 5 note: GC not initialized 2024-09-14T11:05:08.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.683+0000 7f3c14fe1640 20 reqs_thread_entry: start 2024-09-14T11:05:08.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.683+0000 7f3d6352e800 20 init_complete bucket index max shards: 11 2024-09-14T11:05:08.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.683+0000 7f3d6352e800 20 Filter name: none 2024-09-14T11:05:08.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.683+0000 7f3b8e7fc640 20 reqs_thread_entry: start 2024-09-14T11:05:08.682 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.684+0000 7f3d6352e800 20 rados->read ofs=0 len=0 2024-09-14T11:05:08.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.684+0000 7f3d6352e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:05:08.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.684+0000 7f3d6352e800 20 rados->read ofs=0 len=0 2024-09-14T11:05:08.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.685+0000 7f3d6352e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:05:08.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.685+0000 7f3d6352e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:05:08.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.685+0000 7f3d6352e800 20 rados->read ofs=0 len=0 2024-09-14T11:05:08.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.685+0000 7f3d6352e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:05:08.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.685+0000 7f3d6352e800 20 rados->read ofs=0 len=0 2024-09-14T11:05:08.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.686+0000 7f3d6352e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:05:08.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.686+0000 7f3d6352e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:05:08.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.687+0000 7f3c15fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:08.688 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.689+0000 7f3d6352e800 20 remove_watcher() i=0 2024-09-14T11:05:08.688 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.689+0000 7f3d6352e800 2 removed watcher, disabling cache 2024-09-14T11:05:08.689 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.691+0000 7f3d6352e800 20 remove_watcher() i=1 2024-09-14T11:05:08.690 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.692+0000 7f3d6352e800 20 remove_watcher() i=2 2024-09-14T11:05:08.691 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.693+0000 7f3d6352e800 20 remove_watcher() i=3 2024-09-14T11:05:08.692 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.693+0000 7f3d6352e800 20 remove_watcher() i=4 2024-09-14T11:05:08.693 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.695+0000 7f3d6352e800 20 remove_watcher() i=5 2024-09-14T11:05:08.694 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.696+0000 7f3d6352e800 20 remove_watcher() i=6 2024-09-14T11:05:08.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:08.696+0000 7f3d6352e800 20 remove_watcher() i=7 2024-09-14T11:05:08.705 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:08.705 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:05:08.705 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-commit-target-layout id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:05:08.706 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:08.781 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-09-14T11:05:08.781 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:08.978 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-14T11:05:09.007 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:05:09.007 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:05:09.044 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.046+0000 7f8c7c12e800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.048+0000 7f8c7c12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:09.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.048+0000 7f8c7c12e800 20 realm 2024-09-14T11:05:09.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.048+0000 7f8c7c12e800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.048+0000 7f8c7c12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:09.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.048+0000 7f8c7c12e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:05:09.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.048+0000 7f8c7c12e800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.048+0000 7f8c7c12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:09.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.048+0000 7f8c7c12e800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.049+0000 7f8c7c12e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:09.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.049+0000 7f8c7c12e800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.050+0000 7f8c7c12e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:05:09.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.050+0000 7f8c7c12e800 20 searching for the correct realm 2024-09-14T11:05:09.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.050+0000 7f8c77d64640 0 -- 172.21.15.97:0/81688586 >> [v2:172.21.15.152:6808/1010851305,v1:172.21.15.152:6809/1010851305] conn(0x562c72ff46b0 msgr2=0x562c72ff6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:05:09.253 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.254+0000 7f8c78565640 0 -- 172.21.15.97:0/81688586 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x562c72fe7f80 msgr2=0x562c72fea3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:05:09.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.261+0000 7f8c7c12e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:05:09.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.261+0000 7f8c7c12e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:05:09.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.261+0000 7f8c7c12e800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:05:09.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.261+0000 7f8c7c12e800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:05:09.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.261+0000 7f8c7c12e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:05:09.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.261+0000 7f8c7c12e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:05:09.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.261+0000 7f8c7c12e800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.261+0000 7f8c7c12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:09.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.261+0000 7f8c7c12e800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.261+0000 7f8c7c12e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:09.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.261+0000 7f8c7c12e800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.262+0000 7f8c7c12e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:05:09.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.262+0000 7f8c7c12e800 20 zone default found 2024-09-14T11:05:09.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.262+0000 7f8c7c12e800 4 Realm: () 2024-09-14T11:05:09.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.262+0000 7f8c7c12e800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:05:09.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.262+0000 7f8c7c12e800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:05:09.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.262+0000 7f8c7c12e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:05:09.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.262+0000 7f8c7c12e800 20 zonegroup default 2024-09-14T11:05:09.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.262+0000 7f8c7c12e800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.262+0000 7f8c7c12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:09.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.262+0000 7f8c7c12e800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.262+0000 7f8c7c12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:09.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.262+0000 7f8c7c12e800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.262+0000 7f8c7c12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:09.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.262+0000 7f8c7c12e800 20 started sync module instance, tier type = 2024-09-14T11:05:09.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.262+0000 7f8c7c12e800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:05:09.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.271+0000 7f8c7c12e800 20 add_watcher() i=0 2024-09-14T11:05:09.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.271+0000 7f8c7c12e800 20 add_watcher() i=1 2024-09-14T11:05:09.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.271+0000 7f8c7c12e800 20 add_watcher() i=2 2024-09-14T11:05:09.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.271+0000 7f8c7c12e800 20 add_watcher() i=3 2024-09-14T11:05:09.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.271+0000 7f8c7c12e800 20 add_watcher() i=4 2024-09-14T11:05:09.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.271+0000 7f8c7c12e800 20 add_watcher() i=5 2024-09-14T11:05:09.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.271+0000 7f8c7c12e800 20 add_watcher() i=6 2024-09-14T11:05:09.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.272+0000 7f8c7c12e800 20 add_watcher() i=7 2024-09-14T11:05:09.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.272+0000 7f8c7c12e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:05:09.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.274+0000 7f8b2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:09.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.275+0000 7f8c7c12e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:05:09.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.275+0000 7f8c7c12e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:05:09.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.275+0000 7f8c7c12e800 5 note: GC not initialized 2024-09-14T11:05:09.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.275+0000 7f8b2cfe1640 20 reqs_thread_entry: start 2024-09-14T11:05:09.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.275+0000 7f8c7c12e800 20 init_complete bucket index max shards: 11 2024-09-14T11:05:09.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.275+0000 7f8c7c12e800 20 Filter name: none 2024-09-14T11:05:09.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.275+0000 7f8aa67fc640 20 reqs_thread_entry: start 2024-09-14T11:05:09.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.275+0000 7f8c7c12e800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.276+0000 7f8c7c12e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:05:09.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.276+0000 7f8c7c12e800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.276+0000 7f8c7c12e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:05:09.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.276+0000 7f8c7c12e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:05:09.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.276+0000 7f8c7c12e800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.277+0000 7f8c7c12e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:05:09.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.277+0000 7f8c7c12e800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.277+0000 7f8c7c12e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:05:09.277 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.277+0000 7f8c7c12e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:05:09.277 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.279+0000 7f8b2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:09.279 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.281+0000 7f8c7c12e800 20 remove_watcher() i=0 2024-09-14T11:05:09.279 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.281+0000 7f8c7c12e800 2 removed watcher, disabling cache 2024-09-14T11:05:09.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.282+0000 7f8c7c12e800 20 remove_watcher() i=1 2024-09-14T11:05:09.281 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.283+0000 7f8c7c12e800 20 remove_watcher() i=2 2024-09-14T11:05:09.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.284+0000 7f8c7c12e800 20 remove_watcher() i=3 2024-09-14T11:05:09.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.285+0000 7f8c7c12e800 20 remove_watcher() i=4 2024-09-14T11:05:09.284 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.286+0000 7f8c7c12e800 20 remove_watcher() i=5 2024-09-14T11:05:09.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.287+0000 7f8c7c12e800 20 remove_watcher() i=6 2024-09-14T11:05:09.286 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.288+0000 7f8c7c12e800 20 remove_watcher() i=7 2024-09-14T11:05:09.297 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:09.297 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:05:09.297 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: abort-at-commit-target-layout id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:05:09.297 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:09.298 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-09-14T11:05:09.333 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:05:09.333 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:05:09.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.371+0000 7f978ef46800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.372+0000 7f978ef46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:09.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.372+0000 7f978ef46800 20 realm 2024-09-14T11:05:09.372 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.372+0000 7f978ef46800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.372 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.372+0000 7f978ef46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:09.372 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.372+0000 7f978ef46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:05:09.372 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.372+0000 7f978ef46800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.372 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.373+0000 7f978ef46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:09.372 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.373+0000 7f978ef46800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.373+0000 7f978ef46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:09.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.373+0000 7f978ef46800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.374+0000 7f978ef46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:05:09.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.374+0000 7f978ef46800 20 searching for the correct realm 2024-09-14T11:05:09.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.376+0000 7f978d238640 0 -- 172.21.15.97:0/1560020169 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f97740a2070 msgr2=0x7f97740030b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:05:09.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.582+0000 7f9784236640 0 -- 172.21.15.97:0/1560020169 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f977c092230 msgr2=0x7f977c066180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:05:09.585 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.587+0000 7f978ef46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:05:09.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.587+0000 7f978ef46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:05:09.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.587+0000 7f978ef46800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:05:09.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.587+0000 7f978ef46800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:05:09.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.587+0000 7f978ef46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:05:09.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.587+0000 7f978ef46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:05:09.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.587+0000 7f978ef46800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.587+0000 7f978ef46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:09.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.587+0000 7f978ef46800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.587+0000 7f978ef46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:09.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.587+0000 7f978ef46800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.588+0000 7f978ef46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:05:09.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.588+0000 7f978ef46800 20 zone default found 2024-09-14T11:05:09.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.588+0000 7f978ef46800 4 Realm: () 2024-09-14T11:05:09.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.588+0000 7f978ef46800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:05:09.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.588+0000 7f978ef46800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:05:09.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.588+0000 7f978ef46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:05:09.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.588+0000 7f978ef46800 20 zonegroup default 2024-09-14T11:05:09.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.588+0000 7f978ef46800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.588+0000 7f978ef46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:09.589 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.588+0000 7f978ef46800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.589 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.588+0000 7f978ef46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:09.589 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.588+0000 7f978ef46800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.589 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.589+0000 7f978ef46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:09.589 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.589+0000 7f978ef46800 20 started sync module instance, tier type = 2024-09-14T11:05:09.589 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.589+0000 7f978ef46800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:05:09.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.597+0000 7f978ef46800 20 add_watcher() i=0 2024-09-14T11:05:09.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.597+0000 7f978ef46800 20 add_watcher() i=1 2024-09-14T11:05:09.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.597+0000 7f978ef46800 20 add_watcher() i=2 2024-09-14T11:05:09.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.597+0000 7f978ef46800 20 add_watcher() i=3 2024-09-14T11:05:09.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.597+0000 7f978ef46800 20 add_watcher() i=4 2024-09-14T11:05:09.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.597+0000 7f978ef46800 20 add_watcher() i=5 2024-09-14T11:05:09.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.597+0000 7f978ef46800 20 add_watcher() i=6 2024-09-14T11:05:09.596 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.598+0000 7f978ef46800 20 add_watcher() i=7 2024-09-14T11:05:09.597 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.598+0000 7f978ef46800 2 all 8 watchers are set, enabling cache 2024-09-14T11:05:09.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.600+0000 7f96437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:09.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.600+0000 7f978ef46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:05:09.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.600+0000 7f978ef46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:05:09.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.600+0000 7f978ef46800 5 note: GC not initialized 2024-09-14T11:05:09.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.600+0000 7f96427e4640 20 reqs_thread_entry: start 2024-09-14T11:05:09.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.600+0000 7f978ef46800 20 init_complete bucket index max shards: 11 2024-09-14T11:05:09.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.600+0000 7f978ef46800 20 Filter name: none 2024-09-14T11:05:09.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.600+0000 7f963bfff640 20 reqs_thread_entry: start 2024-09-14T11:05:09.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.600+0000 7f978ef46800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:05:09.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.601+0000 7f978ef46800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.601+0000 7f978ef46800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:05:09.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.601+0000 7f978ef46800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:05:09.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.601+0000 7f978ef46800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:05:09.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.601+0000 7f978ef46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 : miss 2024-09-14T11:05:09.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.601+0000 7f978ef46800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.601+0000 7f978ef46800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:05:09.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.601+0000 7f978ef46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 info.flags=0x17 2024-09-14T11:05:09.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.601+0000 7f978ef46800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 to cache LRU end 2024-09-14T11:05:09.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.601+0000 7f978ef46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:05:09.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.601+0000 7f978ef46800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:09.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.601+0000 7f978ef46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 2024-09-14T11:05:09.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.606+0000 7f978ef46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 info.flags=0x17 2024-09-14T11:05:09.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.606+0000 7f978ef46800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 to cache LRU end 2024-09-14T11:05:09.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.606+0000 7f978ef46800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:09.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.606+0000 7f978ef46800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32, ofs0, ns] 2024-09-14T11:05:09.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.606+0000 7f96637fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595203 cookie 94473985249088 notifier 7374 bl.length()=931 2024-09-14T11:05:09.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.606+0000 7f96637fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 info.flags=0x17 2024-09-14T11:05:09.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.606+0000 7f96637fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 to cache LRU end 2024-09-14T11:05:09.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.606+0000 7f96637fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:09.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.607+0000 7f978ef46800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32]): orig_sources= new_sources= 2024-09-14T11:05:09.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.607+0000 7f978ef46800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32]): potential sources added=[] removed=[] 2024-09-14T11:05:09.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.607+0000 7f978ef46800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32]): orig_dests= new_dests= 2024-09-14T11:05:09.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.607+0000 7f978ef46800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32]): potential dests added=[] removed=[] 2024-09-14T11:05:09.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.612+0000 7f978ef46800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.0 2024-09-14T11:05:09.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.612+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.0 2024-09-14T11:05:09.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.612+0000 7f978ef46800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.1 2024-09-14T11:05:09.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.612+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.1 2024-09-14T11:05:09.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.612+0000 7f978ef46800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.2 2024-09-14T11:05:09.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.612+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.2 2024-09-14T11:05:09.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.612+0000 7f978ef46800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.3 2024-09-14T11:05:09.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.612+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.3 2024-09-14T11:05:09.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.612+0000 7f978ef46800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.4 2024-09-14T11:05:09.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.612+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.4 2024-09-14T11:05:09.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.612+0000 7f978ef46800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.5 2024-09-14T11:05:09.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.612+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.5 2024-09-14T11:05:09.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.612+0000 7f978ef46800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.6 2024-09-14T11:05:09.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.612+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.6 2024-09-14T11:05:09.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.612+0000 7f978ef46800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.7 2024-09-14T11:05:09.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.612+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.7 2024-09-14T11:05:09.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.612+0000 7f978ef46800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.8 2024-09-14T11:05:09.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.612+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.8 2024-09-14T11:05:09.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.612+0000 7f978ef46800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.9 2024-09-14T11:05:09.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.612+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.9 2024-09-14T11:05:09.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.612+0000 7f978ef46800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.10 2024-09-14T11:05:09.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.612+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.10 2024-09-14T11:05:09.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.612+0000 7f978ef46800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.11 2024-09-14T11:05:09.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.612+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.11 2024-09-14T11:05:09.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.612+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.0 2024-09-14T11:05:09.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.612+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1 2024-09-14T11:05:09.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.613+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.2 2024-09-14T11:05:09.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.613+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.3 2024-09-14T11:05:09.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.614+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.4 2024-09-14T11:05:09.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.614+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.5 2024-09-14T11:05:09.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.614+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.6 2024-09-14T11:05:09.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.615+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.7 2024-09-14T11:05:09.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.615+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.8 2024-09-14T11:05:09.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.616+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.9 2024-09-14T11:05:09.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.616+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.10 2024-09-14T11:05:09.618 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.619+0000 7f978ef46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 : hit (requested=0x17, cached=0x17) 2024-09-14T11:05:09.618 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.619+0000 7f978ef46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 2024-09-14T11:05:09.619 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.620+0000 7f978ef46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 info.flags=0x17 2024-09-14T11:05:09.619 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.620+0000 7f978ef46800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 to cache LRU end 2024-09-14T11:05:09.619 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.620+0000 7f978ef46800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:09.619 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.620+0000 7f978ef46800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32, ofs0, ns] 2024-09-14T11:05:09.619 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.621+0000 7f96637fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595204 cookie 94473985249088 notifier 7374 bl.length()=931 2024-09-14T11:05:09.619 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.621+0000 7f96637fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 info.flags=0x17 2024-09-14T11:05:09.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.621+0000 7f96637fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 to cache LRU end 2024-09-14T11:05:09.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.621+0000 7f96637fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:09.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.621+0000 7f978ef46800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32]): orig_sources= new_sources= 2024-09-14T11:05:09.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.621+0000 7f978ef46800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32]): potential sources added=[] removed=[] 2024-09-14T11:05:09.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.621+0000 7f978ef46800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32]): orig_dests= new_dests= 2024-09-14T11:05:09.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.621+0000 7f978ef46800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32]): potential dests added=[] removed=[] 2024-09-14T11:05:09.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.623+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.0 2024-09-14T11:05:09.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.623+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1 2024-09-14T11:05:09.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.624+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.2 2024-09-14T11:05:09.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.624+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.3 2024-09-14T11:05:09.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.624+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.4 2024-09-14T11:05:09.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.624+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.5 2024-09-14T11:05:09.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.625+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.6 2024-09-14T11:05:09.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.625+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.7 2024-09-14T11:05:09.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.625+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.8 2024-09-14T11:05:09.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.626+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.9 2024-09-14T11:05:09.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.626+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.10 2024-09-14T11:05:09.625 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f978ef46800 time 2024-09-14T11:05:09.627666+0000 2024-09-14T11:05:09.625 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:05:09.626 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:05:09.626 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f979258c76a] 2024-09-14T11:05:09.626 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f979258c928] 2024-09-14T11:05:09.626 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ec6db030b1] 2024-09-14T11:05:09.626 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55ec6db13217] 2024-09-14T11:05:09.626 INFO:tasks.workunit.client.0.smithi097.stderr: 5: main() 2024-09-14T11:05:09.626 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f9791229590] 2024-09-14T11:05:09.626 INFO:tasks.workunit.client.0.smithi097.stderr: 7: __libc_start_main() 2024-09-14T11:05:09.626 INFO:tasks.workunit.client.0.smithi097.stderr: 8: _start() 2024-09-14T11:05:09.626 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.627+0000 7f978ef46800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f978ef46800 time 2024-09-14T11:05:09.627666+0000 2024-09-14T11:05:09.626 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:05:09.627 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:09.627 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:05:09.627 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f979258c76a] 2024-09-14T11:05:09.627 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f979258c928] 2024-09-14T11:05:09.627 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ec6db030b1] 2024-09-14T11:05:09.627 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55ec6db13217] 2024-09-14T11:05:09.627 INFO:tasks.workunit.client.0.smithi097.stderr: 5: main() 2024-09-14T11:05:09.627 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f9791229590] 2024-09-14T11:05:09.627 INFO:tasks.workunit.client.0.smithi097.stderr: 7: __libc_start_main() 2024-09-14T11:05:09.627 INFO:tasks.workunit.client.0.smithi097.stderr: 8: _start() 2024-09-14T11:05:09.627 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:09.627 INFO:tasks.workunit.client.0.smithi097.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:05:09.627 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f978ef46800 thread_name:radosgw-admin 2024-09-14T11:05:09.645 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:05:09.645 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f979123e6f0] 2024-09-14T11:05:09.645 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f979128b99c] 2024-09-14T11:05:09.645 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-14T11:05:09.645 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-14T11:05:09.646 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f979258c7c4] 2024-09-14T11:05:09.646 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f979258c928] 2024-09-14T11:05:09.646 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ec6db030b1] 2024-09-14T11:05:09.646 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55ec6db13217] 2024-09-14T11:05:09.646 INFO:tasks.workunit.client.0.smithi097.stderr: 9: main() 2024-09-14T11:05:09.646 INFO:tasks.workunit.client.0.smithi097.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f9791229590] 2024-09-14T11:05:09.646 INFO:tasks.workunit.client.0.smithi097.stderr: 11: __libc_start_main() 2024-09-14T11:05:09.646 INFO:tasks.workunit.client.0.smithi097.stderr: 12: _start() 2024-09-14T11:05:09.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.628+0000 7f978ef46800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:05:09.646 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f978ef46800 thread_name:radosgw-admin 2024-09-14T11:05:09.646 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:09.646 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:05:09.646 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f979123e6f0] 2024-09-14T11:05:09.647 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f979128b99c] 2024-09-14T11:05:09.647 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-14T11:05:09.647 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-14T11:05:09.647 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f979258c7c4] 2024-09-14T11:05:09.647 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f979258c928] 2024-09-14T11:05:09.647 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ec6db030b1] 2024-09-14T11:05:09.647 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55ec6db13217] 2024-09-14T11:05:09.647 INFO:tasks.workunit.client.0.smithi097.stderr: 9: main() 2024-09-14T11:05:09.647 INFO:tasks.workunit.client.0.smithi097.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f9791229590] 2024-09-14T11:05:09.647 INFO:tasks.workunit.client.0.smithi097.stderr: 11: __libc_start_main() 2024-09-14T11:05:09.647 INFO:tasks.workunit.client.0.smithi097.stderr: 12: _start() 2024-09-14T11:05:09.647 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:05:09.647 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:09.648 INFO:tasks.workunit.client.0.smithi097.stderr:--- begin dump of recent events --- 2024-09-14T11:05:09.648 INFO:tasks.workunit.client.0.smithi097.stderr: -499> 2024-09-14T11:05:09.355+0000 7f978ca37640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:05:09.648 INFO:tasks.workunit.client.0.smithi097.stderr: -498> 2024-09-14T11:05:09.355+0000 7f978ca37640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:05:09.648 INFO:tasks.workunit.client.0.smithi097.stderr: -497> 2024-09-14T11:05:09.355+0000 7f9784236640 10 monclient(hunting): get_auth_request con 0x55ec702f5b40 auth_method 0 2024-09-14T11:05:09.648 INFO:tasks.workunit.client.0.smithi097.stderr: -496> 2024-09-14T11:05:09.355+0000 7f9784236640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:05:09.648 INFO:tasks.workunit.client.0.smithi097.stderr: -495> 2024-09-14T11:05:09.355+0000 7f9784236640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:05:09.648 INFO:tasks.workunit.client.0.smithi097.stderr: -494> 2024-09-14T11:05:09.355+0000 7f9784236640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:05:09.648 INFO:tasks.workunit.client.0.smithi097.stderr: -493> 2024-09-14T11:05:09.356+0000 7f978ca37640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:05:09.648 INFO:tasks.workunit.client.0.smithi097.stderr: -492> 2024-09-14T11:05:09.356+0000 7f978ca37640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:05:09.648 INFO:tasks.workunit.client.0.smithi097.stderr: -491> 2024-09-14T11:05:09.356+0000 7f978ca37640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:05:09.648 INFO:tasks.workunit.client.0.smithi097.stderr: -490> 2024-09-14T11:05:09.356+0000 7f9784236640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:05:09.648 INFO:tasks.workunit.client.0.smithi097.stderr: -489> 2024-09-14T11:05:09.356+0000 7f9784236640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:05:09.648 INFO:tasks.workunit.client.0.smithi097.stderr: -488> 2024-09-14T11:05:09.356+0000 7f9784236640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:05:09.649 INFO:tasks.workunit.client.0.smithi097.stderr: -487> 2024-09-14T11:05:09.356+0000 7f978d238640 10 monclient(hunting): get_auth_request con 0x55ec7038f550 auth_method 0 2024-09-14T11:05:09.649 INFO:tasks.workunit.client.0.smithi097.stderr: -486> 2024-09-14T11:05:09.356+0000 7f978d238640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:05:09.649 INFO:tasks.workunit.client.0.smithi097.stderr: -485> 2024-09-14T11:05:09.356+0000 7f978d238640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:05:09.649 INFO:tasks.workunit.client.0.smithi097.stderr: -484> 2024-09-14T11:05:09.356+0000 7f978d238640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:05:09.649 INFO:tasks.workunit.client.0.smithi097.stderr: -483> 2024-09-14T11:05:09.356+0000 7f978d238640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:05:09.649 INFO:tasks.workunit.client.0.smithi097.stderr: -482> 2024-09-14T11:05:09.356+0000 7f978d238640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:05:09.649 INFO:tasks.workunit.client.0.smithi097.stderr: -481> 2024-09-14T11:05:09.356+0000 7f978d238640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:05:09.649 INFO:tasks.workunit.client.0.smithi097.stderr: -480> 2024-09-14T11:05:09.356+0000 7f978ca37640 10 monclient(hunting): handle_auth_done global_id 6941 payload 824 2024-09-14T11:05:09.649 INFO:tasks.workunit.client.0.smithi097.stderr: -479> 2024-09-14T11:05:09.356+0000 7f978ca37640 10 monclient: _finish_hunting 0 2024-09-14T11:05:09.649 INFO:tasks.workunit.client.0.smithi097.stderr: -478> 2024-09-14T11:05:09.356+0000 7f978ca37640 1 monclient: found mon.noname-c 2024-09-14T11:05:09.649 INFO:tasks.workunit.client.0.smithi097.stderr: -477> 2024-09-14T11:05:09.356+0000 7f978ca37640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:05:09.649 INFO:tasks.workunit.client.0.smithi097.stderr: -476> 2024-09-14T11:05:09.356+0000 7f967960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:05:09.649 INFO:tasks.workunit.client.0.smithi097.stderr: -475> 2024-09-14T11:05:09.356+0000 7f967960a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:05:09.649 INFO:tasks.workunit.client.0.smithi097.stderr: -474> 2024-09-14T11:05:09.356+0000 7f967960a640 10 monclient: dump: 2024-09-14T11:05:09.650 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:05:09.650 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:05:09.650 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:09.650 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:09.650 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:05:09.650 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:05:09.650 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:05:09.650 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:05:09.650 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:05:09.650 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:09.650 INFO:tasks.workunit.client.0.smithi097.stderr: -473> 2024-09-14T11:05:09.356+0000 7f967960a640 10 monclient: _finish_auth 0 2024-09-14T11:05:09.650 INFO:tasks.workunit.client.0.smithi097.stderr: -472> 2024-09-14T11:05:09.356+0000 7f967960a640 10 monclient: _check_auth_tickets 2024-09-14T11:05:09.650 INFO:tasks.workunit.client.0.smithi097.stderr: -471> 2024-09-14T11:05:09.356+0000 7f978ef46800 5 monclient: authenticate success, global_id 6941 2024-09-14T11:05:09.651 INFO:tasks.workunit.client.0.smithi097.stderr: -470> 2024-09-14T11:05:09.356+0000 7f978ef46800 10 monclient: _renew_subs 2024-09-14T11:05:09.651 INFO:tasks.workunit.client.0.smithi097.stderr: -469> 2024-09-14T11:05:09.356+0000 7f978ef46800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:05:09.651 INFO:tasks.workunit.client.0.smithi097.stderr: -468> 2024-09-14T11:05:09.356+0000 7f967960a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:05:09.651 INFO:tasks.workunit.client.0.smithi097.stderr: -467> 2024-09-14T11:05:09.356+0000 7f967960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:05:09.651 INFO:tasks.workunit.client.0.smithi097.stderr: -466> 2024-09-14T11:05:09.356+0000 7f967960a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:05:09.651 INFO:tasks.workunit.client.0.smithi097.stderr: -465> 2024-09-14T11:05:09.356+0000 7f967960a640 10 monclient: dump: 2024-09-14T11:05:09.651 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:05:09.651 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:05:09.651 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:09.651 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:09.651 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:05:09.651 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:05:09.651 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:05:09.651 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:05:09.651 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:05:09.652 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:09.652 INFO:tasks.workunit.client.0.smithi097.stderr: -464> 2024-09-14T11:05:09.356+0000 7f967ae0d640 4 set_mon_vals no callback set 2024-09-14T11:05:09.652 INFO:tasks.workunit.client.0.smithi097.stderr: -463> 2024-09-14T11:05:09.356+0000 7f978ef46800 10 monclient: _renew_subs 2024-09-14T11:05:09.652 INFO:tasks.workunit.client.0.smithi097.stderr: -462> 2024-09-14T11:05:09.356+0000 7f978ef46800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:05:09.652 INFO:tasks.workunit.client.0.smithi097.stderr: -461> 2024-09-14T11:05:09.356+0000 7f978ef46800 1 librados: init done 2024-09-14T11:05:09.652 INFO:tasks.workunit.client.0.smithi097.stderr: -460> 2024-09-14T11:05:09.358+0000 7f967960a640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:05:09.652 INFO:tasks.workunit.client.0.smithi097.stderr: -459> 2024-09-14T11:05:09.358+0000 7f967960a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:05:09.652 INFO:tasks.workunit.client.0.smithi097.stderr: -458> 2024-09-14T11:05:09.358+0000 7f967960a640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:05:09.652 INFO:tasks.workunit.client.0.smithi097.stderr: -457> 2024-09-14T11:05:09.358+0000 7f9784236640 10 monclient: get_auth_request con 0x7f9674077230 auth_method 0 2024-09-14T11:05:09.652 INFO:tasks.workunit.client.0.smithi097.stderr: -456> 2024-09-14T11:05:09.358+0000 7f978d238640 10 monclient: get_auth_request con 0x55ec70473460 auth_method 0 2024-09-14T11:05:09.652 INFO:tasks.workunit.client.0.smithi097.stderr: -455> 2024-09-14T11:05:09.359+0000 7f978ca37640 10 monclient: get_auth_request con 0x55ec70495df0 auth_method 0 2024-09-14T11:05:09.652 INFO:tasks.workunit.client.0.smithi097.stderr: -454> 2024-09-14T11:05:09.360+0000 7f9784236640 10 monclient: get_auth_request con 0x55ec7049a150 auth_method 0 2024-09-14T11:05:09.652 INFO:tasks.workunit.client.0.smithi097.stderr: -453> 2024-09-14T11:05:09.361+0000 7f978d238640 10 monclient: get_auth_request con 0x55ec70499620 auth_method 0 2024-09-14T11:05:09.653 INFO:tasks.workunit.client.0.smithi097.stderr: -452> 2024-09-14T11:05:09.361+0000 7f978ef46800 10 monclient: build_initial_monmap 2024-09-14T11:05:09.653 INFO:tasks.workunit.client.0.smithi097.stderr: -451> 2024-09-14T11:05:09.361+0000 7f978ef46800 1 build_initial for_mkfs: 0 2024-09-14T11:05:09.653 INFO:tasks.workunit.client.0.smithi097.stderr: -450> 2024-09-14T11:05:09.362+0000 7f978ef46800 10 monclient: monmap: 2024-09-14T11:05:09.653 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:05:09.653 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:05:09.653 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:05:09.653 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:05:09.653 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:05:09.653 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:05:09.653 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:05:09.653 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:05:09.653 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:05:09.653 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:09.653 INFO:tasks.workunit.client.0.smithi097.stderr: -449> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a21e0) adding auth protocol: cephx 2024-09-14T11:05:09.654 INFO:tasks.workunit.client.0.smithi097.stderr: -448> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a21e0) adding auth protocol: cephx 2024-09-14T11:05:09.654 INFO:tasks.workunit.client.0.smithi097.stderr: -447> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a21e0) adding auth protocol: cephx 2024-09-14T11:05:09.654 INFO:tasks.workunit.client.0.smithi097.stderr: -446> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a21e0) adding con mode: secure 2024-09-14T11:05:09.654 INFO:tasks.workunit.client.0.smithi097.stderr: -445> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a21e0) adding con mode: crc 2024-09-14T11:05:09.654 INFO:tasks.workunit.client.0.smithi097.stderr: -444> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a21e0) adding con mode: secure 2024-09-14T11:05:09.654 INFO:tasks.workunit.client.0.smithi097.stderr: -443> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a21e0) adding con mode: crc 2024-09-14T11:05:09.654 INFO:tasks.workunit.client.0.smithi097.stderr: -442> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a21e0) adding con mode: secure 2024-09-14T11:05:09.654 INFO:tasks.workunit.client.0.smithi097.stderr: -441> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a21e0) adding con mode: crc 2024-09-14T11:05:09.654 INFO:tasks.workunit.client.0.smithi097.stderr: -440> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a21e0) adding con mode: crc 2024-09-14T11:05:09.654 INFO:tasks.workunit.client.0.smithi097.stderr: -439> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a21e0) adding con mode: secure 2024-09-14T11:05:09.654 INFO:tasks.workunit.client.0.smithi097.stderr: -438> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a21e0) adding con mode: crc 2024-09-14T11:05:09.654 INFO:tasks.workunit.client.0.smithi097.stderr: -437> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a21e0) adding con mode: secure 2024-09-14T11:05:09.654 INFO:tasks.workunit.client.0.smithi097.stderr: -436> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a21e0) adding con mode: crc 2024-09-14T11:05:09.655 INFO:tasks.workunit.client.0.smithi097.stderr: -435> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a21e0) adding con mode: secure 2024-09-14T11:05:09.655 INFO:tasks.workunit.client.0.smithi097.stderr: -434> 2024-09-14T11:05:09.362+0000 7f978ef46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:05:09.655 INFO:tasks.workunit.client.0.smithi097.stderr: -433> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 asok(0x55ec7022a270) register_command objecter_requests cmddesc objecter_requests hook 0x55ec704a5bd0 EEXIST 2024-09-14T11:05:09.655 INFO:tasks.workunit.client.0.smithi097.stderr: -432> 2024-09-14T11:05:09.362+0000 7f978ef46800 10 monclient: init 2024-09-14T11:05:09.655 INFO:tasks.workunit.client.0.smithi097.stderr: -431> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a10d8) adding auth protocol: cephx 2024-09-14T11:05:09.655 INFO:tasks.workunit.client.0.smithi097.stderr: -430> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a10d8) adding auth protocol: cephx 2024-09-14T11:05:09.655 INFO:tasks.workunit.client.0.smithi097.stderr: -429> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a10d8) adding auth protocol: cephx 2024-09-14T11:05:09.655 INFO:tasks.workunit.client.0.smithi097.stderr: -428> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a10d8) adding con mode: secure 2024-09-14T11:05:09.655 INFO:tasks.workunit.client.0.smithi097.stderr: -427> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a10d8) adding con mode: crc 2024-09-14T11:05:09.655 INFO:tasks.workunit.client.0.smithi097.stderr: -426> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a10d8) adding con mode: secure 2024-09-14T11:05:09.655 INFO:tasks.workunit.client.0.smithi097.stderr: -425> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a10d8) adding con mode: crc 2024-09-14T11:05:09.655 INFO:tasks.workunit.client.0.smithi097.stderr: -424> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a10d8) adding con mode: secure 2024-09-14T11:05:09.655 INFO:tasks.workunit.client.0.smithi097.stderr: -423> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a10d8) adding con mode: crc 2024-09-14T11:05:09.655 INFO:tasks.workunit.client.0.smithi097.stderr: -422> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a10d8) adding con mode: crc 2024-09-14T11:05:09.656 INFO:tasks.workunit.client.0.smithi097.stderr: -421> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a10d8) adding con mode: secure 2024-09-14T11:05:09.656 INFO:tasks.workunit.client.0.smithi097.stderr: -420> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a10d8) adding con mode: crc 2024-09-14T11:05:09.656 INFO:tasks.workunit.client.0.smithi097.stderr: -419> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a10d8) adding con mode: secure 2024-09-14T11:05:09.656 INFO:tasks.workunit.client.0.smithi097.stderr: -418> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a10d8) adding con mode: crc 2024-09-14T11:05:09.656 INFO:tasks.workunit.client.0.smithi097.stderr: -417> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a10d8) adding con mode: secure 2024-09-14T11:05:09.656 INFO:tasks.workunit.client.0.smithi097.stderr: -416> 2024-09-14T11:05:09.362+0000 7f978ef46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:05:09.656 INFO:tasks.workunit.client.0.smithi097.stderr: -415> 2024-09-14T11:05:09.362+0000 7f978ef46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:05:09.656 INFO:tasks.workunit.client.0.smithi097.stderr: -414> 2024-09-14T11:05:09.363+0000 7f978ef46800 5 asok(0x55ec7022a270) register_command rotate-key cmddesc rotate-key hook 0x55ec704a1220 EEXIST 2024-09-14T11:05:09.656 INFO:tasks.workunit.client.0.smithi097.stderr: -413> 2024-09-14T11:05:09.363+0000 7f978ef46800 10 monclient: _reopen_session rank -1 2024-09-14T11:05:09.656 INFO:tasks.workunit.client.0.smithi097.stderr: -412> 2024-09-14T11:05:09.363+0000 7f978ef46800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:05:09.656 INFO:tasks.workunit.client.0.smithi097.stderr: -411> 2024-09-14T11:05:09.363+0000 7f978ef46800 10 monclient(hunting): picked mon.noname-a con 0x55ec704c98c0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:05:09.656 INFO:tasks.workunit.client.0.smithi097.stderr: -410> 2024-09-14T11:05:09.363+0000 7f978ef46800 10 monclient(hunting): picked mon.noname-b con 0x55ec704cbb90 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:05:09.656 INFO:tasks.workunit.client.0.smithi097.stderr: -409> 2024-09-14T11:05:09.363+0000 7f978ef46800 10 monclient(hunting): picked mon.noname-c con 0x55ec704c8090 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:05:09.657 INFO:tasks.workunit.client.0.smithi097.stderr: -408> 2024-09-14T11:05:09.363+0000 7f978ef46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:05:09.657 INFO:tasks.workunit.client.0.smithi097.stderr: -407> 2024-09-14T11:05:09.363+0000 7f978ef46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:05:09.657 INFO:tasks.workunit.client.0.smithi097.stderr: -406> 2024-09-14T11:05:09.363+0000 7f978ef46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:05:09.657 INFO:tasks.workunit.client.0.smithi097.stderr: -405> 2024-09-14T11:05:09.363+0000 7f978ef46800 10 monclient(hunting): _renew_subs 2024-09-14T11:05:09.657 INFO:tasks.workunit.client.0.smithi097.stderr: -404> 2024-09-14T11:05:09.363+0000 7f978ef46800 10 monclient(hunting): authenticate will time out at 1991.016098s 2024-09-14T11:05:09.657 INFO:tasks.workunit.client.0.smithi097.stderr: -403> 2024-09-14T11:05:09.363+0000 7f9784236640 10 monclient(hunting): get_auth_request con 0x55ec704c98c0 auth_method 0 2024-09-14T11:05:09.657 INFO:tasks.workunit.client.0.smithi097.stderr: -402> 2024-09-14T11:05:09.363+0000 7f9784236640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:05:09.657 INFO:tasks.workunit.client.0.smithi097.stderr: -401> 2024-09-14T11:05:09.363+0000 7f9784236640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:05:09.657 INFO:tasks.workunit.client.0.smithi097.stderr: -400> 2024-09-14T11:05:09.363+0000 7f9784236640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:05:09.657 INFO:tasks.workunit.client.0.smithi097.stderr: -399> 2024-09-14T11:05:09.363+0000 7f978ca37640 10 monclient(hunting): get_auth_request con 0x55ec704c8090 auth_method 0 2024-09-14T11:05:09.657 INFO:tasks.workunit.client.0.smithi097.stderr: -398> 2024-09-14T11:05:09.363+0000 7f978ca37640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:05:09.657 INFO:tasks.workunit.client.0.smithi097.stderr: -397> 2024-09-14T11:05:09.363+0000 7f978ca37640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:05:09.657 INFO:tasks.workunit.client.0.smithi097.stderr: -396> 2024-09-14T11:05:09.363+0000 7f978ca37640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:05:09.658 INFO:tasks.workunit.client.0.smithi097.stderr: -395> 2024-09-14T11:05:09.363+0000 7f978d238640 10 monclient(hunting): get_auth_request con 0x55ec704cbb90 auth_method 0 2024-09-14T11:05:09.658 INFO:tasks.workunit.client.0.smithi097.stderr: -394> 2024-09-14T11:05:09.363+0000 7f978d238640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:05:09.658 INFO:tasks.workunit.client.0.smithi097.stderr: -393> 2024-09-14T11:05:09.363+0000 7f978d238640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:05:09.658 INFO:tasks.workunit.client.0.smithi097.stderr: -392> 2024-09-14T11:05:09.363+0000 7f978d238640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:05:09.658 INFO:tasks.workunit.client.0.smithi097.stderr: -391> 2024-09-14T11:05:09.363+0000 7f978ca37640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:05:09.658 INFO:tasks.workunit.client.0.smithi097.stderr: -390> 2024-09-14T11:05:09.363+0000 7f978ca37640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:05:09.658 INFO:tasks.workunit.client.0.smithi097.stderr: -389> 2024-09-14T11:05:09.363+0000 7f978ca37640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:05:09.658 INFO:tasks.workunit.client.0.smithi097.stderr: -388> 2024-09-14T11:05:09.363+0000 7f9784236640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:05:09.658 INFO:tasks.workunit.client.0.smithi097.stderr: -387> 2024-09-14T11:05:09.363+0000 7f9784236640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:05:09.658 INFO:tasks.workunit.client.0.smithi097.stderr: -386> 2024-09-14T11:05:09.363+0000 7f9784236640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:05:09.658 INFO:tasks.workunit.client.0.smithi097.stderr: -385> 2024-09-14T11:05:09.363+0000 7f978d238640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:05:09.658 INFO:tasks.workunit.client.0.smithi097.stderr: -384> 2024-09-14T11:05:09.363+0000 7f978d238640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:05:09.658 INFO:tasks.workunit.client.0.smithi097.stderr: -383> 2024-09-14T11:05:09.363+0000 7f978d238640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:05:09.659 INFO:tasks.workunit.client.0.smithi097.stderr: -382> 2024-09-14T11:05:09.363+0000 7f978ca37640 10 monclient(hunting): handle_auth_done global_id 6944 payload 824 2024-09-14T11:05:09.659 INFO:tasks.workunit.client.0.smithi097.stderr: -381> 2024-09-14T11:05:09.363+0000 7f978ca37640 10 monclient: _finish_hunting 0 2024-09-14T11:05:09.659 INFO:tasks.workunit.client.0.smithi097.stderr: -380> 2024-09-14T11:05:09.363+0000 7f978ca37640 1 monclient: found mon.noname-c 2024-09-14T11:05:09.659 INFO:tasks.workunit.client.0.smithi097.stderr: -379> 2024-09-14T11:05:09.363+0000 7f978ca37640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:05:09.659 INFO:tasks.workunit.client.0.smithi097.stderr: -378> 2024-09-14T11:05:09.363+0000 7f96727fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:05:09.659 INFO:tasks.workunit.client.0.smithi097.stderr: -377> 2024-09-14T11:05:09.363+0000 7f96727fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:05:09.659 INFO:tasks.workunit.client.0.smithi097.stderr: -376> 2024-09-14T11:05:09.363+0000 7f96727fc640 10 monclient: dump: 2024-09-14T11:05:09.659 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:05:09.659 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:05:09.659 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:09.659 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:09.659 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:05:09.659 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:05:09.659 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:05:09.660 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:05:09.660 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:05:09.660 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:09.660 INFO:tasks.workunit.client.0.smithi097.stderr: -375> 2024-09-14T11:05:09.363+0000 7f96727fc640 10 monclient: _finish_auth 0 2024-09-14T11:05:09.660 INFO:tasks.workunit.client.0.smithi097.stderr: -374> 2024-09-14T11:05:09.363+0000 7f96727fc640 10 monclient: _check_auth_tickets 2024-09-14T11:05:09.660 INFO:tasks.workunit.client.0.smithi097.stderr: -373> 2024-09-14T11:05:09.363+0000 7f96727fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:05:09.660 INFO:tasks.workunit.client.0.smithi097.stderr: -372> 2024-09-14T11:05:09.363+0000 7f96727fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:05:09.660 INFO:tasks.workunit.client.0.smithi097.stderr: -371> 2024-09-14T11:05:09.363+0000 7f96727fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:05:09.660 INFO:tasks.workunit.client.0.smithi097.stderr: -370> 2024-09-14T11:05:09.363+0000 7f96727fc640 10 monclient: dump: 2024-09-14T11:05:09.660 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:05:09.660 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:05:09.660 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:09.660 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:09.661 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:05:09.661 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:05:09.661 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:05:09.661 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:05:09.661 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:05:09.661 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:09.661 INFO:tasks.workunit.client.0.smithi097.stderr: -369> 2024-09-14T11:05:09.363+0000 7f978ef46800 5 monclient: authenticate success, global_id 6944 2024-09-14T11:05:09.661 INFO:tasks.workunit.client.0.smithi097.stderr: -368> 2024-09-14T11:05:09.363+0000 7f978ef46800 10 monclient: _renew_subs 2024-09-14T11:05:09.661 INFO:tasks.workunit.client.0.smithi097.stderr: -367> 2024-09-14T11:05:09.363+0000 7f978ef46800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:05:09.661 INFO:tasks.workunit.client.0.smithi097.stderr: -366> 2024-09-14T11:05:09.363+0000 7f978da39640 4 set_mon_vals no callback set 2024-09-14T11:05:09.661 INFO:tasks.workunit.client.0.smithi097.stderr: -365> 2024-09-14T11:05:09.363+0000 7f978ef46800 10 monclient: _renew_subs 2024-09-14T11:05:09.661 INFO:tasks.workunit.client.0.smithi097.stderr: -364> 2024-09-14T11:05:09.363+0000 7f978ef46800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:05:09.662 INFO:tasks.workunit.client.0.smithi097.stderr: -363> 2024-09-14T11:05:09.365+0000 7f96727fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:05:09.662 INFO:tasks.workunit.client.0.smithi097.stderr: -362> 2024-09-14T11:05:09.365+0000 7f96727fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:05:09.662 INFO:tasks.workunit.client.0.smithi097.stderr: -361> 2024-09-14T11:05:09.365+0000 7f96727fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:05:09.662 INFO:tasks.workunit.client.0.smithi097.stderr: -360> 2024-09-14T11:05:09.365+0000 7f9784236640 10 monclient: get_auth_request con 0x7f9664077140 auth_method 0 2024-09-14T11:05:09.662 INFO:tasks.workunit.client.0.smithi097.stderr: -359> 2024-09-14T11:05:09.365+0000 7f978ef46800 10 monclient: get_monmap_and_config 2024-09-14T11:05:09.662 INFO:tasks.workunit.client.0.smithi097.stderr: -358> 2024-09-14T11:05:09.365+0000 7f978ef46800 10 monclient: build_initial_monmap 2024-09-14T11:05:09.662 INFO:tasks.workunit.client.0.smithi097.stderr: -357> 2024-09-14T11:05:09.365+0000 7f978ef46800 1 build_initial for_mkfs: 0 2024-09-14T11:05:09.662 INFO:tasks.workunit.client.0.smithi097.stderr: -356> 2024-09-14T11:05:09.365+0000 7f978ef46800 10 monclient: monmap: 2024-09-14T11:05:09.662 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:05:09.662 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:05:09.662 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:05:09.662 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:05:09.662 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:05:09.662 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:05:09.663 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:05:09.663 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:05:09.663 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:05:09.663 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:09.663 INFO:tasks.workunit.client.0.smithi097.stderr: -355> 2024-09-14T11:05:09.365+0000 7f978ef46800 5 AuthRegistry(0x55ec704e9700) adding auth protocol: cephx 2024-09-14T11:05:09.663 INFO:tasks.workunit.client.0.smithi097.stderr: -354> 2024-09-14T11:05:09.365+0000 7f978ef46800 5 AuthRegistry(0x55ec704e9700) adding auth protocol: cephx 2024-09-14T11:05:09.663 INFO:tasks.workunit.client.0.smithi097.stderr: -353> 2024-09-14T11:05:09.365+0000 7f978ef46800 5 AuthRegistry(0x55ec704e9700) adding auth protocol: cephx 2024-09-14T11:05:09.663 INFO:tasks.workunit.client.0.smithi097.stderr: -352> 2024-09-14T11:05:09.365+0000 7f978ef46800 5 AuthRegistry(0x55ec704e9700) adding con mode: secure 2024-09-14T11:05:09.663 INFO:tasks.workunit.client.0.smithi097.stderr: -351> 2024-09-14T11:05:09.365+0000 7f978ef46800 5 AuthRegistry(0x55ec704e9700) adding con mode: crc 2024-09-14T11:05:09.663 INFO:tasks.workunit.client.0.smithi097.stderr: -350> 2024-09-14T11:05:09.365+0000 7f978ef46800 5 AuthRegistry(0x55ec704e9700) adding con mode: secure 2024-09-14T11:05:09.663 INFO:tasks.workunit.client.0.smithi097.stderr: -349> 2024-09-14T11:05:09.365+0000 7f978ef46800 5 AuthRegistry(0x55ec704e9700) adding con mode: crc 2024-09-14T11:05:09.663 INFO:tasks.workunit.client.0.smithi097.stderr: -348> 2024-09-14T11:05:09.365+0000 7f978ef46800 5 AuthRegistry(0x55ec704e9700) adding con mode: secure 2024-09-14T11:05:09.663 INFO:tasks.workunit.client.0.smithi097.stderr: -347> 2024-09-14T11:05:09.365+0000 7f978ef46800 5 AuthRegistry(0x55ec704e9700) adding con mode: crc 2024-09-14T11:05:09.663 INFO:tasks.workunit.client.0.smithi097.stderr: -346> 2024-09-14T11:05:09.365+0000 7f978ef46800 5 AuthRegistry(0x55ec704e9700) adding con mode: crc 2024-09-14T11:05:09.663 INFO:tasks.workunit.client.0.smithi097.stderr: -345> 2024-09-14T11:05:09.365+0000 7f978ef46800 5 AuthRegistry(0x55ec704e9700) adding con mode: secure 2024-09-14T11:05:09.664 INFO:tasks.workunit.client.0.smithi097.stderr: -344> 2024-09-14T11:05:09.365+0000 7f978ef46800 5 AuthRegistry(0x55ec704e9700) adding con mode: crc 2024-09-14T11:05:09.664 INFO:tasks.workunit.client.0.smithi097.stderr: -343> 2024-09-14T11:05:09.365+0000 7f978ef46800 5 AuthRegistry(0x55ec704e9700) adding con mode: secure 2024-09-14T11:05:09.664 INFO:tasks.workunit.client.0.smithi097.stderr: -342> 2024-09-14T11:05:09.365+0000 7f978ef46800 5 AuthRegistry(0x55ec704e9700) adding con mode: crc 2024-09-14T11:05:09.664 INFO:tasks.workunit.client.0.smithi097.stderr: -341> 2024-09-14T11:05:09.365+0000 7f978ef46800 5 AuthRegistry(0x55ec704e9700) adding con mode: secure 2024-09-14T11:05:09.664 INFO:tasks.workunit.client.0.smithi097.stderr: -340> 2024-09-14T11:05:09.366+0000 7f978ef46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:05:09.664 INFO:tasks.workunit.client.0.smithi097.stderr: -339> 2024-09-14T11:05:09.366+0000 7f978ef46800 10 monclient: init 2024-09-14T11:05:09.664 INFO:tasks.workunit.client.0.smithi097.stderr: -338> 2024-09-14T11:05:09.366+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22380) adding auth protocol: cephx 2024-09-14T11:05:09.664 INFO:tasks.workunit.client.0.smithi097.stderr: -337> 2024-09-14T11:05:09.366+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22380) adding auth protocol: cephx 2024-09-14T11:05:09.664 INFO:tasks.workunit.client.0.smithi097.stderr: -336> 2024-09-14T11:05:09.366+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22380) adding auth protocol: cephx 2024-09-14T11:05:09.664 INFO:tasks.workunit.client.0.smithi097.stderr: -335> 2024-09-14T11:05:09.366+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22380) adding con mode: secure 2024-09-14T11:05:09.664 INFO:tasks.workunit.client.0.smithi097.stderr: -334> 2024-09-14T11:05:09.366+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22380) adding con mode: crc 2024-09-14T11:05:09.664 INFO:tasks.workunit.client.0.smithi097.stderr: -333> 2024-09-14T11:05:09.366+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22380) adding con mode: secure 2024-09-14T11:05:09.664 INFO:tasks.workunit.client.0.smithi097.stderr: -332> 2024-09-14T11:05:09.366+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22380) adding con mode: crc 2024-09-14T11:05:09.664 INFO:tasks.workunit.client.0.smithi097.stderr: -331> 2024-09-14T11:05:09.366+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22380) adding con mode: secure 2024-09-14T11:05:09.665 INFO:tasks.workunit.client.0.smithi097.stderr: -330> 2024-09-14T11:05:09.366+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22380) adding con mode: crc 2024-09-14T11:05:09.665 INFO:tasks.workunit.client.0.smithi097.stderr: -329> 2024-09-14T11:05:09.366+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22380) adding con mode: crc 2024-09-14T11:05:09.665 INFO:tasks.workunit.client.0.smithi097.stderr: -328> 2024-09-14T11:05:09.366+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22380) adding con mode: secure 2024-09-14T11:05:09.665 INFO:tasks.workunit.client.0.smithi097.stderr: -327> 2024-09-14T11:05:09.366+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22380) adding con mode: crc 2024-09-14T11:05:09.665 INFO:tasks.workunit.client.0.smithi097.stderr: -326> 2024-09-14T11:05:09.366+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22380) adding con mode: secure 2024-09-14T11:05:09.665 INFO:tasks.workunit.client.0.smithi097.stderr: -325> 2024-09-14T11:05:09.366+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22380) adding con mode: crc 2024-09-14T11:05:09.665 INFO:tasks.workunit.client.0.smithi097.stderr: -324> 2024-09-14T11:05:09.366+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22380) adding con mode: secure 2024-09-14T11:05:09.665 INFO:tasks.workunit.client.0.smithi097.stderr: -323> 2024-09-14T11:05:09.366+0000 7f978ef46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:05:09.665 INFO:tasks.workunit.client.0.smithi097.stderr: -322> 2024-09-14T11:05:09.366+0000 7f978ef46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:05:09.665 INFO:tasks.workunit.client.0.smithi097.stderr: -321> 2024-09-14T11:05:09.366+0000 7f978ef46800 5 asok(0x55ec7022a270) register_command rotate-key cmddesc rotate-key hook 0x7ffcb0b224c8 EEXIST 2024-09-14T11:05:09.665 INFO:tasks.workunit.client.0.smithi097.stderr: -320> 2024-09-14T11:05:09.366+0000 7f978ef46800 10 monclient: _reopen_session rank -1 2024-09-14T11:05:09.665 INFO:tasks.workunit.client.0.smithi097.stderr: -319> 2024-09-14T11:05:09.366+0000 7f978ef46800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:05:09.665 INFO:tasks.workunit.client.0.smithi097.stderr: -318> 2024-09-14T11:05:09.366+0000 7f978ef46800 10 monclient(hunting): picked mon.noname-a con 0x55ec7051dde0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:05:09.665 INFO:tasks.workunit.client.0.smithi097.stderr: -317> 2024-09-14T11:05:09.366+0000 7f978ef46800 10 monclient(hunting): picked mon.noname-c con 0x55ec704edbf0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:05:09.666 INFO:tasks.workunit.client.0.smithi097.stderr: -316> 2024-09-14T11:05:09.366+0000 7f978ef46800 10 monclient(hunting): picked mon.noname-b con 0x55ec705191a0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:05:09.666 INFO:tasks.workunit.client.0.smithi097.stderr: -315> 2024-09-14T11:05:09.366+0000 7f978ef46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:05:09.666 INFO:tasks.workunit.client.0.smithi097.stderr: -314> 2024-09-14T11:05:09.366+0000 7f978ef46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:05:09.666 INFO:tasks.workunit.client.0.smithi097.stderr: -313> 2024-09-14T11:05:09.366+0000 7f978ef46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:05:09.666 INFO:tasks.workunit.client.0.smithi097.stderr: -312> 2024-09-14T11:05:09.366+0000 7f978ef46800 10 monclient(hunting): _renew_subs 2024-09-14T11:05:09.666 INFO:tasks.workunit.client.0.smithi097.stderr: -311> 2024-09-14T11:05:09.366+0000 7f978ef46800 10 monclient(hunting): authenticate will time out at 1991.019661s 2024-09-14T11:05:09.666 INFO:tasks.workunit.client.0.smithi097.stderr: -310> 2024-09-14T11:05:09.366+0000 7f9784236640 10 monclient(hunting): get_auth_request con 0x55ec7051dde0 auth_method 0 2024-09-14T11:05:09.666 INFO:tasks.workunit.client.0.smithi097.stderr: -309> 2024-09-14T11:05:09.366+0000 7f9784236640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:05:09.666 INFO:tasks.workunit.client.0.smithi097.stderr: -308> 2024-09-14T11:05:09.366+0000 7f9784236640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:05:09.666 INFO:tasks.workunit.client.0.smithi097.stderr: -307> 2024-09-14T11:05:09.366+0000 7f9784236640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:05:09.666 INFO:tasks.workunit.client.0.smithi097.stderr: -306> 2024-09-14T11:05:09.366+0000 7f978d238640 10 monclient(hunting): get_auth_request con 0x55ec704edbf0 auth_method 0 2024-09-14T11:05:09.666 INFO:tasks.workunit.client.0.smithi097.stderr: -305> 2024-09-14T11:05:09.366+0000 7f978d238640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:05:09.666 INFO:tasks.workunit.client.0.smithi097.stderr: -304> 2024-09-14T11:05:09.366+0000 7f978d238640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:05:09.666 INFO:tasks.workunit.client.0.smithi097.stderr: -303> 2024-09-14T11:05:09.366+0000 7f978d238640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:05:09.666 INFO:tasks.workunit.client.0.smithi097.stderr: -302> 2024-09-14T11:05:09.366+0000 7f9784236640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:05:09.667 INFO:tasks.workunit.client.0.smithi097.stderr: -301> 2024-09-14T11:05:09.366+0000 7f9784236640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:05:09.667 INFO:tasks.workunit.client.0.smithi097.stderr: -300> 2024-09-14T11:05:09.366+0000 7f9784236640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:05:09.667 INFO:tasks.workunit.client.0.smithi097.stderr: -299> 2024-09-14T11:05:09.366+0000 7f978d238640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:05:09.667 INFO:tasks.workunit.client.0.smithi097.stderr: -298> 2024-09-14T11:05:09.366+0000 7f978d238640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:05:09.667 INFO:tasks.workunit.client.0.smithi097.stderr: -297> 2024-09-14T11:05:09.366+0000 7f978d238640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:05:09.667 INFO:tasks.workunit.client.0.smithi097.stderr: -296> 2024-09-14T11:05:09.366+0000 7f9784236640 10 monclient(hunting): handle_auth_done global_id 7371 payload 274 2024-09-14T11:05:09.667 INFO:tasks.workunit.client.0.smithi097.stderr: -295> 2024-09-14T11:05:09.366+0000 7f9784236640 10 monclient: _finish_hunting 0 2024-09-14T11:05:09.667 INFO:tasks.workunit.client.0.smithi097.stderr: -294> 2024-09-14T11:05:09.366+0000 7f9784236640 1 monclient: found mon.noname-a 2024-09-14T11:05:09.667 INFO:tasks.workunit.client.0.smithi097.stderr: -293> 2024-09-14T11:05:09.366+0000 7f9784236640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-14T11:05:09.667 INFO:tasks.workunit.client.0.smithi097.stderr: -292> 2024-09-14T11:05:09.367+0000 7f9663fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:05:09.667 INFO:tasks.workunit.client.0.smithi097.stderr: -291> 2024-09-14T11:05:09.367+0000 7f9663fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:05:09.667 INFO:tasks.workunit.client.0.smithi097.stderr: -290> 2024-09-14T11:05:09.367+0000 7f9663fff640 10 monclient: dump: 2024-09-14T11:05:09.667 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:05:09.668 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:05:09.668 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:09.668 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:09.668 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:05:09.668 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:05:09.668 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:05:09.668 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:05:09.668 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:05:09.668 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:09.668 INFO:tasks.workunit.client.0.smithi097.stderr: -289> 2024-09-14T11:05:09.367+0000 7f9663fff640 10 monclient: _finish_auth 0 2024-09-14T11:05:09.668 INFO:tasks.workunit.client.0.smithi097.stderr: -288> 2024-09-14T11:05:09.367+0000 7f9663fff640 10 monclient: _check_auth_tickets 2024-09-14T11:05:09.668 INFO:tasks.workunit.client.0.smithi097.stderr: -287> 2024-09-14T11:05:09.367+0000 7f9663fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:05:09.668 INFO:tasks.workunit.client.0.smithi097.stderr: -286> 2024-09-14T11:05:09.367+0000 7f978ef46800 5 monclient: authenticate success, global_id 7371 2024-09-14T11:05:09.668 INFO:tasks.workunit.client.0.smithi097.stderr: -285> 2024-09-14T11:05:09.367+0000 7f978ef46800 10 monclient: get_monmap_and_config success 2024-09-14T11:05:09.669 INFO:tasks.workunit.client.0.smithi097.stderr: -284> 2024-09-14T11:05:09.367+0000 7f978ef46800 4 set_mon_vals no callback set 2024-09-14T11:05:09.669 INFO:tasks.workunit.client.0.smithi097.stderr: -283> 2024-09-14T11:05:09.367+0000 7f9663fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:05:09.669 INFO:tasks.workunit.client.0.smithi097.stderr: -282> 2024-09-14T11:05:09.367+0000 7f9663fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:05:09.669 INFO:tasks.workunit.client.0.smithi097.stderr: -281> 2024-09-14T11:05:09.367+0000 7f9663fff640 10 monclient: dump: 2024-09-14T11:05:09.669 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:05:09.669 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:05:09.669 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:09.669 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:09.669 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:05:09.669 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:05:09.669 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:05:09.669 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:05:09.669 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:05:09.670 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:09.670 INFO:tasks.workunit.client.0.smithi097.stderr: -280> 2024-09-14T11:05:09.367+0000 7f978ef46800 10 monclient: shutdown 2024-09-14T11:05:09.670 INFO:tasks.workunit.client.0.smithi097.stderr: -279> 2024-09-14T11:05:09.367+0000 7f978ef46800 10 monclient: build_initial_monmap 2024-09-14T11:05:09.670 INFO:tasks.workunit.client.0.smithi097.stderr: -278> 2024-09-14T11:05:09.367+0000 7f978ef46800 1 build_initial for_mkfs: 0 2024-09-14T11:05:09.670 INFO:tasks.workunit.client.0.smithi097.stderr: -277> 2024-09-14T11:05:09.367+0000 7f978ef46800 10 monclient: monmap: 2024-09-14T11:05:09.670 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:05:09.670 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:05:09.670 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:05:09.670 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:05:09.670 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:05:09.670 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:05:09.670 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:05:09.670 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:05:09.670 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:05:09.671 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:09.671 INFO:tasks.workunit.client.0.smithi097.stderr: -276> 2024-09-14T11:05:09.367+0000 7f978ef46800 5 AuthRegistry(0x55ec704eea30) adding auth protocol: cephx 2024-09-14T11:05:09.671 INFO:tasks.workunit.client.0.smithi097.stderr: -275> 2024-09-14T11:05:09.367+0000 7f978ef46800 5 AuthRegistry(0x55ec704eea30) adding auth protocol: cephx 2024-09-14T11:05:09.671 INFO:tasks.workunit.client.0.smithi097.stderr: -274> 2024-09-14T11:05:09.367+0000 7f978ef46800 5 AuthRegistry(0x55ec704eea30) adding auth protocol: cephx 2024-09-14T11:05:09.671 INFO:tasks.workunit.client.0.smithi097.stderr: -273> 2024-09-14T11:05:09.367+0000 7f978ef46800 5 AuthRegistry(0x55ec704eea30) adding con mode: secure 2024-09-14T11:05:09.671 INFO:tasks.workunit.client.0.smithi097.stderr: -272> 2024-09-14T11:05:09.367+0000 7f978ef46800 5 AuthRegistry(0x55ec704eea30) adding con mode: crc 2024-09-14T11:05:09.671 INFO:tasks.workunit.client.0.smithi097.stderr: -271> 2024-09-14T11:05:09.367+0000 7f978ef46800 5 AuthRegistry(0x55ec704eea30) adding con mode: secure 2024-09-14T11:05:09.671 INFO:tasks.workunit.client.0.smithi097.stderr: -270> 2024-09-14T11:05:09.367+0000 7f978ef46800 5 AuthRegistry(0x55ec704eea30) adding con mode: crc 2024-09-14T11:05:09.671 INFO:tasks.workunit.client.0.smithi097.stderr: -269> 2024-09-14T11:05:09.367+0000 7f978ef46800 5 AuthRegistry(0x55ec704eea30) adding con mode: secure 2024-09-14T11:05:09.671 INFO:tasks.workunit.client.0.smithi097.stderr: -268> 2024-09-14T11:05:09.367+0000 7f978ef46800 5 AuthRegistry(0x55ec704eea30) adding con mode: crc 2024-09-14T11:05:09.671 INFO:tasks.workunit.client.0.smithi097.stderr: -267> 2024-09-14T11:05:09.367+0000 7f978ef46800 5 AuthRegistry(0x55ec704eea30) adding con mode: crc 2024-09-14T11:05:09.671 INFO:tasks.workunit.client.0.smithi097.stderr: -266> 2024-09-14T11:05:09.367+0000 7f978ef46800 5 AuthRegistry(0x55ec704eea30) adding con mode: secure 2024-09-14T11:05:09.671 INFO:tasks.workunit.client.0.smithi097.stderr: -265> 2024-09-14T11:05:09.367+0000 7f978ef46800 5 AuthRegistry(0x55ec704eea30) adding con mode: crc 2024-09-14T11:05:09.671 INFO:tasks.workunit.client.0.smithi097.stderr: -264> 2024-09-14T11:05:09.367+0000 7f978ef46800 5 AuthRegistry(0x55ec704eea30) adding con mode: secure 2024-09-14T11:05:09.672 INFO:tasks.workunit.client.0.smithi097.stderr: -263> 2024-09-14T11:05:09.367+0000 7f978ef46800 5 AuthRegistry(0x55ec704eea30) adding con mode: crc 2024-09-14T11:05:09.672 INFO:tasks.workunit.client.0.smithi097.stderr: -262> 2024-09-14T11:05:09.367+0000 7f978ef46800 5 AuthRegistry(0x55ec704eea30) adding con mode: secure 2024-09-14T11:05:09.672 INFO:tasks.workunit.client.0.smithi097.stderr: -261> 2024-09-14T11:05:09.368+0000 7f978ef46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:05:09.672 INFO:tasks.workunit.client.0.smithi097.stderr: -260> 2024-09-14T11:05:09.368+0000 7f978ef46800 1 librados: starting msgr at 2024-09-14T11:05:09.672 INFO:tasks.workunit.client.0.smithi097.stderr: -259> 2024-09-14T11:05:09.368+0000 7f978ef46800 1 librados: starting objecter 2024-09-14T11:05:09.672 INFO:tasks.workunit.client.0.smithi097.stderr: -258> 2024-09-14T11:05:09.368+0000 7f978ef46800 5 asok(0x55ec7022a270) register_command objecter_requests cmddesc objecter_requests hook 0x55ec704ec010 EEXIST 2024-09-14T11:05:09.672 INFO:tasks.workunit.client.0.smithi097.stderr: -257> 2024-09-14T11:05:09.368+0000 7f978ef46800 1 librados: setting wanted keys 2024-09-14T11:05:09.672 INFO:tasks.workunit.client.0.smithi097.stderr: -256> 2024-09-14T11:05:09.368+0000 7f978ef46800 1 librados: calling monclient init 2024-09-14T11:05:09.672 INFO:tasks.workunit.client.0.smithi097.stderr: -255> 2024-09-14T11:05:09.368+0000 7f978ef46800 10 monclient: init 2024-09-14T11:05:09.672 INFO:tasks.workunit.client.0.smithi097.stderr: -254> 2024-09-14T11:05:09.368+0000 7f978ef46800 5 AuthRegistry(0x55ec704e1670) adding auth protocol: cephx 2024-09-14T11:05:09.672 INFO:tasks.workunit.client.0.smithi097.stderr: -253> 2024-09-14T11:05:09.368+0000 7f978ef46800 5 AuthRegistry(0x55ec704e1670) adding auth protocol: cephx 2024-09-14T11:05:09.672 INFO:tasks.workunit.client.0.smithi097.stderr: -252> 2024-09-14T11:05:09.368+0000 7f978ef46800 5 AuthRegistry(0x55ec704e1670) adding auth protocol: cephx 2024-09-14T11:05:09.672 INFO:tasks.workunit.client.0.smithi097.stderr: -251> 2024-09-14T11:05:09.368+0000 7f978ef46800 5 AuthRegistry(0x55ec704e1670) adding con mode: secure 2024-09-14T11:05:09.673 INFO:tasks.workunit.client.0.smithi097.stderr: -250> 2024-09-14T11:05:09.368+0000 7f978ef46800 5 AuthRegistry(0x55ec704e1670) adding con mode: crc 2024-09-14T11:05:09.673 INFO:tasks.workunit.client.0.smithi097.stderr: -249> 2024-09-14T11:05:09.368+0000 7f978ef46800 5 AuthRegistry(0x55ec704e1670) adding con mode: secure 2024-09-14T11:05:09.673 INFO:tasks.workunit.client.0.smithi097.stderr: -248> 2024-09-14T11:05:09.368+0000 7f978ef46800 5 AuthRegistry(0x55ec704e1670) adding con mode: crc 2024-09-14T11:05:09.673 INFO:tasks.workunit.client.0.smithi097.stderr: -247> 2024-09-14T11:05:09.368+0000 7f978ef46800 5 AuthRegistry(0x55ec704e1670) adding con mode: secure 2024-09-14T11:05:09.673 INFO:tasks.workunit.client.0.smithi097.stderr: -246> 2024-09-14T11:05:09.368+0000 7f978ef46800 5 AuthRegistry(0x55ec704e1670) adding con mode: crc 2024-09-14T11:05:09.673 INFO:tasks.workunit.client.0.smithi097.stderr: -245> 2024-09-14T11:05:09.368+0000 7f978ef46800 5 AuthRegistry(0x55ec704e1670) adding con mode: crc 2024-09-14T11:05:09.673 INFO:tasks.workunit.client.0.smithi097.stderr: -244> 2024-09-14T11:05:09.368+0000 7f978ef46800 5 AuthRegistry(0x55ec704e1670) adding con mode: secure 2024-09-14T11:05:09.673 INFO:tasks.workunit.client.0.smithi097.stderr: -243> 2024-09-14T11:05:09.368+0000 7f978ef46800 5 AuthRegistry(0x55ec704e1670) adding con mode: crc 2024-09-14T11:05:09.673 INFO:tasks.workunit.client.0.smithi097.stderr: -242> 2024-09-14T11:05:09.368+0000 7f978ef46800 5 AuthRegistry(0x55ec704e1670) adding con mode: secure 2024-09-14T11:05:09.673 INFO:tasks.workunit.client.0.smithi097.stderr: -241> 2024-09-14T11:05:09.368+0000 7f978ef46800 5 AuthRegistry(0x55ec704e1670) adding con mode: crc 2024-09-14T11:05:09.673 INFO:tasks.workunit.client.0.smithi097.stderr: -240> 2024-09-14T11:05:09.368+0000 7f978ef46800 5 AuthRegistry(0x55ec704e1670) adding con mode: secure 2024-09-14T11:05:09.673 INFO:tasks.workunit.client.0.smithi097.stderr: -239> 2024-09-14T11:05:09.368+0000 7f978ef46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:05:09.674 INFO:tasks.workunit.client.0.smithi097.stderr: -238> 2024-09-14T11:05:09.368+0000 7f978ef46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:05:09.674 INFO:tasks.workunit.client.0.smithi097.stderr: -237> 2024-09-14T11:05:09.368+0000 7f978ef46800 5 asok(0x55ec7022a270) register_command rotate-key cmddesc rotate-key hook 0x55ec704e17b8 EEXIST 2024-09-14T11:05:09.674 INFO:tasks.workunit.client.0.smithi097.stderr: -236> 2024-09-14T11:05:09.368+0000 7f978ef46800 10 monclient: _reopen_session rank -1 2024-09-14T11:05:09.674 INFO:tasks.workunit.client.0.smithi097.stderr: -235> 2024-09-14T11:05:09.368+0000 7f978ef46800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:05:09.674 INFO:tasks.workunit.client.0.smithi097.stderr: -234> 2024-09-14T11:05:09.368+0000 7f978ef46800 10 monclient(hunting): picked mon.noname-a con 0x55ec704edbf0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:05:09.674 INFO:tasks.workunit.client.0.smithi097.stderr: -233> 2024-09-14T11:05:09.368+0000 7f978ef46800 10 monclient(hunting): picked mon.noname-b con 0x55ec705191a0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:05:09.674 INFO:tasks.workunit.client.0.smithi097.stderr: -232> 2024-09-14T11:05:09.368+0000 7f978ef46800 10 monclient(hunting): picked mon.noname-c con 0x55ec7051dde0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:05:09.674 INFO:tasks.workunit.client.0.smithi097.stderr: -231> 2024-09-14T11:05:09.368+0000 7f978ef46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:05:09.674 INFO:tasks.workunit.client.0.smithi097.stderr: -230> 2024-09-14T11:05:09.368+0000 7f978ef46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:05:09.674 INFO:tasks.workunit.client.0.smithi097.stderr: -229> 2024-09-14T11:05:09.368+0000 7f978ef46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:05:09.674 INFO:tasks.workunit.client.0.smithi097.stderr: -228> 2024-09-14T11:05:09.368+0000 7f978ef46800 10 monclient(hunting): _renew_subs 2024-09-14T11:05:09.674 INFO:tasks.workunit.client.0.smithi097.stderr: -227> 2024-09-14T11:05:09.368+0000 7f978ef46800 10 monclient(hunting): authenticate will time out at 1991.021881s 2024-09-14T11:05:09.674 INFO:tasks.workunit.client.0.smithi097.stderr: -226> 2024-09-14T11:05:09.368+0000 7f9784236640 10 monclient(hunting): get_auth_request con 0x55ec704edbf0 auth_method 0 2024-09-14T11:05:09.674 INFO:tasks.workunit.client.0.smithi097.stderr: -225> 2024-09-14T11:05:09.368+0000 7f9784236640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:05:09.674 INFO:tasks.workunit.client.0.smithi097.stderr: -224> 2024-09-14T11:05:09.368+0000 7f9784236640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:05:09.675 INFO:tasks.workunit.client.0.smithi097.stderr: -223> 2024-09-14T11:05:09.368+0000 7f9784236640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:05:09.675 INFO:tasks.workunit.client.0.smithi097.stderr: -222> 2024-09-14T11:05:09.368+0000 7f978ca37640 10 monclient(hunting): get_auth_request con 0x55ec7051dde0 auth_method 0 2024-09-14T11:05:09.675 INFO:tasks.workunit.client.0.smithi097.stderr: -221> 2024-09-14T11:05:09.368+0000 7f978ca37640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:05:09.675 INFO:tasks.workunit.client.0.smithi097.stderr: -220> 2024-09-14T11:05:09.368+0000 7f978ca37640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:05:09.675 INFO:tasks.workunit.client.0.smithi097.stderr: -219> 2024-09-14T11:05:09.368+0000 7f978ca37640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:05:09.675 INFO:tasks.workunit.client.0.smithi097.stderr: -218> 2024-09-14T11:05:09.369+0000 7f978d238640 10 monclient(hunting): get_auth_request con 0x55ec705191a0 auth_method 0 2024-09-14T11:05:09.675 INFO:tasks.workunit.client.0.smithi097.stderr: -217> 2024-09-14T11:05:09.369+0000 7f978d238640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:05:09.675 INFO:tasks.workunit.client.0.smithi097.stderr: -216> 2024-09-14T11:05:09.369+0000 7f978d238640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:05:09.675 INFO:tasks.workunit.client.0.smithi097.stderr: -215> 2024-09-14T11:05:09.369+0000 7f978d238640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:05:09.675 INFO:tasks.workunit.client.0.smithi097.stderr: -214> 2024-09-14T11:05:09.369+0000 7f9784236640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:05:09.675 INFO:tasks.workunit.client.0.smithi097.stderr: -213> 2024-09-14T11:05:09.369+0000 7f9784236640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:05:09.675 INFO:tasks.workunit.client.0.smithi097.stderr: -212> 2024-09-14T11:05:09.369+0000 7f9784236640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:05:09.676 INFO:tasks.workunit.client.0.smithi097.stderr: -211> 2024-09-14T11:05:09.369+0000 7f978ca37640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:05:09.676 INFO:tasks.workunit.client.0.smithi097.stderr: -210> 2024-09-14T11:05:09.369+0000 7f978ca37640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:05:09.676 INFO:tasks.workunit.client.0.smithi097.stderr: -209> 2024-09-14T11:05:09.369+0000 7f978ca37640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:05:09.676 INFO:tasks.workunit.client.0.smithi097.stderr: -208> 2024-09-14T11:05:09.369+0000 7f978d238640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:05:09.676 INFO:tasks.workunit.client.0.smithi097.stderr: -207> 2024-09-14T11:05:09.369+0000 7f978d238640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:05:09.676 INFO:tasks.workunit.client.0.smithi097.stderr: -206> 2024-09-14T11:05:09.369+0000 7f978d238640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:05:09.676 INFO:tasks.workunit.client.0.smithi097.stderr: -205> 2024-09-14T11:05:09.369+0000 7f9784236640 10 monclient(hunting): handle_auth_done global_id 7374 payload 824 2024-09-14T11:05:09.676 INFO:tasks.workunit.client.0.smithi097.stderr: -204> 2024-09-14T11:05:09.369+0000 7f9784236640 10 monclient: _finish_hunting 0 2024-09-14T11:05:09.676 INFO:tasks.workunit.client.0.smithi097.stderr: -203> 2024-09-14T11:05:09.369+0000 7f9784236640 1 monclient: found mon.noname-a 2024-09-14T11:05:09.676 INFO:tasks.workunit.client.0.smithi097.stderr: -202> 2024-09-14T11:05:09.369+0000 7f9784236640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-14T11:05:09.676 INFO:tasks.workunit.client.0.smithi097.stderr: -201> 2024-09-14T11:05:09.369+0000 7f96627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:05:09.676 INFO:tasks.workunit.client.0.smithi097.stderr: -200> 2024-09-14T11:05:09.369+0000 7f96627fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:05:09.676 INFO:tasks.workunit.client.0.smithi097.stderr: -199> 2024-09-14T11:05:09.369+0000 7f96627fc640 10 monclient: dump: 2024-09-14T11:05:09.676 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:05:09.677 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:05:09.677 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:09.677 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:09.677 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:05:09.677 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:05:09.677 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:05:09.677 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:05:09.677 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:05:09.677 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:09.677 INFO:tasks.workunit.client.0.smithi097.stderr: -198> 2024-09-14T11:05:09.369+0000 7f96627fc640 10 monclient: _finish_auth 0 2024-09-14T11:05:09.677 INFO:tasks.workunit.client.0.smithi097.stderr: -197> 2024-09-14T11:05:09.369+0000 7f96627fc640 10 monclient: _check_auth_tickets 2024-09-14T11:05:09.677 INFO:tasks.workunit.client.0.smithi097.stderr: -196> 2024-09-14T11:05:09.369+0000 7f978ef46800 5 monclient: authenticate success, global_id 7374 2024-09-14T11:05:09.677 INFO:tasks.workunit.client.0.smithi097.stderr: -195> 2024-09-14T11:05:09.369+0000 7f96627fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:05:09.678 INFO:tasks.workunit.client.0.smithi097.stderr: -194> 2024-09-14T11:05:09.369+0000 7f96627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:05:09.678 INFO:tasks.workunit.client.0.smithi097.stderr: -193> 2024-09-14T11:05:09.369+0000 7f96627fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:05:09.678 INFO:tasks.workunit.client.0.smithi097.stderr: -192> 2024-09-14T11:05:09.369+0000 7f96627fc640 10 monclient: dump: 2024-09-14T11:05:09.678 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:05:09.678 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:05:09.678 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:09.678 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:09.678 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:05:09.678 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:05:09.678 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:05:09.678 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:05:09.678 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:05:09.678 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:09.679 INFO:tasks.workunit.client.0.smithi097.stderr: -191> 2024-09-14T11:05:09.369+0000 7f978ef46800 10 monclient: _renew_subs 2024-09-14T11:05:09.679 INFO:tasks.workunit.client.0.smithi097.stderr: -190> 2024-09-14T11:05:09.369+0000 7f9663fff640 4 set_mon_vals no callback set 2024-09-14T11:05:09.679 INFO:tasks.workunit.client.0.smithi097.stderr: -189> 2024-09-14T11:05:09.369+0000 7f978ef46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:05:09.679 INFO:tasks.workunit.client.0.smithi097.stderr: -188> 2024-09-14T11:05:09.369+0000 7f978ef46800 10 monclient: _renew_subs 2024-09-14T11:05:09.679 INFO:tasks.workunit.client.0.smithi097.stderr: -187> 2024-09-14T11:05:09.369+0000 7f978ef46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:05:09.679 INFO:tasks.workunit.client.0.smithi097.stderr: -186> 2024-09-14T11:05:09.369+0000 7f978ef46800 1 librados: init done 2024-09-14T11:05:09.679 INFO:tasks.workunit.client.0.smithi097.stderr: -185> 2024-09-14T11:05:09.369+0000 7f978ef46800 5 asok(0x55ec7022a270) register_command cr dump hook 0x55ec70513c68 2024-09-14T11:05:09.679 INFO:tasks.workunit.client.0.smithi097.stderr: -184> 2024-09-14T11:05:09.371+0000 7f978ef46800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.679 INFO:tasks.workunit.client.0.smithi097.stderr: -183> 2024-09-14T11:05:09.371+0000 7f96627fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:05:09.679 INFO:tasks.workunit.client.0.smithi097.stderr: -182> 2024-09-14T11:05:09.371+0000 7f96627fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:05:09.679 INFO:tasks.workunit.client.0.smithi097.stderr: -181> 2024-09-14T11:05:09.371+0000 7f96627fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:05:09.679 INFO:tasks.workunit.client.0.smithi097.stderr: -180> 2024-09-14T11:05:09.371+0000 7f978d238640 10 monclient: get_auth_request con 0x7f9658077230 auth_method 0 2024-09-14T11:05:09.679 INFO:tasks.workunit.client.0.smithi097.stderr: -179> 2024-09-14T11:05:09.372+0000 7f978ca37640 10 monclient: get_auth_request con 0x55ec70538680 auth_method 0 2024-09-14T11:05:09.679 INFO:tasks.workunit.client.0.smithi097.stderr: -178> 2024-09-14T11:05:09.372+0000 7f978ef46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:09.679 INFO:tasks.workunit.client.0.smithi097.stderr: -177> 2024-09-14T11:05:09.372+0000 7f978ef46800 20 realm 2024-09-14T11:05:09.680 INFO:tasks.workunit.client.0.smithi097.stderr: -176> 2024-09-14T11:05:09.372+0000 7f978ef46800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.680 INFO:tasks.workunit.client.0.smithi097.stderr: -175> 2024-09-14T11:05:09.372+0000 7f978ef46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:09.680 INFO:tasks.workunit.client.0.smithi097.stderr: -174> 2024-09-14T11:05:09.372+0000 7f978ef46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:05:09.680 INFO:tasks.workunit.client.0.smithi097.stderr: -173> 2024-09-14T11:05:09.372+0000 7f978ef46800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.680 INFO:tasks.workunit.client.0.smithi097.stderr: -172> 2024-09-14T11:05:09.373+0000 7f978ef46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:09.680 INFO:tasks.workunit.client.0.smithi097.stderr: -171> 2024-09-14T11:05:09.373+0000 7f978ef46800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.680 INFO:tasks.workunit.client.0.smithi097.stderr: -170> 2024-09-14T11:05:09.373+0000 7f9784236640 10 monclient: get_auth_request con 0x55ec7053c8c0 auth_method 0 2024-09-14T11:05:09.680 INFO:tasks.workunit.client.0.smithi097.stderr: -169> 2024-09-14T11:05:09.373+0000 7f978ef46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:09.680 INFO:tasks.workunit.client.0.smithi097.stderr: -168> 2024-09-14T11:05:09.373+0000 7f978ef46800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.680 INFO:tasks.workunit.client.0.smithi097.stderr: -167> 2024-09-14T11:05:09.374+0000 7f978d238640 10 monclient: get_auth_request con 0x55ec70540100 auth_method 0 2024-09-14T11:05:09.680 INFO:tasks.workunit.client.0.smithi097.stderr: -166> 2024-09-14T11:05:09.374+0000 7f978ef46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:05:09.680 INFO:tasks.workunit.client.0.smithi097.stderr: -165> 2024-09-14T11:05:09.374+0000 7f978ef46800 20 searching for the correct realm 2024-09-14T11:05:09.680 INFO:tasks.workunit.client.0.smithi097.stderr: -164> 2024-09-14T11:05:09.374+0000 7f978ca37640 10 monclient: get_auth_request con 0x55ec70544ee0 auth_method 0 2024-09-14T11:05:09.680 INFO:tasks.workunit.client.0.smithi097.stderr: -163> 2024-09-14T11:05:09.375+0000 7f9784236640 10 monclient: get_auth_request con 0x7f977c087050 auth_method 0 2024-09-14T11:05:09.681 INFO:tasks.workunit.client.0.smithi097.stderr: -162> 2024-09-14T11:05:09.376+0000 7f978d238640 0 -- 172.21.15.97:0/1560020169 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f97740a2070 msgr2=0x7f97740030b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:05:09.681 INFO:tasks.workunit.client.0.smithi097.stderr: -161> 2024-09-14T11:05:09.578+0000 7f978d238640 10 monclient: get_auth_request con 0x7f97740a2070 auth_method 0 2024-09-14T11:05:09.681 INFO:tasks.workunit.client.0.smithi097.stderr: -160> 2024-09-14T11:05:09.581+0000 7f978ca37640 10 monclient: get_auth_request con 0x7f9774097030 auth_method 0 2024-09-14T11:05:09.681 INFO:tasks.workunit.client.0.smithi097.stderr: -159> 2024-09-14T11:05:09.582+0000 7f9784236640 10 monclient: get_auth_request con 0x7f977c092230 auth_method 0 2024-09-14T11:05:09.681 INFO:tasks.workunit.client.0.smithi097.stderr: -158> 2024-09-14T11:05:09.582+0000 7f9784236640 0 -- 172.21.15.97:0/1560020169 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f977c092230 msgr2=0x7f977c066180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:05:09.681 INFO:tasks.workunit.client.0.smithi097.stderr: -157> 2024-09-14T11:05:09.582+0000 7f96627fc640 1 client.7374.objecter ms_handle_reset 0x7f977c092230 session 0x7f977c0900b0 osd.3 2024-09-14T11:05:09.681 INFO:tasks.workunit.client.0.smithi097.stderr: -156> 2024-09-14T11:05:09.582+0000 7f96627fc640 10 monclient: _renew_subs 2024-09-14T11:05:09.681 INFO:tasks.workunit.client.0.smithi097.stderr: -155> 2024-09-14T11:05:09.582+0000 7f96627fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:05:09.681 INFO:tasks.workunit.client.0.smithi097.stderr: -154> 2024-09-14T11:05:09.582+0000 7f9784236640 10 monclient: get_auth_request con 0x7f9658086d50 auth_method 0 2024-09-14T11:05:09.681 INFO:tasks.workunit.client.0.smithi097.stderr: -153> 2024-09-14T11:05:09.587+0000 7f978ef46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:05:09.681 INFO:tasks.workunit.client.0.smithi097.stderr: -152> 2024-09-14T11:05:09.587+0000 7f978ef46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:05:09.681 INFO:tasks.workunit.client.0.smithi097.stderr: -151> 2024-09-14T11:05:09.587+0000 7f978ef46800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:05:09.681 INFO:tasks.workunit.client.0.smithi097.stderr: -150> 2024-09-14T11:05:09.587+0000 7f978ef46800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:05:09.681 INFO:tasks.workunit.client.0.smithi097.stderr: -149> 2024-09-14T11:05:09.587+0000 7f978ef46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:05:09.682 INFO:tasks.workunit.client.0.smithi097.stderr: -148> 2024-09-14T11:05:09.587+0000 7f978ef46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:05:09.682 INFO:tasks.workunit.client.0.smithi097.stderr: -147> 2024-09-14T11:05:09.587+0000 7f978ef46800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.682 INFO:tasks.workunit.client.0.smithi097.stderr: -146> 2024-09-14T11:05:09.587+0000 7f978ef46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:09.682 INFO:tasks.workunit.client.0.smithi097.stderr: -145> 2024-09-14T11:05:09.587+0000 7f978ef46800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.682 INFO:tasks.workunit.client.0.smithi097.stderr: -144> 2024-09-14T11:05:09.587+0000 7f978ef46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:09.682 INFO:tasks.workunit.client.0.smithi097.stderr: -143> 2024-09-14T11:05:09.587+0000 7f978ef46800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.682 INFO:tasks.workunit.client.0.smithi097.stderr: -142> 2024-09-14T11:05:09.588+0000 7f978ef46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:05:09.682 INFO:tasks.workunit.client.0.smithi097.stderr: -141> 2024-09-14T11:05:09.588+0000 7f978ef46800 20 zone default found 2024-09-14T11:05:09.682 INFO:tasks.workunit.client.0.smithi097.stderr: -140> 2024-09-14T11:05:09.588+0000 7f978ef46800 4 Realm: () 2024-09-14T11:05:09.682 INFO:tasks.workunit.client.0.smithi097.stderr: -139> 2024-09-14T11:05:09.588+0000 7f978ef46800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:05:09.682 INFO:tasks.workunit.client.0.smithi097.stderr: -138> 2024-09-14T11:05:09.588+0000 7f978ef46800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:05:09.682 INFO:tasks.workunit.client.0.smithi097.stderr: -137> 2024-09-14T11:05:09.588+0000 7f978ef46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:05:09.682 INFO:tasks.workunit.client.0.smithi097.stderr: -136> 2024-09-14T11:05:09.588+0000 7f978ef46800 20 zonegroup default 2024-09-14T11:05:09.683 INFO:tasks.workunit.client.0.smithi097.stderr: -135> 2024-09-14T11:05:09.588+0000 7f978ef46800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.683 INFO:tasks.workunit.client.0.smithi097.stderr: -134> 2024-09-14T11:05:09.588+0000 7f978ef46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:09.683 INFO:tasks.workunit.client.0.smithi097.stderr: -133> 2024-09-14T11:05:09.588+0000 7f978ef46800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.683 INFO:tasks.workunit.client.0.smithi097.stderr: -132> 2024-09-14T11:05:09.588+0000 7f978ef46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:09.683 INFO:tasks.workunit.client.0.smithi097.stderr: -131> 2024-09-14T11:05:09.588+0000 7f978ef46800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.683 INFO:tasks.workunit.client.0.smithi097.stderr: -130> 2024-09-14T11:05:09.589+0000 7f978ef46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:09.683 INFO:tasks.workunit.client.0.smithi097.stderr: -129> 2024-09-14T11:05:09.589+0000 7f978ef46800 20 started sync module instance, tier type = 2024-09-14T11:05:09.683 INFO:tasks.workunit.client.0.smithi097.stderr: -128> 2024-09-14T11:05:09.589+0000 7f978ef46800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:05:09.683 INFO:tasks.workunit.client.0.smithi097.stderr: -127> 2024-09-14T11:05:09.597+0000 7f978ef46800 20 add_watcher() i=0 2024-09-14T11:05:09.683 INFO:tasks.workunit.client.0.smithi097.stderr: -126> 2024-09-14T11:05:09.597+0000 7f978ef46800 20 add_watcher() i=1 2024-09-14T11:05:09.683 INFO:tasks.workunit.client.0.smithi097.stderr: -125> 2024-09-14T11:05:09.597+0000 7f978ef46800 20 add_watcher() i=2 2024-09-14T11:05:09.683 INFO:tasks.workunit.client.0.smithi097.stderr: -124> 2024-09-14T11:05:09.597+0000 7f978ef46800 20 add_watcher() i=3 2024-09-14T11:05:09.683 INFO:tasks.workunit.client.0.smithi097.stderr: -123> 2024-09-14T11:05:09.597+0000 7f978ef46800 20 add_watcher() i=4 2024-09-14T11:05:09.683 INFO:tasks.workunit.client.0.smithi097.stderr: -122> 2024-09-14T11:05:09.597+0000 7f978ef46800 20 add_watcher() i=5 2024-09-14T11:05:09.684 INFO:tasks.workunit.client.0.smithi097.stderr: -121> 2024-09-14T11:05:09.597+0000 7f978ef46800 20 add_watcher() i=6 2024-09-14T11:05:09.684 INFO:tasks.workunit.client.0.smithi097.stderr: -120> 2024-09-14T11:05:09.598+0000 7f978ef46800 20 add_watcher() i=7 2024-09-14T11:05:09.684 INFO:tasks.workunit.client.0.smithi097.stderr: -119> 2024-09-14T11:05:09.598+0000 7f978ef46800 2 all 8 watchers are set, enabling cache 2024-09-14T11:05:09.684 INFO:tasks.workunit.client.0.smithi097.stderr: -118> 2024-09-14T11:05:09.600+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22860) adding auth protocol: cephx 2024-09-14T11:05:09.684 INFO:tasks.workunit.client.0.smithi097.stderr: -117> 2024-09-14T11:05:09.600+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22860) adding auth protocol: cephx 2024-09-14T11:05:09.684 INFO:tasks.workunit.client.0.smithi097.stderr: -116> 2024-09-14T11:05:09.600+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22860) adding auth protocol: cephx 2024-09-14T11:05:09.684 INFO:tasks.workunit.client.0.smithi097.stderr: -115> 2024-09-14T11:05:09.600+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22860) adding con mode: secure 2024-09-14T11:05:09.684 INFO:tasks.workunit.client.0.smithi097.stderr: -114> 2024-09-14T11:05:09.600+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22860) adding con mode: crc 2024-09-14T11:05:09.684 INFO:tasks.workunit.client.0.smithi097.stderr: -113> 2024-09-14T11:05:09.600+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22860) adding con mode: secure 2024-09-14T11:05:09.684 INFO:tasks.workunit.client.0.smithi097.stderr: -112> 2024-09-14T11:05:09.600+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22860) adding con mode: crc 2024-09-14T11:05:09.684 INFO:tasks.workunit.client.0.smithi097.stderr: -111> 2024-09-14T11:05:09.600+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22860) adding con mode: secure 2024-09-14T11:05:09.684 INFO:tasks.workunit.client.0.smithi097.stderr: -110> 2024-09-14T11:05:09.600+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22860) adding con mode: crc 2024-09-14T11:05:09.684 INFO:tasks.workunit.client.0.smithi097.stderr: -109> 2024-09-14T11:05:09.600+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22860) adding con mode: crc 2024-09-14T11:05:09.684 INFO:tasks.workunit.client.0.smithi097.stderr: -108> 2024-09-14T11:05:09.600+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22860) adding con mode: secure 2024-09-14T11:05:09.684 INFO:tasks.workunit.client.0.smithi097.stderr: -107> 2024-09-14T11:05:09.600+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22860) adding con mode: crc 2024-09-14T11:05:09.685 INFO:tasks.workunit.client.0.smithi097.stderr: -106> 2024-09-14T11:05:09.600+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22860) adding con mode: secure 2024-09-14T11:05:09.685 INFO:tasks.workunit.client.0.smithi097.stderr: -105> 2024-09-14T11:05:09.600+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22860) adding con mode: crc 2024-09-14T11:05:09.685 INFO:tasks.workunit.client.0.smithi097.stderr: -104> 2024-09-14T11:05:09.600+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22860) adding con mode: secure 2024-09-14T11:05:09.685 INFO:tasks.workunit.client.0.smithi097.stderr: -103> 2024-09-14T11:05:09.600+0000 7f96437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:09.685 INFO:tasks.workunit.client.0.smithi097.stderr: -102> 2024-09-14T11:05:09.600+0000 7f978ef46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:05:09.685 INFO:tasks.workunit.client.0.smithi097.stderr: -101> 2024-09-14T11:05:09.600+0000 7f978ef46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:05:09.685 INFO:tasks.workunit.client.0.smithi097.stderr: -100> 2024-09-14T11:05:09.600+0000 7f978ef46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:05:09.685 INFO:tasks.workunit.client.0.smithi097.stderr: -99> 2024-09-14T11:05:09.600+0000 7f978ef46800 5 asok(0x55ec7022a270) register_command cache list hook 0x55ec705106e0 2024-09-14T11:05:09.685 INFO:tasks.workunit.client.0.smithi097.stderr: -98> 2024-09-14T11:05:09.600+0000 7f978ef46800 5 asok(0x55ec7022a270) register_command cache inspect hook 0x55ec705106e0 2024-09-14T11:05:09.685 INFO:tasks.workunit.client.0.smithi097.stderr: -97> 2024-09-14T11:05:09.600+0000 7f978ef46800 5 asok(0x55ec7022a270) register_command cache erase hook 0x55ec705106e0 2024-09-14T11:05:09.685 INFO:tasks.workunit.client.0.smithi097.stderr: -96> 2024-09-14T11:05:09.600+0000 7f978ef46800 5 asok(0x55ec7022a270) register_command cache zap hook 0x55ec705106e0 2024-09-14T11:05:09.685 INFO:tasks.workunit.client.0.smithi097.stderr: -95> 2024-09-14T11:05:09.600+0000 7f978ef46800 5 note: GC not initialized 2024-09-14T11:05:09.685 INFO:tasks.workunit.client.0.smithi097.stderr: -94> 2024-09-14T11:05:09.600+0000 7f96427e4640 20 reqs_thread_entry: start 2024-09-14T11:05:09.685 INFO:tasks.workunit.client.0.smithi097.stderr: -93> 2024-09-14T11:05:09.600+0000 7f978ef46800 5 asok(0x55ec7022a270) register_command sync trace show hook 0x7f9774076370 2024-09-14T11:05:09.686 INFO:tasks.workunit.client.0.smithi097.stderr: -92> 2024-09-14T11:05:09.600+0000 7f978ef46800 5 asok(0x55ec7022a270) register_command sync trace history hook 0x7f9774076370 2024-09-14T11:05:09.686 INFO:tasks.workunit.client.0.smithi097.stderr: -91> 2024-09-14T11:05:09.600+0000 7f978ef46800 5 asok(0x55ec7022a270) register_command sync trace active hook 0x7f9774076370 2024-09-14T11:05:09.686 INFO:tasks.workunit.client.0.smithi097.stderr: -90> 2024-09-14T11:05:09.600+0000 7f978ef46800 5 asok(0x55ec7022a270) register_command sync trace active_short hook 0x7f9774076370 2024-09-14T11:05:09.686 INFO:tasks.workunit.client.0.smithi097.stderr: -89> 2024-09-14T11:05:09.600+0000 7f978ef46800 20 init_complete bucket index max shards: 11 2024-09-14T11:05:09.686 INFO:tasks.workunit.client.0.smithi097.stderr: -88> 2024-09-14T11:05:09.600+0000 7f978ef46800 20 Filter name: none 2024-09-14T11:05:09.686 INFO:tasks.workunit.client.0.smithi097.stderr: -87> 2024-09-14T11:05:09.600+0000 7f963bfff640 20 reqs_thread_entry: start 2024-09-14T11:05:09.686 INFO:tasks.workunit.client.0.smithi097.stderr: -86> 2024-09-14T11:05:09.600+0000 7f978ef46800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:05:09.686 INFO:tasks.workunit.client.0.smithi097.stderr: -85> 2024-09-14T11:05:09.601+0000 7f978ef46800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.686 INFO:tasks.workunit.client.0.smithi097.stderr: -84> 2024-09-14T11:05:09.601+0000 7f978ef46800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:05:09.686 INFO:tasks.workunit.client.0.smithi097.stderr: -83> 2024-09-14T11:05:09.601+0000 7f978ef46800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:05:09.686 INFO:tasks.workunit.client.0.smithi097.stderr: -82> 2024-09-14T11:05:09.601+0000 7f978ef46800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:05:09.686 INFO:tasks.workunit.client.0.smithi097.stderr: -81> 2024-09-14T11:05:09.601+0000 7f978ef46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 : miss 2024-09-14T11:05:09.686 INFO:tasks.workunit.client.0.smithi097.stderr: -80> 2024-09-14T11:05:09.601+0000 7f978ef46800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.686 INFO:tasks.workunit.client.0.smithi097.stderr: -79> 2024-09-14T11:05:09.601+0000 7f978ef46800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:05:09.687 INFO:tasks.workunit.client.0.smithi097.stderr: -78> 2024-09-14T11:05:09.601+0000 7f978ef46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 info.flags=0x17 2024-09-14T11:05:09.687 INFO:tasks.workunit.client.0.smithi097.stderr: -77> 2024-09-14T11:05:09.601+0000 7f978ef46800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 to cache LRU end 2024-09-14T11:05:09.687 INFO:tasks.workunit.client.0.smithi097.stderr: -76> 2024-09-14T11:05:09.601+0000 7f978ef46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:05:09.687 INFO:tasks.workunit.client.0.smithi097.stderr: -75> 2024-09-14T11:05:09.601+0000 7f978ef46800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:09.687 INFO:tasks.workunit.client.0.smithi097.stderr: -74> 2024-09-14T11:05:09.601+0000 7f978ef46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 2024-09-14T11:05:09.687 INFO:tasks.workunit.client.0.smithi097.stderr: -73> 2024-09-14T11:05:09.606+0000 7f978ef46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 info.flags=0x17 2024-09-14T11:05:09.687 INFO:tasks.workunit.client.0.smithi097.stderr: -72> 2024-09-14T11:05:09.606+0000 7f978ef46800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 to cache LRU end 2024-09-14T11:05:09.687 INFO:tasks.workunit.client.0.smithi097.stderr: -71> 2024-09-14T11:05:09.606+0000 7f978ef46800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:09.687 INFO:tasks.workunit.client.0.smithi097.stderr: -70> 2024-09-14T11:05:09.606+0000 7f978ef46800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32, ofs0, ns] 2024-09-14T11:05:09.687 INFO:tasks.workunit.client.0.smithi097.stderr: -69> 2024-09-14T11:05:09.606+0000 7f96637fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595203 cookie 94473985249088 notifier 7374 bl.length()=931 2024-09-14T11:05:09.687 INFO:tasks.workunit.client.0.smithi097.stderr: -68> 2024-09-14T11:05:09.606+0000 7f96637fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 info.flags=0x17 2024-09-14T11:05:09.687 INFO:tasks.workunit.client.0.smithi097.stderr: -67> 2024-09-14T11:05:09.606+0000 7f96637fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 to cache LRU end 2024-09-14T11:05:09.687 INFO:tasks.workunit.client.0.smithi097.stderr: -66> 2024-09-14T11:05:09.606+0000 7f96637fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:09.687 INFO:tasks.workunit.client.0.smithi097.stderr: -65> 2024-09-14T11:05:09.607+0000 7f978ef46800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32]): orig_sources= new_sources= 2024-09-14T11:05:09.688 INFO:tasks.workunit.client.0.smithi097.stderr: -64> 2024-09-14T11:05:09.607+0000 7f978ef46800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32]): potential sources added=[] removed=[] 2024-09-14T11:05:09.688 INFO:tasks.workunit.client.0.smithi097.stderr: -63> 2024-09-14T11:05:09.607+0000 7f978ef46800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32]): orig_dests= new_dests= 2024-09-14T11:05:09.688 INFO:tasks.workunit.client.0.smithi097.stderr: -62> 2024-09-14T11:05:09.607+0000 7f978ef46800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32]): potential dests added=[] removed=[] 2024-09-14T11:05:09.688 INFO:tasks.workunit.client.0.smithi097.stderr: -61> 2024-09-14T11:05:09.612+0000 7f978ef46800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.0 2024-09-14T11:05:09.688 INFO:tasks.workunit.client.0.smithi097.stderr: -60> 2024-09-14T11:05:09.612+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.0 2024-09-14T11:05:09.688 INFO:tasks.workunit.client.0.smithi097.stderr: -59> 2024-09-14T11:05:09.612+0000 7f978ef46800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.1 2024-09-14T11:05:09.688 INFO:tasks.workunit.client.0.smithi097.stderr: -58> 2024-09-14T11:05:09.612+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.1 2024-09-14T11:05:09.688 INFO:tasks.workunit.client.0.smithi097.stderr: -57> 2024-09-14T11:05:09.612+0000 7f978ef46800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.2 2024-09-14T11:05:09.688 INFO:tasks.workunit.client.0.smithi097.stderr: -56> 2024-09-14T11:05:09.612+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.2 2024-09-14T11:05:09.688 INFO:tasks.workunit.client.0.smithi097.stderr: -55> 2024-09-14T11:05:09.612+0000 7f978ef46800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.3 2024-09-14T11:05:09.688 INFO:tasks.workunit.client.0.smithi097.stderr: -54> 2024-09-14T11:05:09.612+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.3 2024-09-14T11:05:09.688 INFO:tasks.workunit.client.0.smithi097.stderr: -53> 2024-09-14T11:05:09.612+0000 7f978ef46800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.4 2024-09-14T11:05:09.688 INFO:tasks.workunit.client.0.smithi097.stderr: -52> 2024-09-14T11:05:09.612+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.4 2024-09-14T11:05:09.688 INFO:tasks.workunit.client.0.smithi097.stderr: -51> 2024-09-14T11:05:09.612+0000 7f978ef46800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.5 2024-09-14T11:05:09.689 INFO:tasks.workunit.client.0.smithi097.stderr: -50> 2024-09-14T11:05:09.612+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.5 2024-09-14T11:05:09.689 INFO:tasks.workunit.client.0.smithi097.stderr: -49> 2024-09-14T11:05:09.612+0000 7f978ef46800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.6 2024-09-14T11:05:09.689 INFO:tasks.workunit.client.0.smithi097.stderr: -48> 2024-09-14T11:05:09.612+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.6 2024-09-14T11:05:09.689 INFO:tasks.workunit.client.0.smithi097.stderr: -47> 2024-09-14T11:05:09.612+0000 7f978ef46800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.7 2024-09-14T11:05:09.689 INFO:tasks.workunit.client.0.smithi097.stderr: -46> 2024-09-14T11:05:09.612+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.7 2024-09-14T11:05:09.689 INFO:tasks.workunit.client.0.smithi097.stderr: -45> 2024-09-14T11:05:09.612+0000 7f978ef46800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.8 2024-09-14T11:05:09.689 INFO:tasks.workunit.client.0.smithi097.stderr: -44> 2024-09-14T11:05:09.612+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.8 2024-09-14T11:05:09.689 INFO:tasks.workunit.client.0.smithi097.stderr: -43> 2024-09-14T11:05:09.612+0000 7f978ef46800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.9 2024-09-14T11:05:09.689 INFO:tasks.workunit.client.0.smithi097.stderr: -42> 2024-09-14T11:05:09.612+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.9 2024-09-14T11:05:09.689 INFO:tasks.workunit.client.0.smithi097.stderr: -41> 2024-09-14T11:05:09.612+0000 7f978ef46800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.10 2024-09-14T11:05:09.689 INFO:tasks.workunit.client.0.smithi097.stderr: -40> 2024-09-14T11:05:09.612+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.10 2024-09-14T11:05:09.689 INFO:tasks.workunit.client.0.smithi097.stderr: -39> 2024-09-14T11:05:09.612+0000 7f978ef46800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.11 2024-09-14T11:05:09.689 INFO:tasks.workunit.client.0.smithi097.stderr: -38> 2024-09-14T11:05:09.612+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.11 2024-09-14T11:05:09.689 INFO:tasks.workunit.client.0.smithi097.stderr: -37> 2024-09-14T11:05:09.612+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.0 2024-09-14T11:05:09.690 INFO:tasks.workunit.client.0.smithi097.stderr: -36> 2024-09-14T11:05:09.612+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1 2024-09-14T11:05:09.690 INFO:tasks.workunit.client.0.smithi097.stderr: -35> 2024-09-14T11:05:09.613+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.2 2024-09-14T11:05:09.690 INFO:tasks.workunit.client.0.smithi097.stderr: -34> 2024-09-14T11:05:09.613+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.3 2024-09-14T11:05:09.690 INFO:tasks.workunit.client.0.smithi097.stderr: -33> 2024-09-14T11:05:09.614+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.4 2024-09-14T11:05:09.690 INFO:tasks.workunit.client.0.smithi097.stderr: -32> 2024-09-14T11:05:09.614+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.5 2024-09-14T11:05:09.690 INFO:tasks.workunit.client.0.smithi097.stderr: -31> 2024-09-14T11:05:09.614+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.6 2024-09-14T11:05:09.690 INFO:tasks.workunit.client.0.smithi097.stderr: -30> 2024-09-14T11:05:09.615+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.7 2024-09-14T11:05:09.690 INFO:tasks.workunit.client.0.smithi097.stderr: -29> 2024-09-14T11:05:09.615+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.8 2024-09-14T11:05:09.690 INFO:tasks.workunit.client.0.smithi097.stderr: -28> 2024-09-14T11:05:09.616+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.9 2024-09-14T11:05:09.690 INFO:tasks.workunit.client.0.smithi097.stderr: -27> 2024-09-14T11:05:09.616+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.10 2024-09-14T11:05:09.690 INFO:tasks.workunit.client.0.smithi097.stderr: -26> 2024-09-14T11:05:09.619+0000 7f978ef46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 : hit (requested=0x17, cached=0x17) 2024-09-14T11:05:09.690 INFO:tasks.workunit.client.0.smithi097.stderr: -25> 2024-09-14T11:05:09.619+0000 7f978ef46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 2024-09-14T11:05:09.690 INFO:tasks.workunit.client.0.smithi097.stderr: -24> 2024-09-14T11:05:09.620+0000 7f978ef46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 info.flags=0x17 2024-09-14T11:05:09.690 INFO:tasks.workunit.client.0.smithi097.stderr: -23> 2024-09-14T11:05:09.620+0000 7f978ef46800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 to cache LRU end 2024-09-14T11:05:09.690 INFO:tasks.workunit.client.0.smithi097.stderr: -22> 2024-09-14T11:05:09.620+0000 7f978ef46800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:09.691 INFO:tasks.workunit.client.0.smithi097.stderr: -21> 2024-09-14T11:05:09.620+0000 7f978ef46800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32, ofs0, ns] 2024-09-14T11:05:09.691 INFO:tasks.workunit.client.0.smithi097.stderr: -20> 2024-09-14T11:05:09.621+0000 7f96637fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595204 cookie 94473985249088 notifier 7374 bl.length()=931 2024-09-14T11:05:09.691 INFO:tasks.workunit.client.0.smithi097.stderr: -19> 2024-09-14T11:05:09.621+0000 7f96637fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 info.flags=0x17 2024-09-14T11:05:09.691 INFO:tasks.workunit.client.0.smithi097.stderr: -18> 2024-09-14T11:05:09.621+0000 7f96637fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 to cache LRU end 2024-09-14T11:05:09.691 INFO:tasks.workunit.client.0.smithi097.stderr: -17> 2024-09-14T11:05:09.621+0000 7f96637fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:09.691 INFO:tasks.workunit.client.0.smithi097.stderr: -16> 2024-09-14T11:05:09.621+0000 7f978ef46800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32]): orig_sources= new_sources= 2024-09-14T11:05:09.691 INFO:tasks.workunit.client.0.smithi097.stderr: -15> 2024-09-14T11:05:09.621+0000 7f978ef46800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32]): potential sources added=[] removed=[] 2024-09-14T11:05:09.691 INFO:tasks.workunit.client.0.smithi097.stderr: -14> 2024-09-14T11:05:09.621+0000 7f978ef46800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32]): orig_dests= new_dests= 2024-09-14T11:05:09.691 INFO:tasks.workunit.client.0.smithi097.stderr: -13> 2024-09-14T11:05:09.621+0000 7f978ef46800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32]): potential dests added=[] removed=[] 2024-09-14T11:05:09.691 INFO:tasks.workunit.client.0.smithi097.stderr: -12> 2024-09-14T11:05:09.623+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.0 2024-09-14T11:05:09.691 INFO:tasks.workunit.client.0.smithi097.stderr: -11> 2024-09-14T11:05:09.623+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1 2024-09-14T11:05:09.691 INFO:tasks.workunit.client.0.smithi097.stderr: -10> 2024-09-14T11:05:09.624+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.2 2024-09-14T11:05:09.691 INFO:tasks.workunit.client.0.smithi097.stderr: -9> 2024-09-14T11:05:09.624+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.3 2024-09-14T11:05:09.691 INFO:tasks.workunit.client.0.smithi097.stderr: -8> 2024-09-14T11:05:09.624+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.4 2024-09-14T11:05:09.692 INFO:tasks.workunit.client.0.smithi097.stderr: -7> 2024-09-14T11:05:09.624+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.5 2024-09-14T11:05:09.692 INFO:tasks.workunit.client.0.smithi097.stderr: -6> 2024-09-14T11:05:09.625+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.6 2024-09-14T11:05:09.692 INFO:tasks.workunit.client.0.smithi097.stderr: -5> 2024-09-14T11:05:09.625+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.7 2024-09-14T11:05:09.692 INFO:tasks.workunit.client.0.smithi097.stderr: -4> 2024-09-14T11:05:09.625+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.8 2024-09-14T11:05:09.692 INFO:tasks.workunit.client.0.smithi097.stderr: -3> 2024-09-14T11:05:09.626+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.9 2024-09-14T11:05:09.692 INFO:tasks.workunit.client.0.smithi097.stderr: -2> 2024-09-14T11:05:09.626+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.10 2024-09-14T11:05:09.692 INFO:tasks.workunit.client.0.smithi097.stderr: -1> 2024-09-14T11:05:09.627+0000 7f978ef46800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f978ef46800 time 2024-09-14T11:05:09.627666+0000 2024-09-14T11:05:09.692 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:05:09.692 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:09.692 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:05:09.692 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f979258c76a] 2024-09-14T11:05:09.692 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f979258c928] 2024-09-14T11:05:09.692 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ec6db030b1] 2024-09-14T11:05:09.692 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55ec6db13217] 2024-09-14T11:05:09.692 INFO:tasks.workunit.client.0.smithi097.stderr: 5: main() 2024-09-14T11:05:09.693 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f9791229590] 2024-09-14T11:05:09.693 INFO:tasks.workunit.client.0.smithi097.stderr: 7: __libc_start_main() 2024-09-14T11:05:09.693 INFO:tasks.workunit.client.0.smithi097.stderr: 8: _start() 2024-09-14T11:05:09.693 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:09.693 INFO:tasks.workunit.client.0.smithi097.stderr: 0> 2024-09-14T11:05:09.628+0000 7f978ef46800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:05:09.693 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f978ef46800 thread_name:radosgw-admin 2024-09-14T11:05:09.693 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:09.693 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:05:09.693 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f979123e6f0] 2024-09-14T11:05:09.693 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f979128b99c] 2024-09-14T11:05:09.693 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-14T11:05:09.693 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-14T11:05:09.693 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f979258c7c4] 2024-09-14T11:05:09.694 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f979258c928] 2024-09-14T11:05:09.694 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ec6db030b1] 2024-09-14T11:05:09.694 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55ec6db13217] 2024-09-14T11:05:09.694 INFO:tasks.workunit.client.0.smithi097.stderr: 9: main() 2024-09-14T11:05:09.694 INFO:tasks.workunit.client.0.smithi097.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f9791229590] 2024-09-14T11:05:09.694 INFO:tasks.workunit.client.0.smithi097.stderr: 11: __libc_start_main() 2024-09-14T11:05:09.694 INFO:tasks.workunit.client.0.smithi097.stderr: 12: _start() 2024-09-14T11:05:09.694 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:05:09.694 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:09.694 INFO:tasks.workunit.client.0.smithi097.stderr:--- logging levels --- 2024-09-14T11:05:09.694 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 none 2024-09-14T11:05:09.695 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 lockdep 2024-09-14T11:05:09.695 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 context 2024-09-14T11:05:09.695 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 crush 2024-09-14T11:05:09.695 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds 2024-09-14T11:05:09.695 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_balancer 2024-09-14T11:05:09.695 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_locker 2024-09-14T11:05:09.695 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log 2024-09-14T11:05:09.695 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log_expire 2024-09-14T11:05:09.695 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_migrator 2024-09-14T11:05:09.695 INFO:tasks.workunit.client.0.smithi097.stderr: 3/ 5 mds_quiesce 2024-09-14T11:05:09.695 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 buffer 2024-09-14T11:05:09.695 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 timer 2024-09-14T11:05:09.696 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 filer 2024-09-14T11:05:09.696 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 striper 2024-09-14T11:05:09.696 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 objecter 2024-09-14T11:05:09.696 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rados 2024-09-14T11:05:09.696 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd 2024-09-14T11:05:09.696 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_mirror 2024-09-14T11:05:09.696 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_replay 2024-09-14T11:05:09.696 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_pwl 2024-09-14T11:05:09.696 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 journaler 2024-09-14T11:05:09.696 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objectcacher 2024-09-14T11:05:09.696 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:05:09.696 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 client 2024-09-14T11:05:09.696 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 osd 2024-09-14T11:05:09.696 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 optracker 2024-09-14T11:05:09.697 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objclass 2024-09-14T11:05:09.697 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 filestore 2024-09-14T11:05:09.697 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 journal 2024-09-14T11:05:09.697 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 ms 2024-09-14T11:05:09.697 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mon 2024-09-14T11:05:09.697 INFO:tasks.workunit.client.0.smithi097.stderr: 0/10 monc 2024-09-14T11:05:09.697 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 paxos 2024-09-14T11:05:09.697 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 tp 2024-09-14T11:05:09.697 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 auth 2024-09-14T11:05:09.697 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 crypto 2024-09-14T11:05:09.697 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 finisher 2024-09-14T11:05:09.697 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 reserver 2024-09-14T11:05:09.697 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 heartbeatmap 2024-09-14T11:05:09.697 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 perfcounter 2024-09-14T11:05:09.698 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw 2024-09-14T11:05:09.698 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_sync 2024-09-14T11:05:09.698 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_datacache 2024-09-14T11:05:09.698 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_access 2024-09-14T11:05:09.698 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:05:09.698 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_flight 2024-09-14T11:05:09.698 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:05:09.698 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw_notification 2024-09-14T11:05:09.698 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 javaclient 2024-09-14T11:05:09.698 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 asok 2024-09-14T11:05:09.698 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 throttle 2024-09-14T11:05:09.698 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 refs 2024-09-14T11:05:09.698 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 compressor 2024-09-14T11:05:09.698 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluestore 2024-09-14T11:05:09.699 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluefs 2024-09-14T11:05:09.699 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 bdev 2024-09-14T11:05:09.699 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 kstore 2024-09-14T11:05:09.699 INFO:tasks.workunit.client.0.smithi097.stderr: 4/ 5 rocksdb 2024-09-14T11:05:09.699 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 fuse 2024-09-14T11:05:09.699 INFO:tasks.workunit.client.0.smithi097.stderr: 2/ 5 mgr 2024-09-14T11:05:09.699 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mgrc 2024-09-14T11:05:09.699 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 dpdk 2024-09-14T11:05:09.699 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 eventtrace 2024-09-14T11:05:09.699 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 prioritycache 2024-09-14T11:05:09.699 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 test 2024-09-14T11:05:09.699 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:05:09.699 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephsqlite 2024-09-14T11:05:09.699 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:05:09.700 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore 2024-09-14T11:05:09.700 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_onode 2024-09-14T11:05:09.700 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_odata 2024-09-14T11:05:09.700 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_omap 2024-09-14T11:05:09.700 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_tm 2024-09-14T11:05:09.700 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_t 2024-09-14T11:05:09.700 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:05:09.700 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_epm 2024-09-14T11:05:09.700 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_lba 2024-09-14T11:05:09.700 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:05:09.700 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cache 2024-09-14T11:05:09.700 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_journal 2024-09-14T11:05:09.700 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_device 2024-09-14T11:05:09.701 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_backref 2024-09-14T11:05:09.701 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 alienstore 2024-09-14T11:05:09.701 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mclock 2024-09-14T11:05:09.701 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cyanstore 2024-09-14T11:05:09.701 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 ceph_exporter 2024-09-14T11:05:09.701 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 memstore 2024-09-14T11:05:09.701 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 trace 2024-09-14T11:05:09.701 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 ceph_dedup 2024-09-14T11:05:09.701 INFO:tasks.workunit.client.0.smithi097.stderr: -2/-2 (syslog threshold) 2024-09-14T11:05:09.701 INFO:tasks.workunit.client.0.smithi097.stderr: 99/99 (stderr threshold) 2024-09-14T11:05:09.701 INFO:tasks.workunit.client.0.smithi097.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:05:09.701 INFO:tasks.workunit.client.0.smithi097.stderr: 7f963bfff640 / http_manager 2024-09-14T11:05:09.701 INFO:tasks.workunit.client.0.smithi097.stderr: 7f96427e4640 / http_manager 2024-09-14T11:05:09.701 INFO:tasks.workunit.client.0.smithi097.stderr: 7f96437e6640 / rgw_dt_lg_renew 2024-09-14T11:05:09.702 INFO:tasks.workunit.client.0.smithi097.stderr: 7f96627fc640 / ms_dispatch 2024-09-14T11:05:09.702 INFO:tasks.workunit.client.0.smithi097.stderr: 7f96637fe640 / io_context_pool 2024-09-14T11:05:09.702 INFO:tasks.workunit.client.0.smithi097.stderr: 7f9663fff640 / io_context_pool 2024-09-14T11:05:09.702 INFO:tasks.workunit.client.0.smithi097.stderr: 7f96727fc640 / ms_dispatch 2024-09-14T11:05:09.702 INFO:tasks.workunit.client.0.smithi097.stderr: 7f967960a640 / ms_dispatch 2024-09-14T11:05:09.702 INFO:tasks.workunit.client.0.smithi097.stderr: 7f967ae0d640 / io_context_pool 2024-09-14T11:05:09.702 INFO:tasks.workunit.client.0.smithi097.stderr: 7f9784236640 / msgr-worker-2 2024-09-14T11:05:09.702 INFO:tasks.workunit.client.0.smithi097.stderr: 7f978ca37640 / msgr-worker-1 2024-09-14T11:05:09.702 INFO:tasks.workunit.client.0.smithi097.stderr: 7f978d238640 / msgr-worker-0 2024-09-14T11:05:09.702 INFO:tasks.workunit.client.0.smithi097.stderr: 7f978da39640 / io_context_pool 2024-09-14T11:05:09.702 INFO:tasks.workunit.client.0.smithi097.stderr: 7f978ef46800 / radosgw-admin 2024-09-14T11:05:09.702 INFO:tasks.workunit.client.0.smithi097.stderr: max_recent 500 2024-09-14T11:05:09.702 INFO:tasks.workunit.client.0.smithi097.stderr: max_new 1000 2024-09-14T11:05:09.702 INFO:tasks.workunit.client.0.smithi097.stderr: log_file /var/log/ceph/ceph-client.admin.122164.log 2024-09-14T11:05:09.703 INFO:tasks.workunit.client.0.smithi097.stderr:--- end dump of recent events --- 2024-09-14T11:05:09.703 INFO:tasks.workunit.client.0.smithi097.stderr:--- begin dump of recent events --- 2024-09-14T11:05:09.703 INFO:tasks.workunit.client.0.smithi097.stderr: -499> 2024-09-14T11:05:09.355+0000 7f978ca37640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:05:09.703 INFO:tasks.workunit.client.0.smithi097.stderr: -498> 2024-09-14T11:05:09.355+0000 7f978ca37640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:05:09.703 INFO:tasks.workunit.client.0.smithi097.stderr: -497> 2024-09-14T11:05:09.355+0000 7f9784236640 10 monclient(hunting): get_auth_request con 0x55ec702f5b40 auth_method 0 2024-09-14T11:05:09.703 INFO:tasks.workunit.client.0.smithi097.stderr: -496> 2024-09-14T11:05:09.355+0000 7f9784236640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:05:09.703 INFO:tasks.workunit.client.0.smithi097.stderr: -495> 2024-09-14T11:05:09.355+0000 7f9784236640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:05:09.703 INFO:tasks.workunit.client.0.smithi097.stderr: -494> 2024-09-14T11:05:09.355+0000 7f9784236640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:05:09.703 INFO:tasks.workunit.client.0.smithi097.stderr: -493> 2024-09-14T11:05:09.356+0000 7f978ca37640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:05:09.703 INFO:tasks.workunit.client.0.smithi097.stderr: -492> 2024-09-14T11:05:09.356+0000 7f978ca37640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:05:09.703 INFO:tasks.workunit.client.0.smithi097.stderr: -491> 2024-09-14T11:05:09.356+0000 7f978ca37640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:05:09.703 INFO:tasks.workunit.client.0.smithi097.stderr: -490> 2024-09-14T11:05:09.356+0000 7f9784236640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:05:09.703 INFO:tasks.workunit.client.0.smithi097.stderr: -489> 2024-09-14T11:05:09.356+0000 7f9784236640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:05:09.703 INFO:tasks.workunit.client.0.smithi097.stderr: -488> 2024-09-14T11:05:09.356+0000 7f9784236640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:05:09.704 INFO:tasks.workunit.client.0.smithi097.stderr: -487> 2024-09-14T11:05:09.356+0000 7f978d238640 10 monclient(hunting): get_auth_request con 0x55ec7038f550 auth_method 0 2024-09-14T11:05:09.704 INFO:tasks.workunit.client.0.smithi097.stderr: -486> 2024-09-14T11:05:09.356+0000 7f978d238640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:05:09.704 INFO:tasks.workunit.client.0.smithi097.stderr: -485> 2024-09-14T11:05:09.356+0000 7f978d238640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:05:09.704 INFO:tasks.workunit.client.0.smithi097.stderr: -484> 2024-09-14T11:05:09.356+0000 7f978d238640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:05:09.704 INFO:tasks.workunit.client.0.smithi097.stderr: -483> 2024-09-14T11:05:09.356+0000 7f978d238640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:05:09.704 INFO:tasks.workunit.client.0.smithi097.stderr: -482> 2024-09-14T11:05:09.356+0000 7f978d238640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:05:09.704 INFO:tasks.workunit.client.0.smithi097.stderr: -481> 2024-09-14T11:05:09.356+0000 7f978d238640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:05:09.704 INFO:tasks.workunit.client.0.smithi097.stderr: -480> 2024-09-14T11:05:09.356+0000 7f978ca37640 10 monclient(hunting): handle_auth_done global_id 6941 payload 824 2024-09-14T11:05:09.704 INFO:tasks.workunit.client.0.smithi097.stderr: -479> 2024-09-14T11:05:09.356+0000 7f978ca37640 10 monclient: _finish_hunting 0 2024-09-14T11:05:09.704 INFO:tasks.workunit.client.0.smithi097.stderr: -478> 2024-09-14T11:05:09.356+0000 7f978ca37640 1 monclient: found mon.noname-c 2024-09-14T11:05:09.704 INFO:tasks.workunit.client.0.smithi097.stderr: -477> 2024-09-14T11:05:09.356+0000 7f978ca37640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:05:09.704 INFO:tasks.workunit.client.0.smithi097.stderr: -476> 2024-09-14T11:05:09.356+0000 7f967960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:05:09.704 INFO:tasks.workunit.client.0.smithi097.stderr: -475> 2024-09-14T11:05:09.356+0000 7f967960a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:05:09.704 INFO:tasks.workunit.client.0.smithi097.stderr: -474> 2024-09-14T11:05:09.356+0000 7f967960a640 10 monclient: dump: 2024-09-14T11:05:09.705 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:05:09.705 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:05:09.705 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:09.705 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:09.705 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:05:09.705 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:05:09.705 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:05:09.705 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:05:09.705 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:05:09.705 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:09.705 INFO:tasks.workunit.client.0.smithi097.stderr: -473> 2024-09-14T11:05:09.356+0000 7f967960a640 10 monclient: _finish_auth 0 2024-09-14T11:05:09.705 INFO:tasks.workunit.client.0.smithi097.stderr: -472> 2024-09-14T11:05:09.356+0000 7f967960a640 10 monclient: _check_auth_tickets 2024-09-14T11:05:09.705 INFO:tasks.workunit.client.0.smithi097.stderr: -471> 2024-09-14T11:05:09.356+0000 7f978ef46800 5 monclient: authenticate success, global_id 6941 2024-09-14T11:05:09.706 INFO:tasks.workunit.client.0.smithi097.stderr: -470> 2024-09-14T11:05:09.356+0000 7f978ef46800 10 monclient: _renew_subs 2024-09-14T11:05:09.706 INFO:tasks.workunit.client.0.smithi097.stderr: -469> 2024-09-14T11:05:09.356+0000 7f978ef46800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:05:09.706 INFO:tasks.workunit.client.0.smithi097.stderr: -468> 2024-09-14T11:05:09.356+0000 7f967960a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:05:09.706 INFO:tasks.workunit.client.0.smithi097.stderr: -467> 2024-09-14T11:05:09.356+0000 7f967960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:05:09.706 INFO:tasks.workunit.client.0.smithi097.stderr: -466> 2024-09-14T11:05:09.356+0000 7f967960a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:05:09.706 INFO:tasks.workunit.client.0.smithi097.stderr: -465> 2024-09-14T11:05:09.356+0000 7f967960a640 10 monclient: dump: 2024-09-14T11:05:09.706 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:05:09.706 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:05:09.706 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:09.706 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:09.706 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:05:09.706 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:05:09.706 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:05:09.706 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:05:09.707 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:05:09.707 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:09.707 INFO:tasks.workunit.client.0.smithi097.stderr: -464> 2024-09-14T11:05:09.356+0000 7f967ae0d640 4 set_mon_vals no callback set 2024-09-14T11:05:09.707 INFO:tasks.workunit.client.0.smithi097.stderr: -463> 2024-09-14T11:05:09.356+0000 7f978ef46800 10 monclient: _renew_subs 2024-09-14T11:05:09.707 INFO:tasks.workunit.client.0.smithi097.stderr: -462> 2024-09-14T11:05:09.356+0000 7f978ef46800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:05:09.707 INFO:tasks.workunit.client.0.smithi097.stderr: -461> 2024-09-14T11:05:09.356+0000 7f978ef46800 1 librados: init done 2024-09-14T11:05:09.707 INFO:tasks.workunit.client.0.smithi097.stderr: -460> 2024-09-14T11:05:09.358+0000 7f967960a640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:05:09.707 INFO:tasks.workunit.client.0.smithi097.stderr: -459> 2024-09-14T11:05:09.358+0000 7f967960a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:05:09.707 INFO:tasks.workunit.client.0.smithi097.stderr: -458> 2024-09-14T11:05:09.358+0000 7f967960a640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:05:09.707 INFO:tasks.workunit.client.0.smithi097.stderr: -457> 2024-09-14T11:05:09.358+0000 7f9784236640 10 monclient: get_auth_request con 0x7f9674077230 auth_method 0 2024-09-14T11:05:09.707 INFO:tasks.workunit.client.0.smithi097.stderr: -456> 2024-09-14T11:05:09.358+0000 7f978d238640 10 monclient: get_auth_request con 0x55ec70473460 auth_method 0 2024-09-14T11:05:09.707 INFO:tasks.workunit.client.0.smithi097.stderr: -455> 2024-09-14T11:05:09.359+0000 7f978ca37640 10 monclient: get_auth_request con 0x55ec70495df0 auth_method 0 2024-09-14T11:05:09.707 INFO:tasks.workunit.client.0.smithi097.stderr: -454> 2024-09-14T11:05:09.360+0000 7f9784236640 10 monclient: get_auth_request con 0x55ec7049a150 auth_method 0 2024-09-14T11:05:09.708 INFO:tasks.workunit.client.0.smithi097.stderr: -453> 2024-09-14T11:05:09.361+0000 7f978d238640 10 monclient: get_auth_request con 0x55ec70499620 auth_method 0 2024-09-14T11:05:09.708 INFO:tasks.workunit.client.0.smithi097.stderr: -452> 2024-09-14T11:05:09.361+0000 7f978ef46800 10 monclient: build_initial_monmap 2024-09-14T11:05:09.708 INFO:tasks.workunit.client.0.smithi097.stderr: -451> 2024-09-14T11:05:09.361+0000 7f978ef46800 1 build_initial for_mkfs: 0 2024-09-14T11:05:09.708 INFO:tasks.workunit.client.0.smithi097.stderr: -450> 2024-09-14T11:05:09.362+0000 7f978ef46800 10 monclient: monmap: 2024-09-14T11:05:09.708 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:05:09.708 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:05:09.708 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:05:09.708 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:05:09.708 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:05:09.708 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:05:09.708 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:05:09.708 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:05:09.709 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:05:09.709 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:09.709 INFO:tasks.workunit.client.0.smithi097.stderr: -449> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a21e0) adding auth protocol: cephx 2024-09-14T11:05:09.709 INFO:tasks.workunit.client.0.smithi097.stderr: -448> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a21e0) adding auth protocol: cephx 2024-09-14T11:05:09.709 INFO:tasks.workunit.client.0.smithi097.stderr: -447> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a21e0) adding auth protocol: cephx 2024-09-14T11:05:09.709 INFO:tasks.workunit.client.0.smithi097.stderr: -446> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a21e0) adding con mode: secure 2024-09-14T11:05:09.709 INFO:tasks.workunit.client.0.smithi097.stderr: -445> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a21e0) adding con mode: crc 2024-09-14T11:05:09.709 INFO:tasks.workunit.client.0.smithi097.stderr: -444> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a21e0) adding con mode: secure 2024-09-14T11:05:09.709 INFO:tasks.workunit.client.0.smithi097.stderr: -443> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a21e0) adding con mode: crc 2024-09-14T11:05:09.709 INFO:tasks.workunit.client.0.smithi097.stderr: -442> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a21e0) adding con mode: secure 2024-09-14T11:05:09.709 INFO:tasks.workunit.client.0.smithi097.stderr: -441> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a21e0) adding con mode: crc 2024-09-14T11:05:09.709 INFO:tasks.workunit.client.0.smithi097.stderr: -440> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a21e0) adding con mode: crc 2024-09-14T11:05:09.709 INFO:tasks.workunit.client.0.smithi097.stderr: -439> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a21e0) adding con mode: secure 2024-09-14T11:05:09.709 INFO:tasks.workunit.client.0.smithi097.stderr: -438> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a21e0) adding con mode: crc 2024-09-14T11:05:09.710 INFO:tasks.workunit.client.0.smithi097.stderr: -437> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a21e0) adding con mode: secure 2024-09-14T11:05:09.710 INFO:tasks.workunit.client.0.smithi097.stderr: -436> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a21e0) adding con mode: crc 2024-09-14T11:05:09.710 INFO:tasks.workunit.client.0.smithi097.stderr: -435> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a21e0) adding con mode: secure 2024-09-14T11:05:09.710 INFO:tasks.workunit.client.0.smithi097.stderr: -434> 2024-09-14T11:05:09.362+0000 7f978ef46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:05:09.710 INFO:tasks.workunit.client.0.smithi097.stderr: -433> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 asok(0x55ec7022a270) register_command objecter_requests cmddesc objecter_requests hook 0x55ec704a5bd0 EEXIST 2024-09-14T11:05:09.710 INFO:tasks.workunit.client.0.smithi097.stderr: -432> 2024-09-14T11:05:09.362+0000 7f978ef46800 10 monclient: init 2024-09-14T11:05:09.710 INFO:tasks.workunit.client.0.smithi097.stderr: -431> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a10d8) adding auth protocol: cephx 2024-09-14T11:05:09.710 INFO:tasks.workunit.client.0.smithi097.stderr: -430> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a10d8) adding auth protocol: cephx 2024-09-14T11:05:09.710 INFO:tasks.workunit.client.0.smithi097.stderr: -429> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a10d8) adding auth protocol: cephx 2024-09-14T11:05:09.710 INFO:tasks.workunit.client.0.smithi097.stderr: -428> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a10d8) adding con mode: secure 2024-09-14T11:05:09.710 INFO:tasks.workunit.client.0.smithi097.stderr: -427> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a10d8) adding con mode: crc 2024-09-14T11:05:09.710 INFO:tasks.workunit.client.0.smithi097.stderr: -426> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a10d8) adding con mode: secure 2024-09-14T11:05:09.710 INFO:tasks.workunit.client.0.smithi097.stderr: -425> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a10d8) adding con mode: crc 2024-09-14T11:05:09.711 INFO:tasks.workunit.client.0.smithi097.stderr: -424> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a10d8) adding con mode: secure 2024-09-14T11:05:09.711 INFO:tasks.workunit.client.0.smithi097.stderr: -423> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a10d8) adding con mode: crc 2024-09-14T11:05:09.711 INFO:tasks.workunit.client.0.smithi097.stderr: -422> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a10d8) adding con mode: crc 2024-09-14T11:05:09.711 INFO:tasks.workunit.client.0.smithi097.stderr: -421> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a10d8) adding con mode: secure 2024-09-14T11:05:09.711 INFO:tasks.workunit.client.0.smithi097.stderr: -420> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a10d8) adding con mode: crc 2024-09-14T11:05:09.711 INFO:tasks.workunit.client.0.smithi097.stderr: -419> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a10d8) adding con mode: secure 2024-09-14T11:05:09.711 INFO:tasks.workunit.client.0.smithi097.stderr: -418> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a10d8) adding con mode: crc 2024-09-14T11:05:09.711 INFO:tasks.workunit.client.0.smithi097.stderr: -417> 2024-09-14T11:05:09.362+0000 7f978ef46800 5 AuthRegistry(0x55ec704a10d8) adding con mode: secure 2024-09-14T11:05:09.711 INFO:tasks.workunit.client.0.smithi097.stderr: -416> 2024-09-14T11:05:09.362+0000 7f978ef46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:05:09.711 INFO:tasks.workunit.client.0.smithi097.stderr: -415> 2024-09-14T11:05:09.362+0000 7f978ef46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:05:09.711 INFO:tasks.workunit.client.0.smithi097.stderr: -414> 2024-09-14T11:05:09.363+0000 7f978ef46800 5 asok(0x55ec7022a270) register_command rotate-key cmddesc rotate-key hook 0x55ec704a1220 EEXIST 2024-09-14T11:05:09.711 INFO:tasks.workunit.client.0.smithi097.stderr: -413> 2024-09-14T11:05:09.363+0000 7f978ef46800 10 monclient: _reopen_session rank -1 2024-09-14T11:05:09.711 INFO:tasks.workunit.client.0.smithi097.stderr: -412> 2024-09-14T11:05:09.363+0000 7f978ef46800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:05:09.712 INFO:tasks.workunit.client.0.smithi097.stderr: -411> 2024-09-14T11:05:09.363+0000 7f978ef46800 10 monclient(hunting): picked mon.noname-a con 0x55ec704c98c0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:05:09.712 INFO:tasks.workunit.client.0.smithi097.stderr: -410> 2024-09-14T11:05:09.363+0000 7f978ef46800 10 monclient(hunting): picked mon.noname-b con 0x55ec704cbb90 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:05:09.712 INFO:tasks.workunit.client.0.smithi097.stderr: -409> 2024-09-14T11:05:09.363+0000 7f978ef46800 10 monclient(hunting): picked mon.noname-c con 0x55ec704c8090 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:05:09.712 INFO:tasks.workunit.client.0.smithi097.stderr: -408> 2024-09-14T11:05:09.363+0000 7f978ef46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:05:09.712 INFO:tasks.workunit.client.0.smithi097.stderr: -407> 2024-09-14T11:05:09.363+0000 7f978ef46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:05:09.712 INFO:tasks.workunit.client.0.smithi097.stderr: -406> 2024-09-14T11:05:09.363+0000 7f978ef46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:05:09.712 INFO:tasks.workunit.client.0.smithi097.stderr: -405> 2024-09-14T11:05:09.363+0000 7f978ef46800 10 monclient(hunting): _renew_subs 2024-09-14T11:05:09.712 INFO:tasks.workunit.client.0.smithi097.stderr: -404> 2024-09-14T11:05:09.363+0000 7f978ef46800 10 monclient(hunting): authenticate will time out at 1991.016098s 2024-09-14T11:05:09.712 INFO:tasks.workunit.client.0.smithi097.stderr: -403> 2024-09-14T11:05:09.363+0000 7f9784236640 10 monclient(hunting): get_auth_request con 0x55ec704c98c0 auth_method 0 2024-09-14T11:05:09.712 INFO:tasks.workunit.client.0.smithi097.stderr: -402> 2024-09-14T11:05:09.363+0000 7f9784236640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:05:09.712 INFO:tasks.workunit.client.0.smithi097.stderr: -401> 2024-09-14T11:05:09.363+0000 7f9784236640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:05:09.712 INFO:tasks.workunit.client.0.smithi097.stderr: -400> 2024-09-14T11:05:09.363+0000 7f9784236640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:05:09.712 INFO:tasks.workunit.client.0.smithi097.stderr: -399> 2024-09-14T11:05:09.363+0000 7f978ca37640 10 monclient(hunting): get_auth_request con 0x55ec704c8090 auth_method 0 2024-09-14T11:05:09.713 INFO:tasks.workunit.client.0.smithi097.stderr: -398> 2024-09-14T11:05:09.363+0000 7f978ca37640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:05:09.713 INFO:tasks.workunit.client.0.smithi097.stderr: -397> 2024-09-14T11:05:09.363+0000 7f978ca37640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:05:09.713 INFO:tasks.workunit.client.0.smithi097.stderr: -396> 2024-09-14T11:05:09.363+0000 7f978ca37640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:05:09.713 INFO:tasks.workunit.client.0.smithi097.stderr: -395> 2024-09-14T11:05:09.363+0000 7f978d238640 10 monclient(hunting): get_auth_request con 0x55ec704cbb90 auth_method 0 2024-09-14T11:05:09.713 INFO:tasks.workunit.client.0.smithi097.stderr: -394> 2024-09-14T11:05:09.363+0000 7f978d238640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:05:09.713 INFO:tasks.workunit.client.0.smithi097.stderr: -393> 2024-09-14T11:05:09.363+0000 7f978d238640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:05:09.713 INFO:tasks.workunit.client.0.smithi097.stderr: -392> 2024-09-14T11:05:09.363+0000 7f978d238640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:05:09.713 INFO:tasks.workunit.client.0.smithi097.stderr: -391> 2024-09-14T11:05:09.363+0000 7f978ca37640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:05:09.713 INFO:tasks.workunit.client.0.smithi097.stderr: -390> 2024-09-14T11:05:09.363+0000 7f978ca37640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:05:09.713 INFO:tasks.workunit.client.0.smithi097.stderr: -389> 2024-09-14T11:05:09.363+0000 7f978ca37640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:05:09.713 INFO:tasks.workunit.client.0.smithi097.stderr: -388> 2024-09-14T11:05:09.363+0000 7f9784236640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:05:09.713 INFO:tasks.workunit.client.0.smithi097.stderr: -387> 2024-09-14T11:05:09.363+0000 7f9784236640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:05:09.713 INFO:tasks.workunit.client.0.smithi097.stderr: -386> 2024-09-14T11:05:09.363+0000 7f9784236640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:05:09.713 INFO:tasks.workunit.client.0.smithi097.stderr: -385> 2024-09-14T11:05:09.363+0000 7f978d238640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:05:09.714 INFO:tasks.workunit.client.0.smithi097.stderr: -384> 2024-09-14T11:05:09.363+0000 7f978d238640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:05:09.714 INFO:tasks.workunit.client.0.smithi097.stderr: -383> 2024-09-14T11:05:09.363+0000 7f978d238640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:05:09.714 INFO:tasks.workunit.client.0.smithi097.stderr: -382> 2024-09-14T11:05:09.363+0000 7f978ca37640 10 monclient(hunting): handle_auth_done global_id 6944 payload 824 2024-09-14T11:05:09.714 INFO:tasks.workunit.client.0.smithi097.stderr: -381> 2024-09-14T11:05:09.363+0000 7f978ca37640 10 monclient: _finish_hunting 0 2024-09-14T11:05:09.714 INFO:tasks.workunit.client.0.smithi097.stderr: -380> 2024-09-14T11:05:09.363+0000 7f978ca37640 1 monclient: found mon.noname-c 2024-09-14T11:05:09.714 INFO:tasks.workunit.client.0.smithi097.stderr: -379> 2024-09-14T11:05:09.363+0000 7f978ca37640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:05:09.714 INFO:tasks.workunit.client.0.smithi097.stderr: -378> 2024-09-14T11:05:09.363+0000 7f96727fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:05:09.714 INFO:tasks.workunit.client.0.smithi097.stderr: -377> 2024-09-14T11:05:09.363+0000 7f96727fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:05:09.714 INFO:tasks.workunit.client.0.smithi097.stderr: -376> 2024-09-14T11:05:09.363+0000 7f96727fc640 10 monclient: dump: 2024-09-14T11:05:09.714 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:05:09.714 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:05:09.714 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:09.714 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:09.714 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:05:09.715 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:05:09.715 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:05:09.715 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:05:09.715 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:05:09.715 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:09.715 INFO:tasks.workunit.client.0.smithi097.stderr: -375> 2024-09-14T11:05:09.363+0000 7f96727fc640 10 monclient: _finish_auth 0 2024-09-14T11:05:09.715 INFO:tasks.workunit.client.0.smithi097.stderr: -374> 2024-09-14T11:05:09.363+0000 7f96727fc640 10 monclient: _check_auth_tickets 2024-09-14T11:05:09.715 INFO:tasks.workunit.client.0.smithi097.stderr: -373> 2024-09-14T11:05:09.363+0000 7f96727fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:05:09.715 INFO:tasks.workunit.client.0.smithi097.stderr: -372> 2024-09-14T11:05:09.363+0000 7f96727fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:05:09.715 INFO:tasks.workunit.client.0.smithi097.stderr: -371> 2024-09-14T11:05:09.363+0000 7f96727fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:05:09.715 INFO:tasks.workunit.client.0.smithi097.stderr: -370> 2024-09-14T11:05:09.363+0000 7f96727fc640 10 monclient: dump: 2024-09-14T11:05:09.715 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:05:09.715 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:05:09.715 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:09.716 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:09.716 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:05:09.716 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:05:09.716 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:05:09.716 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:05:09.716 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:05:09.716 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:09.716 INFO:tasks.workunit.client.0.smithi097.stderr: -369> 2024-09-14T11:05:09.363+0000 7f978ef46800 5 monclient: authenticate success, global_id 6944 2024-09-14T11:05:09.716 INFO:tasks.workunit.client.0.smithi097.stderr: -368> 2024-09-14T11:05:09.363+0000 7f978ef46800 10 monclient: _renew_subs 2024-09-14T11:05:09.716 INFO:tasks.workunit.client.0.smithi097.stderr: -367> 2024-09-14T11:05:09.363+0000 7f978ef46800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:05:09.716 INFO:tasks.workunit.client.0.smithi097.stderr: -366> 2024-09-14T11:05:09.363+0000 7f978da39640 4 set_mon_vals no callback set 2024-09-14T11:05:09.716 INFO:tasks.workunit.client.0.smithi097.stderr: -365> 2024-09-14T11:05:09.363+0000 7f978ef46800 10 monclient: _renew_subs 2024-09-14T11:05:09.716 INFO:tasks.workunit.client.0.smithi097.stderr: -364> 2024-09-14T11:05:09.363+0000 7f978ef46800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:05:09.716 INFO:tasks.workunit.client.0.smithi097.stderr: -363> 2024-09-14T11:05:09.365+0000 7f96727fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:05:09.716 INFO:tasks.workunit.client.0.smithi097.stderr: -362> 2024-09-14T11:05:09.365+0000 7f96727fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:05:09.717 INFO:tasks.workunit.client.0.smithi097.stderr: -361> 2024-09-14T11:05:09.365+0000 7f96727fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:05:09.717 INFO:tasks.workunit.client.0.smithi097.stderr: -360> 2024-09-14T11:05:09.365+0000 7f9784236640 10 monclient: get_auth_request con 0x7f9664077140 auth_method 0 2024-09-14T11:05:09.717 INFO:tasks.workunit.client.0.smithi097.stderr: -359> 2024-09-14T11:05:09.365+0000 7f978ef46800 10 monclient: get_monmap_and_config 2024-09-14T11:05:09.717 INFO:tasks.workunit.client.0.smithi097.stderr: -358> 2024-09-14T11:05:09.365+0000 7f978ef46800 10 monclient: build_initial_monmap 2024-09-14T11:05:09.717 INFO:tasks.workunit.client.0.smithi097.stderr: -357> 2024-09-14T11:05:09.365+0000 7f978ef46800 1 build_initial for_mkfs: 0 2024-09-14T11:05:09.717 INFO:tasks.workunit.client.0.smithi097.stderr: -356> 2024-09-14T11:05:09.365+0000 7f978ef46800 10 monclient: monmap: 2024-09-14T11:05:09.717 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:05:09.717 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:05:09.717 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:05:09.717 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:05:09.717 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:05:09.717 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:05:09.717 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:05:09.718 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:05:09.718 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:05:09.718 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:09.718 INFO:tasks.workunit.client.0.smithi097.stderr: -355> 2024-09-14T11:05:09.365+0000 7f978ef46800 5 AuthRegistry(0x55ec704e9700) adding auth protocol: cephx 2024-09-14T11:05:09.718 INFO:tasks.workunit.client.0.smithi097.stderr: -354> 2024-09-14T11:05:09.365+0000 7f978ef46800 5 AuthRegistry(0x55ec704e9700) adding auth protocol: cephx 2024-09-14T11:05:09.718 INFO:tasks.workunit.client.0.smithi097.stderr: -353> 2024-09-14T11:05:09.365+0000 7f978ef46800 5 AuthRegistry(0x55ec704e9700) adding auth protocol: cephx 2024-09-14T11:05:09.718 INFO:tasks.workunit.client.0.smithi097.stderr: -352> 2024-09-14T11:05:09.365+0000 7f978ef46800 5 AuthRegistry(0x55ec704e9700) adding con mode: secure 2024-09-14T11:05:09.718 INFO:tasks.workunit.client.0.smithi097.stderr: -351> 2024-09-14T11:05:09.365+0000 7f978ef46800 5 AuthRegistry(0x55ec704e9700) adding con mode: crc 2024-09-14T11:05:09.718 INFO:tasks.workunit.client.0.smithi097.stderr: -350> 2024-09-14T11:05:09.365+0000 7f978ef46800 5 AuthRegistry(0x55ec704e9700) adding con mode: secure 2024-09-14T11:05:09.718 INFO:tasks.workunit.client.0.smithi097.stderr: -349> 2024-09-14T11:05:09.365+0000 7f978ef46800 5 AuthRegistry(0x55ec704e9700) adding con mode: crc 2024-09-14T11:05:09.718 INFO:tasks.workunit.client.0.smithi097.stderr: -348> 2024-09-14T11:05:09.365+0000 7f978ef46800 5 AuthRegistry(0x55ec704e9700) adding con mode: secure 2024-09-14T11:05:09.718 INFO:tasks.workunit.client.0.smithi097.stderr: -347> 2024-09-14T11:05:09.365+0000 7f978ef46800 5 AuthRegistry(0x55ec704e9700) adding con mode: crc 2024-09-14T11:05:09.718 INFO:tasks.workunit.client.0.smithi097.stderr: -346> 2024-09-14T11:05:09.365+0000 7f978ef46800 5 AuthRegistry(0x55ec704e9700) adding con mode: crc 2024-09-14T11:05:09.718 INFO:tasks.workunit.client.0.smithi097.stderr: -345> 2024-09-14T11:05:09.365+0000 7f978ef46800 5 AuthRegistry(0x55ec704e9700) adding con mode: secure 2024-09-14T11:05:09.719 INFO:tasks.workunit.client.0.smithi097.stderr: -344> 2024-09-14T11:05:09.365+0000 7f978ef46800 5 AuthRegistry(0x55ec704e9700) adding con mode: crc 2024-09-14T11:05:09.719 INFO:tasks.workunit.client.0.smithi097.stderr: -343> 2024-09-14T11:05:09.365+0000 7f978ef46800 5 AuthRegistry(0x55ec704e9700) adding con mode: secure 2024-09-14T11:05:09.719 INFO:tasks.workunit.client.0.smithi097.stderr: -342> 2024-09-14T11:05:09.365+0000 7f978ef46800 5 AuthRegistry(0x55ec704e9700) adding con mode: crc 2024-09-14T11:05:09.719 INFO:tasks.workunit.client.0.smithi097.stderr: -341> 2024-09-14T11:05:09.365+0000 7f978ef46800 5 AuthRegistry(0x55ec704e9700) adding con mode: secure 2024-09-14T11:05:09.719 INFO:tasks.workunit.client.0.smithi097.stderr: -340> 2024-09-14T11:05:09.366+0000 7f978ef46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:05:09.719 INFO:tasks.workunit.client.0.smithi097.stderr: -339> 2024-09-14T11:05:09.366+0000 7f978ef46800 10 monclient: init 2024-09-14T11:05:09.719 INFO:tasks.workunit.client.0.smithi097.stderr: -338> 2024-09-14T11:05:09.366+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22380) adding auth protocol: cephx 2024-09-14T11:05:09.719 INFO:tasks.workunit.client.0.smithi097.stderr: -337> 2024-09-14T11:05:09.366+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22380) adding auth protocol: cephx 2024-09-14T11:05:09.719 INFO:tasks.workunit.client.0.smithi097.stderr: -336> 2024-09-14T11:05:09.366+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22380) adding auth protocol: cephx 2024-09-14T11:05:09.719 INFO:tasks.workunit.client.0.smithi097.stderr: -335> 2024-09-14T11:05:09.366+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22380) adding con mode: secure 2024-09-14T11:05:09.719 INFO:tasks.workunit.client.0.smithi097.stderr: -334> 2024-09-14T11:05:09.366+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22380) adding con mode: crc 2024-09-14T11:05:09.719 INFO:tasks.workunit.client.0.smithi097.stderr: -333> 2024-09-14T11:05:09.366+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22380) adding con mode: secure 2024-09-14T11:05:09.719 INFO:tasks.workunit.client.0.smithi097.stderr: -332> 2024-09-14T11:05:09.366+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22380) adding con mode: crc 2024-09-14T11:05:09.719 INFO:tasks.workunit.client.0.smithi097.stderr: -331> 2024-09-14T11:05:09.366+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22380) adding con mode: secure 2024-09-14T11:05:09.720 INFO:tasks.workunit.client.0.smithi097.stderr: -330> 2024-09-14T11:05:09.366+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22380) adding con mode: crc 2024-09-14T11:05:09.720 INFO:tasks.workunit.client.0.smithi097.stderr: -329> 2024-09-14T11:05:09.366+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22380) adding con mode: crc 2024-09-14T11:05:09.720 INFO:tasks.workunit.client.0.smithi097.stderr: -328> 2024-09-14T11:05:09.366+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22380) adding con mode: secure 2024-09-14T11:05:09.720 INFO:tasks.workunit.client.0.smithi097.stderr: -327> 2024-09-14T11:05:09.366+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22380) adding con mode: crc 2024-09-14T11:05:09.720 INFO:tasks.workunit.client.0.smithi097.stderr: -326> 2024-09-14T11:05:09.366+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22380) adding con mode: secure 2024-09-14T11:05:09.720 INFO:tasks.workunit.client.0.smithi097.stderr: -325> 2024-09-14T11:05:09.366+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22380) adding con mode: crc 2024-09-14T11:05:09.720 INFO:tasks.workunit.client.0.smithi097.stderr: -324> 2024-09-14T11:05:09.366+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22380) adding con mode: secure 2024-09-14T11:05:09.720 INFO:tasks.workunit.client.0.smithi097.stderr: -323> 2024-09-14T11:05:09.366+0000 7f978ef46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:05:09.720 INFO:tasks.workunit.client.0.smithi097.stderr: -322> 2024-09-14T11:05:09.366+0000 7f978ef46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:05:09.720 INFO:tasks.workunit.client.0.smithi097.stderr: -321> 2024-09-14T11:05:09.366+0000 7f978ef46800 5 asok(0x55ec7022a270) register_command rotate-key cmddesc rotate-key hook 0x7ffcb0b224c8 EEXIST 2024-09-14T11:05:09.720 INFO:tasks.workunit.client.0.smithi097.stderr: -320> 2024-09-14T11:05:09.366+0000 7f978ef46800 10 monclient: _reopen_session rank -1 2024-09-14T11:05:09.720 INFO:tasks.workunit.client.0.smithi097.stderr: -319> 2024-09-14T11:05:09.366+0000 7f978ef46800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:05:09.720 INFO:tasks.workunit.client.0.smithi097.stderr: -318> 2024-09-14T11:05:09.366+0000 7f978ef46800 10 monclient(hunting): picked mon.noname-a con 0x55ec7051dde0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:05:09.720 INFO:tasks.workunit.client.0.smithi097.stderr: -317> 2024-09-14T11:05:09.366+0000 7f978ef46800 10 monclient(hunting): picked mon.noname-c con 0x55ec704edbf0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:05:09.721 INFO:tasks.workunit.client.0.smithi097.stderr: -316> 2024-09-14T11:05:09.366+0000 7f978ef46800 10 monclient(hunting): picked mon.noname-b con 0x55ec705191a0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:05:09.721 INFO:tasks.workunit.client.0.smithi097.stderr: -315> 2024-09-14T11:05:09.366+0000 7f978ef46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:05:09.721 INFO:tasks.workunit.client.0.smithi097.stderr: -314> 2024-09-14T11:05:09.366+0000 7f978ef46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:05:09.721 INFO:tasks.workunit.client.0.smithi097.stderr: -313> 2024-09-14T11:05:09.366+0000 7f978ef46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:05:09.721 INFO:tasks.workunit.client.0.smithi097.stderr: -312> 2024-09-14T11:05:09.366+0000 7f978ef46800 10 monclient(hunting): _renew_subs 2024-09-14T11:05:09.721 INFO:tasks.workunit.client.0.smithi097.stderr: -311> 2024-09-14T11:05:09.366+0000 7f978ef46800 10 monclient(hunting): authenticate will time out at 1991.019661s 2024-09-14T11:05:09.721 INFO:tasks.workunit.client.0.smithi097.stderr: -310> 2024-09-14T11:05:09.366+0000 7f9784236640 10 monclient(hunting): get_auth_request con 0x55ec7051dde0 auth_method 0 2024-09-14T11:05:09.721 INFO:tasks.workunit.client.0.smithi097.stderr: -309> 2024-09-14T11:05:09.366+0000 7f9784236640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:05:09.721 INFO:tasks.workunit.client.0.smithi097.stderr: -308> 2024-09-14T11:05:09.366+0000 7f9784236640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:05:09.721 INFO:tasks.workunit.client.0.smithi097.stderr: -307> 2024-09-14T11:05:09.366+0000 7f9784236640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:05:09.721 INFO:tasks.workunit.client.0.smithi097.stderr: -306> 2024-09-14T11:05:09.366+0000 7f978d238640 10 monclient(hunting): get_auth_request con 0x55ec704edbf0 auth_method 0 2024-09-14T11:05:09.721 INFO:tasks.workunit.client.0.smithi097.stderr: -305> 2024-09-14T11:05:09.366+0000 7f978d238640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:05:09.721 INFO:tasks.workunit.client.0.smithi097.stderr: -304> 2024-09-14T11:05:09.366+0000 7f978d238640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:05:09.722 INFO:tasks.workunit.client.0.smithi097.stderr: -303> 2024-09-14T11:05:09.366+0000 7f978d238640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:05:09.722 INFO:tasks.workunit.client.0.smithi097.stderr: -302> 2024-09-14T11:05:09.366+0000 7f9784236640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:05:09.722 INFO:tasks.workunit.client.0.smithi097.stderr: -301> 2024-09-14T11:05:09.366+0000 7f9784236640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:05:09.722 INFO:tasks.workunit.client.0.smithi097.stderr: -300> 2024-09-14T11:05:09.366+0000 7f9784236640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:05:09.722 INFO:tasks.workunit.client.0.smithi097.stderr: -299> 2024-09-14T11:05:09.366+0000 7f978d238640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:05:09.722 INFO:tasks.workunit.client.0.smithi097.stderr: -298> 2024-09-14T11:05:09.366+0000 7f978d238640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:05:09.722 INFO:tasks.workunit.client.0.smithi097.stderr: -297> 2024-09-14T11:05:09.366+0000 7f978d238640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:05:09.722 INFO:tasks.workunit.client.0.smithi097.stderr: -296> 2024-09-14T11:05:09.366+0000 7f9784236640 10 monclient(hunting): handle_auth_done global_id 7371 payload 274 2024-09-14T11:05:09.722 INFO:tasks.workunit.client.0.smithi097.stderr: -295> 2024-09-14T11:05:09.366+0000 7f9784236640 10 monclient: _finish_hunting 0 2024-09-14T11:05:09.722 INFO:tasks.workunit.client.0.smithi097.stderr: -294> 2024-09-14T11:05:09.366+0000 7f9784236640 1 monclient: found mon.noname-a 2024-09-14T11:05:09.722 INFO:tasks.workunit.client.0.smithi097.stderr: -293> 2024-09-14T11:05:09.366+0000 7f9784236640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-14T11:05:09.722 INFO:tasks.workunit.client.0.smithi097.stderr: -292> 2024-09-14T11:05:09.367+0000 7f9663fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:05:09.722 INFO:tasks.workunit.client.0.smithi097.stderr: -291> 2024-09-14T11:05:09.367+0000 7f9663fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:05:09.722 INFO:tasks.workunit.client.0.smithi097.stderr: -290> 2024-09-14T11:05:09.367+0000 7f9663fff640 10 monclient: dump: 2024-09-14T11:05:09.722 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:05:09.723 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:05:09.723 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:09.723 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:09.723 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:05:09.723 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:05:09.723 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:05:09.723 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:05:09.723 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:05:09.723 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:09.723 INFO:tasks.workunit.client.0.smithi097.stderr: -289> 2024-09-14T11:05:09.367+0000 7f9663fff640 10 monclient: _finish_auth 0 2024-09-14T11:05:09.723 INFO:tasks.workunit.client.0.smithi097.stderr: -288> 2024-09-14T11:05:09.367+0000 7f9663fff640 10 monclient: _check_auth_tickets 2024-09-14T11:05:09.723 INFO:tasks.workunit.client.0.smithi097.stderr: -287> 2024-09-14T11:05:09.367+0000 7f9663fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:05:09.723 INFO:tasks.workunit.client.0.smithi097.stderr: -286> 2024-09-14T11:05:09.367+0000 7f978ef46800 5 monclient: authenticate success, global_id 7371 2024-09-14T11:05:09.723 INFO:tasks.workunit.client.0.smithi097.stderr: -285> 2024-09-14T11:05:09.367+0000 7f978ef46800 10 monclient: get_monmap_and_config success 2024-09-14T11:05:09.723 INFO:tasks.workunit.client.0.smithi097.stderr: -284> 2024-09-14T11:05:09.367+0000 7f978ef46800 4 set_mon_vals no callback set 2024-09-14T11:05:09.724 INFO:tasks.workunit.client.0.smithi097.stderr: -283> 2024-09-14T11:05:09.367+0000 7f9663fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:05:09.724 INFO:tasks.workunit.client.0.smithi097.stderr: -282> 2024-09-14T11:05:09.367+0000 7f9663fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:05:09.724 INFO:tasks.workunit.client.0.smithi097.stderr: -281> 2024-09-14T11:05:09.367+0000 7f9663fff640 10 monclient: dump: 2024-09-14T11:05:09.724 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:05:09.724 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:05:09.724 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:09.724 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:09.724 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:05:09.724 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:05:09.724 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:05:09.724 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:05:09.724 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:05:09.724 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:09.724 INFO:tasks.workunit.client.0.smithi097.stderr: -280> 2024-09-14T11:05:09.367+0000 7f978ef46800 10 monclient: shutdown 2024-09-14T11:05:09.724 INFO:tasks.workunit.client.0.smithi097.stderr: -279> 2024-09-14T11:05:09.367+0000 7f978ef46800 10 monclient: build_initial_monmap 2024-09-14T11:05:09.725 INFO:tasks.workunit.client.0.smithi097.stderr: -278> 2024-09-14T11:05:09.367+0000 7f978ef46800 1 build_initial for_mkfs: 0 2024-09-14T11:05:09.725 INFO:tasks.workunit.client.0.smithi097.stderr: -277> 2024-09-14T11:05:09.367+0000 7f978ef46800 10 monclient: monmap: 2024-09-14T11:05:09.725 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:05:09.725 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:05:09.725 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:05:09.725 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:05:09.725 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:05:09.725 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:05:09.725 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:05:09.725 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:05:09.725 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:05:09.725 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:09.726 INFO:tasks.workunit.client.0.smithi097.stderr: -276> 2024-09-14T11:05:09.367+0000 7f978ef46800 5 AuthRegistry(0x55ec704eea30) adding auth protocol: cephx 2024-09-14T11:05:09.726 INFO:tasks.workunit.client.0.smithi097.stderr: -275> 2024-09-14T11:05:09.367+0000 7f978ef46800 5 AuthRegistry(0x55ec704eea30) adding auth protocol: cephx 2024-09-14T11:05:09.726 INFO:tasks.workunit.client.0.smithi097.stderr: -274> 2024-09-14T11:05:09.367+0000 7f978ef46800 5 AuthRegistry(0x55ec704eea30) adding auth protocol: cephx 2024-09-14T11:05:09.726 INFO:tasks.workunit.client.0.smithi097.stderr: -273> 2024-09-14T11:05:09.367+0000 7f978ef46800 5 AuthRegistry(0x55ec704eea30) adding con mode: secure 2024-09-14T11:05:09.726 INFO:tasks.workunit.client.0.smithi097.stderr: -272> 2024-09-14T11:05:09.367+0000 7f978ef46800 5 AuthRegistry(0x55ec704eea30) adding con mode: crc 2024-09-14T11:05:09.726 INFO:tasks.workunit.client.0.smithi097.stderr: -271> 2024-09-14T11:05:09.367+0000 7f978ef46800 5 AuthRegistry(0x55ec704eea30) adding con mode: secure 2024-09-14T11:05:09.726 INFO:tasks.workunit.client.0.smithi097.stderr: -270> 2024-09-14T11:05:09.367+0000 7f978ef46800 5 AuthRegistry(0x55ec704eea30) adding con mode: crc 2024-09-14T11:05:09.726 INFO:tasks.workunit.client.0.smithi097.stderr: -269> 2024-09-14T11:05:09.367+0000 7f978ef46800 5 AuthRegistry(0x55ec704eea30) adding con mode: secure 2024-09-14T11:05:09.726 INFO:tasks.workunit.client.0.smithi097.stderr: -268> 2024-09-14T11:05:09.367+0000 7f978ef46800 5 AuthRegistry(0x55ec704eea30) adding con mode: crc 2024-09-14T11:05:09.726 INFO:tasks.workunit.client.0.smithi097.stderr: -267> 2024-09-14T11:05:09.367+0000 7f978ef46800 5 AuthRegistry(0x55ec704eea30) adding con mode: crc 2024-09-14T11:05:09.726 INFO:tasks.workunit.client.0.smithi097.stderr: -266> 2024-09-14T11:05:09.367+0000 7f978ef46800 5 AuthRegistry(0x55ec704eea30) adding con mode: secure 2024-09-14T11:05:09.726 INFO:tasks.workunit.client.0.smithi097.stderr: -265> 2024-09-14T11:05:09.367+0000 7f978ef46800 5 AuthRegistry(0x55ec704eea30) adding con mode: crc 2024-09-14T11:05:09.726 INFO:tasks.workunit.client.0.smithi097.stderr: -264> 2024-09-14T11:05:09.367+0000 7f978ef46800 5 AuthRegistry(0x55ec704eea30) adding con mode: secure 2024-09-14T11:05:09.726 INFO:tasks.workunit.client.0.smithi097.stderr: -263> 2024-09-14T11:05:09.367+0000 7f978ef46800 5 AuthRegistry(0x55ec704eea30) adding con mode: crc 2024-09-14T11:05:09.726 INFO:tasks.workunit.client.0.smithi097.stderr: -262> 2024-09-14T11:05:09.367+0000 7f978ef46800 5 AuthRegistry(0x55ec704eea30) adding con mode: secure 2024-09-14T11:05:09.726 INFO:tasks.workunit.client.0.smithi097.stderr: -261> 2024-09-14T11:05:09.368+0000 7f978ef46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:05:09.727 INFO:tasks.workunit.client.0.smithi097.stderr: -260> 2024-09-14T11:05:09.368+0000 7f978ef46800 1 librados: starting msgr at 2024-09-14T11:05:09.727 INFO:tasks.workunit.client.0.smithi097.stderr: -259> 2024-09-14T11:05:09.368+0000 7f978ef46800 1 librados: starting objecter 2024-09-14T11:05:09.727 INFO:tasks.workunit.client.0.smithi097.stderr: -258> 2024-09-14T11:05:09.368+0000 7f978ef46800 5 asok(0x55ec7022a270) register_command objecter_requests cmddesc objecter_requests hook 0x55ec704ec010 EEXIST 2024-09-14T11:05:09.727 INFO:tasks.workunit.client.0.smithi097.stderr: -257> 2024-09-14T11:05:09.368+0000 7f978ef46800 1 librados: setting wanted keys 2024-09-14T11:05:09.727 INFO:tasks.workunit.client.0.smithi097.stderr: -256> 2024-09-14T11:05:09.368+0000 7f978ef46800 1 librados: calling monclient init 2024-09-14T11:05:09.727 INFO:tasks.workunit.client.0.smithi097.stderr: -255> 2024-09-14T11:05:09.368+0000 7f978ef46800 10 monclient: init 2024-09-14T11:05:09.727 INFO:tasks.workunit.client.0.smithi097.stderr: -254> 2024-09-14T11:05:09.368+0000 7f978ef46800 5 AuthRegistry(0x55ec704e1670) adding auth protocol: cephx 2024-09-14T11:05:09.727 INFO:tasks.workunit.client.0.smithi097.stderr: -253> 2024-09-14T11:05:09.368+0000 7f978ef46800 5 AuthRegistry(0x55ec704e1670) adding auth protocol: cephx 2024-09-14T11:05:09.727 INFO:tasks.workunit.client.0.smithi097.stderr: -252> 2024-09-14T11:05:09.368+0000 7f978ef46800 5 AuthRegistry(0x55ec704e1670) adding auth protocol: cephx 2024-09-14T11:05:09.727 INFO:tasks.workunit.client.0.smithi097.stderr: -251> 2024-09-14T11:05:09.368+0000 7f978ef46800 5 AuthRegistry(0x55ec704e1670) adding con mode: secure 2024-09-14T11:05:09.727 INFO:tasks.workunit.client.0.smithi097.stderr: -250> 2024-09-14T11:05:09.368+0000 7f978ef46800 5 AuthRegistry(0x55ec704e1670) adding con mode: crc 2024-09-14T11:05:09.727 INFO:tasks.workunit.client.0.smithi097.stderr: -249> 2024-09-14T11:05:09.368+0000 7f978ef46800 5 AuthRegistry(0x55ec704e1670) adding con mode: secure 2024-09-14T11:05:09.727 INFO:tasks.workunit.client.0.smithi097.stderr: -248> 2024-09-14T11:05:09.368+0000 7f978ef46800 5 AuthRegistry(0x55ec704e1670) adding con mode: crc 2024-09-14T11:05:09.727 INFO:tasks.workunit.client.0.smithi097.stderr: -247> 2024-09-14T11:05:09.368+0000 7f978ef46800 5 AuthRegistry(0x55ec704e1670) adding con mode: secure 2024-09-14T11:05:09.728 INFO:tasks.workunit.client.0.smithi097.stderr: -246> 2024-09-14T11:05:09.368+0000 7f978ef46800 5 AuthRegistry(0x55ec704e1670) adding con mode: crc 2024-09-14T11:05:09.728 INFO:tasks.workunit.client.0.smithi097.stderr: -245> 2024-09-14T11:05:09.368+0000 7f978ef46800 5 AuthRegistry(0x55ec704e1670) adding con mode: crc 2024-09-14T11:05:09.728 INFO:tasks.workunit.client.0.smithi097.stderr: -244> 2024-09-14T11:05:09.368+0000 7f978ef46800 5 AuthRegistry(0x55ec704e1670) adding con mode: secure 2024-09-14T11:05:09.728 INFO:tasks.workunit.client.0.smithi097.stderr: -243> 2024-09-14T11:05:09.368+0000 7f978ef46800 5 AuthRegistry(0x55ec704e1670) adding con mode: crc 2024-09-14T11:05:09.728 INFO:tasks.workunit.client.0.smithi097.stderr: -242> 2024-09-14T11:05:09.368+0000 7f978ef46800 5 AuthRegistry(0x55ec704e1670) adding con mode: secure 2024-09-14T11:05:09.728 INFO:tasks.workunit.client.0.smithi097.stderr: -241> 2024-09-14T11:05:09.368+0000 7f978ef46800 5 AuthRegistry(0x55ec704e1670) adding con mode: crc 2024-09-14T11:05:09.728 INFO:tasks.workunit.client.0.smithi097.stderr: -240> 2024-09-14T11:05:09.368+0000 7f978ef46800 5 AuthRegistry(0x55ec704e1670) adding con mode: secure 2024-09-14T11:05:09.728 INFO:tasks.workunit.client.0.smithi097.stderr: -239> 2024-09-14T11:05:09.368+0000 7f978ef46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:05:09.728 INFO:tasks.workunit.client.0.smithi097.stderr: -238> 2024-09-14T11:05:09.368+0000 7f978ef46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:05:09.728 INFO:tasks.workunit.client.0.smithi097.stderr: -237> 2024-09-14T11:05:09.368+0000 7f978ef46800 5 asok(0x55ec7022a270) register_command rotate-key cmddesc rotate-key hook 0x55ec704e17b8 EEXIST 2024-09-14T11:05:09.728 INFO:tasks.workunit.client.0.smithi097.stderr: -236> 2024-09-14T11:05:09.368+0000 7f978ef46800 10 monclient: _reopen_session rank -1 2024-09-14T11:05:09.728 INFO:tasks.workunit.client.0.smithi097.stderr: -235> 2024-09-14T11:05:09.368+0000 7f978ef46800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:05:09.728 INFO:tasks.workunit.client.0.smithi097.stderr: -234> 2024-09-14T11:05:09.368+0000 7f978ef46800 10 monclient(hunting): picked mon.noname-a con 0x55ec704edbf0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:05:09.729 INFO:tasks.workunit.client.0.smithi097.stderr: -233> 2024-09-14T11:05:09.368+0000 7f978ef46800 10 monclient(hunting): picked mon.noname-b con 0x55ec705191a0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:05:09.729 INFO:tasks.workunit.client.0.smithi097.stderr: -232> 2024-09-14T11:05:09.368+0000 7f978ef46800 10 monclient(hunting): picked mon.noname-c con 0x55ec7051dde0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:05:09.729 INFO:tasks.workunit.client.0.smithi097.stderr: -231> 2024-09-14T11:05:09.368+0000 7f978ef46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:05:09.729 INFO:tasks.workunit.client.0.smithi097.stderr: -230> 2024-09-14T11:05:09.368+0000 7f978ef46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:05:09.729 INFO:tasks.workunit.client.0.smithi097.stderr: -229> 2024-09-14T11:05:09.368+0000 7f978ef46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:05:09.729 INFO:tasks.workunit.client.0.smithi097.stderr: -228> 2024-09-14T11:05:09.368+0000 7f978ef46800 10 monclient(hunting): _renew_subs 2024-09-14T11:05:09.729 INFO:tasks.workunit.client.0.smithi097.stderr: -227> 2024-09-14T11:05:09.368+0000 7f978ef46800 10 monclient(hunting): authenticate will time out at 1991.021881s 2024-09-14T11:05:09.729 INFO:tasks.workunit.client.0.smithi097.stderr: -226> 2024-09-14T11:05:09.368+0000 7f9784236640 10 monclient(hunting): get_auth_request con 0x55ec704edbf0 auth_method 0 2024-09-14T11:05:09.729 INFO:tasks.workunit.client.0.smithi097.stderr: -225> 2024-09-14T11:05:09.368+0000 7f9784236640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:05:09.729 INFO:tasks.workunit.client.0.smithi097.stderr: -224> 2024-09-14T11:05:09.368+0000 7f9784236640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:05:09.729 INFO:tasks.workunit.client.0.smithi097.stderr: -223> 2024-09-14T11:05:09.368+0000 7f9784236640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:05:09.729 INFO:tasks.workunit.client.0.smithi097.stderr: -222> 2024-09-14T11:05:09.368+0000 7f978ca37640 10 monclient(hunting): get_auth_request con 0x55ec7051dde0 auth_method 0 2024-09-14T11:05:09.729 INFO:tasks.workunit.client.0.smithi097.stderr: -221> 2024-09-14T11:05:09.368+0000 7f978ca37640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:05:09.729 INFO:tasks.workunit.client.0.smithi097.stderr: -220> 2024-09-14T11:05:09.368+0000 7f978ca37640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:05:09.730 INFO:tasks.workunit.client.0.smithi097.stderr: -219> 2024-09-14T11:05:09.368+0000 7f978ca37640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:05:09.730 INFO:tasks.workunit.client.0.smithi097.stderr: -218> 2024-09-14T11:05:09.369+0000 7f978d238640 10 monclient(hunting): get_auth_request con 0x55ec705191a0 auth_method 0 2024-09-14T11:05:09.730 INFO:tasks.workunit.client.0.smithi097.stderr: -217> 2024-09-14T11:05:09.369+0000 7f978d238640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:05:09.730 INFO:tasks.workunit.client.0.smithi097.stderr: -216> 2024-09-14T11:05:09.369+0000 7f978d238640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:05:09.730 INFO:tasks.workunit.client.0.smithi097.stderr: -215> 2024-09-14T11:05:09.369+0000 7f978d238640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:05:09.730 INFO:tasks.workunit.client.0.smithi097.stderr: -214> 2024-09-14T11:05:09.369+0000 7f9784236640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:05:09.730 INFO:tasks.workunit.client.0.smithi097.stderr: -213> 2024-09-14T11:05:09.369+0000 7f9784236640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:05:09.730 INFO:tasks.workunit.client.0.smithi097.stderr: -212> 2024-09-14T11:05:09.369+0000 7f9784236640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:05:09.730 INFO:tasks.workunit.client.0.smithi097.stderr: -211> 2024-09-14T11:05:09.369+0000 7f978ca37640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:05:09.730 INFO:tasks.workunit.client.0.smithi097.stderr: -210> 2024-09-14T11:05:09.369+0000 7f978ca37640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:05:09.730 INFO:tasks.workunit.client.0.smithi097.stderr: -209> 2024-09-14T11:05:09.369+0000 7f978ca37640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:05:09.730 INFO:tasks.workunit.client.0.smithi097.stderr: -208> 2024-09-14T11:05:09.369+0000 7f978d238640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:05:09.730 INFO:tasks.workunit.client.0.smithi097.stderr: -207> 2024-09-14T11:05:09.369+0000 7f978d238640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:05:09.730 INFO:tasks.workunit.client.0.smithi097.stderr: -206> 2024-09-14T11:05:09.369+0000 7f978d238640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:05:09.730 INFO:tasks.workunit.client.0.smithi097.stderr: -205> 2024-09-14T11:05:09.369+0000 7f9784236640 10 monclient(hunting): handle_auth_done global_id 7374 payload 824 2024-09-14T11:05:09.731 INFO:tasks.workunit.client.0.smithi097.stderr: -204> 2024-09-14T11:05:09.369+0000 7f9784236640 10 monclient: _finish_hunting 0 2024-09-14T11:05:09.731 INFO:tasks.workunit.client.0.smithi097.stderr: -203> 2024-09-14T11:05:09.369+0000 7f9784236640 1 monclient: found mon.noname-a 2024-09-14T11:05:09.731 INFO:tasks.workunit.client.0.smithi097.stderr: -202> 2024-09-14T11:05:09.369+0000 7f9784236640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-14T11:05:09.731 INFO:tasks.workunit.client.0.smithi097.stderr: -201> 2024-09-14T11:05:09.369+0000 7f96627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:05:09.731 INFO:tasks.workunit.client.0.smithi097.stderr: -200> 2024-09-14T11:05:09.369+0000 7f96627fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:05:09.731 INFO:tasks.workunit.client.0.smithi097.stderr: -199> 2024-09-14T11:05:09.369+0000 7f96627fc640 10 monclient: dump: 2024-09-14T11:05:09.731 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:05:09.731 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:05:09.731 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:09.731 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:09.731 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:05:09.731 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:05:09.731 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:05:09.732 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:05:09.732 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:05:09.732 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:09.732 INFO:tasks.workunit.client.0.smithi097.stderr: -198> 2024-09-14T11:05:09.369+0000 7f96627fc640 10 monclient: _finish_auth 0 2024-09-14T11:05:09.732 INFO:tasks.workunit.client.0.smithi097.stderr: -197> 2024-09-14T11:05:09.369+0000 7f96627fc640 10 monclient: _check_auth_tickets 2024-09-14T11:05:09.732 INFO:tasks.workunit.client.0.smithi097.stderr: -196> 2024-09-14T11:05:09.369+0000 7f978ef46800 5 monclient: authenticate success, global_id 7374 2024-09-14T11:05:09.732 INFO:tasks.workunit.client.0.smithi097.stderr: -195> 2024-09-14T11:05:09.369+0000 7f96627fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:05:09.732 INFO:tasks.workunit.client.0.smithi097.stderr: -194> 2024-09-14T11:05:09.369+0000 7f96627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:05:09.732 INFO:tasks.workunit.client.0.smithi097.stderr: -193> 2024-09-14T11:05:09.369+0000 7f96627fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:05:09.732 INFO:tasks.workunit.client.0.smithi097.stderr: -192> 2024-09-14T11:05:09.369+0000 7f96627fc640 10 monclient: dump: 2024-09-14T11:05:09.732 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:05:09.732 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:05:09.732 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:09.733 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:09.733 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:05:09.733 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:05:09.733 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:05:09.733 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:05:09.733 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:05:09.733 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:09.733 INFO:tasks.workunit.client.0.smithi097.stderr: -191> 2024-09-14T11:05:09.369+0000 7f978ef46800 10 monclient: _renew_subs 2024-09-14T11:05:09.733 INFO:tasks.workunit.client.0.smithi097.stderr: -190> 2024-09-14T11:05:09.369+0000 7f9663fff640 4 set_mon_vals no callback set 2024-09-14T11:05:09.733 INFO:tasks.workunit.client.0.smithi097.stderr: -189> 2024-09-14T11:05:09.369+0000 7f978ef46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:05:09.733 INFO:tasks.workunit.client.0.smithi097.stderr: -188> 2024-09-14T11:05:09.369+0000 7f978ef46800 10 monclient: _renew_subs 2024-09-14T11:05:09.733 INFO:tasks.workunit.client.0.smithi097.stderr: -187> 2024-09-14T11:05:09.369+0000 7f978ef46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:05:09.733 INFO:tasks.workunit.client.0.smithi097.stderr: -186> 2024-09-14T11:05:09.369+0000 7f978ef46800 1 librados: init done 2024-09-14T11:05:09.733 INFO:tasks.workunit.client.0.smithi097.stderr: -185> 2024-09-14T11:05:09.369+0000 7f978ef46800 5 asok(0x55ec7022a270) register_command cr dump hook 0x55ec70513c68 2024-09-14T11:05:09.734 INFO:tasks.workunit.client.0.smithi097.stderr: -184> 2024-09-14T11:05:09.371+0000 7f978ef46800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.734 INFO:tasks.workunit.client.0.smithi097.stderr: -183> 2024-09-14T11:05:09.371+0000 7f96627fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:05:09.734 INFO:tasks.workunit.client.0.smithi097.stderr: -182> 2024-09-14T11:05:09.371+0000 7f96627fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:05:09.734 INFO:tasks.workunit.client.0.smithi097.stderr: -181> 2024-09-14T11:05:09.371+0000 7f96627fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:05:09.734 INFO:tasks.workunit.client.0.smithi097.stderr: -180> 2024-09-14T11:05:09.371+0000 7f978d238640 10 monclient: get_auth_request con 0x7f9658077230 auth_method 0 2024-09-14T11:05:09.734 INFO:tasks.workunit.client.0.smithi097.stderr: -179> 2024-09-14T11:05:09.372+0000 7f978ca37640 10 monclient: get_auth_request con 0x55ec70538680 auth_method 0 2024-09-14T11:05:09.734 INFO:tasks.workunit.client.0.smithi097.stderr: -178> 2024-09-14T11:05:09.372+0000 7f978ef46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:09.734 INFO:tasks.workunit.client.0.smithi097.stderr: -177> 2024-09-14T11:05:09.372+0000 7f978ef46800 20 realm 2024-09-14T11:05:09.734 INFO:tasks.workunit.client.0.smithi097.stderr: -176> 2024-09-14T11:05:09.372+0000 7f978ef46800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.734 INFO:tasks.workunit.client.0.smithi097.stderr: -175> 2024-09-14T11:05:09.372+0000 7f978ef46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:09.734 INFO:tasks.workunit.client.0.smithi097.stderr: -174> 2024-09-14T11:05:09.372+0000 7f978ef46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:05:09.734 INFO:tasks.workunit.client.0.smithi097.stderr: -173> 2024-09-14T11:05:09.372+0000 7f978ef46800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.734 INFO:tasks.workunit.client.0.smithi097.stderr: -172> 2024-09-14T11:05:09.373+0000 7f978ef46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:09.735 INFO:tasks.workunit.client.0.smithi097.stderr: -171> 2024-09-14T11:05:09.373+0000 7f978ef46800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.735 INFO:tasks.workunit.client.0.smithi097.stderr: -170> 2024-09-14T11:05:09.373+0000 7f9784236640 10 monclient: get_auth_request con 0x55ec7053c8c0 auth_method 0 2024-09-14T11:05:09.735 INFO:tasks.workunit.client.0.smithi097.stderr: -169> 2024-09-14T11:05:09.373+0000 7f978ef46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:09.735 INFO:tasks.workunit.client.0.smithi097.stderr: -168> 2024-09-14T11:05:09.373+0000 7f978ef46800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.735 INFO:tasks.workunit.client.0.smithi097.stderr: -167> 2024-09-14T11:05:09.374+0000 7f978d238640 10 monclient: get_auth_request con 0x55ec70540100 auth_method 0 2024-09-14T11:05:09.735 INFO:tasks.workunit.client.0.smithi097.stderr: -166> 2024-09-14T11:05:09.374+0000 7f978ef46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:05:09.735 INFO:tasks.workunit.client.0.smithi097.stderr: -165> 2024-09-14T11:05:09.374+0000 7f978ef46800 20 searching for the correct realm 2024-09-14T11:05:09.735 INFO:tasks.workunit.client.0.smithi097.stderr: -164> 2024-09-14T11:05:09.374+0000 7f978ca37640 10 monclient: get_auth_request con 0x55ec70544ee0 auth_method 0 2024-09-14T11:05:09.735 INFO:tasks.workunit.client.0.smithi097.stderr: -163> 2024-09-14T11:05:09.375+0000 7f9784236640 10 monclient: get_auth_request con 0x7f977c087050 auth_method 0 2024-09-14T11:05:09.735 INFO:tasks.workunit.client.0.smithi097.stderr: -162> 2024-09-14T11:05:09.376+0000 7f978d238640 0 -- 172.21.15.97:0/1560020169 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f97740a2070 msgr2=0x7f97740030b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:05:09.735 INFO:tasks.workunit.client.0.smithi097.stderr: -161> 2024-09-14T11:05:09.578+0000 7f978d238640 10 monclient: get_auth_request con 0x7f97740a2070 auth_method 0 2024-09-14T11:05:09.735 INFO:tasks.workunit.client.0.smithi097.stderr: -160> 2024-09-14T11:05:09.581+0000 7f978ca37640 10 monclient: get_auth_request con 0x7f9774097030 auth_method 0 2024-09-14T11:05:09.735 INFO:tasks.workunit.client.0.smithi097.stderr: -159> 2024-09-14T11:05:09.582+0000 7f9784236640 10 monclient: get_auth_request con 0x7f977c092230 auth_method 0 2024-09-14T11:05:09.735 INFO:tasks.workunit.client.0.smithi097.stderr: -158> 2024-09-14T11:05:09.582+0000 7f9784236640 0 -- 172.21.15.97:0/1560020169 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f977c092230 msgr2=0x7f977c066180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:05:09.736 INFO:tasks.workunit.client.0.smithi097.stderr: -157> 2024-09-14T11:05:09.582+0000 7f96627fc640 1 client.7374.objecter ms_handle_reset 0x7f977c092230 session 0x7f977c0900b0 osd.3 2024-09-14T11:05:09.736 INFO:tasks.workunit.client.0.smithi097.stderr: -156> 2024-09-14T11:05:09.582+0000 7f96627fc640 10 monclient: _renew_subs 2024-09-14T11:05:09.736 INFO:tasks.workunit.client.0.smithi097.stderr: -155> 2024-09-14T11:05:09.582+0000 7f96627fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:05:09.736 INFO:tasks.workunit.client.0.smithi097.stderr: -154> 2024-09-14T11:05:09.582+0000 7f9784236640 10 monclient: get_auth_request con 0x7f9658086d50 auth_method 0 2024-09-14T11:05:09.736 INFO:tasks.workunit.client.0.smithi097.stderr: -153> 2024-09-14T11:05:09.587+0000 7f978ef46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:05:09.736 INFO:tasks.workunit.client.0.smithi097.stderr: -152> 2024-09-14T11:05:09.587+0000 7f978ef46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:05:09.736 INFO:tasks.workunit.client.0.smithi097.stderr: -151> 2024-09-14T11:05:09.587+0000 7f978ef46800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:05:09.736 INFO:tasks.workunit.client.0.smithi097.stderr: -150> 2024-09-14T11:05:09.587+0000 7f978ef46800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:05:09.736 INFO:tasks.workunit.client.0.smithi097.stderr: -149> 2024-09-14T11:05:09.587+0000 7f978ef46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:05:09.736 INFO:tasks.workunit.client.0.smithi097.stderr: -148> 2024-09-14T11:05:09.587+0000 7f978ef46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:05:09.736 INFO:tasks.workunit.client.0.smithi097.stderr: -147> 2024-09-14T11:05:09.587+0000 7f978ef46800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.736 INFO:tasks.workunit.client.0.smithi097.stderr: -146> 2024-09-14T11:05:09.587+0000 7f978ef46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:09.736 INFO:tasks.workunit.client.0.smithi097.stderr: -145> 2024-09-14T11:05:09.587+0000 7f978ef46800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.737 INFO:tasks.workunit.client.0.smithi097.stderr: -144> 2024-09-14T11:05:09.587+0000 7f978ef46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:09.737 INFO:tasks.workunit.client.0.smithi097.stderr: -143> 2024-09-14T11:05:09.587+0000 7f978ef46800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.737 INFO:tasks.workunit.client.0.smithi097.stderr: -142> 2024-09-14T11:05:09.588+0000 7f978ef46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:05:09.737 INFO:tasks.workunit.client.0.smithi097.stderr: -141> 2024-09-14T11:05:09.588+0000 7f978ef46800 20 zone default found 2024-09-14T11:05:09.737 INFO:tasks.workunit.client.0.smithi097.stderr: -140> 2024-09-14T11:05:09.588+0000 7f978ef46800 4 Realm: () 2024-09-14T11:05:09.737 INFO:tasks.workunit.client.0.smithi097.stderr: -139> 2024-09-14T11:05:09.588+0000 7f978ef46800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:05:09.737 INFO:tasks.workunit.client.0.smithi097.stderr: -138> 2024-09-14T11:05:09.588+0000 7f978ef46800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:05:09.737 INFO:tasks.workunit.client.0.smithi097.stderr: -137> 2024-09-14T11:05:09.588+0000 7f978ef46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:05:09.737 INFO:tasks.workunit.client.0.smithi097.stderr: -136> 2024-09-14T11:05:09.588+0000 7f978ef46800 20 zonegroup default 2024-09-14T11:05:09.737 INFO:tasks.workunit.client.0.smithi097.stderr: -135> 2024-09-14T11:05:09.588+0000 7f978ef46800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.737 INFO:tasks.workunit.client.0.smithi097.stderr: -134> 2024-09-14T11:05:09.588+0000 7f978ef46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:09.737 INFO:tasks.workunit.client.0.smithi097.stderr: -133> 2024-09-14T11:05:09.588+0000 7f978ef46800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.737 INFO:tasks.workunit.client.0.smithi097.stderr: -132> 2024-09-14T11:05:09.588+0000 7f978ef46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:09.737 INFO:tasks.workunit.client.0.smithi097.stderr: -131> 2024-09-14T11:05:09.588+0000 7f978ef46800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.738 INFO:tasks.workunit.client.0.smithi097.stderr: -130> 2024-09-14T11:05:09.589+0000 7f978ef46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:09.738 INFO:tasks.workunit.client.0.smithi097.stderr: -129> 2024-09-14T11:05:09.589+0000 7f978ef46800 20 started sync module instance, tier type = 2024-09-14T11:05:09.738 INFO:tasks.workunit.client.0.smithi097.stderr: -128> 2024-09-14T11:05:09.589+0000 7f978ef46800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:05:09.738 INFO:tasks.workunit.client.0.smithi097.stderr: -127> 2024-09-14T11:05:09.597+0000 7f978ef46800 20 add_watcher() i=0 2024-09-14T11:05:09.738 INFO:tasks.workunit.client.0.smithi097.stderr: -126> 2024-09-14T11:05:09.597+0000 7f978ef46800 20 add_watcher() i=1 2024-09-14T11:05:09.738 INFO:tasks.workunit.client.0.smithi097.stderr: -125> 2024-09-14T11:05:09.597+0000 7f978ef46800 20 add_watcher() i=2 2024-09-14T11:05:09.738 INFO:tasks.workunit.client.0.smithi097.stderr: -124> 2024-09-14T11:05:09.597+0000 7f978ef46800 20 add_watcher() i=3 2024-09-14T11:05:09.738 INFO:tasks.workunit.client.0.smithi097.stderr: -123> 2024-09-14T11:05:09.597+0000 7f978ef46800 20 add_watcher() i=4 2024-09-14T11:05:09.738 INFO:tasks.workunit.client.0.smithi097.stderr: -122> 2024-09-14T11:05:09.597+0000 7f978ef46800 20 add_watcher() i=5 2024-09-14T11:05:09.738 INFO:tasks.workunit.client.0.smithi097.stderr: -121> 2024-09-14T11:05:09.597+0000 7f978ef46800 20 add_watcher() i=6 2024-09-14T11:05:09.738 INFO:tasks.workunit.client.0.smithi097.stderr: -120> 2024-09-14T11:05:09.598+0000 7f978ef46800 20 add_watcher() i=7 2024-09-14T11:05:09.738 INFO:tasks.workunit.client.0.smithi097.stderr: -119> 2024-09-14T11:05:09.598+0000 7f978ef46800 2 all 8 watchers are set, enabling cache 2024-09-14T11:05:09.738 INFO:tasks.workunit.client.0.smithi097.stderr: -118> 2024-09-14T11:05:09.600+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22860) adding auth protocol: cephx 2024-09-14T11:05:09.738 INFO:tasks.workunit.client.0.smithi097.stderr: -117> 2024-09-14T11:05:09.600+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22860) adding auth protocol: cephx 2024-09-14T11:05:09.739 INFO:tasks.workunit.client.0.smithi097.stderr: -116> 2024-09-14T11:05:09.600+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22860) adding auth protocol: cephx 2024-09-14T11:05:09.739 INFO:tasks.workunit.client.0.smithi097.stderr: -115> 2024-09-14T11:05:09.600+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22860) adding con mode: secure 2024-09-14T11:05:09.739 INFO:tasks.workunit.client.0.smithi097.stderr: -114> 2024-09-14T11:05:09.600+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22860) adding con mode: crc 2024-09-14T11:05:09.739 INFO:tasks.workunit.client.0.smithi097.stderr: -113> 2024-09-14T11:05:09.600+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22860) adding con mode: secure 2024-09-14T11:05:09.739 INFO:tasks.workunit.client.0.smithi097.stderr: -112> 2024-09-14T11:05:09.600+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22860) adding con mode: crc 2024-09-14T11:05:09.739 INFO:tasks.workunit.client.0.smithi097.stderr: -111> 2024-09-14T11:05:09.600+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22860) adding con mode: secure 2024-09-14T11:05:09.739 INFO:tasks.workunit.client.0.smithi097.stderr: -110> 2024-09-14T11:05:09.600+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22860) adding con mode: crc 2024-09-14T11:05:09.739 INFO:tasks.workunit.client.0.smithi097.stderr: -109> 2024-09-14T11:05:09.600+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22860) adding con mode: crc 2024-09-14T11:05:09.739 INFO:tasks.workunit.client.0.smithi097.stderr: -108> 2024-09-14T11:05:09.600+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22860) adding con mode: secure 2024-09-14T11:05:09.739 INFO:tasks.workunit.client.0.smithi097.stderr: -107> 2024-09-14T11:05:09.600+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22860) adding con mode: crc 2024-09-14T11:05:09.739 INFO:tasks.workunit.client.0.smithi097.stderr: -106> 2024-09-14T11:05:09.600+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22860) adding con mode: secure 2024-09-14T11:05:09.739 INFO:tasks.workunit.client.0.smithi097.stderr: -105> 2024-09-14T11:05:09.600+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22860) adding con mode: crc 2024-09-14T11:05:09.739 INFO:tasks.workunit.client.0.smithi097.stderr: -104> 2024-09-14T11:05:09.600+0000 7f978ef46800 5 AuthRegistry(0x7ffcb0b22860) adding con mode: secure 2024-09-14T11:05:09.739 INFO:tasks.workunit.client.0.smithi097.stderr: -103> 2024-09-14T11:05:09.600+0000 7f96437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:09.740 INFO:tasks.workunit.client.0.smithi097.stderr: -102> 2024-09-14T11:05:09.600+0000 7f978ef46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:05:09.740 INFO:tasks.workunit.client.0.smithi097.stderr: -101> 2024-09-14T11:05:09.600+0000 7f978ef46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:05:09.740 INFO:tasks.workunit.client.0.smithi097.stderr: -100> 2024-09-14T11:05:09.600+0000 7f978ef46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:05:09.740 INFO:tasks.workunit.client.0.smithi097.stderr: -99> 2024-09-14T11:05:09.600+0000 7f978ef46800 5 asok(0x55ec7022a270) register_command cache list hook 0x55ec705106e0 2024-09-14T11:05:09.740 INFO:tasks.workunit.client.0.smithi097.stderr: -98> 2024-09-14T11:05:09.600+0000 7f978ef46800 5 asok(0x55ec7022a270) register_command cache inspect hook 0x55ec705106e0 2024-09-14T11:05:09.740 INFO:tasks.workunit.client.0.smithi097.stderr: -97> 2024-09-14T11:05:09.600+0000 7f978ef46800 5 asok(0x55ec7022a270) register_command cache erase hook 0x55ec705106e0 2024-09-14T11:05:09.740 INFO:tasks.workunit.client.0.smithi097.stderr: -96> 2024-09-14T11:05:09.600+0000 7f978ef46800 5 asok(0x55ec7022a270) register_command cache zap hook 0x55ec705106e0 2024-09-14T11:05:09.740 INFO:tasks.workunit.client.0.smithi097.stderr: -95> 2024-09-14T11:05:09.600+0000 7f978ef46800 5 note: GC not initialized 2024-09-14T11:05:09.740 INFO:tasks.workunit.client.0.smithi097.stderr: -94> 2024-09-14T11:05:09.600+0000 7f96427e4640 20 reqs_thread_entry: start 2024-09-14T11:05:09.740 INFO:tasks.workunit.client.0.smithi097.stderr: -93> 2024-09-14T11:05:09.600+0000 7f978ef46800 5 asok(0x55ec7022a270) register_command sync trace show hook 0x7f9774076370 2024-09-14T11:05:09.740 INFO:tasks.workunit.client.0.smithi097.stderr: -92> 2024-09-14T11:05:09.600+0000 7f978ef46800 5 asok(0x55ec7022a270) register_command sync trace history hook 0x7f9774076370 2024-09-14T11:05:09.740 INFO:tasks.workunit.client.0.smithi097.stderr: -91> 2024-09-14T11:05:09.600+0000 7f978ef46800 5 asok(0x55ec7022a270) register_command sync trace active hook 0x7f9774076370 2024-09-14T11:05:09.740 INFO:tasks.workunit.client.0.smithi097.stderr: -90> 2024-09-14T11:05:09.600+0000 7f978ef46800 5 asok(0x55ec7022a270) register_command sync trace active_short hook 0x7f9774076370 2024-09-14T11:05:09.741 INFO:tasks.workunit.client.0.smithi097.stderr: -89> 2024-09-14T11:05:09.600+0000 7f978ef46800 20 init_complete bucket index max shards: 11 2024-09-14T11:05:09.741 INFO:tasks.workunit.client.0.smithi097.stderr: -88> 2024-09-14T11:05:09.600+0000 7f978ef46800 20 Filter name: none 2024-09-14T11:05:09.741 INFO:tasks.workunit.client.0.smithi097.stderr: -87> 2024-09-14T11:05:09.600+0000 7f963bfff640 20 reqs_thread_entry: start 2024-09-14T11:05:09.741 INFO:tasks.workunit.client.0.smithi097.stderr: -86> 2024-09-14T11:05:09.600+0000 7f978ef46800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:05:09.741 INFO:tasks.workunit.client.0.smithi097.stderr: -85> 2024-09-14T11:05:09.601+0000 7f978ef46800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.741 INFO:tasks.workunit.client.0.smithi097.stderr: -84> 2024-09-14T11:05:09.601+0000 7f978ef46800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:05:09.741 INFO:tasks.workunit.client.0.smithi097.stderr: -83> 2024-09-14T11:05:09.601+0000 7f978ef46800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:05:09.741 INFO:tasks.workunit.client.0.smithi097.stderr: -82> 2024-09-14T11:05:09.601+0000 7f978ef46800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:05:09.741 INFO:tasks.workunit.client.0.smithi097.stderr: -81> 2024-09-14T11:05:09.601+0000 7f978ef46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 : miss 2024-09-14T11:05:09.741 INFO:tasks.workunit.client.0.smithi097.stderr: -80> 2024-09-14T11:05:09.601+0000 7f978ef46800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.741 INFO:tasks.workunit.client.0.smithi097.stderr: -79> 2024-09-14T11:05:09.601+0000 7f978ef46800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:05:09.741 INFO:tasks.workunit.client.0.smithi097.stderr: -78> 2024-09-14T11:05:09.601+0000 7f978ef46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 info.flags=0x17 2024-09-14T11:05:09.741 INFO:tasks.workunit.client.0.smithi097.stderr: -77> 2024-09-14T11:05:09.601+0000 7f978ef46800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 to cache LRU end 2024-09-14T11:05:09.742 INFO:tasks.workunit.client.0.smithi097.stderr: -76> 2024-09-14T11:05:09.601+0000 7f978ef46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:05:09.742 INFO:tasks.workunit.client.0.smithi097.stderr: -75> 2024-09-14T11:05:09.601+0000 7f978ef46800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:09.742 INFO:tasks.workunit.client.0.smithi097.stderr: -74> 2024-09-14T11:05:09.601+0000 7f978ef46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 2024-09-14T11:05:09.742 INFO:tasks.workunit.client.0.smithi097.stderr: -73> 2024-09-14T11:05:09.606+0000 7f978ef46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 info.flags=0x17 2024-09-14T11:05:09.742 INFO:tasks.workunit.client.0.smithi097.stderr: -72> 2024-09-14T11:05:09.606+0000 7f978ef46800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 to cache LRU end 2024-09-14T11:05:09.742 INFO:tasks.workunit.client.0.smithi097.stderr: -71> 2024-09-14T11:05:09.606+0000 7f978ef46800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:09.742 INFO:tasks.workunit.client.0.smithi097.stderr: -70> 2024-09-14T11:05:09.606+0000 7f978ef46800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32, ofs0, ns] 2024-09-14T11:05:09.742 INFO:tasks.workunit.client.0.smithi097.stderr: -69> 2024-09-14T11:05:09.606+0000 7f96637fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595203 cookie 94473985249088 notifier 7374 bl.length()=931 2024-09-14T11:05:09.742 INFO:tasks.workunit.client.0.smithi097.stderr: -68> 2024-09-14T11:05:09.606+0000 7f96637fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 info.flags=0x17 2024-09-14T11:05:09.742 INFO:tasks.workunit.client.0.smithi097.stderr: -67> 2024-09-14T11:05:09.606+0000 7f96637fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 to cache LRU end 2024-09-14T11:05:09.742 INFO:tasks.workunit.client.0.smithi097.stderr: -66> 2024-09-14T11:05:09.606+0000 7f96637fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:09.742 INFO:tasks.workunit.client.0.smithi097.stderr: -65> 2024-09-14T11:05:09.607+0000 7f978ef46800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32]): orig_sources= new_sources= 2024-09-14T11:05:09.742 INFO:tasks.workunit.client.0.smithi097.stderr: -64> 2024-09-14T11:05:09.607+0000 7f978ef46800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32]): potential sources added=[] removed=[] 2024-09-14T11:05:09.742 INFO:tasks.workunit.client.0.smithi097.stderr: -63> 2024-09-14T11:05:09.607+0000 7f978ef46800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32]): orig_dests= new_dests= 2024-09-14T11:05:09.743 INFO:tasks.workunit.client.0.smithi097.stderr: -62> 2024-09-14T11:05:09.607+0000 7f978ef46800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32]): potential dests added=[] removed=[] 2024-09-14T11:05:09.743 INFO:tasks.workunit.client.0.smithi097.stderr: -61> 2024-09-14T11:05:09.612+0000 7f978ef46800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.0 2024-09-14T11:05:09.743 INFO:tasks.workunit.client.0.smithi097.stderr: -60> 2024-09-14T11:05:09.612+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.0 2024-09-14T11:05:09.743 INFO:tasks.workunit.client.0.smithi097.stderr: -59> 2024-09-14T11:05:09.612+0000 7f978ef46800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.1 2024-09-14T11:05:09.743 INFO:tasks.workunit.client.0.smithi097.stderr: -58> 2024-09-14T11:05:09.612+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.1 2024-09-14T11:05:09.743 INFO:tasks.workunit.client.0.smithi097.stderr: -57> 2024-09-14T11:05:09.612+0000 7f978ef46800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.2 2024-09-14T11:05:09.743 INFO:tasks.workunit.client.0.smithi097.stderr: -56> 2024-09-14T11:05:09.612+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.2 2024-09-14T11:05:09.743 INFO:tasks.workunit.client.0.smithi097.stderr: -55> 2024-09-14T11:05:09.612+0000 7f978ef46800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.3 2024-09-14T11:05:09.743 INFO:tasks.workunit.client.0.smithi097.stderr: -54> 2024-09-14T11:05:09.612+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.3 2024-09-14T11:05:09.743 INFO:tasks.workunit.client.0.smithi097.stderr: -53> 2024-09-14T11:05:09.612+0000 7f978ef46800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.4 2024-09-14T11:05:09.743 INFO:tasks.workunit.client.0.smithi097.stderr: -52> 2024-09-14T11:05:09.612+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.4 2024-09-14T11:05:09.743 INFO:tasks.workunit.client.0.smithi097.stderr: -51> 2024-09-14T11:05:09.612+0000 7f978ef46800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.5 2024-09-14T11:05:09.743 INFO:tasks.workunit.client.0.smithi097.stderr: -50> 2024-09-14T11:05:09.612+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.5 2024-09-14T11:05:09.744 INFO:tasks.workunit.client.0.smithi097.stderr: -49> 2024-09-14T11:05:09.612+0000 7f978ef46800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.6 2024-09-14T11:05:09.744 INFO:tasks.workunit.client.0.smithi097.stderr: -48> 2024-09-14T11:05:09.612+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.6 2024-09-14T11:05:09.744 INFO:tasks.workunit.client.0.smithi097.stderr: -47> 2024-09-14T11:05:09.612+0000 7f978ef46800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.7 2024-09-14T11:05:09.744 INFO:tasks.workunit.client.0.smithi097.stderr: -46> 2024-09-14T11:05:09.612+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.7 2024-09-14T11:05:09.744 INFO:tasks.workunit.client.0.smithi097.stderr: -45> 2024-09-14T11:05:09.612+0000 7f978ef46800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.8 2024-09-14T11:05:09.744 INFO:tasks.workunit.client.0.smithi097.stderr: -44> 2024-09-14T11:05:09.612+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.8 2024-09-14T11:05:09.744 INFO:tasks.workunit.client.0.smithi097.stderr: -43> 2024-09-14T11:05:09.612+0000 7f978ef46800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.9 2024-09-14T11:05:09.744 INFO:tasks.workunit.client.0.smithi097.stderr: -42> 2024-09-14T11:05:09.612+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.9 2024-09-14T11:05:09.744 INFO:tasks.workunit.client.0.smithi097.stderr: -41> 2024-09-14T11:05:09.612+0000 7f978ef46800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.10 2024-09-14T11:05:09.744 INFO:tasks.workunit.client.0.smithi097.stderr: -40> 2024-09-14T11:05:09.612+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.10 2024-09-14T11:05:09.744 INFO:tasks.workunit.client.0.smithi097.stderr: -39> 2024-09-14T11:05:09.612+0000 7f978ef46800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.11 2024-09-14T11:05:09.744 INFO:tasks.workunit.client.0.smithi097.stderr: -38> 2024-09-14T11:05:09.612+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.11 2024-09-14T11:05:09.744 INFO:tasks.workunit.client.0.smithi097.stderr: -37> 2024-09-14T11:05:09.612+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.0 2024-09-14T11:05:09.744 INFO:tasks.workunit.client.0.smithi097.stderr: -36> 2024-09-14T11:05:09.612+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1 2024-09-14T11:05:09.745 INFO:tasks.workunit.client.0.smithi097.stderr: -35> 2024-09-14T11:05:09.613+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.2 2024-09-14T11:05:09.745 INFO:tasks.workunit.client.0.smithi097.stderr: -34> 2024-09-14T11:05:09.613+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.3 2024-09-14T11:05:09.745 INFO:tasks.workunit.client.0.smithi097.stderr: -33> 2024-09-14T11:05:09.614+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.4 2024-09-14T11:05:09.745 INFO:tasks.workunit.client.0.smithi097.stderr: -32> 2024-09-14T11:05:09.614+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.5 2024-09-14T11:05:09.745 INFO:tasks.workunit.client.0.smithi097.stderr: -31> 2024-09-14T11:05:09.614+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.6 2024-09-14T11:05:09.745 INFO:tasks.workunit.client.0.smithi097.stderr: -30> 2024-09-14T11:05:09.615+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.7 2024-09-14T11:05:09.745 INFO:tasks.workunit.client.0.smithi097.stderr: -29> 2024-09-14T11:05:09.615+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.8 2024-09-14T11:05:09.745 INFO:tasks.workunit.client.0.smithi097.stderr: -28> 2024-09-14T11:05:09.616+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.9 2024-09-14T11:05:09.748 INFO:tasks.workunit.client.0.smithi097.stderr: -27> 2024-09-14T11:05:09.616+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.10 2024-09-14T11:05:09.748 INFO:tasks.workunit.client.0.smithi097.stderr: -26> 2024-09-14T11:05:09.619+0000 7f978ef46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 : hit (requested=0x17, cached=0x17) 2024-09-14T11:05:09.748 INFO:tasks.workunit.client.0.smithi097.stderr: -25> 2024-09-14T11:05:09.619+0000 7f978ef46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 2024-09-14T11:05:09.748 INFO:tasks.workunit.client.0.smithi097.stderr: -24> 2024-09-14T11:05:09.620+0000 7f978ef46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 info.flags=0x17 2024-09-14T11:05:09.748 INFO:tasks.workunit.client.0.smithi097.stderr: -23> 2024-09-14T11:05:09.620+0000 7f978ef46800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 to cache LRU end 2024-09-14T11:05:09.748 INFO:tasks.workunit.client.0.smithi097.stderr: -22> 2024-09-14T11:05:09.620+0000 7f978ef46800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:09.748 INFO:tasks.workunit.client.0.smithi097.stderr: -21> 2024-09-14T11:05:09.620+0000 7f978ef46800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32, ofs0, ns] 2024-09-14T11:05:09.749 INFO:tasks.workunit.client.0.smithi097.stderr: -20> 2024-09-14T11:05:09.621+0000 7f96637fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595204 cookie 94473985249088 notifier 7374 bl.length()=931 2024-09-14T11:05:09.749 INFO:tasks.workunit.client.0.smithi097.stderr: -19> 2024-09-14T11:05:09.621+0000 7f96637fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 info.flags=0x17 2024-09-14T11:05:09.749 INFO:tasks.workunit.client.0.smithi097.stderr: -18> 2024-09-14T11:05:09.621+0000 7f96637fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 to cache LRU end 2024-09-14T11:05:09.749 INFO:tasks.workunit.client.0.smithi097.stderr: -17> 2024-09-14T11:05:09.621+0000 7f96637fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:09.749 INFO:tasks.workunit.client.0.smithi097.stderr: -16> 2024-09-14T11:05:09.621+0000 7f978ef46800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32]): orig_sources= new_sources= 2024-09-14T11:05:09.749 INFO:tasks.workunit.client.0.smithi097.stderr: -15> 2024-09-14T11:05:09.621+0000 7f978ef46800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32]): potential sources added=[] removed=[] 2024-09-14T11:05:09.749 INFO:tasks.workunit.client.0.smithi097.stderr: -14> 2024-09-14T11:05:09.621+0000 7f978ef46800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32]): orig_dests= new_dests= 2024-09-14T11:05:09.749 INFO:tasks.workunit.client.0.smithi097.stderr: -13> 2024-09-14T11:05:09.621+0000 7f978ef46800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32]): potential dests added=[] removed=[] 2024-09-14T11:05:09.749 INFO:tasks.workunit.client.0.smithi097.stderr: -12> 2024-09-14T11:05:09.623+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.0 2024-09-14T11:05:09.749 INFO:tasks.workunit.client.0.smithi097.stderr: -11> 2024-09-14T11:05:09.623+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1 2024-09-14T11:05:09.749 INFO:tasks.workunit.client.0.smithi097.stderr: -10> 2024-09-14T11:05:09.624+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.2 2024-09-14T11:05:09.749 INFO:tasks.workunit.client.0.smithi097.stderr: -9> 2024-09-14T11:05:09.624+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.3 2024-09-14T11:05:09.749 INFO:tasks.workunit.client.0.smithi097.stderr: -8> 2024-09-14T11:05:09.624+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.4 2024-09-14T11:05:09.750 INFO:tasks.workunit.client.0.smithi097.stderr: -7> 2024-09-14T11:05:09.624+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.5 2024-09-14T11:05:09.750 INFO:tasks.workunit.client.0.smithi097.stderr: -6> 2024-09-14T11:05:09.625+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.6 2024-09-14T11:05:09.750 INFO:tasks.workunit.client.0.smithi097.stderr: -5> 2024-09-14T11:05:09.625+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.7 2024-09-14T11:05:09.750 INFO:tasks.workunit.client.0.smithi097.stderr: -4> 2024-09-14T11:05:09.625+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.8 2024-09-14T11:05:09.750 INFO:tasks.workunit.client.0.smithi097.stderr: -3> 2024-09-14T11:05:09.626+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.9 2024-09-14T11:05:09.750 INFO:tasks.workunit.client.0.smithi097.stderr: -2> 2024-09-14T11:05:09.626+0000 7f978ef46800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.10 2024-09-14T11:05:09.750 INFO:tasks.workunit.client.0.smithi097.stderr: -1> 2024-09-14T11:05:09.627+0000 7f978ef46800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f978ef46800 time 2024-09-14T11:05:09.627666+0000 2024-09-14T11:05:09.750 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:05:09.750 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:09.750 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:05:09.750 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f979258c76a] 2024-09-14T11:05:09.750 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f979258c928] 2024-09-14T11:05:09.750 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ec6db030b1] 2024-09-14T11:05:09.750 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55ec6db13217] 2024-09-14T11:05:09.751 INFO:tasks.workunit.client.0.smithi097.stderr: 5: main() 2024-09-14T11:05:09.751 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f9791229590] 2024-09-14T11:05:09.751 INFO:tasks.workunit.client.0.smithi097.stderr: 7: __libc_start_main() 2024-09-14T11:05:09.751 INFO:tasks.workunit.client.0.smithi097.stderr: 8: _start() 2024-09-14T11:05:09.751 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:09.751 INFO:tasks.workunit.client.0.smithi097.stderr: 0> 2024-09-14T11:05:09.628+0000 7f978ef46800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:05:09.751 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f978ef46800 thread_name:radosgw-admin 2024-09-14T11:05:09.751 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:09.751 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:05:09.751 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f979123e6f0] 2024-09-14T11:05:09.751 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f979128b99c] 2024-09-14T11:05:09.751 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-14T11:05:09.751 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-14T11:05:09.751 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f979258c7c4] 2024-09-14T11:05:09.752 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f979258c928] 2024-09-14T11:05:09.752 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ec6db030b1] 2024-09-14T11:05:09.752 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55ec6db13217] 2024-09-14T11:05:09.752 INFO:tasks.workunit.client.0.smithi097.stderr: 9: main() 2024-09-14T11:05:09.752 INFO:tasks.workunit.client.0.smithi097.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f9791229590] 2024-09-14T11:05:09.752 INFO:tasks.workunit.client.0.smithi097.stderr: 11: __libc_start_main() 2024-09-14T11:05:09.752 INFO:tasks.workunit.client.0.smithi097.stderr: 12: _start() 2024-09-14T11:05:09.752 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:05:09.752 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:09.752 INFO:tasks.workunit.client.0.smithi097.stderr:--- logging levels --- 2024-09-14T11:05:09.752 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 none 2024-09-14T11:05:09.752 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 lockdep 2024-09-14T11:05:09.753 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 context 2024-09-14T11:05:09.753 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 crush 2024-09-14T11:05:09.753 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds 2024-09-14T11:05:09.753 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_balancer 2024-09-14T11:05:09.753 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_locker 2024-09-14T11:05:09.753 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log 2024-09-14T11:05:09.753 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log_expire 2024-09-14T11:05:09.753 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_migrator 2024-09-14T11:05:09.753 INFO:tasks.workunit.client.0.smithi097.stderr: 3/ 5 mds_quiesce 2024-09-14T11:05:09.753 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 buffer 2024-09-14T11:05:09.753 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 timer 2024-09-14T11:05:09.753 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 filer 2024-09-14T11:05:09.753 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 striper 2024-09-14T11:05:09.754 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 objecter 2024-09-14T11:05:09.754 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rados 2024-09-14T11:05:09.754 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd 2024-09-14T11:05:09.754 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_mirror 2024-09-14T11:05:09.754 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_replay 2024-09-14T11:05:09.754 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_pwl 2024-09-14T11:05:09.754 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 journaler 2024-09-14T11:05:09.754 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objectcacher 2024-09-14T11:05:09.754 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:05:09.754 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 client 2024-09-14T11:05:09.754 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 osd 2024-09-14T11:05:09.754 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 optracker 2024-09-14T11:05:09.754 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objclass 2024-09-14T11:05:09.754 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 filestore 2024-09-14T11:05:09.755 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 journal 2024-09-14T11:05:09.755 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 ms 2024-09-14T11:05:09.755 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mon 2024-09-14T11:05:09.755 INFO:tasks.workunit.client.0.smithi097.stderr: 0/10 monc 2024-09-14T11:05:09.755 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 paxos 2024-09-14T11:05:09.755 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 tp 2024-09-14T11:05:09.755 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 auth 2024-09-14T11:05:09.755 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 crypto 2024-09-14T11:05:09.755 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 finisher 2024-09-14T11:05:09.755 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 reserver 2024-09-14T11:05:09.755 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 heartbeatmap 2024-09-14T11:05:09.755 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 perfcounter 2024-09-14T11:05:09.755 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw 2024-09-14T11:05:09.755 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_sync 2024-09-14T11:05:09.756 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_datacache 2024-09-14T11:05:09.756 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_access 2024-09-14T11:05:09.756 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:05:09.756 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_flight 2024-09-14T11:05:09.756 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:05:09.756 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw_notification 2024-09-14T11:05:09.756 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 javaclient 2024-09-14T11:05:09.756 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 asok 2024-09-14T11:05:09.756 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 throttle 2024-09-14T11:05:09.756 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 refs 2024-09-14T11:05:09.756 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 compressor 2024-09-14T11:05:09.756 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluestore 2024-09-14T11:05:09.756 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluefs 2024-09-14T11:05:09.757 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 bdev 2024-09-14T11:05:09.757 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 kstore 2024-09-14T11:05:09.757 INFO:tasks.workunit.client.0.smithi097.stderr: 4/ 5 rocksdb 2024-09-14T11:05:09.757 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 fuse 2024-09-14T11:05:09.757 INFO:tasks.workunit.client.0.smithi097.stderr: 2/ 5 mgr 2024-09-14T11:05:09.757 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mgrc 2024-09-14T11:05:09.757 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 dpdk 2024-09-14T11:05:09.757 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 eventtrace 2024-09-14T11:05:09.757 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 prioritycache 2024-09-14T11:05:09.757 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 test 2024-09-14T11:05:09.757 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:05:09.757 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephsqlite 2024-09-14T11:05:09.757 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:05:09.757 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore 2024-09-14T11:05:09.758 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_onode 2024-09-14T11:05:09.758 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_odata 2024-09-14T11:05:09.758 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_omap 2024-09-14T11:05:09.758 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_tm 2024-09-14T11:05:09.758 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_t 2024-09-14T11:05:09.758 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:05:09.758 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_epm 2024-09-14T11:05:09.758 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_lba 2024-09-14T11:05:09.758 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:05:09.758 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cache 2024-09-14T11:05:09.758 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_journal 2024-09-14T11:05:09.758 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_device 2024-09-14T11:05:09.758 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_backref 2024-09-14T11:05:09.759 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 alienstore 2024-09-14T11:05:09.759 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mclock 2024-09-14T11:05:09.759 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cyanstore 2024-09-14T11:05:09.759 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 ceph_exporter 2024-09-14T11:05:09.759 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 memstore 2024-09-14T11:05:09.759 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 trace 2024-09-14T11:05:09.759 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 ceph_dedup 2024-09-14T11:05:09.759 INFO:tasks.workunit.client.0.smithi097.stderr: -2/-2 (syslog threshold) 2024-09-14T11:05:09.759 INFO:tasks.workunit.client.0.smithi097.stderr: 99/99 (stderr threshold) 2024-09-14T11:05:09.759 INFO:tasks.workunit.client.0.smithi097.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:05:09.759 INFO:tasks.workunit.client.0.smithi097.stderr: 7f963bfff640 / http_manager 2024-09-14T11:05:09.759 INFO:tasks.workunit.client.0.smithi097.stderr: 7f96427e4640 / http_manager 2024-09-14T11:05:09.759 INFO:tasks.workunit.client.0.smithi097.stderr: 7f96437e6640 / rgw_dt_lg_renew 2024-09-14T11:05:09.759 INFO:tasks.workunit.client.0.smithi097.stderr: 7f96627fc640 / ms_dispatch 2024-09-14T11:05:09.760 INFO:tasks.workunit.client.0.smithi097.stderr: 7f96637fe640 / io_context_pool 2024-09-14T11:05:09.760 INFO:tasks.workunit.client.0.smithi097.stderr: 7f9663fff640 / io_context_pool 2024-09-14T11:05:09.760 INFO:tasks.workunit.client.0.smithi097.stderr: 7f96727fc640 / ms_dispatch 2024-09-14T11:05:09.760 INFO:tasks.workunit.client.0.smithi097.stderr: 7f967960a640 / ms_dispatch 2024-09-14T11:05:09.760 INFO:tasks.workunit.client.0.smithi097.stderr: 7f967ae0d640 / io_context_pool 2024-09-14T11:05:09.760 INFO:tasks.workunit.client.0.smithi097.stderr: 7f9784236640 / msgr-worker-2 2024-09-14T11:05:09.760 INFO:tasks.workunit.client.0.smithi097.stderr: 7f978ca37640 / msgr-worker-1 2024-09-14T11:05:09.760 INFO:tasks.workunit.client.0.smithi097.stderr: 7f978d238640 / msgr-worker-0 2024-09-14T11:05:09.760 INFO:tasks.workunit.client.0.smithi097.stderr: 7f978da39640 / io_context_pool 2024-09-14T11:05:09.760 INFO:tasks.workunit.client.0.smithi097.stderr: 7f978ef46800 / radosgw-admin 2024-09-14T11:05:09.760 INFO:tasks.workunit.client.0.smithi097.stderr: max_recent 500 2024-09-14T11:05:09.760 INFO:tasks.workunit.client.0.smithi097.stderr: max_new 1000 2024-09-14T11:05:09.760 INFO:tasks.workunit.client.0.smithi097.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:05:09.629115Z_ac78be98-4f40-48ce-9d45-10ef06236496/log 2024-09-14T11:05:09.760 INFO:tasks.workunit.client.0.smithi097.stderr:--- end dump of recent events --- 2024-09-14T11:05:09.761 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-14T11:05:09.766 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:05:09.767 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:05:09.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.701+0000 7fc63d922800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.704+0000 7fc63d922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:09.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.704+0000 7fc63d922800 20 realm 2024-09-14T11:05:09.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.704+0000 7fc63d922800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.704+0000 7fc63d922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:09.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.704+0000 7fc63d922800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:05:09.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.704+0000 7fc63d922800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.704+0000 7fc63d922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:09.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.704+0000 7fc63d922800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.705+0000 7fc63d922800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:09.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.705+0000 7fc63d922800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.706+0000 7fc63d922800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:05:09.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.706+0000 7fc63d922800 20 searching for the correct realm 2024-09-14T11:05:09.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.707+0000 7fc630e67640 0 -- 172.21.15.97:0/277317444 >> [v2:172.21.15.97:6816/4093696477,v1:172.21.15.97:6817/4093696477] conn(0x55f8b58a5ec0 msgr2=0x55f8b58a82b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:05:09.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.710+0000 7fc639668640 0 -- 172.21.15.97:0/277317444 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7fc6240b6ff0 msgr2=0x7fc6240b3760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:05:09.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.715+0000 7fc63d922800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:05:09.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.715+0000 7fc63d922800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:05:09.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.715+0000 7fc63d922800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:05:09.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.715+0000 7fc63d922800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:05:09.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.715+0000 7fc63d922800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:05:09.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.715+0000 7fc63d922800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:05:09.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.715+0000 7fc63d922800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.715+0000 7fc63d922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:09.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.715+0000 7fc63d922800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.716+0000 7fc63d922800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:09.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.716+0000 7fc63d922800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.716+0000 7fc63d922800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:05:09.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.716+0000 7fc63d922800 20 zone default found 2024-09-14T11:05:09.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.716+0000 7fc63d922800 4 Realm: () 2024-09-14T11:05:09.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.716+0000 7fc63d922800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:05:09.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.716+0000 7fc63d922800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:05:09.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.716+0000 7fc63d922800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:05:09.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.716+0000 7fc63d922800 20 zonegroup default 2024-09-14T11:05:09.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.716+0000 7fc63d922800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.716+0000 7fc63d922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:09.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.716+0000 7fc63d922800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.717+0000 7fc63d922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:09.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.717+0000 7fc63d922800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.717+0000 7fc63d922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:09.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.717+0000 7fc63d922800 20 started sync module instance, tier type = 2024-09-14T11:05:09.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.717+0000 7fc63d922800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:05:09.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.725+0000 7fc63d922800 20 add_watcher() i=0 2024-09-14T11:05:09.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.725+0000 7fc63d922800 20 add_watcher() i=1 2024-09-14T11:05:09.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.725+0000 7fc63d922800 20 add_watcher() i=2 2024-09-14T11:05:09.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.725+0000 7fc63d922800 20 add_watcher() i=3 2024-09-14T11:05:09.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.725+0000 7fc63d922800 20 add_watcher() i=4 2024-09-14T11:05:09.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.725+0000 7fc63d922800 20 add_watcher() i=5 2024-09-14T11:05:09.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.725+0000 7fc63d922800 20 add_watcher() i=6 2024-09-14T11:05:09.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.726+0000 7fc63d922800 20 add_watcher() i=7 2024-09-14T11:05:09.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.726+0000 7fc63d922800 2 all 8 watchers are set, enabling cache 2024-09-14T11:05:09.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.728+0000 7fc4ef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:09.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.728+0000 7fc63d922800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:05:09.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.728+0000 7fc63d922800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:05:09.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.728+0000 7fc63d922800 5 note: GC not initialized 2024-09-14T11:05:09.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.728+0000 7fc4ee7e4640 20 reqs_thread_entry: start 2024-09-14T11:05:09.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.729+0000 7fc63d922800 20 init_complete bucket index max shards: 11 2024-09-14T11:05:09.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.729+0000 7fc63d922800 20 Filter name: none 2024-09-14T11:05:09.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.729+0000 7fc45ffff640 20 reqs_thread_entry: start 2024-09-14T11:05:09.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.729+0000 7fc63d922800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.729+0000 7fc63d922800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:05:09.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.729+0000 7fc63d922800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.730+0000 7fc63d922800 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:05:09.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.730+0000 7fc63d922800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:05:09.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.730+0000 7fc63d922800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.730+0000 7fc63d922800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:05:09.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.730+0000 7fc63d922800 20 rados->read ofs=0 len=0 2024-09-14T11:05:09.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.730+0000 7fc63d922800 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:05:09.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.730+0000 7fc63d922800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:05:09.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.732+0000 7fc4ef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:09.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.734+0000 7fc63d922800 20 remove_watcher() i=0 2024-09-14T11:05:09.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.734+0000 7fc63d922800 2 removed watcher, disabling cache 2024-09-14T11:05:09.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.735+0000 7fc63d922800 20 remove_watcher() i=1 2024-09-14T11:05:09.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.736+0000 7fc63d922800 20 remove_watcher() i=2 2024-09-14T11:05:09.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.737+0000 7fc63d922800 20 remove_watcher() i=3 2024-09-14T11:05:09.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.738+0000 7fc63d922800 20 remove_watcher() i=4 2024-09-14T11:05:09.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.739+0000 7fc63d922800 20 remove_watcher() i=5 2024-09-14T11:05:09.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.740+0000 7fc63d922800 20 remove_watcher() i=6 2024-09-14T11:05:09.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:09.740+0000 7fc63d922800 20 remove_watcher() i=7 2024-09-14T11:05:09.772 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:09.773 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:05:09.773 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: abort-at-commit-target-layout id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:05:09.773 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:39.838 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:05:39.875 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:05:39.875 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:05:39.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:39.920+0000 7f5576323800 20 rados->read ofs=0 len=0 2024-09-14T11:05:39.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:39.922+0000 7f5576323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:39.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:39.922+0000 7f5576323800 20 realm 2024-09-14T11:05:39.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:39.922+0000 7f5576323800 20 rados->read ofs=0 len=0 2024-09-14T11:05:39.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:39.922+0000 7f5576323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:39.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:39.922+0000 7f5576323800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:05:39.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:39.922+0000 7f5576323800 20 rados->read ofs=0 len=0 2024-09-14T11:05:39.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:39.922+0000 7f5576323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:39.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:39.922+0000 7f5576323800 20 rados->read ofs=0 len=0 2024-09-14T11:05:39.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:39.923+0000 7f5576323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:39.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:39.923+0000 7f5576323800 20 rados->read ofs=0 len=0 2024-09-14T11:05:39.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:39.924+0000 7f5576323800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:05:39.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:39.924+0000 7f5576323800 20 searching for the correct realm 2024-09-14T11:05:39.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:39.926+0000 7f557280d640 0 -- 172.21.15.97:0/1194225497 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f555c06b020 msgr2=0x7f555c0bd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:05:40.130 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.131+0000 7f556980b640 0 -- 172.21.15.97:0/1194225497 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f5564042410 msgr2=0x7f5564042870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:05:40.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.137+0000 7f5576323800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:05:40.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.137+0000 7f5576323800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:05:40.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.137+0000 7f5576323800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:05:40.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.137+0000 7f5576323800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:05:40.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.137+0000 7f5576323800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:05:40.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.137+0000 7f5576323800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:05:40.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.137+0000 7f5576323800 20 rados->read ofs=0 len=0 2024-09-14T11:05:40.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.137+0000 7f5576323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:40.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.137+0000 7f5576323800 20 rados->read ofs=0 len=0 2024-09-14T11:05:40.137 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.137+0000 7f5576323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:40.137 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.137+0000 7f5576323800 20 rados->read ofs=0 len=0 2024-09-14T11:05:40.137 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.138+0000 7f5576323800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:05:40.137 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.138+0000 7f5576323800 20 zone default found 2024-09-14T11:05:40.137 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.138+0000 7f5576323800 4 Realm: () 2024-09-14T11:05:40.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.138+0000 7f5576323800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:05:40.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.138+0000 7f5576323800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:05:40.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.138+0000 7f5576323800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:05:40.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.138+0000 7f5576323800 20 zonegroup default 2024-09-14T11:05:40.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.138+0000 7f5576323800 20 rados->read ofs=0 len=0 2024-09-14T11:05:40.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.138+0000 7f5576323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:40.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.138+0000 7f5576323800 20 rados->read ofs=0 len=0 2024-09-14T11:05:40.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.139+0000 7f5576323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:40.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.139+0000 7f5576323800 20 rados->read ofs=0 len=0 2024-09-14T11:05:40.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.139+0000 7f5576323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:40.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.139+0000 7f5576323800 20 started sync module instance, tier type = 2024-09-14T11:05:40.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.139+0000 7f5576323800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:05:40.148 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.149+0000 7f5576323800 20 add_watcher() i=0 2024-09-14T11:05:40.148 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.149+0000 7f5576323800 20 add_watcher() i=1 2024-09-14T11:05:40.148 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.149+0000 7f5576323800 20 add_watcher() i=2 2024-09-14T11:05:40.148 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.149+0000 7f5576323800 20 add_watcher() i=3 2024-09-14T11:05:40.148 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.149+0000 7f5576323800 20 add_watcher() i=4 2024-09-14T11:05:40.148 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.149+0000 7f5576323800 20 add_watcher() i=5 2024-09-14T11:05:40.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.149+0000 7f5576323800 20 add_watcher() i=6 2024-09-14T11:05:40.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.150+0000 7f5576323800 20 add_watcher() i=7 2024-09-14T11:05:40.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.150+0000 7f5576323800 2 all 8 watchers are set, enabling cache 2024-09-14T11:05:40.150 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.152+0000 7f5428fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:40.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.152+0000 7f5576323800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:05:40.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.152+0000 7f5576323800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:05:40.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.152+0000 7f5576323800 5 note: GC not initialized 2024-09-14T11:05:40.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.152+0000 7f53a37fe640 20 reqs_thread_entry: start 2024-09-14T11:05:40.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.153+0000 7f5576323800 20 init_complete bucket index max shards: 11 2024-09-14T11:05:40.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.153+0000 7f5576323800 20 Filter name: none 2024-09-14T11:05:40.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.153+0000 7f53a17fa640 20 reqs_thread_entry: start 2024-09-14T11:05:40.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.153+0000 7f5576323800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:05:40.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.153+0000 7f5576323800 20 rados->read ofs=0 len=0 2024-09-14T11:05:40.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.153+0000 7f5576323800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:05:40.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.153+0000 7f5576323800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:05:40.153 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.153+0000 7f5576323800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:05:40.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.153+0000 7f5576323800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 : miss 2024-09-14T11:05:40.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.153+0000 7f5576323800 20 rados->read ofs=0 len=0 2024-09-14T11:05:40.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.154+0000 7f5576323800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:05:40.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.154+0000 7f5576323800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 info.flags=0x17 2024-09-14T11:05:40.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.154+0000 7f5576323800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 to cache LRU end 2024-09-14T11:05:40.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.154+0000 7f5576323800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:05:40.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.154+0000 7f5576323800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:40.154 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.154+0000 7f5576323800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 2024-09-14T11:05:40.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.159+0000 7f5576323800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 info.flags=0x17 2024-09-14T11:05:40.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.159+0000 7f5576323800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 to cache LRU end 2024-09-14T11:05:40.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.159+0000 7f5576323800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:40.158 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.159+0000 7f5576323800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32, ofs0, ns] 2024-09-14T11:05:40.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.160+0000 7f54557fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595206 cookie 94565579795408 notifier 7410 bl.length()=931 2024-09-14T11:05:40.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.160+0000 7f54557fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 info.flags=0x17 2024-09-14T11:05:40.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.160+0000 7f54557fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 to cache LRU end 2024-09-14T11:05:40.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.160+0000 7f54557fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:40.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.160+0000 7f5576323800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32]): orig_sources= new_sources= 2024-09-14T11:05:40.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.160+0000 7f5576323800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32]): potential sources added=[] removed=[] 2024-09-14T11:05:40.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.160+0000 7f5576323800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32]): orig_dests= new_dests= 2024-09-14T11:05:40.159 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.160+0000 7f5576323800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32]): potential dests added=[] removed=[] 2024-09-14T11:05:40.164 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.165+0000 7f5576323800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.0 2024-09-14T11:05:40.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.165+0000 7f5576323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.0 2024-09-14T11:05:40.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.165+0000 7f5576323800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.1 2024-09-14T11:05:40.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.165+0000 7f5576323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.1 2024-09-14T11:05:40.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.165+0000 7f5576323800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.2 2024-09-14T11:05:40.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.165+0000 7f5576323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.2 2024-09-14T11:05:40.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.165+0000 7f5576323800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.3 2024-09-14T11:05:40.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.165+0000 7f5576323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.3 2024-09-14T11:05:40.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.165+0000 7f5576323800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.4 2024-09-14T11:05:40.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.165+0000 7f5576323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.4 2024-09-14T11:05:40.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.165+0000 7f5576323800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.5 2024-09-14T11:05:40.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.165+0000 7f5576323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.5 2024-09-14T11:05:40.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.165+0000 7f5576323800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.6 2024-09-14T11:05:40.165 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.165+0000 7f5576323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.6 2024-09-14T11:05:40.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.165+0000 7f5576323800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.7 2024-09-14T11:05:40.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.165+0000 7f5576323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.7 2024-09-14T11:05:40.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.165+0000 7f5576323800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.8 2024-09-14T11:05:40.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.165+0000 7f5576323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.8 2024-09-14T11:05:40.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.165+0000 7f5576323800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.9 2024-09-14T11:05:40.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.165+0000 7f5576323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.9 2024-09-14T11:05:40.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.165+0000 7f5576323800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.10 2024-09-14T11:05:40.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.165+0000 7f5576323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.10 2024-09-14T11:05:40.166 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.165+0000 7f5576323800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.11 2024-09-14T11:05:40.167 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.165+0000 7f5576323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1.11 2024-09-14T11:05:40.167 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.165+0000 7f5576323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.0 2024-09-14T11:05:40.167 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.166+0000 7f5576323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1 2024-09-14T11:05:40.168 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.167+0000 7f5576323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.2 2024-09-14T11:05:40.168 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.167+0000 7f5576323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.3 2024-09-14T11:05:40.168 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.167+0000 7f5576323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.4 2024-09-14T11:05:40.169 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.168+0000 7f5576323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.5 2024-09-14T11:05:40.169 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.168+0000 7f5576323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.6 2024-09-14T11:05:40.169 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.169+0000 7f5576323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.7 2024-09-14T11:05:40.169 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.169+0000 7f5576323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.8 2024-09-14T11:05:40.169 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.170+0000 7f5576323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.9 2024-09-14T11:05:40.169 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.170+0000 7f5576323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.10 2024-09-14T11:05:40.172 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.173+0000 7f5576323800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 : hit (requested=0x17, cached=0x17) 2024-09-14T11:05:40.172 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.173+0000 7f5576323800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 2024-09-14T11:05:40.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.174+0000 7f5576323800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 info.flags=0x17 2024-09-14T11:05:40.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.174+0000 7f5576323800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 to cache LRU end 2024-09-14T11:05:40.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.174+0000 7f5576323800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:40.173 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.175+0000 7f5576323800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32, ofs0, ns] 2024-09-14T11:05:40.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.175+0000 7f54557fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595207 cookie 94565579795408 notifier 7410 bl.length()=931 2024-09-14T11:05:40.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.175+0000 7f54557fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 info.flags=0x17 2024-09-14T11:05:40.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.175+0000 7f54557fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 to cache LRU end 2024-09-14T11:05:40.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.175+0000 7f54557fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:40.174 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.175+0000 7f5576323800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32]): orig_sources= new_sources= 2024-09-14T11:05:40.175 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.175+0000 7f5576323800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32]): potential sources added=[] removed=[] 2024-09-14T11:05:40.175 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.175+0000 7f5576323800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32]): orig_dests= new_dests= 2024-09-14T11:05:40.175 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.175+0000 7f5576323800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32]): potential dests added=[] removed=[] 2024-09-14T11:05:40.176 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.177+0000 7f5576323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.0 2024-09-14T11:05:40.176 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.178+0000 7f5576323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.1 2024-09-14T11:05:40.177 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.178+0000 7f5576323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.2 2024-09-14T11:05:40.178 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.178+0000 7f5576323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.3 2024-09-14T11:05:40.178 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.179+0000 7f5576323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.4 2024-09-14T11:05:40.178 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.179+0000 7f5576323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.5 2024-09-14T11:05:40.178 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.179+0000 7f5576323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.6 2024-09-14T11:05:40.178 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.180+0000 7f5576323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.7 2024-09-14T11:05:40.178 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.180+0000 7f5576323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.8 2024-09-14T11:05:40.179 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.180+0000 7f5576323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.9 2024-09-14T11:05:40.179 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.181+0000 7f5576323800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32.10 2024-09-14T11:05:40.180 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.181+0000 7f5576323800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 : hit (requested=0x17, cached=0x17) 2024-09-14T11:05:40.180 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.181+0000 7f5576323800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 2024-09-14T11:05:40.181 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.182+0000 7f5576323800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 info.flags=0x17 2024-09-14T11:05:40.181 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.182+0000 7f5576323800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 to cache LRU end 2024-09-14T11:05:40.182 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.182+0000 7f5576323800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:40.182 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.182+0000 7f5576323800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32, ofs0, ns] 2024-09-14T11:05:40.182 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.183+0000 7f5455ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595208 cookie 94565579795408 notifier 7410 bl.length()=899 2024-09-14T11:05:40.182 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.183+0000 7f5455ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 info.flags=0x17 2024-09-14T11:05:40.182 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.183+0000 7f5455ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 to cache LRU end 2024-09-14T11:05:40.182 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.183+0000 7f5455ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:40.182 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.183+0000 7f5576323800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32]): orig_sources= new_sources= 2024-09-14T11:05:40.182 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.183+0000 7f5576323800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32]): potential sources added=[] removed=[] 2024-09-14T11:05:40.182 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.183+0000 7f5576323800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32]): orig_dests= new_dests= 2024-09-14T11:05:40.183 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.183+0000 7f5576323800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32]): potential dests added=[] removed=[] 2024-09-14T11:05:40.184 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.185+0000 7f5576323800 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:05:40.186 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.187+0000 7f5428fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:40.188 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.189+0000 7f5576323800 20 remove_watcher() i=0 2024-09-14T11:05:40.188 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.189+0000 7f5576323800 2 removed watcher, disabling cache 2024-09-14T11:05:40.189 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.190+0000 7f5576323800 20 remove_watcher() i=1 2024-09-14T11:05:40.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.191+0000 7f5576323800 20 remove_watcher() i=2 2024-09-14T11:05:40.191 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.192+0000 7f5576323800 20 remove_watcher() i=3 2024-09-14T11:05:40.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.194+0000 7f5576323800 20 remove_watcher() i=4 2024-09-14T11:05:40.193 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.195+0000 7f5576323800 20 remove_watcher() i=5 2024-09-14T11:05:40.194 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.196+0000 7f5576323800 20 remove_watcher() i=6 2024-09-14T11:05:40.195 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.197+0000 7f5576323800 20 remove_watcher() i=7 2024-09-14T11:05:40.207 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-14T11:05:40.236 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:05:40.236 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:05:40.272 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.274+0000 7f04ce925800 20 rados->read ofs=0 len=0 2024-09-14T11:05:40.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.276+0000 7f04ce925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:40.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.276+0000 7f04ce925800 20 realm 2024-09-14T11:05:40.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.276+0000 7f04ce925800 20 rados->read ofs=0 len=0 2024-09-14T11:05:40.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.276+0000 7f04ce925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:40.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.276+0000 7f04ce925800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:05:40.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.276+0000 7f04ce925800 20 rados->read ofs=0 len=0 2024-09-14T11:05:40.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.276+0000 7f04ce925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:40.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.276+0000 7f04ce925800 20 rados->read ofs=0 len=0 2024-09-14T11:05:40.277 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.277+0000 7f04ce925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:40.277 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.277+0000 7f04ce925800 20 rados->read ofs=0 len=0 2024-09-14T11:05:40.277 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.278+0000 7f04ce925800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:05:40.277 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.278+0000 7f04ce925800 20 searching for the correct realm 2024-09-14T11:05:40.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.280+0000 7f04cadaf640 0 -- 172.21.15.97:0/2405871084 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f04b4063040 msgr2=0x7f04b4076780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:05:40.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.486+0000 7f04c1dad640 0 -- 172.21.15.97:0/2405871084 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f04bc036040 msgr2=0x7f04bc0163f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:05:40.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.490+0000 7f04ce925800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:05:40.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.490+0000 7f04ce925800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:05:40.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.490+0000 7f04ce925800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:05:40.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.490+0000 7f04ce925800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:05:40.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.490+0000 7f04ce925800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:05:40.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.490+0000 7f04ce925800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:05:40.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.490+0000 7f04ce925800 20 rados->read ofs=0 len=0 2024-09-14T11:05:40.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.491+0000 7f04ce925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:40.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.491+0000 7f04ce925800 20 rados->read ofs=0 len=0 2024-09-14T11:05:40.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.491+0000 7f04ce925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:40.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.491+0000 7f04ce925800 20 rados->read ofs=0 len=0 2024-09-14T11:05:40.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.491+0000 7f04ce925800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:05:40.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.491+0000 7f04ce925800 20 zone default found 2024-09-14T11:05:40.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.491+0000 7f04ce925800 4 Realm: () 2024-09-14T11:05:40.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.491+0000 7f04ce925800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:05:40.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.491+0000 7f04ce925800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:05:40.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.491+0000 7f04ce925800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:05:40.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.491+0000 7f04ce925800 20 zonegroup default 2024-09-14T11:05:40.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.491+0000 7f04ce925800 20 rados->read ofs=0 len=0 2024-09-14T11:05:40.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.492+0000 7f04ce925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:40.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.492+0000 7f04ce925800 20 rados->read ofs=0 len=0 2024-09-14T11:05:40.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.492+0000 7f04ce925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:40.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.492+0000 7f04ce925800 20 rados->read ofs=0 len=0 2024-09-14T11:05:40.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.492+0000 7f04ce925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:40.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.492+0000 7f04ce925800 20 started sync module instance, tier type = 2024-09-14T11:05:40.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.492+0000 7f04ce925800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:05:40.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.502+0000 7f04ce925800 20 add_watcher() i=0 2024-09-14T11:05:40.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.502+0000 7f04ce925800 20 add_watcher() i=1 2024-09-14T11:05:40.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.502+0000 7f04ce925800 20 add_watcher() i=2 2024-09-14T11:05:40.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.502+0000 7f04ce925800 20 add_watcher() i=3 2024-09-14T11:05:40.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.502+0000 7f04ce925800 20 add_watcher() i=4 2024-09-14T11:05:40.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.502+0000 7f04ce925800 20 add_watcher() i=5 2024-09-14T11:05:40.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.502+0000 7f04ce925800 20 add_watcher() i=6 2024-09-14T11:05:40.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.503+0000 7f04ce925800 20 add_watcher() i=7 2024-09-14T11:05:40.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.503+0000 7f04ce925800 2 all 8 watchers are set, enabling cache 2024-09-14T11:05:40.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.505+0000 7f0380fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:40.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.505+0000 7f04ce925800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:05:40.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.505+0000 7f04ce925800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:05:40.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.505+0000 7f04ce925800 5 note: GC not initialized 2024-09-14T11:05:40.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.505+0000 7f02fb7fe640 20 reqs_thread_entry: start 2024-09-14T11:05:40.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.505+0000 7f04ce925800 20 init_complete bucket index max shards: 11 2024-09-14T11:05:40.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.505+0000 7f04ce925800 20 Filter name: none 2024-09-14T11:05:40.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.505+0000 7f02f97fa640 20 reqs_thread_entry: start 2024-09-14T11:05:40.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.506+0000 7f04ce925800 20 rados->read ofs=0 len=0 2024-09-14T11:05:40.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.506+0000 7f04ce925800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:05:40.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.506+0000 7f04ce925800 20 rados->read ofs=0 len=0 2024-09-14T11:05:40.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.506+0000 7f04ce925800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:05:40.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.506+0000 7f04ce925800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:05:40.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.506+0000 7f04ce925800 20 rados->read ofs=0 len=0 2024-09-14T11:05:40.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.507+0000 7f04ce925800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:05:40.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.507+0000 7f04ce925800 20 rados->read ofs=0 len=0 2024-09-14T11:05:40.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.507+0000 7f04ce925800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:05:40.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.507+0000 7f04ce925800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:05:40.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.509+0000 7f0380fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:40.509 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.511+0000 7f04ce925800 20 remove_watcher() i=0 2024-09-14T11:05:40.509 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.511+0000 7f04ce925800 2 removed watcher, disabling cache 2024-09-14T11:05:40.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.512+0000 7f04ce925800 20 remove_watcher() i=1 2024-09-14T11:05:40.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.513+0000 7f04ce925800 20 remove_watcher() i=2 2024-09-14T11:05:40.513 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.514+0000 7f04ce925800 20 remove_watcher() i=3 2024-09-14T11:05:40.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.515+0000 7f04ce925800 20 remove_watcher() i=4 2024-09-14T11:05:40.515 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.516+0000 7f04ce925800 20 remove_watcher() i=5 2024-09-14T11:05:40.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.517+0000 7f04ce925800 20 remove_watcher() i=6 2024-09-14T11:05:40.517 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.518+0000 7f04ce925800 20 remove_watcher() i=7 2024-09-14T11:05:40.527 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:40.527 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:05:40.527 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: abort-at-commit-target-layout id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:05:40.527 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:40.603 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-09-14T11:05:40.603 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:40.800 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-14T11:05:40.829 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:05:40.829 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:05:40.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.867+0000 7f4eccb23800 20 rados->read ofs=0 len=0 2024-09-14T11:05:40.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.869+0000 7f4eccb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:40.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.869+0000 7f4eccb23800 20 realm 2024-09-14T11:05:40.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.869+0000 7f4eccb23800 20 rados->read ofs=0 len=0 2024-09-14T11:05:40.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.869+0000 7f4eccb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:40.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.869+0000 7f4eccb23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:05:40.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.869+0000 7f4eccb23800 20 rados->read ofs=0 len=0 2024-09-14T11:05:40.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.869+0000 7f4eccb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:40.868 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.869+0000 7f4eccb23800 20 rados->read ofs=0 len=0 2024-09-14T11:05:40.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.870+0000 7f4eccb23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:40.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.870+0000 7f4eccb23800 20 rados->read ofs=0 len=0 2024-09-14T11:05:40.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.870+0000 7f4eccb23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:05:40.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.871+0000 7f4eccb23800 20 searching for the correct realm 2024-09-14T11:05:40.871 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:40.872+0000 7f4ec900d640 0 -- 172.21.15.97:0/2133551893 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f4eb40e8040 msgr2=0x7f4eb40c6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:05:41.076 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.077+0000 7f4ec3fff640 0 -- 172.21.15.97:0/2133551893 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f4ebc00d8f0 msgr2=0x7f4ebc046400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:05:41.080 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.082+0000 7f4eccb23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:05:41.080 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.082+0000 7f4eccb23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:05:41.081 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.082+0000 7f4eccb23800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:05:41.081 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.082+0000 7f4eccb23800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:05:41.081 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.082+0000 7f4eccb23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:05:41.081 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.082+0000 7f4eccb23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:05:41.081 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.082+0000 7f4eccb23800 20 rados->read ofs=0 len=0 2024-09-14T11:05:41.081 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.082+0000 7f4eccb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:41.081 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.082+0000 7f4eccb23800 20 rados->read ofs=0 len=0 2024-09-14T11:05:41.082 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.082+0000 7f4eccb23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:41.082 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.082+0000 7f4eccb23800 20 rados->read ofs=0 len=0 2024-09-14T11:05:41.082 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.083+0000 7f4eccb23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:05:41.082 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.083+0000 7f4eccb23800 20 zone default found 2024-09-14T11:05:41.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.083+0000 7f4eccb23800 4 Realm: () 2024-09-14T11:05:41.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.083+0000 7f4eccb23800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:05:41.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.083+0000 7f4eccb23800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:05:41.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.083+0000 7f4eccb23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:05:41.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.083+0000 7f4eccb23800 20 zonegroup default 2024-09-14T11:05:41.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.083+0000 7f4eccb23800 20 rados->read ofs=0 len=0 2024-09-14T11:05:41.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.083+0000 7f4eccb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:41.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.083+0000 7f4eccb23800 20 rados->read ofs=0 len=0 2024-09-14T11:05:41.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.083+0000 7f4eccb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:41.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.083+0000 7f4eccb23800 20 rados->read ofs=0 len=0 2024-09-14T11:05:41.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.083+0000 7f4eccb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:41.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.083+0000 7f4eccb23800 20 started sync module instance, tier type = 2024-09-14T11:05:41.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.083+0000 7f4eccb23800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:05:41.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.092+0000 7f4eccb23800 20 add_watcher() i=0 2024-09-14T11:05:41.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.092+0000 7f4eccb23800 20 add_watcher() i=1 2024-09-14T11:05:41.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.092+0000 7f4eccb23800 20 add_watcher() i=2 2024-09-14T11:05:41.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.092+0000 7f4eccb23800 20 add_watcher() i=3 2024-09-14T11:05:41.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.092+0000 7f4eccb23800 20 add_watcher() i=4 2024-09-14T11:05:41.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.092+0000 7f4eccb23800 20 add_watcher() i=5 2024-09-14T11:05:41.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.092+0000 7f4eccb23800 20 add_watcher() i=6 2024-09-14T11:05:41.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.093+0000 7f4eccb23800 20 add_watcher() i=7 2024-09-14T11:05:41.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.093+0000 7f4eccb23800 2 all 8 watchers are set, enabling cache 2024-09-14T11:05:41.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.094+0000 7f4d7efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:41.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.095+0000 7f4eccb23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:05:41.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.095+0000 7f4eccb23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:05:41.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.095+0000 7f4eccb23800 5 note: GC not initialized 2024-09-14T11:05:41.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.095+0000 7f4d7dfe3640 20 reqs_thread_entry: start 2024-09-14T11:05:41.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.095+0000 7f4eccb23800 20 init_complete bucket index max shards: 11 2024-09-14T11:05:41.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.095+0000 7f4eccb23800 20 Filter name: none 2024-09-14T11:05:41.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.095+0000 7f4cef7fe640 20 reqs_thread_entry: start 2024-09-14T11:05:41.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.095+0000 7f4eccb23800 20 rados->read ofs=0 len=0 2024-09-14T11:05:41.095 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.096+0000 7f4eccb23800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:05:41.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.096+0000 7f4eccb23800 20 rados->read ofs=0 len=0 2024-09-14T11:05:41.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.096+0000 7f4eccb23800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:05:41.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.096+0000 7f4eccb23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:05:41.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.096+0000 7f4eccb23800 20 rados->read ofs=0 len=0 2024-09-14T11:05:41.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.097+0000 7f4eccb23800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:05:41.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.097+0000 7f4eccb23800 20 rados->read ofs=0 len=0 2024-09-14T11:05:41.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.097+0000 7f4eccb23800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:05:41.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.097+0000 7f4eccb23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:05:41.097 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.099+0000 7f4d7efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:41.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.101+0000 7f4eccb23800 20 remove_watcher() i=0 2024-09-14T11:05:41.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.101+0000 7f4eccb23800 2 removed watcher, disabling cache 2024-09-14T11:05:41.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.101+0000 7f4eccb23800 20 remove_watcher() i=1 2024-09-14T11:05:41.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.102+0000 7f4eccb23800 20 remove_watcher() i=2 2024-09-14T11:05:41.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.103+0000 7f4eccb23800 20 remove_watcher() i=3 2024-09-14T11:05:41.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.104+0000 7f4eccb23800 20 remove_watcher() i=4 2024-09-14T11:05:41.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.105+0000 7f4eccb23800 20 remove_watcher() i=5 2024-09-14T11:05:41.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.106+0000 7f4eccb23800 20 remove_watcher() i=6 2024-09-14T11:05:41.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.107+0000 7f4eccb23800 20 remove_watcher() i=7 2024-09-14T11:05:41.116 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:41.116 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:05:41.116 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-do-reshard id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:05:41.116 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:41.117 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-09-14T11:05:41.151 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:05:41.151 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:05:41.188 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.189+0000 7f7dae614800 20 rados->read ofs=0 len=0 2024-09-14T11:05:41.189 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.191+0000 7f7dae614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:41.189 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.191+0000 7f7dae614800 20 realm 2024-09-14T11:05:41.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.191+0000 7f7dae614800 20 rados->read ofs=0 len=0 2024-09-14T11:05:41.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.191+0000 7f7dae614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:41.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.191+0000 7f7dae614800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:05:41.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.191+0000 7f7dae614800 20 rados->read ofs=0 len=0 2024-09-14T11:05:41.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.191+0000 7f7dae614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:41.190 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.191+0000 7f7dae614800 20 rados->read ofs=0 len=0 2024-09-14T11:05:41.191 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.192+0000 7f7dae614800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:41.191 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.192+0000 7f7dae614800 20 rados->read ofs=0 len=0 2024-09-14T11:05:41.191 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.192+0000 7f7dae614800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:05:41.191 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.192+0000 7f7dae614800 20 searching for the correct realm 2024-09-14T11:05:41.192 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.194+0000 7f7da9ccb640 0 -- 172.21.15.97:0/954575840 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x55e8f8e2e2a0 msgr2=0x55e8f8e30760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:05:41.196 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.197+0000 7f7da9ccb640 0 -- 172.21.15.97:0/954575840 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7f7d94029070 msgr2=0x7f7d9406b3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:05:41.200 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.202+0000 7f7dae614800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:05:41.200 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.202+0000 7f7dae614800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:05:41.201 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.202+0000 7f7dae614800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:05:41.201 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.202+0000 7f7dae614800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:05:41.201 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.202+0000 7f7dae614800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:05:41.201 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.202+0000 7f7dae614800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:05:41.201 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.202+0000 7f7dae614800 20 rados->read ofs=0 len=0 2024-09-14T11:05:41.201 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.202+0000 7f7dae614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:41.201 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.202+0000 7f7dae614800 20 rados->read ofs=0 len=0 2024-09-14T11:05:41.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.202+0000 7f7dae614800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:41.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.202+0000 7f7dae614800 20 rados->read ofs=0 len=0 2024-09-14T11:05:41.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.202+0000 7f7dae614800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:05:41.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.203+0000 7f7dae614800 20 zone default found 2024-09-14T11:05:41.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.203+0000 7f7dae614800 4 Realm: () 2024-09-14T11:05:41.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.203+0000 7f7dae614800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:05:41.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.203+0000 7f7dae614800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:05:41.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.203+0000 7f7dae614800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:05:41.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.203+0000 7f7dae614800 20 zonegroup default 2024-09-14T11:05:41.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.203+0000 7f7dae614800 20 rados->read ofs=0 len=0 2024-09-14T11:05:41.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.203+0000 7f7dae614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:41.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.203+0000 7f7dae614800 20 rados->read ofs=0 len=0 2024-09-14T11:05:41.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.203+0000 7f7dae614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:41.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.203+0000 7f7dae614800 20 rados->read ofs=0 len=0 2024-09-14T11:05:41.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.203+0000 7f7dae614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:41.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.203+0000 7f7dae614800 20 started sync module instance, tier type = 2024-09-14T11:05:41.204 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.203+0000 7f7dae614800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:05:41.210 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.211+0000 7f7dae614800 20 add_watcher() i=0 2024-09-14T11:05:41.210 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.211+0000 7f7dae614800 20 add_watcher() i=1 2024-09-14T11:05:41.210 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.211+0000 7f7dae614800 20 add_watcher() i=2 2024-09-14T11:05:41.210 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.211+0000 7f7dae614800 20 add_watcher() i=3 2024-09-14T11:05:41.210 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.211+0000 7f7dae614800 20 add_watcher() i=4 2024-09-14T11:05:41.210 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.211+0000 7f7dae614800 20 add_watcher() i=5 2024-09-14T11:05:41.211 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.211+0000 7f7dae614800 20 add_watcher() i=6 2024-09-14T11:05:41.211 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.212+0000 7f7dae614800 20 add_watcher() i=7 2024-09-14T11:05:41.211 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.212+0000 7f7dae614800 2 all 8 watchers are set, enabling cache 2024-09-14T11:05:41.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.214+0000 7f7c5b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:41.213 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.214+0000 7f7dae614800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:05:41.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.214+0000 7f7dae614800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:05:41.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.215+0000 7f7dae614800 5 note: GC not initialized 2024-09-14T11:05:41.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.215+0000 7f7c5a7fc640 20 reqs_thread_entry: start 2024-09-14T11:05:41.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.215+0000 7f7dae614800 20 init_complete bucket index max shards: 11 2024-09-14T11:05:41.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.215+0000 7f7dae614800 20 Filter name: none 2024-09-14T11:05:41.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.215+0000 7f7bcbfff640 20 reqs_thread_entry: start 2024-09-14T11:05:41.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.215+0000 7f7dae614800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-14T11:05:41.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.215+0000 7f7dae614800 20 rados->read ofs=0 len=0 2024-09-14T11:05:41.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.215+0000 7f7dae614800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:05:41.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.215+0000 7f7dae614800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-14T11:05:41.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.215+0000 7f7dae614800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-14T11:05:41.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.215+0000 7f7dae614800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33 : miss 2024-09-14T11:05:41.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.215+0000 7f7dae614800 20 rados->read ofs=0 len=0 2024-09-14T11:05:41.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.216+0000 7f7dae614800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:05:41.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.216+0000 7f7dae614800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33 info.flags=0x17 2024-09-14T11:05:41.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.216+0000 7f7dae614800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33 to cache LRU end 2024-09-14T11:05:41.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.216+0000 7f7dae614800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:05:41.215 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.216+0000 7f7dae614800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:41.216 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.216+0000 7f7dae614800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33 2024-09-14T11:05:41.219 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.220+0000 7f7dae614800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33 info.flags=0x17 2024-09-14T11:05:41.220 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.220+0000 7f7dae614800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33 to cache LRU end 2024-09-14T11:05:41.220 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.220+0000 7f7dae614800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:41.220 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.220+0000 7f7dae614800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33, ofs0, ns] 2024-09-14T11:05:41.220 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.221+0000 7f7c8d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595212 cookie 94459096459648 notifier 7037 bl.length()=911 2024-09-14T11:05:41.220 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.221+0000 7f7c8d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33 info.flags=0x17 2024-09-14T11:05:41.220 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.221+0000 7f7c8d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33 to cache LRU end 2024-09-14T11:05:41.220 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.221+0000 7f7c8d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:41.220 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.221+0000 7f7dae614800 20 handle_bi_update(): bucket=:error-at-do-reshard[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33]): orig_sources= new_sources= 2024-09-14T11:05:41.220 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.221+0000 7f7dae614800 20 handle_bi_update(): bucket=:error-at-do-reshard[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33]): potential sources added=[] removed=[] 2024-09-14T11:05:41.220 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.221+0000 7f7dae614800 20 handle_bi_update(): bucket=:error-at-do-reshard[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33]): orig_dests= new_dests= 2024-09-14T11:05:41.220 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.221+0000 7f7dae614800 20 handle_bi_update(): bucket=:error-at-do-reshard[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33]): potential dests added=[] removed=[] 2024-09-14T11:05:41.224 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.225+0000 7f7dae614800 -1 Injecting error=-5 at location=do_reshard 2024-09-14T11:05:41.230 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.231+0000 7f7dae614800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:05:41.230 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.231+0000 7f7dae614800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33 2024-09-14T11:05:41.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.233+0000 7f7dae614800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33 info.flags=0x17 2024-09-14T11:05:41.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.233+0000 7f7dae614800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33 to cache LRU end 2024-09-14T11:05:41.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.233+0000 7f7dae614800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:41.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.233+0000 7f7dae614800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33, ofs0, ns] 2024-09-14T11:05:41.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.233+0000 7f7c8d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595213 cookie 94459096459648 notifier 7037 bl.length()=879 2024-09-14T11:05:41.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.233+0000 7f7c8d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33 info.flags=0x17 2024-09-14T11:05:41.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.233+0000 7f7c8d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33 to cache LRU end 2024-09-14T11:05:41.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.233+0000 7f7c8d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:41.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.233+0000 7f7dae614800 20 handle_bi_update(): bucket=:error-at-do-reshard[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33]): orig_sources= new_sources= 2024-09-14T11:05:41.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.233+0000 7f7dae614800 20 handle_bi_update(): bucket=:error-at-do-reshard[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33]): potential sources added=[] removed=[] 2024-09-14T11:05:41.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.233+0000 7f7dae614800 20 handle_bi_update(): bucket=:error-at-do-reshard[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33]): orig_dests= new_dests= 2024-09-14T11:05:41.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.233+0000 7f7dae614800 20 handle_bi_update(): bucket=:error-at-do-reshard[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33]): potential dests added=[] removed=[] 2024-09-14T11:05:41.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.233+0000 7f7dae614800 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-09-14T11:05:41.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.235+0000 7f7c5b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:41.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.237+0000 7f7dae614800 20 remove_watcher() i=0 2024-09-14T11:05:41.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.237+0000 7f7dae614800 2 removed watcher, disabling cache 2024-09-14T11:05:41.236 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.238+0000 7f7dae614800 20 remove_watcher() i=1 2024-09-14T11:05:41.237 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.239+0000 7f7dae614800 20 remove_watcher() i=2 2024-09-14T11:05:41.238 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.240+0000 7f7dae614800 20 remove_watcher() i=3 2024-09-14T11:05:41.239 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.241+0000 7f7dae614800 20 remove_watcher() i=4 2024-09-14T11:05:41.240 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.242+0000 7f7dae614800 20 remove_watcher() i=5 2024-09-14T11:05:41.241 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.243+0000 7f7dae614800 20 remove_watcher() i=6 2024-09-14T11:05:41.242 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.243+0000 7f7dae614800 20 remove_watcher() i=7 2024-09-14T11:05:41.254 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-14T11:05:41.282 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:05:41.282 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:05:41.319 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.320+0000 7f4a5aebb800 20 rados->read ofs=0 len=0 2024-09-14T11:05:41.321 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.322+0000 7f4a5aebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:41.321 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.322+0000 7f4a5aebb800 20 realm 2024-09-14T11:05:41.321 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.322+0000 7f4a5aebb800 20 rados->read ofs=0 len=0 2024-09-14T11:05:41.321 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.322+0000 7f4a5aebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:41.321 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.322+0000 7f4a5aebb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:05:41.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.322+0000 7f4a5aebb800 20 rados->read ofs=0 len=0 2024-09-14T11:05:41.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.322+0000 7f4a5aebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:41.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.322+0000 7f4a5aebb800 20 rados->read ofs=0 len=0 2024-09-14T11:05:41.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.323+0000 7f4a5aebb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:41.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.323+0000 7f4a5aebb800 20 rados->read ofs=0 len=0 2024-09-14T11:05:41.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.324+0000 7f4a5aebb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:05:41.323 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.324+0000 7f4a5aebb800 20 searching for the correct realm 2024-09-14T11:05:41.324 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.326+0000 7f4a591a6640 0 -- 172.21.15.97:0/107887387 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f4a4006b020 msgr2=0x7f4a400cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:05:41.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.531+0000 7f4a501a4640 0 -- 172.21.15.97:0/107887387 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f4a48028040 msgr2=0x7f4a48072aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:05:41.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.536+0000 7f4a5aebb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:05:41.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.536+0000 7f4a5aebb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:05:41.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.536+0000 7f4a5aebb800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:05:41.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.536+0000 7f4a5aebb800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:05:41.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.536+0000 7f4a5aebb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:05:41.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.536+0000 7f4a5aebb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:05:41.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.536+0000 7f4a5aebb800 20 rados->read ofs=0 len=0 2024-09-14T11:05:41.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.536+0000 7f4a5aebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:41.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.536+0000 7f4a5aebb800 20 rados->read ofs=0 len=0 2024-09-14T11:05:41.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.537+0000 7f4a5aebb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:41.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.537+0000 7f4a5aebb800 20 rados->read ofs=0 len=0 2024-09-14T11:05:41.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.537+0000 7f4a5aebb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:05:41.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.537+0000 7f4a5aebb800 20 zone default found 2024-09-14T11:05:41.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.537+0000 7f4a5aebb800 4 Realm: () 2024-09-14T11:05:41.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.537+0000 7f4a5aebb800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:05:41.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.537+0000 7f4a5aebb800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:05:41.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.537+0000 7f4a5aebb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:05:41.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.537+0000 7f4a5aebb800 20 zonegroup default 2024-09-14T11:05:41.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.537+0000 7f4a5aebb800 20 rados->read ofs=0 len=0 2024-09-14T11:05:41.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.537+0000 7f4a5aebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:41.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.537+0000 7f4a5aebb800 20 rados->read ofs=0 len=0 2024-09-14T11:05:41.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.538+0000 7f4a5aebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:41.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.538+0000 7f4a5aebb800 20 rados->read ofs=0 len=0 2024-09-14T11:05:41.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.538+0000 7f4a5aebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:41.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.538+0000 7f4a5aebb800 20 started sync module instance, tier type = 2024-09-14T11:05:41.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.538+0000 7f4a5aebb800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:05:41.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.546+0000 7f4a5aebb800 20 add_watcher() i=0 2024-09-14T11:05:41.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.546+0000 7f4a5aebb800 20 add_watcher() i=1 2024-09-14T11:05:41.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.546+0000 7f4a5aebb800 20 add_watcher() i=2 2024-09-14T11:05:41.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.546+0000 7f4a5aebb800 20 add_watcher() i=3 2024-09-14T11:05:41.545 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.546+0000 7f4a5aebb800 20 add_watcher() i=4 2024-09-14T11:05:41.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.546+0000 7f4a5aebb800 20 add_watcher() i=5 2024-09-14T11:05:41.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.547+0000 7f4a5aebb800 20 add_watcher() i=6 2024-09-14T11:05:41.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.547+0000 7f4a5aebb800 20 add_watcher() i=7 2024-09-14T11:05:41.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.547+0000 7f4a5aebb800 2 all 8 watchers are set, enabling cache 2024-09-14T11:05:41.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.549+0000 7f490efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:41.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.550+0000 7f4a5aebb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:05:41.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.550+0000 7f4a5aebb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:05:41.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.550+0000 7f4a5aebb800 5 note: GC not initialized 2024-09-14T11:05:41.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.550+0000 7f490dfe3640 20 reqs_thread_entry: start 2024-09-14T11:05:41.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.550+0000 7f4a5aebb800 20 init_complete bucket index max shards: 11 2024-09-14T11:05:41.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.550+0000 7f4a5aebb800 20 Filter name: none 2024-09-14T11:05:41.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.550+0000 7f487f7fe640 20 reqs_thread_entry: start 2024-09-14T11:05:41.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.550+0000 7f4a5aebb800 20 rados->read ofs=0 len=0 2024-09-14T11:05:41.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.551+0000 7f4a5aebb800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:05:41.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.551+0000 7f4a5aebb800 20 rados->read ofs=0 len=0 2024-09-14T11:05:41.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.551+0000 7f4a5aebb800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:05:41.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.551+0000 7f4a5aebb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:05:41.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.551+0000 7f4a5aebb800 20 rados->read ofs=0 len=0 2024-09-14T11:05:41.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.552+0000 7f4a5aebb800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:05:41.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.552+0000 7f4a5aebb800 20 rados->read ofs=0 len=0 2024-09-14T11:05:41.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.552+0000 7f4a5aebb800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:05:41.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.552+0000 7f4a5aebb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:05:41.552 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.553+0000 7f490efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:41.554 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.556+0000 7f4a5aebb800 20 remove_watcher() i=0 2024-09-14T11:05:41.554 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.556+0000 7f4a5aebb800 2 removed watcher, disabling cache 2024-09-14T11:05:41.555 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.557+0000 7f4a5aebb800 20 remove_watcher() i=1 2024-09-14T11:05:41.556 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.557+0000 7f4a5aebb800 20 remove_watcher() i=2 2024-09-14T11:05:41.557 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.558+0000 7f4a5aebb800 20 remove_watcher() i=3 2024-09-14T11:05:41.558 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.559+0000 7f4a5aebb800 20 remove_watcher() i=4 2024-09-14T11:05:41.559 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.560+0000 7f4a5aebb800 20 remove_watcher() i=5 2024-09-14T11:05:41.560 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.561+0000 7f4a5aebb800 20 remove_watcher() i=6 2024-09-14T11:05:41.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.562+0000 7f4a5aebb800 20 remove_watcher() i=7 2024-09-14T11:05:41.571 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:41.571 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:05:41.571 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-do-reshard id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:05:41.571 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:41.623 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:05:41.656 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:05:41.656 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:05:41.693 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.695+0000 7f1078610800 20 rados->read ofs=0 len=0 2024-09-14T11:05:41.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.696+0000 7f1078610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:41.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.696+0000 7f1078610800 20 realm 2024-09-14T11:05:41.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.696+0000 7f1078610800 20 rados->read ofs=0 len=0 2024-09-14T11:05:41.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.696+0000 7f1078610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:41.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.696+0000 7f1078610800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:05:41.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.696+0000 7f1078610800 20 rados->read ofs=0 len=0 2024-09-14T11:05:41.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.697+0000 7f1078610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:41.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.697+0000 7f1078610800 20 rados->read ofs=0 len=0 2024-09-14T11:05:41.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.697+0000 7f1078610800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:41.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.697+0000 7f1078610800 20 rados->read ofs=0 len=0 2024-09-14T11:05:41.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.698+0000 7f1078610800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:05:41.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.698+0000 7f1078610800 20 searching for the correct realm 2024-09-14T11:05:41.699 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.700+0000 7f10735bb640 0 -- 172.21.15.97:0/220069510 >> [v2:172.21.15.97:6816/4093696477,v1:172.21.15.97:6817/4093696477] conn(0x5631cb457dc0 msgr2=0x5631cb45a1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:05:41.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.703+0000 7f10735bb640 0 -- 172.21.15.97:0/220069510 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f106809b040 msgr2=0x7f10680ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:05:41.908 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.909+0000 7f1078610800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:05:41.908 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.909+0000 7f1078610800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:05:41.909 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.909+0000 7f1078610800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:05:41.909 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.909+0000 7f1078610800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:05:41.909 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.909+0000 7f1078610800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:05:41.909 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.909+0000 7f1078610800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:05:41.909 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.909+0000 7f1078610800 20 rados->read ofs=0 len=0 2024-09-14T11:05:41.909 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.910+0000 7f1078610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:41.909 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.910+0000 7f1078610800 20 rados->read ofs=0 len=0 2024-09-14T11:05:41.909 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.910+0000 7f1078610800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:41.909 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.910+0000 7f1078610800 20 rados->read ofs=0 len=0 2024-09-14T11:05:41.910 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.910+0000 7f1078610800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:05:41.910 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.910+0000 7f1078610800 20 zone default found 2024-09-14T11:05:41.911 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.910+0000 7f1078610800 4 Realm: () 2024-09-14T11:05:41.911 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.910+0000 7f1078610800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:05:41.911 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.910+0000 7f1078610800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:05:41.911 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.910+0000 7f1078610800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:05:41.911 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.910+0000 7f1078610800 20 zonegroup default 2024-09-14T11:05:41.911 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.910+0000 7f1078610800 20 rados->read ofs=0 len=0 2024-09-14T11:05:41.911 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.910+0000 7f1078610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:41.911 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.910+0000 7f1078610800 20 rados->read ofs=0 len=0 2024-09-14T11:05:41.911 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.911+0000 7f1078610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:41.911 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.911+0000 7f1078610800 20 rados->read ofs=0 len=0 2024-09-14T11:05:41.911 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.911+0000 7f1078610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:41.911 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.911+0000 7f1078610800 20 started sync module instance, tier type = 2024-09-14T11:05:41.911 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.911+0000 7f1078610800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:05:41.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.920+0000 7f1078610800 20 add_watcher() i=0 2024-09-14T11:05:41.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.920+0000 7f1078610800 20 add_watcher() i=1 2024-09-14T11:05:41.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.920+0000 7f1078610800 20 add_watcher() i=2 2024-09-14T11:05:41.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.920+0000 7f1078610800 20 add_watcher() i=3 2024-09-14T11:05:41.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.920+0000 7f1078610800 20 add_watcher() i=4 2024-09-14T11:05:41.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.920+0000 7f1078610800 20 add_watcher() i=5 2024-09-14T11:05:41.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.920+0000 7f1078610800 20 add_watcher() i=6 2024-09-14T11:05:41.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.921+0000 7f1078610800 20 add_watcher() i=7 2024-09-14T11:05:41.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.921+0000 7f1078610800 2 all 8 watchers are set, enabling cache 2024-09-14T11:05:41.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.923+0000 7f0f29fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:41.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.923+0000 7f1078610800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:05:41.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.923+0000 7f1078610800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:05:41.922 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.923+0000 7f1078610800 5 note: GC not initialized 2024-09-14T11:05:41.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.923+0000 7f0f28fe1640 20 reqs_thread_entry: start 2024-09-14T11:05:41.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.923+0000 7f1078610800 20 init_complete bucket index max shards: 11 2024-09-14T11:05:41.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.923+0000 7f1078610800 20 Filter name: none 2024-09-14T11:05:41.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.924+0000 7f0ea27fc640 20 reqs_thread_entry: start 2024-09-14T11:05:41.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.924+0000 7f1078610800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-14T11:05:41.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.924+0000 7f1078610800 20 rados->read ofs=0 len=0 2024-09-14T11:05:41.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.924+0000 7f1078610800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:05:41.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.924+0000 7f1078610800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-14T11:05:41.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.924+0000 7f1078610800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-14T11:05:41.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.924+0000 7f1078610800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33 : miss 2024-09-14T11:05:41.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.924+0000 7f1078610800 20 rados->read ofs=0 len=0 2024-09-14T11:05:41.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.925+0000 7f1078610800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:05:41.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.925+0000 7f1078610800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33 info.flags=0x17 2024-09-14T11:05:41.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.925+0000 7f1078610800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33 to cache LRU end 2024-09-14T11:05:41.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.925+0000 7f1078610800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:05:41.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.925+0000 7f1078610800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:41.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.925+0000 7f1078610800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33 2024-09-14T11:05:41.927 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.929+0000 7f1078610800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33 info.flags=0x17 2024-09-14T11:05:41.927 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.929+0000 7f1078610800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33 to cache LRU end 2024-09-14T11:05:41.927 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.929+0000 7f1078610800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:41.928 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.929+0000 7f1078610800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33, ofs0, ns] 2024-09-14T11:05:41.928 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.929+0000 7f0f527fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595214 cookie 94771863763504 notifier 7503 bl.length()=911 2024-09-14T11:05:41.928 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.929+0000 7f0f527fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33 info.flags=0x17 2024-09-14T11:05:41.928 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.929+0000 7f0f527fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33 to cache LRU end 2024-09-14T11:05:41.928 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.929+0000 7f0f527fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:41.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.930+0000 7f1078610800 20 handle_bi_update(): bucket=:error-at-do-reshard[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33]): orig_sources= new_sources= 2024-09-14T11:05:41.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.930+0000 7f1078610800 20 handle_bi_update(): bucket=:error-at-do-reshard[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33]): potential sources added=[] removed=[] 2024-09-14T11:05:41.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.930+0000 7f1078610800 20 handle_bi_update(): bucket=:error-at-do-reshard[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33]): orig_dests= new_dests= 2024-09-14T11:05:41.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.930+0000 7f1078610800 20 handle_bi_update(): bucket=:error-at-do-reshard[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33]): potential dests added=[] removed=[] 2024-09-14T11:05:41.933 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.935+0000 7f1078610800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33.1.0 2024-09-14T11:05:41.933 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.935+0000 7f1078610800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33.1.0 2024-09-14T11:05:41.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.935+0000 7f1078610800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33.1.1 2024-09-14T11:05:41.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.935+0000 7f1078610800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33.1.1 2024-09-14T11:05:41.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.935+0000 7f1078610800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33.1.2 2024-09-14T11:05:41.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.935+0000 7f1078610800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33.1.2 2024-09-14T11:05:41.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.935+0000 7f1078610800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33.1.3 2024-09-14T11:05:41.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.935+0000 7f1078610800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33.1.3 2024-09-14T11:05:41.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.935+0000 7f1078610800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33.1.4 2024-09-14T11:05:41.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.935+0000 7f1078610800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33.1.4 2024-09-14T11:05:41.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.935+0000 7f1078610800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33.1.5 2024-09-14T11:05:41.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.935+0000 7f1078610800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33.1.5 2024-09-14T11:05:41.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.935+0000 7f1078610800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33.1.6 2024-09-14T11:05:41.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.935+0000 7f1078610800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33.1.6 2024-09-14T11:05:41.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.935+0000 7f1078610800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33.1.7 2024-09-14T11:05:41.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.935+0000 7f1078610800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33.1.7 2024-09-14T11:05:41.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.935+0000 7f1078610800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33.1.8 2024-09-14T11:05:41.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.935+0000 7f1078610800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33.1.8 2024-09-14T11:05:41.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.935+0000 7f1078610800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33.1.9 2024-09-14T11:05:41.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.935+0000 7f1078610800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33.1.9 2024-09-14T11:05:41.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.935+0000 7f1078610800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33.1.10 2024-09-14T11:05:41.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.935+0000 7f1078610800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33.1.10 2024-09-14T11:05:41.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.935+0000 7f1078610800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33.1.11 2024-09-14T11:05:41.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.935+0000 7f1078610800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33.1.11 2024-09-14T11:05:41.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.935+0000 7f1078610800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33.0 2024-09-14T11:05:41.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.935+0000 7f1078610800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33.1 2024-09-14T11:05:41.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.936+0000 7f1078610800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33.2 2024-09-14T11:05:41.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.936+0000 7f1078610800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33.3 2024-09-14T11:05:41.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.937+0000 7f1078610800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33.4 2024-09-14T11:05:41.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.937+0000 7f1078610800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33.5 2024-09-14T11:05:41.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.938+0000 7f1078610800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33.6 2024-09-14T11:05:41.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.938+0000 7f1078610800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33.7 2024-09-14T11:05:41.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.939+0000 7f1078610800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33.8 2024-09-14T11:05:41.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.939+0000 7f1078610800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33.9 2024-09-14T11:05:41.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.940+0000 7f1078610800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33.10 2024-09-14T11:05:41.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.943+0000 7f1078610800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:05:41.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.943+0000 7f1078610800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33 2024-09-14T11:05:41.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.944+0000 7f1078610800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33 info.flags=0x17 2024-09-14T11:05:41.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.944+0000 7f1078610800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33 to cache LRU end 2024-09-14T11:05:41.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.944+0000 7f1078610800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:41.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.944+0000 7f1078610800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33, ofs0, ns] 2024-09-14T11:05:41.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.944+0000 7f0f52ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595215 cookie 94771863763504 notifier 7503 bl.length()=911 2024-09-14T11:05:41.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.944+0000 7f0f52ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33 info.flags=0x17 2024-09-14T11:05:41.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.944+0000 7f0f52ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33 to cache LRU end 2024-09-14T11:05:41.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.944+0000 7f0f52ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:41.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.945+0000 7f1078610800 20 handle_bi_update(): bucket=:error-at-do-reshard[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33]): orig_sources= new_sources= 2024-09-14T11:05:41.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.945+0000 7f1078610800 20 handle_bi_update(): bucket=:error-at-do-reshard[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33]): potential sources added=[] removed=[] 2024-09-14T11:05:41.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.945+0000 7f1078610800 20 handle_bi_update(): bucket=:error-at-do-reshard[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33]): orig_dests= new_dests= 2024-09-14T11:05:41.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.945+0000 7f1078610800 20 handle_bi_update(): bucket=:error-at-do-reshard[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33]): potential dests added=[] removed=[] 2024-09-14T11:05:41.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.947+0000 7f1078610800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33.0 2024-09-14T11:05:41.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.947+0000 7f1078610800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33.1 2024-09-14T11:05:41.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.948+0000 7f1078610800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33.2 2024-09-14T11:05:41.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.948+0000 7f1078610800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33.3 2024-09-14T11:05:41.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.948+0000 7f1078610800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33.4 2024-09-14T11:05:41.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.949+0000 7f1078610800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33.5 2024-09-14T11:05:41.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.949+0000 7f1078610800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33.6 2024-09-14T11:05:41.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.949+0000 7f1078610800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33.7 2024-09-14T11:05:41.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.950+0000 7f1078610800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33.8 2024-09-14T11:05:41.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.950+0000 7f1078610800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33.9 2024-09-14T11:05:41.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.950+0000 7f1078610800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33.10 2024-09-14T11:05:41.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.951+0000 7f1078610800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:05:41.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.951+0000 7f1078610800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33 2024-09-14T11:05:41.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.952+0000 7f1078610800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33 info.flags=0x17 2024-09-14T11:05:41.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.952+0000 7f1078610800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33 to cache LRU end 2024-09-14T11:05:41.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.952+0000 7f1078610800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:41.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.952+0000 7f1078610800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33, ofs0, ns] 2024-09-14T11:05:41.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.953+0000 7f0f52ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595216 cookie 94771863763504 notifier 7503 bl.length()=879 2024-09-14T11:05:41.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.953+0000 7f0f52ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33 info.flags=0x17 2024-09-14T11:05:41.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.953+0000 7f0f52ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33 to cache LRU end 2024-09-14T11:05:41.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.953+0000 7f0f52ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:41.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.953+0000 7f1078610800 20 handle_bi_update(): bucket=:error-at-do-reshard[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33]): orig_sources= new_sources= 2024-09-14T11:05:41.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.953+0000 7f1078610800 20 handle_bi_update(): bucket=:error-at-do-reshard[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33]): potential sources added=[] removed=[] 2024-09-14T11:05:41.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.953+0000 7f1078610800 20 handle_bi_update(): bucket=:error-at-do-reshard[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33]): orig_dests= new_dests= 2024-09-14T11:05:41.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.953+0000 7f1078610800 20 handle_bi_update(): bucket=:error-at-do-reshard[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33]): potential dests added=[] removed=[] 2024-09-14T11:05:41.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.956+0000 7f1078610800 1 execute INFO: reshard of bucket "error-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-14T11:05:41.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.957+0000 7f0f29fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:41.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.960+0000 7f1078610800 20 remove_watcher() i=0 2024-09-14T11:05:41.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.960+0000 7f1078610800 2 removed watcher, disabling cache 2024-09-14T11:05:41.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.960+0000 7f1078610800 20 remove_watcher() i=1 2024-09-14T11:05:41.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.961+0000 7f1078610800 20 remove_watcher() i=2 2024-09-14T11:05:41.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.962+0000 7f1078610800 20 remove_watcher() i=3 2024-09-14T11:05:41.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.963+0000 7f1078610800 20 remove_watcher() i=4 2024-09-14T11:05:41.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.964+0000 7f1078610800 20 remove_watcher() i=5 2024-09-14T11:05:41.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.965+0000 7f1078610800 20 remove_watcher() i=6 2024-09-14T11:05:41.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:41.967+0000 7f1078610800 20 remove_watcher() i=7 2024-09-14T11:05:41.977 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-14T11:05:42.005 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:05:42.005 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:05:42.042 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.043+0000 7fb28e813800 20 rados->read ofs=0 len=0 2024-09-14T11:05:42.044 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.045+0000 7fb28e813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:42.044 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.045+0000 7fb28e813800 20 realm 2024-09-14T11:05:42.044 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.045+0000 7fb28e813800 20 rados->read ofs=0 len=0 2024-09-14T11:05:42.044 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.045+0000 7fb28e813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:42.044 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.045+0000 7fb28e813800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:05:42.044 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.045+0000 7fb28e813800 20 rados->read ofs=0 len=0 2024-09-14T11:05:42.045 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.046+0000 7fb28e813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:42.045 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.046+0000 7fb28e813800 20 rados->read ofs=0 len=0 2024-09-14T11:05:42.045 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.046+0000 7fb28e813800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:42.045 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.046+0000 7fb28e813800 20 rados->read ofs=0 len=0 2024-09-14T11:05:42.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.047+0000 7fb28e813800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:05:42.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.047+0000 7fb28e813800 20 searching for the correct realm 2024-09-14T11:05:42.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.049+0000 7fb28a749640 0 -- 172.21.15.97:0/1475242371 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7fb274090040 msgr2=0x7fb274092950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:05:42.253 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.254+0000 7fb281747640 0 -- 172.21.15.97:0/1475242371 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7fb27c008930 msgr2=0x7fb27c0153c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:05:42.257 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.258+0000 7fb28e813800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:05:42.257 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.258+0000 7fb28e813800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:05:42.257 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.258+0000 7fb28e813800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:05:42.257 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.258+0000 7fb28e813800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:05:42.257 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.258+0000 7fb28e813800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:05:42.257 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.258+0000 7fb28e813800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:05:42.257 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.258+0000 7fb28e813800 20 rados->read ofs=0 len=0 2024-09-14T11:05:42.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.259+0000 7fb28e813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:42.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.259+0000 7fb28e813800 20 rados->read ofs=0 len=0 2024-09-14T11:05:42.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.259+0000 7fb28e813800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:42.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.259+0000 7fb28e813800 20 rados->read ofs=0 len=0 2024-09-14T11:05:42.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.260+0000 7fb28e813800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:05:42.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.260+0000 7fb28e813800 20 zone default found 2024-09-14T11:05:42.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.260+0000 7fb28e813800 4 Realm: () 2024-09-14T11:05:42.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.260+0000 7fb28e813800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:05:42.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.260+0000 7fb28e813800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:05:42.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.260+0000 7fb28e813800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:05:42.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.260+0000 7fb28e813800 20 zonegroup default 2024-09-14T11:05:42.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.260+0000 7fb28e813800 20 rados->read ofs=0 len=0 2024-09-14T11:05:42.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.260+0000 7fb28e813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:42.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.260+0000 7fb28e813800 20 rados->read ofs=0 len=0 2024-09-14T11:05:42.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.260+0000 7fb28e813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:42.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.260+0000 7fb28e813800 20 rados->read ofs=0 len=0 2024-09-14T11:05:42.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.260+0000 7fb28e813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:42.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.260+0000 7fb28e813800 20 started sync module instance, tier type = 2024-09-14T11:05:42.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.260+0000 7fb28e813800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:05:42.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.270+0000 7fb28e813800 20 add_watcher() i=0 2024-09-14T11:05:42.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.270+0000 7fb28e813800 20 add_watcher() i=1 2024-09-14T11:05:42.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.270+0000 7fb28e813800 20 add_watcher() i=2 2024-09-14T11:05:42.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.270+0000 7fb28e813800 20 add_watcher() i=3 2024-09-14T11:05:42.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.270+0000 7fb28e813800 20 add_watcher() i=4 2024-09-14T11:05:42.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.270+0000 7fb28e813800 20 add_watcher() i=5 2024-09-14T11:05:42.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.270+0000 7fb28e813800 20 add_watcher() i=6 2024-09-14T11:05:42.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.271+0000 7fb28e813800 20 add_watcher() i=7 2024-09-14T11:05:42.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.271+0000 7fb28e813800 2 all 8 watchers are set, enabling cache 2024-09-14T11:05:42.272 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.273+0000 7fb13b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:42.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.274+0000 7fb28e813800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:05:42.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.274+0000 7fb28e813800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:05:42.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.274+0000 7fb28e813800 5 note: GC not initialized 2024-09-14T11:05:42.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.274+0000 7fb13a7fc640 20 reqs_thread_entry: start 2024-09-14T11:05:42.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.274+0000 7fb28e813800 20 init_complete bucket index max shards: 11 2024-09-14T11:05:42.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.274+0000 7fb28e813800 20 Filter name: none 2024-09-14T11:05:42.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.274+0000 7fb0abfff640 20 reqs_thread_entry: start 2024-09-14T11:05:42.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.274+0000 7fb28e813800 20 rados->read ofs=0 len=0 2024-09-14T11:05:42.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.275+0000 7fb28e813800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:05:42.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.275+0000 7fb28e813800 20 rados->read ofs=0 len=0 2024-09-14T11:05:42.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.275+0000 7fb28e813800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:05:42.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.275+0000 7fb28e813800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:05:42.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.275+0000 7fb28e813800 20 rados->read ofs=0 len=0 2024-09-14T11:05:42.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.276+0000 7fb28e813800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:05:42.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.276+0000 7fb28e813800 20 rados->read ofs=0 len=0 2024-09-14T11:05:42.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.276+0000 7fb28e813800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:05:42.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.276+0000 7fb28e813800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:05:42.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.278+0000 7fb13b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:42.278 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.280+0000 7fb28e813800 20 remove_watcher() i=0 2024-09-14T11:05:42.278 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.280+0000 7fb28e813800 2 removed watcher, disabling cache 2024-09-14T11:05:42.279 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.281+0000 7fb28e813800 20 remove_watcher() i=1 2024-09-14T11:05:42.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.282+0000 7fb28e813800 20 remove_watcher() i=2 2024-09-14T11:05:42.281 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.283+0000 7fb28e813800 20 remove_watcher() i=3 2024-09-14T11:05:42.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.284+0000 7fb28e813800 20 remove_watcher() i=4 2024-09-14T11:05:42.284 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.285+0000 7fb28e813800 20 remove_watcher() i=5 2024-09-14T11:05:42.286 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.287+0000 7fb28e813800 20 remove_watcher() i=6 2024-09-14T11:05:42.288 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.289+0000 7fb28e813800 20 remove_watcher() i=7 2024-09-14T11:05:42.298 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:42.298 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:05:42.298 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-do-reshard id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:05:42.298 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:42.372 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: reshard bucket with abort at do_reshard 2024-09-14T11:05:42.372 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:42.603 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-14T11:05:42.631 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:05:42.632 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:05:42.668 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.670+0000 7fad06724800 20 rados->read ofs=0 len=0 2024-09-14T11:05:42.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.672+0000 7fad06724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:42.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.672+0000 7fad06724800 20 realm 2024-09-14T11:05:42.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.672+0000 7fad06724800 20 rados->read ofs=0 len=0 2024-09-14T11:05:42.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.672+0000 7fad06724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:42.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.672+0000 7fad06724800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:05:42.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.672+0000 7fad06724800 20 rados->read ofs=0 len=0 2024-09-14T11:05:42.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.672+0000 7fad06724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:42.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.672+0000 7fad06724800 20 rados->read ofs=0 len=0 2024-09-14T11:05:42.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.673+0000 7fad06724800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:42.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.673+0000 7fad06724800 20 rados->read ofs=0 len=0 2024-09-14T11:05:42.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.673+0000 7fad06724800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:05:42.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.673+0000 7fad06724800 20 searching for the correct realm 2024-09-14T11:05:42.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.674+0000 7fad023d2640 0 -- 172.21.15.97:0/3150009044 >> [v2:172.21.15.152:6808/1010851305,v1:172.21.15.152:6809/1010851305] conn(0x55d34de9a670 msgr2=0x55d34de9cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:05:42.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.879+0000 7fad023d2640 0 -- 172.21.15.97:0/3150009044 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x55d34de8df30 msgr2=0x55d34de90340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:05:42.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.886+0000 7fad06724800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:05:42.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.886+0000 7fad06724800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:05:42.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.886+0000 7fad06724800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:05:42.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.886+0000 7fad06724800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:05:42.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.886+0000 7fad06724800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:05:42.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.886+0000 7fad06724800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:05:42.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.886+0000 7fad06724800 20 rados->read ofs=0 len=0 2024-09-14T11:05:42.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.886+0000 7fad06724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:42.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.886+0000 7fad06724800 20 rados->read ofs=0 len=0 2024-09-14T11:05:42.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.886+0000 7fad06724800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:42.886 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.886+0000 7fad06724800 20 rados->read ofs=0 len=0 2024-09-14T11:05:42.887 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.887+0000 7fad06724800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:05:42.887 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.887+0000 7fad06724800 20 zone default found 2024-09-14T11:05:42.887 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.887+0000 7fad06724800 4 Realm: () 2024-09-14T11:05:42.887 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.887+0000 7fad06724800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:05:42.887 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.887+0000 7fad06724800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:05:42.887 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.887+0000 7fad06724800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:05:42.887 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.887+0000 7fad06724800 20 zonegroup default 2024-09-14T11:05:42.887 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.887+0000 7fad06724800 20 rados->read ofs=0 len=0 2024-09-14T11:05:42.887 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.887+0000 7fad06724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:42.887 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.887+0000 7fad06724800 20 rados->read ofs=0 len=0 2024-09-14T11:05:42.887 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.887+0000 7fad06724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:42.888 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.887+0000 7fad06724800 20 rados->read ofs=0 len=0 2024-09-14T11:05:42.888 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.887+0000 7fad06724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:42.888 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.887+0000 7fad06724800 20 started sync module instance, tier type = 2024-09-14T11:05:42.888 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.887+0000 7fad06724800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:05:42.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.896+0000 7fad06724800 20 add_watcher() i=0 2024-09-14T11:05:42.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.896+0000 7fad06724800 20 add_watcher() i=1 2024-09-14T11:05:42.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.896+0000 7fad06724800 20 add_watcher() i=2 2024-09-14T11:05:42.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.896+0000 7fad06724800 20 add_watcher() i=3 2024-09-14T11:05:42.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.896+0000 7fad06724800 20 add_watcher() i=4 2024-09-14T11:05:42.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.896+0000 7fad06724800 20 add_watcher() i=5 2024-09-14T11:05:42.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.896+0000 7fad06724800 20 add_watcher() i=6 2024-09-14T11:05:42.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.897+0000 7fad06724800 20 add_watcher() i=7 2024-09-14T11:05:42.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.897+0000 7fad06724800 2 all 8 watchers are set, enabling cache 2024-09-14T11:05:42.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.898+0000 7fabb3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:42.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.899+0000 7fad06724800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:05:42.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.899+0000 7fad06724800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:05:42.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.899+0000 7fad06724800 5 note: GC not initialized 2024-09-14T11:05:42.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.899+0000 7fabb2fe5640 20 reqs_thread_entry: start 2024-09-14T11:05:42.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.899+0000 7fad06724800 20 init_complete bucket index max shards: 11 2024-09-14T11:05:42.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.899+0000 7fad06724800 20 Filter name: none 2024-09-14T11:05:42.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.899+0000 7fabb0fe1640 20 reqs_thread_entry: start 2024-09-14T11:05:42.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.899+0000 7fad06724800 20 rados->read ofs=0 len=0 2024-09-14T11:05:42.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.900+0000 7fad06724800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:05:42.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.900+0000 7fad06724800 20 rados->read ofs=0 len=0 2024-09-14T11:05:42.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.900+0000 7fad06724800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:05:42.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.900+0000 7fad06724800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:05:42.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.900+0000 7fad06724800 20 rados->read ofs=0 len=0 2024-09-14T11:05:42.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.901+0000 7fad06724800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:05:42.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.901+0000 7fad06724800 20 rados->read ofs=0 len=0 2024-09-14T11:05:42.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.901+0000 7fad06724800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:05:42.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.901+0000 7fad06724800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:05:42.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.903+0000 7fabb3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:42.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.905+0000 7fad06724800 20 remove_watcher() i=0 2024-09-14T11:05:42.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.905+0000 7fad06724800 2 removed watcher, disabling cache 2024-09-14T11:05:42.905 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.906+0000 7fad06724800 20 remove_watcher() i=1 2024-09-14T11:05:42.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.908+0000 7fad06724800 20 remove_watcher() i=2 2024-09-14T11:05:42.908 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.909+0000 7fad06724800 20 remove_watcher() i=3 2024-09-14T11:05:42.909 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.910+0000 7fad06724800 20 remove_watcher() i=4 2024-09-14T11:05:42.910 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.911+0000 7fad06724800 20 remove_watcher() i=5 2024-09-14T11:05:42.911 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.912+0000 7fad06724800 20 remove_watcher() i=6 2024-09-14T11:05:42.912 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.913+0000 7fad06724800 20 remove_watcher() i=7 2024-09-14T11:05:42.922 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:42.922 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:05:42.922 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: abort-at-do-reshard id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:05:42.922 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:42.924 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-14T11:05:42.958 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:05:42.958 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:05:42.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.997+0000 7f2d7622f800 20 rados->read ofs=0 len=0 2024-09-14T11:05:42.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.998+0000 7f2d7622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:42.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.998+0000 7f2d7622f800 20 realm 2024-09-14T11:05:42.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.998+0000 7f2d7622f800 20 rados->read ofs=0 len=0 2024-09-14T11:05:42.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.999+0000 7f2d7622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:42.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.999+0000 7f2d7622f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:05:42.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.999+0000 7f2d7622f800 20 rados->read ofs=0 len=0 2024-09-14T11:05:42.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.999+0000 7f2d7622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:42.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.999+0000 7f2d7622f800 20 rados->read ofs=0 len=0 2024-09-14T11:05:42.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.999+0000 7f2d7622f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:42.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:42.999+0000 7f2d7622f800 20 rados->read ofs=0 len=0 2024-09-14T11:05:42.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.000+0000 7f2d7622f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:05:42.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.000+0000 7f2d7622f800 20 searching for the correct realm 2024-09-14T11:05:43.001 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.002+0000 7f2d74521640 0 -- 172.21.15.97:0/1250567262 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f2d5c06d060 msgr2=0x7f2d5c0b9770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:05:43.205 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.206+0000 7f2d7351f640 0 -- 172.21.15.97:0/1250567262 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f2d6402f040 msgr2=0x7f2d64070d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:05:43.411 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.412+0000 7f2d7622f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:05:43.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.412+0000 7f2d7622f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:05:43.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.412+0000 7f2d7622f800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:05:43.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.412+0000 7f2d7622f800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:05:43.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.412+0000 7f2d7622f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:05:43.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.412+0000 7f2d7622f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:05:43.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.412+0000 7f2d7622f800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.413+0000 7f2d7622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:43.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.413+0000 7f2d7622f800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.413+0000 7f2d7622f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:43.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.413+0000 7f2d7622f800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.413+0000 7f2d7622f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:05:43.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.413+0000 7f2d7622f800 20 zone default found 2024-09-14T11:05:43.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.413+0000 7f2d7622f800 4 Realm: () 2024-09-14T11:05:43.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.413+0000 7f2d7622f800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:05:43.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.413+0000 7f2d7622f800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:05:43.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.413+0000 7f2d7622f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:05:43.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.413+0000 7f2d7622f800 20 zonegroup default 2024-09-14T11:05:43.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.413+0000 7f2d7622f800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.413+0000 7f2d7622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:43.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.413+0000 7f2d7622f800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.414+0000 7f2d7622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:43.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.414+0000 7f2d7622f800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.414+0000 7f2d7622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:43.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.414+0000 7f2d7622f800 20 started sync module instance, tier type = 2024-09-14T11:05:43.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.414+0000 7f2d7622f800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:05:43.423 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.424+0000 7f2d7622f800 20 add_watcher() i=0 2024-09-14T11:05:43.423 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.424+0000 7f2d7622f800 20 add_watcher() i=1 2024-09-14T11:05:43.424 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.424+0000 7f2d7622f800 20 add_watcher() i=2 2024-09-14T11:05:43.424 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.424+0000 7f2d7622f800 20 add_watcher() i=3 2024-09-14T11:05:43.424 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.424+0000 7f2d7622f800 20 add_watcher() i=4 2024-09-14T11:05:43.424 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.424+0000 7f2d7622f800 20 add_watcher() i=5 2024-09-14T11:05:43.424 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.425+0000 7f2d7622f800 20 add_watcher() i=6 2024-09-14T11:05:43.424 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.425+0000 7f2d7622f800 20 add_watcher() i=7 2024-09-14T11:05:43.424 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.425+0000 7f2d7622f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:05:43.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.427+0000 7f2c29fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:43.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.428+0000 7f2d7622f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:05:43.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.428+0000 7f2d7622f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:05:43.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.428+0000 7f2d7622f800 5 note: GC not initialized 2024-09-14T11:05:43.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.428+0000 7f2c28fe1640 20 reqs_thread_entry: start 2024-09-14T11:05:43.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.428+0000 7f2d7622f800 20 init_complete bucket index max shards: 11 2024-09-14T11:05:43.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.428+0000 7f2d7622f800 20 Filter name: none 2024-09-14T11:05:43.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.428+0000 7f2ba27fc640 20 reqs_thread_entry: start 2024-09-14T11:05:43.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.428+0000 7f2d7622f800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:05:43.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.428+0000 7f2d7622f800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.429+0000 7f2d7622f800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:05:43.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.429+0000 7f2d7622f800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:05:43.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.429+0000 7f2d7622f800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:05:43.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.429+0000 7f2d7622f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 : miss 2024-09-14T11:05:43.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.429+0000 7f2d7622f800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.429+0000 7f2d7622f800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:05:43.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.429+0000 7f2d7622f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 info.flags=0x17 2024-09-14T11:05:43.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.429+0000 7f2d7622f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 to cache LRU end 2024-09-14T11:05:43.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.429+0000 7f2d7622f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:05:43.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.429+0000 7f2d7622f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:43.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.429+0000 7f2d7622f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 2024-09-14T11:05:43.433 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.434+0000 7f2d7622f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 info.flags=0x17 2024-09-14T11:05:43.434 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.434+0000 7f2d7622f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 to cache LRU end 2024-09-14T11:05:43.434 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.434+0000 7f2d7622f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:43.434 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.434+0000 7f2d7622f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34, ofs0, ns] 2024-09-14T11:05:43.434 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.435+0000 7f2c52ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595097 cookie 94446688647040 notifier 7121 bl.length()=911 2024-09-14T11:05:43.434 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.435+0000 7f2c52ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 info.flags=0x17 2024-09-14T11:05:43.434 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.435+0000 7f2c52ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 to cache LRU end 2024-09-14T11:05:43.434 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.435+0000 7f2c52ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:43.434 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.435+0000 7f2d7622f800 20 handle_bi_update(): bucket=:abort-at-do-reshard[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34]): orig_sources= new_sources= 2024-09-14T11:05:43.434 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.435+0000 7f2d7622f800 20 handle_bi_update(): bucket=:abort-at-do-reshard[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34]): potential sources added=[] removed=[] 2024-09-14T11:05:43.434 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.435+0000 7f2d7622f800 20 handle_bi_update(): bucket=:abort-at-do-reshard[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34]): orig_dests= new_dests= 2024-09-14T11:05:43.434 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.435+0000 7f2d7622f800 20 handle_bi_update(): bucket=:abort-at-do-reshard[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34]): potential dests added=[] removed=[] 2024-09-14T11:05:43.438 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2d7622f800 time 2024-09-14T11:05:43.441327+0000 2024-09-14T11:05:43.439 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:05:43.439 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:05:43.439 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f2d7978c76a] 2024-09-14T11:05:43.439 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f2d7978c928] 2024-09-14T11:05:43.439 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e612c6c0b1] 2024-09-14T11:05:43.439 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55e612c7bf6a] 2024-09-14T11:05:43.439 INFO:tasks.workunit.client.0.smithi097.stderr: 5: main() 2024-09-14T11:05:43.440 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f2d78429590] 2024-09-14T11:05:43.440 INFO:tasks.workunit.client.0.smithi097.stderr: 7: __libc_start_main() 2024-09-14T11:05:43.440 INFO:tasks.workunit.client.0.smithi097.stderr: 8: _start() 2024-09-14T11:05:43.440 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.441+0000 7f2d7622f800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2d7622f800 time 2024-09-14T11:05:43.441327+0000 2024-09-14T11:05:43.440 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:05:43.440 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:43.440 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:05:43.440 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f2d7978c76a] 2024-09-14T11:05:43.440 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f2d7978c928] 2024-09-14T11:05:43.440 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e612c6c0b1] 2024-09-14T11:05:43.440 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55e612c7bf6a] 2024-09-14T11:05:43.440 INFO:tasks.workunit.client.0.smithi097.stderr: 5: main() 2024-09-14T11:05:43.441 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f2d78429590] 2024-09-14T11:05:43.441 INFO:tasks.workunit.client.0.smithi097.stderr: 7: __libc_start_main() 2024-09-14T11:05:43.441 INFO:tasks.workunit.client.0.smithi097.stderr: 8: _start() 2024-09-14T11:05:43.441 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:43.441 INFO:tasks.workunit.client.0.smithi097.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:05:43.441 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f2d7622f800 thread_name:radosgw-admin 2024-09-14T11:05:43.460 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:05:43.460 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f2d7843e6f0] 2024-09-14T11:05:43.460 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f2d7848b99c] 2024-09-14T11:05:43.461 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-14T11:05:43.461 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-14T11:05:43.461 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f2d7978c7c4] 2024-09-14T11:05:43.461 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f2d7978c928] 2024-09-14T11:05:43.461 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e612c6c0b1] 2024-09-14T11:05:43.461 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55e612c7bf6a] 2024-09-14T11:05:43.461 INFO:tasks.workunit.client.0.smithi097.stderr: 9: main() 2024-09-14T11:05:43.461 INFO:tasks.workunit.client.0.smithi097.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f2d78429590] 2024-09-14T11:05:43.461 INFO:tasks.workunit.client.0.smithi097.stderr: 11: __libc_start_main() 2024-09-14T11:05:43.461 INFO:tasks.workunit.client.0.smithi097.stderr: 12: _start() 2024-09-14T11:05:43.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.441+0000 7f2d7622f800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:05:43.461 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f2d7622f800 thread_name:radosgw-admin 2024-09-14T11:05:43.461 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:43.462 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:05:43.462 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f2d7843e6f0] 2024-09-14T11:05:43.462 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f2d7848b99c] 2024-09-14T11:05:43.462 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-14T11:05:43.462 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-14T11:05:43.462 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f2d7978c7c4] 2024-09-14T11:05:43.462 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f2d7978c928] 2024-09-14T11:05:43.462 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e612c6c0b1] 2024-09-14T11:05:43.462 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55e612c7bf6a] 2024-09-14T11:05:43.462 INFO:tasks.workunit.client.0.smithi097.stderr: 9: main() 2024-09-14T11:05:43.462 INFO:tasks.workunit.client.0.smithi097.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f2d78429590] 2024-09-14T11:05:43.462 INFO:tasks.workunit.client.0.smithi097.stderr: 11: __libc_start_main() 2024-09-14T11:05:43.462 INFO:tasks.workunit.client.0.smithi097.stderr: 12: _start() 2024-09-14T11:05:43.463 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:05:43.463 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:43.463 INFO:tasks.workunit.client.0.smithi097.stderr:--- begin dump of recent events --- 2024-09-14T11:05:43.463 INFO:tasks.workunit.client.0.smithi097.stderr: -499> 2024-09-14T11:05:42.979+0000 7f2c61e0b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:05:43.463 INFO:tasks.workunit.client.0.smithi097.stderr: -498> 2024-09-14T11:05:42.979+0000 7f2c61e0b640 10 monclient: dump: 2024-09-14T11:05:43.463 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:05:43.463 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:05:43.463 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:43.463 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:43.463 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:05:43.463 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:05:43.463 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:05:43.463 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:05:43.464 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:05:43.464 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:43.464 INFO:tasks.workunit.client.0.smithi097.stderr: -497> 2024-09-14T11:05:42.979+0000 7f2d7622f800 5 monclient: authenticate success, global_id 7548 2024-09-14T11:05:43.464 INFO:tasks.workunit.client.0.smithi097.stderr: -496> 2024-09-14T11:05:42.979+0000 7f2d7622f800 10 monclient: get_monmap_and_config success 2024-09-14T11:05:43.464 INFO:tasks.workunit.client.0.smithi097.stderr: -495> 2024-09-14T11:05:42.979+0000 7f2d7622f800 4 set_mon_vals no callback set 2024-09-14T11:05:43.464 INFO:tasks.workunit.client.0.smithi097.stderr: -494> 2024-09-14T11:05:42.980+0000 7f2d7622f800 10 monclient: shutdown 2024-09-14T11:05:43.464 INFO:tasks.workunit.client.0.smithi097.stderr: -493> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 asok(0x55e61521c270) unregister_commands rotate-key 2024-09-14T11:05:43.464 INFO:tasks.workunit.client.0.smithi097.stderr: -492> 2024-09-14T11:05:42.980+0000 7f2d7622f800 10 monclient: build_initial_monmap 2024-09-14T11:05:43.464 INFO:tasks.workunit.client.0.smithi097.stderr: -491> 2024-09-14T11:05:42.980+0000 7f2d7622f800 1 build_initial for_mkfs: 0 2024-09-14T11:05:43.464 INFO:tasks.workunit.client.0.smithi097.stderr: -490> 2024-09-14T11:05:42.980+0000 7f2d7622f800 10 monclient: monmap: 2024-09-14T11:05:43.464 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:05:43.464 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:05:43.464 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:05:43.464 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:05:43.465 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:05:43.465 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:05:43.465 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:05:43.465 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:05:43.465 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:05:43.465 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:43.465 INFO:tasks.workunit.client.0.smithi097.stderr: -489> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543e680) adding auth protocol: cephx 2024-09-14T11:05:43.465 INFO:tasks.workunit.client.0.smithi097.stderr: -488> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543e680) adding auth protocol: cephx 2024-09-14T11:05:43.465 INFO:tasks.workunit.client.0.smithi097.stderr: -487> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543e680) adding auth protocol: cephx 2024-09-14T11:05:43.465 INFO:tasks.workunit.client.0.smithi097.stderr: -486> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543e680) adding con mode: secure 2024-09-14T11:05:43.465 INFO:tasks.workunit.client.0.smithi097.stderr: -485> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543e680) adding con mode: crc 2024-09-14T11:05:43.465 INFO:tasks.workunit.client.0.smithi097.stderr: -484> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543e680) adding con mode: secure 2024-09-14T11:05:43.465 INFO:tasks.workunit.client.0.smithi097.stderr: -483> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543e680) adding con mode: crc 2024-09-14T11:05:43.465 INFO:tasks.workunit.client.0.smithi097.stderr: -482> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543e680) adding con mode: secure 2024-09-14T11:05:43.466 INFO:tasks.workunit.client.0.smithi097.stderr: -481> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543e680) adding con mode: crc 2024-09-14T11:05:43.466 INFO:tasks.workunit.client.0.smithi097.stderr: -480> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543e680) adding con mode: crc 2024-09-14T11:05:43.466 INFO:tasks.workunit.client.0.smithi097.stderr: -479> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543e680) adding con mode: secure 2024-09-14T11:05:43.466 INFO:tasks.workunit.client.0.smithi097.stderr: -478> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543e680) adding con mode: crc 2024-09-14T11:05:43.466 INFO:tasks.workunit.client.0.smithi097.stderr: -477> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543e680) adding con mode: secure 2024-09-14T11:05:43.466 INFO:tasks.workunit.client.0.smithi097.stderr: -476> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543e680) adding con mode: crc 2024-09-14T11:05:43.466 INFO:tasks.workunit.client.0.smithi097.stderr: -475> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543e680) adding con mode: secure 2024-09-14T11:05:43.466 INFO:tasks.workunit.client.0.smithi097.stderr: -474> 2024-09-14T11:05:42.980+0000 7f2d7622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:05:43.466 INFO:tasks.workunit.client.0.smithi097.stderr: -473> 2024-09-14T11:05:42.980+0000 7f2d7622f800 1 librados: starting msgr at 2024-09-14T11:05:43.466 INFO:tasks.workunit.client.0.smithi097.stderr: -472> 2024-09-14T11:05:42.980+0000 7f2d7622f800 1 librados: starting objecter 2024-09-14T11:05:43.466 INFO:tasks.workunit.client.0.smithi097.stderr: -471> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 asok(0x55e61521c270) register_command objecter_requests hook 0x55e61543e070 2024-09-14T11:05:43.466 INFO:tasks.workunit.client.0.smithi097.stderr: -470> 2024-09-14T11:05:42.980+0000 7f2d7622f800 1 librados: setting wanted keys 2024-09-14T11:05:43.466 INFO:tasks.workunit.client.0.smithi097.stderr: -469> 2024-09-14T11:05:42.980+0000 7f2d7622f800 1 librados: calling monclient init 2024-09-14T11:05:43.467 INFO:tasks.workunit.client.0.smithi097.stderr: -468> 2024-09-14T11:05:42.980+0000 7f2d7622f800 10 monclient: init 2024-09-14T11:05:43.467 INFO:tasks.workunit.client.0.smithi097.stderr: -467> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543c380) adding auth protocol: cephx 2024-09-14T11:05:43.467 INFO:tasks.workunit.client.0.smithi097.stderr: -466> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543c380) adding auth protocol: cephx 2024-09-14T11:05:43.467 INFO:tasks.workunit.client.0.smithi097.stderr: -465> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543c380) adding auth protocol: cephx 2024-09-14T11:05:43.467 INFO:tasks.workunit.client.0.smithi097.stderr: -464> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543c380) adding con mode: secure 2024-09-14T11:05:43.467 INFO:tasks.workunit.client.0.smithi097.stderr: -463> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543c380) adding con mode: crc 2024-09-14T11:05:43.467 INFO:tasks.workunit.client.0.smithi097.stderr: -462> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543c380) adding con mode: secure 2024-09-14T11:05:43.467 INFO:tasks.workunit.client.0.smithi097.stderr: -461> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543c380) adding con mode: crc 2024-09-14T11:05:43.467 INFO:tasks.workunit.client.0.smithi097.stderr: -460> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543c380) adding con mode: secure 2024-09-14T11:05:43.467 INFO:tasks.workunit.client.0.smithi097.stderr: -459> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543c380) adding con mode: crc 2024-09-14T11:05:43.467 INFO:tasks.workunit.client.0.smithi097.stderr: -458> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543c380) adding con mode: crc 2024-09-14T11:05:43.467 INFO:tasks.workunit.client.0.smithi097.stderr: -457> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543c380) adding con mode: secure 2024-09-14T11:05:43.467 INFO:tasks.workunit.client.0.smithi097.stderr: -456> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543c380) adding con mode: crc 2024-09-14T11:05:43.467 INFO:tasks.workunit.client.0.smithi097.stderr: -455> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543c380) adding con mode: secure 2024-09-14T11:05:43.468 INFO:tasks.workunit.client.0.smithi097.stderr: -454> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543c380) adding con mode: crc 2024-09-14T11:05:43.468 INFO:tasks.workunit.client.0.smithi097.stderr: -453> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543c380) adding con mode: secure 2024-09-14T11:05:43.468 INFO:tasks.workunit.client.0.smithi097.stderr: -452> 2024-09-14T11:05:42.980+0000 7f2d7622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:05:43.468 INFO:tasks.workunit.client.0.smithi097.stderr: -451> 2024-09-14T11:05:42.981+0000 7f2d7622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:05:43.468 INFO:tasks.workunit.client.0.smithi097.stderr: -450> 2024-09-14T11:05:42.981+0000 7f2d7622f800 5 asok(0x55e61521c270) register_command rotate-key hook 0x55e61543c4c8 2024-09-14T11:05:43.468 INFO:tasks.workunit.client.0.smithi097.stderr: -449> 2024-09-14T11:05:42.981+0000 7f2d7622f800 10 monclient: _reopen_session rank -1 2024-09-14T11:05:43.468 INFO:tasks.workunit.client.0.smithi097.stderr: -448> 2024-09-14T11:05:42.981+0000 7f2d7622f800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:05:43.468 INFO:tasks.workunit.client.0.smithi097.stderr: -447> 2024-09-14T11:05:42.981+0000 7f2d7622f800 10 monclient(hunting): picked mon.noname-b con 0x55e6152f3f80 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:05:43.468 INFO:tasks.workunit.client.0.smithi097.stderr: -446> 2024-09-14T11:05:42.981+0000 7f2d7622f800 10 monclient(hunting): picked mon.noname-c con 0x55e615382300 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:05:43.468 INFO:tasks.workunit.client.0.smithi097.stderr: -445> 2024-09-14T11:05:42.981+0000 7f2d7622f800 10 monclient(hunting): picked mon.noname-a con 0x55e615442a50 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:05:43.468 INFO:tasks.workunit.client.0.smithi097.stderr: -444> 2024-09-14T11:05:42.981+0000 7f2d7622f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:05:43.468 INFO:tasks.workunit.client.0.smithi097.stderr: -443> 2024-09-14T11:05:42.981+0000 7f2d7622f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:05:43.468 INFO:tasks.workunit.client.0.smithi097.stderr: -442> 2024-09-14T11:05:42.981+0000 7f2d7622f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:05:43.469 INFO:tasks.workunit.client.0.smithi097.stderr: -441> 2024-09-14T11:05:42.981+0000 7f2d7622f800 10 monclient(hunting): _renew_subs 2024-09-14T11:05:43.469 INFO:tasks.workunit.client.0.smithi097.stderr: -440> 2024-09-14T11:05:42.981+0000 7f2d7622f800 10 monclient(hunting): authenticate will time out at 2024.634257s 2024-09-14T11:05:43.469 INFO:tasks.workunit.client.0.smithi097.stderr: -439> 2024-09-14T11:05:42.981+0000 7f2d7351f640 10 monclient(hunting): get_auth_request con 0x55e615382300 auth_method 0 2024-09-14T11:05:43.469 INFO:tasks.workunit.client.0.smithi097.stderr: -438> 2024-09-14T11:05:42.981+0000 7f2d7351f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:05:43.469 INFO:tasks.workunit.client.0.smithi097.stderr: -437> 2024-09-14T11:05:42.981+0000 7f2d7351f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:05:43.469 INFO:tasks.workunit.client.0.smithi097.stderr: -436> 2024-09-14T11:05:42.981+0000 7f2d7351f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:05:43.469 INFO:tasks.workunit.client.0.smithi097.stderr: -435> 2024-09-14T11:05:42.981+0000 7f2d74521640 10 monclient(hunting): get_auth_request con 0x55e615442a50 auth_method 0 2024-09-14T11:05:43.469 INFO:tasks.workunit.client.0.smithi097.stderr: -434> 2024-09-14T11:05:42.981+0000 7f2d74521640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:05:43.469 INFO:tasks.workunit.client.0.smithi097.stderr: -433> 2024-09-14T11:05:42.981+0000 7f2d74521640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:05:43.469 INFO:tasks.workunit.client.0.smithi097.stderr: -432> 2024-09-14T11:05:42.981+0000 7f2d74521640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:05:43.469 INFO:tasks.workunit.client.0.smithi097.stderr: -431> 2024-09-14T11:05:42.981+0000 7f2d7351f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:05:43.469 INFO:tasks.workunit.client.0.smithi097.stderr: -430> 2024-09-14T11:05:42.981+0000 7f2d7351f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:05:43.469 INFO:tasks.workunit.client.0.smithi097.stderr: -429> 2024-09-14T11:05:42.981+0000 7f2d7351f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:05:43.470 INFO:tasks.workunit.client.0.smithi097.stderr: -428> 2024-09-14T11:05:42.981+0000 7f2d74521640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:05:43.470 INFO:tasks.workunit.client.0.smithi097.stderr: -427> 2024-09-14T11:05:42.981+0000 7f2d74521640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:05:43.470 INFO:tasks.workunit.client.0.smithi097.stderr: -426> 2024-09-14T11:05:42.981+0000 7f2d74521640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:05:43.470 INFO:tasks.workunit.client.0.smithi097.stderr: -425> 2024-09-14T11:05:42.981+0000 7f2d73d20640 10 monclient(hunting): get_auth_request con 0x55e6152f3f80 auth_method 0 2024-09-14T11:05:43.470 INFO:tasks.workunit.client.0.smithi097.stderr: -424> 2024-09-14T11:05:42.981+0000 7f2d73d20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:05:43.470 INFO:tasks.workunit.client.0.smithi097.stderr: -423> 2024-09-14T11:05:42.981+0000 7f2d73d20640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:05:43.470 INFO:tasks.workunit.client.0.smithi097.stderr: -422> 2024-09-14T11:05:42.981+0000 7f2d73d20640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:05:43.470 INFO:tasks.workunit.client.0.smithi097.stderr: -421> 2024-09-14T11:05:42.981+0000 7f2d73d20640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:05:43.470 INFO:tasks.workunit.client.0.smithi097.stderr: -420> 2024-09-14T11:05:42.981+0000 7f2d73d20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:05:43.470 INFO:tasks.workunit.client.0.smithi097.stderr: -419> 2024-09-14T11:05:42.981+0000 7f2d73d20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:05:43.470 INFO:tasks.workunit.client.0.smithi097.stderr: -418> 2024-09-14T11:05:42.981+0000 7f2d7351f640 10 monclient(hunting): handle_auth_done global_id 7112 payload 824 2024-09-14T11:05:43.470 INFO:tasks.workunit.client.0.smithi097.stderr: -417> 2024-09-14T11:05:42.981+0000 7f2d7351f640 10 monclient: _finish_hunting 0 2024-09-14T11:05:43.470 INFO:tasks.workunit.client.0.smithi097.stderr: -416> 2024-09-14T11:05:42.981+0000 7f2d7351f640 1 monclient: found mon.noname-c 2024-09-14T11:05:43.470 INFO:tasks.workunit.client.0.smithi097.stderr: -415> 2024-09-14T11:05:42.981+0000 7f2d7351f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:05:43.471 INFO:tasks.workunit.client.0.smithi097.stderr: -414> 2024-09-14T11:05:42.981+0000 7f2c5bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:05:43.471 INFO:tasks.workunit.client.0.smithi097.stderr: -413> 2024-09-14T11:05:42.981+0000 7f2c5bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:05:43.471 INFO:tasks.workunit.client.0.smithi097.stderr: -412> 2024-09-14T11:05:42.981+0000 7f2c5bfff640 10 monclient: dump: 2024-09-14T11:05:43.471 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:05:43.471 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:05:43.471 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:43.471 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:43.471 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:05:43.471 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:05:43.471 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:05:43.471 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:05:43.471 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:05:43.471 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:43.472 INFO:tasks.workunit.client.0.smithi097.stderr: -411> 2024-09-14T11:05:42.981+0000 7f2c5bfff640 10 monclient: _finish_auth 0 2024-09-14T11:05:43.472 INFO:tasks.workunit.client.0.smithi097.stderr: -410> 2024-09-14T11:05:42.981+0000 7f2c5bfff640 10 monclient: _check_auth_tickets 2024-09-14T11:05:43.472 INFO:tasks.workunit.client.0.smithi097.stderr: -409> 2024-09-14T11:05:42.981+0000 7f2c5bfff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:05:43.472 INFO:tasks.workunit.client.0.smithi097.stderr: -408> 2024-09-14T11:05:42.981+0000 7f2c5bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:05:43.472 INFO:tasks.workunit.client.0.smithi097.stderr: -407> 2024-09-14T11:05:42.981+0000 7f2c5bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:05:43.472 INFO:tasks.workunit.client.0.smithi097.stderr: -406> 2024-09-14T11:05:42.981+0000 7f2c5bfff640 10 monclient: dump: 2024-09-14T11:05:43.472 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:05:43.472 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:05:43.472 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:43.472 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:43.472 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:05:43.472 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:05:43.472 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:05:43.473 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:05:43.473 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:05:43.473 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:43.473 INFO:tasks.workunit.client.0.smithi097.stderr: -405> 2024-09-14T11:05:42.981+0000 7f2d7622f800 5 monclient: authenticate success, global_id 7112 2024-09-14T11:05:43.473 INFO:tasks.workunit.client.0.smithi097.stderr: -404> 2024-09-14T11:05:42.981+0000 7f2d7622f800 10 monclient: _renew_subs 2024-09-14T11:05:43.473 INFO:tasks.workunit.client.0.smithi097.stderr: -403> 2024-09-14T11:05:42.981+0000 7f2d7622f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:05:43.473 INFO:tasks.workunit.client.0.smithi097.stderr: -402> 2024-09-14T11:05:42.981+0000 7f2c61e0b640 4 set_mon_vals no callback set 2024-09-14T11:05:43.473 INFO:tasks.workunit.client.0.smithi097.stderr: -401> 2024-09-14T11:05:42.982+0000 7f2d7622f800 10 monclient: _renew_subs 2024-09-14T11:05:43.473 INFO:tasks.workunit.client.0.smithi097.stderr: -400> 2024-09-14T11:05:42.982+0000 7f2d7622f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:05:43.473 INFO:tasks.workunit.client.0.smithi097.stderr: -399> 2024-09-14T11:05:42.982+0000 7f2d7622f800 1 librados: init done 2024-09-14T11:05:43.473 INFO:tasks.workunit.client.0.smithi097.stderr: -398> 2024-09-14T11:05:42.984+0000 7f2c5bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:05:43.473 INFO:tasks.workunit.client.0.smithi097.stderr: -397> 2024-09-14T11:05:42.984+0000 7f2c5bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:05:43.473 INFO:tasks.workunit.client.0.smithi097.stderr: -396> 2024-09-14T11:05:42.984+0000 7f2c5bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:05:43.474 INFO:tasks.workunit.client.0.smithi097.stderr: -395> 2024-09-14T11:05:42.984+0000 7f2d73d20640 10 monclient: get_auth_request con 0x7f2c5c077230 auth_method 0 2024-09-14T11:05:43.474 INFO:tasks.workunit.client.0.smithi097.stderr: -394> 2024-09-14T11:05:42.984+0000 7f2d74521640 10 monclient: get_auth_request con 0x55e615465290 auth_method 0 2024-09-14T11:05:43.474 INFO:tasks.workunit.client.0.smithi097.stderr: -393> 2024-09-14T11:05:42.985+0000 7f2d73d20640 10 monclient: get_auth_request con 0x55e615488090 auth_method 0 2024-09-14T11:05:43.474 INFO:tasks.workunit.client.0.smithi097.stderr: -392> 2024-09-14T11:05:42.986+0000 7f2d7351f640 10 monclient: get_auth_request con 0x55e61548c3f0 auth_method 0 2024-09-14T11:05:43.474 INFO:tasks.workunit.client.0.smithi097.stderr: -391> 2024-09-14T11:05:42.987+0000 7f2d74521640 10 monclient: get_auth_request con 0x55e61548b8c0 auth_method 0 2024-09-14T11:05:43.474 INFO:tasks.workunit.client.0.smithi097.stderr: -390> 2024-09-14T11:05:42.987+0000 7f2d7622f800 10 monclient: build_initial_monmap 2024-09-14T11:05:43.474 INFO:tasks.workunit.client.0.smithi097.stderr: -389> 2024-09-14T11:05:42.987+0000 7f2d7622f800 1 build_initial for_mkfs: 0 2024-09-14T11:05:43.474 INFO:tasks.workunit.client.0.smithi097.stderr: -388> 2024-09-14T11:05:42.987+0000 7f2d7622f800 10 monclient: monmap: 2024-09-14T11:05:43.474 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:05:43.474 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:05:43.474 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:05:43.474 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:05:43.474 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:05:43.474 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:05:43.475 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:05:43.475 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:05:43.475 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:05:43.475 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:43.475 INFO:tasks.workunit.client.0.smithi097.stderr: -387> 2024-09-14T11:05:42.987+0000 7f2d7622f800 5 AuthRegistry(0x55e615494530) adding auth protocol: cephx 2024-09-14T11:05:43.475 INFO:tasks.workunit.client.0.smithi097.stderr: -386> 2024-09-14T11:05:42.987+0000 7f2d7622f800 5 AuthRegistry(0x55e615494530) adding auth protocol: cephx 2024-09-14T11:05:43.475 INFO:tasks.workunit.client.0.smithi097.stderr: -385> 2024-09-14T11:05:42.987+0000 7f2d7622f800 5 AuthRegistry(0x55e615494530) adding auth protocol: cephx 2024-09-14T11:05:43.475 INFO:tasks.workunit.client.0.smithi097.stderr: -384> 2024-09-14T11:05:42.987+0000 7f2d7622f800 5 AuthRegistry(0x55e615494530) adding con mode: secure 2024-09-14T11:05:43.475 INFO:tasks.workunit.client.0.smithi097.stderr: -383> 2024-09-14T11:05:42.987+0000 7f2d7622f800 5 AuthRegistry(0x55e615494530) adding con mode: crc 2024-09-14T11:05:43.475 INFO:tasks.workunit.client.0.smithi097.stderr: -382> 2024-09-14T11:05:42.987+0000 7f2d7622f800 5 AuthRegistry(0x55e615494530) adding con mode: secure 2024-09-14T11:05:43.475 INFO:tasks.workunit.client.0.smithi097.stderr: -381> 2024-09-14T11:05:42.987+0000 7f2d7622f800 5 AuthRegistry(0x55e615494530) adding con mode: crc 2024-09-14T11:05:43.475 INFO:tasks.workunit.client.0.smithi097.stderr: -380> 2024-09-14T11:05:42.987+0000 7f2d7622f800 5 AuthRegistry(0x55e615494530) adding con mode: secure 2024-09-14T11:05:43.475 INFO:tasks.workunit.client.0.smithi097.stderr: -379> 2024-09-14T11:05:42.987+0000 7f2d7622f800 5 AuthRegistry(0x55e615494530) adding con mode: crc 2024-09-14T11:05:43.475 INFO:tasks.workunit.client.0.smithi097.stderr: -378> 2024-09-14T11:05:42.987+0000 7f2d7622f800 5 AuthRegistry(0x55e615494530) adding con mode: crc 2024-09-14T11:05:43.476 INFO:tasks.workunit.client.0.smithi097.stderr: -377> 2024-09-14T11:05:42.987+0000 7f2d7622f800 5 AuthRegistry(0x55e615494530) adding con mode: secure 2024-09-14T11:05:43.476 INFO:tasks.workunit.client.0.smithi097.stderr: -376> 2024-09-14T11:05:42.987+0000 7f2d7622f800 5 AuthRegistry(0x55e615494530) adding con mode: crc 2024-09-14T11:05:43.476 INFO:tasks.workunit.client.0.smithi097.stderr: -375> 2024-09-14T11:05:42.987+0000 7f2d7622f800 5 AuthRegistry(0x55e615494530) adding con mode: secure 2024-09-14T11:05:43.476 INFO:tasks.workunit.client.0.smithi097.stderr: -374> 2024-09-14T11:05:42.987+0000 7f2d7622f800 5 AuthRegistry(0x55e615494530) adding con mode: crc 2024-09-14T11:05:43.476 INFO:tasks.workunit.client.0.smithi097.stderr: -373> 2024-09-14T11:05:42.987+0000 7f2d7622f800 5 AuthRegistry(0x55e615494530) adding con mode: secure 2024-09-14T11:05:43.476 INFO:tasks.workunit.client.0.smithi097.stderr: -372> 2024-09-14T11:05:42.988+0000 7f2d7622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:05:43.476 INFO:tasks.workunit.client.0.smithi097.stderr: -371> 2024-09-14T11:05:42.988+0000 7f2d7622f800 5 asok(0x55e61521c270) register_command objecter_requests cmddesc objecter_requests hook 0x55e615497a00 EEXIST 2024-09-14T11:05:43.476 INFO:tasks.workunit.client.0.smithi097.stderr: -370> 2024-09-14T11:05:42.988+0000 7f2d7622f800 10 monclient: init 2024-09-14T11:05:43.476 INFO:tasks.workunit.client.0.smithi097.stderr: -369> 2024-09-14T11:05:42.988+0000 7f2d7622f800 5 AuthRegistry(0x55e615493428) adding auth protocol: cephx 2024-09-14T11:05:43.476 INFO:tasks.workunit.client.0.smithi097.stderr: -368> 2024-09-14T11:05:42.988+0000 7f2d7622f800 5 AuthRegistry(0x55e615493428) adding auth protocol: cephx 2024-09-14T11:05:43.476 INFO:tasks.workunit.client.0.smithi097.stderr: -367> 2024-09-14T11:05:42.988+0000 7f2d7622f800 5 AuthRegistry(0x55e615493428) adding auth protocol: cephx 2024-09-14T11:05:43.476 INFO:tasks.workunit.client.0.smithi097.stderr: -366> 2024-09-14T11:05:42.988+0000 7f2d7622f800 5 AuthRegistry(0x55e615493428) adding con mode: secure 2024-09-14T11:05:43.476 INFO:tasks.workunit.client.0.smithi097.stderr: -365> 2024-09-14T11:05:42.988+0000 7f2d7622f800 5 AuthRegistry(0x55e615493428) adding con mode: crc 2024-09-14T11:05:43.477 INFO:tasks.workunit.client.0.smithi097.stderr: -364> 2024-09-14T11:05:42.988+0000 7f2d7622f800 5 AuthRegistry(0x55e615493428) adding con mode: secure 2024-09-14T11:05:43.477 INFO:tasks.workunit.client.0.smithi097.stderr: -363> 2024-09-14T11:05:42.988+0000 7f2d7622f800 5 AuthRegistry(0x55e615493428) adding con mode: crc 2024-09-14T11:05:43.477 INFO:tasks.workunit.client.0.smithi097.stderr: -362> 2024-09-14T11:05:42.988+0000 7f2d7622f800 5 AuthRegistry(0x55e615493428) adding con mode: secure 2024-09-14T11:05:43.477 INFO:tasks.workunit.client.0.smithi097.stderr: -361> 2024-09-14T11:05:42.988+0000 7f2d7622f800 5 AuthRegistry(0x55e615493428) adding con mode: crc 2024-09-14T11:05:43.477 INFO:tasks.workunit.client.0.smithi097.stderr: -360> 2024-09-14T11:05:42.988+0000 7f2d7622f800 5 AuthRegistry(0x55e615493428) adding con mode: crc 2024-09-14T11:05:43.477 INFO:tasks.workunit.client.0.smithi097.stderr: -359> 2024-09-14T11:05:42.988+0000 7f2d7622f800 5 AuthRegistry(0x55e615493428) adding con mode: secure 2024-09-14T11:05:43.477 INFO:tasks.workunit.client.0.smithi097.stderr: -358> 2024-09-14T11:05:42.988+0000 7f2d7622f800 5 AuthRegistry(0x55e615493428) adding con mode: crc 2024-09-14T11:05:43.477 INFO:tasks.workunit.client.0.smithi097.stderr: -357> 2024-09-14T11:05:42.988+0000 7f2d7622f800 5 AuthRegistry(0x55e615493428) adding con mode: secure 2024-09-14T11:05:43.477 INFO:tasks.workunit.client.0.smithi097.stderr: -356> 2024-09-14T11:05:42.988+0000 7f2d7622f800 5 AuthRegistry(0x55e615493428) adding con mode: crc 2024-09-14T11:05:43.477 INFO:tasks.workunit.client.0.smithi097.stderr: -355> 2024-09-14T11:05:42.988+0000 7f2d7622f800 5 AuthRegistry(0x55e615493428) adding con mode: secure 2024-09-14T11:05:43.477 INFO:tasks.workunit.client.0.smithi097.stderr: -354> 2024-09-14T11:05:42.988+0000 7f2d7622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:05:43.477 INFO:tasks.workunit.client.0.smithi097.stderr: -353> 2024-09-14T11:05:42.988+0000 7f2d7622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:05:43.477 INFO:tasks.workunit.client.0.smithi097.stderr: -352> 2024-09-14T11:05:42.988+0000 7f2d7622f800 5 asok(0x55e61521c270) register_command rotate-key cmddesc rotate-key hook 0x55e615493570 EEXIST 2024-09-14T11:05:43.478 INFO:tasks.workunit.client.0.smithi097.stderr: -351> 2024-09-14T11:05:42.988+0000 7f2d7622f800 10 monclient: _reopen_session rank -1 2024-09-14T11:05:43.478 INFO:tasks.workunit.client.0.smithi097.stderr: -350> 2024-09-14T11:05:42.988+0000 7f2d7622f800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:05:43.478 INFO:tasks.workunit.client.0.smithi097.stderr: -349> 2024-09-14T11:05:42.988+0000 7f2d7622f800 10 monclient(hunting): picked mon.noname-c con 0x55e6154bbd20 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:05:43.478 INFO:tasks.workunit.client.0.smithi097.stderr: -348> 2024-09-14T11:05:42.988+0000 7f2d7622f800 10 monclient(hunting): picked mon.noname-b con 0x55e6154bc100 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:05:43.478 INFO:tasks.workunit.client.0.smithi097.stderr: -347> 2024-09-14T11:05:42.988+0000 7f2d7622f800 10 monclient(hunting): picked mon.noname-a con 0x55e6154baa30 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:05:43.478 INFO:tasks.workunit.client.0.smithi097.stderr: -346> 2024-09-14T11:05:42.988+0000 7f2d7622f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:05:43.478 INFO:tasks.workunit.client.0.smithi097.stderr: -345> 2024-09-14T11:05:42.988+0000 7f2d7622f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:05:43.478 INFO:tasks.workunit.client.0.smithi097.stderr: -344> 2024-09-14T11:05:42.988+0000 7f2d7622f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:05:43.478 INFO:tasks.workunit.client.0.smithi097.stderr: -343> 2024-09-14T11:05:42.988+0000 7f2d7622f800 10 monclient(hunting): _renew_subs 2024-09-14T11:05:43.478 INFO:tasks.workunit.client.0.smithi097.stderr: -342> 2024-09-14T11:05:42.988+0000 7f2d7622f800 10 monclient(hunting): authenticate will time out at 2024.641860s 2024-09-14T11:05:43.478 INFO:tasks.workunit.client.0.smithi097.stderr: -341> 2024-09-14T11:05:42.988+0000 7f2d7351f640 10 monclient(hunting): get_auth_request con 0x55e6154bbd20 auth_method 0 2024-09-14T11:05:43.478 INFO:tasks.workunit.client.0.smithi097.stderr: -340> 2024-09-14T11:05:42.988+0000 7f2d7351f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:05:43.478 INFO:tasks.workunit.client.0.smithi097.stderr: -339> 2024-09-14T11:05:42.988+0000 7f2d7351f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:05:43.478 INFO:tasks.workunit.client.0.smithi097.stderr: -338> 2024-09-14T11:05:42.988+0000 7f2d7351f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:05:43.479 INFO:tasks.workunit.client.0.smithi097.stderr: -337> 2024-09-14T11:05:42.988+0000 7f2d73d20640 10 monclient(hunting): get_auth_request con 0x55e6154baa30 auth_method 0 2024-09-14T11:05:43.479 INFO:tasks.workunit.client.0.smithi097.stderr: -336> 2024-09-14T11:05:42.989+0000 7f2d73d20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:05:43.479 INFO:tasks.workunit.client.0.smithi097.stderr: -335> 2024-09-14T11:05:42.989+0000 7f2d73d20640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:05:43.479 INFO:tasks.workunit.client.0.smithi097.stderr: -334> 2024-09-14T11:05:42.989+0000 7f2d73d20640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:05:43.479 INFO:tasks.workunit.client.0.smithi097.stderr: -333> 2024-09-14T11:05:42.989+0000 7f2d74521640 10 monclient(hunting): get_auth_request con 0x55e6154bc100 auth_method 0 2024-09-14T11:05:43.479 INFO:tasks.workunit.client.0.smithi097.stderr: -332> 2024-09-14T11:05:42.989+0000 7f2d74521640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:05:43.479 INFO:tasks.workunit.client.0.smithi097.stderr: -331> 2024-09-14T11:05:42.989+0000 7f2d74521640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:05:43.479 INFO:tasks.workunit.client.0.smithi097.stderr: -330> 2024-09-14T11:05:42.989+0000 7f2d74521640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:05:43.479 INFO:tasks.workunit.client.0.smithi097.stderr: -329> 2024-09-14T11:05:42.989+0000 7f2d7351f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:05:43.479 INFO:tasks.workunit.client.0.smithi097.stderr: -328> 2024-09-14T11:05:42.989+0000 7f2d7351f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:05:43.479 INFO:tasks.workunit.client.0.smithi097.stderr: -327> 2024-09-14T11:05:42.989+0000 7f2d7351f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:05:43.479 INFO:tasks.workunit.client.0.smithi097.stderr: -326> 2024-09-14T11:05:42.989+0000 7f2d73d20640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:05:43.479 INFO:tasks.workunit.client.0.smithi097.stderr: -325> 2024-09-14T11:05:42.989+0000 7f2d73d20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:05:43.479 INFO:tasks.workunit.client.0.smithi097.stderr: -324> 2024-09-14T11:05:42.989+0000 7f2d73d20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:05:43.480 INFO:tasks.workunit.client.0.smithi097.stderr: -323> 2024-09-14T11:05:42.989+0000 7f2d74521640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:05:43.480 INFO:tasks.workunit.client.0.smithi097.stderr: -322> 2024-09-14T11:05:42.989+0000 7f2d74521640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:05:43.480 INFO:tasks.workunit.client.0.smithi097.stderr: -321> 2024-09-14T11:05:42.989+0000 7f2d74521640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:05:43.480 INFO:tasks.workunit.client.0.smithi097.stderr: -320> 2024-09-14T11:05:42.989+0000 7f2d7351f640 10 monclient(hunting): handle_auth_done global_id 7115 payload 824 2024-09-14T11:05:43.480 INFO:tasks.workunit.client.0.smithi097.stderr: -319> 2024-09-14T11:05:42.989+0000 7f2d7351f640 10 monclient: _finish_hunting 0 2024-09-14T11:05:43.480 INFO:tasks.workunit.client.0.smithi097.stderr: -318> 2024-09-14T11:05:42.989+0000 7f2d7351f640 1 monclient: found mon.noname-c 2024-09-14T11:05:43.480 INFO:tasks.workunit.client.0.smithi097.stderr: -317> 2024-09-14T11:05:42.989+0000 7f2d7351f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:05:43.480 INFO:tasks.workunit.client.0.smithi097.stderr: -316> 2024-09-14T11:05:42.989+0000 7f2c597fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:05:43.480 INFO:tasks.workunit.client.0.smithi097.stderr: -315> 2024-09-14T11:05:42.989+0000 7f2c597fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:05:43.480 INFO:tasks.workunit.client.0.smithi097.stderr: -314> 2024-09-14T11:05:42.989+0000 7f2c597fa640 10 monclient: dump: 2024-09-14T11:05:43.480 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:05:43.480 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:05:43.480 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:43.481 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:43.481 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:05:43.481 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:05:43.481 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:05:43.481 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:05:43.481 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:05:43.481 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:43.481 INFO:tasks.workunit.client.0.smithi097.stderr: -313> 2024-09-14T11:05:42.989+0000 7f2c597fa640 10 monclient: _finish_auth 0 2024-09-14T11:05:43.481 INFO:tasks.workunit.client.0.smithi097.stderr: -312> 2024-09-14T11:05:42.989+0000 7f2c597fa640 10 monclient: _check_auth_tickets 2024-09-14T11:05:43.481 INFO:tasks.workunit.client.0.smithi097.stderr: -311> 2024-09-14T11:05:42.989+0000 7f2c597fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:05:43.481 INFO:tasks.workunit.client.0.smithi097.stderr: -310> 2024-09-14T11:05:42.989+0000 7f2c597fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:05:43.481 INFO:tasks.workunit.client.0.smithi097.stderr: -309> 2024-09-14T11:05:42.989+0000 7f2c597fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:05:43.481 INFO:tasks.workunit.client.0.smithi097.stderr: -308> 2024-09-14T11:05:42.989+0000 7f2c597fa640 10 monclient: dump: 2024-09-14T11:05:43.481 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:05:43.482 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:05:43.482 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:43.482 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:43.482 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:05:43.482 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:05:43.482 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:05:43.482 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:05:43.482 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:05:43.482 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:43.482 INFO:tasks.workunit.client.0.smithi097.stderr: -307> 2024-09-14T11:05:42.989+0000 7f2d7622f800 5 monclient: authenticate success, global_id 7115 2024-09-14T11:05:43.482 INFO:tasks.workunit.client.0.smithi097.stderr: -306> 2024-09-14T11:05:42.989+0000 7f2d7622f800 10 monclient: _renew_subs 2024-09-14T11:05:43.482 INFO:tasks.workunit.client.0.smithi097.stderr: -305> 2024-09-14T11:05:42.989+0000 7f2d7622f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:05:43.482 INFO:tasks.workunit.client.0.smithi097.stderr: -304> 2024-09-14T11:05:42.989+0000 7f2d74d22640 4 set_mon_vals no callback set 2024-09-14T11:05:43.483 INFO:tasks.workunit.client.0.smithi097.stderr: -303> 2024-09-14T11:05:42.989+0000 7f2d7622f800 10 monclient: _renew_subs 2024-09-14T11:05:43.483 INFO:tasks.workunit.client.0.smithi097.stderr: -302> 2024-09-14T11:05:42.989+0000 7f2d7622f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:05:43.483 INFO:tasks.workunit.client.0.smithi097.stderr: -301> 2024-09-14T11:05:42.991+0000 7f2c597fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:05:43.483 INFO:tasks.workunit.client.0.smithi097.stderr: -300> 2024-09-14T11:05:42.991+0000 7f2c597fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:05:43.483 INFO:tasks.workunit.client.0.smithi097.stderr: -299> 2024-09-14T11:05:42.991+0000 7f2c597fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:05:43.483 INFO:tasks.workunit.client.0.smithi097.stderr: -298> 2024-09-14T11:05:42.991+0000 7f2d74521640 10 monclient: get_auth_request con 0x7f2c4c077140 auth_method 0 2024-09-14T11:05:43.483 INFO:tasks.workunit.client.0.smithi097.stderr: -297> 2024-09-14T11:05:42.991+0000 7f2d7622f800 10 monclient: get_monmap_and_config 2024-09-14T11:05:43.483 INFO:tasks.workunit.client.0.smithi097.stderr: -296> 2024-09-14T11:05:42.991+0000 7f2d7622f800 10 monclient: build_initial_monmap 2024-09-14T11:05:43.483 INFO:tasks.workunit.client.0.smithi097.stderr: -295> 2024-09-14T11:05:42.991+0000 7f2d7622f800 1 build_initial for_mkfs: 0 2024-09-14T11:05:43.483 INFO:tasks.workunit.client.0.smithi097.stderr: -294> 2024-09-14T11:05:42.991+0000 7f2d7622f800 10 monclient: monmap: 2024-09-14T11:05:43.483 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:05:43.483 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:05:43.483 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:05:43.483 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:05:43.483 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:05:43.484 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:05:43.484 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:05:43.484 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:05:43.484 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:05:43.484 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:43.484 INFO:tasks.workunit.client.0.smithi097.stderr: -293> 2024-09-14T11:05:42.991+0000 7f2d7622f800 5 AuthRegistry(0x55e6154db840) adding auth protocol: cephx 2024-09-14T11:05:43.484 INFO:tasks.workunit.client.0.smithi097.stderr: -292> 2024-09-14T11:05:42.991+0000 7f2d7622f800 5 AuthRegistry(0x55e6154db840) adding auth protocol: cephx 2024-09-14T11:05:43.484 INFO:tasks.workunit.client.0.smithi097.stderr: -291> 2024-09-14T11:05:42.991+0000 7f2d7622f800 5 AuthRegistry(0x55e6154db840) adding auth protocol: cephx 2024-09-14T11:05:43.484 INFO:tasks.workunit.client.0.smithi097.stderr: -290> 2024-09-14T11:05:42.991+0000 7f2d7622f800 5 AuthRegistry(0x55e6154db840) adding con mode: secure 2024-09-14T11:05:43.484 INFO:tasks.workunit.client.0.smithi097.stderr: -289> 2024-09-14T11:05:42.991+0000 7f2d7622f800 5 AuthRegistry(0x55e6154db840) adding con mode: crc 2024-09-14T11:05:43.484 INFO:tasks.workunit.client.0.smithi097.stderr: -288> 2024-09-14T11:05:42.991+0000 7f2d7622f800 5 AuthRegistry(0x55e6154db840) adding con mode: secure 2024-09-14T11:05:43.484 INFO:tasks.workunit.client.0.smithi097.stderr: -287> 2024-09-14T11:05:42.991+0000 7f2d7622f800 5 AuthRegistry(0x55e6154db840) adding con mode: crc 2024-09-14T11:05:43.484 INFO:tasks.workunit.client.0.smithi097.stderr: -286> 2024-09-14T11:05:42.991+0000 7f2d7622f800 5 AuthRegistry(0x55e6154db840) adding con mode: secure 2024-09-14T11:05:43.485 INFO:tasks.workunit.client.0.smithi097.stderr: -285> 2024-09-14T11:05:42.991+0000 7f2d7622f800 5 AuthRegistry(0x55e6154db840) adding con mode: crc 2024-09-14T11:05:43.485 INFO:tasks.workunit.client.0.smithi097.stderr: -284> 2024-09-14T11:05:42.991+0000 7f2d7622f800 5 AuthRegistry(0x55e6154db840) adding con mode: crc 2024-09-14T11:05:43.485 INFO:tasks.workunit.client.0.smithi097.stderr: -283> 2024-09-14T11:05:42.991+0000 7f2d7622f800 5 AuthRegistry(0x55e6154db840) adding con mode: secure 2024-09-14T11:05:43.485 INFO:tasks.workunit.client.0.smithi097.stderr: -282> 2024-09-14T11:05:42.991+0000 7f2d7622f800 5 AuthRegistry(0x55e6154db840) adding con mode: crc 2024-09-14T11:05:43.485 INFO:tasks.workunit.client.0.smithi097.stderr: -281> 2024-09-14T11:05:42.991+0000 7f2d7622f800 5 AuthRegistry(0x55e6154db840) adding con mode: secure 2024-09-14T11:05:43.485 INFO:tasks.workunit.client.0.smithi097.stderr: -280> 2024-09-14T11:05:42.991+0000 7f2d7622f800 5 AuthRegistry(0x55e6154db840) adding con mode: crc 2024-09-14T11:05:43.485 INFO:tasks.workunit.client.0.smithi097.stderr: -279> 2024-09-14T11:05:42.991+0000 7f2d7622f800 5 AuthRegistry(0x55e6154db840) adding con mode: secure 2024-09-14T11:05:43.485 INFO:tasks.workunit.client.0.smithi097.stderr: -278> 2024-09-14T11:05:42.992+0000 7f2d7622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:05:43.485 INFO:tasks.workunit.client.0.smithi097.stderr: -277> 2024-09-14T11:05:42.992+0000 7f2d7622f800 10 monclient: init 2024-09-14T11:05:43.485 INFO:tasks.workunit.client.0.smithi097.stderr: -276> 2024-09-14T11:05:42.992+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395e7b0) adding auth protocol: cephx 2024-09-14T11:05:43.485 INFO:tasks.workunit.client.0.smithi097.stderr: -275> 2024-09-14T11:05:42.992+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395e7b0) adding auth protocol: cephx 2024-09-14T11:05:43.485 INFO:tasks.workunit.client.0.smithi097.stderr: -274> 2024-09-14T11:05:42.992+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395e7b0) adding auth protocol: cephx 2024-09-14T11:05:43.485 INFO:tasks.workunit.client.0.smithi097.stderr: -273> 2024-09-14T11:05:42.992+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395e7b0) adding con mode: secure 2024-09-14T11:05:43.485 INFO:tasks.workunit.client.0.smithi097.stderr: -272> 2024-09-14T11:05:42.992+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395e7b0) adding con mode: crc 2024-09-14T11:05:43.486 INFO:tasks.workunit.client.0.smithi097.stderr: -271> 2024-09-14T11:05:42.992+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395e7b0) adding con mode: secure 2024-09-14T11:05:43.486 INFO:tasks.workunit.client.0.smithi097.stderr: -270> 2024-09-14T11:05:42.992+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395e7b0) adding con mode: crc 2024-09-14T11:05:43.486 INFO:tasks.workunit.client.0.smithi097.stderr: -269> 2024-09-14T11:05:42.992+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395e7b0) adding con mode: secure 2024-09-14T11:05:43.486 INFO:tasks.workunit.client.0.smithi097.stderr: -268> 2024-09-14T11:05:42.992+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395e7b0) adding con mode: crc 2024-09-14T11:05:43.486 INFO:tasks.workunit.client.0.smithi097.stderr: -267> 2024-09-14T11:05:42.992+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395e7b0) adding con mode: crc 2024-09-14T11:05:43.486 INFO:tasks.workunit.client.0.smithi097.stderr: -266> 2024-09-14T11:05:42.992+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395e7b0) adding con mode: secure 2024-09-14T11:05:43.486 INFO:tasks.workunit.client.0.smithi097.stderr: -265> 2024-09-14T11:05:42.992+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395e7b0) adding con mode: crc 2024-09-14T11:05:43.486 INFO:tasks.workunit.client.0.smithi097.stderr: -264> 2024-09-14T11:05:42.992+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395e7b0) adding con mode: secure 2024-09-14T11:05:43.486 INFO:tasks.workunit.client.0.smithi097.stderr: -263> 2024-09-14T11:05:42.992+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395e7b0) adding con mode: crc 2024-09-14T11:05:43.486 INFO:tasks.workunit.client.0.smithi097.stderr: -262> 2024-09-14T11:05:42.992+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395e7b0) adding con mode: secure 2024-09-14T11:05:43.486 INFO:tasks.workunit.client.0.smithi097.stderr: -261> 2024-09-14T11:05:42.992+0000 7f2d7622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:05:43.486 INFO:tasks.workunit.client.0.smithi097.stderr: -260> 2024-09-14T11:05:42.992+0000 7f2d7622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:05:43.486 INFO:tasks.workunit.client.0.smithi097.stderr: -259> 2024-09-14T11:05:42.992+0000 7f2d7622f800 5 asok(0x55e61521c270) register_command rotate-key cmddesc rotate-key hook 0x7ffdf395e8f8 EEXIST 2024-09-14T11:05:43.487 INFO:tasks.workunit.client.0.smithi097.stderr: -258> 2024-09-14T11:05:42.992+0000 7f2d7622f800 10 monclient: _reopen_session rank -1 2024-09-14T11:05:43.487 INFO:tasks.workunit.client.0.smithi097.stderr: -257> 2024-09-14T11:05:42.992+0000 7f2d7622f800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:05:43.487 INFO:tasks.workunit.client.0.smithi097.stderr: -256> 2024-09-14T11:05:42.992+0000 7f2d7622f800 10 monclient(hunting): picked mon.noname-c con 0x55e61550fea0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:05:43.487 INFO:tasks.workunit.client.0.smithi097.stderr: -255> 2024-09-14T11:05:42.992+0000 7f2d7622f800 10 monclient(hunting): picked mon.noname-b con 0x55e6154e0eb0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:05:43.487 INFO:tasks.workunit.client.0.smithi097.stderr: -254> 2024-09-14T11:05:42.992+0000 7f2d7622f800 10 monclient(hunting): picked mon.noname-a con 0x55e61550b380 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:05:43.487 INFO:tasks.workunit.client.0.smithi097.stderr: -253> 2024-09-14T11:05:42.992+0000 7f2d7622f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:05:43.487 INFO:tasks.workunit.client.0.smithi097.stderr: -252> 2024-09-14T11:05:42.992+0000 7f2d7622f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:05:43.487 INFO:tasks.workunit.client.0.smithi097.stderr: -251> 2024-09-14T11:05:42.992+0000 7f2d7622f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:05:43.487 INFO:tasks.workunit.client.0.smithi097.stderr: -250> 2024-09-14T11:05:42.992+0000 7f2d7622f800 10 monclient(hunting): _renew_subs 2024-09-14T11:05:43.487 INFO:tasks.workunit.client.0.smithi097.stderr: -249> 2024-09-14T11:05:42.992+0000 7f2d7622f800 10 monclient(hunting): authenticate will time out at 2024.645635s 2024-09-14T11:05:43.487 INFO:tasks.workunit.client.0.smithi097.stderr: -248> 2024-09-14T11:05:42.992+0000 7f2d7351f640 10 monclient(hunting): get_auth_request con 0x55e61550fea0 auth_method 0 2024-09-14T11:05:43.487 INFO:tasks.workunit.client.0.smithi097.stderr: -247> 2024-09-14T11:05:42.992+0000 7f2d7351f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:05:43.487 INFO:tasks.workunit.client.0.smithi097.stderr: -246> 2024-09-14T11:05:42.992+0000 7f2d7351f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:05:43.487 INFO:tasks.workunit.client.0.smithi097.stderr: -245> 2024-09-14T11:05:42.992+0000 7f2d7351f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:05:43.488 INFO:tasks.workunit.client.0.smithi097.stderr: -244> 2024-09-14T11:05:42.992+0000 7f2d73d20640 10 monclient(hunting): get_auth_request con 0x55e61550b380 auth_method 0 2024-09-14T11:05:43.488 INFO:tasks.workunit.client.0.smithi097.stderr: -243> 2024-09-14T11:05:42.992+0000 7f2d73d20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:05:43.488 INFO:tasks.workunit.client.0.smithi097.stderr: -242> 2024-09-14T11:05:42.992+0000 7f2d73d20640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:05:43.488 INFO:tasks.workunit.client.0.smithi097.stderr: -241> 2024-09-14T11:05:42.992+0000 7f2d73d20640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:05:43.488 INFO:tasks.workunit.client.0.smithi097.stderr: -240> 2024-09-14T11:05:42.992+0000 7f2d7351f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:05:43.488 INFO:tasks.workunit.client.0.smithi097.stderr: -239> 2024-09-14T11:05:42.992+0000 7f2d7351f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:05:43.488 INFO:tasks.workunit.client.0.smithi097.stderr: -238> 2024-09-14T11:05:42.992+0000 7f2d7351f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:05:43.488 INFO:tasks.workunit.client.0.smithi097.stderr: -237> 2024-09-14T11:05:42.992+0000 7f2d73d20640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:05:43.488 INFO:tasks.workunit.client.0.smithi097.stderr: -236> 2024-09-14T11:05:42.992+0000 7f2d73d20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:05:43.488 INFO:tasks.workunit.client.0.smithi097.stderr: -235> 2024-09-14T11:05:42.992+0000 7f2d73d20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:05:43.488 INFO:tasks.workunit.client.0.smithi097.stderr: -234> 2024-09-14T11:05:42.992+0000 7f2d7351f640 10 monclient(hunting): handle_auth_done global_id 7118 payload 274 2024-09-14T11:05:43.488 INFO:tasks.workunit.client.0.smithi097.stderr: -233> 2024-09-14T11:05:42.992+0000 7f2d7351f640 10 monclient: _finish_hunting 0 2024-09-14T11:05:43.488 INFO:tasks.workunit.client.0.smithi097.stderr: -232> 2024-09-14T11:05:42.992+0000 7f2d7351f640 1 monclient: found mon.noname-c 2024-09-14T11:05:43.489 INFO:tasks.workunit.client.0.smithi097.stderr: -231> 2024-09-14T11:05:42.992+0000 7f2d7351f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:05:43.489 INFO:tasks.workunit.client.0.smithi097.stderr: -230> 2024-09-14T11:05:42.993+0000 7f2c52ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:05:43.489 INFO:tasks.workunit.client.0.smithi097.stderr: -229> 2024-09-14T11:05:42.993+0000 7f2c52ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:05:43.489 INFO:tasks.workunit.client.0.smithi097.stderr: -228> 2024-09-14T11:05:42.993+0000 7f2c52ffd640 10 monclient: dump: 2024-09-14T11:05:43.489 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:05:43.489 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:05:43.489 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:43.489 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:43.489 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:05:43.489 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:05:43.489 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:05:43.489 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:05:43.489 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:05:43.490 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:43.490 INFO:tasks.workunit.client.0.smithi097.stderr: -227> 2024-09-14T11:05:42.993+0000 7f2c52ffd640 10 monclient: _finish_auth 0 2024-09-14T11:05:43.490 INFO:tasks.workunit.client.0.smithi097.stderr: -226> 2024-09-14T11:05:42.993+0000 7f2c52ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:05:43.490 INFO:tasks.workunit.client.0.smithi097.stderr: -225> 2024-09-14T11:05:42.993+0000 7f2d7622f800 5 monclient: authenticate success, global_id 7118 2024-09-14T11:05:43.490 INFO:tasks.workunit.client.0.smithi097.stderr: -224> 2024-09-14T11:05:42.993+0000 7f2c52ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:05:43.490 INFO:tasks.workunit.client.0.smithi097.stderr: -223> 2024-09-14T11:05:42.993+0000 7f2c52ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:05:43.490 INFO:tasks.workunit.client.0.smithi097.stderr: -222> 2024-09-14T11:05:42.993+0000 7f2c52ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:05:43.490 INFO:tasks.workunit.client.0.smithi097.stderr: -221> 2024-09-14T11:05:42.993+0000 7f2c52ffd640 10 monclient: dump: 2024-09-14T11:05:43.490 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:05:43.490 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:05:43.490 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:43.490 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:43.490 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:05:43.490 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:05:43.491 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:05:43.491 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:05:43.491 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:05:43.491 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:43.491 INFO:tasks.workunit.client.0.smithi097.stderr: -220> 2024-09-14T11:05:42.993+0000 7f2d7622f800 10 monclient: get_monmap_and_config success 2024-09-14T11:05:43.491 INFO:tasks.workunit.client.0.smithi097.stderr: -219> 2024-09-14T11:05:42.993+0000 7f2d7622f800 4 set_mon_vals no callback set 2024-09-14T11:05:43.491 INFO:tasks.workunit.client.0.smithi097.stderr: -218> 2024-09-14T11:05:42.993+0000 7f2d7622f800 10 monclient: shutdown 2024-09-14T11:05:43.491 INFO:tasks.workunit.client.0.smithi097.stderr: -217> 2024-09-14T11:05:42.993+0000 7f2d7622f800 10 monclient: build_initial_monmap 2024-09-14T11:05:43.491 INFO:tasks.workunit.client.0.smithi097.stderr: -216> 2024-09-14T11:05:42.993+0000 7f2d7622f800 1 build_initial for_mkfs: 0 2024-09-14T11:05:43.491 INFO:tasks.workunit.client.0.smithi097.stderr: -215> 2024-09-14T11:05:42.993+0000 7f2d7622f800 10 monclient: monmap: 2024-09-14T11:05:43.491 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:05:43.491 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:05:43.491 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:05:43.492 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:05:43.492 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:05:43.492 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:05:43.492 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:05:43.492 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:05:43.492 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:05:43.492 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:43.492 INFO:tasks.workunit.client.0.smithi097.stderr: -214> 2024-09-14T11:05:42.993+0000 7f2d7622f800 5 AuthRegistry(0x55e61550bf60) adding auth protocol: cephx 2024-09-14T11:05:43.492 INFO:tasks.workunit.client.0.smithi097.stderr: -213> 2024-09-14T11:05:42.993+0000 7f2d7622f800 5 AuthRegistry(0x55e61550bf60) adding auth protocol: cephx 2024-09-14T11:05:43.492 INFO:tasks.workunit.client.0.smithi097.stderr: -212> 2024-09-14T11:05:42.993+0000 7f2d7622f800 5 AuthRegistry(0x55e61550bf60) adding auth protocol: cephx 2024-09-14T11:05:43.492 INFO:tasks.workunit.client.0.smithi097.stderr: -211> 2024-09-14T11:05:42.993+0000 7f2d7622f800 5 AuthRegistry(0x55e61550bf60) adding con mode: secure 2024-09-14T11:05:43.492 INFO:tasks.workunit.client.0.smithi097.stderr: -210> 2024-09-14T11:05:42.993+0000 7f2d7622f800 5 AuthRegistry(0x55e61550bf60) adding con mode: crc 2024-09-14T11:05:43.492 INFO:tasks.workunit.client.0.smithi097.stderr: -209> 2024-09-14T11:05:42.993+0000 7f2d7622f800 5 AuthRegistry(0x55e61550bf60) adding con mode: secure 2024-09-14T11:05:43.492 INFO:tasks.workunit.client.0.smithi097.stderr: -208> 2024-09-14T11:05:42.993+0000 7f2d7622f800 5 AuthRegistry(0x55e61550bf60) adding con mode: crc 2024-09-14T11:05:43.493 INFO:tasks.workunit.client.0.smithi097.stderr: -207> 2024-09-14T11:05:42.993+0000 7f2d7622f800 5 AuthRegistry(0x55e61550bf60) adding con mode: secure 2024-09-14T11:05:43.493 INFO:tasks.workunit.client.0.smithi097.stderr: -206> 2024-09-14T11:05:42.993+0000 7f2d7622f800 5 AuthRegistry(0x55e61550bf60) adding con mode: crc 2024-09-14T11:05:43.493 INFO:tasks.workunit.client.0.smithi097.stderr: -205> 2024-09-14T11:05:42.993+0000 7f2d7622f800 5 AuthRegistry(0x55e61550bf60) adding con mode: crc 2024-09-14T11:05:43.493 INFO:tasks.workunit.client.0.smithi097.stderr: -204> 2024-09-14T11:05:42.993+0000 7f2d7622f800 5 AuthRegistry(0x55e61550bf60) adding con mode: secure 2024-09-14T11:05:43.493 INFO:tasks.workunit.client.0.smithi097.stderr: -203> 2024-09-14T11:05:42.993+0000 7f2d7622f800 5 AuthRegistry(0x55e61550bf60) adding con mode: crc 2024-09-14T11:05:43.493 INFO:tasks.workunit.client.0.smithi097.stderr: -202> 2024-09-14T11:05:42.993+0000 7f2d7622f800 5 AuthRegistry(0x55e61550bf60) adding con mode: secure 2024-09-14T11:05:43.493 INFO:tasks.workunit.client.0.smithi097.stderr: -201> 2024-09-14T11:05:42.993+0000 7f2d7622f800 5 AuthRegistry(0x55e61550bf60) adding con mode: crc 2024-09-14T11:05:43.493 INFO:tasks.workunit.client.0.smithi097.stderr: -200> 2024-09-14T11:05:42.993+0000 7f2d7622f800 5 AuthRegistry(0x55e61550bf60) adding con mode: secure 2024-09-14T11:05:43.493 INFO:tasks.workunit.client.0.smithi097.stderr: -199> 2024-09-14T11:05:42.994+0000 7f2d7622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:05:43.493 INFO:tasks.workunit.client.0.smithi097.stderr: -198> 2024-09-14T11:05:42.994+0000 7f2d7622f800 1 librados: starting msgr at 2024-09-14T11:05:43.493 INFO:tasks.workunit.client.0.smithi097.stderr: -197> 2024-09-14T11:05:42.994+0000 7f2d7622f800 1 librados: starting objecter 2024-09-14T11:05:43.493 INFO:tasks.workunit.client.0.smithi097.stderr: -196> 2024-09-14T11:05:42.994+0000 7f2d7622f800 5 asok(0x55e61521c270) register_command objecter_requests cmddesc objecter_requests hook 0x55e6154bc6a0 EEXIST 2024-09-14T11:05:43.493 INFO:tasks.workunit.client.0.smithi097.stderr: -195> 2024-09-14T11:05:42.994+0000 7f2d7622f800 1 librados: setting wanted keys 2024-09-14T11:05:43.493 INFO:tasks.workunit.client.0.smithi097.stderr: -194> 2024-09-14T11:05:42.994+0000 7f2d7622f800 1 librados: calling monclient init 2024-09-14T11:05:43.494 INFO:tasks.workunit.client.0.smithi097.stderr: -193> 2024-09-14T11:05:42.994+0000 7f2d7622f800 10 monclient: init 2024-09-14T11:05:43.494 INFO:tasks.workunit.client.0.smithi097.stderr: -192> 2024-09-14T11:05:42.994+0000 7f2d7622f800 5 AuthRegistry(0x55e6154d05e0) adding auth protocol: cephx 2024-09-14T11:05:43.494 INFO:tasks.workunit.client.0.smithi097.stderr: -191> 2024-09-14T11:05:42.994+0000 7f2d7622f800 5 AuthRegistry(0x55e6154d05e0) adding auth protocol: cephx 2024-09-14T11:05:43.494 INFO:tasks.workunit.client.0.smithi097.stderr: -190> 2024-09-14T11:05:42.994+0000 7f2d7622f800 5 AuthRegistry(0x55e6154d05e0) adding auth protocol: cephx 2024-09-14T11:05:43.494 INFO:tasks.workunit.client.0.smithi097.stderr: -189> 2024-09-14T11:05:42.994+0000 7f2d7622f800 5 AuthRegistry(0x55e6154d05e0) adding con mode: secure 2024-09-14T11:05:43.494 INFO:tasks.workunit.client.0.smithi097.stderr: -188> 2024-09-14T11:05:42.994+0000 7f2d7622f800 5 AuthRegistry(0x55e6154d05e0) adding con mode: crc 2024-09-14T11:05:43.494 INFO:tasks.workunit.client.0.smithi097.stderr: -187> 2024-09-14T11:05:42.994+0000 7f2d7622f800 5 AuthRegistry(0x55e6154d05e0) adding con mode: secure 2024-09-14T11:05:43.494 INFO:tasks.workunit.client.0.smithi097.stderr: -186> 2024-09-14T11:05:42.994+0000 7f2d7622f800 5 AuthRegistry(0x55e6154d05e0) adding con mode: crc 2024-09-14T11:05:43.494 INFO:tasks.workunit.client.0.smithi097.stderr: -185> 2024-09-14T11:05:42.994+0000 7f2d7622f800 5 AuthRegistry(0x55e6154d05e0) adding con mode: secure 2024-09-14T11:05:43.494 INFO:tasks.workunit.client.0.smithi097.stderr: -184> 2024-09-14T11:05:42.994+0000 7f2d7622f800 5 AuthRegistry(0x55e6154d05e0) adding con mode: crc 2024-09-14T11:05:43.494 INFO:tasks.workunit.client.0.smithi097.stderr: -183> 2024-09-14T11:05:42.994+0000 7f2d7622f800 5 AuthRegistry(0x55e6154d05e0) adding con mode: crc 2024-09-14T11:05:43.494 INFO:tasks.workunit.client.0.smithi097.stderr: -182> 2024-09-14T11:05:42.994+0000 7f2d7622f800 5 AuthRegistry(0x55e6154d05e0) adding con mode: secure 2024-09-14T11:05:43.494 INFO:tasks.workunit.client.0.smithi097.stderr: -181> 2024-09-14T11:05:42.994+0000 7f2d7622f800 5 AuthRegistry(0x55e6154d05e0) adding con mode: crc 2024-09-14T11:05:43.494 INFO:tasks.workunit.client.0.smithi097.stderr: -180> 2024-09-14T11:05:42.994+0000 7f2d7622f800 5 AuthRegistry(0x55e6154d05e0) adding con mode: secure 2024-09-14T11:05:43.495 INFO:tasks.workunit.client.0.smithi097.stderr: -179> 2024-09-14T11:05:42.994+0000 7f2d7622f800 5 AuthRegistry(0x55e6154d05e0) adding con mode: crc 2024-09-14T11:05:43.495 INFO:tasks.workunit.client.0.smithi097.stderr: -178> 2024-09-14T11:05:42.994+0000 7f2d7622f800 5 AuthRegistry(0x55e6154d05e0) adding con mode: secure 2024-09-14T11:05:43.495 INFO:tasks.workunit.client.0.smithi097.stderr: -177> 2024-09-14T11:05:42.994+0000 7f2d7622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:05:43.495 INFO:tasks.workunit.client.0.smithi097.stderr: -176> 2024-09-14T11:05:42.994+0000 7f2d7622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:05:43.495 INFO:tasks.workunit.client.0.smithi097.stderr: -175> 2024-09-14T11:05:42.994+0000 7f2d7622f800 5 asok(0x55e61521c270) register_command rotate-key cmddesc rotate-key hook 0x55e6154d0728 EEXIST 2024-09-14T11:05:43.495 INFO:tasks.workunit.client.0.smithi097.stderr: -174> 2024-09-14T11:05:42.994+0000 7f2d7622f800 10 monclient: _reopen_session rank -1 2024-09-14T11:05:43.495 INFO:tasks.workunit.client.0.smithi097.stderr: -173> 2024-09-14T11:05:42.994+0000 7f2d7622f800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:05:43.495 INFO:tasks.workunit.client.0.smithi097.stderr: -172> 2024-09-14T11:05:42.994+0000 7f2d7622f800 10 monclient(hunting): picked mon.noname-b con 0x55e6154e0eb0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:05:43.495 INFO:tasks.workunit.client.0.smithi097.stderr: -171> 2024-09-14T11:05:42.994+0000 7f2d7622f800 10 monclient(hunting): picked mon.noname-a con 0x55e61550b380 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:05:43.495 INFO:tasks.workunit.client.0.smithi097.stderr: -170> 2024-09-14T11:05:42.994+0000 7f2d7622f800 10 monclient(hunting): picked mon.noname-c con 0x55e61550fea0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:05:43.495 INFO:tasks.workunit.client.0.smithi097.stderr: -169> 2024-09-14T11:05:42.994+0000 7f2d7622f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:05:43.495 INFO:tasks.workunit.client.0.smithi097.stderr: -168> 2024-09-14T11:05:42.994+0000 7f2d7622f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:05:43.495 INFO:tasks.workunit.client.0.smithi097.stderr: -167> 2024-09-14T11:05:42.994+0000 7f2d7622f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:05:43.495 INFO:tasks.workunit.client.0.smithi097.stderr: -166> 2024-09-14T11:05:42.994+0000 7f2d7622f800 10 monclient(hunting): _renew_subs 2024-09-14T11:05:43.496 INFO:tasks.workunit.client.0.smithi097.stderr: -165> 2024-09-14T11:05:42.994+0000 7f2d7622f800 10 monclient(hunting): authenticate will time out at 2024.647723s 2024-09-14T11:05:43.496 INFO:tasks.workunit.client.0.smithi097.stderr: -164> 2024-09-14T11:05:42.994+0000 7f2d73d20640 10 monclient(hunting): get_auth_request con 0x55e61550fea0 auth_method 0 2024-09-14T11:05:43.496 INFO:tasks.workunit.client.0.smithi097.stderr: -163> 2024-09-14T11:05:42.994+0000 7f2d73d20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:05:43.496 INFO:tasks.workunit.client.0.smithi097.stderr: -162> 2024-09-14T11:05:42.994+0000 7f2d73d20640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:05:43.496 INFO:tasks.workunit.client.0.smithi097.stderr: -161> 2024-09-14T11:05:42.994+0000 7f2d73d20640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:05:43.496 INFO:tasks.workunit.client.0.smithi097.stderr: -160> 2024-09-14T11:05:42.994+0000 7f2d74521640 10 monclient(hunting): get_auth_request con 0x55e61550b380 auth_method 0 2024-09-14T11:05:43.496 INFO:tasks.workunit.client.0.smithi097.stderr: -159> 2024-09-14T11:05:42.994+0000 7f2d74521640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:05:43.496 INFO:tasks.workunit.client.0.smithi097.stderr: -158> 2024-09-14T11:05:42.994+0000 7f2d74521640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:05:43.496 INFO:tasks.workunit.client.0.smithi097.stderr: -157> 2024-09-14T11:05:42.994+0000 7f2d74521640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:05:43.496 INFO:tasks.workunit.client.0.smithi097.stderr: -156> 2024-09-14T11:05:42.994+0000 7f2d73d20640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:05:43.496 INFO:tasks.workunit.client.0.smithi097.stderr: -155> 2024-09-14T11:05:42.994+0000 7f2d73d20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:05:43.496 INFO:tasks.workunit.client.0.smithi097.stderr: -154> 2024-09-14T11:05:42.994+0000 7f2d73d20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:05:43.496 INFO:tasks.workunit.client.0.smithi097.stderr: -153> 2024-09-14T11:05:42.994+0000 7f2d74521640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:05:43.497 INFO:tasks.workunit.client.0.smithi097.stderr: -152> 2024-09-14T11:05:42.994+0000 7f2d74521640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:05:43.497 INFO:tasks.workunit.client.0.smithi097.stderr: -151> 2024-09-14T11:05:42.994+0000 7f2d74521640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:05:43.497 INFO:tasks.workunit.client.0.smithi097.stderr: -150> 2024-09-14T11:05:42.995+0000 7f2d7351f640 10 monclient(hunting): get_auth_request con 0x55e6154e0eb0 auth_method 0 2024-09-14T11:05:43.497 INFO:tasks.workunit.client.0.smithi097.stderr: -149> 2024-09-14T11:05:42.995+0000 7f2d7351f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:05:43.497 INFO:tasks.workunit.client.0.smithi097.stderr: -148> 2024-09-14T11:05:42.995+0000 7f2d7351f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:05:43.497 INFO:tasks.workunit.client.0.smithi097.stderr: -147> 2024-09-14T11:05:42.995+0000 7f2d7351f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:05:43.497 INFO:tasks.workunit.client.0.smithi097.stderr: -146> 2024-09-14T11:05:42.995+0000 7f2d73d20640 10 monclient(hunting): handle_auth_done global_id 7121 payload 824 2024-09-14T11:05:43.497 INFO:tasks.workunit.client.0.smithi097.stderr: -145> 2024-09-14T11:05:42.995+0000 7f2d73d20640 10 monclient: _finish_hunting 0 2024-09-14T11:05:43.497 INFO:tasks.workunit.client.0.smithi097.stderr: -144> 2024-09-14T11:05:42.995+0000 7f2d73d20640 1 monclient: found mon.noname-c 2024-09-14T11:05:43.497 INFO:tasks.workunit.client.0.smithi097.stderr: -143> 2024-09-14T11:05:42.995+0000 7f2d73d20640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:05:43.497 INFO:tasks.workunit.client.0.smithi097.stderr: -142> 2024-09-14T11:05:42.995+0000 7f2c517fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:05:43.497 INFO:tasks.workunit.client.0.smithi097.stderr: -141> 2024-09-14T11:05:42.995+0000 7f2c517fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:05:43.497 INFO:tasks.workunit.client.0.smithi097.stderr: -140> 2024-09-14T11:05:42.995+0000 7f2c517fa640 10 monclient: dump: 2024-09-14T11:05:43.497 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:05:43.498 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:05:43.498 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:43.498 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:43.498 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:05:43.498 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:05:43.498 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:05:43.498 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:05:43.498 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:05:43.498 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:43.498 INFO:tasks.workunit.client.0.smithi097.stderr: -139> 2024-09-14T11:05:42.995+0000 7f2c517fa640 10 monclient: _finish_auth 0 2024-09-14T11:05:43.498 INFO:tasks.workunit.client.0.smithi097.stderr: -138> 2024-09-14T11:05:42.995+0000 7f2c517fa640 10 monclient: _check_auth_tickets 2024-09-14T11:05:43.498 INFO:tasks.workunit.client.0.smithi097.stderr: -137> 2024-09-14T11:05:42.995+0000 7f2c517fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:05:43.498 INFO:tasks.workunit.client.0.smithi097.stderr: -136> 2024-09-14T11:05:42.995+0000 7f2c517fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:05:43.499 INFO:tasks.workunit.client.0.smithi097.stderr: -135> 2024-09-14T11:05:42.995+0000 7f2c517fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:05:43.499 INFO:tasks.workunit.client.0.smithi097.stderr: -134> 2024-09-14T11:05:42.995+0000 7f2c517fa640 10 monclient: dump: 2024-09-14T11:05:43.499 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:05:43.499 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:05:43.499 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:43.499 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:43.499 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:05:43.499 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:05:43.499 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:05:43.499 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:05:43.499 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:05:43.499 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:43.499 INFO:tasks.workunit.client.0.smithi097.stderr: -133> 2024-09-14T11:05:42.995+0000 7f2d7622f800 5 monclient: authenticate success, global_id 7121 2024-09-14T11:05:43.499 INFO:tasks.workunit.client.0.smithi097.stderr: -132> 2024-09-14T11:05:42.995+0000 7f2c52ffd640 4 set_mon_vals no callback set 2024-09-14T11:05:43.500 INFO:tasks.workunit.client.0.smithi097.stderr: -131> 2024-09-14T11:05:42.995+0000 7f2d7622f800 10 monclient: _renew_subs 2024-09-14T11:05:43.500 INFO:tasks.workunit.client.0.smithi097.stderr: -130> 2024-09-14T11:05:42.995+0000 7f2d7622f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:05:43.500 INFO:tasks.workunit.client.0.smithi097.stderr: -129> 2024-09-14T11:05:42.995+0000 7f2d7622f800 10 monclient: _renew_subs 2024-09-14T11:05:43.500 INFO:tasks.workunit.client.0.smithi097.stderr: -128> 2024-09-14T11:05:42.995+0000 7f2d7622f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:05:43.500 INFO:tasks.workunit.client.0.smithi097.stderr: -127> 2024-09-14T11:05:42.995+0000 7f2d7622f800 1 librados: init done 2024-09-14T11:05:43.500 INFO:tasks.workunit.client.0.smithi097.stderr: -126> 2024-09-14T11:05:42.995+0000 7f2d7622f800 5 asok(0x55e61521c270) register_command cr dump hook 0x55e615508338 2024-09-14T11:05:43.500 INFO:tasks.workunit.client.0.smithi097.stderr: -125> 2024-09-14T11:05:42.997+0000 7f2d7622f800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.500 INFO:tasks.workunit.client.0.smithi097.stderr: -124> 2024-09-14T11:05:42.997+0000 7f2c517fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:05:43.500 INFO:tasks.workunit.client.0.smithi097.stderr: -123> 2024-09-14T11:05:42.997+0000 7f2c517fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:05:43.500 INFO:tasks.workunit.client.0.smithi097.stderr: -122> 2024-09-14T11:05:42.997+0000 7f2c517fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:05:43.500 INFO:tasks.workunit.client.0.smithi097.stderr: -121> 2024-09-14T11:05:42.997+0000 7f2d7351f640 10 monclient: get_auth_request con 0x7f2c3c077230 auth_method 0 2024-09-14T11:05:43.500 INFO:tasks.workunit.client.0.smithi097.stderr: -120> 2024-09-14T11:05:42.998+0000 7f2d74521640 10 monclient: get_auth_request con 0x55e61552a2d0 auth_method 0 2024-09-14T11:05:43.500 INFO:tasks.workunit.client.0.smithi097.stderr: -119> 2024-09-14T11:05:42.998+0000 7f2d7622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:43.501 INFO:tasks.workunit.client.0.smithi097.stderr: -118> 2024-09-14T11:05:42.998+0000 7f2d7622f800 20 realm 2024-09-14T11:05:43.501 INFO:tasks.workunit.client.0.smithi097.stderr: -117> 2024-09-14T11:05:42.998+0000 7f2d7622f800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.501 INFO:tasks.workunit.client.0.smithi097.stderr: -116> 2024-09-14T11:05:42.999+0000 7f2d7622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:43.501 INFO:tasks.workunit.client.0.smithi097.stderr: -115> 2024-09-14T11:05:42.999+0000 7f2d7622f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:05:43.501 INFO:tasks.workunit.client.0.smithi097.stderr: -114> 2024-09-14T11:05:42.999+0000 7f2d7622f800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.501 INFO:tasks.workunit.client.0.smithi097.stderr: -113> 2024-09-14T11:05:42.999+0000 7f2d7622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:43.501 INFO:tasks.workunit.client.0.smithi097.stderr: -112> 2024-09-14T11:05:42.999+0000 7f2d7622f800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.501 INFO:tasks.workunit.client.0.smithi097.stderr: -111> 2024-09-14T11:05:42.999+0000 7f2d7351f640 10 monclient: get_auth_request con 0x55e61552e4c0 auth_method 0 2024-09-14T11:05:43.501 INFO:tasks.workunit.client.0.smithi097.stderr: -110> 2024-09-14T11:05:42.999+0000 7f2d7622f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:43.501 INFO:tasks.workunit.client.0.smithi097.stderr: -109> 2024-09-14T11:05:42.999+0000 7f2d7622f800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.501 INFO:tasks.workunit.client.0.smithi097.stderr: -108> 2024-09-14T11:05:43.000+0000 7f2d74521640 10 monclient: get_auth_request con 0x55e615531d20 auth_method 0 2024-09-14T11:05:43.501 INFO:tasks.workunit.client.0.smithi097.stderr: -107> 2024-09-14T11:05:43.000+0000 7f2d7622f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:05:43.501 INFO:tasks.workunit.client.0.smithi097.stderr: -106> 2024-09-14T11:05:43.000+0000 7f2d7622f800 20 searching for the correct realm 2024-09-14T11:05:43.501 INFO:tasks.workunit.client.0.smithi097.stderr: -105> 2024-09-14T11:05:43.000+0000 7f2d73d20640 10 monclient: get_auth_request con 0x55e6155369f0 auth_method 0 2024-09-14T11:05:43.502 INFO:tasks.workunit.client.0.smithi097.stderr: -104> 2024-09-14T11:05:43.001+0000 7f2d7351f640 10 monclient: get_auth_request con 0x7f2d64044060 auth_method 0 2024-09-14T11:05:43.502 INFO:tasks.workunit.client.0.smithi097.stderr: -103> 2024-09-14T11:05:43.002+0000 7f2d74521640 10 monclient: get_auth_request con 0x7f2d5c06d060 auth_method 0 2024-09-14T11:05:43.502 INFO:tasks.workunit.client.0.smithi097.stderr: -102> 2024-09-14T11:05:43.002+0000 7f2d74521640 0 -- 172.21.15.97:0/1250567262 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f2d5c06d060 msgr2=0x7f2d5c0b9770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:05:43.502 INFO:tasks.workunit.client.0.smithi097.stderr: -101> 2024-09-14T11:05:43.203+0000 7f2d74521640 10 monclient: get_auth_request con 0x7f2d5c06d060 auth_method 0 2024-09-14T11:05:43.502 INFO:tasks.workunit.client.0.smithi097.stderr: -100> 2024-09-14T11:05:43.204+0000 7f2c517fa640 1 client.7121.objecter ms_handle_reset 0x7f2d64044060 session 0x7f2d64071e90 osd.2 2024-09-14T11:05:43.502 INFO:tasks.workunit.client.0.smithi097.stderr: -99> 2024-09-14T11:05:43.204+0000 7f2c517fa640 10 monclient: _renew_subs 2024-09-14T11:05:43.502 INFO:tasks.workunit.client.0.smithi097.stderr: -98> 2024-09-14T11:05:43.204+0000 7f2c517fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:05:43.502 INFO:tasks.workunit.client.0.smithi097.stderr: -97> 2024-09-14T11:05:43.204+0000 7f2d7351f640 10 monclient: get_auth_request con 0x7f2c3c086d50 auth_method 0 2024-09-14T11:05:43.502 INFO:tasks.workunit.client.0.smithi097.stderr: -96> 2024-09-14T11:05:43.206+0000 7f2d73d20640 10 monclient: get_auth_request con 0x7f2d5c0abe00 auth_method 0 2024-09-14T11:05:43.502 INFO:tasks.workunit.client.0.smithi097.stderr: -95> 2024-09-14T11:05:43.206+0000 7f2d7351f640 0 -- 172.21.15.97:0/1250567262 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f2d6402f040 msgr2=0x7f2d64070d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:05:43.502 INFO:tasks.workunit.client.0.smithi097.stderr: -94> 2024-09-14T11:05:43.407+0000 7f2d7351f640 10 monclient: get_auth_request con 0x7f2d6402f040 auth_method 0 2024-09-14T11:05:43.502 INFO:tasks.workunit.client.0.smithi097.stderr: -93> 2024-09-14T11:05:43.412+0000 7f2d7622f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:05:43.503 INFO:tasks.workunit.client.0.smithi097.stderr: -92> 2024-09-14T11:05:43.412+0000 7f2d7622f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:05:43.503 INFO:tasks.workunit.client.0.smithi097.stderr: -91> 2024-09-14T11:05:43.412+0000 7f2d7622f800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:05:43.503 INFO:tasks.workunit.client.0.smithi097.stderr: -90> 2024-09-14T11:05:43.412+0000 7f2d7622f800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:05:43.503 INFO:tasks.workunit.client.0.smithi097.stderr: -89> 2024-09-14T11:05:43.412+0000 7f2d7622f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:05:43.503 INFO:tasks.workunit.client.0.smithi097.stderr: -88> 2024-09-14T11:05:43.412+0000 7f2d7622f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:05:43.503 INFO:tasks.workunit.client.0.smithi097.stderr: -87> 2024-09-14T11:05:43.412+0000 7f2d7622f800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.503 INFO:tasks.workunit.client.0.smithi097.stderr: -86> 2024-09-14T11:05:43.413+0000 7f2d7622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:43.503 INFO:tasks.workunit.client.0.smithi097.stderr: -85> 2024-09-14T11:05:43.413+0000 7f2d7622f800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.503 INFO:tasks.workunit.client.0.smithi097.stderr: -84> 2024-09-14T11:05:43.413+0000 7f2d7622f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:43.503 INFO:tasks.workunit.client.0.smithi097.stderr: -83> 2024-09-14T11:05:43.413+0000 7f2d7622f800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.503 INFO:tasks.workunit.client.0.smithi097.stderr: -82> 2024-09-14T11:05:43.413+0000 7f2d7622f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:05:43.503 INFO:tasks.workunit.client.0.smithi097.stderr: -81> 2024-09-14T11:05:43.413+0000 7f2d7622f800 20 zone default found 2024-09-14T11:05:43.503 INFO:tasks.workunit.client.0.smithi097.stderr: -80> 2024-09-14T11:05:43.413+0000 7f2d7622f800 4 Realm: () 2024-09-14T11:05:43.503 INFO:tasks.workunit.client.0.smithi097.stderr: -79> 2024-09-14T11:05:43.413+0000 7f2d7622f800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:05:43.504 INFO:tasks.workunit.client.0.smithi097.stderr: -78> 2024-09-14T11:05:43.413+0000 7f2d7622f800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:05:43.504 INFO:tasks.workunit.client.0.smithi097.stderr: -77> 2024-09-14T11:05:43.413+0000 7f2d7622f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:05:43.504 INFO:tasks.workunit.client.0.smithi097.stderr: -76> 2024-09-14T11:05:43.413+0000 7f2d7622f800 20 zonegroup default 2024-09-14T11:05:43.504 INFO:tasks.workunit.client.0.smithi097.stderr: -75> 2024-09-14T11:05:43.413+0000 7f2d7622f800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.504 INFO:tasks.workunit.client.0.smithi097.stderr: -74> 2024-09-14T11:05:43.413+0000 7f2d7622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:43.504 INFO:tasks.workunit.client.0.smithi097.stderr: -73> 2024-09-14T11:05:43.413+0000 7f2d7622f800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.504 INFO:tasks.workunit.client.0.smithi097.stderr: -72> 2024-09-14T11:05:43.414+0000 7f2d7622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:43.504 INFO:tasks.workunit.client.0.smithi097.stderr: -71> 2024-09-14T11:05:43.414+0000 7f2d7622f800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.504 INFO:tasks.workunit.client.0.smithi097.stderr: -70> 2024-09-14T11:05:43.414+0000 7f2d7622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:43.504 INFO:tasks.workunit.client.0.smithi097.stderr: -69> 2024-09-14T11:05:43.414+0000 7f2d7622f800 20 started sync module instance, tier type = 2024-09-14T11:05:43.504 INFO:tasks.workunit.client.0.smithi097.stderr: -68> 2024-09-14T11:05:43.414+0000 7f2d7622f800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:05:43.504 INFO:tasks.workunit.client.0.smithi097.stderr: -67> 2024-09-14T11:05:43.424+0000 7f2d7622f800 20 add_watcher() i=0 2024-09-14T11:05:43.504 INFO:tasks.workunit.client.0.smithi097.stderr: -66> 2024-09-14T11:05:43.424+0000 7f2d7622f800 20 add_watcher() i=1 2024-09-14T11:05:43.504 INFO:tasks.workunit.client.0.smithi097.stderr: -65> 2024-09-14T11:05:43.424+0000 7f2d7622f800 20 add_watcher() i=2 2024-09-14T11:05:43.504 INFO:tasks.workunit.client.0.smithi097.stderr: -64> 2024-09-14T11:05:43.424+0000 7f2d7622f800 20 add_watcher() i=3 2024-09-14T11:05:43.505 INFO:tasks.workunit.client.0.smithi097.stderr: -63> 2024-09-14T11:05:43.424+0000 7f2d7622f800 20 add_watcher() i=4 2024-09-14T11:05:43.505 INFO:tasks.workunit.client.0.smithi097.stderr: -62> 2024-09-14T11:05:43.424+0000 7f2d7622f800 20 add_watcher() i=5 2024-09-14T11:05:43.505 INFO:tasks.workunit.client.0.smithi097.stderr: -61> 2024-09-14T11:05:43.425+0000 7f2d7622f800 20 add_watcher() i=6 2024-09-14T11:05:43.505 INFO:tasks.workunit.client.0.smithi097.stderr: -60> 2024-09-14T11:05:43.425+0000 7f2d7622f800 20 add_watcher() i=7 2024-09-14T11:05:43.505 INFO:tasks.workunit.client.0.smithi097.stderr: -59> 2024-09-14T11:05:43.425+0000 7f2d7622f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:05:43.505 INFO:tasks.workunit.client.0.smithi097.stderr: -58> 2024-09-14T11:05:43.427+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395ec90) adding auth protocol: cephx 2024-09-14T11:05:43.505 INFO:tasks.workunit.client.0.smithi097.stderr: -57> 2024-09-14T11:05:43.427+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395ec90) adding auth protocol: cephx 2024-09-14T11:05:43.505 INFO:tasks.workunit.client.0.smithi097.stderr: -56> 2024-09-14T11:05:43.427+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395ec90) adding auth protocol: cephx 2024-09-14T11:05:43.505 INFO:tasks.workunit.client.0.smithi097.stderr: -55> 2024-09-14T11:05:43.427+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395ec90) adding con mode: secure 2024-09-14T11:05:43.505 INFO:tasks.workunit.client.0.smithi097.stderr: -54> 2024-09-14T11:05:43.427+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395ec90) adding con mode: crc 2024-09-14T11:05:43.505 INFO:tasks.workunit.client.0.smithi097.stderr: -53> 2024-09-14T11:05:43.427+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395ec90) adding con mode: secure 2024-09-14T11:05:43.505 INFO:tasks.workunit.client.0.smithi097.stderr: -52> 2024-09-14T11:05:43.427+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395ec90) adding con mode: crc 2024-09-14T11:05:43.505 INFO:tasks.workunit.client.0.smithi097.stderr: -51> 2024-09-14T11:05:43.427+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395ec90) adding con mode: secure 2024-09-14T11:05:43.505 INFO:tasks.workunit.client.0.smithi097.stderr: -50> 2024-09-14T11:05:43.427+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395ec90) adding con mode: crc 2024-09-14T11:05:43.505 INFO:tasks.workunit.client.0.smithi097.stderr: -49> 2024-09-14T11:05:43.427+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395ec90) adding con mode: crc 2024-09-14T11:05:43.506 INFO:tasks.workunit.client.0.smithi097.stderr: -48> 2024-09-14T11:05:43.427+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395ec90) adding con mode: secure 2024-09-14T11:05:43.506 INFO:tasks.workunit.client.0.smithi097.stderr: -47> 2024-09-14T11:05:43.427+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395ec90) adding con mode: crc 2024-09-14T11:05:43.506 INFO:tasks.workunit.client.0.smithi097.stderr: -46> 2024-09-14T11:05:43.427+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395ec90) adding con mode: secure 2024-09-14T11:05:43.506 INFO:tasks.workunit.client.0.smithi097.stderr: -45> 2024-09-14T11:05:43.427+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395ec90) adding con mode: crc 2024-09-14T11:05:43.506 INFO:tasks.workunit.client.0.smithi097.stderr: -44> 2024-09-14T11:05:43.427+0000 7f2c29fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:43.506 INFO:tasks.workunit.client.0.smithi097.stderr: -43> 2024-09-14T11:05:43.427+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395ec90) adding con mode: secure 2024-09-14T11:05:43.506 INFO:tasks.workunit.client.0.smithi097.stderr: -42> 2024-09-14T11:05:43.428+0000 7f2d7622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:05:43.506 INFO:tasks.workunit.client.0.smithi097.stderr: -41> 2024-09-14T11:05:43.428+0000 7f2d7622f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:05:43.506 INFO:tasks.workunit.client.0.smithi097.stderr: -40> 2024-09-14T11:05:43.428+0000 7f2d7622f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:05:43.506 INFO:tasks.workunit.client.0.smithi097.stderr: -39> 2024-09-14T11:05:43.428+0000 7f2d7622f800 5 asok(0x55e61521c270) register_command cache list hook 0x55e6154fd070 2024-09-14T11:05:43.506 INFO:tasks.workunit.client.0.smithi097.stderr: -38> 2024-09-14T11:05:43.428+0000 7f2d7622f800 5 asok(0x55e61521c270) register_command cache inspect hook 0x55e6154fd070 2024-09-14T11:05:43.506 INFO:tasks.workunit.client.0.smithi097.stderr: -37> 2024-09-14T11:05:43.428+0000 7f2d7622f800 5 asok(0x55e61521c270) register_command cache erase hook 0x55e6154fd070 2024-09-14T11:05:43.506 INFO:tasks.workunit.client.0.smithi097.stderr: -36> 2024-09-14T11:05:43.428+0000 7f2d7622f800 5 asok(0x55e61521c270) register_command cache zap hook 0x55e6154fd070 2024-09-14T11:05:43.506 INFO:tasks.workunit.client.0.smithi097.stderr: -35> 2024-09-14T11:05:43.428+0000 7f2d7622f800 5 note: GC not initialized 2024-09-14T11:05:43.507 INFO:tasks.workunit.client.0.smithi097.stderr: -34> 2024-09-14T11:05:43.428+0000 7f2c28fe1640 20 reqs_thread_entry: start 2024-09-14T11:05:43.507 INFO:tasks.workunit.client.0.smithi097.stderr: -33> 2024-09-14T11:05:43.428+0000 7f2d7622f800 5 asok(0x55e61521c270) register_command sync trace show hook 0x7f2d6c004720 2024-09-14T11:05:43.507 INFO:tasks.workunit.client.0.smithi097.stderr: -32> 2024-09-14T11:05:43.428+0000 7f2d7622f800 5 asok(0x55e61521c270) register_command sync trace history hook 0x7f2d6c004720 2024-09-14T11:05:43.507 INFO:tasks.workunit.client.0.smithi097.stderr: -31> 2024-09-14T11:05:43.428+0000 7f2d7622f800 5 asok(0x55e61521c270) register_command sync trace active hook 0x7f2d6c004720 2024-09-14T11:05:43.507 INFO:tasks.workunit.client.0.smithi097.stderr: -30> 2024-09-14T11:05:43.428+0000 7f2d7622f800 5 asok(0x55e61521c270) register_command sync trace active_short hook 0x7f2d6c004720 2024-09-14T11:05:43.507 INFO:tasks.workunit.client.0.smithi097.stderr: -29> 2024-09-14T11:05:43.428+0000 7f2d7622f800 20 init_complete bucket index max shards: 11 2024-09-14T11:05:43.507 INFO:tasks.workunit.client.0.smithi097.stderr: -28> 2024-09-14T11:05:43.428+0000 7f2d7622f800 20 Filter name: none 2024-09-14T11:05:43.507 INFO:tasks.workunit.client.0.smithi097.stderr: -27> 2024-09-14T11:05:43.428+0000 7f2ba27fc640 20 reqs_thread_entry: start 2024-09-14T11:05:43.507 INFO:tasks.workunit.client.0.smithi097.stderr: -26> 2024-09-14T11:05:43.428+0000 7f2d7622f800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:05:43.507 INFO:tasks.workunit.client.0.smithi097.stderr: -25> 2024-09-14T11:05:43.428+0000 7f2d7622f800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.507 INFO:tasks.workunit.client.0.smithi097.stderr: -24> 2024-09-14T11:05:43.429+0000 7f2d7622f800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:05:43.507 INFO:tasks.workunit.client.0.smithi097.stderr: -23> 2024-09-14T11:05:43.429+0000 7f2d7622f800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:05:43.507 INFO:tasks.workunit.client.0.smithi097.stderr: -22> 2024-09-14T11:05:43.429+0000 7f2d7622f800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:05:43.507 INFO:tasks.workunit.client.0.smithi097.stderr: -21> 2024-09-14T11:05:43.429+0000 7f2d7622f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 : miss 2024-09-14T11:05:43.507 INFO:tasks.workunit.client.0.smithi097.stderr: -20> 2024-09-14T11:05:43.429+0000 7f2d7622f800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.508 INFO:tasks.workunit.client.0.smithi097.stderr: -19> 2024-09-14T11:05:43.429+0000 7f2d7622f800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:05:43.508 INFO:tasks.workunit.client.0.smithi097.stderr: -18> 2024-09-14T11:05:43.429+0000 7f2d7622f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 info.flags=0x17 2024-09-14T11:05:43.508 INFO:tasks.workunit.client.0.smithi097.stderr: -17> 2024-09-14T11:05:43.429+0000 7f2d7622f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 to cache LRU end 2024-09-14T11:05:43.508 INFO:tasks.workunit.client.0.smithi097.stderr: -16> 2024-09-14T11:05:43.429+0000 7f2d7622f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:05:43.508 INFO:tasks.workunit.client.0.smithi097.stderr: -15> 2024-09-14T11:05:43.429+0000 7f2d7622f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:43.508 INFO:tasks.workunit.client.0.smithi097.stderr: -14> 2024-09-14T11:05:43.429+0000 7f2d7622f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 2024-09-14T11:05:43.508 INFO:tasks.workunit.client.0.smithi097.stderr: -13> 2024-09-14T11:05:43.434+0000 7f2d7622f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 info.flags=0x17 2024-09-14T11:05:43.508 INFO:tasks.workunit.client.0.smithi097.stderr: -12> 2024-09-14T11:05:43.434+0000 7f2d7622f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 to cache LRU end 2024-09-14T11:05:43.508 INFO:tasks.workunit.client.0.smithi097.stderr: -11> 2024-09-14T11:05:43.434+0000 7f2d7622f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:43.508 INFO:tasks.workunit.client.0.smithi097.stderr: -10> 2024-09-14T11:05:43.434+0000 7f2d7622f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34, ofs0, ns] 2024-09-14T11:05:43.508 INFO:tasks.workunit.client.0.smithi097.stderr: -9> 2024-09-14T11:05:43.435+0000 7f2c52ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595097 cookie 94446688647040 notifier 7121 bl.length()=911 2024-09-14T11:05:43.508 INFO:tasks.workunit.client.0.smithi097.stderr: -8> 2024-09-14T11:05:43.435+0000 7f2c52ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 info.flags=0x17 2024-09-14T11:05:43.508 INFO:tasks.workunit.client.0.smithi097.stderr: -7> 2024-09-14T11:05:43.435+0000 7f2c52ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 to cache LRU end 2024-09-14T11:05:43.508 INFO:tasks.workunit.client.0.smithi097.stderr: -6> 2024-09-14T11:05:43.435+0000 7f2c52ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:43.508 INFO:tasks.workunit.client.0.smithi097.stderr: -5> 2024-09-14T11:05:43.435+0000 7f2d7622f800 20 handle_bi_update(): bucket=:abort-at-do-reshard[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34]): orig_sources= new_sources= 2024-09-14T11:05:43.509 INFO:tasks.workunit.client.0.smithi097.stderr: -4> 2024-09-14T11:05:43.435+0000 7f2d7622f800 20 handle_bi_update(): bucket=:abort-at-do-reshard[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34]): potential sources added=[] removed=[] 2024-09-14T11:05:43.509 INFO:tasks.workunit.client.0.smithi097.stderr: -3> 2024-09-14T11:05:43.435+0000 7f2d7622f800 20 handle_bi_update(): bucket=:abort-at-do-reshard[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34]): orig_dests= new_dests= 2024-09-14T11:05:43.509 INFO:tasks.workunit.client.0.smithi097.stderr: -2> 2024-09-14T11:05:43.435+0000 7f2d7622f800 20 handle_bi_update(): bucket=:abort-at-do-reshard[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34]): potential dests added=[] removed=[] 2024-09-14T11:05:43.509 INFO:tasks.workunit.client.0.smithi097.stderr: -1> 2024-09-14T11:05:43.441+0000 7f2d7622f800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2d7622f800 time 2024-09-14T11:05:43.441327+0000 2024-09-14T11:05:43.509 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:05:43.509 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:43.509 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:05:43.509 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f2d7978c76a] 2024-09-14T11:05:43.509 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f2d7978c928] 2024-09-14T11:05:43.509 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e612c6c0b1] 2024-09-14T11:05:43.509 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55e612c7bf6a] 2024-09-14T11:05:43.509 INFO:tasks.workunit.client.0.smithi097.stderr: 5: main() 2024-09-14T11:05:43.509 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f2d78429590] 2024-09-14T11:05:43.510 INFO:tasks.workunit.client.0.smithi097.stderr: 7: __libc_start_main() 2024-09-14T11:05:43.510 INFO:tasks.workunit.client.0.smithi097.stderr: 8: _start() 2024-09-14T11:05:43.510 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:43.510 INFO:tasks.workunit.client.0.smithi097.stderr: 0> 2024-09-14T11:05:43.441+0000 7f2d7622f800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:05:43.510 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f2d7622f800 thread_name:radosgw-admin 2024-09-14T11:05:43.510 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:43.510 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:05:43.510 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f2d7843e6f0] 2024-09-14T11:05:43.510 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f2d7848b99c] 2024-09-14T11:05:43.510 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-14T11:05:43.510 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-14T11:05:43.510 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f2d7978c7c4] 2024-09-14T11:05:43.510 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f2d7978c928] 2024-09-14T11:05:43.510 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e612c6c0b1] 2024-09-14T11:05:43.510 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55e612c7bf6a] 2024-09-14T11:05:43.511 INFO:tasks.workunit.client.0.smithi097.stderr: 9: main() 2024-09-14T11:05:43.511 INFO:tasks.workunit.client.0.smithi097.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f2d78429590] 2024-09-14T11:05:43.511 INFO:tasks.workunit.client.0.smithi097.stderr: 11: __libc_start_main() 2024-09-14T11:05:43.511 INFO:tasks.workunit.client.0.smithi097.stderr: 12: _start() 2024-09-14T11:05:43.511 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:05:43.511 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:43.511 INFO:tasks.workunit.client.0.smithi097.stderr:--- logging levels --- 2024-09-14T11:05:43.511 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 none 2024-09-14T11:05:43.511 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 lockdep 2024-09-14T11:05:43.511 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 context 2024-09-14T11:05:43.511 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 crush 2024-09-14T11:05:43.511 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds 2024-09-14T11:05:43.511 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_balancer 2024-09-14T11:05:43.511 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_locker 2024-09-14T11:05:43.511 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log 2024-09-14T11:05:43.511 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log_expire 2024-09-14T11:05:43.512 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_migrator 2024-09-14T11:05:43.512 INFO:tasks.workunit.client.0.smithi097.stderr: 3/ 5 mds_quiesce 2024-09-14T11:05:43.512 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 buffer 2024-09-14T11:05:43.512 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 timer 2024-09-14T11:05:43.512 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 filer 2024-09-14T11:05:43.512 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 striper 2024-09-14T11:05:43.512 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 objecter 2024-09-14T11:05:43.512 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rados 2024-09-14T11:05:43.512 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd 2024-09-14T11:05:43.512 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_mirror 2024-09-14T11:05:43.512 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_replay 2024-09-14T11:05:43.512 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_pwl 2024-09-14T11:05:43.512 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 journaler 2024-09-14T11:05:43.512 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objectcacher 2024-09-14T11:05:43.513 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:05:43.513 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 client 2024-09-14T11:05:43.513 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 osd 2024-09-14T11:05:43.513 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 optracker 2024-09-14T11:05:43.513 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objclass 2024-09-14T11:05:43.513 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 filestore 2024-09-14T11:05:43.513 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 journal 2024-09-14T11:05:43.513 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 ms 2024-09-14T11:05:43.513 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mon 2024-09-14T11:05:43.513 INFO:tasks.workunit.client.0.smithi097.stderr: 0/10 monc 2024-09-14T11:05:43.513 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 paxos 2024-09-14T11:05:43.513 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 tp 2024-09-14T11:05:43.513 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 auth 2024-09-14T11:05:43.513 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 crypto 2024-09-14T11:05:43.514 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 finisher 2024-09-14T11:05:43.514 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 reserver 2024-09-14T11:05:43.514 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 heartbeatmap 2024-09-14T11:05:43.514 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 perfcounter 2024-09-14T11:05:43.514 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw 2024-09-14T11:05:43.514 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_sync 2024-09-14T11:05:43.514 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_datacache 2024-09-14T11:05:43.514 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_access 2024-09-14T11:05:43.514 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:05:43.514 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_flight 2024-09-14T11:05:43.514 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:05:43.514 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw_notification 2024-09-14T11:05:43.514 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 javaclient 2024-09-14T11:05:43.514 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 asok 2024-09-14T11:05:43.515 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 throttle 2024-09-14T11:05:43.515 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 refs 2024-09-14T11:05:43.515 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 compressor 2024-09-14T11:05:43.515 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluestore 2024-09-14T11:05:43.515 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluefs 2024-09-14T11:05:43.515 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 bdev 2024-09-14T11:05:43.515 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 kstore 2024-09-14T11:05:43.515 INFO:tasks.workunit.client.0.smithi097.stderr: 4/ 5 rocksdb 2024-09-14T11:05:43.515 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 fuse 2024-09-14T11:05:43.515 INFO:tasks.workunit.client.0.smithi097.stderr: 2/ 5 mgr 2024-09-14T11:05:43.515 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mgrc 2024-09-14T11:05:43.515 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 dpdk 2024-09-14T11:05:43.516 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 eventtrace 2024-09-14T11:05:43.516 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 prioritycache 2024-09-14T11:05:43.516 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 test 2024-09-14T11:05:43.516 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:05:43.516 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephsqlite 2024-09-14T11:05:43.516 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:05:43.516 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore 2024-09-14T11:05:43.516 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_onode 2024-09-14T11:05:43.516 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_odata 2024-09-14T11:05:43.516 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_omap 2024-09-14T11:05:43.516 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_tm 2024-09-14T11:05:43.516 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_t 2024-09-14T11:05:43.516 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:05:43.517 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_epm 2024-09-14T11:05:43.517 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_lba 2024-09-14T11:05:43.517 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:05:43.517 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cache 2024-09-14T11:05:43.517 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_journal 2024-09-14T11:05:43.517 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_device 2024-09-14T11:05:43.517 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_backref 2024-09-14T11:05:43.517 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 alienstore 2024-09-14T11:05:43.517 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mclock 2024-09-14T11:05:43.517 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cyanstore 2024-09-14T11:05:43.517 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 ceph_exporter 2024-09-14T11:05:43.517 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 memstore 2024-09-14T11:05:43.517 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 trace 2024-09-14T11:05:43.518 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 ceph_dedup 2024-09-14T11:05:43.518 INFO:tasks.workunit.client.0.smithi097.stderr: -2/-2 (syslog threshold) 2024-09-14T11:05:43.518 INFO:tasks.workunit.client.0.smithi097.stderr: 99/99 (stderr threshold) 2024-09-14T11:05:43.518 INFO:tasks.workunit.client.0.smithi097.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:05:43.518 INFO:tasks.workunit.client.0.smithi097.stderr: 7f2ba27fc640 / http_manager 2024-09-14T11:05:43.518 INFO:tasks.workunit.client.0.smithi097.stderr: 7f2c28fe1640 / http_manager 2024-09-14T11:05:43.518 INFO:tasks.workunit.client.0.smithi097.stderr: 7f2c29fe3640 / rgw_dt_lg_renew 2024-09-14T11:05:43.518 INFO:tasks.workunit.client.0.smithi097.stderr: 7f2c517fa640 / ms_dispatch 2024-09-14T11:05:43.518 INFO:tasks.workunit.client.0.smithi097.stderr: 7f2c52ffd640 / io_context_pool 2024-09-14T11:05:43.518 INFO:tasks.workunit.client.0.smithi097.stderr: 7f2c597fa640 / ms_dispatch 2024-09-14T11:05:43.518 INFO:tasks.workunit.client.0.smithi097.stderr: 7f2c5bfff640 / ms_dispatch 2024-09-14T11:05:43.518 INFO:tasks.workunit.client.0.smithi097.stderr: 7f2c61e0b640 / io_context_pool 2024-09-14T11:05:43.518 INFO:tasks.workunit.client.0.smithi097.stderr: 7f2d7351f640 / msgr-worker-2 2024-09-14T11:05:43.518 INFO:tasks.workunit.client.0.smithi097.stderr: 7f2d73d20640 / msgr-worker-1 2024-09-14T11:05:43.519 INFO:tasks.workunit.client.0.smithi097.stderr: 7f2d74521640 / msgr-worker-0 2024-09-14T11:05:43.519 INFO:tasks.workunit.client.0.smithi097.stderr: 7f2d74d22640 / io_context_pool 2024-09-14T11:05:43.519 INFO:tasks.workunit.client.0.smithi097.stderr: 7f2d7622f800 / radosgw-admin 2024-09-14T11:05:43.519 INFO:tasks.workunit.client.0.smithi097.stderr: max_recent 500 2024-09-14T11:05:43.519 INFO:tasks.workunit.client.0.smithi097.stderr: max_new 1000 2024-09-14T11:05:43.519 INFO:tasks.workunit.client.0.smithi097.stderr: log_file /var/log/ceph/ceph-client.admin.128055.log 2024-09-14T11:05:43.519 INFO:tasks.workunit.client.0.smithi097.stderr:--- end dump of recent events --- 2024-09-14T11:05:43.519 INFO:tasks.workunit.client.0.smithi097.stderr:--- begin dump of recent events --- 2024-09-14T11:05:43.519 INFO:tasks.workunit.client.0.smithi097.stderr: -499> 2024-09-14T11:05:42.979+0000 7f2c61e0b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:05:43.519 INFO:tasks.workunit.client.0.smithi097.stderr: -498> 2024-09-14T11:05:42.979+0000 7f2c61e0b640 10 monclient: dump: 2024-09-14T11:05:43.519 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:05:43.519 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:05:43.519 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:43.519 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:43.520 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:05:43.520 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:05:43.520 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:05:43.520 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:05:43.520 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:05:43.520 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:43.520 INFO:tasks.workunit.client.0.smithi097.stderr: -497> 2024-09-14T11:05:42.979+0000 7f2d7622f800 5 monclient: authenticate success, global_id 7548 2024-09-14T11:05:43.520 INFO:tasks.workunit.client.0.smithi097.stderr: -496> 2024-09-14T11:05:42.979+0000 7f2d7622f800 10 monclient: get_monmap_and_config success 2024-09-14T11:05:43.520 INFO:tasks.workunit.client.0.smithi097.stderr: -495> 2024-09-14T11:05:42.979+0000 7f2d7622f800 4 set_mon_vals no callback set 2024-09-14T11:05:43.520 INFO:tasks.workunit.client.0.smithi097.stderr: -494> 2024-09-14T11:05:42.980+0000 7f2d7622f800 10 monclient: shutdown 2024-09-14T11:05:43.520 INFO:tasks.workunit.client.0.smithi097.stderr: -493> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 asok(0x55e61521c270) unregister_commands rotate-key 2024-09-14T11:05:43.520 INFO:tasks.workunit.client.0.smithi097.stderr: -492> 2024-09-14T11:05:42.980+0000 7f2d7622f800 10 monclient: build_initial_monmap 2024-09-14T11:05:43.520 INFO:tasks.workunit.client.0.smithi097.stderr: -491> 2024-09-14T11:05:42.980+0000 7f2d7622f800 1 build_initial for_mkfs: 0 2024-09-14T11:05:43.521 INFO:tasks.workunit.client.0.smithi097.stderr: -490> 2024-09-14T11:05:42.980+0000 7f2d7622f800 10 monclient: monmap: 2024-09-14T11:05:43.521 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:05:43.521 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:05:43.521 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:05:43.521 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:05:43.521 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:05:43.521 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:05:43.521 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:05:43.521 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:05:43.521 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:05:43.521 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:43.521 INFO:tasks.workunit.client.0.smithi097.stderr: -489> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543e680) adding auth protocol: cephx 2024-09-14T11:05:43.521 INFO:tasks.workunit.client.0.smithi097.stderr: -488> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543e680) adding auth protocol: cephx 2024-09-14T11:05:43.521 INFO:tasks.workunit.client.0.smithi097.stderr: -487> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543e680) adding auth protocol: cephx 2024-09-14T11:05:43.522 INFO:tasks.workunit.client.0.smithi097.stderr: -486> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543e680) adding con mode: secure 2024-09-14T11:05:43.522 INFO:tasks.workunit.client.0.smithi097.stderr: -485> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543e680) adding con mode: crc 2024-09-14T11:05:43.522 INFO:tasks.workunit.client.0.smithi097.stderr: -484> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543e680) adding con mode: secure 2024-09-14T11:05:43.522 INFO:tasks.workunit.client.0.smithi097.stderr: -483> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543e680) adding con mode: crc 2024-09-14T11:05:43.522 INFO:tasks.workunit.client.0.smithi097.stderr: -482> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543e680) adding con mode: secure 2024-09-14T11:05:43.522 INFO:tasks.workunit.client.0.smithi097.stderr: -481> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543e680) adding con mode: crc 2024-09-14T11:05:43.522 INFO:tasks.workunit.client.0.smithi097.stderr: -480> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543e680) adding con mode: crc 2024-09-14T11:05:43.522 INFO:tasks.workunit.client.0.smithi097.stderr: -479> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543e680) adding con mode: secure 2024-09-14T11:05:43.522 INFO:tasks.workunit.client.0.smithi097.stderr: -478> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543e680) adding con mode: crc 2024-09-14T11:05:43.522 INFO:tasks.workunit.client.0.smithi097.stderr: -477> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543e680) adding con mode: secure 2024-09-14T11:05:43.522 INFO:tasks.workunit.client.0.smithi097.stderr: -476> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543e680) adding con mode: crc 2024-09-14T11:05:43.522 INFO:tasks.workunit.client.0.smithi097.stderr: -475> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543e680) adding con mode: secure 2024-09-14T11:05:43.522 INFO:tasks.workunit.client.0.smithi097.stderr: -474> 2024-09-14T11:05:42.980+0000 7f2d7622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:05:43.523 INFO:tasks.workunit.client.0.smithi097.stderr: -473> 2024-09-14T11:05:42.980+0000 7f2d7622f800 1 librados: starting msgr at 2024-09-14T11:05:43.523 INFO:tasks.workunit.client.0.smithi097.stderr: -472> 2024-09-14T11:05:42.980+0000 7f2d7622f800 1 librados: starting objecter 2024-09-14T11:05:43.523 INFO:tasks.workunit.client.0.smithi097.stderr: -471> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 asok(0x55e61521c270) register_command objecter_requests hook 0x55e61543e070 2024-09-14T11:05:43.523 INFO:tasks.workunit.client.0.smithi097.stderr: -470> 2024-09-14T11:05:42.980+0000 7f2d7622f800 1 librados: setting wanted keys 2024-09-14T11:05:43.523 INFO:tasks.workunit.client.0.smithi097.stderr: -469> 2024-09-14T11:05:42.980+0000 7f2d7622f800 1 librados: calling monclient init 2024-09-14T11:05:43.523 INFO:tasks.workunit.client.0.smithi097.stderr: -468> 2024-09-14T11:05:42.980+0000 7f2d7622f800 10 monclient: init 2024-09-14T11:05:43.523 INFO:tasks.workunit.client.0.smithi097.stderr: -467> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543c380) adding auth protocol: cephx 2024-09-14T11:05:43.523 INFO:tasks.workunit.client.0.smithi097.stderr: -466> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543c380) adding auth protocol: cephx 2024-09-14T11:05:43.523 INFO:tasks.workunit.client.0.smithi097.stderr: -465> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543c380) adding auth protocol: cephx 2024-09-14T11:05:43.523 INFO:tasks.workunit.client.0.smithi097.stderr: -464> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543c380) adding con mode: secure 2024-09-14T11:05:43.523 INFO:tasks.workunit.client.0.smithi097.stderr: -463> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543c380) adding con mode: crc 2024-09-14T11:05:43.523 INFO:tasks.workunit.client.0.smithi097.stderr: -462> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543c380) adding con mode: secure 2024-09-14T11:05:43.523 INFO:tasks.workunit.client.0.smithi097.stderr: -461> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543c380) adding con mode: crc 2024-09-14T11:05:43.523 INFO:tasks.workunit.client.0.smithi097.stderr: -460> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543c380) adding con mode: secure 2024-09-14T11:05:43.523 INFO:tasks.workunit.client.0.smithi097.stderr: -459> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543c380) adding con mode: crc 2024-09-14T11:05:43.523 INFO:tasks.workunit.client.0.smithi097.stderr: -458> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543c380) adding con mode: crc 2024-09-14T11:05:43.524 INFO:tasks.workunit.client.0.smithi097.stderr: -457> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543c380) adding con mode: secure 2024-09-14T11:05:43.524 INFO:tasks.workunit.client.0.smithi097.stderr: -456> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543c380) adding con mode: crc 2024-09-14T11:05:43.524 INFO:tasks.workunit.client.0.smithi097.stderr: -455> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543c380) adding con mode: secure 2024-09-14T11:05:43.524 INFO:tasks.workunit.client.0.smithi097.stderr: -454> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543c380) adding con mode: crc 2024-09-14T11:05:43.524 INFO:tasks.workunit.client.0.smithi097.stderr: -453> 2024-09-14T11:05:42.980+0000 7f2d7622f800 5 AuthRegistry(0x55e61543c380) adding con mode: secure 2024-09-14T11:05:43.524 INFO:tasks.workunit.client.0.smithi097.stderr: -452> 2024-09-14T11:05:42.980+0000 7f2d7622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:05:43.524 INFO:tasks.workunit.client.0.smithi097.stderr: -451> 2024-09-14T11:05:42.981+0000 7f2d7622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:05:43.524 INFO:tasks.workunit.client.0.smithi097.stderr: -450> 2024-09-14T11:05:42.981+0000 7f2d7622f800 5 asok(0x55e61521c270) register_command rotate-key hook 0x55e61543c4c8 2024-09-14T11:05:43.524 INFO:tasks.workunit.client.0.smithi097.stderr: -449> 2024-09-14T11:05:42.981+0000 7f2d7622f800 10 monclient: _reopen_session rank -1 2024-09-14T11:05:43.524 INFO:tasks.workunit.client.0.smithi097.stderr: -448> 2024-09-14T11:05:42.981+0000 7f2d7622f800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:05:43.524 INFO:tasks.workunit.client.0.smithi097.stderr: -447> 2024-09-14T11:05:42.981+0000 7f2d7622f800 10 monclient(hunting): picked mon.noname-b con 0x55e6152f3f80 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:05:43.524 INFO:tasks.workunit.client.0.smithi097.stderr: -446> 2024-09-14T11:05:42.981+0000 7f2d7622f800 10 monclient(hunting): picked mon.noname-c con 0x55e615382300 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:05:43.524 INFO:tasks.workunit.client.0.smithi097.stderr: -445> 2024-09-14T11:05:42.981+0000 7f2d7622f800 10 monclient(hunting): picked mon.noname-a con 0x55e615442a50 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:05:43.524 INFO:tasks.workunit.client.0.smithi097.stderr: -444> 2024-09-14T11:05:42.981+0000 7f2d7622f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:05:43.525 INFO:tasks.workunit.client.0.smithi097.stderr: -443> 2024-09-14T11:05:42.981+0000 7f2d7622f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:05:43.525 INFO:tasks.workunit.client.0.smithi097.stderr: -442> 2024-09-14T11:05:42.981+0000 7f2d7622f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:05:43.525 INFO:tasks.workunit.client.0.smithi097.stderr: -441> 2024-09-14T11:05:42.981+0000 7f2d7622f800 10 monclient(hunting): _renew_subs 2024-09-14T11:05:43.525 INFO:tasks.workunit.client.0.smithi097.stderr: -440> 2024-09-14T11:05:42.981+0000 7f2d7622f800 10 monclient(hunting): authenticate will time out at 2024.634257s 2024-09-14T11:05:43.525 INFO:tasks.workunit.client.0.smithi097.stderr: -439> 2024-09-14T11:05:42.981+0000 7f2d7351f640 10 monclient(hunting): get_auth_request con 0x55e615382300 auth_method 0 2024-09-14T11:05:43.525 INFO:tasks.workunit.client.0.smithi097.stderr: -438> 2024-09-14T11:05:42.981+0000 7f2d7351f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:05:43.525 INFO:tasks.workunit.client.0.smithi097.stderr: -437> 2024-09-14T11:05:42.981+0000 7f2d7351f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:05:43.525 INFO:tasks.workunit.client.0.smithi097.stderr: -436> 2024-09-14T11:05:42.981+0000 7f2d7351f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:05:43.525 INFO:tasks.workunit.client.0.smithi097.stderr: -435> 2024-09-14T11:05:42.981+0000 7f2d74521640 10 monclient(hunting): get_auth_request con 0x55e615442a50 auth_method 0 2024-09-14T11:05:43.525 INFO:tasks.workunit.client.0.smithi097.stderr: -434> 2024-09-14T11:05:42.981+0000 7f2d74521640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:05:43.525 INFO:tasks.workunit.client.0.smithi097.stderr: -433> 2024-09-14T11:05:42.981+0000 7f2d74521640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:05:43.525 INFO:tasks.workunit.client.0.smithi097.stderr: -432> 2024-09-14T11:05:42.981+0000 7f2d74521640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:05:43.525 INFO:tasks.workunit.client.0.smithi097.stderr: -431> 2024-09-14T11:05:42.981+0000 7f2d7351f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:05:43.526 INFO:tasks.workunit.client.0.smithi097.stderr: -430> 2024-09-14T11:05:42.981+0000 7f2d7351f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:05:43.526 INFO:tasks.workunit.client.0.smithi097.stderr: -429> 2024-09-14T11:05:42.981+0000 7f2d7351f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:05:43.526 INFO:tasks.workunit.client.0.smithi097.stderr: -428> 2024-09-14T11:05:42.981+0000 7f2d74521640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:05:43.526 INFO:tasks.workunit.client.0.smithi097.stderr: -427> 2024-09-14T11:05:42.981+0000 7f2d74521640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:05:43.526 INFO:tasks.workunit.client.0.smithi097.stderr: -426> 2024-09-14T11:05:42.981+0000 7f2d74521640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:05:43.526 INFO:tasks.workunit.client.0.smithi097.stderr: -425> 2024-09-14T11:05:42.981+0000 7f2d73d20640 10 monclient(hunting): get_auth_request con 0x55e6152f3f80 auth_method 0 2024-09-14T11:05:43.526 INFO:tasks.workunit.client.0.smithi097.stderr: -424> 2024-09-14T11:05:42.981+0000 7f2d73d20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:05:43.526 INFO:tasks.workunit.client.0.smithi097.stderr: -423> 2024-09-14T11:05:42.981+0000 7f2d73d20640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:05:43.526 INFO:tasks.workunit.client.0.smithi097.stderr: -422> 2024-09-14T11:05:42.981+0000 7f2d73d20640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:05:43.526 INFO:tasks.workunit.client.0.smithi097.stderr: -421> 2024-09-14T11:05:42.981+0000 7f2d73d20640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:05:43.526 INFO:tasks.workunit.client.0.smithi097.stderr: -420> 2024-09-14T11:05:42.981+0000 7f2d73d20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:05:43.526 INFO:tasks.workunit.client.0.smithi097.stderr: -419> 2024-09-14T11:05:42.981+0000 7f2d73d20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:05:43.526 INFO:tasks.workunit.client.0.smithi097.stderr: -418> 2024-09-14T11:05:42.981+0000 7f2d7351f640 10 monclient(hunting): handle_auth_done global_id 7112 payload 824 2024-09-14T11:05:43.526 INFO:tasks.workunit.client.0.smithi097.stderr: -417> 2024-09-14T11:05:42.981+0000 7f2d7351f640 10 monclient: _finish_hunting 0 2024-09-14T11:05:43.527 INFO:tasks.workunit.client.0.smithi097.stderr: -416> 2024-09-14T11:05:42.981+0000 7f2d7351f640 1 monclient: found mon.noname-c 2024-09-14T11:05:43.527 INFO:tasks.workunit.client.0.smithi097.stderr: -415> 2024-09-14T11:05:42.981+0000 7f2d7351f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:05:43.527 INFO:tasks.workunit.client.0.smithi097.stderr: -414> 2024-09-14T11:05:42.981+0000 7f2c5bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:05:43.527 INFO:tasks.workunit.client.0.smithi097.stderr: -413> 2024-09-14T11:05:42.981+0000 7f2c5bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:05:43.527 INFO:tasks.workunit.client.0.smithi097.stderr: -412> 2024-09-14T11:05:42.981+0000 7f2c5bfff640 10 monclient: dump: 2024-09-14T11:05:43.527 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:05:43.527 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:05:43.527 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:43.527 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:43.527 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:05:43.527 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:05:43.527 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:05:43.527 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:05:43.527 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:05:43.528 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:43.528 INFO:tasks.workunit.client.0.smithi097.stderr: -411> 2024-09-14T11:05:42.981+0000 7f2c5bfff640 10 monclient: _finish_auth 0 2024-09-14T11:05:43.528 INFO:tasks.workunit.client.0.smithi097.stderr: -410> 2024-09-14T11:05:42.981+0000 7f2c5bfff640 10 monclient: _check_auth_tickets 2024-09-14T11:05:43.528 INFO:tasks.workunit.client.0.smithi097.stderr: -409> 2024-09-14T11:05:42.981+0000 7f2c5bfff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:05:43.528 INFO:tasks.workunit.client.0.smithi097.stderr: -408> 2024-09-14T11:05:42.981+0000 7f2c5bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:05:43.528 INFO:tasks.workunit.client.0.smithi097.stderr: -407> 2024-09-14T11:05:42.981+0000 7f2c5bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:05:43.528 INFO:tasks.workunit.client.0.smithi097.stderr: -406> 2024-09-14T11:05:42.981+0000 7f2c5bfff640 10 monclient: dump: 2024-09-14T11:05:43.528 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:05:43.528 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:05:43.528 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:43.528 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:43.528 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:05:43.528 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:05:43.528 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:05:43.529 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:05:43.529 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:05:43.529 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:43.529 INFO:tasks.workunit.client.0.smithi097.stderr: -405> 2024-09-14T11:05:42.981+0000 7f2d7622f800 5 monclient: authenticate success, global_id 7112 2024-09-14T11:05:43.529 INFO:tasks.workunit.client.0.smithi097.stderr: -404> 2024-09-14T11:05:42.981+0000 7f2d7622f800 10 monclient: _renew_subs 2024-09-14T11:05:43.529 INFO:tasks.workunit.client.0.smithi097.stderr: -403> 2024-09-14T11:05:42.981+0000 7f2d7622f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:05:43.529 INFO:tasks.workunit.client.0.smithi097.stderr: -402> 2024-09-14T11:05:42.981+0000 7f2c61e0b640 4 set_mon_vals no callback set 2024-09-14T11:05:43.529 INFO:tasks.workunit.client.0.smithi097.stderr: -401> 2024-09-14T11:05:42.982+0000 7f2d7622f800 10 monclient: _renew_subs 2024-09-14T11:05:43.529 INFO:tasks.workunit.client.0.smithi097.stderr: -400> 2024-09-14T11:05:42.982+0000 7f2d7622f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:05:43.529 INFO:tasks.workunit.client.0.smithi097.stderr: -399> 2024-09-14T11:05:42.982+0000 7f2d7622f800 1 librados: init done 2024-09-14T11:05:43.529 INFO:tasks.workunit.client.0.smithi097.stderr: -398> 2024-09-14T11:05:42.984+0000 7f2c5bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:05:43.529 INFO:tasks.workunit.client.0.smithi097.stderr: -397> 2024-09-14T11:05:42.984+0000 7f2c5bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:05:43.529 INFO:tasks.workunit.client.0.smithi097.stderr: -396> 2024-09-14T11:05:42.984+0000 7f2c5bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:05:43.529 INFO:tasks.workunit.client.0.smithi097.stderr: -395> 2024-09-14T11:05:42.984+0000 7f2d73d20640 10 monclient: get_auth_request con 0x7f2c5c077230 auth_method 0 2024-09-14T11:05:43.529 INFO:tasks.workunit.client.0.smithi097.stderr: -394> 2024-09-14T11:05:42.984+0000 7f2d74521640 10 monclient: get_auth_request con 0x55e615465290 auth_method 0 2024-09-14T11:05:43.530 INFO:tasks.workunit.client.0.smithi097.stderr: -393> 2024-09-14T11:05:42.985+0000 7f2d73d20640 10 monclient: get_auth_request con 0x55e615488090 auth_method 0 2024-09-14T11:05:43.530 INFO:tasks.workunit.client.0.smithi097.stderr: -392> 2024-09-14T11:05:42.986+0000 7f2d7351f640 10 monclient: get_auth_request con 0x55e61548c3f0 auth_method 0 2024-09-14T11:05:43.530 INFO:tasks.workunit.client.0.smithi097.stderr: -391> 2024-09-14T11:05:42.987+0000 7f2d74521640 10 monclient: get_auth_request con 0x55e61548b8c0 auth_method 0 2024-09-14T11:05:43.530 INFO:tasks.workunit.client.0.smithi097.stderr: -390> 2024-09-14T11:05:42.987+0000 7f2d7622f800 10 monclient: build_initial_monmap 2024-09-14T11:05:43.530 INFO:tasks.workunit.client.0.smithi097.stderr: -389> 2024-09-14T11:05:42.987+0000 7f2d7622f800 1 build_initial for_mkfs: 0 2024-09-14T11:05:43.530 INFO:tasks.workunit.client.0.smithi097.stderr: -388> 2024-09-14T11:05:42.987+0000 7f2d7622f800 10 monclient: monmap: 2024-09-14T11:05:43.530 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:05:43.530 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:05:43.530 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:05:43.530 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:05:43.530 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:05:43.530 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:05:43.530 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:05:43.530 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:05:43.530 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:05:43.531 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:43.531 INFO:tasks.workunit.client.0.smithi097.stderr: -387> 2024-09-14T11:05:42.987+0000 7f2d7622f800 5 AuthRegistry(0x55e615494530) adding auth protocol: cephx 2024-09-14T11:05:43.531 INFO:tasks.workunit.client.0.smithi097.stderr: -386> 2024-09-14T11:05:42.987+0000 7f2d7622f800 5 AuthRegistry(0x55e615494530) adding auth protocol: cephx 2024-09-14T11:05:43.531 INFO:tasks.workunit.client.0.smithi097.stderr: -385> 2024-09-14T11:05:42.987+0000 7f2d7622f800 5 AuthRegistry(0x55e615494530) adding auth protocol: cephx 2024-09-14T11:05:43.531 INFO:tasks.workunit.client.0.smithi097.stderr: -384> 2024-09-14T11:05:42.987+0000 7f2d7622f800 5 AuthRegistry(0x55e615494530) adding con mode: secure 2024-09-14T11:05:43.531 INFO:tasks.workunit.client.0.smithi097.stderr: -383> 2024-09-14T11:05:42.987+0000 7f2d7622f800 5 AuthRegistry(0x55e615494530) adding con mode: crc 2024-09-14T11:05:43.531 INFO:tasks.workunit.client.0.smithi097.stderr: -382> 2024-09-14T11:05:42.987+0000 7f2d7622f800 5 AuthRegistry(0x55e615494530) adding con mode: secure 2024-09-14T11:05:43.531 INFO:tasks.workunit.client.0.smithi097.stderr: -381> 2024-09-14T11:05:42.987+0000 7f2d7622f800 5 AuthRegistry(0x55e615494530) adding con mode: crc 2024-09-14T11:05:43.531 INFO:tasks.workunit.client.0.smithi097.stderr: -380> 2024-09-14T11:05:42.987+0000 7f2d7622f800 5 AuthRegistry(0x55e615494530) adding con mode: secure 2024-09-14T11:05:43.531 INFO:tasks.workunit.client.0.smithi097.stderr: -379> 2024-09-14T11:05:42.987+0000 7f2d7622f800 5 AuthRegistry(0x55e615494530) adding con mode: crc 2024-09-14T11:05:43.531 INFO:tasks.workunit.client.0.smithi097.stderr: -378> 2024-09-14T11:05:42.987+0000 7f2d7622f800 5 AuthRegistry(0x55e615494530) adding con mode: crc 2024-09-14T11:05:43.531 INFO:tasks.workunit.client.0.smithi097.stderr: -377> 2024-09-14T11:05:42.987+0000 7f2d7622f800 5 AuthRegistry(0x55e615494530) adding con mode: secure 2024-09-14T11:05:43.531 INFO:tasks.workunit.client.0.smithi097.stderr: -376> 2024-09-14T11:05:42.987+0000 7f2d7622f800 5 AuthRegistry(0x55e615494530) adding con mode: crc 2024-09-14T11:05:43.531 INFO:tasks.workunit.client.0.smithi097.stderr: -375> 2024-09-14T11:05:42.987+0000 7f2d7622f800 5 AuthRegistry(0x55e615494530) adding con mode: secure 2024-09-14T11:05:43.531 INFO:tasks.workunit.client.0.smithi097.stderr: -374> 2024-09-14T11:05:42.987+0000 7f2d7622f800 5 AuthRegistry(0x55e615494530) adding con mode: crc 2024-09-14T11:05:43.532 INFO:tasks.workunit.client.0.smithi097.stderr: -373> 2024-09-14T11:05:42.987+0000 7f2d7622f800 5 AuthRegistry(0x55e615494530) adding con mode: secure 2024-09-14T11:05:43.532 INFO:tasks.workunit.client.0.smithi097.stderr: -372> 2024-09-14T11:05:42.988+0000 7f2d7622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:05:43.532 INFO:tasks.workunit.client.0.smithi097.stderr: -371> 2024-09-14T11:05:42.988+0000 7f2d7622f800 5 asok(0x55e61521c270) register_command objecter_requests cmddesc objecter_requests hook 0x55e615497a00 EEXIST 2024-09-14T11:05:43.532 INFO:tasks.workunit.client.0.smithi097.stderr: -370> 2024-09-14T11:05:42.988+0000 7f2d7622f800 10 monclient: init 2024-09-14T11:05:43.532 INFO:tasks.workunit.client.0.smithi097.stderr: -369> 2024-09-14T11:05:42.988+0000 7f2d7622f800 5 AuthRegistry(0x55e615493428) adding auth protocol: cephx 2024-09-14T11:05:43.532 INFO:tasks.workunit.client.0.smithi097.stderr: -368> 2024-09-14T11:05:42.988+0000 7f2d7622f800 5 AuthRegistry(0x55e615493428) adding auth protocol: cephx 2024-09-14T11:05:43.532 INFO:tasks.workunit.client.0.smithi097.stderr: -367> 2024-09-14T11:05:42.988+0000 7f2d7622f800 5 AuthRegistry(0x55e615493428) adding auth protocol: cephx 2024-09-14T11:05:43.532 INFO:tasks.workunit.client.0.smithi097.stderr: -366> 2024-09-14T11:05:42.988+0000 7f2d7622f800 5 AuthRegistry(0x55e615493428) adding con mode: secure 2024-09-14T11:05:43.532 INFO:tasks.workunit.client.0.smithi097.stderr: -365> 2024-09-14T11:05:42.988+0000 7f2d7622f800 5 AuthRegistry(0x55e615493428) adding con mode: crc 2024-09-14T11:05:43.532 INFO:tasks.workunit.client.0.smithi097.stderr: -364> 2024-09-14T11:05:42.988+0000 7f2d7622f800 5 AuthRegistry(0x55e615493428) adding con mode: secure 2024-09-14T11:05:43.532 INFO:tasks.workunit.client.0.smithi097.stderr: -363> 2024-09-14T11:05:42.988+0000 7f2d7622f800 5 AuthRegistry(0x55e615493428) adding con mode: crc 2024-09-14T11:05:43.532 INFO:tasks.workunit.client.0.smithi097.stderr: -362> 2024-09-14T11:05:42.988+0000 7f2d7622f800 5 AuthRegistry(0x55e615493428) adding con mode: secure 2024-09-14T11:05:43.532 INFO:tasks.workunit.client.0.smithi097.stderr: -361> 2024-09-14T11:05:42.988+0000 7f2d7622f800 5 AuthRegistry(0x55e615493428) adding con mode: crc 2024-09-14T11:05:43.533 INFO:tasks.workunit.client.0.smithi097.stderr: -360> 2024-09-14T11:05:42.988+0000 7f2d7622f800 5 AuthRegistry(0x55e615493428) adding con mode: crc 2024-09-14T11:05:43.533 INFO:tasks.workunit.client.0.smithi097.stderr: -359> 2024-09-14T11:05:42.988+0000 7f2d7622f800 5 AuthRegistry(0x55e615493428) adding con mode: secure 2024-09-14T11:05:43.533 INFO:tasks.workunit.client.0.smithi097.stderr: -358> 2024-09-14T11:05:42.988+0000 7f2d7622f800 5 AuthRegistry(0x55e615493428) adding con mode: crc 2024-09-14T11:05:43.533 INFO:tasks.workunit.client.0.smithi097.stderr: -357> 2024-09-14T11:05:42.988+0000 7f2d7622f800 5 AuthRegistry(0x55e615493428) adding con mode: secure 2024-09-14T11:05:43.533 INFO:tasks.workunit.client.0.smithi097.stderr: -356> 2024-09-14T11:05:42.988+0000 7f2d7622f800 5 AuthRegistry(0x55e615493428) adding con mode: crc 2024-09-14T11:05:43.533 INFO:tasks.workunit.client.0.smithi097.stderr: -355> 2024-09-14T11:05:42.988+0000 7f2d7622f800 5 AuthRegistry(0x55e615493428) adding con mode: secure 2024-09-14T11:05:43.533 INFO:tasks.workunit.client.0.smithi097.stderr: -354> 2024-09-14T11:05:42.988+0000 7f2d7622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:05:43.533 INFO:tasks.workunit.client.0.smithi097.stderr: -353> 2024-09-14T11:05:42.988+0000 7f2d7622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:05:43.533 INFO:tasks.workunit.client.0.smithi097.stderr: -352> 2024-09-14T11:05:42.988+0000 7f2d7622f800 5 asok(0x55e61521c270) register_command rotate-key cmddesc rotate-key hook 0x55e615493570 EEXIST 2024-09-14T11:05:43.533 INFO:tasks.workunit.client.0.smithi097.stderr: -351> 2024-09-14T11:05:42.988+0000 7f2d7622f800 10 monclient: _reopen_session rank -1 2024-09-14T11:05:43.533 INFO:tasks.workunit.client.0.smithi097.stderr: -350> 2024-09-14T11:05:42.988+0000 7f2d7622f800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:05:43.533 INFO:tasks.workunit.client.0.smithi097.stderr: -349> 2024-09-14T11:05:42.988+0000 7f2d7622f800 10 monclient(hunting): picked mon.noname-c con 0x55e6154bbd20 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:05:43.533 INFO:tasks.workunit.client.0.smithi097.stderr: -348> 2024-09-14T11:05:42.988+0000 7f2d7622f800 10 monclient(hunting): picked mon.noname-b con 0x55e6154bc100 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:05:43.534 INFO:tasks.workunit.client.0.smithi097.stderr: -347> 2024-09-14T11:05:42.988+0000 7f2d7622f800 10 monclient(hunting): picked mon.noname-a con 0x55e6154baa30 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:05:43.534 INFO:tasks.workunit.client.0.smithi097.stderr: -346> 2024-09-14T11:05:42.988+0000 7f2d7622f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:05:43.534 INFO:tasks.workunit.client.0.smithi097.stderr: -345> 2024-09-14T11:05:42.988+0000 7f2d7622f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:05:43.534 INFO:tasks.workunit.client.0.smithi097.stderr: -344> 2024-09-14T11:05:42.988+0000 7f2d7622f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:05:43.534 INFO:tasks.workunit.client.0.smithi097.stderr: -343> 2024-09-14T11:05:42.988+0000 7f2d7622f800 10 monclient(hunting): _renew_subs 2024-09-14T11:05:43.534 INFO:tasks.workunit.client.0.smithi097.stderr: -342> 2024-09-14T11:05:42.988+0000 7f2d7622f800 10 monclient(hunting): authenticate will time out at 2024.641860s 2024-09-14T11:05:43.534 INFO:tasks.workunit.client.0.smithi097.stderr: -341> 2024-09-14T11:05:42.988+0000 7f2d7351f640 10 monclient(hunting): get_auth_request con 0x55e6154bbd20 auth_method 0 2024-09-14T11:05:43.534 INFO:tasks.workunit.client.0.smithi097.stderr: -340> 2024-09-14T11:05:42.988+0000 7f2d7351f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:05:43.534 INFO:tasks.workunit.client.0.smithi097.stderr: -339> 2024-09-14T11:05:42.988+0000 7f2d7351f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:05:43.534 INFO:tasks.workunit.client.0.smithi097.stderr: -338> 2024-09-14T11:05:42.988+0000 7f2d7351f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:05:43.534 INFO:tasks.workunit.client.0.smithi097.stderr: -337> 2024-09-14T11:05:42.988+0000 7f2d73d20640 10 monclient(hunting): get_auth_request con 0x55e6154baa30 auth_method 0 2024-09-14T11:05:43.534 INFO:tasks.workunit.client.0.smithi097.stderr: -336> 2024-09-14T11:05:42.989+0000 7f2d73d20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:05:43.534 INFO:tasks.workunit.client.0.smithi097.stderr: -335> 2024-09-14T11:05:42.989+0000 7f2d73d20640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:05:43.534 INFO:tasks.workunit.client.0.smithi097.stderr: -334> 2024-09-14T11:05:42.989+0000 7f2d73d20640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:05:43.535 INFO:tasks.workunit.client.0.smithi097.stderr: -333> 2024-09-14T11:05:42.989+0000 7f2d74521640 10 monclient(hunting): get_auth_request con 0x55e6154bc100 auth_method 0 2024-09-14T11:05:43.535 INFO:tasks.workunit.client.0.smithi097.stderr: -332> 2024-09-14T11:05:42.989+0000 7f2d74521640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:05:43.535 INFO:tasks.workunit.client.0.smithi097.stderr: -331> 2024-09-14T11:05:42.989+0000 7f2d74521640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:05:43.535 INFO:tasks.workunit.client.0.smithi097.stderr: -330> 2024-09-14T11:05:42.989+0000 7f2d74521640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:05:43.535 INFO:tasks.workunit.client.0.smithi097.stderr: -329> 2024-09-14T11:05:42.989+0000 7f2d7351f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:05:43.535 INFO:tasks.workunit.client.0.smithi097.stderr: -328> 2024-09-14T11:05:42.989+0000 7f2d7351f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:05:43.535 INFO:tasks.workunit.client.0.smithi097.stderr: -327> 2024-09-14T11:05:42.989+0000 7f2d7351f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:05:43.535 INFO:tasks.workunit.client.0.smithi097.stderr: -326> 2024-09-14T11:05:42.989+0000 7f2d73d20640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:05:43.535 INFO:tasks.workunit.client.0.smithi097.stderr: -325> 2024-09-14T11:05:42.989+0000 7f2d73d20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:05:43.535 INFO:tasks.workunit.client.0.smithi097.stderr: -324> 2024-09-14T11:05:42.989+0000 7f2d73d20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:05:43.535 INFO:tasks.workunit.client.0.smithi097.stderr: -323> 2024-09-14T11:05:42.989+0000 7f2d74521640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:05:43.535 INFO:tasks.workunit.client.0.smithi097.stderr: -322> 2024-09-14T11:05:42.989+0000 7f2d74521640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:05:43.535 INFO:tasks.workunit.client.0.smithi097.stderr: -321> 2024-09-14T11:05:42.989+0000 7f2d74521640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:05:43.535 INFO:tasks.workunit.client.0.smithi097.stderr: -320> 2024-09-14T11:05:42.989+0000 7f2d7351f640 10 monclient(hunting): handle_auth_done global_id 7115 payload 824 2024-09-14T11:05:43.535 INFO:tasks.workunit.client.0.smithi097.stderr: -319> 2024-09-14T11:05:42.989+0000 7f2d7351f640 10 monclient: _finish_hunting 0 2024-09-14T11:05:43.536 INFO:tasks.workunit.client.0.smithi097.stderr: -318> 2024-09-14T11:05:42.989+0000 7f2d7351f640 1 monclient: found mon.noname-c 2024-09-14T11:05:43.536 INFO:tasks.workunit.client.0.smithi097.stderr: -317> 2024-09-14T11:05:42.989+0000 7f2d7351f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:05:43.536 INFO:tasks.workunit.client.0.smithi097.stderr: -316> 2024-09-14T11:05:42.989+0000 7f2c597fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:05:43.536 INFO:tasks.workunit.client.0.smithi097.stderr: -315> 2024-09-14T11:05:42.989+0000 7f2c597fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:05:43.536 INFO:tasks.workunit.client.0.smithi097.stderr: -314> 2024-09-14T11:05:42.989+0000 7f2c597fa640 10 monclient: dump: 2024-09-14T11:05:43.536 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:05:43.536 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:05:43.536 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:43.536 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:43.536 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:05:43.536 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:05:43.536 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:05:43.536 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:05:43.537 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:05:43.537 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:43.537 INFO:tasks.workunit.client.0.smithi097.stderr: -313> 2024-09-14T11:05:42.989+0000 7f2c597fa640 10 monclient: _finish_auth 0 2024-09-14T11:05:43.537 INFO:tasks.workunit.client.0.smithi097.stderr: -312> 2024-09-14T11:05:42.989+0000 7f2c597fa640 10 monclient: _check_auth_tickets 2024-09-14T11:05:43.537 INFO:tasks.workunit.client.0.smithi097.stderr: -311> 2024-09-14T11:05:42.989+0000 7f2c597fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:05:43.537 INFO:tasks.workunit.client.0.smithi097.stderr: -310> 2024-09-14T11:05:42.989+0000 7f2c597fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:05:43.537 INFO:tasks.workunit.client.0.smithi097.stderr: -309> 2024-09-14T11:05:42.989+0000 7f2c597fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:05:43.537 INFO:tasks.workunit.client.0.smithi097.stderr: -308> 2024-09-14T11:05:42.989+0000 7f2c597fa640 10 monclient: dump: 2024-09-14T11:05:43.537 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:05:43.537 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:05:43.537 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:43.537 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:43.537 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:05:43.538 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:05:43.538 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:05:43.538 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:05:43.538 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:05:43.538 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:43.538 INFO:tasks.workunit.client.0.smithi097.stderr: -307> 2024-09-14T11:05:42.989+0000 7f2d7622f800 5 monclient: authenticate success, global_id 7115 2024-09-14T11:05:43.538 INFO:tasks.workunit.client.0.smithi097.stderr: -306> 2024-09-14T11:05:42.989+0000 7f2d7622f800 10 monclient: _renew_subs 2024-09-14T11:05:43.538 INFO:tasks.workunit.client.0.smithi097.stderr: -305> 2024-09-14T11:05:42.989+0000 7f2d7622f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:05:43.538 INFO:tasks.workunit.client.0.smithi097.stderr: -304> 2024-09-14T11:05:42.989+0000 7f2d74d22640 4 set_mon_vals no callback set 2024-09-14T11:05:43.538 INFO:tasks.workunit.client.0.smithi097.stderr: -303> 2024-09-14T11:05:42.989+0000 7f2d7622f800 10 monclient: _renew_subs 2024-09-14T11:05:43.538 INFO:tasks.workunit.client.0.smithi097.stderr: -302> 2024-09-14T11:05:42.989+0000 7f2d7622f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:05:43.538 INFO:tasks.workunit.client.0.smithi097.stderr: -301> 2024-09-14T11:05:42.991+0000 7f2c597fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:05:43.538 INFO:tasks.workunit.client.0.smithi097.stderr: -300> 2024-09-14T11:05:42.991+0000 7f2c597fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:05:43.538 INFO:tasks.workunit.client.0.smithi097.stderr: -299> 2024-09-14T11:05:42.991+0000 7f2c597fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:05:43.539 INFO:tasks.workunit.client.0.smithi097.stderr: -298> 2024-09-14T11:05:42.991+0000 7f2d74521640 10 monclient: get_auth_request con 0x7f2c4c077140 auth_method 0 2024-09-14T11:05:43.539 INFO:tasks.workunit.client.0.smithi097.stderr: -297> 2024-09-14T11:05:42.991+0000 7f2d7622f800 10 monclient: get_monmap_and_config 2024-09-14T11:05:43.539 INFO:tasks.workunit.client.0.smithi097.stderr: -296> 2024-09-14T11:05:42.991+0000 7f2d7622f800 10 monclient: build_initial_monmap 2024-09-14T11:05:43.539 INFO:tasks.workunit.client.0.smithi097.stderr: -295> 2024-09-14T11:05:42.991+0000 7f2d7622f800 1 build_initial for_mkfs: 0 2024-09-14T11:05:43.539 INFO:tasks.workunit.client.0.smithi097.stderr: -294> 2024-09-14T11:05:42.991+0000 7f2d7622f800 10 monclient: monmap: 2024-09-14T11:05:43.539 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:05:43.539 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:05:43.539 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:05:43.539 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:05:43.539 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:05:43.539 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:05:43.539 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:05:43.539 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:05:43.539 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:05:43.539 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:43.540 INFO:tasks.workunit.client.0.smithi097.stderr: -293> 2024-09-14T11:05:42.991+0000 7f2d7622f800 5 AuthRegistry(0x55e6154db840) adding auth protocol: cephx 2024-09-14T11:05:43.540 INFO:tasks.workunit.client.0.smithi097.stderr: -292> 2024-09-14T11:05:42.991+0000 7f2d7622f800 5 AuthRegistry(0x55e6154db840) adding auth protocol: cephx 2024-09-14T11:05:43.540 INFO:tasks.workunit.client.0.smithi097.stderr: -291> 2024-09-14T11:05:42.991+0000 7f2d7622f800 5 AuthRegistry(0x55e6154db840) adding auth protocol: cephx 2024-09-14T11:05:43.540 INFO:tasks.workunit.client.0.smithi097.stderr: -290> 2024-09-14T11:05:42.991+0000 7f2d7622f800 5 AuthRegistry(0x55e6154db840) adding con mode: secure 2024-09-14T11:05:43.540 INFO:tasks.workunit.client.0.smithi097.stderr: -289> 2024-09-14T11:05:42.991+0000 7f2d7622f800 5 AuthRegistry(0x55e6154db840) adding con mode: crc 2024-09-14T11:05:43.540 INFO:tasks.workunit.client.0.smithi097.stderr: -288> 2024-09-14T11:05:42.991+0000 7f2d7622f800 5 AuthRegistry(0x55e6154db840) adding con mode: secure 2024-09-14T11:05:43.540 INFO:tasks.workunit.client.0.smithi097.stderr: -287> 2024-09-14T11:05:42.991+0000 7f2d7622f800 5 AuthRegistry(0x55e6154db840) adding con mode: crc 2024-09-14T11:05:43.540 INFO:tasks.workunit.client.0.smithi097.stderr: -286> 2024-09-14T11:05:42.991+0000 7f2d7622f800 5 AuthRegistry(0x55e6154db840) adding con mode: secure 2024-09-14T11:05:43.540 INFO:tasks.workunit.client.0.smithi097.stderr: -285> 2024-09-14T11:05:42.991+0000 7f2d7622f800 5 AuthRegistry(0x55e6154db840) adding con mode: crc 2024-09-14T11:05:43.540 INFO:tasks.workunit.client.0.smithi097.stderr: -284> 2024-09-14T11:05:42.991+0000 7f2d7622f800 5 AuthRegistry(0x55e6154db840) adding con mode: crc 2024-09-14T11:05:43.540 INFO:tasks.workunit.client.0.smithi097.stderr: -283> 2024-09-14T11:05:42.991+0000 7f2d7622f800 5 AuthRegistry(0x55e6154db840) adding con mode: secure 2024-09-14T11:05:43.540 INFO:tasks.workunit.client.0.smithi097.stderr: -282> 2024-09-14T11:05:42.991+0000 7f2d7622f800 5 AuthRegistry(0x55e6154db840) adding con mode: crc 2024-09-14T11:05:43.540 INFO:tasks.workunit.client.0.smithi097.stderr: -281> 2024-09-14T11:05:42.991+0000 7f2d7622f800 5 AuthRegistry(0x55e6154db840) adding con mode: secure 2024-09-14T11:05:43.541 INFO:tasks.workunit.client.0.smithi097.stderr: -280> 2024-09-14T11:05:42.991+0000 7f2d7622f800 5 AuthRegistry(0x55e6154db840) adding con mode: crc 2024-09-14T11:05:43.541 INFO:tasks.workunit.client.0.smithi097.stderr: -279> 2024-09-14T11:05:42.991+0000 7f2d7622f800 5 AuthRegistry(0x55e6154db840) adding con mode: secure 2024-09-14T11:05:43.541 INFO:tasks.workunit.client.0.smithi097.stderr: -278> 2024-09-14T11:05:42.992+0000 7f2d7622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:05:43.541 INFO:tasks.workunit.client.0.smithi097.stderr: -277> 2024-09-14T11:05:42.992+0000 7f2d7622f800 10 monclient: init 2024-09-14T11:05:43.541 INFO:tasks.workunit.client.0.smithi097.stderr: -276> 2024-09-14T11:05:42.992+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395e7b0) adding auth protocol: cephx 2024-09-14T11:05:43.541 INFO:tasks.workunit.client.0.smithi097.stderr: -275> 2024-09-14T11:05:42.992+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395e7b0) adding auth protocol: cephx 2024-09-14T11:05:43.541 INFO:tasks.workunit.client.0.smithi097.stderr: -274> 2024-09-14T11:05:42.992+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395e7b0) adding auth protocol: cephx 2024-09-14T11:05:43.541 INFO:tasks.workunit.client.0.smithi097.stderr: -273> 2024-09-14T11:05:42.992+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395e7b0) adding con mode: secure 2024-09-14T11:05:43.541 INFO:tasks.workunit.client.0.smithi097.stderr: -272> 2024-09-14T11:05:42.992+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395e7b0) adding con mode: crc 2024-09-14T11:05:43.541 INFO:tasks.workunit.client.0.smithi097.stderr: -271> 2024-09-14T11:05:42.992+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395e7b0) adding con mode: secure 2024-09-14T11:05:43.541 INFO:tasks.workunit.client.0.smithi097.stderr: -270> 2024-09-14T11:05:42.992+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395e7b0) adding con mode: crc 2024-09-14T11:05:43.541 INFO:tasks.workunit.client.0.smithi097.stderr: -269> 2024-09-14T11:05:42.992+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395e7b0) adding con mode: secure 2024-09-14T11:05:43.541 INFO:tasks.workunit.client.0.smithi097.stderr: -268> 2024-09-14T11:05:42.992+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395e7b0) adding con mode: crc 2024-09-14T11:05:43.542 INFO:tasks.workunit.client.0.smithi097.stderr: -267> 2024-09-14T11:05:42.992+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395e7b0) adding con mode: crc 2024-09-14T11:05:43.542 INFO:tasks.workunit.client.0.smithi097.stderr: -266> 2024-09-14T11:05:42.992+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395e7b0) adding con mode: secure 2024-09-14T11:05:43.542 INFO:tasks.workunit.client.0.smithi097.stderr: -265> 2024-09-14T11:05:42.992+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395e7b0) adding con mode: crc 2024-09-14T11:05:43.542 INFO:tasks.workunit.client.0.smithi097.stderr: -264> 2024-09-14T11:05:42.992+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395e7b0) adding con mode: secure 2024-09-14T11:05:43.542 INFO:tasks.workunit.client.0.smithi097.stderr: -263> 2024-09-14T11:05:42.992+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395e7b0) adding con mode: crc 2024-09-14T11:05:43.542 INFO:tasks.workunit.client.0.smithi097.stderr: -262> 2024-09-14T11:05:42.992+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395e7b0) adding con mode: secure 2024-09-14T11:05:43.542 INFO:tasks.workunit.client.0.smithi097.stderr: -261> 2024-09-14T11:05:42.992+0000 7f2d7622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:05:43.542 INFO:tasks.workunit.client.0.smithi097.stderr: -260> 2024-09-14T11:05:42.992+0000 7f2d7622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:05:43.542 INFO:tasks.workunit.client.0.smithi097.stderr: -259> 2024-09-14T11:05:42.992+0000 7f2d7622f800 5 asok(0x55e61521c270) register_command rotate-key cmddesc rotate-key hook 0x7ffdf395e8f8 EEXIST 2024-09-14T11:05:43.542 INFO:tasks.workunit.client.0.smithi097.stderr: -258> 2024-09-14T11:05:42.992+0000 7f2d7622f800 10 monclient: _reopen_session rank -1 2024-09-14T11:05:43.542 INFO:tasks.workunit.client.0.smithi097.stderr: -257> 2024-09-14T11:05:42.992+0000 7f2d7622f800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:05:43.542 INFO:tasks.workunit.client.0.smithi097.stderr: -256> 2024-09-14T11:05:42.992+0000 7f2d7622f800 10 monclient(hunting): picked mon.noname-c con 0x55e61550fea0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:05:43.542 INFO:tasks.workunit.client.0.smithi097.stderr: -255> 2024-09-14T11:05:42.992+0000 7f2d7622f800 10 monclient(hunting): picked mon.noname-b con 0x55e6154e0eb0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:05:43.543 INFO:tasks.workunit.client.0.smithi097.stderr: -254> 2024-09-14T11:05:42.992+0000 7f2d7622f800 10 monclient(hunting): picked mon.noname-a con 0x55e61550b380 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:05:43.543 INFO:tasks.workunit.client.0.smithi097.stderr: -253> 2024-09-14T11:05:42.992+0000 7f2d7622f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:05:43.543 INFO:tasks.workunit.client.0.smithi097.stderr: -252> 2024-09-14T11:05:42.992+0000 7f2d7622f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:05:43.543 INFO:tasks.workunit.client.0.smithi097.stderr: -251> 2024-09-14T11:05:42.992+0000 7f2d7622f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:05:43.543 INFO:tasks.workunit.client.0.smithi097.stderr: -250> 2024-09-14T11:05:42.992+0000 7f2d7622f800 10 monclient(hunting): _renew_subs 2024-09-14T11:05:43.543 INFO:tasks.workunit.client.0.smithi097.stderr: -249> 2024-09-14T11:05:42.992+0000 7f2d7622f800 10 monclient(hunting): authenticate will time out at 2024.645635s 2024-09-14T11:05:43.543 INFO:tasks.workunit.client.0.smithi097.stderr: -248> 2024-09-14T11:05:42.992+0000 7f2d7351f640 10 monclient(hunting): get_auth_request con 0x55e61550fea0 auth_method 0 2024-09-14T11:05:43.543 INFO:tasks.workunit.client.0.smithi097.stderr: -247> 2024-09-14T11:05:42.992+0000 7f2d7351f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:05:43.543 INFO:tasks.workunit.client.0.smithi097.stderr: -246> 2024-09-14T11:05:42.992+0000 7f2d7351f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:05:43.543 INFO:tasks.workunit.client.0.smithi097.stderr: -245> 2024-09-14T11:05:42.992+0000 7f2d7351f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:05:43.543 INFO:tasks.workunit.client.0.smithi097.stderr: -244> 2024-09-14T11:05:42.992+0000 7f2d73d20640 10 monclient(hunting): get_auth_request con 0x55e61550b380 auth_method 0 2024-09-14T11:05:43.543 INFO:tasks.workunit.client.0.smithi097.stderr: -243> 2024-09-14T11:05:42.992+0000 7f2d73d20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:05:43.543 INFO:tasks.workunit.client.0.smithi097.stderr: -242> 2024-09-14T11:05:42.992+0000 7f2d73d20640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:05:43.544 INFO:tasks.workunit.client.0.smithi097.stderr: -241> 2024-09-14T11:05:42.992+0000 7f2d73d20640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:05:43.544 INFO:tasks.workunit.client.0.smithi097.stderr: -240> 2024-09-14T11:05:42.992+0000 7f2d7351f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:05:43.544 INFO:tasks.workunit.client.0.smithi097.stderr: -239> 2024-09-14T11:05:42.992+0000 7f2d7351f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:05:43.544 INFO:tasks.workunit.client.0.smithi097.stderr: -238> 2024-09-14T11:05:42.992+0000 7f2d7351f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:05:43.544 INFO:tasks.workunit.client.0.smithi097.stderr: -237> 2024-09-14T11:05:42.992+0000 7f2d73d20640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:05:43.544 INFO:tasks.workunit.client.0.smithi097.stderr: -236> 2024-09-14T11:05:42.992+0000 7f2d73d20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:05:43.544 INFO:tasks.workunit.client.0.smithi097.stderr: -235> 2024-09-14T11:05:42.992+0000 7f2d73d20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:05:43.544 INFO:tasks.workunit.client.0.smithi097.stderr: -234> 2024-09-14T11:05:42.992+0000 7f2d7351f640 10 monclient(hunting): handle_auth_done global_id 7118 payload 274 2024-09-14T11:05:43.544 INFO:tasks.workunit.client.0.smithi097.stderr: -233> 2024-09-14T11:05:42.992+0000 7f2d7351f640 10 monclient: _finish_hunting 0 2024-09-14T11:05:43.544 INFO:tasks.workunit.client.0.smithi097.stderr: -232> 2024-09-14T11:05:42.992+0000 7f2d7351f640 1 monclient: found mon.noname-c 2024-09-14T11:05:43.544 INFO:tasks.workunit.client.0.smithi097.stderr: -231> 2024-09-14T11:05:42.992+0000 7f2d7351f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:05:43.544 INFO:tasks.workunit.client.0.smithi097.stderr: -230> 2024-09-14T11:05:42.993+0000 7f2c52ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:05:43.544 INFO:tasks.workunit.client.0.smithi097.stderr: -229> 2024-09-14T11:05:42.993+0000 7f2c52ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:05:43.544 INFO:tasks.workunit.client.0.smithi097.stderr: -228> 2024-09-14T11:05:42.993+0000 7f2c52ffd640 10 monclient: dump: 2024-09-14T11:05:43.545 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:05:43.545 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:05:43.545 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:43.545 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:43.545 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:05:43.545 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:05:43.545 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:05:43.545 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:05:43.545 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:05:43.545 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:43.545 INFO:tasks.workunit.client.0.smithi097.stderr: -227> 2024-09-14T11:05:42.993+0000 7f2c52ffd640 10 monclient: _finish_auth 0 2024-09-14T11:05:43.545 INFO:tasks.workunit.client.0.smithi097.stderr: -226> 2024-09-14T11:05:42.993+0000 7f2c52ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:05:43.546 INFO:tasks.workunit.client.0.smithi097.stderr: -225> 2024-09-14T11:05:42.993+0000 7f2d7622f800 5 monclient: authenticate success, global_id 7118 2024-09-14T11:05:43.546 INFO:tasks.workunit.client.0.smithi097.stderr: -224> 2024-09-14T11:05:42.993+0000 7f2c52ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:05:43.546 INFO:tasks.workunit.client.0.smithi097.stderr: -223> 2024-09-14T11:05:42.993+0000 7f2c52ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:05:43.546 INFO:tasks.workunit.client.0.smithi097.stderr: -222> 2024-09-14T11:05:42.993+0000 7f2c52ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:05:43.546 INFO:tasks.workunit.client.0.smithi097.stderr: -221> 2024-09-14T11:05:42.993+0000 7f2c52ffd640 10 monclient: dump: 2024-09-14T11:05:43.546 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:05:43.546 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:05:43.546 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:43.546 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:43.546 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:05:43.546 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:05:43.546 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:05:43.546 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:05:43.546 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:05:43.546 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:43.547 INFO:tasks.workunit.client.0.smithi097.stderr: -220> 2024-09-14T11:05:42.993+0000 7f2d7622f800 10 monclient: get_monmap_and_config success 2024-09-14T11:05:43.547 INFO:tasks.workunit.client.0.smithi097.stderr: -219> 2024-09-14T11:05:42.993+0000 7f2d7622f800 4 set_mon_vals no callback set 2024-09-14T11:05:43.547 INFO:tasks.workunit.client.0.smithi097.stderr: -218> 2024-09-14T11:05:42.993+0000 7f2d7622f800 10 monclient: shutdown 2024-09-14T11:05:43.547 INFO:tasks.workunit.client.0.smithi097.stderr: -217> 2024-09-14T11:05:42.993+0000 7f2d7622f800 10 monclient: build_initial_monmap 2024-09-14T11:05:43.547 INFO:tasks.workunit.client.0.smithi097.stderr: -216> 2024-09-14T11:05:42.993+0000 7f2d7622f800 1 build_initial for_mkfs: 0 2024-09-14T11:05:43.547 INFO:tasks.workunit.client.0.smithi097.stderr: -215> 2024-09-14T11:05:42.993+0000 7f2d7622f800 10 monclient: monmap: 2024-09-14T11:05:43.547 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:05:43.547 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:05:43.547 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:05:43.547 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:05:43.547 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:05:43.547 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:05:43.547 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:05:43.548 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:05:43.548 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:05:43.548 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:43.548 INFO:tasks.workunit.client.0.smithi097.stderr: -214> 2024-09-14T11:05:42.993+0000 7f2d7622f800 5 AuthRegistry(0x55e61550bf60) adding auth protocol: cephx 2024-09-14T11:05:43.548 INFO:tasks.workunit.client.0.smithi097.stderr: -213> 2024-09-14T11:05:42.993+0000 7f2d7622f800 5 AuthRegistry(0x55e61550bf60) adding auth protocol: cephx 2024-09-14T11:05:43.548 INFO:tasks.workunit.client.0.smithi097.stderr: -212> 2024-09-14T11:05:42.993+0000 7f2d7622f800 5 AuthRegistry(0x55e61550bf60) adding auth protocol: cephx 2024-09-14T11:05:43.548 INFO:tasks.workunit.client.0.smithi097.stderr: -211> 2024-09-14T11:05:42.993+0000 7f2d7622f800 5 AuthRegistry(0x55e61550bf60) adding con mode: secure 2024-09-14T11:05:43.548 INFO:tasks.workunit.client.0.smithi097.stderr: -210> 2024-09-14T11:05:42.993+0000 7f2d7622f800 5 AuthRegistry(0x55e61550bf60) adding con mode: crc 2024-09-14T11:05:43.548 INFO:tasks.workunit.client.0.smithi097.stderr: -209> 2024-09-14T11:05:42.993+0000 7f2d7622f800 5 AuthRegistry(0x55e61550bf60) adding con mode: secure 2024-09-14T11:05:43.548 INFO:tasks.workunit.client.0.smithi097.stderr: -208> 2024-09-14T11:05:42.993+0000 7f2d7622f800 5 AuthRegistry(0x55e61550bf60) adding con mode: crc 2024-09-14T11:05:43.548 INFO:tasks.workunit.client.0.smithi097.stderr: -207> 2024-09-14T11:05:42.993+0000 7f2d7622f800 5 AuthRegistry(0x55e61550bf60) adding con mode: secure 2024-09-14T11:05:43.548 INFO:tasks.workunit.client.0.smithi097.stderr: -206> 2024-09-14T11:05:42.993+0000 7f2d7622f800 5 AuthRegistry(0x55e61550bf60) adding con mode: crc 2024-09-14T11:05:43.548 INFO:tasks.workunit.client.0.smithi097.stderr: -205> 2024-09-14T11:05:42.993+0000 7f2d7622f800 5 AuthRegistry(0x55e61550bf60) adding con mode: crc 2024-09-14T11:05:43.548 INFO:tasks.workunit.client.0.smithi097.stderr: -204> 2024-09-14T11:05:42.993+0000 7f2d7622f800 5 AuthRegistry(0x55e61550bf60) adding con mode: secure 2024-09-14T11:05:43.549 INFO:tasks.workunit.client.0.smithi097.stderr: -203> 2024-09-14T11:05:42.993+0000 7f2d7622f800 5 AuthRegistry(0x55e61550bf60) adding con mode: crc 2024-09-14T11:05:43.549 INFO:tasks.workunit.client.0.smithi097.stderr: -202> 2024-09-14T11:05:42.993+0000 7f2d7622f800 5 AuthRegistry(0x55e61550bf60) adding con mode: secure 2024-09-14T11:05:43.549 INFO:tasks.workunit.client.0.smithi097.stderr: -201> 2024-09-14T11:05:42.993+0000 7f2d7622f800 5 AuthRegistry(0x55e61550bf60) adding con mode: crc 2024-09-14T11:05:43.549 INFO:tasks.workunit.client.0.smithi097.stderr: -200> 2024-09-14T11:05:42.993+0000 7f2d7622f800 5 AuthRegistry(0x55e61550bf60) adding con mode: secure 2024-09-14T11:05:43.549 INFO:tasks.workunit.client.0.smithi097.stderr: -199> 2024-09-14T11:05:42.994+0000 7f2d7622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:05:43.549 INFO:tasks.workunit.client.0.smithi097.stderr: -198> 2024-09-14T11:05:42.994+0000 7f2d7622f800 1 librados: starting msgr at 2024-09-14T11:05:43.549 INFO:tasks.workunit.client.0.smithi097.stderr: -197> 2024-09-14T11:05:42.994+0000 7f2d7622f800 1 librados: starting objecter 2024-09-14T11:05:43.549 INFO:tasks.workunit.client.0.smithi097.stderr: -196> 2024-09-14T11:05:42.994+0000 7f2d7622f800 5 asok(0x55e61521c270) register_command objecter_requests cmddesc objecter_requests hook 0x55e6154bc6a0 EEXIST 2024-09-14T11:05:43.549 INFO:tasks.workunit.client.0.smithi097.stderr: -195> 2024-09-14T11:05:42.994+0000 7f2d7622f800 1 librados: setting wanted keys 2024-09-14T11:05:43.549 INFO:tasks.workunit.client.0.smithi097.stderr: -194> 2024-09-14T11:05:42.994+0000 7f2d7622f800 1 librados: calling monclient init 2024-09-14T11:05:43.549 INFO:tasks.workunit.client.0.smithi097.stderr: -193> 2024-09-14T11:05:42.994+0000 7f2d7622f800 10 monclient: init 2024-09-14T11:05:43.549 INFO:tasks.workunit.client.0.smithi097.stderr: -192> 2024-09-14T11:05:42.994+0000 7f2d7622f800 5 AuthRegistry(0x55e6154d05e0) adding auth protocol: cephx 2024-09-14T11:05:43.549 INFO:tasks.workunit.client.0.smithi097.stderr: -191> 2024-09-14T11:05:42.994+0000 7f2d7622f800 5 AuthRegistry(0x55e6154d05e0) adding auth protocol: cephx 2024-09-14T11:05:43.550 INFO:tasks.workunit.client.0.smithi097.stderr: -190> 2024-09-14T11:05:42.994+0000 7f2d7622f800 5 AuthRegistry(0x55e6154d05e0) adding auth protocol: cephx 2024-09-14T11:05:43.550 INFO:tasks.workunit.client.0.smithi097.stderr: -189> 2024-09-14T11:05:42.994+0000 7f2d7622f800 5 AuthRegistry(0x55e6154d05e0) adding con mode: secure 2024-09-14T11:05:43.550 INFO:tasks.workunit.client.0.smithi097.stderr: -188> 2024-09-14T11:05:42.994+0000 7f2d7622f800 5 AuthRegistry(0x55e6154d05e0) adding con mode: crc 2024-09-14T11:05:43.550 INFO:tasks.workunit.client.0.smithi097.stderr: -187> 2024-09-14T11:05:42.994+0000 7f2d7622f800 5 AuthRegistry(0x55e6154d05e0) adding con mode: secure 2024-09-14T11:05:43.550 INFO:tasks.workunit.client.0.smithi097.stderr: -186> 2024-09-14T11:05:42.994+0000 7f2d7622f800 5 AuthRegistry(0x55e6154d05e0) adding con mode: crc 2024-09-14T11:05:43.550 INFO:tasks.workunit.client.0.smithi097.stderr: -185> 2024-09-14T11:05:42.994+0000 7f2d7622f800 5 AuthRegistry(0x55e6154d05e0) adding con mode: secure 2024-09-14T11:05:43.550 INFO:tasks.workunit.client.0.smithi097.stderr: -184> 2024-09-14T11:05:42.994+0000 7f2d7622f800 5 AuthRegistry(0x55e6154d05e0) adding con mode: crc 2024-09-14T11:05:43.550 INFO:tasks.workunit.client.0.smithi097.stderr: -183> 2024-09-14T11:05:42.994+0000 7f2d7622f800 5 AuthRegistry(0x55e6154d05e0) adding con mode: crc 2024-09-14T11:05:43.550 INFO:tasks.workunit.client.0.smithi097.stderr: -182> 2024-09-14T11:05:42.994+0000 7f2d7622f800 5 AuthRegistry(0x55e6154d05e0) adding con mode: secure 2024-09-14T11:05:43.550 INFO:tasks.workunit.client.0.smithi097.stderr: -181> 2024-09-14T11:05:42.994+0000 7f2d7622f800 5 AuthRegistry(0x55e6154d05e0) adding con mode: crc 2024-09-14T11:05:43.550 INFO:tasks.workunit.client.0.smithi097.stderr: -180> 2024-09-14T11:05:42.994+0000 7f2d7622f800 5 AuthRegistry(0x55e6154d05e0) adding con mode: secure 2024-09-14T11:05:43.550 INFO:tasks.workunit.client.0.smithi097.stderr: -179> 2024-09-14T11:05:42.994+0000 7f2d7622f800 5 AuthRegistry(0x55e6154d05e0) adding con mode: crc 2024-09-14T11:05:43.550 INFO:tasks.workunit.client.0.smithi097.stderr: -178> 2024-09-14T11:05:42.994+0000 7f2d7622f800 5 AuthRegistry(0x55e6154d05e0) adding con mode: secure 2024-09-14T11:05:43.550 INFO:tasks.workunit.client.0.smithi097.stderr: -177> 2024-09-14T11:05:42.994+0000 7f2d7622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:05:43.550 INFO:tasks.workunit.client.0.smithi097.stderr: -176> 2024-09-14T11:05:42.994+0000 7f2d7622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:05:43.551 INFO:tasks.workunit.client.0.smithi097.stderr: -175> 2024-09-14T11:05:42.994+0000 7f2d7622f800 5 asok(0x55e61521c270) register_command rotate-key cmddesc rotate-key hook 0x55e6154d0728 EEXIST 2024-09-14T11:05:43.551 INFO:tasks.workunit.client.0.smithi097.stderr: -174> 2024-09-14T11:05:42.994+0000 7f2d7622f800 10 monclient: _reopen_session rank -1 2024-09-14T11:05:43.551 INFO:tasks.workunit.client.0.smithi097.stderr: -173> 2024-09-14T11:05:42.994+0000 7f2d7622f800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:05:43.551 INFO:tasks.workunit.client.0.smithi097.stderr: -172> 2024-09-14T11:05:42.994+0000 7f2d7622f800 10 monclient(hunting): picked mon.noname-b con 0x55e6154e0eb0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:05:43.551 INFO:tasks.workunit.client.0.smithi097.stderr: -171> 2024-09-14T11:05:42.994+0000 7f2d7622f800 10 monclient(hunting): picked mon.noname-a con 0x55e61550b380 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:05:43.551 INFO:tasks.workunit.client.0.smithi097.stderr: -170> 2024-09-14T11:05:42.994+0000 7f2d7622f800 10 monclient(hunting): picked mon.noname-c con 0x55e61550fea0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:05:43.551 INFO:tasks.workunit.client.0.smithi097.stderr: -169> 2024-09-14T11:05:42.994+0000 7f2d7622f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:05:43.551 INFO:tasks.workunit.client.0.smithi097.stderr: -168> 2024-09-14T11:05:42.994+0000 7f2d7622f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:05:43.551 INFO:tasks.workunit.client.0.smithi097.stderr: -167> 2024-09-14T11:05:42.994+0000 7f2d7622f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:05:43.551 INFO:tasks.workunit.client.0.smithi097.stderr: -166> 2024-09-14T11:05:42.994+0000 7f2d7622f800 10 monclient(hunting): _renew_subs 2024-09-14T11:05:43.551 INFO:tasks.workunit.client.0.smithi097.stderr: -165> 2024-09-14T11:05:42.994+0000 7f2d7622f800 10 monclient(hunting): authenticate will time out at 2024.647723s 2024-09-14T11:05:43.551 INFO:tasks.workunit.client.0.smithi097.stderr: -164> 2024-09-14T11:05:42.994+0000 7f2d73d20640 10 monclient(hunting): get_auth_request con 0x55e61550fea0 auth_method 0 2024-09-14T11:05:43.551 INFO:tasks.workunit.client.0.smithi097.stderr: -163> 2024-09-14T11:05:42.994+0000 7f2d73d20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:05:43.552 INFO:tasks.workunit.client.0.smithi097.stderr: -162> 2024-09-14T11:05:42.994+0000 7f2d73d20640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:05:43.552 INFO:tasks.workunit.client.0.smithi097.stderr: -161> 2024-09-14T11:05:42.994+0000 7f2d73d20640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:05:43.552 INFO:tasks.workunit.client.0.smithi097.stderr: -160> 2024-09-14T11:05:42.994+0000 7f2d74521640 10 monclient(hunting): get_auth_request con 0x55e61550b380 auth_method 0 2024-09-14T11:05:43.552 INFO:tasks.workunit.client.0.smithi097.stderr: -159> 2024-09-14T11:05:42.994+0000 7f2d74521640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:05:43.552 INFO:tasks.workunit.client.0.smithi097.stderr: -158> 2024-09-14T11:05:42.994+0000 7f2d74521640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:05:43.552 INFO:tasks.workunit.client.0.smithi097.stderr: -157> 2024-09-14T11:05:42.994+0000 7f2d74521640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:05:43.552 INFO:tasks.workunit.client.0.smithi097.stderr: -156> 2024-09-14T11:05:42.994+0000 7f2d73d20640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:05:43.552 INFO:tasks.workunit.client.0.smithi097.stderr: -155> 2024-09-14T11:05:42.994+0000 7f2d73d20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:05:43.552 INFO:tasks.workunit.client.0.smithi097.stderr: -154> 2024-09-14T11:05:42.994+0000 7f2d73d20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:05:43.552 INFO:tasks.workunit.client.0.smithi097.stderr: -153> 2024-09-14T11:05:42.994+0000 7f2d74521640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:05:43.552 INFO:tasks.workunit.client.0.smithi097.stderr: -152> 2024-09-14T11:05:42.994+0000 7f2d74521640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:05:43.552 INFO:tasks.workunit.client.0.smithi097.stderr: -151> 2024-09-14T11:05:42.994+0000 7f2d74521640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:05:43.552 INFO:tasks.workunit.client.0.smithi097.stderr: -150> 2024-09-14T11:05:42.995+0000 7f2d7351f640 10 monclient(hunting): get_auth_request con 0x55e6154e0eb0 auth_method 0 2024-09-14T11:05:43.553 INFO:tasks.workunit.client.0.smithi097.stderr: -149> 2024-09-14T11:05:42.995+0000 7f2d7351f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:05:43.553 INFO:tasks.workunit.client.0.smithi097.stderr: -148> 2024-09-14T11:05:42.995+0000 7f2d7351f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:05:43.553 INFO:tasks.workunit.client.0.smithi097.stderr: -147> 2024-09-14T11:05:42.995+0000 7f2d7351f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:05:43.553 INFO:tasks.workunit.client.0.smithi097.stderr: -146> 2024-09-14T11:05:42.995+0000 7f2d73d20640 10 monclient(hunting): handle_auth_done global_id 7121 payload 824 2024-09-14T11:05:43.553 INFO:tasks.workunit.client.0.smithi097.stderr: -145> 2024-09-14T11:05:42.995+0000 7f2d73d20640 10 monclient: _finish_hunting 0 2024-09-14T11:05:43.553 INFO:tasks.workunit.client.0.smithi097.stderr: -144> 2024-09-14T11:05:42.995+0000 7f2d73d20640 1 monclient: found mon.noname-c 2024-09-14T11:05:43.553 INFO:tasks.workunit.client.0.smithi097.stderr: -143> 2024-09-14T11:05:42.995+0000 7f2d73d20640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:05:43.553 INFO:tasks.workunit.client.0.smithi097.stderr: -142> 2024-09-14T11:05:42.995+0000 7f2c517fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:05:43.553 INFO:tasks.workunit.client.0.smithi097.stderr: -141> 2024-09-14T11:05:42.995+0000 7f2c517fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:05:43.553 INFO:tasks.workunit.client.0.smithi097.stderr: -140> 2024-09-14T11:05:42.995+0000 7f2c517fa640 10 monclient: dump: 2024-09-14T11:05:43.553 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:05:43.553 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:05:43.554 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:43.554 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:43.554 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:05:43.554 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:05:43.554 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:05:43.554 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:05:43.554 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:05:43.554 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:43.554 INFO:tasks.workunit.client.0.smithi097.stderr: -139> 2024-09-14T11:05:42.995+0000 7f2c517fa640 10 monclient: _finish_auth 0 2024-09-14T11:05:43.554 INFO:tasks.workunit.client.0.smithi097.stderr: -138> 2024-09-14T11:05:42.995+0000 7f2c517fa640 10 monclient: _check_auth_tickets 2024-09-14T11:05:43.554 INFO:tasks.workunit.client.0.smithi097.stderr: -137> 2024-09-14T11:05:42.995+0000 7f2c517fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:05:43.554 INFO:tasks.workunit.client.0.smithi097.stderr: -136> 2024-09-14T11:05:42.995+0000 7f2c517fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:05:43.554 INFO:tasks.workunit.client.0.smithi097.stderr: -135> 2024-09-14T11:05:42.995+0000 7f2c517fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:05:43.555 INFO:tasks.workunit.client.0.smithi097.stderr: -134> 2024-09-14T11:05:42.995+0000 7f2c517fa640 10 monclient: dump: 2024-09-14T11:05:43.555 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:05:43.555 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:05:43.555 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:43.555 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:05:43.555 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:05:43.555 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:05:43.555 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:05:43.555 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:05:43.555 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:05:43.555 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:43.555 INFO:tasks.workunit.client.0.smithi097.stderr: -133> 2024-09-14T11:05:42.995+0000 7f2d7622f800 5 monclient: authenticate success, global_id 7121 2024-09-14T11:05:43.555 INFO:tasks.workunit.client.0.smithi097.stderr: -132> 2024-09-14T11:05:42.995+0000 7f2c52ffd640 4 set_mon_vals no callback set 2024-09-14T11:05:43.555 INFO:tasks.workunit.client.0.smithi097.stderr: -131> 2024-09-14T11:05:42.995+0000 7f2d7622f800 10 monclient: _renew_subs 2024-09-14T11:05:43.556 INFO:tasks.workunit.client.0.smithi097.stderr: -130> 2024-09-14T11:05:42.995+0000 7f2d7622f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:05:43.556 INFO:tasks.workunit.client.0.smithi097.stderr: -129> 2024-09-14T11:05:42.995+0000 7f2d7622f800 10 monclient: _renew_subs 2024-09-14T11:05:43.556 INFO:tasks.workunit.client.0.smithi097.stderr: -128> 2024-09-14T11:05:42.995+0000 7f2d7622f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:05:43.556 INFO:tasks.workunit.client.0.smithi097.stderr: -127> 2024-09-14T11:05:42.995+0000 7f2d7622f800 1 librados: init done 2024-09-14T11:05:43.556 INFO:tasks.workunit.client.0.smithi097.stderr: -126> 2024-09-14T11:05:42.995+0000 7f2d7622f800 5 asok(0x55e61521c270) register_command cr dump hook 0x55e615508338 2024-09-14T11:05:43.556 INFO:tasks.workunit.client.0.smithi097.stderr: -125> 2024-09-14T11:05:42.997+0000 7f2d7622f800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.556 INFO:tasks.workunit.client.0.smithi097.stderr: -124> 2024-09-14T11:05:42.997+0000 7f2c517fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:05:43.556 INFO:tasks.workunit.client.0.smithi097.stderr: -123> 2024-09-14T11:05:42.997+0000 7f2c517fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:05:43.556 INFO:tasks.workunit.client.0.smithi097.stderr: -122> 2024-09-14T11:05:42.997+0000 7f2c517fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:05:43.556 INFO:tasks.workunit.client.0.smithi097.stderr: -121> 2024-09-14T11:05:42.997+0000 7f2d7351f640 10 monclient: get_auth_request con 0x7f2c3c077230 auth_method 0 2024-09-14T11:05:43.556 INFO:tasks.workunit.client.0.smithi097.stderr: -120> 2024-09-14T11:05:42.998+0000 7f2d74521640 10 monclient: get_auth_request con 0x55e61552a2d0 auth_method 0 2024-09-14T11:05:43.556 INFO:tasks.workunit.client.0.smithi097.stderr: -119> 2024-09-14T11:05:42.998+0000 7f2d7622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:43.556 INFO:tasks.workunit.client.0.smithi097.stderr: -118> 2024-09-14T11:05:42.998+0000 7f2d7622f800 20 realm 2024-09-14T11:05:43.556 INFO:tasks.workunit.client.0.smithi097.stderr: -117> 2024-09-14T11:05:42.998+0000 7f2d7622f800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.556 INFO:tasks.workunit.client.0.smithi097.stderr: -116> 2024-09-14T11:05:42.999+0000 7f2d7622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:43.557 INFO:tasks.workunit.client.0.smithi097.stderr: -115> 2024-09-14T11:05:42.999+0000 7f2d7622f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:05:43.557 INFO:tasks.workunit.client.0.smithi097.stderr: -114> 2024-09-14T11:05:42.999+0000 7f2d7622f800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.557 INFO:tasks.workunit.client.0.smithi097.stderr: -113> 2024-09-14T11:05:42.999+0000 7f2d7622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:43.557 INFO:tasks.workunit.client.0.smithi097.stderr: -112> 2024-09-14T11:05:42.999+0000 7f2d7622f800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.557 INFO:tasks.workunit.client.0.smithi097.stderr: -111> 2024-09-14T11:05:42.999+0000 7f2d7351f640 10 monclient: get_auth_request con 0x55e61552e4c0 auth_method 0 2024-09-14T11:05:43.557 INFO:tasks.workunit.client.0.smithi097.stderr: -110> 2024-09-14T11:05:42.999+0000 7f2d7622f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:43.557 INFO:tasks.workunit.client.0.smithi097.stderr: -109> 2024-09-14T11:05:42.999+0000 7f2d7622f800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.557 INFO:tasks.workunit.client.0.smithi097.stderr: -108> 2024-09-14T11:05:43.000+0000 7f2d74521640 10 monclient: get_auth_request con 0x55e615531d20 auth_method 0 2024-09-14T11:05:43.557 INFO:tasks.workunit.client.0.smithi097.stderr: -107> 2024-09-14T11:05:43.000+0000 7f2d7622f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:05:43.557 INFO:tasks.workunit.client.0.smithi097.stderr: -106> 2024-09-14T11:05:43.000+0000 7f2d7622f800 20 searching for the correct realm 2024-09-14T11:05:43.557 INFO:tasks.workunit.client.0.smithi097.stderr: -105> 2024-09-14T11:05:43.000+0000 7f2d73d20640 10 monclient: get_auth_request con 0x55e6155369f0 auth_method 0 2024-09-14T11:05:43.557 INFO:tasks.workunit.client.0.smithi097.stderr: -104> 2024-09-14T11:05:43.001+0000 7f2d7351f640 10 monclient: get_auth_request con 0x7f2d64044060 auth_method 0 2024-09-14T11:05:43.557 INFO:tasks.workunit.client.0.smithi097.stderr: -103> 2024-09-14T11:05:43.002+0000 7f2d74521640 10 monclient: get_auth_request con 0x7f2d5c06d060 auth_method 0 2024-09-14T11:05:43.557 INFO:tasks.workunit.client.0.smithi097.stderr: -102> 2024-09-14T11:05:43.002+0000 7f2d74521640 0 -- 172.21.15.97:0/1250567262 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f2d5c06d060 msgr2=0x7f2d5c0b9770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:05:43.558 INFO:tasks.workunit.client.0.smithi097.stderr: -101> 2024-09-14T11:05:43.203+0000 7f2d74521640 10 monclient: get_auth_request con 0x7f2d5c06d060 auth_method 0 2024-09-14T11:05:43.558 INFO:tasks.workunit.client.0.smithi097.stderr: -100> 2024-09-14T11:05:43.204+0000 7f2c517fa640 1 client.7121.objecter ms_handle_reset 0x7f2d64044060 session 0x7f2d64071e90 osd.2 2024-09-14T11:05:43.558 INFO:tasks.workunit.client.0.smithi097.stderr: -99> 2024-09-14T11:05:43.204+0000 7f2c517fa640 10 monclient: _renew_subs 2024-09-14T11:05:43.558 INFO:tasks.workunit.client.0.smithi097.stderr: -98> 2024-09-14T11:05:43.204+0000 7f2c517fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:05:43.558 INFO:tasks.workunit.client.0.smithi097.stderr: -97> 2024-09-14T11:05:43.204+0000 7f2d7351f640 10 monclient: get_auth_request con 0x7f2c3c086d50 auth_method 0 2024-09-14T11:05:43.558 INFO:tasks.workunit.client.0.smithi097.stderr: -96> 2024-09-14T11:05:43.206+0000 7f2d73d20640 10 monclient: get_auth_request con 0x7f2d5c0abe00 auth_method 0 2024-09-14T11:05:43.558 INFO:tasks.workunit.client.0.smithi097.stderr: -95> 2024-09-14T11:05:43.206+0000 7f2d7351f640 0 -- 172.21.15.97:0/1250567262 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f2d6402f040 msgr2=0x7f2d64070d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:05:43.558 INFO:tasks.workunit.client.0.smithi097.stderr: -94> 2024-09-14T11:05:43.407+0000 7f2d7351f640 10 monclient: get_auth_request con 0x7f2d6402f040 auth_method 0 2024-09-14T11:05:43.558 INFO:tasks.workunit.client.0.smithi097.stderr: -93> 2024-09-14T11:05:43.412+0000 7f2d7622f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:05:43.558 INFO:tasks.workunit.client.0.smithi097.stderr: -92> 2024-09-14T11:05:43.412+0000 7f2d7622f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:05:43.558 INFO:tasks.workunit.client.0.smithi097.stderr: -91> 2024-09-14T11:05:43.412+0000 7f2d7622f800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:05:43.558 INFO:tasks.workunit.client.0.smithi097.stderr: -90> 2024-09-14T11:05:43.412+0000 7f2d7622f800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:05:43.558 INFO:tasks.workunit.client.0.smithi097.stderr: -89> 2024-09-14T11:05:43.412+0000 7f2d7622f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:05:43.559 INFO:tasks.workunit.client.0.smithi097.stderr: -88> 2024-09-14T11:05:43.412+0000 7f2d7622f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:05:43.559 INFO:tasks.workunit.client.0.smithi097.stderr: -87> 2024-09-14T11:05:43.412+0000 7f2d7622f800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.559 INFO:tasks.workunit.client.0.smithi097.stderr: -86> 2024-09-14T11:05:43.413+0000 7f2d7622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:43.559 INFO:tasks.workunit.client.0.smithi097.stderr: -85> 2024-09-14T11:05:43.413+0000 7f2d7622f800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.559 INFO:tasks.workunit.client.0.smithi097.stderr: -84> 2024-09-14T11:05:43.413+0000 7f2d7622f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:43.559 INFO:tasks.workunit.client.0.smithi097.stderr: -83> 2024-09-14T11:05:43.413+0000 7f2d7622f800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.559 INFO:tasks.workunit.client.0.smithi097.stderr: -82> 2024-09-14T11:05:43.413+0000 7f2d7622f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:05:43.559 INFO:tasks.workunit.client.0.smithi097.stderr: -81> 2024-09-14T11:05:43.413+0000 7f2d7622f800 20 zone default found 2024-09-14T11:05:43.559 INFO:tasks.workunit.client.0.smithi097.stderr: -80> 2024-09-14T11:05:43.413+0000 7f2d7622f800 4 Realm: () 2024-09-14T11:05:43.559 INFO:tasks.workunit.client.0.smithi097.stderr: -79> 2024-09-14T11:05:43.413+0000 7f2d7622f800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:05:43.559 INFO:tasks.workunit.client.0.smithi097.stderr: -78> 2024-09-14T11:05:43.413+0000 7f2d7622f800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:05:43.559 INFO:tasks.workunit.client.0.smithi097.stderr: -77> 2024-09-14T11:05:43.413+0000 7f2d7622f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:05:43.559 INFO:tasks.workunit.client.0.smithi097.stderr: -76> 2024-09-14T11:05:43.413+0000 7f2d7622f800 20 zonegroup default 2024-09-14T11:05:43.560 INFO:tasks.workunit.client.0.smithi097.stderr: -75> 2024-09-14T11:05:43.413+0000 7f2d7622f800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.560 INFO:tasks.workunit.client.0.smithi097.stderr: -74> 2024-09-14T11:05:43.413+0000 7f2d7622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:43.560 INFO:tasks.workunit.client.0.smithi097.stderr: -73> 2024-09-14T11:05:43.413+0000 7f2d7622f800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.560 INFO:tasks.workunit.client.0.smithi097.stderr: -72> 2024-09-14T11:05:43.414+0000 7f2d7622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:43.560 INFO:tasks.workunit.client.0.smithi097.stderr: -71> 2024-09-14T11:05:43.414+0000 7f2d7622f800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.560 INFO:tasks.workunit.client.0.smithi097.stderr: -70> 2024-09-14T11:05:43.414+0000 7f2d7622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:43.560 INFO:tasks.workunit.client.0.smithi097.stderr: -69> 2024-09-14T11:05:43.414+0000 7f2d7622f800 20 started sync module instance, tier type = 2024-09-14T11:05:43.560 INFO:tasks.workunit.client.0.smithi097.stderr: -68> 2024-09-14T11:05:43.414+0000 7f2d7622f800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:05:43.560 INFO:tasks.workunit.client.0.smithi097.stderr: -67> 2024-09-14T11:05:43.424+0000 7f2d7622f800 20 add_watcher() i=0 2024-09-14T11:05:43.560 INFO:tasks.workunit.client.0.smithi097.stderr: -66> 2024-09-14T11:05:43.424+0000 7f2d7622f800 20 add_watcher() i=1 2024-09-14T11:05:43.560 INFO:tasks.workunit.client.0.smithi097.stderr: -65> 2024-09-14T11:05:43.424+0000 7f2d7622f800 20 add_watcher() i=2 2024-09-14T11:05:43.560 INFO:tasks.workunit.client.0.smithi097.stderr: -64> 2024-09-14T11:05:43.424+0000 7f2d7622f800 20 add_watcher() i=3 2024-09-14T11:05:43.560 INFO:tasks.workunit.client.0.smithi097.stderr: -63> 2024-09-14T11:05:43.424+0000 7f2d7622f800 20 add_watcher() i=4 2024-09-14T11:05:43.560 INFO:tasks.workunit.client.0.smithi097.stderr: -62> 2024-09-14T11:05:43.424+0000 7f2d7622f800 20 add_watcher() i=5 2024-09-14T11:05:43.561 INFO:tasks.workunit.client.0.smithi097.stderr: -61> 2024-09-14T11:05:43.425+0000 7f2d7622f800 20 add_watcher() i=6 2024-09-14T11:05:43.561 INFO:tasks.workunit.client.0.smithi097.stderr: -60> 2024-09-14T11:05:43.425+0000 7f2d7622f800 20 add_watcher() i=7 2024-09-14T11:05:43.561 INFO:tasks.workunit.client.0.smithi097.stderr: -59> 2024-09-14T11:05:43.425+0000 7f2d7622f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:05:43.561 INFO:tasks.workunit.client.0.smithi097.stderr: -58> 2024-09-14T11:05:43.427+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395ec90) adding auth protocol: cephx 2024-09-14T11:05:43.561 INFO:tasks.workunit.client.0.smithi097.stderr: -57> 2024-09-14T11:05:43.427+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395ec90) adding auth protocol: cephx 2024-09-14T11:05:43.561 INFO:tasks.workunit.client.0.smithi097.stderr: -56> 2024-09-14T11:05:43.427+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395ec90) adding auth protocol: cephx 2024-09-14T11:05:43.561 INFO:tasks.workunit.client.0.smithi097.stderr: -55> 2024-09-14T11:05:43.427+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395ec90) adding con mode: secure 2024-09-14T11:05:43.561 INFO:tasks.workunit.client.0.smithi097.stderr: -54> 2024-09-14T11:05:43.427+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395ec90) adding con mode: crc 2024-09-14T11:05:43.561 INFO:tasks.workunit.client.0.smithi097.stderr: -53> 2024-09-14T11:05:43.427+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395ec90) adding con mode: secure 2024-09-14T11:05:43.561 INFO:tasks.workunit.client.0.smithi097.stderr: -52> 2024-09-14T11:05:43.427+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395ec90) adding con mode: crc 2024-09-14T11:05:43.561 INFO:tasks.workunit.client.0.smithi097.stderr: -51> 2024-09-14T11:05:43.427+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395ec90) adding con mode: secure 2024-09-14T11:05:43.561 INFO:tasks.workunit.client.0.smithi097.stderr: -50> 2024-09-14T11:05:43.427+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395ec90) adding con mode: crc 2024-09-14T11:05:43.561 INFO:tasks.workunit.client.0.smithi097.stderr: -49> 2024-09-14T11:05:43.427+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395ec90) adding con mode: crc 2024-09-14T11:05:43.562 INFO:tasks.workunit.client.0.smithi097.stderr: -48> 2024-09-14T11:05:43.427+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395ec90) adding con mode: secure 2024-09-14T11:05:43.562 INFO:tasks.workunit.client.0.smithi097.stderr: -47> 2024-09-14T11:05:43.427+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395ec90) adding con mode: crc 2024-09-14T11:05:43.562 INFO:tasks.workunit.client.0.smithi097.stderr: -46> 2024-09-14T11:05:43.427+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395ec90) adding con mode: secure 2024-09-14T11:05:43.562 INFO:tasks.workunit.client.0.smithi097.stderr: -45> 2024-09-14T11:05:43.427+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395ec90) adding con mode: crc 2024-09-14T11:05:43.562 INFO:tasks.workunit.client.0.smithi097.stderr: -44> 2024-09-14T11:05:43.427+0000 7f2c29fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:43.564 INFO:tasks.workunit.client.0.smithi097.stderr: -43> 2024-09-14T11:05:43.427+0000 7f2d7622f800 5 AuthRegistry(0x7ffdf395ec90) adding con mode: secure 2024-09-14T11:05:43.564 INFO:tasks.workunit.client.0.smithi097.stderr: -42> 2024-09-14T11:05:43.428+0000 7f2d7622f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:05:43.564 INFO:tasks.workunit.client.0.smithi097.stderr: -41> 2024-09-14T11:05:43.428+0000 7f2d7622f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:05:43.564 INFO:tasks.workunit.client.0.smithi097.stderr: -40> 2024-09-14T11:05:43.428+0000 7f2d7622f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:05:43.564 INFO:tasks.workunit.client.0.smithi097.stderr: -39> 2024-09-14T11:05:43.428+0000 7f2d7622f800 5 asok(0x55e61521c270) register_command cache list hook 0x55e6154fd070 2024-09-14T11:05:43.564 INFO:tasks.workunit.client.0.smithi097.stderr: -38> 2024-09-14T11:05:43.428+0000 7f2d7622f800 5 asok(0x55e61521c270) register_command cache inspect hook 0x55e6154fd070 2024-09-14T11:05:43.564 INFO:tasks.workunit.client.0.smithi097.stderr: -37> 2024-09-14T11:05:43.428+0000 7f2d7622f800 5 asok(0x55e61521c270) register_command cache erase hook 0x55e6154fd070 2024-09-14T11:05:43.564 INFO:tasks.workunit.client.0.smithi097.stderr: -36> 2024-09-14T11:05:43.428+0000 7f2d7622f800 5 asok(0x55e61521c270) register_command cache zap hook 0x55e6154fd070 2024-09-14T11:05:43.564 INFO:tasks.workunit.client.0.smithi097.stderr: -35> 2024-09-14T11:05:43.428+0000 7f2d7622f800 5 note: GC not initialized 2024-09-14T11:05:43.564 INFO:tasks.workunit.client.0.smithi097.stderr: -34> 2024-09-14T11:05:43.428+0000 7f2c28fe1640 20 reqs_thread_entry: start 2024-09-14T11:05:43.565 INFO:tasks.workunit.client.0.smithi097.stderr: -33> 2024-09-14T11:05:43.428+0000 7f2d7622f800 5 asok(0x55e61521c270) register_command sync trace show hook 0x7f2d6c004720 2024-09-14T11:05:43.565 INFO:tasks.workunit.client.0.smithi097.stderr: -32> 2024-09-14T11:05:43.428+0000 7f2d7622f800 5 asok(0x55e61521c270) register_command sync trace history hook 0x7f2d6c004720 2024-09-14T11:05:43.565 INFO:tasks.workunit.client.0.smithi097.stderr: -31> 2024-09-14T11:05:43.428+0000 7f2d7622f800 5 asok(0x55e61521c270) register_command sync trace active hook 0x7f2d6c004720 2024-09-14T11:05:43.565 INFO:tasks.workunit.client.0.smithi097.stderr: -30> 2024-09-14T11:05:43.428+0000 7f2d7622f800 5 asok(0x55e61521c270) register_command sync trace active_short hook 0x7f2d6c004720 2024-09-14T11:05:43.565 INFO:tasks.workunit.client.0.smithi097.stderr: -29> 2024-09-14T11:05:43.428+0000 7f2d7622f800 20 init_complete bucket index max shards: 11 2024-09-14T11:05:43.565 INFO:tasks.workunit.client.0.smithi097.stderr: -28> 2024-09-14T11:05:43.428+0000 7f2d7622f800 20 Filter name: none 2024-09-14T11:05:43.565 INFO:tasks.workunit.client.0.smithi097.stderr: -27> 2024-09-14T11:05:43.428+0000 7f2ba27fc640 20 reqs_thread_entry: start 2024-09-14T11:05:43.565 INFO:tasks.workunit.client.0.smithi097.stderr: -26> 2024-09-14T11:05:43.428+0000 7f2d7622f800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:05:43.565 INFO:tasks.workunit.client.0.smithi097.stderr: -25> 2024-09-14T11:05:43.428+0000 7f2d7622f800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.565 INFO:tasks.workunit.client.0.smithi097.stderr: -24> 2024-09-14T11:05:43.429+0000 7f2d7622f800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:05:43.565 INFO:tasks.workunit.client.0.smithi097.stderr: -23> 2024-09-14T11:05:43.429+0000 7f2d7622f800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:05:43.565 INFO:tasks.workunit.client.0.smithi097.stderr: -22> 2024-09-14T11:05:43.429+0000 7f2d7622f800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:05:43.565 INFO:tasks.workunit.client.0.smithi097.stderr: -21> 2024-09-14T11:05:43.429+0000 7f2d7622f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 : miss 2024-09-14T11:05:43.566 INFO:tasks.workunit.client.0.smithi097.stderr: -20> 2024-09-14T11:05:43.429+0000 7f2d7622f800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.566 INFO:tasks.workunit.client.0.smithi097.stderr: -19> 2024-09-14T11:05:43.429+0000 7f2d7622f800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:05:43.566 INFO:tasks.workunit.client.0.smithi097.stderr: -18> 2024-09-14T11:05:43.429+0000 7f2d7622f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 info.flags=0x17 2024-09-14T11:05:43.566 INFO:tasks.workunit.client.0.smithi097.stderr: -17> 2024-09-14T11:05:43.429+0000 7f2d7622f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 to cache LRU end 2024-09-14T11:05:43.566 INFO:tasks.workunit.client.0.smithi097.stderr: -16> 2024-09-14T11:05:43.429+0000 7f2d7622f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:05:43.566 INFO:tasks.workunit.client.0.smithi097.stderr: -15> 2024-09-14T11:05:43.429+0000 7f2d7622f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:43.566 INFO:tasks.workunit.client.0.smithi097.stderr: -14> 2024-09-14T11:05:43.429+0000 7f2d7622f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 2024-09-14T11:05:43.566 INFO:tasks.workunit.client.0.smithi097.stderr: -13> 2024-09-14T11:05:43.434+0000 7f2d7622f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 info.flags=0x17 2024-09-14T11:05:43.566 INFO:tasks.workunit.client.0.smithi097.stderr: -12> 2024-09-14T11:05:43.434+0000 7f2d7622f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 to cache LRU end 2024-09-14T11:05:43.566 INFO:tasks.workunit.client.0.smithi097.stderr: -11> 2024-09-14T11:05:43.434+0000 7f2d7622f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:43.566 INFO:tasks.workunit.client.0.smithi097.stderr: -10> 2024-09-14T11:05:43.434+0000 7f2d7622f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34, ofs0, ns] 2024-09-14T11:05:43.566 INFO:tasks.workunit.client.0.smithi097.stderr: -9> 2024-09-14T11:05:43.435+0000 7f2c52ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595097 cookie 94446688647040 notifier 7121 bl.length()=911 2024-09-14T11:05:43.567 INFO:tasks.workunit.client.0.smithi097.stderr: -8> 2024-09-14T11:05:43.435+0000 7f2c52ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 info.flags=0x17 2024-09-14T11:05:43.567 INFO:tasks.workunit.client.0.smithi097.stderr: -7> 2024-09-14T11:05:43.435+0000 7f2c52ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 to cache LRU end 2024-09-14T11:05:43.567 INFO:tasks.workunit.client.0.smithi097.stderr: -6> 2024-09-14T11:05:43.435+0000 7f2c52ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:43.567 INFO:tasks.workunit.client.0.smithi097.stderr: -5> 2024-09-14T11:05:43.435+0000 7f2d7622f800 20 handle_bi_update(): bucket=:abort-at-do-reshard[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34]): orig_sources= new_sources= 2024-09-14T11:05:43.567 INFO:tasks.workunit.client.0.smithi097.stderr: -4> 2024-09-14T11:05:43.435+0000 7f2d7622f800 20 handle_bi_update(): bucket=:abort-at-do-reshard[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34]): potential sources added=[] removed=[] 2024-09-14T11:05:43.567 INFO:tasks.workunit.client.0.smithi097.stderr: -3> 2024-09-14T11:05:43.435+0000 7f2d7622f800 20 handle_bi_update(): bucket=:abort-at-do-reshard[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34]): orig_dests= new_dests= 2024-09-14T11:05:43.567 INFO:tasks.workunit.client.0.smithi097.stderr: -2> 2024-09-14T11:05:43.435+0000 7f2d7622f800 20 handle_bi_update(): bucket=:abort-at-do-reshard[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34]): potential dests added=[] removed=[] 2024-09-14T11:05:43.567 INFO:tasks.workunit.client.0.smithi097.stderr: -1> 2024-09-14T11:05:43.441+0000 7f2d7622f800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2d7622f800 time 2024-09-14T11:05:43.441327+0000 2024-09-14T11:05:43.567 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:05:43.567 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:43.567 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:05:43.567 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f2d7978c76a] 2024-09-14T11:05:43.567 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f2d7978c928] 2024-09-14T11:05:43.567 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e612c6c0b1] 2024-09-14T11:05:43.568 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55e612c7bf6a] 2024-09-14T11:05:43.568 INFO:tasks.workunit.client.0.smithi097.stderr: 5: main() 2024-09-14T11:05:43.568 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f2d78429590] 2024-09-14T11:05:43.568 INFO:tasks.workunit.client.0.smithi097.stderr: 7: __libc_start_main() 2024-09-14T11:05:43.568 INFO:tasks.workunit.client.0.smithi097.stderr: 8: _start() 2024-09-14T11:05:43.568 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:43.568 INFO:tasks.workunit.client.0.smithi097.stderr: 0> 2024-09-14T11:05:43.441+0000 7f2d7622f800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:05:43.568 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f2d7622f800 thread_name:radosgw-admin 2024-09-14T11:05:43.568 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:43.568 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:05:43.568 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f2d7843e6f0] 2024-09-14T11:05:43.568 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f2d7848b99c] 2024-09-14T11:05:43.568 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-14T11:05:43.568 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-14T11:05:43.569 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f2d7978c7c4] 2024-09-14T11:05:43.569 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f2d7978c928] 2024-09-14T11:05:43.569 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e612c6c0b1] 2024-09-14T11:05:43.569 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55e612c7bf6a] 2024-09-14T11:05:43.569 INFO:tasks.workunit.client.0.smithi097.stderr: 9: main() 2024-09-14T11:05:43.569 INFO:tasks.workunit.client.0.smithi097.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f2d78429590] 2024-09-14T11:05:43.569 INFO:tasks.workunit.client.0.smithi097.stderr: 11: __libc_start_main() 2024-09-14T11:05:43.569 INFO:tasks.workunit.client.0.smithi097.stderr: 12: _start() 2024-09-14T11:05:43.569 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:05:43.569 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:43.569 INFO:tasks.workunit.client.0.smithi097.stderr:--- logging levels --- 2024-09-14T11:05:43.569 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 none 2024-09-14T11:05:43.569 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 lockdep 2024-09-14T11:05:43.569 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 context 2024-09-14T11:05:43.570 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 crush 2024-09-14T11:05:43.570 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds 2024-09-14T11:05:43.570 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_balancer 2024-09-14T11:05:43.570 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_locker 2024-09-14T11:05:43.570 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log 2024-09-14T11:05:43.570 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log_expire 2024-09-14T11:05:43.570 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_migrator 2024-09-14T11:05:43.570 INFO:tasks.workunit.client.0.smithi097.stderr: 3/ 5 mds_quiesce 2024-09-14T11:05:43.570 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 buffer 2024-09-14T11:05:43.570 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 timer 2024-09-14T11:05:43.570 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 filer 2024-09-14T11:05:43.570 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 striper 2024-09-14T11:05:43.570 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 objecter 2024-09-14T11:05:43.570 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rados 2024-09-14T11:05:43.571 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd 2024-09-14T11:05:43.571 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_mirror 2024-09-14T11:05:43.571 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_replay 2024-09-14T11:05:43.571 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_pwl 2024-09-14T11:05:43.571 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 journaler 2024-09-14T11:05:43.571 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objectcacher 2024-09-14T11:05:43.571 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:05:43.571 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 client 2024-09-14T11:05:43.571 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 osd 2024-09-14T11:05:43.571 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 optracker 2024-09-14T11:05:43.571 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objclass 2024-09-14T11:05:43.571 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 filestore 2024-09-14T11:05:43.572 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 journal 2024-09-14T11:05:43.572 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 ms 2024-09-14T11:05:43.572 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mon 2024-09-14T11:05:43.572 INFO:tasks.workunit.client.0.smithi097.stderr: 0/10 monc 2024-09-14T11:05:43.572 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 paxos 2024-09-14T11:05:43.572 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 tp 2024-09-14T11:05:43.572 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 auth 2024-09-14T11:05:43.572 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 crypto 2024-09-14T11:05:43.572 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 finisher 2024-09-14T11:05:43.572 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 reserver 2024-09-14T11:05:43.572 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 heartbeatmap 2024-09-14T11:05:43.572 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 perfcounter 2024-09-14T11:05:43.572 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw 2024-09-14T11:05:43.572 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_sync 2024-09-14T11:05:43.573 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_datacache 2024-09-14T11:05:43.573 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_access 2024-09-14T11:05:43.573 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:05:43.573 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_flight 2024-09-14T11:05:43.573 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:05:43.573 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw_notification 2024-09-14T11:05:43.573 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 javaclient 2024-09-14T11:05:43.573 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 asok 2024-09-14T11:05:43.573 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 throttle 2024-09-14T11:05:43.573 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 refs 2024-09-14T11:05:43.573 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 compressor 2024-09-14T11:05:43.573 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluestore 2024-09-14T11:05:43.573 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluefs 2024-09-14T11:05:43.574 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 bdev 2024-09-14T11:05:43.574 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 kstore 2024-09-14T11:05:43.574 INFO:tasks.workunit.client.0.smithi097.stderr: 4/ 5 rocksdb 2024-09-14T11:05:43.574 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 fuse 2024-09-14T11:05:43.574 INFO:tasks.workunit.client.0.smithi097.stderr: 2/ 5 mgr 2024-09-14T11:05:43.574 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mgrc 2024-09-14T11:05:43.574 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 dpdk 2024-09-14T11:05:43.574 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 eventtrace 2024-09-14T11:05:43.574 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 prioritycache 2024-09-14T11:05:43.574 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 test 2024-09-14T11:05:43.574 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:05:43.574 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephsqlite 2024-09-14T11:05:43.574 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:05:43.574 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore 2024-09-14T11:05:43.575 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_onode 2024-09-14T11:05:43.575 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_odata 2024-09-14T11:05:43.575 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_omap 2024-09-14T11:05:43.575 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_tm 2024-09-14T11:05:43.575 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_t 2024-09-14T11:05:43.575 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:05:43.575 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_epm 2024-09-14T11:05:43.575 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_lba 2024-09-14T11:05:43.575 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:05:43.575 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cache 2024-09-14T11:05:43.575 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_journal 2024-09-14T11:05:43.575 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_device 2024-09-14T11:05:43.575 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_backref 2024-09-14T11:05:43.575 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 alienstore 2024-09-14T11:05:43.575 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mclock 2024-09-14T11:05:43.576 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cyanstore 2024-09-14T11:05:43.576 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 ceph_exporter 2024-09-14T11:05:43.576 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 memstore 2024-09-14T11:05:43.576 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 trace 2024-09-14T11:05:43.576 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 ceph_dedup 2024-09-14T11:05:43.576 INFO:tasks.workunit.client.0.smithi097.stderr: -2/-2 (syslog threshold) 2024-09-14T11:05:43.576 INFO:tasks.workunit.client.0.smithi097.stderr: 99/99 (stderr threshold) 2024-09-14T11:05:43.576 INFO:tasks.workunit.client.0.smithi097.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:05:43.576 INFO:tasks.workunit.client.0.smithi097.stderr: 7f2ba27fc640 / http_manager 2024-09-14T11:05:43.576 INFO:tasks.workunit.client.0.smithi097.stderr: 7f2c28fe1640 / http_manager 2024-09-14T11:05:43.576 INFO:tasks.workunit.client.0.smithi097.stderr: 7f2c29fe3640 / rgw_dt_lg_renew 2024-09-14T11:05:43.576 INFO:tasks.workunit.client.0.smithi097.stderr: 7f2c517fa640 / ms_dispatch 2024-09-14T11:05:43.576 INFO:tasks.workunit.client.0.smithi097.stderr: 7f2c52ffd640 / io_context_pool 2024-09-14T11:05:43.576 INFO:tasks.workunit.client.0.smithi097.stderr: 7f2c597fa640 / ms_dispatch 2024-09-14T11:05:43.576 INFO:tasks.workunit.client.0.smithi097.stderr: 7f2c5bfff640 / ms_dispatch 2024-09-14T11:05:43.577 INFO:tasks.workunit.client.0.smithi097.stderr: 7f2c61e0b640 / io_context_pool 2024-09-14T11:05:43.577 INFO:tasks.workunit.client.0.smithi097.stderr: 7f2d7351f640 / msgr-worker-2 2024-09-14T11:05:43.577 INFO:tasks.workunit.client.0.smithi097.stderr: 7f2d73d20640 / msgr-worker-1 2024-09-14T11:05:43.577 INFO:tasks.workunit.client.0.smithi097.stderr: 7f2d74521640 / msgr-worker-0 2024-09-14T11:05:43.577 INFO:tasks.workunit.client.0.smithi097.stderr: 7f2d74d22640 / io_context_pool 2024-09-14T11:05:43.577 INFO:tasks.workunit.client.0.smithi097.stderr: 7f2d7622f800 / radosgw-admin 2024-09-14T11:05:43.577 INFO:tasks.workunit.client.0.smithi097.stderr: max_recent 500 2024-09-14T11:05:43.577 INFO:tasks.workunit.client.0.smithi097.stderr: max_new 1000 2024-09-14T11:05:43.577 INFO:tasks.workunit.client.0.smithi097.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:05:43.442747Z_f12d45a5-a447-4e0f-aa37-9bae7accbcbc/log 2024-09-14T11:05:43.577 INFO:tasks.workunit.client.0.smithi097.stderr:--- end dump of recent events --- 2024-09-14T11:05:43.577 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-14T11:05:43.579 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:05:43.579 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:05:43.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.517+0000 7f1bb3faf800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.519+0000 7f1bb3faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:43.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.519+0000 7f1bb3faf800 20 realm 2024-09-14T11:05:43.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.519+0000 7f1bb3faf800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.519+0000 7f1bb3faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:43.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.519+0000 7f1bb3faf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:05:43.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.519+0000 7f1bb3faf800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.579 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.519+0000 7f1bb3faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:43.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.519+0000 7f1bb3faf800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.520+0000 7f1bb3faf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:43.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.520+0000 7f1bb3faf800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.521+0000 7f1bb3faf800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:05:43.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.521+0000 7f1bb3faf800 20 searching for the correct realm 2024-09-14T11:05:43.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.523+0000 7f1ba9298640 0 -- 172.21.15.97:0/3970688020 >> [v2:172.21.15.97:6816/4093696477,v1:172.21.15.97:6817/4093696477] conn(0x5597a463b050 msgr2=0x5597a463d440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:05:43.580 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.526+0000 7f1ba9298640 0 -- 172.21.15.97:0/3970688020 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f1ba4025040 msgr2=0x7f1ba4071740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:05:43.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.733+0000 7f1bb3faf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:05:43.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.733+0000 7f1bb3faf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:05:43.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.733+0000 7f1bb3faf800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:05:43.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.733+0000 7f1bb3faf800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:05:43.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.733+0000 7f1bb3faf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:05:43.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.733+0000 7f1bb3faf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:05:43.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.733+0000 7f1bb3faf800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.733+0000 7f1bb3faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:43.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.733+0000 7f1bb3faf800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.734+0000 7f1bb3faf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:43.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.734+0000 7f1bb3faf800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.734+0000 7f1bb3faf800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:05:43.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.734+0000 7f1bb3faf800 20 zone default found 2024-09-14T11:05:43.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.734+0000 7f1bb3faf800 4 Realm: () 2024-09-14T11:05:43.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.734+0000 7f1bb3faf800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:05:43.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.734+0000 7f1bb3faf800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:05:43.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.734+0000 7f1bb3faf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:05:43.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.734+0000 7f1bb3faf800 20 zonegroup default 2024-09-14T11:05:43.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.734+0000 7f1bb3faf800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.734+0000 7f1bb3faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:43.735 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.734+0000 7f1bb3faf800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.735 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.735+0000 7f1bb3faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:43.735 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.735+0000 7f1bb3faf800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.735 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.735+0000 7f1bb3faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:43.735 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.735+0000 7f1bb3faf800 20 started sync module instance, tier type = 2024-09-14T11:05:43.735 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.735+0000 7f1bb3faf800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:05:43.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.743+0000 7f1bb3faf800 20 add_watcher() i=0 2024-09-14T11:05:43.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.743+0000 7f1bb3faf800 20 add_watcher() i=1 2024-09-14T11:05:43.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.743+0000 7f1bb3faf800 20 add_watcher() i=2 2024-09-14T11:05:43.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.743+0000 7f1bb3faf800 20 add_watcher() i=3 2024-09-14T11:05:43.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.743+0000 7f1bb3faf800 20 add_watcher() i=4 2024-09-14T11:05:43.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.743+0000 7f1bb3faf800 20 add_watcher() i=5 2024-09-14T11:05:43.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.743+0000 7f1bb3faf800 20 add_watcher() i=6 2024-09-14T11:05:43.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.744+0000 7f1bb3faf800 20 add_watcher() i=7 2024-09-14T11:05:43.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.744+0000 7f1bb3faf800 2 all 8 watchers are set, enabling cache 2024-09-14T11:05:43.744 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.746+0000 7f1a637fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:43.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.746+0000 7f1bb3faf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:05:43.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.746+0000 7f1bb3faf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:05:43.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.746+0000 7f1bb3faf800 5 note: GC not initialized 2024-09-14T11:05:43.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.746+0000 7f1a627fc640 20 reqs_thread_entry: start 2024-09-14T11:05:43.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.746+0000 7f1bb3faf800 20 init_complete bucket index max shards: 11 2024-09-14T11:05:43.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.746+0000 7f1bb3faf800 20 Filter name: none 2024-09-14T11:05:43.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.747+0000 7f19d3fff640 20 reqs_thread_entry: start 2024-09-14T11:05:43.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.747+0000 7f1bb3faf800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.747+0000 7f1bb3faf800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:05:43.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.747+0000 7f1bb3faf800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.748+0000 7f1bb3faf800 20 rados_obj.operate() r=0 bl.length=441 2024-09-14T11:05:43.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.748+0000 7f1bb3faf800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:05:43.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.748+0000 7f1bb3faf800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.748+0000 7f1bb3faf800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:05:43.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.748+0000 7f1bb3faf800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.748+0000 7f1bb3faf800 20 rados_obj.operate() r=0 bl.length=441 2024-09-14T11:05:43.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.748+0000 7f1bb3faf800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:05:43.748 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.750+0000 7f1a637fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:43.750 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.752+0000 7f1bb3faf800 20 remove_watcher() i=0 2024-09-14T11:05:43.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.752+0000 7f1bb3faf800 2 removed watcher, disabling cache 2024-09-14T11:05:43.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.753+0000 7f1bb3faf800 20 remove_watcher() i=1 2024-09-14T11:05:43.752 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.754+0000 7f1bb3faf800 20 remove_watcher() i=2 2024-09-14T11:05:43.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.755+0000 7f1bb3faf800 20 remove_watcher() i=3 2024-09-14T11:05:43.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.756+0000 7f1bb3faf800 20 remove_watcher() i=4 2024-09-14T11:05:43.755 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.757+0000 7f1bb3faf800 20 remove_watcher() i=5 2024-09-14T11:05:43.756 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.758+0000 7f1bb3faf800 20 remove_watcher() i=6 2024-09-14T11:05:43.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.758+0000 7f1bb3faf800 20 remove_watcher() i=7 2024-09-14T11:05:43.768 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:43.768 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:05:43.768 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: abort-at-do-reshard id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:05:43.768 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:05:43.819 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:05:43.850 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:05:43.850 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:05:43.887 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.889+0000 7fec1fd35800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.890+0000 7fec1fd35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:43.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.890+0000 7fec1fd35800 20 realm 2024-09-14T11:05:43.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.890+0000 7fec1fd35800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.890+0000 7fec1fd35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:43.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.890+0000 7fec1fd35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:05:43.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.890+0000 7fec1fd35800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.890+0000 7fec1fd35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:43.889 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.890+0000 7fec1fd35800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.891+0000 7fec1fd35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:43.890 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.891+0000 7fec1fd35800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.892+0000 7fec1fd35800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:05:43.891 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.892+0000 7fec1fd35800 20 searching for the correct realm 2024-09-14T11:05:43.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.894+0000 7fec1bae4640 0 -- 172.21.15.97:0/359406019 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x55c3fae76c30 msgr2=0x55c3fae790d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:05:43.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.897+0000 7fec1bae4640 0 -- 172.21.15.97:0/359406019 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7fec040af100 msgr2=0x7fec040aead0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:05:43.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.902+0000 7fec1fd35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:05:43.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.902+0000 7fec1fd35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:05:43.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.902+0000 7fec1fd35800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:05:43.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.902+0000 7fec1fd35800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:05:43.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.902+0000 7fec1fd35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:05:43.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.902+0000 7fec1fd35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:05:43.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.902+0000 7fec1fd35800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.902+0000 7fec1fd35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:43.901 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.902+0000 7fec1fd35800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.903+0000 7fec1fd35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:05:43.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.903+0000 7fec1fd35800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.903+0000 7fec1fd35800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:05:43.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.903+0000 7fec1fd35800 20 zone default found 2024-09-14T11:05:43.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.903+0000 7fec1fd35800 4 Realm: () 2024-09-14T11:05:43.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.903+0000 7fec1fd35800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:05:43.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.903+0000 7fec1fd35800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:05:43.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.903+0000 7fec1fd35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:05:43.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.903+0000 7fec1fd35800 20 zonegroup default 2024-09-14T11:05:43.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.903+0000 7fec1fd35800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.903+0000 7fec1fd35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:43.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.903+0000 7fec1fd35800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.904+0000 7fec1fd35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:43.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.904+0000 7fec1fd35800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.904+0000 7fec1fd35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:05:43.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.904+0000 7fec1fd35800 20 started sync module instance, tier type = 2024-09-14T11:05:43.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.904+0000 7fec1fd35800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:05:43.914 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.916+0000 7fec1fd35800 20 add_watcher() i=0 2024-09-14T11:05:43.915 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.916+0000 7fec1fd35800 20 add_watcher() i=1 2024-09-14T11:05:43.915 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.916+0000 7fec1fd35800 20 add_watcher() i=2 2024-09-14T11:05:43.915 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.916+0000 7fec1fd35800 20 add_watcher() i=3 2024-09-14T11:05:43.915 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.916+0000 7fec1fd35800 20 add_watcher() i=4 2024-09-14T11:05:43.915 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.916+0000 7fec1fd35800 20 add_watcher() i=5 2024-09-14T11:05:43.915 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.916+0000 7fec1fd35800 20 add_watcher() i=6 2024-09-14T11:05:43.915 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.917+0000 7fec1fd35800 20 add_watcher() i=7 2024-09-14T11:05:43.915 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.917+0000 7fec1fd35800 2 all 8 watchers are set, enabling cache 2024-09-14T11:05:43.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.918+0000 7fead1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:43.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.919+0000 7fec1fd35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:05:43.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.919+0000 7fec1fd35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:05:43.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.919+0000 7fec1fd35800 5 note: GC not initialized 2024-09-14T11:05:43.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.919+0000 7fead0fe1640 20 reqs_thread_entry: start 2024-09-14T11:05:43.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.919+0000 7fec1fd35800 20 init_complete bucket index max shards: 11 2024-09-14T11:05:43.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.919+0000 7fec1fd35800 20 Filter name: none 2024-09-14T11:05:43.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.919+0000 7fea4a7fc640 20 reqs_thread_entry: start 2024-09-14T11:05:43.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.919+0000 7fec1fd35800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:05:43.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.919+0000 7fec1fd35800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.920+0000 7fec1fd35800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:05:43.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.920+0000 7fec1fd35800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:05:43.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.920+0000 7fec1fd35800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:05:43.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.920+0000 7fec1fd35800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 : miss 2024-09-14T11:05:43.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.920+0000 7fec1fd35800 20 rados->read ofs=0 len=0 2024-09-14T11:05:43.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.920+0000 7fec1fd35800 20 rados_obj.operate() r=0 bl.length=441 2024-09-14T11:05:43.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.920+0000 7fec1fd35800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 info.flags=0x17 2024-09-14T11:05:43.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.920+0000 7fec1fd35800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 to cache LRU end 2024-09-14T11:05:43.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.920+0000 7fec1fd35800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:05:43.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.920+0000 7fec1fd35800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:05:43.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.920+0000 7fec1fd35800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 2024-09-14T11:05:43.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.921+0000 7fec1fd35800 0 INFO: RGWReshardLock::lock found lock on abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 to be held by another RGW process; skipping for now 2024-09-14T11:05:43.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.922+0000 7fead1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:05:43.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.925+0000 7fec1fd35800 20 remove_watcher() i=0 2024-09-14T11:05:43.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.925+0000 7fec1fd35800 2 removed watcher, disabling cache 2024-09-14T11:05:43.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.926+0000 7fec1fd35800 20 remove_watcher() i=1 2024-09-14T11:05:43.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.927+0000 7fec1fd35800 20 remove_watcher() i=2 2024-09-14T11:05:43.927 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.928+0000 7fec1fd35800 20 remove_watcher() i=3 2024-09-14T11:05:43.928 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.929+0000 7fec1fd35800 20 remove_watcher() i=4 2024-09-14T11:05:43.928 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.930+0000 7fec1fd35800 20 remove_watcher() i=5 2024-09-14T11:05:43.930 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.931+0000 7fec1fd35800 20 remove_watcher() i=6 2024-09-14T11:05:43.930 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:05:43.932+0000 7fec1fd35800 20 remove_watcher() i=7 2024-09-14T11:05:43.940 INFO:tasks.workunit.client.0.smithi097.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:06:13.955 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:06:13.989 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:06:13.990 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:06:14.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.033+0000 7f731cf73800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.035+0000 7f731cf73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:14.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.035+0000 7f731cf73800 20 realm 2024-09-14T11:06:14.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.035+0000 7f731cf73800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.036+0000 7f731cf73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:14.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.036+0000 7f731cf73800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:06:14.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.036+0000 7f731cf73800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.036+0000 7f731cf73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:14.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.036+0000 7f731cf73800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.037+0000 7f731cf73800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:14.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.037+0000 7f731cf73800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.036 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.038+0000 7f731cf73800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:06:14.036 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.038+0000 7f731cf73800 20 searching for the correct realm 2024-09-14T11:06:14.039 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.040+0000 7f731b25e640 0 -- 172.21.15.97:0/3146093380 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f730408ac20 msgr2=0x7f73040673d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:14.245 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.247+0000 7f731a25c640 0 -- 172.21.15.97:0/3146093380 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f730c0af0d0 msgr2=0x7f730c0c87d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:14.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.252+0000 7f731cf73800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:06:14.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.252+0000 7f731cf73800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:06:14.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.252+0000 7f731cf73800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:06:14.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.252+0000 7f731cf73800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:06:14.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.252+0000 7f731cf73800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:06:14.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.252+0000 7f731cf73800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:06:14.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.252+0000 7f731cf73800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.252+0000 7f731cf73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:14.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.252+0000 7f731cf73800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.253+0000 7f731cf73800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:14.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.253+0000 7f731cf73800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.253 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.253+0000 7f731cf73800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:06:14.253 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.253+0000 7f731cf73800 20 zone default found 2024-09-14T11:06:14.253 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.253+0000 7f731cf73800 4 Realm: () 2024-09-14T11:06:14.253 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.253+0000 7f731cf73800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:06:14.254 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.253+0000 7f731cf73800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:06:14.254 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.253+0000 7f731cf73800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:06:14.254 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.253+0000 7f731cf73800 20 zonegroup default 2024-09-14T11:06:14.254 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.253+0000 7f731cf73800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.254 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.253+0000 7f731cf73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:14.254 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.253+0000 7f731cf73800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.254 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.254+0000 7f731cf73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:14.254 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.254+0000 7f731cf73800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.254 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.254+0000 7f731cf73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:14.254 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.254+0000 7f731cf73800 20 started sync module instance, tier type = 2024-09-14T11:06:14.254 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.254+0000 7f731cf73800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:06:14.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.264+0000 7f731cf73800 20 add_watcher() i=0 2024-09-14T11:06:14.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.264+0000 7f731cf73800 20 add_watcher() i=1 2024-09-14T11:06:14.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.264+0000 7f731cf73800 20 add_watcher() i=2 2024-09-14T11:06:14.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.264+0000 7f731cf73800 20 add_watcher() i=3 2024-09-14T11:06:14.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.264+0000 7f731cf73800 20 add_watcher() i=4 2024-09-14T11:06:14.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.264+0000 7f731cf73800 20 add_watcher() i=5 2024-09-14T11:06:14.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.264+0000 7f731cf73800 20 add_watcher() i=6 2024-09-14T11:06:14.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.265+0000 7f731cf73800 20 add_watcher() i=7 2024-09-14T11:06:14.264 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.265+0000 7f731cf73800 2 all 8 watchers are set, enabling cache 2024-09-14T11:06:14.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.267+0000 7f71d17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:14.266 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.267+0000 7f731cf73800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:06:14.266 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.267+0000 7f731cf73800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:06:14.266 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.267+0000 7f731cf73800 5 note: GC not initialized 2024-09-14T11:06:14.266 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.267+0000 7f714bfff640 20 reqs_thread_entry: start 2024-09-14T11:06:14.266 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.267+0000 7f731cf73800 20 init_complete bucket index max shards: 11 2024-09-14T11:06:14.267 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.267+0000 7f731cf73800 20 Filter name: none 2024-09-14T11:06:14.267 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.268+0000 7f7149ffb640 20 reqs_thread_entry: start 2024-09-14T11:06:14.267 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.268+0000 7f731cf73800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:06:14.267 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.268+0000 7f731cf73800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.267 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.268+0000 7f731cf73800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:06:14.268 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.268+0000 7f731cf73800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:06:14.268 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.268+0000 7f731cf73800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:06:14.268 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.268+0000 7f731cf73800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 : miss 2024-09-14T11:06:14.268 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.268+0000 7f731cf73800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.268 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.269+0000 7f731cf73800 20 rados_obj.operate() r=0 bl.length=441 2024-09-14T11:06:14.268 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.269+0000 7f731cf73800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 info.flags=0x17 2024-09-14T11:06:14.268 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.269+0000 7f731cf73800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 to cache LRU end 2024-09-14T11:06:14.268 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.269+0000 7f731cf73800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:06:14.268 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.269+0000 7f731cf73800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:14.268 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.269+0000 7f731cf73800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 2024-09-14T11:06:14.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.270+0000 7f731cf73800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:06:14.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.277+0000 7f731cf73800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 info.flags=0x17 2024-09-14T11:06:14.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.277+0000 7f731cf73800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 to cache LRU end 2024-09-14T11:06:14.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.277+0000 7f731cf73800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:14.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.277+0000 7f731cf73800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34, ofs0, ns] 2024-09-14T11:06:14.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.277+0000 7f71fe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595098 cookie 93861074612320 notifier 7614 bl.length()=911 2024-09-14T11:06:14.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.277+0000 7f71fe7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 info.flags=0x17 2024-09-14T11:06:14.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.277+0000 7f71fe7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 to cache LRU end 2024-09-14T11:06:14.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.277+0000 7f71fe7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:14.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.277+0000 7f731cf73800 20 handle_bi_update(): bucket=:abort-at-do-reshard[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34]): orig_sources= new_sources= 2024-09-14T11:06:14.277 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.277+0000 7f731cf73800 20 handle_bi_update(): bucket=:abort-at-do-reshard[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34]): potential sources added=[] removed=[] 2024-09-14T11:06:14.277 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.277+0000 7f731cf73800 20 handle_bi_update(): bucket=:abort-at-do-reshard[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34]): orig_dests= new_dests= 2024-09-14T11:06:14.277 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.277+0000 7f731cf73800 20 handle_bi_update(): bucket=:abort-at-do-reshard[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34]): potential dests added=[] removed=[] 2024-09-14T11:06:14.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.283+0000 7f731cf73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34.2.0 2024-09-14T11:06:14.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.283+0000 7f731cf73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34.2.0 2024-09-14T11:06:14.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.283+0000 7f731cf73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34.2.1 2024-09-14T11:06:14.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.283+0000 7f731cf73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34.2.1 2024-09-14T11:06:14.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.283+0000 7f731cf73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34.2.2 2024-09-14T11:06:14.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.283+0000 7f731cf73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34.2.2 2024-09-14T11:06:14.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.283+0000 7f731cf73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34.2.3 2024-09-14T11:06:14.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.283+0000 7f731cf73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34.2.3 2024-09-14T11:06:14.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.283+0000 7f731cf73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34.2.4 2024-09-14T11:06:14.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.283+0000 7f731cf73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34.2.4 2024-09-14T11:06:14.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.283+0000 7f731cf73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34.2.5 2024-09-14T11:06:14.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.283+0000 7f731cf73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34.2.5 2024-09-14T11:06:14.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.283+0000 7f731cf73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34.2.6 2024-09-14T11:06:14.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.283+0000 7f731cf73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34.2.6 2024-09-14T11:06:14.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.283+0000 7f731cf73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34.2.7 2024-09-14T11:06:14.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.283+0000 7f731cf73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34.2.7 2024-09-14T11:06:14.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.283+0000 7f731cf73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34.2.8 2024-09-14T11:06:14.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.283+0000 7f731cf73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34.2.8 2024-09-14T11:06:14.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.283+0000 7f731cf73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34.2.9 2024-09-14T11:06:14.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.283+0000 7f731cf73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34.2.9 2024-09-14T11:06:14.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.283+0000 7f731cf73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34.2.10 2024-09-14T11:06:14.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.283+0000 7f731cf73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34.2.10 2024-09-14T11:06:14.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.283+0000 7f731cf73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34.2.11 2024-09-14T11:06:14.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.283+0000 7f731cf73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34.2.11 2024-09-14T11:06:14.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.283+0000 7f731cf73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34.0 2024-09-14T11:06:14.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.283+0000 7f731cf73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34.1 2024-09-14T11:06:14.284 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.284+0000 7f731cf73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34.2 2024-09-14T11:06:14.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.284+0000 7f731cf73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34.3 2024-09-14T11:06:14.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.284+0000 7f731cf73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34.4 2024-09-14T11:06:14.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.285+0000 7f731cf73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34.5 2024-09-14T11:06:14.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.285+0000 7f731cf73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34.6 2024-09-14T11:06:14.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.286+0000 7f731cf73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34.7 2024-09-14T11:06:14.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.287+0000 7f731cf73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34.8 2024-09-14T11:06:14.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.287+0000 7f731cf73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34.9 2024-09-14T11:06:14.286 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.288+0000 7f731cf73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34.10 2024-09-14T11:06:14.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.291+0000 7f731cf73800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 : hit (requested=0x17, cached=0x17) 2024-09-14T11:06:14.289 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.291+0000 7f731cf73800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 2024-09-14T11:06:14.291 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.292+0000 7f731cf73800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 info.flags=0x17 2024-09-14T11:06:14.291 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.292+0000 7f731cf73800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 to cache LRU end 2024-09-14T11:06:14.291 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.292+0000 7f731cf73800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:14.291 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.292+0000 7f731cf73800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34, ofs0, ns] 2024-09-14T11:06:14.291 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.292+0000 7f71fe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595099 cookie 93861074612320 notifier 7614 bl.length()=911 2024-09-14T11:06:14.291 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.292+0000 7f71fe7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 info.flags=0x17 2024-09-14T11:06:14.291 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.292+0000 7f71fe7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 to cache LRU end 2024-09-14T11:06:14.291 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.292+0000 7f71fe7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:14.292 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.293+0000 7f731cf73800 20 handle_bi_update(): bucket=:abort-at-do-reshard[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34]): orig_sources= new_sources= 2024-09-14T11:06:14.292 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.293+0000 7f731cf73800 20 handle_bi_update(): bucket=:abort-at-do-reshard[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34]): potential sources added=[] removed=[] 2024-09-14T11:06:14.292 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.293+0000 7f731cf73800 20 handle_bi_update(): bucket=:abort-at-do-reshard[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34]): orig_dests= new_dests= 2024-09-14T11:06:14.292 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.293+0000 7f731cf73800 20 handle_bi_update(): bucket=:abort-at-do-reshard[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34]): potential dests added=[] removed=[] 2024-09-14T11:06:14.294 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.295+0000 7f731cf73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34.0 2024-09-14T11:06:14.294 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.296+0000 7f731cf73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34.1 2024-09-14T11:06:14.294 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.296+0000 7f731cf73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34.2 2024-09-14T11:06:14.295 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.296+0000 7f731cf73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34.3 2024-09-14T11:06:14.295 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.296+0000 7f731cf73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34.4 2024-09-14T11:06:14.295 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.297+0000 7f731cf73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34.5 2024-09-14T11:06:14.295 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.297+0000 7f731cf73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34.6 2024-09-14T11:06:14.296 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.297+0000 7f731cf73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34.7 2024-09-14T11:06:14.296 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.298+0000 7f731cf73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34.8 2024-09-14T11:06:14.296 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.298+0000 7f731cf73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34.9 2024-09-14T11:06:14.297 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.298+0000 7f731cf73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34.10 2024-09-14T11:06:14.297 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.299+0000 7f731cf73800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 : hit (requested=0x17, cached=0x17) 2024-09-14T11:06:14.297 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.299+0000 7f731cf73800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 2024-09-14T11:06:14.298 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.300+0000 7f731cf73800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 info.flags=0x17 2024-09-14T11:06:14.299 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.300+0000 7f731cf73800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 to cache LRU end 2024-09-14T11:06:14.299 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.300+0000 7f731cf73800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:14.299 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.300+0000 7f731cf73800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34, ofs0, ns] 2024-09-14T11:06:14.299 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.300+0000 7f71fdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595100 cookie 93861074612320 notifier 7614 bl.length()=879 2024-09-14T11:06:14.299 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.300+0000 7f71fdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 info.flags=0x17 2024-09-14T11:06:14.299 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.300+0000 7f71fdffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 to cache LRU end 2024-09-14T11:06:14.299 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.300+0000 7f71fdffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:14.300 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.301+0000 7f731cf73800 20 handle_bi_update(): bucket=:abort-at-do-reshard[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34]): orig_sources= new_sources= 2024-09-14T11:06:14.300 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.301+0000 7f731cf73800 20 handle_bi_update(): bucket=:abort-at-do-reshard[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34]): potential sources added=[] removed=[] 2024-09-14T11:06:14.300 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.301+0000 7f731cf73800 20 handle_bi_update(): bucket=:abort-at-do-reshard[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34]): orig_dests= new_dests= 2024-09-14T11:06:14.300 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.301+0000 7f731cf73800 20 handle_bi_update(): bucket=:abort-at-do-reshard[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34]): potential dests added=[] removed=[] 2024-09-14T11:06:14.301 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.303+0000 7f731cf73800 1 execute INFO: reshard of bucket "abort-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-14T11:06:14.303 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.305+0000 7f71d17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:14.305 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.307+0000 7f731cf73800 20 remove_watcher() i=0 2024-09-14T11:06:14.305 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.307+0000 7f731cf73800 2 removed watcher, disabling cache 2024-09-14T11:06:14.307 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.308+0000 7f731cf73800 20 remove_watcher() i=1 2024-09-14T11:06:14.308 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.309+0000 7f731cf73800 20 remove_watcher() i=2 2024-09-14T11:06:14.309 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.310+0000 7f731cf73800 20 remove_watcher() i=3 2024-09-14T11:06:14.310 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.311+0000 7f731cf73800 20 remove_watcher() i=4 2024-09-14T11:06:14.311 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.312+0000 7f731cf73800 20 remove_watcher() i=5 2024-09-14T11:06:14.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.313+0000 7f731cf73800 20 remove_watcher() i=6 2024-09-14T11:06:14.313 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.314+0000 7f731cf73800 20 remove_watcher() i=7 2024-09-14T11:06:14.325 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-14T11:06:14.354 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:06:14.354 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:06:14.391 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.392+0000 7ff8715af800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.394+0000 7ff8715af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:14.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.394+0000 7ff8715af800 20 realm 2024-09-14T11:06:14.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.394+0000 7ff8715af800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.394+0000 7ff8715af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:14.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.394+0000 7ff8715af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:06:14.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.394+0000 7ff8715af800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.394+0000 7ff8715af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:14.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.394+0000 7ff8715af800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.395+0000 7ff8715af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:14.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.395+0000 7ff8715af800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.396+0000 7ff8715af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:06:14.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.396+0000 7ff8715af800 20 searching for the correct realm 2024-09-14T11:06:14.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.398+0000 7ff86f099640 0 -- 172.21.15.97:0/1485208726 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x5619352464c0 msgr2=0x5619352488e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:14.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.401+0000 7ff86f099640 0 -- 172.21.15.97:0/1485208726 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7ff858086410 msgr2=0x7ff858086890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:14.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.406+0000 7ff8715af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:06:14.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.406+0000 7ff8715af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:06:14.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.406+0000 7ff8715af800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:06:14.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.406+0000 7ff8715af800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:06:14.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.406+0000 7ff8715af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:06:14.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.406+0000 7ff8715af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:06:14.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.406+0000 7ff8715af800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.406+0000 7ff8715af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:14.406 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.406+0000 7ff8715af800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.406 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.406+0000 7ff8715af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:14.406 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.406+0000 7ff8715af800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.407+0000 7ff8715af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:06:14.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.407+0000 7ff8715af800 20 zone default found 2024-09-14T11:06:14.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.407+0000 7ff8715af800 4 Realm: () 2024-09-14T11:06:14.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.407+0000 7ff8715af800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:06:14.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.407+0000 7ff8715af800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:06:14.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.407+0000 7ff8715af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:06:14.407 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.407+0000 7ff8715af800 20 zonegroup default 2024-09-14T11:06:14.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.407+0000 7ff8715af800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.407+0000 7ff8715af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:14.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.407+0000 7ff8715af800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.407+0000 7ff8715af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:14.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.407+0000 7ff8715af800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.407+0000 7ff8715af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:14.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.407+0000 7ff8715af800 20 started sync module instance, tier type = 2024-09-14T11:06:14.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.407+0000 7ff8715af800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:06:14.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.415+0000 7ff8715af800 20 add_watcher() i=0 2024-09-14T11:06:14.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.415+0000 7ff8715af800 20 add_watcher() i=1 2024-09-14T11:06:14.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.415+0000 7ff8715af800 20 add_watcher() i=2 2024-09-14T11:06:14.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.415+0000 7ff8715af800 20 add_watcher() i=3 2024-09-14T11:06:14.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.415+0000 7ff8715af800 20 add_watcher() i=4 2024-09-14T11:06:14.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.415+0000 7ff8715af800 20 add_watcher() i=5 2024-09-14T11:06:14.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.416+0000 7ff8715af800 20 add_watcher() i=6 2024-09-14T11:06:14.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.416+0000 7ff8715af800 20 add_watcher() i=7 2024-09-14T11:06:14.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.416+0000 7ff8715af800 2 all 8 watchers are set, enabling cache 2024-09-14T11:06:14.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.418+0000 7ff725fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:14.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.419+0000 7ff8715af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:06:14.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.419+0000 7ff8715af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:06:14.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.419+0000 7ff8715af800 5 note: GC not initialized 2024-09-14T11:06:14.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.419+0000 7ff724fe1640 20 reqs_thread_entry: start 2024-09-14T11:06:14.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.419+0000 7ff8715af800 20 init_complete bucket index max shards: 11 2024-09-14T11:06:14.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.419+0000 7ff8715af800 20 Filter name: none 2024-09-14T11:06:14.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.419+0000 7ff69e7fc640 20 reqs_thread_entry: start 2024-09-14T11:06:14.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.419+0000 7ff8715af800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.419 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.420+0000 7ff8715af800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:06:14.419 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.420+0000 7ff8715af800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.420+0000 7ff8715af800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:06:14.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.420+0000 7ff8715af800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:06:14.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.420+0000 7ff8715af800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.421+0000 7ff8715af800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:06:14.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.421+0000 7ff8715af800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.421+0000 7ff8715af800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:06:14.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.421+0000 7ff8715af800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:06:14.421 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.423+0000 7ff725fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:14.423 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.425+0000 7ff8715af800 20 remove_watcher() i=0 2024-09-14T11:06:14.423 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.425+0000 7ff8715af800 2 removed watcher, disabling cache 2024-09-14T11:06:14.424 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.426+0000 7ff8715af800 20 remove_watcher() i=1 2024-09-14T11:06:14.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.427+0000 7ff8715af800 20 remove_watcher() i=2 2024-09-14T11:06:14.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.428+0000 7ff8715af800 20 remove_watcher() i=3 2024-09-14T11:06:14.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.429+0000 7ff8715af800 20 remove_watcher() i=4 2024-09-14T11:06:14.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.430+0000 7ff8715af800 20 remove_watcher() i=5 2024-09-14T11:06:14.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.431+0000 7ff8715af800 20 remove_watcher() i=6 2024-09-14T11:06:14.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.431+0000 7ff8715af800 20 remove_watcher() i=7 2024-09-14T11:06:14.440 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:14.440 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:06:14.440 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: abort-at-do-reshard id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:06:14.440 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:14.515 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: reshard bucket with EIO injected at logrecord_writes 2024-09-14T11:06:14.515 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:14.714 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-14T11:06:14.743 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:06:14.743 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:06:14.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.780+0000 7f48f070c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.781 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.782+0000 7f48f070c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:14.781 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.782+0000 7f48f070c800 20 realm 2024-09-14T11:06:14.781 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.782+0000 7f48f070c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.781 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.782+0000 7f48f070c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:14.781 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.782+0000 7f48f070c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:06:14.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.782+0000 7f48f070c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.782+0000 7f48f070c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:14.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.783+0000 7f48f070c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.783+0000 7f48f070c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:14.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.783+0000 7f48f070c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.783 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.784+0000 7f48f070c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:06:14.783 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.784+0000 7f48f070c800 20 searching for the correct realm 2024-09-14T11:06:14.784 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.786+0000 7f48ee9f7640 0 -- 172.21.15.97:0/711155902 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x55d4103898c0 msgr2=0x55d41038bd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:14.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.789+0000 7f48ee1f6640 0 -- 172.21.15.97:0/711155902 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7f48d80e51f0 msgr2=0x7f48d80a55e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:14.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.793+0000 7f48f070c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:06:14.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.793+0000 7f48f070c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:06:14.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.793+0000 7f48f070c800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:06:14.793 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.793+0000 7f48f070c800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:06:14.793 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.793+0000 7f48f070c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:06:14.793 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.793+0000 7f48f070c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:06:14.793 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.793+0000 7f48f070c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.793 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.794+0000 7f48f070c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:14.793 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.794+0000 7f48f070c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.793 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.794+0000 7f48f070c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:14.793 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.794+0000 7f48f070c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.794 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.794+0000 7f48f070c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:06:14.794 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.794+0000 7f48f070c800 20 zone default found 2024-09-14T11:06:14.794 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.794+0000 7f48f070c800 4 Realm: () 2024-09-14T11:06:14.794 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.794+0000 7f48f070c800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:06:14.794 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.794+0000 7f48f070c800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:06:14.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.794+0000 7f48f070c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:06:14.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.794+0000 7f48f070c800 20 zonegroup default 2024-09-14T11:06:14.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.794+0000 7f48f070c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.794+0000 7f48f070c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:14.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.794+0000 7f48f070c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.795+0000 7f48f070c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:14.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.795+0000 7f48f070c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.795+0000 7f48f070c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:14.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.795+0000 7f48f070c800 20 started sync module instance, tier type = 2024-09-14T11:06:14.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.795+0000 7f48f070c800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:06:14.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.803+0000 7f48f070c800 20 add_watcher() i=0 2024-09-14T11:06:14.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.803+0000 7f48f070c800 20 add_watcher() i=1 2024-09-14T11:06:14.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.803+0000 7f48f070c800 20 add_watcher() i=2 2024-09-14T11:06:14.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.803+0000 7f48f070c800 20 add_watcher() i=3 2024-09-14T11:06:14.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.803+0000 7f48f070c800 20 add_watcher() i=4 2024-09-14T11:06:14.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.803+0000 7f48f070c800 20 add_watcher() i=5 2024-09-14T11:06:14.802 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.803+0000 7f48f070c800 20 add_watcher() i=6 2024-09-14T11:06:14.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.804+0000 7f48f070c800 20 add_watcher() i=7 2024-09-14T11:06:14.803 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.804+0000 7f48f070c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:06:14.804 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.806+0000 7f47a4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:14.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.806+0000 7f48f070c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:06:14.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.806+0000 7f48f070c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:06:14.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.806+0000 7f48f070c800 5 note: GC not initialized 2024-09-14T11:06:14.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.806+0000 7f471f7fe640 20 reqs_thread_entry: start 2024-09-14T11:06:14.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.806+0000 7f48f070c800 20 init_complete bucket index max shards: 11 2024-09-14T11:06:14.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.806+0000 7f48f070c800 20 Filter name: none 2024-09-14T11:06:14.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.806+0000 7f471d7fa640 20 reqs_thread_entry: start 2024-09-14T11:06:14.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.806+0000 7f48f070c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.807+0000 7f48f070c800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:06:14.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.807+0000 7f48f070c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.807+0000 7f48f070c800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:06:14.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.807+0000 7f48f070c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:06:14.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.807+0000 7f48f070c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.808+0000 7f48f070c800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:06:14.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.808+0000 7f48f070c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.808+0000 7f48f070c800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:06:14.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.808+0000 7f48f070c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:06:14.808 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.810+0000 7f47a4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:14.810 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.811+0000 7f48f070c800 20 remove_watcher() i=0 2024-09-14T11:06:14.810 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.811+0000 7f48f070c800 2 removed watcher, disabling cache 2024-09-14T11:06:14.811 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.812+0000 7f48f070c800 20 remove_watcher() i=1 2024-09-14T11:06:14.812 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.813+0000 7f48f070c800 20 remove_watcher() i=2 2024-09-14T11:06:14.813 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.814+0000 7f48f070c800 20 remove_watcher() i=3 2024-09-14T11:06:14.814 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.815+0000 7f48f070c800 20 remove_watcher() i=4 2024-09-14T11:06:14.815 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.816+0000 7f48f070c800 20 remove_watcher() i=5 2024-09-14T11:06:14.816 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.817+0000 7f48f070c800 20 remove_watcher() i=6 2024-09-14T11:06:14.817 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.819+0000 7f48f070c800 20 remove_watcher() i=7 2024-09-14T11:06:14.827 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:14.828 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:06:14.828 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-logrecord-writes id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:06:14.828 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:14.829 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at logrecord_writes 2024-09-14T11:06:14.862 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:06:14.863 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:06:14.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.904+0000 7f580212a800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.906+0000 7f580212a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:14.905 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.906+0000 7f580212a800 20 realm 2024-09-14T11:06:14.905 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.906+0000 7f580212a800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.905 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.906+0000 7f580212a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:14.905 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.906+0000 7f580212a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:06:14.905 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.906+0000 7f580212a800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.905 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.906+0000 7f580212a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:14.905 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.906+0000 7f580212a800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.907+0000 7f580212a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:14.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.907+0000 7f580212a800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.907+0000 7f580212a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:06:14.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.907+0000 7f580212a800 20 searching for the correct realm 2024-09-14T11:06:14.908 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.909+0000 7f57fde1e640 0 -- 172.21.15.97:0/1690935717 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x564411592870 msgr2=0x564411594cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:14.911 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.912+0000 7f57fde1e640 0 -- 172.21.15.97:0/1690935717 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7f57e80cb6f0 msgr2=0x7f57e80bea00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:14.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.917+0000 7f580212a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:06:14.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.917+0000 7f580212a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:06:14.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.917+0000 7f580212a800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:06:14.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.917+0000 7f580212a800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:06:14.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.917+0000 7f580212a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:06:14.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.917+0000 7f580212a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:06:14.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.917+0000 7f580212a800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.917+0000 7f580212a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:14.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.917+0000 7f580212a800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.917 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.918+0000 7f580212a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:14.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.918+0000 7f580212a800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.918+0000 7f580212a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:06:14.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.918+0000 7f580212a800 20 zone default found 2024-09-14T11:06:14.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.918+0000 7f580212a800 4 Realm: () 2024-09-14T11:06:14.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.918+0000 7f580212a800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:06:14.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.918+0000 7f580212a800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:06:14.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.918+0000 7f580212a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:06:14.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.918+0000 7f580212a800 20 zonegroup default 2024-09-14T11:06:14.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.918+0000 7f580212a800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.918+0000 7f580212a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:14.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.918+0000 7f580212a800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.918 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.918+0000 7f580212a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:14.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.918+0000 7f580212a800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.919+0000 7f580212a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:14.919 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.919+0000 7f580212a800 20 started sync module instance, tier type = 2024-09-14T11:06:14.920 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.919+0000 7f580212a800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:06:14.925 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.927+0000 7f580212a800 20 add_watcher() i=0 2024-09-14T11:06:14.926 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.927+0000 7f580212a800 20 add_watcher() i=1 2024-09-14T11:06:14.926 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.927+0000 7f580212a800 20 add_watcher() i=2 2024-09-14T11:06:14.926 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.927+0000 7f580212a800 20 add_watcher() i=3 2024-09-14T11:06:14.926 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.927+0000 7f580212a800 20 add_watcher() i=4 2024-09-14T11:06:14.926 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.927+0000 7f580212a800 20 add_watcher() i=5 2024-09-14T11:06:14.926 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.927+0000 7f580212a800 20 add_watcher() i=6 2024-09-14T11:06:14.926 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.928+0000 7f580212a800 20 add_watcher() i=7 2024-09-14T11:06:14.926 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.928+0000 7f580212a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:06:14.928 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.929+0000 7f56af7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:14.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.930+0000 7f580212a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:06:14.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.930+0000 7f580212a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:06:14.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.930+0000 7f580212a800 5 note: GC not initialized 2024-09-14T11:06:14.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.930+0000 7f56ae7fc640 20 reqs_thread_entry: start 2024-09-14T11:06:14.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.930+0000 7f580212a800 20 init_complete bucket index max shards: 11 2024-09-14T11:06:14.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.930+0000 7f580212a800 20 Filter name: none 2024-09-14T11:06:14.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.930+0000 7f561ffff640 20 reqs_thread_entry: start 2024-09-14T11:06:14.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.930+0000 7f580212a800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-14T11:06:14.929 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.930+0000 7f580212a800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.930 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.930+0000 7f580212a800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:06:14.930 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.930+0000 7f580212a800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-14T11:06:14.930 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.930+0000 7f580212a800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-14T11:06:14.930 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.930+0000 7f580212a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35 : miss 2024-09-14T11:06:14.930 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.930+0000 7f580212a800 20 rados->read ofs=0 len=0 2024-09-14T11:06:14.930 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.931+0000 7f580212a800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:06:14.930 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.931+0000 7f580212a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35 info.flags=0x17 2024-09-14T11:06:14.930 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.931+0000 7f580212a800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35 to cache LRU end 2024-09-14T11:06:14.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.931+0000 7f580212a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:06:14.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.931+0000 7f580212a800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:14.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.931+0000 7f580212a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35 2024-09-14T11:06:14.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.936+0000 7f580212a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35 info.flags=0x17 2024-09-14T11:06:14.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.936+0000 7f580212a800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35 to cache LRU end 2024-09-14T11:06:14.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.936+0000 7f580212a800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:14.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.936+0000 7f580212a800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35, ofs0, ns] 2024-09-14T11:06:14.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.936+0000 7f56e0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595220 cookie 94850348897680 notifier 7671 bl.length()=923 2024-09-14T11:06:14.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.936+0000 7f56e0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35 info.flags=0x17 2024-09-14T11:06:14.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.936+0000 7f56e0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35 to cache LRU end 2024-09-14T11:06:14.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.936+0000 7f56e0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:14.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.937+0000 7f580212a800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35]): orig_sources= new_sources= 2024-09-14T11:06:14.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.937+0000 7f580212a800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35]): potential sources added=[] removed=[] 2024-09-14T11:06:14.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.937+0000 7f580212a800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35]): orig_dests= new_dests= 2024-09-14T11:06:14.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.937+0000 7f580212a800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35]): potential dests added=[] removed=[] 2024-09-14T11:06:14.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.939+0000 7f580212a800 -1 Injecting error=-5 at location=logrecord_writes 2024-09-14T11:06:14.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.939+0000 7f580212a800 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-09-14T11:06:14.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.943+0000 7f580212a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35 : hit (requested=0x17, cached=0x17) 2024-09-14T11:06:14.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.943+0000 7f580212a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35 2024-09-14T11:06:14.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.945+0000 7f580212a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35 info.flags=0x17 2024-09-14T11:06:14.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.945+0000 7f580212a800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35 to cache LRU end 2024-09-14T11:06:14.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.945+0000 7f580212a800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:14.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.945+0000 7f580212a800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35, ofs0, ns] 2024-09-14T11:06:14.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.945+0000 7f56e0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595221 cookie 94850348897680 notifier 7671 bl.length()=891 2024-09-14T11:06:14.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.945+0000 7f56e0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35 info.flags=0x17 2024-09-14T11:06:14.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.945+0000 7f56e0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35 to cache LRU end 2024-09-14T11:06:14.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.945+0000 7f56e0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:14.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.945+0000 7f580212a800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35]): orig_sources= new_sources= 2024-09-14T11:06:14.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.945+0000 7f580212a800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35]): potential sources added=[] removed=[] 2024-09-14T11:06:14.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.945+0000 7f580212a800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35]): orig_dests= new_dests= 2024-09-14T11:06:14.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.945+0000 7f580212a800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35]): potential dests added=[] removed=[] 2024-09-14T11:06:14.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.947+0000 7f56af7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:14.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.949+0000 7f580212a800 20 remove_watcher() i=0 2024-09-14T11:06:14.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.949+0000 7f580212a800 2 removed watcher, disabling cache 2024-09-14T11:06:14.948 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.950+0000 7f580212a800 20 remove_watcher() i=1 2024-09-14T11:06:14.949 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.951+0000 7f580212a800 20 remove_watcher() i=2 2024-09-14T11:06:14.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.952+0000 7f580212a800 20 remove_watcher() i=3 2024-09-14T11:06:14.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.953+0000 7f580212a800 20 remove_watcher() i=4 2024-09-14T11:06:14.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.954+0000 7f580212a800 20 remove_watcher() i=5 2024-09-14T11:06:14.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.955+0000 7f580212a800 20 remove_watcher() i=6 2024-09-14T11:06:14.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:14.955+0000 7f580212a800 20 remove_watcher() i=7 2024-09-14T11:06:14.966 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-14T11:06:14.994 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:06:14.994 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:06:15.031 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.032+0000 7fc0d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:15.033 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.034+0000 7fc0d112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:15.033 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.034+0000 7fc0d112c800 20 realm 2024-09-14T11:06:15.033 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.034+0000 7fc0d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:15.033 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.034+0000 7fc0d112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:15.033 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.034+0000 7fc0d112c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:06:15.033 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.034+0000 7fc0d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:15.033 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.034+0000 7fc0d112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:15.033 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.034+0000 7fc0d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:15.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.035+0000 7fc0d112c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:15.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.035+0000 7fc0d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:15.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.036+0000 7fc0d112c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:06:15.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.036+0000 7fc0d112c800 20 searching for the correct realm 2024-09-14T11:06:15.036 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.037+0000 7fc0cceda640 0 -- 172.21.15.97:0/1499683340 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x55c4fc472d30 msgr2=0x55c4fc4751c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:15.039 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.041+0000 7fc0cceda640 0 -- 172.21.15.97:0/1499683340 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7fc0b4084b20 msgr2=0x7fc0b4047410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:15.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.045+0000 7fc0d112c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:06:15.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.045+0000 7fc0d112c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:06:15.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.045+0000 7fc0d112c800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:06:15.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.045+0000 7fc0d112c800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:06:15.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.045+0000 7fc0d112c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:06:15.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.045+0000 7fc0d112c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:06:15.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.045+0000 7fc0d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:15.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.045+0000 7fc0d112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:15.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.045+0000 7fc0d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:15.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.046+0000 7fc0d112c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:15.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.046+0000 7fc0d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:15.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.046+0000 7fc0d112c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:06:15.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.046+0000 7fc0d112c800 20 zone default found 2024-09-14T11:06:15.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.046+0000 7fc0d112c800 4 Realm: () 2024-09-14T11:06:15.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.046+0000 7fc0d112c800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:06:15.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.046+0000 7fc0d112c800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:06:15.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.046+0000 7fc0d112c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:06:15.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.046+0000 7fc0d112c800 20 zonegroup default 2024-09-14T11:06:15.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.046+0000 7fc0d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:15.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.046+0000 7fc0d112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:15.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.046+0000 7fc0d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:15.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.047+0000 7fc0d112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:15.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.047+0000 7fc0d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:15.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.047+0000 7fc0d112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:15.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.047+0000 7fc0d112c800 20 started sync module instance, tier type = 2024-09-14T11:06:15.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.047+0000 7fc0d112c800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:06:15.053 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.055+0000 7fc0d112c800 20 add_watcher() i=0 2024-09-14T11:06:15.053 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.055+0000 7fc0d112c800 20 add_watcher() i=1 2024-09-14T11:06:15.054 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.055+0000 7fc0d112c800 20 add_watcher() i=2 2024-09-14T11:06:15.054 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.055+0000 7fc0d112c800 20 add_watcher() i=3 2024-09-14T11:06:15.054 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.055+0000 7fc0d112c800 20 add_watcher() i=4 2024-09-14T11:06:15.054 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.055+0000 7fc0d112c800 20 add_watcher() i=5 2024-09-14T11:06:15.054 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.055+0000 7fc0d112c800 20 add_watcher() i=6 2024-09-14T11:06:15.054 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.056+0000 7fc0d112c800 20 add_watcher() i=7 2024-09-14T11:06:15.054 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.056+0000 7fc0d112c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:06:15.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.057+0000 7fbf82fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:15.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.057+0000 7fc0d112c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:06:15.057 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.057+0000 7fc0d112c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:06:15.057 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.057+0000 7fc0d112c800 5 note: GC not initialized 2024-09-14T11:06:15.057 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.058+0000 7fbf81fe3640 20 reqs_thread_entry: start 2024-09-14T11:06:15.057 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.058+0000 7fc0d112c800 20 init_complete bucket index max shards: 11 2024-09-14T11:06:15.057 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.058+0000 7fc0d112c800 20 Filter name: none 2024-09-14T11:06:15.057 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.058+0000 7fbef37fe640 20 reqs_thread_entry: start 2024-09-14T11:06:15.057 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.058+0000 7fc0d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:15.058 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.058+0000 7fc0d112c800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:06:15.058 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.058+0000 7fc0d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:15.058 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.059+0000 7fc0d112c800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:06:15.058 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.059+0000 7fc0d112c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:06:15.058 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.059+0000 7fc0d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:15.058 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.059+0000 7fc0d112c800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:06:15.059 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.059+0000 7fc0d112c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:15.059 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.059+0000 7fc0d112c800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:06:15.059 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.059+0000 7fc0d112c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:06:15.060 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.061+0000 7fbf82fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:15.061 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.063+0000 7fc0d112c800 20 remove_watcher() i=0 2024-09-14T11:06:15.062 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.063+0000 7fc0d112c800 2 removed watcher, disabling cache 2024-09-14T11:06:15.062 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.064+0000 7fc0d112c800 20 remove_watcher() i=1 2024-09-14T11:06:15.063 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.065+0000 7fc0d112c800 20 remove_watcher() i=2 2024-09-14T11:06:15.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.066+0000 7fc0d112c800 20 remove_watcher() i=3 2024-09-14T11:06:15.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.067+0000 7fc0d112c800 20 remove_watcher() i=4 2024-09-14T11:06:15.066 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.068+0000 7fc0d112c800 20 remove_watcher() i=5 2024-09-14T11:06:15.067 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.069+0000 7fc0d112c800 20 remove_watcher() i=6 2024-09-14T11:06:15.068 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.070+0000 7fc0d112c800 20 remove_watcher() i=7 2024-09-14T11:06:15.079 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:15.079 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:06:15.080 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-logrecord-writes id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:06:15.080 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:15.131 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:06:15.163 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:06:15.163 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:06:15.200 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.201+0000 7f6ecfd0c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:15.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.203+0000 7f6ecfd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:15.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.203+0000 7f6ecfd0c800 20 realm 2024-09-14T11:06:15.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.203+0000 7f6ecfd0c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:15.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.203+0000 7f6ecfd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:15.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.203+0000 7f6ecfd0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:06:15.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.203+0000 7f6ecfd0c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:15.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.203+0000 7f6ecfd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:15.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.203+0000 7f6ecfd0c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:15.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.204+0000 7f6ecfd0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:15.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.204+0000 7f6ecfd0c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:15.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.205+0000 7f6ecfd0c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:06:15.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.205+0000 7f6ecfd0c800 20 searching for the correct realm 2024-09-14T11:06:15.205 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.207+0000 7f6ecdffe640 0 -- 172.21.15.97:0/3072301302 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f6eb8097040 msgr2=0x7f6eb8066160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:15.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.413+0000 7f6ec4ffc640 0 -- 172.21.15.97:0/3072301302 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f6ec00b6060 msgr2=0x7f6ec00b4040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:15.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.418+0000 7f6ecfd0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:06:15.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.418+0000 7f6ecfd0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:06:15.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.418+0000 7f6ecfd0c800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:06:15.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.418+0000 7f6ecfd0c800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:06:15.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.418+0000 7f6ecfd0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:06:15.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.418+0000 7f6ecfd0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:06:15.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.418+0000 7f6ecfd0c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:15.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.418+0000 7f6ecfd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:15.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.418+0000 7f6ecfd0c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:15.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.419+0000 7f6ecfd0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:15.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.419+0000 7f6ecfd0c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:15.419 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.419+0000 7f6ecfd0c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:06:15.419 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.419+0000 7f6ecfd0c800 20 zone default found 2024-09-14T11:06:15.419 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.419+0000 7f6ecfd0c800 4 Realm: () 2024-09-14T11:06:15.419 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.419+0000 7f6ecfd0c800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:06:15.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.419+0000 7f6ecfd0c800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:06:15.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.419+0000 7f6ecfd0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:06:15.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.419+0000 7f6ecfd0c800 20 zonegroup default 2024-09-14T11:06:15.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.419+0000 7f6ecfd0c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:15.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.419+0000 7f6ecfd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:15.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.419+0000 7f6ecfd0c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:15.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.420+0000 7f6ecfd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:15.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.420+0000 7f6ecfd0c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:15.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.420+0000 7f6ecfd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:15.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.420+0000 7f6ecfd0c800 20 started sync module instance, tier type = 2024-09-14T11:06:15.420 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.420+0000 7f6ecfd0c800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:06:15.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.428+0000 7f6ecfd0c800 20 add_watcher() i=0 2024-09-14T11:06:15.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.428+0000 7f6ecfd0c800 20 add_watcher() i=1 2024-09-14T11:06:15.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.428+0000 7f6ecfd0c800 20 add_watcher() i=2 2024-09-14T11:06:15.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.428+0000 7f6ecfd0c800 20 add_watcher() i=3 2024-09-14T11:06:15.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.428+0000 7f6ecfd0c800 20 add_watcher() i=4 2024-09-14T11:06:15.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.428+0000 7f6ecfd0c800 20 add_watcher() i=5 2024-09-14T11:06:15.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.428+0000 7f6ecfd0c800 20 add_watcher() i=6 2024-09-14T11:06:15.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.429+0000 7f6ecfd0c800 20 add_watcher() i=7 2024-09-14T11:06:15.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.429+0000 7f6ecfd0c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:06:15.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.431+0000 7f6d837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:15.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.431+0000 7f6ecfd0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:06:15.431 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.431+0000 7f6ecfd0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:06:15.431 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.431+0000 7f6ecfd0c800 5 note: GC not initialized 2024-09-14T11:06:15.431 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.432+0000 7f6d827e4640 20 reqs_thread_entry: start 2024-09-14T11:06:15.431 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.432+0000 7f6ecfd0c800 20 init_complete bucket index max shards: 11 2024-09-14T11:06:15.431 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.432+0000 7f6ecfd0c800 20 Filter name: none 2024-09-14T11:06:15.431 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.432+0000 7f6d7bfff640 20 reqs_thread_entry: start 2024-09-14T11:06:15.431 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.432+0000 7f6ecfd0c800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-14T11:06:15.431 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.432+0000 7f6ecfd0c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:15.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.432+0000 7f6ecfd0c800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:06:15.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.432+0000 7f6ecfd0c800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-14T11:06:15.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.432+0000 7f6ecfd0c800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-14T11:06:15.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.432+0000 7f6ecfd0c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35 : miss 2024-09-14T11:06:15.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.432+0000 7f6ecfd0c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:15.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.433+0000 7f6ecfd0c800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:06:15.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.433+0000 7f6ecfd0c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35 info.flags=0x17 2024-09-14T11:06:15.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.433+0000 7f6ecfd0c800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35 to cache LRU end 2024-09-14T11:06:15.433 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.433+0000 7f6ecfd0c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:06:15.433 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.433+0000 7f6ecfd0c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:15.433 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.433+0000 7f6ecfd0c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35 2024-09-14T11:06:15.436 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.437+0000 7f6ecfd0c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35 info.flags=0x17 2024-09-14T11:06:15.436 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.437+0000 7f6ecfd0c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35 to cache LRU end 2024-09-14T11:06:15.436 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.437+0000 7f6ecfd0c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:15.436 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.437+0000 7f6ecfd0c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35, ofs0, ns] 2024-09-14T11:06:15.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.438+0000 7f6da3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595222 cookie 94502601360816 notifier 7265 bl.length()=923 2024-09-14T11:06:15.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.438+0000 7f6da3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35 info.flags=0x17 2024-09-14T11:06:15.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.438+0000 7f6da3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35 to cache LRU end 2024-09-14T11:06:15.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.438+0000 7f6da3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:15.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.438+0000 7f6ecfd0c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35]): orig_sources= new_sources= 2024-09-14T11:06:15.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.438+0000 7f6ecfd0c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35]): potential sources added=[] removed=[] 2024-09-14T11:06:15.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.438+0000 7f6ecfd0c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35]): orig_dests= new_dests= 2024-09-14T11:06:15.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.438+0000 7f6ecfd0c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35]): potential dests added=[] removed=[] 2024-09-14T11:06:15.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.443+0000 7f6ecfd0c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35.1.0 2024-09-14T11:06:15.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.443+0000 7f6ecfd0c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35.1.0 2024-09-14T11:06:15.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.443+0000 7f6ecfd0c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35.1.1 2024-09-14T11:06:15.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.443+0000 7f6ecfd0c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35.1.1 2024-09-14T11:06:15.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.443+0000 7f6ecfd0c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35.1.2 2024-09-14T11:06:15.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.443+0000 7f6ecfd0c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35.1.2 2024-09-14T11:06:15.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.443+0000 7f6ecfd0c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35.1.3 2024-09-14T11:06:15.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.443+0000 7f6ecfd0c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35.1.3 2024-09-14T11:06:15.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.443+0000 7f6ecfd0c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35.1.4 2024-09-14T11:06:15.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.443+0000 7f6ecfd0c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35.1.4 2024-09-14T11:06:15.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.443+0000 7f6ecfd0c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35.1.5 2024-09-14T11:06:15.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.443+0000 7f6ecfd0c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35.1.5 2024-09-14T11:06:15.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.443+0000 7f6ecfd0c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35.1.6 2024-09-14T11:06:15.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.443+0000 7f6ecfd0c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35.1.6 2024-09-14T11:06:15.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.443+0000 7f6ecfd0c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35.1.7 2024-09-14T11:06:15.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.443+0000 7f6ecfd0c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35.1.7 2024-09-14T11:06:15.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.443+0000 7f6ecfd0c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35.1.8 2024-09-14T11:06:15.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.443+0000 7f6ecfd0c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35.1.8 2024-09-14T11:06:15.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.443+0000 7f6ecfd0c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35.1.9 2024-09-14T11:06:15.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.443+0000 7f6ecfd0c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35.1.9 2024-09-14T11:06:15.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.443+0000 7f6ecfd0c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35.1.10 2024-09-14T11:06:15.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.443+0000 7f6ecfd0c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35.1.10 2024-09-14T11:06:15.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.443+0000 7f6ecfd0c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35.1.11 2024-09-14T11:06:15.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.443+0000 7f6ecfd0c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35.1.11 2024-09-14T11:06:15.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.443+0000 7f6ecfd0c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35.0 2024-09-14T11:06:15.444 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.443+0000 7f6ecfd0c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35.1 2024-09-14T11:06:15.444 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.444+0000 7f6ecfd0c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35.2 2024-09-14T11:06:15.444 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.444+0000 7f6ecfd0c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35.3 2024-09-14T11:06:15.444 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.444+0000 7f6ecfd0c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35.4 2024-09-14T11:06:15.444 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.445+0000 7f6ecfd0c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35.5 2024-09-14T11:06:15.444 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.446+0000 7f6ecfd0c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35.6 2024-09-14T11:06:15.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.446+0000 7f6ecfd0c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35.7 2024-09-14T11:06:15.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.447+0000 7f6ecfd0c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35.8 2024-09-14T11:06:15.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.447+0000 7f6ecfd0c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35.9 2024-09-14T11:06:15.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.447+0000 7f6ecfd0c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35.10 2024-09-14T11:06:15.449 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.451+0000 7f6ecfd0c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35 : hit (requested=0x17, cached=0x17) 2024-09-14T11:06:15.449 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.451+0000 7f6ecfd0c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35 2024-09-14T11:06:15.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.452+0000 7f6ecfd0c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35 info.flags=0x17 2024-09-14T11:06:15.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.452+0000 7f6ecfd0c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35 to cache LRU end 2024-09-14T11:06:15.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.452+0000 7f6ecfd0c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:15.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.452+0000 7f6ecfd0c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35, ofs0, ns] 2024-09-14T11:06:15.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.452+0000 7f6da37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595223 cookie 94502601360816 notifier 7265 bl.length()=923 2024-09-14T11:06:15.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.452+0000 7f6da37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35 info.flags=0x17 2024-09-14T11:06:15.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.452+0000 7f6da37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35 to cache LRU end 2024-09-14T11:06:15.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.452+0000 7f6da37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:15.452 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.453+0000 7f6ecfd0c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35]): orig_sources= new_sources= 2024-09-14T11:06:15.452 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.453+0000 7f6ecfd0c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35]): potential sources added=[] removed=[] 2024-09-14T11:06:15.452 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.453+0000 7f6ecfd0c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35]): orig_dests= new_dests= 2024-09-14T11:06:15.452 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.453+0000 7f6ecfd0c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35]): potential dests added=[] removed=[] 2024-09-14T11:06:15.453 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.455+0000 7f6ecfd0c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35.0 2024-09-14T11:06:15.453 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.455+0000 7f6ecfd0c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35.1 2024-09-14T11:06:15.454 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.455+0000 7f6ecfd0c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35.2 2024-09-14T11:06:15.454 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.456+0000 7f6ecfd0c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35.3 2024-09-14T11:06:15.455 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.456+0000 7f6ecfd0c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35.4 2024-09-14T11:06:15.455 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.456+0000 7f6ecfd0c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35.5 2024-09-14T11:06:15.455 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.457+0000 7f6ecfd0c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35.6 2024-09-14T11:06:15.455 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.457+0000 7f6ecfd0c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35.7 2024-09-14T11:06:15.456 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.457+0000 7f6ecfd0c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35.8 2024-09-14T11:06:15.456 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.457+0000 7f6ecfd0c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35.9 2024-09-14T11:06:15.456 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.458+0000 7f6ecfd0c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35.10 2024-09-14T11:06:15.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.458+0000 7f6ecfd0c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35 : hit (requested=0x17, cached=0x17) 2024-09-14T11:06:15.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.458+0000 7f6ecfd0c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35 2024-09-14T11:06:15.458 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.459+0000 7f6ecfd0c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35 info.flags=0x17 2024-09-14T11:06:15.458 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.459+0000 7f6ecfd0c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35 to cache LRU end 2024-09-14T11:06:15.458 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.459+0000 7f6ecfd0c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:15.458 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.459+0000 7f6ecfd0c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35, ofs0, ns] 2024-09-14T11:06:15.459 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.460+0000 7f6da3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595224 cookie 94502601360816 notifier 7265 bl.length()=891 2024-09-14T11:06:15.459 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.460+0000 7f6da3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35 info.flags=0x17 2024-09-14T11:06:15.459 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.460+0000 7f6da3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35 to cache LRU end 2024-09-14T11:06:15.459 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.460+0000 7f6da3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:15.459 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.460+0000 7f6ecfd0c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35]): orig_sources= new_sources= 2024-09-14T11:06:15.459 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.460+0000 7f6ecfd0c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35]): potential sources added=[] removed=[] 2024-09-14T11:06:15.459 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.460+0000 7f6ecfd0c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35]): orig_dests= new_dests= 2024-09-14T11:06:15.459 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.460+0000 7f6ecfd0c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35]): potential dests added=[] removed=[] 2024-09-14T11:06:15.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.462+0000 7f6ecfd0c800 1 execute INFO: reshard of bucket "error-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-14T11:06:15.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.464+0000 7f6d837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:15.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.466+0000 7f6ecfd0c800 20 remove_watcher() i=0 2024-09-14T11:06:15.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.466+0000 7f6ecfd0c800 2 removed watcher, disabling cache 2024-09-14T11:06:15.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.467+0000 7f6ecfd0c800 20 remove_watcher() i=1 2024-09-14T11:06:15.466 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.468+0000 7f6ecfd0c800 20 remove_watcher() i=2 2024-09-14T11:06:15.467 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.469+0000 7f6ecfd0c800 20 remove_watcher() i=3 2024-09-14T11:06:15.468 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.470+0000 7f6ecfd0c800 20 remove_watcher() i=4 2024-09-14T11:06:15.469 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.471+0000 7f6ecfd0c800 20 remove_watcher() i=5 2024-09-14T11:06:15.470 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.472+0000 7f6ecfd0c800 20 remove_watcher() i=6 2024-09-14T11:06:15.471 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.472+0000 7f6ecfd0c800 20 remove_watcher() i=7 2024-09-14T11:06:15.483 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-14T11:06:15.511 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:06:15.511 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:06:15.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.549+0000 7fb30a940800 20 rados->read ofs=0 len=0 2024-09-14T11:06:15.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.551+0000 7fb30a940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:15.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.551+0000 7fb30a940800 20 realm 2024-09-14T11:06:15.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.551+0000 7fb30a940800 20 rados->read ofs=0 len=0 2024-09-14T11:06:15.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.551+0000 7fb30a940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:15.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.551+0000 7fb30a940800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:06:15.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.551+0000 7fb30a940800 20 rados->read ofs=0 len=0 2024-09-14T11:06:15.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.551+0000 7fb30a940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:15.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.551+0000 7fb30a940800 20 rados->read ofs=0 len=0 2024-09-14T11:06:15.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.552+0000 7fb30a940800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:15.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.552+0000 7fb30a940800 20 rados->read ofs=0 len=0 2024-09-14T11:06:15.551 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.553+0000 7fb30a940800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:06:15.552 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.553+0000 7fb30a940800 20 searching for the correct realm 2024-09-14T11:06:15.553 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.554+0000 7fb2fffff640 0 -- 172.21.15.97:0/2931699084 >> [v2:172.21.15.97:6808/2081705332,v1:172.21.15.97:6809/2081705332] conn(0x7fb2f801a040 msgr2=0x7fb2f801a930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:15.556 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.557+0000 7fb3066c0640 0 -- 172.21.15.97:0/2931699084 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7fb2f00774c0 msgr2=0x7fb2f0070e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:15.763 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.764+0000 7fb30a940800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:06:15.763 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.764+0000 7fb30a940800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:06:15.763 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.764+0000 7fb30a940800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:06:15.764 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.764+0000 7fb30a940800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:06:15.764 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.764+0000 7fb30a940800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:06:15.764 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.764+0000 7fb30a940800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:06:15.764 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.764+0000 7fb30a940800 20 rados->read ofs=0 len=0 2024-09-14T11:06:15.764 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.764+0000 7fb30a940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:15.764 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.764+0000 7fb30a940800 20 rados->read ofs=0 len=0 2024-09-14T11:06:15.764 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.765+0000 7fb30a940800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:15.764 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.765+0000 7fb30a940800 20 rados->read ofs=0 len=0 2024-09-14T11:06:15.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.765+0000 7fb30a940800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:06:15.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.765+0000 7fb30a940800 20 zone default found 2024-09-14T11:06:15.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.765+0000 7fb30a940800 4 Realm: () 2024-09-14T11:06:15.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.765+0000 7fb30a940800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:06:15.765 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.765+0000 7fb30a940800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:06:15.766 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.765+0000 7fb30a940800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:06:15.766 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.765+0000 7fb30a940800 20 zonegroup default 2024-09-14T11:06:15.766 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.765+0000 7fb30a940800 20 rados->read ofs=0 len=0 2024-09-14T11:06:15.766 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.765+0000 7fb30a940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:15.766 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.765+0000 7fb30a940800 20 rados->read ofs=0 len=0 2024-09-14T11:06:15.766 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.766+0000 7fb30a940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:15.766 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.766+0000 7fb30a940800 20 rados->read ofs=0 len=0 2024-09-14T11:06:15.766 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.766+0000 7fb30a940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:15.766 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.766+0000 7fb30a940800 20 started sync module instance, tier type = 2024-09-14T11:06:15.766 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.766+0000 7fb30a940800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:06:15.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.775+0000 7fb30a940800 20 add_watcher() i=0 2024-09-14T11:06:15.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.775+0000 7fb30a940800 20 add_watcher() i=1 2024-09-14T11:06:15.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.775+0000 7fb30a940800 20 add_watcher() i=2 2024-09-14T11:06:15.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.775+0000 7fb30a940800 20 add_watcher() i=3 2024-09-14T11:06:15.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.775+0000 7fb30a940800 20 add_watcher() i=4 2024-09-14T11:06:15.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.775+0000 7fb30a940800 20 add_watcher() i=5 2024-09-14T11:06:15.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.775+0000 7fb30a940800 20 add_watcher() i=6 2024-09-14T11:06:15.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.776+0000 7fb30a940800 20 add_watcher() i=7 2024-09-14T11:06:15.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.776+0000 7fb30a940800 2 all 8 watchers are set, enabling cache 2024-09-14T11:06:15.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.777+0000 7fb1bcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:15.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.778+0000 7fb30a940800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:06:15.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.778+0000 7fb30a940800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:06:15.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.778+0000 7fb30a940800 5 note: GC not initialized 2024-09-14T11:06:15.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.778+0000 7fb1377fe640 20 reqs_thread_entry: start 2024-09-14T11:06:15.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.778+0000 7fb30a940800 20 init_complete bucket index max shards: 11 2024-09-14T11:06:15.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.778+0000 7fb30a940800 20 Filter name: none 2024-09-14T11:06:15.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.779+0000 7fb1357fa640 20 reqs_thread_entry: start 2024-09-14T11:06:15.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.779+0000 7fb30a940800 20 rados->read ofs=0 len=0 2024-09-14T11:06:15.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.779+0000 7fb30a940800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:06:15.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.779+0000 7fb30a940800 20 rados->read ofs=0 len=0 2024-09-14T11:06:15.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.780+0000 7fb30a940800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:06:15.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.780+0000 7fb30a940800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:06:15.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.780+0000 7fb30a940800 20 rados->read ofs=0 len=0 2024-09-14T11:06:15.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.780+0000 7fb30a940800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:06:15.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.780+0000 7fb30a940800 20 rados->read ofs=0 len=0 2024-09-14T11:06:15.779 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.780+0000 7fb30a940800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:06:15.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.780+0000 7fb30a940800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:06:15.781 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.782+0000 7fb1bcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:15.783 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.784+0000 7fb30a940800 20 remove_watcher() i=0 2024-09-14T11:06:15.783 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.784+0000 7fb30a940800 2 removed watcher, disabling cache 2024-09-14T11:06:15.783 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.785+0000 7fb30a940800 20 remove_watcher() i=1 2024-09-14T11:06:15.784 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.786+0000 7fb30a940800 20 remove_watcher() i=2 2024-09-14T11:06:15.786 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.787+0000 7fb30a940800 20 remove_watcher() i=3 2024-09-14T11:06:15.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.788+0000 7fb30a940800 20 remove_watcher() i=4 2024-09-14T11:06:15.788 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.789+0000 7fb30a940800 20 remove_watcher() i=5 2024-09-14T11:06:15.789 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.790+0000 7fb30a940800 20 remove_watcher() i=6 2024-09-14T11:06:15.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:15.791+0000 7fb30a940800 20 remove_watcher() i=7 2024-09-14T11:06:15.800 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:15.800 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:06:15.800 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-logrecord-writes id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:06:15.800 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:16.053 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: reshard bucket with abort at logrecord_writes 2024-09-14T11:06:16.053 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:16.254 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-14T11:06:16.282 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:06:16.282 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:06:16.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.506+0000 7fa581fd9640 0 --2- 172.21.15.97:0/3498388046 >> [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] conn(0x555730999150 0x555730b3f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:06:16.520 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.521+0000 7fa586326800 20 rados->read ofs=0 len=0 2024-09-14T11:06:16.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.523+0000 7fa586326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:16.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.523+0000 7fa586326800 20 realm 2024-09-14T11:06:16.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.523+0000 7fa586326800 20 rados->read ofs=0 len=0 2024-09-14T11:06:16.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.523+0000 7fa586326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:16.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.523+0000 7fa586326800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:06:16.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.523+0000 7fa586326800 20 rados->read ofs=0 len=0 2024-09-14T11:06:16.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.523+0000 7fa586326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:16.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.523+0000 7fa586326800 20 rados->read ofs=0 len=0 2024-09-14T11:06:16.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.524+0000 7fa586326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:16.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.524+0000 7fa586326800 20 rados->read ofs=0 len=0 2024-09-14T11:06:16.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.525+0000 7fa586326800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:06:16.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.525+0000 7fa586326800 20 searching for the correct realm 2024-09-14T11:06:16.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.526+0000 7fa581fd9640 0 -- 172.21.15.97:0/2149257839 >> [v2:172.21.15.152:6808/1010851305,v1:172.21.15.152:6809/1010851305] conn(0x555730c01610 msgr2=0x555730c03ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:16.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.529+0000 7fa5827da640 0 -- 172.21.15.97:0/2149257839 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x555730bf4e00 msgr2=0x555730bf72a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:06:16.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.535+0000 7fa586326800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:06:16.534 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.535+0000 7fa586326800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:06:16.536 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.535+0000 7fa586326800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:06:16.536 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.535+0000 7fa586326800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:06:16.536 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.535+0000 7fa586326800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:06:16.536 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.535+0000 7fa586326800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:06:16.536 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.535+0000 7fa586326800 20 rados->read ofs=0 len=0 2024-09-14T11:06:16.536 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.535+0000 7fa586326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:16.536 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.535+0000 7fa586326800 20 rados->read ofs=0 len=0 2024-09-14T11:06:16.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.535+0000 7fa586326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:16.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.535+0000 7fa586326800 20 rados->read ofs=0 len=0 2024-09-14T11:06:16.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.536+0000 7fa586326800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:06:16.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.536+0000 7fa586326800 20 zone default found 2024-09-14T11:06:16.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.536+0000 7fa586326800 4 Realm: () 2024-09-14T11:06:16.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.536+0000 7fa586326800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:06:16.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.536+0000 7fa586326800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:06:16.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.536+0000 7fa586326800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:06:16.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.536+0000 7fa586326800 20 zonegroup default 2024-09-14T11:06:16.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.536+0000 7fa586326800 20 rados->read ofs=0 len=0 2024-09-14T11:06:16.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.536+0000 7fa586326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:16.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.536+0000 7fa586326800 20 rados->read ofs=0 len=0 2024-09-14T11:06:16.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.536+0000 7fa586326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:16.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.536+0000 7fa586326800 20 rados->read ofs=0 len=0 2024-09-14T11:06:16.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.536+0000 7fa586326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:16.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.536+0000 7fa586326800 20 started sync module instance, tier type = 2024-09-14T11:06:16.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.536+0000 7fa586326800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:06:16.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.545+0000 7fa586326800 20 add_watcher() i=0 2024-09-14T11:06:16.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.545+0000 7fa586326800 20 add_watcher() i=1 2024-09-14T11:06:16.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.545+0000 7fa586326800 20 add_watcher() i=2 2024-09-14T11:06:16.544 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.545+0000 7fa586326800 20 add_watcher() i=3 2024-09-14T11:06:16.544 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.545+0000 7fa586326800 20 add_watcher() i=4 2024-09-14T11:06:16.544 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.545+0000 7fa586326800 20 add_watcher() i=5 2024-09-14T11:06:16.544 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.545+0000 7fa586326800 20 add_watcher() i=6 2024-09-14T11:06:16.544 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.546+0000 7fa586326800 20 add_watcher() i=7 2024-09-14T11:06:16.544 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.546+0000 7fa586326800 2 all 8 watchers are set, enabling cache 2024-09-14T11:06:16.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.547+0000 7fa4337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:16.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.548+0000 7fa586326800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:06:16.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.548+0000 7fa586326800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:06:16.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.548+0000 7fa586326800 5 note: GC not initialized 2024-09-14T11:06:16.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.548+0000 7fa4327fc640 20 reqs_thread_entry: start 2024-09-14T11:06:16.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.548+0000 7fa586326800 20 init_complete bucket index max shards: 11 2024-09-14T11:06:16.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.548+0000 7fa586326800 20 Filter name: none 2024-09-14T11:06:16.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.548+0000 7fa3a3fff640 20 reqs_thread_entry: start 2024-09-14T11:06:16.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.548+0000 7fa586326800 20 rados->read ofs=0 len=0 2024-09-14T11:06:16.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.549+0000 7fa586326800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:06:16.548 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.549+0000 7fa586326800 20 rados->read ofs=0 len=0 2024-09-14T11:06:16.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.549+0000 7fa586326800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:06:16.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.549+0000 7fa586326800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:06:16.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.549+0000 7fa586326800 20 rados->read ofs=0 len=0 2024-09-14T11:06:16.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.550+0000 7fa586326800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:06:16.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.550+0000 7fa586326800 20 rados->read ofs=0 len=0 2024-09-14T11:06:16.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.550+0000 7fa586326800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:06:16.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.550+0000 7fa586326800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:06:16.550 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.551+0000 7fa4337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:16.552 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.553+0000 7fa586326800 20 remove_watcher() i=0 2024-09-14T11:06:16.552 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.553+0000 7fa586326800 2 removed watcher, disabling cache 2024-09-14T11:06:16.553 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.555+0000 7fa586326800 20 remove_watcher() i=1 2024-09-14T11:06:16.554 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.555+0000 7fa586326800 20 remove_watcher() i=2 2024-09-14T11:06:16.555 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.557+0000 7fa586326800 20 remove_watcher() i=3 2024-09-14T11:06:16.556 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.558+0000 7fa586326800 20 remove_watcher() i=4 2024-09-14T11:06:16.557 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.559+0000 7fa586326800 20 remove_watcher() i=5 2024-09-14T11:06:16.558 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.559+0000 7fa586326800 20 remove_watcher() i=6 2024-09-14T11:06:16.559 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.560+0000 7fa586326800 20 remove_watcher() i=7 2024-09-14T11:06:16.569 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:16.569 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:06:16.569 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: abort-at-logrecord-writes id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:06:16.569 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:16.571 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-14T11:06:16.605 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:06:16.605 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:06:16.840 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.842+0000 7f1360aa2640 0 --2- 172.21.15.97:0/2263882649 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559f002f38d0 0x559f003154a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:06:16.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.844+0000 7f1364d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:06:16.845 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.846+0000 7f1364d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:16.845 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.846+0000 7f1364d1f800 20 realm 2024-09-14T11:06:16.845 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.846+0000 7f1364d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:06:16.845 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.846+0000 7f1364d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:16.845 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.846+0000 7f1364d1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:06:16.845 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.846+0000 7f1364d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:06:16.845 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.846+0000 7f1364d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:16.845 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.846+0000 7f1364d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:06:16.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.847+0000 7f1364d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:16.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.847+0000 7f1364d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:06:16.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.848+0000 7f1364d1f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:06:16.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.848+0000 7f1364d1f800 20 searching for the correct realm 2024-09-14T11:06:16.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:16.849+0000 7f13582a1640 0 -- 172.21.15.97:0/2263882649 >> [v2:172.21.15.97:6808/2081705332,v1:172.21.15.97:6809/2081705332] conn(0x7f1350018070 msgr2=0x7f13500605c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:06:17.052 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.053+0000 7f13612a3640 0 -- 172.21.15.97:0/2263882649 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x559f00339ec0 msgr2=0x559f0033c360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:17.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.260+0000 7f1364d1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:06:17.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.260+0000 7f1364d1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:06:17.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.260+0000 7f1364d1f800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:06:17.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.260+0000 7f1364d1f800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:06:17.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.260+0000 7f1364d1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:06:17.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.260+0000 7f1364d1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:06:17.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.260+0000 7f1364d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.260+0000 7f1364d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:17.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.260+0000 7f1364d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.261+0000 7f1364d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:17.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.261+0000 7f1364d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.261+0000 7f1364d1f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:06:17.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.261+0000 7f1364d1f800 20 zone default found 2024-09-14T11:06:17.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.261+0000 7f1364d1f800 4 Realm: () 2024-09-14T11:06:17.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.261+0000 7f1364d1f800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:06:17.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.261+0000 7f1364d1f800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:06:17.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.261+0000 7f1364d1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:06:17.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.261+0000 7f1364d1f800 20 zonegroup default 2024-09-14T11:06:17.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.261+0000 7f1364d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.261+0000 7f1364d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:17.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.261+0000 7f1364d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.262+0000 7f1364d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:17.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.262+0000 7f1364d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.262+0000 7f1364d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:17.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.262+0000 7f1364d1f800 20 started sync module instance, tier type = 2024-09-14T11:06:17.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.262+0000 7f1364d1f800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:06:17.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.271+0000 7f1364d1f800 20 add_watcher() i=0 2024-09-14T11:06:17.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.271+0000 7f1364d1f800 20 add_watcher() i=1 2024-09-14T11:06:17.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.271+0000 7f1364d1f800 20 add_watcher() i=2 2024-09-14T11:06:17.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.271+0000 7f1364d1f800 20 add_watcher() i=3 2024-09-14T11:06:17.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.271+0000 7f1364d1f800 20 add_watcher() i=4 2024-09-14T11:06:17.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.271+0000 7f1364d1f800 20 add_watcher() i=5 2024-09-14T11:06:17.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.271+0000 7f1364d1f800 20 add_watcher() i=6 2024-09-14T11:06:17.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.272+0000 7f1364d1f800 20 add_watcher() i=7 2024-09-14T11:06:17.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.272+0000 7f1364d1f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:06:17.272 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.273+0000 7f12177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:17.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.274+0000 7f1364d1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:06:17.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.274+0000 7f1364d1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:06:17.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.274+0000 7f1364d1f800 5 note: GC not initialized 2024-09-14T11:06:17.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.274+0000 7f12167e4640 20 reqs_thread_entry: start 2024-09-14T11:06:17.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.274+0000 7f1364d1f800 20 init_complete bucket index max shards: 11 2024-09-14T11:06:17.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.274+0000 7f1364d1f800 20 Filter name: none 2024-09-14T11:06:17.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.274+0000 7f120ffff640 20 reqs_thread_entry: start 2024-09-14T11:06:17.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.274+0000 7f1364d1f800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:06:17.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.274+0000 7f1364d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.275+0000 7f1364d1f800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:06:17.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.275+0000 7f1364d1f800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:06:17.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.275+0000 7f1364d1f800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:06:17.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.275+0000 7f1364d1f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 : miss 2024-09-14T11:06:17.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.275+0000 7f1364d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.275+0000 7f1364d1f800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:06:17.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.275+0000 7f1364d1f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 info.flags=0x17 2024-09-14T11:06:17.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.275+0000 7f1364d1f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 to cache LRU end 2024-09-14T11:06:17.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.275+0000 7f1364d1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:06:17.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.275+0000 7f1364d1f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:17.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.275+0000 7f1364d1f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 2024-09-14T11:06:17.279 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.280+0000 7f1364d1f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 info.flags=0x17 2024-09-14T11:06:17.279 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.280+0000 7f1364d1f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 to cache LRU end 2024-09-14T11:06:17.279 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.280+0000 7f1364d1f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:17.279 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.280+0000 7f1364d1f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36, ofs0, ns] 2024-09-14T11:06:17.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.281+0000 7f1237fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595098 cookie 94141391552144 notifier 7764 bl.length()=923 2024-09-14T11:06:17.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.281+0000 7f1237fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 info.flags=0x17 2024-09-14T11:06:17.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.281+0000 7f1237fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 to cache LRU end 2024-09-14T11:06:17.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.281+0000 7f1237fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:17.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.281+0000 7f1364d1f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36]): orig_sources= new_sources= 2024-09-14T11:06:17.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.281+0000 7f1364d1f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36]): potential sources added=[] removed=[] 2024-09-14T11:06:17.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.281+0000 7f1364d1f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36]): orig_dests= new_dests= 2024-09-14T11:06:17.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.281+0000 7f1364d1f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36]): potential dests added=[] removed=[] 2024-09-14T11:06:17.282 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1364d1f800 time 2024-09-14T11:06:17.284623+0000 2024-09-14T11:06:17.282 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:06:17.283 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:06:17.283 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f136658c76a] 2024-09-14T11:06:17.283 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f136658c928] 2024-09-14T11:06:17.284 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559efdb370b1] 2024-09-14T11:06:17.284 INFO:tasks.workunit.client.0.smithi097.stderr: 4: radosgw-admin(+0xd8907c) [0x559efe04b07c] 2024-09-14T11:06:17.284 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559efdb46efd] 2024-09-14T11:06:17.284 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-14T11:06:17.284 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f1365229590] 2024-09-14T11:06:17.284 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-14T11:06:17.284 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-14T11:06:17.284 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.284+0000 7f1364d1f800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1364d1f800 time 2024-09-14T11:06:17.284623+0000 2024-09-14T11:06:17.284 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:06:17.284 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:17.284 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:06:17.284 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f136658c76a] 2024-09-14T11:06:17.284 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f136658c928] 2024-09-14T11:06:17.284 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559efdb370b1] 2024-09-14T11:06:17.285 INFO:tasks.workunit.client.0.smithi097.stderr: 4: radosgw-admin(+0xd8907c) [0x559efe04b07c] 2024-09-14T11:06:17.285 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559efdb46efd] 2024-09-14T11:06:17.285 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-14T11:06:17.285 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f1365229590] 2024-09-14T11:06:17.285 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-14T11:06:17.285 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-14T11:06:17.285 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:17.285 INFO:tasks.workunit.client.0.smithi097.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:06:17.285 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f1364d1f800 thread_name:radosgw-admin 2024-09-14T11:06:17.307 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:06:17.307 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f136523e6f0] 2024-09-14T11:06:17.307 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f136528b99c] 2024-09-14T11:06:17.307 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-14T11:06:17.307 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-14T11:06:17.307 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f136658c7c4] 2024-09-14T11:06:17.307 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f136658c928] 2024-09-14T11:06:17.307 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559efdb370b1] 2024-09-14T11:06:17.308 INFO:tasks.workunit.client.0.smithi097.stderr: 8: radosgw-admin(+0xd8907c) [0x559efe04b07c] 2024-09-14T11:06:17.308 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559efdb46efd] 2024-09-14T11:06:17.308 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-14T11:06:17.308 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f1365229590] 2024-09-14T11:06:17.308 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-14T11:06:17.308 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-14T11:06:17.308 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.285+0000 7f1364d1f800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:06:17.308 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f1364d1f800 thread_name:radosgw-admin 2024-09-14T11:06:17.308 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:17.308 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:06:17.308 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f136523e6f0] 2024-09-14T11:06:17.308 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f136528b99c] 2024-09-14T11:06:17.309 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-14T11:06:17.309 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-14T11:06:17.309 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f136658c7c4] 2024-09-14T11:06:17.309 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f136658c928] 2024-09-14T11:06:17.309 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559efdb370b1] 2024-09-14T11:06:17.309 INFO:tasks.workunit.client.0.smithi097.stderr: 8: radosgw-admin(+0xd8907c) [0x559efe04b07c] 2024-09-14T11:06:17.309 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559efdb46efd] 2024-09-14T11:06:17.309 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-14T11:06:17.309 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f1365229590] 2024-09-14T11:06:17.309 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-14T11:06:17.309 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-14T11:06:17.309 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:06:17.309 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:17.310 INFO:tasks.workunit.client.0.smithi097.stderr:--- begin dump of recent events --- 2024-09-14T11:06:17.310 INFO:tasks.workunit.client.0.smithi097.stderr: -499> 2024-09-14T11:06:16.627+0000 7f1364d1f800 1 librados: calling monclient init 2024-09-14T11:06:17.310 INFO:tasks.workunit.client.0.smithi097.stderr: -498> 2024-09-14T11:06:16.627+0000 7f1364d1f800 10 monclient: init 2024-09-14T11:06:17.310 INFO:tasks.workunit.client.0.smithi097.stderr: -497> 2024-09-14T11:06:16.627+0000 7f1364d1f800 5 AuthRegistry(0x559f002522e0) adding auth protocol: cephx 2024-09-14T11:06:17.310 INFO:tasks.workunit.client.0.smithi097.stderr: -496> 2024-09-14T11:06:16.627+0000 7f1364d1f800 5 AuthRegistry(0x559f002522e0) adding auth protocol: cephx 2024-09-14T11:06:17.310 INFO:tasks.workunit.client.0.smithi097.stderr: -495> 2024-09-14T11:06:16.627+0000 7f1364d1f800 5 AuthRegistry(0x559f002522e0) adding auth protocol: cephx 2024-09-14T11:06:17.310 INFO:tasks.workunit.client.0.smithi097.stderr: -494> 2024-09-14T11:06:16.627+0000 7f1364d1f800 5 AuthRegistry(0x559f002522e0) adding con mode: secure 2024-09-14T11:06:17.310 INFO:tasks.workunit.client.0.smithi097.stderr: -493> 2024-09-14T11:06:16.627+0000 7f1364d1f800 5 AuthRegistry(0x559f002522e0) adding con mode: crc 2024-09-14T11:06:17.310 INFO:tasks.workunit.client.0.smithi097.stderr: -492> 2024-09-14T11:06:16.627+0000 7f1364d1f800 5 AuthRegistry(0x559f002522e0) adding con mode: secure 2024-09-14T11:06:17.310 INFO:tasks.workunit.client.0.smithi097.stderr: -491> 2024-09-14T11:06:16.627+0000 7f1364d1f800 5 AuthRegistry(0x559f002522e0) adding con mode: crc 2024-09-14T11:06:17.310 INFO:tasks.workunit.client.0.smithi097.stderr: -490> 2024-09-14T11:06:16.627+0000 7f1364d1f800 5 AuthRegistry(0x559f002522e0) adding con mode: secure 2024-09-14T11:06:17.310 INFO:tasks.workunit.client.0.smithi097.stderr: -489> 2024-09-14T11:06:16.627+0000 7f1364d1f800 5 AuthRegistry(0x559f002522e0) adding con mode: crc 2024-09-14T11:06:17.310 INFO:tasks.workunit.client.0.smithi097.stderr: -488> 2024-09-14T11:06:16.627+0000 7f1364d1f800 5 AuthRegistry(0x559f002522e0) adding con mode: crc 2024-09-14T11:06:17.310 INFO:tasks.workunit.client.0.smithi097.stderr: -487> 2024-09-14T11:06:16.627+0000 7f1364d1f800 5 AuthRegistry(0x559f002522e0) adding con mode: secure 2024-09-14T11:06:17.311 INFO:tasks.workunit.client.0.smithi097.stderr: -486> 2024-09-14T11:06:16.627+0000 7f1364d1f800 5 AuthRegistry(0x559f002522e0) adding con mode: crc 2024-09-14T11:06:17.311 INFO:tasks.workunit.client.0.smithi097.stderr: -485> 2024-09-14T11:06:16.627+0000 7f1364d1f800 5 AuthRegistry(0x559f002522e0) adding con mode: secure 2024-09-14T11:06:17.311 INFO:tasks.workunit.client.0.smithi097.stderr: -484> 2024-09-14T11:06:16.627+0000 7f1364d1f800 5 AuthRegistry(0x559f002522e0) adding con mode: crc 2024-09-14T11:06:17.311 INFO:tasks.workunit.client.0.smithi097.stderr: -483> 2024-09-14T11:06:16.627+0000 7f1364d1f800 5 AuthRegistry(0x559f002522e0) adding con mode: secure 2024-09-14T11:06:17.311 INFO:tasks.workunit.client.0.smithi097.stderr: -482> 2024-09-14T11:06:16.627+0000 7f1364d1f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:06:17.311 INFO:tasks.workunit.client.0.smithi097.stderr: -481> 2024-09-14T11:06:16.627+0000 7f1364d1f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:06:17.311 INFO:tasks.workunit.client.0.smithi097.stderr: -480> 2024-09-14T11:06:16.628+0000 7f1364d1f800 5 asok(0x559f00032270) register_command rotate-key hook 0x559f00252428 2024-09-14T11:06:17.311 INFO:tasks.workunit.client.0.smithi097.stderr: -479> 2024-09-14T11:06:16.628+0000 7f1364d1f800 10 monclient: _reopen_session rank -1 2024-09-14T11:06:17.311 INFO:tasks.workunit.client.0.smithi097.stderr: -478> 2024-09-14T11:06:16.628+0000 7f1364d1f800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:06:17.311 INFO:tasks.workunit.client.0.smithi097.stderr: -477> 2024-09-14T11:06:16.628+0000 7f1364d1f800 10 monclient(hunting): picked mon.noname-a con 0x559f000dba70 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:06:17.311 INFO:tasks.workunit.client.0.smithi097.stderr: -476> 2024-09-14T11:06:16.628+0000 7f1364d1f800 10 monclient(hunting): picked mon.noname-c con 0x559f00109670 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:06:17.311 INFO:tasks.workunit.client.0.smithi097.stderr: -475> 2024-09-14T11:06:16.628+0000 7f1364d1f800 10 monclient(hunting): picked mon.noname-b con 0x559f002593a0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:06:17.311 INFO:tasks.workunit.client.0.smithi097.stderr: -474> 2024-09-14T11:06:16.628+0000 7f1364d1f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:17.312 INFO:tasks.workunit.client.0.smithi097.stderr: -473> 2024-09-14T11:06:16.628+0000 7f1364d1f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:17.312 INFO:tasks.workunit.client.0.smithi097.stderr: -472> 2024-09-14T11:06:16.628+0000 7f1364d1f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:17.312 INFO:tasks.workunit.client.0.smithi097.stderr: -471> 2024-09-14T11:06:16.628+0000 7f1364d1f800 10 monclient(hunting): _renew_subs 2024-09-14T11:06:17.312 INFO:tasks.workunit.client.0.smithi097.stderr: -470> 2024-09-14T11:06:16.628+0000 7f1364d1f800 10 monclient(hunting): authenticate will time out at 2058.281138s 2024-09-14T11:06:17.312 INFO:tasks.workunit.client.0.smithi097.stderr: -469> 2024-09-14T11:06:16.628+0000 7f1360aa2640 10 monclient(hunting): get_auth_request con 0x559f000dba70 auth_method 0 2024-09-14T11:06:17.312 INFO:tasks.workunit.client.0.smithi097.stderr: -468> 2024-09-14T11:06:16.628+0000 7f1360aa2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:06:17.312 INFO:tasks.workunit.client.0.smithi097.stderr: -467> 2024-09-14T11:06:16.628+0000 7f1360aa2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:06:17.312 INFO:tasks.workunit.client.0.smithi097.stderr: -466> 2024-09-14T11:06:16.628+0000 7f1360aa2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:06:17.312 INFO:tasks.workunit.client.0.smithi097.stderr: -465> 2024-09-14T11:06:16.628+0000 7f13582a1640 10 monclient(hunting): get_auth_request con 0x559f00109670 auth_method 0 2024-09-14T11:06:17.312 INFO:tasks.workunit.client.0.smithi097.stderr: -464> 2024-09-14T11:06:16.628+0000 7f13582a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:06:17.312 INFO:tasks.workunit.client.0.smithi097.stderr: -463> 2024-09-14T11:06:16.628+0000 7f13582a1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:06:17.312 INFO:tasks.workunit.client.0.smithi097.stderr: -462> 2024-09-14T11:06:16.628+0000 7f13582a1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:06:17.312 INFO:tasks.workunit.client.0.smithi097.stderr: -461> 2024-09-14T11:06:16.628+0000 7f1360aa2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:06:17.313 INFO:tasks.workunit.client.0.smithi097.stderr: -460> 2024-09-14T11:06:16.628+0000 7f1360aa2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:06:17.313 INFO:tasks.workunit.client.0.smithi097.stderr: -459> 2024-09-14T11:06:16.628+0000 7f1360aa2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:06:17.313 INFO:tasks.workunit.client.0.smithi097.stderr: -458> 2024-09-14T11:06:16.628+0000 7f13582a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:06:17.313 INFO:tasks.workunit.client.0.smithi097.stderr: -457> 2024-09-14T11:06:16.628+0000 7f13582a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:06:17.313 INFO:tasks.workunit.client.0.smithi097.stderr: -456> 2024-09-14T11:06:16.628+0000 7f13582a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:06:17.313 INFO:tasks.workunit.client.0.smithi097.stderr: -455> 2024-09-14T11:06:16.628+0000 7f13612a3640 10 monclient(hunting): get_auth_request con 0x559f002593a0 auth_method 0 2024-09-14T11:06:17.313 INFO:tasks.workunit.client.0.smithi097.stderr: -454> 2024-09-14T11:06:16.628+0000 7f13612a3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:06:17.313 INFO:tasks.workunit.client.0.smithi097.stderr: -453> 2024-09-14T11:06:16.628+0000 7f13612a3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:06:17.313 INFO:tasks.workunit.client.0.smithi097.stderr: -452> 2024-09-14T11:06:16.628+0000 7f13612a3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:06:17.313 INFO:tasks.workunit.client.0.smithi097.stderr: -451> 2024-09-14T11:06:16.628+0000 7f1360aa2640 10 monclient(hunting): handle_auth_done global_id 7755 payload 824 2024-09-14T11:06:17.313 INFO:tasks.workunit.client.0.smithi097.stderr: -450> 2024-09-14T11:06:16.628+0000 7f1360aa2640 10 monclient: _finish_hunting 0 2024-09-14T11:06:17.313 INFO:tasks.workunit.client.0.smithi097.stderr: -449> 2024-09-14T11:06:16.628+0000 7f1360aa2640 1 monclient: found mon.noname-a 2024-09-14T11:06:17.313 INFO:tasks.workunit.client.0.smithi097.stderr: -448> 2024-09-14T11:06:16.628+0000 7f1360aa2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-14T11:06:17.314 INFO:tasks.workunit.client.0.smithi097.stderr: -447> 2024-09-14T11:06:16.628+0000 7f124d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:06:17.314 INFO:tasks.workunit.client.0.smithi097.stderr: -446> 2024-09-14T11:06:16.628+0000 7f124d60a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:06:17.314 INFO:tasks.workunit.client.0.smithi097.stderr: -445> 2024-09-14T11:06:16.628+0000 7f124d60a640 10 monclient: dump: 2024-09-14T11:06:17.314 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:06:17.314 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:06:17.314 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:17.314 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:17.314 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:06:17.314 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:06:17.314 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:06:17.314 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:06:17.314 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:06:17.314 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:17.315 INFO:tasks.workunit.client.0.smithi097.stderr: -444> 2024-09-14T11:06:16.628+0000 7f124d60a640 10 monclient: _finish_auth 0 2024-09-14T11:06:17.315 INFO:tasks.workunit.client.0.smithi097.stderr: -443> 2024-09-14T11:06:16.628+0000 7f124d60a640 10 monclient: _check_auth_tickets 2024-09-14T11:06:17.315 INFO:tasks.workunit.client.0.smithi097.stderr: -442> 2024-09-14T11:06:16.628+0000 7f124d60a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:06:17.315 INFO:tasks.workunit.client.0.smithi097.stderr: -441> 2024-09-14T11:06:16.628+0000 7f124d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:06:17.315 INFO:tasks.workunit.client.0.smithi097.stderr: -440> 2024-09-14T11:06:16.628+0000 7f124d60a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:06:17.315 INFO:tasks.workunit.client.0.smithi097.stderr: -439> 2024-09-14T11:06:16.628+0000 7f124d60a640 10 monclient: dump: 2024-09-14T11:06:17.315 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:06:17.315 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:06:17.315 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:17.315 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:17.315 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:06:17.315 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:06:17.315 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:06:17.316 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:06:17.316 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:06:17.316 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:17.316 INFO:tasks.workunit.client.0.smithi097.stderr: -438> 2024-09-14T11:06:16.628+0000 7f1364d1f800 5 monclient: authenticate success, global_id 7755 2024-09-14T11:06:17.316 INFO:tasks.workunit.client.0.smithi097.stderr: -437> 2024-09-14T11:06:16.628+0000 7f1364d1f800 10 monclient: _renew_subs 2024-09-14T11:06:17.316 INFO:tasks.workunit.client.0.smithi097.stderr: -436> 2024-09-14T11:06:16.628+0000 7f1364d1f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:06:17.316 INFO:tasks.workunit.client.0.smithi097.stderr: -435> 2024-09-14T11:06:16.628+0000 7f124ee0d640 4 set_mon_vals no callback set 2024-09-14T11:06:17.316 INFO:tasks.workunit.client.0.smithi097.stderr: -434> 2024-09-14T11:06:16.628+0000 7f1364d1f800 10 monclient: _renew_subs 2024-09-14T11:06:17.316 INFO:tasks.workunit.client.0.smithi097.stderr: -433> 2024-09-14T11:06:16.628+0000 7f1364d1f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:06:17.316 INFO:tasks.workunit.client.0.smithi097.stderr: -432> 2024-09-14T11:06:16.628+0000 7f1364d1f800 1 librados: init done 2024-09-14T11:06:17.316 INFO:tasks.workunit.client.0.smithi097.stderr: -431> 2024-09-14T11:06:16.630+0000 7f124d60a640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:06:17.316 INFO:tasks.workunit.client.0.smithi097.stderr: -430> 2024-09-14T11:06:16.630+0000 7f124d60a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:06:17.316 INFO:tasks.workunit.client.0.smithi097.stderr: -429> 2024-09-14T11:06:16.630+0000 7f124d60a640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:06:17.317 INFO:tasks.workunit.client.0.smithi097.stderr: -428> 2024-09-14T11:06:16.631+0000 7f13582a1640 10 monclient: get_auth_request con 0x7f1248077230 auth_method 0 2024-09-14T11:06:17.317 INFO:tasks.workunit.client.0.smithi097.stderr: -427> 2024-09-14T11:06:16.631+0000 7f13612a3640 10 monclient: get_auth_request con 0x559f0029b560 auth_method 0 2024-09-14T11:06:17.317 INFO:tasks.workunit.client.0.smithi097.stderr: -426> 2024-09-14T11:06:16.632+0000 7f1360aa2640 10 monclient: get_auth_request con 0x559f0029e3a0 auth_method 0 2024-09-14T11:06:17.317 INFO:tasks.workunit.client.0.smithi097.stderr: -425> 2024-09-14T11:06:16.632+0000 7f13582a1640 10 monclient: get_auth_request con 0x559f002a27c0 auth_method 0 2024-09-14T11:06:17.317 INFO:tasks.workunit.client.0.smithi097.stderr: -424> 2024-09-14T11:06:16.633+0000 7f13612a3640 10 monclient: get_auth_request con 0x559f002a1c90 auth_method 0 2024-09-14T11:06:17.317 INFO:tasks.workunit.client.0.smithi097.stderr: -423> 2024-09-14T11:06:16.634+0000 7f1364d1f800 10 monclient: build_initial_monmap 2024-09-14T11:06:17.317 INFO:tasks.workunit.client.0.smithi097.stderr: -422> 2024-09-14T11:06:16.634+0000 7f1364d1f800 1 build_initial for_mkfs: 0 2024-09-14T11:06:17.317 INFO:tasks.workunit.client.0.smithi097.stderr: -421> 2024-09-14T11:06:16.634+0000 7f1364d1f800 10 monclient: monmap: 2024-09-14T11:06:17.317 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:06:17.317 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:06:17.317 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:06:17.317 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:06:17.317 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:06:17.318 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:06:17.318 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:06:17.318 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:06:17.318 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:06:17.318 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:17.318 INFO:tasks.workunit.client.0.smithi097.stderr: -420> 2024-09-14T11:06:16.634+0000 7f1364d1f800 5 AuthRegistry(0x559f002aaa20) adding auth protocol: cephx 2024-09-14T11:06:17.318 INFO:tasks.workunit.client.0.smithi097.stderr: -419> 2024-09-14T11:06:16.634+0000 7f1364d1f800 5 AuthRegistry(0x559f002aaa20) adding auth protocol: cephx 2024-09-14T11:06:17.318 INFO:tasks.workunit.client.0.smithi097.stderr: -418> 2024-09-14T11:06:16.634+0000 7f1364d1f800 5 AuthRegistry(0x559f002aaa20) adding auth protocol: cephx 2024-09-14T11:06:17.318 INFO:tasks.workunit.client.0.smithi097.stderr: -417> 2024-09-14T11:06:16.634+0000 7f1364d1f800 5 AuthRegistry(0x559f002aaa20) adding con mode: secure 2024-09-14T11:06:17.318 INFO:tasks.workunit.client.0.smithi097.stderr: -416> 2024-09-14T11:06:16.634+0000 7f1364d1f800 5 AuthRegistry(0x559f002aaa20) adding con mode: crc 2024-09-14T11:06:17.318 INFO:tasks.workunit.client.0.smithi097.stderr: -415> 2024-09-14T11:06:16.634+0000 7f1364d1f800 5 AuthRegistry(0x559f002aaa20) adding con mode: secure 2024-09-14T11:06:17.318 INFO:tasks.workunit.client.0.smithi097.stderr: -414> 2024-09-14T11:06:16.634+0000 7f1364d1f800 5 AuthRegistry(0x559f002aaa20) adding con mode: crc 2024-09-14T11:06:17.318 INFO:tasks.workunit.client.0.smithi097.stderr: -413> 2024-09-14T11:06:16.634+0000 7f1364d1f800 5 AuthRegistry(0x559f002aaa20) adding con mode: secure 2024-09-14T11:06:17.319 INFO:tasks.workunit.client.0.smithi097.stderr: -412> 2024-09-14T11:06:16.634+0000 7f1364d1f800 5 AuthRegistry(0x559f002aaa20) adding con mode: crc 2024-09-14T11:06:17.319 INFO:tasks.workunit.client.0.smithi097.stderr: -411> 2024-09-14T11:06:16.634+0000 7f1364d1f800 5 AuthRegistry(0x559f002aaa20) adding con mode: crc 2024-09-14T11:06:17.319 INFO:tasks.workunit.client.0.smithi097.stderr: -410> 2024-09-14T11:06:16.634+0000 7f1364d1f800 5 AuthRegistry(0x559f002aaa20) adding con mode: secure 2024-09-14T11:06:17.319 INFO:tasks.workunit.client.0.smithi097.stderr: -409> 2024-09-14T11:06:16.634+0000 7f1364d1f800 5 AuthRegistry(0x559f002aaa20) adding con mode: crc 2024-09-14T11:06:17.319 INFO:tasks.workunit.client.0.smithi097.stderr: -408> 2024-09-14T11:06:16.634+0000 7f1364d1f800 5 AuthRegistry(0x559f002aaa20) adding con mode: secure 2024-09-14T11:06:17.319 INFO:tasks.workunit.client.0.smithi097.stderr: -407> 2024-09-14T11:06:16.634+0000 7f1364d1f800 5 AuthRegistry(0x559f002aaa20) adding con mode: crc 2024-09-14T11:06:17.319 INFO:tasks.workunit.client.0.smithi097.stderr: -406> 2024-09-14T11:06:16.634+0000 7f1364d1f800 5 AuthRegistry(0x559f002aaa20) adding con mode: secure 2024-09-14T11:06:17.319 INFO:tasks.workunit.client.0.smithi097.stderr: -405> 2024-09-14T11:06:16.634+0000 7f1364d1f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:06:17.319 INFO:tasks.workunit.client.0.smithi097.stderr: -404> 2024-09-14T11:06:16.635+0000 7f1364d1f800 5 asok(0x559f00032270) register_command objecter_requests cmddesc objecter_requests hook 0x559f002ade20 EEXIST 2024-09-14T11:06:17.319 INFO:tasks.workunit.client.0.smithi097.stderr: -403> 2024-09-14T11:06:16.635+0000 7f1364d1f800 10 monclient: init 2024-09-14T11:06:17.319 INFO:tasks.workunit.client.0.smithi097.stderr: -402> 2024-09-14T11:06:16.635+0000 7f1364d1f800 5 AuthRegistry(0x559f002a9878) adding auth protocol: cephx 2024-09-14T11:06:17.319 INFO:tasks.workunit.client.0.smithi097.stderr: -401> 2024-09-14T11:06:16.635+0000 7f1364d1f800 5 AuthRegistry(0x559f002a9878) adding auth protocol: cephx 2024-09-14T11:06:17.319 INFO:tasks.workunit.client.0.smithi097.stderr: -400> 2024-09-14T11:06:16.635+0000 7f1364d1f800 5 AuthRegistry(0x559f002a9878) adding auth protocol: cephx 2024-09-14T11:06:17.319 INFO:tasks.workunit.client.0.smithi097.stderr: -399> 2024-09-14T11:06:16.635+0000 7f1364d1f800 5 AuthRegistry(0x559f002a9878) adding con mode: secure 2024-09-14T11:06:17.320 INFO:tasks.workunit.client.0.smithi097.stderr: -398> 2024-09-14T11:06:16.635+0000 7f1364d1f800 5 AuthRegistry(0x559f002a9878) adding con mode: crc 2024-09-14T11:06:17.320 INFO:tasks.workunit.client.0.smithi097.stderr: -397> 2024-09-14T11:06:16.635+0000 7f1364d1f800 5 AuthRegistry(0x559f002a9878) adding con mode: secure 2024-09-14T11:06:17.320 INFO:tasks.workunit.client.0.smithi097.stderr: -396> 2024-09-14T11:06:16.635+0000 7f1364d1f800 5 AuthRegistry(0x559f002a9878) adding con mode: crc 2024-09-14T11:06:17.320 INFO:tasks.workunit.client.0.smithi097.stderr: -395> 2024-09-14T11:06:16.635+0000 7f1364d1f800 5 AuthRegistry(0x559f002a9878) adding con mode: secure 2024-09-14T11:06:17.320 INFO:tasks.workunit.client.0.smithi097.stderr: -394> 2024-09-14T11:06:16.635+0000 7f1364d1f800 5 AuthRegistry(0x559f002a9878) adding con mode: crc 2024-09-14T11:06:17.320 INFO:tasks.workunit.client.0.smithi097.stderr: -393> 2024-09-14T11:06:16.635+0000 7f1364d1f800 5 AuthRegistry(0x559f002a9878) adding con mode: crc 2024-09-14T11:06:17.320 INFO:tasks.workunit.client.0.smithi097.stderr: -392> 2024-09-14T11:06:16.635+0000 7f1364d1f800 5 AuthRegistry(0x559f002a9878) adding con mode: secure 2024-09-14T11:06:17.320 INFO:tasks.workunit.client.0.smithi097.stderr: -391> 2024-09-14T11:06:16.635+0000 7f1364d1f800 5 AuthRegistry(0x559f002a9878) adding con mode: crc 2024-09-14T11:06:17.320 INFO:tasks.workunit.client.0.smithi097.stderr: -390> 2024-09-14T11:06:16.635+0000 7f1364d1f800 5 AuthRegistry(0x559f002a9878) adding con mode: secure 2024-09-14T11:06:17.320 INFO:tasks.workunit.client.0.smithi097.stderr: -389> 2024-09-14T11:06:16.635+0000 7f1364d1f800 5 AuthRegistry(0x559f002a9878) adding con mode: crc 2024-09-14T11:06:17.320 INFO:tasks.workunit.client.0.smithi097.stderr: -388> 2024-09-14T11:06:16.635+0000 7f1364d1f800 5 AuthRegistry(0x559f002a9878) adding con mode: secure 2024-09-14T11:06:17.320 INFO:tasks.workunit.client.0.smithi097.stderr: -387> 2024-09-14T11:06:16.635+0000 7f1364d1f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:06:17.320 INFO:tasks.workunit.client.0.smithi097.stderr: -386> 2024-09-14T11:06:16.635+0000 7f1364d1f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:06:17.320 INFO:tasks.workunit.client.0.smithi097.stderr: -385> 2024-09-14T11:06:16.635+0000 7f1364d1f800 5 asok(0x559f00032270) register_command rotate-key cmddesc rotate-key hook 0x559f002a99c0 EEXIST 2024-09-14T11:06:17.321 INFO:tasks.workunit.client.0.smithi097.stderr: -384> 2024-09-14T11:06:16.635+0000 7f1364d1f800 10 monclient: _reopen_session rank -1 2024-09-14T11:06:17.321 INFO:tasks.workunit.client.0.smithi097.stderr: -383> 2024-09-14T11:06:16.635+0000 7f1364d1f800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:06:17.321 INFO:tasks.workunit.client.0.smithi097.stderr: -382> 2024-09-14T11:06:16.635+0000 7f1364d1f800 10 monclient(hunting): picked mon.noname-c con 0x559f002d2140 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:06:17.321 INFO:tasks.workunit.client.0.smithi097.stderr: -381> 2024-09-14T11:06:16.635+0000 7f1364d1f800 10 monclient(hunting): picked mon.noname-a con 0x559f002d2520 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:06:17.321 INFO:tasks.workunit.client.0.smithi097.stderr: -380> 2024-09-14T11:06:16.635+0000 7f1364d1f800 10 monclient(hunting): picked mon.noname-b con 0x559f002d0e50 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:06:17.321 INFO:tasks.workunit.client.0.smithi097.stderr: -379> 2024-09-14T11:06:16.635+0000 7f1364d1f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:17.321 INFO:tasks.workunit.client.0.smithi097.stderr: -378> 2024-09-14T11:06:16.635+0000 7f1364d1f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:17.321 INFO:tasks.workunit.client.0.smithi097.stderr: -377> 2024-09-14T11:06:16.635+0000 7f1364d1f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:17.321 INFO:tasks.workunit.client.0.smithi097.stderr: -376> 2024-09-14T11:06:16.635+0000 7f1364d1f800 10 monclient(hunting): _renew_subs 2024-09-14T11:06:17.321 INFO:tasks.workunit.client.0.smithi097.stderr: -375> 2024-09-14T11:06:16.635+0000 7f1364d1f800 10 monclient(hunting): authenticate will time out at 2058.288625s 2024-09-14T11:06:17.321 INFO:tasks.workunit.client.0.smithi097.stderr: -374> 2024-09-14T11:06:16.635+0000 7f13582a1640 10 monclient(hunting): get_auth_request con 0x559f002d2140 auth_method 0 2024-09-14T11:06:17.321 INFO:tasks.workunit.client.0.smithi097.stderr: -373> 2024-09-14T11:06:16.635+0000 7f13582a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:06:17.321 INFO:tasks.workunit.client.0.smithi097.stderr: -372> 2024-09-14T11:06:16.635+0000 7f13582a1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:06:17.322 INFO:tasks.workunit.client.0.smithi097.stderr: -371> 2024-09-14T11:06:16.635+0000 7f13582a1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:06:17.322 INFO:tasks.workunit.client.0.smithi097.stderr: -370> 2024-09-14T11:06:16.635+0000 7f13612a3640 10 monclient(hunting): get_auth_request con 0x559f002d2520 auth_method 0 2024-09-14T11:06:17.322 INFO:tasks.workunit.client.0.smithi097.stderr: -369> 2024-09-14T11:06:16.635+0000 7f13612a3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:06:17.322 INFO:tasks.workunit.client.0.smithi097.stderr: -368> 2024-09-14T11:06:16.635+0000 7f13612a3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:06:17.322 INFO:tasks.workunit.client.0.smithi097.stderr: -367> 2024-09-14T11:06:16.635+0000 7f13612a3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:06:17.322 INFO:tasks.workunit.client.0.smithi097.stderr: -366> 2024-09-14T11:06:16.635+0000 7f1360aa2640 10 monclient(hunting): get_auth_request con 0x559f002d0e50 auth_method 0 2024-09-14T11:06:17.322 INFO:tasks.workunit.client.0.smithi097.stderr: -365> 2024-09-14T11:06:16.635+0000 7f1360aa2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:06:17.322 INFO:tasks.workunit.client.0.smithi097.stderr: -364> 2024-09-14T11:06:16.635+0000 7f1360aa2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:06:17.322 INFO:tasks.workunit.client.0.smithi097.stderr: -363> 2024-09-14T11:06:16.635+0000 7f1360aa2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:06:17.322 INFO:tasks.workunit.client.0.smithi097.stderr: -362> 2024-09-14T11:06:16.635+0000 7f13582a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:06:17.322 INFO:tasks.workunit.client.0.smithi097.stderr: -361> 2024-09-14T11:06:16.635+0000 7f13582a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:06:17.322 INFO:tasks.workunit.client.0.smithi097.stderr: -360> 2024-09-14T11:06:16.635+0000 7f13582a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:06:17.322 INFO:tasks.workunit.client.0.smithi097.stderr: -359> 2024-09-14T11:06:16.635+0000 7f13612a3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:06:17.323 INFO:tasks.workunit.client.0.smithi097.stderr: -358> 2024-09-14T11:06:16.635+0000 7f13612a3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:06:17.323 INFO:tasks.workunit.client.0.smithi097.stderr: -357> 2024-09-14T11:06:16.635+0000 7f13612a3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:06:17.323 INFO:tasks.workunit.client.0.smithi097.stderr: -356> 2024-09-14T11:06:16.635+0000 7f1360aa2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:06:17.323 INFO:tasks.workunit.client.0.smithi097.stderr: -355> 2024-09-14T11:06:16.635+0000 7f1360aa2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:06:17.323 INFO:tasks.workunit.client.0.smithi097.stderr: -354> 2024-09-14T11:06:16.635+0000 7f1360aa2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:06:17.323 INFO:tasks.workunit.client.0.smithi097.stderr: -353> 2024-09-14T11:06:16.635+0000 7f13612a3640 10 monclient(hunting): handle_auth_done global_id 7758 payload 824 2024-09-14T11:06:17.323 INFO:tasks.workunit.client.0.smithi097.stderr: -352> 2024-09-14T11:06:16.635+0000 7f13612a3640 10 monclient: _finish_hunting 0 2024-09-14T11:06:17.323 INFO:tasks.workunit.client.0.smithi097.stderr: -351> 2024-09-14T11:06:16.635+0000 7f13612a3640 1 monclient: found mon.noname-a 2024-09-14T11:06:17.323 INFO:tasks.workunit.client.0.smithi097.stderr: -350> 2024-09-14T11:06:16.635+0000 7f13612a3640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-14T11:06:17.323 INFO:tasks.workunit.client.0.smithi097.stderr: -349> 2024-09-14T11:06:16.636+0000 7f12467fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:06:17.323 INFO:tasks.workunit.client.0.smithi097.stderr: -348> 2024-09-14T11:06:16.636+0000 7f12467fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:06:17.323 INFO:tasks.workunit.client.0.smithi097.stderr: -347> 2024-09-14T11:06:16.636+0000 7f12467fc640 10 monclient: dump: 2024-09-14T11:06:17.323 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:06:17.324 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:06:17.324 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:17.324 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:17.324 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:06:17.324 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:06:17.324 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:06:17.324 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:06:17.324 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:06:17.324 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:17.324 INFO:tasks.workunit.client.0.smithi097.stderr: -346> 2024-09-14T11:06:16.636+0000 7f12467fc640 10 monclient: _finish_auth 0 2024-09-14T11:06:17.324 INFO:tasks.workunit.client.0.smithi097.stderr: -345> 2024-09-14T11:06:16.636+0000 7f12467fc640 10 monclient: _check_auth_tickets 2024-09-14T11:06:17.324 INFO:tasks.workunit.client.0.smithi097.stderr: -344> 2024-09-14T11:06:16.636+0000 7f12467fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:06:17.324 INFO:tasks.workunit.client.0.smithi097.stderr: -343> 2024-09-14T11:06:16.636+0000 7f12467fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:06:17.324 INFO:tasks.workunit.client.0.smithi097.stderr: -342> 2024-09-14T11:06:16.636+0000 7f12467fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:06:17.325 INFO:tasks.workunit.client.0.smithi097.stderr: -341> 2024-09-14T11:06:16.636+0000 7f12467fc640 10 monclient: dump: 2024-09-14T11:06:17.325 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:06:17.325 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:06:17.325 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:17.325 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:17.325 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:06:17.325 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:06:17.325 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:06:17.325 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:06:17.325 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:06:17.325 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:17.325 INFO:tasks.workunit.client.0.smithi097.stderr: -340> 2024-09-14T11:06:16.636+0000 7f1364d1f800 5 monclient: authenticate success, global_id 7758 2024-09-14T11:06:17.325 INFO:tasks.workunit.client.0.smithi097.stderr: -339> 2024-09-14T11:06:16.636+0000 7f1364d1f800 10 monclient: _renew_subs 2024-09-14T11:06:17.325 INFO:tasks.workunit.client.0.smithi097.stderr: -338> 2024-09-14T11:06:16.636+0000 7f1364d1f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:06:17.326 INFO:tasks.workunit.client.0.smithi097.stderr: -337> 2024-09-14T11:06:16.636+0000 7f1361aa4640 4 set_mon_vals no callback set 2024-09-14T11:06:17.326 INFO:tasks.workunit.client.0.smithi097.stderr: -336> 2024-09-14T11:06:16.636+0000 7f1364d1f800 10 monclient: _renew_subs 2024-09-14T11:06:17.326 INFO:tasks.workunit.client.0.smithi097.stderr: -335> 2024-09-14T11:06:16.636+0000 7f1364d1f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:06:17.326 INFO:tasks.workunit.client.0.smithi097.stderr: -334> 2024-09-14T11:06:16.638+0000 7f12467fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:06:17.326 INFO:tasks.workunit.client.0.smithi097.stderr: -333> 2024-09-14T11:06:16.638+0000 7f12467fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:06:17.326 INFO:tasks.workunit.client.0.smithi097.stderr: -332> 2024-09-14T11:06:16.638+0000 7f12467fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:06:17.326 INFO:tasks.workunit.client.0.smithi097.stderr: -331> 2024-09-14T11:06:16.638+0000 7f13582a1640 10 monclient: get_auth_request con 0x7f1238077140 auth_method 0 2024-09-14T11:06:17.326 INFO:tasks.workunit.client.0.smithi097.stderr: -330> 2024-09-14T11:06:16.638+0000 7f1364d1f800 10 monclient: get_monmap_and_config 2024-09-14T11:06:17.326 INFO:tasks.workunit.client.0.smithi097.stderr: -329> 2024-09-14T11:06:16.638+0000 7f1364d1f800 10 monclient: build_initial_monmap 2024-09-14T11:06:17.326 INFO:tasks.workunit.client.0.smithi097.stderr: -328> 2024-09-14T11:06:16.638+0000 7f1364d1f800 1 build_initial for_mkfs: 0 2024-09-14T11:06:17.326 INFO:tasks.workunit.client.0.smithi097.stderr: -327> 2024-09-14T11:06:16.638+0000 7f1364d1f800 10 monclient: monmap: 2024-09-14T11:06:17.326 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:06:17.326 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:06:17.326 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:06:17.327 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:06:17.327 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:06:17.327 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:06:17.327 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:06:17.327 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:06:17.327 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:06:17.327 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:17.327 INFO:tasks.workunit.client.0.smithi097.stderr: -326> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x559f002f2030) adding auth protocol: cephx 2024-09-14T11:06:17.327 INFO:tasks.workunit.client.0.smithi097.stderr: -325> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x559f002f2030) adding auth protocol: cephx 2024-09-14T11:06:17.327 INFO:tasks.workunit.client.0.smithi097.stderr: -324> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x559f002f2030) adding auth protocol: cephx 2024-09-14T11:06:17.327 INFO:tasks.workunit.client.0.smithi097.stderr: -323> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x559f002f2030) adding con mode: secure 2024-09-14T11:06:17.327 INFO:tasks.workunit.client.0.smithi097.stderr: -322> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x559f002f2030) adding con mode: crc 2024-09-14T11:06:17.327 INFO:tasks.workunit.client.0.smithi097.stderr: -321> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x559f002f2030) adding con mode: secure 2024-09-14T11:06:17.327 INFO:tasks.workunit.client.0.smithi097.stderr: -320> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x559f002f2030) adding con mode: crc 2024-09-14T11:06:17.328 INFO:tasks.workunit.client.0.smithi097.stderr: -319> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x559f002f2030) adding con mode: secure 2024-09-14T11:06:17.328 INFO:tasks.workunit.client.0.smithi097.stderr: -318> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x559f002f2030) adding con mode: crc 2024-09-14T11:06:17.328 INFO:tasks.workunit.client.0.smithi097.stderr: -317> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x559f002f2030) adding con mode: crc 2024-09-14T11:06:17.328 INFO:tasks.workunit.client.0.smithi097.stderr: -316> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x559f002f2030) adding con mode: secure 2024-09-14T11:06:17.328 INFO:tasks.workunit.client.0.smithi097.stderr: -315> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x559f002f2030) adding con mode: crc 2024-09-14T11:06:17.328 INFO:tasks.workunit.client.0.smithi097.stderr: -314> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x559f002f2030) adding con mode: secure 2024-09-14T11:06:17.328 INFO:tasks.workunit.client.0.smithi097.stderr: -313> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x559f002f2030) adding con mode: crc 2024-09-14T11:06:17.328 INFO:tasks.workunit.client.0.smithi097.stderr: -312> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x559f002f2030) adding con mode: secure 2024-09-14T11:06:17.328 INFO:tasks.workunit.client.0.smithi097.stderr: -311> 2024-09-14T11:06:16.638+0000 7f1364d1f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:06:17.328 INFO:tasks.workunit.client.0.smithi097.stderr: -310> 2024-09-14T11:06:16.638+0000 7f1364d1f800 10 monclient: init 2024-09-14T11:06:17.328 INFO:tasks.workunit.client.0.smithi097.stderr: -309> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9580) adding auth protocol: cephx 2024-09-14T11:06:17.328 INFO:tasks.workunit.client.0.smithi097.stderr: -308> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9580) adding auth protocol: cephx 2024-09-14T11:06:17.328 INFO:tasks.workunit.client.0.smithi097.stderr: -307> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9580) adding auth protocol: cephx 2024-09-14T11:06:17.329 INFO:tasks.workunit.client.0.smithi097.stderr: -306> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9580) adding con mode: secure 2024-09-14T11:06:17.329 INFO:tasks.workunit.client.0.smithi097.stderr: -305> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9580) adding con mode: crc 2024-09-14T11:06:17.329 INFO:tasks.workunit.client.0.smithi097.stderr: -304> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9580) adding con mode: secure 2024-09-14T11:06:17.329 INFO:tasks.workunit.client.0.smithi097.stderr: -303> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9580) adding con mode: crc 2024-09-14T11:06:17.329 INFO:tasks.workunit.client.0.smithi097.stderr: -302> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9580) adding con mode: secure 2024-09-14T11:06:17.329 INFO:tasks.workunit.client.0.smithi097.stderr: -301> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9580) adding con mode: crc 2024-09-14T11:06:17.329 INFO:tasks.workunit.client.0.smithi097.stderr: -300> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9580) adding con mode: crc 2024-09-14T11:06:17.329 INFO:tasks.workunit.client.0.smithi097.stderr: -299> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9580) adding con mode: secure 2024-09-14T11:06:17.329 INFO:tasks.workunit.client.0.smithi097.stderr: -298> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9580) adding con mode: crc 2024-09-14T11:06:17.329 INFO:tasks.workunit.client.0.smithi097.stderr: -297> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9580) adding con mode: secure 2024-09-14T11:06:17.329 INFO:tasks.workunit.client.0.smithi097.stderr: -296> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9580) adding con mode: crc 2024-09-14T11:06:17.329 INFO:tasks.workunit.client.0.smithi097.stderr: -295> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9580) adding con mode: secure 2024-09-14T11:06:17.329 INFO:tasks.workunit.client.0.smithi097.stderr: -294> 2024-09-14T11:06:16.639+0000 7f1364d1f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:06:17.329 INFO:tasks.workunit.client.0.smithi097.stderr: -293> 2024-09-14T11:06:16.639+0000 7f1364d1f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:06:17.330 INFO:tasks.workunit.client.0.smithi097.stderr: -292> 2024-09-14T11:06:16.639+0000 7f1364d1f800 5 asok(0x559f00032270) register_command rotate-key cmddesc rotate-key hook 0x7ffcfd6a96c8 EEXIST 2024-09-14T11:06:17.330 INFO:tasks.workunit.client.0.smithi097.stderr: -291> 2024-09-14T11:06:16.639+0000 7f1364d1f800 10 monclient: _reopen_session rank -1 2024-09-14T11:06:17.330 INFO:tasks.workunit.client.0.smithi097.stderr: -290> 2024-09-14T11:06:16.639+0000 7f1364d1f800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:06:17.330 INFO:tasks.workunit.client.0.smithi097.stderr: -289> 2024-09-14T11:06:16.639+0000 7f1364d1f800 10 monclient(hunting): picked mon.noname-b con 0x559f002f61c0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:06:17.330 INFO:tasks.workunit.client.0.smithi097.stderr: -288> 2024-09-14T11:06:16.639+0000 7f1364d1f800 10 monclient(hunting): picked mon.noname-a con 0x559f00320c30 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:06:17.330 INFO:tasks.workunit.client.0.smithi097.stderr: -287> 2024-09-14T11:06:16.639+0000 7f1364d1f800 10 monclient(hunting): picked mon.noname-c con 0x559f00321fe0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:06:17.330 INFO:tasks.workunit.client.0.smithi097.stderr: -286> 2024-09-14T11:06:16.639+0000 7f1364d1f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:17.330 INFO:tasks.workunit.client.0.smithi097.stderr: -285> 2024-09-14T11:06:16.639+0000 7f1364d1f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:17.330 INFO:tasks.workunit.client.0.smithi097.stderr: -284> 2024-09-14T11:06:16.639+0000 7f1364d1f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:17.330 INFO:tasks.workunit.client.0.smithi097.stderr: -283> 2024-09-14T11:06:16.639+0000 7f1364d1f800 10 monclient(hunting): _renew_subs 2024-09-14T11:06:17.330 INFO:tasks.workunit.client.0.smithi097.stderr: -282> 2024-09-14T11:06:16.639+0000 7f1364d1f800 10 monclient(hunting): authenticate will time out at 2058.292360s 2024-09-14T11:06:17.330 INFO:tasks.workunit.client.0.smithi097.stderr: -281> 2024-09-14T11:06:16.639+0000 7f13612a3640 10 monclient(hunting): get_auth_request con 0x559f00320c30 auth_method 0 2024-09-14T11:06:17.330 INFO:tasks.workunit.client.0.smithi097.stderr: -280> 2024-09-14T11:06:16.639+0000 7f13612a3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:06:17.331 INFO:tasks.workunit.client.0.smithi097.stderr: -279> 2024-09-14T11:06:16.639+0000 7f13612a3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:06:17.331 INFO:tasks.workunit.client.0.smithi097.stderr: -278> 2024-09-14T11:06:16.639+0000 7f13612a3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:06:17.331 INFO:tasks.workunit.client.0.smithi097.stderr: -277> 2024-09-14T11:06:16.639+0000 7f1360aa2640 10 monclient(hunting): get_auth_request con 0x559f00321fe0 auth_method 0 2024-09-14T11:06:17.331 INFO:tasks.workunit.client.0.smithi097.stderr: -276> 2024-09-14T11:06:16.639+0000 7f1360aa2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:06:17.331 INFO:tasks.workunit.client.0.smithi097.stderr: -275> 2024-09-14T11:06:16.639+0000 7f1360aa2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:06:17.331 INFO:tasks.workunit.client.0.smithi097.stderr: -274> 2024-09-14T11:06:16.639+0000 7f1360aa2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:06:17.331 INFO:tasks.workunit.client.0.smithi097.stderr: -273> 2024-09-14T11:06:16.639+0000 7f13612a3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:06:17.331 INFO:tasks.workunit.client.0.smithi097.stderr: -272> 2024-09-14T11:06:16.639+0000 7f13612a3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:06:17.331 INFO:tasks.workunit.client.0.smithi097.stderr: -271> 2024-09-14T11:06:16.639+0000 7f13612a3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:06:17.331 INFO:tasks.workunit.client.0.smithi097.stderr: -270> 2024-09-14T11:06:16.639+0000 7f1360aa2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:06:17.331 INFO:tasks.workunit.client.0.smithi097.stderr: -269> 2024-09-14T11:06:16.639+0000 7f1360aa2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:06:17.331 INFO:tasks.workunit.client.0.smithi097.stderr: -268> 2024-09-14T11:06:16.639+0000 7f1360aa2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:06:17.331 INFO:tasks.workunit.client.0.smithi097.stderr: -267> 2024-09-14T11:06:16.639+0000 7f13612a3640 10 monclient(hunting): handle_auth_done global_id 7761 payload 274 2024-09-14T11:06:17.331 INFO:tasks.workunit.client.0.smithi097.stderr: -266> 2024-09-14T11:06:16.639+0000 7f13612a3640 10 monclient: _finish_hunting 0 2024-09-14T11:06:17.332 INFO:tasks.workunit.client.0.smithi097.stderr: -265> 2024-09-14T11:06:16.639+0000 7f13612a3640 1 monclient: found mon.noname-a 2024-09-14T11:06:17.332 INFO:tasks.workunit.client.0.smithi097.stderr: -264> 2024-09-14T11:06:16.639+0000 7f13612a3640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-14T11:06:17.332 INFO:tasks.workunit.client.0.smithi097.stderr: -263> 2024-09-14T11:06:16.639+0000 7f1237fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:06:17.332 INFO:tasks.workunit.client.0.smithi097.stderr: -262> 2024-09-14T11:06:16.639+0000 7f1237fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:06:17.332 INFO:tasks.workunit.client.0.smithi097.stderr: -261> 2024-09-14T11:06:16.639+0000 7f1237fff640 10 monclient: dump: 2024-09-14T11:06:17.332 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:06:17.332 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:06:17.332 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:17.332 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:17.332 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:06:17.332 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:06:17.332 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:06:17.332 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:06:17.332 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:06:17.333 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:17.333 INFO:tasks.workunit.client.0.smithi097.stderr: -260> 2024-09-14T11:06:16.639+0000 7f1237fff640 10 monclient: _finish_auth 0 2024-09-14T11:06:17.333 INFO:tasks.workunit.client.0.smithi097.stderr: -259> 2024-09-14T11:06:16.639+0000 7f1237fff640 10 monclient: _check_auth_tickets 2024-09-14T11:06:17.333 INFO:tasks.workunit.client.0.smithi097.stderr: -258> 2024-09-14T11:06:16.639+0000 7f1237fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:06:17.333 INFO:tasks.workunit.client.0.smithi097.stderr: -257> 2024-09-14T11:06:16.639+0000 7f1237fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:06:17.333 INFO:tasks.workunit.client.0.smithi097.stderr: -256> 2024-09-14T11:06:16.639+0000 7f1237fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:06:17.333 INFO:tasks.workunit.client.0.smithi097.stderr: -255> 2024-09-14T11:06:16.639+0000 7f1237fff640 10 monclient: dump: 2024-09-14T11:06:17.333 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:06:17.333 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:06:17.333 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:17.333 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:17.333 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:06:17.333 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:06:17.334 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:06:17.334 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:06:17.334 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:06:17.334 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:17.334 INFO:tasks.workunit.client.0.smithi097.stderr: -254> 2024-09-14T11:06:16.639+0000 7f1364d1f800 5 monclient: authenticate success, global_id 7761 2024-09-14T11:06:17.334 INFO:tasks.workunit.client.0.smithi097.stderr: -253> 2024-09-14T11:06:16.639+0000 7f1364d1f800 10 monclient: get_monmap_and_config success 2024-09-14T11:06:17.334 INFO:tasks.workunit.client.0.smithi097.stderr: -252> 2024-09-14T11:06:16.639+0000 7f1364d1f800 4 set_mon_vals no callback set 2024-09-14T11:06:17.334 INFO:tasks.workunit.client.0.smithi097.stderr: -251> 2024-09-14T11:06:16.640+0000 7f1364d1f800 10 monclient: shutdown 2024-09-14T11:06:17.334 INFO:tasks.workunit.client.0.smithi097.stderr: -250> 2024-09-14T11:06:16.640+0000 7f1364d1f800 10 monclient: build_initial_monmap 2024-09-14T11:06:17.334 INFO:tasks.workunit.client.0.smithi097.stderr: -249> 2024-09-14T11:06:16.640+0000 7f1364d1f800 1 build_initial for_mkfs: 0 2024-09-14T11:06:17.334 INFO:tasks.workunit.client.0.smithi097.stderr: -248> 2024-09-14T11:06:16.640+0000 7f1364d1f800 10 monclient: monmap: 2024-09-14T11:06:17.334 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:06:17.334 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:06:17.334 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:06:17.335 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:06:17.335 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:06:17.335 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:06:17.335 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:06:17.335 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:06:17.335 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:06:17.335 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:17.335 INFO:tasks.workunit.client.0.smithi097.stderr: -247> 2024-09-14T11:06:16.640+0000 7f1364d1f800 5 AuthRegistry(0x559f00316de0) adding auth protocol: cephx 2024-09-14T11:06:17.335 INFO:tasks.workunit.client.0.smithi097.stderr: -246> 2024-09-14T11:06:16.640+0000 7f1364d1f800 5 AuthRegistry(0x559f00316de0) adding auth protocol: cephx 2024-09-14T11:06:17.335 INFO:tasks.workunit.client.0.smithi097.stderr: -245> 2024-09-14T11:06:16.640+0000 7f1364d1f800 5 AuthRegistry(0x559f00316de0) adding auth protocol: cephx 2024-09-14T11:06:17.335 INFO:tasks.workunit.client.0.smithi097.stderr: -244> 2024-09-14T11:06:16.640+0000 7f1364d1f800 5 AuthRegistry(0x559f00316de0) adding con mode: secure 2024-09-14T11:06:17.335 INFO:tasks.workunit.client.0.smithi097.stderr: -243> 2024-09-14T11:06:16.640+0000 7f1364d1f800 5 AuthRegistry(0x559f00316de0) adding con mode: crc 2024-09-14T11:06:17.335 INFO:tasks.workunit.client.0.smithi097.stderr: -242> 2024-09-14T11:06:16.640+0000 7f1364d1f800 5 AuthRegistry(0x559f00316de0) adding con mode: secure 2024-09-14T11:06:17.335 INFO:tasks.workunit.client.0.smithi097.stderr: -241> 2024-09-14T11:06:16.640+0000 7f1364d1f800 5 AuthRegistry(0x559f00316de0) adding con mode: crc 2024-09-14T11:06:17.336 INFO:tasks.workunit.client.0.smithi097.stderr: -240> 2024-09-14T11:06:16.640+0000 7f1364d1f800 5 AuthRegistry(0x559f00316de0) adding con mode: secure 2024-09-14T11:06:17.336 INFO:tasks.workunit.client.0.smithi097.stderr: -239> 2024-09-14T11:06:16.640+0000 7f1364d1f800 5 AuthRegistry(0x559f00316de0) adding con mode: crc 2024-09-14T11:06:17.336 INFO:tasks.workunit.client.0.smithi097.stderr: -238> 2024-09-14T11:06:16.640+0000 7f1364d1f800 5 AuthRegistry(0x559f00316de0) adding con mode: crc 2024-09-14T11:06:17.336 INFO:tasks.workunit.client.0.smithi097.stderr: -237> 2024-09-14T11:06:16.640+0000 7f1364d1f800 5 AuthRegistry(0x559f00316de0) adding con mode: secure 2024-09-14T11:06:17.336 INFO:tasks.workunit.client.0.smithi097.stderr: -236> 2024-09-14T11:06:16.640+0000 7f1364d1f800 5 AuthRegistry(0x559f00316de0) adding con mode: crc 2024-09-14T11:06:17.336 INFO:tasks.workunit.client.0.smithi097.stderr: -235> 2024-09-14T11:06:16.640+0000 7f1364d1f800 5 AuthRegistry(0x559f00316de0) adding con mode: secure 2024-09-14T11:06:17.336 INFO:tasks.workunit.client.0.smithi097.stderr: -234> 2024-09-14T11:06:16.640+0000 7f1364d1f800 5 AuthRegistry(0x559f00316de0) adding con mode: crc 2024-09-14T11:06:17.336 INFO:tasks.workunit.client.0.smithi097.stderr: -233> 2024-09-14T11:06:16.640+0000 7f1364d1f800 5 AuthRegistry(0x559f00316de0) adding con mode: secure 2024-09-14T11:06:17.336 INFO:tasks.workunit.client.0.smithi097.stderr: -232> 2024-09-14T11:06:16.640+0000 7f1364d1f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:06:17.336 INFO:tasks.workunit.client.0.smithi097.stderr: -231> 2024-09-14T11:06:16.640+0000 7f1364d1f800 1 librados: starting msgr at 2024-09-14T11:06:17.336 INFO:tasks.workunit.client.0.smithi097.stderr: -230> 2024-09-14T11:06:16.640+0000 7f1364d1f800 1 librados: starting objecter 2024-09-14T11:06:17.336 INFO:tasks.workunit.client.0.smithi097.stderr: -229> 2024-09-14T11:06:16.640+0000 7f1364d1f800 5 asok(0x559f00032270) register_command objecter_requests cmddesc objecter_requests hook 0x559f00320a60 EEXIST 2024-09-14T11:06:17.336 INFO:tasks.workunit.client.0.smithi097.stderr: -228> 2024-09-14T11:06:16.640+0000 7f1364d1f800 1 librados: setting wanted keys 2024-09-14T11:06:17.337 INFO:tasks.workunit.client.0.smithi097.stderr: -227> 2024-09-14T11:06:16.641+0000 7f1364d1f800 1 librados: calling monclient init 2024-09-14T11:06:17.337 INFO:tasks.workunit.client.0.smithi097.stderr: -226> 2024-09-14T11:06:16.641+0000 7f1364d1f800 10 monclient: init 2024-09-14T11:06:17.337 INFO:tasks.workunit.client.0.smithi097.stderr: -225> 2024-09-14T11:06:16.641+0000 7f1364d1f800 5 AuthRegistry(0x559f002e6a00) adding auth protocol: cephx 2024-09-14T11:06:17.337 INFO:tasks.workunit.client.0.smithi097.stderr: -224> 2024-09-14T11:06:16.641+0000 7f1364d1f800 5 AuthRegistry(0x559f002e6a00) adding auth protocol: cephx 2024-09-14T11:06:17.337 INFO:tasks.workunit.client.0.smithi097.stderr: -223> 2024-09-14T11:06:16.641+0000 7f1364d1f800 5 AuthRegistry(0x559f002e6a00) adding auth protocol: cephx 2024-09-14T11:06:17.337 INFO:tasks.workunit.client.0.smithi097.stderr: -222> 2024-09-14T11:06:16.641+0000 7f1364d1f800 5 AuthRegistry(0x559f002e6a00) adding con mode: secure 2024-09-14T11:06:17.337 INFO:tasks.workunit.client.0.smithi097.stderr: -221> 2024-09-14T11:06:16.641+0000 7f1364d1f800 5 AuthRegistry(0x559f002e6a00) adding con mode: crc 2024-09-14T11:06:17.337 INFO:tasks.workunit.client.0.smithi097.stderr: -220> 2024-09-14T11:06:16.641+0000 7f1364d1f800 5 AuthRegistry(0x559f002e6a00) adding con mode: secure 2024-09-14T11:06:17.337 INFO:tasks.workunit.client.0.smithi097.stderr: -219> 2024-09-14T11:06:16.641+0000 7f1364d1f800 5 AuthRegistry(0x559f002e6a00) adding con mode: crc 2024-09-14T11:06:17.337 INFO:tasks.workunit.client.0.smithi097.stderr: -218> 2024-09-14T11:06:16.641+0000 7f1364d1f800 5 AuthRegistry(0x559f002e6a00) adding con mode: secure 2024-09-14T11:06:17.337 INFO:tasks.workunit.client.0.smithi097.stderr: -217> 2024-09-14T11:06:16.641+0000 7f1364d1f800 5 AuthRegistry(0x559f002e6a00) adding con mode: crc 2024-09-14T11:06:17.337 INFO:tasks.workunit.client.0.smithi097.stderr: -216> 2024-09-14T11:06:16.641+0000 7f1364d1f800 5 AuthRegistry(0x559f002e6a00) adding con mode: crc 2024-09-14T11:06:17.337 INFO:tasks.workunit.client.0.smithi097.stderr: -215> 2024-09-14T11:06:16.641+0000 7f1364d1f800 5 AuthRegistry(0x559f002e6a00) adding con mode: secure 2024-09-14T11:06:17.337 INFO:tasks.workunit.client.0.smithi097.stderr: -214> 2024-09-14T11:06:16.641+0000 7f1364d1f800 5 AuthRegistry(0x559f002e6a00) adding con mode: crc 2024-09-14T11:06:17.338 INFO:tasks.workunit.client.0.smithi097.stderr: -213> 2024-09-14T11:06:16.641+0000 7f1364d1f800 5 AuthRegistry(0x559f002e6a00) adding con mode: secure 2024-09-14T11:06:17.338 INFO:tasks.workunit.client.0.smithi097.stderr: -212> 2024-09-14T11:06:16.641+0000 7f1364d1f800 5 AuthRegistry(0x559f002e6a00) adding con mode: crc 2024-09-14T11:06:17.338 INFO:tasks.workunit.client.0.smithi097.stderr: -211> 2024-09-14T11:06:16.641+0000 7f1364d1f800 5 AuthRegistry(0x559f002e6a00) adding con mode: secure 2024-09-14T11:06:17.338 INFO:tasks.workunit.client.0.smithi097.stderr: -210> 2024-09-14T11:06:16.641+0000 7f1364d1f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:06:17.338 INFO:tasks.workunit.client.0.smithi097.stderr: -209> 2024-09-14T11:06:16.641+0000 7f1364d1f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:06:17.338 INFO:tasks.workunit.client.0.smithi097.stderr: -208> 2024-09-14T11:06:16.641+0000 7f1364d1f800 5 asok(0x559f00032270) register_command rotate-key cmddesc rotate-key hook 0x559f002e6b48 EEXIST 2024-09-14T11:06:17.338 INFO:tasks.workunit.client.0.smithi097.stderr: -207> 2024-09-14T11:06:16.641+0000 7f1364d1f800 10 monclient: _reopen_session rank -1 2024-09-14T11:06:17.338 INFO:tasks.workunit.client.0.smithi097.stderr: -206> 2024-09-14T11:06:16.641+0000 7f1364d1f800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:06:17.338 INFO:tasks.workunit.client.0.smithi097.stderr: -205> 2024-09-14T11:06:16.641+0000 7f1364d1f800 10 monclient(hunting): picked mon.noname-c con 0x559f002f61c0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:06:17.338 INFO:tasks.workunit.client.0.smithi097.stderr: -204> 2024-09-14T11:06:16.641+0000 7f1364d1f800 10 monclient(hunting): picked mon.noname-b con 0x559f00321fe0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:06:17.338 INFO:tasks.workunit.client.0.smithi097.stderr: -203> 2024-09-14T11:06:16.641+0000 7f1364d1f800 10 monclient(hunting): picked mon.noname-a con 0x559f002f38d0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:06:17.338 INFO:tasks.workunit.client.0.smithi097.stderr: -202> 2024-09-14T11:06:16.641+0000 7f1364d1f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:17.338 INFO:tasks.workunit.client.0.smithi097.stderr: -201> 2024-09-14T11:06:16.641+0000 7f1364d1f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:17.339 INFO:tasks.workunit.client.0.smithi097.stderr: -200> 2024-09-14T11:06:16.641+0000 7f1364d1f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:17.339 INFO:tasks.workunit.client.0.smithi097.stderr: -199> 2024-09-14T11:06:16.641+0000 7f1364d1f800 10 monclient(hunting): _renew_subs 2024-09-14T11:06:17.339 INFO:tasks.workunit.client.0.smithi097.stderr: -198> 2024-09-14T11:06:16.641+0000 7f1364d1f800 10 monclient(hunting): authenticate will time out at 2058.294514s 2024-09-14T11:06:17.339 INFO:tasks.workunit.client.0.smithi097.stderr: -197> 2024-09-14T11:06:16.641+0000 7f13582a1640 10 monclient(hunting): get_auth_request con 0x559f002f61c0 auth_method 0 2024-09-14T11:06:17.339 INFO:tasks.workunit.client.0.smithi097.stderr: -196> 2024-09-14T11:06:16.641+0000 7f13582a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:06:17.339 INFO:tasks.workunit.client.0.smithi097.stderr: -195> 2024-09-14T11:06:16.641+0000 7f13582a1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:06:17.339 INFO:tasks.workunit.client.0.smithi097.stderr: -194> 2024-09-14T11:06:16.641+0000 7f13582a1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:06:17.339 INFO:tasks.workunit.client.0.smithi097.stderr: -193> 2024-09-14T11:06:16.641+0000 7f1360aa2640 10 monclient(hunting): get_auth_request con 0x559f002f38d0 auth_method 0 2024-09-14T11:06:17.339 INFO:tasks.workunit.client.0.smithi097.stderr: -192> 2024-09-14T11:06:16.641+0000 7f1360aa2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:06:17.339 INFO:tasks.workunit.client.0.smithi097.stderr: -191> 2024-09-14T11:06:16.641+0000 7f1360aa2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:06:17.339 INFO:tasks.workunit.client.0.smithi097.stderr: -190> 2024-09-14T11:06:16.641+0000 7f1360aa2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:06:17.339 INFO:tasks.workunit.client.0.smithi097.stderr: -189> 2024-09-14T11:06:16.641+0000 7f1360aa2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:06:17.339 INFO:tasks.workunit.client.0.smithi097.stderr: -188> 2024-09-14T11:06:16.641+0000 7f1360aa2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:06:17.339 INFO:tasks.workunit.client.0.smithi097.stderr: -187> 2024-09-14T11:06:16.641+0000 7f1360aa2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:06:17.340 INFO:tasks.workunit.client.0.smithi097.stderr: -186> 2024-09-14T11:06:16.641+0000 7f13582a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:06:17.340 INFO:tasks.workunit.client.0.smithi097.stderr: -185> 2024-09-14T11:06:16.641+0000 7f13582a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:06:17.340 INFO:tasks.workunit.client.0.smithi097.stderr: -184> 2024-09-14T11:06:16.641+0000 7f13582a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:06:17.340 INFO:tasks.workunit.client.0.smithi097.stderr: -183> 2024-09-14T11:06:16.641+0000 7f13612a3640 10 monclient(hunting): get_auth_request con 0x559f00321fe0 auth_method 0 2024-09-14T11:06:17.340 INFO:tasks.workunit.client.0.smithi097.stderr: -182> 2024-09-14T11:06:16.641+0000 7f13612a3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:06:17.340 INFO:tasks.workunit.client.0.smithi097.stderr: -181> 2024-09-14T11:06:16.641+0000 7f13612a3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:06:17.340 INFO:tasks.workunit.client.0.smithi097.stderr: -180> 2024-09-14T11:06:16.641+0000 7f13612a3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:06:17.340 INFO:tasks.workunit.client.0.smithi097.stderr: -179> 2024-09-14T11:06:16.641+0000 7f1360aa2640 10 monclient(hunting): handle_auth_done global_id 7764 payload 824 2024-09-14T11:06:17.340 INFO:tasks.workunit.client.0.smithi097.stderr: -178> 2024-09-14T11:06:16.641+0000 7f1360aa2640 10 monclient: _finish_hunting 0 2024-09-14T11:06:17.340 INFO:tasks.workunit.client.0.smithi097.stderr: -177> 2024-09-14T11:06:16.641+0000 7f1360aa2640 1 monclient: found mon.noname-a 2024-09-14T11:06:17.340 INFO:tasks.workunit.client.0.smithi097.stderr: -176> 2024-09-14T11:06:16.641+0000 7f1360aa2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-14T11:06:17.340 INFO:tasks.workunit.client.0.smithi097.stderr: -175> 2024-09-14T11:06:16.842+0000 7f1360aa2640 10 monclient: get_auth_request con 0x559f002f38d0 auth_method 0 2024-09-14T11:06:17.340 INFO:tasks.workunit.client.0.smithi097.stderr: -174> 2024-09-14T11:06:16.842+0000 7f1360aa2640 0 --2- 172.21.15.97:0/2263882649 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559f002f38d0 0x559f003154a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:06:17.341 INFO:tasks.workunit.client.0.smithi097.stderr: -173> 2024-09-14T11:06:16.842+0000 7f12367fc640 10 monclient: ms_handle_reset current mon [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:06:17.341 INFO:tasks.workunit.client.0.smithi097.stderr: -172> 2024-09-14T11:06:16.842+0000 7f12367fc640 10 monclient: _reopen_session rank -1 2024-09-14T11:06:17.341 INFO:tasks.workunit.client.0.smithi097.stderr: -171> 2024-09-14T11:06:16.842+0000 7f12367fc640 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:06:17.341 INFO:tasks.workunit.client.0.smithi097.stderr: -170> 2024-09-14T11:06:16.842+0000 7f12367fc640 10 monclient(hunting): picked mon.noname-c con 0x559f002f61c0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:06:17.341 INFO:tasks.workunit.client.0.smithi097.stderr: -169> 2024-09-14T11:06:16.842+0000 7f12367fc640 10 monclient(hunting): picked mon.noname-b con 0x559f00321fe0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:06:17.341 INFO:tasks.workunit.client.0.smithi097.stderr: -168> 2024-09-14T11:06:16.842+0000 7f12367fc640 10 monclient(hunting): picked mon.noname-a con 0x7f122c0073d0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:06:17.341 INFO:tasks.workunit.client.0.smithi097.stderr: -167> 2024-09-14T11:06:16.842+0000 7f12367fc640 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:17.341 INFO:tasks.workunit.client.0.smithi097.stderr: -166> 2024-09-14T11:06:16.842+0000 7f12367fc640 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:17.341 INFO:tasks.workunit.client.0.smithi097.stderr: -165> 2024-09-14T11:06:16.842+0000 7f12367fc640 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:17.341 INFO:tasks.workunit.client.0.smithi097.stderr: -164> 2024-09-14T11:06:16.842+0000 7f12367fc640 10 monclient(hunting): _renew_subs 2024-09-14T11:06:17.341 INFO:tasks.workunit.client.0.smithi097.stderr: -163> 2024-09-14T11:06:16.842+0000 7f1360aa2640 10 monclient(hunting): get_auth_request con 0x7f122c0073d0 auth_method 0 2024-09-14T11:06:17.341 INFO:tasks.workunit.client.0.smithi097.stderr: -162> 2024-09-14T11:06:16.842+0000 7f1360aa2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:06:17.341 INFO:tasks.workunit.client.0.smithi097.stderr: -161> 2024-09-14T11:06:16.842+0000 7f1360aa2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:06:17.341 INFO:tasks.workunit.client.0.smithi097.stderr: -160> 2024-09-14T11:06:16.842+0000 7f1360aa2640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-14T11:06:17.342 INFO:tasks.workunit.client.0.smithi097.stderr: -159> 2024-09-14T11:06:16.842+0000 7f13582a1640 10 monclient(hunting): get_auth_request con 0x559f002f61c0 auth_method 0 2024-09-14T11:06:17.342 INFO:tasks.workunit.client.0.smithi097.stderr: -158> 2024-09-14T11:06:16.842+0000 7f13582a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:06:17.342 INFO:tasks.workunit.client.0.smithi097.stderr: -157> 2024-09-14T11:06:16.842+0000 7f13582a1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:06:17.342 INFO:tasks.workunit.client.0.smithi097.stderr: -156> 2024-09-14T11:06:16.842+0000 7f13582a1640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-14T11:06:17.342 INFO:tasks.workunit.client.0.smithi097.stderr: -155> 2024-09-14T11:06:16.842+0000 7f1360aa2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:06:17.342 INFO:tasks.workunit.client.0.smithi097.stderr: -154> 2024-09-14T11:06:16.842+0000 7f1360aa2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:06:17.342 INFO:tasks.workunit.client.0.smithi097.stderr: -153> 2024-09-14T11:06:16.842+0000 7f1360aa2640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-14T11:06:17.342 INFO:tasks.workunit.client.0.smithi097.stderr: -152> 2024-09-14T11:06:16.842+0000 7f13582a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:06:17.342 INFO:tasks.workunit.client.0.smithi097.stderr: -151> 2024-09-14T11:06:16.842+0000 7f13582a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:06:17.342 INFO:tasks.workunit.client.0.smithi097.stderr: -150> 2024-09-14T11:06:16.842+0000 7f13582a1640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-14T11:06:17.342 INFO:tasks.workunit.client.0.smithi097.stderr: -149> 2024-09-14T11:06:16.842+0000 7f1360aa2640 10 monclient(hunting): handle_auth_done global_id 7764 payload 293 2024-09-14T11:06:17.342 INFO:tasks.workunit.client.0.smithi097.stderr: -148> 2024-09-14T11:06:16.842+0000 7f1360aa2640 10 monclient: _finish_hunting 0 2024-09-14T11:06:17.342 INFO:tasks.workunit.client.0.smithi097.stderr: -147> 2024-09-14T11:06:16.842+0000 7f1360aa2640 1 monclient: found mon.noname-a 2024-09-14T11:06:17.342 INFO:tasks.workunit.client.0.smithi097.stderr: -146> 2024-09-14T11:06:16.842+0000 7f1360aa2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-14T11:06:17.343 INFO:tasks.workunit.client.0.smithi097.stderr: -145> 2024-09-14T11:06:16.842+0000 7f12367fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:06:17.343 INFO:tasks.workunit.client.0.smithi097.stderr: -144> 2024-09-14T11:06:16.842+0000 7f12367fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:06:17.343 INFO:tasks.workunit.client.0.smithi097.stderr: -143> 2024-09-14T11:06:16.842+0000 7f12367fc640 10 monclient: dump: 2024-09-14T11:06:17.343 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:06:17.343 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:06:17.343 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:17.343 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:17.343 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:06:17.343 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:06:17.343 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:06:17.343 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:06:17.343 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:06:17.343 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:17.343 INFO:tasks.workunit.client.0.smithi097.stderr: -142> 2024-09-14T11:06:16.842+0000 7f12367fc640 10 monclient: _finish_auth 0 2024-09-14T11:06:17.344 INFO:tasks.workunit.client.0.smithi097.stderr: -141> 2024-09-14T11:06:16.842+0000 7f12367fc640 10 monclient: _check_auth_tickets 2024-09-14T11:06:17.344 INFO:tasks.workunit.client.0.smithi097.stderr: -140> 2024-09-14T11:06:16.842+0000 7f12367fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:06:17.344 INFO:tasks.workunit.client.0.smithi097.stderr: -139> 2024-09-14T11:06:16.842+0000 7f12367fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:06:17.344 INFO:tasks.workunit.client.0.smithi097.stderr: -138> 2024-09-14T11:06:16.842+0000 7f12367fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:06:17.344 INFO:tasks.workunit.client.0.smithi097.stderr: -137> 2024-09-14T11:06:16.842+0000 7f12367fc640 10 monclient: dump: 2024-09-14T11:06:17.344 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:06:17.344 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:06:17.344 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:17.344 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:17.344 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:06:17.344 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:06:17.344 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:06:17.344 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:06:17.344 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:06:17.345 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:17.345 INFO:tasks.workunit.client.0.smithi097.stderr: -136> 2024-09-14T11:06:16.842+0000 7f1364d1f800 5 monclient: authenticate success, global_id 7764 2024-09-14T11:06:17.345 INFO:tasks.workunit.client.0.smithi097.stderr: -135> 2024-09-14T11:06:16.842+0000 7f1364d1f800 10 monclient: _renew_subs 2024-09-14T11:06:17.345 INFO:tasks.workunit.client.0.smithi097.stderr: -134> 2024-09-14T11:06:16.842+0000 7f1237fff640 4 set_mon_vals no callback set 2024-09-14T11:06:17.345 INFO:tasks.workunit.client.0.smithi097.stderr: -133> 2024-09-14T11:06:16.842+0000 7f1364d1f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:06:17.345 INFO:tasks.workunit.client.0.smithi097.stderr: -132> 2024-09-14T11:06:16.842+0000 7f1364d1f800 10 monclient: _renew_subs 2024-09-14T11:06:17.345 INFO:tasks.workunit.client.0.smithi097.stderr: -131> 2024-09-14T11:06:16.842+0000 7f1364d1f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:06:17.345 INFO:tasks.workunit.client.0.smithi097.stderr: -130> 2024-09-14T11:06:16.842+0000 7f1364d1f800 1 librados: init done 2024-09-14T11:06:17.345 INFO:tasks.workunit.client.0.smithi097.stderr: -129> 2024-09-14T11:06:16.842+0000 7f1364d1f800 5 asok(0x559f00032270) register_command cr dump hook 0x559f002f3018 2024-09-14T11:06:17.345 INFO:tasks.workunit.client.0.smithi097.stderr: -128> 2024-09-14T11:06:16.844+0000 7f1364d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.345 INFO:tasks.workunit.client.0.smithi097.stderr: -127> 2024-09-14T11:06:16.845+0000 7f12367fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:06:17.345 INFO:tasks.workunit.client.0.smithi097.stderr: -126> 2024-09-14T11:06:16.845+0000 7f12367fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:06:17.345 INFO:tasks.workunit.client.0.smithi097.stderr: -125> 2024-09-14T11:06:16.845+0000 7f12367fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:06:17.345 INFO:tasks.workunit.client.0.smithi097.stderr: -124> 2024-09-14T11:06:16.845+0000 7f13582a1640 10 monclient: get_auth_request con 0x559f002f38d0 auth_method 0 2024-09-14T11:06:17.346 INFO:tasks.workunit.client.0.smithi097.stderr: -123> 2024-09-14T11:06:16.845+0000 7f13612a3640 10 monclient: get_auth_request con 0x559f00339ec0 auth_method 0 2024-09-14T11:06:17.346 INFO:tasks.workunit.client.0.smithi097.stderr: -122> 2024-09-14T11:06:16.846+0000 7f1364d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:17.346 INFO:tasks.workunit.client.0.smithi097.stderr: -121> 2024-09-14T11:06:16.846+0000 7f1364d1f800 20 realm 2024-09-14T11:06:17.346 INFO:tasks.workunit.client.0.smithi097.stderr: -120> 2024-09-14T11:06:16.846+0000 7f1364d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.346 INFO:tasks.workunit.client.0.smithi097.stderr: -119> 2024-09-14T11:06:16.846+0000 7f1364d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:17.346 INFO:tasks.workunit.client.0.smithi097.stderr: -118> 2024-09-14T11:06:16.846+0000 7f1364d1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:06:17.346 INFO:tasks.workunit.client.0.smithi097.stderr: -117> 2024-09-14T11:06:16.846+0000 7f1364d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.346 INFO:tasks.workunit.client.0.smithi097.stderr: -116> 2024-09-14T11:06:16.846+0000 7f1364d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:17.346 INFO:tasks.workunit.client.0.smithi097.stderr: -115> 2024-09-14T11:06:16.846+0000 7f1364d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.346 INFO:tasks.workunit.client.0.smithi097.stderr: -114> 2024-09-14T11:06:16.846+0000 7f13582a1640 10 monclient: get_auth_request con 0x559f0033e0a0 auth_method 0 2024-09-14T11:06:17.346 INFO:tasks.workunit.client.0.smithi097.stderr: -113> 2024-09-14T11:06:16.847+0000 7f1364d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:17.346 INFO:tasks.workunit.client.0.smithi097.stderr: -112> 2024-09-14T11:06:16.847+0000 7f1364d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.346 INFO:tasks.workunit.client.0.smithi097.stderr: -111> 2024-09-14T11:06:16.847+0000 7f13612a3640 10 monclient: get_auth_request con 0x559f00341950 auth_method 0 2024-09-14T11:06:17.347 INFO:tasks.workunit.client.0.smithi097.stderr: -110> 2024-09-14T11:06:16.848+0000 7f1364d1f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:06:17.347 INFO:tasks.workunit.client.0.smithi097.stderr: -109> 2024-09-14T11:06:16.848+0000 7f1364d1f800 20 searching for the correct realm 2024-09-14T11:06:17.347 INFO:tasks.workunit.client.0.smithi097.stderr: -108> 2024-09-14T11:06:16.848+0000 7f1360aa2640 10 monclient: get_auth_request con 0x559f00346660 auth_method 0 2024-09-14T11:06:17.347 INFO:tasks.workunit.client.0.smithi097.stderr: -107> 2024-09-14T11:06:16.849+0000 7f13582a1640 10 monclient: get_auth_request con 0x7f1350018070 auth_method 0 2024-09-14T11:06:17.347 INFO:tasks.workunit.client.0.smithi097.stderr: -106> 2024-09-14T11:06:16.849+0000 7f13582a1640 0 -- 172.21.15.97:0/2263882649 >> [v2:172.21.15.97:6808/2081705332,v1:172.21.15.97:6809/2081705332] conn(0x7f1350018070 msgr2=0x7f13500605c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:06:17.347 INFO:tasks.workunit.client.0.smithi097.stderr: -105> 2024-09-14T11:06:17.050+0000 7f13582a1640 10 monclient: get_auth_request con 0x7f1350018070 auth_method 0 2024-09-14T11:06:17.347 INFO:tasks.workunit.client.0.smithi097.stderr: -104> 2024-09-14T11:06:17.050+0000 7f12367fc640 1 client.7764.objecter ms_handle_reset 0x559f0033e0a0 session 0x559f0033da20 osd.1 2024-09-14T11:06:17.347 INFO:tasks.workunit.client.0.smithi097.stderr: -103> 2024-09-14T11:06:17.050+0000 7f12367fc640 10 monclient: _renew_subs 2024-09-14T11:06:17.347 INFO:tasks.workunit.client.0.smithi097.stderr: -102> 2024-09-14T11:06:17.050+0000 7f12367fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:06:17.347 INFO:tasks.workunit.client.0.smithi097.stderr: -101> 2024-09-14T11:06:17.051+0000 7f13582a1640 10 monclient: get_auth_request con 0x7f122c08eb10 auth_method 0 2024-09-14T11:06:17.347 INFO:tasks.workunit.client.0.smithi097.stderr: -100> 2024-09-14T11:06:17.051+0000 7f13612a3640 10 monclient: get_auth_request con 0x7f13480393f0 auth_method 0 2024-09-14T11:06:17.347 INFO:tasks.workunit.client.0.smithi097.stderr: -99> 2024-09-14T11:06:17.053+0000 7f13612a3640 0 -- 172.21.15.97:0/2263882649 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x559f00339ec0 msgr2=0x559f0033c360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:17.347 INFO:tasks.workunit.client.0.smithi097.stderr: -98> 2024-09-14T11:06:17.053+0000 7f12367fc640 1 client.7764.objecter ms_handle_reset 0x559f00339ec0 session 0x559f00339840 osd.6 2024-09-14T11:06:17.347 INFO:tasks.workunit.client.0.smithi097.stderr: -97> 2024-09-14T11:06:17.053+0000 7f13612a3640 10 monclient: get_auth_request con 0x559f0033e0a0 auth_method 0 2024-09-14T11:06:17.348 INFO:tasks.workunit.client.0.smithi097.stderr: -96> 2024-09-14T11:06:17.054+0000 7f1360aa2640 10 monclient: get_auth_request con 0x7f1348060930 auth_method 0 2024-09-14T11:06:17.348 INFO:tasks.workunit.client.0.smithi097.stderr: -95> 2024-09-14T11:06:17.255+0000 7f1360aa2640 10 monclient: get_auth_request con 0x7f1348060930 auth_method 0 2024-09-14T11:06:17.348 INFO:tasks.workunit.client.0.smithi097.stderr: -94> 2024-09-14T11:06:17.255+0000 7f13582a1640 10 monclient: get_auth_request con 0x7f1350044990 auth_method 0 2024-09-14T11:06:17.348 INFO:tasks.workunit.client.0.smithi097.stderr: -93> 2024-09-14T11:06:17.260+0000 7f1364d1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:06:17.348 INFO:tasks.workunit.client.0.smithi097.stderr: -92> 2024-09-14T11:06:17.260+0000 7f1364d1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:06:17.348 INFO:tasks.workunit.client.0.smithi097.stderr: -91> 2024-09-14T11:06:17.260+0000 7f1364d1f800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:06:17.348 INFO:tasks.workunit.client.0.smithi097.stderr: -90> 2024-09-14T11:06:17.260+0000 7f1364d1f800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:06:17.348 INFO:tasks.workunit.client.0.smithi097.stderr: -89> 2024-09-14T11:06:17.260+0000 7f1364d1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:06:17.348 INFO:tasks.workunit.client.0.smithi097.stderr: -88> 2024-09-14T11:06:17.260+0000 7f1364d1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:06:17.348 INFO:tasks.workunit.client.0.smithi097.stderr: -87> 2024-09-14T11:06:17.260+0000 7f1364d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.348 INFO:tasks.workunit.client.0.smithi097.stderr: -86> 2024-09-14T11:06:17.260+0000 7f1364d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:17.348 INFO:tasks.workunit.client.0.smithi097.stderr: -85> 2024-09-14T11:06:17.260+0000 7f1364d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.348 INFO:tasks.workunit.client.0.smithi097.stderr: -84> 2024-09-14T11:06:17.261+0000 7f1364d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:17.349 INFO:tasks.workunit.client.0.smithi097.stderr: -83> 2024-09-14T11:06:17.261+0000 7f1364d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.349 INFO:tasks.workunit.client.0.smithi097.stderr: -82> 2024-09-14T11:06:17.261+0000 7f1364d1f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:06:17.349 INFO:tasks.workunit.client.0.smithi097.stderr: -81> 2024-09-14T11:06:17.261+0000 7f1364d1f800 20 zone default found 2024-09-14T11:06:17.349 INFO:tasks.workunit.client.0.smithi097.stderr: -80> 2024-09-14T11:06:17.261+0000 7f1364d1f800 4 Realm: () 2024-09-14T11:06:17.349 INFO:tasks.workunit.client.0.smithi097.stderr: -79> 2024-09-14T11:06:17.261+0000 7f1364d1f800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:06:17.352 INFO:tasks.workunit.client.0.smithi097.stderr: -78> 2024-09-14T11:06:17.261+0000 7f1364d1f800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:06:17.352 INFO:tasks.workunit.client.0.smithi097.stderr: -77> 2024-09-14T11:06:17.261+0000 7f1364d1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:06:17.352 INFO:tasks.workunit.client.0.smithi097.stderr: -76> 2024-09-14T11:06:17.261+0000 7f1364d1f800 20 zonegroup default 2024-09-14T11:06:17.352 INFO:tasks.workunit.client.0.smithi097.stderr: -75> 2024-09-14T11:06:17.261+0000 7f1364d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.352 INFO:tasks.workunit.client.0.smithi097.stderr: -74> 2024-09-14T11:06:17.261+0000 7f1364d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:17.352 INFO:tasks.workunit.client.0.smithi097.stderr: -73> 2024-09-14T11:06:17.261+0000 7f1364d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.352 INFO:tasks.workunit.client.0.smithi097.stderr: -72> 2024-09-14T11:06:17.262+0000 7f1364d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:17.352 INFO:tasks.workunit.client.0.smithi097.stderr: -71> 2024-09-14T11:06:17.262+0000 7f1364d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.352 INFO:tasks.workunit.client.0.smithi097.stderr: -70> 2024-09-14T11:06:17.262+0000 7f1364d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:17.353 INFO:tasks.workunit.client.0.smithi097.stderr: -69> 2024-09-14T11:06:17.262+0000 7f1364d1f800 20 started sync module instance, tier type = 2024-09-14T11:06:17.353 INFO:tasks.workunit.client.0.smithi097.stderr: -68> 2024-09-14T11:06:17.262+0000 7f1364d1f800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:06:17.353 INFO:tasks.workunit.client.0.smithi097.stderr: -67> 2024-09-14T11:06:17.271+0000 7f1364d1f800 20 add_watcher() i=0 2024-09-14T11:06:17.353 INFO:tasks.workunit.client.0.smithi097.stderr: -66> 2024-09-14T11:06:17.271+0000 7f1364d1f800 20 add_watcher() i=1 2024-09-14T11:06:17.353 INFO:tasks.workunit.client.0.smithi097.stderr: -65> 2024-09-14T11:06:17.271+0000 7f1364d1f800 20 add_watcher() i=2 2024-09-14T11:06:17.353 INFO:tasks.workunit.client.0.smithi097.stderr: -64> 2024-09-14T11:06:17.271+0000 7f1364d1f800 20 add_watcher() i=3 2024-09-14T11:06:17.353 INFO:tasks.workunit.client.0.smithi097.stderr: -63> 2024-09-14T11:06:17.271+0000 7f1364d1f800 20 add_watcher() i=4 2024-09-14T11:06:17.353 INFO:tasks.workunit.client.0.smithi097.stderr: -62> 2024-09-14T11:06:17.271+0000 7f1364d1f800 20 add_watcher() i=5 2024-09-14T11:06:17.353 INFO:tasks.workunit.client.0.smithi097.stderr: -61> 2024-09-14T11:06:17.271+0000 7f1364d1f800 20 add_watcher() i=6 2024-09-14T11:06:17.353 INFO:tasks.workunit.client.0.smithi097.stderr: -60> 2024-09-14T11:06:17.272+0000 7f1364d1f800 20 add_watcher() i=7 2024-09-14T11:06:17.353 INFO:tasks.workunit.client.0.smithi097.stderr: -59> 2024-09-14T11:06:17.272+0000 7f1364d1f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:06:17.354 INFO:tasks.workunit.client.0.smithi097.stderr: -58> 2024-09-14T11:06:17.273+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9a60) adding auth protocol: cephx 2024-09-14T11:06:17.354 INFO:tasks.workunit.client.0.smithi097.stderr: -57> 2024-09-14T11:06:17.273+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9a60) adding auth protocol: cephx 2024-09-14T11:06:17.354 INFO:tasks.workunit.client.0.smithi097.stderr: -56> 2024-09-14T11:06:17.273+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9a60) adding auth protocol: cephx 2024-09-14T11:06:17.354 INFO:tasks.workunit.client.0.smithi097.stderr: -55> 2024-09-14T11:06:17.273+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9a60) adding con mode: secure 2024-09-14T11:06:17.354 INFO:tasks.workunit.client.0.smithi097.stderr: -54> 2024-09-14T11:06:17.273+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9a60) adding con mode: crc 2024-09-14T11:06:17.354 INFO:tasks.workunit.client.0.smithi097.stderr: -53> 2024-09-14T11:06:17.273+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9a60) adding con mode: secure 2024-09-14T11:06:17.354 INFO:tasks.workunit.client.0.smithi097.stderr: -52> 2024-09-14T11:06:17.273+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9a60) adding con mode: crc 2024-09-14T11:06:17.354 INFO:tasks.workunit.client.0.smithi097.stderr: -51> 2024-09-14T11:06:17.273+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9a60) adding con mode: secure 2024-09-14T11:06:17.354 INFO:tasks.workunit.client.0.smithi097.stderr: -50> 2024-09-14T11:06:17.273+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9a60) adding con mode: crc 2024-09-14T11:06:17.354 INFO:tasks.workunit.client.0.smithi097.stderr: -49> 2024-09-14T11:06:17.273+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9a60) adding con mode: crc 2024-09-14T11:06:17.354 INFO:tasks.workunit.client.0.smithi097.stderr: -48> 2024-09-14T11:06:17.273+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9a60) adding con mode: secure 2024-09-14T11:06:17.355 INFO:tasks.workunit.client.0.smithi097.stderr: -47> 2024-09-14T11:06:17.273+0000 7f12177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:17.355 INFO:tasks.workunit.client.0.smithi097.stderr: -46> 2024-09-14T11:06:17.274+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9a60) adding con mode: crc 2024-09-14T11:06:17.355 INFO:tasks.workunit.client.0.smithi097.stderr: -45> 2024-09-14T11:06:17.274+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9a60) adding con mode: secure 2024-09-14T11:06:17.355 INFO:tasks.workunit.client.0.smithi097.stderr: -44> 2024-09-14T11:06:17.274+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9a60) adding con mode: crc 2024-09-14T11:06:17.355 INFO:tasks.workunit.client.0.smithi097.stderr: -43> 2024-09-14T11:06:17.274+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9a60) adding con mode: secure 2024-09-14T11:06:17.355 INFO:tasks.workunit.client.0.smithi097.stderr: -42> 2024-09-14T11:06:17.274+0000 7f1364d1f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:06:17.355 INFO:tasks.workunit.client.0.smithi097.stderr: -41> 2024-09-14T11:06:17.274+0000 7f1364d1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:06:17.355 INFO:tasks.workunit.client.0.smithi097.stderr: -40> 2024-09-14T11:06:17.274+0000 7f1364d1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:06:17.355 INFO:tasks.workunit.client.0.smithi097.stderr: -39> 2024-09-14T11:06:17.274+0000 7f1364d1f800 5 asok(0x559f00032270) register_command cache list hook 0x559f00314e20 2024-09-14T11:06:17.355 INFO:tasks.workunit.client.0.smithi097.stderr: -38> 2024-09-14T11:06:17.274+0000 7f1364d1f800 5 asok(0x559f00032270) register_command cache inspect hook 0x559f00314e20 2024-09-14T11:06:17.355 INFO:tasks.workunit.client.0.smithi097.stderr: -37> 2024-09-14T11:06:17.274+0000 7f1364d1f800 5 asok(0x559f00032270) register_command cache erase hook 0x559f00314e20 2024-09-14T11:06:17.356 INFO:tasks.workunit.client.0.smithi097.stderr: -36> 2024-09-14T11:06:17.274+0000 7f1364d1f800 5 asok(0x559f00032270) register_command cache zap hook 0x559f00314e20 2024-09-14T11:06:17.356 INFO:tasks.workunit.client.0.smithi097.stderr: -35> 2024-09-14T11:06:17.274+0000 7f1364d1f800 5 note: GC not initialized 2024-09-14T11:06:17.356 INFO:tasks.workunit.client.0.smithi097.stderr: -34> 2024-09-14T11:06:17.274+0000 7f12167e4640 20 reqs_thread_entry: start 2024-09-14T11:06:17.356 INFO:tasks.workunit.client.0.smithi097.stderr: -33> 2024-09-14T11:06:17.274+0000 7f1364d1f800 5 asok(0x559f00032270) register_command sync trace show hook 0x7f1350065040 2024-09-14T11:06:17.356 INFO:tasks.workunit.client.0.smithi097.stderr: -32> 2024-09-14T11:06:17.274+0000 7f1364d1f800 5 asok(0x559f00032270) register_command sync trace history hook 0x7f1350065040 2024-09-14T11:06:17.356 INFO:tasks.workunit.client.0.smithi097.stderr: -31> 2024-09-14T11:06:17.274+0000 7f1364d1f800 5 asok(0x559f00032270) register_command sync trace active hook 0x7f1350065040 2024-09-14T11:06:17.356 INFO:tasks.workunit.client.0.smithi097.stderr: -30> 2024-09-14T11:06:17.274+0000 7f1364d1f800 5 asok(0x559f00032270) register_command sync trace active_short hook 0x7f1350065040 2024-09-14T11:06:17.356 INFO:tasks.workunit.client.0.smithi097.stderr: -29> 2024-09-14T11:06:17.274+0000 7f1364d1f800 20 init_complete bucket index max shards: 11 2024-09-14T11:06:17.356 INFO:tasks.workunit.client.0.smithi097.stderr: -28> 2024-09-14T11:06:17.274+0000 7f1364d1f800 20 Filter name: none 2024-09-14T11:06:17.356 INFO:tasks.workunit.client.0.smithi097.stderr: -27> 2024-09-14T11:06:17.274+0000 7f120ffff640 20 reqs_thread_entry: start 2024-09-14T11:06:17.356 INFO:tasks.workunit.client.0.smithi097.stderr: -26> 2024-09-14T11:06:17.274+0000 7f1364d1f800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:06:17.357 INFO:tasks.workunit.client.0.smithi097.stderr: -25> 2024-09-14T11:06:17.274+0000 7f1364d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.357 INFO:tasks.workunit.client.0.smithi097.stderr: -24> 2024-09-14T11:06:17.275+0000 7f1364d1f800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:06:17.357 INFO:tasks.workunit.client.0.smithi097.stderr: -23> 2024-09-14T11:06:17.275+0000 7f1364d1f800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:06:17.357 INFO:tasks.workunit.client.0.smithi097.stderr: -22> 2024-09-14T11:06:17.275+0000 7f1364d1f800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:06:17.357 INFO:tasks.workunit.client.0.smithi097.stderr: -21> 2024-09-14T11:06:17.275+0000 7f1364d1f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 : miss 2024-09-14T11:06:17.357 INFO:tasks.workunit.client.0.smithi097.stderr: -20> 2024-09-14T11:06:17.275+0000 7f1364d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.357 INFO:tasks.workunit.client.0.smithi097.stderr: -19> 2024-09-14T11:06:17.275+0000 7f1364d1f800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:06:17.357 INFO:tasks.workunit.client.0.smithi097.stderr: -18> 2024-09-14T11:06:17.275+0000 7f1364d1f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 info.flags=0x17 2024-09-14T11:06:17.357 INFO:tasks.workunit.client.0.smithi097.stderr: -17> 2024-09-14T11:06:17.275+0000 7f1364d1f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 to cache LRU end 2024-09-14T11:06:17.357 INFO:tasks.workunit.client.0.smithi097.stderr: -16> 2024-09-14T11:06:17.275+0000 7f1364d1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:06:17.358 INFO:tasks.workunit.client.0.smithi097.stderr: -15> 2024-09-14T11:06:17.275+0000 7f1364d1f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:17.358 INFO:tasks.workunit.client.0.smithi097.stderr: -14> 2024-09-14T11:06:17.275+0000 7f1364d1f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 2024-09-14T11:06:17.358 INFO:tasks.workunit.client.0.smithi097.stderr: -13> 2024-09-14T11:06:17.280+0000 7f1364d1f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 info.flags=0x17 2024-09-14T11:06:17.358 INFO:tasks.workunit.client.0.smithi097.stderr: -12> 2024-09-14T11:06:17.280+0000 7f1364d1f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 to cache LRU end 2024-09-14T11:06:17.358 INFO:tasks.workunit.client.0.smithi097.stderr: -11> 2024-09-14T11:06:17.280+0000 7f1364d1f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:17.358 INFO:tasks.workunit.client.0.smithi097.stderr: -10> 2024-09-14T11:06:17.280+0000 7f1364d1f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36, ofs0, ns] 2024-09-14T11:06:17.358 INFO:tasks.workunit.client.0.smithi097.stderr: -9> 2024-09-14T11:06:17.281+0000 7f1237fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595098 cookie 94141391552144 notifier 7764 bl.length()=923 2024-09-14T11:06:17.358 INFO:tasks.workunit.client.0.smithi097.stderr: -8> 2024-09-14T11:06:17.281+0000 7f1237fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 info.flags=0x17 2024-09-14T11:06:17.358 INFO:tasks.workunit.client.0.smithi097.stderr: -7> 2024-09-14T11:06:17.281+0000 7f1237fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 to cache LRU end 2024-09-14T11:06:17.358 INFO:tasks.workunit.client.0.smithi097.stderr: -6> 2024-09-14T11:06:17.281+0000 7f1237fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:17.358 INFO:tasks.workunit.client.0.smithi097.stderr: -5> 2024-09-14T11:06:17.281+0000 7f1364d1f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36]): orig_sources= new_sources= 2024-09-14T11:06:17.358 INFO:tasks.workunit.client.0.smithi097.stderr: -4> 2024-09-14T11:06:17.281+0000 7f1364d1f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36]): potential sources added=[] removed=[] 2024-09-14T11:06:17.359 INFO:tasks.workunit.client.0.smithi097.stderr: -3> 2024-09-14T11:06:17.281+0000 7f1364d1f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36]): orig_dests= new_dests= 2024-09-14T11:06:17.359 INFO:tasks.workunit.client.0.smithi097.stderr: -2> 2024-09-14T11:06:17.281+0000 7f1364d1f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36]): potential dests added=[] removed=[] 2024-09-14T11:06:17.359 INFO:tasks.workunit.client.0.smithi097.stderr: -1> 2024-09-14T11:06:17.284+0000 7f1364d1f800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1364d1f800 time 2024-09-14T11:06:17.284623+0000 2024-09-14T11:06:17.359 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:06:17.359 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:17.359 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:06:17.359 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f136658c76a] 2024-09-14T11:06:17.359 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f136658c928] 2024-09-14T11:06:17.359 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559efdb370b1] 2024-09-14T11:06:17.359 INFO:tasks.workunit.client.0.smithi097.stderr: 4: radosgw-admin(+0xd8907c) [0x559efe04b07c] 2024-09-14T11:06:17.359 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559efdb46efd] 2024-09-14T11:06:17.360 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-14T11:06:17.360 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f1365229590] 2024-09-14T11:06:17.360 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-14T11:06:17.360 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-14T11:06:17.360 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:17.360 INFO:tasks.workunit.client.0.smithi097.stderr: 0> 2024-09-14T11:06:17.285+0000 7f1364d1f800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:06:17.360 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f1364d1f800 thread_name:radosgw-admin 2024-09-14T11:06:17.360 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:17.360 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:06:17.360 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f136523e6f0] 2024-09-14T11:06:17.360 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f136528b99c] 2024-09-14T11:06:17.361 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-14T11:06:17.361 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-14T11:06:17.361 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f136658c7c4] 2024-09-14T11:06:17.361 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f136658c928] 2024-09-14T11:06:17.361 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559efdb370b1] 2024-09-14T11:06:17.361 INFO:tasks.workunit.client.0.smithi097.stderr: 8: radosgw-admin(+0xd8907c) [0x559efe04b07c] 2024-09-14T11:06:17.361 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559efdb46efd] 2024-09-14T11:06:17.361 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-14T11:06:17.361 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f1365229590] 2024-09-14T11:06:17.361 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-14T11:06:17.361 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-14T11:06:17.362 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:06:17.362 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:17.362 INFO:tasks.workunit.client.0.smithi097.stderr:--- logging levels --- 2024-09-14T11:06:17.362 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 none 2024-09-14T11:06:17.362 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 lockdep 2024-09-14T11:06:17.362 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 context 2024-09-14T11:06:17.362 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 crush 2024-09-14T11:06:17.362 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds 2024-09-14T11:06:17.362 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_balancer 2024-09-14T11:06:17.362 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_locker 2024-09-14T11:06:17.362 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log 2024-09-14T11:06:17.362 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log_expire 2024-09-14T11:06:17.363 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_migrator 2024-09-14T11:06:17.363 INFO:tasks.workunit.client.0.smithi097.stderr: 3/ 5 mds_quiesce 2024-09-14T11:06:17.363 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 buffer 2024-09-14T11:06:17.363 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 timer 2024-09-14T11:06:17.363 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 filer 2024-09-14T11:06:17.363 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 striper 2024-09-14T11:06:17.363 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 objecter 2024-09-14T11:06:17.363 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rados 2024-09-14T11:06:17.363 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd 2024-09-14T11:06:17.363 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_mirror 2024-09-14T11:06:17.363 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_replay 2024-09-14T11:06:17.363 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_pwl 2024-09-14T11:06:17.364 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 journaler 2024-09-14T11:06:17.364 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objectcacher 2024-09-14T11:06:17.364 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:06:17.364 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 client 2024-09-14T11:06:17.364 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 osd 2024-09-14T11:06:17.364 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 optracker 2024-09-14T11:06:17.364 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objclass 2024-09-14T11:06:17.364 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 filestore 2024-09-14T11:06:17.364 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 journal 2024-09-14T11:06:17.364 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 ms 2024-09-14T11:06:17.364 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mon 2024-09-14T11:06:17.365 INFO:tasks.workunit.client.0.smithi097.stderr: 0/10 monc 2024-09-14T11:06:17.365 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 paxos 2024-09-14T11:06:17.365 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 tp 2024-09-14T11:06:17.365 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 auth 2024-09-14T11:06:17.365 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 crypto 2024-09-14T11:06:17.365 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 finisher 2024-09-14T11:06:17.365 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 reserver 2024-09-14T11:06:17.365 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 heartbeatmap 2024-09-14T11:06:17.365 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 perfcounter 2024-09-14T11:06:17.365 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw 2024-09-14T11:06:17.365 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_sync 2024-09-14T11:06:17.366 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_datacache 2024-09-14T11:06:17.366 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_access 2024-09-14T11:06:17.366 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:06:17.366 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_flight 2024-09-14T11:06:17.366 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:06:17.366 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw_notification 2024-09-14T11:06:17.366 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 javaclient 2024-09-14T11:06:17.366 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 asok 2024-09-14T11:06:17.366 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 throttle 2024-09-14T11:06:17.366 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 refs 2024-09-14T11:06:17.366 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 compressor 2024-09-14T11:06:17.366 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluestore 2024-09-14T11:06:17.367 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluefs 2024-09-14T11:06:17.367 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 bdev 2024-09-14T11:06:17.367 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 kstore 2024-09-14T11:06:17.367 INFO:tasks.workunit.client.0.smithi097.stderr: 4/ 5 rocksdb 2024-09-14T11:06:17.367 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 fuse 2024-09-14T11:06:17.367 INFO:tasks.workunit.client.0.smithi097.stderr: 2/ 5 mgr 2024-09-14T11:06:17.367 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mgrc 2024-09-14T11:06:17.367 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 dpdk 2024-09-14T11:06:17.367 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 eventtrace 2024-09-14T11:06:17.367 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 prioritycache 2024-09-14T11:06:17.367 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 test 2024-09-14T11:06:17.367 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:06:17.368 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephsqlite 2024-09-14T11:06:17.368 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:06:17.368 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore 2024-09-14T11:06:17.368 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_onode 2024-09-14T11:06:17.368 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_odata 2024-09-14T11:06:17.368 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_omap 2024-09-14T11:06:17.368 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_tm 2024-09-14T11:06:17.368 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_t 2024-09-14T11:06:17.368 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:06:17.368 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_epm 2024-09-14T11:06:17.368 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_lba 2024-09-14T11:06:17.368 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:06:17.369 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cache 2024-09-14T11:06:17.369 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_journal 2024-09-14T11:06:17.369 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_device 2024-09-14T11:06:17.369 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_backref 2024-09-14T11:06:17.369 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 alienstore 2024-09-14T11:06:17.369 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mclock 2024-09-14T11:06:17.369 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cyanstore 2024-09-14T11:06:17.369 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 ceph_exporter 2024-09-14T11:06:17.369 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 memstore 2024-09-14T11:06:17.369 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 trace 2024-09-14T11:06:17.369 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 ceph_dedup 2024-09-14T11:06:17.370 INFO:tasks.workunit.client.0.smithi097.stderr: -2/-2 (syslog threshold) 2024-09-14T11:06:17.370 INFO:tasks.workunit.client.0.smithi097.stderr: 99/99 (stderr threshold) 2024-09-14T11:06:17.370 INFO:tasks.workunit.client.0.smithi097.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:06:17.370 INFO:tasks.workunit.client.0.smithi097.stderr: 7f120ffff640 / http_manager 2024-09-14T11:06:17.370 INFO:tasks.workunit.client.0.smithi097.stderr: 7f12167e4640 / http_manager 2024-09-14T11:06:17.370 INFO:tasks.workunit.client.0.smithi097.stderr: 7f12177e6640 / rgw_dt_lg_renew 2024-09-14T11:06:17.370 INFO:tasks.workunit.client.0.smithi097.stderr: 7f12367fc640 / ms_dispatch 2024-09-14T11:06:17.370 INFO:tasks.workunit.client.0.smithi097.stderr: 7f1237fff640 / io_context_pool 2024-09-14T11:06:17.370 INFO:tasks.workunit.client.0.smithi097.stderr: 7f12467fc640 / ms_dispatch 2024-09-14T11:06:17.370 INFO:tasks.workunit.client.0.smithi097.stderr: 7f124d60a640 / ms_dispatch 2024-09-14T11:06:17.370 INFO:tasks.workunit.client.0.smithi097.stderr: 7f124ee0d640 / io_context_pool 2024-09-14T11:06:17.370 INFO:tasks.workunit.client.0.smithi097.stderr: 7f13582a1640 / msgr-worker-2 2024-09-14T11:06:17.371 INFO:tasks.workunit.client.0.smithi097.stderr: 7f1360aa2640 / msgr-worker-1 2024-09-14T11:06:17.371 INFO:tasks.workunit.client.0.smithi097.stderr: 7f13612a3640 / msgr-worker-0 2024-09-14T11:06:17.371 INFO:tasks.workunit.client.0.smithi097.stderr: 7f1361aa4640 / io_context_pool 2024-09-14T11:06:17.371 INFO:tasks.workunit.client.0.smithi097.stderr: 7f1364d1f800 / radosgw-admin 2024-09-14T11:06:17.371 INFO:tasks.workunit.client.0.smithi097.stderr: max_recent 500 2024-09-14T11:06:17.371 INFO:tasks.workunit.client.0.smithi097.stderr: max_new 1000 2024-09-14T11:06:17.371 INFO:tasks.workunit.client.0.smithi097.stderr: log_file /var/log/ceph/ceph-client.admin.134534.log 2024-09-14T11:06:17.371 INFO:tasks.workunit.client.0.smithi097.stderr:--- end dump of recent events --- 2024-09-14T11:06:17.371 INFO:tasks.workunit.client.0.smithi097.stderr:--- begin dump of recent events --- 2024-09-14T11:06:17.371 INFO:tasks.workunit.client.0.smithi097.stderr: -499> 2024-09-14T11:06:16.627+0000 7f1364d1f800 1 librados: calling monclient init 2024-09-14T11:06:17.371 INFO:tasks.workunit.client.0.smithi097.stderr: -498> 2024-09-14T11:06:16.627+0000 7f1364d1f800 10 monclient: init 2024-09-14T11:06:17.371 INFO:tasks.workunit.client.0.smithi097.stderr: -497> 2024-09-14T11:06:16.627+0000 7f1364d1f800 5 AuthRegistry(0x559f002522e0) adding auth protocol: cephx 2024-09-14T11:06:17.372 INFO:tasks.workunit.client.0.smithi097.stderr: -496> 2024-09-14T11:06:16.627+0000 7f1364d1f800 5 AuthRegistry(0x559f002522e0) adding auth protocol: cephx 2024-09-14T11:06:17.372 INFO:tasks.workunit.client.0.smithi097.stderr: -495> 2024-09-14T11:06:16.627+0000 7f1364d1f800 5 AuthRegistry(0x559f002522e0) adding auth protocol: cephx 2024-09-14T11:06:17.372 INFO:tasks.workunit.client.0.smithi097.stderr: -494> 2024-09-14T11:06:16.627+0000 7f1364d1f800 5 AuthRegistry(0x559f002522e0) adding con mode: secure 2024-09-14T11:06:17.372 INFO:tasks.workunit.client.0.smithi097.stderr: -493> 2024-09-14T11:06:16.627+0000 7f1364d1f800 5 AuthRegistry(0x559f002522e0) adding con mode: crc 2024-09-14T11:06:17.372 INFO:tasks.workunit.client.0.smithi097.stderr: -492> 2024-09-14T11:06:16.627+0000 7f1364d1f800 5 AuthRegistry(0x559f002522e0) adding con mode: secure 2024-09-14T11:06:17.372 INFO:tasks.workunit.client.0.smithi097.stderr: -491> 2024-09-14T11:06:16.627+0000 7f1364d1f800 5 AuthRegistry(0x559f002522e0) adding con mode: crc 2024-09-14T11:06:17.372 INFO:tasks.workunit.client.0.smithi097.stderr: -490> 2024-09-14T11:06:16.627+0000 7f1364d1f800 5 AuthRegistry(0x559f002522e0) adding con mode: secure 2024-09-14T11:06:17.372 INFO:tasks.workunit.client.0.smithi097.stderr: -489> 2024-09-14T11:06:16.627+0000 7f1364d1f800 5 AuthRegistry(0x559f002522e0) adding con mode: crc 2024-09-14T11:06:17.372 INFO:tasks.workunit.client.0.smithi097.stderr: -488> 2024-09-14T11:06:16.627+0000 7f1364d1f800 5 AuthRegistry(0x559f002522e0) adding con mode: crc 2024-09-14T11:06:17.372 INFO:tasks.workunit.client.0.smithi097.stderr: -487> 2024-09-14T11:06:16.627+0000 7f1364d1f800 5 AuthRegistry(0x559f002522e0) adding con mode: secure 2024-09-14T11:06:17.372 INFO:tasks.workunit.client.0.smithi097.stderr: -486> 2024-09-14T11:06:16.627+0000 7f1364d1f800 5 AuthRegistry(0x559f002522e0) adding con mode: crc 2024-09-14T11:06:17.373 INFO:tasks.workunit.client.0.smithi097.stderr: -485> 2024-09-14T11:06:16.627+0000 7f1364d1f800 5 AuthRegistry(0x559f002522e0) adding con mode: secure 2024-09-14T11:06:17.373 INFO:tasks.workunit.client.0.smithi097.stderr: -484> 2024-09-14T11:06:16.627+0000 7f1364d1f800 5 AuthRegistry(0x559f002522e0) adding con mode: crc 2024-09-14T11:06:17.373 INFO:tasks.workunit.client.0.smithi097.stderr: -483> 2024-09-14T11:06:16.627+0000 7f1364d1f800 5 AuthRegistry(0x559f002522e0) adding con mode: secure 2024-09-14T11:06:17.373 INFO:tasks.workunit.client.0.smithi097.stderr: -482> 2024-09-14T11:06:16.627+0000 7f1364d1f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:06:17.373 INFO:tasks.workunit.client.0.smithi097.stderr: -481> 2024-09-14T11:06:16.627+0000 7f1364d1f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:06:17.373 INFO:tasks.workunit.client.0.smithi097.stderr: -480> 2024-09-14T11:06:16.628+0000 7f1364d1f800 5 asok(0x559f00032270) register_command rotate-key hook 0x559f00252428 2024-09-14T11:06:17.373 INFO:tasks.workunit.client.0.smithi097.stderr: -479> 2024-09-14T11:06:16.628+0000 7f1364d1f800 10 monclient: _reopen_session rank -1 2024-09-14T11:06:17.373 INFO:tasks.workunit.client.0.smithi097.stderr: -478> 2024-09-14T11:06:16.628+0000 7f1364d1f800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:06:17.373 INFO:tasks.workunit.client.0.smithi097.stderr: -477> 2024-09-14T11:06:16.628+0000 7f1364d1f800 10 monclient(hunting): picked mon.noname-a con 0x559f000dba70 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:06:17.373 INFO:tasks.workunit.client.0.smithi097.stderr: -476> 2024-09-14T11:06:16.628+0000 7f1364d1f800 10 monclient(hunting): picked mon.noname-c con 0x559f00109670 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:06:17.373 INFO:tasks.workunit.client.0.smithi097.stderr: -475> 2024-09-14T11:06:16.628+0000 7f1364d1f800 10 monclient(hunting): picked mon.noname-b con 0x559f002593a0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:06:17.373 INFO:tasks.workunit.client.0.smithi097.stderr: -474> 2024-09-14T11:06:16.628+0000 7f1364d1f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:17.374 INFO:tasks.workunit.client.0.smithi097.stderr: -473> 2024-09-14T11:06:16.628+0000 7f1364d1f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:17.374 INFO:tasks.workunit.client.0.smithi097.stderr: -472> 2024-09-14T11:06:16.628+0000 7f1364d1f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:17.374 INFO:tasks.workunit.client.0.smithi097.stderr: -471> 2024-09-14T11:06:16.628+0000 7f1364d1f800 10 monclient(hunting): _renew_subs 2024-09-14T11:06:17.374 INFO:tasks.workunit.client.0.smithi097.stderr: -470> 2024-09-14T11:06:16.628+0000 7f1364d1f800 10 monclient(hunting): authenticate will time out at 2058.281138s 2024-09-14T11:06:17.374 INFO:tasks.workunit.client.0.smithi097.stderr: -469> 2024-09-14T11:06:16.628+0000 7f1360aa2640 10 monclient(hunting): get_auth_request con 0x559f000dba70 auth_method 0 2024-09-14T11:06:17.374 INFO:tasks.workunit.client.0.smithi097.stderr: -468> 2024-09-14T11:06:16.628+0000 7f1360aa2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:06:17.374 INFO:tasks.workunit.client.0.smithi097.stderr: -467> 2024-09-14T11:06:16.628+0000 7f1360aa2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:06:17.374 INFO:tasks.workunit.client.0.smithi097.stderr: -466> 2024-09-14T11:06:16.628+0000 7f1360aa2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:06:17.374 INFO:tasks.workunit.client.0.smithi097.stderr: -465> 2024-09-14T11:06:16.628+0000 7f13582a1640 10 monclient(hunting): get_auth_request con 0x559f00109670 auth_method 0 2024-09-14T11:06:17.374 INFO:tasks.workunit.client.0.smithi097.stderr: -464> 2024-09-14T11:06:16.628+0000 7f13582a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:06:17.374 INFO:tasks.workunit.client.0.smithi097.stderr: -463> 2024-09-14T11:06:16.628+0000 7f13582a1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:06:17.374 INFO:tasks.workunit.client.0.smithi097.stderr: -462> 2024-09-14T11:06:16.628+0000 7f13582a1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:06:17.375 INFO:tasks.workunit.client.0.smithi097.stderr: -461> 2024-09-14T11:06:16.628+0000 7f1360aa2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:06:17.375 INFO:tasks.workunit.client.0.smithi097.stderr: -460> 2024-09-14T11:06:16.628+0000 7f1360aa2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:06:17.375 INFO:tasks.workunit.client.0.smithi097.stderr: -459> 2024-09-14T11:06:16.628+0000 7f1360aa2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:06:17.375 INFO:tasks.workunit.client.0.smithi097.stderr: -458> 2024-09-14T11:06:16.628+0000 7f13582a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:06:17.375 INFO:tasks.workunit.client.0.smithi097.stderr: -457> 2024-09-14T11:06:16.628+0000 7f13582a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:06:17.375 INFO:tasks.workunit.client.0.smithi097.stderr: -456> 2024-09-14T11:06:16.628+0000 7f13582a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:06:17.375 INFO:tasks.workunit.client.0.smithi097.stderr: -455> 2024-09-14T11:06:16.628+0000 7f13612a3640 10 monclient(hunting): get_auth_request con 0x559f002593a0 auth_method 0 2024-09-14T11:06:17.375 INFO:tasks.workunit.client.0.smithi097.stderr: -454> 2024-09-14T11:06:16.628+0000 7f13612a3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:06:17.375 INFO:tasks.workunit.client.0.smithi097.stderr: -453> 2024-09-14T11:06:16.628+0000 7f13612a3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:06:17.375 INFO:tasks.workunit.client.0.smithi097.stderr: -452> 2024-09-14T11:06:16.628+0000 7f13612a3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:06:17.375 INFO:tasks.workunit.client.0.smithi097.stderr: -451> 2024-09-14T11:06:16.628+0000 7f1360aa2640 10 monclient(hunting): handle_auth_done global_id 7755 payload 824 2024-09-14T11:06:17.375 INFO:tasks.workunit.client.0.smithi097.stderr: -450> 2024-09-14T11:06:16.628+0000 7f1360aa2640 10 monclient: _finish_hunting 0 2024-09-14T11:06:17.376 INFO:tasks.workunit.client.0.smithi097.stderr: -449> 2024-09-14T11:06:16.628+0000 7f1360aa2640 1 monclient: found mon.noname-a 2024-09-14T11:06:17.376 INFO:tasks.workunit.client.0.smithi097.stderr: -448> 2024-09-14T11:06:16.628+0000 7f1360aa2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-14T11:06:17.376 INFO:tasks.workunit.client.0.smithi097.stderr: -447> 2024-09-14T11:06:16.628+0000 7f124d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:06:17.376 INFO:tasks.workunit.client.0.smithi097.stderr: -446> 2024-09-14T11:06:16.628+0000 7f124d60a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:06:17.376 INFO:tasks.workunit.client.0.smithi097.stderr: -445> 2024-09-14T11:06:16.628+0000 7f124d60a640 10 monclient: dump: 2024-09-14T11:06:17.376 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:06:17.376 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:06:17.376 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:17.376 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:17.376 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:06:17.376 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:06:17.377 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:06:17.377 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:06:17.377 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:06:17.377 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:17.377 INFO:tasks.workunit.client.0.smithi097.stderr: -444> 2024-09-14T11:06:16.628+0000 7f124d60a640 10 monclient: _finish_auth 0 2024-09-14T11:06:17.377 INFO:tasks.workunit.client.0.smithi097.stderr: -443> 2024-09-14T11:06:16.628+0000 7f124d60a640 10 monclient: _check_auth_tickets 2024-09-14T11:06:17.377 INFO:tasks.workunit.client.0.smithi097.stderr: -442> 2024-09-14T11:06:16.628+0000 7f124d60a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:06:17.377 INFO:tasks.workunit.client.0.smithi097.stderr: -441> 2024-09-14T11:06:16.628+0000 7f124d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:06:17.377 INFO:tasks.workunit.client.0.smithi097.stderr: -440> 2024-09-14T11:06:16.628+0000 7f124d60a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:06:17.377 INFO:tasks.workunit.client.0.smithi097.stderr: -439> 2024-09-14T11:06:16.628+0000 7f124d60a640 10 monclient: dump: 2024-09-14T11:06:17.377 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:06:17.378 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:06:17.378 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:17.378 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:17.378 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:06:17.378 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:06:17.378 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:06:17.378 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:06:17.378 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:06:17.378 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:17.378 INFO:tasks.workunit.client.0.smithi097.stderr: -438> 2024-09-14T11:06:16.628+0000 7f1364d1f800 5 monclient: authenticate success, global_id 7755 2024-09-14T11:06:17.378 INFO:tasks.workunit.client.0.smithi097.stderr: -437> 2024-09-14T11:06:16.628+0000 7f1364d1f800 10 monclient: _renew_subs 2024-09-14T11:06:17.378 INFO:tasks.workunit.client.0.smithi097.stderr: -436> 2024-09-14T11:06:16.628+0000 7f1364d1f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:06:17.379 INFO:tasks.workunit.client.0.smithi097.stderr: -435> 2024-09-14T11:06:16.628+0000 7f124ee0d640 4 set_mon_vals no callback set 2024-09-14T11:06:17.379 INFO:tasks.workunit.client.0.smithi097.stderr: -434> 2024-09-14T11:06:16.628+0000 7f1364d1f800 10 monclient: _renew_subs 2024-09-14T11:06:17.379 INFO:tasks.workunit.client.0.smithi097.stderr: -433> 2024-09-14T11:06:16.628+0000 7f1364d1f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:06:17.379 INFO:tasks.workunit.client.0.smithi097.stderr: -432> 2024-09-14T11:06:16.628+0000 7f1364d1f800 1 librados: init done 2024-09-14T11:06:17.379 INFO:tasks.workunit.client.0.smithi097.stderr: -431> 2024-09-14T11:06:16.630+0000 7f124d60a640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:06:17.379 INFO:tasks.workunit.client.0.smithi097.stderr: -430> 2024-09-14T11:06:16.630+0000 7f124d60a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:06:17.379 INFO:tasks.workunit.client.0.smithi097.stderr: -429> 2024-09-14T11:06:16.630+0000 7f124d60a640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:06:17.379 INFO:tasks.workunit.client.0.smithi097.stderr: -428> 2024-09-14T11:06:16.631+0000 7f13582a1640 10 monclient: get_auth_request con 0x7f1248077230 auth_method 0 2024-09-14T11:06:17.379 INFO:tasks.workunit.client.0.smithi097.stderr: -427> 2024-09-14T11:06:16.631+0000 7f13612a3640 10 monclient: get_auth_request con 0x559f0029b560 auth_method 0 2024-09-14T11:06:17.379 INFO:tasks.workunit.client.0.smithi097.stderr: -426> 2024-09-14T11:06:16.632+0000 7f1360aa2640 10 monclient: get_auth_request con 0x559f0029e3a0 auth_method 0 2024-09-14T11:06:17.379 INFO:tasks.workunit.client.0.smithi097.stderr: -425> 2024-09-14T11:06:16.632+0000 7f13582a1640 10 monclient: get_auth_request con 0x559f002a27c0 auth_method 0 2024-09-14T11:06:17.379 INFO:tasks.workunit.client.0.smithi097.stderr: -424> 2024-09-14T11:06:16.633+0000 7f13612a3640 10 monclient: get_auth_request con 0x559f002a1c90 auth_method 0 2024-09-14T11:06:17.380 INFO:tasks.workunit.client.0.smithi097.stderr: -423> 2024-09-14T11:06:16.634+0000 7f1364d1f800 10 monclient: build_initial_monmap 2024-09-14T11:06:17.380 INFO:tasks.workunit.client.0.smithi097.stderr: -422> 2024-09-14T11:06:16.634+0000 7f1364d1f800 1 build_initial for_mkfs: 0 2024-09-14T11:06:17.380 INFO:tasks.workunit.client.0.smithi097.stderr: -421> 2024-09-14T11:06:16.634+0000 7f1364d1f800 10 monclient: monmap: 2024-09-14T11:06:17.380 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:06:17.380 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:06:17.380 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:06:17.380 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:06:17.380 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:06:17.380 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:06:17.380 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:06:17.380 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:06:17.380 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:06:17.381 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:17.381 INFO:tasks.workunit.client.0.smithi097.stderr: -420> 2024-09-14T11:06:16.634+0000 7f1364d1f800 5 AuthRegistry(0x559f002aaa20) adding auth protocol: cephx 2024-09-14T11:06:17.381 INFO:tasks.workunit.client.0.smithi097.stderr: -419> 2024-09-14T11:06:16.634+0000 7f1364d1f800 5 AuthRegistry(0x559f002aaa20) adding auth protocol: cephx 2024-09-14T11:06:17.381 INFO:tasks.workunit.client.0.smithi097.stderr: -418> 2024-09-14T11:06:16.634+0000 7f1364d1f800 5 AuthRegistry(0x559f002aaa20) adding auth protocol: cephx 2024-09-14T11:06:17.381 INFO:tasks.workunit.client.0.smithi097.stderr: -417> 2024-09-14T11:06:16.634+0000 7f1364d1f800 5 AuthRegistry(0x559f002aaa20) adding con mode: secure 2024-09-14T11:06:17.381 INFO:tasks.workunit.client.0.smithi097.stderr: -416> 2024-09-14T11:06:16.634+0000 7f1364d1f800 5 AuthRegistry(0x559f002aaa20) adding con mode: crc 2024-09-14T11:06:17.381 INFO:tasks.workunit.client.0.smithi097.stderr: -415> 2024-09-14T11:06:16.634+0000 7f1364d1f800 5 AuthRegistry(0x559f002aaa20) adding con mode: secure 2024-09-14T11:06:17.381 INFO:tasks.workunit.client.0.smithi097.stderr: -414> 2024-09-14T11:06:16.634+0000 7f1364d1f800 5 AuthRegistry(0x559f002aaa20) adding con mode: crc 2024-09-14T11:06:17.381 INFO:tasks.workunit.client.0.smithi097.stderr: -413> 2024-09-14T11:06:16.634+0000 7f1364d1f800 5 AuthRegistry(0x559f002aaa20) adding con mode: secure 2024-09-14T11:06:17.381 INFO:tasks.workunit.client.0.smithi097.stderr: -412> 2024-09-14T11:06:16.634+0000 7f1364d1f800 5 AuthRegistry(0x559f002aaa20) adding con mode: crc 2024-09-14T11:06:17.381 INFO:tasks.workunit.client.0.smithi097.stderr: -411> 2024-09-14T11:06:16.634+0000 7f1364d1f800 5 AuthRegistry(0x559f002aaa20) adding con mode: crc 2024-09-14T11:06:17.381 INFO:tasks.workunit.client.0.smithi097.stderr: -410> 2024-09-14T11:06:16.634+0000 7f1364d1f800 5 AuthRegistry(0x559f002aaa20) adding con mode: secure 2024-09-14T11:06:17.382 INFO:tasks.workunit.client.0.smithi097.stderr: -409> 2024-09-14T11:06:16.634+0000 7f1364d1f800 5 AuthRegistry(0x559f002aaa20) adding con mode: crc 2024-09-14T11:06:17.382 INFO:tasks.workunit.client.0.smithi097.stderr: -408> 2024-09-14T11:06:16.634+0000 7f1364d1f800 5 AuthRegistry(0x559f002aaa20) adding con mode: secure 2024-09-14T11:06:17.382 INFO:tasks.workunit.client.0.smithi097.stderr: -407> 2024-09-14T11:06:16.634+0000 7f1364d1f800 5 AuthRegistry(0x559f002aaa20) adding con mode: crc 2024-09-14T11:06:17.382 INFO:tasks.workunit.client.0.smithi097.stderr: -406> 2024-09-14T11:06:16.634+0000 7f1364d1f800 5 AuthRegistry(0x559f002aaa20) adding con mode: secure 2024-09-14T11:06:17.382 INFO:tasks.workunit.client.0.smithi097.stderr: -405> 2024-09-14T11:06:16.634+0000 7f1364d1f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:06:17.382 INFO:tasks.workunit.client.0.smithi097.stderr: -404> 2024-09-14T11:06:16.635+0000 7f1364d1f800 5 asok(0x559f00032270) register_command objecter_requests cmddesc objecter_requests hook 0x559f002ade20 EEXIST 2024-09-14T11:06:17.382 INFO:tasks.workunit.client.0.smithi097.stderr: -403> 2024-09-14T11:06:16.635+0000 7f1364d1f800 10 monclient: init 2024-09-14T11:06:17.382 INFO:tasks.workunit.client.0.smithi097.stderr: -402> 2024-09-14T11:06:16.635+0000 7f1364d1f800 5 AuthRegistry(0x559f002a9878) adding auth protocol: cephx 2024-09-14T11:06:17.382 INFO:tasks.workunit.client.0.smithi097.stderr: -401> 2024-09-14T11:06:16.635+0000 7f1364d1f800 5 AuthRegistry(0x559f002a9878) adding auth protocol: cephx 2024-09-14T11:06:17.382 INFO:tasks.workunit.client.0.smithi097.stderr: -400> 2024-09-14T11:06:16.635+0000 7f1364d1f800 5 AuthRegistry(0x559f002a9878) adding auth protocol: cephx 2024-09-14T11:06:17.382 INFO:tasks.workunit.client.0.smithi097.stderr: -399> 2024-09-14T11:06:16.635+0000 7f1364d1f800 5 AuthRegistry(0x559f002a9878) adding con mode: secure 2024-09-14T11:06:17.382 INFO:tasks.workunit.client.0.smithi097.stderr: -398> 2024-09-14T11:06:16.635+0000 7f1364d1f800 5 AuthRegistry(0x559f002a9878) adding con mode: crc 2024-09-14T11:06:17.383 INFO:tasks.workunit.client.0.smithi097.stderr: -397> 2024-09-14T11:06:16.635+0000 7f1364d1f800 5 AuthRegistry(0x559f002a9878) adding con mode: secure 2024-09-14T11:06:17.383 INFO:tasks.workunit.client.0.smithi097.stderr: -396> 2024-09-14T11:06:16.635+0000 7f1364d1f800 5 AuthRegistry(0x559f002a9878) adding con mode: crc 2024-09-14T11:06:17.383 INFO:tasks.workunit.client.0.smithi097.stderr: -395> 2024-09-14T11:06:16.635+0000 7f1364d1f800 5 AuthRegistry(0x559f002a9878) adding con mode: secure 2024-09-14T11:06:17.383 INFO:tasks.workunit.client.0.smithi097.stderr: -394> 2024-09-14T11:06:16.635+0000 7f1364d1f800 5 AuthRegistry(0x559f002a9878) adding con mode: crc 2024-09-14T11:06:17.383 INFO:tasks.workunit.client.0.smithi097.stderr: -393> 2024-09-14T11:06:16.635+0000 7f1364d1f800 5 AuthRegistry(0x559f002a9878) adding con mode: crc 2024-09-14T11:06:17.383 INFO:tasks.workunit.client.0.smithi097.stderr: -392> 2024-09-14T11:06:16.635+0000 7f1364d1f800 5 AuthRegistry(0x559f002a9878) adding con mode: secure 2024-09-14T11:06:17.383 INFO:tasks.workunit.client.0.smithi097.stderr: -391> 2024-09-14T11:06:16.635+0000 7f1364d1f800 5 AuthRegistry(0x559f002a9878) adding con mode: crc 2024-09-14T11:06:17.383 INFO:tasks.workunit.client.0.smithi097.stderr: -390> 2024-09-14T11:06:16.635+0000 7f1364d1f800 5 AuthRegistry(0x559f002a9878) adding con mode: secure 2024-09-14T11:06:17.383 INFO:tasks.workunit.client.0.smithi097.stderr: -389> 2024-09-14T11:06:16.635+0000 7f1364d1f800 5 AuthRegistry(0x559f002a9878) adding con mode: crc 2024-09-14T11:06:17.383 INFO:tasks.workunit.client.0.smithi097.stderr: -388> 2024-09-14T11:06:16.635+0000 7f1364d1f800 5 AuthRegistry(0x559f002a9878) adding con mode: secure 2024-09-14T11:06:17.383 INFO:tasks.workunit.client.0.smithi097.stderr: -387> 2024-09-14T11:06:16.635+0000 7f1364d1f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:06:17.383 INFO:tasks.workunit.client.0.smithi097.stderr: -386> 2024-09-14T11:06:16.635+0000 7f1364d1f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:06:17.384 INFO:tasks.workunit.client.0.smithi097.stderr: -385> 2024-09-14T11:06:16.635+0000 7f1364d1f800 5 asok(0x559f00032270) register_command rotate-key cmddesc rotate-key hook 0x559f002a99c0 EEXIST 2024-09-14T11:06:17.384 INFO:tasks.workunit.client.0.smithi097.stderr: -384> 2024-09-14T11:06:16.635+0000 7f1364d1f800 10 monclient: _reopen_session rank -1 2024-09-14T11:06:17.384 INFO:tasks.workunit.client.0.smithi097.stderr: -383> 2024-09-14T11:06:16.635+0000 7f1364d1f800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:06:17.384 INFO:tasks.workunit.client.0.smithi097.stderr: -382> 2024-09-14T11:06:16.635+0000 7f1364d1f800 10 monclient(hunting): picked mon.noname-c con 0x559f002d2140 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:06:17.384 INFO:tasks.workunit.client.0.smithi097.stderr: -381> 2024-09-14T11:06:16.635+0000 7f1364d1f800 10 monclient(hunting): picked mon.noname-a con 0x559f002d2520 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:06:17.384 INFO:tasks.workunit.client.0.smithi097.stderr: -380> 2024-09-14T11:06:16.635+0000 7f1364d1f800 10 monclient(hunting): picked mon.noname-b con 0x559f002d0e50 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:06:17.384 INFO:tasks.workunit.client.0.smithi097.stderr: -379> 2024-09-14T11:06:16.635+0000 7f1364d1f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:17.384 INFO:tasks.workunit.client.0.smithi097.stderr: -378> 2024-09-14T11:06:16.635+0000 7f1364d1f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:17.384 INFO:tasks.workunit.client.0.smithi097.stderr: -377> 2024-09-14T11:06:16.635+0000 7f1364d1f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:17.384 INFO:tasks.workunit.client.0.smithi097.stderr: -376> 2024-09-14T11:06:16.635+0000 7f1364d1f800 10 monclient(hunting): _renew_subs 2024-09-14T11:06:17.384 INFO:tasks.workunit.client.0.smithi097.stderr: -375> 2024-09-14T11:06:16.635+0000 7f1364d1f800 10 monclient(hunting): authenticate will time out at 2058.288625s 2024-09-14T11:06:17.385 INFO:tasks.workunit.client.0.smithi097.stderr: -374> 2024-09-14T11:06:16.635+0000 7f13582a1640 10 monclient(hunting): get_auth_request con 0x559f002d2140 auth_method 0 2024-09-14T11:06:17.385 INFO:tasks.workunit.client.0.smithi097.stderr: -373> 2024-09-14T11:06:16.635+0000 7f13582a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:06:17.385 INFO:tasks.workunit.client.0.smithi097.stderr: -372> 2024-09-14T11:06:16.635+0000 7f13582a1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:06:17.385 INFO:tasks.workunit.client.0.smithi097.stderr: -371> 2024-09-14T11:06:16.635+0000 7f13582a1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:06:17.385 INFO:tasks.workunit.client.0.smithi097.stderr: -370> 2024-09-14T11:06:16.635+0000 7f13612a3640 10 monclient(hunting): get_auth_request con 0x559f002d2520 auth_method 0 2024-09-14T11:06:17.385 INFO:tasks.workunit.client.0.smithi097.stderr: -369> 2024-09-14T11:06:16.635+0000 7f13612a3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:06:17.385 INFO:tasks.workunit.client.0.smithi097.stderr: -368> 2024-09-14T11:06:16.635+0000 7f13612a3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:06:17.385 INFO:tasks.workunit.client.0.smithi097.stderr: -367> 2024-09-14T11:06:16.635+0000 7f13612a3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:06:17.385 INFO:tasks.workunit.client.0.smithi097.stderr: -366> 2024-09-14T11:06:16.635+0000 7f1360aa2640 10 monclient(hunting): get_auth_request con 0x559f002d0e50 auth_method 0 2024-09-14T11:06:17.385 INFO:tasks.workunit.client.0.smithi097.stderr: -365> 2024-09-14T11:06:16.635+0000 7f1360aa2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:06:17.385 INFO:tasks.workunit.client.0.smithi097.stderr: -364> 2024-09-14T11:06:16.635+0000 7f1360aa2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:06:17.385 INFO:tasks.workunit.client.0.smithi097.stderr: -363> 2024-09-14T11:06:16.635+0000 7f1360aa2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:06:17.386 INFO:tasks.workunit.client.0.smithi097.stderr: -362> 2024-09-14T11:06:16.635+0000 7f13582a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:06:17.386 INFO:tasks.workunit.client.0.smithi097.stderr: -361> 2024-09-14T11:06:16.635+0000 7f13582a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:06:17.386 INFO:tasks.workunit.client.0.smithi097.stderr: -360> 2024-09-14T11:06:16.635+0000 7f13582a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:06:17.386 INFO:tasks.workunit.client.0.smithi097.stderr: -359> 2024-09-14T11:06:16.635+0000 7f13612a3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:06:17.386 INFO:tasks.workunit.client.0.smithi097.stderr: -358> 2024-09-14T11:06:16.635+0000 7f13612a3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:06:17.386 INFO:tasks.workunit.client.0.smithi097.stderr: -357> 2024-09-14T11:06:16.635+0000 7f13612a3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:06:17.386 INFO:tasks.workunit.client.0.smithi097.stderr: -356> 2024-09-14T11:06:16.635+0000 7f1360aa2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:06:17.387 INFO:tasks.workunit.client.0.smithi097.stderr: -355> 2024-09-14T11:06:16.635+0000 7f1360aa2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:06:17.387 INFO:tasks.workunit.client.0.smithi097.stderr: -354> 2024-09-14T11:06:16.635+0000 7f1360aa2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:06:17.387 INFO:tasks.workunit.client.0.smithi097.stderr: -353> 2024-09-14T11:06:16.635+0000 7f13612a3640 10 monclient(hunting): handle_auth_done global_id 7758 payload 824 2024-09-14T11:06:17.387 INFO:tasks.workunit.client.0.smithi097.stderr: -352> 2024-09-14T11:06:16.635+0000 7f13612a3640 10 monclient: _finish_hunting 0 2024-09-14T11:06:17.387 INFO:tasks.workunit.client.0.smithi097.stderr: -351> 2024-09-14T11:06:16.635+0000 7f13612a3640 1 monclient: found mon.noname-a 2024-09-14T11:06:17.387 INFO:tasks.workunit.client.0.smithi097.stderr: -350> 2024-09-14T11:06:16.635+0000 7f13612a3640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-14T11:06:17.387 INFO:tasks.workunit.client.0.smithi097.stderr: -349> 2024-09-14T11:06:16.636+0000 7f12467fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:06:17.387 INFO:tasks.workunit.client.0.smithi097.stderr: -348> 2024-09-14T11:06:16.636+0000 7f12467fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:06:17.387 INFO:tasks.workunit.client.0.smithi097.stderr: -347> 2024-09-14T11:06:16.636+0000 7f12467fc640 10 monclient: dump: 2024-09-14T11:06:17.387 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:06:17.387 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:06:17.388 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:17.388 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:17.388 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:06:17.388 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:06:17.388 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:06:17.388 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:06:17.388 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:06:17.388 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:17.388 INFO:tasks.workunit.client.0.smithi097.stderr: -346> 2024-09-14T11:06:16.636+0000 7f12467fc640 10 monclient: _finish_auth 0 2024-09-14T11:06:17.388 INFO:tasks.workunit.client.0.smithi097.stderr: -345> 2024-09-14T11:06:16.636+0000 7f12467fc640 10 monclient: _check_auth_tickets 2024-09-14T11:06:17.388 INFO:tasks.workunit.client.0.smithi097.stderr: -344> 2024-09-14T11:06:16.636+0000 7f12467fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:06:17.389 INFO:tasks.workunit.client.0.smithi097.stderr: -343> 2024-09-14T11:06:16.636+0000 7f12467fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:06:17.389 INFO:tasks.workunit.client.0.smithi097.stderr: -342> 2024-09-14T11:06:16.636+0000 7f12467fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:06:17.389 INFO:tasks.workunit.client.0.smithi097.stderr: -341> 2024-09-14T11:06:16.636+0000 7f12467fc640 10 monclient: dump: 2024-09-14T11:06:17.389 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:06:17.389 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:06:17.389 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:17.389 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:17.389 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:06:17.389 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:06:17.389 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:06:17.389 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:06:17.389 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:06:17.390 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:17.390 INFO:tasks.workunit.client.0.smithi097.stderr: -340> 2024-09-14T11:06:16.636+0000 7f1364d1f800 5 monclient: authenticate success, global_id 7758 2024-09-14T11:06:17.390 INFO:tasks.workunit.client.0.smithi097.stderr: -339> 2024-09-14T11:06:16.636+0000 7f1364d1f800 10 monclient: _renew_subs 2024-09-14T11:06:17.390 INFO:tasks.workunit.client.0.smithi097.stderr: -338> 2024-09-14T11:06:16.636+0000 7f1364d1f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:06:17.390 INFO:tasks.workunit.client.0.smithi097.stderr: -337> 2024-09-14T11:06:16.636+0000 7f1361aa4640 4 set_mon_vals no callback set 2024-09-14T11:06:17.390 INFO:tasks.workunit.client.0.smithi097.stderr: -336> 2024-09-14T11:06:16.636+0000 7f1364d1f800 10 monclient: _renew_subs 2024-09-14T11:06:17.390 INFO:tasks.workunit.client.0.smithi097.stderr: -335> 2024-09-14T11:06:16.636+0000 7f1364d1f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:06:17.390 INFO:tasks.workunit.client.0.smithi097.stderr: -334> 2024-09-14T11:06:16.638+0000 7f12467fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:06:17.390 INFO:tasks.workunit.client.0.smithi097.stderr: -333> 2024-09-14T11:06:16.638+0000 7f12467fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:06:17.390 INFO:tasks.workunit.client.0.smithi097.stderr: -332> 2024-09-14T11:06:16.638+0000 7f12467fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:06:17.390 INFO:tasks.workunit.client.0.smithi097.stderr: -331> 2024-09-14T11:06:16.638+0000 7f13582a1640 10 monclient: get_auth_request con 0x7f1238077140 auth_method 0 2024-09-14T11:06:17.390 INFO:tasks.workunit.client.0.smithi097.stderr: -330> 2024-09-14T11:06:16.638+0000 7f1364d1f800 10 monclient: get_monmap_and_config 2024-09-14T11:06:17.391 INFO:tasks.workunit.client.0.smithi097.stderr: -329> 2024-09-14T11:06:16.638+0000 7f1364d1f800 10 monclient: build_initial_monmap 2024-09-14T11:06:17.391 INFO:tasks.workunit.client.0.smithi097.stderr: -328> 2024-09-14T11:06:16.638+0000 7f1364d1f800 1 build_initial for_mkfs: 0 2024-09-14T11:06:17.391 INFO:tasks.workunit.client.0.smithi097.stderr: -327> 2024-09-14T11:06:16.638+0000 7f1364d1f800 10 monclient: monmap: 2024-09-14T11:06:17.391 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:06:17.391 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:06:17.391 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:06:17.391 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:06:17.391 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:06:17.391 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:06:17.391 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:06:17.391 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:06:17.392 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:06:17.392 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:17.392 INFO:tasks.workunit.client.0.smithi097.stderr: -326> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x559f002f2030) adding auth protocol: cephx 2024-09-14T11:06:17.392 INFO:tasks.workunit.client.0.smithi097.stderr: -325> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x559f002f2030) adding auth protocol: cephx 2024-09-14T11:06:17.392 INFO:tasks.workunit.client.0.smithi097.stderr: -324> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x559f002f2030) adding auth protocol: cephx 2024-09-14T11:06:17.392 INFO:tasks.workunit.client.0.smithi097.stderr: -323> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x559f002f2030) adding con mode: secure 2024-09-14T11:06:17.392 INFO:tasks.workunit.client.0.smithi097.stderr: -322> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x559f002f2030) adding con mode: crc 2024-09-14T11:06:17.392 INFO:tasks.workunit.client.0.smithi097.stderr: -321> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x559f002f2030) adding con mode: secure 2024-09-14T11:06:17.392 INFO:tasks.workunit.client.0.smithi097.stderr: -320> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x559f002f2030) adding con mode: crc 2024-09-14T11:06:17.392 INFO:tasks.workunit.client.0.smithi097.stderr: -319> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x559f002f2030) adding con mode: secure 2024-09-14T11:06:17.392 INFO:tasks.workunit.client.0.smithi097.stderr: -318> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x559f002f2030) adding con mode: crc 2024-09-14T11:06:17.393 INFO:tasks.workunit.client.0.smithi097.stderr: -317> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x559f002f2030) adding con mode: crc 2024-09-14T11:06:17.393 INFO:tasks.workunit.client.0.smithi097.stderr: -316> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x559f002f2030) adding con mode: secure 2024-09-14T11:06:17.393 INFO:tasks.workunit.client.0.smithi097.stderr: -315> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x559f002f2030) adding con mode: crc 2024-09-14T11:06:17.393 INFO:tasks.workunit.client.0.smithi097.stderr: -314> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x559f002f2030) adding con mode: secure 2024-09-14T11:06:17.393 INFO:tasks.workunit.client.0.smithi097.stderr: -313> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x559f002f2030) adding con mode: crc 2024-09-14T11:06:17.393 INFO:tasks.workunit.client.0.smithi097.stderr: -312> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x559f002f2030) adding con mode: secure 2024-09-14T11:06:17.393 INFO:tasks.workunit.client.0.smithi097.stderr: -311> 2024-09-14T11:06:16.638+0000 7f1364d1f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:06:17.393 INFO:tasks.workunit.client.0.smithi097.stderr: -310> 2024-09-14T11:06:16.638+0000 7f1364d1f800 10 monclient: init 2024-09-14T11:06:17.393 INFO:tasks.workunit.client.0.smithi097.stderr: -309> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9580) adding auth protocol: cephx 2024-09-14T11:06:17.393 INFO:tasks.workunit.client.0.smithi097.stderr: -308> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9580) adding auth protocol: cephx 2024-09-14T11:06:17.393 INFO:tasks.workunit.client.0.smithi097.stderr: -307> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9580) adding auth protocol: cephx 2024-09-14T11:06:17.393 INFO:tasks.workunit.client.0.smithi097.stderr: -306> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9580) adding con mode: secure 2024-09-14T11:06:17.394 INFO:tasks.workunit.client.0.smithi097.stderr: -305> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9580) adding con mode: crc 2024-09-14T11:06:17.394 INFO:tasks.workunit.client.0.smithi097.stderr: -304> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9580) adding con mode: secure 2024-09-14T11:06:17.394 INFO:tasks.workunit.client.0.smithi097.stderr: -303> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9580) adding con mode: crc 2024-09-14T11:06:17.394 INFO:tasks.workunit.client.0.smithi097.stderr: -302> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9580) adding con mode: secure 2024-09-14T11:06:17.394 INFO:tasks.workunit.client.0.smithi097.stderr: -301> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9580) adding con mode: crc 2024-09-14T11:06:17.394 INFO:tasks.workunit.client.0.smithi097.stderr: -300> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9580) adding con mode: crc 2024-09-14T11:06:17.394 INFO:tasks.workunit.client.0.smithi097.stderr: -299> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9580) adding con mode: secure 2024-09-14T11:06:17.395 INFO:tasks.workunit.client.0.smithi097.stderr: -298> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9580) adding con mode: crc 2024-09-14T11:06:17.395 INFO:tasks.workunit.client.0.smithi097.stderr: -297> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9580) adding con mode: secure 2024-09-14T11:06:17.395 INFO:tasks.workunit.client.0.smithi097.stderr: -296> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9580) adding con mode: crc 2024-09-14T11:06:17.395 INFO:tasks.workunit.client.0.smithi097.stderr: -295> 2024-09-14T11:06:16.638+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9580) adding con mode: secure 2024-09-14T11:06:17.395 INFO:tasks.workunit.client.0.smithi097.stderr: -294> 2024-09-14T11:06:16.639+0000 7f1364d1f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:06:17.395 INFO:tasks.workunit.client.0.smithi097.stderr: -293> 2024-09-14T11:06:16.639+0000 7f1364d1f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:06:17.395 INFO:tasks.workunit.client.0.smithi097.stderr: -292> 2024-09-14T11:06:16.639+0000 7f1364d1f800 5 asok(0x559f00032270) register_command rotate-key cmddesc rotate-key hook 0x7ffcfd6a96c8 EEXIST 2024-09-14T11:06:17.395 INFO:tasks.workunit.client.0.smithi097.stderr: -291> 2024-09-14T11:06:16.639+0000 7f1364d1f800 10 monclient: _reopen_session rank -1 2024-09-14T11:06:17.395 INFO:tasks.workunit.client.0.smithi097.stderr: -290> 2024-09-14T11:06:16.639+0000 7f1364d1f800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:06:17.395 INFO:tasks.workunit.client.0.smithi097.stderr: -289> 2024-09-14T11:06:16.639+0000 7f1364d1f800 10 monclient(hunting): picked mon.noname-b con 0x559f002f61c0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:06:17.395 INFO:tasks.workunit.client.0.smithi097.stderr: -288> 2024-09-14T11:06:16.639+0000 7f1364d1f800 10 monclient(hunting): picked mon.noname-a con 0x559f00320c30 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:06:17.395 INFO:tasks.workunit.client.0.smithi097.stderr: -287> 2024-09-14T11:06:16.639+0000 7f1364d1f800 10 monclient(hunting): picked mon.noname-c con 0x559f00321fe0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:06:17.396 INFO:tasks.workunit.client.0.smithi097.stderr: -286> 2024-09-14T11:06:16.639+0000 7f1364d1f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:17.396 INFO:tasks.workunit.client.0.smithi097.stderr: -285> 2024-09-14T11:06:16.639+0000 7f1364d1f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:17.396 INFO:tasks.workunit.client.0.smithi097.stderr: -284> 2024-09-14T11:06:16.639+0000 7f1364d1f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:17.396 INFO:tasks.workunit.client.0.smithi097.stderr: -283> 2024-09-14T11:06:16.639+0000 7f1364d1f800 10 monclient(hunting): _renew_subs 2024-09-14T11:06:17.396 INFO:tasks.workunit.client.0.smithi097.stderr: -282> 2024-09-14T11:06:16.639+0000 7f1364d1f800 10 monclient(hunting): authenticate will time out at 2058.292360s 2024-09-14T11:06:17.396 INFO:tasks.workunit.client.0.smithi097.stderr: -281> 2024-09-14T11:06:16.639+0000 7f13612a3640 10 monclient(hunting): get_auth_request con 0x559f00320c30 auth_method 0 2024-09-14T11:06:17.396 INFO:tasks.workunit.client.0.smithi097.stderr: -280> 2024-09-14T11:06:16.639+0000 7f13612a3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:06:17.396 INFO:tasks.workunit.client.0.smithi097.stderr: -279> 2024-09-14T11:06:16.639+0000 7f13612a3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:06:17.396 INFO:tasks.workunit.client.0.smithi097.stderr: -278> 2024-09-14T11:06:16.639+0000 7f13612a3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:06:17.396 INFO:tasks.workunit.client.0.smithi097.stderr: -277> 2024-09-14T11:06:16.639+0000 7f1360aa2640 10 monclient(hunting): get_auth_request con 0x559f00321fe0 auth_method 0 2024-09-14T11:06:17.396 INFO:tasks.workunit.client.0.smithi097.stderr: -276> 2024-09-14T11:06:16.639+0000 7f1360aa2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:06:17.396 INFO:tasks.workunit.client.0.smithi097.stderr: -275> 2024-09-14T11:06:16.639+0000 7f1360aa2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:06:17.397 INFO:tasks.workunit.client.0.smithi097.stderr: -274> 2024-09-14T11:06:16.639+0000 7f1360aa2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:06:17.397 INFO:tasks.workunit.client.0.smithi097.stderr: -273> 2024-09-14T11:06:16.639+0000 7f13612a3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:06:17.397 INFO:tasks.workunit.client.0.smithi097.stderr: -272> 2024-09-14T11:06:16.639+0000 7f13612a3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:06:17.397 INFO:tasks.workunit.client.0.smithi097.stderr: -271> 2024-09-14T11:06:16.639+0000 7f13612a3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:06:17.397 INFO:tasks.workunit.client.0.smithi097.stderr: -270> 2024-09-14T11:06:16.639+0000 7f1360aa2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:06:17.397 INFO:tasks.workunit.client.0.smithi097.stderr: -269> 2024-09-14T11:06:16.639+0000 7f1360aa2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:06:17.397 INFO:tasks.workunit.client.0.smithi097.stderr: -268> 2024-09-14T11:06:16.639+0000 7f1360aa2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:06:17.397 INFO:tasks.workunit.client.0.smithi097.stderr: -267> 2024-09-14T11:06:16.639+0000 7f13612a3640 10 monclient(hunting): handle_auth_done global_id 7761 payload 274 2024-09-14T11:06:17.397 INFO:tasks.workunit.client.0.smithi097.stderr: -266> 2024-09-14T11:06:16.639+0000 7f13612a3640 10 monclient: _finish_hunting 0 2024-09-14T11:06:17.397 INFO:tasks.workunit.client.0.smithi097.stderr: -265> 2024-09-14T11:06:16.639+0000 7f13612a3640 1 monclient: found mon.noname-a 2024-09-14T11:06:17.397 INFO:tasks.workunit.client.0.smithi097.stderr: -264> 2024-09-14T11:06:16.639+0000 7f13612a3640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-14T11:06:17.398 INFO:tasks.workunit.client.0.smithi097.stderr: -263> 2024-09-14T11:06:16.639+0000 7f1237fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:06:17.398 INFO:tasks.workunit.client.0.smithi097.stderr: -262> 2024-09-14T11:06:16.639+0000 7f1237fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:06:17.398 INFO:tasks.workunit.client.0.smithi097.stderr: -261> 2024-09-14T11:06:16.639+0000 7f1237fff640 10 monclient: dump: 2024-09-14T11:06:17.398 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:06:17.398 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:06:17.398 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:17.398 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:17.398 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:06:17.398 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:06:17.398 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:06:17.398 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:06:17.398 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:06:17.399 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:17.399 INFO:tasks.workunit.client.0.smithi097.stderr: -260> 2024-09-14T11:06:16.639+0000 7f1237fff640 10 monclient: _finish_auth 0 2024-09-14T11:06:17.399 INFO:tasks.workunit.client.0.smithi097.stderr: -259> 2024-09-14T11:06:16.639+0000 7f1237fff640 10 monclient: _check_auth_tickets 2024-09-14T11:06:17.399 INFO:tasks.workunit.client.0.smithi097.stderr: -258> 2024-09-14T11:06:16.639+0000 7f1237fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:06:17.399 INFO:tasks.workunit.client.0.smithi097.stderr: -257> 2024-09-14T11:06:16.639+0000 7f1237fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:06:17.399 INFO:tasks.workunit.client.0.smithi097.stderr: -256> 2024-09-14T11:06:16.639+0000 7f1237fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:06:17.399 INFO:tasks.workunit.client.0.smithi097.stderr: -255> 2024-09-14T11:06:16.639+0000 7f1237fff640 10 monclient: dump: 2024-09-14T11:06:17.399 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:06:17.399 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:06:17.399 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:17.399 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:17.400 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:06:17.400 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:06:17.400 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:06:17.400 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:06:17.400 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:06:17.400 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:17.400 INFO:tasks.workunit.client.0.smithi097.stderr: -254> 2024-09-14T11:06:16.639+0000 7f1364d1f800 5 monclient: authenticate success, global_id 7761 2024-09-14T11:06:17.400 INFO:tasks.workunit.client.0.smithi097.stderr: -253> 2024-09-14T11:06:16.639+0000 7f1364d1f800 10 monclient: get_monmap_and_config success 2024-09-14T11:06:17.400 INFO:tasks.workunit.client.0.smithi097.stderr: -252> 2024-09-14T11:06:16.639+0000 7f1364d1f800 4 set_mon_vals no callback set 2024-09-14T11:06:17.400 INFO:tasks.workunit.client.0.smithi097.stderr: -251> 2024-09-14T11:06:16.640+0000 7f1364d1f800 10 monclient: shutdown 2024-09-14T11:06:17.400 INFO:tasks.workunit.client.0.smithi097.stderr: -250> 2024-09-14T11:06:16.640+0000 7f1364d1f800 10 monclient: build_initial_monmap 2024-09-14T11:06:17.400 INFO:tasks.workunit.client.0.smithi097.stderr: -249> 2024-09-14T11:06:16.640+0000 7f1364d1f800 1 build_initial for_mkfs: 0 2024-09-14T11:06:17.401 INFO:tasks.workunit.client.0.smithi097.stderr: -248> 2024-09-14T11:06:16.640+0000 7f1364d1f800 10 monclient: monmap: 2024-09-14T11:06:17.401 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:06:17.401 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:06:17.401 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:06:17.401 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:06:17.401 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:06:17.401 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:06:17.401 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:06:17.401 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:06:17.401 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:06:17.401 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:17.401 INFO:tasks.workunit.client.0.smithi097.stderr: -247> 2024-09-14T11:06:16.640+0000 7f1364d1f800 5 AuthRegistry(0x559f00316de0) adding auth protocol: cephx 2024-09-14T11:06:17.402 INFO:tasks.workunit.client.0.smithi097.stderr: -246> 2024-09-14T11:06:16.640+0000 7f1364d1f800 5 AuthRegistry(0x559f00316de0) adding auth protocol: cephx 2024-09-14T11:06:17.402 INFO:tasks.workunit.client.0.smithi097.stderr: -245> 2024-09-14T11:06:16.640+0000 7f1364d1f800 5 AuthRegistry(0x559f00316de0) adding auth protocol: cephx 2024-09-14T11:06:17.402 INFO:tasks.workunit.client.0.smithi097.stderr: -244> 2024-09-14T11:06:16.640+0000 7f1364d1f800 5 AuthRegistry(0x559f00316de0) adding con mode: secure 2024-09-14T11:06:17.402 INFO:tasks.workunit.client.0.smithi097.stderr: -243> 2024-09-14T11:06:16.640+0000 7f1364d1f800 5 AuthRegistry(0x559f00316de0) adding con mode: crc 2024-09-14T11:06:17.402 INFO:tasks.workunit.client.0.smithi097.stderr: -242> 2024-09-14T11:06:16.640+0000 7f1364d1f800 5 AuthRegistry(0x559f00316de0) adding con mode: secure 2024-09-14T11:06:17.402 INFO:tasks.workunit.client.0.smithi097.stderr: -241> 2024-09-14T11:06:16.640+0000 7f1364d1f800 5 AuthRegistry(0x559f00316de0) adding con mode: crc 2024-09-14T11:06:17.402 INFO:tasks.workunit.client.0.smithi097.stderr: -240> 2024-09-14T11:06:16.640+0000 7f1364d1f800 5 AuthRegistry(0x559f00316de0) adding con mode: secure 2024-09-14T11:06:17.402 INFO:tasks.workunit.client.0.smithi097.stderr: -239> 2024-09-14T11:06:16.640+0000 7f1364d1f800 5 AuthRegistry(0x559f00316de0) adding con mode: crc 2024-09-14T11:06:17.402 INFO:tasks.workunit.client.0.smithi097.stderr: -238> 2024-09-14T11:06:16.640+0000 7f1364d1f800 5 AuthRegistry(0x559f00316de0) adding con mode: crc 2024-09-14T11:06:17.402 INFO:tasks.workunit.client.0.smithi097.stderr: -237> 2024-09-14T11:06:16.640+0000 7f1364d1f800 5 AuthRegistry(0x559f00316de0) adding con mode: secure 2024-09-14T11:06:17.402 INFO:tasks.workunit.client.0.smithi097.stderr: -236> 2024-09-14T11:06:16.640+0000 7f1364d1f800 5 AuthRegistry(0x559f00316de0) adding con mode: crc 2024-09-14T11:06:17.403 INFO:tasks.workunit.client.0.smithi097.stderr: -235> 2024-09-14T11:06:16.640+0000 7f1364d1f800 5 AuthRegistry(0x559f00316de0) adding con mode: secure 2024-09-14T11:06:17.403 INFO:tasks.workunit.client.0.smithi097.stderr: -234> 2024-09-14T11:06:16.640+0000 7f1364d1f800 5 AuthRegistry(0x559f00316de0) adding con mode: crc 2024-09-14T11:06:17.403 INFO:tasks.workunit.client.0.smithi097.stderr: -233> 2024-09-14T11:06:16.640+0000 7f1364d1f800 5 AuthRegistry(0x559f00316de0) adding con mode: secure 2024-09-14T11:06:17.403 INFO:tasks.workunit.client.0.smithi097.stderr: -232> 2024-09-14T11:06:16.640+0000 7f1364d1f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:06:17.403 INFO:tasks.workunit.client.0.smithi097.stderr: -231> 2024-09-14T11:06:16.640+0000 7f1364d1f800 1 librados: starting msgr at 2024-09-14T11:06:17.403 INFO:tasks.workunit.client.0.smithi097.stderr: -230> 2024-09-14T11:06:16.640+0000 7f1364d1f800 1 librados: starting objecter 2024-09-14T11:06:17.403 INFO:tasks.workunit.client.0.smithi097.stderr: -229> 2024-09-14T11:06:16.640+0000 7f1364d1f800 5 asok(0x559f00032270) register_command objecter_requests cmddesc objecter_requests hook 0x559f00320a60 EEXIST 2024-09-14T11:06:17.403 INFO:tasks.workunit.client.0.smithi097.stderr: -228> 2024-09-14T11:06:16.640+0000 7f1364d1f800 1 librados: setting wanted keys 2024-09-14T11:06:17.403 INFO:tasks.workunit.client.0.smithi097.stderr: -227> 2024-09-14T11:06:16.641+0000 7f1364d1f800 1 librados: calling monclient init 2024-09-14T11:06:17.403 INFO:tasks.workunit.client.0.smithi097.stderr: -226> 2024-09-14T11:06:16.641+0000 7f1364d1f800 10 monclient: init 2024-09-14T11:06:17.403 INFO:tasks.workunit.client.0.smithi097.stderr: -225> 2024-09-14T11:06:16.641+0000 7f1364d1f800 5 AuthRegistry(0x559f002e6a00) adding auth protocol: cephx 2024-09-14T11:06:17.403 INFO:tasks.workunit.client.0.smithi097.stderr: -224> 2024-09-14T11:06:16.641+0000 7f1364d1f800 5 AuthRegistry(0x559f002e6a00) adding auth protocol: cephx 2024-09-14T11:06:17.404 INFO:tasks.workunit.client.0.smithi097.stderr: -223> 2024-09-14T11:06:16.641+0000 7f1364d1f800 5 AuthRegistry(0x559f002e6a00) adding auth protocol: cephx 2024-09-14T11:06:17.404 INFO:tasks.workunit.client.0.smithi097.stderr: -222> 2024-09-14T11:06:16.641+0000 7f1364d1f800 5 AuthRegistry(0x559f002e6a00) adding con mode: secure 2024-09-14T11:06:17.404 INFO:tasks.workunit.client.0.smithi097.stderr: -221> 2024-09-14T11:06:16.641+0000 7f1364d1f800 5 AuthRegistry(0x559f002e6a00) adding con mode: crc 2024-09-14T11:06:17.404 INFO:tasks.workunit.client.0.smithi097.stderr: -220> 2024-09-14T11:06:16.641+0000 7f1364d1f800 5 AuthRegistry(0x559f002e6a00) adding con mode: secure 2024-09-14T11:06:17.404 INFO:tasks.workunit.client.0.smithi097.stderr: -219> 2024-09-14T11:06:16.641+0000 7f1364d1f800 5 AuthRegistry(0x559f002e6a00) adding con mode: crc 2024-09-14T11:06:17.404 INFO:tasks.workunit.client.0.smithi097.stderr: -218> 2024-09-14T11:06:16.641+0000 7f1364d1f800 5 AuthRegistry(0x559f002e6a00) adding con mode: secure 2024-09-14T11:06:17.404 INFO:tasks.workunit.client.0.smithi097.stderr: -217> 2024-09-14T11:06:16.641+0000 7f1364d1f800 5 AuthRegistry(0x559f002e6a00) adding con mode: crc 2024-09-14T11:06:17.404 INFO:tasks.workunit.client.0.smithi097.stderr: -216> 2024-09-14T11:06:16.641+0000 7f1364d1f800 5 AuthRegistry(0x559f002e6a00) adding con mode: crc 2024-09-14T11:06:17.404 INFO:tasks.workunit.client.0.smithi097.stderr: -215> 2024-09-14T11:06:16.641+0000 7f1364d1f800 5 AuthRegistry(0x559f002e6a00) adding con mode: secure 2024-09-14T11:06:17.404 INFO:tasks.workunit.client.0.smithi097.stderr: -214> 2024-09-14T11:06:16.641+0000 7f1364d1f800 5 AuthRegistry(0x559f002e6a00) adding con mode: crc 2024-09-14T11:06:17.404 INFO:tasks.workunit.client.0.smithi097.stderr: -213> 2024-09-14T11:06:16.641+0000 7f1364d1f800 5 AuthRegistry(0x559f002e6a00) adding con mode: secure 2024-09-14T11:06:17.404 INFO:tasks.workunit.client.0.smithi097.stderr: -212> 2024-09-14T11:06:16.641+0000 7f1364d1f800 5 AuthRegistry(0x559f002e6a00) adding con mode: crc 2024-09-14T11:06:17.405 INFO:tasks.workunit.client.0.smithi097.stderr: -211> 2024-09-14T11:06:16.641+0000 7f1364d1f800 5 AuthRegistry(0x559f002e6a00) adding con mode: secure 2024-09-14T11:06:17.405 INFO:tasks.workunit.client.0.smithi097.stderr: -210> 2024-09-14T11:06:16.641+0000 7f1364d1f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:06:17.405 INFO:tasks.workunit.client.0.smithi097.stderr: -209> 2024-09-14T11:06:16.641+0000 7f1364d1f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:06:17.405 INFO:tasks.workunit.client.0.smithi097.stderr: -208> 2024-09-14T11:06:16.641+0000 7f1364d1f800 5 asok(0x559f00032270) register_command rotate-key cmddesc rotate-key hook 0x559f002e6b48 EEXIST 2024-09-14T11:06:17.405 INFO:tasks.workunit.client.0.smithi097.stderr: -207> 2024-09-14T11:06:16.641+0000 7f1364d1f800 10 monclient: _reopen_session rank -1 2024-09-14T11:06:17.405 INFO:tasks.workunit.client.0.smithi097.stderr: -206> 2024-09-14T11:06:16.641+0000 7f1364d1f800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:06:17.405 INFO:tasks.workunit.client.0.smithi097.stderr: -205> 2024-09-14T11:06:16.641+0000 7f1364d1f800 10 monclient(hunting): picked mon.noname-c con 0x559f002f61c0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:06:17.405 INFO:tasks.workunit.client.0.smithi097.stderr: -204> 2024-09-14T11:06:16.641+0000 7f1364d1f800 10 monclient(hunting): picked mon.noname-b con 0x559f00321fe0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:06:17.405 INFO:tasks.workunit.client.0.smithi097.stderr: -203> 2024-09-14T11:06:16.641+0000 7f1364d1f800 10 monclient(hunting): picked mon.noname-a con 0x559f002f38d0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:06:17.405 INFO:tasks.workunit.client.0.smithi097.stderr: -202> 2024-09-14T11:06:16.641+0000 7f1364d1f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:17.405 INFO:tasks.workunit.client.0.smithi097.stderr: -201> 2024-09-14T11:06:16.641+0000 7f1364d1f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:17.405 INFO:tasks.workunit.client.0.smithi097.stderr: -200> 2024-09-14T11:06:16.641+0000 7f1364d1f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:17.406 INFO:tasks.workunit.client.0.smithi097.stderr: -199> 2024-09-14T11:06:16.641+0000 7f1364d1f800 10 monclient(hunting): _renew_subs 2024-09-14T11:06:17.406 INFO:tasks.workunit.client.0.smithi097.stderr: -198> 2024-09-14T11:06:16.641+0000 7f1364d1f800 10 monclient(hunting): authenticate will time out at 2058.294514s 2024-09-14T11:06:17.406 INFO:tasks.workunit.client.0.smithi097.stderr: -197> 2024-09-14T11:06:16.641+0000 7f13582a1640 10 monclient(hunting): get_auth_request con 0x559f002f61c0 auth_method 0 2024-09-14T11:06:17.406 INFO:tasks.workunit.client.0.smithi097.stderr: -196> 2024-09-14T11:06:16.641+0000 7f13582a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:06:17.406 INFO:tasks.workunit.client.0.smithi097.stderr: -195> 2024-09-14T11:06:16.641+0000 7f13582a1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:06:17.406 INFO:tasks.workunit.client.0.smithi097.stderr: -194> 2024-09-14T11:06:16.641+0000 7f13582a1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:06:17.406 INFO:tasks.workunit.client.0.smithi097.stderr: -193> 2024-09-14T11:06:16.641+0000 7f1360aa2640 10 monclient(hunting): get_auth_request con 0x559f002f38d0 auth_method 0 2024-09-14T11:06:17.406 INFO:tasks.workunit.client.0.smithi097.stderr: -192> 2024-09-14T11:06:16.641+0000 7f1360aa2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:06:17.406 INFO:tasks.workunit.client.0.smithi097.stderr: -191> 2024-09-14T11:06:16.641+0000 7f1360aa2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:06:17.406 INFO:tasks.workunit.client.0.smithi097.stderr: -190> 2024-09-14T11:06:16.641+0000 7f1360aa2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:06:17.406 INFO:tasks.workunit.client.0.smithi097.stderr: -189> 2024-09-14T11:06:16.641+0000 7f1360aa2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:06:17.407 INFO:tasks.workunit.client.0.smithi097.stderr: -188> 2024-09-14T11:06:16.641+0000 7f1360aa2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:06:17.407 INFO:tasks.workunit.client.0.smithi097.stderr: -187> 2024-09-14T11:06:16.641+0000 7f1360aa2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:06:17.407 INFO:tasks.workunit.client.0.smithi097.stderr: -186> 2024-09-14T11:06:16.641+0000 7f13582a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:06:17.407 INFO:tasks.workunit.client.0.smithi097.stderr: -185> 2024-09-14T11:06:16.641+0000 7f13582a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:06:17.407 INFO:tasks.workunit.client.0.smithi097.stderr: -184> 2024-09-14T11:06:16.641+0000 7f13582a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:06:17.407 INFO:tasks.workunit.client.0.smithi097.stderr: -183> 2024-09-14T11:06:16.641+0000 7f13612a3640 10 monclient(hunting): get_auth_request con 0x559f00321fe0 auth_method 0 2024-09-14T11:06:17.407 INFO:tasks.workunit.client.0.smithi097.stderr: -182> 2024-09-14T11:06:16.641+0000 7f13612a3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:06:17.407 INFO:tasks.workunit.client.0.smithi097.stderr: -181> 2024-09-14T11:06:16.641+0000 7f13612a3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:06:17.407 INFO:tasks.workunit.client.0.smithi097.stderr: -180> 2024-09-14T11:06:16.641+0000 7f13612a3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:06:17.407 INFO:tasks.workunit.client.0.smithi097.stderr: -179> 2024-09-14T11:06:16.641+0000 7f1360aa2640 10 monclient(hunting): handle_auth_done global_id 7764 payload 824 2024-09-14T11:06:17.407 INFO:tasks.workunit.client.0.smithi097.stderr: -178> 2024-09-14T11:06:16.641+0000 7f1360aa2640 10 monclient: _finish_hunting 0 2024-09-14T11:06:17.407 INFO:tasks.workunit.client.0.smithi097.stderr: -177> 2024-09-14T11:06:16.641+0000 7f1360aa2640 1 monclient: found mon.noname-a 2024-09-14T11:06:17.408 INFO:tasks.workunit.client.0.smithi097.stderr: -176> 2024-09-14T11:06:16.641+0000 7f1360aa2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-14T11:06:17.408 INFO:tasks.workunit.client.0.smithi097.stderr: -175> 2024-09-14T11:06:16.842+0000 7f1360aa2640 10 monclient: get_auth_request con 0x559f002f38d0 auth_method 0 2024-09-14T11:06:17.408 INFO:tasks.workunit.client.0.smithi097.stderr: -174> 2024-09-14T11:06:16.842+0000 7f1360aa2640 0 --2- 172.21.15.97:0/2263882649 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559f002f38d0 0x559f003154a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:06:17.408 INFO:tasks.workunit.client.0.smithi097.stderr: -173> 2024-09-14T11:06:16.842+0000 7f12367fc640 10 monclient: ms_handle_reset current mon [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:06:17.408 INFO:tasks.workunit.client.0.smithi097.stderr: -172> 2024-09-14T11:06:16.842+0000 7f12367fc640 10 monclient: _reopen_session rank -1 2024-09-14T11:06:17.408 INFO:tasks.workunit.client.0.smithi097.stderr: -171> 2024-09-14T11:06:16.842+0000 7f12367fc640 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:06:17.408 INFO:tasks.workunit.client.0.smithi097.stderr: -170> 2024-09-14T11:06:16.842+0000 7f12367fc640 10 monclient(hunting): picked mon.noname-c con 0x559f002f61c0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:06:17.408 INFO:tasks.workunit.client.0.smithi097.stderr: -169> 2024-09-14T11:06:16.842+0000 7f12367fc640 10 monclient(hunting): picked mon.noname-b con 0x559f00321fe0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:06:17.408 INFO:tasks.workunit.client.0.smithi097.stderr: -168> 2024-09-14T11:06:16.842+0000 7f12367fc640 10 monclient(hunting): picked mon.noname-a con 0x7f122c0073d0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:06:17.408 INFO:tasks.workunit.client.0.smithi097.stderr: -167> 2024-09-14T11:06:16.842+0000 7f12367fc640 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:17.408 INFO:tasks.workunit.client.0.smithi097.stderr: -166> 2024-09-14T11:06:16.842+0000 7f12367fc640 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:17.408 INFO:tasks.workunit.client.0.smithi097.stderr: -165> 2024-09-14T11:06:16.842+0000 7f12367fc640 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:17.409 INFO:tasks.workunit.client.0.smithi097.stderr: -164> 2024-09-14T11:06:16.842+0000 7f12367fc640 10 monclient(hunting): _renew_subs 2024-09-14T11:06:17.409 INFO:tasks.workunit.client.0.smithi097.stderr: -163> 2024-09-14T11:06:16.842+0000 7f1360aa2640 10 monclient(hunting): get_auth_request con 0x7f122c0073d0 auth_method 0 2024-09-14T11:06:17.409 INFO:tasks.workunit.client.0.smithi097.stderr: -162> 2024-09-14T11:06:16.842+0000 7f1360aa2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:06:17.409 INFO:tasks.workunit.client.0.smithi097.stderr: -161> 2024-09-14T11:06:16.842+0000 7f1360aa2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:06:17.409 INFO:tasks.workunit.client.0.smithi097.stderr: -160> 2024-09-14T11:06:16.842+0000 7f1360aa2640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-14T11:06:17.409 INFO:tasks.workunit.client.0.smithi097.stderr: -159> 2024-09-14T11:06:16.842+0000 7f13582a1640 10 monclient(hunting): get_auth_request con 0x559f002f61c0 auth_method 0 2024-09-14T11:06:17.409 INFO:tasks.workunit.client.0.smithi097.stderr: -158> 2024-09-14T11:06:16.842+0000 7f13582a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:06:17.409 INFO:tasks.workunit.client.0.smithi097.stderr: -157> 2024-09-14T11:06:16.842+0000 7f13582a1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:06:17.409 INFO:tasks.workunit.client.0.smithi097.stderr: -156> 2024-09-14T11:06:16.842+0000 7f13582a1640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-14T11:06:17.409 INFO:tasks.workunit.client.0.smithi097.stderr: -155> 2024-09-14T11:06:16.842+0000 7f1360aa2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:06:17.409 INFO:tasks.workunit.client.0.smithi097.stderr: -154> 2024-09-14T11:06:16.842+0000 7f1360aa2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:06:17.410 INFO:tasks.workunit.client.0.smithi097.stderr: -153> 2024-09-14T11:06:16.842+0000 7f1360aa2640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-14T11:06:17.410 INFO:tasks.workunit.client.0.smithi097.stderr: -152> 2024-09-14T11:06:16.842+0000 7f13582a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:06:17.410 INFO:tasks.workunit.client.0.smithi097.stderr: -151> 2024-09-14T11:06:16.842+0000 7f13582a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:06:17.410 INFO:tasks.workunit.client.0.smithi097.stderr: -150> 2024-09-14T11:06:16.842+0000 7f13582a1640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-14T11:06:17.410 INFO:tasks.workunit.client.0.smithi097.stderr: -149> 2024-09-14T11:06:16.842+0000 7f1360aa2640 10 monclient(hunting): handle_auth_done global_id 7764 payload 293 2024-09-14T11:06:17.410 INFO:tasks.workunit.client.0.smithi097.stderr: -148> 2024-09-14T11:06:16.842+0000 7f1360aa2640 10 monclient: _finish_hunting 0 2024-09-14T11:06:17.410 INFO:tasks.workunit.client.0.smithi097.stderr: -147> 2024-09-14T11:06:16.842+0000 7f1360aa2640 1 monclient: found mon.noname-a 2024-09-14T11:06:17.410 INFO:tasks.workunit.client.0.smithi097.stderr: -146> 2024-09-14T11:06:16.842+0000 7f1360aa2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-14T11:06:17.410 INFO:tasks.workunit.client.0.smithi097.stderr: -145> 2024-09-14T11:06:16.842+0000 7f12367fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:06:17.410 INFO:tasks.workunit.client.0.smithi097.stderr: -144> 2024-09-14T11:06:16.842+0000 7f12367fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:06:17.410 INFO:tasks.workunit.client.0.smithi097.stderr: -143> 2024-09-14T11:06:16.842+0000 7f12367fc640 10 monclient: dump: 2024-09-14T11:06:17.410 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:06:17.411 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:06:17.411 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:17.411 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:17.411 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:06:17.411 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:06:17.411 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:06:17.411 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:06:17.411 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:06:17.411 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:17.411 INFO:tasks.workunit.client.0.smithi097.stderr: -142> 2024-09-14T11:06:16.842+0000 7f12367fc640 10 monclient: _finish_auth 0 2024-09-14T11:06:17.411 INFO:tasks.workunit.client.0.smithi097.stderr: -141> 2024-09-14T11:06:16.842+0000 7f12367fc640 10 monclient: _check_auth_tickets 2024-09-14T11:06:17.412 INFO:tasks.workunit.client.0.smithi097.stderr: -140> 2024-09-14T11:06:16.842+0000 7f12367fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:06:17.412 INFO:tasks.workunit.client.0.smithi097.stderr: -139> 2024-09-14T11:06:16.842+0000 7f12367fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:06:17.412 INFO:tasks.workunit.client.0.smithi097.stderr: -138> 2024-09-14T11:06:16.842+0000 7f12367fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:06:17.412 INFO:tasks.workunit.client.0.smithi097.stderr: -137> 2024-09-14T11:06:16.842+0000 7f12367fc640 10 monclient: dump: 2024-09-14T11:06:17.412 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:06:17.412 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:06:17.412 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:17.412 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:17.412 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:06:17.412 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:06:17.412 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:06:17.412 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:06:17.413 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:06:17.413 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:17.413 INFO:tasks.workunit.client.0.smithi097.stderr: -136> 2024-09-14T11:06:16.842+0000 7f1364d1f800 5 monclient: authenticate success, global_id 7764 2024-09-14T11:06:17.413 INFO:tasks.workunit.client.0.smithi097.stderr: -135> 2024-09-14T11:06:16.842+0000 7f1364d1f800 10 monclient: _renew_subs 2024-09-14T11:06:17.413 INFO:tasks.workunit.client.0.smithi097.stderr: -134> 2024-09-14T11:06:16.842+0000 7f1237fff640 4 set_mon_vals no callback set 2024-09-14T11:06:17.413 INFO:tasks.workunit.client.0.smithi097.stderr: -133> 2024-09-14T11:06:16.842+0000 7f1364d1f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:06:17.413 INFO:tasks.workunit.client.0.smithi097.stderr: -132> 2024-09-14T11:06:16.842+0000 7f1364d1f800 10 monclient: _renew_subs 2024-09-14T11:06:17.413 INFO:tasks.workunit.client.0.smithi097.stderr: -131> 2024-09-14T11:06:16.842+0000 7f1364d1f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:06:17.413 INFO:tasks.workunit.client.0.smithi097.stderr: -130> 2024-09-14T11:06:16.842+0000 7f1364d1f800 1 librados: init done 2024-09-14T11:06:17.413 INFO:tasks.workunit.client.0.smithi097.stderr: -129> 2024-09-14T11:06:16.842+0000 7f1364d1f800 5 asok(0x559f00032270) register_command cr dump hook 0x559f002f3018 2024-09-14T11:06:17.413 INFO:tasks.workunit.client.0.smithi097.stderr: -128> 2024-09-14T11:06:16.844+0000 7f1364d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.413 INFO:tasks.workunit.client.0.smithi097.stderr: -127> 2024-09-14T11:06:16.845+0000 7f12367fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:06:17.414 INFO:tasks.workunit.client.0.smithi097.stderr: -126> 2024-09-14T11:06:16.845+0000 7f12367fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:06:17.414 INFO:tasks.workunit.client.0.smithi097.stderr: -125> 2024-09-14T11:06:16.845+0000 7f12367fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:06:17.414 INFO:tasks.workunit.client.0.smithi097.stderr: -124> 2024-09-14T11:06:16.845+0000 7f13582a1640 10 monclient: get_auth_request con 0x559f002f38d0 auth_method 0 2024-09-14T11:06:17.414 INFO:tasks.workunit.client.0.smithi097.stderr: -123> 2024-09-14T11:06:16.845+0000 7f13612a3640 10 monclient: get_auth_request con 0x559f00339ec0 auth_method 0 2024-09-14T11:06:17.414 INFO:tasks.workunit.client.0.smithi097.stderr: -122> 2024-09-14T11:06:16.846+0000 7f1364d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:17.414 INFO:tasks.workunit.client.0.smithi097.stderr: -121> 2024-09-14T11:06:16.846+0000 7f1364d1f800 20 realm 2024-09-14T11:06:17.414 INFO:tasks.workunit.client.0.smithi097.stderr: -120> 2024-09-14T11:06:16.846+0000 7f1364d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.414 INFO:tasks.workunit.client.0.smithi097.stderr: -119> 2024-09-14T11:06:16.846+0000 7f1364d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:17.414 INFO:tasks.workunit.client.0.smithi097.stderr: -118> 2024-09-14T11:06:16.846+0000 7f1364d1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:06:17.414 INFO:tasks.workunit.client.0.smithi097.stderr: -117> 2024-09-14T11:06:16.846+0000 7f1364d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.414 INFO:tasks.workunit.client.0.smithi097.stderr: -116> 2024-09-14T11:06:16.846+0000 7f1364d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:17.415 INFO:tasks.workunit.client.0.smithi097.stderr: -115> 2024-09-14T11:06:16.846+0000 7f1364d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.415 INFO:tasks.workunit.client.0.smithi097.stderr: -114> 2024-09-14T11:06:16.846+0000 7f13582a1640 10 monclient: get_auth_request con 0x559f0033e0a0 auth_method 0 2024-09-14T11:06:17.415 INFO:tasks.workunit.client.0.smithi097.stderr: -113> 2024-09-14T11:06:16.847+0000 7f1364d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:17.415 INFO:tasks.workunit.client.0.smithi097.stderr: -112> 2024-09-14T11:06:16.847+0000 7f1364d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.415 INFO:tasks.workunit.client.0.smithi097.stderr: -111> 2024-09-14T11:06:16.847+0000 7f13612a3640 10 monclient: get_auth_request con 0x559f00341950 auth_method 0 2024-09-14T11:06:17.415 INFO:tasks.workunit.client.0.smithi097.stderr: -110> 2024-09-14T11:06:16.848+0000 7f1364d1f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:06:17.415 INFO:tasks.workunit.client.0.smithi097.stderr: -109> 2024-09-14T11:06:16.848+0000 7f1364d1f800 20 searching for the correct realm 2024-09-14T11:06:17.415 INFO:tasks.workunit.client.0.smithi097.stderr: -108> 2024-09-14T11:06:16.848+0000 7f1360aa2640 10 monclient: get_auth_request con 0x559f00346660 auth_method 0 2024-09-14T11:06:17.415 INFO:tasks.workunit.client.0.smithi097.stderr: -107> 2024-09-14T11:06:16.849+0000 7f13582a1640 10 monclient: get_auth_request con 0x7f1350018070 auth_method 0 2024-09-14T11:06:17.415 INFO:tasks.workunit.client.0.smithi097.stderr: -106> 2024-09-14T11:06:16.849+0000 7f13582a1640 0 -- 172.21.15.97:0/2263882649 >> [v2:172.21.15.97:6808/2081705332,v1:172.21.15.97:6809/2081705332] conn(0x7f1350018070 msgr2=0x7f13500605c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:06:17.415 INFO:tasks.workunit.client.0.smithi097.stderr: -105> 2024-09-14T11:06:17.050+0000 7f13582a1640 10 monclient: get_auth_request con 0x7f1350018070 auth_method 0 2024-09-14T11:06:17.415 INFO:tasks.workunit.client.0.smithi097.stderr: -104> 2024-09-14T11:06:17.050+0000 7f12367fc640 1 client.7764.objecter ms_handle_reset 0x559f0033e0a0 session 0x559f0033da20 osd.1 2024-09-14T11:06:17.416 INFO:tasks.workunit.client.0.smithi097.stderr: -103> 2024-09-14T11:06:17.050+0000 7f12367fc640 10 monclient: _renew_subs 2024-09-14T11:06:17.416 INFO:tasks.workunit.client.0.smithi097.stderr: -102> 2024-09-14T11:06:17.050+0000 7f12367fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:06:17.416 INFO:tasks.workunit.client.0.smithi097.stderr: -101> 2024-09-14T11:06:17.051+0000 7f13582a1640 10 monclient: get_auth_request con 0x7f122c08eb10 auth_method 0 2024-09-14T11:06:17.416 INFO:tasks.workunit.client.0.smithi097.stderr: -100> 2024-09-14T11:06:17.051+0000 7f13612a3640 10 monclient: get_auth_request con 0x7f13480393f0 auth_method 0 2024-09-14T11:06:17.416 INFO:tasks.workunit.client.0.smithi097.stderr: -99> 2024-09-14T11:06:17.053+0000 7f13612a3640 0 -- 172.21.15.97:0/2263882649 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x559f00339ec0 msgr2=0x559f0033c360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:17.416 INFO:tasks.workunit.client.0.smithi097.stderr: -98> 2024-09-14T11:06:17.053+0000 7f12367fc640 1 client.7764.objecter ms_handle_reset 0x559f00339ec0 session 0x559f00339840 osd.6 2024-09-14T11:06:17.416 INFO:tasks.workunit.client.0.smithi097.stderr: -97> 2024-09-14T11:06:17.053+0000 7f13612a3640 10 monclient: get_auth_request con 0x559f0033e0a0 auth_method 0 2024-09-14T11:06:17.416 INFO:tasks.workunit.client.0.smithi097.stderr: -96> 2024-09-14T11:06:17.054+0000 7f1360aa2640 10 monclient: get_auth_request con 0x7f1348060930 auth_method 0 2024-09-14T11:06:17.416 INFO:tasks.workunit.client.0.smithi097.stderr: -95> 2024-09-14T11:06:17.255+0000 7f1360aa2640 10 monclient: get_auth_request con 0x7f1348060930 auth_method 0 2024-09-14T11:06:17.416 INFO:tasks.workunit.client.0.smithi097.stderr: -94> 2024-09-14T11:06:17.255+0000 7f13582a1640 10 monclient: get_auth_request con 0x7f1350044990 auth_method 0 2024-09-14T11:06:17.416 INFO:tasks.workunit.client.0.smithi097.stderr: -93> 2024-09-14T11:06:17.260+0000 7f1364d1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:06:17.416 INFO:tasks.workunit.client.0.smithi097.stderr: -92> 2024-09-14T11:06:17.260+0000 7f1364d1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:06:17.417 INFO:tasks.workunit.client.0.smithi097.stderr: -91> 2024-09-14T11:06:17.260+0000 7f1364d1f800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:06:17.417 INFO:tasks.workunit.client.0.smithi097.stderr: -90> 2024-09-14T11:06:17.260+0000 7f1364d1f800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:06:17.417 INFO:tasks.workunit.client.0.smithi097.stderr: -89> 2024-09-14T11:06:17.260+0000 7f1364d1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:06:17.417 INFO:tasks.workunit.client.0.smithi097.stderr: -88> 2024-09-14T11:06:17.260+0000 7f1364d1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:06:17.417 INFO:tasks.workunit.client.0.smithi097.stderr: -87> 2024-09-14T11:06:17.260+0000 7f1364d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.417 INFO:tasks.workunit.client.0.smithi097.stderr: -86> 2024-09-14T11:06:17.260+0000 7f1364d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:17.417 INFO:tasks.workunit.client.0.smithi097.stderr: -85> 2024-09-14T11:06:17.260+0000 7f1364d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.417 INFO:tasks.workunit.client.0.smithi097.stderr: -84> 2024-09-14T11:06:17.261+0000 7f1364d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:17.417 INFO:tasks.workunit.client.0.smithi097.stderr: -83> 2024-09-14T11:06:17.261+0000 7f1364d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.417 INFO:tasks.workunit.client.0.smithi097.stderr: -82> 2024-09-14T11:06:17.261+0000 7f1364d1f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:06:17.417 INFO:tasks.workunit.client.0.smithi097.stderr: -81> 2024-09-14T11:06:17.261+0000 7f1364d1f800 20 zone default found 2024-09-14T11:06:17.417 INFO:tasks.workunit.client.0.smithi097.stderr: -80> 2024-09-14T11:06:17.261+0000 7f1364d1f800 4 Realm: () 2024-09-14T11:06:17.418 INFO:tasks.workunit.client.0.smithi097.stderr: -79> 2024-09-14T11:06:17.261+0000 7f1364d1f800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:06:17.418 INFO:tasks.workunit.client.0.smithi097.stderr: -78> 2024-09-14T11:06:17.261+0000 7f1364d1f800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:06:17.418 INFO:tasks.workunit.client.0.smithi097.stderr: -77> 2024-09-14T11:06:17.261+0000 7f1364d1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:06:17.418 INFO:tasks.workunit.client.0.smithi097.stderr: -76> 2024-09-14T11:06:17.261+0000 7f1364d1f800 20 zonegroup default 2024-09-14T11:06:17.418 INFO:tasks.workunit.client.0.smithi097.stderr: -75> 2024-09-14T11:06:17.261+0000 7f1364d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.418 INFO:tasks.workunit.client.0.smithi097.stderr: -74> 2024-09-14T11:06:17.261+0000 7f1364d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:17.418 INFO:tasks.workunit.client.0.smithi097.stderr: -73> 2024-09-14T11:06:17.261+0000 7f1364d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.418 INFO:tasks.workunit.client.0.smithi097.stderr: -72> 2024-09-14T11:06:17.262+0000 7f1364d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:17.418 INFO:tasks.workunit.client.0.smithi097.stderr: -71> 2024-09-14T11:06:17.262+0000 7f1364d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.418 INFO:tasks.workunit.client.0.smithi097.stderr: -70> 2024-09-14T11:06:17.262+0000 7f1364d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:17.418 INFO:tasks.workunit.client.0.smithi097.stderr: -69> 2024-09-14T11:06:17.262+0000 7f1364d1f800 20 started sync module instance, tier type = 2024-09-14T11:06:17.419 INFO:tasks.workunit.client.0.smithi097.stderr: -68> 2024-09-14T11:06:17.262+0000 7f1364d1f800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:06:17.419 INFO:tasks.workunit.client.0.smithi097.stderr: -67> 2024-09-14T11:06:17.271+0000 7f1364d1f800 20 add_watcher() i=0 2024-09-14T11:06:17.419 INFO:tasks.workunit.client.0.smithi097.stderr: -66> 2024-09-14T11:06:17.271+0000 7f1364d1f800 20 add_watcher() i=1 2024-09-14T11:06:17.419 INFO:tasks.workunit.client.0.smithi097.stderr: -65> 2024-09-14T11:06:17.271+0000 7f1364d1f800 20 add_watcher() i=2 2024-09-14T11:06:17.419 INFO:tasks.workunit.client.0.smithi097.stderr: -64> 2024-09-14T11:06:17.271+0000 7f1364d1f800 20 add_watcher() i=3 2024-09-14T11:06:17.419 INFO:tasks.workunit.client.0.smithi097.stderr: -63> 2024-09-14T11:06:17.271+0000 7f1364d1f800 20 add_watcher() i=4 2024-09-14T11:06:17.419 INFO:tasks.workunit.client.0.smithi097.stderr: -62> 2024-09-14T11:06:17.271+0000 7f1364d1f800 20 add_watcher() i=5 2024-09-14T11:06:17.419 INFO:tasks.workunit.client.0.smithi097.stderr: -61> 2024-09-14T11:06:17.271+0000 7f1364d1f800 20 add_watcher() i=6 2024-09-14T11:06:17.419 INFO:tasks.workunit.client.0.smithi097.stderr: -60> 2024-09-14T11:06:17.272+0000 7f1364d1f800 20 add_watcher() i=7 2024-09-14T11:06:17.419 INFO:tasks.workunit.client.0.smithi097.stderr: -59> 2024-09-14T11:06:17.272+0000 7f1364d1f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:06:17.419 INFO:tasks.workunit.client.0.smithi097.stderr: -58> 2024-09-14T11:06:17.273+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9a60) adding auth protocol: cephx 2024-09-14T11:06:17.419 INFO:tasks.workunit.client.0.smithi097.stderr: -57> 2024-09-14T11:06:17.273+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9a60) adding auth protocol: cephx 2024-09-14T11:06:17.419 INFO:tasks.workunit.client.0.smithi097.stderr: -56> 2024-09-14T11:06:17.273+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9a60) adding auth protocol: cephx 2024-09-14T11:06:17.420 INFO:tasks.workunit.client.0.smithi097.stderr: -55> 2024-09-14T11:06:17.273+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9a60) adding con mode: secure 2024-09-14T11:06:17.420 INFO:tasks.workunit.client.0.smithi097.stderr: -54> 2024-09-14T11:06:17.273+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9a60) adding con mode: crc 2024-09-14T11:06:17.420 INFO:tasks.workunit.client.0.smithi097.stderr: -53> 2024-09-14T11:06:17.273+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9a60) adding con mode: secure 2024-09-14T11:06:17.420 INFO:tasks.workunit.client.0.smithi097.stderr: -52> 2024-09-14T11:06:17.273+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9a60) adding con mode: crc 2024-09-14T11:06:17.420 INFO:tasks.workunit.client.0.smithi097.stderr: -51> 2024-09-14T11:06:17.273+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9a60) adding con mode: secure 2024-09-14T11:06:17.420 INFO:tasks.workunit.client.0.smithi097.stderr: -50> 2024-09-14T11:06:17.273+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9a60) adding con mode: crc 2024-09-14T11:06:17.420 INFO:tasks.workunit.client.0.smithi097.stderr: -49> 2024-09-14T11:06:17.273+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9a60) adding con mode: crc 2024-09-14T11:06:17.420 INFO:tasks.workunit.client.0.smithi097.stderr: -48> 2024-09-14T11:06:17.273+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9a60) adding con mode: secure 2024-09-14T11:06:17.420 INFO:tasks.workunit.client.0.smithi097.stderr: -47> 2024-09-14T11:06:17.273+0000 7f12177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:17.420 INFO:tasks.workunit.client.0.smithi097.stderr: -46> 2024-09-14T11:06:17.274+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9a60) adding con mode: crc 2024-09-14T11:06:17.420 INFO:tasks.workunit.client.0.smithi097.stderr: -45> 2024-09-14T11:06:17.274+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9a60) adding con mode: secure 2024-09-14T11:06:17.421 INFO:tasks.workunit.client.0.smithi097.stderr: -44> 2024-09-14T11:06:17.274+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9a60) adding con mode: crc 2024-09-14T11:06:17.421 INFO:tasks.workunit.client.0.smithi097.stderr: -43> 2024-09-14T11:06:17.274+0000 7f1364d1f800 5 AuthRegistry(0x7ffcfd6a9a60) adding con mode: secure 2024-09-14T11:06:17.421 INFO:tasks.workunit.client.0.smithi097.stderr: -42> 2024-09-14T11:06:17.274+0000 7f1364d1f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:06:17.421 INFO:tasks.workunit.client.0.smithi097.stderr: -41> 2024-09-14T11:06:17.274+0000 7f1364d1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:06:17.421 INFO:tasks.workunit.client.0.smithi097.stderr: -40> 2024-09-14T11:06:17.274+0000 7f1364d1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:06:17.421 INFO:tasks.workunit.client.0.smithi097.stderr: -39> 2024-09-14T11:06:17.274+0000 7f1364d1f800 5 asok(0x559f00032270) register_command cache list hook 0x559f00314e20 2024-09-14T11:06:17.421 INFO:tasks.workunit.client.0.smithi097.stderr: -38> 2024-09-14T11:06:17.274+0000 7f1364d1f800 5 asok(0x559f00032270) register_command cache inspect hook 0x559f00314e20 2024-09-14T11:06:17.421 INFO:tasks.workunit.client.0.smithi097.stderr: -37> 2024-09-14T11:06:17.274+0000 7f1364d1f800 5 asok(0x559f00032270) register_command cache erase hook 0x559f00314e20 2024-09-14T11:06:17.421 INFO:tasks.workunit.client.0.smithi097.stderr: -36> 2024-09-14T11:06:17.274+0000 7f1364d1f800 5 asok(0x559f00032270) register_command cache zap hook 0x559f00314e20 2024-09-14T11:06:17.421 INFO:tasks.workunit.client.0.smithi097.stderr: -35> 2024-09-14T11:06:17.274+0000 7f1364d1f800 5 note: GC not initialized 2024-09-14T11:06:17.421 INFO:tasks.workunit.client.0.smithi097.stderr: -34> 2024-09-14T11:06:17.274+0000 7f12167e4640 20 reqs_thread_entry: start 2024-09-14T11:06:17.421 INFO:tasks.workunit.client.0.smithi097.stderr: -33> 2024-09-14T11:06:17.274+0000 7f1364d1f800 5 asok(0x559f00032270) register_command sync trace show hook 0x7f1350065040 2024-09-14T11:06:17.422 INFO:tasks.workunit.client.0.smithi097.stderr: -32> 2024-09-14T11:06:17.274+0000 7f1364d1f800 5 asok(0x559f00032270) register_command sync trace history hook 0x7f1350065040 2024-09-14T11:06:17.422 INFO:tasks.workunit.client.0.smithi097.stderr: -31> 2024-09-14T11:06:17.274+0000 7f1364d1f800 5 asok(0x559f00032270) register_command sync trace active hook 0x7f1350065040 2024-09-14T11:06:17.422 INFO:tasks.workunit.client.0.smithi097.stderr: -30> 2024-09-14T11:06:17.274+0000 7f1364d1f800 5 asok(0x559f00032270) register_command sync trace active_short hook 0x7f1350065040 2024-09-14T11:06:17.422 INFO:tasks.workunit.client.0.smithi097.stderr: -29> 2024-09-14T11:06:17.274+0000 7f1364d1f800 20 init_complete bucket index max shards: 11 2024-09-14T11:06:17.422 INFO:tasks.workunit.client.0.smithi097.stderr: -28> 2024-09-14T11:06:17.274+0000 7f1364d1f800 20 Filter name: none 2024-09-14T11:06:17.422 INFO:tasks.workunit.client.0.smithi097.stderr: -27> 2024-09-14T11:06:17.274+0000 7f120ffff640 20 reqs_thread_entry: start 2024-09-14T11:06:17.422 INFO:tasks.workunit.client.0.smithi097.stderr: -26> 2024-09-14T11:06:17.274+0000 7f1364d1f800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:06:17.422 INFO:tasks.workunit.client.0.smithi097.stderr: -25> 2024-09-14T11:06:17.274+0000 7f1364d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.422 INFO:tasks.workunit.client.0.smithi097.stderr: -24> 2024-09-14T11:06:17.275+0000 7f1364d1f800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:06:17.422 INFO:tasks.workunit.client.0.smithi097.stderr: -23> 2024-09-14T11:06:17.275+0000 7f1364d1f800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:06:17.422 INFO:tasks.workunit.client.0.smithi097.stderr: -22> 2024-09-14T11:06:17.275+0000 7f1364d1f800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:06:17.423 INFO:tasks.workunit.client.0.smithi097.stderr: -21> 2024-09-14T11:06:17.275+0000 7f1364d1f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 : miss 2024-09-14T11:06:17.423 INFO:tasks.workunit.client.0.smithi097.stderr: -20> 2024-09-14T11:06:17.275+0000 7f1364d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.423 INFO:tasks.workunit.client.0.smithi097.stderr: -19> 2024-09-14T11:06:17.275+0000 7f1364d1f800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:06:17.423 INFO:tasks.workunit.client.0.smithi097.stderr: -18> 2024-09-14T11:06:17.275+0000 7f1364d1f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 info.flags=0x17 2024-09-14T11:06:17.423 INFO:tasks.workunit.client.0.smithi097.stderr: -17> 2024-09-14T11:06:17.275+0000 7f1364d1f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 to cache LRU end 2024-09-14T11:06:17.423 INFO:tasks.workunit.client.0.smithi097.stderr: -16> 2024-09-14T11:06:17.275+0000 7f1364d1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:06:17.423 INFO:tasks.workunit.client.0.smithi097.stderr: -15> 2024-09-14T11:06:17.275+0000 7f1364d1f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:17.423 INFO:tasks.workunit.client.0.smithi097.stderr: -14> 2024-09-14T11:06:17.275+0000 7f1364d1f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 2024-09-14T11:06:17.423 INFO:tasks.workunit.client.0.smithi097.stderr: -13> 2024-09-14T11:06:17.280+0000 7f1364d1f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 info.flags=0x17 2024-09-14T11:06:17.423 INFO:tasks.workunit.client.0.smithi097.stderr: -12> 2024-09-14T11:06:17.280+0000 7f1364d1f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 to cache LRU end 2024-09-14T11:06:17.423 INFO:tasks.workunit.client.0.smithi097.stderr: -11> 2024-09-14T11:06:17.280+0000 7f1364d1f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:17.424 INFO:tasks.workunit.client.0.smithi097.stderr: -10> 2024-09-14T11:06:17.280+0000 7f1364d1f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36, ofs0, ns] 2024-09-14T11:06:17.424 INFO:tasks.workunit.client.0.smithi097.stderr: -9> 2024-09-14T11:06:17.281+0000 7f1237fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595098 cookie 94141391552144 notifier 7764 bl.length()=923 2024-09-14T11:06:17.424 INFO:tasks.workunit.client.0.smithi097.stderr: -8> 2024-09-14T11:06:17.281+0000 7f1237fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 info.flags=0x17 2024-09-14T11:06:17.424 INFO:tasks.workunit.client.0.smithi097.stderr: -7> 2024-09-14T11:06:17.281+0000 7f1237fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 to cache LRU end 2024-09-14T11:06:17.424 INFO:tasks.workunit.client.0.smithi097.stderr: -6> 2024-09-14T11:06:17.281+0000 7f1237fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:17.424 INFO:tasks.workunit.client.0.smithi097.stderr: -5> 2024-09-14T11:06:17.281+0000 7f1364d1f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36]): orig_sources= new_sources= 2024-09-14T11:06:17.424 INFO:tasks.workunit.client.0.smithi097.stderr: -4> 2024-09-14T11:06:17.281+0000 7f1364d1f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36]): potential sources added=[] removed=[] 2024-09-14T11:06:17.424 INFO:tasks.workunit.client.0.smithi097.stderr: -3> 2024-09-14T11:06:17.281+0000 7f1364d1f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36]): orig_dests= new_dests= 2024-09-14T11:06:17.424 INFO:tasks.workunit.client.0.smithi097.stderr: -2> 2024-09-14T11:06:17.281+0000 7f1364d1f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36]): potential dests added=[] removed=[] 2024-09-14T11:06:17.424 INFO:tasks.workunit.client.0.smithi097.stderr: -1> 2024-09-14T11:06:17.284+0000 7f1364d1f800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1364d1f800 time 2024-09-14T11:06:17.284623+0000 2024-09-14T11:06:17.424 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:06:17.424 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:17.425 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:06:17.425 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f136658c76a] 2024-09-14T11:06:17.425 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f136658c928] 2024-09-14T11:06:17.425 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559efdb370b1] 2024-09-14T11:06:17.425 INFO:tasks.workunit.client.0.smithi097.stderr: 4: radosgw-admin(+0xd8907c) [0x559efe04b07c] 2024-09-14T11:06:17.425 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559efdb46efd] 2024-09-14T11:06:17.425 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-14T11:06:17.425 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f1365229590] 2024-09-14T11:06:17.425 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-14T11:06:17.425 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-14T11:06:17.425 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:17.426 INFO:tasks.workunit.client.0.smithi097.stderr: 0> 2024-09-14T11:06:17.285+0000 7f1364d1f800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:06:17.426 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f1364d1f800 thread_name:radosgw-admin 2024-09-14T11:06:17.426 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:17.426 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:06:17.426 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f136523e6f0] 2024-09-14T11:06:17.426 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f136528b99c] 2024-09-14T11:06:17.426 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-14T11:06:17.426 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-14T11:06:17.426 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f136658c7c4] 2024-09-14T11:06:17.426 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f136658c928] 2024-09-14T11:06:17.426 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559efdb370b1] 2024-09-14T11:06:17.426 INFO:tasks.workunit.client.0.smithi097.stderr: 8: radosgw-admin(+0xd8907c) [0x559efe04b07c] 2024-09-14T11:06:17.426 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559efdb46efd] 2024-09-14T11:06:17.427 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-14T11:06:17.427 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f1365229590] 2024-09-14T11:06:17.427 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-14T11:06:17.427 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-14T11:06:17.427 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:06:17.427 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:17.427 INFO:tasks.workunit.client.0.smithi097.stderr:--- logging levels --- 2024-09-14T11:06:17.427 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 none 2024-09-14T11:06:17.427 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 lockdep 2024-09-14T11:06:17.427 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 context 2024-09-14T11:06:17.427 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 crush 2024-09-14T11:06:17.428 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds 2024-09-14T11:06:17.428 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_balancer 2024-09-14T11:06:17.428 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_locker 2024-09-14T11:06:17.428 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log 2024-09-14T11:06:17.428 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log_expire 2024-09-14T11:06:17.428 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_migrator 2024-09-14T11:06:17.428 INFO:tasks.workunit.client.0.smithi097.stderr: 3/ 5 mds_quiesce 2024-09-14T11:06:17.428 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 buffer 2024-09-14T11:06:17.428 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 timer 2024-09-14T11:06:17.428 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 filer 2024-09-14T11:06:17.428 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 striper 2024-09-14T11:06:17.428 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 objecter 2024-09-14T11:06:17.429 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rados 2024-09-14T11:06:17.429 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd 2024-09-14T11:06:17.429 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_mirror 2024-09-14T11:06:17.429 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_replay 2024-09-14T11:06:17.429 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_pwl 2024-09-14T11:06:17.429 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 journaler 2024-09-14T11:06:17.429 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objectcacher 2024-09-14T11:06:17.429 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:06:17.429 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 client 2024-09-14T11:06:17.429 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 osd 2024-09-14T11:06:17.429 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 optracker 2024-09-14T11:06:17.429 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objclass 2024-09-14T11:06:17.430 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 filestore 2024-09-14T11:06:17.430 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 journal 2024-09-14T11:06:17.430 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 ms 2024-09-14T11:06:17.430 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mon 2024-09-14T11:06:17.430 INFO:tasks.workunit.client.0.smithi097.stderr: 0/10 monc 2024-09-14T11:06:17.430 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 paxos 2024-09-14T11:06:17.430 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 tp 2024-09-14T11:06:17.430 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 auth 2024-09-14T11:06:17.430 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 crypto 2024-09-14T11:06:17.430 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 finisher 2024-09-14T11:06:17.430 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 reserver 2024-09-14T11:06:17.430 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 heartbeatmap 2024-09-14T11:06:17.431 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 perfcounter 2024-09-14T11:06:17.431 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw 2024-09-14T11:06:17.431 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_sync 2024-09-14T11:06:17.431 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_datacache 2024-09-14T11:06:17.431 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_access 2024-09-14T11:06:17.431 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:06:17.431 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_flight 2024-09-14T11:06:17.431 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:06:17.431 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw_notification 2024-09-14T11:06:17.431 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 javaclient 2024-09-14T11:06:17.431 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 asok 2024-09-14T11:06:17.431 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 throttle 2024-09-14T11:06:17.432 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 refs 2024-09-14T11:06:17.432 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 compressor 2024-09-14T11:06:17.432 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluestore 2024-09-14T11:06:17.432 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluefs 2024-09-14T11:06:17.432 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 bdev 2024-09-14T11:06:17.432 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 kstore 2024-09-14T11:06:17.432 INFO:tasks.workunit.client.0.smithi097.stderr: 4/ 5 rocksdb 2024-09-14T11:06:17.432 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 fuse 2024-09-14T11:06:17.432 INFO:tasks.workunit.client.0.smithi097.stderr: 2/ 5 mgr 2024-09-14T11:06:17.432 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mgrc 2024-09-14T11:06:17.432 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 dpdk 2024-09-14T11:06:17.433 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 eventtrace 2024-09-14T11:06:17.433 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 prioritycache 2024-09-14T11:06:17.433 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 test 2024-09-14T11:06:17.433 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:06:17.433 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephsqlite 2024-09-14T11:06:17.433 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:06:17.433 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore 2024-09-14T11:06:17.433 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_onode 2024-09-14T11:06:17.433 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_odata 2024-09-14T11:06:17.433 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_omap 2024-09-14T11:06:17.433 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_tm 2024-09-14T11:06:17.433 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_t 2024-09-14T11:06:17.434 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:06:17.434 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_epm 2024-09-14T11:06:17.434 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_lba 2024-09-14T11:06:17.434 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:06:17.434 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cache 2024-09-14T11:06:17.434 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_journal 2024-09-14T11:06:17.434 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_device 2024-09-14T11:06:17.434 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_backref 2024-09-14T11:06:17.434 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 alienstore 2024-09-14T11:06:17.434 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mclock 2024-09-14T11:06:17.434 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cyanstore 2024-09-14T11:06:17.434 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 ceph_exporter 2024-09-14T11:06:17.435 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 memstore 2024-09-14T11:06:17.435 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 trace 2024-09-14T11:06:17.435 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 ceph_dedup 2024-09-14T11:06:17.435 INFO:tasks.workunit.client.0.smithi097.stderr: -2/-2 (syslog threshold) 2024-09-14T11:06:17.435 INFO:tasks.workunit.client.0.smithi097.stderr: 99/99 (stderr threshold) 2024-09-14T11:06:17.435 INFO:tasks.workunit.client.0.smithi097.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:06:17.435 INFO:tasks.workunit.client.0.smithi097.stderr: 7f120ffff640 / http_manager 2024-09-14T11:06:17.435 INFO:tasks.workunit.client.0.smithi097.stderr: 7f12167e4640 / http_manager 2024-09-14T11:06:17.435 INFO:tasks.workunit.client.0.smithi097.stderr: 7f12177e6640 / rgw_dt_lg_renew 2024-09-14T11:06:17.435 INFO:tasks.workunit.client.0.smithi097.stderr: 7f12367fc640 / ms_dispatch 2024-09-14T11:06:17.435 INFO:tasks.workunit.client.0.smithi097.stderr: 7f1237fff640 / io_context_pool 2024-09-14T11:06:17.436 INFO:tasks.workunit.client.0.smithi097.stderr: 7f12467fc640 / ms_dispatch 2024-09-14T11:06:17.436 INFO:tasks.workunit.client.0.smithi097.stderr: 7f124d60a640 / ms_dispatch 2024-09-14T11:06:17.436 INFO:tasks.workunit.client.0.smithi097.stderr: 7f124ee0d640 / io_context_pool 2024-09-14T11:06:17.436 INFO:tasks.workunit.client.0.smithi097.stderr: 7f13582a1640 / msgr-worker-2 2024-09-14T11:06:17.436 INFO:tasks.workunit.client.0.smithi097.stderr: 7f1360aa2640 / msgr-worker-1 2024-09-14T11:06:17.436 INFO:tasks.workunit.client.0.smithi097.stderr: 7f13612a3640 / msgr-worker-0 2024-09-14T11:06:17.436 INFO:tasks.workunit.client.0.smithi097.stderr: 7f1361aa4640 / io_context_pool 2024-09-14T11:06:17.436 INFO:tasks.workunit.client.0.smithi097.stderr: 7f1364d1f800 / radosgw-admin 2024-09-14T11:06:17.436 INFO:tasks.workunit.client.0.smithi097.stderr: max_recent 500 2024-09-14T11:06:17.436 INFO:tasks.workunit.client.0.smithi097.stderr: max_new 1000 2024-09-14T11:06:17.436 INFO:tasks.workunit.client.0.smithi097.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:06:17.286312Z_df5e0d5b-d7c1-4866-9e33-9eaafe4b402a/log 2024-09-14T11:06:17.436 INFO:tasks.workunit.client.0.smithi097.stderr:--- end dump of recent events --- 2024-09-14T11:06:17.437 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-14T11:06:17.442 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:06:17.442 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:06:17.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.361+0000 7fbcbe298800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.363+0000 7fbcbe298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:17.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.363+0000 7fbcbe298800 20 realm 2024-09-14T11:06:17.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.363+0000 7fbcbe298800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.363+0000 7fbcbe298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:17.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.363+0000 7fbcbe298800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:06:17.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.363+0000 7fbcbe298800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.363+0000 7fbcbe298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:17.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.363+0000 7fbcbe298800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.364+0000 7fbcbe298800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:17.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.364+0000 7fbcbe298800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.444 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.365+0000 7fbcbe298800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:06:17.444 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.365+0000 7fbcbe298800 20 searching for the correct realm 2024-09-14T11:06:17.444 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.366+0000 7fbcbbd82640 0 -- 172.21.15.97:0/657955011 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x557f74d5bf70 msgr2=0x557f74d5e3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:17.444 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.369+0000 7fbcbbd82640 0 -- 172.21.15.97:0/657955011 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7fbca40970a0 msgr2=0x7fbca405feb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:17.444 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.374+0000 7fbcbe298800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:06:17.444 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.374+0000 7fbcbe298800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:06:17.444 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.374+0000 7fbcbe298800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:06:17.444 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.374+0000 7fbcbe298800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:06:17.444 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.374+0000 7fbcbe298800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:06:17.444 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.374+0000 7fbcbe298800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:06:17.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.374+0000 7fbcbe298800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.374+0000 7fbcbe298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:17.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.374+0000 7fbcbe298800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.374+0000 7fbcbe298800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:17.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.374+0000 7fbcbe298800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.375+0000 7fbcbe298800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:06:17.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.375+0000 7fbcbe298800 20 zone default found 2024-09-14T11:06:17.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.375+0000 7fbcbe298800 4 Realm: () 2024-09-14T11:06:17.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.375+0000 7fbcbe298800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:06:17.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.375+0000 7fbcbe298800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:06:17.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.375+0000 7fbcbe298800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:06:17.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.375+0000 7fbcbe298800 20 zonegroup default 2024-09-14T11:06:17.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.375+0000 7fbcbe298800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.375+0000 7fbcbe298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:17.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.375+0000 7fbcbe298800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.375+0000 7fbcbe298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:17.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.375+0000 7fbcbe298800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.375+0000 7fbcbe298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:17.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.375+0000 7fbcbe298800 20 started sync module instance, tier type = 2024-09-14T11:06:17.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.375+0000 7fbcbe298800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:06:17.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.384+0000 7fbcbe298800 20 add_watcher() i=0 2024-09-14T11:06:17.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.384+0000 7fbcbe298800 20 add_watcher() i=1 2024-09-14T11:06:17.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.384+0000 7fbcbe298800 20 add_watcher() i=2 2024-09-14T11:06:17.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.384+0000 7fbcbe298800 20 add_watcher() i=3 2024-09-14T11:06:17.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.384+0000 7fbcbe298800 20 add_watcher() i=4 2024-09-14T11:06:17.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.384+0000 7fbcbe298800 20 add_watcher() i=5 2024-09-14T11:06:17.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.384+0000 7fbcbe298800 20 add_watcher() i=6 2024-09-14T11:06:17.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.385+0000 7fbcbe298800 20 add_watcher() i=7 2024-09-14T11:06:17.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.385+0000 7fbcbe298800 2 all 8 watchers are set, enabling cache 2024-09-14T11:06:17.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.386+0000 7fbb71fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:17.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.386+0000 7fbcbe298800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:06:17.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.386+0000 7fbcbe298800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:06:17.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.387+0000 7fbcbe298800 5 note: GC not initialized 2024-09-14T11:06:17.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.387+0000 7fbb70fe1640 20 reqs_thread_entry: start 2024-09-14T11:06:17.448 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.387+0000 7fbcbe298800 20 init_complete bucket index max shards: 11 2024-09-14T11:06:17.448 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.387+0000 7fbcbe298800 20 Filter name: none 2024-09-14T11:06:17.448 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.387+0000 7fbaea7fc640 20 reqs_thread_entry: start 2024-09-14T11:06:17.448 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.387+0000 7fbcbe298800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.448 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.387+0000 7fbcbe298800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:06:17.448 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.387+0000 7fbcbe298800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.448 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.388+0000 7fbcbe298800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:06:17.448 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.388+0000 7fbcbe298800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:06:17.448 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.388+0000 7fbcbe298800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.448 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.388+0000 7fbcbe298800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:06:17.449 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.388+0000 7fbcbe298800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.449 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.388+0000 7fbcbe298800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:06:17.449 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.388+0000 7fbcbe298800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:06:17.449 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.390+0000 7fbb71fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:17.449 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.392+0000 7fbcbe298800 20 remove_watcher() i=0 2024-09-14T11:06:17.449 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.392+0000 7fbcbe298800 2 removed watcher, disabling cache 2024-09-14T11:06:17.449 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.393+0000 7fbcbe298800 20 remove_watcher() i=1 2024-09-14T11:06:17.449 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.394+0000 7fbcbe298800 20 remove_watcher() i=2 2024-09-14T11:06:17.449 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.395+0000 7fbcbe298800 20 remove_watcher() i=3 2024-09-14T11:06:17.449 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.396+0000 7fbcbe298800 20 remove_watcher() i=4 2024-09-14T11:06:17.449 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.397+0000 7fbcbe298800 20 remove_watcher() i=5 2024-09-14T11:06:17.449 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.398+0000 7fbcbe298800 20 remove_watcher() i=6 2024-09-14T11:06:17.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.399+0000 7fbcbe298800 20 remove_watcher() i=7 2024-09-14T11:06:17.450 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:17.450 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:06:17.450 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: abort-at-logrecord-writes id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:06:17.450 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:17.459 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:06:17.491 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:06:17.491 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:06:17.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.529+0000 7fa34a487800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.530+0000 7fa34a487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:17.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.530+0000 7fa34a487800 20 realm 2024-09-14T11:06:17.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.530+0000 7fa34a487800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.530+0000 7fa34a487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:17.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.530+0000 7fa34a487800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:06:17.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.530+0000 7fa34a487800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.531+0000 7fa34a487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:17.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.531+0000 7fa34a487800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.532+0000 7fa34a487800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:17.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.532+0000 7fa34a487800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.531 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.533+0000 7fa34a487800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:06:17.531 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.533+0000 7fa34a487800 20 searching for the correct realm 2024-09-14T11:06:17.532 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.534+0000 7fa347777640 0 -- 172.21.15.97:0/706999571 >> [v2:172.21.15.97:6808/2081705332,v1:172.21.15.97:6809/2081705332] conn(0x7fa33006b020 msgr2=0x7fa3300a4300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:17.737 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.738+0000 7fa347f78640 0 -- 172.21.15.97:0/706999571 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7fa33803d060 msgr2=0x7fa338020a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:17.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.944+0000 7fa34a487800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:06:17.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.944+0000 7fa34a487800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:06:17.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.944+0000 7fa34a487800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:06:17.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.944+0000 7fa34a487800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:06:17.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.944+0000 7fa34a487800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:06:17.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.944+0000 7fa34a487800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:06:17.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.944+0000 7fa34a487800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.945+0000 7fa34a487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:17.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.945+0000 7fa34a487800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.945+0000 7fa34a487800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:17.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.945+0000 7fa34a487800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.945+0000 7fa34a487800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:06:17.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.945+0000 7fa34a487800 20 zone default found 2024-09-14T11:06:17.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.945+0000 7fa34a487800 4 Realm: () 2024-09-14T11:06:17.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.945+0000 7fa34a487800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:06:17.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.945+0000 7fa34a487800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:06:17.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.945+0000 7fa34a487800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:06:17.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.945+0000 7fa34a487800 20 zonegroup default 2024-09-14T11:06:17.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.945+0000 7fa34a487800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.945+0000 7fa34a487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:17.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.945+0000 7fa34a487800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.946+0000 7fa34a487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:17.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.946+0000 7fa34a487800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.946+0000 7fa34a487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:17.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.946+0000 7fa34a487800 20 started sync module instance, tier type = 2024-09-14T11:06:17.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.946+0000 7fa34a487800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:06:17.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.955+0000 7fa34a487800 20 add_watcher() i=0 2024-09-14T11:06:17.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.955+0000 7fa34a487800 20 add_watcher() i=1 2024-09-14T11:06:17.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.955+0000 7fa34a487800 20 add_watcher() i=2 2024-09-14T11:06:17.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.955+0000 7fa34a487800 20 add_watcher() i=3 2024-09-14T11:06:17.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.955+0000 7fa34a487800 20 add_watcher() i=4 2024-09-14T11:06:17.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.955+0000 7fa34a487800 20 add_watcher() i=5 2024-09-14T11:06:17.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.955+0000 7fa34a487800 20 add_watcher() i=6 2024-09-14T11:06:17.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.955+0000 7fa34a487800 20 add_watcher() i=7 2024-09-14T11:06:17.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.955+0000 7fa34a487800 2 all 8 watchers are set, enabling cache 2024-09-14T11:06:17.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.957+0000 7fa1fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:17.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.958+0000 7fa34a487800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:06:17.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.958+0000 7fa34a487800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:06:17.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.958+0000 7fa34a487800 5 note: GC not initialized 2024-09-14T11:06:17.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.958+0000 7fa1fcfe1640 20 reqs_thread_entry: start 2024-09-14T11:06:17.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.958+0000 7fa34a487800 20 init_complete bucket index max shards: 11 2024-09-14T11:06:17.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.958+0000 7fa34a487800 20 Filter name: none 2024-09-14T11:06:17.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.958+0000 7fa1767fc640 20 reqs_thread_entry: start 2024-09-14T11:06:17.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.958+0000 7fa34a487800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:06:17.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.958+0000 7fa34a487800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.958+0000 7fa34a487800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:06:17.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.958+0000 7fa34a487800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:06:17.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.958+0000 7fa34a487800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:06:17.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.958+0000 7fa34a487800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 : miss 2024-09-14T11:06:17.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.958+0000 7fa34a487800 20 rados->read ofs=0 len=0 2024-09-14T11:06:17.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.959+0000 7fa34a487800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:06:17.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.959+0000 7fa34a487800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 info.flags=0x17 2024-09-14T11:06:17.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.959+0000 7fa34a487800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 to cache LRU end 2024-09-14T11:06:17.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.959+0000 7fa34a487800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:06:17.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.959+0000 7fa34a487800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:17.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.959+0000 7fa34a487800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 2024-09-14T11:06:17.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.960+0000 7fa34a487800 0 INFO: RGWReshardLock::lock found lock on abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 to be held by another RGW process; skipping for now 2024-09-14T11:06:17.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.961+0000 7fa1fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:17.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.963+0000 7fa34a487800 20 remove_watcher() i=0 2024-09-14T11:06:17.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.963+0000 7fa34a487800 2 removed watcher, disabling cache 2024-09-14T11:06:17.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.964+0000 7fa34a487800 20 remove_watcher() i=1 2024-09-14T11:06:17.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.965+0000 7fa34a487800 20 remove_watcher() i=2 2024-09-14T11:06:17.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.966+0000 7fa34a487800 20 remove_watcher() i=3 2024-09-14T11:06:17.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.967+0000 7fa34a487800 20 remove_watcher() i=4 2024-09-14T11:06:17.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.968+0000 7fa34a487800 20 remove_watcher() i=5 2024-09-14T11:06:17.967 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.969+0000 7fa34a487800 20 remove_watcher() i=6 2024-09-14T11:06:17.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:17.970+0000 7fa34a487800 20 remove_watcher() i=7 2024-09-14T11:06:17.978 INFO:tasks.workunit.client.0.smithi097.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:06:48.000 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:06:48.035 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:06:48.035 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:06:48.077 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.078+0000 7f623a746800 20 rados->read ofs=0 len=0 2024-09-14T11:06:48.079 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.080+0000 7f623a746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:48.079 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.080+0000 7f623a746800 20 realm 2024-09-14T11:06:48.079 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.080+0000 7f623a746800 20 rados->read ofs=0 len=0 2024-09-14T11:06:48.079 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.080+0000 7f623a746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:48.079 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.080+0000 7f623a746800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:06:48.079 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.080+0000 7f623a746800 20 rados->read ofs=0 len=0 2024-09-14T11:06:48.079 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.080+0000 7f623a746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:48.079 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.080+0000 7f623a746800 20 rados->read ofs=0 len=0 2024-09-14T11:06:48.080 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.081+0000 7f623a746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:48.080 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.081+0000 7f623a746800 20 rados->read ofs=0 len=0 2024-09-14T11:06:48.081 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.082+0000 7f623a746800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:06:48.081 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.082+0000 7f623a746800 20 searching for the correct realm 2024-09-14T11:06:48.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.085+0000 7f6238a31640 0 -- 172.21.15.97:0/2867289272 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f6220045070 msgr2=0x7f6220053410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:48.290 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.291+0000 7f622fa2f640 0 -- 172.21.15.97:0/2867289272 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f622801f070 msgr2=0x7f62280015e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:48.296 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.297+0000 7f623a746800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:06:48.296 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.297+0000 7f623a746800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:06:48.296 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.297+0000 7f623a746800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:06:48.296 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.297+0000 7f623a746800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:06:48.296 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.297+0000 7f623a746800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:06:48.296 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.297+0000 7f623a746800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:06:48.297 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.297+0000 7f623a746800 20 rados->read ofs=0 len=0 2024-09-14T11:06:48.297 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.297+0000 7f623a746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:48.297 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.297+0000 7f623a746800 20 rados->read ofs=0 len=0 2024-09-14T11:06:48.298 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.298+0000 7f623a746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:48.298 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.298+0000 7f623a746800 20 rados->read ofs=0 len=0 2024-09-14T11:06:48.298 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.298+0000 7f623a746800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:06:48.298 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.298+0000 7f623a746800 20 zone default found 2024-09-14T11:06:48.298 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.298+0000 7f623a746800 4 Realm: () 2024-09-14T11:06:48.298 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.298+0000 7f623a746800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:06:48.298 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.298+0000 7f623a746800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:06:48.299 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.298+0000 7f623a746800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:06:48.299 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.298+0000 7f623a746800 20 zonegroup default 2024-09-14T11:06:48.299 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.298+0000 7f623a746800 20 rados->read ofs=0 len=0 2024-09-14T11:06:48.299 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.299+0000 7f623a746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:48.299 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.299+0000 7f623a746800 20 rados->read ofs=0 len=0 2024-09-14T11:06:48.299 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.299+0000 7f623a746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:48.299 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.299+0000 7f623a746800 20 rados->read ofs=0 len=0 2024-09-14T11:06:48.299 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.299+0000 7f623a746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:48.299 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.299+0000 7f623a746800 20 started sync module instance, tier type = 2024-09-14T11:06:48.299 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.299+0000 7f623a746800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:06:48.308 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.309+0000 7f623a746800 20 add_watcher() i=0 2024-09-14T11:06:48.308 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.309+0000 7f623a746800 20 add_watcher() i=1 2024-09-14T11:06:48.308 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.309+0000 7f623a746800 20 add_watcher() i=2 2024-09-14T11:06:48.308 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.309+0000 7f623a746800 20 add_watcher() i=3 2024-09-14T11:06:48.308 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.309+0000 7f623a746800 20 add_watcher() i=4 2024-09-14T11:06:48.308 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.309+0000 7f623a746800 20 add_watcher() i=5 2024-09-14T11:06:48.308 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.309+0000 7f623a746800 20 add_watcher() i=6 2024-09-14T11:06:48.309 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.310+0000 7f623a746800 20 add_watcher() i=7 2024-09-14T11:06:48.309 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.310+0000 7f623a746800 2 all 8 watchers are set, enabling cache 2024-09-14T11:06:48.310 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.312+0000 7f60eefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:48.311 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.312+0000 7f623a746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:06:48.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.312+0000 7f623a746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:06:48.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.312+0000 7f623a746800 5 note: GC not initialized 2024-09-14T11:06:48.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.313+0000 7f60edfdb640 20 reqs_thread_entry: start 2024-09-14T11:06:48.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.313+0000 7f623a746800 20 init_complete bucket index max shards: 11 2024-09-14T11:06:48.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.313+0000 7f623a746800 20 Filter name: none 2024-09-14T11:06:48.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.313+0000 7f605f7fe640 20 reqs_thread_entry: start 2024-09-14T11:06:48.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.313+0000 7f623a746800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:06:48.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.313+0000 7f623a746800 20 rados->read ofs=0 len=0 2024-09-14T11:06:48.313 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.313+0000 7f623a746800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:06:48.313 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.313+0000 7f623a746800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:06:48.313 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.313+0000 7f623a746800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:06:48.313 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.313+0000 7f623a746800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 : miss 2024-09-14T11:06:48.313 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.313+0000 7f623a746800 20 rados->read ofs=0 len=0 2024-09-14T11:06:48.313 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.314+0000 7f623a746800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:06:48.313 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.314+0000 7f623a746800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 info.flags=0x17 2024-09-14T11:06:48.313 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.314+0000 7f623a746800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 to cache LRU end 2024-09-14T11:06:48.314 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.314+0000 7f623a746800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:06:48.314 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.314+0000 7f623a746800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:48.314 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.314+0000 7f623a746800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 2024-09-14T11:06:48.314 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.315+0000 7f623a746800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:06:48.320 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.322+0000 7f623a746800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 info.flags=0x17 2024-09-14T11:06:48.321 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.322+0000 7f623a746800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 to cache LRU end 2024-09-14T11:06:48.321 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.322+0000 7f623a746800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:48.321 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.322+0000 7f623a746800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36, ofs0, ns] 2024-09-14T11:06:48.321 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.322+0000 7f610effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595099 cookie 94807354780592 notifier 7367 bl.length()=923 2024-09-14T11:06:48.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.322+0000 7f610effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 info.flags=0x17 2024-09-14T11:06:48.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.322+0000 7f610effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 to cache LRU end 2024-09-14T11:06:48.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.322+0000 7f610effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:48.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.323+0000 7f623a746800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36]): orig_sources= new_sources= 2024-09-14T11:06:48.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.323+0000 7f623a746800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36]): potential sources added=[] removed=[] 2024-09-14T11:06:48.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.323+0000 7f623a746800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36]): orig_dests= new_dests= 2024-09-14T11:06:48.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.323+0000 7f623a746800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36]): potential dests added=[] removed=[] 2024-09-14T11:06:48.326 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.327+0000 7f623a746800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36.2.0 2024-09-14T11:06:48.326 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.327+0000 7f623a746800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36.2.0 2024-09-14T11:06:48.326 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.327+0000 7f623a746800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36.2.1 2024-09-14T11:06:48.327 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.327+0000 7f623a746800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36.2.1 2024-09-14T11:06:48.327 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.327+0000 7f623a746800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36.2.2 2024-09-14T11:06:48.327 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.327+0000 7f623a746800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36.2.2 2024-09-14T11:06:48.327 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.327+0000 7f623a746800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36.2.3 2024-09-14T11:06:48.327 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.327+0000 7f623a746800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36.2.3 2024-09-14T11:06:48.327 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.327+0000 7f623a746800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36.2.4 2024-09-14T11:06:48.327 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.327+0000 7f623a746800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36.2.4 2024-09-14T11:06:48.327 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.327+0000 7f623a746800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36.2.5 2024-09-14T11:06:48.327 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.327+0000 7f623a746800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36.2.5 2024-09-14T11:06:48.327 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.327+0000 7f623a746800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36.2.6 2024-09-14T11:06:48.327 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.327+0000 7f623a746800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36.2.6 2024-09-14T11:06:48.327 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.327+0000 7f623a746800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36.2.7 2024-09-14T11:06:48.327 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.327+0000 7f623a746800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36.2.7 2024-09-14T11:06:48.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.327+0000 7f623a746800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36.2.8 2024-09-14T11:06:48.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.327+0000 7f623a746800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36.2.8 2024-09-14T11:06:48.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.327+0000 7f623a746800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36.2.9 2024-09-14T11:06:48.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.327+0000 7f623a746800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36.2.9 2024-09-14T11:06:48.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.327+0000 7f623a746800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36.2.10 2024-09-14T11:06:48.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.327+0000 7f623a746800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36.2.10 2024-09-14T11:06:48.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.327+0000 7f623a746800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36.2.11 2024-09-14T11:06:48.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.327+0000 7f623a746800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36.2.11 2024-09-14T11:06:48.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.327+0000 7f623a746800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36.0 2024-09-14T11:06:48.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.328+0000 7f623a746800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36.1 2024-09-14T11:06:48.329 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.328+0000 7f623a746800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36.2 2024-09-14T11:06:48.329 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.329+0000 7f623a746800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36.3 2024-09-14T11:06:48.329 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.329+0000 7f623a746800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36.4 2024-09-14T11:06:48.329 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.330+0000 7f623a746800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36.5 2024-09-14T11:06:48.329 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.330+0000 7f623a746800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36.6 2024-09-14T11:06:48.330 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.331+0000 7f623a746800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36.7 2024-09-14T11:06:48.330 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.331+0000 7f623a746800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36.8 2024-09-14T11:06:48.331 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.332+0000 7f623a746800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36.9 2024-09-14T11:06:48.331 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.332+0000 7f623a746800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36.10 2024-09-14T11:06:48.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.336+0000 7f623a746800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 : hit (requested=0x17, cached=0x17) 2024-09-14T11:06:48.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.336+0000 7f623a746800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 2024-09-14T11:06:48.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.337+0000 7f623a746800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 info.flags=0x17 2024-09-14T11:06:48.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.337+0000 7f623a746800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 to cache LRU end 2024-09-14T11:06:48.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.337+0000 7f623a746800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:48.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.337+0000 7f623a746800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36, ofs0, ns] 2024-09-14T11:06:48.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.338+0000 7f610effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595100 cookie 94807354780592 notifier 7367 bl.length()=923 2024-09-14T11:06:48.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.338+0000 7f610effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 info.flags=0x17 2024-09-14T11:06:48.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.338+0000 7f610effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 to cache LRU end 2024-09-14T11:06:48.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.338+0000 7f610effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:48.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.338+0000 7f623a746800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36]): orig_sources= new_sources= 2024-09-14T11:06:48.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.338+0000 7f623a746800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36]): potential sources added=[] removed=[] 2024-09-14T11:06:48.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.338+0000 7f623a746800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36]): orig_dests= new_dests= 2024-09-14T11:06:48.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.338+0000 7f623a746800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36]): potential dests added=[] removed=[] 2024-09-14T11:06:48.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.341+0000 7f623a746800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36.0 2024-09-14T11:06:48.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.341+0000 7f623a746800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36.1 2024-09-14T11:06:48.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.341+0000 7f623a746800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36.2 2024-09-14T11:06:48.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.342+0000 7f623a746800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36.3 2024-09-14T11:06:48.340 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.342+0000 7f623a746800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36.4 2024-09-14T11:06:48.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.342+0000 7f623a746800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36.5 2024-09-14T11:06:48.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.343+0000 7f623a746800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36.6 2024-09-14T11:06:48.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.343+0000 7f623a746800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36.7 2024-09-14T11:06:48.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.343+0000 7f623a746800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36.8 2024-09-14T11:06:48.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.344+0000 7f623a746800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36.9 2024-09-14T11:06:48.342 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.344+0000 7f623a746800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36.10 2024-09-14T11:06:48.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.344+0000 7f623a746800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 : hit (requested=0x17, cached=0x17) 2024-09-14T11:06:48.343 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.344+0000 7f623a746800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 2024-09-14T11:06:48.344 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.345+0000 7f623a746800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 info.flags=0x17 2024-09-14T11:06:48.344 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.345+0000 7f623a746800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 to cache LRU end 2024-09-14T11:06:48.344 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.345+0000 7f623a746800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:48.344 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.345+0000 7f623a746800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36, ofs0, ns] 2024-09-14T11:06:48.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.346+0000 7f610f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595101 cookie 94807354780592 notifier 7367 bl.length()=891 2024-09-14T11:06:48.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.346+0000 7f610f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 info.flags=0x17 2024-09-14T11:06:48.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.346+0000 7f610f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 to cache LRU end 2024-09-14T11:06:48.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.346+0000 7f610f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:48.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.347+0000 7f623a746800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36]): orig_sources= new_sources= 2024-09-14T11:06:48.346 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.347+0000 7f623a746800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36]): potential sources added=[] removed=[] 2024-09-14T11:06:48.346 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.347+0000 7f623a746800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36]): orig_dests= new_dests= 2024-09-14T11:06:48.346 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.347+0000 7f623a746800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36]): potential dests added=[] removed=[] 2024-09-14T11:06:48.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.349+0000 7f623a746800 1 execute INFO: reshard of bucket "abort-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-14T11:06:48.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.351+0000 7f60eefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:48.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.353+0000 7f623a746800 20 remove_watcher() i=0 2024-09-14T11:06:48.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.353+0000 7f623a746800 2 removed watcher, disabling cache 2024-09-14T11:06:48.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.354+0000 7f623a746800 20 remove_watcher() i=1 2024-09-14T11:06:48.354 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.355+0000 7f623a746800 20 remove_watcher() i=2 2024-09-14T11:06:48.355 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.356+0000 7f623a746800 20 remove_watcher() i=3 2024-09-14T11:06:48.356 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.357+0000 7f623a746800 20 remove_watcher() i=4 2024-09-14T11:06:48.357 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.358+0000 7f623a746800 20 remove_watcher() i=5 2024-09-14T11:06:48.358 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.359+0000 7f623a746800 20 remove_watcher() i=6 2024-09-14T11:06:48.359 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.361+0000 7f623a746800 20 remove_watcher() i=7 2024-09-14T11:06:48.371 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-14T11:06:48.400 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:06:48.400 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:06:48.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.440+0000 7fa07f814800 20 rados->read ofs=0 len=0 2024-09-14T11:06:48.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.442+0000 7fa07f814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:48.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.442+0000 7fa07f814800 20 realm 2024-09-14T11:06:48.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.442+0000 7fa07f814800 20 rados->read ofs=0 len=0 2024-09-14T11:06:48.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.442+0000 7fa07f814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:48.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.442+0000 7fa07f814800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:06:48.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.442+0000 7fa07f814800 20 rados->read ofs=0 len=0 2024-09-14T11:06:48.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.442+0000 7fa07f814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:48.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.442+0000 7fa07f814800 20 rados->read ofs=0 len=0 2024-09-14T11:06:48.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.443+0000 7fa07f814800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:48.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.443+0000 7fa07f814800 20 rados->read ofs=0 len=0 2024-09-14T11:06:48.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.444+0000 7fa07f814800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:06:48.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.444+0000 7fa07f814800 20 searching for the correct realm 2024-09-14T11:06:48.444 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.446+0000 7fa07b6cc640 0 -- 172.21.15.97:0/2071005419 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7fa0700a1030 msgr2=0x7fa07002b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:06:48.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.651+0000 7fa07a6ca640 0 -- 172.21.15.97:0/2071005419 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7fa06c08b400 msgr2=0x7fa06c08b880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:48.654 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.656+0000 7fa07f814800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:06:48.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.656+0000 7fa07f814800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:06:48.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.656+0000 7fa07f814800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:06:48.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.656+0000 7fa07f814800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:06:48.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.656+0000 7fa07f814800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:06:48.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.656+0000 7fa07f814800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:06:48.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.656+0000 7fa07f814800 20 rados->read ofs=0 len=0 2024-09-14T11:06:48.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.656+0000 7fa07f814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:48.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.656+0000 7fa07f814800 20 rados->read ofs=0 len=0 2024-09-14T11:06:48.656 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.656+0000 7fa07f814800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:48.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.656+0000 7fa07f814800 20 rados->read ofs=0 len=0 2024-09-14T11:06:48.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.657+0000 7fa07f814800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:06:48.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.657+0000 7fa07f814800 20 zone default found 2024-09-14T11:06:48.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.657+0000 7fa07f814800 4 Realm: () 2024-09-14T11:06:48.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.657+0000 7fa07f814800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:06:48.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.657+0000 7fa07f814800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:06:48.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.657+0000 7fa07f814800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:06:48.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.657+0000 7fa07f814800 20 zonegroup default 2024-09-14T11:06:48.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.657+0000 7fa07f814800 20 rados->read ofs=0 len=0 2024-09-14T11:06:48.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.657+0000 7fa07f814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:48.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.657+0000 7fa07f814800 20 rados->read ofs=0 len=0 2024-09-14T11:06:48.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.657+0000 7fa07f814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:48.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.657+0000 7fa07f814800 20 rados->read ofs=0 len=0 2024-09-14T11:06:48.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.657+0000 7fa07f814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:48.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.657+0000 7fa07f814800 20 started sync module instance, tier type = 2024-09-14T11:06:48.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.657+0000 7fa07f814800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:06:48.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.667+0000 7fa07f814800 20 add_watcher() i=0 2024-09-14T11:06:48.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.667+0000 7fa07f814800 20 add_watcher() i=1 2024-09-14T11:06:48.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.667+0000 7fa07f814800 20 add_watcher() i=2 2024-09-14T11:06:48.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.667+0000 7fa07f814800 20 add_watcher() i=3 2024-09-14T11:06:48.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.667+0000 7fa07f814800 20 add_watcher() i=4 2024-09-14T11:06:48.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.667+0000 7fa07f814800 20 add_watcher() i=5 2024-09-14T11:06:48.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.667+0000 7fa07f814800 20 add_watcher() i=6 2024-09-14T11:06:48.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.668+0000 7fa07f814800 20 add_watcher() i=7 2024-09-14T11:06:48.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.668+0000 7fa07f814800 2 all 8 watchers are set, enabling cache 2024-09-14T11:06:48.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.670+0000 7f9f317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:48.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.670+0000 7fa07f814800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:06:48.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.670+0000 7fa07f814800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:06:48.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.670+0000 7fa07f814800 5 note: GC not initialized 2024-09-14T11:06:48.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.671+0000 7f9eabfff640 20 reqs_thread_entry: start 2024-09-14T11:06:48.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.671+0000 7fa07f814800 20 init_complete bucket index max shards: 11 2024-09-14T11:06:48.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.671+0000 7fa07f814800 20 Filter name: none 2024-09-14T11:06:48.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.671+0000 7f9ea9ffb640 20 reqs_thread_entry: start 2024-09-14T11:06:48.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.671+0000 7fa07f814800 20 rados->read ofs=0 len=0 2024-09-14T11:06:48.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.671+0000 7fa07f814800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:06:48.670 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.671+0000 7fa07f814800 20 rados->read ofs=0 len=0 2024-09-14T11:06:48.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.672+0000 7fa07f814800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:06:48.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.672+0000 7fa07f814800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:06:48.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.672+0000 7fa07f814800 20 rados->read ofs=0 len=0 2024-09-14T11:06:48.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.672+0000 7fa07f814800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:06:48.671 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.672+0000 7fa07f814800 20 rados->read ofs=0 len=0 2024-09-14T11:06:48.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.672+0000 7fa07f814800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:06:48.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.672+0000 7fa07f814800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:06:48.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.674+0000 7f9f317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:48.675 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.677+0000 7fa07f814800 20 remove_watcher() i=0 2024-09-14T11:06:48.675 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.677+0000 7fa07f814800 2 removed watcher, disabling cache 2024-09-14T11:06:48.676 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.678+0000 7fa07f814800 20 remove_watcher() i=1 2024-09-14T11:06:48.677 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.679+0000 7fa07f814800 20 remove_watcher() i=2 2024-09-14T11:06:48.678 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.680+0000 7fa07f814800 20 remove_watcher() i=3 2024-09-14T11:06:48.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.681+0000 7fa07f814800 20 remove_watcher() i=4 2024-09-14T11:06:48.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.682+0000 7fa07f814800 20 remove_watcher() i=5 2024-09-14T11:06:48.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.683+0000 7fa07f814800 20 remove_watcher() i=6 2024-09-14T11:06:48.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:48.684+0000 7fa07f814800 20 remove_watcher() i=7 2024-09-14T11:06:48.693 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:48.693 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:06:48.693 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: abort-at-logrecord-writes id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:06:48.693 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:48.769 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: reshard bucket with EIO injected at change_reshard_state 2024-09-14T11:06:48.769 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:48.967 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:06:48.995 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:06:48.995 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:06:49.032 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.033+0000 7fe79e52c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:49.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.035+0000 7fe79e52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:49.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.035+0000 7fe79e52c800 20 realm 2024-09-14T11:06:49.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.035+0000 7fe79e52c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:49.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.035+0000 7fe79e52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:49.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.035+0000 7fe79e52c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:06:49.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.035+0000 7fe79e52c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:49.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.035+0000 7fe79e52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:49.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.035+0000 7fe79e52c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:49.036 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.036+0000 7fe79e52c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:49.036 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.036+0000 7fe79e52c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:49.036 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.037+0000 7fe79e52c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:06:49.037 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.037+0000 7fe79e52c800 20 searching for the correct realm 2024-09-14T11:06:49.038 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.039+0000 7fe79a93f640 0 -- 172.21.15.97:0/1448214829 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7fe79004c410 msgr2=0x7fe79004c870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:49.243 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.245+0000 7fe79993d640 0 -- 172.21.15.97:0/1448214829 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7fe78c0b8400 msgr2=0x7fe78c056a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:49.248 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.249+0000 7fe79e52c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:06:49.248 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.249+0000 7fe79e52c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:06:49.248 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.249+0000 7fe79e52c800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:06:49.249 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.249+0000 7fe79e52c800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:06:49.249 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.249+0000 7fe79e52c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:06:49.249 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.249+0000 7fe79e52c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:06:49.249 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.249+0000 7fe79e52c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:49.249 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.249+0000 7fe79e52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:49.249 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.249+0000 7fe79e52c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:49.249 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.249+0000 7fe79e52c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:49.249 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.249+0000 7fe79e52c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:49.250 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.250+0000 7fe79e52c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:06:49.250 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.250+0000 7fe79e52c800 20 zone default found 2024-09-14T11:06:49.250 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.250+0000 7fe79e52c800 4 Realm: () 2024-09-14T11:06:49.250 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.250+0000 7fe79e52c800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:06:49.250 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.250+0000 7fe79e52c800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:06:49.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.250+0000 7fe79e52c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:06:49.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.250+0000 7fe79e52c800 20 zonegroup default 2024-09-14T11:06:49.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.250+0000 7fe79e52c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:49.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.250+0000 7fe79e52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:49.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.250+0000 7fe79e52c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:49.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.251+0000 7fe79e52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:49.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.251+0000 7fe79e52c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:49.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.251+0000 7fe79e52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:49.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.251+0000 7fe79e52c800 20 started sync module instance, tier type = 2024-09-14T11:06:49.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.251+0000 7fe79e52c800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:06:49.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.259+0000 7fe79e52c800 20 add_watcher() i=0 2024-09-14T11:06:49.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.259+0000 7fe79e52c800 20 add_watcher() i=1 2024-09-14T11:06:49.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.259+0000 7fe79e52c800 20 add_watcher() i=2 2024-09-14T11:06:49.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.259+0000 7fe79e52c800 20 add_watcher() i=3 2024-09-14T11:06:49.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.259+0000 7fe79e52c800 20 add_watcher() i=4 2024-09-14T11:06:49.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.259+0000 7fe79e52c800 20 add_watcher() i=5 2024-09-14T11:06:49.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.259+0000 7fe79e52c800 20 add_watcher() i=6 2024-09-14T11:06:49.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.260+0000 7fe79e52c800 20 add_watcher() i=7 2024-09-14T11:06:49.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.260+0000 7fe79e52c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:06:49.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.262+0000 7fe650fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:49.261 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.262+0000 7fe79e52c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:06:49.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.262+0000 7fe79e52c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:06:49.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.262+0000 7fe79e52c800 5 note: GC not initialized 2024-09-14T11:06:49.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.263+0000 7fe5cb7fe640 20 reqs_thread_entry: start 2024-09-14T11:06:49.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.263+0000 7fe79e52c800 20 init_complete bucket index max shards: 11 2024-09-14T11:06:49.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.263+0000 7fe79e52c800 20 Filter name: none 2024-09-14T11:06:49.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.263+0000 7fe5c97fa640 20 reqs_thread_entry: start 2024-09-14T11:06:49.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.263+0000 7fe79e52c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:49.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.263+0000 7fe79e52c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:06:49.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.263+0000 7fe79e52c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:49.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.264+0000 7fe79e52c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:06:49.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.264+0000 7fe79e52c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:06:49.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.264+0000 7fe79e52c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:49.264 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.265+0000 7fe79e52c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:06:49.264 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.265+0000 7fe79e52c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:49.264 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.265+0000 7fe79e52c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:06:49.264 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.265+0000 7fe79e52c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:06:49.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.267+0000 7fe650fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:49.267 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.269+0000 7fe79e52c800 20 remove_watcher() i=0 2024-09-14T11:06:49.267 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.269+0000 7fe79e52c800 2 removed watcher, disabling cache 2024-09-14T11:06:49.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.270+0000 7fe79e52c800 20 remove_watcher() i=1 2024-09-14T11:06:49.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.271+0000 7fe79e52c800 20 remove_watcher() i=2 2024-09-14T11:06:49.271 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.272+0000 7fe79e52c800 20 remove_watcher() i=3 2024-09-14T11:06:49.272 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.273+0000 7fe79e52c800 20 remove_watcher() i=4 2024-09-14T11:06:49.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.274+0000 7fe79e52c800 20 remove_watcher() i=5 2024-09-14T11:06:49.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.275+0000 7fe79e52c800 20 remove_watcher() i=6 2024-09-14T11:06:49.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.276+0000 7fe79e52c800 20 remove_watcher() i=7 2024-09-14T11:06:49.285 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:49.285 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:06:49.285 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-change-reshard-state id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:06:49.285 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:49.286 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state 2024-09-14T11:06:49.320 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:06:49.321 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:06:49.357 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.359+0000 7ff76db2c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:49.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.360+0000 7ff76db2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:49.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.360+0000 7ff76db2c800 20 realm 2024-09-14T11:06:49.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.360+0000 7ff76db2c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:49.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.361+0000 7ff76db2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:49.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.361+0000 7ff76db2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:06:49.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.361+0000 7ff76db2c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:49.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.361+0000 7ff76db2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:49.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.361+0000 7ff76db2c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:49.361 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.361+0000 7ff76db2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:49.361 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.362+0000 7ff76db2c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:49.361 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.362+0000 7ff76db2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:06:49.361 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.362+0000 7ff76db2c800 20 searching for the correct realm 2024-09-14T11:06:49.363 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.364+0000 7ff769f62640 0 -- 172.21.15.97:0/400647747 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7ff754033060 msgr2=0x7ff754067170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:06:49.567 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.569+0000 7ff760f60640 0 -- 172.21.15.97:0/400647747 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7ff75c0dcb70 msgr2=0x7ff75c0c81b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:49.572 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.573+0000 7ff76db2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:06:49.572 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.573+0000 7ff76db2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:06:49.572 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.573+0000 7ff76db2c800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:06:49.573 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.573+0000 7ff76db2c800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:06:49.573 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.573+0000 7ff76db2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:06:49.573 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.573+0000 7ff76db2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:06:49.573 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.573+0000 7ff76db2c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:49.573 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.574+0000 7ff76db2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:49.573 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.574+0000 7ff76db2c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:49.573 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.574+0000 7ff76db2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:49.573 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.574+0000 7ff76db2c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:49.574 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.574+0000 7ff76db2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:06:49.574 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.574+0000 7ff76db2c800 20 zone default found 2024-09-14T11:06:49.574 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.574+0000 7ff76db2c800 4 Realm: () 2024-09-14T11:06:49.574 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.574+0000 7ff76db2c800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:06:49.575 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.574+0000 7ff76db2c800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:06:49.575 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.574+0000 7ff76db2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:06:49.575 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.574+0000 7ff76db2c800 20 zonegroup default 2024-09-14T11:06:49.575 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.574+0000 7ff76db2c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:49.575 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.574+0000 7ff76db2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:49.575 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.574+0000 7ff76db2c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:49.575 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.575+0000 7ff76db2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:49.575 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.575+0000 7ff76db2c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:49.575 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.575+0000 7ff76db2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:49.575 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.575+0000 7ff76db2c800 20 started sync module instance, tier type = 2024-09-14T11:06:49.575 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.575+0000 7ff76db2c800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:06:49.582 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.584+0000 7ff76db2c800 20 add_watcher() i=0 2024-09-14T11:06:49.583 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.584+0000 7ff76db2c800 20 add_watcher() i=1 2024-09-14T11:06:49.583 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.584+0000 7ff76db2c800 20 add_watcher() i=2 2024-09-14T11:06:49.583 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.584+0000 7ff76db2c800 20 add_watcher() i=3 2024-09-14T11:06:49.583 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.584+0000 7ff76db2c800 20 add_watcher() i=4 2024-09-14T11:06:49.583 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.584+0000 7ff76db2c800 20 add_watcher() i=5 2024-09-14T11:06:49.583 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.584+0000 7ff76db2c800 20 add_watcher() i=6 2024-09-14T11:06:49.583 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.585+0000 7ff76db2c800 20 add_watcher() i=7 2024-09-14T11:06:49.583 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.585+0000 7ff76db2c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:06:49.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.587+0000 7ff61ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:49.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.587+0000 7ff76db2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:06:49.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.587+0000 7ff76db2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:06:49.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.587+0000 7ff76db2c800 5 note: GC not initialized 2024-09-14T11:06:49.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.587+0000 7ff61efe5640 20 reqs_thread_entry: start 2024-09-14T11:06:49.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.587+0000 7ff76db2c800 20 init_complete bucket index max shards: 11 2024-09-14T11:06:49.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.587+0000 7ff76db2c800 20 Filter name: none 2024-09-14T11:06:49.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.588+0000 7ff61cfe1640 20 reqs_thread_entry: start 2024-09-14T11:06:49.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.588+0000 7ff76db2c800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-14T11:06:49.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.588+0000 7ff76db2c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:49.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.588+0000 7ff76db2c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:06:49.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.588+0000 7ff76db2c800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-14T11:06:49.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.588+0000 7ff76db2c800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-14T11:06:49.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.588+0000 7ff76db2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37 : miss 2024-09-14T11:06:49.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.588+0000 7ff76db2c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:49.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.589+0000 7ff76db2c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:06:49.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.589+0000 7ff76db2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37 info.flags=0x17 2024-09-14T11:06:49.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.589+0000 7ff76db2c800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37 to cache LRU end 2024-09-14T11:06:49.589 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.589+0000 7ff76db2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:06:49.589 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.589+0000 7ff76db2c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:49.589 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.589+0000 7ff76db2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37 2024-09-14T11:06:49.593 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.594+0000 7ff76db2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37 info.flags=0x17 2024-09-14T11:06:49.593 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.594+0000 7ff76db2c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37 to cache LRU end 2024-09-14T11:06:49.593 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.594+0000 7ff76db2c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:49.593 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.594+0000 7ff76db2c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37, ofs0, ns] 2024-09-14T11:06:49.593 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.594+0000 7ff63bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595229 cookie 94078527206352 notifier 7875 bl.length()=931 2024-09-14T11:06:49.593 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.594+0000 7ff63bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37 info.flags=0x17 2024-09-14T11:06:49.593 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.594+0000 7ff63bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37 to cache LRU end 2024-09-14T11:06:49.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.594+0000 7ff63bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:49.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.595+0000 7ff76db2c800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37]): orig_sources= new_sources= 2024-09-14T11:06:49.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.595+0000 7ff76db2c800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37]): potential sources added=[] removed=[] 2024-09-14T11:06:49.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.595+0000 7ff76db2c800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37]): orig_dests= new_dests= 2024-09-14T11:06:49.594 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.595+0000 7ff76db2c800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37]): potential dests added=[] removed=[] 2024-09-14T11:06:49.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.599+0000 7ff76db2c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.1.0 2024-09-14T11:06:49.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.599+0000 7ff76db2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.1.0 2024-09-14T11:06:49.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.599+0000 7ff76db2c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.1.1 2024-09-14T11:06:49.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.599+0000 7ff76db2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.1.1 2024-09-14T11:06:49.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.599+0000 7ff76db2c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.1.2 2024-09-14T11:06:49.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.599+0000 7ff76db2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.1.2 2024-09-14T11:06:49.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.599+0000 7ff76db2c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.1.3 2024-09-14T11:06:49.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.599+0000 7ff76db2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.1.3 2024-09-14T11:06:49.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.599+0000 7ff76db2c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.1.4 2024-09-14T11:06:49.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.599+0000 7ff76db2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.1.4 2024-09-14T11:06:49.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.599+0000 7ff76db2c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.1.5 2024-09-14T11:06:49.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.599+0000 7ff76db2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.1.5 2024-09-14T11:06:49.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.599+0000 7ff76db2c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.1.6 2024-09-14T11:06:49.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.599+0000 7ff76db2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.1.6 2024-09-14T11:06:49.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.599+0000 7ff76db2c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.1.7 2024-09-14T11:06:49.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.599+0000 7ff76db2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.1.7 2024-09-14T11:06:49.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.599+0000 7ff76db2c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.1.8 2024-09-14T11:06:49.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.599+0000 7ff76db2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.1.8 2024-09-14T11:06:49.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.599+0000 7ff76db2c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.1.9 2024-09-14T11:06:49.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.599+0000 7ff76db2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.1.9 2024-09-14T11:06:49.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.599+0000 7ff76db2c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.1.10 2024-09-14T11:06:49.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.599+0000 7ff76db2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.1.10 2024-09-14T11:06:49.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.599+0000 7ff76db2c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.1.11 2024-09-14T11:06:49.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.599+0000 7ff76db2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.1.11 2024-09-14T11:06:49.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.599+0000 7ff76db2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.0 2024-09-14T11:06:49.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.600+0000 7ff76db2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.1 2024-09-14T11:06:49.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.600+0000 7ff76db2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.2 2024-09-14T11:06:49.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.601+0000 7ff76db2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.3 2024-09-14T11:06:49.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.601+0000 7ff76db2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.4 2024-09-14T11:06:49.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.602+0000 7ff76db2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.5 2024-09-14T11:06:49.601 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.603+0000 7ff76db2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.6 2024-09-14T11:06:49.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.603+0000 7ff76db2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.7 2024-09-14T11:06:49.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.603+0000 7ff76db2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.8 2024-09-14T11:06:49.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.604+0000 7ff76db2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.9 2024-09-14T11:06:49.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.604+0000 7ff76db2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.10 2024-09-14T11:06:49.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.607+0000 7ff76db2c800 -1 Injecting error=-5 at location=change_reshard_state 2024-09-14T11:06:49.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.607+0000 7ff76db2c800 0 ERROR: change_reshard_state failed to commit target index layout: (5) Input/output error 2024-09-14T11:06:49.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.616+0000 7ff76db2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37 : hit (requested=0x17, cached=0x17) 2024-09-14T11:06:49.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.616+0000 7ff76db2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37 2024-09-14T11:06:49.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.617+0000 7ff76db2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37 info.flags=0x17 2024-09-14T11:06:49.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.617+0000 7ff76db2c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37 to cache LRU end 2024-09-14T11:06:49.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.617+0000 7ff76db2c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:49.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.617+0000 7ff76db2c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37, ofs0, ns] 2024-09-14T11:06:49.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.618+0000 7ff63bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595230 cookie 94078527206352 notifier 7875 bl.length()=899 2024-09-14T11:06:49.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.618+0000 7ff63bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37 info.flags=0x17 2024-09-14T11:06:49.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.618+0000 7ff63bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37 to cache LRU end 2024-09-14T11:06:49.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.618+0000 7ff63bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:49.618 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.618+0000 7ff76db2c800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37]): orig_sources= new_sources= 2024-09-14T11:06:49.618 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.618+0000 7ff76db2c800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37]): potential sources added=[] removed=[] 2024-09-14T11:06:49.618 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.618+0000 7ff76db2c800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37]): orig_dests= new_dests= 2024-09-14T11:06:49.618 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.618+0000 7ff76db2c800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37]): potential dests added=[] removed=[] 2024-09-14T11:06:49.618 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.618+0000 7ff76db2c800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" canceled due to errors 2024-09-14T11:06:49.618 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.620+0000 7ff61ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:49.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.622+0000 7ff76db2c800 20 remove_watcher() i=0 2024-09-14T11:06:49.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.622+0000 7ff76db2c800 2 removed watcher, disabling cache 2024-09-14T11:06:49.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.623+0000 7ff76db2c800 20 remove_watcher() i=1 2024-09-14T11:06:49.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.624+0000 7ff76db2c800 20 remove_watcher() i=2 2024-09-14T11:06:49.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.625+0000 7ff76db2c800 20 remove_watcher() i=3 2024-09-14T11:06:49.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.626+0000 7ff76db2c800 20 remove_watcher() i=4 2024-09-14T11:06:49.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.627+0000 7ff76db2c800 20 remove_watcher() i=5 2024-09-14T11:06:49.626 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.628+0000 7ff76db2c800 20 remove_watcher() i=6 2024-09-14T11:06:49.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.629+0000 7ff76db2c800 20 remove_watcher() i=7 2024-09-14T11:06:49.639 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:06:49.668 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:06:49.668 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:06:49.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.705+0000 7f171fcb9800 20 rados->read ofs=0 len=0 2024-09-14T11:06:49.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.708+0000 7f171fcb9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:49.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.708+0000 7f171fcb9800 20 realm 2024-09-14T11:06:49.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.708+0000 7f171fcb9800 20 rados->read ofs=0 len=0 2024-09-14T11:06:49.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.708+0000 7f171fcb9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:49.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.708+0000 7f171fcb9800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:06:49.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.708+0000 7f171fcb9800 20 rados->read ofs=0 len=0 2024-09-14T11:06:49.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.708+0000 7f171fcb9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:49.707 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.708+0000 7f171fcb9800 20 rados->read ofs=0 len=0 2024-09-14T11:06:49.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.709+0000 7f171fcb9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:49.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.709+0000 7f171fcb9800 20 rados->read ofs=0 len=0 2024-09-14T11:06:49.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.709+0000 7f171fcb9800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:06:49.708 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.709+0000 7f171fcb9800 20 searching for the correct realm 2024-09-14T11:06:49.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.712+0000 7f171dfa4640 0 -- 172.21.15.97:0/2990057910 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f170805e170 msgr2=0x7f1708093040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:49.916 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.917+0000 7f1714fa2640 0 -- 172.21.15.97:0/2990057910 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f1710070040 msgr2=0x7f171008e960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:49.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.922+0000 7f171fcb9800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:06:49.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.922+0000 7f171fcb9800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:06:49.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.922+0000 7f171fcb9800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:06:49.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.922+0000 7f171fcb9800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:06:49.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.922+0000 7f171fcb9800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:06:49.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.922+0000 7f171fcb9800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:06:49.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.922+0000 7f171fcb9800 20 rados->read ofs=0 len=0 2024-09-14T11:06:49.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.922+0000 7f171fcb9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:49.921 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.922+0000 7f171fcb9800 20 rados->read ofs=0 len=0 2024-09-14T11:06:49.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.923+0000 7f171fcb9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:49.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.923+0000 7f171fcb9800 20 rados->read ofs=0 len=0 2024-09-14T11:06:49.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.923+0000 7f171fcb9800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:06:49.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.923+0000 7f171fcb9800 20 zone default found 2024-09-14T11:06:49.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.923+0000 7f171fcb9800 4 Realm: () 2024-09-14T11:06:49.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.923+0000 7f171fcb9800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:06:49.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.923+0000 7f171fcb9800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:06:49.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.923+0000 7f171fcb9800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:06:49.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.923+0000 7f171fcb9800 20 zonegroup default 2024-09-14T11:06:49.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.923+0000 7f171fcb9800 20 rados->read ofs=0 len=0 2024-09-14T11:06:49.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.923+0000 7f171fcb9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:49.923 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.923+0000 7f171fcb9800 20 rados->read ofs=0 len=0 2024-09-14T11:06:49.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.924+0000 7f171fcb9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:49.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.924+0000 7f171fcb9800 20 rados->read ofs=0 len=0 2024-09-14T11:06:49.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.924+0000 7f171fcb9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:49.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.924+0000 7f171fcb9800 20 started sync module instance, tier type = 2024-09-14T11:06:49.924 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.924+0000 7f171fcb9800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:06:49.930 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.932+0000 7f171fcb9800 20 add_watcher() i=0 2024-09-14T11:06:49.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.932+0000 7f171fcb9800 20 add_watcher() i=1 2024-09-14T11:06:49.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.932+0000 7f171fcb9800 20 add_watcher() i=2 2024-09-14T11:06:49.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.932+0000 7f171fcb9800 20 add_watcher() i=3 2024-09-14T11:06:49.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.932+0000 7f171fcb9800 20 add_watcher() i=4 2024-09-14T11:06:49.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.932+0000 7f171fcb9800 20 add_watcher() i=5 2024-09-14T11:06:49.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.932+0000 7f171fcb9800 20 add_watcher() i=6 2024-09-14T11:06:49.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.933+0000 7f171fcb9800 20 add_watcher() i=7 2024-09-14T11:06:49.931 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.933+0000 7f171fcb9800 2 all 8 watchers are set, enabling cache 2024-09-14T11:06:49.933 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.935+0000 7f15d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:49.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.935+0000 7f171fcb9800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:06:49.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.935+0000 7f171fcb9800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:06:49.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.935+0000 7f171fcb9800 5 note: GC not initialized 2024-09-14T11:06:49.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.935+0000 7f15d27e4640 20 reqs_thread_entry: start 2024-09-14T11:06:49.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.935+0000 7f171fcb9800 20 init_complete bucket index max shards: 11 2024-09-14T11:06:49.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.936+0000 7f171fcb9800 20 Filter name: none 2024-09-14T11:06:49.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.936+0000 7f1543fff640 20 reqs_thread_entry: start 2024-09-14T11:06:49.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.936+0000 7f171fcb9800 20 rados->read ofs=0 len=0 2024-09-14T11:06:49.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.936+0000 7f171fcb9800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:06:49.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.936+0000 7f171fcb9800 20 rados->read ofs=0 len=0 2024-09-14T11:06:49.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.937+0000 7f171fcb9800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:06:49.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.937+0000 7f171fcb9800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:06:49.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.937+0000 7f171fcb9800 20 rados->read ofs=0 len=0 2024-09-14T11:06:49.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.937+0000 7f171fcb9800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:06:49.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.937+0000 7f171fcb9800 20 rados->read ofs=0 len=0 2024-09-14T11:06:49.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.937+0000 7f171fcb9800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:06:49.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.937+0000 7f171fcb9800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:06:49.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.939+0000 7f15d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:49.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.942+0000 7f171fcb9800 20 remove_watcher() i=0 2024-09-14T11:06:49.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.942+0000 7f171fcb9800 2 removed watcher, disabling cache 2024-09-14T11:06:49.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.943+0000 7f171fcb9800 20 remove_watcher() i=1 2024-09-14T11:06:49.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.943+0000 7f171fcb9800 20 remove_watcher() i=2 2024-09-14T11:06:49.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.944+0000 7f171fcb9800 20 remove_watcher() i=3 2024-09-14T11:06:49.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.945+0000 7f171fcb9800 20 remove_watcher() i=4 2024-09-14T11:06:49.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.946+0000 7f171fcb9800 20 remove_watcher() i=5 2024-09-14T11:06:49.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.947+0000 7f171fcb9800 20 remove_watcher() i=6 2024-09-14T11:06:49.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:49.948+0000 7f171fcb9800 20 remove_watcher() i=7 2024-09-14T11:06:49.957 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:49.957 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:06:49.957 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-change-reshard-state id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:06:49.957 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:50.008 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:06:50.039 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:06:50.039 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:06:50.076 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.077+0000 7f9e4c722800 20 rados->read ofs=0 len=0 2024-09-14T11:06:50.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.079+0000 7f9e4c722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:50.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.079+0000 7f9e4c722800 20 realm 2024-09-14T11:06:50.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.079+0000 7f9e4c722800 20 rados->read ofs=0 len=0 2024-09-14T11:06:50.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.079+0000 7f9e4c722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:50.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.079+0000 7f9e4c722800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:06:50.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.079+0000 7f9e4c722800 20 rados->read ofs=0 len=0 2024-09-14T11:06:50.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.079+0000 7f9e4c722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:50.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.079+0000 7f9e4c722800 20 rados->read ofs=0 len=0 2024-09-14T11:06:50.079 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.080+0000 7f9e4c722800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:50.079 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.080+0000 7f9e4c722800 20 rados->read ofs=0 len=0 2024-09-14T11:06:50.079 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.081+0000 7f9e4c722800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:06:50.080 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.081+0000 7f9e4c722800 20 searching for the correct realm 2024-09-14T11:06:50.082 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.083+0000 7f9e48baf640 0 -- 172.21.15.97:0/3408962421 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f9e30076070 msgr2=0x7f9e30084a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:50.085 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.086+0000 7f9e3fbad640 0 -- 172.21.15.97:0/3408962421 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f9e380c8ad0 msgr2=0x7f9e380c84a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:50.089 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.090+0000 7f9e4c722800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:06:50.089 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.090+0000 7f9e4c722800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:06:50.089 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.090+0000 7f9e4c722800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:06:50.089 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.090+0000 7f9e4c722800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:06:50.090 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.090+0000 7f9e4c722800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:06:50.090 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.090+0000 7f9e4c722800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:06:50.090 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.090+0000 7f9e4c722800 20 rados->read ofs=0 len=0 2024-09-14T11:06:50.090 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.091+0000 7f9e4c722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:50.090 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.091+0000 7f9e4c722800 20 rados->read ofs=0 len=0 2024-09-14T11:06:50.090 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.091+0000 7f9e4c722800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:50.090 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.091+0000 7f9e4c722800 20 rados->read ofs=0 len=0 2024-09-14T11:06:50.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.091+0000 7f9e4c722800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:06:50.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.091+0000 7f9e4c722800 20 zone default found 2024-09-14T11:06:50.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.091+0000 7f9e4c722800 4 Realm: () 2024-09-14T11:06:50.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.091+0000 7f9e4c722800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:06:50.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.091+0000 7f9e4c722800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:06:50.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.091+0000 7f9e4c722800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:06:50.091 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.091+0000 7f9e4c722800 20 zonegroup default 2024-09-14T11:06:50.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.091+0000 7f9e4c722800 20 rados->read ofs=0 len=0 2024-09-14T11:06:50.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.091+0000 7f9e4c722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:50.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.091+0000 7f9e4c722800 20 rados->read ofs=0 len=0 2024-09-14T11:06:50.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.092+0000 7f9e4c722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:50.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.092+0000 7f9e4c722800 20 rados->read ofs=0 len=0 2024-09-14T11:06:50.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.092+0000 7f9e4c722800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:50.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.092+0000 7f9e4c722800 20 started sync module instance, tier type = 2024-09-14T11:06:50.092 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.092+0000 7f9e4c722800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:06:50.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.100+0000 7f9e4c722800 20 add_watcher() i=0 2024-09-14T11:06:50.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.100+0000 7f9e4c722800 20 add_watcher() i=1 2024-09-14T11:06:50.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.100+0000 7f9e4c722800 20 add_watcher() i=2 2024-09-14T11:06:50.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.100+0000 7f9e4c722800 20 add_watcher() i=3 2024-09-14T11:06:50.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.100+0000 7f9e4c722800 20 add_watcher() i=4 2024-09-14T11:06:50.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.100+0000 7f9e4c722800 20 add_watcher() i=5 2024-09-14T11:06:50.099 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.100+0000 7f9e4c722800 20 add_watcher() i=6 2024-09-14T11:06:50.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.101+0000 7f9e4c722800 20 add_watcher() i=7 2024-09-14T11:06:50.100 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.101+0000 7f9e4c722800 2 all 8 watchers are set, enabling cache 2024-09-14T11:06:50.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.102+0000 7f9cfefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:50.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.103+0000 7f9e4c722800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:06:50.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.103+0000 7f9e4c722800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:06:50.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.103+0000 7f9e4c722800 5 note: GC not initialized 2024-09-14T11:06:50.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.103+0000 7f9cfdfdb640 20 reqs_thread_entry: start 2024-09-14T11:06:50.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.103+0000 7f9e4c722800 20 init_complete bucket index max shards: 11 2024-09-14T11:06:50.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.103+0000 7f9e4c722800 20 Filter name: none 2024-09-14T11:06:50.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.103+0000 7f9c6f7fe640 20 reqs_thread_entry: start 2024-09-14T11:06:50.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.103+0000 7f9e4c722800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-14T11:06:50.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.103+0000 7f9e4c722800 20 rados->read ofs=0 len=0 2024-09-14T11:06:50.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.104+0000 7f9e4c722800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:06:50.103 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.104+0000 7f9e4c722800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-14T11:06:50.104 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.104+0000 7f9e4c722800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-14T11:06:50.104 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.104+0000 7f9e4c722800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37 : miss 2024-09-14T11:06:50.104 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.104+0000 7f9e4c722800 20 rados->read ofs=0 len=0 2024-09-14T11:06:50.104 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.104+0000 7f9e4c722800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:06:50.104 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.104+0000 7f9e4c722800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37 info.flags=0x17 2024-09-14T11:06:50.104 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.104+0000 7f9e4c722800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37 to cache LRU end 2024-09-14T11:06:50.104 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.104+0000 7f9e4c722800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:06:50.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.104+0000 7f9e4c722800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:50.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.104+0000 7f9e4c722800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37 2024-09-14T11:06:50.107 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.109+0000 7f9e4c722800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37 info.flags=0x17 2024-09-14T11:06:50.107 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.109+0000 7f9e4c722800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37 to cache LRU end 2024-09-14T11:06:50.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.109+0000 7f9e4c722800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:50.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.109+0000 7f9e4c722800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37, ofs0, ns] 2024-09-14T11:06:50.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.109+0000 7f9d1f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595231 cookie 94083254274416 notifier 7451 bl.length()=931 2024-09-14T11:06:50.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.109+0000 7f9d1f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37 info.flags=0x17 2024-09-14T11:06:50.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.109+0000 7f9d1f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37 to cache LRU end 2024-09-14T11:06:50.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.109+0000 7f9d1f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:50.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.109+0000 7f9e4c722800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37]): orig_sources= new_sources= 2024-09-14T11:06:50.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.109+0000 7f9e4c722800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37]): potential sources added=[] removed=[] 2024-09-14T11:06:50.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.109+0000 7f9e4c722800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37]): orig_dests= new_dests= 2024-09-14T11:06:50.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.109+0000 7f9e4c722800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37]): potential dests added=[] removed=[] 2024-09-14T11:06:50.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.114+0000 7f9e4c722800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.1.0 2024-09-14T11:06:50.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.114+0000 7f9e4c722800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.1.0 2024-09-14T11:06:50.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.114+0000 7f9e4c722800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.1.1 2024-09-14T11:06:50.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.114+0000 7f9e4c722800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.1.1 2024-09-14T11:06:50.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.114+0000 7f9e4c722800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.1.2 2024-09-14T11:06:50.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.114+0000 7f9e4c722800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.1.2 2024-09-14T11:06:50.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.114+0000 7f9e4c722800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.1.3 2024-09-14T11:06:50.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.114+0000 7f9e4c722800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.1.3 2024-09-14T11:06:50.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.114+0000 7f9e4c722800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.1.4 2024-09-14T11:06:50.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.114+0000 7f9e4c722800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.1.4 2024-09-14T11:06:50.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.114+0000 7f9e4c722800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.1.5 2024-09-14T11:06:50.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.114+0000 7f9e4c722800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.1.5 2024-09-14T11:06:50.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.114+0000 7f9e4c722800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.1.6 2024-09-14T11:06:50.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.114+0000 7f9e4c722800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.1.6 2024-09-14T11:06:50.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.114+0000 7f9e4c722800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.1.7 2024-09-14T11:06:50.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.114+0000 7f9e4c722800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.1.7 2024-09-14T11:06:50.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.114+0000 7f9e4c722800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.1.8 2024-09-14T11:06:50.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.114+0000 7f9e4c722800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.1.8 2024-09-14T11:06:50.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.114+0000 7f9e4c722800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.1.9 2024-09-14T11:06:50.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.114+0000 7f9e4c722800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.1.9 2024-09-14T11:06:50.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.114+0000 7f9e4c722800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.1.10 2024-09-14T11:06:50.115 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.114+0000 7f9e4c722800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.1.10 2024-09-14T11:06:50.115 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.114+0000 7f9e4c722800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.1.11 2024-09-14T11:06:50.115 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.114+0000 7f9e4c722800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.1.11 2024-09-14T11:06:50.115 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.114+0000 7f9e4c722800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.0 2024-09-14T11:06:50.115 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.114+0000 7f9e4c722800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.1 2024-09-14T11:06:50.116 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.115+0000 7f9e4c722800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.2 2024-09-14T11:06:50.116 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.115+0000 7f9e4c722800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.3 2024-09-14T11:06:50.116 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.115+0000 7f9e4c722800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.4 2024-09-14T11:06:50.116 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.116+0000 7f9e4c722800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.5 2024-09-14T11:06:50.116 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.116+0000 7f9e4c722800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.6 2024-09-14T11:06:50.116 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.117+0000 7f9e4c722800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.7 2024-09-14T11:06:50.116 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.117+0000 7f9e4c722800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.8 2024-09-14T11:06:50.116 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.118+0000 7f9e4c722800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.9 2024-09-14T11:06:50.117 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.118+0000 7f9e4c722800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.10 2024-09-14T11:06:50.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.121+0000 7f9e4c722800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37 : hit (requested=0x17, cached=0x17) 2024-09-14T11:06:50.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.121+0000 7f9e4c722800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37 2024-09-14T11:06:50.120 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.122+0000 7f9e4c722800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37 info.flags=0x17 2024-09-14T11:06:50.120 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.122+0000 7f9e4c722800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37 to cache LRU end 2024-09-14T11:06:50.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.122+0000 7f9e4c722800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:50.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.122+0000 7f9e4c722800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37, ofs0, ns] 2024-09-14T11:06:50.122 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.122+0000 7f9d1f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595232 cookie 94083254274416 notifier 7451 bl.length()=931 2024-09-14T11:06:50.122 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.122+0000 7f9d1f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37 info.flags=0x17 2024-09-14T11:06:50.122 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.122+0000 7f9d1f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37 to cache LRU end 2024-09-14T11:06:50.122 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.122+0000 7f9d1f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:50.122 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.122+0000 7f9e4c722800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37]): orig_sources= new_sources= 2024-09-14T11:06:50.122 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.122+0000 7f9e4c722800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37]): potential sources added=[] removed=[] 2024-09-14T11:06:50.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.122+0000 7f9e4c722800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37]): orig_dests= new_dests= 2024-09-14T11:06:50.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.122+0000 7f9e4c722800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37]): potential dests added=[] removed=[] 2024-09-14T11:06:50.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.125+0000 7f9e4c722800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.0 2024-09-14T11:06:50.124 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.125+0000 7f9e4c722800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.1 2024-09-14T11:06:50.124 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.125+0000 7f9e4c722800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.2 2024-09-14T11:06:50.124 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.125+0000 7f9e4c722800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.3 2024-09-14T11:06:50.124 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.126+0000 7f9e4c722800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.4 2024-09-14T11:06:50.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.126+0000 7f9e4c722800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.5 2024-09-14T11:06:50.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.126+0000 7f9e4c722800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.6 2024-09-14T11:06:50.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.127+0000 7f9e4c722800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.7 2024-09-14T11:06:50.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.127+0000 7f9e4c722800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.8 2024-09-14T11:06:50.126 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.127+0000 7f9e4c722800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.9 2024-09-14T11:06:50.126 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.127+0000 7f9e4c722800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37.10 2024-09-14T11:06:50.126 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.128+0000 7f9e4c722800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37 : hit (requested=0x17, cached=0x17) 2024-09-14T11:06:50.127 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.128+0000 7f9e4c722800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37 2024-09-14T11:06:50.128 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.129+0000 7f9e4c722800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37 info.flags=0x17 2024-09-14T11:06:50.128 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.129+0000 7f9e4c722800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37 to cache LRU end 2024-09-14T11:06:50.128 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.129+0000 7f9e4c722800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:50.128 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.129+0000 7f9e4c722800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37, ofs0, ns] 2024-09-14T11:06:50.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.130+0000 7f9d1f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595233 cookie 94083254274416 notifier 7451 bl.length()=899 2024-09-14T11:06:50.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.130+0000 7f9d1f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37 info.flags=0x17 2024-09-14T11:06:50.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.130+0000 7f9d1f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37 to cache LRU end 2024-09-14T11:06:50.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.130+0000 7f9d1f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:50.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.130+0000 7f9e4c722800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37]): orig_sources= new_sources= 2024-09-14T11:06:50.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.130+0000 7f9e4c722800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37]): potential sources added=[] removed=[] 2024-09-14T11:06:50.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.130+0000 7f9e4c722800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37]): orig_dests= new_dests= 2024-09-14T11:06:50.129 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.130+0000 7f9e4c722800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37]): potential dests added=[] removed=[] 2024-09-14T11:06:50.131 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.132+0000 7f9e4c722800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-14T11:06:50.132 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.134+0000 7f9cfefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:50.134 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.136+0000 7f9e4c722800 20 remove_watcher() i=0 2024-09-14T11:06:50.134 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.136+0000 7f9e4c722800 2 removed watcher, disabling cache 2024-09-14T11:06:50.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.137+0000 7f9e4c722800 20 remove_watcher() i=1 2024-09-14T11:06:50.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.138+0000 7f9e4c722800 20 remove_watcher() i=2 2024-09-14T11:06:50.137 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.138+0000 7f9e4c722800 20 remove_watcher() i=3 2024-09-14T11:06:50.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.139+0000 7f9e4c722800 20 remove_watcher() i=4 2024-09-14T11:06:50.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.140+0000 7f9e4c722800 20 remove_watcher() i=5 2024-09-14T11:06:50.140 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.141+0000 7f9e4c722800 20 remove_watcher() i=6 2024-09-14T11:06:50.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.142+0000 7f9e4c722800 20 remove_watcher() i=7 2024-09-14T11:06:50.153 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:06:50.181 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:06:50.181 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:06:50.219 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.221+0000 7f5394128800 20 rados->read ofs=0 len=0 2024-09-14T11:06:50.221 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.222+0000 7f5394128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:50.221 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.222+0000 7f5394128800 20 realm 2024-09-14T11:06:50.222 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.222+0000 7f5394128800 20 rados->read ofs=0 len=0 2024-09-14T11:06:50.222 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.223+0000 7f5394128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:50.222 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.223+0000 7f5394128800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:06:50.222 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.223+0000 7f5394128800 20 rados->read ofs=0 len=0 2024-09-14T11:06:50.222 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.223+0000 7f5394128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:50.222 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.223+0000 7f5394128800 20 rados->read ofs=0 len=0 2024-09-14T11:06:50.223 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.223+0000 7f5394128800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:50.223 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.223+0000 7f5394128800 20 rados->read ofs=0 len=0 2024-09-14T11:06:50.223 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.224+0000 7f5394128800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:06:50.223 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.224+0000 7f5394128800 20 searching for the correct realm 2024-09-14T11:06:50.224 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.225+0000 7f538fe4b640 0 -- 172.21.15.97:0/911325117 >> [v2:172.21.15.152:6808/1010851305,v1:172.21.15.152:6809/1010851305] conn(0x562cb2e0c730 msgr2=0x562cb2e0ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:50.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.430+0000 7f538fe4b640 0 -- 172.21.15.97:0/911325117 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x562cb2dffee0 msgr2=0x562cb2e02350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:50.436 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.437+0000 7f5394128800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:06:50.436 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.437+0000 7f5394128800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:06:50.436 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.437+0000 7f5394128800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:06:50.436 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.437+0000 7f5394128800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:06:50.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.437+0000 7f5394128800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:06:50.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.437+0000 7f5394128800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:06:50.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.437+0000 7f5394128800 20 rados->read ofs=0 len=0 2024-09-14T11:06:50.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.438+0000 7f5394128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:50.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.438+0000 7f5394128800 20 rados->read ofs=0 len=0 2024-09-14T11:06:50.438 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.438+0000 7f5394128800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:50.438 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.438+0000 7f5394128800 20 rados->read ofs=0 len=0 2024-09-14T11:06:50.438 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.438+0000 7f5394128800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:06:50.438 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.438+0000 7f5394128800 20 zone default found 2024-09-14T11:06:50.438 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.438+0000 7f5394128800 4 Realm: () 2024-09-14T11:06:50.438 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.438+0000 7f5394128800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:06:50.438 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.438+0000 7f5394128800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:06:50.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.438+0000 7f5394128800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:06:50.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.438+0000 7f5394128800 20 zonegroup default 2024-09-14T11:06:50.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.438+0000 7f5394128800 20 rados->read ofs=0 len=0 2024-09-14T11:06:50.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.439+0000 7f5394128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:50.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.439+0000 7f5394128800 20 rados->read ofs=0 len=0 2024-09-14T11:06:50.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.439+0000 7f5394128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:50.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.439+0000 7f5394128800 20 rados->read ofs=0 len=0 2024-09-14T11:06:50.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.439+0000 7f5394128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:50.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.439+0000 7f5394128800 20 started sync module instance, tier type = 2024-09-14T11:06:50.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.439+0000 7f5394128800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:06:50.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.448+0000 7f5394128800 20 add_watcher() i=0 2024-09-14T11:06:50.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.448+0000 7f5394128800 20 add_watcher() i=1 2024-09-14T11:06:50.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.448+0000 7f5394128800 20 add_watcher() i=2 2024-09-14T11:06:50.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.448+0000 7f5394128800 20 add_watcher() i=3 2024-09-14T11:06:50.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.448+0000 7f5394128800 20 add_watcher() i=4 2024-09-14T11:06:50.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.448+0000 7f5394128800 20 add_watcher() i=5 2024-09-14T11:06:50.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.448+0000 7f5394128800 20 add_watcher() i=6 2024-09-14T11:06:50.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.448+0000 7f5394128800 20 add_watcher() i=7 2024-09-14T11:06:50.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.448+0000 7f5394128800 2 all 8 watchers are set, enabling cache 2024-09-14T11:06:50.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.450+0000 7f5241fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:50.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.450+0000 7f5394128800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:06:50.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.450+0000 7f5394128800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:06:50.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.450+0000 7f5394128800 5 note: GC not initialized 2024-09-14T11:06:50.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.451+0000 7f5240fe1640 20 reqs_thread_entry: start 2024-09-14T11:06:50.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.451+0000 7f5394128800 20 init_complete bucket index max shards: 11 2024-09-14T11:06:50.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.451+0000 7f5394128800 20 Filter name: none 2024-09-14T11:06:50.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.451+0000 7f51ba7fc640 20 reqs_thread_entry: start 2024-09-14T11:06:50.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.451+0000 7f5394128800 20 rados->read ofs=0 len=0 2024-09-14T11:06:50.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.451+0000 7f5394128800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:06:50.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.451+0000 7f5394128800 20 rados->read ofs=0 len=0 2024-09-14T11:06:50.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.452+0000 7f5394128800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:06:50.452 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.452+0000 7f5394128800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:06:50.452 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.452+0000 7f5394128800 20 rados->read ofs=0 len=0 2024-09-14T11:06:50.452 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.452+0000 7f5394128800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:06:50.452 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.452+0000 7f5394128800 20 rados->read ofs=0 len=0 2024-09-14T11:06:50.452 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.453+0000 7f5394128800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:06:50.452 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.453+0000 7f5394128800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:06:50.453 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.454+0000 7f5241fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:50.455 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.456+0000 7f5394128800 20 remove_watcher() i=0 2024-09-14T11:06:50.455 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.456+0000 7f5394128800 2 removed watcher, disabling cache 2024-09-14T11:06:50.456 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.457+0000 7f5394128800 20 remove_watcher() i=1 2024-09-14T11:06:50.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.459+0000 7f5394128800 20 remove_watcher() i=2 2024-09-14T11:06:50.458 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.460+0000 7f5394128800 20 remove_watcher() i=3 2024-09-14T11:06:50.459 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.461+0000 7f5394128800 20 remove_watcher() i=4 2024-09-14T11:06:50.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.461+0000 7f5394128800 20 remove_watcher() i=5 2024-09-14T11:06:50.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.462+0000 7f5394128800 20 remove_watcher() i=6 2024-09-14T11:06:50.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.463+0000 7f5394128800 20 remove_watcher() i=7 2024-09-14T11:06:50.472 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:50.473 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:06:50.473 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-change-reshard-state id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:06:50.473 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:50.547 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: reshard bucket with ECANCELED injected at change_reshard_state 2024-09-14T11:06:50.547 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:50.739 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:06:50.767 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:06:50.767 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:06:50.804 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.805+0000 7f48e9d3e800 20 rados->read ofs=0 len=0 2024-09-14T11:06:50.805 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.806+0000 7f48e9d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:50.805 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.806+0000 7f48e9d3e800 20 realm 2024-09-14T11:06:50.805 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.806+0000 7f48e9d3e800 20 rados->read ofs=0 len=0 2024-09-14T11:06:50.805 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.807+0000 7f48e9d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:50.805 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.807+0000 7f48e9d3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:06:50.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.807+0000 7f48e9d3e800 20 rados->read ofs=0 len=0 2024-09-14T11:06:50.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.807+0000 7f48e9d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:50.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.807+0000 7f48e9d3e800 20 rados->read ofs=0 len=0 2024-09-14T11:06:50.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.808+0000 7f48e9d3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:50.806 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.808+0000 7f48e9d3e800 20 rados->read ofs=0 len=0 2024-09-14T11:06:50.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.809+0000 7f48e9d3e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:06:50.807 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.809+0000 7f48e9d3e800 20 searching for the correct realm 2024-09-14T11:06:50.809 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.810+0000 7f48e5285640 0 -- 172.21.15.97:0/3290756881 >> [v2:172.21.15.97:6816/4093696477,v1:172.21.15.97:6817/4093696477] conn(0x55bfb1b38bd0 msgr2=0x55bfb1b3afc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:50.812 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:50.813+0000 7f48e5285640 0 -- 172.21.15.97:0/3290756881 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f48d80dfc20 msgr2=0x7f48d80afcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:51.019 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.020+0000 7f48e9d3e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:06:51.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.020+0000 7f48e9d3e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:06:51.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.020+0000 7f48e9d3e800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:06:51.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.020+0000 7f48e9d3e800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:06:51.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.020+0000 7f48e9d3e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:06:51.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.020+0000 7f48e9d3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:06:51.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.020+0000 7f48e9d3e800 20 rados->read ofs=0 len=0 2024-09-14T11:06:51.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.021+0000 7f48e9d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:51.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.021+0000 7f48e9d3e800 20 rados->read ofs=0 len=0 2024-09-14T11:06:51.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.021+0000 7f48e9d3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:51.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.021+0000 7f48e9d3e800 20 rados->read ofs=0 len=0 2024-09-14T11:06:51.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.021+0000 7f48e9d3e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:06:51.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.021+0000 7f48e9d3e800 20 zone default found 2024-09-14T11:06:51.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.021+0000 7f48e9d3e800 4 Realm: () 2024-09-14T11:06:51.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.021+0000 7f48e9d3e800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:06:51.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.021+0000 7f48e9d3e800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:06:51.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.021+0000 7f48e9d3e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:06:51.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.021+0000 7f48e9d3e800 20 zonegroup default 2024-09-14T11:06:51.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.021+0000 7f48e9d3e800 20 rados->read ofs=0 len=0 2024-09-14T11:06:51.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.022+0000 7f48e9d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:51.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.022+0000 7f48e9d3e800 20 rados->read ofs=0 len=0 2024-09-14T11:06:51.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.022+0000 7f48e9d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:51.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.022+0000 7f48e9d3e800 20 rados->read ofs=0 len=0 2024-09-14T11:06:51.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.022+0000 7f48e9d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:51.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.022+0000 7f48e9d3e800 20 started sync module instance, tier type = 2024-09-14T11:06:51.022 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.022+0000 7f48e9d3e800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:06:51.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.031+0000 7f48e9d3e800 20 add_watcher() i=0 2024-09-14T11:06:51.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.031+0000 7f48e9d3e800 20 add_watcher() i=1 2024-09-14T11:06:51.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.031+0000 7f48e9d3e800 20 add_watcher() i=2 2024-09-14T11:06:51.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.031+0000 7f48e9d3e800 20 add_watcher() i=3 2024-09-14T11:06:51.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.031+0000 7f48e9d3e800 20 add_watcher() i=4 2024-09-14T11:06:51.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.031+0000 7f48e9d3e800 20 add_watcher() i=5 2024-09-14T11:06:51.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.031+0000 7f48e9d3e800 20 add_watcher() i=6 2024-09-14T11:06:51.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.032+0000 7f48e9d3e800 20 add_watcher() i=7 2024-09-14T11:06:51.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.032+0000 7f48e9d3e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:06:51.033 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.034+0000 7f47977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:51.033 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.034+0000 7f48e9d3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:06:51.033 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.034+0000 7f48e9d3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:06:51.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.034+0000 7f48e9d3e800 5 note: GC not initialized 2024-09-14T11:06:51.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.034+0000 7f47967fc640 20 reqs_thread_entry: start 2024-09-14T11:06:51.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.035+0000 7f48e9d3e800 20 init_complete bucket index max shards: 11 2024-09-14T11:06:51.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.035+0000 7f48e9d3e800 20 Filter name: none 2024-09-14T11:06:51.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.035+0000 7f4707fff640 20 reqs_thread_entry: start 2024-09-14T11:06:51.034 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.035+0000 7f48e9d3e800 20 rados->read ofs=0 len=0 2024-09-14T11:06:51.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.035+0000 7f48e9d3e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:06:51.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.035+0000 7f48e9d3e800 20 rados->read ofs=0 len=0 2024-09-14T11:06:51.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.036+0000 7f48e9d3e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:06:51.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.036+0000 7f48e9d3e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:06:51.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.036+0000 7f48e9d3e800 20 rados->read ofs=0 len=0 2024-09-14T11:06:51.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.036+0000 7f48e9d3e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:06:51.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.036+0000 7f48e9d3e800 20 rados->read ofs=0 len=0 2024-09-14T11:06:51.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.036+0000 7f48e9d3e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:06:51.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.036+0000 7f48e9d3e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:06:51.037 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.038+0000 7f47977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:51.039 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.040+0000 7f48e9d3e800 20 remove_watcher() i=0 2024-09-14T11:06:51.039 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.040+0000 7f48e9d3e800 2 removed watcher, disabling cache 2024-09-14T11:06:51.040 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.041+0000 7f48e9d3e800 20 remove_watcher() i=1 2024-09-14T11:06:51.041 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.043+0000 7f48e9d3e800 20 remove_watcher() i=2 2024-09-14T11:06:51.042 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.044+0000 7f48e9d3e800 20 remove_watcher() i=3 2024-09-14T11:06:51.043 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.045+0000 7f48e9d3e800 20 remove_watcher() i=4 2024-09-14T11:06:51.044 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.046+0000 7f48e9d3e800 20 remove_watcher() i=5 2024-09-14T11:06:51.045 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.047+0000 7f48e9d3e800 20 remove_watcher() i=6 2024-09-14T11:06:51.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.048+0000 7f48e9d3e800 20 remove_watcher() i=7 2024-09-14T11:06:51.056 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:51.056 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:06:51.057 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-change-reshard-state id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:06:51.057 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:51.058 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state --inject-error-code 125 2024-09-14T11:06:51.094 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:06:51.094 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:06:51.133 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.135+0000 7f94a7b25800 20 rados->read ofs=0 len=0 2024-09-14T11:06:51.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.136+0000 7f94a7b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:51.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.136+0000 7f94a7b25800 20 realm 2024-09-14T11:06:51.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.136+0000 7f94a7b25800 20 rados->read ofs=0 len=0 2024-09-14T11:06:51.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.136+0000 7f94a7b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:51.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.136+0000 7f94a7b25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:06:51.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.136+0000 7f94a7b25800 20 rados->read ofs=0 len=0 2024-09-14T11:06:51.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.136+0000 7f94a7b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:51.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.136+0000 7f94a7b25800 20 rados->read ofs=0 len=0 2024-09-14T11:06:51.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.137+0000 7f94a7b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:51.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.137+0000 7f94a7b25800 20 rados->read ofs=0 len=0 2024-09-14T11:06:51.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.138+0000 7f94a7b25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:06:51.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.138+0000 7f94a7b25800 20 searching for the correct realm 2024-09-14T11:06:51.137 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.139+0000 7f94a3733640 0 -- 172.21.15.97:0/861915917 >> [v2:172.21.15.152:6808/1010851305,v1:172.21.15.152:6809/1010851305] conn(0x560bb9b1adf0 msgr2=0x560bb9b1d2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:51.140 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.142+0000 7f94a3733640 0 -- 172.21.15.97:0/861915917 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x560bb9b0e520 msgr2=0x560bb9b109a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:51.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.350+0000 7f94a7b25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:06:51.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.350+0000 7f94a7b25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:06:51.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.350+0000 7f94a7b25800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:06:51.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.350+0000 7f94a7b25800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:06:51.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.350+0000 7f94a7b25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:06:51.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.350+0000 7f94a7b25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:06:51.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.350+0000 7f94a7b25800 20 rados->read ofs=0 len=0 2024-09-14T11:06:51.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.350+0000 7f94a7b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:51.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.350+0000 7f94a7b25800 20 rados->read ofs=0 len=0 2024-09-14T11:06:51.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.351+0000 7f94a7b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:51.350 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.351+0000 7f94a7b25800 20 rados->read ofs=0 len=0 2024-09-14T11:06:51.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.351+0000 7f94a7b25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:06:51.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.351+0000 7f94a7b25800 20 zone default found 2024-09-14T11:06:51.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.351+0000 7f94a7b25800 4 Realm: () 2024-09-14T11:06:51.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.351+0000 7f94a7b25800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:06:51.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.351+0000 7f94a7b25800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:06:51.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.351+0000 7f94a7b25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:06:51.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.351+0000 7f94a7b25800 20 zonegroup default 2024-09-14T11:06:51.352 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.351+0000 7f94a7b25800 20 rados->read ofs=0 len=0 2024-09-14T11:06:51.352 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.351+0000 7f94a7b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:51.352 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.351+0000 7f94a7b25800 20 rados->read ofs=0 len=0 2024-09-14T11:06:51.352 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.352+0000 7f94a7b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:51.352 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.352+0000 7f94a7b25800 20 rados->read ofs=0 len=0 2024-09-14T11:06:51.352 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.352+0000 7f94a7b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:51.352 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.352+0000 7f94a7b25800 20 started sync module instance, tier type = 2024-09-14T11:06:51.352 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.352+0000 7f94a7b25800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:06:51.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.361+0000 7f94a7b25800 20 add_watcher() i=0 2024-09-14T11:06:51.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.361+0000 7f94a7b25800 20 add_watcher() i=1 2024-09-14T11:06:51.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.361+0000 7f94a7b25800 20 add_watcher() i=2 2024-09-14T11:06:51.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.361+0000 7f94a7b25800 20 add_watcher() i=3 2024-09-14T11:06:51.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.361+0000 7f94a7b25800 20 add_watcher() i=4 2024-09-14T11:06:51.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.361+0000 7f94a7b25800 20 add_watcher() i=5 2024-09-14T11:06:51.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.361+0000 7f94a7b25800 20 add_watcher() i=6 2024-09-14T11:06:51.361 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.362+0000 7f94a7b25800 20 add_watcher() i=7 2024-09-14T11:06:51.361 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.362+0000 7f94a7b25800 2 all 8 watchers are set, enabling cache 2024-09-14T11:06:51.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.364+0000 7f9359fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:51.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.364+0000 7f94a7b25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:06:51.363 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.364+0000 7f94a7b25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:06:51.363 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.364+0000 7f94a7b25800 5 note: GC not initialized 2024-09-14T11:06:51.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.364+0000 7f9358fe1640 20 reqs_thread_entry: start 2024-09-14T11:06:51.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.364+0000 7f94a7b25800 20 init_complete bucket index max shards: 11 2024-09-14T11:06:51.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.364+0000 7f94a7b25800 20 Filter name: none 2024-09-14T11:06:51.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.364+0000 7f92d27fc640 20 reqs_thread_entry: start 2024-09-14T11:06:51.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.365+0000 7f94a7b25800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-14T11:06:51.364 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.365+0000 7f94a7b25800 20 rados->read ofs=0 len=0 2024-09-14T11:06:51.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.365+0000 7f94a7b25800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:06:51.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.365+0000 7f94a7b25800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-14T11:06:51.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.365+0000 7f94a7b25800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-14T11:06:51.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.365+0000 7f94a7b25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38 : miss 2024-09-14T11:06:51.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.365+0000 7f94a7b25800 20 rados->read ofs=0 len=0 2024-09-14T11:06:51.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.365+0000 7f94a7b25800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:06:51.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.365+0000 7f94a7b25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38 info.flags=0x17 2024-09-14T11:06:51.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.365+0000 7f94a7b25800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38 to cache LRU end 2024-09-14T11:06:51.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.365+0000 7f94a7b25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:06:51.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.365+0000 7f94a7b25800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:51.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.365+0000 7f94a7b25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38 2024-09-14T11:06:51.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.370+0000 7f94a7b25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38 info.flags=0x17 2024-09-14T11:06:51.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.370+0000 7f94a7b25800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38 to cache LRU end 2024-09-14T11:06:51.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.370+0000 7f94a7b25800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:51.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.370+0000 7f94a7b25800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38, ofs0, ns] 2024-09-14T11:06:51.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.370+0000 7f9386ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595238 cookie 94608360065760 notifier 7499 bl.length()=931 2024-09-14T11:06:51.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.370+0000 7f9386ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38 info.flags=0x17 2024-09-14T11:06:51.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.370+0000 7f9386ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38 to cache LRU end 2024-09-14T11:06:51.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.370+0000 7f9386ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:51.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.371+0000 7f94a7b25800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38]): orig_sources= new_sources= 2024-09-14T11:06:51.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.371+0000 7f94a7b25800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38]): potential sources added=[] removed=[] 2024-09-14T11:06:51.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.371+0000 7f94a7b25800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38]): orig_dests= new_dests= 2024-09-14T11:06:51.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.371+0000 7f94a7b25800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38]): potential dests added=[] removed=[] 2024-09-14T11:06:51.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.375+0000 7f94a7b25800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38.1.0 2024-09-14T11:06:51.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.375+0000 7f94a7b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38.1.0 2024-09-14T11:06:51.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.375+0000 7f94a7b25800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38.1.1 2024-09-14T11:06:51.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.375+0000 7f94a7b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38.1.1 2024-09-14T11:06:51.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.375+0000 7f94a7b25800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38.1.2 2024-09-14T11:06:51.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.375+0000 7f94a7b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38.1.2 2024-09-14T11:06:51.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.375+0000 7f94a7b25800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38.1.3 2024-09-14T11:06:51.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.375+0000 7f94a7b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38.1.3 2024-09-14T11:06:51.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.375+0000 7f94a7b25800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38.1.4 2024-09-14T11:06:51.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.375+0000 7f94a7b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38.1.4 2024-09-14T11:06:51.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.375+0000 7f94a7b25800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38.1.5 2024-09-14T11:06:51.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.375+0000 7f94a7b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38.1.5 2024-09-14T11:06:51.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.375+0000 7f94a7b25800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38.1.6 2024-09-14T11:06:51.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.375+0000 7f94a7b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38.1.6 2024-09-14T11:06:51.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.375+0000 7f94a7b25800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38.1.7 2024-09-14T11:06:51.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.375+0000 7f94a7b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38.1.7 2024-09-14T11:06:51.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.375+0000 7f94a7b25800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38.1.8 2024-09-14T11:06:51.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.375+0000 7f94a7b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38.1.8 2024-09-14T11:06:51.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.375+0000 7f94a7b25800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38.1.9 2024-09-14T11:06:51.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.375+0000 7f94a7b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38.1.9 2024-09-14T11:06:51.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.375+0000 7f94a7b25800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38.1.10 2024-09-14T11:06:51.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.375+0000 7f94a7b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38.1.10 2024-09-14T11:06:51.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.375+0000 7f94a7b25800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38.1.11 2024-09-14T11:06:51.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.375+0000 7f94a7b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38.1.11 2024-09-14T11:06:51.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.375+0000 7f94a7b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38.0 2024-09-14T11:06:51.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.376+0000 7f94a7b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38.1 2024-09-14T11:06:51.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.376+0000 7f94a7b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38.2 2024-09-14T11:06:51.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.377+0000 7f94a7b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38.3 2024-09-14T11:06:51.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.377+0000 7f94a7b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38.4 2024-09-14T11:06:51.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.377+0000 7f94a7b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38.5 2024-09-14T11:06:51.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.378+0000 7f94a7b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38.6 2024-09-14T11:06:51.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.379+0000 7f94a7b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38.7 2024-09-14T11:06:51.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.379+0000 7f94a7b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38.8 2024-09-14T11:06:51.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.379+0000 7f94a7b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38.9 2024-09-14T11:06:51.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.380+0000 7f94a7b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38.10 2024-09-14T11:06:51.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.385+0000 7f94a7b25800 -1 Injecting error=-125 at location=change_reshard_state 2024-09-14T11:06:51.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.385+0000 7f94a7b25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38 : hit (requested=0x17, cached=0x17) 2024-09-14T11:06:51.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.385+0000 7f94a7b25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38 2024-09-14T11:06:51.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.386+0000 7f94a7b25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38 info.flags=0x17 2024-09-14T11:06:51.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.386+0000 7f94a7b25800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38 to cache LRU end 2024-09-14T11:06:51.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.386+0000 7f94a7b25800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:51.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.386+0000 7f94a7b25800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38, ofs0, ns] 2024-09-14T11:06:51.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.387+0000 7f9386ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595239 cookie 94608360065760 notifier 7499 bl.length()=931 2024-09-14T11:06:51.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.387+0000 7f9386ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38 info.flags=0x17 2024-09-14T11:06:51.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.387+0000 7f9386ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38 to cache LRU end 2024-09-14T11:06:51.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.387+0000 7f9386ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:51.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.387+0000 7f94a7b25800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38]): orig_sources= new_sources= 2024-09-14T11:06:51.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.387+0000 7f94a7b25800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38]): potential sources added=[] removed=[] 2024-09-14T11:06:51.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.387+0000 7f94a7b25800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38]): orig_dests= new_dests= 2024-09-14T11:06:51.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.387+0000 7f94a7b25800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38]): potential dests added=[] removed=[] 2024-09-14T11:06:51.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.389+0000 7f94a7b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38.0 2024-09-14T11:06:51.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.389+0000 7f94a7b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38.1 2024-09-14T11:06:51.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.390+0000 7f94a7b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38.2 2024-09-14T11:06:51.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.390+0000 7f94a7b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38.3 2024-09-14T11:06:51.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.390+0000 7f94a7b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38.4 2024-09-14T11:06:51.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.390+0000 7f94a7b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38.5 2024-09-14T11:06:51.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.391+0000 7f94a7b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38.6 2024-09-14T11:06:51.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.391+0000 7f94a7b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38.7 2024-09-14T11:06:51.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.391+0000 7f94a7b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38.8 2024-09-14T11:06:51.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.392+0000 7f94a7b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38.9 2024-09-14T11:06:51.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.392+0000 7f94a7b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38.10 2024-09-14T11:06:51.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.392+0000 7f94a7b25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38 : hit (requested=0x17, cached=0x17) 2024-09-14T11:06:51.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.392+0000 7f94a7b25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38 2024-09-14T11:06:51.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.393+0000 7f94a7b25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38 info.flags=0x17 2024-09-14T11:06:51.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.393+0000 7f94a7b25800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38 to cache LRU end 2024-09-14T11:06:51.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.393+0000 7f94a7b25800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:51.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.393+0000 7f94a7b25800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38, ofs0, ns] 2024-09-14T11:06:51.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.394+0000 7f93867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595240 cookie 94608360065760 notifier 7499 bl.length()=899 2024-09-14T11:06:51.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.394+0000 7f93867fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38 info.flags=0x17 2024-09-14T11:06:51.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.394+0000 7f93867fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38 to cache LRU end 2024-09-14T11:06:51.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.394+0000 7f93867fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:51.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.394+0000 7f94a7b25800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38]): orig_sources= new_sources= 2024-09-14T11:06:51.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.394+0000 7f94a7b25800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38]): potential sources added=[] removed=[] 2024-09-14T11:06:51.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.394+0000 7f94a7b25800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38]): orig_dests= new_dests= 2024-09-14T11:06:51.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.394+0000 7f94a7b25800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38]): potential dests added=[] removed=[] 2024-09-14T11:06:51.396 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.397+0000 7f94a7b25800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-14T11:06:51.397 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.399+0000 7f9359fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:51.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.401+0000 7f94a7b25800 20 remove_watcher() i=0 2024-09-14T11:06:51.400 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.401+0000 7f94a7b25800 2 removed watcher, disabling cache 2024-09-14T11:06:51.400 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.402+0000 7f94a7b25800 20 remove_watcher() i=1 2024-09-14T11:06:51.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.403+0000 7f94a7b25800 20 remove_watcher() i=2 2024-09-14T11:06:51.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.404+0000 7f94a7b25800 20 remove_watcher() i=3 2024-09-14T11:06:51.403 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.405+0000 7f94a7b25800 20 remove_watcher() i=4 2024-09-14T11:06:51.404 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.406+0000 7f94a7b25800 20 remove_watcher() i=5 2024-09-14T11:06:51.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.407+0000 7f94a7b25800 20 remove_watcher() i=6 2024-09-14T11:06:51.406 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.408+0000 7f94a7b25800 20 remove_watcher() i=7 2024-09-14T11:06:51.418 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:06:51.447 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:06:51.447 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:06:51.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.485+0000 7f9dba535800 20 rados->read ofs=0 len=0 2024-09-14T11:06:51.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.487+0000 7f9dba535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:51.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.487+0000 7f9dba535800 20 realm 2024-09-14T11:06:51.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.487+0000 7f9dba535800 20 rados->read ofs=0 len=0 2024-09-14T11:06:51.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.488+0000 7f9dba535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:51.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.488+0000 7f9dba535800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:06:51.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.488+0000 7f9dba535800 20 rados->read ofs=0 len=0 2024-09-14T11:06:51.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.488+0000 7f9dba535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:51.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.488+0000 7f9dba535800 20 rados->read ofs=0 len=0 2024-09-14T11:06:51.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.489+0000 7f9dba535800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:51.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.489+0000 7f9dba535800 20 rados->read ofs=0 len=0 2024-09-14T11:06:51.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.489+0000 7f9dba535800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:06:51.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.489+0000 7f9dba535800 20 searching for the correct realm 2024-09-14T11:06:51.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.491+0000 7f9db6a22640 0 -- 172.21.15.97:0/885070652 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f9da0053430 msgr2=0x7f9da00538b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:51.694 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.696+0000 7f9db5a20640 0 -- 172.21.15.97:0/885070652 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f9db00dd920 msgr2=0x7f9db00cbf80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:51.699 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.700+0000 7f9dba535800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:06:51.699 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.700+0000 7f9dba535800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:06:51.699 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.700+0000 7f9dba535800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:06:51.699 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.700+0000 7f9dba535800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:06:51.699 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.700+0000 7f9dba535800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:06:51.699 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.700+0000 7f9dba535800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:06:51.699 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.700+0000 7f9dba535800 20 rados->read ofs=0 len=0 2024-09-14T11:06:51.700 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.701+0000 7f9dba535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:51.700 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.701+0000 7f9dba535800 20 rados->read ofs=0 len=0 2024-09-14T11:06:51.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.701+0000 7f9dba535800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:51.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.701+0000 7f9dba535800 20 rados->read ofs=0 len=0 2024-09-14T11:06:51.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.701+0000 7f9dba535800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:06:51.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.701+0000 7f9dba535800 20 zone default found 2024-09-14T11:06:51.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.701+0000 7f9dba535800 4 Realm: () 2024-09-14T11:06:51.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.701+0000 7f9dba535800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:06:51.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.701+0000 7f9dba535800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:06:51.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.701+0000 7f9dba535800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:06:51.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.701+0000 7f9dba535800 20 zonegroup default 2024-09-14T11:06:51.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.701+0000 7f9dba535800 20 rados->read ofs=0 len=0 2024-09-14T11:06:51.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.701+0000 7f9dba535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:51.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.701+0000 7f9dba535800 20 rados->read ofs=0 len=0 2024-09-14T11:06:51.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.702+0000 7f9dba535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:51.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.702+0000 7f9dba535800 20 rados->read ofs=0 len=0 2024-09-14T11:06:51.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.702+0000 7f9dba535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:51.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.702+0000 7f9dba535800 20 started sync module instance, tier type = 2024-09-14T11:06:51.702 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.702+0000 7f9dba535800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:06:51.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.711+0000 7f9dba535800 20 add_watcher() i=0 2024-09-14T11:06:51.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.711+0000 7f9dba535800 20 add_watcher() i=1 2024-09-14T11:06:51.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.711+0000 7f9dba535800 20 add_watcher() i=2 2024-09-14T11:06:51.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.711+0000 7f9dba535800 20 add_watcher() i=3 2024-09-14T11:06:51.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.711+0000 7f9dba535800 20 add_watcher() i=4 2024-09-14T11:06:51.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.711+0000 7f9dba535800 20 add_watcher() i=5 2024-09-14T11:06:51.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.711+0000 7f9dba535800 20 add_watcher() i=6 2024-09-14T11:06:51.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.712+0000 7f9dba535800 20 add_watcher() i=7 2024-09-14T11:06:51.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.712+0000 7f9dba535800 2 all 8 watchers are set, enabling cache 2024-09-14T11:06:51.712 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.713+0000 7f9c6cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:51.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.713+0000 7f9dba535800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:06:51.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.713+0000 7f9dba535800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:06:51.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.713+0000 7f9dba535800 5 note: GC not initialized 2024-09-14T11:06:51.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.714+0000 7f9be77fe640 20 reqs_thread_entry: start 2024-09-14T11:06:51.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.714+0000 7f9dba535800 20 init_complete bucket index max shards: 11 2024-09-14T11:06:51.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.714+0000 7f9dba535800 20 Filter name: none 2024-09-14T11:06:51.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.714+0000 7f9be57fa640 20 reqs_thread_entry: start 2024-09-14T11:06:51.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.714+0000 7f9dba535800 20 rados->read ofs=0 len=0 2024-09-14T11:06:51.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.714+0000 7f9dba535800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:06:51.713 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.714+0000 7f9dba535800 20 rados->read ofs=0 len=0 2024-09-14T11:06:51.714 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.715+0000 7f9dba535800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:06:51.714 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.715+0000 7f9dba535800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:06:51.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.715+0000 7f9dba535800 20 rados->read ofs=0 len=0 2024-09-14T11:06:51.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.715+0000 7f9dba535800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:06:51.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.715+0000 7f9dba535800 20 rados->read ofs=0 len=0 2024-09-14T11:06:51.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.715+0000 7f9dba535800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:06:51.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.715+0000 7f9dba535800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:06:51.715 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.717+0000 7f9c6cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:51.718 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.719+0000 7f9dba535800 20 remove_watcher() i=0 2024-09-14T11:06:51.718 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.719+0000 7f9dba535800 2 removed watcher, disabling cache 2024-09-14T11:06:51.718 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.720+0000 7f9dba535800 20 remove_watcher() i=1 2024-09-14T11:06:51.719 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.721+0000 7f9dba535800 20 remove_watcher() i=2 2024-09-14T11:06:51.720 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.722+0000 7f9dba535800 20 remove_watcher() i=3 2024-09-14T11:06:51.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.723+0000 7f9dba535800 20 remove_watcher() i=4 2024-09-14T11:06:51.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.724+0000 7f9dba535800 20 remove_watcher() i=5 2024-09-14T11:06:51.723 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.725+0000 7f9dba535800 20 remove_watcher() i=6 2024-09-14T11:06:51.724 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:51.726+0000 7f9dba535800 20 remove_watcher() i=7 2024-09-14T11:06:51.734 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:51.735 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:06:51.735 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: error-at-change-reshard-state id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:06:51.735 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:51.816 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: reshard bucket with abort at change_reshard_state 2024-09-14T11:06:51.816 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:52.010 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-14T11:06:52.039 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:06:52.039 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:06:52.075 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.076+0000 7fdfebd35800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.077 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.078+0000 7fdfebd35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:52.077 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.078+0000 7fdfebd35800 20 realm 2024-09-14T11:06:52.077 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.078+0000 7fdfebd35800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.077 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.078+0000 7fdfebd35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:52.077 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.078+0000 7fdfebd35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:06:52.077 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.078+0000 7fdfebd35800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.077 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.078+0000 7fdfebd35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:52.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.078+0000 7fdfebd35800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.079+0000 7fdfebd35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:52.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.079+0000 7fdfebd35800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.080+0000 7fdfebd35800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:06:52.079 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.080+0000 7fdfebd35800 20 searching for the correct realm 2024-09-14T11:06:52.080 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.082+0000 7fdfe8222640 0 -- 172.21.15.97:0/2264693575 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7fdfdc07d040 msgr2=0x7fdfdc0676b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:52.286 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.287+0000 7fdfe7220640 0 -- 172.21.15.97:0/2264693575 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7fdfd808d400 msgr2=0x7fdfd808d860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:52.290 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.292+0000 7fdfebd35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:06:52.291 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.292+0000 7fdfebd35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:06:52.291 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.292+0000 7fdfebd35800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:06:52.291 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.292+0000 7fdfebd35800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:06:52.291 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.292+0000 7fdfebd35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:06:52.291 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.292+0000 7fdfebd35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:06:52.291 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.292+0000 7fdfebd35800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.291 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.292+0000 7fdfebd35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:52.291 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.292+0000 7fdfebd35800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.292 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.292+0000 7fdfebd35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:52.293 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.292+0000 7fdfebd35800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.293 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.293+0000 7fdfebd35800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:06:52.293 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.293+0000 7fdfebd35800 20 zone default found 2024-09-14T11:06:52.293 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.293+0000 7fdfebd35800 4 Realm: () 2024-09-14T11:06:52.293 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.293+0000 7fdfebd35800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:06:52.293 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.293+0000 7fdfebd35800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:06:52.293 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.293+0000 7fdfebd35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:06:52.293 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.293+0000 7fdfebd35800 20 zonegroup default 2024-09-14T11:06:52.293 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.293+0000 7fdfebd35800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.293 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.293+0000 7fdfebd35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:52.293 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.293+0000 7fdfebd35800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.294 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.293+0000 7fdfebd35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:52.294 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.293+0000 7fdfebd35800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.294 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.293+0000 7fdfebd35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:52.294 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.293+0000 7fdfebd35800 20 started sync module instance, tier type = 2024-09-14T11:06:52.294 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.293+0000 7fdfebd35800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:06:52.300 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.302+0000 7fdfebd35800 20 add_watcher() i=0 2024-09-14T11:06:52.301 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.302+0000 7fdfebd35800 20 add_watcher() i=1 2024-09-14T11:06:52.301 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.302+0000 7fdfebd35800 20 add_watcher() i=2 2024-09-14T11:06:52.301 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.302+0000 7fdfebd35800 20 add_watcher() i=3 2024-09-14T11:06:52.301 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.302+0000 7fdfebd35800 20 add_watcher() i=4 2024-09-14T11:06:52.301 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.302+0000 7fdfebd35800 20 add_watcher() i=5 2024-09-14T11:06:52.301 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.302+0000 7fdfebd35800 20 add_watcher() i=6 2024-09-14T11:06:52.301 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.303+0000 7fdfebd35800 20 add_watcher() i=7 2024-09-14T11:06:52.301 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.303+0000 7fdfebd35800 2 all 8 watchers are set, enabling cache 2024-09-14T11:06:52.303 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.304+0000 7fde9dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:52.303 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.304+0000 7fdfebd35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:06:52.304 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.304+0000 7fdfebd35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:06:52.304 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.305+0000 7fdfebd35800 5 note: GC not initialized 2024-09-14T11:06:52.304 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.305+0000 7fde9cfe1640 20 reqs_thread_entry: start 2024-09-14T11:06:52.304 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.305+0000 7fdfebd35800 20 init_complete bucket index max shards: 11 2024-09-14T11:06:52.304 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.305+0000 7fdfebd35800 20 Filter name: none 2024-09-14T11:06:52.304 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.305+0000 7fde167fc640 20 reqs_thread_entry: start 2024-09-14T11:06:52.304 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.305+0000 7fdfebd35800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.305 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.305+0000 7fdfebd35800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:06:52.305 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.305+0000 7fdfebd35800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.305 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.306+0000 7fdfebd35800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:06:52.305 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.306+0000 7fdfebd35800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:06:52.305 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.306+0000 7fdfebd35800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.305 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.306+0000 7fdfebd35800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:06:52.305 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.306+0000 7fdfebd35800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.306 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.307+0000 7fdfebd35800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:06:52.306 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.307+0000 7fdfebd35800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:06:52.307 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.308+0000 7fde9dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:52.309 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.310+0000 7fdfebd35800 20 remove_watcher() i=0 2024-09-14T11:06:52.309 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.310+0000 7fdfebd35800 2 removed watcher, disabling cache 2024-09-14T11:06:52.309 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.311+0000 7fdfebd35800 20 remove_watcher() i=1 2024-09-14T11:06:52.310 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.312+0000 7fdfebd35800 20 remove_watcher() i=2 2024-09-14T11:06:52.311 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.313+0000 7fdfebd35800 20 remove_watcher() i=3 2024-09-14T11:06:52.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.314+0000 7fdfebd35800 20 remove_watcher() i=4 2024-09-14T11:06:52.313 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.315+0000 7fdfebd35800 20 remove_watcher() i=5 2024-09-14T11:06:52.314 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.316+0000 7fdfebd35800 20 remove_watcher() i=6 2024-09-14T11:06:52.315 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.317+0000 7fdfebd35800 20 remove_watcher() i=7 2024-09-14T11:06:52.325 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:52.326 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:06:52.326 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: abort-at-change-reshard-state id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:06:52.326 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:52.327 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-14T11:06:52.361 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:06:52.361 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:06:52.398 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.399+0000 7f8f8630c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.400+0000 7f8f8630c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:52.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.400+0000 7f8f8630c800 20 realm 2024-09-14T11:06:52.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.400+0000 7f8f8630c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.400+0000 7f8f8630c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:52.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.400+0000 7f8f8630c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:06:52.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.400+0000 7f8f8630c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.401+0000 7f8f8630c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:52.400 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.401+0000 7f8f8630c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.400 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.401+0000 7f8f8630c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:52.400 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.401+0000 7f8f8630c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.402+0000 7f8f8630c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:06:52.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.402+0000 7f8f8630c800 20 searching for the correct realm 2024-09-14T11:06:52.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.404+0000 7f8f845fe640 0 -- 172.21.15.97:0/1685494170 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f8f6c063070 msgr2=0x7f8f6c089940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:06:52.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.609+0000 7f8f7b5fc640 0 -- 172.21.15.97:0/1685494170 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f8f74019670 msgr2=0x7f8f7407e4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:52.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.614+0000 7f8f8630c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:06:52.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.614+0000 7f8f8630c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:06:52.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.614+0000 7f8f8630c800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:06:52.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.614+0000 7f8f8630c800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:06:52.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.614+0000 7f8f8630c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:06:52.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.614+0000 7f8f8630c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:06:52.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.614+0000 7f8f8630c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.614+0000 7f8f8630c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:52.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.614+0000 7f8f8630c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.615+0000 7f8f8630c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:52.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.615+0000 7f8f8630c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.615+0000 7f8f8630c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:06:52.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.615+0000 7f8f8630c800 20 zone default found 2024-09-14T11:06:52.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.615+0000 7f8f8630c800 4 Realm: () 2024-09-14T11:06:52.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.615+0000 7f8f8630c800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:06:52.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.615+0000 7f8f8630c800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:06:52.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.615+0000 7f8f8630c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:06:52.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.615+0000 7f8f8630c800 20 zonegroup default 2024-09-14T11:06:52.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.615+0000 7f8f8630c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.615+0000 7f8f8630c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:52.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.615+0000 7f8f8630c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.616+0000 7f8f8630c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:52.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.616+0000 7f8f8630c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.616+0000 7f8f8630c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:52.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.616+0000 7f8f8630c800 20 started sync module instance, tier type = 2024-09-14T11:06:52.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.616+0000 7f8f8630c800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:06:52.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.625+0000 7f8f8630c800 20 add_watcher() i=0 2024-09-14T11:06:52.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.625+0000 7f8f8630c800 20 add_watcher() i=1 2024-09-14T11:06:52.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.625+0000 7f8f8630c800 20 add_watcher() i=2 2024-09-14T11:06:52.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.625+0000 7f8f8630c800 20 add_watcher() i=3 2024-09-14T11:06:52.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.625+0000 7f8f8630c800 20 add_watcher() i=4 2024-09-14T11:06:52.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.625+0000 7f8f8630c800 20 add_watcher() i=5 2024-09-14T11:06:52.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.625+0000 7f8f8630c800 20 add_watcher() i=6 2024-09-14T11:06:52.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.626+0000 7f8f8630c800 20 add_watcher() i=7 2024-09-14T11:06:52.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.626+0000 7f8f8630c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:06:52.626 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.628+0000 7f8e39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:52.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.628+0000 7f8f8630c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:06:52.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.628+0000 7f8f8630c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:06:52.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.628+0000 7f8f8630c800 5 note: GC not initialized 2024-09-14T11:06:52.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.628+0000 7f8e38fe1640 20 reqs_thread_entry: start 2024-09-14T11:06:52.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.628+0000 7f8f8630c800 20 init_complete bucket index max shards: 11 2024-09-14T11:06:52.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.628+0000 7f8f8630c800 20 Filter name: none 2024-09-14T11:06:52.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.628+0000 7f8db27fc640 20 reqs_thread_entry: start 2024-09-14T11:06:52.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.628+0000 7f8f8630c800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:06:52.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.628+0000 7f8f8630c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.629+0000 7f8f8630c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:06:52.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.629+0000 7f8f8630c800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:06:52.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.629+0000 7f8f8630c800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:06:52.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.629+0000 7f8f8630c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 : miss 2024-09-14T11:06:52.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.629+0000 7f8f8630c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.629+0000 7f8f8630c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:06:52.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.629+0000 7f8f8630c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 info.flags=0x17 2024-09-14T11:06:52.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.629+0000 7f8f8630c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 to cache LRU end 2024-09-14T11:06:52.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.629+0000 7f8f8630c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:06:52.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.629+0000 7f8f8630c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:52.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.629+0000 7f8f8630c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 2024-09-14T11:06:52.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.635+0000 7f8f8630c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 info.flags=0x17 2024-09-14T11:06:52.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.635+0000 7f8f8630c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 to cache LRU end 2024-09-14T11:06:52.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.635+0000 7f8f8630c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:52.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.635+0000 7f8f8630c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39, ofs0, ns] 2024-09-14T11:06:52.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.635+0000 7f8e627fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595104 cookie 94688869274624 notifier 7547 bl.length()=931 2024-09-14T11:06:52.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.635+0000 7f8e627fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 info.flags=0x17 2024-09-14T11:06:52.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.635+0000 7f8e627fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 to cache LRU end 2024-09-14T11:06:52.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.635+0000 7f8e627fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:52.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.636+0000 7f8f8630c800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39]): orig_sources= new_sources= 2024-09-14T11:06:52.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.636+0000 7f8f8630c800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39]): potential sources added=[] removed=[] 2024-09-14T11:06:52.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.636+0000 7f8f8630c800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39]): orig_dests= new_dests= 2024-09-14T11:06:52.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.636+0000 7f8f8630c800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39]): potential dests added=[] removed=[] 2024-09-14T11:06:52.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.641+0000 7f8f8630c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.0 2024-09-14T11:06:52.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.641+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.0 2024-09-14T11:06:52.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.641+0000 7f8f8630c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.1 2024-09-14T11:06:52.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.641+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.1 2024-09-14T11:06:52.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.641+0000 7f8f8630c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.2 2024-09-14T11:06:52.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.641+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.2 2024-09-14T11:06:52.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.641+0000 7f8f8630c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.3 2024-09-14T11:06:52.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.641+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.3 2024-09-14T11:06:52.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.641+0000 7f8f8630c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.4 2024-09-14T11:06:52.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.641+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.4 2024-09-14T11:06:52.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.641+0000 7f8f8630c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.5 2024-09-14T11:06:52.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.641+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.5 2024-09-14T11:06:52.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.641+0000 7f8f8630c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.6 2024-09-14T11:06:52.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.641+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.6 2024-09-14T11:06:52.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.641+0000 7f8f8630c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.7 2024-09-14T11:06:52.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.641+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.7 2024-09-14T11:06:52.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.641+0000 7f8f8630c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.8 2024-09-14T11:06:52.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.641+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.8 2024-09-14T11:06:52.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.641+0000 7f8f8630c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.9 2024-09-14T11:06:52.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.641+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.9 2024-09-14T11:06:52.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.641+0000 7f8f8630c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.10 2024-09-14T11:06:52.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.641+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.10 2024-09-14T11:06:52.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.641+0000 7f8f8630c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.11 2024-09-14T11:06:52.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.641+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.11 2024-09-14T11:06:52.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.641+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.0 2024-09-14T11:06:52.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.641+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1 2024-09-14T11:06:52.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.642+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.2 2024-09-14T11:06:52.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.642+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.3 2024-09-14T11:06:52.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.642+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.4 2024-09-14T11:06:52.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.643+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.5 2024-09-14T11:06:52.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.643+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.6 2024-09-14T11:06:52.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.644+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.7 2024-09-14T11:06:52.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.644+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.8 2024-09-14T11:06:52.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.644+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.9 2024-09-14T11:06:52.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.645+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.10 2024-09-14T11:06:52.648 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8f8630c800 time 2024-09-14T11:06:52.650806+0000 2024-09-14T11:06:52.648 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:06:52.649 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:06:52.649 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8f8978c76a] 2024-09-14T11:06:52.649 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f8f8978c928] 2024-09-14T11:06:52.649 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561e7798b0b1] 2024-09-14T11:06:52.649 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x561e7799a124] 2024-09-14T11:06:52.649 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x561e7799afc4] 2024-09-14T11:06:52.650 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-14T11:06:52.650 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f8f88429590] 2024-09-14T11:06:52.650 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-14T11:06:52.650 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-14T11:06:52.650 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.650+0000 7f8f8630c800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8f8630c800 time 2024-09-14T11:06:52.650806+0000 2024-09-14T11:06:52.651 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:06:52.651 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:52.651 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:06:52.651 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8f8978c76a] 2024-09-14T11:06:52.651 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f8f8978c928] 2024-09-14T11:06:52.651 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561e7798b0b1] 2024-09-14T11:06:52.652 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x561e7799a124] 2024-09-14T11:06:52.652 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x561e7799afc4] 2024-09-14T11:06:52.652 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-14T11:06:52.652 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f8f88429590] 2024-09-14T11:06:52.652 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-14T11:06:52.652 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-14T11:06:52.652 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:52.652 INFO:tasks.workunit.client.0.smithi097.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:06:52.652 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f8f8630c800 thread_name:radosgw-admin 2024-09-14T11:06:52.668 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:06:52.668 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8f8843e6f0] 2024-09-14T11:06:52.668 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f8f8848b99c] 2024-09-14T11:06:52.668 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-14T11:06:52.668 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-14T11:06:52.668 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8f8978c7c4] 2024-09-14T11:06:52.668 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f8f8978c928] 2024-09-14T11:06:52.668 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561e7798b0b1] 2024-09-14T11:06:52.668 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x561e7799a124] 2024-09-14T11:06:52.669 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x561e7799afc4] 2024-09-14T11:06:52.669 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-14T11:06:52.669 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f8f88429590] 2024-09-14T11:06:52.669 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-14T11:06:52.669 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-14T11:06:52.669 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.651+0000 7f8f8630c800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:06:52.669 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f8f8630c800 thread_name:radosgw-admin 2024-09-14T11:06:52.669 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:52.669 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:06:52.669 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8f8843e6f0] 2024-09-14T11:06:52.669 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f8f8848b99c] 2024-09-14T11:06:52.669 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-14T11:06:52.669 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-14T11:06:52.670 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8f8978c7c4] 2024-09-14T11:06:52.670 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f8f8978c928] 2024-09-14T11:06:52.670 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561e7798b0b1] 2024-09-14T11:06:52.670 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x561e7799a124] 2024-09-14T11:06:52.670 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x561e7799afc4] 2024-09-14T11:06:52.670 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-14T11:06:52.670 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f8f88429590] 2024-09-14T11:06:52.670 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-14T11:06:52.670 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-14T11:06:52.670 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:06:52.670 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:52.670 INFO:tasks.workunit.client.0.smithi097.stderr:--- begin dump of recent events --- 2024-09-14T11:06:52.670 INFO:tasks.workunit.client.0.smithi097.stderr: -499> 2024-09-14T11:06:52.383+0000 7f8f8630c800 5 AuthRegistry(0x561e785ad1b0) adding con mode: crc 2024-09-14T11:06:52.670 INFO:tasks.workunit.client.0.smithi097.stderr: -498> 2024-09-14T11:06:52.383+0000 7f8f8630c800 5 AuthRegistry(0x561e785ad1b0) adding con mode: secure 2024-09-14T11:06:52.670 INFO:tasks.workunit.client.0.smithi097.stderr: -497> 2024-09-14T11:06:52.383+0000 7f8f8630c800 5 AuthRegistry(0x561e785ad1b0) adding con mode: crc 2024-09-14T11:06:52.671 INFO:tasks.workunit.client.0.smithi097.stderr: -496> 2024-09-14T11:06:52.383+0000 7f8f8630c800 5 AuthRegistry(0x561e785ad1b0) adding con mode: crc 2024-09-14T11:06:52.671 INFO:tasks.workunit.client.0.smithi097.stderr: -495> 2024-09-14T11:06:52.383+0000 7f8f8630c800 5 AuthRegistry(0x561e785ad1b0) adding con mode: secure 2024-09-14T11:06:52.671 INFO:tasks.workunit.client.0.smithi097.stderr: -494> 2024-09-14T11:06:52.383+0000 7f8f8630c800 5 AuthRegistry(0x561e785ad1b0) adding con mode: crc 2024-09-14T11:06:52.671 INFO:tasks.workunit.client.0.smithi097.stderr: -493> 2024-09-14T11:06:52.383+0000 7f8f8630c800 5 AuthRegistry(0x561e785ad1b0) adding con mode: secure 2024-09-14T11:06:52.671 INFO:tasks.workunit.client.0.smithi097.stderr: -492> 2024-09-14T11:06:52.383+0000 7f8f8630c800 5 AuthRegistry(0x561e785ad1b0) adding con mode: crc 2024-09-14T11:06:52.671 INFO:tasks.workunit.client.0.smithi097.stderr: -491> 2024-09-14T11:06:52.383+0000 7f8f8630c800 5 AuthRegistry(0x561e785ad1b0) adding con mode: secure 2024-09-14T11:06:52.671 INFO:tasks.workunit.client.0.smithi097.stderr: -490> 2024-09-14T11:06:52.384+0000 7f8f8630c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:06:52.671 INFO:tasks.workunit.client.0.smithi097.stderr: -489> 2024-09-14T11:06:52.384+0000 7f8f8630c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:06:52.671 INFO:tasks.workunit.client.0.smithi097.stderr: -488> 2024-09-14T11:06:52.384+0000 7f8f8630c800 5 asok(0x561e7838e270) register_command rotate-key hook 0x561e785ad2f8 2024-09-14T11:06:52.671 INFO:tasks.workunit.client.0.smithi097.stderr: -487> 2024-09-14T11:06:52.384+0000 7f8f8630c800 10 monclient: _reopen_session rank -1 2024-09-14T11:06:52.671 INFO:tasks.workunit.client.0.smithi097.stderr: -486> 2024-09-14T11:06:52.384+0000 7f8f8630c800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:06:52.671 INFO:tasks.workunit.client.0.smithi097.stderr: -485> 2024-09-14T11:06:52.384+0000 7f8f8630c800 10 monclient(hunting): picked mon.noname-a con 0x561e78459760 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:06:52.671 INFO:tasks.workunit.client.0.smithi097.stderr: -484> 2024-09-14T11:06:52.384+0000 7f8f8630c800 10 monclient(hunting): picked mon.noname-b con 0x561e78459b40 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:06:52.671 INFO:tasks.workunit.client.0.smithi097.stderr: -483> 2024-09-14T11:06:52.384+0000 7f8f8630c800 10 monclient(hunting): picked mon.noname-c con 0x561e784f3550 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:06:52.671 INFO:tasks.workunit.client.0.smithi097.stderr: -482> 2024-09-14T11:06:52.384+0000 7f8f8630c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:52.672 INFO:tasks.workunit.client.0.smithi097.stderr: -481> 2024-09-14T11:06:52.384+0000 7f8f8630c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:52.672 INFO:tasks.workunit.client.0.smithi097.stderr: -480> 2024-09-14T11:06:52.384+0000 7f8f8630c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:52.672 INFO:tasks.workunit.client.0.smithi097.stderr: -479> 2024-09-14T11:06:52.384+0000 7f8f8630c800 10 monclient(hunting): _renew_subs 2024-09-14T11:06:52.672 INFO:tasks.workunit.client.0.smithi097.stderr: -478> 2024-09-14T11:06:52.384+0000 7f8f8630c800 10 monclient(hunting): authenticate will time out at 2094.037338s 2024-09-14T11:06:52.672 INFO:tasks.workunit.client.0.smithi097.stderr: -477> 2024-09-14T11:06:52.384+0000 7f8f83dfd640 10 monclient(hunting): get_auth_request con 0x561e78459760 auth_method 0 2024-09-14T11:06:52.672 INFO:tasks.workunit.client.0.smithi097.stderr: -476> 2024-09-14T11:06:52.384+0000 7f8f83dfd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:06:52.672 INFO:tasks.workunit.client.0.smithi097.stderr: -475> 2024-09-14T11:06:52.384+0000 7f8f83dfd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:06:52.672 INFO:tasks.workunit.client.0.smithi097.stderr: -474> 2024-09-14T11:06:52.384+0000 7f8f83dfd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:06:52.672 INFO:tasks.workunit.client.0.smithi097.stderr: -473> 2024-09-14T11:06:52.384+0000 7f8f845fe640 10 monclient(hunting): get_auth_request con 0x561e784f3550 auth_method 0 2024-09-14T11:06:52.672 INFO:tasks.workunit.client.0.smithi097.stderr: -472> 2024-09-14T11:06:52.384+0000 7f8f845fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:06:52.672 INFO:tasks.workunit.client.0.smithi097.stderr: -471> 2024-09-14T11:06:52.384+0000 7f8f845fe640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:06:52.672 INFO:tasks.workunit.client.0.smithi097.stderr: -470> 2024-09-14T11:06:52.384+0000 7f8f845fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:06:52.672 INFO:tasks.workunit.client.0.smithi097.stderr: -469> 2024-09-14T11:06:52.384+0000 7f8f83dfd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:06:52.672 INFO:tasks.workunit.client.0.smithi097.stderr: -468> 2024-09-14T11:06:52.384+0000 7f8f83dfd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:06:52.673 INFO:tasks.workunit.client.0.smithi097.stderr: -467> 2024-09-14T11:06:52.384+0000 7f8f83dfd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:06:52.673 INFO:tasks.workunit.client.0.smithi097.stderr: -466> 2024-09-14T11:06:52.384+0000 7f8f845fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:06:52.673 INFO:tasks.workunit.client.0.smithi097.stderr: -465> 2024-09-14T11:06:52.384+0000 7f8f845fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:06:52.673 INFO:tasks.workunit.client.0.smithi097.stderr: -464> 2024-09-14T11:06:52.384+0000 7f8f845fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:06:52.673 INFO:tasks.workunit.client.0.smithi097.stderr: -463> 2024-09-14T11:06:52.384+0000 7f8f83dfd640 10 monclient(hunting): handle_auth_done global_id 8019 payload 824 2024-09-14T11:06:52.673 INFO:tasks.workunit.client.0.smithi097.stderr: -462> 2024-09-14T11:06:52.384+0000 7f8f83dfd640 10 monclient: _finish_hunting 0 2024-09-14T11:06:52.673 INFO:tasks.workunit.client.0.smithi097.stderr: -461> 2024-09-14T11:06:52.384+0000 7f8f83dfd640 1 monclient: found mon.noname-a 2024-09-14T11:06:52.673 INFO:tasks.workunit.client.0.smithi097.stderr: -460> 2024-09-14T11:06:52.384+0000 7f8f83dfd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-14T11:06:52.673 INFO:tasks.workunit.client.0.smithi097.stderr: -459> 2024-09-14T11:06:52.384+0000 7f8e6bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:06:52.673 INFO:tasks.workunit.client.0.smithi097.stderr: -458> 2024-09-14T11:06:52.384+0000 7f8e6bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:06:52.673 INFO:tasks.workunit.client.0.smithi097.stderr: -457> 2024-09-14T11:06:52.384+0000 7f8e6bfff640 10 monclient: dump: 2024-09-14T11:06:52.674 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:06:52.674 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:06:52.674 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:52.674 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:52.674 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:06:52.674 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:06:52.674 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:06:52.674 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:06:52.674 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:06:52.674 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:52.674 INFO:tasks.workunit.client.0.smithi097.stderr: -456> 2024-09-14T11:06:52.384+0000 7f8e6bfff640 10 monclient: _finish_auth 0 2024-09-14T11:06:52.674 INFO:tasks.workunit.client.0.smithi097.stderr: -455> 2024-09-14T11:06:52.384+0000 7f8e6bfff640 10 monclient: _check_auth_tickets 2024-09-14T11:06:52.674 INFO:tasks.workunit.client.0.smithi097.stderr: -454> 2024-09-14T11:06:52.384+0000 7f8f8630c800 5 monclient: authenticate success, global_id 8019 2024-09-14T11:06:52.674 INFO:tasks.workunit.client.0.smithi097.stderr: -453> 2024-09-14T11:06:52.384+0000 7f8e6bfff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:06:52.675 INFO:tasks.workunit.client.0.smithi097.stderr: -452> 2024-09-14T11:06:52.384+0000 7f8e6bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:06:52.675 INFO:tasks.workunit.client.0.smithi097.stderr: -451> 2024-09-14T11:06:52.384+0000 7f8e6bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:06:52.675 INFO:tasks.workunit.client.0.smithi097.stderr: -450> 2024-09-14T11:06:52.384+0000 7f8e6bfff640 10 monclient: dump: 2024-09-14T11:06:52.675 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:06:52.675 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:06:52.675 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:52.675 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:52.675 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:06:52.675 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:06:52.675 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:06:52.675 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:06:52.675 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:06:52.675 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:52.675 INFO:tasks.workunit.client.0.smithi097.stderr: -449> 2024-09-14T11:06:52.385+0000 7f8f8630c800 10 monclient: _renew_subs 2024-09-14T11:06:52.676 INFO:tasks.workunit.client.0.smithi097.stderr: -448> 2024-09-14T11:06:52.385+0000 7f8f8630c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:06:52.676 INFO:tasks.workunit.client.0.smithi097.stderr: -447> 2024-09-14T11:06:52.384+0000 7f8e71e0b640 4 set_mon_vals no callback set 2024-09-14T11:06:52.676 INFO:tasks.workunit.client.0.smithi097.stderr: -446> 2024-09-14T11:06:52.385+0000 7f8f8630c800 10 monclient: _renew_subs 2024-09-14T11:06:52.676 INFO:tasks.workunit.client.0.smithi097.stderr: -445> 2024-09-14T11:06:52.385+0000 7f8f8630c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:06:52.676 INFO:tasks.workunit.client.0.smithi097.stderr: -444> 2024-09-14T11:06:52.385+0000 7f8f8630c800 1 librados: init done 2024-09-14T11:06:52.676 INFO:tasks.workunit.client.0.smithi097.stderr: -443> 2024-09-14T11:06:52.386+0000 7f8e6bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:06:52.676 INFO:tasks.workunit.client.0.smithi097.stderr: -442> 2024-09-14T11:06:52.386+0000 7f8e6bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:06:52.676 INFO:tasks.workunit.client.0.smithi097.stderr: -441> 2024-09-14T11:06:52.386+0000 7f8e6bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:06:52.676 INFO:tasks.workunit.client.0.smithi097.stderr: -440> 2024-09-14T11:06:52.387+0000 7f8f7b5fc640 10 monclient: get_auth_request con 0x7f8e6c077230 auth_method 0 2024-09-14T11:06:52.676 INFO:tasks.workunit.client.0.smithi097.stderr: -439> 2024-09-14T11:06:52.387+0000 7f8f845fe640 10 monclient: get_auth_request con 0x561e785d6020 auth_method 0 2024-09-14T11:06:52.676 INFO:tasks.workunit.client.0.smithi097.stderr: -438> 2024-09-14T11:06:52.388+0000 7f8f83dfd640 10 monclient: get_auth_request con 0x561e785f8fb0 auth_method 0 2024-09-14T11:06:52.676 INFO:tasks.workunit.client.0.smithi097.stderr: -437> 2024-09-14T11:06:52.388+0000 7f8f7b5fc640 10 monclient: get_auth_request con 0x561e785fd310 auth_method 0 2024-09-14T11:06:52.676 INFO:tasks.workunit.client.0.smithi097.stderr: -436> 2024-09-14T11:06:52.389+0000 7f8f845fe640 10 monclient: get_auth_request con 0x561e785fc870 auth_method 0 2024-09-14T11:06:52.677 INFO:tasks.workunit.client.0.smithi097.stderr: -435> 2024-09-14T11:06:52.390+0000 7f8f8630c800 10 monclient: build_initial_monmap 2024-09-14T11:06:52.677 INFO:tasks.workunit.client.0.smithi097.stderr: -434> 2024-09-14T11:06:52.390+0000 7f8f8630c800 1 build_initial for_mkfs: 0 2024-09-14T11:06:52.677 INFO:tasks.workunit.client.0.smithi097.stderr: -433> 2024-09-14T11:06:52.390+0000 7f8f8630c800 10 monclient: monmap: 2024-09-14T11:06:52.677 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:06:52.677 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:06:52.677 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:06:52.677 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:06:52.677 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:06:52.677 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:06:52.677 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:06:52.677 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:06:52.677 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:06:52.677 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:52.677 INFO:tasks.workunit.client.0.smithi097.stderr: -432> 2024-09-14T11:06:52.390+0000 7f8f8630c800 5 AuthRegistry(0x561e78605470) adding auth protocol: cephx 2024-09-14T11:06:52.678 INFO:tasks.workunit.client.0.smithi097.stderr: -431> 2024-09-14T11:06:52.390+0000 7f8f8630c800 5 AuthRegistry(0x561e78605470) adding auth protocol: cephx 2024-09-14T11:06:52.678 INFO:tasks.workunit.client.0.smithi097.stderr: -430> 2024-09-14T11:06:52.390+0000 7f8f8630c800 5 AuthRegistry(0x561e78605470) adding auth protocol: cephx 2024-09-14T11:06:52.678 INFO:tasks.workunit.client.0.smithi097.stderr: -429> 2024-09-14T11:06:52.390+0000 7f8f8630c800 5 AuthRegistry(0x561e78605470) adding con mode: secure 2024-09-14T11:06:52.678 INFO:tasks.workunit.client.0.smithi097.stderr: -428> 2024-09-14T11:06:52.390+0000 7f8f8630c800 5 AuthRegistry(0x561e78605470) adding con mode: crc 2024-09-14T11:06:52.678 INFO:tasks.workunit.client.0.smithi097.stderr: -427> 2024-09-14T11:06:52.390+0000 7f8f8630c800 5 AuthRegistry(0x561e78605470) adding con mode: secure 2024-09-14T11:06:52.678 INFO:tasks.workunit.client.0.smithi097.stderr: -426> 2024-09-14T11:06:52.390+0000 7f8f8630c800 5 AuthRegistry(0x561e78605470) adding con mode: crc 2024-09-14T11:06:52.678 INFO:tasks.workunit.client.0.smithi097.stderr: -425> 2024-09-14T11:06:52.390+0000 7f8f8630c800 5 AuthRegistry(0x561e78605470) adding con mode: secure 2024-09-14T11:06:52.678 INFO:tasks.workunit.client.0.smithi097.stderr: -424> 2024-09-14T11:06:52.390+0000 7f8f8630c800 5 AuthRegistry(0x561e78605470) adding con mode: crc 2024-09-14T11:06:52.678 INFO:tasks.workunit.client.0.smithi097.stderr: -423> 2024-09-14T11:06:52.390+0000 7f8f8630c800 5 AuthRegistry(0x561e78605470) adding con mode: crc 2024-09-14T11:06:52.678 INFO:tasks.workunit.client.0.smithi097.stderr: -422> 2024-09-14T11:06:52.390+0000 7f8f8630c800 5 AuthRegistry(0x561e78605470) adding con mode: secure 2024-09-14T11:06:52.678 INFO:tasks.workunit.client.0.smithi097.stderr: -421> 2024-09-14T11:06:52.390+0000 7f8f8630c800 5 AuthRegistry(0x561e78605470) adding con mode: crc 2024-09-14T11:06:52.678 INFO:tasks.workunit.client.0.smithi097.stderr: -420> 2024-09-14T11:06:52.390+0000 7f8f8630c800 5 AuthRegistry(0x561e78605470) adding con mode: secure 2024-09-14T11:06:52.678 INFO:tasks.workunit.client.0.smithi097.stderr: -419> 2024-09-14T11:06:52.390+0000 7f8f8630c800 5 AuthRegistry(0x561e78605470) adding con mode: crc 2024-09-14T11:06:52.679 INFO:tasks.workunit.client.0.smithi097.stderr: -418> 2024-09-14T11:06:52.390+0000 7f8f8630c800 5 AuthRegistry(0x561e78605470) adding con mode: secure 2024-09-14T11:06:52.679 INFO:tasks.workunit.client.0.smithi097.stderr: -417> 2024-09-14T11:06:52.390+0000 7f8f8630c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:06:52.679 INFO:tasks.workunit.client.0.smithi097.stderr: -416> 2024-09-14T11:06:52.390+0000 7f8f8630c800 5 asok(0x561e7838e270) register_command objecter_requests cmddesc objecter_requests hook 0x561e78608940 EEXIST 2024-09-14T11:06:52.679 INFO:tasks.workunit.client.0.smithi097.stderr: -415> 2024-09-14T11:06:52.391+0000 7f8f8630c800 10 monclient: init 2024-09-14T11:06:52.679 INFO:tasks.workunit.client.0.smithi097.stderr: -414> 2024-09-14T11:06:52.391+0000 7f8f8630c800 5 AuthRegistry(0x561e78604368) adding auth protocol: cephx 2024-09-14T11:06:52.679 INFO:tasks.workunit.client.0.smithi097.stderr: -413> 2024-09-14T11:06:52.391+0000 7f8f8630c800 5 AuthRegistry(0x561e78604368) adding auth protocol: cephx 2024-09-14T11:06:52.679 INFO:tasks.workunit.client.0.smithi097.stderr: -412> 2024-09-14T11:06:52.391+0000 7f8f8630c800 5 AuthRegistry(0x561e78604368) adding auth protocol: cephx 2024-09-14T11:06:52.679 INFO:tasks.workunit.client.0.smithi097.stderr: -411> 2024-09-14T11:06:52.391+0000 7f8f8630c800 5 AuthRegistry(0x561e78604368) adding con mode: secure 2024-09-14T11:06:52.679 INFO:tasks.workunit.client.0.smithi097.stderr: -410> 2024-09-14T11:06:52.391+0000 7f8f8630c800 5 AuthRegistry(0x561e78604368) adding con mode: crc 2024-09-14T11:06:52.679 INFO:tasks.workunit.client.0.smithi097.stderr: -409> 2024-09-14T11:06:52.391+0000 7f8f8630c800 5 AuthRegistry(0x561e78604368) adding con mode: secure 2024-09-14T11:06:52.679 INFO:tasks.workunit.client.0.smithi097.stderr: -408> 2024-09-14T11:06:52.391+0000 7f8f8630c800 5 AuthRegistry(0x561e78604368) adding con mode: crc 2024-09-14T11:06:52.679 INFO:tasks.workunit.client.0.smithi097.stderr: -407> 2024-09-14T11:06:52.391+0000 7f8f8630c800 5 AuthRegistry(0x561e78604368) adding con mode: secure 2024-09-14T11:06:52.680 INFO:tasks.workunit.client.0.smithi097.stderr: -406> 2024-09-14T11:06:52.391+0000 7f8f8630c800 5 AuthRegistry(0x561e78604368) adding con mode: crc 2024-09-14T11:06:52.680 INFO:tasks.workunit.client.0.smithi097.stderr: -405> 2024-09-14T11:06:52.391+0000 7f8f8630c800 5 AuthRegistry(0x561e78604368) adding con mode: crc 2024-09-14T11:06:52.680 INFO:tasks.workunit.client.0.smithi097.stderr: -404> 2024-09-14T11:06:52.391+0000 7f8f8630c800 5 AuthRegistry(0x561e78604368) adding con mode: secure 2024-09-14T11:06:52.680 INFO:tasks.workunit.client.0.smithi097.stderr: -403> 2024-09-14T11:06:52.391+0000 7f8f8630c800 5 AuthRegistry(0x561e78604368) adding con mode: crc 2024-09-14T11:06:52.680 INFO:tasks.workunit.client.0.smithi097.stderr: -402> 2024-09-14T11:06:52.391+0000 7f8f8630c800 5 AuthRegistry(0x561e78604368) adding con mode: secure 2024-09-14T11:06:52.680 INFO:tasks.workunit.client.0.smithi097.stderr: -401> 2024-09-14T11:06:52.391+0000 7f8f8630c800 5 AuthRegistry(0x561e78604368) adding con mode: crc 2024-09-14T11:06:52.680 INFO:tasks.workunit.client.0.smithi097.stderr: -400> 2024-09-14T11:06:52.391+0000 7f8f8630c800 5 AuthRegistry(0x561e78604368) adding con mode: secure 2024-09-14T11:06:52.680 INFO:tasks.workunit.client.0.smithi097.stderr: -399> 2024-09-14T11:06:52.391+0000 7f8f8630c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:06:52.680 INFO:tasks.workunit.client.0.smithi097.stderr: -398> 2024-09-14T11:06:52.391+0000 7f8f8630c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:06:52.680 INFO:tasks.workunit.client.0.smithi097.stderr: -397> 2024-09-14T11:06:52.391+0000 7f8f8630c800 5 asok(0x561e7838e270) register_command rotate-key cmddesc rotate-key hook 0x561e786044b0 EEXIST 2024-09-14T11:06:52.680 INFO:tasks.workunit.client.0.smithi097.stderr: -396> 2024-09-14T11:06:52.391+0000 7f8f8630c800 10 monclient: _reopen_session rank -1 2024-09-14T11:06:52.681 INFO:tasks.workunit.client.0.smithi097.stderr: -395> 2024-09-14T11:06:52.391+0000 7f8f8630c800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:06:52.681 INFO:tasks.workunit.client.0.smithi097.stderr: -394> 2024-09-14T11:06:52.391+0000 7f8f8630c800 10 monclient(hunting): picked mon.noname-b con 0x561e7862cc60 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:06:52.681 INFO:tasks.workunit.client.0.smithi097.stderr: -393> 2024-09-14T11:06:52.391+0000 7f8f8630c800 10 monclient(hunting): picked mon.noname-a con 0x561e7862d040 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:06:52.681 INFO:tasks.workunit.client.0.smithi097.stderr: -392> 2024-09-14T11:06:52.391+0000 7f8f8630c800 10 monclient(hunting): picked mon.noname-c con 0x561e7862b970 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:06:52.681 INFO:tasks.workunit.client.0.smithi097.stderr: -391> 2024-09-14T11:06:52.391+0000 7f8f8630c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:52.681 INFO:tasks.workunit.client.0.smithi097.stderr: -390> 2024-09-14T11:06:52.391+0000 7f8f8630c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:52.681 INFO:tasks.workunit.client.0.smithi097.stderr: -389> 2024-09-14T11:06:52.391+0000 7f8f8630c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:52.681 INFO:tasks.workunit.client.0.smithi097.stderr: -388> 2024-09-14T11:06:52.391+0000 7f8f8630c800 10 monclient(hunting): _renew_subs 2024-09-14T11:06:52.681 INFO:tasks.workunit.client.0.smithi097.stderr: -387> 2024-09-14T11:06:52.391+0000 7f8f8630c800 10 monclient(hunting): authenticate will time out at 2094.044549s 2024-09-14T11:06:52.682 INFO:tasks.workunit.client.0.smithi097.stderr: -386> 2024-09-14T11:06:52.391+0000 7f8f83dfd640 10 monclient(hunting): get_auth_request con 0x561e7862b970 auth_method 0 2024-09-14T11:06:52.682 INFO:tasks.workunit.client.0.smithi097.stderr: -385> 2024-09-14T11:06:52.391+0000 7f8f83dfd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:06:52.682 INFO:tasks.workunit.client.0.smithi097.stderr: -384> 2024-09-14T11:06:52.391+0000 7f8f83dfd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:06:52.682 INFO:tasks.workunit.client.0.smithi097.stderr: -383> 2024-09-14T11:06:52.391+0000 7f8f83dfd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:06:52.682 INFO:tasks.workunit.client.0.smithi097.stderr: -382> 2024-09-14T11:06:52.391+0000 7f8f845fe640 10 monclient(hunting): get_auth_request con 0x561e7862d040 auth_method 0 2024-09-14T11:06:52.682 INFO:tasks.workunit.client.0.smithi097.stderr: -381> 2024-09-14T11:06:52.391+0000 7f8f845fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:06:52.682 INFO:tasks.workunit.client.0.smithi097.stderr: -380> 2024-09-14T11:06:52.391+0000 7f8f845fe640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:06:52.682 INFO:tasks.workunit.client.0.smithi097.stderr: -379> 2024-09-14T11:06:52.391+0000 7f8f845fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:06:52.682 INFO:tasks.workunit.client.0.smithi097.stderr: -378> 2024-09-14T11:06:52.391+0000 7f8f7b5fc640 10 monclient(hunting): get_auth_request con 0x561e7862cc60 auth_method 0 2024-09-14T11:06:52.682 INFO:tasks.workunit.client.0.smithi097.stderr: -377> 2024-09-14T11:06:52.391+0000 7f8f7b5fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:06:52.682 INFO:tasks.workunit.client.0.smithi097.stderr: -376> 2024-09-14T11:06:52.391+0000 7f8f7b5fc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:06:52.682 INFO:tasks.workunit.client.0.smithi097.stderr: -375> 2024-09-14T11:06:52.391+0000 7f8f7b5fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:06:52.682 INFO:tasks.workunit.client.0.smithi097.stderr: -374> 2024-09-14T11:06:52.391+0000 7f8f83dfd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:06:52.682 INFO:tasks.workunit.client.0.smithi097.stderr: -373> 2024-09-14T11:06:52.391+0000 7f8f83dfd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:06:52.683 INFO:tasks.workunit.client.0.smithi097.stderr: -372> 2024-09-14T11:06:52.391+0000 7f8f83dfd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:06:52.683 INFO:tasks.workunit.client.0.smithi097.stderr: -371> 2024-09-14T11:06:52.391+0000 7f8f845fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:06:52.683 INFO:tasks.workunit.client.0.smithi097.stderr: -370> 2024-09-14T11:06:52.391+0000 7f8f845fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:06:52.683 INFO:tasks.workunit.client.0.smithi097.stderr: -369> 2024-09-14T11:06:52.391+0000 7f8f845fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:06:52.683 INFO:tasks.workunit.client.0.smithi097.stderr: -368> 2024-09-14T11:06:52.391+0000 7f8f7b5fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:06:52.683 INFO:tasks.workunit.client.0.smithi097.stderr: -367> 2024-09-14T11:06:52.391+0000 7f8f7b5fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:06:52.683 INFO:tasks.workunit.client.0.smithi097.stderr: -366> 2024-09-14T11:06:52.391+0000 7f8f7b5fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:06:52.683 INFO:tasks.workunit.client.0.smithi097.stderr: -365> 2024-09-14T11:06:52.391+0000 7f8f83dfd640 10 monclient(hunting): handle_auth_done global_id 7541 payload 824 2024-09-14T11:06:52.683 INFO:tasks.workunit.client.0.smithi097.stderr: -364> 2024-09-14T11:06:52.391+0000 7f8f83dfd640 10 monclient: _finish_hunting 0 2024-09-14T11:06:52.683 INFO:tasks.workunit.client.0.smithi097.stderr: -363> 2024-09-14T11:06:52.391+0000 7f8f83dfd640 1 monclient: found mon.noname-c 2024-09-14T11:06:52.683 INFO:tasks.workunit.client.0.smithi097.stderr: -362> 2024-09-14T11:06:52.391+0000 7f8f83dfd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:06:52.683 INFO:tasks.workunit.client.0.smithi097.stderr: -361> 2024-09-14T11:06:52.392+0000 7f8e697fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:06:52.683 INFO:tasks.workunit.client.0.smithi097.stderr: -360> 2024-09-14T11:06:52.392+0000 7f8e697fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:06:52.684 INFO:tasks.workunit.client.0.smithi097.stderr: -359> 2024-09-14T11:06:52.392+0000 7f8e697fa640 10 monclient: dump: 2024-09-14T11:06:52.684 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:06:52.684 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:06:52.684 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:52.684 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:52.684 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:06:52.684 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:06:52.684 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:06:52.684 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:06:52.684 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:06:52.685 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:52.685 INFO:tasks.workunit.client.0.smithi097.stderr: -358> 2024-09-14T11:06:52.392+0000 7f8e697fa640 10 monclient: _finish_auth 0 2024-09-14T11:06:52.685 INFO:tasks.workunit.client.0.smithi097.stderr: -357> 2024-09-14T11:06:52.392+0000 7f8e697fa640 10 monclient: _check_auth_tickets 2024-09-14T11:06:52.685 INFO:tasks.workunit.client.0.smithi097.stderr: -356> 2024-09-14T11:06:52.392+0000 7f8e697fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:06:52.685 INFO:tasks.workunit.client.0.smithi097.stderr: -355> 2024-09-14T11:06:52.392+0000 7f8e697fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:06:52.685 INFO:tasks.workunit.client.0.smithi097.stderr: -354> 2024-09-14T11:06:52.392+0000 7f8e697fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:06:52.685 INFO:tasks.workunit.client.0.smithi097.stderr: -353> 2024-09-14T11:06:52.392+0000 7f8e697fa640 10 monclient: dump: 2024-09-14T11:06:52.685 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:06:52.685 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:06:52.685 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:52.685 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:52.685 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:06:52.685 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:06:52.685 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:06:52.686 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:06:52.686 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:06:52.686 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:52.686 INFO:tasks.workunit.client.0.smithi097.stderr: -352> 2024-09-14T11:06:52.392+0000 7f8f8630c800 5 monclient: authenticate success, global_id 7541 2024-09-14T11:06:52.686 INFO:tasks.workunit.client.0.smithi097.stderr: -351> 2024-09-14T11:06:52.392+0000 7f8f8630c800 10 monclient: _renew_subs 2024-09-14T11:06:52.686 INFO:tasks.workunit.client.0.smithi097.stderr: -350> 2024-09-14T11:06:52.392+0000 7f8f8630c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:06:52.686 INFO:tasks.workunit.client.0.smithi097.stderr: -349> 2024-09-14T11:06:52.392+0000 7f8f84dff640 4 set_mon_vals no callback set 2024-09-14T11:06:52.686 INFO:tasks.workunit.client.0.smithi097.stderr: -348> 2024-09-14T11:06:52.392+0000 7f8f8630c800 10 monclient: _renew_subs 2024-09-14T11:06:52.686 INFO:tasks.workunit.client.0.smithi097.stderr: -347> 2024-09-14T11:06:52.392+0000 7f8f8630c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:06:52.686 INFO:tasks.workunit.client.0.smithi097.stderr: -346> 2024-09-14T11:06:52.393+0000 7f8e697fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:06:52.686 INFO:tasks.workunit.client.0.smithi097.stderr: -345> 2024-09-14T11:06:52.393+0000 7f8e697fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:06:52.686 INFO:tasks.workunit.client.0.smithi097.stderr: -344> 2024-09-14T11:06:52.393+0000 7f8e697fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:06:52.686 INFO:tasks.workunit.client.0.smithi097.stderr: -343> 2024-09-14T11:06:52.393+0000 7f8f7b5fc640 10 monclient: get_auth_request con 0x7f8e5c077140 auth_method 0 2024-09-14T11:06:52.686 INFO:tasks.workunit.client.0.smithi097.stderr: -342> 2024-09-14T11:06:52.394+0000 7f8f8630c800 10 monclient: get_monmap_and_config 2024-09-14T11:06:52.687 INFO:tasks.workunit.client.0.smithi097.stderr: -341> 2024-09-14T11:06:52.394+0000 7f8f8630c800 10 monclient: build_initial_monmap 2024-09-14T11:06:52.687 INFO:tasks.workunit.client.0.smithi097.stderr: -340> 2024-09-14T11:06:52.394+0000 7f8f8630c800 1 build_initial for_mkfs: 0 2024-09-14T11:06:52.687 INFO:tasks.workunit.client.0.smithi097.stderr: -339> 2024-09-14T11:06:52.394+0000 7f8f8630c800 10 monclient: monmap: 2024-09-14T11:06:52.687 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:06:52.687 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:06:52.687 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:06:52.687 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:06:52.687 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:06:52.687 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:06:52.687 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:06:52.687 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:06:52.687 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:06:52.687 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:52.688 INFO:tasks.workunit.client.0.smithi097.stderr: -338> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x561e7864c990) adding auth protocol: cephx 2024-09-14T11:06:52.688 INFO:tasks.workunit.client.0.smithi097.stderr: -337> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x561e7864c990) adding auth protocol: cephx 2024-09-14T11:06:52.688 INFO:tasks.workunit.client.0.smithi097.stderr: -336> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x561e7864c990) adding auth protocol: cephx 2024-09-14T11:06:52.688 INFO:tasks.workunit.client.0.smithi097.stderr: -335> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x561e7864c990) adding con mode: secure 2024-09-14T11:06:52.688 INFO:tasks.workunit.client.0.smithi097.stderr: -334> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x561e7864c990) adding con mode: crc 2024-09-14T11:06:52.688 INFO:tasks.workunit.client.0.smithi097.stderr: -333> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x561e7864c990) adding con mode: secure 2024-09-14T11:06:52.688 INFO:tasks.workunit.client.0.smithi097.stderr: -332> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x561e7864c990) adding con mode: crc 2024-09-14T11:06:52.688 INFO:tasks.workunit.client.0.smithi097.stderr: -331> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x561e7864c990) adding con mode: secure 2024-09-14T11:06:52.688 INFO:tasks.workunit.client.0.smithi097.stderr: -330> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x561e7864c990) adding con mode: crc 2024-09-14T11:06:52.688 INFO:tasks.workunit.client.0.smithi097.stderr: -329> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x561e7864c990) adding con mode: crc 2024-09-14T11:06:52.688 INFO:tasks.workunit.client.0.smithi097.stderr: -328> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x561e7864c990) adding con mode: secure 2024-09-14T11:06:52.688 INFO:tasks.workunit.client.0.smithi097.stderr: -327> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x561e7864c990) adding con mode: crc 2024-09-14T11:06:52.688 INFO:tasks.workunit.client.0.smithi097.stderr: -326> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x561e7864c990) adding con mode: secure 2024-09-14T11:06:52.688 INFO:tasks.workunit.client.0.smithi097.stderr: -325> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x561e7864c990) adding con mode: crc 2024-09-14T11:06:52.689 INFO:tasks.workunit.client.0.smithi097.stderr: -324> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x561e7864c990) adding con mode: secure 2024-09-14T11:06:52.689 INFO:tasks.workunit.client.0.smithi097.stderr: -323> 2024-09-14T11:06:52.394+0000 7f8f8630c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:06:52.689 INFO:tasks.workunit.client.0.smithi097.stderr: -322> 2024-09-14T11:06:52.394+0000 7f8f8630c800 10 monclient: init 2024-09-14T11:06:52.689 INFO:tasks.workunit.client.0.smithi097.stderr: -321> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29160) adding auth protocol: cephx 2024-09-14T11:06:52.689 INFO:tasks.workunit.client.0.smithi097.stderr: -320> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29160) adding auth protocol: cephx 2024-09-14T11:06:52.689 INFO:tasks.workunit.client.0.smithi097.stderr: -319> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29160) adding auth protocol: cephx 2024-09-14T11:06:52.689 INFO:tasks.workunit.client.0.smithi097.stderr: -318> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29160) adding con mode: secure 2024-09-14T11:06:52.689 INFO:tasks.workunit.client.0.smithi097.stderr: -317> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29160) adding con mode: crc 2024-09-14T11:06:52.689 INFO:tasks.workunit.client.0.smithi097.stderr: -316> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29160) adding con mode: secure 2024-09-14T11:06:52.689 INFO:tasks.workunit.client.0.smithi097.stderr: -315> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29160) adding con mode: crc 2024-09-14T11:06:52.689 INFO:tasks.workunit.client.0.smithi097.stderr: -314> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29160) adding con mode: secure 2024-09-14T11:06:52.689 INFO:tasks.workunit.client.0.smithi097.stderr: -313> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29160) adding con mode: crc 2024-09-14T11:06:52.689 INFO:tasks.workunit.client.0.smithi097.stderr: -312> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29160) adding con mode: crc 2024-09-14T11:06:52.690 INFO:tasks.workunit.client.0.smithi097.stderr: -311> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29160) adding con mode: secure 2024-09-14T11:06:52.690 INFO:tasks.workunit.client.0.smithi097.stderr: -310> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29160) adding con mode: crc 2024-09-14T11:06:52.690 INFO:tasks.workunit.client.0.smithi097.stderr: -309> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29160) adding con mode: secure 2024-09-14T11:06:52.690 INFO:tasks.workunit.client.0.smithi097.stderr: -308> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29160) adding con mode: crc 2024-09-14T11:06:52.690 INFO:tasks.workunit.client.0.smithi097.stderr: -307> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29160) adding con mode: secure 2024-09-14T11:06:52.690 INFO:tasks.workunit.client.0.smithi097.stderr: -306> 2024-09-14T11:06:52.394+0000 7f8f8630c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:06:52.690 INFO:tasks.workunit.client.0.smithi097.stderr: -305> 2024-09-14T11:06:52.394+0000 7f8f8630c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:06:52.690 INFO:tasks.workunit.client.0.smithi097.stderr: -304> 2024-09-14T11:06:52.395+0000 7f8f8630c800 5 asok(0x561e7838e270) register_command rotate-key cmddesc rotate-key hook 0x7ffe1af292a8 EEXIST 2024-09-14T11:06:52.690 INFO:tasks.workunit.client.0.smithi097.stderr: -303> 2024-09-14T11:06:52.395+0000 7f8f8630c800 10 monclient: _reopen_session rank -1 2024-09-14T11:06:52.690 INFO:tasks.workunit.client.0.smithi097.stderr: -302> 2024-09-14T11:06:52.395+0000 7f8f8630c800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:06:52.690 INFO:tasks.workunit.client.0.smithi097.stderr: -301> 2024-09-14T11:06:52.395+0000 7f8f8630c800 10 monclient(hunting): picked mon.noname-b con 0x561e78681050 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:06:52.690 INFO:tasks.workunit.client.0.smithi097.stderr: -300> 2024-09-14T11:06:52.395+0000 7f8f8630c800 10 monclient(hunting): picked mon.noname-c con 0x561e78651fa0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:06:52.690 INFO:tasks.workunit.client.0.smithi097.stderr: -299> 2024-09-14T11:06:52.395+0000 7f8f8630c800 10 monclient(hunting): picked mon.noname-a con 0x561e7867c8f0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:06:52.690 INFO:tasks.workunit.client.0.smithi097.stderr: -298> 2024-09-14T11:06:52.395+0000 7f8f8630c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:52.691 INFO:tasks.workunit.client.0.smithi097.stderr: -297> 2024-09-14T11:06:52.395+0000 7f8f8630c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:52.691 INFO:tasks.workunit.client.0.smithi097.stderr: -296> 2024-09-14T11:06:52.395+0000 7f8f8630c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:52.691 INFO:tasks.workunit.client.0.smithi097.stderr: -295> 2024-09-14T11:06:52.395+0000 7f8f8630c800 10 monclient(hunting): _renew_subs 2024-09-14T11:06:52.691 INFO:tasks.workunit.client.0.smithi097.stderr: -294> 2024-09-14T11:06:52.395+0000 7f8f8630c800 10 monclient(hunting): authenticate will time out at 2094.048080s 2024-09-14T11:06:52.691 INFO:tasks.workunit.client.0.smithi097.stderr: -293> 2024-09-14T11:06:52.395+0000 7f8f845fe640 10 monclient(hunting): get_auth_request con 0x561e78651fa0 auth_method 0 2024-09-14T11:06:52.691 INFO:tasks.workunit.client.0.smithi097.stderr: -292> 2024-09-14T11:06:52.395+0000 7f8f845fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:06:52.691 INFO:tasks.workunit.client.0.smithi097.stderr: -291> 2024-09-14T11:06:52.395+0000 7f8f845fe640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:06:52.691 INFO:tasks.workunit.client.0.smithi097.stderr: -290> 2024-09-14T11:06:52.395+0000 7f8f845fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:06:52.691 INFO:tasks.workunit.client.0.smithi097.stderr: -289> 2024-09-14T11:06:52.395+0000 7f8f83dfd640 10 monclient(hunting): get_auth_request con 0x561e7867c8f0 auth_method 0 2024-09-14T11:06:52.691 INFO:tasks.workunit.client.0.smithi097.stderr: -288> 2024-09-14T11:06:52.395+0000 7f8f83dfd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:06:52.691 INFO:tasks.workunit.client.0.smithi097.stderr: -287> 2024-09-14T11:06:52.395+0000 7f8f83dfd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:06:52.691 INFO:tasks.workunit.client.0.smithi097.stderr: -286> 2024-09-14T11:06:52.395+0000 7f8f83dfd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:06:52.691 INFO:tasks.workunit.client.0.smithi097.stderr: -285> 2024-09-14T11:06:52.395+0000 7f8f7b5fc640 10 monclient(hunting): get_auth_request con 0x561e78681050 auth_method 0 2024-09-14T11:06:52.691 INFO:tasks.workunit.client.0.smithi097.stderr: -284> 2024-09-14T11:06:52.395+0000 7f8f7b5fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:06:52.692 INFO:tasks.workunit.client.0.smithi097.stderr: -283> 2024-09-14T11:06:52.395+0000 7f8f7b5fc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:06:52.692 INFO:tasks.workunit.client.0.smithi097.stderr: -282> 2024-09-14T11:06:52.395+0000 7f8f7b5fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:06:52.692 INFO:tasks.workunit.client.0.smithi097.stderr: -281> 2024-09-14T11:06:52.395+0000 7f8f845fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:06:52.692 INFO:tasks.workunit.client.0.smithi097.stderr: -280> 2024-09-14T11:06:52.395+0000 7f8f845fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:06:52.692 INFO:tasks.workunit.client.0.smithi097.stderr: -279> 2024-09-14T11:06:52.395+0000 7f8f845fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:06:52.692 INFO:tasks.workunit.client.0.smithi097.stderr: -278> 2024-09-14T11:06:52.395+0000 7f8f83dfd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:06:52.692 INFO:tasks.workunit.client.0.smithi097.stderr: -277> 2024-09-14T11:06:52.395+0000 7f8f83dfd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:06:52.692 INFO:tasks.workunit.client.0.smithi097.stderr: -276> 2024-09-14T11:06:52.395+0000 7f8f83dfd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:06:52.692 INFO:tasks.workunit.client.0.smithi097.stderr: -275> 2024-09-14T11:06:52.395+0000 7f8f7b5fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:06:52.692 INFO:tasks.workunit.client.0.smithi097.stderr: -274> 2024-09-14T11:06:52.395+0000 7f8f7b5fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:06:52.692 INFO:tasks.workunit.client.0.smithi097.stderr: -273> 2024-09-14T11:06:52.395+0000 7f8f7b5fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:06:52.692 INFO:tasks.workunit.client.0.smithi097.stderr: -272> 2024-09-14T11:06:52.395+0000 7f8f845fe640 10 monclient(hunting): handle_auth_done global_id 7544 payload 274 2024-09-14T11:06:52.692 INFO:tasks.workunit.client.0.smithi097.stderr: -271> 2024-09-14T11:06:52.395+0000 7f8f845fe640 10 monclient: _finish_hunting 0 2024-09-14T11:06:52.692 INFO:tasks.workunit.client.0.smithi097.stderr: -270> 2024-09-14T11:06:52.395+0000 7f8f845fe640 1 monclient: found mon.noname-c 2024-09-14T11:06:52.693 INFO:tasks.workunit.client.0.smithi097.stderr: -269> 2024-09-14T11:06:52.395+0000 7f8f845fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:06:52.693 INFO:tasks.workunit.client.0.smithi097.stderr: -268> 2024-09-14T11:06:52.395+0000 7f8e62ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:06:52.693 INFO:tasks.workunit.client.0.smithi097.stderr: -267> 2024-09-14T11:06:52.395+0000 7f8e62ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:06:52.693 INFO:tasks.workunit.client.0.smithi097.stderr: -266> 2024-09-14T11:06:52.395+0000 7f8e62ffd640 10 monclient: dump: 2024-09-14T11:06:52.693 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:06:52.693 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:06:52.693 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:52.693 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:52.693 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:06:52.693 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:06:52.693 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:06:52.693 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:06:52.693 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:06:52.693 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:52.693 INFO:tasks.workunit.client.0.smithi097.stderr: -265> 2024-09-14T11:06:52.395+0000 7f8e62ffd640 10 monclient: _finish_auth 0 2024-09-14T11:06:52.694 INFO:tasks.workunit.client.0.smithi097.stderr: -264> 2024-09-14T11:06:52.395+0000 7f8e62ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:06:52.694 INFO:tasks.workunit.client.0.smithi097.stderr: -263> 2024-09-14T11:06:52.395+0000 7f8e62ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:06:52.694 INFO:tasks.workunit.client.0.smithi097.stderr: -262> 2024-09-14T11:06:52.395+0000 7f8e62ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:06:52.694 INFO:tasks.workunit.client.0.smithi097.stderr: -261> 2024-09-14T11:06:52.395+0000 7f8e62ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:06:52.694 INFO:tasks.workunit.client.0.smithi097.stderr: -260> 2024-09-14T11:06:52.395+0000 7f8e62ffd640 10 monclient: dump: 2024-09-14T11:06:52.694 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:06:52.694 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:06:52.694 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:52.694 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:52.694 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:06:52.694 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:06:52.694 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:06:52.694 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:06:52.694 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:06:52.694 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:52.695 INFO:tasks.workunit.client.0.smithi097.stderr: -259> 2024-09-14T11:06:52.395+0000 7f8f8630c800 5 monclient: authenticate success, global_id 7544 2024-09-14T11:06:52.695 INFO:tasks.workunit.client.0.smithi097.stderr: -258> 2024-09-14T11:06:52.395+0000 7f8f8630c800 10 monclient: get_monmap_and_config success 2024-09-14T11:06:52.695 INFO:tasks.workunit.client.0.smithi097.stderr: -257> 2024-09-14T11:06:52.395+0000 7f8f8630c800 4 set_mon_vals no callback set 2024-09-14T11:06:52.695 INFO:tasks.workunit.client.0.smithi097.stderr: -256> 2024-09-14T11:06:52.396+0000 7f8f8630c800 10 monclient: shutdown 2024-09-14T11:06:52.695 INFO:tasks.workunit.client.0.smithi097.stderr: -255> 2024-09-14T11:06:52.396+0000 7f8f8630c800 10 monclient: build_initial_monmap 2024-09-14T11:06:52.695 INFO:tasks.workunit.client.0.smithi097.stderr: -254> 2024-09-14T11:06:52.396+0000 7f8f8630c800 1 build_initial for_mkfs: 0 2024-09-14T11:06:52.695 INFO:tasks.workunit.client.0.smithi097.stderr: -253> 2024-09-14T11:06:52.396+0000 7f8f8630c800 10 monclient: monmap: 2024-09-14T11:06:52.695 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:06:52.695 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:06:52.695 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:06:52.695 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:06:52.695 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:06:52.696 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:06:52.696 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:06:52.696 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:06:52.696 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:06:52.696 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:52.696 INFO:tasks.workunit.client.0.smithi097.stderr: -252> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78673570) adding auth protocol: cephx 2024-09-14T11:06:52.696 INFO:tasks.workunit.client.0.smithi097.stderr: -251> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78673570) adding auth protocol: cephx 2024-09-14T11:06:52.696 INFO:tasks.workunit.client.0.smithi097.stderr: -250> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78673570) adding auth protocol: cephx 2024-09-14T11:06:52.696 INFO:tasks.workunit.client.0.smithi097.stderr: -249> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78673570) adding con mode: secure 2024-09-14T11:06:52.696 INFO:tasks.workunit.client.0.smithi097.stderr: -248> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78673570) adding con mode: crc 2024-09-14T11:06:52.696 INFO:tasks.workunit.client.0.smithi097.stderr: -247> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78673570) adding con mode: secure 2024-09-14T11:06:52.696 INFO:tasks.workunit.client.0.smithi097.stderr: -246> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78673570) adding con mode: crc 2024-09-14T11:06:52.696 INFO:tasks.workunit.client.0.smithi097.stderr: -245> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78673570) adding con mode: secure 2024-09-14T11:06:52.696 INFO:tasks.workunit.client.0.smithi097.stderr: -244> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78673570) adding con mode: crc 2024-09-14T11:06:52.697 INFO:tasks.workunit.client.0.smithi097.stderr: -243> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78673570) adding con mode: crc 2024-09-14T11:06:52.697 INFO:tasks.workunit.client.0.smithi097.stderr: -242> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78673570) adding con mode: secure 2024-09-14T11:06:52.697 INFO:tasks.workunit.client.0.smithi097.stderr: -241> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78673570) adding con mode: crc 2024-09-14T11:06:52.697 INFO:tasks.workunit.client.0.smithi097.stderr: -240> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78673570) adding con mode: secure 2024-09-14T11:06:52.697 INFO:tasks.workunit.client.0.smithi097.stderr: -239> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78673570) adding con mode: crc 2024-09-14T11:06:52.697 INFO:tasks.workunit.client.0.smithi097.stderr: -238> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78673570) adding con mode: secure 2024-09-14T11:06:52.697 INFO:tasks.workunit.client.0.smithi097.stderr: -237> 2024-09-14T11:06:52.396+0000 7f8f8630c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:06:52.697 INFO:tasks.workunit.client.0.smithi097.stderr: -236> 2024-09-14T11:06:52.396+0000 7f8f8630c800 1 librados: starting msgr at 2024-09-14T11:06:52.697 INFO:tasks.workunit.client.0.smithi097.stderr: -235> 2024-09-14T11:06:52.396+0000 7f8f8630c800 1 librados: starting objecter 2024-09-14T11:06:52.697 INFO:tasks.workunit.client.0.smithi097.stderr: -234> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 asok(0x561e7838e270) register_command objecter_requests cmddesc objecter_requests hook 0x561e78650d30 EEXIST 2024-09-14T11:06:52.697 INFO:tasks.workunit.client.0.smithi097.stderr: -233> 2024-09-14T11:06:52.396+0000 7f8f8630c800 1 librados: setting wanted keys 2024-09-14T11:06:52.697 INFO:tasks.workunit.client.0.smithi097.stderr: -232> 2024-09-14T11:06:52.396+0000 7f8f8630c800 1 librados: calling monclient init 2024-09-14T11:06:52.697 INFO:tasks.workunit.client.0.smithi097.stderr: -231> 2024-09-14T11:06:52.396+0000 7f8f8630c800 10 monclient: init 2024-09-14T11:06:52.697 INFO:tasks.workunit.client.0.smithi097.stderr: -230> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78641520) adding auth protocol: cephx 2024-09-14T11:06:52.698 INFO:tasks.workunit.client.0.smithi097.stderr: -229> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78641520) adding auth protocol: cephx 2024-09-14T11:06:52.698 INFO:tasks.workunit.client.0.smithi097.stderr: -228> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78641520) adding auth protocol: cephx 2024-09-14T11:06:52.698 INFO:tasks.workunit.client.0.smithi097.stderr: -227> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78641520) adding con mode: secure 2024-09-14T11:06:52.698 INFO:tasks.workunit.client.0.smithi097.stderr: -226> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78641520) adding con mode: crc 2024-09-14T11:06:52.698 INFO:tasks.workunit.client.0.smithi097.stderr: -225> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78641520) adding con mode: secure 2024-09-14T11:06:52.698 INFO:tasks.workunit.client.0.smithi097.stderr: -224> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78641520) adding con mode: crc 2024-09-14T11:06:52.698 INFO:tasks.workunit.client.0.smithi097.stderr: -223> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78641520) adding con mode: secure 2024-09-14T11:06:52.698 INFO:tasks.workunit.client.0.smithi097.stderr: -222> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78641520) adding con mode: crc 2024-09-14T11:06:52.698 INFO:tasks.workunit.client.0.smithi097.stderr: -221> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78641520) adding con mode: crc 2024-09-14T11:06:52.698 INFO:tasks.workunit.client.0.smithi097.stderr: -220> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78641520) adding con mode: secure 2024-09-14T11:06:52.698 INFO:tasks.workunit.client.0.smithi097.stderr: -219> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78641520) adding con mode: crc 2024-09-14T11:06:52.698 INFO:tasks.workunit.client.0.smithi097.stderr: -218> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78641520) adding con mode: secure 2024-09-14T11:06:52.698 INFO:tasks.workunit.client.0.smithi097.stderr: -217> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78641520) adding con mode: crc 2024-09-14T11:06:52.699 INFO:tasks.workunit.client.0.smithi097.stderr: -216> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78641520) adding con mode: secure 2024-09-14T11:06:52.699 INFO:tasks.workunit.client.0.smithi097.stderr: -215> 2024-09-14T11:06:52.396+0000 7f8f8630c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:06:52.699 INFO:tasks.workunit.client.0.smithi097.stderr: -214> 2024-09-14T11:06:52.397+0000 7f8f8630c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:06:52.699 INFO:tasks.workunit.client.0.smithi097.stderr: -213> 2024-09-14T11:06:52.397+0000 7f8f8630c800 5 asok(0x561e7838e270) register_command rotate-key cmddesc rotate-key hook 0x561e78641668 EEXIST 2024-09-14T11:06:52.699 INFO:tasks.workunit.client.0.smithi097.stderr: -212> 2024-09-14T11:06:52.397+0000 7f8f8630c800 10 monclient: _reopen_session rank -1 2024-09-14T11:06:52.699 INFO:tasks.workunit.client.0.smithi097.stderr: -211> 2024-09-14T11:06:52.397+0000 7f8f8630c800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:06:52.699 INFO:tasks.workunit.client.0.smithi097.stderr: -210> 2024-09-14T11:06:52.397+0000 7f8f8630c800 10 monclient(hunting): picked mon.noname-a con 0x561e78651fa0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:06:52.699 INFO:tasks.workunit.client.0.smithi097.stderr: -209> 2024-09-14T11:06:52.397+0000 7f8f8630c800 10 monclient(hunting): picked mon.noname-b con 0x561e7867c8f0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:06:52.699 INFO:tasks.workunit.client.0.smithi097.stderr: -208> 2024-09-14T11:06:52.397+0000 7f8f8630c800 10 monclient(hunting): picked mon.noname-c con 0x561e78681050 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:06:52.699 INFO:tasks.workunit.client.0.smithi097.stderr: -207> 2024-09-14T11:06:52.397+0000 7f8f8630c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:52.699 INFO:tasks.workunit.client.0.smithi097.stderr: -206> 2024-09-14T11:06:52.397+0000 7f8f8630c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:52.699 INFO:tasks.workunit.client.0.smithi097.stderr: -205> 2024-09-14T11:06:52.397+0000 7f8f8630c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:52.699 INFO:tasks.workunit.client.0.smithi097.stderr: -204> 2024-09-14T11:06:52.397+0000 7f8f8630c800 10 monclient(hunting): _renew_subs 2024-09-14T11:06:52.699 INFO:tasks.workunit.client.0.smithi097.stderr: -203> 2024-09-14T11:06:52.397+0000 7f8f8630c800 10 monclient(hunting): authenticate will time out at 2094.050228s 2024-09-14T11:06:52.699 INFO:tasks.workunit.client.0.smithi097.stderr: -202> 2024-09-14T11:06:52.397+0000 7f8f83dfd640 10 monclient(hunting): get_auth_request con 0x561e78681050 auth_method 0 2024-09-14T11:06:52.700 INFO:tasks.workunit.client.0.smithi097.stderr: -201> 2024-09-14T11:06:52.397+0000 7f8f83dfd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:06:52.700 INFO:tasks.workunit.client.0.smithi097.stderr: -200> 2024-09-14T11:06:52.397+0000 7f8f83dfd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:06:52.700 INFO:tasks.workunit.client.0.smithi097.stderr: -199> 2024-09-14T11:06:52.397+0000 7f8f83dfd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:06:52.700 INFO:tasks.workunit.client.0.smithi097.stderr: -198> 2024-09-14T11:06:52.397+0000 7f8f7b5fc640 10 monclient(hunting): get_auth_request con 0x561e78651fa0 auth_method 0 2024-09-14T11:06:52.700 INFO:tasks.workunit.client.0.smithi097.stderr: -197> 2024-09-14T11:06:52.397+0000 7f8f7b5fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:06:52.700 INFO:tasks.workunit.client.0.smithi097.stderr: -196> 2024-09-14T11:06:52.397+0000 7f8f7b5fc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:06:52.700 INFO:tasks.workunit.client.0.smithi097.stderr: -195> 2024-09-14T11:06:52.397+0000 7f8f7b5fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:06:52.700 INFO:tasks.workunit.client.0.smithi097.stderr: -194> 2024-09-14T11:06:52.397+0000 7f8f845fe640 10 monclient(hunting): get_auth_request con 0x561e7867c8f0 auth_method 0 2024-09-14T11:06:52.700 INFO:tasks.workunit.client.0.smithi097.stderr: -193> 2024-09-14T11:06:52.397+0000 7f8f845fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:06:52.700 INFO:tasks.workunit.client.0.smithi097.stderr: -192> 2024-09-14T11:06:52.397+0000 7f8f845fe640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:06:52.700 INFO:tasks.workunit.client.0.smithi097.stderr: -191> 2024-09-14T11:06:52.397+0000 7f8f845fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:06:52.700 INFO:tasks.workunit.client.0.smithi097.stderr: -190> 2024-09-14T11:06:52.397+0000 7f8f83dfd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:06:52.701 INFO:tasks.workunit.client.0.smithi097.stderr: -189> 2024-09-14T11:06:52.397+0000 7f8f83dfd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:06:52.701 INFO:tasks.workunit.client.0.smithi097.stderr: -188> 2024-09-14T11:06:52.397+0000 7f8f83dfd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:06:52.701 INFO:tasks.workunit.client.0.smithi097.stderr: -187> 2024-09-14T11:06:52.397+0000 7f8f7b5fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:06:52.701 INFO:tasks.workunit.client.0.smithi097.stderr: -186> 2024-09-14T11:06:52.397+0000 7f8f7b5fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:06:52.701 INFO:tasks.workunit.client.0.smithi097.stderr: -185> 2024-09-14T11:06:52.397+0000 7f8f7b5fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:06:52.701 INFO:tasks.workunit.client.0.smithi097.stderr: -184> 2024-09-14T11:06:52.397+0000 7f8f845fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:06:52.701 INFO:tasks.workunit.client.0.smithi097.stderr: -183> 2024-09-14T11:06:52.397+0000 7f8f845fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:06:52.701 INFO:tasks.workunit.client.0.smithi097.stderr: -182> 2024-09-14T11:06:52.397+0000 7f8f845fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:06:52.701 INFO:tasks.workunit.client.0.smithi097.stderr: -181> 2024-09-14T11:06:52.397+0000 7f8f83dfd640 10 monclient(hunting): handle_auth_done global_id 7547 payload 824 2024-09-14T11:06:52.701 INFO:tasks.workunit.client.0.smithi097.stderr: -180> 2024-09-14T11:06:52.397+0000 7f8f83dfd640 10 monclient: _finish_hunting 0 2024-09-14T11:06:52.701 INFO:tasks.workunit.client.0.smithi097.stderr: -179> 2024-09-14T11:06:52.397+0000 7f8f83dfd640 1 monclient: found mon.noname-c 2024-09-14T11:06:52.701 INFO:tasks.workunit.client.0.smithi097.stderr: -178> 2024-09-14T11:06:52.397+0000 7f8f83dfd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:06:52.701 INFO:tasks.workunit.client.0.smithi097.stderr: -177> 2024-09-14T11:06:52.397+0000 7f8e617fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:06:52.702 INFO:tasks.workunit.client.0.smithi097.stderr: -176> 2024-09-14T11:06:52.397+0000 7f8e617fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:06:52.702 INFO:tasks.workunit.client.0.smithi097.stderr: -175> 2024-09-14T11:06:52.397+0000 7f8e617fa640 10 monclient: dump: 2024-09-14T11:06:52.702 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:06:52.702 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:06:52.702 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:52.702 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:52.702 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:06:52.702 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:06:52.702 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:06:52.702 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:06:52.702 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:06:52.702 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:52.702 INFO:tasks.workunit.client.0.smithi097.stderr: -174> 2024-09-14T11:06:52.397+0000 7f8e617fa640 10 monclient: _finish_auth 0 2024-09-14T11:06:52.703 INFO:tasks.workunit.client.0.smithi097.stderr: -173> 2024-09-14T11:06:52.397+0000 7f8e617fa640 10 monclient: _check_auth_tickets 2024-09-14T11:06:52.703 INFO:tasks.workunit.client.0.smithi097.stderr: -172> 2024-09-14T11:06:52.397+0000 7f8e617fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:06:52.703 INFO:tasks.workunit.client.0.smithi097.stderr: -171> 2024-09-14T11:06:52.397+0000 7f8e617fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:06:52.703 INFO:tasks.workunit.client.0.smithi097.stderr: -170> 2024-09-14T11:06:52.397+0000 7f8e617fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:06:52.703 INFO:tasks.workunit.client.0.smithi097.stderr: -169> 2024-09-14T11:06:52.397+0000 7f8e617fa640 10 monclient: dump: 2024-09-14T11:06:52.703 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:06:52.703 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:06:52.703 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:52.703 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:52.703 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:06:52.703 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:06:52.703 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:06:52.703 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:06:52.703 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:06:52.704 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:52.704 INFO:tasks.workunit.client.0.smithi097.stderr: -168> 2024-09-14T11:06:52.397+0000 7f8f8630c800 5 monclient: authenticate success, global_id 7547 2024-09-14T11:06:52.704 INFO:tasks.workunit.client.0.smithi097.stderr: -167> 2024-09-14T11:06:52.397+0000 7f8e62ffd640 4 set_mon_vals no callback set 2024-09-14T11:06:52.704 INFO:tasks.workunit.client.0.smithi097.stderr: -166> 2024-09-14T11:06:52.397+0000 7f8f8630c800 10 monclient: _renew_subs 2024-09-14T11:06:52.704 INFO:tasks.workunit.client.0.smithi097.stderr: -165> 2024-09-14T11:06:52.397+0000 7f8f8630c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:06:52.704 INFO:tasks.workunit.client.0.smithi097.stderr: -164> 2024-09-14T11:06:52.397+0000 7f8f8630c800 10 monclient: _renew_subs 2024-09-14T11:06:52.704 INFO:tasks.workunit.client.0.smithi097.stderr: -163> 2024-09-14T11:06:52.397+0000 7f8f8630c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:06:52.704 INFO:tasks.workunit.client.0.smithi097.stderr: -162> 2024-09-14T11:06:52.397+0000 7f8f8630c800 1 librados: init done 2024-09-14T11:06:52.704 INFO:tasks.workunit.client.0.smithi097.stderr: -161> 2024-09-14T11:06:52.397+0000 7f8f8630c800 5 asok(0x561e7838e270) register_command cr dump hook 0x561e786785c8 2024-09-14T11:06:52.704 INFO:tasks.workunit.client.0.smithi097.stderr: -160> 2024-09-14T11:06:52.399+0000 7f8f8630c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.704 INFO:tasks.workunit.client.0.smithi097.stderr: -159> 2024-09-14T11:06:52.399+0000 7f8e617fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:06:52.704 INFO:tasks.workunit.client.0.smithi097.stderr: -158> 2024-09-14T11:06:52.399+0000 7f8e617fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:06:52.704 INFO:tasks.workunit.client.0.smithi097.stderr: -157> 2024-09-14T11:06:52.399+0000 7f8e617fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:06:52.705 INFO:tasks.workunit.client.0.smithi097.stderr: -156> 2024-09-14T11:06:52.399+0000 7f8f7b5fc640 10 monclient: get_auth_request con 0x7f8e4c077230 auth_method 0 2024-09-14T11:06:52.705 INFO:tasks.workunit.client.0.smithi097.stderr: -155> 2024-09-14T11:06:52.400+0000 7f8f845fe640 10 monclient: get_auth_request con 0x561e7869b030 auth_method 0 2024-09-14T11:06:52.705 INFO:tasks.workunit.client.0.smithi097.stderr: -154> 2024-09-14T11:06:52.400+0000 7f8f8630c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:52.705 INFO:tasks.workunit.client.0.smithi097.stderr: -153> 2024-09-14T11:06:52.400+0000 7f8f8630c800 20 realm 2024-09-14T11:06:52.705 INFO:tasks.workunit.client.0.smithi097.stderr: -152> 2024-09-14T11:06:52.400+0000 7f8f8630c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.705 INFO:tasks.workunit.client.0.smithi097.stderr: -151> 2024-09-14T11:06:52.400+0000 7f8f8630c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:52.705 INFO:tasks.workunit.client.0.smithi097.stderr: -150> 2024-09-14T11:06:52.400+0000 7f8f8630c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:06:52.705 INFO:tasks.workunit.client.0.smithi097.stderr: -149> 2024-09-14T11:06:52.400+0000 7f8f8630c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.705 INFO:tasks.workunit.client.0.smithi097.stderr: -148> 2024-09-14T11:06:52.401+0000 7f8f8630c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:52.705 INFO:tasks.workunit.client.0.smithi097.stderr: -147> 2024-09-14T11:06:52.401+0000 7f8f8630c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.705 INFO:tasks.workunit.client.0.smithi097.stderr: -146> 2024-09-14T11:06:52.401+0000 7f8f7b5fc640 10 monclient: get_auth_request con 0x561e7869f210 auth_method 0 2024-09-14T11:06:52.705 INFO:tasks.workunit.client.0.smithi097.stderr: -145> 2024-09-14T11:06:52.401+0000 7f8f8630c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:52.705 INFO:tasks.workunit.client.0.smithi097.stderr: -144> 2024-09-14T11:06:52.401+0000 7f8f8630c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.705 INFO:tasks.workunit.client.0.smithi097.stderr: -143> 2024-09-14T11:06:52.401+0000 7f8f845fe640 10 monclient: get_auth_request con 0x561e786a2a70 auth_method 0 2024-09-14T11:06:52.706 INFO:tasks.workunit.client.0.smithi097.stderr: -142> 2024-09-14T11:06:52.402+0000 7f8f8630c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:06:52.706 INFO:tasks.workunit.client.0.smithi097.stderr: -141> 2024-09-14T11:06:52.402+0000 7f8f8630c800 20 searching for the correct realm 2024-09-14T11:06:52.706 INFO:tasks.workunit.client.0.smithi097.stderr: -140> 2024-09-14T11:06:52.402+0000 7f8f83dfd640 10 monclient: get_auth_request con 0x561e786a7780 auth_method 0 2024-09-14T11:06:52.706 INFO:tasks.workunit.client.0.smithi097.stderr: -139> 2024-09-14T11:06:52.403+0000 7f8f7b5fc640 10 monclient: get_auth_request con 0x7f8f74011c80 auth_method 0 2024-09-14T11:06:52.706 INFO:tasks.workunit.client.0.smithi097.stderr: -138> 2024-09-14T11:06:52.404+0000 7f8f845fe640 10 monclient: get_auth_request con 0x7f8f6c063070 auth_method 0 2024-09-14T11:06:52.706 INFO:tasks.workunit.client.0.smithi097.stderr: -137> 2024-09-14T11:06:52.404+0000 7f8f845fe640 0 -- 172.21.15.97:0/1685494170 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f8f6c063070 msgr2=0x7f8f6c089940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:06:52.706 INFO:tasks.workunit.client.0.smithi097.stderr: -136> 2024-09-14T11:06:52.605+0000 7f8f845fe640 10 monclient: get_auth_request con 0x7f8f6c063070 auth_method 0 2024-09-14T11:06:52.706 INFO:tasks.workunit.client.0.smithi097.stderr: -135> 2024-09-14T11:06:52.608+0000 7f8f83dfd640 10 monclient: get_auth_request con 0x7f8f6c0a2910 auth_method 0 2024-09-14T11:06:52.706 INFO:tasks.workunit.client.0.smithi097.stderr: -134> 2024-09-14T11:06:52.609+0000 7f8f7b5fc640 10 monclient: get_auth_request con 0x7f8f74019670 auth_method 0 2024-09-14T11:06:52.706 INFO:tasks.workunit.client.0.smithi097.stderr: -133> 2024-09-14T11:06:52.609+0000 7f8f7b5fc640 0 -- 172.21.15.97:0/1685494170 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f8f74019670 msgr2=0x7f8f7407e4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:52.706 INFO:tasks.workunit.client.0.smithi097.stderr: -132> 2024-09-14T11:06:52.609+0000 7f8e617fa640 1 client.7547.objecter ms_handle_reset 0x7f8f74019670 session 0x7f8f740640c0 osd.3 2024-09-14T11:06:52.706 INFO:tasks.workunit.client.0.smithi097.stderr: -131> 2024-09-14T11:06:52.609+0000 7f8e617fa640 10 monclient: _renew_subs 2024-09-14T11:06:52.706 INFO:tasks.workunit.client.0.smithi097.stderr: -130> 2024-09-14T11:06:52.609+0000 7f8e617fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:06:52.706 INFO:tasks.workunit.client.0.smithi097.stderr: -129> 2024-09-14T11:06:52.609+0000 7f8f7b5fc640 10 monclient: get_auth_request con 0x7f8e4c086d50 auth_method 0 2024-09-14T11:06:52.707 INFO:tasks.workunit.client.0.smithi097.stderr: -128> 2024-09-14T11:06:52.614+0000 7f8f8630c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:06:52.707 INFO:tasks.workunit.client.0.smithi097.stderr: -127> 2024-09-14T11:06:52.614+0000 7f8f8630c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:06:52.707 INFO:tasks.workunit.client.0.smithi097.stderr: -126> 2024-09-14T11:06:52.614+0000 7f8f8630c800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:06:52.707 INFO:tasks.workunit.client.0.smithi097.stderr: -125> 2024-09-14T11:06:52.614+0000 7f8f8630c800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:06:52.707 INFO:tasks.workunit.client.0.smithi097.stderr: -124> 2024-09-14T11:06:52.614+0000 7f8f8630c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:06:52.707 INFO:tasks.workunit.client.0.smithi097.stderr: -123> 2024-09-14T11:06:52.614+0000 7f8f8630c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:06:52.707 INFO:tasks.workunit.client.0.smithi097.stderr: -122> 2024-09-14T11:06:52.614+0000 7f8f8630c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.707 INFO:tasks.workunit.client.0.smithi097.stderr: -121> 2024-09-14T11:06:52.614+0000 7f8f8630c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:52.707 INFO:tasks.workunit.client.0.smithi097.stderr: -120> 2024-09-14T11:06:52.614+0000 7f8f8630c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.707 INFO:tasks.workunit.client.0.smithi097.stderr: -119> 2024-09-14T11:06:52.615+0000 7f8f8630c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:52.707 INFO:tasks.workunit.client.0.smithi097.stderr: -118> 2024-09-14T11:06:52.615+0000 7f8f8630c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.707 INFO:tasks.workunit.client.0.smithi097.stderr: -117> 2024-09-14T11:06:52.615+0000 7f8f8630c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:06:52.707 INFO:tasks.workunit.client.0.smithi097.stderr: -116> 2024-09-14T11:06:52.615+0000 7f8f8630c800 20 zone default found 2024-09-14T11:06:52.707 INFO:tasks.workunit.client.0.smithi097.stderr: -115> 2024-09-14T11:06:52.615+0000 7f8f8630c800 4 Realm: () 2024-09-14T11:06:52.708 INFO:tasks.workunit.client.0.smithi097.stderr: -114> 2024-09-14T11:06:52.615+0000 7f8f8630c800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:06:52.708 INFO:tasks.workunit.client.0.smithi097.stderr: -113> 2024-09-14T11:06:52.615+0000 7f8f8630c800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:06:52.708 INFO:tasks.workunit.client.0.smithi097.stderr: -112> 2024-09-14T11:06:52.615+0000 7f8f8630c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:06:52.708 INFO:tasks.workunit.client.0.smithi097.stderr: -111> 2024-09-14T11:06:52.615+0000 7f8f8630c800 20 zonegroup default 2024-09-14T11:06:52.708 INFO:tasks.workunit.client.0.smithi097.stderr: -110> 2024-09-14T11:06:52.615+0000 7f8f8630c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.708 INFO:tasks.workunit.client.0.smithi097.stderr: -109> 2024-09-14T11:06:52.615+0000 7f8f8630c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:52.708 INFO:tasks.workunit.client.0.smithi097.stderr: -108> 2024-09-14T11:06:52.615+0000 7f8f8630c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.708 INFO:tasks.workunit.client.0.smithi097.stderr: -107> 2024-09-14T11:06:52.616+0000 7f8f8630c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:52.708 INFO:tasks.workunit.client.0.smithi097.stderr: -106> 2024-09-14T11:06:52.616+0000 7f8f8630c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.708 INFO:tasks.workunit.client.0.smithi097.stderr: -105> 2024-09-14T11:06:52.616+0000 7f8f8630c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:52.708 INFO:tasks.workunit.client.0.smithi097.stderr: -104> 2024-09-14T11:06:52.616+0000 7f8f8630c800 20 started sync module instance, tier type = 2024-09-14T11:06:52.708 INFO:tasks.workunit.client.0.smithi097.stderr: -103> 2024-09-14T11:06:52.616+0000 7f8f8630c800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:06:52.708 INFO:tasks.workunit.client.0.smithi097.stderr: -102> 2024-09-14T11:06:52.625+0000 7f8f8630c800 20 add_watcher() i=0 2024-09-14T11:06:52.708 INFO:tasks.workunit.client.0.smithi097.stderr: -101> 2024-09-14T11:06:52.625+0000 7f8f8630c800 20 add_watcher() i=1 2024-09-14T11:06:52.709 INFO:tasks.workunit.client.0.smithi097.stderr: -100> 2024-09-14T11:06:52.625+0000 7f8f8630c800 20 add_watcher() i=2 2024-09-14T11:06:52.709 INFO:tasks.workunit.client.0.smithi097.stderr: -99> 2024-09-14T11:06:52.625+0000 7f8f8630c800 20 add_watcher() i=3 2024-09-14T11:06:52.709 INFO:tasks.workunit.client.0.smithi097.stderr: -98> 2024-09-14T11:06:52.625+0000 7f8f8630c800 20 add_watcher() i=4 2024-09-14T11:06:52.709 INFO:tasks.workunit.client.0.smithi097.stderr: -97> 2024-09-14T11:06:52.625+0000 7f8f8630c800 20 add_watcher() i=5 2024-09-14T11:06:52.709 INFO:tasks.workunit.client.0.smithi097.stderr: -96> 2024-09-14T11:06:52.625+0000 7f8f8630c800 20 add_watcher() i=6 2024-09-14T11:06:52.709 INFO:tasks.workunit.client.0.smithi097.stderr: -95> 2024-09-14T11:06:52.626+0000 7f8f8630c800 20 add_watcher() i=7 2024-09-14T11:06:52.709 INFO:tasks.workunit.client.0.smithi097.stderr: -94> 2024-09-14T11:06:52.626+0000 7f8f8630c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:06:52.709 INFO:tasks.workunit.client.0.smithi097.stderr: -93> 2024-09-14T11:06:52.628+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29640) adding auth protocol: cephx 2024-09-14T11:06:52.709 INFO:tasks.workunit.client.0.smithi097.stderr: -92> 2024-09-14T11:06:52.628+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29640) adding auth protocol: cephx 2024-09-14T11:06:52.709 INFO:tasks.workunit.client.0.smithi097.stderr: -91> 2024-09-14T11:06:52.628+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29640) adding auth protocol: cephx 2024-09-14T11:06:52.709 INFO:tasks.workunit.client.0.smithi097.stderr: -90> 2024-09-14T11:06:52.628+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29640) adding con mode: secure 2024-09-14T11:06:52.709 INFO:tasks.workunit.client.0.smithi097.stderr: -89> 2024-09-14T11:06:52.628+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29640) adding con mode: crc 2024-09-14T11:06:52.710 INFO:tasks.workunit.client.0.smithi097.stderr: -88> 2024-09-14T11:06:52.628+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29640) adding con mode: secure 2024-09-14T11:06:52.710 INFO:tasks.workunit.client.0.smithi097.stderr: -87> 2024-09-14T11:06:52.628+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29640) adding con mode: crc 2024-09-14T11:06:52.710 INFO:tasks.workunit.client.0.smithi097.stderr: -86> 2024-09-14T11:06:52.628+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29640) adding con mode: secure 2024-09-14T11:06:52.710 INFO:tasks.workunit.client.0.smithi097.stderr: -85> 2024-09-14T11:06:52.628+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29640) adding con mode: crc 2024-09-14T11:06:52.710 INFO:tasks.workunit.client.0.smithi097.stderr: -84> 2024-09-14T11:06:52.628+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29640) adding con mode: crc 2024-09-14T11:06:52.710 INFO:tasks.workunit.client.0.smithi097.stderr: -83> 2024-09-14T11:06:52.628+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29640) adding con mode: secure 2024-09-14T11:06:52.710 INFO:tasks.workunit.client.0.smithi097.stderr: -82> 2024-09-14T11:06:52.628+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29640) adding con mode: crc 2024-09-14T11:06:52.710 INFO:tasks.workunit.client.0.smithi097.stderr: -81> 2024-09-14T11:06:52.628+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29640) adding con mode: secure 2024-09-14T11:06:52.710 INFO:tasks.workunit.client.0.smithi097.stderr: -80> 2024-09-14T11:06:52.628+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29640) adding con mode: crc 2024-09-14T11:06:52.711 INFO:tasks.workunit.client.0.smithi097.stderr: -79> 2024-09-14T11:06:52.628+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29640) adding con mode: secure 2024-09-14T11:06:52.711 INFO:tasks.workunit.client.0.smithi097.stderr: -78> 2024-09-14T11:06:52.628+0000 7f8e39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:52.711 INFO:tasks.workunit.client.0.smithi097.stderr: -77> 2024-09-14T11:06:52.628+0000 7f8f8630c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:06:52.711 INFO:tasks.workunit.client.0.smithi097.stderr: -76> 2024-09-14T11:06:52.628+0000 7f8f8630c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:06:52.711 INFO:tasks.workunit.client.0.smithi097.stderr: -75> 2024-09-14T11:06:52.628+0000 7f8f8630c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:06:52.711 INFO:tasks.workunit.client.0.smithi097.stderr: -74> 2024-09-14T11:06:52.628+0000 7f8f8630c800 5 asok(0x561e7838e270) register_command cache list hook 0x561e78675d30 2024-09-14T11:06:52.711 INFO:tasks.workunit.client.0.smithi097.stderr: -73> 2024-09-14T11:06:52.628+0000 7f8f8630c800 5 asok(0x561e7838e270) register_command cache inspect hook 0x561e78675d30 2024-09-14T11:06:52.711 INFO:tasks.workunit.client.0.smithi097.stderr: -72> 2024-09-14T11:06:52.628+0000 7f8f8630c800 5 asok(0x561e7838e270) register_command cache erase hook 0x561e78675d30 2024-09-14T11:06:52.711 INFO:tasks.workunit.client.0.smithi097.stderr: -71> 2024-09-14T11:06:52.628+0000 7f8f8630c800 5 asok(0x561e7838e270) register_command cache zap hook 0x561e78675d30 2024-09-14T11:06:52.711 INFO:tasks.workunit.client.0.smithi097.stderr: -70> 2024-09-14T11:06:52.628+0000 7f8f8630c800 5 note: GC not initialized 2024-09-14T11:06:52.711 INFO:tasks.workunit.client.0.smithi097.stderr: -69> 2024-09-14T11:06:52.628+0000 7f8e38fe1640 20 reqs_thread_entry: start 2024-09-14T11:06:52.711 INFO:tasks.workunit.client.0.smithi097.stderr: -68> 2024-09-14T11:06:52.628+0000 7f8f8630c800 5 asok(0x561e7838e270) register_command sync trace show hook 0x7f8f7c017620 2024-09-14T11:06:52.712 INFO:tasks.workunit.client.0.smithi097.stderr: -67> 2024-09-14T11:06:52.628+0000 7f8f8630c800 5 asok(0x561e7838e270) register_command sync trace history hook 0x7f8f7c017620 2024-09-14T11:06:52.712 INFO:tasks.workunit.client.0.smithi097.stderr: -66> 2024-09-14T11:06:52.628+0000 7f8f8630c800 5 asok(0x561e7838e270) register_command sync trace active hook 0x7f8f7c017620 2024-09-14T11:06:52.712 INFO:tasks.workunit.client.0.smithi097.stderr: -65> 2024-09-14T11:06:52.628+0000 7f8f8630c800 5 asok(0x561e7838e270) register_command sync trace active_short hook 0x7f8f7c017620 2024-09-14T11:06:52.712 INFO:tasks.workunit.client.0.smithi097.stderr: -64> 2024-09-14T11:06:52.628+0000 7f8f8630c800 20 init_complete bucket index max shards: 11 2024-09-14T11:06:52.712 INFO:tasks.workunit.client.0.smithi097.stderr: -63> 2024-09-14T11:06:52.628+0000 7f8f8630c800 20 Filter name: none 2024-09-14T11:06:52.712 INFO:tasks.workunit.client.0.smithi097.stderr: -62> 2024-09-14T11:06:52.628+0000 7f8db27fc640 20 reqs_thread_entry: start 2024-09-14T11:06:52.712 INFO:tasks.workunit.client.0.smithi097.stderr: -61> 2024-09-14T11:06:52.628+0000 7f8f8630c800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:06:52.712 INFO:tasks.workunit.client.0.smithi097.stderr: -60> 2024-09-14T11:06:52.628+0000 7f8f8630c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.712 INFO:tasks.workunit.client.0.smithi097.stderr: -59> 2024-09-14T11:06:52.629+0000 7f8f8630c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:06:52.712 INFO:tasks.workunit.client.0.smithi097.stderr: -58> 2024-09-14T11:06:52.629+0000 7f8f8630c800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:06:52.712 INFO:tasks.workunit.client.0.smithi097.stderr: -57> 2024-09-14T11:06:52.629+0000 7f8f8630c800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:06:52.712 INFO:tasks.workunit.client.0.smithi097.stderr: -56> 2024-09-14T11:06:52.629+0000 7f8f8630c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 : miss 2024-09-14T11:06:52.712 INFO:tasks.workunit.client.0.smithi097.stderr: -55> 2024-09-14T11:06:52.629+0000 7f8f8630c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.713 INFO:tasks.workunit.client.0.smithi097.stderr: -54> 2024-09-14T11:06:52.629+0000 7f8f8630c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:06:52.713 INFO:tasks.workunit.client.0.smithi097.stderr: -53> 2024-09-14T11:06:52.629+0000 7f8f8630c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 info.flags=0x17 2024-09-14T11:06:52.713 INFO:tasks.workunit.client.0.smithi097.stderr: -52> 2024-09-14T11:06:52.629+0000 7f8f8630c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 to cache LRU end 2024-09-14T11:06:52.713 INFO:tasks.workunit.client.0.smithi097.stderr: -51> 2024-09-14T11:06:52.629+0000 7f8f8630c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:06:52.713 INFO:tasks.workunit.client.0.smithi097.stderr: -50> 2024-09-14T11:06:52.629+0000 7f8f8630c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:52.713 INFO:tasks.workunit.client.0.smithi097.stderr: -49> 2024-09-14T11:06:52.629+0000 7f8f8630c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 2024-09-14T11:06:52.713 INFO:tasks.workunit.client.0.smithi097.stderr: -48> 2024-09-14T11:06:52.635+0000 7f8f8630c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 info.flags=0x17 2024-09-14T11:06:52.713 INFO:tasks.workunit.client.0.smithi097.stderr: -47> 2024-09-14T11:06:52.635+0000 7f8f8630c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 to cache LRU end 2024-09-14T11:06:52.713 INFO:tasks.workunit.client.0.smithi097.stderr: -46> 2024-09-14T11:06:52.635+0000 7f8f8630c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:52.713 INFO:tasks.workunit.client.0.smithi097.stderr: -45> 2024-09-14T11:06:52.635+0000 7f8f8630c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39, ofs0, ns] 2024-09-14T11:06:52.713 INFO:tasks.workunit.client.0.smithi097.stderr: -44> 2024-09-14T11:06:52.635+0000 7f8e627fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595104 cookie 94688869274624 notifier 7547 bl.length()=931 2024-09-14T11:06:52.713 INFO:tasks.workunit.client.0.smithi097.stderr: -43> 2024-09-14T11:06:52.635+0000 7f8e627fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 info.flags=0x17 2024-09-14T11:06:52.713 INFO:tasks.workunit.client.0.smithi097.stderr: -42> 2024-09-14T11:06:52.635+0000 7f8e627fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 to cache LRU end 2024-09-14T11:06:52.714 INFO:tasks.workunit.client.0.smithi097.stderr: -41> 2024-09-14T11:06:52.635+0000 7f8e627fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:52.714 INFO:tasks.workunit.client.0.smithi097.stderr: -40> 2024-09-14T11:06:52.636+0000 7f8f8630c800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39]): orig_sources= new_sources= 2024-09-14T11:06:52.714 INFO:tasks.workunit.client.0.smithi097.stderr: -39> 2024-09-14T11:06:52.636+0000 7f8f8630c800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39]): potential sources added=[] removed=[] 2024-09-14T11:06:52.714 INFO:tasks.workunit.client.0.smithi097.stderr: -38> 2024-09-14T11:06:52.636+0000 7f8f8630c800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39]): orig_dests= new_dests= 2024-09-14T11:06:52.714 INFO:tasks.workunit.client.0.smithi097.stderr: -37> 2024-09-14T11:06:52.636+0000 7f8f8630c800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39]): potential dests added=[] removed=[] 2024-09-14T11:06:52.714 INFO:tasks.workunit.client.0.smithi097.stderr: -36> 2024-09-14T11:06:52.641+0000 7f8f8630c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.0 2024-09-14T11:06:52.714 INFO:tasks.workunit.client.0.smithi097.stderr: -35> 2024-09-14T11:06:52.641+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.0 2024-09-14T11:06:52.714 INFO:tasks.workunit.client.0.smithi097.stderr: -34> 2024-09-14T11:06:52.641+0000 7f8f8630c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.1 2024-09-14T11:06:52.714 INFO:tasks.workunit.client.0.smithi097.stderr: -33> 2024-09-14T11:06:52.641+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.1 2024-09-14T11:06:52.714 INFO:tasks.workunit.client.0.smithi097.stderr: -32> 2024-09-14T11:06:52.641+0000 7f8f8630c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.2 2024-09-14T11:06:52.714 INFO:tasks.workunit.client.0.smithi097.stderr: -31> 2024-09-14T11:06:52.641+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.2 2024-09-14T11:06:52.714 INFO:tasks.workunit.client.0.smithi097.stderr: -30> 2024-09-14T11:06:52.641+0000 7f8f8630c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.3 2024-09-14T11:06:52.715 INFO:tasks.workunit.client.0.smithi097.stderr: -29> 2024-09-14T11:06:52.641+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.3 2024-09-14T11:06:52.715 INFO:tasks.workunit.client.0.smithi097.stderr: -28> 2024-09-14T11:06:52.641+0000 7f8f8630c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.4 2024-09-14T11:06:52.715 INFO:tasks.workunit.client.0.smithi097.stderr: -27> 2024-09-14T11:06:52.641+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.4 2024-09-14T11:06:52.715 INFO:tasks.workunit.client.0.smithi097.stderr: -26> 2024-09-14T11:06:52.641+0000 7f8f8630c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.5 2024-09-14T11:06:52.715 INFO:tasks.workunit.client.0.smithi097.stderr: -25> 2024-09-14T11:06:52.641+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.5 2024-09-14T11:06:52.715 INFO:tasks.workunit.client.0.smithi097.stderr: -24> 2024-09-14T11:06:52.641+0000 7f8f8630c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.6 2024-09-14T11:06:52.715 INFO:tasks.workunit.client.0.smithi097.stderr: -23> 2024-09-14T11:06:52.641+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.6 2024-09-14T11:06:52.715 INFO:tasks.workunit.client.0.smithi097.stderr: -22> 2024-09-14T11:06:52.641+0000 7f8f8630c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.7 2024-09-14T11:06:52.715 INFO:tasks.workunit.client.0.smithi097.stderr: -21> 2024-09-14T11:06:52.641+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.7 2024-09-14T11:06:52.715 INFO:tasks.workunit.client.0.smithi097.stderr: -20> 2024-09-14T11:06:52.641+0000 7f8f8630c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.8 2024-09-14T11:06:52.715 INFO:tasks.workunit.client.0.smithi097.stderr: -19> 2024-09-14T11:06:52.641+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.8 2024-09-14T11:06:52.715 INFO:tasks.workunit.client.0.smithi097.stderr: -18> 2024-09-14T11:06:52.641+0000 7f8f8630c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.9 2024-09-14T11:06:52.715 INFO:tasks.workunit.client.0.smithi097.stderr: -17> 2024-09-14T11:06:52.641+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.9 2024-09-14T11:06:52.715 INFO:tasks.workunit.client.0.smithi097.stderr: -16> 2024-09-14T11:06:52.641+0000 7f8f8630c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.10 2024-09-14T11:06:52.716 INFO:tasks.workunit.client.0.smithi097.stderr: -15> 2024-09-14T11:06:52.641+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.10 2024-09-14T11:06:52.716 INFO:tasks.workunit.client.0.smithi097.stderr: -14> 2024-09-14T11:06:52.641+0000 7f8f8630c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.11 2024-09-14T11:06:52.716 INFO:tasks.workunit.client.0.smithi097.stderr: -13> 2024-09-14T11:06:52.641+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.11 2024-09-14T11:06:52.716 INFO:tasks.workunit.client.0.smithi097.stderr: -12> 2024-09-14T11:06:52.641+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.0 2024-09-14T11:06:52.716 INFO:tasks.workunit.client.0.smithi097.stderr: -11> 2024-09-14T11:06:52.641+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1 2024-09-14T11:06:52.716 INFO:tasks.workunit.client.0.smithi097.stderr: -10> 2024-09-14T11:06:52.642+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.2 2024-09-14T11:06:52.716 INFO:tasks.workunit.client.0.smithi097.stderr: -9> 2024-09-14T11:06:52.642+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.3 2024-09-14T11:06:52.716 INFO:tasks.workunit.client.0.smithi097.stderr: -8> 2024-09-14T11:06:52.642+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.4 2024-09-14T11:06:52.716 INFO:tasks.workunit.client.0.smithi097.stderr: -7> 2024-09-14T11:06:52.643+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.5 2024-09-14T11:06:52.716 INFO:tasks.workunit.client.0.smithi097.stderr: -6> 2024-09-14T11:06:52.643+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.6 2024-09-14T11:06:52.716 INFO:tasks.workunit.client.0.smithi097.stderr: -5> 2024-09-14T11:06:52.644+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.7 2024-09-14T11:06:52.716 INFO:tasks.workunit.client.0.smithi097.stderr: -4> 2024-09-14T11:06:52.644+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.8 2024-09-14T11:06:52.716 INFO:tasks.workunit.client.0.smithi097.stderr: -3> 2024-09-14T11:06:52.644+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.9 2024-09-14T11:06:52.717 INFO:tasks.workunit.client.0.smithi097.stderr: -2> 2024-09-14T11:06:52.645+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.10 2024-09-14T11:06:52.717 INFO:tasks.workunit.client.0.smithi097.stderr: -1> 2024-09-14T11:06:52.650+0000 7f8f8630c800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8f8630c800 time 2024-09-14T11:06:52.650806+0000 2024-09-14T11:06:52.717 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:06:52.717 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:52.717 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:06:52.717 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8f8978c76a] 2024-09-14T11:06:52.717 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f8f8978c928] 2024-09-14T11:06:52.717 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561e7798b0b1] 2024-09-14T11:06:52.717 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x561e7799a124] 2024-09-14T11:06:52.717 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x561e7799afc4] 2024-09-14T11:06:52.717 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-14T11:06:52.717 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f8f88429590] 2024-09-14T11:06:52.717 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-14T11:06:52.718 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-14T11:06:52.718 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:52.718 INFO:tasks.workunit.client.0.smithi097.stderr: 0> 2024-09-14T11:06:52.651+0000 7f8f8630c800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:06:52.718 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f8f8630c800 thread_name:radosgw-admin 2024-09-14T11:06:52.718 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:52.718 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:06:52.718 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8f8843e6f0] 2024-09-14T11:06:52.718 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f8f8848b99c] 2024-09-14T11:06:52.718 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-14T11:06:52.718 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-14T11:06:52.718 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8f8978c7c4] 2024-09-14T11:06:52.718 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f8f8978c928] 2024-09-14T11:06:52.718 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561e7798b0b1] 2024-09-14T11:06:52.718 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x561e7799a124] 2024-09-14T11:06:52.719 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x561e7799afc4] 2024-09-14T11:06:52.719 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-14T11:06:52.719 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f8f88429590] 2024-09-14T11:06:52.719 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-14T11:06:52.719 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-14T11:06:52.719 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:06:52.719 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:52.719 INFO:tasks.workunit.client.0.smithi097.stderr:--- logging levels --- 2024-09-14T11:06:52.719 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 none 2024-09-14T11:06:52.719 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 lockdep 2024-09-14T11:06:52.719 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 context 2024-09-14T11:06:52.719 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 crush 2024-09-14T11:06:52.719 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds 2024-09-14T11:06:52.719 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_balancer 2024-09-14T11:06:52.720 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_locker 2024-09-14T11:06:52.720 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log 2024-09-14T11:06:52.720 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log_expire 2024-09-14T11:06:52.720 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_migrator 2024-09-14T11:06:52.720 INFO:tasks.workunit.client.0.smithi097.stderr: 3/ 5 mds_quiesce 2024-09-14T11:06:52.720 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 buffer 2024-09-14T11:06:52.720 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 timer 2024-09-14T11:06:52.720 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 filer 2024-09-14T11:06:52.720 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 striper 2024-09-14T11:06:52.720 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 objecter 2024-09-14T11:06:52.720 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rados 2024-09-14T11:06:52.720 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd 2024-09-14T11:06:52.720 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_mirror 2024-09-14T11:06:52.721 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_replay 2024-09-14T11:06:52.721 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_pwl 2024-09-14T11:06:52.721 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 journaler 2024-09-14T11:06:52.721 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objectcacher 2024-09-14T11:06:52.721 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:06:52.721 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 client 2024-09-14T11:06:52.721 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 osd 2024-09-14T11:06:52.721 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 optracker 2024-09-14T11:06:52.722 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objclass 2024-09-14T11:06:52.722 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 filestore 2024-09-14T11:06:52.722 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 journal 2024-09-14T11:06:52.722 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 ms 2024-09-14T11:06:52.722 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mon 2024-09-14T11:06:52.722 INFO:tasks.workunit.client.0.smithi097.stderr: 0/10 monc 2024-09-14T11:06:52.722 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 paxos 2024-09-14T11:06:52.722 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 tp 2024-09-14T11:06:52.722 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 auth 2024-09-14T11:06:52.722 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 crypto 2024-09-14T11:06:52.722 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 finisher 2024-09-14T11:06:52.722 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 reserver 2024-09-14T11:06:52.722 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 heartbeatmap 2024-09-14T11:06:52.723 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 perfcounter 2024-09-14T11:06:52.723 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw 2024-09-14T11:06:52.723 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_sync 2024-09-14T11:06:52.723 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_datacache 2024-09-14T11:06:52.723 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_access 2024-09-14T11:06:52.723 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:06:52.723 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_flight 2024-09-14T11:06:52.723 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:06:52.723 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw_notification 2024-09-14T11:06:52.723 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 javaclient 2024-09-14T11:06:52.723 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 asok 2024-09-14T11:06:52.723 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 throttle 2024-09-14T11:06:52.724 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 refs 2024-09-14T11:06:52.724 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 compressor 2024-09-14T11:06:52.724 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluestore 2024-09-14T11:06:52.724 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluefs 2024-09-14T11:06:52.724 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 bdev 2024-09-14T11:06:52.724 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 kstore 2024-09-14T11:06:52.724 INFO:tasks.workunit.client.0.smithi097.stderr: 4/ 5 rocksdb 2024-09-14T11:06:52.724 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 fuse 2024-09-14T11:06:52.724 INFO:tasks.workunit.client.0.smithi097.stderr: 2/ 5 mgr 2024-09-14T11:06:52.724 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mgrc 2024-09-14T11:06:52.724 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 dpdk 2024-09-14T11:06:52.724 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 eventtrace 2024-09-14T11:06:52.724 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 prioritycache 2024-09-14T11:06:52.725 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 test 2024-09-14T11:06:52.725 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:06:52.725 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephsqlite 2024-09-14T11:06:52.725 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:06:52.725 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore 2024-09-14T11:06:52.725 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_onode 2024-09-14T11:06:52.725 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_odata 2024-09-14T11:06:52.725 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_omap 2024-09-14T11:06:52.725 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_tm 2024-09-14T11:06:52.725 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_t 2024-09-14T11:06:52.725 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:06:52.725 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_epm 2024-09-14T11:06:52.725 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_lba 2024-09-14T11:06:52.726 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:06:52.726 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cache 2024-09-14T11:06:52.726 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_journal 2024-09-14T11:06:52.726 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_device 2024-09-14T11:06:52.726 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_backref 2024-09-14T11:06:52.726 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 alienstore 2024-09-14T11:06:52.726 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mclock 2024-09-14T11:06:52.726 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cyanstore 2024-09-14T11:06:52.726 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 ceph_exporter 2024-09-14T11:06:52.726 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 memstore 2024-09-14T11:06:52.726 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 trace 2024-09-14T11:06:52.726 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 ceph_dedup 2024-09-14T11:06:52.727 INFO:tasks.workunit.client.0.smithi097.stderr: -2/-2 (syslog threshold) 2024-09-14T11:06:52.727 INFO:tasks.workunit.client.0.smithi097.stderr: 99/99 (stderr threshold) 2024-09-14T11:06:52.727 INFO:tasks.workunit.client.0.smithi097.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:06:52.727 INFO:tasks.workunit.client.0.smithi097.stderr: 7f8db27fc640 / http_manager 2024-09-14T11:06:52.727 INFO:tasks.workunit.client.0.smithi097.stderr: 7f8e38fe1640 / http_manager 2024-09-14T11:06:52.727 INFO:tasks.workunit.client.0.smithi097.stderr: 7f8e39fe3640 / rgw_dt_lg_renew 2024-09-14T11:06:52.727 INFO:tasks.workunit.client.0.smithi097.stderr: 7f8e617fa640 / ms_dispatch 2024-09-14T11:06:52.727 INFO:tasks.workunit.client.0.smithi097.stderr: 7f8e627fc640 / io_context_pool 2024-09-14T11:06:52.727 INFO:tasks.workunit.client.0.smithi097.stderr: 7f8e62ffd640 / io_context_pool 2024-09-14T11:06:52.727 INFO:tasks.workunit.client.0.smithi097.stderr: 7f8e697fa640 / ms_dispatch 2024-09-14T11:06:52.727 INFO:tasks.workunit.client.0.smithi097.stderr: 7f8e6bfff640 / ms_dispatch 2024-09-14T11:06:52.727 INFO:tasks.workunit.client.0.smithi097.stderr: 7f8e71e0b640 / io_context_pool 2024-09-14T11:06:52.728 INFO:tasks.workunit.client.0.smithi097.stderr: 7f8f7b5fc640 / msgr-worker-2 2024-09-14T11:06:52.728 INFO:tasks.workunit.client.0.smithi097.stderr: 7f8f83dfd640 / msgr-worker-1 2024-09-14T11:06:52.728 INFO:tasks.workunit.client.0.smithi097.stderr: 7f8f845fe640 / msgr-worker-0 2024-09-14T11:06:52.728 INFO:tasks.workunit.client.0.smithi097.stderr: 7f8f84dff640 / io_context_pool 2024-09-14T11:06:52.728 INFO:tasks.workunit.client.0.smithi097.stderr: 7f8f8630c800 / radosgw-admin 2024-09-14T11:06:52.728 INFO:tasks.workunit.client.0.smithi097.stderr: max_recent 500 2024-09-14T11:06:52.728 INFO:tasks.workunit.client.0.smithi097.stderr: max_new 1000 2024-09-14T11:06:52.728 INFO:tasks.workunit.client.0.smithi097.stderr: log_file /var/log/ceph/ceph-client.admin.142781.log 2024-09-14T11:06:52.728 INFO:tasks.workunit.client.0.smithi097.stderr:--- end dump of recent events --- 2024-09-14T11:06:52.728 INFO:tasks.workunit.client.0.smithi097.stderr:--- begin dump of recent events --- 2024-09-14T11:06:52.728 INFO:tasks.workunit.client.0.smithi097.stderr: -499> 2024-09-14T11:06:52.383+0000 7f8f8630c800 5 AuthRegistry(0x561e785ad1b0) adding con mode: crc 2024-09-14T11:06:52.728 INFO:tasks.workunit.client.0.smithi097.stderr: -498> 2024-09-14T11:06:52.383+0000 7f8f8630c800 5 AuthRegistry(0x561e785ad1b0) adding con mode: secure 2024-09-14T11:06:52.728 INFO:tasks.workunit.client.0.smithi097.stderr: -497> 2024-09-14T11:06:52.383+0000 7f8f8630c800 5 AuthRegistry(0x561e785ad1b0) adding con mode: crc 2024-09-14T11:06:52.729 INFO:tasks.workunit.client.0.smithi097.stderr: -496> 2024-09-14T11:06:52.383+0000 7f8f8630c800 5 AuthRegistry(0x561e785ad1b0) adding con mode: crc 2024-09-14T11:06:52.729 INFO:tasks.workunit.client.0.smithi097.stderr: -495> 2024-09-14T11:06:52.383+0000 7f8f8630c800 5 AuthRegistry(0x561e785ad1b0) adding con mode: secure 2024-09-14T11:06:52.729 INFO:tasks.workunit.client.0.smithi097.stderr: -494> 2024-09-14T11:06:52.383+0000 7f8f8630c800 5 AuthRegistry(0x561e785ad1b0) adding con mode: crc 2024-09-14T11:06:52.729 INFO:tasks.workunit.client.0.smithi097.stderr: -493> 2024-09-14T11:06:52.383+0000 7f8f8630c800 5 AuthRegistry(0x561e785ad1b0) adding con mode: secure 2024-09-14T11:06:52.729 INFO:tasks.workunit.client.0.smithi097.stderr: -492> 2024-09-14T11:06:52.383+0000 7f8f8630c800 5 AuthRegistry(0x561e785ad1b0) adding con mode: crc 2024-09-14T11:06:52.729 INFO:tasks.workunit.client.0.smithi097.stderr: -491> 2024-09-14T11:06:52.383+0000 7f8f8630c800 5 AuthRegistry(0x561e785ad1b0) adding con mode: secure 2024-09-14T11:06:52.729 INFO:tasks.workunit.client.0.smithi097.stderr: -490> 2024-09-14T11:06:52.384+0000 7f8f8630c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:06:52.729 INFO:tasks.workunit.client.0.smithi097.stderr: -489> 2024-09-14T11:06:52.384+0000 7f8f8630c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:06:52.729 INFO:tasks.workunit.client.0.smithi097.stderr: -488> 2024-09-14T11:06:52.384+0000 7f8f8630c800 5 asok(0x561e7838e270) register_command rotate-key hook 0x561e785ad2f8 2024-09-14T11:06:52.729 INFO:tasks.workunit.client.0.smithi097.stderr: -487> 2024-09-14T11:06:52.384+0000 7f8f8630c800 10 monclient: _reopen_session rank -1 2024-09-14T11:06:52.729 INFO:tasks.workunit.client.0.smithi097.stderr: -486> 2024-09-14T11:06:52.384+0000 7f8f8630c800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:06:52.729 INFO:tasks.workunit.client.0.smithi097.stderr: -485> 2024-09-14T11:06:52.384+0000 7f8f8630c800 10 monclient(hunting): picked mon.noname-a con 0x561e78459760 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:06:52.729 INFO:tasks.workunit.client.0.smithi097.stderr: -484> 2024-09-14T11:06:52.384+0000 7f8f8630c800 10 monclient(hunting): picked mon.noname-b con 0x561e78459b40 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:06:52.730 INFO:tasks.workunit.client.0.smithi097.stderr: -483> 2024-09-14T11:06:52.384+0000 7f8f8630c800 10 monclient(hunting): picked mon.noname-c con 0x561e784f3550 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:06:52.730 INFO:tasks.workunit.client.0.smithi097.stderr: -482> 2024-09-14T11:06:52.384+0000 7f8f8630c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:52.730 INFO:tasks.workunit.client.0.smithi097.stderr: -481> 2024-09-14T11:06:52.384+0000 7f8f8630c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:52.730 INFO:tasks.workunit.client.0.smithi097.stderr: -480> 2024-09-14T11:06:52.384+0000 7f8f8630c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:52.730 INFO:tasks.workunit.client.0.smithi097.stderr: -479> 2024-09-14T11:06:52.384+0000 7f8f8630c800 10 monclient(hunting): _renew_subs 2024-09-14T11:06:52.730 INFO:tasks.workunit.client.0.smithi097.stderr: -478> 2024-09-14T11:06:52.384+0000 7f8f8630c800 10 monclient(hunting): authenticate will time out at 2094.037338s 2024-09-14T11:06:52.730 INFO:tasks.workunit.client.0.smithi097.stderr: -477> 2024-09-14T11:06:52.384+0000 7f8f83dfd640 10 monclient(hunting): get_auth_request con 0x561e78459760 auth_method 0 2024-09-14T11:06:52.730 INFO:tasks.workunit.client.0.smithi097.stderr: -476> 2024-09-14T11:06:52.384+0000 7f8f83dfd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:06:52.730 INFO:tasks.workunit.client.0.smithi097.stderr: -475> 2024-09-14T11:06:52.384+0000 7f8f83dfd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:06:52.730 INFO:tasks.workunit.client.0.smithi097.stderr: -474> 2024-09-14T11:06:52.384+0000 7f8f83dfd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:06:52.730 INFO:tasks.workunit.client.0.smithi097.stderr: -473> 2024-09-14T11:06:52.384+0000 7f8f845fe640 10 monclient(hunting): get_auth_request con 0x561e784f3550 auth_method 0 2024-09-14T11:06:52.730 INFO:tasks.workunit.client.0.smithi097.stderr: -472> 2024-09-14T11:06:52.384+0000 7f8f845fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:06:52.731 INFO:tasks.workunit.client.0.smithi097.stderr: -471> 2024-09-14T11:06:52.384+0000 7f8f845fe640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:06:52.731 INFO:tasks.workunit.client.0.smithi097.stderr: -470> 2024-09-14T11:06:52.384+0000 7f8f845fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:06:52.731 INFO:tasks.workunit.client.0.smithi097.stderr: -469> 2024-09-14T11:06:52.384+0000 7f8f83dfd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:06:52.731 INFO:tasks.workunit.client.0.smithi097.stderr: -468> 2024-09-14T11:06:52.384+0000 7f8f83dfd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:06:52.731 INFO:tasks.workunit.client.0.smithi097.stderr: -467> 2024-09-14T11:06:52.384+0000 7f8f83dfd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:06:52.731 INFO:tasks.workunit.client.0.smithi097.stderr: -466> 2024-09-14T11:06:52.384+0000 7f8f845fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:06:52.731 INFO:tasks.workunit.client.0.smithi097.stderr: -465> 2024-09-14T11:06:52.384+0000 7f8f845fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:06:52.731 INFO:tasks.workunit.client.0.smithi097.stderr: -464> 2024-09-14T11:06:52.384+0000 7f8f845fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:06:52.731 INFO:tasks.workunit.client.0.smithi097.stderr: -463> 2024-09-14T11:06:52.384+0000 7f8f83dfd640 10 monclient(hunting): handle_auth_done global_id 8019 payload 824 2024-09-14T11:06:52.731 INFO:tasks.workunit.client.0.smithi097.stderr: -462> 2024-09-14T11:06:52.384+0000 7f8f83dfd640 10 monclient: _finish_hunting 0 2024-09-14T11:06:52.732 INFO:tasks.workunit.client.0.smithi097.stderr: -461> 2024-09-14T11:06:52.384+0000 7f8f83dfd640 1 monclient: found mon.noname-a 2024-09-14T11:06:52.732 INFO:tasks.workunit.client.0.smithi097.stderr: -460> 2024-09-14T11:06:52.384+0000 7f8f83dfd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-14T11:06:52.732 INFO:tasks.workunit.client.0.smithi097.stderr: -459> 2024-09-14T11:06:52.384+0000 7f8e6bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:06:52.732 INFO:tasks.workunit.client.0.smithi097.stderr: -458> 2024-09-14T11:06:52.384+0000 7f8e6bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:06:52.732 INFO:tasks.workunit.client.0.smithi097.stderr: -457> 2024-09-14T11:06:52.384+0000 7f8e6bfff640 10 monclient: dump: 2024-09-14T11:06:52.732 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:06:52.732 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:06:52.732 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:52.732 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:52.732 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:06:52.732 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:06:52.732 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:06:52.732 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:06:52.733 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:06:52.733 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:52.733 INFO:tasks.workunit.client.0.smithi097.stderr: -456> 2024-09-14T11:06:52.384+0000 7f8e6bfff640 10 monclient: _finish_auth 0 2024-09-14T11:06:52.733 INFO:tasks.workunit.client.0.smithi097.stderr: -455> 2024-09-14T11:06:52.384+0000 7f8e6bfff640 10 monclient: _check_auth_tickets 2024-09-14T11:06:52.733 INFO:tasks.workunit.client.0.smithi097.stderr: -454> 2024-09-14T11:06:52.384+0000 7f8f8630c800 5 monclient: authenticate success, global_id 8019 2024-09-14T11:06:52.733 INFO:tasks.workunit.client.0.smithi097.stderr: -453> 2024-09-14T11:06:52.384+0000 7f8e6bfff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:06:52.733 INFO:tasks.workunit.client.0.smithi097.stderr: -452> 2024-09-14T11:06:52.384+0000 7f8e6bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:06:52.733 INFO:tasks.workunit.client.0.smithi097.stderr: -451> 2024-09-14T11:06:52.384+0000 7f8e6bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:06:52.733 INFO:tasks.workunit.client.0.smithi097.stderr: -450> 2024-09-14T11:06:52.384+0000 7f8e6bfff640 10 monclient: dump: 2024-09-14T11:06:52.733 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:06:52.733 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:06:52.733 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:52.733 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:52.734 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:06:52.734 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:06:52.734 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:06:52.734 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:06:52.734 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:06:52.734 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:52.734 INFO:tasks.workunit.client.0.smithi097.stderr: -449> 2024-09-14T11:06:52.385+0000 7f8f8630c800 10 monclient: _renew_subs 2024-09-14T11:06:52.734 INFO:tasks.workunit.client.0.smithi097.stderr: -448> 2024-09-14T11:06:52.385+0000 7f8f8630c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:06:52.734 INFO:tasks.workunit.client.0.smithi097.stderr: -447> 2024-09-14T11:06:52.384+0000 7f8e71e0b640 4 set_mon_vals no callback set 2024-09-14T11:06:52.734 INFO:tasks.workunit.client.0.smithi097.stderr: -446> 2024-09-14T11:06:52.385+0000 7f8f8630c800 10 monclient: _renew_subs 2024-09-14T11:06:52.734 INFO:tasks.workunit.client.0.smithi097.stderr: -445> 2024-09-14T11:06:52.385+0000 7f8f8630c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:06:52.734 INFO:tasks.workunit.client.0.smithi097.stderr: -444> 2024-09-14T11:06:52.385+0000 7f8f8630c800 1 librados: init done 2024-09-14T11:06:52.735 INFO:tasks.workunit.client.0.smithi097.stderr: -443> 2024-09-14T11:06:52.386+0000 7f8e6bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:06:52.735 INFO:tasks.workunit.client.0.smithi097.stderr: -442> 2024-09-14T11:06:52.386+0000 7f8e6bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:06:52.735 INFO:tasks.workunit.client.0.smithi097.stderr: -441> 2024-09-14T11:06:52.386+0000 7f8e6bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:06:52.735 INFO:tasks.workunit.client.0.smithi097.stderr: -440> 2024-09-14T11:06:52.387+0000 7f8f7b5fc640 10 monclient: get_auth_request con 0x7f8e6c077230 auth_method 0 2024-09-14T11:06:52.735 INFO:tasks.workunit.client.0.smithi097.stderr: -439> 2024-09-14T11:06:52.387+0000 7f8f845fe640 10 monclient: get_auth_request con 0x561e785d6020 auth_method 0 2024-09-14T11:06:52.735 INFO:tasks.workunit.client.0.smithi097.stderr: -438> 2024-09-14T11:06:52.388+0000 7f8f83dfd640 10 monclient: get_auth_request con 0x561e785f8fb0 auth_method 0 2024-09-14T11:06:52.735 INFO:tasks.workunit.client.0.smithi097.stderr: -437> 2024-09-14T11:06:52.388+0000 7f8f7b5fc640 10 monclient: get_auth_request con 0x561e785fd310 auth_method 0 2024-09-14T11:06:52.735 INFO:tasks.workunit.client.0.smithi097.stderr: -436> 2024-09-14T11:06:52.389+0000 7f8f845fe640 10 monclient: get_auth_request con 0x561e785fc870 auth_method 0 2024-09-14T11:06:52.735 INFO:tasks.workunit.client.0.smithi097.stderr: -435> 2024-09-14T11:06:52.390+0000 7f8f8630c800 10 monclient: build_initial_monmap 2024-09-14T11:06:52.735 INFO:tasks.workunit.client.0.smithi097.stderr: -434> 2024-09-14T11:06:52.390+0000 7f8f8630c800 1 build_initial for_mkfs: 0 2024-09-14T11:06:52.735 INFO:tasks.workunit.client.0.smithi097.stderr: -433> 2024-09-14T11:06:52.390+0000 7f8f8630c800 10 monclient: monmap: 2024-09-14T11:06:52.735 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:06:52.735 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:06:52.735 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:06:52.736 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:06:52.736 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:06:52.736 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:06:52.736 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:06:52.736 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:06:52.736 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:06:52.736 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:52.736 INFO:tasks.workunit.client.0.smithi097.stderr: -432> 2024-09-14T11:06:52.390+0000 7f8f8630c800 5 AuthRegistry(0x561e78605470) adding auth protocol: cephx 2024-09-14T11:06:52.736 INFO:tasks.workunit.client.0.smithi097.stderr: -431> 2024-09-14T11:06:52.390+0000 7f8f8630c800 5 AuthRegistry(0x561e78605470) adding auth protocol: cephx 2024-09-14T11:06:52.736 INFO:tasks.workunit.client.0.smithi097.stderr: -430> 2024-09-14T11:06:52.390+0000 7f8f8630c800 5 AuthRegistry(0x561e78605470) adding auth protocol: cephx 2024-09-14T11:06:52.736 INFO:tasks.workunit.client.0.smithi097.stderr: -429> 2024-09-14T11:06:52.390+0000 7f8f8630c800 5 AuthRegistry(0x561e78605470) adding con mode: secure 2024-09-14T11:06:52.736 INFO:tasks.workunit.client.0.smithi097.stderr: -428> 2024-09-14T11:06:52.390+0000 7f8f8630c800 5 AuthRegistry(0x561e78605470) adding con mode: crc 2024-09-14T11:06:52.736 INFO:tasks.workunit.client.0.smithi097.stderr: -427> 2024-09-14T11:06:52.390+0000 7f8f8630c800 5 AuthRegistry(0x561e78605470) adding con mode: secure 2024-09-14T11:06:52.736 INFO:tasks.workunit.client.0.smithi097.stderr: -426> 2024-09-14T11:06:52.390+0000 7f8f8630c800 5 AuthRegistry(0x561e78605470) adding con mode: crc 2024-09-14T11:06:52.737 INFO:tasks.workunit.client.0.smithi097.stderr: -425> 2024-09-14T11:06:52.390+0000 7f8f8630c800 5 AuthRegistry(0x561e78605470) adding con mode: secure 2024-09-14T11:06:52.737 INFO:tasks.workunit.client.0.smithi097.stderr: -424> 2024-09-14T11:06:52.390+0000 7f8f8630c800 5 AuthRegistry(0x561e78605470) adding con mode: crc 2024-09-14T11:06:52.737 INFO:tasks.workunit.client.0.smithi097.stderr: -423> 2024-09-14T11:06:52.390+0000 7f8f8630c800 5 AuthRegistry(0x561e78605470) adding con mode: crc 2024-09-14T11:06:52.737 INFO:tasks.workunit.client.0.smithi097.stderr: -422> 2024-09-14T11:06:52.390+0000 7f8f8630c800 5 AuthRegistry(0x561e78605470) adding con mode: secure 2024-09-14T11:06:52.737 INFO:tasks.workunit.client.0.smithi097.stderr: -421> 2024-09-14T11:06:52.390+0000 7f8f8630c800 5 AuthRegistry(0x561e78605470) adding con mode: crc 2024-09-14T11:06:52.737 INFO:tasks.workunit.client.0.smithi097.stderr: -420> 2024-09-14T11:06:52.390+0000 7f8f8630c800 5 AuthRegistry(0x561e78605470) adding con mode: secure 2024-09-14T11:06:52.737 INFO:tasks.workunit.client.0.smithi097.stderr: -419> 2024-09-14T11:06:52.390+0000 7f8f8630c800 5 AuthRegistry(0x561e78605470) adding con mode: crc 2024-09-14T11:06:52.737 INFO:tasks.workunit.client.0.smithi097.stderr: -418> 2024-09-14T11:06:52.390+0000 7f8f8630c800 5 AuthRegistry(0x561e78605470) adding con mode: secure 2024-09-14T11:06:52.737 INFO:tasks.workunit.client.0.smithi097.stderr: -417> 2024-09-14T11:06:52.390+0000 7f8f8630c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:06:52.737 INFO:tasks.workunit.client.0.smithi097.stderr: -416> 2024-09-14T11:06:52.390+0000 7f8f8630c800 5 asok(0x561e7838e270) register_command objecter_requests cmddesc objecter_requests hook 0x561e78608940 EEXIST 2024-09-14T11:06:52.737 INFO:tasks.workunit.client.0.smithi097.stderr: -415> 2024-09-14T11:06:52.391+0000 7f8f8630c800 10 monclient: init 2024-09-14T11:06:52.737 INFO:tasks.workunit.client.0.smithi097.stderr: -414> 2024-09-14T11:06:52.391+0000 7f8f8630c800 5 AuthRegistry(0x561e78604368) adding auth protocol: cephx 2024-09-14T11:06:52.737 INFO:tasks.workunit.client.0.smithi097.stderr: -413> 2024-09-14T11:06:52.391+0000 7f8f8630c800 5 AuthRegistry(0x561e78604368) adding auth protocol: cephx 2024-09-14T11:06:52.737 INFO:tasks.workunit.client.0.smithi097.stderr: -412> 2024-09-14T11:06:52.391+0000 7f8f8630c800 5 AuthRegistry(0x561e78604368) adding auth protocol: cephx 2024-09-14T11:06:52.738 INFO:tasks.workunit.client.0.smithi097.stderr: -411> 2024-09-14T11:06:52.391+0000 7f8f8630c800 5 AuthRegistry(0x561e78604368) adding con mode: secure 2024-09-14T11:06:52.738 INFO:tasks.workunit.client.0.smithi097.stderr: -410> 2024-09-14T11:06:52.391+0000 7f8f8630c800 5 AuthRegistry(0x561e78604368) adding con mode: crc 2024-09-14T11:06:52.738 INFO:tasks.workunit.client.0.smithi097.stderr: -409> 2024-09-14T11:06:52.391+0000 7f8f8630c800 5 AuthRegistry(0x561e78604368) adding con mode: secure 2024-09-14T11:06:52.738 INFO:tasks.workunit.client.0.smithi097.stderr: -408> 2024-09-14T11:06:52.391+0000 7f8f8630c800 5 AuthRegistry(0x561e78604368) adding con mode: crc 2024-09-14T11:06:52.738 INFO:tasks.workunit.client.0.smithi097.stderr: -407> 2024-09-14T11:06:52.391+0000 7f8f8630c800 5 AuthRegistry(0x561e78604368) adding con mode: secure 2024-09-14T11:06:52.738 INFO:tasks.workunit.client.0.smithi097.stderr: -406> 2024-09-14T11:06:52.391+0000 7f8f8630c800 5 AuthRegistry(0x561e78604368) adding con mode: crc 2024-09-14T11:06:52.738 INFO:tasks.workunit.client.0.smithi097.stderr: -405> 2024-09-14T11:06:52.391+0000 7f8f8630c800 5 AuthRegistry(0x561e78604368) adding con mode: crc 2024-09-14T11:06:52.738 INFO:tasks.workunit.client.0.smithi097.stderr: -404> 2024-09-14T11:06:52.391+0000 7f8f8630c800 5 AuthRegistry(0x561e78604368) adding con mode: secure 2024-09-14T11:06:52.738 INFO:tasks.workunit.client.0.smithi097.stderr: -403> 2024-09-14T11:06:52.391+0000 7f8f8630c800 5 AuthRegistry(0x561e78604368) adding con mode: crc 2024-09-14T11:06:52.738 INFO:tasks.workunit.client.0.smithi097.stderr: -402> 2024-09-14T11:06:52.391+0000 7f8f8630c800 5 AuthRegistry(0x561e78604368) adding con mode: secure 2024-09-14T11:06:52.738 INFO:tasks.workunit.client.0.smithi097.stderr: -401> 2024-09-14T11:06:52.391+0000 7f8f8630c800 5 AuthRegistry(0x561e78604368) adding con mode: crc 2024-09-14T11:06:52.738 INFO:tasks.workunit.client.0.smithi097.stderr: -400> 2024-09-14T11:06:52.391+0000 7f8f8630c800 5 AuthRegistry(0x561e78604368) adding con mode: secure 2024-09-14T11:06:52.738 INFO:tasks.workunit.client.0.smithi097.stderr: -399> 2024-09-14T11:06:52.391+0000 7f8f8630c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:06:52.738 INFO:tasks.workunit.client.0.smithi097.stderr: -398> 2024-09-14T11:06:52.391+0000 7f8f8630c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:06:52.739 INFO:tasks.workunit.client.0.smithi097.stderr: -397> 2024-09-14T11:06:52.391+0000 7f8f8630c800 5 asok(0x561e7838e270) register_command rotate-key cmddesc rotate-key hook 0x561e786044b0 EEXIST 2024-09-14T11:06:52.739 INFO:tasks.workunit.client.0.smithi097.stderr: -396> 2024-09-14T11:06:52.391+0000 7f8f8630c800 10 monclient: _reopen_session rank -1 2024-09-14T11:06:52.739 INFO:tasks.workunit.client.0.smithi097.stderr: -395> 2024-09-14T11:06:52.391+0000 7f8f8630c800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:06:52.739 INFO:tasks.workunit.client.0.smithi097.stderr: -394> 2024-09-14T11:06:52.391+0000 7f8f8630c800 10 monclient(hunting): picked mon.noname-b con 0x561e7862cc60 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:06:52.739 INFO:tasks.workunit.client.0.smithi097.stderr: -393> 2024-09-14T11:06:52.391+0000 7f8f8630c800 10 monclient(hunting): picked mon.noname-a con 0x561e7862d040 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:06:52.739 INFO:tasks.workunit.client.0.smithi097.stderr: -392> 2024-09-14T11:06:52.391+0000 7f8f8630c800 10 monclient(hunting): picked mon.noname-c con 0x561e7862b970 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:06:52.739 INFO:tasks.workunit.client.0.smithi097.stderr: -391> 2024-09-14T11:06:52.391+0000 7f8f8630c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:52.739 INFO:tasks.workunit.client.0.smithi097.stderr: -390> 2024-09-14T11:06:52.391+0000 7f8f8630c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:52.739 INFO:tasks.workunit.client.0.smithi097.stderr: -389> 2024-09-14T11:06:52.391+0000 7f8f8630c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:52.739 INFO:tasks.workunit.client.0.smithi097.stderr: -388> 2024-09-14T11:06:52.391+0000 7f8f8630c800 10 monclient(hunting): _renew_subs 2024-09-14T11:06:52.739 INFO:tasks.workunit.client.0.smithi097.stderr: -387> 2024-09-14T11:06:52.391+0000 7f8f8630c800 10 monclient(hunting): authenticate will time out at 2094.044549s 2024-09-14T11:06:52.739 INFO:tasks.workunit.client.0.smithi097.stderr: -386> 2024-09-14T11:06:52.391+0000 7f8f83dfd640 10 monclient(hunting): get_auth_request con 0x561e7862b970 auth_method 0 2024-09-14T11:06:52.739 INFO:tasks.workunit.client.0.smithi097.stderr: -385> 2024-09-14T11:06:52.391+0000 7f8f83dfd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:06:52.739 INFO:tasks.workunit.client.0.smithi097.stderr: -384> 2024-09-14T11:06:52.391+0000 7f8f83dfd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:06:52.739 INFO:tasks.workunit.client.0.smithi097.stderr: -383> 2024-09-14T11:06:52.391+0000 7f8f83dfd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:06:52.740 INFO:tasks.workunit.client.0.smithi097.stderr: -382> 2024-09-14T11:06:52.391+0000 7f8f845fe640 10 monclient(hunting): get_auth_request con 0x561e7862d040 auth_method 0 2024-09-14T11:06:52.740 INFO:tasks.workunit.client.0.smithi097.stderr: -381> 2024-09-14T11:06:52.391+0000 7f8f845fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:06:52.740 INFO:tasks.workunit.client.0.smithi097.stderr: -380> 2024-09-14T11:06:52.391+0000 7f8f845fe640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:06:52.740 INFO:tasks.workunit.client.0.smithi097.stderr: -379> 2024-09-14T11:06:52.391+0000 7f8f845fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:06:52.740 INFO:tasks.workunit.client.0.smithi097.stderr: -378> 2024-09-14T11:06:52.391+0000 7f8f7b5fc640 10 monclient(hunting): get_auth_request con 0x561e7862cc60 auth_method 0 2024-09-14T11:06:52.740 INFO:tasks.workunit.client.0.smithi097.stderr: -377> 2024-09-14T11:06:52.391+0000 7f8f7b5fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:06:52.740 INFO:tasks.workunit.client.0.smithi097.stderr: -376> 2024-09-14T11:06:52.391+0000 7f8f7b5fc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:06:52.740 INFO:tasks.workunit.client.0.smithi097.stderr: -375> 2024-09-14T11:06:52.391+0000 7f8f7b5fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:06:52.740 INFO:tasks.workunit.client.0.smithi097.stderr: -374> 2024-09-14T11:06:52.391+0000 7f8f83dfd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:06:52.740 INFO:tasks.workunit.client.0.smithi097.stderr: -373> 2024-09-14T11:06:52.391+0000 7f8f83dfd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:06:52.740 INFO:tasks.workunit.client.0.smithi097.stderr: -372> 2024-09-14T11:06:52.391+0000 7f8f83dfd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:06:52.741 INFO:tasks.workunit.client.0.smithi097.stderr: -371> 2024-09-14T11:06:52.391+0000 7f8f845fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:06:52.741 INFO:tasks.workunit.client.0.smithi097.stderr: -370> 2024-09-14T11:06:52.391+0000 7f8f845fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:06:52.741 INFO:tasks.workunit.client.0.smithi097.stderr: -369> 2024-09-14T11:06:52.391+0000 7f8f845fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:06:52.741 INFO:tasks.workunit.client.0.smithi097.stderr: -368> 2024-09-14T11:06:52.391+0000 7f8f7b5fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:06:52.741 INFO:tasks.workunit.client.0.smithi097.stderr: -367> 2024-09-14T11:06:52.391+0000 7f8f7b5fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:06:52.741 INFO:tasks.workunit.client.0.smithi097.stderr: -366> 2024-09-14T11:06:52.391+0000 7f8f7b5fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:06:52.741 INFO:tasks.workunit.client.0.smithi097.stderr: -365> 2024-09-14T11:06:52.391+0000 7f8f83dfd640 10 monclient(hunting): handle_auth_done global_id 7541 payload 824 2024-09-14T11:06:52.741 INFO:tasks.workunit.client.0.smithi097.stderr: -364> 2024-09-14T11:06:52.391+0000 7f8f83dfd640 10 monclient: _finish_hunting 0 2024-09-14T11:06:52.741 INFO:tasks.workunit.client.0.smithi097.stderr: -363> 2024-09-14T11:06:52.391+0000 7f8f83dfd640 1 monclient: found mon.noname-c 2024-09-14T11:06:52.741 INFO:tasks.workunit.client.0.smithi097.stderr: -362> 2024-09-14T11:06:52.391+0000 7f8f83dfd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:06:52.741 INFO:tasks.workunit.client.0.smithi097.stderr: -361> 2024-09-14T11:06:52.392+0000 7f8e697fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:06:52.741 INFO:tasks.workunit.client.0.smithi097.stderr: -360> 2024-09-14T11:06:52.392+0000 7f8e697fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:06:52.741 INFO:tasks.workunit.client.0.smithi097.stderr: -359> 2024-09-14T11:06:52.392+0000 7f8e697fa640 10 monclient: dump: 2024-09-14T11:06:52.742 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:06:52.742 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:06:52.742 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:52.742 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:52.742 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:06:52.742 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:06:52.742 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:06:52.742 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:06:52.742 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:06:52.742 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:52.742 INFO:tasks.workunit.client.0.smithi097.stderr: -358> 2024-09-14T11:06:52.392+0000 7f8e697fa640 10 monclient: _finish_auth 0 2024-09-14T11:06:52.742 INFO:tasks.workunit.client.0.smithi097.stderr: -357> 2024-09-14T11:06:52.392+0000 7f8e697fa640 10 monclient: _check_auth_tickets 2024-09-14T11:06:52.742 INFO:tasks.workunit.client.0.smithi097.stderr: -356> 2024-09-14T11:06:52.392+0000 7f8e697fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:06:52.742 INFO:tasks.workunit.client.0.smithi097.stderr: -355> 2024-09-14T11:06:52.392+0000 7f8e697fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:06:52.743 INFO:tasks.workunit.client.0.smithi097.stderr: -354> 2024-09-14T11:06:52.392+0000 7f8e697fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:06:52.743 INFO:tasks.workunit.client.0.smithi097.stderr: -353> 2024-09-14T11:06:52.392+0000 7f8e697fa640 10 monclient: dump: 2024-09-14T11:06:52.743 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:06:52.743 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:06:52.743 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:52.743 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:52.743 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:06:52.743 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:06:52.743 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:06:52.743 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:06:52.743 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:06:52.743 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:52.743 INFO:tasks.workunit.client.0.smithi097.stderr: -352> 2024-09-14T11:06:52.392+0000 7f8f8630c800 5 monclient: authenticate success, global_id 7541 2024-09-14T11:06:52.743 INFO:tasks.workunit.client.0.smithi097.stderr: -351> 2024-09-14T11:06:52.392+0000 7f8f8630c800 10 monclient: _renew_subs 2024-09-14T11:06:52.743 INFO:tasks.workunit.client.0.smithi097.stderr: -350> 2024-09-14T11:06:52.392+0000 7f8f8630c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:06:52.744 INFO:tasks.workunit.client.0.smithi097.stderr: -349> 2024-09-14T11:06:52.392+0000 7f8f84dff640 4 set_mon_vals no callback set 2024-09-14T11:06:52.744 INFO:tasks.workunit.client.0.smithi097.stderr: -348> 2024-09-14T11:06:52.392+0000 7f8f8630c800 10 monclient: _renew_subs 2024-09-14T11:06:52.744 INFO:tasks.workunit.client.0.smithi097.stderr: -347> 2024-09-14T11:06:52.392+0000 7f8f8630c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:06:52.744 INFO:tasks.workunit.client.0.smithi097.stderr: -346> 2024-09-14T11:06:52.393+0000 7f8e697fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:06:52.744 INFO:tasks.workunit.client.0.smithi097.stderr: -345> 2024-09-14T11:06:52.393+0000 7f8e697fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:06:52.744 INFO:tasks.workunit.client.0.smithi097.stderr: -344> 2024-09-14T11:06:52.393+0000 7f8e697fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:06:52.744 INFO:tasks.workunit.client.0.smithi097.stderr: -343> 2024-09-14T11:06:52.393+0000 7f8f7b5fc640 10 monclient: get_auth_request con 0x7f8e5c077140 auth_method 0 2024-09-14T11:06:52.744 INFO:tasks.workunit.client.0.smithi097.stderr: -342> 2024-09-14T11:06:52.394+0000 7f8f8630c800 10 monclient: get_monmap_and_config 2024-09-14T11:06:52.744 INFO:tasks.workunit.client.0.smithi097.stderr: -341> 2024-09-14T11:06:52.394+0000 7f8f8630c800 10 monclient: build_initial_monmap 2024-09-14T11:06:52.744 INFO:tasks.workunit.client.0.smithi097.stderr: -340> 2024-09-14T11:06:52.394+0000 7f8f8630c800 1 build_initial for_mkfs: 0 2024-09-14T11:06:52.744 INFO:tasks.workunit.client.0.smithi097.stderr: -339> 2024-09-14T11:06:52.394+0000 7f8f8630c800 10 monclient: monmap: 2024-09-14T11:06:52.744 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:06:52.745 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:06:52.745 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:06:52.745 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:06:52.745 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:06:52.745 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:06:52.745 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:06:52.745 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:06:52.745 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:06:52.745 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:52.745 INFO:tasks.workunit.client.0.smithi097.stderr: -338> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x561e7864c990) adding auth protocol: cephx 2024-09-14T11:06:52.745 INFO:tasks.workunit.client.0.smithi097.stderr: -337> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x561e7864c990) adding auth protocol: cephx 2024-09-14T11:06:52.745 INFO:tasks.workunit.client.0.smithi097.stderr: -336> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x561e7864c990) adding auth protocol: cephx 2024-09-14T11:06:52.745 INFO:tasks.workunit.client.0.smithi097.stderr: -335> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x561e7864c990) adding con mode: secure 2024-09-14T11:06:52.745 INFO:tasks.workunit.client.0.smithi097.stderr: -334> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x561e7864c990) adding con mode: crc 2024-09-14T11:06:52.746 INFO:tasks.workunit.client.0.smithi097.stderr: -333> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x561e7864c990) adding con mode: secure 2024-09-14T11:06:52.746 INFO:tasks.workunit.client.0.smithi097.stderr: -332> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x561e7864c990) adding con mode: crc 2024-09-14T11:06:52.746 INFO:tasks.workunit.client.0.smithi097.stderr: -331> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x561e7864c990) adding con mode: secure 2024-09-14T11:06:52.746 INFO:tasks.workunit.client.0.smithi097.stderr: -330> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x561e7864c990) adding con mode: crc 2024-09-14T11:06:52.746 INFO:tasks.workunit.client.0.smithi097.stderr: -329> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x561e7864c990) adding con mode: crc 2024-09-14T11:06:52.746 INFO:tasks.workunit.client.0.smithi097.stderr: -328> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x561e7864c990) adding con mode: secure 2024-09-14T11:06:52.746 INFO:tasks.workunit.client.0.smithi097.stderr: -327> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x561e7864c990) adding con mode: crc 2024-09-14T11:06:52.746 INFO:tasks.workunit.client.0.smithi097.stderr: -326> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x561e7864c990) adding con mode: secure 2024-09-14T11:06:52.746 INFO:tasks.workunit.client.0.smithi097.stderr: -325> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x561e7864c990) adding con mode: crc 2024-09-14T11:06:52.746 INFO:tasks.workunit.client.0.smithi097.stderr: -324> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x561e7864c990) adding con mode: secure 2024-09-14T11:06:52.746 INFO:tasks.workunit.client.0.smithi097.stderr: -323> 2024-09-14T11:06:52.394+0000 7f8f8630c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:06:52.746 INFO:tasks.workunit.client.0.smithi097.stderr: -322> 2024-09-14T11:06:52.394+0000 7f8f8630c800 10 monclient: init 2024-09-14T11:06:52.746 INFO:tasks.workunit.client.0.smithi097.stderr: -321> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29160) adding auth protocol: cephx 2024-09-14T11:06:52.747 INFO:tasks.workunit.client.0.smithi097.stderr: -320> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29160) adding auth protocol: cephx 2024-09-14T11:06:52.747 INFO:tasks.workunit.client.0.smithi097.stderr: -319> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29160) adding auth protocol: cephx 2024-09-14T11:06:52.747 INFO:tasks.workunit.client.0.smithi097.stderr: -318> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29160) adding con mode: secure 2024-09-14T11:06:52.747 INFO:tasks.workunit.client.0.smithi097.stderr: -317> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29160) adding con mode: crc 2024-09-14T11:06:52.747 INFO:tasks.workunit.client.0.smithi097.stderr: -316> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29160) adding con mode: secure 2024-09-14T11:06:52.747 INFO:tasks.workunit.client.0.smithi097.stderr: -315> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29160) adding con mode: crc 2024-09-14T11:06:52.747 INFO:tasks.workunit.client.0.smithi097.stderr: -314> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29160) adding con mode: secure 2024-09-14T11:06:52.747 INFO:tasks.workunit.client.0.smithi097.stderr: -313> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29160) adding con mode: crc 2024-09-14T11:06:52.747 INFO:tasks.workunit.client.0.smithi097.stderr: -312> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29160) adding con mode: crc 2024-09-14T11:06:52.747 INFO:tasks.workunit.client.0.smithi097.stderr: -311> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29160) adding con mode: secure 2024-09-14T11:06:52.747 INFO:tasks.workunit.client.0.smithi097.stderr: -310> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29160) adding con mode: crc 2024-09-14T11:06:52.747 INFO:tasks.workunit.client.0.smithi097.stderr: -309> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29160) adding con mode: secure 2024-09-14T11:06:52.747 INFO:tasks.workunit.client.0.smithi097.stderr: -308> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29160) adding con mode: crc 2024-09-14T11:06:52.748 INFO:tasks.workunit.client.0.smithi097.stderr: -307> 2024-09-14T11:06:52.394+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29160) adding con mode: secure 2024-09-14T11:06:52.748 INFO:tasks.workunit.client.0.smithi097.stderr: -306> 2024-09-14T11:06:52.394+0000 7f8f8630c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:06:52.748 INFO:tasks.workunit.client.0.smithi097.stderr: -305> 2024-09-14T11:06:52.394+0000 7f8f8630c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:06:52.748 INFO:tasks.workunit.client.0.smithi097.stderr: -304> 2024-09-14T11:06:52.395+0000 7f8f8630c800 5 asok(0x561e7838e270) register_command rotate-key cmddesc rotate-key hook 0x7ffe1af292a8 EEXIST 2024-09-14T11:06:52.748 INFO:tasks.workunit.client.0.smithi097.stderr: -303> 2024-09-14T11:06:52.395+0000 7f8f8630c800 10 monclient: _reopen_session rank -1 2024-09-14T11:06:52.748 INFO:tasks.workunit.client.0.smithi097.stderr: -302> 2024-09-14T11:06:52.395+0000 7f8f8630c800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:06:52.748 INFO:tasks.workunit.client.0.smithi097.stderr: -301> 2024-09-14T11:06:52.395+0000 7f8f8630c800 10 monclient(hunting): picked mon.noname-b con 0x561e78681050 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:06:52.748 INFO:tasks.workunit.client.0.smithi097.stderr: -300> 2024-09-14T11:06:52.395+0000 7f8f8630c800 10 monclient(hunting): picked mon.noname-c con 0x561e78651fa0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:06:52.748 INFO:tasks.workunit.client.0.smithi097.stderr: -299> 2024-09-14T11:06:52.395+0000 7f8f8630c800 10 monclient(hunting): picked mon.noname-a con 0x561e7867c8f0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:06:52.748 INFO:tasks.workunit.client.0.smithi097.stderr: -298> 2024-09-14T11:06:52.395+0000 7f8f8630c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:52.748 INFO:tasks.workunit.client.0.smithi097.stderr: -297> 2024-09-14T11:06:52.395+0000 7f8f8630c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:52.748 INFO:tasks.workunit.client.0.smithi097.stderr: -296> 2024-09-14T11:06:52.395+0000 7f8f8630c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:52.748 INFO:tasks.workunit.client.0.smithi097.stderr: -295> 2024-09-14T11:06:52.395+0000 7f8f8630c800 10 monclient(hunting): _renew_subs 2024-09-14T11:06:52.748 INFO:tasks.workunit.client.0.smithi097.stderr: -294> 2024-09-14T11:06:52.395+0000 7f8f8630c800 10 monclient(hunting): authenticate will time out at 2094.048080s 2024-09-14T11:06:52.749 INFO:tasks.workunit.client.0.smithi097.stderr: -293> 2024-09-14T11:06:52.395+0000 7f8f845fe640 10 monclient(hunting): get_auth_request con 0x561e78651fa0 auth_method 0 2024-09-14T11:06:52.749 INFO:tasks.workunit.client.0.smithi097.stderr: -292> 2024-09-14T11:06:52.395+0000 7f8f845fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:06:52.749 INFO:tasks.workunit.client.0.smithi097.stderr: -291> 2024-09-14T11:06:52.395+0000 7f8f845fe640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:06:52.749 INFO:tasks.workunit.client.0.smithi097.stderr: -290> 2024-09-14T11:06:52.395+0000 7f8f845fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:06:52.749 INFO:tasks.workunit.client.0.smithi097.stderr: -289> 2024-09-14T11:06:52.395+0000 7f8f83dfd640 10 monclient(hunting): get_auth_request con 0x561e7867c8f0 auth_method 0 2024-09-14T11:06:52.749 INFO:tasks.workunit.client.0.smithi097.stderr: -288> 2024-09-14T11:06:52.395+0000 7f8f83dfd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:06:52.749 INFO:tasks.workunit.client.0.smithi097.stderr: -287> 2024-09-14T11:06:52.395+0000 7f8f83dfd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:06:52.749 INFO:tasks.workunit.client.0.smithi097.stderr: -286> 2024-09-14T11:06:52.395+0000 7f8f83dfd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:06:52.749 INFO:tasks.workunit.client.0.smithi097.stderr: -285> 2024-09-14T11:06:52.395+0000 7f8f7b5fc640 10 monclient(hunting): get_auth_request con 0x561e78681050 auth_method 0 2024-09-14T11:06:52.749 INFO:tasks.workunit.client.0.smithi097.stderr: -284> 2024-09-14T11:06:52.395+0000 7f8f7b5fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:06:52.749 INFO:tasks.workunit.client.0.smithi097.stderr: -283> 2024-09-14T11:06:52.395+0000 7f8f7b5fc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:06:52.749 INFO:tasks.workunit.client.0.smithi097.stderr: -282> 2024-09-14T11:06:52.395+0000 7f8f7b5fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:06:52.749 INFO:tasks.workunit.client.0.smithi097.stderr: -281> 2024-09-14T11:06:52.395+0000 7f8f845fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:06:52.749 INFO:tasks.workunit.client.0.smithi097.stderr: -280> 2024-09-14T11:06:52.395+0000 7f8f845fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:06:52.749 INFO:tasks.workunit.client.0.smithi097.stderr: -279> 2024-09-14T11:06:52.395+0000 7f8f845fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:06:52.750 INFO:tasks.workunit.client.0.smithi097.stderr: -278> 2024-09-14T11:06:52.395+0000 7f8f83dfd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:06:52.750 INFO:tasks.workunit.client.0.smithi097.stderr: -277> 2024-09-14T11:06:52.395+0000 7f8f83dfd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:06:52.750 INFO:tasks.workunit.client.0.smithi097.stderr: -276> 2024-09-14T11:06:52.395+0000 7f8f83dfd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:06:52.750 INFO:tasks.workunit.client.0.smithi097.stderr: -275> 2024-09-14T11:06:52.395+0000 7f8f7b5fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:06:52.750 INFO:tasks.workunit.client.0.smithi097.stderr: -274> 2024-09-14T11:06:52.395+0000 7f8f7b5fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:06:52.750 INFO:tasks.workunit.client.0.smithi097.stderr: -273> 2024-09-14T11:06:52.395+0000 7f8f7b5fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:06:52.750 INFO:tasks.workunit.client.0.smithi097.stderr: -272> 2024-09-14T11:06:52.395+0000 7f8f845fe640 10 monclient(hunting): handle_auth_done global_id 7544 payload 274 2024-09-14T11:06:52.750 INFO:tasks.workunit.client.0.smithi097.stderr: -271> 2024-09-14T11:06:52.395+0000 7f8f845fe640 10 monclient: _finish_hunting 0 2024-09-14T11:06:52.750 INFO:tasks.workunit.client.0.smithi097.stderr: -270> 2024-09-14T11:06:52.395+0000 7f8f845fe640 1 monclient: found mon.noname-c 2024-09-14T11:06:52.750 INFO:tasks.workunit.client.0.smithi097.stderr: -269> 2024-09-14T11:06:52.395+0000 7f8f845fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:06:52.750 INFO:tasks.workunit.client.0.smithi097.stderr: -268> 2024-09-14T11:06:52.395+0000 7f8e62ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:06:52.750 INFO:tasks.workunit.client.0.smithi097.stderr: -267> 2024-09-14T11:06:52.395+0000 7f8e62ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:06:52.750 INFO:tasks.workunit.client.0.smithi097.stderr: -266> 2024-09-14T11:06:52.395+0000 7f8e62ffd640 10 monclient: dump: 2024-09-14T11:06:52.750 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:06:52.751 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:06:52.751 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:52.751 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:52.751 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:06:52.751 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:06:52.751 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:06:52.751 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:06:52.751 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:06:52.751 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:52.751 INFO:tasks.workunit.client.0.smithi097.stderr: -265> 2024-09-14T11:06:52.395+0000 7f8e62ffd640 10 monclient: _finish_auth 0 2024-09-14T11:06:52.751 INFO:tasks.workunit.client.0.smithi097.stderr: -264> 2024-09-14T11:06:52.395+0000 7f8e62ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:06:52.751 INFO:tasks.workunit.client.0.smithi097.stderr: -263> 2024-09-14T11:06:52.395+0000 7f8e62ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:06:52.751 INFO:tasks.workunit.client.0.smithi097.stderr: -262> 2024-09-14T11:06:52.395+0000 7f8e62ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:06:52.752 INFO:tasks.workunit.client.0.smithi097.stderr: -261> 2024-09-14T11:06:52.395+0000 7f8e62ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:06:52.752 INFO:tasks.workunit.client.0.smithi097.stderr: -260> 2024-09-14T11:06:52.395+0000 7f8e62ffd640 10 monclient: dump: 2024-09-14T11:06:52.752 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:06:52.752 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:06:52.752 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:52.752 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:52.752 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:06:52.752 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:06:52.752 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:06:52.752 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:06:52.752 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:06:52.752 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:52.752 INFO:tasks.workunit.client.0.smithi097.stderr: -259> 2024-09-14T11:06:52.395+0000 7f8f8630c800 5 monclient: authenticate success, global_id 7544 2024-09-14T11:06:52.753 INFO:tasks.workunit.client.0.smithi097.stderr: -258> 2024-09-14T11:06:52.395+0000 7f8f8630c800 10 monclient: get_monmap_and_config success 2024-09-14T11:06:52.753 INFO:tasks.workunit.client.0.smithi097.stderr: -257> 2024-09-14T11:06:52.395+0000 7f8f8630c800 4 set_mon_vals no callback set 2024-09-14T11:06:52.753 INFO:tasks.workunit.client.0.smithi097.stderr: -256> 2024-09-14T11:06:52.396+0000 7f8f8630c800 10 monclient: shutdown 2024-09-14T11:06:52.753 INFO:tasks.workunit.client.0.smithi097.stderr: -255> 2024-09-14T11:06:52.396+0000 7f8f8630c800 10 monclient: build_initial_monmap 2024-09-14T11:06:52.753 INFO:tasks.workunit.client.0.smithi097.stderr: -254> 2024-09-14T11:06:52.396+0000 7f8f8630c800 1 build_initial for_mkfs: 0 2024-09-14T11:06:52.753 INFO:tasks.workunit.client.0.smithi097.stderr: -253> 2024-09-14T11:06:52.396+0000 7f8f8630c800 10 monclient: monmap: 2024-09-14T11:06:52.753 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:06:52.753 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:06:52.753 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:06:52.753 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:06:52.753 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:06:52.753 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:06:52.753 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:06:52.754 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:06:52.754 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:06:52.754 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:52.754 INFO:tasks.workunit.client.0.smithi097.stderr: -252> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78673570) adding auth protocol: cephx 2024-09-14T11:06:52.754 INFO:tasks.workunit.client.0.smithi097.stderr: -251> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78673570) adding auth protocol: cephx 2024-09-14T11:06:52.754 INFO:tasks.workunit.client.0.smithi097.stderr: -250> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78673570) adding auth protocol: cephx 2024-09-14T11:06:52.754 INFO:tasks.workunit.client.0.smithi097.stderr: -249> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78673570) adding con mode: secure 2024-09-14T11:06:52.754 INFO:tasks.workunit.client.0.smithi097.stderr: -248> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78673570) adding con mode: crc 2024-09-14T11:06:52.754 INFO:tasks.workunit.client.0.smithi097.stderr: -247> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78673570) adding con mode: secure 2024-09-14T11:06:52.754 INFO:tasks.workunit.client.0.smithi097.stderr: -246> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78673570) adding con mode: crc 2024-09-14T11:06:52.754 INFO:tasks.workunit.client.0.smithi097.stderr: -245> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78673570) adding con mode: secure 2024-09-14T11:06:52.754 INFO:tasks.workunit.client.0.smithi097.stderr: -244> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78673570) adding con mode: crc 2024-09-14T11:06:52.755 INFO:tasks.workunit.client.0.smithi097.stderr: -243> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78673570) adding con mode: crc 2024-09-14T11:06:52.755 INFO:tasks.workunit.client.0.smithi097.stderr: -242> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78673570) adding con mode: secure 2024-09-14T11:06:52.755 INFO:tasks.workunit.client.0.smithi097.stderr: -241> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78673570) adding con mode: crc 2024-09-14T11:06:52.755 INFO:tasks.workunit.client.0.smithi097.stderr: -240> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78673570) adding con mode: secure 2024-09-14T11:06:52.755 INFO:tasks.workunit.client.0.smithi097.stderr: -239> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78673570) adding con mode: crc 2024-09-14T11:06:52.755 INFO:tasks.workunit.client.0.smithi097.stderr: -238> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78673570) adding con mode: secure 2024-09-14T11:06:52.755 INFO:tasks.workunit.client.0.smithi097.stderr: -237> 2024-09-14T11:06:52.396+0000 7f8f8630c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:06:52.755 INFO:tasks.workunit.client.0.smithi097.stderr: -236> 2024-09-14T11:06:52.396+0000 7f8f8630c800 1 librados: starting msgr at 2024-09-14T11:06:52.755 INFO:tasks.workunit.client.0.smithi097.stderr: -235> 2024-09-14T11:06:52.396+0000 7f8f8630c800 1 librados: starting objecter 2024-09-14T11:06:52.755 INFO:tasks.workunit.client.0.smithi097.stderr: -234> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 asok(0x561e7838e270) register_command objecter_requests cmddesc objecter_requests hook 0x561e78650d30 EEXIST 2024-09-14T11:06:52.755 INFO:tasks.workunit.client.0.smithi097.stderr: -233> 2024-09-14T11:06:52.396+0000 7f8f8630c800 1 librados: setting wanted keys 2024-09-14T11:06:52.755 INFO:tasks.workunit.client.0.smithi097.stderr: -232> 2024-09-14T11:06:52.396+0000 7f8f8630c800 1 librados: calling monclient init 2024-09-14T11:06:52.755 INFO:tasks.workunit.client.0.smithi097.stderr: -231> 2024-09-14T11:06:52.396+0000 7f8f8630c800 10 monclient: init 2024-09-14T11:06:52.756 INFO:tasks.workunit.client.0.smithi097.stderr: -230> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78641520) adding auth protocol: cephx 2024-09-14T11:06:52.756 INFO:tasks.workunit.client.0.smithi097.stderr: -229> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78641520) adding auth protocol: cephx 2024-09-14T11:06:52.756 INFO:tasks.workunit.client.0.smithi097.stderr: -228> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78641520) adding auth protocol: cephx 2024-09-14T11:06:52.756 INFO:tasks.workunit.client.0.smithi097.stderr: -227> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78641520) adding con mode: secure 2024-09-14T11:06:52.756 INFO:tasks.workunit.client.0.smithi097.stderr: -226> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78641520) adding con mode: crc 2024-09-14T11:06:52.756 INFO:tasks.workunit.client.0.smithi097.stderr: -225> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78641520) adding con mode: secure 2024-09-14T11:06:52.756 INFO:tasks.workunit.client.0.smithi097.stderr: -224> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78641520) adding con mode: crc 2024-09-14T11:06:52.756 INFO:tasks.workunit.client.0.smithi097.stderr: -223> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78641520) adding con mode: secure 2024-09-14T11:06:52.756 INFO:tasks.workunit.client.0.smithi097.stderr: -222> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78641520) adding con mode: crc 2024-09-14T11:06:52.756 INFO:tasks.workunit.client.0.smithi097.stderr: -221> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78641520) adding con mode: crc 2024-09-14T11:06:52.756 INFO:tasks.workunit.client.0.smithi097.stderr: -220> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78641520) adding con mode: secure 2024-09-14T11:06:52.757 INFO:tasks.workunit.client.0.smithi097.stderr: -219> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78641520) adding con mode: crc 2024-09-14T11:06:52.757 INFO:tasks.workunit.client.0.smithi097.stderr: -218> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78641520) adding con mode: secure 2024-09-14T11:06:52.757 INFO:tasks.workunit.client.0.smithi097.stderr: -217> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78641520) adding con mode: crc 2024-09-14T11:06:52.757 INFO:tasks.workunit.client.0.smithi097.stderr: -216> 2024-09-14T11:06:52.396+0000 7f8f8630c800 5 AuthRegistry(0x561e78641520) adding con mode: secure 2024-09-14T11:06:52.757 INFO:tasks.workunit.client.0.smithi097.stderr: -215> 2024-09-14T11:06:52.396+0000 7f8f8630c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:06:52.757 INFO:tasks.workunit.client.0.smithi097.stderr: -214> 2024-09-14T11:06:52.397+0000 7f8f8630c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:06:52.757 INFO:tasks.workunit.client.0.smithi097.stderr: -213> 2024-09-14T11:06:52.397+0000 7f8f8630c800 5 asok(0x561e7838e270) register_command rotate-key cmddesc rotate-key hook 0x561e78641668 EEXIST 2024-09-14T11:06:52.757 INFO:tasks.workunit.client.0.smithi097.stderr: -212> 2024-09-14T11:06:52.397+0000 7f8f8630c800 10 monclient: _reopen_session rank -1 2024-09-14T11:06:52.757 INFO:tasks.workunit.client.0.smithi097.stderr: -211> 2024-09-14T11:06:52.397+0000 7f8f8630c800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:06:52.757 INFO:tasks.workunit.client.0.smithi097.stderr: -210> 2024-09-14T11:06:52.397+0000 7f8f8630c800 10 monclient(hunting): picked mon.noname-a con 0x561e78651fa0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:06:52.757 INFO:tasks.workunit.client.0.smithi097.stderr: -209> 2024-09-14T11:06:52.397+0000 7f8f8630c800 10 monclient(hunting): picked mon.noname-b con 0x561e7867c8f0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:06:52.757 INFO:tasks.workunit.client.0.smithi097.stderr: -208> 2024-09-14T11:06:52.397+0000 7f8f8630c800 10 monclient(hunting): picked mon.noname-c con 0x561e78681050 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:06:52.757 INFO:tasks.workunit.client.0.smithi097.stderr: -207> 2024-09-14T11:06:52.397+0000 7f8f8630c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:52.757 INFO:tasks.workunit.client.0.smithi097.stderr: -206> 2024-09-14T11:06:52.397+0000 7f8f8630c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:52.758 INFO:tasks.workunit.client.0.smithi097.stderr: -205> 2024-09-14T11:06:52.397+0000 7f8f8630c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:06:52.758 INFO:tasks.workunit.client.0.smithi097.stderr: -204> 2024-09-14T11:06:52.397+0000 7f8f8630c800 10 monclient(hunting): _renew_subs 2024-09-14T11:06:52.758 INFO:tasks.workunit.client.0.smithi097.stderr: -203> 2024-09-14T11:06:52.397+0000 7f8f8630c800 10 monclient(hunting): authenticate will time out at 2094.050228s 2024-09-14T11:06:52.758 INFO:tasks.workunit.client.0.smithi097.stderr: -202> 2024-09-14T11:06:52.397+0000 7f8f83dfd640 10 monclient(hunting): get_auth_request con 0x561e78681050 auth_method 0 2024-09-14T11:06:52.758 INFO:tasks.workunit.client.0.smithi097.stderr: -201> 2024-09-14T11:06:52.397+0000 7f8f83dfd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:06:52.758 INFO:tasks.workunit.client.0.smithi097.stderr: -200> 2024-09-14T11:06:52.397+0000 7f8f83dfd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:06:52.758 INFO:tasks.workunit.client.0.smithi097.stderr: -199> 2024-09-14T11:06:52.397+0000 7f8f83dfd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:06:52.758 INFO:tasks.workunit.client.0.smithi097.stderr: -198> 2024-09-14T11:06:52.397+0000 7f8f7b5fc640 10 monclient(hunting): get_auth_request con 0x561e78651fa0 auth_method 0 2024-09-14T11:06:52.758 INFO:tasks.workunit.client.0.smithi097.stderr: -197> 2024-09-14T11:06:52.397+0000 7f8f7b5fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:06:52.758 INFO:tasks.workunit.client.0.smithi097.stderr: -196> 2024-09-14T11:06:52.397+0000 7f8f7b5fc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:06:52.758 INFO:tasks.workunit.client.0.smithi097.stderr: -195> 2024-09-14T11:06:52.397+0000 7f8f7b5fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:06:52.758 INFO:tasks.workunit.client.0.smithi097.stderr: -194> 2024-09-14T11:06:52.397+0000 7f8f845fe640 10 monclient(hunting): get_auth_request con 0x561e7867c8f0 auth_method 0 2024-09-14T11:06:52.758 INFO:tasks.workunit.client.0.smithi097.stderr: -193> 2024-09-14T11:06:52.397+0000 7f8f845fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:06:52.759 INFO:tasks.workunit.client.0.smithi097.stderr: -192> 2024-09-14T11:06:52.397+0000 7f8f845fe640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:06:52.759 INFO:tasks.workunit.client.0.smithi097.stderr: -191> 2024-09-14T11:06:52.397+0000 7f8f845fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:06:52.759 INFO:tasks.workunit.client.0.smithi097.stderr: -190> 2024-09-14T11:06:52.397+0000 7f8f83dfd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:06:52.759 INFO:tasks.workunit.client.0.smithi097.stderr: -189> 2024-09-14T11:06:52.397+0000 7f8f83dfd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:06:52.759 INFO:tasks.workunit.client.0.smithi097.stderr: -188> 2024-09-14T11:06:52.397+0000 7f8f83dfd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:06:52.759 INFO:tasks.workunit.client.0.smithi097.stderr: -187> 2024-09-14T11:06:52.397+0000 7f8f7b5fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:06:52.759 INFO:tasks.workunit.client.0.smithi097.stderr: -186> 2024-09-14T11:06:52.397+0000 7f8f7b5fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:06:52.759 INFO:tasks.workunit.client.0.smithi097.stderr: -185> 2024-09-14T11:06:52.397+0000 7f8f7b5fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:06:52.759 INFO:tasks.workunit.client.0.smithi097.stderr: -184> 2024-09-14T11:06:52.397+0000 7f8f845fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:06:52.759 INFO:tasks.workunit.client.0.smithi097.stderr: -183> 2024-09-14T11:06:52.397+0000 7f8f845fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:06:52.759 INFO:tasks.workunit.client.0.smithi097.stderr: -182> 2024-09-14T11:06:52.397+0000 7f8f845fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:06:52.759 INFO:tasks.workunit.client.0.smithi097.stderr: -181> 2024-09-14T11:06:52.397+0000 7f8f83dfd640 10 monclient(hunting): handle_auth_done global_id 7547 payload 824 2024-09-14T11:06:52.759 INFO:tasks.workunit.client.0.smithi097.stderr: -180> 2024-09-14T11:06:52.397+0000 7f8f83dfd640 10 monclient: _finish_hunting 0 2024-09-14T11:06:52.760 INFO:tasks.workunit.client.0.smithi097.stderr: -179> 2024-09-14T11:06:52.397+0000 7f8f83dfd640 1 monclient: found mon.noname-c 2024-09-14T11:06:52.760 INFO:tasks.workunit.client.0.smithi097.stderr: -178> 2024-09-14T11:06:52.397+0000 7f8f83dfd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:06:52.760 INFO:tasks.workunit.client.0.smithi097.stderr: -177> 2024-09-14T11:06:52.397+0000 7f8e617fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:06:52.760 INFO:tasks.workunit.client.0.smithi097.stderr: -176> 2024-09-14T11:06:52.397+0000 7f8e617fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:06:52.760 INFO:tasks.workunit.client.0.smithi097.stderr: -175> 2024-09-14T11:06:52.397+0000 7f8e617fa640 10 monclient: dump: 2024-09-14T11:06:52.760 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:06:52.760 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:06:52.760 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:52.760 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:52.760 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:06:52.760 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:06:52.761 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:06:52.761 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:06:52.761 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:06:52.761 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:52.761 INFO:tasks.workunit.client.0.smithi097.stderr: -174> 2024-09-14T11:06:52.397+0000 7f8e617fa640 10 monclient: _finish_auth 0 2024-09-14T11:06:52.761 INFO:tasks.workunit.client.0.smithi097.stderr: -173> 2024-09-14T11:06:52.397+0000 7f8e617fa640 10 monclient: _check_auth_tickets 2024-09-14T11:06:52.761 INFO:tasks.workunit.client.0.smithi097.stderr: -172> 2024-09-14T11:06:52.397+0000 7f8e617fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:06:52.761 INFO:tasks.workunit.client.0.smithi097.stderr: -171> 2024-09-14T11:06:52.397+0000 7f8e617fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:06:52.761 INFO:tasks.workunit.client.0.smithi097.stderr: -170> 2024-09-14T11:06:52.397+0000 7f8e617fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:06:52.761 INFO:tasks.workunit.client.0.smithi097.stderr: -169> 2024-09-14T11:06:52.397+0000 7f8e617fa640 10 monclient: dump: 2024-09-14T11:06:52.761 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:06:52.761 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:06:52.761 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:52.762 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:06:52.762 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:06:52.762 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:06:52.762 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:06:52.762 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:06:52.762 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:06:52.762 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:52.762 INFO:tasks.workunit.client.0.smithi097.stderr: -168> 2024-09-14T11:06:52.397+0000 7f8f8630c800 5 monclient: authenticate success, global_id 7547 2024-09-14T11:06:52.762 INFO:tasks.workunit.client.0.smithi097.stderr: -167> 2024-09-14T11:06:52.397+0000 7f8e62ffd640 4 set_mon_vals no callback set 2024-09-14T11:06:52.762 INFO:tasks.workunit.client.0.smithi097.stderr: -166> 2024-09-14T11:06:52.397+0000 7f8f8630c800 10 monclient: _renew_subs 2024-09-14T11:06:52.762 INFO:tasks.workunit.client.0.smithi097.stderr: -165> 2024-09-14T11:06:52.397+0000 7f8f8630c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:06:52.762 INFO:tasks.workunit.client.0.smithi097.stderr: -164> 2024-09-14T11:06:52.397+0000 7f8f8630c800 10 monclient: _renew_subs 2024-09-14T11:06:52.763 INFO:tasks.workunit.client.0.smithi097.stderr: -163> 2024-09-14T11:06:52.397+0000 7f8f8630c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:06:52.763 INFO:tasks.workunit.client.0.smithi097.stderr: -162> 2024-09-14T11:06:52.397+0000 7f8f8630c800 1 librados: init done 2024-09-14T11:06:52.763 INFO:tasks.workunit.client.0.smithi097.stderr: -161> 2024-09-14T11:06:52.397+0000 7f8f8630c800 5 asok(0x561e7838e270) register_command cr dump hook 0x561e786785c8 2024-09-14T11:06:52.763 INFO:tasks.workunit.client.0.smithi097.stderr: -160> 2024-09-14T11:06:52.399+0000 7f8f8630c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.763 INFO:tasks.workunit.client.0.smithi097.stderr: -159> 2024-09-14T11:06:52.399+0000 7f8e617fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:06:52.763 INFO:tasks.workunit.client.0.smithi097.stderr: -158> 2024-09-14T11:06:52.399+0000 7f8e617fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:06:52.763 INFO:tasks.workunit.client.0.smithi097.stderr: -157> 2024-09-14T11:06:52.399+0000 7f8e617fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:06:52.763 INFO:tasks.workunit.client.0.smithi097.stderr: -156> 2024-09-14T11:06:52.399+0000 7f8f7b5fc640 10 monclient: get_auth_request con 0x7f8e4c077230 auth_method 0 2024-09-14T11:06:52.763 INFO:tasks.workunit.client.0.smithi097.stderr: -155> 2024-09-14T11:06:52.400+0000 7f8f845fe640 10 monclient: get_auth_request con 0x561e7869b030 auth_method 0 2024-09-14T11:06:52.763 INFO:tasks.workunit.client.0.smithi097.stderr: -154> 2024-09-14T11:06:52.400+0000 7f8f8630c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:52.763 INFO:tasks.workunit.client.0.smithi097.stderr: -153> 2024-09-14T11:06:52.400+0000 7f8f8630c800 20 realm 2024-09-14T11:06:52.763 INFO:tasks.workunit.client.0.smithi097.stderr: -152> 2024-09-14T11:06:52.400+0000 7f8f8630c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.763 INFO:tasks.workunit.client.0.smithi097.stderr: -151> 2024-09-14T11:06:52.400+0000 7f8f8630c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:52.763 INFO:tasks.workunit.client.0.smithi097.stderr: -150> 2024-09-14T11:06:52.400+0000 7f8f8630c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:06:52.764 INFO:tasks.workunit.client.0.smithi097.stderr: -149> 2024-09-14T11:06:52.400+0000 7f8f8630c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.764 INFO:tasks.workunit.client.0.smithi097.stderr: -148> 2024-09-14T11:06:52.401+0000 7f8f8630c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:52.764 INFO:tasks.workunit.client.0.smithi097.stderr: -147> 2024-09-14T11:06:52.401+0000 7f8f8630c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.764 INFO:tasks.workunit.client.0.smithi097.stderr: -146> 2024-09-14T11:06:52.401+0000 7f8f7b5fc640 10 monclient: get_auth_request con 0x561e7869f210 auth_method 0 2024-09-14T11:06:52.764 INFO:tasks.workunit.client.0.smithi097.stderr: -145> 2024-09-14T11:06:52.401+0000 7f8f8630c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:52.764 INFO:tasks.workunit.client.0.smithi097.stderr: -144> 2024-09-14T11:06:52.401+0000 7f8f8630c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.764 INFO:tasks.workunit.client.0.smithi097.stderr: -143> 2024-09-14T11:06:52.401+0000 7f8f845fe640 10 monclient: get_auth_request con 0x561e786a2a70 auth_method 0 2024-09-14T11:06:52.764 INFO:tasks.workunit.client.0.smithi097.stderr: -142> 2024-09-14T11:06:52.402+0000 7f8f8630c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:06:52.764 INFO:tasks.workunit.client.0.smithi097.stderr: -141> 2024-09-14T11:06:52.402+0000 7f8f8630c800 20 searching for the correct realm 2024-09-14T11:06:52.764 INFO:tasks.workunit.client.0.smithi097.stderr: -140> 2024-09-14T11:06:52.402+0000 7f8f83dfd640 10 monclient: get_auth_request con 0x561e786a7780 auth_method 0 2024-09-14T11:06:52.764 INFO:tasks.workunit.client.0.smithi097.stderr: -139> 2024-09-14T11:06:52.403+0000 7f8f7b5fc640 10 monclient: get_auth_request con 0x7f8f74011c80 auth_method 0 2024-09-14T11:06:52.764 INFO:tasks.workunit.client.0.smithi097.stderr: -138> 2024-09-14T11:06:52.404+0000 7f8f845fe640 10 monclient: get_auth_request con 0x7f8f6c063070 auth_method 0 2024-09-14T11:06:52.764 INFO:tasks.workunit.client.0.smithi097.stderr: -137> 2024-09-14T11:06:52.404+0000 7f8f845fe640 0 -- 172.21.15.97:0/1685494170 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f8f6c063070 msgr2=0x7f8f6c089940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:06:52.764 INFO:tasks.workunit.client.0.smithi097.stderr: -136> 2024-09-14T11:06:52.605+0000 7f8f845fe640 10 monclient: get_auth_request con 0x7f8f6c063070 auth_method 0 2024-09-14T11:06:52.765 INFO:tasks.workunit.client.0.smithi097.stderr: -135> 2024-09-14T11:06:52.608+0000 7f8f83dfd640 10 monclient: get_auth_request con 0x7f8f6c0a2910 auth_method 0 2024-09-14T11:06:52.765 INFO:tasks.workunit.client.0.smithi097.stderr: -134> 2024-09-14T11:06:52.609+0000 7f8f7b5fc640 10 monclient: get_auth_request con 0x7f8f74019670 auth_method 0 2024-09-14T11:06:52.765 INFO:tasks.workunit.client.0.smithi097.stderr: -133> 2024-09-14T11:06:52.609+0000 7f8f7b5fc640 0 -- 172.21.15.97:0/1685494170 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f8f74019670 msgr2=0x7f8f7407e4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:52.765 INFO:tasks.workunit.client.0.smithi097.stderr: -132> 2024-09-14T11:06:52.609+0000 7f8e617fa640 1 client.7547.objecter ms_handle_reset 0x7f8f74019670 session 0x7f8f740640c0 osd.3 2024-09-14T11:06:52.765 INFO:tasks.workunit.client.0.smithi097.stderr: -131> 2024-09-14T11:06:52.609+0000 7f8e617fa640 10 monclient: _renew_subs 2024-09-14T11:06:52.765 INFO:tasks.workunit.client.0.smithi097.stderr: -130> 2024-09-14T11:06:52.609+0000 7f8e617fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:06:52.765 INFO:tasks.workunit.client.0.smithi097.stderr: -129> 2024-09-14T11:06:52.609+0000 7f8f7b5fc640 10 monclient: get_auth_request con 0x7f8e4c086d50 auth_method 0 2024-09-14T11:06:52.765 INFO:tasks.workunit.client.0.smithi097.stderr: -128> 2024-09-14T11:06:52.614+0000 7f8f8630c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:06:52.765 INFO:tasks.workunit.client.0.smithi097.stderr: -127> 2024-09-14T11:06:52.614+0000 7f8f8630c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:06:52.765 INFO:tasks.workunit.client.0.smithi097.stderr: -126> 2024-09-14T11:06:52.614+0000 7f8f8630c800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:06:52.765 INFO:tasks.workunit.client.0.smithi097.stderr: -125> 2024-09-14T11:06:52.614+0000 7f8f8630c800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:06:52.765 INFO:tasks.workunit.client.0.smithi097.stderr: -124> 2024-09-14T11:06:52.614+0000 7f8f8630c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:06:52.765 INFO:tasks.workunit.client.0.smithi097.stderr: -123> 2024-09-14T11:06:52.614+0000 7f8f8630c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:06:52.765 INFO:tasks.workunit.client.0.smithi097.stderr: -122> 2024-09-14T11:06:52.614+0000 7f8f8630c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.765 INFO:tasks.workunit.client.0.smithi097.stderr: -121> 2024-09-14T11:06:52.614+0000 7f8f8630c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:52.766 INFO:tasks.workunit.client.0.smithi097.stderr: -120> 2024-09-14T11:06:52.614+0000 7f8f8630c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.766 INFO:tasks.workunit.client.0.smithi097.stderr: -119> 2024-09-14T11:06:52.615+0000 7f8f8630c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:52.766 INFO:tasks.workunit.client.0.smithi097.stderr: -118> 2024-09-14T11:06:52.615+0000 7f8f8630c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.766 INFO:tasks.workunit.client.0.smithi097.stderr: -117> 2024-09-14T11:06:52.615+0000 7f8f8630c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:06:52.766 INFO:tasks.workunit.client.0.smithi097.stderr: -116> 2024-09-14T11:06:52.615+0000 7f8f8630c800 20 zone default found 2024-09-14T11:06:52.766 INFO:tasks.workunit.client.0.smithi097.stderr: -115> 2024-09-14T11:06:52.615+0000 7f8f8630c800 4 Realm: () 2024-09-14T11:06:52.766 INFO:tasks.workunit.client.0.smithi097.stderr: -114> 2024-09-14T11:06:52.615+0000 7f8f8630c800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:06:52.766 INFO:tasks.workunit.client.0.smithi097.stderr: -113> 2024-09-14T11:06:52.615+0000 7f8f8630c800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:06:52.766 INFO:tasks.workunit.client.0.smithi097.stderr: -112> 2024-09-14T11:06:52.615+0000 7f8f8630c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:06:52.766 INFO:tasks.workunit.client.0.smithi097.stderr: -111> 2024-09-14T11:06:52.615+0000 7f8f8630c800 20 zonegroup default 2024-09-14T11:06:52.766 INFO:tasks.workunit.client.0.smithi097.stderr: -110> 2024-09-14T11:06:52.615+0000 7f8f8630c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.766 INFO:tasks.workunit.client.0.smithi097.stderr: -109> 2024-09-14T11:06:52.615+0000 7f8f8630c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:52.766 INFO:tasks.workunit.client.0.smithi097.stderr: -108> 2024-09-14T11:06:52.615+0000 7f8f8630c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.766 INFO:tasks.workunit.client.0.smithi097.stderr: -107> 2024-09-14T11:06:52.616+0000 7f8f8630c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:52.766 INFO:tasks.workunit.client.0.smithi097.stderr: -106> 2024-09-14T11:06:52.616+0000 7f8f8630c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.767 INFO:tasks.workunit.client.0.smithi097.stderr: -105> 2024-09-14T11:06:52.616+0000 7f8f8630c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:52.767 INFO:tasks.workunit.client.0.smithi097.stderr: -104> 2024-09-14T11:06:52.616+0000 7f8f8630c800 20 started sync module instance, tier type = 2024-09-14T11:06:52.767 INFO:tasks.workunit.client.0.smithi097.stderr: -103> 2024-09-14T11:06:52.616+0000 7f8f8630c800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:06:52.767 INFO:tasks.workunit.client.0.smithi097.stderr: -102> 2024-09-14T11:06:52.625+0000 7f8f8630c800 20 add_watcher() i=0 2024-09-14T11:06:52.767 INFO:tasks.workunit.client.0.smithi097.stderr: -101> 2024-09-14T11:06:52.625+0000 7f8f8630c800 20 add_watcher() i=1 2024-09-14T11:06:52.767 INFO:tasks.workunit.client.0.smithi097.stderr: -100> 2024-09-14T11:06:52.625+0000 7f8f8630c800 20 add_watcher() i=2 2024-09-14T11:06:52.767 INFO:tasks.workunit.client.0.smithi097.stderr: -99> 2024-09-14T11:06:52.625+0000 7f8f8630c800 20 add_watcher() i=3 2024-09-14T11:06:52.767 INFO:tasks.workunit.client.0.smithi097.stderr: -98> 2024-09-14T11:06:52.625+0000 7f8f8630c800 20 add_watcher() i=4 2024-09-14T11:06:52.767 INFO:tasks.workunit.client.0.smithi097.stderr: -97> 2024-09-14T11:06:52.625+0000 7f8f8630c800 20 add_watcher() i=5 2024-09-14T11:06:52.767 INFO:tasks.workunit.client.0.smithi097.stderr: -96> 2024-09-14T11:06:52.625+0000 7f8f8630c800 20 add_watcher() i=6 2024-09-14T11:06:52.767 INFO:tasks.workunit.client.0.smithi097.stderr: -95> 2024-09-14T11:06:52.626+0000 7f8f8630c800 20 add_watcher() i=7 2024-09-14T11:06:52.767 INFO:tasks.workunit.client.0.smithi097.stderr: -94> 2024-09-14T11:06:52.626+0000 7f8f8630c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:06:52.767 INFO:tasks.workunit.client.0.smithi097.stderr: -93> 2024-09-14T11:06:52.628+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29640) adding auth protocol: cephx 2024-09-14T11:06:52.768 INFO:tasks.workunit.client.0.smithi097.stderr: -92> 2024-09-14T11:06:52.628+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29640) adding auth protocol: cephx 2024-09-14T11:06:52.768 INFO:tasks.workunit.client.0.smithi097.stderr: -91> 2024-09-14T11:06:52.628+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29640) adding auth protocol: cephx 2024-09-14T11:06:52.768 INFO:tasks.workunit.client.0.smithi097.stderr: -90> 2024-09-14T11:06:52.628+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29640) adding con mode: secure 2024-09-14T11:06:52.768 INFO:tasks.workunit.client.0.smithi097.stderr: -89> 2024-09-14T11:06:52.628+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29640) adding con mode: crc 2024-09-14T11:06:52.768 INFO:tasks.workunit.client.0.smithi097.stderr: -88> 2024-09-14T11:06:52.628+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29640) adding con mode: secure 2024-09-14T11:06:52.768 INFO:tasks.workunit.client.0.smithi097.stderr: -87> 2024-09-14T11:06:52.628+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29640) adding con mode: crc 2024-09-14T11:06:52.768 INFO:tasks.workunit.client.0.smithi097.stderr: -86> 2024-09-14T11:06:52.628+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29640) adding con mode: secure 2024-09-14T11:06:52.768 INFO:tasks.workunit.client.0.smithi097.stderr: -85> 2024-09-14T11:06:52.628+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29640) adding con mode: crc 2024-09-14T11:06:52.768 INFO:tasks.workunit.client.0.smithi097.stderr: -84> 2024-09-14T11:06:52.628+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29640) adding con mode: crc 2024-09-14T11:06:52.768 INFO:tasks.workunit.client.0.smithi097.stderr: -83> 2024-09-14T11:06:52.628+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29640) adding con mode: secure 2024-09-14T11:06:52.768 INFO:tasks.workunit.client.0.smithi097.stderr: -82> 2024-09-14T11:06:52.628+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29640) adding con mode: crc 2024-09-14T11:06:52.768 INFO:tasks.workunit.client.0.smithi097.stderr: -81> 2024-09-14T11:06:52.628+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29640) adding con mode: secure 2024-09-14T11:06:52.769 INFO:tasks.workunit.client.0.smithi097.stderr: -80> 2024-09-14T11:06:52.628+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29640) adding con mode: crc 2024-09-14T11:06:52.769 INFO:tasks.workunit.client.0.smithi097.stderr: -79> 2024-09-14T11:06:52.628+0000 7f8f8630c800 5 AuthRegistry(0x7ffe1af29640) adding con mode: secure 2024-09-14T11:06:52.769 INFO:tasks.workunit.client.0.smithi097.stderr: -78> 2024-09-14T11:06:52.628+0000 7f8e39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:52.769 INFO:tasks.workunit.client.0.smithi097.stderr: -77> 2024-09-14T11:06:52.628+0000 7f8f8630c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:06:52.769 INFO:tasks.workunit.client.0.smithi097.stderr: -76> 2024-09-14T11:06:52.628+0000 7f8f8630c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:06:52.769 INFO:tasks.workunit.client.0.smithi097.stderr: -75> 2024-09-14T11:06:52.628+0000 7f8f8630c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:06:52.769 INFO:tasks.workunit.client.0.smithi097.stderr: -74> 2024-09-14T11:06:52.628+0000 7f8f8630c800 5 asok(0x561e7838e270) register_command cache list hook 0x561e78675d30 2024-09-14T11:06:52.769 INFO:tasks.workunit.client.0.smithi097.stderr: -73> 2024-09-14T11:06:52.628+0000 7f8f8630c800 5 asok(0x561e7838e270) register_command cache inspect hook 0x561e78675d30 2024-09-14T11:06:52.769 INFO:tasks.workunit.client.0.smithi097.stderr: -72> 2024-09-14T11:06:52.628+0000 7f8f8630c800 5 asok(0x561e7838e270) register_command cache erase hook 0x561e78675d30 2024-09-14T11:06:52.769 INFO:tasks.workunit.client.0.smithi097.stderr: -71> 2024-09-14T11:06:52.628+0000 7f8f8630c800 5 asok(0x561e7838e270) register_command cache zap hook 0x561e78675d30 2024-09-14T11:06:52.769 INFO:tasks.workunit.client.0.smithi097.stderr: -70> 2024-09-14T11:06:52.628+0000 7f8f8630c800 5 note: GC not initialized 2024-09-14T11:06:52.769 INFO:tasks.workunit.client.0.smithi097.stderr: -69> 2024-09-14T11:06:52.628+0000 7f8e38fe1640 20 reqs_thread_entry: start 2024-09-14T11:06:52.769 INFO:tasks.workunit.client.0.smithi097.stderr: -68> 2024-09-14T11:06:52.628+0000 7f8f8630c800 5 asok(0x561e7838e270) register_command sync trace show hook 0x7f8f7c017620 2024-09-14T11:06:52.769 INFO:tasks.workunit.client.0.smithi097.stderr: -67> 2024-09-14T11:06:52.628+0000 7f8f8630c800 5 asok(0x561e7838e270) register_command sync trace history hook 0x7f8f7c017620 2024-09-14T11:06:52.770 INFO:tasks.workunit.client.0.smithi097.stderr: -66> 2024-09-14T11:06:52.628+0000 7f8f8630c800 5 asok(0x561e7838e270) register_command sync trace active hook 0x7f8f7c017620 2024-09-14T11:06:52.770 INFO:tasks.workunit.client.0.smithi097.stderr: -65> 2024-09-14T11:06:52.628+0000 7f8f8630c800 5 asok(0x561e7838e270) register_command sync trace active_short hook 0x7f8f7c017620 2024-09-14T11:06:52.770 INFO:tasks.workunit.client.0.smithi097.stderr: -64> 2024-09-14T11:06:52.628+0000 7f8f8630c800 20 init_complete bucket index max shards: 11 2024-09-14T11:06:52.770 INFO:tasks.workunit.client.0.smithi097.stderr: -63> 2024-09-14T11:06:52.628+0000 7f8f8630c800 20 Filter name: none 2024-09-14T11:06:52.770 INFO:tasks.workunit.client.0.smithi097.stderr: -62> 2024-09-14T11:06:52.628+0000 7f8db27fc640 20 reqs_thread_entry: start 2024-09-14T11:06:52.770 INFO:tasks.workunit.client.0.smithi097.stderr: -61> 2024-09-14T11:06:52.628+0000 7f8f8630c800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:06:52.770 INFO:tasks.workunit.client.0.smithi097.stderr: -60> 2024-09-14T11:06:52.628+0000 7f8f8630c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.770 INFO:tasks.workunit.client.0.smithi097.stderr: -59> 2024-09-14T11:06:52.629+0000 7f8f8630c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:06:52.770 INFO:tasks.workunit.client.0.smithi097.stderr: -58> 2024-09-14T11:06:52.629+0000 7f8f8630c800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:06:52.770 INFO:tasks.workunit.client.0.smithi097.stderr: -57> 2024-09-14T11:06:52.629+0000 7f8f8630c800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:06:52.770 INFO:tasks.workunit.client.0.smithi097.stderr: -56> 2024-09-14T11:06:52.629+0000 7f8f8630c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 : miss 2024-09-14T11:06:52.770 INFO:tasks.workunit.client.0.smithi097.stderr: -55> 2024-09-14T11:06:52.629+0000 7f8f8630c800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.770 INFO:tasks.workunit.client.0.smithi097.stderr: -54> 2024-09-14T11:06:52.629+0000 7f8f8630c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:06:52.770 INFO:tasks.workunit.client.0.smithi097.stderr: -53> 2024-09-14T11:06:52.629+0000 7f8f8630c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 info.flags=0x17 2024-09-14T11:06:52.771 INFO:tasks.workunit.client.0.smithi097.stderr: -52> 2024-09-14T11:06:52.629+0000 7f8f8630c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 to cache LRU end 2024-09-14T11:06:52.771 INFO:tasks.workunit.client.0.smithi097.stderr: -51> 2024-09-14T11:06:52.629+0000 7f8f8630c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:06:52.771 INFO:tasks.workunit.client.0.smithi097.stderr: -50> 2024-09-14T11:06:52.629+0000 7f8f8630c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:52.771 INFO:tasks.workunit.client.0.smithi097.stderr: -49> 2024-09-14T11:06:52.629+0000 7f8f8630c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 2024-09-14T11:06:52.771 INFO:tasks.workunit.client.0.smithi097.stderr: -48> 2024-09-14T11:06:52.635+0000 7f8f8630c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 info.flags=0x17 2024-09-14T11:06:52.771 INFO:tasks.workunit.client.0.smithi097.stderr: -47> 2024-09-14T11:06:52.635+0000 7f8f8630c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 to cache LRU end 2024-09-14T11:06:52.771 INFO:tasks.workunit.client.0.smithi097.stderr: -46> 2024-09-14T11:06:52.635+0000 7f8f8630c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:52.771 INFO:tasks.workunit.client.0.smithi097.stderr: -45> 2024-09-14T11:06:52.635+0000 7f8f8630c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39, ofs0, ns] 2024-09-14T11:06:52.771 INFO:tasks.workunit.client.0.smithi097.stderr: -44> 2024-09-14T11:06:52.635+0000 7f8e627fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595104 cookie 94688869274624 notifier 7547 bl.length()=931 2024-09-14T11:06:52.771 INFO:tasks.workunit.client.0.smithi097.stderr: -43> 2024-09-14T11:06:52.635+0000 7f8e627fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 info.flags=0x17 2024-09-14T11:06:52.771 INFO:tasks.workunit.client.0.smithi097.stderr: -42> 2024-09-14T11:06:52.635+0000 7f8e627fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 to cache LRU end 2024-09-14T11:06:52.771 INFO:tasks.workunit.client.0.smithi097.stderr: -41> 2024-09-14T11:06:52.635+0000 7f8e627fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:52.771 INFO:tasks.workunit.client.0.smithi097.stderr: -40> 2024-09-14T11:06:52.636+0000 7f8f8630c800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39]): orig_sources= new_sources= 2024-09-14T11:06:52.772 INFO:tasks.workunit.client.0.smithi097.stderr: -39> 2024-09-14T11:06:52.636+0000 7f8f8630c800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39]): potential sources added=[] removed=[] 2024-09-14T11:06:52.772 INFO:tasks.workunit.client.0.smithi097.stderr: -38> 2024-09-14T11:06:52.636+0000 7f8f8630c800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39]): orig_dests= new_dests= 2024-09-14T11:06:52.772 INFO:tasks.workunit.client.0.smithi097.stderr: -37> 2024-09-14T11:06:52.636+0000 7f8f8630c800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39]): potential dests added=[] removed=[] 2024-09-14T11:06:52.772 INFO:tasks.workunit.client.0.smithi097.stderr: -36> 2024-09-14T11:06:52.641+0000 7f8f8630c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.0 2024-09-14T11:06:52.772 INFO:tasks.workunit.client.0.smithi097.stderr: -35> 2024-09-14T11:06:52.641+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.0 2024-09-14T11:06:52.772 INFO:tasks.workunit.client.0.smithi097.stderr: -34> 2024-09-14T11:06:52.641+0000 7f8f8630c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.1 2024-09-14T11:06:52.772 INFO:tasks.workunit.client.0.smithi097.stderr: -33> 2024-09-14T11:06:52.641+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.1 2024-09-14T11:06:52.772 INFO:tasks.workunit.client.0.smithi097.stderr: -32> 2024-09-14T11:06:52.641+0000 7f8f8630c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.2 2024-09-14T11:06:52.772 INFO:tasks.workunit.client.0.smithi097.stderr: -31> 2024-09-14T11:06:52.641+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.2 2024-09-14T11:06:52.772 INFO:tasks.workunit.client.0.smithi097.stderr: -30> 2024-09-14T11:06:52.641+0000 7f8f8630c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.3 2024-09-14T11:06:52.772 INFO:tasks.workunit.client.0.smithi097.stderr: -29> 2024-09-14T11:06:52.641+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.3 2024-09-14T11:06:52.772 INFO:tasks.workunit.client.0.smithi097.stderr: -28> 2024-09-14T11:06:52.641+0000 7f8f8630c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.4 2024-09-14T11:06:52.772 INFO:tasks.workunit.client.0.smithi097.stderr: -27> 2024-09-14T11:06:52.641+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.4 2024-09-14T11:06:52.773 INFO:tasks.workunit.client.0.smithi097.stderr: -26> 2024-09-14T11:06:52.641+0000 7f8f8630c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.5 2024-09-14T11:06:52.773 INFO:tasks.workunit.client.0.smithi097.stderr: -25> 2024-09-14T11:06:52.641+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.5 2024-09-14T11:06:52.773 INFO:tasks.workunit.client.0.smithi097.stderr: -24> 2024-09-14T11:06:52.641+0000 7f8f8630c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.6 2024-09-14T11:06:52.773 INFO:tasks.workunit.client.0.smithi097.stderr: -23> 2024-09-14T11:06:52.641+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.6 2024-09-14T11:06:52.773 INFO:tasks.workunit.client.0.smithi097.stderr: -22> 2024-09-14T11:06:52.641+0000 7f8f8630c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.7 2024-09-14T11:06:52.773 INFO:tasks.workunit.client.0.smithi097.stderr: -21> 2024-09-14T11:06:52.641+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.7 2024-09-14T11:06:52.773 INFO:tasks.workunit.client.0.smithi097.stderr: -20> 2024-09-14T11:06:52.641+0000 7f8f8630c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.8 2024-09-14T11:06:52.773 INFO:tasks.workunit.client.0.smithi097.stderr: -19> 2024-09-14T11:06:52.641+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.8 2024-09-14T11:06:52.773 INFO:tasks.workunit.client.0.smithi097.stderr: -18> 2024-09-14T11:06:52.641+0000 7f8f8630c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.9 2024-09-14T11:06:52.773 INFO:tasks.workunit.client.0.smithi097.stderr: -17> 2024-09-14T11:06:52.641+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.9 2024-09-14T11:06:52.773 INFO:tasks.workunit.client.0.smithi097.stderr: -16> 2024-09-14T11:06:52.641+0000 7f8f8630c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.10 2024-09-14T11:06:52.773 INFO:tasks.workunit.client.0.smithi097.stderr: -15> 2024-09-14T11:06:52.641+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.10 2024-09-14T11:06:52.773 INFO:tasks.workunit.client.0.smithi097.stderr: -14> 2024-09-14T11:06:52.641+0000 7f8f8630c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.11 2024-09-14T11:06:52.774 INFO:tasks.workunit.client.0.smithi097.stderr: -13> 2024-09-14T11:06:52.641+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1.11 2024-09-14T11:06:52.774 INFO:tasks.workunit.client.0.smithi097.stderr: -12> 2024-09-14T11:06:52.641+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.0 2024-09-14T11:06:52.774 INFO:tasks.workunit.client.0.smithi097.stderr: -11> 2024-09-14T11:06:52.641+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1 2024-09-14T11:06:52.774 INFO:tasks.workunit.client.0.smithi097.stderr: -10> 2024-09-14T11:06:52.642+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.2 2024-09-14T11:06:52.774 INFO:tasks.workunit.client.0.smithi097.stderr: -9> 2024-09-14T11:06:52.642+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.3 2024-09-14T11:06:52.774 INFO:tasks.workunit.client.0.smithi097.stderr: -8> 2024-09-14T11:06:52.642+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.4 2024-09-14T11:06:52.774 INFO:tasks.workunit.client.0.smithi097.stderr: -7> 2024-09-14T11:06:52.643+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.5 2024-09-14T11:06:52.774 INFO:tasks.workunit.client.0.smithi097.stderr: -6> 2024-09-14T11:06:52.643+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.6 2024-09-14T11:06:52.774 INFO:tasks.workunit.client.0.smithi097.stderr: -5> 2024-09-14T11:06:52.644+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.7 2024-09-14T11:06:52.774 INFO:tasks.workunit.client.0.smithi097.stderr: -4> 2024-09-14T11:06:52.644+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.8 2024-09-14T11:06:52.774 INFO:tasks.workunit.client.0.smithi097.stderr: -3> 2024-09-14T11:06:52.644+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.9 2024-09-14T11:06:52.774 INFO:tasks.workunit.client.0.smithi097.stderr: -2> 2024-09-14T11:06:52.645+0000 7f8f8630c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.10 2024-09-14T11:06:52.775 INFO:tasks.workunit.client.0.smithi097.stderr: -1> 2024-09-14T11:06:52.650+0000 7f8f8630c800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8f8630c800 time 2024-09-14T11:06:52.650806+0000 2024-09-14T11:06:52.775 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:06:52.775 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:52.775 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:06:52.775 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8f8978c76a] 2024-09-14T11:06:52.775 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f8f8978c928] 2024-09-14T11:06:52.775 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561e7798b0b1] 2024-09-14T11:06:52.775 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x561e7799a124] 2024-09-14T11:06:52.775 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x561e7799afc4] 2024-09-14T11:06:52.775 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-14T11:06:52.775 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f8f88429590] 2024-09-14T11:06:52.775 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-14T11:06:52.775 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-14T11:06:52.775 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:52.776 INFO:tasks.workunit.client.0.smithi097.stderr: 0> 2024-09-14T11:06:52.651+0000 7f8f8630c800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:06:52.776 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f8f8630c800 thread_name:radosgw-admin 2024-09-14T11:06:52.776 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:52.776 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:06:52.776 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8f8843e6f0] 2024-09-14T11:06:52.776 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f8f8848b99c] 2024-09-14T11:06:52.776 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-14T11:06:52.776 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-14T11:06:52.776 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8f8978c7c4] 2024-09-14T11:06:52.776 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f8f8978c928] 2024-09-14T11:06:52.776 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561e7798b0b1] 2024-09-14T11:06:52.776 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x561e7799a124] 2024-09-14T11:06:52.777 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x561e7799afc4] 2024-09-14T11:06:52.777 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-14T11:06:52.777 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f8f88429590] 2024-09-14T11:06:52.777 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-14T11:06:52.777 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-14T11:06:52.777 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:06:52.777 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:52.777 INFO:tasks.workunit.client.0.smithi097.stderr:--- logging levels --- 2024-09-14T11:06:52.777 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 none 2024-09-14T11:06:52.777 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 lockdep 2024-09-14T11:06:52.777 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 context 2024-09-14T11:06:52.777 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 crush 2024-09-14T11:06:52.777 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds 2024-09-14T11:06:52.778 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_balancer 2024-09-14T11:06:52.778 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_locker 2024-09-14T11:06:52.778 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log 2024-09-14T11:06:52.778 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log_expire 2024-09-14T11:06:52.778 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_migrator 2024-09-14T11:06:52.778 INFO:tasks.workunit.client.0.smithi097.stderr: 3/ 5 mds_quiesce 2024-09-14T11:06:52.778 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 buffer 2024-09-14T11:06:52.778 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 timer 2024-09-14T11:06:52.778 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 filer 2024-09-14T11:06:52.778 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 striper 2024-09-14T11:06:52.778 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 objecter 2024-09-14T11:06:52.778 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rados 2024-09-14T11:06:52.778 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd 2024-09-14T11:06:52.778 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_mirror 2024-09-14T11:06:52.779 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_replay 2024-09-14T11:06:52.779 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_pwl 2024-09-14T11:06:52.779 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 journaler 2024-09-14T11:06:52.779 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objectcacher 2024-09-14T11:06:52.779 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:06:52.779 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 client 2024-09-14T11:06:52.779 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 osd 2024-09-14T11:06:52.779 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 optracker 2024-09-14T11:06:52.779 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objclass 2024-09-14T11:06:52.779 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 filestore 2024-09-14T11:06:52.779 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 journal 2024-09-14T11:06:52.779 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 ms 2024-09-14T11:06:52.779 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mon 2024-09-14T11:06:52.779 INFO:tasks.workunit.client.0.smithi097.stderr: 0/10 monc 2024-09-14T11:06:52.780 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 paxos 2024-09-14T11:06:52.780 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 tp 2024-09-14T11:06:52.780 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 auth 2024-09-14T11:06:52.780 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 crypto 2024-09-14T11:06:52.780 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 finisher 2024-09-14T11:06:52.780 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 reserver 2024-09-14T11:06:52.780 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 heartbeatmap 2024-09-14T11:06:52.780 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 perfcounter 2024-09-14T11:06:52.780 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw 2024-09-14T11:06:52.780 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_sync 2024-09-14T11:06:52.780 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_datacache 2024-09-14T11:06:52.780 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_access 2024-09-14T11:06:52.781 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:06:52.781 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_flight 2024-09-14T11:06:52.781 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:06:52.781 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw_notification 2024-09-14T11:06:52.781 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 javaclient 2024-09-14T11:06:52.781 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 asok 2024-09-14T11:06:52.781 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 throttle 2024-09-14T11:06:52.781 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 refs 2024-09-14T11:06:52.781 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 compressor 2024-09-14T11:06:52.781 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluestore 2024-09-14T11:06:52.781 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluefs 2024-09-14T11:06:52.781 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 bdev 2024-09-14T11:06:52.781 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 kstore 2024-09-14T11:06:52.781 INFO:tasks.workunit.client.0.smithi097.stderr: 4/ 5 rocksdb 2024-09-14T11:06:52.782 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 fuse 2024-09-14T11:06:52.782 INFO:tasks.workunit.client.0.smithi097.stderr: 2/ 5 mgr 2024-09-14T11:06:52.782 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mgrc 2024-09-14T11:06:52.782 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 dpdk 2024-09-14T11:06:52.782 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 eventtrace 2024-09-14T11:06:52.782 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 prioritycache 2024-09-14T11:06:52.782 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 test 2024-09-14T11:06:52.782 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:06:52.782 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephsqlite 2024-09-14T11:06:52.782 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:06:52.782 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore 2024-09-14T11:06:52.782 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_onode 2024-09-14T11:06:52.782 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_odata 2024-09-14T11:06:52.782 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_omap 2024-09-14T11:06:52.782 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_tm 2024-09-14T11:06:52.783 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_t 2024-09-14T11:06:52.783 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:06:52.783 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_epm 2024-09-14T11:06:52.783 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_lba 2024-09-14T11:06:52.783 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:06:52.783 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cache 2024-09-14T11:06:52.783 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_journal 2024-09-14T11:06:52.783 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_device 2024-09-14T11:06:52.783 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_backref 2024-09-14T11:06:52.783 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 alienstore 2024-09-14T11:06:52.783 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mclock 2024-09-14T11:06:52.783 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cyanstore 2024-09-14T11:06:52.783 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 ceph_exporter 2024-09-14T11:06:52.783 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 memstore 2024-09-14T11:06:52.783 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 trace 2024-09-14T11:06:52.784 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 ceph_dedup 2024-09-14T11:06:52.784 INFO:tasks.workunit.client.0.smithi097.stderr: -2/-2 (syslog threshold) 2024-09-14T11:06:52.784 INFO:tasks.workunit.client.0.smithi097.stderr: 99/99 (stderr threshold) 2024-09-14T11:06:52.784 INFO:tasks.workunit.client.0.smithi097.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:06:52.784 INFO:tasks.workunit.client.0.smithi097.stderr: 7f8db27fc640 / http_manager 2024-09-14T11:06:52.784 INFO:tasks.workunit.client.0.smithi097.stderr: 7f8e38fe1640 / http_manager 2024-09-14T11:06:52.784 INFO:tasks.workunit.client.0.smithi097.stderr: 7f8e39fe3640 / rgw_dt_lg_renew 2024-09-14T11:06:52.784 INFO:tasks.workunit.client.0.smithi097.stderr: 7f8e617fa640 / ms_dispatch 2024-09-14T11:06:52.784 INFO:tasks.workunit.client.0.smithi097.stderr: 7f8e627fc640 / io_context_pool 2024-09-14T11:06:52.784 INFO:tasks.workunit.client.0.smithi097.stderr: 7f8e62ffd640 / io_context_pool 2024-09-14T11:06:52.784 INFO:tasks.workunit.client.0.smithi097.stderr: 7f8e697fa640 / ms_dispatch 2024-09-14T11:06:52.784 INFO:tasks.workunit.client.0.smithi097.stderr: 7f8e6bfff640 / ms_dispatch 2024-09-14T11:06:52.784 INFO:tasks.workunit.client.0.smithi097.stderr: 7f8e71e0b640 / io_context_pool 2024-09-14T11:06:52.785 INFO:tasks.workunit.client.0.smithi097.stderr: 7f8f7b5fc640 / msgr-worker-2 2024-09-14T11:06:52.785 INFO:tasks.workunit.client.0.smithi097.stderr: 7f8f83dfd640 / msgr-worker-1 2024-09-14T11:06:52.785 INFO:tasks.workunit.client.0.smithi097.stderr: 7f8f845fe640 / msgr-worker-0 2024-09-14T11:06:52.785 INFO:tasks.workunit.client.0.smithi097.stderr: 7f8f84dff640 / io_context_pool 2024-09-14T11:06:52.785 INFO:tasks.workunit.client.0.smithi097.stderr: 7f8f8630c800 / radosgw-admin 2024-09-14T11:06:52.785 INFO:tasks.workunit.client.0.smithi097.stderr: max_recent 500 2024-09-14T11:06:52.785 INFO:tasks.workunit.client.0.smithi097.stderr: max_new 1000 2024-09-14T11:06:52.785 INFO:tasks.workunit.client.0.smithi097.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:06:52.652424Z_1c4128e8-6469-49de-881b-11508025a5c2/log 2024-09-14T11:06:52.785 INFO:tasks.workunit.client.0.smithi097.stderr:--- end dump of recent events --- 2024-09-14T11:06:52.785 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-14T11:06:52.786 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:06:52.787 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:06:52.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.725+0000 7f01fb734800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.727+0000 7f01fb734800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:52.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.727+0000 7f01fb734800 20 realm 2024-09-14T11:06:52.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.727+0000 7f01fb734800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.728+0000 7f01fb734800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:52.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.728+0000 7f01fb734800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:06:52.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.728+0000 7f01fb734800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.728+0000 7f01fb734800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:52.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.728+0000 7f01fb734800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.728+0000 7f01fb734800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:52.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.728+0000 7f01fb734800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.729+0000 7f01fb734800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:06:52.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.729+0000 7f01fb734800 20 searching for the correct realm 2024-09-14T11:06:52.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.731+0000 7f01f7cb8640 0 -- 172.21.15.97:0/31395324 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f01ec043060 msgr2=0x7f01ec06b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:52.934 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.936+0000 7f01f6cb6640 0 -- 172.21.15.97:0/31395324 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f01e8021060 msgr2=0x7f01e80443f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:52.939 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.940+0000 7f01fb734800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:06:52.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.940+0000 7f01fb734800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:06:52.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.940+0000 7f01fb734800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:06:52.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.940+0000 7f01fb734800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:06:52.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.940+0000 7f01fb734800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:06:52.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.940+0000 7f01fb734800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:06:52.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.940+0000 7f01fb734800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.941+0000 7f01fb734800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:52.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.941+0000 7f01fb734800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.941+0000 7f01fb734800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:52.940 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.941+0000 7f01fb734800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.942+0000 7f01fb734800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:06:52.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.942+0000 7f01fb734800 20 zone default found 2024-09-14T11:06:52.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.942+0000 7f01fb734800 4 Realm: () 2024-09-14T11:06:52.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.942+0000 7f01fb734800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:06:52.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.942+0000 7f01fb734800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:06:52.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.942+0000 7f01fb734800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:06:52.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.942+0000 7f01fb734800 20 zonegroup default 2024-09-14T11:06:52.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.942+0000 7f01fb734800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.942+0000 7f01fb734800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:52.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.942+0000 7f01fb734800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.942+0000 7f01fb734800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:52.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.942+0000 7f01fb734800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.943+0000 7f01fb734800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:52.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.943+0000 7f01fb734800 20 started sync module instance, tier type = 2024-09-14T11:06:52.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.943+0000 7f01fb734800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:06:52.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.952+0000 7f01fb734800 20 add_watcher() i=0 2024-09-14T11:06:52.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.952+0000 7f01fb734800 20 add_watcher() i=1 2024-09-14T11:06:52.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.952+0000 7f01fb734800 20 add_watcher() i=2 2024-09-14T11:06:52.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.952+0000 7f01fb734800 20 add_watcher() i=3 2024-09-14T11:06:52.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.952+0000 7f01fb734800 20 add_watcher() i=4 2024-09-14T11:06:52.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.952+0000 7f01fb734800 20 add_watcher() i=5 2024-09-14T11:06:52.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.952+0000 7f01fb734800 20 add_watcher() i=6 2024-09-14T11:06:52.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.953+0000 7f01fb734800 20 add_watcher() i=7 2024-09-14T11:06:52.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.953+0000 7f01fb734800 2 all 8 watchers are set, enabling cache 2024-09-14T11:06:52.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.955+0000 7f00adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:52.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.955+0000 7f01fb734800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:06:52.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.955+0000 7f01fb734800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:06:52.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.955+0000 7f01fb734800 5 note: GC not initialized 2024-09-14T11:06:52.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.955+0000 7f00acfe1640 20 reqs_thread_entry: start 2024-09-14T11:06:52.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.955+0000 7f01fb734800 20 init_complete bucket index max shards: 11 2024-09-14T11:06:52.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.956+0000 7f01fb734800 20 Filter name: none 2024-09-14T11:06:52.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.956+0000 7f00267fc640 20 reqs_thread_entry: start 2024-09-14T11:06:52.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.956+0000 7f01fb734800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.956+0000 7f01fb734800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:06:52.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.956+0000 7f01fb734800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.957+0000 7f01fb734800 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:06:52.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.957+0000 7f01fb734800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:06:52.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.957+0000 7f01fb734800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.957+0000 7f01fb734800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:06:52.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.957+0000 7f01fb734800 20 rados->read ofs=0 len=0 2024-09-14T11:06:52.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.957+0000 7f01fb734800 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:06:52.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.957+0000 7f01fb734800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:06:52.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.959+0000 7f00adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:52.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.961+0000 7f01fb734800 20 remove_watcher() i=0 2024-09-14T11:06:52.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.961+0000 7f01fb734800 2 removed watcher, disabling cache 2024-09-14T11:06:52.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.962+0000 7f01fb734800 20 remove_watcher() i=1 2024-09-14T11:06:52.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.963+0000 7f01fb734800 20 remove_watcher() i=2 2024-09-14T11:06:52.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.964+0000 7f01fb734800 20 remove_watcher() i=3 2024-09-14T11:06:52.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.965+0000 7f01fb734800 20 remove_watcher() i=4 2024-09-14T11:06:52.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.966+0000 7f01fb734800 20 remove_watcher() i=5 2024-09-14T11:06:52.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.967+0000 7f01fb734800 20 remove_watcher() i=6 2024-09-14T11:06:52.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:52.968+0000 7f01fb734800 20 remove_watcher() i=7 2024-09-14T11:06:52.976 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:52.976 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:06:52.976 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: abort-at-change-reshard-state id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:06:52.977 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:06:53.029 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:06:53.061 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:06:53.062 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:06:53.098 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.100+0000 7f1df1940800 20 rados->read ofs=0 len=0 2024-09-14T11:06:53.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.102+0000 7f1df1940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:53.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.102+0000 7f1df1940800 20 realm 2024-09-14T11:06:53.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.102+0000 7f1df1940800 20 rados->read ofs=0 len=0 2024-09-14T11:06:53.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.102+0000 7f1df1940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:53.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.102+0000 7f1df1940800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:06:53.101 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.102+0000 7f1df1940800 20 rados->read ofs=0 len=0 2024-09-14T11:06:53.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.102+0000 7f1df1940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:53.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.102+0000 7f1df1940800 20 rados->read ofs=0 len=0 2024-09-14T11:06:53.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.103+0000 7f1df1940800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:53.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.103+0000 7f1df1940800 20 rados->read ofs=0 len=0 2024-09-14T11:06:53.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.104+0000 7f1df1940800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:06:53.102 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.104+0000 7f1df1940800 20 searching for the correct realm 2024-09-14T11:06:53.104 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.106+0000 7f1dedec1640 0 -- 172.21.15.97:0/3638584030 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f1dd806e070 msgr2=0x7f1dd806a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:06:53.310 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.311+0000 7f1de4ebf640 0 -- 172.21.15.97:0/3638584030 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f1de00ad340 msgr2=0x7f1de00e50b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:53.314 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.316+0000 7f1df1940800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:06:53.314 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.316+0000 7f1df1940800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:06:53.314 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.316+0000 7f1df1940800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:06:53.315 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.316+0000 7f1df1940800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:06:53.315 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.316+0000 7f1df1940800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:06:53.315 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.316+0000 7f1df1940800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:06:53.315 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.316+0000 7f1df1940800 20 rados->read ofs=0 len=0 2024-09-14T11:06:53.315 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.316+0000 7f1df1940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:53.315 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.316+0000 7f1df1940800 20 rados->read ofs=0 len=0 2024-09-14T11:06:53.316 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.316+0000 7f1df1940800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:53.316 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.316+0000 7f1df1940800 20 rados->read ofs=0 len=0 2024-09-14T11:06:53.316 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.317+0000 7f1df1940800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:06:53.316 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.317+0000 7f1df1940800 20 zone default found 2024-09-14T11:06:53.316 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.317+0000 7f1df1940800 4 Realm: () 2024-09-14T11:06:53.317 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.317+0000 7f1df1940800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:06:53.317 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.317+0000 7f1df1940800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:06:53.317 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.317+0000 7f1df1940800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:06:53.317 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.317+0000 7f1df1940800 20 zonegroup default 2024-09-14T11:06:53.317 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.317+0000 7f1df1940800 20 rados->read ofs=0 len=0 2024-09-14T11:06:53.317 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.317+0000 7f1df1940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:53.317 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.317+0000 7f1df1940800 20 rados->read ofs=0 len=0 2024-09-14T11:06:53.317 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.317+0000 7f1df1940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:53.317 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.317+0000 7f1df1940800 20 rados->read ofs=0 len=0 2024-09-14T11:06:53.317 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.317+0000 7f1df1940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:53.317 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.317+0000 7f1df1940800 20 started sync module instance, tier type = 2024-09-14T11:06:53.317 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.317+0000 7f1df1940800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:06:53.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.326+0000 7f1df1940800 20 add_watcher() i=0 2024-09-14T11:06:53.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.326+0000 7f1df1940800 20 add_watcher() i=1 2024-09-14T11:06:53.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.326+0000 7f1df1940800 20 add_watcher() i=2 2024-09-14T11:06:53.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.326+0000 7f1df1940800 20 add_watcher() i=3 2024-09-14T11:06:53.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.326+0000 7f1df1940800 20 add_watcher() i=4 2024-09-14T11:06:53.326 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.326+0000 7f1df1940800 20 add_watcher() i=5 2024-09-14T11:06:53.326 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.326+0000 7f1df1940800 20 add_watcher() i=6 2024-09-14T11:06:53.326 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.327+0000 7f1df1940800 20 add_watcher() i=7 2024-09-14T11:06:53.326 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.327+0000 7f1df1940800 2 all 8 watchers are set, enabling cache 2024-09-14T11:06:53.328 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.329+0000 7f1ca37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:53.329 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.330+0000 7f1df1940800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:06:53.329 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.330+0000 7f1df1940800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:06:53.329 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.330+0000 7f1df1940800 5 note: GC not initialized 2024-09-14T11:06:53.329 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.330+0000 7f1ca27e4640 20 reqs_thread_entry: start 2024-09-14T11:06:53.329 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.330+0000 7f1df1940800 20 init_complete bucket index max shards: 11 2024-09-14T11:06:53.329 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.330+0000 7f1df1940800 20 Filter name: none 2024-09-14T11:06:53.329 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.330+0000 7f1c13fff640 20 reqs_thread_entry: start 2024-09-14T11:06:53.329 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.330+0000 7f1df1940800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:06:53.329 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.330+0000 7f1df1940800 20 rados->read ofs=0 len=0 2024-09-14T11:06:53.330 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.331+0000 7f1df1940800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:06:53.330 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.331+0000 7f1df1940800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:06:53.330 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.331+0000 7f1df1940800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:06:53.330 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.331+0000 7f1df1940800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 : miss 2024-09-14T11:06:53.330 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.331+0000 7f1df1940800 20 rados->read ofs=0 len=0 2024-09-14T11:06:53.330 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.331+0000 7f1df1940800 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:06:53.331 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.331+0000 7f1df1940800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 info.flags=0x17 2024-09-14T11:06:53.331 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.331+0000 7f1df1940800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 to cache LRU end 2024-09-14T11:06:53.331 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.331+0000 7f1df1940800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:06:53.331 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.331+0000 7f1df1940800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:06:53.331 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.331+0000 7f1df1940800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 2024-09-14T11:06:53.331 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.332+0000 7f1df1940800 0 INFO: RGWReshardLock::lock found lock on abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 to be held by another RGW process; skipping for now 2024-09-14T11:06:53.331 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.333+0000 7f1ca37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:53.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.335+0000 7f1df1940800 20 remove_watcher() i=0 2024-09-14T11:06:53.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.335+0000 7f1df1940800 2 removed watcher, disabling cache 2024-09-14T11:06:53.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.336+0000 7f1df1940800 20 remove_watcher() i=1 2024-09-14T11:06:53.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.337+0000 7f1df1940800 20 remove_watcher() i=2 2024-09-14T11:06:53.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.338+0000 7f1df1940800 20 remove_watcher() i=3 2024-09-14T11:06:53.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.339+0000 7f1df1940800 20 remove_watcher() i=4 2024-09-14T11:06:53.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.340+0000 7f1df1940800 20 remove_watcher() i=5 2024-09-14T11:06:53.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.341+0000 7f1df1940800 20 remove_watcher() i=6 2024-09-14T11:06:53.341 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:06:53.342+0000 7f1df1940800 20 remove_watcher() i=7 2024-09-14T11:06:53.351 INFO:tasks.workunit.client.0.smithi097.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:07:23.384 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:07:23.421 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:07:23.422 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:07:23.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.465+0000 7fec16d32800 20 rados->read ofs=0 len=0 2024-09-14T11:07:23.466 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.467+0000 7fec16d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:23.466 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.467+0000 7fec16d32800 20 realm 2024-09-14T11:07:23.467 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.467+0000 7fec16d32800 20 rados->read ofs=0 len=0 2024-09-14T11:07:23.467 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.467+0000 7fec16d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:23.467 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.467+0000 7fec16d32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:07:23.467 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.467+0000 7fec16d32800 20 rados->read ofs=0 len=0 2024-09-14T11:07:23.467 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.467+0000 7fec16d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:23.467 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.467+0000 7fec16d32800 20 rados->read ofs=0 len=0 2024-09-14T11:07:23.468 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.468+0000 7fec16d32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:07:23.468 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.468+0000 7fec16d32800 20 rados->read ofs=0 len=0 2024-09-14T11:07:23.468 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.469+0000 7fec16d32800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:07:23.469 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.469+0000 7fec16d32800 20 searching for the correct realm 2024-09-14T11:07:23.471 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.471+0000 7fec0bfff640 0 -- 172.21.15.97:0/3783519470 >> [v2:172.21.15.97:6816/4093696477,v1:172.21.15.97:6817/4093696477] conn(0x5616114ae040 msgr2=0x5616114b0470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:07:23.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.475+0000 7fec129bc640 0 -- 172.21.15.97:0/3783519470 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7febfc03e8b0 msgr2=0x7febfc047470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:07:23.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.480+0000 7fec16d32800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:07:23.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.480+0000 7fec16d32800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:07:23.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.480+0000 7fec16d32800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:07:23.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.480+0000 7fec16d32800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:07:23.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.480+0000 7fec16d32800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:07:23.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.480+0000 7fec16d32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:07:23.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.480+0000 7fec16d32800 20 rados->read ofs=0 len=0 2024-09-14T11:07:23.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.480+0000 7fec16d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:23.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.480+0000 7fec16d32800 20 rados->read ofs=0 len=0 2024-09-14T11:07:23.482 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.481+0000 7fec16d32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:07:23.482 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.481+0000 7fec16d32800 20 rados->read ofs=0 len=0 2024-09-14T11:07:23.482 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.481+0000 7fec16d32800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:07:23.482 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.481+0000 7fec16d32800 20 zone default found 2024-09-14T11:07:23.482 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.481+0000 7fec16d32800 4 Realm: () 2024-09-14T11:07:23.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.481+0000 7fec16d32800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:07:23.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.481+0000 7fec16d32800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:07:23.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.481+0000 7fec16d32800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:07:23.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.481+0000 7fec16d32800 20 zonegroup default 2024-09-14T11:07:23.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.481+0000 7fec16d32800 20 rados->read ofs=0 len=0 2024-09-14T11:07:23.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.481+0000 7fec16d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:23.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.481+0000 7fec16d32800 20 rados->read ofs=0 len=0 2024-09-14T11:07:23.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.482+0000 7fec16d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:23.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.482+0000 7fec16d32800 20 rados->read ofs=0 len=0 2024-09-14T11:07:23.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.482+0000 7fec16d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:23.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.482+0000 7fec16d32800 20 started sync module instance, tier type = 2024-09-14T11:07:23.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.482+0000 7fec16d32800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:07:23.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.492+0000 7fec16d32800 20 add_watcher() i=0 2024-09-14T11:07:23.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.492+0000 7fec16d32800 20 add_watcher() i=1 2024-09-14T11:07:23.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.492+0000 7fec16d32800 20 add_watcher() i=2 2024-09-14T11:07:23.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.492+0000 7fec16d32800 20 add_watcher() i=3 2024-09-14T11:07:23.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.492+0000 7fec16d32800 20 add_watcher() i=4 2024-09-14T11:07:23.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.492+0000 7fec16d32800 20 add_watcher() i=5 2024-09-14T11:07:23.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.492+0000 7fec16d32800 20 add_watcher() i=6 2024-09-14T11:07:23.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.493+0000 7fec16d32800 20 add_watcher() i=7 2024-09-14T11:07:23.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.493+0000 7fec16d32800 2 all 8 watchers are set, enabling cache 2024-09-14T11:07:23.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.495+0000 7feac97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:07:23.495 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.495+0000 7fec16d32800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:07:23.495 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.495+0000 7fec16d32800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:07:23.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.495+0000 7fec16d32800 5 note: GC not initialized 2024-09-14T11:07:23.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.495+0000 7fea43fff640 20 reqs_thread_entry: start 2024-09-14T11:07:23.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.496+0000 7fec16d32800 20 init_complete bucket index max shards: 11 2024-09-14T11:07:23.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.496+0000 7fec16d32800 20 Filter name: none 2024-09-14T11:07:23.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.496+0000 7fea41ffb640 20 reqs_thread_entry: start 2024-09-14T11:07:23.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.496+0000 7fec16d32800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:07:23.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.496+0000 7fec16d32800 20 rados->read ofs=0 len=0 2024-09-14T11:07:23.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.496+0000 7fec16d32800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:07:23.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.496+0000 7fec16d32800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:07:23.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.496+0000 7fec16d32800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:07:23.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.496+0000 7fec16d32800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 : miss 2024-09-14T11:07:23.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.496+0000 7fec16d32800 20 rados->read ofs=0 len=0 2024-09-14T11:07:23.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.497+0000 7fec16d32800 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:07:23.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.497+0000 7fec16d32800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 info.flags=0x17 2024-09-14T11:07:23.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.497+0000 7fec16d32800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 to cache LRU end 2024-09-14T11:07:23.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.497+0000 7fec16d32800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:07:23.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.497+0000 7fec16d32800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:07:23.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.497+0000 7fec16d32800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 2024-09-14T11:07:23.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.498+0000 7fec16d32800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:07:23.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.504+0000 7fec16d32800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 info.flags=0x17 2024-09-14T11:07:23.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.504+0000 7fec16d32800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 to cache LRU end 2024-09-14T11:07:23.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.504+0000 7fec16d32800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:07:23.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.504+0000 7fec16d32800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39, ofs0, ns] 2024-09-14T11:07:23.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.505+0000 7feaf67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595105 cookie 94652779441808 notifier 8085 bl.length()=931 2024-09-14T11:07:23.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.505+0000 7feaf67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 info.flags=0x17 2024-09-14T11:07:23.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.505+0000 7feaf67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 to cache LRU end 2024-09-14T11:07:23.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.505+0000 7feaf67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:07:23.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.505+0000 7fec16d32800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39]): orig_sources= new_sources= 2024-09-14T11:07:23.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.505+0000 7fec16d32800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39]): potential sources added=[] removed=[] 2024-09-14T11:07:23.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.505+0000 7fec16d32800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39]): orig_dests= new_dests= 2024-09-14T11:07:23.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.505+0000 7fec16d32800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39]): potential dests added=[] removed=[] 2024-09-14T11:07:23.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.511+0000 7fec16d32800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.2.0 2024-09-14T11:07:23.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.511+0000 7fec16d32800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.2.0 2024-09-14T11:07:23.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.511+0000 7fec16d32800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.2.1 2024-09-14T11:07:23.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.511+0000 7fec16d32800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.2.1 2024-09-14T11:07:23.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.511+0000 7fec16d32800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.2.2 2024-09-14T11:07:23.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.511+0000 7fec16d32800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.2.2 2024-09-14T11:07:23.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.511+0000 7fec16d32800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.2.3 2024-09-14T11:07:23.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.511+0000 7fec16d32800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.2.3 2024-09-14T11:07:23.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.511+0000 7fec16d32800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.2.4 2024-09-14T11:07:23.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.511+0000 7fec16d32800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.2.4 2024-09-14T11:07:23.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.511+0000 7fec16d32800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.2.5 2024-09-14T11:07:23.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.511+0000 7fec16d32800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.2.5 2024-09-14T11:07:23.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.511+0000 7fec16d32800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.2.6 2024-09-14T11:07:23.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.511+0000 7fec16d32800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.2.6 2024-09-14T11:07:23.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.511+0000 7fec16d32800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.2.7 2024-09-14T11:07:23.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.511+0000 7fec16d32800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.2.7 2024-09-14T11:07:23.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.511+0000 7fec16d32800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.2.8 2024-09-14T11:07:23.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.511+0000 7fec16d32800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.2.8 2024-09-14T11:07:23.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.511+0000 7fec16d32800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.2.9 2024-09-14T11:07:23.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.511+0000 7fec16d32800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.2.9 2024-09-14T11:07:23.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.511+0000 7fec16d32800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.2.10 2024-09-14T11:07:23.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.511+0000 7fec16d32800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.2.10 2024-09-14T11:07:23.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.511+0000 7fec16d32800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.2.11 2024-09-14T11:07:23.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.511+0000 7fec16d32800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.2.11 2024-09-14T11:07:23.513 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.511+0000 7fec16d32800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.0 2024-09-14T11:07:23.513 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.511+0000 7fec16d32800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1 2024-09-14T11:07:23.513 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.512+0000 7fec16d32800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.2 2024-09-14T11:07:23.513 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.512+0000 7fec16d32800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.3 2024-09-14T11:07:23.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.513+0000 7fec16d32800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.4 2024-09-14T11:07:23.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.513+0000 7fec16d32800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.5 2024-09-14T11:07:23.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.514+0000 7fec16d32800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.6 2024-09-14T11:07:23.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.514+0000 7fec16d32800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.7 2024-09-14T11:07:23.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.515+0000 7fec16d32800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.8 2024-09-14T11:07:23.515 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.516+0000 7fec16d32800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.9 2024-09-14T11:07:23.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.517+0000 7fec16d32800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.10 2024-09-14T11:07:23.519 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.520+0000 7fec16d32800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 : hit (requested=0x17, cached=0x17) 2024-09-14T11:07:23.519 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.520+0000 7fec16d32800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 2024-09-14T11:07:23.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.521+0000 7fec16d32800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 info.flags=0x17 2024-09-14T11:07:23.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.521+0000 7fec16d32800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 to cache LRU end 2024-09-14T11:07:23.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.521+0000 7fec16d32800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:07:23.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.521+0000 7fec16d32800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39, ofs0, ns] 2024-09-14T11:07:23.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.521+0000 7feaf5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595106 cookie 94652779441808 notifier 8085 bl.length()=931 2024-09-14T11:07:23.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.521+0000 7feaf5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 info.flags=0x17 2024-09-14T11:07:23.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.521+0000 7feaf5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 to cache LRU end 2024-09-14T11:07:23.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.521+0000 7feaf5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:07:23.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.522+0000 7fec16d32800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39]): orig_sources= new_sources= 2024-09-14T11:07:23.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.522+0000 7fec16d32800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39]): potential sources added=[] removed=[] 2024-09-14T11:07:23.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.522+0000 7fec16d32800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39]): orig_dests= new_dests= 2024-09-14T11:07:23.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.522+0000 7fec16d32800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39]): potential dests added=[] removed=[] 2024-09-14T11:07:23.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.524+0000 7fec16d32800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.0 2024-09-14T11:07:23.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.524+0000 7fec16d32800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.1 2024-09-14T11:07:23.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.524+0000 7fec16d32800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.2 2024-09-14T11:07:23.524 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.525+0000 7fec16d32800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.3 2024-09-14T11:07:23.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.525+0000 7fec16d32800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.4 2024-09-14T11:07:23.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.525+0000 7fec16d32800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.5 2024-09-14T11:07:23.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.526+0000 7fec16d32800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.6 2024-09-14T11:07:23.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.526+0000 7fec16d32800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.7 2024-09-14T11:07:23.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.526+0000 7fec16d32800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.8 2024-09-14T11:07:23.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.527+0000 7fec16d32800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.9 2024-09-14T11:07:23.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.527+0000 7fec16d32800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39.10 2024-09-14T11:07:23.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.528+0000 7fec16d32800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 : hit (requested=0x17, cached=0x17) 2024-09-14T11:07:23.527 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.528+0000 7fec16d32800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 2024-09-14T11:07:23.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.529+0000 7fec16d32800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 info.flags=0x17 2024-09-14T11:07:23.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.529+0000 7fec16d32800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 to cache LRU end 2024-09-14T11:07:23.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.529+0000 7fec16d32800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:07:23.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.529+0000 7fec16d32800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39, ofs0, ns] 2024-09-14T11:07:23.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.529+0000 7feaf5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595107 cookie 94652779441808 notifier 8085 bl.length()=899 2024-09-14T11:07:23.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.529+0000 7feaf5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 info.flags=0x17 2024-09-14T11:07:23.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.529+0000 7feaf5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 to cache LRU end 2024-09-14T11:07:23.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.529+0000 7feaf5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:07:23.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.529+0000 7fec16d32800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39]): orig_sources= new_sources= 2024-09-14T11:07:23.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.529+0000 7fec16d32800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39]): potential sources added=[] removed=[] 2024-09-14T11:07:23.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.529+0000 7fec16d32800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39]): orig_dests= new_dests= 2024-09-14T11:07:23.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.529+0000 7fec16d32800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39]): potential dests added=[] removed=[] 2024-09-14T11:07:23.531 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.531+0000 7fec16d32800 1 execute INFO: reshard of bucket "abort-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-14T11:07:23.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.533+0000 7feac97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:07:23.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.535+0000 7fec16d32800 20 remove_watcher() i=0 2024-09-14T11:07:23.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.535+0000 7fec16d32800 2 removed watcher, disabling cache 2024-09-14T11:07:23.536 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.536+0000 7fec16d32800 20 remove_watcher() i=1 2024-09-14T11:07:23.537 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.538+0000 7fec16d32800 20 remove_watcher() i=2 2024-09-14T11:07:23.538 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.539+0000 7fec16d32800 20 remove_watcher() i=3 2024-09-14T11:07:23.539 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.540+0000 7fec16d32800 20 remove_watcher() i=4 2024-09-14T11:07:23.540 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.541+0000 7fec16d32800 20 remove_watcher() i=5 2024-09-14T11:07:23.541 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.542+0000 7fec16d32800 20 remove_watcher() i=6 2024-09-14T11:07:23.542 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.543+0000 7fec16d32800 20 remove_watcher() i=7 2024-09-14T11:07:23.554 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-14T11:07:23.582 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:07:23.583 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:07:23.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.821+0000 7fe6fe528800 20 rados->read ofs=0 len=0 2024-09-14T11:07:23.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.823+0000 7fe6fe528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:23.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.823+0000 7fe6fe528800 20 realm 2024-09-14T11:07:23.823 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.823+0000 7fe6fe528800 20 rados->read ofs=0 len=0 2024-09-14T11:07:23.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.823+0000 7fe6fe528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:23.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.823+0000 7fe6fe528800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:07:23.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.823+0000 7fe6fe528800 20 rados->read ofs=0 len=0 2024-09-14T11:07:23.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.824+0000 7fe6fe528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:23.824 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.824+0000 7fe6fe528800 20 rados->read ofs=0 len=0 2024-09-14T11:07:23.825 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.824+0000 7fe6fe528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:07:23.825 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.824+0000 7fe6fe528800 20 rados->read ofs=0 len=0 2024-09-14T11:07:23.825 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.825+0000 7fe6fe528800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:07:23.825 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.825+0000 7fe6fe528800 20 searching for the correct realm 2024-09-14T11:07:23.826 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.827+0000 7fe6faa70640 0 -- 172.21.15.97:0/2322467442 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x55a45c5ce150 msgr2=0x55a45c5d05c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:07:23.830 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.831+0000 7fe6fa26f640 0 -- 172.21.15.97:0/2322467442 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7fe6e405d3e0 msgr2=0x7fe6e405d860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:07:23.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.835+0000 7fe6fe528800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:07:23.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.835+0000 7fe6fe528800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:07:23.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.835+0000 7fe6fe528800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:07:23.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.835+0000 7fe6fe528800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:07:23.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.835+0000 7fe6fe528800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:07:23.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.835+0000 7fe6fe528800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:07:23.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.835+0000 7fe6fe528800 20 rados->read ofs=0 len=0 2024-09-14T11:07:23.837 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.836+0000 7fe6fe528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:23.837 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.836+0000 7fe6fe528800 20 rados->read ofs=0 len=0 2024-09-14T11:07:23.837 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.836+0000 7fe6fe528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:07:23.837 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.836+0000 7fe6fe528800 20 rados->read ofs=0 len=0 2024-09-14T11:07:23.837 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.836+0000 7fe6fe528800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:07:23.837 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.836+0000 7fe6fe528800 20 zone default found 2024-09-14T11:07:23.837 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.836+0000 7fe6fe528800 4 Realm: () 2024-09-14T11:07:23.837 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.836+0000 7fe6fe528800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:07:23.837 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.836+0000 7fe6fe528800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:07:23.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.836+0000 7fe6fe528800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:07:23.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.836+0000 7fe6fe528800 20 zonegroup default 2024-09-14T11:07:23.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.836+0000 7fe6fe528800 20 rados->read ofs=0 len=0 2024-09-14T11:07:23.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.837+0000 7fe6fe528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:23.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.837+0000 7fe6fe528800 20 rados->read ofs=0 len=0 2024-09-14T11:07:23.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.837+0000 7fe6fe528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:23.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.837+0000 7fe6fe528800 20 rados->read ofs=0 len=0 2024-09-14T11:07:23.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.837+0000 7fe6fe528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:23.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.837+0000 7fe6fe528800 20 started sync module instance, tier type = 2024-09-14T11:07:23.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.837+0000 7fe6fe528800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:07:23.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.846+0000 7fe6fe528800 20 add_watcher() i=0 2024-09-14T11:07:23.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.846+0000 7fe6fe528800 20 add_watcher() i=1 2024-09-14T11:07:23.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.846+0000 7fe6fe528800 20 add_watcher() i=2 2024-09-14T11:07:23.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.846+0000 7fe6fe528800 20 add_watcher() i=3 2024-09-14T11:07:23.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.846+0000 7fe6fe528800 20 add_watcher() i=4 2024-09-14T11:07:23.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.846+0000 7fe6fe528800 20 add_watcher() i=5 2024-09-14T11:07:23.846 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.846+0000 7fe6fe528800 20 add_watcher() i=6 2024-09-14T11:07:23.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.847+0000 7fe6fe528800 20 add_watcher() i=7 2024-09-14T11:07:23.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.847+0000 7fe6fe528800 2 all 8 watchers are set, enabling cache 2024-09-14T11:07:23.848 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.849+0000 7fe5b0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:07:23.849 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.849+0000 7fe6fe528800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:07:23.849 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.849+0000 7fe6fe528800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:07:23.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.849+0000 7fe6fe528800 5 note: GC not initialized 2024-09-14T11:07:23.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.849+0000 7fe52b7fe640 20 reqs_thread_entry: start 2024-09-14T11:07:23.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.850+0000 7fe6fe528800 20 init_complete bucket index max shards: 11 2024-09-14T11:07:23.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.850+0000 7fe6fe528800 20 Filter name: none 2024-09-14T11:07:23.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.850+0000 7fe5297fa640 20 reqs_thread_entry: start 2024-09-14T11:07:23.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.850+0000 7fe6fe528800 20 rados->read ofs=0 len=0 2024-09-14T11:07:23.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.850+0000 7fe6fe528800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:07:23.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.850+0000 7fe6fe528800 20 rados->read ofs=0 len=0 2024-09-14T11:07:23.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.851+0000 7fe6fe528800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:07:23.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.851+0000 7fe6fe528800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:07:23.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.851+0000 7fe6fe528800 20 rados->read ofs=0 len=0 2024-09-14T11:07:23.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.851+0000 7fe6fe528800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:07:23.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.851+0000 7fe6fe528800 20 rados->read ofs=0 len=0 2024-09-14T11:07:23.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.852+0000 7fe6fe528800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:07:23.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.852+0000 7fe6fe528800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:07:23.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.853+0000 7fe5b0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:07:23.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.855+0000 7fe6fe528800 20 remove_watcher() i=0 2024-09-14T11:07:23.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.855+0000 7fe6fe528800 2 removed watcher, disabling cache 2024-09-14T11:07:23.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.856+0000 7fe6fe528800 20 remove_watcher() i=1 2024-09-14T11:07:23.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.857+0000 7fe6fe528800 20 remove_watcher() i=2 2024-09-14T11:07:23.858 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.859+0000 7fe6fe528800 20 remove_watcher() i=3 2024-09-14T11:07:23.859 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.860+0000 7fe6fe528800 20 remove_watcher() i=4 2024-09-14T11:07:23.860 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.861+0000 7fe6fe528800 20 remove_watcher() i=5 2024-09-14T11:07:23.861 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.861+0000 7fe6fe528800 20 remove_watcher() i=6 2024-09-14T11:07:23.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:23.862+0000 7fe6fe528800 20 remove_watcher() i=7 2024-09-14T11:07:23.872 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:23.872 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:07:23.872 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: abort-at-change-reshard-state id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:07:23.872 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:23.949 INFO:tasks.workunit.client.0.smithi097.stderr: test: logrecord could be stopped after reshard failed 2024-09-14T11:07:23.950 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:07:23.978 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:07:23.978 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:07:24.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.015+0000 7f0f0022f800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.017 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.017+0000 7f0f0022f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:24.017 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.017+0000 7f0f0022f800 20 realm 2024-09-14T11:07:24.017 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.017+0000 7f0f0022f800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.017 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.017+0000 7f0f0022f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:24.017 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.017+0000 7f0f0022f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:07:24.017 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.017+0000 7f0f0022f800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.017 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.017+0000 7f0f0022f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:24.017 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.017+0000 7f0f0022f800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.018+0000 7f0f0022f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:07:24.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.018+0000 7f0f0022f800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.018+0000 7f0f0022f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:07:24.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.018+0000 7f0f0022f800 20 searching for the correct realm 2024-09-14T11:07:24.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.020+0000 7f0efe51a640 0 -- 172.21.15.97:0/313606657 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f0ee8046430 msgr2=0x7f0ee80468b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:07:24.225 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.225+0000 7f0ef5518640 0 -- 172.21.15.97:0/313606657 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f0ef000b040 msgr2=0x7f0ef0094010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:07:24.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.229+0000 7f0f0022f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:07:24.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.229+0000 7f0f0022f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:07:24.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.229+0000 7f0f0022f800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:07:24.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.229+0000 7f0f0022f800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:07:24.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.229+0000 7f0f0022f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:07:24.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.229+0000 7f0f0022f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:07:24.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.229+0000 7f0f0022f800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.230+0000 7f0f0022f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:24.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.230+0000 7f0f0022f800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.230+0000 7f0f0022f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:07:24.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.230+0000 7f0f0022f800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.231+0000 7f0f0022f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:07:24.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.231+0000 7f0f0022f800 20 zone default found 2024-09-14T11:07:24.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.231+0000 7f0f0022f800 4 Realm: () 2024-09-14T11:07:24.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.231+0000 7f0f0022f800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:07:24.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.231+0000 7f0f0022f800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:07:24.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.231+0000 7f0f0022f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:07:24.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.231+0000 7f0f0022f800 20 zonegroup default 2024-09-14T11:07:24.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.231+0000 7f0f0022f800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.231+0000 7f0f0022f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:24.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.231+0000 7f0f0022f800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.231+0000 7f0f0022f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:24.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.231+0000 7f0f0022f800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.232+0000 7f0f0022f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:24.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.232+0000 7f0f0022f800 20 started sync module instance, tier type = 2024-09-14T11:07:24.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.232+0000 7f0f0022f800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:07:24.240 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.240+0000 7f0f0022f800 20 add_watcher() i=0 2024-09-14T11:07:24.240 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.240+0000 7f0f0022f800 20 add_watcher() i=1 2024-09-14T11:07:24.240 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.240+0000 7f0f0022f800 20 add_watcher() i=2 2024-09-14T11:07:24.240 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.240+0000 7f0f0022f800 20 add_watcher() i=3 2024-09-14T11:07:24.240 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.240+0000 7f0f0022f800 20 add_watcher() i=4 2024-09-14T11:07:24.240 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.240+0000 7f0f0022f800 20 add_watcher() i=5 2024-09-14T11:07:24.240 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.240+0000 7f0f0022f800 20 add_watcher() i=6 2024-09-14T11:07:24.240 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.242+0000 7f0f0022f800 20 add_watcher() i=7 2024-09-14T11:07:24.241 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.242+0000 7f0f0022f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:07:24.243 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.242+0000 7f0daf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:07:24.243 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.243+0000 7f0f0022f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:07:24.243 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.243+0000 7f0f0022f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:07:24.243 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.243+0000 7f0f0022f800 5 note: GC not initialized 2024-09-14T11:07:24.243 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.243+0000 7f0dae7fc640 20 reqs_thread_entry: start 2024-09-14T11:07:24.243 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.243+0000 7f0f0022f800 20 init_complete bucket index max shards: 11 2024-09-14T11:07:24.243 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.243+0000 7f0f0022f800 20 Filter name: none 2024-09-14T11:07:24.243 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.243+0000 7f0d1ffff640 20 reqs_thread_entry: start 2024-09-14T11:07:24.243 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.243+0000 7f0f0022f800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.244+0000 7f0f0022f800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:07:24.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.244+0000 7f0f0022f800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.245 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.244+0000 7f0f0022f800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:07:24.245 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.244+0000 7f0f0022f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:07:24.245 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.244+0000 7f0f0022f800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.245 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.245+0000 7f0f0022f800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:07:24.245 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.245+0000 7f0f0022f800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.245 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.245+0000 7f0f0022f800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:07:24.245 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.245+0000 7f0f0022f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:07:24.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.247+0000 7f0daf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:07:24.248 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.249+0000 7f0f0022f800 20 remove_watcher() i=0 2024-09-14T11:07:24.249 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.249+0000 7f0f0022f800 2 removed watcher, disabling cache 2024-09-14T11:07:24.249 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.250+0000 7f0f0022f800 20 remove_watcher() i=1 2024-09-14T11:07:24.250 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.251+0000 7f0f0022f800 20 remove_watcher() i=2 2024-09-14T11:07:24.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.252+0000 7f0f0022f800 20 remove_watcher() i=3 2024-09-14T11:07:24.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.253+0000 7f0f0022f800 20 remove_watcher() i=4 2024-09-14T11:07:24.253 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.254+0000 7f0f0022f800 20 remove_watcher() i=5 2024-09-14T11:07:24.254 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.255+0000 7f0f0022f800 20 remove_watcher() i=6 2024-09-14T11:07:24.255 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.256+0000 7f0f0022f800 20 remove_watcher() i=7 2024-09-14T11:07:24.265 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:24.265 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:07:24.266 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: a-bucket id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-14T11:07:24.266 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:24.267 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:07:24.295 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:07:24.295 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:07:24.332 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.332+0000 7fb891128800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.334+0000 7fb891128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:24.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.334+0000 7fb891128800 20 realm 2024-09-14T11:07:24.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.334+0000 7fb891128800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.334+0000 7fb891128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:24.334 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.334+0000 7fb891128800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:07:24.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.334+0000 7fb891128800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.335+0000 7fb891128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:24.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.335+0000 7fb891128800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.335+0000 7fb891128800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:07:24.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.335+0000 7fb891128800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.336+0000 7fb891128800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:07:24.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.336+0000 7fb891128800 20 searching for the correct realm 2024-09-14T11:07:24.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.337+0000 7fb88ce4b640 0 -- 172.21.15.97:0/1137410960 >> [v2:172.21.15.152:6808/1010851305,v1:172.21.15.152:6809/1010851305] conn(0x5585417eafb0 msgr2=0x5585417ed470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:07:24.339 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.340+0000 7fb88ce4b640 0 -- 172.21.15.97:0/1137410960 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x5585417de850 msgr2=0x5585417e0c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:07:24.346 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.346+0000 7fb891128800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:07:24.346 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.346+0000 7fb891128800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:07:24.346 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.346+0000 7fb891128800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:07:24.346 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.346+0000 7fb891128800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:07:24.346 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.346+0000 7fb891128800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:07:24.346 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.346+0000 7fb891128800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:07:24.346 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.346+0000 7fb891128800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.346 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.346+0000 7fb891128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:24.346 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.346+0000 7fb891128800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.346+0000 7fb891128800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:07:24.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.346+0000 7fb891128800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.347+0000 7fb891128800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:07:24.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.347+0000 7fb891128800 20 zone default found 2024-09-14T11:07:24.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.347+0000 7fb891128800 4 Realm: () 2024-09-14T11:07:24.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.347+0000 7fb891128800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:07:24.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.347+0000 7fb891128800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:07:24.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.347+0000 7fb891128800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:07:24.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.347+0000 7fb891128800 20 zonegroup default 2024-09-14T11:07:24.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.347+0000 7fb891128800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.347+0000 7fb891128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:24.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.347+0000 7fb891128800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.348+0000 7fb891128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:24.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.348+0000 7fb891128800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.348+0000 7fb891128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:24.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.348+0000 7fb891128800 20 started sync module instance, tier type = 2024-09-14T11:07:24.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.348+0000 7fb891128800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:07:24.355 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.356+0000 7fb891128800 20 add_watcher() i=0 2024-09-14T11:07:24.356 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.356+0000 7fb891128800 20 add_watcher() i=1 2024-09-14T11:07:24.356 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.356+0000 7fb891128800 20 add_watcher() i=2 2024-09-14T11:07:24.356 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.356+0000 7fb891128800 20 add_watcher() i=3 2024-09-14T11:07:24.356 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.356+0000 7fb891128800 20 add_watcher() i=4 2024-09-14T11:07:24.356 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.356+0000 7fb891128800 20 add_watcher() i=5 2024-09-14T11:07:24.356 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.357+0000 7fb891128800 20 add_watcher() i=6 2024-09-14T11:07:24.357 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.358+0000 7fb891128800 20 add_watcher() i=7 2024-09-14T11:07:24.357 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.358+0000 7fb891128800 2 all 8 watchers are set, enabling cache 2024-09-14T11:07:24.359 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.360+0000 7fb7437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:07:24.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.360+0000 7fb891128800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:07:24.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.360+0000 7fb891128800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:07:24.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.360+0000 7fb891128800 5 note: GC not initialized 2024-09-14T11:07:24.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.360+0000 7fb7427e4640 20 reqs_thread_entry: start 2024-09-14T11:07:24.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.360+0000 7fb891128800 20 init_complete bucket index max shards: 11 2024-09-14T11:07:24.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.360+0000 7fb891128800 20 Filter name: none 2024-09-14T11:07:24.361 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.360+0000 7fb73bfff640 20 reqs_thread_entry: start 2024-09-14T11:07:24.361 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.361+0000 7fb891128800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.361+0000 7fb891128800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:07:24.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.361+0000 7fb891128800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.361+0000 7fb891128800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:07:24.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.361+0000 7fb891128800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:07:24.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.361+0000 7fb891128800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.362+0000 7fb891128800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:07:24.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.362+0000 7fb891128800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.362+0000 7fb891128800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:07:24.362 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.362+0000 7fb891128800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:07:24.363 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.364+0000 7fb7437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:07:24.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.366+0000 7fb891128800 20 remove_watcher() i=0 2024-09-14T11:07:24.365 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.366+0000 7fb891128800 2 removed watcher, disabling cache 2024-09-14T11:07:24.366 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.367+0000 7fb891128800 20 remove_watcher() i=1 2024-09-14T11:07:24.368 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.368+0000 7fb891128800 20 remove_watcher() i=2 2024-09-14T11:07:24.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.369+0000 7fb891128800 20 remove_watcher() i=3 2024-09-14T11:07:24.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.370+0000 7fb891128800 20 remove_watcher() i=4 2024-09-14T11:07:24.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.372+0000 7fb891128800 20 remove_watcher() i=5 2024-09-14T11:07:24.372 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.373+0000 7fb891128800 20 remove_watcher() i=6 2024-09-14T11:07:24.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.374+0000 7fb891128800 20 remove_watcher() i=7 2024-09-14T11:07:24.385 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-14T11:07:24.418 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:07:24.418 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:07:24.455 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.456+0000 7fbbdef73800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.457+0000 7fbbdef73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:24.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.457+0000 7fbbdef73800 20 realm 2024-09-14T11:07:24.458 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.457+0000 7fbbdef73800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.458 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.458+0000 7fbbdef73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:24.458 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.458+0000 7fbbdef73800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:07:24.458 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.458+0000 7fbbdef73800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.458 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.458+0000 7fbbdef73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:24.458 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.458+0000 7fbbdef73800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.458 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.458+0000 7fbbdef73800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:07:24.458 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.459+0000 7fbbdef73800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.459 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.459+0000 7fbbdef73800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:07:24.459 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.459+0000 7fbbdef73800 20 searching for the correct realm 2024-09-14T11:07:24.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.461+0000 7fbbdc25c640 0 -- 172.21.15.97:0/3149427196 >> [v2:172.21.15.97:6816/4093696477,v1:172.21.15.97:6817/4093696477] conn(0x558d9d8cccd0 msgr2=0x558d9d8cf100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:07:24.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.464+0000 7fbbdc25c640 0 -- 172.21.15.97:0/3149427196 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7fbbcc0333f0 msgr2=0x7fbbcc033850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:07:24.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.670+0000 7fbbdef73800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:07:24.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.670+0000 7fbbdef73800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:07:24.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.670+0000 7fbbdef73800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:07:24.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.670+0000 7fbbdef73800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:07:24.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.670+0000 7fbbdef73800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:07:24.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.670+0000 7fbbdef73800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:07:24.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.670+0000 7fbbdef73800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.671+0000 7fbbdef73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:24.672 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.671+0000 7fbbdef73800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.671+0000 7fbbdef73800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:07:24.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.671+0000 7fbbdef73800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.671+0000 7fbbdef73800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:07:24.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.671+0000 7fbbdef73800 20 zone default found 2024-09-14T11:07:24.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.671+0000 7fbbdef73800 4 Realm: () 2024-09-14T11:07:24.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.671+0000 7fbbdef73800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:07:24.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.671+0000 7fbbdef73800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:07:24.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.671+0000 7fbbdef73800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:07:24.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.671+0000 7fbbdef73800 20 zonegroup default 2024-09-14T11:07:24.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.671+0000 7fbbdef73800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.671+0000 7fbbdef73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:24.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.671+0000 7fbbdef73800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.673 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.672+0000 7fbbdef73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:24.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.672+0000 7fbbdef73800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.672+0000 7fbbdef73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:24.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.672+0000 7fbbdef73800 20 started sync module instance, tier type = 2024-09-14T11:07:24.674 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.672+0000 7fbbdef73800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:07:24.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.680+0000 7fbbdef73800 20 add_watcher() i=0 2024-09-14T11:07:24.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.680+0000 7fbbdef73800 20 add_watcher() i=1 2024-09-14T11:07:24.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.680+0000 7fbbdef73800 20 add_watcher() i=2 2024-09-14T11:07:24.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.680+0000 7fbbdef73800 20 add_watcher() i=3 2024-09-14T11:07:24.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.680+0000 7fbbdef73800 20 add_watcher() i=4 2024-09-14T11:07:24.680 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.680+0000 7fbbdef73800 20 add_watcher() i=5 2024-09-14T11:07:24.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.680+0000 7fbbdef73800 20 add_watcher() i=6 2024-09-14T11:07:24.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.681+0000 7fbbdef73800 20 add_watcher() i=7 2024-09-14T11:07:24.681 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.681+0000 7fbbdef73800 2 all 8 watchers are set, enabling cache 2024-09-14T11:07:24.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.683+0000 7fba92fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:07:24.683 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.683+0000 7fbbdef73800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:07:24.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.683+0000 7fbbdef73800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:07:24.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.683+0000 7fbbdef73800 5 note: GC not initialized 2024-09-14T11:07:24.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.683+0000 7fba91fe3640 20 reqs_thread_entry: start 2024-09-14T11:07:24.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.684+0000 7fbbdef73800 20 init_complete bucket index max shards: 11 2024-09-14T11:07:24.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.684+0000 7fbbdef73800 20 Filter name: none 2024-09-14T11:07:24.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.684+0000 7fba037fe640 20 reqs_thread_entry: start 2024-09-14T11:07:24.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.684+0000 7fbbdef73800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:07:24.684 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.684+0000 7fbbdef73800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.684+0000 7fbbdef73800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:07:24.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.684+0000 7fbbdef73800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:07:24.685 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.684+0000 7fbbdef73800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:07:24.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.684+0000 7fbbdef73800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 : miss 2024-09-14T11:07:24.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.684+0000 7fbbdef73800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.685+0000 7fbbdef73800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:07:24.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.685+0000 7fbbdef73800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:07:24.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.685+0000 7fbbdef73800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:07:24.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.685+0000 7fbbdef73800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:07:24.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.685+0000 7fbbdef73800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:07:24.686 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.685+0000 7fbbdef73800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 2024-09-14T11:07:24.690 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.690+0000 7fbbdef73800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:07:24.690 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.690+0000 7fbbdef73800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:07:24.690 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.690+0000 7fbbdef73800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:07:24.690 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.690+0000 7fbbdef73800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17, ofs0, ns] 2024-09-14T11:07:24.690 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.690+0000 7fbab3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595243 cookie 94066722056800 notifier 8160 bl.length()=827 2024-09-14T11:07:24.690 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.690+0000 7fbab3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:07:24.690 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.690+0000 7fbab3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:07:24.690 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.690+0000 7fbab3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:07:24.691 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.691+0000 7fbbdef73800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): orig_sources= new_sources= 2024-09-14T11:07:24.691 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.691+0000 7fbbdef73800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): potential sources added=[] removed=[] 2024-09-14T11:07:24.691 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.691+0000 7fbbdef73800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): orig_dests= new_dests= 2024-09-14T11:07:24.691 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.691+0000 7fbbdef73800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): potential dests added=[] removed=[] 2024-09-14T11:07:24.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.695+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.0 2024-09-14T11:07:24.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.695+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.0 2024-09-14T11:07:24.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.695+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.1 2024-09-14T11:07:24.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.695+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.1 2024-09-14T11:07:24.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.695+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.2 2024-09-14T11:07:24.695 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.695+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.2 2024-09-14T11:07:24.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.695+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.3 2024-09-14T11:07:24.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.695+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.3 2024-09-14T11:07:24.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.695+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.4 2024-09-14T11:07:24.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.695+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.4 2024-09-14T11:07:24.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.695+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.5 2024-09-14T11:07:24.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.695+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.5 2024-09-14T11:07:24.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.695+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.6 2024-09-14T11:07:24.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.695+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.6 2024-09-14T11:07:24.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.695+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.7 2024-09-14T11:07:24.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.695+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.7 2024-09-14T11:07:24.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.695+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.8 2024-09-14T11:07:24.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.695+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.8 2024-09-14T11:07:24.696 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.695+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.9 2024-09-14T11:07:24.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.695+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.9 2024-09-14T11:07:24.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.695+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.10 2024-09-14T11:07:24.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.695+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.10 2024-09-14T11:07:24.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.695+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.11 2024-09-14T11:07:24.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.695+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.11 2024-09-14T11:07:24.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.695+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.12 2024-09-14T11:07:24.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.695+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.12 2024-09-14T11:07:24.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.695+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.13 2024-09-14T11:07:24.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.695+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.13 2024-09-14T11:07:24.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.695+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.0 2024-09-14T11:07:24.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.695+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.0 2024-09-14T11:07:24.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.696+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.1 2024-09-14T11:07:24.697 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.696+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.1 2024-09-14T11:07:24.698 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.696+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.2 2024-09-14T11:07:24.698 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.696+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.2 2024-09-14T11:07:24.699 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.696+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.3 2024-09-14T11:07:24.699 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.696+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.3 2024-09-14T11:07:24.699 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.697+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.4 2024-09-14T11:07:24.699 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.697+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.4 2024-09-14T11:07:24.699 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.697+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.5 2024-09-14T11:07:24.699 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.697+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.5 2024-09-14T11:07:24.699 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.698+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.6 2024-09-14T11:07:24.699 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.698+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.6 2024-09-14T11:07:24.699 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.698+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.7 2024-09-14T11:07:24.699 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.698+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.7 2024-09-14T11:07:24.699 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.699+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.8 2024-09-14T11:07:24.699 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.699+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.8 2024-09-14T11:07:24.700 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.699+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.9 2024-09-14T11:07:24.700 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.699+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.9 2024-09-14T11:07:24.700 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.700+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.10 2024-09-14T11:07:24.700 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.700+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.10 2024-09-14T11:07:24.700 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.700+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.11 2024-09-14T11:07:24.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.700+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.11 2024-09-14T11:07:24.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.701+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.12 2024-09-14T11:07:24.701 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.701+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.12 2024-09-14T11:07:24.703 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fbbdef73800 time 2024-09-14T11:07:24.705465+0000 2024-09-14T11:07:24.703 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:07:24.703 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:07:24.704 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fbbe258c76a] 2024-09-14T11:07:24.704 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fbbe258c928] 2024-09-14T11:07:24.704 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558d9c1e50b1] 2024-09-14T11:07:24.704 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x558d9c1f4124] 2024-09-14T11:07:24.704 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x558d9c1f4fc4] 2024-09-14T11:07:24.704 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-14T11:07:24.704 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fbbe1229590] 2024-09-14T11:07:24.704 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-14T11:07:24.704 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-14T11:07:24.704 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.704+0000 7fbbdef73800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fbbdef73800 time 2024-09-14T11:07:24.705465+0000 2024-09-14T11:07:24.704 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:07:24.704 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:24.704 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:07:24.705 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fbbe258c76a] 2024-09-14T11:07:24.705 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fbbe258c928] 2024-09-14T11:07:24.705 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558d9c1e50b1] 2024-09-14T11:07:24.705 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x558d9c1f4124] 2024-09-14T11:07:24.705 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x558d9c1f4fc4] 2024-09-14T11:07:24.705 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-14T11:07:24.705 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fbbe1229590] 2024-09-14T11:07:24.705 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-14T11:07:24.705 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-14T11:07:24.705 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:24.705 INFO:tasks.workunit.client.0.smithi097.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:07:24.705 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7fbbdef73800 thread_name:radosgw-admin 2024-09-14T11:07:24.720 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:07:24.720 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fbbe123e6f0] 2024-09-14T11:07:24.721 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fbbe128b99c] 2024-09-14T11:07:24.721 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-14T11:07:24.721 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-14T11:07:24.721 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fbbe258c7c4] 2024-09-14T11:07:24.721 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fbbe258c928] 2024-09-14T11:07:24.721 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558d9c1e50b1] 2024-09-14T11:07:24.721 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x558d9c1f4124] 2024-09-14T11:07:24.721 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x558d9c1f4fc4] 2024-09-14T11:07:24.721 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-14T11:07:24.721 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fbbe1229590] 2024-09-14T11:07:24.721 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-14T11:07:24.721 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-14T11:07:24.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.705+0000 7fbbdef73800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:07:24.722 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7fbbdef73800 thread_name:radosgw-admin 2024-09-14T11:07:24.722 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:24.722 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:07:24.722 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fbbe123e6f0] 2024-09-14T11:07:24.722 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fbbe128b99c] 2024-09-14T11:07:24.722 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-14T11:07:24.722 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-14T11:07:24.722 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fbbe258c7c4] 2024-09-14T11:07:24.722 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fbbe258c928] 2024-09-14T11:07:24.722 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558d9c1e50b1] 2024-09-14T11:07:24.722 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x558d9c1f4124] 2024-09-14T11:07:24.722 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x558d9c1f4fc4] 2024-09-14T11:07:24.722 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-14T11:07:24.723 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fbbe1229590] 2024-09-14T11:07:24.723 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-14T11:07:24.723 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-14T11:07:24.723 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:07:24.723 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:24.723 INFO:tasks.workunit.client.0.smithi097.stderr:--- begin dump of recent events --- 2024-09-14T11:07:24.723 INFO:tasks.workunit.client.0.smithi097.stderr: -499> 2024-09-14T11:07:24.440+0000 7fbbdd25e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:07:24.723 INFO:tasks.workunit.client.0.smithi097.stderr: -498> 2024-09-14T11:07:24.440+0000 7fbbdca5d640 10 monclient(hunting): get_auth_request con 0x558d9d692020 auth_method 0 2024-09-14T11:07:24.723 INFO:tasks.workunit.client.0.smithi097.stderr: -497> 2024-09-14T11:07:24.440+0000 7fbbdca5d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:07:24.723 INFO:tasks.workunit.client.0.smithi097.stderr: -496> 2024-09-14T11:07:24.440+0000 7fbbdca5d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:07:24.723 INFO:tasks.workunit.client.0.smithi097.stderr: -495> 2024-09-14T11:07:24.440+0000 7fbbdca5d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:07:24.723 INFO:tasks.workunit.client.0.smithi097.stderr: -494> 2024-09-14T11:07:24.440+0000 7fbbdc25c640 10 monclient(hunting): get_auth_request con 0x558d9d71e4f0 auth_method 0 2024-09-14T11:07:24.723 INFO:tasks.workunit.client.0.smithi097.stderr: -493> 2024-09-14T11:07:24.440+0000 7fbbdc25c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:07:24.723 INFO:tasks.workunit.client.0.smithi097.stderr: -492> 2024-09-14T11:07:24.440+0000 7fbbdc25c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:07:24.724 INFO:tasks.workunit.client.0.smithi097.stderr: -491> 2024-09-14T11:07:24.440+0000 7fbbdc25c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:07:24.724 INFO:tasks.workunit.client.0.smithi097.stderr: -490> 2024-09-14T11:07:24.440+0000 7fbbdd25e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:07:24.724 INFO:tasks.workunit.client.0.smithi097.stderr: -489> 2024-09-14T11:07:24.440+0000 7fbbdd25e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:07:24.724 INFO:tasks.workunit.client.0.smithi097.stderr: -488> 2024-09-14T11:07:24.440+0000 7fbbdd25e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:07:24.724 INFO:tasks.workunit.client.0.smithi097.stderr: -487> 2024-09-14T11:07:24.440+0000 7fbbdca5d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:07:24.724 INFO:tasks.workunit.client.0.smithi097.stderr: -486> 2024-09-14T11:07:24.440+0000 7fbbdca5d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:07:24.724 INFO:tasks.workunit.client.0.smithi097.stderr: -485> 2024-09-14T11:07:24.440+0000 7fbbdca5d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:07:24.724 INFO:tasks.workunit.client.0.smithi097.stderr: -484> 2024-09-14T11:07:24.440+0000 7fbbdc25c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:07:24.724 INFO:tasks.workunit.client.0.smithi097.stderr: -483> 2024-09-14T11:07:24.440+0000 7fbbdc25c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:07:24.724 INFO:tasks.workunit.client.0.smithi097.stderr: -482> 2024-09-14T11:07:24.440+0000 7fbbdc25c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:07:24.724 INFO:tasks.workunit.client.0.smithi097.stderr: -481> 2024-09-14T11:07:24.440+0000 7fbbdd25e640 10 monclient(hunting): handle_auth_done global_id 7655 payload 824 2024-09-14T11:07:24.724 INFO:tasks.workunit.client.0.smithi097.stderr: -480> 2024-09-14T11:07:24.440+0000 7fbbdd25e640 10 monclient: _finish_hunting 0 2024-09-14T11:07:24.724 INFO:tasks.workunit.client.0.smithi097.stderr: -479> 2024-09-14T11:07:24.440+0000 7fbbdd25e640 1 monclient: found mon.noname-c 2024-09-14T11:07:24.724 INFO:tasks.workunit.client.0.smithi097.stderr: -478> 2024-09-14T11:07:24.440+0000 7fbbdd25e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:07:24.725 INFO:tasks.workunit.client.0.smithi097.stderr: -477> 2024-09-14T11:07:24.441+0000 7fbac960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:07:24.725 INFO:tasks.workunit.client.0.smithi097.stderr: -476> 2024-09-14T11:07:24.441+0000 7fbac960a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:07:24.725 INFO:tasks.workunit.client.0.smithi097.stderr: -475> 2024-09-14T11:07:24.441+0000 7fbac960a640 10 monclient: dump: 2024-09-14T11:07:24.725 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:07:24.725 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:07:24.725 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:24.725 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:24.725 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:07:24.725 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:07:24.725 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:07:24.725 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:07:24.725 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:07:24.725 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:24.726 INFO:tasks.workunit.client.0.smithi097.stderr: -474> 2024-09-14T11:07:24.441+0000 7fbac960a640 10 monclient: _finish_auth 0 2024-09-14T11:07:24.726 INFO:tasks.workunit.client.0.smithi097.stderr: -473> 2024-09-14T11:07:24.441+0000 7fbac960a640 10 monclient: _check_auth_tickets 2024-09-14T11:07:24.726 INFO:tasks.workunit.client.0.smithi097.stderr: -472> 2024-09-14T11:07:24.441+0000 7fbac960a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:07:24.726 INFO:tasks.workunit.client.0.smithi097.stderr: -471> 2024-09-14T11:07:24.441+0000 7fbac960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:07:24.726 INFO:tasks.workunit.client.0.smithi097.stderr: -470> 2024-09-14T11:07:24.441+0000 7fbac960a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:07:24.726 INFO:tasks.workunit.client.0.smithi097.stderr: -469> 2024-09-14T11:07:24.441+0000 7fbac960a640 10 monclient: dump: 2024-09-14T11:07:24.726 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:07:24.726 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:07:24.726 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:24.726 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:24.726 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:07:24.726 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:07:24.726 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:07:24.726 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:07:24.727 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:07:24.727 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:24.727 INFO:tasks.workunit.client.0.smithi097.stderr: -468> 2024-09-14T11:07:24.441+0000 7fbbdef73800 5 monclient: authenticate success, global_id 7655 2024-09-14T11:07:24.727 INFO:tasks.workunit.client.0.smithi097.stderr: -467> 2024-09-14T11:07:24.441+0000 7fbbdef73800 10 monclient: _renew_subs 2024-09-14T11:07:24.727 INFO:tasks.workunit.client.0.smithi097.stderr: -466> 2024-09-14T11:07:24.441+0000 7fbbdef73800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:07:24.727 INFO:tasks.workunit.client.0.smithi097.stderr: -465> 2024-09-14T11:07:24.441+0000 7fbacae0d640 4 set_mon_vals no callback set 2024-09-14T11:07:24.727 INFO:tasks.workunit.client.0.smithi097.stderr: -464> 2024-09-14T11:07:24.441+0000 7fbbdef73800 10 monclient: _renew_subs 2024-09-14T11:07:24.727 INFO:tasks.workunit.client.0.smithi097.stderr: -463> 2024-09-14T11:07:24.441+0000 7fbbdef73800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:07:24.727 INFO:tasks.workunit.client.0.smithi097.stderr: -462> 2024-09-14T11:07:24.441+0000 7fbbdef73800 1 librados: init done 2024-09-14T11:07:24.727 INFO:tasks.workunit.client.0.smithi097.stderr: -461> 2024-09-14T11:07:24.443+0000 7fbac960a640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:07:24.727 INFO:tasks.workunit.client.0.smithi097.stderr: -460> 2024-09-14T11:07:24.443+0000 7fbac960a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:07:24.727 INFO:tasks.workunit.client.0.smithi097.stderr: -459> 2024-09-14T11:07:24.443+0000 7fbac960a640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:07:24.727 INFO:tasks.workunit.client.0.smithi097.stderr: -458> 2024-09-14T11:07:24.443+0000 7fbbdca5d640 10 monclient: get_auth_request con 0x7fbac4077230 auth_method 0 2024-09-14T11:07:24.728 INFO:tasks.workunit.client.0.smithi097.stderr: -457> 2024-09-14T11:07:24.443+0000 7fbbdc25c640 10 monclient: get_auth_request con 0x558d9d823bc0 auth_method 0 2024-09-14T11:07:24.728 INFO:tasks.workunit.client.0.smithi097.stderr: -456> 2024-09-14T11:07:24.444+0000 7fbbdca5d640 10 monclient: get_auth_request con 0x558d9d826da0 auth_method 0 2024-09-14T11:07:24.728 INFO:tasks.workunit.client.0.smithi097.stderr: -455> 2024-09-14T11:07:24.445+0000 7fbbdc25c640 10 monclient: get_auth_request con 0x558d9d82af90 auth_method 0 2024-09-14T11:07:24.728 INFO:tasks.workunit.client.0.smithi097.stderr: -454> 2024-09-14T11:07:24.446+0000 7fbbdd25e640 10 monclient: get_auth_request con 0x558d9d82a620 auth_method 0 2024-09-14T11:07:24.728 INFO:tasks.workunit.client.0.smithi097.stderr: -453> 2024-09-14T11:07:24.446+0000 7fbbdef73800 10 monclient: build_initial_monmap 2024-09-14T11:07:24.728 INFO:tasks.workunit.client.0.smithi097.stderr: -452> 2024-09-14T11:07:24.446+0000 7fbbdef73800 1 build_initial for_mkfs: 0 2024-09-14T11:07:24.728 INFO:tasks.workunit.client.0.smithi097.stderr: -451> 2024-09-14T11:07:24.446+0000 7fbbdef73800 10 monclient: monmap: 2024-09-14T11:07:24.728 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:07:24.728 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:07:24.728 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:07:24.728 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:07:24.728 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:07:24.728 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:07:24.729 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:07:24.729 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:07:24.729 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:07:24.729 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:24.729 INFO:tasks.workunit.client.0.smithi097.stderr: -450> 2024-09-14T11:07:24.446+0000 7fbbdef73800 5 AuthRegistry(0x558d9d833020) adding auth protocol: cephx 2024-09-14T11:07:24.729 INFO:tasks.workunit.client.0.smithi097.stderr: -449> 2024-09-14T11:07:24.446+0000 7fbbdef73800 5 AuthRegistry(0x558d9d833020) adding auth protocol: cephx 2024-09-14T11:07:24.729 INFO:tasks.workunit.client.0.smithi097.stderr: -448> 2024-09-14T11:07:24.446+0000 7fbbdef73800 5 AuthRegistry(0x558d9d833020) adding auth protocol: cephx 2024-09-14T11:07:24.729 INFO:tasks.workunit.client.0.smithi097.stderr: -447> 2024-09-14T11:07:24.446+0000 7fbbdef73800 5 AuthRegistry(0x558d9d833020) adding con mode: secure 2024-09-14T11:07:24.729 INFO:tasks.workunit.client.0.smithi097.stderr: -446> 2024-09-14T11:07:24.446+0000 7fbbdef73800 5 AuthRegistry(0x558d9d833020) adding con mode: crc 2024-09-14T11:07:24.729 INFO:tasks.workunit.client.0.smithi097.stderr: -445> 2024-09-14T11:07:24.446+0000 7fbbdef73800 5 AuthRegistry(0x558d9d833020) adding con mode: secure 2024-09-14T11:07:24.729 INFO:tasks.workunit.client.0.smithi097.stderr: -444> 2024-09-14T11:07:24.446+0000 7fbbdef73800 5 AuthRegistry(0x558d9d833020) adding con mode: crc 2024-09-14T11:07:24.729 INFO:tasks.workunit.client.0.smithi097.stderr: -443> 2024-09-14T11:07:24.446+0000 7fbbdef73800 5 AuthRegistry(0x558d9d833020) adding con mode: secure 2024-09-14T11:07:24.729 INFO:tasks.workunit.client.0.smithi097.stderr: -442> 2024-09-14T11:07:24.446+0000 7fbbdef73800 5 AuthRegistry(0x558d9d833020) adding con mode: crc 2024-09-14T11:07:24.729 INFO:tasks.workunit.client.0.smithi097.stderr: -441> 2024-09-14T11:07:24.446+0000 7fbbdef73800 5 AuthRegistry(0x558d9d833020) adding con mode: crc 2024-09-14T11:07:24.730 INFO:tasks.workunit.client.0.smithi097.stderr: -440> 2024-09-14T11:07:24.446+0000 7fbbdef73800 5 AuthRegistry(0x558d9d833020) adding con mode: secure 2024-09-14T11:07:24.730 INFO:tasks.workunit.client.0.smithi097.stderr: -439> 2024-09-14T11:07:24.446+0000 7fbbdef73800 5 AuthRegistry(0x558d9d833020) adding con mode: crc 2024-09-14T11:07:24.730 INFO:tasks.workunit.client.0.smithi097.stderr: -438> 2024-09-14T11:07:24.446+0000 7fbbdef73800 5 AuthRegistry(0x558d9d833020) adding con mode: secure 2024-09-14T11:07:24.730 INFO:tasks.workunit.client.0.smithi097.stderr: -437> 2024-09-14T11:07:24.446+0000 7fbbdef73800 5 AuthRegistry(0x558d9d833020) adding con mode: crc 2024-09-14T11:07:24.730 INFO:tasks.workunit.client.0.smithi097.stderr: -436> 2024-09-14T11:07:24.446+0000 7fbbdef73800 5 AuthRegistry(0x558d9d833020) adding con mode: secure 2024-09-14T11:07:24.730 INFO:tasks.workunit.client.0.smithi097.stderr: -435> 2024-09-14T11:07:24.446+0000 7fbbdef73800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:07:24.730 INFO:tasks.workunit.client.0.smithi097.stderr: -434> 2024-09-14T11:07:24.447+0000 7fbbdef73800 5 asok(0x558d9d5bb270) register_command objecter_requests cmddesc objecter_requests hook 0x558d9d836530 EEXIST 2024-09-14T11:07:24.730 INFO:tasks.workunit.client.0.smithi097.stderr: -433> 2024-09-14T11:07:24.447+0000 7fbbdef73800 10 monclient: init 2024-09-14T11:07:24.730 INFO:tasks.workunit.client.0.smithi097.stderr: -432> 2024-09-14T11:07:24.447+0000 7fbbdef73800 5 AuthRegistry(0x558d9d831f18) adding auth protocol: cephx 2024-09-14T11:07:24.730 INFO:tasks.workunit.client.0.smithi097.stderr: -431> 2024-09-14T11:07:24.447+0000 7fbbdef73800 5 AuthRegistry(0x558d9d831f18) adding auth protocol: cephx 2024-09-14T11:07:24.730 INFO:tasks.workunit.client.0.smithi097.stderr: -430> 2024-09-14T11:07:24.447+0000 7fbbdef73800 5 AuthRegistry(0x558d9d831f18) adding auth protocol: cephx 2024-09-14T11:07:24.730 INFO:tasks.workunit.client.0.smithi097.stderr: -429> 2024-09-14T11:07:24.447+0000 7fbbdef73800 5 AuthRegistry(0x558d9d831f18) adding con mode: secure 2024-09-14T11:07:24.730 INFO:tasks.workunit.client.0.smithi097.stderr: -428> 2024-09-14T11:07:24.447+0000 7fbbdef73800 5 AuthRegistry(0x558d9d831f18) adding con mode: crc 2024-09-14T11:07:24.730 INFO:tasks.workunit.client.0.smithi097.stderr: -427> 2024-09-14T11:07:24.447+0000 7fbbdef73800 5 AuthRegistry(0x558d9d831f18) adding con mode: secure 2024-09-14T11:07:24.731 INFO:tasks.workunit.client.0.smithi097.stderr: -426> 2024-09-14T11:07:24.447+0000 7fbbdef73800 5 AuthRegistry(0x558d9d831f18) adding con mode: crc 2024-09-14T11:07:24.731 INFO:tasks.workunit.client.0.smithi097.stderr: -425> 2024-09-14T11:07:24.447+0000 7fbbdef73800 5 AuthRegistry(0x558d9d831f18) adding con mode: secure 2024-09-14T11:07:24.731 INFO:tasks.workunit.client.0.smithi097.stderr: -424> 2024-09-14T11:07:24.447+0000 7fbbdef73800 5 AuthRegistry(0x558d9d831f18) adding con mode: crc 2024-09-14T11:07:24.731 INFO:tasks.workunit.client.0.smithi097.stderr: -423> 2024-09-14T11:07:24.447+0000 7fbbdef73800 5 AuthRegistry(0x558d9d831f18) adding con mode: crc 2024-09-14T11:07:24.731 INFO:tasks.workunit.client.0.smithi097.stderr: -422> 2024-09-14T11:07:24.447+0000 7fbbdef73800 5 AuthRegistry(0x558d9d831f18) adding con mode: secure 2024-09-14T11:07:24.731 INFO:tasks.workunit.client.0.smithi097.stderr: -421> 2024-09-14T11:07:24.447+0000 7fbbdef73800 5 AuthRegistry(0x558d9d831f18) adding con mode: crc 2024-09-14T11:07:24.731 INFO:tasks.workunit.client.0.smithi097.stderr: -420> 2024-09-14T11:07:24.447+0000 7fbbdef73800 5 AuthRegistry(0x558d9d831f18) adding con mode: secure 2024-09-14T11:07:24.731 INFO:tasks.workunit.client.0.smithi097.stderr: -419> 2024-09-14T11:07:24.447+0000 7fbbdef73800 5 AuthRegistry(0x558d9d831f18) adding con mode: crc 2024-09-14T11:07:24.731 INFO:tasks.workunit.client.0.smithi097.stderr: -418> 2024-09-14T11:07:24.447+0000 7fbbdef73800 5 AuthRegistry(0x558d9d831f18) adding con mode: secure 2024-09-14T11:07:24.731 INFO:tasks.workunit.client.0.smithi097.stderr: -417> 2024-09-14T11:07:24.447+0000 7fbbdef73800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:07:24.731 INFO:tasks.workunit.client.0.smithi097.stderr: -416> 2024-09-14T11:07:24.447+0000 7fbbdef73800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:07:24.731 INFO:tasks.workunit.client.0.smithi097.stderr: -415> 2024-09-14T11:07:24.447+0000 7fbbdef73800 5 asok(0x558d9d5bb270) register_command rotate-key cmddesc rotate-key hook 0x558d9d832060 EEXIST 2024-09-14T11:07:24.731 INFO:tasks.workunit.client.0.smithi097.stderr: -414> 2024-09-14T11:07:24.447+0000 7fbbdef73800 10 monclient: _reopen_session rank -1 2024-09-14T11:07:24.731 INFO:tasks.workunit.client.0.smithi097.stderr: -413> 2024-09-14T11:07:24.447+0000 7fbbdef73800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:07:24.732 INFO:tasks.workunit.client.0.smithi097.stderr: -412> 2024-09-14T11:07:24.447+0000 7fbbdef73800 10 monclient(hunting): picked mon.noname-c con 0x558d9d85a850 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:07:24.732 INFO:tasks.workunit.client.0.smithi097.stderr: -411> 2024-09-14T11:07:24.447+0000 7fbbdef73800 10 monclient(hunting): picked mon.noname-b con 0x558d9d85ac30 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:07:24.732 INFO:tasks.workunit.client.0.smithi097.stderr: -410> 2024-09-14T11:07:24.447+0000 7fbbdef73800 10 monclient(hunting): picked mon.noname-a con 0x558d9d859560 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:07:24.732 INFO:tasks.workunit.client.0.smithi097.stderr: -409> 2024-09-14T11:07:24.447+0000 7fbbdef73800 10 monclient(hunting): start opening mon connection 2024-09-14T11:07:24.732 INFO:tasks.workunit.client.0.smithi097.stderr: -408> 2024-09-14T11:07:24.447+0000 7fbbdef73800 10 monclient(hunting): start opening mon connection 2024-09-14T11:07:24.732 INFO:tasks.workunit.client.0.smithi097.stderr: -407> 2024-09-14T11:07:24.447+0000 7fbbdef73800 10 monclient(hunting): start opening mon connection 2024-09-14T11:07:24.732 INFO:tasks.workunit.client.0.smithi097.stderr: -406> 2024-09-14T11:07:24.447+0000 7fbbdef73800 10 monclient(hunting): _renew_subs 2024-09-14T11:07:24.732 INFO:tasks.workunit.client.0.smithi097.stderr: -405> 2024-09-14T11:07:24.447+0000 7fbbdef73800 10 monclient(hunting): authenticate will time out at 2126.101741s 2024-09-14T11:07:24.732 INFO:tasks.workunit.client.0.smithi097.stderr: -404> 2024-09-14T11:07:24.447+0000 7fbbdc25c640 10 monclient(hunting): get_auth_request con 0x558d9d85a850 auth_method 0 2024-09-14T11:07:24.732 INFO:tasks.workunit.client.0.smithi097.stderr: -403> 2024-09-14T11:07:24.447+0000 7fbbdc25c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:07:24.732 INFO:tasks.workunit.client.0.smithi097.stderr: -402> 2024-09-14T11:07:24.447+0000 7fbbdc25c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:07:24.732 INFO:tasks.workunit.client.0.smithi097.stderr: -401> 2024-09-14T11:07:24.447+0000 7fbbdc25c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:07:24.732 INFO:tasks.workunit.client.0.smithi097.stderr: -400> 2024-09-14T11:07:24.447+0000 7fbbdca5d640 10 monclient(hunting): get_auth_request con 0x558d9d859560 auth_method 0 2024-09-14T11:07:24.732 INFO:tasks.workunit.client.0.smithi097.stderr: -399> 2024-09-14T11:07:24.447+0000 7fbbdca5d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:07:24.733 INFO:tasks.workunit.client.0.smithi097.stderr: -398> 2024-09-14T11:07:24.447+0000 7fbbdca5d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:07:24.733 INFO:tasks.workunit.client.0.smithi097.stderr: -397> 2024-09-14T11:07:24.447+0000 7fbbdca5d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:07:24.733 INFO:tasks.workunit.client.0.smithi097.stderr: -396> 2024-09-14T11:07:24.447+0000 7fbbdd25e640 10 monclient(hunting): get_auth_request con 0x558d9d85ac30 auth_method 0 2024-09-14T11:07:24.733 INFO:tasks.workunit.client.0.smithi097.stderr: -395> 2024-09-14T11:07:24.447+0000 7fbbdd25e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:07:24.733 INFO:tasks.workunit.client.0.smithi097.stderr: -394> 2024-09-14T11:07:24.447+0000 7fbbdd25e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:07:24.733 INFO:tasks.workunit.client.0.smithi097.stderr: -393> 2024-09-14T11:07:24.447+0000 7fbbdd25e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:07:24.733 INFO:tasks.workunit.client.0.smithi097.stderr: -392> 2024-09-14T11:07:24.447+0000 7fbbdc25c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:07:24.733 INFO:tasks.workunit.client.0.smithi097.stderr: -391> 2024-09-14T11:07:24.447+0000 7fbbdc25c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:07:24.733 INFO:tasks.workunit.client.0.smithi097.stderr: -390> 2024-09-14T11:07:24.447+0000 7fbbdc25c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:07:24.733 INFO:tasks.workunit.client.0.smithi097.stderr: -389> 2024-09-14T11:07:24.447+0000 7fbbdca5d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:07:24.733 INFO:tasks.workunit.client.0.smithi097.stderr: -388> 2024-09-14T11:07:24.447+0000 7fbbdca5d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:07:24.734 INFO:tasks.workunit.client.0.smithi097.stderr: -387> 2024-09-14T11:07:24.447+0000 7fbbdca5d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:07:24.734 INFO:tasks.workunit.client.0.smithi097.stderr: -386> 2024-09-14T11:07:24.448+0000 7fbbdd25e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:07:24.734 INFO:tasks.workunit.client.0.smithi097.stderr: -385> 2024-09-14T11:07:24.448+0000 7fbbdd25e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:07:24.734 INFO:tasks.workunit.client.0.smithi097.stderr: -384> 2024-09-14T11:07:24.448+0000 7fbbdd25e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:07:24.734 INFO:tasks.workunit.client.0.smithi097.stderr: -383> 2024-09-14T11:07:24.448+0000 7fbbdc25c640 10 monclient(hunting): handle_auth_done global_id 7658 payload 824 2024-09-14T11:07:24.734 INFO:tasks.workunit.client.0.smithi097.stderr: -382> 2024-09-14T11:07:24.448+0000 7fbbdc25c640 10 monclient: _finish_hunting 0 2024-09-14T11:07:24.734 INFO:tasks.workunit.client.0.smithi097.stderr: -381> 2024-09-14T11:07:24.448+0000 7fbbdc25c640 1 monclient: found mon.noname-c 2024-09-14T11:07:24.734 INFO:tasks.workunit.client.0.smithi097.stderr: -380> 2024-09-14T11:07:24.448+0000 7fbbdc25c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:07:24.734 INFO:tasks.workunit.client.0.smithi097.stderr: -379> 2024-09-14T11:07:24.448+0000 7fbac27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:07:24.734 INFO:tasks.workunit.client.0.smithi097.stderr: -378> 2024-09-14T11:07:24.448+0000 7fbac27fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:07:24.734 INFO:tasks.workunit.client.0.smithi097.stderr: -377> 2024-09-14T11:07:24.448+0000 7fbac27fc640 10 monclient: dump: 2024-09-14T11:07:24.734 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:07:24.734 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:07:24.735 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:24.735 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:24.735 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:07:24.735 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:07:24.735 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:07:24.735 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:07:24.735 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:07:24.735 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:24.735 INFO:tasks.workunit.client.0.smithi097.stderr: -376> 2024-09-14T11:07:24.448+0000 7fbac27fc640 10 monclient: _finish_auth 0 2024-09-14T11:07:24.735 INFO:tasks.workunit.client.0.smithi097.stderr: -375> 2024-09-14T11:07:24.448+0000 7fbac27fc640 10 monclient: _check_auth_tickets 2024-09-14T11:07:24.735 INFO:tasks.workunit.client.0.smithi097.stderr: -374> 2024-09-14T11:07:24.448+0000 7fbac27fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:07:24.735 INFO:tasks.workunit.client.0.smithi097.stderr: -373> 2024-09-14T11:07:24.448+0000 7fbac27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:07:24.735 INFO:tasks.workunit.client.0.smithi097.stderr: -372> 2024-09-14T11:07:24.448+0000 7fbac27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:07:24.735 INFO:tasks.workunit.client.0.smithi097.stderr: -371> 2024-09-14T11:07:24.448+0000 7fbac27fc640 10 monclient: dump: 2024-09-14T11:07:24.736 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:07:24.736 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:07:24.736 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:24.736 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:24.736 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:07:24.736 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:07:24.736 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:07:24.736 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:07:24.736 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:07:24.736 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:24.736 INFO:tasks.workunit.client.0.smithi097.stderr: -370> 2024-09-14T11:07:24.448+0000 7fbbdef73800 5 monclient: authenticate success, global_id 7658 2024-09-14T11:07:24.736 INFO:tasks.workunit.client.0.smithi097.stderr: -369> 2024-09-14T11:07:24.448+0000 7fbbdef73800 10 monclient: _renew_subs 2024-09-14T11:07:24.736 INFO:tasks.workunit.client.0.smithi097.stderr: -368> 2024-09-14T11:07:24.448+0000 7fbbdda5f640 4 set_mon_vals no callback set 2024-09-14T11:07:24.736 INFO:tasks.workunit.client.0.smithi097.stderr: -367> 2024-09-14T11:07:24.448+0000 7fbbdef73800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:07:24.737 INFO:tasks.workunit.client.0.smithi097.stderr: -366> 2024-09-14T11:07:24.448+0000 7fbbdef73800 10 monclient: _renew_subs 2024-09-14T11:07:24.737 INFO:tasks.workunit.client.0.smithi097.stderr: -365> 2024-09-14T11:07:24.448+0000 7fbbdef73800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:07:24.737 INFO:tasks.workunit.client.0.smithi097.stderr: -364> 2024-09-14T11:07:24.450+0000 7fbac27fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:07:24.737 INFO:tasks.workunit.client.0.smithi097.stderr: -363> 2024-09-14T11:07:24.450+0000 7fbac27fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:07:24.737 INFO:tasks.workunit.client.0.smithi097.stderr: -362> 2024-09-14T11:07:24.450+0000 7fbac27fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:07:24.737 INFO:tasks.workunit.client.0.smithi097.stderr: -361> 2024-09-14T11:07:24.450+0000 7fbbdd25e640 10 monclient: get_auth_request con 0x7fbab4077140 auth_method 0 2024-09-14T11:07:24.737 INFO:tasks.workunit.client.0.smithi097.stderr: -360> 2024-09-14T11:07:24.450+0000 7fbbdef73800 10 monclient: get_monmap_and_config 2024-09-14T11:07:24.737 INFO:tasks.workunit.client.0.smithi097.stderr: -359> 2024-09-14T11:07:24.450+0000 7fbbdef73800 10 monclient: build_initial_monmap 2024-09-14T11:07:24.737 INFO:tasks.workunit.client.0.smithi097.stderr: -358> 2024-09-14T11:07:24.450+0000 7fbbdef73800 1 build_initial for_mkfs: 0 2024-09-14T11:07:24.737 INFO:tasks.workunit.client.0.smithi097.stderr: -357> 2024-09-14T11:07:24.450+0000 7fbbdef73800 10 monclient: monmap: 2024-09-14T11:07:24.737 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:07:24.737 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:07:24.737 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:07:24.737 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:07:24.738 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:07:24.738 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:07:24.738 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:07:24.738 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:07:24.738 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:07:24.738 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:24.738 INFO:tasks.workunit.client.0.smithi097.stderr: -356> 2024-09-14T11:07:24.450+0000 7fbbdef73800 5 AuthRegistry(0x558d9d87a700) adding auth protocol: cephx 2024-09-14T11:07:24.738 INFO:tasks.workunit.client.0.smithi097.stderr: -355> 2024-09-14T11:07:24.450+0000 7fbbdef73800 5 AuthRegistry(0x558d9d87a700) adding auth protocol: cephx 2024-09-14T11:07:24.738 INFO:tasks.workunit.client.0.smithi097.stderr: -354> 2024-09-14T11:07:24.450+0000 7fbbdef73800 5 AuthRegistry(0x558d9d87a700) adding auth protocol: cephx 2024-09-14T11:07:24.738 INFO:tasks.workunit.client.0.smithi097.stderr: -353> 2024-09-14T11:07:24.450+0000 7fbbdef73800 5 AuthRegistry(0x558d9d87a700) adding con mode: secure 2024-09-14T11:07:24.738 INFO:tasks.workunit.client.0.smithi097.stderr: -352> 2024-09-14T11:07:24.450+0000 7fbbdef73800 5 AuthRegistry(0x558d9d87a700) adding con mode: crc 2024-09-14T11:07:24.738 INFO:tasks.workunit.client.0.smithi097.stderr: -351> 2024-09-14T11:07:24.450+0000 7fbbdef73800 5 AuthRegistry(0x558d9d87a700) adding con mode: secure 2024-09-14T11:07:24.738 INFO:tasks.workunit.client.0.smithi097.stderr: -350> 2024-09-14T11:07:24.450+0000 7fbbdef73800 5 AuthRegistry(0x558d9d87a700) adding con mode: crc 2024-09-14T11:07:24.738 INFO:tasks.workunit.client.0.smithi097.stderr: -349> 2024-09-14T11:07:24.450+0000 7fbbdef73800 5 AuthRegistry(0x558d9d87a700) adding con mode: secure 2024-09-14T11:07:24.738 INFO:tasks.workunit.client.0.smithi097.stderr: -348> 2024-09-14T11:07:24.450+0000 7fbbdef73800 5 AuthRegistry(0x558d9d87a700) adding con mode: crc 2024-09-14T11:07:24.739 INFO:tasks.workunit.client.0.smithi097.stderr: -347> 2024-09-14T11:07:24.450+0000 7fbbdef73800 5 AuthRegistry(0x558d9d87a700) adding con mode: crc 2024-09-14T11:07:24.739 INFO:tasks.workunit.client.0.smithi097.stderr: -346> 2024-09-14T11:07:24.450+0000 7fbbdef73800 5 AuthRegistry(0x558d9d87a700) adding con mode: secure 2024-09-14T11:07:24.739 INFO:tasks.workunit.client.0.smithi097.stderr: -345> 2024-09-14T11:07:24.450+0000 7fbbdef73800 5 AuthRegistry(0x558d9d87a700) adding con mode: crc 2024-09-14T11:07:24.739 INFO:tasks.workunit.client.0.smithi097.stderr: -344> 2024-09-14T11:07:24.450+0000 7fbbdef73800 5 AuthRegistry(0x558d9d87a700) adding con mode: secure 2024-09-14T11:07:24.739 INFO:tasks.workunit.client.0.smithi097.stderr: -343> 2024-09-14T11:07:24.450+0000 7fbbdef73800 5 AuthRegistry(0x558d9d87a700) adding con mode: crc 2024-09-14T11:07:24.739 INFO:tasks.workunit.client.0.smithi097.stderr: -342> 2024-09-14T11:07:24.450+0000 7fbbdef73800 5 AuthRegistry(0x558d9d87a700) adding con mode: secure 2024-09-14T11:07:24.739 INFO:tasks.workunit.client.0.smithi097.stderr: -341> 2024-09-14T11:07:24.450+0000 7fbbdef73800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:07:24.739 INFO:tasks.workunit.client.0.smithi097.stderr: -340> 2024-09-14T11:07:24.451+0000 7fbbdef73800 10 monclient: init 2024-09-14T11:07:24.739 INFO:tasks.workunit.client.0.smithi097.stderr: -339> 2024-09-14T11:07:24.451+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5e8b0) adding auth protocol: cephx 2024-09-14T11:07:24.739 INFO:tasks.workunit.client.0.smithi097.stderr: -338> 2024-09-14T11:07:24.451+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5e8b0) adding auth protocol: cephx 2024-09-14T11:07:24.739 INFO:tasks.workunit.client.0.smithi097.stderr: -337> 2024-09-14T11:07:24.451+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5e8b0) adding auth protocol: cephx 2024-09-14T11:07:24.739 INFO:tasks.workunit.client.0.smithi097.stderr: -336> 2024-09-14T11:07:24.451+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5e8b0) adding con mode: secure 2024-09-14T11:07:24.739 INFO:tasks.workunit.client.0.smithi097.stderr: -335> 2024-09-14T11:07:24.451+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5e8b0) adding con mode: crc 2024-09-14T11:07:24.739 INFO:tasks.workunit.client.0.smithi097.stderr: -334> 2024-09-14T11:07:24.451+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5e8b0) adding con mode: secure 2024-09-14T11:07:24.740 INFO:tasks.workunit.client.0.smithi097.stderr: -333> 2024-09-14T11:07:24.451+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5e8b0) adding con mode: crc 2024-09-14T11:07:24.740 INFO:tasks.workunit.client.0.smithi097.stderr: -332> 2024-09-14T11:07:24.451+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5e8b0) adding con mode: secure 2024-09-14T11:07:24.740 INFO:tasks.workunit.client.0.smithi097.stderr: -331> 2024-09-14T11:07:24.451+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5e8b0) adding con mode: crc 2024-09-14T11:07:24.740 INFO:tasks.workunit.client.0.smithi097.stderr: -330> 2024-09-14T11:07:24.451+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5e8b0) adding con mode: crc 2024-09-14T11:07:24.740 INFO:tasks.workunit.client.0.smithi097.stderr: -329> 2024-09-14T11:07:24.451+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5e8b0) adding con mode: secure 2024-09-14T11:07:24.740 INFO:tasks.workunit.client.0.smithi097.stderr: -328> 2024-09-14T11:07:24.451+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5e8b0) adding con mode: crc 2024-09-14T11:07:24.740 INFO:tasks.workunit.client.0.smithi097.stderr: -327> 2024-09-14T11:07:24.451+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5e8b0) adding con mode: secure 2024-09-14T11:07:24.740 INFO:tasks.workunit.client.0.smithi097.stderr: -326> 2024-09-14T11:07:24.451+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5e8b0) adding con mode: crc 2024-09-14T11:07:24.740 INFO:tasks.workunit.client.0.smithi097.stderr: -325> 2024-09-14T11:07:24.451+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5e8b0) adding con mode: secure 2024-09-14T11:07:24.740 INFO:tasks.workunit.client.0.smithi097.stderr: -324> 2024-09-14T11:07:24.451+0000 7fbbdef73800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:07:24.740 INFO:tasks.workunit.client.0.smithi097.stderr: -323> 2024-09-14T11:07:24.451+0000 7fbbdef73800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:07:24.740 INFO:tasks.workunit.client.0.smithi097.stderr: -322> 2024-09-14T11:07:24.451+0000 7fbbdef73800 5 asok(0x558d9d5bb270) register_command rotate-key cmddesc rotate-key hook 0x7fffa7a5e9f8 EEXIST 2024-09-14T11:07:24.740 INFO:tasks.workunit.client.0.smithi097.stderr: -321> 2024-09-14T11:07:24.451+0000 7fbbdef73800 10 monclient: _reopen_session rank -1 2024-09-14T11:07:24.741 INFO:tasks.workunit.client.0.smithi097.stderr: -320> 2024-09-14T11:07:24.451+0000 7fbbdef73800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:07:24.741 INFO:tasks.workunit.client.0.smithi097.stderr: -319> 2024-09-14T11:07:24.451+0000 7fbbdef73800 10 monclient(hunting): picked mon.noname-a con 0x558d9d8aed60 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:07:24.741 INFO:tasks.workunit.client.0.smithi097.stderr: -318> 2024-09-14T11:07:24.451+0000 7fbbdef73800 10 monclient(hunting): picked mon.noname-b con 0x558d9d87fd70 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:07:24.741 INFO:tasks.workunit.client.0.smithi097.stderr: -317> 2024-09-14T11:07:24.451+0000 7fbbdef73800 10 monclient(hunting): picked mon.noname-c con 0x558d9d8aa240 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:07:24.741 INFO:tasks.workunit.client.0.smithi097.stderr: -316> 2024-09-14T11:07:24.451+0000 7fbbdef73800 10 monclient(hunting): start opening mon connection 2024-09-14T11:07:24.741 INFO:tasks.workunit.client.0.smithi097.stderr: -315> 2024-09-14T11:07:24.451+0000 7fbbdef73800 10 monclient(hunting): start opening mon connection 2024-09-14T11:07:24.741 INFO:tasks.workunit.client.0.smithi097.stderr: -314> 2024-09-14T11:07:24.451+0000 7fbbdef73800 10 monclient(hunting): start opening mon connection 2024-09-14T11:07:24.741 INFO:tasks.workunit.client.0.smithi097.stderr: -313> 2024-09-14T11:07:24.451+0000 7fbbdef73800 10 monclient(hunting): _renew_subs 2024-09-14T11:07:24.741 INFO:tasks.workunit.client.0.smithi097.stderr: -312> 2024-09-14T11:07:24.451+0000 7fbbdef73800 10 monclient(hunting): authenticate will time out at 2126.105527s 2024-09-14T11:07:24.741 INFO:tasks.workunit.client.0.smithi097.stderr: -311> 2024-09-14T11:07:24.451+0000 7fbbdc25c640 10 monclient(hunting): get_auth_request con 0x558d9d8aed60 auth_method 0 2024-09-14T11:07:24.741 INFO:tasks.workunit.client.0.smithi097.stderr: -310> 2024-09-14T11:07:24.451+0000 7fbbdc25c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:07:24.741 INFO:tasks.workunit.client.0.smithi097.stderr: -309> 2024-09-14T11:07:24.451+0000 7fbbdc25c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:07:24.741 INFO:tasks.workunit.client.0.smithi097.stderr: -308> 2024-09-14T11:07:24.451+0000 7fbbdc25c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:07:24.741 INFO:tasks.workunit.client.0.smithi097.stderr: -307> 2024-09-14T11:07:24.451+0000 7fbbdca5d640 10 monclient(hunting): get_auth_request con 0x558d9d8aa240 auth_method 0 2024-09-14T11:07:24.742 INFO:tasks.workunit.client.0.smithi097.stderr: -306> 2024-09-14T11:07:24.451+0000 7fbbdca5d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:07:24.742 INFO:tasks.workunit.client.0.smithi097.stderr: -305> 2024-09-14T11:07:24.451+0000 7fbbdca5d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:07:24.742 INFO:tasks.workunit.client.0.smithi097.stderr: -304> 2024-09-14T11:07:24.451+0000 7fbbdca5d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:07:24.742 INFO:tasks.workunit.client.0.smithi097.stderr: -303> 2024-09-14T11:07:24.451+0000 7fbbdc25c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:07:24.742 INFO:tasks.workunit.client.0.smithi097.stderr: -302> 2024-09-14T11:07:24.451+0000 7fbbdc25c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:07:24.742 INFO:tasks.workunit.client.0.smithi097.stderr: -301> 2024-09-14T11:07:24.451+0000 7fbbdc25c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:07:24.742 INFO:tasks.workunit.client.0.smithi097.stderr: -300> 2024-09-14T11:07:24.451+0000 7fbbdd25e640 10 monclient(hunting): get_auth_request con 0x558d9d87fd70 auth_method 0 2024-09-14T11:07:24.742 INFO:tasks.workunit.client.0.smithi097.stderr: -299> 2024-09-14T11:07:24.451+0000 7fbbdd25e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:07:24.742 INFO:tasks.workunit.client.0.smithi097.stderr: -298> 2024-09-14T11:07:24.451+0000 7fbbdd25e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:07:24.742 INFO:tasks.workunit.client.0.smithi097.stderr: -297> 2024-09-14T11:07:24.451+0000 7fbbdd25e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:07:24.742 INFO:tasks.workunit.client.0.smithi097.stderr: -296> 2024-09-14T11:07:24.451+0000 7fbbdca5d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:07:24.742 INFO:tasks.workunit.client.0.smithi097.stderr: -295> 2024-09-14T11:07:24.451+0000 7fbbdca5d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:07:24.742 INFO:tasks.workunit.client.0.smithi097.stderr: -294> 2024-09-14T11:07:24.451+0000 7fbbdca5d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:07:24.742 INFO:tasks.workunit.client.0.smithi097.stderr: -293> 2024-09-14T11:07:24.451+0000 7fbbdd25e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:07:24.743 INFO:tasks.workunit.client.0.smithi097.stderr: -292> 2024-09-14T11:07:24.451+0000 7fbbdd25e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:07:24.743 INFO:tasks.workunit.client.0.smithi097.stderr: -291> 2024-09-14T11:07:24.451+0000 7fbbdd25e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:07:24.743 INFO:tasks.workunit.client.0.smithi097.stderr: -290> 2024-09-14T11:07:24.451+0000 7fbbdc25c640 10 monclient(hunting): handle_auth_done global_id 8157 payload 274 2024-09-14T11:07:24.743 INFO:tasks.workunit.client.0.smithi097.stderr: -289> 2024-09-14T11:07:24.451+0000 7fbbdc25c640 10 monclient: _finish_hunting 0 2024-09-14T11:07:24.743 INFO:tasks.workunit.client.0.smithi097.stderr: -288> 2024-09-14T11:07:24.451+0000 7fbbdc25c640 1 monclient: found mon.noname-a 2024-09-14T11:07:24.743 INFO:tasks.workunit.client.0.smithi097.stderr: -287> 2024-09-14T11:07:24.451+0000 7fbbdc25c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-14T11:07:24.743 INFO:tasks.workunit.client.0.smithi097.stderr: -286> 2024-09-14T11:07:24.452+0000 7fbab3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:07:24.743 INFO:tasks.workunit.client.0.smithi097.stderr: -285> 2024-09-14T11:07:24.452+0000 7fbab3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:07:24.743 INFO:tasks.workunit.client.0.smithi097.stderr: -284> 2024-09-14T11:07:24.452+0000 7fbab3fff640 10 monclient: dump: 2024-09-14T11:07:24.743 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:07:24.743 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:07:24.743 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:24.743 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:24.743 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:07:24.744 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:07:24.744 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:07:24.744 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:07:24.744 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:07:24.744 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:24.744 INFO:tasks.workunit.client.0.smithi097.stderr: -283> 2024-09-14T11:07:24.452+0000 7fbab3fff640 10 monclient: _finish_auth 0 2024-09-14T11:07:24.744 INFO:tasks.workunit.client.0.smithi097.stderr: -282> 2024-09-14T11:07:24.452+0000 7fbab3fff640 10 monclient: _check_auth_tickets 2024-09-14T11:07:24.744 INFO:tasks.workunit.client.0.smithi097.stderr: -281> 2024-09-14T11:07:24.452+0000 7fbab3fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:07:24.744 INFO:tasks.workunit.client.0.smithi097.stderr: -280> 2024-09-14T11:07:24.452+0000 7fbab3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:07:24.744 INFO:tasks.workunit.client.0.smithi097.stderr: -279> 2024-09-14T11:07:24.452+0000 7fbab3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:07:24.744 INFO:tasks.workunit.client.0.smithi097.stderr: -278> 2024-09-14T11:07:24.452+0000 7fbab3fff640 10 monclient: dump: 2024-09-14T11:07:24.744 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:07:24.744 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:07:24.745 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:24.745 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:24.745 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:07:24.745 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:07:24.745 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:07:24.745 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:07:24.745 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:07:24.745 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:24.745 INFO:tasks.workunit.client.0.smithi097.stderr: -277> 2024-09-14T11:07:24.452+0000 7fbbdef73800 5 monclient: authenticate success, global_id 8157 2024-09-14T11:07:24.745 INFO:tasks.workunit.client.0.smithi097.stderr: -276> 2024-09-14T11:07:24.452+0000 7fbbdef73800 10 monclient: get_monmap_and_config success 2024-09-14T11:07:24.745 INFO:tasks.workunit.client.0.smithi097.stderr: -275> 2024-09-14T11:07:24.452+0000 7fbbdef73800 4 set_mon_vals no callback set 2024-09-14T11:07:24.745 INFO:tasks.workunit.client.0.smithi097.stderr: -274> 2024-09-14T11:07:24.452+0000 7fbbdef73800 10 monclient: shutdown 2024-09-14T11:07:24.745 INFO:tasks.workunit.client.0.smithi097.stderr: -273> 2024-09-14T11:07:24.452+0000 7fbbdef73800 10 monclient: build_initial_monmap 2024-09-14T11:07:24.745 INFO:tasks.workunit.client.0.smithi097.stderr: -272> 2024-09-14T11:07:24.452+0000 7fbbdef73800 1 build_initial for_mkfs: 0 2024-09-14T11:07:24.746 INFO:tasks.workunit.client.0.smithi097.stderr: -271> 2024-09-14T11:07:24.452+0000 7fbbdef73800 10 monclient: monmap: 2024-09-14T11:07:24.746 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:07:24.746 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:07:24.746 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:07:24.746 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:07:24.746 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:07:24.746 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:07:24.746 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:07:24.746 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:07:24.746 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:07:24.746 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:24.746 INFO:tasks.workunit.client.0.smithi097.stderr: -270> 2024-09-14T11:07:24.452+0000 7fbbdef73800 5 AuthRegistry(0x558d9d89f550) adding auth protocol: cephx 2024-09-14T11:07:24.746 INFO:tasks.workunit.client.0.smithi097.stderr: -269> 2024-09-14T11:07:24.452+0000 7fbbdef73800 5 AuthRegistry(0x558d9d89f550) adding auth protocol: cephx 2024-09-14T11:07:24.746 INFO:tasks.workunit.client.0.smithi097.stderr: -268> 2024-09-14T11:07:24.452+0000 7fbbdef73800 5 AuthRegistry(0x558d9d89f550) adding auth protocol: cephx 2024-09-14T11:07:24.747 INFO:tasks.workunit.client.0.smithi097.stderr: -267> 2024-09-14T11:07:24.452+0000 7fbbdef73800 5 AuthRegistry(0x558d9d89f550) adding con mode: secure 2024-09-14T11:07:24.747 INFO:tasks.workunit.client.0.smithi097.stderr: -266> 2024-09-14T11:07:24.452+0000 7fbbdef73800 5 AuthRegistry(0x558d9d89f550) adding con mode: crc 2024-09-14T11:07:24.747 INFO:tasks.workunit.client.0.smithi097.stderr: -265> 2024-09-14T11:07:24.452+0000 7fbbdef73800 5 AuthRegistry(0x558d9d89f550) adding con mode: secure 2024-09-14T11:07:24.747 INFO:tasks.workunit.client.0.smithi097.stderr: -264> 2024-09-14T11:07:24.452+0000 7fbbdef73800 5 AuthRegistry(0x558d9d89f550) adding con mode: crc 2024-09-14T11:07:24.747 INFO:tasks.workunit.client.0.smithi097.stderr: -263> 2024-09-14T11:07:24.452+0000 7fbbdef73800 5 AuthRegistry(0x558d9d89f550) adding con mode: secure 2024-09-14T11:07:24.747 INFO:tasks.workunit.client.0.smithi097.stderr: -262> 2024-09-14T11:07:24.452+0000 7fbbdef73800 5 AuthRegistry(0x558d9d89f550) adding con mode: crc 2024-09-14T11:07:24.747 INFO:tasks.workunit.client.0.smithi097.stderr: -261> 2024-09-14T11:07:24.452+0000 7fbbdef73800 5 AuthRegistry(0x558d9d89f550) adding con mode: crc 2024-09-14T11:07:24.747 INFO:tasks.workunit.client.0.smithi097.stderr: -260> 2024-09-14T11:07:24.452+0000 7fbbdef73800 5 AuthRegistry(0x558d9d89f550) adding con mode: secure 2024-09-14T11:07:24.747 INFO:tasks.workunit.client.0.smithi097.stderr: -259> 2024-09-14T11:07:24.452+0000 7fbbdef73800 5 AuthRegistry(0x558d9d89f550) adding con mode: crc 2024-09-14T11:07:24.747 INFO:tasks.workunit.client.0.smithi097.stderr: -258> 2024-09-14T11:07:24.452+0000 7fbbdef73800 5 AuthRegistry(0x558d9d89f550) adding con mode: secure 2024-09-14T11:07:24.747 INFO:tasks.workunit.client.0.smithi097.stderr: -257> 2024-09-14T11:07:24.452+0000 7fbbdef73800 5 AuthRegistry(0x558d9d89f550) adding con mode: crc 2024-09-14T11:07:24.747 INFO:tasks.workunit.client.0.smithi097.stderr: -256> 2024-09-14T11:07:24.452+0000 7fbbdef73800 5 AuthRegistry(0x558d9d89f550) adding con mode: secure 2024-09-14T11:07:24.747 INFO:tasks.workunit.client.0.smithi097.stderr: -255> 2024-09-14T11:07:24.452+0000 7fbbdef73800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:07:24.748 INFO:tasks.workunit.client.0.smithi097.stderr: -254> 2024-09-14T11:07:24.452+0000 7fbbdef73800 1 librados: starting msgr at 2024-09-14T11:07:24.748 INFO:tasks.workunit.client.0.smithi097.stderr: -253> 2024-09-14T11:07:24.452+0000 7fbbdef73800 1 librados: starting objecter 2024-09-14T11:07:24.748 INFO:tasks.workunit.client.0.smithi097.stderr: -252> 2024-09-14T11:07:24.453+0000 7fbbdef73800 5 asok(0x558d9d5bb270) register_command objecter_requests cmddesc objecter_requests hook 0x558d9d87e3c0 EEXIST 2024-09-14T11:07:24.748 INFO:tasks.workunit.client.0.smithi097.stderr: -251> 2024-09-14T11:07:24.453+0000 7fbbdef73800 1 librados: setting wanted keys 2024-09-14T11:07:24.748 INFO:tasks.workunit.client.0.smithi097.stderr: -250> 2024-09-14T11:07:24.453+0000 7fbbdef73800 1 librados: calling monclient init 2024-09-14T11:07:24.748 INFO:tasks.workunit.client.0.smithi097.stderr: -249> 2024-09-14T11:07:24.453+0000 7fbbdef73800 10 monclient: init 2024-09-14T11:07:24.748 INFO:tasks.workunit.client.0.smithi097.stderr: -248> 2024-09-14T11:07:24.453+0000 7fbbdef73800 5 AuthRegistry(0x558d9d86f110) adding auth protocol: cephx 2024-09-14T11:07:24.748 INFO:tasks.workunit.client.0.smithi097.stderr: -247> 2024-09-14T11:07:24.453+0000 7fbbdef73800 5 AuthRegistry(0x558d9d86f110) adding auth protocol: cephx 2024-09-14T11:07:24.748 INFO:tasks.workunit.client.0.smithi097.stderr: -246> 2024-09-14T11:07:24.453+0000 7fbbdef73800 5 AuthRegistry(0x558d9d86f110) adding auth protocol: cephx 2024-09-14T11:07:24.748 INFO:tasks.workunit.client.0.smithi097.stderr: -245> 2024-09-14T11:07:24.453+0000 7fbbdef73800 5 AuthRegistry(0x558d9d86f110) adding con mode: secure 2024-09-14T11:07:24.748 INFO:tasks.workunit.client.0.smithi097.stderr: -244> 2024-09-14T11:07:24.453+0000 7fbbdef73800 5 AuthRegistry(0x558d9d86f110) adding con mode: crc 2024-09-14T11:07:24.748 INFO:tasks.workunit.client.0.smithi097.stderr: -243> 2024-09-14T11:07:24.453+0000 7fbbdef73800 5 AuthRegistry(0x558d9d86f110) adding con mode: secure 2024-09-14T11:07:24.748 INFO:tasks.workunit.client.0.smithi097.stderr: -242> 2024-09-14T11:07:24.453+0000 7fbbdef73800 5 AuthRegistry(0x558d9d86f110) adding con mode: crc 2024-09-14T11:07:24.749 INFO:tasks.workunit.client.0.smithi097.stderr: -241> 2024-09-14T11:07:24.453+0000 7fbbdef73800 5 AuthRegistry(0x558d9d86f110) adding con mode: secure 2024-09-14T11:07:24.749 INFO:tasks.workunit.client.0.smithi097.stderr: -240> 2024-09-14T11:07:24.453+0000 7fbbdef73800 5 AuthRegistry(0x558d9d86f110) adding con mode: crc 2024-09-14T11:07:24.749 INFO:tasks.workunit.client.0.smithi097.stderr: -239> 2024-09-14T11:07:24.453+0000 7fbbdef73800 5 AuthRegistry(0x558d9d86f110) adding con mode: crc 2024-09-14T11:07:24.749 INFO:tasks.workunit.client.0.smithi097.stderr: -238> 2024-09-14T11:07:24.453+0000 7fbbdef73800 5 AuthRegistry(0x558d9d86f110) adding con mode: secure 2024-09-14T11:07:24.749 INFO:tasks.workunit.client.0.smithi097.stderr: -237> 2024-09-14T11:07:24.453+0000 7fbbdef73800 5 AuthRegistry(0x558d9d86f110) adding con mode: crc 2024-09-14T11:07:24.749 INFO:tasks.workunit.client.0.smithi097.stderr: -236> 2024-09-14T11:07:24.453+0000 7fbbdef73800 5 AuthRegistry(0x558d9d86f110) adding con mode: secure 2024-09-14T11:07:24.749 INFO:tasks.workunit.client.0.smithi097.stderr: -235> 2024-09-14T11:07:24.453+0000 7fbbdef73800 5 AuthRegistry(0x558d9d86f110) adding con mode: crc 2024-09-14T11:07:24.749 INFO:tasks.workunit.client.0.smithi097.stderr: -234> 2024-09-14T11:07:24.453+0000 7fbbdef73800 5 AuthRegistry(0x558d9d86f110) adding con mode: secure 2024-09-14T11:07:24.749 INFO:tasks.workunit.client.0.smithi097.stderr: -233> 2024-09-14T11:07:24.453+0000 7fbbdef73800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:07:24.749 INFO:tasks.workunit.client.0.smithi097.stderr: -232> 2024-09-14T11:07:24.453+0000 7fbbdef73800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:07:24.749 INFO:tasks.workunit.client.0.smithi097.stderr: -231> 2024-09-14T11:07:24.453+0000 7fbbdef73800 5 asok(0x558d9d5bb270) register_command rotate-key cmddesc rotate-key hook 0x558d9d86f258 EEXIST 2024-09-14T11:07:24.749 INFO:tasks.workunit.client.0.smithi097.stderr: -230> 2024-09-14T11:07:24.453+0000 7fbbdef73800 10 monclient: _reopen_session rank -1 2024-09-14T11:07:24.749 INFO:tasks.workunit.client.0.smithi097.stderr: -229> 2024-09-14T11:07:24.453+0000 7fbbdef73800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:07:24.749 INFO:tasks.workunit.client.0.smithi097.stderr: -228> 2024-09-14T11:07:24.453+0000 7fbbdef73800 10 monclient(hunting): picked mon.noname-a con 0x558d9d87fd70 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:07:24.750 INFO:tasks.workunit.client.0.smithi097.stderr: -227> 2024-09-14T11:07:24.453+0000 7fbbdef73800 10 monclient(hunting): picked mon.noname-c con 0x558d9d8aa240 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:07:24.750 INFO:tasks.workunit.client.0.smithi097.stderr: -226> 2024-09-14T11:07:24.453+0000 7fbbdef73800 10 monclient(hunting): picked mon.noname-b con 0x558d9d8aed60 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:07:24.750 INFO:tasks.workunit.client.0.smithi097.stderr: -225> 2024-09-14T11:07:24.453+0000 7fbbdef73800 10 monclient(hunting): start opening mon connection 2024-09-14T11:07:24.750 INFO:tasks.workunit.client.0.smithi097.stderr: -224> 2024-09-14T11:07:24.453+0000 7fbbdef73800 10 monclient(hunting): start opening mon connection 2024-09-14T11:07:24.750 INFO:tasks.workunit.client.0.smithi097.stderr: -223> 2024-09-14T11:07:24.453+0000 7fbbdef73800 10 monclient(hunting): start opening mon connection 2024-09-14T11:07:24.750 INFO:tasks.workunit.client.0.smithi097.stderr: -222> 2024-09-14T11:07:24.453+0000 7fbbdef73800 10 monclient(hunting): _renew_subs 2024-09-14T11:07:24.750 INFO:tasks.workunit.client.0.smithi097.stderr: -221> 2024-09-14T11:07:24.453+0000 7fbbdef73800 10 monclient(hunting): authenticate will time out at 2126.107651s 2024-09-14T11:07:24.750 INFO:tasks.workunit.client.0.smithi097.stderr: -220> 2024-09-14T11:07:24.453+0000 7fbbdd25e640 10 monclient(hunting): get_auth_request con 0x558d9d8aa240 auth_method 0 2024-09-14T11:07:24.750 INFO:tasks.workunit.client.0.smithi097.stderr: -219> 2024-09-14T11:07:24.453+0000 7fbbdd25e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:07:24.750 INFO:tasks.workunit.client.0.smithi097.stderr: -218> 2024-09-14T11:07:24.453+0000 7fbbdd25e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:07:24.750 INFO:tasks.workunit.client.0.smithi097.stderr: -217> 2024-09-14T11:07:24.453+0000 7fbbdd25e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:07:24.750 INFO:tasks.workunit.client.0.smithi097.stderr: -216> 2024-09-14T11:07:24.453+0000 7fbbdc25c640 10 monclient(hunting): get_auth_request con 0x558d9d87fd70 auth_method 0 2024-09-14T11:07:24.750 INFO:tasks.workunit.client.0.smithi097.stderr: -215> 2024-09-14T11:07:24.453+0000 7fbbdc25c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:07:24.750 INFO:tasks.workunit.client.0.smithi097.stderr: -214> 2024-09-14T11:07:24.453+0000 7fbbdc25c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:07:24.750 INFO:tasks.workunit.client.0.smithi097.stderr: -213> 2024-09-14T11:07:24.453+0000 7fbbdc25c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:07:24.751 INFO:tasks.workunit.client.0.smithi097.stderr: -212> 2024-09-14T11:07:24.453+0000 7fbbdca5d640 10 monclient(hunting): get_auth_request con 0x558d9d8aed60 auth_method 0 2024-09-14T11:07:24.751 INFO:tasks.workunit.client.0.smithi097.stderr: -211> 2024-09-14T11:07:24.453+0000 7fbbdca5d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:07:24.751 INFO:tasks.workunit.client.0.smithi097.stderr: -210> 2024-09-14T11:07:24.453+0000 7fbbdca5d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:07:24.751 INFO:tasks.workunit.client.0.smithi097.stderr: -209> 2024-09-14T11:07:24.453+0000 7fbbdca5d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:07:24.751 INFO:tasks.workunit.client.0.smithi097.stderr: -208> 2024-09-14T11:07:24.453+0000 7fbbdd25e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:07:24.751 INFO:tasks.workunit.client.0.smithi097.stderr: -207> 2024-09-14T11:07:24.453+0000 7fbbdd25e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:07:24.751 INFO:tasks.workunit.client.0.smithi097.stderr: -206> 2024-09-14T11:07:24.453+0000 7fbbdd25e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:07:24.751 INFO:tasks.workunit.client.0.smithi097.stderr: -205> 2024-09-14T11:07:24.453+0000 7fbbdc25c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:07:24.751 INFO:tasks.workunit.client.0.smithi097.stderr: -204> 2024-09-14T11:07:24.453+0000 7fbbdc25c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:07:24.751 INFO:tasks.workunit.client.0.smithi097.stderr: -203> 2024-09-14T11:07:24.453+0000 7fbbdc25c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:07:24.751 INFO:tasks.workunit.client.0.smithi097.stderr: -202> 2024-09-14T11:07:24.453+0000 7fbbdca5d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:07:24.751 INFO:tasks.workunit.client.0.smithi097.stderr: -201> 2024-09-14T11:07:24.453+0000 7fbbdca5d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:07:24.751 INFO:tasks.workunit.client.0.smithi097.stderr: -200> 2024-09-14T11:07:24.453+0000 7fbbdca5d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:07:24.752 INFO:tasks.workunit.client.0.smithi097.stderr: -199> 2024-09-14T11:07:24.453+0000 7fbbdc25c640 10 monclient(hunting): handle_auth_done global_id 8160 payload 824 2024-09-14T11:07:24.752 INFO:tasks.workunit.client.0.smithi097.stderr: -198> 2024-09-14T11:07:24.453+0000 7fbbdc25c640 10 monclient: _finish_hunting 0 2024-09-14T11:07:24.752 INFO:tasks.workunit.client.0.smithi097.stderr: -197> 2024-09-14T11:07:24.453+0000 7fbbdc25c640 1 monclient: found mon.noname-a 2024-09-14T11:07:24.752 INFO:tasks.workunit.client.0.smithi097.stderr: -196> 2024-09-14T11:07:24.453+0000 7fbbdc25c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-14T11:07:24.752 INFO:tasks.workunit.client.0.smithi097.stderr: -195> 2024-09-14T11:07:24.454+0000 7fbab27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:07:24.752 INFO:tasks.workunit.client.0.smithi097.stderr: -194> 2024-09-14T11:07:24.454+0000 7fbab27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:07:24.752 INFO:tasks.workunit.client.0.smithi097.stderr: -193> 2024-09-14T11:07:24.454+0000 7fbab27fc640 10 monclient: dump: 2024-09-14T11:07:24.752 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:07:24.752 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:07:24.752 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:24.752 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:24.752 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:07:24.752 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:07:24.752 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:07:24.753 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:07:24.753 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:07:24.753 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:24.753 INFO:tasks.workunit.client.0.smithi097.stderr: -192> 2024-09-14T11:07:24.454+0000 7fbab27fc640 10 monclient: _finish_auth 0 2024-09-14T11:07:24.753 INFO:tasks.workunit.client.0.smithi097.stderr: -191> 2024-09-14T11:07:24.454+0000 7fbab27fc640 10 monclient: _check_auth_tickets 2024-09-14T11:07:24.753 INFO:tasks.workunit.client.0.smithi097.stderr: -190> 2024-09-14T11:07:24.454+0000 7fbab27fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:07:24.753 INFO:tasks.workunit.client.0.smithi097.stderr: -189> 2024-09-14T11:07:24.454+0000 7fbab27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:07:24.753 INFO:tasks.workunit.client.0.smithi097.stderr: -188> 2024-09-14T11:07:24.454+0000 7fbab27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:07:24.753 INFO:tasks.workunit.client.0.smithi097.stderr: -187> 2024-09-14T11:07:24.454+0000 7fbab27fc640 10 monclient: dump: 2024-09-14T11:07:24.753 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:07:24.753 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:07:24.753 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:24.753 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:24.753 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:07:24.754 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:07:24.754 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:07:24.754 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:07:24.754 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:07:24.754 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:24.754 INFO:tasks.workunit.client.0.smithi097.stderr: -186> 2024-09-14T11:07:24.454+0000 7fbbdef73800 5 monclient: authenticate success, global_id 8160 2024-09-14T11:07:24.754 INFO:tasks.workunit.client.0.smithi097.stderr: -185> 2024-09-14T11:07:24.454+0000 7fbab3fff640 4 set_mon_vals no callback set 2024-09-14T11:07:24.754 INFO:tasks.workunit.client.0.smithi097.stderr: -184> 2024-09-14T11:07:24.454+0000 7fbbdef73800 10 monclient: _renew_subs 2024-09-14T11:07:24.754 INFO:tasks.workunit.client.0.smithi097.stderr: -183> 2024-09-14T11:07:24.454+0000 7fbbdef73800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:07:24.754 INFO:tasks.workunit.client.0.smithi097.stderr: -182> 2024-09-14T11:07:24.454+0000 7fbbdef73800 10 monclient: _renew_subs 2024-09-14T11:07:24.754 INFO:tasks.workunit.client.0.smithi097.stderr: -181> 2024-09-14T11:07:24.454+0000 7fbbdef73800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:07:24.754 INFO:tasks.workunit.client.0.smithi097.stderr: -180> 2024-09-14T11:07:24.454+0000 7fbbdef73800 1 librados: init done 2024-09-14T11:07:24.754 INFO:tasks.workunit.client.0.smithi097.stderr: -179> 2024-09-14T11:07:24.454+0000 7fbbdef73800 5 asok(0x558d9d5bb270) register_command cr dump hook 0x558d9d8a8358 2024-09-14T11:07:24.754 INFO:tasks.workunit.client.0.smithi097.stderr: -178> 2024-09-14T11:07:24.456+0000 7fbbdef73800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.755 INFO:tasks.workunit.client.0.smithi097.stderr: -177> 2024-09-14T11:07:24.456+0000 7fbab27fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:07:24.755 INFO:tasks.workunit.client.0.smithi097.stderr: -176> 2024-09-14T11:07:24.456+0000 7fbab27fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:07:24.755 INFO:tasks.workunit.client.0.smithi097.stderr: -175> 2024-09-14T11:07:24.456+0000 7fbab27fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:07:24.755 INFO:tasks.workunit.client.0.smithi097.stderr: -174> 2024-09-14T11:07:24.456+0000 7fbbdd25e640 10 monclient: get_auth_request con 0x7fbaa8077230 auth_method 0 2024-09-14T11:07:24.755 INFO:tasks.workunit.client.0.smithi097.stderr: -173> 2024-09-14T11:07:24.457+0000 7fbbdca5d640 10 monclient: get_auth_request con 0x558d9d8c8ad0 auth_method 0 2024-09-14T11:07:24.755 INFO:tasks.workunit.client.0.smithi097.stderr: -172> 2024-09-14T11:07:24.457+0000 7fbbdef73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:24.755 INFO:tasks.workunit.client.0.smithi097.stderr: -171> 2024-09-14T11:07:24.457+0000 7fbbdef73800 20 realm 2024-09-14T11:07:24.755 INFO:tasks.workunit.client.0.smithi097.stderr: -170> 2024-09-14T11:07:24.457+0000 7fbbdef73800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.755 INFO:tasks.workunit.client.0.smithi097.stderr: -169> 2024-09-14T11:07:24.458+0000 7fbbdef73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:24.755 INFO:tasks.workunit.client.0.smithi097.stderr: -168> 2024-09-14T11:07:24.458+0000 7fbbdef73800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:07:24.755 INFO:tasks.workunit.client.0.smithi097.stderr: -167> 2024-09-14T11:07:24.458+0000 7fbbdef73800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.755 INFO:tasks.workunit.client.0.smithi097.stderr: -166> 2024-09-14T11:07:24.458+0000 7fbbdef73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:24.755 INFO:tasks.workunit.client.0.smithi097.stderr: -165> 2024-09-14T11:07:24.458+0000 7fbbdef73800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.756 INFO:tasks.workunit.client.0.smithi097.stderr: -164> 2024-09-14T11:07:24.458+0000 7fbbdc25c640 10 monclient: get_auth_request con 0x558d9d8cccd0 auth_method 0 2024-09-14T11:07:24.756 INFO:tasks.workunit.client.0.smithi097.stderr: -163> 2024-09-14T11:07:24.458+0000 7fbbdef73800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:07:24.756 INFO:tasks.workunit.client.0.smithi097.stderr: -162> 2024-09-14T11:07:24.459+0000 7fbbdef73800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.756 INFO:tasks.workunit.client.0.smithi097.stderr: -161> 2024-09-14T11:07:24.459+0000 7fbbdd25e640 10 monclient: get_auth_request con 0x558d9d8d0530 auth_method 0 2024-09-14T11:07:24.756 INFO:tasks.workunit.client.0.smithi097.stderr: -160> 2024-09-14T11:07:24.459+0000 7fbbdef73800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:07:24.756 INFO:tasks.workunit.client.0.smithi097.stderr: -159> 2024-09-14T11:07:24.459+0000 7fbbdef73800 20 searching for the correct realm 2024-09-14T11:07:24.756 INFO:tasks.workunit.client.0.smithi097.stderr: -158> 2024-09-14T11:07:24.460+0000 7fbbdca5d640 10 monclient: get_auth_request con 0x558d9d8d52f0 auth_method 0 2024-09-14T11:07:24.756 INFO:tasks.workunit.client.0.smithi097.stderr: -157> 2024-09-14T11:07:24.460+0000 7fbbdc25c640 10 monclient: get_auth_request con 0x7fbbcc018070 auth_method 0 2024-09-14T11:07:24.756 INFO:tasks.workunit.client.0.smithi097.stderr: -156> 2024-09-14T11:07:24.461+0000 7fbbdc25c640 0 -- 172.21.15.97:0/3149427196 >> [v2:172.21.15.97:6816/4093696477,v1:172.21.15.97:6817/4093696477] conn(0x558d9d8cccd0 msgr2=0x558d9d8cf100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:07:24.756 INFO:tasks.workunit.client.0.smithi097.stderr: -155> 2024-09-14T11:07:24.461+0000 7fbab27fc640 1 client.8160.objecter ms_handle_reset 0x558d9d8cccd0 session 0x558d9d8cc650 osd.1 2024-09-14T11:07:24.756 INFO:tasks.workunit.client.0.smithi097.stderr: -154> 2024-09-14T11:07:24.461+0000 7fbab27fc640 10 monclient: _renew_subs 2024-09-14T11:07:24.756 INFO:tasks.workunit.client.0.smithi097.stderr: -153> 2024-09-14T11:07:24.461+0000 7fbab27fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:07:24.756 INFO:tasks.workunit.client.0.smithi097.stderr: -152> 2024-09-14T11:07:24.461+0000 7fbbdd25e640 10 monclient: get_auth_request con 0x7fbbc4032060 auth_method 0 2024-09-14T11:07:24.756 INFO:tasks.workunit.client.0.smithi097.stderr: -151> 2024-09-14T11:07:24.462+0000 7fbbdc25c640 10 monclient: get_auth_request con 0x7fbaa8086d50 auth_method 0 2024-09-14T11:07:24.756 INFO:tasks.workunit.client.0.smithi097.stderr: -150> 2024-09-14T11:07:24.464+0000 7fbbdca5d640 10 monclient: get_auth_request con 0x7fbbc407ad30 auth_method 0 2024-09-14T11:07:24.757 INFO:tasks.workunit.client.0.smithi097.stderr: -149> 2024-09-14T11:07:24.464+0000 7fbbdc25c640 0 -- 172.21.15.97:0/3149427196 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7fbbcc0333f0 msgr2=0x7fbbcc033850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:07:24.757 INFO:tasks.workunit.client.0.smithi097.stderr: -148> 2024-09-14T11:07:24.666+0000 7fbbdc25c640 10 monclient: get_auth_request con 0x7fbbcc0333f0 auth_method 0 2024-09-14T11:07:24.757 INFO:tasks.workunit.client.0.smithi097.stderr: -147> 2024-09-14T11:07:24.670+0000 7fbbdef73800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:07:24.757 INFO:tasks.workunit.client.0.smithi097.stderr: -146> 2024-09-14T11:07:24.670+0000 7fbbdef73800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:07:24.757 INFO:tasks.workunit.client.0.smithi097.stderr: -145> 2024-09-14T11:07:24.670+0000 7fbbdef73800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:07:24.757 INFO:tasks.workunit.client.0.smithi097.stderr: -144> 2024-09-14T11:07:24.670+0000 7fbbdef73800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:07:24.757 INFO:tasks.workunit.client.0.smithi097.stderr: -143> 2024-09-14T11:07:24.670+0000 7fbbdef73800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:07:24.757 INFO:tasks.workunit.client.0.smithi097.stderr: -142> 2024-09-14T11:07:24.670+0000 7fbbdef73800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:07:24.757 INFO:tasks.workunit.client.0.smithi097.stderr: -141> 2024-09-14T11:07:24.670+0000 7fbbdef73800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.757 INFO:tasks.workunit.client.0.smithi097.stderr: -140> 2024-09-14T11:07:24.671+0000 7fbbdef73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:24.757 INFO:tasks.workunit.client.0.smithi097.stderr: -139> 2024-09-14T11:07:24.671+0000 7fbbdef73800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.757 INFO:tasks.workunit.client.0.smithi097.stderr: -138> 2024-09-14T11:07:24.671+0000 7fbbdef73800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:07:24.757 INFO:tasks.workunit.client.0.smithi097.stderr: -137> 2024-09-14T11:07:24.671+0000 7fbbdef73800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.757 INFO:tasks.workunit.client.0.smithi097.stderr: -136> 2024-09-14T11:07:24.671+0000 7fbbdef73800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:07:24.758 INFO:tasks.workunit.client.0.smithi097.stderr: -135> 2024-09-14T11:07:24.671+0000 7fbbdef73800 20 zone default found 2024-09-14T11:07:24.758 INFO:tasks.workunit.client.0.smithi097.stderr: -134> 2024-09-14T11:07:24.671+0000 7fbbdef73800 4 Realm: () 2024-09-14T11:07:24.758 INFO:tasks.workunit.client.0.smithi097.stderr: -133> 2024-09-14T11:07:24.671+0000 7fbbdef73800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:07:24.758 INFO:tasks.workunit.client.0.smithi097.stderr: -132> 2024-09-14T11:07:24.671+0000 7fbbdef73800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:07:24.758 INFO:tasks.workunit.client.0.smithi097.stderr: -131> 2024-09-14T11:07:24.671+0000 7fbbdef73800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:07:24.758 INFO:tasks.workunit.client.0.smithi097.stderr: -130> 2024-09-14T11:07:24.671+0000 7fbbdef73800 20 zonegroup default 2024-09-14T11:07:24.758 INFO:tasks.workunit.client.0.smithi097.stderr: -129> 2024-09-14T11:07:24.671+0000 7fbbdef73800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.758 INFO:tasks.workunit.client.0.smithi097.stderr: -128> 2024-09-14T11:07:24.671+0000 7fbbdef73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:24.758 INFO:tasks.workunit.client.0.smithi097.stderr: -127> 2024-09-14T11:07:24.671+0000 7fbbdef73800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.758 INFO:tasks.workunit.client.0.smithi097.stderr: -126> 2024-09-14T11:07:24.672+0000 7fbbdef73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:24.758 INFO:tasks.workunit.client.0.smithi097.stderr: -125> 2024-09-14T11:07:24.672+0000 7fbbdef73800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.758 INFO:tasks.workunit.client.0.smithi097.stderr: -124> 2024-09-14T11:07:24.672+0000 7fbbdef73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:24.758 INFO:tasks.workunit.client.0.smithi097.stderr: -123> 2024-09-14T11:07:24.672+0000 7fbbdef73800 20 started sync module instance, tier type = 2024-09-14T11:07:24.758 INFO:tasks.workunit.client.0.smithi097.stderr: -122> 2024-09-14T11:07:24.672+0000 7fbbdef73800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:07:24.759 INFO:tasks.workunit.client.0.smithi097.stderr: -121> 2024-09-14T11:07:24.680+0000 7fbbdef73800 20 add_watcher() i=0 2024-09-14T11:07:24.759 INFO:tasks.workunit.client.0.smithi097.stderr: -120> 2024-09-14T11:07:24.680+0000 7fbbdef73800 20 add_watcher() i=1 2024-09-14T11:07:24.759 INFO:tasks.workunit.client.0.smithi097.stderr: -119> 2024-09-14T11:07:24.680+0000 7fbbdef73800 20 add_watcher() i=2 2024-09-14T11:07:24.759 INFO:tasks.workunit.client.0.smithi097.stderr: -118> 2024-09-14T11:07:24.680+0000 7fbbdef73800 20 add_watcher() i=3 2024-09-14T11:07:24.759 INFO:tasks.workunit.client.0.smithi097.stderr: -117> 2024-09-14T11:07:24.680+0000 7fbbdef73800 20 add_watcher() i=4 2024-09-14T11:07:24.759 INFO:tasks.workunit.client.0.smithi097.stderr: -116> 2024-09-14T11:07:24.680+0000 7fbbdef73800 20 add_watcher() i=5 2024-09-14T11:07:24.759 INFO:tasks.workunit.client.0.smithi097.stderr: -115> 2024-09-14T11:07:24.680+0000 7fbbdef73800 20 add_watcher() i=6 2024-09-14T11:07:24.759 INFO:tasks.workunit.client.0.smithi097.stderr: -114> 2024-09-14T11:07:24.681+0000 7fbbdef73800 20 add_watcher() i=7 2024-09-14T11:07:24.759 INFO:tasks.workunit.client.0.smithi097.stderr: -113> 2024-09-14T11:07:24.681+0000 7fbbdef73800 2 all 8 watchers are set, enabling cache 2024-09-14T11:07:24.759 INFO:tasks.workunit.client.0.smithi097.stderr: -112> 2024-09-14T11:07:24.683+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5ed90) adding auth protocol: cephx 2024-09-14T11:07:24.759 INFO:tasks.workunit.client.0.smithi097.stderr: -111> 2024-09-14T11:07:24.683+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5ed90) adding auth protocol: cephx 2024-09-14T11:07:24.759 INFO:tasks.workunit.client.0.smithi097.stderr: -110> 2024-09-14T11:07:24.683+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5ed90) adding auth protocol: cephx 2024-09-14T11:07:24.759 INFO:tasks.workunit.client.0.smithi097.stderr: -109> 2024-09-14T11:07:24.683+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5ed90) adding con mode: secure 2024-09-14T11:07:24.759 INFO:tasks.workunit.client.0.smithi097.stderr: -108> 2024-09-14T11:07:24.683+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5ed90) adding con mode: crc 2024-09-14T11:07:24.760 INFO:tasks.workunit.client.0.smithi097.stderr: -107> 2024-09-14T11:07:24.683+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5ed90) adding con mode: secure 2024-09-14T11:07:24.760 INFO:tasks.workunit.client.0.smithi097.stderr: -106> 2024-09-14T11:07:24.683+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5ed90) adding con mode: crc 2024-09-14T11:07:24.760 INFO:tasks.workunit.client.0.smithi097.stderr: -105> 2024-09-14T11:07:24.683+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5ed90) adding con mode: secure 2024-09-14T11:07:24.760 INFO:tasks.workunit.client.0.smithi097.stderr: -104> 2024-09-14T11:07:24.683+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5ed90) adding con mode: crc 2024-09-14T11:07:24.760 INFO:tasks.workunit.client.0.smithi097.stderr: -103> 2024-09-14T11:07:24.683+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5ed90) adding con mode: crc 2024-09-14T11:07:24.760 INFO:tasks.workunit.client.0.smithi097.stderr: -102> 2024-09-14T11:07:24.683+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5ed90) adding con mode: secure 2024-09-14T11:07:24.760 INFO:tasks.workunit.client.0.smithi097.stderr: -101> 2024-09-14T11:07:24.683+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5ed90) adding con mode: crc 2024-09-14T11:07:24.760 INFO:tasks.workunit.client.0.smithi097.stderr: -100> 2024-09-14T11:07:24.683+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5ed90) adding con mode: secure 2024-09-14T11:07:24.760 INFO:tasks.workunit.client.0.smithi097.stderr: -99> 2024-09-14T11:07:24.683+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5ed90) adding con mode: crc 2024-09-14T11:07:24.760 INFO:tasks.workunit.client.0.smithi097.stderr: -98> 2024-09-14T11:07:24.683+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5ed90) adding con mode: secure 2024-09-14T11:07:24.760 INFO:tasks.workunit.client.0.smithi097.stderr: -97> 2024-09-14T11:07:24.683+0000 7fba92fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:07:24.760 INFO:tasks.workunit.client.0.smithi097.stderr: -96> 2024-09-14T11:07:24.683+0000 7fbbdef73800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:07:24.760 INFO:tasks.workunit.client.0.smithi097.stderr: -95> 2024-09-14T11:07:24.683+0000 7fbbdef73800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:07:24.760 INFO:tasks.workunit.client.0.smithi097.stderr: -94> 2024-09-14T11:07:24.683+0000 7fbbdef73800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:07:24.761 INFO:tasks.workunit.client.0.smithi097.stderr: -93> 2024-09-14T11:07:24.683+0000 7fbbdef73800 5 asok(0x558d9d5bb270) register_command cache list hook 0x558d9d8a5460 2024-09-14T11:07:24.761 INFO:tasks.workunit.client.0.smithi097.stderr: -92> 2024-09-14T11:07:24.683+0000 7fbbdef73800 5 asok(0x558d9d5bb270) register_command cache inspect hook 0x558d9d8a5460 2024-09-14T11:07:24.761 INFO:tasks.workunit.client.0.smithi097.stderr: -91> 2024-09-14T11:07:24.683+0000 7fbbdef73800 5 asok(0x558d9d5bb270) register_command cache erase hook 0x558d9d8a5460 2024-09-14T11:07:24.761 INFO:tasks.workunit.client.0.smithi097.stderr: -90> 2024-09-14T11:07:24.683+0000 7fbbdef73800 5 asok(0x558d9d5bb270) register_command cache zap hook 0x558d9d8a5460 2024-09-14T11:07:24.761 INFO:tasks.workunit.client.0.smithi097.stderr: -89> 2024-09-14T11:07:24.683+0000 7fbbdef73800 5 note: GC not initialized 2024-09-14T11:07:24.761 INFO:tasks.workunit.client.0.smithi097.stderr: -88> 2024-09-14T11:07:24.683+0000 7fba91fe3640 20 reqs_thread_entry: start 2024-09-14T11:07:24.761 INFO:tasks.workunit.client.0.smithi097.stderr: -87> 2024-09-14T11:07:24.684+0000 7fbbdef73800 5 asok(0x558d9d5bb270) register_command sync trace show hook 0x7fbbcc00a900 2024-09-14T11:07:24.761 INFO:tasks.workunit.client.0.smithi097.stderr: -86> 2024-09-14T11:07:24.684+0000 7fbbdef73800 5 asok(0x558d9d5bb270) register_command sync trace history hook 0x7fbbcc00a900 2024-09-14T11:07:24.761 INFO:tasks.workunit.client.0.smithi097.stderr: -85> 2024-09-14T11:07:24.684+0000 7fbbdef73800 5 asok(0x558d9d5bb270) register_command sync trace active hook 0x7fbbcc00a900 2024-09-14T11:07:24.761 INFO:tasks.workunit.client.0.smithi097.stderr: -84> 2024-09-14T11:07:24.684+0000 7fbbdef73800 5 asok(0x558d9d5bb270) register_command sync trace active_short hook 0x7fbbcc00a900 2024-09-14T11:07:24.761 INFO:tasks.workunit.client.0.smithi097.stderr: -83> 2024-09-14T11:07:24.684+0000 7fbbdef73800 20 init_complete bucket index max shards: 11 2024-09-14T11:07:24.761 INFO:tasks.workunit.client.0.smithi097.stderr: -82> 2024-09-14T11:07:24.684+0000 7fbbdef73800 20 Filter name: none 2024-09-14T11:07:24.761 INFO:tasks.workunit.client.0.smithi097.stderr: -81> 2024-09-14T11:07:24.684+0000 7fba037fe640 20 reqs_thread_entry: start 2024-09-14T11:07:24.762 INFO:tasks.workunit.client.0.smithi097.stderr: -80> 2024-09-14T11:07:24.684+0000 7fbbdef73800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:07:24.762 INFO:tasks.workunit.client.0.smithi097.stderr: -79> 2024-09-14T11:07:24.684+0000 7fbbdef73800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.762 INFO:tasks.workunit.client.0.smithi097.stderr: -78> 2024-09-14T11:07:24.684+0000 7fbbdef73800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:07:24.762 INFO:tasks.workunit.client.0.smithi097.stderr: -77> 2024-09-14T11:07:24.684+0000 7fbbdef73800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:07:24.762 INFO:tasks.workunit.client.0.smithi097.stderr: -76> 2024-09-14T11:07:24.684+0000 7fbbdef73800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:07:24.762 INFO:tasks.workunit.client.0.smithi097.stderr: -75> 2024-09-14T11:07:24.684+0000 7fbbdef73800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 : miss 2024-09-14T11:07:24.762 INFO:tasks.workunit.client.0.smithi097.stderr: -74> 2024-09-14T11:07:24.684+0000 7fbbdef73800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.762 INFO:tasks.workunit.client.0.smithi097.stderr: -73> 2024-09-14T11:07:24.685+0000 7fbbdef73800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:07:24.762 INFO:tasks.workunit.client.0.smithi097.stderr: -72> 2024-09-14T11:07:24.685+0000 7fbbdef73800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:07:24.762 INFO:tasks.workunit.client.0.smithi097.stderr: -71> 2024-09-14T11:07:24.685+0000 7fbbdef73800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:07:24.762 INFO:tasks.workunit.client.0.smithi097.stderr: -70> 2024-09-14T11:07:24.685+0000 7fbbdef73800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:07:24.762 INFO:tasks.workunit.client.0.smithi097.stderr: -69> 2024-09-14T11:07:24.685+0000 7fbbdef73800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:07:24.762 INFO:tasks.workunit.client.0.smithi097.stderr: -68> 2024-09-14T11:07:24.685+0000 7fbbdef73800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 2024-09-14T11:07:24.763 INFO:tasks.workunit.client.0.smithi097.stderr: -67> 2024-09-14T11:07:24.690+0000 7fbbdef73800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:07:24.763 INFO:tasks.workunit.client.0.smithi097.stderr: -66> 2024-09-14T11:07:24.690+0000 7fbbdef73800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:07:24.763 INFO:tasks.workunit.client.0.smithi097.stderr: -65> 2024-09-14T11:07:24.690+0000 7fbbdef73800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:07:24.763 INFO:tasks.workunit.client.0.smithi097.stderr: -64> 2024-09-14T11:07:24.690+0000 7fbbdef73800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17, ofs0, ns] 2024-09-14T11:07:24.763 INFO:tasks.workunit.client.0.smithi097.stderr: -63> 2024-09-14T11:07:24.690+0000 7fbab3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595243 cookie 94066722056800 notifier 8160 bl.length()=827 2024-09-14T11:07:24.763 INFO:tasks.workunit.client.0.smithi097.stderr: -62> 2024-09-14T11:07:24.690+0000 7fbab3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:07:24.763 INFO:tasks.workunit.client.0.smithi097.stderr: -61> 2024-09-14T11:07:24.690+0000 7fbab3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:07:24.763 INFO:tasks.workunit.client.0.smithi097.stderr: -60> 2024-09-14T11:07:24.690+0000 7fbab3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:07:24.763 INFO:tasks.workunit.client.0.smithi097.stderr: -59> 2024-09-14T11:07:24.691+0000 7fbbdef73800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): orig_sources= new_sources= 2024-09-14T11:07:24.763 INFO:tasks.workunit.client.0.smithi097.stderr: -58> 2024-09-14T11:07:24.691+0000 7fbbdef73800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): potential sources added=[] removed=[] 2024-09-14T11:07:24.763 INFO:tasks.workunit.client.0.smithi097.stderr: -57> 2024-09-14T11:07:24.691+0000 7fbbdef73800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): orig_dests= new_dests= 2024-09-14T11:07:24.763 INFO:tasks.workunit.client.0.smithi097.stderr: -56> 2024-09-14T11:07:24.691+0000 7fbbdef73800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): potential dests added=[] removed=[] 2024-09-14T11:07:24.763 INFO:tasks.workunit.client.0.smithi097.stderr: -55> 2024-09-14T11:07:24.695+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.0 2024-09-14T11:07:24.763 INFO:tasks.workunit.client.0.smithi097.stderr: -54> 2024-09-14T11:07:24.695+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.0 2024-09-14T11:07:24.764 INFO:tasks.workunit.client.0.smithi097.stderr: -53> 2024-09-14T11:07:24.695+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.1 2024-09-14T11:07:24.764 INFO:tasks.workunit.client.0.smithi097.stderr: -52> 2024-09-14T11:07:24.695+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.1 2024-09-14T11:07:24.764 INFO:tasks.workunit.client.0.smithi097.stderr: -51> 2024-09-14T11:07:24.695+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.2 2024-09-14T11:07:24.764 INFO:tasks.workunit.client.0.smithi097.stderr: -50> 2024-09-14T11:07:24.695+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.2 2024-09-14T11:07:24.764 INFO:tasks.workunit.client.0.smithi097.stderr: -49> 2024-09-14T11:07:24.695+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.3 2024-09-14T11:07:24.764 INFO:tasks.workunit.client.0.smithi097.stderr: -48> 2024-09-14T11:07:24.695+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.3 2024-09-14T11:07:24.764 INFO:tasks.workunit.client.0.smithi097.stderr: -47> 2024-09-14T11:07:24.695+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.4 2024-09-14T11:07:24.764 INFO:tasks.workunit.client.0.smithi097.stderr: -46> 2024-09-14T11:07:24.695+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.4 2024-09-14T11:07:24.764 INFO:tasks.workunit.client.0.smithi097.stderr: -45> 2024-09-14T11:07:24.695+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.5 2024-09-14T11:07:24.764 INFO:tasks.workunit.client.0.smithi097.stderr: -44> 2024-09-14T11:07:24.695+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.5 2024-09-14T11:07:24.764 INFO:tasks.workunit.client.0.smithi097.stderr: -43> 2024-09-14T11:07:24.695+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.6 2024-09-14T11:07:24.764 INFO:tasks.workunit.client.0.smithi097.stderr: -42> 2024-09-14T11:07:24.695+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.6 2024-09-14T11:07:24.764 INFO:tasks.workunit.client.0.smithi097.stderr: -41> 2024-09-14T11:07:24.695+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.7 2024-09-14T11:07:24.764 INFO:tasks.workunit.client.0.smithi097.stderr: -40> 2024-09-14T11:07:24.695+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.7 2024-09-14T11:07:24.765 INFO:tasks.workunit.client.0.smithi097.stderr: -39> 2024-09-14T11:07:24.695+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.8 2024-09-14T11:07:24.765 INFO:tasks.workunit.client.0.smithi097.stderr: -38> 2024-09-14T11:07:24.695+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.8 2024-09-14T11:07:24.765 INFO:tasks.workunit.client.0.smithi097.stderr: -37> 2024-09-14T11:07:24.695+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.9 2024-09-14T11:07:24.765 INFO:tasks.workunit.client.0.smithi097.stderr: -36> 2024-09-14T11:07:24.695+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.9 2024-09-14T11:07:24.765 INFO:tasks.workunit.client.0.smithi097.stderr: -35> 2024-09-14T11:07:24.695+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.10 2024-09-14T11:07:24.765 INFO:tasks.workunit.client.0.smithi097.stderr: -34> 2024-09-14T11:07:24.695+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.10 2024-09-14T11:07:24.765 INFO:tasks.workunit.client.0.smithi097.stderr: -33> 2024-09-14T11:07:24.695+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.11 2024-09-14T11:07:24.765 INFO:tasks.workunit.client.0.smithi097.stderr: -32> 2024-09-14T11:07:24.695+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.11 2024-09-14T11:07:24.765 INFO:tasks.workunit.client.0.smithi097.stderr: -31> 2024-09-14T11:07:24.695+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.12 2024-09-14T11:07:24.765 INFO:tasks.workunit.client.0.smithi097.stderr: -30> 2024-09-14T11:07:24.695+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.12 2024-09-14T11:07:24.765 INFO:tasks.workunit.client.0.smithi097.stderr: -29> 2024-09-14T11:07:24.695+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.13 2024-09-14T11:07:24.765 INFO:tasks.workunit.client.0.smithi097.stderr: -28> 2024-09-14T11:07:24.695+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.13 2024-09-14T11:07:24.765 INFO:tasks.workunit.client.0.smithi097.stderr: -27> 2024-09-14T11:07:24.695+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.0 2024-09-14T11:07:24.766 INFO:tasks.workunit.client.0.smithi097.stderr: -26> 2024-09-14T11:07:24.695+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.0 2024-09-14T11:07:24.766 INFO:tasks.workunit.client.0.smithi097.stderr: -25> 2024-09-14T11:07:24.696+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.1 2024-09-14T11:07:24.766 INFO:tasks.workunit.client.0.smithi097.stderr: -24> 2024-09-14T11:07:24.696+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.1 2024-09-14T11:07:24.766 INFO:tasks.workunit.client.0.smithi097.stderr: -23> 2024-09-14T11:07:24.696+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.2 2024-09-14T11:07:24.766 INFO:tasks.workunit.client.0.smithi097.stderr: -22> 2024-09-14T11:07:24.696+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.2 2024-09-14T11:07:24.766 INFO:tasks.workunit.client.0.smithi097.stderr: -21> 2024-09-14T11:07:24.696+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.3 2024-09-14T11:07:24.766 INFO:tasks.workunit.client.0.smithi097.stderr: -20> 2024-09-14T11:07:24.696+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.3 2024-09-14T11:07:24.766 INFO:tasks.workunit.client.0.smithi097.stderr: -19> 2024-09-14T11:07:24.697+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.4 2024-09-14T11:07:24.766 INFO:tasks.workunit.client.0.smithi097.stderr: -18> 2024-09-14T11:07:24.697+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.4 2024-09-14T11:07:24.766 INFO:tasks.workunit.client.0.smithi097.stderr: -17> 2024-09-14T11:07:24.697+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.5 2024-09-14T11:07:24.766 INFO:tasks.workunit.client.0.smithi097.stderr: -16> 2024-09-14T11:07:24.697+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.5 2024-09-14T11:07:24.766 INFO:tasks.workunit.client.0.smithi097.stderr: -15> 2024-09-14T11:07:24.698+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.6 2024-09-14T11:07:24.766 INFO:tasks.workunit.client.0.smithi097.stderr: -14> 2024-09-14T11:07:24.698+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.6 2024-09-14T11:07:24.767 INFO:tasks.workunit.client.0.smithi097.stderr: -13> 2024-09-14T11:07:24.698+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.7 2024-09-14T11:07:24.767 INFO:tasks.workunit.client.0.smithi097.stderr: -12> 2024-09-14T11:07:24.698+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.7 2024-09-14T11:07:24.767 INFO:tasks.workunit.client.0.smithi097.stderr: -11> 2024-09-14T11:07:24.699+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.8 2024-09-14T11:07:24.767 INFO:tasks.workunit.client.0.smithi097.stderr: -10> 2024-09-14T11:07:24.699+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.8 2024-09-14T11:07:24.767 INFO:tasks.workunit.client.0.smithi097.stderr: -9> 2024-09-14T11:07:24.699+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.9 2024-09-14T11:07:24.767 INFO:tasks.workunit.client.0.smithi097.stderr: -8> 2024-09-14T11:07:24.699+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.9 2024-09-14T11:07:24.767 INFO:tasks.workunit.client.0.smithi097.stderr: -7> 2024-09-14T11:07:24.700+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.10 2024-09-14T11:07:24.767 INFO:tasks.workunit.client.0.smithi097.stderr: -6> 2024-09-14T11:07:24.700+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.10 2024-09-14T11:07:24.767 INFO:tasks.workunit.client.0.smithi097.stderr: -5> 2024-09-14T11:07:24.700+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.11 2024-09-14T11:07:24.767 INFO:tasks.workunit.client.0.smithi097.stderr: -4> 2024-09-14T11:07:24.700+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.11 2024-09-14T11:07:24.767 INFO:tasks.workunit.client.0.smithi097.stderr: -3> 2024-09-14T11:07:24.701+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.12 2024-09-14T11:07:24.767 INFO:tasks.workunit.client.0.smithi097.stderr: -2> 2024-09-14T11:07:24.701+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.12 2024-09-14T11:07:24.767 INFO:tasks.workunit.client.0.smithi097.stderr: -1> 2024-09-14T11:07:24.704+0000 7fbbdef73800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fbbdef73800 time 2024-09-14T11:07:24.705465+0000 2024-09-14T11:07:24.767 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:07:24.768 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:24.768 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:07:24.768 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fbbe258c76a] 2024-09-14T11:07:24.768 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fbbe258c928] 2024-09-14T11:07:24.768 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558d9c1e50b1] 2024-09-14T11:07:24.768 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x558d9c1f4124] 2024-09-14T11:07:24.768 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x558d9c1f4fc4] 2024-09-14T11:07:24.768 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-14T11:07:24.768 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fbbe1229590] 2024-09-14T11:07:24.768 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-14T11:07:24.768 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-14T11:07:24.768 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:24.768 INFO:tasks.workunit.client.0.smithi097.stderr: 0> 2024-09-14T11:07:24.705+0000 7fbbdef73800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:07:24.769 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7fbbdef73800 thread_name:radosgw-admin 2024-09-14T11:07:24.769 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:24.769 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:07:24.769 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fbbe123e6f0] 2024-09-14T11:07:24.769 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fbbe128b99c] 2024-09-14T11:07:24.769 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-14T11:07:24.769 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-14T11:07:24.769 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fbbe258c7c4] 2024-09-14T11:07:24.769 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fbbe258c928] 2024-09-14T11:07:24.769 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558d9c1e50b1] 2024-09-14T11:07:24.769 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x558d9c1f4124] 2024-09-14T11:07:24.769 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x558d9c1f4fc4] 2024-09-14T11:07:24.769 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-14T11:07:24.770 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fbbe1229590] 2024-09-14T11:07:24.770 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-14T11:07:24.770 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-14T11:07:24.770 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:07:24.770 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:24.770 INFO:tasks.workunit.client.0.smithi097.stderr:--- logging levels --- 2024-09-14T11:07:24.770 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 none 2024-09-14T11:07:24.770 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 lockdep 2024-09-14T11:07:24.770 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 context 2024-09-14T11:07:24.770 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 crush 2024-09-14T11:07:24.770 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds 2024-09-14T11:07:24.770 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_balancer 2024-09-14T11:07:24.770 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_locker 2024-09-14T11:07:24.771 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log 2024-09-14T11:07:24.771 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log_expire 2024-09-14T11:07:24.771 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_migrator 2024-09-14T11:07:24.771 INFO:tasks.workunit.client.0.smithi097.stderr: 3/ 5 mds_quiesce 2024-09-14T11:07:24.771 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 buffer 2024-09-14T11:07:24.771 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 timer 2024-09-14T11:07:24.771 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 filer 2024-09-14T11:07:24.771 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 striper 2024-09-14T11:07:24.771 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 objecter 2024-09-14T11:07:24.771 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rados 2024-09-14T11:07:24.771 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd 2024-09-14T11:07:24.771 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_mirror 2024-09-14T11:07:24.771 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_replay 2024-09-14T11:07:24.771 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_pwl 2024-09-14T11:07:24.772 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 journaler 2024-09-14T11:07:24.772 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objectcacher 2024-09-14T11:07:24.772 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:07:24.772 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 client 2024-09-14T11:07:24.772 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 osd 2024-09-14T11:07:24.772 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 optracker 2024-09-14T11:07:24.772 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objclass 2024-09-14T11:07:24.772 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 filestore 2024-09-14T11:07:24.772 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 journal 2024-09-14T11:07:24.772 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 ms 2024-09-14T11:07:24.772 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mon 2024-09-14T11:07:24.772 INFO:tasks.workunit.client.0.smithi097.stderr: 0/10 monc 2024-09-14T11:07:24.772 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 paxos 2024-09-14T11:07:24.772 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 tp 2024-09-14T11:07:24.773 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 auth 2024-09-14T11:07:24.773 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 crypto 2024-09-14T11:07:24.773 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 finisher 2024-09-14T11:07:24.773 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 reserver 2024-09-14T11:07:24.773 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 heartbeatmap 2024-09-14T11:07:24.773 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 perfcounter 2024-09-14T11:07:24.773 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw 2024-09-14T11:07:24.773 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_sync 2024-09-14T11:07:24.773 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_datacache 2024-09-14T11:07:24.773 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_access 2024-09-14T11:07:24.773 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:07:24.773 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_flight 2024-09-14T11:07:24.773 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:07:24.774 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw_notification 2024-09-14T11:07:24.774 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 javaclient 2024-09-14T11:07:24.774 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 asok 2024-09-14T11:07:24.774 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 throttle 2024-09-14T11:07:24.774 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 refs 2024-09-14T11:07:24.774 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 compressor 2024-09-14T11:07:24.774 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluestore 2024-09-14T11:07:24.774 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluefs 2024-09-14T11:07:24.774 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 bdev 2024-09-14T11:07:24.774 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 kstore 2024-09-14T11:07:24.774 INFO:tasks.workunit.client.0.smithi097.stderr: 4/ 5 rocksdb 2024-09-14T11:07:24.774 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 fuse 2024-09-14T11:07:24.774 INFO:tasks.workunit.client.0.smithi097.stderr: 2/ 5 mgr 2024-09-14T11:07:24.775 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mgrc 2024-09-14T11:07:24.775 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 dpdk 2024-09-14T11:07:24.775 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 eventtrace 2024-09-14T11:07:24.775 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 prioritycache 2024-09-14T11:07:24.775 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 test 2024-09-14T11:07:24.775 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:07:24.775 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephsqlite 2024-09-14T11:07:24.775 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:07:24.775 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore 2024-09-14T11:07:24.775 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_onode 2024-09-14T11:07:24.775 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_odata 2024-09-14T11:07:24.775 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_omap 2024-09-14T11:07:24.775 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_tm 2024-09-14T11:07:24.775 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_t 2024-09-14T11:07:24.775 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:07:24.776 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_epm 2024-09-14T11:07:24.776 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_lba 2024-09-14T11:07:24.776 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:07:24.776 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cache 2024-09-14T11:07:24.776 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_journal 2024-09-14T11:07:24.776 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_device 2024-09-14T11:07:24.776 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_backref 2024-09-14T11:07:24.776 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 alienstore 2024-09-14T11:07:24.776 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mclock 2024-09-14T11:07:24.776 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cyanstore 2024-09-14T11:07:24.776 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 ceph_exporter 2024-09-14T11:07:24.776 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 memstore 2024-09-14T11:07:24.776 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 trace 2024-09-14T11:07:24.776 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 ceph_dedup 2024-09-14T11:07:24.776 INFO:tasks.workunit.client.0.smithi097.stderr: -2/-2 (syslog threshold) 2024-09-14T11:07:24.777 INFO:tasks.workunit.client.0.smithi097.stderr: 99/99 (stderr threshold) 2024-09-14T11:07:24.777 INFO:tasks.workunit.client.0.smithi097.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:07:24.777 INFO:tasks.workunit.client.0.smithi097.stderr: 7fba037fe640 / http_manager 2024-09-14T11:07:24.777 INFO:tasks.workunit.client.0.smithi097.stderr: 7fba91fe3640 / http_manager 2024-09-14T11:07:24.777 INFO:tasks.workunit.client.0.smithi097.stderr: 7fba92fe5640 / rgw_dt_lg_renew 2024-09-14T11:07:24.777 INFO:tasks.workunit.client.0.smithi097.stderr: 7fbab27fc640 / ms_dispatch 2024-09-14T11:07:24.777 INFO:tasks.workunit.client.0.smithi097.stderr: 7fbab3fff640 / io_context_pool 2024-09-14T11:07:24.777 INFO:tasks.workunit.client.0.smithi097.stderr: 7fbac27fc640 / ms_dispatch 2024-09-14T11:07:24.777 INFO:tasks.workunit.client.0.smithi097.stderr: 7fbac960a640 / ms_dispatch 2024-09-14T11:07:24.777 INFO:tasks.workunit.client.0.smithi097.stderr: 7fbacae0d640 / io_context_pool 2024-09-14T11:07:24.777 INFO:tasks.workunit.client.0.smithi097.stderr: 7fbbdc25c640 / msgr-worker-2 2024-09-14T11:07:24.777 INFO:tasks.workunit.client.0.smithi097.stderr: 7fbbdca5d640 / msgr-worker-1 2024-09-14T11:07:24.777 INFO:tasks.workunit.client.0.smithi097.stderr: 7fbbdd25e640 / msgr-worker-0 2024-09-14T11:07:24.777 INFO:tasks.workunit.client.0.smithi097.stderr: 7fbbdda5f640 / io_context_pool 2024-09-14T11:07:24.778 INFO:tasks.workunit.client.0.smithi097.stderr: 7fbbdef73800 / radosgw-admin 2024-09-14T11:07:24.778 INFO:tasks.workunit.client.0.smithi097.stderr: max_recent 500 2024-09-14T11:07:24.778 INFO:tasks.workunit.client.0.smithi097.stderr: max_new 1000 2024-09-14T11:07:24.778 INFO:tasks.workunit.client.0.smithi097.stderr: log_file /var/log/ceph/ceph-client.admin.146905.log 2024-09-14T11:07:24.778 INFO:tasks.workunit.client.0.smithi097.stderr:--- end dump of recent events --- 2024-09-14T11:07:24.778 INFO:tasks.workunit.client.0.smithi097.stderr:--- begin dump of recent events --- 2024-09-14T11:07:24.778 INFO:tasks.workunit.client.0.smithi097.stderr: -499> 2024-09-14T11:07:24.440+0000 7fbbdd25e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:07:24.778 INFO:tasks.workunit.client.0.smithi097.stderr: -498> 2024-09-14T11:07:24.440+0000 7fbbdca5d640 10 monclient(hunting): get_auth_request con 0x558d9d692020 auth_method 0 2024-09-14T11:07:24.778 INFO:tasks.workunit.client.0.smithi097.stderr: -497> 2024-09-14T11:07:24.440+0000 7fbbdca5d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:07:24.778 INFO:tasks.workunit.client.0.smithi097.stderr: -496> 2024-09-14T11:07:24.440+0000 7fbbdca5d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:07:24.778 INFO:tasks.workunit.client.0.smithi097.stderr: -495> 2024-09-14T11:07:24.440+0000 7fbbdca5d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:07:24.778 INFO:tasks.workunit.client.0.smithi097.stderr: -494> 2024-09-14T11:07:24.440+0000 7fbbdc25c640 10 monclient(hunting): get_auth_request con 0x558d9d71e4f0 auth_method 0 2024-09-14T11:07:24.779 INFO:tasks.workunit.client.0.smithi097.stderr: -493> 2024-09-14T11:07:24.440+0000 7fbbdc25c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:07:24.779 INFO:tasks.workunit.client.0.smithi097.stderr: -492> 2024-09-14T11:07:24.440+0000 7fbbdc25c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:07:24.779 INFO:tasks.workunit.client.0.smithi097.stderr: -491> 2024-09-14T11:07:24.440+0000 7fbbdc25c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:07:24.779 INFO:tasks.workunit.client.0.smithi097.stderr: -490> 2024-09-14T11:07:24.440+0000 7fbbdd25e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:07:24.779 INFO:tasks.workunit.client.0.smithi097.stderr: -489> 2024-09-14T11:07:24.440+0000 7fbbdd25e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:07:24.779 INFO:tasks.workunit.client.0.smithi097.stderr: -488> 2024-09-14T11:07:24.440+0000 7fbbdd25e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:07:24.779 INFO:tasks.workunit.client.0.smithi097.stderr: -487> 2024-09-14T11:07:24.440+0000 7fbbdca5d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:07:24.779 INFO:tasks.workunit.client.0.smithi097.stderr: -486> 2024-09-14T11:07:24.440+0000 7fbbdca5d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:07:24.779 INFO:tasks.workunit.client.0.smithi097.stderr: -485> 2024-09-14T11:07:24.440+0000 7fbbdca5d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:07:24.779 INFO:tasks.workunit.client.0.smithi097.stderr: -484> 2024-09-14T11:07:24.440+0000 7fbbdc25c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:07:24.779 INFO:tasks.workunit.client.0.smithi097.stderr: -483> 2024-09-14T11:07:24.440+0000 7fbbdc25c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:07:24.779 INFO:tasks.workunit.client.0.smithi097.stderr: -482> 2024-09-14T11:07:24.440+0000 7fbbdc25c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:07:24.779 INFO:tasks.workunit.client.0.smithi097.stderr: -481> 2024-09-14T11:07:24.440+0000 7fbbdd25e640 10 monclient(hunting): handle_auth_done global_id 7655 payload 824 2024-09-14T11:07:24.780 INFO:tasks.workunit.client.0.smithi097.stderr: -480> 2024-09-14T11:07:24.440+0000 7fbbdd25e640 10 monclient: _finish_hunting 0 2024-09-14T11:07:24.780 INFO:tasks.workunit.client.0.smithi097.stderr: -479> 2024-09-14T11:07:24.440+0000 7fbbdd25e640 1 monclient: found mon.noname-c 2024-09-14T11:07:24.780 INFO:tasks.workunit.client.0.smithi097.stderr: -478> 2024-09-14T11:07:24.440+0000 7fbbdd25e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:07:24.780 INFO:tasks.workunit.client.0.smithi097.stderr: -477> 2024-09-14T11:07:24.441+0000 7fbac960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:07:24.780 INFO:tasks.workunit.client.0.smithi097.stderr: -476> 2024-09-14T11:07:24.441+0000 7fbac960a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:07:24.780 INFO:tasks.workunit.client.0.smithi097.stderr: -475> 2024-09-14T11:07:24.441+0000 7fbac960a640 10 monclient: dump: 2024-09-14T11:07:24.780 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:07:24.780 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:07:24.780 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:24.780 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:24.780 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:07:24.780 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:07:24.780 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:07:24.780 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:07:24.781 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:07:24.781 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:24.781 INFO:tasks.workunit.client.0.smithi097.stderr: -474> 2024-09-14T11:07:24.441+0000 7fbac960a640 10 monclient: _finish_auth 0 2024-09-14T11:07:24.781 INFO:tasks.workunit.client.0.smithi097.stderr: -473> 2024-09-14T11:07:24.441+0000 7fbac960a640 10 monclient: _check_auth_tickets 2024-09-14T11:07:24.781 INFO:tasks.workunit.client.0.smithi097.stderr: -472> 2024-09-14T11:07:24.441+0000 7fbac960a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:07:24.781 INFO:tasks.workunit.client.0.smithi097.stderr: -471> 2024-09-14T11:07:24.441+0000 7fbac960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:07:24.781 INFO:tasks.workunit.client.0.smithi097.stderr: -470> 2024-09-14T11:07:24.441+0000 7fbac960a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:07:24.781 INFO:tasks.workunit.client.0.smithi097.stderr: -469> 2024-09-14T11:07:24.441+0000 7fbac960a640 10 monclient: dump: 2024-09-14T11:07:24.781 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:07:24.781 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:07:24.781 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:24.781 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:24.781 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:07:24.782 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:07:24.782 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:07:24.782 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:07:24.782 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:07:24.782 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:24.782 INFO:tasks.workunit.client.0.smithi097.stderr: -468> 2024-09-14T11:07:24.441+0000 7fbbdef73800 5 monclient: authenticate success, global_id 7655 2024-09-14T11:07:24.782 INFO:tasks.workunit.client.0.smithi097.stderr: -467> 2024-09-14T11:07:24.441+0000 7fbbdef73800 10 monclient: _renew_subs 2024-09-14T11:07:24.782 INFO:tasks.workunit.client.0.smithi097.stderr: -466> 2024-09-14T11:07:24.441+0000 7fbbdef73800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:07:24.782 INFO:tasks.workunit.client.0.smithi097.stderr: -465> 2024-09-14T11:07:24.441+0000 7fbacae0d640 4 set_mon_vals no callback set 2024-09-14T11:07:24.782 INFO:tasks.workunit.client.0.smithi097.stderr: -464> 2024-09-14T11:07:24.441+0000 7fbbdef73800 10 monclient: _renew_subs 2024-09-14T11:07:24.782 INFO:tasks.workunit.client.0.smithi097.stderr: -463> 2024-09-14T11:07:24.441+0000 7fbbdef73800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:07:24.783 INFO:tasks.workunit.client.0.smithi097.stderr: -462> 2024-09-14T11:07:24.441+0000 7fbbdef73800 1 librados: init done 2024-09-14T11:07:24.783 INFO:tasks.workunit.client.0.smithi097.stderr: -461> 2024-09-14T11:07:24.443+0000 7fbac960a640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:07:24.783 INFO:tasks.workunit.client.0.smithi097.stderr: -460> 2024-09-14T11:07:24.443+0000 7fbac960a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:07:24.783 INFO:tasks.workunit.client.0.smithi097.stderr: -459> 2024-09-14T11:07:24.443+0000 7fbac960a640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:07:24.783 INFO:tasks.workunit.client.0.smithi097.stderr: -458> 2024-09-14T11:07:24.443+0000 7fbbdca5d640 10 monclient: get_auth_request con 0x7fbac4077230 auth_method 0 2024-09-14T11:07:24.783 INFO:tasks.workunit.client.0.smithi097.stderr: -457> 2024-09-14T11:07:24.443+0000 7fbbdc25c640 10 monclient: get_auth_request con 0x558d9d823bc0 auth_method 0 2024-09-14T11:07:24.783 INFO:tasks.workunit.client.0.smithi097.stderr: -456> 2024-09-14T11:07:24.444+0000 7fbbdca5d640 10 monclient: get_auth_request con 0x558d9d826da0 auth_method 0 2024-09-14T11:07:24.783 INFO:tasks.workunit.client.0.smithi097.stderr: -455> 2024-09-14T11:07:24.445+0000 7fbbdc25c640 10 monclient: get_auth_request con 0x558d9d82af90 auth_method 0 2024-09-14T11:07:24.783 INFO:tasks.workunit.client.0.smithi097.stderr: -454> 2024-09-14T11:07:24.446+0000 7fbbdd25e640 10 monclient: get_auth_request con 0x558d9d82a620 auth_method 0 2024-09-14T11:07:24.783 INFO:tasks.workunit.client.0.smithi097.stderr: -453> 2024-09-14T11:07:24.446+0000 7fbbdef73800 10 monclient: build_initial_monmap 2024-09-14T11:07:24.783 INFO:tasks.workunit.client.0.smithi097.stderr: -452> 2024-09-14T11:07:24.446+0000 7fbbdef73800 1 build_initial for_mkfs: 0 2024-09-14T11:07:24.783 INFO:tasks.workunit.client.0.smithi097.stderr: -451> 2024-09-14T11:07:24.446+0000 7fbbdef73800 10 monclient: monmap: 2024-09-14T11:07:24.783 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:07:24.784 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:07:24.784 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:07:24.784 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:07:24.784 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:07:24.784 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:07:24.784 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:07:24.784 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:07:24.784 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:07:24.784 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:24.784 INFO:tasks.workunit.client.0.smithi097.stderr: -450> 2024-09-14T11:07:24.446+0000 7fbbdef73800 5 AuthRegistry(0x558d9d833020) adding auth protocol: cephx 2024-09-14T11:07:24.784 INFO:tasks.workunit.client.0.smithi097.stderr: -449> 2024-09-14T11:07:24.446+0000 7fbbdef73800 5 AuthRegistry(0x558d9d833020) adding auth protocol: cephx 2024-09-14T11:07:24.785 INFO:tasks.workunit.client.0.smithi097.stderr: -448> 2024-09-14T11:07:24.446+0000 7fbbdef73800 5 AuthRegistry(0x558d9d833020) adding auth protocol: cephx 2024-09-14T11:07:24.785 INFO:tasks.workunit.client.0.smithi097.stderr: -447> 2024-09-14T11:07:24.446+0000 7fbbdef73800 5 AuthRegistry(0x558d9d833020) adding con mode: secure 2024-09-14T11:07:24.785 INFO:tasks.workunit.client.0.smithi097.stderr: -446> 2024-09-14T11:07:24.446+0000 7fbbdef73800 5 AuthRegistry(0x558d9d833020) adding con mode: crc 2024-09-14T11:07:24.785 INFO:tasks.workunit.client.0.smithi097.stderr: -445> 2024-09-14T11:07:24.446+0000 7fbbdef73800 5 AuthRegistry(0x558d9d833020) adding con mode: secure 2024-09-14T11:07:24.785 INFO:tasks.workunit.client.0.smithi097.stderr: -444> 2024-09-14T11:07:24.446+0000 7fbbdef73800 5 AuthRegistry(0x558d9d833020) adding con mode: crc 2024-09-14T11:07:24.785 INFO:tasks.workunit.client.0.smithi097.stderr: -443> 2024-09-14T11:07:24.446+0000 7fbbdef73800 5 AuthRegistry(0x558d9d833020) adding con mode: secure 2024-09-14T11:07:24.785 INFO:tasks.workunit.client.0.smithi097.stderr: -442> 2024-09-14T11:07:24.446+0000 7fbbdef73800 5 AuthRegistry(0x558d9d833020) adding con mode: crc 2024-09-14T11:07:24.785 INFO:tasks.workunit.client.0.smithi097.stderr: -441> 2024-09-14T11:07:24.446+0000 7fbbdef73800 5 AuthRegistry(0x558d9d833020) adding con mode: crc 2024-09-14T11:07:24.785 INFO:tasks.workunit.client.0.smithi097.stderr: -440> 2024-09-14T11:07:24.446+0000 7fbbdef73800 5 AuthRegistry(0x558d9d833020) adding con mode: secure 2024-09-14T11:07:24.785 INFO:tasks.workunit.client.0.smithi097.stderr: -439> 2024-09-14T11:07:24.446+0000 7fbbdef73800 5 AuthRegistry(0x558d9d833020) adding con mode: crc 2024-09-14T11:07:24.785 INFO:tasks.workunit.client.0.smithi097.stderr: -438> 2024-09-14T11:07:24.446+0000 7fbbdef73800 5 AuthRegistry(0x558d9d833020) adding con mode: secure 2024-09-14T11:07:24.785 INFO:tasks.workunit.client.0.smithi097.stderr: -437> 2024-09-14T11:07:24.446+0000 7fbbdef73800 5 AuthRegistry(0x558d9d833020) adding con mode: crc 2024-09-14T11:07:24.785 INFO:tasks.workunit.client.0.smithi097.stderr: -436> 2024-09-14T11:07:24.446+0000 7fbbdef73800 5 AuthRegistry(0x558d9d833020) adding con mode: secure 2024-09-14T11:07:24.785 INFO:tasks.workunit.client.0.smithi097.stderr: -435> 2024-09-14T11:07:24.446+0000 7fbbdef73800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:07:24.786 INFO:tasks.workunit.client.0.smithi097.stderr: -434> 2024-09-14T11:07:24.447+0000 7fbbdef73800 5 asok(0x558d9d5bb270) register_command objecter_requests cmddesc objecter_requests hook 0x558d9d836530 EEXIST 2024-09-14T11:07:24.786 INFO:tasks.workunit.client.0.smithi097.stderr: -433> 2024-09-14T11:07:24.447+0000 7fbbdef73800 10 monclient: init 2024-09-14T11:07:24.786 INFO:tasks.workunit.client.0.smithi097.stderr: -432> 2024-09-14T11:07:24.447+0000 7fbbdef73800 5 AuthRegistry(0x558d9d831f18) adding auth protocol: cephx 2024-09-14T11:07:24.786 INFO:tasks.workunit.client.0.smithi097.stderr: -431> 2024-09-14T11:07:24.447+0000 7fbbdef73800 5 AuthRegistry(0x558d9d831f18) adding auth protocol: cephx 2024-09-14T11:07:24.786 INFO:tasks.workunit.client.0.smithi097.stderr: -430> 2024-09-14T11:07:24.447+0000 7fbbdef73800 5 AuthRegistry(0x558d9d831f18) adding auth protocol: cephx 2024-09-14T11:07:24.786 INFO:tasks.workunit.client.0.smithi097.stderr: -429> 2024-09-14T11:07:24.447+0000 7fbbdef73800 5 AuthRegistry(0x558d9d831f18) adding con mode: secure 2024-09-14T11:07:24.786 INFO:tasks.workunit.client.0.smithi097.stderr: -428> 2024-09-14T11:07:24.447+0000 7fbbdef73800 5 AuthRegistry(0x558d9d831f18) adding con mode: crc 2024-09-14T11:07:24.786 INFO:tasks.workunit.client.0.smithi097.stderr: -427> 2024-09-14T11:07:24.447+0000 7fbbdef73800 5 AuthRegistry(0x558d9d831f18) adding con mode: secure 2024-09-14T11:07:24.786 INFO:tasks.workunit.client.0.smithi097.stderr: -426> 2024-09-14T11:07:24.447+0000 7fbbdef73800 5 AuthRegistry(0x558d9d831f18) adding con mode: crc 2024-09-14T11:07:24.786 INFO:tasks.workunit.client.0.smithi097.stderr: -425> 2024-09-14T11:07:24.447+0000 7fbbdef73800 5 AuthRegistry(0x558d9d831f18) adding con mode: secure 2024-09-14T11:07:24.786 INFO:tasks.workunit.client.0.smithi097.stderr: -424> 2024-09-14T11:07:24.447+0000 7fbbdef73800 5 AuthRegistry(0x558d9d831f18) adding con mode: crc 2024-09-14T11:07:24.786 INFO:tasks.workunit.client.0.smithi097.stderr: -423> 2024-09-14T11:07:24.447+0000 7fbbdef73800 5 AuthRegistry(0x558d9d831f18) adding con mode: crc 2024-09-14T11:07:24.786 INFO:tasks.workunit.client.0.smithi097.stderr: -422> 2024-09-14T11:07:24.447+0000 7fbbdef73800 5 AuthRegistry(0x558d9d831f18) adding con mode: secure 2024-09-14T11:07:24.786 INFO:tasks.workunit.client.0.smithi097.stderr: -421> 2024-09-14T11:07:24.447+0000 7fbbdef73800 5 AuthRegistry(0x558d9d831f18) adding con mode: crc 2024-09-14T11:07:24.786 INFO:tasks.workunit.client.0.smithi097.stderr: -420> 2024-09-14T11:07:24.447+0000 7fbbdef73800 5 AuthRegistry(0x558d9d831f18) adding con mode: secure 2024-09-14T11:07:24.787 INFO:tasks.workunit.client.0.smithi097.stderr: -419> 2024-09-14T11:07:24.447+0000 7fbbdef73800 5 AuthRegistry(0x558d9d831f18) adding con mode: crc 2024-09-14T11:07:24.787 INFO:tasks.workunit.client.0.smithi097.stderr: -418> 2024-09-14T11:07:24.447+0000 7fbbdef73800 5 AuthRegistry(0x558d9d831f18) adding con mode: secure 2024-09-14T11:07:24.787 INFO:tasks.workunit.client.0.smithi097.stderr: -417> 2024-09-14T11:07:24.447+0000 7fbbdef73800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:07:24.787 INFO:tasks.workunit.client.0.smithi097.stderr: -416> 2024-09-14T11:07:24.447+0000 7fbbdef73800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:07:24.787 INFO:tasks.workunit.client.0.smithi097.stderr: -415> 2024-09-14T11:07:24.447+0000 7fbbdef73800 5 asok(0x558d9d5bb270) register_command rotate-key cmddesc rotate-key hook 0x558d9d832060 EEXIST 2024-09-14T11:07:24.787 INFO:tasks.workunit.client.0.smithi097.stderr: -414> 2024-09-14T11:07:24.447+0000 7fbbdef73800 10 monclient: _reopen_session rank -1 2024-09-14T11:07:24.787 INFO:tasks.workunit.client.0.smithi097.stderr: -413> 2024-09-14T11:07:24.447+0000 7fbbdef73800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:07:24.787 INFO:tasks.workunit.client.0.smithi097.stderr: -412> 2024-09-14T11:07:24.447+0000 7fbbdef73800 10 monclient(hunting): picked mon.noname-c con 0x558d9d85a850 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:07:24.787 INFO:tasks.workunit.client.0.smithi097.stderr: -411> 2024-09-14T11:07:24.447+0000 7fbbdef73800 10 monclient(hunting): picked mon.noname-b con 0x558d9d85ac30 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:07:24.787 INFO:tasks.workunit.client.0.smithi097.stderr: -410> 2024-09-14T11:07:24.447+0000 7fbbdef73800 10 monclient(hunting): picked mon.noname-a con 0x558d9d859560 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:07:24.787 INFO:tasks.workunit.client.0.smithi097.stderr: -409> 2024-09-14T11:07:24.447+0000 7fbbdef73800 10 monclient(hunting): start opening mon connection 2024-09-14T11:07:24.787 INFO:tasks.workunit.client.0.smithi097.stderr: -408> 2024-09-14T11:07:24.447+0000 7fbbdef73800 10 monclient(hunting): start opening mon connection 2024-09-14T11:07:24.787 INFO:tasks.workunit.client.0.smithi097.stderr: -407> 2024-09-14T11:07:24.447+0000 7fbbdef73800 10 monclient(hunting): start opening mon connection 2024-09-14T11:07:24.788 INFO:tasks.workunit.client.0.smithi097.stderr: -406> 2024-09-14T11:07:24.447+0000 7fbbdef73800 10 monclient(hunting): _renew_subs 2024-09-14T11:07:24.788 INFO:tasks.workunit.client.0.smithi097.stderr: -405> 2024-09-14T11:07:24.447+0000 7fbbdef73800 10 monclient(hunting): authenticate will time out at 2126.101741s 2024-09-14T11:07:24.788 INFO:tasks.workunit.client.0.smithi097.stderr: -404> 2024-09-14T11:07:24.447+0000 7fbbdc25c640 10 monclient(hunting): get_auth_request con 0x558d9d85a850 auth_method 0 2024-09-14T11:07:24.788 INFO:tasks.workunit.client.0.smithi097.stderr: -403> 2024-09-14T11:07:24.447+0000 7fbbdc25c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:07:24.788 INFO:tasks.workunit.client.0.smithi097.stderr: -402> 2024-09-14T11:07:24.447+0000 7fbbdc25c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:07:24.788 INFO:tasks.workunit.client.0.smithi097.stderr: -401> 2024-09-14T11:07:24.447+0000 7fbbdc25c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:07:24.788 INFO:tasks.workunit.client.0.smithi097.stderr: -400> 2024-09-14T11:07:24.447+0000 7fbbdca5d640 10 monclient(hunting): get_auth_request con 0x558d9d859560 auth_method 0 2024-09-14T11:07:24.788 INFO:tasks.workunit.client.0.smithi097.stderr: -399> 2024-09-14T11:07:24.447+0000 7fbbdca5d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:07:24.788 INFO:tasks.workunit.client.0.smithi097.stderr: -398> 2024-09-14T11:07:24.447+0000 7fbbdca5d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:07:24.788 INFO:tasks.workunit.client.0.smithi097.stderr: -397> 2024-09-14T11:07:24.447+0000 7fbbdca5d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:07:24.788 INFO:tasks.workunit.client.0.smithi097.stderr: -396> 2024-09-14T11:07:24.447+0000 7fbbdd25e640 10 monclient(hunting): get_auth_request con 0x558d9d85ac30 auth_method 0 2024-09-14T11:07:24.788 INFO:tasks.workunit.client.0.smithi097.stderr: -395> 2024-09-14T11:07:24.447+0000 7fbbdd25e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:07:24.788 INFO:tasks.workunit.client.0.smithi097.stderr: -394> 2024-09-14T11:07:24.447+0000 7fbbdd25e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:07:24.789 INFO:tasks.workunit.client.0.smithi097.stderr: -393> 2024-09-14T11:07:24.447+0000 7fbbdd25e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:07:24.789 INFO:tasks.workunit.client.0.smithi097.stderr: -392> 2024-09-14T11:07:24.447+0000 7fbbdc25c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:07:24.789 INFO:tasks.workunit.client.0.smithi097.stderr: -391> 2024-09-14T11:07:24.447+0000 7fbbdc25c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:07:24.789 INFO:tasks.workunit.client.0.smithi097.stderr: -390> 2024-09-14T11:07:24.447+0000 7fbbdc25c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:07:24.789 INFO:tasks.workunit.client.0.smithi097.stderr: -389> 2024-09-14T11:07:24.447+0000 7fbbdca5d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:07:24.789 INFO:tasks.workunit.client.0.smithi097.stderr: -388> 2024-09-14T11:07:24.447+0000 7fbbdca5d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:07:24.789 INFO:tasks.workunit.client.0.smithi097.stderr: -387> 2024-09-14T11:07:24.447+0000 7fbbdca5d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:07:24.789 INFO:tasks.workunit.client.0.smithi097.stderr: -386> 2024-09-14T11:07:24.448+0000 7fbbdd25e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:07:24.789 INFO:tasks.workunit.client.0.smithi097.stderr: -385> 2024-09-14T11:07:24.448+0000 7fbbdd25e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:07:24.789 INFO:tasks.workunit.client.0.smithi097.stderr: -384> 2024-09-14T11:07:24.448+0000 7fbbdd25e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:07:24.789 INFO:tasks.workunit.client.0.smithi097.stderr: -383> 2024-09-14T11:07:24.448+0000 7fbbdc25c640 10 monclient(hunting): handle_auth_done global_id 7658 payload 824 2024-09-14T11:07:24.789 INFO:tasks.workunit.client.0.smithi097.stderr: -382> 2024-09-14T11:07:24.448+0000 7fbbdc25c640 10 monclient: _finish_hunting 0 2024-09-14T11:07:24.789 INFO:tasks.workunit.client.0.smithi097.stderr: -381> 2024-09-14T11:07:24.448+0000 7fbbdc25c640 1 monclient: found mon.noname-c 2024-09-14T11:07:24.789 INFO:tasks.workunit.client.0.smithi097.stderr: -380> 2024-09-14T11:07:24.448+0000 7fbbdc25c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:07:24.790 INFO:tasks.workunit.client.0.smithi097.stderr: -379> 2024-09-14T11:07:24.448+0000 7fbac27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:07:24.790 INFO:tasks.workunit.client.0.smithi097.stderr: -378> 2024-09-14T11:07:24.448+0000 7fbac27fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:07:24.790 INFO:tasks.workunit.client.0.smithi097.stderr: -377> 2024-09-14T11:07:24.448+0000 7fbac27fc640 10 monclient: dump: 2024-09-14T11:07:24.790 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:07:24.790 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:07:24.790 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:24.790 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:24.790 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:07:24.790 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:07:24.790 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:07:24.790 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:07:24.790 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:07:24.790 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:24.790 INFO:tasks.workunit.client.0.smithi097.stderr: -376> 2024-09-14T11:07:24.448+0000 7fbac27fc640 10 monclient: _finish_auth 0 2024-09-14T11:07:24.790 INFO:tasks.workunit.client.0.smithi097.stderr: -375> 2024-09-14T11:07:24.448+0000 7fbac27fc640 10 monclient: _check_auth_tickets 2024-09-14T11:07:24.791 INFO:tasks.workunit.client.0.smithi097.stderr: -374> 2024-09-14T11:07:24.448+0000 7fbac27fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:07:24.791 INFO:tasks.workunit.client.0.smithi097.stderr: -373> 2024-09-14T11:07:24.448+0000 7fbac27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:07:24.791 INFO:tasks.workunit.client.0.smithi097.stderr: -372> 2024-09-14T11:07:24.448+0000 7fbac27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:07:24.791 INFO:tasks.workunit.client.0.smithi097.stderr: -371> 2024-09-14T11:07:24.448+0000 7fbac27fc640 10 monclient: dump: 2024-09-14T11:07:24.791 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:07:24.791 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:07:24.791 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:24.791 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:24.791 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:07:24.791 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:07:24.791 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:07:24.791 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:07:24.791 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:07:24.791 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:24.792 INFO:tasks.workunit.client.0.smithi097.stderr: -370> 2024-09-14T11:07:24.448+0000 7fbbdef73800 5 monclient: authenticate success, global_id 7658 2024-09-14T11:07:24.792 INFO:tasks.workunit.client.0.smithi097.stderr: -369> 2024-09-14T11:07:24.448+0000 7fbbdef73800 10 monclient: _renew_subs 2024-09-14T11:07:24.792 INFO:tasks.workunit.client.0.smithi097.stderr: -368> 2024-09-14T11:07:24.448+0000 7fbbdda5f640 4 set_mon_vals no callback set 2024-09-14T11:07:24.792 INFO:tasks.workunit.client.0.smithi097.stderr: -367> 2024-09-14T11:07:24.448+0000 7fbbdef73800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:07:24.792 INFO:tasks.workunit.client.0.smithi097.stderr: -366> 2024-09-14T11:07:24.448+0000 7fbbdef73800 10 monclient: _renew_subs 2024-09-14T11:07:24.792 INFO:tasks.workunit.client.0.smithi097.stderr: -365> 2024-09-14T11:07:24.448+0000 7fbbdef73800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:07:24.792 INFO:tasks.workunit.client.0.smithi097.stderr: -364> 2024-09-14T11:07:24.450+0000 7fbac27fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:07:24.792 INFO:tasks.workunit.client.0.smithi097.stderr: -363> 2024-09-14T11:07:24.450+0000 7fbac27fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:07:24.792 INFO:tasks.workunit.client.0.smithi097.stderr: -362> 2024-09-14T11:07:24.450+0000 7fbac27fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:07:24.792 INFO:tasks.workunit.client.0.smithi097.stderr: -361> 2024-09-14T11:07:24.450+0000 7fbbdd25e640 10 monclient: get_auth_request con 0x7fbab4077140 auth_method 0 2024-09-14T11:07:24.792 INFO:tasks.workunit.client.0.smithi097.stderr: -360> 2024-09-14T11:07:24.450+0000 7fbbdef73800 10 monclient: get_monmap_and_config 2024-09-14T11:07:24.792 INFO:tasks.workunit.client.0.smithi097.stderr: -359> 2024-09-14T11:07:24.450+0000 7fbbdef73800 10 monclient: build_initial_monmap 2024-09-14T11:07:24.792 INFO:tasks.workunit.client.0.smithi097.stderr: -358> 2024-09-14T11:07:24.450+0000 7fbbdef73800 1 build_initial for_mkfs: 0 2024-09-14T11:07:24.792 INFO:tasks.workunit.client.0.smithi097.stderr: -357> 2024-09-14T11:07:24.450+0000 7fbbdef73800 10 monclient: monmap: 2024-09-14T11:07:24.793 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:07:24.793 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:07:24.793 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:07:24.793 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:07:24.793 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:07:24.793 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:07:24.793 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:07:24.793 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:07:24.793 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:07:24.793 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:24.793 INFO:tasks.workunit.client.0.smithi097.stderr: -356> 2024-09-14T11:07:24.450+0000 7fbbdef73800 5 AuthRegistry(0x558d9d87a700) adding auth protocol: cephx 2024-09-14T11:07:24.793 INFO:tasks.workunit.client.0.smithi097.stderr: -355> 2024-09-14T11:07:24.450+0000 7fbbdef73800 5 AuthRegistry(0x558d9d87a700) adding auth protocol: cephx 2024-09-14T11:07:24.793 INFO:tasks.workunit.client.0.smithi097.stderr: -354> 2024-09-14T11:07:24.450+0000 7fbbdef73800 5 AuthRegistry(0x558d9d87a700) adding auth protocol: cephx 2024-09-14T11:07:24.794 INFO:tasks.workunit.client.0.smithi097.stderr: -353> 2024-09-14T11:07:24.450+0000 7fbbdef73800 5 AuthRegistry(0x558d9d87a700) adding con mode: secure 2024-09-14T11:07:24.794 INFO:tasks.workunit.client.0.smithi097.stderr: -352> 2024-09-14T11:07:24.450+0000 7fbbdef73800 5 AuthRegistry(0x558d9d87a700) adding con mode: crc 2024-09-14T11:07:24.794 INFO:tasks.workunit.client.0.smithi097.stderr: -351> 2024-09-14T11:07:24.450+0000 7fbbdef73800 5 AuthRegistry(0x558d9d87a700) adding con mode: secure 2024-09-14T11:07:24.794 INFO:tasks.workunit.client.0.smithi097.stderr: -350> 2024-09-14T11:07:24.450+0000 7fbbdef73800 5 AuthRegistry(0x558d9d87a700) adding con mode: crc 2024-09-14T11:07:24.794 INFO:tasks.workunit.client.0.smithi097.stderr: -349> 2024-09-14T11:07:24.450+0000 7fbbdef73800 5 AuthRegistry(0x558d9d87a700) adding con mode: secure 2024-09-14T11:07:24.794 INFO:tasks.workunit.client.0.smithi097.stderr: -348> 2024-09-14T11:07:24.450+0000 7fbbdef73800 5 AuthRegistry(0x558d9d87a700) adding con mode: crc 2024-09-14T11:07:24.794 INFO:tasks.workunit.client.0.smithi097.stderr: -347> 2024-09-14T11:07:24.450+0000 7fbbdef73800 5 AuthRegistry(0x558d9d87a700) adding con mode: crc 2024-09-14T11:07:24.794 INFO:tasks.workunit.client.0.smithi097.stderr: -346> 2024-09-14T11:07:24.450+0000 7fbbdef73800 5 AuthRegistry(0x558d9d87a700) adding con mode: secure 2024-09-14T11:07:24.794 INFO:tasks.workunit.client.0.smithi097.stderr: -345> 2024-09-14T11:07:24.450+0000 7fbbdef73800 5 AuthRegistry(0x558d9d87a700) adding con mode: crc 2024-09-14T11:07:24.794 INFO:tasks.workunit.client.0.smithi097.stderr: -344> 2024-09-14T11:07:24.450+0000 7fbbdef73800 5 AuthRegistry(0x558d9d87a700) adding con mode: secure 2024-09-14T11:07:24.794 INFO:tasks.workunit.client.0.smithi097.stderr: -343> 2024-09-14T11:07:24.450+0000 7fbbdef73800 5 AuthRegistry(0x558d9d87a700) adding con mode: crc 2024-09-14T11:07:24.794 INFO:tasks.workunit.client.0.smithi097.stderr: -342> 2024-09-14T11:07:24.450+0000 7fbbdef73800 5 AuthRegistry(0x558d9d87a700) adding con mode: secure 2024-09-14T11:07:24.794 INFO:tasks.workunit.client.0.smithi097.stderr: -341> 2024-09-14T11:07:24.450+0000 7fbbdef73800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:07:24.795 INFO:tasks.workunit.client.0.smithi097.stderr: -340> 2024-09-14T11:07:24.451+0000 7fbbdef73800 10 monclient: init 2024-09-14T11:07:24.795 INFO:tasks.workunit.client.0.smithi097.stderr: -339> 2024-09-14T11:07:24.451+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5e8b0) adding auth protocol: cephx 2024-09-14T11:07:24.795 INFO:tasks.workunit.client.0.smithi097.stderr: -338> 2024-09-14T11:07:24.451+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5e8b0) adding auth protocol: cephx 2024-09-14T11:07:24.795 INFO:tasks.workunit.client.0.smithi097.stderr: -337> 2024-09-14T11:07:24.451+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5e8b0) adding auth protocol: cephx 2024-09-14T11:07:24.795 INFO:tasks.workunit.client.0.smithi097.stderr: -336> 2024-09-14T11:07:24.451+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5e8b0) adding con mode: secure 2024-09-14T11:07:24.795 INFO:tasks.workunit.client.0.smithi097.stderr: -335> 2024-09-14T11:07:24.451+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5e8b0) adding con mode: crc 2024-09-14T11:07:24.795 INFO:tasks.workunit.client.0.smithi097.stderr: -334> 2024-09-14T11:07:24.451+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5e8b0) adding con mode: secure 2024-09-14T11:07:24.795 INFO:tasks.workunit.client.0.smithi097.stderr: -333> 2024-09-14T11:07:24.451+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5e8b0) adding con mode: crc 2024-09-14T11:07:24.795 INFO:tasks.workunit.client.0.smithi097.stderr: -332> 2024-09-14T11:07:24.451+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5e8b0) adding con mode: secure 2024-09-14T11:07:24.795 INFO:tasks.workunit.client.0.smithi097.stderr: -331> 2024-09-14T11:07:24.451+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5e8b0) adding con mode: crc 2024-09-14T11:07:24.795 INFO:tasks.workunit.client.0.smithi097.stderr: -330> 2024-09-14T11:07:24.451+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5e8b0) adding con mode: crc 2024-09-14T11:07:24.795 INFO:tasks.workunit.client.0.smithi097.stderr: -329> 2024-09-14T11:07:24.451+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5e8b0) adding con mode: secure 2024-09-14T11:07:24.795 INFO:tasks.workunit.client.0.smithi097.stderr: -328> 2024-09-14T11:07:24.451+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5e8b0) adding con mode: crc 2024-09-14T11:07:24.795 INFO:tasks.workunit.client.0.smithi097.stderr: -327> 2024-09-14T11:07:24.451+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5e8b0) adding con mode: secure 2024-09-14T11:07:24.796 INFO:tasks.workunit.client.0.smithi097.stderr: -326> 2024-09-14T11:07:24.451+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5e8b0) adding con mode: crc 2024-09-14T11:07:24.796 INFO:tasks.workunit.client.0.smithi097.stderr: -325> 2024-09-14T11:07:24.451+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5e8b0) adding con mode: secure 2024-09-14T11:07:24.796 INFO:tasks.workunit.client.0.smithi097.stderr: -324> 2024-09-14T11:07:24.451+0000 7fbbdef73800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:07:24.796 INFO:tasks.workunit.client.0.smithi097.stderr: -323> 2024-09-14T11:07:24.451+0000 7fbbdef73800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:07:24.796 INFO:tasks.workunit.client.0.smithi097.stderr: -322> 2024-09-14T11:07:24.451+0000 7fbbdef73800 5 asok(0x558d9d5bb270) register_command rotate-key cmddesc rotate-key hook 0x7fffa7a5e9f8 EEXIST 2024-09-14T11:07:24.796 INFO:tasks.workunit.client.0.smithi097.stderr: -321> 2024-09-14T11:07:24.451+0000 7fbbdef73800 10 monclient: _reopen_session rank -1 2024-09-14T11:07:24.796 INFO:tasks.workunit.client.0.smithi097.stderr: -320> 2024-09-14T11:07:24.451+0000 7fbbdef73800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:07:24.796 INFO:tasks.workunit.client.0.smithi097.stderr: -319> 2024-09-14T11:07:24.451+0000 7fbbdef73800 10 monclient(hunting): picked mon.noname-a con 0x558d9d8aed60 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:07:24.796 INFO:tasks.workunit.client.0.smithi097.stderr: -318> 2024-09-14T11:07:24.451+0000 7fbbdef73800 10 monclient(hunting): picked mon.noname-b con 0x558d9d87fd70 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:07:24.796 INFO:tasks.workunit.client.0.smithi097.stderr: -317> 2024-09-14T11:07:24.451+0000 7fbbdef73800 10 monclient(hunting): picked mon.noname-c con 0x558d9d8aa240 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:07:24.796 INFO:tasks.workunit.client.0.smithi097.stderr: -316> 2024-09-14T11:07:24.451+0000 7fbbdef73800 10 monclient(hunting): start opening mon connection 2024-09-14T11:07:24.796 INFO:tasks.workunit.client.0.smithi097.stderr: -315> 2024-09-14T11:07:24.451+0000 7fbbdef73800 10 monclient(hunting): start opening mon connection 2024-09-14T11:07:24.796 INFO:tasks.workunit.client.0.smithi097.stderr: -314> 2024-09-14T11:07:24.451+0000 7fbbdef73800 10 monclient(hunting): start opening mon connection 2024-09-14T11:07:24.797 INFO:tasks.workunit.client.0.smithi097.stderr: -313> 2024-09-14T11:07:24.451+0000 7fbbdef73800 10 monclient(hunting): _renew_subs 2024-09-14T11:07:24.797 INFO:tasks.workunit.client.0.smithi097.stderr: -312> 2024-09-14T11:07:24.451+0000 7fbbdef73800 10 monclient(hunting): authenticate will time out at 2126.105527s 2024-09-14T11:07:24.797 INFO:tasks.workunit.client.0.smithi097.stderr: -311> 2024-09-14T11:07:24.451+0000 7fbbdc25c640 10 monclient(hunting): get_auth_request con 0x558d9d8aed60 auth_method 0 2024-09-14T11:07:24.797 INFO:tasks.workunit.client.0.smithi097.stderr: -310> 2024-09-14T11:07:24.451+0000 7fbbdc25c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:07:24.797 INFO:tasks.workunit.client.0.smithi097.stderr: -309> 2024-09-14T11:07:24.451+0000 7fbbdc25c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:07:24.797 INFO:tasks.workunit.client.0.smithi097.stderr: -308> 2024-09-14T11:07:24.451+0000 7fbbdc25c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:07:24.797 INFO:tasks.workunit.client.0.smithi097.stderr: -307> 2024-09-14T11:07:24.451+0000 7fbbdca5d640 10 monclient(hunting): get_auth_request con 0x558d9d8aa240 auth_method 0 2024-09-14T11:07:24.797 INFO:tasks.workunit.client.0.smithi097.stderr: -306> 2024-09-14T11:07:24.451+0000 7fbbdca5d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:07:24.797 INFO:tasks.workunit.client.0.smithi097.stderr: -305> 2024-09-14T11:07:24.451+0000 7fbbdca5d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:07:24.797 INFO:tasks.workunit.client.0.smithi097.stderr: -304> 2024-09-14T11:07:24.451+0000 7fbbdca5d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:07:24.797 INFO:tasks.workunit.client.0.smithi097.stderr: -303> 2024-09-14T11:07:24.451+0000 7fbbdc25c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:07:24.797 INFO:tasks.workunit.client.0.smithi097.stderr: -302> 2024-09-14T11:07:24.451+0000 7fbbdc25c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:07:24.797 INFO:tasks.workunit.client.0.smithi097.stderr: -301> 2024-09-14T11:07:24.451+0000 7fbbdc25c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:07:24.797 INFO:tasks.workunit.client.0.smithi097.stderr: -300> 2024-09-14T11:07:24.451+0000 7fbbdd25e640 10 monclient(hunting): get_auth_request con 0x558d9d87fd70 auth_method 0 2024-09-14T11:07:24.798 INFO:tasks.workunit.client.0.smithi097.stderr: -299> 2024-09-14T11:07:24.451+0000 7fbbdd25e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:07:24.798 INFO:tasks.workunit.client.0.smithi097.stderr: -298> 2024-09-14T11:07:24.451+0000 7fbbdd25e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:07:24.798 INFO:tasks.workunit.client.0.smithi097.stderr: -297> 2024-09-14T11:07:24.451+0000 7fbbdd25e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:07:24.798 INFO:tasks.workunit.client.0.smithi097.stderr: -296> 2024-09-14T11:07:24.451+0000 7fbbdca5d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:07:24.798 INFO:tasks.workunit.client.0.smithi097.stderr: -295> 2024-09-14T11:07:24.451+0000 7fbbdca5d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:07:24.798 INFO:tasks.workunit.client.0.smithi097.stderr: -294> 2024-09-14T11:07:24.451+0000 7fbbdca5d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:07:24.798 INFO:tasks.workunit.client.0.smithi097.stderr: -293> 2024-09-14T11:07:24.451+0000 7fbbdd25e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:07:24.798 INFO:tasks.workunit.client.0.smithi097.stderr: -292> 2024-09-14T11:07:24.451+0000 7fbbdd25e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:07:24.798 INFO:tasks.workunit.client.0.smithi097.stderr: -291> 2024-09-14T11:07:24.451+0000 7fbbdd25e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:07:24.798 INFO:tasks.workunit.client.0.smithi097.stderr: -290> 2024-09-14T11:07:24.451+0000 7fbbdc25c640 10 monclient(hunting): handle_auth_done global_id 8157 payload 274 2024-09-14T11:07:24.798 INFO:tasks.workunit.client.0.smithi097.stderr: -289> 2024-09-14T11:07:24.451+0000 7fbbdc25c640 10 monclient: _finish_hunting 0 2024-09-14T11:07:24.798 INFO:tasks.workunit.client.0.smithi097.stderr: -288> 2024-09-14T11:07:24.451+0000 7fbbdc25c640 1 monclient: found mon.noname-a 2024-09-14T11:07:24.798 INFO:tasks.workunit.client.0.smithi097.stderr: -287> 2024-09-14T11:07:24.451+0000 7fbbdc25c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-14T11:07:24.799 INFO:tasks.workunit.client.0.smithi097.stderr: -286> 2024-09-14T11:07:24.452+0000 7fbab3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:07:24.799 INFO:tasks.workunit.client.0.smithi097.stderr: -285> 2024-09-14T11:07:24.452+0000 7fbab3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:07:24.799 INFO:tasks.workunit.client.0.smithi097.stderr: -284> 2024-09-14T11:07:24.452+0000 7fbab3fff640 10 monclient: dump: 2024-09-14T11:07:24.799 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:07:24.799 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:07:24.799 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:24.799 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:24.799 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:07:24.799 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:07:24.799 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:07:24.799 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:07:24.799 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:07:24.799 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:24.800 INFO:tasks.workunit.client.0.smithi097.stderr: -283> 2024-09-14T11:07:24.452+0000 7fbab3fff640 10 monclient: _finish_auth 0 2024-09-14T11:07:24.800 INFO:tasks.workunit.client.0.smithi097.stderr: -282> 2024-09-14T11:07:24.452+0000 7fbab3fff640 10 monclient: _check_auth_tickets 2024-09-14T11:07:24.800 INFO:tasks.workunit.client.0.smithi097.stderr: -281> 2024-09-14T11:07:24.452+0000 7fbab3fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:07:24.800 INFO:tasks.workunit.client.0.smithi097.stderr: -280> 2024-09-14T11:07:24.452+0000 7fbab3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:07:24.800 INFO:tasks.workunit.client.0.smithi097.stderr: -279> 2024-09-14T11:07:24.452+0000 7fbab3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:07:24.800 INFO:tasks.workunit.client.0.smithi097.stderr: -278> 2024-09-14T11:07:24.452+0000 7fbab3fff640 10 monclient: dump: 2024-09-14T11:07:24.800 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:07:24.800 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:07:24.800 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:24.800 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:24.800 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:07:24.800 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:07:24.800 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:07:24.800 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:07:24.801 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:07:24.801 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:24.801 INFO:tasks.workunit.client.0.smithi097.stderr: -277> 2024-09-14T11:07:24.452+0000 7fbbdef73800 5 monclient: authenticate success, global_id 8157 2024-09-14T11:07:24.801 INFO:tasks.workunit.client.0.smithi097.stderr: -276> 2024-09-14T11:07:24.452+0000 7fbbdef73800 10 monclient: get_monmap_and_config success 2024-09-14T11:07:24.801 INFO:tasks.workunit.client.0.smithi097.stderr: -275> 2024-09-14T11:07:24.452+0000 7fbbdef73800 4 set_mon_vals no callback set 2024-09-14T11:07:24.801 INFO:tasks.workunit.client.0.smithi097.stderr: -274> 2024-09-14T11:07:24.452+0000 7fbbdef73800 10 monclient: shutdown 2024-09-14T11:07:24.801 INFO:tasks.workunit.client.0.smithi097.stderr: -273> 2024-09-14T11:07:24.452+0000 7fbbdef73800 10 monclient: build_initial_monmap 2024-09-14T11:07:24.801 INFO:tasks.workunit.client.0.smithi097.stderr: -272> 2024-09-14T11:07:24.452+0000 7fbbdef73800 1 build_initial for_mkfs: 0 2024-09-14T11:07:24.801 INFO:tasks.workunit.client.0.smithi097.stderr: -271> 2024-09-14T11:07:24.452+0000 7fbbdef73800 10 monclient: monmap: 2024-09-14T11:07:24.801 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:07:24.801 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:07:24.801 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:07:24.801 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:07:24.801 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:07:24.802 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:07:24.802 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:07:24.802 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:07:24.802 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:07:24.802 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:24.802 INFO:tasks.workunit.client.0.smithi097.stderr: -270> 2024-09-14T11:07:24.452+0000 7fbbdef73800 5 AuthRegistry(0x558d9d89f550) adding auth protocol: cephx 2024-09-14T11:07:24.802 INFO:tasks.workunit.client.0.smithi097.stderr: -269> 2024-09-14T11:07:24.452+0000 7fbbdef73800 5 AuthRegistry(0x558d9d89f550) adding auth protocol: cephx 2024-09-14T11:07:24.802 INFO:tasks.workunit.client.0.smithi097.stderr: -268> 2024-09-14T11:07:24.452+0000 7fbbdef73800 5 AuthRegistry(0x558d9d89f550) adding auth protocol: cephx 2024-09-14T11:07:24.802 INFO:tasks.workunit.client.0.smithi097.stderr: -267> 2024-09-14T11:07:24.452+0000 7fbbdef73800 5 AuthRegistry(0x558d9d89f550) adding con mode: secure 2024-09-14T11:07:24.802 INFO:tasks.workunit.client.0.smithi097.stderr: -266> 2024-09-14T11:07:24.452+0000 7fbbdef73800 5 AuthRegistry(0x558d9d89f550) adding con mode: crc 2024-09-14T11:07:24.802 INFO:tasks.workunit.client.0.smithi097.stderr: -265> 2024-09-14T11:07:24.452+0000 7fbbdef73800 5 AuthRegistry(0x558d9d89f550) adding con mode: secure 2024-09-14T11:07:24.802 INFO:tasks.workunit.client.0.smithi097.stderr: -264> 2024-09-14T11:07:24.452+0000 7fbbdef73800 5 AuthRegistry(0x558d9d89f550) adding con mode: crc 2024-09-14T11:07:24.802 INFO:tasks.workunit.client.0.smithi097.stderr: -263> 2024-09-14T11:07:24.452+0000 7fbbdef73800 5 AuthRegistry(0x558d9d89f550) adding con mode: secure 2024-09-14T11:07:24.803 INFO:tasks.workunit.client.0.smithi097.stderr: -262> 2024-09-14T11:07:24.452+0000 7fbbdef73800 5 AuthRegistry(0x558d9d89f550) adding con mode: crc 2024-09-14T11:07:24.803 INFO:tasks.workunit.client.0.smithi097.stderr: -261> 2024-09-14T11:07:24.452+0000 7fbbdef73800 5 AuthRegistry(0x558d9d89f550) adding con mode: crc 2024-09-14T11:07:24.803 INFO:tasks.workunit.client.0.smithi097.stderr: -260> 2024-09-14T11:07:24.452+0000 7fbbdef73800 5 AuthRegistry(0x558d9d89f550) adding con mode: secure 2024-09-14T11:07:24.803 INFO:tasks.workunit.client.0.smithi097.stderr: -259> 2024-09-14T11:07:24.452+0000 7fbbdef73800 5 AuthRegistry(0x558d9d89f550) adding con mode: crc 2024-09-14T11:07:24.803 INFO:tasks.workunit.client.0.smithi097.stderr: -258> 2024-09-14T11:07:24.452+0000 7fbbdef73800 5 AuthRegistry(0x558d9d89f550) adding con mode: secure 2024-09-14T11:07:24.803 INFO:tasks.workunit.client.0.smithi097.stderr: -257> 2024-09-14T11:07:24.452+0000 7fbbdef73800 5 AuthRegistry(0x558d9d89f550) adding con mode: crc 2024-09-14T11:07:24.803 INFO:tasks.workunit.client.0.smithi097.stderr: -256> 2024-09-14T11:07:24.452+0000 7fbbdef73800 5 AuthRegistry(0x558d9d89f550) adding con mode: secure 2024-09-14T11:07:24.803 INFO:tasks.workunit.client.0.smithi097.stderr: -255> 2024-09-14T11:07:24.452+0000 7fbbdef73800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:07:24.803 INFO:tasks.workunit.client.0.smithi097.stderr: -254> 2024-09-14T11:07:24.452+0000 7fbbdef73800 1 librados: starting msgr at 2024-09-14T11:07:24.803 INFO:tasks.workunit.client.0.smithi097.stderr: -253> 2024-09-14T11:07:24.452+0000 7fbbdef73800 1 librados: starting objecter 2024-09-14T11:07:24.803 INFO:tasks.workunit.client.0.smithi097.stderr: -252> 2024-09-14T11:07:24.453+0000 7fbbdef73800 5 asok(0x558d9d5bb270) register_command objecter_requests cmddesc objecter_requests hook 0x558d9d87e3c0 EEXIST 2024-09-14T11:07:24.803 INFO:tasks.workunit.client.0.smithi097.stderr: -251> 2024-09-14T11:07:24.453+0000 7fbbdef73800 1 librados: setting wanted keys 2024-09-14T11:07:24.803 INFO:tasks.workunit.client.0.smithi097.stderr: -250> 2024-09-14T11:07:24.453+0000 7fbbdef73800 1 librados: calling monclient init 2024-09-14T11:07:24.803 INFO:tasks.workunit.client.0.smithi097.stderr: -249> 2024-09-14T11:07:24.453+0000 7fbbdef73800 10 monclient: init 2024-09-14T11:07:24.804 INFO:tasks.workunit.client.0.smithi097.stderr: -248> 2024-09-14T11:07:24.453+0000 7fbbdef73800 5 AuthRegistry(0x558d9d86f110) adding auth protocol: cephx 2024-09-14T11:07:24.804 INFO:tasks.workunit.client.0.smithi097.stderr: -247> 2024-09-14T11:07:24.453+0000 7fbbdef73800 5 AuthRegistry(0x558d9d86f110) adding auth protocol: cephx 2024-09-14T11:07:24.804 INFO:tasks.workunit.client.0.smithi097.stderr: -246> 2024-09-14T11:07:24.453+0000 7fbbdef73800 5 AuthRegistry(0x558d9d86f110) adding auth protocol: cephx 2024-09-14T11:07:24.804 INFO:tasks.workunit.client.0.smithi097.stderr: -245> 2024-09-14T11:07:24.453+0000 7fbbdef73800 5 AuthRegistry(0x558d9d86f110) adding con mode: secure 2024-09-14T11:07:24.804 INFO:tasks.workunit.client.0.smithi097.stderr: -244> 2024-09-14T11:07:24.453+0000 7fbbdef73800 5 AuthRegistry(0x558d9d86f110) adding con mode: crc 2024-09-14T11:07:24.804 INFO:tasks.workunit.client.0.smithi097.stderr: -243> 2024-09-14T11:07:24.453+0000 7fbbdef73800 5 AuthRegistry(0x558d9d86f110) adding con mode: secure 2024-09-14T11:07:24.804 INFO:tasks.workunit.client.0.smithi097.stderr: -242> 2024-09-14T11:07:24.453+0000 7fbbdef73800 5 AuthRegistry(0x558d9d86f110) adding con mode: crc 2024-09-14T11:07:24.804 INFO:tasks.workunit.client.0.smithi097.stderr: -241> 2024-09-14T11:07:24.453+0000 7fbbdef73800 5 AuthRegistry(0x558d9d86f110) adding con mode: secure 2024-09-14T11:07:24.804 INFO:tasks.workunit.client.0.smithi097.stderr: -240> 2024-09-14T11:07:24.453+0000 7fbbdef73800 5 AuthRegistry(0x558d9d86f110) adding con mode: crc 2024-09-14T11:07:24.804 INFO:tasks.workunit.client.0.smithi097.stderr: -239> 2024-09-14T11:07:24.453+0000 7fbbdef73800 5 AuthRegistry(0x558d9d86f110) adding con mode: crc 2024-09-14T11:07:24.804 INFO:tasks.workunit.client.0.smithi097.stderr: -238> 2024-09-14T11:07:24.453+0000 7fbbdef73800 5 AuthRegistry(0x558d9d86f110) adding con mode: secure 2024-09-14T11:07:24.804 INFO:tasks.workunit.client.0.smithi097.stderr: -237> 2024-09-14T11:07:24.453+0000 7fbbdef73800 5 AuthRegistry(0x558d9d86f110) adding con mode: crc 2024-09-14T11:07:24.804 INFO:tasks.workunit.client.0.smithi097.stderr: -236> 2024-09-14T11:07:24.453+0000 7fbbdef73800 5 AuthRegistry(0x558d9d86f110) adding con mode: secure 2024-09-14T11:07:24.805 INFO:tasks.workunit.client.0.smithi097.stderr: -235> 2024-09-14T11:07:24.453+0000 7fbbdef73800 5 AuthRegistry(0x558d9d86f110) adding con mode: crc 2024-09-14T11:07:24.805 INFO:tasks.workunit.client.0.smithi097.stderr: -234> 2024-09-14T11:07:24.453+0000 7fbbdef73800 5 AuthRegistry(0x558d9d86f110) adding con mode: secure 2024-09-14T11:07:24.805 INFO:tasks.workunit.client.0.smithi097.stderr: -233> 2024-09-14T11:07:24.453+0000 7fbbdef73800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:07:24.805 INFO:tasks.workunit.client.0.smithi097.stderr: -232> 2024-09-14T11:07:24.453+0000 7fbbdef73800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:07:24.805 INFO:tasks.workunit.client.0.smithi097.stderr: -231> 2024-09-14T11:07:24.453+0000 7fbbdef73800 5 asok(0x558d9d5bb270) register_command rotate-key cmddesc rotate-key hook 0x558d9d86f258 EEXIST 2024-09-14T11:07:24.805 INFO:tasks.workunit.client.0.smithi097.stderr: -230> 2024-09-14T11:07:24.453+0000 7fbbdef73800 10 monclient: _reopen_session rank -1 2024-09-14T11:07:24.805 INFO:tasks.workunit.client.0.smithi097.stderr: -229> 2024-09-14T11:07:24.453+0000 7fbbdef73800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:07:24.805 INFO:tasks.workunit.client.0.smithi097.stderr: -228> 2024-09-14T11:07:24.453+0000 7fbbdef73800 10 monclient(hunting): picked mon.noname-a con 0x558d9d87fd70 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:07:24.805 INFO:tasks.workunit.client.0.smithi097.stderr: -227> 2024-09-14T11:07:24.453+0000 7fbbdef73800 10 monclient(hunting): picked mon.noname-c con 0x558d9d8aa240 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:07:24.805 INFO:tasks.workunit.client.0.smithi097.stderr: -226> 2024-09-14T11:07:24.453+0000 7fbbdef73800 10 monclient(hunting): picked mon.noname-b con 0x558d9d8aed60 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:07:24.805 INFO:tasks.workunit.client.0.smithi097.stderr: -225> 2024-09-14T11:07:24.453+0000 7fbbdef73800 10 monclient(hunting): start opening mon connection 2024-09-14T11:07:24.805 INFO:tasks.workunit.client.0.smithi097.stderr: -224> 2024-09-14T11:07:24.453+0000 7fbbdef73800 10 monclient(hunting): start opening mon connection 2024-09-14T11:07:24.805 INFO:tasks.workunit.client.0.smithi097.stderr: -223> 2024-09-14T11:07:24.453+0000 7fbbdef73800 10 monclient(hunting): start opening mon connection 2024-09-14T11:07:24.805 INFO:tasks.workunit.client.0.smithi097.stderr: -222> 2024-09-14T11:07:24.453+0000 7fbbdef73800 10 monclient(hunting): _renew_subs 2024-09-14T11:07:24.806 INFO:tasks.workunit.client.0.smithi097.stderr: -221> 2024-09-14T11:07:24.453+0000 7fbbdef73800 10 monclient(hunting): authenticate will time out at 2126.107651s 2024-09-14T11:07:24.806 INFO:tasks.workunit.client.0.smithi097.stderr: -220> 2024-09-14T11:07:24.453+0000 7fbbdd25e640 10 monclient(hunting): get_auth_request con 0x558d9d8aa240 auth_method 0 2024-09-14T11:07:24.806 INFO:tasks.workunit.client.0.smithi097.stderr: -219> 2024-09-14T11:07:24.453+0000 7fbbdd25e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:07:24.806 INFO:tasks.workunit.client.0.smithi097.stderr: -218> 2024-09-14T11:07:24.453+0000 7fbbdd25e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:07:24.806 INFO:tasks.workunit.client.0.smithi097.stderr: -217> 2024-09-14T11:07:24.453+0000 7fbbdd25e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:07:24.806 INFO:tasks.workunit.client.0.smithi097.stderr: -216> 2024-09-14T11:07:24.453+0000 7fbbdc25c640 10 monclient(hunting): get_auth_request con 0x558d9d87fd70 auth_method 0 2024-09-14T11:07:24.806 INFO:tasks.workunit.client.0.smithi097.stderr: -215> 2024-09-14T11:07:24.453+0000 7fbbdc25c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:07:24.806 INFO:tasks.workunit.client.0.smithi097.stderr: -214> 2024-09-14T11:07:24.453+0000 7fbbdc25c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:07:24.806 INFO:tasks.workunit.client.0.smithi097.stderr: -213> 2024-09-14T11:07:24.453+0000 7fbbdc25c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:07:24.806 INFO:tasks.workunit.client.0.smithi097.stderr: -212> 2024-09-14T11:07:24.453+0000 7fbbdca5d640 10 monclient(hunting): get_auth_request con 0x558d9d8aed60 auth_method 0 2024-09-14T11:07:24.806 INFO:tasks.workunit.client.0.smithi097.stderr: -211> 2024-09-14T11:07:24.453+0000 7fbbdca5d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:07:24.806 INFO:tasks.workunit.client.0.smithi097.stderr: -210> 2024-09-14T11:07:24.453+0000 7fbbdca5d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:07:24.806 INFO:tasks.workunit.client.0.smithi097.stderr: -209> 2024-09-14T11:07:24.453+0000 7fbbdca5d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:07:24.807 INFO:tasks.workunit.client.0.smithi097.stderr: -208> 2024-09-14T11:07:24.453+0000 7fbbdd25e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:07:24.807 INFO:tasks.workunit.client.0.smithi097.stderr: -207> 2024-09-14T11:07:24.453+0000 7fbbdd25e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:07:24.807 INFO:tasks.workunit.client.0.smithi097.stderr: -206> 2024-09-14T11:07:24.453+0000 7fbbdd25e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:07:24.807 INFO:tasks.workunit.client.0.smithi097.stderr: -205> 2024-09-14T11:07:24.453+0000 7fbbdc25c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:07:24.807 INFO:tasks.workunit.client.0.smithi097.stderr: -204> 2024-09-14T11:07:24.453+0000 7fbbdc25c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:07:24.807 INFO:tasks.workunit.client.0.smithi097.stderr: -203> 2024-09-14T11:07:24.453+0000 7fbbdc25c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:07:24.807 INFO:tasks.workunit.client.0.smithi097.stderr: -202> 2024-09-14T11:07:24.453+0000 7fbbdca5d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:07:24.807 INFO:tasks.workunit.client.0.smithi097.stderr: -201> 2024-09-14T11:07:24.453+0000 7fbbdca5d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:07:24.807 INFO:tasks.workunit.client.0.smithi097.stderr: -200> 2024-09-14T11:07:24.453+0000 7fbbdca5d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:07:24.807 INFO:tasks.workunit.client.0.smithi097.stderr: -199> 2024-09-14T11:07:24.453+0000 7fbbdc25c640 10 monclient(hunting): handle_auth_done global_id 8160 payload 824 2024-09-14T11:07:24.807 INFO:tasks.workunit.client.0.smithi097.stderr: -198> 2024-09-14T11:07:24.453+0000 7fbbdc25c640 10 monclient: _finish_hunting 0 2024-09-14T11:07:24.807 INFO:tasks.workunit.client.0.smithi097.stderr: -197> 2024-09-14T11:07:24.453+0000 7fbbdc25c640 1 monclient: found mon.noname-a 2024-09-14T11:07:24.807 INFO:tasks.workunit.client.0.smithi097.stderr: -196> 2024-09-14T11:07:24.453+0000 7fbbdc25c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-14T11:07:24.807 INFO:tasks.workunit.client.0.smithi097.stderr: -195> 2024-09-14T11:07:24.454+0000 7fbab27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:07:24.808 INFO:tasks.workunit.client.0.smithi097.stderr: -194> 2024-09-14T11:07:24.454+0000 7fbab27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:07:24.808 INFO:tasks.workunit.client.0.smithi097.stderr: -193> 2024-09-14T11:07:24.454+0000 7fbab27fc640 10 monclient: dump: 2024-09-14T11:07:24.808 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:07:24.808 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:07:24.808 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:24.808 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:24.808 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:07:24.808 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:07:24.808 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:07:24.808 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:07:24.808 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:07:24.808 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:24.808 INFO:tasks.workunit.client.0.smithi097.stderr: -192> 2024-09-14T11:07:24.454+0000 7fbab27fc640 10 monclient: _finish_auth 0 2024-09-14T11:07:24.808 INFO:tasks.workunit.client.0.smithi097.stderr: -191> 2024-09-14T11:07:24.454+0000 7fbab27fc640 10 monclient: _check_auth_tickets 2024-09-14T11:07:24.809 INFO:tasks.workunit.client.0.smithi097.stderr: -190> 2024-09-14T11:07:24.454+0000 7fbab27fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:07:24.809 INFO:tasks.workunit.client.0.smithi097.stderr: -189> 2024-09-14T11:07:24.454+0000 7fbab27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:07:24.809 INFO:tasks.workunit.client.0.smithi097.stderr: -188> 2024-09-14T11:07:24.454+0000 7fbab27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:07:24.809 INFO:tasks.workunit.client.0.smithi097.stderr: -187> 2024-09-14T11:07:24.454+0000 7fbab27fc640 10 monclient: dump: 2024-09-14T11:07:24.809 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:07:24.809 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:07:24.809 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:24.809 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:24.809 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:07:24.809 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:07:24.809 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:07:24.809 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:07:24.809 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:07:24.810 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:24.810 INFO:tasks.workunit.client.0.smithi097.stderr: -186> 2024-09-14T11:07:24.454+0000 7fbbdef73800 5 monclient: authenticate success, global_id 8160 2024-09-14T11:07:24.810 INFO:tasks.workunit.client.0.smithi097.stderr: -185> 2024-09-14T11:07:24.454+0000 7fbab3fff640 4 set_mon_vals no callback set 2024-09-14T11:07:24.810 INFO:tasks.workunit.client.0.smithi097.stderr: -184> 2024-09-14T11:07:24.454+0000 7fbbdef73800 10 monclient: _renew_subs 2024-09-14T11:07:24.810 INFO:tasks.workunit.client.0.smithi097.stderr: -183> 2024-09-14T11:07:24.454+0000 7fbbdef73800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:07:24.810 INFO:tasks.workunit.client.0.smithi097.stderr: -182> 2024-09-14T11:07:24.454+0000 7fbbdef73800 10 monclient: _renew_subs 2024-09-14T11:07:24.810 INFO:tasks.workunit.client.0.smithi097.stderr: -181> 2024-09-14T11:07:24.454+0000 7fbbdef73800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:07:24.810 INFO:tasks.workunit.client.0.smithi097.stderr: -180> 2024-09-14T11:07:24.454+0000 7fbbdef73800 1 librados: init done 2024-09-14T11:07:24.810 INFO:tasks.workunit.client.0.smithi097.stderr: -179> 2024-09-14T11:07:24.454+0000 7fbbdef73800 5 asok(0x558d9d5bb270) register_command cr dump hook 0x558d9d8a8358 2024-09-14T11:07:24.810 INFO:tasks.workunit.client.0.smithi097.stderr: -178> 2024-09-14T11:07:24.456+0000 7fbbdef73800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.810 INFO:tasks.workunit.client.0.smithi097.stderr: -177> 2024-09-14T11:07:24.456+0000 7fbab27fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:07:24.810 INFO:tasks.workunit.client.0.smithi097.stderr: -176> 2024-09-14T11:07:24.456+0000 7fbab27fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:07:24.810 INFO:tasks.workunit.client.0.smithi097.stderr: -175> 2024-09-14T11:07:24.456+0000 7fbab27fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:07:24.810 INFO:tasks.workunit.client.0.smithi097.stderr: -174> 2024-09-14T11:07:24.456+0000 7fbbdd25e640 10 monclient: get_auth_request con 0x7fbaa8077230 auth_method 0 2024-09-14T11:07:24.810 INFO:tasks.workunit.client.0.smithi097.stderr: -173> 2024-09-14T11:07:24.457+0000 7fbbdca5d640 10 monclient: get_auth_request con 0x558d9d8c8ad0 auth_method 0 2024-09-14T11:07:24.811 INFO:tasks.workunit.client.0.smithi097.stderr: -172> 2024-09-14T11:07:24.457+0000 7fbbdef73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:24.811 INFO:tasks.workunit.client.0.smithi097.stderr: -171> 2024-09-14T11:07:24.457+0000 7fbbdef73800 20 realm 2024-09-14T11:07:24.811 INFO:tasks.workunit.client.0.smithi097.stderr: -170> 2024-09-14T11:07:24.457+0000 7fbbdef73800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.811 INFO:tasks.workunit.client.0.smithi097.stderr: -169> 2024-09-14T11:07:24.458+0000 7fbbdef73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:24.811 INFO:tasks.workunit.client.0.smithi097.stderr: -168> 2024-09-14T11:07:24.458+0000 7fbbdef73800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:07:24.811 INFO:tasks.workunit.client.0.smithi097.stderr: -167> 2024-09-14T11:07:24.458+0000 7fbbdef73800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.811 INFO:tasks.workunit.client.0.smithi097.stderr: -166> 2024-09-14T11:07:24.458+0000 7fbbdef73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:24.811 INFO:tasks.workunit.client.0.smithi097.stderr: -165> 2024-09-14T11:07:24.458+0000 7fbbdef73800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.811 INFO:tasks.workunit.client.0.smithi097.stderr: -164> 2024-09-14T11:07:24.458+0000 7fbbdc25c640 10 monclient: get_auth_request con 0x558d9d8cccd0 auth_method 0 2024-09-14T11:07:24.811 INFO:tasks.workunit.client.0.smithi097.stderr: -163> 2024-09-14T11:07:24.458+0000 7fbbdef73800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:07:24.811 INFO:tasks.workunit.client.0.smithi097.stderr: -162> 2024-09-14T11:07:24.459+0000 7fbbdef73800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.811 INFO:tasks.workunit.client.0.smithi097.stderr: -161> 2024-09-14T11:07:24.459+0000 7fbbdd25e640 10 monclient: get_auth_request con 0x558d9d8d0530 auth_method 0 2024-09-14T11:07:24.811 INFO:tasks.workunit.client.0.smithi097.stderr: -160> 2024-09-14T11:07:24.459+0000 7fbbdef73800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:07:24.812 INFO:tasks.workunit.client.0.smithi097.stderr: -159> 2024-09-14T11:07:24.459+0000 7fbbdef73800 20 searching for the correct realm 2024-09-14T11:07:24.812 INFO:tasks.workunit.client.0.smithi097.stderr: -158> 2024-09-14T11:07:24.460+0000 7fbbdca5d640 10 monclient: get_auth_request con 0x558d9d8d52f0 auth_method 0 2024-09-14T11:07:24.812 INFO:tasks.workunit.client.0.smithi097.stderr: -157> 2024-09-14T11:07:24.460+0000 7fbbdc25c640 10 monclient: get_auth_request con 0x7fbbcc018070 auth_method 0 2024-09-14T11:07:24.812 INFO:tasks.workunit.client.0.smithi097.stderr: -156> 2024-09-14T11:07:24.461+0000 7fbbdc25c640 0 -- 172.21.15.97:0/3149427196 >> [v2:172.21.15.97:6816/4093696477,v1:172.21.15.97:6817/4093696477] conn(0x558d9d8cccd0 msgr2=0x558d9d8cf100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:07:24.812 INFO:tasks.workunit.client.0.smithi097.stderr: -155> 2024-09-14T11:07:24.461+0000 7fbab27fc640 1 client.8160.objecter ms_handle_reset 0x558d9d8cccd0 session 0x558d9d8cc650 osd.1 2024-09-14T11:07:24.812 INFO:tasks.workunit.client.0.smithi097.stderr: -154> 2024-09-14T11:07:24.461+0000 7fbab27fc640 10 monclient: _renew_subs 2024-09-14T11:07:24.812 INFO:tasks.workunit.client.0.smithi097.stderr: -153> 2024-09-14T11:07:24.461+0000 7fbab27fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:07:24.812 INFO:tasks.workunit.client.0.smithi097.stderr: -152> 2024-09-14T11:07:24.461+0000 7fbbdd25e640 10 monclient: get_auth_request con 0x7fbbc4032060 auth_method 0 2024-09-14T11:07:24.812 INFO:tasks.workunit.client.0.smithi097.stderr: -151> 2024-09-14T11:07:24.462+0000 7fbbdc25c640 10 monclient: get_auth_request con 0x7fbaa8086d50 auth_method 0 2024-09-14T11:07:24.812 INFO:tasks.workunit.client.0.smithi097.stderr: -150> 2024-09-14T11:07:24.464+0000 7fbbdca5d640 10 monclient: get_auth_request con 0x7fbbc407ad30 auth_method 0 2024-09-14T11:07:24.812 INFO:tasks.workunit.client.0.smithi097.stderr: -149> 2024-09-14T11:07:24.464+0000 7fbbdc25c640 0 -- 172.21.15.97:0/3149427196 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7fbbcc0333f0 msgr2=0x7fbbcc033850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:07:24.812 INFO:tasks.workunit.client.0.smithi097.stderr: -148> 2024-09-14T11:07:24.666+0000 7fbbdc25c640 10 monclient: get_auth_request con 0x7fbbcc0333f0 auth_method 0 2024-09-14T11:07:24.812 INFO:tasks.workunit.client.0.smithi097.stderr: -147> 2024-09-14T11:07:24.670+0000 7fbbdef73800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:07:24.813 INFO:tasks.workunit.client.0.smithi097.stderr: -146> 2024-09-14T11:07:24.670+0000 7fbbdef73800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:07:24.813 INFO:tasks.workunit.client.0.smithi097.stderr: -145> 2024-09-14T11:07:24.670+0000 7fbbdef73800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:07:24.813 INFO:tasks.workunit.client.0.smithi097.stderr: -144> 2024-09-14T11:07:24.670+0000 7fbbdef73800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:07:24.813 INFO:tasks.workunit.client.0.smithi097.stderr: -143> 2024-09-14T11:07:24.670+0000 7fbbdef73800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:07:24.813 INFO:tasks.workunit.client.0.smithi097.stderr: -142> 2024-09-14T11:07:24.670+0000 7fbbdef73800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:07:24.813 INFO:tasks.workunit.client.0.smithi097.stderr: -141> 2024-09-14T11:07:24.670+0000 7fbbdef73800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.813 INFO:tasks.workunit.client.0.smithi097.stderr: -140> 2024-09-14T11:07:24.671+0000 7fbbdef73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:24.813 INFO:tasks.workunit.client.0.smithi097.stderr: -139> 2024-09-14T11:07:24.671+0000 7fbbdef73800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.813 INFO:tasks.workunit.client.0.smithi097.stderr: -138> 2024-09-14T11:07:24.671+0000 7fbbdef73800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:07:24.813 INFO:tasks.workunit.client.0.smithi097.stderr: -137> 2024-09-14T11:07:24.671+0000 7fbbdef73800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.813 INFO:tasks.workunit.client.0.smithi097.stderr: -136> 2024-09-14T11:07:24.671+0000 7fbbdef73800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:07:24.813 INFO:tasks.workunit.client.0.smithi097.stderr: -135> 2024-09-14T11:07:24.671+0000 7fbbdef73800 20 zone default found 2024-09-14T11:07:24.813 INFO:tasks.workunit.client.0.smithi097.stderr: -134> 2024-09-14T11:07:24.671+0000 7fbbdef73800 4 Realm: () 2024-09-14T11:07:24.813 INFO:tasks.workunit.client.0.smithi097.stderr: -133> 2024-09-14T11:07:24.671+0000 7fbbdef73800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:07:24.814 INFO:tasks.workunit.client.0.smithi097.stderr: -132> 2024-09-14T11:07:24.671+0000 7fbbdef73800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:07:24.814 INFO:tasks.workunit.client.0.smithi097.stderr: -131> 2024-09-14T11:07:24.671+0000 7fbbdef73800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:07:24.814 INFO:tasks.workunit.client.0.smithi097.stderr: -130> 2024-09-14T11:07:24.671+0000 7fbbdef73800 20 zonegroup default 2024-09-14T11:07:24.814 INFO:tasks.workunit.client.0.smithi097.stderr: -129> 2024-09-14T11:07:24.671+0000 7fbbdef73800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.814 INFO:tasks.workunit.client.0.smithi097.stderr: -128> 2024-09-14T11:07:24.671+0000 7fbbdef73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:24.814 INFO:tasks.workunit.client.0.smithi097.stderr: -127> 2024-09-14T11:07:24.671+0000 7fbbdef73800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.814 INFO:tasks.workunit.client.0.smithi097.stderr: -126> 2024-09-14T11:07:24.672+0000 7fbbdef73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:24.814 INFO:tasks.workunit.client.0.smithi097.stderr: -125> 2024-09-14T11:07:24.672+0000 7fbbdef73800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.814 INFO:tasks.workunit.client.0.smithi097.stderr: -124> 2024-09-14T11:07:24.672+0000 7fbbdef73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:24.814 INFO:tasks.workunit.client.0.smithi097.stderr: -123> 2024-09-14T11:07:24.672+0000 7fbbdef73800 20 started sync module instance, tier type = 2024-09-14T11:07:24.814 INFO:tasks.workunit.client.0.smithi097.stderr: -122> 2024-09-14T11:07:24.672+0000 7fbbdef73800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:07:24.814 INFO:tasks.workunit.client.0.smithi097.stderr: -121> 2024-09-14T11:07:24.680+0000 7fbbdef73800 20 add_watcher() i=0 2024-09-14T11:07:24.814 INFO:tasks.workunit.client.0.smithi097.stderr: -120> 2024-09-14T11:07:24.680+0000 7fbbdef73800 20 add_watcher() i=1 2024-09-14T11:07:24.815 INFO:tasks.workunit.client.0.smithi097.stderr: -119> 2024-09-14T11:07:24.680+0000 7fbbdef73800 20 add_watcher() i=2 2024-09-14T11:07:24.815 INFO:tasks.workunit.client.0.smithi097.stderr: -118> 2024-09-14T11:07:24.680+0000 7fbbdef73800 20 add_watcher() i=3 2024-09-14T11:07:24.815 INFO:tasks.workunit.client.0.smithi097.stderr: -117> 2024-09-14T11:07:24.680+0000 7fbbdef73800 20 add_watcher() i=4 2024-09-14T11:07:24.815 INFO:tasks.workunit.client.0.smithi097.stderr: -116> 2024-09-14T11:07:24.680+0000 7fbbdef73800 20 add_watcher() i=5 2024-09-14T11:07:24.815 INFO:tasks.workunit.client.0.smithi097.stderr: -115> 2024-09-14T11:07:24.680+0000 7fbbdef73800 20 add_watcher() i=6 2024-09-14T11:07:24.815 INFO:tasks.workunit.client.0.smithi097.stderr: -114> 2024-09-14T11:07:24.681+0000 7fbbdef73800 20 add_watcher() i=7 2024-09-14T11:07:24.815 INFO:tasks.workunit.client.0.smithi097.stderr: -113> 2024-09-14T11:07:24.681+0000 7fbbdef73800 2 all 8 watchers are set, enabling cache 2024-09-14T11:07:24.815 INFO:tasks.workunit.client.0.smithi097.stderr: -112> 2024-09-14T11:07:24.683+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5ed90) adding auth protocol: cephx 2024-09-14T11:07:24.815 INFO:tasks.workunit.client.0.smithi097.stderr: -111> 2024-09-14T11:07:24.683+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5ed90) adding auth protocol: cephx 2024-09-14T11:07:24.815 INFO:tasks.workunit.client.0.smithi097.stderr: -110> 2024-09-14T11:07:24.683+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5ed90) adding auth protocol: cephx 2024-09-14T11:07:24.815 INFO:tasks.workunit.client.0.smithi097.stderr: -109> 2024-09-14T11:07:24.683+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5ed90) adding con mode: secure 2024-09-14T11:07:24.815 INFO:tasks.workunit.client.0.smithi097.stderr: -108> 2024-09-14T11:07:24.683+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5ed90) adding con mode: crc 2024-09-14T11:07:24.815 INFO:tasks.workunit.client.0.smithi097.stderr: -107> 2024-09-14T11:07:24.683+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5ed90) adding con mode: secure 2024-09-14T11:07:24.815 INFO:tasks.workunit.client.0.smithi097.stderr: -106> 2024-09-14T11:07:24.683+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5ed90) adding con mode: crc 2024-09-14T11:07:24.816 INFO:tasks.workunit.client.0.smithi097.stderr: -105> 2024-09-14T11:07:24.683+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5ed90) adding con mode: secure 2024-09-14T11:07:24.816 INFO:tasks.workunit.client.0.smithi097.stderr: -104> 2024-09-14T11:07:24.683+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5ed90) adding con mode: crc 2024-09-14T11:07:24.816 INFO:tasks.workunit.client.0.smithi097.stderr: -103> 2024-09-14T11:07:24.683+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5ed90) adding con mode: crc 2024-09-14T11:07:24.816 INFO:tasks.workunit.client.0.smithi097.stderr: -102> 2024-09-14T11:07:24.683+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5ed90) adding con mode: secure 2024-09-14T11:07:24.816 INFO:tasks.workunit.client.0.smithi097.stderr: -101> 2024-09-14T11:07:24.683+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5ed90) adding con mode: crc 2024-09-14T11:07:24.816 INFO:tasks.workunit.client.0.smithi097.stderr: -100> 2024-09-14T11:07:24.683+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5ed90) adding con mode: secure 2024-09-14T11:07:24.816 INFO:tasks.workunit.client.0.smithi097.stderr: -99> 2024-09-14T11:07:24.683+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5ed90) adding con mode: crc 2024-09-14T11:07:24.816 INFO:tasks.workunit.client.0.smithi097.stderr: -98> 2024-09-14T11:07:24.683+0000 7fbbdef73800 5 AuthRegistry(0x7fffa7a5ed90) adding con mode: secure 2024-09-14T11:07:24.816 INFO:tasks.workunit.client.0.smithi097.stderr: -97> 2024-09-14T11:07:24.683+0000 7fba92fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:07:24.816 INFO:tasks.workunit.client.0.smithi097.stderr: -96> 2024-09-14T11:07:24.683+0000 7fbbdef73800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:07:24.816 INFO:tasks.workunit.client.0.smithi097.stderr: -95> 2024-09-14T11:07:24.683+0000 7fbbdef73800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:07:24.816 INFO:tasks.workunit.client.0.smithi097.stderr: -94> 2024-09-14T11:07:24.683+0000 7fbbdef73800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:07:24.817 INFO:tasks.workunit.client.0.smithi097.stderr: -93> 2024-09-14T11:07:24.683+0000 7fbbdef73800 5 asok(0x558d9d5bb270) register_command cache list hook 0x558d9d8a5460 2024-09-14T11:07:24.817 INFO:tasks.workunit.client.0.smithi097.stderr: -92> 2024-09-14T11:07:24.683+0000 7fbbdef73800 5 asok(0x558d9d5bb270) register_command cache inspect hook 0x558d9d8a5460 2024-09-14T11:07:24.817 INFO:tasks.workunit.client.0.smithi097.stderr: -91> 2024-09-14T11:07:24.683+0000 7fbbdef73800 5 asok(0x558d9d5bb270) register_command cache erase hook 0x558d9d8a5460 2024-09-14T11:07:24.817 INFO:tasks.workunit.client.0.smithi097.stderr: -90> 2024-09-14T11:07:24.683+0000 7fbbdef73800 5 asok(0x558d9d5bb270) register_command cache zap hook 0x558d9d8a5460 2024-09-14T11:07:24.817 INFO:tasks.workunit.client.0.smithi097.stderr: -89> 2024-09-14T11:07:24.683+0000 7fbbdef73800 5 note: GC not initialized 2024-09-14T11:07:24.817 INFO:tasks.workunit.client.0.smithi097.stderr: -88> 2024-09-14T11:07:24.683+0000 7fba91fe3640 20 reqs_thread_entry: start 2024-09-14T11:07:24.817 INFO:tasks.workunit.client.0.smithi097.stderr: -87> 2024-09-14T11:07:24.684+0000 7fbbdef73800 5 asok(0x558d9d5bb270) register_command sync trace show hook 0x7fbbcc00a900 2024-09-14T11:07:24.817 INFO:tasks.workunit.client.0.smithi097.stderr: -86> 2024-09-14T11:07:24.684+0000 7fbbdef73800 5 asok(0x558d9d5bb270) register_command sync trace history hook 0x7fbbcc00a900 2024-09-14T11:07:24.817 INFO:tasks.workunit.client.0.smithi097.stderr: -85> 2024-09-14T11:07:24.684+0000 7fbbdef73800 5 asok(0x558d9d5bb270) register_command sync trace active hook 0x7fbbcc00a900 2024-09-14T11:07:24.817 INFO:tasks.workunit.client.0.smithi097.stderr: -84> 2024-09-14T11:07:24.684+0000 7fbbdef73800 5 asok(0x558d9d5bb270) register_command sync trace active_short hook 0x7fbbcc00a900 2024-09-14T11:07:24.817 INFO:tasks.workunit.client.0.smithi097.stderr: -83> 2024-09-14T11:07:24.684+0000 7fbbdef73800 20 init_complete bucket index max shards: 11 2024-09-14T11:07:24.817 INFO:tasks.workunit.client.0.smithi097.stderr: -82> 2024-09-14T11:07:24.684+0000 7fbbdef73800 20 Filter name: none 2024-09-14T11:07:24.817 INFO:tasks.workunit.client.0.smithi097.stderr: -81> 2024-09-14T11:07:24.684+0000 7fba037fe640 20 reqs_thread_entry: start 2024-09-14T11:07:24.818 INFO:tasks.workunit.client.0.smithi097.stderr: -80> 2024-09-14T11:07:24.684+0000 7fbbdef73800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:07:24.818 INFO:tasks.workunit.client.0.smithi097.stderr: -79> 2024-09-14T11:07:24.684+0000 7fbbdef73800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.818 INFO:tasks.workunit.client.0.smithi097.stderr: -78> 2024-09-14T11:07:24.684+0000 7fbbdef73800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:07:24.818 INFO:tasks.workunit.client.0.smithi097.stderr: -77> 2024-09-14T11:07:24.684+0000 7fbbdef73800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:07:24.818 INFO:tasks.workunit.client.0.smithi097.stderr: -76> 2024-09-14T11:07:24.684+0000 7fbbdef73800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:07:24.818 INFO:tasks.workunit.client.0.smithi097.stderr: -75> 2024-09-14T11:07:24.684+0000 7fbbdef73800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 : miss 2024-09-14T11:07:24.818 INFO:tasks.workunit.client.0.smithi097.stderr: -74> 2024-09-14T11:07:24.684+0000 7fbbdef73800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.818 INFO:tasks.workunit.client.0.smithi097.stderr: -73> 2024-09-14T11:07:24.685+0000 7fbbdef73800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:07:24.818 INFO:tasks.workunit.client.0.smithi097.stderr: -72> 2024-09-14T11:07:24.685+0000 7fbbdef73800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:07:24.818 INFO:tasks.workunit.client.0.smithi097.stderr: -71> 2024-09-14T11:07:24.685+0000 7fbbdef73800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:07:24.818 INFO:tasks.workunit.client.0.smithi097.stderr: -70> 2024-09-14T11:07:24.685+0000 7fbbdef73800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:07:24.818 INFO:tasks.workunit.client.0.smithi097.stderr: -69> 2024-09-14T11:07:24.685+0000 7fbbdef73800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:07:24.818 INFO:tasks.workunit.client.0.smithi097.stderr: -68> 2024-09-14T11:07:24.685+0000 7fbbdef73800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 2024-09-14T11:07:24.818 INFO:tasks.workunit.client.0.smithi097.stderr: -67> 2024-09-14T11:07:24.690+0000 7fbbdef73800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:07:24.819 INFO:tasks.workunit.client.0.smithi097.stderr: -66> 2024-09-14T11:07:24.690+0000 7fbbdef73800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:07:24.819 INFO:tasks.workunit.client.0.smithi097.stderr: -65> 2024-09-14T11:07:24.690+0000 7fbbdef73800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:07:24.819 INFO:tasks.workunit.client.0.smithi097.stderr: -64> 2024-09-14T11:07:24.690+0000 7fbbdef73800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17, ofs0, ns] 2024-09-14T11:07:24.819 INFO:tasks.workunit.client.0.smithi097.stderr: -63> 2024-09-14T11:07:24.690+0000 7fbab3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595243 cookie 94066722056800 notifier 8160 bl.length()=827 2024-09-14T11:07:24.819 INFO:tasks.workunit.client.0.smithi097.stderr: -62> 2024-09-14T11:07:24.690+0000 7fbab3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:07:24.819 INFO:tasks.workunit.client.0.smithi097.stderr: -61> 2024-09-14T11:07:24.690+0000 7fbab3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:07:24.819 INFO:tasks.workunit.client.0.smithi097.stderr: -60> 2024-09-14T11:07:24.690+0000 7fbab3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:07:24.819 INFO:tasks.workunit.client.0.smithi097.stderr: -59> 2024-09-14T11:07:24.691+0000 7fbbdef73800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): orig_sources= new_sources= 2024-09-14T11:07:24.819 INFO:tasks.workunit.client.0.smithi097.stderr: -58> 2024-09-14T11:07:24.691+0000 7fbbdef73800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): potential sources added=[] removed=[] 2024-09-14T11:07:24.819 INFO:tasks.workunit.client.0.smithi097.stderr: -57> 2024-09-14T11:07:24.691+0000 7fbbdef73800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): orig_dests= new_dests= 2024-09-14T11:07:24.819 INFO:tasks.workunit.client.0.smithi097.stderr: -56> 2024-09-14T11:07:24.691+0000 7fbbdef73800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): potential dests added=[] removed=[] 2024-09-14T11:07:24.819 INFO:tasks.workunit.client.0.smithi097.stderr: -55> 2024-09-14T11:07:24.695+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.0 2024-09-14T11:07:24.819 INFO:tasks.workunit.client.0.smithi097.stderr: -54> 2024-09-14T11:07:24.695+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.0 2024-09-14T11:07:24.819 INFO:tasks.workunit.client.0.smithi097.stderr: -53> 2024-09-14T11:07:24.695+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.1 2024-09-14T11:07:24.819 INFO:tasks.workunit.client.0.smithi097.stderr: -52> 2024-09-14T11:07:24.695+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.1 2024-09-14T11:07:24.820 INFO:tasks.workunit.client.0.smithi097.stderr: -51> 2024-09-14T11:07:24.695+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.2 2024-09-14T11:07:24.820 INFO:tasks.workunit.client.0.smithi097.stderr: -50> 2024-09-14T11:07:24.695+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.2 2024-09-14T11:07:24.820 INFO:tasks.workunit.client.0.smithi097.stderr: -49> 2024-09-14T11:07:24.695+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.3 2024-09-14T11:07:24.820 INFO:tasks.workunit.client.0.smithi097.stderr: -48> 2024-09-14T11:07:24.695+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.3 2024-09-14T11:07:24.820 INFO:tasks.workunit.client.0.smithi097.stderr: -47> 2024-09-14T11:07:24.695+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.4 2024-09-14T11:07:24.820 INFO:tasks.workunit.client.0.smithi097.stderr: -46> 2024-09-14T11:07:24.695+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.4 2024-09-14T11:07:24.820 INFO:tasks.workunit.client.0.smithi097.stderr: -45> 2024-09-14T11:07:24.695+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.5 2024-09-14T11:07:24.820 INFO:tasks.workunit.client.0.smithi097.stderr: -44> 2024-09-14T11:07:24.695+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.5 2024-09-14T11:07:24.820 INFO:tasks.workunit.client.0.smithi097.stderr: -43> 2024-09-14T11:07:24.695+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.6 2024-09-14T11:07:24.820 INFO:tasks.workunit.client.0.smithi097.stderr: -42> 2024-09-14T11:07:24.695+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.6 2024-09-14T11:07:24.820 INFO:tasks.workunit.client.0.smithi097.stderr: -41> 2024-09-14T11:07:24.695+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.7 2024-09-14T11:07:24.820 INFO:tasks.workunit.client.0.smithi097.stderr: -40> 2024-09-14T11:07:24.695+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.7 2024-09-14T11:07:24.820 INFO:tasks.workunit.client.0.smithi097.stderr: -39> 2024-09-14T11:07:24.695+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.8 2024-09-14T11:07:24.820 INFO:tasks.workunit.client.0.smithi097.stderr: -38> 2024-09-14T11:07:24.695+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.8 2024-09-14T11:07:24.821 INFO:tasks.workunit.client.0.smithi097.stderr: -37> 2024-09-14T11:07:24.695+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.9 2024-09-14T11:07:24.821 INFO:tasks.workunit.client.0.smithi097.stderr: -36> 2024-09-14T11:07:24.695+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.9 2024-09-14T11:07:24.821 INFO:tasks.workunit.client.0.smithi097.stderr: -35> 2024-09-14T11:07:24.695+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.10 2024-09-14T11:07:24.821 INFO:tasks.workunit.client.0.smithi097.stderr: -34> 2024-09-14T11:07:24.695+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.10 2024-09-14T11:07:24.821 INFO:tasks.workunit.client.0.smithi097.stderr: -33> 2024-09-14T11:07:24.695+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.11 2024-09-14T11:07:24.821 INFO:tasks.workunit.client.0.smithi097.stderr: -32> 2024-09-14T11:07:24.695+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.11 2024-09-14T11:07:24.821 INFO:tasks.workunit.client.0.smithi097.stderr: -31> 2024-09-14T11:07:24.695+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.12 2024-09-14T11:07:24.821 INFO:tasks.workunit.client.0.smithi097.stderr: -30> 2024-09-14T11:07:24.695+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.12 2024-09-14T11:07:24.821 INFO:tasks.workunit.client.0.smithi097.stderr: -29> 2024-09-14T11:07:24.695+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.13 2024-09-14T11:07:24.821 INFO:tasks.workunit.client.0.smithi097.stderr: -28> 2024-09-14T11:07:24.695+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.13 2024-09-14T11:07:24.821 INFO:tasks.workunit.client.0.smithi097.stderr: -27> 2024-09-14T11:07:24.695+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.0 2024-09-14T11:07:24.821 INFO:tasks.workunit.client.0.smithi097.stderr: -26> 2024-09-14T11:07:24.695+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.0 2024-09-14T11:07:24.821 INFO:tasks.workunit.client.0.smithi097.stderr: -25> 2024-09-14T11:07:24.696+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.1 2024-09-14T11:07:24.821 INFO:tasks.workunit.client.0.smithi097.stderr: -24> 2024-09-14T11:07:24.696+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.1 2024-09-14T11:07:24.822 INFO:tasks.workunit.client.0.smithi097.stderr: -23> 2024-09-14T11:07:24.696+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.2 2024-09-14T11:07:24.822 INFO:tasks.workunit.client.0.smithi097.stderr: -22> 2024-09-14T11:07:24.696+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.2 2024-09-14T11:07:24.822 INFO:tasks.workunit.client.0.smithi097.stderr: -21> 2024-09-14T11:07:24.696+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.3 2024-09-14T11:07:24.822 INFO:tasks.workunit.client.0.smithi097.stderr: -20> 2024-09-14T11:07:24.696+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.3 2024-09-14T11:07:24.822 INFO:tasks.workunit.client.0.smithi097.stderr: -19> 2024-09-14T11:07:24.697+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.4 2024-09-14T11:07:24.822 INFO:tasks.workunit.client.0.smithi097.stderr: -18> 2024-09-14T11:07:24.697+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.4 2024-09-14T11:07:24.822 INFO:tasks.workunit.client.0.smithi097.stderr: -17> 2024-09-14T11:07:24.697+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.5 2024-09-14T11:07:24.822 INFO:tasks.workunit.client.0.smithi097.stderr: -16> 2024-09-14T11:07:24.697+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.5 2024-09-14T11:07:24.822 INFO:tasks.workunit.client.0.smithi097.stderr: -15> 2024-09-14T11:07:24.698+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.6 2024-09-14T11:07:24.822 INFO:tasks.workunit.client.0.smithi097.stderr: -14> 2024-09-14T11:07:24.698+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.6 2024-09-14T11:07:24.822 INFO:tasks.workunit.client.0.smithi097.stderr: -13> 2024-09-14T11:07:24.698+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.7 2024-09-14T11:07:24.822 INFO:tasks.workunit.client.0.smithi097.stderr: -12> 2024-09-14T11:07:24.698+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.7 2024-09-14T11:07:24.822 INFO:tasks.workunit.client.0.smithi097.stderr: -11> 2024-09-14T11:07:24.699+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.8 2024-09-14T11:07:24.822 INFO:tasks.workunit.client.0.smithi097.stderr: -10> 2024-09-14T11:07:24.699+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.8 2024-09-14T11:07:24.822 INFO:tasks.workunit.client.0.smithi097.stderr: -9> 2024-09-14T11:07:24.699+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.9 2024-09-14T11:07:24.823 INFO:tasks.workunit.client.0.smithi097.stderr: -8> 2024-09-14T11:07:24.699+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.9 2024-09-14T11:07:24.823 INFO:tasks.workunit.client.0.smithi097.stderr: -7> 2024-09-14T11:07:24.700+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.10 2024-09-14T11:07:24.823 INFO:tasks.workunit.client.0.smithi097.stderr: -6> 2024-09-14T11:07:24.700+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.10 2024-09-14T11:07:24.823 INFO:tasks.workunit.client.0.smithi097.stderr: -5> 2024-09-14T11:07:24.700+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.11 2024-09-14T11:07:24.823 INFO:tasks.workunit.client.0.smithi097.stderr: -4> 2024-09-14T11:07:24.700+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.11 2024-09-14T11:07:24.823 INFO:tasks.workunit.client.0.smithi097.stderr: -3> 2024-09-14T11:07:24.701+0000 7fbbdef73800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.12 2024-09-14T11:07:24.823 INFO:tasks.workunit.client.0.smithi097.stderr: -2> 2024-09-14T11:07:24.701+0000 7fbbdef73800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.12 2024-09-14T11:07:24.823 INFO:tasks.workunit.client.0.smithi097.stderr: -1> 2024-09-14T11:07:24.704+0000 7fbbdef73800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fbbdef73800 time 2024-09-14T11:07:24.705465+0000 2024-09-14T11:07:24.823 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:07:24.823 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:24.823 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:07:24.823 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fbbe258c76a] 2024-09-14T11:07:24.823 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fbbe258c928] 2024-09-14T11:07:24.823 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558d9c1e50b1] 2024-09-14T11:07:24.824 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x558d9c1f4124] 2024-09-14T11:07:24.824 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x558d9c1f4fc4] 2024-09-14T11:07:24.824 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-14T11:07:24.824 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fbbe1229590] 2024-09-14T11:07:24.824 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-14T11:07:24.824 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-14T11:07:24.824 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:24.824 INFO:tasks.workunit.client.0.smithi097.stderr: 0> 2024-09-14T11:07:24.705+0000 7fbbdef73800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:07:24.824 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7fbbdef73800 thread_name:radosgw-admin 2024-09-14T11:07:24.824 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:24.824 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:07:24.824 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fbbe123e6f0] 2024-09-14T11:07:24.824 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fbbe128b99c] 2024-09-14T11:07:24.825 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-14T11:07:24.825 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-14T11:07:24.825 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fbbe258c7c4] 2024-09-14T11:07:24.825 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fbbe258c928] 2024-09-14T11:07:24.825 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558d9c1e50b1] 2024-09-14T11:07:24.825 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x558d9c1f4124] 2024-09-14T11:07:24.825 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x558d9c1f4fc4] 2024-09-14T11:07:24.825 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-14T11:07:24.825 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fbbe1229590] 2024-09-14T11:07:24.825 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-14T11:07:24.825 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-14T11:07:24.825 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:07:24.825 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:24.826 INFO:tasks.workunit.client.0.smithi097.stderr:--- logging levels --- 2024-09-14T11:07:24.826 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 none 2024-09-14T11:07:24.826 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 lockdep 2024-09-14T11:07:24.826 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 context 2024-09-14T11:07:24.826 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 crush 2024-09-14T11:07:24.826 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds 2024-09-14T11:07:24.826 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_balancer 2024-09-14T11:07:24.826 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_locker 2024-09-14T11:07:24.826 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log 2024-09-14T11:07:24.826 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log_expire 2024-09-14T11:07:24.826 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_migrator 2024-09-14T11:07:24.826 INFO:tasks.workunit.client.0.smithi097.stderr: 3/ 5 mds_quiesce 2024-09-14T11:07:24.826 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 buffer 2024-09-14T11:07:24.826 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 timer 2024-09-14T11:07:24.827 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 filer 2024-09-14T11:07:24.827 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 striper 2024-09-14T11:07:24.827 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 objecter 2024-09-14T11:07:24.827 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rados 2024-09-14T11:07:24.827 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd 2024-09-14T11:07:24.827 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_mirror 2024-09-14T11:07:24.827 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_replay 2024-09-14T11:07:24.827 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_pwl 2024-09-14T11:07:24.827 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 journaler 2024-09-14T11:07:24.827 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objectcacher 2024-09-14T11:07:24.827 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:07:24.827 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 client 2024-09-14T11:07:24.827 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 osd 2024-09-14T11:07:24.827 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 optracker 2024-09-14T11:07:24.828 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objclass 2024-09-14T11:07:24.828 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 filestore 2024-09-14T11:07:24.828 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 journal 2024-09-14T11:07:24.828 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 ms 2024-09-14T11:07:24.828 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mon 2024-09-14T11:07:24.828 INFO:tasks.workunit.client.0.smithi097.stderr: 0/10 monc 2024-09-14T11:07:24.828 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 paxos 2024-09-14T11:07:24.828 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 tp 2024-09-14T11:07:24.828 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 auth 2024-09-14T11:07:24.828 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 crypto 2024-09-14T11:07:24.828 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 finisher 2024-09-14T11:07:24.828 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 reserver 2024-09-14T11:07:24.828 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 heartbeatmap 2024-09-14T11:07:24.828 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 perfcounter 2024-09-14T11:07:24.829 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw 2024-09-14T11:07:24.829 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_sync 2024-09-14T11:07:24.829 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_datacache 2024-09-14T11:07:24.829 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_access 2024-09-14T11:07:24.829 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:07:24.829 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_flight 2024-09-14T11:07:24.829 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:07:24.829 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw_notification 2024-09-14T11:07:24.829 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 javaclient 2024-09-14T11:07:24.829 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 asok 2024-09-14T11:07:24.829 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 throttle 2024-09-14T11:07:24.829 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 refs 2024-09-14T11:07:24.829 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 compressor 2024-09-14T11:07:24.829 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluestore 2024-09-14T11:07:24.830 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluefs 2024-09-14T11:07:24.830 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 bdev 2024-09-14T11:07:24.830 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 kstore 2024-09-14T11:07:24.830 INFO:tasks.workunit.client.0.smithi097.stderr: 4/ 5 rocksdb 2024-09-14T11:07:24.830 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 fuse 2024-09-14T11:07:24.830 INFO:tasks.workunit.client.0.smithi097.stderr: 2/ 5 mgr 2024-09-14T11:07:24.830 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mgrc 2024-09-14T11:07:24.830 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 dpdk 2024-09-14T11:07:24.830 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 eventtrace 2024-09-14T11:07:24.830 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 prioritycache 2024-09-14T11:07:24.830 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 test 2024-09-14T11:07:24.830 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:07:24.830 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephsqlite 2024-09-14T11:07:24.830 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:07:24.830 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore 2024-09-14T11:07:24.831 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_onode 2024-09-14T11:07:24.831 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_odata 2024-09-14T11:07:24.831 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_omap 2024-09-14T11:07:24.831 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_tm 2024-09-14T11:07:24.831 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_t 2024-09-14T11:07:24.831 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:07:24.831 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_epm 2024-09-14T11:07:24.831 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_lba 2024-09-14T11:07:24.831 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:07:24.831 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cache 2024-09-14T11:07:24.831 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_journal 2024-09-14T11:07:24.831 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_device 2024-09-14T11:07:24.831 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_backref 2024-09-14T11:07:24.831 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 alienstore 2024-09-14T11:07:24.832 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mclock 2024-09-14T11:07:24.832 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cyanstore 2024-09-14T11:07:24.832 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 ceph_exporter 2024-09-14T11:07:24.832 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 memstore 2024-09-14T11:07:24.832 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 trace 2024-09-14T11:07:24.832 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 ceph_dedup 2024-09-14T11:07:24.832 INFO:tasks.workunit.client.0.smithi097.stderr: -2/-2 (syslog threshold) 2024-09-14T11:07:24.832 INFO:tasks.workunit.client.0.smithi097.stderr: 99/99 (stderr threshold) 2024-09-14T11:07:24.832 INFO:tasks.workunit.client.0.smithi097.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:07:24.832 INFO:tasks.workunit.client.0.smithi097.stderr: 7fba037fe640 / http_manager 2024-09-14T11:07:24.832 INFO:tasks.workunit.client.0.smithi097.stderr: 7fba91fe3640 / http_manager 2024-09-14T11:07:24.832 INFO:tasks.workunit.client.0.smithi097.stderr: 7fba92fe5640 / rgw_dt_lg_renew 2024-09-14T11:07:24.832 INFO:tasks.workunit.client.0.smithi097.stderr: 7fbab27fc640 / ms_dispatch 2024-09-14T11:07:24.832 INFO:tasks.workunit.client.0.smithi097.stderr: 7fbab3fff640 / io_context_pool 2024-09-14T11:07:24.833 INFO:tasks.workunit.client.0.smithi097.stderr: 7fbac27fc640 / ms_dispatch 2024-09-14T11:07:24.833 INFO:tasks.workunit.client.0.smithi097.stderr: 7fbac960a640 / ms_dispatch 2024-09-14T11:07:24.833 INFO:tasks.workunit.client.0.smithi097.stderr: 7fbacae0d640 / io_context_pool 2024-09-14T11:07:24.833 INFO:tasks.workunit.client.0.smithi097.stderr: 7fbbdc25c640 / msgr-worker-2 2024-09-14T11:07:24.833 INFO:tasks.workunit.client.0.smithi097.stderr: 7fbbdca5d640 / msgr-worker-1 2024-09-14T11:07:24.833 INFO:tasks.workunit.client.0.smithi097.stderr: 7fbbdd25e640 / msgr-worker-0 2024-09-14T11:07:24.833 INFO:tasks.workunit.client.0.smithi097.stderr: 7fbbdda5f640 / io_context_pool 2024-09-14T11:07:24.833 INFO:tasks.workunit.client.0.smithi097.stderr: 7fbbdef73800 / radosgw-admin 2024-09-14T11:07:24.833 INFO:tasks.workunit.client.0.smithi097.stderr: max_recent 500 2024-09-14T11:07:24.833 INFO:tasks.workunit.client.0.smithi097.stderr: max_new 1000 2024-09-14T11:07:24.833 INFO:tasks.workunit.client.0.smithi097.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:07:24.707124Z_fa9c6a1f-808a-4b11-98c6-7fc9ca0f8e06/log 2024-09-14T11:07:24.833 INFO:tasks.workunit.client.0.smithi097.stderr:--- end dump of recent events --- 2024-09-14T11:07:24.833 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:07:24.835 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:07:24.835 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:07:24.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.779+0000 7f7b980bb800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.781+0000 7f7b980bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:24.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.781+0000 7f7b980bb800 20 realm 2024-09-14T11:07:24.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.781+0000 7f7b980bb800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.781+0000 7f7b980bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:24.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.781+0000 7f7b980bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:07:24.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.781+0000 7f7b980bb800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.781+0000 7f7b980bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:24.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.781+0000 7f7b980bb800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.782+0000 7f7b980bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:07:24.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.782+0000 7f7b980bb800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.783+0000 7f7b980bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:07:24.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.783+0000 7f7b980bb800 20 searching for the correct realm 2024-09-14T11:07:24.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.783+0000 7f7b95ba5640 0 -- 172.21.15.97:0/4208793805 >> [v2:172.21.15.152:6808/1010851305,v1:172.21.15.152:6809/1010851305] conn(0x562aad56bb90 msgr2=0x562aad56e050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:07:24.987 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.987+0000 7f7b95ba5640 0 -- 172.21.15.97:0/4208793805 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x562aad55f350 msgr2=0x562aad561760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:07:24.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.994+0000 7f7b980bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:07:24.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.994+0000 7f7b980bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:07:24.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.994+0000 7f7b980bb800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:07:24.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.994+0000 7f7b980bb800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:07:24.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.994+0000 7f7b980bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:07:24.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.994+0000 7f7b980bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:07:24.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.994+0000 7f7b980bb800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.994+0000 7f7b980bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:24.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.994+0000 7f7b980bb800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.994+0000 7f7b980bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:07:24.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.994+0000 7f7b980bb800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.995+0000 7f7b980bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:07:24.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.995+0000 7f7b980bb800 20 zone default found 2024-09-14T11:07:24.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.995+0000 7f7b980bb800 4 Realm: () 2024-09-14T11:07:24.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.995+0000 7f7b980bb800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:07:24.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.995+0000 7f7b980bb800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:07:24.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.995+0000 7f7b980bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:07:24.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.995+0000 7f7b980bb800 20 zonegroup default 2024-09-14T11:07:24.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.995+0000 7f7b980bb800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.995+0000 7f7b980bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:24.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.995+0000 7f7b980bb800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.995+0000 7f7b980bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:24.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.995+0000 7f7b980bb800 20 rados->read ofs=0 len=0 2024-09-14T11:07:24.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.996+0000 7f7b980bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:24.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.996+0000 7f7b980bb800 20 started sync module instance, tier type = 2024-09-14T11:07:24.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:24.996+0000 7f7b980bb800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:07:25.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.005+0000 7f7b980bb800 20 add_watcher() i=0 2024-09-14T11:07:25.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.005+0000 7f7b980bb800 20 add_watcher() i=1 2024-09-14T11:07:25.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.005+0000 7f7b980bb800 20 add_watcher() i=2 2024-09-14T11:07:25.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.005+0000 7f7b980bb800 20 add_watcher() i=3 2024-09-14T11:07:25.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.005+0000 7f7b980bb800 20 add_watcher() i=4 2024-09-14T11:07:25.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.005+0000 7f7b980bb800 20 add_watcher() i=5 2024-09-14T11:07:25.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.005+0000 7f7b980bb800 20 add_watcher() i=6 2024-09-14T11:07:25.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.006+0000 7f7b980bb800 20 add_watcher() i=7 2024-09-14T11:07:25.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.006+0000 7f7b980bb800 2 all 8 watchers are set, enabling cache 2024-09-14T11:07:25.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.008+0000 7f7a477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:07:25.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.009+0000 7f7b980bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:07:25.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.009+0000 7f7b980bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:07:25.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.009+0000 7f7b980bb800 5 note: GC not initialized 2024-09-14T11:07:25.009 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.009+0000 7f7a467fc640 20 reqs_thread_entry: start 2024-09-14T11:07:25.009 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.009+0000 7f7b980bb800 20 init_complete bucket index max shards: 11 2024-09-14T11:07:25.009 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.009+0000 7f7b980bb800 20 Filter name: none 2024-09-14T11:07:25.010 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.009+0000 7f79b7fff640 20 reqs_thread_entry: start 2024-09-14T11:07:25.010 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.009+0000 7f7b980bb800 20 rados->read ofs=0 len=0 2024-09-14T11:07:25.010 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.010+0000 7f7b980bb800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:07:25.010 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.010+0000 7f7b980bb800 20 rados->read ofs=0 len=0 2024-09-14T11:07:25.011 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.010+0000 7f7b980bb800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:07:25.011 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.010+0000 7f7b980bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:07:25.011 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.010+0000 7f7b980bb800 20 rados->read ofs=0 len=0 2024-09-14T11:07:25.011 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.010+0000 7f7b980bb800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:07:25.011 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.010+0000 7f7b980bb800 20 rados->read ofs=0 len=0 2024-09-14T11:07:25.011 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.011+0000 7f7b980bb800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:07:25.011 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.011+0000 7f7b980bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:07:25.012 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.013+0000 7f7a477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:07:25.014 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.015+0000 7f7b980bb800 20 remove_watcher() i=0 2024-09-14T11:07:25.014 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.015+0000 7f7b980bb800 2 removed watcher, disabling cache 2024-09-14T11:07:25.015 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.016+0000 7f7b980bb800 20 remove_watcher() i=1 2024-09-14T11:07:25.016 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.017+0000 7f7b980bb800 20 remove_watcher() i=2 2024-09-14T11:07:25.017 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.018+0000 7f7b980bb800 20 remove_watcher() i=3 2024-09-14T11:07:25.018 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.019+0000 7f7b980bb800 20 remove_watcher() i=4 2024-09-14T11:07:25.019 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.020+0000 7f7b980bb800 20 remove_watcher() i=5 2024-09-14T11:07:25.020 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.021+0000 7f7b980bb800 20 remove_watcher() i=6 2024-09-14T11:07:25.021 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.022+0000 7f7b980bb800 20 remove_watcher() i=7 2024-09-14T11:07:25.043 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:07:25.071 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:07:25.071 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:07:25.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.109+0000 7f9fa9f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:07:25.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.110+0000 7f9fa9f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:25.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.110+0000 7f9fa9f2e800 20 realm 2024-09-14T11:07:25.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.110+0000 7f9fa9f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:07:25.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.111+0000 7f9fa9f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:25.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.111+0000 7f9fa9f2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:07:25.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.111+0000 7f9fa9f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:07:25.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.111+0000 7f9fa9f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:25.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.111+0000 7f9fa9f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:07:25.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.111+0000 7f9fa9f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:07:25.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.112+0000 7f9fa9f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:07:25.112 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.112+0000 7f9fa9f2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:07:25.112 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.112+0000 7f9fa9f2e800 20 searching for the correct realm 2024-09-14T11:07:25.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.114+0000 7f9fa54dc640 0 -- 172.21.15.97:0/2342326970 >> [v2:172.21.15.97:6816/4093696477,v1:172.21.15.97:6817/4093696477] conn(0x559f2b42ec70 msgr2=0x559f2b4310a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:07:25.117 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.117+0000 7f9fa5cdd640 0 -- 172.21.15.97:0/2342326970 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7f9f9c078040 msgr2=0x7f9f9c083410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:07:25.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.122+0000 7f9fa9f2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:07:25.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.122+0000 7f9fa9f2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:07:25.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.122+0000 7f9fa9f2e800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:07:25.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.122+0000 7f9fa9f2e800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:07:25.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.122+0000 7f9fa9f2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:07:25.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.122+0000 7f9fa9f2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:07:25.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.122+0000 7f9fa9f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:07:25.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.122+0000 7f9fa9f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:25.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.122+0000 7f9fa9f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:07:25.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.122+0000 7f9fa9f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:07:25.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.122+0000 7f9fa9f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:07:25.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.123+0000 7f9fa9f2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:07:25.123 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.123+0000 7f9fa9f2e800 20 zone default found 2024-09-14T11:07:25.124 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.123+0000 7f9fa9f2e800 4 Realm: () 2024-09-14T11:07:25.124 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.123+0000 7f9fa9f2e800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:07:25.124 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.123+0000 7f9fa9f2e800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:07:25.124 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.123+0000 7f9fa9f2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:07:25.124 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.123+0000 7f9fa9f2e800 20 zonegroup default 2024-09-14T11:07:25.124 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.123+0000 7f9fa9f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:07:25.124 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.123+0000 7f9fa9f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:25.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.123+0000 7f9fa9f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:07:25.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.123+0000 7f9fa9f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:25.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.123+0000 7f9fa9f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:07:25.125 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.123+0000 7f9fa9f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:25.126 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.123+0000 7f9fa9f2e800 20 started sync module instance, tier type = 2024-09-14T11:07:25.126 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.123+0000 7f9fa9f2e800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:07:25.131 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.132+0000 7f9fa9f2e800 20 add_watcher() i=0 2024-09-14T11:07:25.132 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.132+0000 7f9fa9f2e800 20 add_watcher() i=1 2024-09-14T11:07:25.132 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.132+0000 7f9fa9f2e800 20 add_watcher() i=2 2024-09-14T11:07:25.132 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.132+0000 7f9fa9f2e800 20 add_watcher() i=3 2024-09-14T11:07:25.132 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.132+0000 7f9fa9f2e800 20 add_watcher() i=4 2024-09-14T11:07:25.132 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.132+0000 7f9fa9f2e800 20 add_watcher() i=5 2024-09-14T11:07:25.132 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.132+0000 7f9fa9f2e800 20 add_watcher() i=6 2024-09-14T11:07:25.132 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.134+0000 7f9fa9f2e800 20 add_watcher() i=7 2024-09-14T11:07:25.132 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.134+0000 7f9fa9f2e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:07:25.134 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.134+0000 7f9e577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:07:25.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.135+0000 7f9fa9f2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:07:25.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.135+0000 7f9fa9f2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:07:25.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.135+0000 7f9fa9f2e800 5 note: GC not initialized 2024-09-14T11:07:25.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.135+0000 7f9e567fc640 20 reqs_thread_entry: start 2024-09-14T11:07:25.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.135+0000 7f9fa9f2e800 20 init_complete bucket index max shards: 11 2024-09-14T11:07:25.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.135+0000 7f9fa9f2e800 20 Filter name: none 2024-09-14T11:07:25.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.135+0000 7f9dc7fff640 20 reqs_thread_entry: start 2024-09-14T11:07:25.135 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.135+0000 7f9fa9f2e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:07:25.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.135+0000 7f9fa9f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:07:25.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.135+0000 7f9fa9f2e800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:07:25.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.135+0000 7f9fa9f2e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:07:25.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.135+0000 7f9fa9f2e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:07:25.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.135+0000 7f9fa9f2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 : miss 2024-09-14T11:07:25.136 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.135+0000 7f9fa9f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:07:25.137 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.136+0000 7f9fa9f2e800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:07:25.137 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.136+0000 7f9fa9f2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:07:25.137 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.136+0000 7f9fa9f2e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:07:25.137 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.136+0000 7f9fa9f2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:07:25.137 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.136+0000 7f9fa9f2e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:07:25.137 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.136+0000 7f9fa9f2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 2024-09-14T11:07:25.137 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.136+0000 7f9fa9f2e800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.0 2024-09-14T11:07:25.137 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.136+0000 7f9fa9f2e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.0 2024-09-14T11:07:25.137 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.137+0000 7f9fa9f2e800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.1 2024-09-14T11:07:25.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.137+0000 7f9fa9f2e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.1 2024-09-14T11:07:25.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.137+0000 7f9fa9f2e800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.2 2024-09-14T11:07:25.138 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.137+0000 7f9fa9f2e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.2 2024-09-14T11:07:25.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.138+0000 7f9fa9f2e800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.3 2024-09-14T11:07:25.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.138+0000 7f9fa9f2e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.3 2024-09-14T11:07:25.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.138+0000 7f9fa9f2e800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.4 2024-09-14T11:07:25.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.138+0000 7f9fa9f2e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.4 2024-09-14T11:07:25.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.138+0000 7f9fa9f2e800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.5 2024-09-14T11:07:25.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.138+0000 7f9fa9f2e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.5 2024-09-14T11:07:25.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.139+0000 7f9fa9f2e800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.6 2024-09-14T11:07:25.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.139+0000 7f9fa9f2e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.6 2024-09-14T11:07:25.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.139+0000 7f9fa9f2e800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.7 2024-09-14T11:07:25.139 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.139+0000 7f9fa9f2e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.7 2024-09-14T11:07:25.140 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.140+0000 7f9fa9f2e800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.8 2024-09-14T11:07:25.140 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.140+0000 7f9fa9f2e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.8 2024-09-14T11:07:25.140 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.140+0000 7f9fa9f2e800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.9 2024-09-14T11:07:25.140 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.140+0000 7f9fa9f2e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.9 2024-09-14T11:07:25.140 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.140+0000 7f9fa9f2e800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.10 2024-09-14T11:07:25.140 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.140+0000 7f9fa9f2e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.10 2024-09-14T11:07:25.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.141+0000 7f9fa9f2e800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.11 2024-09-14T11:07:25.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.141+0000 7f9fa9f2e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.11 2024-09-14T11:07:25.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.141+0000 7f9fa9f2e800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.12 2024-09-14T11:07:25.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.141+0000 7f9fa9f2e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.12 2024-09-14T11:07:25.141 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.142+0000 7f9e577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:07:25.143 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.144+0000 7f9fa9f2e800 20 remove_watcher() i=0 2024-09-14T11:07:25.144 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.144+0000 7f9fa9f2e800 2 removed watcher, disabling cache 2024-09-14T11:07:25.144 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.145+0000 7f9fa9f2e800 20 remove_watcher() i=1 2024-09-14T11:07:25.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.146+0000 7f9fa9f2e800 20 remove_watcher() i=2 2024-09-14T11:07:25.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.147+0000 7f9fa9f2e800 20 remove_watcher() i=3 2024-09-14T11:07:25.147 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.148+0000 7f9fa9f2e800 20 remove_watcher() i=4 2024-09-14T11:07:25.148 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.149+0000 7f9fa9f2e800 20 remove_watcher() i=5 2024-09-14T11:07:25.149 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.150+0000 7f9fa9f2e800 20 remove_watcher() i=6 2024-09-14T11:07:25.150 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:25.151+0000 7f9fa9f2e800 20 remove_watcher() i=7 2024-09-14T11:07:55.179 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:07:55.211 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:07:55.211 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:07:55.253 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.254+0000 7f57d8931800 20 rados->read ofs=0 len=0 2024-09-14T11:07:55.255 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.257+0000 7f57d8931800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:55.256 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.257+0000 7f57d8931800 20 realm 2024-09-14T11:07:55.256 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.257+0000 7f57d8931800 20 rados->read ofs=0 len=0 2024-09-14T11:07:55.256 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.257+0000 7f57d8931800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:55.256 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.257+0000 7f57d8931800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:07:55.256 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.257+0000 7f57d8931800 20 rados->read ofs=0 len=0 2024-09-14T11:07:55.256 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.257+0000 7f57d8931800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:55.256 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.257+0000 7f57d8931800 20 rados->read ofs=0 len=0 2024-09-14T11:07:55.257 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.258+0000 7f57d8931800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:07:55.257 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.258+0000 7f57d8931800 20 rados->read ofs=0 len=0 2024-09-14T11:07:55.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.259+0000 7f57d8931800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:07:55.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.259+0000 7f57d8931800 20 searching for the correct realm 2024-09-14T11:07:55.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.261+0000 7f57d4d9a640 0 -- 172.21.15.97:0/3403707299 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f57c806b020 msgr2=0x7f57c804df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:07:55.466 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.468+0000 7f57d3d98640 0 -- 172.21.15.97:0/3403707299 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f57c4048910 msgr2=0x7f57c401a3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:07:55.472 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.474+0000 7f57d8931800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:07:55.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.474+0000 7f57d8931800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:07:55.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.474+0000 7f57d8931800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:07:55.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.474+0000 7f57d8931800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:07:55.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.474+0000 7f57d8931800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:07:55.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.474+0000 7f57d8931800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:07:55.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.474+0000 7f57d8931800 20 rados->read ofs=0 len=0 2024-09-14T11:07:55.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.474+0000 7f57d8931800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:55.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.474+0000 7f57d8931800 20 rados->read ofs=0 len=0 2024-09-14T11:07:55.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.474+0000 7f57d8931800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:07:55.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.474+0000 7f57d8931800 20 rados->read ofs=0 len=0 2024-09-14T11:07:55.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.475+0000 7f57d8931800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:07:55.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.475+0000 7f57d8931800 20 zone default found 2024-09-14T11:07:55.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.475+0000 7f57d8931800 4 Realm: () 2024-09-14T11:07:55.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.475+0000 7f57d8931800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:07:55.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.475+0000 7f57d8931800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:07:55.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.475+0000 7f57d8931800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:07:55.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.475+0000 7f57d8931800 20 zonegroup default 2024-09-14T11:07:55.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.475+0000 7f57d8931800 20 rados->read ofs=0 len=0 2024-09-14T11:07:55.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.475+0000 7f57d8931800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:55.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.475+0000 7f57d8931800 20 rados->read ofs=0 len=0 2024-09-14T11:07:55.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.475+0000 7f57d8931800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:55.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.475+0000 7f57d8931800 20 rados->read ofs=0 len=0 2024-09-14T11:07:55.476 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.476+0000 7f57d8931800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:55.476 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.476+0000 7f57d8931800 20 started sync module instance, tier type = 2024-09-14T11:07:55.476 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.476+0000 7f57d8931800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:07:55.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.486+0000 7f57d8931800 20 add_watcher() i=0 2024-09-14T11:07:55.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.486+0000 7f57d8931800 20 add_watcher() i=1 2024-09-14T11:07:55.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.486+0000 7f57d8931800 20 add_watcher() i=2 2024-09-14T11:07:55.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.486+0000 7f57d8931800 20 add_watcher() i=3 2024-09-14T11:07:55.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.486+0000 7f57d8931800 20 add_watcher() i=4 2024-09-14T11:07:55.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.486+0000 7f57d8931800 20 add_watcher() i=5 2024-09-14T11:07:55.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.486+0000 7f57d8931800 20 add_watcher() i=6 2024-09-14T11:07:55.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.487+0000 7f57d8931800 20 add_watcher() i=7 2024-09-14T11:07:55.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.487+0000 7f57d8931800 2 all 8 watchers are set, enabling cache 2024-09-14T11:07:55.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.489+0000 7f568afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:07:55.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.490+0000 7f57d8931800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:07:55.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.490+0000 7f57d8931800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:07:55.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.490+0000 7f57d8931800 5 note: GC not initialized 2024-09-14T11:07:55.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.490+0000 7f5689fdb640 20 reqs_thread_entry: start 2024-09-14T11:07:55.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.490+0000 7f57d8931800 20 init_complete bucket index max shards: 11 2024-09-14T11:07:55.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.490+0000 7f57d8931800 20 Filter name: none 2024-09-14T11:07:55.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.490+0000 7f55fb7fe640 20 reqs_thread_entry: start 2024-09-14T11:07:55.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.490+0000 7f57d8931800 20 rados->read ofs=0 len=0 2024-09-14T11:07:55.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.491+0000 7f57d8931800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:07:55.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.491+0000 7f57d8931800 20 rados->read ofs=0 len=0 2024-09-14T11:07:55.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.491+0000 7f57d8931800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:07:55.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.491+0000 7f57d8931800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:07:55.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.491+0000 7f57d8931800 20 rados->read ofs=0 len=0 2024-09-14T11:07:55.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.492+0000 7f57d8931800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:07:55.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.492+0000 7f57d8931800 20 rados->read ofs=0 len=0 2024-09-14T11:07:55.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.492+0000 7f57d8931800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:07:55.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.492+0000 7f57d8931800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:07:55.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.494+0000 7f568afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:07:55.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.496+0000 7f57d8931800 20 remove_watcher() i=0 2024-09-14T11:07:55.495 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.496+0000 7f57d8931800 2 removed watcher, disabling cache 2024-09-14T11:07:55.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.497+0000 7f57d8931800 20 remove_watcher() i=1 2024-09-14T11:07:55.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.498+0000 7f57d8931800 20 remove_watcher() i=2 2024-09-14T11:07:55.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.499+0000 7f57d8931800 20 remove_watcher() i=3 2024-09-14T11:07:55.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.500+0000 7f57d8931800 20 remove_watcher() i=4 2024-09-14T11:07:55.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.502+0000 7f57d8931800 20 remove_watcher() i=5 2024-09-14T11:07:55.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.503+0000 7f57d8931800 20 remove_watcher() i=6 2024-09-14T11:07:55.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.504+0000 7f57d8931800 20 remove_watcher() i=7 2024-09-14T11:07:55.540 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:07:55.568 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:07:55.569 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:07:55.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.607+0000 7f888fb33800 20 rados->read ofs=0 len=0 2024-09-14T11:07:55.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.609+0000 7f888fb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:55.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.609+0000 7f888fb33800 20 realm 2024-09-14T11:07:55.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.609+0000 7f888fb33800 20 rados->read ofs=0 len=0 2024-09-14T11:07:55.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.609+0000 7f888fb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:55.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.609+0000 7f888fb33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:07:55.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.609+0000 7f888fb33800 20 rados->read ofs=0 len=0 2024-09-14T11:07:55.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.609+0000 7f888fb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:55.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.609+0000 7f888fb33800 20 rados->read ofs=0 len=0 2024-09-14T11:07:55.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.610+0000 7f888fb33800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:07:55.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.610+0000 7f888fb33800 20 rados->read ofs=0 len=0 2024-09-14T11:07:55.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.611+0000 7f888fb33800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:07:55.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.611+0000 7f888fb33800 20 searching for the correct realm 2024-09-14T11:07:55.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.613+0000 7f8883075640 0 -- 172.21.15.97:0/917673614 >> [v2:172.21.15.97:6816/4093696477,v1:172.21.15.97:6817/4093696477] conn(0x55e0d22b8e90 msgr2=0x55e0d22bb280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:07:55.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.616+0000 7f888b876640 0 -- 172.21.15.97:0/917673614 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7f8874095040 msgr2=0x7f88740bf280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:07:55.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.621+0000 7f888fb33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:07:55.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.621+0000 7f888fb33800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:07:55.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.621+0000 7f888fb33800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:07:55.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.621+0000 7f888fb33800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:07:55.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.621+0000 7f888fb33800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:07:55.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.621+0000 7f888fb33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:07:55.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.621+0000 7f888fb33800 20 rados->read ofs=0 len=0 2024-09-14T11:07:55.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.622+0000 7f888fb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:55.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.622+0000 7f888fb33800 20 rados->read ofs=0 len=0 2024-09-14T11:07:55.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.622+0000 7f888fb33800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:07:55.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.622+0000 7f888fb33800 20 rados->read ofs=0 len=0 2024-09-14T11:07:55.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.622+0000 7f888fb33800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:07:55.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.622+0000 7f888fb33800 20 zone default found 2024-09-14T11:07:55.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.622+0000 7f888fb33800 4 Realm: () 2024-09-14T11:07:55.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.622+0000 7f888fb33800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:07:55.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.622+0000 7f888fb33800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:07:55.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.622+0000 7f888fb33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:07:55.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.622+0000 7f888fb33800 20 zonegroup default 2024-09-14T11:07:55.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.622+0000 7f888fb33800 20 rados->read ofs=0 len=0 2024-09-14T11:07:55.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.623+0000 7f888fb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:55.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.623+0000 7f888fb33800 20 rados->read ofs=0 len=0 2024-09-14T11:07:55.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.623+0000 7f888fb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:55.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.623+0000 7f888fb33800 20 rados->read ofs=0 len=0 2024-09-14T11:07:55.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.623+0000 7f888fb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:55.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.623+0000 7f888fb33800 20 started sync module instance, tier type = 2024-09-14T11:07:55.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.623+0000 7f888fb33800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:07:55.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.632+0000 7f888fb33800 20 add_watcher() i=0 2024-09-14T11:07:55.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.632+0000 7f888fb33800 20 add_watcher() i=1 2024-09-14T11:07:55.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.632+0000 7f888fb33800 20 add_watcher() i=2 2024-09-14T11:07:55.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.632+0000 7f888fb33800 20 add_watcher() i=3 2024-09-14T11:07:55.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.632+0000 7f888fb33800 20 add_watcher() i=4 2024-09-14T11:07:55.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.632+0000 7f888fb33800 20 add_watcher() i=5 2024-09-14T11:07:55.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.632+0000 7f888fb33800 20 add_watcher() i=6 2024-09-14T11:07:55.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.633+0000 7f888fb33800 20 add_watcher() i=7 2024-09-14T11:07:55.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.633+0000 7f888fb33800 2 all 8 watchers are set, enabling cache 2024-09-14T11:07:55.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.634+0000 7f8741fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:07:55.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.634+0000 7f888fb33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:07:55.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.634+0000 7f888fb33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:07:55.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.635+0000 7f888fb33800 5 note: GC not initialized 2024-09-14T11:07:55.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.635+0000 7f8740fe1640 20 reqs_thread_entry: start 2024-09-14T11:07:55.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.635+0000 7f888fb33800 20 init_complete bucket index max shards: 11 2024-09-14T11:07:55.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.635+0000 7f888fb33800 20 Filter name: none 2024-09-14T11:07:55.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.635+0000 7f86ba7fc640 20 reqs_thread_entry: start 2024-09-14T11:07:55.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.635+0000 7f888fb33800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:07:55.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.635+0000 7f888fb33800 20 rados->read ofs=0 len=0 2024-09-14T11:07:55.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.635+0000 7f888fb33800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:07:55.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.635+0000 7f888fb33800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:07:55.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.635+0000 7f888fb33800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:07:55.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.635+0000 7f888fb33800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 : miss 2024-09-14T11:07:55.635 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.635+0000 7f888fb33800 20 rados->read ofs=0 len=0 2024-09-14T11:07:55.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.636+0000 7f888fb33800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:07:55.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.636+0000 7f888fb33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:07:55.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.636+0000 7f888fb33800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:07:55.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.636+0000 7f888fb33800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:07:55.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.636+0000 7f888fb33800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:07:55.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.636+0000 7f888fb33800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 2024-09-14T11:07:55.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.636+0000 7f888fb33800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.0 2024-09-14T11:07:55.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.636+0000 7f888fb33800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.0 2024-09-14T11:07:55.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.636+0000 7f888fb33800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.1 2024-09-14T11:07:55.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.636+0000 7f888fb33800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.1 2024-09-14T11:07:55.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.637+0000 7f888fb33800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.2 2024-09-14T11:07:55.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.637+0000 7f888fb33800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.2 2024-09-14T11:07:55.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.637+0000 7f888fb33800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.3 2024-09-14T11:07:55.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.637+0000 7f888fb33800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.3 2024-09-14T11:07:55.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.638+0000 7f888fb33800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.4 2024-09-14T11:07:55.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.638+0000 7f888fb33800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.4 2024-09-14T11:07:55.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.638+0000 7f888fb33800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.5 2024-09-14T11:07:55.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.638+0000 7f888fb33800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.5 2024-09-14T11:07:55.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.638+0000 7f888fb33800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.6 2024-09-14T11:07:55.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.638+0000 7f888fb33800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.6 2024-09-14T11:07:55.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.639+0000 7f888fb33800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.7 2024-09-14T11:07:55.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.639+0000 7f888fb33800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.7 2024-09-14T11:07:55.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.639+0000 7f888fb33800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.8 2024-09-14T11:07:55.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.639+0000 7f888fb33800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.8 2024-09-14T11:07:55.639 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.639+0000 7f888fb33800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.9 2024-09-14T11:07:55.639 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.639+0000 7f888fb33800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.9 2024-09-14T11:07:55.639 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.639+0000 7f888fb33800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.10 2024-09-14T11:07:55.639 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.639+0000 7f888fb33800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.10 2024-09-14T11:07:55.639 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.640+0000 7f888fb33800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.11 2024-09-14T11:07:55.639 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.640+0000 7f888fb33800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.11 2024-09-14T11:07:55.639 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.640+0000 7f888fb33800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.12 2024-09-14T11:07:55.639 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.640+0000 7f888fb33800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.12 2024-09-14T11:07:55.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.641+0000 7f8741fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:07:55.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.643+0000 7f888fb33800 20 remove_watcher() i=0 2024-09-14T11:07:55.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.643+0000 7f888fb33800 2 removed watcher, disabling cache 2024-09-14T11:07:55.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.644+0000 7f888fb33800 20 remove_watcher() i=1 2024-09-14T11:07:55.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.645+0000 7f888fb33800 20 remove_watcher() i=2 2024-09-14T11:07:55.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.646+0000 7f888fb33800 20 remove_watcher() i=3 2024-09-14T11:07:55.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.647+0000 7f888fb33800 20 remove_watcher() i=4 2024-09-14T11:07:55.647 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.648+0000 7f888fb33800 20 remove_watcher() i=5 2024-09-14T11:07:55.648 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.649+0000 7f888fb33800 20 remove_watcher() i=6 2024-09-14T11:07:55.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.650+0000 7f888fb33800 20 remove_watcher() i=7 2024-09-14T11:07:55.661 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:07:55.689 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:07:55.689 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:07:55.726 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.727+0000 7fe4c9e98800 20 rados->read ofs=0 len=0 2024-09-14T11:07:55.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.729+0000 7fe4c9e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:55.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.729+0000 7fe4c9e98800 20 realm 2024-09-14T11:07:55.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.729+0000 7fe4c9e98800 20 rados->read ofs=0 len=0 2024-09-14T11:07:55.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.729+0000 7fe4c9e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:55.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.729+0000 7fe4c9e98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:07:55.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.729+0000 7fe4c9e98800 20 rados->read ofs=0 len=0 2024-09-14T11:07:55.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.729+0000 7fe4c9e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:55.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.729+0000 7fe4c9e98800 20 rados->read ofs=0 len=0 2024-09-14T11:07:55.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.730+0000 7fe4c9e98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:07:55.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.730+0000 7fe4c9e98800 20 rados->read ofs=0 len=0 2024-09-14T11:07:55.730 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.731+0000 7fe4c9e98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:07:55.730 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.731+0000 7fe4c9e98800 20 searching for the correct realm 2024-09-14T11:07:55.731 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.733+0000 7fe4c8183640 0 -- 172.21.15.97:0/2816171021 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7fe4b0066130 msgr2=0x7fe4b009a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:07:55.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.938+0000 7fe4bf181640 0 -- 172.21.15.97:0/2816171021 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7fe4b8085000 msgr2=0x7fe4b8085400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:07:55.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.943+0000 7fe4c9e98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:07:55.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.943+0000 7fe4c9e98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:07:55.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.943+0000 7fe4c9e98800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:07:55.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.943+0000 7fe4c9e98800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:07:55.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.943+0000 7fe4c9e98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:07:55.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.943+0000 7fe4c9e98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:07:55.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.943+0000 7fe4c9e98800 20 rados->read ofs=0 len=0 2024-09-14T11:07:55.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.943+0000 7fe4c9e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:55.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.943+0000 7fe4c9e98800 20 rados->read ofs=0 len=0 2024-09-14T11:07:55.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.943+0000 7fe4c9e98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:07:55.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.943+0000 7fe4c9e98800 20 rados->read ofs=0 len=0 2024-09-14T11:07:55.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.944+0000 7fe4c9e98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:07:55.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.944+0000 7fe4c9e98800 20 zone default found 2024-09-14T11:07:55.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.944+0000 7fe4c9e98800 4 Realm: () 2024-09-14T11:07:55.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.944+0000 7fe4c9e98800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:07:55.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.944+0000 7fe4c9e98800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:07:55.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.944+0000 7fe4c9e98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:07:55.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.944+0000 7fe4c9e98800 20 zonegroup default 2024-09-14T11:07:55.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.944+0000 7fe4c9e98800 20 rados->read ofs=0 len=0 2024-09-14T11:07:55.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.944+0000 7fe4c9e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:55.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.944+0000 7fe4c9e98800 20 rados->read ofs=0 len=0 2024-09-14T11:07:55.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.944+0000 7fe4c9e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:55.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.944+0000 7fe4c9e98800 20 rados->read ofs=0 len=0 2024-09-14T11:07:55.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.944+0000 7fe4c9e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:55.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.944+0000 7fe4c9e98800 20 started sync module instance, tier type = 2024-09-14T11:07:55.945 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.944+0000 7fe4c9e98800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:07:55.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.955+0000 7fe4c9e98800 20 add_watcher() i=0 2024-09-14T11:07:55.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.955+0000 7fe4c9e98800 20 add_watcher() i=1 2024-09-14T11:07:55.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.955+0000 7fe4c9e98800 20 add_watcher() i=2 2024-09-14T11:07:55.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.955+0000 7fe4c9e98800 20 add_watcher() i=3 2024-09-14T11:07:55.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.955+0000 7fe4c9e98800 20 add_watcher() i=4 2024-09-14T11:07:55.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.955+0000 7fe4c9e98800 20 add_watcher() i=5 2024-09-14T11:07:55.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.955+0000 7fe4c9e98800 20 add_watcher() i=6 2024-09-14T11:07:55.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.956+0000 7fe4c9e98800 20 add_watcher() i=7 2024-09-14T11:07:55.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.956+0000 7fe4c9e98800 2 all 8 watchers are set, enabling cache 2024-09-14T11:07:55.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.957+0000 7fe37dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:07:55.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.958+0000 7fe4c9e98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:07:55.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.958+0000 7fe4c9e98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:07:55.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.958+0000 7fe4c9e98800 5 note: GC not initialized 2024-09-14T11:07:55.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.958+0000 7fe37cfe1640 20 reqs_thread_entry: start 2024-09-14T11:07:55.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.958+0000 7fe4c9e98800 20 init_complete bucket index max shards: 11 2024-09-14T11:07:55.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.958+0000 7fe4c9e98800 20 Filter name: none 2024-09-14T11:07:55.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.958+0000 7fe2f67fc640 20 reqs_thread_entry: start 2024-09-14T11:07:55.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.958+0000 7fe4c9e98800 20 rados->read ofs=0 len=0 2024-09-14T11:07:55.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.959+0000 7fe4c9e98800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:07:55.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.959+0000 7fe4c9e98800 20 rados->read ofs=0 len=0 2024-09-14T11:07:55.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.959+0000 7fe4c9e98800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:07:55.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.959+0000 7fe4c9e98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:07:55.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.959+0000 7fe4c9e98800 20 rados->read ofs=0 len=0 2024-09-14T11:07:55.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.960+0000 7fe4c9e98800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:07:55.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.960+0000 7fe4c9e98800 20 rados->read ofs=0 len=0 2024-09-14T11:07:55.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.960+0000 7fe4c9e98800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:07:55.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.960+0000 7fe4c9e98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:07:55.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.962+0000 7fe37dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:07:55.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.964+0000 7fe4c9e98800 20 remove_watcher() i=0 2024-09-14T11:07:55.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.964+0000 7fe4c9e98800 2 removed watcher, disabling cache 2024-09-14T11:07:55.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.965+0000 7fe4c9e98800 20 remove_watcher() i=1 2024-09-14T11:07:55.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.966+0000 7fe4c9e98800 20 remove_watcher() i=2 2024-09-14T11:07:55.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.967+0000 7fe4c9e98800 20 remove_watcher() i=3 2024-09-14T11:07:55.967 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.969+0000 7fe4c9e98800 20 remove_watcher() i=4 2024-09-14T11:07:55.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.970+0000 7fe4c9e98800 20 remove_watcher() i=5 2024-09-14T11:07:55.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.970+0000 7fe4c9e98800 20 remove_watcher() i=6 2024-09-14T11:07:55.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:55.972+0000 7fe4c9e98800 20 remove_watcher() i=7 2024-09-14T11:07:55.980 INFO:tasks.workunit.client.0.smithi097.stderr: test: duplicated entries should be purged before reshard 2024-09-14T11:07:55.982 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:07:56.010 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:07:56.010 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:07:56.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.048+0000 7f3083325800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.050+0000 7f3083325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:56.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.050+0000 7f3083325800 20 realm 2024-09-14T11:07:56.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.050+0000 7f3083325800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.050+0000 7f3083325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:56.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.050+0000 7f3083325800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:07:56.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.050+0000 7f3083325800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.050 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.051+0000 7f3083325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:56.050 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.051+0000 7f3083325800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.050 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.051+0000 7f3083325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:07:56.050 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.051+0000 7f3083325800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.051 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.052+0000 7f3083325800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:07:56.051 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.052+0000 7f3083325800 20 searching for the correct realm 2024-09-14T11:07:56.052 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.054+0000 7f307f7af640 0 -- 172.21.15.97:0/2728017985 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f3074094bf0 msgr2=0x7f3074088950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:07:56.257 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.258+0000 7f307e7ad640 0 -- 172.21.15.97:0/2728017985 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f307005d280 msgr2=0x7f307006b9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:07:56.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.263+0000 7f3083325800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:07:56.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.263+0000 7f3083325800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:07:56.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.263+0000 7f3083325800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:07:56.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.263+0000 7f3083325800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:07:56.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.263+0000 7f3083325800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:07:56.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.263+0000 7f3083325800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:07:56.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.263+0000 7f3083325800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.263+0000 7f3083325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:56.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.263+0000 7f3083325800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.263+0000 7f3083325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:07:56.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.263+0000 7f3083325800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.264 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.264+0000 7f3083325800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:07:56.264 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.264+0000 7f3083325800 20 zone default found 2024-09-14T11:07:56.264 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.264+0000 7f3083325800 4 Realm: () 2024-09-14T11:07:56.264 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.264+0000 7f3083325800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:07:56.264 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.264+0000 7f3083325800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:07:56.264 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.264+0000 7f3083325800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:07:56.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.264+0000 7f3083325800 20 zonegroup default 2024-09-14T11:07:56.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.264+0000 7f3083325800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.264+0000 7f3083325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:56.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.264+0000 7f3083325800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.264+0000 7f3083325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:56.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.264+0000 7f3083325800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.265+0000 7f3083325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:56.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.265+0000 7f3083325800 20 started sync module instance, tier type = 2024-09-14T11:07:56.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.265+0000 7f3083325800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:07:56.272 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.273+0000 7f3083325800 20 add_watcher() i=0 2024-09-14T11:07:56.272 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.273+0000 7f3083325800 20 add_watcher() i=1 2024-09-14T11:07:56.272 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.273+0000 7f3083325800 20 add_watcher() i=2 2024-09-14T11:07:56.272 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.273+0000 7f3083325800 20 add_watcher() i=3 2024-09-14T11:07:56.272 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.273+0000 7f3083325800 20 add_watcher() i=4 2024-09-14T11:07:56.272 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.273+0000 7f3083325800 20 add_watcher() i=5 2024-09-14T11:07:56.272 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.273+0000 7f3083325800 20 add_watcher() i=6 2024-09-14T11:07:56.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.274+0000 7f3083325800 20 add_watcher() i=7 2024-09-14T11:07:56.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.274+0000 7f3083325800 2 all 8 watchers are set, enabling cache 2024-09-14T11:07:56.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.276+0000 7f2f357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:07:56.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.276+0000 7f3083325800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:07:56.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.276+0000 7f3083325800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:07:56.275 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.276+0000 7f3083325800 5 note: GC not initialized 2024-09-14T11:07:56.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.276+0000 7f2eaffff640 20 reqs_thread_entry: start 2024-09-14T11:07:56.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.276+0000 7f3083325800 20 init_complete bucket index max shards: 11 2024-09-14T11:07:56.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.276+0000 7f3083325800 20 Filter name: none 2024-09-14T11:07:56.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.276+0000 7f2eadffb640 20 reqs_thread_entry: start 2024-09-14T11:07:56.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.276+0000 7f3083325800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.277+0000 7f3083325800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:07:56.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.277+0000 7f3083325800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.277 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.277+0000 7f3083325800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:07:56.277 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.277+0000 7f3083325800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:07:56.277 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.277+0000 7f3083325800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.277 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.277+0000 7f3083325800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:07:56.278 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.277+0000 7f3083325800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.278 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.278+0000 7f3083325800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:07:56.278 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.278+0000 7f3083325800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:07:56.278 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.279+0000 7f2f357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:07:56.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.281+0000 7f3083325800 20 remove_watcher() i=0 2024-09-14T11:07:56.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.281+0000 7f3083325800 2 removed watcher, disabling cache 2024-09-14T11:07:56.281 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.282+0000 7f3083325800 20 remove_watcher() i=1 2024-09-14T11:07:56.282 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.284+0000 7f3083325800 20 remove_watcher() i=2 2024-09-14T11:07:56.283 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.284+0000 7f3083325800 20 remove_watcher() i=3 2024-09-14T11:07:56.284 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.285+0000 7f3083325800 20 remove_watcher() i=4 2024-09-14T11:07:56.285 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.286+0000 7f3083325800 20 remove_watcher() i=5 2024-09-14T11:07:56.286 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.287+0000 7f3083325800 20 remove_watcher() i=6 2024-09-14T11:07:56.287 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.288+0000 7f3083325800 20 remove_watcher() i=7 2024-09-14T11:07:56.297 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:56.297 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:07:56.297 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: a-bucket id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 num_objects: 10 size_kb: 1 num_shards: 13 2024-09-14T11:07:56.298 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:56.299 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-14T11:07:56.333 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:07:56.333 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:07:56.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.371+0000 7f3f75416800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.372+0000 7f3f75416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:56.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.372+0000 7f3f75416800 20 realm 2024-09-14T11:07:56.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.372+0000 7f3f75416800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.372+0000 7f3f75416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:56.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.372+0000 7f3f75416800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:07:56.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.372+0000 7f3f75416800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.372 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.372+0000 7f3f75416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:56.372 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.373+0000 7f3f75416800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.372 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.373+0000 7f3f75416800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:07:56.372 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.373+0000 7f3f75416800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.374+0000 7f3f75416800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:07:56.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.374+0000 7f3f75416800 20 searching for the correct realm 2024-09-14T11:07:56.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.375+0000 7f3f70be7640 0 -- 172.21.15.97:0/3596470943 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x562766ca9c60 msgr2=0x562766cac100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:07:56.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.379+0000 7f3f70be7640 0 -- 172.21.15.97:0/3596470943 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7f3f58088b20 msgr2=0x7f3f58064990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:07:56.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.384+0000 7f3f75416800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:07:56.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.384+0000 7f3f75416800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:07:56.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.384+0000 7f3f75416800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:07:56.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.384+0000 7f3f75416800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:07:56.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.384+0000 7f3f75416800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:07:56.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.384+0000 7f3f75416800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:07:56.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.384+0000 7f3f75416800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.385+0000 7f3f75416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:56.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.385+0000 7f3f75416800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.385+0000 7f3f75416800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:07:56.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.385+0000 7f3f75416800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.385+0000 7f3f75416800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:07:56.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.385+0000 7f3f75416800 20 zone default found 2024-09-14T11:07:56.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.385+0000 7f3f75416800 4 Realm: () 2024-09-14T11:07:56.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.385+0000 7f3f75416800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:07:56.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.385+0000 7f3f75416800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:07:56.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.385+0000 7f3f75416800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:07:56.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.385+0000 7f3f75416800 20 zonegroup default 2024-09-14T11:07:56.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.385+0000 7f3f75416800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.385+0000 7f3f75416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:56.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.385+0000 7f3f75416800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.386+0000 7f3f75416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:56.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.386+0000 7f3f75416800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.386+0000 7f3f75416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:56.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.386+0000 7f3f75416800 20 started sync module instance, tier type = 2024-09-14T11:07:56.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.386+0000 7f3f75416800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:07:56.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.394+0000 7f3f75416800 20 add_watcher() i=0 2024-09-14T11:07:56.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.394+0000 7f3f75416800 20 add_watcher() i=1 2024-09-14T11:07:56.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.394+0000 7f3f75416800 20 add_watcher() i=2 2024-09-14T11:07:56.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.394+0000 7f3f75416800 20 add_watcher() i=3 2024-09-14T11:07:56.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.394+0000 7f3f75416800 20 add_watcher() i=4 2024-09-14T11:07:56.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.394+0000 7f3f75416800 20 add_watcher() i=5 2024-09-14T11:07:56.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.394+0000 7f3f75416800 20 add_watcher() i=6 2024-09-14T11:07:56.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.395+0000 7f3f75416800 20 add_watcher() i=7 2024-09-14T11:07:56.394 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.395+0000 7f3f75416800 2 all 8 watchers are set, enabling cache 2024-09-14T11:07:56.395 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.397+0000 7f3e26fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:07:56.397 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.397+0000 7f3f75416800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:07:56.397 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.397+0000 7f3f75416800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:07:56.397 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.397+0000 7f3f75416800 5 note: GC not initialized 2024-09-14T11:07:56.397 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.398+0000 7f3e25fe3640 20 reqs_thread_entry: start 2024-09-14T11:07:56.397 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.398+0000 7f3f75416800 20 init_complete bucket index max shards: 11 2024-09-14T11:07:56.397 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.398+0000 7f3f75416800 20 Filter name: none 2024-09-14T11:07:56.397 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.398+0000 7f3d977fe640 20 reqs_thread_entry: start 2024-09-14T11:07:56.397 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.398+0000 7f3f75416800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:07:56.397 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.398+0000 7f3f75416800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.397 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.398+0000 7f3f75416800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:07:56.397 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.398+0000 7f3f75416800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:07:56.398 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.398+0000 7f3f75416800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:07:56.398 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.398+0000 7f3f75416800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 : miss 2024-09-14T11:07:56.398 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.398+0000 7f3f75416800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.398 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.399+0000 7f3f75416800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:07:56.398 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.399+0000 7f3f75416800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:07:56.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.399+0000 7f3f75416800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:07:56.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.399+0000 7f3f75416800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:07:56.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.399+0000 7f3f75416800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:07:56.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.399+0000 7f3f75416800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 2024-09-14T11:07:56.404 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.405+0000 7f3f75416800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:07:56.404 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.405+0000 7f3f75416800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:07:56.404 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.405+0000 7f3f75416800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:07:56.404 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.405+0000 7f3f75416800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17, ofs0, ns] 2024-09-14T11:07:56.404 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.405+0000 7f3e47fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595245 cookie 94727228340976 notifier 8292 bl.length()=827 2024-09-14T11:07:56.404 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.405+0000 7f3e47fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:07:56.404 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.405+0000 7f3e47fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:07:56.404 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.405+0000 7f3e47fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:07:56.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.405+0000 7f3f75416800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): orig_sources= new_sources= 2024-09-14T11:07:56.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.405+0000 7f3f75416800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): potential sources added=[] removed=[] 2024-09-14T11:07:56.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.405+0000 7f3f75416800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): orig_dests= new_dests= 2024-09-14T11:07:56.405 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.405+0000 7f3f75416800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): potential dests added=[] removed=[] 2024-09-14T11:07:56.411 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3f75416800 time 2024-09-14T11:07:56.413594+0000 2024-09-14T11:07:56.411 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:07:56.411 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:07:56.411 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3f7658c76a] 2024-09-14T11:07:56.412 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f3f7658c928] 2024-09-14T11:07:56.412 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5627656880b1] 2024-09-14T11:07:56.412 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562765697f6a] 2024-09-14T11:07:56.412 INFO:tasks.workunit.client.0.smithi097.stderr: 5: main() 2024-09-14T11:07:56.412 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f3f75229590] 2024-09-14T11:07:56.413 INFO:tasks.workunit.client.0.smithi097.stderr: 7: __libc_start_main() 2024-09-14T11:07:56.413 INFO:tasks.workunit.client.0.smithi097.stderr: 8: _start() 2024-09-14T11:07:56.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.413+0000 7f3f75416800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3f75416800 time 2024-09-14T11:07:56.413594+0000 2024-09-14T11:07:56.413 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:07:56.413 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:56.414 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:07:56.414 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3f7658c76a] 2024-09-14T11:07:56.414 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f3f7658c928] 2024-09-14T11:07:56.414 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5627656880b1] 2024-09-14T11:07:56.414 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562765697f6a] 2024-09-14T11:07:56.414 INFO:tasks.workunit.client.0.smithi097.stderr: 5: main() 2024-09-14T11:07:56.414 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f3f75229590] 2024-09-14T11:07:56.414 INFO:tasks.workunit.client.0.smithi097.stderr: 7: __libc_start_main() 2024-09-14T11:07:56.414 INFO:tasks.workunit.client.0.smithi097.stderr: 8: _start() 2024-09-14T11:07:56.415 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:56.415 INFO:tasks.workunit.client.0.smithi097.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:07:56.415 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f3f75416800 thread_name:radosgw-admin 2024-09-14T11:07:56.432 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:07:56.432 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3f7523e6f0] 2024-09-14T11:07:56.433 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3f7528b99c] 2024-09-14T11:07:56.433 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-14T11:07:56.433 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-14T11:07:56.433 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3f7658c7c4] 2024-09-14T11:07:56.433 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f3f7658c928] 2024-09-14T11:07:56.433 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5627656880b1] 2024-09-14T11:07:56.433 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562765697f6a] 2024-09-14T11:07:56.433 INFO:tasks.workunit.client.0.smithi097.stderr: 9: main() 2024-09-14T11:07:56.433 INFO:tasks.workunit.client.0.smithi097.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f3f75229590] 2024-09-14T11:07:56.433 INFO:tasks.workunit.client.0.smithi097.stderr: 11: __libc_start_main() 2024-09-14T11:07:56.434 INFO:tasks.workunit.client.0.smithi097.stderr: 12: _start() 2024-09-14T11:07:56.434 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.414+0000 7f3f75416800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:07:56.434 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f3f75416800 thread_name:radosgw-admin 2024-09-14T11:07:56.434 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:56.434 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:07:56.434 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3f7523e6f0] 2024-09-14T11:07:56.434 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3f7528b99c] 2024-09-14T11:07:56.434 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-14T11:07:56.434 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-14T11:07:56.434 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3f7658c7c4] 2024-09-14T11:07:56.434 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f3f7658c928] 2024-09-14T11:07:56.434 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5627656880b1] 2024-09-14T11:07:56.434 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562765697f6a] 2024-09-14T11:07:56.434 INFO:tasks.workunit.client.0.smithi097.stderr: 9: main() 2024-09-14T11:07:56.434 INFO:tasks.workunit.client.0.smithi097.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f3f75229590] 2024-09-14T11:07:56.435 INFO:tasks.workunit.client.0.smithi097.stderr: 11: __libc_start_main() 2024-09-14T11:07:56.435 INFO:tasks.workunit.client.0.smithi097.stderr: 12: _start() 2024-09-14T11:07:56.435 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:07:56.435 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:56.435 INFO:tasks.workunit.client.0.smithi097.stderr:--- begin dump of recent events --- 2024-09-14T11:07:56.435 INFO:tasks.workunit.client.0.smithi097.stderr: -499> 2024-09-14T11:07:56.354+0000 7f3f75416800 10 monclient: shutdown 2024-09-14T11:07:56.435 INFO:tasks.workunit.client.0.smithi097.stderr: -498> 2024-09-14T11:07:56.354+0000 7f3f75416800 5 asok(0x56276699a270) unregister_commands rotate-key 2024-09-14T11:07:56.435 INFO:tasks.workunit.client.0.smithi097.stderr: -497> 2024-09-14T11:07:56.354+0000 7f3f75416800 10 monclient: build_initial_monmap 2024-09-14T11:07:56.435 INFO:tasks.workunit.client.0.smithi097.stderr: -496> 2024-09-14T11:07:56.354+0000 7f3f75416800 1 build_initial for_mkfs: 0 2024-09-14T11:07:56.435 INFO:tasks.workunit.client.0.smithi097.stderr: -495> 2024-09-14T11:07:56.354+0000 7f3f75416800 10 monclient: monmap: 2024-09-14T11:07:56.435 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:07:56.436 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:07:56.436 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:07:56.436 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:07:56.436 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:07:56.436 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:07:56.436 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:07:56.436 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:07:56.436 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:07:56.436 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:56.436 INFO:tasks.workunit.client.0.smithi097.stderr: -494> 2024-09-14T11:07:56.354+0000 7f3f75416800 5 AuthRegistry(0x562766bc1fc0) adding auth protocol: cephx 2024-09-14T11:07:56.436 INFO:tasks.workunit.client.0.smithi097.stderr: -493> 2024-09-14T11:07:56.354+0000 7f3f75416800 5 AuthRegistry(0x562766bc1fc0) adding auth protocol: cephx 2024-09-14T11:07:56.436 INFO:tasks.workunit.client.0.smithi097.stderr: -492> 2024-09-14T11:07:56.354+0000 7f3f75416800 5 AuthRegistry(0x562766bc1fc0) adding auth protocol: cephx 2024-09-14T11:07:56.436 INFO:tasks.workunit.client.0.smithi097.stderr: -491> 2024-09-14T11:07:56.354+0000 7f3f75416800 5 AuthRegistry(0x562766bc1fc0) adding con mode: secure 2024-09-14T11:07:56.436 INFO:tasks.workunit.client.0.smithi097.stderr: -490> 2024-09-14T11:07:56.354+0000 7f3f75416800 5 AuthRegistry(0x562766bc1fc0) adding con mode: crc 2024-09-14T11:07:56.436 INFO:tasks.workunit.client.0.smithi097.stderr: -489> 2024-09-14T11:07:56.354+0000 7f3f75416800 5 AuthRegistry(0x562766bc1fc0) adding con mode: secure 2024-09-14T11:07:56.437 INFO:tasks.workunit.client.0.smithi097.stderr: -488> 2024-09-14T11:07:56.354+0000 7f3f75416800 5 AuthRegistry(0x562766bc1fc0) adding con mode: crc 2024-09-14T11:07:56.437 INFO:tasks.workunit.client.0.smithi097.stderr: -487> 2024-09-14T11:07:56.354+0000 7f3f75416800 5 AuthRegistry(0x562766bc1fc0) adding con mode: secure 2024-09-14T11:07:56.437 INFO:tasks.workunit.client.0.smithi097.stderr: -486> 2024-09-14T11:07:56.354+0000 7f3f75416800 5 AuthRegistry(0x562766bc1fc0) adding con mode: crc 2024-09-14T11:07:56.437 INFO:tasks.workunit.client.0.smithi097.stderr: -485> 2024-09-14T11:07:56.354+0000 7f3f75416800 5 AuthRegistry(0x562766bc1fc0) adding con mode: crc 2024-09-14T11:07:56.437 INFO:tasks.workunit.client.0.smithi097.stderr: -484> 2024-09-14T11:07:56.354+0000 7f3f75416800 5 AuthRegistry(0x562766bc1fc0) adding con mode: secure 2024-09-14T11:07:56.437 INFO:tasks.workunit.client.0.smithi097.stderr: -483> 2024-09-14T11:07:56.354+0000 7f3f75416800 5 AuthRegistry(0x562766bc1fc0) adding con mode: crc 2024-09-14T11:07:56.437 INFO:tasks.workunit.client.0.smithi097.stderr: -482> 2024-09-14T11:07:56.354+0000 7f3f75416800 5 AuthRegistry(0x562766bc1fc0) adding con mode: secure 2024-09-14T11:07:56.437 INFO:tasks.workunit.client.0.smithi097.stderr: -481> 2024-09-14T11:07:56.354+0000 7f3f75416800 5 AuthRegistry(0x562766bc1fc0) adding con mode: crc 2024-09-14T11:07:56.437 INFO:tasks.workunit.client.0.smithi097.stderr: -480> 2024-09-14T11:07:56.354+0000 7f3f75416800 5 AuthRegistry(0x562766bc1fc0) adding con mode: secure 2024-09-14T11:07:56.437 INFO:tasks.workunit.client.0.smithi097.stderr: -479> 2024-09-14T11:07:56.355+0000 7f3f75416800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:07:56.437 INFO:tasks.workunit.client.0.smithi097.stderr: -478> 2024-09-14T11:07:56.355+0000 7f3f75416800 1 librados: starting msgr at 2024-09-14T11:07:56.437 INFO:tasks.workunit.client.0.smithi097.stderr: -477> 2024-09-14T11:07:56.355+0000 7f3f75416800 1 librados: starting objecter 2024-09-14T11:07:56.437 INFO:tasks.workunit.client.0.smithi097.stderr: -476> 2024-09-14T11:07:56.355+0000 7f3f75416800 5 asok(0x56276699a270) register_command objecter_requests hook 0x562766bc45e0 2024-09-14T11:07:56.437 INFO:tasks.workunit.client.0.smithi097.stderr: -475> 2024-09-14T11:07:56.355+0000 7f3f75416800 1 librados: setting wanted keys 2024-09-14T11:07:56.438 INFO:tasks.workunit.client.0.smithi097.stderr: -474> 2024-09-14T11:07:56.355+0000 7f3f75416800 1 librados: calling monclient init 2024-09-14T11:07:56.438 INFO:tasks.workunit.client.0.smithi097.stderr: -473> 2024-09-14T11:07:56.355+0000 7f3f75416800 10 monclient: init 2024-09-14T11:07:56.438 INFO:tasks.workunit.client.0.smithi097.stderr: -472> 2024-09-14T11:07:56.355+0000 7f3f75416800 5 AuthRegistry(0x562766bbc2a0) adding auth protocol: cephx 2024-09-14T11:07:56.438 INFO:tasks.workunit.client.0.smithi097.stderr: -471> 2024-09-14T11:07:56.355+0000 7f3f75416800 5 AuthRegistry(0x562766bbc2a0) adding auth protocol: cephx 2024-09-14T11:07:56.438 INFO:tasks.workunit.client.0.smithi097.stderr: -470> 2024-09-14T11:07:56.355+0000 7f3f75416800 5 AuthRegistry(0x562766bbc2a0) adding auth protocol: cephx 2024-09-14T11:07:56.438 INFO:tasks.workunit.client.0.smithi097.stderr: -469> 2024-09-14T11:07:56.355+0000 7f3f75416800 5 AuthRegistry(0x562766bbc2a0) adding con mode: secure 2024-09-14T11:07:56.438 INFO:tasks.workunit.client.0.smithi097.stderr: -468> 2024-09-14T11:07:56.355+0000 7f3f75416800 5 AuthRegistry(0x562766bbc2a0) adding con mode: crc 2024-09-14T11:07:56.438 INFO:tasks.workunit.client.0.smithi097.stderr: -467> 2024-09-14T11:07:56.355+0000 7f3f75416800 5 AuthRegistry(0x562766bbc2a0) adding con mode: secure 2024-09-14T11:07:56.438 INFO:tasks.workunit.client.0.smithi097.stderr: -466> 2024-09-14T11:07:56.355+0000 7f3f75416800 5 AuthRegistry(0x562766bbc2a0) adding con mode: crc 2024-09-14T11:07:56.438 INFO:tasks.workunit.client.0.smithi097.stderr: -465> 2024-09-14T11:07:56.355+0000 7f3f75416800 5 AuthRegistry(0x562766bbc2a0) adding con mode: secure 2024-09-14T11:07:56.438 INFO:tasks.workunit.client.0.smithi097.stderr: -464> 2024-09-14T11:07:56.355+0000 7f3f75416800 5 AuthRegistry(0x562766bbc2a0) adding con mode: crc 2024-09-14T11:07:56.438 INFO:tasks.workunit.client.0.smithi097.stderr: -463> 2024-09-14T11:07:56.355+0000 7f3f75416800 5 AuthRegistry(0x562766bbc2a0) adding con mode: crc 2024-09-14T11:07:56.438 INFO:tasks.workunit.client.0.smithi097.stderr: -462> 2024-09-14T11:07:56.355+0000 7f3f75416800 5 AuthRegistry(0x562766bbc2a0) adding con mode: secure 2024-09-14T11:07:56.439 INFO:tasks.workunit.client.0.smithi097.stderr: -461> 2024-09-14T11:07:56.355+0000 7f3f75416800 5 AuthRegistry(0x562766bbc2a0) adding con mode: crc 2024-09-14T11:07:56.439 INFO:tasks.workunit.client.0.smithi097.stderr: -460> 2024-09-14T11:07:56.355+0000 7f3f75416800 5 AuthRegistry(0x562766bbc2a0) adding con mode: secure 2024-09-14T11:07:56.439 INFO:tasks.workunit.client.0.smithi097.stderr: -459> 2024-09-14T11:07:56.355+0000 7f3f75416800 5 AuthRegistry(0x562766bbc2a0) adding con mode: crc 2024-09-14T11:07:56.439 INFO:tasks.workunit.client.0.smithi097.stderr: -458> 2024-09-14T11:07:56.355+0000 7f3f75416800 5 AuthRegistry(0x562766bbc2a0) adding con mode: secure 2024-09-14T11:07:56.439 INFO:tasks.workunit.client.0.smithi097.stderr: -457> 2024-09-14T11:07:56.355+0000 7f3f75416800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:07:56.439 INFO:tasks.workunit.client.0.smithi097.stderr: -456> 2024-09-14T11:07:56.355+0000 7f3f75416800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:07:56.439 INFO:tasks.workunit.client.0.smithi097.stderr: -455> 2024-09-14T11:07:56.355+0000 7f3f75416800 5 asok(0x56276699a270) register_command rotate-key hook 0x562766bbc3e8 2024-09-14T11:07:56.439 INFO:tasks.workunit.client.0.smithi097.stderr: -454> 2024-09-14T11:07:56.355+0000 7f3f75416800 10 monclient: _reopen_session rank -1 2024-09-14T11:07:56.439 INFO:tasks.workunit.client.0.smithi097.stderr: -453> 2024-09-14T11:07:56.355+0000 7f3f75416800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:07:56.439 INFO:tasks.workunit.client.0.smithi097.stderr: -452> 2024-09-14T11:07:56.355+0000 7f3f75416800 10 monclient(hunting): picked mon.noname-c con 0x562766a721d0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:07:56.440 INFO:tasks.workunit.client.0.smithi097.stderr: -451> 2024-09-14T11:07:56.355+0000 7f3f75416800 10 monclient(hunting): picked mon.noname-a con 0x562766aff740 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:07:56.440 INFO:tasks.workunit.client.0.smithi097.stderr: -450> 2024-09-14T11:07:56.355+0000 7f3f75416800 10 monclient(hunting): picked mon.noname-b con 0x562766b02b00 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:07:56.440 INFO:tasks.workunit.client.0.smithi097.stderr: -449> 2024-09-14T11:07:56.355+0000 7f3f75416800 10 monclient(hunting): start opening mon connection 2024-09-14T11:07:56.440 INFO:tasks.workunit.client.0.smithi097.stderr: -448> 2024-09-14T11:07:56.355+0000 7f3f75416800 10 monclient(hunting): start opening mon connection 2024-09-14T11:07:56.440 INFO:tasks.workunit.client.0.smithi097.stderr: -447> 2024-09-14T11:07:56.355+0000 7f3f75416800 10 monclient(hunting): start opening mon connection 2024-09-14T11:07:56.440 INFO:tasks.workunit.client.0.smithi097.stderr: -446> 2024-09-14T11:07:56.355+0000 7f3f75416800 10 monclient(hunting): _renew_subs 2024-09-14T11:07:56.440 INFO:tasks.workunit.client.0.smithi097.stderr: -445> 2024-09-14T11:07:56.355+0000 7f3f75416800 10 monclient(hunting): authenticate will time out at 2158.008747s 2024-09-14T11:07:56.440 INFO:tasks.workunit.client.0.smithi097.stderr: -444> 2024-09-14T11:07:56.355+0000 7f3f70be7640 10 monclient(hunting): get_auth_request con 0x562766a721d0 auth_method 0 2024-09-14T11:07:56.440 INFO:tasks.workunit.client.0.smithi097.stderr: -443> 2024-09-14T11:07:56.355+0000 7f3f70be7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:07:56.441 INFO:tasks.workunit.client.0.smithi097.stderr: -442> 2024-09-14T11:07:56.355+0000 7f3f70be7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:07:56.441 INFO:tasks.workunit.client.0.smithi097.stderr: -441> 2024-09-14T11:07:56.355+0000 7f3f70be7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:07:56.441 INFO:tasks.workunit.client.0.smithi097.stderr: -440> 2024-09-14T11:07:56.355+0000 7f3f703e6640 10 monclient(hunting): get_auth_request con 0x562766aff740 auth_method 0 2024-09-14T11:07:56.441 INFO:tasks.workunit.client.0.smithi097.stderr: -439> 2024-09-14T11:07:56.355+0000 7f3f703e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:07:56.441 INFO:tasks.workunit.client.0.smithi097.stderr: -438> 2024-09-14T11:07:56.355+0000 7f3f703e6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:07:56.441 INFO:tasks.workunit.client.0.smithi097.stderr: -437> 2024-09-14T11:07:56.355+0000 7f3f703e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:07:56.441 INFO:tasks.workunit.client.0.smithi097.stderr: -436> 2024-09-14T11:07:56.355+0000 7f3f70be7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:07:56.441 INFO:tasks.workunit.client.0.smithi097.stderr: -435> 2024-09-14T11:07:56.355+0000 7f3f70be7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:07:56.441 INFO:tasks.workunit.client.0.smithi097.stderr: -434> 2024-09-14T11:07:56.355+0000 7f3f70be7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:07:56.441 INFO:tasks.workunit.client.0.smithi097.stderr: -433> 2024-09-14T11:07:56.355+0000 7f3f703e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:07:56.441 INFO:tasks.workunit.client.0.smithi097.stderr: -432> 2024-09-14T11:07:56.355+0000 7f3f703e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:07:56.441 INFO:tasks.workunit.client.0.smithi097.stderr: -431> 2024-09-14T11:07:56.355+0000 7f3f703e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:07:56.441 INFO:tasks.workunit.client.0.smithi097.stderr: -430> 2024-09-14T11:07:56.355+0000 7f3f713e8640 10 monclient(hunting): get_auth_request con 0x562766b02b00 auth_method 0 2024-09-14T11:07:56.442 INFO:tasks.workunit.client.0.smithi097.stderr: -429> 2024-09-14T11:07:56.355+0000 7f3f713e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:07:56.442 INFO:tasks.workunit.client.0.smithi097.stderr: -428> 2024-09-14T11:07:56.355+0000 7f3f713e8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:07:56.442 INFO:tasks.workunit.client.0.smithi097.stderr: -427> 2024-09-14T11:07:56.355+0000 7f3f713e8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:07:56.442 INFO:tasks.workunit.client.0.smithi097.stderr: -426> 2024-09-14T11:07:56.356+0000 7f3f713e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:07:56.442 INFO:tasks.workunit.client.0.smithi097.stderr: -425> 2024-09-14T11:07:56.356+0000 7f3f713e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:07:56.442 INFO:tasks.workunit.client.0.smithi097.stderr: -424> 2024-09-14T11:07:56.356+0000 7f3f713e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:07:56.442 INFO:tasks.workunit.client.0.smithi097.stderr: -423> 2024-09-14T11:07:56.356+0000 7f3f703e6640 10 monclient(hunting): handle_auth_done global_id 8283 payload 824 2024-09-14T11:07:56.442 INFO:tasks.workunit.client.0.smithi097.stderr: -422> 2024-09-14T11:07:56.356+0000 7f3f703e6640 10 monclient: _finish_hunting 0 2024-09-14T11:07:56.442 INFO:tasks.workunit.client.0.smithi097.stderr: -421> 2024-09-14T11:07:56.356+0000 7f3f703e6640 1 monclient: found mon.noname-a 2024-09-14T11:07:56.442 INFO:tasks.workunit.client.0.smithi097.stderr: -420> 2024-09-14T11:07:56.356+0000 7f3f703e6640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-14T11:07:56.442 INFO:tasks.workunit.client.0.smithi097.stderr: -419> 2024-09-14T11:07:56.356+0000 7f3e5d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:07:56.442 INFO:tasks.workunit.client.0.smithi097.stderr: -418> 2024-09-14T11:07:56.356+0000 7f3e5d60a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:07:56.442 INFO:tasks.workunit.client.0.smithi097.stderr: -417> 2024-09-14T11:07:56.356+0000 7f3e5d60a640 10 monclient: dump: 2024-09-14T11:07:56.442 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:07:56.442 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:07:56.443 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:56.443 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:56.443 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:07:56.443 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:07:56.443 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:07:56.443 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:07:56.443 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:07:56.443 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:56.443 INFO:tasks.workunit.client.0.smithi097.stderr: -416> 2024-09-14T11:07:56.356+0000 7f3e5d60a640 10 monclient: _finish_auth 0 2024-09-14T11:07:56.443 INFO:tasks.workunit.client.0.smithi097.stderr: -415> 2024-09-14T11:07:56.356+0000 7f3e5d60a640 10 monclient: _check_auth_tickets 2024-09-14T11:07:56.443 INFO:tasks.workunit.client.0.smithi097.stderr: -414> 2024-09-14T11:07:56.356+0000 7f3e5d60a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:07:56.443 INFO:tasks.workunit.client.0.smithi097.stderr: -413> 2024-09-14T11:07:56.356+0000 7f3e5d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:07:56.443 INFO:tasks.workunit.client.0.smithi097.stderr: -412> 2024-09-14T11:07:56.356+0000 7f3e5d60a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:07:56.444 INFO:tasks.workunit.client.0.smithi097.stderr: -411> 2024-09-14T11:07:56.356+0000 7f3e5d60a640 10 monclient: dump: 2024-09-14T11:07:56.444 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:07:56.444 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:07:56.444 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:56.444 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:56.444 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:07:56.444 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:07:56.444 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:07:56.444 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:07:56.444 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:07:56.444 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:56.444 INFO:tasks.workunit.client.0.smithi097.stderr: -410> 2024-09-14T11:07:56.356+0000 7f3f75416800 5 monclient: authenticate success, global_id 8283 2024-09-14T11:07:56.444 INFO:tasks.workunit.client.0.smithi097.stderr: -409> 2024-09-14T11:07:56.356+0000 7f3f75416800 10 monclient: _renew_subs 2024-09-14T11:07:56.445 INFO:tasks.workunit.client.0.smithi097.stderr: -408> 2024-09-14T11:07:56.356+0000 7f3f75416800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:07:56.445 INFO:tasks.workunit.client.0.smithi097.stderr: -407> 2024-09-14T11:07:56.356+0000 7f3e5ee0d640 4 set_mon_vals no callback set 2024-09-14T11:07:56.445 INFO:tasks.workunit.client.0.smithi097.stderr: -406> 2024-09-14T11:07:56.356+0000 7f3f75416800 10 monclient: _renew_subs 2024-09-14T11:07:56.445 INFO:tasks.workunit.client.0.smithi097.stderr: -405> 2024-09-14T11:07:56.356+0000 7f3f75416800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:07:56.445 INFO:tasks.workunit.client.0.smithi097.stderr: -404> 2024-09-14T11:07:56.356+0000 7f3f75416800 1 librados: init done 2024-09-14T11:07:56.445 INFO:tasks.workunit.client.0.smithi097.stderr: -403> 2024-09-14T11:07:56.358+0000 7f3e5d60a640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:07:56.445 INFO:tasks.workunit.client.0.smithi097.stderr: -402> 2024-09-14T11:07:56.358+0000 7f3e5d60a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:07:56.445 INFO:tasks.workunit.client.0.smithi097.stderr: -401> 2024-09-14T11:07:56.358+0000 7f3e5d60a640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:07:56.445 INFO:tasks.workunit.client.0.smithi097.stderr: -400> 2024-09-14T11:07:56.358+0000 7f3f70be7640 10 monclient: get_auth_request con 0x7f3e58077230 auth_method 0 2024-09-14T11:07:56.445 INFO:tasks.workunit.client.0.smithi097.stderr: -399> 2024-09-14T11:07:56.358+0000 7f3f713e8640 10 monclient: get_auth_request con 0x562766be3300 auth_method 0 2024-09-14T11:07:56.445 INFO:tasks.workunit.client.0.smithi097.stderr: -398> 2024-09-14T11:07:56.359+0000 7f3f70be7640 10 monclient: get_auth_request con 0x562766c07cc0 auth_method 0 2024-09-14T11:07:56.445 INFO:tasks.workunit.client.0.smithi097.stderr: -397> 2024-09-14T11:07:56.360+0000 7f3f703e6640 10 monclient: get_auth_request con 0x562766c0c070 auth_method 0 2024-09-14T11:07:56.445 INFO:tasks.workunit.client.0.smithi097.stderr: -396> 2024-09-14T11:07:56.361+0000 7f3f713e8640 10 monclient: get_auth_request con 0x562766c0b540 auth_method 0 2024-09-14T11:07:56.446 INFO:tasks.workunit.client.0.smithi097.stderr: -395> 2024-09-14T11:07:56.362+0000 7f3f75416800 10 monclient: build_initial_monmap 2024-09-14T11:07:56.446 INFO:tasks.workunit.client.0.smithi097.stderr: -394> 2024-09-14T11:07:56.362+0000 7f3f75416800 1 build_initial for_mkfs: 0 2024-09-14T11:07:56.446 INFO:tasks.workunit.client.0.smithi097.stderr: -393> 2024-09-14T11:07:56.362+0000 7f3f75416800 10 monclient: monmap: 2024-09-14T11:07:56.446 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:07:56.446 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:07:56.446 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:07:56.446 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:07:56.446 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:07:56.446 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:07:56.446 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:07:56.446 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:07:56.446 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:07:56.446 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:56.446 INFO:tasks.workunit.client.0.smithi097.stderr: -392> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c142c0) adding auth protocol: cephx 2024-09-14T11:07:56.447 INFO:tasks.workunit.client.0.smithi097.stderr: -391> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c142c0) adding auth protocol: cephx 2024-09-14T11:07:56.447 INFO:tasks.workunit.client.0.smithi097.stderr: -390> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c142c0) adding auth protocol: cephx 2024-09-14T11:07:56.447 INFO:tasks.workunit.client.0.smithi097.stderr: -389> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c142c0) adding con mode: secure 2024-09-14T11:07:56.447 INFO:tasks.workunit.client.0.smithi097.stderr: -388> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c142c0) adding con mode: crc 2024-09-14T11:07:56.447 INFO:tasks.workunit.client.0.smithi097.stderr: -387> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c142c0) adding con mode: secure 2024-09-14T11:07:56.447 INFO:tasks.workunit.client.0.smithi097.stderr: -386> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c142c0) adding con mode: crc 2024-09-14T11:07:56.447 INFO:tasks.workunit.client.0.smithi097.stderr: -385> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c142c0) adding con mode: secure 2024-09-14T11:07:56.447 INFO:tasks.workunit.client.0.smithi097.stderr: -384> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c142c0) adding con mode: crc 2024-09-14T11:07:56.447 INFO:tasks.workunit.client.0.smithi097.stderr: -383> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c142c0) adding con mode: crc 2024-09-14T11:07:56.447 INFO:tasks.workunit.client.0.smithi097.stderr: -382> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c142c0) adding con mode: secure 2024-09-14T11:07:56.447 INFO:tasks.workunit.client.0.smithi097.stderr: -381> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c142c0) adding con mode: crc 2024-09-14T11:07:56.447 INFO:tasks.workunit.client.0.smithi097.stderr: -380> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c142c0) adding con mode: secure 2024-09-14T11:07:56.447 INFO:tasks.workunit.client.0.smithi097.stderr: -379> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c142c0) adding con mode: crc 2024-09-14T11:07:56.447 INFO:tasks.workunit.client.0.smithi097.stderr: -378> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c142c0) adding con mode: secure 2024-09-14T11:07:56.448 INFO:tasks.workunit.client.0.smithi097.stderr: -377> 2024-09-14T11:07:56.362+0000 7f3f75416800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:07:56.448 INFO:tasks.workunit.client.0.smithi097.stderr: -376> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 asok(0x56276699a270) register_command objecter_requests cmddesc objecter_requests hook 0x562766c17770 EEXIST 2024-09-14T11:07:56.448 INFO:tasks.workunit.client.0.smithi097.stderr: -375> 2024-09-14T11:07:56.362+0000 7f3f75416800 10 monclient: init 2024-09-14T11:07:56.448 INFO:tasks.workunit.client.0.smithi097.stderr: -374> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c130c8) adding auth protocol: cephx 2024-09-14T11:07:56.448 INFO:tasks.workunit.client.0.smithi097.stderr: -373> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c130c8) adding auth protocol: cephx 2024-09-14T11:07:56.448 INFO:tasks.workunit.client.0.smithi097.stderr: -372> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c130c8) adding auth protocol: cephx 2024-09-14T11:07:56.448 INFO:tasks.workunit.client.0.smithi097.stderr: -371> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c130c8) adding con mode: secure 2024-09-14T11:07:56.448 INFO:tasks.workunit.client.0.smithi097.stderr: -370> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c130c8) adding con mode: crc 2024-09-14T11:07:56.448 INFO:tasks.workunit.client.0.smithi097.stderr: -369> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c130c8) adding con mode: secure 2024-09-14T11:07:56.448 INFO:tasks.workunit.client.0.smithi097.stderr: -368> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c130c8) adding con mode: crc 2024-09-14T11:07:56.448 INFO:tasks.workunit.client.0.smithi097.stderr: -367> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c130c8) adding con mode: secure 2024-09-14T11:07:56.448 INFO:tasks.workunit.client.0.smithi097.stderr: -366> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c130c8) adding con mode: crc 2024-09-14T11:07:56.448 INFO:tasks.workunit.client.0.smithi097.stderr: -365> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c130c8) adding con mode: crc 2024-09-14T11:07:56.448 INFO:tasks.workunit.client.0.smithi097.stderr: -364> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c130c8) adding con mode: secure 2024-09-14T11:07:56.449 INFO:tasks.workunit.client.0.smithi097.stderr: -363> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c130c8) adding con mode: crc 2024-09-14T11:07:56.449 INFO:tasks.workunit.client.0.smithi097.stderr: -362> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c130c8) adding con mode: secure 2024-09-14T11:07:56.449 INFO:tasks.workunit.client.0.smithi097.stderr: -361> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c130c8) adding con mode: crc 2024-09-14T11:07:56.449 INFO:tasks.workunit.client.0.smithi097.stderr: -360> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c130c8) adding con mode: secure 2024-09-14T11:07:56.449 INFO:tasks.workunit.client.0.smithi097.stderr: -359> 2024-09-14T11:07:56.362+0000 7f3f75416800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:07:56.449 INFO:tasks.workunit.client.0.smithi097.stderr: -358> 2024-09-14T11:07:56.362+0000 7f3f75416800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:07:56.449 INFO:tasks.workunit.client.0.smithi097.stderr: -357> 2024-09-14T11:07:56.363+0000 7f3f75416800 5 asok(0x56276699a270) register_command rotate-key cmddesc rotate-key hook 0x562766c13210 EEXIST 2024-09-14T11:07:56.449 INFO:tasks.workunit.client.0.smithi097.stderr: -356> 2024-09-14T11:07:56.363+0000 7f3f75416800 10 monclient: _reopen_session rank -1 2024-09-14T11:07:56.449 INFO:tasks.workunit.client.0.smithi097.stderr: -355> 2024-09-14T11:07:56.363+0000 7f3f75416800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:07:56.449 INFO:tasks.workunit.client.0.smithi097.stderr: -354> 2024-09-14T11:07:56.363+0000 7f3f75416800 10 monclient(hunting): picked mon.noname-b con 0x562766c3ba90 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:07:56.449 INFO:tasks.workunit.client.0.smithi097.stderr: -353> 2024-09-14T11:07:56.363+0000 7f3f75416800 10 monclient(hunting): picked mon.noname-c con 0x562766c3be70 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:07:56.449 INFO:tasks.workunit.client.0.smithi097.stderr: -352> 2024-09-14T11:07:56.363+0000 7f3f75416800 10 monclient(hunting): picked mon.noname-a con 0x562766c3a7a0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:07:56.449 INFO:tasks.workunit.client.0.smithi097.stderr: -351> 2024-09-14T11:07:56.363+0000 7f3f75416800 10 monclient(hunting): start opening mon connection 2024-09-14T11:07:56.449 INFO:tasks.workunit.client.0.smithi097.stderr: -350> 2024-09-14T11:07:56.363+0000 7f3f75416800 10 monclient(hunting): start opening mon connection 2024-09-14T11:07:56.450 INFO:tasks.workunit.client.0.smithi097.stderr: -349> 2024-09-14T11:07:56.363+0000 7f3f75416800 10 monclient(hunting): start opening mon connection 2024-09-14T11:07:56.450 INFO:tasks.workunit.client.0.smithi097.stderr: -348> 2024-09-14T11:07:56.363+0000 7f3f75416800 10 monclient(hunting): _renew_subs 2024-09-14T11:07:56.450 INFO:tasks.workunit.client.0.smithi097.stderr: -347> 2024-09-14T11:07:56.363+0000 7f3f75416800 10 monclient(hunting): authenticate will time out at 2158.016081s 2024-09-14T11:07:56.450 INFO:tasks.workunit.client.0.smithi097.stderr: -346> 2024-09-14T11:07:56.363+0000 7f3f713e8640 10 monclient(hunting): get_auth_request con 0x562766c3be70 auth_method 0 2024-09-14T11:07:56.450 INFO:tasks.workunit.client.0.smithi097.stderr: -345> 2024-09-14T11:07:56.363+0000 7f3f713e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:07:56.450 INFO:tasks.workunit.client.0.smithi097.stderr: -344> 2024-09-14T11:07:56.363+0000 7f3f713e8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:07:56.450 INFO:tasks.workunit.client.0.smithi097.stderr: -343> 2024-09-14T11:07:56.363+0000 7f3f713e8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:07:56.450 INFO:tasks.workunit.client.0.smithi097.stderr: -342> 2024-09-14T11:07:56.363+0000 7f3f70be7640 10 monclient(hunting): get_auth_request con 0x562766c3a7a0 auth_method 0 2024-09-14T11:07:56.450 INFO:tasks.workunit.client.0.smithi097.stderr: -341> 2024-09-14T11:07:56.363+0000 7f3f70be7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:07:56.450 INFO:tasks.workunit.client.0.smithi097.stderr: -340> 2024-09-14T11:07:56.363+0000 7f3f70be7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:07:56.450 INFO:tasks.workunit.client.0.smithi097.stderr: -339> 2024-09-14T11:07:56.363+0000 7f3f70be7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:07:56.450 INFO:tasks.workunit.client.0.smithi097.stderr: -338> 2024-09-14T11:07:56.363+0000 7f3f703e6640 10 monclient(hunting): get_auth_request con 0x562766c3ba90 auth_method 0 2024-09-14T11:07:56.450 INFO:tasks.workunit.client.0.smithi097.stderr: -337> 2024-09-14T11:07:56.363+0000 7f3f703e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:07:56.451 INFO:tasks.workunit.client.0.smithi097.stderr: -336> 2024-09-14T11:07:56.363+0000 7f3f703e6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:07:56.451 INFO:tasks.workunit.client.0.smithi097.stderr: -335> 2024-09-14T11:07:56.363+0000 7f3f703e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:07:56.451 INFO:tasks.workunit.client.0.smithi097.stderr: -334> 2024-09-14T11:07:56.363+0000 7f3f713e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:07:56.451 INFO:tasks.workunit.client.0.smithi097.stderr: -333> 2024-09-14T11:07:56.363+0000 7f3f713e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:07:56.451 INFO:tasks.workunit.client.0.smithi097.stderr: -332> 2024-09-14T11:07:56.363+0000 7f3f713e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:07:56.451 INFO:tasks.workunit.client.0.smithi097.stderr: -331> 2024-09-14T11:07:56.363+0000 7f3f70be7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:07:56.451 INFO:tasks.workunit.client.0.smithi097.stderr: -330> 2024-09-14T11:07:56.363+0000 7f3f70be7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:07:56.451 INFO:tasks.workunit.client.0.smithi097.stderr: -329> 2024-09-14T11:07:56.363+0000 7f3f70be7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:07:56.451 INFO:tasks.workunit.client.0.smithi097.stderr: -328> 2024-09-14T11:07:56.363+0000 7f3f703e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:07:56.451 INFO:tasks.workunit.client.0.smithi097.stderr: -327> 2024-09-14T11:07:56.363+0000 7f3f703e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:07:56.451 INFO:tasks.workunit.client.0.smithi097.stderr: -326> 2024-09-14T11:07:56.363+0000 7f3f703e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:07:56.451 INFO:tasks.workunit.client.0.smithi097.stderr: -325> 2024-09-14T11:07:56.363+0000 7f3f713e8640 10 monclient(hunting): handle_auth_done global_id 7772 payload 824 2024-09-14T11:07:56.451 INFO:tasks.workunit.client.0.smithi097.stderr: -324> 2024-09-14T11:07:56.363+0000 7f3f713e8640 10 monclient: _finish_hunting 0 2024-09-14T11:07:56.451 INFO:tasks.workunit.client.0.smithi097.stderr: -323> 2024-09-14T11:07:56.363+0000 7f3f713e8640 1 monclient: found mon.noname-c 2024-09-14T11:07:56.451 INFO:tasks.workunit.client.0.smithi097.stderr: -322> 2024-09-14T11:07:56.363+0000 7f3f713e8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:07:56.451 INFO:tasks.workunit.client.0.smithi097.stderr: -321> 2024-09-14T11:07:56.363+0000 7f3e567fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:07:56.452 INFO:tasks.workunit.client.0.smithi097.stderr: -320> 2024-09-14T11:07:56.363+0000 7f3e567fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:07:56.452 INFO:tasks.workunit.client.0.smithi097.stderr: -319> 2024-09-14T11:07:56.363+0000 7f3e567fc640 10 monclient: dump: 2024-09-14T11:07:56.452 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:07:56.452 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:07:56.452 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:56.452 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:56.452 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:07:56.452 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:07:56.452 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:07:56.452 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:07:56.452 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:07:56.452 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:56.452 INFO:tasks.workunit.client.0.smithi097.stderr: -318> 2024-09-14T11:07:56.363+0000 7f3e567fc640 10 monclient: _finish_auth 0 2024-09-14T11:07:56.453 INFO:tasks.workunit.client.0.smithi097.stderr: -317> 2024-09-14T11:07:56.363+0000 7f3e567fc640 10 monclient: _check_auth_tickets 2024-09-14T11:07:56.453 INFO:tasks.workunit.client.0.smithi097.stderr: -316> 2024-09-14T11:07:56.363+0000 7f3f75416800 5 monclient: authenticate success, global_id 7772 2024-09-14T11:07:56.453 INFO:tasks.workunit.client.0.smithi097.stderr: -315> 2024-09-14T11:07:56.363+0000 7f3e567fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:07:56.453 INFO:tasks.workunit.client.0.smithi097.stderr: -314> 2024-09-14T11:07:56.363+0000 7f3e567fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:07:56.453 INFO:tasks.workunit.client.0.smithi097.stderr: -313> 2024-09-14T11:07:56.363+0000 7f3e567fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:07:56.453 INFO:tasks.workunit.client.0.smithi097.stderr: -312> 2024-09-14T11:07:56.363+0000 7f3e567fc640 10 monclient: dump: 2024-09-14T11:07:56.453 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:07:56.453 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:07:56.453 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:56.453 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:56.453 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:07:56.454 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:07:56.454 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:07:56.454 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:07:56.454 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:07:56.454 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:56.454 INFO:tasks.workunit.client.0.smithi097.stderr: -311> 2024-09-14T11:07:56.363+0000 7f3f75416800 10 monclient: _renew_subs 2024-09-14T11:07:56.454 INFO:tasks.workunit.client.0.smithi097.stderr: -310> 2024-09-14T11:07:56.363+0000 7f3f71be9640 4 set_mon_vals no callback set 2024-09-14T11:07:56.454 INFO:tasks.workunit.client.0.smithi097.stderr: -309> 2024-09-14T11:07:56.363+0000 7f3f75416800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:07:56.454 INFO:tasks.workunit.client.0.smithi097.stderr: -308> 2024-09-14T11:07:56.363+0000 7f3f75416800 10 monclient: _renew_subs 2024-09-14T11:07:56.454 INFO:tasks.workunit.client.0.smithi097.stderr: -307> 2024-09-14T11:07:56.363+0000 7f3f75416800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:07:56.454 INFO:tasks.workunit.client.0.smithi097.stderr: -306> 2024-09-14T11:07:56.365+0000 7f3e567fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:07:56.454 INFO:tasks.workunit.client.0.smithi097.stderr: -305> 2024-09-14T11:07:56.365+0000 7f3e567fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:07:56.454 INFO:tasks.workunit.client.0.smithi097.stderr: -304> 2024-09-14T11:07:56.365+0000 7f3e567fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:07:56.454 INFO:tasks.workunit.client.0.smithi097.stderr: -303> 2024-09-14T11:07:56.365+0000 7f3f703e6640 10 monclient: get_auth_request con 0x7f3e48077140 auth_method 0 2024-09-14T11:07:56.455 INFO:tasks.workunit.client.0.smithi097.stderr: -302> 2024-09-14T11:07:56.365+0000 7f3f75416800 10 monclient: get_monmap_and_config 2024-09-14T11:07:56.455 INFO:tasks.workunit.client.0.smithi097.stderr: -301> 2024-09-14T11:07:56.365+0000 7f3f75416800 10 monclient: build_initial_monmap 2024-09-14T11:07:56.455 INFO:tasks.workunit.client.0.smithi097.stderr: -300> 2024-09-14T11:07:56.365+0000 7f3f75416800 1 build_initial for_mkfs: 0 2024-09-14T11:07:56.455 INFO:tasks.workunit.client.0.smithi097.stderr: -299> 2024-09-14T11:07:56.365+0000 7f3f75416800 10 monclient: monmap: 2024-09-14T11:07:56.455 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:07:56.455 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:07:56.455 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:07:56.455 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:07:56.455 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:07:56.455 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:07:56.455 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:07:56.455 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:07:56.455 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:07:56.456 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:56.456 INFO:tasks.workunit.client.0.smithi097.stderr: -298> 2024-09-14T11:07:56.365+0000 7f3f75416800 5 AuthRegistry(0x562766c5b940) adding auth protocol: cephx 2024-09-14T11:07:56.456 INFO:tasks.workunit.client.0.smithi097.stderr: -297> 2024-09-14T11:07:56.365+0000 7f3f75416800 5 AuthRegistry(0x562766c5b940) adding auth protocol: cephx 2024-09-14T11:07:56.456 INFO:tasks.workunit.client.0.smithi097.stderr: -296> 2024-09-14T11:07:56.365+0000 7f3f75416800 5 AuthRegistry(0x562766c5b940) adding auth protocol: cephx 2024-09-14T11:07:56.456 INFO:tasks.workunit.client.0.smithi097.stderr: -295> 2024-09-14T11:07:56.365+0000 7f3f75416800 5 AuthRegistry(0x562766c5b940) adding con mode: secure 2024-09-14T11:07:56.456 INFO:tasks.workunit.client.0.smithi097.stderr: -294> 2024-09-14T11:07:56.365+0000 7f3f75416800 5 AuthRegistry(0x562766c5b940) adding con mode: crc 2024-09-14T11:07:56.456 INFO:tasks.workunit.client.0.smithi097.stderr: -293> 2024-09-14T11:07:56.365+0000 7f3f75416800 5 AuthRegistry(0x562766c5b940) adding con mode: secure 2024-09-14T11:07:56.456 INFO:tasks.workunit.client.0.smithi097.stderr: -292> 2024-09-14T11:07:56.365+0000 7f3f75416800 5 AuthRegistry(0x562766c5b940) adding con mode: crc 2024-09-14T11:07:56.456 INFO:tasks.workunit.client.0.smithi097.stderr: -291> 2024-09-14T11:07:56.365+0000 7f3f75416800 5 AuthRegistry(0x562766c5b940) adding con mode: secure 2024-09-14T11:07:56.456 INFO:tasks.workunit.client.0.smithi097.stderr: -290> 2024-09-14T11:07:56.365+0000 7f3f75416800 5 AuthRegistry(0x562766c5b940) adding con mode: crc 2024-09-14T11:07:56.456 INFO:tasks.workunit.client.0.smithi097.stderr: -289> 2024-09-14T11:07:56.365+0000 7f3f75416800 5 AuthRegistry(0x562766c5b940) adding con mode: crc 2024-09-14T11:07:56.456 INFO:tasks.workunit.client.0.smithi097.stderr: -288> 2024-09-14T11:07:56.365+0000 7f3f75416800 5 AuthRegistry(0x562766c5b940) adding con mode: secure 2024-09-14T11:07:56.456 INFO:tasks.workunit.client.0.smithi097.stderr: -287> 2024-09-14T11:07:56.365+0000 7f3f75416800 5 AuthRegistry(0x562766c5b940) adding con mode: crc 2024-09-14T11:07:56.456 INFO:tasks.workunit.client.0.smithi097.stderr: -286> 2024-09-14T11:07:56.365+0000 7f3f75416800 5 AuthRegistry(0x562766c5b940) adding con mode: secure 2024-09-14T11:07:56.457 INFO:tasks.workunit.client.0.smithi097.stderr: -285> 2024-09-14T11:07:56.365+0000 7f3f75416800 5 AuthRegistry(0x562766c5b940) adding con mode: crc 2024-09-14T11:07:56.457 INFO:tasks.workunit.client.0.smithi097.stderr: -284> 2024-09-14T11:07:56.365+0000 7f3f75416800 5 AuthRegistry(0x562766c5b940) adding con mode: secure 2024-09-14T11:07:56.457 INFO:tasks.workunit.client.0.smithi097.stderr: -283> 2024-09-14T11:07:56.366+0000 7f3f75416800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:07:56.457 INFO:tasks.workunit.client.0.smithi097.stderr: -282> 2024-09-14T11:07:56.366+0000 7f3f75416800 10 monclient: init 2024-09-14T11:07:56.457 INFO:tasks.workunit.client.0.smithi097.stderr: -281> 2024-09-14T11:07:56.366+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e8eb0) adding auth protocol: cephx 2024-09-14T11:07:56.457 INFO:tasks.workunit.client.0.smithi097.stderr: -280> 2024-09-14T11:07:56.366+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e8eb0) adding auth protocol: cephx 2024-09-14T11:07:56.457 INFO:tasks.workunit.client.0.smithi097.stderr: -279> 2024-09-14T11:07:56.366+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e8eb0) adding auth protocol: cephx 2024-09-14T11:07:56.457 INFO:tasks.workunit.client.0.smithi097.stderr: -278> 2024-09-14T11:07:56.366+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e8eb0) adding con mode: secure 2024-09-14T11:07:56.457 INFO:tasks.workunit.client.0.smithi097.stderr: -277> 2024-09-14T11:07:56.366+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e8eb0) adding con mode: crc 2024-09-14T11:07:56.457 INFO:tasks.workunit.client.0.smithi097.stderr: -276> 2024-09-14T11:07:56.366+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e8eb0) adding con mode: secure 2024-09-14T11:07:56.458 INFO:tasks.workunit.client.0.smithi097.stderr: -275> 2024-09-14T11:07:56.366+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e8eb0) adding con mode: crc 2024-09-14T11:07:56.458 INFO:tasks.workunit.client.0.smithi097.stderr: -274> 2024-09-14T11:07:56.366+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e8eb0) adding con mode: secure 2024-09-14T11:07:56.458 INFO:tasks.workunit.client.0.smithi097.stderr: -273> 2024-09-14T11:07:56.366+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e8eb0) adding con mode: crc 2024-09-14T11:07:56.458 INFO:tasks.workunit.client.0.smithi097.stderr: -272> 2024-09-14T11:07:56.366+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e8eb0) adding con mode: crc 2024-09-14T11:07:56.458 INFO:tasks.workunit.client.0.smithi097.stderr: -271> 2024-09-14T11:07:56.366+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e8eb0) adding con mode: secure 2024-09-14T11:07:56.458 INFO:tasks.workunit.client.0.smithi097.stderr: -270> 2024-09-14T11:07:56.366+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e8eb0) adding con mode: crc 2024-09-14T11:07:56.458 INFO:tasks.workunit.client.0.smithi097.stderr: -269> 2024-09-14T11:07:56.366+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e8eb0) adding con mode: secure 2024-09-14T11:07:56.458 INFO:tasks.workunit.client.0.smithi097.stderr: -268> 2024-09-14T11:07:56.366+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e8eb0) adding con mode: crc 2024-09-14T11:07:56.458 INFO:tasks.workunit.client.0.smithi097.stderr: -267> 2024-09-14T11:07:56.366+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e8eb0) adding con mode: secure 2024-09-14T11:07:56.458 INFO:tasks.workunit.client.0.smithi097.stderr: -266> 2024-09-14T11:07:56.366+0000 7f3f75416800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:07:56.458 INFO:tasks.workunit.client.0.smithi097.stderr: -265> 2024-09-14T11:07:56.366+0000 7f3f75416800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:07:56.458 INFO:tasks.workunit.client.0.smithi097.stderr: -264> 2024-09-14T11:07:56.366+0000 7f3f75416800 5 asok(0x56276699a270) register_command rotate-key cmddesc rotate-key hook 0x7ffe528e8ff8 EEXIST 2024-09-14T11:07:56.458 INFO:tasks.workunit.client.0.smithi097.stderr: -263> 2024-09-14T11:07:56.366+0000 7f3f75416800 10 monclient: _reopen_session rank -1 2024-09-14T11:07:56.458 INFO:tasks.workunit.client.0.smithi097.stderr: -262> 2024-09-14T11:07:56.366+0000 7f3f75416800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:07:56.459 INFO:tasks.workunit.client.0.smithi097.stderr: -261> 2024-09-14T11:07:56.366+0000 7f3f75416800 10 monclient(hunting): picked mon.noname-b con 0x562766c90000 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:07:56.459 INFO:tasks.workunit.client.0.smithi097.stderr: -260> 2024-09-14T11:07:56.366+0000 7f3f75416800 10 monclient(hunting): picked mon.noname-a con 0x562766c60f50 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:07:56.459 INFO:tasks.workunit.client.0.smithi097.stderr: -259> 2024-09-14T11:07:56.366+0000 7f3f75416800 10 monclient(hunting): picked mon.noname-c con 0x562766c8b8a0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:07:56.459 INFO:tasks.workunit.client.0.smithi097.stderr: -258> 2024-09-14T11:07:56.366+0000 7f3f75416800 10 monclient(hunting): start opening mon connection 2024-09-14T11:07:56.459 INFO:tasks.workunit.client.0.smithi097.stderr: -257> 2024-09-14T11:07:56.366+0000 7f3f75416800 10 monclient(hunting): start opening mon connection 2024-09-14T11:07:56.459 INFO:tasks.workunit.client.0.smithi097.stderr: -256> 2024-09-14T11:07:56.366+0000 7f3f75416800 10 monclient(hunting): start opening mon connection 2024-09-14T11:07:56.459 INFO:tasks.workunit.client.0.smithi097.stderr: -255> 2024-09-14T11:07:56.366+0000 7f3f75416800 10 monclient(hunting): _renew_subs 2024-09-14T11:07:56.459 INFO:tasks.workunit.client.0.smithi097.stderr: -254> 2024-09-14T11:07:56.366+0000 7f3f75416800 10 monclient(hunting): authenticate will time out at 2158.019847s 2024-09-14T11:07:56.459 INFO:tasks.workunit.client.0.smithi097.stderr: -253> 2024-09-14T11:07:56.366+0000 7f3f713e8640 10 monclient(hunting): get_auth_request con 0x562766c60f50 auth_method 0 2024-09-14T11:07:56.459 INFO:tasks.workunit.client.0.smithi097.stderr: -252> 2024-09-14T11:07:56.366+0000 7f3f713e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:07:56.459 INFO:tasks.workunit.client.0.smithi097.stderr: -251> 2024-09-14T11:07:56.366+0000 7f3f713e8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:07:56.459 INFO:tasks.workunit.client.0.smithi097.stderr: -250> 2024-09-14T11:07:56.366+0000 7f3f713e8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:07:56.459 INFO:tasks.workunit.client.0.smithi097.stderr: -249> 2024-09-14T11:07:56.366+0000 7f3f70be7640 10 monclient(hunting): get_auth_request con 0x562766c8b8a0 auth_method 0 2024-09-14T11:07:56.460 INFO:tasks.workunit.client.0.smithi097.stderr: -248> 2024-09-14T11:07:56.366+0000 7f3f70be7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:07:56.460 INFO:tasks.workunit.client.0.smithi097.stderr: -247> 2024-09-14T11:07:56.366+0000 7f3f70be7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:07:56.460 INFO:tasks.workunit.client.0.smithi097.stderr: -246> 2024-09-14T11:07:56.366+0000 7f3f70be7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:07:56.460 INFO:tasks.workunit.client.0.smithi097.stderr: -245> 2024-09-14T11:07:56.367+0000 7f3f713e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:07:56.460 INFO:tasks.workunit.client.0.smithi097.stderr: -244> 2024-09-14T11:07:56.367+0000 7f3f713e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:07:56.461 INFO:tasks.workunit.client.0.smithi097.stderr: -243> 2024-09-14T11:07:56.367+0000 7f3f713e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:07:56.461 INFO:tasks.workunit.client.0.smithi097.stderr: -242> 2024-09-14T11:07:56.367+0000 7f3f70be7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:07:56.461 INFO:tasks.workunit.client.0.smithi097.stderr: -241> 2024-09-14T11:07:56.367+0000 7f3f70be7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:07:56.461 INFO:tasks.workunit.client.0.smithi097.stderr: -240> 2024-09-14T11:07:56.367+0000 7f3f70be7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:07:56.461 INFO:tasks.workunit.client.0.smithi097.stderr: -239> 2024-09-14T11:07:56.367+0000 7f3f703e6640 10 monclient(hunting): get_auth_request con 0x562766c90000 auth_method 0 2024-09-14T11:07:56.461 INFO:tasks.workunit.client.0.smithi097.stderr: -238> 2024-09-14T11:07:56.367+0000 7f3f703e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:07:56.461 INFO:tasks.workunit.client.0.smithi097.stderr: -237> 2024-09-14T11:07:56.367+0000 7f3f703e6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:07:56.461 INFO:tasks.workunit.client.0.smithi097.stderr: -236> 2024-09-14T11:07:56.367+0000 7f3f703e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:07:56.461 INFO:tasks.workunit.client.0.smithi097.stderr: -235> 2024-09-14T11:07:56.367+0000 7f3f713e8640 10 monclient(hunting): handle_auth_done global_id 8289 payload 274 2024-09-14T11:07:56.461 INFO:tasks.workunit.client.0.smithi097.stderr: -234> 2024-09-14T11:07:56.367+0000 7f3f713e8640 10 monclient: _finish_hunting 0 2024-09-14T11:07:56.461 INFO:tasks.workunit.client.0.smithi097.stderr: -233> 2024-09-14T11:07:56.367+0000 7f3f713e8640 1 monclient: found mon.noname-a 2024-09-14T11:07:56.461 INFO:tasks.workunit.client.0.smithi097.stderr: -232> 2024-09-14T11:07:56.367+0000 7f3f713e8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-14T11:07:56.462 INFO:tasks.workunit.client.0.smithi097.stderr: -231> 2024-09-14T11:07:56.367+0000 7f3e47fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:07:56.462 INFO:tasks.workunit.client.0.smithi097.stderr: -230> 2024-09-14T11:07:56.367+0000 7f3e47fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:07:56.462 INFO:tasks.workunit.client.0.smithi097.stderr: -229> 2024-09-14T11:07:56.367+0000 7f3e47fff640 10 monclient: dump: 2024-09-14T11:07:56.462 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:07:56.462 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:07:56.462 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:56.462 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:56.462 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:07:56.462 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:07:56.462 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:07:56.462 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:07:56.462 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:07:56.462 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:56.462 INFO:tasks.workunit.client.0.smithi097.stderr: -228> 2024-09-14T11:07:56.367+0000 7f3e47fff640 10 monclient: _finish_auth 0 2024-09-14T11:07:56.463 INFO:tasks.workunit.client.0.smithi097.stderr: -227> 2024-09-14T11:07:56.367+0000 7f3e47fff640 10 monclient: _check_auth_tickets 2024-09-14T11:07:56.463 INFO:tasks.workunit.client.0.smithi097.stderr: -226> 2024-09-14T11:07:56.367+0000 7f3e47fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:07:56.463 INFO:tasks.workunit.client.0.smithi097.stderr: -225> 2024-09-14T11:07:56.367+0000 7f3f75416800 5 monclient: authenticate success, global_id 8289 2024-09-14T11:07:56.463 INFO:tasks.workunit.client.0.smithi097.stderr: -224> 2024-09-14T11:07:56.367+0000 7f3f75416800 10 monclient: get_monmap_and_config success 2024-09-14T11:07:56.463 INFO:tasks.workunit.client.0.smithi097.stderr: -223> 2024-09-14T11:07:56.367+0000 7f3f75416800 4 set_mon_vals no callback set 2024-09-14T11:07:56.463 INFO:tasks.workunit.client.0.smithi097.stderr: -222> 2024-09-14T11:07:56.367+0000 7f3e47fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:07:56.463 INFO:tasks.workunit.client.0.smithi097.stderr: -221> 2024-09-14T11:07:56.367+0000 7f3e47fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:07:56.463 INFO:tasks.workunit.client.0.smithi097.stderr: -220> 2024-09-14T11:07:56.367+0000 7f3e47fff640 10 monclient: dump: 2024-09-14T11:07:56.463 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:07:56.463 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:07:56.463 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:56.463 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:56.463 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:07:56.463 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:07:56.463 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:07:56.464 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:07:56.464 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:07:56.464 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:56.464 INFO:tasks.workunit.client.0.smithi097.stderr: -219> 2024-09-14T11:07:56.367+0000 7f3f75416800 10 monclient: shutdown 2024-09-14T11:07:56.464 INFO:tasks.workunit.client.0.smithi097.stderr: -218> 2024-09-14T11:07:56.368+0000 7f3f75416800 10 monclient: build_initial_monmap 2024-09-14T11:07:56.464 INFO:tasks.workunit.client.0.smithi097.stderr: -217> 2024-09-14T11:07:56.368+0000 7f3f75416800 1 build_initial for_mkfs: 0 2024-09-14T11:07:56.464 INFO:tasks.workunit.client.0.smithi097.stderr: -216> 2024-09-14T11:07:56.368+0000 7f3f75416800 10 monclient: monmap: 2024-09-14T11:07:56.464 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:07:56.464 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:07:56.464 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:07:56.464 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:07:56.464 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:07:56.464 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:07:56.464 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:07:56.465 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:07:56.465 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:07:56.465 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:56.465 INFO:tasks.workunit.client.0.smithi097.stderr: -215> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c821a0) adding auth protocol: cephx 2024-09-14T11:07:56.465 INFO:tasks.workunit.client.0.smithi097.stderr: -214> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c821a0) adding auth protocol: cephx 2024-09-14T11:07:56.465 INFO:tasks.workunit.client.0.smithi097.stderr: -213> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c821a0) adding auth protocol: cephx 2024-09-14T11:07:56.465 INFO:tasks.workunit.client.0.smithi097.stderr: -212> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c821a0) adding con mode: secure 2024-09-14T11:07:56.465 INFO:tasks.workunit.client.0.smithi097.stderr: -211> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c821a0) adding con mode: crc 2024-09-14T11:07:56.465 INFO:tasks.workunit.client.0.smithi097.stderr: -210> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c821a0) adding con mode: secure 2024-09-14T11:07:56.465 INFO:tasks.workunit.client.0.smithi097.stderr: -209> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c821a0) adding con mode: crc 2024-09-14T11:07:56.465 INFO:tasks.workunit.client.0.smithi097.stderr: -208> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c821a0) adding con mode: secure 2024-09-14T11:07:56.465 INFO:tasks.workunit.client.0.smithi097.stderr: -207> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c821a0) adding con mode: crc 2024-09-14T11:07:56.465 INFO:tasks.workunit.client.0.smithi097.stderr: -206> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c821a0) adding con mode: crc 2024-09-14T11:07:56.465 INFO:tasks.workunit.client.0.smithi097.stderr: -205> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c821a0) adding con mode: secure 2024-09-14T11:07:56.466 INFO:tasks.workunit.client.0.smithi097.stderr: -204> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c821a0) adding con mode: crc 2024-09-14T11:07:56.466 INFO:tasks.workunit.client.0.smithi097.stderr: -203> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c821a0) adding con mode: secure 2024-09-14T11:07:56.466 INFO:tasks.workunit.client.0.smithi097.stderr: -202> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c821a0) adding con mode: crc 2024-09-14T11:07:56.466 INFO:tasks.workunit.client.0.smithi097.stderr: -201> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c821a0) adding con mode: secure 2024-09-14T11:07:56.466 INFO:tasks.workunit.client.0.smithi097.stderr: -200> 2024-09-14T11:07:56.368+0000 7f3f75416800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:07:56.466 INFO:tasks.workunit.client.0.smithi097.stderr: -199> 2024-09-14T11:07:56.368+0000 7f3f75416800 1 librados: starting msgr at 2024-09-14T11:07:56.466 INFO:tasks.workunit.client.0.smithi097.stderr: -198> 2024-09-14T11:07:56.368+0000 7f3f75416800 1 librados: starting objecter 2024-09-14T11:07:56.466 INFO:tasks.workunit.client.0.smithi097.stderr: -197> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 asok(0x56276699a270) register_command objecter_requests cmddesc objecter_requests hook 0x562766c61370 EEXIST 2024-09-14T11:07:56.466 INFO:tasks.workunit.client.0.smithi097.stderr: -196> 2024-09-14T11:07:56.368+0000 7f3f75416800 1 librados: setting wanted keys 2024-09-14T11:07:56.466 INFO:tasks.workunit.client.0.smithi097.stderr: -195> 2024-09-14T11:07:56.368+0000 7f3f75416800 1 librados: calling monclient init 2024-09-14T11:07:56.466 INFO:tasks.workunit.client.0.smithi097.stderr: -194> 2024-09-14T11:07:56.368+0000 7f3f75416800 10 monclient: init 2024-09-14T11:07:56.466 INFO:tasks.workunit.client.0.smithi097.stderr: -193> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c50350) adding auth protocol: cephx 2024-09-14T11:07:56.466 INFO:tasks.workunit.client.0.smithi097.stderr: -192> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c50350) adding auth protocol: cephx 2024-09-14T11:07:56.466 INFO:tasks.workunit.client.0.smithi097.stderr: -191> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c50350) adding auth protocol: cephx 2024-09-14T11:07:56.466 INFO:tasks.workunit.client.0.smithi097.stderr: -190> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c50350) adding con mode: secure 2024-09-14T11:07:56.466 INFO:tasks.workunit.client.0.smithi097.stderr: -189> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c50350) adding con mode: crc 2024-09-14T11:07:56.466 INFO:tasks.workunit.client.0.smithi097.stderr: -188> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c50350) adding con mode: secure 2024-09-14T11:07:56.467 INFO:tasks.workunit.client.0.smithi097.stderr: -187> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c50350) adding con mode: crc 2024-09-14T11:07:56.467 INFO:tasks.workunit.client.0.smithi097.stderr: -186> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c50350) adding con mode: secure 2024-09-14T11:07:56.467 INFO:tasks.workunit.client.0.smithi097.stderr: -185> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c50350) adding con mode: crc 2024-09-14T11:07:56.467 INFO:tasks.workunit.client.0.smithi097.stderr: -184> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c50350) adding con mode: crc 2024-09-14T11:07:56.467 INFO:tasks.workunit.client.0.smithi097.stderr: -183> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c50350) adding con mode: secure 2024-09-14T11:07:56.467 INFO:tasks.workunit.client.0.smithi097.stderr: -182> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c50350) adding con mode: crc 2024-09-14T11:07:56.467 INFO:tasks.workunit.client.0.smithi097.stderr: -181> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c50350) adding con mode: secure 2024-09-14T11:07:56.467 INFO:tasks.workunit.client.0.smithi097.stderr: -180> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c50350) adding con mode: crc 2024-09-14T11:07:56.467 INFO:tasks.workunit.client.0.smithi097.stderr: -179> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c50350) adding con mode: secure 2024-09-14T11:07:56.467 INFO:tasks.workunit.client.0.smithi097.stderr: -178> 2024-09-14T11:07:56.368+0000 7f3f75416800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:07:56.467 INFO:tasks.workunit.client.0.smithi097.stderr: -177> 2024-09-14T11:07:56.368+0000 7f3f75416800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:07:56.467 INFO:tasks.workunit.client.0.smithi097.stderr: -176> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 asok(0x56276699a270) register_command rotate-key cmddesc rotate-key hook 0x562766c50498 EEXIST 2024-09-14T11:07:56.467 INFO:tasks.workunit.client.0.smithi097.stderr: -175> 2024-09-14T11:07:56.368+0000 7f3f75416800 10 monclient: _reopen_session rank -1 2024-09-14T11:07:56.467 INFO:tasks.workunit.client.0.smithi097.stderr: -174> 2024-09-14T11:07:56.368+0000 7f3f75416800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:07:56.468 INFO:tasks.workunit.client.0.smithi097.stderr: -173> 2024-09-14T11:07:56.368+0000 7f3f75416800 10 monclient(hunting): picked mon.noname-b con 0x562766c60f50 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:07:56.468 INFO:tasks.workunit.client.0.smithi097.stderr: -172> 2024-09-14T11:07:56.368+0000 7f3f75416800 10 monclient(hunting): picked mon.noname-a con 0x562766c8b8a0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:07:56.468 INFO:tasks.workunit.client.0.smithi097.stderr: -171> 2024-09-14T11:07:56.369+0000 7f3f75416800 10 monclient(hunting): picked mon.noname-c con 0x562766c90000 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:07:56.468 INFO:tasks.workunit.client.0.smithi097.stderr: -170> 2024-09-14T11:07:56.369+0000 7f3f75416800 10 monclient(hunting): start opening mon connection 2024-09-14T11:07:56.468 INFO:tasks.workunit.client.0.smithi097.stderr: -169> 2024-09-14T11:07:56.369+0000 7f3f75416800 10 monclient(hunting): start opening mon connection 2024-09-14T11:07:56.468 INFO:tasks.workunit.client.0.smithi097.stderr: -168> 2024-09-14T11:07:56.369+0000 7f3f75416800 10 monclient(hunting): start opening mon connection 2024-09-14T11:07:56.468 INFO:tasks.workunit.client.0.smithi097.stderr: -167> 2024-09-14T11:07:56.369+0000 7f3f75416800 10 monclient(hunting): _renew_subs 2024-09-14T11:07:56.468 INFO:tasks.workunit.client.0.smithi097.stderr: -166> 2024-09-14T11:07:56.369+0000 7f3f75416800 10 monclient(hunting): authenticate will time out at 2158.022023s 2024-09-14T11:07:56.468 INFO:tasks.workunit.client.0.smithi097.stderr: -165> 2024-09-14T11:07:56.369+0000 7f3f713e8640 10 monclient(hunting): get_auth_request con 0x562766c8b8a0 auth_method 0 2024-09-14T11:07:56.468 INFO:tasks.workunit.client.0.smithi097.stderr: -164> 2024-09-14T11:07:56.369+0000 7f3f713e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:07:56.469 INFO:tasks.workunit.client.0.smithi097.stderr: -163> 2024-09-14T11:07:56.369+0000 7f3f713e8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:07:56.469 INFO:tasks.workunit.client.0.smithi097.stderr: -162> 2024-09-14T11:07:56.369+0000 7f3f713e8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:07:56.469 INFO:tasks.workunit.client.0.smithi097.stderr: -161> 2024-09-14T11:07:56.369+0000 7f3f70be7640 10 monclient(hunting): get_auth_request con 0x562766c90000 auth_method 0 2024-09-14T11:07:56.469 INFO:tasks.workunit.client.0.smithi097.stderr: -160> 2024-09-14T11:07:56.369+0000 7f3f70be7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:07:56.469 INFO:tasks.workunit.client.0.smithi097.stderr: -159> 2024-09-14T11:07:56.369+0000 7f3f70be7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:07:56.469 INFO:tasks.workunit.client.0.smithi097.stderr: -158> 2024-09-14T11:07:56.369+0000 7f3f70be7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:07:56.469 INFO:tasks.workunit.client.0.smithi097.stderr: -157> 2024-09-14T11:07:56.369+0000 7f3f713e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:07:56.469 INFO:tasks.workunit.client.0.smithi097.stderr: -156> 2024-09-14T11:07:56.369+0000 7f3f713e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:07:56.469 INFO:tasks.workunit.client.0.smithi097.stderr: -155> 2024-09-14T11:07:56.369+0000 7f3f713e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:07:56.469 INFO:tasks.workunit.client.0.smithi097.stderr: -154> 2024-09-14T11:07:56.369+0000 7f3f70be7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:07:56.469 INFO:tasks.workunit.client.0.smithi097.stderr: -153> 2024-09-14T11:07:56.369+0000 7f3f70be7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:07:56.469 INFO:tasks.workunit.client.0.smithi097.stderr: -152> 2024-09-14T11:07:56.369+0000 7f3f70be7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:07:56.469 INFO:tasks.workunit.client.0.smithi097.stderr: -151> 2024-09-14T11:07:56.369+0000 7f3f703e6640 10 monclient(hunting): get_auth_request con 0x562766c60f50 auth_method 0 2024-09-14T11:07:56.470 INFO:tasks.workunit.client.0.smithi097.stderr: -150> 2024-09-14T11:07:56.369+0000 7f3f703e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:07:56.470 INFO:tasks.workunit.client.0.smithi097.stderr: -149> 2024-09-14T11:07:56.369+0000 7f3f703e6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:07:56.470 INFO:tasks.workunit.client.0.smithi097.stderr: -148> 2024-09-14T11:07:56.369+0000 7f3f703e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:07:56.470 INFO:tasks.workunit.client.0.smithi097.stderr: -147> 2024-09-14T11:07:56.369+0000 7f3f713e8640 10 monclient(hunting): handle_auth_done global_id 8292 payload 824 2024-09-14T11:07:56.470 INFO:tasks.workunit.client.0.smithi097.stderr: -146> 2024-09-14T11:07:56.369+0000 7f3f713e8640 10 monclient: _finish_hunting 0 2024-09-14T11:07:56.470 INFO:tasks.workunit.client.0.smithi097.stderr: -145> 2024-09-14T11:07:56.369+0000 7f3f713e8640 1 monclient: found mon.noname-a 2024-09-14T11:07:56.470 INFO:tasks.workunit.client.0.smithi097.stderr: -144> 2024-09-14T11:07:56.369+0000 7f3f713e8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-14T11:07:56.470 INFO:tasks.workunit.client.0.smithi097.stderr: -143> 2024-09-14T11:07:56.369+0000 7f3e467fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:07:56.470 INFO:tasks.workunit.client.0.smithi097.stderr: -142> 2024-09-14T11:07:56.369+0000 7f3e467fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:07:56.470 INFO:tasks.workunit.client.0.smithi097.stderr: -141> 2024-09-14T11:07:56.369+0000 7f3e467fc640 10 monclient: dump: 2024-09-14T11:07:56.470 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:07:56.470 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:07:56.470 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:56.471 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:56.471 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:07:56.471 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:07:56.471 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:07:56.471 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:07:56.471 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:07:56.471 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:56.471 INFO:tasks.workunit.client.0.smithi097.stderr: -140> 2024-09-14T11:07:56.369+0000 7f3e467fc640 10 monclient: _finish_auth 0 2024-09-14T11:07:56.471 INFO:tasks.workunit.client.0.smithi097.stderr: -139> 2024-09-14T11:07:56.369+0000 7f3e467fc640 10 monclient: _check_auth_tickets 2024-09-14T11:07:56.471 INFO:tasks.workunit.client.0.smithi097.stderr: -138> 2024-09-14T11:07:56.369+0000 7f3e467fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:07:56.471 INFO:tasks.workunit.client.0.smithi097.stderr: -137> 2024-09-14T11:07:56.369+0000 7f3e467fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:07:56.471 INFO:tasks.workunit.client.0.smithi097.stderr: -136> 2024-09-14T11:07:56.369+0000 7f3e467fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:07:56.471 INFO:tasks.workunit.client.0.smithi097.stderr: -135> 2024-09-14T11:07:56.369+0000 7f3e467fc640 10 monclient: dump: 2024-09-14T11:07:56.471 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:07:56.471 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:07:56.472 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:56.472 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:56.472 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:07:56.472 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:07:56.472 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:07:56.472 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:07:56.472 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:07:56.472 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:56.472 INFO:tasks.workunit.client.0.smithi097.stderr: -134> 2024-09-14T11:07:56.369+0000 7f3f75416800 5 monclient: authenticate success, global_id 8292 2024-09-14T11:07:56.472 INFO:tasks.workunit.client.0.smithi097.stderr: -133> 2024-09-14T11:07:56.369+0000 7f3f75416800 10 monclient: _renew_subs 2024-09-14T11:07:56.472 INFO:tasks.workunit.client.0.smithi097.stderr: -132> 2024-09-14T11:07:56.369+0000 7f3e47fff640 4 set_mon_vals no callback set 2024-09-14T11:07:56.472 INFO:tasks.workunit.client.0.smithi097.stderr: -131> 2024-09-14T11:07:56.369+0000 7f3f75416800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:07:56.472 INFO:tasks.workunit.client.0.smithi097.stderr: -130> 2024-09-14T11:07:56.369+0000 7f3f75416800 10 monclient: _renew_subs 2024-09-14T11:07:56.473 INFO:tasks.workunit.client.0.smithi097.stderr: -129> 2024-09-14T11:07:56.369+0000 7f3f75416800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:07:56.473 INFO:tasks.workunit.client.0.smithi097.stderr: -128> 2024-09-14T11:07:56.369+0000 7f3f75416800 1 librados: init done 2024-09-14T11:07:56.473 INFO:tasks.workunit.client.0.smithi097.stderr: -127> 2024-09-14T11:07:56.369+0000 7f3f75416800 5 asok(0x56276699a270) register_command cr dump hook 0x562766c86c18 2024-09-14T11:07:56.473 INFO:tasks.workunit.client.0.smithi097.stderr: -126> 2024-09-14T11:07:56.371+0000 7f3f75416800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.473 INFO:tasks.workunit.client.0.smithi097.stderr: -125> 2024-09-14T11:07:56.371+0000 7f3e467fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:07:56.473 INFO:tasks.workunit.client.0.smithi097.stderr: -124> 2024-09-14T11:07:56.371+0000 7f3e467fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:07:56.473 INFO:tasks.workunit.client.0.smithi097.stderr: -123> 2024-09-14T11:07:56.371+0000 7f3e467fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:07:56.473 INFO:tasks.workunit.client.0.smithi097.stderr: -122> 2024-09-14T11:07:56.371+0000 7f3f703e6640 10 monclient: get_auth_request con 0x7f3e3c077230 auth_method 0 2024-09-14T11:07:56.473 INFO:tasks.workunit.client.0.smithi097.stderr: -121> 2024-09-14T11:07:56.372+0000 7f3f70be7640 10 monclient: get_auth_request con 0x562766ca9c60 auth_method 0 2024-09-14T11:07:56.473 INFO:tasks.workunit.client.0.smithi097.stderr: -120> 2024-09-14T11:07:56.372+0000 7f3f75416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:56.473 INFO:tasks.workunit.client.0.smithi097.stderr: -119> 2024-09-14T11:07:56.372+0000 7f3f75416800 20 realm 2024-09-14T11:07:56.473 INFO:tasks.workunit.client.0.smithi097.stderr: -118> 2024-09-14T11:07:56.372+0000 7f3f75416800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.473 INFO:tasks.workunit.client.0.smithi097.stderr: -117> 2024-09-14T11:07:56.372+0000 7f3f75416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:56.473 INFO:tasks.workunit.client.0.smithi097.stderr: -116> 2024-09-14T11:07:56.372+0000 7f3f75416800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:07:56.473 INFO:tasks.workunit.client.0.smithi097.stderr: -115> 2024-09-14T11:07:56.372+0000 7f3f75416800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.474 INFO:tasks.workunit.client.0.smithi097.stderr: -114> 2024-09-14T11:07:56.372+0000 7f3f75416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:56.474 INFO:tasks.workunit.client.0.smithi097.stderr: -113> 2024-09-14T11:07:56.373+0000 7f3f75416800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.474 INFO:tasks.workunit.client.0.smithi097.stderr: -112> 2024-09-14T11:07:56.373+0000 7f3f703e6640 10 monclient: get_auth_request con 0x562766cadff0 auth_method 0 2024-09-14T11:07:56.474 INFO:tasks.workunit.client.0.smithi097.stderr: -111> 2024-09-14T11:07:56.373+0000 7f3f75416800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:07:56.474 INFO:tasks.workunit.client.0.smithi097.stderr: -110> 2024-09-14T11:07:56.373+0000 7f3f75416800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.474 INFO:tasks.workunit.client.0.smithi097.stderr: -109> 2024-09-14T11:07:56.373+0000 7f3f713e8640 10 monclient: get_auth_request con 0x562766cb16f0 auth_method 0 2024-09-14T11:07:56.474 INFO:tasks.workunit.client.0.smithi097.stderr: -108> 2024-09-14T11:07:56.374+0000 7f3f75416800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:07:56.474 INFO:tasks.workunit.client.0.smithi097.stderr: -107> 2024-09-14T11:07:56.374+0000 7f3f75416800 20 searching for the correct realm 2024-09-14T11:07:56.474 INFO:tasks.workunit.client.0.smithi097.stderr: -106> 2024-09-14T11:07:56.374+0000 7f3f70be7640 10 monclient: get_auth_request con 0x562766cb6470 auth_method 0 2024-09-14T11:07:56.474 INFO:tasks.workunit.client.0.smithi097.stderr: -105> 2024-09-14T11:07:56.375+0000 7f3f703e6640 10 monclient: get_auth_request con 0x7f3f6001e070 auth_method 0 2024-09-14T11:07:56.474 INFO:tasks.workunit.client.0.smithi097.stderr: -104> 2024-09-14T11:07:56.375+0000 7f3f70be7640 0 -- 172.21.15.97:0/3596470943 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x562766ca9c60 msgr2=0x562766cac100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:07:56.474 INFO:tasks.workunit.client.0.smithi097.stderr: -103> 2024-09-14T11:07:56.375+0000 7f3e467fc640 1 client.8292.objecter ms_handle_reset 0x562766ca9c60 session 0x562766ca95e0 osd.6 2024-09-14T11:07:56.474 INFO:tasks.workunit.client.0.smithi097.stderr: -102> 2024-09-14T11:07:56.375+0000 7f3e467fc640 10 monclient: _renew_subs 2024-09-14T11:07:56.474 INFO:tasks.workunit.client.0.smithi097.stderr: -101> 2024-09-14T11:07:56.375+0000 7f3e467fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:07:56.475 INFO:tasks.workunit.client.0.smithi097.stderr: -100> 2024-09-14T11:07:56.376+0000 7f3f70be7640 10 monclient: get_auth_request con 0x7f3e3c086d50 auth_method 0 2024-09-14T11:07:56.475 INFO:tasks.workunit.client.0.smithi097.stderr: -99> 2024-09-14T11:07:56.376+0000 7f3f713e8640 10 monclient: get_auth_request con 0x7f3f5806bb50 auth_method 0 2024-09-14T11:07:56.475 INFO:tasks.workunit.client.0.smithi097.stderr: -98> 2024-09-14T11:07:56.379+0000 7f3f70be7640 10 monclient: get_auth_request con 0x7f3f58088b20 auth_method 0 2024-09-14T11:07:56.475 INFO:tasks.workunit.client.0.smithi097.stderr: -97> 2024-09-14T11:07:56.379+0000 7f3f70be7640 0 -- 172.21.15.97:0/3596470943 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7f3f58088b20 msgr2=0x7f3f58064990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:07:56.475 INFO:tasks.workunit.client.0.smithi097.stderr: -96> 2024-09-14T11:07:56.379+0000 7f3e467fc640 1 client.8292.objecter ms_handle_reset 0x7f3f58088b20 session 0x7f3f5807c070 osd.7 2024-09-14T11:07:56.475 INFO:tasks.workunit.client.0.smithi097.stderr: -95> 2024-09-14T11:07:56.379+0000 7f3f70be7640 10 monclient: get_auth_request con 0x562766ca9c60 auth_method 0 2024-09-14T11:07:56.475 INFO:tasks.workunit.client.0.smithi097.stderr: -94> 2024-09-14T11:07:56.380+0000 7f3f703e6640 10 monclient: get_auth_request con 0x7f3f60037920 auth_method 0 2024-09-14T11:07:56.475 INFO:tasks.workunit.client.0.smithi097.stderr: -93> 2024-09-14T11:07:56.384+0000 7f3f75416800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:07:56.475 INFO:tasks.workunit.client.0.smithi097.stderr: -92> 2024-09-14T11:07:56.384+0000 7f3f75416800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:07:56.475 INFO:tasks.workunit.client.0.smithi097.stderr: -91> 2024-09-14T11:07:56.384+0000 7f3f75416800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:07:56.475 INFO:tasks.workunit.client.0.smithi097.stderr: -90> 2024-09-14T11:07:56.384+0000 7f3f75416800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:07:56.475 INFO:tasks.workunit.client.0.smithi097.stderr: -89> 2024-09-14T11:07:56.384+0000 7f3f75416800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:07:56.475 INFO:tasks.workunit.client.0.smithi097.stderr: -88> 2024-09-14T11:07:56.384+0000 7f3f75416800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:07:56.475 INFO:tasks.workunit.client.0.smithi097.stderr: -87> 2024-09-14T11:07:56.384+0000 7f3f75416800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.476 INFO:tasks.workunit.client.0.smithi097.stderr: -86> 2024-09-14T11:07:56.385+0000 7f3f75416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:56.476 INFO:tasks.workunit.client.0.smithi097.stderr: -85> 2024-09-14T11:07:56.385+0000 7f3f75416800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.476 INFO:tasks.workunit.client.0.smithi097.stderr: -84> 2024-09-14T11:07:56.385+0000 7f3f75416800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:07:56.476 INFO:tasks.workunit.client.0.smithi097.stderr: -83> 2024-09-14T11:07:56.385+0000 7f3f75416800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.476 INFO:tasks.workunit.client.0.smithi097.stderr: -82> 2024-09-14T11:07:56.385+0000 7f3f75416800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:07:56.476 INFO:tasks.workunit.client.0.smithi097.stderr: -81> 2024-09-14T11:07:56.385+0000 7f3f75416800 20 zone default found 2024-09-14T11:07:56.476 INFO:tasks.workunit.client.0.smithi097.stderr: -80> 2024-09-14T11:07:56.385+0000 7f3f75416800 4 Realm: () 2024-09-14T11:07:56.476 INFO:tasks.workunit.client.0.smithi097.stderr: -79> 2024-09-14T11:07:56.385+0000 7f3f75416800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:07:56.476 INFO:tasks.workunit.client.0.smithi097.stderr: -78> 2024-09-14T11:07:56.385+0000 7f3f75416800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:07:56.476 INFO:tasks.workunit.client.0.smithi097.stderr: -77> 2024-09-14T11:07:56.385+0000 7f3f75416800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:07:56.476 INFO:tasks.workunit.client.0.smithi097.stderr: -76> 2024-09-14T11:07:56.385+0000 7f3f75416800 20 zonegroup default 2024-09-14T11:07:56.476 INFO:tasks.workunit.client.0.smithi097.stderr: -75> 2024-09-14T11:07:56.385+0000 7f3f75416800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.476 INFO:tasks.workunit.client.0.smithi097.stderr: -74> 2024-09-14T11:07:56.385+0000 7f3f75416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:56.476 INFO:tasks.workunit.client.0.smithi097.stderr: -73> 2024-09-14T11:07:56.385+0000 7f3f75416800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.477 INFO:tasks.workunit.client.0.smithi097.stderr: -72> 2024-09-14T11:07:56.386+0000 7f3f75416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:56.477 INFO:tasks.workunit.client.0.smithi097.stderr: -71> 2024-09-14T11:07:56.386+0000 7f3f75416800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.477 INFO:tasks.workunit.client.0.smithi097.stderr: -70> 2024-09-14T11:07:56.386+0000 7f3f75416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:56.477 INFO:tasks.workunit.client.0.smithi097.stderr: -69> 2024-09-14T11:07:56.386+0000 7f3f75416800 20 started sync module instance, tier type = 2024-09-14T11:07:56.477 INFO:tasks.workunit.client.0.smithi097.stderr: -68> 2024-09-14T11:07:56.386+0000 7f3f75416800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:07:56.477 INFO:tasks.workunit.client.0.smithi097.stderr: -67> 2024-09-14T11:07:56.394+0000 7f3f75416800 20 add_watcher() i=0 2024-09-14T11:07:56.477 INFO:tasks.workunit.client.0.smithi097.stderr: -66> 2024-09-14T11:07:56.394+0000 7f3f75416800 20 add_watcher() i=1 2024-09-14T11:07:56.477 INFO:tasks.workunit.client.0.smithi097.stderr: -65> 2024-09-14T11:07:56.394+0000 7f3f75416800 20 add_watcher() i=2 2024-09-14T11:07:56.477 INFO:tasks.workunit.client.0.smithi097.stderr: -64> 2024-09-14T11:07:56.394+0000 7f3f75416800 20 add_watcher() i=3 2024-09-14T11:07:56.477 INFO:tasks.workunit.client.0.smithi097.stderr: -63> 2024-09-14T11:07:56.394+0000 7f3f75416800 20 add_watcher() i=4 2024-09-14T11:07:56.477 INFO:tasks.workunit.client.0.smithi097.stderr: -62> 2024-09-14T11:07:56.394+0000 7f3f75416800 20 add_watcher() i=5 2024-09-14T11:07:56.477 INFO:tasks.workunit.client.0.smithi097.stderr: -61> 2024-09-14T11:07:56.394+0000 7f3f75416800 20 add_watcher() i=6 2024-09-14T11:07:56.477 INFO:tasks.workunit.client.0.smithi097.stderr: -60> 2024-09-14T11:07:56.395+0000 7f3f75416800 20 add_watcher() i=7 2024-09-14T11:07:56.477 INFO:tasks.workunit.client.0.smithi097.stderr: -59> 2024-09-14T11:07:56.395+0000 7f3f75416800 2 all 8 watchers are set, enabling cache 2024-09-14T11:07:56.477 INFO:tasks.workunit.client.0.smithi097.stderr: -58> 2024-09-14T11:07:56.397+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e9390) adding auth protocol: cephx 2024-09-14T11:07:56.478 INFO:tasks.workunit.client.0.smithi097.stderr: -57> 2024-09-14T11:07:56.397+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e9390) adding auth protocol: cephx 2024-09-14T11:07:56.478 INFO:tasks.workunit.client.0.smithi097.stderr: -56> 2024-09-14T11:07:56.397+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e9390) adding auth protocol: cephx 2024-09-14T11:07:56.478 INFO:tasks.workunit.client.0.smithi097.stderr: -55> 2024-09-14T11:07:56.397+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e9390) adding con mode: secure 2024-09-14T11:07:56.478 INFO:tasks.workunit.client.0.smithi097.stderr: -54> 2024-09-14T11:07:56.397+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e9390) adding con mode: crc 2024-09-14T11:07:56.478 INFO:tasks.workunit.client.0.smithi097.stderr: -53> 2024-09-14T11:07:56.397+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e9390) adding con mode: secure 2024-09-14T11:07:56.478 INFO:tasks.workunit.client.0.smithi097.stderr: -52> 2024-09-14T11:07:56.397+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e9390) adding con mode: crc 2024-09-14T11:07:56.478 INFO:tasks.workunit.client.0.smithi097.stderr: -51> 2024-09-14T11:07:56.397+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e9390) adding con mode: secure 2024-09-14T11:07:56.478 INFO:tasks.workunit.client.0.smithi097.stderr: -50> 2024-09-14T11:07:56.397+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e9390) adding con mode: crc 2024-09-14T11:07:56.478 INFO:tasks.workunit.client.0.smithi097.stderr: -49> 2024-09-14T11:07:56.397+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e9390) adding con mode: crc 2024-09-14T11:07:56.478 INFO:tasks.workunit.client.0.smithi097.stderr: -48> 2024-09-14T11:07:56.397+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e9390) adding con mode: secure 2024-09-14T11:07:56.478 INFO:tasks.workunit.client.0.smithi097.stderr: -47> 2024-09-14T11:07:56.397+0000 7f3e26fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:07:56.478 INFO:tasks.workunit.client.0.smithi097.stderr: -46> 2024-09-14T11:07:56.397+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e9390) adding con mode: crc 2024-09-14T11:07:56.478 INFO:tasks.workunit.client.0.smithi097.stderr: -45> 2024-09-14T11:07:56.397+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e9390) adding con mode: secure 2024-09-14T11:07:56.478 INFO:tasks.workunit.client.0.smithi097.stderr: -44> 2024-09-14T11:07:56.397+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e9390) adding con mode: crc 2024-09-14T11:07:56.478 INFO:tasks.workunit.client.0.smithi097.stderr: -43> 2024-09-14T11:07:56.397+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e9390) adding con mode: secure 2024-09-14T11:07:56.478 INFO:tasks.workunit.client.0.smithi097.stderr: -42> 2024-09-14T11:07:56.397+0000 7f3f75416800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:07:56.479 INFO:tasks.workunit.client.0.smithi097.stderr: -41> 2024-09-14T11:07:56.397+0000 7f3f75416800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:07:56.479 INFO:tasks.workunit.client.0.smithi097.stderr: -40> 2024-09-14T11:07:56.397+0000 7f3f75416800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:07:56.479 INFO:tasks.workunit.client.0.smithi097.stderr: -39> 2024-09-14T11:07:56.397+0000 7f3f75416800 5 asok(0x56276699a270) register_command cache list hook 0x562766c86850 2024-09-14T11:07:56.479 INFO:tasks.workunit.client.0.smithi097.stderr: -38> 2024-09-14T11:07:56.397+0000 7f3f75416800 5 asok(0x56276699a270) register_command cache inspect hook 0x562766c86850 2024-09-14T11:07:56.479 INFO:tasks.workunit.client.0.smithi097.stderr: -37> 2024-09-14T11:07:56.397+0000 7f3f75416800 5 asok(0x56276699a270) register_command cache erase hook 0x562766c86850 2024-09-14T11:07:56.479 INFO:tasks.workunit.client.0.smithi097.stderr: -36> 2024-09-14T11:07:56.397+0000 7f3f75416800 5 asok(0x56276699a270) register_command cache zap hook 0x562766c86850 2024-09-14T11:07:56.479 INFO:tasks.workunit.client.0.smithi097.stderr: -35> 2024-09-14T11:07:56.397+0000 7f3f75416800 5 note: GC not initialized 2024-09-14T11:07:56.479 INFO:tasks.workunit.client.0.smithi097.stderr: -34> 2024-09-14T11:07:56.398+0000 7f3e25fe3640 20 reqs_thread_entry: start 2024-09-14T11:07:56.479 INFO:tasks.workunit.client.0.smithi097.stderr: -33> 2024-09-14T11:07:56.398+0000 7f3f75416800 5 asok(0x56276699a270) register_command sync trace show hook 0x7f3f5c001d30 2024-09-14T11:07:56.479 INFO:tasks.workunit.client.0.smithi097.stderr: -32> 2024-09-14T11:07:56.398+0000 7f3f75416800 5 asok(0x56276699a270) register_command sync trace history hook 0x7f3f5c001d30 2024-09-14T11:07:56.479 INFO:tasks.workunit.client.0.smithi097.stderr: -31> 2024-09-14T11:07:56.398+0000 7f3f75416800 5 asok(0x56276699a270) register_command sync trace active hook 0x7f3f5c001d30 2024-09-14T11:07:56.479 INFO:tasks.workunit.client.0.smithi097.stderr: -30> 2024-09-14T11:07:56.398+0000 7f3f75416800 5 asok(0x56276699a270) register_command sync trace active_short hook 0x7f3f5c001d30 2024-09-14T11:07:56.479 INFO:tasks.workunit.client.0.smithi097.stderr: -29> 2024-09-14T11:07:56.398+0000 7f3f75416800 20 init_complete bucket index max shards: 11 2024-09-14T11:07:56.479 INFO:tasks.workunit.client.0.smithi097.stderr: -28> 2024-09-14T11:07:56.398+0000 7f3f75416800 20 Filter name: none 2024-09-14T11:07:56.479 INFO:tasks.workunit.client.0.smithi097.stderr: -27> 2024-09-14T11:07:56.398+0000 7f3d977fe640 20 reqs_thread_entry: start 2024-09-14T11:07:56.480 INFO:tasks.workunit.client.0.smithi097.stderr: -26> 2024-09-14T11:07:56.398+0000 7f3f75416800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:07:56.480 INFO:tasks.workunit.client.0.smithi097.stderr: -25> 2024-09-14T11:07:56.398+0000 7f3f75416800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.480 INFO:tasks.workunit.client.0.smithi097.stderr: -24> 2024-09-14T11:07:56.398+0000 7f3f75416800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:07:56.480 INFO:tasks.workunit.client.0.smithi097.stderr: -23> 2024-09-14T11:07:56.398+0000 7f3f75416800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:07:56.480 INFO:tasks.workunit.client.0.smithi097.stderr: -22> 2024-09-14T11:07:56.398+0000 7f3f75416800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:07:56.480 INFO:tasks.workunit.client.0.smithi097.stderr: -21> 2024-09-14T11:07:56.398+0000 7f3f75416800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 : miss 2024-09-14T11:07:56.480 INFO:tasks.workunit.client.0.smithi097.stderr: -20> 2024-09-14T11:07:56.398+0000 7f3f75416800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.480 INFO:tasks.workunit.client.0.smithi097.stderr: -19> 2024-09-14T11:07:56.399+0000 7f3f75416800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:07:56.480 INFO:tasks.workunit.client.0.smithi097.stderr: -18> 2024-09-14T11:07:56.399+0000 7f3f75416800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:07:56.480 INFO:tasks.workunit.client.0.smithi097.stderr: -17> 2024-09-14T11:07:56.399+0000 7f3f75416800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:07:56.480 INFO:tasks.workunit.client.0.smithi097.stderr: -16> 2024-09-14T11:07:56.399+0000 7f3f75416800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:07:56.480 INFO:tasks.workunit.client.0.smithi097.stderr: -15> 2024-09-14T11:07:56.399+0000 7f3f75416800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:07:56.480 INFO:tasks.workunit.client.0.smithi097.stderr: -14> 2024-09-14T11:07:56.399+0000 7f3f75416800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 2024-09-14T11:07:56.480 INFO:tasks.workunit.client.0.smithi097.stderr: -13> 2024-09-14T11:07:56.405+0000 7f3f75416800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:07:56.480 INFO:tasks.workunit.client.0.smithi097.stderr: -12> 2024-09-14T11:07:56.405+0000 7f3f75416800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:07:56.481 INFO:tasks.workunit.client.0.smithi097.stderr: -11> 2024-09-14T11:07:56.405+0000 7f3f75416800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:07:56.481 INFO:tasks.workunit.client.0.smithi097.stderr: -10> 2024-09-14T11:07:56.405+0000 7f3f75416800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17, ofs0, ns] 2024-09-14T11:07:56.481 INFO:tasks.workunit.client.0.smithi097.stderr: -9> 2024-09-14T11:07:56.405+0000 7f3e47fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595245 cookie 94727228340976 notifier 8292 bl.length()=827 2024-09-14T11:07:56.481 INFO:tasks.workunit.client.0.smithi097.stderr: -8> 2024-09-14T11:07:56.405+0000 7f3e47fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:07:56.481 INFO:tasks.workunit.client.0.smithi097.stderr: -7> 2024-09-14T11:07:56.405+0000 7f3e47fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:07:56.481 INFO:tasks.workunit.client.0.smithi097.stderr: -6> 2024-09-14T11:07:56.405+0000 7f3e47fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:07:56.481 INFO:tasks.workunit.client.0.smithi097.stderr: -5> 2024-09-14T11:07:56.405+0000 7f3f75416800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): orig_sources= new_sources= 2024-09-14T11:07:56.481 INFO:tasks.workunit.client.0.smithi097.stderr: -4> 2024-09-14T11:07:56.405+0000 7f3f75416800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): potential sources added=[] removed=[] 2024-09-14T11:07:56.481 INFO:tasks.workunit.client.0.smithi097.stderr: -3> 2024-09-14T11:07:56.405+0000 7f3f75416800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): orig_dests= new_dests= 2024-09-14T11:07:56.481 INFO:tasks.workunit.client.0.smithi097.stderr: -2> 2024-09-14T11:07:56.405+0000 7f3f75416800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): potential dests added=[] removed=[] 2024-09-14T11:07:56.481 INFO:tasks.workunit.client.0.smithi097.stderr: -1> 2024-09-14T11:07:56.413+0000 7f3f75416800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3f75416800 time 2024-09-14T11:07:56.413594+0000 2024-09-14T11:07:56.481 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:07:56.481 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:56.481 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:07:56.482 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3f7658c76a] 2024-09-14T11:07:56.482 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f3f7658c928] 2024-09-14T11:07:56.482 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5627656880b1] 2024-09-14T11:07:56.482 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562765697f6a] 2024-09-14T11:07:56.482 INFO:tasks.workunit.client.0.smithi097.stderr: 5: main() 2024-09-14T11:07:56.482 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f3f75229590] 2024-09-14T11:07:56.482 INFO:tasks.workunit.client.0.smithi097.stderr: 7: __libc_start_main() 2024-09-14T11:07:56.482 INFO:tasks.workunit.client.0.smithi097.stderr: 8: _start() 2024-09-14T11:07:56.482 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:56.482 INFO:tasks.workunit.client.0.smithi097.stderr: 0> 2024-09-14T11:07:56.414+0000 7f3f75416800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:07:56.483 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f3f75416800 thread_name:radosgw-admin 2024-09-14T11:07:56.483 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:56.483 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:07:56.483 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3f7523e6f0] 2024-09-14T11:07:56.483 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3f7528b99c] 2024-09-14T11:07:56.483 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-14T11:07:56.483 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-14T11:07:56.483 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3f7658c7c4] 2024-09-14T11:07:56.483 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f3f7658c928] 2024-09-14T11:07:56.483 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5627656880b1] 2024-09-14T11:07:56.483 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562765697f6a] 2024-09-14T11:07:56.483 INFO:tasks.workunit.client.0.smithi097.stderr: 9: main() 2024-09-14T11:07:56.483 INFO:tasks.workunit.client.0.smithi097.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f3f75229590] 2024-09-14T11:07:56.483 INFO:tasks.workunit.client.0.smithi097.stderr: 11: __libc_start_main() 2024-09-14T11:07:56.484 INFO:tasks.workunit.client.0.smithi097.stderr: 12: _start() 2024-09-14T11:07:56.484 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:07:56.484 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:56.484 INFO:tasks.workunit.client.0.smithi097.stderr:--- logging levels --- 2024-09-14T11:07:56.484 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 none 2024-09-14T11:07:56.484 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 lockdep 2024-09-14T11:07:56.484 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 context 2024-09-14T11:07:56.484 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 crush 2024-09-14T11:07:56.484 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds 2024-09-14T11:07:56.484 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_balancer 2024-09-14T11:07:56.484 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_locker 2024-09-14T11:07:56.484 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log 2024-09-14T11:07:56.484 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log_expire 2024-09-14T11:07:56.485 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_migrator 2024-09-14T11:07:56.485 INFO:tasks.workunit.client.0.smithi097.stderr: 3/ 5 mds_quiesce 2024-09-14T11:07:56.485 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 buffer 2024-09-14T11:07:56.485 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 timer 2024-09-14T11:07:56.485 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 filer 2024-09-14T11:07:56.485 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 striper 2024-09-14T11:07:56.485 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 objecter 2024-09-14T11:07:56.485 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rados 2024-09-14T11:07:56.485 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd 2024-09-14T11:07:56.485 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_mirror 2024-09-14T11:07:56.485 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_replay 2024-09-14T11:07:56.485 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_pwl 2024-09-14T11:07:56.485 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 journaler 2024-09-14T11:07:56.485 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objectcacher 2024-09-14T11:07:56.485 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:07:56.486 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 client 2024-09-14T11:07:56.486 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 osd 2024-09-14T11:07:56.486 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 optracker 2024-09-14T11:07:56.486 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objclass 2024-09-14T11:07:56.486 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 filestore 2024-09-14T11:07:56.486 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 journal 2024-09-14T11:07:56.486 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 ms 2024-09-14T11:07:56.486 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mon 2024-09-14T11:07:56.486 INFO:tasks.workunit.client.0.smithi097.stderr: 0/10 monc 2024-09-14T11:07:56.486 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 paxos 2024-09-14T11:07:56.486 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 tp 2024-09-14T11:07:56.486 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 auth 2024-09-14T11:07:56.487 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 crypto 2024-09-14T11:07:56.487 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 finisher 2024-09-14T11:07:56.487 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 reserver 2024-09-14T11:07:56.487 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 heartbeatmap 2024-09-14T11:07:56.487 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 perfcounter 2024-09-14T11:07:56.487 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw 2024-09-14T11:07:56.487 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_sync 2024-09-14T11:07:56.487 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_datacache 2024-09-14T11:07:56.487 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_access 2024-09-14T11:07:56.487 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:07:56.487 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_flight 2024-09-14T11:07:56.487 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:07:56.487 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw_notification 2024-09-14T11:07:56.487 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 javaclient 2024-09-14T11:07:56.487 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 asok 2024-09-14T11:07:56.488 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 throttle 2024-09-14T11:07:56.488 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 refs 2024-09-14T11:07:56.488 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 compressor 2024-09-14T11:07:56.488 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluestore 2024-09-14T11:07:56.488 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluefs 2024-09-14T11:07:56.488 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 bdev 2024-09-14T11:07:56.488 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 kstore 2024-09-14T11:07:56.488 INFO:tasks.workunit.client.0.smithi097.stderr: 4/ 5 rocksdb 2024-09-14T11:07:56.488 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 fuse 2024-09-14T11:07:56.488 INFO:tasks.workunit.client.0.smithi097.stderr: 2/ 5 mgr 2024-09-14T11:07:56.488 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mgrc 2024-09-14T11:07:56.488 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 dpdk 2024-09-14T11:07:56.488 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 eventtrace 2024-09-14T11:07:56.488 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 prioritycache 2024-09-14T11:07:56.489 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 test 2024-09-14T11:07:56.489 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:07:56.489 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephsqlite 2024-09-14T11:07:56.489 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:07:56.489 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore 2024-09-14T11:07:56.489 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_onode 2024-09-14T11:07:56.489 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_odata 2024-09-14T11:07:56.489 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_omap 2024-09-14T11:07:56.489 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_tm 2024-09-14T11:07:56.489 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_t 2024-09-14T11:07:56.489 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:07:56.489 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_epm 2024-09-14T11:07:56.489 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_lba 2024-09-14T11:07:56.490 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:07:56.490 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cache 2024-09-14T11:07:56.490 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_journal 2024-09-14T11:07:56.490 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_device 2024-09-14T11:07:56.490 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_backref 2024-09-14T11:07:56.490 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 alienstore 2024-09-14T11:07:56.490 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mclock 2024-09-14T11:07:56.490 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cyanstore 2024-09-14T11:07:56.490 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 ceph_exporter 2024-09-14T11:07:56.490 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 memstore 2024-09-14T11:07:56.491 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 trace 2024-09-14T11:07:56.491 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 ceph_dedup 2024-09-14T11:07:56.491 INFO:tasks.workunit.client.0.smithi097.stderr: -2/-2 (syslog threshold) 2024-09-14T11:07:56.491 INFO:tasks.workunit.client.0.smithi097.stderr: 99/99 (stderr threshold) 2024-09-14T11:07:56.491 INFO:tasks.workunit.client.0.smithi097.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:07:56.491 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3d977fe640 / http_manager 2024-09-14T11:07:56.491 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3e25fe3640 / http_manager 2024-09-14T11:07:56.491 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3e26fe5640 / rgw_dt_lg_renew 2024-09-14T11:07:56.492 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3e467fc640 / ms_dispatch 2024-09-14T11:07:56.492 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3e47fff640 / io_context_pool 2024-09-14T11:07:56.492 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3e567fc640 / ms_dispatch 2024-09-14T11:07:56.492 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3e5d60a640 / ms_dispatch 2024-09-14T11:07:56.492 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3e5ee0d640 / io_context_pool 2024-09-14T11:07:56.492 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3f703e6640 / msgr-worker-2 2024-09-14T11:07:56.492 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3f70be7640 / msgr-worker-1 2024-09-14T11:07:56.492 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3f713e8640 / msgr-worker-0 2024-09-14T11:07:56.492 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3f71be9640 / io_context_pool 2024-09-14T11:07:56.492 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3f75416800 / radosgw-admin 2024-09-14T11:07:56.493 INFO:tasks.workunit.client.0.smithi097.stderr: max_recent 500 2024-09-14T11:07:56.493 INFO:tasks.workunit.client.0.smithi097.stderr: max_new 1000 2024-09-14T11:07:56.493 INFO:tasks.workunit.client.0.smithi097.stderr: log_file /var/log/ceph/ceph-client.admin.151029.log 2024-09-14T11:07:56.493 INFO:tasks.workunit.client.0.smithi097.stderr:--- end dump of recent events --- 2024-09-14T11:07:56.493 INFO:tasks.workunit.client.0.smithi097.stderr:--- begin dump of recent events --- 2024-09-14T11:07:56.493 INFO:tasks.workunit.client.0.smithi097.stderr: -499> 2024-09-14T11:07:56.354+0000 7f3f75416800 10 monclient: shutdown 2024-09-14T11:07:56.493 INFO:tasks.workunit.client.0.smithi097.stderr: -498> 2024-09-14T11:07:56.354+0000 7f3f75416800 5 asok(0x56276699a270) unregister_commands rotate-key 2024-09-14T11:07:56.493 INFO:tasks.workunit.client.0.smithi097.stderr: -497> 2024-09-14T11:07:56.354+0000 7f3f75416800 10 monclient: build_initial_monmap 2024-09-14T11:07:56.494 INFO:tasks.workunit.client.0.smithi097.stderr: -496> 2024-09-14T11:07:56.354+0000 7f3f75416800 1 build_initial for_mkfs: 0 2024-09-14T11:07:56.494 INFO:tasks.workunit.client.0.smithi097.stderr: -495> 2024-09-14T11:07:56.354+0000 7f3f75416800 10 monclient: monmap: 2024-09-14T11:07:56.494 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:07:56.494 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:07:56.494 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:07:56.494 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:07:56.494 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:07:56.494 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:07:56.494 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:07:56.494 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:07:56.494 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:07:56.495 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:56.495 INFO:tasks.workunit.client.0.smithi097.stderr: -494> 2024-09-14T11:07:56.354+0000 7f3f75416800 5 AuthRegistry(0x562766bc1fc0) adding auth protocol: cephx 2024-09-14T11:07:56.495 INFO:tasks.workunit.client.0.smithi097.stderr: -493> 2024-09-14T11:07:56.354+0000 7f3f75416800 5 AuthRegistry(0x562766bc1fc0) adding auth protocol: cephx 2024-09-14T11:07:56.495 INFO:tasks.workunit.client.0.smithi097.stderr: -492> 2024-09-14T11:07:56.354+0000 7f3f75416800 5 AuthRegistry(0x562766bc1fc0) adding auth protocol: cephx 2024-09-14T11:07:56.495 INFO:tasks.workunit.client.0.smithi097.stderr: -491> 2024-09-14T11:07:56.354+0000 7f3f75416800 5 AuthRegistry(0x562766bc1fc0) adding con mode: secure 2024-09-14T11:07:56.495 INFO:tasks.workunit.client.0.smithi097.stderr: -490> 2024-09-14T11:07:56.354+0000 7f3f75416800 5 AuthRegistry(0x562766bc1fc0) adding con mode: crc 2024-09-14T11:07:56.495 INFO:tasks.workunit.client.0.smithi097.stderr: -489> 2024-09-14T11:07:56.354+0000 7f3f75416800 5 AuthRegistry(0x562766bc1fc0) adding con mode: secure 2024-09-14T11:07:56.495 INFO:tasks.workunit.client.0.smithi097.stderr: -488> 2024-09-14T11:07:56.354+0000 7f3f75416800 5 AuthRegistry(0x562766bc1fc0) adding con mode: crc 2024-09-14T11:07:56.495 INFO:tasks.workunit.client.0.smithi097.stderr: -487> 2024-09-14T11:07:56.354+0000 7f3f75416800 5 AuthRegistry(0x562766bc1fc0) adding con mode: secure 2024-09-14T11:07:56.495 INFO:tasks.workunit.client.0.smithi097.stderr: -486> 2024-09-14T11:07:56.354+0000 7f3f75416800 5 AuthRegistry(0x562766bc1fc0) adding con mode: crc 2024-09-14T11:07:56.495 INFO:tasks.workunit.client.0.smithi097.stderr: -485> 2024-09-14T11:07:56.354+0000 7f3f75416800 5 AuthRegistry(0x562766bc1fc0) adding con mode: crc 2024-09-14T11:07:56.495 INFO:tasks.workunit.client.0.smithi097.stderr: -484> 2024-09-14T11:07:56.354+0000 7f3f75416800 5 AuthRegistry(0x562766bc1fc0) adding con mode: secure 2024-09-14T11:07:56.495 INFO:tasks.workunit.client.0.smithi097.stderr: -483> 2024-09-14T11:07:56.354+0000 7f3f75416800 5 AuthRegistry(0x562766bc1fc0) adding con mode: crc 2024-09-14T11:07:56.496 INFO:tasks.workunit.client.0.smithi097.stderr: -482> 2024-09-14T11:07:56.354+0000 7f3f75416800 5 AuthRegistry(0x562766bc1fc0) adding con mode: secure 2024-09-14T11:07:56.496 INFO:tasks.workunit.client.0.smithi097.stderr: -481> 2024-09-14T11:07:56.354+0000 7f3f75416800 5 AuthRegistry(0x562766bc1fc0) adding con mode: crc 2024-09-14T11:07:56.496 INFO:tasks.workunit.client.0.smithi097.stderr: -480> 2024-09-14T11:07:56.354+0000 7f3f75416800 5 AuthRegistry(0x562766bc1fc0) adding con mode: secure 2024-09-14T11:07:56.496 INFO:tasks.workunit.client.0.smithi097.stderr: -479> 2024-09-14T11:07:56.355+0000 7f3f75416800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:07:56.496 INFO:tasks.workunit.client.0.smithi097.stderr: -478> 2024-09-14T11:07:56.355+0000 7f3f75416800 1 librados: starting msgr at 2024-09-14T11:07:56.496 INFO:tasks.workunit.client.0.smithi097.stderr: -477> 2024-09-14T11:07:56.355+0000 7f3f75416800 1 librados: starting objecter 2024-09-14T11:07:56.496 INFO:tasks.workunit.client.0.smithi097.stderr: -476> 2024-09-14T11:07:56.355+0000 7f3f75416800 5 asok(0x56276699a270) register_command objecter_requests hook 0x562766bc45e0 2024-09-14T11:07:56.496 INFO:tasks.workunit.client.0.smithi097.stderr: -475> 2024-09-14T11:07:56.355+0000 7f3f75416800 1 librados: setting wanted keys 2024-09-14T11:07:56.496 INFO:tasks.workunit.client.0.smithi097.stderr: -474> 2024-09-14T11:07:56.355+0000 7f3f75416800 1 librados: calling monclient init 2024-09-14T11:07:56.496 INFO:tasks.workunit.client.0.smithi097.stderr: -473> 2024-09-14T11:07:56.355+0000 7f3f75416800 10 monclient: init 2024-09-14T11:07:56.496 INFO:tasks.workunit.client.0.smithi097.stderr: -472> 2024-09-14T11:07:56.355+0000 7f3f75416800 5 AuthRegistry(0x562766bbc2a0) adding auth protocol: cephx 2024-09-14T11:07:56.496 INFO:tasks.workunit.client.0.smithi097.stderr: -471> 2024-09-14T11:07:56.355+0000 7f3f75416800 5 AuthRegistry(0x562766bbc2a0) adding auth protocol: cephx 2024-09-14T11:07:56.496 INFO:tasks.workunit.client.0.smithi097.stderr: -470> 2024-09-14T11:07:56.355+0000 7f3f75416800 5 AuthRegistry(0x562766bbc2a0) adding auth protocol: cephx 2024-09-14T11:07:56.496 INFO:tasks.workunit.client.0.smithi097.stderr: -469> 2024-09-14T11:07:56.355+0000 7f3f75416800 5 AuthRegistry(0x562766bbc2a0) adding con mode: secure 2024-09-14T11:07:56.497 INFO:tasks.workunit.client.0.smithi097.stderr: -468> 2024-09-14T11:07:56.355+0000 7f3f75416800 5 AuthRegistry(0x562766bbc2a0) adding con mode: crc 2024-09-14T11:07:56.497 INFO:tasks.workunit.client.0.smithi097.stderr: -467> 2024-09-14T11:07:56.355+0000 7f3f75416800 5 AuthRegistry(0x562766bbc2a0) adding con mode: secure 2024-09-14T11:07:56.497 INFO:tasks.workunit.client.0.smithi097.stderr: -466> 2024-09-14T11:07:56.355+0000 7f3f75416800 5 AuthRegistry(0x562766bbc2a0) adding con mode: crc 2024-09-14T11:07:56.497 INFO:tasks.workunit.client.0.smithi097.stderr: -465> 2024-09-14T11:07:56.355+0000 7f3f75416800 5 AuthRegistry(0x562766bbc2a0) adding con mode: secure 2024-09-14T11:07:56.497 INFO:tasks.workunit.client.0.smithi097.stderr: -464> 2024-09-14T11:07:56.355+0000 7f3f75416800 5 AuthRegistry(0x562766bbc2a0) adding con mode: crc 2024-09-14T11:07:56.497 INFO:tasks.workunit.client.0.smithi097.stderr: -463> 2024-09-14T11:07:56.355+0000 7f3f75416800 5 AuthRegistry(0x562766bbc2a0) adding con mode: crc 2024-09-14T11:07:56.497 INFO:tasks.workunit.client.0.smithi097.stderr: -462> 2024-09-14T11:07:56.355+0000 7f3f75416800 5 AuthRegistry(0x562766bbc2a0) adding con mode: secure 2024-09-14T11:07:56.497 INFO:tasks.workunit.client.0.smithi097.stderr: -461> 2024-09-14T11:07:56.355+0000 7f3f75416800 5 AuthRegistry(0x562766bbc2a0) adding con mode: crc 2024-09-14T11:07:56.497 INFO:tasks.workunit.client.0.smithi097.stderr: -460> 2024-09-14T11:07:56.355+0000 7f3f75416800 5 AuthRegistry(0x562766bbc2a0) adding con mode: secure 2024-09-14T11:07:56.497 INFO:tasks.workunit.client.0.smithi097.stderr: -459> 2024-09-14T11:07:56.355+0000 7f3f75416800 5 AuthRegistry(0x562766bbc2a0) adding con mode: crc 2024-09-14T11:07:56.497 INFO:tasks.workunit.client.0.smithi097.stderr: -458> 2024-09-14T11:07:56.355+0000 7f3f75416800 5 AuthRegistry(0x562766bbc2a0) adding con mode: secure 2024-09-14T11:07:56.497 INFO:tasks.workunit.client.0.smithi097.stderr: -457> 2024-09-14T11:07:56.355+0000 7f3f75416800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:07:56.497 INFO:tasks.workunit.client.0.smithi097.stderr: -456> 2024-09-14T11:07:56.355+0000 7f3f75416800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:07:56.498 INFO:tasks.workunit.client.0.smithi097.stderr: -455> 2024-09-14T11:07:56.355+0000 7f3f75416800 5 asok(0x56276699a270) register_command rotate-key hook 0x562766bbc3e8 2024-09-14T11:07:56.498 INFO:tasks.workunit.client.0.smithi097.stderr: -454> 2024-09-14T11:07:56.355+0000 7f3f75416800 10 monclient: _reopen_session rank -1 2024-09-14T11:07:56.498 INFO:tasks.workunit.client.0.smithi097.stderr: -453> 2024-09-14T11:07:56.355+0000 7f3f75416800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:07:56.498 INFO:tasks.workunit.client.0.smithi097.stderr: -452> 2024-09-14T11:07:56.355+0000 7f3f75416800 10 monclient(hunting): picked mon.noname-c con 0x562766a721d0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:07:56.498 INFO:tasks.workunit.client.0.smithi097.stderr: -451> 2024-09-14T11:07:56.355+0000 7f3f75416800 10 monclient(hunting): picked mon.noname-a con 0x562766aff740 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:07:56.498 INFO:tasks.workunit.client.0.smithi097.stderr: -450> 2024-09-14T11:07:56.355+0000 7f3f75416800 10 monclient(hunting): picked mon.noname-b con 0x562766b02b00 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:07:56.498 INFO:tasks.workunit.client.0.smithi097.stderr: -449> 2024-09-14T11:07:56.355+0000 7f3f75416800 10 monclient(hunting): start opening mon connection 2024-09-14T11:07:56.498 INFO:tasks.workunit.client.0.smithi097.stderr: -448> 2024-09-14T11:07:56.355+0000 7f3f75416800 10 monclient(hunting): start opening mon connection 2024-09-14T11:07:56.498 INFO:tasks.workunit.client.0.smithi097.stderr: -447> 2024-09-14T11:07:56.355+0000 7f3f75416800 10 monclient(hunting): start opening mon connection 2024-09-14T11:07:56.498 INFO:tasks.workunit.client.0.smithi097.stderr: -446> 2024-09-14T11:07:56.355+0000 7f3f75416800 10 monclient(hunting): _renew_subs 2024-09-14T11:07:56.498 INFO:tasks.workunit.client.0.smithi097.stderr: -445> 2024-09-14T11:07:56.355+0000 7f3f75416800 10 monclient(hunting): authenticate will time out at 2158.008747s 2024-09-14T11:07:56.499 INFO:tasks.workunit.client.0.smithi097.stderr: -444> 2024-09-14T11:07:56.355+0000 7f3f70be7640 10 monclient(hunting): get_auth_request con 0x562766a721d0 auth_method 0 2024-09-14T11:07:56.499 INFO:tasks.workunit.client.0.smithi097.stderr: -443> 2024-09-14T11:07:56.355+0000 7f3f70be7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:07:56.499 INFO:tasks.workunit.client.0.smithi097.stderr: -442> 2024-09-14T11:07:56.355+0000 7f3f70be7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:07:56.499 INFO:tasks.workunit.client.0.smithi097.stderr: -441> 2024-09-14T11:07:56.355+0000 7f3f70be7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:07:56.499 INFO:tasks.workunit.client.0.smithi097.stderr: -440> 2024-09-14T11:07:56.355+0000 7f3f703e6640 10 monclient(hunting): get_auth_request con 0x562766aff740 auth_method 0 2024-09-14T11:07:56.499 INFO:tasks.workunit.client.0.smithi097.stderr: -439> 2024-09-14T11:07:56.355+0000 7f3f703e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:07:56.499 INFO:tasks.workunit.client.0.smithi097.stderr: -438> 2024-09-14T11:07:56.355+0000 7f3f703e6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:07:56.499 INFO:tasks.workunit.client.0.smithi097.stderr: -437> 2024-09-14T11:07:56.355+0000 7f3f703e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:07:56.499 INFO:tasks.workunit.client.0.smithi097.stderr: -436> 2024-09-14T11:07:56.355+0000 7f3f70be7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:07:56.499 INFO:tasks.workunit.client.0.smithi097.stderr: -435> 2024-09-14T11:07:56.355+0000 7f3f70be7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:07:56.499 INFO:tasks.workunit.client.0.smithi097.stderr: -434> 2024-09-14T11:07:56.355+0000 7f3f70be7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:07:56.499 INFO:tasks.workunit.client.0.smithi097.stderr: -433> 2024-09-14T11:07:56.355+0000 7f3f703e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:07:56.500 INFO:tasks.workunit.client.0.smithi097.stderr: -432> 2024-09-14T11:07:56.355+0000 7f3f703e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:07:56.500 INFO:tasks.workunit.client.0.smithi097.stderr: -431> 2024-09-14T11:07:56.355+0000 7f3f703e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:07:56.500 INFO:tasks.workunit.client.0.smithi097.stderr: -430> 2024-09-14T11:07:56.355+0000 7f3f713e8640 10 monclient(hunting): get_auth_request con 0x562766b02b00 auth_method 0 2024-09-14T11:07:56.500 INFO:tasks.workunit.client.0.smithi097.stderr: -429> 2024-09-14T11:07:56.355+0000 7f3f713e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:07:56.500 INFO:tasks.workunit.client.0.smithi097.stderr: -428> 2024-09-14T11:07:56.355+0000 7f3f713e8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:07:56.500 INFO:tasks.workunit.client.0.smithi097.stderr: -427> 2024-09-14T11:07:56.355+0000 7f3f713e8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:07:56.500 INFO:tasks.workunit.client.0.smithi097.stderr: -426> 2024-09-14T11:07:56.356+0000 7f3f713e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:07:56.500 INFO:tasks.workunit.client.0.smithi097.stderr: -425> 2024-09-14T11:07:56.356+0000 7f3f713e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:07:56.500 INFO:tasks.workunit.client.0.smithi097.stderr: -424> 2024-09-14T11:07:56.356+0000 7f3f713e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:07:56.500 INFO:tasks.workunit.client.0.smithi097.stderr: -423> 2024-09-14T11:07:56.356+0000 7f3f703e6640 10 monclient(hunting): handle_auth_done global_id 8283 payload 824 2024-09-14T11:07:56.500 INFO:tasks.workunit.client.0.smithi097.stderr: -422> 2024-09-14T11:07:56.356+0000 7f3f703e6640 10 monclient: _finish_hunting 0 2024-09-14T11:07:56.501 INFO:tasks.workunit.client.0.smithi097.stderr: -421> 2024-09-14T11:07:56.356+0000 7f3f703e6640 1 monclient: found mon.noname-a 2024-09-14T11:07:56.501 INFO:tasks.workunit.client.0.smithi097.stderr: -420> 2024-09-14T11:07:56.356+0000 7f3f703e6640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-14T11:07:56.501 INFO:tasks.workunit.client.0.smithi097.stderr: -419> 2024-09-14T11:07:56.356+0000 7f3e5d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:07:56.501 INFO:tasks.workunit.client.0.smithi097.stderr: -418> 2024-09-14T11:07:56.356+0000 7f3e5d60a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:07:56.501 INFO:tasks.workunit.client.0.smithi097.stderr: -417> 2024-09-14T11:07:56.356+0000 7f3e5d60a640 10 monclient: dump: 2024-09-14T11:07:56.501 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:07:56.501 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:07:56.501 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:56.501 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:56.502 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:07:56.502 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:07:56.502 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:07:56.502 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:07:56.502 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:07:56.502 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:56.502 INFO:tasks.workunit.client.0.smithi097.stderr: -416> 2024-09-14T11:07:56.356+0000 7f3e5d60a640 10 monclient: _finish_auth 0 2024-09-14T11:07:56.502 INFO:tasks.workunit.client.0.smithi097.stderr: -415> 2024-09-14T11:07:56.356+0000 7f3e5d60a640 10 monclient: _check_auth_tickets 2024-09-14T11:07:56.502 INFO:tasks.workunit.client.0.smithi097.stderr: -414> 2024-09-14T11:07:56.356+0000 7f3e5d60a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:07:56.502 INFO:tasks.workunit.client.0.smithi097.stderr: -413> 2024-09-14T11:07:56.356+0000 7f3e5d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:07:56.502 INFO:tasks.workunit.client.0.smithi097.stderr: -412> 2024-09-14T11:07:56.356+0000 7f3e5d60a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:07:56.502 INFO:tasks.workunit.client.0.smithi097.stderr: -411> 2024-09-14T11:07:56.356+0000 7f3e5d60a640 10 monclient: dump: 2024-09-14T11:07:56.502 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:07:56.503 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:07:56.503 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:56.503 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:56.503 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:07:56.503 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:07:56.503 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:07:56.503 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:07:56.503 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:07:56.503 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:56.503 INFO:tasks.workunit.client.0.smithi097.stderr: -410> 2024-09-14T11:07:56.356+0000 7f3f75416800 5 monclient: authenticate success, global_id 8283 2024-09-14T11:07:56.504 INFO:tasks.workunit.client.0.smithi097.stderr: -409> 2024-09-14T11:07:56.356+0000 7f3f75416800 10 monclient: _renew_subs 2024-09-14T11:07:56.504 INFO:tasks.workunit.client.0.smithi097.stderr: -408> 2024-09-14T11:07:56.356+0000 7f3f75416800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:07:56.504 INFO:tasks.workunit.client.0.smithi097.stderr: -407> 2024-09-14T11:07:56.356+0000 7f3e5ee0d640 4 set_mon_vals no callback set 2024-09-14T11:07:56.504 INFO:tasks.workunit.client.0.smithi097.stderr: -406> 2024-09-14T11:07:56.356+0000 7f3f75416800 10 monclient: _renew_subs 2024-09-14T11:07:56.504 INFO:tasks.workunit.client.0.smithi097.stderr: -405> 2024-09-14T11:07:56.356+0000 7f3f75416800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:07:56.504 INFO:tasks.workunit.client.0.smithi097.stderr: -404> 2024-09-14T11:07:56.356+0000 7f3f75416800 1 librados: init done 2024-09-14T11:07:56.504 INFO:tasks.workunit.client.0.smithi097.stderr: -403> 2024-09-14T11:07:56.358+0000 7f3e5d60a640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:07:56.504 INFO:tasks.workunit.client.0.smithi097.stderr: -402> 2024-09-14T11:07:56.358+0000 7f3e5d60a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:07:56.504 INFO:tasks.workunit.client.0.smithi097.stderr: -401> 2024-09-14T11:07:56.358+0000 7f3e5d60a640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:07:56.504 INFO:tasks.workunit.client.0.smithi097.stderr: -400> 2024-09-14T11:07:56.358+0000 7f3f70be7640 10 monclient: get_auth_request con 0x7f3e58077230 auth_method 0 2024-09-14T11:07:56.504 INFO:tasks.workunit.client.0.smithi097.stderr: -399> 2024-09-14T11:07:56.358+0000 7f3f713e8640 10 monclient: get_auth_request con 0x562766be3300 auth_method 0 2024-09-14T11:07:56.504 INFO:tasks.workunit.client.0.smithi097.stderr: -398> 2024-09-14T11:07:56.359+0000 7f3f70be7640 10 monclient: get_auth_request con 0x562766c07cc0 auth_method 0 2024-09-14T11:07:56.504 INFO:tasks.workunit.client.0.smithi097.stderr: -397> 2024-09-14T11:07:56.360+0000 7f3f703e6640 10 monclient: get_auth_request con 0x562766c0c070 auth_method 0 2024-09-14T11:07:56.504 INFO:tasks.workunit.client.0.smithi097.stderr: -396> 2024-09-14T11:07:56.361+0000 7f3f713e8640 10 monclient: get_auth_request con 0x562766c0b540 auth_method 0 2024-09-14T11:07:56.505 INFO:tasks.workunit.client.0.smithi097.stderr: -395> 2024-09-14T11:07:56.362+0000 7f3f75416800 10 monclient: build_initial_monmap 2024-09-14T11:07:56.505 INFO:tasks.workunit.client.0.smithi097.stderr: -394> 2024-09-14T11:07:56.362+0000 7f3f75416800 1 build_initial for_mkfs: 0 2024-09-14T11:07:56.505 INFO:tasks.workunit.client.0.smithi097.stderr: -393> 2024-09-14T11:07:56.362+0000 7f3f75416800 10 monclient: monmap: 2024-09-14T11:07:56.505 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:07:56.505 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:07:56.505 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:07:56.505 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:07:56.505 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:07:56.505 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:07:56.505 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:07:56.505 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:07:56.505 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:07:56.505 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:56.505 INFO:tasks.workunit.client.0.smithi097.stderr: -392> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c142c0) adding auth protocol: cephx 2024-09-14T11:07:56.506 INFO:tasks.workunit.client.0.smithi097.stderr: -391> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c142c0) adding auth protocol: cephx 2024-09-14T11:07:56.506 INFO:tasks.workunit.client.0.smithi097.stderr: -390> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c142c0) adding auth protocol: cephx 2024-09-14T11:07:56.506 INFO:tasks.workunit.client.0.smithi097.stderr: -389> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c142c0) adding con mode: secure 2024-09-14T11:07:56.506 INFO:tasks.workunit.client.0.smithi097.stderr: -388> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c142c0) adding con mode: crc 2024-09-14T11:07:56.506 INFO:tasks.workunit.client.0.smithi097.stderr: -387> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c142c0) adding con mode: secure 2024-09-14T11:07:56.506 INFO:tasks.workunit.client.0.smithi097.stderr: -386> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c142c0) adding con mode: crc 2024-09-14T11:07:56.506 INFO:tasks.workunit.client.0.smithi097.stderr: -385> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c142c0) adding con mode: secure 2024-09-14T11:07:56.506 INFO:tasks.workunit.client.0.smithi097.stderr: -384> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c142c0) adding con mode: crc 2024-09-14T11:07:56.506 INFO:tasks.workunit.client.0.smithi097.stderr: -383> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c142c0) adding con mode: crc 2024-09-14T11:07:56.507 INFO:tasks.workunit.client.0.smithi097.stderr: -382> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c142c0) adding con mode: secure 2024-09-14T11:07:56.507 INFO:tasks.workunit.client.0.smithi097.stderr: -381> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c142c0) adding con mode: crc 2024-09-14T11:07:56.507 INFO:tasks.workunit.client.0.smithi097.stderr: -380> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c142c0) adding con mode: secure 2024-09-14T11:07:56.507 INFO:tasks.workunit.client.0.smithi097.stderr: -379> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c142c0) adding con mode: crc 2024-09-14T11:07:56.507 INFO:tasks.workunit.client.0.smithi097.stderr: -378> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c142c0) adding con mode: secure 2024-09-14T11:07:56.507 INFO:tasks.workunit.client.0.smithi097.stderr: -377> 2024-09-14T11:07:56.362+0000 7f3f75416800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:07:56.507 INFO:tasks.workunit.client.0.smithi097.stderr: -376> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 asok(0x56276699a270) register_command objecter_requests cmddesc objecter_requests hook 0x562766c17770 EEXIST 2024-09-14T11:07:56.507 INFO:tasks.workunit.client.0.smithi097.stderr: -375> 2024-09-14T11:07:56.362+0000 7f3f75416800 10 monclient: init 2024-09-14T11:07:56.507 INFO:tasks.workunit.client.0.smithi097.stderr: -374> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c130c8) adding auth protocol: cephx 2024-09-14T11:07:56.507 INFO:tasks.workunit.client.0.smithi097.stderr: -373> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c130c8) adding auth protocol: cephx 2024-09-14T11:07:56.507 INFO:tasks.workunit.client.0.smithi097.stderr: -372> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c130c8) adding auth protocol: cephx 2024-09-14T11:07:56.507 INFO:tasks.workunit.client.0.smithi097.stderr: -371> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c130c8) adding con mode: secure 2024-09-14T11:07:56.508 INFO:tasks.workunit.client.0.smithi097.stderr: -370> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c130c8) adding con mode: crc 2024-09-14T11:07:56.508 INFO:tasks.workunit.client.0.smithi097.stderr: -369> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c130c8) adding con mode: secure 2024-09-14T11:07:56.508 INFO:tasks.workunit.client.0.smithi097.stderr: -368> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c130c8) adding con mode: crc 2024-09-14T11:07:56.508 INFO:tasks.workunit.client.0.smithi097.stderr: -367> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c130c8) adding con mode: secure 2024-09-14T11:07:56.508 INFO:tasks.workunit.client.0.smithi097.stderr: -366> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c130c8) adding con mode: crc 2024-09-14T11:07:56.508 INFO:tasks.workunit.client.0.smithi097.stderr: -365> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c130c8) adding con mode: crc 2024-09-14T11:07:56.508 INFO:tasks.workunit.client.0.smithi097.stderr: -364> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c130c8) adding con mode: secure 2024-09-14T11:07:56.508 INFO:tasks.workunit.client.0.smithi097.stderr: -363> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c130c8) adding con mode: crc 2024-09-14T11:07:56.508 INFO:tasks.workunit.client.0.smithi097.stderr: -362> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c130c8) adding con mode: secure 2024-09-14T11:07:56.508 INFO:tasks.workunit.client.0.smithi097.stderr: -361> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c130c8) adding con mode: crc 2024-09-14T11:07:56.508 INFO:tasks.workunit.client.0.smithi097.stderr: -360> 2024-09-14T11:07:56.362+0000 7f3f75416800 5 AuthRegistry(0x562766c130c8) adding con mode: secure 2024-09-14T11:07:56.508 INFO:tasks.workunit.client.0.smithi097.stderr: -359> 2024-09-14T11:07:56.362+0000 7f3f75416800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:07:56.508 INFO:tasks.workunit.client.0.smithi097.stderr: -358> 2024-09-14T11:07:56.362+0000 7f3f75416800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:07:56.508 INFO:tasks.workunit.client.0.smithi097.stderr: -357> 2024-09-14T11:07:56.363+0000 7f3f75416800 5 asok(0x56276699a270) register_command rotate-key cmddesc rotate-key hook 0x562766c13210 EEXIST 2024-09-14T11:07:56.509 INFO:tasks.workunit.client.0.smithi097.stderr: -356> 2024-09-14T11:07:56.363+0000 7f3f75416800 10 monclient: _reopen_session rank -1 2024-09-14T11:07:56.509 INFO:tasks.workunit.client.0.smithi097.stderr: -355> 2024-09-14T11:07:56.363+0000 7f3f75416800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:07:56.509 INFO:tasks.workunit.client.0.smithi097.stderr: -354> 2024-09-14T11:07:56.363+0000 7f3f75416800 10 monclient(hunting): picked mon.noname-b con 0x562766c3ba90 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:07:56.509 INFO:tasks.workunit.client.0.smithi097.stderr: -353> 2024-09-14T11:07:56.363+0000 7f3f75416800 10 monclient(hunting): picked mon.noname-c con 0x562766c3be70 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:07:56.509 INFO:tasks.workunit.client.0.smithi097.stderr: -352> 2024-09-14T11:07:56.363+0000 7f3f75416800 10 monclient(hunting): picked mon.noname-a con 0x562766c3a7a0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:07:56.509 INFO:tasks.workunit.client.0.smithi097.stderr: -351> 2024-09-14T11:07:56.363+0000 7f3f75416800 10 monclient(hunting): start opening mon connection 2024-09-14T11:07:56.509 INFO:tasks.workunit.client.0.smithi097.stderr: -350> 2024-09-14T11:07:56.363+0000 7f3f75416800 10 monclient(hunting): start opening mon connection 2024-09-14T11:07:56.509 INFO:tasks.workunit.client.0.smithi097.stderr: -349> 2024-09-14T11:07:56.363+0000 7f3f75416800 10 monclient(hunting): start opening mon connection 2024-09-14T11:07:56.509 INFO:tasks.workunit.client.0.smithi097.stderr: -348> 2024-09-14T11:07:56.363+0000 7f3f75416800 10 monclient(hunting): _renew_subs 2024-09-14T11:07:56.509 INFO:tasks.workunit.client.0.smithi097.stderr: -347> 2024-09-14T11:07:56.363+0000 7f3f75416800 10 monclient(hunting): authenticate will time out at 2158.016081s 2024-09-14T11:07:56.509 INFO:tasks.workunit.client.0.smithi097.stderr: -346> 2024-09-14T11:07:56.363+0000 7f3f713e8640 10 monclient(hunting): get_auth_request con 0x562766c3be70 auth_method 0 2024-09-14T11:07:56.509 INFO:tasks.workunit.client.0.smithi097.stderr: -345> 2024-09-14T11:07:56.363+0000 7f3f713e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:07:56.510 INFO:tasks.workunit.client.0.smithi097.stderr: -344> 2024-09-14T11:07:56.363+0000 7f3f713e8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:07:56.510 INFO:tasks.workunit.client.0.smithi097.stderr: -343> 2024-09-14T11:07:56.363+0000 7f3f713e8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:07:56.510 INFO:tasks.workunit.client.0.smithi097.stderr: -342> 2024-09-14T11:07:56.363+0000 7f3f70be7640 10 monclient(hunting): get_auth_request con 0x562766c3a7a0 auth_method 0 2024-09-14T11:07:56.510 INFO:tasks.workunit.client.0.smithi097.stderr: -341> 2024-09-14T11:07:56.363+0000 7f3f70be7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:07:56.510 INFO:tasks.workunit.client.0.smithi097.stderr: -340> 2024-09-14T11:07:56.363+0000 7f3f70be7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:07:56.510 INFO:tasks.workunit.client.0.smithi097.stderr: -339> 2024-09-14T11:07:56.363+0000 7f3f70be7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:07:56.510 INFO:tasks.workunit.client.0.smithi097.stderr: -338> 2024-09-14T11:07:56.363+0000 7f3f703e6640 10 monclient(hunting): get_auth_request con 0x562766c3ba90 auth_method 0 2024-09-14T11:07:56.510 INFO:tasks.workunit.client.0.smithi097.stderr: -337> 2024-09-14T11:07:56.363+0000 7f3f703e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:07:56.510 INFO:tasks.workunit.client.0.smithi097.stderr: -336> 2024-09-14T11:07:56.363+0000 7f3f703e6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:07:56.510 INFO:tasks.workunit.client.0.smithi097.stderr: -335> 2024-09-14T11:07:56.363+0000 7f3f703e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:07:56.510 INFO:tasks.workunit.client.0.smithi097.stderr: -334> 2024-09-14T11:07:56.363+0000 7f3f713e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:07:56.510 INFO:tasks.workunit.client.0.smithi097.stderr: -333> 2024-09-14T11:07:56.363+0000 7f3f713e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:07:56.511 INFO:tasks.workunit.client.0.smithi097.stderr: -332> 2024-09-14T11:07:56.363+0000 7f3f713e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:07:56.511 INFO:tasks.workunit.client.0.smithi097.stderr: -331> 2024-09-14T11:07:56.363+0000 7f3f70be7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:07:56.511 INFO:tasks.workunit.client.0.smithi097.stderr: -330> 2024-09-14T11:07:56.363+0000 7f3f70be7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:07:56.511 INFO:tasks.workunit.client.0.smithi097.stderr: -329> 2024-09-14T11:07:56.363+0000 7f3f70be7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:07:56.511 INFO:tasks.workunit.client.0.smithi097.stderr: -328> 2024-09-14T11:07:56.363+0000 7f3f703e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:07:56.511 INFO:tasks.workunit.client.0.smithi097.stderr: -327> 2024-09-14T11:07:56.363+0000 7f3f703e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:07:56.511 INFO:tasks.workunit.client.0.smithi097.stderr: -326> 2024-09-14T11:07:56.363+0000 7f3f703e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:07:56.511 INFO:tasks.workunit.client.0.smithi097.stderr: -325> 2024-09-14T11:07:56.363+0000 7f3f713e8640 10 monclient(hunting): handle_auth_done global_id 7772 payload 824 2024-09-14T11:07:56.511 INFO:tasks.workunit.client.0.smithi097.stderr: -324> 2024-09-14T11:07:56.363+0000 7f3f713e8640 10 monclient: _finish_hunting 0 2024-09-14T11:07:56.511 INFO:tasks.workunit.client.0.smithi097.stderr: -323> 2024-09-14T11:07:56.363+0000 7f3f713e8640 1 monclient: found mon.noname-c 2024-09-14T11:07:56.511 INFO:tasks.workunit.client.0.smithi097.stderr: -322> 2024-09-14T11:07:56.363+0000 7f3f713e8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:07:56.511 INFO:tasks.workunit.client.0.smithi097.stderr: -321> 2024-09-14T11:07:56.363+0000 7f3e567fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:07:56.511 INFO:tasks.workunit.client.0.smithi097.stderr: -320> 2024-09-14T11:07:56.363+0000 7f3e567fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:07:56.512 INFO:tasks.workunit.client.0.smithi097.stderr: -319> 2024-09-14T11:07:56.363+0000 7f3e567fc640 10 monclient: dump: 2024-09-14T11:07:56.512 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:07:56.512 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:07:56.512 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:56.512 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:56.512 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:07:56.512 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:07:56.512 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:07:56.512 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:07:56.512 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:07:56.513 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:56.513 INFO:tasks.workunit.client.0.smithi097.stderr: -318> 2024-09-14T11:07:56.363+0000 7f3e567fc640 10 monclient: _finish_auth 0 2024-09-14T11:07:56.513 INFO:tasks.workunit.client.0.smithi097.stderr: -317> 2024-09-14T11:07:56.363+0000 7f3e567fc640 10 monclient: _check_auth_tickets 2024-09-14T11:07:56.513 INFO:tasks.workunit.client.0.smithi097.stderr: -316> 2024-09-14T11:07:56.363+0000 7f3f75416800 5 monclient: authenticate success, global_id 7772 2024-09-14T11:07:56.513 INFO:tasks.workunit.client.0.smithi097.stderr: -315> 2024-09-14T11:07:56.363+0000 7f3e567fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:07:56.513 INFO:tasks.workunit.client.0.smithi097.stderr: -314> 2024-09-14T11:07:56.363+0000 7f3e567fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:07:56.513 INFO:tasks.workunit.client.0.smithi097.stderr: -313> 2024-09-14T11:07:56.363+0000 7f3e567fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:07:56.513 INFO:tasks.workunit.client.0.smithi097.stderr: -312> 2024-09-14T11:07:56.363+0000 7f3e567fc640 10 monclient: dump: 2024-09-14T11:07:56.513 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:07:56.514 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:07:56.514 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:56.514 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:56.514 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:07:56.514 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:07:56.514 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:07:56.514 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:07:56.514 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:07:56.514 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:56.514 INFO:tasks.workunit.client.0.smithi097.stderr: -311> 2024-09-14T11:07:56.363+0000 7f3f75416800 10 monclient: _renew_subs 2024-09-14T11:07:56.514 INFO:tasks.workunit.client.0.smithi097.stderr: -310> 2024-09-14T11:07:56.363+0000 7f3f71be9640 4 set_mon_vals no callback set 2024-09-14T11:07:56.514 INFO:tasks.workunit.client.0.smithi097.stderr: -309> 2024-09-14T11:07:56.363+0000 7f3f75416800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:07:56.514 INFO:tasks.workunit.client.0.smithi097.stderr: -308> 2024-09-14T11:07:56.363+0000 7f3f75416800 10 monclient: _renew_subs 2024-09-14T11:07:56.515 INFO:tasks.workunit.client.0.smithi097.stderr: -307> 2024-09-14T11:07:56.363+0000 7f3f75416800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:07:56.515 INFO:tasks.workunit.client.0.smithi097.stderr: -306> 2024-09-14T11:07:56.365+0000 7f3e567fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:07:56.515 INFO:tasks.workunit.client.0.smithi097.stderr: -305> 2024-09-14T11:07:56.365+0000 7f3e567fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:07:56.515 INFO:tasks.workunit.client.0.smithi097.stderr: -304> 2024-09-14T11:07:56.365+0000 7f3e567fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:07:56.515 INFO:tasks.workunit.client.0.smithi097.stderr: -303> 2024-09-14T11:07:56.365+0000 7f3f703e6640 10 monclient: get_auth_request con 0x7f3e48077140 auth_method 0 2024-09-14T11:07:56.515 INFO:tasks.workunit.client.0.smithi097.stderr: -302> 2024-09-14T11:07:56.365+0000 7f3f75416800 10 monclient: get_monmap_and_config 2024-09-14T11:07:56.515 INFO:tasks.workunit.client.0.smithi097.stderr: -301> 2024-09-14T11:07:56.365+0000 7f3f75416800 10 monclient: build_initial_monmap 2024-09-14T11:07:56.515 INFO:tasks.workunit.client.0.smithi097.stderr: -300> 2024-09-14T11:07:56.365+0000 7f3f75416800 1 build_initial for_mkfs: 0 2024-09-14T11:07:56.515 INFO:tasks.workunit.client.0.smithi097.stderr: -299> 2024-09-14T11:07:56.365+0000 7f3f75416800 10 monclient: monmap: 2024-09-14T11:07:56.515 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:07:56.515 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:07:56.515 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:07:56.515 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:07:56.515 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:07:56.516 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:07:56.516 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:07:56.516 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:07:56.516 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:07:56.516 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:56.516 INFO:tasks.workunit.client.0.smithi097.stderr: -298> 2024-09-14T11:07:56.365+0000 7f3f75416800 5 AuthRegistry(0x562766c5b940) adding auth protocol: cephx 2024-09-14T11:07:56.516 INFO:tasks.workunit.client.0.smithi097.stderr: -297> 2024-09-14T11:07:56.365+0000 7f3f75416800 5 AuthRegistry(0x562766c5b940) adding auth protocol: cephx 2024-09-14T11:07:56.516 INFO:tasks.workunit.client.0.smithi097.stderr: -296> 2024-09-14T11:07:56.365+0000 7f3f75416800 5 AuthRegistry(0x562766c5b940) adding auth protocol: cephx 2024-09-14T11:07:56.516 INFO:tasks.workunit.client.0.smithi097.stderr: -295> 2024-09-14T11:07:56.365+0000 7f3f75416800 5 AuthRegistry(0x562766c5b940) adding con mode: secure 2024-09-14T11:07:56.516 INFO:tasks.workunit.client.0.smithi097.stderr: -294> 2024-09-14T11:07:56.365+0000 7f3f75416800 5 AuthRegistry(0x562766c5b940) adding con mode: crc 2024-09-14T11:07:56.516 INFO:tasks.workunit.client.0.smithi097.stderr: -293> 2024-09-14T11:07:56.365+0000 7f3f75416800 5 AuthRegistry(0x562766c5b940) adding con mode: secure 2024-09-14T11:07:56.517 INFO:tasks.workunit.client.0.smithi097.stderr: -292> 2024-09-14T11:07:56.365+0000 7f3f75416800 5 AuthRegistry(0x562766c5b940) adding con mode: crc 2024-09-14T11:07:56.517 INFO:tasks.workunit.client.0.smithi097.stderr: -291> 2024-09-14T11:07:56.365+0000 7f3f75416800 5 AuthRegistry(0x562766c5b940) adding con mode: secure 2024-09-14T11:07:56.517 INFO:tasks.workunit.client.0.smithi097.stderr: -290> 2024-09-14T11:07:56.365+0000 7f3f75416800 5 AuthRegistry(0x562766c5b940) adding con mode: crc 2024-09-14T11:07:56.517 INFO:tasks.workunit.client.0.smithi097.stderr: -289> 2024-09-14T11:07:56.365+0000 7f3f75416800 5 AuthRegistry(0x562766c5b940) adding con mode: crc 2024-09-14T11:07:56.517 INFO:tasks.workunit.client.0.smithi097.stderr: -288> 2024-09-14T11:07:56.365+0000 7f3f75416800 5 AuthRegistry(0x562766c5b940) adding con mode: secure 2024-09-14T11:07:56.517 INFO:tasks.workunit.client.0.smithi097.stderr: -287> 2024-09-14T11:07:56.365+0000 7f3f75416800 5 AuthRegistry(0x562766c5b940) adding con mode: crc 2024-09-14T11:07:56.517 INFO:tasks.workunit.client.0.smithi097.stderr: -286> 2024-09-14T11:07:56.365+0000 7f3f75416800 5 AuthRegistry(0x562766c5b940) adding con mode: secure 2024-09-14T11:07:56.517 INFO:tasks.workunit.client.0.smithi097.stderr: -285> 2024-09-14T11:07:56.365+0000 7f3f75416800 5 AuthRegistry(0x562766c5b940) adding con mode: crc 2024-09-14T11:07:56.517 INFO:tasks.workunit.client.0.smithi097.stderr: -284> 2024-09-14T11:07:56.365+0000 7f3f75416800 5 AuthRegistry(0x562766c5b940) adding con mode: secure 2024-09-14T11:07:56.517 INFO:tasks.workunit.client.0.smithi097.stderr: -283> 2024-09-14T11:07:56.366+0000 7f3f75416800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:07:56.517 INFO:tasks.workunit.client.0.smithi097.stderr: -282> 2024-09-14T11:07:56.366+0000 7f3f75416800 10 monclient: init 2024-09-14T11:07:56.517 INFO:tasks.workunit.client.0.smithi097.stderr: -281> 2024-09-14T11:07:56.366+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e8eb0) adding auth protocol: cephx 2024-09-14T11:07:56.517 INFO:tasks.workunit.client.0.smithi097.stderr: -280> 2024-09-14T11:07:56.366+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e8eb0) adding auth protocol: cephx 2024-09-14T11:07:56.517 INFO:tasks.workunit.client.0.smithi097.stderr: -279> 2024-09-14T11:07:56.366+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e8eb0) adding auth protocol: cephx 2024-09-14T11:07:56.518 INFO:tasks.workunit.client.0.smithi097.stderr: -278> 2024-09-14T11:07:56.366+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e8eb0) adding con mode: secure 2024-09-14T11:07:56.518 INFO:tasks.workunit.client.0.smithi097.stderr: -277> 2024-09-14T11:07:56.366+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e8eb0) adding con mode: crc 2024-09-14T11:07:56.518 INFO:tasks.workunit.client.0.smithi097.stderr: -276> 2024-09-14T11:07:56.366+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e8eb0) adding con mode: secure 2024-09-14T11:07:56.518 INFO:tasks.workunit.client.0.smithi097.stderr: -275> 2024-09-14T11:07:56.366+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e8eb0) adding con mode: crc 2024-09-14T11:07:56.518 INFO:tasks.workunit.client.0.smithi097.stderr: -274> 2024-09-14T11:07:56.366+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e8eb0) adding con mode: secure 2024-09-14T11:07:56.518 INFO:tasks.workunit.client.0.smithi097.stderr: -273> 2024-09-14T11:07:56.366+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e8eb0) adding con mode: crc 2024-09-14T11:07:56.518 INFO:tasks.workunit.client.0.smithi097.stderr: -272> 2024-09-14T11:07:56.366+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e8eb0) adding con mode: crc 2024-09-14T11:07:56.518 INFO:tasks.workunit.client.0.smithi097.stderr: -271> 2024-09-14T11:07:56.366+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e8eb0) adding con mode: secure 2024-09-14T11:07:56.518 INFO:tasks.workunit.client.0.smithi097.stderr: -270> 2024-09-14T11:07:56.366+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e8eb0) adding con mode: crc 2024-09-14T11:07:56.518 INFO:tasks.workunit.client.0.smithi097.stderr: -269> 2024-09-14T11:07:56.366+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e8eb0) adding con mode: secure 2024-09-14T11:07:56.518 INFO:tasks.workunit.client.0.smithi097.stderr: -268> 2024-09-14T11:07:56.366+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e8eb0) adding con mode: crc 2024-09-14T11:07:56.519 INFO:tasks.workunit.client.0.smithi097.stderr: -267> 2024-09-14T11:07:56.366+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e8eb0) adding con mode: secure 2024-09-14T11:07:56.519 INFO:tasks.workunit.client.0.smithi097.stderr: -266> 2024-09-14T11:07:56.366+0000 7f3f75416800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:07:56.519 INFO:tasks.workunit.client.0.smithi097.stderr: -265> 2024-09-14T11:07:56.366+0000 7f3f75416800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:07:56.519 INFO:tasks.workunit.client.0.smithi097.stderr: -264> 2024-09-14T11:07:56.366+0000 7f3f75416800 5 asok(0x56276699a270) register_command rotate-key cmddesc rotate-key hook 0x7ffe528e8ff8 EEXIST 2024-09-14T11:07:56.519 INFO:tasks.workunit.client.0.smithi097.stderr: -263> 2024-09-14T11:07:56.366+0000 7f3f75416800 10 monclient: _reopen_session rank -1 2024-09-14T11:07:56.519 INFO:tasks.workunit.client.0.smithi097.stderr: -262> 2024-09-14T11:07:56.366+0000 7f3f75416800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:07:56.519 INFO:tasks.workunit.client.0.smithi097.stderr: -261> 2024-09-14T11:07:56.366+0000 7f3f75416800 10 monclient(hunting): picked mon.noname-b con 0x562766c90000 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:07:56.519 INFO:tasks.workunit.client.0.smithi097.stderr: -260> 2024-09-14T11:07:56.366+0000 7f3f75416800 10 monclient(hunting): picked mon.noname-a con 0x562766c60f50 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:07:56.519 INFO:tasks.workunit.client.0.smithi097.stderr: -259> 2024-09-14T11:07:56.366+0000 7f3f75416800 10 monclient(hunting): picked mon.noname-c con 0x562766c8b8a0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:07:56.519 INFO:tasks.workunit.client.0.smithi097.stderr: -258> 2024-09-14T11:07:56.366+0000 7f3f75416800 10 monclient(hunting): start opening mon connection 2024-09-14T11:07:56.519 INFO:tasks.workunit.client.0.smithi097.stderr: -257> 2024-09-14T11:07:56.366+0000 7f3f75416800 10 monclient(hunting): start opening mon connection 2024-09-14T11:07:56.519 INFO:tasks.workunit.client.0.smithi097.stderr: -256> 2024-09-14T11:07:56.366+0000 7f3f75416800 10 monclient(hunting): start opening mon connection 2024-09-14T11:07:56.519 INFO:tasks.workunit.client.0.smithi097.stderr: -255> 2024-09-14T11:07:56.366+0000 7f3f75416800 10 monclient(hunting): _renew_subs 2024-09-14T11:07:56.519 INFO:tasks.workunit.client.0.smithi097.stderr: -254> 2024-09-14T11:07:56.366+0000 7f3f75416800 10 monclient(hunting): authenticate will time out at 2158.019847s 2024-09-14T11:07:56.519 INFO:tasks.workunit.client.0.smithi097.stderr: -253> 2024-09-14T11:07:56.366+0000 7f3f713e8640 10 monclient(hunting): get_auth_request con 0x562766c60f50 auth_method 0 2024-09-14T11:07:56.520 INFO:tasks.workunit.client.0.smithi097.stderr: -252> 2024-09-14T11:07:56.366+0000 7f3f713e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:07:56.520 INFO:tasks.workunit.client.0.smithi097.stderr: -251> 2024-09-14T11:07:56.366+0000 7f3f713e8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:07:56.520 INFO:tasks.workunit.client.0.smithi097.stderr: -250> 2024-09-14T11:07:56.366+0000 7f3f713e8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:07:56.520 INFO:tasks.workunit.client.0.smithi097.stderr: -249> 2024-09-14T11:07:56.366+0000 7f3f70be7640 10 monclient(hunting): get_auth_request con 0x562766c8b8a0 auth_method 0 2024-09-14T11:07:56.520 INFO:tasks.workunit.client.0.smithi097.stderr: -248> 2024-09-14T11:07:56.366+0000 7f3f70be7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:07:56.520 INFO:tasks.workunit.client.0.smithi097.stderr: -247> 2024-09-14T11:07:56.366+0000 7f3f70be7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:07:56.520 INFO:tasks.workunit.client.0.smithi097.stderr: -246> 2024-09-14T11:07:56.366+0000 7f3f70be7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:07:56.520 INFO:tasks.workunit.client.0.smithi097.stderr: -245> 2024-09-14T11:07:56.367+0000 7f3f713e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:07:56.520 INFO:tasks.workunit.client.0.smithi097.stderr: -244> 2024-09-14T11:07:56.367+0000 7f3f713e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:07:56.520 INFO:tasks.workunit.client.0.smithi097.stderr: -243> 2024-09-14T11:07:56.367+0000 7f3f713e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:07:56.520 INFO:tasks.workunit.client.0.smithi097.stderr: -242> 2024-09-14T11:07:56.367+0000 7f3f70be7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:07:56.520 INFO:tasks.workunit.client.0.smithi097.stderr: -241> 2024-09-14T11:07:56.367+0000 7f3f70be7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:07:56.520 INFO:tasks.workunit.client.0.smithi097.stderr: -240> 2024-09-14T11:07:56.367+0000 7f3f70be7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:07:56.521 INFO:tasks.workunit.client.0.smithi097.stderr: -239> 2024-09-14T11:07:56.367+0000 7f3f703e6640 10 monclient(hunting): get_auth_request con 0x562766c90000 auth_method 0 2024-09-14T11:07:56.521 INFO:tasks.workunit.client.0.smithi097.stderr: -238> 2024-09-14T11:07:56.367+0000 7f3f703e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:07:56.521 INFO:tasks.workunit.client.0.smithi097.stderr: -237> 2024-09-14T11:07:56.367+0000 7f3f703e6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:07:56.521 INFO:tasks.workunit.client.0.smithi097.stderr: -236> 2024-09-14T11:07:56.367+0000 7f3f703e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:07:56.521 INFO:tasks.workunit.client.0.smithi097.stderr: -235> 2024-09-14T11:07:56.367+0000 7f3f713e8640 10 monclient(hunting): handle_auth_done global_id 8289 payload 274 2024-09-14T11:07:56.521 INFO:tasks.workunit.client.0.smithi097.stderr: -234> 2024-09-14T11:07:56.367+0000 7f3f713e8640 10 monclient: _finish_hunting 0 2024-09-14T11:07:56.521 INFO:tasks.workunit.client.0.smithi097.stderr: -233> 2024-09-14T11:07:56.367+0000 7f3f713e8640 1 monclient: found mon.noname-a 2024-09-14T11:07:56.521 INFO:tasks.workunit.client.0.smithi097.stderr: -232> 2024-09-14T11:07:56.367+0000 7f3f713e8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-14T11:07:56.521 INFO:tasks.workunit.client.0.smithi097.stderr: -231> 2024-09-14T11:07:56.367+0000 7f3e47fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:07:56.521 INFO:tasks.workunit.client.0.smithi097.stderr: -230> 2024-09-14T11:07:56.367+0000 7f3e47fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:07:56.521 INFO:tasks.workunit.client.0.smithi097.stderr: -229> 2024-09-14T11:07:56.367+0000 7f3e47fff640 10 monclient: dump: 2024-09-14T11:07:56.521 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:07:56.521 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:07:56.521 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:56.522 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:56.522 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:07:56.522 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:07:56.522 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:07:56.522 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:07:56.522 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:07:56.522 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:56.522 INFO:tasks.workunit.client.0.smithi097.stderr: -228> 2024-09-14T11:07:56.367+0000 7f3e47fff640 10 monclient: _finish_auth 0 2024-09-14T11:07:56.522 INFO:tasks.workunit.client.0.smithi097.stderr: -227> 2024-09-14T11:07:56.367+0000 7f3e47fff640 10 monclient: _check_auth_tickets 2024-09-14T11:07:56.522 INFO:tasks.workunit.client.0.smithi097.stderr: -226> 2024-09-14T11:07:56.367+0000 7f3e47fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:07:56.522 INFO:tasks.workunit.client.0.smithi097.stderr: -225> 2024-09-14T11:07:56.367+0000 7f3f75416800 5 monclient: authenticate success, global_id 8289 2024-09-14T11:07:56.523 INFO:tasks.workunit.client.0.smithi097.stderr: -224> 2024-09-14T11:07:56.367+0000 7f3f75416800 10 monclient: get_monmap_and_config success 2024-09-14T11:07:56.523 INFO:tasks.workunit.client.0.smithi097.stderr: -223> 2024-09-14T11:07:56.367+0000 7f3f75416800 4 set_mon_vals no callback set 2024-09-14T11:07:56.523 INFO:tasks.workunit.client.0.smithi097.stderr: -222> 2024-09-14T11:07:56.367+0000 7f3e47fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:07:56.523 INFO:tasks.workunit.client.0.smithi097.stderr: -221> 2024-09-14T11:07:56.367+0000 7f3e47fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:07:56.523 INFO:tasks.workunit.client.0.smithi097.stderr: -220> 2024-09-14T11:07:56.367+0000 7f3e47fff640 10 monclient: dump: 2024-09-14T11:07:56.523 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:07:56.523 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:07:56.523 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:56.523 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:56.524 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:07:56.524 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:07:56.524 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:07:56.524 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:07:56.524 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:07:56.524 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:56.524 INFO:tasks.workunit.client.0.smithi097.stderr: -219> 2024-09-14T11:07:56.367+0000 7f3f75416800 10 monclient: shutdown 2024-09-14T11:07:56.524 INFO:tasks.workunit.client.0.smithi097.stderr: -218> 2024-09-14T11:07:56.368+0000 7f3f75416800 10 monclient: build_initial_monmap 2024-09-14T11:07:56.524 INFO:tasks.workunit.client.0.smithi097.stderr: -217> 2024-09-14T11:07:56.368+0000 7f3f75416800 1 build_initial for_mkfs: 0 2024-09-14T11:07:56.524 INFO:tasks.workunit.client.0.smithi097.stderr: -216> 2024-09-14T11:07:56.368+0000 7f3f75416800 10 monclient: monmap: 2024-09-14T11:07:56.524 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:07:56.524 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:07:56.524 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:07:56.525 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:07:56.525 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:07:56.525 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:07:56.525 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:07:56.525 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:07:56.525 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:07:56.525 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:56.525 INFO:tasks.workunit.client.0.smithi097.stderr: -215> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c821a0) adding auth protocol: cephx 2024-09-14T11:07:56.525 INFO:tasks.workunit.client.0.smithi097.stderr: -214> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c821a0) adding auth protocol: cephx 2024-09-14T11:07:56.525 INFO:tasks.workunit.client.0.smithi097.stderr: -213> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c821a0) adding auth protocol: cephx 2024-09-14T11:07:56.525 INFO:tasks.workunit.client.0.smithi097.stderr: -212> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c821a0) adding con mode: secure 2024-09-14T11:07:56.525 INFO:tasks.workunit.client.0.smithi097.stderr: -211> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c821a0) adding con mode: crc 2024-09-14T11:07:56.526 INFO:tasks.workunit.client.0.smithi097.stderr: -210> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c821a0) adding con mode: secure 2024-09-14T11:07:56.526 INFO:tasks.workunit.client.0.smithi097.stderr: -209> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c821a0) adding con mode: crc 2024-09-14T11:07:56.526 INFO:tasks.workunit.client.0.smithi097.stderr: -208> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c821a0) adding con mode: secure 2024-09-14T11:07:56.526 INFO:tasks.workunit.client.0.smithi097.stderr: -207> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c821a0) adding con mode: crc 2024-09-14T11:07:56.526 INFO:tasks.workunit.client.0.smithi097.stderr: -206> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c821a0) adding con mode: crc 2024-09-14T11:07:56.526 INFO:tasks.workunit.client.0.smithi097.stderr: -205> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c821a0) adding con mode: secure 2024-09-14T11:07:56.526 INFO:tasks.workunit.client.0.smithi097.stderr: -204> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c821a0) adding con mode: crc 2024-09-14T11:07:56.526 INFO:tasks.workunit.client.0.smithi097.stderr: -203> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c821a0) adding con mode: secure 2024-09-14T11:07:56.526 INFO:tasks.workunit.client.0.smithi097.stderr: -202> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c821a0) adding con mode: crc 2024-09-14T11:07:56.526 INFO:tasks.workunit.client.0.smithi097.stderr: -201> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c821a0) adding con mode: secure 2024-09-14T11:07:56.526 INFO:tasks.workunit.client.0.smithi097.stderr: -200> 2024-09-14T11:07:56.368+0000 7f3f75416800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:07:56.526 INFO:tasks.workunit.client.0.smithi097.stderr: -199> 2024-09-14T11:07:56.368+0000 7f3f75416800 1 librados: starting msgr at 2024-09-14T11:07:56.526 INFO:tasks.workunit.client.0.smithi097.stderr: -198> 2024-09-14T11:07:56.368+0000 7f3f75416800 1 librados: starting objecter 2024-09-14T11:07:56.526 INFO:tasks.workunit.client.0.smithi097.stderr: -197> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 asok(0x56276699a270) register_command objecter_requests cmddesc objecter_requests hook 0x562766c61370 EEXIST 2024-09-14T11:07:56.527 INFO:tasks.workunit.client.0.smithi097.stderr: -196> 2024-09-14T11:07:56.368+0000 7f3f75416800 1 librados: setting wanted keys 2024-09-14T11:07:56.527 INFO:tasks.workunit.client.0.smithi097.stderr: -195> 2024-09-14T11:07:56.368+0000 7f3f75416800 1 librados: calling monclient init 2024-09-14T11:07:56.527 INFO:tasks.workunit.client.0.smithi097.stderr: -194> 2024-09-14T11:07:56.368+0000 7f3f75416800 10 monclient: init 2024-09-14T11:07:56.527 INFO:tasks.workunit.client.0.smithi097.stderr: -193> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c50350) adding auth protocol: cephx 2024-09-14T11:07:56.527 INFO:tasks.workunit.client.0.smithi097.stderr: -192> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c50350) adding auth protocol: cephx 2024-09-14T11:07:56.527 INFO:tasks.workunit.client.0.smithi097.stderr: -191> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c50350) adding auth protocol: cephx 2024-09-14T11:07:56.527 INFO:tasks.workunit.client.0.smithi097.stderr: -190> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c50350) adding con mode: secure 2024-09-14T11:07:56.527 INFO:tasks.workunit.client.0.smithi097.stderr: -189> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c50350) adding con mode: crc 2024-09-14T11:07:56.527 INFO:tasks.workunit.client.0.smithi097.stderr: -188> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c50350) adding con mode: secure 2024-09-14T11:07:56.527 INFO:tasks.workunit.client.0.smithi097.stderr: -187> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c50350) adding con mode: crc 2024-09-14T11:07:56.527 INFO:tasks.workunit.client.0.smithi097.stderr: -186> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c50350) adding con mode: secure 2024-09-14T11:07:56.528 INFO:tasks.workunit.client.0.smithi097.stderr: -185> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c50350) adding con mode: crc 2024-09-14T11:07:56.528 INFO:tasks.workunit.client.0.smithi097.stderr: -184> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c50350) adding con mode: crc 2024-09-14T11:07:56.528 INFO:tasks.workunit.client.0.smithi097.stderr: -183> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c50350) adding con mode: secure 2024-09-14T11:07:56.528 INFO:tasks.workunit.client.0.smithi097.stderr: -182> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c50350) adding con mode: crc 2024-09-14T11:07:56.528 INFO:tasks.workunit.client.0.smithi097.stderr: -181> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c50350) adding con mode: secure 2024-09-14T11:07:56.528 INFO:tasks.workunit.client.0.smithi097.stderr: -180> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c50350) adding con mode: crc 2024-09-14T11:07:56.528 INFO:tasks.workunit.client.0.smithi097.stderr: -179> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 AuthRegistry(0x562766c50350) adding con mode: secure 2024-09-14T11:07:56.528 INFO:tasks.workunit.client.0.smithi097.stderr: -178> 2024-09-14T11:07:56.368+0000 7f3f75416800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:07:56.528 INFO:tasks.workunit.client.0.smithi097.stderr: -177> 2024-09-14T11:07:56.368+0000 7f3f75416800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:07:56.529 INFO:tasks.workunit.client.0.smithi097.stderr: -176> 2024-09-14T11:07:56.368+0000 7f3f75416800 5 asok(0x56276699a270) register_command rotate-key cmddesc rotate-key hook 0x562766c50498 EEXIST 2024-09-14T11:07:56.529 INFO:tasks.workunit.client.0.smithi097.stderr: -175> 2024-09-14T11:07:56.368+0000 7f3f75416800 10 monclient: _reopen_session rank -1 2024-09-14T11:07:56.529 INFO:tasks.workunit.client.0.smithi097.stderr: -174> 2024-09-14T11:07:56.368+0000 7f3f75416800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:07:56.529 INFO:tasks.workunit.client.0.smithi097.stderr: -173> 2024-09-14T11:07:56.368+0000 7f3f75416800 10 monclient(hunting): picked mon.noname-b con 0x562766c60f50 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:07:56.529 INFO:tasks.workunit.client.0.smithi097.stderr: -172> 2024-09-14T11:07:56.368+0000 7f3f75416800 10 monclient(hunting): picked mon.noname-a con 0x562766c8b8a0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:07:56.529 INFO:tasks.workunit.client.0.smithi097.stderr: -171> 2024-09-14T11:07:56.369+0000 7f3f75416800 10 monclient(hunting): picked mon.noname-c con 0x562766c90000 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:07:56.529 INFO:tasks.workunit.client.0.smithi097.stderr: -170> 2024-09-14T11:07:56.369+0000 7f3f75416800 10 monclient(hunting): start opening mon connection 2024-09-14T11:07:56.529 INFO:tasks.workunit.client.0.smithi097.stderr: -169> 2024-09-14T11:07:56.369+0000 7f3f75416800 10 monclient(hunting): start opening mon connection 2024-09-14T11:07:56.529 INFO:tasks.workunit.client.0.smithi097.stderr: -168> 2024-09-14T11:07:56.369+0000 7f3f75416800 10 monclient(hunting): start opening mon connection 2024-09-14T11:07:56.529 INFO:tasks.workunit.client.0.smithi097.stderr: -167> 2024-09-14T11:07:56.369+0000 7f3f75416800 10 monclient(hunting): _renew_subs 2024-09-14T11:07:56.529 INFO:tasks.workunit.client.0.smithi097.stderr: -166> 2024-09-14T11:07:56.369+0000 7f3f75416800 10 monclient(hunting): authenticate will time out at 2158.022023s 2024-09-14T11:07:56.529 INFO:tasks.workunit.client.0.smithi097.stderr: -165> 2024-09-14T11:07:56.369+0000 7f3f713e8640 10 monclient(hunting): get_auth_request con 0x562766c8b8a0 auth_method 0 2024-09-14T11:07:56.530 INFO:tasks.workunit.client.0.smithi097.stderr: -164> 2024-09-14T11:07:56.369+0000 7f3f713e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:07:56.530 INFO:tasks.workunit.client.0.smithi097.stderr: -163> 2024-09-14T11:07:56.369+0000 7f3f713e8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:07:56.530 INFO:tasks.workunit.client.0.smithi097.stderr: -162> 2024-09-14T11:07:56.369+0000 7f3f713e8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:07:56.530 INFO:tasks.workunit.client.0.smithi097.stderr: -161> 2024-09-14T11:07:56.369+0000 7f3f70be7640 10 monclient(hunting): get_auth_request con 0x562766c90000 auth_method 0 2024-09-14T11:07:56.530 INFO:tasks.workunit.client.0.smithi097.stderr: -160> 2024-09-14T11:07:56.369+0000 7f3f70be7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:07:56.530 INFO:tasks.workunit.client.0.smithi097.stderr: -159> 2024-09-14T11:07:56.369+0000 7f3f70be7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:07:56.530 INFO:tasks.workunit.client.0.smithi097.stderr: -158> 2024-09-14T11:07:56.369+0000 7f3f70be7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:07:56.530 INFO:tasks.workunit.client.0.smithi097.stderr: -157> 2024-09-14T11:07:56.369+0000 7f3f713e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:07:56.530 INFO:tasks.workunit.client.0.smithi097.stderr: -156> 2024-09-14T11:07:56.369+0000 7f3f713e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:07:56.530 INFO:tasks.workunit.client.0.smithi097.stderr: -155> 2024-09-14T11:07:56.369+0000 7f3f713e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:07:56.530 INFO:tasks.workunit.client.0.smithi097.stderr: -154> 2024-09-14T11:07:56.369+0000 7f3f70be7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:07:56.530 INFO:tasks.workunit.client.0.smithi097.stderr: -153> 2024-09-14T11:07:56.369+0000 7f3f70be7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:07:56.530 INFO:tasks.workunit.client.0.smithi097.stderr: -152> 2024-09-14T11:07:56.369+0000 7f3f70be7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:07:56.531 INFO:tasks.workunit.client.0.smithi097.stderr: -151> 2024-09-14T11:07:56.369+0000 7f3f703e6640 10 monclient(hunting): get_auth_request con 0x562766c60f50 auth_method 0 2024-09-14T11:07:56.531 INFO:tasks.workunit.client.0.smithi097.stderr: -150> 2024-09-14T11:07:56.369+0000 7f3f703e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:07:56.531 INFO:tasks.workunit.client.0.smithi097.stderr: -149> 2024-09-14T11:07:56.369+0000 7f3f703e6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:07:56.531 INFO:tasks.workunit.client.0.smithi097.stderr: -148> 2024-09-14T11:07:56.369+0000 7f3f703e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:07:56.531 INFO:tasks.workunit.client.0.smithi097.stderr: -147> 2024-09-14T11:07:56.369+0000 7f3f713e8640 10 monclient(hunting): handle_auth_done global_id 8292 payload 824 2024-09-14T11:07:56.531 INFO:tasks.workunit.client.0.smithi097.stderr: -146> 2024-09-14T11:07:56.369+0000 7f3f713e8640 10 monclient: _finish_hunting 0 2024-09-14T11:07:56.531 INFO:tasks.workunit.client.0.smithi097.stderr: -145> 2024-09-14T11:07:56.369+0000 7f3f713e8640 1 monclient: found mon.noname-a 2024-09-14T11:07:56.531 INFO:tasks.workunit.client.0.smithi097.stderr: -144> 2024-09-14T11:07:56.369+0000 7f3f713e8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-14T11:07:56.531 INFO:tasks.workunit.client.0.smithi097.stderr: -143> 2024-09-14T11:07:56.369+0000 7f3e467fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:07:56.531 INFO:tasks.workunit.client.0.smithi097.stderr: -142> 2024-09-14T11:07:56.369+0000 7f3e467fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:07:56.531 INFO:tasks.workunit.client.0.smithi097.stderr: -141> 2024-09-14T11:07:56.369+0000 7f3e467fc640 10 monclient: dump: 2024-09-14T11:07:56.531 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:07:56.531 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:07:56.531 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:56.532 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:56.532 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:07:56.532 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:07:56.532 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:07:56.532 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:07:56.532 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:07:56.532 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:56.532 INFO:tasks.workunit.client.0.smithi097.stderr: -140> 2024-09-14T11:07:56.369+0000 7f3e467fc640 10 monclient: _finish_auth 0 2024-09-14T11:07:56.532 INFO:tasks.workunit.client.0.smithi097.stderr: -139> 2024-09-14T11:07:56.369+0000 7f3e467fc640 10 monclient: _check_auth_tickets 2024-09-14T11:07:56.532 INFO:tasks.workunit.client.0.smithi097.stderr: -138> 2024-09-14T11:07:56.369+0000 7f3e467fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:07:56.532 INFO:tasks.workunit.client.0.smithi097.stderr: -137> 2024-09-14T11:07:56.369+0000 7f3e467fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:07:56.532 INFO:tasks.workunit.client.0.smithi097.stderr: -136> 2024-09-14T11:07:56.369+0000 7f3e467fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:07:56.532 INFO:tasks.workunit.client.0.smithi097.stderr: -135> 2024-09-14T11:07:56.369+0000 7f3e467fc640 10 monclient: dump: 2024-09-14T11:07:56.533 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:07:56.533 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:07:56.533 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:56.533 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:07:56.533 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:07:56.533 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:07:56.533 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:07:56.533 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:07:56.533 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:07:56.533 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:56.533 INFO:tasks.workunit.client.0.smithi097.stderr: -134> 2024-09-14T11:07:56.369+0000 7f3f75416800 5 monclient: authenticate success, global_id 8292 2024-09-14T11:07:56.533 INFO:tasks.workunit.client.0.smithi097.stderr: -133> 2024-09-14T11:07:56.369+0000 7f3f75416800 10 monclient: _renew_subs 2024-09-14T11:07:56.534 INFO:tasks.workunit.client.0.smithi097.stderr: -132> 2024-09-14T11:07:56.369+0000 7f3e47fff640 4 set_mon_vals no callback set 2024-09-14T11:07:56.534 INFO:tasks.workunit.client.0.smithi097.stderr: -131> 2024-09-14T11:07:56.369+0000 7f3f75416800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:07:56.534 INFO:tasks.workunit.client.0.smithi097.stderr: -130> 2024-09-14T11:07:56.369+0000 7f3f75416800 10 monclient: _renew_subs 2024-09-14T11:07:56.534 INFO:tasks.workunit.client.0.smithi097.stderr: -129> 2024-09-14T11:07:56.369+0000 7f3f75416800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:07:56.534 INFO:tasks.workunit.client.0.smithi097.stderr: -128> 2024-09-14T11:07:56.369+0000 7f3f75416800 1 librados: init done 2024-09-14T11:07:56.534 INFO:tasks.workunit.client.0.smithi097.stderr: -127> 2024-09-14T11:07:56.369+0000 7f3f75416800 5 asok(0x56276699a270) register_command cr dump hook 0x562766c86c18 2024-09-14T11:07:56.534 INFO:tasks.workunit.client.0.smithi097.stderr: -126> 2024-09-14T11:07:56.371+0000 7f3f75416800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.534 INFO:tasks.workunit.client.0.smithi097.stderr: -125> 2024-09-14T11:07:56.371+0000 7f3e467fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:07:56.534 INFO:tasks.workunit.client.0.smithi097.stderr: -124> 2024-09-14T11:07:56.371+0000 7f3e467fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:07:56.534 INFO:tasks.workunit.client.0.smithi097.stderr: -123> 2024-09-14T11:07:56.371+0000 7f3e467fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:07:56.534 INFO:tasks.workunit.client.0.smithi097.stderr: -122> 2024-09-14T11:07:56.371+0000 7f3f703e6640 10 monclient: get_auth_request con 0x7f3e3c077230 auth_method 0 2024-09-14T11:07:56.535 INFO:tasks.workunit.client.0.smithi097.stderr: -121> 2024-09-14T11:07:56.372+0000 7f3f70be7640 10 monclient: get_auth_request con 0x562766ca9c60 auth_method 0 2024-09-14T11:07:56.535 INFO:tasks.workunit.client.0.smithi097.stderr: -120> 2024-09-14T11:07:56.372+0000 7f3f75416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:56.535 INFO:tasks.workunit.client.0.smithi097.stderr: -119> 2024-09-14T11:07:56.372+0000 7f3f75416800 20 realm 2024-09-14T11:07:56.535 INFO:tasks.workunit.client.0.smithi097.stderr: -118> 2024-09-14T11:07:56.372+0000 7f3f75416800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.535 INFO:tasks.workunit.client.0.smithi097.stderr: -117> 2024-09-14T11:07:56.372+0000 7f3f75416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:56.535 INFO:tasks.workunit.client.0.smithi097.stderr: -116> 2024-09-14T11:07:56.372+0000 7f3f75416800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:07:56.535 INFO:tasks.workunit.client.0.smithi097.stderr: -115> 2024-09-14T11:07:56.372+0000 7f3f75416800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.535 INFO:tasks.workunit.client.0.smithi097.stderr: -114> 2024-09-14T11:07:56.372+0000 7f3f75416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:56.535 INFO:tasks.workunit.client.0.smithi097.stderr: -113> 2024-09-14T11:07:56.373+0000 7f3f75416800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.535 INFO:tasks.workunit.client.0.smithi097.stderr: -112> 2024-09-14T11:07:56.373+0000 7f3f703e6640 10 monclient: get_auth_request con 0x562766cadff0 auth_method 0 2024-09-14T11:07:56.535 INFO:tasks.workunit.client.0.smithi097.stderr: -111> 2024-09-14T11:07:56.373+0000 7f3f75416800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:07:56.536 INFO:tasks.workunit.client.0.smithi097.stderr: -110> 2024-09-14T11:07:56.373+0000 7f3f75416800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.536 INFO:tasks.workunit.client.0.smithi097.stderr: -109> 2024-09-14T11:07:56.373+0000 7f3f713e8640 10 monclient: get_auth_request con 0x562766cb16f0 auth_method 0 2024-09-14T11:07:56.536 INFO:tasks.workunit.client.0.smithi097.stderr: -108> 2024-09-14T11:07:56.374+0000 7f3f75416800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:07:56.536 INFO:tasks.workunit.client.0.smithi097.stderr: -107> 2024-09-14T11:07:56.374+0000 7f3f75416800 20 searching for the correct realm 2024-09-14T11:07:56.536 INFO:tasks.workunit.client.0.smithi097.stderr: -106> 2024-09-14T11:07:56.374+0000 7f3f70be7640 10 monclient: get_auth_request con 0x562766cb6470 auth_method 0 2024-09-14T11:07:56.536 INFO:tasks.workunit.client.0.smithi097.stderr: -105> 2024-09-14T11:07:56.375+0000 7f3f703e6640 10 monclient: get_auth_request con 0x7f3f6001e070 auth_method 0 2024-09-14T11:07:56.536 INFO:tasks.workunit.client.0.smithi097.stderr: -104> 2024-09-14T11:07:56.375+0000 7f3f70be7640 0 -- 172.21.15.97:0/3596470943 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x562766ca9c60 msgr2=0x562766cac100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:07:56.536 INFO:tasks.workunit.client.0.smithi097.stderr: -103> 2024-09-14T11:07:56.375+0000 7f3e467fc640 1 client.8292.objecter ms_handle_reset 0x562766ca9c60 session 0x562766ca95e0 osd.6 2024-09-14T11:07:56.536 INFO:tasks.workunit.client.0.smithi097.stderr: -102> 2024-09-14T11:07:56.375+0000 7f3e467fc640 10 monclient: _renew_subs 2024-09-14T11:07:56.536 INFO:tasks.workunit.client.0.smithi097.stderr: -101> 2024-09-14T11:07:56.375+0000 7f3e467fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:07:56.536 INFO:tasks.workunit.client.0.smithi097.stderr: -100> 2024-09-14T11:07:56.376+0000 7f3f70be7640 10 monclient: get_auth_request con 0x7f3e3c086d50 auth_method 0 2024-09-14T11:07:56.536 INFO:tasks.workunit.client.0.smithi097.stderr: -99> 2024-09-14T11:07:56.376+0000 7f3f713e8640 10 monclient: get_auth_request con 0x7f3f5806bb50 auth_method 0 2024-09-14T11:07:56.536 INFO:tasks.workunit.client.0.smithi097.stderr: -98> 2024-09-14T11:07:56.379+0000 7f3f70be7640 10 monclient: get_auth_request con 0x7f3f58088b20 auth_method 0 2024-09-14T11:07:56.536 INFO:tasks.workunit.client.0.smithi097.stderr: -97> 2024-09-14T11:07:56.379+0000 7f3f70be7640 0 -- 172.21.15.97:0/3596470943 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7f3f58088b20 msgr2=0x7f3f58064990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:07:56.537 INFO:tasks.workunit.client.0.smithi097.stderr: -96> 2024-09-14T11:07:56.379+0000 7f3e467fc640 1 client.8292.objecter ms_handle_reset 0x7f3f58088b20 session 0x7f3f5807c070 osd.7 2024-09-14T11:07:56.537 INFO:tasks.workunit.client.0.smithi097.stderr: -95> 2024-09-14T11:07:56.379+0000 7f3f70be7640 10 monclient: get_auth_request con 0x562766ca9c60 auth_method 0 2024-09-14T11:07:56.537 INFO:tasks.workunit.client.0.smithi097.stderr: -94> 2024-09-14T11:07:56.380+0000 7f3f703e6640 10 monclient: get_auth_request con 0x7f3f60037920 auth_method 0 2024-09-14T11:07:56.537 INFO:tasks.workunit.client.0.smithi097.stderr: -93> 2024-09-14T11:07:56.384+0000 7f3f75416800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:07:56.537 INFO:tasks.workunit.client.0.smithi097.stderr: -92> 2024-09-14T11:07:56.384+0000 7f3f75416800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:07:56.537 INFO:tasks.workunit.client.0.smithi097.stderr: -91> 2024-09-14T11:07:56.384+0000 7f3f75416800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:07:56.537 INFO:tasks.workunit.client.0.smithi097.stderr: -90> 2024-09-14T11:07:56.384+0000 7f3f75416800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:07:56.537 INFO:tasks.workunit.client.0.smithi097.stderr: -89> 2024-09-14T11:07:56.384+0000 7f3f75416800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:07:56.537 INFO:tasks.workunit.client.0.smithi097.stderr: -88> 2024-09-14T11:07:56.384+0000 7f3f75416800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:07:56.537 INFO:tasks.workunit.client.0.smithi097.stderr: -87> 2024-09-14T11:07:56.384+0000 7f3f75416800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.537 INFO:tasks.workunit.client.0.smithi097.stderr: -86> 2024-09-14T11:07:56.385+0000 7f3f75416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:56.537 INFO:tasks.workunit.client.0.smithi097.stderr: -85> 2024-09-14T11:07:56.385+0000 7f3f75416800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.537 INFO:tasks.workunit.client.0.smithi097.stderr: -84> 2024-09-14T11:07:56.385+0000 7f3f75416800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:07:56.538 INFO:tasks.workunit.client.0.smithi097.stderr: -83> 2024-09-14T11:07:56.385+0000 7f3f75416800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.538 INFO:tasks.workunit.client.0.smithi097.stderr: -82> 2024-09-14T11:07:56.385+0000 7f3f75416800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:07:56.538 INFO:tasks.workunit.client.0.smithi097.stderr: -81> 2024-09-14T11:07:56.385+0000 7f3f75416800 20 zone default found 2024-09-14T11:07:56.538 INFO:tasks.workunit.client.0.smithi097.stderr: -80> 2024-09-14T11:07:56.385+0000 7f3f75416800 4 Realm: () 2024-09-14T11:07:56.538 INFO:tasks.workunit.client.0.smithi097.stderr: -79> 2024-09-14T11:07:56.385+0000 7f3f75416800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:07:56.538 INFO:tasks.workunit.client.0.smithi097.stderr: -78> 2024-09-14T11:07:56.385+0000 7f3f75416800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:07:56.538 INFO:tasks.workunit.client.0.smithi097.stderr: -77> 2024-09-14T11:07:56.385+0000 7f3f75416800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:07:56.538 INFO:tasks.workunit.client.0.smithi097.stderr: -76> 2024-09-14T11:07:56.385+0000 7f3f75416800 20 zonegroup default 2024-09-14T11:07:56.538 INFO:tasks.workunit.client.0.smithi097.stderr: -75> 2024-09-14T11:07:56.385+0000 7f3f75416800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.538 INFO:tasks.workunit.client.0.smithi097.stderr: -74> 2024-09-14T11:07:56.385+0000 7f3f75416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:56.538 INFO:tasks.workunit.client.0.smithi097.stderr: -73> 2024-09-14T11:07:56.385+0000 7f3f75416800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.538 INFO:tasks.workunit.client.0.smithi097.stderr: -72> 2024-09-14T11:07:56.386+0000 7f3f75416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:56.538 INFO:tasks.workunit.client.0.smithi097.stderr: -71> 2024-09-14T11:07:56.386+0000 7f3f75416800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.538 INFO:tasks.workunit.client.0.smithi097.stderr: -70> 2024-09-14T11:07:56.386+0000 7f3f75416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:56.539 INFO:tasks.workunit.client.0.smithi097.stderr: -69> 2024-09-14T11:07:56.386+0000 7f3f75416800 20 started sync module instance, tier type = 2024-09-14T11:07:56.539 INFO:tasks.workunit.client.0.smithi097.stderr: -68> 2024-09-14T11:07:56.386+0000 7f3f75416800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:07:56.539 INFO:tasks.workunit.client.0.smithi097.stderr: -67> 2024-09-14T11:07:56.394+0000 7f3f75416800 20 add_watcher() i=0 2024-09-14T11:07:56.539 INFO:tasks.workunit.client.0.smithi097.stderr: -66> 2024-09-14T11:07:56.394+0000 7f3f75416800 20 add_watcher() i=1 2024-09-14T11:07:56.539 INFO:tasks.workunit.client.0.smithi097.stderr: -65> 2024-09-14T11:07:56.394+0000 7f3f75416800 20 add_watcher() i=2 2024-09-14T11:07:56.539 INFO:tasks.workunit.client.0.smithi097.stderr: -64> 2024-09-14T11:07:56.394+0000 7f3f75416800 20 add_watcher() i=3 2024-09-14T11:07:56.539 INFO:tasks.workunit.client.0.smithi097.stderr: -63> 2024-09-14T11:07:56.394+0000 7f3f75416800 20 add_watcher() i=4 2024-09-14T11:07:56.539 INFO:tasks.workunit.client.0.smithi097.stderr: -62> 2024-09-14T11:07:56.394+0000 7f3f75416800 20 add_watcher() i=5 2024-09-14T11:07:56.539 INFO:tasks.workunit.client.0.smithi097.stderr: -61> 2024-09-14T11:07:56.394+0000 7f3f75416800 20 add_watcher() i=6 2024-09-14T11:07:56.539 INFO:tasks.workunit.client.0.smithi097.stderr: -60> 2024-09-14T11:07:56.395+0000 7f3f75416800 20 add_watcher() i=7 2024-09-14T11:07:56.539 INFO:tasks.workunit.client.0.smithi097.stderr: -59> 2024-09-14T11:07:56.395+0000 7f3f75416800 2 all 8 watchers are set, enabling cache 2024-09-14T11:07:56.539 INFO:tasks.workunit.client.0.smithi097.stderr: -58> 2024-09-14T11:07:56.397+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e9390) adding auth protocol: cephx 2024-09-14T11:07:56.539 INFO:tasks.workunit.client.0.smithi097.stderr: -57> 2024-09-14T11:07:56.397+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e9390) adding auth protocol: cephx 2024-09-14T11:07:56.540 INFO:tasks.workunit.client.0.smithi097.stderr: -56> 2024-09-14T11:07:56.397+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e9390) adding auth protocol: cephx 2024-09-14T11:07:56.540 INFO:tasks.workunit.client.0.smithi097.stderr: -55> 2024-09-14T11:07:56.397+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e9390) adding con mode: secure 2024-09-14T11:07:56.540 INFO:tasks.workunit.client.0.smithi097.stderr: -54> 2024-09-14T11:07:56.397+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e9390) adding con mode: crc 2024-09-14T11:07:56.540 INFO:tasks.workunit.client.0.smithi097.stderr: -53> 2024-09-14T11:07:56.397+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e9390) adding con mode: secure 2024-09-14T11:07:56.540 INFO:tasks.workunit.client.0.smithi097.stderr: -52> 2024-09-14T11:07:56.397+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e9390) adding con mode: crc 2024-09-14T11:07:56.540 INFO:tasks.workunit.client.0.smithi097.stderr: -51> 2024-09-14T11:07:56.397+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e9390) adding con mode: secure 2024-09-14T11:07:56.540 INFO:tasks.workunit.client.0.smithi097.stderr: -50> 2024-09-14T11:07:56.397+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e9390) adding con mode: crc 2024-09-14T11:07:56.540 INFO:tasks.workunit.client.0.smithi097.stderr: -49> 2024-09-14T11:07:56.397+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e9390) adding con mode: crc 2024-09-14T11:07:56.540 INFO:tasks.workunit.client.0.smithi097.stderr: -48> 2024-09-14T11:07:56.397+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e9390) adding con mode: secure 2024-09-14T11:07:56.540 INFO:tasks.workunit.client.0.smithi097.stderr: -47> 2024-09-14T11:07:56.397+0000 7f3e26fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:07:56.540 INFO:tasks.workunit.client.0.smithi097.stderr: -46> 2024-09-14T11:07:56.397+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e9390) adding con mode: crc 2024-09-14T11:07:56.540 INFO:tasks.workunit.client.0.smithi097.stderr: -45> 2024-09-14T11:07:56.397+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e9390) adding con mode: secure 2024-09-14T11:07:56.540 INFO:tasks.workunit.client.0.smithi097.stderr: -44> 2024-09-14T11:07:56.397+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e9390) adding con mode: crc 2024-09-14T11:07:56.540 INFO:tasks.workunit.client.0.smithi097.stderr: -43> 2024-09-14T11:07:56.397+0000 7f3f75416800 5 AuthRegistry(0x7ffe528e9390) adding con mode: secure 2024-09-14T11:07:56.541 INFO:tasks.workunit.client.0.smithi097.stderr: -42> 2024-09-14T11:07:56.397+0000 7f3f75416800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:07:56.541 INFO:tasks.workunit.client.0.smithi097.stderr: -41> 2024-09-14T11:07:56.397+0000 7f3f75416800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:07:56.541 INFO:tasks.workunit.client.0.smithi097.stderr: -40> 2024-09-14T11:07:56.397+0000 7f3f75416800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:07:56.541 INFO:tasks.workunit.client.0.smithi097.stderr: -39> 2024-09-14T11:07:56.397+0000 7f3f75416800 5 asok(0x56276699a270) register_command cache list hook 0x562766c86850 2024-09-14T11:07:56.541 INFO:tasks.workunit.client.0.smithi097.stderr: -38> 2024-09-14T11:07:56.397+0000 7f3f75416800 5 asok(0x56276699a270) register_command cache inspect hook 0x562766c86850 2024-09-14T11:07:56.541 INFO:tasks.workunit.client.0.smithi097.stderr: -37> 2024-09-14T11:07:56.397+0000 7f3f75416800 5 asok(0x56276699a270) register_command cache erase hook 0x562766c86850 2024-09-14T11:07:56.541 INFO:tasks.workunit.client.0.smithi097.stderr: -36> 2024-09-14T11:07:56.397+0000 7f3f75416800 5 asok(0x56276699a270) register_command cache zap hook 0x562766c86850 2024-09-14T11:07:56.541 INFO:tasks.workunit.client.0.smithi097.stderr: -35> 2024-09-14T11:07:56.397+0000 7f3f75416800 5 note: GC not initialized 2024-09-14T11:07:56.541 INFO:tasks.workunit.client.0.smithi097.stderr: -34> 2024-09-14T11:07:56.398+0000 7f3e25fe3640 20 reqs_thread_entry: start 2024-09-14T11:07:56.541 INFO:tasks.workunit.client.0.smithi097.stderr: -33> 2024-09-14T11:07:56.398+0000 7f3f75416800 5 asok(0x56276699a270) register_command sync trace show hook 0x7f3f5c001d30 2024-09-14T11:07:56.541 INFO:tasks.workunit.client.0.smithi097.stderr: -32> 2024-09-14T11:07:56.398+0000 7f3f75416800 5 asok(0x56276699a270) register_command sync trace history hook 0x7f3f5c001d30 2024-09-14T11:07:56.542 INFO:tasks.workunit.client.0.smithi097.stderr: -31> 2024-09-14T11:07:56.398+0000 7f3f75416800 5 asok(0x56276699a270) register_command sync trace active hook 0x7f3f5c001d30 2024-09-14T11:07:56.542 INFO:tasks.workunit.client.0.smithi097.stderr: -30> 2024-09-14T11:07:56.398+0000 7f3f75416800 5 asok(0x56276699a270) register_command sync trace active_short hook 0x7f3f5c001d30 2024-09-14T11:07:56.542 INFO:tasks.workunit.client.0.smithi097.stderr: -29> 2024-09-14T11:07:56.398+0000 7f3f75416800 20 init_complete bucket index max shards: 11 2024-09-14T11:07:56.542 INFO:tasks.workunit.client.0.smithi097.stderr: -28> 2024-09-14T11:07:56.398+0000 7f3f75416800 20 Filter name: none 2024-09-14T11:07:56.542 INFO:tasks.workunit.client.0.smithi097.stderr: -27> 2024-09-14T11:07:56.398+0000 7f3d977fe640 20 reqs_thread_entry: start 2024-09-14T11:07:56.542 INFO:tasks.workunit.client.0.smithi097.stderr: -26> 2024-09-14T11:07:56.398+0000 7f3f75416800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:07:56.542 INFO:tasks.workunit.client.0.smithi097.stderr: -25> 2024-09-14T11:07:56.398+0000 7f3f75416800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.542 INFO:tasks.workunit.client.0.smithi097.stderr: -24> 2024-09-14T11:07:56.398+0000 7f3f75416800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:07:56.542 INFO:tasks.workunit.client.0.smithi097.stderr: -23> 2024-09-14T11:07:56.398+0000 7f3f75416800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:07:56.542 INFO:tasks.workunit.client.0.smithi097.stderr: -22> 2024-09-14T11:07:56.398+0000 7f3f75416800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:07:56.542 INFO:tasks.workunit.client.0.smithi097.stderr: -21> 2024-09-14T11:07:56.398+0000 7f3f75416800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 : miss 2024-09-14T11:07:56.542 INFO:tasks.workunit.client.0.smithi097.stderr: -20> 2024-09-14T11:07:56.398+0000 7f3f75416800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.543 INFO:tasks.workunit.client.0.smithi097.stderr: -19> 2024-09-14T11:07:56.399+0000 7f3f75416800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:07:56.543 INFO:tasks.workunit.client.0.smithi097.stderr: -18> 2024-09-14T11:07:56.399+0000 7f3f75416800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:07:56.543 INFO:tasks.workunit.client.0.smithi097.stderr: -17> 2024-09-14T11:07:56.399+0000 7f3f75416800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:07:56.543 INFO:tasks.workunit.client.0.smithi097.stderr: -16> 2024-09-14T11:07:56.399+0000 7f3f75416800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:07:56.543 INFO:tasks.workunit.client.0.smithi097.stderr: -15> 2024-09-14T11:07:56.399+0000 7f3f75416800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:07:56.543 INFO:tasks.workunit.client.0.smithi097.stderr: -14> 2024-09-14T11:07:56.399+0000 7f3f75416800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 2024-09-14T11:07:56.543 INFO:tasks.workunit.client.0.smithi097.stderr: -13> 2024-09-14T11:07:56.405+0000 7f3f75416800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:07:56.543 INFO:tasks.workunit.client.0.smithi097.stderr: -12> 2024-09-14T11:07:56.405+0000 7f3f75416800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:07:56.543 INFO:tasks.workunit.client.0.smithi097.stderr: -11> 2024-09-14T11:07:56.405+0000 7f3f75416800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:07:56.543 INFO:tasks.workunit.client.0.smithi097.stderr: -10> 2024-09-14T11:07:56.405+0000 7f3f75416800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17, ofs0, ns] 2024-09-14T11:07:56.543 INFO:tasks.workunit.client.0.smithi097.stderr: -9> 2024-09-14T11:07:56.405+0000 7f3e47fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595245 cookie 94727228340976 notifier 8292 bl.length()=827 2024-09-14T11:07:56.543 INFO:tasks.workunit.client.0.smithi097.stderr: -8> 2024-09-14T11:07:56.405+0000 7f3e47fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:07:56.543 INFO:tasks.workunit.client.0.smithi097.stderr: -7> 2024-09-14T11:07:56.405+0000 7f3e47fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:07:56.543 INFO:tasks.workunit.client.0.smithi097.stderr: -6> 2024-09-14T11:07:56.405+0000 7f3e47fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:07:56.544 INFO:tasks.workunit.client.0.smithi097.stderr: -5> 2024-09-14T11:07:56.405+0000 7f3f75416800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): orig_sources= new_sources= 2024-09-14T11:07:56.544 INFO:tasks.workunit.client.0.smithi097.stderr: -4> 2024-09-14T11:07:56.405+0000 7f3f75416800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): potential sources added=[] removed=[] 2024-09-14T11:07:56.544 INFO:tasks.workunit.client.0.smithi097.stderr: -3> 2024-09-14T11:07:56.405+0000 7f3f75416800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): orig_dests= new_dests= 2024-09-14T11:07:56.544 INFO:tasks.workunit.client.0.smithi097.stderr: -2> 2024-09-14T11:07:56.405+0000 7f3f75416800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): potential dests added=[] removed=[] 2024-09-14T11:07:56.544 INFO:tasks.workunit.client.0.smithi097.stderr: -1> 2024-09-14T11:07:56.413+0000 7f3f75416800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3f75416800 time 2024-09-14T11:07:56.413594+0000 2024-09-14T11:07:56.544 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:07:56.544 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:56.544 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:07:56.544 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3f7658c76a] 2024-09-14T11:07:56.545 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f3f7658c928] 2024-09-14T11:07:56.545 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5627656880b1] 2024-09-14T11:07:56.545 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562765697f6a] 2024-09-14T11:07:56.545 INFO:tasks.workunit.client.0.smithi097.stderr: 5: main() 2024-09-14T11:07:56.545 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f3f75229590] 2024-09-14T11:07:56.545 INFO:tasks.workunit.client.0.smithi097.stderr: 7: __libc_start_main() 2024-09-14T11:07:56.545 INFO:tasks.workunit.client.0.smithi097.stderr: 8: _start() 2024-09-14T11:07:56.545 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:56.545 INFO:tasks.workunit.client.0.smithi097.stderr: 0> 2024-09-14T11:07:56.414+0000 7f3f75416800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:07:56.546 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f3f75416800 thread_name:radosgw-admin 2024-09-14T11:07:56.546 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:56.546 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:07:56.546 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3f7523e6f0] 2024-09-14T11:07:56.546 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3f7528b99c] 2024-09-14T11:07:56.546 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-14T11:07:56.546 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-14T11:07:56.546 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3f7658c7c4] 2024-09-14T11:07:56.546 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f3f7658c928] 2024-09-14T11:07:56.546 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5627656880b1] 2024-09-14T11:07:56.546 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562765697f6a] 2024-09-14T11:07:56.546 INFO:tasks.workunit.client.0.smithi097.stderr: 9: main() 2024-09-14T11:07:56.546 INFO:tasks.workunit.client.0.smithi097.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f3f75229590] 2024-09-14T11:07:56.547 INFO:tasks.workunit.client.0.smithi097.stderr: 11: __libc_start_main() 2024-09-14T11:07:56.547 INFO:tasks.workunit.client.0.smithi097.stderr: 12: _start() 2024-09-14T11:07:56.547 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:07:56.547 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:07:56.547 INFO:tasks.workunit.client.0.smithi097.stderr:--- logging levels --- 2024-09-14T11:07:56.547 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 none 2024-09-14T11:07:56.547 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 lockdep 2024-09-14T11:07:56.547 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 context 2024-09-14T11:07:56.547 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 crush 2024-09-14T11:07:56.547 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds 2024-09-14T11:07:56.547 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_balancer 2024-09-14T11:07:56.547 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_locker 2024-09-14T11:07:56.547 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log 2024-09-14T11:07:56.547 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log_expire 2024-09-14T11:07:56.548 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_migrator 2024-09-14T11:07:56.548 INFO:tasks.workunit.client.0.smithi097.stderr: 3/ 5 mds_quiesce 2024-09-14T11:07:56.548 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 buffer 2024-09-14T11:07:56.548 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 timer 2024-09-14T11:07:56.548 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 filer 2024-09-14T11:07:56.548 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 striper 2024-09-14T11:07:56.548 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 objecter 2024-09-14T11:07:56.548 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rados 2024-09-14T11:07:56.548 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd 2024-09-14T11:07:56.548 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_mirror 2024-09-14T11:07:56.548 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_replay 2024-09-14T11:07:56.548 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_pwl 2024-09-14T11:07:56.548 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 journaler 2024-09-14T11:07:56.548 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objectcacher 2024-09-14T11:07:56.549 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:07:56.549 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 client 2024-09-14T11:07:56.549 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 osd 2024-09-14T11:07:56.549 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 optracker 2024-09-14T11:07:56.549 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objclass 2024-09-14T11:07:56.549 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 filestore 2024-09-14T11:07:56.549 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 journal 2024-09-14T11:07:56.549 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 ms 2024-09-14T11:07:56.549 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mon 2024-09-14T11:07:56.549 INFO:tasks.workunit.client.0.smithi097.stderr: 0/10 monc 2024-09-14T11:07:56.549 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 paxos 2024-09-14T11:07:56.549 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 tp 2024-09-14T11:07:56.549 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 auth 2024-09-14T11:07:56.549 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 crypto 2024-09-14T11:07:56.550 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 finisher 2024-09-14T11:07:56.550 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 reserver 2024-09-14T11:07:56.550 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 heartbeatmap 2024-09-14T11:07:56.550 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 perfcounter 2024-09-14T11:07:56.550 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw 2024-09-14T11:07:56.550 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_sync 2024-09-14T11:07:56.550 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_datacache 2024-09-14T11:07:56.550 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_access 2024-09-14T11:07:56.550 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:07:56.550 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_flight 2024-09-14T11:07:56.550 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:07:56.550 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw_notification 2024-09-14T11:07:56.550 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 javaclient 2024-09-14T11:07:56.550 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 asok 2024-09-14T11:07:56.551 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 throttle 2024-09-14T11:07:56.551 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 refs 2024-09-14T11:07:56.551 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 compressor 2024-09-14T11:07:56.551 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluestore 2024-09-14T11:07:56.551 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluefs 2024-09-14T11:07:56.551 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 bdev 2024-09-14T11:07:56.551 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 kstore 2024-09-14T11:07:56.551 INFO:tasks.workunit.client.0.smithi097.stderr: 4/ 5 rocksdb 2024-09-14T11:07:56.551 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 fuse 2024-09-14T11:07:56.551 INFO:tasks.workunit.client.0.smithi097.stderr: 2/ 5 mgr 2024-09-14T11:07:56.551 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mgrc 2024-09-14T11:07:56.551 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 dpdk 2024-09-14T11:07:56.551 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 eventtrace 2024-09-14T11:07:56.551 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 prioritycache 2024-09-14T11:07:56.552 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 test 2024-09-14T11:07:56.552 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:07:56.552 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephsqlite 2024-09-14T11:07:56.552 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:07:56.552 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore 2024-09-14T11:07:56.552 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_onode 2024-09-14T11:07:56.552 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_odata 2024-09-14T11:07:56.552 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_omap 2024-09-14T11:07:56.552 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_tm 2024-09-14T11:07:56.552 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_t 2024-09-14T11:07:56.552 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:07:56.552 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_epm 2024-09-14T11:07:56.553 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_lba 2024-09-14T11:07:56.553 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:07:56.553 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cache 2024-09-14T11:07:56.553 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_journal 2024-09-14T11:07:56.553 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_device 2024-09-14T11:07:56.553 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_backref 2024-09-14T11:07:56.553 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 alienstore 2024-09-14T11:07:56.553 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mclock 2024-09-14T11:07:56.553 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cyanstore 2024-09-14T11:07:56.553 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 ceph_exporter 2024-09-14T11:07:56.553 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 memstore 2024-09-14T11:07:56.553 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 trace 2024-09-14T11:07:56.553 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 ceph_dedup 2024-09-14T11:07:56.554 INFO:tasks.workunit.client.0.smithi097.stderr: -2/-2 (syslog threshold) 2024-09-14T11:07:56.554 INFO:tasks.workunit.client.0.smithi097.stderr: 99/99 (stderr threshold) 2024-09-14T11:07:56.554 INFO:tasks.workunit.client.0.smithi097.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:07:56.554 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3d977fe640 / http_manager 2024-09-14T11:07:56.554 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3e25fe3640 / http_manager 2024-09-14T11:07:56.554 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3e26fe5640 / rgw_dt_lg_renew 2024-09-14T11:07:56.554 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3e467fc640 / ms_dispatch 2024-09-14T11:07:56.554 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3e47fff640 / io_context_pool 2024-09-14T11:07:56.554 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3e567fc640 / ms_dispatch 2024-09-14T11:07:56.554 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3e5d60a640 / ms_dispatch 2024-09-14T11:07:56.554 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3e5ee0d640 / io_context_pool 2024-09-14T11:07:56.554 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3f703e6640 / msgr-worker-2 2024-09-14T11:07:56.555 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3f70be7640 / msgr-worker-1 2024-09-14T11:07:56.555 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3f713e8640 / msgr-worker-0 2024-09-14T11:07:56.555 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3f71be9640 / io_context_pool 2024-09-14T11:07:56.555 INFO:tasks.workunit.client.0.smithi097.stderr: 7f3f75416800 / radosgw-admin 2024-09-14T11:07:56.555 INFO:tasks.workunit.client.0.smithi097.stderr: max_recent 500 2024-09-14T11:07:56.555 INFO:tasks.workunit.client.0.smithi097.stderr: max_new 1000 2024-09-14T11:07:56.555 INFO:tasks.workunit.client.0.smithi097.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:07:56.414991Z_aeb854c3-4020-43a7-aa8a-22db1d2a4a16/log 2024-09-14T11:07:56.555 INFO:tasks.workunit.client.0.smithi097.stderr:--- end dump of recent events --- 2024-09-14T11:07:56.555 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:07:56.561 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:07:56.561 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:07:56.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.488+0000 7f56a880e800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.561 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.490+0000 7f56a880e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:56.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.490+0000 7f56a880e800 20 realm 2024-09-14T11:07:56.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.490+0000 7f56a880e800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.490+0000 7f56a880e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:56.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.490+0000 7f56a880e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:07:56.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.490+0000 7f56a880e800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.490+0000 7f56a880e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:56.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.490+0000 7f56a880e800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.491+0000 7f56a880e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:07:56.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.491+0000 7f56a880e800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.492+0000 7f56a880e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:07:56.562 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.492+0000 7f56a880e800 20 searching for the correct realm 2024-09-14T11:07:56.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.493+0000 7f56a465a640 0 -- 172.21.15.97:0/391949940 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x55f8490979d0 msgr2=0x55f849099e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:07:56.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.497+0000 7f56a3e59640 0 -- 172.21.15.97:0/391949940 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7f568c028900 msgr2=0x7f568c0433f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:07:56.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.501+0000 7f56a880e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:07:56.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.501+0000 7f56a880e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:07:56.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.501+0000 7f56a880e800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:07:56.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.501+0000 7f56a880e800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:07:56.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.501+0000 7f56a880e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:07:56.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.501+0000 7f56a880e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:07:56.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.501+0000 7f56a880e800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.501+0000 7f56a880e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:56.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.501+0000 7f56a880e800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.502+0000 7f56a880e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:07:56.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.502+0000 7f56a880e800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.563 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.502+0000 7f56a880e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:07:56.564 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.502+0000 7f56a880e800 20 zone default found 2024-09-14T11:07:56.564 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.502+0000 7f56a880e800 4 Realm: () 2024-09-14T11:07:56.564 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.502+0000 7f56a880e800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:07:56.564 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.502+0000 7f56a880e800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:07:56.564 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.502+0000 7f56a880e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:07:56.564 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.502+0000 7f56a880e800 20 zonegroup default 2024-09-14T11:07:56.564 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.502+0000 7f56a880e800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.564 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.502+0000 7f56a880e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:56.564 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.502+0000 7f56a880e800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.564 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.502+0000 7f56a880e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:56.564 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.502+0000 7f56a880e800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.564 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.503+0000 7f56a880e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:56.564 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.503+0000 7f56a880e800 20 started sync module instance, tier type = 2024-09-14T11:07:56.564 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.503+0000 7f56a880e800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:07:56.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.511+0000 7f56a880e800 20 add_watcher() i=0 2024-09-14T11:07:56.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.511+0000 7f56a880e800 20 add_watcher() i=1 2024-09-14T11:07:56.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.511+0000 7f56a880e800 20 add_watcher() i=2 2024-09-14T11:07:56.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.511+0000 7f56a880e800 20 add_watcher() i=3 2024-09-14T11:07:56.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.511+0000 7f56a880e800 20 add_watcher() i=4 2024-09-14T11:07:56.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.511+0000 7f56a880e800 20 add_watcher() i=5 2024-09-14T11:07:56.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.511+0000 7f56a880e800 20 add_watcher() i=6 2024-09-14T11:07:56.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.512+0000 7f56a880e800 20 add_watcher() i=7 2024-09-14T11:07:56.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.512+0000 7f56a880e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:07:56.565 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.513+0000 7f5559fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:07:56.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.514+0000 7f56a880e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:07:56.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.514+0000 7f56a880e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:07:56.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.514+0000 7f56a880e800 5 note: GC not initialized 2024-09-14T11:07:56.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.514+0000 7f5558fe1640 20 reqs_thread_entry: start 2024-09-14T11:07:56.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.514+0000 7f56a880e800 20 init_complete bucket index max shards: 11 2024-09-14T11:07:56.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.514+0000 7f56a880e800 20 Filter name: none 2024-09-14T11:07:56.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.514+0000 7f54d27fc640 20 reqs_thread_entry: start 2024-09-14T11:07:56.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.514+0000 7f56a880e800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.514+0000 7f56a880e800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:07:56.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.514+0000 7f56a880e800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.515+0000 7f56a880e800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:07:56.566 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.515+0000 7f56a880e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:07:56.567 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.515+0000 7f56a880e800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.567 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.516+0000 7f56a880e800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:07:56.567 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.516+0000 7f56a880e800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.567 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.516+0000 7f56a880e800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:07:56.567 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.516+0000 7f56a880e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:07:56.567 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.518+0000 7f5559fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:07:56.567 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.520+0000 7f56a880e800 20 remove_watcher() i=0 2024-09-14T11:07:56.567 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.520+0000 7f56a880e800 2 removed watcher, disabling cache 2024-09-14T11:07:56.567 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.520+0000 7f56a880e800 20 remove_watcher() i=1 2024-09-14T11:07:56.567 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.521+0000 7f56a880e800 20 remove_watcher() i=2 2024-09-14T11:07:56.567 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.522+0000 7f56a880e800 20 remove_watcher() i=3 2024-09-14T11:07:56.567 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.523+0000 7f56a880e800 20 remove_watcher() i=4 2024-09-14T11:07:56.567 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.524+0000 7f56a880e800 20 remove_watcher() i=5 2024-09-14T11:07:56.567 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.525+0000 7f56a880e800 20 remove_watcher() i=6 2024-09-14T11:07:56.567 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.526+0000 7f56a880e800 20 remove_watcher() i=7 2024-09-14T11:07:56.568 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:07:56.573 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:07:56.573 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:07:56.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.611+0000 7f1e22d37800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.613+0000 7f1e22d37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:56.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.613+0000 7f1e22d37800 20 realm 2024-09-14T11:07:56.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.613+0000 7f1e22d37800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.613+0000 7f1e22d37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:56.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.613+0000 7f1e22d37800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:07:56.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.613+0000 7f1e22d37800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.613+0000 7f1e22d37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:56.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.613+0000 7f1e22d37800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.614+0000 7f1e22d37800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:07:56.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.614+0000 7f1e22d37800 20 rados->read ofs=0 len=0 2024-09-14T11:07:56.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.615+0000 7f1e22d37800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:07:56.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.615+0000 7f1e22d37800 20 searching for the correct realm 2024-09-14T11:07:56.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.616+0000 7f1e1f222640 0 -- 172.21.15.97:0/2823468991 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x558ada2566c0 msgr2=0x558ada258b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:07:56.821 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:56.822+0000 7f1e1ea21640 0 -- 172.21.15.97:0/2823468991 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7f1e080168f0 msgr2=0x7f1e0803a440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:07:57.028 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.029+0000 7f1e22d37800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:07:57.028 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.029+0000 7f1e22d37800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:07:57.028 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.029+0000 7f1e22d37800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:07:57.028 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.029+0000 7f1e22d37800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:07:57.028 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.029+0000 7f1e22d37800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:07:57.028 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.029+0000 7f1e22d37800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:07:57.028 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.029+0000 7f1e22d37800 20 rados->read ofs=0 len=0 2024-09-14T11:07:57.028 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.029+0000 7f1e22d37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:57.028 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.029+0000 7f1e22d37800 20 rados->read ofs=0 len=0 2024-09-14T11:07:57.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.029+0000 7f1e22d37800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:07:57.029 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.029+0000 7f1e22d37800 20 rados->read ofs=0 len=0 2024-09-14T11:07:57.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.029+0000 7f1e22d37800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:07:57.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.029+0000 7f1e22d37800 20 zone default found 2024-09-14T11:07:57.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.029+0000 7f1e22d37800 4 Realm: () 2024-09-14T11:07:57.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.029+0000 7f1e22d37800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:07:57.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.030+0000 7f1e22d37800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:07:57.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.030+0000 7f1e22d37800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:07:57.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.030+0000 7f1e22d37800 20 zonegroup default 2024-09-14T11:07:57.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.030+0000 7f1e22d37800 20 rados->read ofs=0 len=0 2024-09-14T11:07:57.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.030+0000 7f1e22d37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:57.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.030+0000 7f1e22d37800 20 rados->read ofs=0 len=0 2024-09-14T11:07:57.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.030+0000 7f1e22d37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:57.030 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.030+0000 7f1e22d37800 20 rados->read ofs=0 len=0 2024-09-14T11:07:57.031 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.030+0000 7f1e22d37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:07:57.031 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.030+0000 7f1e22d37800 20 started sync module instance, tier type = 2024-09-14T11:07:57.031 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.030+0000 7f1e22d37800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:07:57.038 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.040+0000 7f1e22d37800 20 add_watcher() i=0 2024-09-14T11:07:57.038 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.040+0000 7f1e22d37800 20 add_watcher() i=1 2024-09-14T11:07:57.038 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.040+0000 7f1e22d37800 20 add_watcher() i=2 2024-09-14T11:07:57.038 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.040+0000 7f1e22d37800 20 add_watcher() i=3 2024-09-14T11:07:57.039 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.040+0000 7f1e22d37800 20 add_watcher() i=4 2024-09-14T11:07:57.039 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.040+0000 7f1e22d37800 20 add_watcher() i=5 2024-09-14T11:07:57.039 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.040+0000 7f1e22d37800 20 add_watcher() i=6 2024-09-14T11:07:57.039 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.041+0000 7f1e22d37800 20 add_watcher() i=7 2024-09-14T11:07:57.039 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.041+0000 7f1e22d37800 2 all 8 watchers are set, enabling cache 2024-09-14T11:07:57.041 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.042+0000 7f1cd57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:07:57.042 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.043+0000 7f1e22d37800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:07:57.042 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.043+0000 7f1e22d37800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:07:57.042 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.043+0000 7f1e22d37800 5 note: GC not initialized 2024-09-14T11:07:57.043 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.043+0000 7f1c4ffff640 20 reqs_thread_entry: start 2024-09-14T11:07:57.043 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.043+0000 7f1e22d37800 20 init_complete bucket index max shards: 11 2024-09-14T11:07:57.043 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.043+0000 7f1e22d37800 20 Filter name: none 2024-09-14T11:07:57.043 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.043+0000 7f1c4dffb640 20 reqs_thread_entry: start 2024-09-14T11:07:57.043 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.043+0000 7f1e22d37800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:07:57.043 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.043+0000 7f1e22d37800 20 rados->read ofs=0 len=0 2024-09-14T11:07:57.043 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.044+0000 7f1e22d37800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:07:57.043 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.044+0000 7f1e22d37800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:07:57.043 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.044+0000 7f1e22d37800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:07:57.043 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.044+0000 7f1e22d37800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 : miss 2024-09-14T11:07:57.043 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.044+0000 7f1e22d37800 20 rados->read ofs=0 len=0 2024-09-14T11:07:57.045 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.044+0000 7f1e22d37800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:07:57.045 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.044+0000 7f1e22d37800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:07:57.045 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.044+0000 7f1e22d37800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:07:57.045 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.044+0000 7f1e22d37800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:07:57.045 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.044+0000 7f1e22d37800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:07:57.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.044+0000 7f1e22d37800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 2024-09-14T11:07:57.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.044+0000 7f1e22d37800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.0 2024-09-14T11:07:57.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.044+0000 7f1e22d37800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.0 2024-09-14T11:07:57.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.044+0000 7f1e22d37800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.1 2024-09-14T11:07:57.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.044+0000 7f1e22d37800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.1 2024-09-14T11:07:57.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.045+0000 7f1e22d37800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.2 2024-09-14T11:07:57.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.045+0000 7f1e22d37800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.2 2024-09-14T11:07:57.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.045+0000 7f1e22d37800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.3 2024-09-14T11:07:57.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.045+0000 7f1e22d37800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.3 2024-09-14T11:07:57.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.045+0000 7f1e22d37800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.4 2024-09-14T11:07:57.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.045+0000 7f1e22d37800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.4 2024-09-14T11:07:57.046 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.046+0000 7f1e22d37800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.5 2024-09-14T11:07:57.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.046+0000 7f1e22d37800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.5 2024-09-14T11:07:57.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.046+0000 7f1e22d37800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.6 2024-09-14T11:07:57.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.046+0000 7f1e22d37800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.6 2024-09-14T11:07:57.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.046+0000 7f1e22d37800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.7 2024-09-14T11:07:57.047 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.046+0000 7f1e22d37800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.7 2024-09-14T11:07:57.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.047+0000 7f1e22d37800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.8 2024-09-14T11:07:57.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.047+0000 7f1e22d37800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.8 2024-09-14T11:07:57.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.047+0000 7f1e22d37800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.9 2024-09-14T11:07:57.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.047+0000 7f1e22d37800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.9 2024-09-14T11:07:57.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.047+0000 7f1e22d37800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.10 2024-09-14T11:07:57.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.047+0000 7f1e22d37800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.10 2024-09-14T11:07:57.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.048+0000 7f1e22d37800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.11 2024-09-14T11:07:57.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.048+0000 7f1e22d37800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.11 2024-09-14T11:07:57.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.048+0000 7f1e22d37800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.12 2024-09-14T11:07:57.048 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.048+0000 7f1e22d37800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.12 2024-09-14T11:07:57.049 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.049+0000 7f1cd57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:07:57.051 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.052+0000 7f1e22d37800 20 remove_watcher() i=0 2024-09-14T11:07:57.051 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.052+0000 7f1e22d37800 2 removed watcher, disabling cache 2024-09-14T11:07:57.052 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.054+0000 7f1e22d37800 20 remove_watcher() i=1 2024-09-14T11:07:57.053 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.055+0000 7f1e22d37800 20 remove_watcher() i=2 2024-09-14T11:07:57.054 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.056+0000 7f1e22d37800 20 remove_watcher() i=3 2024-09-14T11:07:57.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.057+0000 7f1e22d37800 20 remove_watcher() i=4 2024-09-14T11:07:57.056 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.058+0000 7f1e22d37800 20 remove_watcher() i=5 2024-09-14T11:07:57.057 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.059+0000 7f1e22d37800 20 remove_watcher() i=6 2024-09-14T11:07:57.058 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:07:57.060+0000 7f1e22d37800 20 remove_watcher() i=7 2024-09-14T11:08:27.101 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-14T11:08:27.138 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:08:27.139 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:08:27.181 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.183+0000 7f7348412800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.184 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.184+0000 7f7348412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:27.184 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.184+0000 7f7348412800 20 realm 2024-09-14T11:08:27.184 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.184+0000 7f7348412800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.184 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.185+0000 7f7348412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:27.184 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.185+0000 7f7348412800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:08:27.184 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.185+0000 7f7348412800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.184 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.185+0000 7f7348412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:27.184 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.185+0000 7f7348412800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.185 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.186+0000 7f7348412800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:08:27.185 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.186+0000 7f7348412800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.186 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.187+0000 7f7348412800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:08:27.186 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.187+0000 7f7348412800 20 searching for the correct realm 2024-09-14T11:08:27.186 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.188+0000 7f733b3df640 0 -- 172.21.15.97:0/625851093 >> [v2:172.21.15.97:6808/2081705332,v1:172.21.15.97:6809/2081705332] conn(0x7f733405dc40 msgr2=0x7f73340853d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:08:27.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.394+0000 7f7343be0640 0 -- 172.21.15.97:0/625851093 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7f732c01b040 msgr2=0x7f732c04c410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:08:27.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.604+0000 7f7348412800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:08:27.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.604+0000 7f7348412800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:08:27.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.604+0000 7f7348412800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:08:27.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.604+0000 7f7348412800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:08:27.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.604+0000 7f7348412800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:08:27.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.604+0000 7f7348412800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:08:27.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.604+0000 7f7348412800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.604+0000 7f7348412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:27.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.604+0000 7f7348412800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.604 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.604+0000 7f7348412800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:08:27.604 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.604+0000 7f7348412800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.604 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.605+0000 7f7348412800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:08:27.604 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.605+0000 7f7348412800 20 zone default found 2024-09-14T11:08:27.604 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.605+0000 7f7348412800 4 Realm: () 2024-09-14T11:08:27.604 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.605+0000 7f7348412800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:08:27.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.605+0000 7f7348412800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:08:27.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.605+0000 7f7348412800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:08:27.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.605+0000 7f7348412800 20 zonegroup default 2024-09-14T11:08:27.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.605+0000 7f7348412800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.605+0000 7f7348412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:27.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.605+0000 7f7348412800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.606+0000 7f7348412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:27.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.606+0000 7f7348412800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.606+0000 7f7348412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:27.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.606+0000 7f7348412800 20 started sync module instance, tier type = 2024-09-14T11:08:27.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.606+0000 7f7348412800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:08:27.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.617+0000 7f7348412800 20 add_watcher() i=0 2024-09-14T11:08:27.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.617+0000 7f7348412800 20 add_watcher() i=1 2024-09-14T11:08:27.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.617+0000 7f7348412800 20 add_watcher() i=2 2024-09-14T11:08:27.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.617+0000 7f7348412800 20 add_watcher() i=3 2024-09-14T11:08:27.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.617+0000 7f7348412800 20 add_watcher() i=4 2024-09-14T11:08:27.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.617+0000 7f7348412800 20 add_watcher() i=5 2024-09-14T11:08:27.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.617+0000 7f7348412800 20 add_watcher() i=6 2024-09-14T11:08:27.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.618+0000 7f7348412800 20 add_watcher() i=7 2024-09-14T11:08:27.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.618+0000 7f7348412800 2 all 8 watchers are set, enabling cache 2024-09-14T11:08:27.619 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.620+0000 7f71f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:08:27.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.620+0000 7f7348412800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:08:27.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.620+0000 7f7348412800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:08:27.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.621+0000 7f7348412800 5 note: GC not initialized 2024-09-14T11:08:27.620 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.621+0000 7f71f8fe1640 20 reqs_thread_entry: start 2024-09-14T11:08:27.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.621+0000 7f7348412800 20 init_complete bucket index max shards: 11 2024-09-14T11:08:27.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.621+0000 7f7348412800 20 Filter name: none 2024-09-14T11:08:27.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.621+0000 7f71727fc640 20 reqs_thread_entry: start 2024-09-14T11:08:27.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.621+0000 7f7348412800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:08:27.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.621+0000 7f7348412800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.622+0000 7f7348412800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:08:27.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.622+0000 7f7348412800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:08:27.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.622+0000 7f7348412800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:08:27.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.622+0000 7f7348412800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 : miss 2024-09-14T11:08:27.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.622+0000 7f7348412800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.622+0000 7f7348412800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:08:27.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.622+0000 7f7348412800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:08:27.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.622+0000 7f7348412800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:08:27.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.622+0000 7f7348412800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:08:27.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.622+0000 7f7348412800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:08:27.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.622+0000 7f7348412800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 2024-09-14T11:08:27.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.623+0000 7f7348412800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:08:27.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.632+0000 7f7348412800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:08:27.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.632+0000 7f7348412800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:08:27.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.632+0000 7f7348412800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:08:27.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.632+0000 7f7348412800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17, ofs0, ns] 2024-09-14T11:08:27.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.632+0000 7f7222ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595246 cookie 94533486772288 notifier 7826 bl.length()=827 2024-09-14T11:08:27.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.632+0000 7f7222ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:08:27.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.632+0000 7f7222ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:08:27.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.632+0000 7f7222ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:08:27.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.633+0000 7f7348412800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): orig_sources= new_sources= 2024-09-14T11:08:27.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.633+0000 7f7348412800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): potential sources added=[] removed=[] 2024-09-14T11:08:27.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.633+0000 7f7348412800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): orig_dests= new_dests= 2024-09-14T11:08:27.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.633+0000 7f7348412800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): potential dests added=[] removed=[] 2024-09-14T11:08:27.634 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7348412800 time 2024-09-14T11:08:27.637324+0000 2024-09-14T11:08:27.635 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:08:27.636 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:08:27.636 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f734958c76a] 2024-09-14T11:08:27.636 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f734958c928] 2024-09-14T11:08:27.636 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fa49dcd0b1] 2024-09-14T11:08:27.636 INFO:tasks.workunit.client.0.smithi097.stderr: 4: radosgw-admin(+0xd8907c) [0x55fa4a2e107c] 2024-09-14T11:08:27.636 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55fa49ddcefd] 2024-09-14T11:08:27.636 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-14T11:08:27.636 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f7348229590] 2024-09-14T11:08:27.636 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-14T11:08:27.636 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-14T11:08:27.636 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.637+0000 7f7348412800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7348412800 time 2024-09-14T11:08:27.637324+0000 2024-09-14T11:08:27.637 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:08:27.637 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:27.637 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:08:27.637 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f734958c76a] 2024-09-14T11:08:27.637 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f734958c928] 2024-09-14T11:08:27.637 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fa49dcd0b1] 2024-09-14T11:08:27.637 INFO:tasks.workunit.client.0.smithi097.stderr: 4: radosgw-admin(+0xd8907c) [0x55fa4a2e107c] 2024-09-14T11:08:27.637 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55fa49ddcefd] 2024-09-14T11:08:27.637 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-14T11:08:27.637 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f7348229590] 2024-09-14T11:08:27.637 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-14T11:08:27.638 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-14T11:08:27.638 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:27.638 INFO:tasks.workunit.client.0.smithi097.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:08:27.638 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f7348412800 thread_name:radosgw-admin 2024-09-14T11:08:27.654 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:08:27.654 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f734823e6f0] 2024-09-14T11:08:27.654 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f734828b99c] 2024-09-14T11:08:27.654 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-14T11:08:27.654 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-14T11:08:27.654 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f734958c7c4] 2024-09-14T11:08:27.654 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f734958c928] 2024-09-14T11:08:27.654 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fa49dcd0b1] 2024-09-14T11:08:27.655 INFO:tasks.workunit.client.0.smithi097.stderr: 8: radosgw-admin(+0xd8907c) [0x55fa4a2e107c] 2024-09-14T11:08:27.655 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55fa49ddcefd] 2024-09-14T11:08:27.655 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-14T11:08:27.655 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f7348229590] 2024-09-14T11:08:27.655 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-14T11:08:27.655 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-14T11:08:27.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.638+0000 7f7348412800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:08:27.655 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f7348412800 thread_name:radosgw-admin 2024-09-14T11:08:27.655 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:27.655 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:08:27.655 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f734823e6f0] 2024-09-14T11:08:27.655 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f734828b99c] 2024-09-14T11:08:27.655 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-14T11:08:27.655 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-14T11:08:27.656 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f734958c7c4] 2024-09-14T11:08:27.656 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f734958c928] 2024-09-14T11:08:27.656 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fa49dcd0b1] 2024-09-14T11:08:27.656 INFO:tasks.workunit.client.0.smithi097.stderr: 8: radosgw-admin(+0xd8907c) [0x55fa4a2e107c] 2024-09-14T11:08:27.656 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55fa49ddcefd] 2024-09-14T11:08:27.656 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-14T11:08:27.656 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f7348229590] 2024-09-14T11:08:27.656 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-14T11:08:27.656 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-14T11:08:27.656 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:08:27.656 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:27.656 INFO:tasks.workunit.client.0.smithi097.stderr:--- begin dump of recent events --- 2024-09-14T11:08:27.656 INFO:tasks.workunit.client.0.smithi097.stderr: -499> 2024-09-14T11:08:27.163+0000 7f7231e0b640 10 monclient: dump: 2024-09-14T11:08:27.657 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:08:27.657 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:08:27.657 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:27.657 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:27.657 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:08:27.657 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:27.657 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:08:27.657 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:08:27.657 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:08:27.657 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:27.657 INFO:tasks.workunit.client.0.smithi097.stderr: -498> 2024-09-14T11:08:27.163+0000 7f7231e0b640 10 monclient: _finish_auth 0 2024-09-14T11:08:27.657 INFO:tasks.workunit.client.0.smithi097.stderr: -497> 2024-09-14T11:08:27.163+0000 7f7231e0b640 10 monclient: _check_auth_tickets 2024-09-14T11:08:27.657 INFO:tasks.workunit.client.0.smithi097.stderr: -496> 2024-09-14T11:08:27.163+0000 7f7231e0b640 10 monclient: handle_config config(0 keys) 2024-09-14T11:08:27.657 INFO:tasks.workunit.client.0.smithi097.stderr: -495> 2024-09-14T11:08:27.163+0000 7f7231e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:08:27.658 INFO:tasks.workunit.client.0.smithi097.stderr: -494> 2024-09-14T11:08:27.163+0000 7f7231e0b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:08:27.658 INFO:tasks.workunit.client.0.smithi097.stderr: -493> 2024-09-14T11:08:27.163+0000 7f7231e0b640 10 monclient: dump: 2024-09-14T11:08:27.658 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:08:27.658 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:08:27.658 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:27.658 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:27.658 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:08:27.658 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:27.658 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:08:27.658 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:08:27.658 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:08:27.658 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:27.658 INFO:tasks.workunit.client.0.smithi097.stderr: -492> 2024-09-14T11:08:27.163+0000 7f7348412800 5 monclient: authenticate success, global_id 7814 2024-09-14T11:08:27.658 INFO:tasks.workunit.client.0.smithi097.stderr: -491> 2024-09-14T11:08:27.163+0000 7f7348412800 10 monclient: get_monmap_and_config success 2024-09-14T11:08:27.658 INFO:tasks.workunit.client.0.smithi097.stderr: -490> 2024-09-14T11:08:27.163+0000 7f7348412800 4 set_mon_vals no callback set 2024-09-14T11:08:27.659 INFO:tasks.workunit.client.0.smithi097.stderr: -489> 2024-09-14T11:08:27.164+0000 7f7348412800 10 monclient: shutdown 2024-09-14T11:08:27.659 INFO:tasks.workunit.client.0.smithi097.stderr: -488> 2024-09-14T11:08:27.164+0000 7f7348412800 5 asok(0x55fa4ab3c270) unregister_commands rotate-key 2024-09-14T11:08:27.659 INFO:tasks.workunit.client.0.smithi097.stderr: -487> 2024-09-14T11:08:27.164+0000 7f7348412800 10 monclient: build_initial_monmap 2024-09-14T11:08:27.659 INFO:tasks.workunit.client.0.smithi097.stderr: -486> 2024-09-14T11:08:27.164+0000 7f7348412800 1 build_initial for_mkfs: 0 2024-09-14T11:08:27.659 INFO:tasks.workunit.client.0.smithi097.stderr: -485> 2024-09-14T11:08:27.164+0000 7f7348412800 10 monclient: monmap: 2024-09-14T11:08:27.659 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:08:27.659 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:08:27.659 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:08:27.659 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:08:27.659 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:08:27.659 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:27.659 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:08:27.659 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:08:27.659 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:08:27.660 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:27.660 INFO:tasks.workunit.client.0.smithi097.stderr: -484> 2024-09-14T11:08:27.164+0000 7f7348412800 5 AuthRegistry(0x55fa4ad61dc0) adding auth protocol: cephx 2024-09-14T11:08:27.660 INFO:tasks.workunit.client.0.smithi097.stderr: -483> 2024-09-14T11:08:27.164+0000 7f7348412800 5 AuthRegistry(0x55fa4ad61dc0) adding auth protocol: cephx 2024-09-14T11:08:27.660 INFO:tasks.workunit.client.0.smithi097.stderr: -482> 2024-09-14T11:08:27.164+0000 7f7348412800 5 AuthRegistry(0x55fa4ad61dc0) adding auth protocol: cephx 2024-09-14T11:08:27.660 INFO:tasks.workunit.client.0.smithi097.stderr: -481> 2024-09-14T11:08:27.164+0000 7f7348412800 5 AuthRegistry(0x55fa4ad61dc0) adding con mode: secure 2024-09-14T11:08:27.660 INFO:tasks.workunit.client.0.smithi097.stderr: -480> 2024-09-14T11:08:27.164+0000 7f7348412800 5 AuthRegistry(0x55fa4ad61dc0) adding con mode: crc 2024-09-14T11:08:27.660 INFO:tasks.workunit.client.0.smithi097.stderr: -479> 2024-09-14T11:08:27.164+0000 7f7348412800 5 AuthRegistry(0x55fa4ad61dc0) adding con mode: secure 2024-09-14T11:08:27.660 INFO:tasks.workunit.client.0.smithi097.stderr: -478> 2024-09-14T11:08:27.164+0000 7f7348412800 5 AuthRegistry(0x55fa4ad61dc0) adding con mode: crc 2024-09-14T11:08:27.660 INFO:tasks.workunit.client.0.smithi097.stderr: -477> 2024-09-14T11:08:27.164+0000 7f7348412800 5 AuthRegistry(0x55fa4ad61dc0) adding con mode: secure 2024-09-14T11:08:27.660 INFO:tasks.workunit.client.0.smithi097.stderr: -476> 2024-09-14T11:08:27.164+0000 7f7348412800 5 AuthRegistry(0x55fa4ad61dc0) adding con mode: crc 2024-09-14T11:08:27.660 INFO:tasks.workunit.client.0.smithi097.stderr: -475> 2024-09-14T11:08:27.164+0000 7f7348412800 5 AuthRegistry(0x55fa4ad61dc0) adding con mode: crc 2024-09-14T11:08:27.660 INFO:tasks.workunit.client.0.smithi097.stderr: -474> 2024-09-14T11:08:27.164+0000 7f7348412800 5 AuthRegistry(0x55fa4ad61dc0) adding con mode: secure 2024-09-14T11:08:27.660 INFO:tasks.workunit.client.0.smithi097.stderr: -473> 2024-09-14T11:08:27.164+0000 7f7348412800 5 AuthRegistry(0x55fa4ad61dc0) adding con mode: crc 2024-09-14T11:08:27.661 INFO:tasks.workunit.client.0.smithi097.stderr: -472> 2024-09-14T11:08:27.164+0000 7f7348412800 5 AuthRegistry(0x55fa4ad61dc0) adding con mode: secure 2024-09-14T11:08:27.661 INFO:tasks.workunit.client.0.smithi097.stderr: -471> 2024-09-14T11:08:27.164+0000 7f7348412800 5 AuthRegistry(0x55fa4ad61dc0) adding con mode: crc 2024-09-14T11:08:27.661 INFO:tasks.workunit.client.0.smithi097.stderr: -470> 2024-09-14T11:08:27.164+0000 7f7348412800 5 AuthRegistry(0x55fa4ad61dc0) adding con mode: secure 2024-09-14T11:08:27.661 INFO:tasks.workunit.client.0.smithi097.stderr: -469> 2024-09-14T11:08:27.165+0000 7f7348412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:27.661 INFO:tasks.workunit.client.0.smithi097.stderr: -468> 2024-09-14T11:08:27.165+0000 7f7348412800 1 librados: starting msgr at 2024-09-14T11:08:27.661 INFO:tasks.workunit.client.0.smithi097.stderr: -467> 2024-09-14T11:08:27.165+0000 7f7348412800 1 librados: starting objecter 2024-09-14T11:08:27.661 INFO:tasks.workunit.client.0.smithi097.stderr: -466> 2024-09-14T11:08:27.165+0000 7f7348412800 5 asok(0x55fa4ab3c270) register_command objecter_requests hook 0x55fa4ad62890 2024-09-14T11:08:27.661 INFO:tasks.workunit.client.0.smithi097.stderr: -465> 2024-09-14T11:08:27.165+0000 7f7348412800 1 librados: setting wanted keys 2024-09-14T11:08:27.661 INFO:tasks.workunit.client.0.smithi097.stderr: -464> 2024-09-14T11:08:27.165+0000 7f7348412800 1 librados: calling monclient init 2024-09-14T11:08:27.661 INFO:tasks.workunit.client.0.smithi097.stderr: -463> 2024-09-14T11:08:27.165+0000 7f7348412800 10 monclient: init 2024-09-14T11:08:27.661 INFO:tasks.workunit.client.0.smithi097.stderr: -462> 2024-09-14T11:08:27.165+0000 7f7348412800 5 AuthRegistry(0x55fa4ad5c060) adding auth protocol: cephx 2024-09-14T11:08:27.661 INFO:tasks.workunit.client.0.smithi097.stderr: -461> 2024-09-14T11:08:27.165+0000 7f7348412800 5 AuthRegistry(0x55fa4ad5c060) adding auth protocol: cephx 2024-09-14T11:08:27.661 INFO:tasks.workunit.client.0.smithi097.stderr: -460> 2024-09-14T11:08:27.165+0000 7f7348412800 5 AuthRegistry(0x55fa4ad5c060) adding auth protocol: cephx 2024-09-14T11:08:27.662 INFO:tasks.workunit.client.0.smithi097.stderr: -459> 2024-09-14T11:08:27.165+0000 7f7348412800 5 AuthRegistry(0x55fa4ad5c060) adding con mode: secure 2024-09-14T11:08:27.662 INFO:tasks.workunit.client.0.smithi097.stderr: -458> 2024-09-14T11:08:27.165+0000 7f7348412800 5 AuthRegistry(0x55fa4ad5c060) adding con mode: crc 2024-09-14T11:08:27.662 INFO:tasks.workunit.client.0.smithi097.stderr: -457> 2024-09-14T11:08:27.165+0000 7f7348412800 5 AuthRegistry(0x55fa4ad5c060) adding con mode: secure 2024-09-14T11:08:27.662 INFO:tasks.workunit.client.0.smithi097.stderr: -456> 2024-09-14T11:08:27.165+0000 7f7348412800 5 AuthRegistry(0x55fa4ad5c060) adding con mode: crc 2024-09-14T11:08:27.662 INFO:tasks.workunit.client.0.smithi097.stderr: -455> 2024-09-14T11:08:27.165+0000 7f7348412800 5 AuthRegistry(0x55fa4ad5c060) adding con mode: secure 2024-09-14T11:08:27.662 INFO:tasks.workunit.client.0.smithi097.stderr: -454> 2024-09-14T11:08:27.165+0000 7f7348412800 5 AuthRegistry(0x55fa4ad5c060) adding con mode: crc 2024-09-14T11:08:27.662 INFO:tasks.workunit.client.0.smithi097.stderr: -453> 2024-09-14T11:08:27.165+0000 7f7348412800 5 AuthRegistry(0x55fa4ad5c060) adding con mode: crc 2024-09-14T11:08:27.662 INFO:tasks.workunit.client.0.smithi097.stderr: -452> 2024-09-14T11:08:27.165+0000 7f7348412800 5 AuthRegistry(0x55fa4ad5c060) adding con mode: secure 2024-09-14T11:08:27.662 INFO:tasks.workunit.client.0.smithi097.stderr: -451> 2024-09-14T11:08:27.165+0000 7f7348412800 5 AuthRegistry(0x55fa4ad5c060) adding con mode: crc 2024-09-14T11:08:27.662 INFO:tasks.workunit.client.0.smithi097.stderr: -450> 2024-09-14T11:08:27.165+0000 7f7348412800 5 AuthRegistry(0x55fa4ad5c060) adding con mode: secure 2024-09-14T11:08:27.662 INFO:tasks.workunit.client.0.smithi097.stderr: -449> 2024-09-14T11:08:27.165+0000 7f7348412800 5 AuthRegistry(0x55fa4ad5c060) adding con mode: crc 2024-09-14T11:08:27.662 INFO:tasks.workunit.client.0.smithi097.stderr: -448> 2024-09-14T11:08:27.165+0000 7f7348412800 5 AuthRegistry(0x55fa4ad5c060) adding con mode: secure 2024-09-14T11:08:27.662 INFO:tasks.workunit.client.0.smithi097.stderr: -447> 2024-09-14T11:08:27.165+0000 7f7348412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:27.662 INFO:tasks.workunit.client.0.smithi097.stderr: -446> 2024-09-14T11:08:27.165+0000 7f7348412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:27.663 INFO:tasks.workunit.client.0.smithi097.stderr: -445> 2024-09-14T11:08:27.165+0000 7f7348412800 5 asok(0x55fa4ab3c270) register_command rotate-key hook 0x55fa4ad5c1a8 2024-09-14T11:08:27.663 INFO:tasks.workunit.client.0.smithi097.stderr: -444> 2024-09-14T11:08:27.165+0000 7f7348412800 10 monclient: _reopen_session rank -1 2024-09-14T11:08:27.663 INFO:tasks.workunit.client.0.smithi097.stderr: -443> 2024-09-14T11:08:27.165+0000 7f7348412800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:08:27.663 INFO:tasks.workunit.client.0.smithi097.stderr: -442> 2024-09-14T11:08:27.165+0000 7f7348412800 10 monclient(hunting): picked mon.noname-a con 0x55fa4ad5f6a0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:08:27.663 INFO:tasks.workunit.client.0.smithi097.stderr: -441> 2024-09-14T11:08:27.165+0000 7f7348412800 10 monclient(hunting): picked mon.noname-c con 0x55fa4ad85f20 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:08:27.663 INFO:tasks.workunit.client.0.smithi097.stderr: -440> 2024-09-14T11:08:27.165+0000 7f7348412800 10 monclient(hunting): picked mon.noname-b con 0x7f7330003bd0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:08:27.663 INFO:tasks.workunit.client.0.smithi097.stderr: -439> 2024-09-14T11:08:27.165+0000 7f7348412800 10 monclient(hunting): start opening mon connection 2024-09-14T11:08:27.663 INFO:tasks.workunit.client.0.smithi097.stderr: -438> 2024-09-14T11:08:27.165+0000 7f7348412800 10 monclient(hunting): start opening mon connection 2024-09-14T11:08:27.663 INFO:tasks.workunit.client.0.smithi097.stderr: -437> 2024-09-14T11:08:27.165+0000 7f7348412800 10 monclient(hunting): start opening mon connection 2024-09-14T11:08:27.663 INFO:tasks.workunit.client.0.smithi097.stderr: -436> 2024-09-14T11:08:27.165+0000 7f7348412800 10 monclient(hunting): _renew_subs 2024-09-14T11:08:27.663 INFO:tasks.workunit.client.0.smithi097.stderr: -435> 2024-09-14T11:08:27.165+0000 7f7348412800 10 monclient(hunting): authenticate will time out at 2188.818842s 2024-09-14T11:08:27.663 INFO:tasks.workunit.client.0.smithi097.stderr: -434> 2024-09-14T11:08:27.165+0000 7f733b3df640 10 monclient(hunting): get_auth_request con 0x55fa4ad85f20 auth_method 0 2024-09-14T11:08:27.663 INFO:tasks.workunit.client.0.smithi097.stderr: -433> 2024-09-14T11:08:27.165+0000 7f733b3df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:08:27.664 INFO:tasks.workunit.client.0.smithi097.stderr: -432> 2024-09-14T11:08:27.165+0000 7f733b3df640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:08:27.664 INFO:tasks.workunit.client.0.smithi097.stderr: -431> 2024-09-14T11:08:27.165+0000 7f733b3df640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:08:27.664 INFO:tasks.workunit.client.0.smithi097.stderr: -430> 2024-09-14T11:08:27.165+0000 7f7343be0640 10 monclient(hunting): get_auth_request con 0x55fa4ad5f6a0 auth_method 0 2024-09-14T11:08:27.664 INFO:tasks.workunit.client.0.smithi097.stderr: -429> 2024-09-14T11:08:27.165+0000 7f7343be0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:08:27.664 INFO:tasks.workunit.client.0.smithi097.stderr: -428> 2024-09-14T11:08:27.165+0000 7f7343be0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:08:27.664 INFO:tasks.workunit.client.0.smithi097.stderr: -427> 2024-09-14T11:08:27.165+0000 7f7343be0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:08:27.664 INFO:tasks.workunit.client.0.smithi097.stderr: -426> 2024-09-14T11:08:27.166+0000 7f733b3df640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:08:27.664 INFO:tasks.workunit.client.0.smithi097.stderr: -425> 2024-09-14T11:08:27.166+0000 7f733b3df640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:08:27.664 INFO:tasks.workunit.client.0.smithi097.stderr: -424> 2024-09-14T11:08:27.166+0000 7f733b3df640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:08:27.664 INFO:tasks.workunit.client.0.smithi097.stderr: -423> 2024-09-14T11:08:27.166+0000 7f7343be0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:08:27.664 INFO:tasks.workunit.client.0.smithi097.stderr: -422> 2024-09-14T11:08:27.166+0000 7f7343be0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:08:27.664 INFO:tasks.workunit.client.0.smithi097.stderr: -421> 2024-09-14T11:08:27.166+0000 7f7343be0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:08:27.664 INFO:tasks.workunit.client.0.smithi097.stderr: -420> 2024-09-14T11:08:27.166+0000 7f7343be0640 10 monclient(hunting): handle_auth_done global_id 8340 payload 824 2024-09-14T11:08:27.665 INFO:tasks.workunit.client.0.smithi097.stderr: -419> 2024-09-14T11:08:27.166+0000 7f7343be0640 10 monclient: _finish_hunting 0 2024-09-14T11:08:27.665 INFO:tasks.workunit.client.0.smithi097.stderr: -418> 2024-09-14T11:08:27.166+0000 7f7343be0640 1 monclient: found mon.noname-a 2024-09-14T11:08:27.665 INFO:tasks.workunit.client.0.smithi097.stderr: -417> 2024-09-14T11:08:27.166+0000 7f7343be0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-14T11:08:27.665 INFO:tasks.workunit.client.0.smithi097.stderr: -416> 2024-09-14T11:08:27.166+0000 7f73443e1640 10 monclient: get_auth_request con 0x7f7330003bd0 auth_method 0 2024-09-14T11:08:27.665 INFO:tasks.workunit.client.0.smithi097.stderr: -415> 2024-09-14T11:08:27.166+0000 7f722bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:08:27.665 INFO:tasks.workunit.client.0.smithi097.stderr: -414> 2024-09-14T11:08:27.166+0000 7f722bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:08:27.665 INFO:tasks.workunit.client.0.smithi097.stderr: -413> 2024-09-14T11:08:27.166+0000 7f722bfff640 10 monclient: dump: 2024-09-14T11:08:27.665 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:08:27.665 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:08:27.665 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:27.665 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:27.665 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:08:27.665 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:27.666 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:08:27.666 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:08:27.666 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:08:27.666 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:27.666 INFO:tasks.workunit.client.0.smithi097.stderr: -412> 2024-09-14T11:08:27.166+0000 7f722bfff640 10 monclient: _finish_auth 0 2024-09-14T11:08:27.666 INFO:tasks.workunit.client.0.smithi097.stderr: -411> 2024-09-14T11:08:27.166+0000 7f722bfff640 10 monclient: _check_auth_tickets 2024-09-14T11:08:27.666 INFO:tasks.workunit.client.0.smithi097.stderr: -410> 2024-09-14T11:08:27.166+0000 7f722bfff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:08:27.666 INFO:tasks.workunit.client.0.smithi097.stderr: -409> 2024-09-14T11:08:27.166+0000 7f722bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:08:27.666 INFO:tasks.workunit.client.0.smithi097.stderr: -408> 2024-09-14T11:08:27.166+0000 7f722bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:08:27.666 INFO:tasks.workunit.client.0.smithi097.stderr: -407> 2024-09-14T11:08:27.166+0000 7f722bfff640 10 monclient: dump: 2024-09-14T11:08:27.666 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:08:27.666 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:08:27.666 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:27.667 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:27.667 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:08:27.667 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:27.667 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:08:27.667 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:08:27.667 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:08:27.667 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:27.667 INFO:tasks.workunit.client.0.smithi097.stderr: -406> 2024-09-14T11:08:27.166+0000 7f7348412800 5 monclient: authenticate success, global_id 8340 2024-09-14T11:08:27.667 INFO:tasks.workunit.client.0.smithi097.stderr: -405> 2024-09-14T11:08:27.166+0000 7f7348412800 10 monclient: _renew_subs 2024-09-14T11:08:27.667 INFO:tasks.workunit.client.0.smithi097.stderr: -404> 2024-09-14T11:08:27.166+0000 7f7231e0b640 4 set_mon_vals no callback set 2024-09-14T11:08:27.667 INFO:tasks.workunit.client.0.smithi097.stderr: -403> 2024-09-14T11:08:27.166+0000 7f7348412800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:08:27.667 INFO:tasks.workunit.client.0.smithi097.stderr: -402> 2024-09-14T11:08:27.166+0000 7f7348412800 10 monclient: _renew_subs 2024-09-14T11:08:27.667 INFO:tasks.workunit.client.0.smithi097.stderr: -401> 2024-09-14T11:08:27.166+0000 7f7348412800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:08:27.667 INFO:tasks.workunit.client.0.smithi097.stderr: -400> 2024-09-14T11:08:27.166+0000 7f7348412800 1 librados: init done 2024-09-14T11:08:27.668 INFO:tasks.workunit.client.0.smithi097.stderr: -399> 2024-09-14T11:08:27.168+0000 7f722bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:08:27.668 INFO:tasks.workunit.client.0.smithi097.stderr: -398> 2024-09-14T11:08:27.168+0000 7f722bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:08:27.668 INFO:tasks.workunit.client.0.smithi097.stderr: -397> 2024-09-14T11:08:27.168+0000 7f722bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:08:27.668 INFO:tasks.workunit.client.0.smithi097.stderr: -396> 2024-09-14T11:08:27.168+0000 7f733b3df640 10 monclient: get_auth_request con 0x7f722c077260 auth_method 0 2024-09-14T11:08:27.668 INFO:tasks.workunit.client.0.smithi097.stderr: -395> 2024-09-14T11:08:27.169+0000 7f73443e1640 10 monclient: get_auth_request con 0x55fa4ad9d1e0 auth_method 0 2024-09-14T11:08:27.668 INFO:tasks.workunit.client.0.smithi097.stderr: -394> 2024-09-14T11:08:27.170+0000 7f7343be0640 10 monclient: get_auth_request con 0x55fa4ada8560 auth_method 0 2024-09-14T11:08:27.668 INFO:tasks.workunit.client.0.smithi097.stderr: -393> 2024-09-14T11:08:27.171+0000 7f733b3df640 10 monclient: get_auth_request con 0x55fa4adac8c0 auth_method 0 2024-09-14T11:08:27.668 INFO:tasks.workunit.client.0.smithi097.stderr: -392> 2024-09-14T11:08:27.172+0000 7f73443e1640 10 monclient: get_auth_request con 0x55fa4adabe10 auth_method 0 2024-09-14T11:08:27.668 INFO:tasks.workunit.client.0.smithi097.stderr: -391> 2024-09-14T11:08:27.173+0000 7f7348412800 10 monclient: build_initial_monmap 2024-09-14T11:08:27.668 INFO:tasks.workunit.client.0.smithi097.stderr: -390> 2024-09-14T11:08:27.173+0000 7f7348412800 1 build_initial for_mkfs: 0 2024-09-14T11:08:27.668 INFO:tasks.workunit.client.0.smithi097.stderr: -389> 2024-09-14T11:08:27.173+0000 7f7348412800 10 monclient: monmap: 2024-09-14T11:08:27.668 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:08:27.668 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:08:27.669 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:08:27.669 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:08:27.669 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:08:27.669 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:27.669 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:08:27.669 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:08:27.669 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:08:27.669 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:27.669 INFO:tasks.workunit.client.0.smithi097.stderr: -388> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb4a30) adding auth protocol: cephx 2024-09-14T11:08:27.669 INFO:tasks.workunit.client.0.smithi097.stderr: -387> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb4a30) adding auth protocol: cephx 2024-09-14T11:08:27.669 INFO:tasks.workunit.client.0.smithi097.stderr: -386> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb4a30) adding auth protocol: cephx 2024-09-14T11:08:27.669 INFO:tasks.workunit.client.0.smithi097.stderr: -385> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb4a30) adding con mode: secure 2024-09-14T11:08:27.669 INFO:tasks.workunit.client.0.smithi097.stderr: -384> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb4a30) adding con mode: crc 2024-09-14T11:08:27.670 INFO:tasks.workunit.client.0.smithi097.stderr: -383> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb4a30) adding con mode: secure 2024-09-14T11:08:27.670 INFO:tasks.workunit.client.0.smithi097.stderr: -382> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb4a30) adding con mode: crc 2024-09-14T11:08:27.670 INFO:tasks.workunit.client.0.smithi097.stderr: -381> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb4a30) adding con mode: secure 2024-09-14T11:08:27.670 INFO:tasks.workunit.client.0.smithi097.stderr: -380> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb4a30) adding con mode: crc 2024-09-14T11:08:27.670 INFO:tasks.workunit.client.0.smithi097.stderr: -379> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb4a30) adding con mode: crc 2024-09-14T11:08:27.670 INFO:tasks.workunit.client.0.smithi097.stderr: -378> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb4a30) adding con mode: secure 2024-09-14T11:08:27.670 INFO:tasks.workunit.client.0.smithi097.stderr: -377> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb4a30) adding con mode: crc 2024-09-14T11:08:27.670 INFO:tasks.workunit.client.0.smithi097.stderr: -376> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb4a30) adding con mode: secure 2024-09-14T11:08:27.670 INFO:tasks.workunit.client.0.smithi097.stderr: -375> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb4a30) adding con mode: crc 2024-09-14T11:08:27.670 INFO:tasks.workunit.client.0.smithi097.stderr: -374> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb4a30) adding con mode: secure 2024-09-14T11:08:27.670 INFO:tasks.workunit.client.0.smithi097.stderr: -373> 2024-09-14T11:08:27.173+0000 7f7348412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:27.670 INFO:tasks.workunit.client.0.smithi097.stderr: -372> 2024-09-14T11:08:27.173+0000 7f7348412800 5 asok(0x55fa4ab3c270) register_command objecter_requests cmddesc objecter_requests hook 0x55fa4adb7f20 EEXIST 2024-09-14T11:08:27.670 INFO:tasks.workunit.client.0.smithi097.stderr: -371> 2024-09-14T11:08:27.173+0000 7f7348412800 10 monclient: init 2024-09-14T11:08:27.670 INFO:tasks.workunit.client.0.smithi097.stderr: -370> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb3978) adding auth protocol: cephx 2024-09-14T11:08:27.671 INFO:tasks.workunit.client.0.smithi097.stderr: -369> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb3978) adding auth protocol: cephx 2024-09-14T11:08:27.671 INFO:tasks.workunit.client.0.smithi097.stderr: -368> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb3978) adding auth protocol: cephx 2024-09-14T11:08:27.671 INFO:tasks.workunit.client.0.smithi097.stderr: -367> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb3978) adding con mode: secure 2024-09-14T11:08:27.671 INFO:tasks.workunit.client.0.smithi097.stderr: -366> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb3978) adding con mode: crc 2024-09-14T11:08:27.671 INFO:tasks.workunit.client.0.smithi097.stderr: -365> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb3978) adding con mode: secure 2024-09-14T11:08:27.671 INFO:tasks.workunit.client.0.smithi097.stderr: -364> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb3978) adding con mode: crc 2024-09-14T11:08:27.671 INFO:tasks.workunit.client.0.smithi097.stderr: -363> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb3978) adding con mode: secure 2024-09-14T11:08:27.671 INFO:tasks.workunit.client.0.smithi097.stderr: -362> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb3978) adding con mode: crc 2024-09-14T11:08:27.671 INFO:tasks.workunit.client.0.smithi097.stderr: -361> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb3978) adding con mode: crc 2024-09-14T11:08:27.671 INFO:tasks.workunit.client.0.smithi097.stderr: -360> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb3978) adding con mode: secure 2024-09-14T11:08:27.671 INFO:tasks.workunit.client.0.smithi097.stderr: -359> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb3978) adding con mode: crc 2024-09-14T11:08:27.671 INFO:tasks.workunit.client.0.smithi097.stderr: -358> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb3978) adding con mode: secure 2024-09-14T11:08:27.671 INFO:tasks.workunit.client.0.smithi097.stderr: -357> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb3978) adding con mode: crc 2024-09-14T11:08:27.672 INFO:tasks.workunit.client.0.smithi097.stderr: -356> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb3978) adding con mode: secure 2024-09-14T11:08:27.672 INFO:tasks.workunit.client.0.smithi097.stderr: -355> 2024-09-14T11:08:27.173+0000 7f7348412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:27.672 INFO:tasks.workunit.client.0.smithi097.stderr: -354> 2024-09-14T11:08:27.174+0000 7f7348412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:27.672 INFO:tasks.workunit.client.0.smithi097.stderr: -353> 2024-09-14T11:08:27.174+0000 7f7348412800 5 asok(0x55fa4ab3c270) register_command rotate-key cmddesc rotate-key hook 0x55fa4adb3ac0 EEXIST 2024-09-14T11:08:27.672 INFO:tasks.workunit.client.0.smithi097.stderr: -352> 2024-09-14T11:08:27.174+0000 7f7348412800 10 monclient: _reopen_session rank -1 2024-09-14T11:08:27.672 INFO:tasks.workunit.client.0.smithi097.stderr: -351> 2024-09-14T11:08:27.174+0000 7f7348412800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:08:27.672 INFO:tasks.workunit.client.0.smithi097.stderr: -350> 2024-09-14T11:08:27.174+0000 7f7348412800 10 monclient(hunting): picked mon.noname-b con 0x55fa4addc240 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:08:27.672 INFO:tasks.workunit.client.0.smithi097.stderr: -349> 2024-09-14T11:08:27.174+0000 7f7348412800 10 monclient(hunting): picked mon.noname-a con 0x55fa4addc620 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:08:27.672 INFO:tasks.workunit.client.0.smithi097.stderr: -348> 2024-09-14T11:08:27.174+0000 7f7348412800 10 monclient(hunting): picked mon.noname-c con 0x55fa4addaf50 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:08:27.672 INFO:tasks.workunit.client.0.smithi097.stderr: -347> 2024-09-14T11:08:27.174+0000 7f7348412800 10 monclient(hunting): start opening mon connection 2024-09-14T11:08:27.672 INFO:tasks.workunit.client.0.smithi097.stderr: -346> 2024-09-14T11:08:27.174+0000 7f7348412800 10 monclient(hunting): start opening mon connection 2024-09-14T11:08:27.672 INFO:tasks.workunit.client.0.smithi097.stderr: -345> 2024-09-14T11:08:27.174+0000 7f7348412800 10 monclient(hunting): start opening mon connection 2024-09-14T11:08:27.672 INFO:tasks.workunit.client.0.smithi097.stderr: -344> 2024-09-14T11:08:27.174+0000 7f7348412800 10 monclient(hunting): _renew_subs 2024-09-14T11:08:27.673 INFO:tasks.workunit.client.0.smithi097.stderr: -343> 2024-09-14T11:08:27.174+0000 7f7348412800 10 monclient(hunting): authenticate will time out at 2188.827169s 2024-09-14T11:08:27.673 INFO:tasks.workunit.client.0.smithi097.stderr: -342> 2024-09-14T11:08:27.174+0000 7f7343be0640 10 monclient(hunting): get_auth_request con 0x55fa4addaf50 auth_method 0 2024-09-14T11:08:27.673 INFO:tasks.workunit.client.0.smithi097.stderr: -341> 2024-09-14T11:08:27.174+0000 7f7343be0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:08:27.673 INFO:tasks.workunit.client.0.smithi097.stderr: -340> 2024-09-14T11:08:27.174+0000 7f7343be0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:08:27.673 INFO:tasks.workunit.client.0.smithi097.stderr: -339> 2024-09-14T11:08:27.174+0000 7f7343be0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:08:27.673 INFO:tasks.workunit.client.0.smithi097.stderr: -338> 2024-09-14T11:08:27.174+0000 7f73443e1640 10 monclient(hunting): get_auth_request con 0x55fa4addc620 auth_method 0 2024-09-14T11:08:27.673 INFO:tasks.workunit.client.0.smithi097.stderr: -337> 2024-09-14T11:08:27.174+0000 7f73443e1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:08:27.673 INFO:tasks.workunit.client.0.smithi097.stderr: -336> 2024-09-14T11:08:27.174+0000 7f73443e1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:08:27.673 INFO:tasks.workunit.client.0.smithi097.stderr: -335> 2024-09-14T11:08:27.174+0000 7f73443e1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:08:27.673 INFO:tasks.workunit.client.0.smithi097.stderr: -334> 2024-09-14T11:08:27.174+0000 7f733b3df640 10 monclient(hunting): get_auth_request con 0x55fa4addc240 auth_method 0 2024-09-14T11:08:27.673 INFO:tasks.workunit.client.0.smithi097.stderr: -333> 2024-09-14T11:08:27.174+0000 7f733b3df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:08:27.673 INFO:tasks.workunit.client.0.smithi097.stderr: -332> 2024-09-14T11:08:27.174+0000 7f733b3df640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:08:27.674 INFO:tasks.workunit.client.0.smithi097.stderr: -331> 2024-09-14T11:08:27.174+0000 7f733b3df640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:08:27.674 INFO:tasks.workunit.client.0.smithi097.stderr: -330> 2024-09-14T11:08:27.174+0000 7f7343be0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:08:27.674 INFO:tasks.workunit.client.0.smithi097.stderr: -329> 2024-09-14T11:08:27.174+0000 7f7343be0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:08:27.674 INFO:tasks.workunit.client.0.smithi097.stderr: -328> 2024-09-14T11:08:27.174+0000 7f7343be0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:08:27.674 INFO:tasks.workunit.client.0.smithi097.stderr: -327> 2024-09-14T11:08:27.174+0000 7f73443e1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:08:27.674 INFO:tasks.workunit.client.0.smithi097.stderr: -326> 2024-09-14T11:08:27.174+0000 7f73443e1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:08:27.674 INFO:tasks.workunit.client.0.smithi097.stderr: -325> 2024-09-14T11:08:27.174+0000 7f73443e1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:08:27.674 INFO:tasks.workunit.client.0.smithi097.stderr: -324> 2024-09-14T11:08:27.174+0000 7f733b3df640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:08:27.674 INFO:tasks.workunit.client.0.smithi097.stderr: -323> 2024-09-14T11:08:27.174+0000 7f733b3df640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:08:27.674 INFO:tasks.workunit.client.0.smithi097.stderr: -322> 2024-09-14T11:08:27.174+0000 7f733b3df640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:08:27.674 INFO:tasks.workunit.client.0.smithi097.stderr: -321> 2024-09-14T11:08:27.174+0000 7f7343be0640 10 monclient(hunting): handle_auth_done global_id 7820 payload 824 2024-09-14T11:08:27.674 INFO:tasks.workunit.client.0.smithi097.stderr: -320> 2024-09-14T11:08:27.174+0000 7f7343be0640 10 monclient: _finish_hunting 0 2024-09-14T11:08:27.674 INFO:tasks.workunit.client.0.smithi097.stderr: -319> 2024-09-14T11:08:27.174+0000 7f7343be0640 1 monclient: found mon.noname-c 2024-09-14T11:08:27.675 INFO:tasks.workunit.client.0.smithi097.stderr: -318> 2024-09-14T11:08:27.174+0000 7f7343be0640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:08:27.675 INFO:tasks.workunit.client.0.smithi097.stderr: -317> 2024-09-14T11:08:27.174+0000 7f72297fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:08:27.675 INFO:tasks.workunit.client.0.smithi097.stderr: -316> 2024-09-14T11:08:27.174+0000 7f72297fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:08:27.675 INFO:tasks.workunit.client.0.smithi097.stderr: -315> 2024-09-14T11:08:27.174+0000 7f72297fa640 10 monclient: dump: 2024-09-14T11:08:27.675 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:08:27.675 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:08:27.675 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:27.675 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:27.675 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:08:27.675 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:27.675 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:08:27.675 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:08:27.675 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:08:27.675 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:27.676 INFO:tasks.workunit.client.0.smithi097.stderr: -314> 2024-09-14T11:08:27.174+0000 7f72297fa640 10 monclient: _finish_auth 0 2024-09-14T11:08:27.676 INFO:tasks.workunit.client.0.smithi097.stderr: -313> 2024-09-14T11:08:27.174+0000 7f72297fa640 10 monclient: _check_auth_tickets 2024-09-14T11:08:27.676 INFO:tasks.workunit.client.0.smithi097.stderr: -312> 2024-09-14T11:08:27.174+0000 7f72297fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:08:27.676 INFO:tasks.workunit.client.0.smithi097.stderr: -311> 2024-09-14T11:08:27.174+0000 7f72297fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:08:27.676 INFO:tasks.workunit.client.0.smithi097.stderr: -310> 2024-09-14T11:08:27.174+0000 7f72297fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:08:27.676 INFO:tasks.workunit.client.0.smithi097.stderr: -309> 2024-09-14T11:08:27.174+0000 7f72297fa640 10 monclient: dump: 2024-09-14T11:08:27.676 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:08:27.676 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:08:27.676 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:27.676 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:27.676 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:08:27.676 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:27.676 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:08:27.676 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:08:27.677 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:08:27.677 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:27.677 INFO:tasks.workunit.client.0.smithi097.stderr: -308> 2024-09-14T11:08:27.174+0000 7f7348412800 5 monclient: authenticate success, global_id 7820 2024-09-14T11:08:27.677 INFO:tasks.workunit.client.0.smithi097.stderr: -307> 2024-09-14T11:08:27.174+0000 7f7348412800 10 monclient: _renew_subs 2024-09-14T11:08:27.677 INFO:tasks.workunit.client.0.smithi097.stderr: -306> 2024-09-14T11:08:27.174+0000 7f7344be2640 4 set_mon_vals no callback set 2024-09-14T11:08:27.677 INFO:tasks.workunit.client.0.smithi097.stderr: -305> 2024-09-14T11:08:27.174+0000 7f7348412800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:08:27.677 INFO:tasks.workunit.client.0.smithi097.stderr: -304> 2024-09-14T11:08:27.174+0000 7f7348412800 10 monclient: _renew_subs 2024-09-14T11:08:27.677 INFO:tasks.workunit.client.0.smithi097.stderr: -303> 2024-09-14T11:08:27.174+0000 7f7348412800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:08:27.677 INFO:tasks.workunit.client.0.smithi097.stderr: -302> 2024-09-14T11:08:27.176+0000 7f72297fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:08:27.677 INFO:tasks.workunit.client.0.smithi097.stderr: -301> 2024-09-14T11:08:27.176+0000 7f72297fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:08:27.677 INFO:tasks.workunit.client.0.smithi097.stderr: -300> 2024-09-14T11:08:27.176+0000 7f72297fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:08:27.677 INFO:tasks.workunit.client.0.smithi097.stderr: -299> 2024-09-14T11:08:27.176+0000 7f733b3df640 10 monclient: get_auth_request con 0x7f721c077140 auth_method 0 2024-09-14T11:08:27.677 INFO:tasks.workunit.client.0.smithi097.stderr: -298> 2024-09-14T11:08:27.177+0000 7f7348412800 10 monclient: get_monmap_and_config 2024-09-14T11:08:27.677 INFO:tasks.workunit.client.0.smithi097.stderr: -297> 2024-09-14T11:08:27.177+0000 7f7348412800 10 monclient: build_initial_monmap 2024-09-14T11:08:27.678 INFO:tasks.workunit.client.0.smithi097.stderr: -296> 2024-09-14T11:08:27.177+0000 7f7348412800 1 build_initial for_mkfs: 0 2024-09-14T11:08:27.678 INFO:tasks.workunit.client.0.smithi097.stderr: -295> 2024-09-14T11:08:27.177+0000 7f7348412800 10 monclient: monmap: 2024-09-14T11:08:27.678 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:08:27.678 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:08:27.678 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:08:27.678 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:08:27.678 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:08:27.678 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:27.678 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:08:27.678 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:08:27.678 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:08:27.678 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:27.678 INFO:tasks.workunit.client.0.smithi097.stderr: -294> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x55fa4adfc1a0) adding auth protocol: cephx 2024-09-14T11:08:27.678 INFO:tasks.workunit.client.0.smithi097.stderr: -293> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x55fa4adfc1a0) adding auth protocol: cephx 2024-09-14T11:08:27.678 INFO:tasks.workunit.client.0.smithi097.stderr: -292> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x55fa4adfc1a0) adding auth protocol: cephx 2024-09-14T11:08:27.679 INFO:tasks.workunit.client.0.smithi097.stderr: -291> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x55fa4adfc1a0) adding con mode: secure 2024-09-14T11:08:27.679 INFO:tasks.workunit.client.0.smithi097.stderr: -290> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x55fa4adfc1a0) adding con mode: crc 2024-09-14T11:08:27.679 INFO:tasks.workunit.client.0.smithi097.stderr: -289> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x55fa4adfc1a0) adding con mode: secure 2024-09-14T11:08:27.679 INFO:tasks.workunit.client.0.smithi097.stderr: -288> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x55fa4adfc1a0) adding con mode: crc 2024-09-14T11:08:27.679 INFO:tasks.workunit.client.0.smithi097.stderr: -287> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x55fa4adfc1a0) adding con mode: secure 2024-09-14T11:08:27.679 INFO:tasks.workunit.client.0.smithi097.stderr: -286> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x55fa4adfc1a0) adding con mode: crc 2024-09-14T11:08:27.679 INFO:tasks.workunit.client.0.smithi097.stderr: -285> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x55fa4adfc1a0) adding con mode: crc 2024-09-14T11:08:27.679 INFO:tasks.workunit.client.0.smithi097.stderr: -284> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x55fa4adfc1a0) adding con mode: secure 2024-09-14T11:08:27.679 INFO:tasks.workunit.client.0.smithi097.stderr: -283> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x55fa4adfc1a0) adding con mode: crc 2024-09-14T11:08:27.679 INFO:tasks.workunit.client.0.smithi097.stderr: -282> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x55fa4adfc1a0) adding con mode: secure 2024-09-14T11:08:27.679 INFO:tasks.workunit.client.0.smithi097.stderr: -281> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x55fa4adfc1a0) adding con mode: crc 2024-09-14T11:08:27.679 INFO:tasks.workunit.client.0.smithi097.stderr: -280> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x55fa4adfc1a0) adding con mode: secure 2024-09-14T11:08:27.679 INFO:tasks.workunit.client.0.smithi097.stderr: -279> 2024-09-14T11:08:27.177+0000 7f7348412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:27.679 INFO:tasks.workunit.client.0.smithi097.stderr: -278> 2024-09-14T11:08:27.177+0000 7f7348412800 10 monclient: init 2024-09-14T11:08:27.679 INFO:tasks.workunit.client.0.smithi097.stderr: -277> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x7fff033a3c50) adding auth protocol: cephx 2024-09-14T11:08:27.680 INFO:tasks.workunit.client.0.smithi097.stderr: -276> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x7fff033a3c50) adding auth protocol: cephx 2024-09-14T11:08:27.680 INFO:tasks.workunit.client.0.smithi097.stderr: -275> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x7fff033a3c50) adding auth protocol: cephx 2024-09-14T11:08:27.680 INFO:tasks.workunit.client.0.smithi097.stderr: -274> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x7fff033a3c50) adding con mode: secure 2024-09-14T11:08:27.680 INFO:tasks.workunit.client.0.smithi097.stderr: -273> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x7fff033a3c50) adding con mode: crc 2024-09-14T11:08:27.680 INFO:tasks.workunit.client.0.smithi097.stderr: -272> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x7fff033a3c50) adding con mode: secure 2024-09-14T11:08:27.680 INFO:tasks.workunit.client.0.smithi097.stderr: -271> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x7fff033a3c50) adding con mode: crc 2024-09-14T11:08:27.680 INFO:tasks.workunit.client.0.smithi097.stderr: -270> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x7fff033a3c50) adding con mode: secure 2024-09-14T11:08:27.680 INFO:tasks.workunit.client.0.smithi097.stderr: -269> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x7fff033a3c50) adding con mode: crc 2024-09-14T11:08:27.680 INFO:tasks.workunit.client.0.smithi097.stderr: -268> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x7fff033a3c50) adding con mode: crc 2024-09-14T11:08:27.680 INFO:tasks.workunit.client.0.smithi097.stderr: -267> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x7fff033a3c50) adding con mode: secure 2024-09-14T11:08:27.680 INFO:tasks.workunit.client.0.smithi097.stderr: -266> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x7fff033a3c50) adding con mode: crc 2024-09-14T11:08:27.680 INFO:tasks.workunit.client.0.smithi097.stderr: -265> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x7fff033a3c50) adding con mode: secure 2024-09-14T11:08:27.680 INFO:tasks.workunit.client.0.smithi097.stderr: -264> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x7fff033a3c50) adding con mode: crc 2024-09-14T11:08:27.680 INFO:tasks.workunit.client.0.smithi097.stderr: -263> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x7fff033a3c50) adding con mode: secure 2024-09-14T11:08:27.680 INFO:tasks.workunit.client.0.smithi097.stderr: -262> 2024-09-14T11:08:27.177+0000 7f7348412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:27.681 INFO:tasks.workunit.client.0.smithi097.stderr: -261> 2024-09-14T11:08:27.178+0000 7f7348412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:27.681 INFO:tasks.workunit.client.0.smithi097.stderr: -260> 2024-09-14T11:08:27.178+0000 7f7348412800 5 asok(0x55fa4ab3c270) register_command rotate-key cmddesc rotate-key hook 0x7fff033a3d98 EEXIST 2024-09-14T11:08:27.681 INFO:tasks.workunit.client.0.smithi097.stderr: -259> 2024-09-14T11:08:27.178+0000 7f7348412800 10 monclient: _reopen_session rank -1 2024-09-14T11:08:27.681 INFO:tasks.workunit.client.0.smithi097.stderr: -258> 2024-09-14T11:08:27.178+0000 7f7348412800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:08:27.681 INFO:tasks.workunit.client.0.smithi097.stderr: -257> 2024-09-14T11:08:27.178+0000 7f7348412800 10 monclient(hunting): picked mon.noname-a con 0x55fa4ae307c0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:08:27.681 INFO:tasks.workunit.client.0.smithi097.stderr: -256> 2024-09-14T11:08:27.178+0000 7f7348412800 10 monclient(hunting): picked mon.noname-c con 0x55fa4ae21110 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:08:27.681 INFO:tasks.workunit.client.0.smithi097.stderr: -255> 2024-09-14T11:08:27.178+0000 7f7348412800 10 monclient(hunting): picked mon.noname-b con 0x55fa4ae2bbf0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:08:27.681 INFO:tasks.workunit.client.0.smithi097.stderr: -254> 2024-09-14T11:08:27.178+0000 7f7348412800 10 monclient(hunting): start opening mon connection 2024-09-14T11:08:27.681 INFO:tasks.workunit.client.0.smithi097.stderr: -253> 2024-09-14T11:08:27.178+0000 7f7348412800 10 monclient(hunting): start opening mon connection 2024-09-14T11:08:27.681 INFO:tasks.workunit.client.0.smithi097.stderr: -252> 2024-09-14T11:08:27.178+0000 7f7348412800 10 monclient(hunting): start opening mon connection 2024-09-14T11:08:27.681 INFO:tasks.workunit.client.0.smithi097.stderr: -251> 2024-09-14T11:08:27.178+0000 7f7348412800 10 monclient(hunting): _renew_subs 2024-09-14T11:08:27.681 INFO:tasks.workunit.client.0.smithi097.stderr: -250> 2024-09-14T11:08:27.178+0000 7f7348412800 10 monclient(hunting): authenticate will time out at 2188.831224s 2024-09-14T11:08:27.681 INFO:tasks.workunit.client.0.smithi097.stderr: -249> 2024-09-14T11:08:27.178+0000 7f733b3df640 10 monclient(hunting): get_auth_request con 0x55fa4ae307c0 auth_method 0 2024-09-14T11:08:27.681 INFO:tasks.workunit.client.0.smithi097.stderr: -248> 2024-09-14T11:08:27.178+0000 7f733b3df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:08:27.681 INFO:tasks.workunit.client.0.smithi097.stderr: -247> 2024-09-14T11:08:27.178+0000 7f733b3df640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:08:27.682 INFO:tasks.workunit.client.0.smithi097.stderr: -246> 2024-09-14T11:08:27.178+0000 7f733b3df640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:08:27.682 INFO:tasks.workunit.client.0.smithi097.stderr: -245> 2024-09-14T11:08:27.178+0000 7f73443e1640 10 monclient(hunting): get_auth_request con 0x55fa4ae21110 auth_method 0 2024-09-14T11:08:27.682 INFO:tasks.workunit.client.0.smithi097.stderr: -244> 2024-09-14T11:08:27.178+0000 7f73443e1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:08:27.682 INFO:tasks.workunit.client.0.smithi097.stderr: -243> 2024-09-14T11:08:27.178+0000 7f73443e1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:08:27.683 INFO:tasks.workunit.client.0.smithi097.stderr: -242> 2024-09-14T11:08:27.178+0000 7f73443e1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:08:27.683 INFO:tasks.workunit.client.0.smithi097.stderr: -241> 2024-09-14T11:08:27.178+0000 7f733b3df640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:08:27.683 INFO:tasks.workunit.client.0.smithi097.stderr: -240> 2024-09-14T11:08:27.178+0000 7f733b3df640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:08:27.683 INFO:tasks.workunit.client.0.smithi097.stderr: -239> 2024-09-14T11:08:27.178+0000 7f733b3df640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:08:27.683 INFO:tasks.workunit.client.0.smithi097.stderr: -238> 2024-09-14T11:08:27.178+0000 7f73443e1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:08:27.684 INFO:tasks.workunit.client.0.smithi097.stderr: -237> 2024-09-14T11:08:27.178+0000 7f73443e1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:08:27.684 INFO:tasks.workunit.client.0.smithi097.stderr: -236> 2024-09-14T11:08:27.178+0000 7f73443e1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:08:27.684 INFO:tasks.workunit.client.0.smithi097.stderr: -235> 2024-09-14T11:08:27.178+0000 7f7343be0640 10 monclient(hunting): get_auth_request con 0x55fa4ae2bbf0 auth_method 0 2024-09-14T11:08:27.684 INFO:tasks.workunit.client.0.smithi097.stderr: -234> 2024-09-14T11:08:27.178+0000 7f7343be0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:08:27.684 INFO:tasks.workunit.client.0.smithi097.stderr: -233> 2024-09-14T11:08:27.178+0000 7f7343be0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:08:27.684 INFO:tasks.workunit.client.0.smithi097.stderr: -232> 2024-09-14T11:08:27.178+0000 7f7343be0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:08:27.684 INFO:tasks.workunit.client.0.smithi097.stderr: -231> 2024-09-14T11:08:27.178+0000 7f733b3df640 10 monclient(hunting): handle_auth_done global_id 8346 payload 274 2024-09-14T11:08:27.684 INFO:tasks.workunit.client.0.smithi097.stderr: -230> 2024-09-14T11:08:27.178+0000 7f733b3df640 10 monclient: _finish_hunting 0 2024-09-14T11:08:27.684 INFO:tasks.workunit.client.0.smithi097.stderr: -229> 2024-09-14T11:08:27.178+0000 7f733b3df640 1 monclient: found mon.noname-a 2024-09-14T11:08:27.684 INFO:tasks.workunit.client.0.smithi097.stderr: -228> 2024-09-14T11:08:27.178+0000 7f733b3df640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-14T11:08:27.684 INFO:tasks.workunit.client.0.smithi097.stderr: -227> 2024-09-14T11:08:27.178+0000 7f7222ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:08:27.684 INFO:tasks.workunit.client.0.smithi097.stderr: -226> 2024-09-14T11:08:27.178+0000 7f7222ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:08:27.684 INFO:tasks.workunit.client.0.smithi097.stderr: -225> 2024-09-14T11:08:27.178+0000 7f7222ffd640 10 monclient: dump: 2024-09-14T11:08:27.684 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:08:27.685 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:08:27.685 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:27.685 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:27.685 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:08:27.685 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:27.685 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:08:27.685 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:08:27.685 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:08:27.685 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:27.685 INFO:tasks.workunit.client.0.smithi097.stderr: -224> 2024-09-14T11:08:27.178+0000 7f7222ffd640 10 monclient: _finish_auth 0 2024-09-14T11:08:27.685 INFO:tasks.workunit.client.0.smithi097.stderr: -223> 2024-09-14T11:08:27.178+0000 7f7222ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:08:27.685 INFO:tasks.workunit.client.0.smithi097.stderr: -222> 2024-09-14T11:08:27.178+0000 7f7222ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:08:27.685 INFO:tasks.workunit.client.0.smithi097.stderr: -221> 2024-09-14T11:08:27.178+0000 7f7222ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:08:27.685 INFO:tasks.workunit.client.0.smithi097.stderr: -220> 2024-09-14T11:08:27.178+0000 7f7222ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:08:27.686 INFO:tasks.workunit.client.0.smithi097.stderr: -219> 2024-09-14T11:08:27.178+0000 7f7222ffd640 10 monclient: dump: 2024-09-14T11:08:27.686 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:08:27.686 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:08:27.686 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:27.686 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:27.686 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:08:27.686 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:27.686 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:08:27.686 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:08:27.686 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:08:27.686 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:27.686 INFO:tasks.workunit.client.0.smithi097.stderr: -218> 2024-09-14T11:08:27.178+0000 7f7348412800 5 monclient: authenticate success, global_id 8346 2024-09-14T11:08:27.686 INFO:tasks.workunit.client.0.smithi097.stderr: -217> 2024-09-14T11:08:27.178+0000 7f7348412800 10 monclient: get_monmap_and_config success 2024-09-14T11:08:27.686 INFO:tasks.workunit.client.0.smithi097.stderr: -216> 2024-09-14T11:08:27.178+0000 7f7348412800 4 set_mon_vals no callback set 2024-09-14T11:08:27.686 INFO:tasks.workunit.client.0.smithi097.stderr: -215> 2024-09-14T11:08:27.179+0000 7f7348412800 10 monclient: shutdown 2024-09-14T11:08:27.687 INFO:tasks.workunit.client.0.smithi097.stderr: -214> 2024-09-14T11:08:27.179+0000 7f7348412800 10 monclient: build_initial_monmap 2024-09-14T11:08:27.687 INFO:tasks.workunit.client.0.smithi097.stderr: -213> 2024-09-14T11:08:27.179+0000 7f7348412800 1 build_initial for_mkfs: 0 2024-09-14T11:08:27.687 INFO:tasks.workunit.client.0.smithi097.stderr: -212> 2024-09-14T11:08:27.179+0000 7f7348412800 10 monclient: monmap: 2024-09-14T11:08:27.687 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:08:27.687 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:08:27.687 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:08:27.687 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:08:27.687 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:08:27.687 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:27.687 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:08:27.687 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:08:27.687 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:08:27.687 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:27.687 INFO:tasks.workunit.client.0.smithi097.stderr: -211> 2024-09-14T11:08:27.179+0000 7f7348412800 5 AuthRegistry(0x55fa4adffd20) adding auth protocol: cephx 2024-09-14T11:08:27.687 INFO:tasks.workunit.client.0.smithi097.stderr: -210> 2024-09-14T11:08:27.179+0000 7f7348412800 5 AuthRegistry(0x55fa4adffd20) adding auth protocol: cephx 2024-09-14T11:08:27.688 INFO:tasks.workunit.client.0.smithi097.stderr: -209> 2024-09-14T11:08:27.179+0000 7f7348412800 5 AuthRegistry(0x55fa4adffd20) adding auth protocol: cephx 2024-09-14T11:08:27.688 INFO:tasks.workunit.client.0.smithi097.stderr: -208> 2024-09-14T11:08:27.179+0000 7f7348412800 5 AuthRegistry(0x55fa4adffd20) adding con mode: secure 2024-09-14T11:08:27.688 INFO:tasks.workunit.client.0.smithi097.stderr: -207> 2024-09-14T11:08:27.179+0000 7f7348412800 5 AuthRegistry(0x55fa4adffd20) adding con mode: crc 2024-09-14T11:08:27.688 INFO:tasks.workunit.client.0.smithi097.stderr: -206> 2024-09-14T11:08:27.179+0000 7f7348412800 5 AuthRegistry(0x55fa4adffd20) adding con mode: secure 2024-09-14T11:08:27.688 INFO:tasks.workunit.client.0.smithi097.stderr: -205> 2024-09-14T11:08:27.179+0000 7f7348412800 5 AuthRegistry(0x55fa4adffd20) adding con mode: crc 2024-09-14T11:08:27.688 INFO:tasks.workunit.client.0.smithi097.stderr: -204> 2024-09-14T11:08:27.179+0000 7f7348412800 5 AuthRegistry(0x55fa4adffd20) adding con mode: secure 2024-09-14T11:08:27.688 INFO:tasks.workunit.client.0.smithi097.stderr: -203> 2024-09-14T11:08:27.179+0000 7f7348412800 5 AuthRegistry(0x55fa4adffd20) adding con mode: crc 2024-09-14T11:08:27.688 INFO:tasks.workunit.client.0.smithi097.stderr: -202> 2024-09-14T11:08:27.179+0000 7f7348412800 5 AuthRegistry(0x55fa4adffd20) adding con mode: crc 2024-09-14T11:08:27.688 INFO:tasks.workunit.client.0.smithi097.stderr: -201> 2024-09-14T11:08:27.179+0000 7f7348412800 5 AuthRegistry(0x55fa4adffd20) adding con mode: secure 2024-09-14T11:08:27.688 INFO:tasks.workunit.client.0.smithi097.stderr: -200> 2024-09-14T11:08:27.179+0000 7f7348412800 5 AuthRegistry(0x55fa4adffd20) adding con mode: crc 2024-09-14T11:08:27.688 INFO:tasks.workunit.client.0.smithi097.stderr: -199> 2024-09-14T11:08:27.179+0000 7f7348412800 5 AuthRegistry(0x55fa4adffd20) adding con mode: secure 2024-09-14T11:08:27.688 INFO:tasks.workunit.client.0.smithi097.stderr: -198> 2024-09-14T11:08:27.179+0000 7f7348412800 5 AuthRegistry(0x55fa4adffd20) adding con mode: crc 2024-09-14T11:08:27.688 INFO:tasks.workunit.client.0.smithi097.stderr: -197> 2024-09-14T11:08:27.179+0000 7f7348412800 5 AuthRegistry(0x55fa4adffd20) adding con mode: secure 2024-09-14T11:08:27.688 INFO:tasks.workunit.client.0.smithi097.stderr: -196> 2024-09-14T11:08:27.179+0000 7f7348412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:27.688 INFO:tasks.workunit.client.0.smithi097.stderr: -195> 2024-09-14T11:08:27.179+0000 7f7348412800 1 librados: starting msgr at 2024-09-14T11:08:27.689 INFO:tasks.workunit.client.0.smithi097.stderr: -194> 2024-09-14T11:08:27.179+0000 7f7348412800 1 librados: starting objecter 2024-09-14T11:08:27.689 INFO:tasks.workunit.client.0.smithi097.stderr: -193> 2024-09-14T11:08:27.180+0000 7f7348412800 5 asok(0x55fa4ab3c270) register_command objecter_requests cmddesc objecter_requests hook 0x55fa4ae01780 EEXIST 2024-09-14T11:08:27.689 INFO:tasks.workunit.client.0.smithi097.stderr: -192> 2024-09-14T11:08:27.180+0000 7f7348412800 1 librados: setting wanted keys 2024-09-14T11:08:27.689 INFO:tasks.workunit.client.0.smithi097.stderr: -191> 2024-09-14T11:08:27.180+0000 7f7348412800 1 librados: calling monclient init 2024-09-14T11:08:27.689 INFO:tasks.workunit.client.0.smithi097.stderr: -190> 2024-09-14T11:08:27.180+0000 7f7348412800 10 monclient: init 2024-09-14T11:08:27.689 INFO:tasks.workunit.client.0.smithi097.stderr: -189> 2024-09-14T11:08:27.180+0000 7f7348412800 5 AuthRegistry(0x55fa4adf0b00) adding auth protocol: cephx 2024-09-14T11:08:27.689 INFO:tasks.workunit.client.0.smithi097.stderr: -188> 2024-09-14T11:08:27.180+0000 7f7348412800 5 AuthRegistry(0x55fa4adf0b00) adding auth protocol: cephx 2024-09-14T11:08:27.689 INFO:tasks.workunit.client.0.smithi097.stderr: -187> 2024-09-14T11:08:27.180+0000 7f7348412800 5 AuthRegistry(0x55fa4adf0b00) adding auth protocol: cephx 2024-09-14T11:08:27.689 INFO:tasks.workunit.client.0.smithi097.stderr: -186> 2024-09-14T11:08:27.180+0000 7f7348412800 5 AuthRegistry(0x55fa4adf0b00) adding con mode: secure 2024-09-14T11:08:27.689 INFO:tasks.workunit.client.0.smithi097.stderr: -185> 2024-09-14T11:08:27.180+0000 7f7348412800 5 AuthRegistry(0x55fa4adf0b00) adding con mode: crc 2024-09-14T11:08:27.689 INFO:tasks.workunit.client.0.smithi097.stderr: -184> 2024-09-14T11:08:27.180+0000 7f7348412800 5 AuthRegistry(0x55fa4adf0b00) adding con mode: secure 2024-09-14T11:08:27.689 INFO:tasks.workunit.client.0.smithi097.stderr: -183> 2024-09-14T11:08:27.180+0000 7f7348412800 5 AuthRegistry(0x55fa4adf0b00) adding con mode: crc 2024-09-14T11:08:27.689 INFO:tasks.workunit.client.0.smithi097.stderr: -182> 2024-09-14T11:08:27.180+0000 7f7348412800 5 AuthRegistry(0x55fa4adf0b00) adding con mode: secure 2024-09-14T11:08:27.689 INFO:tasks.workunit.client.0.smithi097.stderr: -181> 2024-09-14T11:08:27.180+0000 7f7348412800 5 AuthRegistry(0x55fa4adf0b00) adding con mode: crc 2024-09-14T11:08:27.689 INFO:tasks.workunit.client.0.smithi097.stderr: -180> 2024-09-14T11:08:27.180+0000 7f7348412800 5 AuthRegistry(0x55fa4adf0b00) adding con mode: crc 2024-09-14T11:08:27.689 INFO:tasks.workunit.client.0.smithi097.stderr: -179> 2024-09-14T11:08:27.180+0000 7f7348412800 5 AuthRegistry(0x55fa4adf0b00) adding con mode: secure 2024-09-14T11:08:27.690 INFO:tasks.workunit.client.0.smithi097.stderr: -178> 2024-09-14T11:08:27.180+0000 7f7348412800 5 AuthRegistry(0x55fa4adf0b00) adding con mode: crc 2024-09-14T11:08:27.690 INFO:tasks.workunit.client.0.smithi097.stderr: -177> 2024-09-14T11:08:27.180+0000 7f7348412800 5 AuthRegistry(0x55fa4adf0b00) adding con mode: secure 2024-09-14T11:08:27.690 INFO:tasks.workunit.client.0.smithi097.stderr: -176> 2024-09-14T11:08:27.180+0000 7f7348412800 5 AuthRegistry(0x55fa4adf0b00) adding con mode: crc 2024-09-14T11:08:27.690 INFO:tasks.workunit.client.0.smithi097.stderr: -175> 2024-09-14T11:08:27.180+0000 7f7348412800 5 AuthRegistry(0x55fa4adf0b00) adding con mode: secure 2024-09-14T11:08:27.690 INFO:tasks.workunit.client.0.smithi097.stderr: -174> 2024-09-14T11:08:27.180+0000 7f7348412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:27.690 INFO:tasks.workunit.client.0.smithi097.stderr: -173> 2024-09-14T11:08:27.180+0000 7f7348412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:27.690 INFO:tasks.workunit.client.0.smithi097.stderr: -172> 2024-09-14T11:08:27.180+0000 7f7348412800 5 asok(0x55fa4ab3c270) register_command rotate-key cmddesc rotate-key hook 0x55fa4adf0c48 EEXIST 2024-09-14T11:08:27.690 INFO:tasks.workunit.client.0.smithi097.stderr: -171> 2024-09-14T11:08:27.180+0000 7f7348412800 10 monclient: _reopen_session rank -1 2024-09-14T11:08:27.690 INFO:tasks.workunit.client.0.smithi097.stderr: -170> 2024-09-14T11:08:27.180+0000 7f7348412800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:08:27.690 INFO:tasks.workunit.client.0.smithi097.stderr: -169> 2024-09-14T11:08:27.180+0000 7f7348412800 10 monclient(hunting): picked mon.noname-a con 0x55fa4ae21110 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:08:27.690 INFO:tasks.workunit.client.0.smithi097.stderr: -168> 2024-09-14T11:08:27.180+0000 7f7348412800 10 monclient(hunting): picked mon.noname-b con 0x55fa4ae2bbf0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:08:27.690 INFO:tasks.workunit.client.0.smithi097.stderr: -167> 2024-09-14T11:08:27.180+0000 7f7348412800 10 monclient(hunting): picked mon.noname-c con 0x55fa4ae307c0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:08:27.690 INFO:tasks.workunit.client.0.smithi097.stderr: -166> 2024-09-14T11:08:27.180+0000 7f7348412800 10 monclient(hunting): start opening mon connection 2024-09-14T11:08:27.690 INFO:tasks.workunit.client.0.smithi097.stderr: -165> 2024-09-14T11:08:27.180+0000 7f7348412800 10 monclient(hunting): start opening mon connection 2024-09-14T11:08:27.690 INFO:tasks.workunit.client.0.smithi097.stderr: -164> 2024-09-14T11:08:27.180+0000 7f7348412800 10 monclient(hunting): start opening mon connection 2024-09-14T11:08:27.691 INFO:tasks.workunit.client.0.smithi097.stderr: -163> 2024-09-14T11:08:27.180+0000 7f7348412800 10 monclient(hunting): _renew_subs 2024-09-14T11:08:27.691 INFO:tasks.workunit.client.0.smithi097.stderr: -162> 2024-09-14T11:08:27.180+0000 7f7348412800 10 monclient(hunting): authenticate will time out at 2188.833674s 2024-09-14T11:08:27.691 INFO:tasks.workunit.client.0.smithi097.stderr: -161> 2024-09-14T11:08:27.180+0000 7f7343be0640 10 monclient(hunting): get_auth_request con 0x55fa4ae307c0 auth_method 0 2024-09-14T11:08:27.691 INFO:tasks.workunit.client.0.smithi097.stderr: -160> 2024-09-14T11:08:27.180+0000 7f7343be0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:08:27.691 INFO:tasks.workunit.client.0.smithi097.stderr: -159> 2024-09-14T11:08:27.180+0000 7f7343be0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:08:27.691 INFO:tasks.workunit.client.0.smithi097.stderr: -158> 2024-09-14T11:08:27.180+0000 7f7343be0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:08:27.691 INFO:tasks.workunit.client.0.smithi097.stderr: -157> 2024-09-14T11:08:27.180+0000 7f733b3df640 10 monclient(hunting): get_auth_request con 0x55fa4ae21110 auth_method 0 2024-09-14T11:08:27.691 INFO:tasks.workunit.client.0.smithi097.stderr: -156> 2024-09-14T11:08:27.180+0000 7f733b3df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:08:27.691 INFO:tasks.workunit.client.0.smithi097.stderr: -155> 2024-09-14T11:08:27.180+0000 7f733b3df640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:08:27.691 INFO:tasks.workunit.client.0.smithi097.stderr: -154> 2024-09-14T11:08:27.180+0000 7f733b3df640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:08:27.691 INFO:tasks.workunit.client.0.smithi097.stderr: -153> 2024-09-14T11:08:27.180+0000 7f7343be0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:08:27.691 INFO:tasks.workunit.client.0.smithi097.stderr: -152> 2024-09-14T11:08:27.180+0000 7f7343be0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:08:27.691 INFO:tasks.workunit.client.0.smithi097.stderr: -151> 2024-09-14T11:08:27.180+0000 7f7343be0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:08:27.691 INFO:tasks.workunit.client.0.smithi097.stderr: -150> 2024-09-14T11:08:27.180+0000 7f733b3df640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:08:27.691 INFO:tasks.workunit.client.0.smithi097.stderr: -149> 2024-09-14T11:08:27.180+0000 7f733b3df640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:08:27.692 INFO:tasks.workunit.client.0.smithi097.stderr: -148> 2024-09-14T11:08:27.180+0000 7f733b3df640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:08:27.692 INFO:tasks.workunit.client.0.smithi097.stderr: -147> 2024-09-14T11:08:27.180+0000 7f73443e1640 10 monclient(hunting): get_auth_request con 0x55fa4ae2bbf0 auth_method 0 2024-09-14T11:08:27.692 INFO:tasks.workunit.client.0.smithi097.stderr: -146> 2024-09-14T11:08:27.180+0000 7f73443e1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:08:27.692 INFO:tasks.workunit.client.0.smithi097.stderr: -145> 2024-09-14T11:08:27.180+0000 7f73443e1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:08:27.692 INFO:tasks.workunit.client.0.smithi097.stderr: -144> 2024-09-14T11:08:27.180+0000 7f73443e1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:08:27.692 INFO:tasks.workunit.client.0.smithi097.stderr: -143> 2024-09-14T11:08:27.181+0000 7f7343be0640 10 monclient(hunting): handle_auth_done global_id 7826 payload 824 2024-09-14T11:08:27.692 INFO:tasks.workunit.client.0.smithi097.stderr: -142> 2024-09-14T11:08:27.181+0000 7f7343be0640 10 monclient: _finish_hunting 0 2024-09-14T11:08:27.692 INFO:tasks.workunit.client.0.smithi097.stderr: -141> 2024-09-14T11:08:27.181+0000 7f7343be0640 1 monclient: found mon.noname-c 2024-09-14T11:08:27.692 INFO:tasks.workunit.client.0.smithi097.stderr: -140> 2024-09-14T11:08:27.181+0000 7f7343be0640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:08:27.692 INFO:tasks.workunit.client.0.smithi097.stderr: -139> 2024-09-14T11:08:27.181+0000 7f72217fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:08:27.692 INFO:tasks.workunit.client.0.smithi097.stderr: -138> 2024-09-14T11:08:27.181+0000 7f72217fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:08:27.692 INFO:tasks.workunit.client.0.smithi097.stderr: -137> 2024-09-14T11:08:27.181+0000 7f72217fa640 10 monclient: dump: 2024-09-14T11:08:27.692 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:08:27.692 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:08:27.693 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:27.693 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:27.693 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:08:27.693 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:27.693 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:08:27.693 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:08:27.693 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:08:27.693 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:27.693 INFO:tasks.workunit.client.0.smithi097.stderr: -136> 2024-09-14T11:08:27.181+0000 7f72217fa640 10 monclient: _finish_auth 0 2024-09-14T11:08:27.693 INFO:tasks.workunit.client.0.smithi097.stderr: -135> 2024-09-14T11:08:27.181+0000 7f72217fa640 10 monclient: _check_auth_tickets 2024-09-14T11:08:27.693 INFO:tasks.workunit.client.0.smithi097.stderr: -134> 2024-09-14T11:08:27.181+0000 7f72217fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:08:27.693 INFO:tasks.workunit.client.0.smithi097.stderr: -133> 2024-09-14T11:08:27.181+0000 7f72217fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:08:27.693 INFO:tasks.workunit.client.0.smithi097.stderr: -132> 2024-09-14T11:08:27.181+0000 7f72217fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:08:27.693 INFO:tasks.workunit.client.0.smithi097.stderr: -131> 2024-09-14T11:08:27.181+0000 7f72217fa640 10 monclient: dump: 2024-09-14T11:08:27.693 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:08:27.694 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:08:27.694 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:27.694 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:27.694 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:08:27.694 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:27.694 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:08:27.694 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:08:27.694 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:08:27.694 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:27.694 INFO:tasks.workunit.client.0.smithi097.stderr: -130> 2024-09-14T11:08:27.181+0000 7f7348412800 5 monclient: authenticate success, global_id 7826 2024-09-14T11:08:27.694 INFO:tasks.workunit.client.0.smithi097.stderr: -129> 2024-09-14T11:08:27.181+0000 7f7222ffd640 4 set_mon_vals no callback set 2024-09-14T11:08:27.694 INFO:tasks.workunit.client.0.smithi097.stderr: -128> 2024-09-14T11:08:27.181+0000 7f7348412800 10 monclient: _renew_subs 2024-09-14T11:08:27.694 INFO:tasks.workunit.client.0.smithi097.stderr: -127> 2024-09-14T11:08:27.181+0000 7f7348412800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:08:27.694 INFO:tasks.workunit.client.0.smithi097.stderr: -126> 2024-09-14T11:08:27.181+0000 7f7348412800 10 monclient: _renew_subs 2024-09-14T11:08:27.695 INFO:tasks.workunit.client.0.smithi097.stderr: -125> 2024-09-14T11:08:27.181+0000 7f7348412800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:08:27.695 INFO:tasks.workunit.client.0.smithi097.stderr: -124> 2024-09-14T11:08:27.181+0000 7f7348412800 1 librados: init done 2024-09-14T11:08:27.695 INFO:tasks.workunit.client.0.smithi097.stderr: -123> 2024-09-14T11:08:27.181+0000 7f7348412800 5 asok(0x55fa4ab3c270) register_command cr dump hook 0x55fa4ae2a088 2024-09-14T11:08:27.695 INFO:tasks.workunit.client.0.smithi097.stderr: -122> 2024-09-14T11:08:27.183+0000 7f7348412800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.695 INFO:tasks.workunit.client.0.smithi097.stderr: -121> 2024-09-14T11:08:27.183+0000 7f72217fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:08:27.695 INFO:tasks.workunit.client.0.smithi097.stderr: -120> 2024-09-14T11:08:27.183+0000 7f72217fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:08:27.695 INFO:tasks.workunit.client.0.smithi097.stderr: -119> 2024-09-14T11:08:27.183+0000 7f72217fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:08:27.695 INFO:tasks.workunit.client.0.smithi097.stderr: -118> 2024-09-14T11:08:27.183+0000 7f733b3df640 10 monclient: get_auth_request con 0x7f720c077230 auth_method 0 2024-09-14T11:08:27.695 INFO:tasks.workunit.client.0.smithi097.stderr: -117> 2024-09-14T11:08:27.184+0000 7f73443e1640 10 monclient: get_auth_request con 0x55fa4ae4ac60 auth_method 0 2024-09-14T11:08:27.695 INFO:tasks.workunit.client.0.smithi097.stderr: -116> 2024-09-14T11:08:27.184+0000 7f7348412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:27.695 INFO:tasks.workunit.client.0.smithi097.stderr: -115> 2024-09-14T11:08:27.184+0000 7f7348412800 20 realm 2024-09-14T11:08:27.695 INFO:tasks.workunit.client.0.smithi097.stderr: -114> 2024-09-14T11:08:27.184+0000 7f7348412800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.695 INFO:tasks.workunit.client.0.smithi097.stderr: -113> 2024-09-14T11:08:27.185+0000 7f7348412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:27.695 INFO:tasks.workunit.client.0.smithi097.stderr: -112> 2024-09-14T11:08:27.185+0000 7f7348412800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:08:27.696 INFO:tasks.workunit.client.0.smithi097.stderr: -111> 2024-09-14T11:08:27.185+0000 7f7348412800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.696 INFO:tasks.workunit.client.0.smithi097.stderr: -110> 2024-09-14T11:08:27.185+0000 7f7348412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:27.696 INFO:tasks.workunit.client.0.smithi097.stderr: -109> 2024-09-14T11:08:27.185+0000 7f7348412800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.696 INFO:tasks.workunit.client.0.smithi097.stderr: -108> 2024-09-14T11:08:27.185+0000 7f733b3df640 10 monclient: get_auth_request con 0x55fa4ae4eec0 auth_method 0 2024-09-14T11:08:27.696 INFO:tasks.workunit.client.0.smithi097.stderr: -107> 2024-09-14T11:08:27.186+0000 7f7348412800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:08:27.696 INFO:tasks.workunit.client.0.smithi097.stderr: -106> 2024-09-14T11:08:27.186+0000 7f7348412800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.696 INFO:tasks.workunit.client.0.smithi097.stderr: -105> 2024-09-14T11:08:27.186+0000 7f73443e1640 10 monclient: get_auth_request con 0x55fa4ae52790 auth_method 0 2024-09-14T11:08:27.696 INFO:tasks.workunit.client.0.smithi097.stderr: -104> 2024-09-14T11:08:27.187+0000 7f7348412800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:08:27.696 INFO:tasks.workunit.client.0.smithi097.stderr: -103> 2024-09-14T11:08:27.187+0000 7f7348412800 20 searching for the correct realm 2024-09-14T11:08:27.696 INFO:tasks.workunit.client.0.smithi097.stderr: -102> 2024-09-14T11:08:27.187+0000 7f7343be0640 10 monclient: get_auth_request con 0x55fa4ae57490 auth_method 0 2024-09-14T11:08:27.696 INFO:tasks.workunit.client.0.smithi097.stderr: -101> 2024-09-14T11:08:27.188+0000 7f733b3df640 0 -- 172.21.15.97:0/625851093 >> [v2:172.21.15.97:6808/2081705332,v1:172.21.15.97:6809/2081705332] conn(0x7f733405dc40 msgr2=0x7f73340853d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:08:27.696 INFO:tasks.workunit.client.0.smithi097.stderr: -100> 2024-09-14T11:08:27.389+0000 7f733b3df640 10 monclient: get_auth_request con 0x7f733405dc40 auth_method 0 2024-09-14T11:08:27.696 INFO:tasks.workunit.client.0.smithi097.stderr: -99> 2024-09-14T11:08:27.391+0000 7f73443e1640 10 monclient: get_auth_request con 0x7f732c04d040 auth_method 0 2024-09-14T11:08:27.696 INFO:tasks.workunit.client.0.smithi097.stderr: -98> 2024-09-14T11:08:27.394+0000 7f7343be0640 10 monclient: get_auth_request con 0x7f732c01b040 auth_method 0 2024-09-14T11:08:27.697 INFO:tasks.workunit.client.0.smithi097.stderr: -97> 2024-09-14T11:08:27.394+0000 7f7343be0640 0 -- 172.21.15.97:0/625851093 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7f732c01b040 msgr2=0x7f732c04c410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:08:27.697 INFO:tasks.workunit.client.0.smithi097.stderr: -96> 2024-09-14T11:08:27.596+0000 7f7343be0640 10 monclient: get_auth_request con 0x7f732c01b040 auth_method 0 2024-09-14T11:08:27.697 INFO:tasks.workunit.client.0.smithi097.stderr: -95> 2024-09-14T11:08:27.597+0000 7f733b3df640 10 monclient: get_auth_request con 0x7f733404b000 auth_method 0 2024-09-14T11:08:27.697 INFO:tasks.workunit.client.0.smithi097.stderr: -94> 2024-09-14T11:08:27.604+0000 7f7348412800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:08:27.697 INFO:tasks.workunit.client.0.smithi097.stderr: -93> 2024-09-14T11:08:27.604+0000 7f7348412800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:08:27.697 INFO:tasks.workunit.client.0.smithi097.stderr: -92> 2024-09-14T11:08:27.604+0000 7f7348412800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:08:27.697 INFO:tasks.workunit.client.0.smithi097.stderr: -91> 2024-09-14T11:08:27.604+0000 7f7348412800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:08:27.697 INFO:tasks.workunit.client.0.smithi097.stderr: -90> 2024-09-14T11:08:27.604+0000 7f7348412800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:08:27.697 INFO:tasks.workunit.client.0.smithi097.stderr: -89> 2024-09-14T11:08:27.604+0000 7f7348412800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:08:27.697 INFO:tasks.workunit.client.0.smithi097.stderr: -88> 2024-09-14T11:08:27.604+0000 7f7348412800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.697 INFO:tasks.workunit.client.0.smithi097.stderr: -87> 2024-09-14T11:08:27.604+0000 7f7348412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:27.697 INFO:tasks.workunit.client.0.smithi097.stderr: -86> 2024-09-14T11:08:27.604+0000 7f7348412800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.697 INFO:tasks.workunit.client.0.smithi097.stderr: -85> 2024-09-14T11:08:27.604+0000 7f7348412800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:08:27.698 INFO:tasks.workunit.client.0.smithi097.stderr: -84> 2024-09-14T11:08:27.604+0000 7f7348412800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.698 INFO:tasks.workunit.client.0.smithi097.stderr: -83> 2024-09-14T11:08:27.605+0000 7f7348412800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:08:27.698 INFO:tasks.workunit.client.0.smithi097.stderr: -82> 2024-09-14T11:08:27.605+0000 7f7348412800 20 zone default found 2024-09-14T11:08:27.698 INFO:tasks.workunit.client.0.smithi097.stderr: -81> 2024-09-14T11:08:27.605+0000 7f7348412800 4 Realm: () 2024-09-14T11:08:27.698 INFO:tasks.workunit.client.0.smithi097.stderr: -80> 2024-09-14T11:08:27.605+0000 7f7348412800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:08:27.698 INFO:tasks.workunit.client.0.smithi097.stderr: -79> 2024-09-14T11:08:27.605+0000 7f7348412800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:08:27.698 INFO:tasks.workunit.client.0.smithi097.stderr: -78> 2024-09-14T11:08:27.605+0000 7f7348412800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:08:27.698 INFO:tasks.workunit.client.0.smithi097.stderr: -77> 2024-09-14T11:08:27.605+0000 7f7348412800 20 zonegroup default 2024-09-14T11:08:27.698 INFO:tasks.workunit.client.0.smithi097.stderr: -76> 2024-09-14T11:08:27.605+0000 7f7348412800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.698 INFO:tasks.workunit.client.0.smithi097.stderr: -75> 2024-09-14T11:08:27.605+0000 7f7348412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:27.698 INFO:tasks.workunit.client.0.smithi097.stderr: -74> 2024-09-14T11:08:27.605+0000 7f7348412800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.698 INFO:tasks.workunit.client.0.smithi097.stderr: -73> 2024-09-14T11:08:27.606+0000 7f7348412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:27.698 INFO:tasks.workunit.client.0.smithi097.stderr: -72> 2024-09-14T11:08:27.606+0000 7f7348412800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.698 INFO:tasks.workunit.client.0.smithi097.stderr: -71> 2024-09-14T11:08:27.606+0000 7f7348412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:27.699 INFO:tasks.workunit.client.0.smithi097.stderr: -70> 2024-09-14T11:08:27.606+0000 7f7348412800 20 started sync module instance, tier type = 2024-09-14T11:08:27.699 INFO:tasks.workunit.client.0.smithi097.stderr: -69> 2024-09-14T11:08:27.606+0000 7f7348412800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:08:27.699 INFO:tasks.workunit.client.0.smithi097.stderr: -68> 2024-09-14T11:08:27.617+0000 7f7348412800 20 add_watcher() i=0 2024-09-14T11:08:27.699 INFO:tasks.workunit.client.0.smithi097.stderr: -67> 2024-09-14T11:08:27.617+0000 7f7348412800 20 add_watcher() i=1 2024-09-14T11:08:27.699 INFO:tasks.workunit.client.0.smithi097.stderr: -66> 2024-09-14T11:08:27.617+0000 7f7348412800 20 add_watcher() i=2 2024-09-14T11:08:27.699 INFO:tasks.workunit.client.0.smithi097.stderr: -65> 2024-09-14T11:08:27.617+0000 7f7348412800 20 add_watcher() i=3 2024-09-14T11:08:27.699 INFO:tasks.workunit.client.0.smithi097.stderr: -64> 2024-09-14T11:08:27.617+0000 7f7348412800 20 add_watcher() i=4 2024-09-14T11:08:27.699 INFO:tasks.workunit.client.0.smithi097.stderr: -63> 2024-09-14T11:08:27.617+0000 7f7348412800 20 add_watcher() i=5 2024-09-14T11:08:27.699 INFO:tasks.workunit.client.0.smithi097.stderr: -62> 2024-09-14T11:08:27.617+0000 7f7348412800 20 add_watcher() i=6 2024-09-14T11:08:27.699 INFO:tasks.workunit.client.0.smithi097.stderr: -61> 2024-09-14T11:08:27.618+0000 7f7348412800 20 add_watcher() i=7 2024-09-14T11:08:27.699 INFO:tasks.workunit.client.0.smithi097.stderr: -60> 2024-09-14T11:08:27.618+0000 7f7348412800 2 all 8 watchers are set, enabling cache 2024-09-14T11:08:27.699 INFO:tasks.workunit.client.0.smithi097.stderr: -59> 2024-09-14T11:08:27.620+0000 7f7348412800 5 AuthRegistry(0x7fff033a4130) adding auth protocol: cephx 2024-09-14T11:08:27.699 INFO:tasks.workunit.client.0.smithi097.stderr: -58> 2024-09-14T11:08:27.620+0000 7f7348412800 5 AuthRegistry(0x7fff033a4130) adding auth protocol: cephx 2024-09-14T11:08:27.699 INFO:tasks.workunit.client.0.smithi097.stderr: -57> 2024-09-14T11:08:27.620+0000 7f7348412800 5 AuthRegistry(0x7fff033a4130) adding auth protocol: cephx 2024-09-14T11:08:27.700 INFO:tasks.workunit.client.0.smithi097.stderr: -56> 2024-09-14T11:08:27.620+0000 7f7348412800 5 AuthRegistry(0x7fff033a4130) adding con mode: secure 2024-09-14T11:08:27.700 INFO:tasks.workunit.client.0.smithi097.stderr: -55> 2024-09-14T11:08:27.620+0000 7f7348412800 5 AuthRegistry(0x7fff033a4130) adding con mode: crc 2024-09-14T11:08:27.700 INFO:tasks.workunit.client.0.smithi097.stderr: -54> 2024-09-14T11:08:27.620+0000 7f7348412800 5 AuthRegistry(0x7fff033a4130) adding con mode: secure 2024-09-14T11:08:27.700 INFO:tasks.workunit.client.0.smithi097.stderr: -53> 2024-09-14T11:08:27.620+0000 7f7348412800 5 AuthRegistry(0x7fff033a4130) adding con mode: crc 2024-09-14T11:08:27.700 INFO:tasks.workunit.client.0.smithi097.stderr: -52> 2024-09-14T11:08:27.620+0000 7f7348412800 5 AuthRegistry(0x7fff033a4130) adding con mode: secure 2024-09-14T11:08:27.700 INFO:tasks.workunit.client.0.smithi097.stderr: -51> 2024-09-14T11:08:27.620+0000 7f7348412800 5 AuthRegistry(0x7fff033a4130) adding con mode: crc 2024-09-14T11:08:27.700 INFO:tasks.workunit.client.0.smithi097.stderr: -50> 2024-09-14T11:08:27.620+0000 7f7348412800 5 AuthRegistry(0x7fff033a4130) adding con mode: crc 2024-09-14T11:08:27.700 INFO:tasks.workunit.client.0.smithi097.stderr: -49> 2024-09-14T11:08:27.620+0000 7f7348412800 5 AuthRegistry(0x7fff033a4130) adding con mode: secure 2024-09-14T11:08:27.700 INFO:tasks.workunit.client.0.smithi097.stderr: -48> 2024-09-14T11:08:27.620+0000 7f7348412800 5 AuthRegistry(0x7fff033a4130) adding con mode: crc 2024-09-14T11:08:27.700 INFO:tasks.workunit.client.0.smithi097.stderr: -47> 2024-09-14T11:08:27.620+0000 7f7348412800 5 AuthRegistry(0x7fff033a4130) adding con mode: secure 2024-09-14T11:08:27.700 INFO:tasks.workunit.client.0.smithi097.stderr: -46> 2024-09-14T11:08:27.620+0000 7f7348412800 5 AuthRegistry(0x7fff033a4130) adding con mode: crc 2024-09-14T11:08:27.700 INFO:tasks.workunit.client.0.smithi097.stderr: -45> 2024-09-14T11:08:27.620+0000 7f7348412800 5 AuthRegistry(0x7fff033a4130) adding con mode: secure 2024-09-14T11:08:27.700 INFO:tasks.workunit.client.0.smithi097.stderr: -44> 2024-09-14T11:08:27.620+0000 7f71f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:08:27.700 INFO:tasks.workunit.client.0.smithi097.stderr: -43> 2024-09-14T11:08:27.620+0000 7f7348412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:27.701 INFO:tasks.workunit.client.0.smithi097.stderr: -42> 2024-09-14T11:08:27.620+0000 7f7348412800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:08:27.701 INFO:tasks.workunit.client.0.smithi097.stderr: -41> 2024-09-14T11:08:27.620+0000 7f7348412800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:08:27.701 INFO:tasks.workunit.client.0.smithi097.stderr: -40> 2024-09-14T11:08:27.621+0000 7f7348412800 5 asok(0x55fa4ab3c270) register_command cache list hook 0x55fa4ae1ffb0 2024-09-14T11:08:27.701 INFO:tasks.workunit.client.0.smithi097.stderr: -39> 2024-09-14T11:08:27.621+0000 7f7348412800 5 asok(0x55fa4ab3c270) register_command cache inspect hook 0x55fa4ae1ffb0 2024-09-14T11:08:27.701 INFO:tasks.workunit.client.0.smithi097.stderr: -38> 2024-09-14T11:08:27.621+0000 7f7348412800 5 asok(0x55fa4ab3c270) register_command cache erase hook 0x55fa4ae1ffb0 2024-09-14T11:08:27.701 INFO:tasks.workunit.client.0.smithi097.stderr: -37> 2024-09-14T11:08:27.621+0000 7f7348412800 5 asok(0x55fa4ab3c270) register_command cache zap hook 0x55fa4ae1ffb0 2024-09-14T11:08:27.701 INFO:tasks.workunit.client.0.smithi097.stderr: -36> 2024-09-14T11:08:27.621+0000 7f7348412800 5 note: GC not initialized 2024-09-14T11:08:27.701 INFO:tasks.workunit.client.0.smithi097.stderr: -35> 2024-09-14T11:08:27.621+0000 7f71f8fe1640 20 reqs_thread_entry: start 2024-09-14T11:08:27.701 INFO:tasks.workunit.client.0.smithi097.stderr: -34> 2024-09-14T11:08:27.621+0000 7f7348412800 5 asok(0x55fa4ab3c270) register_command sync trace show hook 0x7f732c001790 2024-09-14T11:08:27.701 INFO:tasks.workunit.client.0.smithi097.stderr: -33> 2024-09-14T11:08:27.621+0000 7f7348412800 5 asok(0x55fa4ab3c270) register_command sync trace history hook 0x7f732c001790 2024-09-14T11:08:27.701 INFO:tasks.workunit.client.0.smithi097.stderr: -32> 2024-09-14T11:08:27.621+0000 7f7348412800 5 asok(0x55fa4ab3c270) register_command sync trace active hook 0x7f732c001790 2024-09-14T11:08:27.701 INFO:tasks.workunit.client.0.smithi097.stderr: -31> 2024-09-14T11:08:27.621+0000 7f7348412800 5 asok(0x55fa4ab3c270) register_command sync trace active_short hook 0x7f732c001790 2024-09-14T11:08:27.701 INFO:tasks.workunit.client.0.smithi097.stderr: -30> 2024-09-14T11:08:27.621+0000 7f7348412800 20 init_complete bucket index max shards: 11 2024-09-14T11:08:27.701 INFO:tasks.workunit.client.0.smithi097.stderr: -29> 2024-09-14T11:08:27.621+0000 7f7348412800 20 Filter name: none 2024-09-14T11:08:27.702 INFO:tasks.workunit.client.0.smithi097.stderr: -28> 2024-09-14T11:08:27.621+0000 7f71727fc640 20 reqs_thread_entry: start 2024-09-14T11:08:27.702 INFO:tasks.workunit.client.0.smithi097.stderr: -27> 2024-09-14T11:08:27.621+0000 7f7348412800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:08:27.702 INFO:tasks.workunit.client.0.smithi097.stderr: -26> 2024-09-14T11:08:27.621+0000 7f7348412800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.702 INFO:tasks.workunit.client.0.smithi097.stderr: -25> 2024-09-14T11:08:27.622+0000 7f7348412800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:08:27.702 INFO:tasks.workunit.client.0.smithi097.stderr: -24> 2024-09-14T11:08:27.622+0000 7f7348412800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:08:27.702 INFO:tasks.workunit.client.0.smithi097.stderr: -23> 2024-09-14T11:08:27.622+0000 7f7348412800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:08:27.702 INFO:tasks.workunit.client.0.smithi097.stderr: -22> 2024-09-14T11:08:27.622+0000 7f7348412800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 : miss 2024-09-14T11:08:27.702 INFO:tasks.workunit.client.0.smithi097.stderr: -21> 2024-09-14T11:08:27.622+0000 7f7348412800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.702 INFO:tasks.workunit.client.0.smithi097.stderr: -20> 2024-09-14T11:08:27.622+0000 7f7348412800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:08:27.702 INFO:tasks.workunit.client.0.smithi097.stderr: -19> 2024-09-14T11:08:27.622+0000 7f7348412800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:08:27.702 INFO:tasks.workunit.client.0.smithi097.stderr: -18> 2024-09-14T11:08:27.622+0000 7f7348412800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:08:27.702 INFO:tasks.workunit.client.0.smithi097.stderr: -17> 2024-09-14T11:08:27.622+0000 7f7348412800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:08:27.702 INFO:tasks.workunit.client.0.smithi097.stderr: -16> 2024-09-14T11:08:27.622+0000 7f7348412800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:08:27.702 INFO:tasks.workunit.client.0.smithi097.stderr: -15> 2024-09-14T11:08:27.622+0000 7f7348412800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 2024-09-14T11:08:27.703 INFO:tasks.workunit.client.0.smithi097.stderr: -14> 2024-09-14T11:08:27.623+0000 7f7348412800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:08:27.703 INFO:tasks.workunit.client.0.smithi097.stderr: -13> 2024-09-14T11:08:27.632+0000 7f7348412800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:08:27.703 INFO:tasks.workunit.client.0.smithi097.stderr: -12> 2024-09-14T11:08:27.632+0000 7f7348412800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:08:27.703 INFO:tasks.workunit.client.0.smithi097.stderr: -11> 2024-09-14T11:08:27.632+0000 7f7348412800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:08:27.703 INFO:tasks.workunit.client.0.smithi097.stderr: -10> 2024-09-14T11:08:27.632+0000 7f7348412800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17, ofs0, ns] 2024-09-14T11:08:27.703 INFO:tasks.workunit.client.0.smithi097.stderr: -9> 2024-09-14T11:08:27.632+0000 7f7222ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595246 cookie 94533486772288 notifier 7826 bl.length()=827 2024-09-14T11:08:27.703 INFO:tasks.workunit.client.0.smithi097.stderr: -8> 2024-09-14T11:08:27.632+0000 7f7222ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:08:27.703 INFO:tasks.workunit.client.0.smithi097.stderr: -7> 2024-09-14T11:08:27.632+0000 7f7222ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:08:27.703 INFO:tasks.workunit.client.0.smithi097.stderr: -6> 2024-09-14T11:08:27.632+0000 7f7222ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:08:27.703 INFO:tasks.workunit.client.0.smithi097.stderr: -5> 2024-09-14T11:08:27.633+0000 7f7348412800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): orig_sources= new_sources= 2024-09-14T11:08:27.703 INFO:tasks.workunit.client.0.smithi097.stderr: -4> 2024-09-14T11:08:27.633+0000 7f7348412800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): potential sources added=[] removed=[] 2024-09-14T11:08:27.703 INFO:tasks.workunit.client.0.smithi097.stderr: -3> 2024-09-14T11:08:27.633+0000 7f7348412800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): orig_dests= new_dests= 2024-09-14T11:08:27.703 INFO:tasks.workunit.client.0.smithi097.stderr: -2> 2024-09-14T11:08:27.633+0000 7f7348412800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): potential dests added=[] removed=[] 2024-09-14T11:08:27.703 INFO:tasks.workunit.client.0.smithi097.stderr: -1> 2024-09-14T11:08:27.637+0000 7f7348412800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7348412800 time 2024-09-14T11:08:27.637324+0000 2024-09-14T11:08:27.703 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:08:27.704 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:27.704 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:08:27.704 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f734958c76a] 2024-09-14T11:08:27.704 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f734958c928] 2024-09-14T11:08:27.704 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fa49dcd0b1] 2024-09-14T11:08:27.704 INFO:tasks.workunit.client.0.smithi097.stderr: 4: radosgw-admin(+0xd8907c) [0x55fa4a2e107c] 2024-09-14T11:08:27.704 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55fa49ddcefd] 2024-09-14T11:08:27.704 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-14T11:08:27.704 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f7348229590] 2024-09-14T11:08:27.704 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-14T11:08:27.704 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-14T11:08:27.704 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:27.704 INFO:tasks.workunit.client.0.smithi097.stderr: 0> 2024-09-14T11:08:27.638+0000 7f7348412800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:08:27.704 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f7348412800 thread_name:radosgw-admin 2024-09-14T11:08:27.704 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:27.705 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:08:27.705 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f734823e6f0] 2024-09-14T11:08:27.705 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f734828b99c] 2024-09-14T11:08:27.705 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-14T11:08:27.705 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-14T11:08:27.705 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f734958c7c4] 2024-09-14T11:08:27.705 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f734958c928] 2024-09-14T11:08:27.705 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fa49dcd0b1] 2024-09-14T11:08:27.705 INFO:tasks.workunit.client.0.smithi097.stderr: 8: radosgw-admin(+0xd8907c) [0x55fa4a2e107c] 2024-09-14T11:08:27.705 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55fa49ddcefd] 2024-09-14T11:08:27.705 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-14T11:08:27.705 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f7348229590] 2024-09-14T11:08:27.705 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-14T11:08:27.705 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-14T11:08:27.706 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:08:27.706 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:27.706 INFO:tasks.workunit.client.0.smithi097.stderr:--- logging levels --- 2024-09-14T11:08:27.706 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 none 2024-09-14T11:08:27.706 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 lockdep 2024-09-14T11:08:27.706 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 context 2024-09-14T11:08:27.706 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 crush 2024-09-14T11:08:27.706 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds 2024-09-14T11:08:27.706 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_balancer 2024-09-14T11:08:27.706 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_locker 2024-09-14T11:08:27.706 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log 2024-09-14T11:08:27.706 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log_expire 2024-09-14T11:08:27.706 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_migrator 2024-09-14T11:08:27.707 INFO:tasks.workunit.client.0.smithi097.stderr: 3/ 5 mds_quiesce 2024-09-14T11:08:27.707 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 buffer 2024-09-14T11:08:27.707 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 timer 2024-09-14T11:08:27.707 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 filer 2024-09-14T11:08:27.707 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 striper 2024-09-14T11:08:27.707 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 objecter 2024-09-14T11:08:27.707 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rados 2024-09-14T11:08:27.707 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd 2024-09-14T11:08:27.707 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_mirror 2024-09-14T11:08:27.707 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_replay 2024-09-14T11:08:27.707 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_pwl 2024-09-14T11:08:27.707 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 journaler 2024-09-14T11:08:27.707 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objectcacher 2024-09-14T11:08:27.708 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:08:27.708 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 client 2024-09-14T11:08:27.708 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 osd 2024-09-14T11:08:27.708 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 optracker 2024-09-14T11:08:27.708 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objclass 2024-09-14T11:08:27.708 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 filestore 2024-09-14T11:08:27.708 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 journal 2024-09-14T11:08:27.708 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 ms 2024-09-14T11:08:27.708 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mon 2024-09-14T11:08:27.708 INFO:tasks.workunit.client.0.smithi097.stderr: 0/10 monc 2024-09-14T11:08:27.708 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 paxos 2024-09-14T11:08:27.708 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 tp 2024-09-14T11:08:27.708 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 auth 2024-09-14T11:08:27.708 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 crypto 2024-09-14T11:08:27.709 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 finisher 2024-09-14T11:08:27.709 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 reserver 2024-09-14T11:08:27.709 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 heartbeatmap 2024-09-14T11:08:27.709 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 perfcounter 2024-09-14T11:08:27.709 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw 2024-09-14T11:08:27.709 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_sync 2024-09-14T11:08:27.709 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_datacache 2024-09-14T11:08:27.709 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_access 2024-09-14T11:08:27.709 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:08:27.709 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_flight 2024-09-14T11:08:27.709 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:08:27.709 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw_notification 2024-09-14T11:08:27.709 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 javaclient 2024-09-14T11:08:27.710 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 asok 2024-09-14T11:08:27.710 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 throttle 2024-09-14T11:08:27.710 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 refs 2024-09-14T11:08:27.710 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 compressor 2024-09-14T11:08:27.710 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluestore 2024-09-14T11:08:27.710 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluefs 2024-09-14T11:08:27.710 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 bdev 2024-09-14T11:08:27.710 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 kstore 2024-09-14T11:08:27.710 INFO:tasks.workunit.client.0.smithi097.stderr: 4/ 5 rocksdb 2024-09-14T11:08:27.710 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 fuse 2024-09-14T11:08:27.710 INFO:tasks.workunit.client.0.smithi097.stderr: 2/ 5 mgr 2024-09-14T11:08:27.710 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mgrc 2024-09-14T11:08:27.710 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 dpdk 2024-09-14T11:08:27.710 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 eventtrace 2024-09-14T11:08:27.710 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 prioritycache 2024-09-14T11:08:27.711 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 test 2024-09-14T11:08:27.711 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:08:27.711 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephsqlite 2024-09-14T11:08:27.711 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:08:27.711 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore 2024-09-14T11:08:27.711 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_onode 2024-09-14T11:08:27.711 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_odata 2024-09-14T11:08:27.711 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_omap 2024-09-14T11:08:27.711 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_tm 2024-09-14T11:08:27.711 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_t 2024-09-14T11:08:27.711 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:08:27.711 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_epm 2024-09-14T11:08:27.711 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_lba 2024-09-14T11:08:27.712 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:08:27.712 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cache 2024-09-14T11:08:27.712 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_journal 2024-09-14T11:08:27.712 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_device 2024-09-14T11:08:27.712 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_backref 2024-09-14T11:08:27.712 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 alienstore 2024-09-14T11:08:27.712 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mclock 2024-09-14T11:08:27.712 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cyanstore 2024-09-14T11:08:27.712 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 ceph_exporter 2024-09-14T11:08:27.712 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 memstore 2024-09-14T11:08:27.712 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 trace 2024-09-14T11:08:27.712 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 ceph_dedup 2024-09-14T11:08:27.712 INFO:tasks.workunit.client.0.smithi097.stderr: -2/-2 (syslog threshold) 2024-09-14T11:08:27.713 INFO:tasks.workunit.client.0.smithi097.stderr: 99/99 (stderr threshold) 2024-09-14T11:08:27.713 INFO:tasks.workunit.client.0.smithi097.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:08:27.713 INFO:tasks.workunit.client.0.smithi097.stderr: 7f71727fc640 / http_manager 2024-09-14T11:08:27.713 INFO:tasks.workunit.client.0.smithi097.stderr: 7f71f8fe1640 / http_manager 2024-09-14T11:08:27.713 INFO:tasks.workunit.client.0.smithi097.stderr: 7f71f9fe3640 / rgw_dt_lg_renew 2024-09-14T11:08:27.713 INFO:tasks.workunit.client.0.smithi097.stderr: 7f72217fa640 / ms_dispatch 2024-09-14T11:08:27.713 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7222ffd640 / io_context_pool 2024-09-14T11:08:27.713 INFO:tasks.workunit.client.0.smithi097.stderr: 7f72297fa640 / ms_dispatch 2024-09-14T11:08:27.713 INFO:tasks.workunit.client.0.smithi097.stderr: 7f722bfff640 / ms_dispatch 2024-09-14T11:08:27.713 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7231e0b640 / io_context_pool 2024-09-14T11:08:27.713 INFO:tasks.workunit.client.0.smithi097.stderr: 7f733b3df640 / msgr-worker-2 2024-09-14T11:08:27.713 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7343be0640 / msgr-worker-1 2024-09-14T11:08:27.713 INFO:tasks.workunit.client.0.smithi097.stderr: 7f73443e1640 / msgr-worker-0 2024-09-14T11:08:27.713 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7344be2640 / io_context_pool 2024-09-14T11:08:27.714 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7348412800 / radosgw-admin 2024-09-14T11:08:27.714 INFO:tasks.workunit.client.0.smithi097.stderr: max_recent 500 2024-09-14T11:08:27.714 INFO:tasks.workunit.client.0.smithi097.stderr: max_new 1000 2024-09-14T11:08:27.714 INFO:tasks.workunit.client.0.smithi097.stderr: log_file /var/log/ceph/ceph-client.admin.152796.log 2024-09-14T11:08:27.714 INFO:tasks.workunit.client.0.smithi097.stderr:--- end dump of recent events --- 2024-09-14T11:08:27.714 INFO:tasks.workunit.client.0.smithi097.stderr:--- begin dump of recent events --- 2024-09-14T11:08:27.714 INFO:tasks.workunit.client.0.smithi097.stderr: -499> 2024-09-14T11:08:27.163+0000 7f7231e0b640 10 monclient: dump: 2024-09-14T11:08:27.714 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:08:27.714 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:08:27.714 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:27.714 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:27.714 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:08:27.714 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:27.714 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:08:27.714 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:08:27.715 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:08:27.715 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:27.715 INFO:tasks.workunit.client.0.smithi097.stderr: -498> 2024-09-14T11:08:27.163+0000 7f7231e0b640 10 monclient: _finish_auth 0 2024-09-14T11:08:27.715 INFO:tasks.workunit.client.0.smithi097.stderr: -497> 2024-09-14T11:08:27.163+0000 7f7231e0b640 10 monclient: _check_auth_tickets 2024-09-14T11:08:27.715 INFO:tasks.workunit.client.0.smithi097.stderr: -496> 2024-09-14T11:08:27.163+0000 7f7231e0b640 10 monclient: handle_config config(0 keys) 2024-09-14T11:08:27.715 INFO:tasks.workunit.client.0.smithi097.stderr: -495> 2024-09-14T11:08:27.163+0000 7f7231e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:08:27.715 INFO:tasks.workunit.client.0.smithi097.stderr: -494> 2024-09-14T11:08:27.163+0000 7f7231e0b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:08:27.715 INFO:tasks.workunit.client.0.smithi097.stderr: -493> 2024-09-14T11:08:27.163+0000 7f7231e0b640 10 monclient: dump: 2024-09-14T11:08:27.715 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:08:27.715 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:08:27.715 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:27.715 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:27.715 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:08:27.715 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:27.715 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:08:27.715 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:08:27.716 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:08:27.716 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:27.716 INFO:tasks.workunit.client.0.smithi097.stderr: -492> 2024-09-14T11:08:27.163+0000 7f7348412800 5 monclient: authenticate success, global_id 7814 2024-09-14T11:08:27.716 INFO:tasks.workunit.client.0.smithi097.stderr: -491> 2024-09-14T11:08:27.163+0000 7f7348412800 10 monclient: get_monmap_and_config success 2024-09-14T11:08:27.716 INFO:tasks.workunit.client.0.smithi097.stderr: -490> 2024-09-14T11:08:27.163+0000 7f7348412800 4 set_mon_vals no callback set 2024-09-14T11:08:27.716 INFO:tasks.workunit.client.0.smithi097.stderr: -489> 2024-09-14T11:08:27.164+0000 7f7348412800 10 monclient: shutdown 2024-09-14T11:08:27.716 INFO:tasks.workunit.client.0.smithi097.stderr: -488> 2024-09-14T11:08:27.164+0000 7f7348412800 5 asok(0x55fa4ab3c270) unregister_commands rotate-key 2024-09-14T11:08:27.716 INFO:tasks.workunit.client.0.smithi097.stderr: -487> 2024-09-14T11:08:27.164+0000 7f7348412800 10 monclient: build_initial_monmap 2024-09-14T11:08:27.716 INFO:tasks.workunit.client.0.smithi097.stderr: -486> 2024-09-14T11:08:27.164+0000 7f7348412800 1 build_initial for_mkfs: 0 2024-09-14T11:08:27.716 INFO:tasks.workunit.client.0.smithi097.stderr: -485> 2024-09-14T11:08:27.164+0000 7f7348412800 10 monclient: monmap: 2024-09-14T11:08:27.716 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:08:27.716 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:08:27.717 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:08:27.717 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:08:27.717 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:08:27.717 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:27.717 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:08:27.717 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:08:27.717 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:08:27.717 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:27.717 INFO:tasks.workunit.client.0.smithi097.stderr: -484> 2024-09-14T11:08:27.164+0000 7f7348412800 5 AuthRegistry(0x55fa4ad61dc0) adding auth protocol: cephx 2024-09-14T11:08:27.717 INFO:tasks.workunit.client.0.smithi097.stderr: -483> 2024-09-14T11:08:27.164+0000 7f7348412800 5 AuthRegistry(0x55fa4ad61dc0) adding auth protocol: cephx 2024-09-14T11:08:27.717 INFO:tasks.workunit.client.0.smithi097.stderr: -482> 2024-09-14T11:08:27.164+0000 7f7348412800 5 AuthRegistry(0x55fa4ad61dc0) adding auth protocol: cephx 2024-09-14T11:08:27.717 INFO:tasks.workunit.client.0.smithi097.stderr: -481> 2024-09-14T11:08:27.164+0000 7f7348412800 5 AuthRegistry(0x55fa4ad61dc0) adding con mode: secure 2024-09-14T11:08:27.717 INFO:tasks.workunit.client.0.smithi097.stderr: -480> 2024-09-14T11:08:27.164+0000 7f7348412800 5 AuthRegistry(0x55fa4ad61dc0) adding con mode: crc 2024-09-14T11:08:27.717 INFO:tasks.workunit.client.0.smithi097.stderr: -479> 2024-09-14T11:08:27.164+0000 7f7348412800 5 AuthRegistry(0x55fa4ad61dc0) adding con mode: secure 2024-09-14T11:08:27.717 INFO:tasks.workunit.client.0.smithi097.stderr: -478> 2024-09-14T11:08:27.164+0000 7f7348412800 5 AuthRegistry(0x55fa4ad61dc0) adding con mode: crc 2024-09-14T11:08:27.718 INFO:tasks.workunit.client.0.smithi097.stderr: -477> 2024-09-14T11:08:27.164+0000 7f7348412800 5 AuthRegistry(0x55fa4ad61dc0) adding con mode: secure 2024-09-14T11:08:27.718 INFO:tasks.workunit.client.0.smithi097.stderr: -476> 2024-09-14T11:08:27.164+0000 7f7348412800 5 AuthRegistry(0x55fa4ad61dc0) adding con mode: crc 2024-09-14T11:08:27.718 INFO:tasks.workunit.client.0.smithi097.stderr: -475> 2024-09-14T11:08:27.164+0000 7f7348412800 5 AuthRegistry(0x55fa4ad61dc0) adding con mode: crc 2024-09-14T11:08:27.718 INFO:tasks.workunit.client.0.smithi097.stderr: -474> 2024-09-14T11:08:27.164+0000 7f7348412800 5 AuthRegistry(0x55fa4ad61dc0) adding con mode: secure 2024-09-14T11:08:27.718 INFO:tasks.workunit.client.0.smithi097.stderr: -473> 2024-09-14T11:08:27.164+0000 7f7348412800 5 AuthRegistry(0x55fa4ad61dc0) adding con mode: crc 2024-09-14T11:08:27.718 INFO:tasks.workunit.client.0.smithi097.stderr: -472> 2024-09-14T11:08:27.164+0000 7f7348412800 5 AuthRegistry(0x55fa4ad61dc0) adding con mode: secure 2024-09-14T11:08:27.718 INFO:tasks.workunit.client.0.smithi097.stderr: -471> 2024-09-14T11:08:27.164+0000 7f7348412800 5 AuthRegistry(0x55fa4ad61dc0) adding con mode: crc 2024-09-14T11:08:27.718 INFO:tasks.workunit.client.0.smithi097.stderr: -470> 2024-09-14T11:08:27.164+0000 7f7348412800 5 AuthRegistry(0x55fa4ad61dc0) adding con mode: secure 2024-09-14T11:08:27.718 INFO:tasks.workunit.client.0.smithi097.stderr: -469> 2024-09-14T11:08:27.165+0000 7f7348412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:27.718 INFO:tasks.workunit.client.0.smithi097.stderr: -468> 2024-09-14T11:08:27.165+0000 7f7348412800 1 librados: starting msgr at 2024-09-14T11:08:27.718 INFO:tasks.workunit.client.0.smithi097.stderr: -467> 2024-09-14T11:08:27.165+0000 7f7348412800 1 librados: starting objecter 2024-09-14T11:08:27.718 INFO:tasks.workunit.client.0.smithi097.stderr: -466> 2024-09-14T11:08:27.165+0000 7f7348412800 5 asok(0x55fa4ab3c270) register_command objecter_requests hook 0x55fa4ad62890 2024-09-14T11:08:27.718 INFO:tasks.workunit.client.0.smithi097.stderr: -465> 2024-09-14T11:08:27.165+0000 7f7348412800 1 librados: setting wanted keys 2024-09-14T11:08:27.718 INFO:tasks.workunit.client.0.smithi097.stderr: -464> 2024-09-14T11:08:27.165+0000 7f7348412800 1 librados: calling monclient init 2024-09-14T11:08:27.718 INFO:tasks.workunit.client.0.smithi097.stderr: -463> 2024-09-14T11:08:27.165+0000 7f7348412800 10 monclient: init 2024-09-14T11:08:27.719 INFO:tasks.workunit.client.0.smithi097.stderr: -462> 2024-09-14T11:08:27.165+0000 7f7348412800 5 AuthRegistry(0x55fa4ad5c060) adding auth protocol: cephx 2024-09-14T11:08:27.719 INFO:tasks.workunit.client.0.smithi097.stderr: -461> 2024-09-14T11:08:27.165+0000 7f7348412800 5 AuthRegistry(0x55fa4ad5c060) adding auth protocol: cephx 2024-09-14T11:08:27.719 INFO:tasks.workunit.client.0.smithi097.stderr: -460> 2024-09-14T11:08:27.165+0000 7f7348412800 5 AuthRegistry(0x55fa4ad5c060) adding auth protocol: cephx 2024-09-14T11:08:27.719 INFO:tasks.workunit.client.0.smithi097.stderr: -459> 2024-09-14T11:08:27.165+0000 7f7348412800 5 AuthRegistry(0x55fa4ad5c060) adding con mode: secure 2024-09-14T11:08:27.719 INFO:tasks.workunit.client.0.smithi097.stderr: -458> 2024-09-14T11:08:27.165+0000 7f7348412800 5 AuthRegistry(0x55fa4ad5c060) adding con mode: crc 2024-09-14T11:08:27.719 INFO:tasks.workunit.client.0.smithi097.stderr: -457> 2024-09-14T11:08:27.165+0000 7f7348412800 5 AuthRegistry(0x55fa4ad5c060) adding con mode: secure 2024-09-14T11:08:27.719 INFO:tasks.workunit.client.0.smithi097.stderr: -456> 2024-09-14T11:08:27.165+0000 7f7348412800 5 AuthRegistry(0x55fa4ad5c060) adding con mode: crc 2024-09-14T11:08:27.719 INFO:tasks.workunit.client.0.smithi097.stderr: -455> 2024-09-14T11:08:27.165+0000 7f7348412800 5 AuthRegistry(0x55fa4ad5c060) adding con mode: secure 2024-09-14T11:08:27.719 INFO:tasks.workunit.client.0.smithi097.stderr: -454> 2024-09-14T11:08:27.165+0000 7f7348412800 5 AuthRegistry(0x55fa4ad5c060) adding con mode: crc 2024-09-14T11:08:27.719 INFO:tasks.workunit.client.0.smithi097.stderr: -453> 2024-09-14T11:08:27.165+0000 7f7348412800 5 AuthRegistry(0x55fa4ad5c060) adding con mode: crc 2024-09-14T11:08:27.719 INFO:tasks.workunit.client.0.smithi097.stderr: -452> 2024-09-14T11:08:27.165+0000 7f7348412800 5 AuthRegistry(0x55fa4ad5c060) adding con mode: secure 2024-09-14T11:08:27.719 INFO:tasks.workunit.client.0.smithi097.stderr: -451> 2024-09-14T11:08:27.165+0000 7f7348412800 5 AuthRegistry(0x55fa4ad5c060) adding con mode: crc 2024-09-14T11:08:27.719 INFO:tasks.workunit.client.0.smithi097.stderr: -450> 2024-09-14T11:08:27.165+0000 7f7348412800 5 AuthRegistry(0x55fa4ad5c060) adding con mode: secure 2024-09-14T11:08:27.720 INFO:tasks.workunit.client.0.smithi097.stderr: -449> 2024-09-14T11:08:27.165+0000 7f7348412800 5 AuthRegistry(0x55fa4ad5c060) adding con mode: crc 2024-09-14T11:08:27.720 INFO:tasks.workunit.client.0.smithi097.stderr: -448> 2024-09-14T11:08:27.165+0000 7f7348412800 5 AuthRegistry(0x55fa4ad5c060) adding con mode: secure 2024-09-14T11:08:27.720 INFO:tasks.workunit.client.0.smithi097.stderr: -447> 2024-09-14T11:08:27.165+0000 7f7348412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:27.720 INFO:tasks.workunit.client.0.smithi097.stderr: -446> 2024-09-14T11:08:27.165+0000 7f7348412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:27.720 INFO:tasks.workunit.client.0.smithi097.stderr: -445> 2024-09-14T11:08:27.165+0000 7f7348412800 5 asok(0x55fa4ab3c270) register_command rotate-key hook 0x55fa4ad5c1a8 2024-09-14T11:08:27.720 INFO:tasks.workunit.client.0.smithi097.stderr: -444> 2024-09-14T11:08:27.165+0000 7f7348412800 10 monclient: _reopen_session rank -1 2024-09-14T11:08:27.720 INFO:tasks.workunit.client.0.smithi097.stderr: -443> 2024-09-14T11:08:27.165+0000 7f7348412800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:08:27.720 INFO:tasks.workunit.client.0.smithi097.stderr: -442> 2024-09-14T11:08:27.165+0000 7f7348412800 10 monclient(hunting): picked mon.noname-a con 0x55fa4ad5f6a0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:08:27.720 INFO:tasks.workunit.client.0.smithi097.stderr: -441> 2024-09-14T11:08:27.165+0000 7f7348412800 10 monclient(hunting): picked mon.noname-c con 0x55fa4ad85f20 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:08:27.720 INFO:tasks.workunit.client.0.smithi097.stderr: -440> 2024-09-14T11:08:27.165+0000 7f7348412800 10 monclient(hunting): picked mon.noname-b con 0x7f7330003bd0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:08:27.720 INFO:tasks.workunit.client.0.smithi097.stderr: -439> 2024-09-14T11:08:27.165+0000 7f7348412800 10 monclient(hunting): start opening mon connection 2024-09-14T11:08:27.720 INFO:tasks.workunit.client.0.smithi097.stderr: -438> 2024-09-14T11:08:27.165+0000 7f7348412800 10 monclient(hunting): start opening mon connection 2024-09-14T11:08:27.720 INFO:tasks.workunit.client.0.smithi097.stderr: -437> 2024-09-14T11:08:27.165+0000 7f7348412800 10 monclient(hunting): start opening mon connection 2024-09-14T11:08:27.720 INFO:tasks.workunit.client.0.smithi097.stderr: -436> 2024-09-14T11:08:27.165+0000 7f7348412800 10 monclient(hunting): _renew_subs 2024-09-14T11:08:27.721 INFO:tasks.workunit.client.0.smithi097.stderr: -435> 2024-09-14T11:08:27.165+0000 7f7348412800 10 monclient(hunting): authenticate will time out at 2188.818842s 2024-09-14T11:08:27.721 INFO:tasks.workunit.client.0.smithi097.stderr: -434> 2024-09-14T11:08:27.165+0000 7f733b3df640 10 monclient(hunting): get_auth_request con 0x55fa4ad85f20 auth_method 0 2024-09-14T11:08:27.721 INFO:tasks.workunit.client.0.smithi097.stderr: -433> 2024-09-14T11:08:27.165+0000 7f733b3df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:08:27.721 INFO:tasks.workunit.client.0.smithi097.stderr: -432> 2024-09-14T11:08:27.165+0000 7f733b3df640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:08:27.721 INFO:tasks.workunit.client.0.smithi097.stderr: -431> 2024-09-14T11:08:27.165+0000 7f733b3df640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:08:27.721 INFO:tasks.workunit.client.0.smithi097.stderr: -430> 2024-09-14T11:08:27.165+0000 7f7343be0640 10 monclient(hunting): get_auth_request con 0x55fa4ad5f6a0 auth_method 0 2024-09-14T11:08:27.721 INFO:tasks.workunit.client.0.smithi097.stderr: -429> 2024-09-14T11:08:27.165+0000 7f7343be0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:08:27.721 INFO:tasks.workunit.client.0.smithi097.stderr: -428> 2024-09-14T11:08:27.165+0000 7f7343be0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:08:27.721 INFO:tasks.workunit.client.0.smithi097.stderr: -427> 2024-09-14T11:08:27.165+0000 7f7343be0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:08:27.721 INFO:tasks.workunit.client.0.smithi097.stderr: -426> 2024-09-14T11:08:27.166+0000 7f733b3df640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:08:27.721 INFO:tasks.workunit.client.0.smithi097.stderr: -425> 2024-09-14T11:08:27.166+0000 7f733b3df640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:08:27.721 INFO:tasks.workunit.client.0.smithi097.stderr: -424> 2024-09-14T11:08:27.166+0000 7f733b3df640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:08:27.722 INFO:tasks.workunit.client.0.smithi097.stderr: -423> 2024-09-14T11:08:27.166+0000 7f7343be0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:08:27.722 INFO:tasks.workunit.client.0.smithi097.stderr: -422> 2024-09-14T11:08:27.166+0000 7f7343be0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:08:27.722 INFO:tasks.workunit.client.0.smithi097.stderr: -421> 2024-09-14T11:08:27.166+0000 7f7343be0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:08:27.722 INFO:tasks.workunit.client.0.smithi097.stderr: -420> 2024-09-14T11:08:27.166+0000 7f7343be0640 10 monclient(hunting): handle_auth_done global_id 8340 payload 824 2024-09-14T11:08:27.722 INFO:tasks.workunit.client.0.smithi097.stderr: -419> 2024-09-14T11:08:27.166+0000 7f7343be0640 10 monclient: _finish_hunting 0 2024-09-14T11:08:27.722 INFO:tasks.workunit.client.0.smithi097.stderr: -418> 2024-09-14T11:08:27.166+0000 7f7343be0640 1 monclient: found mon.noname-a 2024-09-14T11:08:27.722 INFO:tasks.workunit.client.0.smithi097.stderr: -417> 2024-09-14T11:08:27.166+0000 7f7343be0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-14T11:08:27.722 INFO:tasks.workunit.client.0.smithi097.stderr: -416> 2024-09-14T11:08:27.166+0000 7f73443e1640 10 monclient: get_auth_request con 0x7f7330003bd0 auth_method 0 2024-09-14T11:08:27.722 INFO:tasks.workunit.client.0.smithi097.stderr: -415> 2024-09-14T11:08:27.166+0000 7f722bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:08:27.722 INFO:tasks.workunit.client.0.smithi097.stderr: -414> 2024-09-14T11:08:27.166+0000 7f722bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:08:27.722 INFO:tasks.workunit.client.0.smithi097.stderr: -413> 2024-09-14T11:08:27.166+0000 7f722bfff640 10 monclient: dump: 2024-09-14T11:08:27.722 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:08:27.723 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:08:27.723 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:27.723 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:27.723 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:08:27.723 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:27.723 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:08:27.723 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:08:27.723 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:08:27.723 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:27.723 INFO:tasks.workunit.client.0.smithi097.stderr: -412> 2024-09-14T11:08:27.166+0000 7f722bfff640 10 monclient: _finish_auth 0 2024-09-14T11:08:27.723 INFO:tasks.workunit.client.0.smithi097.stderr: -411> 2024-09-14T11:08:27.166+0000 7f722bfff640 10 monclient: _check_auth_tickets 2024-09-14T11:08:27.723 INFO:tasks.workunit.client.0.smithi097.stderr: -410> 2024-09-14T11:08:27.166+0000 7f722bfff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:08:27.723 INFO:tasks.workunit.client.0.smithi097.stderr: -409> 2024-09-14T11:08:27.166+0000 7f722bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:08:27.723 INFO:tasks.workunit.client.0.smithi097.stderr: -408> 2024-09-14T11:08:27.166+0000 7f722bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:08:27.723 INFO:tasks.workunit.client.0.smithi097.stderr: -407> 2024-09-14T11:08:27.166+0000 7f722bfff640 10 monclient: dump: 2024-09-14T11:08:27.724 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:08:27.724 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:08:27.724 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:27.724 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:27.724 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:08:27.724 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:27.724 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:08:27.724 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:08:27.724 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:08:27.724 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:27.724 INFO:tasks.workunit.client.0.smithi097.stderr: -406> 2024-09-14T11:08:27.166+0000 7f7348412800 5 monclient: authenticate success, global_id 8340 2024-09-14T11:08:27.724 INFO:tasks.workunit.client.0.smithi097.stderr: -405> 2024-09-14T11:08:27.166+0000 7f7348412800 10 monclient: _renew_subs 2024-09-14T11:08:27.724 INFO:tasks.workunit.client.0.smithi097.stderr: -404> 2024-09-14T11:08:27.166+0000 7f7231e0b640 4 set_mon_vals no callback set 2024-09-14T11:08:27.725 INFO:tasks.workunit.client.0.smithi097.stderr: -403> 2024-09-14T11:08:27.166+0000 7f7348412800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:08:27.725 INFO:tasks.workunit.client.0.smithi097.stderr: -402> 2024-09-14T11:08:27.166+0000 7f7348412800 10 monclient: _renew_subs 2024-09-14T11:08:27.725 INFO:tasks.workunit.client.0.smithi097.stderr: -401> 2024-09-14T11:08:27.166+0000 7f7348412800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.97:3300/0 2024-09-14T11:08:27.725 INFO:tasks.workunit.client.0.smithi097.stderr: -400> 2024-09-14T11:08:27.166+0000 7f7348412800 1 librados: init done 2024-09-14T11:08:27.725 INFO:tasks.workunit.client.0.smithi097.stderr: -399> 2024-09-14T11:08:27.168+0000 7f722bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:08:27.725 INFO:tasks.workunit.client.0.smithi097.stderr: -398> 2024-09-14T11:08:27.168+0000 7f722bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:08:27.725 INFO:tasks.workunit.client.0.smithi097.stderr: -397> 2024-09-14T11:08:27.168+0000 7f722bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:08:27.725 INFO:tasks.workunit.client.0.smithi097.stderr: -396> 2024-09-14T11:08:27.168+0000 7f733b3df640 10 monclient: get_auth_request con 0x7f722c077260 auth_method 0 2024-09-14T11:08:27.725 INFO:tasks.workunit.client.0.smithi097.stderr: -395> 2024-09-14T11:08:27.169+0000 7f73443e1640 10 monclient: get_auth_request con 0x55fa4ad9d1e0 auth_method 0 2024-09-14T11:08:27.725 INFO:tasks.workunit.client.0.smithi097.stderr: -394> 2024-09-14T11:08:27.170+0000 7f7343be0640 10 monclient: get_auth_request con 0x55fa4ada8560 auth_method 0 2024-09-14T11:08:27.725 INFO:tasks.workunit.client.0.smithi097.stderr: -393> 2024-09-14T11:08:27.171+0000 7f733b3df640 10 monclient: get_auth_request con 0x55fa4adac8c0 auth_method 0 2024-09-14T11:08:27.725 INFO:tasks.workunit.client.0.smithi097.stderr: -392> 2024-09-14T11:08:27.172+0000 7f73443e1640 10 monclient: get_auth_request con 0x55fa4adabe10 auth_method 0 2024-09-14T11:08:27.725 INFO:tasks.workunit.client.0.smithi097.stderr: -391> 2024-09-14T11:08:27.173+0000 7f7348412800 10 monclient: build_initial_monmap 2024-09-14T11:08:27.725 INFO:tasks.workunit.client.0.smithi097.stderr: -390> 2024-09-14T11:08:27.173+0000 7f7348412800 1 build_initial for_mkfs: 0 2024-09-14T11:08:27.725 INFO:tasks.workunit.client.0.smithi097.stderr: -389> 2024-09-14T11:08:27.173+0000 7f7348412800 10 monclient: monmap: 2024-09-14T11:08:27.726 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:08:27.726 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:08:27.726 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:08:27.726 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:08:27.726 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:08:27.726 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:27.726 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:08:27.726 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:08:27.726 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:08:27.726 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:27.726 INFO:tasks.workunit.client.0.smithi097.stderr: -388> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb4a30) adding auth protocol: cephx 2024-09-14T11:08:27.726 INFO:tasks.workunit.client.0.smithi097.stderr: -387> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb4a30) adding auth protocol: cephx 2024-09-14T11:08:27.726 INFO:tasks.workunit.client.0.smithi097.stderr: -386> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb4a30) adding auth protocol: cephx 2024-09-14T11:08:27.726 INFO:tasks.workunit.client.0.smithi097.stderr: -385> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb4a30) adding con mode: secure 2024-09-14T11:08:27.727 INFO:tasks.workunit.client.0.smithi097.stderr: -384> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb4a30) adding con mode: crc 2024-09-14T11:08:27.727 INFO:tasks.workunit.client.0.smithi097.stderr: -383> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb4a30) adding con mode: secure 2024-09-14T11:08:27.727 INFO:tasks.workunit.client.0.smithi097.stderr: -382> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb4a30) adding con mode: crc 2024-09-14T11:08:27.727 INFO:tasks.workunit.client.0.smithi097.stderr: -381> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb4a30) adding con mode: secure 2024-09-14T11:08:27.727 INFO:tasks.workunit.client.0.smithi097.stderr: -380> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb4a30) adding con mode: crc 2024-09-14T11:08:27.727 INFO:tasks.workunit.client.0.smithi097.stderr: -379> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb4a30) adding con mode: crc 2024-09-14T11:08:27.727 INFO:tasks.workunit.client.0.smithi097.stderr: -378> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb4a30) adding con mode: secure 2024-09-14T11:08:27.727 INFO:tasks.workunit.client.0.smithi097.stderr: -377> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb4a30) adding con mode: crc 2024-09-14T11:08:27.727 INFO:tasks.workunit.client.0.smithi097.stderr: -376> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb4a30) adding con mode: secure 2024-09-14T11:08:27.727 INFO:tasks.workunit.client.0.smithi097.stderr: -375> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb4a30) adding con mode: crc 2024-09-14T11:08:27.727 INFO:tasks.workunit.client.0.smithi097.stderr: -374> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb4a30) adding con mode: secure 2024-09-14T11:08:27.727 INFO:tasks.workunit.client.0.smithi097.stderr: -373> 2024-09-14T11:08:27.173+0000 7f7348412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:27.728 INFO:tasks.workunit.client.0.smithi097.stderr: -372> 2024-09-14T11:08:27.173+0000 7f7348412800 5 asok(0x55fa4ab3c270) register_command objecter_requests cmddesc objecter_requests hook 0x55fa4adb7f20 EEXIST 2024-09-14T11:08:27.728 INFO:tasks.workunit.client.0.smithi097.stderr: -371> 2024-09-14T11:08:27.173+0000 7f7348412800 10 monclient: init 2024-09-14T11:08:27.728 INFO:tasks.workunit.client.0.smithi097.stderr: -370> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb3978) adding auth protocol: cephx 2024-09-14T11:08:27.728 INFO:tasks.workunit.client.0.smithi097.stderr: -369> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb3978) adding auth protocol: cephx 2024-09-14T11:08:27.728 INFO:tasks.workunit.client.0.smithi097.stderr: -368> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb3978) adding auth protocol: cephx 2024-09-14T11:08:27.728 INFO:tasks.workunit.client.0.smithi097.stderr: -367> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb3978) adding con mode: secure 2024-09-14T11:08:27.728 INFO:tasks.workunit.client.0.smithi097.stderr: -366> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb3978) adding con mode: crc 2024-09-14T11:08:27.728 INFO:tasks.workunit.client.0.smithi097.stderr: -365> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb3978) adding con mode: secure 2024-09-14T11:08:27.728 INFO:tasks.workunit.client.0.smithi097.stderr: -364> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb3978) adding con mode: crc 2024-09-14T11:08:27.728 INFO:tasks.workunit.client.0.smithi097.stderr: -363> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb3978) adding con mode: secure 2024-09-14T11:08:27.728 INFO:tasks.workunit.client.0.smithi097.stderr: -362> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb3978) adding con mode: crc 2024-09-14T11:08:27.728 INFO:tasks.workunit.client.0.smithi097.stderr: -361> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb3978) adding con mode: crc 2024-09-14T11:08:27.728 INFO:tasks.workunit.client.0.smithi097.stderr: -360> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb3978) adding con mode: secure 2024-09-14T11:08:27.728 INFO:tasks.workunit.client.0.smithi097.stderr: -359> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb3978) adding con mode: crc 2024-09-14T11:08:27.729 INFO:tasks.workunit.client.0.smithi097.stderr: -358> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb3978) adding con mode: secure 2024-09-14T11:08:27.729 INFO:tasks.workunit.client.0.smithi097.stderr: -357> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb3978) adding con mode: crc 2024-09-14T11:08:27.729 INFO:tasks.workunit.client.0.smithi097.stderr: -356> 2024-09-14T11:08:27.173+0000 7f7348412800 5 AuthRegistry(0x55fa4adb3978) adding con mode: secure 2024-09-14T11:08:27.729 INFO:tasks.workunit.client.0.smithi097.stderr: -355> 2024-09-14T11:08:27.173+0000 7f7348412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:27.729 INFO:tasks.workunit.client.0.smithi097.stderr: -354> 2024-09-14T11:08:27.174+0000 7f7348412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:27.729 INFO:tasks.workunit.client.0.smithi097.stderr: -353> 2024-09-14T11:08:27.174+0000 7f7348412800 5 asok(0x55fa4ab3c270) register_command rotate-key cmddesc rotate-key hook 0x55fa4adb3ac0 EEXIST 2024-09-14T11:08:27.729 INFO:tasks.workunit.client.0.smithi097.stderr: -352> 2024-09-14T11:08:27.174+0000 7f7348412800 10 monclient: _reopen_session rank -1 2024-09-14T11:08:27.729 INFO:tasks.workunit.client.0.smithi097.stderr: -351> 2024-09-14T11:08:27.174+0000 7f7348412800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:08:27.729 INFO:tasks.workunit.client.0.smithi097.stderr: -350> 2024-09-14T11:08:27.174+0000 7f7348412800 10 monclient(hunting): picked mon.noname-b con 0x55fa4addc240 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:08:27.729 INFO:tasks.workunit.client.0.smithi097.stderr: -349> 2024-09-14T11:08:27.174+0000 7f7348412800 10 monclient(hunting): picked mon.noname-a con 0x55fa4addc620 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:08:27.729 INFO:tasks.workunit.client.0.smithi097.stderr: -348> 2024-09-14T11:08:27.174+0000 7f7348412800 10 monclient(hunting): picked mon.noname-c con 0x55fa4addaf50 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:08:27.729 INFO:tasks.workunit.client.0.smithi097.stderr: -347> 2024-09-14T11:08:27.174+0000 7f7348412800 10 monclient(hunting): start opening mon connection 2024-09-14T11:08:27.729 INFO:tasks.workunit.client.0.smithi097.stderr: -346> 2024-09-14T11:08:27.174+0000 7f7348412800 10 monclient(hunting): start opening mon connection 2024-09-14T11:08:27.729 INFO:tasks.workunit.client.0.smithi097.stderr: -345> 2024-09-14T11:08:27.174+0000 7f7348412800 10 monclient(hunting): start opening mon connection 2024-09-14T11:08:27.729 INFO:tasks.workunit.client.0.smithi097.stderr: -344> 2024-09-14T11:08:27.174+0000 7f7348412800 10 monclient(hunting): _renew_subs 2024-09-14T11:08:27.730 INFO:tasks.workunit.client.0.smithi097.stderr: -343> 2024-09-14T11:08:27.174+0000 7f7348412800 10 monclient(hunting): authenticate will time out at 2188.827169s 2024-09-14T11:08:27.730 INFO:tasks.workunit.client.0.smithi097.stderr: -342> 2024-09-14T11:08:27.174+0000 7f7343be0640 10 monclient(hunting): get_auth_request con 0x55fa4addaf50 auth_method 0 2024-09-14T11:08:27.730 INFO:tasks.workunit.client.0.smithi097.stderr: -341> 2024-09-14T11:08:27.174+0000 7f7343be0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:08:27.730 INFO:tasks.workunit.client.0.smithi097.stderr: -340> 2024-09-14T11:08:27.174+0000 7f7343be0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:08:27.730 INFO:tasks.workunit.client.0.smithi097.stderr: -339> 2024-09-14T11:08:27.174+0000 7f7343be0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:08:27.730 INFO:tasks.workunit.client.0.smithi097.stderr: -338> 2024-09-14T11:08:27.174+0000 7f73443e1640 10 monclient(hunting): get_auth_request con 0x55fa4addc620 auth_method 0 2024-09-14T11:08:27.730 INFO:tasks.workunit.client.0.smithi097.stderr: -337> 2024-09-14T11:08:27.174+0000 7f73443e1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:08:27.730 INFO:tasks.workunit.client.0.smithi097.stderr: -336> 2024-09-14T11:08:27.174+0000 7f73443e1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:08:27.730 INFO:tasks.workunit.client.0.smithi097.stderr: -335> 2024-09-14T11:08:27.174+0000 7f73443e1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:08:27.730 INFO:tasks.workunit.client.0.smithi097.stderr: -334> 2024-09-14T11:08:27.174+0000 7f733b3df640 10 monclient(hunting): get_auth_request con 0x55fa4addc240 auth_method 0 2024-09-14T11:08:27.730 INFO:tasks.workunit.client.0.smithi097.stderr: -333> 2024-09-14T11:08:27.174+0000 7f733b3df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:08:27.730 INFO:tasks.workunit.client.0.smithi097.stderr: -332> 2024-09-14T11:08:27.174+0000 7f733b3df640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:08:27.730 INFO:tasks.workunit.client.0.smithi097.stderr: -331> 2024-09-14T11:08:27.174+0000 7f733b3df640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:08:27.730 INFO:tasks.workunit.client.0.smithi097.stderr: -330> 2024-09-14T11:08:27.174+0000 7f7343be0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:08:27.730 INFO:tasks.workunit.client.0.smithi097.stderr: -329> 2024-09-14T11:08:27.174+0000 7f7343be0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:08:27.730 INFO:tasks.workunit.client.0.smithi097.stderr: -328> 2024-09-14T11:08:27.174+0000 7f7343be0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:08:27.731 INFO:tasks.workunit.client.0.smithi097.stderr: -327> 2024-09-14T11:08:27.174+0000 7f73443e1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:08:27.731 INFO:tasks.workunit.client.0.smithi097.stderr: -326> 2024-09-14T11:08:27.174+0000 7f73443e1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:08:27.731 INFO:tasks.workunit.client.0.smithi097.stderr: -325> 2024-09-14T11:08:27.174+0000 7f73443e1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:08:27.731 INFO:tasks.workunit.client.0.smithi097.stderr: -324> 2024-09-14T11:08:27.174+0000 7f733b3df640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:08:27.731 INFO:tasks.workunit.client.0.smithi097.stderr: -323> 2024-09-14T11:08:27.174+0000 7f733b3df640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:08:27.731 INFO:tasks.workunit.client.0.smithi097.stderr: -322> 2024-09-14T11:08:27.174+0000 7f733b3df640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:08:27.731 INFO:tasks.workunit.client.0.smithi097.stderr: -321> 2024-09-14T11:08:27.174+0000 7f7343be0640 10 monclient(hunting): handle_auth_done global_id 7820 payload 824 2024-09-14T11:08:27.731 INFO:tasks.workunit.client.0.smithi097.stderr: -320> 2024-09-14T11:08:27.174+0000 7f7343be0640 10 monclient: _finish_hunting 0 2024-09-14T11:08:27.731 INFO:tasks.workunit.client.0.smithi097.stderr: -319> 2024-09-14T11:08:27.174+0000 7f7343be0640 1 monclient: found mon.noname-c 2024-09-14T11:08:27.731 INFO:tasks.workunit.client.0.smithi097.stderr: -318> 2024-09-14T11:08:27.174+0000 7f7343be0640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:08:27.731 INFO:tasks.workunit.client.0.smithi097.stderr: -317> 2024-09-14T11:08:27.174+0000 7f72297fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:08:27.731 INFO:tasks.workunit.client.0.smithi097.stderr: -316> 2024-09-14T11:08:27.174+0000 7f72297fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:08:27.731 INFO:tasks.workunit.client.0.smithi097.stderr: -315> 2024-09-14T11:08:27.174+0000 7f72297fa640 10 monclient: dump: 2024-09-14T11:08:27.732 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:08:27.732 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:08:27.732 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:27.732 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:27.732 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:08:27.732 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:27.732 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:08:27.732 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:08:27.732 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:08:27.732 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:27.732 INFO:tasks.workunit.client.0.smithi097.stderr: -314> 2024-09-14T11:08:27.174+0000 7f72297fa640 10 monclient: _finish_auth 0 2024-09-14T11:08:27.732 INFO:tasks.workunit.client.0.smithi097.stderr: -313> 2024-09-14T11:08:27.174+0000 7f72297fa640 10 monclient: _check_auth_tickets 2024-09-14T11:08:27.732 INFO:tasks.workunit.client.0.smithi097.stderr: -312> 2024-09-14T11:08:27.174+0000 7f72297fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:08:27.733 INFO:tasks.workunit.client.0.smithi097.stderr: -311> 2024-09-14T11:08:27.174+0000 7f72297fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:08:27.733 INFO:tasks.workunit.client.0.smithi097.stderr: -310> 2024-09-14T11:08:27.174+0000 7f72297fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:08:27.733 INFO:tasks.workunit.client.0.smithi097.stderr: -309> 2024-09-14T11:08:27.174+0000 7f72297fa640 10 monclient: dump: 2024-09-14T11:08:27.733 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:08:27.733 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:08:27.733 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:27.733 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:27.733 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:08:27.733 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:27.733 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:08:27.733 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:08:27.733 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:08:27.733 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:27.734 INFO:tasks.workunit.client.0.smithi097.stderr: -308> 2024-09-14T11:08:27.174+0000 7f7348412800 5 monclient: authenticate success, global_id 7820 2024-09-14T11:08:27.734 INFO:tasks.workunit.client.0.smithi097.stderr: -307> 2024-09-14T11:08:27.174+0000 7f7348412800 10 monclient: _renew_subs 2024-09-14T11:08:27.734 INFO:tasks.workunit.client.0.smithi097.stderr: -306> 2024-09-14T11:08:27.174+0000 7f7344be2640 4 set_mon_vals no callback set 2024-09-14T11:08:27.734 INFO:tasks.workunit.client.0.smithi097.stderr: -305> 2024-09-14T11:08:27.174+0000 7f7348412800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:08:27.734 INFO:tasks.workunit.client.0.smithi097.stderr: -304> 2024-09-14T11:08:27.174+0000 7f7348412800 10 monclient: _renew_subs 2024-09-14T11:08:27.734 INFO:tasks.workunit.client.0.smithi097.stderr: -303> 2024-09-14T11:08:27.174+0000 7f7348412800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:08:27.734 INFO:tasks.workunit.client.0.smithi097.stderr: -302> 2024-09-14T11:08:27.176+0000 7f72297fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:08:27.734 INFO:tasks.workunit.client.0.smithi097.stderr: -301> 2024-09-14T11:08:27.176+0000 7f72297fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:08:27.734 INFO:tasks.workunit.client.0.smithi097.stderr: -300> 2024-09-14T11:08:27.176+0000 7f72297fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:08:27.734 INFO:tasks.workunit.client.0.smithi097.stderr: -299> 2024-09-14T11:08:27.176+0000 7f733b3df640 10 monclient: get_auth_request con 0x7f721c077140 auth_method 0 2024-09-14T11:08:27.734 INFO:tasks.workunit.client.0.smithi097.stderr: -298> 2024-09-14T11:08:27.177+0000 7f7348412800 10 monclient: get_monmap_and_config 2024-09-14T11:08:27.734 INFO:tasks.workunit.client.0.smithi097.stderr: -297> 2024-09-14T11:08:27.177+0000 7f7348412800 10 monclient: build_initial_monmap 2024-09-14T11:08:27.734 INFO:tasks.workunit.client.0.smithi097.stderr: -296> 2024-09-14T11:08:27.177+0000 7f7348412800 1 build_initial for_mkfs: 0 2024-09-14T11:08:27.734 INFO:tasks.workunit.client.0.smithi097.stderr: -295> 2024-09-14T11:08:27.177+0000 7f7348412800 10 monclient: monmap: 2024-09-14T11:08:27.735 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:08:27.735 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:08:27.735 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:08:27.735 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:08:27.735 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:08:27.735 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:27.735 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:08:27.735 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:08:27.735 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:08:27.735 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:27.735 INFO:tasks.workunit.client.0.smithi097.stderr: -294> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x55fa4adfc1a0) adding auth protocol: cephx 2024-09-14T11:08:27.735 INFO:tasks.workunit.client.0.smithi097.stderr: -293> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x55fa4adfc1a0) adding auth protocol: cephx 2024-09-14T11:08:27.735 INFO:tasks.workunit.client.0.smithi097.stderr: -292> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x55fa4adfc1a0) adding auth protocol: cephx 2024-09-14T11:08:27.735 INFO:tasks.workunit.client.0.smithi097.stderr: -291> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x55fa4adfc1a0) adding con mode: secure 2024-09-14T11:08:27.736 INFO:tasks.workunit.client.0.smithi097.stderr: -290> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x55fa4adfc1a0) adding con mode: crc 2024-09-14T11:08:27.736 INFO:tasks.workunit.client.0.smithi097.stderr: -289> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x55fa4adfc1a0) adding con mode: secure 2024-09-14T11:08:27.736 INFO:tasks.workunit.client.0.smithi097.stderr: -288> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x55fa4adfc1a0) adding con mode: crc 2024-09-14T11:08:27.736 INFO:tasks.workunit.client.0.smithi097.stderr: -287> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x55fa4adfc1a0) adding con mode: secure 2024-09-14T11:08:27.736 INFO:tasks.workunit.client.0.smithi097.stderr: -286> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x55fa4adfc1a0) adding con mode: crc 2024-09-14T11:08:27.736 INFO:tasks.workunit.client.0.smithi097.stderr: -285> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x55fa4adfc1a0) adding con mode: crc 2024-09-14T11:08:27.736 INFO:tasks.workunit.client.0.smithi097.stderr: -284> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x55fa4adfc1a0) adding con mode: secure 2024-09-14T11:08:27.736 INFO:tasks.workunit.client.0.smithi097.stderr: -283> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x55fa4adfc1a0) adding con mode: crc 2024-09-14T11:08:27.736 INFO:tasks.workunit.client.0.smithi097.stderr: -282> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x55fa4adfc1a0) adding con mode: secure 2024-09-14T11:08:27.736 INFO:tasks.workunit.client.0.smithi097.stderr: -281> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x55fa4adfc1a0) adding con mode: crc 2024-09-14T11:08:27.736 INFO:tasks.workunit.client.0.smithi097.stderr: -280> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x55fa4adfc1a0) adding con mode: secure 2024-09-14T11:08:27.736 INFO:tasks.workunit.client.0.smithi097.stderr: -279> 2024-09-14T11:08:27.177+0000 7f7348412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:27.736 INFO:tasks.workunit.client.0.smithi097.stderr: -278> 2024-09-14T11:08:27.177+0000 7f7348412800 10 monclient: init 2024-09-14T11:08:27.737 INFO:tasks.workunit.client.0.smithi097.stderr: -277> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x7fff033a3c50) adding auth protocol: cephx 2024-09-14T11:08:27.737 INFO:tasks.workunit.client.0.smithi097.stderr: -276> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x7fff033a3c50) adding auth protocol: cephx 2024-09-14T11:08:27.737 INFO:tasks.workunit.client.0.smithi097.stderr: -275> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x7fff033a3c50) adding auth protocol: cephx 2024-09-14T11:08:27.737 INFO:tasks.workunit.client.0.smithi097.stderr: -274> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x7fff033a3c50) adding con mode: secure 2024-09-14T11:08:27.737 INFO:tasks.workunit.client.0.smithi097.stderr: -273> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x7fff033a3c50) adding con mode: crc 2024-09-14T11:08:27.737 INFO:tasks.workunit.client.0.smithi097.stderr: -272> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x7fff033a3c50) adding con mode: secure 2024-09-14T11:08:27.737 INFO:tasks.workunit.client.0.smithi097.stderr: -271> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x7fff033a3c50) adding con mode: crc 2024-09-14T11:08:27.737 INFO:tasks.workunit.client.0.smithi097.stderr: -270> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x7fff033a3c50) adding con mode: secure 2024-09-14T11:08:27.737 INFO:tasks.workunit.client.0.smithi097.stderr: -269> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x7fff033a3c50) adding con mode: crc 2024-09-14T11:08:27.737 INFO:tasks.workunit.client.0.smithi097.stderr: -268> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x7fff033a3c50) adding con mode: crc 2024-09-14T11:08:27.737 INFO:tasks.workunit.client.0.smithi097.stderr: -267> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x7fff033a3c50) adding con mode: secure 2024-09-14T11:08:27.737 INFO:tasks.workunit.client.0.smithi097.stderr: -266> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x7fff033a3c50) adding con mode: crc 2024-09-14T11:08:27.737 INFO:tasks.workunit.client.0.smithi097.stderr: -265> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x7fff033a3c50) adding con mode: secure 2024-09-14T11:08:27.737 INFO:tasks.workunit.client.0.smithi097.stderr: -264> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x7fff033a3c50) adding con mode: crc 2024-09-14T11:08:27.738 INFO:tasks.workunit.client.0.smithi097.stderr: -263> 2024-09-14T11:08:27.177+0000 7f7348412800 5 AuthRegistry(0x7fff033a3c50) adding con mode: secure 2024-09-14T11:08:27.738 INFO:tasks.workunit.client.0.smithi097.stderr: -262> 2024-09-14T11:08:27.177+0000 7f7348412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:27.738 INFO:tasks.workunit.client.0.smithi097.stderr: -261> 2024-09-14T11:08:27.178+0000 7f7348412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:27.738 INFO:tasks.workunit.client.0.smithi097.stderr: -260> 2024-09-14T11:08:27.178+0000 7f7348412800 5 asok(0x55fa4ab3c270) register_command rotate-key cmddesc rotate-key hook 0x7fff033a3d98 EEXIST 2024-09-14T11:08:27.738 INFO:tasks.workunit.client.0.smithi097.stderr: -259> 2024-09-14T11:08:27.178+0000 7f7348412800 10 monclient: _reopen_session rank -1 2024-09-14T11:08:27.738 INFO:tasks.workunit.client.0.smithi097.stderr: -258> 2024-09-14T11:08:27.178+0000 7f7348412800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:08:27.738 INFO:tasks.workunit.client.0.smithi097.stderr: -257> 2024-09-14T11:08:27.178+0000 7f7348412800 10 monclient(hunting): picked mon.noname-a con 0x55fa4ae307c0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:08:27.738 INFO:tasks.workunit.client.0.smithi097.stderr: -256> 2024-09-14T11:08:27.178+0000 7f7348412800 10 monclient(hunting): picked mon.noname-c con 0x55fa4ae21110 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:08:27.738 INFO:tasks.workunit.client.0.smithi097.stderr: -255> 2024-09-14T11:08:27.178+0000 7f7348412800 10 monclient(hunting): picked mon.noname-b con 0x55fa4ae2bbf0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:08:27.738 INFO:tasks.workunit.client.0.smithi097.stderr: -254> 2024-09-14T11:08:27.178+0000 7f7348412800 10 monclient(hunting): start opening mon connection 2024-09-14T11:08:27.738 INFO:tasks.workunit.client.0.smithi097.stderr: -253> 2024-09-14T11:08:27.178+0000 7f7348412800 10 monclient(hunting): start opening mon connection 2024-09-14T11:08:27.738 INFO:tasks.workunit.client.0.smithi097.stderr: -252> 2024-09-14T11:08:27.178+0000 7f7348412800 10 monclient(hunting): start opening mon connection 2024-09-14T11:08:27.738 INFO:tasks.workunit.client.0.smithi097.stderr: -251> 2024-09-14T11:08:27.178+0000 7f7348412800 10 monclient(hunting): _renew_subs 2024-09-14T11:08:27.739 INFO:tasks.workunit.client.0.smithi097.stderr: -250> 2024-09-14T11:08:27.178+0000 7f7348412800 10 monclient(hunting): authenticate will time out at 2188.831224s 2024-09-14T11:08:27.739 INFO:tasks.workunit.client.0.smithi097.stderr: -249> 2024-09-14T11:08:27.178+0000 7f733b3df640 10 monclient(hunting): get_auth_request con 0x55fa4ae307c0 auth_method 0 2024-09-14T11:08:27.739 INFO:tasks.workunit.client.0.smithi097.stderr: -248> 2024-09-14T11:08:27.178+0000 7f733b3df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:08:27.739 INFO:tasks.workunit.client.0.smithi097.stderr: -247> 2024-09-14T11:08:27.178+0000 7f733b3df640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:08:27.739 INFO:tasks.workunit.client.0.smithi097.stderr: -246> 2024-09-14T11:08:27.178+0000 7f733b3df640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:08:27.739 INFO:tasks.workunit.client.0.smithi097.stderr: -245> 2024-09-14T11:08:27.178+0000 7f73443e1640 10 monclient(hunting): get_auth_request con 0x55fa4ae21110 auth_method 0 2024-09-14T11:08:27.739 INFO:tasks.workunit.client.0.smithi097.stderr: -244> 2024-09-14T11:08:27.178+0000 7f73443e1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:08:27.739 INFO:tasks.workunit.client.0.smithi097.stderr: -243> 2024-09-14T11:08:27.178+0000 7f73443e1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:08:27.739 INFO:tasks.workunit.client.0.smithi097.stderr: -242> 2024-09-14T11:08:27.178+0000 7f73443e1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:08:27.739 INFO:tasks.workunit.client.0.smithi097.stderr: -241> 2024-09-14T11:08:27.178+0000 7f733b3df640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:08:27.739 INFO:tasks.workunit.client.0.smithi097.stderr: -240> 2024-09-14T11:08:27.178+0000 7f733b3df640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:08:27.739 INFO:tasks.workunit.client.0.smithi097.stderr: -239> 2024-09-14T11:08:27.178+0000 7f733b3df640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:08:27.739 INFO:tasks.workunit.client.0.smithi097.stderr: -238> 2024-09-14T11:08:27.178+0000 7f73443e1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:08:27.739 INFO:tasks.workunit.client.0.smithi097.stderr: -237> 2024-09-14T11:08:27.178+0000 7f73443e1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:08:27.739 INFO:tasks.workunit.client.0.smithi097.stderr: -236> 2024-09-14T11:08:27.178+0000 7f73443e1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:08:27.740 INFO:tasks.workunit.client.0.smithi097.stderr: -235> 2024-09-14T11:08:27.178+0000 7f7343be0640 10 monclient(hunting): get_auth_request con 0x55fa4ae2bbf0 auth_method 0 2024-09-14T11:08:27.740 INFO:tasks.workunit.client.0.smithi097.stderr: -234> 2024-09-14T11:08:27.178+0000 7f7343be0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:08:27.740 INFO:tasks.workunit.client.0.smithi097.stderr: -233> 2024-09-14T11:08:27.178+0000 7f7343be0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:08:27.740 INFO:tasks.workunit.client.0.smithi097.stderr: -232> 2024-09-14T11:08:27.178+0000 7f7343be0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:08:27.740 INFO:tasks.workunit.client.0.smithi097.stderr: -231> 2024-09-14T11:08:27.178+0000 7f733b3df640 10 monclient(hunting): handle_auth_done global_id 8346 payload 274 2024-09-14T11:08:27.740 INFO:tasks.workunit.client.0.smithi097.stderr: -230> 2024-09-14T11:08:27.178+0000 7f733b3df640 10 monclient: _finish_hunting 0 2024-09-14T11:08:27.740 INFO:tasks.workunit.client.0.smithi097.stderr: -229> 2024-09-14T11:08:27.178+0000 7f733b3df640 1 monclient: found mon.noname-a 2024-09-14T11:08:27.740 INFO:tasks.workunit.client.0.smithi097.stderr: -228> 2024-09-14T11:08:27.178+0000 7f733b3df640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.97:3300/0 2024-09-14T11:08:27.740 INFO:tasks.workunit.client.0.smithi097.stderr: -227> 2024-09-14T11:08:27.178+0000 7f7222ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:08:27.740 INFO:tasks.workunit.client.0.smithi097.stderr: -226> 2024-09-14T11:08:27.178+0000 7f7222ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:08:27.740 INFO:tasks.workunit.client.0.smithi097.stderr: -225> 2024-09-14T11:08:27.178+0000 7f7222ffd640 10 monclient: dump: 2024-09-14T11:08:27.740 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:08:27.740 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:08:27.741 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:27.741 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:27.741 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:08:27.741 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:27.741 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:08:27.741 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:08:27.741 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:08:27.741 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:27.741 INFO:tasks.workunit.client.0.smithi097.stderr: -224> 2024-09-14T11:08:27.178+0000 7f7222ffd640 10 monclient: _finish_auth 0 2024-09-14T11:08:27.741 INFO:tasks.workunit.client.0.smithi097.stderr: -223> 2024-09-14T11:08:27.178+0000 7f7222ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:08:27.741 INFO:tasks.workunit.client.0.smithi097.stderr: -222> 2024-09-14T11:08:27.178+0000 7f7222ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:08:27.741 INFO:tasks.workunit.client.0.smithi097.stderr: -221> 2024-09-14T11:08:27.178+0000 7f7222ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:08:27.741 INFO:tasks.workunit.client.0.smithi097.stderr: -220> 2024-09-14T11:08:27.178+0000 7f7222ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:08:27.741 INFO:tasks.workunit.client.0.smithi097.stderr: -219> 2024-09-14T11:08:27.178+0000 7f7222ffd640 10 monclient: dump: 2024-09-14T11:08:27.742 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:08:27.742 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:08:27.742 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:27.742 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:27.742 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:08:27.742 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:27.742 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:08:27.742 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:08:27.742 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:08:27.742 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:27.742 INFO:tasks.workunit.client.0.smithi097.stderr: -218> 2024-09-14T11:08:27.178+0000 7f7348412800 5 monclient: authenticate success, global_id 8346 2024-09-14T11:08:27.742 INFO:tasks.workunit.client.0.smithi097.stderr: -217> 2024-09-14T11:08:27.178+0000 7f7348412800 10 monclient: get_monmap_and_config success 2024-09-14T11:08:27.742 INFO:tasks.workunit.client.0.smithi097.stderr: -216> 2024-09-14T11:08:27.178+0000 7f7348412800 4 set_mon_vals no callback set 2024-09-14T11:08:27.742 INFO:tasks.workunit.client.0.smithi097.stderr: -215> 2024-09-14T11:08:27.179+0000 7f7348412800 10 monclient: shutdown 2024-09-14T11:08:27.742 INFO:tasks.workunit.client.0.smithi097.stderr: -214> 2024-09-14T11:08:27.179+0000 7f7348412800 10 monclient: build_initial_monmap 2024-09-14T11:08:27.743 INFO:tasks.workunit.client.0.smithi097.stderr: -213> 2024-09-14T11:08:27.179+0000 7f7348412800 1 build_initial for_mkfs: 0 2024-09-14T11:08:27.743 INFO:tasks.workunit.client.0.smithi097.stderr: -212> 2024-09-14T11:08:27.179+0000 7f7348412800 10 monclient: monmap: 2024-09-14T11:08:27.743 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:08:27.743 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:08:27.743 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:08:27.743 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:08:27.743 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:08:27.743 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:27.743 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:08:27.743 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:08:27.743 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:08:27.743 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:27.743 INFO:tasks.workunit.client.0.smithi097.stderr: -211> 2024-09-14T11:08:27.179+0000 7f7348412800 5 AuthRegistry(0x55fa4adffd20) adding auth protocol: cephx 2024-09-14T11:08:27.743 INFO:tasks.workunit.client.0.smithi097.stderr: -210> 2024-09-14T11:08:27.179+0000 7f7348412800 5 AuthRegistry(0x55fa4adffd20) adding auth protocol: cephx 2024-09-14T11:08:27.743 INFO:tasks.workunit.client.0.smithi097.stderr: -209> 2024-09-14T11:08:27.179+0000 7f7348412800 5 AuthRegistry(0x55fa4adffd20) adding auth protocol: cephx 2024-09-14T11:08:27.744 INFO:tasks.workunit.client.0.smithi097.stderr: -208> 2024-09-14T11:08:27.179+0000 7f7348412800 5 AuthRegistry(0x55fa4adffd20) adding con mode: secure 2024-09-14T11:08:27.744 INFO:tasks.workunit.client.0.smithi097.stderr: -207> 2024-09-14T11:08:27.179+0000 7f7348412800 5 AuthRegistry(0x55fa4adffd20) adding con mode: crc 2024-09-14T11:08:27.744 INFO:tasks.workunit.client.0.smithi097.stderr: -206> 2024-09-14T11:08:27.179+0000 7f7348412800 5 AuthRegistry(0x55fa4adffd20) adding con mode: secure 2024-09-14T11:08:27.744 INFO:tasks.workunit.client.0.smithi097.stderr: -205> 2024-09-14T11:08:27.179+0000 7f7348412800 5 AuthRegistry(0x55fa4adffd20) adding con mode: crc 2024-09-14T11:08:27.744 INFO:tasks.workunit.client.0.smithi097.stderr: -204> 2024-09-14T11:08:27.179+0000 7f7348412800 5 AuthRegistry(0x55fa4adffd20) adding con mode: secure 2024-09-14T11:08:27.744 INFO:tasks.workunit.client.0.smithi097.stderr: -203> 2024-09-14T11:08:27.179+0000 7f7348412800 5 AuthRegistry(0x55fa4adffd20) adding con mode: crc 2024-09-14T11:08:27.744 INFO:tasks.workunit.client.0.smithi097.stderr: -202> 2024-09-14T11:08:27.179+0000 7f7348412800 5 AuthRegistry(0x55fa4adffd20) adding con mode: crc 2024-09-14T11:08:27.744 INFO:tasks.workunit.client.0.smithi097.stderr: -201> 2024-09-14T11:08:27.179+0000 7f7348412800 5 AuthRegistry(0x55fa4adffd20) adding con mode: secure 2024-09-14T11:08:27.744 INFO:tasks.workunit.client.0.smithi097.stderr: -200> 2024-09-14T11:08:27.179+0000 7f7348412800 5 AuthRegistry(0x55fa4adffd20) adding con mode: crc 2024-09-14T11:08:27.744 INFO:tasks.workunit.client.0.smithi097.stderr: -199> 2024-09-14T11:08:27.179+0000 7f7348412800 5 AuthRegistry(0x55fa4adffd20) adding con mode: secure 2024-09-14T11:08:27.744 INFO:tasks.workunit.client.0.smithi097.stderr: -198> 2024-09-14T11:08:27.179+0000 7f7348412800 5 AuthRegistry(0x55fa4adffd20) adding con mode: crc 2024-09-14T11:08:27.744 INFO:tasks.workunit.client.0.smithi097.stderr: -197> 2024-09-14T11:08:27.179+0000 7f7348412800 5 AuthRegistry(0x55fa4adffd20) adding con mode: secure 2024-09-14T11:08:27.744 INFO:tasks.workunit.client.0.smithi097.stderr: -196> 2024-09-14T11:08:27.179+0000 7f7348412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:27.744 INFO:tasks.workunit.client.0.smithi097.stderr: -195> 2024-09-14T11:08:27.179+0000 7f7348412800 1 librados: starting msgr at 2024-09-14T11:08:27.744 INFO:tasks.workunit.client.0.smithi097.stderr: -194> 2024-09-14T11:08:27.179+0000 7f7348412800 1 librados: starting objecter 2024-09-14T11:08:27.745 INFO:tasks.workunit.client.0.smithi097.stderr: -193> 2024-09-14T11:08:27.180+0000 7f7348412800 5 asok(0x55fa4ab3c270) register_command objecter_requests cmddesc objecter_requests hook 0x55fa4ae01780 EEXIST 2024-09-14T11:08:27.745 INFO:tasks.workunit.client.0.smithi097.stderr: -192> 2024-09-14T11:08:27.180+0000 7f7348412800 1 librados: setting wanted keys 2024-09-14T11:08:27.745 INFO:tasks.workunit.client.0.smithi097.stderr: -191> 2024-09-14T11:08:27.180+0000 7f7348412800 1 librados: calling monclient init 2024-09-14T11:08:27.745 INFO:tasks.workunit.client.0.smithi097.stderr: -190> 2024-09-14T11:08:27.180+0000 7f7348412800 10 monclient: init 2024-09-14T11:08:27.745 INFO:tasks.workunit.client.0.smithi097.stderr: -189> 2024-09-14T11:08:27.180+0000 7f7348412800 5 AuthRegistry(0x55fa4adf0b00) adding auth protocol: cephx 2024-09-14T11:08:27.745 INFO:tasks.workunit.client.0.smithi097.stderr: -188> 2024-09-14T11:08:27.180+0000 7f7348412800 5 AuthRegistry(0x55fa4adf0b00) adding auth protocol: cephx 2024-09-14T11:08:27.745 INFO:tasks.workunit.client.0.smithi097.stderr: -187> 2024-09-14T11:08:27.180+0000 7f7348412800 5 AuthRegistry(0x55fa4adf0b00) adding auth protocol: cephx 2024-09-14T11:08:27.745 INFO:tasks.workunit.client.0.smithi097.stderr: -186> 2024-09-14T11:08:27.180+0000 7f7348412800 5 AuthRegistry(0x55fa4adf0b00) adding con mode: secure 2024-09-14T11:08:27.745 INFO:tasks.workunit.client.0.smithi097.stderr: -185> 2024-09-14T11:08:27.180+0000 7f7348412800 5 AuthRegistry(0x55fa4adf0b00) adding con mode: crc 2024-09-14T11:08:27.745 INFO:tasks.workunit.client.0.smithi097.stderr: -184> 2024-09-14T11:08:27.180+0000 7f7348412800 5 AuthRegistry(0x55fa4adf0b00) adding con mode: secure 2024-09-14T11:08:27.745 INFO:tasks.workunit.client.0.smithi097.stderr: -183> 2024-09-14T11:08:27.180+0000 7f7348412800 5 AuthRegistry(0x55fa4adf0b00) adding con mode: crc 2024-09-14T11:08:27.745 INFO:tasks.workunit.client.0.smithi097.stderr: -182> 2024-09-14T11:08:27.180+0000 7f7348412800 5 AuthRegistry(0x55fa4adf0b00) adding con mode: secure 2024-09-14T11:08:27.745 INFO:tasks.workunit.client.0.smithi097.stderr: -181> 2024-09-14T11:08:27.180+0000 7f7348412800 5 AuthRegistry(0x55fa4adf0b00) adding con mode: crc 2024-09-14T11:08:27.745 INFO:tasks.workunit.client.0.smithi097.stderr: -180> 2024-09-14T11:08:27.180+0000 7f7348412800 5 AuthRegistry(0x55fa4adf0b00) adding con mode: crc 2024-09-14T11:08:27.745 INFO:tasks.workunit.client.0.smithi097.stderr: -179> 2024-09-14T11:08:27.180+0000 7f7348412800 5 AuthRegistry(0x55fa4adf0b00) adding con mode: secure 2024-09-14T11:08:27.746 INFO:tasks.workunit.client.0.smithi097.stderr: -178> 2024-09-14T11:08:27.180+0000 7f7348412800 5 AuthRegistry(0x55fa4adf0b00) adding con mode: crc 2024-09-14T11:08:27.746 INFO:tasks.workunit.client.0.smithi097.stderr: -177> 2024-09-14T11:08:27.180+0000 7f7348412800 5 AuthRegistry(0x55fa4adf0b00) adding con mode: secure 2024-09-14T11:08:27.746 INFO:tasks.workunit.client.0.smithi097.stderr: -176> 2024-09-14T11:08:27.180+0000 7f7348412800 5 AuthRegistry(0x55fa4adf0b00) adding con mode: crc 2024-09-14T11:08:27.746 INFO:tasks.workunit.client.0.smithi097.stderr: -175> 2024-09-14T11:08:27.180+0000 7f7348412800 5 AuthRegistry(0x55fa4adf0b00) adding con mode: secure 2024-09-14T11:08:27.746 INFO:tasks.workunit.client.0.smithi097.stderr: -174> 2024-09-14T11:08:27.180+0000 7f7348412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:27.746 INFO:tasks.workunit.client.0.smithi097.stderr: -173> 2024-09-14T11:08:27.180+0000 7f7348412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:27.746 INFO:tasks.workunit.client.0.smithi097.stderr: -172> 2024-09-14T11:08:27.180+0000 7f7348412800 5 asok(0x55fa4ab3c270) register_command rotate-key cmddesc rotate-key hook 0x55fa4adf0c48 EEXIST 2024-09-14T11:08:27.746 INFO:tasks.workunit.client.0.smithi097.stderr: -171> 2024-09-14T11:08:27.180+0000 7f7348412800 10 monclient: _reopen_session rank -1 2024-09-14T11:08:27.746 INFO:tasks.workunit.client.0.smithi097.stderr: -170> 2024-09-14T11:08:27.180+0000 7f7348412800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:08:27.746 INFO:tasks.workunit.client.0.smithi097.stderr: -169> 2024-09-14T11:08:27.180+0000 7f7348412800 10 monclient(hunting): picked mon.noname-a con 0x55fa4ae21110 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:08:27.746 INFO:tasks.workunit.client.0.smithi097.stderr: -168> 2024-09-14T11:08:27.180+0000 7f7348412800 10 monclient(hunting): picked mon.noname-b con 0x55fa4ae2bbf0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:08:27.746 INFO:tasks.workunit.client.0.smithi097.stderr: -167> 2024-09-14T11:08:27.180+0000 7f7348412800 10 monclient(hunting): picked mon.noname-c con 0x55fa4ae307c0 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:08:27.746 INFO:tasks.workunit.client.0.smithi097.stderr: -166> 2024-09-14T11:08:27.180+0000 7f7348412800 10 monclient(hunting): start opening mon connection 2024-09-14T11:08:27.746 INFO:tasks.workunit.client.0.smithi097.stderr: -165> 2024-09-14T11:08:27.180+0000 7f7348412800 10 monclient(hunting): start opening mon connection 2024-09-14T11:08:27.746 INFO:tasks.workunit.client.0.smithi097.stderr: -164> 2024-09-14T11:08:27.180+0000 7f7348412800 10 monclient(hunting): start opening mon connection 2024-09-14T11:08:27.747 INFO:tasks.workunit.client.0.smithi097.stderr: -163> 2024-09-14T11:08:27.180+0000 7f7348412800 10 monclient(hunting): _renew_subs 2024-09-14T11:08:27.747 INFO:tasks.workunit.client.0.smithi097.stderr: -162> 2024-09-14T11:08:27.180+0000 7f7348412800 10 monclient(hunting): authenticate will time out at 2188.833674s 2024-09-14T11:08:27.747 INFO:tasks.workunit.client.0.smithi097.stderr: -161> 2024-09-14T11:08:27.180+0000 7f7343be0640 10 monclient(hunting): get_auth_request con 0x55fa4ae307c0 auth_method 0 2024-09-14T11:08:27.747 INFO:tasks.workunit.client.0.smithi097.stderr: -160> 2024-09-14T11:08:27.180+0000 7f7343be0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:08:27.747 INFO:tasks.workunit.client.0.smithi097.stderr: -159> 2024-09-14T11:08:27.180+0000 7f7343be0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:08:27.747 INFO:tasks.workunit.client.0.smithi097.stderr: -158> 2024-09-14T11:08:27.180+0000 7f7343be0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:08:27.747 INFO:tasks.workunit.client.0.smithi097.stderr: -157> 2024-09-14T11:08:27.180+0000 7f733b3df640 10 monclient(hunting): get_auth_request con 0x55fa4ae21110 auth_method 0 2024-09-14T11:08:27.747 INFO:tasks.workunit.client.0.smithi097.stderr: -156> 2024-09-14T11:08:27.180+0000 7f733b3df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:08:27.747 INFO:tasks.workunit.client.0.smithi097.stderr: -155> 2024-09-14T11:08:27.180+0000 7f733b3df640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:08:27.747 INFO:tasks.workunit.client.0.smithi097.stderr: -154> 2024-09-14T11:08:27.180+0000 7f733b3df640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:08:27.747 INFO:tasks.workunit.client.0.smithi097.stderr: -153> 2024-09-14T11:08:27.180+0000 7f7343be0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:08:27.747 INFO:tasks.workunit.client.0.smithi097.stderr: -152> 2024-09-14T11:08:27.180+0000 7f7343be0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:08:27.747 INFO:tasks.workunit.client.0.smithi097.stderr: -151> 2024-09-14T11:08:27.180+0000 7f7343be0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:08:27.747 INFO:tasks.workunit.client.0.smithi097.stderr: -150> 2024-09-14T11:08:27.180+0000 7f733b3df640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:08:27.748 INFO:tasks.workunit.client.0.smithi097.stderr: -149> 2024-09-14T11:08:27.180+0000 7f733b3df640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:08:27.748 INFO:tasks.workunit.client.0.smithi097.stderr: -148> 2024-09-14T11:08:27.180+0000 7f733b3df640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:08:27.748 INFO:tasks.workunit.client.0.smithi097.stderr: -147> 2024-09-14T11:08:27.180+0000 7f73443e1640 10 monclient(hunting): get_auth_request con 0x55fa4ae2bbf0 auth_method 0 2024-09-14T11:08:27.748 INFO:tasks.workunit.client.0.smithi097.stderr: -146> 2024-09-14T11:08:27.180+0000 7f73443e1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:08:27.748 INFO:tasks.workunit.client.0.smithi097.stderr: -145> 2024-09-14T11:08:27.180+0000 7f73443e1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:08:27.748 INFO:tasks.workunit.client.0.smithi097.stderr: -144> 2024-09-14T11:08:27.180+0000 7f73443e1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:08:27.748 INFO:tasks.workunit.client.0.smithi097.stderr: -143> 2024-09-14T11:08:27.181+0000 7f7343be0640 10 monclient(hunting): handle_auth_done global_id 7826 payload 824 2024-09-14T11:08:27.748 INFO:tasks.workunit.client.0.smithi097.stderr: -142> 2024-09-14T11:08:27.181+0000 7f7343be0640 10 monclient: _finish_hunting 0 2024-09-14T11:08:27.748 INFO:tasks.workunit.client.0.smithi097.stderr: -141> 2024-09-14T11:08:27.181+0000 7f7343be0640 1 monclient: found mon.noname-c 2024-09-14T11:08:27.748 INFO:tasks.workunit.client.0.smithi097.stderr: -140> 2024-09-14T11:08:27.181+0000 7f7343be0640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:08:27.748 INFO:tasks.workunit.client.0.smithi097.stderr: -139> 2024-09-14T11:08:27.181+0000 7f72217fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:08:27.748 INFO:tasks.workunit.client.0.smithi097.stderr: -138> 2024-09-14T11:08:27.181+0000 7f72217fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:08:27.748 INFO:tasks.workunit.client.0.smithi097.stderr: -137> 2024-09-14T11:08:27.181+0000 7f72217fa640 10 monclient: dump: 2024-09-14T11:08:27.749 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:08:27.749 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:08:27.749 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:27.749 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:27.749 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:08:27.749 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:27.749 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:08:27.749 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:08:27.749 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:08:27.749 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:27.749 INFO:tasks.workunit.client.0.smithi097.stderr: -136> 2024-09-14T11:08:27.181+0000 7f72217fa640 10 monclient: _finish_auth 0 2024-09-14T11:08:27.749 INFO:tasks.workunit.client.0.smithi097.stderr: -135> 2024-09-14T11:08:27.181+0000 7f72217fa640 10 monclient: _check_auth_tickets 2024-09-14T11:08:27.749 INFO:tasks.workunit.client.0.smithi097.stderr: -134> 2024-09-14T11:08:27.181+0000 7f72217fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:08:27.749 INFO:tasks.workunit.client.0.smithi097.stderr: -133> 2024-09-14T11:08:27.181+0000 7f72217fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:08:27.749 INFO:tasks.workunit.client.0.smithi097.stderr: -132> 2024-09-14T11:08:27.181+0000 7f72217fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:08:27.750 INFO:tasks.workunit.client.0.smithi097.stderr: -131> 2024-09-14T11:08:27.181+0000 7f72217fa640 10 monclient: dump: 2024-09-14T11:08:27.750 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:08:27.750 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:08:27.750 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:27.750 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:27.750 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:08:27.750 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:27.750 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:08:27.750 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:08:27.750 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:08:27.750 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:27.750 INFO:tasks.workunit.client.0.smithi097.stderr: -130> 2024-09-14T11:08:27.181+0000 7f7348412800 5 monclient: authenticate success, global_id 7826 2024-09-14T11:08:27.750 INFO:tasks.workunit.client.0.smithi097.stderr: -129> 2024-09-14T11:08:27.181+0000 7f7222ffd640 4 set_mon_vals no callback set 2024-09-14T11:08:27.750 INFO:tasks.workunit.client.0.smithi097.stderr: -128> 2024-09-14T11:08:27.181+0000 7f7348412800 10 monclient: _renew_subs 2024-09-14T11:08:27.751 INFO:tasks.workunit.client.0.smithi097.stderr: -127> 2024-09-14T11:08:27.181+0000 7f7348412800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:08:27.751 INFO:tasks.workunit.client.0.smithi097.stderr: -126> 2024-09-14T11:08:27.181+0000 7f7348412800 10 monclient: _renew_subs 2024-09-14T11:08:27.751 INFO:tasks.workunit.client.0.smithi097.stderr: -125> 2024-09-14T11:08:27.181+0000 7f7348412800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:08:27.751 INFO:tasks.workunit.client.0.smithi097.stderr: -124> 2024-09-14T11:08:27.181+0000 7f7348412800 1 librados: init done 2024-09-14T11:08:27.751 INFO:tasks.workunit.client.0.smithi097.stderr: -123> 2024-09-14T11:08:27.181+0000 7f7348412800 5 asok(0x55fa4ab3c270) register_command cr dump hook 0x55fa4ae2a088 2024-09-14T11:08:27.751 INFO:tasks.workunit.client.0.smithi097.stderr: -122> 2024-09-14T11:08:27.183+0000 7f7348412800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.751 INFO:tasks.workunit.client.0.smithi097.stderr: -121> 2024-09-14T11:08:27.183+0000 7f72217fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:08:27.751 INFO:tasks.workunit.client.0.smithi097.stderr: -120> 2024-09-14T11:08:27.183+0000 7f72217fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:08:27.751 INFO:tasks.workunit.client.0.smithi097.stderr: -119> 2024-09-14T11:08:27.183+0000 7f72217fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:08:27.751 INFO:tasks.workunit.client.0.smithi097.stderr: -118> 2024-09-14T11:08:27.183+0000 7f733b3df640 10 monclient: get_auth_request con 0x7f720c077230 auth_method 0 2024-09-14T11:08:27.751 INFO:tasks.workunit.client.0.smithi097.stderr: -117> 2024-09-14T11:08:27.184+0000 7f73443e1640 10 monclient: get_auth_request con 0x55fa4ae4ac60 auth_method 0 2024-09-14T11:08:27.751 INFO:tasks.workunit.client.0.smithi097.stderr: -116> 2024-09-14T11:08:27.184+0000 7f7348412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:27.751 INFO:tasks.workunit.client.0.smithi097.stderr: -115> 2024-09-14T11:08:27.184+0000 7f7348412800 20 realm 2024-09-14T11:08:27.751 INFO:tasks.workunit.client.0.smithi097.stderr: -114> 2024-09-14T11:08:27.184+0000 7f7348412800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.752 INFO:tasks.workunit.client.0.smithi097.stderr: -113> 2024-09-14T11:08:27.185+0000 7f7348412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:27.752 INFO:tasks.workunit.client.0.smithi097.stderr: -112> 2024-09-14T11:08:27.185+0000 7f7348412800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:08:27.752 INFO:tasks.workunit.client.0.smithi097.stderr: -111> 2024-09-14T11:08:27.185+0000 7f7348412800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.752 INFO:tasks.workunit.client.0.smithi097.stderr: -110> 2024-09-14T11:08:27.185+0000 7f7348412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:27.752 INFO:tasks.workunit.client.0.smithi097.stderr: -109> 2024-09-14T11:08:27.185+0000 7f7348412800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.752 INFO:tasks.workunit.client.0.smithi097.stderr: -108> 2024-09-14T11:08:27.185+0000 7f733b3df640 10 monclient: get_auth_request con 0x55fa4ae4eec0 auth_method 0 2024-09-14T11:08:27.752 INFO:tasks.workunit.client.0.smithi097.stderr: -107> 2024-09-14T11:08:27.186+0000 7f7348412800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:08:27.752 INFO:tasks.workunit.client.0.smithi097.stderr: -106> 2024-09-14T11:08:27.186+0000 7f7348412800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.752 INFO:tasks.workunit.client.0.smithi097.stderr: -105> 2024-09-14T11:08:27.186+0000 7f73443e1640 10 monclient: get_auth_request con 0x55fa4ae52790 auth_method 0 2024-09-14T11:08:27.752 INFO:tasks.workunit.client.0.smithi097.stderr: -104> 2024-09-14T11:08:27.187+0000 7f7348412800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:08:27.752 INFO:tasks.workunit.client.0.smithi097.stderr: -103> 2024-09-14T11:08:27.187+0000 7f7348412800 20 searching for the correct realm 2024-09-14T11:08:27.752 INFO:tasks.workunit.client.0.smithi097.stderr: -102> 2024-09-14T11:08:27.187+0000 7f7343be0640 10 monclient: get_auth_request con 0x55fa4ae57490 auth_method 0 2024-09-14T11:08:27.752 INFO:tasks.workunit.client.0.smithi097.stderr: -101> 2024-09-14T11:08:27.188+0000 7f733b3df640 0 -- 172.21.15.97:0/625851093 >> [v2:172.21.15.97:6808/2081705332,v1:172.21.15.97:6809/2081705332] conn(0x7f733405dc40 msgr2=0x7f73340853d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:08:27.752 INFO:tasks.workunit.client.0.smithi097.stderr: -100> 2024-09-14T11:08:27.389+0000 7f733b3df640 10 monclient: get_auth_request con 0x7f733405dc40 auth_method 0 2024-09-14T11:08:27.753 INFO:tasks.workunit.client.0.smithi097.stderr: -99> 2024-09-14T11:08:27.391+0000 7f73443e1640 10 monclient: get_auth_request con 0x7f732c04d040 auth_method 0 2024-09-14T11:08:27.753 INFO:tasks.workunit.client.0.smithi097.stderr: -98> 2024-09-14T11:08:27.394+0000 7f7343be0640 10 monclient: get_auth_request con 0x7f732c01b040 auth_method 0 2024-09-14T11:08:27.753 INFO:tasks.workunit.client.0.smithi097.stderr: -97> 2024-09-14T11:08:27.394+0000 7f7343be0640 0 -- 172.21.15.97:0/625851093 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7f732c01b040 msgr2=0x7f732c04c410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:08:27.753 INFO:tasks.workunit.client.0.smithi097.stderr: -96> 2024-09-14T11:08:27.596+0000 7f7343be0640 10 monclient: get_auth_request con 0x7f732c01b040 auth_method 0 2024-09-14T11:08:27.753 INFO:tasks.workunit.client.0.smithi097.stderr: -95> 2024-09-14T11:08:27.597+0000 7f733b3df640 10 monclient: get_auth_request con 0x7f733404b000 auth_method 0 2024-09-14T11:08:27.753 INFO:tasks.workunit.client.0.smithi097.stderr: -94> 2024-09-14T11:08:27.604+0000 7f7348412800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:08:27.753 INFO:tasks.workunit.client.0.smithi097.stderr: -93> 2024-09-14T11:08:27.604+0000 7f7348412800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:08:27.753 INFO:tasks.workunit.client.0.smithi097.stderr: -92> 2024-09-14T11:08:27.604+0000 7f7348412800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:08:27.753 INFO:tasks.workunit.client.0.smithi097.stderr: -91> 2024-09-14T11:08:27.604+0000 7f7348412800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:08:27.753 INFO:tasks.workunit.client.0.smithi097.stderr: -90> 2024-09-14T11:08:27.604+0000 7f7348412800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:08:27.753 INFO:tasks.workunit.client.0.smithi097.stderr: -89> 2024-09-14T11:08:27.604+0000 7f7348412800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:08:27.753 INFO:tasks.workunit.client.0.smithi097.stderr: -88> 2024-09-14T11:08:27.604+0000 7f7348412800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.753 INFO:tasks.workunit.client.0.smithi097.stderr: -87> 2024-09-14T11:08:27.604+0000 7f7348412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:27.754 INFO:tasks.workunit.client.0.smithi097.stderr: -86> 2024-09-14T11:08:27.604+0000 7f7348412800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.754 INFO:tasks.workunit.client.0.smithi097.stderr: -85> 2024-09-14T11:08:27.604+0000 7f7348412800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:08:27.754 INFO:tasks.workunit.client.0.smithi097.stderr: -84> 2024-09-14T11:08:27.604+0000 7f7348412800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.754 INFO:tasks.workunit.client.0.smithi097.stderr: -83> 2024-09-14T11:08:27.605+0000 7f7348412800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:08:27.754 INFO:tasks.workunit.client.0.smithi097.stderr: -82> 2024-09-14T11:08:27.605+0000 7f7348412800 20 zone default found 2024-09-14T11:08:27.754 INFO:tasks.workunit.client.0.smithi097.stderr: -81> 2024-09-14T11:08:27.605+0000 7f7348412800 4 Realm: () 2024-09-14T11:08:27.754 INFO:tasks.workunit.client.0.smithi097.stderr: -80> 2024-09-14T11:08:27.605+0000 7f7348412800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:08:27.754 INFO:tasks.workunit.client.0.smithi097.stderr: -79> 2024-09-14T11:08:27.605+0000 7f7348412800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:08:27.754 INFO:tasks.workunit.client.0.smithi097.stderr: -78> 2024-09-14T11:08:27.605+0000 7f7348412800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:08:27.754 INFO:tasks.workunit.client.0.smithi097.stderr: -77> 2024-09-14T11:08:27.605+0000 7f7348412800 20 zonegroup default 2024-09-14T11:08:27.754 INFO:tasks.workunit.client.0.smithi097.stderr: -76> 2024-09-14T11:08:27.605+0000 7f7348412800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.754 INFO:tasks.workunit.client.0.smithi097.stderr: -75> 2024-09-14T11:08:27.605+0000 7f7348412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:27.754 INFO:tasks.workunit.client.0.smithi097.stderr: -74> 2024-09-14T11:08:27.605+0000 7f7348412800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.754 INFO:tasks.workunit.client.0.smithi097.stderr: -73> 2024-09-14T11:08:27.606+0000 7f7348412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:27.754 INFO:tasks.workunit.client.0.smithi097.stderr: -72> 2024-09-14T11:08:27.606+0000 7f7348412800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.755 INFO:tasks.workunit.client.0.smithi097.stderr: -71> 2024-09-14T11:08:27.606+0000 7f7348412800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:27.755 INFO:tasks.workunit.client.0.smithi097.stderr: -70> 2024-09-14T11:08:27.606+0000 7f7348412800 20 started sync module instance, tier type = 2024-09-14T11:08:27.755 INFO:tasks.workunit.client.0.smithi097.stderr: -69> 2024-09-14T11:08:27.606+0000 7f7348412800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:08:27.755 INFO:tasks.workunit.client.0.smithi097.stderr: -68> 2024-09-14T11:08:27.617+0000 7f7348412800 20 add_watcher() i=0 2024-09-14T11:08:27.755 INFO:tasks.workunit.client.0.smithi097.stderr: -67> 2024-09-14T11:08:27.617+0000 7f7348412800 20 add_watcher() i=1 2024-09-14T11:08:27.755 INFO:tasks.workunit.client.0.smithi097.stderr: -66> 2024-09-14T11:08:27.617+0000 7f7348412800 20 add_watcher() i=2 2024-09-14T11:08:27.755 INFO:tasks.workunit.client.0.smithi097.stderr: -65> 2024-09-14T11:08:27.617+0000 7f7348412800 20 add_watcher() i=3 2024-09-14T11:08:27.755 INFO:tasks.workunit.client.0.smithi097.stderr: -64> 2024-09-14T11:08:27.617+0000 7f7348412800 20 add_watcher() i=4 2024-09-14T11:08:27.755 INFO:tasks.workunit.client.0.smithi097.stderr: -63> 2024-09-14T11:08:27.617+0000 7f7348412800 20 add_watcher() i=5 2024-09-14T11:08:27.755 INFO:tasks.workunit.client.0.smithi097.stderr: -62> 2024-09-14T11:08:27.617+0000 7f7348412800 20 add_watcher() i=6 2024-09-14T11:08:27.755 INFO:tasks.workunit.client.0.smithi097.stderr: -61> 2024-09-14T11:08:27.618+0000 7f7348412800 20 add_watcher() i=7 2024-09-14T11:08:27.755 INFO:tasks.workunit.client.0.smithi097.stderr: -60> 2024-09-14T11:08:27.618+0000 7f7348412800 2 all 8 watchers are set, enabling cache 2024-09-14T11:08:27.755 INFO:tasks.workunit.client.0.smithi097.stderr: -59> 2024-09-14T11:08:27.620+0000 7f7348412800 5 AuthRegistry(0x7fff033a4130) adding auth protocol: cephx 2024-09-14T11:08:27.755 INFO:tasks.workunit.client.0.smithi097.stderr: -58> 2024-09-14T11:08:27.620+0000 7f7348412800 5 AuthRegistry(0x7fff033a4130) adding auth protocol: cephx 2024-09-14T11:08:27.756 INFO:tasks.workunit.client.0.smithi097.stderr: -57> 2024-09-14T11:08:27.620+0000 7f7348412800 5 AuthRegistry(0x7fff033a4130) adding auth protocol: cephx 2024-09-14T11:08:27.756 INFO:tasks.workunit.client.0.smithi097.stderr: -56> 2024-09-14T11:08:27.620+0000 7f7348412800 5 AuthRegistry(0x7fff033a4130) adding con mode: secure 2024-09-14T11:08:27.756 INFO:tasks.workunit.client.0.smithi097.stderr: -55> 2024-09-14T11:08:27.620+0000 7f7348412800 5 AuthRegistry(0x7fff033a4130) adding con mode: crc 2024-09-14T11:08:27.756 INFO:tasks.workunit.client.0.smithi097.stderr: -54> 2024-09-14T11:08:27.620+0000 7f7348412800 5 AuthRegistry(0x7fff033a4130) adding con mode: secure 2024-09-14T11:08:27.756 INFO:tasks.workunit.client.0.smithi097.stderr: -53> 2024-09-14T11:08:27.620+0000 7f7348412800 5 AuthRegistry(0x7fff033a4130) adding con mode: crc 2024-09-14T11:08:27.756 INFO:tasks.workunit.client.0.smithi097.stderr: -52> 2024-09-14T11:08:27.620+0000 7f7348412800 5 AuthRegistry(0x7fff033a4130) adding con mode: secure 2024-09-14T11:08:27.756 INFO:tasks.workunit.client.0.smithi097.stderr: -51> 2024-09-14T11:08:27.620+0000 7f7348412800 5 AuthRegistry(0x7fff033a4130) adding con mode: crc 2024-09-14T11:08:27.756 INFO:tasks.workunit.client.0.smithi097.stderr: -50> 2024-09-14T11:08:27.620+0000 7f7348412800 5 AuthRegistry(0x7fff033a4130) adding con mode: crc 2024-09-14T11:08:27.756 INFO:tasks.workunit.client.0.smithi097.stderr: -49> 2024-09-14T11:08:27.620+0000 7f7348412800 5 AuthRegistry(0x7fff033a4130) adding con mode: secure 2024-09-14T11:08:27.756 INFO:tasks.workunit.client.0.smithi097.stderr: -48> 2024-09-14T11:08:27.620+0000 7f7348412800 5 AuthRegistry(0x7fff033a4130) adding con mode: crc 2024-09-14T11:08:27.756 INFO:tasks.workunit.client.0.smithi097.stderr: -47> 2024-09-14T11:08:27.620+0000 7f7348412800 5 AuthRegistry(0x7fff033a4130) adding con mode: secure 2024-09-14T11:08:27.756 INFO:tasks.workunit.client.0.smithi097.stderr: -46> 2024-09-14T11:08:27.620+0000 7f7348412800 5 AuthRegistry(0x7fff033a4130) adding con mode: crc 2024-09-14T11:08:27.756 INFO:tasks.workunit.client.0.smithi097.stderr: -45> 2024-09-14T11:08:27.620+0000 7f7348412800 5 AuthRegistry(0x7fff033a4130) adding con mode: secure 2024-09-14T11:08:27.757 INFO:tasks.workunit.client.0.smithi097.stderr: -44> 2024-09-14T11:08:27.620+0000 7f71f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:08:27.757 INFO:tasks.workunit.client.0.smithi097.stderr: -43> 2024-09-14T11:08:27.620+0000 7f7348412800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:27.757 INFO:tasks.workunit.client.0.smithi097.stderr: -42> 2024-09-14T11:08:27.620+0000 7f7348412800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:08:27.757 INFO:tasks.workunit.client.0.smithi097.stderr: -41> 2024-09-14T11:08:27.620+0000 7f7348412800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:08:27.757 INFO:tasks.workunit.client.0.smithi097.stderr: -40> 2024-09-14T11:08:27.621+0000 7f7348412800 5 asok(0x55fa4ab3c270) register_command cache list hook 0x55fa4ae1ffb0 2024-09-14T11:08:27.757 INFO:tasks.workunit.client.0.smithi097.stderr: -39> 2024-09-14T11:08:27.621+0000 7f7348412800 5 asok(0x55fa4ab3c270) register_command cache inspect hook 0x55fa4ae1ffb0 2024-09-14T11:08:27.757 INFO:tasks.workunit.client.0.smithi097.stderr: -38> 2024-09-14T11:08:27.621+0000 7f7348412800 5 asok(0x55fa4ab3c270) register_command cache erase hook 0x55fa4ae1ffb0 2024-09-14T11:08:27.757 INFO:tasks.workunit.client.0.smithi097.stderr: -37> 2024-09-14T11:08:27.621+0000 7f7348412800 5 asok(0x55fa4ab3c270) register_command cache zap hook 0x55fa4ae1ffb0 2024-09-14T11:08:27.757 INFO:tasks.workunit.client.0.smithi097.stderr: -36> 2024-09-14T11:08:27.621+0000 7f7348412800 5 note: GC not initialized 2024-09-14T11:08:27.757 INFO:tasks.workunit.client.0.smithi097.stderr: -35> 2024-09-14T11:08:27.621+0000 7f71f8fe1640 20 reqs_thread_entry: start 2024-09-14T11:08:27.757 INFO:tasks.workunit.client.0.smithi097.stderr: -34> 2024-09-14T11:08:27.621+0000 7f7348412800 5 asok(0x55fa4ab3c270) register_command sync trace show hook 0x7f732c001790 2024-09-14T11:08:27.757 INFO:tasks.workunit.client.0.smithi097.stderr: -33> 2024-09-14T11:08:27.621+0000 7f7348412800 5 asok(0x55fa4ab3c270) register_command sync trace history hook 0x7f732c001790 2024-09-14T11:08:27.757 INFO:tasks.workunit.client.0.smithi097.stderr: -32> 2024-09-14T11:08:27.621+0000 7f7348412800 5 asok(0x55fa4ab3c270) register_command sync trace active hook 0x7f732c001790 2024-09-14T11:08:27.757 INFO:tasks.workunit.client.0.smithi097.stderr: -31> 2024-09-14T11:08:27.621+0000 7f7348412800 5 asok(0x55fa4ab3c270) register_command sync trace active_short hook 0x7f732c001790 2024-09-14T11:08:27.757 INFO:tasks.workunit.client.0.smithi097.stderr: -30> 2024-09-14T11:08:27.621+0000 7f7348412800 20 init_complete bucket index max shards: 11 2024-09-14T11:08:27.758 INFO:tasks.workunit.client.0.smithi097.stderr: -29> 2024-09-14T11:08:27.621+0000 7f7348412800 20 Filter name: none 2024-09-14T11:08:27.758 INFO:tasks.workunit.client.0.smithi097.stderr: -28> 2024-09-14T11:08:27.621+0000 7f71727fc640 20 reqs_thread_entry: start 2024-09-14T11:08:27.758 INFO:tasks.workunit.client.0.smithi097.stderr: -27> 2024-09-14T11:08:27.621+0000 7f7348412800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:08:27.758 INFO:tasks.workunit.client.0.smithi097.stderr: -26> 2024-09-14T11:08:27.621+0000 7f7348412800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.758 INFO:tasks.workunit.client.0.smithi097.stderr: -25> 2024-09-14T11:08:27.622+0000 7f7348412800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:08:27.758 INFO:tasks.workunit.client.0.smithi097.stderr: -24> 2024-09-14T11:08:27.622+0000 7f7348412800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:08:27.758 INFO:tasks.workunit.client.0.smithi097.stderr: -23> 2024-09-14T11:08:27.622+0000 7f7348412800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:08:27.758 INFO:tasks.workunit.client.0.smithi097.stderr: -22> 2024-09-14T11:08:27.622+0000 7f7348412800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 : miss 2024-09-14T11:08:27.758 INFO:tasks.workunit.client.0.smithi097.stderr: -21> 2024-09-14T11:08:27.622+0000 7f7348412800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.758 INFO:tasks.workunit.client.0.smithi097.stderr: -20> 2024-09-14T11:08:27.622+0000 7f7348412800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:08:27.758 INFO:tasks.workunit.client.0.smithi097.stderr: -19> 2024-09-14T11:08:27.622+0000 7f7348412800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:08:27.758 INFO:tasks.workunit.client.0.smithi097.stderr: -18> 2024-09-14T11:08:27.622+0000 7f7348412800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:08:27.758 INFO:tasks.workunit.client.0.smithi097.stderr: -17> 2024-09-14T11:08:27.622+0000 7f7348412800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:08:27.758 INFO:tasks.workunit.client.0.smithi097.stderr: -16> 2024-09-14T11:08:27.622+0000 7f7348412800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:08:27.758 INFO:tasks.workunit.client.0.smithi097.stderr: -15> 2024-09-14T11:08:27.622+0000 7f7348412800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 2024-09-14T11:08:27.759 INFO:tasks.workunit.client.0.smithi097.stderr: -14> 2024-09-14T11:08:27.623+0000 7f7348412800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:08:27.759 INFO:tasks.workunit.client.0.smithi097.stderr: -13> 2024-09-14T11:08:27.632+0000 7f7348412800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:08:27.759 INFO:tasks.workunit.client.0.smithi097.stderr: -12> 2024-09-14T11:08:27.632+0000 7f7348412800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:08:27.759 INFO:tasks.workunit.client.0.smithi097.stderr: -11> 2024-09-14T11:08:27.632+0000 7f7348412800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:08:27.759 INFO:tasks.workunit.client.0.smithi097.stderr: -10> 2024-09-14T11:08:27.632+0000 7f7348412800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17, ofs0, ns] 2024-09-14T11:08:27.759 INFO:tasks.workunit.client.0.smithi097.stderr: -9> 2024-09-14T11:08:27.632+0000 7f7222ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595246 cookie 94533486772288 notifier 7826 bl.length()=827 2024-09-14T11:08:27.759 INFO:tasks.workunit.client.0.smithi097.stderr: -8> 2024-09-14T11:08:27.632+0000 7f7222ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:08:27.759 INFO:tasks.workunit.client.0.smithi097.stderr: -7> 2024-09-14T11:08:27.632+0000 7f7222ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:08:27.759 INFO:tasks.workunit.client.0.smithi097.stderr: -6> 2024-09-14T11:08:27.632+0000 7f7222ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:08:27.759 INFO:tasks.workunit.client.0.smithi097.stderr: -5> 2024-09-14T11:08:27.633+0000 7f7348412800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): orig_sources= new_sources= 2024-09-14T11:08:27.759 INFO:tasks.workunit.client.0.smithi097.stderr: -4> 2024-09-14T11:08:27.633+0000 7f7348412800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): potential sources added=[] removed=[] 2024-09-14T11:08:27.759 INFO:tasks.workunit.client.0.smithi097.stderr: -3> 2024-09-14T11:08:27.633+0000 7f7348412800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): orig_dests= new_dests= 2024-09-14T11:08:27.759 INFO:tasks.workunit.client.0.smithi097.stderr: -2> 2024-09-14T11:08:27.633+0000 7f7348412800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): potential dests added=[] removed=[] 2024-09-14T11:08:27.759 INFO:tasks.workunit.client.0.smithi097.stderr: -1> 2024-09-14T11:08:27.637+0000 7f7348412800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7348412800 time 2024-09-14T11:08:27.637324+0000 2024-09-14T11:08:27.760 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:08:27.760 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:27.760 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:08:27.760 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f734958c76a] 2024-09-14T11:08:27.760 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f734958c928] 2024-09-14T11:08:27.760 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fa49dcd0b1] 2024-09-14T11:08:27.760 INFO:tasks.workunit.client.0.smithi097.stderr: 4: radosgw-admin(+0xd8907c) [0x55fa4a2e107c] 2024-09-14T11:08:27.760 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55fa49ddcefd] 2024-09-14T11:08:27.760 INFO:tasks.workunit.client.0.smithi097.stderr: 6: main() 2024-09-14T11:08:27.760 INFO:tasks.workunit.client.0.smithi097.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f7348229590] 2024-09-14T11:08:27.760 INFO:tasks.workunit.client.0.smithi097.stderr: 8: __libc_start_main() 2024-09-14T11:08:27.760 INFO:tasks.workunit.client.0.smithi097.stderr: 9: _start() 2024-09-14T11:08:27.760 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:27.760 INFO:tasks.workunit.client.0.smithi097.stderr: 0> 2024-09-14T11:08:27.638+0000 7f7348412800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:08:27.761 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7f7348412800 thread_name:radosgw-admin 2024-09-14T11:08:27.761 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:27.761 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:08:27.761 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f734823e6f0] 2024-09-14T11:08:27.761 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f734828b99c] 2024-09-14T11:08:27.761 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-14T11:08:27.761 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-14T11:08:27.761 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f734958c7c4] 2024-09-14T11:08:27.761 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f734958c928] 2024-09-14T11:08:27.761 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fa49dcd0b1] 2024-09-14T11:08:27.761 INFO:tasks.workunit.client.0.smithi097.stderr: 8: radosgw-admin(+0xd8907c) [0x55fa4a2e107c] 2024-09-14T11:08:27.761 INFO:tasks.workunit.client.0.smithi097.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55fa49ddcefd] 2024-09-14T11:08:27.762 INFO:tasks.workunit.client.0.smithi097.stderr: 10: main() 2024-09-14T11:08:27.762 INFO:tasks.workunit.client.0.smithi097.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f7348229590] 2024-09-14T11:08:27.762 INFO:tasks.workunit.client.0.smithi097.stderr: 12: __libc_start_main() 2024-09-14T11:08:27.762 INFO:tasks.workunit.client.0.smithi097.stderr: 13: _start() 2024-09-14T11:08:27.762 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:08:27.762 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:27.762 INFO:tasks.workunit.client.0.smithi097.stderr:--- logging levels --- 2024-09-14T11:08:27.762 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 none 2024-09-14T11:08:27.762 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 lockdep 2024-09-14T11:08:27.762 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 context 2024-09-14T11:08:27.762 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 crush 2024-09-14T11:08:27.762 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds 2024-09-14T11:08:27.762 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_balancer 2024-09-14T11:08:27.763 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_locker 2024-09-14T11:08:27.763 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log 2024-09-14T11:08:27.763 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log_expire 2024-09-14T11:08:27.763 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_migrator 2024-09-14T11:08:27.763 INFO:tasks.workunit.client.0.smithi097.stderr: 3/ 5 mds_quiesce 2024-09-14T11:08:27.763 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 buffer 2024-09-14T11:08:27.763 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 timer 2024-09-14T11:08:27.763 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 filer 2024-09-14T11:08:27.763 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 striper 2024-09-14T11:08:27.763 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 objecter 2024-09-14T11:08:27.763 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rados 2024-09-14T11:08:27.763 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd 2024-09-14T11:08:27.763 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_mirror 2024-09-14T11:08:27.764 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_replay 2024-09-14T11:08:27.764 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_pwl 2024-09-14T11:08:27.764 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 journaler 2024-09-14T11:08:27.764 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objectcacher 2024-09-14T11:08:27.764 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:08:27.764 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 client 2024-09-14T11:08:27.764 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 osd 2024-09-14T11:08:27.764 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 optracker 2024-09-14T11:08:27.764 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objclass 2024-09-14T11:08:27.764 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 filestore 2024-09-14T11:08:27.764 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 journal 2024-09-14T11:08:27.764 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 ms 2024-09-14T11:08:27.764 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mon 2024-09-14T11:08:27.764 INFO:tasks.workunit.client.0.smithi097.stderr: 0/10 monc 2024-09-14T11:08:27.765 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 paxos 2024-09-14T11:08:27.765 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 tp 2024-09-14T11:08:27.765 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 auth 2024-09-14T11:08:27.765 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 crypto 2024-09-14T11:08:27.765 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 finisher 2024-09-14T11:08:27.765 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 reserver 2024-09-14T11:08:27.765 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 heartbeatmap 2024-09-14T11:08:27.765 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 perfcounter 2024-09-14T11:08:27.765 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw 2024-09-14T11:08:27.765 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_sync 2024-09-14T11:08:27.765 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_datacache 2024-09-14T11:08:27.765 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_access 2024-09-14T11:08:27.765 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:08:27.765 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_flight 2024-09-14T11:08:27.765 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:08:27.766 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw_notification 2024-09-14T11:08:27.766 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 javaclient 2024-09-14T11:08:27.766 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 asok 2024-09-14T11:08:27.766 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 throttle 2024-09-14T11:08:27.766 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 refs 2024-09-14T11:08:27.766 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 compressor 2024-09-14T11:08:27.766 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluestore 2024-09-14T11:08:27.766 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluefs 2024-09-14T11:08:27.766 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 bdev 2024-09-14T11:08:27.766 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 kstore 2024-09-14T11:08:27.766 INFO:tasks.workunit.client.0.smithi097.stderr: 4/ 5 rocksdb 2024-09-14T11:08:27.766 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 fuse 2024-09-14T11:08:27.766 INFO:tasks.workunit.client.0.smithi097.stderr: 2/ 5 mgr 2024-09-14T11:08:27.767 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mgrc 2024-09-14T11:08:27.767 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 dpdk 2024-09-14T11:08:27.767 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 eventtrace 2024-09-14T11:08:27.767 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 prioritycache 2024-09-14T11:08:27.767 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 test 2024-09-14T11:08:27.767 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:08:27.767 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephsqlite 2024-09-14T11:08:27.767 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:08:27.767 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore 2024-09-14T11:08:27.767 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_onode 2024-09-14T11:08:27.767 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_odata 2024-09-14T11:08:27.767 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_omap 2024-09-14T11:08:27.767 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_tm 2024-09-14T11:08:27.767 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_t 2024-09-14T11:08:27.768 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:08:27.768 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_epm 2024-09-14T11:08:27.768 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_lba 2024-09-14T11:08:27.768 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:08:27.768 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cache 2024-09-14T11:08:27.768 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_journal 2024-09-14T11:08:27.768 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_device 2024-09-14T11:08:27.768 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_backref 2024-09-14T11:08:27.768 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 alienstore 2024-09-14T11:08:27.768 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mclock 2024-09-14T11:08:27.768 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cyanstore 2024-09-14T11:08:27.768 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 ceph_exporter 2024-09-14T11:08:27.768 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 memstore 2024-09-14T11:08:27.768 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 trace 2024-09-14T11:08:27.769 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 ceph_dedup 2024-09-14T11:08:27.769 INFO:tasks.workunit.client.0.smithi097.stderr: -2/-2 (syslog threshold) 2024-09-14T11:08:27.769 INFO:tasks.workunit.client.0.smithi097.stderr: 99/99 (stderr threshold) 2024-09-14T11:08:27.769 INFO:tasks.workunit.client.0.smithi097.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:08:27.769 INFO:tasks.workunit.client.0.smithi097.stderr: 7f71727fc640 / http_manager 2024-09-14T11:08:27.769 INFO:tasks.workunit.client.0.smithi097.stderr: 7f71f8fe1640 / http_manager 2024-09-14T11:08:27.769 INFO:tasks.workunit.client.0.smithi097.stderr: 7f71f9fe3640 / rgw_dt_lg_renew 2024-09-14T11:08:27.769 INFO:tasks.workunit.client.0.smithi097.stderr: 7f72217fa640 / ms_dispatch 2024-09-14T11:08:27.769 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7222ffd640 / io_context_pool 2024-09-14T11:08:27.769 INFO:tasks.workunit.client.0.smithi097.stderr: 7f72297fa640 / ms_dispatch 2024-09-14T11:08:27.769 INFO:tasks.workunit.client.0.smithi097.stderr: 7f722bfff640 / ms_dispatch 2024-09-14T11:08:27.769 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7231e0b640 / io_context_pool 2024-09-14T11:08:27.769 INFO:tasks.workunit.client.0.smithi097.stderr: 7f733b3df640 / msgr-worker-2 2024-09-14T11:08:27.769 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7343be0640 / msgr-worker-1 2024-09-14T11:08:27.770 INFO:tasks.workunit.client.0.smithi097.stderr: 7f73443e1640 / msgr-worker-0 2024-09-14T11:08:27.770 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7344be2640 / io_context_pool 2024-09-14T11:08:27.770 INFO:tasks.workunit.client.0.smithi097.stderr: 7f7348412800 / radosgw-admin 2024-09-14T11:08:27.770 INFO:tasks.workunit.client.0.smithi097.stderr: max_recent 500 2024-09-14T11:08:27.770 INFO:tasks.workunit.client.0.smithi097.stderr: max_new 1000 2024-09-14T11:08:27.770 INFO:tasks.workunit.client.0.smithi097.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:08:27.639036Z_be9ccb17-7040-4ac3-8f81-de59756d0f9d/log 2024-09-14T11:08:27.770 INFO:tasks.workunit.client.0.smithi097.stderr:--- end dump of recent events --- 2024-09-14T11:08:27.770 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:08:27.771 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:08:27.772 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:08:27.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.719+0000 7f7cfc336800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.721+0000 7f7cfc336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:27.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.721+0000 7f7cfc336800 20 realm 2024-09-14T11:08:27.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.721+0000 7f7cfc336800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.721+0000 7f7cfc336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:27.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.721+0000 7f7cfc336800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:08:27.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.721+0000 7f7cfc336800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.721+0000 7f7cfc336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:27.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.721+0000 7f7cfc336800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.722+0000 7f7cfc336800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:08:27.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.722+0000 7f7cfc336800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.772 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.723+0000 7f7cfc336800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:08:27.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.723+0000 7f7cfc336800 20 searching for the correct realm 2024-09-14T11:08:27.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.725+0000 7f7cef8b6640 0 -- 172.21.15.97:0/933914846 >> [v2:172.21.15.97:6816/4093696477,v1:172.21.15.97:6817/4093696477] conn(0x558f72a3d5d0 msgr2=0x558f72a3f9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:08:27.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.729+0000 7f7cef8b6640 0 -- 172.21.15.97:0/933914846 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f7ce806b060 msgr2=0x7f7ce80c8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:08:27.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.936+0000 7f7cfc336800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:08:27.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.936+0000 7f7cfc336800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:08:27.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.936+0000 7f7cfc336800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:08:27.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.936+0000 7f7cfc336800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:08:27.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.936+0000 7f7cfc336800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:08:27.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.936+0000 7f7cfc336800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:08:27.935 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.936+0000 7f7cfc336800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.936+0000 7f7cfc336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:27.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.936+0000 7f7cfc336800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.937+0000 7f7cfc336800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:08:27.936 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.937+0000 7f7cfc336800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.937+0000 7f7cfc336800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:08:27.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.937+0000 7f7cfc336800 20 zone default found 2024-09-14T11:08:27.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.937+0000 7f7cfc336800 4 Realm: () 2024-09-14T11:08:27.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.937+0000 7f7cfc336800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:08:27.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.937+0000 7f7cfc336800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:08:27.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.937+0000 7f7cfc336800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:08:27.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.937+0000 7f7cfc336800 20 zonegroup default 2024-09-14T11:08:27.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.937+0000 7f7cfc336800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.937 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.937+0000 7f7cfc336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:27.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.937+0000 7f7cfc336800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.938+0000 7f7cfc336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:27.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.938+0000 7f7cfc336800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.938+0000 7f7cfc336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:27.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.938+0000 7f7cfc336800 20 started sync module instance, tier type = 2024-09-14T11:08:27.938 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.938+0000 7f7cfc336800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:08:27.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.947+0000 7f7cfc336800 20 add_watcher() i=0 2024-09-14T11:08:27.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.947+0000 7f7cfc336800 20 add_watcher() i=1 2024-09-14T11:08:27.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.947+0000 7f7cfc336800 20 add_watcher() i=2 2024-09-14T11:08:27.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.947+0000 7f7cfc336800 20 add_watcher() i=3 2024-09-14T11:08:27.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.947+0000 7f7cfc336800 20 add_watcher() i=4 2024-09-14T11:08:27.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.947+0000 7f7cfc336800 20 add_watcher() i=5 2024-09-14T11:08:27.946 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.947+0000 7f7cfc336800 20 add_watcher() i=6 2024-09-14T11:08:27.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.948+0000 7f7cfc336800 20 add_watcher() i=7 2024-09-14T11:08:27.947 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.948+0000 7f7cfc336800 2 all 8 watchers are set, enabling cache 2024-09-14T11:08:27.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.950+0000 7f7baefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:08:27.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.951+0000 7f7cfc336800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:08:27.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.951+0000 7f7cfc336800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:08:27.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.951+0000 7f7cfc336800 5 note: GC not initialized 2024-09-14T11:08:27.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.951+0000 7f7badfdb640 20 reqs_thread_entry: start 2024-09-14T11:08:27.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.951+0000 7f7cfc336800 20 init_complete bucket index max shards: 11 2024-09-14T11:08:27.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.951+0000 7f7cfc336800 20 Filter name: none 2024-09-14T11:08:27.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.951+0000 7f7b1f7fe640 20 reqs_thread_entry: start 2024-09-14T11:08:27.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.951+0000 7f7cfc336800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:08:27.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.951+0000 7f7cfc336800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.952+0000 7f7cfc336800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:08:27.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.952+0000 7f7cfc336800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:08:27.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.952+0000 7f7cfc336800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:08:27.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.952+0000 7f7cfc336800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 : miss 2024-09-14T11:08:27.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.952+0000 7f7cfc336800 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.952+0000 7f7cfc336800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:08:27.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.952+0000 7f7cfc336800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:08:27.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.952+0000 7f7cfc336800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:08:27.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.952+0000 7f7cfc336800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:08:27.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.952+0000 7f7cfc336800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:08:27.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.952+0000 7f7cfc336800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 2024-09-14T11:08:27.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.952+0000 7f7cfc336800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.0 2024-09-14T11:08:27.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.952+0000 7f7cfc336800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.0 2024-09-14T11:08:27.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.953+0000 7f7cfc336800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.1 2024-09-14T11:08:27.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.953+0000 7f7cfc336800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.1 2024-09-14T11:08:27.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.953+0000 7f7cfc336800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.2 2024-09-14T11:08:27.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.953+0000 7f7cfc336800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.2 2024-09-14T11:08:27.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.953+0000 7f7cfc336800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.3 2024-09-14T11:08:27.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.953+0000 7f7cfc336800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.3 2024-09-14T11:08:27.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.954+0000 7f7cfc336800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.4 2024-09-14T11:08:27.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.954+0000 7f7cfc336800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.4 2024-09-14T11:08:27.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.954+0000 7f7cfc336800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.5 2024-09-14T11:08:27.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.954+0000 7f7cfc336800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.5 2024-09-14T11:08:27.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.955+0000 7f7cfc336800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.6 2024-09-14T11:08:27.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.955+0000 7f7cfc336800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.6 2024-09-14T11:08:27.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.955+0000 7f7cfc336800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.7 2024-09-14T11:08:27.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.955+0000 7f7cfc336800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.7 2024-09-14T11:08:27.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.955+0000 7f7cfc336800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.8 2024-09-14T11:08:27.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.955+0000 7f7cfc336800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.8 2024-09-14T11:08:27.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.956+0000 7f7cfc336800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.9 2024-09-14T11:08:27.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.956+0000 7f7cfc336800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.9 2024-09-14T11:08:27.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.956+0000 7f7cfc336800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.10 2024-09-14T11:08:27.955 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.956+0000 7f7cfc336800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.10 2024-09-14T11:08:27.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.956+0000 7f7cfc336800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.11 2024-09-14T11:08:27.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.956+0000 7f7cfc336800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.11 2024-09-14T11:08:27.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.957+0000 7f7cfc336800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.12 2024-09-14T11:08:27.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.957+0000 7f7cfc336800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.12 2024-09-14T11:08:27.956 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.958+0000 7f7baefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:08:27.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.960+0000 7f7cfc336800 20 remove_watcher() i=0 2024-09-14T11:08:27.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.960+0000 7f7cfc336800 2 removed watcher, disabling cache 2024-09-14T11:08:27.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.961+0000 7f7cfc336800 20 remove_watcher() i=1 2024-09-14T11:08:27.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.962+0000 7f7cfc336800 20 remove_watcher() i=2 2024-09-14T11:08:27.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.963+0000 7f7cfc336800 20 remove_watcher() i=3 2024-09-14T11:08:27.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.964+0000 7f7cfc336800 20 remove_watcher() i=4 2024-09-14T11:08:27.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.965+0000 7f7cfc336800 20 remove_watcher() i=5 2024-09-14T11:08:27.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.966+0000 7f7cfc336800 20 remove_watcher() i=6 2024-09-14T11:08:27.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:27.968+0000 7f7cfc336800 20 remove_watcher() i=7 2024-09-14T11:08:27.976 INFO:tasks.workunit.client.0.smithi097.stderr: test: duplicated entries can be purged manually 2024-09-14T11:08:58.000 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:08:58.032 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:08:58.032 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:08:58.074 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.076+0000 7f97e1739800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.077 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.078+0000 7f97e1739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:58.077 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.078+0000 7f97e1739800 20 realm 2024-09-14T11:08:58.077 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.078+0000 7f97e1739800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.077 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.078+0000 7f97e1739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:58.077 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.078+0000 7f97e1739800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:08:58.077 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.078+0000 7f97e1739800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.078+0000 7f97e1739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:58.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.078+0000 7f97e1739800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.079+0000 7f97e1739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:08:58.078 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.079+0000 7f97e1739800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.079 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.080+0000 7f97e1739800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:08:58.079 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.080+0000 7f97e1739800 20 searching for the correct realm 2024-09-14T11:08:58.081 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.083+0000 7f97ddc26640 0 -- 172.21.15.97:0/2957026289 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f97c806cc20 msgr2=0x7f97c8073290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:08:58.287 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.289+0000 7f97d4c24640 0 -- 172.21.15.97:0/2957026289 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f97d0064950 msgr2=0x7f97d008b3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:08:58.293 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.295+0000 7f97e1739800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:08:58.293 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.295+0000 7f97e1739800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:08:58.294 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.295+0000 7f97e1739800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:08:58.294 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.295+0000 7f97e1739800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:08:58.294 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.295+0000 7f97e1739800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:08:58.294 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.295+0000 7f97e1739800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:08:58.294 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.295+0000 7f97e1739800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.294 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.295+0000 7f97e1739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:58.294 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.295+0000 7f97e1739800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.295 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.295+0000 7f97e1739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:08:58.295 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.295+0000 7f97e1739800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.295 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.296+0000 7f97e1739800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:08:58.295 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.296+0000 7f97e1739800 20 zone default found 2024-09-14T11:08:58.295 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.296+0000 7f97e1739800 4 Realm: () 2024-09-14T11:08:58.295 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.296+0000 7f97e1739800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:08:58.295 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.296+0000 7f97e1739800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:08:58.295 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.296+0000 7f97e1739800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:08:58.296 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.296+0000 7f97e1739800 20 zonegroup default 2024-09-14T11:08:58.296 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.296+0000 7f97e1739800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.296 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.296+0000 7f97e1739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:58.296 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.296+0000 7f97e1739800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.296 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.296+0000 7f97e1739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:58.296 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.296+0000 7f97e1739800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.296 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.297+0000 7f97e1739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:58.296 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.297+0000 7f97e1739800 20 started sync module instance, tier type = 2024-09-14T11:08:58.296 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.297+0000 7f97e1739800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:08:58.306 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.307+0000 7f97e1739800 20 add_watcher() i=0 2024-09-14T11:08:58.306 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.307+0000 7f97e1739800 20 add_watcher() i=1 2024-09-14T11:08:58.306 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.307+0000 7f97e1739800 20 add_watcher() i=2 2024-09-14T11:08:58.306 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.307+0000 7f97e1739800 20 add_watcher() i=3 2024-09-14T11:08:58.306 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.307+0000 7f97e1739800 20 add_watcher() i=4 2024-09-14T11:08:58.306 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.307+0000 7f97e1739800 20 add_watcher() i=5 2024-09-14T11:08:58.306 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.307+0000 7f97e1739800 20 add_watcher() i=6 2024-09-14T11:08:58.307 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.308+0000 7f97e1739800 20 add_watcher() i=7 2024-09-14T11:08:58.307 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.308+0000 7f97e1739800 2 all 8 watchers are set, enabling cache 2024-09-14T11:08:58.309 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.310+0000 7f96937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:08:58.310 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.310+0000 7f97e1739800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:08:58.310 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.310+0000 7f97e1739800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:08:58.310 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.310+0000 7f97e1739800 5 note: GC not initialized 2024-09-14T11:08:58.310 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.311+0000 7f96927e4640 20 reqs_thread_entry: start 2024-09-14T11:08:58.310 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.311+0000 7f97e1739800 20 init_complete bucket index max shards: 11 2024-09-14T11:08:58.310 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.311+0000 7f97e1739800 20 Filter name: none 2024-09-14T11:08:58.310 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.311+0000 7f9603fff640 20 reqs_thread_entry: start 2024-09-14T11:08:58.310 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.311+0000 7f97e1739800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.311 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.311+0000 7f97e1739800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:08:58.311 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.311+0000 7f97e1739800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.311 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.312+0000 7f97e1739800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:08:58.311 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.312+0000 7f97e1739800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:08:58.311 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.312+0000 7f97e1739800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.311 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.312+0000 7f97e1739800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:08:58.311 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.312+0000 7f97e1739800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.313+0000 7f97e1739800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:08:58.312 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.313+0000 7f97e1739800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:08:58.313 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.315+0000 7f96937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:08:58.315 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.317+0000 7f97e1739800 20 remove_watcher() i=0 2024-09-14T11:08:58.316 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.317+0000 7f97e1739800 2 removed watcher, disabling cache 2024-09-14T11:08:58.317 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.318+0000 7f97e1739800 20 remove_watcher() i=1 2024-09-14T11:08:58.318 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.319+0000 7f97e1739800 20 remove_watcher() i=2 2024-09-14T11:08:58.319 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.320+0000 7f97e1739800 20 remove_watcher() i=3 2024-09-14T11:08:58.320 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.322+0000 7f97e1739800 20 remove_watcher() i=4 2024-09-14T11:08:58.321 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.323+0000 7f97e1739800 20 remove_watcher() i=5 2024-09-14T11:08:58.322 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.324+0000 7f97e1739800 20 remove_watcher() i=6 2024-09-14T11:08:58.323 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.325+0000 7f97e1739800 20 remove_watcher() i=7 2024-09-14T11:08:58.335 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:58.335 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:08:58.335 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: a-bucket id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 num_objects: 11 size_kb: 1 num_shards: 13 2024-09-14T11:08:58.335 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:58.336 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-14T11:08:58.371 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:08:58.372 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:08:58.410 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.411+0000 7efe1cd23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.413+0000 7efe1cd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:58.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.413+0000 7efe1cd23800 20 realm 2024-09-14T11:08:58.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.413+0000 7efe1cd23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.413+0000 7efe1cd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:58.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.413+0000 7efe1cd23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:08:58.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.413+0000 7efe1cd23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.414+0000 7efe1cd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:58.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.414+0000 7efe1cd23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.414+0000 7efe1cd23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:08:58.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.414+0000 7efe1cd23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.415+0000 7efe1cd23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:08:58.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.415+0000 7efe1cd23800 20 searching for the correct realm 2024-09-14T11:08:58.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.417+0000 7efe1920d640 0 -- 172.21.15.97:0/821645223 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7efe000684e0 msgr2=0x7efe00066f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:08:58.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.622+0000 7efe1820b640 0 -- 172.21.15.97:0/821645223 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7efe08061040 msgr2=0x7efe080e38c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:08:58.626 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.628+0000 7efe1cd23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:08:58.626 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.628+0000 7efe1cd23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:08:58.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.628+0000 7efe1cd23800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:08:58.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.628+0000 7efe1cd23800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:08:58.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.628+0000 7efe1cd23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:08:58.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.628+0000 7efe1cd23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:08:58.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.628+0000 7efe1cd23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.628+0000 7efe1cd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:58.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.628+0000 7efe1cd23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.628+0000 7efe1cd23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:08:58.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.628+0000 7efe1cd23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.629+0000 7efe1cd23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:08:58.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.629+0000 7efe1cd23800 20 zone default found 2024-09-14T11:08:58.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.629+0000 7efe1cd23800 4 Realm: () 2024-09-14T11:08:58.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.629+0000 7efe1cd23800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:08:58.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.629+0000 7efe1cd23800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:08:58.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.629+0000 7efe1cd23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:08:58.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.629+0000 7efe1cd23800 20 zonegroup default 2024-09-14T11:08:58.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.629+0000 7efe1cd23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.629+0000 7efe1cd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:58.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.629+0000 7efe1cd23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.629+0000 7efe1cd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:58.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.629+0000 7efe1cd23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.630+0000 7efe1cd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:58.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.630+0000 7efe1cd23800 20 started sync module instance, tier type = 2024-09-14T11:08:58.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.630+0000 7efe1cd23800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:08:58.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.639+0000 7efe1cd23800 20 add_watcher() i=0 2024-09-14T11:08:58.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.639+0000 7efe1cd23800 20 add_watcher() i=1 2024-09-14T11:08:58.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.639+0000 7efe1cd23800 20 add_watcher() i=2 2024-09-14T11:08:58.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.639+0000 7efe1cd23800 20 add_watcher() i=3 2024-09-14T11:08:58.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.639+0000 7efe1cd23800 20 add_watcher() i=4 2024-09-14T11:08:58.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.639+0000 7efe1cd23800 20 add_watcher() i=5 2024-09-14T11:08:58.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.639+0000 7efe1cd23800 20 add_watcher() i=6 2024-09-14T11:08:58.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.640+0000 7efe1cd23800 20 add_watcher() i=7 2024-09-14T11:08:58.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.640+0000 7efe1cd23800 2 all 8 watchers are set, enabling cache 2024-09-14T11:08:58.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.642+0000 7efccf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:08:58.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.643+0000 7efe1cd23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:08:58.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.643+0000 7efe1cd23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:08:58.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.643+0000 7efe1cd23800 5 note: GC not initialized 2024-09-14T11:08:58.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.643+0000 7efcce7e4640 20 reqs_thread_entry: start 2024-09-14T11:08:58.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.643+0000 7efe1cd23800 20 init_complete bucket index max shards: 11 2024-09-14T11:08:58.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.643+0000 7efe1cd23800 20 Filter name: none 2024-09-14T11:08:58.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.643+0000 7efcc77fe640 20 reqs_thread_entry: start 2024-09-14T11:08:58.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.643+0000 7efe1cd23800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:08:58.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.643+0000 7efe1cd23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.644+0000 7efe1cd23800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:08:58.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.644+0000 7efe1cd23800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:08:58.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.644+0000 7efe1cd23800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:08:58.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.644+0000 7efe1cd23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 : miss 2024-09-14T11:08:58.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.644+0000 7efe1cd23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.644+0000 7efe1cd23800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:08:58.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.644+0000 7efe1cd23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:08:58.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.644+0000 7efe1cd23800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:08:58.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.644+0000 7efe1cd23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:08:58.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.644+0000 7efe1cd23800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:08:58.644 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.645+0000 7efe1cd23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 2024-09-14T11:08:58.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.646+0000 7efe1cd23800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:08:58.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.653+0000 7efe1cd23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:08:58.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.653+0000 7efe1cd23800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:08:58.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.653+0000 7efe1cd23800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:08:58.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.653+0000 7efe1cd23800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17, ofs0, ns] 2024-09-14T11:08:58.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.654+0000 7efceffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595247 cookie 94440582161072 notifier 7877 bl.length()=827 2024-09-14T11:08:58.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.654+0000 7efceffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:08:58.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.654+0000 7efceffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:08:58.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.654+0000 7efceffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:08:58.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.654+0000 7efe1cd23800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): orig_sources= new_sources= 2024-09-14T11:08:58.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.654+0000 7efe1cd23800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): potential sources added=[] removed=[] 2024-09-14T11:08:58.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.654+0000 7efe1cd23800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): orig_dests= new_dests= 2024-09-14T11:08:58.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.654+0000 7efe1cd23800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): potential dests added=[] removed=[] 2024-09-14T11:08:58.657 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7efe1cd23800 time 2024-09-14T11:08:58.659762+0000 2024-09-14T11:08:58.657 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:08:58.658 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:08:58.658 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7efe1e38c76a] 2024-09-14T11:08:58.658 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7efe1e38c928] 2024-09-14T11:08:58.658 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e4a6d020b1] 2024-09-14T11:08:58.658 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55e4a6d11f6a] 2024-09-14T11:08:58.658 INFO:tasks.workunit.client.0.smithi097.stderr: 5: main() 2024-09-14T11:08:58.658 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7efe1d029590] 2024-09-14T11:08:58.658 INFO:tasks.workunit.client.0.smithi097.stderr: 7: __libc_start_main() 2024-09-14T11:08:58.658 INFO:tasks.workunit.client.0.smithi097.stderr: 8: _start() 2024-09-14T11:08:58.658 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.659+0000 7efe1cd23800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7efe1cd23800 time 2024-09-14T11:08:58.659762+0000 2024-09-14T11:08:58.658 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:08:58.658 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:58.659 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:08:58.659 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7efe1e38c76a] 2024-09-14T11:08:58.659 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7efe1e38c928] 2024-09-14T11:08:58.659 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e4a6d020b1] 2024-09-14T11:08:58.659 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55e4a6d11f6a] 2024-09-14T11:08:58.659 INFO:tasks.workunit.client.0.smithi097.stderr: 5: main() 2024-09-14T11:08:58.659 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7efe1d029590] 2024-09-14T11:08:58.659 INFO:tasks.workunit.client.0.smithi097.stderr: 7: __libc_start_main() 2024-09-14T11:08:58.659 INFO:tasks.workunit.client.0.smithi097.stderr: 8: _start() 2024-09-14T11:08:58.659 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:58.659 INFO:tasks.workunit.client.0.smithi097.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:08:58.659 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7efe1cd23800 thread_name:radosgw-admin 2024-09-14T11:08:58.678 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:08:58.678 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7efe1d03e6f0] 2024-09-14T11:08:58.678 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7efe1d08b99c] 2024-09-14T11:08:58.678 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-14T11:08:58.678 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-14T11:08:58.678 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7efe1e38c7c4] 2024-09-14T11:08:58.678 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7efe1e38c928] 2024-09-14T11:08:58.678 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e4a6d020b1] 2024-09-14T11:08:58.679 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55e4a6d11f6a] 2024-09-14T11:08:58.679 INFO:tasks.workunit.client.0.smithi097.stderr: 9: main() 2024-09-14T11:08:58.679 INFO:tasks.workunit.client.0.smithi097.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7efe1d029590] 2024-09-14T11:08:58.679 INFO:tasks.workunit.client.0.smithi097.stderr: 11: __libc_start_main() 2024-09-14T11:08:58.679 INFO:tasks.workunit.client.0.smithi097.stderr: 12: _start() 2024-09-14T11:08:58.679 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.660+0000 7efe1cd23800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:08:58.679 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7efe1cd23800 thread_name:radosgw-admin 2024-09-14T11:08:58.679 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:58.679 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:08:58.679 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7efe1d03e6f0] 2024-09-14T11:08:58.679 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7efe1d08b99c] 2024-09-14T11:08:58.679 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-14T11:08:58.679 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-14T11:08:58.680 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7efe1e38c7c4] 2024-09-14T11:08:58.680 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7efe1e38c928] 2024-09-14T11:08:58.680 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e4a6d020b1] 2024-09-14T11:08:58.680 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55e4a6d11f6a] 2024-09-14T11:08:58.680 INFO:tasks.workunit.client.0.smithi097.stderr: 9: main() 2024-09-14T11:08:58.680 INFO:tasks.workunit.client.0.smithi097.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7efe1d029590] 2024-09-14T11:08:58.680 INFO:tasks.workunit.client.0.smithi097.stderr: 11: __libc_start_main() 2024-09-14T11:08:58.681 INFO:tasks.workunit.client.0.smithi097.stderr: 12: _start() 2024-09-14T11:08:58.681 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:08:58.681 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:58.681 INFO:tasks.workunit.client.0.smithi097.stderr:--- begin dump of recent events --- 2024-09-14T11:08:58.681 INFO:tasks.workunit.client.0.smithi097.stderr: -499> 2024-09-14T11:08:58.393+0000 7efd06e0d640 10 monclient: handle_config config(0 keys) 2024-09-14T11:08:58.681 INFO:tasks.workunit.client.0.smithi097.stderr: -498> 2024-09-14T11:08:58.393+0000 7efd06e0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:08:58.681 INFO:tasks.workunit.client.0.smithi097.stderr: -497> 2024-09-14T11:08:58.393+0000 7efd06e0d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:08:58.681 INFO:tasks.workunit.client.0.smithi097.stderr: -496> 2024-09-14T11:08:58.393+0000 7efd06e0d640 10 monclient: dump: 2024-09-14T11:08:58.681 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:08:58.681 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:08:58.681 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:58.681 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:58.681 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:08:58.681 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:58.682 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:08:58.682 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:08:58.682 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:08:58.682 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:58.682 INFO:tasks.workunit.client.0.smithi097.stderr: -495> 2024-09-14T11:08:58.393+0000 7efe1cd23800 5 monclient: authenticate success, global_id 8394 2024-09-14T11:08:58.682 INFO:tasks.workunit.client.0.smithi097.stderr: -494> 2024-09-14T11:08:58.393+0000 7efe1cd23800 10 monclient: get_monmap_and_config success 2024-09-14T11:08:58.682 INFO:tasks.workunit.client.0.smithi097.stderr: -493> 2024-09-14T11:08:58.393+0000 7efe1cd23800 4 set_mon_vals no callback set 2024-09-14T11:08:58.682 INFO:tasks.workunit.client.0.smithi097.stderr: -492> 2024-09-14T11:08:58.394+0000 7efe1cd23800 10 monclient: shutdown 2024-09-14T11:08:58.682 INFO:tasks.workunit.client.0.smithi097.stderr: -491> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 asok(0x55e4a9281270) unregister_commands rotate-key 2024-09-14T11:08:58.682 INFO:tasks.workunit.client.0.smithi097.stderr: -490> 2024-09-14T11:08:58.394+0000 7efe1cd23800 10 monclient: build_initial_monmap 2024-09-14T11:08:58.682 INFO:tasks.workunit.client.0.smithi097.stderr: -489> 2024-09-14T11:08:58.394+0000 7efe1cd23800 1 build_initial for_mkfs: 0 2024-09-14T11:08:58.682 INFO:tasks.workunit.client.0.smithi097.stderr: -488> 2024-09-14T11:08:58.394+0000 7efe1cd23800 10 monclient: monmap: 2024-09-14T11:08:58.682 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:08:58.682 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:08:58.682 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:08:58.683 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:08:58.683 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:08:58.683 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:58.683 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:08:58.683 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:08:58.683 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:08:58.683 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:58.683 INFO:tasks.workunit.client.0.smithi097.stderr: -487> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a3840) adding auth protocol: cephx 2024-09-14T11:08:58.683 INFO:tasks.workunit.client.0.smithi097.stderr: -486> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a3840) adding auth protocol: cephx 2024-09-14T11:08:58.683 INFO:tasks.workunit.client.0.smithi097.stderr: -485> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a3840) adding auth protocol: cephx 2024-09-14T11:08:58.683 INFO:tasks.workunit.client.0.smithi097.stderr: -484> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a3840) adding con mode: secure 2024-09-14T11:08:58.683 INFO:tasks.workunit.client.0.smithi097.stderr: -483> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a3840) adding con mode: crc 2024-09-14T11:08:58.683 INFO:tasks.workunit.client.0.smithi097.stderr: -482> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a3840) adding con mode: secure 2024-09-14T11:08:58.683 INFO:tasks.workunit.client.0.smithi097.stderr: -481> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a3840) adding con mode: crc 2024-09-14T11:08:58.683 INFO:tasks.workunit.client.0.smithi097.stderr: -480> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a3840) adding con mode: secure 2024-09-14T11:08:58.684 INFO:tasks.workunit.client.0.smithi097.stderr: -479> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a3840) adding con mode: crc 2024-09-14T11:08:58.684 INFO:tasks.workunit.client.0.smithi097.stderr: -478> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a3840) adding con mode: crc 2024-09-14T11:08:58.684 INFO:tasks.workunit.client.0.smithi097.stderr: -477> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a3840) adding con mode: secure 2024-09-14T11:08:58.684 INFO:tasks.workunit.client.0.smithi097.stderr: -476> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a3840) adding con mode: crc 2024-09-14T11:08:58.684 INFO:tasks.workunit.client.0.smithi097.stderr: -475> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a3840) adding con mode: secure 2024-09-14T11:08:58.684 INFO:tasks.workunit.client.0.smithi097.stderr: -474> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a3840) adding con mode: crc 2024-09-14T11:08:58.684 INFO:tasks.workunit.client.0.smithi097.stderr: -473> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a3840) adding con mode: secure 2024-09-14T11:08:58.684 INFO:tasks.workunit.client.0.smithi097.stderr: -472> 2024-09-14T11:08:58.394+0000 7efe1cd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:58.684 INFO:tasks.workunit.client.0.smithi097.stderr: -471> 2024-09-14T11:08:58.394+0000 7efe1cd23800 1 librados: starting msgr at 2024-09-14T11:08:58.684 INFO:tasks.workunit.client.0.smithi097.stderr: -470> 2024-09-14T11:08:58.394+0000 7efe1cd23800 1 librados: starting objecter 2024-09-14T11:08:58.684 INFO:tasks.workunit.client.0.smithi097.stderr: -469> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 asok(0x55e4a9281270) register_command objecter_requests hook 0x55e4a94a6bb0 2024-09-14T11:08:58.684 INFO:tasks.workunit.client.0.smithi097.stderr: -468> 2024-09-14T11:08:58.394+0000 7efe1cd23800 1 librados: setting wanted keys 2024-09-14T11:08:58.684 INFO:tasks.workunit.client.0.smithi097.stderr: -467> 2024-09-14T11:08:58.394+0000 7efe1cd23800 1 librados: calling monclient init 2024-09-14T11:08:58.684 INFO:tasks.workunit.client.0.smithi097.stderr: -466> 2024-09-14T11:08:58.394+0000 7efe1cd23800 10 monclient: init 2024-09-14T11:08:58.684 INFO:tasks.workunit.client.0.smithi097.stderr: -465> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a01e0) adding auth protocol: cephx 2024-09-14T11:08:58.685 INFO:tasks.workunit.client.0.smithi097.stderr: -464> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a01e0) adding auth protocol: cephx 2024-09-14T11:08:58.685 INFO:tasks.workunit.client.0.smithi097.stderr: -463> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a01e0) adding auth protocol: cephx 2024-09-14T11:08:58.685 INFO:tasks.workunit.client.0.smithi097.stderr: -462> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a01e0) adding con mode: secure 2024-09-14T11:08:58.685 INFO:tasks.workunit.client.0.smithi097.stderr: -461> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a01e0) adding con mode: crc 2024-09-14T11:08:58.685 INFO:tasks.workunit.client.0.smithi097.stderr: -460> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a01e0) adding con mode: secure 2024-09-14T11:08:58.685 INFO:tasks.workunit.client.0.smithi097.stderr: -459> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a01e0) adding con mode: crc 2024-09-14T11:08:58.685 INFO:tasks.workunit.client.0.smithi097.stderr: -458> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a01e0) adding con mode: secure 2024-09-14T11:08:58.685 INFO:tasks.workunit.client.0.smithi097.stderr: -457> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a01e0) adding con mode: crc 2024-09-14T11:08:58.685 INFO:tasks.workunit.client.0.smithi097.stderr: -456> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a01e0) adding con mode: crc 2024-09-14T11:08:58.685 INFO:tasks.workunit.client.0.smithi097.stderr: -455> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a01e0) adding con mode: secure 2024-09-14T11:08:58.685 INFO:tasks.workunit.client.0.smithi097.stderr: -454> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a01e0) adding con mode: crc 2024-09-14T11:08:58.685 INFO:tasks.workunit.client.0.smithi097.stderr: -453> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a01e0) adding con mode: secure 2024-09-14T11:08:58.685 INFO:tasks.workunit.client.0.smithi097.stderr: -452> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a01e0) adding con mode: crc 2024-09-14T11:08:58.686 INFO:tasks.workunit.client.0.smithi097.stderr: -451> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a01e0) adding con mode: secure 2024-09-14T11:08:58.686 INFO:tasks.workunit.client.0.smithi097.stderr: -450> 2024-09-14T11:08:58.395+0000 7efe1cd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:58.686 INFO:tasks.workunit.client.0.smithi097.stderr: -449> 2024-09-14T11:08:58.395+0000 7efe1cd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:58.686 INFO:tasks.workunit.client.0.smithi097.stderr: -448> 2024-09-14T11:08:58.395+0000 7efe1cd23800 5 asok(0x55e4a9281270) register_command rotate-key hook 0x55e4a94a0328 2024-09-14T11:08:58.686 INFO:tasks.workunit.client.0.smithi097.stderr: -447> 2024-09-14T11:08:58.395+0000 7efe1cd23800 10 monclient: _reopen_session rank -1 2024-09-14T11:08:58.686 INFO:tasks.workunit.client.0.smithi097.stderr: -446> 2024-09-14T11:08:58.395+0000 7efe1cd23800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:08:58.686 INFO:tasks.workunit.client.0.smithi097.stderr: -445> 2024-09-14T11:08:58.395+0000 7efe1cd23800 10 monclient(hunting): picked mon.noname-a con 0x55e4a934c760 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:08:58.686 INFO:tasks.workunit.client.0.smithi097.stderr: -444> 2024-09-14T11:08:58.395+0000 7efe1cd23800 10 monclient(hunting): picked mon.noname-b con 0x55e4a93559d0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:08:58.686 INFO:tasks.workunit.client.0.smithi097.stderr: -443> 2024-09-14T11:08:58.395+0000 7efe1cd23800 10 monclient(hunting): picked mon.noname-c con 0x55e4a9355e40 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:08:58.686 INFO:tasks.workunit.client.0.smithi097.stderr: -442> 2024-09-14T11:08:58.395+0000 7efe1cd23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:08:58.686 INFO:tasks.workunit.client.0.smithi097.stderr: -441> 2024-09-14T11:08:58.395+0000 7efe1cd23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:08:58.686 INFO:tasks.workunit.client.0.smithi097.stderr: -440> 2024-09-14T11:08:58.395+0000 7efe1cd23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:08:58.686 INFO:tasks.workunit.client.0.smithi097.stderr: -439> 2024-09-14T11:08:58.395+0000 7efe1cd23800 10 monclient(hunting): _renew_subs 2024-09-14T11:08:58.686 INFO:tasks.workunit.client.0.smithi097.stderr: -438> 2024-09-14T11:08:58.395+0000 7efe1cd23800 10 monclient(hunting): authenticate will time out at 2220.048483s 2024-09-14T11:08:58.686 INFO:tasks.workunit.client.0.smithi097.stderr: -437> 2024-09-14T11:08:58.395+0000 7efe18a0c640 10 monclient(hunting): get_auth_request con 0x55e4a934c760 auth_method 0 2024-09-14T11:08:58.687 INFO:tasks.workunit.client.0.smithi097.stderr: -436> 2024-09-14T11:08:58.395+0000 7efe18a0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:08:58.687 INFO:tasks.workunit.client.0.smithi097.stderr: -435> 2024-09-14T11:08:58.395+0000 7efe18a0c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:08:58.687 INFO:tasks.workunit.client.0.smithi097.stderr: -434> 2024-09-14T11:08:58.395+0000 7efe18a0c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:08:58.687 INFO:tasks.workunit.client.0.smithi097.stderr: -433> 2024-09-14T11:08:58.395+0000 7efe1920d640 10 monclient(hunting): get_auth_request con 0x55e4a9355e40 auth_method 0 2024-09-14T11:08:58.687 INFO:tasks.workunit.client.0.smithi097.stderr: -432> 2024-09-14T11:08:58.395+0000 7efe1920d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:08:58.687 INFO:tasks.workunit.client.0.smithi097.stderr: -431> 2024-09-14T11:08:58.395+0000 7efe1920d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:08:58.687 INFO:tasks.workunit.client.0.smithi097.stderr: -430> 2024-09-14T11:08:58.395+0000 7efe1920d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:08:58.687 INFO:tasks.workunit.client.0.smithi097.stderr: -429> 2024-09-14T11:08:58.395+0000 7efe18a0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:08:58.687 INFO:tasks.workunit.client.0.smithi097.stderr: -428> 2024-09-14T11:08:58.395+0000 7efe18a0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:08:58.687 INFO:tasks.workunit.client.0.smithi097.stderr: -427> 2024-09-14T11:08:58.395+0000 7efe18a0c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:08:58.687 INFO:tasks.workunit.client.0.smithi097.stderr: -426> 2024-09-14T11:08:58.395+0000 7efe1920d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:08:58.687 INFO:tasks.workunit.client.0.smithi097.stderr: -425> 2024-09-14T11:08:58.395+0000 7efe1920d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:08:58.687 INFO:tasks.workunit.client.0.smithi097.stderr: -424> 2024-09-14T11:08:58.395+0000 7efe1920d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:08:58.687 INFO:tasks.workunit.client.0.smithi097.stderr: -423> 2024-09-14T11:08:58.395+0000 7efe1820b640 10 monclient(hunting): get_auth_request con 0x55e4a93559d0 auth_method 0 2024-09-14T11:08:58.687 INFO:tasks.workunit.client.0.smithi097.stderr: -422> 2024-09-14T11:08:58.395+0000 7efe1820b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:08:58.688 INFO:tasks.workunit.client.0.smithi097.stderr: -421> 2024-09-14T11:08:58.395+0000 7efe1820b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:08:58.688 INFO:tasks.workunit.client.0.smithi097.stderr: -420> 2024-09-14T11:08:58.395+0000 7efe1820b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:08:58.688 INFO:tasks.workunit.client.0.smithi097.stderr: -419> 2024-09-14T11:08:58.395+0000 7efe1920d640 10 monclient(hunting): handle_auth_done global_id 7868 payload 824 2024-09-14T11:08:58.688 INFO:tasks.workunit.client.0.smithi097.stderr: -418> 2024-09-14T11:08:58.395+0000 7efe1920d640 10 monclient: _finish_hunting 0 2024-09-14T11:08:58.688 INFO:tasks.workunit.client.0.smithi097.stderr: -417> 2024-09-14T11:08:58.395+0000 7efe1920d640 1 monclient: found mon.noname-c 2024-09-14T11:08:58.688 INFO:tasks.workunit.client.0.smithi097.stderr: -416> 2024-09-14T11:08:58.395+0000 7efe1920d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:08:58.688 INFO:tasks.workunit.client.0.smithi097.stderr: -415> 2024-09-14T11:08:58.396+0000 7efd0560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:08:58.688 INFO:tasks.workunit.client.0.smithi097.stderr: -414> 2024-09-14T11:08:58.396+0000 7efd0560a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:08:58.688 INFO:tasks.workunit.client.0.smithi097.stderr: -413> 2024-09-14T11:08:58.396+0000 7efd0560a640 10 monclient: dump: 2024-09-14T11:08:58.688 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:08:58.688 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:08:58.688 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:58.688 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:58.688 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:08:58.688 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:58.689 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:08:58.689 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:08:58.689 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:08:58.689 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:58.689 INFO:tasks.workunit.client.0.smithi097.stderr: -412> 2024-09-14T11:08:58.396+0000 7efd0560a640 10 monclient: _finish_auth 0 2024-09-14T11:08:58.689 INFO:tasks.workunit.client.0.smithi097.stderr: -411> 2024-09-14T11:08:58.396+0000 7efd0560a640 10 monclient: _check_auth_tickets 2024-09-14T11:08:58.689 INFO:tasks.workunit.client.0.smithi097.stderr: -410> 2024-09-14T11:08:58.396+0000 7efd0560a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:08:58.689 INFO:tasks.workunit.client.0.smithi097.stderr: -409> 2024-09-14T11:08:58.396+0000 7efd0560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:08:58.689 INFO:tasks.workunit.client.0.smithi097.stderr: -408> 2024-09-14T11:08:58.396+0000 7efd0560a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:08:58.689 INFO:tasks.workunit.client.0.smithi097.stderr: -407> 2024-09-14T11:08:58.396+0000 7efd0560a640 10 monclient: dump: 2024-09-14T11:08:58.689 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:08:58.689 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:08:58.689 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:58.689 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:58.690 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:08:58.690 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:58.690 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:08:58.690 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:08:58.690 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:08:58.690 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:58.690 INFO:tasks.workunit.client.0.smithi097.stderr: -406> 2024-09-14T11:08:58.396+0000 7efe1cd23800 5 monclient: authenticate success, global_id 7868 2024-09-14T11:08:58.690 INFO:tasks.workunit.client.0.smithi097.stderr: -405> 2024-09-14T11:08:58.396+0000 7efe1cd23800 10 monclient: _renew_subs 2024-09-14T11:08:58.690 INFO:tasks.workunit.client.0.smithi097.stderr: -404> 2024-09-14T11:08:58.396+0000 7efd06e0d640 4 set_mon_vals no callback set 2024-09-14T11:08:58.690 INFO:tasks.workunit.client.0.smithi097.stderr: -403> 2024-09-14T11:08:58.396+0000 7efe1cd23800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:08:58.690 INFO:tasks.workunit.client.0.smithi097.stderr: -402> 2024-09-14T11:08:58.396+0000 7efe1cd23800 10 monclient: _renew_subs 2024-09-14T11:08:58.690 INFO:tasks.workunit.client.0.smithi097.stderr: -401> 2024-09-14T11:08:58.396+0000 7efe1cd23800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:08:58.690 INFO:tasks.workunit.client.0.smithi097.stderr: -400> 2024-09-14T11:08:58.396+0000 7efe1cd23800 1 librados: init done 2024-09-14T11:08:58.690 INFO:tasks.workunit.client.0.smithi097.stderr: -399> 2024-09-14T11:08:58.398+0000 7efd0560a640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:08:58.691 INFO:tasks.workunit.client.0.smithi097.stderr: -398> 2024-09-14T11:08:58.398+0000 7efd0560a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:08:58.691 INFO:tasks.workunit.client.0.smithi097.stderr: -397> 2024-09-14T11:08:58.398+0000 7efd0560a640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:08:58.691 INFO:tasks.workunit.client.0.smithi097.stderr: -396> 2024-09-14T11:08:58.398+0000 7efe18a0c640 10 monclient: get_auth_request con 0x7efd00077230 auth_method 0 2024-09-14T11:08:58.691 INFO:tasks.workunit.client.0.smithi097.stderr: -395> 2024-09-14T11:08:58.398+0000 7efe1820b640 10 monclient: get_auth_request con 0x55e4a94c8ff0 auth_method 0 2024-09-14T11:08:58.691 INFO:tasks.workunit.client.0.smithi097.stderr: -394> 2024-09-14T11:08:58.399+0000 7efe18a0c640 10 monclient: get_auth_request con 0x55e4a94eb7c0 auth_method 0 2024-09-14T11:08:58.691 INFO:tasks.workunit.client.0.smithi097.stderr: -393> 2024-09-14T11:08:58.400+0000 7efe1820b640 10 monclient: get_auth_request con 0x55e4a94eff10 auth_method 0 2024-09-14T11:08:58.691 INFO:tasks.workunit.client.0.smithi097.stderr: -392> 2024-09-14T11:08:58.401+0000 7efe1920d640 10 monclient: get_auth_request con 0x55e4a94f3e30 auth_method 0 2024-09-14T11:08:58.691 INFO:tasks.workunit.client.0.smithi097.stderr: -391> 2024-09-14T11:08:58.402+0000 7efe1cd23800 10 monclient: build_initial_monmap 2024-09-14T11:08:58.691 INFO:tasks.workunit.client.0.smithi097.stderr: -390> 2024-09-14T11:08:58.402+0000 7efe1cd23800 1 build_initial for_mkfs: 0 2024-09-14T11:08:58.691 INFO:tasks.workunit.client.0.smithi097.stderr: -389> 2024-09-14T11:08:58.402+0000 7efe1cd23800 10 monclient: monmap: 2024-09-14T11:08:58.691 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:08:58.691 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:08:58.691 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:08:58.691 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:08:58.692 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:08:58.692 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:58.692 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:08:58.692 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:08:58.692 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:08:58.692 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:58.692 INFO:tasks.workunit.client.0.smithi097.stderr: -388> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f7f60) adding auth protocol: cephx 2024-09-14T11:08:58.692 INFO:tasks.workunit.client.0.smithi097.stderr: -387> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f7f60) adding auth protocol: cephx 2024-09-14T11:08:58.692 INFO:tasks.workunit.client.0.smithi097.stderr: -386> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f7f60) adding auth protocol: cephx 2024-09-14T11:08:58.692 INFO:tasks.workunit.client.0.smithi097.stderr: -385> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f7f60) adding con mode: secure 2024-09-14T11:08:58.692 INFO:tasks.workunit.client.0.smithi097.stderr: -384> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f7f60) adding con mode: crc 2024-09-14T11:08:58.692 INFO:tasks.workunit.client.0.smithi097.stderr: -383> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f7f60) adding con mode: secure 2024-09-14T11:08:58.692 INFO:tasks.workunit.client.0.smithi097.stderr: -382> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f7f60) adding con mode: crc 2024-09-14T11:08:58.693 INFO:tasks.workunit.client.0.smithi097.stderr: -381> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f7f60) adding con mode: secure 2024-09-14T11:08:58.693 INFO:tasks.workunit.client.0.smithi097.stderr: -380> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f7f60) adding con mode: crc 2024-09-14T11:08:58.693 INFO:tasks.workunit.client.0.smithi097.stderr: -379> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f7f60) adding con mode: crc 2024-09-14T11:08:58.693 INFO:tasks.workunit.client.0.smithi097.stderr: -378> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f7f60) adding con mode: secure 2024-09-14T11:08:58.693 INFO:tasks.workunit.client.0.smithi097.stderr: -377> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f7f60) adding con mode: crc 2024-09-14T11:08:58.693 INFO:tasks.workunit.client.0.smithi097.stderr: -376> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f7f60) adding con mode: secure 2024-09-14T11:08:58.693 INFO:tasks.workunit.client.0.smithi097.stderr: -375> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f7f60) adding con mode: crc 2024-09-14T11:08:58.693 INFO:tasks.workunit.client.0.smithi097.stderr: -374> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f7f60) adding con mode: secure 2024-09-14T11:08:58.693 INFO:tasks.workunit.client.0.smithi097.stderr: -373> 2024-09-14T11:08:58.402+0000 7efe1cd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:58.693 INFO:tasks.workunit.client.0.smithi097.stderr: -372> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 asok(0x55e4a9281270) register_command objecter_requests cmddesc objecter_requests hook 0x55e4a94fb450 EEXIST 2024-09-14T11:08:58.693 INFO:tasks.workunit.client.0.smithi097.stderr: -371> 2024-09-14T11:08:58.402+0000 7efe1cd23800 10 monclient: init 2024-09-14T11:08:58.693 INFO:tasks.workunit.client.0.smithi097.stderr: -370> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f6e58) adding auth protocol: cephx 2024-09-14T11:08:58.693 INFO:tasks.workunit.client.0.smithi097.stderr: -369> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f6e58) adding auth protocol: cephx 2024-09-14T11:08:58.693 INFO:tasks.workunit.client.0.smithi097.stderr: -368> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f6e58) adding auth protocol: cephx 2024-09-14T11:08:58.694 INFO:tasks.workunit.client.0.smithi097.stderr: -367> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f6e58) adding con mode: secure 2024-09-14T11:08:58.694 INFO:tasks.workunit.client.0.smithi097.stderr: -366> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f6e58) adding con mode: crc 2024-09-14T11:08:58.694 INFO:tasks.workunit.client.0.smithi097.stderr: -365> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f6e58) adding con mode: secure 2024-09-14T11:08:58.694 INFO:tasks.workunit.client.0.smithi097.stderr: -364> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f6e58) adding con mode: crc 2024-09-14T11:08:58.694 INFO:tasks.workunit.client.0.smithi097.stderr: -363> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f6e58) adding con mode: secure 2024-09-14T11:08:58.694 INFO:tasks.workunit.client.0.smithi097.stderr: -362> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f6e58) adding con mode: crc 2024-09-14T11:08:58.694 INFO:tasks.workunit.client.0.smithi097.stderr: -361> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f6e58) adding con mode: crc 2024-09-14T11:08:58.694 INFO:tasks.workunit.client.0.smithi097.stderr: -360> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f6e58) adding con mode: secure 2024-09-14T11:08:58.694 INFO:tasks.workunit.client.0.smithi097.stderr: -359> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f6e58) adding con mode: crc 2024-09-14T11:08:58.694 INFO:tasks.workunit.client.0.smithi097.stderr: -358> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f6e58) adding con mode: secure 2024-09-14T11:08:58.694 INFO:tasks.workunit.client.0.smithi097.stderr: -357> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f6e58) adding con mode: crc 2024-09-14T11:08:58.694 INFO:tasks.workunit.client.0.smithi097.stderr: -356> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f6e58) adding con mode: secure 2024-09-14T11:08:58.694 INFO:tasks.workunit.client.0.smithi097.stderr: -355> 2024-09-14T11:08:58.402+0000 7efe1cd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:58.694 INFO:tasks.workunit.client.0.smithi097.stderr: -354> 2024-09-14T11:08:58.403+0000 7efe1cd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:58.695 INFO:tasks.workunit.client.0.smithi097.stderr: -353> 2024-09-14T11:08:58.403+0000 7efe1cd23800 5 asok(0x55e4a9281270) register_command rotate-key cmddesc rotate-key hook 0x55e4a94f6fa0 EEXIST 2024-09-14T11:08:58.695 INFO:tasks.workunit.client.0.smithi097.stderr: -352> 2024-09-14T11:08:58.403+0000 7efe1cd23800 10 monclient: _reopen_session rank -1 2024-09-14T11:08:58.695 INFO:tasks.workunit.client.0.smithi097.stderr: -351> 2024-09-14T11:08:58.403+0000 7efe1cd23800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:08:58.695 INFO:tasks.workunit.client.0.smithi097.stderr: -350> 2024-09-14T11:08:58.403+0000 7efe1cd23800 10 monclient(hunting): picked mon.noname-c con 0x55e4a951f770 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:08:58.695 INFO:tasks.workunit.client.0.smithi097.stderr: -349> 2024-09-14T11:08:58.403+0000 7efe1cd23800 10 monclient(hunting): picked mon.noname-a con 0x55e4a951fb50 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:08:58.695 INFO:tasks.workunit.client.0.smithi097.stderr: -348> 2024-09-14T11:08:58.403+0000 7efe1cd23800 10 monclient(hunting): picked mon.noname-b con 0x55e4a951e480 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:08:58.695 INFO:tasks.workunit.client.0.smithi097.stderr: -347> 2024-09-14T11:08:58.403+0000 7efe1cd23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:08:58.695 INFO:tasks.workunit.client.0.smithi097.stderr: -346> 2024-09-14T11:08:58.403+0000 7efe1cd23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:08:58.695 INFO:tasks.workunit.client.0.smithi097.stderr: -345> 2024-09-14T11:08:58.403+0000 7efe1cd23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:08:58.695 INFO:tasks.workunit.client.0.smithi097.stderr: -344> 2024-09-14T11:08:58.403+0000 7efe1cd23800 10 monclient(hunting): _renew_subs 2024-09-14T11:08:58.695 INFO:tasks.workunit.client.0.smithi097.stderr: -343> 2024-09-14T11:08:58.403+0000 7efe1cd23800 10 monclient(hunting): authenticate will time out at 2220.056244s 2024-09-14T11:08:58.695 INFO:tasks.workunit.client.0.smithi097.stderr: -342> 2024-09-14T11:08:58.403+0000 7efe1820b640 10 monclient(hunting): get_auth_request con 0x55e4a951f770 auth_method 0 2024-09-14T11:08:58.695 INFO:tasks.workunit.client.0.smithi097.stderr: -341> 2024-09-14T11:08:58.403+0000 7efe1820b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:08:58.695 INFO:tasks.workunit.client.0.smithi097.stderr: -340> 2024-09-14T11:08:58.403+0000 7efe1820b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:08:58.696 INFO:tasks.workunit.client.0.smithi097.stderr: -339> 2024-09-14T11:08:58.403+0000 7efe1820b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:08:58.696 INFO:tasks.workunit.client.0.smithi097.stderr: -338> 2024-09-14T11:08:58.403+0000 7efe1920d640 10 monclient(hunting): get_auth_request con 0x55e4a951fb50 auth_method 0 2024-09-14T11:08:58.696 INFO:tasks.workunit.client.0.smithi097.stderr: -337> 2024-09-14T11:08:58.403+0000 7efe1920d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:08:58.696 INFO:tasks.workunit.client.0.smithi097.stderr: -336> 2024-09-14T11:08:58.403+0000 7efe1920d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:08:58.696 INFO:tasks.workunit.client.0.smithi097.stderr: -335> 2024-09-14T11:08:58.403+0000 7efe1920d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:08:58.696 INFO:tasks.workunit.client.0.smithi097.stderr: -334> 2024-09-14T11:08:58.403+0000 7efe1820b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:08:58.696 INFO:tasks.workunit.client.0.smithi097.stderr: -333> 2024-09-14T11:08:58.403+0000 7efe1820b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:08:58.696 INFO:tasks.workunit.client.0.smithi097.stderr: -332> 2024-09-14T11:08:58.403+0000 7efe1820b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:08:58.696 INFO:tasks.workunit.client.0.smithi097.stderr: -331> 2024-09-14T11:08:58.403+0000 7efe1920d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:08:58.696 INFO:tasks.workunit.client.0.smithi097.stderr: -330> 2024-09-14T11:08:58.403+0000 7efe1920d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:08:58.696 INFO:tasks.workunit.client.0.smithi097.stderr: -329> 2024-09-14T11:08:58.403+0000 7efe1920d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:08:58.696 INFO:tasks.workunit.client.0.smithi097.stderr: -328> 2024-09-14T11:08:58.403+0000 7efe18a0c640 10 monclient(hunting): get_auth_request con 0x55e4a951e480 auth_method 0 2024-09-14T11:08:58.696 INFO:tasks.workunit.client.0.smithi097.stderr: -327> 2024-09-14T11:08:58.403+0000 7efe18a0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:08:58.696 INFO:tasks.workunit.client.0.smithi097.stderr: -326> 2024-09-14T11:08:58.403+0000 7efe18a0c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:08:58.697 INFO:tasks.workunit.client.0.smithi097.stderr: -325> 2024-09-14T11:08:58.403+0000 7efe18a0c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:08:58.697 INFO:tasks.workunit.client.0.smithi097.stderr: -324> 2024-09-14T11:08:58.403+0000 7efe18a0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:08:58.697 INFO:tasks.workunit.client.0.smithi097.stderr: -323> 2024-09-14T11:08:58.403+0000 7efe18a0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:08:58.697 INFO:tasks.workunit.client.0.smithi097.stderr: -322> 2024-09-14T11:08:58.403+0000 7efe18a0c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:08:58.697 INFO:tasks.workunit.client.0.smithi097.stderr: -321> 2024-09-14T11:08:58.403+0000 7efe1820b640 10 monclient(hunting): handle_auth_done global_id 7871 payload 824 2024-09-14T11:08:58.697 INFO:tasks.workunit.client.0.smithi097.stderr: -320> 2024-09-14T11:08:58.403+0000 7efe1820b640 10 monclient: _finish_hunting 0 2024-09-14T11:08:58.697 INFO:tasks.workunit.client.0.smithi097.stderr: -319> 2024-09-14T11:08:58.403+0000 7efe1820b640 1 monclient: found mon.noname-c 2024-09-14T11:08:58.697 INFO:tasks.workunit.client.0.smithi097.stderr: -318> 2024-09-14T11:08:58.403+0000 7efe1820b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:08:58.697 INFO:tasks.workunit.client.0.smithi097.stderr: -317> 2024-09-14T11:08:58.403+0000 7efcfe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:08:58.697 INFO:tasks.workunit.client.0.smithi097.stderr: -316> 2024-09-14T11:08:58.403+0000 7efcfe7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:08:58.697 INFO:tasks.workunit.client.0.smithi097.stderr: -315> 2024-09-14T11:08:58.403+0000 7efcfe7fc640 10 monclient: dump: 2024-09-14T11:08:58.697 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:08:58.697 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:08:58.698 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:58.698 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:58.698 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:08:58.698 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:58.698 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:08:58.698 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:08:58.698 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:08:58.698 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:58.698 INFO:tasks.workunit.client.0.smithi097.stderr: -314> 2024-09-14T11:08:58.403+0000 7efcfe7fc640 10 monclient: _finish_auth 0 2024-09-14T11:08:58.698 INFO:tasks.workunit.client.0.smithi097.stderr: -313> 2024-09-14T11:08:58.403+0000 7efcfe7fc640 10 monclient: _check_auth_tickets 2024-09-14T11:08:58.698 INFO:tasks.workunit.client.0.smithi097.stderr: -312> 2024-09-14T11:08:58.403+0000 7efe1cd23800 5 monclient: authenticate success, global_id 7871 2024-09-14T11:08:58.698 INFO:tasks.workunit.client.0.smithi097.stderr: -311> 2024-09-14T11:08:58.403+0000 7efe1cd23800 10 monclient: _renew_subs 2024-09-14T11:08:58.698 INFO:tasks.workunit.client.0.smithi097.stderr: -310> 2024-09-14T11:08:58.403+0000 7efe1cd23800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:08:58.699 INFO:tasks.workunit.client.0.smithi097.stderr: -309> 2024-09-14T11:08:58.403+0000 7efcfe7fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:08:58.699 INFO:tasks.workunit.client.0.smithi097.stderr: -308> 2024-09-14T11:08:58.403+0000 7efcfe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:08:58.699 INFO:tasks.workunit.client.0.smithi097.stderr: -307> 2024-09-14T11:08:58.403+0000 7efcfe7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:08:58.699 INFO:tasks.workunit.client.0.smithi097.stderr: -306> 2024-09-14T11:08:58.403+0000 7efcfe7fc640 10 monclient: dump: 2024-09-14T11:08:58.699 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:08:58.699 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:08:58.699 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:58.699 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:58.699 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:08:58.699 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:58.699 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:08:58.699 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:08:58.699 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:08:58.699 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:58.700 INFO:tasks.workunit.client.0.smithi097.stderr: -305> 2024-09-14T11:08:58.403+0000 7efe19a0e640 4 set_mon_vals no callback set 2024-09-14T11:08:58.700 INFO:tasks.workunit.client.0.smithi097.stderr: -304> 2024-09-14T11:08:58.404+0000 7efe1cd23800 10 monclient: _renew_subs 2024-09-14T11:08:58.700 INFO:tasks.workunit.client.0.smithi097.stderr: -303> 2024-09-14T11:08:58.404+0000 7efe1cd23800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:08:58.700 INFO:tasks.workunit.client.0.smithi097.stderr: -302> 2024-09-14T11:08:58.405+0000 7efcfe7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:08:58.700 INFO:tasks.workunit.client.0.smithi097.stderr: -301> 2024-09-14T11:08:58.405+0000 7efcfe7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:08:58.700 INFO:tasks.workunit.client.0.smithi097.stderr: -300> 2024-09-14T11:08:58.405+0000 7efcfe7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:08:58.700 INFO:tasks.workunit.client.0.smithi097.stderr: -299> 2024-09-14T11:08:58.405+0000 7efe1920d640 10 monclient: get_auth_request con 0x7efcf0077140 auth_method 0 2024-09-14T11:08:58.700 INFO:tasks.workunit.client.0.smithi097.stderr: -298> 2024-09-14T11:08:58.406+0000 7efe1cd23800 10 monclient: get_monmap_and_config 2024-09-14T11:08:58.700 INFO:tasks.workunit.client.0.smithi097.stderr: -297> 2024-09-14T11:08:58.406+0000 7efe1cd23800 10 monclient: build_initial_monmap 2024-09-14T11:08:58.700 INFO:tasks.workunit.client.0.smithi097.stderr: -296> 2024-09-14T11:08:58.406+0000 7efe1cd23800 1 build_initial for_mkfs: 0 2024-09-14T11:08:58.700 INFO:tasks.workunit.client.0.smithi097.stderr: -295> 2024-09-14T11:08:58.406+0000 7efe1cd23800 10 monclient: monmap: 2024-09-14T11:08:58.700 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:08:58.700 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:08:58.700 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:08:58.701 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:08:58.701 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:08:58.701 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:58.701 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:08:58.701 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:08:58.701 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:08:58.701 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:58.701 INFO:tasks.workunit.client.0.smithi097.stderr: -294> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x55e4a953f690) adding auth protocol: cephx 2024-09-14T11:08:58.701 INFO:tasks.workunit.client.0.smithi097.stderr: -293> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x55e4a953f690) adding auth protocol: cephx 2024-09-14T11:08:58.701 INFO:tasks.workunit.client.0.smithi097.stderr: -292> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x55e4a953f690) adding auth protocol: cephx 2024-09-14T11:08:58.701 INFO:tasks.workunit.client.0.smithi097.stderr: -291> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x55e4a953f690) adding con mode: secure 2024-09-14T11:08:58.701 INFO:tasks.workunit.client.0.smithi097.stderr: -290> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x55e4a953f690) adding con mode: crc 2024-09-14T11:08:58.701 INFO:tasks.workunit.client.0.smithi097.stderr: -289> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x55e4a953f690) adding con mode: secure 2024-09-14T11:08:58.702 INFO:tasks.workunit.client.0.smithi097.stderr: -288> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x55e4a953f690) adding con mode: crc 2024-09-14T11:08:58.702 INFO:tasks.workunit.client.0.smithi097.stderr: -287> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x55e4a953f690) adding con mode: secure 2024-09-14T11:08:58.702 INFO:tasks.workunit.client.0.smithi097.stderr: -286> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x55e4a953f690) adding con mode: crc 2024-09-14T11:08:58.702 INFO:tasks.workunit.client.0.smithi097.stderr: -285> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x55e4a953f690) adding con mode: crc 2024-09-14T11:08:58.702 INFO:tasks.workunit.client.0.smithi097.stderr: -284> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x55e4a953f690) adding con mode: secure 2024-09-14T11:08:58.702 INFO:tasks.workunit.client.0.smithi097.stderr: -283> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x55e4a953f690) adding con mode: crc 2024-09-14T11:08:58.702 INFO:tasks.workunit.client.0.smithi097.stderr: -282> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x55e4a953f690) adding con mode: secure 2024-09-14T11:08:58.702 INFO:tasks.workunit.client.0.smithi097.stderr: -281> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x55e4a953f690) adding con mode: crc 2024-09-14T11:08:58.702 INFO:tasks.workunit.client.0.smithi097.stderr: -280> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x55e4a953f690) adding con mode: secure 2024-09-14T11:08:58.702 INFO:tasks.workunit.client.0.smithi097.stderr: -279> 2024-09-14T11:08:58.406+0000 7efe1cd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:58.702 INFO:tasks.workunit.client.0.smithi097.stderr: -278> 2024-09-14T11:08:58.406+0000 7efe1cd23800 10 monclient: init 2024-09-14T11:08:58.702 INFO:tasks.workunit.client.0.smithi097.stderr: -277> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b1815a0) adding auth protocol: cephx 2024-09-14T11:08:58.702 INFO:tasks.workunit.client.0.smithi097.stderr: -276> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b1815a0) adding auth protocol: cephx 2024-09-14T11:08:58.702 INFO:tasks.workunit.client.0.smithi097.stderr: -275> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b1815a0) adding auth protocol: cephx 2024-09-14T11:08:58.703 INFO:tasks.workunit.client.0.smithi097.stderr: -274> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b1815a0) adding con mode: secure 2024-09-14T11:08:58.703 INFO:tasks.workunit.client.0.smithi097.stderr: -273> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b1815a0) adding con mode: crc 2024-09-14T11:08:58.703 INFO:tasks.workunit.client.0.smithi097.stderr: -272> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b1815a0) adding con mode: secure 2024-09-14T11:08:58.703 INFO:tasks.workunit.client.0.smithi097.stderr: -271> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b1815a0) adding con mode: crc 2024-09-14T11:08:58.703 INFO:tasks.workunit.client.0.smithi097.stderr: -270> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b1815a0) adding con mode: secure 2024-09-14T11:08:58.703 INFO:tasks.workunit.client.0.smithi097.stderr: -269> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b1815a0) adding con mode: crc 2024-09-14T11:08:58.703 INFO:tasks.workunit.client.0.smithi097.stderr: -268> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b1815a0) adding con mode: crc 2024-09-14T11:08:58.703 INFO:tasks.workunit.client.0.smithi097.stderr: -267> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b1815a0) adding con mode: secure 2024-09-14T11:08:58.703 INFO:tasks.workunit.client.0.smithi097.stderr: -266> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b1815a0) adding con mode: crc 2024-09-14T11:08:58.703 INFO:tasks.workunit.client.0.smithi097.stderr: -265> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b1815a0) adding con mode: secure 2024-09-14T11:08:58.703 INFO:tasks.workunit.client.0.smithi097.stderr: -264> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b1815a0) adding con mode: crc 2024-09-14T11:08:58.703 INFO:tasks.workunit.client.0.smithi097.stderr: -263> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b1815a0) adding con mode: secure 2024-09-14T11:08:58.703 INFO:tasks.workunit.client.0.smithi097.stderr: -262> 2024-09-14T11:08:58.406+0000 7efe1cd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:58.703 INFO:tasks.workunit.client.0.smithi097.stderr: -261> 2024-09-14T11:08:58.406+0000 7efe1cd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:58.704 INFO:tasks.workunit.client.0.smithi097.stderr: -260> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 asok(0x55e4a9281270) register_command rotate-key cmddesc rotate-key hook 0x7ffc4b1816e8 EEXIST 2024-09-14T11:08:58.704 INFO:tasks.workunit.client.0.smithi097.stderr: -259> 2024-09-14T11:08:58.407+0000 7efe1cd23800 10 monclient: _reopen_session rank -1 2024-09-14T11:08:58.704 INFO:tasks.workunit.client.0.smithi097.stderr: -258> 2024-09-14T11:08:58.407+0000 7efe1cd23800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:08:58.704 INFO:tasks.workunit.client.0.smithi097.stderr: -257> 2024-09-14T11:08:58.407+0000 7efe1cd23800 10 monclient(hunting): picked mon.noname-b con 0x55e4a956d180 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:08:58.704 INFO:tasks.workunit.client.0.smithi097.stderr: -256> 2024-09-14T11:08:58.407+0000 7efe1cd23800 10 monclient(hunting): picked mon.noname-c con 0x55e4a9565c20 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:08:58.704 INFO:tasks.workunit.client.0.smithi097.stderr: -255> 2024-09-14T11:08:58.407+0000 7efe1cd23800 10 monclient(hunting): picked mon.noname-a con 0x55e4a9540ef0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:08:58.704 INFO:tasks.workunit.client.0.smithi097.stderr: -254> 2024-09-14T11:08:58.407+0000 7efe1cd23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:08:58.704 INFO:tasks.workunit.client.0.smithi097.stderr: -253> 2024-09-14T11:08:58.407+0000 7efe1cd23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:08:58.704 INFO:tasks.workunit.client.0.smithi097.stderr: -252> 2024-09-14T11:08:58.407+0000 7efe1cd23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:08:58.705 INFO:tasks.workunit.client.0.smithi097.stderr: -251> 2024-09-14T11:08:58.407+0000 7efe1cd23800 10 monclient(hunting): _renew_subs 2024-09-14T11:08:58.705 INFO:tasks.workunit.client.0.smithi097.stderr: -250> 2024-09-14T11:08:58.407+0000 7efe1cd23800 10 monclient(hunting): authenticate will time out at 2220.060060s 2024-09-14T11:08:58.705 INFO:tasks.workunit.client.0.smithi097.stderr: -249> 2024-09-14T11:08:58.407+0000 7efe1920d640 10 monclient(hunting): get_auth_request con 0x55e4a9565c20 auth_method 0 2024-09-14T11:08:58.705 INFO:tasks.workunit.client.0.smithi097.stderr: -248> 2024-09-14T11:08:58.407+0000 7efe1920d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:08:58.705 INFO:tasks.workunit.client.0.smithi097.stderr: -247> 2024-09-14T11:08:58.407+0000 7efe1920d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:08:58.705 INFO:tasks.workunit.client.0.smithi097.stderr: -246> 2024-09-14T11:08:58.407+0000 7efe1920d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:08:58.705 INFO:tasks.workunit.client.0.smithi097.stderr: -245> 2024-09-14T11:08:58.407+0000 7efe18a0c640 10 monclient(hunting): get_auth_request con 0x55e4a9540ef0 auth_method 0 2024-09-14T11:08:58.705 INFO:tasks.workunit.client.0.smithi097.stderr: -244> 2024-09-14T11:08:58.407+0000 7efe18a0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:08:58.705 INFO:tasks.workunit.client.0.smithi097.stderr: -243> 2024-09-14T11:08:58.407+0000 7efe18a0c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:08:58.705 INFO:tasks.workunit.client.0.smithi097.stderr: -242> 2024-09-14T11:08:58.407+0000 7efe18a0c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:08:58.705 INFO:tasks.workunit.client.0.smithi097.stderr: -241> 2024-09-14T11:08:58.407+0000 7efe1920d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:08:58.705 INFO:tasks.workunit.client.0.smithi097.stderr: -240> 2024-09-14T11:08:58.407+0000 7efe1920d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:08:58.705 INFO:tasks.workunit.client.0.smithi097.stderr: -239> 2024-09-14T11:08:58.407+0000 7efe1920d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:08:58.706 INFO:tasks.workunit.client.0.smithi097.stderr: -238> 2024-09-14T11:08:58.407+0000 7efe18a0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:08:58.706 INFO:tasks.workunit.client.0.smithi097.stderr: -237> 2024-09-14T11:08:58.407+0000 7efe18a0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:08:58.706 INFO:tasks.workunit.client.0.smithi097.stderr: -236> 2024-09-14T11:08:58.407+0000 7efe18a0c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:08:58.706 INFO:tasks.workunit.client.0.smithi097.stderr: -235> 2024-09-14T11:08:58.407+0000 7efe1820b640 10 monclient(hunting): get_auth_request con 0x55e4a956d180 auth_method 0 2024-09-14T11:08:58.706 INFO:tasks.workunit.client.0.smithi097.stderr: -234> 2024-09-14T11:08:58.407+0000 7efe1820b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:08:58.706 INFO:tasks.workunit.client.0.smithi097.stderr: -233> 2024-09-14T11:08:58.407+0000 7efe1820b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:08:58.706 INFO:tasks.workunit.client.0.smithi097.stderr: -232> 2024-09-14T11:08:58.407+0000 7efe1820b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:08:58.706 INFO:tasks.workunit.client.0.smithi097.stderr: -231> 2024-09-14T11:08:58.407+0000 7efe1920d640 10 monclient(hunting): handle_auth_done global_id 7874 payload 274 2024-09-14T11:08:58.706 INFO:tasks.workunit.client.0.smithi097.stderr: -230> 2024-09-14T11:08:58.407+0000 7efe1920d640 10 monclient: _finish_hunting 0 2024-09-14T11:08:58.706 INFO:tasks.workunit.client.0.smithi097.stderr: -229> 2024-09-14T11:08:58.407+0000 7efe1920d640 1 monclient: found mon.noname-c 2024-09-14T11:08:58.706 INFO:tasks.workunit.client.0.smithi097.stderr: -228> 2024-09-14T11:08:58.407+0000 7efe1920d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:08:58.706 INFO:tasks.workunit.client.0.smithi097.stderr: -227> 2024-09-14T11:08:58.407+0000 7efceffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:08:58.706 INFO:tasks.workunit.client.0.smithi097.stderr: -226> 2024-09-14T11:08:58.407+0000 7efceffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:08:58.706 INFO:tasks.workunit.client.0.smithi097.stderr: -225> 2024-09-14T11:08:58.407+0000 7efceffff640 10 monclient: dump: 2024-09-14T11:08:58.707 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:08:58.707 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:08:58.707 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:58.707 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:58.707 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:08:58.707 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:58.707 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:08:58.707 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:08:58.707 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:08:58.707 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:58.707 INFO:tasks.workunit.client.0.smithi097.stderr: -224> 2024-09-14T11:08:58.407+0000 7efceffff640 10 monclient: _finish_auth 0 2024-09-14T11:08:58.707 INFO:tasks.workunit.client.0.smithi097.stderr: -223> 2024-09-14T11:08:58.407+0000 7efceffff640 10 monclient: _check_auth_tickets 2024-09-14T11:08:58.707 INFO:tasks.workunit.client.0.smithi097.stderr: -222> 2024-09-14T11:08:58.407+0000 7efceffff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:08:58.707 INFO:tasks.workunit.client.0.smithi097.stderr: -221> 2024-09-14T11:08:58.407+0000 7efceffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:08:58.708 INFO:tasks.workunit.client.0.smithi097.stderr: -220> 2024-09-14T11:08:58.407+0000 7efceffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:08:58.708 INFO:tasks.workunit.client.0.smithi097.stderr: -219> 2024-09-14T11:08:58.407+0000 7efceffff640 10 monclient: dump: 2024-09-14T11:08:58.708 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:08:58.708 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:08:58.708 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:58.708 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:58.708 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:08:58.708 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:58.708 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:08:58.708 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:08:58.708 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:08:58.708 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:58.708 INFO:tasks.workunit.client.0.smithi097.stderr: -218> 2024-09-14T11:08:58.407+0000 7efe1cd23800 5 monclient: authenticate success, global_id 7874 2024-09-14T11:08:58.709 INFO:tasks.workunit.client.0.smithi097.stderr: -217> 2024-09-14T11:08:58.407+0000 7efe1cd23800 10 monclient: get_monmap_and_config success 2024-09-14T11:08:58.709 INFO:tasks.workunit.client.0.smithi097.stderr: -216> 2024-09-14T11:08:58.407+0000 7efe1cd23800 4 set_mon_vals no callback set 2024-09-14T11:08:58.709 INFO:tasks.workunit.client.0.smithi097.stderr: -215> 2024-09-14T11:08:58.408+0000 7efe1cd23800 10 monclient: shutdown 2024-09-14T11:08:58.709 INFO:tasks.workunit.client.0.smithi097.stderr: -214> 2024-09-14T11:08:58.408+0000 7efe1cd23800 10 monclient: build_initial_monmap 2024-09-14T11:08:58.709 INFO:tasks.workunit.client.0.smithi097.stderr: -213> 2024-09-14T11:08:58.408+0000 7efe1cd23800 1 build_initial for_mkfs: 0 2024-09-14T11:08:58.709 INFO:tasks.workunit.client.0.smithi097.stderr: -212> 2024-09-14T11:08:58.408+0000 7efe1cd23800 10 monclient: monmap: 2024-09-14T11:08:58.709 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:08:58.709 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:08:58.709 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:08:58.709 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:08:58.709 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:08:58.709 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:58.709 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:08:58.710 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:08:58.710 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:08:58.710 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:58.710 INFO:tasks.workunit.client.0.smithi097.stderr: -211> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9541420) adding auth protocol: cephx 2024-09-14T11:08:58.710 INFO:tasks.workunit.client.0.smithi097.stderr: -210> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9541420) adding auth protocol: cephx 2024-09-14T11:08:58.710 INFO:tasks.workunit.client.0.smithi097.stderr: -209> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9541420) adding auth protocol: cephx 2024-09-14T11:08:58.710 INFO:tasks.workunit.client.0.smithi097.stderr: -208> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9541420) adding con mode: secure 2024-09-14T11:08:58.710 INFO:tasks.workunit.client.0.smithi097.stderr: -207> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9541420) adding con mode: crc 2024-09-14T11:08:58.710 INFO:tasks.workunit.client.0.smithi097.stderr: -206> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9541420) adding con mode: secure 2024-09-14T11:08:58.710 INFO:tasks.workunit.client.0.smithi097.stderr: -205> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9541420) adding con mode: crc 2024-09-14T11:08:58.710 INFO:tasks.workunit.client.0.smithi097.stderr: -204> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9541420) adding con mode: secure 2024-09-14T11:08:58.710 INFO:tasks.workunit.client.0.smithi097.stderr: -203> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9541420) adding con mode: crc 2024-09-14T11:08:58.710 INFO:tasks.workunit.client.0.smithi097.stderr: -202> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9541420) adding con mode: crc 2024-09-14T11:08:58.710 INFO:tasks.workunit.client.0.smithi097.stderr: -201> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9541420) adding con mode: secure 2024-09-14T11:08:58.710 INFO:tasks.workunit.client.0.smithi097.stderr: -200> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9541420) adding con mode: crc 2024-09-14T11:08:58.711 INFO:tasks.workunit.client.0.smithi097.stderr: -199> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9541420) adding con mode: secure 2024-09-14T11:08:58.711 INFO:tasks.workunit.client.0.smithi097.stderr: -198> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9541420) adding con mode: crc 2024-09-14T11:08:58.711 INFO:tasks.workunit.client.0.smithi097.stderr: -197> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9541420) adding con mode: secure 2024-09-14T11:08:58.711 INFO:tasks.workunit.client.0.smithi097.stderr: -196> 2024-09-14T11:08:58.408+0000 7efe1cd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:58.711 INFO:tasks.workunit.client.0.smithi097.stderr: -195> 2024-09-14T11:08:58.408+0000 7efe1cd23800 1 librados: starting msgr at 2024-09-14T11:08:58.711 INFO:tasks.workunit.client.0.smithi097.stderr: -194> 2024-09-14T11:08:58.408+0000 7efe1cd23800 1 librados: starting objecter 2024-09-14T11:08:58.711 INFO:tasks.workunit.client.0.smithi097.stderr: -193> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 asok(0x55e4a9281270) register_command objecter_requests cmddesc objecter_requests hook 0x55e4a9540cf0 EEXIST 2024-09-14T11:08:58.711 INFO:tasks.workunit.client.0.smithi097.stderr: -192> 2024-09-14T11:08:58.408+0000 7efe1cd23800 1 librados: setting wanted keys 2024-09-14T11:08:58.711 INFO:tasks.workunit.client.0.smithi097.stderr: -191> 2024-09-14T11:08:58.408+0000 7efe1cd23800 1 librados: calling monclient init 2024-09-14T11:08:58.711 INFO:tasks.workunit.client.0.smithi097.stderr: -190> 2024-09-14T11:08:58.408+0000 7efe1cd23800 10 monclient: init 2024-09-14T11:08:58.711 INFO:tasks.workunit.client.0.smithi097.stderr: -189> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9534030) adding auth protocol: cephx 2024-09-14T11:08:58.711 INFO:tasks.workunit.client.0.smithi097.stderr: -188> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9534030) adding auth protocol: cephx 2024-09-14T11:08:58.711 INFO:tasks.workunit.client.0.smithi097.stderr: -187> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9534030) adding auth protocol: cephx 2024-09-14T11:08:58.712 INFO:tasks.workunit.client.0.smithi097.stderr: -186> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9534030) adding con mode: secure 2024-09-14T11:08:58.712 INFO:tasks.workunit.client.0.smithi097.stderr: -185> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9534030) adding con mode: crc 2024-09-14T11:08:58.712 INFO:tasks.workunit.client.0.smithi097.stderr: -184> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9534030) adding con mode: secure 2024-09-14T11:08:58.712 INFO:tasks.workunit.client.0.smithi097.stderr: -183> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9534030) adding con mode: crc 2024-09-14T11:08:58.712 INFO:tasks.workunit.client.0.smithi097.stderr: -182> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9534030) adding con mode: secure 2024-09-14T11:08:58.712 INFO:tasks.workunit.client.0.smithi097.stderr: -181> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9534030) adding con mode: crc 2024-09-14T11:08:58.712 INFO:tasks.workunit.client.0.smithi097.stderr: -180> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9534030) adding con mode: crc 2024-09-14T11:08:58.712 INFO:tasks.workunit.client.0.smithi097.stderr: -179> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9534030) adding con mode: secure 2024-09-14T11:08:58.712 INFO:tasks.workunit.client.0.smithi097.stderr: -178> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9534030) adding con mode: crc 2024-09-14T11:08:58.712 INFO:tasks.workunit.client.0.smithi097.stderr: -177> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9534030) adding con mode: secure 2024-09-14T11:08:58.712 INFO:tasks.workunit.client.0.smithi097.stderr: -176> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9534030) adding con mode: crc 2024-09-14T11:08:58.712 INFO:tasks.workunit.client.0.smithi097.stderr: -175> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9534030) adding con mode: secure 2024-09-14T11:08:58.712 INFO:tasks.workunit.client.0.smithi097.stderr: -174> 2024-09-14T11:08:58.408+0000 7efe1cd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:58.713 INFO:tasks.workunit.client.0.smithi097.stderr: -173> 2024-09-14T11:08:58.409+0000 7efe1cd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:58.713 INFO:tasks.workunit.client.0.smithi097.stderr: -172> 2024-09-14T11:08:58.409+0000 7efe1cd23800 5 asok(0x55e4a9281270) register_command rotate-key cmddesc rotate-key hook 0x55e4a9534178 EEXIST 2024-09-14T11:08:58.713 INFO:tasks.workunit.client.0.smithi097.stderr: -171> 2024-09-14T11:08:58.409+0000 7efe1cd23800 10 monclient: _reopen_session rank -1 2024-09-14T11:08:58.713 INFO:tasks.workunit.client.0.smithi097.stderr: -170> 2024-09-14T11:08:58.409+0000 7efe1cd23800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:08:58.713 INFO:tasks.workunit.client.0.smithi097.stderr: -169> 2024-09-14T11:08:58.409+0000 7efe1cd23800 10 monclient(hunting): picked mon.noname-b con 0x55e4a9540ef0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:08:58.713 INFO:tasks.workunit.client.0.smithi097.stderr: -168> 2024-09-14T11:08:58.409+0000 7efe1cd23800 10 monclient(hunting): picked mon.noname-a con 0x55e4a9565c20 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:08:58.713 INFO:tasks.workunit.client.0.smithi097.stderr: -167> 2024-09-14T11:08:58.409+0000 7efe1cd23800 10 monclient(hunting): picked mon.noname-c con 0x55e4a956d180 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:08:58.713 INFO:tasks.workunit.client.0.smithi097.stderr: -166> 2024-09-14T11:08:58.409+0000 7efe1cd23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:08:58.713 INFO:tasks.workunit.client.0.smithi097.stderr: -165> 2024-09-14T11:08:58.409+0000 7efe1cd23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:08:58.713 INFO:tasks.workunit.client.0.smithi097.stderr: -164> 2024-09-14T11:08:58.409+0000 7efe1cd23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:08:58.713 INFO:tasks.workunit.client.0.smithi097.stderr: -163> 2024-09-14T11:08:58.409+0000 7efe1cd23800 10 monclient(hunting): _renew_subs 2024-09-14T11:08:58.713 INFO:tasks.workunit.client.0.smithi097.stderr: -162> 2024-09-14T11:08:58.409+0000 7efe1cd23800 10 monclient(hunting): authenticate will time out at 2220.062244s 2024-09-14T11:08:58.713 INFO:tasks.workunit.client.0.smithi097.stderr: -161> 2024-09-14T11:08:58.409+0000 7efe1920d640 10 monclient(hunting): get_auth_request con 0x55e4a9565c20 auth_method 0 2024-09-14T11:08:58.714 INFO:tasks.workunit.client.0.smithi097.stderr: -160> 2024-09-14T11:08:58.409+0000 7efe1920d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:08:58.714 INFO:tasks.workunit.client.0.smithi097.stderr: -159> 2024-09-14T11:08:58.409+0000 7efe1920d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:08:58.714 INFO:tasks.workunit.client.0.smithi097.stderr: -158> 2024-09-14T11:08:58.409+0000 7efe1920d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:08:58.714 INFO:tasks.workunit.client.0.smithi097.stderr: -157> 2024-09-14T11:08:58.409+0000 7efe18a0c640 10 monclient(hunting): get_auth_request con 0x55e4a956d180 auth_method 0 2024-09-14T11:08:58.714 INFO:tasks.workunit.client.0.smithi097.stderr: -156> 2024-09-14T11:08:58.409+0000 7efe18a0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:08:58.714 INFO:tasks.workunit.client.0.smithi097.stderr: -155> 2024-09-14T11:08:58.409+0000 7efe18a0c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:08:58.714 INFO:tasks.workunit.client.0.smithi097.stderr: -154> 2024-09-14T11:08:58.409+0000 7efe18a0c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:08:58.714 INFO:tasks.workunit.client.0.smithi097.stderr: -153> 2024-09-14T11:08:58.409+0000 7efe18a0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:08:58.714 INFO:tasks.workunit.client.0.smithi097.stderr: -152> 2024-09-14T11:08:58.409+0000 7efe18a0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:08:58.714 INFO:tasks.workunit.client.0.smithi097.stderr: -151> 2024-09-14T11:08:58.409+0000 7efe18a0c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:08:58.714 INFO:tasks.workunit.client.0.smithi097.stderr: -150> 2024-09-14T11:08:58.409+0000 7efe1920d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:08:58.714 INFO:tasks.workunit.client.0.smithi097.stderr: -149> 2024-09-14T11:08:58.409+0000 7efe1920d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:08:58.714 INFO:tasks.workunit.client.0.smithi097.stderr: -148> 2024-09-14T11:08:58.409+0000 7efe1920d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:08:58.715 INFO:tasks.workunit.client.0.smithi097.stderr: -147> 2024-09-14T11:08:58.409+0000 7efe18a0c640 10 monclient(hunting): handle_auth_done global_id 7877 payload 824 2024-09-14T11:08:58.715 INFO:tasks.workunit.client.0.smithi097.stderr: -146> 2024-09-14T11:08:58.409+0000 7efe18a0c640 10 monclient: _finish_hunting 0 2024-09-14T11:08:58.715 INFO:tasks.workunit.client.0.smithi097.stderr: -145> 2024-09-14T11:08:58.409+0000 7efe18a0c640 1 monclient: found mon.noname-c 2024-09-14T11:08:58.715 INFO:tasks.workunit.client.0.smithi097.stderr: -144> 2024-09-14T11:08:58.409+0000 7efe18a0c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:08:58.715 INFO:tasks.workunit.client.0.smithi097.stderr: -143> 2024-09-14T11:08:58.409+0000 7efcee7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:08:58.715 INFO:tasks.workunit.client.0.smithi097.stderr: -142> 2024-09-14T11:08:58.409+0000 7efcee7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:08:58.715 INFO:tasks.workunit.client.0.smithi097.stderr: -141> 2024-09-14T11:08:58.409+0000 7efcee7fc640 10 monclient: dump: 2024-09-14T11:08:58.715 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:08:58.715 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:08:58.715 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:58.715 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:58.715 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:08:58.715 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:58.715 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:08:58.716 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:08:58.716 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:08:58.716 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:58.716 INFO:tasks.workunit.client.0.smithi097.stderr: -140> 2024-09-14T11:08:58.409+0000 7efcee7fc640 10 monclient: _finish_auth 0 2024-09-14T11:08:58.716 INFO:tasks.workunit.client.0.smithi097.stderr: -139> 2024-09-14T11:08:58.409+0000 7efcee7fc640 10 monclient: _check_auth_tickets 2024-09-14T11:08:58.716 INFO:tasks.workunit.client.0.smithi097.stderr: -138> 2024-09-14T11:08:58.409+0000 7efe1cd23800 5 monclient: authenticate success, global_id 7877 2024-09-14T11:08:58.716 INFO:tasks.workunit.client.0.smithi097.stderr: -137> 2024-09-14T11:08:58.409+0000 7efcee7fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:08:58.716 INFO:tasks.workunit.client.0.smithi097.stderr: -136> 2024-09-14T11:08:58.409+0000 7efcee7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:08:58.716 INFO:tasks.workunit.client.0.smithi097.stderr: -135> 2024-09-14T11:08:58.409+0000 7efcee7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:08:58.716 INFO:tasks.workunit.client.0.smithi097.stderr: -134> 2024-09-14T11:08:58.409+0000 7efcee7fc640 10 monclient: dump: 2024-09-14T11:08:58.716 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:08:58.716 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:08:58.716 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:58.716 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:58.717 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:08:58.717 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:58.717 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:08:58.717 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:08:58.717 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:08:58.717 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:58.717 INFO:tasks.workunit.client.0.smithi097.stderr: -133> 2024-09-14T11:08:58.409+0000 7efe1cd23800 10 monclient: _renew_subs 2024-09-14T11:08:58.717 INFO:tasks.workunit.client.0.smithi097.stderr: -132> 2024-09-14T11:08:58.409+0000 7efceffff640 4 set_mon_vals no callback set 2024-09-14T11:08:58.717 INFO:tasks.workunit.client.0.smithi097.stderr: -131> 2024-09-14T11:08:58.409+0000 7efe1cd23800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:08:58.717 INFO:tasks.workunit.client.0.smithi097.stderr: -130> 2024-09-14T11:08:58.409+0000 7efe1cd23800 10 monclient: _renew_subs 2024-09-14T11:08:58.717 INFO:tasks.workunit.client.0.smithi097.stderr: -129> 2024-09-14T11:08:58.409+0000 7efe1cd23800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:08:58.717 INFO:tasks.workunit.client.0.smithi097.stderr: -128> 2024-09-14T11:08:58.409+0000 7efe1cd23800 1 librados: init done 2024-09-14T11:08:58.717 INFO:tasks.workunit.client.0.smithi097.stderr: -127> 2024-09-14T11:08:58.409+0000 7efe1cd23800 5 asok(0x55e4a9281270) register_command cr dump hook 0x55e4a957f858 2024-09-14T11:08:58.718 INFO:tasks.workunit.client.0.smithi097.stderr: -126> 2024-09-14T11:08:58.411+0000 7efe1cd23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.718 INFO:tasks.workunit.client.0.smithi097.stderr: -125> 2024-09-14T11:08:58.412+0000 7efcee7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:08:58.718 INFO:tasks.workunit.client.0.smithi097.stderr: -124> 2024-09-14T11:08:58.412+0000 7efcee7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:08:58.718 INFO:tasks.workunit.client.0.smithi097.stderr: -123> 2024-09-14T11:08:58.412+0000 7efcee7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:08:58.718 INFO:tasks.workunit.client.0.smithi097.stderr: -122> 2024-09-14T11:08:58.412+0000 7efe1820b640 10 monclient: get_auth_request con 0x7efce4077230 auth_method 0 2024-09-14T11:08:58.718 INFO:tasks.workunit.client.0.smithi097.stderr: -121> 2024-09-14T11:08:58.413+0000 7efe1920d640 10 monclient: get_auth_request con 0x55e4a958f8b0 auth_method 0 2024-09-14T11:08:58.718 INFO:tasks.workunit.client.0.smithi097.stderr: -120> 2024-09-14T11:08:58.413+0000 7efe1cd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:58.718 INFO:tasks.workunit.client.0.smithi097.stderr: -119> 2024-09-14T11:08:58.413+0000 7efe1cd23800 20 realm 2024-09-14T11:08:58.718 INFO:tasks.workunit.client.0.smithi097.stderr: -118> 2024-09-14T11:08:58.413+0000 7efe1cd23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.718 INFO:tasks.workunit.client.0.smithi097.stderr: -117> 2024-09-14T11:08:58.413+0000 7efe1cd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:58.718 INFO:tasks.workunit.client.0.smithi097.stderr: -116> 2024-09-14T11:08:58.413+0000 7efe1cd23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:08:58.718 INFO:tasks.workunit.client.0.smithi097.stderr: -115> 2024-09-14T11:08:58.413+0000 7efe1cd23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.718 INFO:tasks.workunit.client.0.smithi097.stderr: -114> 2024-09-14T11:08:58.414+0000 7efe1cd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:58.718 INFO:tasks.workunit.client.0.smithi097.stderr: -113> 2024-09-14T11:08:58.414+0000 7efe1cd23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.719 INFO:tasks.workunit.client.0.smithi097.stderr: -112> 2024-09-14T11:08:58.414+0000 7efe1820b640 10 monclient: get_auth_request con 0x55e4a9593a20 auth_method 0 2024-09-14T11:08:58.719 INFO:tasks.workunit.client.0.smithi097.stderr: -111> 2024-09-14T11:08:58.414+0000 7efe1cd23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:08:58.719 INFO:tasks.workunit.client.0.smithi097.stderr: -110> 2024-09-14T11:08:58.414+0000 7efe1cd23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.719 INFO:tasks.workunit.client.0.smithi097.stderr: -109> 2024-09-14T11:08:58.415+0000 7efe1920d640 10 monclient: get_auth_request con 0x55e4a9597310 auth_method 0 2024-09-14T11:08:58.719 INFO:tasks.workunit.client.0.smithi097.stderr: -108> 2024-09-14T11:08:58.415+0000 7efe1cd23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:08:58.719 INFO:tasks.workunit.client.0.smithi097.stderr: -107> 2024-09-14T11:08:58.415+0000 7efe1cd23800 20 searching for the correct realm 2024-09-14T11:08:58.719 INFO:tasks.workunit.client.0.smithi097.stderr: -106> 2024-09-14T11:08:58.415+0000 7efe18a0c640 10 monclient: get_auth_request con 0x55e4a959c030 auth_method 0 2024-09-14T11:08:58.719 INFO:tasks.workunit.client.0.smithi097.stderr: -105> 2024-09-14T11:08:58.416+0000 7efe1820b640 10 monclient: get_auth_request con 0x7efe0807d070 auth_method 0 2024-09-14T11:08:58.719 INFO:tasks.workunit.client.0.smithi097.stderr: -104> 2024-09-14T11:08:58.417+0000 7efe1920d640 10 monclient: get_auth_request con 0x7efe000684e0 auth_method 0 2024-09-14T11:08:58.719 INFO:tasks.workunit.client.0.smithi097.stderr: -103> 2024-09-14T11:08:58.417+0000 7efe1920d640 0 -- 172.21.15.97:0/821645223 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7efe000684e0 msgr2=0x7efe00066f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:08:58.719 INFO:tasks.workunit.client.0.smithi097.stderr: -102> 2024-09-14T11:08:58.618+0000 7efe1920d640 10 monclient: get_auth_request con 0x7efe000684e0 auth_method 0 2024-09-14T11:08:58.719 INFO:tasks.workunit.client.0.smithi097.stderr: -101> 2024-09-14T11:08:58.621+0000 7efe18a0c640 10 monclient: get_auth_request con 0x7efe000716d0 auth_method 0 2024-09-14T11:08:58.719 INFO:tasks.workunit.client.0.smithi097.stderr: -100> 2024-09-14T11:08:58.622+0000 7efe1820b640 10 monclient: get_auth_request con 0x7efe08061040 auth_method 0 2024-09-14T11:08:58.719 INFO:tasks.workunit.client.0.smithi097.stderr: -99> 2024-09-14T11:08:58.622+0000 7efe1820b640 0 -- 172.21.15.97:0/821645223 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7efe08061040 msgr2=0x7efe080e38c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:08:58.720 INFO:tasks.workunit.client.0.smithi097.stderr: -98> 2024-09-14T11:08:58.622+0000 7efcee7fc640 1 client.7877.objecter ms_handle_reset 0x7efe08061040 session 0x7efe080ad700 osd.3 2024-09-14T11:08:58.720 INFO:tasks.workunit.client.0.smithi097.stderr: -97> 2024-09-14T11:08:58.622+0000 7efcee7fc640 10 monclient: _renew_subs 2024-09-14T11:08:58.720 INFO:tasks.workunit.client.0.smithi097.stderr: -96> 2024-09-14T11:08:58.622+0000 7efcee7fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:08:58.720 INFO:tasks.workunit.client.0.smithi097.stderr: -95> 2024-09-14T11:08:58.623+0000 7efe1820b640 10 monclient: get_auth_request con 0x7efce4086d50 auth_method 0 2024-09-14T11:08:58.720 INFO:tasks.workunit.client.0.smithi097.stderr: -94> 2024-09-14T11:08:58.628+0000 7efe1cd23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:08:58.720 INFO:tasks.workunit.client.0.smithi097.stderr: -93> 2024-09-14T11:08:58.628+0000 7efe1cd23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:08:58.720 INFO:tasks.workunit.client.0.smithi097.stderr: -92> 2024-09-14T11:08:58.628+0000 7efe1cd23800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:08:58.720 INFO:tasks.workunit.client.0.smithi097.stderr: -91> 2024-09-14T11:08:58.628+0000 7efe1cd23800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:08:58.720 INFO:tasks.workunit.client.0.smithi097.stderr: -90> 2024-09-14T11:08:58.628+0000 7efe1cd23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:08:58.720 INFO:tasks.workunit.client.0.smithi097.stderr: -89> 2024-09-14T11:08:58.628+0000 7efe1cd23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:08:58.720 INFO:tasks.workunit.client.0.smithi097.stderr: -88> 2024-09-14T11:08:58.628+0000 7efe1cd23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.720 INFO:tasks.workunit.client.0.smithi097.stderr: -87> 2024-09-14T11:08:58.628+0000 7efe1cd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:58.721 INFO:tasks.workunit.client.0.smithi097.stderr: -86> 2024-09-14T11:08:58.628+0000 7efe1cd23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.721 INFO:tasks.workunit.client.0.smithi097.stderr: -85> 2024-09-14T11:08:58.628+0000 7efe1cd23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:08:58.721 INFO:tasks.workunit.client.0.smithi097.stderr: -84> 2024-09-14T11:08:58.628+0000 7efe1cd23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.721 INFO:tasks.workunit.client.0.smithi097.stderr: -83> 2024-09-14T11:08:58.629+0000 7efe1cd23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:08:58.721 INFO:tasks.workunit.client.0.smithi097.stderr: -82> 2024-09-14T11:08:58.629+0000 7efe1cd23800 20 zone default found 2024-09-14T11:08:58.721 INFO:tasks.workunit.client.0.smithi097.stderr: -81> 2024-09-14T11:08:58.629+0000 7efe1cd23800 4 Realm: () 2024-09-14T11:08:58.721 INFO:tasks.workunit.client.0.smithi097.stderr: -80> 2024-09-14T11:08:58.629+0000 7efe1cd23800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:08:58.721 INFO:tasks.workunit.client.0.smithi097.stderr: -79> 2024-09-14T11:08:58.629+0000 7efe1cd23800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:08:58.721 INFO:tasks.workunit.client.0.smithi097.stderr: -78> 2024-09-14T11:08:58.629+0000 7efe1cd23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:08:58.721 INFO:tasks.workunit.client.0.smithi097.stderr: -77> 2024-09-14T11:08:58.629+0000 7efe1cd23800 20 zonegroup default 2024-09-14T11:08:58.721 INFO:tasks.workunit.client.0.smithi097.stderr: -76> 2024-09-14T11:08:58.629+0000 7efe1cd23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.721 INFO:tasks.workunit.client.0.smithi097.stderr: -75> 2024-09-14T11:08:58.629+0000 7efe1cd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:58.721 INFO:tasks.workunit.client.0.smithi097.stderr: -74> 2024-09-14T11:08:58.629+0000 7efe1cd23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.721 INFO:tasks.workunit.client.0.smithi097.stderr: -73> 2024-09-14T11:08:58.629+0000 7efe1cd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:58.722 INFO:tasks.workunit.client.0.smithi097.stderr: -72> 2024-09-14T11:08:58.629+0000 7efe1cd23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.722 INFO:tasks.workunit.client.0.smithi097.stderr: -71> 2024-09-14T11:08:58.630+0000 7efe1cd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:58.722 INFO:tasks.workunit.client.0.smithi097.stderr: -70> 2024-09-14T11:08:58.630+0000 7efe1cd23800 20 started sync module instance, tier type = 2024-09-14T11:08:58.722 INFO:tasks.workunit.client.0.smithi097.stderr: -69> 2024-09-14T11:08:58.630+0000 7efe1cd23800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:08:58.722 INFO:tasks.workunit.client.0.smithi097.stderr: -68> 2024-09-14T11:08:58.639+0000 7efe1cd23800 20 add_watcher() i=0 2024-09-14T11:08:58.722 INFO:tasks.workunit.client.0.smithi097.stderr: -67> 2024-09-14T11:08:58.639+0000 7efe1cd23800 20 add_watcher() i=1 2024-09-14T11:08:58.722 INFO:tasks.workunit.client.0.smithi097.stderr: -66> 2024-09-14T11:08:58.639+0000 7efe1cd23800 20 add_watcher() i=2 2024-09-14T11:08:58.722 INFO:tasks.workunit.client.0.smithi097.stderr: -65> 2024-09-14T11:08:58.639+0000 7efe1cd23800 20 add_watcher() i=3 2024-09-14T11:08:58.722 INFO:tasks.workunit.client.0.smithi097.stderr: -64> 2024-09-14T11:08:58.639+0000 7efe1cd23800 20 add_watcher() i=4 2024-09-14T11:08:58.722 INFO:tasks.workunit.client.0.smithi097.stderr: -63> 2024-09-14T11:08:58.639+0000 7efe1cd23800 20 add_watcher() i=5 2024-09-14T11:08:58.722 INFO:tasks.workunit.client.0.smithi097.stderr: -62> 2024-09-14T11:08:58.639+0000 7efe1cd23800 20 add_watcher() i=6 2024-09-14T11:08:58.722 INFO:tasks.workunit.client.0.smithi097.stderr: -61> 2024-09-14T11:08:58.640+0000 7efe1cd23800 20 add_watcher() i=7 2024-09-14T11:08:58.722 INFO:tasks.workunit.client.0.smithi097.stderr: -60> 2024-09-14T11:08:58.640+0000 7efe1cd23800 2 all 8 watchers are set, enabling cache 2024-09-14T11:08:58.722 INFO:tasks.workunit.client.0.smithi097.stderr: -59> 2024-09-14T11:08:58.642+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b181a80) adding auth protocol: cephx 2024-09-14T11:08:58.723 INFO:tasks.workunit.client.0.smithi097.stderr: -58> 2024-09-14T11:08:58.642+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b181a80) adding auth protocol: cephx 2024-09-14T11:08:58.723 INFO:tasks.workunit.client.0.smithi097.stderr: -57> 2024-09-14T11:08:58.642+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b181a80) adding auth protocol: cephx 2024-09-14T11:08:58.723 INFO:tasks.workunit.client.0.smithi097.stderr: -56> 2024-09-14T11:08:58.642+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b181a80) adding con mode: secure 2024-09-14T11:08:58.723 INFO:tasks.workunit.client.0.smithi097.stderr: -55> 2024-09-14T11:08:58.642+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b181a80) adding con mode: crc 2024-09-14T11:08:58.723 INFO:tasks.workunit.client.0.smithi097.stderr: -54> 2024-09-14T11:08:58.643+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b181a80) adding con mode: secure 2024-09-14T11:08:58.723 INFO:tasks.workunit.client.0.smithi097.stderr: -53> 2024-09-14T11:08:58.643+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b181a80) adding con mode: crc 2024-09-14T11:08:58.723 INFO:tasks.workunit.client.0.smithi097.stderr: -52> 2024-09-14T11:08:58.643+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b181a80) adding con mode: secure 2024-09-14T11:08:58.723 INFO:tasks.workunit.client.0.smithi097.stderr: -51> 2024-09-14T11:08:58.643+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b181a80) adding con mode: crc 2024-09-14T11:08:58.723 INFO:tasks.workunit.client.0.smithi097.stderr: -50> 2024-09-14T11:08:58.643+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b181a80) adding con mode: crc 2024-09-14T11:08:58.723 INFO:tasks.workunit.client.0.smithi097.stderr: -49> 2024-09-14T11:08:58.643+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b181a80) adding con mode: secure 2024-09-14T11:08:58.723 INFO:tasks.workunit.client.0.smithi097.stderr: -48> 2024-09-14T11:08:58.642+0000 7efccf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:08:58.723 INFO:tasks.workunit.client.0.smithi097.stderr: -47> 2024-09-14T11:08:58.643+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b181a80) adding con mode: crc 2024-09-14T11:08:58.723 INFO:tasks.workunit.client.0.smithi097.stderr: -46> 2024-09-14T11:08:58.643+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b181a80) adding con mode: secure 2024-09-14T11:08:58.723 INFO:tasks.workunit.client.0.smithi097.stderr: -45> 2024-09-14T11:08:58.643+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b181a80) adding con mode: crc 2024-09-14T11:08:58.724 INFO:tasks.workunit.client.0.smithi097.stderr: -44> 2024-09-14T11:08:58.643+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b181a80) adding con mode: secure 2024-09-14T11:08:58.724 INFO:tasks.workunit.client.0.smithi097.stderr: -43> 2024-09-14T11:08:58.643+0000 7efe1cd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:58.724 INFO:tasks.workunit.client.0.smithi097.stderr: -42> 2024-09-14T11:08:58.643+0000 7efe1cd23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:08:58.724 INFO:tasks.workunit.client.0.smithi097.stderr: -41> 2024-09-14T11:08:58.643+0000 7efe1cd23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:08:58.724 INFO:tasks.workunit.client.0.smithi097.stderr: -40> 2024-09-14T11:08:58.643+0000 7efe1cd23800 5 asok(0x55e4a9281270) register_command cache list hook 0x55e4a9576210 2024-09-14T11:08:58.724 INFO:tasks.workunit.client.0.smithi097.stderr: -39> 2024-09-14T11:08:58.643+0000 7efe1cd23800 5 asok(0x55e4a9281270) register_command cache inspect hook 0x55e4a9576210 2024-09-14T11:08:58.724 INFO:tasks.workunit.client.0.smithi097.stderr: -38> 2024-09-14T11:08:58.643+0000 7efe1cd23800 5 asok(0x55e4a9281270) register_command cache erase hook 0x55e4a9576210 2024-09-14T11:08:58.724 INFO:tasks.workunit.client.0.smithi097.stderr: -37> 2024-09-14T11:08:58.643+0000 7efe1cd23800 5 asok(0x55e4a9281270) register_command cache zap hook 0x55e4a9576210 2024-09-14T11:08:58.724 INFO:tasks.workunit.client.0.smithi097.stderr: -36> 2024-09-14T11:08:58.643+0000 7efe1cd23800 5 note: GC not initialized 2024-09-14T11:08:58.724 INFO:tasks.workunit.client.0.smithi097.stderr: -35> 2024-09-14T11:08:58.643+0000 7efcce7e4640 20 reqs_thread_entry: start 2024-09-14T11:08:58.724 INFO:tasks.workunit.client.0.smithi097.stderr: -34> 2024-09-14T11:08:58.643+0000 7efe1cd23800 5 asok(0x55e4a9281270) register_command sync trace show hook 0x7efe100044d0 2024-09-14T11:08:58.724 INFO:tasks.workunit.client.0.smithi097.stderr: -33> 2024-09-14T11:08:58.643+0000 7efe1cd23800 5 asok(0x55e4a9281270) register_command sync trace history hook 0x7efe100044d0 2024-09-14T11:08:58.724 INFO:tasks.workunit.client.0.smithi097.stderr: -32> 2024-09-14T11:08:58.643+0000 7efe1cd23800 5 asok(0x55e4a9281270) register_command sync trace active hook 0x7efe100044d0 2024-09-14T11:08:58.725 INFO:tasks.workunit.client.0.smithi097.stderr: -31> 2024-09-14T11:08:58.643+0000 7efe1cd23800 5 asok(0x55e4a9281270) register_command sync trace active_short hook 0x7efe100044d0 2024-09-14T11:08:58.725 INFO:tasks.workunit.client.0.smithi097.stderr: -30> 2024-09-14T11:08:58.643+0000 7efe1cd23800 20 init_complete bucket index max shards: 11 2024-09-14T11:08:58.725 INFO:tasks.workunit.client.0.smithi097.stderr: -29> 2024-09-14T11:08:58.643+0000 7efe1cd23800 20 Filter name: none 2024-09-14T11:08:58.725 INFO:tasks.workunit.client.0.smithi097.stderr: -28> 2024-09-14T11:08:58.643+0000 7efcc77fe640 20 reqs_thread_entry: start 2024-09-14T11:08:58.725 INFO:tasks.workunit.client.0.smithi097.stderr: -27> 2024-09-14T11:08:58.643+0000 7efe1cd23800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:08:58.725 INFO:tasks.workunit.client.0.smithi097.stderr: -26> 2024-09-14T11:08:58.643+0000 7efe1cd23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.725 INFO:tasks.workunit.client.0.smithi097.stderr: -25> 2024-09-14T11:08:58.644+0000 7efe1cd23800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:08:58.725 INFO:tasks.workunit.client.0.smithi097.stderr: -24> 2024-09-14T11:08:58.644+0000 7efe1cd23800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:08:58.725 INFO:tasks.workunit.client.0.smithi097.stderr: -23> 2024-09-14T11:08:58.644+0000 7efe1cd23800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:08:58.725 INFO:tasks.workunit.client.0.smithi097.stderr: -22> 2024-09-14T11:08:58.644+0000 7efe1cd23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 : miss 2024-09-14T11:08:58.725 INFO:tasks.workunit.client.0.smithi097.stderr: -21> 2024-09-14T11:08:58.644+0000 7efe1cd23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.725 INFO:tasks.workunit.client.0.smithi097.stderr: -20> 2024-09-14T11:08:58.644+0000 7efe1cd23800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:08:58.726 INFO:tasks.workunit.client.0.smithi097.stderr: -19> 2024-09-14T11:08:58.644+0000 7efe1cd23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:08:58.726 INFO:tasks.workunit.client.0.smithi097.stderr: -18> 2024-09-14T11:08:58.644+0000 7efe1cd23800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:08:58.726 INFO:tasks.workunit.client.0.smithi097.stderr: -17> 2024-09-14T11:08:58.644+0000 7efe1cd23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:08:58.726 INFO:tasks.workunit.client.0.smithi097.stderr: -16> 2024-09-14T11:08:58.644+0000 7efe1cd23800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:08:58.726 INFO:tasks.workunit.client.0.smithi097.stderr: -15> 2024-09-14T11:08:58.645+0000 7efe1cd23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 2024-09-14T11:08:58.726 INFO:tasks.workunit.client.0.smithi097.stderr: -14> 2024-09-14T11:08:58.646+0000 7efe1cd23800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:08:58.726 INFO:tasks.workunit.client.0.smithi097.stderr: -13> 2024-09-14T11:08:58.653+0000 7efe1cd23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:08:58.726 INFO:tasks.workunit.client.0.smithi097.stderr: -12> 2024-09-14T11:08:58.653+0000 7efe1cd23800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:08:58.726 INFO:tasks.workunit.client.0.smithi097.stderr: -11> 2024-09-14T11:08:58.653+0000 7efe1cd23800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:08:58.726 INFO:tasks.workunit.client.0.smithi097.stderr: -10> 2024-09-14T11:08:58.653+0000 7efe1cd23800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17, ofs0, ns] 2024-09-14T11:08:58.726 INFO:tasks.workunit.client.0.smithi097.stderr: -9> 2024-09-14T11:08:58.654+0000 7efceffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595247 cookie 94440582161072 notifier 7877 bl.length()=827 2024-09-14T11:08:58.726 INFO:tasks.workunit.client.0.smithi097.stderr: -8> 2024-09-14T11:08:58.654+0000 7efceffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:08:58.726 INFO:tasks.workunit.client.0.smithi097.stderr: -7> 2024-09-14T11:08:58.654+0000 7efceffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:08:58.726 INFO:tasks.workunit.client.0.smithi097.stderr: -6> 2024-09-14T11:08:58.654+0000 7efceffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:08:58.727 INFO:tasks.workunit.client.0.smithi097.stderr: -5> 2024-09-14T11:08:58.654+0000 7efe1cd23800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): orig_sources= new_sources= 2024-09-14T11:08:58.727 INFO:tasks.workunit.client.0.smithi097.stderr: -4> 2024-09-14T11:08:58.654+0000 7efe1cd23800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): potential sources added=[] removed=[] 2024-09-14T11:08:58.727 INFO:tasks.workunit.client.0.smithi097.stderr: -3> 2024-09-14T11:08:58.654+0000 7efe1cd23800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): orig_dests= new_dests= 2024-09-14T11:08:58.727 INFO:tasks.workunit.client.0.smithi097.stderr: -2> 2024-09-14T11:08:58.654+0000 7efe1cd23800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): potential dests added=[] removed=[] 2024-09-14T11:08:58.727 INFO:tasks.workunit.client.0.smithi097.stderr: -1> 2024-09-14T11:08:58.659+0000 7efe1cd23800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7efe1cd23800 time 2024-09-14T11:08:58.659762+0000 2024-09-14T11:08:58.727 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:08:58.727 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:58.727 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:08:58.727 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7efe1e38c76a] 2024-09-14T11:08:58.727 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7efe1e38c928] 2024-09-14T11:08:58.727 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e4a6d020b1] 2024-09-14T11:08:58.727 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55e4a6d11f6a] 2024-09-14T11:08:58.727 INFO:tasks.workunit.client.0.smithi097.stderr: 5: main() 2024-09-14T11:08:58.728 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7efe1d029590] 2024-09-14T11:08:58.728 INFO:tasks.workunit.client.0.smithi097.stderr: 7: __libc_start_main() 2024-09-14T11:08:58.728 INFO:tasks.workunit.client.0.smithi097.stderr: 8: _start() 2024-09-14T11:08:58.728 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:58.728 INFO:tasks.workunit.client.0.smithi097.stderr: 0> 2024-09-14T11:08:58.660+0000 7efe1cd23800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:08:58.728 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7efe1cd23800 thread_name:radosgw-admin 2024-09-14T11:08:58.728 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:58.728 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:08:58.728 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7efe1d03e6f0] 2024-09-14T11:08:58.728 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7efe1d08b99c] 2024-09-14T11:08:58.728 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-14T11:08:58.728 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-14T11:08:58.728 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7efe1e38c7c4] 2024-09-14T11:08:58.728 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7efe1e38c928] 2024-09-14T11:08:58.728 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e4a6d020b1] 2024-09-14T11:08:58.729 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55e4a6d11f6a] 2024-09-14T11:08:58.729 INFO:tasks.workunit.client.0.smithi097.stderr: 9: main() 2024-09-14T11:08:58.729 INFO:tasks.workunit.client.0.smithi097.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7efe1d029590] 2024-09-14T11:08:58.729 INFO:tasks.workunit.client.0.smithi097.stderr: 11: __libc_start_main() 2024-09-14T11:08:58.729 INFO:tasks.workunit.client.0.smithi097.stderr: 12: _start() 2024-09-14T11:08:58.729 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:08:58.729 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:58.729 INFO:tasks.workunit.client.0.smithi097.stderr:--- logging levels --- 2024-09-14T11:08:58.729 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 none 2024-09-14T11:08:58.729 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 lockdep 2024-09-14T11:08:58.729 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 context 2024-09-14T11:08:58.729 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 crush 2024-09-14T11:08:58.729 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds 2024-09-14T11:08:58.729 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_balancer 2024-09-14T11:08:58.730 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_locker 2024-09-14T11:08:58.730 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log 2024-09-14T11:08:58.730 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log_expire 2024-09-14T11:08:58.730 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_migrator 2024-09-14T11:08:58.730 INFO:tasks.workunit.client.0.smithi097.stderr: 3/ 5 mds_quiesce 2024-09-14T11:08:58.730 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 buffer 2024-09-14T11:08:58.730 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 timer 2024-09-14T11:08:58.730 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 filer 2024-09-14T11:08:58.730 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 striper 2024-09-14T11:08:58.730 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 objecter 2024-09-14T11:08:58.731 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rados 2024-09-14T11:08:58.731 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd 2024-09-14T11:08:58.731 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_mirror 2024-09-14T11:08:58.731 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_replay 2024-09-14T11:08:58.731 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_pwl 2024-09-14T11:08:58.731 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 journaler 2024-09-14T11:08:58.731 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objectcacher 2024-09-14T11:08:58.731 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:08:58.731 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 client 2024-09-14T11:08:58.731 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 osd 2024-09-14T11:08:58.731 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 optracker 2024-09-14T11:08:58.731 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objclass 2024-09-14T11:08:58.731 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 filestore 2024-09-14T11:08:58.732 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 journal 2024-09-14T11:08:58.732 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 ms 2024-09-14T11:08:58.732 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mon 2024-09-14T11:08:58.732 INFO:tasks.workunit.client.0.smithi097.stderr: 0/10 monc 2024-09-14T11:08:58.732 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 paxos 2024-09-14T11:08:58.732 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 tp 2024-09-14T11:08:58.732 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 auth 2024-09-14T11:08:58.732 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 crypto 2024-09-14T11:08:58.732 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 finisher 2024-09-14T11:08:58.732 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 reserver 2024-09-14T11:08:58.732 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 heartbeatmap 2024-09-14T11:08:58.732 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 perfcounter 2024-09-14T11:08:58.732 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw 2024-09-14T11:08:58.733 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_sync 2024-09-14T11:08:58.733 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_datacache 2024-09-14T11:08:58.733 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_access 2024-09-14T11:08:58.733 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:08:58.733 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_flight 2024-09-14T11:08:58.733 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:08:58.733 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw_notification 2024-09-14T11:08:58.733 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 javaclient 2024-09-14T11:08:58.733 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 asok 2024-09-14T11:08:58.733 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 throttle 2024-09-14T11:08:58.733 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 refs 2024-09-14T11:08:58.733 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 compressor 2024-09-14T11:08:58.733 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluestore 2024-09-14T11:08:58.733 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluefs 2024-09-14T11:08:58.734 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 bdev 2024-09-14T11:08:58.734 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 kstore 2024-09-14T11:08:58.734 INFO:tasks.workunit.client.0.smithi097.stderr: 4/ 5 rocksdb 2024-09-14T11:08:58.734 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 fuse 2024-09-14T11:08:58.734 INFO:tasks.workunit.client.0.smithi097.stderr: 2/ 5 mgr 2024-09-14T11:08:58.734 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mgrc 2024-09-14T11:08:58.734 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 dpdk 2024-09-14T11:08:58.734 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 eventtrace 2024-09-14T11:08:58.734 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 prioritycache 2024-09-14T11:08:58.734 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 test 2024-09-14T11:08:58.734 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:08:58.734 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephsqlite 2024-09-14T11:08:58.735 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:08:58.735 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore 2024-09-14T11:08:58.735 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_onode 2024-09-14T11:08:58.735 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_odata 2024-09-14T11:08:58.735 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_omap 2024-09-14T11:08:58.735 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_tm 2024-09-14T11:08:58.735 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_t 2024-09-14T11:08:58.735 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:08:58.735 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_epm 2024-09-14T11:08:58.735 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_lba 2024-09-14T11:08:58.735 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:08:58.735 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cache 2024-09-14T11:08:58.735 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_journal 2024-09-14T11:08:58.735 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_device 2024-09-14T11:08:58.736 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_backref 2024-09-14T11:08:58.736 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 alienstore 2024-09-14T11:08:58.736 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mclock 2024-09-14T11:08:58.736 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cyanstore 2024-09-14T11:08:58.736 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 ceph_exporter 2024-09-14T11:08:58.736 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 memstore 2024-09-14T11:08:58.736 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 trace 2024-09-14T11:08:58.736 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 ceph_dedup 2024-09-14T11:08:58.736 INFO:tasks.workunit.client.0.smithi097.stderr: -2/-2 (syslog threshold) 2024-09-14T11:08:58.736 INFO:tasks.workunit.client.0.smithi097.stderr: 99/99 (stderr threshold) 2024-09-14T11:08:58.736 INFO:tasks.workunit.client.0.smithi097.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:08:58.736 INFO:tasks.workunit.client.0.smithi097.stderr: 7efcc77fe640 / http_manager 2024-09-14T11:08:58.736 INFO:tasks.workunit.client.0.smithi097.stderr: 7efcce7e4640 / http_manager 2024-09-14T11:08:58.737 INFO:tasks.workunit.client.0.smithi097.stderr: 7efccf7e6640 / rgw_dt_lg_renew 2024-09-14T11:08:58.737 INFO:tasks.workunit.client.0.smithi097.stderr: 7efcee7fc640 / ms_dispatch 2024-09-14T11:08:58.737 INFO:tasks.workunit.client.0.smithi097.stderr: 7efceffff640 / io_context_pool 2024-09-14T11:08:58.737 INFO:tasks.workunit.client.0.smithi097.stderr: 7efcfe7fc640 / ms_dispatch 2024-09-14T11:08:58.737 INFO:tasks.workunit.client.0.smithi097.stderr: 7efd0560a640 / ms_dispatch 2024-09-14T11:08:58.737 INFO:tasks.workunit.client.0.smithi097.stderr: 7efd06e0d640 / io_context_pool 2024-09-14T11:08:58.737 INFO:tasks.workunit.client.0.smithi097.stderr: 7efe1820b640 / msgr-worker-2 2024-09-14T11:08:58.737 INFO:tasks.workunit.client.0.smithi097.stderr: 7efe18a0c640 / msgr-worker-1 2024-09-14T11:08:58.737 INFO:tasks.workunit.client.0.smithi097.stderr: 7efe1920d640 / msgr-worker-0 2024-09-14T11:08:58.737 INFO:tasks.workunit.client.0.smithi097.stderr: 7efe19a0e640 / io_context_pool 2024-09-14T11:08:58.737 INFO:tasks.workunit.client.0.smithi097.stderr: 7efe1cd23800 / radosgw-admin 2024-09-14T11:08:58.737 INFO:tasks.workunit.client.0.smithi097.stderr: max_recent 500 2024-09-14T11:08:58.737 INFO:tasks.workunit.client.0.smithi097.stderr: max_new 1000 2024-09-14T11:08:58.737 INFO:tasks.workunit.client.0.smithi097.stderr: log_file /var/log/ceph/ceph-client.admin.154563.log 2024-09-14T11:08:58.738 INFO:tasks.workunit.client.0.smithi097.stderr:--- end dump of recent events --- 2024-09-14T11:08:58.738 INFO:tasks.workunit.client.0.smithi097.stderr:--- begin dump of recent events --- 2024-09-14T11:08:58.738 INFO:tasks.workunit.client.0.smithi097.stderr: -499> 2024-09-14T11:08:58.393+0000 7efd06e0d640 10 monclient: handle_config config(0 keys) 2024-09-14T11:08:58.738 INFO:tasks.workunit.client.0.smithi097.stderr: -498> 2024-09-14T11:08:58.393+0000 7efd06e0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:08:58.738 INFO:tasks.workunit.client.0.smithi097.stderr: -497> 2024-09-14T11:08:58.393+0000 7efd06e0d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:08:58.738 INFO:tasks.workunit.client.0.smithi097.stderr: -496> 2024-09-14T11:08:58.393+0000 7efd06e0d640 10 monclient: dump: 2024-09-14T11:08:58.738 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:08:58.738 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:08:58.738 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:58.738 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:58.738 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:08:58.738 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:58.738 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:08:58.739 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:08:58.739 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:08:58.739 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:58.739 INFO:tasks.workunit.client.0.smithi097.stderr: -495> 2024-09-14T11:08:58.393+0000 7efe1cd23800 5 monclient: authenticate success, global_id 8394 2024-09-14T11:08:58.739 INFO:tasks.workunit.client.0.smithi097.stderr: -494> 2024-09-14T11:08:58.393+0000 7efe1cd23800 10 monclient: get_monmap_and_config success 2024-09-14T11:08:58.739 INFO:tasks.workunit.client.0.smithi097.stderr: -493> 2024-09-14T11:08:58.393+0000 7efe1cd23800 4 set_mon_vals no callback set 2024-09-14T11:08:58.739 INFO:tasks.workunit.client.0.smithi097.stderr: -492> 2024-09-14T11:08:58.394+0000 7efe1cd23800 10 monclient: shutdown 2024-09-14T11:08:58.739 INFO:tasks.workunit.client.0.smithi097.stderr: -491> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 asok(0x55e4a9281270) unregister_commands rotate-key 2024-09-14T11:08:58.739 INFO:tasks.workunit.client.0.smithi097.stderr: -490> 2024-09-14T11:08:58.394+0000 7efe1cd23800 10 monclient: build_initial_monmap 2024-09-14T11:08:58.739 INFO:tasks.workunit.client.0.smithi097.stderr: -489> 2024-09-14T11:08:58.394+0000 7efe1cd23800 1 build_initial for_mkfs: 0 2024-09-14T11:08:58.739 INFO:tasks.workunit.client.0.smithi097.stderr: -488> 2024-09-14T11:08:58.394+0000 7efe1cd23800 10 monclient: monmap: 2024-09-14T11:08:58.739 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:08:58.739 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:08:58.739 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:08:58.739 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:08:58.740 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:08:58.740 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:58.740 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:08:58.740 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:08:58.740 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:08:58.740 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:58.740 INFO:tasks.workunit.client.0.smithi097.stderr: -487> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a3840) adding auth protocol: cephx 2024-09-14T11:08:58.740 INFO:tasks.workunit.client.0.smithi097.stderr: -486> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a3840) adding auth protocol: cephx 2024-09-14T11:08:58.740 INFO:tasks.workunit.client.0.smithi097.stderr: -485> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a3840) adding auth protocol: cephx 2024-09-14T11:08:58.740 INFO:tasks.workunit.client.0.smithi097.stderr: -484> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a3840) adding con mode: secure 2024-09-14T11:08:58.740 INFO:tasks.workunit.client.0.smithi097.stderr: -483> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a3840) adding con mode: crc 2024-09-14T11:08:58.741 INFO:tasks.workunit.client.0.smithi097.stderr: -482> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a3840) adding con mode: secure 2024-09-14T11:08:58.741 INFO:tasks.workunit.client.0.smithi097.stderr: -481> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a3840) adding con mode: crc 2024-09-14T11:08:58.741 INFO:tasks.workunit.client.0.smithi097.stderr: -480> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a3840) adding con mode: secure 2024-09-14T11:08:58.741 INFO:tasks.workunit.client.0.smithi097.stderr: -479> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a3840) adding con mode: crc 2024-09-14T11:08:58.741 INFO:tasks.workunit.client.0.smithi097.stderr: -478> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a3840) adding con mode: crc 2024-09-14T11:08:58.741 INFO:tasks.workunit.client.0.smithi097.stderr: -477> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a3840) adding con mode: secure 2024-09-14T11:08:58.741 INFO:tasks.workunit.client.0.smithi097.stderr: -476> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a3840) adding con mode: crc 2024-09-14T11:08:58.741 INFO:tasks.workunit.client.0.smithi097.stderr: -475> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a3840) adding con mode: secure 2024-09-14T11:08:58.741 INFO:tasks.workunit.client.0.smithi097.stderr: -474> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a3840) adding con mode: crc 2024-09-14T11:08:58.741 INFO:tasks.workunit.client.0.smithi097.stderr: -473> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a3840) adding con mode: secure 2024-09-14T11:08:58.741 INFO:tasks.workunit.client.0.smithi097.stderr: -472> 2024-09-14T11:08:58.394+0000 7efe1cd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:58.741 INFO:tasks.workunit.client.0.smithi097.stderr: -471> 2024-09-14T11:08:58.394+0000 7efe1cd23800 1 librados: starting msgr at 2024-09-14T11:08:58.741 INFO:tasks.workunit.client.0.smithi097.stderr: -470> 2024-09-14T11:08:58.394+0000 7efe1cd23800 1 librados: starting objecter 2024-09-14T11:08:58.742 INFO:tasks.workunit.client.0.smithi097.stderr: -469> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 asok(0x55e4a9281270) register_command objecter_requests hook 0x55e4a94a6bb0 2024-09-14T11:08:58.742 INFO:tasks.workunit.client.0.smithi097.stderr: -468> 2024-09-14T11:08:58.394+0000 7efe1cd23800 1 librados: setting wanted keys 2024-09-14T11:08:58.742 INFO:tasks.workunit.client.0.smithi097.stderr: -467> 2024-09-14T11:08:58.394+0000 7efe1cd23800 1 librados: calling monclient init 2024-09-14T11:08:58.742 INFO:tasks.workunit.client.0.smithi097.stderr: -466> 2024-09-14T11:08:58.394+0000 7efe1cd23800 10 monclient: init 2024-09-14T11:08:58.742 INFO:tasks.workunit.client.0.smithi097.stderr: -465> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a01e0) adding auth protocol: cephx 2024-09-14T11:08:58.742 INFO:tasks.workunit.client.0.smithi097.stderr: -464> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a01e0) adding auth protocol: cephx 2024-09-14T11:08:58.742 INFO:tasks.workunit.client.0.smithi097.stderr: -463> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a01e0) adding auth protocol: cephx 2024-09-14T11:08:58.742 INFO:tasks.workunit.client.0.smithi097.stderr: -462> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a01e0) adding con mode: secure 2024-09-14T11:08:58.742 INFO:tasks.workunit.client.0.smithi097.stderr: -461> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a01e0) adding con mode: crc 2024-09-14T11:08:58.742 INFO:tasks.workunit.client.0.smithi097.stderr: -460> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a01e0) adding con mode: secure 2024-09-14T11:08:58.742 INFO:tasks.workunit.client.0.smithi097.stderr: -459> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a01e0) adding con mode: crc 2024-09-14T11:08:58.742 INFO:tasks.workunit.client.0.smithi097.stderr: -458> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a01e0) adding con mode: secure 2024-09-14T11:08:58.742 INFO:tasks.workunit.client.0.smithi097.stderr: -457> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a01e0) adding con mode: crc 2024-09-14T11:08:58.743 INFO:tasks.workunit.client.0.smithi097.stderr: -456> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a01e0) adding con mode: crc 2024-09-14T11:08:58.743 INFO:tasks.workunit.client.0.smithi097.stderr: -455> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a01e0) adding con mode: secure 2024-09-14T11:08:58.743 INFO:tasks.workunit.client.0.smithi097.stderr: -454> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a01e0) adding con mode: crc 2024-09-14T11:08:58.743 INFO:tasks.workunit.client.0.smithi097.stderr: -453> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a01e0) adding con mode: secure 2024-09-14T11:08:58.743 INFO:tasks.workunit.client.0.smithi097.stderr: -452> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a01e0) adding con mode: crc 2024-09-14T11:08:58.743 INFO:tasks.workunit.client.0.smithi097.stderr: -451> 2024-09-14T11:08:58.394+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94a01e0) adding con mode: secure 2024-09-14T11:08:58.743 INFO:tasks.workunit.client.0.smithi097.stderr: -450> 2024-09-14T11:08:58.395+0000 7efe1cd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:58.743 INFO:tasks.workunit.client.0.smithi097.stderr: -449> 2024-09-14T11:08:58.395+0000 7efe1cd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:58.743 INFO:tasks.workunit.client.0.smithi097.stderr: -448> 2024-09-14T11:08:58.395+0000 7efe1cd23800 5 asok(0x55e4a9281270) register_command rotate-key hook 0x55e4a94a0328 2024-09-14T11:08:58.743 INFO:tasks.workunit.client.0.smithi097.stderr: -447> 2024-09-14T11:08:58.395+0000 7efe1cd23800 10 monclient: _reopen_session rank -1 2024-09-14T11:08:58.743 INFO:tasks.workunit.client.0.smithi097.stderr: -446> 2024-09-14T11:08:58.395+0000 7efe1cd23800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:08:58.743 INFO:tasks.workunit.client.0.smithi097.stderr: -445> 2024-09-14T11:08:58.395+0000 7efe1cd23800 10 monclient(hunting): picked mon.noname-a con 0x55e4a934c760 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:08:58.743 INFO:tasks.workunit.client.0.smithi097.stderr: -444> 2024-09-14T11:08:58.395+0000 7efe1cd23800 10 monclient(hunting): picked mon.noname-b con 0x55e4a93559d0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:08:58.743 INFO:tasks.workunit.client.0.smithi097.stderr: -443> 2024-09-14T11:08:58.395+0000 7efe1cd23800 10 monclient(hunting): picked mon.noname-c con 0x55e4a9355e40 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:08:58.743 INFO:tasks.workunit.client.0.smithi097.stderr: -442> 2024-09-14T11:08:58.395+0000 7efe1cd23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:08:58.744 INFO:tasks.workunit.client.0.smithi097.stderr: -441> 2024-09-14T11:08:58.395+0000 7efe1cd23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:08:58.744 INFO:tasks.workunit.client.0.smithi097.stderr: -440> 2024-09-14T11:08:58.395+0000 7efe1cd23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:08:58.744 INFO:tasks.workunit.client.0.smithi097.stderr: -439> 2024-09-14T11:08:58.395+0000 7efe1cd23800 10 monclient(hunting): _renew_subs 2024-09-14T11:08:58.744 INFO:tasks.workunit.client.0.smithi097.stderr: -438> 2024-09-14T11:08:58.395+0000 7efe1cd23800 10 monclient(hunting): authenticate will time out at 2220.048483s 2024-09-14T11:08:58.744 INFO:tasks.workunit.client.0.smithi097.stderr: -437> 2024-09-14T11:08:58.395+0000 7efe18a0c640 10 monclient(hunting): get_auth_request con 0x55e4a934c760 auth_method 0 2024-09-14T11:08:58.744 INFO:tasks.workunit.client.0.smithi097.stderr: -436> 2024-09-14T11:08:58.395+0000 7efe18a0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:08:58.744 INFO:tasks.workunit.client.0.smithi097.stderr: -435> 2024-09-14T11:08:58.395+0000 7efe18a0c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:08:58.744 INFO:tasks.workunit.client.0.smithi097.stderr: -434> 2024-09-14T11:08:58.395+0000 7efe18a0c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:08:58.744 INFO:tasks.workunit.client.0.smithi097.stderr: -433> 2024-09-14T11:08:58.395+0000 7efe1920d640 10 monclient(hunting): get_auth_request con 0x55e4a9355e40 auth_method 0 2024-09-14T11:08:58.744 INFO:tasks.workunit.client.0.smithi097.stderr: -432> 2024-09-14T11:08:58.395+0000 7efe1920d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:08:58.744 INFO:tasks.workunit.client.0.smithi097.stderr: -431> 2024-09-14T11:08:58.395+0000 7efe1920d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:08:58.744 INFO:tasks.workunit.client.0.smithi097.stderr: -430> 2024-09-14T11:08:58.395+0000 7efe1920d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:08:58.744 INFO:tasks.workunit.client.0.smithi097.stderr: -429> 2024-09-14T11:08:58.395+0000 7efe18a0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:08:58.745 INFO:tasks.workunit.client.0.smithi097.stderr: -428> 2024-09-14T11:08:58.395+0000 7efe18a0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:08:58.745 INFO:tasks.workunit.client.0.smithi097.stderr: -427> 2024-09-14T11:08:58.395+0000 7efe18a0c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:08:58.745 INFO:tasks.workunit.client.0.smithi097.stderr: -426> 2024-09-14T11:08:58.395+0000 7efe1920d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:08:58.745 INFO:tasks.workunit.client.0.smithi097.stderr: -425> 2024-09-14T11:08:58.395+0000 7efe1920d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:08:58.745 INFO:tasks.workunit.client.0.smithi097.stderr: -424> 2024-09-14T11:08:58.395+0000 7efe1920d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:08:58.745 INFO:tasks.workunit.client.0.smithi097.stderr: -423> 2024-09-14T11:08:58.395+0000 7efe1820b640 10 monclient(hunting): get_auth_request con 0x55e4a93559d0 auth_method 0 2024-09-14T11:08:58.745 INFO:tasks.workunit.client.0.smithi097.stderr: -422> 2024-09-14T11:08:58.395+0000 7efe1820b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:08:58.745 INFO:tasks.workunit.client.0.smithi097.stderr: -421> 2024-09-14T11:08:58.395+0000 7efe1820b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:08:58.745 INFO:tasks.workunit.client.0.smithi097.stderr: -420> 2024-09-14T11:08:58.395+0000 7efe1820b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:08:58.745 INFO:tasks.workunit.client.0.smithi097.stderr: -419> 2024-09-14T11:08:58.395+0000 7efe1920d640 10 monclient(hunting): handle_auth_done global_id 7868 payload 824 2024-09-14T11:08:58.745 INFO:tasks.workunit.client.0.smithi097.stderr: -418> 2024-09-14T11:08:58.395+0000 7efe1920d640 10 monclient: _finish_hunting 0 2024-09-14T11:08:58.745 INFO:tasks.workunit.client.0.smithi097.stderr: -417> 2024-09-14T11:08:58.395+0000 7efe1920d640 1 monclient: found mon.noname-c 2024-09-14T11:08:58.745 INFO:tasks.workunit.client.0.smithi097.stderr: -416> 2024-09-14T11:08:58.395+0000 7efe1920d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:08:58.746 INFO:tasks.workunit.client.0.smithi097.stderr: -415> 2024-09-14T11:08:58.396+0000 7efd0560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:08:58.746 INFO:tasks.workunit.client.0.smithi097.stderr: -414> 2024-09-14T11:08:58.396+0000 7efd0560a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:08:58.746 INFO:tasks.workunit.client.0.smithi097.stderr: -413> 2024-09-14T11:08:58.396+0000 7efd0560a640 10 monclient: dump: 2024-09-14T11:08:58.746 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:08:58.746 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:08:58.746 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:58.746 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:58.746 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:08:58.746 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:58.746 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:08:58.746 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:08:58.746 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:08:58.746 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:58.746 INFO:tasks.workunit.client.0.smithi097.stderr: -412> 2024-09-14T11:08:58.396+0000 7efd0560a640 10 monclient: _finish_auth 0 2024-09-14T11:08:58.747 INFO:tasks.workunit.client.0.smithi097.stderr: -411> 2024-09-14T11:08:58.396+0000 7efd0560a640 10 monclient: _check_auth_tickets 2024-09-14T11:08:58.747 INFO:tasks.workunit.client.0.smithi097.stderr: -410> 2024-09-14T11:08:58.396+0000 7efd0560a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:08:58.747 INFO:tasks.workunit.client.0.smithi097.stderr: -409> 2024-09-14T11:08:58.396+0000 7efd0560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:08:58.747 INFO:tasks.workunit.client.0.smithi097.stderr: -408> 2024-09-14T11:08:58.396+0000 7efd0560a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:08:58.747 INFO:tasks.workunit.client.0.smithi097.stderr: -407> 2024-09-14T11:08:58.396+0000 7efd0560a640 10 monclient: dump: 2024-09-14T11:08:58.747 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:08:58.747 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:08:58.747 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:58.747 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:58.747 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:08:58.747 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:58.747 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:08:58.747 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:08:58.748 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:08:58.748 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:58.748 INFO:tasks.workunit.client.0.smithi097.stderr: -406> 2024-09-14T11:08:58.396+0000 7efe1cd23800 5 monclient: authenticate success, global_id 7868 2024-09-14T11:08:58.748 INFO:tasks.workunit.client.0.smithi097.stderr: -405> 2024-09-14T11:08:58.396+0000 7efe1cd23800 10 monclient: _renew_subs 2024-09-14T11:08:58.748 INFO:tasks.workunit.client.0.smithi097.stderr: -404> 2024-09-14T11:08:58.396+0000 7efd06e0d640 4 set_mon_vals no callback set 2024-09-14T11:08:58.748 INFO:tasks.workunit.client.0.smithi097.stderr: -403> 2024-09-14T11:08:58.396+0000 7efe1cd23800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:08:58.748 INFO:tasks.workunit.client.0.smithi097.stderr: -402> 2024-09-14T11:08:58.396+0000 7efe1cd23800 10 monclient: _renew_subs 2024-09-14T11:08:58.748 INFO:tasks.workunit.client.0.smithi097.stderr: -401> 2024-09-14T11:08:58.396+0000 7efe1cd23800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:08:58.748 INFO:tasks.workunit.client.0.smithi097.stderr: -400> 2024-09-14T11:08:58.396+0000 7efe1cd23800 1 librados: init done 2024-09-14T11:08:58.748 INFO:tasks.workunit.client.0.smithi097.stderr: -399> 2024-09-14T11:08:58.398+0000 7efd0560a640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:08:58.748 INFO:tasks.workunit.client.0.smithi097.stderr: -398> 2024-09-14T11:08:58.398+0000 7efd0560a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:08:58.748 INFO:tasks.workunit.client.0.smithi097.stderr: -397> 2024-09-14T11:08:58.398+0000 7efd0560a640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:08:58.748 INFO:tasks.workunit.client.0.smithi097.stderr: -396> 2024-09-14T11:08:58.398+0000 7efe18a0c640 10 monclient: get_auth_request con 0x7efd00077230 auth_method 0 2024-09-14T11:08:58.748 INFO:tasks.workunit.client.0.smithi097.stderr: -395> 2024-09-14T11:08:58.398+0000 7efe1820b640 10 monclient: get_auth_request con 0x55e4a94c8ff0 auth_method 0 2024-09-14T11:08:58.749 INFO:tasks.workunit.client.0.smithi097.stderr: -394> 2024-09-14T11:08:58.399+0000 7efe18a0c640 10 monclient: get_auth_request con 0x55e4a94eb7c0 auth_method 0 2024-09-14T11:08:58.749 INFO:tasks.workunit.client.0.smithi097.stderr: -393> 2024-09-14T11:08:58.400+0000 7efe1820b640 10 monclient: get_auth_request con 0x55e4a94eff10 auth_method 0 2024-09-14T11:08:58.749 INFO:tasks.workunit.client.0.smithi097.stderr: -392> 2024-09-14T11:08:58.401+0000 7efe1920d640 10 monclient: get_auth_request con 0x55e4a94f3e30 auth_method 0 2024-09-14T11:08:58.749 INFO:tasks.workunit.client.0.smithi097.stderr: -391> 2024-09-14T11:08:58.402+0000 7efe1cd23800 10 monclient: build_initial_monmap 2024-09-14T11:08:58.749 INFO:tasks.workunit.client.0.smithi097.stderr: -390> 2024-09-14T11:08:58.402+0000 7efe1cd23800 1 build_initial for_mkfs: 0 2024-09-14T11:08:58.749 INFO:tasks.workunit.client.0.smithi097.stderr: -389> 2024-09-14T11:08:58.402+0000 7efe1cd23800 10 monclient: monmap: 2024-09-14T11:08:58.749 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:08:58.749 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:08:58.749 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:08:58.749 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:08:58.749 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:08:58.749 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:58.749 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:08:58.749 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:08:58.750 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:08:58.750 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:58.750 INFO:tasks.workunit.client.0.smithi097.stderr: -388> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f7f60) adding auth protocol: cephx 2024-09-14T11:08:58.750 INFO:tasks.workunit.client.0.smithi097.stderr: -387> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f7f60) adding auth protocol: cephx 2024-09-14T11:08:58.750 INFO:tasks.workunit.client.0.smithi097.stderr: -386> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f7f60) adding auth protocol: cephx 2024-09-14T11:08:58.750 INFO:tasks.workunit.client.0.smithi097.stderr: -385> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f7f60) adding con mode: secure 2024-09-14T11:08:58.750 INFO:tasks.workunit.client.0.smithi097.stderr: -384> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f7f60) adding con mode: crc 2024-09-14T11:08:58.750 INFO:tasks.workunit.client.0.smithi097.stderr: -383> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f7f60) adding con mode: secure 2024-09-14T11:08:58.750 INFO:tasks.workunit.client.0.smithi097.stderr: -382> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f7f60) adding con mode: crc 2024-09-14T11:08:58.750 INFO:tasks.workunit.client.0.smithi097.stderr: -381> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f7f60) adding con mode: secure 2024-09-14T11:08:58.750 INFO:tasks.workunit.client.0.smithi097.stderr: -380> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f7f60) adding con mode: crc 2024-09-14T11:08:58.750 INFO:tasks.workunit.client.0.smithi097.stderr: -379> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f7f60) adding con mode: crc 2024-09-14T11:08:58.750 INFO:tasks.workunit.client.0.smithi097.stderr: -378> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f7f60) adding con mode: secure 2024-09-14T11:08:58.751 INFO:tasks.workunit.client.0.smithi097.stderr: -377> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f7f60) adding con mode: crc 2024-09-14T11:08:58.751 INFO:tasks.workunit.client.0.smithi097.stderr: -376> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f7f60) adding con mode: secure 2024-09-14T11:08:58.751 INFO:tasks.workunit.client.0.smithi097.stderr: -375> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f7f60) adding con mode: crc 2024-09-14T11:08:58.751 INFO:tasks.workunit.client.0.smithi097.stderr: -374> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f7f60) adding con mode: secure 2024-09-14T11:08:58.751 INFO:tasks.workunit.client.0.smithi097.stderr: -373> 2024-09-14T11:08:58.402+0000 7efe1cd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:58.751 INFO:tasks.workunit.client.0.smithi097.stderr: -372> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 asok(0x55e4a9281270) register_command objecter_requests cmddesc objecter_requests hook 0x55e4a94fb450 EEXIST 2024-09-14T11:08:58.751 INFO:tasks.workunit.client.0.smithi097.stderr: -371> 2024-09-14T11:08:58.402+0000 7efe1cd23800 10 monclient: init 2024-09-14T11:08:58.751 INFO:tasks.workunit.client.0.smithi097.stderr: -370> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f6e58) adding auth protocol: cephx 2024-09-14T11:08:58.751 INFO:tasks.workunit.client.0.smithi097.stderr: -369> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f6e58) adding auth protocol: cephx 2024-09-14T11:08:58.751 INFO:tasks.workunit.client.0.smithi097.stderr: -368> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f6e58) adding auth protocol: cephx 2024-09-14T11:08:58.751 INFO:tasks.workunit.client.0.smithi097.stderr: -367> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f6e58) adding con mode: secure 2024-09-14T11:08:58.751 INFO:tasks.workunit.client.0.smithi097.stderr: -366> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f6e58) adding con mode: crc 2024-09-14T11:08:58.751 INFO:tasks.workunit.client.0.smithi097.stderr: -365> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f6e58) adding con mode: secure 2024-09-14T11:08:58.752 INFO:tasks.workunit.client.0.smithi097.stderr: -364> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f6e58) adding con mode: crc 2024-09-14T11:08:58.752 INFO:tasks.workunit.client.0.smithi097.stderr: -363> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f6e58) adding con mode: secure 2024-09-14T11:08:58.752 INFO:tasks.workunit.client.0.smithi097.stderr: -362> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f6e58) adding con mode: crc 2024-09-14T11:08:58.752 INFO:tasks.workunit.client.0.smithi097.stderr: -361> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f6e58) adding con mode: crc 2024-09-14T11:08:58.752 INFO:tasks.workunit.client.0.smithi097.stderr: -360> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f6e58) adding con mode: secure 2024-09-14T11:08:58.752 INFO:tasks.workunit.client.0.smithi097.stderr: -359> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f6e58) adding con mode: crc 2024-09-14T11:08:58.752 INFO:tasks.workunit.client.0.smithi097.stderr: -358> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f6e58) adding con mode: secure 2024-09-14T11:08:58.752 INFO:tasks.workunit.client.0.smithi097.stderr: -357> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f6e58) adding con mode: crc 2024-09-14T11:08:58.752 INFO:tasks.workunit.client.0.smithi097.stderr: -356> 2024-09-14T11:08:58.402+0000 7efe1cd23800 5 AuthRegistry(0x55e4a94f6e58) adding con mode: secure 2024-09-14T11:08:58.752 INFO:tasks.workunit.client.0.smithi097.stderr: -355> 2024-09-14T11:08:58.402+0000 7efe1cd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:58.752 INFO:tasks.workunit.client.0.smithi097.stderr: -354> 2024-09-14T11:08:58.403+0000 7efe1cd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:58.752 INFO:tasks.workunit.client.0.smithi097.stderr: -353> 2024-09-14T11:08:58.403+0000 7efe1cd23800 5 asok(0x55e4a9281270) register_command rotate-key cmddesc rotate-key hook 0x55e4a94f6fa0 EEXIST 2024-09-14T11:08:58.752 INFO:tasks.workunit.client.0.smithi097.stderr: -352> 2024-09-14T11:08:58.403+0000 7efe1cd23800 10 monclient: _reopen_session rank -1 2024-09-14T11:08:58.753 INFO:tasks.workunit.client.0.smithi097.stderr: -351> 2024-09-14T11:08:58.403+0000 7efe1cd23800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:08:58.753 INFO:tasks.workunit.client.0.smithi097.stderr: -350> 2024-09-14T11:08:58.403+0000 7efe1cd23800 10 monclient(hunting): picked mon.noname-c con 0x55e4a951f770 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:08:58.753 INFO:tasks.workunit.client.0.smithi097.stderr: -349> 2024-09-14T11:08:58.403+0000 7efe1cd23800 10 monclient(hunting): picked mon.noname-a con 0x55e4a951fb50 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:08:58.753 INFO:tasks.workunit.client.0.smithi097.stderr: -348> 2024-09-14T11:08:58.403+0000 7efe1cd23800 10 monclient(hunting): picked mon.noname-b con 0x55e4a951e480 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:08:58.753 INFO:tasks.workunit.client.0.smithi097.stderr: -347> 2024-09-14T11:08:58.403+0000 7efe1cd23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:08:58.753 INFO:tasks.workunit.client.0.smithi097.stderr: -346> 2024-09-14T11:08:58.403+0000 7efe1cd23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:08:58.753 INFO:tasks.workunit.client.0.smithi097.stderr: -345> 2024-09-14T11:08:58.403+0000 7efe1cd23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:08:58.753 INFO:tasks.workunit.client.0.smithi097.stderr: -344> 2024-09-14T11:08:58.403+0000 7efe1cd23800 10 monclient(hunting): _renew_subs 2024-09-14T11:08:58.753 INFO:tasks.workunit.client.0.smithi097.stderr: -343> 2024-09-14T11:08:58.403+0000 7efe1cd23800 10 monclient(hunting): authenticate will time out at 2220.056244s 2024-09-14T11:08:58.753 INFO:tasks.workunit.client.0.smithi097.stderr: -342> 2024-09-14T11:08:58.403+0000 7efe1820b640 10 monclient(hunting): get_auth_request con 0x55e4a951f770 auth_method 0 2024-09-14T11:08:58.753 INFO:tasks.workunit.client.0.smithi097.stderr: -341> 2024-09-14T11:08:58.403+0000 7efe1820b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:08:58.753 INFO:tasks.workunit.client.0.smithi097.stderr: -340> 2024-09-14T11:08:58.403+0000 7efe1820b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:08:58.753 INFO:tasks.workunit.client.0.smithi097.stderr: -339> 2024-09-14T11:08:58.403+0000 7efe1820b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:08:58.754 INFO:tasks.workunit.client.0.smithi097.stderr: -338> 2024-09-14T11:08:58.403+0000 7efe1920d640 10 monclient(hunting): get_auth_request con 0x55e4a951fb50 auth_method 0 2024-09-14T11:08:58.754 INFO:tasks.workunit.client.0.smithi097.stderr: -337> 2024-09-14T11:08:58.403+0000 7efe1920d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:08:58.754 INFO:tasks.workunit.client.0.smithi097.stderr: -336> 2024-09-14T11:08:58.403+0000 7efe1920d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:08:58.754 INFO:tasks.workunit.client.0.smithi097.stderr: -335> 2024-09-14T11:08:58.403+0000 7efe1920d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:08:58.754 INFO:tasks.workunit.client.0.smithi097.stderr: -334> 2024-09-14T11:08:58.403+0000 7efe1820b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:08:58.754 INFO:tasks.workunit.client.0.smithi097.stderr: -333> 2024-09-14T11:08:58.403+0000 7efe1820b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:08:58.754 INFO:tasks.workunit.client.0.smithi097.stderr: -332> 2024-09-14T11:08:58.403+0000 7efe1820b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:08:58.754 INFO:tasks.workunit.client.0.smithi097.stderr: -331> 2024-09-14T11:08:58.403+0000 7efe1920d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:08:58.754 INFO:tasks.workunit.client.0.smithi097.stderr: -330> 2024-09-14T11:08:58.403+0000 7efe1920d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:08:58.754 INFO:tasks.workunit.client.0.smithi097.stderr: -329> 2024-09-14T11:08:58.403+0000 7efe1920d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:08:58.754 INFO:tasks.workunit.client.0.smithi097.stderr: -328> 2024-09-14T11:08:58.403+0000 7efe18a0c640 10 monclient(hunting): get_auth_request con 0x55e4a951e480 auth_method 0 2024-09-14T11:08:58.754 INFO:tasks.workunit.client.0.smithi097.stderr: -327> 2024-09-14T11:08:58.403+0000 7efe18a0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:08:58.754 INFO:tasks.workunit.client.0.smithi097.stderr: -326> 2024-09-14T11:08:58.403+0000 7efe18a0c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:08:58.754 INFO:tasks.workunit.client.0.smithi097.stderr: -325> 2024-09-14T11:08:58.403+0000 7efe18a0c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:08:58.755 INFO:tasks.workunit.client.0.smithi097.stderr: -324> 2024-09-14T11:08:58.403+0000 7efe18a0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:08:58.755 INFO:tasks.workunit.client.0.smithi097.stderr: -323> 2024-09-14T11:08:58.403+0000 7efe18a0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:08:58.755 INFO:tasks.workunit.client.0.smithi097.stderr: -322> 2024-09-14T11:08:58.403+0000 7efe18a0c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:08:58.755 INFO:tasks.workunit.client.0.smithi097.stderr: -321> 2024-09-14T11:08:58.403+0000 7efe1820b640 10 monclient(hunting): handle_auth_done global_id 7871 payload 824 2024-09-14T11:08:58.755 INFO:tasks.workunit.client.0.smithi097.stderr: -320> 2024-09-14T11:08:58.403+0000 7efe1820b640 10 monclient: _finish_hunting 0 2024-09-14T11:08:58.755 INFO:tasks.workunit.client.0.smithi097.stderr: -319> 2024-09-14T11:08:58.403+0000 7efe1820b640 1 monclient: found mon.noname-c 2024-09-14T11:08:58.755 INFO:tasks.workunit.client.0.smithi097.stderr: -318> 2024-09-14T11:08:58.403+0000 7efe1820b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:08:58.755 INFO:tasks.workunit.client.0.smithi097.stderr: -317> 2024-09-14T11:08:58.403+0000 7efcfe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:08:58.755 INFO:tasks.workunit.client.0.smithi097.stderr: -316> 2024-09-14T11:08:58.403+0000 7efcfe7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:08:58.755 INFO:tasks.workunit.client.0.smithi097.stderr: -315> 2024-09-14T11:08:58.403+0000 7efcfe7fc640 10 monclient: dump: 2024-09-14T11:08:58.755 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:08:58.755 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:08:58.755 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:58.756 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:58.756 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:08:58.756 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:58.756 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:08:58.756 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:08:58.756 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:08:58.756 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:58.756 INFO:tasks.workunit.client.0.smithi097.stderr: -314> 2024-09-14T11:08:58.403+0000 7efcfe7fc640 10 monclient: _finish_auth 0 2024-09-14T11:08:58.756 INFO:tasks.workunit.client.0.smithi097.stderr: -313> 2024-09-14T11:08:58.403+0000 7efcfe7fc640 10 monclient: _check_auth_tickets 2024-09-14T11:08:58.756 INFO:tasks.workunit.client.0.smithi097.stderr: -312> 2024-09-14T11:08:58.403+0000 7efe1cd23800 5 monclient: authenticate success, global_id 7871 2024-09-14T11:08:58.756 INFO:tasks.workunit.client.0.smithi097.stderr: -311> 2024-09-14T11:08:58.403+0000 7efe1cd23800 10 monclient: _renew_subs 2024-09-14T11:08:58.756 INFO:tasks.workunit.client.0.smithi097.stderr: -310> 2024-09-14T11:08:58.403+0000 7efe1cd23800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:08:58.756 INFO:tasks.workunit.client.0.smithi097.stderr: -309> 2024-09-14T11:08:58.403+0000 7efcfe7fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:08:58.757 INFO:tasks.workunit.client.0.smithi097.stderr: -308> 2024-09-14T11:08:58.403+0000 7efcfe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:08:58.757 INFO:tasks.workunit.client.0.smithi097.stderr: -307> 2024-09-14T11:08:58.403+0000 7efcfe7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:08:58.757 INFO:tasks.workunit.client.0.smithi097.stderr: -306> 2024-09-14T11:08:58.403+0000 7efcfe7fc640 10 monclient: dump: 2024-09-14T11:08:58.757 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:08:58.757 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:08:58.757 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:58.757 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:58.757 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:08:58.757 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:58.757 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:08:58.757 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:08:58.757 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:08:58.757 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:58.757 INFO:tasks.workunit.client.0.smithi097.stderr: -305> 2024-09-14T11:08:58.403+0000 7efe19a0e640 4 set_mon_vals no callback set 2024-09-14T11:08:58.758 INFO:tasks.workunit.client.0.smithi097.stderr: -304> 2024-09-14T11:08:58.404+0000 7efe1cd23800 10 monclient: _renew_subs 2024-09-14T11:08:58.758 INFO:tasks.workunit.client.0.smithi097.stderr: -303> 2024-09-14T11:08:58.404+0000 7efe1cd23800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:08:58.758 INFO:tasks.workunit.client.0.smithi097.stderr: -302> 2024-09-14T11:08:58.405+0000 7efcfe7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:08:58.758 INFO:tasks.workunit.client.0.smithi097.stderr: -301> 2024-09-14T11:08:58.405+0000 7efcfe7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:08:58.758 INFO:tasks.workunit.client.0.smithi097.stderr: -300> 2024-09-14T11:08:58.405+0000 7efcfe7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:08:58.758 INFO:tasks.workunit.client.0.smithi097.stderr: -299> 2024-09-14T11:08:58.405+0000 7efe1920d640 10 monclient: get_auth_request con 0x7efcf0077140 auth_method 0 2024-09-14T11:08:58.758 INFO:tasks.workunit.client.0.smithi097.stderr: -298> 2024-09-14T11:08:58.406+0000 7efe1cd23800 10 monclient: get_monmap_and_config 2024-09-14T11:08:58.758 INFO:tasks.workunit.client.0.smithi097.stderr: -297> 2024-09-14T11:08:58.406+0000 7efe1cd23800 10 monclient: build_initial_monmap 2024-09-14T11:08:58.758 INFO:tasks.workunit.client.0.smithi097.stderr: -296> 2024-09-14T11:08:58.406+0000 7efe1cd23800 1 build_initial for_mkfs: 0 2024-09-14T11:08:58.758 INFO:tasks.workunit.client.0.smithi097.stderr: -295> 2024-09-14T11:08:58.406+0000 7efe1cd23800 10 monclient: monmap: 2024-09-14T11:08:58.758 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:08:58.758 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:08:58.758 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:08:58.758 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:08:58.759 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:08:58.759 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:58.759 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:08:58.759 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:08:58.759 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:08:58.759 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:58.759 INFO:tasks.workunit.client.0.smithi097.stderr: -294> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x55e4a953f690) adding auth protocol: cephx 2024-09-14T11:08:58.759 INFO:tasks.workunit.client.0.smithi097.stderr: -293> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x55e4a953f690) adding auth protocol: cephx 2024-09-14T11:08:58.759 INFO:tasks.workunit.client.0.smithi097.stderr: -292> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x55e4a953f690) adding auth protocol: cephx 2024-09-14T11:08:58.759 INFO:tasks.workunit.client.0.smithi097.stderr: -291> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x55e4a953f690) adding con mode: secure 2024-09-14T11:08:58.759 INFO:tasks.workunit.client.0.smithi097.stderr: -290> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x55e4a953f690) adding con mode: crc 2024-09-14T11:08:58.759 INFO:tasks.workunit.client.0.smithi097.stderr: -289> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x55e4a953f690) adding con mode: secure 2024-09-14T11:08:58.759 INFO:tasks.workunit.client.0.smithi097.stderr: -288> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x55e4a953f690) adding con mode: crc 2024-09-14T11:08:58.759 INFO:tasks.workunit.client.0.smithi097.stderr: -287> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x55e4a953f690) adding con mode: secure 2024-09-14T11:08:58.760 INFO:tasks.workunit.client.0.smithi097.stderr: -286> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x55e4a953f690) adding con mode: crc 2024-09-14T11:08:58.760 INFO:tasks.workunit.client.0.smithi097.stderr: -285> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x55e4a953f690) adding con mode: crc 2024-09-14T11:08:58.760 INFO:tasks.workunit.client.0.smithi097.stderr: -284> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x55e4a953f690) adding con mode: secure 2024-09-14T11:08:58.760 INFO:tasks.workunit.client.0.smithi097.stderr: -283> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x55e4a953f690) adding con mode: crc 2024-09-14T11:08:58.760 INFO:tasks.workunit.client.0.smithi097.stderr: -282> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x55e4a953f690) adding con mode: secure 2024-09-14T11:08:58.760 INFO:tasks.workunit.client.0.smithi097.stderr: -281> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x55e4a953f690) adding con mode: crc 2024-09-14T11:08:58.760 INFO:tasks.workunit.client.0.smithi097.stderr: -280> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x55e4a953f690) adding con mode: secure 2024-09-14T11:08:58.760 INFO:tasks.workunit.client.0.smithi097.stderr: -279> 2024-09-14T11:08:58.406+0000 7efe1cd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:58.760 INFO:tasks.workunit.client.0.smithi097.stderr: -278> 2024-09-14T11:08:58.406+0000 7efe1cd23800 10 monclient: init 2024-09-14T11:08:58.760 INFO:tasks.workunit.client.0.smithi097.stderr: -277> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b1815a0) adding auth protocol: cephx 2024-09-14T11:08:58.760 INFO:tasks.workunit.client.0.smithi097.stderr: -276> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b1815a0) adding auth protocol: cephx 2024-09-14T11:08:58.760 INFO:tasks.workunit.client.0.smithi097.stderr: -275> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b1815a0) adding auth protocol: cephx 2024-09-14T11:08:58.760 INFO:tasks.workunit.client.0.smithi097.stderr: -274> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b1815a0) adding con mode: secure 2024-09-14T11:08:58.761 INFO:tasks.workunit.client.0.smithi097.stderr: -273> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b1815a0) adding con mode: crc 2024-09-14T11:08:58.761 INFO:tasks.workunit.client.0.smithi097.stderr: -272> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b1815a0) adding con mode: secure 2024-09-14T11:08:58.761 INFO:tasks.workunit.client.0.smithi097.stderr: -271> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b1815a0) adding con mode: crc 2024-09-14T11:08:58.761 INFO:tasks.workunit.client.0.smithi097.stderr: -270> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b1815a0) adding con mode: secure 2024-09-14T11:08:58.761 INFO:tasks.workunit.client.0.smithi097.stderr: -269> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b1815a0) adding con mode: crc 2024-09-14T11:08:58.761 INFO:tasks.workunit.client.0.smithi097.stderr: -268> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b1815a0) adding con mode: crc 2024-09-14T11:08:58.761 INFO:tasks.workunit.client.0.smithi097.stderr: -267> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b1815a0) adding con mode: secure 2024-09-14T11:08:58.761 INFO:tasks.workunit.client.0.smithi097.stderr: -266> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b1815a0) adding con mode: crc 2024-09-14T11:08:58.761 INFO:tasks.workunit.client.0.smithi097.stderr: -265> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b1815a0) adding con mode: secure 2024-09-14T11:08:58.761 INFO:tasks.workunit.client.0.smithi097.stderr: -264> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b1815a0) adding con mode: crc 2024-09-14T11:08:58.761 INFO:tasks.workunit.client.0.smithi097.stderr: -263> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b1815a0) adding con mode: secure 2024-09-14T11:08:58.761 INFO:tasks.workunit.client.0.smithi097.stderr: -262> 2024-09-14T11:08:58.406+0000 7efe1cd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:58.761 INFO:tasks.workunit.client.0.smithi097.stderr: -261> 2024-09-14T11:08:58.406+0000 7efe1cd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:58.762 INFO:tasks.workunit.client.0.smithi097.stderr: -260> 2024-09-14T11:08:58.406+0000 7efe1cd23800 5 asok(0x55e4a9281270) register_command rotate-key cmddesc rotate-key hook 0x7ffc4b1816e8 EEXIST 2024-09-14T11:08:58.762 INFO:tasks.workunit.client.0.smithi097.stderr: -259> 2024-09-14T11:08:58.407+0000 7efe1cd23800 10 monclient: _reopen_session rank -1 2024-09-14T11:08:58.762 INFO:tasks.workunit.client.0.smithi097.stderr: -258> 2024-09-14T11:08:58.407+0000 7efe1cd23800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:08:58.762 INFO:tasks.workunit.client.0.smithi097.stderr: -257> 2024-09-14T11:08:58.407+0000 7efe1cd23800 10 monclient(hunting): picked mon.noname-b con 0x55e4a956d180 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:08:58.762 INFO:tasks.workunit.client.0.smithi097.stderr: -256> 2024-09-14T11:08:58.407+0000 7efe1cd23800 10 monclient(hunting): picked mon.noname-c con 0x55e4a9565c20 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:08:58.762 INFO:tasks.workunit.client.0.smithi097.stderr: -255> 2024-09-14T11:08:58.407+0000 7efe1cd23800 10 monclient(hunting): picked mon.noname-a con 0x55e4a9540ef0 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:08:58.762 INFO:tasks.workunit.client.0.smithi097.stderr: -254> 2024-09-14T11:08:58.407+0000 7efe1cd23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:08:58.762 INFO:tasks.workunit.client.0.smithi097.stderr: -253> 2024-09-14T11:08:58.407+0000 7efe1cd23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:08:58.762 INFO:tasks.workunit.client.0.smithi097.stderr: -252> 2024-09-14T11:08:58.407+0000 7efe1cd23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:08:58.762 INFO:tasks.workunit.client.0.smithi097.stderr: -251> 2024-09-14T11:08:58.407+0000 7efe1cd23800 10 monclient(hunting): _renew_subs 2024-09-14T11:08:58.762 INFO:tasks.workunit.client.0.smithi097.stderr: -250> 2024-09-14T11:08:58.407+0000 7efe1cd23800 10 monclient(hunting): authenticate will time out at 2220.060060s 2024-09-14T11:08:58.762 INFO:tasks.workunit.client.0.smithi097.stderr: -249> 2024-09-14T11:08:58.407+0000 7efe1920d640 10 monclient(hunting): get_auth_request con 0x55e4a9565c20 auth_method 0 2024-09-14T11:08:58.762 INFO:tasks.workunit.client.0.smithi097.stderr: -248> 2024-09-14T11:08:58.407+0000 7efe1920d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:08:58.763 INFO:tasks.workunit.client.0.smithi097.stderr: -247> 2024-09-14T11:08:58.407+0000 7efe1920d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:08:58.763 INFO:tasks.workunit.client.0.smithi097.stderr: -246> 2024-09-14T11:08:58.407+0000 7efe1920d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:08:58.763 INFO:tasks.workunit.client.0.smithi097.stderr: -245> 2024-09-14T11:08:58.407+0000 7efe18a0c640 10 monclient(hunting): get_auth_request con 0x55e4a9540ef0 auth_method 0 2024-09-14T11:08:58.763 INFO:tasks.workunit.client.0.smithi097.stderr: -244> 2024-09-14T11:08:58.407+0000 7efe18a0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:08:58.763 INFO:tasks.workunit.client.0.smithi097.stderr: -243> 2024-09-14T11:08:58.407+0000 7efe18a0c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:08:58.763 INFO:tasks.workunit.client.0.smithi097.stderr: -242> 2024-09-14T11:08:58.407+0000 7efe18a0c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:08:58.763 INFO:tasks.workunit.client.0.smithi097.stderr: -241> 2024-09-14T11:08:58.407+0000 7efe1920d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:08:58.763 INFO:tasks.workunit.client.0.smithi097.stderr: -240> 2024-09-14T11:08:58.407+0000 7efe1920d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:08:58.763 INFO:tasks.workunit.client.0.smithi097.stderr: -239> 2024-09-14T11:08:58.407+0000 7efe1920d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:08:58.763 INFO:tasks.workunit.client.0.smithi097.stderr: -238> 2024-09-14T11:08:58.407+0000 7efe18a0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:08:58.763 INFO:tasks.workunit.client.0.smithi097.stderr: -237> 2024-09-14T11:08:58.407+0000 7efe18a0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:08:58.763 INFO:tasks.workunit.client.0.smithi097.stderr: -236> 2024-09-14T11:08:58.407+0000 7efe18a0c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:08:58.763 INFO:tasks.workunit.client.0.smithi097.stderr: -235> 2024-09-14T11:08:58.407+0000 7efe1820b640 10 monclient(hunting): get_auth_request con 0x55e4a956d180 auth_method 0 2024-09-14T11:08:58.763 INFO:tasks.workunit.client.0.smithi097.stderr: -234> 2024-09-14T11:08:58.407+0000 7efe1820b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:08:58.764 INFO:tasks.workunit.client.0.smithi097.stderr: -233> 2024-09-14T11:08:58.407+0000 7efe1820b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:08:58.764 INFO:tasks.workunit.client.0.smithi097.stderr: -232> 2024-09-14T11:08:58.407+0000 7efe1820b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:08:58.764 INFO:tasks.workunit.client.0.smithi097.stderr: -231> 2024-09-14T11:08:58.407+0000 7efe1920d640 10 monclient(hunting): handle_auth_done global_id 7874 payload 274 2024-09-14T11:08:58.764 INFO:tasks.workunit.client.0.smithi097.stderr: -230> 2024-09-14T11:08:58.407+0000 7efe1920d640 10 monclient: _finish_hunting 0 2024-09-14T11:08:58.764 INFO:tasks.workunit.client.0.smithi097.stderr: -229> 2024-09-14T11:08:58.407+0000 7efe1920d640 1 monclient: found mon.noname-c 2024-09-14T11:08:58.764 INFO:tasks.workunit.client.0.smithi097.stderr: -228> 2024-09-14T11:08:58.407+0000 7efe1920d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:08:58.764 INFO:tasks.workunit.client.0.smithi097.stderr: -227> 2024-09-14T11:08:58.407+0000 7efceffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:08:58.764 INFO:tasks.workunit.client.0.smithi097.stderr: -226> 2024-09-14T11:08:58.407+0000 7efceffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:08:58.764 INFO:tasks.workunit.client.0.smithi097.stderr: -225> 2024-09-14T11:08:58.407+0000 7efceffff640 10 monclient: dump: 2024-09-14T11:08:58.764 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:08:58.764 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:08:58.764 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:58.764 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:58.765 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:08:58.765 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:58.765 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:08:58.765 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:08:58.765 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:08:58.765 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:58.765 INFO:tasks.workunit.client.0.smithi097.stderr: -224> 2024-09-14T11:08:58.407+0000 7efceffff640 10 monclient: _finish_auth 0 2024-09-14T11:08:58.765 INFO:tasks.workunit.client.0.smithi097.stderr: -223> 2024-09-14T11:08:58.407+0000 7efceffff640 10 monclient: _check_auth_tickets 2024-09-14T11:08:58.765 INFO:tasks.workunit.client.0.smithi097.stderr: -222> 2024-09-14T11:08:58.407+0000 7efceffff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:08:58.765 INFO:tasks.workunit.client.0.smithi097.stderr: -221> 2024-09-14T11:08:58.407+0000 7efceffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:08:58.765 INFO:tasks.workunit.client.0.smithi097.stderr: -220> 2024-09-14T11:08:58.407+0000 7efceffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:08:58.765 INFO:tasks.workunit.client.0.smithi097.stderr: -219> 2024-09-14T11:08:58.407+0000 7efceffff640 10 monclient: dump: 2024-09-14T11:08:58.765 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:08:58.766 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:08:58.766 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:58.766 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:58.766 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:08:58.766 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:58.766 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:08:58.766 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:08:58.766 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:08:58.766 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:58.766 INFO:tasks.workunit.client.0.smithi097.stderr: -218> 2024-09-14T11:08:58.407+0000 7efe1cd23800 5 monclient: authenticate success, global_id 7874 2024-09-14T11:08:58.766 INFO:tasks.workunit.client.0.smithi097.stderr: -217> 2024-09-14T11:08:58.407+0000 7efe1cd23800 10 monclient: get_monmap_and_config success 2024-09-14T11:08:58.766 INFO:tasks.workunit.client.0.smithi097.stderr: -216> 2024-09-14T11:08:58.407+0000 7efe1cd23800 4 set_mon_vals no callback set 2024-09-14T11:08:58.766 INFO:tasks.workunit.client.0.smithi097.stderr: -215> 2024-09-14T11:08:58.408+0000 7efe1cd23800 10 monclient: shutdown 2024-09-14T11:08:58.766 INFO:tasks.workunit.client.0.smithi097.stderr: -214> 2024-09-14T11:08:58.408+0000 7efe1cd23800 10 monclient: build_initial_monmap 2024-09-14T11:08:58.767 INFO:tasks.workunit.client.0.smithi097.stderr: -213> 2024-09-14T11:08:58.408+0000 7efe1cd23800 1 build_initial for_mkfs: 0 2024-09-14T11:08:58.767 INFO:tasks.workunit.client.0.smithi097.stderr: -212> 2024-09-14T11:08:58.408+0000 7efe1cd23800 10 monclient: monmap: 2024-09-14T11:08:58.767 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 0 2024-09-14T11:08:58.767 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:08:58.767 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 0.000000 2024-09-14T11:08:58.767 INFO:tasks.workunit.client.0.smithi097.stderr:created 0.000000 2024-09-14T11:08:58.767 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 0 (unknown) 2024-09-14T11:08:58.767 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:58.767 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.noname-a 2024-09-14T11:08:58.767 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.noname-b 2024-09-14T11:08:58.767 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.noname-c 2024-09-14T11:08:58.767 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:58.767 INFO:tasks.workunit.client.0.smithi097.stderr: -211> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9541420) adding auth protocol: cephx 2024-09-14T11:08:58.768 INFO:tasks.workunit.client.0.smithi097.stderr: -210> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9541420) adding auth protocol: cephx 2024-09-14T11:08:58.768 INFO:tasks.workunit.client.0.smithi097.stderr: -209> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9541420) adding auth protocol: cephx 2024-09-14T11:08:58.768 INFO:tasks.workunit.client.0.smithi097.stderr: -208> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9541420) adding con mode: secure 2024-09-14T11:08:58.768 INFO:tasks.workunit.client.0.smithi097.stderr: -207> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9541420) adding con mode: crc 2024-09-14T11:08:58.768 INFO:tasks.workunit.client.0.smithi097.stderr: -206> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9541420) adding con mode: secure 2024-09-14T11:08:58.768 INFO:tasks.workunit.client.0.smithi097.stderr: -205> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9541420) adding con mode: crc 2024-09-14T11:08:58.768 INFO:tasks.workunit.client.0.smithi097.stderr: -204> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9541420) adding con mode: secure 2024-09-14T11:08:58.768 INFO:tasks.workunit.client.0.smithi097.stderr: -203> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9541420) adding con mode: crc 2024-09-14T11:08:58.768 INFO:tasks.workunit.client.0.smithi097.stderr: -202> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9541420) adding con mode: crc 2024-09-14T11:08:58.768 INFO:tasks.workunit.client.0.smithi097.stderr: -201> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9541420) adding con mode: secure 2024-09-14T11:08:58.768 INFO:tasks.workunit.client.0.smithi097.stderr: -200> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9541420) adding con mode: crc 2024-09-14T11:08:58.768 INFO:tasks.workunit.client.0.smithi097.stderr: -199> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9541420) adding con mode: secure 2024-09-14T11:08:58.768 INFO:tasks.workunit.client.0.smithi097.stderr: -198> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9541420) adding con mode: crc 2024-09-14T11:08:58.768 INFO:tasks.workunit.client.0.smithi097.stderr: -197> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9541420) adding con mode: secure 2024-09-14T11:08:58.769 INFO:tasks.workunit.client.0.smithi097.stderr: -196> 2024-09-14T11:08:58.408+0000 7efe1cd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:58.769 INFO:tasks.workunit.client.0.smithi097.stderr: -195> 2024-09-14T11:08:58.408+0000 7efe1cd23800 1 librados: starting msgr at 2024-09-14T11:08:58.769 INFO:tasks.workunit.client.0.smithi097.stderr: -194> 2024-09-14T11:08:58.408+0000 7efe1cd23800 1 librados: starting objecter 2024-09-14T11:08:58.769 INFO:tasks.workunit.client.0.smithi097.stderr: -193> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 asok(0x55e4a9281270) register_command objecter_requests cmddesc objecter_requests hook 0x55e4a9540cf0 EEXIST 2024-09-14T11:08:58.769 INFO:tasks.workunit.client.0.smithi097.stderr: -192> 2024-09-14T11:08:58.408+0000 7efe1cd23800 1 librados: setting wanted keys 2024-09-14T11:08:58.769 INFO:tasks.workunit.client.0.smithi097.stderr: -191> 2024-09-14T11:08:58.408+0000 7efe1cd23800 1 librados: calling monclient init 2024-09-14T11:08:58.769 INFO:tasks.workunit.client.0.smithi097.stderr: -190> 2024-09-14T11:08:58.408+0000 7efe1cd23800 10 monclient: init 2024-09-14T11:08:58.769 INFO:tasks.workunit.client.0.smithi097.stderr: -189> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9534030) adding auth protocol: cephx 2024-09-14T11:08:58.769 INFO:tasks.workunit.client.0.smithi097.stderr: -188> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9534030) adding auth protocol: cephx 2024-09-14T11:08:58.769 INFO:tasks.workunit.client.0.smithi097.stderr: -187> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9534030) adding auth protocol: cephx 2024-09-14T11:08:58.769 INFO:tasks.workunit.client.0.smithi097.stderr: -186> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9534030) adding con mode: secure 2024-09-14T11:08:58.769 INFO:tasks.workunit.client.0.smithi097.stderr: -185> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9534030) adding con mode: crc 2024-09-14T11:08:58.769 INFO:tasks.workunit.client.0.smithi097.stderr: -184> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9534030) adding con mode: secure 2024-09-14T11:08:58.770 INFO:tasks.workunit.client.0.smithi097.stderr: -183> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9534030) adding con mode: crc 2024-09-14T11:08:58.770 INFO:tasks.workunit.client.0.smithi097.stderr: -182> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9534030) adding con mode: secure 2024-09-14T11:08:58.770 INFO:tasks.workunit.client.0.smithi097.stderr: -181> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9534030) adding con mode: crc 2024-09-14T11:08:58.770 INFO:tasks.workunit.client.0.smithi097.stderr: -180> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9534030) adding con mode: crc 2024-09-14T11:08:58.770 INFO:tasks.workunit.client.0.smithi097.stderr: -179> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9534030) adding con mode: secure 2024-09-14T11:08:58.770 INFO:tasks.workunit.client.0.smithi097.stderr: -178> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9534030) adding con mode: crc 2024-09-14T11:08:58.770 INFO:tasks.workunit.client.0.smithi097.stderr: -177> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9534030) adding con mode: secure 2024-09-14T11:08:58.770 INFO:tasks.workunit.client.0.smithi097.stderr: -176> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9534030) adding con mode: crc 2024-09-14T11:08:58.770 INFO:tasks.workunit.client.0.smithi097.stderr: -175> 2024-09-14T11:08:58.408+0000 7efe1cd23800 5 AuthRegistry(0x55e4a9534030) adding con mode: secure 2024-09-14T11:08:58.770 INFO:tasks.workunit.client.0.smithi097.stderr: -174> 2024-09-14T11:08:58.408+0000 7efe1cd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:58.770 INFO:tasks.workunit.client.0.smithi097.stderr: -173> 2024-09-14T11:08:58.409+0000 7efe1cd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:58.770 INFO:tasks.workunit.client.0.smithi097.stderr: -172> 2024-09-14T11:08:58.409+0000 7efe1cd23800 5 asok(0x55e4a9281270) register_command rotate-key cmddesc rotate-key hook 0x55e4a9534178 EEXIST 2024-09-14T11:08:58.770 INFO:tasks.workunit.client.0.smithi097.stderr: -171> 2024-09-14T11:08:58.409+0000 7efe1cd23800 10 monclient: _reopen_session rank -1 2024-09-14T11:08:58.770 INFO:tasks.workunit.client.0.smithi097.stderr: -170> 2024-09-14T11:08:58.409+0000 7efe1cd23800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:08:58.771 INFO:tasks.workunit.client.0.smithi097.stderr: -169> 2024-09-14T11:08:58.409+0000 7efe1cd23800 10 monclient(hunting): picked mon.noname-b con 0x55e4a9540ef0 addr [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] 2024-09-14T11:08:58.771 INFO:tasks.workunit.client.0.smithi097.stderr: -168> 2024-09-14T11:08:58.409+0000 7efe1cd23800 10 monclient(hunting): picked mon.noname-a con 0x55e4a9565c20 addr [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] 2024-09-14T11:08:58.771 INFO:tasks.workunit.client.0.smithi097.stderr: -167> 2024-09-14T11:08:58.409+0000 7efe1cd23800 10 monclient(hunting): picked mon.noname-c con 0x55e4a956d180 addr [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] 2024-09-14T11:08:58.771 INFO:tasks.workunit.client.0.smithi097.stderr: -166> 2024-09-14T11:08:58.409+0000 7efe1cd23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:08:58.771 INFO:tasks.workunit.client.0.smithi097.stderr: -165> 2024-09-14T11:08:58.409+0000 7efe1cd23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:08:58.771 INFO:tasks.workunit.client.0.smithi097.stderr: -164> 2024-09-14T11:08:58.409+0000 7efe1cd23800 10 monclient(hunting): start opening mon connection 2024-09-14T11:08:58.771 INFO:tasks.workunit.client.0.smithi097.stderr: -163> 2024-09-14T11:08:58.409+0000 7efe1cd23800 10 monclient(hunting): _renew_subs 2024-09-14T11:08:58.771 INFO:tasks.workunit.client.0.smithi097.stderr: -162> 2024-09-14T11:08:58.409+0000 7efe1cd23800 10 monclient(hunting): authenticate will time out at 2220.062244s 2024-09-14T11:08:58.771 INFO:tasks.workunit.client.0.smithi097.stderr: -161> 2024-09-14T11:08:58.409+0000 7efe1920d640 10 monclient(hunting): get_auth_request con 0x55e4a9565c20 auth_method 0 2024-09-14T11:08:58.771 INFO:tasks.workunit.client.0.smithi097.stderr: -160> 2024-09-14T11:08:58.409+0000 7efe1920d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:08:58.771 INFO:tasks.workunit.client.0.smithi097.stderr: -159> 2024-09-14T11:08:58.409+0000 7efe1920d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:08:58.771 INFO:tasks.workunit.client.0.smithi097.stderr: -158> 2024-09-14T11:08:58.409+0000 7efe1920d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:08:58.771 INFO:tasks.workunit.client.0.smithi097.stderr: -157> 2024-09-14T11:08:58.409+0000 7efe18a0c640 10 monclient(hunting): get_auth_request con 0x55e4a956d180 auth_method 0 2024-09-14T11:08:58.771 INFO:tasks.workunit.client.0.smithi097.stderr: -156> 2024-09-14T11:08:58.409+0000 7efe18a0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:08:58.772 INFO:tasks.workunit.client.0.smithi097.stderr: -155> 2024-09-14T11:08:58.409+0000 7efe18a0c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:08:58.772 INFO:tasks.workunit.client.0.smithi097.stderr: -154> 2024-09-14T11:08:58.409+0000 7efe18a0c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:08:58.772 INFO:tasks.workunit.client.0.smithi097.stderr: -153> 2024-09-14T11:08:58.409+0000 7efe18a0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:08:58.772 INFO:tasks.workunit.client.0.smithi097.stderr: -152> 2024-09-14T11:08:58.409+0000 7efe18a0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:08:58.772 INFO:tasks.workunit.client.0.smithi097.stderr: -151> 2024-09-14T11:08:58.409+0000 7efe18a0c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:08:58.772 INFO:tasks.workunit.client.0.smithi097.stderr: -150> 2024-09-14T11:08:58.409+0000 7efe1920d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:08:58.772 INFO:tasks.workunit.client.0.smithi097.stderr: -149> 2024-09-14T11:08:58.409+0000 7efe1920d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:08:58.772 INFO:tasks.workunit.client.0.smithi097.stderr: -148> 2024-09-14T11:08:58.409+0000 7efe1920d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:08:58.772 INFO:tasks.workunit.client.0.smithi097.stderr: -147> 2024-09-14T11:08:58.409+0000 7efe18a0c640 10 monclient(hunting): handle_auth_done global_id 7877 payload 824 2024-09-14T11:08:58.772 INFO:tasks.workunit.client.0.smithi097.stderr: -146> 2024-09-14T11:08:58.409+0000 7efe18a0c640 10 monclient: _finish_hunting 0 2024-09-14T11:08:58.772 INFO:tasks.workunit.client.0.smithi097.stderr: -145> 2024-09-14T11:08:58.409+0000 7efe18a0c640 1 monclient: found mon.noname-c 2024-09-14T11:08:58.772 INFO:tasks.workunit.client.0.smithi097.stderr: -144> 2024-09-14T11:08:58.409+0000 7efe18a0c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.97:3301/0 2024-09-14T11:08:58.773 INFO:tasks.workunit.client.0.smithi097.stderr: -143> 2024-09-14T11:08:58.409+0000 7efcee7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:08:58.773 INFO:tasks.workunit.client.0.smithi097.stderr: -142> 2024-09-14T11:08:58.409+0000 7efcee7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:08:58.773 INFO:tasks.workunit.client.0.smithi097.stderr: -141> 2024-09-14T11:08:58.409+0000 7efcee7fc640 10 monclient: dump: 2024-09-14T11:08:58.773 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:08:58.773 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:08:58.773 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:58.773 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:58.773 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:08:58.773 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:58.773 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:08:58.773 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:08:58.773 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:08:58.773 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:58.773 INFO:tasks.workunit.client.0.smithi097.stderr: -140> 2024-09-14T11:08:58.409+0000 7efcee7fc640 10 monclient: _finish_auth 0 2024-09-14T11:08:58.774 INFO:tasks.workunit.client.0.smithi097.stderr: -139> 2024-09-14T11:08:58.409+0000 7efcee7fc640 10 monclient: _check_auth_tickets 2024-09-14T11:08:58.774 INFO:tasks.workunit.client.0.smithi097.stderr: -138> 2024-09-14T11:08:58.409+0000 7efe1cd23800 5 monclient: authenticate success, global_id 7877 2024-09-14T11:08:58.774 INFO:tasks.workunit.client.0.smithi097.stderr: -137> 2024-09-14T11:08:58.409+0000 7efcee7fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:08:58.774 INFO:tasks.workunit.client.0.smithi097.stderr: -136> 2024-09-14T11:08:58.409+0000 7efcee7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:08:58.774 INFO:tasks.workunit.client.0.smithi097.stderr: -135> 2024-09-14T11:08:58.409+0000 7efcee7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:08:58.774 INFO:tasks.workunit.client.0.smithi097.stderr: -134> 2024-09-14T11:08:58.409+0000 7efcee7fc640 10 monclient: dump: 2024-09-14T11:08:58.774 INFO:tasks.workunit.client.0.smithi097.stderr:epoch 1 2024-09-14T11:08:58.774 INFO:tasks.workunit.client.0.smithi097.stderr:fsid 60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9 2024-09-14T11:08:58.774 INFO:tasks.workunit.client.0.smithi097.stderr:last_changed 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:58.774 INFO:tasks.workunit.client.0.smithi097.stderr:created 2024-09-14T10:44:32.192460+0000 2024-09-14T11:08:58.774 INFO:tasks.workunit.client.0.smithi097.stderr:min_mon_release 19 (squid) 2024-09-14T11:08:58.774 INFO:tasks.workunit.client.0.smithi097.stderr:election_strategy: 1 2024-09-14T11:08:58.774 INFO:tasks.workunit.client.0.smithi097.stderr:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-09-14T11:08:58.774 INFO:tasks.workunit.client.0.smithi097.stderr:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-14T11:08:58.775 INFO:tasks.workunit.client.0.smithi097.stderr:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-09-14T11:08:58.775 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:58.775 INFO:tasks.workunit.client.0.smithi097.stderr: -133> 2024-09-14T11:08:58.409+0000 7efe1cd23800 10 monclient: _renew_subs 2024-09-14T11:08:58.775 INFO:tasks.workunit.client.0.smithi097.stderr: -132> 2024-09-14T11:08:58.409+0000 7efceffff640 4 set_mon_vals no callback set 2024-09-14T11:08:58.775 INFO:tasks.workunit.client.0.smithi097.stderr: -131> 2024-09-14T11:08:58.409+0000 7efe1cd23800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:08:58.775 INFO:tasks.workunit.client.0.smithi097.stderr: -130> 2024-09-14T11:08:58.409+0000 7efe1cd23800 10 monclient: _renew_subs 2024-09-14T11:08:58.775 INFO:tasks.workunit.client.0.smithi097.stderr: -129> 2024-09-14T11:08:58.409+0000 7efe1cd23800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:08:58.775 INFO:tasks.workunit.client.0.smithi097.stderr: -128> 2024-09-14T11:08:58.409+0000 7efe1cd23800 1 librados: init done 2024-09-14T11:08:58.775 INFO:tasks.workunit.client.0.smithi097.stderr: -127> 2024-09-14T11:08:58.409+0000 7efe1cd23800 5 asok(0x55e4a9281270) register_command cr dump hook 0x55e4a957f858 2024-09-14T11:08:58.775 INFO:tasks.workunit.client.0.smithi097.stderr: -126> 2024-09-14T11:08:58.411+0000 7efe1cd23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.775 INFO:tasks.workunit.client.0.smithi097.stderr: -125> 2024-09-14T11:08:58.412+0000 7efcee7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:08:58.775 INFO:tasks.workunit.client.0.smithi097.stderr: -124> 2024-09-14T11:08:58.412+0000 7efcee7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:08:58.775 INFO:tasks.workunit.client.0.smithi097.stderr: -123> 2024-09-14T11:08:58.412+0000 7efcee7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.97:6832/3343919203,v1:172.21.15.97:6833/3343919203] 2024-09-14T11:08:58.776 INFO:tasks.workunit.client.0.smithi097.stderr: -122> 2024-09-14T11:08:58.412+0000 7efe1820b640 10 monclient: get_auth_request con 0x7efce4077230 auth_method 0 2024-09-14T11:08:58.776 INFO:tasks.workunit.client.0.smithi097.stderr: -121> 2024-09-14T11:08:58.413+0000 7efe1920d640 10 monclient: get_auth_request con 0x55e4a958f8b0 auth_method 0 2024-09-14T11:08:58.776 INFO:tasks.workunit.client.0.smithi097.stderr: -120> 2024-09-14T11:08:58.413+0000 7efe1cd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:58.776 INFO:tasks.workunit.client.0.smithi097.stderr: -119> 2024-09-14T11:08:58.413+0000 7efe1cd23800 20 realm 2024-09-14T11:08:58.776 INFO:tasks.workunit.client.0.smithi097.stderr: -118> 2024-09-14T11:08:58.413+0000 7efe1cd23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.776 INFO:tasks.workunit.client.0.smithi097.stderr: -117> 2024-09-14T11:08:58.413+0000 7efe1cd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:58.776 INFO:tasks.workunit.client.0.smithi097.stderr: -116> 2024-09-14T11:08:58.413+0000 7efe1cd23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:08:58.776 INFO:tasks.workunit.client.0.smithi097.stderr: -115> 2024-09-14T11:08:58.413+0000 7efe1cd23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.776 INFO:tasks.workunit.client.0.smithi097.stderr: -114> 2024-09-14T11:08:58.414+0000 7efe1cd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:58.776 INFO:tasks.workunit.client.0.smithi097.stderr: -113> 2024-09-14T11:08:58.414+0000 7efe1cd23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.776 INFO:tasks.workunit.client.0.smithi097.stderr: -112> 2024-09-14T11:08:58.414+0000 7efe1820b640 10 monclient: get_auth_request con 0x55e4a9593a20 auth_method 0 2024-09-14T11:08:58.776 INFO:tasks.workunit.client.0.smithi097.stderr: -111> 2024-09-14T11:08:58.414+0000 7efe1cd23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:08:58.776 INFO:tasks.workunit.client.0.smithi097.stderr: -110> 2024-09-14T11:08:58.414+0000 7efe1cd23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.777 INFO:tasks.workunit.client.0.smithi097.stderr: -109> 2024-09-14T11:08:58.415+0000 7efe1920d640 10 monclient: get_auth_request con 0x55e4a9597310 auth_method 0 2024-09-14T11:08:58.777 INFO:tasks.workunit.client.0.smithi097.stderr: -108> 2024-09-14T11:08:58.415+0000 7efe1cd23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:08:58.777 INFO:tasks.workunit.client.0.smithi097.stderr: -107> 2024-09-14T11:08:58.415+0000 7efe1cd23800 20 searching for the correct realm 2024-09-14T11:08:58.777 INFO:tasks.workunit.client.0.smithi097.stderr: -106> 2024-09-14T11:08:58.415+0000 7efe18a0c640 10 monclient: get_auth_request con 0x55e4a959c030 auth_method 0 2024-09-14T11:08:58.777 INFO:tasks.workunit.client.0.smithi097.stderr: -105> 2024-09-14T11:08:58.416+0000 7efe1820b640 10 monclient: get_auth_request con 0x7efe0807d070 auth_method 0 2024-09-14T11:08:58.777 INFO:tasks.workunit.client.0.smithi097.stderr: -104> 2024-09-14T11:08:58.417+0000 7efe1920d640 10 monclient: get_auth_request con 0x7efe000684e0 auth_method 0 2024-09-14T11:08:58.777 INFO:tasks.workunit.client.0.smithi097.stderr: -103> 2024-09-14T11:08:58.417+0000 7efe1920d640 0 -- 172.21.15.97:0/821645223 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7efe000684e0 msgr2=0x7efe00066f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:08:58.777 INFO:tasks.workunit.client.0.smithi097.stderr: -102> 2024-09-14T11:08:58.618+0000 7efe1920d640 10 monclient: get_auth_request con 0x7efe000684e0 auth_method 0 2024-09-14T11:08:58.777 INFO:tasks.workunit.client.0.smithi097.stderr: -101> 2024-09-14T11:08:58.621+0000 7efe18a0c640 10 monclient: get_auth_request con 0x7efe000716d0 auth_method 0 2024-09-14T11:08:58.777 INFO:tasks.workunit.client.0.smithi097.stderr: -100> 2024-09-14T11:08:58.622+0000 7efe1820b640 10 monclient: get_auth_request con 0x7efe08061040 auth_method 0 2024-09-14T11:08:58.777 INFO:tasks.workunit.client.0.smithi097.stderr: -99> 2024-09-14T11:08:58.622+0000 7efe1820b640 0 -- 172.21.15.97:0/821645223 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7efe08061040 msgr2=0x7efe080e38c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:08:58.777 INFO:tasks.workunit.client.0.smithi097.stderr: -98> 2024-09-14T11:08:58.622+0000 7efcee7fc640 1 client.7877.objecter ms_handle_reset 0x7efe08061040 session 0x7efe080ad700 osd.3 2024-09-14T11:08:58.777 INFO:tasks.workunit.client.0.smithi097.stderr: -97> 2024-09-14T11:08:58.622+0000 7efcee7fc640 10 monclient: _renew_subs 2024-09-14T11:08:58.777 INFO:tasks.workunit.client.0.smithi097.stderr: -96> 2024-09-14T11:08:58.622+0000 7efcee7fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.97:3301/0 2024-09-14T11:08:58.778 INFO:tasks.workunit.client.0.smithi097.stderr: -95> 2024-09-14T11:08:58.623+0000 7efe1820b640 10 monclient: get_auth_request con 0x7efce4086d50 auth_method 0 2024-09-14T11:08:58.778 INFO:tasks.workunit.client.0.smithi097.stderr: -94> 2024-09-14T11:08:58.628+0000 7efe1cd23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:08:58.778 INFO:tasks.workunit.client.0.smithi097.stderr: -93> 2024-09-14T11:08:58.628+0000 7efe1cd23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:08:58.778 INFO:tasks.workunit.client.0.smithi097.stderr: -92> 2024-09-14T11:08:58.628+0000 7efe1cd23800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:08:58.778 INFO:tasks.workunit.client.0.smithi097.stderr: -91> 2024-09-14T11:08:58.628+0000 7efe1cd23800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:08:58.778 INFO:tasks.workunit.client.0.smithi097.stderr: -90> 2024-09-14T11:08:58.628+0000 7efe1cd23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:08:58.778 INFO:tasks.workunit.client.0.smithi097.stderr: -89> 2024-09-14T11:08:58.628+0000 7efe1cd23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:08:58.778 INFO:tasks.workunit.client.0.smithi097.stderr: -88> 2024-09-14T11:08:58.628+0000 7efe1cd23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.778 INFO:tasks.workunit.client.0.smithi097.stderr: -87> 2024-09-14T11:08:58.628+0000 7efe1cd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:58.778 INFO:tasks.workunit.client.0.smithi097.stderr: -86> 2024-09-14T11:08:58.628+0000 7efe1cd23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.778 INFO:tasks.workunit.client.0.smithi097.stderr: -85> 2024-09-14T11:08:58.628+0000 7efe1cd23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:08:58.778 INFO:tasks.workunit.client.0.smithi097.stderr: -84> 2024-09-14T11:08:58.628+0000 7efe1cd23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.778 INFO:tasks.workunit.client.0.smithi097.stderr: -83> 2024-09-14T11:08:58.629+0000 7efe1cd23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:08:58.779 INFO:tasks.workunit.client.0.smithi097.stderr: -82> 2024-09-14T11:08:58.629+0000 7efe1cd23800 20 zone default found 2024-09-14T11:08:58.779 INFO:tasks.workunit.client.0.smithi097.stderr: -81> 2024-09-14T11:08:58.629+0000 7efe1cd23800 4 Realm: () 2024-09-14T11:08:58.779 INFO:tasks.workunit.client.0.smithi097.stderr: -80> 2024-09-14T11:08:58.629+0000 7efe1cd23800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:08:58.779 INFO:tasks.workunit.client.0.smithi097.stderr: -79> 2024-09-14T11:08:58.629+0000 7efe1cd23800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:08:58.779 INFO:tasks.workunit.client.0.smithi097.stderr: -78> 2024-09-14T11:08:58.629+0000 7efe1cd23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:08:58.779 INFO:tasks.workunit.client.0.smithi097.stderr: -77> 2024-09-14T11:08:58.629+0000 7efe1cd23800 20 zonegroup default 2024-09-14T11:08:58.779 INFO:tasks.workunit.client.0.smithi097.stderr: -76> 2024-09-14T11:08:58.629+0000 7efe1cd23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.779 INFO:tasks.workunit.client.0.smithi097.stderr: -75> 2024-09-14T11:08:58.629+0000 7efe1cd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:58.779 INFO:tasks.workunit.client.0.smithi097.stderr: -74> 2024-09-14T11:08:58.629+0000 7efe1cd23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.779 INFO:tasks.workunit.client.0.smithi097.stderr: -73> 2024-09-14T11:08:58.629+0000 7efe1cd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:58.779 INFO:tasks.workunit.client.0.smithi097.stderr: -72> 2024-09-14T11:08:58.629+0000 7efe1cd23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.779 INFO:tasks.workunit.client.0.smithi097.stderr: -71> 2024-09-14T11:08:58.630+0000 7efe1cd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:58.780 INFO:tasks.workunit.client.0.smithi097.stderr: -70> 2024-09-14T11:08:58.630+0000 7efe1cd23800 20 started sync module instance, tier type = 2024-09-14T11:08:58.780 INFO:tasks.workunit.client.0.smithi097.stderr: -69> 2024-09-14T11:08:58.630+0000 7efe1cd23800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:08:58.780 INFO:tasks.workunit.client.0.smithi097.stderr: -68> 2024-09-14T11:08:58.639+0000 7efe1cd23800 20 add_watcher() i=0 2024-09-14T11:08:58.781 INFO:tasks.workunit.client.0.smithi097.stderr: -67> 2024-09-14T11:08:58.639+0000 7efe1cd23800 20 add_watcher() i=1 2024-09-14T11:08:58.781 INFO:tasks.workunit.client.0.smithi097.stderr: -66> 2024-09-14T11:08:58.639+0000 7efe1cd23800 20 add_watcher() i=2 2024-09-14T11:08:58.781 INFO:tasks.workunit.client.0.smithi097.stderr: -65> 2024-09-14T11:08:58.639+0000 7efe1cd23800 20 add_watcher() i=3 2024-09-14T11:08:58.781 INFO:tasks.workunit.client.0.smithi097.stderr: -64> 2024-09-14T11:08:58.639+0000 7efe1cd23800 20 add_watcher() i=4 2024-09-14T11:08:58.781 INFO:tasks.workunit.client.0.smithi097.stderr: -63> 2024-09-14T11:08:58.639+0000 7efe1cd23800 20 add_watcher() i=5 2024-09-14T11:08:58.781 INFO:tasks.workunit.client.0.smithi097.stderr: -62> 2024-09-14T11:08:58.639+0000 7efe1cd23800 20 add_watcher() i=6 2024-09-14T11:08:58.781 INFO:tasks.workunit.client.0.smithi097.stderr: -61> 2024-09-14T11:08:58.640+0000 7efe1cd23800 20 add_watcher() i=7 2024-09-14T11:08:58.781 INFO:tasks.workunit.client.0.smithi097.stderr: -60> 2024-09-14T11:08:58.640+0000 7efe1cd23800 2 all 8 watchers are set, enabling cache 2024-09-14T11:08:58.781 INFO:tasks.workunit.client.0.smithi097.stderr: -59> 2024-09-14T11:08:58.642+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b181a80) adding auth protocol: cephx 2024-09-14T11:08:58.781 INFO:tasks.workunit.client.0.smithi097.stderr: -58> 2024-09-14T11:08:58.642+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b181a80) adding auth protocol: cephx 2024-09-14T11:08:58.781 INFO:tasks.workunit.client.0.smithi097.stderr: -57> 2024-09-14T11:08:58.642+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b181a80) adding auth protocol: cephx 2024-09-14T11:08:58.781 INFO:tasks.workunit.client.0.smithi097.stderr: -56> 2024-09-14T11:08:58.642+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b181a80) adding con mode: secure 2024-09-14T11:08:58.781 INFO:tasks.workunit.client.0.smithi097.stderr: -55> 2024-09-14T11:08:58.642+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b181a80) adding con mode: crc 2024-09-14T11:08:58.781 INFO:tasks.workunit.client.0.smithi097.stderr: -54> 2024-09-14T11:08:58.643+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b181a80) adding con mode: secure 2024-09-14T11:08:58.782 INFO:tasks.workunit.client.0.smithi097.stderr: -53> 2024-09-14T11:08:58.643+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b181a80) adding con mode: crc 2024-09-14T11:08:58.782 INFO:tasks.workunit.client.0.smithi097.stderr: -52> 2024-09-14T11:08:58.643+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b181a80) adding con mode: secure 2024-09-14T11:08:58.782 INFO:tasks.workunit.client.0.smithi097.stderr: -51> 2024-09-14T11:08:58.643+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b181a80) adding con mode: crc 2024-09-14T11:08:58.782 INFO:tasks.workunit.client.0.smithi097.stderr: -50> 2024-09-14T11:08:58.643+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b181a80) adding con mode: crc 2024-09-14T11:08:58.782 INFO:tasks.workunit.client.0.smithi097.stderr: -49> 2024-09-14T11:08:58.643+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b181a80) adding con mode: secure 2024-09-14T11:08:58.782 INFO:tasks.workunit.client.0.smithi097.stderr: -48> 2024-09-14T11:08:58.642+0000 7efccf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:08:58.782 INFO:tasks.workunit.client.0.smithi097.stderr: -47> 2024-09-14T11:08:58.643+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b181a80) adding con mode: crc 2024-09-14T11:08:58.782 INFO:tasks.workunit.client.0.smithi097.stderr: -46> 2024-09-14T11:08:58.643+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b181a80) adding con mode: secure 2024-09-14T11:08:58.782 INFO:tasks.workunit.client.0.smithi097.stderr: -45> 2024-09-14T11:08:58.643+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b181a80) adding con mode: crc 2024-09-14T11:08:58.782 INFO:tasks.workunit.client.0.smithi097.stderr: -44> 2024-09-14T11:08:58.643+0000 7efe1cd23800 5 AuthRegistry(0x7ffc4b181a80) adding con mode: secure 2024-09-14T11:08:58.782 INFO:tasks.workunit.client.0.smithi097.stderr: -43> 2024-09-14T11:08:58.643+0000 7efe1cd23800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:08:58.782 INFO:tasks.workunit.client.0.smithi097.stderr: -42> 2024-09-14T11:08:58.643+0000 7efe1cd23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:08:58.782 INFO:tasks.workunit.client.0.smithi097.stderr: -41> 2024-09-14T11:08:58.643+0000 7efe1cd23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:08:58.783 INFO:tasks.workunit.client.0.smithi097.stderr: -40> 2024-09-14T11:08:58.643+0000 7efe1cd23800 5 asok(0x55e4a9281270) register_command cache list hook 0x55e4a9576210 2024-09-14T11:08:58.783 INFO:tasks.workunit.client.0.smithi097.stderr: -39> 2024-09-14T11:08:58.643+0000 7efe1cd23800 5 asok(0x55e4a9281270) register_command cache inspect hook 0x55e4a9576210 2024-09-14T11:08:58.783 INFO:tasks.workunit.client.0.smithi097.stderr: -38> 2024-09-14T11:08:58.643+0000 7efe1cd23800 5 asok(0x55e4a9281270) register_command cache erase hook 0x55e4a9576210 2024-09-14T11:08:58.783 INFO:tasks.workunit.client.0.smithi097.stderr: -37> 2024-09-14T11:08:58.643+0000 7efe1cd23800 5 asok(0x55e4a9281270) register_command cache zap hook 0x55e4a9576210 2024-09-14T11:08:58.783 INFO:tasks.workunit.client.0.smithi097.stderr: -36> 2024-09-14T11:08:58.643+0000 7efe1cd23800 5 note: GC not initialized 2024-09-14T11:08:58.783 INFO:tasks.workunit.client.0.smithi097.stderr: -35> 2024-09-14T11:08:58.643+0000 7efcce7e4640 20 reqs_thread_entry: start 2024-09-14T11:08:58.783 INFO:tasks.workunit.client.0.smithi097.stderr: -34> 2024-09-14T11:08:58.643+0000 7efe1cd23800 5 asok(0x55e4a9281270) register_command sync trace show hook 0x7efe100044d0 2024-09-14T11:08:58.783 INFO:tasks.workunit.client.0.smithi097.stderr: -33> 2024-09-14T11:08:58.643+0000 7efe1cd23800 5 asok(0x55e4a9281270) register_command sync trace history hook 0x7efe100044d0 2024-09-14T11:08:58.783 INFO:tasks.workunit.client.0.smithi097.stderr: -32> 2024-09-14T11:08:58.643+0000 7efe1cd23800 5 asok(0x55e4a9281270) register_command sync trace active hook 0x7efe100044d0 2024-09-14T11:08:58.783 INFO:tasks.workunit.client.0.smithi097.stderr: -31> 2024-09-14T11:08:58.643+0000 7efe1cd23800 5 asok(0x55e4a9281270) register_command sync trace active_short hook 0x7efe100044d0 2024-09-14T11:08:58.784 INFO:tasks.workunit.client.0.smithi097.stderr: -30> 2024-09-14T11:08:58.643+0000 7efe1cd23800 20 init_complete bucket index max shards: 11 2024-09-14T11:08:58.784 INFO:tasks.workunit.client.0.smithi097.stderr: -29> 2024-09-14T11:08:58.643+0000 7efe1cd23800 20 Filter name: none 2024-09-14T11:08:58.784 INFO:tasks.workunit.client.0.smithi097.stderr: -28> 2024-09-14T11:08:58.643+0000 7efcc77fe640 20 reqs_thread_entry: start 2024-09-14T11:08:58.784 INFO:tasks.workunit.client.0.smithi097.stderr: -27> 2024-09-14T11:08:58.643+0000 7efe1cd23800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:08:58.784 INFO:tasks.workunit.client.0.smithi097.stderr: -26> 2024-09-14T11:08:58.643+0000 7efe1cd23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.784 INFO:tasks.workunit.client.0.smithi097.stderr: -25> 2024-09-14T11:08:58.644+0000 7efe1cd23800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:08:58.784 INFO:tasks.workunit.client.0.smithi097.stderr: -24> 2024-09-14T11:08:58.644+0000 7efe1cd23800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:08:58.784 INFO:tasks.workunit.client.0.smithi097.stderr: -23> 2024-09-14T11:08:58.644+0000 7efe1cd23800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:08:58.784 INFO:tasks.workunit.client.0.smithi097.stderr: -22> 2024-09-14T11:08:58.644+0000 7efe1cd23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 : miss 2024-09-14T11:08:58.784 INFO:tasks.workunit.client.0.smithi097.stderr: -21> 2024-09-14T11:08:58.644+0000 7efe1cd23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.784 INFO:tasks.workunit.client.0.smithi097.stderr: -20> 2024-09-14T11:08:58.644+0000 7efe1cd23800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:08:58.784 INFO:tasks.workunit.client.0.smithi097.stderr: -19> 2024-09-14T11:08:58.644+0000 7efe1cd23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:08:58.784 INFO:tasks.workunit.client.0.smithi097.stderr: -18> 2024-09-14T11:08:58.644+0000 7efe1cd23800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:08:58.784 INFO:tasks.workunit.client.0.smithi097.stderr: -17> 2024-09-14T11:08:58.644+0000 7efe1cd23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:08:58.785 INFO:tasks.workunit.client.0.smithi097.stderr: -16> 2024-09-14T11:08:58.644+0000 7efe1cd23800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:08:58.785 INFO:tasks.workunit.client.0.smithi097.stderr: -15> 2024-09-14T11:08:58.645+0000 7efe1cd23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 2024-09-14T11:08:58.785 INFO:tasks.workunit.client.0.smithi097.stderr: -14> 2024-09-14T11:08:58.646+0000 7efe1cd23800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:08:58.785 INFO:tasks.workunit.client.0.smithi097.stderr: -13> 2024-09-14T11:08:58.653+0000 7efe1cd23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:08:58.785 INFO:tasks.workunit.client.0.smithi097.stderr: -12> 2024-09-14T11:08:58.653+0000 7efe1cd23800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:08:58.785 INFO:tasks.workunit.client.0.smithi097.stderr: -11> 2024-09-14T11:08:58.653+0000 7efe1cd23800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:08:58.785 INFO:tasks.workunit.client.0.smithi097.stderr: -10> 2024-09-14T11:08:58.653+0000 7efe1cd23800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17, ofs0, ns] 2024-09-14T11:08:58.785 INFO:tasks.workunit.client.0.smithi097.stderr: -9> 2024-09-14T11:08:58.654+0000 7efceffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595247 cookie 94440582161072 notifier 7877 bl.length()=827 2024-09-14T11:08:58.785 INFO:tasks.workunit.client.0.smithi097.stderr: -8> 2024-09-14T11:08:58.654+0000 7efceffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:08:58.785 INFO:tasks.workunit.client.0.smithi097.stderr: -7> 2024-09-14T11:08:58.654+0000 7efceffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:08:58.785 INFO:tasks.workunit.client.0.smithi097.stderr: -6> 2024-09-14T11:08:58.654+0000 7efceffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:08:58.785 INFO:tasks.workunit.client.0.smithi097.stderr: -5> 2024-09-14T11:08:58.654+0000 7efe1cd23800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): orig_sources= new_sources= 2024-09-14T11:08:58.785 INFO:tasks.workunit.client.0.smithi097.stderr: -4> 2024-09-14T11:08:58.654+0000 7efe1cd23800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): potential sources added=[] removed=[] 2024-09-14T11:08:58.786 INFO:tasks.workunit.client.0.smithi097.stderr: -3> 2024-09-14T11:08:58.654+0000 7efe1cd23800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): orig_dests= new_dests= 2024-09-14T11:08:58.786 INFO:tasks.workunit.client.0.smithi097.stderr: -2> 2024-09-14T11:08:58.654+0000 7efe1cd23800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): potential dests added=[] removed=[] 2024-09-14T11:08:58.786 INFO:tasks.workunit.client.0.smithi097.stderr: -1> 2024-09-14T11:08:58.659+0000 7efe1cd23800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7efe1cd23800 time 2024-09-14T11:08:58.659762+0000 2024-09-14T11:08:58.786 INFO:tasks.workunit.client.0.smithi097.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:08:58.786 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:58.786 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:08:58.786 INFO:tasks.workunit.client.0.smithi097.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7efe1e38c76a] 2024-09-14T11:08:58.786 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7efe1e38c928] 2024-09-14T11:08:58.786 INFO:tasks.workunit.client.0.smithi097.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e4a6d020b1] 2024-09-14T11:08:58.786 INFO:tasks.workunit.client.0.smithi097.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55e4a6d11f6a] 2024-09-14T11:08:58.787 INFO:tasks.workunit.client.0.smithi097.stderr: 5: main() 2024-09-14T11:08:58.787 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7efe1d029590] 2024-09-14T11:08:58.787 INFO:tasks.workunit.client.0.smithi097.stderr: 7: __libc_start_main() 2024-09-14T11:08:58.787 INFO:tasks.workunit.client.0.smithi097.stderr: 8: _start() 2024-09-14T11:08:58.787 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:58.787 INFO:tasks.workunit.client.0.smithi097.stderr: 0> 2024-09-14T11:08:58.660+0000 7efe1cd23800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:08:58.787 INFO:tasks.workunit.client.0.smithi097.stderr: in thread 7efe1cd23800 thread_name:radosgw-admin 2024-09-14T11:08:58.787 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:58.787 INFO:tasks.workunit.client.0.smithi097.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:08:58.787 INFO:tasks.workunit.client.0.smithi097.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7efe1d03e6f0] 2024-09-14T11:08:58.788 INFO:tasks.workunit.client.0.smithi097.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7efe1d08b99c] 2024-09-14T11:08:58.788 INFO:tasks.workunit.client.0.smithi097.stderr: 3: raise() 2024-09-14T11:08:58.788 INFO:tasks.workunit.client.0.smithi097.stderr: 4: abort() 2024-09-14T11:08:58.788 INFO:tasks.workunit.client.0.smithi097.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7efe1e38c7c4] 2024-09-14T11:08:58.788 INFO:tasks.workunit.client.0.smithi097.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7efe1e38c928] 2024-09-14T11:08:58.788 INFO:tasks.workunit.client.0.smithi097.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e4a6d020b1] 2024-09-14T11:08:58.788 INFO:tasks.workunit.client.0.smithi097.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55e4a6d11f6a] 2024-09-14T11:08:58.788 INFO:tasks.workunit.client.0.smithi097.stderr: 9: main() 2024-09-14T11:08:58.788 INFO:tasks.workunit.client.0.smithi097.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7efe1d029590] 2024-09-14T11:08:58.788 INFO:tasks.workunit.client.0.smithi097.stderr: 11: __libc_start_main() 2024-09-14T11:08:58.788 INFO:tasks.workunit.client.0.smithi097.stderr: 12: _start() 2024-09-14T11:08:58.788 INFO:tasks.workunit.client.0.smithi097.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:08:58.788 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:08:58.789 INFO:tasks.workunit.client.0.smithi097.stderr:--- logging levels --- 2024-09-14T11:08:58.789 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 none 2024-09-14T11:08:58.789 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 lockdep 2024-09-14T11:08:58.789 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 context 2024-09-14T11:08:58.789 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 crush 2024-09-14T11:08:58.789 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds 2024-09-14T11:08:58.789 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_balancer 2024-09-14T11:08:58.789 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_locker 2024-09-14T11:08:58.789 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log 2024-09-14T11:08:58.789 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_log_expire 2024-09-14T11:08:58.789 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mds_migrator 2024-09-14T11:08:58.789 INFO:tasks.workunit.client.0.smithi097.stderr: 3/ 5 mds_quiesce 2024-09-14T11:08:58.789 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 buffer 2024-09-14T11:08:58.789 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 timer 2024-09-14T11:08:58.790 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 filer 2024-09-14T11:08:58.790 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 striper 2024-09-14T11:08:58.790 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 1 objecter 2024-09-14T11:08:58.790 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rados 2024-09-14T11:08:58.790 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd 2024-09-14T11:08:58.790 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_mirror 2024-09-14T11:08:58.790 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_replay 2024-09-14T11:08:58.790 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 rbd_pwl 2024-09-14T11:08:58.790 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 journaler 2024-09-14T11:08:58.790 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objectcacher 2024-09-14T11:08:58.790 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:08:58.790 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 client 2024-09-14T11:08:58.790 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 osd 2024-09-14T11:08:58.790 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 optracker 2024-09-14T11:08:58.791 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 objclass 2024-09-14T11:08:58.791 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 filestore 2024-09-14T11:08:58.791 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 journal 2024-09-14T11:08:58.791 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 ms 2024-09-14T11:08:58.791 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mon 2024-09-14T11:08:58.791 INFO:tasks.workunit.client.0.smithi097.stderr: 0/10 monc 2024-09-14T11:08:58.791 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 paxos 2024-09-14T11:08:58.791 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 tp 2024-09-14T11:08:58.791 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 auth 2024-09-14T11:08:58.791 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 crypto 2024-09-14T11:08:58.791 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 finisher 2024-09-14T11:08:58.791 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 reserver 2024-09-14T11:08:58.791 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 heartbeatmap 2024-09-14T11:08:58.791 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 perfcounter 2024-09-14T11:08:58.792 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw 2024-09-14T11:08:58.792 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_sync 2024-09-14T11:08:58.792 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_datacache 2024-09-14T11:08:58.792 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_access 2024-09-14T11:08:58.792 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:08:58.792 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_flight 2024-09-14T11:08:58.792 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:08:58.792 INFO:tasks.workunit.client.0.smithi097.stderr: 20/20 rgw_notification 2024-09-14T11:08:58.792 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 javaclient 2024-09-14T11:08:58.792 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 asok 2024-09-14T11:08:58.792 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 1 throttle 2024-09-14T11:08:58.792 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 0 refs 2024-09-14T11:08:58.793 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 compressor 2024-09-14T11:08:58.793 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluestore 2024-09-14T11:08:58.793 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 bluefs 2024-09-14T11:08:58.793 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 3 bdev 2024-09-14T11:08:58.793 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 kstore 2024-09-14T11:08:58.793 INFO:tasks.workunit.client.0.smithi097.stderr: 4/ 5 rocksdb 2024-09-14T11:08:58.793 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 fuse 2024-09-14T11:08:58.793 INFO:tasks.workunit.client.0.smithi097.stderr: 2/ 5 mgr 2024-09-14T11:08:58.793 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mgrc 2024-09-14T11:08:58.793 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 dpdk 2024-09-14T11:08:58.793 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 eventtrace 2024-09-14T11:08:58.793 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 prioritycache 2024-09-14T11:08:58.793 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 test 2024-09-14T11:08:58.793 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:08:58.794 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cephsqlite 2024-09-14T11:08:58.794 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:08:58.794 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore 2024-09-14T11:08:58.794 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_onode 2024-09-14T11:08:58.794 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_odata 2024-09-14T11:08:58.794 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_omap 2024-09-14T11:08:58.794 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_tm 2024-09-14T11:08:58.794 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_t 2024-09-14T11:08:58.794 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:08:58.794 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_epm 2024-09-14T11:08:58.794 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_lba 2024-09-14T11:08:58.794 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:08:58.794 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_cache 2024-09-14T11:08:58.794 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_journal 2024-09-14T11:08:58.795 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_device 2024-09-14T11:08:58.795 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 seastore_backref 2024-09-14T11:08:58.795 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 alienstore 2024-09-14T11:08:58.795 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 mclock 2024-09-14T11:08:58.795 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 cyanstore 2024-09-14T11:08:58.795 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 ceph_exporter 2024-09-14T11:08:58.795 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 memstore 2024-09-14T11:08:58.795 INFO:tasks.workunit.client.0.smithi097.stderr: 1/ 5 trace 2024-09-14T11:08:58.795 INFO:tasks.workunit.client.0.smithi097.stderr: 0/ 5 ceph_dedup 2024-09-14T11:08:58.795 INFO:tasks.workunit.client.0.smithi097.stderr: -2/-2 (syslog threshold) 2024-09-14T11:08:58.795 INFO:tasks.workunit.client.0.smithi097.stderr: 99/99 (stderr threshold) 2024-09-14T11:08:58.795 INFO:tasks.workunit.client.0.smithi097.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:08:58.795 INFO:tasks.workunit.client.0.smithi097.stderr: 7efcc77fe640 / http_manager 2024-09-14T11:08:58.795 INFO:tasks.workunit.client.0.smithi097.stderr: 7efcce7e4640 / http_manager 2024-09-14T11:08:58.796 INFO:tasks.workunit.client.0.smithi097.stderr: 7efccf7e6640 / rgw_dt_lg_renew 2024-09-14T11:08:58.796 INFO:tasks.workunit.client.0.smithi097.stderr: 7efcee7fc640 / ms_dispatch 2024-09-14T11:08:58.796 INFO:tasks.workunit.client.0.smithi097.stderr: 7efceffff640 / io_context_pool 2024-09-14T11:08:58.796 INFO:tasks.workunit.client.0.smithi097.stderr: 7efcfe7fc640 / ms_dispatch 2024-09-14T11:08:58.796 INFO:tasks.workunit.client.0.smithi097.stderr: 7efd0560a640 / ms_dispatch 2024-09-14T11:08:58.796 INFO:tasks.workunit.client.0.smithi097.stderr: 7efd06e0d640 / io_context_pool 2024-09-14T11:08:58.796 INFO:tasks.workunit.client.0.smithi097.stderr: 7efe1820b640 / msgr-worker-2 2024-09-14T11:08:58.796 INFO:tasks.workunit.client.0.smithi097.stderr: 7efe18a0c640 / msgr-worker-1 2024-09-14T11:08:58.796 INFO:tasks.workunit.client.0.smithi097.stderr: 7efe1920d640 / msgr-worker-0 2024-09-14T11:08:58.796 INFO:tasks.workunit.client.0.smithi097.stderr: 7efe19a0e640 / io_context_pool 2024-09-14T11:08:58.796 INFO:tasks.workunit.client.0.smithi097.stderr: 7efe1cd23800 / radosgw-admin 2024-09-14T11:08:58.796 INFO:tasks.workunit.client.0.smithi097.stderr: max_recent 500 2024-09-14T11:08:58.796 INFO:tasks.workunit.client.0.smithi097.stderr: max_new 1000 2024-09-14T11:08:58.796 INFO:tasks.workunit.client.0.smithi097.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:08:58.661163Z_28c65fdf-c9b2-4bac-a182-6484549b0af8/log 2024-09-14T11:08:58.797 INFO:tasks.workunit.client.0.smithi097.stderr:--- end dump of recent events --- 2024-09-14T11:08:58.797 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:08:58.798 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:08:58.798 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:08:58.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.735+0000 7fd0b912c800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.737+0000 7fd0b912c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:58.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.737+0000 7fd0b912c800 20 realm 2024-09-14T11:08:58.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.737+0000 7fd0b912c800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.737+0000 7fd0b912c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:58.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.737+0000 7fd0b912c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:08:58.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.737+0000 7fd0b912c800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.737+0000 7fd0b912c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:58.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.737+0000 7fd0b912c800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.738+0000 7fd0b912c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:08:58.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.738+0000 7fd0b912c800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.739+0000 7fd0b912c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:08:58.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.739+0000 7fd0b912c800 20 searching for the correct realm 2024-09-14T11:08:58.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.741+0000 7fd0affff640 0 -- 172.21.15.97:0/4267456493 >> [v2:172.21.15.97:6816/4093696477,v1:172.21.15.97:6817/4093696477] conn(0x55e93a363530 msgr2=0x55e93a365920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:08:58.799 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.744+0000 7fd0affff640 0 -- 172.21.15.97:0/4267456493 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7fd0a80abbc0 msgr2=0x7fd0a806c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:08:58.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.951+0000 7fd0b912c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:08:58.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.951+0000 7fd0b912c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:08:58.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.951+0000 7fd0b912c800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:08:58.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.951+0000 7fd0b912c800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:08:58.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.951+0000 7fd0b912c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:08:58.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.951+0000 7fd0b912c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:08:58.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.951+0000 7fd0b912c800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.951+0000 7fd0b912c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:58.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.951+0000 7fd0b912c800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.950 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.951+0000 7fd0b912c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:08:58.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.951+0000 7fd0b912c800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.951 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.952+0000 7fd0b912c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:08:58.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.952+0000 7fd0b912c800 20 zone default found 2024-09-14T11:08:58.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.952+0000 7fd0b912c800 4 Realm: () 2024-09-14T11:08:58.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.952+0000 7fd0b912c800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:08:58.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.952+0000 7fd0b912c800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:08:58.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.952+0000 7fd0b912c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:08:58.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.952+0000 7fd0b912c800 20 zonegroup default 2024-09-14T11:08:58.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.952+0000 7fd0b912c800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.952+0000 7fd0b912c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:58.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.952+0000 7fd0b912c800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.952+0000 7fd0b912c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:58.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.952+0000 7fd0b912c800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.953+0000 7fd0b912c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:58.952 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.953+0000 7fd0b912c800 20 started sync module instance, tier type = 2024-09-14T11:08:58.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.953+0000 7fd0b912c800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:08:58.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.963+0000 7fd0b912c800 20 add_watcher() i=0 2024-09-14T11:08:58.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.963+0000 7fd0b912c800 20 add_watcher() i=1 2024-09-14T11:08:58.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.963+0000 7fd0b912c800 20 add_watcher() i=2 2024-09-14T11:08:58.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.963+0000 7fd0b912c800 20 add_watcher() i=3 2024-09-14T11:08:58.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.963+0000 7fd0b912c800 20 add_watcher() i=4 2024-09-14T11:08:58.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.963+0000 7fd0b912c800 20 add_watcher() i=5 2024-09-14T11:08:58.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.963+0000 7fd0b912c800 20 add_watcher() i=6 2024-09-14T11:08:58.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.964+0000 7fd0b912c800 20 add_watcher() i=7 2024-09-14T11:08:58.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.964+0000 7fd0b912c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:08:58.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.966+0000 7fcf6afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:08:58.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.966+0000 7fd0b912c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:08:58.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.966+0000 7fd0b912c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:08:58.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.966+0000 7fd0b912c800 5 note: GC not initialized 2024-09-14T11:08:58.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.966+0000 7fcf69fe3640 20 reqs_thread_entry: start 2024-09-14T11:08:58.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.966+0000 7fd0b912c800 20 init_complete bucket index max shards: 11 2024-09-14T11:08:58.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.966+0000 7fd0b912c800 20 Filter name: none 2024-09-14T11:08:58.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.966+0000 7fcedb7fe640 20 reqs_thread_entry: start 2024-09-14T11:08:58.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.966+0000 7fd0b912c800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.967+0000 7fd0b912c800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:08:58.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.967+0000 7fd0b912c800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.967 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.967+0000 7fd0b912c800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:08:58.967 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.967+0000 7fd0b912c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:08:58.967 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.967+0000 7fd0b912c800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.967 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.968+0000 7fd0b912c800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:08:58.967 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.968+0000 7fd0b912c800 20 rados->read ofs=0 len=0 2024-09-14T11:08:58.967 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.968+0000 7fd0b912c800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:08:58.967 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.968+0000 7fd0b912c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:08:58.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.970+0000 7fcf6afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:08:58.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.972+0000 7fd0b912c800 20 remove_watcher() i=0 2024-09-14T11:08:58.971 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.972+0000 7fd0b912c800 2 removed watcher, disabling cache 2024-09-14T11:08:58.971 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.973+0000 7fd0b912c800 20 remove_watcher() i=1 2024-09-14T11:08:58.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.974+0000 7fd0b912c800 20 remove_watcher() i=2 2024-09-14T11:08:58.974 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.975+0000 7fd0b912c800 20 remove_watcher() i=3 2024-09-14T11:08:58.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.976+0000 7fd0b912c800 20 remove_watcher() i=4 2024-09-14T11:08:58.976 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.977+0000 7fd0b912c800 20 remove_watcher() i=5 2024-09-14T11:08:58.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.978+0000 7fd0b912c800 20 remove_watcher() i=6 2024-09-14T11:08:58.978 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:58.979+0000 7fd0b912c800 20 remove_watcher() i=7 2024-09-14T11:08:58.999 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:08:59.027 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:08:59.027 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:08:59.267 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.268+0000 7f678fb23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:59.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.270+0000 7f678fb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:59.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.270+0000 7f678fb23800 20 realm 2024-09-14T11:08:59.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.270+0000 7f678fb23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:59.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.270+0000 7f678fb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:59.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.270+0000 7f678fb23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:08:59.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.270+0000 7f678fb23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:59.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.270+0000 7f678fb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:59.269 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.270+0000 7f678fb23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:59.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.271+0000 7f678fb23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:08:59.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.271+0000 7f678fb23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:59.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.272+0000 7f678fb23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:08:59.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.272+0000 7f678fb23800 20 searching for the correct realm 2024-09-14T11:08:59.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.274+0000 7f678c00d640 0 -- 172.21.15.97:0/305594338 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f6780078310 msgr2=0x7f678008c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:08:59.477 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.479+0000 7f678b00b640 0 -- 172.21.15.97:0/305594338 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f677c097040 msgr2=0x7f677c0693f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:08:59.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.485+0000 7f678fb23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:08:59.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.485+0000 7f678fb23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:08:59.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.485+0000 7f678fb23800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:08:59.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.485+0000 7f678fb23800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:08:59.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.485+0000 7f678fb23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:08:59.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.485+0000 7f678fb23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:08:59.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.485+0000 7f678fb23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:59.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.485+0000 7f678fb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:59.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.485+0000 7f678fb23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:59.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.485+0000 7f678fb23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:08:59.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.485+0000 7f678fb23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:59.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.486+0000 7f678fb23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:08:59.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.486+0000 7f678fb23800 20 zone default found 2024-09-14T11:08:59.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.486+0000 7f678fb23800 4 Realm: () 2024-09-14T11:08:59.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.486+0000 7f678fb23800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:08:59.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.486+0000 7f678fb23800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:08:59.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.486+0000 7f678fb23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:08:59.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.486+0000 7f678fb23800 20 zonegroup default 2024-09-14T11:08:59.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.486+0000 7f678fb23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:59.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.486+0000 7f678fb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:59.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.486+0000 7f678fb23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:59.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.486+0000 7f678fb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:59.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.486+0000 7f678fb23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:59.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.487+0000 7f678fb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:59.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.487+0000 7f678fb23800 20 started sync module instance, tier type = 2024-09-14T11:08:59.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.487+0000 7f678fb23800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:08:59.495 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.497+0000 7f678fb23800 20 add_watcher() i=0 2024-09-14T11:08:59.495 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.497+0000 7f678fb23800 20 add_watcher() i=1 2024-09-14T11:08:59.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.497+0000 7f678fb23800 20 add_watcher() i=2 2024-09-14T11:08:59.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.497+0000 7f678fb23800 20 add_watcher() i=3 2024-09-14T11:08:59.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.497+0000 7f678fb23800 20 add_watcher() i=4 2024-09-14T11:08:59.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.497+0000 7f678fb23800 20 add_watcher() i=5 2024-09-14T11:08:59.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.497+0000 7f678fb23800 20 add_watcher() i=6 2024-09-14T11:08:59.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.498+0000 7f678fb23800 20 add_watcher() i=7 2024-09-14T11:08:59.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.498+0000 7f678fb23800 2 all 8 watchers are set, enabling cache 2024-09-14T11:08:59.498 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.500+0000 7f6641fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:08:59.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.500+0000 7f678fb23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:08:59.499 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.500+0000 7f678fb23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:08:59.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.500+0000 7f678fb23800 5 note: GC not initialized 2024-09-14T11:08:59.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.500+0000 7f6640fe1640 20 reqs_thread_entry: start 2024-09-14T11:08:59.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.500+0000 7f678fb23800 20 init_complete bucket index max shards: 11 2024-09-14T11:08:59.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.500+0000 7f678fb23800 20 Filter name: none 2024-09-14T11:08:59.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.501+0000 7f65ba7fc640 20 reqs_thread_entry: start 2024-09-14T11:08:59.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.501+0000 7f678fb23800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:08:59.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.501+0000 7f678fb23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:59.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.501+0000 7f678fb23800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:08:59.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.501+0000 7f678fb23800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:08:59.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.501+0000 7f678fb23800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:08:59.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.501+0000 7f678fb23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 : miss 2024-09-14T11:08:59.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.501+0000 7f678fb23800 20 rados->read ofs=0 len=0 2024-09-14T11:08:59.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.501+0000 7f678fb23800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:08:59.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.501+0000 7f678fb23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:08:59.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.501+0000 7f678fb23800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:08:59.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.502+0000 7f678fb23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:08:59.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.502+0000 7f678fb23800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:08:59.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.502+0000 7f678fb23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 2024-09-14T11:08:59.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.502+0000 7f678fb23800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.0 2024-09-14T11:08:59.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.502+0000 7f678fb23800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.0 2024-09-14T11:08:59.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.502+0000 7f678fb23800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.1 2024-09-14T11:08:59.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.502+0000 7f678fb23800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.1 2024-09-14T11:08:59.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.502+0000 7f678fb23800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.2 2024-09-14T11:08:59.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.502+0000 7f678fb23800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.2 2024-09-14T11:08:59.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.503+0000 7f678fb23800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.3 2024-09-14T11:08:59.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.503+0000 7f678fb23800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.3 2024-09-14T11:08:59.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.503+0000 7f678fb23800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.4 2024-09-14T11:08:59.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.503+0000 7f678fb23800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.4 2024-09-14T11:08:59.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.503+0000 7f678fb23800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.5 2024-09-14T11:08:59.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.503+0000 7f678fb23800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.5 2024-09-14T11:08:59.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.504+0000 7f678fb23800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.6 2024-09-14T11:08:59.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.504+0000 7f678fb23800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.6 2024-09-14T11:08:59.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.504+0000 7f678fb23800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.7 2024-09-14T11:08:59.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.504+0000 7f678fb23800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.7 2024-09-14T11:08:59.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.504+0000 7f678fb23800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.8 2024-09-14T11:08:59.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.504+0000 7f678fb23800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.8 2024-09-14T11:08:59.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.505+0000 7f678fb23800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.9 2024-09-14T11:08:59.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.505+0000 7f678fb23800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.9 2024-09-14T11:08:59.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.505+0000 7f678fb23800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.10 2024-09-14T11:08:59.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.505+0000 7f678fb23800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.10 2024-09-14T11:08:59.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.506+0000 7f678fb23800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.11 2024-09-14T11:08:59.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.506+0000 7f678fb23800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.11 2024-09-14T11:08:59.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.506+0000 7f678fb23800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.12 2024-09-14T11:08:59.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.506+0000 7f678fb23800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.12 2024-09-14T11:08:59.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.507+0000 7f6641fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:08:59.508 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.509+0000 7f678fb23800 20 remove_watcher() i=0 2024-09-14T11:08:59.508 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.509+0000 7f678fb23800 2 removed watcher, disabling cache 2024-09-14T11:08:59.509 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.510+0000 7f678fb23800 20 remove_watcher() i=1 2024-09-14T11:08:59.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.512+0000 7f678fb23800 20 remove_watcher() i=2 2024-09-14T11:08:59.511 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.513+0000 7f678fb23800 20 remove_watcher() i=3 2024-09-14T11:08:59.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.514+0000 7f678fb23800 20 remove_watcher() i=4 2024-09-14T11:08:59.513 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.515+0000 7f678fb23800 20 remove_watcher() i=5 2024-09-14T11:08:59.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.516+0000 7f678fb23800 20 remove_watcher() i=6 2024-09-14T11:08:59.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:08:59.517+0000 7f678fb23800 20 remove_watcher() i=7 2024-09-14T11:09:29.556 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin reshardlog purge --bucket a-bucket 2024-09-14T11:09:29.588 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:29.588 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:29.630 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.632+0000 7f43f8b24800 20 rados->read ofs=0 len=0 2024-09-14T11:09:29.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.633+0000 7f43f8b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:29.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.633+0000 7f43f8b24800 20 realm 2024-09-14T11:09:29.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.633+0000 7f43f8b24800 20 rados->read ofs=0 len=0 2024-09-14T11:09:29.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.634+0000 7f43f8b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:29.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.634+0000 7f43f8b24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:29.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.634+0000 7f43f8b24800 20 rados->read ofs=0 len=0 2024-09-14T11:09:29.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.634+0000 7f43f8b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:29.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.634+0000 7f43f8b24800 20 rados->read ofs=0 len=0 2024-09-14T11:09:29.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.635+0000 7f43f8b24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:29.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.635+0000 7f43f8b24800 20 rados->read ofs=0 len=0 2024-09-14T11:09:29.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.636+0000 7f43f8b24800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:09:29.634 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.636+0000 7f43f8b24800 20 searching for the correct realm 2024-09-14T11:09:29.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.638+0000 7f43f5069640 0 -- 172.21.15.97:0/182364609 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f43e8032060 msgr2=0x7f43e8066850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:29.843 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.844+0000 7f43f4067640 0 -- 172.21.15.97:0/182364609 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f43e406d400 msgr2=0x7f43e406d880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:29.849 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.850+0000 7f43f8b24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:29.849 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.850+0000 7f43f8b24800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:29.849 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.850+0000 7f43f8b24800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:09:29.849 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.850+0000 7f43f8b24800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:09:29.849 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.850+0000 7f43f8b24800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:29.849 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.850+0000 7f43f8b24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:29.849 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.850+0000 7f43f8b24800 20 rados->read ofs=0 len=0 2024-09-14T11:09:29.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.850+0000 7f43f8b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:29.850 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.850+0000 7f43f8b24800 20 rados->read ofs=0 len=0 2024-09-14T11:09:29.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.850+0000 7f43f8b24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:29.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.850+0000 7f43f8b24800 20 rados->read ofs=0 len=0 2024-09-14T11:09:29.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.851+0000 7f43f8b24800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:09:29.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.851+0000 7f43f8b24800 20 zone default found 2024-09-14T11:09:29.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.851+0000 7f43f8b24800 4 Realm: () 2024-09-14T11:09:29.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.851+0000 7f43f8b24800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:09:29.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.851+0000 7f43f8b24800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:09:29.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.851+0000 7f43f8b24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:29.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.851+0000 7f43f8b24800 20 zonegroup default 2024-09-14T11:09:29.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.851+0000 7f43f8b24800 20 rados->read ofs=0 len=0 2024-09-14T11:09:29.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.851+0000 7f43f8b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:29.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.851+0000 7f43f8b24800 20 rados->read ofs=0 len=0 2024-09-14T11:09:29.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.852+0000 7f43f8b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:29.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.852+0000 7f43f8b24800 20 rados->read ofs=0 len=0 2024-09-14T11:09:29.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.852+0000 7f43f8b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:29.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.852+0000 7f43f8b24800 20 started sync module instance, tier type = 2024-09-14T11:09:29.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.852+0000 7f43f8b24800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:09:29.860 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.862+0000 7f43f8b24800 20 add_watcher() i=0 2024-09-14T11:09:29.861 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.862+0000 7f43f8b24800 20 add_watcher() i=1 2024-09-14T11:09:29.861 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.862+0000 7f43f8b24800 20 add_watcher() i=2 2024-09-14T11:09:29.861 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.862+0000 7f43f8b24800 20 add_watcher() i=3 2024-09-14T11:09:29.861 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.862+0000 7f43f8b24800 20 add_watcher() i=4 2024-09-14T11:09:29.861 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.862+0000 7f43f8b24800 20 add_watcher() i=5 2024-09-14T11:09:29.861 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.862+0000 7f43f8b24800 20 add_watcher() i=6 2024-09-14T11:09:29.861 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.863+0000 7f43f8b24800 20 add_watcher() i=7 2024-09-14T11:09:29.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.863+0000 7f43f8b24800 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:29.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.865+0000 7f42aafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:29.864 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.865+0000 7f43f8b24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:29.864 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.865+0000 7f43f8b24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:29.864 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.865+0000 7f43f8b24800 5 note: GC not initialized 2024-09-14T11:09:29.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.865+0000 7f42a9fe3640 20 reqs_thread_entry: start 2024-09-14T11:09:29.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.866+0000 7f43f8b24800 20 init_complete bucket index max shards: 11 2024-09-14T11:09:29.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.866+0000 7f43f8b24800 20 Filter name: none 2024-09-14T11:09:29.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.866+0000 7f421b7fe640 20 reqs_thread_entry: start 2024-09-14T11:09:29.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.866+0000 7f43f8b24800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:09:29.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.866+0000 7f43f8b24800 20 rados->read ofs=0 len=0 2024-09-14T11:09:29.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.866+0000 7f43f8b24800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:09:29.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.866+0000 7f43f8b24800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:09:29.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.866+0000 7f43f8b24800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:09:29.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.866+0000 7f43f8b24800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 : miss 2024-09-14T11:09:29.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.866+0000 7f43f8b24800 20 rados->read ofs=0 len=0 2024-09-14T11:09:29.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.867+0000 7f43f8b24800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:09:29.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.867+0000 7f43f8b24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:09:29.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.867+0000 7f43f8b24800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:09:29.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.867+0000 7f43f8b24800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:09:29.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.867+0000 7f43f8b24800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:09:29.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.867+0000 7f43f8b24800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 2024-09-14T11:09:29.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.871+0000 7f42aafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:29.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.873+0000 7f43f8b24800 20 remove_watcher() i=0 2024-09-14T11:09:29.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.873+0000 7f43f8b24800 2 removed watcher, disabling cache 2024-09-14T11:09:29.873 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.875+0000 7f43f8b24800 20 remove_watcher() i=1 2024-09-14T11:09:29.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.876+0000 7f43f8b24800 20 remove_watcher() i=2 2024-09-14T11:09:29.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.877+0000 7f43f8b24800 20 remove_watcher() i=3 2024-09-14T11:09:29.876 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.878+0000 7f43f8b24800 20 remove_watcher() i=4 2024-09-14T11:09:29.877 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.879+0000 7f43f8b24800 20 remove_watcher() i=5 2024-09-14T11:09:29.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.880+0000 7f43f8b24800 20 remove_watcher() i=6 2024-09-14T11:09:29.880 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.881+0000 7f43f8b24800 20 remove_watcher() i=7 2024-09-14T11:09:29.892 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:09:29.922 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:29.922 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:29.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.962+0000 7f31abb26800 20 rados->read ofs=0 len=0 2024-09-14T11:09:29.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.963+0000 7f31abb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:29.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.963+0000 7f31abb26800 20 realm 2024-09-14T11:09:29.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.963+0000 7f31abb26800 20 rados->read ofs=0 len=0 2024-09-14T11:09:29.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.964+0000 7f31abb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:29.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.964+0000 7f31abb26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:29.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.964+0000 7f31abb26800 20 rados->read ofs=0 len=0 2024-09-14T11:09:29.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.964+0000 7f31abb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:29.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.964+0000 7f31abb26800 20 rados->read ofs=0 len=0 2024-09-14T11:09:29.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.965+0000 7f31abb26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:29.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.965+0000 7f31abb26800 20 rados->read ofs=0 len=0 2024-09-14T11:09:29.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.965+0000 7f31abb26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:09:29.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.965+0000 7f31abb26800 20 searching for the correct realm 2024-09-14T11:09:29.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.966+0000 7f31a784b640 0 -- 172.21.15.97:0/3629542422 >> [v2:172.21.15.152:6808/1010851305,v1:172.21.15.152:6809/1010851305] conn(0x55bf7ce2ccb0 msgr2=0x55bf7ce2f170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:29.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.970+0000 7f31a784b640 0 -- 172.21.15.97:0/3629542422 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x55bf7ce203f0 msgr2=0x55bf7ce228b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:29.974 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.975+0000 7f31abb26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:29.974 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.975+0000 7f31abb26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:29.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.975+0000 7f31abb26800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:09:29.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.975+0000 7f31abb26800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:09:29.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.975+0000 7f31abb26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:29.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.975+0000 7f31abb26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:29.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.975+0000 7f31abb26800 20 rados->read ofs=0 len=0 2024-09-14T11:09:29.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.976+0000 7f31abb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:29.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.976+0000 7f31abb26800 20 rados->read ofs=0 len=0 2024-09-14T11:09:29.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.976+0000 7f31abb26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:29.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.976+0000 7f31abb26800 20 rados->read ofs=0 len=0 2024-09-14T11:09:29.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.976+0000 7f31abb26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:09:29.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.976+0000 7f31abb26800 20 zone default found 2024-09-14T11:09:29.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.976+0000 7f31abb26800 4 Realm: () 2024-09-14T11:09:29.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.976+0000 7f31abb26800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:09:29.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.976+0000 7f31abb26800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:09:29.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.976+0000 7f31abb26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:29.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.976+0000 7f31abb26800 20 zonegroup default 2024-09-14T11:09:29.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.976+0000 7f31abb26800 20 rados->read ofs=0 len=0 2024-09-14T11:09:29.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.976+0000 7f31abb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:29.978 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.977+0000 7f31abb26800 20 rados->read ofs=0 len=0 2024-09-14T11:09:29.978 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.977+0000 7f31abb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:29.978 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.977+0000 7f31abb26800 20 rados->read ofs=0 len=0 2024-09-14T11:09:29.978 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.977+0000 7f31abb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:29.978 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.977+0000 7f31abb26800 20 started sync module instance, tier type = 2024-09-14T11:09:29.978 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.977+0000 7f31abb26800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:09:29.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.986+0000 7f31abb26800 20 add_watcher() i=0 2024-09-14T11:09:29.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.986+0000 7f31abb26800 20 add_watcher() i=1 2024-09-14T11:09:29.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.986+0000 7f31abb26800 20 add_watcher() i=2 2024-09-14T11:09:29.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.986+0000 7f31abb26800 20 add_watcher() i=3 2024-09-14T11:09:29.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.986+0000 7f31abb26800 20 add_watcher() i=4 2024-09-14T11:09:29.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.986+0000 7f31abb26800 20 add_watcher() i=5 2024-09-14T11:09:29.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.986+0000 7f31abb26800 20 add_watcher() i=6 2024-09-14T11:09:29.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.987+0000 7f31abb26800 20 add_watcher() i=7 2024-09-14T11:09:29.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.987+0000 7f31abb26800 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:29.987 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.989+0000 7f305dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:29.988 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.989+0000 7f31abb26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:29.988 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.989+0000 7f31abb26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:29.988 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.989+0000 7f31abb26800 5 note: GC not initialized 2024-09-14T11:09:29.988 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.989+0000 7f305cfe1640 20 reqs_thread_entry: start 2024-09-14T11:09:29.988 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.989+0000 7f31abb26800 20 init_complete bucket index max shards: 11 2024-09-14T11:09:29.988 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.989+0000 7f31abb26800 20 Filter name: none 2024-09-14T11:09:29.988 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.989+0000 7f2fd67fc640 20 reqs_thread_entry: start 2024-09-14T11:09:29.989 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.990+0000 7f31abb26800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:09:29.989 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.990+0000 7f31abb26800 20 rados->read ofs=0 len=0 2024-09-14T11:09:29.990 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.990+0000 7f31abb26800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:09:29.990 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.990+0000 7f31abb26800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:09:29.990 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.990+0000 7f31abb26800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:09:29.990 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.990+0000 7f31abb26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 : miss 2024-09-14T11:09:29.990 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.990+0000 7f31abb26800 20 rados->read ofs=0 len=0 2024-09-14T11:09:29.990 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.990+0000 7f31abb26800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:09:29.990 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.990+0000 7f31abb26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:09:29.990 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.990+0000 7f31abb26800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:09:29.990 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.990+0000 7f31abb26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:09:29.990 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.990+0000 7f31abb26800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:09:29.990 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.990+0000 7f31abb26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 2024-09-14T11:09:29.990 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.990+0000 7f31abb26800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.0 2024-09-14T11:09:29.991 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.990+0000 7f31abb26800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.0 2024-09-14T11:09:29.991 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.991+0000 7f31abb26800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.1 2024-09-14T11:09:29.991 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.991+0000 7f31abb26800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.1 2024-09-14T11:09:29.991 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.991+0000 7f31abb26800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.2 2024-09-14T11:09:29.991 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.991+0000 7f31abb26800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.2 2024-09-14T11:09:29.992 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.991+0000 7f31abb26800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.3 2024-09-14T11:09:29.992 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.991+0000 7f31abb26800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.3 2024-09-14T11:09:29.992 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.992+0000 7f31abb26800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.4 2024-09-14T11:09:29.992 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.992+0000 7f31abb26800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.4 2024-09-14T11:09:29.992 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.992+0000 7f31abb26800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.5 2024-09-14T11:09:29.992 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.992+0000 7f31abb26800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.5 2024-09-14T11:09:29.992 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.992+0000 7f31abb26800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.6 2024-09-14T11:09:29.992 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.992+0000 7f31abb26800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.6 2024-09-14T11:09:29.992 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.993+0000 7f31abb26800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.7 2024-09-14T11:09:29.992 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.993+0000 7f31abb26800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.7 2024-09-14T11:09:29.993 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.993+0000 7f31abb26800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.8 2024-09-14T11:09:29.993 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.993+0000 7f31abb26800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.8 2024-09-14T11:09:29.993 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.993+0000 7f31abb26800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.9 2024-09-14T11:09:29.993 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.993+0000 7f31abb26800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.9 2024-09-14T11:09:29.993 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.994+0000 7f31abb26800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.10 2024-09-14T11:09:29.993 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.994+0000 7f31abb26800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.10 2024-09-14T11:09:29.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.994+0000 7f31abb26800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.11 2024-09-14T11:09:29.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.994+0000 7f31abb26800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.11 2024-09-14T11:09:29.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.994+0000 7f31abb26800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.12 2024-09-14T11:09:29.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.994+0000 7f31abb26800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.12 2024-09-14T11:09:29.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.995+0000 7f305dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:29.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.998+0000 7f31abb26800 20 remove_watcher() i=0 2024-09-14T11:09:29.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.998+0000 7f31abb26800 2 removed watcher, disabling cache 2024-09-14T11:09:29.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:29.999+0000 7f31abb26800 20 remove_watcher() i=1 2024-09-14T11:09:29.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.000+0000 7f31abb26800 20 remove_watcher() i=2 2024-09-14T11:09:30.000 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.001+0000 7f31abb26800 20 remove_watcher() i=3 2024-09-14T11:09:30.001 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.002+0000 7f31abb26800 20 remove_watcher() i=4 2024-09-14T11:09:30.001 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.003+0000 7f31abb26800 20 remove_watcher() i=5 2024-09-14T11:09:30.002 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.004+0000 7f31abb26800 20 remove_watcher() i=6 2024-09-14T11:09:30.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.005+0000 7f31abb26800 20 remove_watcher() i=7 2024-09-14T11:09:30.014 INFO:tasks.workunit.client.0.smithi097.stderr:check reshard logrecord successfully 2024-09-14T11:09:30.014 INFO:tasks.workunit.client.0.smithi097.stderr: test: reshard versioned bucket 2024-09-14T11:09:30.015 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:09:30.044 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:30.044 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:30.080 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.082+0000 7fb7c3139800 20 rados->read ofs=0 len=0 2024-09-14T11:09:30.082 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.083+0000 7fb7c3139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:30.082 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.083+0000 7fb7c3139800 20 realm 2024-09-14T11:09:30.082 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.083+0000 7fb7c3139800 20 rados->read ofs=0 len=0 2024-09-14T11:09:30.082 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.084+0000 7fb7c3139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:30.082 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.084+0000 7fb7c3139800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:30.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.084+0000 7fb7c3139800 20 rados->read ofs=0 len=0 2024-09-14T11:09:30.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.084+0000 7fb7c3139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:30.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.084+0000 7fb7c3139800 20 rados->read ofs=0 len=0 2024-09-14T11:09:30.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.084+0000 7fb7c3139800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:30.083 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.084+0000 7fb7c3139800 20 rados->read ofs=0 len=0 2024-09-14T11:09:30.084 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.085+0000 7fb7c3139800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:09:30.084 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.085+0000 7fb7c3139800 20 searching for the correct realm 2024-09-14T11:09:30.085 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.087+0000 7fb7bf5cf640 0 -- 172.21.15.97:0/2822281539 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x562bd8e8f370 msgr2=0x562bd8e91760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:30.089 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.090+0000 7fb7bedce640 0 -- 172.21.15.97:0/2822281539 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7fb7a8087440 msgr2=0x7fb7a80878c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:30.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.095+0000 7fb7c3139800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:30.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.095+0000 7fb7c3139800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:30.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.095+0000 7fb7c3139800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:09:30.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.095+0000 7fb7c3139800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:09:30.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.095+0000 7fb7c3139800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:30.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.095+0000 7fb7c3139800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:30.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.095+0000 7fb7c3139800 20 rados->read ofs=0 len=0 2024-09-14T11:09:30.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.096+0000 7fb7c3139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:30.094 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.096+0000 7fb7c3139800 20 rados->read ofs=0 len=0 2024-09-14T11:09:30.095 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.096+0000 7fb7c3139800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:30.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.096+0000 7fb7c3139800 20 rados->read ofs=0 len=0 2024-09-14T11:09:30.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.096+0000 7fb7c3139800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:09:30.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.096+0000 7fb7c3139800 20 zone default found 2024-09-14T11:09:30.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.096+0000 7fb7c3139800 4 Realm: () 2024-09-14T11:09:30.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.096+0000 7fb7c3139800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:09:30.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.096+0000 7fb7c3139800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:09:30.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.096+0000 7fb7c3139800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:30.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.096+0000 7fb7c3139800 20 zonegroup default 2024-09-14T11:09:30.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.096+0000 7fb7c3139800 20 rados->read ofs=0 len=0 2024-09-14T11:09:30.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.096+0000 7fb7c3139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:30.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.096+0000 7fb7c3139800 20 rados->read ofs=0 len=0 2024-09-14T11:09:30.096 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.097+0000 7fb7c3139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:30.097 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.097+0000 7fb7c3139800 20 rados->read ofs=0 len=0 2024-09-14T11:09:30.097 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.097+0000 7fb7c3139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:30.097 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.097+0000 7fb7c3139800 20 started sync module instance, tier type = 2024-09-14T11:09:30.097 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.097+0000 7fb7c3139800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:09:30.104 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.106+0000 7fb7c3139800 20 add_watcher() i=0 2024-09-14T11:09:30.104 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.106+0000 7fb7c3139800 20 add_watcher() i=1 2024-09-14T11:09:30.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.106+0000 7fb7c3139800 20 add_watcher() i=2 2024-09-14T11:09:30.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.106+0000 7fb7c3139800 20 add_watcher() i=3 2024-09-14T11:09:30.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.106+0000 7fb7c3139800 20 add_watcher() i=4 2024-09-14T11:09:30.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.106+0000 7fb7c3139800 20 add_watcher() i=5 2024-09-14T11:09:30.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.106+0000 7fb7c3139800 20 add_watcher() i=6 2024-09-14T11:09:30.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.107+0000 7fb7c3139800 20 add_watcher() i=7 2024-09-14T11:09:30.105 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.107+0000 7fb7c3139800 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:30.107 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.108+0000 7fb6757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:30.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.109+0000 7fb7c3139800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:30.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.109+0000 7fb7c3139800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:30.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.109+0000 7fb7c3139800 5 note: GC not initialized 2024-09-14T11:09:30.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.109+0000 7fb5effff640 20 reqs_thread_entry: start 2024-09-14T11:09:30.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.109+0000 7fb7c3139800 20 init_complete bucket index max shards: 11 2024-09-14T11:09:30.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.109+0000 7fb7c3139800 20 Filter name: none 2024-09-14T11:09:30.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.109+0000 7fb5edffb640 20 reqs_thread_entry: start 2024-09-14T11:09:30.108 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.109+0000 7fb7c3139800 20 rados->read ofs=0 len=0 2024-09-14T11:09:30.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.110+0000 7fb7c3139800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:09:30.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.110+0000 7fb7c3139800 20 rados->read ofs=0 len=0 2024-09-14T11:09:30.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.110+0000 7fb7c3139800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:09:30.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.110+0000 7fb7c3139800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:09:30.109 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.110+0000 7fb7c3139800 20 rados->read ofs=0 len=0 2024-09-14T11:09:30.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.111+0000 7fb7c3139800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:09:30.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.111+0000 7fb7c3139800 20 rados->read ofs=0 len=0 2024-09-14T11:09:30.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.111+0000 7fb7c3139800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:09:30.110 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.111+0000 7fb7c3139800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:09:30.111 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.113+0000 7fb6757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:30.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.115+0000 7fb7c3139800 20 remove_watcher() i=0 2024-09-14T11:09:30.113 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.115+0000 7fb7c3139800 2 removed watcher, disabling cache 2024-09-14T11:09:30.114 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.116+0000 7fb7c3139800 20 remove_watcher() i=1 2024-09-14T11:09:30.115 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.117+0000 7fb7c3139800 20 remove_watcher() i=2 2024-09-14T11:09:30.116 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.118+0000 7fb7c3139800 20 remove_watcher() i=3 2024-09-14T11:09:30.117 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.119+0000 7fb7c3139800 20 remove_watcher() i=4 2024-09-14T11:09:30.118 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.120+0000 7fb7c3139800 20 remove_watcher() i=5 2024-09-14T11:09:30.119 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.121+0000 7fb7c3139800 20 remove_watcher() i=6 2024-09-14T11:09:30.121 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.122+0000 7fb7c3139800 20 remove_watcher() i=7 2024-09-14T11:09:30.131 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:09:30.131 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:09:30.131 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: myver id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-14T11:09:30.131 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:09:30.132 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 12 2024-09-14T11:09:30.163 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:30.163 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:30.201 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.202+0000 7feeee92e800 20 rados->read ofs=0 len=0 2024-09-14T11:09:30.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.203+0000 7feeee92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:30.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.203+0000 7feeee92e800 20 realm 2024-09-14T11:09:30.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.203+0000 7feeee92e800 20 rados->read ofs=0 len=0 2024-09-14T11:09:30.202 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.204+0000 7feeee92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:30.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.204+0000 7feeee92e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:30.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.204+0000 7feeee92e800 20 rados->read ofs=0 len=0 2024-09-14T11:09:30.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.204+0000 7feeee92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:30.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.204+0000 7feeee92e800 20 rados->read ofs=0 len=0 2024-09-14T11:09:30.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.204+0000 7feeee92e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:30.203 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.204+0000 7feeee92e800 20 rados->read ofs=0 len=0 2024-09-14T11:09:30.204 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.205+0000 7feeee92e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:09:30.204 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.205+0000 7feeee92e800 20 searching for the correct realm 2024-09-14T11:09:30.206 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.207+0000 7feeeaede640 0 -- 172.21.15.97:0/1083025131 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7feed404f040 msgr2=0x7feed4066cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:30.410 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.412+0000 7feee1edc640 0 -- 172.21.15.97:0/1083025131 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7feedc08e040 msgr2=0x7feedc078900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:30.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.416+0000 7feeee92e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:30.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.416+0000 7feeee92e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:30.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.416+0000 7feeee92e800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:09:30.415 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.416+0000 7feeee92e800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:09:30.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.416+0000 7feeee92e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:30.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.416+0000 7feeee92e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:30.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.416+0000 7feeee92e800 20 rados->read ofs=0 len=0 2024-09-14T11:09:30.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.417+0000 7feeee92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:30.416 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.417+0000 7feeee92e800 20 rados->read ofs=0 len=0 2024-09-14T11:09:30.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.417+0000 7feeee92e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:30.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.417+0000 7feeee92e800 20 rados->read ofs=0 len=0 2024-09-14T11:09:30.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.417+0000 7feeee92e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:09:30.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.417+0000 7feeee92e800 20 zone default found 2024-09-14T11:09:30.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.417+0000 7feeee92e800 4 Realm: () 2024-09-14T11:09:30.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.417+0000 7feeee92e800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:09:30.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.417+0000 7feeee92e800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:09:30.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.417+0000 7feeee92e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:30.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.417+0000 7feeee92e800 20 zonegroup default 2024-09-14T11:09:30.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.417+0000 7feeee92e800 20 rados->read ofs=0 len=0 2024-09-14T11:09:30.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.418+0000 7feeee92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:30.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.418+0000 7feeee92e800 20 rados->read ofs=0 len=0 2024-09-14T11:09:30.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.418+0000 7feeee92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:30.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.418+0000 7feeee92e800 20 rados->read ofs=0 len=0 2024-09-14T11:09:30.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.418+0000 7feeee92e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:30.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.419+0000 7feeee92e800 20 started sync module instance, tier type = 2024-09-14T11:09:30.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.419+0000 7feeee92e800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:09:30.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.427+0000 7feeee92e800 20 add_watcher() i=0 2024-09-14T11:09:30.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.427+0000 7feeee92e800 20 add_watcher() i=1 2024-09-14T11:09:30.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.427+0000 7feeee92e800 20 add_watcher() i=2 2024-09-14T11:09:30.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.427+0000 7feeee92e800 20 add_watcher() i=3 2024-09-14T11:09:30.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.427+0000 7feeee92e800 20 add_watcher() i=4 2024-09-14T11:09:30.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.427+0000 7feeee92e800 20 add_watcher() i=5 2024-09-14T11:09:30.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.427+0000 7feeee92e800 20 add_watcher() i=6 2024-09-14T11:09:30.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.428+0000 7feeee92e800 20 add_watcher() i=7 2024-09-14T11:09:30.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.428+0000 7feeee92e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:30.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.430+0000 7feda0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:30.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.430+0000 7feeee92e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:30.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.430+0000 7feeee92e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:30.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.430+0000 7feeee92e800 5 note: GC not initialized 2024-09-14T11:09:30.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.431+0000 7fed1b7fe640 20 reqs_thread_entry: start 2024-09-14T11:09:30.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.431+0000 7feeee92e800 20 init_complete bucket index max shards: 11 2024-09-14T11:09:30.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.431+0000 7feeee92e800 20 Filter name: none 2024-09-14T11:09:30.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.431+0000 7fed197fa640 20 reqs_thread_entry: start 2024-09-14T11:09:30.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.431+0000 7feeee92e800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:09:30.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.431+0000 7feeee92e800 20 rados->read ofs=0 len=0 2024-09-14T11:09:30.431 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.431+0000 7feeee92e800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:09:30.431 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.431+0000 7feeee92e800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:09:30.431 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.431+0000 7feeee92e800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:09:30.431 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.431+0000 7feeee92e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 : miss 2024-09-14T11:09:30.431 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.431+0000 7feeee92e800 20 rados->read ofs=0 len=0 2024-09-14T11:09:30.431 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.432+0000 7feeee92e800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:09:30.431 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.432+0000 7feeee92e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 info.flags=0x17 2024-09-14T11:09:30.431 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.432+0000 7feeee92e800 10 adding default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 to cache LRU end 2024-09-14T11:09:30.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.432+0000 7feeee92e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:09:30.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.432+0000 7feeee92e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:09:30.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.432+0000 7feeee92e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 2024-09-14T11:09:30.435 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.437+0000 7feeee92e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 info.flags=0x17 2024-09-14T11:09:30.435 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.437+0000 7feeee92e800 10 moving default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 to cache LRU end 2024-09-14T11:09:30.435 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.437+0000 7feeee92e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:09:30.436 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.437+0000 7feeee92e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18, ofs0, ns] 2024-09-14T11:09:30.436 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.437+0000 7fedcd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595194 cookie 94569069278608 notifier 8517 bl.length()=821 2024-09-14T11:09:30.436 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.437+0000 7fedcd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 info.flags=0x17 2024-09-14T11:09:30.436 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.437+0000 7fedcd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 to cache LRU end 2024-09-14T11:09:30.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.437+0000 7fedcd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:09:30.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.438+0000 7feeee92e800 20 handle_bi_update(): bucket=:myver[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18]): orig_sources= new_sources= 2024-09-14T11:09:30.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.438+0000 7feeee92e800 20 handle_bi_update(): bucket=:myver[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18]): potential sources added=[] removed=[] 2024-09-14T11:09:30.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.438+0000 7feeee92e800 20 handle_bi_update(): bucket=:myver[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18]): orig_dests= new_dests= 2024-09-14T11:09:30.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.438+0000 7feeee92e800 20 handle_bi_update(): bucket=:myver[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18]): potential dests added=[] removed=[] 2024-09-14T11:09:30.440 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.442+0000 7feeee92e800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.0 2024-09-14T11:09:30.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.442+0000 7feeee92e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.0 2024-09-14T11:09:30.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.442+0000 7feeee92e800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.1 2024-09-14T11:09:30.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.442+0000 7feeee92e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.1 2024-09-14T11:09:30.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.442+0000 7feeee92e800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.2 2024-09-14T11:09:30.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.442+0000 7feeee92e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.2 2024-09-14T11:09:30.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.442+0000 7feeee92e800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.3 2024-09-14T11:09:30.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.442+0000 7feeee92e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.3 2024-09-14T11:09:30.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.442+0000 7feeee92e800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.4 2024-09-14T11:09:30.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.442+0000 7feeee92e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.4 2024-09-14T11:09:30.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.442+0000 7feeee92e800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.5 2024-09-14T11:09:30.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.442+0000 7feeee92e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.5 2024-09-14T11:09:30.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.442+0000 7feeee92e800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.6 2024-09-14T11:09:30.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.442+0000 7feeee92e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.6 2024-09-14T11:09:30.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.442+0000 7feeee92e800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.7 2024-09-14T11:09:30.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.442+0000 7feeee92e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.7 2024-09-14T11:09:30.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.442+0000 7feeee92e800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.8 2024-09-14T11:09:30.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.442+0000 7feeee92e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.8 2024-09-14T11:09:30.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.442+0000 7feeee92e800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.9 2024-09-14T11:09:30.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.442+0000 7feeee92e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.9 2024-09-14T11:09:30.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.442+0000 7feeee92e800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.10 2024-09-14T11:09:30.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.442+0000 7feeee92e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.10 2024-09-14T11:09:30.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.442+0000 7feeee92e800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.11 2024-09-14T11:09:30.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.442+0000 7feeee92e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.11 2024-09-14T11:09:30.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.442+0000 7feeee92e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.0 2024-09-14T11:09:30.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.442+0000 7feeee92e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1 2024-09-14T11:09:30.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.443+0000 7feeee92e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2 2024-09-14T11:09:30.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.443+0000 7feeee92e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3 2024-09-14T11:09:30.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.443+0000 7feeee92e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.4 2024-09-14T11:09:30.444 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.444+0000 7feeee92e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.5 2024-09-14T11:09:30.444 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.444+0000 7feeee92e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.6 2024-09-14T11:09:30.444 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.445+0000 7feeee92e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.7 2024-09-14T11:09:30.444 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.445+0000 7feeee92e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.8 2024-09-14T11:09:30.444 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.446+0000 7feeee92e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.9 2024-09-14T11:09:30.444 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.446+0000 7feeee92e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.10 2024-09-14T11:09:30.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.446+0000 7feeee92e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:09:30.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.446+0000 7feeee92e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 2024-09-14T11:09:30.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.448+0000 7feeee92e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 info.flags=0x17 2024-09-14T11:09:30.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.448+0000 7feeee92e800 10 moving default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 to cache LRU end 2024-09-14T11:09:30.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.448+0000 7feeee92e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:09:30.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.448+0000 7feeee92e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18, ofs0, ns] 2024-09-14T11:09:30.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.448+0000 7fedcd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595195 cookie 94569069278608 notifier 8517 bl.length()=821 2024-09-14T11:09:30.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.448+0000 7fedcd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 info.flags=0x17 2024-09-14T11:09:30.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.448+0000 7fedcd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 to cache LRU end 2024-09-14T11:09:30.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.448+0000 7fedcd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:09:30.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.448+0000 7feeee92e800 20 handle_bi_update(): bucket=:myver[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18]): orig_sources= new_sources= 2024-09-14T11:09:30.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.448+0000 7feeee92e800 20 handle_bi_update(): bucket=:myver[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18]): potential sources added=[] removed=[] 2024-09-14T11:09:30.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.448+0000 7feeee92e800 20 handle_bi_update(): bucket=:myver[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18]): orig_dests= new_dests= 2024-09-14T11:09:30.448 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.448+0000 7feeee92e800 20 handle_bi_update(): bucket=:myver[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18]): potential dests added=[] removed=[] 2024-09-14T11:09:30.449 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.451+0000 7feeee92e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.0 2024-09-14T11:09:30.449 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.451+0000 7feeee92e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1 2024-09-14T11:09:30.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.451+0000 7feeee92e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2 2024-09-14T11:09:30.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.451+0000 7feeee92e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3 2024-09-14T11:09:30.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.452+0000 7feeee92e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.4 2024-09-14T11:09:30.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.452+0000 7feeee92e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.5 2024-09-14T11:09:30.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.453+0000 7feeee92e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.6 2024-09-14T11:09:30.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.453+0000 7feeee92e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.7 2024-09-14T11:09:30.452 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.453+0000 7feeee92e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.8 2024-09-14T11:09:30.452 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.453+0000 7feeee92e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.9 2024-09-14T11:09:30.452 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.454+0000 7feeee92e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.10 2024-09-14T11:09:30.453 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.454+0000 7feeee92e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:09:30.453 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.454+0000 7feeee92e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 2024-09-14T11:09:30.454 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.455+0000 7feeee92e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 info.flags=0x17 2024-09-14T11:09:30.455 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.455+0000 7feeee92e800 10 moving default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 to cache LRU end 2024-09-14T11:09:30.455 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.455+0000 7feeee92e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:09:30.455 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.455+0000 7feeee92e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18, ofs0, ns] 2024-09-14T11:09:30.455 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.456+0000 7fedcdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595196 cookie 94569069278608 notifier 8517 bl.length()=789 2024-09-14T11:09:30.455 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.456+0000 7fedcdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 info.flags=0x17 2024-09-14T11:09:30.455 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.456+0000 7fedcdffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 to cache LRU end 2024-09-14T11:09:30.455 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.456+0000 7fedcdffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:09:30.456 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.456+0000 7feeee92e800 20 handle_bi_update(): bucket=:myver[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18]): orig_sources= new_sources= 2024-09-14T11:09:30.456 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.456+0000 7feeee92e800 20 handle_bi_update(): bucket=:myver[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18]): potential sources added=[] removed=[] 2024-09-14T11:09:30.456 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.456+0000 7feeee92e800 20 handle_bi_update(): bucket=:myver[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18]): orig_dests= new_dests= 2024-09-14T11:09:30.456 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.456+0000 7feeee92e800 20 handle_bi_update(): bucket=:myver[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18]): potential dests added=[] removed=[] 2024-09-14T11:09:30.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.458+0000 7feeee92e800 1 execute INFO: reshard of bucket "myver" from 11 shards to 12 shards completed successfully 2024-09-14T11:09:30.459 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.460+0000 7feda0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:30.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.462+0000 7feeee92e800 20 remove_watcher() i=0 2024-09-14T11:09:30.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.462+0000 7feeee92e800 2 removed watcher, disabling cache 2024-09-14T11:09:30.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.463+0000 7feeee92e800 20 remove_watcher() i=1 2024-09-14T11:09:30.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.464+0000 7feeee92e800 20 remove_watcher() i=2 2024-09-14T11:09:30.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.465+0000 7feeee92e800 20 remove_watcher() i=3 2024-09-14T11:09:30.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.466+0000 7feeee92e800 20 remove_watcher() i=4 2024-09-14T11:09:30.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.467+0000 7feeee92e800 20 remove_watcher() i=5 2024-09-14T11:09:30.466 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.468+0000 7feeee92e800 20 remove_watcher() i=6 2024-09-14T11:09:30.467 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.468+0000 7feeee92e800 20 remove_watcher() i=7 2024-09-14T11:09:30.479 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:09:30.507 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:30.507 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:30.543 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.545+0000 7f943b687800 20 rados->read ofs=0 len=0 2024-09-14T11:09:30.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.547+0000 7f943b687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:30.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.547+0000 7f943b687800 20 realm 2024-09-14T11:09:30.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.547+0000 7f943b687800 20 rados->read ofs=0 len=0 2024-09-14T11:09:30.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.547+0000 7f943b687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:30.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.547+0000 7f943b687800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:30.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.547+0000 7f943b687800 20 rados->read ofs=0 len=0 2024-09-14T11:09:30.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.547+0000 7f943b687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:30.546 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.547+0000 7f943b687800 20 rados->read ofs=0 len=0 2024-09-14T11:09:30.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.548+0000 7f943b687800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:30.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.548+0000 7f943b687800 20 rados->read ofs=0 len=0 2024-09-14T11:09:30.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.549+0000 7f943b687800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:09:30.547 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.549+0000 7f943b687800 20 searching for the correct realm 2024-09-14T11:09:30.549 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.551+0000 7f9439972640 0 -- 172.21.15.97:0/4193088558 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f94300cc040 msgr2=0x7f94300a5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:09:30.755 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.757+0000 7f9438970640 0 -- 172.21.15.97:0/4193088558 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f942c074110 msgr2=0x7f942c06f0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:30.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.761+0000 7f943b687800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:30.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.761+0000 7f943b687800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:30.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.761+0000 7f943b687800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:09:30.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.761+0000 7f943b687800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:09:30.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.761+0000 7f943b687800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:30.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.761+0000 7f943b687800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:30.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.762+0000 7f943b687800 20 rados->read ofs=0 len=0 2024-09-14T11:09:30.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.762+0000 7f943b687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:30.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.762+0000 7f943b687800 20 rados->read ofs=0 len=0 2024-09-14T11:09:30.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.762+0000 7f943b687800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:30.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.762+0000 7f943b687800 20 rados->read ofs=0 len=0 2024-09-14T11:09:30.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.762+0000 7f943b687800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:09:30.763 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.762+0000 7f943b687800 20 zone default found 2024-09-14T11:09:30.763 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.762+0000 7f943b687800 4 Realm: () 2024-09-14T11:09:30.763 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.762+0000 7f943b687800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:09:30.763 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.762+0000 7f943b687800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:09:30.763 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.762+0000 7f943b687800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:30.763 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.762+0000 7f943b687800 20 zonegroup default 2024-09-14T11:09:30.763 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.762+0000 7f943b687800 20 rados->read ofs=0 len=0 2024-09-14T11:09:30.763 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.763+0000 7f943b687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:30.763 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.763+0000 7f943b687800 20 rados->read ofs=0 len=0 2024-09-14T11:09:30.763 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.763+0000 7f943b687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:30.763 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.763+0000 7f943b687800 20 rados->read ofs=0 len=0 2024-09-14T11:09:30.763 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.763+0000 7f943b687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:30.763 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.763+0000 7f943b687800 20 started sync module instance, tier type = 2024-09-14T11:09:30.764 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.763+0000 7f943b687800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:09:30.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.771+0000 7f943b687800 20 add_watcher() i=0 2024-09-14T11:09:30.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.771+0000 7f943b687800 20 add_watcher() i=1 2024-09-14T11:09:30.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.771+0000 7f943b687800 20 add_watcher() i=2 2024-09-14T11:09:30.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.771+0000 7f943b687800 20 add_watcher() i=3 2024-09-14T11:09:30.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.771+0000 7f943b687800 20 add_watcher() i=4 2024-09-14T11:09:30.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.771+0000 7f943b687800 20 add_watcher() i=5 2024-09-14T11:09:30.770 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.771+0000 7f943b687800 20 add_watcher() i=6 2024-09-14T11:09:30.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.773+0000 7f943b687800 20 add_watcher() i=7 2024-09-14T11:09:30.771 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.773+0000 7f943b687800 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:30.773 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.774+0000 7f92effe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:30.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.775+0000 7f943b687800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:30.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.775+0000 7f943b687800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:30.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.775+0000 7f943b687800 5 note: GC not initialized 2024-09-14T11:09:30.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.775+0000 7f92eefe5640 20 reqs_thread_entry: start 2024-09-14T11:09:30.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.775+0000 7f943b687800 20 init_complete bucket index max shards: 11 2024-09-14T11:09:30.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.775+0000 7f943b687800 20 Filter name: none 2024-09-14T11:09:30.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.775+0000 7f92ecfe1640 20 reqs_thread_entry: start 2024-09-14T11:09:30.774 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.775+0000 7f943b687800 20 rados->read ofs=0 len=0 2024-09-14T11:09:30.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.776+0000 7f943b687800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:09:30.775 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.776+0000 7f943b687800 20 rados->read ofs=0 len=0 2024-09-14T11:09:30.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.776+0000 7f943b687800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:09:30.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.776+0000 7f943b687800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:09:30.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.776+0000 7f943b687800 20 rados->read ofs=0 len=0 2024-09-14T11:09:30.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.777+0000 7f943b687800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:09:30.776 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.777+0000 7f943b687800 20 rados->read ofs=0 len=0 2024-09-14T11:09:30.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.777+0000 7f943b687800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:09:30.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.777+0000 7f943b687800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:09:30.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.779+0000 7f92effe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:30.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.781+0000 7f943b687800 20 remove_watcher() i=0 2024-09-14T11:09:30.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.781+0000 7f943b687800 2 removed watcher, disabling cache 2024-09-14T11:09:30.781 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.782+0000 7f943b687800 20 remove_watcher() i=1 2024-09-14T11:09:30.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.783+0000 7f943b687800 20 remove_watcher() i=2 2024-09-14T11:09:30.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.784+0000 7f943b687800 20 remove_watcher() i=3 2024-09-14T11:09:30.783 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.785+0000 7f943b687800 20 remove_watcher() i=4 2024-09-14T11:09:30.784 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.786+0000 7f943b687800 20 remove_watcher() i=5 2024-09-14T11:09:30.785 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.787+0000 7f943b687800 20 remove_watcher() i=6 2024-09-14T11:09:30.786 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:30.788+0000 7f943b687800 20 remove_watcher() i=7 2024-09-14T11:09:30.797 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:09:30.797 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:09:30.797 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: myver id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-14T11:09:30.797 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:09:30.844 INFO:tasks.workunit.client.0.smithi097.stderr: test: reshard removes olh entries with empty name 2024-09-14T11:09:30.937 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:09:30.966 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:30.966 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:31.002 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.004+0000 7fe7cbf1f800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.005+0000 7fe7cbf1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:31.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.005+0000 7fe7cbf1f800 20 realm 2024-09-14T11:09:31.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.005+0000 7fe7cbf1f800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.005+0000 7fe7cbf1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:31.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.005+0000 7fe7cbf1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:31.004 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.005+0000 7fe7cbf1f800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.006+0000 7fe7cbf1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:31.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.006+0000 7fe7cbf1f800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.006+0000 7fe7cbf1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:31.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.006+0000 7fe7cbf1f800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.007+0000 7fe7cbf1f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:09:31.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.007+0000 7fe7cbf1f800 20 searching for the correct realm 2024-09-14T11:09:31.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.009+0000 7fe7c838c640 0 -- 172.21.15.97:0/419535737 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7fe7bc04d1f0 msgr2=0x7fe7bc049a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:31.214 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.215+0000 7fe7c738a640 0 -- 172.21.15.97:0/419535737 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7fe7b8063b80 msgr2=0x7fe7b807e3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:31.219 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.220+0000 7fe7cbf1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:31.219 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.220+0000 7fe7cbf1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:31.219 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.220+0000 7fe7cbf1f800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:09:31.219 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.220+0000 7fe7cbf1f800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:09:31.219 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.220+0000 7fe7cbf1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:31.219 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.220+0000 7fe7cbf1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:31.219 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.220+0000 7fe7cbf1f800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.219 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.220+0000 7fe7cbf1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:31.219 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.220+0000 7fe7cbf1f800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.219 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.220+0000 7fe7cbf1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:31.220 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.220+0000 7fe7cbf1f800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.221 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.221+0000 7fe7cbf1f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:09:31.221 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.221+0000 7fe7cbf1f800 20 zone default found 2024-09-14T11:09:31.221 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.221+0000 7fe7cbf1f800 4 Realm: () 2024-09-14T11:09:31.221 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.221+0000 7fe7cbf1f800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:09:31.221 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.221+0000 7fe7cbf1f800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:09:31.221 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.221+0000 7fe7cbf1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:31.221 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.221+0000 7fe7cbf1f800 20 zonegroup default 2024-09-14T11:09:31.221 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.221+0000 7fe7cbf1f800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.221 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.221+0000 7fe7cbf1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:31.221 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.221+0000 7fe7cbf1f800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.221 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.221+0000 7fe7cbf1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:31.222 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.221+0000 7fe7cbf1f800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.222 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.222+0000 7fe7cbf1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:31.222 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.222+0000 7fe7cbf1f800 20 started sync module instance, tier type = 2024-09-14T11:09:31.222 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.222+0000 7fe7cbf1f800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:09:31.228 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.230+0000 7fe7cbf1f800 20 add_watcher() i=0 2024-09-14T11:09:31.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.230+0000 7fe7cbf1f800 20 add_watcher() i=1 2024-09-14T11:09:31.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.230+0000 7fe7cbf1f800 20 add_watcher() i=2 2024-09-14T11:09:31.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.230+0000 7fe7cbf1f800 20 add_watcher() i=3 2024-09-14T11:09:31.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.230+0000 7fe7cbf1f800 20 add_watcher() i=4 2024-09-14T11:09:31.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.230+0000 7fe7cbf1f800 20 add_watcher() i=5 2024-09-14T11:09:31.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.230+0000 7fe7cbf1f800 20 add_watcher() i=6 2024-09-14T11:09:31.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.231+0000 7fe7cbf1f800 20 add_watcher() i=7 2024-09-14T11:09:31.229 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.231+0000 7fe7cbf1f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:31.231 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.232+0000 7fe67dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:31.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.233+0000 7fe7cbf1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:31.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.233+0000 7fe7cbf1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:31.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.233+0000 7fe7cbf1f800 5 note: GC not initialized 2024-09-14T11:09:31.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.233+0000 7fe67cfe1640 20 reqs_thread_entry: start 2024-09-14T11:09:31.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.233+0000 7fe7cbf1f800 20 init_complete bucket index max shards: 11 2024-09-14T11:09:31.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.233+0000 7fe7cbf1f800 20 Filter name: none 2024-09-14T11:09:31.232 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.233+0000 7fe7cbf1f800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.233 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.233+0000 7fe5f67fc640 20 reqs_thread_entry: start 2024-09-14T11:09:31.234 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.234+0000 7fe7cbf1f800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:09:31.234 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.234+0000 7fe7cbf1f800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.234 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.234+0000 7fe7cbf1f800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:09:31.234 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.234+0000 7fe7cbf1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:09:31.234 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.234+0000 7fe7cbf1f800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.234 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.235+0000 7fe7cbf1f800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:09:31.234 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.235+0000 7fe7cbf1f800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.234 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.235+0000 7fe7cbf1f800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:09:31.234 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.235+0000 7fe7cbf1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:09:31.235 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.237+0000 7fe67dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:31.237 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.239+0000 7fe7cbf1f800 20 remove_watcher() i=0 2024-09-14T11:09:31.238 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.239+0000 7fe7cbf1f800 2 removed watcher, disabling cache 2024-09-14T11:09:31.238 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.240+0000 7fe7cbf1f800 20 remove_watcher() i=1 2024-09-14T11:09:31.239 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.241+0000 7fe7cbf1f800 20 remove_watcher() i=2 2024-09-14T11:09:31.240 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.242+0000 7fe7cbf1f800 20 remove_watcher() i=3 2024-09-14T11:09:31.241 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.243+0000 7fe7cbf1f800 20 remove_watcher() i=4 2024-09-14T11:09:31.242 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.244+0000 7fe7cbf1f800 20 remove_watcher() i=5 2024-09-14T11:09:31.243 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.245+0000 7fe7cbf1f800 20 remove_watcher() i=6 2024-09-14T11:09:31.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.246+0000 7fe7cbf1f800 20 remove_watcher() i=7 2024-09-14T11:09:31.254 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:09:31.254 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:09:31.254 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: a-bucket id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 num_objects: 0 size_kb: 0 num_shards: 13 2024-09-14T11:09:31.255 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:09:31.256 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-09-14T11:09:31.285 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:31.285 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:31.321 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.322+0000 7f54182bb800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.323 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.324+0000 7f54182bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:31.323 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.324+0000 7f54182bb800 20 realm 2024-09-14T11:09:31.323 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.324+0000 7f54182bb800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.323 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.324+0000 7f54182bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:31.323 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.324+0000 7f54182bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:31.323 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.324+0000 7f54182bb800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.324 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.325+0000 7f54182bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:31.324 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.325+0000 7f54182bb800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.324 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.325+0000 7f54182bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:31.324 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.325+0000 7f54182bb800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.326+0000 7f54182bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:09:31.325 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.326+0000 7f54182bb800 20 searching for the correct realm 2024-09-14T11:09:31.326 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.328+0000 7f5415da5640 0 -- 172.21.15.97:0/4003446475 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x55b33048b610 msgr2=0x55b33048da90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:31.329 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.331+0000 7f5415da5640 0 -- 172.21.15.97:0/4003446475 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7f540c06fbb0 msgr2=0x7f540c047e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:31.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.336+0000 7f54182bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:31.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.336+0000 7f54182bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:31.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.336+0000 7f54182bb800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:09:31.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.336+0000 7f54182bb800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:09:31.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.336+0000 7f54182bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:31.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.336+0000 7f54182bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:31.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.336+0000 7f54182bb800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.336+0000 7f54182bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:31.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.336+0000 7f54182bb800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.335 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.336+0000 7f54182bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:31.336 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.336+0000 7f54182bb800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.337+0000 7f54182bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:09:31.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.337+0000 7f54182bb800 20 zone default found 2024-09-14T11:09:31.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.337+0000 7f54182bb800 4 Realm: () 2024-09-14T11:09:31.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.337+0000 7f54182bb800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:09:31.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.337+0000 7f54182bb800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:09:31.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.337+0000 7f54182bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:31.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.337+0000 7f54182bb800 20 zonegroup default 2024-09-14T11:09:31.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.337+0000 7f54182bb800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.337+0000 7f54182bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:31.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.337+0000 7f54182bb800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.337+0000 7f54182bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:31.337 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.337+0000 7f54182bb800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.337+0000 7f54182bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:31.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.337+0000 7f54182bb800 20 started sync module instance, tier type = 2024-09-14T11:09:31.338 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.337+0000 7f54182bb800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:09:31.344 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.346+0000 7f54182bb800 20 add_watcher() i=0 2024-09-14T11:09:31.344 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.346+0000 7f54182bb800 20 add_watcher() i=1 2024-09-14T11:09:31.344 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.346+0000 7f54182bb800 20 add_watcher() i=2 2024-09-14T11:09:31.344 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.346+0000 7f54182bb800 20 add_watcher() i=3 2024-09-14T11:09:31.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.346+0000 7f54182bb800 20 add_watcher() i=4 2024-09-14T11:09:31.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.346+0000 7f54182bb800 20 add_watcher() i=5 2024-09-14T11:09:31.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.346+0000 7f54182bb800 20 add_watcher() i=6 2024-09-14T11:09:31.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.346+0000 7f54182bb800 20 add_watcher() i=7 2024-09-14T11:09:31.345 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.346+0000 7f54182bb800 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:31.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.348+0000 7f52c77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:31.347 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.348+0000 7f54182bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:31.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.348+0000 7f54182bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:31.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.348+0000 7f54182bb800 5 note: GC not initialized 2024-09-14T11:09:31.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.349+0000 7f52c67fc640 20 reqs_thread_entry: start 2024-09-14T11:09:31.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.349+0000 7f54182bb800 20 init_complete bucket index max shards: 11 2024-09-14T11:09:31.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.349+0000 7f54182bb800 20 Filter name: none 2024-09-14T11:09:31.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.349+0000 7f5237fff640 20 reqs_thread_entry: start 2024-09-14T11:09:31.348 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.349+0000 7f54182bb800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.349+0000 7f54182bb800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:09:31.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.349+0000 7f54182bb800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.350+0000 7f54182bb800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:09:31.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.350+0000 7f54182bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:09:31.349 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.351+0000 7f52c77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:31.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.353+0000 7f54182bb800 20 remove_watcher() i=0 2024-09-14T11:09:31.351 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.353+0000 7f54182bb800 2 removed watcher, disabling cache 2024-09-14T11:09:31.352 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.354+0000 7f54182bb800 20 remove_watcher() i=1 2024-09-14T11:09:31.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.355+0000 7f54182bb800 20 remove_watcher() i=2 2024-09-14T11:09:31.354 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.356+0000 7f54182bb800 20 remove_watcher() i=3 2024-09-14T11:09:31.355 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.356+0000 7f54182bb800 20 remove_watcher() i=4 2024-09-14T11:09:31.356 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.358+0000 7f54182bb800 20 remove_watcher() i=5 2024-09-14T11:09:31.357 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.359+0000 7f54182bb800 20 remove_watcher() i=6 2024-09-14T11:09:31.358 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.359+0000 7f54182bb800 20 remove_watcher() i=7 2024-09-14T11:09:31.370 INFO:tasks.workunit.client.0.smithi097.stderr:rados -p default.rgw.buckets.index setomapval .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-09-14T11:09:31.395 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:31.396 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:31.412 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-14T11:09:31.441 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:31.441 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:31.477 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.478+0000 7fc309122800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.479 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.480+0000 7fc309122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:31.479 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.480+0000 7fc309122800 20 realm 2024-09-14T11:09:31.479 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.480+0000 7fc309122800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.479 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.480+0000 7fc309122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:31.479 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.480+0000 7fc309122800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:31.479 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.480+0000 7fc309122800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.479 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.480+0000 7fc309122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:31.479 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.480+0000 7fc309122800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.481+0000 7fc309122800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:31.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.481+0000 7fc309122800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.482+0000 7fc309122800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:09:31.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.482+0000 7fc309122800 20 searching for the correct realm 2024-09-14T11:09:31.482 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.483+0000 7fc304d02640 0 -- 172.21.15.97:0/1209926701 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x5599b9e1cb30 msgr2=0x5599b9e1efb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:31.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.486+0000 7fc304d02640 0 -- 172.21.15.97:0/1209926701 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7fc2ec080bd0 msgr2=0x7fc2ec065930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:31.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.491+0000 7fc309122800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:31.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.491+0000 7fc309122800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:31.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.491+0000 7fc309122800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:09:31.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.491+0000 7fc309122800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:09:31.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.491+0000 7fc309122800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:31.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.491+0000 7fc309122800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:31.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.491+0000 7fc309122800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.492+0000 7fc309122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:31.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.492+0000 7fc309122800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.493+0000 7fc309122800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:31.492 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.493+0000 7fc309122800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.493+0000 7fc309122800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:09:31.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.493+0000 7fc309122800 20 zone default found 2024-09-14T11:09:31.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.493+0000 7fc309122800 4 Realm: () 2024-09-14T11:09:31.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.493+0000 7fc309122800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:09:31.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.493+0000 7fc309122800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:09:31.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.493+0000 7fc309122800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:31.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.493+0000 7fc309122800 20 zonegroup default 2024-09-14T11:09:31.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.493+0000 7fc309122800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.493+0000 7fc309122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:31.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.493+0000 7fc309122800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.493+0000 7fc309122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:31.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.493+0000 7fc309122800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.494+0000 7fc309122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:31.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.494+0000 7fc309122800 20 started sync module instance, tier type = 2024-09-14T11:09:31.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.494+0000 7fc309122800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:09:31.500 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.502+0000 7fc309122800 20 add_watcher() i=0 2024-09-14T11:09:31.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.502+0000 7fc309122800 20 add_watcher() i=1 2024-09-14T11:09:31.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.502+0000 7fc309122800 20 add_watcher() i=2 2024-09-14T11:09:31.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.502+0000 7fc309122800 20 add_watcher() i=3 2024-09-14T11:09:31.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.502+0000 7fc309122800 20 add_watcher() i=4 2024-09-14T11:09:31.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.502+0000 7fc309122800 20 add_watcher() i=5 2024-09-14T11:09:31.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.502+0000 7fc309122800 20 add_watcher() i=6 2024-09-14T11:09:31.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.503+0000 7fc309122800 20 add_watcher() i=7 2024-09-14T11:09:31.501 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.503+0000 7fc309122800 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:31.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.504+0000 7fc1bafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:31.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.504+0000 7fc309122800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:31.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.504+0000 7fc309122800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:31.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.505+0000 7fc309122800 5 note: GC not initialized 2024-09-14T11:09:31.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.505+0000 7fc1b9fe3640 20 reqs_thread_entry: start 2024-09-14T11:09:31.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.505+0000 7fc309122800 20 init_complete bucket index max shards: 11 2024-09-14T11:09:31.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.505+0000 7fc309122800 20 Filter name: none 2024-09-14T11:09:31.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.505+0000 7fc12b7fe640 20 reqs_thread_entry: start 2024-09-14T11:09:31.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.505+0000 7fc309122800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.505+0000 7fc309122800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:09:31.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.505+0000 7fc309122800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.506+0000 7fc309122800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:09:31.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.506+0000 7fc309122800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:09:31.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.506+0000 7fc309122800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-14T11:09:31.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.506+0000 7fc309122800 20 INFO: main: starting shard=0 2024-09-14T11:09:31.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.506+0000 7fc309122800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.0 2024-09-14T11:09:31.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.506+0000 7fc309122800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.0 2024-09-14T11:09:31.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.506+0000 7fc309122800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:09:31.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.506+0000 7fc309122800 20 INFO: main: starting shard=1 2024-09-14T11:09:31.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.506+0000 7fc309122800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.1 2024-09-14T11:09:31.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.506+0000 7fc309122800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.1 2024-09-14T11:09:31.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.507+0000 7fc309122800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:09:31.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.507+0000 7fc309122800 20 INFO: main: starting shard=2 2024-09-14T11:09:31.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.507+0000 7fc309122800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.2 2024-09-14T11:09:31.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.507+0000 7fc309122800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.2 2024-09-14T11:09:31.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.507+0000 7fc309122800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:09:31.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.507+0000 7fc309122800 20 INFO: main: starting shard=3 2024-09-14T11:09:31.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.507+0000 7fc309122800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.3 2024-09-14T11:09:31.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.507+0000 7fc309122800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.3 2024-09-14T11:09:31.509 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.508+0000 7fc309122800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:09:31.509 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.508+0000 7fc309122800 20 INFO: main: starting shard=4 2024-09-14T11:09:31.509 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.508+0000 7fc309122800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.4 2024-09-14T11:09:31.509 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.508+0000 7fc309122800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.4 2024-09-14T11:09:31.509 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.508+0000 7fc309122800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:09:31.509 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.508+0000 7fc309122800 20 INFO: main: starting shard=5 2024-09-14T11:09:31.509 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.508+0000 7fc309122800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.5 2024-09-14T11:09:31.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.508+0000 7fc309122800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.5 2024-09-14T11:09:31.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.509+0000 7fc309122800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:09:31.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.509+0000 7fc309122800 20 INFO: main: starting shard=6 2024-09-14T11:09:31.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.509+0000 7fc309122800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.6 2024-09-14T11:09:31.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.509+0000 7fc309122800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.6 2024-09-14T11:09:31.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.509+0000 7fc309122800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:09:31.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.509+0000 7fc309122800 20 INFO: main: starting shard=7 2024-09-14T11:09:31.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.509+0000 7fc309122800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.7 2024-09-14T11:09:31.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.509+0000 7fc309122800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.7 2024-09-14T11:09:31.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.510+0000 7fc309122800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:09:31.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.510+0000 7fc309122800 20 INFO: main: starting shard=8 2024-09-14T11:09:31.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.510+0000 7fc309122800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.8 2024-09-14T11:09:31.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.510+0000 7fc309122800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.8 2024-09-14T11:09:31.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.511+0000 7fc309122800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:09:31.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.511+0000 7fc309122800 20 INFO: main: starting shard=9 2024-09-14T11:09:31.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.511+0000 7fc309122800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.9 2024-09-14T11:09:31.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.511+0000 7fc309122800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.9 2024-09-14T11:09:31.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.511+0000 7fc309122800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:09:31.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.511+0000 7fc309122800 20 INFO: main: starting shard=10 2024-09-14T11:09:31.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.511+0000 7fc309122800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.10 2024-09-14T11:09:31.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.511+0000 7fc309122800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.10 2024-09-14T11:09:31.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.511+0000 7fc309122800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:09:31.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.511+0000 7fc309122800 20 INFO: main: starting shard=11 2024-09-14T11:09:31.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.511+0000 7fc309122800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.11 2024-09-14T11:09:31.513 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.511+0000 7fc309122800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.11 2024-09-14T11:09:31.513 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.512+0000 7fc309122800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:09:31.513 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.512+0000 7fc309122800 20 INFO: main: starting shard=12 2024-09-14T11:09:31.513 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.512+0000 7fc309122800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.12 2024-09-14T11:09:31.513 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.512+0000 7fc309122800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.12 2024-09-14T11:09:31.513 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.512+0000 7fc309122800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:09:31.513 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.512+0000 7fc309122800 20 INFO: main: done 2024-09-14T11:09:31.513 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.513+0000 7fc1bafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:31.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.515+0000 7fc309122800 20 remove_watcher() i=0 2024-09-14T11:09:31.514 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.515+0000 7fc309122800 2 removed watcher, disabling cache 2024-09-14T11:09:31.515 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.516+0000 7fc309122800 20 remove_watcher() i=1 2024-09-14T11:09:31.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.517+0000 7fc309122800 20 remove_watcher() i=2 2024-09-14T11:09:31.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.518+0000 7fc309122800 20 remove_watcher() i=3 2024-09-14T11:09:31.517 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.519+0000 7fc309122800 20 remove_watcher() i=4 2024-09-14T11:09:31.518 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.520+0000 7fc309122800 20 remove_watcher() i=5 2024-09-14T11:09:31.519 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.521+0000 7fc309122800 20 remove_watcher() i=6 2024-09-14T11:09:31.520 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.522+0000 7fc309122800 20 remove_watcher() i=7 2024-09-14T11:09:31.532 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-09-14T11:09:31.563 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:31.563 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:31.600 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.602+0000 7f45d8d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.603+0000 7f45d8d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:31.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.603+0000 7f45d8d2c800 20 realm 2024-09-14T11:09:31.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.603+0000 7f45d8d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.603+0000 7f45d8d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:31.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.603+0000 7f45d8d2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:31.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.603+0000 7f45d8d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.603+0000 7f45d8d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:31.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.603+0000 7f45d8d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.604+0000 7f45d8d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:31.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.604+0000 7f45d8d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.604 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.605+0000 7f45d8d2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:09:31.604 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.605+0000 7f45d8d2c800 20 searching for the correct realm 2024-09-14T11:09:31.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.607+0000 7f45cc24e640 0 -- 172.21.15.97:0/280529083 >> [v2:172.21.15.97:6816/4093696477,v1:172.21.15.97:6817/4093696477] conn(0x55e2f1f5aa10 msgr2=0x55e2f1f5ce00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:31.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.610+0000 7f45d4a4f640 0 -- 172.21.15.97:0/280529083 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7f45bc03a950 msgr2=0x7f45bc056410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:31.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.615+0000 7f45d8d2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:31.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.615+0000 7f45d8d2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:31.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.615+0000 7f45d8d2c800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:09:31.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.615+0000 7f45d8d2c800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:09:31.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.615+0000 7f45d8d2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:31.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.615+0000 7f45d8d2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:31.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.615+0000 7f45d8d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.615+0000 7f45d8d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:31.614 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.615+0000 7f45d8d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.615+0000 7f45d8d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:31.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.615+0000 7f45d8d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.616+0000 7f45d8d2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:09:31.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.616+0000 7f45d8d2c800 20 zone default found 2024-09-14T11:09:31.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.616+0000 7f45d8d2c800 4 Realm: () 2024-09-14T11:09:31.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.616+0000 7f45d8d2c800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:09:31.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.616+0000 7f45d8d2c800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:09:31.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.616+0000 7f45d8d2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:31.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.616+0000 7f45d8d2c800 20 zonegroup default 2024-09-14T11:09:31.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.616+0000 7f45d8d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.616+0000 7f45d8d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:31.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.616+0000 7f45d8d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.617+0000 7f45d8d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:31.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.617+0000 7f45d8d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.617+0000 7f45d8d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:31.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.617+0000 7f45d8d2c800 20 started sync module instance, tier type = 2024-09-14T11:09:31.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.617+0000 7f45d8d2c800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:09:31.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.625+0000 7f45d8d2c800 20 add_watcher() i=0 2024-09-14T11:09:31.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.625+0000 7f45d8d2c800 20 add_watcher() i=1 2024-09-14T11:09:31.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.625+0000 7f45d8d2c800 20 add_watcher() i=2 2024-09-14T11:09:31.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.625+0000 7f45d8d2c800 20 add_watcher() i=3 2024-09-14T11:09:31.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.625+0000 7f45d8d2c800 20 add_watcher() i=4 2024-09-14T11:09:31.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.625+0000 7f45d8d2c800 20 add_watcher() i=5 2024-09-14T11:09:31.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.625+0000 7f45d8d2c800 20 add_watcher() i=6 2024-09-14T11:09:31.624 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.626+0000 7f45d8d2c800 20 add_watcher() i=7 2024-09-14T11:09:31.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.626+0000 7f45d8d2c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:31.626 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.627+0000 7f448b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:31.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.628+0000 7f45d8d2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:31.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.628+0000 7f45d8d2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:31.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.628+0000 7f45d8d2c800 5 note: GC not initialized 2024-09-14T11:09:31.627 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.628+0000 7f448a7e4640 20 reqs_thread_entry: start 2024-09-14T11:09:31.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.628+0000 7f45d8d2c800 20 init_complete bucket index max shards: 11 2024-09-14T11:09:31.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.628+0000 7f45d8d2c800 20 Filter name: none 2024-09-14T11:09:31.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.628+0000 7f4483fff640 20 reqs_thread_entry: start 2024-09-14T11:09:31.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.628+0000 7f45d8d2c800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:09:31.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.628+0000 7f45d8d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.629+0000 7f45d8d2c800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:09:31.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.629+0000 7f45d8d2c800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:09:31.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.629+0000 7f45d8d2c800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:09:31.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.629+0000 7f45d8d2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 : miss 2024-09-14T11:09:31.628 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.629+0000 7f45d8d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.629+0000 7f45d8d2c800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:09:31.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.629+0000 7f45d8d2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:09:31.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.629+0000 7f45d8d2c800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:09:31.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.629+0000 7f45d8d2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:09:31.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.629+0000 7f45d8d2c800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:09:31.629 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.629+0000 7f45d8d2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 2024-09-14T11:09:31.631 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.633+0000 7f45d8d2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:09:31.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.633+0000 7f45d8d2c800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:09:31.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.633+0000 7f45d8d2c800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:09:31.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.633+0000 7f45d8d2c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17, ofs0, ns] 2024-09-14T11:09:31.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.633+0000 7f44ab7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595249 cookie 94433210429584 notifier 8081 bl.length()=827 2024-09-14T11:09:31.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.633+0000 7f44ab7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:09:31.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.633+0000 7f44ab7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:09:31.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.633+0000 7f44ab7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:09:31.632 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.633+0000 7f45d8d2c800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): orig_sources= new_sources= 2024-09-14T11:09:31.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.633+0000 7f45d8d2c800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): potential sources added=[] removed=[] 2024-09-14T11:09:31.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.633+0000 7f45d8d2c800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): orig_dests= new_dests= 2024-09-14T11:09:31.633 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.633+0000 7f45d8d2c800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): potential dests added=[] removed=[] 2024-09-14T11:09:31.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.639+0000 7f45d8d2c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.0 2024-09-14T11:09:31.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.639+0000 7f45d8d2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.0 2024-09-14T11:09:31.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.639+0000 7f45d8d2c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.0 2024-09-14T11:09:31.637 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.639+0000 7f45d8d2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.0 2024-09-14T11:09:31.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.639+0000 7f45d8d2c800 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-09-14T11:09:31.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.639+0000 7f45d8d2c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.1 2024-09-14T11:09:31.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.639+0000 7f45d8d2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.1 2024-09-14T11:09:31.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.639+0000 7f45d8d2c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.2 2024-09-14T11:09:31.638 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.639+0000 7f45d8d2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.2 2024-09-14T11:09:31.639 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.640+0000 7f45d8d2c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.3 2024-09-14T11:09:31.639 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.640+0000 7f45d8d2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.3 2024-09-14T11:09:31.639 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.640+0000 7f45d8d2c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.4 2024-09-14T11:09:31.639 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.640+0000 7f45d8d2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.4 2024-09-14T11:09:31.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.641+0000 7f45d8d2c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.5 2024-09-14T11:09:31.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.641+0000 7f45d8d2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.5 2024-09-14T11:09:31.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.641+0000 7f45d8d2c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.6 2024-09-14T11:09:31.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.641+0000 7f45d8d2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.6 2024-09-14T11:09:31.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.642+0000 7f45d8d2c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.7 2024-09-14T11:09:31.640 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.642+0000 7f45d8d2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.7 2024-09-14T11:09:31.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.642+0000 7f45d8d2c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.8 2024-09-14T11:09:31.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.642+0000 7f45d8d2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.8 2024-09-14T11:09:31.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.642+0000 7f45d8d2c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.9 2024-09-14T11:09:31.641 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.642+0000 7f45d8d2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.9 2024-09-14T11:09:31.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.643+0000 7f45d8d2c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.10 2024-09-14T11:09:31.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.643+0000 7f45d8d2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.10 2024-09-14T11:09:31.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.643+0000 7f45d8d2c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.11 2024-09-14T11:09:31.642 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.643+0000 7f45d8d2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.11 2024-09-14T11:09:31.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.644+0000 7f45d8d2c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.12 2024-09-14T11:09:31.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.644+0000 7f45d8d2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.12 2024-09-14T11:09:31.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.644+0000 7f45d8d2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 : hit (requested=0x17, cached=0x17) 2024-09-14T11:09:31.643 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.644+0000 7f45d8d2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 2024-09-14T11:09:31.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.646+0000 7f45d8d2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:09:31.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.646+0000 7f45d8d2c800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:09:31.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.646+0000 7f45d8d2c800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:09:31.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.646+0000 7f45d8d2c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17, ofs0, ns] 2024-09-14T11:09:31.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.646+0000 7f44abfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595250 cookie 94433210429584 notifier 8081 bl.length()=827 2024-09-14T11:09:31.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.646+0000 7f44abfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:09:31.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.646+0000 7f44abfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:09:31.645 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.646+0000 7f44abfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:09:31.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.646+0000 7f45d8d2c800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): orig_sources= new_sources= 2024-09-14T11:09:31.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.646+0000 7f45d8d2c800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): potential sources added=[] removed=[] 2024-09-14T11:09:31.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.646+0000 7f45d8d2c800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): orig_dests= new_dests= 2024-09-14T11:09:31.646 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.646+0000 7f45d8d2c800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): potential dests added=[] removed=[] 2024-09-14T11:09:31.647 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.649+0000 7f45d8d2c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.0 2024-09-14T11:09:31.647 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.649+0000 7f45d8d2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.0 2024-09-14T11:09:31.648 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.649+0000 7f45d8d2c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.1 2024-09-14T11:09:31.648 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.649+0000 7f45d8d2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.1 2024-09-14T11:09:31.648 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.649+0000 7f45d8d2c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.2 2024-09-14T11:09:31.648 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.649+0000 7f45d8d2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.2 2024-09-14T11:09:31.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.650+0000 7f45d8d2c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.3 2024-09-14T11:09:31.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.650+0000 7f45d8d2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.3 2024-09-14T11:09:31.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.650+0000 7f45d8d2c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.4 2024-09-14T11:09:31.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.650+0000 7f45d8d2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.4 2024-09-14T11:09:31.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.650+0000 7f45d8d2c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.5 2024-09-14T11:09:31.649 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.650+0000 7f45d8d2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.5 2024-09-14T11:09:31.650 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.650+0000 7f45d8d2c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.6 2024-09-14T11:09:31.650 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.650+0000 7f45d8d2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.6 2024-09-14T11:09:31.650 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.651+0000 7f45d8d2c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.7 2024-09-14T11:09:31.650 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.651+0000 7f45d8d2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.7 2024-09-14T11:09:31.650 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.651+0000 7f45d8d2c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.8 2024-09-14T11:09:31.650 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.651+0000 7f45d8d2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.8 2024-09-14T11:09:31.650 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.651+0000 7f45d8d2c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.9 2024-09-14T11:09:31.650 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.651+0000 7f45d8d2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.9 2024-09-14T11:09:31.651 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.652+0000 7f45d8d2c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.10 2024-09-14T11:09:31.651 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.652+0000 7f45d8d2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.10 2024-09-14T11:09:31.651 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.652+0000 7f45d8d2c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.11 2024-09-14T11:09:31.651 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.652+0000 7f45d8d2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.11 2024-09-14T11:09:31.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.652+0000 7f45d8d2c800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.12 2024-09-14T11:09:31.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.652+0000 7f45d8d2c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.2.12 2024-09-14T11:09:31.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.652+0000 7f45d8d2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 : hit (requested=0x17, cached=0x17) 2024-09-14T11:09:31.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.652+0000 7f45d8d2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 2024-09-14T11:09:31.652 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.654+0000 7f45d8d2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:09:31.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.654+0000 7f45d8d2c800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:09:31.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.654+0000 7f45d8d2c800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:09:31.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.654+0000 7f45d8d2c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17, ofs0, ns] 2024-09-14T11:09:31.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.654+0000 7f44abfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595251 cookie 94433210429584 notifier 8081 bl.length()=795 2024-09-14T11:09:31.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.654+0000 7f44abfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 info.flags=0x17 2024-09-14T11:09:31.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.654+0000 7f44abfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17 to cache LRU end 2024-09-14T11:09:31.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.654+0000 7f44abfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:09:31.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.654+0000 7f45d8d2c800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): orig_sources= new_sources= 2024-09-14T11:09:31.653 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.654+0000 7f45d8d2c800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): potential sources added=[] removed=[] 2024-09-14T11:09:31.654 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.654+0000 7f45d8d2c800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): orig_dests= new_dests= 2024-09-14T11:09:31.654 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.654+0000 7f45d8d2c800 20 handle_bi_update(): bucket=:a-bucket[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17]): potential dests added=[] removed=[] 2024-09-14T11:09:31.655 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.657+0000 7f45d8d2c800 1 execute INFO: reshard of bucket "a-bucket" from 13 shards to 1 shards completed successfully 2024-09-14T11:09:31.657 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.659+0000 7f448b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:31.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.660+0000 7f45d8d2c800 20 remove_watcher() i=0 2024-09-14T11:09:31.659 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.660+0000 7f45d8d2c800 2 removed watcher, disabling cache 2024-09-14T11:09:31.660 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.662+0000 7f45d8d2c800 20 remove_watcher() i=1 2024-09-14T11:09:31.661 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.663+0000 7f45d8d2c800 20 remove_watcher() i=2 2024-09-14T11:09:31.662 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.664+0000 7f45d8d2c800 20 remove_watcher() i=3 2024-09-14T11:09:31.663 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.665+0000 7f45d8d2c800 20 remove_watcher() i=4 2024-09-14T11:09:31.664 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.666+0000 7f45d8d2c800 20 remove_watcher() i=5 2024-09-14T11:09:31.665 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.667+0000 7f45d8d2c800 20 remove_watcher() i=6 2024-09-14T11:09:31.666 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.668+0000 7f45d8d2c800 20 remove_watcher() i=7 2024-09-14T11:09:31.678 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-14T11:09:31.707 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:31.707 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:31.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.744+0000 7f37a0375800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.746+0000 7f37a0375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:31.745 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.746+0000 7f37a0375800 20 realm 2024-09-14T11:09:31.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.746+0000 7f37a0375800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.746+0000 7f37a0375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:31.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.746+0000 7f37a0375800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:31.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.746+0000 7f37a0375800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.747+0000 7f37a0375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:31.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.747+0000 7f37a0375800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.748+0000 7f37a0375800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:31.746 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.748+0000 7f37a0375800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.748+0000 7f37a0375800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:09:31.747 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.748+0000 7f37a0375800 20 searching for the correct realm 2024-09-14T11:09:31.749 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.750+0000 7f379e660640 0 -- 172.21.15.97:0/557407397 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f3788021030 msgr2=0x7f3788061330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:31.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.955+0000 7f379565e640 0 -- 172.21.15.97:0/557407397 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f379008d910 msgr2=0x7f379006f3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:31.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.960+0000 7f37a0375800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:31.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.960+0000 7f37a0375800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:31.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.960+0000 7f37a0375800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:09:31.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.960+0000 7f37a0375800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:09:31.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.960+0000 7f37a0375800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:31.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.960+0000 7f37a0375800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:31.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.960+0000 7f37a0375800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.960+0000 7f37a0375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:31.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.960+0000 7f37a0375800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.961+0000 7f37a0375800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:31.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.961+0000 7f37a0375800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.961+0000 7f37a0375800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:09:31.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.961+0000 7f37a0375800 20 zone default found 2024-09-14T11:09:31.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.961+0000 7f37a0375800 4 Realm: () 2024-09-14T11:09:31.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.961+0000 7f37a0375800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:09:31.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.961+0000 7f37a0375800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:09:31.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.961+0000 7f37a0375800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:31.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.961+0000 7f37a0375800 20 zonegroup default 2024-09-14T11:09:31.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.961+0000 7f37a0375800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.961+0000 7f37a0375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:31.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.961+0000 7f37a0375800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.964 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.962+0000 7f37a0375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:31.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.962+0000 7f37a0375800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.962+0000 7f37a0375800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:31.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.962+0000 7f37a0375800 20 started sync module instance, tier type = 2024-09-14T11:09:31.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.962+0000 7f37a0375800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:09:31.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.971+0000 7f37a0375800 20 add_watcher() i=0 2024-09-14T11:09:31.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.971+0000 7f37a0375800 20 add_watcher() i=1 2024-09-14T11:09:31.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.971+0000 7f37a0375800 20 add_watcher() i=2 2024-09-14T11:09:31.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.971+0000 7f37a0375800 20 add_watcher() i=3 2024-09-14T11:09:31.971 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.971+0000 7f37a0375800 20 add_watcher() i=4 2024-09-14T11:09:31.971 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.971+0000 7f37a0375800 20 add_watcher() i=5 2024-09-14T11:09:31.971 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.971+0000 7f37a0375800 20 add_watcher() i=6 2024-09-14T11:09:31.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.972+0000 7f37a0375800 20 add_watcher() i=7 2024-09-14T11:09:31.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.972+0000 7f37a0375800 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:31.974 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.974+0000 7f364f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:31.974 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.974+0000 7f37a0375800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:31.974 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.974+0000 7f37a0375800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:31.974 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.974+0000 7f37a0375800 5 note: GC not initialized 2024-09-14T11:09:31.974 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.975+0000 7f364e7fc640 20 reqs_thread_entry: start 2024-09-14T11:09:31.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.975+0000 7f37a0375800 20 init_complete bucket index max shards: 11 2024-09-14T11:09:31.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.975+0000 7f37a0375800 20 Filter name: none 2024-09-14T11:09:31.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.975+0000 7f35c3fff640 20 reqs_thread_entry: start 2024-09-14T11:09:31.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.975+0000 7f37a0375800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.975+0000 7f37a0375800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:09:31.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.975+0000 7f37a0375800 20 rados->read ofs=0 len=0 2024-09-14T11:09:31.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.976+0000 7f37a0375800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:09:31.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.976+0000 7f37a0375800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:09:31.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.976+0000 7f37a0375800 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-09-14T11:09:31.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.976+0000 7f37a0375800 20 INFO: main: starting shard=0 2024-09-14T11:09:31.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.976+0000 7f37a0375800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.0 2024-09-14T11:09:31.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.976+0000 7f37a0375800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17.3.0 2024-09-14T11:09:31.978 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.976+0000 7f37a0375800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:09:31.978 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.976+0000 7f37a0375800 20 INFO: main: done 2024-09-14T11:09:31.978 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.977+0000 7f364f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:31.979 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.979+0000 7f37a0375800 20 remove_watcher() i=0 2024-09-14T11:09:31.979 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.979+0000 7f37a0375800 2 removed watcher, disabling cache 2024-09-14T11:09:31.979 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.981+0000 7f37a0375800 20 remove_watcher() i=1 2024-09-14T11:09:31.980 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.981+0000 7f37a0375800 20 remove_watcher() i=2 2024-09-14T11:09:31.981 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.983+0000 7f37a0375800 20 remove_watcher() i=3 2024-09-14T11:09:31.982 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.984+0000 7f37a0375800 20 remove_watcher() i=4 2024-09-14T11:09:31.983 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.985+0000 7f37a0375800 20 remove_watcher() i=5 2024-09-14T11:09:31.984 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.986+0000 7f37a0375800 20 remove_watcher() i=6 2024-09-14T11:09:31.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:31.987+0000 7f37a0375800 20 remove_watcher() i=7 2024-09-14T11:09:31.995 INFO:tasks.workunit.client.0.smithi097.stderr: test: PUT succeeds during reshard 2024-09-14T11:09:31.997 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:09:32.025 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:32.025 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:32.062 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.063+0000 7fabb233c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:32.064 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.065+0000 7fabb233c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:32.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.065+0000 7fabb233c800 20 realm 2024-09-14T11:09:32.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.065+0000 7fabb233c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:32.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.066+0000 7fabb233c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:32.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.066+0000 7fabb233c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:32.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.066+0000 7fabb233c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:32.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.066+0000 7fabb233c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:32.065 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.066+0000 7fabb233c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:32.066 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.066+0000 7fabb233c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:32.066 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.066+0000 7fabb233c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:32.066 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.067+0000 7fabb233c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:09:32.066 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.067+0000 7fabb233c800 20 searching for the correct realm 2024-09-14T11:09:32.068 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.069+0000 7fabae882640 0 -- 172.21.15.97:0/4108387028 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7fab98092020 msgr2=0x7fab980b9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:32.272 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.274+0000 7faba5880640 0 -- 172.21.15.97:0/4108387028 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7faba003e910 msgr2=0x7faba002f3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:32.277 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.278+0000 7fabb233c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:32.277 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.278+0000 7fabb233c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:32.277 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.278+0000 7fabb233c800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:09:32.277 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.278+0000 7fabb233c800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:09:32.278 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.278+0000 7fabb233c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:32.278 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.278+0000 7fabb233c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:32.278 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.278+0000 7fabb233c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:32.278 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.279+0000 7fabb233c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:32.278 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.279+0000 7fabb233c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:32.278 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.279+0000 7fabb233c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:32.278 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.279+0000 7fabb233c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:32.279 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.279+0000 7fabb233c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:09:32.279 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.279+0000 7fabb233c800 20 zone default found 2024-09-14T11:09:32.279 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.279+0000 7fabb233c800 4 Realm: () 2024-09-14T11:09:32.279 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.279+0000 7fabb233c800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:09:32.279 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.279+0000 7fabb233c800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:09:32.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.279+0000 7fabb233c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:32.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.279+0000 7fabb233c800 20 zonegroup default 2024-09-14T11:09:32.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.279+0000 7fabb233c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:32.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.279+0000 7fabb233c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:32.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.279+0000 7fabb233c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:32.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.280+0000 7fabb233c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:32.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.280+0000 7fabb233c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:32.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.280+0000 7fabb233c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:32.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.280+0000 7fabb233c800 20 started sync module instance, tier type = 2024-09-14T11:09:32.280 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.280+0000 7fabb233c800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:09:32.287 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.289+0000 7fabb233c800 20 add_watcher() i=0 2024-09-14T11:09:32.287 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.289+0000 7fabb233c800 20 add_watcher() i=1 2024-09-14T11:09:32.287 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.289+0000 7fabb233c800 20 add_watcher() i=2 2024-09-14T11:09:32.288 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.289+0000 7fabb233c800 20 add_watcher() i=3 2024-09-14T11:09:32.288 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.289+0000 7fabb233c800 20 add_watcher() i=4 2024-09-14T11:09:32.288 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.289+0000 7fabb233c800 20 add_watcher() i=5 2024-09-14T11:09:32.288 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.289+0000 7fabb233c800 20 add_watcher() i=6 2024-09-14T11:09:32.288 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.290+0000 7fabb233c800 20 add_watcher() i=7 2024-09-14T11:09:32.288 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.290+0000 7fabb233c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:32.290 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.291+0000 7faa64fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:32.291 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.292+0000 7fabb233c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:32.291 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.292+0000 7fabb233c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:32.291 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.292+0000 7fabb233c800 5 note: GC not initialized 2024-09-14T11:09:32.291 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.292+0000 7fa9df7fe640 20 reqs_thread_entry: start 2024-09-14T11:09:32.291 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.292+0000 7fabb233c800 20 init_complete bucket index max shards: 11 2024-09-14T11:09:32.291 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.292+0000 7fabb233c800 20 Filter name: none 2024-09-14T11:09:32.292 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.292+0000 7fa9dd7fa640 20 reqs_thread_entry: start 2024-09-14T11:09:32.292 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.292+0000 7fabb233c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:32.292 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.293+0000 7fabb233c800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:09:32.292 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.293+0000 7fabb233c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:32.293 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.293+0000 7fabb233c800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:09:32.293 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.293+0000 7fabb233c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:09:32.293 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.293+0000 7fabb233c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:32.293 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.293+0000 7fabb233c800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:09:32.293 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.293+0000 7fabb233c800 20 rados->read ofs=0 len=0 2024-09-14T11:09:32.293 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.294+0000 7fabb233c800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:09:32.293 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.294+0000 7fabb233c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:09:32.294 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.295+0000 7faa64fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:32.296 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.297+0000 7fabb233c800 20 remove_watcher() i=0 2024-09-14T11:09:32.296 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.297+0000 7fabb233c800 2 removed watcher, disabling cache 2024-09-14T11:09:32.297 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.298+0000 7fabb233c800 20 remove_watcher() i=1 2024-09-14T11:09:32.297 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.299+0000 7fabb233c800 20 remove_watcher() i=2 2024-09-14T11:09:32.299 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.300+0000 7fabb233c800 20 remove_watcher() i=3 2024-09-14T11:09:32.299 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.301+0000 7fabb233c800 20 remove_watcher() i=4 2024-09-14T11:09:32.301 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.302+0000 7fabb233c800 20 remove_watcher() i=5 2024-09-14T11:09:32.301 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.303+0000 7fabb233c800 20 remove_watcher() i=6 2024-09-14T11:09:32.302 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.304+0000 7fabb233c800 20 remove_watcher() i=7 2024-09-14T11:09:32.313 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:09:32.313 INFO:tasks.workunit.client.0.smithi097.stderr:BUCKET_STATS: 2024-09-14T11:09:32.313 INFO:tasks.workunit.client.0.smithi097.stderr:bucket: myver id: 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-14T11:09:32.313 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:09:32.315 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 13 2024-09-14T11:09:32.348 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:32.348 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:32.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.386+0000 7f2f334bb800 20 rados->read ofs=0 len=0 2024-09-14T11:09:32.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.388+0000 7f2f334bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:32.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.388+0000 7f2f334bb800 20 realm 2024-09-14T11:09:32.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.388+0000 7f2f334bb800 20 rados->read ofs=0 len=0 2024-09-14T11:09:32.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.388+0000 7f2f334bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:32.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.388+0000 7f2f334bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:32.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.388+0000 7f2f334bb800 20 rados->read ofs=0 len=0 2024-09-14T11:09:32.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.388+0000 7f2f334bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:32.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.388+0000 7f2f334bb800 20 rados->read ofs=0 len=0 2024-09-14T11:09:32.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.389+0000 7f2f334bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:32.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.389+0000 7f2f334bb800 20 rados->read ofs=0 len=0 2024-09-14T11:09:32.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.390+0000 7f2f334bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:09:32.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.390+0000 7f2f334bb800 20 searching for the correct realm 2024-09-14T11:09:32.390 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.391+0000 7f2f30fa5640 0 -- 172.21.15.97:0/1729578008 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x55ee1f0482e0 msgr2=0x55ee1f04a730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:32.393 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.394+0000 7f2f30fa5640 0 -- 172.21.15.97:0/1729578008 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7f2f1806d830 msgr2=0x7f2f180931b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:09:32.398 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.399+0000 7f2f334bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:32.398 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.400+0000 7f2f334bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:32.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.400+0000 7f2f334bb800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:09:32.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.400+0000 7f2f334bb800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:09:32.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.400+0000 7f2f334bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:32.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.400+0000 7f2f334bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:32.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.400+0000 7f2f334bb800 20 rados->read ofs=0 len=0 2024-09-14T11:09:32.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.400+0000 7f2f334bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:32.399 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.400+0000 7f2f334bb800 20 rados->read ofs=0 len=0 2024-09-14T11:09:32.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.400+0000 7f2f334bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:32.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.400+0000 7f2f334bb800 20 rados->read ofs=0 len=0 2024-09-14T11:09:32.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.400+0000 7f2f334bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:09:32.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.400+0000 7f2f334bb800 20 zone default found 2024-09-14T11:09:32.401 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.400+0000 7f2f334bb800 4 Realm: () 2024-09-14T11:09:32.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.400+0000 7f2f334bb800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:09:32.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.400+0000 7f2f334bb800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:09:32.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.400+0000 7f2f334bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:32.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.400+0000 7f2f334bb800 20 zonegroup default 2024-09-14T11:09:32.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.400+0000 7f2f334bb800 20 rados->read ofs=0 len=0 2024-09-14T11:09:32.402 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.401+0000 7f2f334bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:32.403 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.401+0000 7f2f334bb800 20 rados->read ofs=0 len=0 2024-09-14T11:09:32.403 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.401+0000 7f2f334bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:32.403 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.401+0000 7f2f334bb800 20 rados->read ofs=0 len=0 2024-09-14T11:09:32.403 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.401+0000 7f2f334bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:32.403 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.401+0000 7f2f334bb800 20 started sync module instance, tier type = 2024-09-14T11:09:32.403 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.401+0000 7f2f334bb800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:09:32.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.409+0000 7f2f334bb800 20 add_watcher() i=0 2024-09-14T11:09:32.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.409+0000 7f2f334bb800 20 add_watcher() i=1 2024-09-14T11:09:32.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.409+0000 7f2f334bb800 20 add_watcher() i=2 2024-09-14T11:09:32.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.409+0000 7f2f334bb800 20 add_watcher() i=3 2024-09-14T11:09:32.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.409+0000 7f2f334bb800 20 add_watcher() i=4 2024-09-14T11:09:32.408 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.409+0000 7f2f334bb800 20 add_watcher() i=5 2024-09-14T11:09:32.409 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.409+0000 7f2f334bb800 20 add_watcher() i=6 2024-09-14T11:09:32.409 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.410+0000 7f2f334bb800 20 add_watcher() i=7 2024-09-14T11:09:32.409 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.410+0000 7f2f334bb800 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:32.411 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.412+0000 7f2de6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:32.411 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.412+0000 7f2f334bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:32.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.412+0000 7f2f334bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:32.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.413+0000 7f2f334bb800 5 note: GC not initialized 2024-09-14T11:09:32.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.413+0000 7f2de5fe3640 20 reqs_thread_entry: start 2024-09-14T11:09:32.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.413+0000 7f2f334bb800 20 init_complete bucket index max shards: 11 2024-09-14T11:09:32.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.413+0000 7f2f334bb800 20 Filter name: none 2024-09-14T11:09:32.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.413+0000 7f2d577fe640 20 reqs_thread_entry: start 2024-09-14T11:09:32.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.413+0000 7f2f334bb800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:09:32.412 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.413+0000 7f2f334bb800 20 rados->read ofs=0 len=0 2024-09-14T11:09:32.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.413+0000 7f2f334bb800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:09:32.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.413+0000 7f2f334bb800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:09:32.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.413+0000 7f2f334bb800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:09:32.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.413+0000 7f2f334bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 : miss 2024-09-14T11:09:32.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.413+0000 7f2f334bb800 20 rados->read ofs=0 len=0 2024-09-14T11:09:32.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.414+0000 7f2f334bb800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:09:32.413 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.414+0000 7f2f334bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 info.flags=0x17 2024-09-14T11:09:32.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.414+0000 7f2f334bb800 10 adding default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 to cache LRU end 2024-09-14T11:09:32.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.414+0000 7f2f334bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:09:32.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.414+0000 7f2f334bb800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:09:32.414 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.414+0000 7f2f334bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 2024-09-14T11:09:32.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.419+0000 7f2f334bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 info.flags=0x17 2024-09-14T11:09:32.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.419+0000 7f2f334bb800 10 moving default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 to cache LRU end 2024-09-14T11:09:32.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.419+0000 7f2f334bb800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:09:32.417 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.419+0000 7f2f334bb800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18, ofs0, ns] 2024-09-14T11:09:32.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.419+0000 7f2e07fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595197 cookie 94481211040672 notifier 8126 bl.length()=821 2024-09-14T11:09:32.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.419+0000 7f2e07fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 info.flags=0x17 2024-09-14T11:09:32.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.419+0000 7f2e07fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 to cache LRU end 2024-09-14T11:09:32.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.419+0000 7f2e07fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:09:32.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.419+0000 7f2f334bb800 20 handle_bi_update(): bucket=:myver[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18]): orig_sources= new_sources= 2024-09-14T11:09:32.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.419+0000 7f2f334bb800 20 handle_bi_update(): bucket=:myver[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18]): potential sources added=[] removed=[] 2024-09-14T11:09:32.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.419+0000 7f2f334bb800 20 handle_bi_update(): bucket=:myver[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18]): orig_dests= new_dests= 2024-09-14T11:09:32.418 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.419+0000 7f2f334bb800 20 handle_bi_update(): bucket=:myver[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18]): potential dests added=[] removed=[] 2024-09-14T11:09:32.423 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:32.425+0000 7f2f334bb800 -1 Injecting delay=5.000000000s at location=do_reshard 2024-09-14T11:09:33.336 INFO:tasks.workunit.client.0.smithi097.stderr:put object successful 2024-09-14T11:09:37.424 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.425+0000 7f2f334bb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.0 2024-09-14T11:09:37.424 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.425+0000 7f2f334bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.0 2024-09-14T11:09:37.424 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.425+0000 7f2f334bb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.1 2024-09-14T11:09:37.424 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.425+0000 7f2f334bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.1 2024-09-14T11:09:37.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.425+0000 7f2f334bb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.2 2024-09-14T11:09:37.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.425+0000 7f2f334bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.2 2024-09-14T11:09:37.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.425+0000 7f2f334bb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.3 2024-09-14T11:09:37.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.425+0000 7f2f334bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.3 2024-09-14T11:09:37.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.425+0000 7f2f334bb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.4 2024-09-14T11:09:37.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.425+0000 7f2f334bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.4 2024-09-14T11:09:37.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.425+0000 7f2f334bb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.5 2024-09-14T11:09:37.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.425+0000 7f2f334bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.5 2024-09-14T11:09:37.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.425+0000 7f2f334bb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.6 2024-09-14T11:09:37.425 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.425+0000 7f2f334bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.6 2024-09-14T11:09:37.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.425+0000 7f2f334bb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.7 2024-09-14T11:09:37.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.425+0000 7f2f334bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.7 2024-09-14T11:09:37.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.425+0000 7f2f334bb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.8 2024-09-14T11:09:37.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.425+0000 7f2f334bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.8 2024-09-14T11:09:37.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.425+0000 7f2f334bb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.9 2024-09-14T11:09:37.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.425+0000 7f2f334bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.9 2024-09-14T11:09:37.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.425+0000 7f2f334bb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.10 2024-09-14T11:09:37.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.425+0000 7f2f334bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.10 2024-09-14T11:09:37.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.425+0000 7f2f334bb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.11 2024-09-14T11:09:37.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.425+0000 7f2f334bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.11 2024-09-14T11:09:37.426 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.425+0000 7f2f334bb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.12 2024-09-14T11:09:37.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.425+0000 7f2f334bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.12 2024-09-14T11:09:37.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.425+0000 7f2f334bb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.0 2024-09-14T11:09:37.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.425+0000 7f2f334bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.0 2024-09-14T11:09:37.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.426+0000 7f2f334bb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.1 2024-09-14T11:09:37.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.426+0000 7f2f334bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.1 2024-09-14T11:09:37.427 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.427+0000 7f2f334bb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.2 2024-09-14T11:09:37.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.427+0000 7f2f334bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.2 2024-09-14T11:09:37.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.427+0000 7f2f334bb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.3 2024-09-14T11:09:37.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.427+0000 7f2f334bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.3 2024-09-14T11:09:37.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.428+0000 7f2f334bb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.4 2024-09-14T11:09:37.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.428+0000 7f2f334bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.4 2024-09-14T11:09:37.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.429+0000 7f2f334bb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.5 2024-09-14T11:09:37.428 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.429+0000 7f2f334bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.5 2024-09-14T11:09:37.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.430+0000 7f2f334bb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.6 2024-09-14T11:09:37.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.430+0000 7f2f334bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.6 2024-09-14T11:09:37.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.431+0000 7f2f334bb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.7 2024-09-14T11:09:37.429 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.431+0000 7f2f334bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.7 2024-09-14T11:09:37.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.431+0000 7f2f334bb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.8 2024-09-14T11:09:37.430 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.431+0000 7f2f334bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.8 2024-09-14T11:09:37.431 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.432+0000 7f2f334bb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.9 2024-09-14T11:09:37.431 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.432+0000 7f2f334bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.9 2024-09-14T11:09:37.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.433+0000 7f2f334bb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.10 2024-09-14T11:09:37.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.433+0000 7f2f334bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.10 2024-09-14T11:09:37.432 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.434+0000 7f2f334bb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.11 2024-09-14T11:09:37.433 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.434+0000 7f2f334bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.11 2024-09-14T11:09:37.435 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.436+0000 7f2f334bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:09:37.435 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.436+0000 7f2f334bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 2024-09-14T11:09:37.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.439+0000 7f2f334bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 info.flags=0x17 2024-09-14T11:09:37.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.439+0000 7f2f334bb800 10 moving default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 to cache LRU end 2024-09-14T11:09:37.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.439+0000 7f2f334bb800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:09:37.437 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.439+0000 7f2f334bb800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18, ofs0, ns] 2024-09-14T11:09:37.438 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.439+0000 7f2e07fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595198 cookie 94481211040672 notifier 8126 bl.length()=821 2024-09-14T11:09:37.438 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.439+0000 7f2e07fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 info.flags=0x17 2024-09-14T11:09:37.438 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.439+0000 7f2e07fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 to cache LRU end 2024-09-14T11:09:37.438 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.439+0000 7f2e07fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:09:37.438 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.440+0000 7f2f334bb800 20 handle_bi_update(): bucket=:myver[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18]): orig_sources= new_sources= 2024-09-14T11:09:37.438 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.440+0000 7f2f334bb800 20 handle_bi_update(): bucket=:myver[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18]): potential sources added=[] removed=[] 2024-09-14T11:09:37.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.440+0000 7f2f334bb800 20 handle_bi_update(): bucket=:myver[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18]): orig_dests= new_dests= 2024-09-14T11:09:37.439 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.440+0000 7f2f334bb800 20 handle_bi_update(): bucket=:myver[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18]): potential dests added=[] removed=[] 2024-09-14T11:09:37.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.442+0000 7f2f334bb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.0 2024-09-14T11:09:37.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.442+0000 7f2f334bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.0 2024-09-14T11:09:37.441 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.443+0000 7f2f334bb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.1 2024-09-14T11:09:37.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.443+0000 7f2f334bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.1 2024-09-14T11:09:37.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.443+0000 7f2f334bb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.2 2024-09-14T11:09:37.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.443+0000 7f2f334bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.2 2024-09-14T11:09:37.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.444+0000 7f2f334bb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.3 2024-09-14T11:09:37.442 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.444+0000 7f2f334bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.3 2024-09-14T11:09:37.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.444+0000 7f2f334bb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.4 2024-09-14T11:09:37.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.444+0000 7f2f334bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.4 2024-09-14T11:09:37.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.444+0000 7f2f334bb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.5 2024-09-14T11:09:37.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.445+0000 7f2f334bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.5 2024-09-14T11:09:37.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.445+0000 7f2f334bb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.6 2024-09-14T11:09:37.443 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.445+0000 7f2f334bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.6 2024-09-14T11:09:37.444 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.445+0000 7f2f334bb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.7 2024-09-14T11:09:37.444 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.445+0000 7f2f334bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.7 2024-09-14T11:09:37.444 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.446+0000 7f2f334bb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.8 2024-09-14T11:09:37.444 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.446+0000 7f2f334bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.8 2024-09-14T11:09:37.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.447+0000 7f2f334bb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.9 2024-09-14T11:09:37.445 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.447+0000 7f2f334bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.9 2024-09-14T11:09:37.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.447+0000 7f2f334bb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.10 2024-09-14T11:09:37.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.447+0000 7f2f334bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.10 2024-09-14T11:09:37.446 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.447+0000 7f2f334bb800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.11 2024-09-14T11:09:37.447 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.447+0000 7f2f334bb800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.1.11 2024-09-14T11:09:37.448 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.450+0000 7f2f334bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:09:37.448 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.450+0000 7f2f334bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 2024-09-14T11:09:37.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.451+0000 7f2f334bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 info.flags=0x17 2024-09-14T11:09:37.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.451+0000 7f2f334bb800 10 moving default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 to cache LRU end 2024-09-14T11:09:37.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.451+0000 7f2f334bb800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:09:37.450 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.451+0000 7f2f334bb800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18, ofs0, ns] 2024-09-14T11:09:37.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.452+0000 7f2e077fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595199 cookie 94481211040672 notifier 8126 bl.length()=789 2024-09-14T11:09:37.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.452+0000 7f2e077fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 info.flags=0x17 2024-09-14T11:09:37.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.452+0000 7f2e077fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 to cache LRU end 2024-09-14T11:09:37.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.452+0000 7f2e077fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:09:37.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.453+0000 7f2f334bb800 20 handle_bi_update(): bucket=:myver[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18]): orig_sources= new_sources= 2024-09-14T11:09:37.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.453+0000 7f2f334bb800 20 handle_bi_update(): bucket=:myver[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18]): potential sources added=[] removed=[] 2024-09-14T11:09:37.451 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.453+0000 7f2f334bb800 20 handle_bi_update(): bucket=:myver[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18]): orig_dests= new_dests= 2024-09-14T11:09:37.452 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.453+0000 7f2f334bb800 20 handle_bi_update(): bucket=:myver[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18]): potential dests added=[] removed=[] 2024-09-14T11:09:37.454 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.456+0000 7f2f334bb800 1 execute INFO: reshard of bucket "myver" from 12 shards to 13 shards completed successfully 2024-09-14T11:09:37.457 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.458+0000 7f2de6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:37.459 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.461+0000 7f2f334bb800 20 remove_watcher() i=0 2024-09-14T11:09:37.459 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.461+0000 7f2f334bb800 2 removed watcher, disabling cache 2024-09-14T11:09:37.460 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.462+0000 7f2f334bb800 20 remove_watcher() i=1 2024-09-14T11:09:37.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.463+0000 7f2f334bb800 20 remove_watcher() i=2 2024-09-14T11:09:37.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.464+0000 7f2f334bb800 20 remove_watcher() i=3 2024-09-14T11:09:37.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.465+0000 7f2f334bb800 20 remove_watcher() i=4 2024-09-14T11:09:37.465 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.467+0000 7f2f334bb800 20 remove_watcher() i=5 2024-09-14T11:09:37.466 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.468+0000 7f2f334bb800 20 remove_watcher() i=6 2024-09-14T11:09:37.467 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:37.469+0000 7f2f334bb800 20 remove_watcher() i=7 2024-09-14T11:09:38.341 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-09-14T11:09:38.341 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:09:38.451 INFO:tasks.workunit.client.0.smithi097.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T11:09:38.846 INFO:tasks.workunit.client.0.smithi097.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-14T11:09:40.293 INFO:tasks.workunit.client.0.smithi097.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:09:40.294 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bi list --bucket myver --object x 2024-09-14T11:09:40.327 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:40.328 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:40.368 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.369+0000 7f75a9f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:09:40.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.371+0000 7f75a9f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:40.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.371+0000 7f75a9f2e800 20 realm 2024-09-14T11:09:40.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.371+0000 7f75a9f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:09:40.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.372+0000 7f75a9f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:40.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.372+0000 7f75a9f2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:40.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.372+0000 7f75a9f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:09:40.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.372+0000 7f75a9f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:40.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.372+0000 7f75a9f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:09:40.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.372+0000 7f75a9f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:40.371 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.372+0000 7f75a9f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:09:40.372 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.373+0000 7f75a9f2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:09:40.372 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.373+0000 7f75a9f2e800 20 searching for the correct realm 2024-09-14T11:09:40.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.376+0000 7f75a6365640 0 -- 172.21.15.97:0/3401307510 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f7590075070 msgr2=0x7f75900a6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:09:40.581 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.582+0000 7f759d363640 0 -- 172.21.15.97:0/3401307510 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f7598023040 msgr2=0x7f7598022920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:40.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.588+0000 7f75a9f2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:40.586 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.588+0000 7f75a9f2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:40.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.588+0000 7f75a9f2e800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:09:40.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.588+0000 7f75a9f2e800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:09:40.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.588+0000 7f75a9f2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:40.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.588+0000 7f75a9f2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:40.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.588+0000 7f75a9f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:09:40.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.588+0000 7f75a9f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:40.587 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.588+0000 7f75a9f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:09:40.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.588+0000 7f75a9f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:40.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.588+0000 7f75a9f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:09:40.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.589+0000 7f75a9f2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:09:40.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.589+0000 7f75a9f2e800 20 zone default found 2024-09-14T11:09:40.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.589+0000 7f75a9f2e800 4 Realm: () 2024-09-14T11:09:40.588 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.589+0000 7f75a9f2e800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:09:40.589 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.589+0000 7f75a9f2e800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:09:40.589 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.589+0000 7f75a9f2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:40.589 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.589+0000 7f75a9f2e800 20 zonegroup default 2024-09-14T11:09:40.589 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.589+0000 7f75a9f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:09:40.589 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.589+0000 7f75a9f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:40.589 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.589+0000 7f75a9f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:09:40.589 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.589+0000 7f75a9f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:40.589 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.589+0000 7f75a9f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:09:40.589 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.590+0000 7f75a9f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:40.589 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.590+0000 7f75a9f2e800 20 started sync module instance, tier type = 2024-09-14T11:09:40.589 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.590+0000 7f75a9f2e800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:09:40.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.600+0000 7f75a9f2e800 20 add_watcher() i=0 2024-09-14T11:09:40.598 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.600+0000 7f75a9f2e800 20 add_watcher() i=1 2024-09-14T11:09:40.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.600+0000 7f75a9f2e800 20 add_watcher() i=2 2024-09-14T11:09:40.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.600+0000 7f75a9f2e800 20 add_watcher() i=3 2024-09-14T11:09:40.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.600+0000 7f75a9f2e800 20 add_watcher() i=4 2024-09-14T11:09:40.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.600+0000 7f75a9f2e800 20 add_watcher() i=5 2024-09-14T11:09:40.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.600+0000 7f75a9f2e800 20 add_watcher() i=6 2024-09-14T11:09:40.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.601+0000 7f75a9f2e800 20 add_watcher() i=7 2024-09-14T11:09:40.599 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.601+0000 7f75a9f2e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:40.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.603+0000 7f74577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:40.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.603+0000 7f75a9f2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:40.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.603+0000 7f75a9f2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:40.602 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.603+0000 7f75a9f2e800 5 note: GC not initialized 2024-09-14T11:09:40.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.604+0000 7f74567fc640 20 reqs_thread_entry: start 2024-09-14T11:09:40.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.604+0000 7f75a9f2e800 20 init_complete bucket index max shards: 11 2024-09-14T11:09:40.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.604+0000 7f75a9f2e800 20 Filter name: none 2024-09-14T11:09:40.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.604+0000 7f73c7fff640 20 reqs_thread_entry: start 2024-09-14T11:09:40.603 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.604+0000 7f75a9f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:09:40.604 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.605+0000 7f75a9f2e800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:09:40.604 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.605+0000 7f75a9f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:09:40.604 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.605+0000 7f75a9f2e800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:09:40.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.605+0000 7f75a9f2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:09:40.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.605+0000 7f75a9f2e800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-14T11:09:40.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.605+0000 7f75a9f2e800 20 INFO: main: starting shard=0 2024-09-14T11:09:40.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.606+0000 7f75a9f2e800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.0 2024-09-14T11:09:40.605 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.606+0000 7f75a9f2e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.0 2024-09-14T11:09:40.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.606+0000 7f75a9f2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:09:40.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.606+0000 7f75a9f2e800 20 INFO: main: starting shard=1 2024-09-14T11:09:40.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.606+0000 7f75a9f2e800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.1 2024-09-14T11:09:40.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.606+0000 7f75a9f2e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.1 2024-09-14T11:09:40.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.607+0000 7f75a9f2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:09:40.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.607+0000 7f75a9f2e800 20 INFO: main: starting shard=2 2024-09-14T11:09:40.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.607+0000 7f75a9f2e800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.2 2024-09-14T11:09:40.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.607+0000 7f75a9f2e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.2 2024-09-14T11:09:40.606 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.607+0000 7f75a9f2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:09:40.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.607+0000 7f75a9f2e800 20 INFO: main: starting shard=3 2024-09-14T11:09:40.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.607+0000 7f75a9f2e800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.3 2024-09-14T11:09:40.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.607+0000 7f75a9f2e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.3 2024-09-14T11:09:40.607 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.608+0000 7f75a9f2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:09:40.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.608+0000 7f75a9f2e800 20 INFO: main: starting shard=4 2024-09-14T11:09:40.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.608+0000 7f75a9f2e800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.4 2024-09-14T11:09:40.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.608+0000 7f75a9f2e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.4 2024-09-14T11:09:40.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.608+0000 7f75a9f2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:09:40.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.608+0000 7f75a9f2e800 20 INFO: main: starting shard=5 2024-09-14T11:09:40.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.608+0000 7f75a9f2e800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.5 2024-09-14T11:09:40.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.608+0000 7f75a9f2e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.5 2024-09-14T11:09:40.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.609+0000 7f75a9f2e800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:09:40.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.609+0000 7f75a9f2e800 20 INFO: main: starting shard=6 2024-09-14T11:09:40.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.609+0000 7f75a9f2e800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.6 2024-09-14T11:09:40.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.609+0000 7f75a9f2e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.6 2024-09-14T11:09:40.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.609+0000 7f75a9f2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:09:40.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.609+0000 7f75a9f2e800 20 INFO: main: starting shard=7 2024-09-14T11:09:40.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.609+0000 7f75a9f2e800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.7 2024-09-14T11:09:40.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.609+0000 7f75a9f2e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.7 2024-09-14T11:09:40.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.610+0000 7f75a9f2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:09:40.609 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.610+0000 7f75a9f2e800 20 INFO: main: starting shard=8 2024-09-14T11:09:40.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.610+0000 7f75a9f2e800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.8 2024-09-14T11:09:40.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.610+0000 7f75a9f2e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.8 2024-09-14T11:09:40.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.611+0000 7f75a9f2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:09:40.610 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.611+0000 7f75a9f2e800 20 INFO: main: starting shard=9 2024-09-14T11:09:40.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.611+0000 7f75a9f2e800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.9 2024-09-14T11:09:40.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.611+0000 7f75a9f2e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.9 2024-09-14T11:09:40.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.612+0000 7f75a9f2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:09:40.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.612+0000 7f75a9f2e800 20 INFO: main: starting shard=10 2024-09-14T11:09:40.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.612+0000 7f75a9f2e800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.10 2024-09-14T11:09:40.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.612+0000 7f75a9f2e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.10 2024-09-14T11:09:40.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.612+0000 7f75a9f2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:09:40.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.612+0000 7f75a9f2e800 20 INFO: main: starting shard=11 2024-09-14T11:09:40.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.612+0000 7f75a9f2e800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.11 2024-09-14T11:09:40.611 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.612+0000 7f75a9f2e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.11 2024-09-14T11:09:40.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.613+0000 7f75a9f2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:09:40.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.613+0000 7f75a9f2e800 20 INFO: main: starting shard=12 2024-09-14T11:09:40.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.613+0000 7f75a9f2e800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.12 2024-09-14T11:09:40.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.613+0000 7f75a9f2e800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.12 2024-09-14T11:09:40.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.613+0000 7f75a9f2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:09:40.612 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.613+0000 7f75a9f2e800 20 INFO: main: done 2024-09-14T11:09:40.613 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.614+0000 7f74577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:40.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.616+0000 7f75a9f2e800 20 remove_watcher() i=0 2024-09-14T11:09:40.615 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.616+0000 7f75a9f2e800 2 removed watcher, disabling cache 2024-09-14T11:09:40.616 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.618+0000 7f75a9f2e800 20 remove_watcher() i=1 2024-09-14T11:09:40.617 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.619+0000 7f75a9f2e800 20 remove_watcher() i=2 2024-09-14T11:09:40.618 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.620+0000 7f75a9f2e800 20 remove_watcher() i=3 2024-09-14T11:09:40.619 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.621+0000 7f75a9f2e800 20 remove_watcher() i=4 2024-09-14T11:09:40.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.622+0000 7f75a9f2e800 20 remove_watcher() i=5 2024-09-14T11:09:40.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.623+0000 7f75a9f2e800 20 remove_watcher() i=6 2024-09-14T11:09:40.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.625+0000 7f75a9f2e800 20 remove_watcher() i=7 2024-09-14T11:09:40.689 INFO:tasks.workunit.client.0.smithi097.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:09:40.690 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bi list --bucket myver --object y 2024-09-14T11:09:40.721 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:40.721 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:40.758 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.759+0000 7fee0d9af800 20 rados->read ofs=0 len=0 2024-09-14T11:09:40.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.761+0000 7fee0d9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:40.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.761+0000 7fee0d9af800 20 realm 2024-09-14T11:09:40.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.761+0000 7fee0d9af800 20 rados->read ofs=0 len=0 2024-09-14T11:09:40.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.761+0000 7fee0d9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:40.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.761+0000 7fee0d9af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:40.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.761+0000 7fee0d9af800 20 rados->read ofs=0 len=0 2024-09-14T11:09:40.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.762+0000 7fee0d9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:40.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.762+0000 7fee0d9af800 20 rados->read ofs=0 len=0 2024-09-14T11:09:40.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.762+0000 7fee0d9af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:40.761 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.762+0000 7fee0d9af800 20 rados->read ofs=0 len=0 2024-09-14T11:09:40.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.763+0000 7fee0d9af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:09:40.762 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.763+0000 7fee0d9af800 20 searching for the correct realm 2024-09-14T11:09:40.764 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.765+0000 7fee0bc9a640 0 -- 172.21.15.97:0/676224746 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7fedf4063070 msgr2=0x7fedf40ce9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:09:40.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.970+0000 7fee02c98640 0 -- 172.21.15.97:0/676224746 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7fedfc06c210 msgr2=0x7fedfc067190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:40.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.975+0000 7fee0d9af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:40.975 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.975+0000 7fee0d9af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:40.976 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.975+0000 7fee0d9af800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:09:40.976 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.975+0000 7fee0d9af800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:09:40.976 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.975+0000 7fee0d9af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:40.976 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.975+0000 7fee0d9af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:40.976 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.975+0000 7fee0d9af800 20 rados->read ofs=0 len=0 2024-09-14T11:09:40.976 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.976+0000 7fee0d9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:40.976 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.976+0000 7fee0d9af800 20 rados->read ofs=0 len=0 2024-09-14T11:09:40.976 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.976+0000 7fee0d9af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:40.976 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.976+0000 7fee0d9af800 20 rados->read ofs=0 len=0 2024-09-14T11:09:40.976 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.976+0000 7fee0d9af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:09:40.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.976+0000 7fee0d9af800 20 zone default found 2024-09-14T11:09:40.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.976+0000 7fee0d9af800 4 Realm: () 2024-09-14T11:09:40.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.976+0000 7fee0d9af800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:09:40.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.976+0000 7fee0d9af800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:09:40.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.976+0000 7fee0d9af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:40.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.976+0000 7fee0d9af800 20 zonegroup default 2024-09-14T11:09:40.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.976+0000 7fee0d9af800 20 rados->read ofs=0 len=0 2024-09-14T11:09:40.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.977+0000 7fee0d9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:40.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.977+0000 7fee0d9af800 20 rados->read ofs=0 len=0 2024-09-14T11:09:40.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.977+0000 7fee0d9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:40.977 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.977+0000 7fee0d9af800 20 rados->read ofs=0 len=0 2024-09-14T11:09:40.978 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.977+0000 7fee0d9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:40.978 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.977+0000 7fee0d9af800 20 started sync module instance, tier type = 2024-09-14T11:09:40.978 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.977+0000 7fee0d9af800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:09:40.985 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.987+0000 7fee0d9af800 20 add_watcher() i=0 2024-09-14T11:09:40.986 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.987+0000 7fee0d9af800 20 add_watcher() i=1 2024-09-14T11:09:40.986 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.987+0000 7fee0d9af800 20 add_watcher() i=2 2024-09-14T11:09:40.986 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.987+0000 7fee0d9af800 20 add_watcher() i=3 2024-09-14T11:09:40.986 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.987+0000 7fee0d9af800 20 add_watcher() i=4 2024-09-14T11:09:40.986 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.987+0000 7fee0d9af800 20 add_watcher() i=5 2024-09-14T11:09:40.986 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.987+0000 7fee0d9af800 20 add_watcher() i=6 2024-09-14T11:09:40.987 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.988+0000 7fee0d9af800 20 add_watcher() i=7 2024-09-14T11:09:40.987 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.988+0000 7fee0d9af800 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:40.989 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.990+0000 7fecc1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:40.990 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.991+0000 7fee0d9af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:40.990 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.991+0000 7fee0d9af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:40.990 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.991+0000 7fee0d9af800 5 note: GC not initialized 2024-09-14T11:09:40.990 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.991+0000 7fecc0fe1640 20 reqs_thread_entry: start 2024-09-14T11:09:40.991 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.991+0000 7fee0d9af800 20 init_complete bucket index max shards: 11 2024-09-14T11:09:40.991 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.991+0000 7fee0d9af800 20 Filter name: none 2024-09-14T11:09:40.991 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.991+0000 7fec3a7fc640 20 reqs_thread_entry: start 2024-09-14T11:09:40.991 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.991+0000 7fee0d9af800 20 rados->read ofs=0 len=0 2024-09-14T11:09:40.991 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.992+0000 7fee0d9af800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:09:40.991 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.992+0000 7fee0d9af800 20 rados->read ofs=0 len=0 2024-09-14T11:09:40.992 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.992+0000 7fee0d9af800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:09:40.992 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.992+0000 7fee0d9af800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:09:40.992 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.992+0000 7fee0d9af800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-14T11:09:40.992 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.992+0000 7fee0d9af800 20 INFO: main: starting shard=0 2024-09-14T11:09:40.993 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.992+0000 7fee0d9af800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.0 2024-09-14T11:09:40.993 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.992+0000 7fee0d9af800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.0 2024-09-14T11:09:40.993 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.993+0000 7fee0d9af800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:09:40.993 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.993+0000 7fee0d9af800 20 INFO: main: starting shard=1 2024-09-14T11:09:40.993 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.993+0000 7fee0d9af800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.1 2024-09-14T11:09:40.993 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.993+0000 7fee0d9af800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.1 2024-09-14T11:09:40.993 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.993+0000 7fee0d9af800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:09:40.993 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.993+0000 7fee0d9af800 20 INFO: main: starting shard=2 2024-09-14T11:09:40.993 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.993+0000 7fee0d9af800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.2 2024-09-14T11:09:40.993 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.993+0000 7fee0d9af800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.2 2024-09-14T11:09:40.993 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.994+0000 7fee0d9af800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:09:40.993 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.994+0000 7fee0d9af800 20 INFO: main: starting shard=3 2024-09-14T11:09:40.993 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.994+0000 7fee0d9af800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.3 2024-09-14T11:09:40.994 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.994+0000 7fee0d9af800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.3 2024-09-14T11:09:40.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.994+0000 7fee0d9af800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:09:40.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.994+0000 7fee0d9af800 20 INFO: main: starting shard=4 2024-09-14T11:09:40.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.994+0000 7fee0d9af800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.4 2024-09-14T11:09:40.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.994+0000 7fee0d9af800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.4 2024-09-14T11:09:40.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.995+0000 7fee0d9af800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:09:40.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.995+0000 7fee0d9af800 20 INFO: main: starting shard=5 2024-09-14T11:09:40.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.995+0000 7fee0d9af800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.5 2024-09-14T11:09:40.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.995+0000 7fee0d9af800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.5 2024-09-14T11:09:40.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.995+0000 7fee0d9af800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:09:40.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.995+0000 7fee0d9af800 20 INFO: main: starting shard=6 2024-09-14T11:09:40.995 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.995+0000 7fee0d9af800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.6 2024-09-14T11:09:40.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.995+0000 7fee0d9af800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.6 2024-09-14T11:09:40.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.995+0000 7fee0d9af800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:09:40.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.995+0000 7fee0d9af800 20 INFO: main: starting shard=7 2024-09-14T11:09:40.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.995+0000 7fee0d9af800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.7 2024-09-14T11:09:40.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.995+0000 7fee0d9af800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.7 2024-09-14T11:09:40.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.996+0000 7fee0d9af800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:09:40.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.996+0000 7fee0d9af800 20 INFO: main: starting shard=8 2024-09-14T11:09:40.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.996+0000 7fee0d9af800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.8 2024-09-14T11:09:40.996 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.996+0000 7fee0d9af800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.8 2024-09-14T11:09:40.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.997+0000 7fee0d9af800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:09:40.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.997+0000 7fee0d9af800 20 INFO: main: starting shard=9 2024-09-14T11:09:40.997 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.997+0000 7fee0d9af800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.9 2024-09-14T11:09:40.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.997+0000 7fee0d9af800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.9 2024-09-14T11:09:40.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.997+0000 7fee0d9af800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:09:40.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.997+0000 7fee0d9af800 20 INFO: main: starting shard=10 2024-09-14T11:09:40.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.997+0000 7fee0d9af800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.10 2024-09-14T11:09:40.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.997+0000 7fee0d9af800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.10 2024-09-14T11:09:40.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.998+0000 7fee0d9af800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:09:40.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.998+0000 7fee0d9af800 20 INFO: main: starting shard=11 2024-09-14T11:09:40.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.998+0000 7fee0d9af800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.11 2024-09-14T11:09:40.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.998+0000 7fee0d9af800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.11 2024-09-14T11:09:40.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.998+0000 7fee0d9af800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:09:40.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.998+0000 7fee0d9af800 20 INFO: main: starting shard=12 2024-09-14T11:09:40.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.998+0000 7fee0d9af800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.12 2024-09-14T11:09:40.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.998+0000 7fee0d9af800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.12 2024-09-14T11:09:40.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.998+0000 7fee0d9af800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:09:40.998 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.998+0000 7fee0d9af800 20 INFO: main: done 2024-09-14T11:09:40.999 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:40.999+0000 7fecc1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:41.000 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.002+0000 7fee0d9af800 20 remove_watcher() i=0 2024-09-14T11:09:41.000 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.002+0000 7fee0d9af800 2 removed watcher, disabling cache 2024-09-14T11:09:41.001 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.003+0000 7fee0d9af800 20 remove_watcher() i=1 2024-09-14T11:09:41.002 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.004+0000 7fee0d9af800 20 remove_watcher() i=2 2024-09-14T11:09:41.003 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.005+0000 7fee0d9af800 20 remove_watcher() i=3 2024-09-14T11:09:41.005 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.006+0000 7fee0d9af800 20 remove_watcher() i=4 2024-09-14T11:09:41.006 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.007+0000 7fee0d9af800 20 remove_watcher() i=5 2024-09-14T11:09:41.007 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.008+0000 7fee0d9af800 20 remove_watcher() i=6 2024-09-14T11:09:41.008 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.009+0000 7fee0d9af800 20 remove_watcher() i=7 2024-09-14T11:09:41.073 INFO:tasks.workunit.client.0.smithi097.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:09:41.075 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bi list --bucket myver --object z 2024-09-14T11:09:41.104 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:41.105 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:41.142 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.143+0000 7f7573d25800 20 rados->read ofs=0 len=0 2024-09-14T11:09:41.144 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.145+0000 7f7573d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:41.144 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.145+0000 7f7573d25800 20 realm 2024-09-14T11:09:41.144 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.145+0000 7f7573d25800 20 rados->read ofs=0 len=0 2024-09-14T11:09:41.144 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.145+0000 7f7573d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:41.144 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.145+0000 7f7573d25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:41.144 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.145+0000 7f7573d25800 20 rados->read ofs=0 len=0 2024-09-14T11:09:41.144 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.145+0000 7f7573d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:41.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.145+0000 7f7573d25800 20 rados->read ofs=0 len=0 2024-09-14T11:09:41.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.146+0000 7f7573d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:41.145 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.146+0000 7f7573d25800 20 rados->read ofs=0 len=0 2024-09-14T11:09:41.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.147+0000 7f7573d25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:09:41.146 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.147+0000 7f7573d25800 20 searching for the correct realm 2024-09-14T11:09:41.148 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.149+0000 7f7570134640 0 -- 172.21.15.97:0/205600100 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f7558048fa0 msgr2=0x7f755806ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:41.353 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.354+0000 7f7567fff640 0 -- 172.21.15.97:0/205600100 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f7560081400 msgr2=0x7f7560081860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:41.358 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.359+0000 7f7573d25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:41.358 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.359+0000 7f7573d25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:41.358 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.359+0000 7f7573d25800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:09:41.358 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.359+0000 7f7573d25800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:09:41.358 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.359+0000 7f7573d25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:41.358 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.359+0000 7f7573d25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:41.358 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.359+0000 7f7573d25800 20 rados->read ofs=0 len=0 2024-09-14T11:09:41.358 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.359+0000 7f7573d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:41.358 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.359+0000 7f7573d25800 20 rados->read ofs=0 len=0 2024-09-14T11:09:41.359 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.359+0000 7f7573d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:41.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.359+0000 7f7573d25800 20 rados->read ofs=0 len=0 2024-09-14T11:09:41.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.360+0000 7f7573d25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:09:41.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.360+0000 7f7573d25800 20 zone default found 2024-09-14T11:09:41.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.360+0000 7f7573d25800 4 Realm: () 2024-09-14T11:09:41.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.360+0000 7f7573d25800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:09:41.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.360+0000 7f7573d25800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:09:41.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.360+0000 7f7573d25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:41.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.360+0000 7f7573d25800 20 zonegroup default 2024-09-14T11:09:41.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.360+0000 7f7573d25800 20 rados->read ofs=0 len=0 2024-09-14T11:09:41.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.360+0000 7f7573d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:41.360 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.360+0000 7f7573d25800 20 rados->read ofs=0 len=0 2024-09-14T11:09:41.361 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.361+0000 7f7573d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:41.361 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.361+0000 7f7573d25800 20 rados->read ofs=0 len=0 2024-09-14T11:09:41.361 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.361+0000 7f7573d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:41.361 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.361+0000 7f7573d25800 20 started sync module instance, tier type = 2024-09-14T11:09:41.361 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.361+0000 7f7573d25800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:09:41.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.371+0000 7f7573d25800 20 add_watcher() i=0 2024-09-14T11:09:41.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.371+0000 7f7573d25800 20 add_watcher() i=1 2024-09-14T11:09:41.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.371+0000 7f7573d25800 20 add_watcher() i=2 2024-09-14T11:09:41.369 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.371+0000 7f7573d25800 20 add_watcher() i=3 2024-09-14T11:09:41.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.371+0000 7f7573d25800 20 add_watcher() i=4 2024-09-14T11:09:41.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.371+0000 7f7573d25800 20 add_watcher() i=5 2024-09-14T11:09:41.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.371+0000 7f7573d25800 20 add_watcher() i=6 2024-09-14T11:09:41.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.372+0000 7f7573d25800 20 add_watcher() i=7 2024-09-14T11:09:41.370 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.372+0000 7f7573d25800 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:41.372 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.373+0000 7f7425fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:41.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.374+0000 7f7573d25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:41.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.374+0000 7f7573d25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:41.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.374+0000 7f7573d25800 5 note: GC not initialized 2024-09-14T11:09:41.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.374+0000 7f7424fe1640 20 reqs_thread_entry: start 2024-09-14T11:09:41.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.374+0000 7f7573d25800 20 init_complete bucket index max shards: 11 2024-09-14T11:09:41.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.374+0000 7f7573d25800 20 Filter name: none 2024-09-14T11:09:41.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.374+0000 7f739e7fc640 20 reqs_thread_entry: start 2024-09-14T11:09:41.373 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.374+0000 7f7573d25800 20 rados->read ofs=0 len=0 2024-09-14T11:09:41.374 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.375+0000 7f7573d25800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:09:41.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.375+0000 7f7573d25800 20 rados->read ofs=0 len=0 2024-09-14T11:09:41.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.375+0000 7f7573d25800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:09:41.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.375+0000 7f7573d25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:09:41.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.375+0000 7f7573d25800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-14T11:09:41.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.375+0000 7f7573d25800 20 INFO: main: starting shard=0 2024-09-14T11:09:41.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.375+0000 7f7573d25800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.0 2024-09-14T11:09:41.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.375+0000 7f7573d25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.0 2024-09-14T11:09:41.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.376+0000 7f7573d25800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:09:41.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.376+0000 7f7573d25800 20 INFO: main: starting shard=1 2024-09-14T11:09:41.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.376+0000 7f7573d25800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.1 2024-09-14T11:09:41.375 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.376+0000 7f7573d25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.1 2024-09-14T11:09:41.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.377+0000 7f7573d25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:09:41.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.377+0000 7f7573d25800 20 INFO: main: starting shard=2 2024-09-14T11:09:41.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.377+0000 7f7573d25800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.2 2024-09-14T11:09:41.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.377+0000 7f7573d25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.2 2024-09-14T11:09:41.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.377+0000 7f7573d25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:09:41.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.377+0000 7f7573d25800 20 INFO: main: starting shard=3 2024-09-14T11:09:41.376 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.377+0000 7f7573d25800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.3 2024-09-14T11:09:41.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.377+0000 7f7573d25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.3 2024-09-14T11:09:41.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.377+0000 7f7573d25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:09:41.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.377+0000 7f7573d25800 20 INFO: main: starting shard=4 2024-09-14T11:09:41.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.377+0000 7f7573d25800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.4 2024-09-14T11:09:41.377 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.377+0000 7f7573d25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.4 2024-09-14T11:09:41.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.378+0000 7f7573d25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:09:41.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.378+0000 7f7573d25800 20 INFO: main: starting shard=5 2024-09-14T11:09:41.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.378+0000 7f7573d25800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.5 2024-09-14T11:09:41.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.378+0000 7f7573d25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.5 2024-09-14T11:09:41.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.379+0000 7f7573d25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:09:41.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.379+0000 7f7573d25800 20 INFO: main: starting shard=6 2024-09-14T11:09:41.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.379+0000 7f7573d25800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.6 2024-09-14T11:09:41.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.379+0000 7f7573d25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.6 2024-09-14T11:09:41.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.379+0000 7f7573d25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:09:41.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.379+0000 7f7573d25800 20 INFO: main: starting shard=7 2024-09-14T11:09:41.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.379+0000 7f7573d25800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.7 2024-09-14T11:09:41.378 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.379+0000 7f7573d25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.7 2024-09-14T11:09:41.379 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.380+0000 7f7573d25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:09:41.379 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.380+0000 7f7573d25800 20 INFO: main: starting shard=8 2024-09-14T11:09:41.379 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.380+0000 7f7573d25800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.8 2024-09-14T11:09:41.379 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.380+0000 7f7573d25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.8 2024-09-14T11:09:41.379 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.380+0000 7f7573d25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:09:41.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.380+0000 7f7573d25800 20 INFO: main: starting shard=9 2024-09-14T11:09:41.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.380+0000 7f7573d25800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.9 2024-09-14T11:09:41.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.380+0000 7f7573d25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.9 2024-09-14T11:09:41.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.381+0000 7f7573d25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:09:41.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.381+0000 7f7573d25800 20 INFO: main: starting shard=10 2024-09-14T11:09:41.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.381+0000 7f7573d25800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.10 2024-09-14T11:09:41.380 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.381+0000 7f7573d25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.10 2024-09-14T11:09:41.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.381+0000 7f7573d25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:09:41.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.381+0000 7f7573d25800 20 INFO: main: starting shard=11 2024-09-14T11:09:41.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.381+0000 7f7573d25800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.11 2024-09-14T11:09:41.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.381+0000 7f7573d25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.11 2024-09-14T11:09:41.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.381+0000 7f7573d25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:09:41.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.381+0000 7f7573d25800 20 INFO: main: starting shard=12 2024-09-14T11:09:41.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.381+0000 7f7573d25800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.12 2024-09-14T11:09:41.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.381+0000 7f7573d25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.12 2024-09-14T11:09:41.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.382+0000 7f7573d25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:09:41.381 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.382+0000 7f7573d25800 20 INFO: main: done 2024-09-14T11:09:41.382 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.383+0000 7f7425fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:41.383 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.385+0000 7f7573d25800 20 remove_watcher() i=0 2024-09-14T11:09:41.384 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.385+0000 7f7573d25800 2 removed watcher, disabling cache 2024-09-14T11:09:41.385 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.386+0000 7f7573d25800 20 remove_watcher() i=1 2024-09-14T11:09:41.386 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.387+0000 7f7573d25800 20 remove_watcher() i=2 2024-09-14T11:09:41.387 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.388+0000 7f7573d25800 20 remove_watcher() i=3 2024-09-14T11:09:41.388 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.389+0000 7f7573d25800 20 remove_watcher() i=4 2024-09-14T11:09:41.389 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.390+0000 7f7573d25800 20 remove_watcher() i=5 2024-09-14T11:09:41.390 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.391+0000 7f7573d25800 20 remove_watcher() i=6 2024-09-14T11:09:41.391 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:41.392+0000 7f7573d25800 20 remove_watcher() i=7 2024-09-14T11:09:41.407 INFO:tasks.workunit.client.0.smithi097.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T11:09:41.797 INFO:tasks.workunit.client.0.smithi097.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-14T11:09:42.188 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-09-14T11:09:42.218 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:42.218 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:42.256 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.257+0000 7fee22a87800 20 rados->read ofs=0 len=0 2024-09-14T11:09:42.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.259+0000 7fee22a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:42.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.259+0000 7fee22a87800 20 realm 2024-09-14T11:09:42.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.259+0000 7fee22a87800 20 rados->read ofs=0 len=0 2024-09-14T11:09:42.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.259+0000 7fee22a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:42.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.259+0000 7fee22a87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:42.258 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.259+0000 7fee22a87800 20 rados->read ofs=0 len=0 2024-09-14T11:09:42.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.260+0000 7fee22a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:42.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.260+0000 7fee22a87800 20 rados->read ofs=0 len=0 2024-09-14T11:09:42.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.260+0000 7fee22a87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:42.259 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.260+0000 7fee22a87800 20 rados->read ofs=0 len=0 2024-09-14T11:09:42.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.261+0000 7fee22a87800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:09:42.260 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.261+0000 7fee22a87800 20 searching for the correct realm 2024-09-14T11:09:42.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.263+0000 7fee20d72640 0 -- 172.21.15.97:0/2636055887 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7fee08017040 msgr2=0x7fee0800fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:42.466 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.468+0000 7fee1fd70640 0 -- 172.21.15.97:0/2636055887 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7fee18009df0 msgr2=0x7fee180c7260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:42.472 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.473+0000 7fee22a87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:42.472 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.473+0000 7fee22a87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:42.472 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.473+0000 7fee22a87800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:09:42.472 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.473+0000 7fee22a87800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:09:42.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.473+0000 7fee22a87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:42.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.473+0000 7fee22a87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:42.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.473+0000 7fee22a87800 20 rados->read ofs=0 len=0 2024-09-14T11:09:42.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.473+0000 7fee22a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:42.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.473+0000 7fee22a87800 20 rados->read ofs=0 len=0 2024-09-14T11:09:42.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.474+0000 7fee22a87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:42.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.474+0000 7fee22a87800 20 rados->read ofs=0 len=0 2024-09-14T11:09:42.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.474+0000 7fee22a87800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:09:42.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.474+0000 7fee22a87800 20 zone default found 2024-09-14T11:09:42.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.474+0000 7fee22a87800 4 Realm: () 2024-09-14T11:09:42.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.474+0000 7fee22a87800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:09:42.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.474+0000 7fee22a87800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:09:42.474 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.474+0000 7fee22a87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:42.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.474+0000 7fee22a87800 20 zonegroup default 2024-09-14T11:09:42.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.474+0000 7fee22a87800 20 rados->read ofs=0 len=0 2024-09-14T11:09:42.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.474+0000 7fee22a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:42.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.474+0000 7fee22a87800 20 rados->read ofs=0 len=0 2024-09-14T11:09:42.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.475+0000 7fee22a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:42.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.475+0000 7fee22a87800 20 rados->read ofs=0 len=0 2024-09-14T11:09:42.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.475+0000 7fee22a87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:42.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.475+0000 7fee22a87800 20 started sync module instance, tier type = 2024-09-14T11:09:42.475 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.475+0000 7fee22a87800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:09:42.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.485+0000 7fee22a87800 20 add_watcher() i=0 2024-09-14T11:09:42.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.485+0000 7fee22a87800 20 add_watcher() i=1 2024-09-14T11:09:42.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.485+0000 7fee22a87800 20 add_watcher() i=2 2024-09-14T11:09:42.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.485+0000 7fee22a87800 20 add_watcher() i=3 2024-09-14T11:09:42.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.485+0000 7fee22a87800 20 add_watcher() i=4 2024-09-14T11:09:42.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.485+0000 7fee22a87800 20 add_watcher() i=5 2024-09-14T11:09:42.484 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.485+0000 7fee22a87800 20 add_watcher() i=6 2024-09-14T11:09:42.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.486+0000 7fee22a87800 20 add_watcher() i=7 2024-09-14T11:09:42.485 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.486+0000 7fee22a87800 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:42.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.488+0000 7fecd6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:42.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.488+0000 7fee22a87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:42.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.488+0000 7fee22a87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:42.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.489+0000 7fee22a87800 5 note: GC not initialized 2024-09-14T11:09:42.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.489+0000 7fecd5fdb640 20 reqs_thread_entry: start 2024-09-14T11:09:42.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.489+0000 7fee22a87800 20 init_complete bucket index max shards: 11 2024-09-14T11:09:42.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.489+0000 7fee22a87800 20 Filter name: none 2024-09-14T11:09:42.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.489+0000 7fec477fe640 20 reqs_thread_entry: start 2024-09-14T11:09:42.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.489+0000 7fee22a87800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:09:42.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.489+0000 7fee22a87800 20 rados->read ofs=0 len=0 2024-09-14T11:09:42.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.490+0000 7fee22a87800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:09:42.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.490+0000 7fee22a87800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:09:42.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.490+0000 7fee22a87800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:09:42.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.490+0000 7fee22a87800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 : miss 2024-09-14T11:09:42.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.490+0000 7fee22a87800 20 rados->read ofs=0 len=0 2024-09-14T11:09:42.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.490+0000 7fee22a87800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:09:42.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.490+0000 7fee22a87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 info.flags=0x17 2024-09-14T11:09:42.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.490+0000 7fee22a87800 10 adding default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 to cache LRU end 2024-09-14T11:09:42.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.490+0000 7fee22a87800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:09:42.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.490+0000 7fee22a87800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:09:42.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.490+0000 7fee22a87800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 2024-09-14T11:09:42.495 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.496+0000 7fee22a87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 info.flags=0x17 2024-09-14T11:09:42.495 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.496+0000 7fee22a87800 10 moving default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 to cache LRU end 2024-09-14T11:09:42.495 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.496+0000 7fee22a87800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:09:42.495 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.496+0000 7fee22a87800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18, ofs0, ns] 2024-09-14T11:09:42.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.497+0000 7fecf6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595200 cookie 94763555771168 notifier 8778 bl.length()=821 2024-09-14T11:09:42.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.497+0000 7fecf6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 info.flags=0x17 2024-09-14T11:09:42.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.497+0000 7fecf6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 to cache LRU end 2024-09-14T11:09:42.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.497+0000 7fecf6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:09:42.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.497+0000 7fee22a87800 20 handle_bi_update(): bucket=:myver[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18]): orig_sources= new_sources= 2024-09-14T11:09:42.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.497+0000 7fee22a87800 20 handle_bi_update(): bucket=:myver[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18]): potential sources added=[] removed=[] 2024-09-14T11:09:42.496 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.497+0000 7fee22a87800 20 handle_bi_update(): bucket=:myver[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18]): orig_dests= new_dests= 2024-09-14T11:09:42.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.497+0000 7fee22a87800 20 handle_bi_update(): bucket=:myver[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18]): potential dests added=[] removed=[] 2024-09-14T11:09:42.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.503+0000 7fee22a87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.0 2024-09-14T11:09:42.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.503+0000 7fee22a87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.0 2024-09-14T11:09:42.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.503+0000 7fee22a87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.1 2024-09-14T11:09:42.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.503+0000 7fee22a87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.1 2024-09-14T11:09:42.502 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.503+0000 7fee22a87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.2 2024-09-14T11:09:42.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.503+0000 7fee22a87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.2 2024-09-14T11:09:42.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.503+0000 7fee22a87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.3 2024-09-14T11:09:42.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.503+0000 7fee22a87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.3 2024-09-14T11:09:42.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.503+0000 7fee22a87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.4 2024-09-14T11:09:42.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.503+0000 7fee22a87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.4 2024-09-14T11:09:42.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.503+0000 7fee22a87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.5 2024-09-14T11:09:42.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.503+0000 7fee22a87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.5 2024-09-14T11:09:42.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.503+0000 7fee22a87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.6 2024-09-14T11:09:42.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.503+0000 7fee22a87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.6 2024-09-14T11:09:42.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.503+0000 7fee22a87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.7 2024-09-14T11:09:42.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.503+0000 7fee22a87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.7 2024-09-14T11:09:42.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.503+0000 7fee22a87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.8 2024-09-14T11:09:42.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.503+0000 7fee22a87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.8 2024-09-14T11:09:42.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.503+0000 7fee22a87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.9 2024-09-14T11:09:42.503 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.503+0000 7fee22a87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.9 2024-09-14T11:09:42.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.503+0000 7fee22a87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.10 2024-09-14T11:09:42.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.503+0000 7fee22a87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.10 2024-09-14T11:09:42.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.503+0000 7fee22a87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.11 2024-09-14T11:09:42.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.503+0000 7fee22a87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.11 2024-09-14T11:09:42.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.503+0000 7fee22a87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.12 2024-09-14T11:09:42.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.503+0000 7fee22a87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.12 2024-09-14T11:09:42.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.503+0000 7fee22a87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.13 2024-09-14T11:09:42.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.503+0000 7fee22a87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.13 2024-09-14T11:09:42.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.503+0000 7fee22a87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.14 2024-09-14T11:09:42.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.503+0000 7fee22a87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.14 2024-09-14T11:09:42.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.503+0000 7fee22a87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.15 2024-09-14T11:09:42.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.503+0000 7fee22a87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.15 2024-09-14T11:09:42.504 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.503+0000 7fee22a87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.16 2024-09-14T11:09:42.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.503+0000 7fee22a87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.16 2024-09-14T11:09:42.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.503+0000 7fee22a87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.0 2024-09-14T11:09:42.505 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.503+0000 7fee22a87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.0 2024-09-14T11:09:42.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.504+0000 7fee22a87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.1 2024-09-14T11:09:42.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.504+0000 7fee22a87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.1 2024-09-14T11:09:42.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.504+0000 7fee22a87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.2 2024-09-14T11:09:42.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.504+0000 7fee22a87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.2 2024-09-14T11:09:42.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.505+0000 7fee22a87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.3 2024-09-14T11:09:42.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.505+0000 7fee22a87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.3 2024-09-14T11:09:42.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.505+0000 7fee22a87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.4 2024-09-14T11:09:42.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.505+0000 7fee22a87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.4 2024-09-14T11:09:42.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.506+0000 7fee22a87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.5 2024-09-14T11:09:42.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.506+0000 7fee22a87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.5 2024-09-14T11:09:42.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.507+0000 7fee22a87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.6 2024-09-14T11:09:42.506 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.507+0000 7fee22a87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.6 2024-09-14T11:09:42.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.507+0000 7fee22a87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.7 2024-09-14T11:09:42.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.507+0000 7fee22a87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.7 2024-09-14T11:09:42.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.508+0000 7fee22a87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.8 2024-09-14T11:09:42.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.508+0000 7fee22a87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.8 2024-09-14T11:09:42.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.508+0000 7fee22a87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.9 2024-09-14T11:09:42.507 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.508+0000 7fee22a87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.9 2024-09-14T11:09:42.508 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.508+0000 7fee22a87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.10 2024-09-14T11:09:42.508 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.508+0000 7fee22a87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.10 2024-09-14T11:09:42.508 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.509+0000 7fee22a87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.11 2024-09-14T11:09:42.508 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.509+0000 7fee22a87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.11 2024-09-14T11:09:42.508 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.509+0000 7fee22a87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.12 2024-09-14T11:09:42.508 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.509+0000 7fee22a87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.12 2024-09-14T11:09:42.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.511+0000 7fee22a87800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:09:42.510 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.511+0000 7fee22a87800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 2024-09-14T11:09:42.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.513+0000 7fee22a87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 info.flags=0x17 2024-09-14T11:09:42.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.513+0000 7fee22a87800 10 moving default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 to cache LRU end 2024-09-14T11:09:42.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.513+0000 7fee22a87800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:09:42.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.513+0000 7fee22a87800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18, ofs0, ns] 2024-09-14T11:09:42.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.514+0000 7fecf77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595201 cookie 94763555771168 notifier 8778 bl.length()=821 2024-09-14T11:09:42.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.514+0000 7fecf77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 info.flags=0x17 2024-09-14T11:09:42.512 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.514+0000 7fecf77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 to cache LRU end 2024-09-14T11:09:42.513 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.514+0000 7fecf77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:09:42.513 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.514+0000 7fee22a87800 20 handle_bi_update(): bucket=:myver[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18]): orig_sources= new_sources= 2024-09-14T11:09:42.513 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.514+0000 7fee22a87800 20 handle_bi_update(): bucket=:myver[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18]): potential sources added=[] removed=[] 2024-09-14T11:09:42.513 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.514+0000 7fee22a87800 20 handle_bi_update(): bucket=:myver[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18]): orig_dests= new_dests= 2024-09-14T11:09:42.513 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.514+0000 7fee22a87800 20 handle_bi_update(): bucket=:myver[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18]): potential dests added=[] removed=[] 2024-09-14T11:09:42.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.517+0000 7fee22a87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.0 2024-09-14T11:09:42.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.517+0000 7fee22a87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.0 2024-09-14T11:09:42.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.517+0000 7fee22a87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.1 2024-09-14T11:09:42.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.517+0000 7fee22a87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.1 2024-09-14T11:09:42.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.518+0000 7fee22a87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.2 2024-09-14T11:09:42.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.518+0000 7fee22a87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.2 2024-09-14T11:09:42.516 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.518+0000 7fee22a87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.3 2024-09-14T11:09:42.517 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.518+0000 7fee22a87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.3 2024-09-14T11:09:42.517 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.518+0000 7fee22a87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.4 2024-09-14T11:09:42.517 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.518+0000 7fee22a87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.4 2024-09-14T11:09:42.517 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.518+0000 7fee22a87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.5 2024-09-14T11:09:42.517 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.518+0000 7fee22a87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.5 2024-09-14T11:09:42.517 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.519+0000 7fee22a87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.6 2024-09-14T11:09:42.517 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.519+0000 7fee22a87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.6 2024-09-14T11:09:42.518 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.519+0000 7fee22a87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.7 2024-09-14T11:09:42.518 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.519+0000 7fee22a87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.7 2024-09-14T11:09:42.518 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.519+0000 7fee22a87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.8 2024-09-14T11:09:42.518 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.519+0000 7fee22a87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.8 2024-09-14T11:09:42.518 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.520+0000 7fee22a87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.9 2024-09-14T11:09:42.518 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.520+0000 7fee22a87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.9 2024-09-14T11:09:42.519 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.520+0000 7fee22a87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.10 2024-09-14T11:09:42.519 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.520+0000 7fee22a87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.10 2024-09-14T11:09:42.519 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.520+0000 7fee22a87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.11 2024-09-14T11:09:42.519 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.520+0000 7fee22a87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.11 2024-09-14T11:09:42.520 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.521+0000 7fee22a87800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.12 2024-09-14T11:09:42.520 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.521+0000 7fee22a87800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.2.12 2024-09-14T11:09:42.520 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.521+0000 7fee22a87800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:09:42.520 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.521+0000 7fee22a87800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 2024-09-14T11:09:42.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.522+0000 7fee22a87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 info.flags=0x17 2024-09-14T11:09:42.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.522+0000 7fee22a87800 10 moving default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 to cache LRU end 2024-09-14T11:09:42.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.522+0000 7fee22a87800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:09:42.521 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.522+0000 7fee22a87800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18, ofs0, ns] 2024-09-14T11:09:42.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.523+0000 7fecf77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595202 cookie 94763555771168 notifier 8778 bl.length()=789 2024-09-14T11:09:42.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.523+0000 7fecf77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 info.flags=0x17 2024-09-14T11:09:42.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.523+0000 7fecf77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 to cache LRU end 2024-09-14T11:09:42.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.523+0000 7fecf77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:09:42.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.523+0000 7fee22a87800 20 handle_bi_update(): bucket=:myver[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18]): orig_sources= new_sources= 2024-09-14T11:09:42.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.523+0000 7fee22a87800 20 handle_bi_update(): bucket=:myver[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18]): potential sources added=[] removed=[] 2024-09-14T11:09:42.522 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.523+0000 7fee22a87800 20 handle_bi_update(): bucket=:myver[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18]): orig_dests= new_dests= 2024-09-14T11:09:42.523 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.523+0000 7fee22a87800 20 handle_bi_update(): bucket=:myver[428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18]): potential dests added=[] removed=[] 2024-09-14T11:09:42.525 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.526+0000 7fee22a87800 1 execute INFO: reshard of bucket "myver" from 13 shards to 17 shards completed successfully 2024-09-14T11:09:42.526 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.528+0000 7fecd6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:42.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.530+0000 7fee22a87800 20 remove_watcher() i=0 2024-09-14T11:09:42.528 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.530+0000 7fee22a87800 2 removed watcher, disabling cache 2024-09-14T11:09:42.529 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.531+0000 7fee22a87800 20 remove_watcher() i=1 2024-09-14T11:09:42.530 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.532+0000 7fee22a87800 20 remove_watcher() i=2 2024-09-14T11:09:42.531 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.533+0000 7fee22a87800 20 remove_watcher() i=3 2024-09-14T11:09:42.532 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.534+0000 7fee22a87800 20 remove_watcher() i=4 2024-09-14T11:09:42.533 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.535+0000 7fee22a87800 20 remove_watcher() i=5 2024-09-14T11:09:42.534 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.536+0000 7fee22a87800 20 remove_watcher() i=6 2024-09-14T11:09:42.535 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.537+0000 7fee22a87800 20 remove_watcher() i=7 2024-09-14T11:09:42.547 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T11:09:42.582 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:42.582 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:42.619 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.621+0000 7f7ce431f800 20 rados->read ofs=0 len=0 2024-09-14T11:09:42.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.622+0000 7f7ce431f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:42.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.622+0000 7f7ce431f800 20 realm 2024-09-14T11:09:42.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.622+0000 7f7ce431f800 20 rados->read ofs=0 len=0 2024-09-14T11:09:42.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.622+0000 7f7ce431f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:42.621 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.622+0000 7f7ce431f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:42.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.622+0000 7f7ce431f800 20 rados->read ofs=0 len=0 2024-09-14T11:09:42.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.623+0000 7f7ce431f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:42.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.623+0000 7f7ce431f800 20 rados->read ofs=0 len=0 2024-09-14T11:09:42.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.623+0000 7f7ce431f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:42.622 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.623+0000 7f7ce431f800 20 rados->read ofs=0 len=0 2024-09-14T11:09:42.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.624+0000 7f7ce431f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:09:42.623 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.624+0000 7f7ce431f800 20 searching for the correct realm 2024-09-14T11:09:42.625 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.626+0000 7f7ce08a3640 0 -- 172.21.15.97:0/414452291 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f7cd4021070 msgr2=0x7f7cd40493f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:42.830 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.832+0000 7f7cdf8a1640 0 -- 172.21.15.97:0/414452291 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f7cd00586d0 msgr2=0x7f7cd00ae110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:42.835 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.837+0000 7f7ce431f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:42.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.837+0000 7f7ce431f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:42.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.837+0000 7f7ce431f800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:09:42.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.837+0000 7f7ce431f800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:09:42.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.837+0000 7f7ce431f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:42.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.837+0000 7f7ce431f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:42.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.837+0000 7f7ce431f800 20 rados->read ofs=0 len=0 2024-09-14T11:09:42.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.837+0000 7f7ce431f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:42.836 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.837+0000 7f7ce431f800 20 rados->read ofs=0 len=0 2024-09-14T11:09:42.837 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.837+0000 7f7ce431f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:42.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.837+0000 7f7ce431f800 20 rados->read ofs=0 len=0 2024-09-14T11:09:42.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.838+0000 7f7ce431f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:09:42.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.838+0000 7f7ce431f800 20 zone default found 2024-09-14T11:09:42.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.838+0000 7f7ce431f800 4 Realm: () 2024-09-14T11:09:42.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.838+0000 7f7ce431f800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:09:42.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.838+0000 7f7ce431f800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:09:42.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.838+0000 7f7ce431f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:42.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.838+0000 7f7ce431f800 20 zonegroup default 2024-09-14T11:09:42.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.838+0000 7f7ce431f800 20 rados->read ofs=0 len=0 2024-09-14T11:09:42.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.838+0000 7f7ce431f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:42.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.838+0000 7f7ce431f800 20 rados->read ofs=0 len=0 2024-09-14T11:09:42.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.838+0000 7f7ce431f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:42.838 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.838+0000 7f7ce431f800 20 rados->read ofs=0 len=0 2024-09-14T11:09:42.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.839+0000 7f7ce431f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:42.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.839+0000 7f7ce431f800 20 started sync module instance, tier type = 2024-09-14T11:09:42.839 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.839+0000 7f7ce431f800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:09:42.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.848+0000 7f7ce431f800 20 add_watcher() i=0 2024-09-14T11:09:42.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.848+0000 7f7ce431f800 20 add_watcher() i=1 2024-09-14T11:09:42.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.848+0000 7f7ce431f800 20 add_watcher() i=2 2024-09-14T11:09:42.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.848+0000 7f7ce431f800 20 add_watcher() i=3 2024-09-14T11:09:42.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.848+0000 7f7ce431f800 20 add_watcher() i=4 2024-09-14T11:09:42.847 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.848+0000 7f7ce431f800 20 add_watcher() i=5 2024-09-14T11:09:42.848 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.849+0000 7f7ce431f800 20 add_watcher() i=6 2024-09-14T11:09:42.849 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.851+0000 7f7ce431f800 20 add_watcher() i=7 2024-09-14T11:09:42.849 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.851+0000 7f7ce431f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:42.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.853+0000 7f7b96fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:42.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.853+0000 7f7ce431f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:42.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.853+0000 7f7ce431f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:42.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.853+0000 7f7ce431f800 5 note: GC not initialized 2024-09-14T11:09:42.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.853+0000 7f7b95fdb640 20 reqs_thread_entry: start 2024-09-14T11:09:42.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.853+0000 7f7ce431f800 20 init_complete bucket index max shards: 11 2024-09-14T11:09:42.852 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.853+0000 7f7ce431f800 20 Filter name: none 2024-09-14T11:09:42.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.853+0000 7f7b077fe640 20 reqs_thread_entry: start 2024-09-14T11:09:42.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.854+0000 7f7ce431f800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:09:42.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.854+0000 7f7ce431f800 20 rados->read ofs=0 len=0 2024-09-14T11:09:42.853 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.854+0000 7f7ce431f800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:09:42.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.854+0000 7f7ce431f800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:09:42.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.854+0000 7f7ce431f800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:09:42.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.854+0000 7f7ce431f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 : miss 2024-09-14T11:09:42.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.854+0000 7f7ce431f800 20 rados->read ofs=0 len=0 2024-09-14T11:09:42.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.855+0000 7f7ce431f800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:09:42.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.855+0000 7f7ce431f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 info.flags=0x17 2024-09-14T11:09:42.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.855+0000 7f7ce431f800 10 adding default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 to cache LRU end 2024-09-14T11:09:42.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.855+0000 7f7ce431f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:09:42.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.855+0000 7f7ce431f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:09:42.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.855+0000 7f7ce431f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18 2024-09-14T11:09:42.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.855+0000 7f7ce431f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.0 2024-09-14T11:09:42.854 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.855+0000 7f7ce431f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.0 2024-09-14T11:09:42.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.855+0000 7f7ce431f800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-14T11:09:42.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.855+0000 7f7ce431f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.1 2024-09-14T11:09:42.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.855+0000 7f7ce431f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.1 2024-09-14T11:09:42.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.856+0000 7f7ce431f800 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-14T11:09:42.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.856+0000 7f7ce431f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.2 2024-09-14T11:09:42.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.856+0000 7f7ce431f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.2 2024-09-14T11:09:42.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.856+0000 7f7ce431f800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-14T11:09:42.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.856+0000 7f7ce431f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.3 2024-09-14T11:09:42.855 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.856+0000 7f7ce431f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.3 2024-09-14T11:09:42.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.857+0000 7f7ce431f800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-14T11:09:42.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.857+0000 7f7ce431f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.4 2024-09-14T11:09:42.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.857+0000 7f7ce431f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.4 2024-09-14T11:09:42.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.857+0000 7f7ce431f800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-14T11:09:42.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.857+0000 7f7ce431f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.5 2024-09-14T11:09:42.856 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.857+0000 7f7ce431f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.5 2024-09-14T11:09:42.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.858+0000 7f7ce431f800 1 NOTICE: finished shard 5 (0 entries removed) 2024-09-14T11:09:42.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.858+0000 7f7ce431f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.6 2024-09-14T11:09:42.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.858+0000 7f7ce431f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.6 2024-09-14T11:09:42.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.859+0000 7f7ce431f800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-14T11:09:42.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.859+0000 7f7ce431f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.7 2024-09-14T11:09:42.857 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.859+0000 7f7ce431f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.7 2024-09-14T11:09:42.860 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.859+0000 7f7ce431f800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-14T11:09:42.860 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.859+0000 7f7ce431f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.8 2024-09-14T11:09:42.860 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.859+0000 7f7ce431f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.8 2024-09-14T11:09:42.860 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.860+0000 7f7ce431f800 1 NOTICE: finished shard 8 (0 entries removed) 2024-09-14T11:09:42.860 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.860+0000 7f7ce431f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.9 2024-09-14T11:09:42.860 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.860+0000 7f7ce431f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.9 2024-09-14T11:09:42.860 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.860+0000 7f7ce431f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.10 2024-09-14T11:09:42.861 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.860+0000 7f7ce431f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.10 2024-09-14T11:09:42.861 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.861+0000 7f7ce431f800 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-14T11:09:42.861 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.861+0000 7f7ce431f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.11 2024-09-14T11:09:42.861 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.861+0000 7f7ce431f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.11 2024-09-14T11:09:42.861 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.861+0000 7f7ce431f800 1 NOTICE: finished shard 11 (0 entries removed) 2024-09-14T11:09:42.861 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.861+0000 7f7ce431f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.12 2024-09-14T11:09:42.861 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.861+0000 7f7ce431f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.12 2024-09-14T11:09:42.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.862+0000 7f7ce431f800 1 NOTICE: finished shard 12 (0 entries removed) 2024-09-14T11:09:42.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.862+0000 7f7ce431f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.13 2024-09-14T11:09:42.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.862+0000 7f7ce431f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.13 2024-09-14T11:09:42.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.862+0000 7f7ce431f800 1 NOTICE: finished shard 13 (0 entries removed) 2024-09-14T11:09:42.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.862+0000 7f7ce431f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.14 2024-09-14T11:09:42.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.862+0000 7f7ce431f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.14 2024-09-14T11:09:42.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.863+0000 7f7ce431f800 1 NOTICE: finished shard 14 (0 entries removed) 2024-09-14T11:09:42.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.863+0000 7f7ce431f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.15 2024-09-14T11:09:42.862 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.863+0000 7f7ce431f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.15 2024-09-14T11:09:42.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.864+0000 7f7ce431f800 1 NOTICE: finished shard 15 (0 entries removed) 2024-09-14T11:09:42.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.864+0000 7f7ce431f800 10 bucket_obj is .dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.16 2024-09-14T11:09:42.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.864+0000 7f7ce431f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.16 2024-09-14T11:09:42.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.864+0000 7f7ce431f800 1 NOTICE: finished shard 16 (0 entries removed) 2024-09-14T11:09:42.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.864+0000 7f7ce431f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.9 2024-09-14T11:09:42.863 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.864+0000 7f7ce431f800 20 get_obj_state: octx=0x56475acf8380 obj=myver:x state=0x56475afc7468 s->prefetch_data=0 2024-09-14T11:09:42.864 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.865+0000 7f7ce431f800 20 get_obj_state: setting s->obj_tag to qsbn07ie296o8een4b8iu22m3gz51mxb 2024-09-14T11:09:42.864 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.865+0000 7f7ce431f800 20 get_obj_state_impl: setting s->olh_tag to 0mvs84xdxl9g3q794je3kg253ue8wha3 2024-09-14T11:09:42.864 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.865+0000 7f7ce431f800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=0mvs84xdxl9g3q794je3kg253ue8wha3 2024-09-14T11:09:42.865 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.866+0000 7f7ce431f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.9 2024-09-14T11:09:42.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.867+0000 7f7ce431f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.9 2024-09-14T11:09:42.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.868+0000 7f7ce431f800 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-09-14T11:09:42.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.868+0000 7f7ce431f800 20 olh_log_entry: epoch=2 op=3 key=x[AdVtIC97yZaSB08F3bQXZJkoTV57cnK] 2024-09-14T11:09:42.866 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.868+0000 7f7ce431f800 20 get_obj_state: octx=0x56475acf8380 obj=myver:_:AdVtIC97yZaSB08F3bQXZJkoTV57cnK_x state=0x56475b004a38 s->prefetch_data=0 2024-09-14T11:09:42.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.868+0000 7f7ce431f800 10 manifest: total_size = 9 2024-09-14T11:09:42.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.868+0000 7f7ce431f800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1686528307421999523 2024-09-14T11:09:42.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.868+0000 7f7ce431f800 20 get_obj_state: octx=0x56475acf8380 obj=myver:_:AdVtIC97yZaSB08F3bQXZJkoTV57cnK_x state=0x56475b004a38 s->prefetch_data=0 2024-09-14T11:09:42.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.868+0000 7f7ce431f800 20 prepare_atomic_modification: state is not atomic. state=0x56475b004a38 2024-09-14T11:09:42.867 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.868+0000 7f7ce431f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.9 2024-09-14T11:09:42.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.870+0000 7f7ce431f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:09:42.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.870+0000 7f7ce431f800 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-14T11:09:42.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.870+0000 7f7ce431f800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:09:42.869 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.870+0000 7f7ce431f800 5 delete_objs_inline: removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18__shadow:AdVtIC97yZaSB08F3bQXZJkoTV57cnK_.4MJxdsYWhZtgdEJyGv_CZY1zy5UMGUP_0 2024-09-14T11:09:42.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.871+0000 7f7bb77fe640 20 handle_completion(): completion ok for obj=x[AdVtIC97yZaSB08F3bQXZJkoTV57cnK] 2024-09-14T11:09:42.870 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.872+0000 7f7ce431f800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:09:42.871 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.873+0000 7f7ce431f800 20 get_obj_state: octx=0x56475acf8380 obj=myver:x state=0x56475afc7468 s->prefetch_data=0 2024-09-14T11:09:42.872 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.873+0000 7f7ce431f800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=0mvs84xdxl9g3q794je3kg253ue8wha3 2024-09-14T11:09:42.874 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.875+0000 7f7ce431f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.9 2024-09-14T11:09:42.875 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.877+0000 7f7ce431f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.9 2024-09-14T11:09:42.876 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.877+0000 7f7ce431f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.9 2024-09-14T11:09:42.876 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.877+0000 7f7ce431f800 20 get_obj_state: octx=0x56475acf8380 obj=myver:y state=0x56475b001f18 s->prefetch_data=0 2024-09-14T11:09:42.876 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.877+0000 7f7ce431f800 20 get_obj_state: setting s->obj_tag to zgsmzvok7k1q0un4cws316mwaeqqo60t 2024-09-14T11:09:42.877 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.877+0000 7f7ce431f800 20 get_obj_state_impl: setting s->olh_tag to nkz22v2hiquajp05f5fr6qi1jwehoha3 2024-09-14T11:09:42.877 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.877+0000 7f7ce431f800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=nkz22v2hiquajp05f5fr6qi1jwehoha3 2024-09-14T11:09:42.877 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.878+0000 7f7ce431f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.9 2024-09-14T11:09:42.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.880+0000 7f7ce431f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.9 2024-09-14T11:09:42.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.880+0000 7f7ce431f800 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-09-14T11:09:42.878 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.880+0000 7f7ce431f800 20 olh_log_entry: epoch=2 op=3 key=y[t2AOp9ZOoR85LZ8hpKelka-xFv6lZii] 2024-09-14T11:09:42.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.880+0000 7f7ce431f800 20 get_obj_state: octx=0x56475acf8380 obj=myver:_:t2AOp9ZOoR85LZ8hpKelka-xFv6lZii_y state=0x56475afc4268 s->prefetch_data=0 2024-09-14T11:09:42.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.880+0000 7f7ce431f800 10 manifest: total_size = 22 2024-09-14T11:09:42.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.880+0000 7f7ce431f800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9769070187961994685 2024-09-14T11:09:42.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.880+0000 7f7ce431f800 20 get_obj_state: octx=0x56475acf8380 obj=myver:_:t2AOp9ZOoR85LZ8hpKelka-xFv6lZii_y state=0x56475afc4268 s->prefetch_data=0 2024-09-14T11:09:42.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.880+0000 7f7ce431f800 20 prepare_atomic_modification: state is not atomic. state=0x56475afc4268 2024-09-14T11:09:42.879 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.880+0000 7f7ce431f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.9 2024-09-14T11:09:42.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.883+0000 7f7ce431f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:09:42.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.883+0000 7f7ce431f800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-14T11:09:42.881 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.883+0000 7f7ce431f800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:09:42.882 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.883+0000 7f7ce431f800 5 delete_objs_inline: removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18__shadow:t2AOp9ZOoR85LZ8hpKelka-xFv6lZii_.e8daXaEQEU-wtWR-c-wLPjb67YzW6QA_0 2024-09-14T11:09:42.882 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.884+0000 7f7ce431f800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:09:42.883 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.884+0000 7f7bb6ffd640 20 handle_completion(): completion ok for obj=y[t2AOp9ZOoR85LZ8hpKelka-xFv6lZii] 2024-09-14T11:09:42.883 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.885+0000 7f7ce431f800 20 get_obj_state: octx=0x56475acf8380 obj=myver:y state=0x56475b001f18 s->prefetch_data=0 2024-09-14T11:09:42.883 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.885+0000 7f7ce431f800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=nkz22v2hiquajp05f5fr6qi1jwehoha3 2024-09-14T11:09:42.885 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.887+0000 7f7ce431f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.9 2024-09-14T11:09:42.886 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.888+0000 7f7ce431f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.9 2024-09-14T11:09:42.887 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.888+0000 7f7ce431f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.9 2024-09-14T11:09:42.887 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.888+0000 7f7ce431f800 20 get_obj_state: octx=0x56475acf8380 obj=myver:z state=0x56475afc4fe8 s->prefetch_data=0 2024-09-14T11:09:42.887 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.889+0000 7f7ce431f800 20 get_obj_state: setting s->obj_tag to vei5rbhyyyetriqt4acx3equdzy9h52p 2024-09-14T11:09:42.887 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.889+0000 7f7ce431f800 20 get_obj_state_impl: setting s->olh_tag to wphzl3nirg5invd2mn9eio0xejuaq2jx 2024-09-14T11:09:42.887 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.889+0000 7f7ce431f800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=wphzl3nirg5invd2mn9eio0xejuaq2jx 2024-09-14T11:09:42.888 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.889+0000 7f7ce431f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.9 2024-09-14T11:09:42.892 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.891+0000 7f7ce431f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.9 2024-09-14T11:09:42.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.891+0000 7f7ce431f800 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-09-14T11:09:42.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.891+0000 7f7ce431f800 20 olh_log_entry: epoch=2 op=3 key=z[3c-VofoMcE5Y32ZRlWrPQFVbW8VUDkT] 2024-09-14T11:09:42.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.891+0000 7f7ce431f800 20 get_obj_state: octx=0x56475acf8380 obj=myver:_:3c-VofoMcE5Y32ZRlWrPQFVbW8VUDkT_z state=0x56475afc3258 s->prefetch_data=0 2024-09-14T11:09:42.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.892+0000 7f7ce431f800 10 manifest: total_size = 22 2024-09-14T11:09:42.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.892+0000 7f7ce431f800 20 get_obj_state: setting s->obj_tag to 428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12822439575203143082 2024-09-14T11:09:42.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.892+0000 7f7ce431f800 20 get_obj_state: octx=0x56475acf8380 obj=myver:_:3c-VofoMcE5Y32ZRlWrPQFVbW8VUDkT_z state=0x56475afc3258 s->prefetch_data=0 2024-09-14T11:09:42.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.892+0000 7f7ce431f800 20 prepare_atomic_modification: state is not atomic. state=0x56475afc3258 2024-09-14T11:09:42.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.892+0000 7f7ce431f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.9 2024-09-14T11:09:42.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.894+0000 7f7ce431f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:09:42.894 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.894+0000 7f7ce431f800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-14T11:09:42.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.894+0000 7f7ce431f800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:09:42.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.894+0000 7f7ce431f800 5 delete_objs_inline: removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18__shadow:3c-VofoMcE5Y32ZRlWrPQFVbW8VUDkT_.TeVQY8lxSTxfZnK3MXKHn6JiDMcleSv_0 2024-09-14T11:09:42.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.895+0000 7f7bb77fe640 20 handle_completion(): completion ok for obj=z[3c-VofoMcE5Y32ZRlWrPQFVbW8VUDkT] 2024-09-14T11:09:42.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.895+0000 7f7ce431f800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:09:42.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.896+0000 7f7ce431f800 20 get_obj_state: octx=0x56475acf8380 obj=myver:z state=0x56475afc4fe8 s->prefetch_data=0 2024-09-14T11:09:42.895 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.896+0000 7f7ce431f800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=wphzl3nirg5invd2mn9eio0xejuaq2jx 2024-09-14T11:09:42.896 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.898+0000 7f7ce431f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.9 2024-09-14T11:09:42.897 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.899+0000 7f7ce431f800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18.3.9 2024-09-14T11:09:42.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.899+0000 7f7ce431f800 1 NOTICE: finished shard 9 (3 entries removed) 2024-09-14T11:09:42.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.899+0000 7f7ce431f800 1 NOTICE: finished all shards (3 entries removed) 2024-09-14T11:09:42.898 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.900+0000 7f7b96fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:42.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.902+0000 7f7ce431f800 20 remove_watcher() i=0 2024-09-14T11:09:42.900 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.902+0000 7f7ce431f800 2 removed watcher, disabling cache 2024-09-14T11:09:42.902 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.904+0000 7f7ce431f800 20 remove_watcher() i=1 2024-09-14T11:09:42.903 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.905+0000 7f7ce431f800 20 remove_watcher() i=2 2024-09-14T11:09:42.904 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.906+0000 7f7ce431f800 20 remove_watcher() i=3 2024-09-14T11:09:42.906 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.908+0000 7f7ce431f800 20 remove_watcher() i=4 2024-09-14T11:09:42.907 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.909+0000 7f7ce431f800 20 remove_watcher() i=5 2024-09-14T11:09:42.908 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.910+0000 7f7ce431f800 20 remove_watcher() i=6 2024-09-14T11:09:42.910 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:42.911+0000 7f7ce431f800 20 remove_watcher() i=7 2024-09-14T11:09:42.969 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:09:42.997 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:42.997 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:43.033 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.034+0000 7f4f94f30800 20 rados->read ofs=0 len=0 2024-09-14T11:09:43.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.036+0000 7f4f94f30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:43.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.036+0000 7f4f94f30800 20 realm 2024-09-14T11:09:43.035 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.036+0000 7f4f94f30800 20 rados->read ofs=0 len=0 2024-09-14T11:09:43.036 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.037+0000 7f4f94f30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:43.036 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.037+0000 7f4f94f30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:09:43.036 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.037+0000 7f4f94f30800 20 rados->read ofs=0 len=0 2024-09-14T11:09:43.036 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.037+0000 7f4f94f30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:43.036 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.037+0000 7f4f94f30800 20 rados->read ofs=0 len=0 2024-09-14T11:09:43.036 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.037+0000 7f4f94f30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:43.036 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.037+0000 7f4f94f30800 20 rados->read ofs=0 len=0 2024-09-14T11:09:43.037 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.038+0000 7f4f94f30800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:09:43.037 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.038+0000 7f4f94f30800 20 searching for the correct realm 2024-09-14T11:09:43.039 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.040+0000 7f4f913bd640 0 -- 172.21.15.97:0/3332327367 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f4f78031060 msgr2=0x7f4f78066d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:09:43.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.245+0000 7f4f883bb640 0 -- 172.21.15.97:0/3332327367 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f4f80061400 msgr2=0x7f4f80061840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:09:43.249 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.251+0000 7f4f94f30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:09:43.249 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.251+0000 7f4f94f30800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:09:43.250 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.251+0000 7f4f94f30800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:09:43.250 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.251+0000 7f4f94f30800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:09:43.250 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.251+0000 7f4f94f30800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:09:43.250 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.251+0000 7f4f94f30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:09:43.250 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.251+0000 7f4f94f30800 20 rados->read ofs=0 len=0 2024-09-14T11:09:43.250 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.251+0000 7f4f94f30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:43.250 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.251+0000 7f4f94f30800 20 rados->read ofs=0 len=0 2024-09-14T11:09:43.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.251+0000 7f4f94f30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:09:43.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.251+0000 7f4f94f30800 20 rados->read ofs=0 len=0 2024-09-14T11:09:43.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.252+0000 7f4f94f30800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:09:43.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.252+0000 7f4f94f30800 20 zone default found 2024-09-14T11:09:43.251 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.252+0000 7f4f94f30800 4 Realm: () 2024-09-14T11:09:43.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.252+0000 7f4f94f30800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:09:43.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.252+0000 7f4f94f30800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:09:43.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.252+0000 7f4f94f30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:09:43.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.252+0000 7f4f94f30800 20 zonegroup default 2024-09-14T11:09:43.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.252+0000 7f4f94f30800 20 rados->read ofs=0 len=0 2024-09-14T11:09:43.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.252+0000 7f4f94f30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:43.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.252+0000 7f4f94f30800 20 rados->read ofs=0 len=0 2024-09-14T11:09:43.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.252+0000 7f4f94f30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:43.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.252+0000 7f4f94f30800 20 rados->read ofs=0 len=0 2024-09-14T11:09:43.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.253+0000 7f4f94f30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:09:43.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.253+0000 7f4f94f30800 20 started sync module instance, tier type = 2024-09-14T11:09:43.252 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.253+0000 7f4f94f30800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:09:43.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.263+0000 7f4f94f30800 20 add_watcher() i=0 2024-09-14T11:09:43.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.263+0000 7f4f94f30800 20 add_watcher() i=1 2024-09-14T11:09:43.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.263+0000 7f4f94f30800 20 add_watcher() i=2 2024-09-14T11:09:43.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.263+0000 7f4f94f30800 20 add_watcher() i=3 2024-09-14T11:09:43.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.263+0000 7f4f94f30800 20 add_watcher() i=4 2024-09-14T11:09:43.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.263+0000 7f4f94f30800 20 add_watcher() i=5 2024-09-14T11:09:43.262 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.263+0000 7f4f94f30800 20 add_watcher() i=6 2024-09-14T11:09:43.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.264+0000 7f4f94f30800 20 add_watcher() i=7 2024-09-14T11:09:43.263 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.264+0000 7f4f94f30800 2 all 8 watchers are set, enabling cache 2024-09-14T11:09:43.265 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.266+0000 7f4e46fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:43.266 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.267+0000 7f4f94f30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:09:43.266 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.267+0000 7f4f94f30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:09:43.266 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.267+0000 7f4f94f30800 5 note: GC not initialized 2024-09-14T11:09:43.266 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.267+0000 7f4e45fe3640 20 reqs_thread_entry: start 2024-09-14T11:09:43.266 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.267+0000 7f4f94f30800 20 init_complete bucket index max shards: 11 2024-09-14T11:09:43.266 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.267+0000 7f4f94f30800 20 Filter name: none 2024-09-14T11:09:43.266 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.267+0000 7f4db77fe640 20 reqs_thread_entry: start 2024-09-14T11:09:43.266 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.267+0000 7f4f94f30800 20 rados->read ofs=0 len=0 2024-09-14T11:09:43.267 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.267+0000 7f4f94f30800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:09:43.267 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.267+0000 7f4f94f30800 20 rados->read ofs=0 len=0 2024-09-14T11:09:43.267 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.268+0000 7f4f94f30800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:09:43.267 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.268+0000 7f4f94f30800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:09:43.268 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.268+0000 7f4f94f30800 20 rados->read ofs=0 len=0 2024-09-14T11:09:43.268 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.268+0000 7f4f94f30800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:09:43.268 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.268+0000 7f4f94f30800 20 rados->read ofs=0 len=0 2024-09-14T11:09:43.268 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.269+0000 7f4f94f30800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:09:43.268 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.269+0000 7f4f94f30800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:09:43.270 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.271+0000 7f4e46fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:09:43.272 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.273+0000 7f4f94f30800 20 remove_watcher() i=0 2024-09-14T11:09:43.272 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.273+0000 7f4f94f30800 2 removed watcher, disabling cache 2024-09-14T11:09:43.273 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.274+0000 7f4f94f30800 20 remove_watcher() i=1 2024-09-14T11:09:43.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.275+0000 7f4f94f30800 20 remove_watcher() i=2 2024-09-14T11:09:43.274 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.276+0000 7f4f94f30800 20 remove_watcher() i=3 2024-09-14T11:09:43.276 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.277+0000 7f4f94f30800 20 remove_watcher() i=4 2024-09-14T11:09:43.277 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.278+0000 7f4f94f30800 20 remove_watcher() i=5 2024-09-14T11:09:43.278 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.279+0000 7f4f94f30800 20 remove_watcher() i=6 2024-09-14T11:09:43.279 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:09:43.280+0000 7f4f94f30800 20 remove_watcher() i=7 2024-09-14T11:09:43.289 INFO:tasks.workunit.client.0.smithi097.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-14T11:09:43.289 INFO:tasks.workunit.client.0.smithi097.stderr:Deleting bucket a-bucket 2024-09-14T11:09:43.308 INFO:tasks.workunit.client.0.smithi097.stderr:Deleting bucket myver 2024-09-14T11:09:43.390 INFO:tasks.workunit.client.0.smithi097.stderr:Completed resharding tests 2024-09-14T11:09:43.391 INFO:tasks.workunit.client.0.smithi097.stdout:connected to http://localhost:80 2024-09-14T11:09:43.468 INFO:tasks.workunit.client.0.smithi097.stderr:+ deactivate 2024-09-14T11:09:43.468 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-14T11:09:43.468 INFO:tasks.workunit.client.0.smithi097.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:09:43.468 INFO:tasks.workunit.client.0.smithi097.stderr:+ export PATH 2024-09-14T11:09:43.468 INFO:tasks.workunit.client.0.smithi097.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-14T11:09:43.468 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' -n '' ']' 2024-09-14T11:09:43.469 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:09:43.469 INFO:tasks.workunit.client.0.smithi097.stderr:+ hash -r 2024-09-14T11:09:43.469 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' -n '' ']' 2024-09-14T11:09:43.469 INFO:tasks.workunit.client.0.smithi097.stderr:+ unset VIRTUAL_ENV 2024-09-14T11:09:43.469 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-14T11:09:43.469 INFO:tasks.workunit.client.0.smithi097.stderr:+ unset -f deactivate 2024-09-14T11:09:43.469 INFO:tasks.workunit.client.0.smithi097.stderr:+ echo OK. 2024-09-14T11:09:43.470 INFO:tasks.workunit.client.0.smithi097.stdout:OK. 2024-09-14T11:09:43.470 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:09:43.470 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:09:43.550 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-09-14T11:09:43.550 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:09:43.962 DEBUG:teuthology.parallel:result is None 2024-09-14T11:09:43.962 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:09:44.000 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:09:44.001 DEBUG:teuthology.orchestra.run.smithi097:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:09:44.069 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:09:44.069 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-09-14T11:09:44.085 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-09-14T11:09:44.085 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-09-14T11:09:44.085 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-09-14T11:09:44.085 DEBUG:teuthology.orchestra.run.smithi097:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-09-14T11:09:44.139 INFO:teuthology.orchestra.run.smithi097.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-09-14T11:09:48.341 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-09-14T11:09:48.341 DEBUG:teuthology.orchestra.run.smithi097:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-09-14T11:09:50.218 INFO:teuthology.orchestra.run.smithi097.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required RPM packages. Installing via sudo. 2024-09-14T11:09:50.784 INFO:teuthology.orchestra.run.smithi097.stdout:Last metadata expiration check: 0:28:20 ago on Sat 14 Sep 2024 10:41:30 AM UTC. 2024-09-14T11:09:50.925 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2024-09-14T11:09:50.926 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-14T11:09:50.926 INFO:teuthology.orchestra.run.smithi097.stdout: Package Arch Version Repository Size 2024-09-14T11:09:50.926 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-14T11:09:50.926 INFO:teuthology.orchestra.run.smithi097.stdout:Installing: 2024-09-14T11:09:50.926 INFO:teuthology.orchestra.run.smithi097.stdout: java-1.8.0-openjdk x86_64 1:1.8.0.362.b09-4.el9 appstream 426 k 2024-09-14T11:09:50.926 INFO:teuthology.orchestra.run.smithi097.stdout: java-1.8.0-openjdk-devel x86_64 1:1.8.0.362.b09-4.el9 appstream 9.3 M 2024-09-14T11:09:50.926 INFO:teuthology.orchestra.run.smithi097.stdout:Installing dependencies: 2024-09-14T11:09:50.926 INFO:teuthology.orchestra.run.smithi097.stdout: java-1.8.0-openjdk-headless x86_64 1:1.8.0.362.b09-4.el9 appstream 32 M 2024-09-14T11:09:50.926 INFO:teuthology.orchestra.run.smithi097.stdout:Installing weak dependencies: 2024-09-14T11:09:50.927 INFO:teuthology.orchestra.run.smithi097.stdout: gtk2 x86_64 2.24.33-8.el9 appstream 3.5 M 2024-09-14T11:09:50.927 INFO:teuthology.orchestra.run.smithi097.stdout: libcanberra-gtk2 x86_64 0.30-27.el9 appstream 26 k 2024-09-14T11:09:50.927 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:09:50.927 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction Summary 2024-09-14T11:09:50.927 INFO:teuthology.orchestra.run.smithi097.stdout:================================================================================ 2024-09-14T11:09:50.927 INFO:teuthology.orchestra.run.smithi097.stdout:Install 5 Packages 2024-09-14T11:09:50.927 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:09:50.928 INFO:teuthology.orchestra.run.smithi097.stdout:Total download size: 46 M 2024-09-14T11:09:50.928 INFO:teuthology.orchestra.run.smithi097.stdout:Installed size: 166 M 2024-09-14T11:09:50.928 INFO:teuthology.orchestra.run.smithi097.stdout:Downloading Packages: 2024-09-14T11:09:51.218 INFO:teuthology.orchestra.run.smithi097.stdout:(1/5): java-1.8.0-openjdk-1.8.0.362.b09-4.el9.x 1.6 MB/s | 426 kB 00:00 2024-09-14T11:09:51.351 INFO:teuthology.orchestra.run.smithi097.stdout:(2/5): gtk2-2.24.33-8.el9.x86_64.rpm 9.0 MB/s | 3.5 MB 00:00 2024-09-14T11:09:51.393 INFO:teuthology.orchestra.run.smithi097.stdout:(3/5): libcanberra-gtk2-0.30-27.el9.x86_64.rpm 624 kB/s | 26 kB 00:00 2024-09-14T11:09:51.493 INFO:teuthology.orchestra.run.smithi097.stdout:(4/5): java-1.8.0-openjdk-devel-1.8.0.362.b09-4 18 MB/s | 9.3 MB 00:00 2024-09-14T11:09:51.968 INFO:teuthology.orchestra.run.smithi097.stdout:(5/5): java-1.8.0-openjdk-headless-1.8.0.362.b0 43 MB/s | 32 MB 00:00 2024-09-14T11:09:51.969 INFO:teuthology.orchestra.run.smithi097.stdout:-------------------------------------------------------------------------------- 2024-09-14T11:09:51.969 INFO:teuthology.orchestra.run.smithi097.stdout:Total 44 MB/s | 46 MB 00:01 2024-09-14T11:09:52.393 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction check 2024-09-14T11:09:52.414 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction check succeeded. 2024-09-14T11:09:52.414 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction test 2024-09-14T11:09:52.890 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction test succeeded. 2024-09-14T11:09:52.891 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction 2024-09-14T11:09:53.415 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 1/1 2024-09-14T11:09:53.560 INFO:teuthology.orchestra.run.smithi097.stdout: Preparing : 1/1 2024-09-14T11:09:53.735 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libcanberra-gtk2-0.30-27.el9.x86_64 1/5 2024-09-14T11:09:54.339 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : gtk2-2.24.33-8.el9.x86_64 2/5 2024-09-14T11:09:54.379 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-14T11:09:54.611 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-14T11:09:54.639 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-14T11:09:54.865 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-14T11:09:54.901 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-14T11:09:54.908 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-14T11:09:54.917 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 5/5 2024-09-14T11:09:54.961 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 5/5 2024-09-14T11:09:58.330 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-14T11:09:58.330 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : gtk2-2.24.33-8.el9.x86_64 1/5 2024-09-14T11:09:58.330 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2/5 2024-09-14T11:09:58.331 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 3/5 2024-09-14T11:09:58.331 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 4/5 2024-09-14T11:09:58.738 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libcanberra-gtk2-0.30-27.el9.x86_64 5/5 2024-09-14T11:09:58.738 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:09:58.738 INFO:teuthology.orchestra.run.smithi097.stdout:Installed: 2024-09-14T11:09:58.738 INFO:teuthology.orchestra.run.smithi097.stdout: gtk2-2.24.33-8.el9.x86_64 2024-09-14T11:09:58.738 INFO:teuthology.orchestra.run.smithi097.stdout: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2024-09-14T11:09:58.738 INFO:teuthology.orchestra.run.smithi097.stdout: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_64 2024-09-14T11:09:58.739 INFO:teuthology.orchestra.run.smithi097.stdout: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x86_64 2024-09-14T11:09:58.739 INFO:teuthology.orchestra.run.smithi097.stdout: libcanberra-gtk2-0.30-27.el9.x86_64 2024-09-14T11:09:58.739 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:09:58.739 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2024-09-14T11:09:59.202 INFO:teuthology.orchestra.run.smithi097.stdout: Gradle will be installed under /opt/gradle 2024-09-14T11:09:59.302 INFO:teuthology.orchestra.run.smithi097.stderr:--2024-09-14 11:09:59-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-09-14T11:09:59.563 INFO:teuthology.orchestra.run.smithi097.stderr:Resolving services.gradle.org (services.gradle.org)... 104.16.73.101, 104.16.72.101, 2606:4700::6810:4865, ... 2024-09-14T11:09:59.576 INFO:teuthology.orchestra.run.smithi097.stderr:Connecting to services.gradle.org (services.gradle.org)|104.16.73.101|:443... connected. 2024-09-14T11:09:59.657 INFO:teuthology.orchestra.run.smithi097.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-09-14T11:09:59.657 INFO:teuthology.orchestra.run.smithi097.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-09-14T11:09:59.657 INFO:teuthology.orchestra.run.smithi097.stderr:--2024-09-14 11:09:59-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-09-14T11:09:59.657 INFO:teuthology.orchestra.run.smithi097.stderr:Resolving github.com (github.com)... 140.82.114.4 2024-09-14T11:09:59.667 INFO:teuthology.orchestra.run.smithi097.stderr:Connecting to github.com (github.com)|140.82.114.4|:443... connected. 2024-09-14T11:09:59.756 INFO:teuthology.orchestra.run.smithi097.stderr:HTTP request sent, awaiting response... 302 Found 2024-09-14T11:09:59.756 INFO:teuthology.orchestra.run.smithi097.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240914%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240914T110959Z&X-Amz-Expires=300&X-Amz-Signature=3fb79fdc852f6a19f5aaea1f5e946448f731bffd5c2bcadef2c16eaf65fa0dce&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-09-14T11:09:59.756 INFO:teuthology.orchestra.run.smithi097.stderr:--2024-09-14 11:09:59-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240914%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240914T110959Z&X-Amz-Expires=300&X-Amz-Signature=3fb79fdc852f6a19f5aaea1f5e946448f731bffd5c2bcadef2c16eaf65fa0dce&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-09-14T11:09:59.756 INFO:teuthology.orchestra.run.smithi097.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.109.133, 185.199.108.133, 185.199.110.133, ... 2024-09-14T11:09:59.768 INFO:teuthology.orchestra.run.smithi097.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.109.133|:443... connected. 2024-09-14T11:09:59.849 INFO:teuthology.orchestra.run.smithi097.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-14T11:09:59.850 INFO:teuthology.orchestra.run.smithi097.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-09-14T11:09:59.850 INFO:teuthology.orchestra.run.smithi097.stderr:Saving to: ‘gradle-6.0.1-bin.zip’ 2024-09-14T11:09:59.850 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-09-14T11:09:59.860 INFO:teuthology.orchestra.run.smithi097.stderr: 0K .......... .......... .......... .......... .......... 0% 3.60M 25s 2024-09-14T11:09:59.873 INFO:teuthology.orchestra.run.smithi097.stderr: 50K .......... .......... .......... .......... .......... 0% 3.70M 25s 2024-09-14T11:09:59.881 INFO:teuthology.orchestra.run.smithi097.stderr: 100K .......... .......... .......... .......... .......... 0% 5.59M 22s 2024-09-14T11:09:59.884 INFO:teuthology.orchestra.run.smithi097.stderr: 150K .......... .......... .......... .......... .......... 0% 19.7M 18s 2024-09-14T11:09:59.886 INFO:teuthology.orchestra.run.smithi097.stderr: 200K .......... .......... .......... .......... .......... 0% 26.1M 15s 2024-09-14T11:09:59.894 INFO:teuthology.orchestra.run.smithi097.stderr: 250K .......... .......... .......... .......... .......... 0% 6.58M 15s 2024-09-14T11:09:59.896 INFO:teuthology.orchestra.run.smithi097.stderr: 300K .......... .......... .......... .......... .......... 0% 54.4M 13s 2024-09-14T11:09:59.899 INFO:teuthology.orchestra.run.smithi097.stderr: 350K .......... .......... .......... .......... .......... 0% 44.1M 11s 2024-09-14T11:09:59.899 INFO:teuthology.orchestra.run.smithi097.stderr: 400K .......... .......... .......... .......... .......... 0% 29.3M 10s 2024-09-14T11:09:59.899 INFO:teuthology.orchestra.run.smithi097.stderr: 450K .......... .......... .......... .......... .......... 0% 43.5M 10s 2024-09-14T11:09:59.901 INFO:teuthology.orchestra.run.smithi097.stderr: 500K .......... .......... .......... .......... .......... 0% 28.5M 9s 2024-09-14T11:09:59.901 INFO:teuthology.orchestra.run.smithi097.stderr: 550K .......... .......... .......... .......... .......... 0% 72.4M 8s 2024-09-14T11:09:59.901 INFO:teuthology.orchestra.run.smithi097.stderr: 600K .......... .......... .......... .......... .......... 0% 200M 8s 2024-09-14T11:09:59.915 INFO:teuthology.orchestra.run.smithi097.stderr: 650K .......... .......... .......... .......... .......... 0% 10.2M 8s 2024-09-14T11:09:59.915 INFO:teuthology.orchestra.run.smithi097.stderr: 700K .......... .......... .......... .......... .......... 0% 115M 7s 2024-09-14T11:09:59.915 INFO:teuthology.orchestra.run.smithi097.stderr: 750K .......... .......... .......... .......... .......... 0% 28.5M 7s 2024-09-14T11:09:59.915 INFO:teuthology.orchestra.run.smithi097.stderr: 800K .......... .......... .......... .......... .......... 0% 340M 7s 2024-09-14T11:09:59.915 INFO:teuthology.orchestra.run.smithi097.stderr: 850K .......... .......... .......... .......... .......... 0% 160M 6s 2024-09-14T11:09:59.915 INFO:teuthology.orchestra.run.smithi097.stderr: 900K .......... .......... .......... .......... .......... 1% 72.5M 6s 2024-09-14T11:09:59.915 INFO:teuthology.orchestra.run.smithi097.stderr: 950K .......... .......... .......... .......... .......... 1% 48.9M 6s 2024-09-14T11:09:59.915 INFO:teuthology.orchestra.run.smithi097.stderr: 1000K .......... .......... .......... .......... .......... 1% 87.7M 6s 2024-09-14T11:09:59.915 INFO:teuthology.orchestra.run.smithi097.stderr: 1050K .......... .......... .......... .......... .......... 1% 323M 5s 2024-09-14T11:09:59.915 INFO:teuthology.orchestra.run.smithi097.stderr: 1100K .......... .......... .......... .......... .......... 1% 51.6M 5s 2024-09-14T11:09:59.916 INFO:teuthology.orchestra.run.smithi097.stderr: 1150K .......... .......... .......... .......... .......... 1% 60.8M 5s 2024-09-14T11:09:59.916 INFO:teuthology.orchestra.run.smithi097.stderr: 1200K .......... .......... .......... .......... .......... 1% 174M 5s 2024-09-14T11:10:01.357 INFO:teuthology.orchestra.run.smithi097.stderr: 1250K .......... .......... .......... .......... .......... 1% 372M 5s 2024-09-14T11:10:01.357 INFO:teuthology.orchestra.run.smithi097.stderr: 1300K .......... .......... .......... .......... .......... 1% 10.5M 5s 2024-09-14T11:10:01.358 INFO:teuthology.orchestra.run.smithi097.stderr: 1350K .......... .......... .......... .......... .......... 1% 121M 5s 2024-09-14T11:10:01.358 INFO:teuthology.orchestra.run.smithi097.stderr: 1400K .......... .......... .......... .......... .......... 1% 110M 5s 2024-09-14T11:10:01.358 INFO:teuthology.orchestra.run.smithi097.stderr: 1450K .......... .......... .......... .......... .......... 1% 180M 4s 2024-09-14T11:10:01.358 INFO:teuthology.orchestra.run.smithi097.stderr: 1500K .......... .......... .......... .......... .......... 1% 318M 4s 2024-09-14T11:10:01.358 INFO:teuthology.orchestra.run.smithi097.stderr: 1550K .......... .......... .......... .......... .......... 1% 88.5M 4s 2024-09-14T11:10:01.358 INFO:teuthology.orchestra.run.smithi097.stderr: 1600K .......... .......... .......... .......... .......... 1% 55.6M 4s 2024-09-14T11:10:01.358 INFO:teuthology.orchestra.run.smithi097.stderr: 1650K .......... .......... .......... .......... .......... 1% 125M 4s 2024-09-14T11:10:01.358 INFO:teuthology.orchestra.run.smithi097.stderr: 1700K .......... .......... .......... .......... .......... 1% 187M 4s 2024-09-14T11:10:01.359 INFO:teuthology.orchestra.run.smithi097.stderr: 1750K .......... .......... .......... .......... .......... 1% 250M 4s 2024-09-14T11:10:01.359 INFO:teuthology.orchestra.run.smithi097.stderr: 1800K .......... .......... .......... .......... .......... 1% 188M 4s 2024-09-14T11:10:01.359 INFO:teuthology.orchestra.run.smithi097.stderr: 1850K .......... .......... .......... .......... .......... 2% 258M 4s 2024-09-14T11:10:01.359 INFO:teuthology.orchestra.run.smithi097.stderr: 1900K .......... .......... .......... .......... .......... 2% 97.8M 4s 2024-09-14T11:10:01.359 INFO:teuthology.orchestra.run.smithi097.stderr: 1950K .......... .......... .......... .......... .......... 2% 337M 3s 2024-09-14T11:10:01.359 INFO:teuthology.orchestra.run.smithi097.stderr: 2000K .......... .......... .......... .......... .......... 2% 270M 3s 2024-09-14T11:10:01.359 INFO:teuthology.orchestra.run.smithi097.stderr: 2050K .......... .......... .......... .......... .......... 2% 272M 3s 2024-09-14T11:10:01.359 INFO:teuthology.orchestra.run.smithi097.stderr: 2100K .......... .......... .......... .......... .......... 2% 105M 3s 2024-09-14T11:10:01.359 INFO:teuthology.orchestra.run.smithi097.stderr: 2150K .......... .......... .......... .......... .......... 2% 290M 3s 2024-09-14T11:10:01.359 INFO:teuthology.orchestra.run.smithi097.stderr: 2200K .......... .......... .......... .......... .......... 2% 322M 3s 2024-09-14T11:10:01.359 INFO:teuthology.orchestra.run.smithi097.stderr: 2250K .......... .......... .......... .......... .......... 2% 260M 3s 2024-09-14T11:10:01.359 INFO:teuthology.orchestra.run.smithi097.stderr: 2300K .......... .......... .......... .......... .......... 2% 159M 3s 2024-09-14T11:10:01.359 INFO:teuthology.orchestra.run.smithi097.stderr: 2350K .......... .......... .......... .......... .......... 2% 106M 3s 2024-09-14T11:10:01.359 INFO:teuthology.orchestra.run.smithi097.stderr: 2400K .......... .......... .......... .......... .......... 2% 224M 3s 2024-09-14T11:10:01.360 INFO:teuthology.orchestra.run.smithi097.stderr: 2450K .......... .......... .......... .......... .......... 2% 356M 3s 2024-09-14T11:10:01.360 INFO:teuthology.orchestra.run.smithi097.stderr: 2500K .......... .......... .......... .......... .......... 2% 154M 3s 2024-09-14T11:10:01.360 INFO:teuthology.orchestra.run.smithi097.stderr: 2550K .......... .......... .......... .......... .......... 2% 152M 3s 2024-09-14T11:10:01.360 INFO:teuthology.orchestra.run.smithi097.stderr: 2600K .......... .......... .......... .......... .......... 2% 11.2M 3s 2024-09-14T11:10:01.360 INFO:teuthology.orchestra.run.smithi097.stderr: 2650K .......... .......... .......... .......... .......... 2% 159M 3s 2024-09-14T11:10:01.360 INFO:teuthology.orchestra.run.smithi097.stderr: 2700K .......... .......... .......... .......... .......... 2% 350M 3s 2024-09-14T11:10:01.360 INFO:teuthology.orchestra.run.smithi097.stderr: 2750K .......... .......... .......... .......... .......... 3% 295M 3s 2024-09-14T11:10:01.360 INFO:teuthology.orchestra.run.smithi097.stderr: 2800K .......... .......... .......... .......... .......... 3% 85.5M 3s 2024-09-14T11:10:01.360 INFO:teuthology.orchestra.run.smithi097.stderr: 2850K .......... .......... .......... .......... .......... 3% 343M 3s 2024-09-14T11:10:01.360 INFO:teuthology.orchestra.run.smithi097.stderr: 2900K .......... .......... .......... .......... .......... 3% 275M 3s 2024-09-14T11:10:01.360 INFO:teuthology.orchestra.run.smithi097.stderr: 2950K .......... .......... .......... .......... .......... 3% 306M 3s 2024-09-14T11:10:01.360 INFO:teuthology.orchestra.run.smithi097.stderr: 3000K .......... .......... .......... .......... .......... 3% 80.1M 3s 2024-09-14T11:10:01.360 INFO:teuthology.orchestra.run.smithi097.stderr: 3050K .......... .......... .......... .......... .......... 3% 169M 2s 2024-09-14T11:10:01.360 INFO:teuthology.orchestra.run.smithi097.stderr: 3100K .......... .......... .......... .......... .......... 3% 330M 2s 2024-09-14T11:10:01.361 INFO:teuthology.orchestra.run.smithi097.stderr: 3150K .......... .......... .......... .......... .......... 3% 362M 2s 2024-09-14T11:10:01.361 INFO:teuthology.orchestra.run.smithi097.stderr: 3200K .......... .......... .......... .......... .......... 3% 297M 2s 2024-09-14T11:10:01.361 INFO:teuthology.orchestra.run.smithi097.stderr: 3250K .......... .......... .......... .......... .......... 3% 233M 2s 2024-09-14T11:10:01.361 INFO:teuthology.orchestra.run.smithi097.stderr: 3300K .......... .......... .......... .......... .......... 3% 159M 2s 2024-09-14T11:10:01.361 INFO:teuthology.orchestra.run.smithi097.stderr: 3350K .......... .......... .......... .......... .......... 3% 366M 2s 2024-09-14T11:10:01.361 INFO:teuthology.orchestra.run.smithi097.stderr: 3400K .......... .......... .......... .......... .......... 3% 139M 2s 2024-09-14T11:10:01.361 INFO:teuthology.orchestra.run.smithi097.stderr: 3450K .......... .......... .......... .......... .......... 3% 164M 2s 2024-09-14T11:10:01.361 INFO:teuthology.orchestra.run.smithi097.stderr: 3500K .......... .......... .......... .......... .......... 3% 352M 2s 2024-09-14T11:10:01.361 INFO:teuthology.orchestra.run.smithi097.stderr: 3550K .......... .......... .......... .......... .......... 3% 197M 2s 2024-09-14T11:10:01.361 INFO:teuthology.orchestra.run.smithi097.stderr: 3600K .......... .......... .......... .......... .......... 3% 330M 2s 2024-09-14T11:10:01.361 INFO:teuthology.orchestra.run.smithi097.stderr: 3650K .......... .......... .......... .......... .......... 3% 172M 2s 2024-09-14T11:10:01.361 INFO:teuthology.orchestra.run.smithi097.stderr: 3700K .......... .......... .......... .......... .......... 4% 240M 2s 2024-09-14T11:10:01.361 INFO:teuthology.orchestra.run.smithi097.stderr: 3750K .......... .......... .......... .......... .......... 4% 160M 2s 2024-09-14T11:10:01.362 INFO:teuthology.orchestra.run.smithi097.stderr: 3800K .......... .......... .......... .......... .......... 4% 273M 2s 2024-09-14T11:10:01.362 INFO:teuthology.orchestra.run.smithi097.stderr: 3850K .......... .......... .......... .......... .......... 4% 336M 2s 2024-09-14T11:10:01.362 INFO:teuthology.orchestra.run.smithi097.stderr: 3900K .......... .......... .......... .......... .......... 4% 331M 2s 2024-09-14T11:10:01.362 INFO:teuthology.orchestra.run.smithi097.stderr: 3950K .......... .......... .......... .......... .......... 4% 252M 2s 2024-09-14T11:10:01.362 INFO:teuthology.orchestra.run.smithi097.stderr: 4000K .......... .......... .......... .......... .......... 4% 193M 2s 2024-09-14T11:10:01.362 INFO:teuthology.orchestra.run.smithi097.stderr: 4050K .......... .......... .......... .......... .......... 4% 370M 2s 2024-09-14T11:10:01.362 INFO:teuthology.orchestra.run.smithi097.stderr: 4100K .......... .......... .......... .......... .......... 4% 313M 2s 2024-09-14T11:10:01.362 INFO:teuthology.orchestra.run.smithi097.stderr: 4150K .......... .......... .......... .......... .......... 4% 313M 2s 2024-09-14T11:10:01.362 INFO:teuthology.orchestra.run.smithi097.stderr: 4200K .......... .......... .......... .......... .......... 4% 272M 2s 2024-09-14T11:10:01.362 INFO:teuthology.orchestra.run.smithi097.stderr: 4250K .......... .......... .......... .......... .......... 4% 129M 2s 2024-09-14T11:10:01.362 INFO:teuthology.orchestra.run.smithi097.stderr: 4300K .......... .......... .......... .......... .......... 4% 320M 2s 2024-09-14T11:10:01.362 INFO:teuthology.orchestra.run.smithi097.stderr: 4350K .......... .......... .......... .......... .......... 4% 365M 2s 2024-09-14T11:10:01.362 INFO:teuthology.orchestra.run.smithi097.stderr: 4400K .......... .......... .......... .......... .......... 4% 303M 2s 2024-09-14T11:10:01.362 INFO:teuthology.orchestra.run.smithi097.stderr: 4450K .......... .......... .......... .......... .......... 4% 367M 2s 2024-09-14T11:10:01.362 INFO:teuthology.orchestra.run.smithi097.stderr: 4500K .......... .......... .......... .......... .......... 4% 358M 2s 2024-09-14T11:10:01.363 INFO:teuthology.orchestra.run.smithi097.stderr: 4550K .......... .......... .......... .......... .......... 4% 372M 2s 2024-09-14T11:10:01.363 INFO:teuthology.orchestra.run.smithi097.stderr: 4600K .......... .......... .......... .......... .......... 5% 321M 2s 2024-09-14T11:10:01.363 INFO:teuthology.orchestra.run.smithi097.stderr: 4650K .......... .......... .......... .......... .......... 5% 360M 2s 2024-09-14T11:10:01.363 INFO:teuthology.orchestra.run.smithi097.stderr: 4700K .......... .......... .......... .......... .......... 5% 299M 2s 2024-09-14T11:10:01.363 INFO:teuthology.orchestra.run.smithi097.stderr: 4750K .......... .......... .......... .......... .......... 5% 351M 2s 2024-09-14T11:10:01.363 INFO:teuthology.orchestra.run.smithi097.stderr: 4800K .......... .......... .......... .......... .......... 5% 194M 2s 2024-09-14T11:10:01.363 INFO:teuthology.orchestra.run.smithi097.stderr: 4850K .......... .......... .......... .......... .......... 5% 365M 2s 2024-09-14T11:10:01.363 INFO:teuthology.orchestra.run.smithi097.stderr: 4900K .......... .......... .......... .......... .......... 5% 221M 2s 2024-09-14T11:10:01.363 INFO:teuthology.orchestra.run.smithi097.stderr: 4950K .......... .......... .......... .......... .......... 5% 340M 2s 2024-09-14T11:10:01.363 INFO:teuthology.orchestra.run.smithi097.stderr: 5000K .......... .......... .......... .......... .......... 5% 382M 2s 2024-09-14T11:10:01.363 INFO:teuthology.orchestra.run.smithi097.stderr: 5050K .......... .......... .......... .......... .......... 5% 355M 2s 2024-09-14T11:10:01.363 INFO:teuthology.orchestra.run.smithi097.stderr: 5100K .......... .......... .......... .......... .......... 5% 304M 2s 2024-09-14T11:10:01.363 INFO:teuthology.orchestra.run.smithi097.stderr: 5150K .......... .......... .......... .......... .......... 5% 369M 2s 2024-09-14T11:10:01.364 INFO:teuthology.orchestra.run.smithi097.stderr: 5200K .......... .......... .......... .......... .......... 5% 364M 2s 2024-09-14T11:10:01.364 INFO:teuthology.orchestra.run.smithi097.stderr: 5250K .......... .......... .......... .......... .......... 5% 362M 2s 2024-09-14T11:10:01.364 INFO:teuthology.orchestra.run.smithi097.stderr: 5300K .......... .......... .......... .......... .......... 5% 25.9M 2s 2024-09-14T11:10:01.364 INFO:teuthology.orchestra.run.smithi097.stderr: 5350K .......... .......... .......... .......... .......... 5% 266M 2s 2024-09-14T11:10:01.364 INFO:teuthology.orchestra.run.smithi097.stderr: 5400K .......... .......... .......... .......... .......... 5% 353M 2s 2024-09-14T11:10:01.364 INFO:teuthology.orchestra.run.smithi097.stderr: 5450K .......... .......... .......... .......... .......... 5% 359M 2s 2024-09-14T11:10:01.364 INFO:teuthology.orchestra.run.smithi097.stderr: 5500K .......... .......... .......... .......... .......... 5% 302M 2s 2024-09-14T11:10:01.364 INFO:teuthology.orchestra.run.smithi097.stderr: 5550K .......... .......... .......... .......... .......... 6% 199M 2s 2024-09-14T11:10:01.364 INFO:teuthology.orchestra.run.smithi097.stderr: 5600K .......... .......... .......... .......... .......... 6% 372M 1s 2024-09-14T11:10:01.364 INFO:teuthology.orchestra.run.smithi097.stderr: 5650K .......... .......... .......... .......... .......... 6% 91.2M 1s 2024-09-14T11:10:01.364 INFO:teuthology.orchestra.run.smithi097.stderr: 5700K .......... .......... .......... .......... .......... 6% 376M 1s 2024-09-14T11:10:01.364 INFO:teuthology.orchestra.run.smithi097.stderr: 5750K .......... .......... .......... .......... .......... 6% 325M 1s 2024-09-14T11:10:01.364 INFO:teuthology.orchestra.run.smithi097.stderr: 5800K .......... .......... .......... .......... .......... 6% 384M 1s 2024-09-14T11:10:01.365 INFO:teuthology.orchestra.run.smithi097.stderr: 5850K .......... .......... .......... .......... .......... 6% 296M 1s 2024-09-14T11:10:01.365 INFO:teuthology.orchestra.run.smithi097.stderr: 5900K .......... .......... .......... .......... .......... 6% 359M 1s 2024-09-14T11:10:01.365 INFO:teuthology.orchestra.run.smithi097.stderr: 5950K .......... .......... .......... .......... .......... 6% 352M 1s 2024-09-14T11:10:01.365 INFO:teuthology.orchestra.run.smithi097.stderr: 6000K .......... .......... .......... .......... .......... 6% 205M 1s 2024-09-14T11:10:01.365 INFO:teuthology.orchestra.run.smithi097.stderr: 6050K .......... .......... .......... .......... .......... 6% 211M 1s 2024-09-14T11:10:01.365 INFO:teuthology.orchestra.run.smithi097.stderr: 6100K .......... .......... .......... .......... .......... 6% 235M 1s 2024-09-14T11:10:01.365 INFO:teuthology.orchestra.run.smithi097.stderr: 6150K .......... .......... .......... .......... .......... 6% 121M 1s 2024-09-14T11:10:01.365 INFO:teuthology.orchestra.run.smithi097.stderr: 6200K .......... .......... .......... .......... .......... 6% 325M 1s 2024-09-14T11:10:01.365 INFO:teuthology.orchestra.run.smithi097.stderr: 6250K .......... .......... .......... .......... .......... 6% 216M 1s 2024-09-14T11:10:01.365 INFO:teuthology.orchestra.run.smithi097.stderr: 6300K .......... .......... .......... .......... .......... 6% 258M 1s 2024-09-14T11:10:01.365 INFO:teuthology.orchestra.run.smithi097.stderr: 6350K .......... .......... .......... .......... .......... 6% 164M 1s 2024-09-14T11:10:01.365 INFO:teuthology.orchestra.run.smithi097.stderr: 6400K .......... .......... .......... .......... .......... 6% 366M 1s 2024-09-14T11:10:01.365 INFO:teuthology.orchestra.run.smithi097.stderr: 6450K .......... .......... .......... .......... .......... 6% 176M 1s 2024-09-14T11:10:01.365 INFO:teuthology.orchestra.run.smithi097.stderr: 6500K .......... .......... .......... .......... .......... 7% 154M 1s 2024-09-14T11:10:01.365 INFO:teuthology.orchestra.run.smithi097.stderr: 6550K .......... .......... .......... .......... .......... 7% 130M 1s 2024-09-14T11:10:01.366 INFO:teuthology.orchestra.run.smithi097.stderr: 6600K .......... .......... .......... .......... .......... 7% 302M 1s 2024-09-14T11:10:01.366 INFO:teuthology.orchestra.run.smithi097.stderr: 6650K .......... .......... .......... .......... .......... 7% 344M 1s 2024-09-14T11:10:01.366 INFO:teuthology.orchestra.run.smithi097.stderr: 6700K .......... .......... .......... .......... .......... 7% 258M 1s 2024-09-14T11:10:01.366 INFO:teuthology.orchestra.run.smithi097.stderr: 6750K .......... .......... .......... .......... .......... 7% 143M 1s 2024-09-14T11:10:01.366 INFO:teuthology.orchestra.run.smithi097.stderr: 6800K .......... .......... .......... .......... .......... 7% 370M 1s 2024-09-14T11:10:01.366 INFO:teuthology.orchestra.run.smithi097.stderr: 6850K .......... .......... .......... .......... .......... 7% 176M 1s 2024-09-14T11:10:01.366 INFO:teuthology.orchestra.run.smithi097.stderr: 6900K .......... .......... .......... .......... .......... 7% 276M 1s 2024-09-14T11:10:01.366 INFO:teuthology.orchestra.run.smithi097.stderr: 6950K .......... .......... .......... .......... .......... 7% 123M 1s 2024-09-14T11:10:01.366 INFO:teuthology.orchestra.run.smithi097.stderr: 7000K .......... .......... .......... .......... .......... 7% 181M 1s 2024-09-14T11:10:01.366 INFO:teuthology.orchestra.run.smithi097.stderr: 7050K .......... .......... .......... .......... .......... 7% 318M 1s 2024-09-14T11:10:01.366 INFO:teuthology.orchestra.run.smithi097.stderr: 7100K .......... .......... .......... .......... .......... 7% 159M 1s 2024-09-14T11:10:01.366 INFO:teuthology.orchestra.run.smithi097.stderr: 7150K .......... .......... .......... .......... .......... 7% 292M 1s 2024-09-14T11:10:01.366 INFO:teuthology.orchestra.run.smithi097.stderr: 7200K .......... .......... .......... .......... .......... 7% 386M 1s 2024-09-14T11:10:01.366 INFO:teuthology.orchestra.run.smithi097.stderr: 7250K .......... .......... .......... .......... .......... 7% 120M 1s 2024-09-14T11:10:01.367 INFO:teuthology.orchestra.run.smithi097.stderr: 7300K .......... .......... .......... .......... .......... 7% 85.6M 1s 2024-09-14T11:10:01.367 INFO:teuthology.orchestra.run.smithi097.stderr: 7350K .......... .......... .......... .......... .......... 7% 364M 1s 2024-09-14T11:10:01.367 INFO:teuthology.orchestra.run.smithi097.stderr: 7400K .......... .......... .......... .......... .......... 8% 194M 1s 2024-09-14T11:10:01.367 INFO:teuthology.orchestra.run.smithi097.stderr: 7450K .......... .......... .......... .......... .......... 8% 313M 1s 2024-09-14T11:10:01.367 INFO:teuthology.orchestra.run.smithi097.stderr: 7500K .......... .......... .......... .......... .......... 8% 380M 1s 2024-09-14T11:10:01.367 INFO:teuthology.orchestra.run.smithi097.stderr: 7550K .......... .......... .......... .......... .......... 8% 147M 1s 2024-09-14T11:10:01.367 INFO:teuthology.orchestra.run.smithi097.stderr: 7600K .......... .......... .......... .......... .......... 8% 363M 1s 2024-09-14T11:10:01.367 INFO:teuthology.orchestra.run.smithi097.stderr: 7650K .......... .......... .......... .......... .......... 8% 378M 1s 2024-09-14T11:10:01.367 INFO:teuthology.orchestra.run.smithi097.stderr: 7700K .......... .......... .......... .......... .......... 8% 419M 1s 2024-09-14T11:10:01.367 INFO:teuthology.orchestra.run.smithi097.stderr: 7750K .......... .......... .......... .......... .......... 8% 241M 1s 2024-09-14T11:10:01.367 INFO:teuthology.orchestra.run.smithi097.stderr: 7800K .......... .......... .......... .......... .......... 8% 120M 1s 2024-09-14T11:10:01.367 INFO:teuthology.orchestra.run.smithi097.stderr: 7850K .......... .......... .......... .......... .......... 8% 417M 1s 2024-09-14T11:10:01.367 INFO:teuthology.orchestra.run.smithi097.stderr: 7900K .......... .......... .......... .......... .......... 8% 325M 1s 2024-09-14T11:10:01.367 INFO:teuthology.orchestra.run.smithi097.stderr: 7950K .......... .......... .......... .......... .......... 8% 405M 1s 2024-09-14T11:10:01.367 INFO:teuthology.orchestra.run.smithi097.stderr: 8000K .......... .......... .......... .......... .......... 8% 235M 1s 2024-09-14T11:10:01.368 INFO:teuthology.orchestra.run.smithi097.stderr: 8050K .......... .......... .......... .......... .......... 8% 364M 1s 2024-09-14T11:10:01.368 INFO:teuthology.orchestra.run.smithi097.stderr: 8100K .......... .......... .......... .......... .......... 8% 445M 1s 2024-09-14T11:10:01.368 INFO:teuthology.orchestra.run.smithi097.stderr: 8150K .......... .......... .......... .......... .......... 8% 432M 1s 2024-09-14T11:10:01.368 INFO:teuthology.orchestra.run.smithi097.stderr: 8200K .......... .......... .......... .......... .......... 8% 351M 1s 2024-09-14T11:10:01.368 INFO:teuthology.orchestra.run.smithi097.stderr: 8250K .......... .......... .......... .......... .......... 8% 298M 1s 2024-09-14T11:10:01.368 INFO:teuthology.orchestra.run.smithi097.stderr: 8300K .......... .......... .......... .......... .......... 8% 385M 1s 2024-09-14T11:10:01.368 INFO:teuthology.orchestra.run.smithi097.stderr: 8350K .......... .......... .......... .......... .......... 9% 58.3M 1s 2024-09-14T11:10:01.368 INFO:teuthology.orchestra.run.smithi097.stderr: 8400K .......... .......... .......... .......... .......... 9% 97.5M 1s 2024-09-14T11:10:01.368 INFO:teuthology.orchestra.run.smithi097.stderr: 8450K .......... .......... .......... .......... .......... 9% 371M 1s 2024-09-14T11:10:01.368 INFO:teuthology.orchestra.run.smithi097.stderr: 8500K .......... .......... .......... .......... .......... 9% 178M 1s 2024-09-14T11:10:01.368 INFO:teuthology.orchestra.run.smithi097.stderr: 8550K .......... .......... .......... .......... .......... 9% 300M 1s 2024-09-14T11:10:01.368 INFO:teuthology.orchestra.run.smithi097.stderr: 8600K .......... .......... .......... .......... .......... 9% 333M 1s 2024-09-14T11:10:01.368 INFO:teuthology.orchestra.run.smithi097.stderr: 8650K .......... .......... .......... .......... .......... 9% 211M 1s 2024-09-14T11:10:01.369 INFO:teuthology.orchestra.run.smithi097.stderr: 8700K .......... .......... .......... .......... .......... 9% 237M 1s 2024-09-14T11:10:01.369 INFO:teuthology.orchestra.run.smithi097.stderr: 8750K .......... .......... .......... .......... .......... 9% 342M 1s 2024-09-14T11:10:01.369 INFO:teuthology.orchestra.run.smithi097.stderr: 8800K .......... .......... .......... .......... .......... 9% 381M 1s 2024-09-14T11:10:01.369 INFO:teuthology.orchestra.run.smithi097.stderr: 8850K .......... .......... .......... .......... .......... 9% 139M 1s 2024-09-14T11:10:01.369 INFO:teuthology.orchestra.run.smithi097.stderr: 8900K .......... .......... .......... .......... .......... 9% 375M 1s 2024-09-14T11:10:01.369 INFO:teuthology.orchestra.run.smithi097.stderr: 8950K .......... .......... .......... .......... .......... 9% 364M 1s 2024-09-14T11:10:01.369 INFO:teuthology.orchestra.run.smithi097.stderr: 9000K .......... .......... .......... .......... .......... 9% 220M 1s 2024-09-14T11:10:01.369 INFO:teuthology.orchestra.run.smithi097.stderr: 9050K .......... .......... .......... .......... .......... 9% 167M 1s 2024-09-14T11:10:01.369 INFO:teuthology.orchestra.run.smithi097.stderr: 9100K .......... .......... .......... .......... .......... 9% 371M 1s 2024-09-14T11:10:01.369 INFO:teuthology.orchestra.run.smithi097.stderr: 9150K .......... .......... .......... .......... .......... 9% 230M 1s 2024-09-14T11:10:01.369 INFO:teuthology.orchestra.run.smithi097.stderr: 9200K .......... .......... .......... .......... .......... 9% 109M 1s 2024-09-14T11:10:01.369 INFO:teuthology.orchestra.run.smithi097.stderr: 9250K .......... .......... .......... .......... .......... 10% 325M 1s 2024-09-14T11:10:01.369 INFO:teuthology.orchestra.run.smithi097.stderr: 9300K .......... .......... .......... .......... .......... 10% 375M 1s 2024-09-14T11:10:01.369 INFO:teuthology.orchestra.run.smithi097.stderr: 9350K .......... .......... .......... .......... .......... 10% 330M 1s 2024-09-14T11:10:01.370 INFO:teuthology.orchestra.run.smithi097.stderr: 9400K .......... .......... .......... .......... .......... 10% 172M 1s 2024-09-14T11:10:01.370 INFO:teuthology.orchestra.run.smithi097.stderr: 9450K .......... .......... .......... .......... .......... 10% 386M 1s 2024-09-14T11:10:01.370 INFO:teuthology.orchestra.run.smithi097.stderr: 9500K .......... .......... .......... .......... .......... 10% 302M 1s 2024-09-14T11:10:01.370 INFO:teuthology.orchestra.run.smithi097.stderr: 9550K .......... .......... .......... .......... .......... 10% 114M 1s 2024-09-14T11:10:01.370 INFO:teuthology.orchestra.run.smithi097.stderr: 9600K .......... .......... .......... .......... .......... 10% 213M 1s 2024-09-14T11:10:01.370 INFO:teuthology.orchestra.run.smithi097.stderr: 9650K .......... .......... .......... .......... .......... 10% 148M 1s 2024-09-14T11:10:01.370 INFO:teuthology.orchestra.run.smithi097.stderr: 9700K .......... .......... .......... .......... .......... 10% 367M 1s 2024-09-14T11:10:01.370 INFO:teuthology.orchestra.run.smithi097.stderr: 9750K .......... .......... .......... .......... .......... 10% 88.6M 1s 2024-09-14T11:10:01.370 INFO:teuthology.orchestra.run.smithi097.stderr: 9800K .......... .......... .......... .......... .......... 10% 372M 1s 2024-09-14T11:10:01.370 INFO:teuthology.orchestra.run.smithi097.stderr: 9850K .......... .......... .......... .......... .......... 10% 331M 1s 2024-09-14T11:10:01.370 INFO:teuthology.orchestra.run.smithi097.stderr: 9900K .......... .......... .......... .......... .......... 10% 385M 1s 2024-09-14T11:10:01.370 INFO:teuthology.orchestra.run.smithi097.stderr: 9950K .......... .......... .......... .......... .......... 10% 163M 1s 2024-09-14T11:10:01.370 INFO:teuthology.orchestra.run.smithi097.stderr: 10000K .......... .......... .......... .......... .......... 10% 146M 1s 2024-09-14T11:10:01.370 INFO:teuthology.orchestra.run.smithi097.stderr: 10050K .......... .......... .......... .......... .......... 10% 160M 1s 2024-09-14T11:10:01.371 INFO:teuthology.orchestra.run.smithi097.stderr: 10100K .......... .......... .......... .......... .......... 10% 392M 1s 2024-09-14T11:10:01.371 INFO:teuthology.orchestra.run.smithi097.stderr: 10150K .......... .......... .......... .......... .......... 10% 248M 1s 2024-09-14T11:10:01.371 INFO:teuthology.orchestra.run.smithi097.stderr: 10200K .......... .......... .......... .......... .......... 11% 335M 1s 2024-09-14T11:10:01.371 INFO:teuthology.orchestra.run.smithi097.stderr: 10250K .......... .......... .......... .......... .......... 11% 15.3M 1s 2024-09-14T11:10:01.371 INFO:teuthology.orchestra.run.smithi097.stderr: 10300K .......... .......... .......... .......... .......... 11% 210M 1s 2024-09-14T11:10:01.371 INFO:teuthology.orchestra.run.smithi097.stderr: 10350K .......... .......... .......... .......... .......... 11% 286M 1s 2024-09-14T11:10:01.371 INFO:teuthology.orchestra.run.smithi097.stderr: 10400K .......... .......... .......... .......... .......... 11% 301M 1s 2024-09-14T11:10:01.371 INFO:teuthology.orchestra.run.smithi097.stderr: 10450K .......... .......... .......... .......... .......... 11% 362M 1s 2024-09-14T11:10:01.371 INFO:teuthology.orchestra.run.smithi097.stderr: 10500K .......... .......... .......... .......... .......... 11% 284M 1s 2024-09-14T11:10:01.371 INFO:teuthology.orchestra.run.smithi097.stderr: 10550K .......... .......... .......... .......... .......... 11% 372M 1s 2024-09-14T11:10:01.371 INFO:teuthology.orchestra.run.smithi097.stderr: 10600K .......... .......... .......... .......... .......... 11% 385M 1s 2024-09-14T11:10:01.371 INFO:teuthology.orchestra.run.smithi097.stderr: 10650K .......... .......... .......... .......... .......... 11% 152M 1s 2024-09-14T11:10:01.371 INFO:teuthology.orchestra.run.smithi097.stderr: 10700K .......... .......... .......... .......... .......... 11% 179M 1s 2024-09-14T11:10:01.371 INFO:teuthology.orchestra.run.smithi097.stderr: 10750K .......... .......... .......... .......... .......... 11% 194M 1s 2024-09-14T11:10:01.371 INFO:teuthology.orchestra.run.smithi097.stderr: 10800K .......... .......... .......... .......... .......... 11% 320M 1s 2024-09-14T11:10:01.372 INFO:teuthology.orchestra.run.smithi097.stderr: 10850K .......... .......... .......... .......... .......... 11% 373M 1s 2024-09-14T11:10:01.372 INFO:teuthology.orchestra.run.smithi097.stderr: 10900K .......... .......... .......... .......... .......... 11% 339M 1s 2024-09-14T11:10:01.372 INFO:teuthology.orchestra.run.smithi097.stderr: 10950K .......... .......... .......... .......... .......... 11% 167M 1s 2024-09-14T11:10:01.372 INFO:teuthology.orchestra.run.smithi097.stderr: 11000K .......... .......... .......... .......... .......... 11% 302M 1s 2024-09-14T11:10:01.372 INFO:teuthology.orchestra.run.smithi097.stderr: 11050K .......... .......... .......... .......... .......... 11% 374M 1s 2024-09-14T11:10:01.372 INFO:teuthology.orchestra.run.smithi097.stderr: 11100K .......... .......... .......... .......... .......... 12% 310M 1s 2024-09-14T11:10:01.372 INFO:teuthology.orchestra.run.smithi097.stderr: 11150K .......... .......... .......... .......... .......... 12% 369M 1s 2024-09-14T11:10:01.372 INFO:teuthology.orchestra.run.smithi097.stderr: 11200K .......... .......... .......... .......... .......... 12% 374M 1s 2024-09-14T11:10:01.372 INFO:teuthology.orchestra.run.smithi097.stderr: 11250K .......... .......... .......... .......... .......... 12% 366M 1s 2024-09-14T11:10:01.372 INFO:teuthology.orchestra.run.smithi097.stderr: 11300K .......... .......... .......... .......... .......... 12% 339M 1s 2024-09-14T11:10:01.372 INFO:teuthology.orchestra.run.smithi097.stderr: 11350K .......... .......... .......... .......... .......... 12% 119M 1s 2024-09-14T11:10:01.372 INFO:teuthology.orchestra.run.smithi097.stderr: 11400K .......... .......... .......... .......... .......... 12% 377M 1s 2024-09-14T11:10:01.372 INFO:teuthology.orchestra.run.smithi097.stderr: 11450K .......... .......... .......... .......... .......... 12% 96.3M 1s 2024-09-14T11:10:01.372 INFO:teuthology.orchestra.run.smithi097.stderr: 11500K .......... .......... .......... .......... .......... 12% 291M 1s 2024-09-14T11:10:01.372 INFO:teuthology.orchestra.run.smithi097.stderr: 11550K .......... .......... .......... .......... .......... 12% 365M 1s 2024-09-14T11:10:01.373 INFO:teuthology.orchestra.run.smithi097.stderr: 11600K .......... .......... .......... .......... .......... 12% 341M 1s 2024-09-14T11:10:01.373 INFO:teuthology.orchestra.run.smithi097.stderr: 11650K .......... .......... .......... .......... .......... 12% 381M 1s 2024-09-14T11:10:01.373 INFO:teuthology.orchestra.run.smithi097.stderr: 11700K .......... .......... .......... .......... .......... 12% 337M 1s 2024-09-14T11:10:01.373 INFO:teuthology.orchestra.run.smithi097.stderr: 11750K .......... .......... .......... .......... .......... 12% 164M 1s 2024-09-14T11:10:01.373 INFO:teuthology.orchestra.run.smithi097.stderr: 11800K .......... .......... .......... .......... .......... 12% 257M 1s 2024-09-14T11:10:01.373 INFO:teuthology.orchestra.run.smithi097.stderr: 11850K .......... .......... .......... .......... .......... 12% 338M 1s 2024-09-14T11:10:01.373 INFO:teuthology.orchestra.run.smithi097.stderr: 11900K .......... .......... .......... .......... .......... 12% 187M 1s 2024-09-14T11:10:01.373 INFO:teuthology.orchestra.run.smithi097.stderr: 11950K .......... .......... .......... .......... .......... 12% 111M 1s 2024-09-14T11:10:01.373 INFO:teuthology.orchestra.run.smithi097.stderr: 12000K .......... .......... .......... .......... .......... 12% 121M 1s 2024-09-14T11:10:01.373 INFO:teuthology.orchestra.run.smithi097.stderr: 12050K .......... .......... .......... .......... .......... 13% 337M 1s 2024-09-14T11:10:01.373 INFO:teuthology.orchestra.run.smithi097.stderr: 12100K .......... .......... .......... .......... .......... 13% 224M 1s 2024-09-14T11:10:01.373 INFO:teuthology.orchestra.run.smithi097.stderr: 12150K .......... .......... .......... .......... .......... 13% 364M 1s 2024-09-14T11:10:01.373 INFO:teuthology.orchestra.run.smithi097.stderr: 12200K .......... .......... .......... .......... .......... 13% 385M 1s 2024-09-14T11:10:01.373 INFO:teuthology.orchestra.run.smithi097.stderr: 12250K .......... .......... .......... .......... .......... 13% 364M 1s 2024-09-14T11:10:01.374 INFO:teuthology.orchestra.run.smithi097.stderr: 12300K .......... .......... .......... .......... .......... 13% 324M 1s 2024-09-14T11:10:01.374 INFO:teuthology.orchestra.run.smithi097.stderr: 12350K .......... .......... .......... .......... .......... 13% 198M 1s 2024-09-14T11:10:01.374 INFO:teuthology.orchestra.run.smithi097.stderr: 12400K .......... .......... .......... .......... .......... 13% 373M 1s 2024-09-14T11:10:01.374 INFO:teuthology.orchestra.run.smithi097.stderr: 12450K .......... .......... .......... .......... .......... 13% 150M 1s 2024-09-14T11:10:01.374 INFO:teuthology.orchestra.run.smithi097.stderr: 12500K .......... .......... .......... .......... .......... 13% 248M 1s 2024-09-14T11:10:01.374 INFO:teuthology.orchestra.run.smithi097.stderr: 12550K .......... .......... .......... .......... .......... 13% 249M 1s 2024-09-14T11:10:01.374 INFO:teuthology.orchestra.run.smithi097.stderr: 12600K .......... .......... .......... .......... .......... 13% 365M 1s 2024-09-14T11:10:01.374 INFO:teuthology.orchestra.run.smithi097.stderr: 12650K .......... .......... .......... .......... .......... 13% 151M 1s 2024-09-14T11:10:01.374 INFO:teuthology.orchestra.run.smithi097.stderr: 12700K .......... .......... .......... .......... .......... 13% 127M 1s 2024-09-14T11:10:01.374 INFO:teuthology.orchestra.run.smithi097.stderr: 12750K .......... .......... .......... .......... .......... 13% 381M 1s 2024-09-14T11:10:01.374 INFO:teuthology.orchestra.run.smithi097.stderr: 12800K .......... .......... .......... .......... .......... 13% 235M 1s 2024-09-14T11:10:01.374 INFO:teuthology.orchestra.run.smithi097.stderr: 12850K .......... .......... .......... .......... .......... 13% 260M 1s 2024-09-14T11:10:01.374 INFO:teuthology.orchestra.run.smithi097.stderr: 12900K .......... .......... .......... .......... .......... 13% 40.9M 1s 2024-09-14T11:10:01.374 INFO:teuthology.orchestra.run.smithi097.stderr: 12950K .......... .......... .......... .......... .......... 13% 397M 1s 2024-09-14T11:10:01.375 INFO:teuthology.orchestra.run.smithi097.stderr: 13000K .......... .......... .......... .......... .......... 14% 303M 1s 2024-09-14T11:10:01.375 INFO:teuthology.orchestra.run.smithi097.stderr: 13050K .......... .......... .......... .......... .......... 14% 376M 1s 2024-09-14T11:10:01.375 INFO:teuthology.orchestra.run.smithi097.stderr: 13100K .......... .......... .......... .......... .......... 14% 160M 1s 2024-09-14T11:10:01.375 INFO:teuthology.orchestra.run.smithi097.stderr: 13150K .......... .......... .......... .......... .......... 14% 311M 1s 2024-09-14T11:10:01.375 INFO:teuthology.orchestra.run.smithi097.stderr: 13200K .......... .......... .......... .......... .......... 14% 232M 1s 2024-09-14T11:10:01.375 INFO:teuthology.orchestra.run.smithi097.stderr: 13250K .......... .......... .......... .......... .......... 14% 373M 1s 2024-09-14T11:10:01.375 INFO:teuthology.orchestra.run.smithi097.stderr: 13300K .......... .......... .......... .......... .......... 14% 26.9M 1s 2024-09-14T11:10:01.375 INFO:teuthology.orchestra.run.smithi097.stderr: 13350K .......... .......... .......... .......... .......... 14% 231M 1s 2024-09-14T11:10:01.375 INFO:teuthology.orchestra.run.smithi097.stderr: 13400K .......... .......... .......... .......... .......... 14% 377M 1s 2024-09-14T11:10:01.375 INFO:teuthology.orchestra.run.smithi097.stderr: 13450K .......... .......... .......... .......... .......... 14% 278M 1s 2024-09-14T11:10:01.375 INFO:teuthology.orchestra.run.smithi097.stderr: 13500K .......... .......... .......... .......... .......... 14% 170M 1s 2024-09-14T11:10:01.375 INFO:teuthology.orchestra.run.smithi097.stderr: 13550K .......... .......... .......... .......... .......... 14% 217M 1s 2024-09-14T11:10:01.375 INFO:teuthology.orchestra.run.smithi097.stderr: 13600K .......... .......... .......... .......... .......... 14% 369M 1s 2024-09-14T11:10:01.375 INFO:teuthology.orchestra.run.smithi097.stderr: 13650K .......... .......... .......... .......... .......... 14% 369M 1s 2024-09-14T11:10:01.376 INFO:teuthology.orchestra.run.smithi097.stderr: 13700K .......... .......... .......... .......... .......... 14% 304M 1s 2024-09-14T11:10:01.376 INFO:teuthology.orchestra.run.smithi097.stderr: 13750K .......... .......... .......... .......... .......... 14% 382M 1s 2024-09-14T11:10:01.376 INFO:teuthology.orchestra.run.smithi097.stderr: 13800K .......... .......... .......... .......... .......... 14% 353M 1s 2024-09-14T11:10:01.376 INFO:teuthology.orchestra.run.smithi097.stderr: 13850K .......... .......... .......... .......... .......... 14% 386M 1s 2024-09-14T11:10:01.376 INFO:teuthology.orchestra.run.smithi097.stderr: 13900K .......... .......... .......... .......... .......... 15% 315M 1s 2024-09-14T11:10:01.376 INFO:teuthology.orchestra.run.smithi097.stderr: 13950K .......... .......... .......... .......... .......... 15% 233M 1s 2024-09-14T11:10:01.376 INFO:teuthology.orchestra.run.smithi097.stderr: 14000K .......... .......... .......... .......... .......... 15% 153M 1s 2024-09-14T11:10:01.376 INFO:teuthology.orchestra.run.smithi097.stderr: 14050K .......... .......... .......... .......... .......... 15% 241M 1s 2024-09-14T11:10:01.376 INFO:teuthology.orchestra.run.smithi097.stderr: 14100K .......... .......... .......... .......... .......... 15% 344M 1s 2024-09-14T11:10:01.376 INFO:teuthology.orchestra.run.smithi097.stderr: 14150K .......... .......... .......... .......... .......... 15% 376M 1s 2024-09-14T11:10:01.376 INFO:teuthology.orchestra.run.smithi097.stderr: 14200K .......... .......... .......... .......... .......... 15% 365M 1s 2024-09-14T11:10:01.376 INFO:teuthology.orchestra.run.smithi097.stderr: 14250K .......... .......... .......... .......... .......... 15% 392M 1s 2024-09-14T11:10:01.376 INFO:teuthology.orchestra.run.smithi097.stderr: 14300K .......... .......... .......... .......... .......... 15% 79.7M 1s 2024-09-14T11:10:01.376 INFO:teuthology.orchestra.run.smithi097.stderr: 14350K .......... .......... .......... .......... .......... 15% 243M 1s 2024-09-14T11:10:01.376 INFO:teuthology.orchestra.run.smithi097.stderr: 14400K .......... .......... .......... .......... .......... 15% 373M 1s 2024-09-14T11:10:01.377 INFO:teuthology.orchestra.run.smithi097.stderr: 14450K .......... .......... .......... .......... .......... 15% 150M 1s 2024-09-14T11:10:01.377 INFO:teuthology.orchestra.run.smithi097.stderr: 14500K .......... .......... .......... .......... .......... 15% 263M 1s 2024-09-14T11:10:01.377 INFO:teuthology.orchestra.run.smithi097.stderr: 14550K .......... .......... .......... .......... .......... 15% 129M 1s 2024-09-14T11:10:01.377 INFO:teuthology.orchestra.run.smithi097.stderr: 14600K .......... .......... .......... .......... .......... 15% 373M 1s 2024-09-14T11:10:01.377 INFO:teuthology.orchestra.run.smithi097.stderr: 14650K .......... .......... .......... .......... .......... 15% 380M 1s 2024-09-14T11:10:01.377 INFO:teuthology.orchestra.run.smithi097.stderr: 14700K .......... .......... .......... .......... .......... 15% 312M 1s 2024-09-14T11:10:01.377 INFO:teuthology.orchestra.run.smithi097.stderr: 14750K .......... .......... .......... .......... .......... 15% 388M 1s 2024-09-14T11:10:01.377 INFO:teuthology.orchestra.run.smithi097.stderr: 14800K .......... .......... .......... .......... .......... 15% 362M 1s 2024-09-14T11:10:01.377 INFO:teuthology.orchestra.run.smithi097.stderr: 14850K .......... .......... .......... .......... .......... 16% 362M 1s 2024-09-14T11:10:01.377 INFO:teuthology.orchestra.run.smithi097.stderr: 14900K .......... .......... .......... .......... .......... 16% 174M 1s 2024-09-14T11:10:01.377 INFO:teuthology.orchestra.run.smithi097.stderr: 14950K .......... .......... .......... .......... .......... 16% 349M 1s 2024-09-14T11:10:01.377 INFO:teuthology.orchestra.run.smithi097.stderr: 15000K .......... .......... .......... .......... .......... 16% 367M 1s 2024-09-14T11:10:01.377 INFO:teuthology.orchestra.run.smithi097.stderr: 15050K .......... .......... .......... .......... .......... 16% 352M 1s 2024-09-14T11:10:01.377 INFO:teuthology.orchestra.run.smithi097.stderr: 15100K .......... .......... .......... .......... .......... 16% 141M 1s 2024-09-14T11:10:01.377 INFO:teuthology.orchestra.run.smithi097.stderr: 15150K .......... .......... .......... .......... .......... 16% 172M 1s 2024-09-14T11:10:01.378 INFO:teuthology.orchestra.run.smithi097.stderr: 15200K .......... .......... .......... .......... .......... 16% 376M 1s 2024-09-14T11:10:01.378 INFO:teuthology.orchestra.run.smithi097.stderr: 15250K .......... .......... .......... .......... .......... 16% 271M 1s 2024-09-14T11:10:01.378 INFO:teuthology.orchestra.run.smithi097.stderr: 15300K .......... .......... .......... .......... .......... 16% 327M 1s 2024-09-14T11:10:01.378 INFO:teuthology.orchestra.run.smithi097.stderr: 15350K .......... .......... .......... .......... .......... 16% 341M 1s 2024-09-14T11:10:01.378 INFO:teuthology.orchestra.run.smithi097.stderr: 15400K .......... .......... .......... .......... .......... 16% 123M 1s 2024-09-14T11:10:01.378 INFO:teuthology.orchestra.run.smithi097.stderr: 15450K .......... .......... .......... .......... .......... 16% 246M 1s 2024-09-14T11:10:01.378 INFO:teuthology.orchestra.run.smithi097.stderr: 15500K .......... .......... .......... .......... .......... 16% 247M 1s 2024-09-14T11:10:01.378 INFO:teuthology.orchestra.run.smithi097.stderr: 15550K .......... .......... .......... .......... .......... 16% 342M 1s 2024-09-14T11:10:01.378 INFO:teuthology.orchestra.run.smithi097.stderr: 15600K .......... .......... .......... .......... .......... 16% 248M 1s 2024-09-14T11:10:01.378 INFO:teuthology.orchestra.run.smithi097.stderr: 15650K .......... .......... .......... .......... .......... 16% 281M 1s 2024-09-14T11:10:01.378 INFO:teuthology.orchestra.run.smithi097.stderr: 15700K .......... .......... .......... .......... .......... 16% 267M 1s 2024-09-14T11:10:01.378 INFO:teuthology.orchestra.run.smithi097.stderr: 15750K .......... .......... .......... .......... .......... 17% 366M 1s 2024-09-14T11:10:01.378 INFO:teuthology.orchestra.run.smithi097.stderr: 15800K .......... .......... .......... .......... .......... 17% 237M 1s 2024-09-14T11:10:01.378 INFO:teuthology.orchestra.run.smithi097.stderr: 15850K .......... .......... .......... .......... .......... 17% 364M 1s 2024-09-14T11:10:01.378 INFO:teuthology.orchestra.run.smithi097.stderr: 15900K .......... .......... .......... .......... .......... 17% 176M 1s 2024-09-14T11:10:01.379 INFO:teuthology.orchestra.run.smithi097.stderr: 15950K .......... .......... .......... .......... .......... 17% 138M 1s 2024-09-14T11:10:01.379 INFO:teuthology.orchestra.run.smithi097.stderr: 16000K .......... .......... .......... .......... .......... 17% 235M 1s 2024-09-14T11:10:01.379 INFO:teuthology.orchestra.run.smithi097.stderr: 16050K .......... .......... .......... .......... .......... 17% 166M 1s 2024-09-14T11:10:01.379 INFO:teuthology.orchestra.run.smithi097.stderr: 16100K .......... .......... .......... .......... .......... 17% 69.3M 1s 2024-09-14T11:10:01.379 INFO:teuthology.orchestra.run.smithi097.stderr: 16150K .......... .......... .......... .......... .......... 17% 273M 1s 2024-09-14T11:10:01.379 INFO:teuthology.orchestra.run.smithi097.stderr: 16200K .......... .......... .......... .......... .......... 17% 379M 1s 2024-09-14T11:10:01.379 INFO:teuthology.orchestra.run.smithi097.stderr: 16250K .......... .......... .......... .......... .......... 17% 374M 1s 2024-09-14T11:10:01.379 INFO:teuthology.orchestra.run.smithi097.stderr: 16300K .......... .......... .......... .......... .......... 17% 318M 1s 2024-09-14T11:10:01.379 INFO:teuthology.orchestra.run.smithi097.stderr: 16350K .......... .......... .......... .......... .......... 17% 87.1M 1s 2024-09-14T11:10:01.379 INFO:teuthology.orchestra.run.smithi097.stderr: 16400K .......... .......... .......... .......... .......... 17% 277M 1s 2024-09-14T11:10:01.379 INFO:teuthology.orchestra.run.smithi097.stderr: 16450K .......... .......... .......... .......... .......... 17% 359M 1s 2024-09-14T11:10:01.379 INFO:teuthology.orchestra.run.smithi097.stderr: 16500K .......... .......... .......... .......... .......... 17% 347M 1s 2024-09-14T11:10:01.379 INFO:teuthology.orchestra.run.smithi097.stderr: 16550K .......... .......... .......... .......... .......... 17% 297M 1s 2024-09-14T11:10:01.380 INFO:teuthology.orchestra.run.smithi097.stderr: 16600K .......... .......... .......... .......... .......... 17% 381M 1s 2024-09-14T11:10:01.380 INFO:teuthology.orchestra.run.smithi097.stderr: 16650K .......... .......... .......... .......... .......... 17% 372M 1s 2024-09-14T11:10:01.380 INFO:teuthology.orchestra.run.smithi097.stderr: 16700K .......... .......... .......... .......... .......... 18% 307M 1s 2024-09-14T11:10:01.380 INFO:teuthology.orchestra.run.smithi097.stderr: 16750K .......... .......... .......... .......... .......... 18% 400M 1s 2024-09-14T11:10:01.380 INFO:teuthology.orchestra.run.smithi097.stderr: 16800K .......... .......... .......... .......... .......... 18% 187M 1s 2024-09-14T11:10:01.380 INFO:teuthology.orchestra.run.smithi097.stderr: 16850K .......... .......... .......... .......... .......... 18% 203M 1s 2024-09-14T11:10:01.380 INFO:teuthology.orchestra.run.smithi097.stderr: 16900K .......... .......... .......... .......... .......... 18% 243M 1s 2024-09-14T11:10:01.380 INFO:teuthology.orchestra.run.smithi097.stderr: 16950K .......... .......... .......... .......... .......... 18% 345M 1s 2024-09-14T11:10:01.380 INFO:teuthology.orchestra.run.smithi097.stderr: 17000K .......... .......... .......... .......... .......... 18% 294M 1s 2024-09-14T11:10:01.380 INFO:teuthology.orchestra.run.smithi097.stderr: 17050K .......... .......... .......... .......... .......... 18% 248M 1s 2024-09-14T11:10:01.380 INFO:teuthology.orchestra.run.smithi097.stderr: 17100K .......... .......... .......... .......... .......... 18% 361M 1s 2024-09-14T11:10:01.380 INFO:teuthology.orchestra.run.smithi097.stderr: 17150K .......... .......... .......... .......... .......... 18% 376M 1s 2024-09-14T11:10:01.380 INFO:teuthology.orchestra.run.smithi097.stderr: 17200K .......... .......... .......... .......... .......... 18% 313M 1s 2024-09-14T11:10:01.380 INFO:teuthology.orchestra.run.smithi097.stderr: 17250K .......... .......... .......... .......... .......... 18% 112M 1s 2024-09-14T11:10:01.380 INFO:teuthology.orchestra.run.smithi097.stderr: 17300K .......... .......... .......... .......... .......... 18% 361M 1s 2024-09-14T11:10:01.381 INFO:teuthology.orchestra.run.smithi097.stderr: 17350K .......... .......... .......... .......... .......... 18% 179M 1s 2024-09-14T11:10:01.381 INFO:teuthology.orchestra.run.smithi097.stderr: 17400K .......... .......... .......... .......... .......... 18% 297M 1s 2024-09-14T11:10:01.381 INFO:teuthology.orchestra.run.smithi097.stderr: 17450K .......... .......... .......... .......... .......... 18% 173M 1s 2024-09-14T11:10:01.381 INFO:teuthology.orchestra.run.smithi097.stderr: 17500K .......... .......... .......... .......... .......... 18% 394M 1s 2024-09-14T11:10:01.381 INFO:teuthology.orchestra.run.smithi097.stderr: 17550K .......... .......... .......... .......... .......... 18% 139M 1s 2024-09-14T11:10:01.381 INFO:teuthology.orchestra.run.smithi097.stderr: 17600K .......... .......... .......... .......... .......... 18% 129M 1s 2024-09-14T11:10:01.381 INFO:teuthology.orchestra.run.smithi097.stderr: 17650K .......... .......... .......... .......... .......... 19% 279M 1s 2024-09-14T11:10:01.381 INFO:teuthology.orchestra.run.smithi097.stderr: 17700K .......... .......... .......... .......... .......... 19% 160M 1s 2024-09-14T11:10:01.381 INFO:teuthology.orchestra.run.smithi097.stderr: 17750K .......... .......... .......... .......... .......... 19% 375M 1s 2024-09-14T11:10:01.381 INFO:teuthology.orchestra.run.smithi097.stderr: 17800K .......... .......... .......... .......... .......... 19% 357M 1s 2024-09-14T11:10:01.381 INFO:teuthology.orchestra.run.smithi097.stderr: 17850K .......... .......... .......... .......... .......... 19% 331M 1s 2024-09-14T11:10:01.381 INFO:teuthology.orchestra.run.smithi097.stderr: 17900K .......... .......... .......... .......... .......... 19% 294M 1s 2024-09-14T11:10:01.381 INFO:teuthology.orchestra.run.smithi097.stderr: 17950K .......... .......... .......... .......... .......... 19% 380M 1s 2024-09-14T11:10:01.381 INFO:teuthology.orchestra.run.smithi097.stderr: 18000K .......... .......... .......... .......... .......... 19% 128M 1s 2024-09-14T11:10:01.382 INFO:teuthology.orchestra.run.smithi097.stderr: 18050K .......... .......... .......... .......... .......... 19% 352M 1s 2024-09-14T11:10:01.382 INFO:teuthology.orchestra.run.smithi097.stderr: 18100K .......... .......... .......... .......... .......... 19% 389M 1s 2024-09-14T11:10:01.382 INFO:teuthology.orchestra.run.smithi097.stderr: 18150K .......... .......... .......... .......... .......... 19% 97.9M 1s 2024-09-14T11:10:01.382 INFO:teuthology.orchestra.run.smithi097.stderr: 18200K .......... .......... .......... .......... .......... 19% 345M 1s 2024-09-14T11:10:01.382 INFO:teuthology.orchestra.run.smithi097.stderr: 18250K .......... .......... .......... .......... .......... 19% 259M 1s 2024-09-14T11:10:01.382 INFO:teuthology.orchestra.run.smithi097.stderr: 18300K .......... .......... .......... .......... .......... 19% 224M 1s 2024-09-14T11:10:01.382 INFO:teuthology.orchestra.run.smithi097.stderr: 18350K .......... .......... .......... .......... .......... 19% 328M 1s 2024-09-14T11:10:01.382 INFO:teuthology.orchestra.run.smithi097.stderr: 18400K .......... .......... .......... .......... .......... 19% 140M 1s 2024-09-14T11:10:01.382 INFO:teuthology.orchestra.run.smithi097.stderr: 18450K .......... .......... .......... .......... .......... 19% 144M 1s 2024-09-14T11:10:01.382 INFO:teuthology.orchestra.run.smithi097.stderr: 18500K .......... .......... .......... .......... .......... 19% 160M 1s 2024-09-14T11:10:01.382 INFO:teuthology.orchestra.run.smithi097.stderr: 18550K .......... .......... .......... .......... .......... 20% 241M 1s 2024-09-14T11:10:01.382 INFO:teuthology.orchestra.run.smithi097.stderr: 18600K .......... .......... .......... .......... .......... 20% 386M 1s 2024-09-14T11:10:01.382 INFO:teuthology.orchestra.run.smithi097.stderr: 18650K .......... .......... .......... .......... .......... 20% 124M 1s 2024-09-14T11:10:01.382 INFO:teuthology.orchestra.run.smithi097.stderr: 18700K .......... .......... .......... .......... .......... 20% 196M 1s 2024-09-14T11:10:01.382 INFO:teuthology.orchestra.run.smithi097.stderr: 18750K .......... .......... .......... .......... .......... 20% 380M 1s 2024-09-14T11:10:01.383 INFO:teuthology.orchestra.run.smithi097.stderr: 18800K .......... .......... .......... .......... .......... 20% 271M 1s 2024-09-14T11:10:01.383 INFO:teuthology.orchestra.run.smithi097.stderr: 18850K .......... .......... .......... .......... .......... 20% 79.0M 1s 2024-09-14T11:10:01.383 INFO:teuthology.orchestra.run.smithi097.stderr: 18900K .......... .......... .......... .......... .......... 20% 354M 1s 2024-09-14T11:10:01.383 INFO:teuthology.orchestra.run.smithi097.stderr: 18950K .......... .......... .......... .......... .......... 20% 400M 1s 2024-09-14T11:10:01.383 INFO:teuthology.orchestra.run.smithi097.stderr: 19000K .......... .......... .......... .......... .......... 20% 376M 1s 2024-09-14T11:10:01.383 INFO:teuthology.orchestra.run.smithi097.stderr: 19050K .......... .......... .......... .......... .......... 20% 150M 1s 2024-09-14T11:10:01.383 INFO:teuthology.orchestra.run.smithi097.stderr: 19100K .......... .......... .......... .......... .......... 20% 155M 1s 2024-09-14T11:10:01.383 INFO:teuthology.orchestra.run.smithi097.stderr: 19150K .......... .......... .......... .......... .......... 20% 197M 1s 2024-09-14T11:10:01.383 INFO:teuthology.orchestra.run.smithi097.stderr: 19200K .......... .......... .......... .......... .......... 20% 74.4M 1s 2024-09-14T11:10:01.383 INFO:teuthology.orchestra.run.smithi097.stderr: 19250K .......... .......... .......... .......... .......... 20% 373M 1s 2024-09-14T11:10:01.383 INFO:teuthology.orchestra.run.smithi097.stderr: 19300K .......... .......... .......... .......... .......... 20% 394M 1s 2024-09-14T11:10:01.383 INFO:teuthology.orchestra.run.smithi097.stderr: 19350K .......... .......... .......... .......... .......... 20% 341M 1s 2024-09-14T11:10:01.383 INFO:teuthology.orchestra.run.smithi097.stderr: 19400K .......... .......... .......... .......... .......... 20% 157M 1s 2024-09-14T11:10:01.383 INFO:teuthology.orchestra.run.smithi097.stderr: 19450K .......... .......... .......... .......... .......... 20% 282M 1s 2024-09-14T11:10:01.383 INFO:teuthology.orchestra.run.smithi097.stderr: 19500K .......... .......... .......... .......... .......... 21% 374M 1s 2024-09-14T11:10:01.384 INFO:teuthology.orchestra.run.smithi097.stderr: 19550K .......... .......... .......... .......... .......... 21% 201M 1s 2024-09-14T11:10:01.384 INFO:teuthology.orchestra.run.smithi097.stderr: 19600K .......... .......... .......... .......... .......... 21% 260M 1s 2024-09-14T11:10:01.384 INFO:teuthology.orchestra.run.smithi097.stderr: 19650K .......... .......... .......... .......... .......... 21% 364M 1s 2024-09-14T11:10:01.384 INFO:teuthology.orchestra.run.smithi097.stderr: 19700K .......... .......... .......... .......... .......... 21% 370M 1s 2024-09-14T11:10:01.384 INFO:teuthology.orchestra.run.smithi097.stderr: 19750K .......... .......... .......... .......... .......... 21% 371M 1s 2024-09-14T11:10:01.384 INFO:teuthology.orchestra.run.smithi097.stderr: 19800K .......... .......... .......... .......... .......... 21% 321M 1s 2024-09-14T11:10:01.384 INFO:teuthology.orchestra.run.smithi097.stderr: 19850K .......... .......... .......... .......... .......... 21% 293M 1s 2024-09-14T11:10:01.384 INFO:teuthology.orchestra.run.smithi097.stderr: 19900K .......... .......... .......... .......... .......... 21% 396M 1s 2024-09-14T11:10:01.384 INFO:teuthology.orchestra.run.smithi097.stderr: 19950K .......... .......... .......... .......... .......... 21% 319M 1s 2024-09-14T11:10:01.384 INFO:teuthology.orchestra.run.smithi097.stderr: 20000K .......... .......... .......... .......... .......... 21% 228M 1s 2024-09-14T11:10:01.384 INFO:teuthology.orchestra.run.smithi097.stderr: 20050K .......... .......... .......... .......... .......... 21% 374M 1s 2024-09-14T11:10:01.384 INFO:teuthology.orchestra.run.smithi097.stderr: 20100K .......... .......... .......... .......... .......... 21% 249M 1s 2024-09-14T11:10:01.384 INFO:teuthology.orchestra.run.smithi097.stderr: 20150K .......... .......... .......... .......... .......... 21% 256M 1s 2024-09-14T11:10:01.384 INFO:teuthology.orchestra.run.smithi097.stderr: 20200K .......... .......... .......... .......... .......... 21% 368M 1s 2024-09-14T11:10:01.384 INFO:teuthology.orchestra.run.smithi097.stderr: 20250K .......... .......... .......... .......... .......... 21% 369M 1s 2024-09-14T11:10:01.385 INFO:teuthology.orchestra.run.smithi097.stderr: 20300K .......... .......... .......... .......... .......... 21% 108M 1s 2024-09-14T11:10:01.385 INFO:teuthology.orchestra.run.smithi097.stderr: 20350K .......... .......... .......... .......... .......... 21% 210M 1s 2024-09-14T11:10:01.385 INFO:teuthology.orchestra.run.smithi097.stderr: 20400K .......... .......... .......... .......... .......... 22% 360M 1s 2024-09-14T11:10:01.385 INFO:teuthology.orchestra.run.smithi097.stderr: 20450K .......... .......... .......... .......... .......... 22% 384M 1s 2024-09-14T11:10:01.385 INFO:teuthology.orchestra.run.smithi097.stderr: 20500K .......... .......... .......... .......... .......... 22% 153M 1s 2024-09-14T11:10:01.385 INFO:teuthology.orchestra.run.smithi097.stderr: 20550K .......... .......... .......... .......... .......... 22% 361M 1s 2024-09-14T11:10:01.385 INFO:teuthology.orchestra.run.smithi097.stderr: 20600K .......... .......... .......... .......... .......... 22% 173M 1s 2024-09-14T11:10:01.385 INFO:teuthology.orchestra.run.smithi097.stderr: 20650K .......... .......... .......... .......... .......... 22% 335M 1s 2024-09-14T11:10:01.385 INFO:teuthology.orchestra.run.smithi097.stderr: 20700K .......... .......... .......... .......... .......... 22% 95.2M 1s 2024-09-14T11:10:01.385 INFO:teuthology.orchestra.run.smithi097.stderr: 20750K .......... .......... .......... .......... .......... 22% 166M 1s 2024-09-14T11:10:01.385 INFO:teuthology.orchestra.run.smithi097.stderr: 20800K .......... .......... .......... .......... .......... 22% 353M 1s 2024-09-14T11:10:01.385 INFO:teuthology.orchestra.run.smithi097.stderr: 20850K .......... .......... .......... .......... .......... 22% 118M 1s 2024-09-14T11:10:01.385 INFO:teuthology.orchestra.run.smithi097.stderr: 20900K .......... .......... .......... .......... .......... 22% 331M 1s 2024-09-14T11:10:01.385 INFO:teuthology.orchestra.run.smithi097.stderr: 20950K .......... .......... .......... .......... .......... 22% 385M 1s 2024-09-14T11:10:01.385 INFO:teuthology.orchestra.run.smithi097.stderr: 21000K .......... .......... .......... .......... .......... 22% 387M 1s 2024-09-14T11:10:01.386 INFO:teuthology.orchestra.run.smithi097.stderr: 21050K .......... .......... .......... .......... .......... 22% 273M 1s 2024-09-14T11:10:01.386 INFO:teuthology.orchestra.run.smithi097.stderr: 21100K .......... .......... .......... .......... .......... 22% 184M 1s 2024-09-14T11:10:01.386 INFO:teuthology.orchestra.run.smithi097.stderr: 21150K .......... .......... .......... .......... .......... 22% 217M 1s 2024-09-14T11:10:01.386 INFO:teuthology.orchestra.run.smithi097.stderr: 21200K .......... .......... .......... .......... .......... 22% 99.7M 1s 2024-09-14T11:10:01.386 INFO:teuthology.orchestra.run.smithi097.stderr: 21250K .......... .......... .......... .......... .......... 22% 372M 1s 2024-09-14T11:10:01.386 INFO:teuthology.orchestra.run.smithi097.stderr: 21300K .......... .......... .......... .......... .......... 22% 385M 1s 2024-09-14T11:10:01.386 INFO:teuthology.orchestra.run.smithi097.stderr: 21350K .......... .......... .......... .......... .......... 23% 395M 1s 2024-09-14T11:10:01.386 INFO:teuthology.orchestra.run.smithi097.stderr: 21400K .......... .......... .......... .......... .......... 23% 327M 1s 2024-09-14T11:10:01.386 INFO:teuthology.orchestra.run.smithi097.stderr: 21450K .......... .......... .......... .......... .......... 23% 207M 1s 2024-09-14T11:10:01.386 INFO:teuthology.orchestra.run.smithi097.stderr: 21500K .......... .......... .......... .......... .......... 23% 369M 1s 2024-09-14T11:10:01.386 INFO:teuthology.orchestra.run.smithi097.stderr: 21550K .......... .......... .......... .......... .......... 23% 148M 1s 2024-09-14T11:10:01.386 INFO:teuthology.orchestra.run.smithi097.stderr: 21600K .......... .......... .......... .......... .......... 23% 344M 1s 2024-09-14T11:10:01.386 INFO:teuthology.orchestra.run.smithi097.stderr: 21650K .......... .......... .......... .......... .......... 23% 302M 1s 2024-09-14T11:10:01.386 INFO:teuthology.orchestra.run.smithi097.stderr: 21700K .......... .......... .......... .......... .......... 23% 212M 1s 2024-09-14T11:10:01.386 INFO:teuthology.orchestra.run.smithi097.stderr: 21750K .......... .......... .......... .......... .......... 23% 324M 1s 2024-09-14T11:10:01.387 INFO:teuthology.orchestra.run.smithi097.stderr: 21800K .......... .......... .......... .......... .......... 23% 171M 1s 2024-09-14T11:10:01.387 INFO:teuthology.orchestra.run.smithi097.stderr: 21850K .......... .......... .......... .......... .......... 23% 219M 1s 2024-09-14T11:10:01.387 INFO:teuthology.orchestra.run.smithi097.stderr: 21900K .......... .......... .......... .......... .......... 23% 122M 1s 2024-09-14T11:10:01.387 INFO:teuthology.orchestra.run.smithi097.stderr: 21950K .......... .......... .......... .......... .......... 23% 163M 1s 2024-09-14T11:10:01.387 INFO:teuthology.orchestra.run.smithi097.stderr: 22000K .......... .......... .......... .......... .......... 23% 93.2M 1s 2024-09-14T11:10:01.387 INFO:teuthology.orchestra.run.smithi097.stderr: 22050K .......... .......... .......... .......... .......... 23% 186M 1s 2024-09-14T11:10:01.387 INFO:teuthology.orchestra.run.smithi097.stderr: 22100K .......... .......... .......... .......... .......... 23% 372M 1s 2024-09-14T11:10:01.387 INFO:teuthology.orchestra.run.smithi097.stderr: 22150K .......... .......... .......... .......... .......... 23% 111M 1s 2024-09-14T11:10:01.387 INFO:teuthology.orchestra.run.smithi097.stderr: 22200K .......... .......... .......... .......... .......... 23% 276M 1s 2024-09-14T11:10:01.387 INFO:teuthology.orchestra.run.smithi097.stderr: 22250K .......... .......... .......... .......... .......... 24% 79.4M 1s 2024-09-14T11:10:01.387 INFO:teuthology.orchestra.run.smithi097.stderr: 22300K .......... .......... .......... .......... .......... 24% 199M 1s 2024-09-14T11:10:01.387 INFO:teuthology.orchestra.run.smithi097.stderr: 22350K .......... .......... .......... .......... .......... 24% 319M 1s 2024-09-14T11:10:01.387 INFO:teuthology.orchestra.run.smithi097.stderr: 22400K .......... .......... .......... .......... .......... 24% 365M 1s 2024-09-14T11:10:01.387 INFO:teuthology.orchestra.run.smithi097.stderr: 22450K .......... .......... .......... .......... .......... 24% 393M 1s 2024-09-14T11:10:01.387 INFO:teuthology.orchestra.run.smithi097.stderr: 22500K .......... .......... .......... .......... .......... 24% 364M 1s 2024-09-14T11:10:01.388 INFO:teuthology.orchestra.run.smithi097.stderr: 22550K .......... .......... .......... .......... .......... 24% 336M 1s 2024-09-14T11:10:01.388 INFO:teuthology.orchestra.run.smithi097.stderr: 22600K .......... .......... .......... .......... .......... 24% 108M 1s 2024-09-14T11:10:01.388 INFO:teuthology.orchestra.run.smithi097.stderr: 22650K .......... .......... .......... .......... .......... 24% 257M 1s 2024-09-14T11:10:01.388 INFO:teuthology.orchestra.run.smithi097.stderr: 22700K .......... .......... .......... .......... .......... 24% 366M 1s 2024-09-14T11:10:01.388 INFO:teuthology.orchestra.run.smithi097.stderr: 22750K .......... .......... .......... .......... .......... 24% 320M 1s 2024-09-14T11:10:01.388 INFO:teuthology.orchestra.run.smithi097.stderr: 22800K .......... .......... .......... .......... .......... 24% 396M 1s 2024-09-14T11:10:01.388 INFO:teuthology.orchestra.run.smithi097.stderr: 22850K .......... .......... .......... .......... .......... 24% 275M 1s 2024-09-14T11:10:01.388 INFO:teuthology.orchestra.run.smithi097.stderr: 22900K .......... .......... .......... .......... .......... 24% 378M 1s 2024-09-14T11:10:01.388 INFO:teuthology.orchestra.run.smithi097.stderr: 22950K .......... .......... .......... .......... .......... 24% 352M 1s 2024-09-14T11:10:01.388 INFO:teuthology.orchestra.run.smithi097.stderr: 23000K .......... .......... .......... .......... .......... 24% 358M 1s 2024-09-14T11:10:01.388 INFO:teuthology.orchestra.run.smithi097.stderr: 23050K .......... .......... .......... .......... .......... 24% 338M 1s 2024-09-14T11:10:01.388 INFO:teuthology.orchestra.run.smithi097.stderr: 23100K .......... .......... .......... .......... .......... 24% 146M 1s 2024-09-14T11:10:01.388 INFO:teuthology.orchestra.run.smithi097.stderr: 23150K .......... .......... .......... .......... .......... 24% 178M 1s 2024-09-14T11:10:01.389 INFO:teuthology.orchestra.run.smithi097.stderr: 23200K .......... .......... .......... .......... .......... 25% 369M 1s 2024-09-14T11:10:01.389 INFO:teuthology.orchestra.run.smithi097.stderr: 23250K .......... .......... .......... .......... .......... 25% 311M 1s 2024-09-14T11:10:01.389 INFO:teuthology.orchestra.run.smithi097.stderr: 23300K .......... .......... .......... .......... .......... 25% 316M 1s 2024-09-14T11:10:01.389 INFO:teuthology.orchestra.run.smithi097.stderr: 23350K .......... .......... .......... .......... .......... 25% 145M 1s 2024-09-14T11:10:01.389 INFO:teuthology.orchestra.run.smithi097.stderr: 23400K .......... .......... .......... .......... .......... 25% 240M 1s 2024-09-14T11:10:01.389 INFO:teuthology.orchestra.run.smithi097.stderr: 23450K .......... .......... .......... .......... .......... 25% 262M 1s 2024-09-14T11:10:01.389 INFO:teuthology.orchestra.run.smithi097.stderr: 23500K .......... .......... .......... .......... .......... 25% 297M 1s 2024-09-14T11:10:01.389 INFO:teuthology.orchestra.run.smithi097.stderr: 23550K .......... .......... .......... .......... .......... 25% 266M 1s 2024-09-14T11:10:01.389 INFO:teuthology.orchestra.run.smithi097.stderr: 23600K .......... .......... .......... .......... .......... 25% 292M 1s 2024-09-14T11:10:01.389 INFO:teuthology.orchestra.run.smithi097.stderr: 23650K .......... .......... .......... .......... .......... 25% 238M 1s 2024-09-14T11:10:01.389 INFO:teuthology.orchestra.run.smithi097.stderr: 23700K .......... .......... .......... .......... .......... 25% 293M 1s 2024-09-14T11:10:01.389 INFO:teuthology.orchestra.run.smithi097.stderr: 23750K .......... .......... .......... .......... .......... 25% 248M 1s 2024-09-14T11:10:01.389 INFO:teuthology.orchestra.run.smithi097.stderr: 23800K .......... .......... .......... .......... .......... 25% 237M 1s 2024-09-14T11:10:01.389 INFO:teuthology.orchestra.run.smithi097.stderr: 23850K .......... .......... .......... .......... .......... 25% 149M 1s 2024-09-14T11:10:01.389 INFO:teuthology.orchestra.run.smithi097.stderr: 23900K .......... .......... .......... .......... .......... 25% 287M 1s 2024-09-14T11:10:01.390 INFO:teuthology.orchestra.run.smithi097.stderr: 23950K .......... .......... .......... .......... .......... 25% 292M 1s 2024-09-14T11:10:01.390 INFO:teuthology.orchestra.run.smithi097.stderr: 24000K .......... .......... .......... .......... .......... 25% 215M 1s 2024-09-14T11:10:01.390 INFO:teuthology.orchestra.run.smithi097.stderr: 24050K .......... .......... .......... .......... .......... 25% 151M 1s 2024-09-14T11:10:01.390 INFO:teuthology.orchestra.run.smithi097.stderr: 24100K .......... .......... .......... .......... .......... 25% 285M 1s 2024-09-14T11:10:01.390 INFO:teuthology.orchestra.run.smithi097.stderr: 24150K .......... .......... .......... .......... .......... 26% 293M 1s 2024-09-14T11:10:01.390 INFO:teuthology.orchestra.run.smithi097.stderr: 24200K .......... .......... .......... .......... .......... 26% 261M 1s 2024-09-14T11:10:01.390 INFO:teuthology.orchestra.run.smithi097.stderr: 24250K .......... .......... .......... .......... .......... 26% 117M 1s 2024-09-14T11:10:01.390 INFO:teuthology.orchestra.run.smithi097.stderr: 24300K .......... .......... .......... .......... .......... 26% 281M 1s 2024-09-14T11:10:01.390 INFO:teuthology.orchestra.run.smithi097.stderr: 24350K .......... .......... .......... .......... .......... 26% 163M 1s 2024-09-14T11:10:01.390 INFO:teuthology.orchestra.run.smithi097.stderr: 24400K .......... .......... .......... .......... .......... 26% 259M 1s 2024-09-14T11:10:01.390 INFO:teuthology.orchestra.run.smithi097.stderr: 24450K .......... .......... .......... .......... .......... 26% 233M 1s 2024-09-14T11:10:01.390 INFO:teuthology.orchestra.run.smithi097.stderr: 24500K .......... .......... .......... .......... .......... 26% 283M 1s 2024-09-14T11:10:01.390 INFO:teuthology.orchestra.run.smithi097.stderr: 24550K .......... .......... .......... .......... .......... 26% 289M 1s 2024-09-14T11:10:01.390 INFO:teuthology.orchestra.run.smithi097.stderr: 24600K .......... .......... .......... .......... .......... 26% 291M 1s 2024-09-14T11:10:01.390 INFO:teuthology.orchestra.run.smithi097.stderr: 24650K .......... .......... .......... .......... .......... 26% 252M 1s 2024-09-14T11:10:01.391 INFO:teuthology.orchestra.run.smithi097.stderr: 24700K .......... .......... .......... .......... .......... 26% 281M 1s 2024-09-14T11:10:01.391 INFO:teuthology.orchestra.run.smithi097.stderr: 24750K .......... .......... .......... .......... .......... 26% 299M 1s 2024-09-14T11:10:01.391 INFO:teuthology.orchestra.run.smithi097.stderr: 24800K .......... .......... .......... .......... .......... 26% 284M 1s 2024-09-14T11:10:01.391 INFO:teuthology.orchestra.run.smithi097.stderr: 24850K .......... .......... .......... .......... .......... 26% 248M 1s 2024-09-14T11:10:01.391 INFO:teuthology.orchestra.run.smithi097.stderr: 24900K .......... .......... .......... .......... .......... 26% 267M 1s 2024-09-14T11:10:01.391 INFO:teuthology.orchestra.run.smithi097.stderr: 24950K .......... .......... .......... .......... .......... 26% 293M 1s 2024-09-14T11:10:01.391 INFO:teuthology.orchestra.run.smithi097.stderr: 25000K .......... .......... .......... .......... .......... 26% 283M 1s 2024-09-14T11:10:01.391 INFO:teuthology.orchestra.run.smithi097.stderr: 25050K .......... .......... .......... .......... .......... 27% 172M 1s 2024-09-14T11:10:01.391 INFO:teuthology.orchestra.run.smithi097.stderr: 25100K .......... .......... .......... .......... .......... 27% 77.0M 1s 2024-09-14T11:10:01.391 INFO:teuthology.orchestra.run.smithi097.stderr: 25150K .......... .......... .......... .......... .......... 27% 278M 1s 2024-09-14T11:10:01.391 INFO:teuthology.orchestra.run.smithi097.stderr: 25200K .......... .......... .......... .......... .......... 27% 291M 1s 2024-09-14T11:10:01.391 INFO:teuthology.orchestra.run.smithi097.stderr: 25250K .......... .......... .......... .......... .......... 27% 101M 1s 2024-09-14T11:10:01.391 INFO:teuthology.orchestra.run.smithi097.stderr: 25300K .......... .......... .......... .......... .......... 27% 94.1M 1s 2024-09-14T11:10:01.391 INFO:teuthology.orchestra.run.smithi097.stderr: 25350K .......... .......... .......... .......... .......... 27% 289M 0s 2024-09-14T11:10:01.392 INFO:teuthology.orchestra.run.smithi097.stderr: 25400K .......... .......... .......... .......... .......... 27% 129M 0s 2024-09-14T11:10:01.392 INFO:teuthology.orchestra.run.smithi097.stderr: 25450K .......... .......... .......... .......... .......... 27% 256M 0s 2024-09-14T11:10:01.392 INFO:teuthology.orchestra.run.smithi097.stderr: 25500K .......... .......... .......... .......... .......... 27% 163M 0s 2024-09-14T11:10:01.392 INFO:teuthology.orchestra.run.smithi097.stderr: 25550K .......... .......... .......... .......... .......... 27% 259M 0s 2024-09-14T11:10:01.392 INFO:teuthology.orchestra.run.smithi097.stderr: 25600K .......... .......... .......... .......... .......... 27% 260M 0s 2024-09-14T11:10:01.392 INFO:teuthology.orchestra.run.smithi097.stderr: 25650K .......... .......... .......... .......... .......... 27% 288M 0s 2024-09-14T11:10:01.392 INFO:teuthology.orchestra.run.smithi097.stderr: 25700K .......... .......... .......... .......... .......... 27% 272M 0s 2024-09-14T11:10:01.392 INFO:teuthology.orchestra.run.smithi097.stderr: 25750K .......... .......... .......... .......... .......... 27% 278M 0s 2024-09-14T11:10:01.392 INFO:teuthology.orchestra.run.smithi097.stderr: 25800K .......... .......... .......... .......... .......... 27% 236M 0s 2024-09-14T11:10:01.392 INFO:teuthology.orchestra.run.smithi097.stderr: 25850K .......... .......... .......... .......... .......... 27% 294M 0s 2024-09-14T11:10:01.392 INFO:teuthology.orchestra.run.smithi097.stderr: 25900K .......... .......... .......... .......... .......... 27% 282M 0s 2024-09-14T11:10:01.392 INFO:teuthology.orchestra.run.smithi097.stderr: 25950K .......... .......... .......... .......... .......... 27% 290M 0s 2024-09-14T11:10:01.392 INFO:teuthology.orchestra.run.smithi097.stderr: 26000K .......... .......... .......... .......... .......... 28% 266M 0s 2024-09-14T11:10:01.393 INFO:teuthology.orchestra.run.smithi097.stderr: 26050K .......... .......... .......... .......... .......... 28% 238M 0s 2024-09-14T11:10:01.393 INFO:teuthology.orchestra.run.smithi097.stderr: 26100K .......... .......... .......... .......... .......... 28% 294M 0s 2024-09-14T11:10:01.393 INFO:teuthology.orchestra.run.smithi097.stderr: 26150K .......... .......... .......... .......... .......... 28% 245M 0s 2024-09-14T11:10:01.393 INFO:teuthology.orchestra.run.smithi097.stderr: 26200K .......... .......... .......... .......... .......... 28% 290M 0s 2024-09-14T11:10:01.393 INFO:teuthology.orchestra.run.smithi097.stderr: 26250K .......... .......... .......... .......... .......... 28% 256M 0s 2024-09-14T11:10:01.393 INFO:teuthology.orchestra.run.smithi097.stderr: 26300K .......... .......... .......... .......... .......... 28% 295M 0s 2024-09-14T11:10:01.393 INFO:teuthology.orchestra.run.smithi097.stderr: 26350K .......... .......... .......... .......... .......... 28% 287M 0s 2024-09-14T11:10:01.393 INFO:teuthology.orchestra.run.smithi097.stderr: 26400K .......... .......... .......... .......... .......... 28% 291M 0s 2024-09-14T11:10:01.393 INFO:teuthology.orchestra.run.smithi097.stderr: 26450K .......... .......... .......... .......... .......... 28% 244M 0s 2024-09-14T11:10:01.393 INFO:teuthology.orchestra.run.smithi097.stderr: 26500K .......... .......... .......... .......... .......... 28% 288M 0s 2024-09-14T11:10:01.393 INFO:teuthology.orchestra.run.smithi097.stderr: 26550K .......... .......... .......... .......... .......... 28% 270M 0s 2024-09-14T11:10:01.393 INFO:teuthology.orchestra.run.smithi097.stderr: 26600K .......... .......... .......... .......... .......... 28% 293M 0s 2024-09-14T11:10:01.393 INFO:teuthology.orchestra.run.smithi097.stderr: 26650K .......... .......... .......... .......... .......... 28% 286M 0s 2024-09-14T11:10:01.394 INFO:teuthology.orchestra.run.smithi097.stderr: 26700K .......... .......... .......... .......... .......... 28% 286M 0s 2024-09-14T11:10:01.394 INFO:teuthology.orchestra.run.smithi097.stderr: 26750K .......... .......... .......... .......... .......... 28% 248M 0s 2024-09-14T11:10:01.394 INFO:teuthology.orchestra.run.smithi097.stderr: 26800K .......... .......... .......... .......... .......... 28% 289M 0s 2024-09-14T11:10:01.394 INFO:teuthology.orchestra.run.smithi097.stderr: 26850K .......... .......... .......... .......... .......... 28% 234M 0s 2024-09-14T11:10:01.394 INFO:teuthology.orchestra.run.smithi097.stderr: 26900K .......... .......... .......... .......... .......... 29% 284M 0s 2024-09-14T11:10:01.394 INFO:teuthology.orchestra.run.smithi097.stderr: 26950K .......... .......... .......... .......... .......... 29% 289M 0s 2024-09-14T11:10:01.394 INFO:teuthology.orchestra.run.smithi097.stderr: 27000K .......... .......... .......... .......... .......... 29% 293M 0s 2024-09-14T11:10:01.394 INFO:teuthology.orchestra.run.smithi097.stderr: 27050K .......... .......... .......... .......... .......... 29% 264M 0s 2024-09-14T11:10:01.394 INFO:teuthology.orchestra.run.smithi097.stderr: 27100K .......... .......... .......... .......... .......... 29% 275M 0s 2024-09-14T11:10:01.394 INFO:teuthology.orchestra.run.smithi097.stderr: 27150K .......... .......... .......... .......... .......... 29% 282M 0s 2024-09-14T11:10:01.394 INFO:teuthology.orchestra.run.smithi097.stderr: 27200K .......... .......... .......... .......... .......... 29% 288M 0s 2024-09-14T11:10:01.394 INFO:teuthology.orchestra.run.smithi097.stderr: 27250K .......... .......... .......... .......... .......... 29% 246M 0s 2024-09-14T11:10:01.394 INFO:teuthology.orchestra.run.smithi097.stderr: 27300K .......... .......... .......... .......... .......... 29% 282M 0s 2024-09-14T11:10:01.394 INFO:teuthology.orchestra.run.smithi097.stderr: 27350K .......... .......... .......... .......... .......... 29% 97.5M 0s 2024-09-14T11:10:01.395 INFO:teuthology.orchestra.run.smithi097.stderr: 27400K .......... .......... .......... .......... .......... 29% 290M 0s 2024-09-14T11:10:01.395 INFO:teuthology.orchestra.run.smithi097.stderr: 27450K .......... .......... .......... .......... .......... 29% 246M 0s 2024-09-14T11:10:01.395 INFO:teuthology.orchestra.run.smithi097.stderr: 27500K .......... .......... .......... .......... .......... 29% 199M 0s 2024-09-14T11:10:01.395 INFO:teuthology.orchestra.run.smithi097.stderr: 27550K .......... .......... .......... .......... .......... 29% 271M 0s 2024-09-14T11:10:01.395 INFO:teuthology.orchestra.run.smithi097.stderr: 27600K .......... .......... .......... .......... .......... 29% 295M 0s 2024-09-14T11:10:01.395 INFO:teuthology.orchestra.run.smithi097.stderr: 27650K .......... .......... .......... .......... .......... 29% 290M 0s 2024-09-14T11:10:01.395 INFO:teuthology.orchestra.run.smithi097.stderr: 27700K .......... .......... .......... .......... .......... 29% 259M 0s 2024-09-14T11:10:01.395 INFO:teuthology.orchestra.run.smithi097.stderr: 27750K .......... .......... .......... .......... .......... 29% 258M 0s 2024-09-14T11:10:01.395 INFO:teuthology.orchestra.run.smithi097.stderr: 27800K .......... .......... .......... .......... .......... 29% 283M 0s 2024-09-14T11:10:01.395 INFO:teuthology.orchestra.run.smithi097.stderr: 27850K .......... .......... .......... .......... .......... 30% 259M 0s 2024-09-14T11:10:01.395 INFO:teuthology.orchestra.run.smithi097.stderr: 27900K .......... .......... .......... .......... .......... 30% 247M 0s 2024-09-14T11:10:01.395 INFO:teuthology.orchestra.run.smithi097.stderr: 27950K .......... .......... .......... .......... .......... 30% 239M 0s 2024-09-14T11:10:01.395 INFO:teuthology.orchestra.run.smithi097.stderr: 28000K .......... .......... .......... .......... .......... 30% 190M 0s 2024-09-14T11:10:01.396 INFO:teuthology.orchestra.run.smithi097.stderr: 28050K .......... .......... .......... .......... .......... 30% 267M 0s 2024-09-14T11:10:01.396 INFO:teuthology.orchestra.run.smithi097.stderr: 28100K .......... .......... .......... .......... .......... 30% 286M 0s 2024-09-14T11:10:01.396 INFO:teuthology.orchestra.run.smithi097.stderr: 28150K .......... .......... .......... .......... .......... 30% 281M 0s 2024-09-14T11:10:01.396 INFO:teuthology.orchestra.run.smithi097.stderr: 28200K .......... .......... .......... .......... .......... 30% 70.8M 0s 2024-09-14T11:10:01.396 INFO:teuthology.orchestra.run.smithi097.stderr: 28250K .......... .......... .......... .......... .......... 30% 185M 0s 2024-09-14T11:10:01.396 INFO:teuthology.orchestra.run.smithi097.stderr: 28300K .......... .......... .......... .......... .......... 30% 118M 0s 2024-09-14T11:10:01.396 INFO:teuthology.orchestra.run.smithi097.stderr: 28350K .......... .......... .......... .......... .......... 30% 49.6M 0s 2024-09-14T11:10:01.396 INFO:teuthology.orchestra.run.smithi097.stderr: 28400K .......... .......... .......... .......... .......... 30% 248M 0s 2024-09-14T11:10:01.396 INFO:teuthology.orchestra.run.smithi097.stderr: 28450K .......... .......... .......... .......... .......... 30% 107M 0s 2024-09-14T11:10:01.396 INFO:teuthology.orchestra.run.smithi097.stderr: 28500K .......... .......... .......... .......... .......... 30% 137M 0s 2024-09-14T11:10:01.396 INFO:teuthology.orchestra.run.smithi097.stderr: 28550K .......... .......... .......... .......... .......... 30% 281M 0s 2024-09-14T11:10:01.396 INFO:teuthology.orchestra.run.smithi097.stderr: 28600K .......... .......... .......... .......... .......... 30% 286M 0s 2024-09-14T11:10:01.396 INFO:teuthology.orchestra.run.smithi097.stderr: 28650K .......... .......... .......... .......... .......... 30% 263M 0s 2024-09-14T11:10:01.397 INFO:teuthology.orchestra.run.smithi097.stderr: 28700K .......... .......... .......... .......... .......... 30% 166M 0s 2024-09-14T11:10:01.397 INFO:teuthology.orchestra.run.smithi097.stderr: 28750K .......... .......... .......... .......... .......... 31% 260M 0s 2024-09-14T11:10:01.397 INFO:teuthology.orchestra.run.smithi097.stderr: 28800K .......... .......... .......... .......... .......... 31% 288M 0s 2024-09-14T11:10:01.397 INFO:teuthology.orchestra.run.smithi097.stderr: 28850K .......... .......... .......... .......... .......... 31% 262M 0s 2024-09-14T11:10:01.397 INFO:teuthology.orchestra.run.smithi097.stderr: 28900K .......... .......... .......... .......... .......... 31% 231M 0s 2024-09-14T11:10:01.397 INFO:teuthology.orchestra.run.smithi097.stderr: 28950K .......... .......... .......... .......... .......... 31% 276M 0s 2024-09-14T11:10:01.397 INFO:teuthology.orchestra.run.smithi097.stderr: 29000K .......... .......... .......... .......... .......... 31% 264M 0s 2024-09-14T11:10:01.397 INFO:teuthology.orchestra.run.smithi097.stderr: 29050K .......... .......... .......... .......... .......... 31% 292M 0s 2024-09-14T11:10:01.397 INFO:teuthology.orchestra.run.smithi097.stderr: 29100K .......... .......... .......... .......... .......... 31% 255M 0s 2024-09-14T11:10:01.397 INFO:teuthology.orchestra.run.smithi097.stderr: 29150K .......... .......... .......... .......... .......... 31% 295M 0s 2024-09-14T11:10:01.397 INFO:teuthology.orchestra.run.smithi097.stderr: 29200K .......... .......... .......... .......... .......... 31% 289M 0s 2024-09-14T11:10:01.397 INFO:teuthology.orchestra.run.smithi097.stderr: 29250K .......... .......... .......... .......... .......... 31% 272M 0s 2024-09-14T11:10:01.397 INFO:teuthology.orchestra.run.smithi097.stderr: 29300K .......... .......... .......... .......... .......... 31% 296M 0s 2024-09-14T11:10:01.397 INFO:teuthology.orchestra.run.smithi097.stderr: 29350K .......... .......... .......... .......... .......... 31% 255M 0s 2024-09-14T11:10:01.398 INFO:teuthology.orchestra.run.smithi097.stderr: 29400K .......... .......... .......... .......... .......... 31% 282M 0s 2024-09-14T11:10:01.398 INFO:teuthology.orchestra.run.smithi097.stderr: 29450K .......... .......... .......... .......... .......... 31% 294M 0s 2024-09-14T11:10:01.398 INFO:teuthology.orchestra.run.smithi097.stderr: 29500K .......... .......... .......... .......... .......... 31% 298M 0s 2024-09-14T11:10:01.398 INFO:teuthology.orchestra.run.smithi097.stderr: 29550K .......... .......... .......... .......... .......... 31% 244M 0s 2024-09-14T11:10:01.398 INFO:teuthology.orchestra.run.smithi097.stderr: 29600K .......... .......... .......... .......... .......... 31% 263M 0s 2024-09-14T11:10:01.398 INFO:teuthology.orchestra.run.smithi097.stderr: 29650K .......... .......... .......... .......... .......... 31% 286M 0s 2024-09-14T11:10:01.398 INFO:teuthology.orchestra.run.smithi097.stderr: 29700K .......... .......... .......... .......... .......... 32% 269M 0s 2024-09-14T11:10:01.398 INFO:teuthology.orchestra.run.smithi097.stderr: 29750K .......... .......... .......... .......... .......... 32% 387M 0s 2024-09-14T11:10:01.398 INFO:teuthology.orchestra.run.smithi097.stderr: 29800K .......... .......... .......... .......... .......... 32% 421M 0s 2024-09-14T11:10:01.398 INFO:teuthology.orchestra.run.smithi097.stderr: 29850K .......... .......... .......... .......... .......... 32% 209M 0s 2024-09-14T11:10:01.398 INFO:teuthology.orchestra.run.smithi097.stderr: 29900K .......... .......... .......... .......... .......... 32% 134M 0s 2024-09-14T11:10:01.398 INFO:teuthology.orchestra.run.smithi097.stderr: 29950K .......... .......... .......... .......... .......... 32% 288M 0s 2024-09-14T11:10:01.398 INFO:teuthology.orchestra.run.smithi097.stderr: 30000K .......... .......... .......... .......... .......... 32% 261M 0s 2024-09-14T11:10:01.399 INFO:teuthology.orchestra.run.smithi097.stderr: 30050K .......... .......... .......... .......... .......... 32% 69.1M 0s 2024-09-14T11:10:01.399 INFO:teuthology.orchestra.run.smithi097.stderr: 30100K .......... .......... .......... .......... .......... 32% 410M 0s 2024-09-14T11:10:01.399 INFO:teuthology.orchestra.run.smithi097.stderr: 30150K .......... .......... .......... .......... .......... 32% 161M 0s 2024-09-14T11:10:01.399 INFO:teuthology.orchestra.run.smithi097.stderr: 30200K .......... .......... .......... .......... .......... 32% 424M 0s 2024-09-14T11:10:01.399 INFO:teuthology.orchestra.run.smithi097.stderr: 30250K .......... .......... .......... .......... .......... 32% 358M 0s 2024-09-14T11:10:01.399 INFO:teuthology.orchestra.run.smithi097.stderr: 30300K .......... .......... .......... .......... .......... 32% 126M 0s 2024-09-14T11:10:01.399 INFO:teuthology.orchestra.run.smithi097.stderr: 30350K .......... .......... .......... .......... .......... 32% 396M 0s 2024-09-14T11:10:01.399 INFO:teuthology.orchestra.run.smithi097.stderr: 30400K .......... .......... .......... .......... .......... 32% 103M 0s 2024-09-14T11:10:01.399 INFO:teuthology.orchestra.run.smithi097.stderr: 30450K .......... .......... .......... .......... .......... 32% 161M 0s 2024-09-14T11:10:01.399 INFO:teuthology.orchestra.run.smithi097.stderr: 30500K .......... .......... .......... .......... .......... 32% 375M 0s 2024-09-14T11:10:01.399 INFO:teuthology.orchestra.run.smithi097.stderr: 30550K .......... .......... .......... .......... .......... 32% 140M 0s 2024-09-14T11:10:01.399 INFO:teuthology.orchestra.run.smithi097.stderr: 30600K .......... .......... .......... .......... .......... 32% 138M 0s 2024-09-14T11:10:01.399 INFO:teuthology.orchestra.run.smithi097.stderr: 30650K .......... .......... .......... .......... .......... 33% 89.3M 0s 2024-09-14T11:10:01.399 INFO:teuthology.orchestra.run.smithi097.stderr: 30700K .......... .......... .......... .......... .......... 33% 386M 0s 2024-09-14T11:10:01.400 INFO:teuthology.orchestra.run.smithi097.stderr: 30750K .......... .......... .......... .......... .......... 33% 101M 0s 2024-09-14T11:10:01.400 INFO:teuthology.orchestra.run.smithi097.stderr: 30800K .......... .......... .......... .......... .......... 33% 167M 0s 2024-09-14T11:10:01.400 INFO:teuthology.orchestra.run.smithi097.stderr: 30850K .......... .......... .......... .......... .......... 33% 69.4M 0s 2024-09-14T11:10:01.400 INFO:teuthology.orchestra.run.smithi097.stderr: 30900K .......... .......... .......... .......... .......... 33% 412M 0s 2024-09-14T11:10:01.400 INFO:teuthology.orchestra.run.smithi097.stderr: 30950K .......... .......... .......... .......... .......... 33% 452M 0s 2024-09-14T11:10:01.400 INFO:teuthology.orchestra.run.smithi097.stderr: 31000K .......... .......... .......... .......... .......... 33% 298M 0s 2024-09-14T11:10:01.400 INFO:teuthology.orchestra.run.smithi097.stderr: 31050K .......... .......... .......... .......... .......... 33% 244M 0s 2024-09-14T11:10:01.400 INFO:teuthology.orchestra.run.smithi097.stderr: 31100K .......... .......... .......... .......... .......... 33% 214M 0s 2024-09-14T11:10:01.400 INFO:teuthology.orchestra.run.smithi097.stderr: 31150K .......... .......... .......... .......... .......... 33% 335M 0s 2024-09-14T11:10:01.400 INFO:teuthology.orchestra.run.smithi097.stderr: 31200K .......... .......... .......... .......... .......... 33% 330M 0s 2024-09-14T11:10:01.400 INFO:teuthology.orchestra.run.smithi097.stderr: 31250K .......... .......... .......... .......... .......... 33% 50.8M 0s 2024-09-14T11:10:01.400 INFO:teuthology.orchestra.run.smithi097.stderr: 31300K .......... .......... .......... .......... .......... 33% 93.5M 0s 2024-09-14T11:10:01.400 INFO:teuthology.orchestra.run.smithi097.stderr: 31350K .......... .......... .......... .......... .......... 33% 88.0M 0s 2024-09-14T11:10:01.400 INFO:teuthology.orchestra.run.smithi097.stderr: 31400K .......... .......... .......... .......... .......... 33% 400M 0s 2024-09-14T11:10:01.401 INFO:teuthology.orchestra.run.smithi097.stderr: 31450K .......... .......... .......... .......... .......... 33% 69.3M 0s 2024-09-14T11:10:01.401 INFO:teuthology.orchestra.run.smithi097.stderr: 31500K .......... .......... .......... .......... .......... 33% 152M 0s 2024-09-14T11:10:01.401 INFO:teuthology.orchestra.run.smithi097.stderr: 31550K .......... .......... .......... .......... .......... 34% 158M 0s 2024-09-14T11:10:01.401 INFO:teuthology.orchestra.run.smithi097.stderr: 31600K .......... .......... .......... .......... .......... 34% 97.4M 0s 2024-09-14T11:10:01.401 INFO:teuthology.orchestra.run.smithi097.stderr: 31650K .......... .......... .......... .......... .......... 34% 373M 0s 2024-09-14T11:10:01.401 INFO:teuthology.orchestra.run.smithi097.stderr: 31700K .......... .......... .......... .......... .......... 34% 455M 0s 2024-09-14T11:10:01.401 INFO:teuthology.orchestra.run.smithi097.stderr: 31750K .......... .......... .......... .......... .......... 34% 293M 0s 2024-09-14T11:10:01.401 INFO:teuthology.orchestra.run.smithi097.stderr: 31800K .......... .......... .......... .......... .......... 34% 357M 0s 2024-09-14T11:10:01.401 INFO:teuthology.orchestra.run.smithi097.stderr: 31850K .......... .......... .......... .......... .......... 34% 380M 0s 2024-09-14T11:10:01.401 INFO:teuthology.orchestra.run.smithi097.stderr: 31900K .......... .......... .......... .......... .......... 34% 274M 0s 2024-09-14T11:10:01.401 INFO:teuthology.orchestra.run.smithi097.stderr: 31950K .......... .......... .......... .......... .......... 34% 319M 0s 2024-09-14T11:10:01.401 INFO:teuthology.orchestra.run.smithi097.stderr: 32000K .......... .......... .......... .......... .......... 34% 214M 0s 2024-09-14T11:10:01.401 INFO:teuthology.orchestra.run.smithi097.stderr: 32050K .......... .......... .......... .......... .......... 34% 427M 0s 2024-09-14T11:10:01.401 INFO:teuthology.orchestra.run.smithi097.stderr: 32100K .......... .......... .......... .......... .......... 34% 172M 0s 2024-09-14T11:10:01.402 INFO:teuthology.orchestra.run.smithi097.stderr: 32150K .......... .......... .......... .......... .......... 34% 386M 0s 2024-09-14T11:10:01.402 INFO:teuthology.orchestra.run.smithi097.stderr: 32200K .......... .......... .......... .......... .......... 34% 231M 0s 2024-09-14T11:10:01.402 INFO:teuthology.orchestra.run.smithi097.stderr: 32250K .......... .......... .......... .......... .......... 34% 340M 0s 2024-09-14T11:10:01.402 INFO:teuthology.orchestra.run.smithi097.stderr: 32300K .......... .......... .......... .......... .......... 34% 103M 0s 2024-09-14T11:10:01.402 INFO:teuthology.orchestra.run.smithi097.stderr: 32350K .......... .......... .......... .......... .......... 34% 431M 0s 2024-09-14T11:10:01.402 INFO:teuthology.orchestra.run.smithi097.stderr: 32400K .......... .......... .......... .......... .......... 34% 446M 0s 2024-09-14T11:10:01.402 INFO:teuthology.orchestra.run.smithi097.stderr: 32450K .......... .......... .......... .......... .......... 34% 147M 0s 2024-09-14T11:10:01.402 INFO:teuthology.orchestra.run.smithi097.stderr: 32500K .......... .......... .......... .......... .......... 35% 195M 0s 2024-09-14T11:10:01.402 INFO:teuthology.orchestra.run.smithi097.stderr: 32550K .......... .......... .......... .......... .......... 35% 332M 0s 2024-09-14T11:10:01.402 INFO:teuthology.orchestra.run.smithi097.stderr: 32600K .......... .......... .......... .......... .......... 35% 282M 0s 2024-09-14T11:10:01.402 INFO:teuthology.orchestra.run.smithi097.stderr: 32650K .......... .......... .......... .......... .......... 35% 245M 0s 2024-09-14T11:10:01.402 INFO:teuthology.orchestra.run.smithi097.stderr: 32700K .......... .......... .......... .......... .......... 35% 231M 0s 2024-09-14T11:10:01.402 INFO:teuthology.orchestra.run.smithi097.stderr: 32750K .......... .......... .......... .......... .......... 35% 207M 0s 2024-09-14T11:10:01.402 INFO:teuthology.orchestra.run.smithi097.stderr: 32800K .......... .......... .......... .......... .......... 35% 207M 0s 2024-09-14T11:10:01.403 INFO:teuthology.orchestra.run.smithi097.stderr: 32850K .......... .......... .......... .......... .......... 35% 413M 0s 2024-09-14T11:10:01.403 INFO:teuthology.orchestra.run.smithi097.stderr: 32900K .......... .......... .......... .......... .......... 35% 339M 0s 2024-09-14T11:10:01.403 INFO:teuthology.orchestra.run.smithi097.stderr: 32950K .......... .......... .......... .......... .......... 35% 128M 0s 2024-09-14T11:10:01.403 INFO:teuthology.orchestra.run.smithi097.stderr: 33000K .......... .......... .......... .......... .......... 35% 390M 0s 2024-09-14T11:10:01.403 INFO:teuthology.orchestra.run.smithi097.stderr: 33050K .......... .......... .......... .......... .......... 35% 449M 0s 2024-09-14T11:10:01.403 INFO:teuthology.orchestra.run.smithi097.stderr: 33100K .......... .......... .......... .......... .......... 35% 105M 0s 2024-09-14T11:10:01.403 INFO:teuthology.orchestra.run.smithi097.stderr: 33150K .......... .......... .......... .......... .......... 35% 276M 0s 2024-09-14T11:10:01.403 INFO:teuthology.orchestra.run.smithi097.stderr: 33200K .......... .......... .......... .......... .......... 35% 421M 0s 2024-09-14T11:10:01.403 INFO:teuthology.orchestra.run.smithi097.stderr: 33250K .......... .......... .......... .......... .......... 35% 413M 0s 2024-09-14T11:10:01.403 INFO:teuthology.orchestra.run.smithi097.stderr: 33300K .......... .......... .......... .......... .......... 35% 400M 0s 2024-09-14T11:10:01.403 INFO:teuthology.orchestra.run.smithi097.stderr: 33350K .......... .......... .......... .......... .......... 35% 206M 0s 2024-09-14T11:10:01.403 INFO:teuthology.orchestra.run.smithi097.stderr: 33400K .......... .......... .......... .......... .......... 36% 144M 0s 2024-09-14T11:10:01.403 INFO:teuthology.orchestra.run.smithi097.stderr: 33450K .......... .......... .......... .......... .......... 36% 252M 0s 2024-09-14T11:10:01.403 INFO:teuthology.orchestra.run.smithi097.stderr: 33500K .......... .......... .......... .......... .......... 36% 106M 0s 2024-09-14T11:10:01.404 INFO:teuthology.orchestra.run.smithi097.stderr: 33550K .......... .......... .......... .......... .......... 36% 433M 0s 2024-09-14T11:10:01.404 INFO:teuthology.orchestra.run.smithi097.stderr: 33600K .......... .......... .......... .......... .......... 36% 124M 0s 2024-09-14T11:10:01.404 INFO:teuthology.orchestra.run.smithi097.stderr: 33650K .......... .......... .......... .......... .......... 36% 176M 0s 2024-09-14T11:10:01.404 INFO:teuthology.orchestra.run.smithi097.stderr: 33700K .......... .......... .......... .......... .......... 36% 196M 0s 2024-09-14T11:10:01.404 INFO:teuthology.orchestra.run.smithi097.stderr: 33750K .......... .......... .......... .......... .......... 36% 360M 0s 2024-09-14T11:10:01.404 INFO:teuthology.orchestra.run.smithi097.stderr: 33800K .......... .......... .......... .......... .......... 36% 92.4M 0s 2024-09-14T11:10:01.404 INFO:teuthology.orchestra.run.smithi097.stderr: 33850K .......... .......... .......... .......... .......... 36% 84.7M 0s 2024-09-14T11:10:01.404 INFO:teuthology.orchestra.run.smithi097.stderr: 33900K .......... .......... .......... .......... .......... 36% 83.8M 0s 2024-09-14T11:10:01.404 INFO:teuthology.orchestra.run.smithi097.stderr: 33950K .......... .......... .......... .......... .......... 36% 185M 0s 2024-09-14T11:10:01.404 INFO:teuthology.orchestra.run.smithi097.stderr: 34000K .......... .......... .......... .......... .......... 36% 229M 0s 2024-09-14T11:10:01.404 INFO:teuthology.orchestra.run.smithi097.stderr: 34050K .......... .......... .......... .......... .......... 36% 240M 0s 2024-09-14T11:10:01.404 INFO:teuthology.orchestra.run.smithi097.stderr: 34100K .......... .......... .......... .......... .......... 36% 376M 0s 2024-09-14T11:10:01.404 INFO:teuthology.orchestra.run.smithi097.stderr: 34150K .......... .......... .......... .......... .......... 36% 281M 0s 2024-09-14T11:10:01.404 INFO:teuthology.orchestra.run.smithi097.stderr: 34200K .......... .......... .......... .......... .......... 36% 464M 0s 2024-09-14T11:10:01.405 INFO:teuthology.orchestra.run.smithi097.stderr: 34250K .......... .......... .......... .......... .......... 36% 173M 0s 2024-09-14T11:10:01.405 INFO:teuthology.orchestra.run.smithi097.stderr: 34300K .......... .......... .......... .......... .......... 36% 73.7M 0s 2024-09-14T11:10:01.405 INFO:teuthology.orchestra.run.smithi097.stderr: 34350K .......... .......... .......... .......... .......... 37% 66.3M 0s 2024-09-14T11:10:01.405 INFO:teuthology.orchestra.run.smithi097.stderr: 34400K .......... .......... .......... .......... .......... 37% 456M 0s 2024-09-14T11:10:01.405 INFO:teuthology.orchestra.run.smithi097.stderr: 34450K .......... .......... .......... .......... .......... 37% 96.1M 0s 2024-09-14T11:10:01.405 INFO:teuthology.orchestra.run.smithi097.stderr: 34500K .......... .......... .......... .......... .......... 37% 58.8M 0s 2024-09-14T11:10:01.405 INFO:teuthology.orchestra.run.smithi097.stderr: 34550K .......... .......... .......... .......... .......... 37% 258M 0s 2024-09-14T11:10:01.405 INFO:teuthology.orchestra.run.smithi097.stderr: 34600K .......... .......... .......... .......... .......... 37% 168M 0s 2024-09-14T11:10:01.405 INFO:teuthology.orchestra.run.smithi097.stderr: 34650K .......... .......... .......... .......... .......... 37% 199M 0s 2024-09-14T11:10:01.405 INFO:teuthology.orchestra.run.smithi097.stderr: 34700K .......... .......... .......... .......... .......... 37% 348M 0s 2024-09-14T11:10:01.405 INFO:teuthology.orchestra.run.smithi097.stderr: 34750K .......... .......... .......... .......... .......... 37% 142M 0s 2024-09-14T11:10:01.405 INFO:teuthology.orchestra.run.smithi097.stderr: 34800K .......... .......... .......... .......... .......... 37% 106M 0s 2024-09-14T11:10:01.405 INFO:teuthology.orchestra.run.smithi097.stderr: 34850K .......... .......... .......... .......... .......... 37% 443M 0s 2024-09-14T11:10:01.405 INFO:teuthology.orchestra.run.smithi097.stderr: 34900K .......... .......... .......... .......... .......... 37% 442M 0s 2024-09-14T11:10:01.406 INFO:teuthology.orchestra.run.smithi097.stderr: 34950K .......... .......... .......... .......... .......... 37% 389M 0s 2024-09-14T11:10:01.406 INFO:teuthology.orchestra.run.smithi097.stderr: 35000K .......... .......... .......... .......... .......... 37% 208M 0s 2024-09-14T11:10:01.406 INFO:teuthology.orchestra.run.smithi097.stderr: 35050K .......... .......... .......... .......... .......... 37% 400M 0s 2024-09-14T11:10:01.406 INFO:teuthology.orchestra.run.smithi097.stderr: 35100K .......... .......... .......... .......... .......... 37% 442M 0s 2024-09-14T11:10:01.406 INFO:teuthology.orchestra.run.smithi097.stderr: 35150K .......... .......... .......... .......... .......... 37% 219M 0s 2024-09-14T11:10:01.406 INFO:teuthology.orchestra.run.smithi097.stderr: 35200K .......... .......... .......... .......... .......... 37% 151M 0s 2024-09-14T11:10:01.406 INFO:teuthology.orchestra.run.smithi097.stderr: 35250K .......... .......... .......... .......... .......... 37% 413M 0s 2024-09-14T11:10:01.406 INFO:teuthology.orchestra.run.smithi097.stderr: 35300K .......... .......... .......... .......... .......... 38% 227M 0s 2024-09-14T11:10:01.406 INFO:teuthology.orchestra.run.smithi097.stderr: 35350K .......... .......... .......... .......... .......... 38% 428M 0s 2024-09-14T11:10:01.406 INFO:teuthology.orchestra.run.smithi097.stderr: 35400K .......... .......... .......... .......... .......... 38% 426M 0s 2024-09-14T11:10:01.406 INFO:teuthology.orchestra.run.smithi097.stderr: 35450K .......... .......... .......... .......... .......... 38% 147M 0s 2024-09-14T11:10:01.406 INFO:teuthology.orchestra.run.smithi097.stderr: 35500K .......... .......... .......... .......... .......... 38% 325M 0s 2024-09-14T11:10:01.406 INFO:teuthology.orchestra.run.smithi097.stderr: 35550K .......... .......... .......... .......... .......... 38% 156M 0s 2024-09-14T11:10:01.406 INFO:teuthology.orchestra.run.smithi097.stderr: 35600K .......... .......... .......... .......... .......... 38% 425M 0s 2024-09-14T11:10:01.406 INFO:teuthology.orchestra.run.smithi097.stderr: 35650K .......... .......... .......... .......... .......... 38% 424M 0s 2024-09-14T11:10:01.407 INFO:teuthology.orchestra.run.smithi097.stderr: 35700K .......... .......... .......... .......... .......... 38% 313M 0s 2024-09-14T11:10:01.407 INFO:teuthology.orchestra.run.smithi097.stderr: 35750K .......... .......... .......... .......... .......... 38% 428M 0s 2024-09-14T11:10:01.407 INFO:teuthology.orchestra.run.smithi097.stderr: 35800K .......... .......... .......... .......... .......... 38% 354M 0s 2024-09-14T11:10:01.407 INFO:teuthology.orchestra.run.smithi097.stderr: 35850K .......... .......... .......... .......... .......... 38% 393M 0s 2024-09-14T11:10:01.407 INFO:teuthology.orchestra.run.smithi097.stderr: 35900K .......... .......... .......... .......... .......... 38% 349M 0s 2024-09-14T11:10:01.407 INFO:teuthology.orchestra.run.smithi097.stderr: 35950K .......... .......... .......... .......... .......... 38% 195M 0s 2024-09-14T11:10:01.407 INFO:teuthology.orchestra.run.smithi097.stderr: 36000K .......... .......... .......... .......... .......... 38% 394M 0s 2024-09-14T11:10:01.407 INFO:teuthology.orchestra.run.smithi097.stderr: 36050K .......... .......... .......... .......... .......... 38% 357M 0s 2024-09-14T11:10:01.407 INFO:teuthology.orchestra.run.smithi097.stderr: 36100K .......... .......... .......... .......... .......... 38% 450M 0s 2024-09-14T11:10:01.407 INFO:teuthology.orchestra.run.smithi097.stderr: 36150K .......... .......... .......... .......... .......... 38% 220M 0s 2024-09-14T11:10:01.407 INFO:teuthology.orchestra.run.smithi097.stderr: 36200K .......... .......... .......... .......... .......... 39% 193M 0s 2024-09-14T11:10:01.407 INFO:teuthology.orchestra.run.smithi097.stderr: 36250K .......... .......... .......... .......... .......... 39% 295M 0s 2024-09-14T11:10:01.407 INFO:teuthology.orchestra.run.smithi097.stderr: 36300K .......... .......... .......... .......... .......... 39% 288M 0s 2024-09-14T11:10:01.407 INFO:teuthology.orchestra.run.smithi097.stderr: 36350K .......... .......... .......... .......... .......... 39% 401M 0s 2024-09-14T11:10:01.408 INFO:teuthology.orchestra.run.smithi097.stderr: 36400K .......... .......... .......... .......... .......... 39% 108M 0s 2024-09-14T11:10:01.408 INFO:teuthology.orchestra.run.smithi097.stderr: 36450K .......... .......... .......... .......... .......... 39% 354M 0s 2024-09-14T11:10:01.408 INFO:teuthology.orchestra.run.smithi097.stderr: 36500K .......... .......... .......... .......... .......... 39% 177M 0s 2024-09-14T11:10:01.408 INFO:teuthology.orchestra.run.smithi097.stderr: 36550K .......... .......... .......... .......... .......... 39% 422M 0s 2024-09-14T11:10:01.408 INFO:teuthology.orchestra.run.smithi097.stderr: 36600K .......... .......... .......... .......... .......... 39% 154M 0s 2024-09-14T11:10:01.408 INFO:teuthology.orchestra.run.smithi097.stderr: 36650K .......... .......... .......... .......... .......... 39% 223M 0s 2024-09-14T11:10:01.408 INFO:teuthology.orchestra.run.smithi097.stderr: 36700K .......... .......... .......... .......... .......... 39% 427M 0s 2024-09-14T11:10:01.408 INFO:teuthology.orchestra.run.smithi097.stderr: 36750K .......... .......... .......... .......... .......... 39% 443M 0s 2024-09-14T11:10:01.408 INFO:teuthology.orchestra.run.smithi097.stderr: 36800K .......... .......... .......... .......... .......... 39% 165M 0s 2024-09-14T11:10:01.408 INFO:teuthology.orchestra.run.smithi097.stderr: 36850K .......... .......... .......... .......... .......... 39% 178M 0s 2024-09-14T11:10:01.408 INFO:teuthology.orchestra.run.smithi097.stderr: 36900K .......... .......... .......... .......... .......... 39% 155M 0s 2024-09-14T11:10:01.408 INFO:teuthology.orchestra.run.smithi097.stderr: 36950K .......... .......... .......... .......... .......... 39% 135M 0s 2024-09-14T11:10:01.408 INFO:teuthology.orchestra.run.smithi097.stderr: 37000K .......... .......... .......... .......... .......... 39% 391M 0s 2024-09-14T11:10:01.408 INFO:teuthology.orchestra.run.smithi097.stderr: 37050K .......... .......... .......... .......... .......... 39% 155M 0s 2024-09-14T11:10:01.408 INFO:teuthology.orchestra.run.smithi097.stderr: 37100K .......... .......... .......... .......... .......... 39% 293M 0s 2024-09-14T11:10:01.409 INFO:teuthology.orchestra.run.smithi097.stderr: 37150K .......... .......... .......... .......... .......... 40% 231M 0s 2024-09-14T11:10:01.409 INFO:teuthology.orchestra.run.smithi097.stderr: 37200K .......... .......... .......... .......... .......... 40% 160M 0s 2024-09-14T11:10:01.409 INFO:teuthology.orchestra.run.smithi097.stderr: 37250K .......... .......... .......... .......... .......... 40% 436M 0s 2024-09-14T11:10:01.409 INFO:teuthology.orchestra.run.smithi097.stderr: 37300K .......... .......... .......... .......... .......... 40% 375M 0s 2024-09-14T11:10:01.409 INFO:teuthology.orchestra.run.smithi097.stderr: 37350K .......... .......... .......... .......... .......... 40% 111M 0s 2024-09-14T11:10:01.409 INFO:teuthology.orchestra.run.smithi097.stderr: 37400K .......... .......... .......... .......... .......... 40% 86.0M 0s 2024-09-14T11:10:01.409 INFO:teuthology.orchestra.run.smithi097.stderr: 37450K .......... .......... .......... .......... .......... 40% 422M 0s 2024-09-14T11:10:01.409 INFO:teuthology.orchestra.run.smithi097.stderr: 37500K .......... .......... .......... .......... .......... 40% 108M 0s 2024-09-14T11:10:01.409 INFO:teuthology.orchestra.run.smithi097.stderr: 37550K .......... .......... .......... .......... .......... 40% 63.9M 0s 2024-09-14T11:10:01.409 INFO:teuthology.orchestra.run.smithi097.stderr: 37600K .......... .......... .......... .......... .......... 40% 227M 0s 2024-09-14T11:10:01.409 INFO:teuthology.orchestra.run.smithi097.stderr: 37650K .......... .......... .......... .......... .......... 40% 81.4M 0s 2024-09-14T11:10:01.409 INFO:teuthology.orchestra.run.smithi097.stderr: 37700K .......... .......... .......... .......... .......... 40% 391M 0s 2024-09-14T11:10:01.409 INFO:teuthology.orchestra.run.smithi097.stderr: 37750K .......... .......... .......... .......... .......... 40% 119M 0s 2024-09-14T11:10:01.409 INFO:teuthology.orchestra.run.smithi097.stderr: 37800K .......... .......... .......... .......... .......... 40% 129M 0s 2024-09-14T11:10:01.409 INFO:teuthology.orchestra.run.smithi097.stderr: 37850K .......... .......... .......... .......... .......... 40% 119M 0s 2024-09-14T11:10:01.410 INFO:teuthology.orchestra.run.smithi097.stderr: 37900K .......... .......... .......... .......... .......... 40% 157M 0s 2024-09-14T11:10:01.410 INFO:teuthology.orchestra.run.smithi097.stderr: 37950K .......... .......... .......... .......... .......... 40% 365M 0s 2024-09-14T11:10:01.410 INFO:teuthology.orchestra.run.smithi097.stderr: 38000K .......... .......... .......... .......... .......... 40% 292M 0s 2024-09-14T11:10:01.410 INFO:teuthology.orchestra.run.smithi097.stderr: 38050K .......... .......... .......... .......... .......... 41% 432M 0s 2024-09-14T11:10:01.410 INFO:teuthology.orchestra.run.smithi097.stderr: 38100K .......... .......... .......... .......... .......... 41% 108M 0s 2024-09-14T11:10:01.410 INFO:teuthology.orchestra.run.smithi097.stderr: 38150K .......... .......... .......... .......... .......... 41% 438M 0s 2024-09-14T11:10:01.410 INFO:teuthology.orchestra.run.smithi097.stderr: 38200K .......... .......... .......... .......... .......... 41% 334M 0s 2024-09-14T11:10:01.410 INFO:teuthology.orchestra.run.smithi097.stderr: 38250K .......... .......... .......... .......... .......... 41% 146M 0s 2024-09-14T11:10:01.410 INFO:teuthology.orchestra.run.smithi097.stderr: 38300K .......... .......... .......... .......... .......... 41% 265M 0s 2024-09-14T11:10:01.410 INFO:teuthology.orchestra.run.smithi097.stderr: 38350K .......... .......... .......... .......... .......... 41% 291M 0s 2024-09-14T11:10:01.410 INFO:teuthology.orchestra.run.smithi097.stderr: 38400K .......... .......... .......... .......... .......... 41% 426M 0s 2024-09-14T11:10:01.410 INFO:teuthology.orchestra.run.smithi097.stderr: 38450K .......... .......... .......... .......... .......... 41% 359M 0s 2024-09-14T11:10:01.410 INFO:teuthology.orchestra.run.smithi097.stderr: 38500K .......... .......... .......... .......... .......... 41% 117M 0s 2024-09-14T11:10:01.410 INFO:teuthology.orchestra.run.smithi097.stderr: 38550K .......... .......... .......... .......... .......... 41% 148M 0s 2024-09-14T11:10:01.411 INFO:teuthology.orchestra.run.smithi097.stderr: 38600K .......... .......... .......... .......... .......... 41% 92.3M 0s 2024-09-14T11:10:01.411 INFO:teuthology.orchestra.run.smithi097.stderr: 38650K .......... .......... .......... .......... .......... 41% 389M 0s 2024-09-14T11:10:01.411 INFO:teuthology.orchestra.run.smithi097.stderr: 38700K .......... .......... .......... .......... .......... 41% 434M 0s 2024-09-14T11:10:01.411 INFO:teuthology.orchestra.run.smithi097.stderr: 38750K .......... .......... .......... .......... .......... 41% 430M 0s 2024-09-14T11:10:01.411 INFO:teuthology.orchestra.run.smithi097.stderr: 38800K .......... .......... .......... .......... .......... 41% 153M 0s 2024-09-14T11:10:01.411 INFO:teuthology.orchestra.run.smithi097.stderr: 38850K .......... .......... .......... .......... .......... 41% 234M 0s 2024-09-14T11:10:01.411 INFO:teuthology.orchestra.run.smithi097.stderr: 38900K .......... .......... .......... .......... .......... 41% 229M 0s 2024-09-14T11:10:01.411 INFO:teuthology.orchestra.run.smithi097.stderr: 38950K .......... .......... .......... .......... .......... 41% 390M 0s 2024-09-14T11:10:01.411 INFO:teuthology.orchestra.run.smithi097.stderr: 39000K .......... .......... .......... .......... .......... 42% 161M 0s 2024-09-14T11:10:01.411 INFO:teuthology.orchestra.run.smithi097.stderr: 39050K .......... .......... .......... .......... .......... 42% 134M 0s 2024-09-14T11:10:01.411 INFO:teuthology.orchestra.run.smithi097.stderr: 39100K .......... .......... .......... .......... .......... 42% 430M 0s 2024-09-14T11:10:01.411 INFO:teuthology.orchestra.run.smithi097.stderr: 39150K .......... .......... .......... .......... .......... 42% 88.1M 0s 2024-09-14T11:10:01.411 INFO:teuthology.orchestra.run.smithi097.stderr: 39200K .......... .......... .......... .......... .......... 42% 346M 0s 2024-09-14T11:10:01.412 INFO:teuthology.orchestra.run.smithi097.stderr: 39250K .......... .......... .......... .......... .......... 42% 84.9M 0s 2024-09-14T11:10:01.412 INFO:teuthology.orchestra.run.smithi097.stderr: 39300K .......... .......... .......... .......... .......... 42% 288M 0s 2024-09-14T11:10:01.412 INFO:teuthology.orchestra.run.smithi097.stderr: 39350K .......... .......... .......... .......... .......... 42% 442M 0s 2024-09-14T11:10:01.412 INFO:teuthology.orchestra.run.smithi097.stderr: 39400K .......... .......... .......... .......... .......... 42% 169M 0s 2024-09-14T11:10:01.412 INFO:teuthology.orchestra.run.smithi097.stderr: 39450K .......... .......... .......... .......... .......... 42% 264M 0s 2024-09-14T11:10:01.412 INFO:teuthology.orchestra.run.smithi097.stderr: 39500K .......... .......... .......... .......... .......... 42% 103M 0s 2024-09-14T11:10:01.412 INFO:teuthology.orchestra.run.smithi097.stderr: 39550K .......... .......... .......... .......... .......... 42% 268M 0s 2024-09-14T11:10:01.412 INFO:teuthology.orchestra.run.smithi097.stderr: 39600K .......... .......... .......... .......... .......... 42% 276M 0s 2024-09-14T11:10:01.412 INFO:teuthology.orchestra.run.smithi097.stderr: 39650K .......... .......... .......... .......... .......... 42% 219M 0s 2024-09-14T11:10:01.412 INFO:teuthology.orchestra.run.smithi097.stderr: 39700K .......... .......... .......... .......... .......... 42% 147M 0s 2024-09-14T11:10:01.412 INFO:teuthology.orchestra.run.smithi097.stderr: 39750K .......... .......... .......... .......... .......... 42% 112M 0s 2024-09-14T11:10:01.412 INFO:teuthology.orchestra.run.smithi097.stderr: 39800K .......... .......... .......... .......... .......... 42% 330M 0s 2024-09-14T11:10:01.412 INFO:teuthology.orchestra.run.smithi097.stderr: 39850K .......... .......... .......... .......... .......... 42% 141M 0s 2024-09-14T11:10:01.412 INFO:teuthology.orchestra.run.smithi097.stderr: 39900K .......... .......... .......... .......... .......... 43% 162M 0s 2024-09-14T11:10:01.412 INFO:teuthology.orchestra.run.smithi097.stderr: 39950K .......... .......... .......... .......... .......... 43% 183M 0s 2024-09-14T11:10:01.413 INFO:teuthology.orchestra.run.smithi097.stderr: 40000K .......... .......... .......... .......... .......... 43% 59.3M 0s 2024-09-14T11:10:01.413 INFO:teuthology.orchestra.run.smithi097.stderr: 40050K .......... .......... .......... .......... .......... 43% 347M 0s 2024-09-14T11:10:01.413 INFO:teuthology.orchestra.run.smithi097.stderr: 40100K .......... .......... .......... .......... .......... 43% 69.3M 0s 2024-09-14T11:10:01.413 INFO:teuthology.orchestra.run.smithi097.stderr: 40150K .......... .......... .......... .......... .......... 43% 118M 0s 2024-09-14T11:10:01.413 INFO:teuthology.orchestra.run.smithi097.stderr: 40200K .......... .......... .......... .......... .......... 43% 435M 0s 2024-09-14T11:10:01.413 INFO:teuthology.orchestra.run.smithi097.stderr: 40250K .......... .......... .......... .......... .......... 43% 320M 0s 2024-09-14T11:10:01.413 INFO:teuthology.orchestra.run.smithi097.stderr: 40300K .......... .......... .......... .......... .......... 43% 338M 0s 2024-09-14T11:10:01.413 INFO:teuthology.orchestra.run.smithi097.stderr: 40350K .......... .......... .......... .......... .......... 43% 183M 0s 2024-09-14T11:10:01.413 INFO:teuthology.orchestra.run.smithi097.stderr: 40400K .......... .......... .......... .......... .......... 43% 88.0M 0s 2024-09-14T11:10:01.413 INFO:teuthology.orchestra.run.smithi097.stderr: 40450K .......... .......... .......... .......... .......... 43% 57.6M 0s 2024-09-14T11:10:01.413 INFO:teuthology.orchestra.run.smithi097.stderr: 40500K .......... .......... .......... .......... .......... 43% 424M 0s 2024-09-14T11:10:01.413 INFO:teuthology.orchestra.run.smithi097.stderr: 40550K .......... .......... .......... .......... .......... 43% 70.5M 0s 2024-09-14T11:10:01.413 INFO:teuthology.orchestra.run.smithi097.stderr: 40600K .......... .......... .......... .......... .......... 43% 61.4M 0s 2024-09-14T11:10:01.414 INFO:teuthology.orchestra.run.smithi097.stderr: 40650K .......... .......... .......... .......... .......... 43% 223M 0s 2024-09-14T11:10:01.414 INFO:teuthology.orchestra.run.smithi097.stderr: 40700K .......... .......... .......... .......... .......... 43% 142M 0s 2024-09-14T11:10:01.414 INFO:teuthology.orchestra.run.smithi097.stderr: 40750K .......... .......... .......... .......... .......... 43% 306M 0s 2024-09-14T11:10:01.414 INFO:teuthology.orchestra.run.smithi097.stderr: 40800K .......... .......... .......... .......... .......... 43% 382M 0s 2024-09-14T11:10:01.414 INFO:teuthology.orchestra.run.smithi097.stderr: 40850K .......... .......... .......... .......... .......... 44% 111M 0s 2024-09-14T11:10:01.414 INFO:teuthology.orchestra.run.smithi097.stderr: 40900K .......... .......... .......... .......... .......... 44% 290M 0s 2024-09-14T11:10:01.414 INFO:teuthology.orchestra.run.smithi097.stderr: 40950K .......... .......... .......... .......... .......... 44% 153M 0s 2024-09-14T11:10:01.414 INFO:teuthology.orchestra.run.smithi097.stderr: 41000K .......... .......... .......... .......... .......... 44% 243M 0s 2024-09-14T11:10:01.414 INFO:teuthology.orchestra.run.smithi097.stderr: 41050K .......... .......... .......... .......... .......... 44% 476M 0s 2024-09-14T11:10:01.414 INFO:teuthology.orchestra.run.smithi097.stderr: 41100K .......... .......... .......... .......... .......... 44% 237M 0s 2024-09-14T11:10:01.414 INFO:teuthology.orchestra.run.smithi097.stderr: 41150K .......... .......... .......... .......... .......... 44% 482M 0s 2024-09-14T11:10:01.414 INFO:teuthology.orchestra.run.smithi097.stderr: 41200K .......... .......... .......... .......... .......... 44% 87.3M 0s 2024-09-14T11:10:01.414 INFO:teuthology.orchestra.run.smithi097.stderr: 41250K .......... .......... .......... .......... .......... 44% 228M 0s 2024-09-14T11:10:01.414 INFO:teuthology.orchestra.run.smithi097.stderr: 41300K .......... .......... .......... .......... .......... 44% 485M 0s 2024-09-14T11:10:01.414 INFO:teuthology.orchestra.run.smithi097.stderr: 41350K .......... .......... .......... .......... .......... 44% 297M 0s 2024-09-14T11:10:01.415 INFO:teuthology.orchestra.run.smithi097.stderr: 41400K .......... .......... .......... .......... .......... 44% 205M 0s 2024-09-14T11:10:01.415 INFO:teuthology.orchestra.run.smithi097.stderr: 41450K .......... .......... .......... .......... .......... 44% 461M 0s 2024-09-14T11:10:01.415 INFO:teuthology.orchestra.run.smithi097.stderr: 41500K .......... .......... .......... .......... .......... 44% 442M 0s 2024-09-14T11:10:01.415 INFO:teuthology.orchestra.run.smithi097.stderr: 41550K .......... .......... .......... .......... .......... 44% 65.1M 0s 2024-09-14T11:10:01.415 INFO:teuthology.orchestra.run.smithi097.stderr: 41600K .......... .......... .......... .......... .......... 44% 119M 0s 2024-09-14T11:10:01.415 INFO:teuthology.orchestra.run.smithi097.stderr: 41650K .......... .......... .......... .......... .......... 44% 405M 0s 2024-09-14T11:10:01.415 INFO:teuthology.orchestra.run.smithi097.stderr: 41700K .......... .......... .......... .......... .......... 44% 192M 0s 2024-09-14T11:10:01.415 INFO:teuthology.orchestra.run.smithi097.stderr: 41750K .......... .......... .......... .......... .......... 44% 292M 0s 2024-09-14T11:10:01.415 INFO:teuthology.orchestra.run.smithi097.stderr: 41800K .......... .......... .......... .......... .......... 45% 272M 0s 2024-09-14T11:10:01.415 INFO:teuthology.orchestra.run.smithi097.stderr: 41850K .......... .......... .......... .......... .......... 45% 380M 0s 2024-09-14T11:10:01.415 INFO:teuthology.orchestra.run.smithi097.stderr: 41900K .......... .......... .......... .......... .......... 45% 373M 0s 2024-09-14T11:10:01.415 INFO:teuthology.orchestra.run.smithi097.stderr: 41950K .......... .......... .......... .......... .......... 45% 302M 0s 2024-09-14T11:10:01.415 INFO:teuthology.orchestra.run.smithi097.stderr: 42000K .......... .......... .......... .......... .......... 45% 147M 0s 2024-09-14T11:10:01.415 INFO:teuthology.orchestra.run.smithi097.stderr: 42050K .......... .......... .......... .......... .......... 45% 426M 0s 2024-09-14T11:10:01.416 INFO:teuthology.orchestra.run.smithi097.stderr: 42100K .......... .......... .......... .......... .......... 45% 248M 0s 2024-09-14T11:10:01.416 INFO:teuthology.orchestra.run.smithi097.stderr: 42150K .......... .......... .......... .......... .......... 45% 273M 0s 2024-09-14T11:10:01.416 INFO:teuthology.orchestra.run.smithi097.stderr: 42200K .......... .......... .......... .......... .......... 45% 149M 0s 2024-09-14T11:10:01.416 INFO:teuthology.orchestra.run.smithi097.stderr: 42250K .......... .......... .......... .......... .......... 45% 250M 0s 2024-09-14T11:10:01.416 INFO:teuthology.orchestra.run.smithi097.stderr: 42300K .......... .......... .......... .......... .......... 45% 254M 0s 2024-09-14T11:10:01.416 INFO:teuthology.orchestra.run.smithi097.stderr: 42350K .......... .......... .......... .......... .......... 45% 313M 0s 2024-09-14T11:10:01.416 INFO:teuthology.orchestra.run.smithi097.stderr: 42400K .......... .......... .......... .......... .......... 45% 372M 0s 2024-09-14T11:10:01.416 INFO:teuthology.orchestra.run.smithi097.stderr: 42450K .......... .......... .......... .......... .......... 45% 321M 0s 2024-09-14T11:10:01.416 INFO:teuthology.orchestra.run.smithi097.stderr: 42500K .......... .......... .......... .......... .......... 45% 148M 0s 2024-09-14T11:10:01.416 INFO:teuthology.orchestra.run.smithi097.stderr: 42550K .......... .......... .......... .......... .......... 45% 192M 0s 2024-09-14T11:10:01.416 INFO:teuthology.orchestra.run.smithi097.stderr: 42600K .......... .......... .......... .......... .......... 45% 453M 0s 2024-09-14T11:10:01.416 INFO:teuthology.orchestra.run.smithi097.stderr: 42650K .......... .......... .......... .......... .......... 45% 230M 0s 2024-09-14T11:10:01.416 INFO:teuthology.orchestra.run.smithi097.stderr: 42700K .......... .......... .......... .......... .......... 46% 133M 0s 2024-09-14T11:10:01.416 INFO:teuthology.orchestra.run.smithi097.stderr: 42750K .......... .......... .......... .......... .......... 46% 229M 0s 2024-09-14T11:10:01.416 INFO:teuthology.orchestra.run.smithi097.stderr: 42800K .......... .......... .......... .......... .......... 46% 92.2M 0s 2024-09-14T11:10:01.417 INFO:teuthology.orchestra.run.smithi097.stderr: 42850K .......... .......... .......... .......... .......... 46% 419M 0s 2024-09-14T11:10:01.417 INFO:teuthology.orchestra.run.smithi097.stderr: 42900K .......... .......... .......... .......... .......... 46% 136M 0s 2024-09-14T11:10:01.417 INFO:teuthology.orchestra.run.smithi097.stderr: 42950K .......... .......... .......... .......... .......... 46% 86.2M 0s 2024-09-14T11:10:01.417 INFO:teuthology.orchestra.run.smithi097.stderr: 43000K .......... .......... .......... .......... .......... 46% 93.3M 0s 2024-09-14T11:10:01.417 INFO:teuthology.orchestra.run.smithi097.stderr: 43050K .......... .......... .......... .......... .......... 46% 59.5M 0s 2024-09-14T11:10:01.417 INFO:teuthology.orchestra.run.smithi097.stderr: 43100K .......... .......... .......... .......... .......... 46% 355M 0s 2024-09-14T11:10:01.417 INFO:teuthology.orchestra.run.smithi097.stderr: 43150K .......... .......... .......... .......... .......... 46% 64.6M 0s 2024-09-14T11:10:01.417 INFO:teuthology.orchestra.run.smithi097.stderr: 43200K .......... .......... .......... .......... .......... 46% 135M 0s 2024-09-14T11:10:01.417 INFO:teuthology.orchestra.run.smithi097.stderr: 43250K .......... .......... .......... .......... .......... 46% 97.8M 0s 2024-09-14T11:10:01.417 INFO:teuthology.orchestra.run.smithi097.stderr: 43300K .......... .......... .......... .......... .......... 46% 439M 0s 2024-09-14T11:10:01.417 INFO:teuthology.orchestra.run.smithi097.stderr: 43350K .......... .......... .......... .......... .......... 46% 336M 0s 2024-09-14T11:10:01.417 INFO:teuthology.orchestra.run.smithi097.stderr: 43400K .......... .......... .......... .......... .......... 46% 444M 0s 2024-09-14T11:10:01.417 INFO:teuthology.orchestra.run.smithi097.stderr: 43450K .......... .......... .......... .......... .......... 46% 160M 0s 2024-09-14T11:10:01.417 INFO:teuthology.orchestra.run.smithi097.stderr: 43500K .......... .......... .......... .......... .......... 46% 62.2M 0s 2024-09-14T11:10:01.417 INFO:teuthology.orchestra.run.smithi097.stderr: 43550K .......... .......... .......... .......... .......... 46% 424M 0s 2024-09-14T11:10:01.418 INFO:teuthology.orchestra.run.smithi097.stderr: 43600K .......... .......... .......... .......... .......... 46% 106M 0s 2024-09-14T11:10:01.418 INFO:teuthology.orchestra.run.smithi097.stderr: 43650K .......... .......... .......... .......... .......... 47% 80.9M 0s 2024-09-14T11:10:01.418 INFO:teuthology.orchestra.run.smithi097.stderr: 43700K .......... .......... .......... .......... .......... 47% 356M 0s 2024-09-14T11:10:01.418 INFO:teuthology.orchestra.run.smithi097.stderr: 43750K .......... .......... .......... .......... .......... 47% 401M 0s 2024-09-14T11:10:01.418 INFO:teuthology.orchestra.run.smithi097.stderr: 43800K .......... .......... .......... .......... .......... 47% 433M 0s 2024-09-14T11:10:01.418 INFO:teuthology.orchestra.run.smithi097.stderr: 43850K .......... .......... .......... .......... .......... 47% 347M 0s 2024-09-14T11:10:01.418 INFO:teuthology.orchestra.run.smithi097.stderr: 43900K .......... .......... .......... .......... .......... 47% 232M 0s 2024-09-14T11:10:01.418 INFO:teuthology.orchestra.run.smithi097.stderr: 43950K .......... .......... .......... .......... .......... 47% 258M 0s 2024-09-14T11:10:01.418 INFO:teuthology.orchestra.run.smithi097.stderr: 44000K .......... .......... .......... .......... .......... 47% 195M 0s 2024-09-14T11:10:01.418 INFO:teuthology.orchestra.run.smithi097.stderr: 44050K .......... .......... .......... .......... .......... 47% 212M 0s 2024-09-14T11:10:01.418 INFO:teuthology.orchestra.run.smithi097.stderr: 44100K .......... .......... .......... .......... .......... 47% 369M 0s 2024-09-14T11:10:01.418 INFO:teuthology.orchestra.run.smithi097.stderr: 44150K .......... .......... .......... .......... .......... 47% 222M 0s 2024-09-14T11:10:01.418 INFO:teuthology.orchestra.run.smithi097.stderr: 44200K .......... .......... .......... .......... .......... 47% 440M 0s 2024-09-14T11:10:01.418 INFO:teuthology.orchestra.run.smithi097.stderr: 44250K .......... .......... .......... .......... .......... 47% 439M 0s 2024-09-14T11:10:01.418 INFO:teuthology.orchestra.run.smithi097.stderr: 44300K .......... .......... .......... .......... .......... 47% 436M 0s 2024-09-14T11:10:01.419 INFO:teuthology.orchestra.run.smithi097.stderr: 44350K .......... .......... .......... .......... .......... 47% 382M 0s 2024-09-14T11:10:01.419 INFO:teuthology.orchestra.run.smithi097.stderr: 44400K .......... .......... .......... .......... .......... 47% 438M 0s 2024-09-14T11:10:01.419 INFO:teuthology.orchestra.run.smithi097.stderr: 44450K .......... .......... .......... .......... .......... 47% 442M 0s 2024-09-14T11:10:01.419 INFO:teuthology.orchestra.run.smithi097.stderr: 44500K .......... .......... .......... .......... .......... 47% 437M 0s 2024-09-14T11:10:01.419 INFO:teuthology.orchestra.run.smithi097.stderr: 44550K .......... .......... .......... .......... .......... 48% 383M 0s 2024-09-14T11:10:01.419 INFO:teuthology.orchestra.run.smithi097.stderr: 44600K .......... .......... .......... .......... .......... 48% 412M 0s 2024-09-14T11:10:01.419 INFO:teuthology.orchestra.run.smithi097.stderr: 44650K .......... .......... .......... .......... .......... 48% 354M 0s 2024-09-14T11:10:01.419 INFO:teuthology.orchestra.run.smithi097.stderr: 44700K .......... .......... .......... .......... .......... 48% 246M 0s 2024-09-14T11:10:01.419 INFO:teuthology.orchestra.run.smithi097.stderr: 44750K .......... .......... .......... .......... .......... 48% 406M 0s 2024-09-14T11:10:01.419 INFO:teuthology.orchestra.run.smithi097.stderr: 44800K .......... .......... .......... .......... .......... 48% 358M 0s 2024-09-14T11:10:01.419 INFO:teuthology.orchestra.run.smithi097.stderr: 44850K .......... .......... .......... .......... .......... 48% 354M 0s 2024-09-14T11:10:01.419 INFO:teuthology.orchestra.run.smithi097.stderr: 44900K .......... .......... .......... .......... .......... 48% 440M 0s 2024-09-14T11:10:01.419 INFO:teuthology.orchestra.run.smithi097.stderr: 44950K .......... .......... .......... .......... .......... 48% 436M 0s 2024-09-14T11:10:01.419 INFO:teuthology.orchestra.run.smithi097.stderr: 45000K .......... .......... .......... .......... .......... 48% 443M 0s 2024-09-14T11:10:01.420 INFO:teuthology.orchestra.run.smithi097.stderr: 45050K .......... .......... .......... .......... .......... 48% 358M 0s 2024-09-14T11:10:01.420 INFO:teuthology.orchestra.run.smithi097.stderr: 45100K .......... .......... .......... .......... .......... 48% 431M 0s 2024-09-14T11:10:01.420 INFO:teuthology.orchestra.run.smithi097.stderr: 45150K .......... .......... .......... .......... .......... 48% 422M 0s 2024-09-14T11:10:01.420 INFO:teuthology.orchestra.run.smithi097.stderr: 45200K .......... .......... .......... .......... .......... 48% 228M 0s 2024-09-14T11:10:01.420 INFO:teuthology.orchestra.run.smithi097.stderr: 45250K .......... .......... .......... .......... .......... 48% 350M 0s 2024-09-14T11:10:01.420 INFO:teuthology.orchestra.run.smithi097.stderr: 45300K .......... .......... .......... .......... .......... 48% 395M 0s 2024-09-14T11:10:01.420 INFO:teuthology.orchestra.run.smithi097.stderr: 45350K .......... .......... .......... .......... .......... 48% 427M 0s 2024-09-14T11:10:01.420 INFO:teuthology.orchestra.run.smithi097.stderr: 45400K .......... .......... .......... .......... .......... 48% 439M 0s 2024-09-14T11:10:01.420 INFO:teuthology.orchestra.run.smithi097.stderr: 45450K .......... .......... .......... .......... .......... 48% 218M 0s 2024-09-14T11:10:01.420 INFO:teuthology.orchestra.run.smithi097.stderr: 45500K .......... .......... .......... .......... .......... 49% 285M 0s 2024-09-14T11:10:01.420 INFO:teuthology.orchestra.run.smithi097.stderr: 45550K .......... .......... .......... .......... .......... 49% 291M 0s 2024-09-14T11:10:01.420 INFO:teuthology.orchestra.run.smithi097.stderr: 45600K .......... .......... .......... .......... .......... 49% 222M 0s 2024-09-14T11:10:01.420 INFO:teuthology.orchestra.run.smithi097.stderr: 45650K .......... .......... .......... .......... .......... 49% 374M 0s 2024-09-14T11:10:01.420 INFO:teuthology.orchestra.run.smithi097.stderr: 45700K .......... .......... .......... .......... .......... 49% 352M 0s 2024-09-14T11:10:01.421 INFO:teuthology.orchestra.run.smithi097.stderr: 45750K .......... .......... .......... .......... .......... 49% 402M 0s 2024-09-14T11:10:01.421 INFO:teuthology.orchestra.run.smithi097.stderr: 45800K .......... .......... .......... .......... .......... 49% 384M 0s 2024-09-14T11:10:01.421 INFO:teuthology.orchestra.run.smithi097.stderr: 45850K .......... .......... .......... .......... .......... 49% 346M 0s 2024-09-14T11:10:01.421 INFO:teuthology.orchestra.run.smithi097.stderr: 45900K .......... .......... .......... .......... .......... 49% 270M 0s 2024-09-14T11:10:01.421 INFO:teuthology.orchestra.run.smithi097.stderr: 45950K .......... .......... .......... .......... .......... 49% 370M 0s 2024-09-14T11:10:01.421 INFO:teuthology.orchestra.run.smithi097.stderr: 46000K .......... .......... .......... .......... .......... 49% 330M 0s 2024-09-14T11:10:01.421 INFO:teuthology.orchestra.run.smithi097.stderr: 46050K .......... .......... .......... .......... .......... 49% 80.4M 0s 2024-09-14T11:10:01.421 INFO:teuthology.orchestra.run.smithi097.stderr: 46100K .......... .......... .......... .......... .......... 49% 373M 0s 2024-09-14T11:10:01.421 INFO:teuthology.orchestra.run.smithi097.stderr: 46150K .......... .......... .......... .......... .......... 49% 108M 0s 2024-09-14T11:10:01.421 INFO:teuthology.orchestra.run.smithi097.stderr: 46200K .......... .......... .......... .......... .......... 49% 66.6M 0s 2024-09-14T11:10:01.421 INFO:teuthology.orchestra.run.smithi097.stderr: 46250K .......... .......... .......... .......... .......... 49% 120M 0s 2024-09-14T11:10:01.421 INFO:teuthology.orchestra.run.smithi097.stderr: 46300K .......... .......... .......... .......... .......... 49% 73.6M 0s 2024-09-14T11:10:01.421 INFO:teuthology.orchestra.run.smithi097.stderr: 46350K .......... .......... .......... .......... .......... 49% 366M 0s 2024-09-14T11:10:01.421 INFO:teuthology.orchestra.run.smithi097.stderr: 46400K .......... .......... .......... .......... .......... 49% 160M 0s 2024-09-14T11:10:01.422 INFO:teuthology.orchestra.run.smithi097.stderr: 46450K .......... .......... .......... .......... .......... 50% 267M 0s 2024-09-14T11:10:01.422 INFO:teuthology.orchestra.run.smithi097.stderr: 46500K .......... .......... .......... .......... .......... 50% 435M 0s 2024-09-14T11:10:01.422 INFO:teuthology.orchestra.run.smithi097.stderr: 46550K .......... .......... .......... .......... .......... 50% 416M 0s 2024-09-14T11:10:01.422 INFO:teuthology.orchestra.run.smithi097.stderr: 46600K .......... .......... .......... .......... .......... 50% 434M 0s 2024-09-14T11:10:01.422 INFO:teuthology.orchestra.run.smithi097.stderr: 46650K .......... .......... .......... .......... .......... 50% 149M 0s 2024-09-14T11:10:01.422 INFO:teuthology.orchestra.run.smithi097.stderr: 46700K .......... .......... .......... .......... .......... 50% 74.3M 0s 2024-09-14T11:10:01.422 INFO:teuthology.orchestra.run.smithi097.stderr: 46750K .......... .......... .......... .......... .......... 50% 235M 0s 2024-09-14T11:10:01.422 INFO:teuthology.orchestra.run.smithi097.stderr: 46800K .......... .......... .......... .......... .......... 50% 445M 0s 2024-09-14T11:10:01.422 INFO:teuthology.orchestra.run.smithi097.stderr: 46850K .......... .......... .......... .......... .......... 50% 338M 0s 2024-09-14T11:10:01.422 INFO:teuthology.orchestra.run.smithi097.stderr: 46900K .......... .......... .......... .......... .......... 50% 437M 0s 2024-09-14T11:10:01.422 INFO:teuthology.orchestra.run.smithi097.stderr: 46950K .......... .......... .......... .......... .......... 50% 449M 0s 2024-09-14T11:10:01.422 INFO:teuthology.orchestra.run.smithi097.stderr: 47000K .......... .......... .......... .......... .......... 50% 152M 0s 2024-09-14T11:10:01.422 INFO:teuthology.orchestra.run.smithi097.stderr: 47050K .......... .......... .......... .......... .......... 50% 413M 0s 2024-09-14T11:10:01.422 INFO:teuthology.orchestra.run.smithi097.stderr: 47100K .......... .......... .......... .......... .......... 50% 256M 0s 2024-09-14T11:10:01.423 INFO:teuthology.orchestra.run.smithi097.stderr: 47150K .......... .......... .......... .......... .......... 50% 173M 0s 2024-09-14T11:10:01.423 INFO:teuthology.orchestra.run.smithi097.stderr: 47200K .......... .......... .......... .......... .......... 50% 140M 0s 2024-09-14T11:10:01.423 INFO:teuthology.orchestra.run.smithi097.stderr: 47250K .......... .......... .......... .......... .......... 50% 248M 0s 2024-09-14T11:10:01.423 INFO:teuthology.orchestra.run.smithi097.stderr: 47300K .......... .......... .......... .......... .......... 50% 407M 0s 2024-09-14T11:10:01.423 INFO:teuthology.orchestra.run.smithi097.stderr: 47350K .......... .......... .......... .......... .......... 51% 226M 0s 2024-09-14T11:10:01.423 INFO:teuthology.orchestra.run.smithi097.stderr: 47400K .......... .......... .......... .......... .......... 51% 419M 0s 2024-09-14T11:10:01.423 INFO:teuthology.orchestra.run.smithi097.stderr: 47450K .......... .......... .......... .......... .......... 51% 368M 0s 2024-09-14T11:10:01.423 INFO:teuthology.orchestra.run.smithi097.stderr: 47500K .......... .......... .......... .......... .......... 51% 426M 0s 2024-09-14T11:10:01.423 INFO:teuthology.orchestra.run.smithi097.stderr: 47550K .......... .......... .......... .......... .......... 51% 443M 0s 2024-09-14T11:10:01.423 INFO:teuthology.orchestra.run.smithi097.stderr: 47600K .......... .......... .......... .......... .......... 51% 421M 0s 2024-09-14T11:10:01.423 INFO:teuthology.orchestra.run.smithi097.stderr: 47650K .......... .......... .......... .......... .......... 51% 366M 0s 2024-09-14T11:10:01.423 INFO:teuthology.orchestra.run.smithi097.stderr: 47700K .......... .......... .......... .......... .......... 51% 442M 0s 2024-09-14T11:10:01.423 INFO:teuthology.orchestra.run.smithi097.stderr: 47750K .......... .......... .......... .......... .......... 51% 388M 0s 2024-09-14T11:10:01.423 INFO:teuthology.orchestra.run.smithi097.stderr: 47800K .......... .......... .......... .......... .......... 51% 428M 0s 2024-09-14T11:10:01.423 INFO:teuthology.orchestra.run.smithi097.stderr: 47850K .......... .......... .......... .......... .......... 51% 414M 0s 2024-09-14T11:10:01.423 INFO:teuthology.orchestra.run.smithi097.stderr: 47900K .......... .......... .......... .......... .......... 51% 345M 0s 2024-09-14T11:10:01.424 INFO:teuthology.orchestra.run.smithi097.stderr: 47950K .......... .......... .......... .......... .......... 51% 448M 0s 2024-09-14T11:10:01.424 INFO:teuthology.orchestra.run.smithi097.stderr: 48000K .......... .......... .......... .......... .......... 51% 427M 0s 2024-09-14T11:10:01.424 INFO:teuthology.orchestra.run.smithi097.stderr: 48050K .......... .......... .......... .......... .......... 51% 427M 0s 2024-09-14T11:10:01.424 INFO:teuthology.orchestra.run.smithi097.stderr: 48100K .......... .......... .......... .......... .......... 51% 388M 0s 2024-09-14T11:10:01.424 INFO:teuthology.orchestra.run.smithi097.stderr: 48150K .......... .......... .......... .......... .......... 51% 429M 0s 2024-09-14T11:10:01.424 INFO:teuthology.orchestra.run.smithi097.stderr: 48200K .......... .......... .......... .......... .......... 51% 425M 0s 2024-09-14T11:10:01.424 INFO:teuthology.orchestra.run.smithi097.stderr: 48250K .......... .......... .......... .......... .......... 51% 443M 0s 2024-09-14T11:10:01.424 INFO:teuthology.orchestra.run.smithi097.stderr: 48300K .......... .......... .......... .......... .......... 52% 336M 0s 2024-09-14T11:10:01.424 INFO:teuthology.orchestra.run.smithi097.stderr: 48350K .......... .......... .......... .......... .......... 52% 178M 0s 2024-09-14T11:10:01.424 INFO:teuthology.orchestra.run.smithi097.stderr: 48400K .......... .......... .......... .......... .......... 52% 207M 0s 2024-09-14T11:10:01.424 INFO:teuthology.orchestra.run.smithi097.stderr: 48450K .......... .......... .......... .......... .......... 52% 424M 0s 2024-09-14T11:10:01.424 INFO:teuthology.orchestra.run.smithi097.stderr: 48500K .......... .......... .......... .......... .......... 52% 340M 0s 2024-09-14T11:10:01.424 INFO:teuthology.orchestra.run.smithi097.stderr: 48550K .......... .......... .......... .......... .......... 52% 191M 0s 2024-09-14T11:10:01.424 INFO:teuthology.orchestra.run.smithi097.stderr: 48600K .......... .......... .......... .......... .......... 52% 353M 0s 2024-09-14T11:10:01.424 INFO:teuthology.orchestra.run.smithi097.stderr: 48650K .......... .......... .......... .......... .......... 52% 112M 0s 2024-09-14T11:10:01.425 INFO:teuthology.orchestra.run.smithi097.stderr: 48700K .......... .......... .......... .......... .......... 52% 402M 0s 2024-09-14T11:10:01.425 INFO:teuthology.orchestra.run.smithi097.stderr: 48750K .......... .......... .......... .......... .......... 52% 182M 0s 2024-09-14T11:10:01.425 INFO:teuthology.orchestra.run.smithi097.stderr: 48800K .......... .......... .......... .......... .......... 52% 150M 0s 2024-09-14T11:10:01.425 INFO:teuthology.orchestra.run.smithi097.stderr: 48850K .......... .......... .......... .......... .......... 52% 421M 0s 2024-09-14T11:10:01.425 INFO:teuthology.orchestra.run.smithi097.stderr: 48900K .......... .......... .......... .......... .......... 52% 436M 0s 2024-09-14T11:10:01.425 INFO:teuthology.orchestra.run.smithi097.stderr: 48950K .......... .......... .......... .......... .......... 52% 203M 0s 2024-09-14T11:10:01.425 INFO:teuthology.orchestra.run.smithi097.stderr: 49000K .......... .......... .......... .......... .......... 52% 384M 0s 2024-09-14T11:10:01.425 INFO:teuthology.orchestra.run.smithi097.stderr: 49050K .......... .......... .......... .......... .......... 52% 288M 0s 2024-09-14T11:10:01.425 INFO:teuthology.orchestra.run.smithi097.stderr: 49100K .......... .......... .......... .......... .......... 52% 387M 0s 2024-09-14T11:10:01.425 INFO:teuthology.orchestra.run.smithi097.stderr: 49150K .......... .......... .......... .......... .......... 52% 395M 0s 2024-09-14T11:10:01.425 INFO:teuthology.orchestra.run.smithi097.stderr: 49200K .......... .......... .......... .......... .......... 53% 152M 0s 2024-09-14T11:10:01.425 INFO:teuthology.orchestra.run.smithi097.stderr: 49250K .......... .......... .......... .......... .......... 53% 179M 0s 2024-09-14T11:10:01.425 INFO:teuthology.orchestra.run.smithi097.stderr: 49300K .......... .......... .......... .......... .......... 53% 80.7M 0s 2024-09-14T11:10:01.425 INFO:teuthology.orchestra.run.smithi097.stderr: 49350K .......... .......... .......... .......... .......... 53% 76.3M 0s 2024-09-14T11:10:01.426 INFO:teuthology.orchestra.run.smithi097.stderr: 49400K .......... .......... .......... .......... .......... 53% 246M 0s 2024-09-14T11:10:01.426 INFO:teuthology.orchestra.run.smithi097.stderr: 49450K .......... .......... .......... .......... .......... 53% 357M 0s 2024-09-14T11:10:01.426 INFO:teuthology.orchestra.run.smithi097.stderr: 49500K .......... .......... .......... .......... .......... 53% 420M 0s 2024-09-14T11:10:01.426 INFO:teuthology.orchestra.run.smithi097.stderr: 49550K .......... .......... .......... .......... .......... 53% 221M 0s 2024-09-14T11:10:01.426 INFO:teuthology.orchestra.run.smithi097.stderr: 49600K .......... .......... .......... .......... .......... 53% 201M 0s 2024-09-14T11:10:01.426 INFO:teuthology.orchestra.run.smithi097.stderr: 49650K .......... .......... .......... .......... .......... 53% 411M 0s 2024-09-14T11:10:01.426 INFO:teuthology.orchestra.run.smithi097.stderr: 49700K .......... .......... .......... .......... .......... 53% 261M 0s 2024-09-14T11:10:01.426 INFO:teuthology.orchestra.run.smithi097.stderr: 49750K .......... .......... .......... .......... .......... 53% 90.3M 0s 2024-09-14T11:10:01.426 INFO:teuthology.orchestra.run.smithi097.stderr: 49800K .......... .......... .......... .......... .......... 53% 423M 0s 2024-09-14T11:10:01.426 INFO:teuthology.orchestra.run.smithi097.stderr: 49850K .......... .......... .......... .......... .......... 53% 224M 0s 2024-09-14T11:10:01.426 INFO:teuthology.orchestra.run.smithi097.stderr: 49900K .......... .......... .......... .......... .......... 53% 392M 0s 2024-09-14T11:10:01.426 INFO:teuthology.orchestra.run.smithi097.stderr: 49950K .......... .......... .......... .......... .......... 53% 372M 0s 2024-09-14T11:10:01.426 INFO:teuthology.orchestra.run.smithi097.stderr: 50000K .......... .......... .......... .......... .......... 53% 175M 0s 2024-09-14T11:10:01.426 INFO:teuthology.orchestra.run.smithi097.stderr: 50050K .......... .......... .......... .......... .......... 53% 266M 0s 2024-09-14T11:10:01.427 INFO:teuthology.orchestra.run.smithi097.stderr: 50100K .......... .......... .......... .......... .......... 53% 294M 0s 2024-09-14T11:10:01.427 INFO:teuthology.orchestra.run.smithi097.stderr: 50150K .......... .......... .......... .......... .......... 54% 364M 0s 2024-09-14T11:10:01.427 INFO:teuthology.orchestra.run.smithi097.stderr: 50200K .......... .......... .......... .......... .......... 54% 200M 0s 2024-09-14T11:10:01.427 INFO:teuthology.orchestra.run.smithi097.stderr: 50250K .......... .......... .......... .......... .......... 54% 101M 0s 2024-09-14T11:10:01.427 INFO:teuthology.orchestra.run.smithi097.stderr: 50300K .......... .......... .......... .......... .......... 54% 218M 0s 2024-09-14T11:10:01.427 INFO:teuthology.orchestra.run.smithi097.stderr: 50350K .......... .......... .......... .......... .......... 54% 163M 0s 2024-09-14T11:10:01.427 INFO:teuthology.orchestra.run.smithi097.stderr: 50400K .......... .......... .......... .......... .......... 54% 90.8M 0s 2024-09-14T11:10:01.427 INFO:teuthology.orchestra.run.smithi097.stderr: 50450K .......... .......... .......... .......... .......... 54% 273M 0s 2024-09-14T11:10:01.427 INFO:teuthology.orchestra.run.smithi097.stderr: 50500K .......... .......... .......... .......... .......... 54% 336M 0s 2024-09-14T11:10:01.427 INFO:teuthology.orchestra.run.smithi097.stderr: 50550K .......... .......... .......... .......... .......... 54% 356M 0s 2024-09-14T11:10:01.427 INFO:teuthology.orchestra.run.smithi097.stderr: 50600K .......... .......... .......... .......... .......... 54% 341M 0s 2024-09-14T11:10:01.427 INFO:teuthology.orchestra.run.smithi097.stderr: 50650K .......... .......... .......... .......... .......... 54% 401M 0s 2024-09-14T11:10:01.427 INFO:teuthology.orchestra.run.smithi097.stderr: 50700K .......... .......... .......... .......... .......... 54% 352M 0s 2024-09-14T11:10:01.427 INFO:teuthology.orchestra.run.smithi097.stderr: 50750K .......... .......... .......... .......... .......... 54% 340M 0s 2024-09-14T11:10:01.428 INFO:teuthology.orchestra.run.smithi097.stderr: 50800K .......... .......... .......... .......... .......... 54% 313M 0s 2024-09-14T11:10:01.428 INFO:teuthology.orchestra.run.smithi097.stderr: 50850K .......... .......... .......... .......... .......... 54% 348M 0s 2024-09-14T11:10:01.428 INFO:teuthology.orchestra.run.smithi097.stderr: 50900K .......... .......... .......... .......... .......... 54% 333M 0s 2024-09-14T11:10:01.428 INFO:teuthology.orchestra.run.smithi097.stderr: 50950K .......... .......... .......... .......... .......... 54% 280M 0s 2024-09-14T11:10:01.428 INFO:teuthology.orchestra.run.smithi097.stderr: 51000K .......... .......... .......... .......... .......... 54% 359M 0s 2024-09-14T11:10:01.428 INFO:teuthology.orchestra.run.smithi097.stderr: 51050K .......... .......... .......... .......... .......... 55% 337M 0s 2024-09-14T11:10:01.428 INFO:teuthology.orchestra.run.smithi097.stderr: 51100K .......... .......... .......... .......... .......... 55% 335M 0s 2024-09-14T11:10:01.428 INFO:teuthology.orchestra.run.smithi097.stderr: 51150K .......... .......... .......... .......... .......... 55% 387M 0s 2024-09-14T11:10:01.428 INFO:teuthology.orchestra.run.smithi097.stderr: 51200K .......... .......... .......... .......... .......... 55% 374M 0s 2024-09-14T11:10:01.428 INFO:teuthology.orchestra.run.smithi097.stderr: 51250K .......... .......... .......... .......... .......... 55% 387M 0s 2024-09-14T11:10:01.428 INFO:teuthology.orchestra.run.smithi097.stderr: 51300K .......... .......... .......... .......... .......... 55% 288M 0s 2024-09-14T11:10:01.428 INFO:teuthology.orchestra.run.smithi097.stderr: 51350K .......... .......... .......... .......... .......... 55% 384M 0s 2024-09-14T11:10:01.428 INFO:teuthology.orchestra.run.smithi097.stderr: 51400K .......... .......... .......... .......... .......... 55% 318M 0s 2024-09-14T11:10:01.428 INFO:teuthology.orchestra.run.smithi097.stderr: 51450K .......... .......... .......... .......... .......... 55% 361M 0s 2024-09-14T11:10:01.428 INFO:teuthology.orchestra.run.smithi097.stderr: 51500K .......... .......... .......... .......... .......... 55% 329M 0s 2024-09-14T11:10:01.429 INFO:teuthology.orchestra.run.smithi097.stderr: 51550K .......... .......... .......... .......... .......... 55% 361M 0s 2024-09-14T11:10:01.429 INFO:teuthology.orchestra.run.smithi097.stderr: 51600K .......... .......... .......... .......... .......... 55% 387M 0s 2024-09-14T11:10:01.429 INFO:teuthology.orchestra.run.smithi097.stderr: 51650K .......... .......... .......... .......... .......... 55% 357M 0s 2024-09-14T11:10:01.429 INFO:teuthology.orchestra.run.smithi097.stderr: 51700K .......... .......... .......... .......... .......... 55% 287M 0s 2024-09-14T11:10:01.429 INFO:teuthology.orchestra.run.smithi097.stderr: 51750K .......... .......... .......... .......... .......... 55% 333M 0s 2024-09-14T11:10:01.429 INFO:teuthology.orchestra.run.smithi097.stderr: 51800K .......... .......... .......... .......... .......... 55% 379M 0s 2024-09-14T11:10:01.429 INFO:teuthology.orchestra.run.smithi097.stderr: 51850K .......... .......... .......... .......... .......... 55% 346M 0s 2024-09-14T11:10:01.429 INFO:teuthology.orchestra.run.smithi097.stderr: 51900K .......... .......... .......... .......... .......... 55% 338M 0s 2024-09-14T11:10:01.429 INFO:teuthology.orchestra.run.smithi097.stderr: 51950K .......... .......... .......... .......... .......... 55% 383M 0s 2024-09-14T11:10:01.429 INFO:teuthology.orchestra.run.smithi097.stderr: 52000K .......... .......... .......... .......... .......... 56% 443M 0s 2024-09-14T11:10:01.429 INFO:teuthology.orchestra.run.smithi097.stderr: 52050K .......... .......... .......... .......... .......... 56% 316M 0s 2024-09-14T11:10:01.429 INFO:teuthology.orchestra.run.smithi097.stderr: 52100K .......... .......... .......... .......... .......... 56% 176M 0s 2024-09-14T11:10:01.429 INFO:teuthology.orchestra.run.smithi097.stderr: 52150K .......... .......... .......... .......... .......... 56% 219M 0s 2024-09-14T11:10:01.429 INFO:teuthology.orchestra.run.smithi097.stderr: 52200K .......... .......... .......... .......... .......... 56% 359M 0s 2024-09-14T11:10:01.430 INFO:teuthology.orchestra.run.smithi097.stderr: 52250K .......... .......... .......... .......... .......... 56% 401M 0s 2024-09-14T11:10:01.430 INFO:teuthology.orchestra.run.smithi097.stderr: 52300K .......... .......... .......... .......... .......... 56% 307M 0s 2024-09-14T11:10:01.430 INFO:teuthology.orchestra.run.smithi097.stderr: 52350K .......... .......... .......... .......... .......... 56% 116M 0s 2024-09-14T11:10:01.430 INFO:teuthology.orchestra.run.smithi097.stderr: 52400K .......... .......... .......... .......... .......... 56% 376M 0s 2024-09-14T11:10:01.430 INFO:teuthology.orchestra.run.smithi097.stderr: 52450K .......... .......... .......... .......... .......... 56% 65.2M 0s 2024-09-14T11:10:01.430 INFO:teuthology.orchestra.run.smithi097.stderr: 52500K .......... .......... .......... .......... .......... 56% 319M 0s 2024-09-14T11:10:01.430 INFO:teuthology.orchestra.run.smithi097.stderr: 52550K .......... .......... .......... .......... .......... 56% 248M 0s 2024-09-14T11:10:01.430 INFO:teuthology.orchestra.run.smithi097.stderr: 52600K .......... .......... .......... .......... .......... 56% 329M 0s 2024-09-14T11:10:01.430 INFO:teuthology.orchestra.run.smithi097.stderr: 52650K .......... .......... .......... .......... .......... 56% 391M 0s 2024-09-14T11:10:01.430 INFO:teuthology.orchestra.run.smithi097.stderr: 52700K .......... .......... .......... .......... .......... 56% 166M 0s 2024-09-14T11:10:01.430 INFO:teuthology.orchestra.run.smithi097.stderr: 52750K .......... .......... .......... .......... .......... 56% 120M 0s 2024-09-14T11:10:01.430 INFO:teuthology.orchestra.run.smithi097.stderr: 52800K .......... .......... .......... .......... .......... 56% 71.2M 0s 2024-09-14T11:10:01.430 INFO:teuthology.orchestra.run.smithi097.stderr: 52850K .......... .......... .......... .......... .......... 56% 372M 0s 2024-09-14T11:10:01.431 INFO:teuthology.orchestra.run.smithi097.stderr: 52900K .......... .......... .......... .......... .......... 56% 392M 0s 2024-09-14T11:10:01.431 INFO:teuthology.orchestra.run.smithi097.stderr: 52950K .......... .......... .......... .......... .......... 57% 376M 0s 2024-09-14T11:10:01.431 INFO:teuthology.orchestra.run.smithi097.stderr: 53000K .......... .......... .......... .......... .......... 57% 257M 0s 2024-09-14T11:10:01.431 INFO:teuthology.orchestra.run.smithi097.stderr: 53050K .......... .......... .......... .......... .......... 57% 336M 0s 2024-09-14T11:10:01.431 INFO:teuthology.orchestra.run.smithi097.stderr: 53100K .......... .......... .......... .......... .......... 57% 331M 0s 2024-09-14T11:10:01.431 INFO:teuthology.orchestra.run.smithi097.stderr: 53150K .......... .......... .......... .......... .......... 57% 326M 0s 2024-09-14T11:10:01.431 INFO:teuthology.orchestra.run.smithi097.stderr: 53200K .......... .......... .......... .......... .......... 57% 337M 0s 2024-09-14T11:10:01.431 INFO:teuthology.orchestra.run.smithi097.stderr: 53250K .......... .......... .......... .......... .......... 57% 314M 0s 2024-09-14T11:10:01.431 INFO:teuthology.orchestra.run.smithi097.stderr: 53300K .......... .......... .......... .......... .......... 57% 70.3M 0s 2024-09-14T11:10:01.431 INFO:teuthology.orchestra.run.smithi097.stderr: 53350K .......... .......... .......... .......... .......... 57% 349M 0s 2024-09-14T11:10:01.431 INFO:teuthology.orchestra.run.smithi097.stderr: 53400K .......... .......... .......... .......... .......... 57% 283M 0s 2024-09-14T11:10:01.431 INFO:teuthology.orchestra.run.smithi097.stderr: 53450K .......... .......... .......... .......... .......... 57% 113M 0s 2024-09-14T11:10:01.431 INFO:teuthology.orchestra.run.smithi097.stderr: 53500K .......... .......... .......... .......... .......... 57% 236M 0s 2024-09-14T11:10:01.432 INFO:teuthology.orchestra.run.smithi097.stderr: 53550K .......... .......... .......... .......... .......... 57% 149M 0s 2024-09-14T11:10:01.432 INFO:teuthology.orchestra.run.smithi097.stderr: 53600K .......... .......... .......... .......... .......... 57% 243M 0s 2024-09-14T11:10:01.432 INFO:teuthology.orchestra.run.smithi097.stderr: 53650K .......... .......... .......... .......... .......... 57% 317M 0s 2024-09-14T11:10:01.432 INFO:teuthology.orchestra.run.smithi097.stderr: 53700K .......... .......... .......... .......... .......... 57% 331M 0s 2024-09-14T11:10:01.432 INFO:teuthology.orchestra.run.smithi097.stderr: 53750K .......... .......... .......... .......... .......... 57% 128M 0s 2024-09-14T11:10:01.432 INFO:teuthology.orchestra.run.smithi097.stderr: 53800K .......... .......... .......... .......... .......... 57% 288M 0s 2024-09-14T11:10:01.432 INFO:teuthology.orchestra.run.smithi097.stderr: 53850K .......... .......... .......... .......... .......... 58% 371M 0s 2024-09-14T11:10:01.432 INFO:teuthology.orchestra.run.smithi097.stderr: 53900K .......... .......... .......... .......... .......... 58% 389M 0s 2024-09-14T11:10:01.432 INFO:teuthology.orchestra.run.smithi097.stderr: 53950K .......... .......... .......... .......... .......... 58% 258M 0s 2024-09-14T11:10:01.432 INFO:teuthology.orchestra.run.smithi097.stderr: 54000K .......... .......... .......... .......... .......... 58% 308M 0s 2024-09-14T11:10:01.432 INFO:teuthology.orchestra.run.smithi097.stderr: 54050K .......... .......... .......... .......... .......... 58% 390M 0s 2024-09-14T11:10:01.432 INFO:teuthology.orchestra.run.smithi097.stderr: 54100K .......... .......... .......... .......... .......... 58% 337M 0s 2024-09-14T11:10:01.432 INFO:teuthology.orchestra.run.smithi097.stderr: 54150K .......... .......... .......... .......... .......... 58% 332M 0s 2024-09-14T11:10:01.433 INFO:teuthology.orchestra.run.smithi097.stderr: 54200K .......... .......... .......... .......... .......... 58% 381M 0s 2024-09-14T11:10:01.433 INFO:teuthology.orchestra.run.smithi097.stderr: 54250K .......... .......... .......... .......... .......... 58% 375M 0s 2024-09-14T11:10:01.433 INFO:teuthology.orchestra.run.smithi097.stderr: 54300K .......... .......... .......... .......... .......... 58% 332M 0s 2024-09-14T11:10:01.433 INFO:teuthology.orchestra.run.smithi097.stderr: 54350K .......... .......... .......... .......... .......... 58% 359M 0s 2024-09-14T11:10:01.433 INFO:teuthology.orchestra.run.smithi097.stderr: 54400K .......... .......... .......... .......... .......... 58% 339M 0s 2024-09-14T11:10:01.433 INFO:teuthology.orchestra.run.smithi097.stderr: 54450K .......... .......... .......... .......... .......... 58% 324M 0s 2024-09-14T11:10:01.433 INFO:teuthology.orchestra.run.smithi097.stderr: 54500K .......... .......... .......... .......... .......... 58% 398M 0s 2024-09-14T11:10:01.433 INFO:teuthology.orchestra.run.smithi097.stderr: 54550K .......... .......... .......... .......... .......... 58% 373M 0s 2024-09-14T11:10:01.433 INFO:teuthology.orchestra.run.smithi097.stderr: 54600K .......... .......... .......... .......... .......... 58% 394M 0s 2024-09-14T11:10:01.433 INFO:teuthology.orchestra.run.smithi097.stderr: 54650K .......... .......... .......... .......... .......... 58% 260M 0s 2024-09-14T11:10:01.433 INFO:teuthology.orchestra.run.smithi097.stderr: 54700K .......... .......... .......... .......... .......... 58% 338M 0s 2024-09-14T11:10:01.433 INFO:teuthology.orchestra.run.smithi097.stderr: 54750K .......... .......... .......... .......... .......... 58% 313M 0s 2024-09-14T11:10:01.433 INFO:teuthology.orchestra.run.smithi097.stderr: 54800K .......... .......... .......... .......... .......... 59% 387M 0s 2024-09-14T11:10:01.433 INFO:teuthology.orchestra.run.smithi097.stderr: 54850K .......... .......... .......... .......... .......... 59% 338M 0s 2024-09-14T11:10:01.433 INFO:teuthology.orchestra.run.smithi097.stderr: 54900K .......... .......... .......... .......... .......... 59% 310M 0s 2024-09-14T11:10:01.434 INFO:teuthology.orchestra.run.smithi097.stderr: 54950K .......... .......... .......... .......... .......... 59% 358M 0s 2024-09-14T11:10:01.434 INFO:teuthology.orchestra.run.smithi097.stderr: 55000K .......... .......... .......... .......... .......... 59% 299M 0s 2024-09-14T11:10:01.434 INFO:teuthology.orchestra.run.smithi097.stderr: 55050K .......... .......... .......... .......... .......... 59% 290M 0s 2024-09-14T11:10:01.434 INFO:teuthology.orchestra.run.smithi097.stderr: 55100K .......... .......... .......... .......... .......... 59% 316M 0s 2024-09-14T11:10:01.434 INFO:teuthology.orchestra.run.smithi097.stderr: 55150K .......... .......... .......... .......... .......... 59% 406M 0s 2024-09-14T11:10:01.434 INFO:teuthology.orchestra.run.smithi097.stderr: 55200K .......... .......... .......... .......... .......... 59% 385M 0s 2024-09-14T11:10:01.434 INFO:teuthology.orchestra.run.smithi097.stderr: 55250K .......... .......... .......... .......... .......... 59% 375M 0s 2024-09-14T11:10:01.434 INFO:teuthology.orchestra.run.smithi097.stderr: 55300K .......... .......... .......... .......... .......... 59% 283M 0s 2024-09-14T11:10:01.434 INFO:teuthology.orchestra.run.smithi097.stderr: 55350K .......... .......... .......... .......... .......... 59% 357M 0s 2024-09-14T11:10:01.434 INFO:teuthology.orchestra.run.smithi097.stderr: 55400K .......... .......... .......... .......... .......... 59% 341M 0s 2024-09-14T11:10:01.434 INFO:teuthology.orchestra.run.smithi097.stderr: 55450K .......... .......... .......... .......... .......... 59% 396M 0s 2024-09-14T11:10:01.434 INFO:teuthology.orchestra.run.smithi097.stderr: 55500K .......... .......... .......... .......... .......... 59% 70.9M 0s 2024-09-14T11:10:01.434 INFO:teuthology.orchestra.run.smithi097.stderr: 55550K .......... .......... .......... .......... .......... 59% 362M 0s 2024-09-14T11:10:01.434 INFO:teuthology.orchestra.run.smithi097.stderr: 55600K .......... .......... .......... .......... .......... 59% 296M 0s 2024-09-14T11:10:01.434 INFO:teuthology.orchestra.run.smithi097.stderr: 55650K .......... .......... .......... .......... .......... 59% 377M 0s 2024-09-14T11:10:01.435 INFO:teuthology.orchestra.run.smithi097.stderr: 55700K .......... .......... .......... .......... .......... 60% 399M 0s 2024-09-14T11:10:01.435 INFO:teuthology.orchestra.run.smithi097.stderr: 55750K .......... .......... .......... .......... .......... 60% 196M 0s 2024-09-14T11:10:01.435 INFO:teuthology.orchestra.run.smithi097.stderr: 55800K .......... .......... .......... .......... .......... 60% 207M 0s 2024-09-14T11:10:01.435 INFO:teuthology.orchestra.run.smithi097.stderr: 55850K .......... .......... .......... .......... .......... 60% 55.5M 0s 2024-09-14T11:10:01.435 INFO:teuthology.orchestra.run.smithi097.stderr: 55900K .......... .......... .......... .......... .......... 60% 317M 0s 2024-09-14T11:10:01.435 INFO:teuthology.orchestra.run.smithi097.stderr: 55950K .......... .......... .......... .......... .......... 60% 280M 0s 2024-09-14T11:10:01.435 INFO:teuthology.orchestra.run.smithi097.stderr: 56000K .......... .......... .......... .......... .......... 60% 344M 0s 2024-09-14T11:10:01.435 INFO:teuthology.orchestra.run.smithi097.stderr: 56050K .......... .......... .......... .......... .......... 60% 384M 0s 2024-09-14T11:10:01.435 INFO:teuthology.orchestra.run.smithi097.stderr: 56100K .......... .......... .......... .......... .......... 60% 362M 0s 2024-09-14T11:10:01.435 INFO:teuthology.orchestra.run.smithi097.stderr: 56150K .......... .......... .......... .......... .......... 60% 244M 0s 2024-09-14T11:10:01.435 INFO:teuthology.orchestra.run.smithi097.stderr: 56200K .......... .......... .......... .......... .......... 60% 316M 0s 2024-09-14T11:10:01.435 INFO:teuthology.orchestra.run.smithi097.stderr: 56250K .......... .......... .......... .......... .......... 60% 379M 0s 2024-09-14T11:10:01.435 INFO:teuthology.orchestra.run.smithi097.stderr: 56300K .......... .......... .......... .......... .......... 60% 68.0M 0s 2024-09-14T11:10:01.435 INFO:teuthology.orchestra.run.smithi097.stderr: 56350K .......... .......... .......... .......... .......... 60% 178M 0s 2024-09-14T11:10:01.435 INFO:teuthology.orchestra.run.smithi097.stderr: 56400K .......... .......... .......... .......... .......... 60% 348M 0s 2024-09-14T11:10:01.436 INFO:teuthology.orchestra.run.smithi097.stderr: 56450K .......... .......... .......... .......... .......... 60% 368M 0s 2024-09-14T11:10:01.436 INFO:teuthology.orchestra.run.smithi097.stderr: 56500K .......... .......... .......... .......... .......... 60% 368M 0s 2024-09-14T11:10:01.436 INFO:teuthology.orchestra.run.smithi097.stderr: 56550K .......... .......... .......... .......... .......... 60% 296M 0s 2024-09-14T11:10:01.436 INFO:teuthology.orchestra.run.smithi097.stderr: 56600K .......... .......... .......... .......... .......... 60% 83.8M 0s 2024-09-14T11:10:01.436 INFO:teuthology.orchestra.run.smithi097.stderr: 56650K .......... .......... .......... .......... .......... 61% 432M 0s 2024-09-14T11:10:01.436 INFO:teuthology.orchestra.run.smithi097.stderr: 56700K .......... .......... .......... .......... .......... 61% 286M 0s 2024-09-14T11:10:01.436 INFO:teuthology.orchestra.run.smithi097.stderr: 56750K .......... .......... .......... .......... .......... 61% 87.2M 0s 2024-09-14T11:10:01.436 INFO:teuthology.orchestra.run.smithi097.stderr: 56800K .......... .......... .......... .......... .......... 61% 283M 0s 2024-09-14T11:10:01.436 INFO:teuthology.orchestra.run.smithi097.stderr: 56850K .......... .......... .......... .......... .......... 61% 331M 0s 2024-09-14T11:10:01.436 INFO:teuthology.orchestra.run.smithi097.stderr: 56900K .......... .......... .......... .......... .......... 61% 365M 0s 2024-09-14T11:10:01.436 INFO:teuthology.orchestra.run.smithi097.stderr: 56950K .......... .......... .......... .......... .......... 61% 380M 0s 2024-09-14T11:10:01.436 INFO:teuthology.orchestra.run.smithi097.stderr: 57000K .......... .......... .......... .......... .......... 61% 333M 0s 2024-09-14T11:10:01.436 INFO:teuthology.orchestra.run.smithi097.stderr: 57050K .......... .......... .......... .......... .......... 61% 287M 0s 2024-09-14T11:10:01.436 INFO:teuthology.orchestra.run.smithi097.stderr: 57100K .......... .......... .......... .......... .......... 61% 331M 0s 2024-09-14T11:10:01.436 INFO:teuthology.orchestra.run.smithi097.stderr: 57150K .......... .......... .......... .......... .......... 61% 332M 0s 2024-09-14T11:10:01.437 INFO:teuthology.orchestra.run.smithi097.stderr: 57200K .......... .......... .......... .......... .......... 61% 278M 0s 2024-09-14T11:10:01.437 INFO:teuthology.orchestra.run.smithi097.stderr: 57250K .......... .......... .......... .......... .......... 61% 197M 0s 2024-09-14T11:10:01.437 INFO:teuthology.orchestra.run.smithi097.stderr: 57300K .......... .......... .......... .......... .......... 61% 228M 0s 2024-09-14T11:10:01.437 INFO:teuthology.orchestra.run.smithi097.stderr: 57350K .......... .......... .......... .......... .......... 61% 340M 0s 2024-09-14T11:10:01.437 INFO:teuthology.orchestra.run.smithi097.stderr: 57400K .......... .......... .......... .......... .......... 61% 321M 0s 2024-09-14T11:10:01.437 INFO:teuthology.orchestra.run.smithi097.stderr: 57450K .......... .......... .......... .......... .......... 61% 417M 0s 2024-09-14T11:10:01.437 INFO:teuthology.orchestra.run.smithi097.stderr: 57500K .......... .......... .......... .......... .......... 61% 354M 0s 2024-09-14T11:10:01.437 INFO:teuthology.orchestra.run.smithi097.stderr: 57550K .......... .......... .......... .......... .......... 62% 383M 0s 2024-09-14T11:10:01.437 INFO:teuthology.orchestra.run.smithi097.stderr: 57600K .......... .......... .......... .......... .......... 62% 389M 0s 2024-09-14T11:10:01.437 INFO:teuthology.orchestra.run.smithi097.stderr: 57650K .......... .......... .......... .......... .......... 62% 319M 0s 2024-09-14T11:10:01.437 INFO:teuthology.orchestra.run.smithi097.stderr: 57700K .......... .......... .......... .......... .......... 62% 311M 0s 2024-09-14T11:10:01.437 INFO:teuthology.orchestra.run.smithi097.stderr: 57750K .......... .......... .......... .......... .......... 62% 344M 0s 2024-09-14T11:10:01.437 INFO:teuthology.orchestra.run.smithi097.stderr: 57800K .......... .......... .......... .......... .......... 62% 352M 0s 2024-09-14T11:10:01.437 INFO:teuthology.orchestra.run.smithi097.stderr: 57850K .......... .......... .......... .......... .......... 62% 349M 0s 2024-09-14T11:10:01.437 INFO:teuthology.orchestra.run.smithi097.stderr: 57900K .......... .......... .......... .......... .......... 62% 306M 0s 2024-09-14T11:10:01.438 INFO:teuthology.orchestra.run.smithi097.stderr: 57950K .......... .......... .......... .......... .......... 62% 178M 0s 2024-09-14T11:10:01.438 INFO:teuthology.orchestra.run.smithi097.stderr: 58000K .......... .......... .......... .......... .......... 62% 346M 0s 2024-09-14T11:10:01.438 INFO:teuthology.orchestra.run.smithi097.stderr: 58050K .......... .......... .......... .......... .......... 62% 310M 0s 2024-09-14T11:10:01.438 INFO:teuthology.orchestra.run.smithi097.stderr: 58100K .......... .......... .......... .......... .......... 62% 358M 0s 2024-09-14T11:10:01.438 INFO:teuthology.orchestra.run.smithi097.stderr: 58150K .......... .......... .......... .......... .......... 62% 343M 0s 2024-09-14T11:10:01.438 INFO:teuthology.orchestra.run.smithi097.stderr: 58200K .......... .......... .......... .......... .......... 62% 429M 0s 2024-09-14T11:10:01.438 INFO:teuthology.orchestra.run.smithi097.stderr: 58250K .......... .......... .......... .......... .......... 62% 415M 0s 2024-09-14T11:10:01.438 INFO:teuthology.orchestra.run.smithi097.stderr: 58300K .......... .......... .......... .......... .......... 62% 374M 0s 2024-09-14T11:10:01.438 INFO:teuthology.orchestra.run.smithi097.stderr: 58350K .......... .......... .......... .......... .......... 62% 296M 0s 2024-09-14T11:10:01.438 INFO:teuthology.orchestra.run.smithi097.stderr: 58400K .......... .......... .......... .......... .......... 62% 373M 0s 2024-09-14T11:10:01.438 INFO:teuthology.orchestra.run.smithi097.stderr: 58450K .......... .......... .......... .......... .......... 62% 236M 0s 2024-09-14T11:10:01.438 INFO:teuthology.orchestra.run.smithi097.stderr: 58500K .......... .......... .......... .......... .......... 63% 382M 0s 2024-09-14T11:10:01.438 INFO:teuthology.orchestra.run.smithi097.stderr: 58550K .......... .......... .......... .......... .......... 63% 377M 0s 2024-09-14T11:10:01.438 INFO:teuthology.orchestra.run.smithi097.stderr: 58600K .......... .......... .......... .......... .......... 63% 109M 0s 2024-09-14T11:10:01.438 INFO:teuthology.orchestra.run.smithi097.stderr: 58650K .......... .......... .......... .......... .......... 63% 308M 0s 2024-09-14T11:10:01.438 INFO:teuthology.orchestra.run.smithi097.stderr: 58700K .......... .......... .......... .......... .......... 63% 333M 0s 2024-09-14T11:10:01.439 INFO:teuthology.orchestra.run.smithi097.stderr: 58750K .......... .......... .......... .......... .......... 63% 303M 0s 2024-09-14T11:10:01.439 INFO:teuthology.orchestra.run.smithi097.stderr: 58800K .......... .......... .......... .......... .......... 63% 329M 0s 2024-09-14T11:10:01.439 INFO:teuthology.orchestra.run.smithi097.stderr: 58850K .......... .......... .......... .......... .......... 63% 333M 0s 2024-09-14T11:10:01.439 INFO:teuthology.orchestra.run.smithi097.stderr: 58900K .......... .......... .......... .......... .......... 63% 78.1M 0s 2024-09-14T11:10:01.439 INFO:teuthology.orchestra.run.smithi097.stderr: 58950K .......... .......... .......... .......... .......... 63% 300M 0s 2024-09-14T11:10:01.439 INFO:teuthology.orchestra.run.smithi097.stderr: 59000K .......... .......... .......... .......... .......... 63% 212M 0s 2024-09-14T11:10:01.439 INFO:teuthology.orchestra.run.smithi097.stderr: 59050K .......... .......... .......... .......... .......... 63% 128M 0s 2024-09-14T11:10:01.439 INFO:teuthology.orchestra.run.smithi097.stderr: 59100K .......... .......... .......... .......... .......... 63% 234M 0s 2024-09-14T11:10:01.439 INFO:teuthology.orchestra.run.smithi097.stderr: 59150K .......... .......... .......... .......... .......... 63% 314M 0s 2024-09-14T11:10:01.439 INFO:teuthology.orchestra.run.smithi097.stderr: 59200K .......... .......... .......... .......... .......... 63% 323M 0s 2024-09-14T11:10:01.439 INFO:teuthology.orchestra.run.smithi097.stderr: 59250K .......... .......... .......... .......... .......... 63% 189M 0s 2024-09-14T11:10:01.439 INFO:teuthology.orchestra.run.smithi097.stderr: 59300K .......... .......... .......... .......... .......... 63% 133M 0s 2024-09-14T11:10:01.439 INFO:teuthology.orchestra.run.smithi097.stderr: 59350K .......... .......... .......... .......... .......... 63% 336M 0s 2024-09-14T11:10:01.439 INFO:teuthology.orchestra.run.smithi097.stderr: 59400K .......... .......... .......... .......... .......... 63% 135M 0s 2024-09-14T11:10:01.439 INFO:teuthology.orchestra.run.smithi097.stderr: 59450K .......... .......... .......... .......... .......... 64% 308M 0s 2024-09-14T11:10:01.439 INFO:teuthology.orchestra.run.smithi097.stderr: 59500K .......... .......... .......... .......... .......... 64% 263M 0s 2024-09-14T11:10:01.440 INFO:teuthology.orchestra.run.smithi097.stderr: 59550K .......... .......... .......... .......... .......... 64% 344M 0s 2024-09-14T11:10:01.440 INFO:teuthology.orchestra.run.smithi097.stderr: 59600K .......... .......... .......... .......... .......... 64% 186M 0s 2024-09-14T11:10:01.440 INFO:teuthology.orchestra.run.smithi097.stderr: 59650K .......... .......... .......... .......... .......... 64% 360M 0s 2024-09-14T11:10:01.440 INFO:teuthology.orchestra.run.smithi097.stderr: 59700K .......... .......... .......... .......... .......... 64% 150M 0s 2024-09-14T11:10:01.440 INFO:teuthology.orchestra.run.smithi097.stderr: 59750K .......... .......... .......... .......... .......... 64% 345M 0s 2024-09-14T11:10:01.440 INFO:teuthology.orchestra.run.smithi097.stderr: 59800K .......... .......... .......... .......... .......... 64% 125M 0s 2024-09-14T11:10:01.440 INFO:teuthology.orchestra.run.smithi097.stderr: 59850K .......... .......... .......... .......... .......... 64% 205M 0s 2024-09-14T11:10:01.440 INFO:teuthology.orchestra.run.smithi097.stderr: 59900K .......... .......... .......... .......... .......... 64% 237M 0s 2024-09-14T11:10:01.440 INFO:teuthology.orchestra.run.smithi097.stderr: 59950K .......... .......... .......... .......... .......... 64% 331M 0s 2024-09-14T11:10:01.440 INFO:teuthology.orchestra.run.smithi097.stderr: 60000K .......... .......... .......... .......... .......... 64% 382M 0s 2024-09-14T11:10:01.440 INFO:teuthology.orchestra.run.smithi097.stderr: 60050K .......... .......... .......... .......... .......... 64% 208M 0s 2024-09-14T11:10:01.440 INFO:teuthology.orchestra.run.smithi097.stderr: 60100K .......... .......... .......... .......... .......... 64% 240M 0s 2024-09-14T11:10:01.440 INFO:teuthology.orchestra.run.smithi097.stderr: 60150K .......... .......... .......... .......... .......... 64% 321M 0s 2024-09-14T11:10:01.440 INFO:teuthology.orchestra.run.smithi097.stderr: 60200K .......... .......... .......... .......... .......... 64% 101M 0s 2024-09-14T11:10:01.440 INFO:teuthology.orchestra.run.smithi097.stderr: 60250K .......... .......... .......... .......... .......... 64% 153M 0s 2024-09-14T11:10:01.440 INFO:teuthology.orchestra.run.smithi097.stderr: 60300K .......... .......... .......... .......... .......... 64% 399M 0s 2024-09-14T11:10:01.441 INFO:teuthology.orchestra.run.smithi097.stderr: 60350K .......... .......... .......... .......... .......... 65% 316M 0s 2024-09-14T11:10:01.441 INFO:teuthology.orchestra.run.smithi097.stderr: 60400K .......... .......... .......... .......... .......... 65% 365M 0s 2024-09-14T11:10:01.441 INFO:teuthology.orchestra.run.smithi097.stderr: 60450K .......... .......... .......... .......... .......... 65% 325M 0s 2024-09-14T11:10:01.441 INFO:teuthology.orchestra.run.smithi097.stderr: 60500K .......... .......... .......... .......... .......... 65% 375M 0s 2024-09-14T11:10:01.441 INFO:teuthology.orchestra.run.smithi097.stderr: 60550K .......... .......... .......... .......... .......... 65% 324M 0s 2024-09-14T11:10:01.441 INFO:teuthology.orchestra.run.smithi097.stderr: 60600K .......... .......... .......... .......... .......... 65% 344M 0s 2024-09-14T11:10:01.441 INFO:teuthology.orchestra.run.smithi097.stderr: 60650K .......... .......... .......... .......... .......... 65% 439M 0s 2024-09-14T11:10:01.441 INFO:teuthology.orchestra.run.smithi097.stderr: 60700K .......... .......... .......... .......... .......... 65% 336M 0s 2024-09-14T11:10:01.441 INFO:teuthology.orchestra.run.smithi097.stderr: 60750K .......... .......... .......... .......... .......... 65% 298M 0s 2024-09-14T11:10:01.441 INFO:teuthology.orchestra.run.smithi097.stderr: 60800K .......... .......... .......... .......... .......... 65% 308M 0s 2024-09-14T11:10:01.441 INFO:teuthology.orchestra.run.smithi097.stderr: 60850K .......... .......... .......... .......... .......... 65% 205M 0s 2024-09-14T11:10:01.441 INFO:teuthology.orchestra.run.smithi097.stderr: 60900K .......... .......... .......... .......... .......... 65% 394M 0s 2024-09-14T11:10:01.441 INFO:teuthology.orchestra.run.smithi097.stderr: 60950K .......... .......... .......... .......... .......... 65% 126M 0s 2024-09-14T11:10:01.441 INFO:teuthology.orchestra.run.smithi097.stderr: 61000K .......... .......... .......... .......... .......... 65% 304M 0s 2024-09-14T11:10:01.441 INFO:teuthology.orchestra.run.smithi097.stderr: 61050K .......... .......... .......... .......... .......... 65% 375M 0s 2024-09-14T11:10:01.441 INFO:teuthology.orchestra.run.smithi097.stderr: 61100K .......... .......... .......... .......... .......... 65% 379M 0s 2024-09-14T11:10:01.442 INFO:teuthology.orchestra.run.smithi097.stderr: 61150K .......... .......... .......... .......... .......... 65% 383M 0s 2024-09-14T11:10:01.442 INFO:teuthology.orchestra.run.smithi097.stderr: 61200K .......... .......... .......... .......... .......... 65% 359M 0s 2024-09-14T11:10:01.442 INFO:teuthology.orchestra.run.smithi097.stderr: 61250K .......... .......... .......... .......... .......... 65% 384M 0s 2024-09-14T11:10:01.442 INFO:teuthology.orchestra.run.smithi097.stderr: 61300K .......... .......... .......... .......... .......... 66% 316M 0s 2024-09-14T11:10:01.442 INFO:teuthology.orchestra.run.smithi097.stderr: 61350K .......... .......... .......... .......... .......... 66% 357M 0s 2024-09-14T11:10:01.442 INFO:teuthology.orchestra.run.smithi097.stderr: 61400K .......... .......... .......... .......... .......... 66% 310M 0s 2024-09-14T11:10:01.442 INFO:teuthology.orchestra.run.smithi097.stderr: 61450K .......... .......... .......... .......... .......... 66% 427M 0s 2024-09-14T11:10:01.442 INFO:teuthology.orchestra.run.smithi097.stderr: 61500K .......... .......... .......... .......... .......... 66% 433M 0s 2024-09-14T11:10:01.442 INFO:teuthology.orchestra.run.smithi097.stderr: 61550K .......... .......... .......... .......... .......... 66% 321M 0s 2024-09-14T11:10:01.442 INFO:teuthology.orchestra.run.smithi097.stderr: 61600K .......... .......... .......... .......... .......... 66% 412M 0s 2024-09-14T11:10:01.442 INFO:teuthology.orchestra.run.smithi097.stderr: 61650K .......... .......... .......... .......... .......... 66% 274M 0s 2024-09-14T11:10:01.442 INFO:teuthology.orchestra.run.smithi097.stderr: 61700K .......... .......... .......... .......... .......... 66% 146M 0s 2024-09-14T11:10:01.442 INFO:teuthology.orchestra.run.smithi097.stderr: 61750K .......... .......... .......... .......... .......... 66% 335M 0s 2024-09-14T11:10:01.443 INFO:teuthology.orchestra.run.smithi097.stderr: 61800K .......... .......... .......... .......... .......... 66% 402M 0s 2024-09-14T11:10:01.443 INFO:teuthology.orchestra.run.smithi097.stderr: 61850K .......... .......... .......... .......... .......... 66% 363M 0s 2024-09-14T11:10:01.443 INFO:teuthology.orchestra.run.smithi097.stderr: 61900K .......... .......... .......... .......... .......... 66% 90.5M 0s 2024-09-14T11:10:01.443 INFO:teuthology.orchestra.run.smithi097.stderr: 61950K .......... .......... .......... .......... .......... 66% 324M 0s 2024-09-14T11:10:01.443 INFO:teuthology.orchestra.run.smithi097.stderr: 62000K .......... .......... .......... .......... .......... 66% 384M 0s 2024-09-14T11:10:01.443 INFO:teuthology.orchestra.run.smithi097.stderr: 62050K .......... .......... .......... .......... .......... 66% 256M 0s 2024-09-14T11:10:01.443 INFO:teuthology.orchestra.run.smithi097.stderr: 62100K .......... .......... .......... .......... .......... 66% 150M 0s 2024-09-14T11:10:01.443 INFO:teuthology.orchestra.run.smithi097.stderr: 62150K .......... .......... .......... .......... .......... 66% 282M 0s 2024-09-14T11:10:01.443 INFO:teuthology.orchestra.run.smithi097.stderr: 62200K .......... .......... .......... .......... .......... 67% 147M 0s 2024-09-14T11:10:01.443 INFO:teuthology.orchestra.run.smithi097.stderr: 62250K .......... .......... .......... .......... .......... 67% 263M 0s 2024-09-14T11:10:01.443 INFO:teuthology.orchestra.run.smithi097.stderr: 62300K .......... .......... .......... .......... .......... 67% 241M 0s 2024-09-14T11:10:01.443 INFO:teuthology.orchestra.run.smithi097.stderr: 62350K .......... .......... .......... .......... .......... 67% 243M 0s 2024-09-14T11:10:01.443 INFO:teuthology.orchestra.run.smithi097.stderr: 62400K .......... .......... .......... .......... .......... 67% 266M 0s 2024-09-14T11:10:01.443 INFO:teuthology.orchestra.run.smithi097.stderr: 62450K .......... .......... .......... .......... .......... 67% 123M 0s 2024-09-14T11:10:01.443 INFO:teuthology.orchestra.run.smithi097.stderr: 62500K .......... .......... .......... .......... .......... 67% 327M 0s 2024-09-14T11:10:01.443 INFO:teuthology.orchestra.run.smithi097.stderr: 62550K .......... .......... .......... .......... .......... 67% 91.9M 0s 2024-09-14T11:10:01.444 INFO:teuthology.orchestra.run.smithi097.stderr: 62600K .......... .......... .......... .......... .......... 67% 369M 0s 2024-09-14T11:10:01.444 INFO:teuthology.orchestra.run.smithi097.stderr: 62650K .......... .......... .......... .......... .......... 67% 397M 0s 2024-09-14T11:10:01.444 INFO:teuthology.orchestra.run.smithi097.stderr: 62700K .......... .......... .......... .......... .......... 67% 314M 0s 2024-09-14T11:10:01.444 INFO:teuthology.orchestra.run.smithi097.stderr: 62750K .......... .......... .......... .......... .......... 67% 296M 0s 2024-09-14T11:10:01.444 INFO:teuthology.orchestra.run.smithi097.stderr: 62800K .......... .......... .......... .......... .......... 67% 143M 0s 2024-09-14T11:10:01.444 INFO:teuthology.orchestra.run.smithi097.stderr: 62850K .......... .......... .......... .......... .......... 67% 226M 0s 2024-09-14T11:10:01.444 INFO:teuthology.orchestra.run.smithi097.stderr: 62900K .......... .......... .......... .......... .......... 67% 315M 0s 2024-09-14T11:10:01.444 INFO:teuthology.orchestra.run.smithi097.stderr: 62950K .......... .......... .......... .......... .......... 67% 377M 0s 2024-09-14T11:10:01.444 INFO:teuthology.orchestra.run.smithi097.stderr: 63000K .......... .......... .......... .......... .......... 67% 288M 0s 2024-09-14T11:10:01.444 INFO:teuthology.orchestra.run.smithi097.stderr: 63050K .......... .......... .......... .......... .......... 67% 204M 0s 2024-09-14T11:10:01.444 INFO:teuthology.orchestra.run.smithi097.stderr: 63100K .......... .......... .......... .......... .......... 67% 346M 0s 2024-09-14T11:10:01.444 INFO:teuthology.orchestra.run.smithi097.stderr: 63150K .......... .......... .......... .......... .......... 68% 387M 0s 2024-09-14T11:10:01.444 INFO:teuthology.orchestra.run.smithi097.stderr: 63200K .......... .......... .......... .......... .......... 68% 332M 0s 2024-09-14T11:10:01.444 INFO:teuthology.orchestra.run.smithi097.stderr: 63250K .......... .......... .......... .......... .......... 68% 78.9M 0s 2024-09-14T11:10:01.444 INFO:teuthology.orchestra.run.smithi097.stderr: 63300K .......... .......... .......... .......... .......... 68% 164M 0s 2024-09-14T11:10:01.444 INFO:teuthology.orchestra.run.smithi097.stderr: 63350K .......... .......... .......... .......... .......... 68% 239M 0s 2024-09-14T11:10:01.445 INFO:teuthology.orchestra.run.smithi097.stderr: 63400K .......... .......... .......... .......... .......... 68% 276M 0s 2024-09-14T11:10:01.445 INFO:teuthology.orchestra.run.smithi097.stderr: 63450K .......... .......... .......... .......... .......... 68% 138M 0s 2024-09-14T11:10:01.445 INFO:teuthology.orchestra.run.smithi097.stderr: 63500K .......... .......... .......... .......... .......... 68% 370M 0s 2024-09-14T11:10:01.445 INFO:teuthology.orchestra.run.smithi097.stderr: 63550K .......... .......... .......... .......... .......... 68% 379M 0s 2024-09-14T11:10:01.445 INFO:teuthology.orchestra.run.smithi097.stderr: 63600K .......... .......... .......... .......... .......... 68% 223M 0s 2024-09-14T11:10:01.445 INFO:teuthology.orchestra.run.smithi097.stderr: 63650K .......... .......... .......... .......... .......... 68% 329M 0s 2024-09-14T11:10:01.445 INFO:teuthology.orchestra.run.smithi097.stderr: 63700K .......... .......... .......... .......... .......... 68% 350M 0s 2024-09-14T11:10:01.445 INFO:teuthology.orchestra.run.smithi097.stderr: 63750K .......... .......... .......... .......... .......... 68% 338M 0s 2024-09-14T11:10:01.445 INFO:teuthology.orchestra.run.smithi097.stderr: 63800K .......... .......... .......... .......... .......... 68% 340M 0s 2024-09-14T11:10:01.445 INFO:teuthology.orchestra.run.smithi097.stderr: 63850K .......... .......... .......... .......... .......... 68% 383M 0s 2024-09-14T11:10:01.445 INFO:teuthology.orchestra.run.smithi097.stderr: 63900K .......... .......... .......... .......... .......... 68% 137M 0s 2024-09-14T11:10:01.445 INFO:teuthology.orchestra.run.smithi097.stderr: 63950K .......... .......... .......... .......... .......... 68% 124M 0s 2024-09-14T11:10:01.445 INFO:teuthology.orchestra.run.smithi097.stderr: 64000K .......... .......... .......... .......... .......... 68% 296M 0s 2024-09-14T11:10:01.445 INFO:teuthology.orchestra.run.smithi097.stderr: 64050K .......... .......... .......... .......... .......... 68% 281M 0s 2024-09-14T11:10:01.445 INFO:teuthology.orchestra.run.smithi097.stderr: 64100K .......... .......... .......... .......... .......... 69% 334M 0s 2024-09-14T11:10:01.445 INFO:teuthology.orchestra.run.smithi097.stderr: 64150K .......... .......... .......... .......... .......... 69% 411M 0s 2024-09-14T11:10:01.446 INFO:teuthology.orchestra.run.smithi097.stderr: 64200K .......... .......... .......... .......... .......... 69% 275M 0s 2024-09-14T11:10:01.446 INFO:teuthology.orchestra.run.smithi097.stderr: 64250K .......... .......... .......... .......... .......... 69% 209M 0s 2024-09-14T11:10:01.446 INFO:teuthology.orchestra.run.smithi097.stderr: 64300K .......... .......... .......... .......... .......... 69% 217M 0s 2024-09-14T11:10:01.446 INFO:teuthology.orchestra.run.smithi097.stderr: 64350K .......... .......... .......... .......... .......... 69% 384M 0s 2024-09-14T11:10:01.446 INFO:teuthology.orchestra.run.smithi097.stderr: 64400K .......... .......... .......... .......... .......... 69% 398M 0s 2024-09-14T11:10:01.446 INFO:teuthology.orchestra.run.smithi097.stderr: 64450K .......... .......... .......... .......... .......... 69% 421M 0s 2024-09-14T11:10:01.446 INFO:teuthology.orchestra.run.smithi097.stderr: 64500K .......... .......... .......... .......... .......... 69% 289M 0s 2024-09-14T11:10:01.446 INFO:teuthology.orchestra.run.smithi097.stderr: 64550K .......... .......... .......... .......... .......... 69% 104M 0s 2024-09-14T11:10:01.446 INFO:teuthology.orchestra.run.smithi097.stderr: 64600K .......... .......... .......... .......... .......... 69% 393M 0s 2024-09-14T11:10:01.446 INFO:teuthology.orchestra.run.smithi097.stderr: 64650K .......... .......... .......... .......... .......... 69% 395M 0s 2024-09-14T11:10:01.446 INFO:teuthology.orchestra.run.smithi097.stderr: 64700K .......... .......... .......... .......... .......... 69% 117M 0s 2024-09-14T11:10:01.446 INFO:teuthology.orchestra.run.smithi097.stderr: 64750K .......... .......... .......... .......... .......... 69% 348M 0s 2024-09-14T11:10:01.446 INFO:teuthology.orchestra.run.smithi097.stderr: 64800K .......... .......... .......... .......... .......... 69% 374M 0s 2024-09-14T11:10:01.446 INFO:teuthology.orchestra.run.smithi097.stderr: 64850K .......... .......... .......... .......... .......... 69% 405M 0s 2024-09-14T11:10:01.446 INFO:teuthology.orchestra.run.smithi097.stderr: 64900K .......... .......... .......... .......... .......... 69% 381M 0s 2024-09-14T11:10:01.447 INFO:teuthology.orchestra.run.smithi097.stderr: 64950K .......... .......... .......... .......... .......... 69% 342M 0s 2024-09-14T11:10:01.447 INFO:teuthology.orchestra.run.smithi097.stderr: 65000K .......... .......... .......... .......... .......... 70% 320M 0s 2024-09-14T11:10:01.447 INFO:teuthology.orchestra.run.smithi097.stderr: 65050K .......... .......... .......... .......... .......... 70% 307M 0s 2024-09-14T11:10:01.447 INFO:teuthology.orchestra.run.smithi097.stderr: 65100K .......... .......... .......... .......... .......... 70% 348M 0s 2024-09-14T11:10:01.447 INFO:teuthology.orchestra.run.smithi097.stderr: 65150K .......... .......... .......... .......... .......... 70% 265M 0s 2024-09-14T11:10:01.447 INFO:teuthology.orchestra.run.smithi097.stderr: 65200K .......... .......... .......... .......... .......... 70% 125M 0s 2024-09-14T11:10:01.447 INFO:teuthology.orchestra.run.smithi097.stderr: 65250K .......... .......... .......... .......... .......... 70% 121M 0s 2024-09-14T11:10:01.447 INFO:teuthology.orchestra.run.smithi097.stderr: 65300K .......... .......... .......... .......... .......... 70% 403M 0s 2024-09-14T11:10:01.447 INFO:teuthology.orchestra.run.smithi097.stderr: 65350K .......... .......... .......... .......... .......... 70% 404M 0s 2024-09-14T11:10:01.447 INFO:teuthology.orchestra.run.smithi097.stderr: 65400K .......... .......... .......... .......... .......... 70% 410M 0s 2024-09-14T11:10:01.447 INFO:teuthology.orchestra.run.smithi097.stderr: 65450K .......... .......... .......... .......... .......... 70% 328M 0s 2024-09-14T11:10:01.447 INFO:teuthology.orchestra.run.smithi097.stderr: 65500K .......... .......... .......... .......... .......... 70% 398M 0s 2024-09-14T11:10:01.447 INFO:teuthology.orchestra.run.smithi097.stderr: 65550K .......... .......... .......... .......... .......... 70% 328M 0s 2024-09-14T11:10:01.447 INFO:teuthology.orchestra.run.smithi097.stderr: 65600K .......... .......... .......... .......... .......... 70% 151M 0s 2024-09-14T11:10:01.447 INFO:teuthology.orchestra.run.smithi097.stderr: 65650K .......... .......... .......... .......... .......... 70% 308M 0s 2024-09-14T11:10:01.448 INFO:teuthology.orchestra.run.smithi097.stderr: 65700K .......... .......... .......... .......... .......... 70% 397M 0s 2024-09-14T11:10:01.448 INFO:teuthology.orchestra.run.smithi097.stderr: 65750K .......... .......... .......... .......... .......... 70% 375M 0s 2024-09-14T11:10:01.448 INFO:teuthology.orchestra.run.smithi097.stderr: 65800K .......... .......... .......... .......... .......... 70% 185M 0s 2024-09-14T11:10:01.448 INFO:teuthology.orchestra.run.smithi097.stderr: 65850K .......... .......... .......... .......... .......... 70% 372M 0s 2024-09-14T11:10:01.448 INFO:teuthology.orchestra.run.smithi097.stderr: 65900K .......... .......... .......... .......... .......... 70% 199M 0s 2024-09-14T11:10:01.448 INFO:teuthology.orchestra.run.smithi097.stderr: 65950K .......... .......... .......... .......... .......... 71% 224M 0s 2024-09-14T11:10:01.448 INFO:teuthology.orchestra.run.smithi097.stderr: 66000K .......... .......... .......... .......... .......... 71% 385M 0s 2024-09-14T11:10:01.448 INFO:teuthology.orchestra.run.smithi097.stderr: 66050K .......... .......... .......... .......... .......... 71% 396M 0s 2024-09-14T11:10:01.448 INFO:teuthology.orchestra.run.smithi097.stderr: 66100K .......... .......... .......... .......... .......... 71% 297M 0s 2024-09-14T11:10:01.448 INFO:teuthology.orchestra.run.smithi097.stderr: 66150K .......... .......... .......... .......... .......... 71% 271M 0s 2024-09-14T11:10:01.448 INFO:teuthology.orchestra.run.smithi097.stderr: 66200K .......... .......... .......... .......... .......... 71% 388M 0s 2024-09-14T11:10:01.448 INFO:teuthology.orchestra.run.smithi097.stderr: 66250K .......... .......... .......... .......... .......... 71% 72.0M 0s 2024-09-14T11:10:01.448 INFO:teuthology.orchestra.run.smithi097.stderr: 66300K .......... .......... .......... .......... .......... 71% 313M 0s 2024-09-14T11:10:01.448 INFO:teuthology.orchestra.run.smithi097.stderr: 66350K .......... .......... .......... .......... .......... 71% 410M 0s 2024-09-14T11:10:01.448 INFO:teuthology.orchestra.run.smithi097.stderr: 66400K .......... .......... .......... .......... .......... 71% 130M 0s 2024-09-14T11:10:01.449 INFO:teuthology.orchestra.run.smithi097.stderr: 66450K .......... .......... .......... .......... .......... 71% 291M 0s 2024-09-14T11:10:01.449 INFO:teuthology.orchestra.run.smithi097.stderr: 66500K .......... .......... .......... .......... .......... 71% 111M 0s 2024-09-14T11:10:01.449 INFO:teuthology.orchestra.run.smithi097.stderr: 66550K .......... .......... .......... .......... .......... 71% 150M 0s 2024-09-14T11:10:01.449 INFO:teuthology.orchestra.run.smithi097.stderr: 66600K .......... .......... .......... .......... .......... 71% 317M 0s 2024-09-14T11:10:01.449 INFO:teuthology.orchestra.run.smithi097.stderr: 66650K .......... .......... .......... .......... .......... 71% 153M 0s 2024-09-14T11:10:01.449 INFO:teuthology.orchestra.run.smithi097.stderr: 66700K .......... .......... .......... .......... .......... 71% 269M 0s 2024-09-14T11:10:01.449 INFO:teuthology.orchestra.run.smithi097.stderr: 66750K .......... .......... .......... .......... .......... 71% 379M 0s 2024-09-14T11:10:01.449 INFO:teuthology.orchestra.run.smithi097.stderr: 66800K .......... .......... .......... .......... .......... 71% 128M 0s 2024-09-14T11:10:01.449 INFO:teuthology.orchestra.run.smithi097.stderr: 66850K .......... .......... .......... .......... .......... 72% 353M 0s 2024-09-14T11:10:01.449 INFO:teuthology.orchestra.run.smithi097.stderr: 66900K .......... .......... .......... .......... .......... 72% 366M 0s 2024-09-14T11:10:01.449 INFO:teuthology.orchestra.run.smithi097.stderr: 66950K .......... .......... .......... .......... .......... 72% 298M 0s 2024-09-14T11:10:01.449 INFO:teuthology.orchestra.run.smithi097.stderr: 67000K .......... .......... .......... .......... .......... 72% 403M 0s 2024-09-14T11:10:01.449 INFO:teuthology.orchestra.run.smithi097.stderr: 67050K .......... .......... .......... .......... .......... 72% 111M 0s 2024-09-14T11:10:01.449 INFO:teuthology.orchestra.run.smithi097.stderr: 67100K .......... .......... .......... .......... .......... 72% 387M 0s 2024-09-14T11:10:01.449 INFO:teuthology.orchestra.run.smithi097.stderr: 67150K .......... .......... .......... .......... .......... 72% 284M 0s 2024-09-14T11:10:01.449 INFO:teuthology.orchestra.run.smithi097.stderr: 67200K .......... .......... .......... .......... .......... 72% 149M 0s 2024-09-14T11:10:01.450 INFO:teuthology.orchestra.run.smithi097.stderr: 67250K .......... .......... .......... .......... .......... 72% 267M 0s 2024-09-14T11:10:01.450 INFO:teuthology.orchestra.run.smithi097.stderr: 67300K .......... .......... .......... .......... .......... 72% 193M 0s 2024-09-14T11:10:01.450 INFO:teuthology.orchestra.run.smithi097.stderr: 67350K .......... .......... .......... .......... .......... 72% 270M 0s 2024-09-14T11:10:01.450 INFO:teuthology.orchestra.run.smithi097.stderr: 67400K .......... .......... .......... .......... .......... 72% 380M 0s 2024-09-14T11:10:01.450 INFO:teuthology.orchestra.run.smithi097.stderr: 67450K .......... .......... .......... .......... .......... 72% 185M 0s 2024-09-14T11:10:01.450 INFO:teuthology.orchestra.run.smithi097.stderr: 67500K .......... .......... .......... .......... .......... 72% 400M 0s 2024-09-14T11:10:01.450 INFO:teuthology.orchestra.run.smithi097.stderr: 67550K .......... .......... .......... .......... .......... 72% 323M 0s 2024-09-14T11:10:01.450 INFO:teuthology.orchestra.run.smithi097.stderr: 67600K .......... .......... .......... .......... .......... 72% 310M 0s 2024-09-14T11:10:01.450 INFO:teuthology.orchestra.run.smithi097.stderr: 67650K .......... .......... .......... .......... .......... 72% 268M 0s 2024-09-14T11:10:01.450 INFO:teuthology.orchestra.run.smithi097.stderr: 67700K .......... .......... .......... .......... .......... 72% 75.3M 0s 2024-09-14T11:10:01.450 INFO:teuthology.orchestra.run.smithi097.stderr: 67750K .......... .......... .......... .......... .......... 72% 334M 0s 2024-09-14T11:10:01.450 INFO:teuthology.orchestra.run.smithi097.stderr: 67800K .......... .......... .......... .......... .......... 73% 336M 0s 2024-09-14T11:10:01.450 INFO:teuthology.orchestra.run.smithi097.stderr: 67850K .......... .......... .......... .......... .......... 73% 322M 0s 2024-09-14T11:10:01.450 INFO:teuthology.orchestra.run.smithi097.stderr: 67900K .......... .......... .......... .......... .......... 73% 387M 0s 2024-09-14T11:10:01.450 INFO:teuthology.orchestra.run.smithi097.stderr: 67950K .......... .......... .......... .......... .......... 73% 278M 0s 2024-09-14T11:10:01.451 INFO:teuthology.orchestra.run.smithi097.stderr: 68000K .......... .......... .......... .......... .......... 73% 280M 0s 2024-09-14T11:10:01.451 INFO:teuthology.orchestra.run.smithi097.stderr: 68050K .......... .......... .......... .......... .......... 73% 319M 0s 2024-09-14T11:10:01.451 INFO:teuthology.orchestra.run.smithi097.stderr: 68100K .......... .......... .......... .......... .......... 73% 326M 0s 2024-09-14T11:10:01.451 INFO:teuthology.orchestra.run.smithi097.stderr: 68150K .......... .......... .......... .......... .......... 73% 309M 0s 2024-09-14T11:10:01.451 INFO:teuthology.orchestra.run.smithi097.stderr: 68200K .......... .......... .......... .......... .......... 73% 309M 0s 2024-09-14T11:10:01.451 INFO:teuthology.orchestra.run.smithi097.stderr: 68250K .......... .......... .......... .......... .......... 73% 391M 0s 2024-09-14T11:10:01.451 INFO:teuthology.orchestra.run.smithi097.stderr: 68300K .......... .......... .......... .......... .......... 73% 267M 0s 2024-09-14T11:10:01.451 INFO:teuthology.orchestra.run.smithi097.stderr: 68350K .......... .......... .......... .......... .......... 73% 280M 0s 2024-09-14T11:10:01.451 INFO:teuthology.orchestra.run.smithi097.stderr: 68400K .......... .......... .......... .......... .......... 73% 385M 0s 2024-09-14T11:10:01.451 INFO:teuthology.orchestra.run.smithi097.stderr: 68450K .......... .......... .......... .......... .......... 73% 208M 0s 2024-09-14T11:10:01.451 INFO:teuthology.orchestra.run.smithi097.stderr: 68500K .......... .......... .......... .......... .......... 73% 332M 0s 2024-09-14T11:10:01.451 INFO:teuthology.orchestra.run.smithi097.stderr: 68550K .......... .......... .......... .......... .......... 73% 377M 0s 2024-09-14T11:10:01.451 INFO:teuthology.orchestra.run.smithi097.stderr: 68600K .......... .......... .......... .......... .......... 73% 404M 0s 2024-09-14T11:10:01.451 INFO:teuthology.orchestra.run.smithi097.stderr: 68650K .......... .......... .......... .......... .......... 73% 378M 0s 2024-09-14T11:10:01.451 INFO:teuthology.orchestra.run.smithi097.stderr: 68700K .......... .......... .......... .......... .......... 74% 250M 0s 2024-09-14T11:10:01.452 INFO:teuthology.orchestra.run.smithi097.stderr: 68750K .......... .......... .......... .......... .......... 74% 304M 0s 2024-09-14T11:10:01.452 INFO:teuthology.orchestra.run.smithi097.stderr: 68800K .......... .......... .......... .......... .......... 74% 380M 0s 2024-09-14T11:10:01.452 INFO:teuthology.orchestra.run.smithi097.stderr: 68850K .......... .......... .......... .......... .......... 74% 399M 0s 2024-09-14T11:10:01.452 INFO:teuthology.orchestra.run.smithi097.stderr: 68900K .......... .......... .......... .......... .......... 74% 221M 0s 2024-09-14T11:10:01.452 INFO:teuthology.orchestra.run.smithi097.stderr: 68950K .......... .......... .......... .......... .......... 74% 347M 0s 2024-09-14T11:10:01.452 INFO:teuthology.orchestra.run.smithi097.stderr: 69000K .......... .......... .......... .......... .......... 74% 409M 0s 2024-09-14T11:10:01.452 INFO:teuthology.orchestra.run.smithi097.stderr: 69050K .......... .......... .......... .......... .......... 74% 408M 0s 2024-09-14T11:10:01.452 INFO:teuthology.orchestra.run.smithi097.stderr: 69100K .......... .......... .......... .......... .......... 74% 417M 0s 2024-09-14T11:10:01.452 INFO:teuthology.orchestra.run.smithi097.stderr: 69150K .......... .......... .......... .......... .......... 74% 294M 0s 2024-09-14T11:10:01.452 INFO:teuthology.orchestra.run.smithi097.stderr: 69200K .......... .......... .......... .......... .......... 74% 333M 0s 2024-09-14T11:10:01.452 INFO:teuthology.orchestra.run.smithi097.stderr: 69250K .......... .......... .......... .......... .......... 74% 179M 0s 2024-09-14T11:10:01.452 INFO:teuthology.orchestra.run.smithi097.stderr: 69300K .......... .......... .......... .......... .......... 74% 135M 0s 2024-09-14T11:10:01.452 INFO:teuthology.orchestra.run.smithi097.stderr: 69350K .......... .......... .......... .......... .......... 74% 324M 0s 2024-09-14T11:10:01.452 INFO:teuthology.orchestra.run.smithi097.stderr: 69400K .......... .......... .......... .......... .......... 74% 201M 0s 2024-09-14T11:10:01.452 INFO:teuthology.orchestra.run.smithi097.stderr: 69450K .......... .......... .......... .......... .......... 74% 348M 0s 2024-09-14T11:10:01.453 INFO:teuthology.orchestra.run.smithi097.stderr: 69500K .......... .......... .......... .......... .......... 74% 368M 0s 2024-09-14T11:10:01.453 INFO:teuthology.orchestra.run.smithi097.stderr: 69550K .......... .......... .......... .......... .......... 74% 89.4M 0s 2024-09-14T11:10:01.453 INFO:teuthology.orchestra.run.smithi097.stderr: 69600K .......... .......... .......... .......... .......... 74% 144M 0s 2024-09-14T11:10:01.453 INFO:teuthology.orchestra.run.smithi097.stderr: 69650K .......... .......... .......... .......... .......... 75% 135M 0s 2024-09-14T11:10:01.453 INFO:teuthology.orchestra.run.smithi097.stderr: 69700K .......... .......... .......... .......... .......... 75% 354M 0s 2024-09-14T11:10:01.453 INFO:teuthology.orchestra.run.smithi097.stderr: 69750K .......... .......... .......... .......... .......... 75% 294M 0s 2024-09-14T11:10:01.453 INFO:teuthology.orchestra.run.smithi097.stderr: 69800K .......... .......... .......... .......... .......... 75% 166M 0s 2024-09-14T11:10:01.453 INFO:teuthology.orchestra.run.smithi097.stderr: 69850K .......... .......... .......... .......... .......... 75% 277M 0s 2024-09-14T11:10:01.453 INFO:teuthology.orchestra.run.smithi097.stderr: 69900K .......... .......... .......... .......... .......... 75% 212M 0s 2024-09-14T11:10:01.453 INFO:teuthology.orchestra.run.smithi097.stderr: 69950K .......... .......... .......... .......... .......... 75% 403M 0s 2024-09-14T11:10:01.453 INFO:teuthology.orchestra.run.smithi097.stderr: 70000K .......... .......... .......... .......... .......... 75% 314M 0s 2024-09-14T11:10:01.453 INFO:teuthology.orchestra.run.smithi097.stderr: 70050K .......... .......... .......... .......... .......... 75% 350M 0s 2024-09-14T11:10:01.453 INFO:teuthology.orchestra.run.smithi097.stderr: 70100K .......... .......... .......... .......... .......... 75% 198M 0s 2024-09-14T11:10:01.453 INFO:teuthology.orchestra.run.smithi097.stderr: 70150K .......... .......... .......... .......... .......... 75% 410M 0s 2024-09-14T11:10:01.453 INFO:teuthology.orchestra.run.smithi097.stderr: 70200K .......... .......... .......... .......... .......... 75% 92.8M 0s 2024-09-14T11:10:01.454 INFO:teuthology.orchestra.run.smithi097.stderr: 70250K .......... .......... .......... .......... .......... 75% 225M 0s 2024-09-14T11:10:01.454 INFO:teuthology.orchestra.run.smithi097.stderr: 70300K .......... .......... .......... .......... .......... 75% 198M 0s 2024-09-14T11:10:01.454 INFO:teuthology.orchestra.run.smithi097.stderr: 70350K .......... .......... .......... .......... .......... 75% 359M 0s 2024-09-14T11:10:01.454 INFO:teuthology.orchestra.run.smithi097.stderr: 70400K .......... .......... .......... .......... .......... 75% 395M 0s 2024-09-14T11:10:01.454 INFO:teuthology.orchestra.run.smithi097.stderr: 70450K .......... .......... .......... .......... .......... 75% 318M 0s 2024-09-14T11:10:01.454 INFO:teuthology.orchestra.run.smithi097.stderr: 70500K .......... .......... .......... .......... .......... 75% 351M 0s 2024-09-14T11:10:01.454 INFO:teuthology.orchestra.run.smithi097.stderr: 70550K .......... .......... .......... .......... .......... 75% 312M 0s 2024-09-14T11:10:01.454 INFO:teuthology.orchestra.run.smithi097.stderr: 70600K .......... .......... .......... .......... .......... 76% 313M 0s 2024-09-14T11:10:01.454 INFO:teuthology.orchestra.run.smithi097.stderr: 70650K .......... .......... .......... .......... .......... 76% 370M 0s 2024-09-14T11:10:01.454 INFO:teuthology.orchestra.run.smithi097.stderr: 70700K .......... .......... .......... .......... .......... 76% 409M 0s 2024-09-14T11:10:01.454 INFO:teuthology.orchestra.run.smithi097.stderr: 70750K .......... .......... .......... .......... .......... 76% 67.9M 0s 2024-09-14T11:10:01.454 INFO:teuthology.orchestra.run.smithi097.stderr: 70800K .......... .......... .......... .......... .......... 76% 215M 0s 2024-09-14T11:10:01.454 INFO:teuthology.orchestra.run.smithi097.stderr: 70850K .......... .......... .......... .......... .......... 76% 361M 0s 2024-09-14T11:10:01.454 INFO:teuthology.orchestra.run.smithi097.stderr: 70900K .......... .......... .......... .......... .......... 76% 309M 0s 2024-09-14T11:10:01.454 INFO:teuthology.orchestra.run.smithi097.stderr: 70950K .......... .......... .......... .......... .......... 76% 305M 0s 2024-09-14T11:10:01.454 INFO:teuthology.orchestra.run.smithi097.stderr: 71000K .......... .......... .......... .......... .......... 76% 280M 0s 2024-09-14T11:10:01.455 INFO:teuthology.orchestra.run.smithi097.stderr: 71050K .......... .......... .......... .......... .......... 76% 386M 0s 2024-09-14T11:10:01.455 INFO:teuthology.orchestra.run.smithi097.stderr: 71100K .......... .......... .......... .......... .......... 76% 415M 0s 2024-09-14T11:10:01.455 INFO:teuthology.orchestra.run.smithi097.stderr: 71150K .......... .......... .......... .......... .......... 76% 345M 0s 2024-09-14T11:10:01.455 INFO:teuthology.orchestra.run.smithi097.stderr: 71200K .......... .......... .......... .......... .......... 76% 444M 0s 2024-09-14T11:10:01.455 INFO:teuthology.orchestra.run.smithi097.stderr: 71250K .......... .......... .......... .......... .......... 76% 265M 0s 2024-09-14T11:10:01.455 INFO:teuthology.orchestra.run.smithi097.stderr: 71300K .......... .......... .......... .......... .......... 76% 89.8M 0s 2024-09-14T11:10:01.455 INFO:teuthology.orchestra.run.smithi097.stderr: 71350K .......... .......... .......... .......... .......... 76% 428M 0s 2024-09-14T11:10:01.455 INFO:teuthology.orchestra.run.smithi097.stderr: 71400K .......... .......... .......... .......... .......... 76% 414M 0s 2024-09-14T11:10:01.455 INFO:teuthology.orchestra.run.smithi097.stderr: 71450K .......... .......... .......... .......... .......... 76% 181M 0s 2024-09-14T11:10:01.455 INFO:teuthology.orchestra.run.smithi097.stderr: 71500K .......... .......... .......... .......... .......... 77% 314M 0s 2024-09-14T11:10:01.455 INFO:teuthology.orchestra.run.smithi097.stderr: 71550K .......... .......... .......... .......... .......... 77% 302M 0s 2024-09-14T11:10:01.455 INFO:teuthology.orchestra.run.smithi097.stderr: 71600K .......... .......... .......... .......... .......... 77% 347M 0s 2024-09-14T11:10:01.455 INFO:teuthology.orchestra.run.smithi097.stderr: 71650K .......... .......... .......... .......... .......... 77% 362M 0s 2024-09-14T11:10:01.455 INFO:teuthology.orchestra.run.smithi097.stderr: 71700K .......... .......... .......... .......... .......... 77% 227M 0s 2024-09-14T11:10:01.456 INFO:teuthology.orchestra.run.smithi097.stderr: 71750K .......... .......... .......... .......... .......... 77% 84.8M 0s 2024-09-14T11:10:01.456 INFO:teuthology.orchestra.run.smithi097.stderr: 71800K .......... .......... .......... .......... .......... 77% 258M 0s 2024-09-14T11:10:01.456 INFO:teuthology.orchestra.run.smithi097.stderr: 71850K .......... .......... .......... .......... .......... 77% 384M 0s 2024-09-14T11:10:01.456 INFO:teuthology.orchestra.run.smithi097.stderr: 71900K .......... .......... .......... .......... .......... 77% 424M 0s 2024-09-14T11:10:01.456 INFO:teuthology.orchestra.run.smithi097.stderr: 71950K .......... .......... .......... .......... .......... 77% 283M 0s 2024-09-14T11:10:01.456 INFO:teuthology.orchestra.run.smithi097.stderr: 72000K .......... .......... .......... .......... .......... 77% 378M 0s 2024-09-14T11:10:01.456 INFO:teuthology.orchestra.run.smithi097.stderr: 72050K .......... .......... .......... .......... .......... 77% 351M 0s 2024-09-14T11:10:01.456 INFO:teuthology.orchestra.run.smithi097.stderr: 72100K .......... .......... .......... .......... .......... 77% 377M 0s 2024-09-14T11:10:01.456 INFO:teuthology.orchestra.run.smithi097.stderr: 72150K .......... .......... .......... .......... .......... 77% 343M 0s 2024-09-14T11:10:01.456 INFO:teuthology.orchestra.run.smithi097.stderr: 72200K .......... .......... .......... .......... .......... 77% 339M 0s 2024-09-14T11:10:01.456 INFO:teuthology.orchestra.run.smithi097.stderr: 72250K .......... .......... .......... .......... .......... 77% 416M 0s 2024-09-14T11:10:01.456 INFO:teuthology.orchestra.run.smithi097.stderr: 72300K .......... .......... .......... .......... .......... 77% 389M 0s 2024-09-14T11:10:01.456 INFO:teuthology.orchestra.run.smithi097.stderr: 72350K .......... .......... .......... .......... .......... 77% 189M 0s 2024-09-14T11:10:01.456 INFO:teuthology.orchestra.run.smithi097.stderr: 72400K .......... .......... .......... .......... .......... 77% 198M 0s 2024-09-14T11:10:01.456 INFO:teuthology.orchestra.run.smithi097.stderr: 72450K .......... .......... .......... .......... .......... 78% 139M 0s 2024-09-14T11:10:01.457 INFO:teuthology.orchestra.run.smithi097.stderr: 72500K .......... .......... .......... .......... .......... 78% 291M 0s 2024-09-14T11:10:01.457 INFO:teuthology.orchestra.run.smithi097.stderr: 72550K .......... .......... .......... .......... .......... 78% 255M 0s 2024-09-14T11:10:01.457 INFO:teuthology.orchestra.run.smithi097.stderr: 72600K .......... .......... .......... .......... .......... 78% 72.7M 0s 2024-09-14T11:10:01.457 INFO:teuthology.orchestra.run.smithi097.stderr: 72650K .......... .......... .......... .......... .......... 78% 128M 0s 2024-09-14T11:10:01.457 INFO:teuthology.orchestra.run.smithi097.stderr: 72700K .......... .......... .......... .......... .......... 78% 253M 0s 2024-09-14T11:10:01.457 INFO:teuthology.orchestra.run.smithi097.stderr: 72750K .......... .......... .......... .......... .......... 78% 162M 0s 2024-09-14T11:10:01.457 INFO:teuthology.orchestra.run.smithi097.stderr: 72800K .......... .......... .......... .......... .......... 78% 414M 0s 2024-09-14T11:10:01.457 INFO:teuthology.orchestra.run.smithi097.stderr: 72850K .......... .......... .......... .......... .......... 78% 198M 0s 2024-09-14T11:10:01.457 INFO:teuthology.orchestra.run.smithi097.stderr: 72900K .......... .......... .......... .......... .......... 78% 186M 0s 2024-09-14T11:10:01.457 INFO:teuthology.orchestra.run.smithi097.stderr: 72950K .......... .......... .......... .......... .......... 78% 400M 0s 2024-09-14T11:10:01.457 INFO:teuthology.orchestra.run.smithi097.stderr: 73000K .......... .......... .......... .......... .......... 78% 80.8M 0s 2024-09-14T11:10:01.457 INFO:teuthology.orchestra.run.smithi097.stderr: 73050K .......... .......... .......... .......... .......... 78% 389M 0s 2024-09-14T11:10:01.457 INFO:teuthology.orchestra.run.smithi097.stderr: 73100K .......... .......... .......... .......... .......... 78% 343M 0s 2024-09-14T11:10:01.457 INFO:teuthology.orchestra.run.smithi097.stderr: 73150K .......... .......... .......... .......... .......... 78% 391M 0s 2024-09-14T11:10:01.457 INFO:teuthology.orchestra.run.smithi097.stderr: 73200K .......... .......... .......... .......... .......... 78% 387M 0s 2024-09-14T11:10:01.458 INFO:teuthology.orchestra.run.smithi097.stderr: 73250K .......... .......... .......... .......... .......... 78% 97.5M 0s 2024-09-14T11:10:01.458 INFO:teuthology.orchestra.run.smithi097.stderr: 73300K .......... .......... .......... .......... .......... 78% 386M 0s 2024-09-14T11:10:01.458 INFO:teuthology.orchestra.run.smithi097.stderr: 73350K .......... .......... .......... .......... .......... 79% 310M 0s 2024-09-14T11:10:01.458 INFO:teuthology.orchestra.run.smithi097.stderr: 73400K .......... .......... .......... .......... .......... 79% 399M 0s 2024-09-14T11:10:01.458 INFO:teuthology.orchestra.run.smithi097.stderr: 73450K .......... .......... .......... .......... .......... 79% 384M 0s 2024-09-14T11:10:01.458 INFO:teuthology.orchestra.run.smithi097.stderr: 73500K .......... .......... .......... .......... .......... 79% 320M 0s 2024-09-14T11:10:01.458 INFO:teuthology.orchestra.run.smithi097.stderr: 73550K .......... .......... .......... .......... .......... 79% 356M 0s 2024-09-14T11:10:01.458 INFO:teuthology.orchestra.run.smithi097.stderr: 73600K .......... .......... .......... .......... .......... 79% 240M 0s 2024-09-14T11:10:01.458 INFO:teuthology.orchestra.run.smithi097.stderr: 73650K .......... .......... .......... .......... .......... 79% 335M 0s 2024-09-14T11:10:01.458 INFO:teuthology.orchestra.run.smithi097.stderr: 73700K .......... .......... .......... .......... .......... 79% 338M 0s 2024-09-14T11:10:01.458 INFO:teuthology.orchestra.run.smithi097.stderr: 73750K .......... .......... .......... .......... .......... 79% 356M 0s 2024-09-14T11:10:01.458 INFO:teuthology.orchestra.run.smithi097.stderr: 73800K .......... .......... .......... .......... .......... 79% 276M 0s 2024-09-14T11:10:01.458 INFO:teuthology.orchestra.run.smithi097.stderr: 73850K .......... .......... .......... .......... .......... 79% 316M 0s 2024-09-14T11:10:01.458 INFO:teuthology.orchestra.run.smithi097.stderr: 73900K .......... .......... .......... .......... .......... 79% 325M 0s 2024-09-14T11:10:01.459 INFO:teuthology.orchestra.run.smithi097.stderr: 73950K .......... .......... .......... .......... .......... 79% 301M 0s 2024-09-14T11:10:01.459 INFO:teuthology.orchestra.run.smithi097.stderr: 74000K .......... .......... .......... .......... .......... 79% 306M 0s 2024-09-14T11:10:01.459 INFO:teuthology.orchestra.run.smithi097.stderr: 74050K .......... .......... .......... .......... .......... 79% 394M 0s 2024-09-14T11:10:01.459 INFO:teuthology.orchestra.run.smithi097.stderr: 74100K .......... .......... .......... .......... .......... 79% 385M 0s 2024-09-14T11:10:01.459 INFO:teuthology.orchestra.run.smithi097.stderr: 74150K .......... .......... .......... .......... .......... 79% 379M 0s 2024-09-14T11:10:01.459 INFO:teuthology.orchestra.run.smithi097.stderr: 74200K .......... .......... .......... .......... .......... 79% 326M 0s 2024-09-14T11:10:01.459 INFO:teuthology.orchestra.run.smithi097.stderr: 74250K .......... .......... .......... .......... .......... 79% 342M 0s 2024-09-14T11:10:01.459 INFO:teuthology.orchestra.run.smithi097.stderr: 74300K .......... .......... .......... .......... .......... 80% 361M 0s 2024-09-14T11:10:01.459 INFO:teuthology.orchestra.run.smithi097.stderr: 74350K .......... .......... .......... .......... .......... 80% 319M 0s 2024-09-14T11:10:01.459 INFO:teuthology.orchestra.run.smithi097.stderr: 74400K .......... .......... .......... .......... .......... 80% 316M 0s 2024-09-14T11:10:01.459 INFO:teuthology.orchestra.run.smithi097.stderr: 74450K .......... .......... .......... .......... .......... 80% 216M 0s 2024-09-14T11:10:01.460 INFO:teuthology.orchestra.run.smithi097.stderr: 74500K .......... .......... .......... .......... .......... 80% 389M 0s 2024-09-14T11:10:01.460 INFO:teuthology.orchestra.run.smithi097.stderr: 74550K .......... .......... .......... .......... .......... 80% 336M 0s 2024-09-14T11:10:01.460 INFO:teuthology.orchestra.run.smithi097.stderr: 74600K .......... .......... .......... .......... .......... 80% 317M 0s 2024-09-14T11:10:01.460 INFO:teuthology.orchestra.run.smithi097.stderr: 74650K .......... .......... .......... .......... .......... 80% 365M 0s 2024-09-14T11:10:01.460 INFO:teuthology.orchestra.run.smithi097.stderr: 74700K .......... .......... .......... .......... .......... 80% 339M 0s 2024-09-14T11:10:01.460 INFO:teuthology.orchestra.run.smithi097.stderr: 74750K .......... .......... .......... .......... .......... 80% 341M 0s 2024-09-14T11:10:01.460 INFO:teuthology.orchestra.run.smithi097.stderr: 74800K .......... .......... .......... .......... .......... 80% 97.6M 0s 2024-09-14T11:10:01.460 INFO:teuthology.orchestra.run.smithi097.stderr: 74850K .......... .......... .......... .......... .......... 80% 394M 0s 2024-09-14T11:10:01.460 INFO:teuthology.orchestra.run.smithi097.stderr: 74900K .......... .......... .......... .......... .......... 80% 90.1M 0s 2024-09-14T11:10:01.460 INFO:teuthology.orchestra.run.smithi097.stderr: 74950K .......... .......... .......... .......... .......... 80% 201M 0s 2024-09-14T11:10:01.460 INFO:teuthology.orchestra.run.smithi097.stderr: 75000K .......... .......... .......... .......... .......... 80% 316M 0s 2024-09-14T11:10:01.460 INFO:teuthology.orchestra.run.smithi097.stderr: 75050K .......... .......... .......... .......... .......... 80% 297M 0s 2024-09-14T11:10:01.460 INFO:teuthology.orchestra.run.smithi097.stderr: 75100K .......... .......... .......... .......... .......... 80% 177M 0s 2024-09-14T11:10:01.460 INFO:teuthology.orchestra.run.smithi097.stderr: 75150K .......... .......... .......... .......... .......... 80% 431M 0s 2024-09-14T11:10:01.461 INFO:teuthology.orchestra.run.smithi097.stderr: 75200K .......... .......... .......... .......... .......... 81% 358M 0s 2024-09-14T11:10:01.461 INFO:teuthology.orchestra.run.smithi097.stderr: 75250K .......... .......... .......... .......... .......... 81% 430M 0s 2024-09-14T11:10:01.461 INFO:teuthology.orchestra.run.smithi097.stderr: 75300K .......... .......... .......... .......... .......... 81% 387M 0s 2024-09-14T11:10:01.461 INFO:teuthology.orchestra.run.smithi097.stderr: 75350K .......... .......... .......... .......... .......... 81% 282M 0s 2024-09-14T11:10:01.461 INFO:teuthology.orchestra.run.smithi097.stderr: 75400K .......... .......... .......... .......... .......... 81% 245M 0s 2024-09-14T11:10:01.461 INFO:teuthology.orchestra.run.smithi097.stderr: 75450K .......... .......... .......... .......... .......... 81% 174M 0s 2024-09-14T11:10:01.461 INFO:teuthology.orchestra.run.smithi097.stderr: 75500K .......... .......... .......... .......... .......... 81% 64.3M 0s 2024-09-14T11:10:01.461 INFO:teuthology.orchestra.run.smithi097.stderr: 75550K .......... .......... .......... .......... .......... 81% 369M 0s 2024-09-14T11:10:01.461 INFO:teuthology.orchestra.run.smithi097.stderr: 75600K .......... .......... .......... .......... .......... 81% 416M 0s 2024-09-14T11:10:01.461 INFO:teuthology.orchestra.run.smithi097.stderr: 75650K .......... .......... .......... .......... .......... 81% 75.9M 0s 2024-09-14T11:10:01.461 INFO:teuthology.orchestra.run.smithi097.stderr: 75700K .......... .......... .......... .......... .......... 81% 152M 0s 2024-09-14T11:10:01.461 INFO:teuthology.orchestra.run.smithi097.stderr: 75750K .......... .......... .......... .......... .......... 81% 429M 0s 2024-09-14T11:10:01.461 INFO:teuthology.orchestra.run.smithi097.stderr: 75800K .......... .......... .......... .......... .......... 81% 98.6M 0s 2024-09-14T11:10:01.461 INFO:teuthology.orchestra.run.smithi097.stderr: 75850K .......... .......... .......... .......... .......... 81% 75.1M 0s 2024-09-14T11:10:01.462 INFO:teuthology.orchestra.run.smithi097.stderr: 75900K .......... .......... .......... .......... .......... 81% 185M 0s 2024-09-14T11:10:01.462 INFO:teuthology.orchestra.run.smithi097.stderr: 75950K .......... .......... .......... .......... .......... 81% 326M 0s 2024-09-14T11:10:01.462 INFO:teuthology.orchestra.run.smithi097.stderr: 76000K .......... .......... .......... .......... .......... 81% 399M 0s 2024-09-14T11:10:01.462 INFO:teuthology.orchestra.run.smithi097.stderr: 76050K .......... .......... .......... .......... .......... 81% 287M 0s 2024-09-14T11:10:01.462 INFO:teuthology.orchestra.run.smithi097.stderr: 76100K .......... .......... .......... .......... .......... 81% 189M 0s 2024-09-14T11:10:01.462 INFO:teuthology.orchestra.run.smithi097.stderr: 76150K .......... .......... .......... .......... .......... 82% 393M 0s 2024-09-14T11:10:01.462 INFO:teuthology.orchestra.run.smithi097.stderr: 76200K .......... .......... .......... .......... .......... 82% 150M 0s 2024-09-14T11:10:01.462 INFO:teuthology.orchestra.run.smithi097.stderr: 76250K .......... .......... .......... .......... .......... 82% 311M 0s 2024-09-14T11:10:01.462 INFO:teuthology.orchestra.run.smithi097.stderr: 76300K .......... .......... .......... .......... .......... 82% 346M 0s 2024-09-14T11:10:01.462 INFO:teuthology.orchestra.run.smithi097.stderr: 76350K .......... .......... .......... .......... .......... 82% 311M 0s 2024-09-14T11:10:01.462 INFO:teuthology.orchestra.run.smithi097.stderr: 76400K .......... .......... .......... .......... .......... 82% 394M 0s 2024-09-14T11:10:01.462 INFO:teuthology.orchestra.run.smithi097.stderr: 76450K .......... .......... .......... .......... .......... 82% 405M 0s 2024-09-14T11:10:01.462 INFO:teuthology.orchestra.run.smithi097.stderr: 76500K .......... .......... .......... .......... .......... 82% 434M 0s 2024-09-14T11:10:01.462 INFO:teuthology.orchestra.run.smithi097.stderr: 76550K .......... .......... .......... .......... .......... 82% 146M 0s 2024-09-14T11:10:01.463 INFO:teuthology.orchestra.run.smithi097.stderr: 76600K .......... .......... .......... .......... .......... 82% 341M 0s 2024-09-14T11:10:01.463 INFO:teuthology.orchestra.run.smithi097.stderr: 76650K .......... .......... .......... .......... .......... 82% 256M 0s 2024-09-14T11:10:01.463 INFO:teuthology.orchestra.run.smithi097.stderr: 76700K .......... .......... .......... .......... .......... 82% 440M 0s 2024-09-14T11:10:01.463 INFO:teuthology.orchestra.run.smithi097.stderr: 76750K .......... .......... .......... .......... .......... 82% 379M 0s 2024-09-14T11:10:01.463 INFO:teuthology.orchestra.run.smithi097.stderr: 76800K .......... .......... .......... .......... .......... 82% 413M 0s 2024-09-14T11:10:01.463 INFO:teuthology.orchestra.run.smithi097.stderr: 76850K .......... .......... .......... .......... .......... 82% 386M 0s 2024-09-14T11:10:01.463 INFO:teuthology.orchestra.run.smithi097.stderr: 76900K .......... .......... .......... .......... .......... 82% 448M 0s 2024-09-14T11:10:01.463 INFO:teuthology.orchestra.run.smithi097.stderr: 76950K .......... .......... .......... .......... .......... 82% 244M 0s 2024-09-14T11:10:01.463 INFO:teuthology.orchestra.run.smithi097.stderr: 77000K .......... .......... .......... .......... .......... 82% 443M 0s 2024-09-14T11:10:01.463 INFO:teuthology.orchestra.run.smithi097.stderr: 77050K .......... .......... .......... .......... .......... 82% 397M 0s 2024-09-14T11:10:01.463 INFO:teuthology.orchestra.run.smithi097.stderr: 77100K .......... .......... .......... .......... .......... 83% 399M 0s 2024-09-14T11:10:01.463 INFO:teuthology.orchestra.run.smithi097.stderr: 77150K .......... .......... .......... .......... .......... 83% 432M 0s 2024-09-14T11:10:01.463 INFO:teuthology.orchestra.run.smithi097.stderr: 77200K .......... .......... .......... .......... .......... 83% 412M 0s 2024-09-14T11:10:01.463 INFO:teuthology.orchestra.run.smithi097.stderr: 77250K .......... .......... .......... .......... .......... 83% 413M 0s 2024-09-14T11:10:01.464 INFO:teuthology.orchestra.run.smithi097.stderr: 77300K .......... .......... .......... .......... .......... 83% 313M 0s 2024-09-14T11:10:01.464 INFO:teuthology.orchestra.run.smithi097.stderr: 77350K .......... .......... .......... .......... .......... 83% 320M 0s 2024-09-14T11:10:01.464 INFO:teuthology.orchestra.run.smithi097.stderr: 77400K .......... .......... .......... .......... .......... 83% 351M 0s 2024-09-14T11:10:01.464 INFO:teuthology.orchestra.run.smithi097.stderr: 77450K .......... .......... .......... .......... .......... 83% 365M 0s 2024-09-14T11:10:01.464 INFO:teuthology.orchestra.run.smithi097.stderr: 77500K .......... .......... .......... .......... .......... 83% 409M 0s 2024-09-14T11:10:01.464 INFO:teuthology.orchestra.run.smithi097.stderr: 77550K .......... .......... .......... .......... .......... 83% 317M 0s 2024-09-14T11:10:01.464 INFO:teuthology.orchestra.run.smithi097.stderr: 77600K .......... .......... .......... .......... .......... 83% 333M 0s 2024-09-14T11:10:01.464 INFO:teuthology.orchestra.run.smithi097.stderr: 77650K .......... .......... .......... .......... .......... 83% 401M 0s 2024-09-14T11:10:01.464 INFO:teuthology.orchestra.run.smithi097.stderr: 77700K .......... .......... .......... .......... .......... 83% 392M 0s 2024-09-14T11:10:01.464 INFO:teuthology.orchestra.run.smithi097.stderr: 77750K .......... .......... .......... .......... .......... 83% 367M 0s 2024-09-14T11:10:01.464 INFO:teuthology.orchestra.run.smithi097.stderr: 77800K .......... .......... .......... .......... .......... 83% 366M 0s 2024-09-14T11:10:01.464 INFO:teuthology.orchestra.run.smithi097.stderr: 77850K .......... .......... .......... .......... .......... 83% 444M 0s 2024-09-14T11:10:01.464 INFO:teuthology.orchestra.run.smithi097.stderr: 77900K .......... .......... .......... .......... .......... 83% 436M 0s 2024-09-14T11:10:01.464 INFO:teuthology.orchestra.run.smithi097.stderr: 77950K .......... .......... .......... .......... .......... 83% 145M 0s 2024-09-14T11:10:01.464 INFO:teuthology.orchestra.run.smithi097.stderr: 78000K .......... .......... .......... .......... .......... 84% 190M 0s 2024-09-14T11:10:01.465 INFO:teuthology.orchestra.run.smithi097.stderr: 78050K .......... .......... .......... .......... .......... 84% 204M 0s 2024-09-14T11:10:01.465 INFO:teuthology.orchestra.run.smithi097.stderr: 78100K .......... .......... .......... .......... .......... 84% 405M 0s 2024-09-14T11:10:01.465 INFO:teuthology.orchestra.run.smithi097.stderr: 78150K .......... .......... .......... .......... .......... 84% 410M 0s 2024-09-14T11:10:01.465 INFO:teuthology.orchestra.run.smithi097.stderr: 78200K .......... .......... .......... .......... .......... 84% 295M 0s 2024-09-14T11:10:01.465 INFO:teuthology.orchestra.run.smithi097.stderr: 78250K .......... .......... .......... .......... .......... 84% 286M 0s 2024-09-14T11:10:01.465 INFO:teuthology.orchestra.run.smithi097.stderr: 78300K .......... .......... .......... .......... .......... 84% 247M 0s 2024-09-14T11:10:01.465 INFO:teuthology.orchestra.run.smithi097.stderr: 78350K .......... .......... .......... .......... .......... 84% 381M 0s 2024-09-14T11:10:01.465 INFO:teuthology.orchestra.run.smithi097.stderr: 78400K .......... .......... .......... .......... .......... 84% 187M 0s 2024-09-14T11:10:01.465 INFO:teuthology.orchestra.run.smithi097.stderr: 78450K .......... .......... .......... .......... .......... 84% 301M 0s 2024-09-14T11:10:01.465 INFO:teuthology.orchestra.run.smithi097.stderr: 78500K .......... .......... .......... .......... .......... 84% 97.0M 0s 2024-09-14T11:10:01.465 INFO:teuthology.orchestra.run.smithi097.stderr: 78550K .......... .......... .......... .......... .......... 84% 128M 0s 2024-09-14T11:10:01.465 INFO:teuthology.orchestra.run.smithi097.stderr: 78600K .......... .......... .......... .......... .......... 84% 437M 0s 2024-09-14T11:10:01.465 INFO:teuthology.orchestra.run.smithi097.stderr: 78650K .......... .......... .......... .......... .......... 84% 320M 0s 2024-09-14T11:10:01.466 INFO:teuthology.orchestra.run.smithi097.stderr: 78700K .......... .......... .......... .......... .......... 84% 94.4M 0s 2024-09-14T11:10:01.466 INFO:teuthology.orchestra.run.smithi097.stderr: 78750K .......... .......... .......... .......... .......... 84% 164M 0s 2024-09-14T11:10:01.466 INFO:teuthology.orchestra.run.smithi097.stderr: 78800K .......... .......... .......... .......... .......... 84% 104M 0s 2024-09-14T11:10:01.466 INFO:teuthology.orchestra.run.smithi097.stderr: 78850K .......... .......... .......... .......... .......... 84% 364M 0s 2024-09-14T11:10:01.466 INFO:teuthology.orchestra.run.smithi097.stderr: 78900K .......... .......... .......... .......... .......... 84% 55.5M 0s 2024-09-14T11:10:01.466 INFO:teuthology.orchestra.run.smithi097.stderr: 78950K .......... .......... .......... .......... .......... 85% 173M 0s 2024-09-14T11:10:01.466 INFO:teuthology.orchestra.run.smithi097.stderr: 79000K .......... .......... .......... .......... .......... 85% 226M 0s 2024-09-14T11:10:01.466 INFO:teuthology.orchestra.run.smithi097.stderr: 79050K .......... .......... .......... .......... .......... 85% 386M 0s 2024-09-14T11:10:01.466 INFO:teuthology.orchestra.run.smithi097.stderr: 79100K .......... .......... .......... .......... .......... 85% 347M 0s 2024-09-14T11:10:01.466 INFO:teuthology.orchestra.run.smithi097.stderr: 79150K .......... .......... .......... .......... .......... 85% 389M 0s 2024-09-14T11:10:01.466 INFO:teuthology.orchestra.run.smithi097.stderr: 79200K .......... .......... .......... .......... .......... 85% 127M 0s 2024-09-14T11:10:01.466 INFO:teuthology.orchestra.run.smithi097.stderr: 79250K .......... .......... .......... .......... .......... 85% 162M 0s 2024-09-14T11:10:01.466 INFO:teuthology.orchestra.run.smithi097.stderr: 79300K .......... .......... .......... .......... .......... 85% 442M 0s 2024-09-14T11:10:01.466 INFO:teuthology.orchestra.run.smithi097.stderr: 79350K .......... .......... .......... .......... .......... 85% 388M 0s 2024-09-14T11:10:01.466 INFO:teuthology.orchestra.run.smithi097.stderr: 79400K .......... .......... .......... .......... .......... 85% 434M 0s 2024-09-14T11:10:01.467 INFO:teuthology.orchestra.run.smithi097.stderr: 79450K .......... .......... .......... .......... .......... 85% 239M 0s 2024-09-14T11:10:01.467 INFO:teuthology.orchestra.run.smithi097.stderr: 79500K .......... .......... .......... .......... .......... 85% 194M 0s 2024-09-14T11:10:01.467 INFO:teuthology.orchestra.run.smithi097.stderr: 79550K .......... .......... .......... .......... .......... 85% 420M 0s 2024-09-14T11:10:01.467 INFO:teuthology.orchestra.run.smithi097.stderr: 79600K .......... .......... .......... .......... .......... 85% 148M 0s 2024-09-14T11:10:01.467 INFO:teuthology.orchestra.run.smithi097.stderr: 79650K .......... .......... .......... .......... .......... 85% 433M 0s 2024-09-14T11:10:01.467 INFO:teuthology.orchestra.run.smithi097.stderr: 79700K .......... .......... .......... .......... .......... 85% 335M 0s 2024-09-14T11:10:01.467 INFO:teuthology.orchestra.run.smithi097.stderr: 79750K .......... .......... .......... .......... .......... 85% 456M 0s 2024-09-14T11:10:01.467 INFO:teuthology.orchestra.run.smithi097.stderr: 79800K .......... .......... .......... .......... .......... 85% 186M 0s 2024-09-14T11:10:01.467 INFO:teuthology.orchestra.run.smithi097.stderr: 79850K .......... .......... .......... .......... .......... 86% 398M 0s 2024-09-14T11:10:01.467 INFO:teuthology.orchestra.run.smithi097.stderr: 79900K .......... .......... .......... .......... .......... 86% 429M 0s 2024-09-14T11:10:01.467 INFO:teuthology.orchestra.run.smithi097.stderr: 79950K .......... .......... .......... .......... .......... 86% 459M 0s 2024-09-14T11:10:01.467 INFO:teuthology.orchestra.run.smithi097.stderr: 80000K .......... .......... .......... .......... .......... 86% 434M 0s 2024-09-14T11:10:01.467 INFO:teuthology.orchestra.run.smithi097.stderr: 80050K .......... .......... .......... .......... .......... 86% 364M 0s 2024-09-14T11:10:01.468 INFO:teuthology.orchestra.run.smithi097.stderr: 80100K .......... .......... .......... .......... .......... 86% 431M 0s 2024-09-14T11:10:01.468 INFO:teuthology.orchestra.run.smithi097.stderr: 80150K .......... .......... .......... .......... .......... 86% 162M 0s 2024-09-14T11:10:01.468 INFO:teuthology.orchestra.run.smithi097.stderr: 80200K .......... .......... .......... .......... .......... 86% 196M 0s 2024-09-14T11:10:01.468 INFO:teuthology.orchestra.run.smithi097.stderr: 80250K .......... .......... .......... .......... .......... 86% 390M 0s 2024-09-14T11:10:01.468 INFO:teuthology.orchestra.run.smithi097.stderr: 80300K .......... .......... .......... .......... .......... 86% 435M 0s 2024-09-14T11:10:01.468 INFO:teuthology.orchestra.run.smithi097.stderr: 80350K .......... .......... .......... .......... .......... 86% 441M 0s 2024-09-14T11:10:01.468 INFO:teuthology.orchestra.run.smithi097.stderr: 80400K .......... .......... .......... .......... .......... 86% 421M 0s 2024-09-14T11:10:01.468 INFO:teuthology.orchestra.run.smithi097.stderr: 80450K .......... .......... .......... .......... .......... 86% 281M 0s 2024-09-14T11:10:01.468 INFO:teuthology.orchestra.run.smithi097.stderr: 80500K .......... .......... .......... .......... .......... 86% 425M 0s 2024-09-14T11:10:01.468 INFO:teuthology.orchestra.run.smithi097.stderr: 80550K .......... .......... .......... .......... .......... 86% 401M 0s 2024-09-14T11:10:01.468 INFO:teuthology.orchestra.run.smithi097.stderr: 80600K .......... .......... .......... .......... .......... 86% 437M 0s 2024-09-14T11:10:01.468 INFO:teuthology.orchestra.run.smithi097.stderr: 80650K .......... .......... .......... .......... .......... 86% 445M 0s 2024-09-14T11:10:01.468 INFO:teuthology.orchestra.run.smithi097.stderr: 80700K .......... .......... .......... .......... .......... 86% 421M 0s 2024-09-14T11:10:01.468 INFO:teuthology.orchestra.run.smithi097.stderr: 80750K .......... .......... .......... .......... .......... 86% 384M 0s 2024-09-14T11:10:01.469 INFO:teuthology.orchestra.run.smithi097.stderr: 80800K .......... .......... .......... .......... .......... 87% 415M 0s 2024-09-14T11:10:01.469 INFO:teuthology.orchestra.run.smithi097.stderr: 80850K .......... .......... .......... .......... .......... 87% 436M 0s 2024-09-14T11:10:01.469 INFO:teuthology.orchestra.run.smithi097.stderr: 80900K .......... .......... .......... .......... .......... 87% 410M 0s 2024-09-14T11:10:01.469 INFO:teuthology.orchestra.run.smithi097.stderr: 80950K .......... .......... .......... .......... .......... 87% 398M 0s 2024-09-14T11:10:01.469 INFO:teuthology.orchestra.run.smithi097.stderr: 81000K .......... .......... .......... .......... .......... 87% 412M 0s 2024-09-14T11:10:01.469 INFO:teuthology.orchestra.run.smithi097.stderr: 81050K .......... .......... .......... .......... .......... 87% 308M 0s 2024-09-14T11:10:01.469 INFO:teuthology.orchestra.run.smithi097.stderr: 81100K .......... .......... .......... .......... .......... 87% 430M 0s 2024-09-14T11:10:01.469 INFO:teuthology.orchestra.run.smithi097.stderr: 81150K .......... .......... .......... .......... .......... 87% 441M 0s 2024-09-14T11:10:01.469 INFO:teuthology.orchestra.run.smithi097.stderr: 81200K .......... .......... .......... .......... .......... 87% 246M 0s 2024-09-14T11:10:01.469 INFO:teuthology.orchestra.run.smithi097.stderr: 81250K .......... .......... .......... .......... .......... 87% 301M 0s 2024-09-14T11:10:01.469 INFO:teuthology.orchestra.run.smithi097.stderr: 81300K .......... .......... .......... .......... .......... 87% 200M 0s 2024-09-14T11:10:01.469 INFO:teuthology.orchestra.run.smithi097.stderr: 81350K .......... .......... .......... .......... .......... 87% 427M 0s 2024-09-14T11:10:01.469 INFO:teuthology.orchestra.run.smithi097.stderr: 81400K .......... .......... .......... .......... .......... 87% 366M 0s 2024-09-14T11:10:01.469 INFO:teuthology.orchestra.run.smithi097.stderr: 81450K .......... .......... .......... .......... .......... 87% 99.7M 0s 2024-09-14T11:10:01.470 INFO:teuthology.orchestra.run.smithi097.stderr: 81500K .......... .......... .......... .......... .......... 87% 365M 0s 2024-09-14T11:10:01.470 INFO:teuthology.orchestra.run.smithi097.stderr: 81550K .......... .......... .......... .......... .......... 87% 412M 0s 2024-09-14T11:10:01.470 INFO:teuthology.orchestra.run.smithi097.stderr: 81600K .......... .......... .......... .......... .......... 87% 326M 0s 2024-09-14T11:10:01.470 INFO:teuthology.orchestra.run.smithi097.stderr: 81650K .......... .......... .......... .......... .......... 87% 113M 0s 2024-09-14T11:10:01.470 INFO:teuthology.orchestra.run.smithi097.stderr: 81700K .......... .......... .......... .......... .......... 87% 321M 0s 2024-09-14T11:10:01.470 INFO:teuthology.orchestra.run.smithi097.stderr: 81750K .......... .......... .......... .......... .......... 88% 139M 0s 2024-09-14T11:10:01.470 INFO:teuthology.orchestra.run.smithi097.stderr: 81800K .......... .......... .......... .......... .......... 88% 149M 0s 2024-09-14T11:10:01.470 INFO:teuthology.orchestra.run.smithi097.stderr: 81850K .......... .......... .......... .......... .......... 88% 411M 0s 2024-09-14T11:10:01.470 INFO:teuthology.orchestra.run.smithi097.stderr: 81900K .......... .......... .......... .......... .......... 88% 90.7M 0s 2024-09-14T11:10:01.470 INFO:teuthology.orchestra.run.smithi097.stderr: 81950K .......... .......... .......... .......... .......... 88% 49.8M 0s 2024-09-14T11:10:01.470 INFO:teuthology.orchestra.run.smithi097.stderr: 82000K .......... .......... .......... .......... .......... 88% 115M 0s 2024-09-14T11:10:01.470 INFO:teuthology.orchestra.run.smithi097.stderr: 82050K .......... .......... .......... .......... .......... 88% 385M 0s 2024-09-14T11:10:01.470 INFO:teuthology.orchestra.run.smithi097.stderr: 82100K .......... .......... .......... .......... .......... 88% 406M 0s 2024-09-14T11:10:01.470 INFO:teuthology.orchestra.run.smithi097.stderr: 82150K .......... .......... .......... .......... .......... 88% 144M 0s 2024-09-14T11:10:01.471 INFO:teuthology.orchestra.run.smithi097.stderr: 82200K .......... .......... .......... .......... .......... 88% 203M 0s 2024-09-14T11:10:01.471 INFO:teuthology.orchestra.run.smithi097.stderr: 82250K .......... .......... .......... .......... .......... 88% 337M 0s 2024-09-14T11:10:01.471 INFO:teuthology.orchestra.run.smithi097.stderr: 82300K .......... .......... .......... .......... .......... 88% 456M 0s 2024-09-14T11:10:01.471 INFO:teuthology.orchestra.run.smithi097.stderr: 82350K .......... .......... .......... .......... .......... 88% 195M 0s 2024-09-14T11:10:01.471 INFO:teuthology.orchestra.run.smithi097.stderr: 82400K .......... .......... .......... .......... .......... 88% 344M 0s 2024-09-14T11:10:01.471 INFO:teuthology.orchestra.run.smithi097.stderr: 82450K .......... .......... .......... .......... .......... 88% 225M 0s 2024-09-14T11:10:01.471 INFO:teuthology.orchestra.run.smithi097.stderr: 82500K .......... .......... .......... .......... .......... 88% 395M 0s 2024-09-14T11:10:01.471 INFO:teuthology.orchestra.run.smithi097.stderr: 82550K .......... .......... .......... .......... .......... 88% 390M 0s 2024-09-14T11:10:01.471 INFO:teuthology.orchestra.run.smithi097.stderr: 82600K .......... .......... .......... .......... .......... 88% 420M 0s 2024-09-14T11:10:01.471 INFO:teuthology.orchestra.run.smithi097.stderr: 82650K .......... .......... .......... .......... .......... 89% 107M 0s 2024-09-14T11:10:01.471 INFO:teuthology.orchestra.run.smithi097.stderr: 82700K .......... .......... .......... .......... .......... 89% 421M 0s 2024-09-14T11:10:01.471 INFO:teuthology.orchestra.run.smithi097.stderr: 82750K .......... .......... .......... .......... .......... 89% 354M 0s 2024-09-14T11:10:01.471 INFO:teuthology.orchestra.run.smithi097.stderr: 82800K .......... .......... .......... .......... .......... 89% 437M 0s 2024-09-14T11:10:01.471 INFO:teuthology.orchestra.run.smithi097.stderr: 82850K .......... .......... .......... .......... .......... 89% 214M 0s 2024-09-14T11:10:01.471 INFO:teuthology.orchestra.run.smithi097.stderr: 82900K .......... .......... .......... .......... .......... 89% 245M 0s 2024-09-14T11:10:01.472 INFO:teuthology.orchestra.run.smithi097.stderr: 82950K .......... .......... .......... .......... .......... 89% 278M 0s 2024-09-14T11:10:01.472 INFO:teuthology.orchestra.run.smithi097.stderr: 83000K .......... .......... .......... .......... .......... 89% 347M 0s 2024-09-14T11:10:01.472 INFO:teuthology.orchestra.run.smithi097.stderr: 83050K .......... .......... .......... .......... .......... 89% 438M 0s 2024-09-14T11:10:01.472 INFO:teuthology.orchestra.run.smithi097.stderr: 83100K .......... .......... .......... .......... .......... 89% 249M 0s 2024-09-14T11:10:01.472 INFO:teuthology.orchestra.run.smithi097.stderr: 83150K .......... .......... .......... .......... .......... 89% 374M 0s 2024-09-14T11:10:01.472 INFO:teuthology.orchestra.run.smithi097.stderr: 83200K .......... .......... .......... .......... .......... 89% 369M 0s 2024-09-14T11:10:01.472 INFO:teuthology.orchestra.run.smithi097.stderr: 83250K .......... .......... .......... .......... .......... 89% 439M 0s 2024-09-14T11:10:01.472 INFO:teuthology.orchestra.run.smithi097.stderr: 83300K .......... .......... .......... .......... .......... 89% 98.0M 0s 2024-09-14T11:10:01.472 INFO:teuthology.orchestra.run.smithi097.stderr: 83350K .......... .......... .......... .......... .......... 89% 339M 0s 2024-09-14T11:10:01.472 INFO:teuthology.orchestra.run.smithi097.stderr: 83400K .......... .......... .......... .......... .......... 89% 288M 0s 2024-09-14T11:10:01.472 INFO:teuthology.orchestra.run.smithi097.stderr: 83450K .......... .......... .......... .......... .......... 89% 349M 0s 2024-09-14T11:10:01.472 INFO:teuthology.orchestra.run.smithi097.stderr: 83500K .......... .......... .......... .......... .......... 89% 310M 0s 2024-09-14T11:10:01.472 INFO:teuthology.orchestra.run.smithi097.stderr: 83550K .......... .......... .......... .......... .......... 89% 380M 0s 2024-09-14T11:10:01.472 INFO:teuthology.orchestra.run.smithi097.stderr: 83600K .......... .......... .......... .......... .......... 90% 382M 0s 2024-09-14T11:10:01.472 INFO:teuthology.orchestra.run.smithi097.stderr: 83650K .......... .......... .......... .......... .......... 90% 322M 0s 2024-09-14T11:10:01.473 INFO:teuthology.orchestra.run.smithi097.stderr: 83700K .......... .......... .......... .......... .......... 90% 400M 0s 2024-09-14T11:10:01.473 INFO:teuthology.orchestra.run.smithi097.stderr: 83750K .......... .......... .......... .......... .......... 90% 400M 0s 2024-09-14T11:10:01.473 INFO:teuthology.orchestra.run.smithi097.stderr: 83800K .......... .......... .......... .......... .......... 90% 416M 0s 2024-09-14T11:10:01.473 INFO:teuthology.orchestra.run.smithi097.stderr: 83850K .......... .......... .......... .......... .......... 90% 370M 0s 2024-09-14T11:10:01.473 INFO:teuthology.orchestra.run.smithi097.stderr: 83900K .......... .......... .......... .......... .......... 90% 445M 0s 2024-09-14T11:10:01.473 INFO:teuthology.orchestra.run.smithi097.stderr: 83950K .......... .......... .......... .......... .......... 90% 440M 0s 2024-09-14T11:10:01.473 INFO:teuthology.orchestra.run.smithi097.stderr: 84000K .......... .......... .......... .......... .......... 90% 435M 0s 2024-09-14T11:10:01.473 INFO:teuthology.orchestra.run.smithi097.stderr: 84050K .......... .......... .......... .......... .......... 90% 382M 0s 2024-09-14T11:10:01.473 INFO:teuthology.orchestra.run.smithi097.stderr: 84100K .......... .......... .......... .......... .......... 90% 447M 0s 2024-09-14T11:10:01.473 INFO:teuthology.orchestra.run.smithi097.stderr: 84150K .......... .......... .......... .......... .......... 90% 399M 0s 2024-09-14T11:10:01.473 INFO:teuthology.orchestra.run.smithi097.stderr: 84200K .......... .......... .......... .......... .......... 90% 408M 0s 2024-09-14T11:10:01.473 INFO:teuthology.orchestra.run.smithi097.stderr: 84250K .......... .......... .......... .......... .......... 90% 435M 0s 2024-09-14T11:10:01.473 INFO:teuthology.orchestra.run.smithi097.stderr: 84300K .......... .......... .......... .......... .......... 90% 415M 0s 2024-09-14T11:10:01.473 INFO:teuthology.orchestra.run.smithi097.stderr: 84350K .......... .......... .......... .......... .......... 90% 352M 0s 2024-09-14T11:10:01.473 INFO:teuthology.orchestra.run.smithi097.stderr: 84400K .......... .......... .......... .......... .......... 90% 455M 0s 2024-09-14T11:10:01.473 INFO:teuthology.orchestra.run.smithi097.stderr: 84450K .......... .......... .......... .......... .......... 90% 443M 0s 2024-09-14T11:10:01.474 INFO:teuthology.orchestra.run.smithi097.stderr: 84500K .......... .......... .......... .......... .......... 91% 457M 0s 2024-09-14T11:10:01.474 INFO:teuthology.orchestra.run.smithi097.stderr: 84550K .......... .......... .......... .......... .......... 91% 194M 0s 2024-09-14T11:10:01.474 INFO:teuthology.orchestra.run.smithi097.stderr: 84600K .......... .......... .......... .......... .......... 91% 177M 0s 2024-09-14T11:10:01.474 INFO:teuthology.orchestra.run.smithi097.stderr: 84650K .......... .......... .......... .......... .......... 91% 278M 0s 2024-09-14T11:10:01.474 INFO:teuthology.orchestra.run.smithi097.stderr: 84700K .......... .......... .......... .......... .......... 91% 275M 0s 2024-09-14T11:10:01.474 INFO:teuthology.orchestra.run.smithi097.stderr: 84750K .......... .......... .......... .......... .......... 91% 204M 0s 2024-09-14T11:10:01.474 INFO:teuthology.orchestra.run.smithi097.stderr: 84800K .......... .......... .......... .......... .......... 91% 238M 0s 2024-09-14T11:10:01.474 INFO:teuthology.orchestra.run.smithi097.stderr: 84850K .......... .......... .......... .......... .......... 91% 107M 0s 2024-09-14T11:10:01.474 INFO:teuthology.orchestra.run.smithi097.stderr: 84900K .......... .......... .......... .......... .......... 91% 378M 0s 2024-09-14T11:10:01.474 INFO:teuthology.orchestra.run.smithi097.stderr: 84950K .......... .......... .......... .......... .......... 91% 80.4M 0s 2024-09-14T11:10:01.474 INFO:teuthology.orchestra.run.smithi097.stderr: 85000K .......... .......... .......... .......... .......... 91% 50.8M 0s 2024-09-14T11:10:01.474 INFO:teuthology.orchestra.run.smithi097.stderr: 85050K .......... .......... .......... .......... .......... 91% 111M 0s 2024-09-14T11:10:01.474 INFO:teuthology.orchestra.run.smithi097.stderr: 85100K .......... .......... .......... .......... .......... 91% 379M 0s 2024-09-14T11:10:01.474 INFO:teuthology.orchestra.run.smithi097.stderr: 85150K .......... .......... .......... .......... .......... 91% 200M 0s 2024-09-14T11:10:01.474 INFO:teuthology.orchestra.run.smithi097.stderr: 85200K .......... .......... .......... .......... .......... 91% 422M 0s 2024-09-14T11:10:01.475 INFO:teuthology.orchestra.run.smithi097.stderr: 85250K .......... .......... .......... .......... .......... 91% 319M 0s 2024-09-14T11:10:01.475 INFO:teuthology.orchestra.run.smithi097.stderr: 85300K .......... .......... .......... .......... .......... 91% 98.0M 0s 2024-09-14T11:10:01.475 INFO:teuthology.orchestra.run.smithi097.stderr: 85350K .......... .......... .......... .......... .......... 91% 386M 0s 2024-09-14T11:10:01.475 INFO:teuthology.orchestra.run.smithi097.stderr: 85400K .......... .......... .......... .......... .......... 91% 446M 0s 2024-09-14T11:10:01.475 INFO:teuthology.orchestra.run.smithi097.stderr: 85450K .......... .......... .......... .......... .......... 92% 262M 0s 2024-09-14T11:10:01.475 INFO:teuthology.orchestra.run.smithi097.stderr: 85500K .......... .......... .......... .......... .......... 92% 379M 0s 2024-09-14T11:10:01.475 INFO:teuthology.orchestra.run.smithi097.stderr: 85550K .......... .......... .......... .......... .......... 92% 370M 0s 2024-09-14T11:10:01.475 INFO:teuthology.orchestra.run.smithi097.stderr: 85600K .......... .......... .......... .......... .......... 92% 311M 0s 2024-09-14T11:10:01.475 INFO:teuthology.orchestra.run.smithi097.stderr: 85650K .......... .......... .......... .......... .......... 92% 301M 0s 2024-09-14T11:10:01.475 INFO:teuthology.orchestra.run.smithi097.stderr: 85700K .......... .......... .......... .......... .......... 92% 265M 0s 2024-09-14T11:10:01.475 INFO:teuthology.orchestra.run.smithi097.stderr: 85750K .......... .......... .......... .......... .......... 92% 91.2M 0s 2024-09-14T11:10:01.475 INFO:teuthology.orchestra.run.smithi097.stderr: 85800K .......... .......... .......... .......... .......... 92% 400M 0s 2024-09-14T11:10:01.475 INFO:teuthology.orchestra.run.smithi097.stderr: 85850K .......... .......... .......... .......... .......... 92% 185M 0s 2024-09-14T11:10:01.475 INFO:teuthology.orchestra.run.smithi097.stderr: 85900K .......... .......... .......... .......... .......... 92% 388M 0s 2024-09-14T11:10:01.475 INFO:teuthology.orchestra.run.smithi097.stderr: 85950K .......... .......... .......... .......... .......... 92% 327M 0s 2024-09-14T11:10:01.475 INFO:teuthology.orchestra.run.smithi097.stderr: 86000K .......... .......... .......... .......... .......... 92% 400M 0s 2024-09-14T11:10:01.476 INFO:teuthology.orchestra.run.smithi097.stderr: 86050K .......... .......... .......... .......... .......... 92% 358M 0s 2024-09-14T11:10:01.476 INFO:teuthology.orchestra.run.smithi097.stderr: 86100K .......... .......... .......... .......... .......... 92% 348M 0s 2024-09-14T11:10:01.476 INFO:teuthology.orchestra.run.smithi097.stderr: 86150K .......... .......... .......... .......... .......... 92% 423M 0s 2024-09-14T11:10:01.476 INFO:teuthology.orchestra.run.smithi097.stderr: 86200K .......... .......... .......... .......... .......... 92% 434M 0s 2024-09-14T11:10:01.476 INFO:teuthology.orchestra.run.smithi097.stderr: 86250K .......... .......... .......... .......... .......... 92% 346M 0s 2024-09-14T11:10:01.476 INFO:teuthology.orchestra.run.smithi097.stderr: 86300K .......... .......... .......... .......... .......... 92% 154M 0s 2024-09-14T11:10:01.476 INFO:teuthology.orchestra.run.smithi097.stderr: 86350K .......... .......... .......... .......... .......... 93% 398M 0s 2024-09-14T11:10:01.476 INFO:teuthology.orchestra.run.smithi097.stderr: 86400K .......... .......... .......... .......... .......... 93% 153M 0s 2024-09-14T11:10:01.476 INFO:teuthology.orchestra.run.smithi097.stderr: 86450K .......... .......... .......... .......... .......... 93% 443M 0s 2024-09-14T11:10:01.476 INFO:teuthology.orchestra.run.smithi097.stderr: 86500K .......... .......... .......... .......... .......... 93% 414M 0s 2024-09-14T11:10:01.476 INFO:teuthology.orchestra.run.smithi097.stderr: 86550K .......... .......... .......... .......... .......... 93% 176M 0s 2024-09-14T11:10:01.476 INFO:teuthology.orchestra.run.smithi097.stderr: 86600K .......... .......... .......... .......... .......... 93% 446M 0s 2024-09-14T11:10:01.476 INFO:teuthology.orchestra.run.smithi097.stderr: 86650K .......... .......... .......... .......... .......... 93% 438M 0s 2024-09-14T11:10:01.476 INFO:teuthology.orchestra.run.smithi097.stderr: 86700K .......... .......... .......... .......... .......... 93% 451M 0s 2024-09-14T11:10:01.476 INFO:teuthology.orchestra.run.smithi097.stderr: 86750K .......... .......... .......... .......... .......... 93% 404M 0s 2024-09-14T11:10:01.476 INFO:teuthology.orchestra.run.smithi097.stderr: 86800K .......... .......... .......... .......... .......... 93% 447M 0s 2024-09-14T11:10:01.477 INFO:teuthology.orchestra.run.smithi097.stderr: 86850K .......... .......... .......... .......... .......... 93% 444M 0s 2024-09-14T11:10:01.477 INFO:teuthology.orchestra.run.smithi097.stderr: 86900K .......... .......... .......... .......... .......... 93% 456M 0s 2024-09-14T11:10:01.477 INFO:teuthology.orchestra.run.smithi097.stderr: 86950K .......... .......... .......... .......... .......... 93% 128M 0s 2024-09-14T11:10:01.477 INFO:teuthology.orchestra.run.smithi097.stderr: 87000K .......... .......... .......... .......... .......... 93% 261M 0s 2024-09-14T11:10:01.477 INFO:teuthology.orchestra.run.smithi097.stderr: 87050K .......... .......... .......... .......... .......... 93% 446M 0s 2024-09-14T11:10:01.477 INFO:teuthology.orchestra.run.smithi097.stderr: 87100K .......... .......... .......... .......... .......... 93% 412M 0s 2024-09-14T11:10:01.477 INFO:teuthology.orchestra.run.smithi097.stderr: 87150K .......... .......... .......... .......... .......... 93% 438M 0s 2024-09-14T11:10:01.477 INFO:teuthology.orchestra.run.smithi097.stderr: 87200K .......... .......... .......... .......... .......... 93% 449M 0s 2024-09-14T11:10:01.477 INFO:teuthology.orchestra.run.smithi097.stderr: 87250K .......... .......... .......... .......... .......... 93% 362M 0s 2024-09-14T11:10:01.477 INFO:teuthology.orchestra.run.smithi097.stderr: 87300K .......... .......... .......... .......... .......... 94% 431M 0s 2024-09-14T11:10:01.477 INFO:teuthology.orchestra.run.smithi097.stderr: 87350K .......... .......... .......... .......... .......... 94% 408M 0s 2024-09-14T11:10:01.477 INFO:teuthology.orchestra.run.smithi097.stderr: 87400K .......... .......... .......... .......... .......... 94% 427M 0s 2024-09-14T11:10:01.477 INFO:teuthology.orchestra.run.smithi097.stderr: 87450K .......... .......... .......... .......... .......... 94% 363M 0s 2024-09-14T11:10:01.477 INFO:teuthology.orchestra.run.smithi097.stderr: 87500K .......... .......... .......... .......... .......... 94% 404M 0s 2024-09-14T11:10:01.477 INFO:teuthology.orchestra.run.smithi097.stderr: 87550K .......... .......... .......... .......... .......... 94% 408M 0s 2024-09-14T11:10:01.477 INFO:teuthology.orchestra.run.smithi097.stderr: 87600K .......... .......... .......... .......... .......... 94% 432M 0s 2024-09-14T11:10:01.478 INFO:teuthology.orchestra.run.smithi097.stderr: 87650K .......... .......... .......... .......... .......... 94% 399M 0s 2024-09-14T11:10:01.478 INFO:teuthology.orchestra.run.smithi097.stderr: 87700K .......... .......... .......... .......... .......... 94% 397M 0s 2024-09-14T11:10:01.478 INFO:teuthology.orchestra.run.smithi097.stderr: 87750K .......... .......... .......... .......... .......... 94% 123M 0s 2024-09-14T11:10:01.478 INFO:teuthology.orchestra.run.smithi097.stderr: 87800K .......... .......... .......... .......... .......... 94% 394M 0s 2024-09-14T11:10:01.478 INFO:teuthology.orchestra.run.smithi097.stderr: 87850K .......... .......... .......... .......... .......... 94% 433M 0s 2024-09-14T11:10:01.478 INFO:teuthology.orchestra.run.smithi097.stderr: 87900K .......... .......... .......... .......... .......... 94% 259M 0s 2024-09-14T11:10:01.478 INFO:teuthology.orchestra.run.smithi097.stderr: 87950K .......... .......... .......... .......... .......... 94% 300M 0s 2024-09-14T11:10:01.478 INFO:teuthology.orchestra.run.smithi097.stderr: 88000K .......... .......... .......... .......... .......... 94% 69.1M 0s 2024-09-14T11:10:01.478 INFO:teuthology.orchestra.run.smithi097.stderr: 88050K .......... .......... .......... .......... .......... 94% 55.0M 0s 2024-09-14T11:10:01.478 INFO:teuthology.orchestra.run.smithi097.stderr: 88100K .......... .......... .......... .......... .......... 94% 90.2M 0s 2024-09-14T11:10:01.478 INFO:teuthology.orchestra.run.smithi097.stderr: 88150K .......... .......... .......... .......... .......... 94% 372M 0s 2024-09-14T11:10:01.478 INFO:teuthology.orchestra.run.smithi097.stderr: 88200K .......... .......... .......... .......... .......... 94% 297M 0s 2024-09-14T11:10:01.478 INFO:teuthology.orchestra.run.smithi097.stderr: 88250K .......... .......... .......... .......... .......... 95% 376M 0s 2024-09-14T11:10:01.478 INFO:teuthology.orchestra.run.smithi097.stderr: 88300K .......... .......... .......... .......... .......... 95% 332M 0s 2024-09-14T11:10:01.478 INFO:teuthology.orchestra.run.smithi097.stderr: 88350K .......... .......... .......... .......... .......... 95% 102M 0s 2024-09-14T11:10:01.478 INFO:teuthology.orchestra.run.smithi097.stderr: 88400K .......... .......... .......... .......... .......... 95% 345M 0s 2024-09-14T11:10:01.479 INFO:teuthology.orchestra.run.smithi097.stderr: 88450K .......... .......... .......... .......... .......... 95% 107M 0s 2024-09-14T11:10:01.479 INFO:teuthology.orchestra.run.smithi097.stderr: 88500K .......... .......... .......... .......... .......... 95% 403M 0s 2024-09-14T11:10:01.479 INFO:teuthology.orchestra.run.smithi097.stderr: 88550K .......... .......... .......... .......... .......... 95% 351M 0s 2024-09-14T11:10:01.479 INFO:teuthology.orchestra.run.smithi097.stderr: 88600K .......... .......... .......... .......... .......... 95% 326M 0s 2024-09-14T11:10:01.479 INFO:teuthology.orchestra.run.smithi097.stderr: 88650K .......... .......... .......... .......... .......... 95% 380M 0s 2024-09-14T11:10:01.479 INFO:teuthology.orchestra.run.smithi097.stderr: 88700K .......... .......... .......... .......... .......... 95% 358M 0s 2024-09-14T11:10:01.479 INFO:teuthology.orchestra.run.smithi097.stderr: 88750K .......... .......... .......... .......... .......... 95% 444M 0s 2024-09-14T11:10:01.479 INFO:teuthology.orchestra.run.smithi097.stderr: 88800K .......... .......... .......... .......... .......... 95% 84.6M 0s 2024-09-14T11:10:01.479 INFO:teuthology.orchestra.run.smithi097.stderr: 88850K .......... .......... .......... .......... .......... 95% 424M 0s 2024-09-14T11:10:01.479 INFO:teuthology.orchestra.run.smithi097.stderr: 88900K .......... .......... .......... .......... .......... 95% 188M 0s 2024-09-14T11:10:01.479 INFO:teuthology.orchestra.run.smithi097.stderr: 88950K .......... .......... .......... .......... .......... 95% 254M 0s 2024-09-14T11:10:01.479 INFO:teuthology.orchestra.run.smithi097.stderr: 89000K .......... .......... .......... .......... .......... 95% 217M 0s 2024-09-14T11:10:01.479 INFO:teuthology.orchestra.run.smithi097.stderr: 89050K .......... .......... .......... .......... .......... 95% 336M 0s 2024-09-14T11:10:01.479 INFO:teuthology.orchestra.run.smithi097.stderr: 89100K .......... .......... .......... .......... .......... 95% 426M 0s 2024-09-14T11:10:01.479 INFO:teuthology.orchestra.run.smithi097.stderr: 89150K .......... .......... .......... .......... .......... 96% 413M 0s 2024-09-14T11:10:01.480 INFO:teuthology.orchestra.run.smithi097.stderr: 89200K .......... .......... .......... .......... .......... 96% 357M 0s 2024-09-14T11:10:01.480 INFO:teuthology.orchestra.run.smithi097.stderr: 89250K .......... .......... .......... .......... .......... 96% 449M 0s 2024-09-14T11:10:01.480 INFO:teuthology.orchestra.run.smithi097.stderr: 89300K .......... .......... .......... .......... .......... 96% 388M 0s 2024-09-14T11:10:01.480 INFO:teuthology.orchestra.run.smithi097.stderr: 89350K .......... .......... .......... .......... .......... 96% 394M 0s 2024-09-14T11:10:01.480 INFO:teuthology.orchestra.run.smithi097.stderr: 89400K .......... .......... .......... .......... .......... 96% 270M 0s 2024-09-14T11:10:01.480 INFO:teuthology.orchestra.run.smithi097.stderr: 89450K .......... .......... .......... .......... .......... 96% 237M 0s 2024-09-14T11:10:01.480 INFO:teuthology.orchestra.run.smithi097.stderr: 89500K .......... .......... .......... .......... .......... 96% 210M 0s 2024-09-14T11:10:01.480 INFO:teuthology.orchestra.run.smithi097.stderr: 89550K .......... .......... .......... .......... .......... 96% 424M 0s 2024-09-14T11:10:01.480 INFO:teuthology.orchestra.run.smithi097.stderr: 89600K .......... .......... .......... .......... .......... 96% 446M 0s 2024-09-14T11:10:01.480 INFO:teuthology.orchestra.run.smithi097.stderr: 89650K .......... .......... .......... .......... .......... 96% 116M 0s 2024-09-14T11:10:01.480 INFO:teuthology.orchestra.run.smithi097.stderr: 89700K .......... .......... .......... .......... .......... 96% 369M 0s 2024-09-14T11:10:01.480 INFO:teuthology.orchestra.run.smithi097.stderr: 89750K .......... .......... .......... .......... .......... 96% 405M 0s 2024-09-14T11:10:01.480 INFO:teuthology.orchestra.run.smithi097.stderr: 89800K .......... .......... .......... .......... .......... 96% 362M 0s 2024-09-14T11:10:01.480 INFO:teuthology.orchestra.run.smithi097.stderr: 89850K .......... .......... .......... .......... .......... 96% 449M 0s 2024-09-14T11:10:01.480 INFO:teuthology.orchestra.run.smithi097.stderr: 89900K .......... .......... .......... .......... .......... 96% 459M 0s 2024-09-14T11:10:01.481 INFO:teuthology.orchestra.run.smithi097.stderr: 89950K .......... .......... .......... .......... .......... 96% 214M 0s 2024-09-14T11:10:01.481 INFO:teuthology.orchestra.run.smithi097.stderr: 90000K .......... .......... .......... .......... .......... 96% 329M 0s 2024-09-14T11:10:01.481 INFO:teuthology.orchestra.run.smithi097.stderr: 90050K .......... .......... .......... .......... .......... 96% 376M 0s 2024-09-14T11:10:01.481 INFO:teuthology.orchestra.run.smithi097.stderr: 90100K .......... .......... .......... .......... .......... 97% 382M 0s 2024-09-14T11:10:01.481 INFO:teuthology.orchestra.run.smithi097.stderr: 90150K .......... .......... .......... .......... .......... 97% 402M 0s 2024-09-14T11:10:01.481 INFO:teuthology.orchestra.run.smithi097.stderr: 90200K .......... .......... .......... .......... .......... 97% 364M 0s 2024-09-14T11:10:01.481 INFO:teuthology.orchestra.run.smithi097.stderr: 90250K .......... .......... .......... .......... .......... 97% 419M 0s 2024-09-14T11:10:01.481 INFO:teuthology.orchestra.run.smithi097.stderr: 90300K .......... .......... .......... .......... .......... 97% 299M 0s 2024-09-14T11:10:01.481 INFO:teuthology.orchestra.run.smithi097.stderr: 90350K .......... .......... .......... .......... .......... 97% 347M 0s 2024-09-14T11:10:01.481 INFO:teuthology.orchestra.run.smithi097.stderr: 90400K .......... .......... .......... .......... .......... 97% 335M 0s 2024-09-14T11:10:01.481 INFO:teuthology.orchestra.run.smithi097.stderr: 90450K .......... .......... .......... .......... .......... 97% 379M 0s 2024-09-14T11:10:01.481 INFO:teuthology.orchestra.run.smithi097.stderr: 90500K .......... .......... .......... .......... .......... 97% 422M 0s 2024-09-14T11:10:01.481 INFO:teuthology.orchestra.run.smithi097.stderr: 90550K .......... .......... .......... .......... .......... 97% 455M 0s 2024-09-14T11:10:01.481 INFO:teuthology.orchestra.run.smithi097.stderr: 90600K .......... .......... .......... .......... .......... 97% 412M 0s 2024-09-14T11:10:01.482 INFO:teuthology.orchestra.run.smithi097.stderr: 90650K .......... .......... .......... .......... .......... 97% 182M 0s 2024-09-14T11:10:01.482 INFO:teuthology.orchestra.run.smithi097.stderr: 90700K .......... .......... .......... .......... .......... 97% 378M 0s 2024-09-14T11:10:01.482 INFO:teuthology.orchestra.run.smithi097.stderr: 90750K .......... .......... .......... .......... .......... 97% 409M 0s 2024-09-14T11:10:01.482 INFO:teuthology.orchestra.run.smithi097.stderr: 90800K .......... .......... .......... .......... .......... 97% 433M 0s 2024-09-14T11:10:01.482 INFO:teuthology.orchestra.run.smithi097.stderr: 90850K .......... .......... .......... .......... .......... 97% 219M 0s 2024-09-14T11:10:01.482 INFO:teuthology.orchestra.run.smithi097.stderr: 90900K .......... .......... .......... .......... .......... 97% 368M 0s 2024-09-14T11:10:01.482 INFO:teuthology.orchestra.run.smithi097.stderr: 90950K .......... .......... .......... .......... .......... 97% 462M 0s 2024-09-14T11:10:01.482 INFO:teuthology.orchestra.run.smithi097.stderr: 91000K .......... .......... .......... .......... .......... 98% 470M 0s 2024-09-14T11:10:01.482 INFO:teuthology.orchestra.run.smithi097.stderr: 91050K .......... .......... .......... .......... .......... 98% 102M 0s 2024-09-14T11:10:01.482 INFO:teuthology.orchestra.run.smithi097.stderr: 91100K .......... .......... .......... .......... .......... 98% 56.3M 0s 2024-09-14T11:10:01.482 INFO:teuthology.orchestra.run.smithi097.stderr: 91150K .......... .......... .......... .......... .......... 98% 87.5M 0s 2024-09-14T11:10:01.482 INFO:teuthology.orchestra.run.smithi097.stderr: 91200K .......... .......... .......... .......... .......... 98% 396M 0s 2024-09-14T11:10:01.482 INFO:teuthology.orchestra.run.smithi097.stderr: 91250K .......... .......... .......... .......... .......... 98% 121M 0s 2024-09-14T11:10:01.482 INFO:teuthology.orchestra.run.smithi097.stderr: 91300K .......... .......... .......... .......... .......... 98% 401M 0s 2024-09-14T11:10:01.482 INFO:teuthology.orchestra.run.smithi097.stderr: 91350K .......... .......... .......... .......... .......... 98% 100M 0s 2024-09-14T11:10:01.483 INFO:teuthology.orchestra.run.smithi097.stderr: 91400K .......... .......... .......... .......... .......... 98% 273M 0s 2024-09-14T11:10:01.483 INFO:teuthology.orchestra.run.smithi097.stderr: 91450K .......... .......... .......... .......... .......... 98% 395M 0s 2024-09-14T11:10:01.483 INFO:teuthology.orchestra.run.smithi097.stderr: 91500K .......... .......... .......... .......... .......... 98% 163M 0s 2024-09-14T11:10:01.483 INFO:teuthology.orchestra.run.smithi097.stderr: 91550K .......... .......... .......... .......... .......... 98% 249M 0s 2024-09-14T11:10:01.483 INFO:teuthology.orchestra.run.smithi097.stderr: 91600K .......... .......... .......... .......... .......... 98% 228M 0s 2024-09-14T11:10:01.483 INFO:teuthology.orchestra.run.smithi097.stderr: 91650K .......... .......... .......... .......... .......... 98% 309M 0s 2024-09-14T11:10:01.483 INFO:teuthology.orchestra.run.smithi097.stderr: 91700K .......... .......... .......... .......... .......... 98% 314M 0s 2024-09-14T11:10:01.483 INFO:teuthology.orchestra.run.smithi097.stderr: 91750K .......... .......... .......... .......... .......... 98% 364M 0s 2024-09-14T11:10:01.483 INFO:teuthology.orchestra.run.smithi097.stderr: 91800K .......... .......... .......... .......... .......... 98% 105M 0s 2024-09-14T11:10:01.483 INFO:teuthology.orchestra.run.smithi097.stderr: 91850K .......... .......... .......... .......... .......... 98% 385M 0s 2024-09-14T11:10:01.483 INFO:teuthology.orchestra.run.smithi097.stderr: 91900K .......... .......... .......... .......... .......... 98% 353M 0s 2024-09-14T11:10:01.483 INFO:teuthology.orchestra.run.smithi097.stderr: 91950K .......... .......... .......... .......... .......... 99% 415M 0s 2024-09-14T11:10:01.483 INFO:teuthology.orchestra.run.smithi097.stderr: 92000K .......... .......... .......... .......... .......... 99% 165M 0s 2024-09-14T11:10:01.483 INFO:teuthology.orchestra.run.smithi097.stderr: 92050K .......... .......... .......... .......... .......... 99% 224M 0s 2024-09-14T11:10:01.483 INFO:teuthology.orchestra.run.smithi097.stderr: 92100K .......... .......... .......... .......... .......... 99% 450M 0s 2024-09-14T11:10:01.483 INFO:teuthology.orchestra.run.smithi097.stderr: 92150K .......... .......... .......... .......... .......... 99% 159M 0s 2024-09-14T11:10:01.484 INFO:teuthology.orchestra.run.smithi097.stderr: 92200K .......... .......... .......... .......... .......... 99% 380M 0s 2024-09-14T11:10:01.484 INFO:teuthology.orchestra.run.smithi097.stderr: 92250K .......... .......... .......... .......... .......... 99% 461M 0s 2024-09-14T11:10:01.484 INFO:teuthology.orchestra.run.smithi097.stderr: 92300K .......... .......... .......... .......... .......... 99% 437M 0s 2024-09-14T11:10:01.484 INFO:teuthology.orchestra.run.smithi097.stderr: 92350K .......... .......... .......... .......... .......... 99% 374M 0s 2024-09-14T11:10:01.484 INFO:teuthology.orchestra.run.smithi097.stderr: 92400K .......... .......... .......... .......... .......... 99% 311M 0s 2024-09-14T11:10:01.484 INFO:teuthology.orchestra.run.smithi097.stderr: 92450K .......... .......... .......... .......... .......... 99% 182M 0s 2024-09-14T11:10:01.484 INFO:teuthology.orchestra.run.smithi097.stderr: 92500K .......... .......... .......... .......... .......... 99% 308M 0s 2024-09-14T11:10:01.484 INFO:teuthology.orchestra.run.smithi097.stderr: 92550K .......... .......... .......... .......... .......... 99% 175M 0s 2024-09-14T11:10:01.484 INFO:teuthology.orchestra.run.smithi097.stderr: 92600K .......... .......... .......... .......... .......... 99% 360M 0s 2024-09-14T11:10:01.484 INFO:teuthology.orchestra.run.smithi097.stderr: 92650K .......... .......... .......... .......... .......... 99% 205M 0s 2024-09-14T11:10:01.484 INFO:teuthology.orchestra.run.smithi097.stderr: 92700K .......... .......... .......... .......... .......... 99% 202M 0s 2024-09-14T11:10:01.484 INFO:teuthology.orchestra.run.smithi097.stderr: 92750K .......... .......... .......... .......... .......... 99% 348M 0s 2024-09-14T11:10:01.484 INFO:teuthology.orchestra.run.smithi097.stderr: 92800K .......... .......... .......... .......... .......... 99% 384M 0s 2024-09-14T11:10:01.484 INFO:teuthology.orchestra.run.smithi097.stderr: 92850K .......... .......... .......... .......... .......... 99% 355M 0s 2024-09-14T11:10:01.484 INFO:teuthology.orchestra.run.smithi097.stderr: 92900K 100% 134G=0.5s 2024-09-14T11:10:01.484 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-09-14T11:10:01.485 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14 11:10:00 (191 MB/s) - ‘gradle-6.0.1-bin.zip’ saved [95129672/95129672] 2024-09-14T11:10:01.485 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-09-14T11:10:01.518 INFO:teuthology.orchestra.run.smithi097.stdout:Archive: gradle-6.0.1-bin.zip 2024-09-14T11:10:01.518 INFO:teuthology.orchestra.run.smithi097.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-09-14T11:10:01.518 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-09-14T11:10:01.519 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-09-14T11:10:01.519 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-09-14T11:10:01.519 INFO:teuthology.orchestra.run.smithi097.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-09-14T11:10:01.519 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-09-14T11:10:01.519 INFO:teuthology.orchestra.run.smithi097.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-09-14T11:10:01.519 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-09-14T11:10:01.519 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-09-14T11:10:01.519 INFO:teuthology.orchestra.run.smithi097.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-09-14T11:10:01.519 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-09-14T11:10:01.519 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-09-14T11:10:01.519 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-09-14T11:10:01.519 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-09-14T11:10:01.519 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-09-14T11:10:01.520 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-09-14T11:10:01.520 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-09-14T11:10:01.520 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-09-14T11:10:01.520 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-09-14T11:10:01.520 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-09-14T11:10:01.520 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-09-14T11:10:01.520 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-09-14T11:10:01.520 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-09-14T11:10:01.520 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-09-14T11:10:01.520 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-09-14T11:10:01.520 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-09-14T11:10:01.520 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-09-14T11:10:01.520 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-09-14T11:10:01.521 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-09-14T11:10:01.521 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-09-14T11:10:01.521 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-09-14T11:10:01.521 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-09-14T11:10:01.521 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-09-14T11:10:01.521 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-09-14T11:10:01.521 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-09-14T11:10:01.521 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-09-14T11:10:01.521 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-09-14T11:10:01.521 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-09-14T11:10:01.521 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-09-14T11:10:01.521 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-09-14T11:10:01.521 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-09-14T11:10:01.521 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-09-14T11:10:01.522 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-09-14T11:10:01.522 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-09-14T11:10:01.522 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-09-14T11:10:01.522 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-09-14T11:10:01.522 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-09-14T11:10:01.522 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-09-14T11:10:01.522 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-09-14T11:10:01.522 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-09-14T11:10:01.522 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-09-14T11:10:01.522 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-09-14T11:10:01.522 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-09-14T11:10:01.522 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-09-14T11:10:01.522 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-09-14T11:10:01.523 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-09-14T11:10:01.523 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-09-14T11:10:01.523 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-09-14T11:10:01.523 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-09-14T11:10:01.523 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-09-14T11:10:01.523 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-09-14T11:10:01.523 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-09-14T11:10:01.523 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-09-14T11:10:01.523 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-09-14T11:10:01.523 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-09-14T11:10:01.523 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-09-14T11:10:01.523 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-09-14T11:10:01.523 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-09-14T11:10:01.523 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-09-14T11:10:01.523 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-09-14T11:10:01.524 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-09-14T11:10:01.524 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-09-14T11:10:01.524 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-09-14T11:10:01.524 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-09-14T11:10:01.524 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-09-14T11:10:01.524 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-09-14T11:10:01.524 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-09-14T11:10:01.524 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-09-14T11:10:01.524 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-09-14T11:10:01.524 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-09-14T11:10:01.524 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-09-14T11:10:01.524 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-09-14T11:10:01.524 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-09-14T11:10:01.524 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-09-14T11:10:01.525 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-09-14T11:10:01.525 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-09-14T11:10:01.525 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-09-14T11:10:01.525 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-09-14T11:10:01.525 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-09-14T11:10:01.525 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-09-14T11:10:01.525 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-09-14T11:10:01.525 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-09-14T11:10:01.525 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-09-14T11:10:01.525 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-09-14T11:10:01.525 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-09-14T11:10:01.525 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-09-14T11:10:01.525 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-09-14T11:10:01.525 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-09-14T11:10:01.526 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-09-14T11:10:01.526 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-09-14T11:10:01.526 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-09-14T11:10:01.526 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-09-14T11:10:01.526 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-09-14T11:10:01.526 INFO:teuthology.orchestra.run.smithi097.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-09-14T11:10:01.526 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-09-14T11:10:01.526 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-09-14T11:10:01.526 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-09-14T11:10:01.526 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-09-14T11:10:01.526 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-09-14T11:10:01.526 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-09-14T11:10:01.526 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-09-14T11:10:01.526 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-09-14T11:10:01.526 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-09-14T11:10:01.527 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-09-14T11:10:01.527 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-09-14T11:10:01.527 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-09-14T11:10:01.527 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-09-14T11:10:01.527 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-09-14T11:10:01.527 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-09-14T11:10:01.527 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-09-14T11:10:01.527 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-09-14T11:10:01.527 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-09-14T11:10:01.527 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-09-14T11:10:01.527 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-09-14T11:10:01.527 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-09-14T11:10:01.527 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-09-14T11:10:01.527 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-09-14T11:10:01.528 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-09-14T11:10:01.528 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-09-14T11:10:01.528 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-09-14T11:10:01.528 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-09-14T11:10:01.528 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-09-14T11:10:01.528 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-09-14T11:10:01.528 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-09-14T11:10:01.528 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-09-14T11:10:01.528 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-09-14T11:10:01.528 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-09-14T11:10:01.528 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-09-14T11:10:01.528 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-09-14T11:10:01.528 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-09-14T11:10:01.528 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-09-14T11:10:01.529 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-09-14T11:10:01.529 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-09-14T11:10:01.529 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-09-14T11:10:01.529 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-09-14T11:10:01.529 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-09-14T11:10:01.529 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-09-14T11:10:01.529 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-09-14T11:10:01.529 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-09-14T11:10:01.529 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-09-14T11:10:01.529 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-09-14T11:10:01.529 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-09-14T11:10:01.529 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-09-14T11:10:01.529 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-09-14T11:10:01.529 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-09-14T11:10:01.530 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-09-14T11:10:01.530 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-09-14T11:10:01.530 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-09-14T11:10:01.530 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-09-14T11:10:01.530 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-09-14T11:10:01.530 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-09-14T11:10:01.530 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-09-14T11:10:01.530 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-09-14T11:10:01.530 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-09-14T11:10:01.530 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-09-14T11:10:01.530 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-09-14T11:10:01.530 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-09-14T11:10:01.530 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-09-14T11:10:01.530 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-09-14T11:10:01.530 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-09-14T11:10:01.531 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-09-14T11:10:01.531 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-09-14T11:10:01.531 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-09-14T11:10:01.531 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-09-14T11:10:01.531 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-09-14T11:10:01.531 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-09-14T11:10:01.531 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-09-14T11:10:01.531 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-09-14T11:10:01.531 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-09-14T11:10:01.531 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-09-14T11:10:01.531 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-09-14T11:10:01.531 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-09-14T11:10:01.531 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-09-14T11:10:01.532 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-09-14T11:10:01.532 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-09-14T11:10:01.532 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-09-14T11:10:01.532 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-09-14T11:10:01.532 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-09-14T11:10:01.532 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-09-14T11:10:01.532 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-09-14T11:10:01.532 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-09-14T11:10:01.532 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-09-14T11:10:01.532 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-09-14T11:10:01.532 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-09-14T11:10:01.532 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-09-14T11:10:01.532 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-09-14T11:10:01.532 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-09-14T11:10:01.532 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-09-14T11:10:01.533 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-09-14T11:10:01.533 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-09-14T11:10:01.533 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-09-14T11:10:01.533 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-09-14T11:10:01.533 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-09-14T11:10:01.533 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-09-14T11:10:01.533 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-09-14T11:10:01.533 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-09-14T11:10:01.533 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-09-14T11:10:01.533 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-09-14T11:10:01.533 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-09-14T11:10:01.533 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-09-14T11:10:01.533 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-09-14T11:10:01.533 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-09-14T11:10:01.533 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-09-14T11:10:01.533 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-09-14T11:10:01.534 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-09-14T11:10:01.534 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-09-14T11:10:01.534 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-09-14T11:10:01.534 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-09-14T11:10:01.534 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-09-14T11:10:01.534 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-09-14T11:10:01.536 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-09-14T11:10:01.536 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-09-14T11:10:01.536 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-09-14T11:10:01.536 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-09-14T11:10:01.537 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-09-14T11:10:01.537 INFO:teuthology.orchestra.run.smithi097.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-09-14T11:10:01.537 INFO:teuthology.orchestra.run.smithi097.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2024-09-14T11:10:01.537 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:01.537 INFO:teuthology.orchestra.run.smithi097.stdout:Welcome to Gradle 6.0.1! 2024-09-14T11:10:01.537 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:01.537 INFO:teuthology.orchestra.run.smithi097.stdout:Here are the highlights of this release: 2024-09-14T11:10:01.537 INFO:teuthology.orchestra.run.smithi097.stdout: - Substantial improvements in dependency management, including 2024-09-14T11:10:01.537 INFO:teuthology.orchestra.run.smithi097.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-09-14T11:10:01.537 INFO:teuthology.orchestra.run.smithi097.stdout: - Advanced control of transitive versions 2024-09-14T11:10:01.537 INFO:teuthology.orchestra.run.smithi097.stdout: - Support for optional features and dependencies 2024-09-14T11:10:01.537 INFO:teuthology.orchestra.run.smithi097.stdout: - Rules to tweak published metadata 2024-09-14T11:10:01.538 INFO:teuthology.orchestra.run.smithi097.stdout: - Support for Java 13 2024-09-14T11:10:01.538 INFO:teuthology.orchestra.run.smithi097.stdout: - Faster incremental Java and Groovy compilation 2024-09-14T11:10:01.538 INFO:teuthology.orchestra.run.smithi097.stdout: - New Zinc compiler for Scala 2024-09-14T11:10:01.538 INFO:teuthology.orchestra.run.smithi097.stdout: - VS2019 support 2024-09-14T11:10:01.538 INFO:teuthology.orchestra.run.smithi097.stdout: - Support for Gradle Enterprise plugin 3.0 2024-09-14T11:10:01.538 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:01.538 INFO:teuthology.orchestra.run.smithi097.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-09-14T11:10:01.538 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:01.538 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:01.538 INFO:teuthology.orchestra.run.smithi097.stdout:------------------------------------------------------------ 2024-09-14T11:10:01.538 INFO:teuthology.orchestra.run.smithi097.stdout:Gradle 6.0.1 2024-09-14T11:10:01.539 INFO:teuthology.orchestra.run.smithi097.stdout:------------------------------------------------------------ 2024-09-14T11:10:01.539 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:01.539 INFO:teuthology.orchestra.run.smithi097.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-09-14T11:10:01.539 INFO:teuthology.orchestra.run.smithi097.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-09-14T11:10:01.539 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:01.539 INFO:teuthology.orchestra.run.smithi097.stdout:Kotlin: 1.3.50 2024-09-14T11:10:01.539 INFO:teuthology.orchestra.run.smithi097.stdout:Groovy: 2.5.8 2024-09-14T11:10:01.540 INFO:teuthology.orchestra.run.smithi097.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-09-14T11:10:01.540 INFO:teuthology.orchestra.run.smithi097.stdout:JVM: 11.0.20.1 (Red Hat, Inc. 11.0.20.1+1-LTS) 2024-09-14T11:10:01.540 INFO:teuthology.orchestra.run.smithi097.stdout:OS: Linux 5.14.0-505.el9.x86_64 amd64 2024-09-14T11:10:01.540 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:01.540 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-09-14T11:10:01.540 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-14T11:10:01.540 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi097.front.sepia.ceph.com 2024-09-14T11:10:01.541 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-14T11:10:01.541 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi152.front.sepia.ceph.com 2024-09-14T11:10:01.541 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-09-14T11:10:01.751 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-09-14T11:10:01.751 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-09-14T11:10:01.751 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'YBDPVVPEYCHWLYZBNHPV', 'access_secret': 'xWFPH9azIuhB1N2+Y1nXHMk9WO1YpLYo63wdRX65d1R1Vyu4XIdBPQ==', 'region': 'mexico', 'endpoint': 'smithi097.front.sepia.ceph.com:80', 'port': 80, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': False, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi097.front.sepia.ceph.com'} 2024-09-14T11:10:01.751 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-09-14T11:10:01.751 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'YBDPVVPEYCHWLYZBNHPV', '--secret', 'xWFPH9azIuhB1N2+Y1nXHMk9WO1YpLYo63wdRX65d1R1Vyu4XIdBPQ==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-09-14T11:10:01.752 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key YBDPVVPEYCHWLYZBNHPV --secret xWFPH9azIuhB1N2+Y1nXHMk9WO1YpLYo63wdRX65d1R1Vyu4XIdBPQ== --email tester.client.0_test@test.test --cluster ceph 2024-09-14T11:10:01.817 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:01.817 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:01.850 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:01.851+0000 7fed00e10800 20 rados->read ofs=0 len=0 2024-09-14T11:10:01.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:01.853+0000 7fed00e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:01.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:01.853+0000 7fed00e10800 20 realm 2024-09-14T11:10:01.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:01.853+0000 7fed00e10800 20 rados->read ofs=0 len=0 2024-09-14T11:10:01.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:01.853+0000 7fed00e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:01.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:01.853+0000 7fed00e10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:01.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:01.853+0000 7fed00e10800 20 rados->read ofs=0 len=0 2024-09-14T11:10:01.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:01.854+0000 7fed00e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:01.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:01.854+0000 7fed00e10800 20 rados->read ofs=0 len=0 2024-09-14T11:10:01.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:01.854+0000 7fed00e10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:01.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:01.854+0000 7fed00e10800 20 rados->read ofs=0 len=0 2024-09-14T11:10:01.854 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:01.855+0000 7fed00e10800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:01.854 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:01.855+0000 7fed00e10800 20 searching for the correct realm 2024-09-14T11:10:01.856 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:01.858+0000 7fecfce1b640 0 -- 172.21.15.97:0/1688547945 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7fecf00b9040 msgr2=0x7fecf00ae940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:10:02.062 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.063+0000 7fecfbe19640 0 -- 172.21.15.97:0/1688547945 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7fecec0493f0 msgr2=0x7fecec049870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:02.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.068+0000 7fed00e10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:02.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.068+0000 7fed00e10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:02.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.068+0000 7fed00e10800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:10:02.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.068+0000 7fed00e10800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:10:02.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.068+0000 7fed00e10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:02.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.068+0000 7fed00e10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:02.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.068+0000 7fed00e10800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.069+0000 7fed00e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:02.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.069+0000 7fed00e10800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.069+0000 7fed00e10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:02.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.069+0000 7fed00e10800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.069+0000 7fed00e10800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:02.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.069+0000 7fed00e10800 20 zone default found 2024-09-14T11:10:02.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.069+0000 7fed00e10800 4 Realm: () 2024-09-14T11:10:02.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.069+0000 7fed00e10800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:10:02.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.069+0000 7fed00e10800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:10:02.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.069+0000 7fed00e10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:02.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.069+0000 7fed00e10800 20 zonegroup default 2024-09-14T11:10:02.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.069+0000 7fed00e10800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.070+0000 7fed00e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:02.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.070+0000 7fed00e10800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.070+0000 7fed00e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:02.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.070+0000 7fed00e10800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.070+0000 7fed00e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:02.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.070+0000 7fed00e10800 20 started sync module instance, tier type = 2024-09-14T11:10:02.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.070+0000 7fed00e10800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:10:02.080 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.081+0000 7fed00e10800 20 add_watcher() i=0 2024-09-14T11:10:02.080 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.081+0000 7fed00e10800 20 add_watcher() i=1 2024-09-14T11:10:02.080 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.081+0000 7fed00e10800 20 add_watcher() i=2 2024-09-14T11:10:02.080 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.081+0000 7fed00e10800 20 add_watcher() i=3 2024-09-14T11:10:02.080 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.081+0000 7fed00e10800 20 add_watcher() i=4 2024-09-14T11:10:02.080 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.081+0000 7fed00e10800 20 add_watcher() i=5 2024-09-14T11:10:02.080 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.081+0000 7fed00e10800 20 add_watcher() i=6 2024-09-14T11:10:02.081 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.082+0000 7fed00e10800 20 add_watcher() i=7 2024-09-14T11:10:02.081 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.082+0000 7fed00e10800 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:02.084 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.084+0000 7febb27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:02.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.084+0000 7fed00e10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:02.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.084+0000 7fed00e10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:02.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.084+0000 7fed00e10800 5 note: GC not initialized 2024-09-14T11:10:02.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.084+0000 7febb17e2640 20 reqs_thread_entry: start 2024-09-14T11:10:02.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.084+0000 7fed00e10800 20 init_complete bucket index max shards: 11 2024-09-14T11:10:02.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.084+0000 7fed00e10800 20 Filter name: none 2024-09-14T11:10:02.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.084+0000 7feb22ffd640 20 reqs_thread_entry: start 2024-09-14T11:10:02.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.084+0000 7fed00e10800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-14T11:10:02.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.084+0000 7fed00e10800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.085+0000 7fed00e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:02.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.085+0000 7fed00e10800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-09-14T11:10:02.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.085+0000 7fed00e10800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T11:10:02.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.085+0000 7fed00e10800 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-09-14T11:10:02.086 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.085+0000 7fed00e10800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.086 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.085+0000 7fed00e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:02.086 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.085+0000 7fed00e10800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-09-14T11:10:02.086 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.085+0000 7fed00e10800 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-14T11:10:02.086 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.085+0000 7fed00e10800 10 cache get: name=default.rgw.meta+users.keys+YBDPVVPEYCHWLYZBNHPV : miss 2024-09-14T11:10:02.086 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.085+0000 7fed00e10800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.086 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.085+0000 7fed00e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:02.086 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.085+0000 7fed00e10800 10 cache put: name=default.rgw.meta+users.keys+YBDPVVPEYCHWLYZBNHPV info.flags=0x0 2024-09-14T11:10:02.086 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.085+0000 7fed00e10800 10 adding default.rgw.meta+users.keys+YBDPVVPEYCHWLYZBNHPV to cache LRU end 2024-09-14T11:10:02.086 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.085+0000 7fed00e10800 10 cache get: name=default.rgw.meta+users.keys+YBDPVVPEYCHWLYZBNHPV : hit (negative entry) 2024-09-14T11:10:02.087 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.085+0000 7fed00e10800 10 cache get: name=default.rgw.meta+users.keys+YBDPVVPEYCHWLYZBNHPV : hit (negative entry) 2024-09-14T11:10:02.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.087+0000 7fed00e10800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-14T11:10:02.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.087+0000 7fed00e10800 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T11:10:02.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.087+0000 7fed00e10800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-14T11:10:02.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.087+0000 7febd37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595204 cookie 94582786088448 notifier 8264 bl.length()=670 2024-09-14T11:10:02.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.087+0000 7febd37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-14T11:10:02.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.087+0000 7febd37fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T11:10:02.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.089+0000 7fed00e10800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-14T11:10:02.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.089+0000 7fed00e10800 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-14T11:10:02.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.089+0000 7fed00e10800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-14T11:10:02.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.089+0000 7febd2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595110 cookie 94582786078064 notifier 8264 bl.length()=200 2024-09-14T11:10:02.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.089+0000 7febd2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-14T11:10:02.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.089+0000 7febd2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-14T11:10:02.090 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.091+0000 7fed00e10800 10 cache put: name=default.rgw.meta+users.keys+YBDPVVPEYCHWLYZBNHPV info.flags=0x7 2024-09-14T11:10:02.090 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.091+0000 7fed00e10800 10 moving default.rgw.meta+users.keys+YBDPVVPEYCHWLYZBNHPV to cache LRU end 2024-09-14T11:10:02.090 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.091+0000 7fed00e10800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:YBDPVVPEYCHWLYZBNHPV, ofs0, ns] 2024-09-14T11:10:02.090 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.091+0000 7febd2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595118 cookie 94582786070144 notifier 8264 bl.length()=189 2024-09-14T11:10:02.090 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.091+0000 7febd2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+YBDPVVPEYCHWLYZBNHPV info.flags=0x7 2024-09-14T11:10:02.090 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.091+0000 7febd2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+YBDPVVPEYCHWLYZBNHPV to cache LRU end 2024-09-14T11:10:02.091 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-14T11:10:02.091 INFO:teuthology.orchestra.run.smithi097.stdout: "user_id": "tester.client.0", 2024-09-14T11:10:02.091 INFO:teuthology.orchestra.run.smithi097.stdout: "display_name": "Ms. tester.client.0", 2024-09-14T11:10:02.091 INFO:teuthology.orchestra.run.smithi097.stdout: "email": "tester.client.0_test@test.test", 2024-09-14T11:10:02.091 INFO:teuthology.orchestra.run.smithi097.stdout: "suspended": 0, 2024-09-14T11:10:02.091 INFO:teuthology.orchestra.run.smithi097.stdout: "max_buckets": 1000, 2024-09-14T11:10:02.091 INFO:teuthology.orchestra.run.smithi097.stdout: "subusers": [], 2024-09-14T11:10:02.091 INFO:teuthology.orchestra.run.smithi097.stdout: "keys": [ 2024-09-14T11:10:02.092 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-09-14T11:10:02.092 INFO:teuthology.orchestra.run.smithi097.stdout: "user": "tester.client.0", 2024-09-14T11:10:02.092 INFO:teuthology.orchestra.run.smithi097.stdout: "access_key": "YBDPVVPEYCHWLYZBNHPV", 2024-09-14T11:10:02.092 INFO:teuthology.orchestra.run.smithi097.stdout: "secret_key": "xWFPH9azIuhB1N2+Y1nXHMk9WO1YpLYo63wdRX65d1R1Vyu4XIdBPQ==", 2024-09-14T11:10:02.092 INFO:teuthology.orchestra.run.smithi097.stdout: "active": true, 2024-09-14T11:10:02.092 INFO:teuthology.orchestra.run.smithi097.stdout: "create_date": "2024-09-14T11:10:02.086856Z" 2024-09-14T11:10:02.092 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-14T11:10:02.092 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2024-09-14T11:10:02.092 INFO:teuthology.orchestra.run.smithi097.stdout: "swift_keys": [], 2024-09-14T11:10:02.092 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": [], 2024-09-14T11:10:02.092 INFO:teuthology.orchestra.run.smithi097.stdout: "op_mask": "read, write, delete", 2024-09-14T11:10:02.092 INFO:teuthology.orchestra.run.smithi097.stdout: "default_placement": "", 2024-09-14T11:10:02.092 INFO:teuthology.orchestra.run.smithi097.stdout: "default_storage_class": "", 2024-09-14T11:10:02.093 INFO:teuthology.orchestra.run.smithi097.stdout: "placement_tags": [], 2024-09-14T11:10:02.093 INFO:teuthology.orchestra.run.smithi097.stdout: "bucket_quota": { 2024-09-14T11:10:02.093 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-14T11:10:02.093 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-14T11:10:02.093 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-14T11:10:02.093 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-14T11:10:02.093 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-14T11:10:02.093 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-14T11:10:02.093 INFO:teuthology.orchestra.run.smithi097.stdout: "user_quota": { 2024-09-14T11:10:02.093 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-14T11:10:02.093 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-14T11:10:02.093 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-14T11:10:02.094 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-14T11:10:02.094 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-14T11:10:02.094 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-14T11:10:02.094 INFO:teuthology.orchestra.run.smithi097.stdout: "temp_url_keys": [], 2024-09-14T11:10:02.094 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "rgw", 2024-09-14T11:10:02.094 INFO:teuthology.orchestra.run.smithi097.stdout: "mfa_ids": [], 2024-09-14T11:10:02.094 INFO:teuthology.orchestra.run.smithi097.stdout: "account_id": "", 2024-09-14T11:10:02.094 INFO:teuthology.orchestra.run.smithi097.stdout: "path": "/", 2024-09-14T11:10:02.094 INFO:teuthology.orchestra.run.smithi097.stdout: "create_date": "2024-09-14T11:10:02.086845Z", 2024-09-14T11:10:02.094 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2024-09-14T11:10:02.095 INFO:teuthology.orchestra.run.smithi097.stdout: "group_ids": [] 2024-09-14T11:10:02.095 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-14T11:10:02.095 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:02.096 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.093+0000 7febb27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:02.096 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.095+0000 7fed00e10800 20 remove_watcher() i=0 2024-09-14T11:10:02.096 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.095+0000 7fed00e10800 2 removed watcher, disabling cache 2024-09-14T11:10:02.096 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.096+0000 7fed00e10800 20 remove_watcher() i=1 2024-09-14T11:10:02.096 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.097+0000 7fed00e10800 20 remove_watcher() i=2 2024-09-14T11:10:02.096 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.098+0000 7fed00e10800 20 remove_watcher() i=3 2024-09-14T11:10:02.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.099+0000 7fed00e10800 20 remove_watcher() i=4 2024-09-14T11:10:02.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.100+0000 7fed00e10800 20 remove_watcher() i=5 2024-09-14T11:10:02.100 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.101+0000 7fed00e10800 20 remove_watcher() i=6 2024-09-14T11:10:02.101 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.102+0000 7fed00e10800 20 remove_watcher() i=7 2024-09-14T11:10:02.113 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-14T11:10:02.113 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-09-14T11:10:02.146 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-09-14T11:10:02.147 DEBUG:teuthology.orchestra.run.smithi097:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-09-14T11:10:02.213 DEBUG:teuthology.orchestra.run.smithi097:> radosgw-admin gc process --include-all 2024-09-14T11:10:02.307 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:02.307 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:02.345 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.346+0000 7fbe1a694800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.347 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.348+0000 7fbe1a694800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:02.347 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.348+0000 7fbe1a694800 20 realm 2024-09-14T11:10:02.347 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.348+0000 7fbe1a694800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.347 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.348+0000 7fbe1a694800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:02.347 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.348+0000 7fbe1a694800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:02.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.348+0000 7fbe1a694800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.348+0000 7fbe1a694800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:02.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.348+0000 7fbe1a694800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.349+0000 7fbe1a694800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:02.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.349+0000 7fbe1a694800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.350+0000 7fbe1a694800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:02.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.350+0000 7fbe1a694800 20 searching for the correct realm 2024-09-14T11:10:02.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.352+0000 7fbe1897f640 0 -- 172.21.15.97:0/1290909188 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7fbe0c026030 msgr2=0x7fbe0c061170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:10:02.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.759+0000 7fbe1797d640 0 -- 172.21.15.97:0/1290909188 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7fbe0808c7d0 msgr2=0x7fbe08068680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:02.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.966+0000 7fbe1a694800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:02.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.966+0000 7fbe1a694800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:02.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.966+0000 7fbe1a694800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:10:02.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.966+0000 7fbe1a694800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:10:02.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.966+0000 7fbe1a694800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:02.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.966+0000 7fbe1a694800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:02.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.967+0000 7fbe1a694800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.967+0000 7fbe1a694800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:02.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.967+0000 7fbe1a694800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.967 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.967+0000 7fbe1a694800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:02.967 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.967+0000 7fbe1a694800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.967 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.968+0000 7fbe1a694800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:02.967 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.968+0000 7fbe1a694800 20 zone default found 2024-09-14T11:10:02.967 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.968+0000 7fbe1a694800 4 Realm: () 2024-09-14T11:10:02.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.968+0000 7fbe1a694800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:10:02.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.968+0000 7fbe1a694800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:10:02.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.968+0000 7fbe1a694800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:02.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.968+0000 7fbe1a694800 20 zonegroup default 2024-09-14T11:10:02.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.968+0000 7fbe1a694800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.968+0000 7fbe1a694800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:02.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.968+0000 7fbe1a694800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.968+0000 7fbe1a694800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:02.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.968+0000 7fbe1a694800 20 rados->read ofs=0 len=0 2024-09-14T11:10:02.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.969+0000 7fbe1a694800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:02.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.969+0000 7fbe1a694800 20 started sync module instance, tier type = 2024-09-14T11:10:02.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.969+0000 7fbe1a694800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:10:02.977 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.978+0000 7fbe1a694800 20 add_watcher() i=0 2024-09-14T11:10:02.977 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.978+0000 7fbe1a694800 20 add_watcher() i=1 2024-09-14T11:10:02.977 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.978+0000 7fbe1a694800 20 add_watcher() i=2 2024-09-14T11:10:02.977 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.978+0000 7fbe1a694800 20 add_watcher() i=3 2024-09-14T11:10:02.977 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.978+0000 7fbe1a694800 20 add_watcher() i=4 2024-09-14T11:10:02.977 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.978+0000 7fbe1a694800 20 add_watcher() i=5 2024-09-14T11:10:02.977 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.978+0000 7fbe1a694800 20 add_watcher() i=6 2024-09-14T11:10:02.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.980+0000 7fbe1a694800 20 add_watcher() i=7 2024-09-14T11:10:02.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.980+0000 7fbe1a694800 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:02.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.982+0000 7fbccf7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:02.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.982+0000 7fbe1a694800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:02.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:02.982+0000 7fbe1a694800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:03.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.023+0000 7fbcce7dc640 20 reqs_thread_entry: start 2024-09-14T11:10:03.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.023+0000 7fbe1a694800 20 init_complete bucket index max shards: 11 2024-09-14T11:10:03.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.024+0000 7fbe1a694800 20 Filter name: none 2024-09-14T11:10:03.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.024+0000 7fbcc77fe640 20 reqs_thread_entry: start 2024-09-14T11:10:03.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.024+0000 7fbe1a694800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:10:03.024 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.025+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.024 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.026+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.026+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-14T11:10:03.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.026+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6786044003438548673', time=2024-09-14T13:01:30.846363+0000, chain.objs.size()=1 2024-09-14T11:10:03.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.026+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7__shadow_.3Ei_pOWaSjmfb5lH1zw2wda3zbfRGI9_0 2024-09-14T11:10:03.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.026+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6919761892311074116', time=2024-09-14T13:01:30.853660+0000, chain.objs.size()=1 2024-09-14T11:10:03.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.026+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7__shadow_.CRFDiQH4WGh0ZmkDEyL21FKgA1KRjaC_0 2024-09-14T11:10:03.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.026+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5567579803057526123', time=2024-09-14T13:01:30.875888+0000, chain.objs.size()=1 2024-09-14T11:10:03.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.026+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8__shadow_.GyVlMJZmsr3nij29TzlmckID8w5JMOp_0 2024-09-14T11:10:03.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.026+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6656363037457818786', time=2024-09-14T13:02:46.268979+0000, chain.objs.size()=1 2024-09-14T11:10:03.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.026+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19__shadow_.Rqg76BPtShnY2g5SPU2Q_t_1BLZlP8V_0 2024-09-14T11:10:03.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.026+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7118739090113588075', time=2024-09-14T13:02:46.269621+0000, chain.objs.size()=1 2024-09-14T11:10:03.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.026+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19__shadow_.pANWNVuflZESJp1zYbM4iaG8VfAJIwp_0 2024-09-14T11:10:03.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.026+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7230221613264376234', time=2024-09-14T13:03:20.062172+0000, chain.objs.size()=1 2024-09-14T11:10:03.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.026+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21__shadow_.sBxws6P4torpfEv24AlXDP-fKIue_24_0 2024-09-14T11:10:03.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.026+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14055944484355337682', time=2024-09-14T13:03:22.872931+0000, chain.objs.size()=1 2024-09-14T11:10:03.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.026+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23__shadow_.0u1HMI3uYhFf6PwUE6GGviw0wNN3dw__0 2024-09-14T11:10:03.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.027+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12969493594362154182', time=2024-09-14T13:03:55.167049+0000, chain.objs.size()=1 2024-09-14T11:10:03.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.027+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24__shadow_.ShOBCeJEdsZdRIRZFOk7skwO3fbO4el_0 2024-09-14T11:10:03.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.027+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9156535487627113241', time=2024-09-14T13:04:32.515903+0000, chain.objs.size()=1 2024-09-14T11:10:03.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.027+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28__shadow_.VQTIgaGFSdb1vLDcoUv6VDpOqIq0QgK_0 2024-09-14T11:10:03.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.027+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6765099757939214467', time=2024-09-14T13:04:34.166978+0000, chain.objs.size()=1 2024-09-14T11:10:03.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.027+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29__shadow_.YHEXFWuYIMb8e6q4_BqWCSfzFCSOdD0_0 2024-09-14T11:10:03.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.027+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4813361647186852032', time=2024-09-14T13:05:07.274321+0000, chain.objs.size()=1 2024-09-14T11:10:03.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.027+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30__shadow_.Ytgi8DSd0QcwhiDqlgBYK8aGUk9Jsye_0 2024-09-14T11:10:03.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.027+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2075188207248348028', time=2024-09-14T13:05:08.723939+0000, chain.objs.size()=1 2024-09-14T11:10:03.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.027+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31__shadow_.o8et3e-5SCTH20MBCz_ga8PjyU-VbEx_0 2024-09-14T11:10:03.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.028+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18197997923688340131', time=2024-09-14T13:06:50.487813+0000, chain.objs.size()=1 2024-09-14T11:10:03.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.028+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37__shadow_.f3gN7llL_Ll7zh1YnFWBfxSmpzsc1Gp_0 2024-09-14T11:10:03.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.028+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16350767003357431898', time=2024-09-14T13:06:51.750307+0000, chain.objs.size()=1 2024-09-14T11:10:03.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.028+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38__shadow_.oiihHkTPD2NKt1eB9Wug-vc5V3zbI6b_0 2024-09-14T11:10:03.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.028+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10477829959750755048', time=2024-09-14T13:06:51.753687+0000, chain.objs.size()=1 2024-09-14T11:10:03.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.028+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38__shadow_.4xlioqO_mZ91ZsCGAoVwvkEZfP4quGb_0 2024-09-14T11:10:03.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.028+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13432628672463084927', time=2024-09-14T13:07:23.892385+0000, chain.objs.size()=1 2024-09-14T11:10:03.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.028+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39__shadow_.Ieig90PT7NndKYp9EtnO3HrG4hlW2lB_0 2024-09-14T11:10:03.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.030+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:03.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.033+0000 7fbe1a694800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:10:03.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.034+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.035+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.035+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-14T11:10:03.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.035+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5381023215295808090', time=2024-09-14T13:01:30.879572+0000, chain.objs.size()=1 2024-09-14T11:10:03.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.035+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8__shadow_.WRyb4Vo36FoYWQ27oZQIMD1ByFfkIOm_0 2024-09-14T11:10:03.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.035+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9248947966234051051', time=2024-09-14T13:02:46.269927+0000, chain.objs.size()=1 2024-09-14T11:10:03.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.035+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19__shadow_.C0Tn6oL70xUBJdlkoEfAiBCGsvNwb8q_0 2024-09-14T11:10:03.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.035+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14722519826698003515', time=2024-09-14T13:02:47.523796+0000, chain.objs.size()=1 2024-09-14T11:10:03.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.035+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20__shadow_.kMMPsJkgY9wfDmg72zKRRa2REKGtXvl_0 2024-09-14T11:10:03.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.035+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9582004889555450941', time=2024-09-14T13:02:47.525322+0000, chain.objs.size()=1 2024-09-14T11:10:03.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.035+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20__shadow_.stZkmOkJsrYXxhmk4OQhE2mho5nGyW__0 2024-09-14T11:10:03.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.035+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10432245760059801409', time=2024-09-14T13:03:20.062491+0000, chain.objs.size()=1 2024-09-14T11:10:03.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.035+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21__shadow_.RzNzujY8FBKEpduPmRYORUUGHijnjrw_0 2024-09-14T11:10:03.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.035+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4516040370513318302', time=2024-09-14T13:03:22.022377+0000, chain.objs.size()=1 2024-09-14T11:10:03.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.035+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22__shadow_.wZNF6Zg_aqagmuglDGUUSSXLTjOoVxd_0 2024-09-14T11:10:03.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.035+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8030516777229975210', time=2024-09-14T13:03:55.173158+0000, chain.objs.size()=1 2024-09-14T11:10:03.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.035+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24__shadow_.1bYZOwRphInCgs0rpGwunNFf0BgeJ-h_0 2024-09-14T11:10:03.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.036+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5613315734393003283', time=2024-09-14T13:03:56.926590+0000, chain.objs.size()=1 2024-09-14T11:10:03.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.036+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25__shadow_.nx3UxCx_L6toscPBbITgj2cPxqx4EN6_0 2024-09-14T11:10:03.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.036+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7478438483881658457', time=2024-09-14T13:03:58.007607+0000, chain.objs.size()=1 2024-09-14T11:10:03.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.036+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26__shadow_.n1DEDv-Irx0VecfRQNzgvKro0lJI6VN_0 2024-09-14T11:10:03.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.036+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.128053418337309411', time=2024-09-14T13:04:32.516965+0000, chain.objs.size()=1 2024-09-14T11:10:03.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.036+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28__shadow_.mXLajIARya2EMUd4LEt7wVRrBOom_hv_0 2024-09-14T11:10:03.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.036+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12718845630824398884', time=2024-09-14T13:05:07.264175+0000, chain.objs.size()=1 2024-09-14T11:10:03.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.036+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30__shadow_.cDSgnGpyd3Hm-46fhTS-lQeZrxkxeT4_0 2024-09-14T11:10:03.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.036+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7290659465847010198', time=2024-09-14T13:05:42.318295+0000, chain.objs.size()=1 2024-09-14T11:10:03.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.036+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33__shadow_.KwmemcmNIV91rYURZtGFhjA1Cs6et10_0 2024-09-14T11:10:03.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.038+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6462164728248663207', time=2024-09-14T13:06:17.416148+0000, chain.objs.size()=1 2024-09-14T11:10:03.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.038+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36__shadow_.m-WNdfddhcfFWqgHH56bDpGrBdyLE8o_0 2024-09-14T11:10:03.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.038+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8935466201038068446', time=2024-09-14T13:06:51.749321+0000, chain.objs.size()=1 2024-09-14T11:10:03.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.038+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38__shadow_.j-OaRhrfZnFr2kAWKgZGm8CsMZ_Tuo5_0 2024-09-14T11:10:03.038 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.039+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:03.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.041+0000 7fbe1a694800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:10:03.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.043+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.043+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.044+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-14T11:10:03.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.044+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1932288849841002274', time=2024-09-14T13:02:47.521066+0000, chain.objs.size()=1 2024-09-14T11:10:03.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.044+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20__shadow_.o87KTpv2Pf19NTBEWLVWCDNCVONEbzS_0 2024-09-14T11:10:03.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.044+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9113773898106737272', time=2024-09-14T13:03:20.062005+0000, chain.objs.size()=1 2024-09-14T11:10:03.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.044+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21__shadow_.rkAa-zY6CkYwDdnG5gvfUWgGBsvRTeG_0 2024-09-14T11:10:03.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.044+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.504820666814264746', time=2024-09-14T13:03:22.027424+0000, chain.objs.size()=1 2024-09-14T11:10:03.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.044+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22__shadow_.5_IsoiaRB-zZymtIqcHmY8SFGL3e-VU_0 2024-09-14T11:10:03.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.044+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13396523541919745145', time=2024-09-14T13:03:24.082863+0000, chain.objs.size()=1 2024-09-14T11:10:03.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.044+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24__shadow_.sbAl0Vtl-0XDi3FuLElSejFiNkgApVn_0 2024-09-14T11:10:03.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.044+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6061693444932564411', time=2024-09-14T13:04:30.324017+0000, chain.objs.size()=1 2024-09-14T11:10:03.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.044+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27__shadow_.e5rUBBiYy35TW5hrUGriPAeCQFImUCm_0 2024-09-14T11:10:03.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.044+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4443395393057421595', time=2024-09-14T13:05:05.065508+0000, chain.objs.size()=1 2024-09-14T11:10:03.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.044+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29__shadow_.u5l98Sy0iCcRWhpITsnMLh8vjF8Pog8_0 2024-09-14T11:10:03.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.044+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13078787071516027349', time=2024-09-14T13:05:07.265973+0000, chain.objs.size()=1 2024-09-14T11:10:03.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.044+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30__shadow_.1VBhWm-IjMfR4vg3gzuav8ahPe7Lp5w_0 2024-09-14T11:10:03.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.044+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14276304945469810349', time=2024-09-14T13:05:08.721545+0000, chain.objs.size()=1 2024-09-14T11:10:03.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.044+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31__shadow_.vxbdcB8edQhsolP_ooRdgI6YELvpE2Q_0 2024-09-14T11:10:03.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.044+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16626196035489107324', time=2024-09-14T13:05:40.545869+0000, chain.objs.size()=1 2024-09-14T11:10:03.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.044+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32__shadow_.pPe-m1zxLdDIzbOKBJTiqWShGzXmLFl_0 2024-09-14T11:10:03.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.044+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7882999447733215272', time=2024-09-14T13:05:42.316967+0000, chain.objs.size()=1 2024-09-14T11:10:03.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.044+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33__shadow_.2LtuYzS8RTobIZO63NzFiaHebGDT47H_0 2024-09-14T11:10:03.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.044+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6224316844524283906', time=2024-09-14T13:06:15.816788+0000, chain.objs.size()=1 2024-09-14T11:10:03.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.044+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35__shadow_.1ONrX1vHJwFsUY2W64g_PEe01ZRPi9a_0 2024-09-14T11:10:03.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.044+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6021313596624751124', time=2024-09-14T13:06:50.487438+0000, chain.objs.size()=1 2024-09-14T11:10:03.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.044+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37__shadow_.K4PBzVEQV582SfyGjNtRIz0qq5Z2AOC_0 2024-09-14T11:10:03.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.046+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2357044068281120804', time=2024-09-14T13:06:50.498646+0000, chain.objs.size()=1 2024-09-14T11:10:03.046 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.046+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37__shadow_.e2W9E0DWzCnEMA5Hlpai0v3lRWDYY5u_0 2024-09-14T11:10:03.046 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.046+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7163871006881619031', time=2024-09-14T13:06:51.751879+0000, chain.objs.size()=1 2024-09-14T11:10:03.046 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.046+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38__shadow_.SZAnjm8shnv8VHRWNQhEVJ42Jwsw8bs_0 2024-09-14T11:10:03.046 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.046+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4067668239179934068', time=2024-09-14T13:06:51.758271+0000, chain.objs.size()=1 2024-09-14T11:10:03.046 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.046+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38__shadow_.ABYRmyP2QUvp2s1-6HL3nnMbYYkmR9P_0 2024-09-14T11:10:03.046 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.048+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:03.048 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.050+0000 7fbe1a694800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:10:03.050 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.051+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.050 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.052+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.052+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-14T11:10:03.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.052+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7553092282653919425', time=2024-09-14T13:01:30.555453+0000, chain.objs.size()=4 2024-09-14T11:10:03.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.052+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11__multipart_foo.2~Ie-GC1nIkaBIJIsl2QMEQ06gJBOBFac.1 2024-09-14T11:10:03.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.052+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11__multipart_foo.2~Ie-GC1nIkaBIJIsl2QMEQ06gJBOBFac.2 2024-09-14T11:10:03.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.052+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11__multipart_foo.2~Ie-GC1nIkaBIJIsl2QMEQ06gJBOBFac.3 2024-09-14T11:10:03.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.052+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11__multipart_foo.2~Ie-GC1nIkaBIJIsl2QMEQ06gJBOBFac.4 2024-09-14T11:10:03.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.052+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11030229602919375074', time=2024-09-14T13:01:30.794598+0000, chain.objs.size()=2 2024-09-14T11:10:03.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.052+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13__shadow_.iWuyjnDp-b7bVENnx20sdXGZ5yeHWI__0 2024-09-14T11:10:03.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.052+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13__shadow_.iWuyjnDp-b7bVENnx20sdXGZ5yeHWI__1 2024-09-14T11:10:03.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.052+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18068589574300133588', time=2024-09-14T13:01:30.842715+0000, chain.objs.size()=1 2024-09-14T11:10:03.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.052+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7__shadow_.uiMOsQ9_ZbEeJoOCGBwMmEFrwRG7dTX_0 2024-09-14T11:10:03.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.052+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.630573661191181579', time=2024-09-14T13:02:46.275638+0000, chain.objs.size()=1 2024-09-14T11:10:03.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.052+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19__shadow_.VLbrqSpJ-e65kvM9eoJhEy748e902_j_0 2024-09-14T11:10:03.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.052+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5191945045387028921', time=2024-09-14T13:02:47.524907+0000, chain.objs.size()=1 2024-09-14T11:10:03.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.052+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20__shadow_.xloT_YElaaS7Toy0na5EOBUIkbw7xns_0 2024-09-14T11:10:03.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.052+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14575739695451783935', time=2024-09-14T13:03:22.871834+0000, chain.objs.size()=1 2024-09-14T11:10:03.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.053+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23__shadow_.jtf0cIQvVmoZfXfW6_EbsZNmbwyFl49_0 2024-09-14T11:10:03.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.053+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11334782074116214992', time=2024-09-14T13:04:30.329496+0000, chain.objs.size()=1 2024-09-14T11:10:03.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.053+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27__shadow_.r2n6gHGRBVDqfaLCkMUrgSwR0tAcGGD_0 2024-09-14T11:10:03.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.053+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16537346320263944483', time=2024-09-14T13:04:32.514552+0000, chain.objs.size()=1 2024-09-14T11:10:03.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.053+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28__shadow_.aISO4cWk0kRv0I7qEQw_8scLP2KDF5w_0 2024-09-14T11:10:03.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.055+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7028032753371683248', time=2024-09-14T13:04:32.521299+0000, chain.objs.size()=1 2024-09-14T11:10:03.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.055+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28__shadow_.eAv3QK4LEaE_KIqBZ0eNU7dJ4EEicqE_0 2024-09-14T11:10:03.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.056+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13231356288453766451', time=2024-09-14T13:05:07.268103+0000, chain.objs.size()=1 2024-09-14T11:10:03.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.056+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30__shadow_.nFY5FoiFb2p7HxqipTHkF1llJ9BJpjE_0 2024-09-14T11:10:03.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.056+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5237404533284175491', time=2024-09-14T13:05:40.542198+0000, chain.objs.size()=1 2024-09-14T11:10:03.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.056+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32__shadow_.2hjcd2AkeeEJyvWal1kwPMtqs8V4K70_0 2024-09-14T11:10:03.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.056+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9191009063291187249', time=2024-09-14T13:05:40.551099+0000, chain.objs.size()=1 2024-09-14T11:10:03.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.056+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32__shadow_.IN_LhrURCTAiGY8oN9eHa5JR-eYtjte_0 2024-09-14T11:10:03.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.056+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13248766330179866942', time=2024-09-14T13:05:42.312595+0000, chain.objs.size()=1 2024-09-14T11:10:03.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.056+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33__shadow_.69Tflc8ypHfByVlerJGiLvWOhA_Dbf3_0 2024-09-14T11:10:03.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.056+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2237881286787266014', time=2024-09-14T13:05:42.315463+0000, chain.objs.size()=1 2024-09-14T11:10:03.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.056+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33__shadow_.uvZNs3VCmLuTCYIBePVrGusY2nKZ0SP_0 2024-09-14T11:10:03.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.056+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16065013199219680367', time=2024-09-14T13:06:48.708661+0000, chain.objs.size()=1 2024-09-14T11:10:03.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.056+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36__shadow_.oxTjKldc5olzVaa2bj0W7klozfy_Wgj_0 2024-09-14T11:10:03.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.056+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10181958636728179601', time=2024-09-14T13:06:50.493627+0000, chain.objs.size()=1 2024-09-14T11:10:03.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.056+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37__shadow_.306DWcTKJq2-pRzdOcneVnNqc-bxoHz_0 2024-09-14T11:10:03.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.056+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4193646774791927226', time=2024-09-14T13:06:51.750611+0000, chain.objs.size()=1 2024-09-14T11:10:03.057 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.056+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38__shadow_.bFEtglOh-jVdPsGqsNIbN4XmhRL3YfH_0 2024-09-14T11:10:03.057 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.056+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17446629872436560275', time=2024-09-14T13:06:51.753688+0000, chain.objs.size()=1 2024-09-14T11:10:03.057 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.056+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38__shadow_.n30HeLAC6eMIz6pzVAGs7JH1GkZ2Ijg_0 2024-09-14T11:10:03.057 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.056+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5115382681357051997', time=2024-09-14T13:09:30.927494+0000, chain.objs.size()=1 2024-09-14T11:10:03.057 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.056+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17__shadow_.KFn_xP0gkpPGyOw6no9gwmgusJ8augk_0 2024-09-14T11:10:03.057 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.056+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8021575714928383696', time=2024-09-14T13:09:30.928554+0000, chain.objs.size()=1 2024-09-14T11:10:03.057 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.056+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17__shadow_.FCfWkuheH-pt331svdapXPjFqcrn5Wc_0 2024-09-14T11:10:03.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.058+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3218769990253867330', time=2024-09-14T13:09:30.930586+0000, chain.objs.size()=1 2024-09-14T11:10:03.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.058+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17__shadow_.NQpQr_bM86jnBtMi7muv5McgokBwbUQ_0 2024-09-14T11:10:03.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.059+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:03.060 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.061+0000 7fbe1a694800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:10:03.061 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.063+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.062 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.063+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.063 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.064+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-14T11:10:03.063 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.064+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5191357837158127895', time=2024-09-14T13:01:30.501830+0000, chain.objs.size()=1 2024-09-14T11:10:03.063 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.064+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4__shadow_.OwpHdT2xQCO08IJnUozDkJ97pNWCf0f_0 2024-09-14T11:10:03.063 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.064+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8474790174166008383', time=2024-09-14T13:01:30.681695+0000, chain.objs.size()=1 2024-09-14T11:10:03.063 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.064+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15__shadow_.d49zgqSfhKEnIlV_poY-lqcXo4BzJW8_0 2024-09-14T11:10:03.064 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.064+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6986826418039477963', time=2024-09-14T13:01:30.730569+0000, chain.objs.size()=3 2024-09-14T11:10:03.064 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.064+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__multipart_foo-STANDARD.2~Q_rKueWQEzTMXM5eiryaCuie6AsQ8M2.1 2024-09-14T11:10:03.064 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.064+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__multipart_foo-STANDARD.2~Q_rKueWQEzTMXM5eiryaCuie6AsQ8M2.2 2024-09-14T11:10:03.064 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.064+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__multipart_foo-STANDARD.2~Q_rKueWQEzTMXM5eiryaCuie6AsQ8M2.3 2024-09-14T11:10:03.064 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.064+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9359076458136615079', time=2024-09-14T13:03:20.065295+0000, chain.objs.size()=1 2024-09-14T11:10:03.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.064+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21__shadow_.HiNxaUc9-4C02diOJFVXaeyQ5AcLFLG_0 2024-09-14T11:10:03.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.064+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10269045855381438640', time=2024-09-14T13:03:20.066413+0000, chain.objs.size()=1 2024-09-14T11:10:03.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.064+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21__shadow_.S6COoeSIKULQyyL7aLddzspOuA4zkan_0 2024-09-14T11:10:03.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.064+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10257854032214930626', time=2024-09-14T13:03:22.873813+0000, chain.objs.size()=1 2024-09-14T11:10:03.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.064+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23__shadow_._ubYVzgbh59wy3pd8cgZszbnrb_6LJI_0 2024-09-14T11:10:03.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.064+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5434150400805871694', time=2024-09-14T13:03:56.920368+0000, chain.objs.size()=1 2024-09-14T11:10:03.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.064+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25__shadow_.LLQUFOXWIcMvMvZpi98BgUNz2VSDijO_0 2024-09-14T11:10:03.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.064+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16098921172656910982', time=2024-09-14T13:03:58.007599+0000, chain.objs.size()=1 2024-09-14T11:10:03.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.064+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26__shadow_.OCINKsAU8Q6vKZv1dUwDe2NW-P522e2_0 2024-09-14T11:10:03.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.064+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16132415625554378758', time=2024-09-14T13:04:30.325852+0000, chain.objs.size()=1 2024-09-14T11:10:03.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.064+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27__shadow_.z6vVUgA8SE9NinTs5ho9Kqyg-YkAOsC_0 2024-09-14T11:10:03.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.064+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10192356449519663142', time=2024-09-14T13:05:07.269303+0000, chain.objs.size()=1 2024-09-14T11:10:03.066 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.064+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30__shadow_.wxA6iizWpzPgbwd-mqX7gyv3sn5WosD_0 2024-09-14T11:10:03.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.066+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3436866144070565973', time=2024-09-14T13:05:42.315249+0000, chain.objs.size()=1 2024-09-14T11:10:03.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.066+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33__shadow_.38DoXUZ16VPHSjWqcF29EdG5K0IOWVO_0 2024-09-14T11:10:03.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.066+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7324357995712543370', time=2024-09-14T13:07:23.888105+0000, chain.objs.size()=1 2024-09-14T11:10:03.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.066+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39__shadow_.PTTv5r6XU6tEVptYTSO7FbIIrQ7uVQH_0 2024-09-14T11:10:03.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.066+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16133797748256011776', time=2024-09-14T13:09:30.928990+0000, chain.objs.size()=1 2024-09-14T11:10:03.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.066+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17__shadow_.1a7ekRauLuIRJ7kJW2xaUCxPC9SalgW_0 2024-09-14T11:10:03.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.068+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:03.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.070+0000 7fbe1a694800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:10:03.069 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.071+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.072+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.072+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-14T11:10:03.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.072+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4862595364982880933', time=2024-09-14T13:01:30.648632+0000, chain.objs.size()=1 2024-09-14T11:10:03.072 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.072+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15__shadow_.d49zgqSfhKEnIlV_poY-lqcXo4BzJW8_0 2024-09-14T11:10:03.072 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.072+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.873592951494251759', time=2024-09-14T13:01:30.667298+0000, chain.objs.size()=1 2024-09-14T11:10:03.072 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.072+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15__shadow_.uLnFR-pKXcCUIXeRxj197s4c9bhfUMm_0 2024-09-14T11:10:03.072 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.072+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17534820962157740316', time=2024-09-14T13:01:30.670707+0000, chain.objs.size()=1 2024-09-14T11:10:03.072 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.072+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15__shadow_.en3z6Z7Au1dtBuxbpUT78jZibuzvYRt_0 2024-09-14T11:10:03.072 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.072+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5693304300103414840', time=2024-09-14T13:01:30.790687+0000, chain.objs.size()=1 2024-09-14T11:10:03.072 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.072+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13__shadow_.Mwb58S3jcGeFaU5-wYERiAocw2VEGzi_0 2024-09-14T11:10:03.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.072+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13679194982822092326', time=2024-09-14T13:02:46.267767+0000, chain.objs.size()=1 2024-09-14T11:10:03.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.072+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19__shadow_.9tXLbsp9Vqdh7redonSjSDhgEf_Qd7E_0 2024-09-14T11:10:03.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.072+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7942328131364310683', time=2024-09-14T13:03:22.033837+0000, chain.objs.size()=1 2024-09-14T11:10:03.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.072+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22__shadow_.YY5kf9CpVbxx1cfgdeG1y-6YN8lMGmC_0 2024-09-14T11:10:03.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.072+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4893551281217211138', time=2024-09-14T13:03:55.164410+0000, chain.objs.size()=1 2024-09-14T11:10:03.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.072+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24__shadow_.SLqaObJbr6aJh5AAKVldBdBh-f8v0fC_0 2024-09-14T11:10:03.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.072+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1517077250117113875', time=2024-09-14T13:03:55.174422+0000, chain.objs.size()=1 2024-09-14T11:10:03.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.072+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24__shadow_.PyTWIXc6vpv1jKLSmnTLVtNxz3836x-_0 2024-09-14T11:10:03.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.072+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17484675555256846642', time=2024-09-14T13:03:56.924665+0000, chain.objs.size()=1 2024-09-14T11:10:03.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.072+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25__shadow_.wwdAuk5BfJVLekrlrrd8YMJ-8WnG5cU_0 2024-09-14T11:10:03.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.072+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7113972152360250640', time=2024-09-14T13:04:30.320521+0000, chain.objs.size()=1 2024-09-14T11:10:03.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.072+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27__shadow_.oGay7Vj4AmNbWiqAafMNvu291hZ_ps0_0 2024-09-14T11:10:03.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.072+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11205810814085242963', time=2024-09-14T13:05:05.066775+0000, chain.objs.size()=1 2024-09-14T11:10:03.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.072+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29__shadow_.ULyhy4xd5Ft--STeQC29kzJWf7Ua8Cu_0 2024-09-14T11:10:03.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.072+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18159190797337382230', time=2024-09-14T13:05:05.067458+0000, chain.objs.size()=1 2024-09-14T11:10:03.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.072+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29__shadow_.aefDk2CRfZmEaQwPpp2JAm5JdCQvVfg_0 2024-09-14T11:10:03.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.074+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4856691980727234133', time=2024-09-14T13:05:40.548079+0000, chain.objs.size()=1 2024-09-14T11:10:03.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.074+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32__shadow_.qabXaBJBOYzaY4XvPKsGkCmzTD_nPwY_0 2024-09-14T11:10:03.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.074+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17496194462069884245', time=2024-09-14T13:05:42.318323+0000, chain.objs.size()=1 2024-09-14T11:10:03.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.074+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33__shadow_.zs1V2Rh1i06e7ff4bPVlU-ufdrd0Gs5_0 2024-09-14T11:10:03.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.074+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16432436787042585307', time=2024-09-14T13:05:43.775760+0000, chain.objs.size()=1 2024-09-14T11:10:03.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.074+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34__shadow_.TCbRuUp8guYPcyh15_JAv6zZnvAB33S_0 2024-09-14T11:10:03.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.074+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5881947809477988644', time=2024-09-14T13:06:50.489619+0000, chain.objs.size()=1 2024-09-14T11:10:03.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.074+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37__shadow_.tELQOaUmtbTgGjyZRzFkkjKHkkjZxvY_0 2024-09-14T11:10:03.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.074+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4216668787109669258', time=2024-09-14T13:06:52.985745+0000, chain.objs.size()=1 2024-09-14T11:10:03.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.074+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39__shadow_.FtjKrBYCglqngqxSRWPb9hi1HLuE1XZ_0 2024-09-14T11:10:03.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.074+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18129925829402346420', time=2024-09-14T13:07:23.891012+0000, chain.objs.size()=1 2024-09-14T11:10:03.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.074+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39__shadow_.eKOCH2SnbyUsRSQSrSsBi3snWzvhCGn_0 2024-09-14T11:10:03.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.074+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11880728132675610547', time=2024-09-14T13:07:23.897672+0000, chain.objs.size()=1 2024-09-14T11:10:03.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.074+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39__shadow_.D6SZq_26KQvJYQW6kQBVg2_kRdLX1NN_0 2024-09-14T11:10:03.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.074+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3449383492564284996', time=2024-09-14T13:07:23.898355+0000, chain.objs.size()=1 2024-09-14T11:10:03.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.074+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39__shadow_.2ctW7MleyEo5Agpk4YQawIFeMr1FHQL_0 2024-09-14T11:10:03.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.075+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3151420343037819126', time=2024-09-14T13:09:30.923320+0000, chain.objs.size()=1 2024-09-14T11:10:03.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.075+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17__shadow_.ZJ3CXXPQMAjncWMfTKXkpinA6aSJZev_0 2024-09-14T11:10:03.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.077+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:03.078 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.079+0000 7fbe1a694800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:10:03.079 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.081+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.080 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.081+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.081 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.082+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-14T11:10:03.081 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.082+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6230597089339443576', time=2024-09-14T13:01:30.505574+0000, chain.objs.size()=1 2024-09-14T11:10:03.081 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.082+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4__shadow_.qZsRP7obGqd3vyh57Wvq8UuGqVONFO0_0 2024-09-14T11:10:03.081 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.082+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15731904942047451965', time=2024-09-14T13:01:30.513950+0000, chain.objs.size()=1 2024-09-14T11:10:03.081 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.082+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4__shadow_.8fuldMuK5o3W1hBUCrCMW4BS-yF-66M_0 2024-09-14T11:10:03.081 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.082+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='_Mqh-VMTNZu_lDSfbf4kuKMiRlkGY3Ji', time=2024-09-14T13:01:30.641196+0000, chain.objs.size()=1 2024-09-14T11:10:03.082 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.082+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15__shadow_.h-IFGn3mhxInh2gqbr_89gYIjOa6oE5_0 2024-09-14T11:10:03.082 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.082+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='_N67pcYV0kJUbFMBlc-tRbR5rDb1CMCL', time=2024-09-14T13:01:30.712077+0000, chain.objs.size()=2 2024-09-14T11:10:03.082 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.082+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__shadow_.xf0Ct5m3bK8W4Vuq31UbRpIOH5eC36j_0 2024-09-14T11:10:03.082 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.082+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__shadow_.xf0Ct5m3bK8W4Vuq31UbRpIOH5eC36j_1 2024-09-14T11:10:03.082 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.082+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17068648562495923249', time=2024-09-14T13:02:46.268323+0000, chain.objs.size()=1 2024-09-14T11:10:03.082 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.082+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19__shadow_.GzDXQ-WftZQiYtVm1AmooZQmWLxSBes_0 2024-09-14T11:10:03.082 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.082+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.921463347955113657', time=2024-09-14T13:03:22.871307+0000, chain.objs.size()=1 2024-09-14T11:10:03.082 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.082+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23__shadow_.Ef47HvPa1Uxil0-BBLUNBWBZr_vlEe7_0 2024-09-14T11:10:03.082 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.082+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1676256046097016980', time=2024-09-14T13:03:55.173966+0000, chain.objs.size()=1 2024-09-14T11:10:03.082 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.082+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24__shadow_.ER-ikzWWqq9TOuxs4bVjklpVPwIH2QU_0 2024-09-14T11:10:03.082 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.082+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2644645205996155096', time=2024-09-14T13:04:30.324119+0000, chain.objs.size()=1 2024-09-14T11:10:03.082 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.082+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27__shadow_.gMy7fJq9VODhTGSMq1nIEZ7ALHztC8O_0 2024-09-14T11:10:03.083 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.082+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8329121449566799382', time=2024-09-14T13:05:07.274025+0000, chain.objs.size()=1 2024-09-14T11:10:03.083 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.082+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30__shadow_.1lKFQY6yKPDWrytHoVpkkslO0q1Ik5s_0 2024-09-14T11:10:03.083 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.082+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1130086898748045620', time=2024-09-14T13:05:08.719697+0000, chain.objs.size()=1 2024-09-14T11:10:03.083 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.082+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31__shadow_.FCUPKjkchsVUKK1yk2LKyuFYKDc3SZg_0 2024-09-14T11:10:03.083 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.082+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14767934659470713597', time=2024-09-14T13:05:08.723524+0000, chain.objs.size()=1 2024-09-14T11:10:03.083 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.082+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31__shadow_.zLiFgmG2IpZYUpzy59F2aRuTq9Rqql-_0 2024-09-14T11:10:03.083 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.083+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4031766648729546432', time=2024-09-14T13:05:39.792811+0000, chain.objs.size()=1 2024-09-14T11:10:03.084 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.083+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32__shadow_.8lNeJpIV5NZ5xYYPi24DdvtfzBtkJSv_0 2024-09-14T11:10:03.084 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.084+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14542717383413944539', time=2024-09-14T13:06:51.748809+0000, chain.objs.size()=1 2024-09-14T11:10:03.084 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.084+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38__shadow_.hH2zCLXPhk75aZnsb-vP55HXMU2wI92_0 2024-09-14T11:10:03.084 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.085+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:03.086 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.088+0000 7fbe1a694800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:10:03.087 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.089+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.089+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.089 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.090+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-14T11:10:03.089 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.090+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12648715477331637722', time=2024-09-14T13:01:30.574248+0000, chain.objs.size()=4 2024-09-14T11:10:03.089 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.090+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12__multipart_foo.2~qnvSR0SS3y6axNti6fX0vbWPxZEIFp6.1 2024-09-14T11:10:03.089 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.090+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12__multipart_foo.2~qnvSR0SS3y6axNti6fX0vbWPxZEIFp6.2 2024-09-14T11:10:03.089 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.090+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12__multipart_foo.2~qnvSR0SS3y6axNti6fX0vbWPxZEIFp6.3 2024-09-14T11:10:03.089 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.090+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12__multipart_foo.2~qnvSR0SS3y6axNti6fX0vbWPxZEIFp6.4 2024-09-14T11:10:03.089 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.090+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.417888418236195546', time=2024-09-14T13:03:55.161420+0000, chain.objs.size()=1 2024-09-14T11:10:03.089 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.090+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24__shadow_.iubAhwkBjQtvGnf9xjeM7MdbzVPGBM7_0 2024-09-14T11:10:03.089 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.090+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17791312822041093861', time=2024-09-14T13:03:57.998075+0000, chain.objs.size()=1 2024-09-14T11:10:03.089 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.090+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26__shadow_.BLRTHPEq_bvf14ER9ZVcow-C9Lt-lXl_0 2024-09-14T11:10:03.089 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.090+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15872304310424808304', time=2024-09-14T13:03:58.002252+0000, chain.objs.size()=1 2024-09-14T11:10:03.090 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.090+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26__shadow_.uYR7vfojl4-_T1WHaj_UFaPYi22slRj_0 2024-09-14T11:10:03.090 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.090+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12537718628588332749', time=2024-09-14T13:04:32.512552+0000, chain.objs.size()=1 2024-09-14T11:10:03.090 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.090+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28__shadow_.m3kqXty0w4l8gJW03iCrgll7yLmJhJ4_0 2024-09-14T11:10:03.090 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.090+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15683517326544969570', time=2024-09-14T13:05:05.063170+0000, chain.objs.size()=1 2024-09-14T11:10:03.090 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.090+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29__shadow_.KxOIRgDVGCQgKmETlvu024Y6Ey5Ga61_0 2024-09-14T11:10:03.090 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.090+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14205833779642598246', time=2024-09-14T13:05:05.064639+0000, chain.objs.size()=1 2024-09-14T11:10:03.090 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.090+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29__shadow_.aSA7_1P2s6-49Of1PhAsS8Q6ywRtRNR_0 2024-09-14T11:10:03.090 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.090+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1297769313334730980', time=2024-09-14T13:05:07.265327+0000, chain.objs.size()=1 2024-09-14T11:10:03.090 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.090+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30__shadow_.H8sUFycwPdYD5oJXVpGs3FZ9jHJ-o5C_0 2024-09-14T11:10:03.090 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.090+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9319006646616718661', time=2024-09-14T13:05:08.730764+0000, chain.objs.size()=1 2024-09-14T11:10:03.090 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.090+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31__shadow_.iaruNKxwhBM3TvPBnqV3k_OFTd3wwzL_0 2024-09-14T11:10:03.091 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.091+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12168387267935379010', time=2024-09-14T13:05:08.731566+0000, chain.objs.size()=1 2024-09-14T11:10:03.091 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.091+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31__shadow_.SvXKwZxWaPKMW8mjTqSVeYkixQEky15_0 2024-09-14T11:10:03.092 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.092+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12637125026541008424', time=2024-09-14T13:05:40.545179+0000, chain.objs.size()=1 2024-09-14T11:10:03.092 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.092+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32__shadow_.ek19DBOxzKuJOWfkqTUrnA1PonsFDrx_0 2024-09-14T11:10:03.092 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.092+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5339098221084473196', time=2024-09-14T13:06:14.457863+0000, chain.objs.size()=1 2024-09-14T11:10:03.092 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.092+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34__shadow_.9n4iIIxAdHaPlJ5iaoy3dGMp7fIf_cE_0 2024-09-14T11:10:03.092 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.092+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16786171268519546792', time=2024-09-14T13:06:51.752683+0000, chain.objs.size()=1 2024-09-14T11:10:03.092 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.092+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38__shadow_.b3LlPsrNW1DsBw9wFyzhNzrP0Sj2mwI_0 2024-09-14T11:10:03.092 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.092+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6885770937308839128', time=2024-09-14T13:07:23.892749+0000, chain.objs.size()=1 2024-09-14T11:10:03.092 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.092+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39__shadow_.J1bnJdYeWbi3tvSWmmhhlXJsQvj0dIW_0 2024-09-14T11:10:03.092 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.092+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16172691253517707502', time=2024-09-14T13:09:30.928304+0000, chain.objs.size()=1 2024-09-14T11:10:03.092 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.092+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17__shadow_.AhFmT9lA0ZtjdXDXImco_Up5EtCLVMO_0 2024-09-14T11:10:03.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.093+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:03.094 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.096+0000 7fbe1a694800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:10:03.095 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.097+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.096 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.097+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.097+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-14T11:10:03.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.097+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='_O96ZkdykOVBpiZP6JcyQRvQpCYoBCwW', time=2024-09-14T13:01:30.663690+0000, chain.objs.size()=1 2024-09-14T11:10:03.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.098+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15__shadow_.UHNJjoIRuor9eLrEoYLosPTNxKawc9g_0 2024-09-14T11:10:03.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.098+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10063753178723832640', time=2024-09-14T13:02:47.521118+0000, chain.objs.size()=1 2024-09-14T11:10:03.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.098+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20__shadow_.QZVtjxbLM8yFK4DJF34tjqckb1CfIhr_0 2024-09-14T11:10:03.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.098+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17845418821077681659', time=2024-09-14T13:03:20.070489+0000, chain.objs.size()=1 2024-09-14T11:10:03.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.098+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21__shadow_.zlcbs6HAkTBMzZwJ5CwmFXP0i0Ny_BP_0 2024-09-14T11:10:03.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.098+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5939621798912437206', time=2024-09-14T13:03:22.872720+0000, chain.objs.size()=1 2024-09-14T11:10:03.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.098+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23__shadow_.xun0s9udz4cZEk71KZHRiRcAquGMEpH_0 2024-09-14T11:10:03.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.098+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4954540405756165626', time=2024-09-14T13:03:56.924705+0000, chain.objs.size()=1 2024-09-14T11:10:03.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.098+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25__shadow_.6JUwA7WNFgKJfs-88hQiTTvrjVKYTGt_0 2024-09-14T11:10:03.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.098+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8480165556780243367', time=2024-09-14T13:05:05.064127+0000, chain.objs.size()=1 2024-09-14T11:10:03.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.098+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29__shadow_.G0ndMeM7oPlSSajt4jXuIRC0swyvkbv_0 2024-09-14T11:10:03.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.098+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6088407596796855590', time=2024-09-14T13:05:07.266993+0000, chain.objs.size()=1 2024-09-14T11:10:03.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.098+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30__shadow_.GGZEZdjTdO5e_fFq501xYiaUN9DxJod_0 2024-09-14T11:10:03.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.098+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14349414229703666086', time=2024-09-14T13:05:40.543456+0000, chain.objs.size()=1 2024-09-14T11:10:03.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.098+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32__shadow_.MPsVhkCK35fQHHjuszgAkZ7NyPrxZm7_0 2024-09-14T11:10:03.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.098+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11165665288141875124', time=2024-09-14T13:05:42.318318+0000, chain.objs.size()=1 2024-09-14T11:10:03.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.098+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33__shadow_.7RnCD5FduQ3p23rmX_c-pq8CrEIw2sX_0 2024-09-14T11:10:03.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.098+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6974296321983069932', time=2024-09-14T13:06:50.498045+0000, chain.objs.size()=1 2024-09-14T11:10:03.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.098+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37__shadow_.1s67D0buVDrsfkXg1z-IM-HBuMBmyXF_0 2024-09-14T11:10:03.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.100+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:03.101 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.102+0000 7fbe1a694800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:10:03.102 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.104+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.104+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.104+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-14T11:10:03.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.104+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11726169462728092791', time=2024-09-14T13:01:30.530363+0000, chain.objs.size()=1 2024-09-14T11:10:03.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.104+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4__shadow_.BI28t_4qMUIbvMhTMxqx80rD7HEivpU_0 2024-09-14T11:10:03.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.104+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='_xWHJqgBBTJt-leO_i_FPN7EgJDf1Sw3', time=2024-09-14T13:01:30.678177+0000, chain.objs.size()=1 2024-09-14T11:10:03.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.104+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15__shadow_.rrayXErQcsdeV70n8iwQxRRFjrFKJS8_0 2024-09-14T11:10:03.107 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.104+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13125500106967684921', time=2024-09-14T13:02:46.275496+0000, chain.objs.size()=1 2024-09-14T11:10:03.107 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.104+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19__shadow_.gplVxvU1v4UN5x5UqktqocXbeLZvPB2_0 2024-09-14T11:10:03.107 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.104+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16511011148542113285', time=2024-09-14T13:02:47.522968+0000, chain.objs.size()=1 2024-09-14T11:10:03.107 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.104+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20__shadow_.O8gdR-p4tss2Q_BEyt1VtKX-oTFlMeB_0 2024-09-14T11:10:03.107 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.104+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11614413386674600586', time=2024-09-14T13:03:20.063905+0000, chain.objs.size()=1 2024-09-14T11:10:03.107 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.104+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21__shadow_.-Q1OBg0a57PTNQdtygPvSSIKgmt_jrh_0 2024-09-14T11:10:03.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.104+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.613208289622003941', time=2024-09-14T13:03:22.869502+0000, chain.objs.size()=1 2024-09-14T11:10:03.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.104+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23__shadow_.SZUcPMLsTHRKnDlbF58H0BI9UB6egpQ_0 2024-09-14T11:10:03.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.104+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10364191799267632830', time=2024-09-14T13:03:55.162917+0000, chain.objs.size()=1 2024-09-14T11:10:03.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.104+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24__shadow_.qNxs5QrsIsK61fIvcUgwRVfmA2jFtaj_0 2024-09-14T11:10:03.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.104+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6939018445121783869', time=2024-09-14T13:05:05.064299+0000, chain.objs.size()=1 2024-09-14T11:10:03.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.104+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29__shadow_.sAxiQMeH0eijyspl7HnA5E3UYghUh_5_0 2024-09-14T11:10:03.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.104+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4490683207005358229', time=2024-09-14T13:05:05.065209+0000, chain.objs.size()=1 2024-09-14T11:10:03.109 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.104+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29__shadow_.raPsDSqUmF1JXrCSAkCIlx6RwehjOSx_0 2024-09-14T11:10:03.109 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.104+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1646377258107466568', time=2024-09-14T13:05:07.268743+0000, chain.objs.size()=1 2024-09-14T11:10:03.109 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.104+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30__shadow_.f2aWCkY9xRahx7POBMJG96XC7qK7xCp_0 2024-09-14T11:10:03.109 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.105+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18117650963774794245', time=2024-09-14T13:05:08.724766+0000, chain.objs.size()=1 2024-09-14T11:10:03.109 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.105+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31__shadow_.x4pD3ywrd91rB7zfnj_gVQX3AyG6YKW_0 2024-09-14T11:10:03.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.105+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8765494694850880989', time=2024-09-14T13:06:50.488554+0000, chain.objs.size()=1 2024-09-14T11:10:03.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.105+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37__shadow_.UFXHzR38nGQduZIWa41flBSlhQXweDb_0 2024-09-14T11:10:03.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.106+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6135659062152124746', time=2024-09-14T13:07:23.888409+0000, chain.objs.size()=1 2024-09-14T11:10:03.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.106+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39__shadow_.tySrxhQcKWpzzJhQOrXxJfUlwrrqJRE_0 2024-09-14T11:10:03.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.107+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:03.113 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.109+0000 7fbe1a694800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:10:03.113 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.111+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.113 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.111+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.113 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.111+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-14T11:10:03.113 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.111+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1077532962713955348', time=2024-09-14T13:01:30.533988+0000, chain.objs.size()=1 2024-09-14T11:10:03.113 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.111+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4__shadow_.D4CBylkwfkfIRrqj4j0QQkD_qYpnyHH_0 2024-09-14T11:10:03.113 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.111+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4679937817698873138', time=2024-09-14T13:01:30.659796+0000, chain.objs.size()=1 2024-09-14T11:10:03.113 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.111+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15__shadow_.en3z6Z7Au1dtBuxbpUT78jZibuzvYRt_0 2024-09-14T11:10:03.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.111+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3057835000615923590', time=2024-09-14T13:02:46.275304+0000, chain.objs.size()=1 2024-09-14T11:10:03.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.111+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19__shadow_.UQQ4OwdfrO8A-x_i7oWVtjD4xmhw9L-_0 2024-09-14T11:10:03.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.111+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2210870389015361583', time=2024-09-14T13:03:20.062675+0000, chain.objs.size()=1 2024-09-14T11:10:03.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.111+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21__shadow_.d-V0bnfZQNYxwQRKH4SmEjfPImiqBwn_0 2024-09-14T11:10:03.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.111+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2122376838887846051', time=2024-09-14T13:03:22.879325+0000, chain.objs.size()=1 2024-09-14T11:10:03.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.111+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23__shadow_.7IyI2XNYRk6xwGku1kEnRYpx2j8cK6L_0 2024-09-14T11:10:03.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.111+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4360151586030138282', time=2024-09-14T13:03:55.160984+0000, chain.objs.size()=1 2024-09-14T11:10:03.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.111+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24__shadow_.TM9k6KhQtr59gaIeFwloLQe7RA4-jYJ_0 2024-09-14T11:10:03.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.111+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8187730103485141959', time=2024-09-14T13:04:30.329251+0000, chain.objs.size()=1 2024-09-14T11:10:03.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.111+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27__shadow_.aZXA8SMoTW6geBoTrF4vpVwEVvbKeZ7_0 2024-09-14T11:10:03.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.111+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1567606142616434730', time=2024-09-14T13:04:32.520880+0000, chain.objs.size()=1 2024-09-14T11:10:03.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.111+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28__shadow_.Cmnm-Scin-olMBYGqXjE8TWdHpaIQuo_0 2024-09-14T11:10:03.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.112+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3156115910761101559', time=2024-09-14T13:05:05.073266+0000, chain.objs.size()=1 2024-09-14T11:10:03.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.112+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29__shadow_.66SCGOGnmGkeuSCQnXAsqfX3JrXpW5H_0 2024-09-14T11:10:03.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.112+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7908318505993137313', time=2024-09-14T13:06:16.025062+0000, chain.objs.size()=1 2024-09-14T11:10:03.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.112+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35__shadow_.9Lk_9Eb4zuqGcQaTQZANVFpAEWpa6eE_0 2024-09-14T11:10:03.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.112+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5129163202502295562', time=2024-09-14T13:06:48.709313+0000, chain.objs.size()=1 2024-09-14T11:10:03.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.112+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36__shadow_.rsa_6kBPWeGNdVEJ--jSv6V38RK_vz__0 2024-09-14T11:10:03.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.112+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6618276595078917673', time=2024-09-14T13:06:51.753046+0000, chain.objs.size()=1 2024-09-14T11:10:03.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.112+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38__shadow_.EScuS38yB-1g0d_3LABz78fwvaua0wK_0 2024-09-14T11:10:03.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.113+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14988789614777029921', time=2024-09-14T13:09:30.930476+0000, chain.objs.size()=1 2024-09-14T11:10:03.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.113+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17__shadow_.qBeVRPe8rpI9NwEvldzVwoAyVoLwOPh_0 2024-09-14T11:10:03.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.114+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:03.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.117+0000 7fbe1a694800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:10:03.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.118+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.117 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.118+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.118 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.119+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-14T11:10:03.118 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.119+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='_m3dIv5WouI97qol36_YOsPWpYPzu5HE', time=2024-09-14T13:01:30.715538+0000, chain.objs.size()=2 2024-09-14T11:10:03.119 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.119+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__shadow_.HrdhBujeMYmCXl6Jji9SFCDUSl13-8v_0 2024-09-14T11:10:03.119 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.119+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__shadow_.HrdhBujeMYmCXl6Jji9SFCDUSl13-8v_1 2024-09-14T11:10:03.119 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.119+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4288891329751422723', time=2024-09-14T13:01:30.741709+0000, chain.objs.size()=3 2024-09-14T11:10:03.119 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.119+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__multipart_foo-FROZEN.2~NGM1mcc-nAFE3fd1norGwNsKhDQgmA_.1 2024-09-14T11:10:03.119 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.119+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__multipart_foo-FROZEN.2~NGM1mcc-nAFE3fd1norGwNsKhDQgmA_.2 2024-09-14T11:10:03.119 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.119+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__multipart_foo-FROZEN.2~NGM1mcc-nAFE3fd1norGwNsKhDQgmA_.3 2024-09-14T11:10:03.119 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.119+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10830963675828438912', time=2024-09-14T13:01:30.849858+0000, chain.objs.size()=1 2024-09-14T11:10:03.119 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.119+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7__shadow_.2-QpI1rnLLbUQltOBchsNPElJYW5F4g_0 2024-09-14T11:10:03.119 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.119+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6445789878378513131', time=2024-09-14T13:03:22.022042+0000, chain.objs.size()=1 2024-09-14T11:10:03.119 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.119+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22__shadow_.i7HmKU33JX49XeoMEpuZ3MRh5MBtDEC_0 2024-09-14T11:10:03.119 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.119+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7038915892675559783', time=2024-09-14T13:03:22.025228+0000, chain.objs.size()=1 2024-09-14T11:10:03.119 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.119+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22__shadow_.y3TY_9jvQt8Ou3DL2jlSb6kTVL-8nif_0 2024-09-14T11:10:03.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.119+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10803326758051946386', time=2024-09-14T13:03:22.027756+0000, chain.objs.size()=1 2024-09-14T11:10:03.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.119+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22__shadow_.9owzglAB5qCFMXMWwXp4y4EK2mGEFCN_0 2024-09-14T11:10:03.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.119+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5859489574011704955', time=2024-09-14T13:03:58.000594+0000, chain.objs.size()=1 2024-09-14T11:10:03.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.119+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26__shadow_.MlYNqlLdzsdsmga7vuAqedfXa8SeBS4_0 2024-09-14T11:10:03.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.119+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8552642792975739438', time=2024-09-14T13:04:32.517041+0000, chain.objs.size()=1 2024-09-14T11:10:03.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.119+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28__shadow_.5mB_fzoxSSENMX7ueKIRIAb9w4ID3fV_0 2024-09-14T11:10:03.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.119+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3715552126929473743', time=2024-09-14T13:05:40.543150+0000, chain.objs.size()=1 2024-09-14T11:10:03.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.119+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32__shadow_.k4n7lOn4rgqMHEo9tzmAQWEwxVeOpRE_0 2024-09-14T11:10:03.121 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.122+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13430115289472753345', time=2024-09-14T13:05:42.314794+0000, chain.objs.size()=1 2024-09-14T11:10:03.121 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.122+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33__shadow_.esMSaNgJPQCmtkUXoYa4TgbfVAdp2Km_0 2024-09-14T11:10:03.121 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.122+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7975523443891160112', time=2024-09-14T13:06:15.087613+0000, chain.objs.size()=1 2024-09-14T11:10:03.121 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.122+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35__shadow_.Ji0aug_mDlHerKfAKpkbMzcye-qJ2w2_0 2024-09-14T11:10:03.121 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.122+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.357594392348917610', time=2024-09-14T13:06:50.492028+0000, chain.objs.size()=1 2024-09-14T11:10:03.121 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.122+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37__shadow_.dKf6oWqHh9ykCOxohL3FXmuUJfvH_6r_0 2024-09-14T11:10:03.121 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.122+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16612714961807030079', time=2024-09-14T13:09:42.939229+0000, chain.objs.size()=1 2024-09-14T11:10:03.121 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.122+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18__shadow:uTXrMvvDbze4Jka97bTzPGFsF9tZLzm_.GeqUOn2YL2avyNrvghG70INqw8sEy2E_0 2024-09-14T11:10:03.122 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.123+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:03.124 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.125+0000 7fbe1a694800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:10:03.125 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.127+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.126 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.127+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.127 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.127+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-14T11:10:03.127 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.127+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='_xlQgopPlc9S7GaKdxdlsDY0bBy1ECZL', time=2024-09-14T13:01:30.723152+0000, chain.objs.size()=2 2024-09-14T11:10:03.127 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.127+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__shadow_.YRj2Ptqfs8KJMVtLtjEnbI6-dNXppQt_0 2024-09-14T11:10:03.128 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.128+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__shadow_.YRj2Ptqfs8KJMVtLtjEnbI6-dNXppQt_1 2024-09-14T11:10:03.128 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.128+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5473358611521469111', time=2024-09-14T13:01:30.786893+0000, chain.objs.size()=2 2024-09-14T11:10:03.128 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.128+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13__shadow_.WtPFw8GcYO3HlHJjUjEHWHEVS7P3428_0 2024-09-14T11:10:03.128 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.128+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13__shadow_.WtPFw8GcYO3HlHJjUjEHWHEVS7P3428_1 2024-09-14T11:10:03.128 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.128+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10900955680617041778', time=2024-09-14T13:02:47.522791+0000, chain.objs.size()=1 2024-09-14T11:10:03.128 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.128+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20__shadow_.UGvOYclGAONmCZDz5iG_hGCoxiAkd7p_0 2024-09-14T11:10:03.128 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.128+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10567263000523999891', time=2024-09-14T13:02:47.524452+0000, chain.objs.size()=1 2024-09-14T11:10:03.128 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.128+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20__shadow_.PJ3K6_IJBYd4GzqSUan5gJbuknWdIpn_0 2024-09-14T11:10:03.128 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.128+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17525044706864903536', time=2024-09-14T13:03:21.092737+0000, chain.objs.size()=1 2024-09-14T11:10:03.128 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.128+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22__shadow_.aKLYtTs6QprGEzRWkYGGUpY58JBg5JO_0 2024-09-14T11:10:03.128 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.128+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6786328637443607005', time=2024-09-14T13:03:22.031232+0000, chain.objs.size()=1 2024-09-14T11:10:03.129 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.128+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22__shadow_.E0omg-6p1NKF9KaBLW552iURxOTuVik_0 2024-09-14T11:10:03.129 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.128+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17357188310381517928', time=2024-09-14T13:03:56.920003+0000, chain.objs.size()=1 2024-09-14T11:10:03.129 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.128+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25__shadow_.gelm9PUQmPosb6n6z51DYNSWDhqNgQ1_0 2024-09-14T11:10:03.129 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.128+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13847680470235764238', time=2024-09-14T13:05:40.545123+0000, chain.objs.size()=1 2024-09-14T11:10:03.129 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.128+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32__shadow_._JCtd-b02ZHrPLR4oBi_e5dcQb5hKO2_0 2024-09-14T11:10:03.129 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.128+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17670059365103608262', time=2024-09-14T13:05:41.580299+0000, chain.objs.size()=1 2024-09-14T11:10:03.129 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.128+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33__shadow_.HKDGnwV6NASxd_bK1q83lcDjngVN-3D_0 2024-09-14T11:10:03.129 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.128+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7268143383161024048', time=2024-09-14T13:06:14.458202+0000, chain.objs.size()=1 2024-09-14T11:10:03.129 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.128+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34__shadow_.8x9tJcZtZLulPOIMOMuBaJ8q6GsLEU__0 2024-09-14T11:10:03.130 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.130+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5702830586343505614', time=2024-09-14T13:06:48.710716+0000, chain.objs.size()=1 2024-09-14T11:10:03.130 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.130+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36__shadow_.pyrpl1-KygkfB2mFxmR4KKzCoPAQ9R2_0 2024-09-14T11:10:03.130 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.130+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16849408916227945754', time=2024-09-14T13:06:51.751244+0000, chain.objs.size()=1 2024-09-14T11:10:03.130 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.130+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38__shadow_.bWBkuchQwwqWSVQhbS43fdxIck_1j9E_0 2024-09-14T11:10:03.131 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.130+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18113770194230938131', time=2024-09-14T13:07:23.888407+0000, chain.objs.size()=1 2024-09-14T11:10:03.131 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.130+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39__shadow_.Sc5P7iSBwkUg2oikMCpBK9ylTT6j0vM_0 2024-09-14T11:10:03.131 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.130+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16041427448705488146', time=2024-09-14T13:07:23.889567+0000, chain.objs.size()=1 2024-09-14T11:10:03.131 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.130+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39__shadow_.jnJEQGw5co0V-MjxteyBOESBaGAVU6B_0 2024-09-14T11:10:03.131 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.130+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12423255235221083085', time=2024-09-14T13:07:23.890490+0000, chain.objs.size()=1 2024-09-14T11:10:03.131 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.130+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39__shadow_.xTxNC32CmFqP7oP4m-3K0kNkfPIr8mE_0 2024-09-14T11:10:03.131 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.130+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11234562883749552906', time=2024-09-14T13:09:30.927219+0000, chain.objs.size()=1 2024-09-14T11:10:03.131 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.130+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17__shadow_.ocn3dMWngrIRDCfIvrbD_64wNojHkJF_0 2024-09-14T11:10:03.131 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.132+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:03.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.134+0000 7fbe1a694800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:10:03.134 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.136+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.135 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.136+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.136 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.137+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-14T11:10:03.136 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.137+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13499261806152956069', time=2024-09-14T13:01:30.509648+0000, chain.objs.size()=1 2024-09-14T11:10:03.136 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.137+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4__shadow_.xx59Z-ydnMnmLdW7b_rYhwQQaMttRNv_0 2024-09-14T11:10:03.136 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.137+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2298407120315975741', time=2024-09-14T13:03:22.022364+0000, chain.objs.size()=1 2024-09-14T11:10:03.136 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.137+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22__shadow_.Fdq8Vl6v_B5b62Tuo2aOATo1fmyGDxy_0 2024-09-14T11:10:03.136 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.137+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9008242590489185582', time=2024-09-14T13:03:55.165404+0000, chain.objs.size()=1 2024-09-14T11:10:03.136 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.137+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24__shadow_.9bwTxeav1s-RB_oWwtXF8q6wxOEMblX_0 2024-09-14T11:10:03.136 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.137+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7408203785771844349', time=2024-09-14T13:03:56.193564+0000, chain.objs.size()=1 2024-09-14T11:10:03.137 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.137+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25__shadow_.5AiJzyrG-rpl4skEQFdtpCFuXox6hfv_0 2024-09-14T11:10:03.137 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.137+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16531206625058432757', time=2024-09-14T13:04:30.322068+0000, chain.objs.size()=1 2024-09-14T11:10:03.137 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.137+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27__shadow_.zzGj4ArrGS62xUpvZGsuDh3MSjnfJSx_0 2024-09-14T11:10:03.137 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.137+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16883563746989765978', time=2024-09-14T13:04:31.785394+0000, chain.objs.size()=1 2024-09-14T11:10:03.137 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.137+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28__shadow_.8teU_GcmcQ9swBtDFJWOP9oM0eiaSx7_0 2024-09-14T11:10:03.137 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.137+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1460620021554416425', time=2024-09-14T13:05:07.269547+0000, chain.objs.size()=1 2024-09-14T11:10:03.137 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.137+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30__shadow_.fUJVMMvKQYROQ04zgISfscxE0JQKMyN_0 2024-09-14T11:10:03.137 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.137+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5993889453193141838', time=2024-09-14T13:05:07.274063+0000, chain.objs.size()=1 2024-09-14T11:10:03.137 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.137+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30__shadow_.99Z94UY6Q1tCFTuawvC2fo47k35V4a5_0 2024-09-14T11:10:03.137 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.137+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9749376814231607043', time=2024-09-14T13:05:08.723269+0000, chain.objs.size()=1 2024-09-14T11:10:03.137 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.137+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31__shadow_.N8pfdOJoC-rU9vekEBDjnIjxmEzTrxe_0 2024-09-14T11:10:03.137 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.137+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1952660412804482740', time=2024-09-14T13:05:40.544854+0000, chain.objs.size()=1 2024-09-14T11:10:03.137 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.137+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32__shadow_.ONoyL8GXWtNgIGcPx6zCyEgR48vZBtz_0 2024-09-14T11:10:03.137 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.137+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2825496127721450392', time=2024-09-14T13:06:48.709154+0000, chain.objs.size()=1 2024-09-14T11:10:03.138 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.137+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36__shadow_.sJSLFnrohuWigo5rv71XYu9aWZd9Vkt_0 2024-09-14T11:10:03.138 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.137+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15828446037520527524', time=2024-09-14T13:06:48.711709+0000, chain.objs.size()=1 2024-09-14T11:10:03.138 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.137+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36__shadow_.rJThqIuXe5XWmG0aE2E3R5Ba-ZCHxP4_0 2024-09-14T11:10:03.138 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.138+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17667672961667562117', time=2024-09-14T13:06:51.750729+0000, chain.objs.size()=1 2024-09-14T11:10:03.139 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.138+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38__shadow_.3TWbkrPSfHUrql189q-6rs46Seb6Chb_0 2024-09-14T11:10:03.139 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.139+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15652007756776316464', time=2024-09-14T13:07:23.890723+0000, chain.objs.size()=1 2024-09-14T11:10:03.139 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.139+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39__shadow_.Y6KxKa_FizCIy4ZmIMZMXFb3vwD1s9V_0 2024-09-14T11:10:03.139 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.139+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5859696822837939432', time=2024-09-14T13:09:42.938798+0000, chain.objs.size()=1 2024-09-14T11:10:03.139 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.139+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18__shadow:Ezr7f8qqke5-J0UWQ4FGuVJ-4izVHIm_.nRYrAeuGUN9kMgZylMHeG4IscC2b8vC_0 2024-09-14T11:10:03.139 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.140+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:03.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.142+0000 7fbe1a694800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:10:03.142 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.144+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.143 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.144+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.144 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.144+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-14T11:10:03.144 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.144+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12317520870698197980', time=2024-09-14T13:03:20.057456+0000, chain.objs.size()=1 2024-09-14T11:10:03.144 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.144+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21__shadow_.5317lF6UFPwq-WXBOvoQWMkLWcniTK7_0 2024-09-14T11:10:03.144 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.144+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14630042152124829885', time=2024-09-14T13:03:20.059887+0000, chain.objs.size()=1 2024-09-14T11:10:03.144 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.144+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21__shadow_.oqPzZWGEgyzBAqs7NP9jgsCALwnORG4_0 2024-09-14T11:10:03.144 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.144+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17851001199113080860', time=2024-09-14T13:03:22.879511+0000, chain.objs.size()=1 2024-09-14T11:10:03.144 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.144+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23__shadow_.6k1l-Oowd6UlsdoqaQ3Va3X13FOgBtc_0 2024-09-14T11:10:03.144 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.144+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13638684620174247964', time=2024-09-14T13:03:56.921462+0000, chain.objs.size()=1 2024-09-14T11:10:03.144 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.144+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25__shadow_.CzNMAB8Y6Dxm5GnZC_KCNYsPWFAliWR_0 2024-09-14T11:10:03.144 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.144+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2252478510944854515', time=2024-09-14T13:03:58.000394+0000, chain.objs.size()=1 2024-09-14T11:10:03.144 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.144+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26__shadow_.Ze-mJJAma2TfJbexhkYZiHOpmfH-eNc_0 2024-09-14T11:10:03.144 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.144+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5326788808617133610', time=2024-09-14T13:05:05.063798+0000, chain.objs.size()=1 2024-09-14T11:10:03.145 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.144+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29__shadow_.WIlIPKXKnbRUFwpcPh9xvXEW0ud5aPm_0 2024-09-14T11:10:03.145 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.144+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1482133419098826027', time=2024-09-14T13:05:08.721819+0000, chain.objs.size()=1 2024-09-14T11:10:03.145 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.144+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31__shadow_.mUDawEsHQHS4WftTf3vSc6sOxtSnGRe_0 2024-09-14T11:10:03.145 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.144+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17869870729392134147', time=2024-09-14T13:06:16.025246+0000, chain.objs.size()=1 2024-09-14T11:10:03.145 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.144+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35__shadow_.qxQTaRWR3zcQHFofsQyX-3Y4iTTaSyr_0 2024-09-14T11:10:03.145 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.144+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14201355661372685234', time=2024-09-14T13:06:48.708676+0000, chain.objs.size()=1 2024-09-14T11:10:03.145 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.144+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36__shadow_.4cbrc5Q8aVyyzDdTsbAZaD3KtI8lX8A_0 2024-09-14T11:10:03.145 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.144+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8520099788006523277', time=2024-09-14T13:06:50.487843+0000, chain.objs.size()=1 2024-09-14T11:10:03.145 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.144+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37__shadow_.N5SUE9yIVEXeyfx4wtQwAS-uR5ywjCH_0 2024-09-14T11:10:03.145 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.144+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17021305398871327799', time=2024-09-14T13:07:23.886448+0000, chain.objs.size()=1 2024-09-14T11:10:03.145 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.144+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39__shadow_.1C6Fsgz3_FtIzb2VKppEoHjTxaR8Qv__0 2024-09-14T11:10:03.146 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.146+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:03.147 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.149+0000 7fbe1a694800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:10:03.148 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.150+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.149 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.150+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.150 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.151+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-14T11:10:03.150 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.151+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17164155466848276297', time=2024-09-14T13:01:30.517694+0000, chain.objs.size()=1 2024-09-14T11:10:03.150 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.151+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4__shadow_.NnR-967UFyG52r1SiDhpT4ijkd95SdL_0 2024-09-14T11:10:03.150 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.151+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5429439615894379303', time=2024-09-14T13:01:30.522267+0000, chain.objs.size()=1 2024-09-14T11:10:03.150 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.151+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4__shadow_.tQFIAa6iqJXRycIcW3_92okuxmYjSc-_0 2024-09-14T11:10:03.150 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.151+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='_rzyqNbZ_Ui5e_rReIlh-FsKXs2x51T_', time=2024-09-14T13:01:30.652778+0000, chain.objs.size()=1 2024-09-14T11:10:03.150 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.151+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15__shadow_.UtWTOTZcjH7Nx5jtrh4u01A4rm7890f_0 2024-09-14T11:10:03.150 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.151+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8823166689257408714', time=2024-09-14T13:02:46.267426+0000, chain.objs.size()=1 2024-09-14T11:10:03.151 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.151+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19__shadow_.4c6Ngn-zxlPhdNDhjPmUkC1vBOzMMjK_0 2024-09-14T11:10:03.151 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.151+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2344809558482081405', time=2024-09-14T13:02:46.268228+0000, chain.objs.size()=1 2024-09-14T11:10:03.151 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.151+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19__shadow_.Q7OIuMY49Sb2d6E9QisQwCenm5AUMZa_0 2024-09-14T11:10:03.151 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.151+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15778588279715345000', time=2024-09-14T13:02:47.528908+0000, chain.objs.size()=1 2024-09-14T11:10:03.151 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.151+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20__shadow_.Ve6XGMtBgtGY3zLHiMfG0IH9WkHZpvP_0 2024-09-14T11:10:03.151 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.151+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5824690390033929375', time=2024-09-14T13:03:22.023101+0000, chain.objs.size()=1 2024-09-14T11:10:03.151 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.151+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22__shadow_.bnZPyfO6SS_aqBrs1LuBPM28DghHxnt_0 2024-09-14T11:10:03.151 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.151+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9632819135472465077', time=2024-09-14T13:03:56.920232+0000, chain.objs.size()=1 2024-09-14T11:10:03.151 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.151+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25__shadow_.xSCmgy98KDHtVCK1MGrntaytZLfzcGO_0 2024-09-14T11:10:03.151 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.151+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18366961487652858902', time=2024-09-14T13:03:58.007465+0000, chain.objs.size()=1 2024-09-14T11:10:03.151 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.151+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26__shadow_.FITfHidmHaYl7R1FQu5nk4sr_WAVlDT_0 2024-09-14T11:10:03.151 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.151+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4020462590746846473', time=2024-09-14T13:04:30.321363+0000, chain.objs.size()=1 2024-09-14T11:10:03.151 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.151+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27__shadow_.TyYOrzHq2c8ZfaGc2K08RxehqS-viff_0 2024-09-14T11:10:03.151 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.151+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16034799360356936542', time=2024-09-14T13:05:08.722189+0000, chain.objs.size()=1 2024-09-14T11:10:03.152 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.151+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31__shadow_.F1bYLmzzbkes2bDIC5RgRYfcqJfwGpX_0 2024-09-14T11:10:03.152 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.151+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10084214498616263500', time=2024-09-14T13:05:42.315509+0000, chain.objs.size()=1 2024-09-14T11:10:03.152 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.151+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33__shadow_.P3LsruoN4VKIHWxyFPVkmtOwoE8kGYK_0 2024-09-14T11:10:03.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.153+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14236797070393484053', time=2024-09-14T13:05:42.316179+0000, chain.objs.size()=1 2024-09-14T11:10:03.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.153+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33__shadow_.JVnoFaiPDaTu5wNkklRwRjtP4kiuECp_0 2024-09-14T11:10:03.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.153+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11607743022632114418', time=2024-09-14T13:06:15.817751+0000, chain.objs.size()=1 2024-09-14T11:10:03.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.153+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35__shadow_.L1y_Tcz7KPmY3Xby4BAK_yHHYbppgCx_0 2024-09-14T11:10:03.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.154+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7955923164305410020', time=2024-09-14T13:06:15.818436+0000, chain.objs.size()=1 2024-09-14T11:10:03.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.154+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35__shadow_.1Uc0R5mkBvY1E-eUIPNf3xj47ywKV_X_0 2024-09-14T11:10:03.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.154+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6865523130501464146', time=2024-09-14T13:06:15.819177+0000, chain.objs.size()=1 2024-09-14T11:10:03.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.154+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35__shadow_.ZyTY9Pq-OTbj-v4UhnT8jVJUdoBm6_Z_0 2024-09-14T11:10:03.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.154+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11920462025732130540', time=2024-09-14T13:06:15.820591+0000, chain.objs.size()=1 2024-09-14T11:10:03.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.154+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35__shadow_.jcr6KGmlQUUlMadXRaW2DxSGYubHDoB_0 2024-09-14T11:10:03.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.154+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13168816093057523723', time=2024-09-14T13:06:48.709176+0000, chain.objs.size()=1 2024-09-14T11:10:03.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.154+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36__shadow_.xo7MTJ4dfSYtKIxOUotVwHPzhdBR05e_0 2024-09-14T11:10:03.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.154+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15348990984628522212', time=2024-09-14T13:06:51.758439+0000, chain.objs.size()=1 2024-09-14T11:10:03.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.154+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38__shadow_.NpHvKpq6-kbkmSfqf_Y_RiyGsOwza1A_0 2024-09-14T11:10:03.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.155+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:03.155 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.157+0000 7fbe1a694800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:10:03.157 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.159+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.159+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.159 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.160+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-14T11:10:03.159 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.160+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4142416409859602121', time=2024-09-14T13:01:30.674537+0000, chain.objs.size()=1 2024-09-14T11:10:03.159 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.160+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15__shadow_.uLnFR-pKXcCUIXeRxj197s4c9bhfUMm_0 2024-09-14T11:10:03.159 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.160+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3641353035608146895', time=2024-09-14T13:01:30.726941+0000, chain.objs.size()=3 2024-09-14T11:10:03.159 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.160+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__multipart_foo-LUKEWARM.2~5lyvpszBcbiA6-AintwdqOM4swCDj8X.1 2024-09-14T11:10:03.159 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.160+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__multipart_foo-LUKEWARM.2~5lyvpszBcbiA6-AintwdqOM4swCDj8X.2 2024-09-14T11:10:03.159 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.160+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__multipart_foo-LUKEWARM.2~5lyvpszBcbiA6-AintwdqOM4swCDj8X.3 2024-09-14T11:10:03.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.160+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6380888001571439194', time=2024-09-14T13:01:30.768346+0000, chain.objs.size()=3 2024-09-14T11:10:03.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.160+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14__multipart_foo-LUKEWARM.2~nOB4IWZOZXVY8hPrYas-l7c7CLVFFiR.1 2024-09-14T11:10:03.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.160+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14__multipart_foo-LUKEWARM.2~nOB4IWZOZXVY8hPrYas-l7c7CLVFFiR.2 2024-09-14T11:10:03.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.160+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14__multipart_foo-LUKEWARM.2~nOB4IWZOZXVY8hPrYas-l7c7CLVFFiR.3 2024-09-14T11:10:03.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.160+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16577577958827977169', time=2024-09-14T13:01:30.883196+0000, chain.objs.size()=1 2024-09-14T11:10:03.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.160+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8__shadow_.ogbprFc4TFGrxXN1JoSqghCFchHqMWC_0 2024-09-14T11:10:03.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.160+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16267144018617630122', time=2024-09-14T13:02:46.268476+0000, chain.objs.size()=1 2024-09-14T11:10:03.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.160+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19__shadow_.cg6ahj5mSgwnG0SrdLyTwUBZg65vUi9_0 2024-09-14T11:10:03.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.160+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16758102387469384257', time=2024-09-14T13:02:47.524146+0000, chain.objs.size()=1 2024-09-14T11:10:03.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.160+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20__shadow_.P4C4E9BpEhYk3xY7kskgYUgIJ5BVW1X_0 2024-09-14T11:10:03.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.160+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5153593953642285094', time=2024-09-14T13:03:22.025747+0000, chain.objs.size()=1 2024-09-14T11:10:03.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.160+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22__shadow_.Stj51lOgzmgJ28rybWfSbfSThWu-ATK_0 2024-09-14T11:10:03.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.160+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11107615939250730339', time=2024-09-14T13:03:55.162027+0000, chain.objs.size()=1 2024-09-14T11:10:03.161 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.160+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24__shadow_.w24zc7Bx7k4mAXnpfBzVegxAghwit08_0 2024-09-14T11:10:03.162 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.163+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.381697179367208629', time=2024-09-14T13:03:56.920904+0000, chain.objs.size()=1 2024-09-14T11:10:03.162 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.163+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25__shadow_.4F_9MR6wt6OL0rtuSKpeOPGyOaZUB8z_0 2024-09-14T11:10:03.162 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.163+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14735466243634748291', time=2024-09-14T13:03:57.998174+0000, chain.objs.size()=1 2024-09-14T11:10:03.162 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.163+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26__shadow_.pDU0jTCC9e-dprK6Ff0R1YRiQHQJpc-_0 2024-09-14T11:10:03.162 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.163+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15060701867225813063', time=2024-09-14T13:04:32.520947+0000, chain.objs.size()=1 2024-09-14T11:10:03.162 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.163+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28__shadow_.BnbxUCZ6KftEgLG-yaAZ2emDhe14ZQs_0 2024-09-14T11:10:03.162 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.163+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17200650742388931207', time=2024-09-14T13:05:05.065693+0000, chain.objs.size()=1 2024-09-14T11:10:03.163 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.163+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29__shadow_.gSqs9NXzTPDf-7_4eF99ePT8nYWj9kc_0 2024-09-14T11:10:03.163 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.163+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14980522983582738481', time=2024-09-14T13:05:05.068116+0000, chain.objs.size()=1 2024-09-14T11:10:03.163 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.163+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29__shadow_.X9bpBT9Tbn0zHkM4mOrkD3ihxTfbId__0 2024-09-14T11:10:03.163 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.163+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2686752469308455171', time=2024-09-14T13:05:06.531843+0000, chain.objs.size()=1 2024-09-14T11:10:03.163 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.163+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30__shadow_.loFV5ZkF_lshl4NQwR6ehROfUnyfV8M_0 2024-09-14T11:10:03.163 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.163+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2243473549767267180', time=2024-09-14T13:05:08.730637+0000, chain.objs.size()=1 2024-09-14T11:10:03.163 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.163+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31__shadow_.QLHePSWnXmnfuG6G7PZWMKfnuhZzYnj_0 2024-09-14T11:10:03.163 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.163+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.856619586805298806', time=2024-09-14T13:06:15.816577+0000, chain.objs.size()=1 2024-09-14T11:10:03.163 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.163+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35__shadow_.eeeT2q5tyvHjIVJZiS9sqP-F_jouCnB_0 2024-09-14T11:10:03.163 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.163+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5864787854917159074', time=2024-09-14T13:07:23.894618+0000, chain.objs.size()=1 2024-09-14T11:10:03.163 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.163+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39__shadow_.WF7nvUHggGRvICzeY8YAxtkr4Gz0S5m_0 2024-09-14T11:10:03.164 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.165+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:03.166 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.167+0000 7fbe1a694800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:10:03.167 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.168+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.167 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.169+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.168 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.169+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-14T11:10:03.168 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.169+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='_PwcLat7rdyREvc7WzFHcHZjIp72DXX-', time=2024-09-14T13:01:30.737907+0000, chain.objs.size()=1 2024-09-14T11:10:03.168 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.169+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__shadow_.le95HA5lZroqCwnrMN9HS1tCp8rIqYM_0 2024-09-14T11:10:03.169 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.169+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10326571793987156929', time=2024-09-14T13:02:46.269719+0000, chain.objs.size()=1 2024-09-14T11:10:03.169 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.169+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19__shadow_.HqCsUoBWg8RPBw9Kk02GF_50ZwTIcF3_0 2024-09-14T11:10:03.169 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.169+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13393799237877404456', time=2024-09-14T13:02:46.271608+0000, chain.objs.size()=1 2024-09-14T11:10:03.169 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.169+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19__shadow_.wob2lFN6tqNzJ5dCHjwTC-6d94vWLqw_0 2024-09-14T11:10:03.169 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.169+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2544380709812419263', time=2024-09-14T13:03:22.020481+0000, chain.objs.size()=1 2024-09-14T11:10:03.169 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.169+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22__shadow_.ieKkbsGHACOVcSXG0dg9fYG2QcfL3Qb_0 2024-09-14T11:10:03.169 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.169+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7154411875128194020', time=2024-09-14T13:03:55.171511+0000, chain.objs.size()=1 2024-09-14T11:10:03.169 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.169+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24__shadow_.N-iT0-r_wIVdSxWv4RyyauEon-v0gQA_0 2024-09-14T11:10:03.169 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.169+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18001527483837260249', time=2024-09-14T13:03:56.919009+0000, chain.objs.size()=1 2024-09-14T11:10:03.169 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.169+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25__shadow_.vKofACJyyakcTRaW5VwnS75FzCC6epB_0 2024-09-14T11:10:03.169 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.169+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13180579288784609147', time=2024-09-14T13:03:58.003536+0000, chain.objs.size()=1 2024-09-14T11:10:03.169 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.169+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26__shadow_.QHQPvz9o8z5HKBiVpoAF-fcRXTuA3MK_0 2024-09-14T11:10:03.170 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.169+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8496387648500670194', time=2024-09-14T13:04:32.515719+0000, chain.objs.size()=1 2024-09-14T11:10:03.170 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.169+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28__shadow_.0ep4qCMNnGhkgkYg_KcUUQ_uZzLmeXc_0 2024-09-14T11:10:03.170 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.169+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4533496916361728508', time=2024-09-14T13:05:40.543104+0000, chain.objs.size()=1 2024-09-14T11:10:03.170 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.169+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32__shadow_.Sga89cK8tcxVLyHaucHfCBfII9HZcCV_0 2024-09-14T11:10:03.170 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.169+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6454840003638127509', time=2024-09-14T13:05:40.546370+0000, chain.objs.size()=1 2024-09-14T11:10:03.170 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.169+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32__shadow_.Zbd3FnVhLn4Qzepv8B1lSJjqVS0wcWy_0 2024-09-14T11:10:03.170 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.169+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10023676061407395116', time=2024-09-14T13:06:14.455607+0000, chain.objs.size()=1 2024-09-14T11:10:03.170 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.169+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34__shadow_.xcJRyy7Z60YMR3GSRuP9NC8dQz0XAOD_0 2024-09-14T11:10:03.170 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.169+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11553165967223627005', time=2024-09-14T13:06:14.464032+0000, chain.objs.size()=1 2024-09-14T11:10:03.170 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.169+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34__shadow_.ShSa05ppvPZMIFSWH7t9KcNPDjOS-37_0 2024-09-14T11:10:03.173 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.171+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17773117920439399130', time=2024-09-14T13:06:15.817740+0000, chain.objs.size()=1 2024-09-14T11:10:03.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.171+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35__shadow_.hV_hQbokNtqmtJDbDWbLYKgnp-DTiXz_0 2024-09-14T11:10:03.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.171+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16976878710514610196', time=2024-09-14T13:06:15.820342+0000, chain.objs.size()=1 2024-09-14T11:10:03.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.171+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35__shadow_.XIaEEHlqOGqXq88kwSAnc2JgSSiS2jI_0 2024-09-14T11:10:03.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.171+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15118832294996577669', time=2024-09-14T13:06:48.717342+0000, chain.objs.size()=1 2024-09-14T11:10:03.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.171+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36__shadow_.yJow2TKTbJ1YV02TVwq-UBguNePfLtu_0 2024-09-14T11:10:03.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.171+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6486774196523868658', time=2024-09-14T13:06:50.490266+0000, chain.objs.size()=1 2024-09-14T11:10:03.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.171+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37__shadow_.S7yOFP6Rb06eA0vYNKeAwFqg7VMH93s_0 2024-09-14T11:10:03.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.171+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8348494040417003343', time=2024-09-14T13:06:50.491580+0000, chain.objs.size()=1 2024-09-14T11:10:03.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.171+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37__shadow_.aRMuTliZILja7rXOcVnorZbuNPFcdTl_0 2024-09-14T11:10:03.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.173+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:03.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.175+0000 7fbe1a694800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:10:03.176 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.176+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.176 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.176+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.176 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.177+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-14T11:10:03.176 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.177+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5675839499263280108', time=2024-09-14T13:02:46.266606+0000, chain.objs.size()=1 2024-09-14T11:10:03.176 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.177+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19__shadow_.kXj4Ou8dfUvHNUCutf3imJPcyumB5eM_0 2024-09-14T11:10:03.176 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.177+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6605066246041481485', time=2024-09-14T13:02:46.267628+0000, chain.objs.size()=1 2024-09-14T11:10:03.177 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.177+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19__shadow_.Sv6lkbu1WUPUJGY4PWocmFu-SKLPlEW_0 2024-09-14T11:10:03.177 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.177+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2968471416449830126', time=2024-09-14T13:02:47.520233+0000, chain.objs.size()=1 2024-09-14T11:10:03.177 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.177+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20__shadow_.r1-7UVj9rcMMeS7iSWtfwXGBYv1Sfs4_0 2024-09-14T11:10:03.177 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.177+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9433186054524046799', time=2024-09-14T13:02:47.520921+0000, chain.objs.size()=1 2024-09-14T11:10:03.177 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.177+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20__shadow_.bKegsqT4GJmLPYFFnB51CkgF8zRiCGr_0 2024-09-14T11:10:03.177 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.177+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4019145685486470612', time=2024-09-14T13:02:47.529393+0000, chain.objs.size()=1 2024-09-14T11:10:03.177 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.177+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20__shadow_.-gJxwlWNhU0Gg-RSmRgAOVFvd1enYHb_0 2024-09-14T11:10:03.177 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.177+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5783907174568511839', time=2024-09-14T13:03:20.061123+0000, chain.objs.size()=1 2024-09-14T11:10:03.177 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.177+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21__shadow_.VLIW6CbQWygMGYIGn0l1yh9hoPOmdkI_0 2024-09-14T11:10:03.177 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.177+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3272963819911499181', time=2024-09-14T13:03:20.070360+0000, chain.objs.size()=1 2024-09-14T11:10:03.177 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.177+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21__shadow_.98jJ2mDLBC5uK-lP0_1d1eiAmdMFRV8_0 2024-09-14T11:10:03.177 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.177+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9182285070335384975', time=2024-09-14T13:03:56.921830+0000, chain.objs.size()=1 2024-09-14T11:10:03.178 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.177+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25__shadow_.G4cdjpvujWy-BIkQiHjb6AjsFguzzW9_0 2024-09-14T11:10:03.178 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.177+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11376330366683087344', time=2024-09-14T13:03:56.923774+0000, chain.objs.size()=1 2024-09-14T11:10:03.178 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.177+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25__shadow_.Pjt31sFXGd1R8FkxcjDYpPON_TW_89u_0 2024-09-14T11:10:03.178 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.177+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11865589613848822966', time=2024-09-14T13:04:30.321108+0000, chain.objs.size()=1 2024-09-14T11:10:03.178 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.177+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27__shadow_.WRnL0f8hTmf1iHdQ3mtn3p0yIq7AUcc_0 2024-09-14T11:10:03.178 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.177+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12481547281728456824', time=2024-09-14T13:04:30.321985+0000, chain.objs.size()=1 2024-09-14T11:10:03.178 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.177+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27__shadow_.UM1v3ya8cEeQMgbPqpbLcplKYXqOr3U_0 2024-09-14T11:10:03.178 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.177+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9160839495150282019', time=2024-09-14T13:05:05.068245+0000, chain.objs.size()=1 2024-09-14T11:10:03.178 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.177+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29__shadow_.zBXPe6kQcGHsKVBISJBE-CV-AGTet23_0 2024-09-14T11:10:03.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.179+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1120422530376327399', time=2024-09-14T13:05:42.322276+0000, chain.objs.size()=1 2024-09-14T11:10:03.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.179+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33__shadow_.-ZpzrMfI80o6VdKFeEWiuOs5tC4zd1A_0 2024-09-14T11:10:03.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.179+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14846645382954006169', time=2024-09-14T13:06:14.462314+0000, chain.objs.size()=1 2024-09-14T11:10:03.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.179+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34__shadow_.xJ0iYcXAl5daSYnob3EZmic4K7jV38U_0 2024-09-14T11:10:03.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.179+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11490996975870720751', time=2024-09-14T13:06:15.816639+0000, chain.objs.size()=1 2024-09-14T11:10:03.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.179+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35__shadow_.dCzBSTPwt_Uqn3J5l9d5ICpX_Wc2MDz_0 2024-09-14T11:10:03.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.179+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16212098786635350567', time=2024-09-14T13:06:48.710056+0000, chain.objs.size()=1 2024-09-14T11:10:03.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.179+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36__shadow_.FI3T8CL16JQMgjuM8em9INQswGpwRHH_0 2024-09-14T11:10:03.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.179+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6507627695096543637', time=2024-09-14T13:06:48.714533+0000, chain.objs.size()=1 2024-09-14T11:10:03.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.179+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36__shadow_.bMKG2Fu0c5aRwJVu_Y8U6p_2I0OvTAt_0 2024-09-14T11:10:03.181 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.179+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4975126830434986454', time=2024-09-14T13:06:50.489309+0000, chain.objs.size()=1 2024-09-14T11:10:03.181 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.179+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37__shadow_.BSexCr-D9MIdYyNpux1XJtnpgryo-M0_0 2024-09-14T11:10:03.181 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.179+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9102774858203395521', time=2024-09-14T13:06:50.496257+0000, chain.objs.size()=1 2024-09-14T11:10:03.181 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.179+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37__shadow_.dtv18Q24_udLxOsJv6J1z9rGadKU-CS_0 2024-09-14T11:10:03.181 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.179+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5056239997035208628', time=2024-09-14T13:09:30.923120+0000, chain.objs.size()=1 2024-09-14T11:10:03.181 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.179+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17__shadow_.DV_6Ed1cioo1ClRCuA9MHgljsEq96aA_0 2024-09-14T11:10:03.181 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.179+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8530806439280670913', time=2024-09-14T13:09:38.361150+0000, chain.objs.size()=1 2024-09-14T11:10:03.181 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.179+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18__shadow:Bt.gMJ9oBcYNYVj6KxiiqdEk4NghV1._.QFjJVXKzuzl6mqFdxBlrWtdLcLHBeEs_0 2024-09-14T11:10:03.181 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.181+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:03.182 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.183+0000 7fbe1a694800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:10:03.183 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.184+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.183 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.185+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.185+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-14T11:10:03.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.185+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15065388726834758581', time=2024-09-14T13:01:30.596986+0000, chain.objs.size()=4 2024-09-14T11:10:03.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.185+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10__multipart_foo.2~s3YtaT4QesIGCoFCR7FiqiYyqrWrsoT.1 2024-09-14T11:10:03.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.185+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10__multipart_foo.2~s3YtaT4QesIGCoFCR7FiqiYyqrWrsoT.2 2024-09-14T11:10:03.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.185+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10__multipart_foo.2~s3YtaT4QesIGCoFCR7FiqiYyqrWrsoT.3 2024-09-14T11:10:03.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.185+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10__multipart_foo.2~s3YtaT4QesIGCoFCR7FiqiYyqrWrsoT.4 2024-09-14T11:10:03.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.185+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10227202223519766557', time=2024-09-14T13:02:47.521954+0000, chain.objs.size()=1 2024-09-14T11:10:03.186 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.185+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20__shadow_.0r-_YGlsBDd6wq6NoM83IlE2YmRE9PZ_0 2024-09-14T11:10:03.186 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.185+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2920986350290284536', time=2024-09-14T13:03:20.072264+0000, chain.objs.size()=1 2024-09-14T11:10:03.186 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.185+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21__shadow_.3MZCeXZRDjBW1NI8H3-eNAOhV_oIB0v_0 2024-09-14T11:10:03.186 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.185+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6289066871574309407', time=2024-09-14T13:03:22.874374+0000, chain.objs.size()=1 2024-09-14T11:10:03.186 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.185+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23__shadow_.eBHa7usaBlsEJWPupRsA00dibP05IB__0 2024-09-14T11:10:03.186 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.185+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3448756184059408295', time=2024-09-14T13:03:55.171598+0000, chain.objs.size()=1 2024-09-14T11:10:03.186 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.185+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24__shadow_.7HwUJ4HY5hBJVukGruHROrB1dzIzrHB_0 2024-09-14T11:10:03.186 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.185+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5996525759109403140', time=2024-09-14T13:03:57.998195+0000, chain.objs.size()=1 2024-09-14T11:10:03.186 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.185+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26__shadow_.fZmHW8mKesmkqdmhHOg1_I6j9duepu9_0 2024-09-14T11:10:03.186 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.185+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7440442489926853604', time=2024-09-14T13:03:58.003264+0000, chain.objs.size()=1 2024-09-14T11:10:03.186 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.185+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26__shadow_.zhsd4zem0Cczlkvn4bgqwEDlQuBjP7R_0 2024-09-14T11:10:03.186 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.185+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13659304487877623361', time=2024-09-14T13:04:32.513740+0000, chain.objs.size()=1 2024-09-14T11:10:03.186 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.185+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28__shadow_.rhVlFZ3NxDyT7V4A2XHislSTSJIX0_R_0 2024-09-14T11:10:03.187 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.185+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17747462353153459283', time=2024-09-14T13:05:40.555766+0000, chain.objs.size()=1 2024-09-14T11:10:03.187 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.185+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32__shadow_.hJvjGtWD-WSrC_nuqI6hfJgAIun16ph_0 2024-09-14T11:10:03.188 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.187+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16730142032502131336', time=2024-09-14T13:05:42.316492+0000, chain.objs.size()=1 2024-09-14T11:10:03.188 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.187+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33__shadow_.tBF5LpR5lAoUCFQR1FW3jYD4pOtjydW_0 2024-09-14T11:10:03.188 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.187+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5396768108793056528', time=2024-09-14T13:06:48.710991+0000, chain.objs.size()=1 2024-09-14T11:10:03.188 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.187+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36__shadow_.Vb1zHxEVrI6yLm_ZZsJnyLohJElwtIH_0 2024-09-14T11:10:03.188 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.187+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9400399991158559192', time=2024-09-14T13:06:48.712059+0000, chain.objs.size()=1 2024-09-14T11:10:03.188 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.187+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36__shadow_.U1ZV00jFj14eE4-5zZNJlf0_860VbUU_0 2024-09-14T11:10:03.188 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.187+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3513643648990942149', time=2024-09-14T13:06:51.749075+0000, chain.objs.size()=1 2024-09-14T11:10:03.188 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.187+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38__shadow_.Bn10QfuKI5SihxFd67cZff7_Az35YXr_0 2024-09-14T11:10:03.188 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.189+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:03.190 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.191+0000 7fbe1a694800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:10:03.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.193+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.193+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.193+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-14T11:10:03.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.193+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11456701320619194599', time=2024-09-14T13:01:30.708540+0000, chain.objs.size()=3 2024-09-14T11:10:03.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.193+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__multipart_foo-FROZEN.2~NGM1mcc-nAFE3fd1norGwNsKhDQgmA_.1 2024-09-14T11:10:03.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.193+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__multipart_foo-FROZEN.2~NGM1mcc-nAFE3fd1norGwNsKhDQgmA_.2 2024-09-14T11:10:03.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.193+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__multipart_foo-FROZEN.2~NGM1mcc-nAFE3fd1norGwNsKhDQgmA_.3 2024-09-14T11:10:03.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.193+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3126078334440539068', time=2024-09-14T13:01:30.764667+0000, chain.objs.size()=3 2024-09-14T11:10:03.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.193+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14__multipart_foo-STANDARD.2~vjAH0Dat9hswSo1QIsC9u1An1kPcWHU.1 2024-09-14T11:10:03.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.193+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14__multipart_foo-STANDARD.2~vjAH0Dat9hswSo1QIsC9u1An1kPcWHU.2 2024-09-14T11:10:03.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.193+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14__multipart_foo-STANDARD.2~vjAH0Dat9hswSo1QIsC9u1An1kPcWHU.3 2024-09-14T11:10:03.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.193+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3998183104628285498', time=2024-09-14T13:02:46.268527+0000, chain.objs.size()=1 2024-09-14T11:10:03.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.193+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19__shadow_.H0MhrjKHAVDEFrbxSZPWAqJl9mdJNvy_0 2024-09-14T11:10:03.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.193+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2456673574350859555', time=2024-09-14T13:02:47.521249+0000, chain.objs.size()=1 2024-09-14T11:10:03.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.193+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20__shadow_.SEE2JACYLqJam-6nHB945MwAQ4bNaXp_0 2024-09-14T11:10:03.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.193+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17426760766596586384', time=2024-09-14T13:02:47.522787+0000, chain.objs.size()=1 2024-09-14T11:10:03.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.193+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20__shadow_.ciFjJ1LByoreubHBVsJomzUTzOct3Aa_0 2024-09-14T11:10:03.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.193+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10752143258022007100', time=2024-09-14T13:03:57.999709+0000, chain.objs.size()=1 2024-09-14T11:10:03.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.193+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26__shadow_.8w9RzmRf19yKYHrL0gLWZk3VI0QM2BK_0 2024-09-14T11:10:03.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.193+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8971728788462122641', time=2024-09-14T13:03:59.430103+0000, chain.objs.size()=1 2024-09-14T11:10:03.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.193+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27__shadow_.kefsK99YKHm9PSHvHa9vKhH3GT5LTYF_0 2024-09-14T11:10:03.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.194+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10960736058755952556', time=2024-09-14T13:05:07.266167+0000, chain.objs.size()=1 2024-09-14T11:10:03.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.194+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30__shadow_.B7CBDjPV5yxz9y2D6ANlvXRVbW8CnHb_0 2024-09-14T11:10:03.195 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.196+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14633467947927678901', time=2024-09-14T13:05:40.543179+0000, chain.objs.size()=1 2024-09-14T11:10:03.195 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.196+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32__shadow_.ci9yvFcXdU2gfTDvZsWaNre7f9bSw9J_0 2024-09-14T11:10:03.195 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.196+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4461613631546555883', time=2024-09-14T13:05:42.321039+0000, chain.objs.size()=1 2024-09-14T11:10:03.195 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.196+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33__shadow_.77awwDl6-AeUQHX0sTwqU2mdZnPMP27_0 2024-09-14T11:10:03.195 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.196+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10594366878623034669', time=2024-09-14T13:06:15.816355+0000, chain.objs.size()=1 2024-09-14T11:10:03.195 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.196+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35__shadow_.84J80nrGCevmaJOujyhVIpy_UvpMQVT_0 2024-09-14T11:10:03.195 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.196+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17598766799680577318', time=2024-09-14T13:06:15.817476+0000, chain.objs.size()=1 2024-09-14T11:10:03.195 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.196+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35__shadow_.ad8tRD3fkdMpw-Dn80hRtKaHgrVXyJB_0 2024-09-14T11:10:03.196 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.196+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9381225354752629124', time=2024-09-14T13:06:15.823901+0000, chain.objs.size()=1 2024-09-14T11:10:03.196 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.196+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35__shadow_.cWXX2JU123lJUb2FNW7EU0J7YsVed1j_0 2024-09-14T11:10:03.196 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.196+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2290707749218877410', time=2024-09-14T13:06:48.713211+0000, chain.objs.size()=1 2024-09-14T11:10:03.196 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.196+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36__shadow_.ae8A4Mjzdg-710IyXnvQR-6jFRIVKxg_0 2024-09-14T11:10:03.196 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.196+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6215992104115217933', time=2024-09-14T13:06:50.489700+0000, chain.objs.size()=1 2024-09-14T11:10:03.196 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.196+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37__shadow_.cqQFDyrohCnJbJWv-Zjx_S3GwxojbHP_0 2024-09-14T11:10:03.196 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.198+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:03.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.200+0000 7fbe1a694800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:10:03.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.201+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.202+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.201 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.202+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-14T11:10:03.201 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.202+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='_jNg6hk7zDuCgBlfjX8K8rDjUjpTdhCE', time=2024-09-14T13:01:30.644956+0000, chain.objs.size()=1 2024-09-14T11:10:03.201 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.202+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15__shadow_.OpVHHB3IVd86vK4WmuXXy5mfSAwHhY9_0 2024-09-14T11:10:03.201 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.202+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13622323044004381075', time=2024-09-14T13:02:46.270131+0000, chain.objs.size()=1 2024-09-14T11:10:03.201 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.202+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19__shadow_.hINezI9OllIul3adRo-kEwCbVH2KrzR_0 2024-09-14T11:10:03.201 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.202+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17423414488440511052', time=2024-09-14T13:03:20.060547+0000, chain.objs.size()=1 2024-09-14T11:10:03.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.202+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21__shadow_.57pZGm7gjKU0hInqTOToXJnNAqw02ol_0 2024-09-14T11:10:03.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.202+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6698504635007378231', time=2024-09-14T13:03:20.061605+0000, chain.objs.size()=1 2024-09-14T11:10:03.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.202+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21__shadow_.Iet9NkhvDeYH_dsk6K6IEZTnQ5qiHpZ_0 2024-09-14T11:10:03.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.202+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15244210368006873885', time=2024-09-14T13:03:56.928069+0000, chain.objs.size()=1 2024-09-14T11:10:03.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.202+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25__shadow_.w0yeKlWvgwcVv50ZLKyw68QSu8IO6rF_0 2024-09-14T11:10:03.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.202+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17219047201940659965', time=2024-09-14T13:05:08.719820+0000, chain.objs.size()=1 2024-09-14T11:10:03.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.202+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31__shadow_.9_cV7ZOG-63dEChszm6k6m-4dM6lgJP_0 2024-09-14T11:10:03.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.202+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13841570230146465860', time=2024-09-14T13:05:08.721498+0000, chain.objs.size()=1 2024-09-14T11:10:03.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.202+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31__shadow_.2mpgC6sigrlGt0mYhsLFz06kYJ-32rU_0 2024-09-14T11:10:03.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.202+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9638480176449457668', time=2024-09-14T13:05:42.312597+0000, chain.objs.size()=1 2024-09-14T11:10:03.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.202+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33__shadow_.sPAKJ56n0Qoa1DUtNdNecV7OA3Gh8BJ_0 2024-09-14T11:10:03.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.202+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17900628478579645612', time=2024-09-14T13:06:48.709254+0000, chain.objs.size()=1 2024-09-14T11:10:03.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.202+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36__shadow_.o1IfvURO6y51j-HrQ6hipd2NwnLtdGg_0 2024-09-14T11:10:03.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.202+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6223966359565317976', time=2024-09-14T13:06:51.758462+0000, chain.objs.size()=1 2024-09-14T11:10:03.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.202+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38__shadow_.myCmbWOhKw0ByQjsYzxjZHymMO-ETgx_0 2024-09-14T11:10:03.207 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.209+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:03.210 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.211+0000 7fbe1a694800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:10:03.211 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.213+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.211 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.213+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.213 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.213+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-14T11:10:03.213 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.213+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7760621398495937674', time=2024-09-14T13:01:30.621595+0000, chain.objs.size()=4 2024-09-14T11:10:03.213 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.213+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9__multipart_foo.2~sMpxUD-Jmwpb3iVymRjC1dmSbqnAWnu.1 2024-09-14T11:10:03.213 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.213+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9__multipart_foo.2~sMpxUD-Jmwpb3iVymRjC1dmSbqnAWnu.2 2024-09-14T11:10:03.213 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.213+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9__multipart_foo.2~sMpxUD-Jmwpb3iVymRjC1dmSbqnAWnu.3 2024-09-14T11:10:03.213 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.213+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9__multipart_foo.2~sMpxUD-Jmwpb3iVymRjC1dmSbqnAWnu.4 2024-09-14T11:10:03.213 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.213+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2187130898943722286', time=2024-09-14T13:03:22.027272+0000, chain.objs.size()=1 2024-09-14T11:10:03.213 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.213+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22__shadow_._wquXYHyQv7bHz5rmOrlDCtL4JA7HZ6_0 2024-09-14T11:10:03.213 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.213+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4225479191188699346', time=2024-09-14T13:03:55.164552+0000, chain.objs.size()=1 2024-09-14T11:10:03.213 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.213+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24__shadow_.Ewlt6rdtwVjE94RgZ11rHlLzzHSNLhB_0 2024-09-14T11:10:03.213 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.213+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12874428113022949802', time=2024-09-14T13:03:56.921573+0000, chain.objs.size()=1 2024-09-14T11:10:03.213 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.213+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25__shadow_.iSrHM2Z3qPNJ4Jjf-J7ozGxMQfeTZ5g_0 2024-09-14T11:10:03.213 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.213+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5835530134796168945', time=2024-09-14T13:03:56.922261+0000, chain.objs.size()=1 2024-09-14T11:10:03.213 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.213+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25__shadow_.H5YrekGE5yX2AG-iT92WglvpfFx_W7B_0 2024-09-14T11:10:03.214 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.213+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17786615134734864317', time=2024-09-14T13:04:32.512595+0000, chain.objs.size()=1 2024-09-14T11:10:03.214 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.213+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28__shadow_.c1n-PiegDXBWdUFwY1iRbeAbIs1dibI_0 2024-09-14T11:10:03.214 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.213+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2929444179892424731', time=2024-09-14T13:04:32.516373+0000, chain.objs.size()=1 2024-09-14T11:10:03.214 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.213+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28__shadow_.mUiozi8GBvvo6ET_Qeuf_FSzIm7TPOq_0 2024-09-14T11:10:03.214 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.213+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17677270038112585583', time=2024-09-14T13:05:07.266168+0000, chain.objs.size()=1 2024-09-14T11:10:03.214 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.213+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30__shadow_.KJPFoIflE9dfprZd7RSo8DMU9fTviiq_0 2024-09-14T11:10:03.214 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.213+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16604907861349707003', time=2024-09-14T13:05:08.724743+0000, chain.objs.size()=1 2024-09-14T11:10:03.214 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.213+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31__shadow_.A_WXoXSLeKyLO9sMDr0-N0fnWFa5gLA_0 2024-09-14T11:10:03.215 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.215+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8725057355808423633', time=2024-09-14T13:05:42.314708+0000, chain.objs.size()=1 2024-09-14T11:10:03.215 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.215+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33__shadow_.AxEgx4-Wa11nErCAXKO4-U4QuBKR426_0 2024-09-14T11:10:03.215 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.216+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17583005254464833124', time=2024-09-14T13:06:14.459295+0000, chain.objs.size()=1 2024-09-14T11:10:03.215 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.216+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34__shadow_.RvTXGZmKEksj1QOe_Ru0rVP8MDO4f6R_0 2024-09-14T11:10:03.215 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.216+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10772773422990054632', time=2024-09-14T13:06:14.460840+0000, chain.objs.size()=1 2024-09-14T11:10:03.215 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.216+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34__shadow_.Ti6mtkLil-GU-PKEfYG8jMBV3mFs05T_0 2024-09-14T11:10:03.215 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.216+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8176119062460169297', time=2024-09-14T13:06:14.464740+0000, chain.objs.size()=1 2024-09-14T11:10:03.216 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.216+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34__shadow_.iXDCkj7Vzm42Ie7ovR1aduQB9f3r1jm_0 2024-09-14T11:10:03.216 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.216+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14298958356514764943', time=2024-09-14T13:06:15.813511+0000, chain.objs.size()=1 2024-09-14T11:10:03.216 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.216+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35__shadow_.Rr-bJvwLoKBpAn-WgufuNZTpBGkg_Am_0 2024-09-14T11:10:03.216 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.216+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5256255786186873295', time=2024-09-14T13:06:50.490960+0000, chain.objs.size()=1 2024-09-14T11:10:03.216 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.216+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37__shadow_.RkHnZIyR5LEnYk1ZcXHaO-tJRUSCfuK_0 2024-09-14T11:10:03.216 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.216+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11145285925456749362', time=2024-09-14T13:06:51.749735+0000, chain.objs.size()=1 2024-09-14T11:10:03.216 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.216+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38__shadow_.-O90Rv-c8pw-cu4vz3USuAi4X8ShzPX_0 2024-09-14T11:10:03.216 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.216+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10233705789054550956', time=2024-09-14T13:09:42.938543+0000, chain.objs.size()=1 2024-09-14T11:10:03.216 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.216+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18__shadow:G7B2tSq4QvCSKXG9yv4o1hP4hVN4UpS_.0w61weObJY2TnR-eNBpFLgGwJxD8aaD_0 2024-09-14T11:10:03.217 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.218+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:03.218 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.220+0000 7fbe1a694800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:10:03.219 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.221+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.220 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.221+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.221 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.222+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-14T11:10:03.221 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.222+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='_g6pf7ZCz_rRTVx5xrKQtYc0lmY7poL2', time=2024-09-14T13:01:30.704877+0000, chain.objs.size()=2 2024-09-14T11:10:03.221 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.222+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__shadow_.1Qv2hBKJMbs8asZFnHC7Vc0w6f72OR4_0 2024-09-14T11:10:03.221 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.222+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__shadow_.1Qv2hBKJMbs8asZFnHC7Vc0w6f72OR4_1 2024-09-14T11:10:03.221 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.222+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14510598353016679615', time=2024-09-14T13:01:30.734170+0000, chain.objs.size()=3 2024-09-14T11:10:03.221 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.222+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__multipart_foo-LUKEWARM.2~5lyvpszBcbiA6-AintwdqOM4swCDj8X.1 2024-09-14T11:10:03.221 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.222+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__multipart_foo-LUKEWARM.2~5lyvpszBcbiA6-AintwdqOM4swCDj8X.2 2024-09-14T11:10:03.221 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.222+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__multipart_foo-LUKEWARM.2~5lyvpszBcbiA6-AintwdqOM4swCDj8X.3 2024-09-14T11:10:03.221 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.222+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7972525894038663350', time=2024-09-14T13:02:46.269671+0000, chain.objs.size()=1 2024-09-14T11:10:03.221 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.222+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19__shadow_.XCVnSW5WLNJfcpv6oO3mo6pSdkdfpZ7_0 2024-09-14T11:10:03.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.222+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5145782221026484897', time=2024-09-14T13:03:22.876196+0000, chain.objs.size()=1 2024-09-14T11:10:03.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.222+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23__shadow_.WQu0fUsBCkwl3il4Isfno2iFXRwXjGT_0 2024-09-14T11:10:03.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.222+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9762805183957549956', time=2024-09-14T13:03:55.171721+0000, chain.objs.size()=1 2024-09-14T11:10:03.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.222+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24__shadow_.n7a4B5ofsQ0cv2cKae8GQFevnKTukNu_0 2024-09-14T11:10:03.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.222+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17782586335837265654', time=2024-09-14T13:03:56.921075+0000, chain.objs.size()=1 2024-09-14T11:10:03.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.222+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25__shadow_.cNvZ8_ng2RnTqN-RRwbDLSfP6D13GNF_0 2024-09-14T11:10:03.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.222+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17210315978350832440', time=2024-09-14T13:03:56.924100+0000, chain.objs.size()=1 2024-09-14T11:10:03.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.222+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25__shadow_.RiXIKBvJcPRUrvV6-U-m7maLASBSr91_0 2024-09-14T11:10:03.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.222+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14316538684289286069', time=2024-09-14T13:03:56.928861+0000, chain.objs.size()=1 2024-09-14T11:10:03.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.222+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25__shadow_.CITp-eKwEHex6s3QOuoAXk6t9DBsqAw_0 2024-09-14T11:10:03.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.222+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14595870334634426431', time=2024-09-14T13:03:57.997739+0000, chain.objs.size()=1 2024-09-14T11:10:03.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.222+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26__shadow_.2V7AVqbsnrYmhIKjaqmvg6LP1J1G_Zd_0 2024-09-14T11:10:03.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.226+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2694300798108692200', time=2024-09-14T13:04:30.322430+0000, chain.objs.size()=1 2024-09-14T11:10:03.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.226+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27__shadow_.4aS3HN0CnepTPsgadf_Me-9BSD4y9W4_0 2024-09-14T11:10:03.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.226+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7411597388395419248', time=2024-09-14T13:04:30.324042+0000, chain.objs.size()=1 2024-09-14T11:10:03.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.226+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27__shadow_.1xOO3Fa271Lct9FqgUpJcbtJ0hlbZVI_0 2024-09-14T11:10:03.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.226+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6467415923059201654', time=2024-09-14T13:04:30.325136+0000, chain.objs.size()=1 2024-09-14T11:10:03.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.226+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27__shadow_.NRWfsU--yJcqu-smv266YGcEucrwlaa_0 2024-09-14T11:10:03.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.226+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14347324217837658448', time=2024-09-14T13:05:05.065731+0000, chain.objs.size()=1 2024-09-14T11:10:03.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.226+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29__shadow_.qeY8bUQxQndc19MSjA_vEJe8wPxwRIn_0 2024-09-14T11:10:03.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.226+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8996552712575082837', time=2024-09-14T13:06:14.456288+0000, chain.objs.size()=1 2024-09-14T11:10:03.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.226+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34__shadow_.tlcHorgqSynKQemLhcaoaoJnB84e7Yv_0 2024-09-14T11:10:03.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.226+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10951987698112510091', time=2024-09-14T13:06:48.714110+0000, chain.objs.size()=1 2024-09-14T11:10:03.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.226+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36__shadow_.U61nWaRMb_QcrgJSVJaKJZprLSiaukb_0 2024-09-14T11:10:03.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.226+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.503309313977871547', time=2024-09-14T13:06:50.491131+0000, chain.objs.size()=1 2024-09-14T11:10:03.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.226+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37__shadow_.9dzY5qg1tDJ9kohh9hDDFiiXEVqjnzD_0 2024-09-14T11:10:03.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.226+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13228348933114201291', time=2024-09-14T13:06:51.753280+0000, chain.objs.size()=1 2024-09-14T11:10:03.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.226+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38__shadow_.Wrm8RT-yB0HLQg8pDf1XuybZsTzV4eT_0 2024-09-14T11:10:03.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.226+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4549517793732193788', time=2024-09-14T13:07:23.896142+0000, chain.objs.size()=1 2024-09-14T11:10:03.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.226+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39__shadow_.aW-eZFNYWAxK3tSXg3297SwoWNsTctk_0 2024-09-14T11:10:03.227 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.226+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4167891239212399776', time=2024-09-14T13:09:30.927486+0000, chain.objs.size()=1 2024-09-14T11:10:03.227 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.226+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17__shadow_.xqAknxAfw5GJX8ikE2ngBsbRWJjX0Pe_0 2024-09-14T11:10:03.227 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.228+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:03.229 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.230+0000 7fbe1a694800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:10:03.230 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.232+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.232+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.233+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-14T11:10:03.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.233+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='_Yo9kslKdJ5MS9YXMUmxbkWimrzLN9yV', time=2024-09-14T13:01:30.701151+0000, chain.objs.size()=1 2024-09-14T11:10:03.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.233+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__shadow_.OTBZgbyGDPzJ_z7zBBET90Tpf_6SZFe_0 2024-09-14T11:10:03.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.233+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11859456998952321587', time=2024-09-14T13:02:47.522756+0000, chain.objs.size()=1 2024-09-14T11:10:03.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.233+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20__shadow_.fW0vfVxIbnX-tgHa9IYOUdKJAIB_lSc_0 2024-09-14T11:10:03.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.233+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16912904072863198011', time=2024-09-14T13:03:20.062936+0000, chain.objs.size()=1 2024-09-14T11:10:03.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.233+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21__shadow_.l-Nl3eN2w9zOTsDkm4jbRBD4oTqzmJl_0 2024-09-14T11:10:03.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.233+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15912934295290402931', time=2024-09-14T13:03:22.869674+0000, chain.objs.size()=1 2024-09-14T11:10:03.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.233+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23__shadow_.qXThvFpniXZIslKFPEkm51wLJ3zsgxU_0 2024-09-14T11:10:03.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.233+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17512141508374775385', time=2024-09-14T13:04:30.322956+0000, chain.objs.size()=1 2024-09-14T11:10:03.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.233+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27__shadow_.t9zADIHwnl-ZpsdmOwFMWsVPzi0KzlD_0 2024-09-14T11:10:03.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.233+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13881133134921900281', time=2024-09-14T13:04:32.514166+0000, chain.objs.size()=1 2024-09-14T11:10:03.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.233+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28__shadow_.yD5su3HJESbcvgwW2qXTTvM6EY2N0mC_0 2024-09-14T11:10:03.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.233+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9052054702871229127', time=2024-09-14T13:05:40.545921+0000, chain.objs.size()=1 2024-09-14T11:10:03.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.233+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32__shadow_.TiSfe_ac9fPrmqmoAxuVAPIJJgd8-Nr_0 2024-09-14T11:10:03.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.233+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3623760241593496104', time=2024-09-14T13:06:14.455648+0000, chain.objs.size()=1 2024-09-14T11:10:03.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.233+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34__shadow_.aw5w2qzqRweG8rD6D2gUv6z9ACODipU_0 2024-09-14T11:10:03.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.233+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12897443674249314216', time=2024-09-14T13:06:16.024146+0000, chain.objs.size()=1 2024-09-14T11:10:03.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.233+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35__shadow_.gMd-bSUzHklyfjW65vNN1JthMen4bso_0 2024-09-14T11:10:03.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.233+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9238499667854417933', time=2024-09-14T13:06:49.965433+0000, chain.objs.size()=1 2024-09-14T11:10:03.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.233+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37__shadow_._oMItZlqtXqL_v0LJqWcP_DZ8qS84sd_0 2024-09-14T11:10:03.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.233+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7186602960608158453', time=2024-09-14T13:06:50.489429+0000, chain.objs.size()=1 2024-09-14T11:10:03.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.233+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37__shadow_.Ke_hUnSJKIHOHqgw5zZ5UcLdk2l-7_k_0 2024-09-14T11:10:03.234 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.235+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:03.235 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.237+0000 7fbe1a694800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:10:03.236 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.238+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.238+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.239+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-14T11:10:03.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.239+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6237930328789275419', time=2024-09-14T13:02:47.528636+0000, chain.objs.size()=1 2024-09-14T11:10:03.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.239+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20__shadow_.AnqXj_tLyQmhCfw9BgX1CMQxXq5Aw2C_0 2024-09-14T11:10:03.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.239+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17254776021684586039', time=2024-09-14T13:02:48.741101+0000, chain.objs.size()=1 2024-09-14T11:10:03.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.239+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21__shadow_.wYGk2R0KPRO_cIUsw9suMmXZgDo1mwR_0 2024-09-14T11:10:03.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.239+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14640151733847996319', time=2024-09-14T13:03:22.879183+0000, chain.objs.size()=1 2024-09-14T11:10:03.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.239+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23__shadow_.5NqGbpCtrW10GdI0zMvylSt3wmIWyMw_0 2024-09-14T11:10:03.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.239+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12058556507643136161', time=2024-09-14T13:04:32.512557+0000, chain.objs.size()=1 2024-09-14T11:10:03.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.239+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28__shadow_.RbKT0YOr3FhND5S7JqTsSC0eYP9Mnp2_0 2024-09-14T11:10:03.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.239+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33002666703712158', time=2024-09-14T13:05:07.263785+0000, chain.objs.size()=1 2024-09-14T11:10:03.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.239+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30__shadow_.cW11C2EWPzOXah_v8xdSJDHhl9iRYCa_0 2024-09-14T11:10:03.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.239+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5432930822413526246', time=2024-09-14T13:05:07.267128+0000, chain.objs.size()=1 2024-09-14T11:10:03.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.239+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30__shadow_.8SJecdpSp7Rp9-S9hTyJ6kq5iuLLQgK_0 2024-09-14T11:10:03.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.239+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3193341770250901587', time=2024-09-14T13:05:40.545587+0000, chain.objs.size()=1 2024-09-14T11:10:03.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.239+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32__shadow_.v1N_GmR_rfaKaQMd1VNmdJ5xdmJJ2px_0 2024-09-14T11:10:03.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.239+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9791132486622241505', time=2024-09-14T13:06:14.461018+0000, chain.objs.size()=1 2024-09-14T11:10:03.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.239+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34__shadow_.y4QajN7F-I9NU0O8BbWbWCy36eri2Kb_0 2024-09-14T11:10:03.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.239+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4125788444848542394', time=2024-09-14T13:06:50.493440+0000, chain.objs.size()=1 2024-09-14T11:10:03.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.239+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37__shadow_._NcCg3d2Liy-hs034DVLS488-dLi8eF_0 2024-09-14T11:10:03.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.239+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3277392002353361778', time=2024-09-14T13:06:51.751936+0000, chain.objs.size()=1 2024-09-14T11:10:03.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.239+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38__shadow_.dPhoYYdCfPAQy3Y8eBm-wOySNDi8_fZ_0 2024-09-14T11:10:03.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.239+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18416129741045061745', time=2024-09-14T13:07:23.888737+0000, chain.objs.size()=1 2024-09-14T11:10:03.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.239+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39__shadow_.g_H_IkyzF2baPowvVUt8Fx0C_qERM8Y_0 2024-09-14T11:10:03.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.241+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:03.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.243+0000 7fbe1a694800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:10:03.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.244+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.244+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.245+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-14T11:10:03.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.245+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12721765043872896435', time=2024-09-14T13:02:46.268778+0000, chain.objs.size()=1 2024-09-14T11:10:03.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.245+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19__shadow_.KGE82_tGg763yb3ntio4MPQQQmwF24o_0 2024-09-14T11:10:03.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.245+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13428070924876374675', time=2024-09-14T13:02:47.522634+0000, chain.objs.size()=1 2024-09-14T11:10:03.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.245+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20__shadow_.L6bqspAQD0QDo49MFH064gaG2IG2Hbb_0 2024-09-14T11:10:03.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.245+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6274417701528263289', time=2024-09-14T13:03:20.061983+0000, chain.objs.size()=1 2024-09-14T11:10:03.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.245+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21__shadow_.IRLWOr7SnrxRl_f2-2On2suVjQO1qYe_0 2024-09-14T11:10:03.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.245+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7176646540764800432', time=2024-09-14T13:03:22.022229+0000, chain.objs.size()=1 2024-09-14T11:10:03.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.245+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22__shadow_.ika8nC1NyMhJEII__Cph0J2Rdfr73Hw_0 2024-09-14T11:10:03.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.245+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15784769741657150317', time=2024-09-14T13:03:22.868838+0000, chain.objs.size()=1 2024-09-14T11:10:03.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.245+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23__shadow_.1Ulrh_Pr2kXy2Nnfux3Q0paNXRuw3lQ_0 2024-09-14T11:10:03.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.245+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2514221097483614141', time=2024-09-14T13:03:22.869556+0000, chain.objs.size()=1 2024-09-14T11:10:03.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.245+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23__shadow_.O37wPlMdVP0DDte49J00IBSGTIIDTrR_0 2024-09-14T11:10:03.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.245+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7776623519597446452', time=2024-09-14T13:03:56.928393+0000, chain.objs.size()=1 2024-09-14T11:10:03.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.245+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25__shadow_.W2PLfuUQtTNoKzkmKYNY2Pkh46ts-W9_0 2024-09-14T11:10:03.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.245+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6767311487983414498', time=2024-09-14T13:03:57.999827+0000, chain.objs.size()=1 2024-09-14T11:10:03.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.245+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26__shadow_.VnQDV88ZGFEf5x8WXC2f4QenxixUbiK_0 2024-09-14T11:10:03.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.245+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6268830884609427737', time=2024-09-14T13:04:30.323723+0000, chain.objs.size()=1 2024-09-14T11:10:03.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.245+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27__shadow_.9lDoyivf-B4hG8_MGSNcthLXcDz3982_0 2024-09-14T11:10:03.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.245+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14310639736769591973', time=2024-09-14T13:05:05.063973+0000, chain.objs.size()=1 2024-09-14T11:10:03.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.245+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29__shadow_.H2gaOBiBg34nH3LhDPpdTfyhMVSoS_I_0 2024-09-14T11:10:03.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.245+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17188314711653476686', time=2024-09-14T13:05:05.064627+0000, chain.objs.size()=1 2024-09-14T11:10:03.246 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.245+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29__shadow_.7-rDYkw7BaZ-1bZmgqJaliPzmOga4Jt_0 2024-09-14T11:10:03.246 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.245+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8924837935677972569', time=2024-09-14T13:05:05.073069+0000, chain.objs.size()=1 2024-09-14T11:10:03.246 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.245+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29__shadow_.uZxYmvfdefSDaxJumpivVU_1QoiaBid_0 2024-09-14T11:10:03.246 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.247+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.753643190541855618', time=2024-09-14T13:05:40.546617+0000, chain.objs.size()=1 2024-09-14T11:10:03.246 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.247+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32__shadow_.5z6zg13nSxmfQrGyfiwuR2TRitr5qvx_0 2024-09-14T11:10:03.246 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.247+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12836598863888318587', time=2024-09-14T13:05:40.555796+0000, chain.objs.size()=1 2024-09-14T11:10:03.246 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.247+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32__shadow_.Xb0fIKzKfiTYGmA2qaew5HBAopp4ymJ_0 2024-09-14T11:10:03.246 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.247+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12878200897654010458', time=2024-09-14T13:06:14.459643+0000, chain.objs.size()=1 2024-09-14T11:10:03.246 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.247+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34__shadow_.-OIVOTuycwQ8CyPipSWYFxes3OzWDun_0 2024-09-14T11:10:03.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.247+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15092467513538500507', time=2024-09-14T13:06:15.817782+0000, chain.objs.size()=1 2024-09-14T11:10:03.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.247+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35__shadow_.LjKE63iYCp-hP7fgvGdl4k3B5y6OrtL_0 2024-09-14T11:10:03.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.247+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13233268313334712190', time=2024-09-14T13:09:30.927425+0000, chain.objs.size()=1 2024-09-14T11:10:03.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.247+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17__shadow_.pbwlBWl571pjAhECG2Ju__gogL6DWRb_0 2024-09-14T11:10:03.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.249+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:03.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.251+0000 7fbe1a694800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:10:03.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.252+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.253+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.254+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-14T11:10:03.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.254+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6349251770078567695', time=2024-09-14T13:01:30.760818+0000, chain.objs.size()=3 2024-09-14T11:10:03.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.254+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14__multipart_foo-FROZEN.2~yUMH8vp5t8sQKs9Ji3zU52cw7ZUMWdY.1 2024-09-14T11:10:03.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.254+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14__multipart_foo-FROZEN.2~yUMH8vp5t8sQKs9Ji3zU52cw7ZUMWdY.2 2024-09-14T11:10:03.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.254+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14__multipart_foo-FROZEN.2~yUMH8vp5t8sQKs9Ji3zU52cw7ZUMWdY.3 2024-09-14T11:10:03.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.254+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3168036595581408191', time=2024-09-14T13:03:22.024949+0000, chain.objs.size()=1 2024-09-14T11:10:03.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.254+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22__shadow_.4ACWcN5v_CaYAhrr5qu42eKqnfKPRo0_0 2024-09-14T11:10:03.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.254+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7110945359994085377', time=2024-09-14T13:03:22.870135+0000, chain.objs.size()=1 2024-09-14T11:10:03.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.254+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23__shadow_.aA6jQ-m6OYfCS31N3fcftm4aMxggOWw_0 2024-09-14T11:10:03.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.254+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17155253813327497786', time=2024-09-14T13:03:55.163127+0000, chain.objs.size()=1 2024-09-14T11:10:03.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.254+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24__shadow_.GylnM5oFaH9fEF9f0rzxePOD3lzFY_L_0 2024-09-14T11:10:03.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.254+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13826133223789180837', time=2024-09-14T13:03:55.164973+0000, chain.objs.size()=1 2024-09-14T11:10:03.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.254+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24__shadow_.E7j8nNeqw1oiLPmiuLHbOuxDx_wZWKQ_0 2024-09-14T11:10:03.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.254+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.548222419777212268', time=2024-09-14T13:03:55.165682+0000, chain.objs.size()=1 2024-09-14T11:10:03.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.254+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24__shadow_.l8e-VatYvHVTDXHSaYBnK4YCTiyis8e_0 2024-09-14T11:10:03.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.254+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14009525665055759728', time=2024-09-14T13:03:58.000420+0000, chain.objs.size()=1 2024-09-14T11:10:03.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.254+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26__shadow_.18w4BQdJRqjd-4-KeSqNcbWe36T-2gr_0 2024-09-14T11:10:03.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.254+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7222576881021303582', time=2024-09-14T13:03:58.001647+0000, chain.objs.size()=1 2024-09-14T11:10:03.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.254+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26__shadow_.P5Q-LeA2abctoEJ1dUwbhnag1k6M_q6_0 2024-09-14T11:10:03.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.254+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10567191469431410914', time=2024-09-14T13:04:30.324056+0000, chain.objs.size()=1 2024-09-14T11:10:03.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.254+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27__shadow_.c1vLu6M3xrssa2T3g03s7TOXiPXnWZl_0 2024-09-14T11:10:03.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.254+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9073611011769707381', time=2024-09-14T13:04:30.329626+0000, chain.objs.size()=1 2024-09-14T11:10:03.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.254+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27__shadow_.bsppWADwAr6wBB-Ndk5GTLEg0ygsrxT_0 2024-09-14T11:10:03.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.256+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4517864768785779829', time=2024-09-14T13:04:32.514201+0000, chain.objs.size()=1 2024-09-14T11:10:03.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.256+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28__shadow_.D0prbo1i1qa8Qj7xKUichqZtI91DeYB_0 2024-09-14T11:10:03.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.256+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3084985917564880880', time=2024-09-14T13:04:32.517087+0000, chain.objs.size()=1 2024-09-14T11:10:03.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.256+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28__shadow_.7CmZ6pfEndl2jwEbRLYPkAdqaC0iD1r_0 2024-09-14T11:10:03.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.256+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15640096765773054674', time=2024-09-14T13:05:05.066649+0000, chain.objs.size()=1 2024-09-14T11:10:03.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.256+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29__shadow_.RoSLCQEbYh17W2paG6HnA2ULGRWpaNe_0 2024-09-14T11:10:03.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.256+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12430004249320159925', time=2024-09-14T13:05:07.265982+0000, chain.objs.size()=1 2024-09-14T11:10:03.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.256+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30__shadow_.4XUxfUfVca9jBeK5c8_71NylYB2UDki_0 2024-09-14T11:10:03.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.256+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7565252392299764639', time=2024-09-14T13:05:40.544255+0000, chain.objs.size()=1 2024-09-14T11:10:03.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.256+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32__shadow_.0YqbK_0_6KjOCqjgfNPwEC9XHUD-vxV_0 2024-09-14T11:10:03.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.256+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1922832997320768994', time=2024-09-14T13:05:42.315467+0000, chain.objs.size()=1 2024-09-14T11:10:03.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.256+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33__shadow_.eVLAUje6rD3By9n7fj-LKS7H-O5rtE__0 2024-09-14T11:10:03.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.256+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1866618938824366546', time=2024-09-14T13:06:14.460945+0000, chain.objs.size()=1 2024-09-14T11:10:03.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.256+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34__shadow_._bA0xFNQaZMcHlOp_pLw6PMg28JeKA2_0 2024-09-14T11:10:03.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.256+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8439752750782977889', time=2024-09-14T13:06:15.817686+0000, chain.objs.size()=1 2024-09-14T11:10:03.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.256+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35__shadow_.ZomwNGVnToh3FNQ1064WLxwX4nLhCa4_0 2024-09-14T11:10:03.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.256+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7938381248871491705', time=2024-09-14T13:06:15.821151+0000, chain.objs.size()=1 2024-09-14T11:10:03.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.256+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.35__shadow_.0SjzO34NR8eRkEXqswXAKVRDIcoHAXD_0 2024-09-14T11:10:03.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.256+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13391213761149365211', time=2024-09-14T13:06:50.489973+0000, chain.objs.size()=1 2024-09-14T11:10:03.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.256+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.37__shadow_.N-mCZ846KiqGSe2zmxF6RnIS3bi4DzJ_0 2024-09-14T11:10:03.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.256+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11692408165719319335', time=2024-09-14T13:07:23.888772+0000, chain.objs.size()=1 2024-09-14T11:10:03.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.256+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39__shadow_.ZT5w2G1PzZ9Y59DqFUN6-B5JSF-_YSH_0 2024-09-14T11:10:03.258 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.258+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:03.260 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.261+0000 7fbe1a694800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:10:03.261 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.263+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.262 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.263+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.263 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.264+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-14T11:10:03.263 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.264+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13039448559062943704', time=2024-09-14T13:01:30.719549+0000, chain.objs.size()=3 2024-09-14T11:10:03.263 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.264+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__multipart_foo-STANDARD.2~Q_rKueWQEzTMXM5eiryaCuie6AsQ8M2.1 2024-09-14T11:10:03.263 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.264+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__multipart_foo-STANDARD.2~Q_rKueWQEzTMXM5eiryaCuie6AsQ8M2.2 2024-09-14T11:10:03.263 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.264+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16__multipart_foo-STANDARD.2~Q_rKueWQEzTMXM5eiryaCuie6AsQ8M2.3 2024-09-14T11:10:03.263 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.264+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1038374322751314530', time=2024-09-14T13:02:47.529412+0000, chain.objs.size()=1 2024-09-14T11:10:03.263 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.264+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.20__shadow_.g15XJ59TKnaNvBvpRNiEs9oKtodHc6K_0 2024-09-14T11:10:03.263 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.264+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14254125889357434372', time=2024-09-14T13:03:22.021086+0000, chain.objs.size()=1 2024-09-14T11:10:03.263 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.264+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22__shadow_.0_S9_hf6m8nS9aSEsrb1XeuWV5JDX0y_0 2024-09-14T11:10:03.263 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.264+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2391685971473202311', time=2024-09-14T13:03:22.022180+0000, chain.objs.size()=1 2024-09-14T11:10:03.263 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.264+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22__shadow_.4Ar3yOZNN2iT_9l9PutyVfU5E8YYHn0_0 2024-09-14T11:10:03.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.264+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18391184259816459937', time=2024-09-14T13:03:22.031006+0000, chain.objs.size()=1 2024-09-14T11:10:03.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.264+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22__shadow_.LGnCvGre0UWbebM_wc9V85ASM0iNq1V_0 2024-09-14T11:10:03.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.264+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17773960938922278322', time=2024-09-14T13:03:22.879792+0000, chain.objs.size()=1 2024-09-14T11:10:03.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.264+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23__shadow_.apiZ5fmJHXwQo4bhPqNUnEoHMwd7-pS_0 2024-09-14T11:10:03.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.264+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4702391227731638936', time=2024-09-14T13:03:56.920160+0000, chain.objs.size()=1 2024-09-14T11:10:03.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.264+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.25__shadow_.tGWFUyWE_PPssavNCzR_1YK_3fc4k5B_0 2024-09-14T11:10:03.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.264+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13451801431953619073', time=2024-09-14T13:03:58.002752+0000, chain.objs.size()=1 2024-09-14T11:10:03.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.264+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26__shadow_.6hh3Ptm4VItoGARjDuMpIDpAv7MkNIn_0 2024-09-14T11:10:03.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.264+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6157103546406997578', time=2024-09-14T13:03:58.008478+0000, chain.objs.size()=1 2024-09-14T11:10:03.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.264+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26__shadow_.5zZkMO0EH6vsQ6uKZxAriknGptJZ6U3_0 2024-09-14T11:10:03.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.264+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4170686601897229782', time=2024-09-14T13:05:08.724303+0000, chain.objs.size()=1 2024-09-14T11:10:03.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.264+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31__shadow_.Qp5eQNB2BzWvuQspfrv8UZqpdsMRlzK_0 2024-09-14T11:10:03.265 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.265+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12142034486709833212', time=2024-09-14T13:06:14.455939+0000, chain.objs.size()=1 2024-09-14T11:10:03.265 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.265+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34__shadow_.5keEx-dHGcB9VquvZgzbuKK1borDxPl_0 2024-09-14T11:10:03.265 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.266+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10041232801036940490', time=2024-09-14T13:06:48.708674+0000, chain.objs.size()=1 2024-09-14T11:10:03.265 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.266+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36__shadow_.Co4CHK134BqIxOFMkW5NufMqC7B0Q--_0 2024-09-14T11:10:03.265 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.266+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7839453941089927124', time=2024-09-14T13:06:48.717186+0000, chain.objs.size()=1 2024-09-14T11:10:03.265 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.266+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36__shadow_.2cSFYdGLBLK_wKuQxUY3NKjIENu-63I_0 2024-09-14T11:10:03.265 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.266+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3931053711501198333', time=2024-09-14T13:06:51.749088+0000, chain.objs.size()=1 2024-09-14T11:10:03.265 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.266+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38__shadow_.9k-MImRAzj1SY5nN1h-Y3QXy0GJC61n_0 2024-09-14T11:10:03.265 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.266+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14796646446321526166', time=2024-09-14T13:06:51.756973+0000, chain.objs.size()=1 2024-09-14T11:10:03.266 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.266+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.38__shadow_.Xciu5pqOSAjCCN1qxN3DWj0CJp6SN7D_0 2024-09-14T11:10:03.266 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.268+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:03.268 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.270+0000 7fbe1a694800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:10:03.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.271+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.271+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.272+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-14T11:10:03.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.272+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1233803733840229549', time=2024-09-14T13:01:30.526464+0000, chain.objs.size()=1 2024-09-14T11:10:03.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.272+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4__shadow_.CZ_34ec1GPNYR-Ws0nzYDr0FNPJc2Ap_0 2024-09-14T11:10:03.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.272+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16258313840354428810', time=2024-09-14T13:03:22.024669+0000, chain.objs.size()=1 2024-09-14T11:10:03.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.272+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22__shadow_.-YrXnhjspbDf5uVk-diya6YBljps8EG_0 2024-09-14T11:10:03.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.272+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6048162817677550997', time=2024-09-14T13:03:22.869052+0000, chain.objs.size()=1 2024-09-14T11:10:03.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.272+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23__shadow_.zDBdTzPdK6aMdwy9xZtnM9Y_y27J7_s_0 2024-09-14T11:10:03.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.272+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13170493095488893142', time=2024-09-14T13:03:22.872237+0000, chain.objs.size()=1 2024-09-14T11:10:03.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.272+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23__shadow_.KlTTjOTTDa0WQJLCYnjGsu9w0fncglj_0 2024-09-14T11:10:03.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.272+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7772760297279791801', time=2024-09-14T13:04:30.323668+0000, chain.objs.size()=1 2024-09-14T11:10:03.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.272+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27__shadow_.grac9K43Ffsk8PzVUVzzGu7YbaHdkcF_0 2024-09-14T11:10:03.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.272+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.207384870384073886', time=2024-09-14T13:04:32.514007+0000, chain.objs.size()=1 2024-09-14T11:10:03.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.272+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28__shadow_.ZJG84uuCfM1CnZrfaTQ8euksAT2kXR4_0 2024-09-14T11:10:03.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.272+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13455467535204676048', time=2024-09-14T13:05:05.073321+0000, chain.objs.size()=1 2024-09-14T11:10:03.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.272+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29__shadow_.LjMMM_9Hheo58QN3Tk0fgmXhGhCuTUX_0 2024-09-14T11:10:03.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.272+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1686678595946201822', time=2024-09-14T13:05:07.263095+0000, chain.objs.size()=1 2024-09-14T11:10:03.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.272+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30__shadow_.2EkMx317Qd0xNFVnoNdotuJ_XKUhCV1_0 2024-09-14T11:10:03.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.272+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12672941260290873863', time=2024-09-14T13:05:08.719843+0000, chain.objs.size()=1 2024-09-14T11:10:03.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.272+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31__shadow_.cOgBmUP05MjLe4JzosHGCg2FQz1Grat_0 2024-09-14T11:10:03.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.272+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.984936396073185473', time=2024-09-14T13:06:14.464541+0000, chain.objs.size()=1 2024-09-14T11:10:03.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.272+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34__shadow_.MfgYRsuBrDnLqqdNCs0SuJAiyYnJeqe_0 2024-09-14T11:10:03.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.272+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17374094851298858074', time=2024-09-14T13:07:23.891308+0000, chain.objs.size()=1 2024-09-14T11:10:03.273 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.272+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39__shadow_.j3AO6cgjcoMq3wvzRhntmcfYtvGXro5_0 2024-09-14T11:10:03.273 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.272+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8099420538311453555', time=2024-09-14T13:07:23.892833+0000, chain.objs.size()=1 2024-09-14T11:10:03.273 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.272+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39__shadow_.ntceymZbkhW5TjtGafdYG_aSTITvmkj_0 2024-09-14T11:10:03.273 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.274+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:03.275 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.277+0000 7fbe1a694800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:10:03.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.278+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.279+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.279+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-14T11:10:03.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.279+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14997540245328451207', time=2024-09-14T13:02:45.536736+0000, chain.objs.size()=1 2024-09-14T11:10:03.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.279+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.19__shadow_.K9VbPVZ59ot-5AtDSeACLYAaxnEfSeX_0 2024-09-14T11:10:03.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.279+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18140605140848226913', time=2024-09-14T13:03:20.063023+0000, chain.objs.size()=1 2024-09-14T11:10:03.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.279+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21__shadow_.UHxR5VNuuIYqAsxtqKR5v67HGP2cgE4_0 2024-09-14T11:10:03.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.279+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14876242839794194963', time=2024-09-14T13:03:22.027424+0000, chain.objs.size()=1 2024-09-14T11:10:03.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.279+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.22__shadow_.vTj6z_h_j-h-pFQc46i4liE1FwzbRfd_0 2024-09-14T11:10:03.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.279+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14619618401822875010', time=2024-09-14T13:03:22.871824+0000, chain.objs.size()=1 2024-09-14T11:10:03.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.279+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23__shadow_.CxYijCQqtcZlnM3_jjLhAxm8Ce6hPjC_0 2024-09-14T11:10:03.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.279+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10541669064353577497', time=2024-09-14T13:03:22.873831+0000, chain.objs.size()=1 2024-09-14T11:10:03.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.279+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.23__shadow_.kRrsoQCfaCBV4qurSNo-ekGpDKe9rBw_0 2024-09-14T11:10:03.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.279+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6058891867381423423', time=2024-09-14T13:03:55.161389+0000, chain.objs.size()=1 2024-09-14T11:10:03.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.279+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24__shadow_.nmameDgbzyTwmNgPJPLHUoCMrpcp4et_0 2024-09-14T11:10:03.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.279+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16046546604450657082', time=2024-09-14T13:03:55.165032+0000, chain.objs.size()=1 2024-09-14T11:10:03.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.279+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.24__shadow_.Yms1Lob3_LapIA883n7hvPwI4OhXZ-b_0 2024-09-14T11:10:03.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.279+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16408975520687168943', time=2024-09-14T13:03:57.999581+0000, chain.objs.size()=1 2024-09-14T11:10:03.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.279+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26__shadow_.LhQP-h71BV-2lSdDgWyw0trJ9mfoXTU_0 2024-09-14T11:10:03.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.279+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5660633858162316753', time=2024-09-14T13:04:30.322493+0000, chain.objs.size()=1 2024-09-14T11:10:03.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.279+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.27__shadow_.3yi2p-o9kNHk1u8HGkLxIBX-9BDEQs-_0 2024-09-14T11:10:03.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.279+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15210149595617411414', time=2024-09-14T13:04:32.511893+0000, chain.objs.size()=1 2024-09-14T11:10:03.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.279+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28__shadow_.zDXGTh_lidIUywipYfd2SM9XnaQrpYp_0 2024-09-14T11:10:03.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.279+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7640273684234562491', time=2024-09-14T13:04:32.513437+0000, chain.objs.size()=1 2024-09-14T11:10:03.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.279+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.28__shadow_.4CVoKKDmPDo1u_szKH87gOZ-xujM0zI_0 2024-09-14T11:10:03.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.279+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13931526797170178467', time=2024-09-14T13:05:07.265079+0000, chain.objs.size()=1 2024-09-14T11:10:03.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.279+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30__shadow_.G5jhmrUOV5yitmPeAxnuuEmbmgiwxZN_0 2024-09-14T11:10:03.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.281+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.468505018949017827', time=2024-09-14T13:05:07.268041+0000, chain.objs.size()=1 2024-09-14T11:10:03.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.281+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30__shadow_.bXvAZEI5TeGWPUNdYYt7pq6QVF6-tg9_0 2024-09-14T11:10:03.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.281+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4027499913224239922', time=2024-09-14T13:05:08.730913+0000, chain.objs.size()=1 2024-09-14T11:10:03.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.281+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31__shadow_.Ll4uV0KcpXKUBmC6W5zm-NgvxpDgQ0M_0 2024-09-14T11:10:03.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.281+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15650218459398776028', time=2024-09-14T13:05:42.314754+0000, chain.objs.size()=1 2024-09-14T11:10:03.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.281+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33__shadow_.1PNfD0Sk0de6LSbUmP70UsJkY1MqvZ9_0 2024-09-14T11:10:03.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.281+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13095350274355942761', time=2024-09-14T13:05:42.318845+0000, chain.objs.size()=1 2024-09-14T11:10:03.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.281+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33__shadow_.pSh1LbMMBNhVSq9ed9aBb4LuXzqaGHT_0 2024-09-14T11:10:03.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.281+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12605876371634910265', time=2024-09-14T13:06:14.457873+0000, chain.objs.size()=1 2024-09-14T11:10:03.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.281+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34__shadow_.UNX3IwkbkGwoKLLvgSPW-q_If2Q-QlA_0 2024-09-14T11:10:03.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.281+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10931816688068851648', time=2024-09-14T13:06:14.458630+0000, chain.objs.size()=1 2024-09-14T11:10:03.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.281+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34__shadow_.7uI6Cx4Aw3_vir3KA_CHKYqTw9JP_Yr_0 2024-09-14T11:10:03.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.282+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13451746239044476520', time=2024-09-14T13:06:14.461224+0000, chain.objs.size()=1 2024-09-14T11:10:03.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.282+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34__shadow_.AfPTvmCUEatyllihnSNaJUTACyhwfGr_0 2024-09-14T11:10:03.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.282+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15330440480574282052', time=2024-09-14T13:06:48.711597+0000, chain.objs.size()=1 2024-09-14T11:10:03.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.282+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36__shadow_.DA6z33RiiNEnYgS6K5GjFvtUcrVJXA2_0 2024-09-14T11:10:03.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.282+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6427496872513607195', time=2024-09-14T13:09:30.928498+0000, chain.objs.size()=1 2024-09-14T11:10:03.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.282+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17__shadow_.n-_o85CtujE2Jk9ymGppQwz7Qt3v_bc_0 2024-09-14T11:10:03.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.284+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:03.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.286+0000 7fbe1a694800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:10:03.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.287+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.287+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.288+0000 7fbe1a694800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-14T11:10:03.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.288+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='_BsKheWE9dXgzioj1hXaGrGekxPJTTsg', time=2024-09-14T13:01:30.656256+0000, chain.objs.size()=1 2024-09-14T11:10:03.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.288+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15__shadow_.Hr57S5_luop0gT5dU1PNfFYjK_snJJY_0 2024-09-14T11:10:03.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.288+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5043473179856349148', time=2024-09-14T13:01:30.871806+0000, chain.objs.size()=1 2024-09-14T11:10:03.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.288+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8__shadow_.lCIDlXGBbbzi4_Fap9QtJoqnraWIkBr_0 2024-09-14T11:10:03.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.288+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5188769218636925911', time=2024-09-14T13:03:20.058469+0000, chain.objs.size()=1 2024-09-14T11:10:03.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.288+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21__shadow_.-4klJUipcJlRs-HPKSxdhyXHJO87RsX_0 2024-09-14T11:10:03.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.288+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1214301133312600968', time=2024-09-14T13:03:58.000793+0000, chain.objs.size()=1 2024-09-14T11:10:03.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.288+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.26__shadow_.jDz0G4Dmr0J_-B2ZZH-Kvw-G0onlkev_0 2024-09-14T11:10:03.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.288+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15120393446220992291', time=2024-09-14T13:05:08.720201+0000, chain.objs.size()=1 2024-09-14T11:10:03.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.288+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31__shadow_.9hzxdhCn4v8bLjeMIDEiBAk_q0z5ZFB_0 2024-09-14T11:10:03.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.288+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13458607958262327706', time=2024-09-14T13:05:08.720847+0000, chain.objs.size()=1 2024-09-14T11:10:03.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.288+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31__shadow_.hRLLST65FITIQIT9U6CTAa3DJ3EN7CR_0 2024-09-14T11:10:03.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.288+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10198689262998411799', time=2024-09-14T13:05:08.721566+0000, chain.objs.size()=1 2024-09-14T11:10:03.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.288+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.31__shadow_.OwJNhPy8uwLxn-FCGna3hc97ESPsMWN_0 2024-09-14T11:10:03.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.288+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11154925528853243587', time=2024-09-14T13:05:40.544392+0000, chain.objs.size()=1 2024-09-14T11:10:03.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.288+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.32__shadow_.Lyf5iBJ7x9SozFCaCroJlxnanakmkJL_0 2024-09-14T11:10:03.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.288+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.861647063608628719', time=2024-09-14T13:05:42.322583+0000, chain.objs.size()=1 2024-09-14T11:10:03.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.288+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.33__shadow_.RuAVjv-ZzNMkbK2mpzfaKaojucU_bOy_0 2024-09-14T11:10:03.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.288+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.749886464919165690', time=2024-09-14T13:06:14.456324+0000, chain.objs.size()=1 2024-09-14T11:10:03.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.288+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34__shadow_.zxgDLTz1kU4Do5QsItnJF9idRyKyMhq_0 2024-09-14T11:10:03.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.288+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15570801764469013365', time=2024-09-14T13:06:48.716616+0000, chain.objs.size()=1 2024-09-14T11:10:03.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.288+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.36__shadow_._IkIrDOJ6bjIGkwk2Mai9Y7EIIZmxnX_0 2024-09-14T11:10:03.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.288+0000 7fbe1a694800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5526801357190614700', time=2024-09-14T13:07:23.888909+0000, chain.objs.size()=1 2024-09-14T11:10:03.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.288+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.39__shadow_.L3dr9gtP2xW8c3jzBvT38VoPpsEfa0b_0 2024-09-14T11:10:03.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.291+0000 7fbe1a694800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:03.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.294+0000 7fbccf7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:03.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.296+0000 7fbe1a694800 20 remove_watcher() i=0 2024-09-14T11:10:03.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.296+0000 7fbe1a694800 2 removed watcher, disabling cache 2024-09-14T11:10:03.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.297+0000 7fbe1a694800 20 remove_watcher() i=1 2024-09-14T11:10:03.296 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.298+0000 7fbe1a694800 20 remove_watcher() i=2 2024-09-14T11:10:03.297 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.299+0000 7fbe1a694800 20 remove_watcher() i=3 2024-09-14T11:10:03.298 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.300+0000 7fbe1a694800 20 remove_watcher() i=4 2024-09-14T11:10:03.299 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.301+0000 7fbe1a694800 20 remove_watcher() i=5 2024-09-14T11:10:03.300 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.302+0000 7fbe1a694800 20 remove_watcher() i=6 2024-09-14T11:10:03.301 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.303+0000 7fbe1a694800 20 remove_watcher() i=7 2024-09-14T11:10:03.313 DEBUG:teuthology.orchestra.run.smithi097:> radosgw-admin gc process --include-all 2024-09-14T11:10:03.404 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:03.404 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:03.441 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.442+0000 7f93bb140800 20 rados->read ofs=0 len=0 2024-09-14T11:10:03.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.444+0000 7f93bb140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:03.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.444+0000 7f93bb140800 20 realm 2024-09-14T11:10:03.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.444+0000 7f93bb140800 20 rados->read ofs=0 len=0 2024-09-14T11:10:03.444 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.444+0000 7f93bb140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:03.444 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.444+0000 7f93bb140800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:03.444 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.444+0000 7f93bb140800 20 rados->read ofs=0 len=0 2024-09-14T11:10:03.444 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.445+0000 7f93bb140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:03.444 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.445+0000 7f93bb140800 20 rados->read ofs=0 len=0 2024-09-14T11:10:03.445 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.445+0000 7f93bb140800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:03.445 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.445+0000 7f93bb140800 20 rados->read ofs=0 len=0 2024-09-14T11:10:03.445 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.446+0000 7f93bb140800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:03.445 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.446+0000 7f93bb140800 20 searching for the correct realm 2024-09-14T11:10:03.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.448+0000 7f93b76c1640 0 -- 172.21.15.97:0/3205685907 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f93a000b040 msgr2=0x7f93a0068200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:03.652 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.654+0000 7f93ae6bf640 0 -- 172.21.15.97:0/3205685907 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f93a80b73f0 msgr2=0x7f93a80e47d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:03.658 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.658+0000 7f93bb140800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:03.659 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.658+0000 7f93bb140800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:03.659 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.658+0000 7f93bb140800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:10:03.659 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.658+0000 7f93bb140800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:10:03.659 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.658+0000 7f93bb140800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:03.659 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.658+0000 7f93bb140800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:03.659 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.658+0000 7f93bb140800 20 rados->read ofs=0 len=0 2024-09-14T11:10:03.659 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.659+0000 7f93bb140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:03.659 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.659+0000 7f93bb140800 20 rados->read ofs=0 len=0 2024-09-14T11:10:03.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.659+0000 7f93bb140800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:03.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.659+0000 7f93bb140800 20 rados->read ofs=0 len=0 2024-09-14T11:10:03.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.659+0000 7f93bb140800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:03.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.659+0000 7f93bb140800 20 zone default found 2024-09-14T11:10:03.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.659+0000 7f93bb140800 4 Realm: () 2024-09-14T11:10:03.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.659+0000 7f93bb140800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:10:03.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.659+0000 7f93bb140800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:10:03.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.659+0000 7f93bb140800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:03.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.659+0000 7f93bb140800 20 zonegroup default 2024-09-14T11:10:03.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.659+0000 7f93bb140800 20 rados->read ofs=0 len=0 2024-09-14T11:10:03.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.659+0000 7f93bb140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:03.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.659+0000 7f93bb140800 20 rados->read ofs=0 len=0 2024-09-14T11:10:03.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.660+0000 7f93bb140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:03.661 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.660+0000 7f93bb140800 20 rados->read ofs=0 len=0 2024-09-14T11:10:03.661 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.660+0000 7f93bb140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:03.661 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.660+0000 7f93bb140800 20 started sync module instance, tier type = 2024-09-14T11:10:03.661 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.660+0000 7f93bb140800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:10:03.666 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.668+0000 7f93bb140800 20 add_watcher() i=0 2024-09-14T11:10:03.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.668+0000 7f93bb140800 20 add_watcher() i=1 2024-09-14T11:10:03.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.668+0000 7f93bb140800 20 add_watcher() i=2 2024-09-14T11:10:03.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.668+0000 7f93bb140800 20 add_watcher() i=3 2024-09-14T11:10:03.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.668+0000 7f93bb140800 20 add_watcher() i=4 2024-09-14T11:10:03.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.668+0000 7f93bb140800 20 add_watcher() i=5 2024-09-14T11:10:03.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.668+0000 7f93bb140800 20 add_watcher() i=6 2024-09-14T11:10:03.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.669+0000 7f93bb140800 20 add_watcher() i=7 2024-09-14T11:10:03.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.669+0000 7f93bb140800 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:03.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.671+0000 7f926d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:03.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.671+0000 7f93bb140800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:03.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.671+0000 7f93bb140800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:03.704 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.705+0000 7f91e7fff640 20 reqs_thread_entry: start 2024-09-14T11:10:03.705 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.705+0000 7f93bb140800 20 init_complete bucket index max shards: 11 2024-09-14T11:10:03.705 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.705+0000 7f93bb140800 20 Filter name: none 2024-09-14T11:10:03.705 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.705+0000 7f91e5ffb640 20 reqs_thread_entry: start 2024-09-14T11:10:03.705 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.705+0000 7f93bb140800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:10:03.705 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.707+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.707+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.708+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.707 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.708+0000 7f93bb140800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:10:03.708 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.710+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.709 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.710+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.709 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.710+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.710 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.711+0000 7f93bb140800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:10:03.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.712+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.713+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.713+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.714+0000 7f93bb140800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:10:03.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.715+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.716+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.716+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.717+0000 7f93bb140800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:10:03.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.718+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.719+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.719+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.720+0000 7f93bb140800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:10:03.719 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.721+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.720 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.721+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.720 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.722+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.721 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.722+0000 7f93bb140800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:10:03.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.724+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.724+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.723 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.724+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.725+0000 7f93bb140800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:10:03.725 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.726+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.725 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.727+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.727+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.728+0000 7f93bb140800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:10:03.728 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.729+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.728 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.730+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.728 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.730+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.729 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.731+0000 7f93bb140800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:10:03.730 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.732+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.733+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.733+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.734+0000 7f93bb140800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:10:03.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.735+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.734 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.735+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.734 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.736+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.735 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.737+0000 7f93bb140800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:10:03.736 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.738+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.737 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.738+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.737 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.738+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.738 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.740+0000 7f93bb140800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:10:03.740 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.741+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.740 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.742+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.740 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.742+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.743+0000 7f93bb140800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:10:03.743 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.744+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.743 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.745+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.743 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.745+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.746+0000 7f93bb140800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:10:03.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.747+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.746 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.747+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.746 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.748+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.749+0000 7f93bb140800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:10:03.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.750+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.751+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.751+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.752+0000 7f93bb140800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:10:03.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.753+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.753+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.754+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.753 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.755+0000 7f93bb140800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:10:03.754 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.756+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.755 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.756+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.755 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.757+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.756 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.757+0000 7f93bb140800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:10:03.757 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.759+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.759+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.759+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.760+0000 7f93bb140800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:10:03.761 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.762+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.761 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.762+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.761 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.763+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.764+0000 7f93bb140800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:10:03.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.765+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.765+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.766+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.767+0000 7f93bb140800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:10:03.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.769+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.769+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.769+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.769 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.770+0000 7f93bb140800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:10:03.770 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.772+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.771 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.772+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.771 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.772+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.772 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.773+0000 7f93bb140800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:10:03.773 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.775+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.773 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.775+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.775+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.776+0000 7f93bb140800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:10:03.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.777+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.778+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.778+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.779+0000 7f93bb140800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:10:03.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.780+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.781+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.781+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.780 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.782+0000 7f93bb140800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:10:03.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.783+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.784+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.784+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.786+0000 7f93bb140800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:10:03.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.787+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.788+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.788+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.789+0000 7f93bb140800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:10:03.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.790+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.790+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.791+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.792+0000 7f93bb140800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:10:03.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.793+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.793+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.794+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.793 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.794+0000 7f93bb140800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:10:03.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.796+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.795 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.796+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.795 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.797+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.798+0000 7f93bb140800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:10:03.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.799+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.798 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.799+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:03.798 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.799+0000 7f93bb140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:03.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.801+0000 7f926d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:03.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.803+0000 7f93bb140800 20 remove_watcher() i=0 2024-09-14T11:10:03.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.803+0000 7f93bb140800 2 removed watcher, disabling cache 2024-09-14T11:10:03.803 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.804+0000 7f93bb140800 20 remove_watcher() i=1 2024-09-14T11:10:03.804 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.805+0000 7f93bb140800 20 remove_watcher() i=2 2024-09-14T11:10:03.805 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.806+0000 7f93bb140800 20 remove_watcher() i=3 2024-09-14T11:10:03.806 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.807+0000 7f93bb140800 20 remove_watcher() i=4 2024-09-14T11:10:03.806 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.808+0000 7f93bb140800 20 remove_watcher() i=5 2024-09-14T11:10:03.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.809+0000 7f93bb140800 20 remove_watcher() i=6 2024-09-14T11:10:03.809 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:03.810+0000 7f93bb140800 20 remove_watcher() i=7 2024-09-14T11:10:03.819 DEBUG:teuthology.orchestra.run.smithi097:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-09-14T11:10:04.302 INFO:teuthology.orchestra.run.smithi097.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-09-14T11:10:07.902 INFO:teuthology.orchestra.run.smithi097.stdout:> Task :clean UP-TO-DATE 2024-09-14T11:10:25.602 INFO:teuthology.orchestra.run.smithi097.stdout:> Task :compileJava 2024-09-14T11:10:25.602 INFO:teuthology.orchestra.run.smithi097.stdout:> Task :processResources 2024-09-14T11:10:25.603 INFO:teuthology.orchestra.run.smithi097.stdout:> Task :classes 2024-09-14T11:10:26.201 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:26.201 INFO:teuthology.orchestra.run.smithi097.stdout:> Task :compileTestJava 2024-09-14T11:10:26.202 INFO:teuthology.orchestra.run.smithi097.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-14T11:10:26.202 INFO:teuthology.orchestra.run.smithi097.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-14T11:10:26.203 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:26.203 INFO:teuthology.orchestra.run.smithi097.stdout:> Task :processTestResources NO-SOURCE 2024-09-14T11:10:26.203 INFO:teuthology.orchestra.run.smithi097.stdout:> Task :testClasses 2024-09-14T11:10:31.801 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:31.801 INFO:teuthology.orchestra.run.smithi097.stdout:> Task :test 2024-09-14T11:10:31.802 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:31.802 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-09-14T11:10:32.301 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:32.301 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-09-14T11:10:32.501 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:32.501 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-09-14T11:10:32.601 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:32.601 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-09-14T11:10:32.801 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:32.801 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-09-14T11:10:33.201 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:33.201 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-09-14T11:10:33.401 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:33.401 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-09-14T11:10:33.402 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:33.402 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-09-14T11:10:33.501 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:33.502 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-09-14T11:10:33.502 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:33.502 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-09-14T11:10:33.701 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:33.701 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-09-14T11:10:34.101 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:34.101 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-09-14T11:10:34.501 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:34.501 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-09-14T11:10:34.601 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:34.601 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-09-14T11:10:34.601 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14 11:10:34,564 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-14T11:10:38.201 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:38.201 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-09-14T11:10:38.501 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:38.501 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-09-14T11:10:38.502 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:38.502 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-09-14T11:10:38.701 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:38.701 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-09-14T11:10:38.701 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:38.702 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-09-14T11:10:39.101 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:39.101 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-09-14T11:10:39.401 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:39.401 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-09-14T11:10:39.601 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:39.602 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-09-14T11:10:39.701 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:39.701 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-09-14T11:10:39.801 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:39.801 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-09-14T11:10:42.101 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:42.101 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-09-14T11:10:42.201 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:42.201 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-09-14T11:10:42.601 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:42.601 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-09-14T11:10:42.901 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:42.901 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-09-14T11:10:43.201 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:43.201 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-09-14T11:10:43.601 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:43.601 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-09-14T11:10:48.401 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:48.401 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-09-14T11:10:48.601 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:48.601 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-09-14T11:10:49.501 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:49.501 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-09-14T11:10:49.701 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:49.701 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-09-14T11:10:50.201 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:50.201 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-09-14T11:10:50.401 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:50.401 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-09-14T11:10:50.801 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:50.801 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-09-14T11:10:51.001 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:51.001 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-09-14T11:10:51.001 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:51.002 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-09-14T11:10:51.201 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:51.202 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-09-14T11:10:51.202 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:51.202 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-09-14T11:10:51.401 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:51.401 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-09-14T11:10:51.501 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:51.501 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-09-14T11:10:51.701 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:51.701 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-09-14T11:10:51.701 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:51.701 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-09-14T11:10:51.901 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:51.901 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-09-14T11:10:51.901 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:51.901 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-09-14T11:10:52.101 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:52.101 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-09-14T11:10:52.101 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:52.102 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-09-14T11:10:52.301 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:52.301 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-09-14T11:10:52.301 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:52.302 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-09-14T11:10:52.501 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:52.501 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-09-14T11:10:53.401 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:53.401 INFO:teuthology.orchestra.run.smithi097.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-09-14T11:10:53.683 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:53.683 INFO:teuthology.orchestra.run.smithi097.stdout:---------------------------------------------------------------------- 2024-09-14T11:10:53.683 INFO:teuthology.orchestra.run.smithi097.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-09-14T11:10:53.683 INFO:teuthology.orchestra.run.smithi097.stdout:---------------------------------------------------------------------- 2024-09-14T11:10:53.683 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:53.683 INFO:teuthology.orchestra.run.smithi097.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-14T11:10:53.683 INFO:teuthology.orchestra.run.smithi097.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-14T11:10:53.684 INFO:teuthology.orchestra.run.smithi097.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-14T11:10:53.684 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:53.684 INFO:teuthology.orchestra.run.smithi097.stdout:BUILD SUCCESSFUL in 49s 2024-09-14T11:10:53.684 INFO:teuthology.orchestra.run.smithi097.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-09-14T11:10:54.000 DEBUG:teuthology.orchestra.run.smithi097:> radosgw-admin gc process --include-all 2024-09-14T11:10:54.054 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:54.054 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:54.091 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.092+0000 7f920511f800 20 rados->read ofs=0 len=0 2024-09-14T11:10:54.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.094+0000 7f920511f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:54.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.094+0000 7f920511f800 20 realm 2024-09-14T11:10:54.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.094+0000 7f920511f800 20 rados->read ofs=0 len=0 2024-09-14T11:10:54.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.094+0000 7f920511f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:54.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.094+0000 7f920511f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:54.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.094+0000 7f920511f800 20 rados->read ofs=0 len=0 2024-09-14T11:10:54.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.094+0000 7f920511f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:54.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.094+0000 7f920511f800 20 rados->read ofs=0 len=0 2024-09-14T11:10:54.094 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.095+0000 7f920511f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:54.094 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.095+0000 7f920511f800 20 rados->read ofs=0 len=0 2024-09-14T11:10:54.094 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.096+0000 7f920511f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:54.094 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.096+0000 7f920511f800 20 searching for the correct realm 2024-09-14T11:10:54.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.098+0000 7f92016a3640 0 -- 172.21.15.97:0/2307603412 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f91e8056b60 msgr2=0x7f91e8089940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:54.100 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.102+0000 7f92006a1640 0 -- 172.21.15.97:0/2307603412 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f91f80735a0 msgr2=0x7f91f80a0970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:54.105 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.106+0000 7f920511f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:54.105 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.106+0000 7f920511f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:54.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.106+0000 7f920511f800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:10:54.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.106+0000 7f920511f800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:10:54.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.106+0000 7f920511f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:54.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.106+0000 7f920511f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:54.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.106+0000 7f920511f800 20 rados->read ofs=0 len=0 2024-09-14T11:10:54.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.107+0000 7f920511f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:54.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.107+0000 7f920511f800 20 rados->read ofs=0 len=0 2024-09-14T11:10:54.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.107+0000 7f920511f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:54.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.107+0000 7f920511f800 20 rados->read ofs=0 len=0 2024-09-14T11:10:54.107 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.107+0000 7f920511f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:54.107 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.107+0000 7f920511f800 20 zone default found 2024-09-14T11:10:54.107 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.107+0000 7f920511f800 4 Realm: () 2024-09-14T11:10:54.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.107+0000 7f920511f800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:10:54.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.107+0000 7f920511f800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:10:54.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.107+0000 7f920511f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:54.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.107+0000 7f920511f800 20 zonegroup default 2024-09-14T11:10:54.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.107+0000 7f920511f800 20 rados->read ofs=0 len=0 2024-09-14T11:10:54.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.107+0000 7f920511f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:54.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.107+0000 7f920511f800 20 rados->read ofs=0 len=0 2024-09-14T11:10:54.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.108+0000 7f920511f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:54.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.108+0000 7f920511f800 20 rados->read ofs=0 len=0 2024-09-14T11:10:54.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.108+0000 7f920511f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:54.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.108+0000 7f920511f800 20 started sync module instance, tier type = 2024-09-14T11:10:54.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.108+0000 7f920511f800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:10:54.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.117+0000 7f920511f800 20 add_watcher() i=0 2024-09-14T11:10:54.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.117+0000 7f920511f800 20 add_watcher() i=1 2024-09-14T11:10:54.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.117+0000 7f920511f800 20 add_watcher() i=2 2024-09-14T11:10:54.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.117+0000 7f920511f800 20 add_watcher() i=3 2024-09-14T11:10:54.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.117+0000 7f920511f800 20 add_watcher() i=4 2024-09-14T11:10:54.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.117+0000 7f920511f800 20 add_watcher() i=5 2024-09-14T11:10:54.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.117+0000 7f920511f800 20 add_watcher() i=6 2024-09-14T11:10:54.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.118+0000 7f920511f800 20 add_watcher() i=7 2024-09-14T11:10:54.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.118+0000 7f920511f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:54.118 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.119+0000 7f90b6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:54.118 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.120+0000 7f920511f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:54.118 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.120+0000 7f920511f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:54.152 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.153+0000 7f90b5fe3640 20 reqs_thread_entry: start 2024-09-14T11:10:54.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.153+0000 7f920511f800 20 init_complete bucket index max shards: 11 2024-09-14T11:10:54.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.153+0000 7f920511f800 20 Filter name: none 2024-09-14T11:10:54.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.154+0000 7f90277fe640 20 reqs_thread_entry: start 2024-09-14T11:10:54.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.154+0000 7f920511f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:10:54.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.155+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.155+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.155 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.156+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:10:54.155 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.156+0000 7f920511f800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7872643850505636805', time=2024-09-14T13:10:38.075571+0000, chain.objs.size()=5 2024-09-14T11:10:54.155 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.156+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.47__multipart_key1.2~RDfxnscSaBzJH76ux1FfRcKc4CFitij.1 2024-09-14T11:10:54.155 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.156+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.47__shadow_key1.2~RDfxnscSaBzJH76ux1FfRcKc4CFitij.1_1 2024-09-14T11:10:54.155 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.156+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.47__multipart_key1.2~RDfxnscSaBzJH76ux1FfRcKc4CFitij.2 2024-09-14T11:10:54.156 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.156+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.47__shadow_key1.2~RDfxnscSaBzJH76ux1FfRcKc4CFitij.2_1 2024-09-14T11:10:54.156 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.156+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.47__multipart_key1.2~RDfxnscSaBzJH76ux1FfRcKc4CFitij.3 2024-09-14T11:10:54.156 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.156+0000 7f920511f800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18363174608976308401', time=2024-09-14T13:10:46.817709+0000, chain.objs.size()=10 2024-09-14T11:10:54.156 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.156+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__multipart_key1.2~aS0boVN0cVsqnxX55YKsspHkebFUpcS.1 2024-09-14T11:10:54.156 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.156+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__multipart_key1.2~aS0boVN0cVsqnxX55YKsspHkebFUpcS.2 2024-09-14T11:10:54.156 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.156+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__multipart_key1.2~aS0boVN0cVsqnxX55YKsspHkebFUpcS.3 2024-09-14T11:10:54.156 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.156+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__multipart_key1.2~aS0boVN0cVsqnxX55YKsspHkebFUpcS.4 2024-09-14T11:10:54.156 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.156+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__multipart_key1.2~aS0boVN0cVsqnxX55YKsspHkebFUpcS.5 2024-09-14T11:10:54.156 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.156+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__multipart_key1.2~aS0boVN0cVsqnxX55YKsspHkebFUpcS.6 2024-09-14T11:10:54.156 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.156+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__multipart_key1.2~aS0boVN0cVsqnxX55YKsspHkebFUpcS.7 2024-09-14T11:10:54.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.160+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__multipart_key1.2~aS0boVN0cVsqnxX55YKsspHkebFUpcS.8 2024-09-14T11:10:54.159 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.160+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__multipart_key1.2~aS0boVN0cVsqnxX55YKsspHkebFUpcS.9 2024-09-14T11:10:54.159 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.160+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__multipart_key1.2~aS0boVN0cVsqnxX55YKsspHkebFUpcS.10 2024-09-14T11:10:54.161 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.163+0000 7f920511f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:54.163 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.165+0000 7f920511f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:10:54.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.166+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.167+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.167+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:10:54.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.167+0000 7f920511f800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7182213819724531396', time=2024-09-14T13:10:51.498099+0000, chain.objs.size()=1 2024-09-14T11:10:54.166 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.167+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.61__shadow_.mmjBGhwz4d9kkjd5MBQ6cu3W7dTJn00_0 2024-09-14T11:10:54.166 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.168+0000 7f920511f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:54.169 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.170+0000 7f920511f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:10:54.170 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.172+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.171 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.172+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.171 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.172+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:10:54.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.172+0000 7f920511f800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12605047640472544882', time=2024-09-14T13:10:34.284611+0000, chain.objs.size()=5 2024-09-14T11:10:54.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.172+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.44__multipart_key1.2~63PqbLjV28Cxd1iY6HgSbVK3dgN6E09.1 2024-09-14T11:10:54.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.172+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.44__multipart_key1.2~63PqbLjV28Cxd1iY6HgSbVK3dgN6E09.2 2024-09-14T11:10:54.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.172+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.44__multipart_key1.2~63PqbLjV28Cxd1iY6HgSbVK3dgN6E09.3 2024-09-14T11:10:54.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.172+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.44__multipart_key1.2~63PqbLjV28Cxd1iY6HgSbVK3dgN6E09.4 2024-09-14T11:10:54.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.172+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.44__multipart_key1.2~63PqbLjV28Cxd1iY6HgSbVK3dgN6E09.5 2024-09-14T11:10:54.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.172+0000 7f920511f800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17259375765790155159', time=2024-09-14T13:10:36.719647+0000, chain.objs.size()=5 2024-09-14T11:10:54.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.172+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.47__multipart_key1.2~H1lmiIVgJEIslcL84uQbp6fnacJ8A0u.1 2024-09-14T11:10:54.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.173+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.47__multipart_key1.2~H1lmiIVgJEIslcL84uQbp6fnacJ8A0u.2 2024-09-14T11:10:54.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.173+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.47__multipart_key1.2~H1lmiIVgJEIslcL84uQbp6fnacJ8A0u.3 2024-09-14T11:10:54.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.173+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.47__multipart_key1.2~H1lmiIVgJEIslcL84uQbp6fnacJ8A0u.4 2024-09-14T11:10:54.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.174+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.47__multipart_key1.2~H1lmiIVgJEIslcL84uQbp6fnacJ8A0u.5 2024-09-14T11:10:54.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.174+0000 7f920511f800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10101109189626103992', time=2024-09-14T13:10:42.066444+0000, chain.objs.size()=5 2024-09-14T11:10:54.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.174+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.52__multipart_key1.2~4DZMfjw3g3J16GC673dGQMYsexOqfYs.1 2024-09-14T11:10:54.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.174+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.52__multipart_key1.2~4DZMfjw3g3J16GC673dGQMYsexOqfYs.2 2024-09-14T11:10:54.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.174+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.52__multipart_key1.2~4DZMfjw3g3J16GC673dGQMYsexOqfYs.3 2024-09-14T11:10:54.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.175+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.52__multipart_key1.2~4DZMfjw3g3J16GC673dGQMYsexOqfYs.4 2024-09-14T11:10:54.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.175+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.52__multipart_key1.2~4DZMfjw3g3J16GC673dGQMYsexOqfYs.5 2024-09-14T11:10:54.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.180+0000 7f920511f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:54.181 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.183+0000 7f920511f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:10:54.183 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.184+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.184 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.184+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.184 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.185+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:10:54.184 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.185+0000 7f920511f800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10090493186493594745', time=2024-09-14T13:10:38.214220+0000, chain.objs.size()=5 2024-09-14T11:10:54.184 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.185+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.47__multipart_key1.2~b3WbMZH0n5uon7jWLVYNHv39bCUDDZ4.1 2024-09-14T11:10:54.184 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.185+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.47__shadow_key1.2~b3WbMZH0n5uon7jWLVYNHv39bCUDDZ4.1_1 2024-09-14T11:10:54.184 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.185+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.47__multipart_key1.2~b3WbMZH0n5uon7jWLVYNHv39bCUDDZ4.2 2024-09-14T11:10:54.184 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.185+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.47__shadow_key1.2~b3WbMZH0n5uon7jWLVYNHv39bCUDDZ4.2_1 2024-09-14T11:10:54.184 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.185+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.47__multipart_key1.2~b3WbMZH0n5uon7jWLVYNHv39bCUDDZ4.3 2024-09-14T11:10:54.188 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.190+0000 7f920511f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:54.190 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.191+0000 7f920511f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:10:54.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.193+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.193+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.194+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:10:54.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.194+0000 7f920511f800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9088790004537532653', time=2024-09-14T13:10:49.575085+0000, chain.objs.size()=5 2024-09-14T11:10:54.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.194+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.56__multipart_key1.2~zaNpT4WIgMGjElT6AiEet5gxXq2jCrf.1 2024-09-14T11:10:54.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.194+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.56__multipart_key1.2~zaNpT4WIgMGjElT6AiEet5gxXq2jCrf.2 2024-09-14T11:10:54.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.194+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.56__multipart_key1.2~zaNpT4WIgMGjElT6AiEet5gxXq2jCrf.3 2024-09-14T11:10:54.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.194+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.56__multipart_key1.2~zaNpT4WIgMGjElT6AiEet5gxXq2jCrf.4 2024-09-14T11:10:54.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.194+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.56__multipart_key1.2~zaNpT4WIgMGjElT6AiEet5gxXq2jCrf.5 2024-09-14T11:10:54.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.199+0000 7f920511f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:54.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.201+0000 7f920511f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:10:54.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.203+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.204+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.204+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.205+0000 7f920511f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:10:54.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.206+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.207+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.207+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.206 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.208+0000 7f920511f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:10:54.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.209+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.210+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.210+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:10:54.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.210+0000 7f920511f800 20 garbage collection: RGWGC::process iterating over entry tag='2~-SSVNq2r99l8ix7f5q6jePQwrrcuQ0I', time=2024-09-14T13:10:32.267881+0000, chain.objs.size()=5 2024-09-14T11:10:54.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.210+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.40__multipart_key1.2~-SSVNq2r99l8ix7f5q6jePQwrrcuQ0I.1 2024-09-14T11:10:54.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.210+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.40__multipart_key1.2~-SSVNq2r99l8ix7f5q6jePQwrrcuQ0I.2 2024-09-14T11:10:54.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.210+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.40__multipart_key1.2~-SSVNq2r99l8ix7f5q6jePQwrrcuQ0I.3 2024-09-14T11:10:54.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.210+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.40__multipart_key1.2~-SSVNq2r99l8ix7f5q6jePQwrrcuQ0I.4 2024-09-14T11:10:54.210 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.210+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.40__multipart_key1.2~-SSVNq2r99l8ix7f5q6jePQwrrcuQ0I.5 2024-09-14T11:10:54.210 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.210+0000 7f920511f800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3754145166812754815', time=2024-09-14T13:10:34.165403+0000, chain.objs.size()=5 2024-09-14T11:10:54.210 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.210+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.44__multipart_key1.2~63PqbLjV28Cxd1iY6HgSbVK3dgN6E09.1 2024-09-14T11:10:54.210 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.210+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.44__multipart_key1.2~63PqbLjV28Cxd1iY6HgSbVK3dgN6E09.2 2024-09-14T11:10:54.210 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.210+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.44__multipart_key1.2~63PqbLjV28Cxd1iY6HgSbVK3dgN6E09.3 2024-09-14T11:10:54.210 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.210+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.44__multipart_key1.2~63PqbLjV28Cxd1iY6HgSbVK3dgN6E09.4 2024-09-14T11:10:54.210 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.210+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.44__multipart_key1.2~63PqbLjV28Cxd1iY6HgSbVK3dgN6E09.5 2024-09-14T11:10:54.210 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.210+0000 7f920511f800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3412317634743219380', time=2024-09-14T13:10:42.701274+0000, chain.objs.size()=5 2024-09-14T11:10:54.210 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.210+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.53__multipart_file2.mpg.2~H_1m0cji8MO-xGZ96eZadWptIrDsm7J.1 2024-09-14T11:10:54.210 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.210+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.53__multipart_file2.mpg.2~H_1m0cji8MO-xGZ96eZadWptIrDsm7J.2 2024-09-14T11:10:54.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.214+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.53__multipart_file2.mpg.2~H_1m0cji8MO-xGZ96eZadWptIrDsm7J.3 2024-09-14T11:10:54.213 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.214+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.53__multipart_file2.mpg.2~H_1m0cji8MO-xGZ96eZadWptIrDsm7J.4 2024-09-14T11:10:54.213 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.214+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.53__multipart_file2.mpg.2~H_1m0cji8MO-xGZ96eZadWptIrDsm7J.5 2024-09-14T11:10:54.215 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.217+0000 7f920511f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:54.217 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.219+0000 7f920511f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:10:54.219 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.220+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.219 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.221+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.219 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.221+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.221 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.222+0000 7f920511f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:10:54.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.223+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.224+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.223 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.224+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:10:54.223 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.224+0000 7f920511f800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4628252781823121614', time=2024-09-14T13:10:42.689951+0000, chain.objs.size()=5 2024-09-14T11:10:54.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.224+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.53__multipart_file.mpg.2~mnsMEvCvs2qTCsqULwV4CCWnyMi1Pub.1 2024-09-14T11:10:54.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.224+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.53__multipart_file.mpg.2~mnsMEvCvs2qTCsqULwV4CCWnyMi1Pub.2 2024-09-14T11:10:54.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.224+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.53__multipart_file.mpg.2~mnsMEvCvs2qTCsqULwV4CCWnyMi1Pub.3 2024-09-14T11:10:54.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.224+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.53__multipart_file.mpg.2~mnsMEvCvs2qTCsqULwV4CCWnyMi1Pub.4 2024-09-14T11:10:54.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.224+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.53__multipart_file.mpg.2~mnsMEvCvs2qTCsqULwV4CCWnyMi1Pub.5 2024-09-14T11:10:54.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.224+0000 7f920511f800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4517391960053510566', time=2024-09-14T13:10:51.275762+0000, chain.objs.size()=1 2024-09-14T11:10:54.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.224+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.60__shadow_.3GVe36_OeAUk67b4xMQ11z2QY-F9xpx_0 2024-09-14T11:10:54.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.227+0000 7f920511f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:54.227 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.229+0000 7f920511f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:10:54.229 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.230+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.229 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.231+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.229 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.231+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.230 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.232+0000 7f920511f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:10:54.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.233+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.233+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.234+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:10:54.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.234+0000 7f920511f800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17262884929708106894', time=2024-09-14T13:10:42.711919+0000, chain.objs.size()=1 2024-09-14T11:10:54.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.234+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.53__shadow_.Hqs8Po37QyKmMpXUfA4eR6oo_lIFJB7_0 2024-09-14T11:10:54.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.235+0000 7f920511f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:54.235 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.237+0000 7f920511f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:10:54.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.238+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.239+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.239+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:10:54.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.239+0000 7f920511f800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.166280481193373417', time=2024-09-14T13:10:42.695553+0000, chain.objs.size()=1 2024-09-14T11:10:54.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.239+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.53__shadow_.8NENxmfGzNl5_XSoaVyb-9-7Qd_Ykcq_0 2024-09-14T11:10:54.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.239+0000 7f920511f800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.516947896080657271', time=2024-09-14T13:10:49.050115+0000, chain.objs.size()=1 2024-09-14T11:10:54.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.239+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.56__shadow_.liKk4hzR-ML-raXBdn1_HZsmj2oiKUa_0 2024-09-14T11:10:54.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.241+0000 7f920511f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:54.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.243+0000 7f920511f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:10:54.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.244+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.244+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.245+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:10:54.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.245+0000 7f920511f800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13252581646057416069', time=2024-09-14T13:10:48.464213+0000, chain.objs.size()=11 2024-09-14T11:10:54.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.245+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__multipart_key1.2~M1okJwUUfCMIvLrSPEipQuyrcdQKJN9.1 2024-09-14T11:10:54.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.245+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__shadow_key1.2~M1okJwUUfCMIvLrSPEipQuyrcdQKJN9.1_1 2024-09-14T11:10:54.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.245+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__multipart_key1.2~M1okJwUUfCMIvLrSPEipQuyrcdQKJN9.2 2024-09-14T11:10:54.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.245+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__shadow_key1.2~M1okJwUUfCMIvLrSPEipQuyrcdQKJN9.2_1 2024-09-14T11:10:54.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.245+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__multipart_key1.2~M1okJwUUfCMIvLrSPEipQuyrcdQKJN9.3 2024-09-14T11:10:54.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.245+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__shadow_key1.2~M1okJwUUfCMIvLrSPEipQuyrcdQKJN9.3_1 2024-09-14T11:10:54.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.245+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__multipart_key1.2~M1okJwUUfCMIvLrSPEipQuyrcdQKJN9.4 2024-09-14T11:10:54.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.245+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__shadow_key1.2~M1okJwUUfCMIvLrSPEipQuyrcdQKJN9.4_1 2024-09-14T11:10:54.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.245+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__multipart_key1.2~M1okJwUUfCMIvLrSPEipQuyrcdQKJN9.5 2024-09-14T11:10:54.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.245+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__shadow_key1.2~M1okJwUUfCMIvLrSPEipQuyrcdQKJN9.5_1 2024-09-14T11:10:54.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.245+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__multipart_key1.2~M1okJwUUfCMIvLrSPEipQuyrcdQKJN9.6 2024-09-14T11:10:54.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.249+0000 7f920511f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:54.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.252+0000 7f920511f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:10:54.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.253+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.253+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.254+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:10:54.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.254+0000 7f920511f800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9435421306140691733', time=2024-09-14T13:10:37.134556+0000, chain.objs.size()=5 2024-09-14T11:10:54.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.254+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.47__multipart_key1.2~xLQPS5IMOHLRCEtV3Buqy3nEhu_zm9s.1 2024-09-14T11:10:54.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.254+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.47__shadow_key1.2~xLQPS5IMOHLRCEtV3Buqy3nEhu_zm9s.1_1 2024-09-14T11:10:54.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.254+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.47__multipart_key1.2~xLQPS5IMOHLRCEtV3Buqy3nEhu_zm9s.2 2024-09-14T11:10:54.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.254+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.47__shadow_key1.2~xLQPS5IMOHLRCEtV3Buqy3nEhu_zm9s.2_1 2024-09-14T11:10:54.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.254+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.47__multipart_key1.2~xLQPS5IMOHLRCEtV3Buqy3nEhu_zm9s.3 2024-09-14T11:10:54.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.254+0000 7f920511f800 20 garbage collection: RGWGC::process iterating over entry tag='2~RvYjRkVbfzsly0T-XdEkRmxZLTxgJaO', time=2024-09-14T13:10:43.242757+0000, chain.objs.size()=3 2024-09-14T11:10:54.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.254+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.54__multipart_key1.2~RvYjRkVbfzsly0T-XdEkRmxZLTxgJaO.7 2024-09-14T11:10:54.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.254+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.54__multipart_key1.2~RvYjRkVbfzsly0T-XdEkRmxZLTxgJaO.10 2024-09-14T11:10:54.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.254+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.54__multipart_key1.2~RvYjRkVbfzsly0T-XdEkRmxZLTxgJaO.13 2024-09-14T11:10:54.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.254+0000 7f920511f800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3546814750597684456', time=2024-09-14T13:10:48.325337+0000, chain.objs.size()=11 2024-09-14T11:10:54.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.254+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__multipart_key1.2~kpXg20UDRZbj6wxhXMokIs8SFAC9W4Y.1 2024-09-14T11:10:54.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.254+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__shadow_key1.2~kpXg20UDRZbj6wxhXMokIs8SFAC9W4Y.1_1 2024-09-14T11:10:54.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.254+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__multipart_key1.2~kpXg20UDRZbj6wxhXMokIs8SFAC9W4Y.2 2024-09-14T11:10:54.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.254+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__shadow_key1.2~kpXg20UDRZbj6wxhXMokIs8SFAC9W4Y.2_1 2024-09-14T11:10:54.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.257+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__multipart_key1.2~kpXg20UDRZbj6wxhXMokIs8SFAC9W4Y.3 2024-09-14T11:10:54.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.258+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__shadow_key1.2~kpXg20UDRZbj6wxhXMokIs8SFAC9W4Y.3_1 2024-09-14T11:10:54.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.258+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__multipart_key1.2~kpXg20UDRZbj6wxhXMokIs8SFAC9W4Y.4 2024-09-14T11:10:54.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.258+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__shadow_key1.2~kpXg20UDRZbj6wxhXMokIs8SFAC9W4Y.4_1 2024-09-14T11:10:54.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.258+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__multipart_key1.2~kpXg20UDRZbj6wxhXMokIs8SFAC9W4Y.5 2024-09-14T11:10:54.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.258+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__shadow_key1.2~kpXg20UDRZbj6wxhXMokIs8SFAC9W4Y.5_1 2024-09-14T11:10:54.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.258+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__multipart_key1.2~kpXg20UDRZbj6wxhXMokIs8SFAC9W4Y.6 2024-09-14T11:10:54.260 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.261+0000 7f920511f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:54.262 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.263+0000 7f920511f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:10:54.263 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.265+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.265+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.266+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:10:54.265 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.266+0000 7f920511f800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15978832446950184405', time=2024-09-14T13:10:35.773657+0000, chain.objs.size()=5 2024-09-14T11:10:54.265 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.266+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.47__multipart_key1.2~J0mvgKhFy7e_v6QERNHIZ4XsqKh4-Ca.1 2024-09-14T11:10:54.265 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.266+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.47__multipart_key1.2~J0mvgKhFy7e_v6QERNHIZ4XsqKh4-Ca.2 2024-09-14T11:10:54.265 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.266+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.47__multipart_key1.2~J0mvgKhFy7e_v6QERNHIZ4XsqKh4-Ca.3 2024-09-14T11:10:54.265 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.266+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.47__multipart_key1.2~J0mvgKhFy7e_v6QERNHIZ4XsqKh4-Ca.4 2024-09-14T11:10:54.265 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.266+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.47__multipart_key1.2~J0mvgKhFy7e_v6QERNHIZ4XsqKh4-Ca.5 2024-09-14T11:10:54.268 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.269+0000 7f920511f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:54.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.271+0000 7f920511f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:10:54.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.273+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.273+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.274 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.274+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:10:54.274 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.274+0000 7f920511f800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13691127453124901828', time=2024-09-14T13:10:46.071730+0000, chain.objs.size()=11 2024-09-14T11:10:54.274 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.274+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__multipart_key1.2~F_RzZiB_oHPZ_9ifp3UNfdTKDW_719o.1 2024-09-14T11:10:54.274 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.274+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__multipart_key1.2~F_RzZiB_oHPZ_9ifp3UNfdTKDW_719o.2 2024-09-14T11:10:54.274 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.274+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__multipart_key1.2~F_RzZiB_oHPZ_9ifp3UNfdTKDW_719o.3 2024-09-14T11:10:54.274 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.274+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__multipart_key1.2~F_RzZiB_oHPZ_9ifp3UNfdTKDW_719o.4 2024-09-14T11:10:54.274 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.274+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__multipart_key1.2~F_RzZiB_oHPZ_9ifp3UNfdTKDW_719o.5 2024-09-14T11:10:54.274 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.274+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__multipart_key1.2~F_RzZiB_oHPZ_9ifp3UNfdTKDW_719o.6 2024-09-14T11:10:54.274 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.274+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__multipart_key1.2~F_RzZiB_oHPZ_9ifp3UNfdTKDW_719o.7 2024-09-14T11:10:54.274 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.274+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__multipart_key1.2~F_RzZiB_oHPZ_9ifp3UNfdTKDW_719o.8 2024-09-14T11:10:54.274 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.274+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__multipart_key1.2~F_RzZiB_oHPZ_9ifp3UNfdTKDW_719o.9 2024-09-14T11:10:54.274 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.274+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__multipart_key1.2~F_RzZiB_oHPZ_9ifp3UNfdTKDW_719o.10 2024-09-14T11:10:54.275 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.274+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__multipart_key1.2~F_RzZiB_oHPZ_9ifp3UNfdTKDW_719o.11 2024-09-14T11:10:54.275 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.274+0000 7f920511f800 20 garbage collection: RGWGC::process iterating over entry tag='2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY', time=2024-09-14T13:10:50.875955+0000, chain.objs.size()=92 2024-09-14T11:10:54.275 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.274+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.1 2024-09-14T11:10:54.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.277+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.2 2024-09-14T11:10:54.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.278+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.3 2024-09-14T11:10:54.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.278+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.4 2024-09-14T11:10:54.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.278+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.5 2024-09-14T11:10:54.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.278+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.6 2024-09-14T11:10:54.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.278+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.7 2024-09-14T11:10:54.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.278+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.8 2024-09-14T11:10:54.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.278+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.9 2024-09-14T11:10:54.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.278+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.10 2024-09-14T11:10:54.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.278+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.11 2024-09-14T11:10:54.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.279+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.12 2024-09-14T11:10:54.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.279+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.13 2024-09-14T11:10:54.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.280+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.14 2024-09-14T11:10:54.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.281+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.15 2024-09-14T11:10:54.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.281+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.16 2024-09-14T11:10:54.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.281+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.17 2024-09-14T11:10:54.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.281+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.18 2024-09-14T11:10:54.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.281+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.19 2024-09-14T11:10:54.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.281+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.20 2024-09-14T11:10:54.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.281+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.21 2024-09-14T11:10:54.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.281+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.22 2024-09-14T11:10:54.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.281+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.23 2024-09-14T11:10:54.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.281+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.24 2024-09-14T11:10:54.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.282+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.25 2024-09-14T11:10:54.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.282+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.26 2024-09-14T11:10:54.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.282+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.27 2024-09-14T11:10:54.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.283+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.28 2024-09-14T11:10:54.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.283+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.29 2024-09-14T11:10:54.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.283+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.30 2024-09-14T11:10:54.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.283+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.31 2024-09-14T11:10:54.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.284+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.32 2024-09-14T11:10:54.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.284+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.33 2024-09-14T11:10:54.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.284+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.34 2024-09-14T11:10:54.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.284+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.35 2024-09-14T11:10:54.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.284+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.36 2024-09-14T11:10:54.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.284+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.37 2024-09-14T11:10:54.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.286+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.38 2024-09-14T11:10:54.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.286+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.39 2024-09-14T11:10:54.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.286+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.40 2024-09-14T11:10:54.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.286+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.41 2024-09-14T11:10:54.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.286+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.42 2024-09-14T11:10:54.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.286+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.43 2024-09-14T11:10:54.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.287+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.44 2024-09-14T11:10:54.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.288+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.45 2024-09-14T11:10:54.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.288+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.46 2024-09-14T11:10:54.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.288+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.47 2024-09-14T11:10:54.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.288+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.48 2024-09-14T11:10:54.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.288+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.49 2024-09-14T11:10:54.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.288+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.50 2024-09-14T11:10:54.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.288+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.51 2024-09-14T11:10:54.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.288+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.52 2024-09-14T11:10:54.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.288+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.53 2024-09-14T11:10:54.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.288+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.54 2024-09-14T11:10:54.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.288+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.55 2024-09-14T11:10:54.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.289+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.56 2024-09-14T11:10:54.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.289+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.57 2024-09-14T11:10:54.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.290+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.58 2024-09-14T11:10:54.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.290+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.59 2024-09-14T11:10:54.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.290+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.60 2024-09-14T11:10:54.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.290+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.61 2024-09-14T11:10:54.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.290+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.62 2024-09-14T11:10:54.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.290+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.63 2024-09-14T11:10:54.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.290+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.64 2024-09-14T11:10:54.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.291+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.65 2024-09-14T11:10:54.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.291+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.66 2024-09-14T11:10:54.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.292+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.67 2024-09-14T11:10:54.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.292+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.68 2024-09-14T11:10:54.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.292+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.69 2024-09-14T11:10:54.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.292+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.70 2024-09-14T11:10:54.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.292+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.71 2024-09-14T11:10:54.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.292+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.72 2024-09-14T11:10:54.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.292+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.73 2024-09-14T11:10:54.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.292+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.74 2024-09-14T11:10:54.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.292+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.75 2024-09-14T11:10:54.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.292+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.76 2024-09-14T11:10:54.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.292+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.77 2024-09-14T11:10:54.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.293+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.78 2024-09-14T11:10:54.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.294+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.79 2024-09-14T11:10:54.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.294+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.80 2024-09-14T11:10:54.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.294+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.81 2024-09-14T11:10:54.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.294+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.82 2024-09-14T11:10:54.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.294+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.83 2024-09-14T11:10:54.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.294+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.84 2024-09-14T11:10:54.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.294+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.85 2024-09-14T11:10:54.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.294+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.86 2024-09-14T11:10:54.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.296+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.87 2024-09-14T11:10:54.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.296+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.88 2024-09-14T11:10:54.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.296+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.89 2024-09-14T11:10:54.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.297+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.90 2024-09-14T11:10:54.296 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.297+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.91 2024-09-14T11:10:54.296 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.297+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.58__multipart_key1.2~HFEqC2S-IP_wOiBuzIVe6A1ESW2pgfY.92 2024-09-14T11:10:54.297 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.298+0000 7f920511f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:54.299 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.301+0000 7f920511f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:10:54.300 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.302+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.301 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.302+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.303+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:10:54.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.303+0000 7f920511f800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15038217986309119648', time=2024-09-14T13:10:47.565120+0000, chain.objs.size()=11 2024-09-14T11:10:54.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.303+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__multipart_key1.2~s3nEiG4BOfLvUTQbficSXqnljzyP-8v.1 2024-09-14T11:10:54.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.303+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__shadow_key1.2~s3nEiG4BOfLvUTQbficSXqnljzyP-8v.1_1 2024-09-14T11:10:54.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.303+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__multipart_key1.2~s3nEiG4BOfLvUTQbficSXqnljzyP-8v.2 2024-09-14T11:10:54.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.303+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__shadow_key1.2~s3nEiG4BOfLvUTQbficSXqnljzyP-8v.2_1 2024-09-14T11:10:54.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.303+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__multipart_key1.2~s3nEiG4BOfLvUTQbficSXqnljzyP-8v.3 2024-09-14T11:10:54.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.303+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__shadow_key1.2~s3nEiG4BOfLvUTQbficSXqnljzyP-8v.3_1 2024-09-14T11:10:54.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.303+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__multipart_key1.2~s3nEiG4BOfLvUTQbficSXqnljzyP-8v.4 2024-09-14T11:10:54.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.303+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__shadow_key1.2~s3nEiG4BOfLvUTQbficSXqnljzyP-8v.4_1 2024-09-14T11:10:54.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.303+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__multipart_key1.2~s3nEiG4BOfLvUTQbficSXqnljzyP-8v.5 2024-09-14T11:10:54.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.303+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__shadow_key1.2~s3nEiG4BOfLvUTQbficSXqnljzyP-8v.5_1 2024-09-14T11:10:54.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.303+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__multipart_key1.2~s3nEiG4BOfLvUTQbficSXqnljzyP-8v.6 2024-09-14T11:10:54.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.307+0000 7f920511f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:54.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.311+0000 7f920511f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:10:54.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.313+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.313+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.314+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.315+0000 7f920511f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:10:54.314 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.316+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.315 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.317+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.315 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.317+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:10:54.316 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.317+0000 7f920511f800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16501260545142187590', time=2024-09-14T13:10:36.304394+0000, chain.objs.size()=5 2024-09-14T11:10:54.316 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.317+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.47__multipart_key1.2~EF7l6cB7S8nhpPhRZvpnBNjo2HV7EhU.1 2024-09-14T11:10:54.316 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.317+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.47__multipart_key1.2~EF7l6cB7S8nhpPhRZvpnBNjo2HV7EhU.2 2024-09-14T11:10:54.316 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.317+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.47__multipart_key1.2~EF7l6cB7S8nhpPhRZvpnBNjo2HV7EhU.3 2024-09-14T11:10:54.316 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.317+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.47__multipart_key1.2~EF7l6cB7S8nhpPhRZvpnBNjo2HV7EhU.4 2024-09-14T11:10:54.316 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.317+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.47__multipart_key1.2~EF7l6cB7S8nhpPhRZvpnBNjo2HV7EhU.5 2024-09-14T11:10:54.318 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.320+0000 7f920511f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:54.320 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.322+0000 7f920511f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:10:54.321 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.323+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.322 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.323+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.322 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.324+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:10:54.322 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.324+0000 7f920511f800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3032861125136332216', time=2024-09-14T13:10:52.164749+0000, chain.objs.size()=1 2024-09-14T11:10:54.322 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.324+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.64__shadow_._rWyhaknSTyb2Y1KEF_xOcvQ4fe1ACm_0 2024-09-14T11:10:54.323 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.325+0000 7f920511f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:54.325 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.327+0000 7f920511f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:10:54.326 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.328+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.327 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.328+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.327 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.329+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:10:54.327 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.329+0000 7f920511f800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13440943222982484609', time=2024-09-14T13:10:51.717482+0000, chain.objs.size()=1 2024-09-14T11:10:54.327 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.329+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.62__shadow_.jMKIoFjcP0Pf6HoYf3_zRjCCqMFC9lC_0 2024-09-14T11:10:54.328 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.330+0000 7f920511f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:54.330 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.332+0000 7f920511f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:10:54.331 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.333+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.332 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.334+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.334+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:10:54.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.334+0000 7f920511f800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4881858145544904386', time=2024-09-14T13:10:50.271368+0000, chain.objs.size()=5 2024-09-14T11:10:54.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.334+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.57__multipart_key1.2~r9mMQpf6901fMObBWfRcBktAen8yrWJ.1 2024-09-14T11:10:54.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.334+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.57__multipart_key1.2~r9mMQpf6901fMObBWfRcBktAen8yrWJ.2 2024-09-14T11:10:54.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.334+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.57__multipart_key1.2~r9mMQpf6901fMObBWfRcBktAen8yrWJ.3 2024-09-14T11:10:54.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.334+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.57__multipart_key1.2~r9mMQpf6901fMObBWfRcBktAen8yrWJ.4 2024-09-14T11:10:54.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.334+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.57__multipart_key1.2~r9mMQpf6901fMObBWfRcBktAen8yrWJ.5 2024-09-14T11:10:54.335 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.336+0000 7f920511f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:54.337 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.338+0000 7f920511f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:10:54.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.340+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.339 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.340+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.339 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.340+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:10:54.339 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.340+0000 7f920511f800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10698998306240695827', time=2024-09-14T13:10:38.334790+0000, chain.objs.size()=4 2024-09-14T11:10:54.339 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.340+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.46__shadow_.1GEwVdsqqCF3DMBYXdl73dKojBnbls__0 2024-09-14T11:10:54.340 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.340+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.46__shadow_.1GEwVdsqqCF3DMBYXdl73dKojBnbls__1 2024-09-14T11:10:54.340 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.340+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.46__shadow_.1GEwVdsqqCF3DMBYXdl73dKojBnbls__2 2024-09-14T11:10:54.340 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.340+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.46__shadow_.1GEwVdsqqCF3DMBYXdl73dKojBnbls__3 2024-09-14T11:10:54.340 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.340+0000 7f920511f800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11923903710890831303', time=2024-09-14T13:10:53.441058+0000, chain.objs.size()=11 2024-09-14T11:10:54.340 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.340+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.66__multipart_key1.2~fm_Xhno0vBBsqjMHIbR0uWoTYo2o5KJ.1 2024-09-14T11:10:54.340 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.340+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.66__multipart_key1.2~fm_Xhno0vBBsqjMHIbR0uWoTYo2o5KJ.2 2024-09-14T11:10:54.340 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.340+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.66__multipart_key1.2~fm_Xhno0vBBsqjMHIbR0uWoTYo2o5KJ.3 2024-09-14T11:10:54.340 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.340+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.66__multipart_key1.2~fm_Xhno0vBBsqjMHIbR0uWoTYo2o5KJ.4 2024-09-14T11:10:54.340 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.340+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.66__multipart_key1.2~fm_Xhno0vBBsqjMHIbR0uWoTYo2o5KJ.5 2024-09-14T11:10:54.340 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.340+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.66__multipart_key1.2~fm_Xhno0vBBsqjMHIbR0uWoTYo2o5KJ.6 2024-09-14T11:10:54.340 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.340+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.66__multipart_key1.2~fm_Xhno0vBBsqjMHIbR0uWoTYo2o5KJ.7 2024-09-14T11:10:54.340 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.340+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.66__multipart_key1.2~fm_Xhno0vBBsqjMHIbR0uWoTYo2o5KJ.8 2024-09-14T11:10:54.347 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.349+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.66__multipart_key1.2~fm_Xhno0vBBsqjMHIbR0uWoTYo2o5KJ.9 2024-09-14T11:10:54.347 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.349+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.66__multipart_key1.2~fm_Xhno0vBBsqjMHIbR0uWoTYo2o5KJ.10 2024-09-14T11:10:54.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.349+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.66__multipart_key1.2~fm_Xhno0vBBsqjMHIbR0uWoTYo2o5KJ.11 2024-09-14T11:10:54.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.351+0000 7f920511f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:54.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.353+0000 7f920511f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:10:54.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.355+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.355+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.356+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:10:54.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.356+0000 7f920511f800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7275920805162086664', time=2024-09-14T13:10:39.456369+0000, chain.objs.size()=5 2024-09-14T11:10:54.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.356+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.51__multipart_key1.2~EKnWPDYff1iRe8YdDuio4FN-ktGYbB4.1 2024-09-14T11:10:54.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.356+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.51__multipart_key1.2~EKnWPDYff1iRe8YdDuio4FN-ktGYbB4.2 2024-09-14T11:10:54.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.356+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.51__multipart_key1.2~EKnWPDYff1iRe8YdDuio4FN-ktGYbB4.3 2024-09-14T11:10:54.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.356+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.51__multipart_key1.2~EKnWPDYff1iRe8YdDuio4FN-ktGYbB4.4 2024-09-14T11:10:54.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.356+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.51__multipart_key1.2~EKnWPDYff1iRe8YdDuio4FN-ktGYbB4.5 2024-09-14T11:10:54.357 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.358+0000 7f920511f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:54.359 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.360+0000 7f920511f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:10:54.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.361+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.362+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.362+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.363+0000 7f920511f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:10:54.363 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.365+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.365+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.365+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:10:54.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.365+0000 7f920511f800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16275768696119982505', time=2024-09-14T13:10:51.939888+0000, chain.objs.size()=1 2024-09-14T11:10:54.364 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.365+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.63__shadow_.ircCACycT_CV0iLld-qdtkvHbI0eL4-_0 2024-09-14T11:10:54.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.367+0000 7f920511f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:54.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.369+0000 7f920511f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:10:54.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.370+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.370+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.371+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.371 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.372+0000 7f920511f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:10:54.373 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.375+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.374 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.375+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.374 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.375+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:10:54.374 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.375+0000 7f920511f800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8500271379447650995', time=2024-09-14T13:10:33.262935+0000, chain.objs.size()=5 2024-09-14T11:10:54.374 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.376+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.42__multipart_key1.2~2ClaSdrF11hrbU3SFjgLSJEUyHmzY3P.1 2024-09-14T11:10:54.375 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.376+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.42__multipart_key1.2~2ClaSdrF11hrbU3SFjgLSJEUyHmzY3P.2 2024-09-14T11:10:54.375 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.376+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.42__multipart_key1.2~2ClaSdrF11hrbU3SFjgLSJEUyHmzY3P.3 2024-09-14T11:10:54.375 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.376+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.42__multipart_key1.2~2ClaSdrF11hrbU3SFjgLSJEUyHmzY3P.4 2024-09-14T11:10:54.375 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.376+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.42__multipart_key1.2~2ClaSdrF11hrbU3SFjgLSJEUyHmzY3P.5 2024-09-14T11:10:54.377 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.378+0000 7f920511f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:54.379 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.381+0000 7f920511f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:10:54.380 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.382+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.381 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.382+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.381 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.383+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.382 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.384+0000 7f920511f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:10:54.383 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.385+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.385+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.386+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:10:54.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.386+0000 7f920511f800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6083307882373304469', time=2024-09-14T13:10:42.706351+0000, chain.objs.size()=1 2024-09-14T11:10:54.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.386+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.53__shadow_.tlXV-9OjZ1YlYc6x1JdGWKa-cgnwoGn_0 2024-09-14T11:10:54.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.386+0000 7f920511f800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13565184892440497326', time=2024-09-14T13:10:45.240480+0000, chain.objs.size()=11 2024-09-14T11:10:54.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.386+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__multipart_key1.2~u7HO3yOBao5vTzf9-JAtasgRmvqSmq1.1 2024-09-14T11:10:54.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.386+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__multipart_key1.2~u7HO3yOBao5vTzf9-JAtasgRmvqSmq1.2 2024-09-14T11:10:54.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.386+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__multipart_key1.2~u7HO3yOBao5vTzf9-JAtasgRmvqSmq1.3 2024-09-14T11:10:54.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.386+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__multipart_key1.2~u7HO3yOBao5vTzf9-JAtasgRmvqSmq1.4 2024-09-14T11:10:54.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.386+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__multipart_key1.2~u7HO3yOBao5vTzf9-JAtasgRmvqSmq1.5 2024-09-14T11:10:54.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.386+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__multipart_key1.2~u7HO3yOBao5vTzf9-JAtasgRmvqSmq1.6 2024-09-14T11:10:54.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.386+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__multipart_key1.2~u7HO3yOBao5vTzf9-JAtasgRmvqSmq1.7 2024-09-14T11:10:54.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.386+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__multipart_key1.2~u7HO3yOBao5vTzf9-JAtasgRmvqSmq1.8 2024-09-14T11:10:54.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.386+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__multipart_key1.2~u7HO3yOBao5vTzf9-JAtasgRmvqSmq1.9 2024-09-14T11:10:54.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.386+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__multipart_key1.2~u7HO3yOBao5vTzf9-JAtasgRmvqSmq1.10 2024-09-14T11:10:54.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.386+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.55__multipart_key1.2~u7HO3yOBao5vTzf9-JAtasgRmvqSmq1.11 2024-09-14T11:10:54.389 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.390+0000 7f920511f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:54.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.392+0000 7f920511f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:10:54.392 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.394+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.394+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.395+0000 7f920511f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:10:54.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.395+0000 7f920511f800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11487903797823035093', time=2024-09-14T13:10:51.052360+0000, chain.objs.size()=1 2024-09-14T11:10:54.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.395+0000 7f920511f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.59__shadow_.ZecWG5AuPjnVPmSNUQisZkfghh1XSWv_0 2024-09-14T11:10:54.394 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.396+0000 7f920511f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:10:54.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.398+0000 7f90b6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:54.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.400+0000 7f920511f800 20 remove_watcher() i=0 2024-09-14T11:10:54.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.400+0000 7f920511f800 2 removed watcher, disabling cache 2024-09-14T11:10:54.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.401+0000 7f920511f800 20 remove_watcher() i=1 2024-09-14T11:10:54.401 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.402+0000 7f920511f800 20 remove_watcher() i=2 2024-09-14T11:10:54.402 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.403+0000 7f920511f800 20 remove_watcher() i=3 2024-09-14T11:10:54.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.404+0000 7f920511f800 20 remove_watcher() i=4 2024-09-14T11:10:54.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.405+0000 7f920511f800 20 remove_watcher() i=5 2024-09-14T11:10:54.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.406+0000 7f920511f800 20 remove_watcher() i=6 2024-09-14T11:10:54.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.408+0000 7f920511f800 20 remove_watcher() i=7 2024-09-14T11:10:54.417 DEBUG:teuthology.orchestra.run.smithi097:> radosgw-admin gc process --include-all 2024-09-14T11:10:54.468 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:54.468 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:54.505 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.507+0000 7f7f9d10c800 20 rados->read ofs=0 len=0 2024-09-14T11:10:54.507 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.508+0000 7f7f9d10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:54.507 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.508+0000 7f7f9d10c800 20 realm 2024-09-14T11:10:54.508 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.508+0000 7f7f9d10c800 20 rados->read ofs=0 len=0 2024-09-14T11:10:54.508 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.509+0000 7f7f9d10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:54.508 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.509+0000 7f7f9d10c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:54.508 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.509+0000 7f7f9d10c800 20 rados->read ofs=0 len=0 2024-09-14T11:10:54.508 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.509+0000 7f7f9d10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:54.508 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.509+0000 7f7f9d10c800 20 rados->read ofs=0 len=0 2024-09-14T11:10:54.508 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.510+0000 7f7f9d10c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:54.508 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.510+0000 7f7f9d10c800 20 rados->read ofs=0 len=0 2024-09-14T11:10:54.509 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.510+0000 7f7f9d10c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:54.509 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.510+0000 7f7f9d10c800 20 searching for the correct realm 2024-09-14T11:10:54.511 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.512+0000 7f7f9b3f7640 0 -- 172.21.15.97:0/2720000778 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f7f840685c0 msgr2=0x7f7f8408b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:54.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.717+0000 7f7f923f5640 0 -- 172.21.15.97:0/2720000778 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f7f8c0935d0 msgr2=0x7f7f8c083350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:54.721 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.722+0000 7f7f9d10c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:54.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.722+0000 7f7f9d10c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:54.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.722+0000 7f7f9d10c800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:10:54.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.722+0000 7f7f9d10c800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:10:54.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.722+0000 7f7f9d10c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:54.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.722+0000 7f7f9d10c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:54.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.722+0000 7f7f9d10c800 20 rados->read ofs=0 len=0 2024-09-14T11:10:54.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.723+0000 7f7f9d10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:54.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.723+0000 7f7f9d10c800 20 rados->read ofs=0 len=0 2024-09-14T11:10:54.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.723+0000 7f7f9d10c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:54.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.723+0000 7f7f9d10c800 20 rados->read ofs=0 len=0 2024-09-14T11:10:54.723 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.723+0000 7f7f9d10c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:54.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.723+0000 7f7f9d10c800 20 zone default found 2024-09-14T11:10:54.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.723+0000 7f7f9d10c800 4 Realm: () 2024-09-14T11:10:54.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.723+0000 7f7f9d10c800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:10:54.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.723+0000 7f7f9d10c800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:10:54.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.723+0000 7f7f9d10c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:54.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.723+0000 7f7f9d10c800 20 zonegroup default 2024-09-14T11:10:54.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.723+0000 7f7f9d10c800 20 rados->read ofs=0 len=0 2024-09-14T11:10:54.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.724+0000 7f7f9d10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:54.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.724+0000 7f7f9d10c800 20 rados->read ofs=0 len=0 2024-09-14T11:10:54.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.724+0000 7f7f9d10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:54.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.724+0000 7f7f9d10c800 20 rados->read ofs=0 len=0 2024-09-14T11:10:54.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.724+0000 7f7f9d10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:54.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.724+0000 7f7f9d10c800 20 started sync module instance, tier type = 2024-09-14T11:10:54.725 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.724+0000 7f7f9d10c800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:10:54.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.733+0000 7f7f9d10c800 20 add_watcher() i=0 2024-09-14T11:10:54.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.733+0000 7f7f9d10c800 20 add_watcher() i=1 2024-09-14T11:10:54.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.733+0000 7f7f9d10c800 20 add_watcher() i=2 2024-09-14T11:10:54.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.733+0000 7f7f9d10c800 20 add_watcher() i=3 2024-09-14T11:10:54.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.733+0000 7f7f9d10c800 20 add_watcher() i=4 2024-09-14T11:10:54.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.733+0000 7f7f9d10c800 20 add_watcher() i=5 2024-09-14T11:10:54.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.733+0000 7f7f9d10c800 20 add_watcher() i=6 2024-09-14T11:10:54.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.734+0000 7f7f9d10c800 20 add_watcher() i=7 2024-09-14T11:10:54.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.734+0000 7f7f9d10c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:54.734 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.735+0000 7f7e517e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:54.734 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.736+0000 7f7f9d10c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:54.734 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.736+0000 7f7f9d10c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:54.770 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.771+0000 7f7dcbfff640 20 reqs_thread_entry: start 2024-09-14T11:10:54.770 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.771+0000 7f7f9d10c800 20 init_complete bucket index max shards: 11 2024-09-14T11:10:54.770 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.771+0000 7f7f9d10c800 20 Filter name: none 2024-09-14T11:10:54.771 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.771+0000 7f7dc9ffb640 20 reqs_thread_entry: start 2024-09-14T11:10:54.771 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.771+0000 7f7f9d10c800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:10:54.771 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.772+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.771 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.773+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.772 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.773+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.772 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.774+0000 7f7f9d10c800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:10:54.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.775+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.776+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.776+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.777+0000 7f7f9d10c800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:10:54.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.778+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.779+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.779+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.780+0000 7f7f9d10c800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:10:54.780 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.782+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.782+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.782+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.783+0000 7f7f9d10c800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:10:54.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.784+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.785+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.785+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.786+0000 7f7f9d10c800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:10:54.787 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.788+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.787 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.789+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.789+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.790+0000 7f7f9d10c800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:10:54.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.791+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.792+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.792+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.793+0000 7f7f9d10c800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:10:54.793 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.795+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.795+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.796+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.795 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.797+0000 7f7f9d10c800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:10:54.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.798+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.798 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.799+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.798 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.799+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.800+0000 7f7f9d10c800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:10:54.800 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.801+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.801 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.802+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.801 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.802+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.803+0000 7f7f9d10c800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:10:54.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.804+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.803 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.804+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.803 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.805+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.804 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.806+0000 7f7f9d10c800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:10:54.805 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.807+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.806 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.807+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.806 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.807+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.807 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.808+0000 7f7f9d10c800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:10:54.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.810+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.809 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.810+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.809 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.811+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.812+0000 7f7f9d10c800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:10:54.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.813+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.812 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.813+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.814+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.815+0000 7f7f9d10c800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:10:54.815 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.816+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.815 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.817+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.815 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.817+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.816 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.818+0000 7f7f9d10c800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:10:54.817 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.819+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.818 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.819+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.818 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.820+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.821+0000 7f7f9d10c800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:10:54.820 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.822+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.821 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.822+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.821 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.823+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.822 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.824+0000 7f7f9d10c800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:10:54.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.825+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.826+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.826+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.825 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.827+0000 7f7f9d10c800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:10:54.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.828+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.829+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.829+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.830+0000 7f7f9d10c800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:10:54.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.831+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.832+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.832+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.833+0000 7f7f9d10c800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:10:54.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.834+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.835+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.834 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.835+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.835 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.836+0000 7f7f9d10c800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:10:54.836 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.837+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.836 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.838+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.837 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.838+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.838 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.839+0000 7f7f9d10c800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:10:54.839 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.841+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.840 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.841+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.840 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.841+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.841 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.842+0000 7f7f9d10c800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:10:54.843 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.844+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.843 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.845+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.844 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.845+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.845 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.846+0000 7f7f9d10c800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:10:54.846 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.847+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.848+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.848+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.848 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.849+0000 7f7f9d10c800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:10:54.849 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.850+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.850 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.851+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.850 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.851+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.850 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.852+0000 7f7f9d10c800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:10:54.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.853+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.854+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.854+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.855+0000 7f7f9d10c800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:10:54.855 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.856+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.855 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.857+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.855 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.857+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.856 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.858+0000 7f7f9d10c800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:10:54.858 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.859+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.858 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.860+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.859 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.860+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.860 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.862+0000 7f7f9d10c800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:10:54.862 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.863+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.862 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.864+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.862 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.864+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.865+0000 7f7f9d10c800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:10:54.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.866+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.867+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.867+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.868+0000 7f7f9d10c800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:10:54.868 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.869+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.868 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.870+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:54.869 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.870+0000 7f7f9d10c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:54.870 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.872+0000 7f7e517e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:54.872 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.873+0000 7f7f9d10c800 20 remove_watcher() i=0 2024-09-14T11:10:54.872 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.873+0000 7f7f9d10c800 2 removed watcher, disabling cache 2024-09-14T11:10:54.873 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.874+0000 7f7f9d10c800 20 remove_watcher() i=1 2024-09-14T11:10:54.874 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.875+0000 7f7f9d10c800 20 remove_watcher() i=2 2024-09-14T11:10:54.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.876+0000 7f7f9d10c800 20 remove_watcher() i=3 2024-09-14T11:10:54.876 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.877+0000 7f7f9d10c800 20 remove_watcher() i=4 2024-09-14T11:10:54.877 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.878+0000 7f7f9d10c800 20 remove_watcher() i=5 2024-09-14T11:10:54.878 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.879+0000 7f7f9d10c800 20 remove_watcher() i=6 2024-09-14T11:10:54.879 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.880+0000 7f7f9d10c800 20 remove_watcher() i=7 2024-09-14T11:10:54.890 DEBUG:teuthology.orchestra.run.smithi097:> radosgw-admin gc process --include-all 2024-09-14T11:10:54.941 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:54.941 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:54.979 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.981+0000 7fcda0326800 20 rados->read ofs=0 len=0 2024-09-14T11:10:54.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.982+0000 7fcda0326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:54.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.982+0000 7fcda0326800 20 realm 2024-09-14T11:10:54.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.982+0000 7fcda0326800 20 rados->read ofs=0 len=0 2024-09-14T11:10:54.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.982+0000 7fcda0326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:54.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.982+0000 7fcda0326800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:54.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.982+0000 7fcda0326800 20 rados->read ofs=0 len=0 2024-09-14T11:10:54.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.982+0000 7fcda0326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:54.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.982+0000 7fcda0326800 20 rados->read ofs=0 len=0 2024-09-14T11:10:54.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.983+0000 7fcda0326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:54.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.983+0000 7fcda0326800 20 rados->read ofs=0 len=0 2024-09-14T11:10:54.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.984+0000 7fcda0326800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:54.983 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.984+0000 7fcda0326800 20 searching for the correct realm 2024-09-14T11:10:54.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:54.986+0000 7fcd9c7da640 0 -- 172.21.15.97:0/2490472063 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7fcd90008070 msgr2=0x7fcd90019040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:55.190 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.192+0000 7fcd9b7d8640 0 -- 172.21.15.97:0/2490472063 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7fcd8c048530 msgr2=0x7fcd8c062a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:55.195 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.196+0000 7fcda0326800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:55.196 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.196+0000 7fcda0326800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:55.196 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.196+0000 7fcda0326800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:10:55.196 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.196+0000 7fcda0326800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:10:55.196 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.196+0000 7fcda0326800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:55.196 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.196+0000 7fcda0326800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:55.196 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.196+0000 7fcda0326800 20 rados->read ofs=0 len=0 2024-09-14T11:10:55.196 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.197+0000 7fcda0326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:55.196 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.197+0000 7fcda0326800 20 rados->read ofs=0 len=0 2024-09-14T11:10:55.196 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.197+0000 7fcda0326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:55.196 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.197+0000 7fcda0326800 20 rados->read ofs=0 len=0 2024-09-14T11:10:55.197 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.197+0000 7fcda0326800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:55.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.197+0000 7fcda0326800 20 zone default found 2024-09-14T11:10:55.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.197+0000 7fcda0326800 4 Realm: () 2024-09-14T11:10:55.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.197+0000 7fcda0326800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:10:55.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.197+0000 7fcda0326800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:10:55.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.197+0000 7fcda0326800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:55.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.197+0000 7fcda0326800 20 zonegroup default 2024-09-14T11:10:55.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.197+0000 7fcda0326800 20 rados->read ofs=0 len=0 2024-09-14T11:10:55.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.198+0000 7fcda0326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:55.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.198+0000 7fcda0326800 20 rados->read ofs=0 len=0 2024-09-14T11:10:55.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.198+0000 7fcda0326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:55.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.198+0000 7fcda0326800 20 rados->read ofs=0 len=0 2024-09-14T11:10:55.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.198+0000 7fcda0326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:55.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.198+0000 7fcda0326800 20 started sync module instance, tier type = 2024-09-14T11:10:55.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.198+0000 7fcda0326800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:10:55.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.207+0000 7fcda0326800 20 add_watcher() i=0 2024-09-14T11:10:55.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.207+0000 7fcda0326800 20 add_watcher() i=1 2024-09-14T11:10:55.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.207+0000 7fcda0326800 20 add_watcher() i=2 2024-09-14T11:10:55.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.207+0000 7fcda0326800 20 add_watcher() i=3 2024-09-14T11:10:55.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.207+0000 7fcda0326800 20 add_watcher() i=4 2024-09-14T11:10:55.206 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.207+0000 7fcda0326800 20 add_watcher() i=5 2024-09-14T11:10:55.206 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.207+0000 7fcda0326800 20 add_watcher() i=6 2024-09-14T11:10:55.206 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.207+0000 7fcda0326800 20 add_watcher() i=7 2024-09-14T11:10:55.206 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.207+0000 7fcda0326800 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:55.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.210+0000 7fcc51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:55.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.210+0000 7fcda0326800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:55.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.210+0000 7fcda0326800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:55.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.245+0000 7fcc50fe1640 20 reqs_thread_entry: start 2024-09-14T11:10:55.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.245+0000 7fcda0326800 20 init_complete bucket index max shards: 11 2024-09-14T11:10:55.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.245+0000 7fcda0326800 20 Filter name: none 2024-09-14T11:10:55.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.245+0000 7fcbca7fc640 20 reqs_thread_entry: start 2024-09-14T11:10:55.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.246+0000 7fcda0326800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:10:55.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.247+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.246 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.247+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.246 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.247+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.248+0000 7fcda0326800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:10:55.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.250+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.250+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.250+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.251+0000 7fcda0326800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:10:55.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.253+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.253+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.254+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.255+0000 7fcda0326800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:10:55.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.256+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.256+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.256+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.257+0000 7fcda0326800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:10:55.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.259+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.258 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.259+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.258 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.259+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.259 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.260+0000 7fcda0326800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:10:55.260 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.262+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.261 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.262+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.261 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.262+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.262 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.263+0000 7fcda0326800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:10:55.263 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.264+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.263 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.265+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.265+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.266+0000 7fcda0326800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:10:55.266 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.267+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.266 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.268+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.267 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.268+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.268 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.269+0000 7fcda0326800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:10:55.269 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.270+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.269 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.271+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.269 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.271+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.272+0000 7fcda0326800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:10:55.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.273+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.273+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.274+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.273 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.275+0000 7fcda0326800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:10:55.275 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.276+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.275 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.277+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.275 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.277+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.278+0000 7fcda0326800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:10:55.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.279+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.279+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.280+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.281+0000 7fcda0326800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:10:55.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.282+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.282+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.282+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.283+0000 7fcda0326800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:10:55.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.285+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.285+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.285+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.287+0000 7fcda0326800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:10:55.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.288+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.288+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.288+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.289+0000 7fcda0326800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:10:55.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.291+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.291+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.291+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.292+0000 7fcda0326800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:10:55.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.294+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.294+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.295+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.296+0000 7fcda0326800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:10:55.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.297+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.296 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.297+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.296 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.297+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.297 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.298+0000 7fcda0326800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:10:55.299 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.300+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.299 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.301+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.299 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.301+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.300 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.302+0000 7fcda0326800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:10:55.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.303+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.304+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.304+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.305+0000 7fcda0326800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:10:55.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.306+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.307+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.307+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.308+0000 7fcda0326800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:10:55.307 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.309+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.308 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.309+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.308 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.310+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.311+0000 7fcda0326800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:10:55.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.312+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.312+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.312+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.314+0000 7fcda0326800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:10:55.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.315+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.314 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.315+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.314 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.316+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.315 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.316+0000 7fcda0326800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:10:55.316 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.318+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.318+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.319+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.319 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.320+0000 7fcda0326800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:10:55.320 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.321+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.320 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.322+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.320 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.322+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.321 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.323+0000 7fcda0326800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:10:55.323 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.324+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.323 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.325+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.323 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.325+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.324 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.326+0000 7fcda0326800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:10:55.325 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.327+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.326 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.327+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.326 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.328+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.327 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.329+0000 7fcda0326800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:10:55.328 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.330+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.329 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.330+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.329 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.331+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.330 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.332+0000 7fcda0326800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:10:55.332 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.333+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.332 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.334+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.334+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.335+0000 7fcda0326800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:10:55.335 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.336+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.335 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.337+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.335 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.337+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.337 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.338+0000 7fcda0326800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:10:55.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.339+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.340+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.340+0000 7fcda0326800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.340 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.342+0000 7fcc51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:55.342 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.343+0000 7fcda0326800 20 remove_watcher() i=0 2024-09-14T11:10:55.342 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.343+0000 7fcda0326800 2 removed watcher, disabling cache 2024-09-14T11:10:55.343 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.344+0000 7fcda0326800 20 remove_watcher() i=1 2024-09-14T11:10:55.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.345+0000 7fcda0326800 20 remove_watcher() i=2 2024-09-14T11:10:55.345 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.346+0000 7fcda0326800 20 remove_watcher() i=3 2024-09-14T11:10:55.346 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.347+0000 7fcda0326800 20 remove_watcher() i=4 2024-09-14T11:10:55.347 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.348+0000 7fcda0326800 20 remove_watcher() i=5 2024-09-14T11:10:55.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.349+0000 7fcda0326800 20 remove_watcher() i=6 2024-09-14T11:10:55.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.350+0000 7fcda0326800 20 remove_watcher() i=7 2024-09-14T11:10:55.359 DEBUG:teuthology.orchestra.run.smithi097:> radosgw-admin gc process --include-all 2024-09-14T11:10:55.411 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:55.411 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:55.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.449+0000 7fad63f23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:55.450 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.451+0000 7fad63f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:55.450 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.451+0000 7fad63f23800 20 realm 2024-09-14T11:10:55.450 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.451+0000 7fad63f23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:55.450 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.451+0000 7fad63f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:55.450 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.451+0000 7fad63f23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:55.450 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.451+0000 7fad63f23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:55.450 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.451+0000 7fad63f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:55.450 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.451+0000 7fad63f23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:55.451 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.452+0000 7fad63f23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:55.451 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.452+0000 7fad63f23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:55.451 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.453+0000 7fad63f23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:55.451 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.453+0000 7fad63f23800 20 searching for the correct realm 2024-09-14T11:10:55.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.454+0000 7fad6040d640 0 -- 172.21.15.97:0/3706638882 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7fad48009040 msgr2=0x7fad4806c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:55.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.659+0000 7fad57fff640 0 -- 172.21.15.97:0/3706638882 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7fad50067130 msgr2=0x7fad5006bb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:55.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.664+0000 7fad63f23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:55.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.664+0000 7fad63f23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:55.663 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.664+0000 7fad63f23800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:10:55.663 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.664+0000 7fad63f23800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:10:55.663 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.664+0000 7fad63f23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:55.663 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.664+0000 7fad63f23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:55.663 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.664+0000 7fad63f23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:55.663 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.664+0000 7fad63f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:55.663 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.664+0000 7fad63f23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:55.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.664+0000 7fad63f23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:55.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.664+0000 7fad63f23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:55.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.665+0000 7fad63f23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:55.665 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.665+0000 7fad63f23800 20 zone default found 2024-09-14T11:10:55.665 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.665+0000 7fad63f23800 4 Realm: () 2024-09-14T11:10:55.665 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.665+0000 7fad63f23800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:10:55.665 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.665+0000 7fad63f23800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:10:55.665 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.665+0000 7fad63f23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:55.665 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.665+0000 7fad63f23800 20 zonegroup default 2024-09-14T11:10:55.665 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.665+0000 7fad63f23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:55.665 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.665+0000 7fad63f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:55.665 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.665+0000 7fad63f23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:55.665 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.665+0000 7fad63f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:55.665 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.665+0000 7fad63f23800 20 rados->read ofs=0 len=0 2024-09-14T11:10:55.665 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.665+0000 7fad63f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:55.665 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.665+0000 7fad63f23800 20 started sync module instance, tier type = 2024-09-14T11:10:55.665 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.665+0000 7fad63f23800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:10:55.673 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.674+0000 7fad63f23800 20 add_watcher() i=0 2024-09-14T11:10:55.673 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.674+0000 7fad63f23800 20 add_watcher() i=1 2024-09-14T11:10:55.673 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.674+0000 7fad63f23800 20 add_watcher() i=2 2024-09-14T11:10:55.673 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.674+0000 7fad63f23800 20 add_watcher() i=3 2024-09-14T11:10:55.673 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.674+0000 7fad63f23800 20 add_watcher() i=4 2024-09-14T11:10:55.673 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.674+0000 7fad63f23800 20 add_watcher() i=5 2024-09-14T11:10:55.673 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.674+0000 7fad63f23800 20 add_watcher() i=6 2024-09-14T11:10:55.673 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.675+0000 7fad63f23800 20 add_watcher() i=7 2024-09-14T11:10:55.674 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.675+0000 7fad63f23800 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:55.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.677+0000 7fac15fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:55.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.677+0000 7fad63f23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:55.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.677+0000 7fad63f23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:55.709 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.710+0000 7fac14fe1640 20 reqs_thread_entry: start 2024-09-14T11:10:55.710 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.710+0000 7fad63f23800 20 init_complete bucket index max shards: 11 2024-09-14T11:10:55.710 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.710+0000 7fad63f23800 20 Filter name: none 2024-09-14T11:10:55.710 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.710+0000 7fab8e7fc640 20 reqs_thread_entry: start 2024-09-14T11:10:55.710 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.710+0000 7fad63f23800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:10:55.710 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.712+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.712+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.712+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.712 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.713+0000 7fad63f23800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:10:55.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.715+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.715+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.715+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.716+0000 7fad63f23800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:10:55.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.718+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.718+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.718+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.719+0000 7fad63f23800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:10:55.719 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.720+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.719 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.721+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.720 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.721+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.721 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.722+0000 7fad63f23800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:10:55.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.725+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.725+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.726+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.725 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.727+0000 7fad63f23800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:10:55.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.728+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.727 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.728+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.727 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.729+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.728 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.729+0000 7fad63f23800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:10:55.729 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.731+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.729 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.731+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.730 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.731+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.732+0000 7fad63f23800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:10:55.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.734+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.734+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.735+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.734 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.736+0000 7fad63f23800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:10:55.735 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.737+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.736 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.737+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.736 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.738+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.737 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.739+0000 7fad63f23800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:10:55.738 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.740+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.739 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.740+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.739 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.741+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.740 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.742+0000 7fad63f23800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:10:55.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.743+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.742 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.743+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.742 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.744+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.743 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.744+0000 7fad63f23800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:10:55.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.746+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.746+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.746+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.746 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.747+0000 7fad63f23800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:10:55.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.748+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.749+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.748 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.749+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.750+0000 7fad63f23800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:10:55.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.751+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.752+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.752+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.753+0000 7fad63f23800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:10:55.753 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.754+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.753 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.755+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.753 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.755+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.754 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.756+0000 7fad63f23800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:10:55.756 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.757+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.756 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.758+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.756 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.758+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.757 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.759+0000 7fad63f23800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:10:55.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.760+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.761+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.761+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.762+0000 7fad63f23800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:10:55.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.763+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.764+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.764+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.765+0000 7fad63f23800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:10:55.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.766+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.767+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.767+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.768+0000 7fad63f23800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:10:55.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.769+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.770+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.769 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.770+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.770 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.771+0000 7fad63f23800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:10:55.772 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.772+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.772 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.773+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.772 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.773+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.773 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.774+0000 7fad63f23800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:10:55.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.775+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.776+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.776+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.777+0000 7fad63f23800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:10:55.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.778+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.778+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.779+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.779+0000 7fad63f23800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:10:55.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.781+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.780 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.781+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.780 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.781+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.782+0000 7fad63f23800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:10:55.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.783+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.784+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.784+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.785+0000 7fad63f23800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:10:55.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.787+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.787+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.786 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.787+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.787 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.789+0000 7fad63f23800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:10:55.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.790+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.790+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.791+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.792+0000 7fad63f23800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:10:55.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.793+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.794+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.793 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.794+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.795+0000 7fad63f23800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:10:55.795 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.797+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.797+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.798+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.799+0000 7fad63f23800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:10:55.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.800+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.801+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.801+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.800 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.802+0000 7fad63f23800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:10:55.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.803+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.804+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.804+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.803 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.805+0000 7fad63f23800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:10:55.804 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.806+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.805 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.806+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:10:55.805 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.807+0000 7fad63f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:10:55.807 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.809+0000 7fac15fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:55.809 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.811+0000 7fad63f23800 20 remove_watcher() i=0 2024-09-14T11:10:55.809 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.811+0000 7fad63f23800 2 removed watcher, disabling cache 2024-09-14T11:10:55.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.812+0000 7fad63f23800 20 remove_watcher() i=1 2024-09-14T11:10:55.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.812+0000 7fad63f23800 20 remove_watcher() i=2 2024-09-14T11:10:55.812 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.813+0000 7fad63f23800 20 remove_watcher() i=3 2024-09-14T11:10:55.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.814+0000 7fad63f23800 20 remove_watcher() i=4 2024-09-14T11:10:55.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.815+0000 7fad63f23800 20 remove_watcher() i=5 2024-09-14T11:10:55.815 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.816+0000 7fad63f23800 20 remove_watcher() i=6 2024-09-14T11:10:55.816 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:10:55.817+0000 7fad63f23800 20 remove_watcher() i=7 2024-09-14T11:10:55.827 DEBUG:teuthology.orchestra.run.smithi097:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-09-14T11:10:56.321 INFO:teuthology.orchestra.run.smithi097.stdout:> Task :clean 2024-09-14T11:10:57.217 INFO:teuthology.orchestra.run.smithi097.stdout:> Task :compileJava 2024-09-14T11:10:57.218 INFO:teuthology.orchestra.run.smithi097.stdout:> Task :processResources 2024-09-14T11:10:57.218 INFO:teuthology.orchestra.run.smithi097.stdout:> Task :classes 2024-09-14T11:10:57.717 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:57.717 INFO:teuthology.orchestra.run.smithi097.stdout:> Task :compileTestJava 2024-09-14T11:10:57.718 INFO:teuthology.orchestra.run.smithi097.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-14T11:10:57.718 INFO:teuthology.orchestra.run.smithi097.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-14T11:10:57.719 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:57.719 INFO:teuthology.orchestra.run.smithi097.stdout:> Task :processTestResources NO-SOURCE 2024-09-14T11:10:57.719 INFO:teuthology.orchestra.run.smithi097.stdout:> Task :testClasses 2024-09-14T11:10:59.719 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:59.719 INFO:teuthology.orchestra.run.smithi097.stdout:> Task :test 2024-09-14T11:10:59.719 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:59.719 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Bucket tests STANDARD_OUT 2024-09-14T11:10:59.720 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14 11:10:58,973 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-14T11:10:59.720 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:59.720 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-09-14T11:10:59.720 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:59.720 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-09-14T11:10:59.720 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:59.720 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-09-14T11:10:59.720 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:59.720 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-09-14T11:10:59.720 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:59.720 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-09-14T11:10:59.720 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:59.721 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-09-14T11:10:59.817 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:59.818 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-09-14T11:10:59.818 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:59.818 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-09-14T11:10:59.917 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:10:59.917 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-09-14T11:11:00.017 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:00.017 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-09-14T11:11:00.217 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:00.217 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-09-14T11:11:00.217 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:00.217 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-09-14T11:11:00.317 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:00.317 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-09-14T11:11:00.417 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:00.417 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-09-14T11:11:00.717 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:00.717 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-09-14T11:11:00.817 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:00.817 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-09-14T11:11:01.017 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:01.017 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-09-14T11:11:01.018 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:01.018 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-09-14T11:11:01.117 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:01.117 INFO:teuthology.orchestra.run.smithi097.stdout:-------------------------------------------------------------------- 2024-09-14T11:11:01.117 INFO:teuthology.orchestra.run.smithi097.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-09-14T11:11:01.117 INFO:teuthology.orchestra.run.smithi097.stdout:-------------------------------------------------------------------- 2024-09-14T11:11:01.148 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:01.148 INFO:teuthology.orchestra.run.smithi097.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-14T11:11:01.148 INFO:teuthology.orchestra.run.smithi097.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-14T11:11:01.148 INFO:teuthology.orchestra.run.smithi097.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-14T11:11:01.148 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:01.148 INFO:teuthology.orchestra.run.smithi097.stdout:BUILD SUCCESSFUL in 5s 2024-09-14T11:11:01.149 INFO:teuthology.orchestra.run.smithi097.stdout:5 actionable tasks: 5 executed 2024-09-14T11:11:01.152 DEBUG:teuthology.orchestra.run.smithi097:> radosgw-admin gc process --include-all 2024-09-14T11:11:01.203 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:01.204 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:01.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.242+0000 7f3520526800 20 rados->read ofs=0 len=0 2024-09-14T11:11:01.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.244+0000 7f3520526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:01.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.244+0000 7f3520526800 20 realm 2024-09-14T11:11:01.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.244+0000 7f3520526800 20 rados->read ofs=0 len=0 2024-09-14T11:11:01.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.245+0000 7f3520526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:01.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.245+0000 7f3520526800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:01.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.245+0000 7f3520526800 20 rados->read ofs=0 len=0 2024-09-14T11:11:01.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.245+0000 7f3520526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:01.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.245+0000 7f3520526800 20 rados->read ofs=0 len=0 2024-09-14T11:11:01.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.245+0000 7f3520526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:01.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.245+0000 7f3520526800 20 rados->read ofs=0 len=0 2024-09-14T11:11:01.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.246+0000 7f3520526800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:01.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.246+0000 7f3520526800 20 searching for the correct realm 2024-09-14T11:11:01.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.250+0000 7f351c9da640 0 -- 172.21.15.97:0/2000896300 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f350403e070 msgr2=0x7f350406c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:01.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.456+0000 7f35139d8640 0 -- 172.21.15.97:0/2000896300 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f350c0b0080 msgr2=0x7f350c0bc3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:01.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.462+0000 7f3520526800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:01.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.462+0000 7f3520526800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:01.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.462+0000 7f3520526800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:11:01.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.462+0000 7f3520526800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:11:01.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.462+0000 7f3520526800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:01.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.462+0000 7f3520526800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:01.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.462+0000 7f3520526800 20 rados->read ofs=0 len=0 2024-09-14T11:11:01.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.463+0000 7f3520526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:01.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.463+0000 7f3520526800 20 rados->read ofs=0 len=0 2024-09-14T11:11:01.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.463+0000 7f3520526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:01.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.463+0000 7f3520526800 20 rados->read ofs=0 len=0 2024-09-14T11:11:01.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.463+0000 7f3520526800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:01.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.463+0000 7f3520526800 20 zone default found 2024-09-14T11:11:01.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.463+0000 7f3520526800 4 Realm: () 2024-09-14T11:11:01.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.463+0000 7f3520526800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:11:01.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.463+0000 7f3520526800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:11:01.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.463+0000 7f3520526800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:01.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.463+0000 7f3520526800 20 zonegroup default 2024-09-14T11:11:01.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.463+0000 7f3520526800 20 rados->read ofs=0 len=0 2024-09-14T11:11:01.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.464+0000 7f3520526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:01.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.464+0000 7f3520526800 20 rados->read ofs=0 len=0 2024-09-14T11:11:01.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.464+0000 7f3520526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:01.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.464+0000 7f3520526800 20 rados->read ofs=0 len=0 2024-09-14T11:11:01.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.464+0000 7f3520526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:01.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.464+0000 7f3520526800 20 started sync module instance, tier type = 2024-09-14T11:11:01.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.464+0000 7f3520526800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:11:01.473 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.474+0000 7f3520526800 20 add_watcher() i=0 2024-09-14T11:11:01.473 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.474+0000 7f3520526800 20 add_watcher() i=1 2024-09-14T11:11:01.473 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.474+0000 7f3520526800 20 add_watcher() i=2 2024-09-14T11:11:01.473 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.474+0000 7f3520526800 20 add_watcher() i=3 2024-09-14T11:11:01.473 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.474+0000 7f3520526800 20 add_watcher() i=4 2024-09-14T11:11:01.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.474+0000 7f3520526800 20 add_watcher() i=5 2024-09-14T11:11:01.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.474+0000 7f3520526800 20 add_watcher() i=6 2024-09-14T11:11:01.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.475+0000 7f3520526800 20 add_watcher() i=7 2024-09-14T11:11:01.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.475+0000 7f3520526800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:01.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.477+0000 7f33d2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:01.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.478+0000 7f3520526800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:01.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.478+0000 7f3520526800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:01.517 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.518+0000 7f33d1fdb640 20 reqs_thread_entry: start 2024-09-14T11:11:01.517 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.519+0000 7f3520526800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:01.518 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.519+0000 7f3520526800 20 Filter name: none 2024-09-14T11:11:01.518 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.519+0000 7f33437fe640 20 reqs_thread_entry: start 2024-09-14T11:11:01.518 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.519+0000 7f3520526800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:11:01.518 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.520+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.519 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.521+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:01.519 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.521+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.522+0000 7f3520526800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:11:01.522 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.523+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.522 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.524+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:01.523 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.524+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.524 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.526+0000 7f3520526800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:11:01.525 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.527+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.527+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:01.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.528+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.527 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.529+0000 7f3520526800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:11:01.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.530+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.531+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:01.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.531+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.532+0000 7f3520526800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:11:01.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.533+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.534+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:01.533 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.534+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.533 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.535+0000 7f3520526800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:11:01.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.537+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.537+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:01.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.538+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.537 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.539+0000 7f3520526800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:11:01.538 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.540+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.539 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.540+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:01.539 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.540+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.540 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.542+0000 7f3520526800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:11:01.542 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.543+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.542 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.543+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:01.542 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.544+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.543 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.545+0000 7f3520526800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:11:01.545 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.546+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.545 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.547+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:01.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.547+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.548+0000 7f3520526800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:11:01.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.549+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.550+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:01.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.550+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.551+0000 7f3520526800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:11:01.551 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.553+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.553+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:01.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.554+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.555+0000 7f3520526800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:11:01.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.556+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.556+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:01.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.557+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.558+0000 7f3520526800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:11:01.558 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.559+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.558 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.560+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:01.558 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.560+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.561+0000 7f3520526800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:11:01.560 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.562+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.562+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:01.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.563+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.562 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.564+0000 7f3520526800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:11:01.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.565+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.565+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:01.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.565+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.565 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.566+0000 7f3520526800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:11:01.566 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.568+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.567 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.568+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:01.567 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.569+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.570+0000 7f3520526800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:11:01.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.571+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.570 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.571+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:01.570 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.572+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.571 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.573+0000 7f3520526800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:11:01.572 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.574+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.573 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.574+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:01.573 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.574+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.575+0000 7f3520526800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:11:01.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.577+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.576 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.577+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:01.576 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.578+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.577 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.579+0000 7f3520526800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:11:01.579 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.580+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.579 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.581+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:01.579 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.581+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.580 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.582+0000 7f3520526800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:11:01.582 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.583+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.582 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.584+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:01.582 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.584+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.583 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.585+0000 7f3520526800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:11:01.585 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.587+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.586 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.587+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:01.586 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.587+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.588+0000 7f3520526800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:11:01.588 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.590+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.589 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.590+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:01.589 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.590+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.590 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.591+0000 7f3520526800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:11:01.591 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.593+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.592 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.593+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:01.592 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.593+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.593 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.594+0000 7f3520526800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:11:01.594 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.595+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.594 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.596+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:01.595 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.596+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:11:01.595 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.596+0000 7f3520526800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6825272617555950043', time=2024-09-14T13:11:00.046546+0000, chain.objs.size()=1 2024-09-14T11:11:01.595 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.596+0000 7f3520526800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.71__shadow_.dPxuGQqo5I9yU8Mj3aaI5ptPNFQ_nwF_0 2024-09-14T11:11:01.595 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.597+0000 7f3520526800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:11:01.598 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.599+0000 7f3520526800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:11:01.599 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.600+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.599 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.601+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:01.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.601+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.601 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.602+0000 7f3520526800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:11:01.602 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.604+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.603 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.604+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:01.603 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.605+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.604 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.606+0000 7f3520526800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:11:01.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.607+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.608+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:01.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.608+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:11:01.607 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.608+0000 7f3520526800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14257118596596409619', time=2024-09-14T13:11:00.458731+0000, chain.objs.size()=1 2024-09-14T11:11:01.607 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.608+0000 7f3520526800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.72__shadow_.vXoYaXw08YAIN-Mpg_YT2gtK5_F8vGN_0 2024-09-14T11:11:01.607 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.609+0000 7f3520526800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:11:01.610 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.611+0000 7f3520526800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:11:01.611 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.612+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.611 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.613+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:01.612 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.613+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.612 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.614+0000 7f3520526800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:11:01.613 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.615+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.614 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.615+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:01.614 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.616+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.615 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.616+0000 7f3520526800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:11:01.616 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.618+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.616 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.618+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:01.617 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.618+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.618 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.619+0000 7f3520526800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:11:01.619 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.621+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.620 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.621+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:01.620 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.622+0000 7f3520526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:01.622 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.624+0000 7f33d2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:01.624 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.626+0000 7f3520526800 20 remove_watcher() i=0 2024-09-14T11:11:01.624 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.626+0000 7f3520526800 2 removed watcher, disabling cache 2024-09-14T11:11:01.625 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.626+0000 7f3520526800 20 remove_watcher() i=1 2024-09-14T11:11:01.626 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.627+0000 7f3520526800 20 remove_watcher() i=2 2024-09-14T11:11:01.627 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.628+0000 7f3520526800 20 remove_watcher() i=3 2024-09-14T11:11:01.628 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.629+0000 7f3520526800 20 remove_watcher() i=4 2024-09-14T11:11:01.629 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.631+0000 7f3520526800 20 remove_watcher() i=5 2024-09-14T11:11:01.630 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.632+0000 7f3520526800 20 remove_watcher() i=6 2024-09-14T11:11:01.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.633+0000 7f3520526800 20 remove_watcher() i=7 2024-09-14T11:11:01.642 DEBUG:teuthology.orchestra.run.smithi097:> radosgw-admin gc process --include-all 2024-09-14T11:11:01.693 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:01.693 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:01.730 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.732+0000 7f6c74d25800 20 rados->read ofs=0 len=0 2024-09-14T11:11:01.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.734+0000 7f6c74d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:01.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.734+0000 7f6c74d25800 20 realm 2024-09-14T11:11:01.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.734+0000 7f6c74d25800 20 rados->read ofs=0 len=0 2024-09-14T11:11:01.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.734+0000 7f6c74d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:01.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.734+0000 7f6c74d25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:01.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.734+0000 7f6c74d25800 20 rados->read ofs=0 len=0 2024-09-14T11:11:01.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.734+0000 7f6c74d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:01.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.734+0000 7f6c74d25800 20 rados->read ofs=0 len=0 2024-09-14T11:11:01.734 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.735+0000 7f6c74d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:01.734 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.735+0000 7f6c74d25800 20 rados->read ofs=0 len=0 2024-09-14T11:11:01.734 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.736+0000 7f6c74d25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:01.735 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.736+0000 7f6c74d25800 20 searching for the correct realm 2024-09-14T11:11:01.736 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.738+0000 7f6c71134640 0 -- 172.21.15.97:0/1354937011 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f6c5802b040 msgr2=0x7f6c5806b2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:11:01.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.943+0000 7f6c68132640 0 -- 172.21.15.97:0/1354937011 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f6c6006be20 msgr2=0x7f6c600158b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:01.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.947+0000 7f6c74d25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:01.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.947+0000 7f6c74d25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:01.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.947+0000 7f6c74d25800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:11:01.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.947+0000 7f6c74d25800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:11:01.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.947+0000 7f6c74d25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:01.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.947+0000 7f6c74d25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:01.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.947+0000 7f6c74d25800 20 rados->read ofs=0 len=0 2024-09-14T11:11:01.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.948+0000 7f6c74d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:01.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.948+0000 7f6c74d25800 20 rados->read ofs=0 len=0 2024-09-14T11:11:01.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.948+0000 7f6c74d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:01.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.948+0000 7f6c74d25800 20 rados->read ofs=0 len=0 2024-09-14T11:11:01.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.948+0000 7f6c74d25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:01.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.948+0000 7f6c74d25800 20 zone default found 2024-09-14T11:11:01.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.948+0000 7f6c74d25800 4 Realm: () 2024-09-14T11:11:01.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.948+0000 7f6c74d25800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:11:01.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.948+0000 7f6c74d25800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:11:01.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.948+0000 7f6c74d25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:01.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.948+0000 7f6c74d25800 20 zonegroup default 2024-09-14T11:11:01.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.948+0000 7f6c74d25800 20 rados->read ofs=0 len=0 2024-09-14T11:11:01.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.949+0000 7f6c74d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:01.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.949+0000 7f6c74d25800 20 rados->read ofs=0 len=0 2024-09-14T11:11:01.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.949+0000 7f6c74d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:01.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.949+0000 7f6c74d25800 20 rados->read ofs=0 len=0 2024-09-14T11:11:01.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.949+0000 7f6c74d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:01.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.949+0000 7f6c74d25800 20 started sync module instance, tier type = 2024-09-14T11:11:01.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.949+0000 7f6c74d25800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:11:01.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.957+0000 7f6c74d25800 20 add_watcher() i=0 2024-09-14T11:11:01.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.957+0000 7f6c74d25800 20 add_watcher() i=1 2024-09-14T11:11:01.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.957+0000 7f6c74d25800 20 add_watcher() i=2 2024-09-14T11:11:01.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.957+0000 7f6c74d25800 20 add_watcher() i=3 2024-09-14T11:11:01.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.957+0000 7f6c74d25800 20 add_watcher() i=4 2024-09-14T11:11:01.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.957+0000 7f6c74d25800 20 add_watcher() i=5 2024-09-14T11:11:01.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.957+0000 7f6c74d25800 20 add_watcher() i=6 2024-09-14T11:11:01.957 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.958+0000 7f6c74d25800 20 add_watcher() i=7 2024-09-14T11:11:01.957 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.958+0000 7f6c74d25800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:01.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.984+0000 7f6b26fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:01.983 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.984+0000 7f6c74d25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:01.983 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:01.984+0000 7f6c74d25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:02.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.019+0000 7f6b25fe3640 20 reqs_thread_entry: start 2024-09-14T11:11:02.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.019+0000 7f6c74d25800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:02.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.019+0000 7f6c74d25800 20 Filter name: none 2024-09-14T11:11:02.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.019+0000 7f6a977fe640 20 reqs_thread_entry: start 2024-09-14T11:11:02.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.019+0000 7f6c74d25800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:11:02.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.020+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.021+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.020 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.021+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.021 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.022+0000 7f6c74d25800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:11:02.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.023+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.024+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.024+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.024 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.025+0000 7f6c74d25800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:11:02.025 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.027+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.027+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.027+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.029+0000 7f6c74d25800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:11:02.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.030+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.030+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.031+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.030 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.032+0000 7f6c74d25800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:11:02.032 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.033+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.032 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.034+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.034+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.034 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.035+0000 7f6c74d25800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:11:02.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.036+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.037+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.037+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.038+0000 7f6c74d25800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:11:02.038 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.039+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.038 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.040+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.038 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.040+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.041+0000 7f6c74d25800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:11:02.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.042+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.042+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.043+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.044+0000 7f6c74d25800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:11:02.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.045+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.045+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.045+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.047+0000 7f6c74d25800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:11:02.046 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.048+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.047 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.048+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.047 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.049+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.048 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.050+0000 7f6c74d25800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:11:02.049 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.051+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.050 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.051+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.050 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.052+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.051 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.053+0000 7f6c74d25800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:11:02.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.054+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.054+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.054+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.055+0000 7f6c74d25800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:11:02.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.057+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.057+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.058+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.057 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.059+0000 7f6c74d25800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:11:02.059 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.060+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.059 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.061+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.059 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.061+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.060 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.062+0000 7f6c74d25800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:11:02.062 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.063+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.062 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.064+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.062 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.064+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.063 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.065+0000 7f6c74d25800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:11:02.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.066+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.067+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.067+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.068+0000 7f6c74d25800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:11:02.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.069+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.070+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.070+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.069 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.071+0000 7f6c74d25800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:11:02.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.072+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.073+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.072 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.073+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.075+0000 7f6c74d25800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:11:02.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.076+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.077+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.077+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.078+0000 7f6c74d25800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:11:02.078 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.079+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.078 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.080+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.078 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.080+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.080 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.081+0000 7f6c74d25800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:11:02.081 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.083+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.082 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.083+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.082 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.084+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.083 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.084+0000 7f6c74d25800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:11:02.084 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.086+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.086+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.087+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.086 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.088+0000 7f6c74d25800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:11:02.087 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.089+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.089+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.090+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.089 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.091+0000 7f6c74d25800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:11:02.090 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.092+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.091 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.092+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.091 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.093+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.092 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.093+0000 7f6c74d25800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:11:02.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.095+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.095+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.094 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.095+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.095 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.096+0000 7f6c74d25800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:11:02.096 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.097+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.096 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.098+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.098+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.099+0000 7f6c74d25800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:11:02.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.101+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.101+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.100 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.101+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.100 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.102+0000 7f6c74d25800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:11:02.102 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.104+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.102 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.104+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.103 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.104+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.105 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.106+0000 7f6c74d25800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:11:02.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.107+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.108+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.107 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.108+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.109+0000 7f6c74d25800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:11:02.109 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.110+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.109 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.111+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.111+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.112+0000 7f6c74d25800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:11:02.112 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.113+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.113 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.114+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.113 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.114+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.113 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.115+0000 7f6c74d25800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:11:02.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.116+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.117+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.117+0000 7f6c74d25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.118 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.119+0000 7f6b26fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:02.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.121+0000 7f6c74d25800 20 remove_watcher() i=0 2024-09-14T11:11:02.120 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.121+0000 7f6c74d25800 2 removed watcher, disabling cache 2024-09-14T11:11:02.121 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.122+0000 7f6c74d25800 20 remove_watcher() i=1 2024-09-14T11:11:02.122 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.123+0000 7f6c74d25800 20 remove_watcher() i=2 2024-09-14T11:11:02.123 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.124+0000 7f6c74d25800 20 remove_watcher() i=3 2024-09-14T11:11:02.124 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.125+0000 7f6c74d25800 20 remove_watcher() i=4 2024-09-14T11:11:02.124 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.126+0000 7f6c74d25800 20 remove_watcher() i=5 2024-09-14T11:11:02.125 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.127+0000 7f6c74d25800 20 remove_watcher() i=6 2024-09-14T11:11:02.126 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.128+0000 7f6c74d25800 20 remove_watcher() i=7 2024-09-14T11:11:02.138 DEBUG:teuthology.orchestra.run.smithi097:> radosgw-admin gc process --include-all 2024-09-14T11:11:02.190 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:02.190 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:02.228 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.229+0000 7f639eb46800 20 rados->read ofs=0 len=0 2024-09-14T11:11:02.229 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.230+0000 7f639eb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:02.229 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.230+0000 7f639eb46800 20 realm 2024-09-14T11:11:02.229 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.230+0000 7f639eb46800 20 rados->read ofs=0 len=0 2024-09-14T11:11:02.229 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.230+0000 7f639eb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:02.229 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.230+0000 7f639eb46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:02.229 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.230+0000 7f639eb46800 20 rados->read ofs=0 len=0 2024-09-14T11:11:02.229 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.230+0000 7f639eb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:02.229 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.230+0000 7f639eb46800 20 rados->read ofs=0 len=0 2024-09-14T11:11:02.230 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.231+0000 7f639eb46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:02.230 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.231+0000 7f639eb46800 20 rados->read ofs=0 len=0 2024-09-14T11:11:02.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.232+0000 7f639eb46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:02.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.232+0000 7f639eb46800 20 searching for the correct realm 2024-09-14T11:11:02.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.234+0000 7f639ce38640 0 -- 172.21.15.97:0/4246178953 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f638407d3f0 msgr2=0x7f638407d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:02.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.438+0000 7f6393e36640 0 -- 172.21.15.97:0/4246178953 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f638c048ca0 msgr2=0x7f638c0974d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:02.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.442+0000 7f639eb46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:02.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.442+0000 7f639eb46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:02.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.442+0000 7f639eb46800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:11:02.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.442+0000 7f639eb46800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:11:02.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.442+0000 7f639eb46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:02.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.442+0000 7f639eb46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:02.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.442+0000 7f639eb46800 20 rados->read ofs=0 len=0 2024-09-14T11:11:02.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.443+0000 7f639eb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:02.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.443+0000 7f639eb46800 20 rados->read ofs=0 len=0 2024-09-14T11:11:02.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.443+0000 7f639eb46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:02.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.443+0000 7f639eb46800 20 rados->read ofs=0 len=0 2024-09-14T11:11:02.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.443+0000 7f639eb46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:02.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.443+0000 7f639eb46800 20 zone default found 2024-09-14T11:11:02.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.443+0000 7f639eb46800 4 Realm: () 2024-09-14T11:11:02.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.443+0000 7f639eb46800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:11:02.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.443+0000 7f639eb46800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:11:02.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.443+0000 7f639eb46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:02.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.443+0000 7f639eb46800 20 zonegroup default 2024-09-14T11:11:02.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.443+0000 7f639eb46800 20 rados->read ofs=0 len=0 2024-09-14T11:11:02.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.443+0000 7f639eb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:02.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.443+0000 7f639eb46800 20 rados->read ofs=0 len=0 2024-09-14T11:11:02.444 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.444+0000 7f639eb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:02.444 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.444+0000 7f639eb46800 20 rados->read ofs=0 len=0 2024-09-14T11:11:02.444 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.444+0000 7f639eb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:02.444 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.444+0000 7f639eb46800 20 started sync module instance, tier type = 2024-09-14T11:11:02.444 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.444+0000 7f639eb46800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:11:02.451 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.452+0000 7f639eb46800 20 add_watcher() i=0 2024-09-14T11:11:02.451 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.452+0000 7f639eb46800 20 add_watcher() i=1 2024-09-14T11:11:02.451 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.452+0000 7f639eb46800 20 add_watcher() i=2 2024-09-14T11:11:02.451 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.452+0000 7f639eb46800 20 add_watcher() i=3 2024-09-14T11:11:02.451 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.452+0000 7f639eb46800 20 add_watcher() i=4 2024-09-14T11:11:02.451 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.452+0000 7f639eb46800 20 add_watcher() i=5 2024-09-14T11:11:02.451 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.452+0000 7f639eb46800 20 add_watcher() i=6 2024-09-14T11:11:02.452 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.453+0000 7f639eb46800 20 add_watcher() i=7 2024-09-14T11:11:02.452 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.453+0000 7f639eb46800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:02.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.454+0000 7f6252fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:02.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.455+0000 7f639eb46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:02.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.455+0000 7f639eb46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:02.488 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.489+0000 7f6251fdb640 20 reqs_thread_entry: start 2024-09-14T11:11:02.488 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.489+0000 7f639eb46800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:02.488 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.489+0000 7f639eb46800 20 Filter name: none 2024-09-14T11:11:02.488 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.489+0000 7f61c37fe640 20 reqs_thread_entry: start 2024-09-14T11:11:02.488 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.489+0000 7f639eb46800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:11:02.489 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.490+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.489 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.491+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.489 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.491+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.490 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.492+0000 7f639eb46800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:11:02.492 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.493+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.492 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.494+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.492 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.494+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.494 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.495+0000 7f639eb46800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:11:02.495 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.497+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.496 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.497+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.496 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.497+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.497 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.498+0000 7f639eb46800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:11:02.498 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.500+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.500+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.500+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.501+0000 7f639eb46800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:11:02.501 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.503+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.502 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.503+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.502 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.504+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.503 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.505+0000 7f639eb46800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:11:02.505 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.506+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.505 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.507+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.506 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.507+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.507 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.508+0000 7f639eb46800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:11:02.508 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.509+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.508 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.510+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.509 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.510+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.510 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.511+0000 7f639eb46800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:11:02.511 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.513+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.511 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.513+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.512 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.513+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.513 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.514+0000 7f639eb46800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:11:02.514 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.516+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.515 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.516+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.515 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.516+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.516 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.517+0000 7f639eb46800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:11:02.518 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.519+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.518 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.520+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.518 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.520+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.521+0000 7f639eb46800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:11:02.521 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.522+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.521 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.523+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.522 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.523+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.523 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.524+0000 7f639eb46800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:11:02.524 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.525+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.524 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.526+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.525 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.526+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.525 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.527+0000 7f639eb46800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:11:02.527 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.528+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.527 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.529+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.528 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.529+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.530+0000 7f639eb46800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:11:02.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.532+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.532+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.532+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.533+0000 7f639eb46800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:11:02.533 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.534+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.533 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.535+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.535+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.536+0000 7f639eb46800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:11:02.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.537+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.538+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.537 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.538+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.538 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.539+0000 7f639eb46800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:11:02.539 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.540+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.539 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.541+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.540 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.541+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.543+0000 7f639eb46800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:11:02.543 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.544+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.543 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.545+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.543 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.545+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.545 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.546+0000 7f639eb46800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:11:02.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.548+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.548+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.548+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.549+0000 7f639eb46800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:11:02.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.551+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.552+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.552+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.553+0000 7f639eb46800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:11:02.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.554+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.555+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.555+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.556+0000 7f639eb46800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:11:02.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.557+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.557 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.558+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.557 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.558+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.558 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.559+0000 7f639eb46800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:11:02.559 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.561+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.560 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.561+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.560 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.561+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.562+0000 7f639eb46800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:11:02.562 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.563+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.562 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.564+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.564+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.565+0000 7f639eb46800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:11:02.565 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.566+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.565 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.567+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.566 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.567+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.567 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.568+0000 7f639eb46800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:11:02.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.569+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.570+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.570+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.571+0000 7f639eb46800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:11:02.570 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.572+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.571 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.572+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.571 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.573+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.572 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.574+0000 7f639eb46800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:11:02.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.575+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.576+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.576+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.577+0000 7f639eb46800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:11:02.577 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.578+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.577 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.579+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.578 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.579+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.579 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.580+0000 7f639eb46800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:11:02.580 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.582+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.581 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.582+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.581 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.583+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.582 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.584+0000 7f639eb46800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:11:02.583 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.585+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.584 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.585+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.584 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.586+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.585 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.586+0000 7f639eb46800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:11:02.586 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.588+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.588+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.588+0000 7f639eb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.589 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.590+0000 7f6252fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:02.590 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.592+0000 7f639eb46800 20 remove_watcher() i=0 2024-09-14T11:11:02.591 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.592+0000 7f639eb46800 2 removed watcher, disabling cache 2024-09-14T11:11:02.591 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.593+0000 7f639eb46800 20 remove_watcher() i=1 2024-09-14T11:11:02.592 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.594+0000 7f639eb46800 20 remove_watcher() i=2 2024-09-14T11:11:02.594 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.596+0000 7f639eb46800 20 remove_watcher() i=3 2024-09-14T11:11:02.595 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.596+0000 7f639eb46800 20 remove_watcher() i=4 2024-09-14T11:11:02.596 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.597+0000 7f639eb46800 20 remove_watcher() i=5 2024-09-14T11:11:02.597 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.598+0000 7f639eb46800 20 remove_watcher() i=6 2024-09-14T11:11:02.598 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.599+0000 7f639eb46800 20 remove_watcher() i=7 2024-09-14T11:11:02.609 DEBUG:teuthology.orchestra.run.smithi097:> radosgw-admin gc process --include-all 2024-09-14T11:11:02.660 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:02.660 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:02.697 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.698+0000 7f7bf4220800 20 rados->read ofs=0 len=0 2024-09-14T11:11:02.699 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.700+0000 7f7bf4220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:02.699 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.700+0000 7f7bf4220800 20 realm 2024-09-14T11:11:02.699 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.700+0000 7f7bf4220800 20 rados->read ofs=0 len=0 2024-09-14T11:11:02.699 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.700+0000 7f7bf4220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:02.699 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.700+0000 7f7bf4220800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:02.699 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.700+0000 7f7bf4220800 20 rados->read ofs=0 len=0 2024-09-14T11:11:02.699 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.700+0000 7f7bf4220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:02.699 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.700+0000 7f7bf4220800 20 rados->read ofs=0 len=0 2024-09-14T11:11:02.700 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.701+0000 7f7bf4220800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:02.700 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.701+0000 7f7bf4220800 20 rados->read ofs=0 len=0 2024-09-14T11:11:02.700 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.702+0000 7f7bf4220800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:02.701 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.702+0000 7f7bf4220800 20 searching for the correct realm 2024-09-14T11:11:02.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.703+0000 7f7bebfff640 0 -- 172.21.15.97:0/4093871882 >> [v2:172.21.15.97:6808/2081705332,v1:172.21.15.97:6809/2081705332] conn(0x7f7be40e3070 msgr2=0x7f7be405a460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:02.705 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.706+0000 7f7bf1d11640 0 -- 172.21.15.97:0/4093871882 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7f7bdc055910 msgr2=0x7f7bdc0143f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:02.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.712+0000 7f7bf4220800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:02.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.712+0000 7f7bf4220800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:02.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.712+0000 7f7bf4220800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:11:02.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.712+0000 7f7bf4220800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:11:02.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.712+0000 7f7bf4220800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:02.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.712+0000 7f7bf4220800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:02.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.712+0000 7f7bf4220800 20 rados->read ofs=0 len=0 2024-09-14T11:11:02.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.712+0000 7f7bf4220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:02.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.712+0000 7f7bf4220800 20 rados->read ofs=0 len=0 2024-09-14T11:11:02.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.712+0000 7f7bf4220800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:02.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.712+0000 7f7bf4220800 20 rados->read ofs=0 len=0 2024-09-14T11:11:02.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.712+0000 7f7bf4220800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:02.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.712+0000 7f7bf4220800 20 zone default found 2024-09-14T11:11:02.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.712+0000 7f7bf4220800 4 Realm: () 2024-09-14T11:11:02.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.712+0000 7f7bf4220800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:11:02.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.712+0000 7f7bf4220800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:11:02.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.712+0000 7f7bf4220800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:02.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.712+0000 7f7bf4220800 20 zonegroup default 2024-09-14T11:11:02.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.712+0000 7f7bf4220800 20 rados->read ofs=0 len=0 2024-09-14T11:11:02.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.713+0000 7f7bf4220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:02.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.713+0000 7f7bf4220800 20 rados->read ofs=0 len=0 2024-09-14T11:11:02.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.713+0000 7f7bf4220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:02.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.713+0000 7f7bf4220800 20 rados->read ofs=0 len=0 2024-09-14T11:11:02.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.714+0000 7f7bf4220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:02.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.714+0000 7f7bf4220800 20 started sync module instance, tier type = 2024-09-14T11:11:02.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.714+0000 7f7bf4220800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:11:02.721 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.722+0000 7f7bf4220800 20 add_watcher() i=0 2024-09-14T11:11:02.721 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.722+0000 7f7bf4220800 20 add_watcher() i=1 2024-09-14T11:11:02.721 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.722+0000 7f7bf4220800 20 add_watcher() i=2 2024-09-14T11:11:02.721 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.722+0000 7f7bf4220800 20 add_watcher() i=3 2024-09-14T11:11:02.721 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.722+0000 7f7bf4220800 20 add_watcher() i=4 2024-09-14T11:11:02.721 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.722+0000 7f7bf4220800 20 add_watcher() i=5 2024-09-14T11:11:02.721 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.722+0000 7f7bf4220800 20 add_watcher() i=6 2024-09-14T11:11:02.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.723+0000 7f7bf4220800 20 add_watcher() i=7 2024-09-14T11:11:02.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.723+0000 7f7bf4220800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:02.723 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.725+0000 7f7aa3fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:02.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.725+0000 7f7bf4220800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:02.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.725+0000 7f7bf4220800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:02.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.764+0000 7f7aa2ffd640 20 reqs_thread_entry: start 2024-09-14T11:11:02.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.764+0000 7f7bf4220800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:02.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.764+0000 7f7bf4220800 20 Filter name: none 2024-09-14T11:11:02.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.765+0000 7f7aa0ff9640 20 reqs_thread_entry: start 2024-09-14T11:11:02.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.765+0000 7f7bf4220800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:11:02.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.767+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.767+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.768+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.769+0000 7f7bf4220800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:11:02.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.770+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.769 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.770+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.769 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.770+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.770 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.771+0000 7f7bf4220800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:11:02.771 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.772+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.771 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.773+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.772 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.773+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.772 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.774+0000 7f7bf4220800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:11:02.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.775+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.776+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.776+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.777+0000 7f7bf4220800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:11:02.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.778+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.779+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.779+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.780+0000 7f7bf4220800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:11:02.780 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.781+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.780 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.782+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.780 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.782+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.783+0000 7f7bf4220800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:11:02.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.784+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.785+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.785+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.786+0000 7f7bf4220800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:11:02.786 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.787+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.786 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.788+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.786 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.788+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.787 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.789+0000 7f7bf4220800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:11:02.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.790+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.791+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.791+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.792+0000 7f7bf4220800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:11:02.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.793+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.794+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.794+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.793 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.795+0000 7f7bf4220800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:11:02.795 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.796+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.795 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.797+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.797+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.798+0000 7f7bf4220800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:11:02.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.800+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.800+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.800+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.800 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.801+0000 7f7bf4220800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:11:02.801 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.803+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.803+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.803+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.803 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.804+0000 7f7bf4220800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:11:02.804 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.805+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.804 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.806+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.805 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.806+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.805 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.807+0000 7f7bf4220800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:11:02.807 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.808+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.807 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.809+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.807 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.809+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.809 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.810+0000 7f7bf4220800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:11:02.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.811+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.812+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.812+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.812 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.813+0000 7f7bf4220800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:11:02.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.814+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.815+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.815+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.815 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.816+0000 7f7bf4220800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:11:02.816 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.818+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.817 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.818+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.817 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.818+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.818 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.820+0000 7f7bf4220800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:11:02.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.821+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.820 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.821+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.820 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.822+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.821 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.823+0000 7f7bf4220800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:11:02.822 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.824+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.824+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.825+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.826+0000 7f7bf4220800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:11:02.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.827+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.828+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.828+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.829+0000 7f7bf4220800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:11:02.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.831+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.831 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.832+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.831 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.832+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.832 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.833+0000 7f7bf4220800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:11:02.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.835+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.834 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.835+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.834 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.835+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.834 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.836+0000 7f7bf4220800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:11:02.836 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.837+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.837 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.838+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.837 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.838+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.838 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.839+0000 7f7bf4220800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:11:02.839 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.841+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.840 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.841+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.840 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.841+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.841 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.843+0000 7f7bf4220800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:11:02.842 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.844+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.843 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.844+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.843 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.844+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.844 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.845+0000 7f7bf4220800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:11:02.846 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.847+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.846 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.847+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.846 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.848+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.849+0000 7f7bf4220800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:11:02.849 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.850+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.849 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.851+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.849 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.851+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.850 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.852+0000 7f7bf4220800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:11:02.851 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.853+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.854+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.854+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.855+0000 7f7bf4220800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:11:02.855 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.856+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.855 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.857+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.855 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.857+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.858+0000 7f7bf4220800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:11:02.858 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.859+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.858 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.860+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.859 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.860+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.859 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.861+0000 7f7bf4220800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:11:02.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.862+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.863+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:02.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.863+0000 7f7bf4220800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:02.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.864+0000 7f7aa3fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:02.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.867+0000 7f7bf4220800 20 remove_watcher() i=0 2024-09-14T11:11:02.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.867+0000 7f7bf4220800 2 removed watcher, disabling cache 2024-09-14T11:11:02.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.868+0000 7f7bf4220800 20 remove_watcher() i=1 2024-09-14T11:11:02.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.869+0000 7f7bf4220800 20 remove_watcher() i=2 2024-09-14T11:11:02.868 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.869+0000 7f7bf4220800 20 remove_watcher() i=3 2024-09-14T11:11:02.869 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.870+0000 7f7bf4220800 20 remove_watcher() i=4 2024-09-14T11:11:02.870 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.871+0000 7f7bf4220800 20 remove_watcher() i=5 2024-09-14T11:11:02.871 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.872+0000 7f7bf4220800 20 remove_watcher() i=6 2024-09-14T11:11:02.872 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:02.873+0000 7f7bf4220800 20 remove_watcher() i=7 2024-09-14T11:11:02.883 DEBUG:teuthology.orchestra.run.smithi097:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-09-14T11:11:03.373 INFO:teuthology.orchestra.run.smithi097.stdout:> Task :clean 2024-09-14T11:11:04.068 INFO:teuthology.orchestra.run.smithi097.stdout:> Task :compileJava 2024-09-14T11:11:04.068 INFO:teuthology.orchestra.run.smithi097.stdout:> Task :processResources 2024-09-14T11:11:04.069 INFO:teuthology.orchestra.run.smithi097.stdout:> Task :classes 2024-09-14T11:11:04.568 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:04.569 INFO:teuthology.orchestra.run.smithi097.stdout:> Task :compileTestJava 2024-09-14T11:11:04.569 INFO:teuthology.orchestra.run.smithi097.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-14T11:11:04.569 INFO:teuthology.orchestra.run.smithi097.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-14T11:11:04.570 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:04.570 INFO:teuthology.orchestra.run.smithi097.stdout:> Task :processTestResources NO-SOURCE 2024-09-14T11:11:04.570 INFO:teuthology.orchestra.run.smithi097.stdout:> Task :testClasses 2024-09-14T11:11:06.570 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:06.570 INFO:teuthology.orchestra.run.smithi097.stdout:> Task :test 2024-09-14T11:11:06.570 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:06.570 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests STANDARD_OUT 2024-09-14T11:11:06.570 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14 11:11:05,751 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-14T11:11:06.570 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:06.570 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-09-14T11:11:06.570 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:06.570 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-09-14T11:11:06.571 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:06.571 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-09-14T11:11:06.571 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:06.571 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-09-14T11:11:06.571 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:06.571 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-09-14T11:11:06.571 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:06.571 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-09-14T11:11:06.768 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:06.768 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-09-14T11:11:07.768 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:07.768 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-09-14T11:11:07.968 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:07.968 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-09-14T11:11:07.968 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:07.969 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-09-14T11:11:08.170 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:08.258 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-09-14T11:11:08.272 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:08.272 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-09-14T11:11:08.468 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:08.468 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-09-14T11:11:08.469 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:08.469 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-09-14T11:11:08.568 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:08.568 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-09-14T11:11:08.569 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:08.569 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-09-14T11:11:08.768 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:08.768 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-09-14T11:11:08.968 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:08.969 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-09-14T11:11:09.168 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:09.168 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-09-14T11:11:09.168 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:09.169 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-09-14T11:11:09.368 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:09.368 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-09-14T11:11:09.368 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:09.369 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-09-14T11:11:09.568 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:09.568 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-09-14T11:11:09.668 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:09.668 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-09-14T11:11:09.868 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:09.869 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-09-14T11:11:09.869 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:09.869 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-09-14T11:11:10.068 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:10.069 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-09-14T11:11:10.168 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:10.168 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-09-14T11:11:10.368 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:10.368 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-09-14T11:11:10.369 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:10.369 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-09-14T11:11:10.568 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:10.568 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-09-14T11:11:10.668 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:10.668 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-09-14T11:11:10.868 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:10.868 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-09-14T11:11:11.268 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:11.268 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-09-14T11:11:11.568 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:11.568 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-09-14T11:11:15.768 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:15.768 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-09-14T11:11:16.068 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:16.068 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-09-14T11:11:16.068 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:16.068 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-09-14T11:11:16.268 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:16.268 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-09-14T11:11:16.368 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:16.368 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-09-14T11:11:16.668 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:16.668 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-09-14T11:11:17.168 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:17.168 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-09-14T11:11:17.368 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:17.368 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-09-14T11:11:17.368 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:17.368 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-09-14T11:11:17.468 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:17.468 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-09-14T11:11:18.369 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:18.369 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-09-14T11:11:18.468 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:18.468 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-09-14T11:11:18.868 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:18.868 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-09-14T11:11:19.068 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:19.068 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-09-14T11:11:19.468 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:19.468 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-09-14T11:11:19.668 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:19.668 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-09-14T11:11:22.668 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:22.668 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-09-14T11:11:22.868 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:22.868 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-09-14T11:11:23.768 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:23.768 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-09-14T11:11:23.968 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:23.968 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-09-14T11:11:24.368 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:24.368 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-09-14T11:11:24.568 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:24.568 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-09-14T11:11:24.968 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:24.968 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-09-14T11:11:25.368 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:25.368 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-09-14T11:11:25.468 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:25.468 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-09-14T11:11:25.468 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:25.468 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-09-14T11:11:25.568 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:25.568 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-09-14T11:11:25.768 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:25.768 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-09-14T11:11:25.768 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:25.768 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-09-14T11:11:25.968 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:25.968 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-09-14T11:11:26.068 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:26.068 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-09-14T11:11:26.268 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:26.268 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-09-14T11:11:26.268 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:26.268 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-09-14T11:11:26.468 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:26.468 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-09-14T11:11:26.568 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:26.568 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-09-14T11:11:26.768 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:26.769 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-09-14T11:11:26.769 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:26.769 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-09-14T11:11:26.968 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:26.968 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-09-14T11:11:27.068 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:27.068 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-09-14T11:11:27.268 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:27.268 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-09-14T11:11:27.368 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:27.368 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-09-14T11:11:27.568 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:27.568 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-09-14T11:11:27.668 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:27.668 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-09-14T11:11:27.868 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:27.868 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-09-14T11:11:27.968 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:27.968 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-09-14T11:11:28.168 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:28.168 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-09-14T11:11:28.268 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:28.268 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-09-14T11:11:28.468 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:28.468 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-09-14T11:11:28.468 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:28.468 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-09-14T11:11:28.768 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:28.768 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-09-14T11:11:28.768 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:28.768 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-09-14T11:11:29.068 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:29.068 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-09-14T11:11:29.069 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:29.069 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-09-14T11:11:29.368 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:29.368 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-09-14T11:11:29.368 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:29.368 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-09-14T11:11:29.568 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:29.568 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-09-14T11:11:29.668 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:29.668 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-09-14T11:11:29.868 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:29.868 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-09-14T11:11:29.968 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:29.968 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-09-14T11:11:30.168 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:30.168 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-09-14T11:11:30.268 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:30.268 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-09-14T11:11:30.468 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:30.468 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-09-14T11:11:30.568 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:30.568 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-09-14T11:11:30.768 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:30.768 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-09-14T11:11:30.768 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:30.768 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-09-14T11:11:31.068 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:31.068 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-09-14T11:11:31.069 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:31.069 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-09-14T11:11:31.368 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:31.368 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-09-14T11:11:31.368 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:31.368 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-09-14T11:11:31.668 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:31.668 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-09-14T11:11:31.668 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:31.668 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-09-14T11:11:31.868 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:31.868 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-09-14T11:11:31.968 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:31.968 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-09-14T11:11:32.168 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:32.168 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-09-14T11:11:32.268 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:32.268 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-09-14T11:11:32.468 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:32.468 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-09-14T11:11:32.568 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:32.568 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-09-14T11:11:32.768 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:32.768 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-09-14T11:11:32.868 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:32.868 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-09-14T11:11:33.068 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:33.068 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-09-14T11:11:33.168 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:33.168 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-09-14T11:11:33.368 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:33.368 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-09-14T11:11:33.368 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:33.368 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-09-14T11:11:33.568 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:33.568 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-09-14T11:11:33.668 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:33.668 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-09-14T11:11:33.868 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:33.868 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-09-14T11:11:33.868 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:33.868 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-09-14T11:11:34.068 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:34.068 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-09-14T11:11:34.068 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:34.068 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-09-14T11:11:34.268 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:34.268 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-09-14T11:11:34.367 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:34.368 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-09-14T11:11:34.568 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:34.568 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-09-14T11:11:34.668 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:34.668 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-09-14T11:11:34.668 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:34.668 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-09-14T11:11:34.768 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:34.768 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-09-14T11:11:34.968 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:34.968 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-09-14T11:11:35.068 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:35.068 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-09-14T11:11:35.268 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:35.268 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-09-14T11:11:35.368 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:35.368 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-09-14T11:11:35.568 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:35.568 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-09-14T11:11:35.668 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:35.668 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-09-14T11:11:35.868 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:35.868 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-09-14T11:11:36.068 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:36.068 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-09-14T11:11:36.268 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:36.268 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-09-14T11:11:36.668 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:36.668 INFO:teuthology.orchestra.run.smithi097.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-09-14T11:11:36.842 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:36.842 INFO:teuthology.orchestra.run.smithi097.stdout:---------------------------------------------------------------------- 2024-09-14T11:11:36.843 INFO:teuthology.orchestra.run.smithi097.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-09-14T11:11:36.843 INFO:teuthology.orchestra.run.smithi097.stdout:---------------------------------------------------------------------- 2024-09-14T11:11:36.843 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:36.843 INFO:teuthology.orchestra.run.smithi097.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-14T11:11:36.843 INFO:teuthology.orchestra.run.smithi097.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-14T11:11:36.843 INFO:teuthology.orchestra.run.smithi097.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-14T11:11:36.843 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:36.843 INFO:teuthology.orchestra.run.smithi097.stdout:BUILD SUCCESSFUL in 33s 2024-09-14T11:11:36.843 INFO:teuthology.orchestra.run.smithi097.stdout:5 actionable tasks: 5 executed 2024-09-14T11:11:36.858 DEBUG:teuthology.orchestra.run.smithi097:> radosgw-admin gc process --include-all 2024-09-14T11:11:36.911 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:36.912 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:36.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:36.950+0000 7fc90fc63800 20 rados->read ofs=0 len=0 2024-09-14T11:11:36.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:36.952+0000 7fc90fc63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:36.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:36.952+0000 7fc90fc63800 20 realm 2024-09-14T11:11:36.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:36.952+0000 7fc90fc63800 20 rados->read ofs=0 len=0 2024-09-14T11:11:36.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:36.952+0000 7fc90fc63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:36.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:36.952+0000 7fc90fc63800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:36.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:36.952+0000 7fc90fc63800 20 rados->read ofs=0 len=0 2024-09-14T11:11:36.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:36.952+0000 7fc90fc63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:36.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:36.952+0000 7fc90fc63800 20 rados->read ofs=0 len=0 2024-09-14T11:11:36.952 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:36.953+0000 7fc90fc63800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:36.952 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:36.953+0000 7fc90fc63800 20 rados->read ofs=0 len=0 2024-09-14T11:11:36.953 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:36.954+0000 7fc90fc63800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:36.953 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:36.954+0000 7fc90fc63800 20 searching for the correct realm 2024-09-14T11:11:36.955 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:36.956+0000 7fc90df55640 0 -- 172.21.15.97:0/3238483566 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7fc8f80e5110 msgr2=0x7fc8f80ab800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:37.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.161+0000 7fc904f53640 0 -- 172.21.15.97:0/3238483566 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7fc90006c880 msgr2=0x7fc900085280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:37.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.166+0000 7fc90fc63800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:37.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.166+0000 7fc90fc63800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:37.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.166+0000 7fc90fc63800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:11:37.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.166+0000 7fc90fc63800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:11:37.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.166+0000 7fc90fc63800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:37.166 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.166+0000 7fc90fc63800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:37.166 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.166+0000 7fc90fc63800 20 rados->read ofs=0 len=0 2024-09-14T11:11:37.166 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.167+0000 7fc90fc63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:37.166 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.167+0000 7fc90fc63800 20 rados->read ofs=0 len=0 2024-09-14T11:11:37.167 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.167+0000 7fc90fc63800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:37.167 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.167+0000 7fc90fc63800 20 rados->read ofs=0 len=0 2024-09-14T11:11:37.167 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.167+0000 7fc90fc63800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:37.167 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.167+0000 7fc90fc63800 20 zone default found 2024-09-14T11:11:37.167 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.167+0000 7fc90fc63800 4 Realm: () 2024-09-14T11:11:37.167 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.167+0000 7fc90fc63800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:11:37.167 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.167+0000 7fc90fc63800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:11:37.168 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.167+0000 7fc90fc63800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:37.168 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.167+0000 7fc90fc63800 20 zonegroup default 2024-09-14T11:11:37.168 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.167+0000 7fc90fc63800 20 rados->read ofs=0 len=0 2024-09-14T11:11:37.168 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.168+0000 7fc90fc63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:37.168 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.168+0000 7fc90fc63800 20 rados->read ofs=0 len=0 2024-09-14T11:11:37.168 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.168+0000 7fc90fc63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:37.168 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.168+0000 7fc90fc63800 20 rados->read ofs=0 len=0 2024-09-14T11:11:37.168 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.168+0000 7fc90fc63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:37.168 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.168+0000 7fc90fc63800 20 started sync module instance, tier type = 2024-09-14T11:11:37.168 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.168+0000 7fc90fc63800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:11:37.177 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.178+0000 7fc90fc63800 20 add_watcher() i=0 2024-09-14T11:11:37.177 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.178+0000 7fc90fc63800 20 add_watcher() i=1 2024-09-14T11:11:37.177 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.178+0000 7fc90fc63800 20 add_watcher() i=2 2024-09-14T11:11:37.177 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.178+0000 7fc90fc63800 20 add_watcher() i=3 2024-09-14T11:11:37.177 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.178+0000 7fc90fc63800 20 add_watcher() i=4 2024-09-14T11:11:37.177 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.178+0000 7fc90fc63800 20 add_watcher() i=5 2024-09-14T11:11:37.177 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.178+0000 7fc90fc63800 20 add_watcher() i=6 2024-09-14T11:11:37.178 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.179+0000 7fc90fc63800 20 add_watcher() i=7 2024-09-14T11:11:37.178 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.179+0000 7fc90fc63800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:37.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.181+0000 7fc7c3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:37.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.182+0000 7fc90fc63800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:37.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.182+0000 7fc90fc63800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:37.218 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.219+0000 7fc7c2fe5640 20 reqs_thread_entry: start 2024-09-14T11:11:37.218 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.219+0000 7fc90fc63800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:37.218 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.219+0000 7fc90fc63800 20 Filter name: none 2024-09-14T11:11:37.218 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.219+0000 7fc7c0fe1640 20 reqs_thread_entry: start 2024-09-14T11:11:37.218 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.219+0000 7fc90fc63800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:11:37.219 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.220+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.219 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.221+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:37.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.221+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:11:37.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.221+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13226906961722443616', time=2024-09-14T13:11:15.804025+0000, chain.objs.size()=4 2024-09-14T11:11:37.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.221+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.93__shadow_.AZqHyfE6IzlluXA3qvh8W2E_BwAhp4q_0 2024-09-14T11:11:37.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.221+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.93__shadow_.AZqHyfE6IzlluXA3qvh8W2E_BwAhp4q_1 2024-09-14T11:11:37.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.221+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.93__shadow_.AZqHyfE6IzlluXA3qvh8W2E_BwAhp4q_2 2024-09-14T11:11:37.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.221+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.93__shadow_.AZqHyfE6IzlluXA3qvh8W2E_BwAhp4q_3 2024-09-14T11:11:37.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.221+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8655343763716066758', time=2024-09-14T13:11:22.740940+0000, chain.objs.size()=5 2024-09-14T11:11:37.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.221+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.102__multipart_key1.2~4aacqq15TIQAutm0_zwf5Koz2ku9LWB.1 2024-09-14T11:11:37.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.221+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.102__shadow_key1.2~4aacqq15TIQAutm0_zwf5Koz2ku9LWB.1_1 2024-09-14T11:11:37.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.221+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.102__multipart_key1.2~4aacqq15TIQAutm0_zwf5Koz2ku9LWB.2 2024-09-14T11:11:37.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.221+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.102__shadow_key1.2~4aacqq15TIQAutm0_zwf5Koz2ku9LWB.2_1 2024-09-14T11:11:37.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.221+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.102__multipart_key1.2~4aacqq15TIQAutm0_zwf5Koz2ku9LWB.3 2024-09-14T11:11:37.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.221+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10660180045099889121', time=2024-09-14T13:11:27.096689+0000, chain.objs.size()=1 2024-09-14T11:11:37.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.221+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.112__shadow_.7KKRrNUdhynCWPbvx6nOaPmpIx3gUOh_0 2024-09-14T11:11:37.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.221+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4074212566420816860', time=2024-09-14T13:11:28.274073+0000, chain.objs.size()=1 2024-09-14T11:11:37.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.221+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.116__shadow_.fioPAtQ5AMUT-4Rw-s8ixUihXOGOCNg_0 2024-09-14T11:11:37.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.223+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.365265562470067145', time=2024-09-14T13:11:33.176439+0000, chain.objs.size()=1 2024-09-14T11:11:37.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.223+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.133__shadow_.krGIWLCRu9gDRMy7Xj8PfLhj6SUPInz_0 2024-09-14T11:11:37.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.227+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:11:37.227 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.229+0000 7fc90fc63800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:11:37.229 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.230+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.229 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.231+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:37.230 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.231+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:11:37.230 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.231+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15641150181317832441', time=2024-09-14T13:11:28.264434+0000, chain.objs.size()=1 2024-09-14T11:11:37.230 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.231+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.116__shadow_.LgVyxBhb-7CM7u1txqXFwwTSZcpu_v8_0 2024-09-14T11:11:37.230 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.231+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10940697970400333001', time=2024-09-14T13:11:32.041513+0000, chain.objs.size()=1 2024-09-14T11:11:37.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.231+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.129__shadow_.6MwRNpRMD5NNKeDgRVz7IqDPza0N_04_0 2024-09-14T11:11:37.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.231+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6884896543844341606', time=2024-09-14T13:11:33.885270+0000, chain.objs.size()=1 2024-09-14T11:11:37.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.231+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.136__shadow_.XeT0Otm88fNFBeLPoOoyusrqrzyF9E5_0 2024-09-14T11:11:37.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.231+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14572524348250827560', time=2024-09-14T13:11:35.073489+0000, chain.objs.size()=1 2024-09-14T11:11:37.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.231+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.140__shadow_.jW6deRCSLK58KgyXFKXKbjuhg-t6Tv7_0 2024-09-14T11:11:37.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.231+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11020810627276937516', time=2024-09-14T13:11:36.675232+0000, chain.objs.size()=5 2024-09-14T11:11:37.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.231+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.144__multipart_key1/data/file.mpg.2~LtUqTyyDqw_rRfMWYS5K9c3xYLgcYSF.1 2024-09-14T11:11:37.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.231+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.144__multipart_key1/data/file.mpg.2~LtUqTyyDqw_rRfMWYS5K9c3xYLgcYSF.2 2024-09-14T11:11:37.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.231+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.144__multipart_key1/data/file.mpg.2~LtUqTyyDqw_rRfMWYS5K9c3xYLgcYSF.3 2024-09-14T11:11:37.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.231+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.144__multipart_key1/data/file.mpg.2~LtUqTyyDqw_rRfMWYS5K9c3xYLgcYSF.4 2024-09-14T11:11:37.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.231+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.144__multipart_key1/data/file.mpg.2~LtUqTyyDqw_rRfMWYS5K9c3xYLgcYSF.5 2024-09-14T11:11:37.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.235+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:11:37.235 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.237+0000 7fc90fc63800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:11:37.238 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.240+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.240+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:37.239 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.241+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:11:37.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.241+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15682626925612095386', time=2024-09-14T13:11:27.982464+0000, chain.objs.size()=1 2024-09-14T11:11:37.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.241+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.115__shadow_.Ks7Y2y_zPF0xwmLPOmgThz3BQGFQ9zz_0 2024-09-14T11:11:37.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.241+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13311549807312445034', time=2024-09-14T13:11:36.681413+0000, chain.objs.size()=1 2024-09-14T11:11:37.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.241+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.144__shadow_.Ej5sj9cSJYXl78-00bk6QbTPIKFw8Mw_0 2024-09-14T11:11:37.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.242+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:11:37.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.244+0000 7fc90fc63800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:11:37.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.246+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.247+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:37.246 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.247+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-14T11:11:37.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.247+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15760124609841921895', time=2024-09-14T13:11:17.171590+0000, chain.objs.size()=5 2024-09-14T11:11:37.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.247+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.98__multipart_key1.2~Vpdk541QZYkV-JwM_NLfAnfyHdIsm0S.1 2024-09-14T11:11:37.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.247+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.98__multipart_key1.2~Vpdk541QZYkV-JwM_NLfAnfyHdIsm0S.2 2024-09-14T11:11:37.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.247+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.98__multipart_key1.2~Vpdk541QZYkV-JwM_NLfAnfyHdIsm0S.3 2024-09-14T11:11:37.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.247+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.98__multipart_key1.2~Vpdk541QZYkV-JwM_NLfAnfyHdIsm0S.4 2024-09-14T11:11:37.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.247+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.98__multipart_key1.2~Vpdk541QZYkV-JwM_NLfAnfyHdIsm0S.5 2024-09-14T11:11:37.247 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.247+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='2~_pGFSt2gs-TZAgY4Qd5R_FNDtiGc5ag', time=2024-09-14T13:11:19.519871+0000, chain.objs.size()=5 2024-09-14T11:11:37.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.247+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.101__multipart_key1.2~_pGFSt2gs-TZAgY4Qd5R_FNDtiGc5ag.7 2024-09-14T11:11:37.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.247+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.101__multipart_key1.2~_pGFSt2gs-TZAgY4Qd5R_FNDtiGc5ag.8 2024-09-14T11:11:37.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.247+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.101__multipart_key1.2~_pGFSt2gs-TZAgY4Qd5R_FNDtiGc5ag.9 2024-09-14T11:11:37.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.247+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.101__multipart_key1.2~_pGFSt2gs-TZAgY4Qd5R_FNDtiGc5ag.10 2024-09-14T11:11:37.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.247+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.101__multipart_key1.2~_pGFSt2gs-TZAgY4Qd5R_FNDtiGc5ag.11 2024-09-14T11:11:37.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.247+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2595215500866284056', time=2024-09-14T13:11:27.396479+0000, chain.objs.size()=1 2024-09-14T11:11:37.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.247+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.113__shadow_.0SrNaIVDqb4rTLqi5F_cZYrkamslLBQ_0 2024-09-14T11:11:37.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.247+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12247192593108643944', time=2024-09-14T13:11:28.856890+0000, chain.objs.size()=1 2024-09-14T11:11:37.248 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.247+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.118__shadow_.tpzVpO2zhPfQOKfu8IKSo2KG2F87BpZ_0 2024-09-14T11:11:37.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.250+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16586017242616205256', time=2024-09-14T13:11:30.017805+0000, chain.objs.size()=1 2024-09-14T11:11:37.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.250+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.122__shadow_.3zaF-jkpFO1hyYJbrjs1aMLKJdqOpYD_0 2024-09-14T11:11:37.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.250+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4577242555014733085', time=2024-09-14T13:11:30.856470+0000, chain.objs.size()=1 2024-09-14T11:11:37.249 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.250+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.125__shadow_.5raQ80AsCtfRBYOmDoHam80Ib3AQPrQ_0 2024-09-14T11:11:37.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.258+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:11:37.259 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.260+0000 7fc90fc63800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:11:37.260 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.261+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.260 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.262+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:37.261 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.262+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:11:37.261 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.262+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11457923581239589038', time=2024-09-14T13:11:28.842308+0000, chain.objs.size()=1 2024-09-14T11:11:37.261 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.262+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.118__shadow_.XtQKrJKOuyWzeNIoe_3DKwW8FAxWXtj_0 2024-09-14T11:11:37.261 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.262+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4032380058611474511', time=2024-09-14T13:11:31.446619+0000, chain.objs.size()=1 2024-09-14T11:11:37.261 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.262+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.127__shadow_.-fM1XkXTtZcqy1sFHZTk8ZiXmojUHvz_0 2024-09-14T11:11:37.262 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.264+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:11:37.266 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.267+0000 7fc90fc63800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:11:37.269 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.270+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.269 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.271+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:37.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.271+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:11:37.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.271+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18367275593954134206', time=2024-09-14T13:11:27.687801+0000, chain.objs.size()=1 2024-09-14T11:11:37.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.271+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.114__shadow_.Crrg40Wpnzn3-cHoFdxRhQ7uS0p_wFI_0 2024-09-14T11:11:37.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.272+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10319350935383531029', time=2024-09-14T13:11:30.022689+0000, chain.objs.size()=1 2024-09-14T11:11:37.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.272+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.122__shadow_.s7ZYD8bockwJRUgLgnY5BMKp0Nx7i0z_0 2024-09-14T11:11:37.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.272+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4239750566512518733', time=2024-09-14T13:11:31.749670+0000, chain.objs.size()=1 2024-09-14T11:11:37.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.272+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.128__shadow_.2xKkzxm9kxhuTDB6ynPWpXGpMN8LG3W_0 2024-09-14T11:11:37.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.273+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:11:37.273 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.275+0000 7fc90fc63800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:11:37.275 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.276+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.275 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.276+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:37.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.277+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:11:37.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.277+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11299910716943214988', time=2024-09-14T13:11:18.886774+0000, chain.objs.size()=1 2024-09-14T11:11:37.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.277+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.100__shadow_.1lifEemnKOIP7UOvpoHpic1ED5jxN31_0 2024-09-14T11:11:37.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.277+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8769808619531141721', time=2024-09-14T13:11:22.603904+0000, chain.objs.size()=5 2024-09-14T11:11:37.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.277+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.102__multipart_key1.2~7T68Vj6Pj8Deim-8j_UzT1qeKZaBk5A.1 2024-09-14T11:11:37.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.277+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.102__shadow_key1.2~7T68Vj6Pj8Deim-8j_UzT1qeKZaBk5A.1_1 2024-09-14T11:11:37.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.277+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.102__multipart_key1.2~7T68Vj6Pj8Deim-8j_UzT1qeKZaBk5A.2 2024-09-14T11:11:37.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.277+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.102__shadow_key1.2~7T68Vj6Pj8Deim-8j_UzT1qeKZaBk5A.2_1 2024-09-14T11:11:37.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.277+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.102__multipart_key1.2~7T68Vj6Pj8Deim-8j_UzT1qeKZaBk5A.3 2024-09-14T11:11:37.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.277+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1374325780328463966', time=2024-09-14T13:11:25.574192+0000, chain.objs.size()=1 2024-09-14T11:11:37.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.277+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.106__shadow_.bTj7Vc4Tu4fSi6y8COYb7zVzdFb3AAa_0 2024-09-14T11:11:37.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.280+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:11:37.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.282+0000 7fc90fc63800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:11:37.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.283+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.283+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:37.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.284+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:11:37.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.284+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7433010673763710896', time=2024-09-14T13:11:18.871563+0000, chain.objs.size()=1 2024-09-14T11:11:37.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.284+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.100__shadow_.56ktYXZYeMnfxIcMWoGwdYXgkoQIzGY_0 2024-09-14T11:11:37.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.284+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14232767629393249943', time=2024-09-14T13:11:27.385315+0000, chain.objs.size()=1 2024-09-14T11:11:37.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.284+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.113__shadow_.-fAiswdNaIHvYMQJs5cm5zHzpIEZXeQ_0 2024-09-14T11:11:37.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.284+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3754346787040301979', time=2024-09-14T13:11:30.292936+0000, chain.objs.size()=1 2024-09-14T11:11:37.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.284+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.123__shadow_.7M-8Il2lUZ8SRUiQzS5YJyUj8eyzwc5_0 2024-09-14T11:11:37.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.284+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10674750835674384839', time=2024-09-14T13:11:30.867055+0000, chain.objs.size()=1 2024-09-14T11:11:37.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.284+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.125__shadow_.HpYeh2SOrX-maov5D9FC0mTziQ4cy1J_0 2024-09-14T11:11:37.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.284+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7475697216733239521', time=2024-09-14T13:11:34.242931+0000, chain.objs.size()=1 2024-09-14T11:11:37.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.284+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.138__shadow_.hi79mM621UpZ1mjfCVT2bRJvVKGN-Ql_0 2024-09-14T11:11:37.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.285+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:11:37.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.288+0000 7fc90fc63800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:11:37.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.289+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.289+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:37.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.290+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:11:37.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.290+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2322531861231397779', time=2024-09-14T13:11:08.312873+0000, chain.objs.size()=1 2024-09-14T11:11:37.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.290+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.81__shadow_.pTZuTnS-ojavhW8iEHzBB2AFR8V-vlA_0 2024-09-14T11:11:37.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.290+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4548524439480085525', time=2024-09-14T13:11:23.243993+0000, chain.objs.size()=1 2024-09-14T11:11:37.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.290+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.103__shadow_.cXd5Uq3F5sAhpStEfoMwSeEU0LpKiAP_0 2024-09-14T11:11:37.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.290+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15071197657577981082', time=2024-09-14T13:11:32.024303+0000, chain.objs.size()=1 2024-09-14T11:11:37.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.290+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.129__shadow_.B1Fo3m13RVxo9RVqCb1FG5qWqyP54q6_0 2024-09-14T11:11:37.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.290+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15922895566337267473', time=2024-09-14T13:11:32.896535+0000, chain.objs.size()=1 2024-09-14T11:11:37.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.290+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.132__shadow_.HXf3-ElSWGzXg9Di9BFznWeaf-PfuAo_0 2024-09-14T11:11:37.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.292+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:11:37.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.293+0000 7fc90fc63800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:11:37.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.295+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.295+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:37.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.296+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:11:37.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.296+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3673661501315371855', time=2024-09-14T13:11:20.799162+0000, chain.objs.size()=5 2024-09-14T11:11:37.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.296+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.102__multipart_key1.2~1qGN-BV9AEBvprxRXUTa3BbH9x4-Jkl.1 2024-09-14T11:11:37.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.296+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.102__multipart_key1.2~1qGN-BV9AEBvprxRXUTa3BbH9x4-Jkl.2 2024-09-14T11:11:37.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.296+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.102__multipart_key1.2~1qGN-BV9AEBvprxRXUTa3BbH9x4-Jkl.3 2024-09-14T11:11:37.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.296+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.102__multipart_key1.2~1qGN-BV9AEBvprxRXUTa3BbH9x4-Jkl.4 2024-09-14T11:11:37.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.296+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.102__multipart_key1.2~1qGN-BV9AEBvprxRXUTa3BbH9x4-Jkl.5 2024-09-14T11:11:37.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.296+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1006298122103101044', time=2024-09-14T13:11:28.561825+0000, chain.objs.size()=1 2024-09-14T11:11:37.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.296+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.117__shadow_.mW72BGJPEr0A_g-dkFRucVAjihcatoN_0 2024-09-14T11:11:37.296 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.296+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14146000465617521018', time=2024-09-14T13:11:29.441626+0000, chain.objs.size()=1 2024-09-14T11:11:37.296 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.296+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.120__shadow_.O6Nj3e3stwgGDnVvkFXCpTtRzx3Yicc_0 2024-09-14T11:11:37.296 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.296+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4493144541027193644', time=2024-09-14T13:11:30.862162+0000, chain.objs.size()=1 2024-09-14T11:11:37.296 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.296+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.125__shadow_.Y0qsAszodyWBboxfCIdU_FWOb9U1UBb_0 2024-09-14T11:11:37.296 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.296+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.913905587332887052', time=2024-09-14T13:11:31.164726+0000, chain.objs.size()=1 2024-09-14T11:11:37.296 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.296+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.126__shadow_.nvcwfBWUu3E6jRB_epGdqjTxy0pJj87_0 2024-09-14T11:11:37.297 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.299+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:11:37.299 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.301+0000 7fc90fc63800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:11:37.301 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.302+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.301 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.302+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:37.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.303+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-14T11:11:37.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.303+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3489233868192876162', time=2024-09-14T13:11:18.876680+0000, chain.objs.size()=5 2024-09-14T11:11:37.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.303+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.100__multipart_file2.mpg.2~ag2K-ZklMWyYVan72DRTtrdAu20gAAR.1 2024-09-14T11:11:37.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.303+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.100__multipart_file2.mpg.2~ag2K-ZklMWyYVan72DRTtrdAu20gAAR.2 2024-09-14T11:11:37.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.303+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.100__multipart_file2.mpg.2~ag2K-ZklMWyYVan72DRTtrdAu20gAAR.3 2024-09-14T11:11:37.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.303+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.100__multipart_file2.mpg.2~ag2K-ZklMWyYVan72DRTtrdAu20gAAR.4 2024-09-14T11:11:37.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.303+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.100__multipart_file2.mpg.2~ag2K-ZklMWyYVan72DRTtrdAu20gAAR.5 2024-09-14T11:11:37.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.303+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3581191089588730271', time=2024-09-14T13:11:27.102324+0000, chain.objs.size()=1 2024-09-14T11:11:37.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.303+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.112__shadow_.syqqJvSsH_h2Nllvutteb9vBpV_c2zY_0 2024-09-14T11:11:37.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.303+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3506710463105498770', time=2024-09-14T13:11:27.697920+0000, chain.objs.size()=1 2024-09-14T11:11:37.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.303+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.114__shadow_.WHau_Pp2VYFbYkQdnDSTzuftBn1OPAi_0 2024-09-14T11:11:37.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.303+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9753095825451341385', time=2024-09-14T13:11:27.972426+0000, chain.objs.size()=1 2024-09-14T11:11:37.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.303+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.115__shadow_.0ycG_VmEurzdaP4ti1AmN5lol0KBGrO_0 2024-09-14T11:11:37.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.303+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16248669718616981473', time=2024-09-14T13:11:30.871967+0000, chain.objs.size()=1 2024-09-14T11:11:37.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.303+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.125__shadow_.2mTF3CcamIjXUMwDPqL6IRAiBwzNhku_0 2024-09-14T11:11:37.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.303+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9615242784868782907', time=2024-09-14T13:11:31.160197+0000, chain.objs.size()=1 2024-09-14T11:11:37.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.303+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.126__shadow_.O3iGP1INDqJQ20ihQouNflLPQYlMsIM_0 2024-09-14T11:11:37.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.303+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12268581229466736058', time=2024-09-14T13:11:31.739996+0000, chain.objs.size()=1 2024-09-14T11:11:37.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.303+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.128__shadow_.6gIv-j1S2Bhc8FLtuf-pS8DwVGWNbPQ_0 2024-09-14T11:11:37.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.307+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:11:37.308 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.310+0000 7fc90fc63800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:11:37.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.312+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.312+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:37.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.312+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:11:37.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.312+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='2~gO9XnmV0WlHjYBevuwgcirQ_7uu-Yep', time=2024-09-14T13:11:07.671886+0000, chain.objs.size()=5 2024-09-14T11:11:37.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.312+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.79__multipart_key1.2~gO9XnmV0WlHjYBevuwgcirQ_7uu-Yep.1 2024-09-14T11:11:37.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.312+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.79__multipart_key1.2~gO9XnmV0WlHjYBevuwgcirQ_7uu-Yep.2 2024-09-14T11:11:37.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.312+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.79__multipart_key1.2~gO9XnmV0WlHjYBevuwgcirQ_7uu-Yep.3 2024-09-14T11:11:37.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.312+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.79__multipart_key1.2~gO9XnmV0WlHjYBevuwgcirQ_7uu-Yep.4 2024-09-14T11:11:37.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.312+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.79__multipart_key1.2~gO9XnmV0WlHjYBevuwgcirQ_7uu-Yep.5 2024-09-14T11:11:37.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.312+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7045535365252310757', time=2024-09-14T13:11:28.278630+0000, chain.objs.size()=1 2024-09-14T11:11:37.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.312+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.116__shadow_.CQ6ilOfu8cTC2z9_dNyYM9qO54g7pfN_0 2024-09-14T11:11:37.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.312+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4373163836740770226', time=2024-09-14T13:11:29.431072+0000, chain.objs.size()=1 2024-09-14T11:11:37.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.312+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.120__shadow_.YCaBnWidXkBImWKOsgHEgaraFXJ-TfT_0 2024-09-14T11:11:37.314 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.315+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:11:37.316 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.317+0000 7fc90fc63800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:11:37.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.319+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.319+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:37.318 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.319+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:11:37.318 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.319+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15102708320424347959', time=2024-09-14T13:11:24.363445+0000, chain.objs.size()=5 2024-09-14T11:11:37.319 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.319+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.104__multipart_key1.2~b9szDYcg9ojdbOSuggsXNyHv7iNtlDx.1 2024-09-14T11:11:37.319 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.319+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.104__multipart_key1.2~b9szDYcg9ojdbOSuggsXNyHv7iNtlDx.2 2024-09-14T11:11:37.319 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.319+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.104__multipart_key1.2~b9szDYcg9ojdbOSuggsXNyHv7iNtlDx.3 2024-09-14T11:11:37.319 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.319+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.104__multipart_key1.2~b9szDYcg9ojdbOSuggsXNyHv7iNtlDx.4 2024-09-14T11:11:37.319 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.319+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.104__multipart_key1.2~b9szDYcg9ojdbOSuggsXNyHv7iNtlDx.5 2024-09-14T11:11:37.319 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.319+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4547484218178107796', time=2024-09-14T13:11:28.847023+0000, chain.objs.size()=1 2024-09-14T11:11:37.319 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.319+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.118__shadow_.-BpQu33ckq2rC1S4LR08j6qla5uVY0b_0 2024-09-14T11:11:37.319 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.319+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17142982407323175394', time=2024-09-14T13:11:29.144009+0000, chain.objs.size()=1 2024-09-14T11:11:37.319 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.319+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.119__shadow_.n6DsXYsKbP30tG-bpkzwNu-LJz6oMcW_0 2024-09-14T11:11:37.319 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.319+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14017616295702925100', time=2024-09-14T13:11:30.007943+0000, chain.objs.size()=1 2024-09-14T11:11:37.319 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.319+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.122__shadow_.hZ6LyXj4a-ulrhcEel8YtW3ckCwVHhq_0 2024-09-14T11:11:37.321 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.322+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:11:37.323 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.324+0000 7fc90fc63800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:11:37.324 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.326+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.325 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.326+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:37.326 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.326+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:11:37.326 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.326+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10116319699110594298', time=2024-09-14T13:11:21.672937+0000, chain.objs.size()=5 2024-09-14T11:11:37.326 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.326+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.102__multipart_key1.2~HJqquqR3kyUmyTt2ohs646Ix0Xm9Utp.1 2024-09-14T11:11:37.326 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.326+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.102__multipart_key1.2~HJqquqR3kyUmyTt2ohs646Ix0Xm9Utp.2 2024-09-14T11:11:37.326 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.326+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.102__multipart_key1.2~HJqquqR3kyUmyTt2ohs646Ix0Xm9Utp.3 2024-09-14T11:11:37.326 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.326+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.102__multipart_key1.2~HJqquqR3kyUmyTt2ohs646Ix0Xm9Utp.4 2024-09-14T11:11:37.326 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.326+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.102__multipart_key1.2~HJqquqR3kyUmyTt2ohs646Ix0Xm9Utp.5 2024-09-14T11:11:37.326 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.326+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12679247388928993542', time=2024-09-14T13:11:28.556758+0000, chain.objs.size()=1 2024-09-14T11:11:37.326 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.326+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.117__shadow_.jHAWy7Rp77NWOJddYUTG6XcRKnkHshL_0 2024-09-14T11:11:37.327 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.329+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:11:37.329 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.331+0000 7fc90fc63800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:11:37.331 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.332+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.331 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.333+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:37.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.333+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:11:37.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.333+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.962369582983998104', time=2024-09-14T13:11:06.379871+0000, chain.objs.size()=1 2024-09-14T11:11:37.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.333+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.77__shadow_.0HemV3Na-WWDhyB_BcJQ9aRbkuAwMNs_0 2024-09-14T11:11:37.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.333+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14997942244528283701', time=2024-09-14T13:11:11.294402+0000, chain.objs.size()=5 2024-09-14T11:11:37.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.333+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.91__multipart_key1.2~-7RmKrATPXX42668-WSv6KEiiaPnU0Q.1 2024-09-14T11:11:37.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.333+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.91__multipart_key1.2~-7RmKrATPXX42668-WSv6KEiiaPnU0Q.2 2024-09-14T11:11:37.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.333+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.91__multipart_key1.2~-7RmKrATPXX42668-WSv6KEiiaPnU0Q.3 2024-09-14T11:11:37.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.333+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.91__multipart_key1.2~-7RmKrATPXX42668-WSv6KEiiaPnU0Q.4 2024-09-14T11:11:37.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.333+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.91__multipart_key1.2~-7RmKrATPXX42668-WSv6KEiiaPnU0Q.5 2024-09-14T11:11:37.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.333+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7687546319649280515', time=2024-09-14T13:11:27.084783+0000, chain.objs.size()=1 2024-09-14T11:11:37.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.333+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.112__shadow_.biRCFRpjQeSEjjsnvihXFjQcQpYgnbQ_0 2024-09-14T11:11:37.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.333+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5833600350086476896', time=2024-09-14T13:11:27.401467+0000, chain.objs.size()=1 2024-09-14T11:11:37.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.333+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.113__shadow_.5HH5wjRcS6I2H6mMWtQYtXlW-giMKmj_0 2024-09-14T11:11:37.334 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.334+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.984117987945497661', time=2024-09-14T13:11:29.722122+0000, chain.objs.size()=1 2024-09-14T11:11:37.334 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.334+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.121__shadow_.O07f51zZGleyMW_BI6lNhi67BRBeb7f_0 2024-09-14T11:11:37.334 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.335+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:11:37.336 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.338+0000 7fc90fc63800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:11:37.337 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.339+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.339+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:37.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.339+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:11:37.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.339+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6873483236071079372', time=2024-09-14T13:11:09.417316+0000, chain.objs.size()=1 2024-09-14T11:11:37.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.339+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.85__shadow_.axFVClmgMYBUms12q-jSUJMroV8vBAM_0 2024-09-14T11:11:37.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.339+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5437763598235768561', time=2024-09-14T13:11:30.572351+0000, chain.objs.size()=1 2024-09-14T11:11:37.339 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.339+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.124__shadow_.TMgGH5NIexJ9jgHzA5aXeEsIWF7hAuq_0 2024-09-14T11:11:37.339 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.339+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11359774950679814510', time=2024-09-14T13:11:30.577346+0000, chain.objs.size()=1 2024-09-14T11:11:37.339 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.339+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.124__shadow_.7aZQ_rb-FzaVdxDvIpXsSZ8iac7ArOD_0 2024-09-14T11:11:37.339 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.341+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:11:37.341 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.343+0000 7fc90fc63800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:11:37.342 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.344+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.343 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.344+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:37.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.345+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:11:37.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.345+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18328424602758906521', time=2024-09-14T13:11:28.852384+0000, chain.objs.size()=1 2024-09-14T11:11:37.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.345+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.118__shadow_._gHJi9GL-szNny68dMkF5rPkc1uodI__0 2024-09-14T11:11:37.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.345+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4209004093849885971', time=2024-09-14T13:11:30.582765+0000, chain.objs.size()=1 2024-09-14T11:11:37.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.345+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.124__shadow_.eLnxVIyd1i4BNKYyXwKIANXvxzs0Yac_0 2024-09-14T11:11:37.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.345+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12229670488366404554', time=2024-09-14T13:11:31.451412+0000, chain.objs.size()=1 2024-09-14T11:11:37.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.345+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.127__shadow_.Nr1u2G5DixDpsxmyjrefoUYYvcVJf0t_0 2024-09-14T11:11:37.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.345+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8580072659496055969', time=2024-09-14T13:11:34.810411+0000, chain.objs.size()=1 2024-09-14T11:11:37.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.345+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.139__shadow_.L98nah-718CI6410kLkF-Pwu53PpeYG_0 2024-09-14T11:11:37.345 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.346+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:11:37.347 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.348+0000 7fc90fc63800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:11:37.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.349+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.350+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:37.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.350+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:11:37.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.350+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2400794231717579852', time=2024-09-14T13:11:15.665536+0000, chain.objs.size()=5 2024-09-14T11:11:37.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.350+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.94__multipart_key1.2~kSgLRMSY8S9zBR2RG5oIA3x58CT6-Ix.1 2024-09-14T11:11:37.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.350+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.94__shadow_key1.2~kSgLRMSY8S9zBR2RG5oIA3x58CT6-Ix.1_1 2024-09-14T11:11:37.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.350+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.94__multipart_key1.2~kSgLRMSY8S9zBR2RG5oIA3x58CT6-Ix.2 2024-09-14T11:11:37.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.350+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.94__shadow_key1.2~kSgLRMSY8S9zBR2RG5oIA3x58CT6-Ix.2_1 2024-09-14T11:11:37.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.350+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.94__multipart_key1.2~kSgLRMSY8S9zBR2RG5oIA3x58CT6-Ix.3 2024-09-14T11:11:37.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.350+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9370010899078830137', time=2024-09-14T13:11:29.139131+0000, chain.objs.size()=1 2024-09-14T11:11:37.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.350+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.119__shadow_.sGATD5MLAS9mRjGLObyfxTR7vJOLbdv_0 2024-09-14T11:11:37.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.350+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16977962777333353632', time=2024-09-14T13:11:32.901419+0000, chain.objs.size()=1 2024-09-14T11:11:37.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.350+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.132__shadow_.edFhoTfEM7S4g6Cc4kT150ToMs2-I4Z_0 2024-09-14T11:11:37.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.353+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:11:37.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.356+0000 7fc90fc63800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:11:37.356 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.357+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.356 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.358+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:37.357 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.358+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:11:37.357 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.358+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1076737451236097422', time=2024-09-14T13:11:18.321256+0000, chain.objs.size()=5 2024-09-14T11:11:37.357 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.358+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.99__multipart_key1.2~SYOi4ZFtUq3VXzPIPmtOgkiddDC77az.1 2024-09-14T11:11:37.357 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.358+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.99__multipart_key1.2~SYOi4ZFtUq3VXzPIPmtOgkiddDC77az.2 2024-09-14T11:11:37.357 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.358+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.99__multipart_key1.2~SYOi4ZFtUq3VXzPIPmtOgkiddDC77az.3 2024-09-14T11:11:37.358 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.358+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.99__multipart_key1.2~SYOi4ZFtUq3VXzPIPmtOgkiddDC77az.4 2024-09-14T11:11:37.358 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.358+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.99__multipart_key1.2~SYOi4ZFtUq3VXzPIPmtOgkiddDC77az.5 2024-09-14T11:11:37.358 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.358+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17244022492623049866', time=2024-09-14T13:11:30.012888+0000, chain.objs.size()=1 2024-09-14T11:11:37.358 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.358+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.122__shadow_.ZvsnTe7bQ_ZEdn6exSC83ObkzQNJkv7_0 2024-09-14T11:11:37.358 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.358+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14498890633668813346', time=2024-09-14T13:11:32.336214+0000, chain.objs.size()=1 2024-09-14T11:11:37.358 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.358+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.130__shadow_.KgSQmuvbn3k3LjqrJ6qEbAi-DEr1aXU_0 2024-09-14T11:11:37.358 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.358+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11355725696840417828', time=2024-09-14T13:11:36.146963+0000, chain.objs.size()=5 2024-09-14T11:11:37.358 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.358+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.143__multipart_key1.2~LGqpKT3jMw74iBPLpunxTosTMXwSWyv.1 2024-09-14T11:11:37.358 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.358+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.143__multipart_key1.2~LGqpKT3jMw74iBPLpunxTosTMXwSWyv.2 2024-09-14T11:11:37.358 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.358+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.143__multipart_key1.2~LGqpKT3jMw74iBPLpunxTosTMXwSWyv.3 2024-09-14T11:11:37.359 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.358+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.143__multipart_key1.2~LGqpKT3jMw74iBPLpunxTosTMXwSWyv.4 2024-09-14T11:11:37.359 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.358+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.143__multipart_key1.2~LGqpKT3jMw74iBPLpunxTosTMXwSWyv.5 2024-09-14T11:11:37.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.363+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:11:37.363 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.365+0000 7fc90fc63800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:11:37.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.366+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.367+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:37.366 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.367+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:11:37.366 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.367+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14551414393026538062', time=2024-09-14T13:11:15.923773+0000, chain.objs.size()=5 2024-09-14T11:11:37.366 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.367+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.94__multipart_key1.2~WztRbf9Kywi2_gAJEiVa5jmx3CXvqvV.1 2024-09-14T11:11:37.366 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.367+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.94__shadow_key1.2~WztRbf9Kywi2_gAJEiVa5jmx3CXvqvV.1_1 2024-09-14T11:11:37.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.367+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.94__multipart_key1.2~WztRbf9Kywi2_gAJEiVa5jmx3CXvqvV.2 2024-09-14T11:11:37.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.367+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.94__shadow_key1.2~WztRbf9Kywi2_gAJEiVa5jmx3CXvqvV.2_1 2024-09-14T11:11:37.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.367+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.94__multipart_key1.2~WztRbf9Kywi2_gAJEiVa5jmx3CXvqvV.3 2024-09-14T11:11:37.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.367+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17110297510556528164', time=2024-09-14T13:11:27.091136+0000, chain.objs.size()=1 2024-09-14T11:11:37.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.367+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.112__shadow_.UgyBhZ-y_puy-yKvVKCLZG3HrlYwSDJ_0 2024-09-14T11:11:37.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.367+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9356507738354610593', time=2024-09-14T13:11:29.436560+0000, chain.objs.size()=1 2024-09-14T11:11:37.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.367+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.120__shadow_.CvCGKfA3qo_C9V73LnlxjNW-uFe8tMg_0 2024-09-14T11:11:37.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.367+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14340410277851291661', time=2024-09-14T13:11:30.297919+0000, chain.objs.size()=1 2024-09-14T11:11:37.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.367+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.123__shadow_.X-uhDZGHgBE2fZu84v9CCyz758po4cs_0 2024-09-14T11:11:37.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.367+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7890647274524423891', time=2024-09-14T13:11:32.034537+0000, chain.objs.size()=1 2024-09-14T11:11:37.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.367+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.129__shadow_.nmSj-VSHgzruO8t_IEsGaWRKox4R0aj_0 2024-09-14T11:11:37.371 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.372+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:11:37.373 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.374+0000 7fc90fc63800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:11:37.374 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.375+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.376 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.376+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:37.377 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.376+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:11:37.377 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.376+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17550955695707239556', time=2024-09-14T13:11:11.411928+0000, chain.objs.size()=5 2024-09-14T11:11:37.377 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.376+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.91__multipart_key1.2~-7RmKrATPXX42668-WSv6KEiiaPnU0Q.1 2024-09-14T11:11:37.377 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.376+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.91__multipart_key1.2~-7RmKrATPXX42668-WSv6KEiiaPnU0Q.2 2024-09-14T11:11:37.377 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.376+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.91__multipart_key1.2~-7RmKrATPXX42668-WSv6KEiiaPnU0Q.3 2024-09-14T11:11:37.378 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.376+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.91__multipart_key1.2~-7RmKrATPXX42668-WSv6KEiiaPnU0Q.4 2024-09-14T11:11:37.378 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.376+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.91__multipart_key1.2~-7RmKrATPXX42668-WSv6KEiiaPnU0Q.5 2024-09-14T11:11:37.378 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.376+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16156914486818735638', time=2024-09-14T13:11:31.149321+0000, chain.objs.size()=1 2024-09-14T11:11:37.378 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.376+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.126__shadow_.vHDJiUNR0sgBGcck6D9CgkvcFuBEdIg_0 2024-09-14T11:11:37.378 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.376+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13176915680929078558', time=2024-09-14T13:11:31.734692+0000, chain.objs.size()=1 2024-09-14T11:11:37.379 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.376+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.128__shadow_.yeU93Z3zsLeJyPKpLhMa0nt1lqutGUG_0 2024-09-14T11:11:37.379 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.376+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15713959803338459752', time=2024-09-14T13:11:32.029765+0000, chain.objs.size()=1 2024-09-14T11:11:37.379 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.376+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.129__shadow_.GAM0iadtUU0YfGuqK_QSHbpw91q1GCP_0 2024-09-14T11:11:37.379 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.379+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:11:37.380 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.382+0000 7fc90fc63800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:11:37.382 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.383+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.383 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.383+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:37.383 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.384+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:11:37.383 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.384+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8720196020377673677', time=2024-09-14T13:11:27.692779+0000, chain.objs.size()=1 2024-09-14T11:11:37.383 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.384+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.114__shadow_.FMXS5_vTA59pyI-MXvT7kD5S313uJqt_0 2024-09-14T11:11:37.383 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.384+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5085427369336359383', time=2024-09-14T13:11:29.726657+0000, chain.objs.size()=1 2024-09-14T11:11:37.383 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.384+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.121__shadow_.6XAl7bgD4sYeid1twl1I9WRYkEdSR7o_0 2024-09-14T11:11:37.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.385+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:11:37.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.387+0000 7fc90fc63800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:11:37.388 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.390+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.389 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.390+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:37.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.391+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:11:37.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.391+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13427851476100066705', time=2024-09-14T13:11:14.809347+0000, chain.objs.size()=5 2024-09-14T11:11:37.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.391+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.94__multipart_key1.2~CEU6JIBEcNmHM1Mi5q6VVCaezVj5w1g.1 2024-09-14T11:11:37.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.391+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.94__multipart_key1.2~CEU6JIBEcNmHM1Mi5q6VVCaezVj5w1g.2 2024-09-14T11:11:37.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.391+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.94__multipart_key1.2~CEU6JIBEcNmHM1Mi5q6VVCaezVj5w1g.3 2024-09-14T11:11:37.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.391+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.94__multipart_key1.2~CEU6JIBEcNmHM1Mi5q6VVCaezVj5w1g.4 2024-09-14T11:11:37.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.391+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.94__multipart_key1.2~CEU6JIBEcNmHM1Mi5q6VVCaezVj5w1g.5 2024-09-14T11:11:37.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.391+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17267984435824130880', time=2024-09-14T13:11:28.551222+0000, chain.objs.size()=1 2024-09-14T11:11:37.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.391+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.117__shadow_.jSElGGcwc9Rq30lctKH7x3fKE0IFrdL_0 2024-09-14T11:11:37.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.391+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14078101331018011927', time=2024-09-14T13:11:30.302720+0000, chain.objs.size()=1 2024-09-14T11:11:37.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.391+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.123__shadow_.rup9HyFdS54VnhxAmqajfDs6BINpcrH_0 2024-09-14T11:11:37.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.391+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2536342995723933070', time=2024-09-14T13:11:32.326419+0000, chain.objs.size()=1 2024-09-14T11:11:37.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.391+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.130__shadow_.ZlB1kKn9tzTYHomPrRLKJRDLVc6RZ6v_0 2024-09-14T11:11:37.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.391+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17491105051353506618', time=2024-09-14T13:11:34.066071+0000, chain.objs.size()=1 2024-09-14T11:11:37.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.391+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.137__shadow_.bN2rYdHRB-l2kWEJi7Z1FttR_9R5E3M_0 2024-09-14T11:11:37.392 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.394+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:11:37.394 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.396+0000 7fc90fc63800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:11:37.396 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.397+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.398+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:37.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.398+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-14T11:11:37.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.398+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8423449023980313914', time=2024-09-14T13:11:10.566665+0000, chain.objs.size()=1 2024-09-14T11:11:37.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.398+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.90__shadow_.qI-ppBLSWA8TO_H3a9-t7aHj6lfPD27_0 2024-09-14T11:11:37.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.398+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12065567583370009850', time=2024-09-14T13:11:27.390722+0000, chain.objs.size()=1 2024-09-14T11:11:37.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.398+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.113__shadow_.VZgfaz6J5RrG0MsdWLDhTatIsHfKSNO_0 2024-09-14T11:11:37.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.398+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16178591796630238177', time=2024-09-14T13:11:28.269296+0000, chain.objs.size()=1 2024-09-14T11:11:37.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.398+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.116__shadow_.IiOsr60onBXS7ot_IFW17QKVlferWxS_0 2024-09-14T11:11:37.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.398+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14327920138188328954', time=2024-09-14T13:11:31.154247+0000, chain.objs.size()=1 2024-09-14T11:11:37.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.398+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.126__shadow_.8sPUfdLyJVDJSl1ICUFp2INOP_a_Rlk_0 2024-09-14T11:11:37.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.398+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5865775217643003467', time=2024-09-14T13:11:31.441695+0000, chain.objs.size()=1 2024-09-14T11:11:37.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.398+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.127__shadow_.63kAzqhsGfbuJZQAO-2MjPqVuLlxrFd_0 2024-09-14T11:11:37.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.398+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2616373710425752464', time=2024-09-14T13:11:33.181655+0000, chain.objs.size()=1 2024-09-14T11:11:37.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.398+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.133__shadow_.JN2w2_m2BWs2hXceMmcTZgWdw7R055y_0 2024-09-14T11:11:37.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.400+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:11:37.401 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.402+0000 7fc90fc63800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:11:37.402 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.403+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.402 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.404+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:37.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.404+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-14T11:11:37.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.404+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka', time=2024-09-14T13:11:25.109898+0000, chain.objs.size()=137 2024-09-14T11:11:37.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.404+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.1 2024-09-14T11:11:37.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.404+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.2 2024-09-14T11:11:37.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.404+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.3 2024-09-14T11:11:37.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.404+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.4 2024-09-14T11:11:37.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.404+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.5 2024-09-14T11:11:37.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.404+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.6 2024-09-14T11:11:37.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.404+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.7 2024-09-14T11:11:37.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.404+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.8 2024-09-14T11:11:37.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.404+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.9 2024-09-14T11:11:37.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.404+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.10 2024-09-14T11:11:37.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.404+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.11 2024-09-14T11:11:37.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.404+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.12 2024-09-14T11:11:37.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.407+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.13 2024-09-14T11:11:37.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.407+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.14 2024-09-14T11:11:37.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.407+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.15 2024-09-14T11:11:37.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.407+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.16 2024-09-14T11:11:37.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.407+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.17 2024-09-14T11:11:37.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.407+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.18 2024-09-14T11:11:37.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.407+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.19 2024-09-14T11:11:37.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.407+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.20 2024-09-14T11:11:37.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.407+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.21 2024-09-14T11:11:37.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.407+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.22 2024-09-14T11:11:37.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.407+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.23 2024-09-14T11:11:37.408 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.408+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.24 2024-09-14T11:11:37.408 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.409+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.25 2024-09-14T11:11:37.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.409+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.26 2024-09-14T11:11:37.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.409+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.27 2024-09-14T11:11:37.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.409+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.28 2024-09-14T11:11:37.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.409+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.29 2024-09-14T11:11:37.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.409+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.30 2024-09-14T11:11:37.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.409+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.31 2024-09-14T11:11:37.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.409+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.32 2024-09-14T11:11:37.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.409+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.33 2024-09-14T11:11:37.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.409+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.34 2024-09-14T11:11:37.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.410+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.35 2024-09-14T11:11:37.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.410+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.36 2024-09-14T11:11:37.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.412+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.37 2024-09-14T11:11:37.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.412+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.38 2024-09-14T11:11:37.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.414+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.39 2024-09-14T11:11:37.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.414+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.40 2024-09-14T11:11:37.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.414+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.41 2024-09-14T11:11:37.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.414+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.42 2024-09-14T11:11:37.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.414+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.43 2024-09-14T11:11:37.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.414+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.44 2024-09-14T11:11:37.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.414+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.45 2024-09-14T11:11:37.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.414+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.46 2024-09-14T11:11:37.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.414+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.47 2024-09-14T11:11:37.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.414+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.48 2024-09-14T11:11:37.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.414+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.49 2024-09-14T11:11:37.415 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.416+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.50 2024-09-14T11:11:37.415 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.416+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.51 2024-09-14T11:11:37.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.417+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.52 2024-09-14T11:11:37.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.417+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.53 2024-09-14T11:11:37.419 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.420+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.54 2024-09-14T11:11:37.419 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.420+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.55 2024-09-14T11:11:37.419 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.420+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.56 2024-09-14T11:11:37.419 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.420+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.57 2024-09-14T11:11:37.419 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.420+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.58 2024-09-14T11:11:37.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.420+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.59 2024-09-14T11:11:37.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.420+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.60 2024-09-14T11:11:37.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.420+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.61 2024-09-14T11:11:37.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.420+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.62 2024-09-14T11:11:37.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.423+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.63 2024-09-14T11:11:37.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.423+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.64 2024-09-14T11:11:37.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.423+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.65 2024-09-14T11:11:37.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.423+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.66 2024-09-14T11:11:37.425 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.426+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.67 2024-09-14T11:11:37.425 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.426+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.68 2024-09-14T11:11:37.425 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.426+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.69 2024-09-14T11:11:37.425 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.426+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.70 2024-09-14T11:11:37.426 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.426+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.71 2024-09-14T11:11:37.426 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.426+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.72 2024-09-14T11:11:37.426 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.426+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.73 2024-09-14T11:11:37.426 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.426+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.74 2024-09-14T11:11:37.426 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.426+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.75 2024-09-14T11:11:37.426 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.426+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.76 2024-09-14T11:11:37.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.428+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.77 2024-09-14T11:11:37.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.428+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.78 2024-09-14T11:11:37.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.431+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.79 2024-09-14T11:11:37.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.431+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.80 2024-09-14T11:11:37.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.431+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.81 2024-09-14T11:11:37.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.431+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.82 2024-09-14T11:11:37.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.431+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.83 2024-09-14T11:11:37.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.431+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.84 2024-09-14T11:11:37.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.431+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.85 2024-09-14T11:11:37.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.431+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.86 2024-09-14T11:11:37.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.431+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.87 2024-09-14T11:11:37.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.432+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.88 2024-09-14T11:11:37.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.432+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.89 2024-09-14T11:11:37.436 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.437+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.90 2024-09-14T11:11:37.436 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.437+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.91 2024-09-14T11:11:37.436 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.437+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.92 2024-09-14T11:11:37.436 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.437+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.93 2024-09-14T11:11:37.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.437+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.94 2024-09-14T11:11:37.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.437+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.95 2024-09-14T11:11:37.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.437+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.96 2024-09-14T11:11:37.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.437+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.97 2024-09-14T11:11:37.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.437+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.98 2024-09-14T11:11:37.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.437+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.99 2024-09-14T11:11:37.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.437+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.100 2024-09-14T11:11:37.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.439+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.101 2024-09-14T11:11:37.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.443+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.102 2024-09-14T11:11:37.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.443+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.103 2024-09-14T11:11:37.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.443+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.104 2024-09-14T11:11:37.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.443+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.105 2024-09-14T11:11:37.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.443+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.106 2024-09-14T11:11:37.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.443+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.107 2024-09-14T11:11:37.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.443+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.108 2024-09-14T11:11:37.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.443+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.109 2024-09-14T11:11:37.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.443+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.110 2024-09-14T11:11:37.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.443+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.111 2024-09-14T11:11:37.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.443+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.112 2024-09-14T11:11:37.444 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.446+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.113 2024-09-14T11:11:37.444 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.446+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.114 2024-09-14T11:11:37.444 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.446+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.115 2024-09-14T11:11:37.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.448+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.116 2024-09-14T11:11:37.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.448+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.117 2024-09-14T11:11:37.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.448+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.118 2024-09-14T11:11:37.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.448+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.119 2024-09-14T11:11:37.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.448+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.120 2024-09-14T11:11:37.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.448+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.121 2024-09-14T11:11:37.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.448+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.122 2024-09-14T11:11:37.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.448+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.123 2024-09-14T11:11:37.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.449+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.124 2024-09-14T11:11:37.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.449+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.125 2024-09-14T11:11:37.450 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.451+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.126 2024-09-14T11:11:37.450 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.451+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.127 2024-09-14T11:11:37.450 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.451+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.128 2024-09-14T11:11:37.450 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.451+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.129 2024-09-14T11:11:37.450 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.451+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.130 2024-09-14T11:11:37.450 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.451+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.131 2024-09-14T11:11:37.450 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.451+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.132 2024-09-14T11:11:37.452 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.454+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.133 2024-09-14T11:11:37.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.454+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.134 2024-09-14T11:11:37.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.454+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.135 2024-09-14T11:11:37.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.454+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.136 2024-09-14T11:11:37.456 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.457+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.137 2024-09-14T11:11:37.456 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.457+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka', time=2024-09-14T13:11:25.128449+0000, chain.objs.size()=11 2024-09-14T11:11:37.456 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.457+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.138 2024-09-14T11:11:37.456 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.457+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.139 2024-09-14T11:11:37.456 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.457+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.140 2024-09-14T11:11:37.456 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.457+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.141 2024-09-14T11:11:37.456 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.457+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.142 2024-09-14T11:11:37.456 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.457+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.143 2024-09-14T11:11:37.456 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.457+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.144 2024-09-14T11:11:37.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.459+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.145 2024-09-14T11:11:37.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.459+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.146 2024-09-14T11:11:37.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.459+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.147 2024-09-14T11:11:37.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.459+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.148 2024-09-14T11:11:37.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.459+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka', time=2024-09-14T13:11:25.151212+0000, chain.objs.size()=10 2024-09-14T11:11:37.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.459+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.149 2024-09-14T11:11:37.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.459+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.150 2024-09-14T11:11:37.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.459+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.151 2024-09-14T11:11:37.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.459+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.152 2024-09-14T11:11:37.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.459+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.153 2024-09-14T11:11:37.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.462+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.154 2024-09-14T11:11:37.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.462+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.155 2024-09-14T11:11:37.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.462+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.156 2024-09-14T11:11:37.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.462+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.157 2024-09-14T11:11:37.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.462+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.158 2024-09-14T11:11:37.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.462+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka', time=2024-09-14T13:11:25.173736+0000, chain.objs.size()=9 2024-09-14T11:11:37.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.462+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.159 2024-09-14T11:11:37.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.464+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.160 2024-09-14T11:11:37.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.464+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.161 2024-09-14T11:11:37.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.464+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.162 2024-09-14T11:11:37.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.464+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.163 2024-09-14T11:11:37.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.465+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.164 2024-09-14T11:11:37.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.465+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.165 2024-09-14T11:11:37.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.466+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.166 2024-09-14T11:11:37.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.466+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.168 2024-09-14T11:11:37.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.466+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka', time=2024-09-14T13:11:25.191754+0000, chain.objs.size()=8 2024-09-14T11:11:37.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.466+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.167 2024-09-14T11:11:37.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.466+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.169 2024-09-14T11:11:37.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.466+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.170 2024-09-14T11:11:37.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.469+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.171 2024-09-14T11:11:37.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.469+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.172 2024-09-14T11:11:37.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.469+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.173 2024-09-14T11:11:37.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.469+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.174 2024-09-14T11:11:37.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.469+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.175 2024-09-14T11:11:37.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.469+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka', time=2024-09-14T13:11:25.212490+0000, chain.objs.size()=10 2024-09-14T11:11:37.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.469+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.176 2024-09-14T11:11:37.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.469+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.177 2024-09-14T11:11:37.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.469+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.178 2024-09-14T11:11:37.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.469+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.179 2024-09-14T11:11:37.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.469+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.180 2024-09-14T11:11:37.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.469+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.181 2024-09-14T11:11:37.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.470+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.182 2024-09-14T11:11:37.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.470+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.183 2024-09-14T11:11:37.470 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.471+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.184 2024-09-14T11:11:37.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.472+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.185 2024-09-14T11:11:37.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.472+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka', time=2024-09-14T13:11:25.224130+0000, chain.objs.size()=6 2024-09-14T11:11:37.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.472+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.186 2024-09-14T11:11:37.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.472+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.187 2024-09-14T11:11:37.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.472+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.188 2024-09-14T11:11:37.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.472+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.189 2024-09-14T11:11:37.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.472+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.190 2024-09-14T11:11:37.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.472+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.191 2024-09-14T11:11:37.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.472+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka', time=2024-09-14T13:11:25.245289+0000, chain.objs.size()=10 2024-09-14T11:11:37.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.472+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.192 2024-09-14T11:11:37.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.472+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.193 2024-09-14T11:11:37.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.472+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.194 2024-09-14T11:11:37.472 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.474+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.195 2024-09-14T11:11:37.472 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.474+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.196 2024-09-14T11:11:37.472 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.474+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.197 2024-09-14T11:11:37.473 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.474+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.198 2024-09-14T11:11:37.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.475+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.199 2024-09-14T11:11:37.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.475+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.200 2024-09-14T11:11:37.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.475+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.201 2024-09-14T11:11:37.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.475+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka', time=2024-09-14T13:11:25.257337+0000, chain.objs.size()=4 2024-09-14T11:11:37.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.475+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.202 2024-09-14T11:11:37.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.475+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.203 2024-09-14T11:11:37.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.475+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.204 2024-09-14T11:11:37.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.475+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.205 2024-09-14T11:11:37.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.475+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka', time=2024-09-14T13:11:25.270881+0000, chain.objs.size()=7 2024-09-14T11:11:37.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.475+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.206 2024-09-14T11:11:37.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.475+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.207 2024-09-14T11:11:37.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.475+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.208 2024-09-14T11:11:37.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.477+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.209 2024-09-14T11:11:37.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.477+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.210 2024-09-14T11:11:37.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.477+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.211 2024-09-14T11:11:37.477 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.478+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.105__multipart_key1.2~eiuPMei1mIeXYj_b9k1N0LOAByqLNka.212 2024-09-14T11:11:37.477 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.478+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1206153795768473678', time=2024-09-14T13:11:28.566593+0000, chain.objs.size()=1 2024-09-14T11:11:37.477 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.478+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.117__shadow_.ZTg-CerowhnDGM4sDDxypcqDL4VLdkB_0 2024-09-14T11:11:37.478 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.480+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:11:37.480 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.482+0000 7fc90fc63800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:11:37.482 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.483+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.482 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.484+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:37.483 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.484+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:11:37.483 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.484+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11567885714872060968', time=2024-09-14T13:11:23.769951+0000, chain.objs.size()=5 2024-09-14T11:11:37.483 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.484+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.103__multipart_key1.2~kA7LBr_xu-mcQcAFZQHWoBEsyCw2jHP.1 2024-09-14T11:11:37.483 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.484+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.103__multipart_key1.2~kA7LBr_xu-mcQcAFZQHWoBEsyCw2jHP.2 2024-09-14T11:11:37.483 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.484+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.103__multipart_key1.2~kA7LBr_xu-mcQcAFZQHWoBEsyCw2jHP.3 2024-09-14T11:11:37.483 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.484+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.103__multipart_key1.2~kA7LBr_xu-mcQcAFZQHWoBEsyCw2jHP.4 2024-09-14T11:11:37.483 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.484+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.103__multipart_key1.2~kA7LBr_xu-mcQcAFZQHWoBEsyCw2jHP.5 2024-09-14T11:11:37.483 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.484+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14562361188538859229', time=2024-09-14T13:11:27.977553+0000, chain.objs.size()=1 2024-09-14T11:11:37.483 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.484+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.115__shadow_.MBtJQC59-rBo5jrbSmtpfZakVqm7Hg6_0 2024-09-14T11:11:37.484 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.484+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9911221912414098954', time=2024-09-14T13:11:29.133996+0000, chain.objs.size()=1 2024-09-14T11:11:37.484 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.484+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.119__shadow_.15sI-tmoPDLlURQFs_YfNB4DnEmgSgZ_0 2024-09-14T11:11:37.484 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.484+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2079953147826280979', time=2024-09-14T13:11:31.456537+0000, chain.objs.size()=1 2024-09-14T11:11:37.484 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.484+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.127__shadow_.scUaaILfaVLCdZMCid9qYacyPnMrsX__0 2024-09-14T11:11:37.484 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.484+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5397392065049709290', time=2024-09-14T13:11:32.615177+0000, chain.objs.size()=1 2024-09-14T11:11:37.484 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.484+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.131__shadow_.LMd3zxr3FJx4fDk7CjhzBY09fVmiH10_0 2024-09-14T11:11:37.486 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.487+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:11:37.488 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.490+0000 7fc90fc63800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:11:37.490 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.491+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.491 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.491+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:37.491 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.492+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:11:37.491 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.492+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8008294148333407863', time=2024-09-14T13:11:08.968069+0000, chain.objs.size()=2 2024-09-14T11:11:37.491 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.492+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.83__shadow_.HXba4C1fjkTmAqvLJ3Pzmf-nX5KO39i_0 2024-09-14T11:11:37.491 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.492+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.83__shadow_.HXba4C1fjkTmAqvLJ3Pzmf-nX5KO39i_1 2024-09-14T11:11:37.491 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.492+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17023674630893734950', time=2024-09-14T13:11:09.192346+0000, chain.objs.size()=1 2024-09-14T11:11:37.491 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.492+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.84__shadow_.1Q6PHz9EEb0gsrWSFybIcOTzWx74xSg_0 2024-09-14T11:11:37.492 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.492+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10276618257661753799', time=2024-09-14T13:11:18.866677+0000, chain.objs.size()=5 2024-09-14T11:11:37.492 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.492+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.100__multipart_file.mpg.2~4F3LDHYtlwmUimTEkwGJKRiEoFGKq49.1 2024-09-14T11:11:37.492 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.492+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.100__multipart_file.mpg.2~4F3LDHYtlwmUimTEkwGJKRiEoFGKq49.2 2024-09-14T11:11:37.492 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.492+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.100__multipart_file.mpg.2~4F3LDHYtlwmUimTEkwGJKRiEoFGKq49.3 2024-09-14T11:11:37.492 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.492+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.100__multipart_file.mpg.2~4F3LDHYtlwmUimTEkwGJKRiEoFGKq49.4 2024-09-14T11:11:37.492 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.492+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.100__multipart_file.mpg.2~4F3LDHYtlwmUimTEkwGJKRiEoFGKq49.5 2024-09-14T11:11:37.493 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.492+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4923870233784627954', time=2024-09-14T13:11:27.682133+0000, chain.objs.size()=1 2024-09-14T11:11:37.493 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.492+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.114__shadow_.MjQ3qle8V-2TDl_BE_Mk0mhte59viIa_0 2024-09-14T11:11:37.495 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.496+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:11:37.498 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.499+0000 7fc90fc63800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:11:37.499 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.501+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.501+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:37.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.502+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:11:37.501 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.502+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15827515160499115196', time=2024-09-14T13:11:22.296287+0000, chain.objs.size()=5 2024-09-14T11:11:37.501 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.502+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.102__multipart_key1.2~88d1IqR7DqKDJdDw6gUR2rbUmDngHdE.1 2024-09-14T11:11:37.501 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.502+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.102__shadow_key1.2~88d1IqR7DqKDJdDw6gUR2rbUmDngHdE.1_1 2024-09-14T11:11:37.501 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.502+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.102__multipart_key1.2~88d1IqR7DqKDJdDw6gUR2rbUmDngHdE.2 2024-09-14T11:11:37.501 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.502+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.102__shadow_key1.2~88d1IqR7DqKDJdDw6gUR2rbUmDngHdE.2_1 2024-09-14T11:11:37.501 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.502+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.102__multipart_key1.2~88d1IqR7DqKDJdDw6gUR2rbUmDngHdE.3 2024-09-14T11:11:37.501 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.502+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.501377927232841560', time=2024-09-14T13:11:31.744928+0000, chain.objs.size()=1 2024-09-14T11:11:37.501 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.502+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.128__shadow_.zbvKOsctaagOq4k3i3MdLygDi62j-Ui_0 2024-09-14T11:11:37.502 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.502+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15599437806831348171', time=2024-09-14T13:11:32.906201+0000, chain.objs.size()=1 2024-09-14T11:11:37.502 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.502+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.132__shadow_.d0qY0JCFlnz-_mOKu9hs432Zqc7adRM_0 2024-09-14T11:11:37.504 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.505+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:11:37.506 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.507+0000 7fc90fc63800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:11:37.507 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.509+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.509 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.509+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:37.509 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.510+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:11:37.509 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.510+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2593372009167294906', time=2024-09-14T13:11:12.799060+0000, chain.objs.size()=5 2024-09-14T11:11:37.509 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.510+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.94__multipart_key1.2~Gq35H0vP0W3iy4heka3vgbD17iyHxfA.1 2024-09-14T11:11:37.509 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.510+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.94__multipart_key1.2~Gq35H0vP0W3iy4heka3vgbD17iyHxfA.2 2024-09-14T11:11:37.509 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.510+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.94__multipart_key1.2~Gq35H0vP0W3iy4heka3vgbD17iyHxfA.3 2024-09-14T11:11:37.509 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.510+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.94__multipart_key1.2~Gq35H0vP0W3iy4heka3vgbD17iyHxfA.4 2024-09-14T11:11:37.509 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.510+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.94__multipart_key1.2~Gq35H0vP0W3iy4heka3vgbD17iyHxfA.5 2024-09-14T11:11:37.509 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.510+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1601672981694676926', time=2024-09-14T13:11:29.150220+0000, chain.objs.size()=1 2024-09-14T11:11:37.510 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.510+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.119__shadow_.GLa01MtGsWsZLyYVqg7etZ1dBAO8SgD_0 2024-09-14T11:11:37.510 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.510+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14176720332897041563', time=2024-09-14T13:11:29.426248+0000, chain.objs.size()=1 2024-09-14T11:11:37.510 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.510+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.120__shadow_.IZwuEncMHHrwDc4w2be2fEcgA8F3lcd_0 2024-09-14T11:11:37.512 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.513+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:11:37.514 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.515+0000 7fc90fc63800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:11:37.516 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.517+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.516 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.518+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:37.517 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.518+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:11:37.517 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.518+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6397608790142096199', time=2024-09-14T13:11:18.881407+0000, chain.objs.size()=1 2024-09-14T11:11:37.517 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.518+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.100__shadow_.fbmgdZxtg9x9osaURjNXJ54tPpyVBjG_0 2024-09-14T11:11:37.517 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.518+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6115494363612280864', time=2024-09-14T13:11:29.732503+0000, chain.objs.size()=1 2024-09-14T11:11:37.517 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.518+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.121__shadow_.fElm5DJ9oybUiGPgGBBRCwTwWkyvLQe_0 2024-09-14T11:11:37.518 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.519+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:11:37.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.521+0000 7fc90fc63800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:11:37.521 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.522+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.521 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.523+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:37.522 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.523+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:11:37.522 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.523+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.987034587768418588', time=2024-09-14T13:11:21.992883+0000, chain.objs.size()=5 2024-09-14T11:11:37.523 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.523+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.102__multipart_key1.2~FnkcuqOeZ59YS4CZRjSU_UbGGpBHc8w.1 2024-09-14T11:11:37.523 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.523+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.102__multipart_key1.2~FnkcuqOeZ59YS4CZRjSU_UbGGpBHc8w.2 2024-09-14T11:11:37.523 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.523+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.102__multipart_key1.2~FnkcuqOeZ59YS4CZRjSU_UbGGpBHc8w.3 2024-09-14T11:11:37.523 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.523+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.102__multipart_key1.2~FnkcuqOeZ59YS4CZRjSU_UbGGpBHc8w.4 2024-09-14T11:11:37.523 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.523+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.102__multipart_key1.2~FnkcuqOeZ59YS4CZRjSU_UbGGpBHc8w.5 2024-09-14T11:11:37.523 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.523+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3459989028779586321', time=2024-09-14T13:11:29.717169+0000, chain.objs.size()=1 2024-09-14T11:11:37.523 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.523+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.121__shadow_.1GfbHu4umAZ9C1QVDj4QMOSLyFCBHbO_0 2024-09-14T11:11:37.523 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.523+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4996166850159523554', time=2024-09-14T13:11:32.620283+0000, chain.objs.size()=1 2024-09-14T11:11:37.523 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.523+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.131__shadow_.rl0HtOMfXuYg0aIMafxmGeQu_qm77D9_0 2024-09-14T11:11:37.523 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.523+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16355368562100883803', time=2024-09-14T13:11:32.624993+0000, chain.objs.size()=1 2024-09-14T11:11:37.523 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.523+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.131__shadow_.7wanWeljCFCe7r2YGbOzC8ubM-t73Zy_0 2024-09-14T11:11:37.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.527+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:11:37.528 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.529+0000 7fc90fc63800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:11:37.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.530+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.531+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:37.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.531+0000 7fc90fc63800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-14T11:11:37.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.531+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14388735751133165595', time=2024-09-14T13:11:13.861604+0000, chain.objs.size()=5 2024-09-14T11:11:37.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.531+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.94__multipart_key1.2~5M9fwQzwEOEvhtdheUvlHYFSj3X3SKh.1 2024-09-14T11:11:37.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.531+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.94__multipart_key1.2~5M9fwQzwEOEvhtdheUvlHYFSj3X3SKh.2 2024-09-14T11:11:37.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.531+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.94__multipart_key1.2~5M9fwQzwEOEvhtdheUvlHYFSj3X3SKh.3 2024-09-14T11:11:37.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.531+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.94__multipart_key1.2~5M9fwQzwEOEvhtdheUvlHYFSj3X3SKh.4 2024-09-14T11:11:37.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.531+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.94__multipart_key1.2~5M9fwQzwEOEvhtdheUvlHYFSj3X3SKh.5 2024-09-14T11:11:37.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.531+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4798442770411413191', time=2024-09-14T13:11:15.233210+0000, chain.objs.size()=5 2024-09-14T11:11:37.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.531+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.94__multipart_key1.2~-OnCv6EvMgrFE04O6M4nzHXhBqhsR1U.1 2024-09-14T11:11:37.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.531+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.94__shadow_key1.2~-OnCv6EvMgrFE04O6M4nzHXhBqhsR1U.1_1 2024-09-14T11:11:37.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.531+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.94__multipart_key1.2~-OnCv6EvMgrFE04O6M4nzHXhBqhsR1U.2 2024-09-14T11:11:37.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.531+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.94__shadow_key1.2~-OnCv6EvMgrFE04O6M4nzHXhBqhsR1U.2_1 2024-09-14T11:11:37.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.531+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.94__multipart_key1.2~-OnCv6EvMgrFE04O6M4nzHXhBqhsR1U.3 2024-09-14T11:11:37.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.531+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16275580154170194111', time=2024-09-14T13:11:27.987860+0000, chain.objs.size()=1 2024-09-14T11:11:37.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.531+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.115__shadow_.tFI8R3p0gIQAXNpdI8pUWvCLGA2WMHU_0 2024-09-14T11:11:37.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.531+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14356668956536936249', time=2024-09-14T13:11:32.331616+0000, chain.objs.size()=1 2024-09-14T11:11:37.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.531+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.130__shadow_.C9znWw9OfnypNHnX9RMROeeMWN0WNVa_0 2024-09-14T11:11:37.533 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.535+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.207136522694169895', time=2024-09-14T13:11:33.186666+0000, chain.objs.size()=1 2024-09-14T11:11:37.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.535+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.133__shadow_.dieE1RIaAbtCDNJiT2ZC61wXyR5MBVi_0 2024-09-14T11:11:37.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.536+0000 7fc90fc63800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18241066588593508282', time=2024-09-14T13:11:34.290860+0000, chain.objs.size()=1 2024-09-14T11:11:37.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.536+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.138__shadow_.ph-Vno9j-aWMdE6ClRoT8tYOs6DvFCK_0 2024-09-14T11:11:37.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.537+0000 7fc90fc63800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:11:37.539 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.540+0000 7fc7c3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:37.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.542+0000 7fc90fc63800 20 remove_watcher() i=0 2024-09-14T11:11:37.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.542+0000 7fc90fc63800 2 removed watcher, disabling cache 2024-09-14T11:11:37.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.543+0000 7fc90fc63800 20 remove_watcher() i=1 2024-09-14T11:11:37.543 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.544+0000 7fc90fc63800 20 remove_watcher() i=2 2024-09-14T11:11:37.544 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.545+0000 7fc90fc63800 20 remove_watcher() i=3 2024-09-14T11:11:37.544 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.546+0000 7fc90fc63800 20 remove_watcher() i=4 2024-09-14T11:11:37.545 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.547+0000 7fc90fc63800 20 remove_watcher() i=5 2024-09-14T11:11:37.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.548+0000 7fc90fc63800 20 remove_watcher() i=6 2024-09-14T11:11:37.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.549+0000 7fc90fc63800 20 remove_watcher() i=7 2024-09-14T11:11:37.559 DEBUG:teuthology.orchestra.run.smithi097:> radosgw-admin gc process --include-all 2024-09-14T11:11:37.611 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:37.611 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:37.648 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.649+0000 7f90a3330800 20 rados->read ofs=0 len=0 2024-09-14T11:11:37.650 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.651+0000 7f90a3330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:37.650 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.651+0000 7f90a3330800 20 realm 2024-09-14T11:11:37.650 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.651+0000 7f90a3330800 20 rados->read ofs=0 len=0 2024-09-14T11:11:37.650 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.651+0000 7f90a3330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:37.650 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.651+0000 7f90a3330800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:37.650 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.651+0000 7f90a3330800 20 rados->read ofs=0 len=0 2024-09-14T11:11:37.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.651+0000 7f90a3330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:37.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.651+0000 7f90a3330800 20 rados->read ofs=0 len=0 2024-09-14T11:11:37.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.652+0000 7f90a3330800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:37.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.652+0000 7f90a3330800 20 rados->read ofs=0 len=0 2024-09-14T11:11:37.652 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.653+0000 7f90a3330800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:37.652 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.653+0000 7f90a3330800 20 searching for the correct realm 2024-09-14T11:11:37.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.655+0000 7f909f7bd640 0 -- 172.21.15.97:0/3652026960 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f908801e060 msgr2=0x7f9088074fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:37.860 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.861+0000 7f9097fff640 0 -- 172.21.15.97:0/3652026960 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f909006ad10 msgr2=0x7f9090082a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:37.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.866+0000 7f90a3330800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:37.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.866+0000 7f90a3330800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:37.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.866+0000 7f90a3330800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:11:37.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.866+0000 7f90a3330800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:11:37.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.866+0000 7f90a3330800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:37.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.866+0000 7f90a3330800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:37.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.866+0000 7f90a3330800 20 rados->read ofs=0 len=0 2024-09-14T11:11:37.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.867+0000 7f90a3330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:37.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.867+0000 7f90a3330800 20 rados->read ofs=0 len=0 2024-09-14T11:11:37.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.867+0000 7f90a3330800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:37.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.867+0000 7f90a3330800 20 rados->read ofs=0 len=0 2024-09-14T11:11:37.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.867+0000 7f90a3330800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:37.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.867+0000 7f90a3330800 20 zone default found 2024-09-14T11:11:37.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.867+0000 7f90a3330800 4 Realm: () 2024-09-14T11:11:37.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.867+0000 7f90a3330800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:11:37.868 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.867+0000 7f90a3330800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:11:37.868 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.867+0000 7f90a3330800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:37.868 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.867+0000 7f90a3330800 20 zonegroup default 2024-09-14T11:11:37.868 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.867+0000 7f90a3330800 20 rados->read ofs=0 len=0 2024-09-14T11:11:37.868 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.868+0000 7f90a3330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:37.868 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.868+0000 7f90a3330800 20 rados->read ofs=0 len=0 2024-09-14T11:11:37.868 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.868+0000 7f90a3330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:37.868 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.868+0000 7f90a3330800 20 rados->read ofs=0 len=0 2024-09-14T11:11:37.868 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.868+0000 7f90a3330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:37.868 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.868+0000 7f90a3330800 20 started sync module instance, tier type = 2024-09-14T11:11:37.868 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.868+0000 7f90a3330800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:11:37.882 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.883+0000 7f90a3330800 20 add_watcher() i=0 2024-09-14T11:11:37.882 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.883+0000 7f90a3330800 20 add_watcher() i=1 2024-09-14T11:11:37.882 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.883+0000 7f90a3330800 20 add_watcher() i=2 2024-09-14T11:11:37.882 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.883+0000 7f90a3330800 20 add_watcher() i=3 2024-09-14T11:11:37.882 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.883+0000 7f90a3330800 20 add_watcher() i=4 2024-09-14T11:11:37.882 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.883+0000 7f90a3330800 20 add_watcher() i=5 2024-09-14T11:11:37.883 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.883+0000 7f90a3330800 20 add_watcher() i=6 2024-09-14T11:11:37.883 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.885+0000 7f90a3330800 20 add_watcher() i=7 2024-09-14T11:11:37.883 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.885+0000 7f90a3330800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:37.885 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.886+0000 7f8f557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:37.885 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.887+0000 7f90a3330800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:37.885 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.887+0000 7f90a3330800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:37.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.923+0000 7f8ecffff640 20 reqs_thread_entry: start 2024-09-14T11:11:37.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.924+0000 7f90a3330800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:37.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.924+0000 7f90a3330800 20 Filter name: none 2024-09-14T11:11:37.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.924+0000 7f8ecdffb640 20 reqs_thread_entry: start 2024-09-14T11:11:37.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.924+0000 7f90a3330800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:11:37.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.925+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.926+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:37.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.926+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.927+0000 7f90a3330800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:11:37.927 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.928+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.927 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.929+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:37.927 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.929+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.929 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.930+0000 7f90a3330800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:11:37.930 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.931+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.930 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.932+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:37.931 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.932+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.931 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.933+0000 7f90a3330800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:11:37.933 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.934+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.933 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.935+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:37.933 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.935+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.934 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.936+0000 7f90a3330800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:11:37.936 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.937+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.936 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.938+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:37.936 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.938+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.937 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.939+0000 7f90a3330800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:11:37.939 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.940+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.939 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.941+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:37.939 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.941+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.940 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.942+0000 7f90a3330800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:11:37.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.943+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.942 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.943+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:37.942 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.944+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.945+0000 7f90a3330800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:11:37.945 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.946+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.947+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:37.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.947+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.948+0000 7f90a3330800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:11:37.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.950+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.996 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.950+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:37.996 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.950+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.996 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.951+0000 7f90a3330800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:11:37.996 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.953+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.996 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.953+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:37.996 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.953+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.997 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.955+0000 7f90a3330800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:11:37.997 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.958+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.997 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.958+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:37.997 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.958+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.997 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.959+0000 7f90a3330800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:11:37.997 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.961+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.997 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.961+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:37.997 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.961+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.997 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.963+0000 7f90a3330800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:11:37.998 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.964+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.998 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.964+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:37.998 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.965+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.998 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.967+0000 7f90a3330800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:11:37.998 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.968+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.998 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.969+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:37.998 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.969+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.998 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.970+0000 7f90a3330800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:11:37.998 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.972+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.998 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.972+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:37.998 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.972+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:37.998 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.997+0000 7f90a3330800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:11:38.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.998+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:38.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.999+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:38.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:37.999+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:38.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.000+0000 7f90a3330800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:11:38.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.001+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:38.001 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.002+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:38.001 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.002+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:38.001 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.003+0000 7f90a3330800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:11:38.002 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.004+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:38.003 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.004+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:38.004 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.005+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:38.004 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.005+0000 7f90a3330800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:11:38.005 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.007+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:38.006 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.007+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:38.006 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.007+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:38.034 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.036+0000 7f90a3330800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:11:38.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.037+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:38.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.037+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:38.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.038+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:38.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.038+0000 7f90a3330800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:11:38.038 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.040+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:38.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.040+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:38.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.041+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:38.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.041+0000 7f90a3330800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:11:38.042 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.043+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:38.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.043+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:38.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.044+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:38.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.045+0000 7f90a3330800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:11:38.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.046+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:38.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.046+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:38.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.047+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:38.049 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.048+0000 7f90a3330800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:11:38.049 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.049+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:38.049 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.049+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:38.050 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.049+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:38.050 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.050+0000 7f90a3330800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:11:38.051 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.052+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:38.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.052+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:38.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.052+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:38.053 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.054+0000 7f90a3330800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:11:38.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.055+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:38.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.056+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:38.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.056+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:38.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.057+0000 7f90a3330800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:11:38.057 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.059+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:38.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.059+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:38.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.059+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:38.059 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.060+0000 7f90a3330800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:11:38.060 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.061+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:38.061 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.062+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:38.061 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.062+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:38.184 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.185+0000 7f90a3330800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:11:38.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.187+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:38.186 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.187+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:38.186 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.188+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:38.187 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.189+0000 7f90a3330800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:11:38.189 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.190+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:38.189 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.191+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:38.189 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.191+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:38.190 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.192+0000 7f90a3330800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:11:38.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.193+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:38.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.193+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:38.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.194+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:38.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.195+0000 7f90a3330800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:11:38.195 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.196+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:38.195 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.196+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:11:38.195 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.196+0000 7f90a3330800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:11:38.197 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.198+0000 7f8f557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:38.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.200+0000 7f90a3330800 20 remove_watcher() i=0 2024-09-14T11:11:38.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.200+0000 7f90a3330800 2 removed watcher, disabling cache 2024-09-14T11:11:38.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.201+0000 7f90a3330800 20 remove_watcher() i=1 2024-09-14T11:11:38.201 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.203+0000 7f90a3330800 20 remove_watcher() i=2 2024-09-14T11:11:38.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.204+0000 7f90a3330800 20 remove_watcher() i=3 2024-09-14T11:11:38.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.205+0000 7f90a3330800 20 remove_watcher() i=4 2024-09-14T11:11:38.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.206+0000 7f90a3330800 20 remove_watcher() i=5 2024-09-14T11:11:38.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.206+0000 7f90a3330800 20 remove_watcher() i=6 2024-09-14T11:11:38.206 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:38.207+0000 7f90a3330800 20 remove_watcher() i=7 2024-09-14T11:11:38.217 INFO:teuthology.run_tasks:Running task s3tests... 2024-09-14T11:11:38.234 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111'}, 'force-branch': 'ceph-master', 'storage classes': 'LUKEWARM, FROZEN'}} 2024-09-14T11:11:38.234 INFO:tasks.s3tests:Downloading s3-tests... 2024-09-14T11:11:38.234 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2024-09-14T11:11:38.235 DEBUG:teuthology.orchestra.run.smithi097:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-09-14T11:11:38.262 INFO:teuthology.orchestra.run.smithi097.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-09-14T11:11:39.272 INFO:tasks.s3tests:Creating rgw users... 2024-09-14T11:11:39.272 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW11111111111111111 --account-name Mr.RGW11111111111111111 --email RGW11111111111111111+test@test.test 2024-09-14T11:11:39.372 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:39.373 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:39.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.407+0000 7fbf8433e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:39.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.409+0000 7fbf8433e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:39.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.409+0000 7fbf8433e800 20 realm 2024-09-14T11:11:39.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.409+0000 7fbf8433e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:39.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.409+0000 7fbf8433e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:39.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.409+0000 7fbf8433e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:39.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.409+0000 7fbf8433e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:39.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.410+0000 7fbf8433e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:39.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.410+0000 7fbf8433e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:39.411 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.410+0000 7fbf8433e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:39.411 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.410+0000 7fbf8433e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:39.411 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.411+0000 7fbf8433e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:39.411 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.411+0000 7fbf8433e800 20 searching for the correct realm 2024-09-14T11:11:39.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.414+0000 7fbf808ee640 0 -- 172.21.15.97:0/1690617112 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7fbf740c0c50 msgr2=0x7fbf740a9f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:39.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.417+0000 7fbf7f8ec640 0 -- 172.21.15.97:0/1690617112 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7fbf70040960 msgr2=0x7fbf70025400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:39.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.422+0000 7fbf8433e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:39.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.422+0000 7fbf8433e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:39.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.422+0000 7fbf8433e800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:11:39.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.422+0000 7fbf8433e800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:11:39.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.422+0000 7fbf8433e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:39.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.422+0000 7fbf8433e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:39.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.422+0000 7fbf8433e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:39.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.422+0000 7fbf8433e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:39.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.422+0000 7fbf8433e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:39.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.422+0000 7fbf8433e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:39.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.422+0000 7fbf8433e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:39.423 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.423+0000 7fbf8433e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:39.423 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.423+0000 7fbf8433e800 20 zone default found 2024-09-14T11:11:39.423 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.423+0000 7fbf8433e800 4 Realm: () 2024-09-14T11:11:39.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.423+0000 7fbf8433e800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:11:39.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.423+0000 7fbf8433e800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:11:39.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.423+0000 7fbf8433e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:39.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.423+0000 7fbf8433e800 20 zonegroup default 2024-09-14T11:11:39.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.423+0000 7fbf8433e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:39.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.423+0000 7fbf8433e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:39.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.423+0000 7fbf8433e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:39.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.423+0000 7fbf8433e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:39.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.423+0000 7fbf8433e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:39.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.424+0000 7fbf8433e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:39.425 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.424+0000 7fbf8433e800 20 started sync module instance, tier type = 2024-09-14T11:11:39.425 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.424+0000 7fbf8433e800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:11:39.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.434+0000 7fbf8433e800 20 add_watcher() i=0 2024-09-14T11:11:39.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.434+0000 7fbf8433e800 20 add_watcher() i=1 2024-09-14T11:11:39.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.435+0000 7fbf8433e800 20 add_watcher() i=2 2024-09-14T11:11:39.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.435+0000 7fbf8433e800 20 add_watcher() i=3 2024-09-14T11:11:39.434 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.435+0000 7fbf8433e800 20 add_watcher() i=4 2024-09-14T11:11:39.434 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.435+0000 7fbf8433e800 20 add_watcher() i=5 2024-09-14T11:11:39.434 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.435+0000 7fbf8433e800 20 add_watcher() i=6 2024-09-14T11:11:39.434 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.436+0000 7fbf8433e800 20 add_watcher() i=7 2024-09-14T11:11:39.434 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.436+0000 7fbf8433e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:39.438 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.438+0000 7fbe36fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:39.438 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.438+0000 7fbf8433e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:39.438 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.438+0000 7fbf8433e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:39.438 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.438+0000 7fbf8433e800 5 note: GC not initialized 2024-09-14T11:11:39.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.438+0000 7fbe35fdb640 20 reqs_thread_entry: start 2024-09-14T11:11:39.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.438+0000 7fbf8433e800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:39.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.438+0000 7fbf8433e800 20 Filter name: none 2024-09-14T11:11:39.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.438+0000 7fbda77fe640 20 reqs_thread_entry: start 2024-09-14T11:11:39.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.438+0000 7fbf8433e800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 : miss 2024-09-14T11:11:39.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.438+0000 7fbf8433e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:39.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.439+0000 7fbf8433e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:39.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.439+0000 7fbf8433e800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x0 2024-09-14T11:11:39.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.439+0000 7fbf8433e800 10 adding default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-14T11:11:39.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.439+0000 7fbf8433e800 20 failed to read name.$Mr.RGW11111111111111111 with: (2) No such file or directory 2024-09-14T11:11:39.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.439+0000 7fbf8433e800 10 cache get: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test : miss 2024-09-14T11:11:39.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.439+0000 7fbf8433e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:39.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.439+0000 7fbf8433e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:39.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.439+0000 7fbf8433e800 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x0 2024-09-14T11:11:39.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.439+0000 7fbf8433e800 10 adding default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-14T11:11:39.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.439+0000 7fbf8433e800 20 failed to read rgw11111111111111111+test@test.test with: (2) No such file or directory 2024-09-14T11:11:39.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.440+0000 7fbf8433e800 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-14T11:11:39.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.440+0000 7fbf8433e800 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-14T11:11:39.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.440+0000 7fbf8433e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW11111111111111111, ofs0, ns] 2024-09-14T11:11:39.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.440+0000 7fbe577fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595366 cookie 93928852518864 notifier 9072 bl.length()=384 2024-09-14T11:11:39.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.440+0000 7fbe577fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-14T11:11:39.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.440+0000 7fbe577fe640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-14T11:11:39.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.442+0000 7fbf8433e800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-09-14T11:11:39.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.442+0000 7fbf8433e800 10 moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-14T11:11:39.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.442+0000 7fbf8433e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW11111111111111111, ofs0, ns] 2024-09-14T11:11:39.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.442+0000 7fbe56ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595367 cookie 93928852529360 notifier 9072 bl.length()=225 2024-09-14T11:11:39.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.442+0000 7fbe56ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-09-14T11:11:39.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.442+0000 7fbe56ffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-14T11:11:39.444 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.444+0000 7fbf8433e800 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-09-14T11:11:39.444 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.444+0000 7fbf8433e800 10 moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-14T11:11:39.444 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.444+0000 7fbf8433e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw11111111111111111+test@test.test, ofs0, ns] 2024-09-14T11:11:39.445 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.444+0000 7fbe577fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595163 cookie 93928852525296 notifier 9072 bl.length()=234 2024-09-14T11:11:39.445 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.444+0000 7fbe577fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-09-14T11:11:39.445 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.444+0000 7fbe577fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-14T11:11:39.445 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.446+0000 7fbe36fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:39.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.448+0000 7fbf8433e800 20 remove_watcher() i=0 2024-09-14T11:11:39.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.448+0000 7fbf8433e800 2 removed watcher, disabling cache 2024-09-14T11:11:39.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.449+0000 7fbf8433e800 20 remove_watcher() i=1 2024-09-14T11:11:39.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.450+0000 7fbf8433e800 20 remove_watcher() i=2 2024-09-14T11:11:39.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.451+0000 7fbf8433e800 20 remove_watcher() i=3 2024-09-14T11:11:39.450 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.452+0000 7fbf8433e800 20 remove_watcher() i=4 2024-09-14T11:11:39.451 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.453+0000 7fbf8433e800 20 remove_watcher() i=5 2024-09-14T11:11:39.452 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.454+0000 7fbf8433e800 20 remove_watcher() i=6 2024-09-14T11:11:39.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.455+0000 7fbf8433e800 20 remove_watcher() i=7 2024-09-14T11:11:39.462 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-14T11:11:39.462 INFO:teuthology.orchestra.run.smithi097.stdout: "id": "RGW11111111111111111", 2024-09-14T11:11:39.462 INFO:teuthology.orchestra.run.smithi097.stdout: "tenant": "", 2024-09-14T11:11:39.462 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "Mr.RGW11111111111111111", 2024-09-14T11:11:39.462 INFO:teuthology.orchestra.run.smithi097.stdout: "email": "RGW11111111111111111+test@test.test", 2024-09-14T11:11:39.463 INFO:teuthology.orchestra.run.smithi097.stdout: "quota": { 2024-09-14T11:11:39.463 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-14T11:11:39.463 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-14T11:11:39.463 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-14T11:11:39.463 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-14T11:11:39.463 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-14T11:11:39.463 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-14T11:11:39.463 INFO:teuthology.orchestra.run.smithi097.stdout: "bucket_quota": { 2024-09-14T11:11:39.463 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-14T11:11:39.463 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-14T11:11:39.463 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-14T11:11:39.463 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-14T11:11:39.463 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-14T11:11:39.463 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-14T11:11:39.464 INFO:teuthology.orchestra.run.smithi097.stdout: "max_users": 1000, 2024-09-14T11:11:39.464 INFO:teuthology.orchestra.run.smithi097.stdout: "max_roles": 1000, 2024-09-14T11:11:39.464 INFO:teuthology.orchestra.run.smithi097.stdout: "max_groups": 1000, 2024-09-14T11:11:39.464 INFO:teuthology.orchestra.run.smithi097.stdout: "max_buckets": 1000, 2024-09-14T11:11:39.464 INFO:teuthology.orchestra.run.smithi097.stdout: "max_access_keys": 4 2024-09-14T11:11:39.464 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-14T11:11:39.465 DEBUG:tasks.s3tests:Creating user RGW11111111111111111 on client.0 2024-09-14T11:11:39.465 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name Mr.RGW11111111111111111 --email foo+test@test.test --access-key PPDMJTTPHLRSOOHGNQPR --secret tDaSxZM1K+4kh2nhIQ3PtN3ZZROHjRBDFjWPoKEEVbTpou46Fg09Dw== --cluster ceph --account-id RGW11111111111111111 --account-root 2024-09-14T11:11:39.533 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:39.533 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:39.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.570+0000 7fb749f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:39.570 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.571+0000 7fb749f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:39.570 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.571+0000 7fb749f2c800 20 realm 2024-09-14T11:11:39.570 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.571+0000 7fb749f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:39.570 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.571+0000 7fb749f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:39.571 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.571+0000 7fb749f2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:39.571 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.571+0000 7fb749f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:39.571 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.572+0000 7fb749f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:39.571 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.572+0000 7fb749f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:39.571 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.572+0000 7fb749f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:39.571 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.572+0000 7fb749f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:39.572 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.573+0000 7fb749f2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:39.572 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.573+0000 7fb749f2c800 20 searching for the correct realm 2024-09-14T11:11:39.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:39.576+0000 7fb746450640 0 -- 172.21.15.97:0/3046600191 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7fb730045b80 msgr2=0x7fb73005c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:40.381 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.383+0000 7fb745c4f640 0 -- 172.21.15.97:0/3046600191 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7fb73001c3e0 msgr2=0x7fb73001c840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:40.388 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.389+0000 7fb749f2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:40.388 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.389+0000 7fb749f2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:40.388 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.389+0000 7fb749f2c800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:11:40.388 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.389+0000 7fb749f2c800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:11:40.388 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.389+0000 7fb749f2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:40.388 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.389+0000 7fb749f2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:40.388 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.389+0000 7fb749f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:40.388 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.389+0000 7fb749f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:40.388 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.389+0000 7fb749f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:40.389 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.389+0000 7fb749f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:40.389 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.389+0000 7fb749f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:40.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.390+0000 7fb749f2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:40.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.390+0000 7fb749f2c800 20 zone default found 2024-09-14T11:11:40.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.390+0000 7fb749f2c800 4 Realm: () 2024-09-14T11:11:40.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.390+0000 7fb749f2c800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:11:40.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.390+0000 7fb749f2c800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:11:40.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.390+0000 7fb749f2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:40.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.390+0000 7fb749f2c800 20 zonegroup default 2024-09-14T11:11:40.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.390+0000 7fb749f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:40.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.390+0000 7fb749f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:40.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.390+0000 7fb749f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:40.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.390+0000 7fb749f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:40.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.390+0000 7fb749f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:40.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.391+0000 7fb749f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:40.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.391+0000 7fb749f2c800 20 started sync module instance, tier type = 2024-09-14T11:11:40.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.391+0000 7fb749f2c800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:11:40.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.402+0000 7fb749f2c800 20 add_watcher() i=0 2024-09-14T11:11:40.401 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.402+0000 7fb749f2c800 20 add_watcher() i=1 2024-09-14T11:11:40.401 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.402+0000 7fb749f2c800 20 add_watcher() i=2 2024-09-14T11:11:40.401 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.402+0000 7fb749f2c800 20 add_watcher() i=3 2024-09-14T11:11:40.401 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.402+0000 7fb749f2c800 20 add_watcher() i=4 2024-09-14T11:11:40.401 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.402+0000 7fb749f2c800 20 add_watcher() i=5 2024-09-14T11:11:40.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.404+0000 7fb749f2c800 20 add_watcher() i=6 2024-09-14T11:11:40.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.407+0000 7fb749f2c800 20 add_watcher() i=7 2024-09-14T11:11:40.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.407+0000 7fb749f2c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:40.408 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.409+0000 7fb5f77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:40.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.409+0000 7fb749f2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:40.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.409+0000 7fb749f2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:40.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.409+0000 7fb749f2c800 5 note: GC not initialized 2024-09-14T11:11:40.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.410+0000 7fb5f67fc640 20 reqs_thread_entry: start 2024-09-14T11:11:40.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.410+0000 7fb749f2c800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:40.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.410+0000 7fb749f2c800 20 Filter name: none 2024-09-14T11:11:40.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.410+0000 7fb567fff640 20 reqs_thread_entry: start 2024-09-14T11:11:40.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.410+0000 7fb749f2c800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-14T11:11:40.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.410+0000 7fb749f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:40.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.410+0000 7fb749f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:40.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.410+0000 7fb749f2c800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-09-14T11:11:40.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.410+0000 7fb749f2c800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:11:40.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.410+0000 7fb749f2c800 10 cache get: name=default.rgw.meta+users.email+foo+test@test.test : miss 2024-09-14T11:11:40.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.410+0000 7fb749f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:40.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.411+0000 7fb749f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:40.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.411+0000 7fb749f2c800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x0 2024-09-14T11:11:40.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.411+0000 7fb749f2c800 10 adding default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-14T11:11:40.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.411+0000 7fb749f2c800 10 cache get: name=default.rgw.meta+users.keys+PPDMJTTPHLRSOOHGNQPR : miss 2024-09-14T11:11:40.411 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.411+0000 7fb749f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:40.411 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.411+0000 7fb749f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:40.411 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.411+0000 7fb749f2c800 10 cache put: name=default.rgw.meta+users.keys+PPDMJTTPHLRSOOHGNQPR info.flags=0x0 2024-09-14T11:11:40.411 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.411+0000 7fb749f2c800 10 adding default.rgw.meta+users.keys+PPDMJTTPHLRSOOHGNQPR to cache LRU end 2024-09-14T11:11:40.411 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.411+0000 7fb749f2c800 10 cache get: name=default.rgw.meta+accounts+account.RGW11111111111111111 : miss 2024-09-14T11:11:40.411 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.411+0000 7fb749f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:40.411 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.412+0000 7fb749f2c800 20 rados_obj.operate() r=0 bl.length=184 2024-09-14T11:11:40.411 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.412+0000 7fb749f2c800 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-14T11:11:40.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.412+0000 7fb749f2c800 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-14T11:11:40.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.412+0000 7fb749f2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:11:40.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.412+0000 7fb749f2c800 10 cache get: name=default.rgw.meta+users.keys+PPDMJTTPHLRSOOHGNQPR : hit (negative entry) 2024-09-14T11:11:40.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.412+0000 7fb749f2c800 10 cache get: name=default.rgw.meta+users.keys+PPDMJTTPHLRSOOHGNQPR : hit (negative entry) 2024-09-14T11:11:40.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.414+0000 7fb749f2c800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T11:11:40.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.414+0000 7fb749f2c800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:11:40.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.414+0000 7fb749f2c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-14T11:11:40.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.415+0000 7fb6297fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595149 cookie 94470112167504 notifier 8495 bl.length()=673 2024-09-14T11:11:40.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.415+0000 7fb6297fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T11:11:40.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.415+0000 7fb6297fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:11:40.415 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.417+0000 7fb749f2c800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-14T11:11:40.415 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.417+0000 7fb749f2c800 10 moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-14T11:11:40.415 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.417+0000 7fb749f2c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:foo+test@test.test, ofs0, ns] 2024-09-14T11:11:40.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.417+0000 7fb6297fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595368 cookie 94470112183504 notifier 8495 bl.length()=185 2024-09-14T11:11:40.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.417+0000 7fb6297fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-14T11:11:40.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.417+0000 7fb6297fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-14T11:11:40.417 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.419+0000 7fb749f2c800 10 cache put: name=default.rgw.meta+users.keys+PPDMJTTPHLRSOOHGNQPR info.flags=0x7 2024-09-14T11:11:40.417 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.419+0000 7fb749f2c800 10 moving default.rgw.meta+users.keys+PPDMJTTPHLRSOOHGNQPR to cache LRU end 2024-09-14T11:11:40.417 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.419+0000 7fb749f2c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:PPDMJTTPHLRSOOHGNQPR, ofs0, ns] 2024-09-14T11:11:40.418 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.419+0000 7fb628ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595164 cookie 94470112178560 notifier 8495 bl.length()=186 2024-09-14T11:11:40.418 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.419+0000 7fb628ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+PPDMJTTPHLRSOOHGNQPR info.flags=0x7 2024-09-14T11:11:40.418 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.419+0000 7fb628ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+PPDMJTTPHLRSOOHGNQPR to cache LRU end 2024-09-14T11:11:40.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.421+0000 7fb749f2c800 20 linked user foo.client.0 to account RGW11111111111111111 2024-09-14T11:11:40.420 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-14T11:11:40.420 INFO:teuthology.orchestra.run.smithi097.stdout: "user_id": "foo.client.0", 2024-09-14T11:11:40.420 INFO:teuthology.orchestra.run.smithi097.stdout: "display_name": "Mr.RGW11111111111111111", 2024-09-14T11:11:40.420 INFO:teuthology.orchestra.run.smithi097.stdout: "email": "foo+test@test.test", 2024-09-14T11:11:40.420 INFO:teuthology.orchestra.run.smithi097.stdout: "suspended": 0, 2024-09-14T11:11:40.420 INFO:teuthology.orchestra.run.smithi097.stdout: "max_buckets": 1000, 2024-09-14T11:11:40.421 INFO:teuthology.orchestra.run.smithi097.stdout: "subusers": [], 2024-09-14T11:11:40.421 INFO:teuthology.orchestra.run.smithi097.stdout: "keys": [ 2024-09-14T11:11:40.421 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-09-14T11:11:40.421 INFO:teuthology.orchestra.run.smithi097.stdout: "user": "foo.client.0", 2024-09-14T11:11:40.421 INFO:teuthology.orchestra.run.smithi097.stdout: "access_key": "PPDMJTTPHLRSOOHGNQPR", 2024-09-14T11:11:40.421 INFO:teuthology.orchestra.run.smithi097.stdout: "secret_key": "tDaSxZM1K+4kh2nhIQ3PtN3ZZROHjRBDFjWPoKEEVbTpou46Fg09Dw==", 2024-09-14T11:11:40.421 INFO:teuthology.orchestra.run.smithi097.stdout: "active": true, 2024-09-14T11:11:40.421 INFO:teuthology.orchestra.run.smithi097.stdout: "create_date": "2024-09-14T11:11:40.413728Z" 2024-09-14T11:11:40.421 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-14T11:11:40.421 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2024-09-14T11:11:40.421 INFO:teuthology.orchestra.run.smithi097.stdout: "swift_keys": [], 2024-09-14T11:11:40.421 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": [], 2024-09-14T11:11:40.421 INFO:teuthology.orchestra.run.smithi097.stdout: "op_mask": "read, write, delete", 2024-09-14T11:11:40.422 INFO:teuthology.orchestra.run.smithi097.stdout: "default_placement": "", 2024-09-14T11:11:40.422 INFO:teuthology.orchestra.run.smithi097.stdout: "default_storage_class": "", 2024-09-14T11:11:40.422 INFO:teuthology.orchestra.run.smithi097.stdout: "placement_tags": [], 2024-09-14T11:11:40.422 INFO:teuthology.orchestra.run.smithi097.stdout: "bucket_quota": { 2024-09-14T11:11:40.422 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-14T11:11:40.422 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-14T11:11:40.422 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-14T11:11:40.422 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-14T11:11:40.422 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-14T11:11:40.422 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-14T11:11:40.422 INFO:teuthology.orchestra.run.smithi097.stdout: "user_quota": { 2024-09-14T11:11:40.422 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-14T11:11:40.422 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-14T11:11:40.422 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-14T11:11:40.422 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-14T11:11:40.423 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-14T11:11:40.423 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-14T11:11:40.423 INFO:teuthology.orchestra.run.smithi097.stdout: "temp_url_keys": [], 2024-09-14T11:11:40.423 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "root", 2024-09-14T11:11:40.423 INFO:teuthology.orchestra.run.smithi097.stdout: "mfa_ids": [], 2024-09-14T11:11:40.423 INFO:teuthology.orchestra.run.smithi097.stdout: "account_id": "RGW11111111111111111", 2024-09-14T11:11:40.423 INFO:teuthology.orchestra.run.smithi097.stdout: "path": "/", 2024-09-14T11:11:40.423 INFO:teuthology.orchestra.run.smithi097.stdout: "create_date": "2024-09-14T11:11:40.413717Z", 2024-09-14T11:11:40.423 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2024-09-14T11:11:40.423 INFO:teuthology.orchestra.run.smithi097.stdout: "group_ids": [] 2024-09-14T11:11:40.423 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-14T11:11:40.423 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:40.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.422+0000 7fb5f77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:40.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.424+0000 7fb749f2c800 20 remove_watcher() i=0 2024-09-14T11:11:40.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.424+0000 7fb749f2c800 2 removed watcher, disabling cache 2024-09-14T11:11:40.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.426+0000 7fb749f2c800 20 remove_watcher() i=1 2024-09-14T11:11:40.425 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.427+0000 7fb749f2c800 20 remove_watcher() i=2 2024-09-14T11:11:40.426 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.428+0000 7fb749f2c800 20 remove_watcher() i=3 2024-09-14T11:11:40.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.429+0000 7fb749f2c800 20 remove_watcher() i=4 2024-09-14T11:11:40.428 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.430+0000 7fb749f2c800 20 remove_watcher() i=5 2024-09-14T11:11:40.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.433+0000 7fb749f2c800 20 remove_watcher() i=6 2024-09-14T11:11:40.434 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.436+0000 7fb749f2c800 20 remove_watcher() i=7 2024-09-14T11:11:40.446 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 5051607238 --totp-seed NTEJSCUNWWDANDAVUAC47FKKQPG6HEND7UXETWCV5G2VCNKK6CIVVFMQLCZP2JJT --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:11:40.512 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:40.512 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:40.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.548+0000 7fda08c2d800 20 rados->read ofs=0 len=0 2024-09-14T11:11:40.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.550+0000 7fda08c2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:40.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.550+0000 7fda08c2d800 20 realm 2024-09-14T11:11:40.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.550+0000 7fda08c2d800 20 rados->read ofs=0 len=0 2024-09-14T11:11:40.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.550+0000 7fda08c2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:40.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.550+0000 7fda08c2d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:40.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.550+0000 7fda08c2d800 20 rados->read ofs=0 len=0 2024-09-14T11:11:40.551 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.550+0000 7fda08c2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:40.551 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.550+0000 7fda08c2d800 20 rados->read ofs=0 len=0 2024-09-14T11:11:40.551 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.551+0000 7fda08c2d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:40.551 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.551+0000 7fda08c2d800 20 rados->read ofs=0 len=0 2024-09-14T11:11:40.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.552+0000 7fda08c2d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:40.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.552+0000 7fda08c2d800 20 searching for the correct realm 2024-09-14T11:11:40.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.554+0000 7fda06f18640 0 -- 172.21.15.97:0/1554060157 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7fd9fc08c040 msgr2=0x7fd9fc07d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:40.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.760+0000 7fda05f16640 0 -- 172.21.15.97:0/1554060157 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7fd9f80970b0 msgr2=0x7fd9f80838b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:40.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.765+0000 7fda08c2d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:40.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.765+0000 7fda08c2d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:40.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.765+0000 7fda08c2d800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:11:40.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.765+0000 7fda08c2d800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:11:40.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.765+0000 7fda08c2d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:40.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.765+0000 7fda08c2d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:40.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.765+0000 7fda08c2d800 20 rados->read ofs=0 len=0 2024-09-14T11:11:40.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.766+0000 7fda08c2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:40.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.766+0000 7fda08c2d800 20 rados->read ofs=0 len=0 2024-09-14T11:11:40.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.766+0000 7fda08c2d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:40.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.766+0000 7fda08c2d800 20 rados->read ofs=0 len=0 2024-09-14T11:11:40.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.766+0000 7fda08c2d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:40.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.766+0000 7fda08c2d800 20 zone default found 2024-09-14T11:11:40.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.766+0000 7fda08c2d800 4 Realm: () 2024-09-14T11:11:40.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.766+0000 7fda08c2d800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:11:40.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.766+0000 7fda08c2d800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:11:40.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.766+0000 7fda08c2d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:40.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.766+0000 7fda08c2d800 20 zonegroup default 2024-09-14T11:11:40.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.766+0000 7fda08c2d800 20 rados->read ofs=0 len=0 2024-09-14T11:11:40.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.767+0000 7fda08c2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:40.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.767+0000 7fda08c2d800 20 rados->read ofs=0 len=0 2024-09-14T11:11:40.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.767+0000 7fda08c2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:40.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.767+0000 7fda08c2d800 20 rados->read ofs=0 len=0 2024-09-14T11:11:40.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.768+0000 7fda08c2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:40.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.768+0000 7fda08c2d800 20 started sync module instance, tier type = 2024-09-14T11:11:40.768 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.768+0000 7fda08c2d800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:11:40.787 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.788+0000 7fda08c2d800 20 add_watcher() i=0 2024-09-14T11:11:40.787 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.788+0000 7fda08c2d800 20 add_watcher() i=1 2024-09-14T11:11:40.787 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.788+0000 7fda08c2d800 20 add_watcher() i=2 2024-09-14T11:11:40.787 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.788+0000 7fda08c2d800 20 add_watcher() i=3 2024-09-14T11:11:40.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.788+0000 7fda08c2d800 20 add_watcher() i=4 2024-09-14T11:11:40.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.788+0000 7fda08c2d800 20 add_watcher() i=5 2024-09-14T11:11:40.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.788+0000 7fda08c2d800 20 add_watcher() i=6 2024-09-14T11:11:40.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.789+0000 7fda08c2d800 20 add_watcher() i=7 2024-09-14T11:11:40.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.789+0000 7fda08c2d800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:40.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.792+0000 7fd8bcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:40.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.792+0000 7fda08c2d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:40.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.792+0000 7fda08c2d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:40.793 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.792+0000 7fda08c2d800 5 note: GC not initialized 2024-09-14T11:11:40.793 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.792+0000 7fd8377fe640 20 reqs_thread_entry: start 2024-09-14T11:11:40.793 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.792+0000 7fda08c2d800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:40.793 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.792+0000 7fda08c2d800 20 Filter name: none 2024-09-14T11:11:40.793 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.792+0000 7fd8357fa640 20 reqs_thread_entry: start 2024-09-14T11:11:40.793 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.792+0000 7fda08c2d800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-14T11:11:40.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.792+0000 7fda08c2d800 20 rados->read ofs=0 len=0 2024-09-14T11:11:40.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.793+0000 7fda08c2d800 20 rados_obj.operate() r=0 bl.length=488 2024-09-14T11:11:40.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.793+0000 7fda08c2d800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-09-14T11:11:40.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.793+0000 7fda08c2d800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:11:40.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:40.793+0000 7fda08c2d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:11:42.591 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.592+0000 7fda08c2d800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T11:11:42.591 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.592+0000 7fda08c2d800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:11:42.591 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.592+0000 7fda08c2d800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-14T11:11:42.592 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.593+0000 7fd8e97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529742 cookie 94021394458272 notifier 8510 bl.length()=687 2024-09-14T11:11:42.592 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.593+0000 7fd8e97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T11:11:42.592 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.593+0000 7fd8e97fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:11:42.593 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.594+0000 7fd8bcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:42.595 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.597+0000 7fda08c2d800 20 remove_watcher() i=0 2024-09-14T11:11:42.595 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.597+0000 7fda08c2d800 2 removed watcher, disabling cache 2024-09-14T11:11:42.596 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.598+0000 7fda08c2d800 20 remove_watcher() i=1 2024-09-14T11:11:42.597 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.599+0000 7fda08c2d800 20 remove_watcher() i=2 2024-09-14T11:11:42.599 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.600+0000 7fda08c2d800 20 remove_watcher() i=3 2024-09-14T11:11:42.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.601+0000 7fda08c2d800 20 remove_watcher() i=4 2024-09-14T11:11:42.601 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.602+0000 7fda08c2d800 20 remove_watcher() i=5 2024-09-14T11:11:42.602 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.603+0000 7fda08c2d800 20 remove_watcher() i=6 2024-09-14T11:11:42.603 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.605+0000 7fda08c2d800 20 remove_watcher() i=7 2024-09-14T11:11:42.615 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-09-14T11:11:42.615 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name Mr.bar.client.0 --email bar+test@test.test --access-key NCHLUVWEQXXTBLZHMAPR --secret bsqi0n5I+Jf+j5rqXTc0F+J2E+uGN6/BugLXLqlGv84SPL7YOylNNA== --cluster ceph 2024-09-14T11:11:42.679 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:42.680 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:42.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.714+0000 7eff4e146800 20 rados->read ofs=0 len=0 2024-09-14T11:11:42.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.716+0000 7eff4e146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:42.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.716+0000 7eff4e146800 20 realm 2024-09-14T11:11:42.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.716+0000 7eff4e146800 20 rados->read ofs=0 len=0 2024-09-14T11:11:42.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.716+0000 7eff4e146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:42.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.716+0000 7eff4e146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:42.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.716+0000 7eff4e146800 20 rados->read ofs=0 len=0 2024-09-14T11:11:42.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.717+0000 7eff4e146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:42.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.717+0000 7eff4e146800 20 rados->read ofs=0 len=0 2024-09-14T11:11:42.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.717+0000 7eff4e146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:42.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.717+0000 7eff4e146800 20 rados->read ofs=0 len=0 2024-09-14T11:11:42.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.718+0000 7eff4e146800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:42.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.718+0000 7eff4e146800 20 searching for the correct realm 2024-09-14T11:11:42.719 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.720+0000 7eff4c438640 0 -- 172.21.15.97:0/3719372035 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7eff40077040 msgr2=0x7eff400679a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:42.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.925+0000 7eff4b436640 0 -- 172.21.15.97:0/3719372035 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7eff3c072d40 msgr2=0x7eff3c072710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:42.929 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.930+0000 7eff4e146800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:42.929 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.930+0000 7eff4e146800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:42.929 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.930+0000 7eff4e146800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:11:42.929 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.930+0000 7eff4e146800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:11:42.929 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.930+0000 7eff4e146800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:42.929 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.930+0000 7eff4e146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:42.929 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.930+0000 7eff4e146800 20 rados->read ofs=0 len=0 2024-09-14T11:11:42.930 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.930+0000 7eff4e146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:42.930 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.930+0000 7eff4e146800 20 rados->read ofs=0 len=0 2024-09-14T11:11:42.930 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.930+0000 7eff4e146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:42.930 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.930+0000 7eff4e146800 20 rados->read ofs=0 len=0 2024-09-14T11:11:42.931 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.931+0000 7eff4e146800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:42.931 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.931+0000 7eff4e146800 20 zone default found 2024-09-14T11:11:42.931 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.931+0000 7eff4e146800 4 Realm: () 2024-09-14T11:11:42.931 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.931+0000 7eff4e146800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:11:42.931 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.931+0000 7eff4e146800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:11:42.931 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.931+0000 7eff4e146800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:42.931 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.931+0000 7eff4e146800 20 zonegroup default 2024-09-14T11:11:42.932 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.931+0000 7eff4e146800 20 rados->read ofs=0 len=0 2024-09-14T11:11:42.932 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.931+0000 7eff4e146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:42.932 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.931+0000 7eff4e146800 20 rados->read ofs=0 len=0 2024-09-14T11:11:42.932 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.931+0000 7eff4e146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:42.932 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.931+0000 7eff4e146800 20 rados->read ofs=0 len=0 2024-09-14T11:11:42.932 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.932+0000 7eff4e146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:42.932 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.932+0000 7eff4e146800 20 started sync module instance, tier type = 2024-09-14T11:11:42.932 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.932+0000 7eff4e146800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:11:42.944 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.943+0000 7eff4e146800 20 add_watcher() i=0 2024-09-14T11:11:42.944 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.943+0000 7eff4e146800 20 add_watcher() i=1 2024-09-14T11:11:42.944 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.943+0000 7eff4e146800 20 add_watcher() i=2 2024-09-14T11:11:42.945 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.943+0000 7eff4e146800 20 add_watcher() i=3 2024-09-14T11:11:42.945 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.943+0000 7eff4e146800 20 add_watcher() i=4 2024-09-14T11:11:42.945 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.943+0000 7eff4e146800 20 add_watcher() i=5 2024-09-14T11:11:42.945 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.943+0000 7eff4e146800 20 add_watcher() i=6 2024-09-14T11:11:42.945 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.945+0000 7eff4e146800 20 add_watcher() i=7 2024-09-14T11:11:42.945 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.945+0000 7eff4e146800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:42.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.946+0000 7efe01fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:42.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.947+0000 7eff4e146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:42.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.947+0000 7eff4e146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:42.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.947+0000 7eff4e146800 5 note: GC not initialized 2024-09-14T11:11:42.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.947+0000 7efe00fe1640 20 reqs_thread_entry: start 2024-09-14T11:11:42.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.947+0000 7eff4e146800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:42.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.947+0000 7eff4e146800 20 Filter name: none 2024-09-14T11:11:42.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.947+0000 7efd7a7fc640 20 reqs_thread_entry: start 2024-09-14T11:11:42.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.947+0000 7eff4e146800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-14T11:11:42.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.947+0000 7eff4e146800 20 rados->read ofs=0 len=0 2024-09-14T11:11:42.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.948+0000 7eff4e146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:42.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.948+0000 7eff4e146800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-09-14T11:11:42.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.948+0000 7eff4e146800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:11:42.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.948+0000 7eff4e146800 10 cache get: name=default.rgw.meta+users.email+bar+test@test.test : miss 2024-09-14T11:11:42.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.948+0000 7eff4e146800 20 rados->read ofs=0 len=0 2024-09-14T11:11:42.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.948+0000 7eff4e146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:42.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.948+0000 7eff4e146800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x0 2024-09-14T11:11:42.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.948+0000 7eff4e146800 10 adding default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-14T11:11:42.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.948+0000 7eff4e146800 10 cache get: name=default.rgw.meta+users.keys+NCHLUVWEQXXTBLZHMAPR : miss 2024-09-14T11:11:42.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.948+0000 7eff4e146800 20 rados->read ofs=0 len=0 2024-09-14T11:11:42.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.948+0000 7eff4e146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:42.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.948+0000 7eff4e146800 10 cache put: name=default.rgw.meta+users.keys+NCHLUVWEQXXTBLZHMAPR info.flags=0x0 2024-09-14T11:11:42.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.948+0000 7eff4e146800 10 adding default.rgw.meta+users.keys+NCHLUVWEQXXTBLZHMAPR to cache LRU end 2024-09-14T11:11:42.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.948+0000 7eff4e146800 10 cache get: name=default.rgw.meta+users.keys+NCHLUVWEQXXTBLZHMAPR : hit (negative entry) 2024-09-14T11:11:42.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.948+0000 7eff4e146800 10 cache get: name=default.rgw.meta+users.keys+NCHLUVWEQXXTBLZHMAPR : hit (negative entry) 2024-09-14T11:11:42.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.949+0000 7eff4e146800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T11:11:42.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.949+0000 7eff4e146800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:11:42.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.949+0000 7eff4e146800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-14T11:11:42.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.950+0000 7efe2affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529961 cookie 93943052618256 notifier 8528 bl.length()=645 2024-09-14T11:11:42.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.950+0000 7efe2affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T11:11:42.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.950+0000 7efe2affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:11:42.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.952+0000 7eff4e146800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-14T11:11:42.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.952+0000 7eff4e146800 10 moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-14T11:11:42.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.952+0000 7eff4e146800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:bar+test@test.test, ofs0, ns] 2024-09-14T11:11:42.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.952+0000 7efe2a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529940 cookie 93943052631008 notifier 8528 bl.length()=185 2024-09-14T11:11:42.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.952+0000 7efe2a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-14T11:11:42.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.952+0000 7efe2a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-14T11:11:42.952 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.953+0000 7eff4e146800 10 cache put: name=default.rgw.meta+users.keys+NCHLUVWEQXXTBLZHMAPR info.flags=0x7 2024-09-14T11:11:42.952 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.953+0000 7eff4e146800 10 moving default.rgw.meta+users.keys+NCHLUVWEQXXTBLZHMAPR to cache LRU end 2024-09-14T11:11:42.952 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.953+0000 7eff4e146800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:NCHLUVWEQXXTBLZHMAPR, ofs0, ns] 2024-09-14T11:11:42.953 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.954+0000 7efe2affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529941 cookie 93943052634464 notifier 8528 bl.length()=186 2024-09-14T11:11:42.953 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.954+0000 7efe2affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NCHLUVWEQXXTBLZHMAPR info.flags=0x7 2024-09-14T11:11:42.953 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.954+0000 7efe2affd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NCHLUVWEQXXTBLZHMAPR to cache LRU end 2024-09-14T11:11:42.953 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-14T11:11:42.953 INFO:teuthology.orchestra.run.smithi097.stdout: "user_id": "bar.client.0", 2024-09-14T11:11:42.953 INFO:teuthology.orchestra.run.smithi097.stdout: "display_name": "Mr.bar.client.0", 2024-09-14T11:11:42.953 INFO:teuthology.orchestra.run.smithi097.stdout: "email": "bar+test@test.test", 2024-09-14T11:11:42.953 INFO:teuthology.orchestra.run.smithi097.stdout: "suspended": 0, 2024-09-14T11:11:42.954 INFO:teuthology.orchestra.run.smithi097.stdout: "max_buckets": 1000, 2024-09-14T11:11:42.954 INFO:teuthology.orchestra.run.smithi097.stdout: "subusers": [], 2024-09-14T11:11:42.954 INFO:teuthology.orchestra.run.smithi097.stdout: "keys": [ 2024-09-14T11:11:42.954 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-09-14T11:11:42.954 INFO:teuthology.orchestra.run.smithi097.stdout: "user": "bar.client.0", 2024-09-14T11:11:42.954 INFO:teuthology.orchestra.run.smithi097.stdout: "access_key": "NCHLUVWEQXXTBLZHMAPR", 2024-09-14T11:11:42.954 INFO:teuthology.orchestra.run.smithi097.stdout: "secret_key": "bsqi0n5I+Jf+j5rqXTc0F+J2E+uGN6/BugLXLqlGv84SPL7YOylNNA==", 2024-09-14T11:11:42.954 INFO:teuthology.orchestra.run.smithi097.stdout: "active": true, 2024-09-14T11:11:42.954 INFO:teuthology.orchestra.run.smithi097.stdout: "create_date": "2024-09-14T11:11:42.949592Z" 2024-09-14T11:11:42.954 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-14T11:11:42.954 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2024-09-14T11:11:42.954 INFO:teuthology.orchestra.run.smithi097.stdout: "swift_keys": [], 2024-09-14T11:11:42.955 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": [], 2024-09-14T11:11:42.955 INFO:teuthology.orchestra.run.smithi097.stdout: "op_mask": "read, write, delete", 2024-09-14T11:11:42.955 INFO:teuthology.orchestra.run.smithi097.stdout: "default_placement": "", 2024-09-14T11:11:42.955 INFO:teuthology.orchestra.run.smithi097.stdout: "default_storage_class": "", 2024-09-14T11:11:42.955 INFO:teuthology.orchestra.run.smithi097.stdout: "placement_tags": [], 2024-09-14T11:11:42.955 INFO:teuthology.orchestra.run.smithi097.stdout: "bucket_quota": { 2024-09-14T11:11:42.955 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-14T11:11:42.955 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-14T11:11:42.955 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-14T11:11:42.955 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-14T11:11:42.955 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-14T11:11:42.955 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-14T11:11:42.955 INFO:teuthology.orchestra.run.smithi097.stdout: "user_quota": { 2024-09-14T11:11:42.956 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-14T11:11:42.956 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-14T11:11:42.956 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-14T11:11:42.956 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-14T11:11:42.956 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-14T11:11:42.956 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-14T11:11:42.956 INFO:teuthology.orchestra.run.smithi097.stdout: "temp_url_keys": [], 2024-09-14T11:11:42.956 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "rgw", 2024-09-14T11:11:42.956 INFO:teuthology.orchestra.run.smithi097.stdout: "mfa_ids": [], 2024-09-14T11:11:42.956 INFO:teuthology.orchestra.run.smithi097.stdout: "account_id": "", 2024-09-14T11:11:42.956 INFO:teuthology.orchestra.run.smithi097.stdout: "path": "/", 2024-09-14T11:11:42.957 INFO:teuthology.orchestra.run.smithi097.stdout: "create_date": "2024-09-14T11:11:42.949581Z", 2024-09-14T11:11:42.957 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2024-09-14T11:11:42.957 INFO:teuthology.orchestra.run.smithi097.stdout: "group_ids": [] 2024-09-14T11:11:42.957 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-14T11:11:42.957 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:42.958 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.955+0000 7efe01fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:42.958 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.957+0000 7eff4e146800 20 remove_watcher() i=0 2024-09-14T11:11:42.958 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.957+0000 7eff4e146800 2 removed watcher, disabling cache 2024-09-14T11:11:42.958 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.958+0000 7eff4e146800 20 remove_watcher() i=1 2024-09-14T11:11:42.958 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.959+0000 7eff4e146800 20 remove_watcher() i=2 2024-09-14T11:11:42.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.960+0000 7eff4e146800 20 remove_watcher() i=3 2024-09-14T11:11:42.960 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.961+0000 7eff4e146800 20 remove_watcher() i=4 2024-09-14T11:11:42.961 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.962+0000 7eff4e146800 20 remove_watcher() i=5 2024-09-14T11:11:42.962 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.963+0000 7eff4e146800 20 remove_watcher() i=6 2024-09-14T11:11:42.963 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:42.964+0000 7eff4e146800 20 remove_watcher() i=7 2024-09-14T11:11:42.974 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 6197345293 --totp-seed RU7JMULFCO7VGUNWVSPB4LUMERTP5XKLKEYKFPVB5MQQDMM5H7CU2JVHUM7SZSYU --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:11:43.040 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:43.040 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:43.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.074+0000 7f1ee0c98800 20 rados->read ofs=0 len=0 2024-09-14T11:11:43.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.076+0000 7f1ee0c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:43.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.076+0000 7f1ee0c98800 20 realm 2024-09-14T11:11:43.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.076+0000 7f1ee0c98800 20 rados->read ofs=0 len=0 2024-09-14T11:11:43.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.076+0000 7f1ee0c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:43.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.076+0000 7f1ee0c98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:43.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.076+0000 7f1ee0c98800 20 rados->read ofs=0 len=0 2024-09-14T11:11:43.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.076+0000 7f1ee0c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:43.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.076+0000 7f1ee0c98800 20 rados->read ofs=0 len=0 2024-09-14T11:11:43.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.279+0000 7f1ee0c98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:43.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.279+0000 7f1ee0c98800 20 rados->read ofs=0 len=0 2024-09-14T11:11:43.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.280+0000 7f1ee0c98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:43.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.280+0000 7f1ee0c98800 20 searching for the correct realm 2024-09-14T11:11:43.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.282+0000 7f1eddf81640 0 -- 172.21.15.97:0/18730144 >> [v2:172.21.15.97:6808/2081705332,v1:172.21.15.97:6809/2081705332] conn(0x7f1ed003d410 msgr2=0x7f1ed003d890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:43.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.286+0000 7f1ede782640 0 -- 172.21.15.97:0/18730144 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7f1ec809c930 msgr2=0x7f1ec8080400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:11:43.493 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.494+0000 7f1ee0c98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:43.493 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.494+0000 7f1ee0c98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:43.493 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.494+0000 7f1ee0c98800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:11:43.494 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.494+0000 7f1ee0c98800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:11:43.494 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.494+0000 7f1ee0c98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:43.494 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.494+0000 7f1ee0c98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:43.494 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.494+0000 7f1ee0c98800 20 rados->read ofs=0 len=0 2024-09-14T11:11:43.494 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.495+0000 7f1ee0c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:43.494 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.495+0000 7f1ee0c98800 20 rados->read ofs=0 len=0 2024-09-14T11:11:43.495 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.495+0000 7f1ee0c98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:43.495 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.495+0000 7f1ee0c98800 20 rados->read ofs=0 len=0 2024-09-14T11:11:43.495 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.495+0000 7f1ee0c98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:43.495 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.495+0000 7f1ee0c98800 20 zone default found 2024-09-14T11:11:43.495 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.495+0000 7f1ee0c98800 4 Realm: () 2024-09-14T11:11:43.496 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.495+0000 7f1ee0c98800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:11:43.496 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.495+0000 7f1ee0c98800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:11:43.496 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.495+0000 7f1ee0c98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:43.496 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.495+0000 7f1ee0c98800 20 zonegroup default 2024-09-14T11:11:43.496 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.495+0000 7f1ee0c98800 20 rados->read ofs=0 len=0 2024-09-14T11:11:43.496 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.496+0000 7f1ee0c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:43.496 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.496+0000 7f1ee0c98800 20 rados->read ofs=0 len=0 2024-09-14T11:11:43.496 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.496+0000 7f1ee0c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:43.496 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.496+0000 7f1ee0c98800 20 rados->read ofs=0 len=0 2024-09-14T11:11:43.496 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.496+0000 7f1ee0c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:43.496 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.496+0000 7f1ee0c98800 20 started sync module instance, tier type = 2024-09-14T11:11:43.496 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.496+0000 7f1ee0c98800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:11:43.517 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.518+0000 7f1ee0c98800 20 add_watcher() i=0 2024-09-14T11:11:43.517 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.518+0000 7f1ee0c98800 20 add_watcher() i=1 2024-09-14T11:11:43.517 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.518+0000 7f1ee0c98800 20 add_watcher() i=2 2024-09-14T11:11:43.517 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.518+0000 7f1ee0c98800 20 add_watcher() i=3 2024-09-14T11:11:43.517 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.518+0000 7f1ee0c98800 20 add_watcher() i=4 2024-09-14T11:11:43.517 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.518+0000 7f1ee0c98800 20 add_watcher() i=5 2024-09-14T11:11:43.518 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.518+0000 7f1ee0c98800 20 add_watcher() i=6 2024-09-14T11:11:43.519 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.521+0000 7f1ee0c98800 20 add_watcher() i=7 2024-09-14T11:11:43.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.521+0000 7f1ee0c98800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:43.523 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.523+0000 7f1d94fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:43.523 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.523+0000 7f1ee0c98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:43.523 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.523+0000 7f1ee0c98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:43.523 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.524+0000 7f1ee0c98800 5 note: GC not initialized 2024-09-14T11:11:43.523 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.524+0000 7f1d0f7fe640 20 reqs_thread_entry: start 2024-09-14T11:11:43.523 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.524+0000 7f1ee0c98800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:43.523 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.524+0000 7f1ee0c98800 20 Filter name: none 2024-09-14T11:11:43.523 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.524+0000 7f1d0d7fa640 20 reqs_thread_entry: start 2024-09-14T11:11:43.523 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.524+0000 7f1ee0c98800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-14T11:11:43.523 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.524+0000 7f1ee0c98800 20 rados->read ofs=0 len=0 2024-09-14T11:11:43.524 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.525+0000 7f1ee0c98800 20 rados_obj.operate() r=0 bl.length=460 2024-09-14T11:11:43.524 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.525+0000 7f1ee0c98800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-09-14T11:11:43.524 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.525+0000 7f1ee0c98800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:11:43.524 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.525+0000 7f1ee0c98800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:11:43.527 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.528+0000 7f1ee0c98800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T11:11:43.527 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.528+0000 7f1ee0c98800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:11:43.527 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.528+0000 7f1ee0c98800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-14T11:11:43.527 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.528+0000 7f1dc1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529962 cookie 94220877978160 notifier 8546 bl.length()=659 2024-09-14T11:11:43.527 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.528+0000 7f1dc1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T11:11:43.527 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.528+0000 7f1dc1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:11:43.528 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.529+0000 7f1d94fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:43.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.532+0000 7f1ee0c98800 20 remove_watcher() i=0 2024-09-14T11:11:43.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.532+0000 7f1ee0c98800 2 removed watcher, disabling cache 2024-09-14T11:11:43.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.533+0000 7f1ee0c98800 20 remove_watcher() i=1 2024-09-14T11:11:43.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.536+0000 7f1ee0c98800 20 remove_watcher() i=2 2024-09-14T11:11:43.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.537+0000 7f1ee0c98800 20 remove_watcher() i=3 2024-09-14T11:11:43.537 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.538+0000 7f1ee0c98800 20 remove_watcher() i=4 2024-09-14T11:11:43.538 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.539+0000 7f1ee0c98800 20 remove_watcher() i=5 2024-09-14T11:11:43.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.542+0000 7f1ee0c98800 20 remove_watcher() i=6 2024-09-14T11:11:43.544 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.545+0000 7f1ee0c98800 20 remove_watcher() i=7 2024-09-14T11:11:43.555 DEBUG:tasks.s3tests:Creating user testx$tenanteduser.client.0 on client.0 2024-09-14T11:11:43.555 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name 'Mr.testx$tenanteduser.client.0' --email 'testx$tenanteduser+test@test.test' --access-key YYQVUSPXNYVPIMJWEIDG --secret +eLepKj1U/uC5B5iFtGH+WGzhH+KSGhAvU2feJ73IQQ5KZdZDWjPFQ== --cluster ceph 2024-09-14T11:11:43.624 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:43.624 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:43.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.671+0000 7fd85cbaf800 20 rados->read ofs=0 len=0 2024-09-14T11:11:43.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.673+0000 7fd85cbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:43.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.673+0000 7fd85cbaf800 20 realm 2024-09-14T11:11:43.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.673+0000 7fd85cbaf800 20 rados->read ofs=0 len=0 2024-09-14T11:11:43.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.673+0000 7fd85cbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:43.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.673+0000 7fd85cbaf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:43.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.673+0000 7fd85cbaf800 20 rados->read ofs=0 len=0 2024-09-14T11:11:43.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.673+0000 7fd85cbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:43.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.673+0000 7fd85cbaf800 20 rados->read ofs=0 len=0 2024-09-14T11:11:43.673 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.674+0000 7fd85cbaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:43.673 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.674+0000 7fd85cbaf800 20 rados->read ofs=0 len=0 2024-09-14T11:11:43.673 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.675+0000 7fd85cbaf800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:43.673 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.675+0000 7fd85cbaf800 20 searching for the correct realm 2024-09-14T11:11:43.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.677+0000 7fd85aea1640 0 -- 172.21.15.97:0/1743540163 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7fd8440a2be0 msgr2=0x7fd844015970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:43.882 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.883+0000 7fd859e9f640 0 -- 172.21.15.97:0/1743540163 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7fd84c0ab2e0 msgr2=0x7fd84c0c7460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:43.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.888+0000 7fd85cbaf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:43.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.888+0000 7fd85cbaf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:43.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.888+0000 7fd85cbaf800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:11:43.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.888+0000 7fd85cbaf800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:11:43.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.888+0000 7fd85cbaf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:43.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.888+0000 7fd85cbaf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:43.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.888+0000 7fd85cbaf800 20 rados->read ofs=0 len=0 2024-09-14T11:11:43.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.888+0000 7fd85cbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:43.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.888+0000 7fd85cbaf800 20 rados->read ofs=0 len=0 2024-09-14T11:11:43.889 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.888+0000 7fd85cbaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:43.889 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.888+0000 7fd85cbaf800 20 rados->read ofs=0 len=0 2024-09-14T11:11:43.889 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.889+0000 7fd85cbaf800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:43.889 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.889+0000 7fd85cbaf800 20 zone default found 2024-09-14T11:11:43.889 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.889+0000 7fd85cbaf800 4 Realm: () 2024-09-14T11:11:43.889 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.889+0000 7fd85cbaf800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:11:43.889 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.889+0000 7fd85cbaf800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:11:43.889 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.889+0000 7fd85cbaf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:43.889 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.889+0000 7fd85cbaf800 20 zonegroup default 2024-09-14T11:11:43.889 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.889+0000 7fd85cbaf800 20 rados->read ofs=0 len=0 2024-09-14T11:11:43.889 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.889+0000 7fd85cbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:43.889 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.889+0000 7fd85cbaf800 20 rados->read ofs=0 len=0 2024-09-14T11:11:43.889 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.889+0000 7fd85cbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:43.889 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.889+0000 7fd85cbaf800 20 rados->read ofs=0 len=0 2024-09-14T11:11:43.890 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.890+0000 7fd85cbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:43.890 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.890+0000 7fd85cbaf800 20 started sync module instance, tier type = 2024-09-14T11:11:43.890 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.890+0000 7fd85cbaf800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:11:43.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.913+0000 7fd85cbaf800 20 add_watcher() i=0 2024-09-14T11:11:43.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.913+0000 7fd85cbaf800 20 add_watcher() i=1 2024-09-14T11:11:43.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.913+0000 7fd85cbaf800 20 add_watcher() i=2 2024-09-14T11:11:43.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.913+0000 7fd85cbaf800 20 add_watcher() i=3 2024-09-14T11:11:43.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.913+0000 7fd85cbaf800 20 add_watcher() i=4 2024-09-14T11:11:43.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.913+0000 7fd85cbaf800 20 add_watcher() i=5 2024-09-14T11:11:43.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.913+0000 7fd85cbaf800 20 add_watcher() i=6 2024-09-14T11:11:43.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.915+0000 7fd85cbaf800 20 add_watcher() i=7 2024-09-14T11:11:43.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.915+0000 7fd85cbaf800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:43.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.917+0000 7fd710fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:43.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.917+0000 7fd85cbaf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:43.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.917+0000 7fd85cbaf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:43.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.917+0000 7fd85cbaf800 5 note: GC not initialized 2024-09-14T11:11:43.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.917+0000 7fd68b7fe640 20 reqs_thread_entry: start 2024-09-14T11:11:43.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.918+0000 7fd85cbaf800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:43.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.918+0000 7fd85cbaf800 20 Filter name: none 2024-09-14T11:11:43.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.918+0000 7fd6897fa640 20 reqs_thread_entry: start 2024-09-14T11:11:43.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.918+0000 7fd85cbaf800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-14T11:11:43.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.918+0000 7fd85cbaf800 20 rados->read ofs=0 len=0 2024-09-14T11:11:43.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.918+0000 7fd85cbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:43.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.918+0000 7fd85cbaf800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-09-14T11:11:43.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.918+0000 7fd85cbaf800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:11:43.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.918+0000 7fd85cbaf800 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test : miss 2024-09-14T11:11:43.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.918+0000 7fd85cbaf800 20 rados->read ofs=0 len=0 2024-09-14T11:11:43.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.919+0000 7fd85cbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:43.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.919+0000 7fd85cbaf800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x0 2024-09-14T11:11:43.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.919+0000 7fd85cbaf800 10 adding default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-14T11:11:43.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.919+0000 7fd85cbaf800 10 cache get: name=default.rgw.meta+users.keys+YYQVUSPXNYVPIMJWEIDG : miss 2024-09-14T11:11:43.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.919+0000 7fd85cbaf800 20 rados->read ofs=0 len=0 2024-09-14T11:11:43.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.919+0000 7fd85cbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:43.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.919+0000 7fd85cbaf800 10 cache put: name=default.rgw.meta+users.keys+YYQVUSPXNYVPIMJWEIDG info.flags=0x0 2024-09-14T11:11:43.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.919+0000 7fd85cbaf800 10 adding default.rgw.meta+users.keys+YYQVUSPXNYVPIMJWEIDG to cache LRU end 2024-09-14T11:11:43.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.919+0000 7fd85cbaf800 10 cache get: name=default.rgw.meta+users.keys+YYQVUSPXNYVPIMJWEIDG : hit (negative entry) 2024-09-14T11:11:43.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.919+0000 7fd85cbaf800 10 cache get: name=default.rgw.meta+users.keys+YYQVUSPXNYVPIMJWEIDG : hit (negative entry) 2024-09-14T11:11:43.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.920+0000 7fd85cbaf800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T11:11:43.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.920+0000 7fd85cbaf800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:11:43.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.920+0000 7fd85cbaf800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-14T11:11:43.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.921+0000 7fd73dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497238 cookie 94585804601056 notifier 8564 bl.length()=719 2024-09-14T11:11:43.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.921+0000 7fd73dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T11:11:43.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.921+0000 7fd73dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:11:43.921 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.922+0000 7fd85cbaf800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-14T11:11:43.921 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.922+0000 7fd85cbaf800 10 moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-14T11:11:43.921 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.922+0000 7fd85cbaf800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser+test@test.test, ofs0, ns] 2024-09-14T11:11:43.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.923+0000 7fd73dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497239 cookie 94585804604672 notifier 8564 bl.length()=215 2024-09-14T11:11:43.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.923+0000 7fd73dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-14T11:11:43.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.923+0000 7fd73dffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-14T11:11:43.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.924+0000 7fd85cbaf800 10 cache put: name=default.rgw.meta+users.keys+YYQVUSPXNYVPIMJWEIDG info.flags=0x7 2024-09-14T11:11:43.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.924+0000 7fd85cbaf800 10 moving default.rgw.meta+users.keys+YYQVUSPXNYVPIMJWEIDG to cache LRU end 2024-09-14T11:11:43.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.924+0000 7fd85cbaf800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:YYQVUSPXNYVPIMJWEIDG, ofs0, ns] 2024-09-14T11:11:43.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.924+0000 7fd73d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497240 cookie 94585804604672 notifier 8564 bl.length()=201 2024-09-14T11:11:43.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.924+0000 7fd73d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+YYQVUSPXNYVPIMJWEIDG info.flags=0x7 2024-09-14T11:11:43.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.924+0000 7fd73d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+YYQVUSPXNYVPIMJWEIDG to cache LRU end 2024-09-14T11:11:43.924 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-14T11:11:43.924 INFO:teuthology.orchestra.run.smithi097.stdout: "user_id": "testx$tenanteduser.client.0", 2024-09-14T11:11:43.924 INFO:teuthology.orchestra.run.smithi097.stdout: "display_name": "Mr.testx$tenanteduser.client.0", 2024-09-14T11:11:43.924 INFO:teuthology.orchestra.run.smithi097.stdout: "email": "testx$tenanteduser+test@test.test", 2024-09-14T11:11:43.924 INFO:teuthology.orchestra.run.smithi097.stdout: "suspended": 0, 2024-09-14T11:11:43.924 INFO:teuthology.orchestra.run.smithi097.stdout: "max_buckets": 1000, 2024-09-14T11:11:43.924 INFO:teuthology.orchestra.run.smithi097.stdout: "subusers": [], 2024-09-14T11:11:43.924 INFO:teuthology.orchestra.run.smithi097.stdout: "keys": [ 2024-09-14T11:11:43.924 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-09-14T11:11:43.924 INFO:teuthology.orchestra.run.smithi097.stdout: "user": "testx$tenanteduser.client.0", 2024-09-14T11:11:43.924 INFO:teuthology.orchestra.run.smithi097.stdout: "access_key": "YYQVUSPXNYVPIMJWEIDG", 2024-09-14T11:11:43.925 INFO:teuthology.orchestra.run.smithi097.stdout: "secret_key": "+eLepKj1U/uC5B5iFtGH+WGzhH+KSGhAvU2feJ73IQQ5KZdZDWjPFQ==", 2024-09-14T11:11:43.925 INFO:teuthology.orchestra.run.smithi097.stdout: "active": true, 2024-09-14T11:11:43.925 INFO:teuthology.orchestra.run.smithi097.stdout: "create_date": "2024-09-14T11:11:43.920289Z" 2024-09-14T11:11:43.925 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-14T11:11:43.925 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2024-09-14T11:11:43.925 INFO:teuthology.orchestra.run.smithi097.stdout: "swift_keys": [], 2024-09-14T11:11:43.925 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": [], 2024-09-14T11:11:43.925 INFO:teuthology.orchestra.run.smithi097.stdout: "op_mask": "read, write, delete", 2024-09-14T11:11:43.925 INFO:teuthology.orchestra.run.smithi097.stdout: "default_placement": "", 2024-09-14T11:11:43.925 INFO:teuthology.orchestra.run.smithi097.stdout: "default_storage_class": "", 2024-09-14T11:11:43.925 INFO:teuthology.orchestra.run.smithi097.stdout: "placement_tags": [], 2024-09-14T11:11:43.925 INFO:teuthology.orchestra.run.smithi097.stdout: "bucket_quota": { 2024-09-14T11:11:43.925 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-14T11:11:43.925 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-14T11:11:43.926 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-14T11:11:43.926 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-14T11:11:43.926 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-14T11:11:43.926 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-14T11:11:43.926 INFO:teuthology.orchestra.run.smithi097.stdout: "user_quota": { 2024-09-14T11:11:43.926 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-14T11:11:43.926 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-14T11:11:43.926 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-14T11:11:43.926 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-14T11:11:43.926 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-14T11:11:43.926 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-14T11:11:43.926 INFO:teuthology.orchestra.run.smithi097.stdout: "temp_url_keys": [], 2024-09-14T11:11:43.926 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "rgw", 2024-09-14T11:11:43.927 INFO:teuthology.orchestra.run.smithi097.stdout: "mfa_ids": [], 2024-09-14T11:11:43.927 INFO:teuthology.orchestra.run.smithi097.stdout: "account_id": "", 2024-09-14T11:11:43.927 INFO:teuthology.orchestra.run.smithi097.stdout: "path": "/", 2024-09-14T11:11:43.927 INFO:teuthology.orchestra.run.smithi097.stdout: "create_date": "2024-09-14T11:11:43.920273Z", 2024-09-14T11:11:43.927 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2024-09-14T11:11:43.927 INFO:teuthology.orchestra.run.smithi097.stdout: "group_ids": [] 2024-09-14T11:11:43.927 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-14T11:11:43.927 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:43.928 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.926+0000 7fd710fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:43.928 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.928+0000 7fd85cbaf800 20 remove_watcher() i=0 2024-09-14T11:11:43.928 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.928+0000 7fd85cbaf800 2 removed watcher, disabling cache 2024-09-14T11:11:43.928 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.929+0000 7fd85cbaf800 20 remove_watcher() i=1 2024-09-14T11:11:43.930 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.932+0000 7fd85cbaf800 20 remove_watcher() i=2 2024-09-14T11:11:43.931 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.933+0000 7fd85cbaf800 20 remove_watcher() i=3 2024-09-14T11:11:43.932 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.933+0000 7fd85cbaf800 20 remove_watcher() i=4 2024-09-14T11:11:43.933 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.934+0000 7fd85cbaf800 20 remove_watcher() i=5 2024-09-14T11:11:43.934 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.936+0000 7fd85cbaf800 20 remove_watcher() i=6 2024-09-14T11:11:43.935 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:43.937+0000 7fd85cbaf800 20 remove_watcher() i=7 2024-09-14T11:11:43.946 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 6824449730 --totp-seed OE7K2XEWO345GLEJAEOXHYFUEKTHCU7MLJDDS2VDIJQRMGG4MXBBM4ZB5NPHCDFQ --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:11:44.012 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:44.012 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:44.046 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.047+0000 7f04cfe14800 20 rados->read ofs=0 len=0 2024-09-14T11:11:44.047 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.049+0000 7f04cfe14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:44.048 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.049+0000 7f04cfe14800 20 realm 2024-09-14T11:11:44.048 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.049+0000 7f04cfe14800 20 rados->read ofs=0 len=0 2024-09-14T11:11:44.048 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.049+0000 7f04cfe14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:44.048 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.049+0000 7f04cfe14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:44.048 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.049+0000 7f04cfe14800 20 rados->read ofs=0 len=0 2024-09-14T11:11:44.048 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.049+0000 7f04cfe14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:44.048 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.049+0000 7f04cfe14800 20 rados->read ofs=0 len=0 2024-09-14T11:11:44.049 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.050+0000 7f04cfe14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:44.049 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.050+0000 7f04cfe14800 20 rados->read ofs=0 len=0 2024-09-14T11:11:44.049 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.051+0000 7f04cfe14800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:44.050 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.051+0000 7f04cfe14800 20 searching for the correct realm 2024-09-14T11:11:44.051 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.053+0000 7f04cbccc640 0 -- 172.21.15.97:0/1442479047 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f04c001a040 msgr2=0x7f04c0069bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:44.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.258+0000 7f04cacca640 0 -- 172.21.15.97:0/1442479047 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f04bc085960 msgr2=0x7f04bc0613c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:44.262 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.263+0000 7f04cfe14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:44.262 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.263+0000 7f04cfe14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:44.262 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.263+0000 7f04cfe14800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:11:44.262 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.263+0000 7f04cfe14800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:11:44.262 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.263+0000 7f04cfe14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:44.262 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.263+0000 7f04cfe14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:44.262 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.263+0000 7f04cfe14800 20 rados->read ofs=0 len=0 2024-09-14T11:11:44.262 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.263+0000 7f04cfe14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:44.262 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.263+0000 7f04cfe14800 20 rados->read ofs=0 len=0 2024-09-14T11:11:44.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.264+0000 7f04cfe14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:44.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.264+0000 7f04cfe14800 20 rados->read ofs=0 len=0 2024-09-14T11:11:44.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.264+0000 7f04cfe14800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:44.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.264+0000 7f04cfe14800 20 zone default found 2024-09-14T11:11:44.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.264+0000 7f04cfe14800 4 Realm: () 2024-09-14T11:11:44.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.264+0000 7f04cfe14800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:11:44.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.264+0000 7f04cfe14800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:11:44.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.264+0000 7f04cfe14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:44.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.264+0000 7f04cfe14800 20 zonegroup default 2024-09-14T11:11:44.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.264+0000 7f04cfe14800 20 rados->read ofs=0 len=0 2024-09-14T11:11:44.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.264+0000 7f04cfe14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:44.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.264+0000 7f04cfe14800 20 rados->read ofs=0 len=0 2024-09-14T11:11:44.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.265+0000 7f04cfe14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:44.265 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.265+0000 7f04cfe14800 20 rados->read ofs=0 len=0 2024-09-14T11:11:44.265 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.265+0000 7f04cfe14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:44.265 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.265+0000 7f04cfe14800 20 started sync module instance, tier type = 2024-09-14T11:11:44.265 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.265+0000 7f04cfe14800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:11:44.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.279+0000 7f04cfe14800 20 add_watcher() i=0 2024-09-14T11:11:44.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.279+0000 7f04cfe14800 20 add_watcher() i=1 2024-09-14T11:11:44.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.279+0000 7f04cfe14800 20 add_watcher() i=2 2024-09-14T11:11:44.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.279+0000 7f04cfe14800 20 add_watcher() i=3 2024-09-14T11:11:44.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.279+0000 7f04cfe14800 20 add_watcher() i=4 2024-09-14T11:11:44.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.279+0000 7f04cfe14800 20 add_watcher() i=5 2024-09-14T11:11:44.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.279+0000 7f04cfe14800 20 add_watcher() i=6 2024-09-14T11:11:44.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.282+0000 7f04cfe14800 20 add_watcher() i=7 2024-09-14T11:11:44.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.282+0000 7f04cfe14800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:44.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.284+0000 7f03827e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:44.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.284+0000 7f04cfe14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:44.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.284+0000 7f04cfe14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:44.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.284+0000 7f04cfe14800 5 note: GC not initialized 2024-09-14T11:11:44.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.285+0000 7f03817e2640 20 reqs_thread_entry: start 2024-09-14T11:11:44.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.285+0000 7f04cfe14800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:44.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.285+0000 7f04cfe14800 20 Filter name: none 2024-09-14T11:11:44.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.285+0000 7f037a7fc640 20 reqs_thread_entry: start 2024-09-14T11:11:44.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.285+0000 7f04cfe14800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-14T11:11:44.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.285+0000 7f04cfe14800 20 rados->read ofs=0 len=0 2024-09-14T11:11:44.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.286+0000 7f04cfe14800 20 rados_obj.operate() r=0 bl.length=519 2024-09-14T11:11:44.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.286+0000 7f04cfe14800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-09-14T11:11:44.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.286+0000 7f04cfe14800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:11:44.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.286+0000 7f04cfe14800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:11:44.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.288+0000 7f04cfe14800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T11:11:44.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.288+0000 7f04cfe14800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:11:44.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.288+0000 7f04cfe14800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-14T11:11:44.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.289+0000 7f03aeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497241 cookie 94005075472048 notifier 9183 bl.length()=733 2024-09-14T11:11:44.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.289+0000 7f03aeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T11:11:44.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.289+0000 7f03aeffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:11:44.288 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.290+0000 7f03827e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:44.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.292+0000 7f04cfe14800 20 remove_watcher() i=0 2024-09-14T11:11:44.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.292+0000 7f04cfe14800 2 removed watcher, disabling cache 2024-09-14T11:11:44.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.293+0000 7f04cfe14800 20 remove_watcher() i=1 2024-09-14T11:11:44.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.295+0000 7f04cfe14800 20 remove_watcher() i=2 2024-09-14T11:11:44.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.296+0000 7f04cfe14800 20 remove_watcher() i=3 2024-09-14T11:11:44.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.297+0000 7f04cfe14800 20 remove_watcher() i=4 2024-09-14T11:11:44.296 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.298+0000 7f04cfe14800 20 remove_watcher() i=5 2024-09-14T11:11:44.299 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.301+0000 7f04cfe14800 20 remove_watcher() i=6 2024-09-14T11:11:44.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.303+0000 7f04cfe14800 20 remove_watcher() i=7 2024-09-14T11:11:44.313 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-09-14T11:11:44.314 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name Mr.foobar.client.0 --email foobar+test@test.test --access-key HIYDCCWRDYKEONIHBGFU --secret Xa6GukX+be1N1kQPdLU2qQuJovWpjmCq1bTEvuiYNHZgJ+P338KEzg== --cluster ceph 2024-09-14T11:11:44.377 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:44.377 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:44.411 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.412+0000 7f1c1e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:44.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.414+0000 7f1c1e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:44.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.414+0000 7f1c1e72c800 20 realm 2024-09-14T11:11:44.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.414+0000 7f1c1e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:44.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.414+0000 7f1c1e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:44.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.414+0000 7f1c1e72c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:44.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.414+0000 7f1c1e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:44.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.414+0000 7f1c1e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:44.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.414+0000 7f1c1e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:44.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.415+0000 7f1c1e72c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:44.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.415+0000 7f1c1e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:44.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.416+0000 7f1c1e72c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:44.415 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.416+0000 7f1c1e72c800 20 searching for the correct realm 2024-09-14T11:11:44.417 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.418+0000 7f1c1ab3f640 0 -- 172.21.15.97:0/3138324989 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f1c10015a80 msgr2=0x7f1c10031430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:11:44.623 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.624+0000 7f1c19b3d640 0 -- 172.21.15.97:0/3138324989 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f1c0c073900 msgr2=0x7f1c0c0633d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:44.628 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.629+0000 7f1c1e72c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:44.628 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.629+0000 7f1c1e72c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:44.628 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.629+0000 7f1c1e72c800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:11:44.629 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.629+0000 7f1c1e72c800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:11:44.629 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.629+0000 7f1c1e72c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:44.629 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.629+0000 7f1c1e72c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:44.629 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.629+0000 7f1c1e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:44.629 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.630+0000 7f1c1e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:44.629 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.630+0000 7f1c1e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:44.630 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.630+0000 7f1c1e72c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:44.630 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.630+0000 7f1c1e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:44.630 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.631+0000 7f1c1e72c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:44.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.631+0000 7f1c1e72c800 20 zone default found 2024-09-14T11:11:44.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.631+0000 7f1c1e72c800 4 Realm: () 2024-09-14T11:11:44.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.631+0000 7f1c1e72c800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:11:44.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.631+0000 7f1c1e72c800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:11:44.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.631+0000 7f1c1e72c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:44.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.631+0000 7f1c1e72c800 20 zonegroup default 2024-09-14T11:11:44.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.631+0000 7f1c1e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:44.632 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.631+0000 7f1c1e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:44.632 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.631+0000 7f1c1e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:44.632 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.631+0000 7f1c1e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:44.632 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.631+0000 7f1c1e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:44.632 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.632+0000 7f1c1e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:44.632 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.632+0000 7f1c1e72c800 20 started sync module instance, tier type = 2024-09-14T11:11:44.632 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.632+0000 7f1c1e72c800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:11:44.650 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.651+0000 7f1c1e72c800 20 add_watcher() i=0 2024-09-14T11:11:44.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.652+0000 7f1c1e72c800 20 add_watcher() i=1 2024-09-14T11:11:44.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.652+0000 7f1c1e72c800 20 add_watcher() i=2 2024-09-14T11:11:44.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.652+0000 7f1c1e72c800 20 add_watcher() i=3 2024-09-14T11:11:44.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.652+0000 7f1c1e72c800 20 add_watcher() i=4 2024-09-14T11:11:44.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.652+0000 7f1c1e72c800 20 add_watcher() i=5 2024-09-14T11:11:44.653 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.655+0000 7f1c1e72c800 20 add_watcher() i=6 2024-09-14T11:11:44.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.657+0000 7f1c1e72c800 20 add_watcher() i=7 2024-09-14T11:11:44.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.657+0000 7f1c1e72c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:44.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.659+0000 7f1ad0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:44.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.659+0000 7f1c1e72c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:44.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.659+0000 7f1c1e72c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:44.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.659+0000 7f1c1e72c800 5 note: GC not initialized 2024-09-14T11:11:44.661 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.659+0000 7f1a4b7fe640 20 reqs_thread_entry: start 2024-09-14T11:11:44.661 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.659+0000 7f1c1e72c800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:44.661 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.659+0000 7f1c1e72c800 20 Filter name: none 2024-09-14T11:11:44.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.659+0000 7f1a497fa640 20 reqs_thread_entry: start 2024-09-14T11:11:44.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.659+0000 7f1c1e72c800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-14T11:11:44.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.659+0000 7f1c1e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:44.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.660+0000 7f1c1e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:44.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.660+0000 7f1c1e72c800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-09-14T11:11:44.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.660+0000 7f1c1e72c800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:11:44.663 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.660+0000 7f1c1e72c800 10 cache get: name=default.rgw.meta+users.email+foobar+test@test.test : miss 2024-09-14T11:11:44.663 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.660+0000 7f1c1e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:44.663 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.660+0000 7f1c1e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:44.663 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.660+0000 7f1c1e72c800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x0 2024-09-14T11:11:44.663 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.660+0000 7f1c1e72c800 10 adding default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-14T11:11:44.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.660+0000 7f1c1e72c800 10 cache get: name=default.rgw.meta+users.keys+HIYDCCWRDYKEONIHBGFU : miss 2024-09-14T11:11:44.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.660+0000 7f1c1e72c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:44.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.661+0000 7f1c1e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:44.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.661+0000 7f1c1e72c800 10 cache put: name=default.rgw.meta+users.keys+HIYDCCWRDYKEONIHBGFU info.flags=0x0 2024-09-14T11:11:44.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.661+0000 7f1c1e72c800 10 adding default.rgw.meta+users.keys+HIYDCCWRDYKEONIHBGFU to cache LRU end 2024-09-14T11:11:44.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.661+0000 7f1c1e72c800 10 cache get: name=default.rgw.meta+users.keys+HIYDCCWRDYKEONIHBGFU : hit (negative entry) 2024-09-14T11:11:44.665 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.661+0000 7f1c1e72c800 10 cache get: name=default.rgw.meta+users.keys+HIYDCCWRDYKEONIHBGFU : hit (negative entry) 2024-09-14T11:11:44.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.662+0000 7f1c1e72c800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:11:44.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.662+0000 7f1c1e72c800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:11:44.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.662+0000 7f1c1e72c800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-14T11:11:44.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.662+0000 7f1afdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497242 cookie 94263608318688 notifier 8600 bl.length()=660 2024-09-14T11:11:44.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.662+0000 7f1afdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:11:44.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.662+0000 7f1afdffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:11:44.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.664+0000 7f1c1e72c800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-14T11:11:44.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.664+0000 7f1c1e72c800 10 moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-14T11:11:44.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.664+0000 7f1c1e72c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:foobar+test@test.test, ofs0, ns] 2024-09-14T11:11:44.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.664+0000 7f1afdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497259 cookie 94263608299408 notifier 8600 bl.length()=191 2024-09-14T11:11:44.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.664+0000 7f1afdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-14T11:11:44.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.664+0000 7f1afdffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-14T11:11:44.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.665+0000 7f1c1e72c800 10 cache put: name=default.rgw.meta+users.keys+HIYDCCWRDYKEONIHBGFU info.flags=0x7 2024-09-14T11:11:44.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.665+0000 7f1c1e72c800 10 moving default.rgw.meta+users.keys+HIYDCCWRDYKEONIHBGFU to cache LRU end 2024-09-14T11:11:44.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.665+0000 7f1c1e72c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:HIYDCCWRDYKEONIHBGFU, ofs0, ns] 2024-09-14T11:11:44.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.666+0000 7f1afd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497039 cookie 94263608294176 notifier 8600 bl.length()=189 2024-09-14T11:11:44.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.666+0000 7f1afd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+HIYDCCWRDYKEONIHBGFU info.flags=0x7 2024-09-14T11:11:44.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.666+0000 7f1afd7fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+HIYDCCWRDYKEONIHBGFU to cache LRU end 2024-09-14T11:11:44.670 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-14T11:11:44.670 INFO:teuthology.orchestra.run.smithi097.stdout: "user_id": "foobar.client.0", 2024-09-14T11:11:44.670 INFO:teuthology.orchestra.run.smithi097.stdout: "display_name": "Mr.foobar.client.0", 2024-09-14T11:11:44.670 INFO:teuthology.orchestra.run.smithi097.stdout: "email": "foobar+test@test.test", 2024-09-14T11:11:44.670 INFO:teuthology.orchestra.run.smithi097.stdout: "suspended": 0, 2024-09-14T11:11:44.670 INFO:teuthology.orchestra.run.smithi097.stdout: "max_buckets": 1000, 2024-09-14T11:11:44.670 INFO:teuthology.orchestra.run.smithi097.stdout: "subusers": [], 2024-09-14T11:11:44.670 INFO:teuthology.orchestra.run.smithi097.stdout: "keys": [ 2024-09-14T11:11:44.671 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-09-14T11:11:44.671 INFO:teuthology.orchestra.run.smithi097.stdout: "user": "foobar.client.0", 2024-09-14T11:11:44.671 INFO:teuthology.orchestra.run.smithi097.stdout: "access_key": "HIYDCCWRDYKEONIHBGFU", 2024-09-14T11:11:44.671 INFO:teuthology.orchestra.run.smithi097.stdout: "secret_key": "Xa6GukX+be1N1kQPdLU2qQuJovWpjmCq1bTEvuiYNHZgJ+P338KEzg==", 2024-09-14T11:11:44.671 INFO:teuthology.orchestra.run.smithi097.stdout: "active": true, 2024-09-14T11:11:44.671 INFO:teuthology.orchestra.run.smithi097.stdout: "create_date": "2024-09-14T11:11:44.661964Z" 2024-09-14T11:11:44.671 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-14T11:11:44.671 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2024-09-14T11:11:44.671 INFO:teuthology.orchestra.run.smithi097.stdout: "swift_keys": [], 2024-09-14T11:11:44.671 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": [], 2024-09-14T11:11:44.671 INFO:teuthology.orchestra.run.smithi097.stdout: "op_mask": "read, write, delete", 2024-09-14T11:11:44.671 INFO:teuthology.orchestra.run.smithi097.stdout: "default_placement": "", 2024-09-14T11:11:44.671 INFO:teuthology.orchestra.run.smithi097.stdout: "default_storage_class": "", 2024-09-14T11:11:44.671 INFO:teuthology.orchestra.run.smithi097.stdout: "placement_tags": [], 2024-09-14T11:11:44.671 INFO:teuthology.orchestra.run.smithi097.stdout: "bucket_quota": { 2024-09-14T11:11:44.672 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-14T11:11:44.672 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-14T11:11:44.672 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-14T11:11:44.672 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-14T11:11:44.672 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-14T11:11:44.672 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-14T11:11:44.672 INFO:teuthology.orchestra.run.smithi097.stdout: "user_quota": { 2024-09-14T11:11:44.672 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-14T11:11:44.672 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-14T11:11:44.672 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-14T11:11:44.672 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-14T11:11:44.672 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-14T11:11:44.672 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-14T11:11:44.672 INFO:teuthology.orchestra.run.smithi097.stdout: "temp_url_keys": [], 2024-09-14T11:11:44.673 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "rgw", 2024-09-14T11:11:44.673 INFO:teuthology.orchestra.run.smithi097.stdout: "mfa_ids": [], 2024-09-14T11:11:44.673 INFO:teuthology.orchestra.run.smithi097.stdout: "account_id": "", 2024-09-14T11:11:44.673 INFO:teuthology.orchestra.run.smithi097.stdout: "path": "/", 2024-09-14T11:11:44.673 INFO:teuthology.orchestra.run.smithi097.stdout: "create_date": "2024-09-14T11:11:44.661954Z", 2024-09-14T11:11:44.673 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2024-09-14T11:11:44.673 INFO:teuthology.orchestra.run.smithi097.stdout: "group_ids": [] 2024-09-14T11:11:44.673 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-14T11:11:44.673 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:44.674 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.667+0000 7f1ad0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:44.674 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.669+0000 7f1c1e72c800 20 remove_watcher() i=0 2024-09-14T11:11:44.674 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.669+0000 7f1c1e72c800 2 removed watcher, disabling cache 2024-09-14T11:11:44.674 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.671+0000 7f1c1e72c800 20 remove_watcher() i=1 2024-09-14T11:11:44.674 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.673+0000 7f1c1e72c800 20 remove_watcher() i=2 2024-09-14T11:11:44.674 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.675+0000 7f1c1e72c800 20 remove_watcher() i=3 2024-09-14T11:11:44.674 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.676+0000 7f1c1e72c800 20 remove_watcher() i=4 2024-09-14T11:11:44.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.677+0000 7f1c1e72c800 20 remove_watcher() i=5 2024-09-14T11:11:44.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.678+0000 7f1c1e72c800 20 remove_watcher() i=6 2024-09-14T11:11:44.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.679+0000 7f1c1e72c800 20 remove_watcher() i=7 2024-09-14T11:11:44.689 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 6549464699 --totp-seed 6HVDWHMARS3HTAXGESWJFSVI46KN3O77I2M6FISAIKYYKUXNIHAJACDTT6U6RTZ2 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:11:44.754 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:44.754 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:44.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.790+0000 7fa88d125800 20 rados->read ofs=0 len=0 2024-09-14T11:11:44.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.791+0000 7fa88d125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:44.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.791+0000 7fa88d125800 20 realm 2024-09-14T11:11:44.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.791+0000 7fa88d125800 20 rados->read ofs=0 len=0 2024-09-14T11:11:44.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.792+0000 7fa88d125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:44.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.792+0000 7fa88d125800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:44.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.792+0000 7fa88d125800 20 rados->read ofs=0 len=0 2024-09-14T11:11:44.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.792+0000 7fa88d125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:44.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.792+0000 7fa88d125800 20 rados->read ofs=0 len=0 2024-09-14T11:11:44.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.792+0000 7fa88d125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:44.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.792+0000 7fa88d125800 20 rados->read ofs=0 len=0 2024-09-14T11:11:44.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.793+0000 7fa88d125800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:44.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.793+0000 7fa88d125800 20 searching for the correct realm 2024-09-14T11:11:44.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:44.796+0000 7fa8896a3640 0 -- 172.21.15.97:0/4150380884 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7fa87c0843f0 msgr2=0x7fa87c084870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:11:45.001 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.002+0000 7fa8886a1640 0 -- 172.21.15.97:0/4150380884 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7fa878072c30 msgr2=0x7fa87806aa60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:45.006 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.007+0000 7fa88d125800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:45.006 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.007+0000 7fa88d125800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:45.006 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.007+0000 7fa88d125800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:11:45.006 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.007+0000 7fa88d125800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:11:45.007 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.007+0000 7fa88d125800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:45.007 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.007+0000 7fa88d125800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:45.007 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.007+0000 7fa88d125800 20 rados->read ofs=0 len=0 2024-09-14T11:11:45.007 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.007+0000 7fa88d125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:45.007 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.007+0000 7fa88d125800 20 rados->read ofs=0 len=0 2024-09-14T11:11:45.007 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.008+0000 7fa88d125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:45.007 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.008+0000 7fa88d125800 20 rados->read ofs=0 len=0 2024-09-14T11:11:45.008 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.008+0000 7fa88d125800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:45.009 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.008+0000 7fa88d125800 20 zone default found 2024-09-14T11:11:45.009 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.008+0000 7fa88d125800 4 Realm: () 2024-09-14T11:11:45.009 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.008+0000 7fa88d125800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:11:45.009 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.008+0000 7fa88d125800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:11:45.009 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.008+0000 7fa88d125800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:45.009 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.008+0000 7fa88d125800 20 zonegroup default 2024-09-14T11:11:45.009 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.008+0000 7fa88d125800 20 rados->read ofs=0 len=0 2024-09-14T11:11:45.009 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.008+0000 7fa88d125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:45.009 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.008+0000 7fa88d125800 20 rados->read ofs=0 len=0 2024-09-14T11:11:45.009 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.009+0000 7fa88d125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:45.009 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.009+0000 7fa88d125800 20 rados->read ofs=0 len=0 2024-09-14T11:11:45.009 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.009+0000 7fa88d125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:45.009 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.009+0000 7fa88d125800 20 started sync module instance, tier type = 2024-09-14T11:11:45.010 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.009+0000 7fa88d125800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:11:45.020 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.021+0000 7fa88d125800 20 add_watcher() i=0 2024-09-14T11:11:45.020 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.021+0000 7fa88d125800 20 add_watcher() i=1 2024-09-14T11:11:45.020 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.021+0000 7fa88d125800 20 add_watcher() i=2 2024-09-14T11:11:45.020 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.021+0000 7fa88d125800 20 add_watcher() i=3 2024-09-14T11:11:45.020 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.021+0000 7fa88d125800 20 add_watcher() i=4 2024-09-14T11:11:45.020 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.021+0000 7fa88d125800 20 add_watcher() i=5 2024-09-14T11:11:45.020 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.021+0000 7fa88d125800 20 add_watcher() i=6 2024-09-14T11:11:45.021 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.022+0000 7fa88d125800 20 add_watcher() i=7 2024-09-14T11:11:45.021 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.022+0000 7fa88d125800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:45.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.023+0000 7fa73f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:45.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.023+0000 7fa88d125800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:45.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.023+0000 7fa88d125800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:45.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.023+0000 7fa88d125800 5 note: GC not initialized 2024-09-14T11:11:45.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.024+0000 7fa73e7e4640 20 reqs_thread_entry: start 2024-09-14T11:11:45.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.024+0000 7fa88d125800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:45.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.024+0000 7fa88d125800 20 Filter name: none 2024-09-14T11:11:45.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.024+0000 7fa737fff640 20 reqs_thread_entry: start 2024-09-14T11:11:45.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.024+0000 7fa88d125800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-14T11:11:45.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.024+0000 7fa88d125800 20 rados->read ofs=0 len=0 2024-09-14T11:11:45.024 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.025+0000 7fa88d125800 20 rados_obj.operate() r=0 bl.length=472 2024-09-14T11:11:45.024 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.025+0000 7fa88d125800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-14T11:11:45.024 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.025+0000 7fa88d125800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:11:45.024 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.025+0000 7fa88d125800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:11:45.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.027+0000 7fa88d125800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:11:45.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.027+0000 7fa88d125800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:11:45.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.027+0000 7fa88d125800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-14T11:11:45.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.027+0000 7fa75ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497243 cookie 94329383159936 notifier 8618 bl.length()=674 2024-09-14T11:11:45.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.027+0000 7fa75ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:11:45.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.027+0000 7fa75ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:11:45.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.029+0000 7fa73f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:45.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.031+0000 7fa88d125800 20 remove_watcher() i=0 2024-09-14T11:11:45.030 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.031+0000 7fa88d125800 2 removed watcher, disabling cache 2024-09-14T11:11:45.030 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.032+0000 7fa88d125800 20 remove_watcher() i=1 2024-09-14T11:11:45.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.033+0000 7fa88d125800 20 remove_watcher() i=2 2024-09-14T11:11:45.032 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.034+0000 7fa88d125800 20 remove_watcher() i=3 2024-09-14T11:11:45.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.035+0000 7fa88d125800 20 remove_watcher() i=4 2024-09-14T11:11:45.034 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.036+0000 7fa88d125800 20 remove_watcher() i=5 2024-09-14T11:11:45.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.037+0000 7fa88d125800 20 remove_watcher() i=6 2024-09-14T11:11:45.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.038+0000 7fa88d125800 20 remove_watcher() i=7 2024-09-14T11:11:45.048 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*;roles=*;user-policy=*' --cluster ceph 2024-09-14T11:11:45.105 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:45.105 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:45.139 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.141+0000 7f274bb2a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:45.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.142+0000 7f274bb2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:45.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.142+0000 7f274bb2a800 20 realm 2024-09-14T11:11:45.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.142+0000 7f274bb2a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:45.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.142+0000 7f274bb2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:45.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.142+0000 7f274bb2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:45.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.142+0000 7f274bb2a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:45.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.142+0000 7f274bb2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:45.142 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.142+0000 7f274bb2a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:45.142 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.143+0000 7f274bb2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:45.142 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.143+0000 7f274bb2a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:45.142 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.144+0000 7f274bb2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:45.143 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.144+0000 7f274bb2a800 20 searching for the correct realm 2024-09-14T11:11:45.144 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.146+0000 7f274701d640 0 -- 172.21.15.97:0/1431499376 >> [v2:172.21.15.97:6816/4093696477,v1:172.21.15.97:6817/4093696477] conn(0x5610b006a600 msgr2=0x5610b006ca50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:11:45.148 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.149+0000 7f274781e640 0 -- 172.21.15.97:0/1431499376 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7f273007c220 msgr2=0x7f273005d050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:45.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.155+0000 7f274bb2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:45.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.155+0000 7f274bb2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:45.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.155+0000 7f274bb2a800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:11:45.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.155+0000 7f274bb2a800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:11:45.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.155+0000 7f274bb2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:45.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.155+0000 7f274bb2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:45.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.155+0000 7f274bb2a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:45.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.155+0000 7f274bb2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:45.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.155+0000 7f274bb2a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:45.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.155+0000 7f274bb2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:45.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.155+0000 7f274bb2a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:45.155 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.156+0000 7f274bb2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:45.156 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.156+0000 7f274bb2a800 20 zone default found 2024-09-14T11:11:45.156 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.156+0000 7f274bb2a800 4 Realm: () 2024-09-14T11:11:45.156 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.156+0000 7f274bb2a800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:11:45.156 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.156+0000 7f274bb2a800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:11:45.156 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.156+0000 7f274bb2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:45.156 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.156+0000 7f274bb2a800 20 zonegroup default 2024-09-14T11:11:45.156 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.156+0000 7f274bb2a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:45.156 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.156+0000 7f274bb2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:45.156 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.156+0000 7f274bb2a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:45.156 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.156+0000 7f274bb2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:45.156 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.156+0000 7f274bb2a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:45.156 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.156+0000 7f274bb2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:45.157 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.156+0000 7f274bb2a800 20 started sync module instance, tier type = 2024-09-14T11:11:45.157 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.156+0000 7f274bb2a800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:11:45.166 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.168+0000 7f274bb2a800 20 add_watcher() i=0 2024-09-14T11:11:45.166 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.168+0000 7f274bb2a800 20 add_watcher() i=1 2024-09-14T11:11:45.167 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.168+0000 7f274bb2a800 20 add_watcher() i=2 2024-09-14T11:11:45.167 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.168+0000 7f274bb2a800 20 add_watcher() i=3 2024-09-14T11:11:45.167 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.168+0000 7f274bb2a800 20 add_watcher() i=4 2024-09-14T11:11:45.167 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.168+0000 7f274bb2a800 20 add_watcher() i=5 2024-09-14T11:11:45.167 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.168+0000 7f274bb2a800 20 add_watcher() i=6 2024-09-14T11:11:45.167 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.169+0000 7f274bb2a800 20 add_watcher() i=7 2024-09-14T11:11:45.167 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.169+0000 7f274bb2a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:45.170 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.171+0000 7f25fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:45.170 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.171+0000 7f274bb2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:45.170 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.171+0000 7f274bb2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:45.171 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.171+0000 7f274bb2a800 5 note: GC not initialized 2024-09-14T11:11:45.171 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.171+0000 7f25fcfe1640 20 reqs_thread_entry: start 2024-09-14T11:11:45.171 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.172+0000 7f274bb2a800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:45.171 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.172+0000 7f274bb2a800 20 Filter name: none 2024-09-14T11:11:45.171 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.172+0000 7f25767fc640 20 reqs_thread_entry: start 2024-09-14T11:11:45.171 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.172+0000 7f274bb2a800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-14T11:11:45.171 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.172+0000 7f274bb2a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:45.171 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.172+0000 7f274bb2a800 20 rados_obj.operate() r=0 bl.length=486 2024-09-14T11:11:45.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.172+0000 7f274bb2a800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-14T11:11:45.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.172+0000 7f274bb2a800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:11:45.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.172+0000 7f274bb2a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:11:45.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.174+0000 7f274bb2a800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:11:45.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.174+0000 7f274bb2a800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:11:45.173 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.174+0000 7f274bb2a800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-14T11:11:45.173 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.174+0000 7f2626ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497244 cookie 94629672756944 notifier 8636 bl.length()=727 2024-09-14T11:11:45.173 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.174+0000 7f2626ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:11:45.173 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.174+0000 7f2626ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:11:45.173 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-14T11:11:45.174 INFO:teuthology.orchestra.run.smithi097.stdout: "user_id": "foobar.client.0", 2024-09-14T11:11:45.174 INFO:teuthology.orchestra.run.smithi097.stdout: "display_name": "Mr.foobar.client.0", 2024-09-14T11:11:45.174 INFO:teuthology.orchestra.run.smithi097.stdout: "email": "foobar+test@test.test", 2024-09-14T11:11:45.174 INFO:teuthology.orchestra.run.smithi097.stdout: "suspended": 0, 2024-09-14T11:11:45.174 INFO:teuthology.orchestra.run.smithi097.stdout: "max_buckets": 1000, 2024-09-14T11:11:45.174 INFO:teuthology.orchestra.run.smithi097.stdout: "subusers": [], 2024-09-14T11:11:45.174 INFO:teuthology.orchestra.run.smithi097.stdout: "keys": [ 2024-09-14T11:11:45.174 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-09-14T11:11:45.174 INFO:teuthology.orchestra.run.smithi097.stdout: "user": "foobar.client.0", 2024-09-14T11:11:45.174 INFO:teuthology.orchestra.run.smithi097.stdout: "access_key": "HIYDCCWRDYKEONIHBGFU", 2024-09-14T11:11:45.174 INFO:teuthology.orchestra.run.smithi097.stdout: "secret_key": "Xa6GukX+be1N1kQPdLU2qQuJovWpjmCq1bTEvuiYNHZgJ+P338KEzg==", 2024-09-14T11:11:45.174 INFO:teuthology.orchestra.run.smithi097.stdout: "active": true, 2024-09-14T11:11:45.174 INFO:teuthology.orchestra.run.smithi097.stdout: "create_date": "2024-09-14T11:11:44.661964Z" 2024-09-14T11:11:45.175 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-14T11:11:45.175 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2024-09-14T11:11:45.175 INFO:teuthology.orchestra.run.smithi097.stdout: "swift_keys": [], 2024-09-14T11:11:45.175 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": [ 2024-09-14T11:11:45.175 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-09-14T11:11:45.175 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "oidc-provider", 2024-09-14T11:11:45.175 INFO:teuthology.orchestra.run.smithi097.stdout: "perm": "*" 2024-09-14T11:11:45.175 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-14T11:11:45.175 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-09-14T11:11:45.175 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "roles", 2024-09-14T11:11:45.175 INFO:teuthology.orchestra.run.smithi097.stdout: "perm": "*" 2024-09-14T11:11:45.175 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-14T11:11:45.175 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-09-14T11:11:45.175 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "user-policy", 2024-09-14T11:11:45.176 INFO:teuthology.orchestra.run.smithi097.stdout: "perm": "*" 2024-09-14T11:11:45.176 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-14T11:11:45.176 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2024-09-14T11:11:45.176 INFO:teuthology.orchestra.run.smithi097.stdout: "op_mask": "read, write, delete", 2024-09-14T11:11:45.176 INFO:teuthology.orchestra.run.smithi097.stdout: "default_placement": "", 2024-09-14T11:11:45.176 INFO:teuthology.orchestra.run.smithi097.stdout: "default_storage_class": "", 2024-09-14T11:11:45.176 INFO:teuthology.orchestra.run.smithi097.stdout: "placement_tags": [], 2024-09-14T11:11:45.176 INFO:teuthology.orchestra.run.smithi097.stdout: "bucket_quota": { 2024-09-14T11:11:45.176 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-14T11:11:45.176 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-14T11:11:45.176 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-14T11:11:45.176 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-14T11:11:45.176 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-14T11:11:45.176 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-14T11:11:45.177 INFO:teuthology.orchestra.run.smithi097.stdout: "user_quota": { 2024-09-14T11:11:45.177 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-14T11:11:45.177 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-14T11:11:45.177 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-14T11:11:45.177 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-14T11:11:45.177 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-14T11:11:45.177 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-14T11:11:45.177 INFO:teuthology.orchestra.run.smithi097.stdout: "temp_url_keys": [], 2024-09-14T11:11:45.177 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "rgw", 2024-09-14T11:11:45.177 INFO:teuthology.orchestra.run.smithi097.stdout: "mfa_ids": [ 2024-09-14T11:11:45.177 INFO:teuthology.orchestra.run.smithi097.stdout: "6549464699" 2024-09-14T11:11:45.177 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2024-09-14T11:11:45.177 INFO:teuthology.orchestra.run.smithi097.stdout: "account_id": "", 2024-09-14T11:11:45.177 INFO:teuthology.orchestra.run.smithi097.stdout: "path": "/", 2024-09-14T11:11:45.178 INFO:teuthology.orchestra.run.smithi097.stdout: "create_date": "2024-09-14T11:11:44.661954Z", 2024-09-14T11:11:45.178 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2024-09-14T11:11:45.178 INFO:teuthology.orchestra.run.smithi097.stdout: "group_ids": [] 2024-09-14T11:11:45.178 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-14T11:11:45.178 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:45.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.175+0000 7f25fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:45.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.178+0000 7f274bb2a800 20 remove_watcher() i=0 2024-09-14T11:11:45.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.178+0000 7f274bb2a800 2 removed watcher, disabling cache 2024-09-14T11:11:45.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.179+0000 7f274bb2a800 20 remove_watcher() i=1 2024-09-14T11:11:45.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.180+0000 7f274bb2a800 20 remove_watcher() i=2 2024-09-14T11:11:45.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.181+0000 7f274bb2a800 20 remove_watcher() i=3 2024-09-14T11:11:45.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.182+0000 7f274bb2a800 20 remove_watcher() i=4 2024-09-14T11:11:45.181 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.183+0000 7f274bb2a800 20 remove_watcher() i=5 2024-09-14T11:11:45.182 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.184+0000 7f274bb2a800 20 remove_watcher() i=6 2024-09-14T11:11:45.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.187+0000 7f274bb2a800 20 remove_watcher() i=7 2024-09-14T11:11:45.196 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW88888888888888888 --account-name Mr.RGW88888888888888888 --email RGW88888888888888888+test@test.test 2024-09-14T11:11:45.256 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:45.256 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:45.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.291+0000 7fe886325800 20 rados->read ofs=0 len=0 2024-09-14T11:11:45.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.293+0000 7fe886325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:45.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.293+0000 7fe886325800 20 realm 2024-09-14T11:11:45.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.293+0000 7fe886325800 20 rados->read ofs=0 len=0 2024-09-14T11:11:45.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.293+0000 7fe886325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:45.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.293+0000 7fe886325800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:45.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.293+0000 7fe886325800 20 rados->read ofs=0 len=0 2024-09-14T11:11:45.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.293+0000 7fe886325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:45.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.293+0000 7fe886325800 20 rados->read ofs=0 len=0 2024-09-14T11:11:45.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.294+0000 7fe886325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:45.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.294+0000 7fe886325800 20 rados->read ofs=0 len=0 2024-09-14T11:11:45.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.295+0000 7fe886325800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:45.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.295+0000 7fe886325800 20 searching for the correct realm 2024-09-14T11:11:45.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.297+0000 7fe8827b6640 0 -- 172.21.15.97:0/1572866209 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7fe86c0bf030 msgr2=0x7fe86c0b1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:45.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.502+0000 7fe8797b4640 0 -- 172.21.15.97:0/1572866209 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7fe8740870c0 msgr2=0x7fe87406a180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:45.506 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.508+0000 7fe886325800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:45.506 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.508+0000 7fe886325800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:45.506 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.508+0000 7fe886325800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:11:45.506 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.508+0000 7fe886325800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:11:45.507 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.508+0000 7fe886325800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:45.507 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.508+0000 7fe886325800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:45.507 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.508+0000 7fe886325800 20 rados->read ofs=0 len=0 2024-09-14T11:11:45.508 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.508+0000 7fe886325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:45.508 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.508+0000 7fe886325800 20 rados->read ofs=0 len=0 2024-09-14T11:11:45.508 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.508+0000 7fe886325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:45.508 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.508+0000 7fe886325800 20 rados->read ofs=0 len=0 2024-09-14T11:11:45.508 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.509+0000 7fe886325800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:45.508 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.509+0000 7fe886325800 20 zone default found 2024-09-14T11:11:45.509 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.509+0000 7fe886325800 4 Realm: () 2024-09-14T11:11:45.509 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.509+0000 7fe886325800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:11:45.509 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.509+0000 7fe886325800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:11:45.509 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.509+0000 7fe886325800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:45.509 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.509+0000 7fe886325800 20 zonegroup default 2024-09-14T11:11:45.509 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.509+0000 7fe886325800 20 rados->read ofs=0 len=0 2024-09-14T11:11:45.509 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.509+0000 7fe886325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:45.509 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.509+0000 7fe886325800 20 rados->read ofs=0 len=0 2024-09-14T11:11:45.509 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.509+0000 7fe886325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:45.509 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.509+0000 7fe886325800 20 rados->read ofs=0 len=0 2024-09-14T11:11:45.510 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.510+0000 7fe886325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:45.510 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.510+0000 7fe886325800 20 started sync module instance, tier type = 2024-09-14T11:11:45.510 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.510+0000 7fe886325800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:11:45.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.533+0000 7fe886325800 20 add_watcher() i=0 2024-09-14T11:11:45.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.533+0000 7fe886325800 20 add_watcher() i=1 2024-09-14T11:11:45.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.533+0000 7fe886325800 20 add_watcher() i=2 2024-09-14T11:11:45.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.533+0000 7fe886325800 20 add_watcher() i=3 2024-09-14T11:11:45.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.533+0000 7fe886325800 20 add_watcher() i=4 2024-09-14T11:11:45.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.533+0000 7fe886325800 20 add_watcher() i=5 2024-09-14T11:11:45.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.533+0000 7fe886325800 20 add_watcher() i=6 2024-09-14T11:11:45.533 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.534+0000 7fe886325800 20 add_watcher() i=7 2024-09-14T11:11:45.533 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.534+0000 7fe886325800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:45.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.536+0000 7fe733fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:45.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.536+0000 7fe886325800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:45.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.536+0000 7fe886325800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:45.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.536+0000 7fe886325800 5 note: GC not initialized 2024-09-14T11:11:45.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.536+0000 7fe732ffd640 20 reqs_thread_entry: start 2024-09-14T11:11:45.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.536+0000 7fe886325800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:45.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.537+0000 7fe886325800 20 Filter name: none 2024-09-14T11:11:45.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.537+0000 7fe730ff9640 20 reqs_thread_entry: start 2024-09-14T11:11:45.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.537+0000 7fe886325800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 : miss 2024-09-14T11:11:45.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.537+0000 7fe886325800 20 rados->read ofs=0 len=0 2024-09-14T11:11:45.537 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.537+0000 7fe886325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:45.537 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.537+0000 7fe886325800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x0 2024-09-14T11:11:45.537 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.537+0000 7fe886325800 10 adding default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-14T11:11:45.537 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.537+0000 7fe886325800 20 failed to read name.$Mr.RGW88888888888888888 with: (2) No such file or directory 2024-09-14T11:11:45.537 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.537+0000 7fe886325800 10 cache get: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test : miss 2024-09-14T11:11:45.537 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.537+0000 7fe886325800 20 rados->read ofs=0 len=0 2024-09-14T11:11:45.537 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.538+0000 7fe886325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:45.538 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.538+0000 7fe886325800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x0 2024-09-14T11:11:45.538 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.538+0000 7fe886325800 10 adding default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-14T11:11:45.538 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.538+0000 7fe886325800 20 failed to read rgw88888888888888888+test@test.test with: (2) No such file or directory 2024-09-14T11:11:45.538 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.539+0000 7fe886325800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-14T11:11:45.538 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.539+0000 7fe886325800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-14T11:11:45.539 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.539+0000 7fe886325800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW88888888888888888, ofs0, ns] 2024-09-14T11:11:45.539 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.539+0000 7fe7657fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497260 cookie 94001979593200 notifier 9264 bl.length()=384 2024-09-14T11:11:45.539 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.539+0000 7fe7657fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-14T11:11:45.539 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.539+0000 7fe7657fa640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-14T11:11:45.540 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.541+0000 7fe886325800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-14T11:11:45.540 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.541+0000 7fe886325800 10 moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-14T11:11:45.540 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.541+0000 7fe886325800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW88888888888888888, ofs0, ns] 2024-09-14T11:11:45.540 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.541+0000 7fe764ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497261 cookie 94001979603600 notifier 9264 bl.length()=225 2024-09-14T11:11:45.540 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.541+0000 7fe764ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-14T11:11:45.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.541+0000 7fe764ff9640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-14T11:11:45.542 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.543+0000 7fe886325800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-14T11:11:45.542 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.543+0000 7fe886325800 10 moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-14T11:11:45.542 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.543+0000 7fe886325800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw88888888888888888+test@test.test, ofs0, ns] 2024-09-14T11:11:45.542 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.543+0000 7fe7657fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497053 cookie 94001979599520 notifier 9264 bl.length()=234 2024-09-14T11:11:45.542 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.543+0000 7fe7657fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-14T11:11:45.542 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.543+0000 7fe7657fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-14T11:11:45.543 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.545+0000 7fe733fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:45.545 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.547+0000 7fe886325800 20 remove_watcher() i=0 2024-09-14T11:11:45.545 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.547+0000 7fe886325800 2 removed watcher, disabling cache 2024-09-14T11:11:45.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.548+0000 7fe886325800 20 remove_watcher() i=1 2024-09-14T11:11:45.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.549+0000 7fe886325800 20 remove_watcher() i=2 2024-09-14T11:11:45.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.550+0000 7fe886325800 20 remove_watcher() i=3 2024-09-14T11:11:45.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.551+0000 7fe886325800 20 remove_watcher() i=4 2024-09-14T11:11:45.551 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.552+0000 7fe886325800 20 remove_watcher() i=5 2024-09-14T11:11:45.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.553+0000 7fe886325800 20 remove_watcher() i=6 2024-09-14T11:11:45.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.555+0000 7fe886325800 20 remove_watcher() i=7 2024-09-14T11:11:45.562 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-14T11:11:45.562 INFO:teuthology.orchestra.run.smithi097.stdout: "id": "RGW88888888888888888", 2024-09-14T11:11:45.562 INFO:teuthology.orchestra.run.smithi097.stdout: "tenant": "", 2024-09-14T11:11:45.562 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "Mr.RGW88888888888888888", 2024-09-14T11:11:45.562 INFO:teuthology.orchestra.run.smithi097.stdout: "email": "RGW88888888888888888+test@test.test", 2024-09-14T11:11:45.562 INFO:teuthology.orchestra.run.smithi097.stdout: "quota": { 2024-09-14T11:11:45.563 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-14T11:11:45.563 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-14T11:11:45.563 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-14T11:11:45.563 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-14T11:11:45.563 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-14T11:11:45.563 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-14T11:11:45.563 INFO:teuthology.orchestra.run.smithi097.stdout: "bucket_quota": { 2024-09-14T11:11:45.563 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-14T11:11:45.563 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-14T11:11:45.563 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-14T11:11:45.563 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-14T11:11:45.563 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-14T11:11:45.563 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-14T11:11:45.564 INFO:teuthology.orchestra.run.smithi097.stdout: "max_users": 1000, 2024-09-14T11:11:45.564 INFO:teuthology.orchestra.run.smithi097.stdout: "max_roles": 1000, 2024-09-14T11:11:45.564 INFO:teuthology.orchestra.run.smithi097.stdout: "max_groups": 1000, 2024-09-14T11:11:45.564 INFO:teuthology.orchestra.run.smithi097.stdout: "max_buckets": 1000, 2024-09-14T11:11:45.564 INFO:teuthology.orchestra.run.smithi097.stdout: "max_access_keys": 4 2024-09-14T11:11:45.564 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-14T11:11:45.565 DEBUG:tasks.s3tests:Creating user RGW88888888888888888 on client.0 2024-09-14T11:11:45.565 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root1.client.0 --display-name Mr.RGW88888888888888888 --email root1+test@test.test --access-key KZTEKGTHFKDSRHFNHIBG --secret HCc9VALTBbSJhBzq3TRG4XRUXwF26SeiQtCVSQE6slZxKClaeKmqug== --cluster ceph --account-id RGW88888888888888888 --account-root 2024-09-14T11:11:45.633 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:45.633 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:45.666 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.668+0000 7f2adc896800 20 rados->read ofs=0 len=0 2024-09-14T11:11:45.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.669+0000 7f2adc896800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:45.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.669+0000 7f2adc896800 20 realm 2024-09-14T11:11:45.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.669+0000 7f2adc896800 20 rados->read ofs=0 len=0 2024-09-14T11:11:45.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.669+0000 7f2adc896800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:45.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.669+0000 7f2adc896800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:45.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.669+0000 7f2adc896800 20 rados->read ofs=0 len=0 2024-09-14T11:11:45.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.670+0000 7f2adc896800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:45.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.670+0000 7f2adc896800 20 rados->read ofs=0 len=0 2024-09-14T11:11:45.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.670+0000 7f2adc896800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:45.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.670+0000 7f2adc896800 20 rados->read ofs=0 len=0 2024-09-14T11:11:45.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.671+0000 7f2adc896800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:45.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.671+0000 7f2adc896800 20 searching for the correct realm 2024-09-14T11:11:45.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.674+0000 7f2adab81640 0 -- 172.21.15.97:0/3446661244 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f2ac4069a50 msgr2=0x7f2ac40763d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:11:45.879 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.880+0000 7f2ad9b7f640 0 -- 172.21.15.97:0/3446661244 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f2acc07fb00 msgr2=0x7f2acc02e870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:45.885 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.886+0000 7f2adc896800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:45.885 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.886+0000 7f2adc896800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:45.885 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.886+0000 7f2adc896800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:11:45.885 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.886+0000 7f2adc896800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:11:45.885 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.886+0000 7f2adc896800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:45.885 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.886+0000 7f2adc896800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:45.885 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.886+0000 7f2adc896800 20 rados->read ofs=0 len=0 2024-09-14T11:11:45.885 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.886+0000 7f2adc896800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:45.885 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.886+0000 7f2adc896800 20 rados->read ofs=0 len=0 2024-09-14T11:11:45.885 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.886+0000 7f2adc896800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:45.885 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.886+0000 7f2adc896800 20 rados->read ofs=0 len=0 2024-09-14T11:11:45.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.887+0000 7f2adc896800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:45.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.887+0000 7f2adc896800 20 zone default found 2024-09-14T11:11:45.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.887+0000 7f2adc896800 4 Realm: () 2024-09-14T11:11:45.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.887+0000 7f2adc896800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:11:45.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.887+0000 7f2adc896800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:11:45.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.887+0000 7f2adc896800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:45.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.887+0000 7f2adc896800 20 zonegroup default 2024-09-14T11:11:45.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.887+0000 7f2adc896800 20 rados->read ofs=0 len=0 2024-09-14T11:11:45.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.887+0000 7f2adc896800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:45.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.887+0000 7f2adc896800 20 rados->read ofs=0 len=0 2024-09-14T11:11:45.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.887+0000 7f2adc896800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:45.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.887+0000 7f2adc896800 20 rados->read ofs=0 len=0 2024-09-14T11:11:45.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.887+0000 7f2adc896800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:45.888 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.887+0000 7f2adc896800 20 started sync module instance, tier type = 2024-09-14T11:11:45.888 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.887+0000 7f2adc896800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:11:45.895 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.897+0000 7f2adc896800 20 add_watcher() i=0 2024-09-14T11:11:45.895 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.897+0000 7f2adc896800 20 add_watcher() i=1 2024-09-14T11:11:45.895 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.897+0000 7f2adc896800 20 add_watcher() i=2 2024-09-14T11:11:45.895 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.897+0000 7f2adc896800 20 add_watcher() i=3 2024-09-14T11:11:45.896 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.897+0000 7f2adc896800 20 add_watcher() i=4 2024-09-14T11:11:45.896 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.897+0000 7f2adc896800 20 add_watcher() i=5 2024-09-14T11:11:45.896 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.897+0000 7f2adc896800 20 add_watcher() i=6 2024-09-14T11:11:45.896 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.898+0000 7f2adc896800 20 add_watcher() i=7 2024-09-14T11:11:45.896 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.898+0000 7f2adc896800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:45.899 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.899+0000 7f2990fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:45.899 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.900+0000 7f2adc896800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:45.899 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.900+0000 7f2adc896800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:45.899 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.900+0000 7f2adc896800 5 note: GC not initialized 2024-09-14T11:11:45.899 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.900+0000 7f290b7fe640 20 reqs_thread_entry: start 2024-09-14T11:11:45.899 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.900+0000 7f2adc896800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:45.899 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.900+0000 7f2adc896800 20 Filter name: none 2024-09-14T11:11:45.899 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.900+0000 7f29097fa640 20 reqs_thread_entry: start 2024-09-14T11:11:45.899 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.900+0000 7f2adc896800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-14T11:11:45.899 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.900+0000 7f2adc896800 20 rados->read ofs=0 len=0 2024-09-14T11:11:45.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.901+0000 7f2adc896800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:45.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.901+0000 7f2adc896800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x0 2024-09-14T11:11:45.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.901+0000 7f2adc896800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:11:45.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.901+0000 7f2adc896800 10 cache get: name=default.rgw.meta+users.email+root1+test@test.test : miss 2024-09-14T11:11:45.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.901+0000 7f2adc896800 20 rados->read ofs=0 len=0 2024-09-14T11:11:45.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.901+0000 7f2adc896800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:45.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.901+0000 7f2adc896800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x0 2024-09-14T11:11:45.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.901+0000 7f2adc896800 10 adding default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-14T11:11:45.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.901+0000 7f2adc896800 10 cache get: name=default.rgw.meta+users.keys+KZTEKGTHFKDSRHFNHIBG : miss 2024-09-14T11:11:45.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.901+0000 7f2adc896800 20 rados->read ofs=0 len=0 2024-09-14T11:11:45.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.901+0000 7f2adc896800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:45.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.901+0000 7f2adc896800 10 cache put: name=default.rgw.meta+users.keys+KZTEKGTHFKDSRHFNHIBG info.flags=0x0 2024-09-14T11:11:45.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.901+0000 7f2adc896800 10 adding default.rgw.meta+users.keys+KZTEKGTHFKDSRHFNHIBG to cache LRU end 2024-09-14T11:11:45.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.901+0000 7f2adc896800 10 cache get: name=default.rgw.meta+accounts+account.RGW88888888888888888 : miss 2024-09-14T11:11:45.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.901+0000 7f2adc896800 20 rados->read ofs=0 len=0 2024-09-14T11:11:45.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.902+0000 7f2adc896800 20 rados_obj.operate() r=0 bl.length=184 2024-09-14T11:11:45.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.902+0000 7f2adc896800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-14T11:11:45.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.902+0000 7f2adc896800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-14T11:11:45.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.902+0000 7f2adc896800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:11:45.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.902+0000 7f2adc896800 10 cache get: name=default.rgw.meta+users.keys+KZTEKGTHFKDSRHFNHIBG : hit (negative entry) 2024-09-14T11:11:45.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.902+0000 7f2adc896800 10 cache get: name=default.rgw.meta+users.keys+KZTEKGTHFKDSRHFNHIBG : hit (negative entry) 2024-09-14T11:11:45.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.903+0000 7f2adc896800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T11:11:45.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.903+0000 7f2adc896800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:11:45.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.903+0000 7f2adc896800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-14T11:11:45.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.904+0000 7f29bdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497262 cookie 94543798945808 notifier 9282 bl.length()=681 2024-09-14T11:11:45.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.904+0000 7f29bdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T11:11:45.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.904+0000 7f29bdffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:11:45.904 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.905+0000 7f2adc896800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-14T11:11:45.904 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.905+0000 7f2adc896800 10 moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-14T11:11:45.904 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.905+0000 7f2adc896800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root1+test@test.test, ofs0, ns] 2024-09-14T11:11:45.904 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.906+0000 7f29bdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497245 cookie 94543798957920 notifier 9282 bl.length()=189 2024-09-14T11:11:45.904 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.906+0000 7f29bdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-14T11:11:45.904 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.906+0000 7f29bdffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-14T11:11:45.906 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.907+0000 7f2adc896800 10 cache put: name=default.rgw.meta+users.keys+KZTEKGTHFKDSRHFNHIBG info.flags=0x7 2024-09-14T11:11:45.906 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.907+0000 7f2adc896800 10 moving default.rgw.meta+users.keys+KZTEKGTHFKDSRHFNHIBG to cache LRU end 2024-09-14T11:11:45.906 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.907+0000 7f2adc896800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:KZTEKGTHFKDSRHFNHIBG, ofs0, ns] 2024-09-14T11:11:45.907 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.908+0000 7f29bd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497246 cookie 94543798960560 notifier 9282 bl.length()=188 2024-09-14T11:11:45.907 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.908+0000 7f29bd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+KZTEKGTHFKDSRHFNHIBG info.flags=0x7 2024-09-14T11:11:45.907 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.908+0000 7f29bd7fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+KZTEKGTHFKDSRHFNHIBG to cache LRU end 2024-09-14T11:11:45.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.909+0000 7f2adc896800 20 linked user root1.client.0 to account RGW88888888888888888 2024-09-14T11:11:45.908 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-14T11:11:45.908 INFO:teuthology.orchestra.run.smithi097.stdout: "user_id": "root1.client.0", 2024-09-14T11:11:45.908 INFO:teuthology.orchestra.run.smithi097.stdout: "display_name": "Mr.RGW88888888888888888", 2024-09-14T11:11:45.908 INFO:teuthology.orchestra.run.smithi097.stdout: "email": "root1+test@test.test", 2024-09-14T11:11:45.909 INFO:teuthology.orchestra.run.smithi097.stdout: "suspended": 0, 2024-09-14T11:11:45.909 INFO:teuthology.orchestra.run.smithi097.stdout: "max_buckets": 1000, 2024-09-14T11:11:45.909 INFO:teuthology.orchestra.run.smithi097.stdout: "subusers": [], 2024-09-14T11:11:45.909 INFO:teuthology.orchestra.run.smithi097.stdout: "keys": [ 2024-09-14T11:11:45.909 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-09-14T11:11:45.909 INFO:teuthology.orchestra.run.smithi097.stdout: "user": "root1.client.0", 2024-09-14T11:11:45.909 INFO:teuthology.orchestra.run.smithi097.stdout: "access_key": "KZTEKGTHFKDSRHFNHIBG", 2024-09-14T11:11:45.909 INFO:teuthology.orchestra.run.smithi097.stdout: "secret_key": "HCc9VALTBbSJhBzq3TRG4XRUXwF26SeiQtCVSQE6slZxKClaeKmqug==", 2024-09-14T11:11:45.909 INFO:teuthology.orchestra.run.smithi097.stdout: "active": true, 2024-09-14T11:11:45.909 INFO:teuthology.orchestra.run.smithi097.stdout: "create_date": "2024-09-14T11:11:45.903084Z" 2024-09-14T11:11:45.909 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-14T11:11:45.909 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2024-09-14T11:11:45.909 INFO:teuthology.orchestra.run.smithi097.stdout: "swift_keys": [], 2024-09-14T11:11:45.909 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": [], 2024-09-14T11:11:45.910 INFO:teuthology.orchestra.run.smithi097.stdout: "op_mask": "read, write, delete", 2024-09-14T11:11:45.910 INFO:teuthology.orchestra.run.smithi097.stdout: "default_placement": "", 2024-09-14T11:11:45.910 INFO:teuthology.orchestra.run.smithi097.stdout: "default_storage_class": "", 2024-09-14T11:11:45.910 INFO:teuthology.orchestra.run.smithi097.stdout: "placement_tags": [], 2024-09-14T11:11:45.910 INFO:teuthology.orchestra.run.smithi097.stdout: "bucket_quota": { 2024-09-14T11:11:45.910 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-14T11:11:45.910 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-14T11:11:45.910 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-14T11:11:45.910 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-14T11:11:45.910 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-14T11:11:45.910 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-14T11:11:45.910 INFO:teuthology.orchestra.run.smithi097.stdout: "user_quota": { 2024-09-14T11:11:45.910 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-14T11:11:45.910 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-14T11:11:45.910 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-14T11:11:45.911 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-14T11:11:45.911 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-14T11:11:45.911 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-14T11:11:45.911 INFO:teuthology.orchestra.run.smithi097.stdout: "temp_url_keys": [], 2024-09-14T11:11:45.911 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "root", 2024-09-14T11:11:45.911 INFO:teuthology.orchestra.run.smithi097.stdout: "mfa_ids": [], 2024-09-14T11:11:45.911 INFO:teuthology.orchestra.run.smithi097.stdout: "account_id": "RGW88888888888888888", 2024-09-14T11:11:45.911 INFO:teuthology.orchestra.run.smithi097.stdout: "path": "/", 2024-09-14T11:11:45.911 INFO:teuthology.orchestra.run.smithi097.stdout: "create_date": "2024-09-14T11:11:45.903072Z", 2024-09-14T11:11:45.911 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2024-09-14T11:11:45.911 INFO:teuthology.orchestra.run.smithi097.stdout: "group_ids": [] 2024-09-14T11:11:45.911 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-14T11:11:45.911 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:45.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.910+0000 7f2990fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:45.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.912+0000 7f2adc896800 20 remove_watcher() i=0 2024-09-14T11:11:45.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.912+0000 7f2adc896800 2 removed watcher, disabling cache 2024-09-14T11:11:45.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.913+0000 7f2adc896800 20 remove_watcher() i=1 2024-09-14T11:11:45.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.914+0000 7f2adc896800 20 remove_watcher() i=2 2024-09-14T11:11:45.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.916+0000 7f2adc896800 20 remove_watcher() i=3 2024-09-14T11:11:45.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.917+0000 7f2adc896800 20 remove_watcher() i=4 2024-09-14T11:11:45.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.918+0000 7f2adc896800 20 remove_watcher() i=5 2024-09-14T11:11:45.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.919+0000 7f2adc896800 20 remove_watcher() i=6 2024-09-14T11:11:45.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:45.920+0000 7f2adc896800 20 remove_watcher() i=7 2024-09-14T11:11:45.929 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root1.client.0 --totp-serial 4952237321 --totp-seed S5SHPDFQ6XAOWF2XEXNV3HURFLRE5LO3U33KZVWJ4PM5BG4OEIXPPSHSXES5GDVA --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:11:45.996 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:45.996 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:46.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.033+0000 7fe384814800 20 rados->read ofs=0 len=0 2024-09-14T11:11:46.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.034+0000 7fe384814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:46.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.034+0000 7fe384814800 20 realm 2024-09-14T11:11:46.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.034+0000 7fe384814800 20 rados->read ofs=0 len=0 2024-09-14T11:11:46.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.035+0000 7fe384814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:46.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.035+0000 7fe384814800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:46.034 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.035+0000 7fe384814800 20 rados->read ofs=0 len=0 2024-09-14T11:11:46.034 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.035+0000 7fe384814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:46.034 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.035+0000 7fe384814800 20 rados->read ofs=0 len=0 2024-09-14T11:11:46.034 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.035+0000 7fe384814800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:46.034 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.035+0000 7fe384814800 20 rados->read ofs=0 len=0 2024-09-14T11:11:46.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.036+0000 7fe384814800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:46.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.036+0000 7fe384814800 20 searching for the correct realm 2024-09-14T11:11:46.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.037+0000 7fe37f6ca640 0 -- 172.21.15.97:0/1558288418 >> [v2:172.21.15.97:6808/2081705332,v1:172.21.15.97:6809/2081705332] conn(0x7fe37008c060 msgr2=0x7fe3700ab910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:46.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.243+0000 7fe37fecb640 0 -- 172.21.15.97:0/1558288418 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7fe36804bb10 msgr2=0x7fe36806c090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:11:46.451 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.452+0000 7fe384814800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:46.451 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.452+0000 7fe384814800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:46.451 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.452+0000 7fe384814800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:11:46.451 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.452+0000 7fe384814800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:11:46.451 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.452+0000 7fe384814800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:46.451 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.452+0000 7fe384814800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:46.451 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.452+0000 7fe384814800 20 rados->read ofs=0 len=0 2024-09-14T11:11:46.451 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.452+0000 7fe384814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:46.452 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.452+0000 7fe384814800 20 rados->read ofs=0 len=0 2024-09-14T11:11:46.452 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.452+0000 7fe384814800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:46.452 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.452+0000 7fe384814800 20 rados->read ofs=0 len=0 2024-09-14T11:11:46.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.453+0000 7fe384814800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:46.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.453+0000 7fe384814800 20 zone default found 2024-09-14T11:11:46.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.453+0000 7fe384814800 4 Realm: () 2024-09-14T11:11:46.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.453+0000 7fe384814800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:11:46.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.453+0000 7fe384814800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:11:46.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.453+0000 7fe384814800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:46.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.453+0000 7fe384814800 20 zonegroup default 2024-09-14T11:11:46.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.453+0000 7fe384814800 20 rados->read ofs=0 len=0 2024-09-14T11:11:46.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.453+0000 7fe384814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:46.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.453+0000 7fe384814800 20 rados->read ofs=0 len=0 2024-09-14T11:11:46.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.453+0000 7fe384814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:46.454 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.453+0000 7fe384814800 20 rados->read ofs=0 len=0 2024-09-14T11:11:46.454 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.454+0000 7fe384814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:46.454 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.454+0000 7fe384814800 20 started sync module instance, tier type = 2024-09-14T11:11:46.454 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.454+0000 7fe384814800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:11:46.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.464+0000 7fe384814800 20 add_watcher() i=0 2024-09-14T11:11:46.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.464+0000 7fe384814800 20 add_watcher() i=1 2024-09-14T11:11:46.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.464+0000 7fe384814800 20 add_watcher() i=2 2024-09-14T11:11:46.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.464+0000 7fe384814800 20 add_watcher() i=3 2024-09-14T11:11:46.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.464+0000 7fe384814800 20 add_watcher() i=4 2024-09-14T11:11:46.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.464+0000 7fe384814800 20 add_watcher() i=5 2024-09-14T11:11:46.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.464+0000 7fe384814800 20 add_watcher() i=6 2024-09-14T11:11:46.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.465+0000 7fe384814800 20 add_watcher() i=7 2024-09-14T11:11:46.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.465+0000 7fe384814800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:46.466 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.467+0000 7fe235fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:46.466 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.467+0000 7fe384814800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:46.466 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.467+0000 7fe384814800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:46.466 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.467+0000 7fe384814800 5 note: GC not initialized 2024-09-14T11:11:46.466 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.467+0000 7fe234fe1640 20 reqs_thread_entry: start 2024-09-14T11:11:46.467 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.467+0000 7fe384814800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:46.467 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.468+0000 7fe384814800 20 Filter name: none 2024-09-14T11:11:46.467 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.468+0000 7fe1ae7fc640 20 reqs_thread_entry: start 2024-09-14T11:11:46.467 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.468+0000 7fe384814800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-14T11:11:46.467 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.468+0000 7fe384814800 20 rados->read ofs=0 len=0 2024-09-14T11:11:46.467 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.469+0000 7fe384814800 20 rados_obj.operate() r=0 bl.length=494 2024-09-14T11:11:46.467 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.469+0000 7fe384814800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x13 2024-09-14T11:11:46.467 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.469+0000 7fe384814800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:11:46.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.469+0000 7fe384814800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:11:46.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.472+0000 7fe384814800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T11:11:46.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.472+0000 7fe384814800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:11:46.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.472+0000 7fe384814800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-14T11:11:46.472 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.472+0000 7fe25effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497263 cookie 94298088270464 notifier 8684 bl.length()=695 2024-09-14T11:11:46.472 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.472+0000 7fe25effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T11:11:46.472 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.472+0000 7fe25effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:11:46.472 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.474+0000 7fe235fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:46.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.476+0000 7fe384814800 20 remove_watcher() i=0 2024-09-14T11:11:46.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.476+0000 7fe384814800 2 removed watcher, disabling cache 2024-09-14T11:11:46.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.477+0000 7fe384814800 20 remove_watcher() i=1 2024-09-14T11:11:46.477 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.478+0000 7fe384814800 20 remove_watcher() i=2 2024-09-14T11:11:46.478 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.479+0000 7fe384814800 20 remove_watcher() i=3 2024-09-14T11:11:46.479 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.480+0000 7fe384814800 20 remove_watcher() i=4 2024-09-14T11:11:46.480 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.482+0000 7fe384814800 20 remove_watcher() i=5 2024-09-14T11:11:46.481 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.483+0000 7fe384814800 20 remove_watcher() i=6 2024-09-14T11:11:46.482 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.484+0000 7fe384814800 20 remove_watcher() i=7 2024-09-14T11:11:46.494 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW99999999999999999 --account-name Mr.RGW99999999999999999 --email RGW99999999999999999+test@test.test 2024-09-14T11:11:46.554 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:46.554 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:46.588 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.590+0000 7f01f8d46800 20 rados->read ofs=0 len=0 2024-09-14T11:11:46.591 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.592+0000 7f01f8d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:46.591 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.592+0000 7f01f8d46800 20 realm 2024-09-14T11:11:46.591 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.592+0000 7f01f8d46800 20 rados->read ofs=0 len=0 2024-09-14T11:11:46.591 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.593+0000 7f01f8d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:46.592 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.593+0000 7f01f8d46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:46.592 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.593+0000 7f01f8d46800 20 rados->read ofs=0 len=0 2024-09-14T11:11:46.592 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.593+0000 7f01f8d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:46.592 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.593+0000 7f01f8d46800 20 rados->read ofs=0 len=0 2024-09-14T11:11:46.592 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.594+0000 7f01f8d46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:46.592 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.594+0000 7f01f8d46800 20 rados->read ofs=0 len=0 2024-09-14T11:11:46.593 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.595+0000 7f01f8d46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:46.593 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.595+0000 7f01f8d46800 20 searching for the correct realm 2024-09-14T11:11:46.596 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.597+0000 7f01f7031640 0 -- 172.21.15.97:0/2603300074 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f01e004fc60 msgr2=0x7f01e00cb3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:46.599 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.601+0000 7f01ee02f640 0 -- 172.21.15.97:0/2603300074 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f01e8033410 msgr2=0x7f01e8033890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:46.604 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.606+0000 7f01f8d46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:46.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.606+0000 7f01f8d46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:46.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.606+0000 7f01f8d46800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:11:46.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.606+0000 7f01f8d46800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:11:46.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.606+0000 7f01f8d46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:46.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.606+0000 7f01f8d46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:46.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.606+0000 7f01f8d46800 20 rados->read ofs=0 len=0 2024-09-14T11:11:46.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.606+0000 7f01f8d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:46.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.606+0000 7f01f8d46800 20 rados->read ofs=0 len=0 2024-09-14T11:11:46.607 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.606+0000 7f01f8d46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:46.607 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.606+0000 7f01f8d46800 20 rados->read ofs=0 len=0 2024-09-14T11:11:46.607 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.607+0000 7f01f8d46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:46.607 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.607+0000 7f01f8d46800 20 zone default found 2024-09-14T11:11:46.607 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.607+0000 7f01f8d46800 4 Realm: () 2024-09-14T11:11:46.607 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.607+0000 7f01f8d46800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:11:46.607 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.607+0000 7f01f8d46800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:11:46.607 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.607+0000 7f01f8d46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:46.607 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.607+0000 7f01f8d46800 20 zonegroup default 2024-09-14T11:11:46.607 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.607+0000 7f01f8d46800 20 rados->read ofs=0 len=0 2024-09-14T11:11:46.608 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.607+0000 7f01f8d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:46.608 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.607+0000 7f01f8d46800 20 rados->read ofs=0 len=0 2024-09-14T11:11:46.608 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.607+0000 7f01f8d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:46.608 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.607+0000 7f01f8d46800 20 rados->read ofs=0 len=0 2024-09-14T11:11:46.608 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.607+0000 7f01f8d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:46.608 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.607+0000 7f01f8d46800 20 started sync module instance, tier type = 2024-09-14T11:11:46.608 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.607+0000 7f01f8d46800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:11:46.616 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.617+0000 7f01f8d46800 20 add_watcher() i=0 2024-09-14T11:11:46.616 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.617+0000 7f01f8d46800 20 add_watcher() i=1 2024-09-14T11:11:46.616 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.617+0000 7f01f8d46800 20 add_watcher() i=2 2024-09-14T11:11:46.616 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.617+0000 7f01f8d46800 20 add_watcher() i=3 2024-09-14T11:11:46.617 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.617+0000 7f01f8d46800 20 add_watcher() i=4 2024-09-14T11:11:46.617 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.617+0000 7f01f8d46800 20 add_watcher() i=5 2024-09-14T11:11:46.617 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.617+0000 7f01f8d46800 20 add_watcher() i=6 2024-09-14T11:11:46.617 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.619+0000 7f01f8d46800 20 add_watcher() i=7 2024-09-14T11:11:46.617 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.619+0000 7f01f8d46800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:46.620 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.621+0000 7f00ad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:46.620 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.621+0000 7f01f8d46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:46.620 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.621+0000 7f01f8d46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:46.620 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.621+0000 7f01f8d46800 5 note: GC not initialized 2024-09-14T11:11:46.620 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.621+0000 7f0027fff640 20 reqs_thread_entry: start 2024-09-14T11:11:46.620 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.621+0000 7f01f8d46800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:46.620 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.621+0000 7f01f8d46800 20 Filter name: none 2024-09-14T11:11:46.620 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.621+0000 7f0025ffb640 20 reqs_thread_entry: start 2024-09-14T11:11:46.620 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.621+0000 7f01f8d46800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 : miss 2024-09-14T11:11:46.621 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.621+0000 7f01f8d46800 20 rados->read ofs=0 len=0 2024-09-14T11:11:46.622 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.622+0000 7f01f8d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:46.622 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.622+0000 7f01f8d46800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x0 2024-09-14T11:11:46.622 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.622+0000 7f01f8d46800 10 adding default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-14T11:11:46.622 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.622+0000 7f01f8d46800 20 failed to read name.$Mr.RGW99999999999999999 with: (2) No such file or directory 2024-09-14T11:11:46.622 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.622+0000 7f01f8d46800 10 cache get: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test : miss 2024-09-14T11:11:46.622 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.622+0000 7f01f8d46800 20 rados->read ofs=0 len=0 2024-09-14T11:11:46.622 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.622+0000 7f01f8d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:46.622 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.622+0000 7f01f8d46800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x0 2024-09-14T11:11:46.622 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.622+0000 7f01f8d46800 10 adding default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-14T11:11:46.622 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.622+0000 7f01f8d46800 20 failed to read rgw99999999999999999+test@test.test with: (2) No such file or directory 2024-09-14T11:11:46.622 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.623+0000 7f01f8d46800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-14T11:11:46.623 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.623+0000 7f01f8d46800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-14T11:11:46.623 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.623+0000 7f01f8d46800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW99999999999999999, ofs0, ns] 2024-09-14T11:11:46.623 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.623+0000 7f00da7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497264 cookie 94880458991888 notifier 8702 bl.length()=384 2024-09-14T11:11:46.623 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.623+0000 7f00da7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-14T11:11:46.623 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.623+0000 7f00da7fc640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-14T11:11:46.624 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.625+0000 7f01f8d46800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-14T11:11:46.624 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.625+0000 7f01f8d46800 10 moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-14T11:11:46.624 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.625+0000 7f01f8d46800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW99999999999999999, ofs0, ns] 2024-09-14T11:11:46.624 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.625+0000 7f00da7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497265 cookie 94880458992944 notifier 8702 bl.length()=225 2024-09-14T11:11:46.624 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.625+0000 7f00da7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-14T11:11:46.624 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.625+0000 7f00da7fc640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-14T11:11:46.625 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.627+0000 7f01f8d46800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-14T11:11:46.625 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.627+0000 7f01f8d46800 10 moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-14T11:11:46.625 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.627+0000 7f01f8d46800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw99999999999999999+test@test.test, ofs0, ns] 2024-09-14T11:11:46.626 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.627+0000 7f00d9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497054 cookie 94880458997712 notifier 8702 bl.length()=234 2024-09-14T11:11:46.626 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.627+0000 7f00d9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-14T11:11:46.626 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.627+0000 7f00d9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-14T11:11:46.627 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.628+0000 7f00ad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:46.629 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.630+0000 7f01f8d46800 20 remove_watcher() i=0 2024-09-14T11:11:46.629 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.630+0000 7f01f8d46800 2 removed watcher, disabling cache 2024-09-14T11:11:46.630 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.631+0000 7f01f8d46800 20 remove_watcher() i=1 2024-09-14T11:11:46.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.633+0000 7f01f8d46800 20 remove_watcher() i=2 2024-09-14T11:11:46.632 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.634+0000 7f01f8d46800 20 remove_watcher() i=3 2024-09-14T11:11:46.633 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.634+0000 7f01f8d46800 20 remove_watcher() i=4 2024-09-14T11:11:46.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.635+0000 7f01f8d46800 20 remove_watcher() i=5 2024-09-14T11:11:46.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.637+0000 7f01f8d46800 20 remove_watcher() i=6 2024-09-14T11:11:46.636 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.638+0000 7f01f8d46800 20 remove_watcher() i=7 2024-09-14T11:11:46.645 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-14T11:11:46.645 INFO:teuthology.orchestra.run.smithi097.stdout: "id": "RGW99999999999999999", 2024-09-14T11:11:46.645 INFO:teuthology.orchestra.run.smithi097.stdout: "tenant": "", 2024-09-14T11:11:46.645 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "Mr.RGW99999999999999999", 2024-09-14T11:11:46.645 INFO:teuthology.orchestra.run.smithi097.stdout: "email": "RGW99999999999999999+test@test.test", 2024-09-14T11:11:46.645 INFO:teuthology.orchestra.run.smithi097.stdout: "quota": { 2024-09-14T11:11:46.645 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-14T11:11:46.646 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-14T11:11:46.646 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-14T11:11:46.646 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-14T11:11:46.646 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-14T11:11:46.646 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-14T11:11:46.646 INFO:teuthology.orchestra.run.smithi097.stdout: "bucket_quota": { 2024-09-14T11:11:46.646 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-14T11:11:46.646 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-14T11:11:46.646 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-14T11:11:46.646 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-14T11:11:46.646 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-14T11:11:46.646 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-14T11:11:46.646 INFO:teuthology.orchestra.run.smithi097.stdout: "max_users": 1000, 2024-09-14T11:11:46.646 INFO:teuthology.orchestra.run.smithi097.stdout: "max_roles": 1000, 2024-09-14T11:11:46.646 INFO:teuthology.orchestra.run.smithi097.stdout: "max_groups": 1000, 2024-09-14T11:11:46.647 INFO:teuthology.orchestra.run.smithi097.stdout: "max_buckets": 1000, 2024-09-14T11:11:46.647 INFO:teuthology.orchestra.run.smithi097.stdout: "max_access_keys": 4 2024-09-14T11:11:46.647 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-14T11:11:46.648 DEBUG:tasks.s3tests:Creating user RGW99999999999999999 on client.0 2024-09-14T11:11:46.648 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root2.client.0 --display-name Mr.RGW99999999999999999 --email root2+test@test.test --access-key ULVXKXZIEMVOFAZZUMHQ --secret 5UtHZW+RyfQ4QyhMGBKKEfRds/WbB90DugJSM7POKoqG49H0U6s07A== --cluster ceph --account-id RGW99999999999999999 --account-root 2024-09-14T11:11:46.715 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:46.715 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:46.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.750+0000 7fe9aed2f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:46.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.752+0000 7fe9aed2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:46.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.752+0000 7fe9aed2f800 20 realm 2024-09-14T11:11:46.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.752+0000 7fe9aed2f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:46.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.752+0000 7fe9aed2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:46.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.752+0000 7fe9aed2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:46.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.752+0000 7fe9aed2f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:46.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.752+0000 7fe9aed2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:46.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.752+0000 7fe9aed2f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:46.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.753+0000 7fe9aed2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:46.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.753+0000 7fe9aed2f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:46.753 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.754+0000 7fe9aed2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:46.753 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.754+0000 7fe9aed2f800 20 searching for the correct realm 2024-09-14T11:11:46.755 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.756+0000 7fe9ab277640 0 -- 172.21.15.97:0/945344142 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7fe994075bd0 msgr2=0x7fe99404e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:46.961 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.962+0000 7fe9a3fff640 0 -- 172.21.15.97:0/945344142 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7fe99c0bb370 msgr2=0x7fe99c0569c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:46.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.967+0000 7fe9aed2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:46.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.967+0000 7fe9aed2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:46.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.967+0000 7fe9aed2f800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:11:46.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.967+0000 7fe9aed2f800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:11:46.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.967+0000 7fe9aed2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:46.967 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.967+0000 7fe9aed2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:46.967 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.967+0000 7fe9aed2f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:46.967 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.968+0000 7fe9aed2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:46.967 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.968+0000 7fe9aed2f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:46.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.968+0000 7fe9aed2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:46.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.968+0000 7fe9aed2f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:46.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.969+0000 7fe9aed2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:46.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.969+0000 7fe9aed2f800 20 zone default found 2024-09-14T11:11:46.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.969+0000 7fe9aed2f800 4 Realm: () 2024-09-14T11:11:46.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.969+0000 7fe9aed2f800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:11:46.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.969+0000 7fe9aed2f800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:11:46.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.969+0000 7fe9aed2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:46.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.969+0000 7fe9aed2f800 20 zonegroup default 2024-09-14T11:11:46.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.969+0000 7fe9aed2f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:46.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.969+0000 7fe9aed2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:46.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.969+0000 7fe9aed2f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:46.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.969+0000 7fe9aed2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:46.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.969+0000 7fe9aed2f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:46.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.969+0000 7fe9aed2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:46.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.970+0000 7fe9aed2f800 20 started sync module instance, tier type = 2024-09-14T11:11:46.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.970+0000 7fe9aed2f800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:11:46.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.980+0000 7fe9aed2f800 20 add_watcher() i=0 2024-09-14T11:11:46.979 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.980+0000 7fe9aed2f800 20 add_watcher() i=1 2024-09-14T11:11:46.979 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.980+0000 7fe9aed2f800 20 add_watcher() i=2 2024-09-14T11:11:46.979 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.980+0000 7fe9aed2f800 20 add_watcher() i=3 2024-09-14T11:11:46.979 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.980+0000 7fe9aed2f800 20 add_watcher() i=4 2024-09-14T11:11:46.979 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.980+0000 7fe9aed2f800 20 add_watcher() i=5 2024-09-14T11:11:46.979 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.980+0000 7fe9aed2f800 20 add_watcher() i=6 2024-09-14T11:11:46.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.983+0000 7fe9aed2f800 20 add_watcher() i=7 2024-09-14T11:11:46.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.983+0000 7fe9aed2f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:46.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.984+0000 7fe8617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:46.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.984+0000 7fe9aed2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:46.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.984+0000 7fe9aed2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:46.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.984+0000 7fe9aed2f800 5 note: GC not initialized 2024-09-14T11:11:46.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.985+0000 7fe7dbfff640 20 reqs_thread_entry: start 2024-09-14T11:11:46.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.985+0000 7fe9aed2f800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:46.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.985+0000 7fe9aed2f800 20 Filter name: none 2024-09-14T11:11:46.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.985+0000 7fe7d9ffb640 20 reqs_thread_entry: start 2024-09-14T11:11:46.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.985+0000 7fe9aed2f800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-14T11:11:46.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.985+0000 7fe9aed2f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:46.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.985+0000 7fe9aed2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:46.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.985+0000 7fe9aed2f800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x0 2024-09-14T11:11:46.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.985+0000 7fe9aed2f800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:11:46.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.985+0000 7fe9aed2f800 10 cache get: name=default.rgw.meta+users.email+root2+test@test.test : miss 2024-09-14T11:11:46.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.985+0000 7fe9aed2f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:46.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.986+0000 7fe9aed2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:46.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.986+0000 7fe9aed2f800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x0 2024-09-14T11:11:46.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.986+0000 7fe9aed2f800 10 adding default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-14T11:11:46.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.986+0000 7fe9aed2f800 10 cache get: name=default.rgw.meta+users.keys+ULVXKXZIEMVOFAZZUMHQ : miss 2024-09-14T11:11:46.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.986+0000 7fe9aed2f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:46.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.986+0000 7fe9aed2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:46.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.986+0000 7fe9aed2f800 10 cache put: name=default.rgw.meta+users.keys+ULVXKXZIEMVOFAZZUMHQ info.flags=0x0 2024-09-14T11:11:46.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.986+0000 7fe9aed2f800 10 adding default.rgw.meta+users.keys+ULVXKXZIEMVOFAZZUMHQ to cache LRU end 2024-09-14T11:11:46.987 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.986+0000 7fe9aed2f800 10 cache get: name=default.rgw.meta+accounts+account.RGW99999999999999999 : miss 2024-09-14T11:11:46.987 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.986+0000 7fe9aed2f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:46.987 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.987+0000 7fe9aed2f800 20 rados_obj.operate() r=0 bl.length=184 2024-09-14T11:11:46.987 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.987+0000 7fe9aed2f800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-14T11:11:46.987 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.987+0000 7fe9aed2f800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-14T11:11:46.987 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.987+0000 7fe9aed2f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:11:46.987 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.987+0000 7fe9aed2f800 10 cache get: name=default.rgw.meta+users.keys+ULVXKXZIEMVOFAZZUMHQ : hit (negative entry) 2024-09-14T11:11:46.987 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.987+0000 7fe9aed2f800 10 cache get: name=default.rgw.meta+users.keys+ULVXKXZIEMVOFAZZUMHQ : hit (negative entry) 2024-09-14T11:11:46.988 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.989+0000 7fe9aed2f800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T11:11:46.988 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.989+0000 7fe9aed2f800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:11:46.988 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.989+0000 7fe9aed2f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-14T11:11:46.988 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.989+0000 7fe88e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497266 cookie 94001666921952 notifier 8720 bl.length()=681 2024-09-14T11:11:46.988 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.989+0000 7fe88e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T11:11:46.988 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.989+0000 7fe88e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:11:46.989 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.991+0000 7fe9aed2f800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-14T11:11:46.989 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.991+0000 7fe9aed2f800 10 moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-14T11:11:46.989 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.991+0000 7fe9aed2f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root2+test@test.test, ofs0, ns] 2024-09-14T11:11:46.990 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.991+0000 7fe88dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497247 cookie 94001666925984 notifier 8720 bl.length()=189 2024-09-14T11:11:46.990 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.991+0000 7fe88dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-14T11:11:46.990 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.991+0000 7fe88dffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-14T11:11:46.991 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.993+0000 7fe9aed2f800 10 cache put: name=default.rgw.meta+users.keys+ULVXKXZIEMVOFAZZUMHQ info.flags=0x7 2024-09-14T11:11:46.991 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.993+0000 7fe9aed2f800 10 moving default.rgw.meta+users.keys+ULVXKXZIEMVOFAZZUMHQ to cache LRU end 2024-09-14T11:11:46.992 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.993+0000 7fe9aed2f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:ULVXKXZIEMVOFAZZUMHQ, ofs0, ns] 2024-09-14T11:11:46.992 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.993+0000 7fe88dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497248 cookie 94001666938320 notifier 8720 bl.length()=188 2024-09-14T11:11:46.992 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.993+0000 7fe88dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+ULVXKXZIEMVOFAZZUMHQ info.flags=0x7 2024-09-14T11:11:46.992 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.993+0000 7fe88dffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+ULVXKXZIEMVOFAZZUMHQ to cache LRU end 2024-09-14T11:11:46.993 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.995+0000 7fe9aed2f800 20 linked user root2.client.0 to account RGW99999999999999999 2024-09-14T11:11:46.994 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-14T11:11:46.994 INFO:teuthology.orchestra.run.smithi097.stdout: "user_id": "root2.client.0", 2024-09-14T11:11:46.994 INFO:teuthology.orchestra.run.smithi097.stdout: "display_name": "Mr.RGW99999999999999999", 2024-09-14T11:11:46.994 INFO:teuthology.orchestra.run.smithi097.stdout: "email": "root2+test@test.test", 2024-09-14T11:11:46.994 INFO:teuthology.orchestra.run.smithi097.stdout: "suspended": 0, 2024-09-14T11:11:46.994 INFO:teuthology.orchestra.run.smithi097.stdout: "max_buckets": 1000, 2024-09-14T11:11:46.994 INFO:teuthology.orchestra.run.smithi097.stdout: "subusers": [], 2024-09-14T11:11:46.994 INFO:teuthology.orchestra.run.smithi097.stdout: "keys": [ 2024-09-14T11:11:46.994 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-09-14T11:11:46.994 INFO:teuthology.orchestra.run.smithi097.stdout: "user": "root2.client.0", 2024-09-14T11:11:46.995 INFO:teuthology.orchestra.run.smithi097.stdout: "access_key": "ULVXKXZIEMVOFAZZUMHQ", 2024-09-14T11:11:46.995 INFO:teuthology.orchestra.run.smithi097.stdout: "secret_key": "5UtHZW+RyfQ4QyhMGBKKEfRds/WbB90DugJSM7POKoqG49H0U6s07A==", 2024-09-14T11:11:46.995 INFO:teuthology.orchestra.run.smithi097.stdout: "active": true, 2024-09-14T11:11:46.995 INFO:teuthology.orchestra.run.smithi097.stdout: "create_date": "2024-09-14T11:11:46.988148Z" 2024-09-14T11:11:46.995 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-14T11:11:46.995 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2024-09-14T11:11:46.995 INFO:teuthology.orchestra.run.smithi097.stdout: "swift_keys": [], 2024-09-14T11:11:46.995 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": [], 2024-09-14T11:11:46.995 INFO:teuthology.orchestra.run.smithi097.stdout: "op_mask": "read, write, delete", 2024-09-14T11:11:46.995 INFO:teuthology.orchestra.run.smithi097.stdout: "default_placement": "", 2024-09-14T11:11:46.995 INFO:teuthology.orchestra.run.smithi097.stdout: "default_storage_class": "", 2024-09-14T11:11:46.995 INFO:teuthology.orchestra.run.smithi097.stdout: "placement_tags": [], 2024-09-14T11:11:46.995 INFO:teuthology.orchestra.run.smithi097.stdout: "bucket_quota": { 2024-09-14T11:11:46.995 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-14T11:11:46.995 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-14T11:11:46.996 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-14T11:11:46.996 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-14T11:11:46.996 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-14T11:11:46.996 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-14T11:11:46.996 INFO:teuthology.orchestra.run.smithi097.stdout: "user_quota": { 2024-09-14T11:11:46.996 INFO:teuthology.orchestra.run.smithi097.stdout: "enabled": false, 2024-09-14T11:11:46.996 INFO:teuthology.orchestra.run.smithi097.stdout: "check_on_raw": false, 2024-09-14T11:11:46.996 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size": -1, 2024-09-14T11:11:46.996 INFO:teuthology.orchestra.run.smithi097.stdout: "max_size_kb": 0, 2024-09-14T11:11:46.996 INFO:teuthology.orchestra.run.smithi097.stdout: "max_objects": -1 2024-09-14T11:11:46.996 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-14T11:11:46.996 INFO:teuthology.orchestra.run.smithi097.stdout: "temp_url_keys": [], 2024-09-14T11:11:46.996 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "root", 2024-09-14T11:11:46.996 INFO:teuthology.orchestra.run.smithi097.stdout: "mfa_ids": [], 2024-09-14T11:11:46.996 INFO:teuthology.orchestra.run.smithi097.stdout: "account_id": "RGW99999999999999999", 2024-09-14T11:11:46.997 INFO:teuthology.orchestra.run.smithi097.stdout: "path": "/", 2024-09-14T11:11:46.997 INFO:teuthology.orchestra.run.smithi097.stdout: "create_date": "2024-09-14T11:11:46.988137Z", 2024-09-14T11:11:46.997 INFO:teuthology.orchestra.run.smithi097.stdout: "tags": [], 2024-09-14T11:11:46.997 INFO:teuthology.orchestra.run.smithi097.stdout: "group_ids": [] 2024-09-14T11:11:46.997 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-14T11:11:46.997 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:11:46.997 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.996+0000 7fe8617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:46.997 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.998+0000 7fe9aed2f800 20 remove_watcher() i=0 2024-09-14T11:11:46.998 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:46.998+0000 7fe9aed2f800 2 removed watcher, disabling cache 2024-09-14T11:11:46.998 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.000+0000 7fe9aed2f800 20 remove_watcher() i=1 2024-09-14T11:11:46.999 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.001+0000 7fe9aed2f800 20 remove_watcher() i=2 2024-09-14T11:11:47.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.002+0000 7fe9aed2f800 20 remove_watcher() i=3 2024-09-14T11:11:47.001 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.003+0000 7fe9aed2f800 20 remove_watcher() i=4 2024-09-14T11:11:47.002 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.004+0000 7fe9aed2f800 20 remove_watcher() i=5 2024-09-14T11:11:47.004 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.006+0000 7fe9aed2f800 20 remove_watcher() i=6 2024-09-14T11:11:47.007 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.009+0000 7fe9aed2f800 20 remove_watcher() i=7 2024-09-14T11:11:47.019 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root2.client.0 --totp-serial 1764652627 --totp-seed IO6A6SMTFLXQ66N34SAKQD57MANKI3CAORXIT3VE5AVAPILYOPPHYZEVKJVUTJVZ --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:11:47.085 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:47.085 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:47.119 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.120+0000 7fe0f572c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:47.121 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.122+0000 7fe0f572c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:47.121 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.122+0000 7fe0f572c800 20 realm 2024-09-14T11:11:47.121 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.122+0000 7fe0f572c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:47.122 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.122+0000 7fe0f572c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:47.122 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.122+0000 7fe0f572c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:47.122 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.122+0000 7fe0f572c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:47.122 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.122+0000 7fe0f572c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:47.122 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.122+0000 7fe0f572c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:47.123 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.123+0000 7fe0f572c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:47.123 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.123+0000 7fe0f572c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:47.123 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.124+0000 7fe0f572c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:47.123 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.124+0000 7fe0f572c800 20 searching for the correct realm 2024-09-14T11:11:47.124 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.126+0000 7fe0f133e640 0 -- 172.21.15.97:0/1419617423 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x560c6dc66710 msgr2=0x560c6dc68ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:47.127 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.129+0000 7fe0f133e640 0 -- 172.21.15.97:0/1419617423 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7fe0dc0bcb30 msgr2=0x7fe0dc0bb0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:47.132 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.134+0000 7fe0f572c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:47.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.134+0000 7fe0f572c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:47.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.134+0000 7fe0f572c800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:11:47.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.134+0000 7fe0f572c800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:11:47.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.134+0000 7fe0f572c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:47.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.134+0000 7fe0f572c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:47.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.134+0000 7fe0f572c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:47.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.134+0000 7fe0f572c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:47.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.134+0000 7fe0f572c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:47.135 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.134+0000 7fe0f572c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:47.135 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.134+0000 7fe0f572c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:47.135 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.135+0000 7fe0f572c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:47.135 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.135+0000 7fe0f572c800 20 zone default found 2024-09-14T11:11:47.135 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.135+0000 7fe0f572c800 4 Realm: () 2024-09-14T11:11:47.135 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.135+0000 7fe0f572c800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:11:47.135 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.135+0000 7fe0f572c800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:11:47.135 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.135+0000 7fe0f572c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:47.135 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.135+0000 7fe0f572c800 20 zonegroup default 2024-09-14T11:11:47.135 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.135+0000 7fe0f572c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:47.136 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.135+0000 7fe0f572c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:47.136 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.135+0000 7fe0f572c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:47.136 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.135+0000 7fe0f572c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:47.136 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.135+0000 7fe0f572c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:47.136 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.135+0000 7fe0f572c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:47.136 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.135+0000 7fe0f572c800 20 started sync module instance, tier type = 2024-09-14T11:11:47.136 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.135+0000 7fe0f572c800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:11:47.147 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.148+0000 7fe0f572c800 20 add_watcher() i=0 2024-09-14T11:11:47.147 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.148+0000 7fe0f572c800 20 add_watcher() i=1 2024-09-14T11:11:47.147 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.148+0000 7fe0f572c800 20 add_watcher() i=2 2024-09-14T11:11:47.147 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.148+0000 7fe0f572c800 20 add_watcher() i=3 2024-09-14T11:11:47.147 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.148+0000 7fe0f572c800 20 add_watcher() i=4 2024-09-14T11:11:47.147 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.148+0000 7fe0f572c800 20 add_watcher() i=5 2024-09-14T11:11:47.147 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.148+0000 7fe0f572c800 20 add_watcher() i=6 2024-09-14T11:11:47.149 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.150+0000 7fe0f572c800 20 add_watcher() i=7 2024-09-14T11:11:47.149 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.150+0000 7fe0f572c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:47.151 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.152+0000 7fdfa77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:47.151 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.152+0000 7fe0f572c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:47.151 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.152+0000 7fe0f572c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:47.151 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.152+0000 7fe0f572c800 5 note: GC not initialized 2024-09-14T11:11:47.152 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.152+0000 7fdfa67e4640 20 reqs_thread_entry: start 2024-09-14T11:11:47.152 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.152+0000 7fe0f572c800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:47.152 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.153+0000 7fe0f572c800 20 Filter name: none 2024-09-14T11:11:47.152 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.153+0000 7fdf17fff640 20 reqs_thread_entry: start 2024-09-14T11:11:47.152 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.153+0000 7fe0f572c800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-14T11:11:47.152 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.153+0000 7fe0f572c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:47.152 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.153+0000 7fe0f572c800 20 rados_obj.operate() r=0 bl.length=494 2024-09-14T11:11:47.152 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.153+0000 7fe0f572c800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x13 2024-09-14T11:11:47.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.153+0000 7fe0f572c800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:11:47.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.153+0000 7fe0f572c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:11:47.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.156+0000 7fe0f572c800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T11:11:47.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.156+0000 7fe0f572c800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:11:47.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.156+0000 7fe0f572c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-14T11:11:47.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.156+0000 7fdfd4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497267 cookie 94611381380400 notifier 8738 bl.length()=695 2024-09-14T11:11:47.155 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.156+0000 7fdfd4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T11:11:47.155 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.156+0000 7fdfd4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:11:47.155 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.157+0000 7fdfa77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:47.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.159+0000 7fe0f572c800 20 remove_watcher() i=0 2024-09-14T11:11:47.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.159+0000 7fe0f572c800 2 removed watcher, disabling cache 2024-09-14T11:11:47.159 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.160+0000 7fe0f572c800 20 remove_watcher() i=1 2024-09-14T11:11:47.161 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.162+0000 7fe0f572c800 20 remove_watcher() i=2 2024-09-14T11:11:47.162 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.163+0000 7fe0f572c800 20 remove_watcher() i=3 2024-09-14T11:11:47.163 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.164+0000 7fe0f572c800 20 remove_watcher() i=4 2024-09-14T11:11:47.164 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.165+0000 7fe0f572c800 20 remove_watcher() i=5 2024-09-14T11:11:47.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.166+0000 7fe0f572c800 20 remove_watcher() i=6 2024-09-14T11:11:47.166 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:11:47.167+0000 7fe0f572c800 20 remove_watcher() i=7 2024-09-14T11:11:47.177 INFO:tasks.s3tests:Configuring s3-tests... 2024-09-14T11:11:47.177 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-14T11:11:47.178 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-09-14T11:11:47.206 INFO:tasks.s3tests:Configuring boto... 2024-09-14T11:11:47.207 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-14T11:11:47.207 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-09-14T11:11:47.275 DEBUG:teuthology.orchestra.run.smithi097:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-14T11:11:47.455 INFO:teuthology.orchestra.run.smithi097.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-09-14T11:11:47.633 INFO:teuthology.orchestra.run.smithi097.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-09-14T11:11:47.892 INFO:teuthology.orchestra.run.smithi097.stdout:py installdeps: -rrequirements.txt 2024-09-14T11:13:25.601 INFO:teuthology.orchestra.run.smithi097.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-09-14T11:13:27.002 INFO:teuthology.orchestra.run.smithi097.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.5.0,certifi==2024.8.30,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.2,filelock==3.16.0,gevent==24.2.1,greenlet==3.1.0,httplib2==0.22.0,idna==3.9,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.3.0,munch==4.0.0,packaging==24.1,platformdirs==4.3.3,pluggy==1.5.0,pyparsing==3.1.4,pyproject-api==1.7.1,pytest==8.3.3,python-dateutil==2.9.0.post0,pytz==2024.2,PyYAML==6.0.2,requests==2.32.3,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=ab3a8b6e5c85d8429ecd40ec02bd37722a655ae7d98c869f03ff440e5051d65e,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.18.1,urllib3==1.26.20,virtualenv==20.26.4,zope.event==5.0,zope.interface==7.0.3 2024-09-14T11:13:27.002 INFO:teuthology.orchestra.run.smithi097.stdout:py run-test-pre: PYTHONHASHSEED='1244682474' 2024-09-14T11:13:27.002 INFO:teuthology.orchestra.run.smithi097.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-14T11:13:27.135 INFO:teuthology.orchestra.run.smithi097.stdout:============================= test session starts ============================== 2024-09-14T11:13:27.135 INFO:teuthology.orchestra.run.smithi097.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-09-14T11:13:27.136 INFO:teuthology.orchestra.run.smithi097.stdout:cachedir: .tox/py/.pytest_cache 2024-09-14T11:13:27.136 INFO:teuthology.orchestra.run.smithi097.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-09-14T11:13:27.136 INFO:teuthology.orchestra.run.smithi097.stdout:configfile: pytest.ini 2024-09-14T11:13:28.879 INFO:teuthology.orchestra.run.smithi097.stdout:collecting ... collected 872 items / 126 deselected / 746 selected 2024-09-14T11:13:28.880 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:13:29.014 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2024-09-14T11:13:29.138 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2024-09-14T11:13:29.315 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-09-14T11:13:29.488 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-09-14T11:13:29.619 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2024-09-14T11:13:29.748 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-09-14T11:13:29.920 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 0%] 2024-09-14T11:13:30.049 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-09-14T11:13:30.135 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2024-09-14T11:13:30.221 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2024-09-14T11:13:30.344 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2024-09-14T11:13:30.467 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2024-09-14T11:13:30.589 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2024-09-14T11:13:30.712 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 1%] 2024-09-14T11:13:30.798 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2024-09-14T11:13:30.884 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2024-09-14T11:13:30.929 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-09-14T11:13:30.975 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-09-14T11:13:31.020 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-09-14T11:13:31.066 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 2%] 2024-09-14T11:13:31.111 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 2%] 2024-09-14T11:13:31.156 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 2%] 2024-09-14T11:13:31.201 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-09-14T11:13:31.246 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-09-14T11:13:31.291 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-09-14T11:13:31.336 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-09-14T11:13:31.381 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 3%] 2024-09-14T11:13:31.426 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 3%] 2024-09-14T11:13:31.471 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 3%] 2024-09-14T11:13:31.516 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-09-14T11:13:31.562 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-09-14T11:13:31.608 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-09-14T11:13:31.654 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-14T11:13:31.700 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-14T11:13:31.745 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 4%] 2024-09-14T11:13:31.790 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 4%] 2024-09-14T11:13:31.836 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 4%] 2024-09-14T11:13:31.882 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-09-14T11:13:31.929 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-09-14T11:13:31.976 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 5%] 2024-09-14T11:13:32.022 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 5%] 2024-09-14T11:13:32.069 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 5%] 2024-09-14T11:13:32.115 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 5%] 2024-09-14T11:13:32.162 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 5%] 2024-09-14T11:13:32.207 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-09-14T11:13:32.253 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-09-14T11:13:32.299 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 6%] 2024-09-14T11:13:32.346 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 6%] 2024-09-14T11:13:32.391 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 6%] 2024-09-14T11:13:32.438 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 6%] 2024-09-14T11:13:32.485 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 6%] 2024-09-14T11:13:32.530 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 6%] 2024-09-14T11:13:32.577 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-09-14T11:13:32.861 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 7%] 2024-09-14T11:13:33.376 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 7%] 2024-09-14T11:13:34.392 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 7%] 2024-09-14T11:13:35.223 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 7%] 2024-09-14T11:13:36.819 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 7%] 2024-09-14T11:13:37.258 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 7%] 2024-09-14T11:13:37.858 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 8%] 2024-09-14T11:13:38.081 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 8%] 2024-09-14T11:13:38.164 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 8%] 2024-09-14T11:13:38.319 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 8%] 2024-09-14T11:13:38.476 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 8%] 2024-09-14T11:13:38.668 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 8%] 2024-09-14T11:13:38.808 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 8%] 2024-09-14T11:13:38.893 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 8%] 2024-09-14T11:13:38.894 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 9%] 2024-09-14T11:13:38.895 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 9%] 2024-09-14T11:13:38.896 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 9%] 2024-09-14T11:13:38.896 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 9%] 2024-09-14T11:13:38.897 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 9%] 2024-09-14T11:13:38.898 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 9%] 2024-09-14T11:13:38.899 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 9%] 2024-09-14T11:13:38.900 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-09-14T11:13:38.900 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-14T11:13:38.901 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-14T11:13:38.902 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-14T11:13:38.903 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 10%] 2024-09-14T11:13:38.903 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-14T11:13:38.904 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-14T11:13:38.905 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-14T11:13:38.906 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-14T11:13:38.907 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-14T11:13:38.908 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-14T11:13:38.909 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-14T11:13:38.909 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 11%] 2024-09-14T11:13:38.910 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 11%] 2024-09-14T11:13:38.911 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 11%] 2024-09-14T11:13:38.912 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 12%] 2024-09-14T11:13:38.913 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 12%] 2024-09-14T11:13:38.913 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 12%] 2024-09-14T11:13:38.914 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 12%] 2024-09-14T11:13:38.915 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 12%] 2024-09-14T11:13:39.000 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 12%] 2024-09-14T11:13:39.011 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 12%] 2024-09-14T11:13:39.277 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 13%] 2024-09-14T11:13:43.472 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 13%] 2024-09-14T11:13:43.655 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 13%] 2024-09-14T11:13:43.892 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 13%] 2024-09-14T11:13:44.128 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 13%] 2024-09-14T11:13:44.361 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 13%] 2024-09-14T11:13:44.603 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 13%] 2024-09-14T11:13:44.779 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 13%] 2024-09-14T11:13:45.046 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 14%] 2024-09-14T11:13:45.269 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 14%] 2024-09-14T11:13:45.491 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 14%] 2024-09-14T11:13:45.666 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 14%] 2024-09-14T11:13:45.834 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 14%] 2024-09-14T11:13:46.002 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 14%] 2024-09-14T11:13:46.090 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 14%] 2024-09-14T11:13:46.265 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 15%] 2024-09-14T11:13:46.492 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 15%] 2024-09-14T11:13:46.754 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 15%] 2024-09-14T11:13:46.928 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 15%] 2024-09-14T11:13:47.103 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 15%] 2024-09-14T11:13:47.289 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 15%] 2024-09-14T11:13:47.486 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 15%] 2024-09-14T11:13:47.661 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 15%] 2024-09-14T11:13:47.829 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 16%] 2024-09-14T11:13:47.997 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 16%] 2024-09-14T11:13:48.084 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 16%] 2024-09-14T11:13:48.206 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 16%] 2024-09-14T11:13:48.294 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 16%] 2024-09-14T11:13:48.381 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 16%] 2024-09-14T11:13:48.470 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 16%] 2024-09-14T11:13:48.630 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 17%] 2024-09-14T11:13:48.720 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 17%] 2024-09-14T11:13:48.815 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 17%] 2024-09-14T11:13:49.007 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 17%] 2024-09-14T11:13:49.194 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 17%] 2024-09-14T11:13:49.285 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 17%] 2024-09-14T11:13:49.503 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 17%] 2024-09-14T11:13:49.688 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 17%] 2024-09-14T11:13:49.968 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-14T11:13:50.110 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 18%] 2024-09-14T11:13:50.295 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 18%] 2024-09-14T11:13:50.481 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 18%] 2024-09-14T11:13:50.857 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-14T11:13:51.063 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-14T11:13:51.291 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-14T11:13:51.533 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:13:51.905 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:13:52.191 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:13:52.534 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:13:52.790 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:13:53.120 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:13:53.352 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 19%] 2024-09-14T11:13:53.718 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 19%] 2024-09-14T11:13:53.909 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 20%] 2024-09-14T11:13:54.675 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_create PASSED [ 20%] 2024-09-14T11:13:55.174 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_case_insensitive_name PASSED [ 20%] 2024-09-14T11:13:55.808 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_delete PASSED [ 20%] 2024-09-14T11:13:57.284 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list PASSED [ 20%] 2024-09-14T11:13:59.323 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list_path_prefix PASSED [ 20%] 2024-09-14T11:14:00.365 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_name PASSED [ 20%] 2024-09-14T11:14:01.321 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_path PASSED [ 21%] 2024-09-14T11:14:02.014 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_create PASSED [ 21%] 2024-09-14T11:14:02.390 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_create PASSED [ 21%] 2024-09-14T11:14:03.203 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_update PASSED [ 21%] 2024-09-14T11:14:03.749 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_update PASSED [ 21%] 2024-09-14T11:14:04.519 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_delete PASSED [ 21%] 2024-09-14T11:14:05.026 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_delete PASSED [ 21%] 2024-09-14T11:14:06.075 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_list PASSED [ 21%] 2024-09-14T11:14:06.733 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_bucket_policy_allow PASSED [ 22%] 2024-09-14T11:14:07.931 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy PASSED [ 22%] 2024-09-14T11:14:09.068 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_managed PASSED [ 22%] 2024-09-14T11:14:09.784 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_allow PASSED [ 22%] 2024-09-14T11:14:10.430 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_create PASSED [ 22%] 2024-09-14T11:14:10.947 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_case_insensitive_name PASSED [ 22%] 2024-09-14T11:14:12.404 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_list PASSED [ 22%] 2024-09-14T11:14:13.378 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_update PASSED [ 23%] 2024-09-14T11:14:14.588 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy PASSED [ 23%] 2024-09-14T11:14:15.754 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy PASSED [ 23%] 2024-09-14T11:14:16.746 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy_allow PASSED [ 23%] 2024-09-14T11:14:17.740 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy_allow PASSED [ 23%] 2024-09-14T11:14:18.491 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_create PASSED [ 23%] 2024-09-14T11:14:19.016 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_case_insensitive_name PASSED [ 23%] 2024-09-14T11:14:19.623 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_delete PASSED [ 23%] 2024-09-14T11:14:20.904 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list PASSED [ 24%] 2024-09-14T11:14:22.671 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list_path_prefix PASSED [ 24%] 2024-09-14T11:14:23.353 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_update PASSED [ 24%] 2024-09-14T11:14:24.414 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy PASSED [ 24%] 2024-09-14T11:14:25.677 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_managed PASSED [ 24%] 2024-09-14T11:14:26.558 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow PASSED [ 24%] 2024-09-14T11:14:27.424 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_same_account_role_policy_allow PASSED [ 24%] 2024-09-14T11:14:28.338 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_role_policy_allow PASSED [ 25%] 2024-09-14T11:14:29.251 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_create_bucket PASSED [ 25%] 2024-09-14T11:14:30.103 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_get_role PASSED [ 25%] 2024-09-14T11:14:30.708 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_account_oidc_provider PASSED [ 25%] 2024-09-14T11:14:31.207 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_new_client_id_to_oidc PASSED [ 25%] 2024-09-14T11:14:31.702 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_existing_client_id_to_oidc PASSED [ 25%] 2024-09-14T11:14:32.203 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_verify_update_thumbprintlist_of_oidc PASSED [ 25%] 2024-09-14T11:14:33.011 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_user_arn PASSED [ 26%] 2024-09-14T11:14:33.813 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_user_arn PASSED [ 26%] 2024-09-14T11:14:34.608 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_arn PASSED [ 26%] 2024-09-14T11:14:35.410 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_arn PASSED [ 26%] 2024-09-14T11:14:36.211 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_id PASSED [ 26%] 2024-09-14T11:14:37.012 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_id PASSED [ 26%] 2024-09-14T11:14:37.845 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_user_id PASSED [ 26%] 2024-09-14T11:14:38.646 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_user_id PASSED [ 26%] 2024-09-14T11:14:39.448 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_canonical_id PASSED [ 27%] 2024-09-14T11:14:40.248 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-14T11:14:41.042 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_account_email PASSED [ 27%] 2024-09-14T11:14:41.843 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_account_email PASSED [ 27%] 2024-09-14T11:14:42.307 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_arn PASSED [ 27%] 2024-09-14T11:14:42.732 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_id PASSED [ 27%] 2024-09-14T11:14:43.118 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-14T11:14:43.501 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_account_email PASSED [ 28%] 2024-09-14T11:14:43.748 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 28%] 2024-09-14T11:14:44.148 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 28%] 2024-09-14T11:14:44.437 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 28%] 2024-09-14T11:14:44.725 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 28%] 2024-09-14T11:14:45.009 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 28%] 2024-09-14T11:14:45.261 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 28%] 2024-09-14T11:14:45.512 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 28%] 2024-09-14T11:14:45.761 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 29%] 2024-09-14T11:14:46.048 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 29%] 2024-09-14T11:14:46.348 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 29%] 2024-09-14T11:14:46.650 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 29%] 2024-09-14T11:14:46.876 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-14T11:14:47.103 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-14T11:14:47.396 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 29%] 2024-09-14T11:14:47.643 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 30%] 2024-09-14T11:14:47.946 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 30%] 2024-09-14T11:14:48.250 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 30%] 2024-09-14T11:14:48.668 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 30%] 2024-09-14T11:14:48.919 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 30%] 2024-09-14T11:14:49.203 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 30%] 2024-09-14T11:14:49.452 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 30%] 2024-09-14T11:14:49.699 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 30%] 2024-09-14T11:14:49.948 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 31%] 2024-09-14T11:14:50.201 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 31%] 2024-09-14T11:14:50.450 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 31%] 2024-09-14T11:14:50.735 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 31%] 2024-09-14T11:14:50.986 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 31%] 2024-09-14T11:14:51.239 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 31%] 2024-09-14T11:14:51.489 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 31%] 2024-09-14T11:14:51.729 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 32%] 2024-09-14T11:14:51.971 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 32%] 2024-09-14T11:14:52.215 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 32%] 2024-09-14T11:14:52.510 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 32%] 2024-09-14T11:14:52.759 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 32%] 2024-09-14T11:15:01.046 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 32%] 2024-09-14T11:15:01.327 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 32%] 2024-09-14T11:15:01.569 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 32%] 2024-09-14T11:15:01.812 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 33%] 2024-09-14T11:15:02.052 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 33%] 2024-09-14T11:15:02.296 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 33%] 2024-09-14T11:15:02.541 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 33%] 2024-09-14T11:15:02.781 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 33%] 2024-09-14T11:15:03.063 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 33%] 2024-09-14T11:15:03.307 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 33%] 2024-09-14T11:15:03.548 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 34%] 2024-09-14T11:15:03.790 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 34%] 2024-09-14T11:15:04.034 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 34%] 2024-09-14T11:15:04.285 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 34%] 2024-09-14T11:15:04.546 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 34%] 2024-09-14T11:15:04.852 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 34%] 2024-09-14T11:15:05.104 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 34%] 2024-09-14T11:15:05.351 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 34%] 2024-09-14T11:15:05.600 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-09-14T11:15:06.055 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-14T11:15:06.307 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-14T11:15:06.557 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-14T11:15:06.844 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-14T11:15:07.138 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 35%] 2024-09-14T11:15:07.434 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 35%] 2024-09-14T11:15:07.683 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 36%] 2024-09-14T11:15:07.931 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 36%] 2024-09-14T11:15:08.180 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 36%] 2024-09-14T11:15:08.468 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 36%] 2024-09-14T11:15:08.560 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 36%] 2024-09-14T11:15:08.785 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 36%] 2024-09-14T11:15:09.376 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 36%] 2024-09-14T11:15:09.958 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 36%] 2024-09-14T11:15:10.207 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 37%] 2024-09-14T11:15:10.495 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 37%] 2024-09-14T11:15:10.746 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 37%] 2024-09-14T11:15:10.994 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 37%] 2024-09-14T11:15:11.286 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 37%] 2024-09-14T11:15:11.581 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 37%] 2024-09-14T11:15:11.831 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 37%] 2024-09-14T11:15:12.084 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 38%] 2024-09-14T11:15:12.373 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 38%] 2024-09-14T11:15:12.622 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 38%] 2024-09-14T11:15:12.872 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 38%] 2024-09-14T11:15:13.120 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 38%] 2024-09-14T11:15:13.538 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 38%] 2024-09-14T11:15:14.047 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 38%] 2024-09-14T11:15:14.270 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 39%] 2024-09-14T11:15:14.454 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 39%] 2024-09-14T11:15:14.630 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 39%] 2024-09-14T11:15:14.808 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 39%] 2024-09-14T11:15:14.898 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 39%] 2024-09-14T11:15:14.990 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 39%] 2024-09-14T11:15:15.080 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 39%] 2024-09-14T11:15:15.313 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 39%] 2024-09-14T11:15:15.552 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 40%] 2024-09-14T11:15:15.682 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 40%] 2024-09-14T11:15:15.908 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 40%] 2024-09-14T11:15:16.079 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 40%] 2024-09-14T11:15:16.261 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 40%] 2024-09-14T11:15:16.436 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 40%] 2024-09-14T11:15:16.842 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 40%] 2024-09-14T11:15:17.214 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 41%] 2024-09-14T11:15:17.584 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 41%] 2024-09-14T11:15:26.049 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 41%] 2024-09-14T11:15:34.502 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 41%] 2024-09-14T11:15:34.726 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 41%] 2024-09-14T11:15:34.952 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 41%] 2024-09-14T11:15:35.180 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 41%] 2024-09-14T11:15:35.405 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 41%] 2024-09-14T11:15:35.687 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 42%] 2024-09-14T11:15:35.918 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 42%] 2024-09-14T11:15:36.145 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 42%] 2024-09-14T11:15:36.391 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 42%] 2024-09-14T11:15:36.664 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 42%] 2024-09-14T11:15:36.930 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 42%] 2024-09-14T11:15:37.197 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 42%] 2024-09-14T11:15:37.425 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 43%] 2024-09-14T11:15:37.691 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 43%] 2024-09-14T11:15:37.863 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 43%] 2024-09-14T11:15:38.286 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 43%] 2024-09-14T11:15:38.504 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 43%] 2024-09-14T11:15:38.761 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 43%] 2024-09-14T11:15:39.028 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 43%] 2024-09-14T11:15:39.250 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 43%] 2024-09-14T11:15:39.473 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 44%] 2024-09-14T11:15:39.702 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 44%] 2024-09-14T11:15:39.972 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 44%] 2024-09-14T11:15:40.148 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 44%] 2024-09-14T11:15:40.323 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 44%] 2024-09-14T11:15:40.498 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 44%] 2024-09-14T11:15:40.673 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 44%] 2024-09-14T11:15:40.884 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 45%] 2024-09-14T11:15:41.061 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 45%] 2024-09-14T11:15:41.285 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 45%] 2024-09-14T11:15:41.461 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 45%] 2024-09-14T11:15:41.635 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 45%] 2024-09-14T11:15:41.813 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 45%] 2024-09-14T11:15:41.991 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 45%] 2024-09-14T11:15:42.251 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 45%] 2024-09-14T11:15:42.425 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 46%] 2024-09-14T11:15:42.600 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 46%] 2024-09-14T11:15:42.816 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 46%] 2024-09-14T11:15:42.991 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 46%] 2024-09-14T11:15:43.164 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 46%] 2024-09-14T11:15:43.338 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 46%] 2024-09-14T11:15:43.516 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 46%] 2024-09-14T11:15:43.771 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 47%] 2024-09-14T11:15:43.946 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 47%] 2024-09-14T11:15:44.212 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 47%] 2024-09-14T11:15:44.482 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 47%] 2024-09-14T11:15:44.749 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 47%] 2024-09-14T11:15:45.015 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 47%] 2024-09-14T11:15:45.284 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 47%] 2024-09-14T11:15:46.538 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 47%] 2024-09-14T11:15:46.821 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 48%] 2024-09-14T11:15:47.093 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 48%] 2024-09-14T11:15:47.413 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 48%] 2024-09-14T11:15:47.772 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 48%] 2024-09-14T11:15:48.094 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 48%] 2024-09-14T11:15:48.397 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 48%] 2024-09-14T11:15:48.717 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 48%] 2024-09-14T11:15:49.078 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 49%] 2024-09-14T11:15:49.348 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 49%] 2024-09-14T11:15:49.705 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 49%] 2024-09-14T11:15:49.931 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 49%] 2024-09-14T11:15:50.077 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 49%] 2024-09-14T11:15:50.223 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 49%] 2024-09-14T11:15:50.450 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 49%] 2024-09-14T11:15:50.626 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 50%] 2024-09-14T11:15:50.718 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 50%] 2024-09-14T11:15:50.979 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 50%] 2024-09-14T11:15:51.205 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 50%] 2024-09-14T11:15:51.432 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 50%] 2024-09-14T11:15:53.922 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 50%] 2024-09-14T11:15:54.157 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 50%] 2024-09-14T11:15:54.425 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 50%] 2024-09-14T11:15:54.654 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 51%] 2024-09-14T11:15:54.884 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 51%] 2024-09-14T11:15:55.070 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 51%] 2024-09-14T11:15:55.302 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 51%] 2024-09-14T11:15:55.527 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 51%] 2024-09-14T11:15:55.760 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 51%] 2024-09-14T11:15:55.983 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 51%] 2024-09-14T11:15:56.211 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 52%] 2024-09-14T11:15:56.437 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 52%] 2024-09-14T11:15:56.706 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 52%] 2024-09-14T11:15:56.942 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 52%] 2024-09-14T11:15:57.164 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 52%] 2024-09-14T11:15:57.394 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl PASSED [ 52%] 2024-09-14T11:15:57.616 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant PASSED [ 52%] 2024-09-14T11:15:57.844 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 52%] 2024-09-14T11:15:57.935 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 53%] 2024-09-14T11:15:58.025 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 53%] 2024-09-14T11:15:58.117 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 53%] 2024-09-14T11:15:58.330 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 53%] 2024-09-14T11:15:58.503 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 53%] 2024-09-14T11:15:58.675 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 53%] 2024-09-14T11:15:58.844 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 53%] 2024-09-14T11:15:59.060 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 54%] 2024-09-14T11:15:59.151 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 54%] 2024-09-14T11:15:59.241 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 54%] 2024-09-14T11:15:59.413 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 54%] 2024-09-14T11:15:59.505 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 54%] 2024-09-14T11:15:59.596 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 54%] 2024-09-14T11:15:59.725 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 54%] 2024-09-14T11:15:59.817 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 54%] 2024-09-14T11:16:00.003 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 55%] 2024-09-14T11:16:00.215 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 55%] 2024-09-14T11:16:00.392 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 55%] 2024-09-14T11:16:00.604 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 55%] 2024-09-14T11:16:00.819 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 55%] 2024-09-14T11:16:00.995 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 55%] 2024-09-14T11:16:01.209 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 55%] 2024-09-14T11:16:01.470 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 56%] 2024-09-14T11:16:01.685 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-14T11:16:01.899 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 56%] 2024-09-14T11:16:02.170 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 56%] 2024-09-14T11:16:02.481 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 56%] 2024-09-14T11:16:02.799 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 56%] 2024-09-14T11:16:03.069 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-14T11:16:03.340 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 56%] 2024-09-14T11:16:03.656 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 57%] 2024-09-14T11:16:03.976 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 57%] 2024-09-14T11:16:04.256 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 57%] 2024-09-14T11:16:04.500 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 57%] 2024-09-14T11:16:04.680 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 57%] 2024-09-14T11:16:05.038 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 57%] 2024-09-14T11:16:05.353 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 57%] 2024-09-14T11:16:05.668 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 58%] 2024-09-14T11:16:05.985 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 58%] 2024-09-14T11:16:06.300 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 58%] 2024-09-14T11:16:06.603 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 58%] 2024-09-14T11:16:06.856 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 58%] 2024-09-14T11:16:07.109 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 58%] 2024-09-14T11:16:07.448 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 58%] 2024-09-14T11:16:07.704 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 58%] 2024-09-14T11:16:07.889 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 59%] 2024-09-14T11:16:08.158 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 59%] 2024-09-14T11:16:08.430 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 59%] 2024-09-14T11:16:08.659 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 59%] 2024-09-14T11:16:08.881 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 59%] 2024-09-14T11:16:09.199 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 59%] 2024-09-14T11:16:09.588 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 59%] 2024-09-14T11:16:09.983 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 60%] 2024-09-14T11:16:10.374 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 60%] 2024-09-14T11:16:10.765 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 60%] 2024-09-14T11:16:11.195 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 60%] 2024-09-14T11:16:11.588 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 60%] 2024-09-14T11:16:11.981 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 60%] 2024-09-14T11:16:12.377 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 60%] 2024-09-14T11:16:12.772 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 60%] 2024-09-14T11:16:13.130 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 61%] 2024-09-14T11:16:13.532 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 61%] 2024-09-14T11:16:13.894 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 61%] 2024-09-14T11:16:14.437 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 61%] 2024-09-14T11:16:14.970 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 61%] 2024-09-14T11:16:15.057 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 61%] 2024-09-14T11:16:15.151 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 61%] 2024-09-14T11:16:15.241 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 62%] 2024-09-14T11:16:15.424 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 62%] 2024-09-14T11:16:15.648 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 62%] 2024-09-14T11:16:15.822 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 62%] 2024-09-14T11:16:15.992 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 62%] 2024-09-14T11:16:16.256 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 62%] 2024-09-14T11:16:17.107 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 62%] 2024-09-14T11:16:17.381 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 63%] 2024-09-14T11:16:17.671 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 63%] 2024-09-14T11:16:18.165 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 63%] 2024-09-14T11:16:18.494 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 63%] 2024-09-14T11:16:18.815 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 63%] 2024-09-14T11:16:19.089 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 63%] 2024-09-14T11:16:19.366 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 63%] 2024-09-14T11:16:19.821 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 63%] 2024-09-14T11:16:20.134 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 64%] 2024-09-14T11:16:20.480 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 64%] 2024-09-14T11:16:20.815 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 64%] 2024-09-14T11:16:21.340 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 64%] 2024-09-14T11:16:21.820 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 64%] 2024-09-14T11:16:22.001 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 64%] 2024-09-14T11:16:22.178 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 64%] 2024-09-14T11:16:23.163 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 65%] 2024-09-14T11:16:23.545 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 65%] 2024-09-14T11:16:25.027 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 65%] 2024-09-14T11:16:25.217 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 65%] 2024-09-14T11:16:25.475 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 65%] 2024-09-14T11:16:26.037 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 65%] 2024-09-14T11:16:26.321 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 65%] 2024-09-14T11:16:26.852 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 65%] 2024-09-14T11:16:28.164 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 66%] 2024-09-14T11:16:29.224 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 66%] 2024-09-14T11:16:31.246 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 66%] 2024-09-14T11:16:35.431 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 66%] 2024-09-14T11:16:36.411 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 66%] 2024-09-14T11:16:38.082 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 66%] 2024-09-14T11:16:38.368 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 66%] 2024-09-14T11:16:38.957 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 67%] 2024-09-14T11:16:39.463 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 67%] 2024-09-14T11:16:39.862 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 67%] 2024-09-14T11:16:40.132 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 67%] 2024-09-14T11:16:40.557 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 67%] 2024-09-14T11:16:40.896 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 67%] 2024-09-14T11:16:41.144 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 67%] 2024-09-14T11:16:41.389 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 67%] 2024-09-14T11:16:55.674 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 68%] 2024-09-14T11:16:57.537 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_single_get_part PASSED [ 68%] 2024-09-14T11:16:57.858 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 68%] 2024-09-14T11:16:58.037 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 68%] 2024-09-14T11:16:58.308 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 68%] 2024-09-14T11:17:01.610 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 68%] 2024-09-14T11:17:04.819 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 68%] 2024-09-14T11:17:08.024 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 69%] 2024-09-14T11:17:08.261 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 69%] 2024-09-14T11:17:08.496 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 69%] 2024-09-14T11:17:08.727 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object PASSED [ 69%] 2024-09-14T11:17:08.957 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl PASSED [ 69%] 2024-09-14T11:17:09.186 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant PASSED [ 69%] 2024-09-14T11:17:09.415 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl PASSED [ 69%] 2024-09-14T11:17:09.724 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 69%] 2024-09-14T11:17:10.025 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 70%] 2024-09-14T11:17:10.409 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 70%] 2024-09-14T11:17:10.831 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 70%] 2024-09-14T11:17:11.357 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 70%] 2024-09-14T11:17:11.788 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 70%] 2024-09-14T11:17:12.275 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 70%] 2024-09-14T11:17:12.591 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 70%] 2024-09-14T11:17:13.084 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 71%] 2024-09-14T11:17:13.710 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 71%] 2024-09-14T11:17:14.178 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 71%] 2024-09-14T11:17:14.542 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 71%] 2024-09-14T11:17:15.041 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 71%] 2024-09-14T11:17:15.310 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 71%] 2024-09-14T11:17:19.469 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 71%] 2024-09-14T11:17:19.744 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 71%] 2024-09-14T11:17:20.020 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 72%] 2024-09-14T11:17:20.293 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 72%] 2024-09-14T11:17:20.564 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 72%] 2024-09-14T11:17:20.982 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 72%] 2024-09-14T11:17:27.227 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 72%] 2024-09-14T11:17:27.590 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 72%] 2024-09-14T11:17:27.934 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 72%] 2024-09-14T11:17:28.385 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 73%] 2024-09-14T11:17:28.870 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 73%] 2024-09-14T11:17:31.417 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 73%] 2024-09-14T11:17:31.834 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy PASSED [ 73%] 2024-09-14T11:17:35.121 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 73%] 2024-09-14T11:17:47.731 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 73%] 2024-09-14T11:17:49.250 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 73%] 2024-09-14T11:17:50.161 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 73%] 2024-09-14T11:17:51.250 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 74%] 2024-09-14T11:17:51.716 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 74%] 2024-09-14T11:17:52.148 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 74%] 2024-09-14T11:17:52.469 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 74%] 2024-09-14T11:17:52.922 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl PASSED [ 74%] 2024-09-14T11:17:53.281 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified PASSED [ 74%] 2024-09-14T11:17:53.723 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 74%] 2024-09-14T11:17:53.907 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 75%] 2024-09-14T11:17:54.134 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 75%] 2024-09-14T11:17:54.403 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 75%] 2024-09-14T11:17:54.583 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 75%] 2024-09-14T11:17:54.760 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 75%] 2024-09-14T11:17:55.024 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 75%] 2024-09-14T11:17:55.212 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 75%] 2024-09-14T11:17:55.392 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 76%] 2024-09-14T11:17:55.632 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 76%] 2024-09-14T11:17:55.818 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 76%] 2024-09-14T11:17:56.004 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 76%] 2024-09-14T11:17:56.192 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 76%] 2024-09-14T11:17:56.416 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 76%] 2024-09-14T11:17:56.796 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 76%] 2024-09-14T11:17:57.070 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 76%] 2024-09-14T11:17:57.345 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 77%] 2024-09-14T11:17:57.637 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 77%] 2024-09-14T11:17:57.909 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 77%] 2024-09-14T11:17:58.146 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 77%] 2024-09-14T11:17:58.417 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 77%] 2024-09-14T11:17:58.685 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 77%] 2024-09-14T11:17:58.947 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 77%] 2024-09-14T11:17:59.167 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 78%] 2024-09-14T11:17:59.386 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 78%] 2024-09-14T11:17:59.606 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 78%] 2024-09-14T11:18:00.972 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 78%] 2024-09-14T11:18:02.322 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 78%] 2024-09-14T11:18:03.177 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 78%] 2024-09-14T11:18:03.407 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 78%] 2024-09-14T11:19:03.878 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_enforced_with_bucket_policy PASSED [ 78%] 2024-09-14T11:20:04.478 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_deny_algo_with_bucket_policy PASSED [ 79%] 2024-09-14T11:20:04.719 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 79%] 2024-09-14T11:20:04.993 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 79%] 2024-09-14T11:20:05.217 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 79%] 2024-09-14T11:20:05.395 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 79%] 2024-09-14T11:20:06.580 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 79%] 2024-09-14T11:20:07.276 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 79%] 2024-09-14T11:20:07.963 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 80%] 2024-09-14T11:20:08.234 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 80%] 2024-09-14T11:20:08.503 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 80%] 2024-09-14T11:20:08.770 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 80%] 2024-09-14T11:20:09.062 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 80%] 2024-09-14T11:20:09.329 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 80%] 2024-09-14T11:20:09.598 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 80%] 2024-09-14T11:20:09.837 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 80%] 2024-09-14T11:20:10.069 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 81%] 2024-09-14T11:20:10.357 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 81%] 2024-09-14T11:20:10.603 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 81%] 2024-09-14T11:20:10.840 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_different_tenant PASSED [ 81%] 2024-09-14T11:20:11.072 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_tenanted_bucket PASSED [ 81%] 2024-09-14T11:20:11.489 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 81%] 2024-09-14T11:20:11.911 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 81%] 2024-09-14T11:20:12.261 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 82%] 2024-09-14T11:20:12.611 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 82%] 2024-09-14T11:20:12.963 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 82%] 2024-09-14T11:20:13.338 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 82%] 2024-09-14T11:20:13.686 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 82%] 2024-09-14T11:20:14.040 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 82%] 2024-09-14T11:20:14.387 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 82%] 2024-09-14T11:20:14.792 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 82%] 2024-09-14T11:20:15.224 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 83%] 2024-09-14T11:20:15.531 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 83%] 2024-09-14T11:20:15.762 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 83%] 2024-09-14T11:20:16.072 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 83%] 2024-09-14T11:20:16.383 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 83%] 2024-09-14T11:20:16.767 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 83%] 2024-09-14T11:20:17.131 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 83%] 2024-09-14T11:20:17.811 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 84%] 2024-09-14T11:20:19.842 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 84%] 2024-09-14T11:20:20.157 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 84%] 2024-09-14T11:20:20.558 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 84%] 2024-09-14T11:20:20.914 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 84%] 2024-09-14T11:20:21.483 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 84%] 2024-09-14T11:20:21.993 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 84%] 2024-09-14T11:20:22.268 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 84%] 2024-09-14T11:20:22.724 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 85%] 2024-09-14T11:20:22.902 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 85%] 2024-09-14T11:20:23.079 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 85%] 2024-09-14T11:20:23.257 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 85%] 2024-09-14T11:20:23.439 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 85%] 2024-09-14T11:20:23.751 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 85%] 2024-09-14T11:20:23.974 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 85%] 2024-09-14T11:20:24.370 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 86%] 2024-09-14T11:20:24.592 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 86%] 2024-09-14T11:20:24.809 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 86%] 2024-09-14T11:20:25.026 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 86%] 2024-09-14T11:20:25.243 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 86%] 2024-09-14T11:20:25.458 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 86%] 2024-09-14T11:20:25.717 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 86%] 2024-09-14T11:20:25.974 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 86%] 2024-09-14T11:20:26.191 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 87%] 2024-09-14T11:20:26.410 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 87%] 2024-09-14T11:20:26.627 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 87%] 2024-09-14T11:20:26.872 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 87%] 2024-09-14T11:20:27.139 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 87%] 2024-09-14T11:20:27.457 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 87%] 2024-09-14T11:20:27.702 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 87%] 2024-09-14T11:20:27.915 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 88%] 2024-09-14T11:20:28.182 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 88%] 2024-09-14T11:20:28.523 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 88%] 2024-09-14T11:20:28.774 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 88%] 2024-09-14T11:20:29.029 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 88%] 2024-09-14T11:20:29.281 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 88%] 2024-09-14T11:20:29.532 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 88%] 2024-09-14T11:20:29.782 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 89%] 2024-09-14T11:20:30.127 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_retention PASSED [ 89%] 2024-09-14T11:20:30.435 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 89%] 2024-09-14T11:20:30.720 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 89%] 2024-09-14T11:20:30.958 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 89%] 2024-09-14T11:20:31.260 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 89%] 2024-09-14T11:20:31.529 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 89%] 2024-09-14T11:20:31.853 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 89%] 2024-09-14T11:20:32.120 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 90%] 2024-09-14T11:20:32.407 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 90%] 2024-09-14T11:20:32.787 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_legal_hold_on PASSED [ 90%] 2024-09-14T11:20:32.990 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 90%] 2024-09-14T11:20:33.207 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 90%] 2024-09-14T11:20:33.414 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 90%] 2024-09-14T11:20:43.600 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 90%] 2024-09-14T11:20:43.883 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 91%] 2024-09-14T11:20:53.163 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 91%] 2024-09-14T11:20:53.488 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 91%] 2024-09-14T11:20:53.809 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 91%] 2024-09-14T11:20:53.989 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 91%] 2024-09-14T11:20:54.213 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 91%] 2024-09-14T11:20:54.434 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 91%] 2024-09-14T11:20:54.656 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 91%] 2024-09-14T11:20:54.919 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-09-14T11:20:55.141 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_principal_bucket_policy_status PASSED [ 92%] 2024-09-14T11:20:55.317 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_allow_notprincipal PASSED [ 92%] 2024-09-14T11:20:55.540 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block PASSED [ 92%] 2024-09-14T11:20:55.813 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy PASSED [ 92%] 2024-09-14T11:20:56.038 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 92%] 2024-09-14T11:20:56.388 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 92%] 2024-09-14T11:20:56.697 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 93%] 2024-09-14T11:20:56.921 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 93%] 2024-09-14T11:20:57.146 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy_with_principal PASSED [ 93%] 2024-09-14T11:20:57.520 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 93%] 2024-09-14T11:20:58.446 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 93%] 2024-09-14T11:20:58.625 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 93%] 2024-09-14T11:20:58.850 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 93%] 2024-09-14T11:20:59.082 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 93%] 2024-09-14T11:20:59.363 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 94%] 2024-09-14T11:20:59.663 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 94%] 2024-09-14T11:20:59.977 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_object_checksum_sha256 PASSED [ 94%] 2024-09-14T11:21:00.482 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_sha256 PASSED [ 94%] 2024-09-14T11:21:01.005 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_3parts PASSED [ 94%] 2024-09-14T11:21:01.259 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_checksum PASSED [ 94%] 2024-09-14T11:21:02.266 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 94%] 2024-09-14T11:21:03.244 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 95%] 2024-09-14T11:21:03.495 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-09-14T11:21:03.783 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-09-14T11:21:04.608 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-09-14T11:21:05.484 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 95%] 2024-09-14T11:21:06.059 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 95%] 2024-09-14T11:21:06.456 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 95%] 2024-09-14T11:21:06.845 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 95%] 2024-09-14T11:21:07.228 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-09-14T11:21:07.511 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-09-14T11:21:07.968 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-09-14T11:21:08.442 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-09-14T11:21:09.722 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 96%] 2024-09-14T11:21:10.188 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 96%] 2024-09-14T11:21:10.600 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 96%] 2024-09-14T11:21:10.966 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 97%] 2024-09-14T11:21:11.298 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-09-14T11:21:11.690 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-09-14T11:21:12.100 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-09-14T11:21:12.379 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 97%] 2024-09-14T11:21:12.760 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 97%] 2024-09-14T11:21:13.176 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 97%] 2024-09-14T11:21:13.594 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 97%] 2024-09-14T11:21:14.046 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-09-14T11:21:14.466 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-09-14T11:21:14.552 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-09-14T11:21:15.035 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 98%] 2024-09-14T11:21:15.509 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 98%] 2024-09-14T11:21:15.943 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 98%] 2024-09-14T11:21:16.370 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 98%] 2024-09-14T11:21:16.721 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-09-14T11:21:27.126 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-09-14T11:21:27.214 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-09-14T11:21:27.745 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic PASSED [ 99%] 2024-09-14T11:21:28.183 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic PASSED [ 99%] 2024-09-14T11:21:28.532 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic_publish PASSED [ 99%] 2024-09-14T11:21:28.986 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic_publish PASSED [ 99%] 2024-09-14T11:21:29.002 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-09-14T11:21:29.002 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:21:29.002 INFO:teuthology.orchestra.run.smithi097.stdout:=============================== warnings summary =============================== 2024-09-14T11:21:29.002 INFO:teuthology.orchestra.run.smithi097.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-14T11:21:29.002 INFO:teuthology.orchestra.run.smithi097.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-14T11:21:29.003 INFO:teuthology.orchestra.run.smithi097.stdout: import imp 2024-09-14T11:21:29.003 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:21:29.003 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py:120 2024-09-14T11:21:29.003 INFO:teuthology.orchestra.run.smithi097.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:120: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-14T11:21:29.003 INFO:teuthology.orchestra.run.smithi097.stdout: if boto_type is 'S3Connection': 2024-09-14T11:21:29.003 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:21:29.003 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_headers.py:124 2024-09-14T11:21:29.003 INFO:teuthology.orchestra.run.smithi097.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-14T11:21:29.003 INFO:teuthology.orchestra.run.smithi097.stdout: elif boto_type is 'HTTPRequest': 2024-09-14T11:21:29.003 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:21:29.003 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3.py:359 2024-09-14T11:21:29.003 INFO:teuthology.orchestra.run.smithi097.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence \W 2024-09-14T11:21:29.004 INFO:teuthology.orchestra.run.smithi097.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-09-14T11:21:29.004 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:21:29.004 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py:176 2024-09-14T11:21:29.004 INFO:teuthology.orchestra.run.smithi097.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-14T11:21:29.004 INFO:teuthology.orchestra.run.smithi097.stdout: if k is 'BucketName': 2024-09-14T11:21:29.004 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:21:29.004 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py:253 2024-09-14T11:21:29.004 INFO:teuthology.orchestra.run.smithi097.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-09-14T11:21:29.004 INFO:teuthology.orchestra.run.smithi097.stdout: @pytest.mark.timeout(10) 2024-09-14T11:21:29.004 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:21:29.004 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests/functional/test_s3_website.py:1077 2024-09-14T11:21:29.004 INFO:teuthology.orchestra.run.smithi097.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-09-14T11:21:29.004 INFO:teuthology.orchestra.run.smithi097.stdout: @pytest.mark.s3website_routing_rules 2024-09-14T11:21:29.005 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:21:29.005 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py:2214 2024-09-14T11:21:29.005 INFO:teuthology.orchestra.run.smithi097.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2214: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:21:29.005 INFO:teuthology.orchestra.run.smithi097.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T11:21:29.005 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:21:29.005 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py:2229 2024-09-14T11:21:29.005 INFO:teuthology.orchestra.run.smithi097.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2229: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:21:29.005 INFO:teuthology.orchestra.run.smithi097.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-14T11:21:29.005 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:21:29.005 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py:2235 2024-09-14T11:21:29.005 INFO:teuthology.orchestra.run.smithi097.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2235: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:21:29.005 INFO:teuthology.orchestra.run.smithi097.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-09-14T11:21:29.005 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:21:29.006 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py:2292 2024-09-14T11:21:29.006 INFO:teuthology.orchestra.run.smithi097.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2292: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:21:29.006 INFO:teuthology.orchestra.run.smithi097.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T11:21:29.006 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:21:29.006 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py:2307 2024-09-14T11:21:29.006 INFO:teuthology.orchestra.run.smithi097.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2307: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:21:29.006 INFO:teuthology.orchestra.run.smithi097.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-14T11:21:29.006 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:21:29.006 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py:2325 2024-09-14T11:21:29.006 INFO:teuthology.orchestra.run.smithi097.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2325: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:21:29.006 INFO:teuthology.orchestra.run.smithi097.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T11:21:29.006 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:21:29.006 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py:2340 2024-09-14T11:21:29.007 INFO:teuthology.orchestra.run.smithi097.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2340: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:21:29.007 INFO:teuthology.orchestra.run.smithi097.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-09-14T11:21:29.007 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:21:29.007 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py:2358 2024-09-14T11:21:29.007 INFO:teuthology.orchestra.run.smithi097.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2358: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:21:29.007 INFO:teuthology.orchestra.run.smithi097.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T11:21:29.007 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:21:29.007 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py:2373 2024-09-14T11:21:29.007 INFO:teuthology.orchestra.run.smithi097.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2373: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:21:29.007 INFO:teuthology.orchestra.run.smithi097.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-14T11:21:29.007 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:21:29.007 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py:2423 2024-09-14T11:21:29.008 INFO:teuthology.orchestra.run.smithi097.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2423: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:21:29.008 INFO:teuthology.orchestra.run.smithi097.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T11:21:29.008 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:21:29.008 INFO:teuthology.orchestra.run.smithi097.stdout:s3tests_boto3/functional/test_s3.py:2455 2024-09-14T11:21:29.008 INFO:teuthology.orchestra.run.smithi097.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2455: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:21:29.008 INFO:teuthology.orchestra.run.smithi097.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T11:21:29.008 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:21:29.008 INFO:teuthology.orchestra.run.smithi097.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-14T11:21:29.008 INFO:teuthology.orchestra.run.smithi097.stdout:= 680 passed, 65 skipped, 126 deselected, 1 xfailed, 18 warnings in 481.87s (0:08:01) = 2024-09-14T11:21:29.131 INFO:teuthology.orchestra.run.smithi097.stdout:___________________________________ summary ____________________________________ 2024-09-14T11:21:29.131 INFO:teuthology.orchestra.run.smithi097.stdout: py: commands succeeded 2024-09-14T11:21:29.131 INFO:teuthology.orchestra.run.smithi097.stdout: congratulations :) 2024-09-14T11:21:29.149 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2024-09-14T11:21:29.150 DEBUG:teuthology.orchestra.run.smithi097:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2024-09-14T11:21:29.260 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:21:29.261 INFO:tasks.s3tests:Cleaning up boto... 2024-09-14T11:21:29.261 DEBUG:teuthology.orchestra.run.smithi097:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-09-14T11:21:29.289 INFO:tasks.s3tests:Removing s3-tests... 2024-09-14T11:21:29.290 DEBUG:teuthology.orchestra.run.smithi097:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-09-14T11:21:29.480 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:21:29.492 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:21:29.492 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:21:29.492 DEBUG:teuthology.orchestra.run.smithi097:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:21:29.520 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:21:29.521 INFO:teuthology.orchestra.run.smithi097.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:21:29.521 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:21:29.589 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:21:29.589 DEBUG:teuthology.orchestra.run.smithi097:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:21:29.659 INFO:tasks.workunit:timeout=3h 2024-09-14T11:21:29.659 INFO:tasks.workunit:cleanup=True 2024-09-14T11:21:29.659 DEBUG:teuthology.orchestra.run.smithi097:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:21:29.729 INFO:tasks.workunit.client.0.smithi097.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:22:26.470 INFO:tasks.workunit.client.0.smithi097.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:22:26.470 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:22:26.470 INFO:tasks.workunit.client.0.smithi097.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:22:26.470 INFO:tasks.workunit.client.0.smithi097.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:22:26.471 INFO:tasks.workunit.client.0.smithi097.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:22:26.471 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:22:26.471 INFO:tasks.workunit.client.0.smithi097.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:22:26.471 INFO:tasks.workunit.client.0.smithi097.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:22:26.471 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:22:26.471 INFO:tasks.workunit.client.0.smithi097.stderr: git switch -c 2024-09-14T11:22:26.471 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:22:26.471 INFO:tasks.workunit.client.0.smithi097.stderr:Or undo this operation with: 2024-09-14T11:22:26.471 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:22:26.471 INFO:tasks.workunit.client.0.smithi097.stderr: git switch - 2024-09-14T11:22:26.471 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:22:26.471 INFO:tasks.workunit.client.0.smithi097.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:22:26.471 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:22:26.472 INFO:tasks.workunit.client.0.smithi097.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:22:26.473 DEBUG:teuthology.orchestra.run.smithi097:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:22:26.541 INFO:tasks.workunit.client.0.smithi097.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:22:26.543 INFO:tasks.workunit.client.0.smithi097.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:22:26.543 INFO:tasks.workunit.client.0.smithi097.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:22:26.592 INFO:tasks.workunit.client.0.smithi097.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:22:26.640 INFO:tasks.workunit.client.0.smithi097.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:22:26.678 INFO:tasks.workunit.client.0.smithi097.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:22:26.680 INFO:tasks.workunit.client.0.smithi097.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:22:26.680 INFO:tasks.workunit.client.0.smithi097.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:22:26.718 INFO:tasks.workunit.client.0.smithi097.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:22:26.722 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-14T11:22:26.722 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:22:26.792 INFO:tasks.workunit:Running workunits matching rgw/run-versioning.sh on client.0... 2024-09-14T11:22:26.793 INFO:tasks.workunit:Running workunit rgw/run-versioning.sh... 2024-09-14T11:22:26.794 DEBUG:teuthology.orchestra.run.smithi097:workunit test rgw/run-versioning.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-14T11:22:26.866 INFO:tasks.workunit.client.0.smithi097.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-14T11:22:26.867 INFO:tasks.workunit.client.0.smithi097.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:22:26.867 INFO:tasks.workunit.client.0.smithi097.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:22:29.159 INFO:tasks.workunit.client.0.smithi097.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-14T11:22:29.159 INFO:tasks.workunit.client.0.smithi097.stderr:++ deactivate nondestructive 2024-09-14T11:22:29.159 INFO:tasks.workunit.client.0.smithi097.stderr:++ '[' -n '' ']' 2024-09-14T11:22:29.159 INFO:tasks.workunit.client.0.smithi097.stderr:++ '[' -n '' ']' 2024-09-14T11:22:29.159 INFO:tasks.workunit.client.0.smithi097.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:22:29.159 INFO:tasks.workunit.client.0.smithi097.stderr:++ hash -r 2024-09-14T11:22:29.159 INFO:tasks.workunit.client.0.smithi097.stderr:++ '[' -n '' ']' 2024-09-14T11:22:29.160 INFO:tasks.workunit.client.0.smithi097.stderr:++ unset VIRTUAL_ENV 2024-09-14T11:22:29.160 INFO:tasks.workunit.client.0.smithi097.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-14T11:22:29.160 INFO:tasks.workunit.client.0.smithi097.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:22:29.160 INFO:tasks.workunit.client.0.smithi097.stderr:++ export VIRTUAL_ENV 2024-09-14T11:22:29.161 INFO:tasks.workunit.client.0.smithi097.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:22:29.161 INFO:tasks.workunit.client.0.smithi097.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:22:29.161 INFO:tasks.workunit.client.0.smithi097.stderr:++ export PATH 2024-09-14T11:22:29.161 INFO:tasks.workunit.client.0.smithi097.stderr:++ '[' -n '' ']' 2024-09-14T11:22:29.161 INFO:tasks.workunit.client.0.smithi097.stderr:++ '[' -z '' ']' 2024-09-14T11:22:29.161 INFO:tasks.workunit.client.0.smithi097.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-14T11:22:29.161 INFO:tasks.workunit.client.0.smithi097.stderr:++ PS1='(rgw) ' 2024-09-14T11:22:29.161 INFO:tasks.workunit.client.0.smithi097.stderr:++ export PS1 2024-09-14T11:22:29.161 INFO:tasks.workunit.client.0.smithi097.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:22:29.161 INFO:tasks.workunit.client.0.smithi097.stderr:++ hash -r 2024-09-14T11:22:29.161 INFO:tasks.workunit.client.0.smithi097.stderr:+ pip install pip --upgrade 2024-09-14T11:22:29.388 INFO:tasks.workunit.client.0.smithi097.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-14T11:22:29.560 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting pip 2024-09-14T11:22:29.565 INFO:tasks.workunit.client.0.smithi097.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T11:22:29.609 INFO:tasks.workunit.client.0.smithi097.stdout:Installing collected packages: pip 2024-09-14T11:22:29.609 INFO:tasks.workunit.client.0.smithi097.stdout: Attempting uninstall: pip 2024-09-14T11:22:29.609 INFO:tasks.workunit.client.0.smithi097.stdout: Found existing installation: pip 21.3.1 2024-09-14T11:22:29.760 INFO:tasks.workunit.client.0.smithi097.stdout: Uninstalling pip-21.3.1: 2024-09-14T11:22:29.765 INFO:tasks.workunit.client.0.smithi097.stdout: Successfully uninstalled pip-21.3.1 2024-09-14T11:22:30.486 INFO:tasks.workunit.client.0.smithi097.stdout:Successfully installed pip-24.2 2024-09-14T11:22:30.534 INFO:tasks.workunit.client.0.smithi097.stderr:+ pip install boto3 2024-09-14T11:22:31.298 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting boto3 2024-09-14T11:22:31.299 INFO:tasks.workunit.client.0.smithi097.stdout: Using cached boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T11:22:31.875 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T11:22:31.876 INFO:tasks.workunit.client.0.smithi097.stdout: Using cached botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T11:22:31.923 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T11:22:31.924 INFO:tasks.workunit.client.0.smithi097.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T11:22:31.986 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T11:22:31.988 INFO:tasks.workunit.client.0.smithi097.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T11:22:32.037 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:22:32.038 INFO:tasks.workunit.client.0.smithi097.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T11:22:32.114 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:22:32.115 INFO:tasks.workunit.client.0.smithi097.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-14T11:22:32.309 INFO:tasks.workunit.client.0.smithi097.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:22:32.311 INFO:tasks.workunit.client.0.smithi097.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T11:22:32.315 INFO:tasks.workunit.client.0.smithi097.stdout:Using cached boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T11:22:32.316 INFO:tasks.workunit.client.0.smithi097.stdout:Using cached botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T11:22:32.325 INFO:tasks.workunit.client.0.smithi097.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T11:22:32.326 INFO:tasks.workunit.client.0.smithi097.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T11:22:32.328 INFO:tasks.workunit.client.0.smithi097.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T11:22:32.329 INFO:tasks.workunit.client.0.smithi097.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-14T11:22:32.330 INFO:tasks.workunit.client.0.smithi097.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:22:32.404 INFO:tasks.workunit.client.0.smithi097.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T11:22:33.416 INFO:tasks.workunit.client.0.smithi097.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-14T11:22:33.532 INFO:tasks.workunit.client.0.smithi097.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_versioning.py 2024-09-14T11:22:33.653 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin user create --uid versioning-tester --display-name "Versioning Testing" --access-key LTA662PVVDTDWX6M2AB0 --secret pvtchqajgzqx5581t6qbddbkj0bgf3a69qdkjcea 2024-09-14T11:22:33.687 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:33.687 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:33.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.726+0000 7f765fb22800 20 rados->read ofs=0 len=0 2024-09-14T11:22:33.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.728+0000 7f765fb22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:33.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.728+0000 7f765fb22800 20 realm 2024-09-14T11:22:33.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.728+0000 7f765fb22800 20 rados->read ofs=0 len=0 2024-09-14T11:22:33.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.728+0000 7f765fb22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:33.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.728+0000 7f765fb22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:22:33.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.728+0000 7f765fb22800 20 rados->read ofs=0 len=0 2024-09-14T11:22:33.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.728+0000 7f765fb22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:33.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.728+0000 7f765fb22800 20 rados->read ofs=0 len=0 2024-09-14T11:22:33.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.729+0000 7f765fb22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:33.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.729+0000 7f765fb22800 20 rados->read ofs=0 len=0 2024-09-14T11:22:33.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.730+0000 7f765fb22800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:22:33.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.730+0000 7f765fb22800 20 searching for the correct realm 2024-09-14T11:22:33.730 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.732+0000 7f7653067640 0 -- 172.21.15.97:0/2629749678 >> [v2:172.21.15.97:6816/4093696477,v1:172.21.15.97:6817/4093696477] conn(0x5578dd310240 msgr2=0x5578dd312670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:33.734 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.735+0000 7f7653067640 0 -- 172.21.15.97:0/2629749678 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f764c06c260 msgr2=0x7f764c0671e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:22:33.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.942+0000 7f765fb22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:22:33.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.942+0000 7f765fb22800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:22:33.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.942+0000 7f765fb22800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:22:33.941 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.942+0000 7f765fb22800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:22:33.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.942+0000 7f765fb22800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:22:33.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.942+0000 7f765fb22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:22:33.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.942+0000 7f765fb22800 20 rados->read ofs=0 len=0 2024-09-14T11:22:33.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.942+0000 7f765fb22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:33.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.942+0000 7f765fb22800 20 rados->read ofs=0 len=0 2024-09-14T11:22:33.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.943+0000 7f765fb22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:33.942 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.943+0000 7f765fb22800 20 rados->read ofs=0 len=0 2024-09-14T11:22:33.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.943+0000 7f765fb22800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:22:33.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.943+0000 7f765fb22800 20 zone default found 2024-09-14T11:22:33.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.943+0000 7f765fb22800 4 Realm: () 2024-09-14T11:22:33.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.943+0000 7f765fb22800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:22:33.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.943+0000 7f765fb22800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:22:33.943 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.943+0000 7f765fb22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:22:33.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.943+0000 7f765fb22800 20 zonegroup default 2024-09-14T11:22:33.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.943+0000 7f765fb22800 20 rados->read ofs=0 len=0 2024-09-14T11:22:33.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.943+0000 7f765fb22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:33.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.943+0000 7f765fb22800 20 rados->read ofs=0 len=0 2024-09-14T11:22:33.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.944+0000 7f765fb22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:33.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.944+0000 7f765fb22800 20 rados->read ofs=0 len=0 2024-09-14T11:22:33.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.944+0000 7f765fb22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:33.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.944+0000 7f765fb22800 20 started sync module instance, tier type = 2024-09-14T11:22:33.944 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.944+0000 7f765fb22800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:22:33.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.954+0000 7f765fb22800 20 add_watcher() i=0 2024-09-14T11:22:33.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.954+0000 7f765fb22800 20 add_watcher() i=1 2024-09-14T11:22:33.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.954+0000 7f765fb22800 20 add_watcher() i=2 2024-09-14T11:22:33.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.954+0000 7f765fb22800 20 add_watcher() i=3 2024-09-14T11:22:33.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.954+0000 7f765fb22800 20 add_watcher() i=4 2024-09-14T11:22:33.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.954+0000 7f765fb22800 20 add_watcher() i=5 2024-09-14T11:22:33.953 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.954+0000 7f765fb22800 20 add_watcher() i=6 2024-09-14T11:22:33.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.956+0000 7f765fb22800 20 add_watcher() i=7 2024-09-14T11:22:33.954 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.956+0000 7f765fb22800 2 all 8 watchers are set, enabling cache 2024-09-14T11:22:33.957 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.958+0000 7f7511fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:33.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.958+0000 7f765fb22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:22:33.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.958+0000 7f765fb22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:22:33.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.958+0000 7f765fb22800 5 note: GC not initialized 2024-09-14T11:22:33.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.959+0000 7f7510fe1640 20 reqs_thread_entry: start 2024-09-14T11:22:33.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.959+0000 7f765fb22800 20 init_complete bucket index max shards: 11 2024-09-14T11:22:33.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.959+0000 7f765fb22800 20 Filter name: none 2024-09-14T11:22:33.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.959+0000 7f748a7fc640 20 reqs_thread_entry: start 2024-09-14T11:22:33.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.959+0000 7f765fb22800 10 cache get: name=default.rgw.meta+users.uid+versioning-tester : miss 2024-09-14T11:22:33.958 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.959+0000 7f765fb22800 20 rados->read ofs=0 len=0 2024-09-14T11:22:33.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.959+0000 7f765fb22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:33.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.959+0000 7f765fb22800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x0 2024-09-14T11:22:33.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.959+0000 7f765fb22800 10 adding default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-14T11:22:33.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.959+0000 7f765fb22800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : miss 2024-09-14T11:22:33.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.959+0000 7f765fb22800 20 rados->read ofs=0 len=0 2024-09-14T11:22:33.959 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.960+0000 7f765fb22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:33.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.960+0000 7f765fb22800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x0 2024-09-14T11:22:33.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.960+0000 7f765fb22800 10 adding default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-14T11:22:33.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.960+0000 7f765fb22800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-14T11:22:33.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.960+0000 7f765fb22800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-14T11:22:33.960 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.961+0000 7f765fb22800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-14T11:22:33.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.961+0000 7f765fb22800 10 moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-14T11:22:33.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.961+0000 7f765fb22800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:versioning-tester, ofs0, ns] 2024-09-14T11:22:33.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.961+0000 7f753affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691498613 cookie 93977595477904 notifier 8756 bl.length()=613 2024-09-14T11:22:33.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.961+0000 7f753affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-14T11:22:33.961 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.961+0000 7f753affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-14T11:22:33.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.963+0000 7f765fb22800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-14T11:22:33.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.963+0000 7f765fb22800 10 moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-14T11:22:33.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.963+0000 7f765fb22800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:LTA662PVVDTDWX6M2AB0, ofs0, ns] 2024-09-14T11:22:33.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.963+0000 7f753affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691498614 cookie 93977595475184 notifier 8756 bl.length()=191 2024-09-14T11:22:33.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.963+0000 7f753affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-14T11:22:33.962 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.963+0000 7f753affd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-14T11:22:33.963 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.965+0000 7f7511fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:33.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.967+0000 7f765fb22800 20 remove_watcher() i=0 2024-09-14T11:22:33.965 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.967+0000 7f765fb22800 2 removed watcher, disabling cache 2024-09-14T11:22:33.966 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.968+0000 7f765fb22800 20 remove_watcher() i=1 2024-09-14T11:22:33.968 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.969+0000 7f765fb22800 20 remove_watcher() i=2 2024-09-14T11:22:33.969 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.970+0000 7f765fb22800 20 remove_watcher() i=3 2024-09-14T11:22:33.970 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.971+0000 7f765fb22800 20 remove_watcher() i=4 2024-09-14T11:22:33.971 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.972+0000 7f765fb22800 20 remove_watcher() i=5 2024-09-14T11:22:33.972 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.974+0000 7f765fb22800 20 remove_watcher() i=6 2024-09-14T11:22:33.973 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:33.975+0000 7f765fb22800 20 remove_watcher() i=7 2024-09-14T11:22:34.149 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: verify that index entries and OLH objects are cleaned up after redundant deletes 2024-09-14T11:22:34.150 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:22:34.179 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-14T11:22:34.219 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:34.219 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:34.244 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.245+0000 7f8a47613800 20 rados->read ofs=0 len=0 2024-09-14T11:22:34.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.247+0000 7f8a47613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:34.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.247+0000 7f8a47613800 20 realm 2024-09-14T11:22:34.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.247+0000 7f8a47613800 20 rados->read ofs=0 len=0 2024-09-14T11:22:34.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.247+0000 7f8a47613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:34.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.247+0000 7f8a47613800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:22:34.246 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.247+0000 7f8a47613800 20 rados->read ofs=0 len=0 2024-09-14T11:22:34.247 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.248+0000 7f8a47613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:34.247 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.248+0000 7f8a47613800 20 rados->read ofs=0 len=0 2024-09-14T11:22:34.247 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.248+0000 7f8a47613800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:34.247 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.248+0000 7f8a47613800 20 rados->read ofs=0 len=0 2024-09-14T11:22:34.248 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.249+0000 7f8a47613800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:22:34.248 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.249+0000 7f8a47613800 20 searching for the correct realm 2024-09-14T11:22:34.249 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.251+0000 7f8a42d48640 0 -- 172.21.15.97:0/2741345593 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x558ae19a6220 msgr2=0x558ae19a8610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:22:34.253 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.254+0000 7f8a42d48640 0 -- 172.21.15.97:0/2741345593 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7f8a2c06a600 msgr2=0x7f8a2c083420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:34.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.462+0000 7f8a47613800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:22:34.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.462+0000 7f8a47613800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:22:34.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.462+0000 7f8a47613800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:22:34.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.462+0000 7f8a47613800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:22:34.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.462+0000 7f8a47613800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:22:34.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.462+0000 7f8a47613800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:22:34.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.462+0000 7f8a47613800 20 rados->read ofs=0 len=0 2024-09-14T11:22:34.461 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.462+0000 7f8a47613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:34.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.462+0000 7f8a47613800 20 rados->read ofs=0 len=0 2024-09-14T11:22:34.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.462+0000 7f8a47613800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:34.462 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.462+0000 7f8a47613800 20 rados->read ofs=0 len=0 2024-09-14T11:22:34.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.463+0000 7f8a47613800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:22:34.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.463+0000 7f8a47613800 20 zone default found 2024-09-14T11:22:34.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.463+0000 7f8a47613800 4 Realm: () 2024-09-14T11:22:34.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.463+0000 7f8a47613800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:22:34.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.463+0000 7f8a47613800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:22:34.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.463+0000 7f8a47613800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:22:34.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.463+0000 7f8a47613800 20 zonegroup default 2024-09-14T11:22:34.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.463+0000 7f8a47613800 20 rados->read ofs=0 len=0 2024-09-14T11:22:34.463 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.463+0000 7f8a47613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:34.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.463+0000 7f8a47613800 20 rados->read ofs=0 len=0 2024-09-14T11:22:34.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.463+0000 7f8a47613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:34.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.463+0000 7f8a47613800 20 rados->read ofs=0 len=0 2024-09-14T11:22:34.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.464+0000 7f8a47613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:34.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.464+0000 7f8a47613800 20 started sync module instance, tier type = 2024-09-14T11:22:34.464 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.464+0000 7f8a47613800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:22:34.472 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.474+0000 7f8a47613800 20 add_watcher() i=0 2024-09-14T11:22:34.472 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.474+0000 7f8a47613800 20 add_watcher() i=1 2024-09-14T11:22:34.472 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.474+0000 7f8a47613800 20 add_watcher() i=2 2024-09-14T11:22:34.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.474+0000 7f8a47613800 20 add_watcher() i=3 2024-09-14T11:22:34.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.474+0000 7f8a47613800 20 add_watcher() i=4 2024-09-14T11:22:34.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.474+0000 7f8a47613800 20 add_watcher() i=5 2024-09-14T11:22:34.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.474+0000 7f8a47613800 20 add_watcher() i=6 2024-09-14T11:22:34.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.475+0000 7f8a47613800 20 add_watcher() i=7 2024-09-14T11:22:34.473 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.475+0000 7f8a47613800 2 all 8 watchers are set, enabling cache 2024-09-14T11:22:34.476 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.476+0000 7f88f97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:34.476 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.477+0000 7f8a47613800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:22:34.476 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.477+0000 7f8a47613800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:22:34.476 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.477+0000 7f8a47613800 5 note: GC not initialized 2024-09-14T11:22:34.476 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.477+0000 7f8873fff640 20 reqs_thread_entry: start 2024-09-14T11:22:34.476 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.477+0000 7f8a47613800 20 init_complete bucket index max shards: 11 2024-09-14T11:22:34.477 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.477+0000 7f8a47613800 20 Filter name: none 2024-09-14T11:22:34.477 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.477+0000 7f8871ffb640 20 reqs_thread_entry: start 2024-09-14T11:22:34.477 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.477+0000 7f8a47613800 20 rados->read ofs=0 len=0 2024-09-14T11:22:34.478 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.478+0000 7f8a47613800 20 rados_obj.operate() r=0 bl.length=209 2024-09-14T11:22:34.478 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.478+0000 7f8a47613800 20 rados->read ofs=0 len=0 2024-09-14T11:22:34.478 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.478+0000 7f8a47613800 20 rados_obj.operate() r=0 bl.length=431 2024-09-14T11:22:34.478 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.478+0000 7f8a47613800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:22:34.478 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.478+0000 7f8a47613800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:22:34.478 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.478+0000 7f8a47613800 20 INFO: main: starting shard=0 2024-09-14T11:22:34.478 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.478+0000 7f8a47613800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.782.0 2024-09-14T11:22:34.478 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.479+0000 7f8a47613800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:22:34.478 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.479+0000 7f8a47613800 20 INFO: main: starting shard=1 2024-09-14T11:22:34.478 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.479+0000 7f8a47613800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.782.1 2024-09-14T11:22:34.479 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.479+0000 7f8a47613800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:22:34.479 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.479+0000 7f8a47613800 20 INFO: main: starting shard=2 2024-09-14T11:22:34.479 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.479+0000 7f8a47613800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.782.2 2024-09-14T11:22:34.479 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.480+0000 7f8a47613800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:22:34.479 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.480+0000 7f8a47613800 20 INFO: main: starting shard=3 2024-09-14T11:22:34.479 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.480+0000 7f8a47613800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.782.3 2024-09-14T11:22:34.479 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.480+0000 7f8a47613800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:22:34.479 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.480+0000 7f8a47613800 20 INFO: main: starting shard=4 2024-09-14T11:22:34.479 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.480+0000 7f8a47613800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.782.4 2024-09-14T11:22:34.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.481+0000 7f8a47613800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:22:34.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.481+0000 7f8a47613800 20 INFO: main: starting shard=5 2024-09-14T11:22:34.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.481+0000 7f8a47613800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.782.5 2024-09-14T11:22:34.480 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.482+0000 7f8a47613800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:22:34.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.482+0000 7f8a47613800 20 INFO: main: starting shard=6 2024-09-14T11:22:34.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.482+0000 7f8a47613800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.782.6 2024-09-14T11:22:34.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.482+0000 7f8a47613800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:22:34.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.482+0000 7f8a47613800 20 INFO: main: starting shard=7 2024-09-14T11:22:34.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.482+0000 7f8a47613800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.782.7 2024-09-14T11:22:34.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.482+0000 7f8a47613800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:22:34.481 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.482+0000 7f8a47613800 20 INFO: main: starting shard=8 2024-09-14T11:22:34.482 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.482+0000 7f8a47613800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.782.8 2024-09-14T11:22:34.482 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.483+0000 7f8a47613800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:22:34.482 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.483+0000 7f8a47613800 20 INFO: main: starting shard=9 2024-09-14T11:22:34.482 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.483+0000 7f8a47613800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.782.9 2024-09-14T11:22:34.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.484+0000 7f8a47613800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:22:34.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.484+0000 7f8a47613800 20 INFO: main: starting shard=10 2024-09-14T11:22:34.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.484+0000 7f8a47613800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.782.10 2024-09-14T11:22:34.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.484+0000 7f8a47613800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:22:34.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.484+0000 7f8a47613800 20 INFO: main: done 2024-09-14T11:22:34.483 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.485+0000 7f88f97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:34.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.487+0000 7f8a47613800 20 remove_watcher() i=0 2024-09-14T11:22:34.486 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.487+0000 7f8a47613800 2 removed watcher, disabling cache 2024-09-14T11:22:34.487 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.489+0000 7f8a47613800 20 remove_watcher() i=1 2024-09-14T11:22:34.488 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.490+0000 7f8a47613800 20 remove_watcher() i=2 2024-09-14T11:22:34.489 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.491+0000 7f8a47613800 20 remove_watcher() i=3 2024-09-14T11:22:34.490 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.492+0000 7f8a47613800 20 remove_watcher() i=4 2024-09-14T11:22:34.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.493+0000 7f8a47613800 20 remove_watcher() i=5 2024-09-14T11:22:34.493 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.494+0000 7f8a47613800 20 remove_watcher() i=6 2024-09-14T11:22:34.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.495+0000 7f8a47613800 20 remove_watcher() i=7 2024-09-14T11:22:34.506 INFO:tasks.workunit.client.0.smithi097.stderr:rados -p default.rgw.buckets.data ls | grep 481e4264-a016-448b-878b-4da910ff1168 2024-09-14T11:22:34.528 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:34.528 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:34.589 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.590+0000 7fbf8a573640 0 -- 172.21.15.97:0/2610561656 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7fbf780030f0 msgr2=0x7fbf74068040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:34.608 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:34.609+0000 7fbf8a573640 0 -- 172.21.15.97:0/2610561656 >> [v2:172.21.15.152:6824/3767355481,v1:172.21.15.152:6825/3767355481] conn(0x561d5a838350 msgr2=0x561d5a8e1900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:34.613 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: verify that index entries and OLH objects are cleaned up after index linking error 2024-09-14T11:22:34.613 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:22:34.614 INFO:tasks.workunit.client.0.smithi097.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T11:22:36.023 INFO:tasks.workunit.client.0.smithi097.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T11:22:36.425 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-14T11:22:36.454 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:36.454 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:36.491 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.492+0000 7fb605b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:36.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.495+0000 7fb605b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:36.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.495+0000 7fb605b25800 20 realm 2024-09-14T11:22:36.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.495+0000 7fb605b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:36.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.495+0000 7fb605b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:36.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.495+0000 7fb605b25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:22:36.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.495+0000 7fb605b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:36.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.495+0000 7fb605b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:36.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.495+0000 7fb605b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:36.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.496+0000 7fb605b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:36.494 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.496+0000 7fb605b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:36.495 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.497+0000 7fb605b25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:22:36.495 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.497+0000 7fb605b25800 20 searching for the correct realm 2024-09-14T11:22:36.497 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.499+0000 7fb601faf640 0 -- 172.21.15.97:0/1631205382 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7fb5ec041070 msgr2=0x7fb5ec041960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:22:36.703 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.705+0000 7fb600fad640 0 -- 172.21.15.97:0/1631205382 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7fb5f40d5040 msgr2=0x7fb5f40ae0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:36.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.710+0000 7fb605b25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:22:36.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.710+0000 7fb605b25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:22:36.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.710+0000 7fb605b25800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:22:36.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.710+0000 7fb605b25800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:22:36.709 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.710+0000 7fb605b25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:22:36.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.710+0000 7fb605b25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:22:36.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.710+0000 7fb605b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:36.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.711+0000 7fb605b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:36.710 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.711+0000 7fb605b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:36.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.711+0000 7fb605b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:36.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.711+0000 7fb605b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:36.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.711+0000 7fb605b25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:22:36.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.711+0000 7fb605b25800 20 zone default found 2024-09-14T11:22:36.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.711+0000 7fb605b25800 4 Realm: () 2024-09-14T11:22:36.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.711+0000 7fb605b25800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:22:36.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.711+0000 7fb605b25800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:22:36.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.711+0000 7fb605b25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:22:36.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.711+0000 7fb605b25800 20 zonegroup default 2024-09-14T11:22:36.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.711+0000 7fb605b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:36.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.712+0000 7fb605b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:36.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.712+0000 7fb605b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:36.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.712+0000 7fb605b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:36.711 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.712+0000 7fb605b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:36.712 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.713+0000 7fb605b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:36.712 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.713+0000 7fb605b25800 20 started sync module instance, tier type = 2024-09-14T11:22:36.712 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.713+0000 7fb605b25800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:22:36.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.722+0000 7fb605b25800 20 add_watcher() i=0 2024-09-14T11:22:36.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.722+0000 7fb605b25800 20 add_watcher() i=1 2024-09-14T11:22:36.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.722+0000 7fb605b25800 20 add_watcher() i=2 2024-09-14T11:22:36.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.722+0000 7fb605b25800 20 add_watcher() i=3 2024-09-14T11:22:36.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.722+0000 7fb605b25800 20 add_watcher() i=4 2024-09-14T11:22:36.721 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.722+0000 7fb605b25800 20 add_watcher() i=5 2024-09-14T11:22:36.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.722+0000 7fb605b25800 20 add_watcher() i=6 2024-09-14T11:22:36.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.723+0000 7fb605b25800 20 add_watcher() i=7 2024-09-14T11:22:36.722 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.723+0000 7fb605b25800 2 all 8 watchers are set, enabling cache 2024-09-14T11:22:36.724 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.726+0000 7fb4b77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:36.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.726+0000 7fb605b25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:22:36.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.726+0000 7fb605b25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:22:36.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.726+0000 7fb605b25800 5 note: GC not initialized 2024-09-14T11:22:36.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.726+0000 7fb4b67e4640 20 reqs_thread_entry: start 2024-09-14T11:22:36.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.726+0000 7fb605b25800 20 init_complete bucket index max shards: 11 2024-09-14T11:22:36.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.726+0000 7fb605b25800 20 Filter name: none 2024-09-14T11:22:36.725 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.726+0000 7fb427fff640 20 reqs_thread_entry: start 2024-09-14T11:22:36.726 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.726+0000 7fb605b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:36.726 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.727+0000 7fb605b25800 20 rados_obj.operate() r=0 bl.length=209 2024-09-14T11:22:36.726 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.727+0000 7fb605b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:36.726 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.728+0000 7fb605b25800 20 rados_obj.operate() r=0 bl.length=431 2024-09-14T11:22:36.726 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.728+0000 7fb605b25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:22:36.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.728+0000 7fb605b25800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:22:36.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.728+0000 7fb605b25800 20 INFO: main: starting shard=0 2024-09-14T11:22:36.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.728+0000 7fb605b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.782.0 2024-09-14T11:22:36.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.728+0000 7fb605b25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:22:36.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.728+0000 7fb605b25800 20 INFO: main: starting shard=1 2024-09-14T11:22:36.727 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.728+0000 7fb605b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.782.1 2024-09-14T11:22:36.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.729+0000 7fb605b25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:22:36.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.729+0000 7fb605b25800 20 INFO: main: starting shard=2 2024-09-14T11:22:36.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.729+0000 7fb605b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.782.2 2024-09-14T11:22:36.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.729+0000 7fb605b25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:22:36.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.729+0000 7fb605b25800 20 INFO: main: starting shard=3 2024-09-14T11:22:36.728 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.729+0000 7fb605b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.782.3 2024-09-14T11:22:36.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.730+0000 7fb605b25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:22:36.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.730+0000 7fb605b25800 20 INFO: main: starting shard=4 2024-09-14T11:22:36.729 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.730+0000 7fb605b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.782.4 2024-09-14T11:22:36.730 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.730+0000 7fb605b25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:22:36.730 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.730+0000 7fb605b25800 20 INFO: main: starting shard=5 2024-09-14T11:22:36.730 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.730+0000 7fb605b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.782.5 2024-09-14T11:22:36.730 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.731+0000 7fb605b25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:22:36.730 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.731+0000 7fb605b25800 20 INFO: main: starting shard=6 2024-09-14T11:22:36.730 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.731+0000 7fb605b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.782.6 2024-09-14T11:22:36.730 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.731+0000 7fb605b25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:22:36.730 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.731+0000 7fb605b25800 20 INFO: main: starting shard=7 2024-09-14T11:22:36.730 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.731+0000 7fb605b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.782.7 2024-09-14T11:22:36.731 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.731+0000 7fb605b25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:22:36.731 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.731+0000 7fb605b25800 20 INFO: main: starting shard=8 2024-09-14T11:22:36.731 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.731+0000 7fb605b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.782.8 2024-09-14T11:22:36.731 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.732+0000 7fb605b25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:22:36.731 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.732+0000 7fb605b25800 20 INFO: main: starting shard=9 2024-09-14T11:22:36.731 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.732+0000 7fb605b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.782.9 2024-09-14T11:22:36.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.733+0000 7fb605b25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:22:36.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.733+0000 7fb605b25800 20 INFO: main: starting shard=10 2024-09-14T11:22:36.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.733+0000 7fb605b25800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.782.10 2024-09-14T11:22:36.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.733+0000 7fb605b25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:22:36.732 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.733+0000 7fb605b25800 20 INFO: main: done 2024-09-14T11:22:36.733 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.734+0000 7fb4b77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:36.735 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.737+0000 7fb605b25800 20 remove_watcher() i=0 2024-09-14T11:22:36.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.737+0000 7fb605b25800 2 removed watcher, disabling cache 2024-09-14T11:22:36.736 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.738+0000 7fb605b25800 20 remove_watcher() i=1 2024-09-14T11:22:36.738 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.739+0000 7fb605b25800 20 remove_watcher() i=2 2024-09-14T11:22:36.739 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.740+0000 7fb605b25800 20 remove_watcher() i=3 2024-09-14T11:22:36.740 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.741+0000 7fb605b25800 20 remove_watcher() i=4 2024-09-14T11:22:36.741 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.742+0000 7fb605b25800 20 remove_watcher() i=5 2024-09-14T11:22:36.742 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.743+0000 7fb605b25800 20 remove_watcher() i=6 2024-09-14T11:22:36.743 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.744+0000 7fb605b25800 20 remove_watcher() i=7 2024-09-14T11:22:36.755 INFO:tasks.workunit.client.0.smithi097.stderr:rados -p default.rgw.buckets.data ls | grep 2c5e22da-8e38-4782-89d7-1e219a9e3a24 2024-09-14T11:22:36.778 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:36.778 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:36.851 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:36.852+0000 7f9bc0255640 0 -- 172.21.15.97:0/74373943 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f9bb8068a00 msgr2=0x7f9bb8073060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:36.864 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: verify that original null object version is intact after failed olh upgrade 2024-09-14T11:22:36.864 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:22:36.900 INFO:tasks.workunit.client.0.smithi097.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T11:22:38.352 INFO:tasks.workunit.client.0.smithi097.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:22:38.354 INFO:tasks.workunit.client.0.smithi097.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T11:22:38.770 INFO:tasks.workunit.client.0.smithi097.stderr:TEST: verify that concurrent delete requests do not leave behind olh entries 2024-09-14T11:22:38.770 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-09-14T11:22:38.869 INFO:tasks.workunit.client.0.smithi097.stderr:ceph config set client rgw_debug_inject_latency_bi_unlink 2 2024-09-14T11:22:42.282 INFO:tasks.workunit.client.0.smithi097.stderr:ceph config rm client rgw_debug_inject_latency_bi_unlink 2024-09-14T11:22:42.683 INFO:tasks.workunit.client.0.smithi097.stderr:radosgw-admin bucket check olh --bucket versioning-bucket --dump-keys 2024-09-14T11:22:42.713 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:42.713 INFO:tasks.workunit.client.0.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:42.751 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.753+0000 7fc2ce32c800 20 rados->read ofs=0 len=0 2024-09-14T11:22:42.753 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.754+0000 7fc2ce32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:42.753 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.754+0000 7fc2ce32c800 20 realm 2024-09-14T11:22:42.753 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.754+0000 7fc2ce32c800 20 rados->read ofs=0 len=0 2024-09-14T11:22:42.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.755+0000 7fc2ce32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:42.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.755+0000 7fc2ce32c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:22:42.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.755+0000 7fc2ce32c800 20 rados->read ofs=0 len=0 2024-09-14T11:22:42.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.755+0000 7fc2ce32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:42.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.755+0000 7fc2ce32c800 20 rados->read ofs=0 len=0 2024-09-14T11:22:42.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.756+0000 7fc2ce32c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:42.754 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.756+0000 7fc2ce32c800 20 rados->read ofs=0 len=0 2024-09-14T11:22:42.755 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.756+0000 7fc2ce32c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:22:42.755 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.756+0000 7fc2ce32c800 20 searching for the correct realm 2024-09-14T11:22:42.757 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.758+0000 7fc2ca04f640 0 -- 172.21.15.97:0/1440763628 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x559067c07380 msgr2=0x559067c09840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:42.760 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.762+0000 7fc2ca04f640 0 -- 172.21.15.97:0/1440763628 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7fc2b401b040 msgr2=0x7fc2b4070b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:42.766 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.767+0000 7fc2ce32c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:22:42.766 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.767+0000 7fc2ce32c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:22:42.766 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.767+0000 7fc2ce32c800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:22:42.766 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.767+0000 7fc2ce32c800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:22:42.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.767+0000 7fc2ce32c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:22:42.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.767+0000 7fc2ce32c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:22:42.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.767+0000 7fc2ce32c800 20 rados->read ofs=0 len=0 2024-09-14T11:22:42.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.768+0000 7fc2ce32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:42.767 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.768+0000 7fc2ce32c800 20 rados->read ofs=0 len=0 2024-09-14T11:22:42.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.768+0000 7fc2ce32c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:42.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.768+0000 7fc2ce32c800 20 rados->read ofs=0 len=0 2024-09-14T11:22:42.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.768+0000 7fc2ce32c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:22:42.768 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.768+0000 7fc2ce32c800 20 zone default found 2024-09-14T11:22:42.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.768+0000 7fc2ce32c800 4 Realm: () 2024-09-14T11:22:42.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.768+0000 7fc2ce32c800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:22:42.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.768+0000 7fc2ce32c800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:22:42.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.768+0000 7fc2ce32c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:22:42.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.768+0000 7fc2ce32c800 20 zonegroup default 2024-09-14T11:22:42.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.768+0000 7fc2ce32c800 20 rados->read ofs=0 len=0 2024-09-14T11:22:42.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.769+0000 7fc2ce32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:42.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.769+0000 7fc2ce32c800 20 rados->read ofs=0 len=0 2024-09-14T11:22:42.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.769+0000 7fc2ce32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:42.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.769+0000 7fc2ce32c800 20 rados->read ofs=0 len=0 2024-09-14T11:22:42.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.769+0000 7fc2ce32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:42.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.769+0000 7fc2ce32c800 20 started sync module instance, tier type = 2024-09-14T11:22:42.769 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.769+0000 7fc2ce32c800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:22:42.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.779+0000 7fc2ce32c800 20 add_watcher() i=0 2024-09-14T11:22:42.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.779+0000 7fc2ce32c800 20 add_watcher() i=1 2024-09-14T11:22:42.777 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.779+0000 7fc2ce32c800 20 add_watcher() i=2 2024-09-14T11:22:42.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.779+0000 7fc2ce32c800 20 add_watcher() i=3 2024-09-14T11:22:42.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.779+0000 7fc2ce32c800 20 add_watcher() i=4 2024-09-14T11:22:42.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.779+0000 7fc2ce32c800 20 add_watcher() i=5 2024-09-14T11:22:42.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.779+0000 7fc2ce32c800 20 add_watcher() i=6 2024-09-14T11:22:42.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.780+0000 7fc2ce32c800 20 add_watcher() i=7 2024-09-14T11:22:42.778 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.780+0000 7fc2ce32c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:22:42.780 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.782+0000 7fc180fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:42.781 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.782+0000 7fc2ce32c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:22:42.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.782+0000 7fc2ce32c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:22:42.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.782+0000 7fc2ce32c800 5 note: GC not initialized 2024-09-14T11:22:42.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.782+0000 7fc0fb7fe640 20 reqs_thread_entry: start 2024-09-14T11:22:42.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.782+0000 7fc2ce32c800 20 init_complete bucket index max shards: 11 2024-09-14T11:22:42.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.782+0000 7fc2ce32c800 20 Filter name: none 2024-09-14T11:22:42.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.782+0000 7fc0f97fa640 20 reqs_thread_entry: start 2024-09-14T11:22:42.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.782+0000 7fc2ce32c800 10 cache get: name=default.rgw.meta+root+versioning-bucket : miss 2024-09-14T11:22:42.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.782+0000 7fc2ce32c800 20 rados->read ofs=0 len=0 2024-09-14T11:22:42.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.783+0000 7fc2ce32c800 20 rados_obj.operate() r=0 bl.length=209 2024-09-14T11:22:42.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.783+0000 7fc2ce32c800 10 cache put: name=default.rgw.meta+root+versioning-bucket info.flags=0x11 2024-09-14T11:22:42.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.783+0000 7fc2ce32c800 10 adding default.rgw.meta+root+versioning-bucket to cache LRU end 2024-09-14T11:22:42.782 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.783+0000 7fc2ce32c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.782 : miss 2024-09-14T11:22:42.783 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.783+0000 7fc2ce32c800 20 rados->read ofs=0 len=0 2024-09-14T11:22:42.784 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.783+0000 7fc2ce32c800 20 rados_obj.operate() r=0 bl.length=431 2024-09-14T11:22:42.784 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.783+0000 7fc2ce32c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.782 info.flags=0x17 2024-09-14T11:22:42.784 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.783+0000 7fc2ce32c800 10 adding default.rgw.meta+root+.bucket.meta.versioning-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.782 to cache LRU end 2024-09-14T11:22:42.784 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.783+0000 7fc2ce32c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:22:42.784 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.783+0000 7fc2ce32c800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:22:42.784 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.783+0000 7fc2ce32c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.versioning-bucket:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.782 2024-09-14T11:22:42.784 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.783+0000 7fc2ce32c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.782.0 2024-09-14T11:22:42.784 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.784+0000 7fc2ce32c800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T11:22:42.784 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.784+0000 7fc2ce32c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.782.1 2024-09-14T11:22:42.784 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.784+0000 7fc2ce32c800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T11:22:42.784 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.784+0000 7fc2ce32c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.782.2 2024-09-14T11:22:42.784 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.785+0000 7fc2ce32c800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T11:22:42.784 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.785+0000 7fc2ce32c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.782.3 2024-09-14T11:22:42.785 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.785+0000 7fc2ce32c800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T11:22:42.785 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.785+0000 7fc2ce32c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.782.4 2024-09-14T11:22:42.785 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.786+0000 7fc2ce32c800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T11:22:42.785 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.786+0000 7fc2ce32c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.782.5 2024-09-14T11:22:42.785 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.786+0000 7fc2ce32c800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-14T11:22:42.786 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.786+0000 7fc2ce32c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.782.6 2024-09-14T11:22:42.786 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.786+0000 7fc2ce32c800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T11:22:42.786 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.786+0000 7fc2ce32c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.782.7 2024-09-14T11:22:42.786 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.787+0000 7fc2ce32c800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T11:22:42.786 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.787+0000 7fc2ce32c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.782.8 2024-09-14T11:22:42.786 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.787+0000 7fc2ce32c800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-14T11:22:42.786 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.787+0000 7fc2ce32c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.782.9 2024-09-14T11:22:42.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.788+0000 7fc2ce32c800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T11:22:42.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.788+0000 7fc2ce32c800 20 bucket index object: :.dir.428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.782.10 2024-09-14T11:22:42.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.789+0000 7fc2ce32c800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T11:22:42.787 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.789+0000 7fc2ce32c800 1 NOTICE: finished all shards (0 entries found) 2024-09-14T11:22:42.788 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.789+0000 7fc180fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:42.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.792+0000 7fc2ce32c800 20 remove_watcher() i=0 2024-09-14T11:22:42.790 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.792+0000 7fc2ce32c800 2 removed watcher, disabling cache 2024-09-14T11:22:42.792 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.793+0000 7fc2ce32c800 20 remove_watcher() i=1 2024-09-14T11:22:42.793 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.794+0000 7fc2ce32c800 20 remove_watcher() i=2 2024-09-14T11:22:42.794 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.795+0000 7fc2ce32c800 20 remove_watcher() i=3 2024-09-14T11:22:42.795 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.796+0000 7fc2ce32c800 20 remove_watcher() i=4 2024-09-14T11:22:42.796 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.797+0000 7fc2ce32c800 20 remove_watcher() i=5 2024-09-14T11:22:42.797 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.799+0000 7fc2ce32c800 20 remove_watcher() i=6 2024-09-14T11:22:42.798 INFO:tasks.workunit.client.0.smithi097.stderr:2024-09-14T11:22:42.800+0000 7fc2ce32c800 20 remove_watcher() i=7 2024-09-14T11:22:42.810 INFO:tasks.workunit.client.0.smithi097.stderr:Deleting bucket versioning-bucket 2024-09-14T11:22:42.843 INFO:tasks.workunit.client.0.smithi097.stderr:Completed bucket versioning tests 2024-09-14T11:22:42.843 INFO:tasks.workunit.client.0.smithi097.stdout:connected to http://localhost:80 2024-09-14T11:22:42.901 INFO:tasks.workunit.client.0.smithi097.stderr:+ deactivate 2024-09-14T11:22:42.902 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-14T11:22:42.902 INFO:tasks.workunit.client.0.smithi097.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:22:42.902 INFO:tasks.workunit.client.0.smithi097.stderr:+ export PATH 2024-09-14T11:22:42.902 INFO:tasks.workunit.client.0.smithi097.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-14T11:22:42.902 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' -n '' ']' 2024-09-14T11:22:42.902 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:22:42.902 INFO:tasks.workunit.client.0.smithi097.stderr:+ hash -r 2024-09-14T11:22:42.902 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' -n '' ']' 2024-09-14T11:22:42.902 INFO:tasks.workunit.client.0.smithi097.stderr:+ unset VIRTUAL_ENV 2024-09-14T11:22:42.902 INFO:tasks.workunit.client.0.smithi097.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-14T11:22:42.902 INFO:tasks.workunit.client.0.smithi097.stderr:+ unset -f deactivate 2024-09-14T11:22:42.902 INFO:tasks.workunit.client.0.smithi097.stderr:+ echo OK. 2024-09-14T11:22:42.903 INFO:tasks.workunit.client.0.smithi097.stdout:OK. 2024-09-14T11:22:42.903 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:22:42.903 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:22:42.983 INFO:tasks.workunit:Stopping ['rgw/run-versioning.sh'] on client.0... 2024-09-14T11:22:42.984 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:22:43.353 DEBUG:teuthology.parallel:result is None 2024-09-14T11:22:43.354 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:22:43.392 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:22:43.392 DEBUG:teuthology.orchestra.run.smithi097:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:22:43.462 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:22:43.462 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-09-14T11:22:43.472 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-09-14T11:22:43.493 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-09-14T11:22:43.493 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-09-14T11:22:43.493 DEBUG:teuthology.orchestra.run.smithi097:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-09-14T11:22:43.565 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-09-14T11:22:43.566 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-09-14T11:22:43.624 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:43.624 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:43.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.661+0000 7fa359811800 20 rados->read ofs=0 len=0 2024-09-14T11:22:43.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.663+0000 7fa359811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:43.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.663+0000 7fa359811800 20 realm 2024-09-14T11:22:43.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.663+0000 7fa359811800 20 rados->read ofs=0 len=0 2024-09-14T11:22:43.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.663+0000 7fa359811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:43.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.663+0000 7fa359811800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:22:43.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.663+0000 7fa359811800 20 rados->read ofs=0 len=0 2024-09-14T11:22:43.663 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.664+0000 7fa359811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:43.663 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.664+0000 7fa359811800 20 rados->read ofs=0 len=0 2024-09-14T11:22:43.663 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.664+0000 7fa359811800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:43.663 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.664+0000 7fa359811800 20 rados->read ofs=0 len=0 2024-09-14T11:22:43.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.665+0000 7fa359811800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:22:43.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.665+0000 7fa359811800 20 searching for the correct realm 2024-09-14T11:22:43.666 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.667+0000 7fa354f48640 0 -- 172.21.15.97:0/377466163 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x560920cd0c90 msgr2=0x560920cd3120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:43.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.671+0000 7fa354f48640 0 -- 172.21.15.97:0/377466163 >> [v2:172.21.15.152:6816/3781551304,v1:172.21.15.152:6817/3781551304] conn(0x7fa340071170 msgr2=0x7fa340082390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:43.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.676+0000 7fa359811800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:22:43.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.676+0000 7fa359811800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:22:43.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.676+0000 7fa359811800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:22:43.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.676+0000 7fa359811800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:22:43.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.676+0000 7fa359811800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:22:43.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.676+0000 7fa359811800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:22:43.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.676+0000 7fa359811800 20 rados->read ofs=0 len=0 2024-09-14T11:22:43.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.677+0000 7fa359811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:43.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.677+0000 7fa359811800 20 rados->read ofs=0 len=0 2024-09-14T11:22:43.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.677+0000 7fa359811800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:43.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.677+0000 7fa359811800 20 rados->read ofs=0 len=0 2024-09-14T11:22:43.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.677+0000 7fa359811800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:22:43.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.677+0000 7fa359811800 20 zone default found 2024-09-14T11:22:43.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.677+0000 7fa359811800 4 Realm: () 2024-09-14T11:22:43.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.677+0000 7fa359811800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:22:43.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.677+0000 7fa359811800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:22:43.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.677+0000 7fa359811800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:22:43.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.677+0000 7fa359811800 20 zonegroup default 2024-09-14T11:22:43.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.677+0000 7fa359811800 20 rados->read ofs=0 len=0 2024-09-14T11:22:43.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.678+0000 7fa359811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:43.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.678+0000 7fa359811800 20 rados->read ofs=0 len=0 2024-09-14T11:22:43.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.678+0000 7fa359811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:43.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.678+0000 7fa359811800 20 rados->read ofs=0 len=0 2024-09-14T11:22:43.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.678+0000 7fa359811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:43.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.678+0000 7fa359811800 20 started sync module instance, tier type = 2024-09-14T11:22:43.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.678+0000 7fa359811800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:22:43.687 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.688+0000 7fa359811800 20 add_watcher() i=0 2024-09-14T11:22:43.687 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.688+0000 7fa359811800 20 add_watcher() i=1 2024-09-14T11:22:43.687 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.688+0000 7fa359811800 20 add_watcher() i=2 2024-09-14T11:22:43.687 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.688+0000 7fa359811800 20 add_watcher() i=3 2024-09-14T11:22:43.687 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.688+0000 7fa359811800 20 add_watcher() i=4 2024-09-14T11:22:43.687 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.688+0000 7fa359811800 20 add_watcher() i=5 2024-09-14T11:22:43.687 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.688+0000 7fa359811800 20 add_watcher() i=6 2024-09-14T11:22:43.687 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.689+0000 7fa359811800 20 add_watcher() i=7 2024-09-14T11:22:43.688 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.689+0000 7fa359811800 2 all 8 watchers are set, enabling cache 2024-09-14T11:22:43.689 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.691+0000 7fa20afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:43.690 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.691+0000 7fa359811800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:22:43.690 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.691+0000 7fa359811800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:22:43.725 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.726+0000 7fa209fe3640 20 reqs_thread_entry: start 2024-09-14T11:22:43.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.726+0000 7fa359811800 20 init_complete bucket index max shards: 11 2024-09-14T11:22:43.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.726+0000 7fa359811800 20 Filter name: none 2024-09-14T11:22:43.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.726+0000 7fa17b7fe640 20 reqs_thread_entry: start 2024-09-14T11:22:43.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.726+0000 7fa359811800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-14T11:22:43.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.726+0000 7fa359811800 20 rados->read ofs=0 len=0 2024-09-14T11:22:43.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.727+0000 7fa359811800 20 rados_obj.operate() r=0 bl.length=482 2024-09-14T11:22:43.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.727+0000 7fa359811800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-09-14T11:22:43.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.727+0000 7fa359811800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T11:22:43.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.727+0000 7fa359811800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:22:43.726 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.727+0000 7fa359811800 10 removing key index: YBDPVVPEYCHWLYZBNHPV 2024-09-14T11:22:43.727 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.729+0000 7fa359811800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:YBDPVVPEYCHWLYZBNHPV, ofs0, ns] 2024-09-14T11:22:43.728 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.729+0000 7fa22bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691498327 cookie 94597205070896 notifier 9504 bl.length()=170 2024-09-14T11:22:43.728 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.729+0000 7fa359811800 10 removing email index: tester.client.0_test@test.test 2024-09-14T11:22:43.729 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.730+0000 7fa359811800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-14T11:22:43.729 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.731+0000 7fa22bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497110 cookie 94597205073632 notifier 9504 bl.length()=181 2024-09-14T11:22:43.730 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.731+0000 7fa359811800 10 removing user buckets index 2024-09-14T11:22:43.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.732+0000 7fa359811800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-09-14T11:22:43.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.733+0000 7fa22b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691498617 cookie 94597205086400 notifier 9504 bl.length()=172 2024-09-14T11:22:43.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.733+0000 7fa359811800 10 removing user index: tester.client.0 2024-09-14T11:22:43.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.734+0000 7fa359811800 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-09-14T11:22:43.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.734+0000 7fa359811800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-14T11:22:43.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.734+0000 7fa22bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691498618 cookie 94597205075904 notifier 9504 bl.length()=164 2024-09-14T11:22:43.734 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.736+0000 7fa20afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:43.737 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.738+0000 7fa359811800 20 remove_watcher() i=0 2024-09-14T11:22:43.737 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.738+0000 7fa359811800 2 removed watcher, disabling cache 2024-09-14T11:22:43.738 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.739+0000 7fa359811800 20 remove_watcher() i=1 2024-09-14T11:22:43.739 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.740+0000 7fa359811800 20 remove_watcher() i=2 2024-09-14T11:22:43.740 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.741+0000 7fa359811800 20 remove_watcher() i=3 2024-09-14T11:22:43.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.742+0000 7fa359811800 20 remove_watcher() i=4 2024-09-14T11:22:43.742 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.743+0000 7fa359811800 20 remove_watcher() i=5 2024-09-14T11:22:43.743 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.744+0000 7fa359811800 20 remove_watcher() i=6 2024-09-14T11:22:43.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:43.745+0000 7fa359811800 20 remove_watcher() i=7 2024-09-14T11:22:43.756 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-09-14T11:22:43.765 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-09-14T11:22:43.774 DEBUG:teuthology.orchestra.run.smithi097:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-09-14T11:22:43.832 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-14T11:22:43.841 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-14T11:22:43.841 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:22:43.842 INFO:tasks.rgw.client.0.smithi097.stdout:2024-09-14T11:22:43.843+0000 7ff220abc640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 46179) UID: 0 2024-09-14T11:22:43.842 INFO:tasks.rgw.client.0.smithi097.stdout:2024-09-14T11:22:43.843+0000 7ff224317880 -1 shutting down 2024-09-14T11:22:49.943 INFO:tasks.rgw.client.0:Stopped 2024-09-14T11:22:49.943 DEBUG:teuthology.orchestra.run.smithi097:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-14T11:22:49.978 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f /etc/ceph/vault-root-token 2024-09-14T11:22:50.062 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-14T11:22:50.143 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-14T11:22:50.143 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-14T11:22:50.144 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-14T11:22:50.242 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:50.242 INFO:teuthology.orchestra.run.smithi097.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:50.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.278+0000 7f0f19c16800 20 rados->read ofs=0 len=0 2024-09-14T11:22:50.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.280+0000 7f0f19c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:50.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.280+0000 7f0f19c16800 20 realm 2024-09-14T11:22:50.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.280+0000 7f0f19c16800 20 rados->read ofs=0 len=0 2024-09-14T11:22:50.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.280+0000 7f0f19c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:50.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.280+0000 7f0f19c16800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:22:50.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.280+0000 7f0f19c16800 20 rados->read ofs=0 len=0 2024-09-14T11:22:50.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.280+0000 7f0f19c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:50.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.280+0000 7f0f19c16800 20 rados->read ofs=0 len=0 2024-09-14T11:22:50.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.281+0000 7f0f19c16800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:50.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.281+0000 7f0f19c16800 20 rados->read ofs=0 len=0 2024-09-14T11:22:50.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.282+0000 7f0f19c16800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:22:50.281 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.282+0000 7f0f19c16800 20 searching for the correct realm 2024-09-14T11:22:50.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.284+0000 7f0f15be8640 0 -- 172.21.15.97:0/3336262302 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f0f00016070 msgr2=0x7f0f00075ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:50.287 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.288+0000 7f0f14be6640 0 -- 172.21.15.97:0/3336262302 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f0f08070040 msgr2=0x7f0f080639b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:50.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.293+0000 7f0f19c16800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:22:50.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.293+0000 7f0f19c16800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:22:50.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.293+0000 7f0f19c16800 20 RGWRados::pool_iterate: got zonegroup_info.84a24a7a-dc0d-461e-858b-ad4ae697684a 2024-09-14T11:22:50.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.293+0000 7f0f19c16800 20 RGWRados::pool_iterate: got zone_info.428283c8-3a45-44a8-bd53-0ab34f1e0563 2024-09-14T11:22:50.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.293+0000 7f0f19c16800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:22:50.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.293+0000 7f0f19c16800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:22:50.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.293+0000 7f0f19c16800 20 rados->read ofs=0 len=0 2024-09-14T11:22:50.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.293+0000 7f0f19c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:50.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.293+0000 7f0f19c16800 20 rados->read ofs=0 len=0 2024-09-14T11:22:50.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.293+0000 7f0f19c16800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:50.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.293+0000 7f0f19c16800 20 rados->read ofs=0 len=0 2024-09-14T11:22:50.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.294+0000 7f0f19c16800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:22:50.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.294+0000 7f0f19c16800 20 zone default found 2024-09-14T11:22:50.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.294+0000 7f0f19c16800 4 Realm: () 2024-09-14T11:22:50.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.294+0000 7f0f19c16800 4 ZoneGroup: default (84a24a7a-dc0d-461e-858b-ad4ae697684a) 2024-09-14T11:22:50.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.294+0000 7f0f19c16800 4 Zone: default (428283c8-3a45-44a8-bd53-0ab34f1e0563) 2024-09-14T11:22:50.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.294+0000 7f0f19c16800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:22:50.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.294+0000 7f0f19c16800 20 zonegroup default 2024-09-14T11:22:50.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.294+0000 7f0f19c16800 20 rados->read ofs=0 len=0 2024-09-14T11:22:50.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.294+0000 7f0f19c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:50.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.294+0000 7f0f19c16800 20 rados->read ofs=0 len=0 2024-09-14T11:22:50.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.294+0000 7f0f19c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:50.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.294+0000 7f0f19c16800 20 rados->read ofs=0 len=0 2024-09-14T11:22:50.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.294+0000 7f0f19c16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:50.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.294+0000 7f0f19c16800 20 started sync module instance, tier type = 2024-09-14T11:22:50.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.294+0000 7f0f19c16800 20 started zone id=428283c8-3a45-44a8-bd53-0ab34f1e0563 (name=default) with tier type = 2024-09-14T11:22:50.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.304+0000 7f0f19c16800 20 add_watcher() i=0 2024-09-14T11:22:50.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.304+0000 7f0f19c16800 20 add_watcher() i=1 2024-09-14T11:22:50.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.304+0000 7f0f19c16800 20 add_watcher() i=2 2024-09-14T11:22:50.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.304+0000 7f0f19c16800 20 add_watcher() i=3 2024-09-14T11:22:50.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.304+0000 7f0f19c16800 20 add_watcher() i=4 2024-09-14T11:22:50.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.304+0000 7f0f19c16800 20 add_watcher() i=5 2024-09-14T11:22:50.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.304+0000 7f0f19c16800 20 add_watcher() i=6 2024-09-14T11:22:50.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.305+0000 7f0f19c16800 20 add_watcher() i=7 2024-09-14T11:22:50.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.305+0000 7f0f19c16800 2 all 8 watchers are set, enabling cache 2024-09-14T11:22:50.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.307+0000 7f0dcb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:50.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.307+0000 7f0f19c16800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:22:50.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.307+0000 7f0f19c16800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:22:50.343 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.344+0000 7f0dca7e4640 20 reqs_thread_entry: start 2024-09-14T11:22:50.343 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.344+0000 7f0f19c16800 20 init_complete bucket index max shards: 11 2024-09-14T11:22:50.343 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.344+0000 7f0f19c16800 20 Filter name: none 2024-09-14T11:22:50.343 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.344+0000 7f0d3bfff640 20 reqs_thread_entry: start 2024-09-14T11:22:50.343 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.344+0000 7f0f19c16800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:22:50.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.345+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:50.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.346+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:50.346 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.347+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49773' 2024-09-14T11:22:50.347 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.347+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9609270300491059926', time=2024-09-14T13:14:49.320736+0000, chain.objs.size()=1 2024-09-14T11:22:50.347 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.347+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.248__shadow_.o8wFSaKvkobyLmz_QsV2B_bAzecZ6CW_0 2024-09-14T11:22:50.347 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.347+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17375087943555911071', time=2024-09-14T13:14:59.793999+0000, chain.objs.size()=1 2024-09-14T11:22:50.347 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.347+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.2PbB-iEECN-Eulnsp2RIy3gJQRUqEjL_0 2024-09-14T11:22:50.347 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.347+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10632417028244280082', time=2024-09-14T13:14:59.802778+0000, chain.objs.size()=1 2024-09-14T11:22:50.347 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.347+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.XzPGpNHvZPHEzOkBO7xCU7XbGPK9CGN_0 2024-09-14T11:22:50.347 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.347+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1585770942704279760', time=2024-09-14T13:14:59.807212+0000, chain.objs.size()=1 2024-09-14T11:22:50.347 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.347+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.MsfiBPbatHs_DYfy6Cx1URvQfAZf_kp_0 2024-09-14T11:22:50.347 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.347+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3162276945678597940', time=2024-09-14T13:14:59.812687+0000, chain.objs.size()=1 2024-09-14T11:22:50.347 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.347+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.VwD97G6kQD1FgmfrjoUmDu6HUqfBpXh_0 2024-09-14T11:22:50.347 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.347+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15091163886273425545', time=2024-09-14T13:15:00.064828+0000, chain.objs.size()=1 2024-09-14T11:22:50.347 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.347+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.pWVi-8XrCPNFs09qPjLzSEK0JRhI2aO_0 2024-09-14T11:22:50.347 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.347+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8631149546865989264', time=2024-09-14T13:15:00.088417+0000, chain.objs.size()=1 2024-09-14T11:22:50.347 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.347+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.s_ThAeKOevFB0zK633LZNLAYJHLtcgh_0 2024-09-14T11:22:50.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.347+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6161950654647246409', time=2024-09-14T13:15:00.095728+0000, chain.objs.size()=1 2024-09-14T11:22:50.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.347+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.236zoeNp2lr1O-oc82Xg1yLOAeNURXb_0 2024-09-14T11:22:50.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.347+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7559046820370356685', time=2024-09-14T13:15:00.104017+0000, chain.objs.size()=1 2024-09-14T11:22:50.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.347+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.s_qtLDXrHT9wv8MWOTsrnXjjB7ysLks_0 2024-09-14T11:22:50.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.347+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6054662290076455172', time=2024-09-14T13:15:00.108659+0000, chain.objs.size()=1 2024-09-14T11:22:50.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.347+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.c35FMZe0tu_Gz5Nr37itaT7fcZC5CP9_0 2024-09-14T11:22:50.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.347+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6806643162795055791', time=2024-09-14T13:15:00.298307+0000, chain.objs.size()=1 2024-09-14T11:22:50.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.347+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.lIhrtGXxS1YYkhJOA2_f0gFTLtAGJrg_0 2024-09-14T11:22:50.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.347+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1684880888956887438', time=2024-09-14T13:15:00.304332+0000, chain.objs.size()=1 2024-09-14T11:22:50.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.347+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.ooKsRXDgZJbhdDTkOaGAzTgZMclgBnj_0 2024-09-14T11:22:50.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.349+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1063711052792464308', time=2024-09-14T13:15:00.306579+0000, chain.objs.size()=1 2024-09-14T11:22:50.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.349+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.eVc6qW6t2rJmz4uLnyBk3EDBOnDm-g7_0 2024-09-14T11:22:50.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.349+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15157434096681723787', time=2024-09-14T13:15:00.389925+0000, chain.objs.size()=1 2024-09-14T11:22:50.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.349+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.tzkz1_ECobODDE7Dsrc4dxStDCv_75__0 2024-09-14T11:22:50.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.349+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14553603297288406350', time=2024-09-14T13:15:00.399072+0000, chain.objs.size()=1 2024-09-14T11:22:50.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.349+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.1bnnJ_yOARxkRcO_PU5PF7CcpT0o_lR_0 2024-09-14T11:22:50.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.349+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2672926461956116613', time=2024-09-14T13:15:00.407264+0000, chain.objs.size()=1 2024-09-14T11:22:50.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.349+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.CyrXOmpUNHeqGyx1SZn8-_AhR6ii5VK_0 2024-09-14T11:22:50.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.349+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13094202731718792745', time=2024-09-14T13:15:00.413395+0000, chain.objs.size()=1 2024-09-14T11:22:50.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.349+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.jqYThzigviFdcg_16JLzavfzjYC1EFN_0 2024-09-14T11:22:50.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.349+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17837081592953498297', time=2024-09-14T13:15:00.436245+0000, chain.objs.size()=1 2024-09-14T11:22:50.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.349+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.K9r09UZPio8ho7wGBqRTtdj5vtOK7C1_0 2024-09-14T11:22:50.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.349+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4004690256488809601', time=2024-09-14T13:15:00.441334+0000, chain.objs.size()=1 2024-09-14T11:22:50.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.349+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.BgxrRyiTxDei2Qrh_AtzlI8wSC4C5i4_0 2024-09-14T11:22:50.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.349+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12370172350497881224', time=2024-09-14T13:15:00.450919+0000, chain.objs.size()=1 2024-09-14T11:22:50.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.349+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Op3jCwGHb0WlBjYsJiXIUqgHPqKRfEE_0 2024-09-14T11:22:50.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.349+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1982658314054159250', time=2024-09-14T13:15:00.472433+0000, chain.objs.size()=1 2024-09-14T11:22:50.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.349+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.gDkGtshcDrC7ClfZlbMQpYeXRPUzrFC_0 2024-09-14T11:22:50.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.349+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8069362083991503804', time=2024-09-14T13:15:00.473288+0000, chain.objs.size()=1 2024-09-14T11:22:50.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.349+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.pzET7OnLvRXgVMi1Ad2cXWAzgBuq4Na_0 2024-09-14T11:22:50.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.349+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3419028075439159434', time=2024-09-14T13:15:00.475828+0000, chain.objs.size()=1 2024-09-14T11:22:50.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.350+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.0f6pEuMooyVGEUDqKuNtY1ztDc0jPO-_0 2024-09-14T11:22:50.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.351+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3655237463562825671', time=2024-09-14T13:15:00.589907+0000, chain.objs.size()=1 2024-09-14T11:22:50.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.351+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.ouY9DsoiaUoRvyWFJNZ-_xbx_RiT-IH_0 2024-09-14T11:22:50.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.352+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11111523271227689610', time=2024-09-14T13:15:00.592858+0000, chain.objs.size()=1 2024-09-14T11:22:50.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.352+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.gcdinqSHnBXPVqKc3btbwpNP86LsWX-_0 2024-09-14T11:22:50.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.352+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8215642633617306570', time=2024-09-14T13:15:00.622957+0000, chain.objs.size()=1 2024-09-14T11:22:50.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.352+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.NbI0umKi9O56RywzZfbdZmVoco9WdYJ_0 2024-09-14T11:22:50.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.352+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15045418727128518650', time=2024-09-14T13:15:00.629637+0000, chain.objs.size()=1 2024-09-14T11:22:50.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.352+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.BebMjjAUbtKLF82RN3beRWO3DQes9Ad_0 2024-09-14T11:22:50.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.352+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7000555946786465043', time=2024-09-14T13:15:00.636907+0000, chain.objs.size()=1 2024-09-14T11:22:50.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.352+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Pr-dZJxxap0u_DMqSPN9QHWNA0fYNFa_0 2024-09-14T11:22:50.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.352+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10097287521442214891', time=2024-09-14T13:15:00.761080+0000, chain.objs.size()=1 2024-09-14T11:22:50.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.352+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.YYLorTWvhA7CMrPRqR1w5gHGrtlkdUM_0 2024-09-14T11:22:50.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.352+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13766229742334302287', time=2024-09-14T13:15:00.777944+0000, chain.objs.size()=1 2024-09-14T11:22:50.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.352+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_._G78Kqr9rI8MySxA7piY9FHo8H6-gva_0 2024-09-14T11:22:50.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.352+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15219448553902032161', time=2024-09-14T13:15:00.874904+0000, chain.objs.size()=1 2024-09-14T11:22:50.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.352+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.rOPS_7-BgHr8i-jHrRNoqRgYonoE0xY_0 2024-09-14T11:22:50.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.352+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5337666954982456920', time=2024-09-14T13:15:00.884905+0000, chain.objs.size()=1 2024-09-14T11:22:50.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.352+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.TKRzE4t4fMhaLehFSzGDxv9DMEIMD9g_0 2024-09-14T11:22:50.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.352+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5679028430061147324', time=2024-09-14T13:15:00.915180+0000, chain.objs.size()=1 2024-09-14T11:22:50.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.352+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.te7IC49JhIjTZB8GsLQmjB7hWHkB52p_0 2024-09-14T11:22:50.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.352+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13147162972691140582', time=2024-09-14T13:15:00.919806+0000, chain.objs.size()=1 2024-09-14T11:22:50.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.352+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.JdiS2GockhQnwHPgSJ1Q9kuOO8z5bqw_0 2024-09-14T11:22:50.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.353+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12255735517416234264', time=2024-09-14T13:15:00.924486+0000, chain.objs.size()=1 2024-09-14T11:22:50.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.353+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.SJv0N4VhBuwVOwp24n9kyUC8KF-f57b_0 2024-09-14T11:22:50.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.353+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17472899760144603467', time=2024-09-14T13:15:02.161610+0000, chain.objs.size()=1 2024-09-14T11:22:50.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.353+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.267__shadow_.kR0SxV9NSNQOzNx2SSGAOzlpgWSTxTk_0 2024-09-14T11:22:50.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.354+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11523900586968521025', time=2024-09-14T13:15:03.415999+0000, chain.objs.size()=1 2024-09-14T11:22:50.356 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.354+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.272__shadow_._nrE-sX8IK1Ldvnyr5fFPQuD-LLi5NO_0 2024-09-14T11:22:50.356 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.354+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12014105215373728537', time=2024-09-14T13:15:09.243826+0000, chain.objs.size()=1 2024-09-14T11:22:50.356 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.354+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.292__shadow_.TxqaB00Zhi8hDSnqxthbGq2NZFUJa84_0 2024-09-14T11:22:50.356 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.355+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3988688590657396859', time=2024-09-14T13:15:09.253269+0000, chain.objs.size()=1 2024-09-14T11:22:50.356 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.355+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.292__shadow_.c6TH6SH2pG__q5Ea1sMd6NMc7kqAlSc_0 2024-09-14T11:22:50.356 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.355+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18172078525234230163', time=2024-09-14T13:15:09.826471+0000, chain.objs.size()=1 2024-09-14T11:22:50.356 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.355+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.293__shadow_.HO2zfGN9nbc8xGKGCctv9cnYYUYWkY4_0 2024-09-14T11:22:50.356 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.355+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15913010507933979448', time=2024-09-14T13:15:17.266696+0000, chain.objs.size()=1 2024-09-14T11:22:50.356 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.355+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.322__shadow_.2VZc4kSYXKj8ZRLka5sp98BM85lP6Y0_0 2024-09-14T11:22:50.356 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.355+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15710928473303837300', time=2024-09-14T13:15:24.714790+0000, chain.objs.size()=1 2024-09-14T11:22:50.356 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.355+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.d9cwV7Eb28ZOKMbxr_lksnxqyLInJIv_0 2024-09-14T11:22:50.356 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.355+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3950684842078456223', time=2024-09-14T13:15:24.725088+0000, chain.objs.size()=1 2024-09-14T11:22:50.356 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.355+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.oCvlvV6ifva9r6mgm3xhn8StsTL5tRV_0 2024-09-14T11:22:50.356 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.355+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14990111014755853911', time=2024-09-14T13:15:24.756133+0000, chain.objs.size()=1 2024-09-14T11:22:50.357 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.355+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.129birJfsYpWCWsodoUOeNZ_rSnVjAl_0 2024-09-14T11:22:50.357 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.355+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5511845678699895992', time=2024-09-14T13:15:24.774116+0000, chain.objs.size()=1 2024-09-14T11:22:50.357 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.355+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.0P2iKcsFFEjGhIq7ya7WkC7VBDNtgrU_0 2024-09-14T11:22:50.357 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.355+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12581574906464692692', time=2024-09-14T13:15:24.795417+0000, chain.objs.size()=1 2024-09-14T11:22:50.357 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.355+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.ZoWkkicbXUZOWV9wab52xe00LZo2VTa_0 2024-09-14T11:22:50.357 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.355+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13831890492113988711', time=2024-09-14T13:15:24.796283+0000, chain.objs.size()=1 2024-09-14T11:22:50.357 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.355+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.WyA_Ba2byllYtTXUbzEQCGLqRT3OI_r_0 2024-09-14T11:22:50.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.357+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8559577316753948230', time=2024-09-14T13:15:24.924749+0000, chain.objs.size()=1 2024-09-14T11:22:50.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.357+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.23MECn3ZVn62Tc4KUThp5DxyUHqsUjX_0 2024-09-14T11:22:50.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.357+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4726574335561873061', time=2024-09-14T13:15:24.933468+0000, chain.objs.size()=1 2024-09-14T11:22:50.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.357+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.dVfMZuhOH_b4eBNz-tC5PU6O-II5rhu_0 2024-09-14T11:22:50.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.357+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14462793058032067218', time=2024-09-14T13:15:24.965720+0000, chain.objs.size()=1 2024-09-14T11:22:50.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.357+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.nVn1h31uzBOMmQqDRktanR-IoEEZOvu_0 2024-09-14T11:22:50.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.357+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16990977222789448542', time=2024-09-14T13:15:25.237304+0000, chain.objs.size()=1 2024-09-14T11:22:50.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.357+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.A_EFuQ2qicBtxNzX6H65IBexzle4fDq_0 2024-09-14T11:22:50.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.357+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13382226832533081717', time=2024-09-14T13:15:25.241855+0000, chain.objs.size()=1 2024-09-14T11:22:50.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.357+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.xnT44htDAP7rBRMQ2qTznz3dN0lZweu_0 2024-09-14T11:22:50.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.357+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8464655782370108440', time=2024-09-14T13:15:25.253051+0000, chain.objs.size()=1 2024-09-14T11:22:50.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.357+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.TpOEukvKoO0_onAyqMHmxSXDXHehq_V_0 2024-09-14T11:22:50.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.357+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2642957878382624459', time=2024-09-14T13:15:25.253909+0000, chain.objs.size()=1 2024-09-14T11:22:50.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.357+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.OnW4fg_zH4m5AViR6KLgWkL_nR-8eub_0 2024-09-14T11:22:50.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.357+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1675540269163478491', time=2024-09-14T13:15:25.263267+0000, chain.objs.size()=1 2024-09-14T11:22:50.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.357+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.tLD2LlUVlHH6BfUumIEZWQF5q0PsguR_0 2024-09-14T11:22:50.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.357+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14252891967809563337', time=2024-09-14T13:15:25.267749+0000, chain.objs.size()=1 2024-09-14T11:22:50.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.357+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.tSJTXP71gl6_ou4Q0uwe9kCJ5WFbEM6_0 2024-09-14T11:22:50.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.358+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3534272692963753215', time=2024-09-14T13:15:25.289363+0000, chain.objs.size()=1 2024-09-14T11:22:50.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.358+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.u2ILbbhjHIp9Zxu2i_6WeII5t_QN86X_0 2024-09-14T11:22:50.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.358+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12849596988340970697', time=2024-09-14T13:15:25.400956+0000, chain.objs.size()=1 2024-09-14T11:22:50.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.358+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.ccEPpVoBv4zcDGCOkuKG53prW-jBpbq_0 2024-09-14T11:22:50.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.358+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5440801473851771757', time=2024-09-14T13:15:25.406553+0000, chain.objs.size()=1 2024-09-14T11:22:50.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.358+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.UgxSIdsbkBCO2UAstOt5ppcxuewl93t_0 2024-09-14T11:22:50.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.358+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4409555141046993141', time=2024-09-14T13:15:25.564339+0000, chain.objs.size()=1 2024-09-14T11:22:50.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.358+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.l18RmJ15ly1rcBXaieZuPbqM60tULrJ_0 2024-09-14T11:22:50.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.358+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15393278008145761701', time=2024-09-14T13:15:25.567249+0000, chain.objs.size()=1 2024-09-14T11:22:50.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.358+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.LqB3VRLO7En_TTc2vywCzz0twjTmEW0_0 2024-09-14T11:22:50.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.358+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2421687587898662511', time=2024-09-14T13:15:25.582747+0000, chain.objs.size()=1 2024-09-14T11:22:50.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.358+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.SBpgMYWD38Wcs3qmjof61spM36aNhf-_0 2024-09-14T11:22:50.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.359+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4074717366467334464', time=2024-09-14T13:15:25.592109+0000, chain.objs.size()=1 2024-09-14T11:22:50.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.359+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.znt-3dnk00y2GBVhkolvSiqGeyNgJXb_0 2024-09-14T11:22:50.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.359+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3899491697623982514', time=2024-09-14T13:15:25.711210+0000, chain.objs.size()=1 2024-09-14T11:22:50.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.359+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.qcroe84DqOcr2rcw1LiVjhQ4hvbatik_0 2024-09-14T11:22:50.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.359+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6432891037166804117', time=2024-09-14T13:15:25.717427+0000, chain.objs.size()=1 2024-09-14T11:22:50.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.360+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.ta3lshAdRKYP-_SAreRDK0iLCIgRfah_0 2024-09-14T11:22:50.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.360+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7505197204970368004', time=2024-09-14T13:15:25.748881+0000, chain.objs.size()=1 2024-09-14T11:22:50.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.360+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.yevFMvMYZ99LsWL_VUiXRztlPVqOBdH_0 2024-09-14T11:22:50.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.360+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12659753552350713654', time=2024-09-14T13:15:25.760739+0000, chain.objs.size()=1 2024-09-14T11:22:50.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.360+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.cSndXPwE9vNORXCuq_bYblqQAD2Ckm9_0 2024-09-14T11:22:50.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.360+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10827546532304915033', time=2024-09-14T13:15:25.891671+0000, chain.objs.size()=1 2024-09-14T11:22:50.363 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.360+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.W-b2Vx9XHKa05UrJH44iPhQgFWo4XFc_0 2024-09-14T11:22:50.363 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.360+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3463212854312331140', time=2024-09-14T13:15:25.894303+0000, chain.objs.size()=1 2024-09-14T11:22:50.363 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.360+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.gcclVkozSjrSD7iyeF43p9p_IfeY3U6_0 2024-09-14T11:22:50.363 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.360+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16950852448142958042', time=2024-09-14T13:15:25.907775+0000, chain.objs.size()=1 2024-09-14T11:22:50.363 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.360+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.r2h3ehryYIJPItcNonRkAKkRTzUr3qC_0 2024-09-14T11:22:50.363 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.360+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1332903095063104390', time=2024-09-14T13:15:25.948171+0000, chain.objs.size()=1 2024-09-14T11:22:50.363 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.360+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.rt_Vkwa755qilFRo-sI6KI-CVA6Cl3V_0 2024-09-14T11:22:50.363 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.361+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.787969372512321165', time=2024-09-14T13:15:33.187201+0000, chain.objs.size()=1 2024-09-14T11:22:50.363 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.361+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.bDmc_lZFQSpAoqNoNoKSOiFDzidGzvI_0 2024-09-14T11:22:50.363 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.361+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4047703391327264078', time=2024-09-14T13:15:33.226582+0000, chain.objs.size()=1 2024-09-14T11:22:50.363 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.361+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.L3ellFSsxxFxQ_P1CzS5rXZZlK_ZVV0_0 2024-09-14T11:22:50.365 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.362+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8958577691109685176', time=2024-09-14T13:15:33.227308+0000, chain.objs.size()=1 2024-09-14T11:22:50.366 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.362+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.wziRPk-vH_6MbPigX25fsgDgZa9FAbi_0 2024-09-14T11:22:50.366 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.362+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.848230445005164622', time=2024-09-14T13:15:33.381005+0000, chain.objs.size()=1 2024-09-14T11:22:50.366 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.362+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.OBV6hxXxkhU4B-Kvf43Nel8OfrgHzka_0 2024-09-14T11:22:50.366 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.362+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14284471047872879147', time=2024-09-14T13:15:33.400966+0000, chain.objs.size()=1 2024-09-14T11:22:50.366 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.362+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.6UZVUy_Aj6OuMKWAcw8FcRiCqikOpRD_0 2024-09-14T11:22:50.366 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.362+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10079629890093887124', time=2024-09-14T13:15:33.415064+0000, chain.objs.size()=1 2024-09-14T11:22:50.366 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.362+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.oOzNbD4xPeJETDNjVJK9umFeQBzRn11_0 2024-09-14T11:22:50.366 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.362+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17215971332746642293', time=2024-09-14T13:15:33.432727+0000, chain.objs.size()=1 2024-09-14T11:22:50.366 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.362+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Oualuo023enyZwIAQW5BXJ7xvxL37WE_0 2024-09-14T11:22:50.366 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.362+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13061148628084247137', time=2024-09-14T13:15:33.533570+0000, chain.objs.size()=1 2024-09-14T11:22:50.366 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.362+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.ux7BGk0FcN60VoVtYxHb2yNJMBXVjA6_0 2024-09-14T11:22:50.366 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.362+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3231582338737331316', time=2024-09-14T13:15:33.534786+0000, chain.objs.size()=1 2024-09-14T11:22:50.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.362+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.VHTntxYWLPXiCWu50R0gRQ7CmahHHwu_0 2024-09-14T11:22:50.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.363+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15482231426167816718', time=2024-09-14T13:15:33.559308+0000, chain.objs.size()=1 2024-09-14T11:22:50.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.363+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.y3f9BbiLNbRsuKvcLQxuGvWCzVrTp0-_0 2024-09-14T11:22:50.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.363+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8267695731743231829', time=2024-09-14T13:15:33.580486+0000, chain.objs.size()=1 2024-09-14T11:22:50.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.363+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.NbSLfBEbq8B_vgs7a6SidFZfNWwk35V_0 2024-09-14T11:22:50.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.364+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10543021021116347224', time=2024-09-14T13:15:33.602404+0000, chain.objs.size()=1 2024-09-14T11:22:50.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.364+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.G1E7kNb04GGs-1w5aNiYbwKkuMg-Ekk_0 2024-09-14T11:22:50.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.364+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12301235537236930756', time=2024-09-14T13:15:33.605024+0000, chain.objs.size()=1 2024-09-14T11:22:50.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.364+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.oiW06dY8VGA4xZQv56KqTXGeiKIg617_0 2024-09-14T11:22:50.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.364+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3254707909969418367', time=2024-09-14T13:15:33.754375+0000, chain.objs.size()=1 2024-09-14T11:22:50.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.364+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.mguSo6gMWk0hqiSE9Dp0bxy4Ki9ZK7o_0 2024-09-14T11:22:50.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.364+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12950846130662461072', time=2024-09-14T13:15:33.867233+0000, chain.objs.size()=1 2024-09-14T11:22:50.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.364+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.gMRSKMttfuKeyIuQ5MjjmlpMCPVqpTN_0 2024-09-14T11:22:50.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.364+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1928252496036809957', time=2024-09-14T13:15:33.906125+0000, chain.objs.size()=1 2024-09-14T11:22:50.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.364+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.D4Q3bb9PRuet9nq4pobzNCiLCf70Vxk_0 2024-09-14T11:22:50.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.364+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13341800456480453732', time=2024-09-14T13:15:33.927378+0000, chain.objs.size()=1 2024-09-14T11:22:50.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.364+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.T9zDG-Z6LzDYvJReJaFjnfEOtEiyIgL_0 2024-09-14T11:22:50.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.364+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11160582141684318898', time=2024-09-14T13:15:34.041301+0000, chain.objs.size()=1 2024-09-14T11:22:50.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.364+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.J02emzRnX5vIzxNHqnwAiKEy_-4GmQS_0 2024-09-14T11:22:50.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.365+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1012959586903693174', time=2024-09-14T13:15:34.085890+0000, chain.objs.size()=1 2024-09-14T11:22:50.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.365+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.L_jy6XYH-BNX3g5H8Hr_C0cW6UptKti_0 2024-09-14T11:22:50.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.365+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11710837353177951813', time=2024-09-14T13:15:34.184603+0000, chain.objs.size()=1 2024-09-14T11:22:50.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.365+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.tY2_hn_LP19MdtgN7ng-1BLkMM4WGoU_0 2024-09-14T11:22:50.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.365+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11904218869179760236', time=2024-09-14T13:15:34.229512+0000, chain.objs.size()=1 2024-09-14T11:22:50.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.365+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.C-V4M89i7vkjcRsOyleCw4uAq42XGZz_0 2024-09-14T11:22:50.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.365+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5921064255351712112', time=2024-09-14T13:15:34.259445+0000, chain.objs.size()=1 2024-09-14T11:22:50.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.365+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.UaShGmTcHZM52dt09QZfUsbKyXbZZw4_0 2024-09-14T11:22:50.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.366+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5889196145349910679', time=2024-09-14T13:15:34.347339+0000, chain.objs.size()=1 2024-09-14T11:22:50.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.366+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.6Ij7M-LvSCSq6Ym3XhDgXSLu3kAAeem_0 2024-09-14T11:22:50.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.366+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17329187898088315198', time=2024-09-14T13:15:34.348058+0000, chain.objs.size()=1 2024-09-14T11:22:50.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.366+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.08Ii4P6tSr3Femr1omvj79rpt0FRiI9_0 2024-09-14T11:22:50.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.366+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11293101366671410660', time=2024-09-14T13:15:34.358947+0000, chain.objs.size()=1 2024-09-14T11:22:50.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.366+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Ko8-N8W20TZu2lfk4UwwxYqfmu5SUnZ_0 2024-09-14T11:22:50.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.366+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5998096597708361245', time=2024-09-14T13:15:34.383234+0000, chain.objs.size()=1 2024-09-14T11:22:50.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.366+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Cq940goegIN0z0kyNunnCM9rHBySZRw_0 2024-09-14T11:22:50.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.366+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6847839879472732089', time=2024-09-14T13:15:37.290086+0000, chain.objs.size()=1 2024-09-14T11:22:50.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.366+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.336__shadow_.faSvbm3M5v-a1L2I1IwQGsM498Ahn-z_0 2024-09-14T11:22:50.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.366+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8960156533442831612', time=2024-09-14T13:16:09.064426+0000, chain.objs.size()=1 2024-09-14T11:22:50.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.366+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.454__shadow_.9rLDjcORKR297iQbu77D5kAP_FVxtwu_0 2024-09-14T11:22:50.370 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.366+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14611912566749413149', time=2024-09-14T13:16:13.394581+0000, chain.objs.size()=1 2024-09-14T11:22:50.370 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.366+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.465__shadow_.k31bWv6vNHwLzQBfvtHjq4icm3nrvi2_0 2024-09-14T11:22:50.371 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.368+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 0/49773 2024-09-14T11:22:50.371 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.370+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-14T11:22:50.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.370+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11942507021981210733', time=2024-09-14T13:16:25.901506+0000, chain.objs.size()=1 2024-09-14T11:22:50.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.370+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.513__multipart_mymultipart.2~3INUlHZMWgBtCb0Tq7_CMCcg11U7Y6o.1 2024-09-14T11:22:50.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.370+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17613833276309668108', time=2024-09-14T13:16:27.914175+0000, chain.objs.size()=1 2024-09-14T11:22:50.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.370+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.517__shadow_.Jnye3TT5u7h5Njn3cgkZv8wKKPeuusN_0 2024-09-14T11:22:50.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.370+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5987369094204814979', time=2024-09-14T13:16:36.996318+0000, chain.objs.size()=2 2024-09-14T11:22:50.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.370+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.525__multipart_mymultipart.2~EWyq6flElr4bjnd6YY7YuyHYh43Uc2S.1 2024-09-14T11:22:50.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.370+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.525__multipart_mymultipart.2~EWyq6flElr4bjnd6YY7YuyHYh43Uc2S.2 2024-09-14T11:22:50.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.370+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11921928364811528406', time=2024-09-14T13:17:12.340175+0000, chain.objs.size()=1 2024-09-14T11:22:50.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.370+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.556__shadow_.nzSb1eDCEZZMDBjrf_N_Y9GzJtWJM9U_0 2024-09-14T11:22:50.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.370+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17720154698736422529', time=2024-09-14T13:17:12.379014+0000, chain.objs.size()=1 2024-09-14T11:22:50.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.370+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.556__shadow_.BdcULoMcDvl0_KKQYMhO95Q0R6cDBqy_0 2024-09-14T11:22:50.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.370+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3469324836024480095', time=2024-09-14T13:17:12.866123+0000, chain.objs.size()=1 2024-09-14T11:22:50.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.370+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.557__shadow_.hYrK-L0aP4jbv2Irtl2SLKKUp2IgaoK_0 2024-09-14T11:22:50.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.370+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1366553462935978131', time=2024-09-14T13:17:21.627912+0000, chain.objs.size()=1 2024-09-14T11:22:50.373 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.370+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.569__shadow:mTn6VaVcNmgVDDvfuQscPGFzUfGz4i2_.c6YOOME4hxeyldepZ0D2IAa5Chx2oiQ_0 2024-09-14T11:22:50.373 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.370+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2706653622297689181', time=2024-09-14T13:17:22.118961+0000, chain.objs.size()=1 2024-09-14T11:22:50.373 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.370+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.569__shadow:9YE.ZJ7kMRWCbjah1CdMn2V2pmLGCmG_.gNFCt_rBP70pRy_yM56ZsJS-gSH4OwV_0 2024-09-14T11:22:50.373 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.370+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8743350005188254371', time=2024-09-14T13:17:37.676146+0000, chain.objs.size()=1 2024-09-14T11:22:50.373 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.370+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.577__shadow:SyKITgjAEe.veGGnXH.WrDGkfe19QPt_.fvNehhBEZBGsqfWWor5ct8EuUMVl6gA_0 2024-09-14T11:22:50.373 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.370+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6502458700160861477', time=2024-09-14T13:17:40.195934+0000, chain.objs.size()=1 2024-09-14T11:22:50.373 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.370+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.577__shadow:89REaVCEjctGwRWWnsKdhDPqohivGP3_.WmeSf8s34Vm9Kq5DE4bHyAXwbJmomg9_0 2024-09-14T11:22:50.373 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.370+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16280341119724771753', time=2024-09-14T13:17:41.231369+0000, chain.objs.size()=1 2024-09-14T11:22:50.373 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.370+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.577__shadow:iSRbPReJOpKRKiHg6ak-5exR6ZBdaHQ_.ecf7967wriNebeZAVSex0EwHGRHsuq2_0 2024-09-14T11:22:50.373 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.373+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5116782819439985232', time=2024-09-14T13:17:49.999692+0000, chain.objs.size()=1 2024-09-14T11:22:50.373 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.373+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.579__shadow:ku2XRQ9TKX3i.7Eq6WndqGU2UeQtHHu_.h6liae1gueW4I6w4gyAFnu_z14MTH0Z_0 2024-09-14T11:22:50.373 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.373+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9551570541051175364', time=2024-09-14T13:17:51.113395+0000, chain.objs.size()=1 2024-09-14T11:22:50.373 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.373+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.580__shadow:UZ6rciVk4cz13HLmBI9-ugt.Iy9SsZK_.29wENJWWqKHn7sxPxs2aoUoI3ZIgXOr_0 2024-09-14T11:22:50.373 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.373+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18233539636012780415', time=2024-09-14T13:18:00.835358+0000, chain.objs.size()=6 2024-09-14T11:22:50.374 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.373+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.613__multipart_multipart_enc.2~S70Az-CVRdzMCtn5iS51IF21Ib_6c82.1 2024-09-14T11:22:50.374 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.373+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.613__multipart_multipart_enc.2~S70Az-CVRdzMCtn5iS51IF21Ib_6c82.2 2024-09-14T11:22:50.374 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.373+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.613__multipart_multipart_enc.2~S70Az-CVRdzMCtn5iS51IF21Ib_6c82.3 2024-09-14T11:22:50.374 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.373+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.613__multipart_multipart_enc.2~S70Az-CVRdzMCtn5iS51IF21Ib_6c82.4 2024-09-14T11:22:50.374 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.374+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.613__multipart_multipart_enc.2~S70Az-CVRdzMCtn5iS51IF21Ib_6c82.5 2024-09-14T11:22:50.375 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.374+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.613__multipart_multipart_enc.2~S70Az-CVRdzMCtn5iS51IF21Ib_6c82.6 2024-09-14T11:22:50.375 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.374+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16584272402793042826', time=2024-09-14T13:20:11.357036+0000, chain.objs.size()=1 2024-09-14T11:22:50.375 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.374+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.639__shadow_.9JsPeWiI0Z6tnYHPd8Wc2yV1WCq44YJ_0 2024-09-14T11:22:50.375 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.374+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13355143321328343191', time=2024-09-14T13:20:20.421138+0000, chain.objs.size()=1 2024-09-14T11:22:50.375 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.374+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.664__shadow_._yWnmCX7IlAhxQmPgwROukNcl7vYFrM_0 2024-09-14T11:22:50.375 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.374+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5058226894519448212', time=2024-09-14T13:21:13.459322+0000, chain.objs.size()=1 2024-09-14T11:22:50.375 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.374+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.771__shadow_.ybCkv-tL37PwO707PDRC2hGSoImOE6q_0 2024-09-14T11:22:50.376 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.377+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:50.378 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.380+0000 7f0f19c16800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:22:50.380 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.381+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:50.380 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.382+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:50.382 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.383+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46045' 2024-09-14T11:22:50.382 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.383+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1843174616247524352', time=2024-09-14T13:13:29.460206+0000, chain.objs.size()=1 2024-09-14T11:22:50.382 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.383+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.148__shadow_.rxy9ZB3j0VpRpsXRDtCeMpnrXHazzLw_0 2024-09-14T11:22:50.382 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.383+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='_p_HKd14JcqZXflT1RVG5FLGZrq_KlKd', time=2024-09-14T13:13:34.552944+0000, chain.objs.size()=1 2024-09-14T11:22:50.382 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.383+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.160__shadow_.dTo0OXsbTpNrCprKMxW_c4J2m6Umzzp_0 2024-09-14T11:22:50.382 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.383+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='_kEaHweUBJLAfCrsCVPUnphzey1aOFlW', time=2024-09-14T13:13:37.227431+0000, chain.objs.size()=1 2024-09-14T11:22:50.382 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.383+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.163__shadow_.SY3R3cBDX4oDxa0j3HD3Wcy30ZrRC5F_0 2024-09-14T11:22:50.382 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.383+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10360415063235721848', time=2024-09-14T13:13:53.001900+0000, chain.objs.size()=1 2024-09-14T11:22:50.382 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.383+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.204__shadow_.wXjoyNB0XVRNA_ZKl_v0nttT2nnq2SS_0 2024-09-14T11:22:50.383 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.383+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4481056795704129977', time=2024-09-14T13:14:45.125044+0000, chain.objs.size()=1 2024-09-14T11:22:50.383 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.383+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.233__shadow_.JYH9KTmssEtV9wSjigdiyQjt6W5Ct9c_0 2024-09-14T11:22:50.383 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.383+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3417839064568278794', time=2024-09-14T13:14:46.515565+0000, chain.objs.size()=1 2024-09-14T11:22:50.383 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.383+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.238__shadow_.1seL8BA7kYfqU0ovjk3zipPksmAQYRx_0 2024-09-14T11:22:50.383 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.383+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5302204835467306175', time=2024-09-14T13:14:47.813102+0000, chain.objs.size()=1 2024-09-14T11:22:50.383 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.383+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.243__shadow_.4230UA3P7_XdjqLUXhr4mCyT4Dn7gpL_0 2024-09-14T11:22:50.383 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.383+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17835529094008408812', time=2024-09-14T13:14:59.764936+0000, chain.objs.size()=1 2024-09-14T11:22:50.383 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.383+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.i1SKrAGRytPLXknv7poIQhp98C7BIvO_0 2024-09-14T11:22:50.383 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.383+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7434301798281131686', time=2024-09-14T13:14:59.768463+0000, chain.objs.size()=1 2024-09-14T11:22:50.383 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.383+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.oL-wDLg4eIEyGyhhWmb3vQLfYOh_89__0 2024-09-14T11:22:50.383 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.383+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13553285476464677206', time=2024-09-14T13:14:59.783976+0000, chain.objs.size()=1 2024-09-14T11:22:50.383 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.383+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.CPFatIDFEV66Nqr32nEqdScXQLw3q8t_0 2024-09-14T11:22:50.383 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.383+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4777791602888935319', time=2024-09-14T13:14:59.819155+0000, chain.objs.size()=1 2024-09-14T11:22:50.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.383+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.h_xSxMUioyVw1rBGh8ejt90obqh_iRH_0 2024-09-14T11:22:50.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.383+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9279525589526049429', time=2024-09-14T13:14:59.915354+0000, chain.objs.size()=1 2024-09-14T11:22:50.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.383+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.MzFqYCMtmFgMlCejBQTaDr0GnZ5zdvs_0 2024-09-14T11:22:50.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.385+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12163876838373666966', time=2024-09-14T13:14:59.926713+0000, chain.objs.size()=1 2024-09-14T11:22:50.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.385+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.-Gygyw200uACXONgdYgpOrDLtlt4ePc_0 2024-09-14T11:22:50.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.385+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1778816237445131079', time=2024-09-14T13:14:59.937798+0000, chain.objs.size()=1 2024-09-14T11:22:50.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.385+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.zEKWOUVPTGWtZVSY0fAw9jnL8AcK8O-_0 2024-09-14T11:22:50.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.385+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2048561757155056916', time=2024-09-14T13:14:59.938859+0000, chain.objs.size()=1 2024-09-14T11:22:50.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.385+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.c32JArfnckUdkT72HFiS7RpyMHco_u4_0 2024-09-14T11:22:50.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.386+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11960449845684731418', time=2024-09-14T13:14:59.939776+0000, chain.objs.size()=1 2024-09-14T11:22:50.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.386+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.jUPlYtKqOh2IgGs5EpiHoC0SlnFPxGl_0 2024-09-14T11:22:50.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.386+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4448758414659049111', time=2024-09-14T13:14:59.942755+0000, chain.objs.size()=1 2024-09-14T11:22:50.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.386+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.GMScBsp5T15fzB-W4PiCXRhWY3wyqiO_0 2024-09-14T11:22:50.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.386+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15425793342571640957', time=2024-09-14T13:14:59.950344+0000, chain.objs.size()=1 2024-09-14T11:22:50.385 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.386+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.cpd3zmgNqVVR1wWw4YnJ5AhpUh62IqA_0 2024-09-14T11:22:50.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.386+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15035551540224000491', time=2024-09-14T13:14:59.954017+0000, chain.objs.size()=1 2024-09-14T11:22:50.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.386+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.a0qmNoHuBqk7YqXYcTACmFshScHE5NS_0 2024-09-14T11:22:50.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.386+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12303623757458343333', time=2024-09-14T13:14:59.958642+0000, chain.objs.size()=1 2024-09-14T11:22:50.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.386+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.XG7YtQs0aHJkkr0gSwf3gbFvHQBRJu5_0 2024-09-14T11:22:50.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.386+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10485057411180788464', time=2024-09-14T13:14:59.983615+0000, chain.objs.size()=1 2024-09-14T11:22:50.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.386+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.LOhjN7Oa1Tecfg39Jx2_Bakjuwz652S_0 2024-09-14T11:22:50.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.386+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17425829286127546763', time=2024-09-14T13:15:00.110574+0000, chain.objs.size()=1 2024-09-14T11:22:50.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.386+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.54tA1svp7ExnCo8Xvabb2-60PvWldEw_0 2024-09-14T11:22:50.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.386+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13333192572431643809', time=2024-09-14T13:15:00.131330+0000, chain.objs.size()=1 2024-09-14T11:22:50.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.386+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.zG1Oktytg7vwDnRpFzZFvplE34CaXyH_0 2024-09-14T11:22:50.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.387+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4872510999497618772', time=2024-09-14T13:15:00.139879+0000, chain.objs.size()=1 2024-09-14T11:22:50.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.387+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.2aDH4-0SJFpUkOtx0jh3iDo9oES-3My_0 2024-09-14T11:22:50.388 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.387+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15936234202756781781', time=2024-09-14T13:15:00.141417+0000, chain.objs.size()=1 2024-09-14T11:22:50.388 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.387+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.-tPXVnjbBgWcUTicmM564iV3Y-E_C9e_0 2024-09-14T11:22:50.388 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.387+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3564171416200008826', time=2024-09-14T13:15:00.251315+0000, chain.objs.size()=1 2024-09-14T11:22:50.388 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.387+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.PquD9bn5Q1gViNaczxU1bweLolwLdjo_0 2024-09-14T11:22:50.388 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.387+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9701977340997633480', time=2024-09-14T13:15:00.269785+0000, chain.objs.size()=1 2024-09-14T11:22:50.388 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.387+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.R57yM_5ptNMNCt4YMYfE1uEzugr3emg_0 2024-09-14T11:22:50.389 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.388+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2295437041289273755', time=2024-09-14T13:15:00.391892+0000, chain.objs.size()=1 2024-09-14T11:22:50.389 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.388+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.PlczTMDdJ_avvalos5mjF1PRtFMLR14_0 2024-09-14T11:22:50.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.388+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9118394268954157457', time=2024-09-14T13:15:00.422109+0000, chain.objs.size()=1 2024-09-14T11:22:50.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.388+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.34ZS-BGYhf34PYCH64paRwOlKkRT-0h_0 2024-09-14T11:22:50.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.388+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4408832782024566207', time=2024-09-14T13:15:00.425743+0000, chain.objs.size()=1 2024-09-14T11:22:50.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.388+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.q2mx0aDceRtEthW8tQcKg1McrlGSR0C_0 2024-09-14T11:22:50.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.388+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3493531899222267435', time=2024-09-14T13:15:00.450697+0000, chain.objs.size()=1 2024-09-14T11:22:50.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.388+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Nwc8cGbP2NuKs9u1-Gt-I0nVqJBmfN8_0 2024-09-14T11:22:50.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.388+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15606038286914076007', time=2024-09-14T13:15:00.710306+0000, chain.objs.size()=1 2024-09-14T11:22:50.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.388+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.8xz0UIiWYypoaKUVRHJHIWYa6Z11i8c_0 2024-09-14T11:22:50.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.388+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8028427186274073166', time=2024-09-14T13:15:00.714615+0000, chain.objs.size()=1 2024-09-14T11:22:50.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.388+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.H4yi9fzQCCr4ka-gWTL1bijO_9RUvHq_0 2024-09-14T11:22:50.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.389+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7601518314792022343', time=2024-09-14T13:15:00.715434+0000, chain.objs.size()=1 2024-09-14T11:22:50.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.389+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.sU2H592rv7Fi0s5Cf1axeMnruw8gAzn_0 2024-09-14T11:22:50.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.389+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6674011048004133919', time=2024-09-14T13:15:00.737869+0000, chain.objs.size()=1 2024-09-14T11:22:50.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.389+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.1SIF6TJd828niZL-qyGSBbCFmkD-3Y4_0 2024-09-14T11:22:50.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.389+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8537173748059212915', time=2024-09-14T13:15:00.872321+0000, chain.objs.size()=1 2024-09-14T11:22:50.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.389+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.9l6GbY_UAAtwGXEeWJFyiQ1UnrmNiRW_0 2024-09-14T11:22:50.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.389+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13252306836866930212', time=2024-09-14T13:15:00.875564+0000, chain.objs.size()=1 2024-09-14T11:22:50.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.389+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.OrHtYQyc0Kq2jhJdeFSaqs6nqAcMdZ9_0 2024-09-14T11:22:50.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.390+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5604956030529062017', time=2024-09-14T13:15:00.899990+0000, chain.objs.size()=1 2024-09-14T11:22:50.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.390+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.C20QcuxawW7zG55o_nU1HwrrxNSlh9q_0 2024-09-14T11:22:50.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.390+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.253289258097602531', time=2024-09-14T13:15:03.171043+0000, chain.objs.size()=1 2024-09-14T11:22:50.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.390+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.271__shadow_.IkPojMLNVEBKAnSwNBboh9VD9P9kEAY_0 2024-09-14T11:22:50.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.391+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17569414106352036458', time=2024-09-14T13:15:06.422758+0000, chain.objs.size()=1 2024-09-14T11:22:50.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.391+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.283__shadow_.Jws4lKb56-bIPuM9J5SSoMsC-MjutKs_0 2024-09-14T11:22:50.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.391+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9851930232363309186', time=2024-09-14T13:15:06.708993+0000, chain.objs.size()=1 2024-09-14T11:22:50.392 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.391+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.284__shadow_.81UssTTbrLAFtqBHVIemauxDWv0JNSj_0 2024-09-14T11:22:50.394 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.391+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7753765569871829067', time=2024-09-14T13:15:07.298323+0000, chain.objs.size()=1 2024-09-14T11:22:50.394 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.391+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.286__shadow_.M8IZJsXnac5sxMVsXJo9qBoSHtAwi9Q_0 2024-09-14T11:22:50.394 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.391+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9633410015927140733', time=2024-09-14T13:15:09.243645+0000, chain.objs.size()=1 2024-09-14T11:22:50.395 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.391+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.292__shadow_.g_caDSY7SCk_MhvZp300fnBOlgPGzR2_0 2024-09-14T11:22:50.395 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.391+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6001431693829577806', time=2024-09-14T13:15:09.249688+0000, chain.objs.size()=1 2024-09-14T11:22:50.395 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.391+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.292__shadow_.ld5op-U_pFgJiJMV3rYbtkCTSiCNue__0 2024-09-14T11:22:50.395 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.391+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17102982954360620615', time=2024-09-14T13:15:09.257820+0000, chain.objs.size()=1 2024-09-14T11:22:50.395 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.391+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.292__shadow_.tvooTGXILR8lQzgJPU3jAWLc9jAn_9F_0 2024-09-14T11:22:50.395 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.391+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10628475626172617160', time=2024-09-14T13:15:10.610346+0000, chain.objs.size()=1 2024-09-14T11:22:50.395 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.391+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.296__shadow_.RiQQtIhMs34DQSKuXv66yAJqG6PZCE__0 2024-09-14T11:22:50.395 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.391+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13722475977539566752', time=2024-09-14T13:15:12.488419+0000, chain.objs.size()=1 2024-09-14T11:22:50.395 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.391+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.303__shadow_.wII9IYnKtpQ4Z42_aSPoIGlzfvt8Hpn_0 2024-09-14T11:22:50.395 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.391+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3004022433893733259', time=2024-09-14T13:15:12.738014+0000, chain.objs.size()=1 2024-09-14T11:22:50.395 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.392+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.304__shadow_.ig_wCD14SuFn6k6oIf0UgFFwbJR-Htd_0 2024-09-14T11:22:50.395 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.392+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13729088588852353585', time=2024-09-14T13:15:12.985835+0000, chain.objs.size()=1 2024-09-14T11:22:50.395 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.392+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.305__shadow_.1oVeN_OHz_Ir2PHcIl_0kw_cztFOKDZ_0 2024-09-14T11:22:50.396 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.392+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10163937579583156126', time=2024-09-14T13:15:17.266359+0000, chain.objs.size()=1 2024-09-14T11:22:50.396 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.392+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.322__shadow_.PRm4VtnV2yVg3deTnNSpvNzWG5EDFdG_0 2024-09-14T11:22:50.396 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.392+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2446142569286263242', time=2024-09-14T13:15:24.934579+0000, chain.objs.size()=1 2024-09-14T11:22:50.396 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.392+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.YJaWfuuGxM61SEwU2nR7bqixMjEiHU4_0 2024-09-14T11:22:50.396 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.392+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17387244995161094407', time=2024-09-14T13:15:24.956520+0000, chain.objs.size()=1 2024-09-14T11:22:50.396 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.392+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.aI52XN99I05cW_sDwlFEAGFR3jzSS7e_0 2024-09-14T11:22:50.396 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.393+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8768104719656598477', time=2024-09-14T13:15:24.967545+0000, chain.objs.size()=1 2024-09-14T11:22:50.396 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.393+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.q-uekXaZ8HhtU_y_TyNdOhSjZ1yXFnJ_0 2024-09-14T11:22:50.396 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.394+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8192526711104754848', time=2024-09-14T13:15:25.043760+0000, chain.objs.size()=1 2024-09-14T11:22:50.396 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.394+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.q5m8r3qJF3obdxBV9HbRToNARRkou7Q_0 2024-09-14T11:22:50.396 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.394+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10852758569879761819', time=2024-09-14T13:15:25.052702+0000, chain.objs.size()=1 2024-09-14T11:22:50.396 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.394+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.9105MobzbufeQooDdLbEG3sAPl12DKD_0 2024-09-14T11:22:50.396 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.394+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5244537466776754212', time=2024-09-14T13:15:25.055803+0000, chain.objs.size()=1 2024-09-14T11:22:50.396 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.394+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.5sfrtiIfaF4IDAPiDO-VBkKEUC_b7Fy_0 2024-09-14T11:22:50.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.394+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13419923054752151847', time=2024-09-14T13:15:25.067809+0000, chain.objs.size()=1 2024-09-14T11:22:50.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.394+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.v4ZYBe2OMVRO28BKq67owm0xi_MXlty_0 2024-09-14T11:22:50.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.394+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15281657737873433569', time=2024-09-14T13:15:25.068430+0000, chain.objs.size()=1 2024-09-14T11:22:50.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.394+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.b-mf2cVZ79WaNVWxB3s2nKGeArxaIyq_0 2024-09-14T11:22:50.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.395+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.983084052377329057', time=2024-09-14T13:15:25.087214+0000, chain.objs.size()=1 2024-09-14T11:22:50.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.395+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.xIdOhCWQ42yIEFjFd8V_XwnwRC60Y74_0 2024-09-14T11:22:50.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.395+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10590082924459096005', time=2024-09-14T13:15:25.217278+0000, chain.objs.size()=1 2024-09-14T11:22:50.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.395+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.OW1Y30vHn92OK-WZiTiZu1-k_PWDvvf_0 2024-09-14T11:22:50.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.395+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15599210852540956966', time=2024-09-14T13:15:25.240444+0000, chain.objs.size()=1 2024-09-14T11:22:50.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.395+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.8SQw-0qfcqj1KnbSXHzBrTJuhJXJtv8_0 2024-09-14T11:22:50.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.395+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5477589301231655210', time=2024-09-14T13:15:25.260955+0000, chain.objs.size()=1 2024-09-14T11:22:50.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.395+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.UoDirJuhWhIPihs3SFrIWJDEZL8p1Ww_0 2024-09-14T11:22:50.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.395+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8656347578442881584', time=2024-09-14T13:15:25.277016+0000, chain.objs.size()=1 2024-09-14T11:22:50.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.395+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.IY6Ksr9ddNn0s0gcXXU53rJ4zYfFujl_0 2024-09-14T11:22:50.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.395+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13471327833228768253', time=2024-09-14T13:15:25.292621+0000, chain.objs.size()=1 2024-09-14T11:22:50.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.395+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.kkT03Y_3cCr3QMxW7fNhPGAElonRL34_0 2024-09-14T11:22:50.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.395+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11633818357536618075', time=2024-09-14T13:15:25.383457+0000, chain.objs.size()=1 2024-09-14T11:22:50.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.395+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.A5nLpqWMhfrlMVsbjfXCmHHSvJIeeab_0 2024-09-14T11:22:50.402 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.396+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8044579750519816859', time=2024-09-14T13:15:25.397471+0000, chain.objs.size()=1 2024-09-14T11:22:50.402 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.396+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.DhCvKhmqIYuBXrrekCa2Z3BoA7T8VMv_0 2024-09-14T11:22:50.402 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.396+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14367865976654557329', time=2024-09-14T13:15:25.402471+0000, chain.objs.size()=1 2024-09-14T11:22:50.402 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.396+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.F5zTAaNf93nKw2tXsOUnWRdHTr8FlVz_0 2024-09-14T11:22:50.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.396+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13640409131758122296', time=2024-09-14T13:15:25.414008+0000, chain.objs.size()=1 2024-09-14T11:22:50.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.396+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.R3d_MMuUa_gL-QBaqzvtL9h7HFwn8YL_0 2024-09-14T11:22:50.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.396+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2185456761277973975', time=2024-09-14T13:15:25.423349+0000, chain.objs.size()=1 2024-09-14T11:22:50.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.396+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.KtSqZwHEB_Vuunz48BgRlpY9_EYCYxi_0 2024-09-14T11:22:50.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.396+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5379483710875976514', time=2024-09-14T13:15:25.432889+0000, chain.objs.size()=1 2024-09-14T11:22:50.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.396+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.EjW2Dn2pGsYJZqjJMTLfCBqnaNNBUnI_0 2024-09-14T11:22:50.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.397+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18169520053324387393', time=2024-09-14T13:15:25.434329+0000, chain.objs.size()=1 2024-09-14T11:22:50.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.397+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.nf-KPgIP4chLNV1Iz0vG3H-Yf_wSjd8_0 2024-09-14T11:22:50.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.397+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17696573808015772253', time=2024-09-14T13:15:25.452237+0000, chain.objs.size()=1 2024-09-14T11:22:50.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.397+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.MKNy4X6NTIeH1NZfPnQNRTbUmH0Q36M_0 2024-09-14T11:22:50.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.397+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13677322701732047064', time=2024-09-14T13:15:25.559796+0000, chain.objs.size()=1 2024-09-14T11:22:50.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.397+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.nvIRDkbl7FHtV36OkWToJZS5-XI0dXF_0 2024-09-14T11:22:50.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.397+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18373039027752742643', time=2024-09-14T13:15:25.602200+0000, chain.objs.size()=1 2024-09-14T11:22:50.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.397+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.-mUOKs7s7Elq6knOF7ESn9AucFBrNSQ_0 2024-09-14T11:22:50.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.397+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10258068507380172642', time=2024-09-14T13:15:25.688153+0000, chain.objs.size()=1 2024-09-14T11:22:50.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.397+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.bOzoraa9HdP7Jlz7AQplrcIDPusbPq__0 2024-09-14T11:22:50.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.398+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15684732180436318418', time=2024-09-14T13:15:25.714642+0000, chain.objs.size()=1 2024-09-14T11:22:50.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.398+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.nTV7T-mr8eURd1dimlrlwweLnc11Yob_0 2024-09-14T11:22:50.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.398+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9796408755648052374', time=2024-09-14T13:15:25.732926+0000, chain.objs.size()=1 2024-09-14T11:22:50.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.398+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.Wbp68jijmAkGxOWBvCy-nWrBAp68Tf2_0 2024-09-14T11:22:50.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.398+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18374025733343431612', time=2024-09-14T13:15:25.892167+0000, chain.objs.size()=1 2024-09-14T11:22:50.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.398+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.lcVStrFKCl16JDmyprznaMhyiyZescr_0 2024-09-14T11:22:50.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.398+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.815453066131492141', time=2024-09-14T13:15:25.895861+0000, chain.objs.size()=1 2024-09-14T11:22:50.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.398+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.lmzkH7plcLJ-kHy_y9IHBP7crxgoV5Y_0 2024-09-14T11:22:50.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.398+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6857251362486089130', time=2024-09-14T13:15:25.916738+0000, chain.objs.size()=1 2024-09-14T11:22:50.404 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.398+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.lwSxqNmbmpziD8uVrKyp-i44fwMfFsf_0 2024-09-14T11:22:50.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.398+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2185014745554717085', time=2024-09-14T13:15:25.927906+0000, chain.objs.size()=1 2024-09-14T11:22:50.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.398+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.kZW8YPcJMGw5Cd3MgQGULCZo3UFzOUV_0 2024-09-14T11:22:50.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.398+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1180814621871808386', time=2024-09-14T13:15:25.932665+0000, chain.objs.size()=1 2024-09-14T11:22:50.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.398+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.CnnBOmKuJi9xgvqP3dNMCn-OBl7FTRJ_0 2024-09-14T11:22:50.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.398+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8973750155476150134', time=2024-09-14T13:15:33.174965+0000, chain.objs.size()=1 2024-09-14T11:22:50.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.398+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.wfzUH2I1jgSfBTiJamANYEAg-JnaEMz_0 2024-09-14T11:22:50.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.398+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16612932061217842467', time=2024-09-14T13:15:33.177703+0000, chain.objs.size()=1 2024-09-14T11:22:50.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.398+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.kIrD5qgZNOSn0xZy5tfGF5sfYynFLUB_0 2024-09-14T11:22:50.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.399+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13652372558279961793', time=2024-09-14T13:15:33.193348+0000, chain.objs.size()=1 2024-09-14T11:22:50.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.399+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Bi1_nZPtVluSCCnSYdpXyDez79e9k6T_0 2024-09-14T11:22:50.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.400+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16678892179003212062', time=2024-09-14T13:15:33.225433+0000, chain.objs.size()=1 2024-09-14T11:22:50.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.400+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Sfl38j3qzBtQ2c5Kp5bhRMAafSIzvwE_0 2024-09-14T11:22:50.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.400+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2719904621371200206', time=2024-09-14T13:15:33.393299+0000, chain.objs.size()=1 2024-09-14T11:22:50.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.400+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.qvxvUWnOPd2bLrhEb0TS50xLdLjgLWD_0 2024-09-14T11:22:50.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.400+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1376051992732697074', time=2024-09-14T13:15:33.427642+0000, chain.objs.size()=1 2024-09-14T11:22:50.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.400+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.zaOixWcId8TgY7BrTrPBmykPTVOaPQz_0 2024-09-14T11:22:50.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.401+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1757418336770084723', time=2024-09-14T13:15:33.445798+0000, chain.objs.size()=1 2024-09-14T11:22:50.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.401+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.t2RdyujusR2znlQJeDLQ4xKxavJXqgl_0 2024-09-14T11:22:50.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.401+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17856644110891266031', time=2024-09-14T13:15:33.532333+0000, chain.objs.size()=1 2024-09-14T11:22:50.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.401+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.sWnwk9EGs4CEmSa5VskL45MdoceJwys_0 2024-09-14T11:22:50.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.401+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10243357409863580169', time=2024-09-14T13:15:33.580184+0000, chain.objs.size()=1 2024-09-14T11:22:50.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.401+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.NQcF2mOvwZmO8U7yDbIduq5jXv46P-F_0 2024-09-14T11:22:50.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.401+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17973098821298687553', time=2024-09-14T13:15:33.596229+0000, chain.objs.size()=1 2024-09-14T11:22:50.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.401+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.IVsDsQMA85HalwYT2bJtAYqJn0TXeIX_0 2024-09-14T11:22:50.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.402+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1283845008444140447', time=2024-09-14T13:15:33.602030+0000, chain.objs.size()=1 2024-09-14T11:22:50.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.402+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.lVqnLt02NXeR43YP0qDMbPxAQI4thsE_0 2024-09-14T11:22:50.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.402+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2755844585507182499', time=2024-09-14T13:15:33.603295+0000, chain.objs.size()=1 2024-09-14T11:22:50.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.402+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.bmZxyyhm4rLaIk908PrD0dQjR1ngtHj_0 2024-09-14T11:22:50.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.402+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6735089607346954045', time=2024-09-14T13:15:33.751106+0000, chain.objs.size()=1 2024-09-14T11:22:50.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.402+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.PIPkvl62crNMRX8CujM2QCm1YVbo0B9_0 2024-09-14T11:22:50.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.402+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8718042841933341497', time=2024-09-14T13:15:33.861222+0000, chain.objs.size()=1 2024-09-14T11:22:50.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.402+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.cee9lQOHHpkI8PD1ul2vmg1k0fb2hN7_0 2024-09-14T11:22:50.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.402+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.162007414856748269', time=2024-09-14T13:15:33.893281+0000, chain.objs.size()=1 2024-09-14T11:22:50.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.402+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.iUWBJFSFFp2uKQyvvP9IPY8uqRa-UZj_0 2024-09-14T11:22:50.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.402+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1867782675762432635', time=2024-09-14T13:15:33.902391+0000, chain.objs.size()=1 2024-09-14T11:22:50.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.402+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.k2MpVIoiupyIaak-qugoHUKqGbt-R5z_0 2024-09-14T11:22:50.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.402+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14850021676723913082', time=2024-09-14T13:15:33.903407+0000, chain.objs.size()=1 2024-09-14T11:22:50.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.402+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Sd3Ytil5mheKWtYpn1xBWD0qLeiPH-a_0 2024-09-14T11:22:50.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.402+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2775366816336451953', time=2024-09-14T13:15:33.929126+0000, chain.objs.size()=1 2024-09-14T11:22:50.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.402+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.G5LnbbI2gyW0vhECmt0vY0v9TBEp6Hn_0 2024-09-14T11:22:50.411 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.404+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 0/46045 2024-09-14T11:22:50.411 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.406+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=28, truncated=0, next_marker='' 2024-09-14T11:22:50.411 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.406+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2987594779134944366', time=2024-09-14T13:15:34.027357+0000, chain.objs.size()=1 2024-09-14T11:22:50.411 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.406+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_._FIN4LIKDQ1fEAy6v4I6JMSuQz6Pa_h_0 2024-09-14T11:22:50.411 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.406+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8550005610879276506', time=2024-09-14T13:15:34.030098+0000, chain.objs.size()=1 2024-09-14T11:22:50.411 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.406+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.ZHfFbZ08sYQrbsqUWlVgP40jepE3NI6_0 2024-09-14T11:22:50.411 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.406+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14769879622713607450', time=2024-09-14T13:15:34.177990+0000, chain.objs.size()=1 2024-09-14T11:22:50.411 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.406+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.yrnnJdYezA3xkEgb4vDyLvgkRqNikmm_0 2024-09-14T11:22:50.411 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.406+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11214843759341233341', time=2024-09-14T13:15:34.195857+0000, chain.objs.size()=1 2024-09-14T11:22:50.411 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.406+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Ewh8t8aBJ2YLVj6A5_nbu0DvcwdogSi_0 2024-09-14T11:22:50.411 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.406+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7488029233790347385', time=2024-09-14T13:15:34.208015+0000, chain.objs.size()=1 2024-09-14T11:22:50.411 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.406+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.OBHwFBh6ODT5vxkbVmvjVkwucPoeUI__0 2024-09-14T11:22:50.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.406+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1507576338742392555', time=2024-09-14T13:15:34.209158+0000, chain.objs.size()=1 2024-09-14T11:22:50.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.406+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.9shgKwEuVG3puW3WOyY_hvkeX3Tr4rX_0 2024-09-14T11:22:50.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.406+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11364084530966658823', time=2024-09-14T13:15:34.236449+0000, chain.objs.size()=1 2024-09-14T11:22:50.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.406+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.CVGgd3m-rdxnWF5DXv5Fkf0-k7EbL85_0 2024-09-14T11:22:50.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.406+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3382349424834806048', time=2024-09-14T13:15:34.332076+0000, chain.objs.size()=1 2024-09-14T11:22:50.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.406+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.LhG99XY2R2mFWFaC4dkgfYu4G_emGSD_0 2024-09-14T11:22:50.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.406+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11373215999248431935', time=2024-09-14T13:15:34.342191+0000, chain.objs.size()=1 2024-09-14T11:22:50.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.406+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.mfAEODDYiV8tG1B67YxTpLIL7z2GPLl_0 2024-09-14T11:22:50.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.406+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7174027739124731533', time=2024-09-14T13:15:34.360185+0000, chain.objs.size()=1 2024-09-14T11:22:50.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.406+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.PrU222VfQn9AfgE9AmWYGHmkTHb2vtH_0 2024-09-14T11:22:50.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.406+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5394927653659707920', time=2024-09-14T13:15:34.369041+0000, chain.objs.size()=1 2024-09-14T11:22:50.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.406+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.vAWlvNAezys220sXC3RwrJqGnXcRPnA_0 2024-09-14T11:22:50.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.406+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12936265940478482573', time=2024-09-14T13:15:34.394779+0000, chain.objs.size()=1 2024-09-14T11:22:50.412 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.406+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.CwgqPQ7nD-2admLgErxxCe53Cry_voL_0 2024-09-14T11:22:50.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.408+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11225869791177768849', time=2024-09-14T13:15:36.254190+0000, chain.objs.size()=1 2024-09-14T11:22:50.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.408+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.332__shadow_.leu0p3abTLnG12-A4DT8T443DJf6M1Y_0 2024-09-14T11:22:50.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.408+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11876428918373452865', time=2024-09-14T13:16:11.846157+0000, chain.objs.size()=1 2024-09-14T11:22:50.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.408+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.461__shadow_.CD7XKxQpkAftEAtivxRwBxvBXHoQybQ_0 2024-09-14T11:22:50.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.408+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12075546633573124779', time=2024-09-14T13:16:21.571048+0000, chain.objs.size()=1 2024-09-14T11:22:50.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.408+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.499__shadow_.GcKiPXZeC5XnBIWMPgbydOASuPZ0FCU_0 2024-09-14T11:22:50.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.408+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14880008355136239020', time=2024-09-14T13:16:25.788619+0000, chain.objs.size()=1 2024-09-14T11:22:50.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.408+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.512__shadow_.5r6H7Hg8CjIz0kn-X7I6iF7cPHoJ1AV_0 2024-09-14T11:22:50.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.408+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12570127953801850113', time=2024-09-14T13:16:37.510583+0000, chain.objs.size()=3 2024-09-14T11:22:50.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.408+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.525__multipart_mymultipart.2~BrmZNQtBmsE9-EMzAd5cuJ3YhZ4BgtM.1 2024-09-14T11:22:50.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.408+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.525__multipart_mymultipart.2~BrmZNQtBmsE9-EMzAd5cuJ3YhZ4BgtM.2 2024-09-14T11:22:50.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.408+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.525__multipart_mymultipart.2~BrmZNQtBmsE9-EMzAd5cuJ3YhZ4BgtM.3 2024-09-14T11:22:50.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.408+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11575499497338604984', time=2024-09-14T13:17:09.791501+0000, chain.objs.size()=1 2024-09-14T11:22:50.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.408+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.550__shadow_.6B1PzzQQvMRDbPMt_U4_jS5rlSudal0_0 2024-09-14T11:22:50.413 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.409+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7919374209843431922', time=2024-09-14T13:17:14.039892+0000, chain.objs.size()=1 2024-09-14T11:22:50.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.409+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.559__shadow_.-xFO5c6f4LDoxXFt_74a_2GV3GZyb1i_0 2024-09-14T11:22:50.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.409+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3683503498039576324', time=2024-09-14T13:17:31.687193+0000, chain.objs.size()=1 2024-09-14T11:22:50.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.409+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.575__shadow_.ZSnIBCsuuxS1OnV3kVDsVKJ5Y929v6s_0 2024-09-14T11:22:50.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.409+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12290304431362919207', time=2024-09-14T13:17:33.413136+0000, chain.objs.size()=1 2024-09-14T11:22:50.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.409+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.576__shadow:xmL1IuWvTz1OrLxG13qt1aFhWJLvVxy_.UQj2K5kTiD3MRUjG8j9YyxLXX_e6Zf-_0 2024-09-14T11:22:50.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.410+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16102836184095490181', time=2024-09-14T13:17:46.699048+0000, chain.objs.size()=1 2024-09-14T11:22:50.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.410+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.577__shadow:0AK75jv9W0nF5tuUXXlPBPq3Oznz6Ql_.-lRCPxMDqPOWtJzCYXrqzPLdJn3ew8d_0 2024-09-14T11:22:50.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.410+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7059382454616596416', time=2024-09-14T13:17:47.406648+0000, chain.objs.size()=1 2024-09-14T11:22:50.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.410+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.577__shadow:SahAPVudOB2CDepCLFHuYKDfqNLrO.x_._3OYfNclR_HNQCURiqymz9467l-h2-F_0 2024-09-14T11:22:50.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.411+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7201547358278980746', time=2024-09-14T13:17:51.830313+0000, chain.objs.size()=1 2024-09-14T11:22:50.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.411+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.583__shadow:gMACZfDK1dfXq9I-Mv3tXTLPXAH.siO_.BjOzOtGCnikKlGg4rm7CmkRXf-2L7QC_0 2024-09-14T11:22:50.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.411+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4302321370232718070', time=2024-09-14T13:17:53.498495+0000, chain.objs.size()=1 2024-09-14T11:22:50.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.411+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.587__shadow:U8kg4Iap1Fnj7s62SugCgjvy6.HcYir_.wQCyFTqxsqhpi1cjd4Ta1qkZnEHMf5W_0 2024-09-14T11:22:50.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.411+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5354931978150449968', time=2024-09-14T13:20:20.779787+0000, chain.objs.size()=1 2024-09-14T11:22:50.415 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.411+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.665__shadow_.hQjzRqSU_ICBmXmPw2yEzs_6QxGF_jB_0 2024-09-14T11:22:50.415 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.411+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11764059552698057949', time=2024-09-14T13:20:28.046154+0000, chain.objs.size()=1 2024-09-14T11:22:50.415 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.411+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.695__shadow_.LjyiSS0Z9xIO-K369HTVYyRqwvXsVTt_0 2024-09-14T11:22:50.415 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.411+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9104970806266749649', time=2024-09-14T13:21:10.459094+0000, chain.objs.size()=1 2024-09-14T11:22:50.415 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.412+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.763__shadow_.TF4mTostL9frgilxzBgVrpa2iGnoLN8_0 2024-09-14T11:22:50.415 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.413+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:50.415 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.415+0000 7f0f19c16800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:22:50.415 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.416+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:50.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.417+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:50.418 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.418+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46456' 2024-09-14T11:22:50.418 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.418+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14205108877979634960', time=2024-09-14T13:13:34.358487+0000, chain.objs.size()=3 2024-09-14T11:22:50.418 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.418+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.159__multipart_mymultipart-STANDARD.2~Xg0WluZ35xFD2PU0Ez78EJo-u7By2-K.1 2024-09-14T11:22:50.418 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.418+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.159__multipart_mymultipart-STANDARD.2~Xg0WluZ35xFD2PU0Ez78EJo-u7By2-K.2 2024-09-14T11:22:50.418 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.418+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.159__multipart_mymultipart-STANDARD.2~Xg0WluZ35xFD2PU0Ez78EJo-u7By2-K.3 2024-09-14T11:22:50.418 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.418+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1043528834943941658', time=2024-09-14T13:13:36.073596+0000, chain.objs.size()=3 2024-09-14T11:22:50.418 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.418+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.161__multipart_foo-LUKEWARM.2~KoJMlyMryAZ6ucwnse8DPYhC4LcyJM-.1 2024-09-14T11:22:50.418 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.418+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.161__multipart_foo-LUKEWARM.2~KoJMlyMryAZ6ucwnse8DPYhC4LcyJM-.2 2024-09-14T11:22:50.418 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.418+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.161__multipart_foo-LUKEWARM.2~KoJMlyMryAZ6ucwnse8DPYhC4LcyJM-.3 2024-09-14T11:22:50.418 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.418+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2841643565883629580', time=2024-09-14T13:13:44.912086+0000, chain.objs.size()=1 2024-09-14T11:22:50.418 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.418+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.181__shadow_.OPFw5q-36zlq8kCWQ3nbjPaNGt1aNc__0 2024-09-14T11:22:50.418 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.418+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7645414246264246931', time=2024-09-14T13:13:51.771463+0000, chain.objs.size()=1 2024-09-14T11:22:50.419 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.418+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.200__shadow_.uiK5Wl6tBHDWxe3dEmCF8qF8AxhRt07_0 2024-09-14T11:22:50.419 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.418+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16745132887050270184', time=2024-09-14T13:14:45.911091+0000, chain.objs.size()=1 2024-09-14T11:22:50.419 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.418+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.236__shadow_.CEf8shQI1ULEs8c4nuRTtzmDC3PaADi_0 2024-09-14T11:22:50.419 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.418+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2909362370575065743', time=2024-09-14T13:14:50.602087+0000, chain.objs.size()=1 2024-09-14T11:22:50.419 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.418+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.253__shadow_.fcf1fnRDRv2LCxzlV7cTypY7iOlI-n8_0 2024-09-14T11:22:50.419 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.418+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5480913163778002128', time=2024-09-14T13:14:52.080856+0000, chain.objs.size()=1 2024-09-14T11:22:50.419 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.418+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.259__shadow_.ALi83gewf2vqxJiUHdrY44z26oXdOUf_0 2024-09-14T11:22:50.419 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.418+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17545116629090176912', time=2024-09-14T13:14:59.734339+0000, chain.objs.size()=1 2024-09-14T11:22:50.419 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.418+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.pGS_FKwnDg_Ji0mEFh4DP5AjWHL4c4j_0 2024-09-14T11:22:50.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.421+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.503579460944873941', time=2024-09-14T13:14:59.765092+0000, chain.objs.size()=1 2024-09-14T11:22:50.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.421+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.e0iJwpA1L8ESghfHCk3Kean0lgdCMzR_0 2024-09-14T11:22:50.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.421+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17736328411566644172', time=2024-09-14T13:14:59.792586+0000, chain.objs.size()=1 2024-09-14T11:22:50.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.421+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.2v5_KHWd5N2Oi0-4vRInYiZf4ECa3bK_0 2024-09-14T11:22:50.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.421+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1374409187098558033', time=2024-09-14T13:14:59.914340+0000, chain.objs.size()=1 2024-09-14T11:22:50.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.421+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.ItABrbjLacKd8gHGE3jlCqrhmusSL-O_0 2024-09-14T11:22:50.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.422+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9650196801481719334', time=2024-09-14T13:14:59.926704+0000, chain.objs.size()=1 2024-09-14T11:22:50.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.422+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.vVDRXwSzdkOveidQG8ahOCIjlL4GH4P_0 2024-09-14T11:22:50.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.422+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17396853079693439951', time=2024-09-14T13:14:59.928919+0000, chain.objs.size()=1 2024-09-14T11:22:50.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.422+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.oUUP6owOTlrroWwXTTRPNNUlN7LXTnY_0 2024-09-14T11:22:50.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.422+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12751083314916676158', time=2024-09-14T13:14:59.950995+0000, chain.objs.size()=1 2024-09-14T11:22:50.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.422+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.RX8FmY1K8vlex7GBOogL08He-4HRq-e_0 2024-09-14T11:22:50.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.422+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13821291720525097530', time=2024-09-14T13:14:59.974642+0000, chain.objs.size()=1 2024-09-14T11:22:50.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.422+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.elVUlb4ejBcRgCnJIFt7XwF2Z4kcqIY_0 2024-09-14T11:22:50.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.422+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5289044692842960674', time=2024-09-14T13:14:59.980394+0000, chain.objs.size()=1 2024-09-14T11:22:50.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.422+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.PcR5IEBjc4IKGgPtxZHUQRfMDWoZqy__0 2024-09-14T11:22:50.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.422+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7130540524233739617', time=2024-09-14T13:14:59.987505+0000, chain.objs.size()=1 2024-09-14T11:22:50.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.422+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.fIdvi2YQoU8kY327LcVsbA3k4aMRSvw_0 2024-09-14T11:22:50.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.422+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8807542614135662862', time=2024-09-14T13:15:00.077394+0000, chain.objs.size()=1 2024-09-14T11:22:50.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.422+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.ku0DjniIry9U_mmdLz-w-LJKQZb5ZI0_0 2024-09-14T11:22:50.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.422+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17270501510367741169', time=2024-09-14T13:15:00.087859+0000, chain.objs.size()=1 2024-09-14T11:22:50.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.422+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.HqoZhUfghDiD2ULEvoAJEfEHHSX9KB2_0 2024-09-14T11:22:50.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.422+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4813492870202049403', time=2024-09-14T13:15:00.230176+0000, chain.objs.size()=1 2024-09-14T11:22:50.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.422+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.rJ2qUEhpKoVFUsmocHw8E2Pzx041Fo4_0 2024-09-14T11:22:50.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.422+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13208771803583351345', time=2024-09-14T13:15:00.242276+0000, chain.objs.size()=1 2024-09-14T11:22:50.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.422+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.dQTZ4pfDeAOS62vJmjTEKVIMWjh5J0N_0 2024-09-14T11:22:50.423 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.422+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14860741348293324063', time=2024-09-14T13:15:00.248895+0000, chain.objs.size()=1 2024-09-14T11:22:50.423 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.422+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.2yTokPSoApxsxqzA1QksXk-D25Q9yvL_0 2024-09-14T11:22:50.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.423+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17336605731876008423', time=2024-09-14T13:15:00.288874+0000, chain.objs.size()=1 2024-09-14T11:22:50.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.423+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.vE_yKeMDInDC53X_51dZ3bI_17Fq1AZ_0 2024-09-14T11:22:50.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.423+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10855083780290382923', time=2024-09-14T13:15:00.404735+0000, chain.objs.size()=1 2024-09-14T11:22:50.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.423+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.hE5OMgRpx0Q6X4SqNRE7LQ6K4M1f00g_0 2024-09-14T11:22:50.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.424+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10577357633496512992', time=2024-09-14T13:15:00.434202+0000, chain.objs.size()=1 2024-09-14T11:22:50.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.424+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.CfnrOc-ert93VQMe0LoGgVRhL-w1rZh_0 2024-09-14T11:22:50.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.424+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9471015372378692510', time=2024-09-14T13:15:00.436617+0000, chain.objs.size()=1 2024-09-14T11:22:50.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.424+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.3DfyCATAlsM5ACxyeYPH4qHqNhpyPgW_0 2024-09-14T11:22:50.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.424+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7394139079449137129', time=2024-09-14T13:15:00.450623+0000, chain.objs.size()=1 2024-09-14T11:22:50.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.424+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.YBBOOCRrYNtlt3efWljizsxjNdMqc4f_0 2024-09-14T11:22:50.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.424+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5571712461519533225', time=2024-09-14T13:15:00.463104+0000, chain.objs.size()=1 2024-09-14T11:22:50.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.424+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.kdS2R18TWYCcWA-_LCnIJZoL_qz_Nul_0 2024-09-14T11:22:50.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.425+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10717124350387865566', time=2024-09-14T13:15:00.475297+0000, chain.objs.size()=1 2024-09-14T11:22:50.425 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.425+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.ZT40jcPnF7YbBxJzF4pkT8SDOltfygd_0 2024-09-14T11:22:50.425 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.425+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13103364213466913791', time=2024-09-14T13:15:00.554656+0000, chain.objs.size()=1 2024-09-14T11:22:50.425 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.425+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.I6lneqB5xfY5SAQB_zQDIc2PZ34UHMl_0 2024-09-14T11:22:50.425 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.425+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.471456221446737943', time=2024-09-14T13:15:00.602084+0000, chain.objs.size()=1 2024-09-14T11:22:50.425 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.425+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.OXqizizvyKnoiO7LPmcWlZXnaIOMBJG_0 2024-09-14T11:22:50.425 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.425+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16633848734958860606', time=2024-09-14T13:15:00.618896+0000, chain.objs.size()=1 2024-09-14T11:22:50.425 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.425+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.jbG8d1PONjG8mVMI6luvd4kvZSrMl3t_0 2024-09-14T11:22:50.425 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.425+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6661102397010338795', time=2024-09-14T13:15:00.622153+0000, chain.objs.size()=1 2024-09-14T11:22:50.425 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.425+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Z_uH1ADsjOBI_DkJHnZV7r8M8YMlUuu_0 2024-09-14T11:22:50.426 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.426+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11328484269189851141', time=2024-09-14T13:15:00.633386+0000, chain.objs.size()=1 2024-09-14T11:22:50.426 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.426+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.bC8X5fHKQRgpz01GzHYNgzzPtij3aM8_0 2024-09-14T11:22:50.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.426+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8144114592622086917', time=2024-09-14T13:15:00.636173+0000, chain.objs.size()=1 2024-09-14T11:22:50.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.426+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.ldztUOUcUu0IpuX9QwGKjRgrtS4WcLc_0 2024-09-14T11:22:50.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.426+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11610921864472870246', time=2024-09-14T13:15:00.638919+0000, chain.objs.size()=1 2024-09-14T11:22:50.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.426+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.yCuxsT07qzlyMu0jfh38J8Cl-Ruh_p0_0 2024-09-14T11:22:50.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.426+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7406795719117238638', time=2024-09-14T13:15:00.747769+0000, chain.objs.size()=1 2024-09-14T11:22:50.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.426+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.d8OAOohUiYd5SfAHzT0Cdn38Uyk5gpj_0 2024-09-14T11:22:50.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.426+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5239768003562884049', time=2024-09-14T13:15:00.768413+0000, chain.objs.size()=1 2024-09-14T11:22:50.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.426+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.e2u0GnozS3vkhkA5IJoJYPLVVen04iJ_0 2024-09-14T11:22:50.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.426+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15365055741875743641', time=2024-09-14T13:15:00.792856+0000, chain.objs.size()=1 2024-09-14T11:22:50.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.426+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.0AHAE8VBzDsB8-LDFXWtbs1rtNqL8w7_0 2024-09-14T11:22:50.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.426+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15586247586315657952', time=2024-09-14T13:15:00.874945+0000, chain.objs.size()=1 2024-09-14T11:22:50.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.426+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Px2NjpMmUPoSbAEU7Rr0yewxKc5dmF0_0 2024-09-14T11:22:50.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.427+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6704964342140394205', time=2024-09-14T13:15:00.878122+0000, chain.objs.size()=1 2024-09-14T11:22:50.428 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.427+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.I69j0_ZD4ym9KLhvO41VDL-GeINdyVC_0 2024-09-14T11:22:50.428 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.427+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16839784012472052314', time=2024-09-14T13:15:00.929916+0000, chain.objs.size()=1 2024-09-14T11:22:50.428 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.427+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.jFG_aJON0mCr03EfGK3MK67UumkInqe_0 2024-09-14T11:22:50.428 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.427+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3217541731664707662', time=2024-09-14T13:15:04.149017+0000, chain.objs.size()=1 2024-09-14T11:22:50.428 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.427+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.275__shadow_.9fijczV_CFfsz9t1VgS5JfDASDGXvLh_0 2024-09-14T11:22:50.428 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.427+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9647441135342763033', time=2024-09-14T13:15:04.967247+0000, chain.objs.size()=1 2024-09-14T11:22:50.428 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.427+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.278__shadow_.zKNfMpIqwiGbngdaQ8VfBv_ddTmr9WI_0 2024-09-14T11:22:50.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.428+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11406861698455320854', time=2024-09-14T13:15:04.968067+0000, chain.objs.size()=1 2024-09-14T11:22:50.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.428+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.278__shadow_.JqwryZ9Gbkqu6NUFP9rHFwJxZeaKdyp_0 2024-09-14T11:22:50.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.428+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4630683544028524927', time=2024-09-14T13:15:07.549039+0000, chain.objs.size()=1 2024-09-14T11:22:50.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.428+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.287__shadow_.cto4k6EWz1xLrsCqGqLewMgROZTyG8O_0 2024-09-14T11:22:50.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.428+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12859548155398203874', time=2024-09-14T13:15:08.295511+0000, chain.objs.size()=1 2024-09-14T11:22:50.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.428+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.290__shadow_.QSiASGF2saJU73eBwGrNNSGtP4esI8y_0 2024-09-14T11:22:50.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.428+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.592123531020529492', time=2024-09-14T13:15:09.248286+0000, chain.objs.size()=1 2024-09-14T11:22:50.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.428+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.292__shadow_.m1KNaidDsWlU3OX_GDB6vBPGRcT0rf-_0 2024-09-14T11:22:50.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.428+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17052621401539132491', time=2024-09-14T13:15:09.256868+0000, chain.objs.size()=1 2024-09-14T11:22:50.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.428+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.292__shadow_.4QH78_JqO0-Pr5qux0i4O28GfbvYlcO_0 2024-09-14T11:22:50.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.428+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12029479409490246956', time=2024-09-14T13:15:09.839896+0000, chain.objs.size()=1 2024-09-14T11:22:50.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.428+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.293__shadow_.AXh6zlcjeIbWfdMCRRLKsCPgRzCDzN8_0 2024-09-14T11:22:50.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.428+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17987897949153866208', time=2024-09-14T13:15:11.152351+0000, chain.objs.size()=1 2024-09-14T11:22:50.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.428+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.298__shadow_.Q0JUlLELcCx9Me7Ukm92w1yniYlHlwA_0 2024-09-14T11:22:50.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.428+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.86287964082128340', time=2024-09-14T13:15:24.740679+0000, chain.objs.size()=1 2024-09-14T11:22:50.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.428+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.fL7GU0UscsFy5Xvq_3LOPXloX6Nw6d3_0 2024-09-14T11:22:50.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.428+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1239526822547827475', time=2024-09-14T13:15:24.781746+0000, chain.objs.size()=1 2024-09-14T11:22:50.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.428+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.wKmrn_nbFH7ReUG5aVNrJ19WjbpISs2_0 2024-09-14T11:22:50.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.428+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5156614406587113101', time=2024-09-14T13:15:24.794616+0000, chain.objs.size()=1 2024-09-14T11:22:50.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.428+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.rrBx61MFd1vzbRzslyF3TvKWrXzeeNW_0 2024-09-14T11:22:50.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.428+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16288304360645048359', time=2024-09-14T13:15:24.802312+0000, chain.objs.size()=1 2024-09-14T11:22:50.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.428+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.5mR6REJ0A_nGpediCVXnFqJbtHjK6H3_0 2024-09-14T11:22:50.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.430+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4161634307662157874', time=2024-09-14T13:15:24.932169+0000, chain.objs.size()=1 2024-09-14T11:22:50.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.430+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.hrejzENDjuaAbm3pC5L2TZy_jM2GdbL_0 2024-09-14T11:22:50.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.431+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13245997959428230693', time=2024-09-14T13:15:24.943084+0000, chain.objs.size()=1 2024-09-14T11:22:50.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.431+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.cae1Chvh_NDPNX7bGD7U2sG4ncM-85x_0 2024-09-14T11:22:50.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.431+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2447813247328781770', time=2024-09-14T13:15:24.963919+0000, chain.objs.size()=1 2024-09-14T11:22:50.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.431+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.mpV5doRBm4Dv1lo69va6I3XCwXtTgK1_0 2024-09-14T11:22:50.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.431+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4903548576584174755', time=2024-09-14T13:15:25.041619+0000, chain.objs.size()=1 2024-09-14T11:22:50.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.431+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.j_lDlc1VBUU4WjaZEtukRX6Z9KuspiL_0 2024-09-14T11:22:50.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.431+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18429031337499851958', time=2024-09-14T13:15:25.043364+0000, chain.objs.size()=1 2024-09-14T11:22:50.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.431+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.alMRmBgXhEICNjAdm6AEAgQ9xh9YdRo_0 2024-09-14T11:22:50.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.431+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12946068683041906655', time=2024-09-14T13:15:25.107021+0000, chain.objs.size()=1 2024-09-14T11:22:50.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.431+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.jc5fPKi2F9HtBmCcPOkELZBpn6rrwHQ_0 2024-09-14T11:22:50.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.431+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10712718272168165698', time=2024-09-14T13:15:25.131037+0000, chain.objs.size()=1 2024-09-14T11:22:50.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.431+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.iOjBhT-gsR8mePQlirSpTpAvvipGIuM_0 2024-09-14T11:22:50.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.431+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13995945505719419', time=2024-09-14T13:15:25.205624+0000, chain.objs.size()=1 2024-09-14T11:22:50.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.431+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.68KOL2AuUicKrnvMRhFcNekpoI5H63R_0 2024-09-14T11:22:50.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.432+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5685323610741957609', time=2024-09-14T13:15:25.218017+0000, chain.objs.size()=1 2024-09-14T11:22:50.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.432+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.kGmidJwFMKYIl_F30JKd0TfLdf3tKt0_0 2024-09-14T11:22:50.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.432+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5601679380780174304', time=2024-09-14T13:15:25.262376+0000, chain.objs.size()=1 2024-09-14T11:22:50.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.432+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.BdRCzcv9DkxYMEvuRIW92VsjE5RMyvK_0 2024-09-14T11:22:50.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.432+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7819471988396148989', time=2024-09-14T13:15:25.270409+0000, chain.objs.size()=1 2024-09-14T11:22:50.435 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.432+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.1_Xq-aQeedFEXlUlvRPVMFA-xlj_-w2_0 2024-09-14T11:22:50.436 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.432+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5740140623556079142', time=2024-09-14T13:15:25.380281+0000, chain.objs.size()=1 2024-09-14T11:22:50.436 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.432+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.j1OOWdfdaxuOAzUgmPrngeglGBdaGzy_0 2024-09-14T11:22:50.436 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.433+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9149450598014669036', time=2024-09-14T13:15:25.388467+0000, chain.objs.size()=1 2024-09-14T11:22:50.436 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.433+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.MlKxYuhPQflykMQ9ekhbAVPzhio8aaT_0 2024-09-14T11:22:50.436 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.433+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4625410947228488688', time=2024-09-14T13:15:25.406329+0000, chain.objs.size()=1 2024-09-14T11:22:50.436 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.433+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.M25-rARchf1OSIbNonISJ56BcVEvMSd_0 2024-09-14T11:22:50.436 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.433+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13790544854869881869', time=2024-09-14T13:15:25.437053+0000, chain.objs.size()=1 2024-09-14T11:22:50.436 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.433+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.PONj71Dr2dzWMmF7JCCxMg7sdSuhyOJ_0 2024-09-14T11:22:50.436 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.434+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13073936029054948622', time=2024-09-14T13:15:25.442242+0000, chain.objs.size()=1 2024-09-14T11:22:50.436 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.434+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.8wx1Ii93p00z8Tq0wEsOo4OkFarxei4_0 2024-09-14T11:22:50.436 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.434+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9032879581130196681', time=2024-09-14T13:15:25.443346+0000, chain.objs.size()=1 2024-09-14T11:22:50.436 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.434+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.91p4RmXH3zR4dmnOF1aGEAO5ro3u9Qz_0 2024-09-14T11:22:50.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.434+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2359969447085876789', time=2024-09-14T13:15:25.451346+0000, chain.objs.size()=1 2024-09-14T11:22:50.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.434+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.SDO39a6P482C0wVLCSEMw76_NxSonF6_0 2024-09-14T11:22:50.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.435+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16728462740835295825', time=2024-09-14T13:15:25.527612+0000, chain.objs.size()=1 2024-09-14T11:22:50.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.435+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.QFAX_rxzS9HkqpoxeKrDF5mnQ99l4yy_0 2024-09-14T11:22:50.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.435+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2174310151586003423', time=2024-09-14T13:15:25.529120+0000, chain.objs.size()=1 2024-09-14T11:22:50.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.435+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.zsvIZY19yhQcCqeu6SVawrLtMJTte5D_0 2024-09-14T11:22:50.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.435+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5324419260912143062', time=2024-09-14T13:15:25.529933+0000, chain.objs.size()=1 2024-09-14T11:22:50.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.435+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.pm1PV14NmVWhuPifHyqhrrFytnZUyzL_0 2024-09-14T11:22:50.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.435+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1746545176900813279', time=2024-09-14T13:15:25.551271+0000, chain.objs.size()=1 2024-09-14T11:22:50.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.435+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.D3ujFQHFkabBNcogSLS4YqWI7EHDcg5_0 2024-09-14T11:22:50.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.435+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13174852222906172265', time=2024-09-14T13:15:25.573888+0000, chain.objs.size()=1 2024-09-14T11:22:50.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.435+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.DpmtTd3NfZHtJuXNIRTlnF22TQ3is-z_0 2024-09-14T11:22:50.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.435+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16391535626557271299', time=2024-09-14T13:15:25.579521+0000, chain.objs.size()=1 2024-09-14T11:22:50.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.435+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.7TgH2tXXnDbZHxlLemJM8R-WSaUjnrk_0 2024-09-14T11:22:50.438 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.435+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15566783155461080993', time=2024-09-14T13:15:25.615481+0000, chain.objs.size()=1 2024-09-14T11:22:50.438 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.435+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.2ulTfCclp7TLqrpNOVJKmgxqZI3m5RP_0 2024-09-14T11:22:50.438 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.435+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5408879891088690624', time=2024-09-14T13:15:25.715577+0000, chain.objs.size()=1 2024-09-14T11:22:50.438 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.435+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.4ijWqJF8cRDr0SMNaGo0_66pfywNXPB_0 2024-09-14T11:22:50.438 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.435+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9026447838748079673', time=2024-09-14T13:15:25.716469+0000, chain.objs.size()=1 2024-09-14T11:22:50.438 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.435+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.KWpROGcGZqXfUtqTPveAhGCdIQdyXQ1_0 2024-09-14T11:22:50.438 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.436+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10755153555437192870', time=2024-09-14T13:15:25.750361+0000, chain.objs.size()=1 2024-09-14T11:22:50.438 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.436+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.n5jk7SmnxFP7_zT1gKsDClNxrNDZB-o_0 2024-09-14T11:22:50.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.436+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4738745360952520874', time=2024-09-14T13:15:25.752112+0000, chain.objs.size()=1 2024-09-14T11:22:50.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.436+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.IPnnMSV3QaD0PWNvhC49anFdr3y7nVI_0 2024-09-14T11:22:50.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.436+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7760242076900888860', time=2024-09-14T13:15:25.941384+0000, chain.objs.size()=1 2024-09-14T11:22:50.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.436+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.MYeMvZ8Lzn_Hjl4d1u8sBinLBnSbB0r_0 2024-09-14T11:22:50.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.436+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12911462361784830905', time=2024-09-14T13:15:33.165847+0000, chain.objs.size()=1 2024-09-14T11:22:50.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.436+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.iWF8obo3Q48569yHPBHxjuh2xct1IUn_0 2024-09-14T11:22:50.441 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.437+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13182957825926495953', time=2024-09-14T13:15:33.207321+0000, chain.objs.size()=1 2024-09-14T11:22:50.441 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.437+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.C1uFEjXTnJOy2io6_IAhi67qnJ6PRuE_0 2024-09-14T11:22:50.441 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.437+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12530580940529751086', time=2024-09-14T13:15:33.249125+0000, chain.objs.size()=1 2024-09-14T11:22:50.441 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.437+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.tbDMmSRZ_Upi6NQcQP2BzB8L5gUQw9i_0 2024-09-14T11:22:50.441 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.437+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5657200550402883143', time=2024-09-14T13:15:33.394148+0000, chain.objs.size()=1 2024-09-14T11:22:50.441 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.437+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.z6DdiLDTTGEvtaTfsLVSTAg_v_AynHk_0 2024-09-14T11:22:50.441 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.437+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9068127923417752635', time=2024-09-14T13:15:33.428122+0000, chain.objs.size()=1 2024-09-14T11:22:50.441 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.437+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.rhW8CFJHMwLOjQVpjbuzWtr_yq857Nu_0 2024-09-14T11:22:50.441 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.437+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15927527295314583575', time=2024-09-14T13:15:33.541718+0000, chain.objs.size()=1 2024-09-14T11:22:50.441 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.437+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.lRgmCYHY3LqwdiR2FTYuVCRKAQWO7DZ_0 2024-09-14T11:22:50.441 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.437+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7127285512699416332', time=2024-09-14T13:15:33.567622+0000, chain.objs.size()=1 2024-09-14T11:22:50.441 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.437+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.K-dTF_oAC8bu2_egqV39YwdyT0ACUZo_0 2024-09-14T11:22:50.441 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.437+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6143809855024464107', time=2024-09-14T13:15:33.689745+0000, chain.objs.size()=1 2024-09-14T11:22:50.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.437+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.xMRUwRZ_2h8x6HNY1sqiBDyWGvGMq8Z_0 2024-09-14T11:22:50.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.437+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18049212175196432166', time=2024-09-14T13:15:33.693511+0000, chain.objs.size()=1 2024-09-14T11:22:50.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.437+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.44_F52rGcxCGxhly89By4anjQ8FZfxS_0 2024-09-14T11:22:50.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.438+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14975679285573192208', time=2024-09-14T13:15:33.745797+0000, chain.objs.size()=1 2024-09-14T11:22:50.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.438+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.jhYJyHs6_A_H0M4HXryI97TETyz2aY0_0 2024-09-14T11:22:50.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.438+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11065344452283754836', time=2024-09-14T13:15:33.758150+0000, chain.objs.size()=1 2024-09-14T11:22:50.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.438+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.yaRJaKu-IqWpTkbiUhxH0DHU8QEmUFJ_0 2024-09-14T11:22:50.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.439+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11519193306777751124', time=2024-09-14T13:15:33.857277+0000, chain.objs.size()=1 2024-09-14T11:22:50.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.439+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.SL4Zbo1pw0PevyF83UhWbQLI14VBHQJ_0 2024-09-14T11:22:50.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.439+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9758552009917620947', time=2024-09-14T13:15:33.862070+0000, chain.objs.size()=1 2024-09-14T11:22:50.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.439+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.PVHt3POQhIcKkG9rheAeaFLJEKGcAJy_0 2024-09-14T11:22:50.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.439+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3040402654950118241', time=2024-09-14T13:15:33.879032+0000, chain.objs.size()=1 2024-09-14T11:22:50.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.440+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.ql-ABkJyysZhCQBep-3DVQxDMq2hMiC_0 2024-09-14T11:22:50.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.440+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15576963924676763924', time=2024-09-14T13:15:33.904608+0000, chain.objs.size()=1 2024-09-14T11:22:50.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.440+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.riMOJHznHlYQPFGeLTBi6zR5NcE0lpv_0 2024-09-14T11:22:50.443 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.441+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 0/46456 2024-09-14T11:22:50.445 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.443+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-14T11:22:50.445 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.443+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10129974810524383569', time=2024-09-14T13:15:33.913023+0000, chain.objs.size()=1 2024-09-14T11:22:50.445 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.443+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.MpIQulUA93vdQaQLi5t36SjX_Vc4EmH_0 2024-09-14T11:22:50.445 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.443+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7869488390649813241', time=2024-09-14T13:15:34.017778+0000, chain.objs.size()=1 2024-09-14T11:22:50.445 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.443+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.HZNIXNGiqrdvLe8SKQDnAfsgIFQ3bAl_0 2024-09-14T11:22:50.445 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.443+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6485583920775221201', time=2024-09-14T13:15:34.050873+0000, chain.objs.size()=1 2024-09-14T11:22:50.445 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.443+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Rhk-lRfRsf6dtSfQNuBxmV_kThGSk3N_0 2024-09-14T11:22:50.445 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.443+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4598397816056079524', time=2024-09-14T13:15:34.067588+0000, chain.objs.size()=1 2024-09-14T11:22:50.445 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.443+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.HP7rYPAigmnZO9uY1yoaCvZxwNHwMF__0 2024-09-14T11:22:50.445 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.443+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12903196971845784493', time=2024-09-14T13:15:34.069097+0000, chain.objs.size()=1 2024-09-14T11:22:50.445 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.443+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.dYd2McDX9pyEGHj7EKNYLfs4xZnRG0__0 2024-09-14T11:22:50.445 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.443+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9118340766127871415', time=2024-09-14T13:15:34.080546+0000, chain.objs.size()=1 2024-09-14T11:22:50.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.443+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.sP_OJ-Wvwwz7Vzw9h1L-0pacEgfhyXw_0 2024-09-14T11:22:50.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.443+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3091630576026927832', time=2024-09-14T13:15:34.233486+0000, chain.objs.size()=1 2024-09-14T11:22:50.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.443+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.qaOUgPQjKpvo3OCFJ3MPfQ1HDai5irJ_0 2024-09-14T11:22:50.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.443+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7380885400295060760', time=2024-09-14T13:15:34.256722+0000, chain.objs.size()=1 2024-09-14T11:22:50.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.443+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Vkia8fI_v3CNWIgcT2_JQEQEt784AIw_0 2024-09-14T11:22:50.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.443+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11083650729701460312', time=2024-09-14T13:15:34.335149+0000, chain.objs.size()=1 2024-09-14T11:22:50.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.443+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Qe3FR4bvCYG58XdAc_fSEUgEGlC3rbd_0 2024-09-14T11:22:50.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.443+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17597799544001491170', time=2024-09-14T13:15:34.358572+0000, chain.objs.size()=1 2024-09-14T11:22:50.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.443+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.ThE5ocNeKoZsvGQXlz1t7RqC2hzRAnF_0 2024-09-14T11:22:50.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.443+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10957658231041521748', time=2024-09-14T13:15:38.371130+0000, chain.objs.size()=1 2024-09-14T11:22:50.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.443+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.340__shadow_.hfZ5IVSftkIg1jKpuUyKhx7ZvGlUT2R_0 2024-09-14T11:22:50.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.443+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12366270984277180387', time=2024-09-14T13:15:39.338613+0000, chain.objs.size()=1 2024-09-14T11:22:50.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.443+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.344__shadow_.8_RhqGItjIQirm62_yHkqwiIzdhmU4P_0 2024-09-14T11:22:50.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.445+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15075339112201843672', time=2024-09-14T13:15:48.581243+0000, chain.objs.size()=1 2024-09-14T11:22:50.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.445+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.381__shadow_.Y4uCO2Ia9wHsyLnigHhNu6x-kkeFpWU_0 2024-09-14T11:22:50.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.445+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.831866805087362400', time=2024-09-14T13:16:13.280101+0000, chain.objs.size()=1 2024-09-14T11:22:50.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.445+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.465__shadow_.HdG5KfzAo7JFpV3h16vY0j4XJXmUqeN_0 2024-09-14T11:22:50.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.445+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14398791067667385172', time=2024-09-14T13:16:13.759258+0000, chain.objs.size()=1 2024-09-14T11:22:50.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.445+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.466__shadow_.NTOxvJ0UHyDJGHFHR-N5GLqHZUDAqNI_0 2024-09-14T11:22:50.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.446+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10300066963287020566', time=2024-09-14T13:16:21.090439+0000, chain.objs.size()=1 2024-09-14T11:22:50.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.446+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.497__shadow_.55X9hp3yWRSX90MOM62enhLj4ru-Kwb_0 2024-09-14T11:22:50.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.446+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17747854400836175769', time=2024-09-14T13:16:24.669091+0000, chain.objs.size()=6 2024-09-14T11:22:50.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.446+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.507__multipart_srcmultipart.2~EQ3ZZNALHrAJsVAZLD-5msuDtyJwYup.1 2024-09-14T11:22:50.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.446+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.507__multipart_srcmultipart.2~EQ3ZZNALHrAJsVAZLD-5msuDtyJwYup.2 2024-09-14T11:22:50.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.446+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.507__multipart_srcmultipart.2~EQ3ZZNALHrAJsVAZLD-5msuDtyJwYup.3 2024-09-14T11:22:50.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.446+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.507__multipart_srcmultipart.2~EQ3ZZNALHrAJsVAZLD-5msuDtyJwYup.4 2024-09-14T11:22:50.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.446+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.507__multipart_srcmultipart.2~EQ3ZZNALHrAJsVAZLD-5msuDtyJwYup.5 2024-09-14T11:22:50.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.446+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.507__multipart_srcmultipart.2~EQ3ZZNALHrAJsVAZLD-5msuDtyJwYup.6 2024-09-14T11:22:50.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.446+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11431739462552138213', time=2024-09-14T13:16:33.120216+0000, chain.objs.size()=6 2024-09-14T11:22:50.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.446+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.522__multipart_mymultipart.2~PjcWKMfDysMo3e08mUnXYYTPLN0IQ6m.1 2024-09-14T11:22:50.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.447+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.522__multipart_mymultipart.7wK52E5F4jmHbdOfr8Nm7vlb8rk9jprY.2 2024-09-14T11:22:50.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.447+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.522__multipart_mymultipart.2~PjcWKMfDysMo3e08mUnXYYTPLN0IQ6m.3 2024-09-14T11:22:50.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.447+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.522__multipart_mymultipart.2~PjcWKMfDysMo3e08mUnXYYTPLN0IQ6m.4 2024-09-14T11:22:50.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.447+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.522__multipart_mymultipart.2~PjcWKMfDysMo3e08mUnXYYTPLN0IQ6m.5 2024-09-14T11:22:50.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.448+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.522__multipart_mymultipart.2~PjcWKMfDysMo3e08mUnXYYTPLN0IQ6m.6 2024-09-14T11:22:50.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.448+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='2~AaNUmwR-K16Tp0LkMc-_kthGWlnNDRO', time=2024-09-14T13:16:41.299832+0000, chain.objs.size()=1 2024-09-14T11:22:50.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.448+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.534__multipart_mymultipart.2~AaNUmwR-K16Tp0LkMc-_kthGWlnNDRO.1 2024-09-14T11:22:50.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.448+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13323222256112871231', time=2024-09-14T13:17:42.919553+0000, chain.objs.size()=1 2024-09-14T11:22:50.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.448+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.577__shadow:Jk3CI1cUYcKmWTNuZ65tqTjbwOEhYzb_.k5PLyrhKotv-zKyO0pc7AhLQzMSn77K_0 2024-09-14T11:22:50.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.448+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3818159522485062041', time=2024-09-14T13:17:44.318498+0000, chain.objs.size()=1 2024-09-14T11:22:50.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.448+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.577__shadow:OWQp8NLdhqGwa4HvE7naNtA14GL7glH_.BVM9aPYnZEMztQu4YJqv8zstvKUE_ht_0 2024-09-14T11:22:50.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.450+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:50.450 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.452+0000 7f0f19c16800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:22:50.451 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.453+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:50.452 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.453+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:50.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.454+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49724' 2024-09-14T11:22:50.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.454+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13596876385562525874', time=2024-09-14T13:13:34.348790+0000, chain.objs.size()=3 2024-09-14T11:22:50.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.454+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.159__multipart_mymultipart-LUKEWARM.2~6Ve3eiATK4Ix_4MyqJKcTbCvhzPP0fE.1 2024-09-14T11:22:50.453 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.454+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.159__multipart_mymultipart-LUKEWARM.2~6Ve3eiATK4Ix_4MyqJKcTbCvhzPP0fE.2 2024-09-14T11:22:50.454 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.454+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.159__multipart_mymultipart-LUKEWARM.2~6Ve3eiATK4Ix_4MyqJKcTbCvhzPP0fE.3 2024-09-14T11:22:50.454 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.454+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4714425736518472733', time=2024-09-14T13:14:44.588820+0000, chain.objs.size()=1 2024-09-14T11:22:50.454 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.454+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.231__shadow_.6JuACL59EUs0Mymi4pxyuca87GjewPC_0 2024-09-14T11:22:50.454 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.454+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11691340381249010545', time=2024-09-14T13:14:45.627629+0000, chain.objs.size()=1 2024-09-14T11:22:50.454 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.454+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.235__shadow_.O0abhrYvxkZhxBFfPlT3W70NtVC5E6r_0 2024-09-14T11:22:50.454 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.454+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18422459943163259554', time=2024-09-14T13:14:46.214186+0000, chain.objs.size()=1 2024-09-14T11:22:50.454 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.454+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.237__shadow_.GJqoRCJG3sOVMj3a9RZ9wOEuUA06_-H_0 2024-09-14T11:22:50.454 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.454+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6850772231211475771', time=2024-09-14T13:14:50.067081+0000, chain.objs.size()=1 2024-09-14T11:22:50.454 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.454+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.251__shadow_.8VfUuZR_8v9xgQnzU2XdF4YNCyRy3kN_0 2024-09-14T11:22:50.454 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.454+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10115546055629849271', time=2024-09-14T13:14:50.851828+0000, chain.objs.size()=1 2024-09-14T11:22:50.454 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.454+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.254__shadow_.2izDcCLbFukP-K0k0X_sqp0EC6s8oIt_0 2024-09-14T11:22:50.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.455+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2417844756097809095', time=2024-09-14T13:14:59.737101+0000, chain.objs.size()=1 2024-09-14T11:22:50.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.455+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.SpZoSk2U71gBNxwI26zYQMlMONWPuVB_0 2024-09-14T11:22:50.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.455+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11108178887167013824', time=2024-09-14T13:14:59.757564+0000, chain.objs.size()=1 2024-09-14T11:22:50.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.455+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.2eOzPuqGQwZyTUFE56g1jPUu-r-k0YK_0 2024-09-14T11:22:50.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.455+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8034706879181599609', time=2024-09-14T13:14:59.772023+0000, chain.objs.size()=1 2024-09-14T11:22:50.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.455+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.gEGRQq_TL50bZcegB8zlHlcGY8OZzzv_0 2024-09-14T11:22:50.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.455+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4619209582252468161', time=2024-09-14T13:14:59.810900+0000, chain.objs.size()=1 2024-09-14T11:22:50.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.455+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.efrEOPIGnbrm4BIumAO2_j__8Il6kXN_0 2024-09-14T11:22:50.456 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.457+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12629628162589127540', time=2024-09-14T13:14:59.948553+0000, chain.objs.size()=1 2024-09-14T11:22:50.456 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.457+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.pz8chSttp-l1k-PkJWh6aVK85GpeNBE_0 2024-09-14T11:22:50.456 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.457+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1364349435975919817', time=2024-09-14T13:14:59.968288+0000, chain.objs.size()=1 2024-09-14T11:22:50.457 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.457+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.ZeUYPkmV2a5cydIomdFy_QqtoE6NxqW_0 2024-09-14T11:22:50.457 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.457+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15913519852091455600', time=2024-09-14T13:15:00.074007+0000, chain.objs.size()=1 2024-09-14T11:22:50.457 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.457+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.uPdtVqSJEWBr2v9lwbavkkXzOGpbcv2_0 2024-09-14T11:22:50.457 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.457+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6513651332935057078', time=2024-09-14T13:15:00.088314+0000, chain.objs.size()=1 2024-09-14T11:22:50.457 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.457+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.YDDDjVrMuCFs0McDBc6c8sxtcD3uExI_0 2024-09-14T11:22:50.457 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.457+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15232063452603828709', time=2024-09-14T13:15:00.104066+0000, chain.objs.size()=1 2024-09-14T11:22:50.457 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.457+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.OV8R6z_ThhAaGacXHdI5HIYzp1cfdFV_0 2024-09-14T11:22:50.457 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.457+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4974693076145955449', time=2024-09-14T13:15:00.139525+0000, chain.objs.size()=1 2024-09-14T11:22:50.457 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.457+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.4YP67888yZnNY2tiYOpscvG74gdY_4Z_0 2024-09-14T11:22:50.457 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.457+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.29231247882922804', time=2024-09-14T13:15:00.148260+0000, chain.objs.size()=1 2024-09-14T11:22:50.457 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.457+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.985LvomexHOcMlAjLwAy09-WZfyg-3p_0 2024-09-14T11:22:50.457 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.457+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6069629182814539446', time=2024-09-14T13:15:00.247901+0000, chain.objs.size()=1 2024-09-14T11:22:50.457 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.457+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.5WmFO9E4lRXuase5bIr8eXtNPYq1Cin_0 2024-09-14T11:22:50.457 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.457+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9649693373687991197', time=2024-09-14T13:15:00.263033+0000, chain.objs.size()=1 2024-09-14T11:22:50.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.457+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.L5AkVVB5PvasllAk22P7mGY2UBDEeJP_0 2024-09-14T11:22:50.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.457+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1273398705092428166', time=2024-09-14T13:15:00.285367+0000, chain.objs.size()=1 2024-09-14T11:22:50.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.457+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.RQyf3IkfgmHirRzywUCN_NHGQ5FjaF9_0 2024-09-14T11:22:50.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.457+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11966863673618069500', time=2024-09-14T13:15:00.309413+0000, chain.objs.size()=1 2024-09-14T11:22:50.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.457+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Vrh6doyFQyBvwPyuRRFjLF00gsRMtSB_0 2024-09-14T11:22:50.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.459+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2544548962177927713', time=2024-09-14T13:15:00.310218+0000, chain.objs.size()=1 2024-09-14T11:22:50.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.459+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.xyVBgIBOTqTHzYcm3diaoJJRzNHl0ZV_0 2024-09-14T11:22:50.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.459+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12274424597527206061', time=2024-09-14T13:15:00.316820+0000, chain.objs.size()=1 2024-09-14T11:22:50.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.459+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.woQ3SepUknpeEUwla9FVp5hBL5SingV_0 2024-09-14T11:22:50.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.459+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4128183764706452589', time=2024-09-14T13:15:00.391957+0000, chain.objs.size()=1 2024-09-14T11:22:50.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.459+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.MHqvTgmW16yVaTXfUJeh1xdyUhDgqTT_0 2024-09-14T11:22:50.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.459+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12520570554000025981', time=2024-09-14T13:15:00.404149+0000, chain.objs.size()=1 2024-09-14T11:22:50.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.459+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.-NjfAwJZ79QyLSe6Fbmfmbp5MlHjNOv_0 2024-09-14T11:22:50.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.459+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16148722401807685993', time=2024-09-14T13:15:00.411555+0000, chain.objs.size()=1 2024-09-14T11:22:50.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.459+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.4JA6WLOBeIPgZZZDAfnq-oQQUCstJJz_0 2024-09-14T11:22:50.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.459+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12996095253710215862', time=2024-09-14T13:15:00.464453+0000, chain.objs.size()=1 2024-09-14T11:22:50.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.459+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.AUAgrDuvt7rmWJVOfIapgUDPFw3e6Hi_0 2024-09-14T11:22:50.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.459+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.922210774750311654', time=2024-09-14T13:15:00.477792+0000, chain.objs.size()=1 2024-09-14T11:22:50.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.459+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.i2qAuwOPFTJkcAD63uHhS_rhbSnhFN6_0 2024-09-14T11:22:50.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.459+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11958269905089753952', time=2024-09-14T13:15:00.563794+0000, chain.objs.size()=1 2024-09-14T11:22:50.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.459+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.HS9iVWpzdSu28slJZkFYDkXxrYkaoJW_0 2024-09-14T11:22:50.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.459+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9092752480031124058', time=2024-09-14T13:15:00.578785+0000, chain.objs.size()=1 2024-09-14T11:22:50.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.459+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.SuVHoeoqNtCggqoqSbaAASJYK2B2r4s_0 2024-09-14T11:22:50.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.459+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34541889800984391', time=2024-09-14T13:15:00.633501+0000, chain.objs.size()=1 2024-09-14T11:22:50.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.459+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.V5vCElnBSvQpatux-_TCTuEUHpwWjaN_0 2024-09-14T11:22:50.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.459+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11074463052742830378', time=2024-09-14T13:15:00.752072+0000, chain.objs.size()=1 2024-09-14T11:22:50.461 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.459+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.ZYlO2Ufc_8wt-Ssg3iPrjpq_GSFrc5V_0 2024-09-14T11:22:50.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.461+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11780652528484236947', time=2024-09-14T13:15:00.870089+0000, chain.objs.size()=1 2024-09-14T11:22:50.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.461+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.bWt8jq85KXUI00kQKqKnVKNH5gavlVB_0 2024-09-14T11:22:50.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.461+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14479440434299738418', time=2024-09-14T13:15:09.246535+0000, chain.objs.size()=1 2024-09-14T11:22:50.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.461+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.292__shadow_.8JDiabfP_J4nq44Wv0L7TgMK2xuAB39_0 2024-09-14T11:22:50.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.461+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11196787350043752580', time=2024-09-14T13:15:10.073795+0000, chain.objs.size()=1 2024-09-14T11:22:50.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.461+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.294__shadow_.EH1eF6z3UJf3P6zNiVKf7YO0g8AESmx_0 2024-09-14T11:22:50.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.461+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5914089208239955210', time=2024-09-14T13:15:12.237053+0000, chain.objs.size()=1 2024-09-14T11:22:50.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.461+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.302__shadow_.wLPNg4dLNW1YajQjvuChIBg8Fiej9oC_0 2024-09-14T11:22:50.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.461+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.975022606261336761', time=2024-09-14T13:15:12.737620+0000, chain.objs.size()=1 2024-09-14T11:22:50.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.461+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.304__shadow_.0vPNzQCol9z96cangcOM_xKkUnvFDYW_0 2024-09-14T11:22:50.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.461+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12329095052025395350', time=2024-09-14T13:15:16.607057+0000, chain.objs.size()=1 2024-09-14T11:22:50.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.461+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.319__shadow:aWSol5PTI40ttbrQBGpBtCzb7UEwT0H_.rdfJCOyvV9ezeIVuNN7AkhZmmWhS4oF_0 2024-09-14T11:22:50.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.461+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1652376861120893227', time=2024-09-14T13:15:24.743062+0000, chain.objs.size()=1 2024-09-14T11:22:50.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.461+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.QeFddsZXRDGc-g3xuwMCqm3vXaffYVL_0 2024-09-14T11:22:50.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.461+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13712706950733271576', time=2024-09-14T13:15:24.743978+0000, chain.objs.size()=1 2024-09-14T11:22:50.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.461+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.z2cMcUXqWsdfct6VIfXSQnR00hgF-lT_0 2024-09-14T11:22:50.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.461+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18353372564350531544', time=2024-09-14T13:15:24.763115+0000, chain.objs.size()=1 2024-09-14T11:22:50.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.461+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.lu_osFVoT6OPrz5-Vb4v3oX-Yd7sFgr_0 2024-09-14T11:22:50.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.461+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3017318549804278167', time=2024-09-14T13:15:24.896443+0000, chain.objs.size()=1 2024-09-14T11:22:50.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.461+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.bttFqgdAxEdaJ8R3sDANpUoB8v4sFbp_0 2024-09-14T11:22:50.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.462+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1053691676825842945', time=2024-09-14T13:15:24.901854+0000, chain.objs.size()=1 2024-09-14T11:22:50.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.462+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.81ZragIOFd7j-qfViZzZtIiDQo6ziXl_0 2024-09-14T11:22:50.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.463+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1114294131023198453', time=2024-09-14T13:15:24.930367+0000, chain.objs.size()=1 2024-09-14T11:22:50.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.463+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.SFOsIEPoWsGF4-BYhj9c8o_9q2LmPlp_0 2024-09-14T11:22:50.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.463+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13929772020862420006', time=2024-09-14T13:15:25.042943+0000, chain.objs.size()=1 2024-09-14T11:22:50.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.463+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.d3FWDE3ACDwcLEJCtW80ita4kHxsPMx_0 2024-09-14T11:22:50.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.463+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2521952313864946815', time=2024-09-14T13:15:25.048420+0000, chain.objs.size()=1 2024-09-14T11:22:50.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.463+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.S3lz9f3WWujMkqvIqfTuqKe-dSGA3rP_0 2024-09-14T11:22:50.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.463+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2058813950088322980', time=2024-09-14T13:15:25.058551+0000, chain.objs.size()=1 2024-09-14T11:22:50.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.463+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.6X_qu8n2aGhx-d6MrWiuHNyRToYf1qY_0 2024-09-14T11:22:50.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.463+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8297785099332202515', time=2024-09-14T13:15:25.063771+0000, chain.objs.size()=1 2024-09-14T11:22:50.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.463+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.jW4WwQc-4wJ2IagU-hIBVK4s0z2RRb3_0 2024-09-14T11:22:50.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.463+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16379958870377030782', time=2024-09-14T13:15:25.064474+0000, chain.objs.size()=1 2024-09-14T11:22:50.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.463+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.7SICXA_yxGr8odQZAYn7wjRZD2LaU7Z_0 2024-09-14T11:22:50.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.463+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5690710433091105724', time=2024-09-14T13:15:25.073775+0000, chain.objs.size()=1 2024-09-14T11:22:50.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.463+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.VSWIITThFFm-4aOTLU8ZkQWYFgw-HXb_0 2024-09-14T11:22:50.466 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.463+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16032235096638372031', time=2024-09-14T13:15:25.096773+0000, chain.objs.size()=1 2024-09-14T11:22:50.466 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.463+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.WhiTV9i9qxPGmDw6Soc2ViyhFFIDflj_0 2024-09-14T11:22:50.466 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.463+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16129886059000633368', time=2024-09-14T13:15:25.122272+0000, chain.objs.size()=1 2024-09-14T11:22:50.466 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.463+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.EHzQTCx9wZvD5syA9lSyH0sEXr1MKzv_0 2024-09-14T11:22:50.466 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.464+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17265463736299739121', time=2024-09-14T13:15:25.129979+0000, chain.objs.size()=1 2024-09-14T11:22:50.466 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.464+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.vD4z4y9zvBkw3QyjzyoFUjsiH3kxQFI_0 2024-09-14T11:22:50.466 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.464+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2835340984916258257', time=2024-09-14T13:15:25.241563+0000, chain.objs.size()=1 2024-09-14T11:22:50.466 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.464+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.GgYy0FwQ_W-XsAcL-MNijzJPBtyJCfc_0 2024-09-14T11:22:50.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.465+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3780882829512022244', time=2024-09-14T13:15:25.379014+0000, chain.objs.size()=1 2024-09-14T11:22:50.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.465+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.YLruDqKYky6Hdl1zeVtMHAdcpngE-Ls_0 2024-09-14T11:22:50.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.465+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11600256692169972305', time=2024-09-14T13:15:25.379992+0000, chain.objs.size()=1 2024-09-14T11:22:50.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.465+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.Xqoa9U45uAug8n0ZdZxS1QmM0R9J2kS_0 2024-09-14T11:22:50.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.466+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13264810585240263580', time=2024-09-14T13:15:25.437058+0000, chain.objs.size()=1 2024-09-14T11:22:50.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.466+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.ifCSZj_6uW8cL5SqygX9WT_Kt5qDMre_0 2024-09-14T11:22:50.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.466+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11514176507346690333', time=2024-09-14T13:15:25.444872+0000, chain.objs.size()=1 2024-09-14T11:22:50.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.466+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.xfh0Ig6RDXtiqE9MIXJtBwgnYaC-ejK_0 2024-09-14T11:22:50.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.467+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12133331966611077291', time=2024-09-14T13:15:25.536992+0000, chain.objs.size()=1 2024-09-14T11:22:50.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.467+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.mCXrBrV0lwouTwdYOKybf4F-qonodtU_0 2024-09-14T11:22:50.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.467+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10715915996980404755', time=2024-09-14T13:15:25.540279+0000, chain.objs.size()=1 2024-09-14T11:22:50.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.467+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.3WU2pDNGdKjj10PcXG6UQ6eWS6dnbyD_0 2024-09-14T11:22:50.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.467+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10784342274221127656', time=2024-09-14T13:15:25.555037+0000, chain.objs.size()=1 2024-09-14T11:22:50.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.467+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.JwdF-PxoxSRMGq6Ri_ymYcXWsPtnq-9_0 2024-09-14T11:22:50.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.467+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8376089919459855845', time=2024-09-14T13:15:25.712314+0000, chain.objs.size()=1 2024-09-14T11:22:50.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.467+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.P5krGm6uyDabWFvdN9ojPtXa2qSrHlH_0 2024-09-14T11:22:50.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.467+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10775261828402617371', time=2024-09-14T13:15:25.744376+0000, chain.objs.size()=1 2024-09-14T11:22:50.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.467+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.VFJ4CVEgmt8ThGRduPdfi8aXCuPDJd0_0 2024-09-14T11:22:50.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.467+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10831678155671703789', time=2024-09-14T13:15:25.761120+0000, chain.objs.size()=1 2024-09-14T11:22:50.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.467+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.aKNnMj3xfYFWwwjkZ0iBdMhxduylsaP_0 2024-09-14T11:22:50.470 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.467+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10814329463738561408', time=2024-09-14T13:15:25.775779+0000, chain.objs.size()=1 2024-09-14T11:22:50.470 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.467+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.Pvr5NR_CN1C8UgCp6-soh9TpuHyuyFO_0 2024-09-14T11:22:50.470 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.467+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4822956017781304718', time=2024-09-14T13:15:25.902146+0000, chain.objs.size()=1 2024-09-14T11:22:50.470 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.467+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.KE38cQGEI6XnPM0yfhiewDatH23Ku3m_0 2024-09-14T11:22:50.470 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.467+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15460103736118776048', time=2024-09-14T13:15:25.919004+0000, chain.objs.size()=1 2024-09-14T11:22:50.470 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.467+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_._NcBtPiK_15fCgUDD51KObgvbPQTeGo_0 2024-09-14T11:22:50.470 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.467+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12388383802885567226', time=2024-09-14T13:15:25.921827+0000, chain.objs.size()=1 2024-09-14T11:22:50.470 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.467+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.dOv2QTLMAf34WS-Xoa6AFevSabvNfa8_0 2024-09-14T11:22:50.470 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.467+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14488912577758391350', time=2024-09-14T13:15:25.938225+0000, chain.objs.size()=1 2024-09-14T11:22:50.470 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.467+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.VwevVzXQ-JpE6SVeT147B6fjc1C7VDS_0 2024-09-14T11:22:50.470 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.468+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2604508882092211556', time=2024-09-14T13:15:33.164354+0000, chain.objs.size()=1 2024-09-14T11:22:50.470 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.468+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.mIOr8DcbeXMurt89bzOdWYV6zFojjbx_0 2024-09-14T11:22:50.470 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.468+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1052496777508703373', time=2024-09-14T13:15:33.170161+0000, chain.objs.size()=1 2024-09-14T11:22:50.470 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.468+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.4HT3e021UX-vhnRpliN8xk4JNcKuGqO_0 2024-09-14T11:22:50.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.469+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13415083254455927769', time=2024-09-14T13:15:33.231908+0000, chain.objs.size()=1 2024-09-14T11:22:50.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.469+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.wq-bzj5T_cC7PlOtZsxtYTdAxdhHUuX_0 2024-09-14T11:22:50.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.469+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16787150069161068268', time=2024-09-14T13:15:33.244690+0000, chain.objs.size()=1 2024-09-14T11:22:50.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.469+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.AqN_5clm3elGMR-lSDX7U3E3-bOS2fg_0 2024-09-14T11:22:50.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.469+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8081494879579070505', time=2024-09-14T13:15:33.246928+0000, chain.objs.size()=1 2024-09-14T11:22:50.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.469+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.SgjR2-FOhxigzgwdS9SVg_ElmP6ysJc_0 2024-09-14T11:22:50.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.469+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8802402245381019192', time=2024-09-14T13:15:33.365155+0000, chain.objs.size()=1 2024-09-14T11:22:50.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.469+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.IkG9Hvt1h3GKnoEATNV4yji0ebSoMXT_0 2024-09-14T11:22:50.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.469+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14659805943612605794', time=2024-09-14T13:15:33.368100+0000, chain.objs.size()=1 2024-09-14T11:22:50.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.469+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.8rj_v7lnyFY7L3OWc7n__Opr2PElgZe_0 2024-09-14T11:22:50.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.469+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9822731583537279728', time=2024-09-14T13:15:33.401145+0000, chain.objs.size()=1 2024-09-14T11:22:50.472 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.469+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.fzLUbCPcwhlsX2fmautLeaGQ7m4Zv2d_0 2024-09-14T11:22:50.473 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.470+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15159462391532195852', time=2024-09-14T13:15:33.411340+0000, chain.objs.size()=1 2024-09-14T11:22:50.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.470+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.8CLAVTmhx1esLtGh0c0BwLwpeKXvt75_0 2024-09-14T11:22:50.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.470+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10533886106096347047', time=2024-09-14T13:15:33.437601+0000, chain.objs.size()=1 2024-09-14T11:22:50.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.470+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.JTtjFvsu_jBvv-_LdmVypS67tNQ7nqu_0 2024-09-14T11:22:50.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.470+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14261284766802985786', time=2024-09-14T13:15:33.541893+0000, chain.objs.size()=1 2024-09-14T11:22:50.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.470+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.YjC3YlLyivj6FfbSuqfW3CMDNg-l5dF_0 2024-09-14T11:22:50.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.470+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2868819286462819020', time=2024-09-14T13:15:33.547067+0000, chain.objs.size()=1 2024-09-14T11:22:50.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.470+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.t9r-TXoVJBcLzFim_T6-zLBYjPO74wu_0 2024-09-14T11:22:50.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.471+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16828650562662840940', time=2024-09-14T13:15:33.553807+0000, chain.objs.size()=1 2024-09-14T11:22:50.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.471+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.M0RFJPyj0kFjKHo9jdYuktrB3ON_Jjy_0 2024-09-14T11:22:50.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.471+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2649456876183928521', time=2024-09-14T13:15:33.563326+0000, chain.objs.size()=1 2024-09-14T11:22:50.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.471+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.S9z4_25jYUgodicaMxgRsz7faNi4OQr_0 2024-09-14T11:22:50.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.471+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3900071258603770407', time=2024-09-14T13:15:33.593425+0000, chain.objs.size()=1 2024-09-14T11:22:50.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.471+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.ZuEomnVBzAnSZpL351YE1DYcPq5h0Xe_0 2024-09-14T11:22:50.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.471+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13308617380411185497', time=2024-09-14T13:15:33.597553+0000, chain.objs.size()=1 2024-09-14T11:22:50.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.471+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.A7iItdc3WBZpLtCRdwZUnpqY7ytl-_h_0 2024-09-14T11:22:50.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.471+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7404176131492003941', time=2024-09-14T13:15:33.691101+0000, chain.objs.size()=1 2024-09-14T11:22:50.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.471+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.gxd8obHUvebrEKp1u0GwXWnEY8y16Pu_0 2024-09-14T11:22:50.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.471+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4222388628796582248', time=2024-09-14T13:15:33.701182+0000, chain.objs.size()=1 2024-09-14T11:22:50.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.471+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.falIap6q0ZtCYcDlyGEwZxCM-HfHfMn_0 2024-09-14T11:22:50.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.472+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9497691554287474196', time=2024-09-14T13:15:33.702050+0000, chain.objs.size()=1 2024-09-14T11:22:50.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.472+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Pav8QEbl1pa6JmtrJO6ix4RfYloIJfR_0 2024-09-14T11:22:50.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.472+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5883035198479932871', time=2024-09-14T13:15:33.731305+0000, chain.objs.size()=1 2024-09-14T11:22:50.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.472+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.O1V7WnPfd0Q6gsIrWtRTBCkvUPDaW4C_0 2024-09-14T11:22:50.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.472+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12349903979226168314', time=2024-09-14T13:15:33.732608+0000, chain.objs.size()=1 2024-09-14T11:22:50.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.472+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.hm0n7pc6DTiWNdjjClNo9wx3TzaFcOQ_0 2024-09-14T11:22:50.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.472+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7725120931065180902', time=2024-09-14T13:15:33.764297+0000, chain.objs.size()=1 2024-09-14T11:22:50.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.472+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.usBxuxBD51dj54IS-Pt7hennqYpRTJS_0 2024-09-14T11:22:50.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.472+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3693556435143277171', time=2024-09-14T13:15:33.767765+0000, chain.objs.size()=1 2024-09-14T11:22:50.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.472+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.yXXFA-4pv6cVLmwUXtBl045YgAT_IAS_0 2024-09-14T11:22:50.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.473+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12976623953001689756', time=2024-09-14T13:15:33.891034+0000, chain.objs.size()=1 2024-09-14T11:22:50.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.473+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.8fg5PifUeSOcG55SV6kpovi6AjN-No1_0 2024-09-14T11:22:50.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.473+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5338971561507738450', time=2024-09-14T13:15:33.903007+0000, chain.objs.size()=1 2024-09-14T11:22:50.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.473+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.2U-nQ2kKcJG8Z-MHggw4kJJmQbI1Gfe_0 2024-09-14T11:22:50.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.473+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8521572009089678716', time=2024-09-14T13:15:33.931956+0000, chain.objs.size()=1 2024-09-14T11:22:50.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.473+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.3T0awYbRLoVCG7dY5N9JQkWZP9vzqpn_0 2024-09-14T11:22:50.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.473+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.111515399235223136', time=2024-09-14T13:15:33.937826+0000, chain.objs.size()=1 2024-09-14T11:22:50.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.473+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.BBOO1VXk6I2zPl-fm58uxN0KDzidl8F_0 2024-09-14T11:22:50.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.473+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3875222932443179578', time=2024-09-14T13:15:34.089682+0000, chain.objs.size()=1 2024-09-14T11:22:50.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.473+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.KAOrVFCc5ZRUsOe51a5Fg-dovt4LsZB_0 2024-09-14T11:22:50.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.473+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1185778167586635683', time=2024-09-14T13:15:34.205312+0000, chain.objs.size()=1 2024-09-14T11:22:50.477 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.473+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.lZLSXxFGDn-Y-xC01hJaL_xYHaVJ8xx_0 2024-09-14T11:22:50.477 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.474+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8823722324934649734', time=2024-09-14T13:15:34.212717+0000, chain.objs.size()=1 2024-09-14T11:22:50.477 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.474+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.sOkNUkApC3hkGYjxV4yxmJpKCmUOG4S_0 2024-09-14T11:22:50.477 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.474+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6052809102412937533', time=2024-09-14T13:15:34.220919+0000, chain.objs.size()=1 2024-09-14T11:22:50.477 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.474+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.b118rk9tjA-tpvQG8BeQSxrtiqsCP5S_0 2024-09-14T11:22:50.478 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.476+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 0/49724 2024-09-14T11:22:50.478 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.478+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=34, truncated=0, next_marker='' 2024-09-14T11:22:50.478 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.478+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.517610954025575063', time=2024-09-14T13:15:34.240400+0000, chain.objs.size()=1 2024-09-14T11:22:50.478 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.478+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.W6q0piOhiJe3gWvlSofrlBtDi5YTyBD_0 2024-09-14T11:22:50.478 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.478+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7919298246309907953', time=2024-09-14T13:15:34.245250+0000, chain.objs.size()=1 2024-09-14T11:22:50.478 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.478+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.pSjve7b2uz6_j1q0djrVlw8vGhgh0BZ_0 2024-09-14T11:22:50.478 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.478+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13097728339047713101', time=2024-09-14T13:15:34.246369+0000, chain.objs.size()=1 2024-09-14T11:22:50.479 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.478+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.OGjUxdsKKcC18Hg1bPGDzDNsHVCXWPs_0 2024-09-14T11:22:50.479 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.478+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13551882611056151855', time=2024-09-14T13:15:34.330214+0000, chain.objs.size()=1 2024-09-14T11:22:50.479 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.478+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.awt_4gJPK6Ulpgisyb6IKjSDOfckQSZ_0 2024-09-14T11:22:50.479 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.478+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10684799780574760365', time=2024-09-14T13:15:34.331066+0000, chain.objs.size()=1 2024-09-14T11:22:50.479 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.478+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.SO0jWXZ4oCduM_GCt_yFpRimao_Ls2P_0 2024-09-14T11:22:50.479 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.478+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1186307315993289401', time=2024-09-14T13:15:34.334877+0000, chain.objs.size()=1 2024-09-14T11:22:50.479 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.478+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Z2OZLeTK1hc4CnffShzIeY-CdqMubkR_0 2024-09-14T11:22:50.479 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.478+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7393449553561136112', time=2024-09-14T13:15:34.350420+0000, chain.objs.size()=1 2024-09-14T11:22:50.479 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.478+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.gDwIJGgnNSj_gj1m_AhGx_rbsU-5Ru6_0 2024-09-14T11:22:50.479 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.478+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17286463342213251214', time=2024-09-14T13:15:34.383370+0000, chain.objs.size()=1 2024-09-14T11:22:50.479 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.478+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.AMAQX4W-VPPmHiBTYgJFUA520vvmVgF_0 2024-09-14T11:22:50.479 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.478+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4918428237853841363', time=2024-09-14T13:15:34.393834+0000, chain.objs.size()=1 2024-09-14T11:22:50.479 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.478+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.b6XmzspVPaDkndoBh8RH6gMjTEJRUyC_0 2024-09-14T11:22:50.480 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.478+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5398829000552904680', time=2024-09-14T13:15:34.400158+0000, chain.objs.size()=1 2024-09-14T11:22:50.480 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.478+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.VgrkYn-5Y606rutmVnSnjMPhvq1Iizo_0 2024-09-14T11:22:50.480 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.478+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13440682763390025698', time=2024-09-14T13:15:34.400944+0000, chain.objs.size()=1 2024-09-14T11:22:50.480 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.478+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.ZU9F8Jyjl9jEWAYTQswORmcVTwTqvEw_0 2024-09-14T11:22:50.480 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.478+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2455278860854070598', time=2024-09-14T13:15:37.946320+0000, chain.objs.size()=1 2024-09-14T11:22:50.480 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.478+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.339__shadow_.KYgvnR7Bdu3qcmjhHIZfWUVRTv2iE17_0 2024-09-14T11:22:50.481 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.480+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10583337803778357260', time=2024-09-14T13:15:41.152317+0000, chain.objs.size()=1 2024-09-14T11:22:50.481 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.480+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.353__shadow_.nXi-9W7zWsLtE4Vdjp6xxsMMEUYTohB_0 2024-09-14T11:22:50.481 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.480+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1812722583077018320', time=2024-09-14T13:15:44.076931+0000, chain.objs.size()=1 2024-09-14T11:22:50.481 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.480+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.369__shadow_.pv0meYhmJVkV4FtkYWJ6U5EYhVXwMMV_0 2024-09-14T11:22:50.481 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.480+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14042182229848930529', time=2024-09-14T13:15:53.783036+0000, chain.objs.size()=1 2024-09-14T11:22:50.481 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.480+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.394__shadow:Qz3wZPAEQhbadl9jG0sKjknSDJjz9Vg_.MFFgjKVBx2crtE1FZ5BYdZ4RyH49zMq_0 2024-09-14T11:22:50.481 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.480+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17357952779740310933', time=2024-09-14T13:16:12.997307+0000, chain.objs.size()=1 2024-09-14T11:22:50.481 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.480+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.464__shadow_.SgD3yDcjoeqpE2c0SRVG8aVYNneS0Wg_0 2024-09-14T11:22:50.482 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.480+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15458763947093573019', time=2024-09-14T13:16:16.974888+0000, chain.objs.size()=1 2024-09-14T11:22:50.482 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.480+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.483__shadow_._slW_mJQe4C8xq9CJjfi_j4IfyGclee_0 2024-09-14T11:22:50.482 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.480+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15522556395101536784', time=2024-09-14T13:16:18.029663+0000, chain.objs.size()=3 2024-09-14T11:22:50.482 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.480+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.486__shadow_.hhSLkPJJh6uGj1HTHhgVIzDHc0VYLFE_0 2024-09-14T11:22:50.482 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.480+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.486__shadow_.hhSLkPJJh6uGj1HTHhgVIzDHc0VYLFE_1 2024-09-14T11:22:50.482 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.480+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.486__shadow_.hhSLkPJJh6uGj1HTHhgVIzDHc0VYLFE_2 2024-09-14T11:22:50.482 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.480+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13728457026149096297', time=2024-09-14T13:16:18.953302+0000, chain.objs.size()=1 2024-09-14T11:22:50.482 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.480+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.489__shadow_.Z9t4fWj5BfuLFHhpwQfC4X38TF2Xyge_0 2024-09-14T11:22:50.482 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.480+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12686998031599407248', time=2024-09-14T13:16:30.505946+0000, chain.objs.size()=3 2024-09-14T11:22:50.482 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.480+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.521__multipart_mymultipart.2~lPlXLxboUKei2LAmFJkF6Ezy-56o941.1 2024-09-14T11:22:50.482 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.480+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.521__multipart_mymultipart.2~lPlXLxboUKei2LAmFJkF6Ezy-56o941.2 2024-09-14T11:22:50.482 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.481+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.521__multipart_mymultipart.2~lPlXLxboUKei2LAmFJkF6Ezy-56o941.3 2024-09-14T11:22:50.482 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.482+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15467905388367449863', time=2024-09-14T13:16:35.622102+0000, chain.objs.size()=1 2024-09-14T11:22:50.482 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.482+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.523__multipart_mymultipart.2~AGqhIHvFEKl5CRvOzRWN7AQzT0m8zes.1 2024-09-14T11:22:50.483 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.482+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11483182028446725607', time=2024-09-14T13:17:21.396478+0000, chain.objs.size()=1 2024-09-14T11:22:50.483 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.482+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.569__shadow:f.9Q4dcC-ngxsq4LBNRwvdkmH8Kt-1Y_.BePJOKhmjoY2ARcGTIXljUlErygRY98_0 2024-09-14T11:22:50.483 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.482+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.877585824856772185', time=2024-09-14T13:17:22.621813+0000, chain.objs.size()=1 2024-09-14T11:22:50.483 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.482+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.569__shadow:d4MXloUe2ioG19dY2Z1SiaZ9k9wMmgQ_.0iiQ4ofMPisJXH2zZw67mtropu7FgMp_0 2024-09-14T11:22:50.483 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.482+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17141542336469318624', time=2024-09-14T13:17:23.824072+0000, chain.objs.size()=1 2024-09-14T11:22:50.483 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.482+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.569__shadow:5h5Hlx2o5XoJuKIP1BIWlMaGXlwTl61_.CUsEgwrXGIIK4zDU9LNXsyJleoearso_0 2024-09-14T11:22:50.484 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.483+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.657999282103102529', time=2024-09-14T13:17:27.456908+0000, chain.objs.size()=1 2024-09-14T11:22:50.484 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.483+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.570__shadow:TdZXkK8VYNd2pTB.6oFH89gRJRSzSMQ_.OdlhJNEyxULS7WzVIKj-d3byLUa68dV_0 2024-09-14T11:22:50.484 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.483+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15263982073963785155', time=2024-09-14T13:17:29.264876+0000, chain.objs.size()=1 2024-09-14T11:22:50.484 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.483+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.574__shadow:0fG2S3K47W3OEdcL33jwrEu1wnXnDdx_.pmKNZ1399K8vq2NJKwiE_tJA8zo8KOb_0 2024-09-14T11:22:50.484 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.483+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1072078081780450757', time=2024-09-14T13:17:47.555900+0000, chain.objs.size()=1 2024-09-14T11:22:50.484 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.483+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.577__shadow:GguuhZ8zOIXOmlr2vzIrBN1QmRma8R-_.keU9bH_x2gIrBqeErY5NYPitWc5DaHc_0 2024-09-14T11:22:50.484 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.483+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3711458814970766507', time=2024-09-14T13:17:53.517649+0000, chain.objs.size()=1 2024-09-14T11:22:50.484 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.483+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.587__shadow:VRLhCdiq9VCBlvXxGQxuZbm6RzrrSsq_.1Z4cVZ6_mMwQ4Lu2Es7W3WDxInbEpHs_0 2024-09-14T11:22:50.484 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.483+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4498717379865597425', time=2024-09-14T13:17:55.496204+0000, chain.objs.size()=1 2024-09-14T11:22:50.484 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.483+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.596__shadow_.ndD56ljqY2SBQ3XMv42mgAHT_Qo5CpD_0 2024-09-14T11:22:50.484 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.483+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13338165653048499232', time=2024-09-14T13:20:13.201677+0000, chain.objs.size()=1 2024-09-14T11:22:50.484 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.483+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.645__shadow_.njOe9y-S0-HpnIRySQ9wcYj9v9277LV_0 2024-09-14T11:22:50.485 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.483+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15347373880279804675', time=2024-09-14T13:20:13.550364+0000, chain.objs.size()=1 2024-09-14T11:22:50.485 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.483+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.646__shadow_.V63BMq4n2q2DN-b0lTeizaxiH_D-kh0_0 2024-09-14T11:22:50.485 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.484+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10356733987611506557', time=2024-09-14T13:20:16.629373+0000, chain.objs.size()=1 2024-09-14T11:22:50.485 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.484+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.655__shadow_.oqDyZtRym13uywdEEpvBShP4J1nX7ho_0 2024-09-14T11:22:50.485 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.484+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10589992467445014739', time=2024-09-14T13:21:11.163887+0000, chain.objs.size()=1 2024-09-14T11:22:50.485 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.484+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.765__shadow_.702DXSnNyP5TLxqIIGJ79qBab_WuyVi_0 2024-09-14T11:22:50.485 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.484+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4405707964852723306', time=2024-09-14T13:21:11.965527+0000, chain.objs.size()=1 2024-09-14T11:22:50.485 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.484+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.767__shadow_.YmF8sAjhiQykIxbZOgvBC-LI1CT77Qu_0 2024-09-14T11:22:50.485 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.487+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:50.487 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.489+0000 7f0f19c16800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:22:50.488 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.490+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:50.489 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.490+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:50.490 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.491+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/99406' 2024-09-14T11:22:50.490 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.491+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8597775918786525433', time=2024-09-14T13:14:49.318720+0000, chain.objs.size()=1 2024-09-14T11:22:50.490 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.491+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.248__shadow_.NAVtRkBnzrtplXQ2va9qnzA3nIwx4jW_0 2024-09-14T11:22:50.491 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.491+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1022584739769639162', time=2024-09-14T13:14:50.315667+0000, chain.objs.size()=1 2024-09-14T11:22:50.491 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.491+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.252__shadow_.k6lHMtBAxQdSHniGfUAheBAvRswzIwq_0 2024-09-14T11:22:50.491 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.491+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6279467931098892737', time=2024-09-14T13:14:51.353661+0000, chain.objs.size()=1 2024-09-14T11:22:50.491 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.491+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.256__shadow_.-ZJvbTqorhC4rCmvqUtOaASvYwxWDAP_0 2024-09-14T11:22:50.491 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.491+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3060146664593687170', time=2024-09-14T13:14:59.778741+0000, chain.objs.size()=1 2024-09-14T11:22:50.491 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.491+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.3PKNd8UwZ9JGfgIwABwNGZ-Y06Z6Oxl_0 2024-09-14T11:22:50.491 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.491+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18195106864088306733', time=2024-09-14T13:14:59.903048+0000, chain.objs.size()=1 2024-09-14T11:22:50.491 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.491+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.AS3xWGEABrII4LyVlevtcCtj1jEGv-s_0 2024-09-14T11:22:50.491 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.491+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10323953703169737973', time=2024-09-14T13:14:59.964351+0000, chain.objs.size()=1 2024-09-14T11:22:50.491 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.491+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.n8eHYbYn0TO4_iAP8-nrYzzvp7sC8gk_0 2024-09-14T11:22:50.491 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.491+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1448571916942214685', time=2024-09-14T13:15:00.074251+0000, chain.objs.size()=1 2024-09-14T11:22:50.491 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.491+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.gh8pg0bAp4RaAPI_8Xb7KIDcuQpgERu_0 2024-09-14T11:22:50.491 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.491+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4496585027880658439', time=2024-09-14T13:15:00.091824+0000, chain.objs.size()=1 2024-09-14T11:22:50.492 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.491+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.-SQYcPNqwwJfvL2b3GgB2ZKVQ5JECw7_0 2024-09-14T11:22:50.492 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.491+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6557156363489807082', time=2024-09-14T13:15:00.103591+0000, chain.objs.size()=1 2024-09-14T11:22:50.492 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.491+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.PV0OVpLFwXT_bZQjGSIEbiv1tpI3oMX_0 2024-09-14T11:22:50.492 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.491+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12660748603128179787', time=2024-09-14T13:15:00.105287+0000, chain.objs.size()=1 2024-09-14T11:22:50.492 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.491+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.as459Zp0qTNayrTpCwRlI_XFE-kzSGO_0 2024-09-14T11:22:50.492 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.491+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17021579454289154653', time=2024-09-14T13:15:00.115835+0000, chain.objs.size()=1 2024-09-14T11:22:50.492 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.491+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.WXdVBX1gXUzZ8pyOFFx7KVEQ8PDfYpO_0 2024-09-14T11:22:50.492 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.491+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17425334074670551804', time=2024-09-14T13:15:00.123810+0000, chain.objs.size()=1 2024-09-14T11:22:50.492 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.491+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Iw7ClpQ50I9AOnegLkFRnvVIysDJmEQ_0 2024-09-14T11:22:50.494 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.493+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4660269556838799684', time=2024-09-14T13:15:00.133017+0000, chain.objs.size()=1 2024-09-14T11:22:50.494 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.493+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.UkexAjdzJBTpYUlkaUxoRdgTBupIFf1_0 2024-09-14T11:22:50.494 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.493+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15155610789339492384', time=2024-09-14T13:15:00.238249+0000, chain.objs.size()=1 2024-09-14T11:22:50.494 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.493+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.a0U2bzhLUdpCp_D3aIrGwreoeAYu2cH_0 2024-09-14T11:22:50.494 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.493+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2722330403523053012', time=2024-09-14T13:15:00.260284+0000, chain.objs.size()=1 2024-09-14T11:22:50.494 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.493+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.SHsugIzxCk1zKALcXJppCzZ8Qa9mFds_0 2024-09-14T11:22:50.494 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.493+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12205983996458444844', time=2024-09-14T13:15:00.298962+0000, chain.objs.size()=1 2024-09-14T11:22:50.494 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.493+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.7tywHPzGuenKMMM_jFIsII7IuMb7OIq_0 2024-09-14T11:22:50.494 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.493+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.734008572423878862', time=2024-09-14T13:15:00.315885+0000, chain.objs.size()=1 2024-09-14T11:22:50.494 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.493+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.7dJ15tknluovoPjdjSVMgQqq-lzKAKN_0 2024-09-14T11:22:50.494 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.493+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6846793675234475496', time=2024-09-14T13:15:00.392615+0000, chain.objs.size()=1 2024-09-14T11:22:50.494 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.493+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.LWELZ5rHFCOGEknC0OxRFF5BcwS_iib_0 2024-09-14T11:22:50.495 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.493+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13650352492651208818', time=2024-09-14T13:15:00.415908+0000, chain.objs.size()=1 2024-09-14T11:22:50.495 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.493+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.6ECgWPsNjy5TlDfBRYeYdiXxClZgM5g_0 2024-09-14T11:22:50.495 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.493+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17167904998344448675', time=2024-09-14T13:15:00.425424+0000, chain.objs.size()=1 2024-09-14T11:22:50.495 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.493+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.bRPeIPLXjNDQDNtC7oDDMNtUo7WCoZz_0 2024-09-14T11:22:50.495 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.493+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16741179053098501651', time=2024-09-14T13:15:00.454008+0000, chain.objs.size()=1 2024-09-14T11:22:50.495 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.493+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.8M8wvQQPRluGpSWnQg8axLCUW50OfjZ_0 2024-09-14T11:22:50.495 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.493+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14056917368633111143', time=2024-09-14T13:15:00.601593+0000, chain.objs.size()=1 2024-09-14T11:22:50.495 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.493+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.PEr858JM8hsdI-1IOt03b28rTwsnWB0_0 2024-09-14T11:22:50.495 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.494+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4970254345181867716', time=2024-09-14T13:15:00.615687+0000, chain.objs.size()=1 2024-09-14T11:22:50.495 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.494+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.qXJ1DkiCxwoM_8g03pj1GtcR5HD1KeK_0 2024-09-14T11:22:50.495 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.495+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10176934997508176005', time=2024-09-14T13:15:00.727016+0000, chain.objs.size()=1 2024-09-14T11:22:50.495 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.495+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.D40RPw0GtIhb78hmfeWmyC6v-Z17zGF_0 2024-09-14T11:22:50.495 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.495+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5873512788478159762', time=2024-09-14T13:15:00.732250+0000, chain.objs.size()=1 2024-09-14T11:22:50.496 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.495+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.RaJMCLv0xdg1Yh_yxnqYhCFk3Yo_zfS_0 2024-09-14T11:22:50.496 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.495+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10234785049767280578', time=2024-09-14T13:15:00.771773+0000, chain.objs.size()=1 2024-09-14T11:22:50.496 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.495+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.eu3j2sSttv75LBE91jBY1MkTflUMK3I_0 2024-09-14T11:22:50.496 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.495+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.369040037183984312', time=2024-09-14T13:15:00.886511+0000, chain.objs.size()=1 2024-09-14T11:22:50.496 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.495+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.t4CfFSVKVpwi6Y8qZvDaWwoOgrJjzZU_0 2024-09-14T11:22:50.496 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.495+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12634967507998260731', time=2024-09-14T13:15:00.895326+0000, chain.objs.size()=1 2024-09-14T11:22:50.496 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.495+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.kcuODzc3BjtTgEeDWDyce-7n7lFsSvv_0 2024-09-14T11:22:50.498 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.496+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13557342940198305707', time=2024-09-14T13:15:00.908768+0000, chain.objs.size()=1 2024-09-14T11:22:50.498 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.496+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.xfdYGNnVEtHrYrXlrEh6hCUQifkpO3X_0 2024-09-14T11:22:50.498 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.496+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3928796267614872097', time=2024-09-14T13:15:00.913388+0000, chain.objs.size()=1 2024-09-14T11:22:50.498 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.496+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.U6tCzhoi0Bt15g1y-vpk-bwvjifZ3Jo_0 2024-09-14T11:22:50.498 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.496+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2147464901261541147', time=2024-09-14T13:15:00.932906+0000, chain.objs.size()=1 2024-09-14T11:22:50.498 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.496+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.xTYs2xlTDMIXe3KD8zFFVyqiJqbZHKh_0 2024-09-14T11:22:50.498 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.496+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15566972515608525174', time=2024-09-14T13:15:00.940256+0000, chain.objs.size()=1 2024-09-14T11:22:50.498 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.496+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Wqb8grVbv-Vx-MIom2Czk3SEUx49Unr_0 2024-09-14T11:22:50.498 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.496+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5084306049827257756', time=2024-09-14T13:15:01.918362+0000, chain.objs.size()=1 2024-09-14T11:22:50.498 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.496+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.266__shadow_.bCPCrxldITV0Asc4rpmbXe_ESSivhkx_0 2024-09-14T11:22:50.499 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.496+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3153427025443732199', time=2024-09-14T13:15:03.170408+0000, chain.objs.size()=1 2024-09-14T11:22:50.499 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.496+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.271__shadow_.24bWSYKNM9inEb2VubWkn3033_Ut9SH_0 2024-09-14T11:22:50.499 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.496+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15044638082796296843', time=2024-09-14T13:15:03.654043+0000, chain.objs.size()=1 2024-09-14T11:22:50.499 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.496+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.273__shadow_.ElU60LXjefm3Onvapv7s5Keu7y8PnTB_0 2024-09-14T11:22:50.499 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.496+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17397544639264369959', time=2024-09-14T13:15:03.655582+0000, chain.objs.size()=1 2024-09-14T11:22:50.499 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.496+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.273__shadow_._pmNkLyccH2luLQdW33Svjn9bwkIDgl_0 2024-09-14T11:22:50.499 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.497+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6403450768769773111', time=2024-09-14T13:15:04.967167+0000, chain.objs.size()=1 2024-09-14T11:22:50.499 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.497+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.278__shadow_.EAtbuZZu-0W4FBVNzsw6lh7d5LXpg_K_0 2024-09-14T11:22:50.499 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.497+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12360658972883013433', time=2024-09-14T13:15:07.002465+0000, chain.objs.size()=1 2024-09-14T11:22:50.499 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.497+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.285__shadow_.bt7CL1dq_kARK2vWkVb4fNEhuonj19w_0 2024-09-14T11:22:50.499 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.497+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2872868278307160436', time=2024-09-14T13:15:09.833611+0000, chain.objs.size()=1 2024-09-14T11:22:50.499 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.497+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.293__shadow_._3H477rH9ON_G4a8tadahRLzIJvPC0V_0 2024-09-14T11:22:50.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.497+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1026171132098881683', time=2024-09-14T13:15:24.743982+0000, chain.objs.size()=1 2024-09-14T11:22:50.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.497+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.oWrOcK65fguK4xURYyquraD6lkFjLHb_0 2024-09-14T11:22:50.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.498+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5973355865615466622', time=2024-09-14T13:15:24.800232+0000, chain.objs.size()=1 2024-09-14T11:22:50.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.498+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.Y1Vt_FKdzqB8UgUv10xijwtZG1qBk4a_0 2024-09-14T11:22:50.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.498+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10960357469458575021', time=2024-09-14T13:15:24.892078+0000, chain.objs.size()=1 2024-09-14T11:22:50.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.498+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.3XiXO-Fyzlu_ImJGXN0Pv62UYN-kh5G_0 2024-09-14T11:22:50.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.498+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4179535416169379034', time=2024-09-14T13:15:24.894641+0000, chain.objs.size()=1 2024-09-14T11:22:50.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.498+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.XpwN3R_phHRvUN3XNIgZJYKCezzBbzR_0 2024-09-14T11:22:50.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.498+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1275468588436689835', time=2024-09-14T13:15:24.923028+0000, chain.objs.size()=1 2024-09-14T11:22:50.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.498+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.ccfi_22bYqswC6ih3yRFjwQLR5D-Lnu_0 2024-09-14T11:22:50.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.498+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17444323671699932321', time=2024-09-14T13:15:24.947874+0000, chain.objs.size()=1 2024-09-14T11:22:50.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.498+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.WTFdS_McL_RmZj1Xg7Hbexr3-lAfTGK_0 2024-09-14T11:22:50.500 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.499+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15377668239672033735', time=2024-09-14T13:15:24.954222+0000, chain.objs.size()=1 2024-09-14T11:22:50.501 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.499+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.WVEIHpQ92v2T3zCnzgnW3OYAwHys5Xn_0 2024-09-14T11:22:50.501 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.499+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13457527419786828549', time=2024-09-14T13:15:25.052646+0000, chain.objs.size()=1 2024-09-14T11:22:50.501 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.499+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.0ffR_UA0UG6Z-FxXTisEAMwgpcqy9sP_0 2024-09-14T11:22:50.501 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.499+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15033214052553272780', time=2024-09-14T13:15:25.059353+0000, chain.objs.size()=1 2024-09-14T11:22:50.501 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.499+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.JyJElSKqvtLOymBBl06fvWGqRzMz-Xd_0 2024-09-14T11:22:50.501 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.499+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9631710782571098664', time=2024-09-14T13:15:25.085536+0000, chain.objs.size()=1 2024-09-14T11:22:50.501 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.499+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.RoLrnqdZ0kJ0W01PAWsVbkxLBw0caUa_0 2024-09-14T11:22:50.501 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.499+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17315137949388704188', time=2024-09-14T13:15:25.097430+0000, chain.objs.size()=1 2024-09-14T11:22:50.501 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.499+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.fIK2niT_XGN2IUcjSltl0kcmsGE73XU_0 2024-09-14T11:22:50.501 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.499+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7036802052144542463', time=2024-09-14T13:15:25.114542+0000, chain.objs.size()=1 2024-09-14T11:22:50.501 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.499+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.dl5Z6bPynMH7j119dRVd3j0cZTCcLHl_0 2024-09-14T11:22:50.501 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.499+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17039414250129870820', time=2024-09-14T13:15:25.115275+0000, chain.objs.size()=1 2024-09-14T11:22:50.501 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.499+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.4KoGp5McwaAh6sp3Xta2KG2X9Hes5O0_0 2024-09-14T11:22:50.503 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.500+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12272902176473461294', time=2024-09-14T13:15:25.276003+0000, chain.objs.size()=1 2024-09-14T11:22:50.503 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.500+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.f9jPp95f27ZRgVzp-_b6j_3jRQixGpd_0 2024-09-14T11:22:50.503 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.501+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10537991373190076134', time=2024-09-14T13:15:25.400207+0000, chain.objs.size()=1 2024-09-14T11:22:50.503 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.501+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.PAcBiRG2ESr4lpn372oIgZGGMAe6g0k_0 2024-09-14T11:22:50.503 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.501+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16969556831342157917', time=2024-09-14T13:15:25.405142+0000, chain.objs.size()=1 2024-09-14T11:22:50.503 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.501+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.Gqi5ehGzW0Qv2wYynqZR_Swk-S6nxrL_0 2024-09-14T11:22:50.503 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.501+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6362429541534131873', time=2024-09-14T13:15:25.410381+0000, chain.objs.size()=1 2024-09-14T11:22:50.503 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.501+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.6Dwj3WHWXLAiJu37UCiFjHYZLx4Wywr_0 2024-09-14T11:22:50.503 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.501+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.93468939307341124', time=2024-09-14T13:15:25.413687+0000, chain.objs.size()=1 2024-09-14T11:22:50.503 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.501+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.6N_133nAh7vzJzf5b_8pget7kGOV-G4_0 2024-09-14T11:22:50.503 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.501+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15584403321516505722', time=2024-09-14T13:15:25.415849+0000, chain.objs.size()=1 2024-09-14T11:22:50.504 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.501+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.fd3OVOtkPPDyLMw1b8oVV94UAJwKM3R_0 2024-09-14T11:22:50.504 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.501+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1652543623121087295', time=2024-09-14T13:15:25.421808+0000, chain.objs.size()=1 2024-09-14T11:22:50.504 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.501+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.DwvjlUjBQw6mg1FuH7j6V4UblKwHAhN_0 2024-09-14T11:22:50.504 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.501+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16786413525898166075', time=2024-09-14T13:15:25.423329+0000, chain.objs.size()=1 2024-09-14T11:22:50.504 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.501+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.xGzoSI33mwvZlgPMi_z2HUTv6wOx6e3_0 2024-09-14T11:22:50.504 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.501+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18236618277629899716', time=2024-09-14T13:15:25.446390+0000, chain.objs.size()=1 2024-09-14T11:22:50.504 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.501+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.qnBW7bRLuaxd0GuWOBnR0YxZqUy3WNK_0 2024-09-14T11:22:50.504 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.501+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2306012342845714099', time=2024-09-14T13:15:25.543179+0000, chain.objs.size()=1 2024-09-14T11:22:50.504 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.501+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.L3yh0UjfgybZd95pVNbLTmTnOq517Xs_0 2024-09-14T11:22:50.504 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.502+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17122728834477084107', time=2024-09-14T13:15:25.551451+0000, chain.objs.size()=1 2024-09-14T11:22:50.504 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.502+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.3BF_VV6lCxJuZ199so6phvHrZ5wOoq1_0 2024-09-14T11:22:50.504 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.502+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3386421753566587021', time=2024-09-14T13:15:25.570691+0000, chain.objs.size()=1 2024-09-14T11:22:50.504 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.502+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.aS1b5_MTvtvbD3hcraM1P3cU5quAHAS_0 2024-09-14T11:22:50.504 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.502+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9901812375036152331', time=2024-09-14T13:15:25.580678+0000, chain.objs.size()=1 2024-09-14T11:22:50.505 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.502+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.7A9RiUSLaj7mrxhQbHroYPpTnQ6Jw1f_0 2024-09-14T11:22:50.505 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.502+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11172931637247613729', time=2024-09-14T13:15:25.595124+0000, chain.objs.size()=1 2024-09-14T11:22:50.505 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.502+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.ciXdk2Fvd4E8fqHwA0ah9EI0HTs39Rv_0 2024-09-14T11:22:50.505 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.502+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1919570467387359756', time=2024-09-14T13:15:25.690988+0000, chain.objs.size()=1 2024-09-14T11:22:50.505 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.502+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.4JY3b0jSv3KTjPiaEeS3WeQsdMFSEWF_0 2024-09-14T11:22:50.505 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.502+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15998276051345368170', time=2024-09-14T13:15:25.707014+0000, chain.objs.size()=1 2024-09-14T11:22:50.505 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.502+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.AYtSt0HeD7ZQiLxtqdJpFLacKOuCpsY_0 2024-09-14T11:22:50.505 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.502+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4779193729557288032', time=2024-09-14T13:15:25.712797+0000, chain.objs.size()=1 2024-09-14T11:22:50.505 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.502+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.tMzkgQqcWIvHctzkPEy4JqamjiBT4Pq_0 2024-09-14T11:22:50.505 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.502+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14771453646055737354', time=2024-09-14T13:15:25.749385+0000, chain.objs.size()=1 2024-09-14T11:22:50.505 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.502+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.DdmC9YRPvRejie9_cfSdECzr8j2MdkG_0 2024-09-14T11:22:50.505 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.502+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.352601604120421812', time=2024-09-14T13:15:25.768510+0000, chain.objs.size()=1 2024-09-14T11:22:50.506 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.502+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.Dm90_NITQEwFlip2FzUBS9jvrwQoLb4_0 2024-09-14T11:22:50.506 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.504+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8061293976329089496', time=2024-09-14T13:15:25.878342+0000, chain.objs.size()=1 2024-09-14T11:22:50.506 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.504+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.VRUGYWljLSo0uK_Is6RAkYJcsFWdsYG_0 2024-09-14T11:22:50.506 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.504+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2337669226850442099', time=2024-09-14T13:15:25.880090+0000, chain.objs.size()=1 2024-09-14T11:22:50.506 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.504+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.G1kLeYPJhrzlPwq0XE36Fkihu-wTbyT_0 2024-09-14T11:22:50.506 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.504+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14176330445599763989', time=2024-09-14T13:15:25.901981+0000, chain.objs.size()=1 2024-09-14T11:22:50.506 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.504+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.cc2lCnJaKk5sMV4WAwR6D6BtczQ05PD_0 2024-09-14T11:22:50.507 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.505+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14450720255017155525', time=2024-09-14T13:15:25.931824+0000, chain.objs.size()=1 2024-09-14T11:22:50.507 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.505+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.ngFEQWpfdfon9VU6SJUCyfdL_t1vu3H_0 2024-09-14T11:22:50.507 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.505+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4206319565810935748', time=2024-09-14T13:15:33.164007+0000, chain.objs.size()=1 2024-09-14T11:22:50.507 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.505+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.eCvtoF78Epj8-YZNSg3Q9GgYch7ulft_0 2024-09-14T11:22:50.507 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.505+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3425649070593714779', time=2024-09-14T13:15:33.165623+0000, chain.objs.size()=1 2024-09-14T11:22:50.507 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.505+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.LJu_ndNqeuMPvyjs3vgpFphwg18UXQF_0 2024-09-14T11:22:50.508 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.505+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7748438654195317840', time=2024-09-14T13:15:33.166672+0000, chain.objs.size()=1 2024-09-14T11:22:50.508 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.505+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.YTCw99nFvYHd_zAn_phXHQpTAC-OfJA_0 2024-09-14T11:22:50.508 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.505+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6145946914330396069', time=2024-09-14T13:15:33.189873+0000, chain.objs.size()=1 2024-09-14T11:22:50.508 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.505+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.v2RdEnzoboVov9ZNZoEHAbhRejyiGGz_0 2024-09-14T11:22:50.508 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.505+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14555484071742760033', time=2024-09-14T13:15:33.217837+0000, chain.objs.size()=1 2024-09-14T11:22:50.508 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.505+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.LyLk1L7_oieufCvkGCldiAaiG1zeR9k_0 2024-09-14T11:22:50.508 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.505+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2500004008823762947', time=2024-09-14T13:15:33.218596+0000, chain.objs.size()=1 2024-09-14T11:22:50.508 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.505+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.6wDCzxkzSW91RhyAFrdOlwMdhaxWOvv_0 2024-09-14T11:22:50.508 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.505+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1827637426846606427', time=2024-09-14T13:15:33.390633+0000, chain.objs.size()=1 2024-09-14T11:22:50.508 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.505+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.QGl6bfCoAJ0nOtH9ZonDnNkWzyzh7od_0 2024-09-14T11:22:50.508 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.506+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18437820030349302216', time=2024-09-14T13:15:33.418795+0000, chain.objs.size()=1 2024-09-14T11:22:50.508 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.506+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.EzGZf18gjgAW9nL_MiOUeLVpOBUxA18_0 2024-09-14T11:22:50.508 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.506+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15974896521004693439', time=2024-09-14T13:15:33.423496+0000, chain.objs.size()=1 2024-09-14T11:22:50.508 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.506+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.UE6qRSL1HiAx7JmbIx6_JYHajXqOYKR_0 2024-09-14T11:22:50.509 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.506+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4541650458034647709', time=2024-09-14T13:15:33.431370+0000, chain.objs.size()=1 2024-09-14T11:22:50.509 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.506+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.BPGrmmUza4gN8tx38qqUWmMmhXrV0YM_0 2024-09-14T11:22:50.509 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.507+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18112777507851470751', time=2024-09-14T13:15:33.450847+0000, chain.objs.size()=1 2024-09-14T11:22:50.509 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.507+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.iYfL9cCH9i0k0aR5-DgY_Sxm9qi53pq_0 2024-09-14T11:22:50.509 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.507+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9356195768816286024', time=2024-09-14T13:15:33.453694+0000, chain.objs.size()=1 2024-09-14T11:22:50.509 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.507+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.7_CCZkQH1DF6gAmMdakniPhrixXsDLC_0 2024-09-14T11:22:50.509 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.507+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12392537169694442607', time=2024-09-14T13:15:33.531285+0000, chain.objs.size()=1 2024-09-14T11:22:50.509 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.507+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.rl27VLEW9jMy-hDefh9SfiJgStVcc1A_0 2024-09-14T11:22:50.509 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.508+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8493708545047864249', time=2024-09-14T13:15:33.554880+0000, chain.objs.size()=1 2024-09-14T11:22:50.509 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.508+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.AsPyGvOGAM7wvg0ddGJfWU6QV4y1ksM_0 2024-09-14T11:22:50.509 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.508+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7250444461821469644', time=2024-09-14T13:15:33.561479+0000, chain.objs.size()=1 2024-09-14T11:22:50.509 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.508+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.3LNTBO2LmM4UebjnPplihlxrZm7OlAv_0 2024-09-14T11:22:50.509 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.508+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16911503956255252500', time=2024-09-14T13:15:33.565455+0000, chain.objs.size()=1 2024-09-14T11:22:50.510 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.508+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.sFTr8_HCGxt2NXxTy6nNjnFEXsr5QZR_0 2024-09-14T11:22:50.510 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.508+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6236784929357594303', time=2024-09-14T13:15:33.577634+0000, chain.objs.size()=1 2024-09-14T11:22:50.510 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.508+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.S5QyAtrYt-Q1xSvVQidxklvGf3SbyRM_0 2024-09-14T11:22:50.510 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.508+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.278464201897107842', time=2024-09-14T13:15:33.723405+0000, chain.objs.size()=1 2024-09-14T11:22:50.510 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.508+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_._rNLhn9ZgUeMD6psCjKTsdHUNgH2usP_0 2024-09-14T11:22:50.510 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.508+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15258816527913830513', time=2024-09-14T13:15:33.744054+0000, chain.objs.size()=1 2024-09-14T11:22:50.510 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.508+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.DsKM1T1DO3TGryDfu4dJ9yPd6Wh9txW_0 2024-09-14T11:22:50.511 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.509+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4700675512309620092', time=2024-09-14T13:15:33.874424+0000, chain.objs.size()=1 2024-09-14T11:22:50.511 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.509+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.nb3NyO1xydpau4vND2RDJ336jR3Qugb_0 2024-09-14T11:22:50.511 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.509+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12985457172125532516', time=2024-09-14T13:15:33.898340+0000, chain.objs.size()=1 2024-09-14T11:22:50.511 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.509+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.erug_xWyv4vKbI2PiGED9wNkS9WwQAu_0 2024-09-14T11:22:50.511 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.509+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18420697294118840395', time=2024-09-14T13:15:34.214875+0000, chain.objs.size()=1 2024-09-14T11:22:50.511 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.509+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.r6JEYa9g5kfmA6pEZKUpU2z6Lo0czFt_0 2024-09-14T11:22:50.511 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.509+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9860481997930264507', time=2024-09-14T13:15:34.225172+0000, chain.objs.size()=1 2024-09-14T11:22:50.511 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.509+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.d_eUgv9qDCWyN8madHJYsSvJTmbKvZg_0 2024-09-14T11:22:50.511 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.509+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4816369071246431688', time=2024-09-14T13:15:34.229956+0000, chain.objs.size()=1 2024-09-14T11:22:50.511 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.509+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.v-pG3eDHV2MlAWsR8xK16s07SuFgBPQ_0 2024-09-14T11:22:50.512 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.510+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2909830078993759131', time=2024-09-14T13:15:34.257525+0000, chain.objs.size()=1 2024-09-14T11:22:50.512 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.510+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.gRZWiNRfpLDLIjqP4yAuxeLBcCujF5n_0 2024-09-14T11:22:50.512 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.511+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 0/99406 2024-09-14T11:22:50.513 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.513+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=29, truncated=0, next_marker='' 2024-09-14T11:22:50.513 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.513+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7230218982576321309', time=2024-09-14T13:15:34.259310+0000, chain.objs.size()=1 2024-09-14T11:22:50.513 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.513+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.iqtWiLe4bUBUT4tnIsbDwVV1FXhOZCe_0 2024-09-14T11:22:50.513 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.513+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15087330492737063064', time=2024-09-14T13:15:34.355387+0000, chain.objs.size()=1 2024-09-14T11:22:50.513 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.513+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.OTzqDxPtpGBgSJkr-tK2QODMUqkY8ix_0 2024-09-14T11:22:50.513 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.513+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10120477229922848046', time=2024-09-14T13:15:34.361109+0000, chain.objs.size()=1 2024-09-14T11:22:50.513 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.513+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.bIjtvOA2Q11Q7jFi6RjIlSD68zLi3Li_0 2024-09-14T11:22:50.513 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.513+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13002899847268516795', time=2024-09-14T13:15:34.388097+0000, chain.objs.size()=1 2024-09-14T11:22:50.513 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.513+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.XEeWLwI__elVgXl631zxuwaDvift1SP_0 2024-09-14T11:22:50.513 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.513+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15659982224828961354', time=2024-09-14T13:15:35.781207+0000, chain.objs.size()=1 2024-09-14T11:22:50.514 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.513+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.330__shadow_.OIVnKXjr21-C6Ap_BYgXCELgTYGON0w_0 2024-09-14T11:22:50.514 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.513+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11550585620874169977', time=2024-09-14T13:15:39.838261+0000, chain.objs.size()=1 2024-09-14T11:22:50.514 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.513+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.346__shadow_.w3KhyEOjR_1zu3Io5J4r1NxjPBDonLw_0 2024-09-14T11:22:50.514 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.513+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10339228364935243942', time=2024-09-14T13:16:10.628414+0000, chain.objs.size()=1 2024-09-14T11:22:50.514 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.513+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.458__shadow_.sUJNm0D-OYm_6qUzoV6c5ACnEI8mCE4_0 2024-09-14T11:22:50.514 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.513+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9400834170652663085', time=2024-09-14T13:16:13.227008+0000, chain.objs.size()=1 2024-09-14T11:22:50.514 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.513+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.465__shadow_.krecHM9KCkW1AycuprIf46-Ow6Ll8zM_0 2024-09-14T11:22:50.514 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.513+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15876808093472635119', time=2024-09-14T13:16:16.972938+0000, chain.objs.size()=1 2024-09-14T11:22:50.514 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.513+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.483__shadow_.JQDAgORVMWg-aJ78CfJv7LymfVKgaRJ_0 2024-09-14T11:22:50.514 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.513+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9147174771524465120', time=2024-09-14T13:16:16.975767+0000, chain.objs.size()=1 2024-09-14T11:22:50.514 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.513+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.483__shadow_.tWBUsujG9igufBCZCWrmxtix0ueNzVb_0 2024-09-14T11:22:50.514 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.513+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9459411811097797647', time=2024-09-14T13:16:16.976459+0000, chain.objs.size()=1 2024-09-14T11:22:50.514 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.513+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.483__shadow_.jWfTr8BSenBeHU5N-6klllvv4zuO_AD_0 2024-09-14T11:22:50.514 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.513+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6242945438137496505', time=2024-09-14T13:16:17.418391+0000, chain.objs.size()=1 2024-09-14T11:22:50.515 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.513+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.485__shadow_.FsJa7juAD7JPg1dyhMY8xz8yamHmb3y_0 2024-09-14T11:22:50.516 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.515+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13966183531000388392', time=2024-09-14T13:16:21.203947+0000, chain.objs.size()=1 2024-09-14T11:22:50.516 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.515+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.498__shadow_.FqOv8zTmmY0bCe9LbsemuJUwo2db-ez_0 2024-09-14T11:22:50.516 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.515+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16840420211628787629', time=2024-09-14T13:16:26.752584+0000, chain.objs.size()=1 2024-09-14T11:22:50.516 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.515+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.516__multipart_mymultipartcopy.2~vpTxUZ3Dij3BdorIrnipGa9_W2H66DL.1 2024-09-14T11:22:50.516 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.515+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3040829159277619918', time=2024-09-14T13:16:27.914346+0000, chain.objs.size()=1 2024-09-14T11:22:50.516 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.515+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.517__shadow_.bqrxJf8uYahN_8B6oafIrxQeQGnPmV7_0 2024-09-14T11:22:50.516 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.515+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='2~H2xWmCMIzpne_d_6wlanKGAkCjFns5_', time=2024-09-14T13:16:33.967476+0000, chain.objs.size()=1 2024-09-14T11:22:50.516 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.515+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.522__multipart_mymultipart.2~H2xWmCMIzpne_d_6wlanKGAkCjFns5_.2 2024-09-14T11:22:50.516 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.515+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='2~H2xWmCMIzpne_d_6wlanKGAkCjFns5_', time=2024-09-14T13:16:33.968780+0000, chain.objs.size()=1 2024-09-14T11:22:50.516 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.515+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.522__multipart_mymultipart.2~H2xWmCMIzpne_d_6wlanKGAkCjFns5_.3 2024-09-14T11:22:50.516 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.515+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1592021521948181688', time=2024-09-14T13:17:29.667755+0000, chain.objs.size()=1 2024-09-14T11:22:50.517 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.515+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.574__shadow:xnL4a0FzGRVgKcWOszcan4iZ.hWb5Pl_.vqaHyETLLOd3j8Gbd8IbGeF75q2MR0a_0 2024-09-14T11:22:50.517 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.515+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7539392226203149317', time=2024-09-14T13:17:30.860568+0000, chain.objs.size()=1 2024-09-14T11:22:50.517 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.515+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.574__shadow:5Ai3GKT4gbtJEC-uulDBcbylFmVTS-1_.rVlL0WflH25MlSWH2W_cvUc2wJxDTiz_0 2024-09-14T11:22:50.517 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.515+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4927705802738949324', time=2024-09-14T13:17:49.087285+0000, chain.objs.size()=4 2024-09-14T11:22:50.517 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.515+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.578__multipart_testobj.2~dNka2rnwLHep5kxdd1hRPaXVrNNrBTh.1 2024-09-14T11:22:50.517 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.515+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.578__multipart_testobj.2~dNka2rnwLHep5kxdd1hRPaXVrNNrBTh.2 2024-09-14T11:22:50.517 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.516+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.578__multipart_testobj.2~dNka2rnwLHep5kxdd1hRPaXVrNNrBTh.3 2024-09-14T11:22:50.517 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.516+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.578__multipart_testobj.2~dNka2rnwLHep5kxdd1hRPaXVrNNrBTh.4 2024-09-14T11:22:50.517 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.516+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1978356207068891377', time=2024-09-14T13:17:51.112637+0000, chain.objs.size()=1 2024-09-14T11:22:50.517 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.516+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.580__shadow:vUFJDgDaYxHHxUnfuEXUGZuAYhYX3ha_.ufyV9_YsPmHiAGg0tiS5vjjyneUoUsT_0 2024-09-14T11:22:50.517 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.517+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16653685334084460630', time=2024-09-14T13:17:51.833443+0000, chain.objs.size()=1 2024-09-14T11:22:50.517 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.517+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.583__shadow:sfxcVmb7TEdW5-EZ1RKr62Lu2P96oHu_.yqBNkOjgOmK67oRYtrkF0ADr5bHZF-2_0 2024-09-14T11:22:50.518 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.517+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5785008502995896489', time=2024-09-14T13:17:52.804560+0000, chain.objs.size()=1 2024-09-14T11:22:50.518 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.517+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.585__shadow:8r9g5qkoQDzIjTLeXATFpISMPdluaTa_.IHsMloOpf-8yXahf8bgA3-1Urx6Dw9B_0 2024-09-14T11:22:50.518 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.517+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15697422898789108584', time=2024-09-14T13:17:56.931302+0000, chain.objs.size()=1 2024-09-14T11:22:50.518 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.517+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.602__shadow_.amKSonNtjUrYy86CGtu7pL2YQZ5BRw__0 2024-09-14T11:22:50.518 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.518+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6992530995293154223', time=2024-09-14T13:20:10.704215+0000, chain.objs.size()=1 2024-09-14T11:22:50.519 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.518+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.636__shadow_.OVGTV1TaeUcJnkbikiudGTo9-FLB_2w_0 2024-09-14T11:22:50.519 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.518+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9453509979484978366', time=2024-09-14T13:20:13.903619+0000, chain.objs.size()=2 2024-09-14T11:22:50.519 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.518+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.647__shadow_.sEBimZtmsmhXgRQsTzlFjXDUdsySREm_0 2024-09-14T11:22:50.519 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.518+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.647__shadow_.sEBimZtmsmhXgRQsTzlFjXDUdsySREm_1 2024-09-14T11:22:50.519 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.518+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14904583366766659280', time=2024-09-14T13:20:32.651814+0000, chain.objs.size()=1 2024-09-14T11:22:50.519 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.518+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.711__multipart_file1.2~Fwu8TkpzMJEFMiKJSRKAkI0kXdpRTFw.1 2024-09-14T11:22:50.519 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.518+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8072865617163267773', time=2024-09-14T13:21:03.110327+0000, chain.objs.size()=1 2024-09-14T11:22:50.519 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.518+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.746__shadow_.BU5A4L-2OKvmBLwXNdYLsrgMeSsRodr_0 2024-09-14T11:22:50.519 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.518+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3978705357123399486', time=2024-09-14T13:21:04.468082+0000, chain.objs.size()=1 2024-09-14T11:22:50.519 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.518+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.750__shadow_.ZObWDSGswjRARKbX067OKjwrqeQBb4h_0 2024-09-14T11:22:50.520 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.521+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:50.521 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.523+0000 7f0f19c16800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:22:50.523 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.524+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:50.523 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.525+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:50.525 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.526+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48124' 2024-09-14T11:22:50.525 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.526+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9457607449004562610', time=2024-09-14T13:13:37.151517+0000, chain.objs.size()=1 2024-09-14T11:22:50.525 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.526+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.162__shadow_.Vy7ud9VDF2gURh9WfPFYrJoY1YcqLUz_0 2024-09-14T11:22:50.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.526+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1987821746963668140', time=2024-09-14T13:14:47.510120+0000, chain.objs.size()=1 2024-09-14T11:22:50.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.526+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.242__shadow_.KQesYB2toRDUHvxle6GFBH4X0LQUl-4_0 2024-09-14T11:22:50.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.526+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13453741028592880879', time=2024-09-14T13:14:48.366124+0000, chain.objs.size()=1 2024-09-14T11:22:50.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.526+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.245__shadow_.zobYYVQ79kITRsmjg5XutBT6LPzHAr9_0 2024-09-14T11:22:50.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.526+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16914810664567980854', time=2024-09-14T13:14:49.069248+0000, chain.objs.size()=1 2024-09-14T11:22:50.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.526+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.247__shadow_.85KBGiZaPT9wgFSJcMNhzM8QjRINzLy_0 2024-09-14T11:22:50.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.526+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12394062837768872310', time=2024-09-14T13:14:51.596930+0000, chain.objs.size()=1 2024-09-14T11:22:50.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.526+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.257__shadow_.8oly6rzkUxxVFXoJs1nYMdtigoEcbVp_0 2024-09-14T11:22:50.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.526+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9415603489054053647', time=2024-09-14T13:14:59.744886+0000, chain.objs.size()=1 2024-09-14T11:22:50.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.526+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.lHvhTB4EXCLJI9jQy9-y_aVsHEftjCo_0 2024-09-14T11:22:50.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.526+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18122946987657272261', time=2024-09-14T13:14:59.754804+0000, chain.objs.size()=1 2024-09-14T11:22:50.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.526+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.7FFOMpXAAxmSueT83kTDPpzwEiORp6x_0 2024-09-14T11:22:50.526 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.526+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2494515714930710129', time=2024-09-14T13:14:59.787684+0000, chain.objs.size()=1 2024-09-14T11:22:50.527 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.526+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.cjtydAio2ltLaNxclva0DMLzaxfviSx_0 2024-09-14T11:22:50.527 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.526+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1874127558193727152', time=2024-09-14T13:14:59.808885+0000, chain.objs.size()=1 2024-09-14T11:22:50.527 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.526+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.0CcJePdKeZTu-57hR7-JwIs7Cn-aeYE_0 2024-09-14T11:22:50.527 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.526+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6783794582613914845', time=2024-09-14T13:14:59.810928+0000, chain.objs.size()=1 2024-09-14T11:22:50.527 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.526+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.By30yOcrG638wW9rvu-mCPx9_uc9-2S_0 2024-09-14T11:22:50.527 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.526+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2609744717979510147', time=2024-09-14T13:14:59.899974+0000, chain.objs.size()=1 2024-09-14T11:22:50.527 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.526+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.TKcHeN350jx8Vucmxt181KLgT3f1TAV_0 2024-09-14T11:22:50.527 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.526+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8699675730122803437', time=2024-09-14T13:14:59.909388+0000, chain.objs.size()=1 2024-09-14T11:22:50.527 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.526+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.syVGIH2rhDXKA9s0iswW7a-UgLF5qpE_0 2024-09-14T11:22:50.528 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.528+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14552440891800637927', time=2024-09-14T13:14:59.915145+0000, chain.objs.size()=1 2024-09-14T11:22:50.528 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.528+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.dkQpCsOgXqIdpVCnP8ly4cSysaTnmbJ_0 2024-09-14T11:22:50.528 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.528+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16228272928965662810', time=2024-09-14T13:14:59.935216+0000, chain.objs.size()=1 2024-09-14T11:22:50.528 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.528+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.o_TZhgklTYm5qFq9-ebF_wGmsZi73Zp_0 2024-09-14T11:22:50.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.528+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9493247164659692808', time=2024-09-14T13:14:59.946338+0000, chain.objs.size()=1 2024-09-14T11:22:50.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.528+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.L8VJKy6Zb_KOkpqkGJYQjUAXSzZJ3ye_0 2024-09-14T11:22:50.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.529+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12411547853030787937', time=2024-09-14T13:14:59.960332+0000, chain.objs.size()=1 2024-09-14T11:22:50.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.529+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.DIdIAYCr6KQFSZzGE6WE1BiCmG2sgjt_0 2024-09-14T11:22:50.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.529+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11106449945289688147', time=2024-09-14T13:15:00.074782+0000, chain.objs.size()=1 2024-09-14T11:22:50.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.529+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Hpt62EI296iRyW0PUo-dHrE7WHJLnra_0 2024-09-14T11:22:50.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.529+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10495893206689678161', time=2024-09-14T13:15:00.109194+0000, chain.objs.size()=1 2024-09-14T11:22:50.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.529+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.f-kTjGGxJkvu0ehP8RLfKjVmROeNygL_0 2024-09-14T11:22:50.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.529+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6990431661127696918', time=2024-09-14T13:15:00.114684+0000, chain.objs.size()=1 2024-09-14T11:22:50.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.529+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.YbbK6EPpMVowhdKbiiO7hnGZCACjkbX_0 2024-09-14T11:22:50.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.529+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13854821063862458810', time=2024-09-14T13:15:00.141173+0000, chain.objs.size()=1 2024-09-14T11:22:50.529 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.529+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.J9NjxYt7KTrbBNC_1Qt1w53NxvVWFxZ_0 2024-09-14T11:22:50.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.529+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5591802682596149808', time=2024-09-14T13:15:00.149102+0000, chain.objs.size()=1 2024-09-14T11:22:50.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.529+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Rx2mXdD3dcVycI_4jXWbYKW8W6Gk1H0_0 2024-09-14T11:22:50.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.529+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2692900574125740845', time=2024-09-14T13:15:00.254394+0000, chain.objs.size()=1 2024-09-14T11:22:50.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.529+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.6JLQpeX_OWNIVIDhG9ykBT-S3X9baKx_0 2024-09-14T11:22:50.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.529+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8285493384416096102', time=2024-09-14T13:15:00.261520+0000, chain.objs.size()=1 2024-09-14T11:22:50.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.529+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Wlux_2kMVLkfLcIVAQWYtDX2hgvTy0L_0 2024-09-14T11:22:50.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.530+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5936169268876431987', time=2024-09-14T13:15:00.280168+0000, chain.objs.size()=1 2024-09-14T11:22:50.530 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.530+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Uw6DgASgmMBUgaVj-fDaGLYSXHzSP1p_0 2024-09-14T11:22:50.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.530+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4611457453511724172', time=2024-09-14T13:15:00.313063+0000, chain.objs.size()=1 2024-09-14T11:22:50.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.530+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.E4sZbrW1n48DO4Q6o-4G-iEkaHQVFlW_0 2024-09-14T11:22:50.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.530+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1416670832070940631', time=2024-09-14T13:15:00.416434+0000, chain.objs.size()=1 2024-09-14T11:22:50.531 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.530+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.JS3qF7ln5f_AYTQme6jaqugXncf2nBy_0 2024-09-14T11:22:50.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.530+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4534600512549591526', time=2024-09-14T13:15:00.452503+0000, chain.objs.size()=1 2024-09-14T11:22:50.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.530+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.mu8S6yl2Vovd3KrGQFp7NbBAOEsHxev_0 2024-09-14T11:22:50.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.531+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15835205954479404245', time=2024-09-14T13:15:00.473323+0000, chain.objs.size()=1 2024-09-14T11:22:50.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.531+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.d5HPehgGgSbeIkCjUDg1y99IJtTcZpX_0 2024-09-14T11:22:50.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.531+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14152357322511341463', time=2024-09-14T13:15:00.615725+0000, chain.objs.size()=1 2024-09-14T11:22:50.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.531+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.X7VKV9OaHeIpQCywh4DJwD528sIV02H_0 2024-09-14T11:22:50.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.531+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11930541385681421905', time=2024-09-14T13:15:00.636663+0000, chain.objs.size()=1 2024-09-14T11:22:50.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.532+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.PZpJekecGuWwyuMWQOQFVvrePkMcN3c_0 2024-09-14T11:22:50.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.532+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1003457621106249431', time=2024-09-14T13:15:00.750344+0000, chain.objs.size()=1 2024-09-14T11:22:50.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.532+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.CMJcUgLO4fhqFnoYKLAB34qMd5UcHqj_0 2024-09-14T11:22:50.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.532+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9282982028012879108', time=2024-09-14T13:15:00.768135+0000, chain.objs.size()=1 2024-09-14T11:22:50.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.532+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.bM7JNLWXWhqVOMeEB4oBJ8jVg1OqQrR_0 2024-09-14T11:22:50.532 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.532+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4304678881197669553', time=2024-09-14T13:15:00.777921+0000, chain.objs.size()=1 2024-09-14T11:22:50.533 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.532+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.VEn1-Voyg6mJRF4tMzdyyG99ycKJ1Wb_0 2024-09-14T11:22:50.533 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.532+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3040257915567086494', time=2024-09-14T13:15:00.794953+0000, chain.objs.size()=1 2024-09-14T11:22:50.533 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.532+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.6F8Uw9eVbwLVLQWqf_IE3Vr56opxHoB_0 2024-09-14T11:22:50.533 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.532+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2547789903289282942', time=2024-09-14T13:15:00.899876+0000, chain.objs.size()=1 2024-09-14T11:22:50.533 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.532+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.E1T8-I6VIAleK4zmver7FKiGC3shf8Y_0 2024-09-14T11:22:50.533 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.532+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14562122858938568483', time=2024-09-14T13:15:00.906971+0000, chain.objs.size()=1 2024-09-14T11:22:50.533 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.532+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.dqs7mvL8aXacBiHBkXKD4s01IKOJ2fp_0 2024-09-14T11:22:50.533 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.532+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2187202260383792282', time=2024-09-14T13:15:00.936516+0000, chain.objs.size()=1 2024-09-14T11:22:50.533 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.532+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.dAreEPQr42CgtPFh_Kukqerzx7kGWXx_0 2024-09-14T11:22:50.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.534+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12981553207429283549', time=2024-09-14T13:15:01.153395+0000, chain.objs.size()=1 2024-09-14T11:22:50.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.534+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.263__shadow_.vWF3BtBQrbwYfGQncbCN88FhrIhs0L1_0 2024-09-14T11:22:50.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.534+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7365269154959966546', time=2024-09-14T13:15:04.717234+0000, chain.objs.size()=1 2024-09-14T11:22:50.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.534+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.277__shadow_.NuO2FFf1Ka2ovuy_rOXCOf0WEu6L9EB_0 2024-09-14T11:22:50.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.534+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3550375317086479199', time=2024-09-14T13:15:05.467575+0000, chain.objs.size()=1 2024-09-14T11:22:50.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.534+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.280__shadow_.hvJbYbHEEkntPhNCTWCYH9JUO-5SW7H_0 2024-09-14T11:22:50.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.534+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13704720372925555413', time=2024-09-14T13:15:13.404901+0000, chain.objs.size()=1 2024-09-14T11:22:50.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.534+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.306__shadow_.jGK_0OB3xWDoO_wVe0PPiU47YmNpLhV_0 2024-09-14T11:22:50.534 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.534+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8735191983829373406', time=2024-09-14T13:15:13.917865+0000, chain.objs.size()=1 2024-09-14T11:22:50.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.534+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.307__shadow:F0c04GaGmL26Ehyd606TVU.fr.23Iql_.ack26CllDJwvADKD0vxFwW5BuMJzJf0_0 2024-09-14T11:22:50.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.534+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2920332069179718155', time=2024-09-14T13:15:16.605535+0000, chain.objs.size()=1 2024-09-14T11:22:50.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.534+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.319__shadow:SlgxkpG4mXu-3GOdQSG.tvTiXy3.kGF_.WMt3BMUY7UV9cKv3uf2R39buc3NOsW4_0 2024-09-14T11:22:50.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.534+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11614244032641359747', time=2024-09-14T13:15:24.716240+0000, chain.objs.size()=1 2024-09-14T11:22:50.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.534+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.us4jPi7dRrVtnEM0rYa_TQVny1VeDwV_0 2024-09-14T11:22:50.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.534+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16306857321439806751', time=2024-09-14T13:15:24.739527+0000, chain.objs.size()=1 2024-09-14T11:22:50.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.534+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.sPnXLSQrnWHsYjvpLmkrIoyW0zWuioI_0 2024-09-14T11:22:50.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.534+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3982981041263076841', time=2024-09-14T13:15:24.746870+0000, chain.objs.size()=1 2024-09-14T11:22:50.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.534+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.2HPLNMO0HBV9uDkUtF7Vpj4UnYTklMy_0 2024-09-14T11:22:50.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.534+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8921596058256419832', time=2024-09-14T13:15:24.755098+0000, chain.objs.size()=1 2024-09-14T11:22:50.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.534+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.OqNKD0z34cfFbfzO6bLF8poN4Zfv9Ha_0 2024-09-14T11:22:50.535 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.534+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5685218535692292772', time=2024-09-14T13:15:24.769859+0000, chain.objs.size()=1 2024-09-14T11:22:50.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.534+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.7e7DwxMwWTYxlNue4y7p8XqSErhF3aB_0 2024-09-14T11:22:50.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.536+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.486292707219796986', time=2024-09-14T13:15:24.774174+0000, chain.objs.size()=1 2024-09-14T11:22:50.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.536+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.0NjTyHkYoUQ4gS6k8NiYPjA19tor23u_0 2024-09-14T11:22:50.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.536+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15985485375436492666', time=2024-09-14T13:15:24.786341+0000, chain.objs.size()=1 2024-09-14T11:22:50.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.536+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.1V0jeJDSG3nkFBrhyYA5jX3G55esZho_0 2024-09-14T11:22:50.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.536+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17268073572125433551', time=2024-09-14T13:15:24.880682+0000, chain.objs.size()=1 2024-09-14T11:22:50.536 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.536+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.XgryqPb22msMBGudEx6_lVj-8uz9qPs_0 2024-09-14T11:22:50.537 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.537+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6477123509877536500', time=2024-09-14T13:15:24.906830+0000, chain.objs.size()=1 2024-09-14T11:22:50.537 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.537+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.DpbqPhan3x1RsWqWCS62WA23GAWpzB3_0 2024-09-14T11:22:50.537 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.537+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13709069138653165617', time=2024-09-14T13:15:24.907558+0000, chain.objs.size()=1 2024-09-14T11:22:50.537 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.537+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.MhUNFz8kFTnG_EZ30OIVrfzC3BNcJ6p_0 2024-09-14T11:22:50.537 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.537+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13234661338896145089', time=2024-09-14T13:15:24.908292+0000, chain.objs.size()=1 2024-09-14T11:22:50.537 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.537+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.cQwN1z6w_AAWkD0POFTDrsS3g0FEhik_0 2024-09-14T11:22:50.537 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.537+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.214223368679526783', time=2024-09-14T13:15:24.914132+0000, chain.objs.size()=1 2024-09-14T11:22:50.537 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.537+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.oKHYDjeiutNm0vu_9dKR8qZhOX5Kczo_0 2024-09-14T11:22:50.537 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.537+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3815303134279842328', time=2024-09-14T13:15:24.936836+0000, chain.objs.size()=1 2024-09-14T11:22:50.537 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.537+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.Zwg5wvWtSFYOD5dvB0JEwlXM_IfbAce_0 2024-09-14T11:22:50.537 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.537+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6171621293720304196', time=2024-09-14T13:15:24.951975+0000, chain.objs.size()=1 2024-09-14T11:22:50.537 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.537+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.j_OMzPfgr78EJgGMTexEPZ0u-tO9Jcv_0 2024-09-14T11:22:50.537 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.537+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9904109139655772997', time=2024-09-14T13:15:24.965207+0000, chain.objs.size()=1 2024-09-14T11:22:50.538 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.537+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.idA_YAYhnsoQKYtZ1R0DI-OqyoVtYqQ_0 2024-09-14T11:22:50.538 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.537+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13361759351461868006', time=2024-09-14T13:15:25.047922+0000, chain.objs.size()=1 2024-09-14T11:22:50.538 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.537+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.TXSDTw3MQZzjIFnMLT0eS393ut9_eIx_0 2024-09-14T11:22:50.539 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.538+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1209092929313647934', time=2024-09-14T13:15:25.079643+0000, chain.objs.size()=1 2024-09-14T11:22:50.539 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.538+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.Z4W4Pd12mPY9SW95wAzUSLZ86l2uKFo_0 2024-09-14T11:22:50.539 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.538+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5487089125971164118', time=2024-09-14T13:15:25.089095+0000, chain.objs.size()=1 2024-09-14T11:22:50.539 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.538+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.L4Vo3RVaIpCYQRKncw7_V52oyiYWwDL_0 2024-09-14T11:22:50.539 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.539+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7789613702593423368', time=2024-09-14T13:15:25.100399+0000, chain.objs.size()=1 2024-09-14T11:22:50.540 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.539+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.PfyQSArnknnHGlvUSXqaSYakmqwc_cM_0 2024-09-14T11:22:50.540 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.539+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10080901794482270370', time=2024-09-14T13:15:25.209413+0000, chain.objs.size()=1 2024-09-14T11:22:50.540 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.539+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.SvDatwxbwvkXxeZy7s_pc6ajRz0b8nd_0 2024-09-14T11:22:50.540 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.539+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7199873096058206161', time=2024-09-14T13:15:25.229536+0000, chain.objs.size()=1 2024-09-14T11:22:50.540 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.539+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.TzBC7OS7vVFIlAjE88pKopof9JApzfy_0 2024-09-14T11:22:50.540 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.539+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5589241318003196847', time=2024-09-14T13:15:25.231846+0000, chain.objs.size()=1 2024-09-14T11:22:50.540 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.539+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.EuAfxNjt9eqa35JzxZqO6Qa7UObYL3O_0 2024-09-14T11:22:50.540 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.539+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1460986404459219108', time=2024-09-14T13:15:25.264995+0000, chain.objs.size()=1 2024-09-14T11:22:50.540 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.539+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.nKpm5x2H_8H8OaUsYID3XX7ofrIb0Jg_0 2024-09-14T11:22:50.540 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.539+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.347710100603291306', time=2024-09-14T13:15:25.273962+0000, chain.objs.size()=1 2024-09-14T11:22:50.540 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.539+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.MxMreNAIeD9enz301jJO2mfdfQliacV_0 2024-09-14T11:22:50.540 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.539+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16865020647517087762', time=2024-09-14T13:15:25.386087+0000, chain.objs.size()=1 2024-09-14T11:22:50.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.539+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.dvetQvGsYmJRducz9NhgEiNa4f3IASP_0 2024-09-14T11:22:50.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.539+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12746976806567685237', time=2024-09-14T13:15:25.404476+0000, chain.objs.size()=1 2024-09-14T11:22:50.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.539+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.NBihmMxRMWuLlJ2X9nXArDxu_6BwsoC_0 2024-09-14T11:22:50.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.539+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16701969414295102989', time=2024-09-14T13:15:25.417113+0000, chain.objs.size()=1 2024-09-14T11:22:50.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.539+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.yJ7bPGSnUyHYKJe1DGV51tfUjXhGLbl_0 2024-09-14T11:22:50.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.540+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11487600368894012105', time=2024-09-14T13:15:25.450414+0000, chain.objs.size()=1 2024-09-14T11:22:50.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.540+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.YNJOV1pHdvryBt3q3dgVrFCFCeYCLiQ_0 2024-09-14T11:22:50.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.540+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9542110000537453185', time=2024-09-14T13:15:25.586803+0000, chain.objs.size()=1 2024-09-14T11:22:50.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.540+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.H-fOwx3x-bUwxsYCBlm8BQoIo7qG4qo_0 2024-09-14T11:22:50.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.540+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10020382450699929609', time=2024-09-14T13:15:25.690433+0000, chain.objs.size()=1 2024-09-14T11:22:50.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.540+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.RfJMBmpr4vee4DoySakc3Xgq057RS-w_0 2024-09-14T11:22:50.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.541+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17961283699010648589', time=2024-09-14T13:15:25.697897+0000, chain.objs.size()=1 2024-09-14T11:22:50.541 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.541+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.dRLW1I-HBkqd80md8yUefLJFcfvWO06_0 2024-09-14T11:22:50.543 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.541+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.603818550050733525', time=2024-09-14T13:15:25.750850+0000, chain.objs.size()=1 2024-09-14T11:22:50.543 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.541+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.xcfiGyBuZQDqCZSuUTTb3_HD0scAJ3G_0 2024-09-14T11:22:50.543 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.541+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9366610149573764460', time=2024-09-14T13:15:25.768795+0000, chain.objs.size()=1 2024-09-14T11:22:50.543 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.541+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.N-TzCwQAH46wd3jW6WpYjo5afhuP5W1_0 2024-09-14T11:22:50.543 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.541+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9180460347790355045', time=2024-09-14T13:15:25.903493+0000, chain.objs.size()=1 2024-09-14T11:22:50.543 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.541+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.e2bEH1OjKGx4l6W17oOKf6og0Hr5tcL_0 2024-09-14T11:22:50.544 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.541+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15811609225942896288', time=2024-09-14T13:15:25.914853+0000, chain.objs.size()=1 2024-09-14T11:22:50.544 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.541+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.itKmsdCb2XyVOMZIjbZhI14zFAa7fzC_0 2024-09-14T11:22:50.544 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.541+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6642059097437130107', time=2024-09-14T13:15:25.934722+0000, chain.objs.size()=1 2024-09-14T11:22:50.544 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.541+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.sCwfSMdXCx5DlolT4njR6WYV7cmbZVv_0 2024-09-14T11:22:50.544 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.541+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2774593540078284389', time=2024-09-14T13:15:25.939700+0000, chain.objs.size()=1 2024-09-14T11:22:50.544 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.541+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.NWJmvOa38DE1YcG_Vslytk8ubjEA6_H_0 2024-09-14T11:22:50.544 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.541+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8375621667723547848', time=2024-09-14T13:15:33.164128+0000, chain.objs.size()=1 2024-09-14T11:22:50.544 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.541+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.xikZaf16MfsCzZ_839y1jhfuFlfO6cH_0 2024-09-14T11:22:50.544 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.541+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18121558364471768012', time=2024-09-14T13:15:33.165742+0000, chain.objs.size()=1 2024-09-14T11:22:50.544 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.541+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.nzKfhQtCIDYY075j0FolK1wJ6ctJ1nL_0 2024-09-14T11:22:50.544 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.542+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7886089724507772121', time=2024-09-14T13:15:33.199981+0000, chain.objs.size()=1 2024-09-14T11:22:50.544 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.542+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.xPfFkilEb6AwDoUBJ-kpQodaZcW7ayh_0 2024-09-14T11:22:50.544 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.542+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17714583865663458656', time=2024-09-14T13:15:33.226620+0000, chain.objs.size()=1 2024-09-14T11:22:50.545 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.542+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.qdXtihZrOsHBuKKi9OehLevb-ZdCX8r_0 2024-09-14T11:22:50.545 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.542+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.446505989947134099', time=2024-09-14T13:15:33.238132+0000, chain.objs.size()=1 2024-09-14T11:22:50.545 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.542+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.a5bRcOTkU0pbv0mnBgoIKaaBCyqJUqi_0 2024-09-14T11:22:50.545 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.543+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8194130994875751169', time=2024-09-14T13:15:33.253460+0000, chain.objs.size()=1 2024-09-14T11:22:50.545 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.543+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.4_Mhxq9R06H7yRXY8ErxnomzFXRmaIJ_0 2024-09-14T11:22:50.545 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.543+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17365885575546665358', time=2024-09-14T13:15:33.381667+0000, chain.objs.size()=1 2024-09-14T11:22:50.545 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.543+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.dWLhE-cVvXCgDhcW08EXZ4qWelCh6yQ_0 2024-09-14T11:22:50.545 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.543+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17148414765271928921', time=2024-09-14T13:15:33.400836+0000, chain.objs.size()=1 2024-09-14T11:22:50.545 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.543+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.U7KNJhBUWZUIHM9BfBSbiIRdLPV0eve_0 2024-09-14T11:22:50.545 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.543+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14068894934297933192', time=2024-09-14T13:15:33.429028+0000, chain.objs.size()=1 2024-09-14T11:22:50.545 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.543+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.xlGUb0FOCiMrr8b-bzJec8X1vqrJ_AF_0 2024-09-14T11:22:50.545 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.544+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5327216232074812365', time=2024-09-14T13:15:33.528851+0000, chain.objs.size()=1 2024-09-14T11:22:50.545 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.544+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.CtnZCinMhTm3i4ZJjDRDVRtnfd1e2O9_0 2024-09-14T11:22:50.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.544+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13633352561234151802', time=2024-09-14T13:15:33.530064+0000, chain.objs.size()=1 2024-09-14T11:22:50.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.544+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.E2--Eqa9b9Fn45vUSlNaJ8pSnn1-JGr_0 2024-09-14T11:22:50.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.544+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11954025860074233840', time=2024-09-14T13:15:33.552387+0000, chain.objs.size()=1 2024-09-14T11:22:50.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.544+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.XYj5KSlsF02hckKd9YOWz23CxirZurS_0 2024-09-14T11:22:50.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.544+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14839716133436909945', time=2024-09-14T13:15:33.567473+0000, chain.objs.size()=1 2024-09-14T11:22:50.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.544+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.wwmyqmikDIQExTZQSF8zw619ZkbOu6__0 2024-09-14T11:22:50.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.544+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9845170463581980528', time=2024-09-14T13:15:33.599542+0000, chain.objs.size()=1 2024-09-14T11:22:50.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.544+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.EHOD_Ir-qpNvrqWxU1HDWn6zYMAFUco_0 2024-09-14T11:22:50.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.545+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5464041058030425837', time=2024-09-14T13:15:33.690538+0000, chain.objs.size()=1 2024-09-14T11:22:50.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.545+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.dipoK8Uc1ZuTnYBvrtBS9mx_uKptarX_0 2024-09-14T11:22:50.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.545+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5167044371755378958', time=2024-09-14T13:15:33.695125+0000, chain.objs.size()=1 2024-09-14T11:22:50.546 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.545+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.T9qNMXxBELj1PUnFQzMhycY3hOCEm8a_0 2024-09-14T11:22:50.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.546+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4380880112961434573', time=2024-09-14T13:15:33.713663+0000, chain.objs.size()=1 2024-09-14T11:22:50.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.546+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.BcTYY3wPw8cms4wzVdYyNZW4r0NnPCM_0 2024-09-14T11:22:50.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.546+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16467572355491352419', time=2024-09-14T13:15:33.718268+0000, chain.objs.size()=1 2024-09-14T11:22:50.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.546+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.AEC46A837c9v9zDdX0Vo-M9hOZkUcKT_0 2024-09-14T11:22:50.547 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.546+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3441704967254083936', time=2024-09-14T13:15:33.754279+0000, chain.objs.size()=1 2024-09-14T11:22:50.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.546+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.ZhGM2dt2gj-9ZJzhIoUmAgDajMAIO1d_0 2024-09-14T11:22:50.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.546+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.172009591492241555', time=2024-09-14T13:15:33.772639+0000, chain.objs.size()=1 2024-09-14T11:22:50.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.546+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.y_KuviO5A5R0LBwllNkvt0_VcEK-2Gu_0 2024-09-14T11:22:50.548 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.548+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 0/48124 2024-09-14T11:22:50.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.550+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=27, truncated=0, next_marker='' 2024-09-14T11:22:50.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.550+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1224091164820843743', time=2024-09-14T13:15:33.777716+0000, chain.objs.size()=1 2024-09-14T11:22:50.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.550+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.zaIA7Ew3doLl2GPxMRuLQcqMeRxSmKI_0 2024-09-14T11:22:50.549 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.550+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12840098684031782513', time=2024-09-14T13:15:33.852581+0000, chain.objs.size()=1 2024-09-14T11:22:50.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.550+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.JzXH9qr_px1XeDpmjqEW0dvd0PVG9PT_0 2024-09-14T11:22:50.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.550+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1889834866138030378', time=2024-09-14T13:15:33.854337+0000, chain.objs.size()=1 2024-09-14T11:22:50.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.550+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.TvBsjDXTCkfGcbiXpt7CJ0KrjqY88E__0 2024-09-14T11:22:50.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.550+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11509647345138526770', time=2024-09-14T13:15:33.881423+0000, chain.objs.size()=1 2024-09-14T11:22:50.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.550+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.V1c_-68Pz_gA3zp3qGPon-xAUEiswZ__0 2024-09-14T11:22:50.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.550+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2475941085856380967', time=2024-09-14T13:15:33.885373+0000, chain.objs.size()=1 2024-09-14T11:22:50.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.550+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.KziCQkghjDocFVJGtcxRkh-tU2a8B-i_0 2024-09-14T11:22:50.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.550+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11490937874510753738', time=2024-09-14T13:15:33.904475+0000, chain.objs.size()=1 2024-09-14T11:22:50.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.550+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.oZmPE30YVPDlmx7iKiWWursAWC4LFyH_0 2024-09-14T11:22:50.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.550+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11245156462682348733', time=2024-09-14T13:15:33.936198+0000, chain.objs.size()=1 2024-09-14T11:22:50.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.550+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.InqbyzNn_Z5Y9rCs8ZCKBOA5DjuceNp_0 2024-09-14T11:22:50.550 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.550+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9301822786080846295', time=2024-09-14T13:15:33.938226+0000, chain.objs.size()=1 2024-09-14T11:22:50.551 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.550+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Sfi-_mqR1eaIn1lNzX-kf2loKcpehs2_0 2024-09-14T11:22:50.551 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.550+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6199910173306873863', time=2024-09-14T13:15:34.033202+0000, chain.objs.size()=1 2024-09-14T11:22:50.551 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.550+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.R4vtxJcg-h4yHrfJ--Qt515vWILTRO6_0 2024-09-14T11:22:50.551 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.550+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15281947066314482159', time=2024-09-14T13:15:34.190182+0000, chain.objs.size()=1 2024-09-14T11:22:50.551 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.550+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.HueK2S2gkYP_spBAF_3X7sCyeBuBGPc_0 2024-09-14T11:22:50.551 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.550+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14659442522110927798', time=2024-09-14T13:15:34.198459+0000, chain.objs.size()=1 2024-09-14T11:22:50.551 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.550+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.anDIO5Rqgog0Uq2p0ReasG4odzBZC16_0 2024-09-14T11:22:50.551 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.550+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5713911450309107571', time=2024-09-14T13:15:34.332580+0000, chain.objs.size()=1 2024-09-14T11:22:50.551 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.550+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.rWp3Y1RMOlJLjEik2oCzjY-mqmByaLd_0 2024-09-14T11:22:50.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.552+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17386699987463595284', time=2024-09-14T13:15:34.395941+0000, chain.objs.size()=1 2024-09-14T11:22:50.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.552+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.LEjY0EU3k6mOawEDFZ9jLbeN1u_Zdum_0 2024-09-14T11:22:50.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.552+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.962509260708462130', time=2024-09-14T13:15:36.529202+0000, chain.objs.size()=1 2024-09-14T11:22:50.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.552+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.333__shadow_.sUflXrBeUKFUZtv5NFQQOFBtmW5IVzu_0 2024-09-14T11:22:50.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.552+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3710866014650685869', time=2024-09-14T13:16:13.758862+0000, chain.objs.size()=1 2024-09-14T11:22:50.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.552+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.466__shadow_.Ar2p6VlooA3GMfGxzPDUBvR8nolLUFR_0 2024-09-14T11:22:50.552 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.552+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12247377739860199339', time=2024-09-14T13:16:16.973300+0000, chain.objs.size()=1 2024-09-14T11:22:50.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.552+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.483__shadow_.1kRZpe4uFpWjJYSuwFKsvJhZPrvI9xP_0 2024-09-14T11:22:50.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.552+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5456416690534148984', time=2024-09-14T13:16:20.300658+0000, chain.objs.size()=1 2024-09-14T11:22:50.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.552+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.495__shadow_.UZZl6LM-kwvyQjLvXwhbYs2ho3hFpmB_0 2024-09-14T11:22:50.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.552+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2439321244551932986', time=2024-09-14T13:16:22.919081+0000, chain.objs.size()=1 2024-09-14T11:22:50.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.552+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.503__shadow:pymE41PAtqbkcQ6I2URloKvd5muPSJ-_.UInzhQl7TQvRYLWzEBL5Aj5TYH25pWP_0 2024-09-14T11:22:50.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.552+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3230636927432836278', time=2024-09-14T13:16:24.893703+0000, chain.objs.size()=6 2024-09-14T11:22:50.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.552+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.507__multipart_srcmultipart.2~EQ3ZZNALHrAJsVAZLD-5msuDtyJwYup.1 2024-09-14T11:22:50.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.552+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.507__multipart_srcmultipart.2~EQ3ZZNALHrAJsVAZLD-5msuDtyJwYup.2 2024-09-14T11:22:50.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.552+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.507__multipart_srcmultipart.2~EQ3ZZNALHrAJsVAZLD-5msuDtyJwYup.3 2024-09-14T11:22:50.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.552+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.507__multipart_srcmultipart.2~EQ3ZZNALHrAJsVAZLD-5msuDtyJwYup.4 2024-09-14T11:22:50.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.552+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.507__multipart_srcmultipart.2~EQ3ZZNALHrAJsVAZLD-5msuDtyJwYup.5 2024-09-14T11:22:50.553 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.553+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.507__multipart_srcmultipart.2~EQ3ZZNALHrAJsVAZLD-5msuDtyJwYup.6 2024-09-14T11:22:50.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.553+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7855026096093220795', time=2024-09-14T13:16:25.339573+0000, chain.objs.size()=1 2024-09-14T11:22:50.554 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.553+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.511__multipart_mymultipart.2~4ao95wtW1XUzS4ETL-s-4lONJojzuS1.1 2024-09-14T11:22:50.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.554+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2090235289800847775', time=2024-09-14T13:16:33.974107+0000, chain.objs.size()=6 2024-09-14T11:22:50.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.554+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.522__multipart_mymultipart.2~NIiQv7HsECjfM7HXopuifuR-QJFlx3l.1 2024-09-14T11:22:50.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.554+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.522__multipart_mymultipart.2~NIiQv7HsECjfM7HXopuifuR-QJFlx3l.2 2024-09-14T11:22:50.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.554+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.522__multipart_mymultipart.zqqsYcKzhjNecXQ_wJnFc05iIrG6-7mB.3 2024-09-14T11:22:50.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.554+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.522__multipart_mymultipart.2~NIiQv7HsECjfM7HXopuifuR-QJFlx3l.4 2024-09-14T11:22:50.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.554+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.522__multipart_mymultipart.2~NIiQv7HsECjfM7HXopuifuR-QJFlx3l.5 2024-09-14T11:22:50.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.555+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.522__multipart_mymultipart.2~NIiQv7HsECjfM7HXopuifuR-QJFlx3l.6 2024-09-14T11:22:50.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.555+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14720708375705773125', time=2024-09-14T13:16:35.290434+0000, chain.objs.size()=6 2024-09-14T11:22:50.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.555+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.522__multipart_mymultipart.nXsyfVywJZaFi5d4uFdD9GFP828QbGDf.1 2024-09-14T11:22:50.555 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.555+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.522__multipart_mymultipart.fwgLTmZ6Lang6lmgyF3aoReFFUIwO33k.2 2024-09-14T11:22:50.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.555+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.522__multipart_mymultipart.-9rpgH-yKJyNfhYu7V_fMNtKWL4Lrgkf.3 2024-09-14T11:22:50.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.555+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.522__multipart_mymultipart.daAi-qWgAcap6q8N1jZpuXF_PIhvlAKn.4 2024-09-14T11:22:50.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.555+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.522__multipart_mymultipart.AsaJa0G_n04mBSZGPDs3dDP6mEQfa04n.5 2024-09-14T11:22:50.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.556+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.522__multipart_mymultipart.dhJT-p_KsluCEomcri17D9RmzJu0jBrR.6 2024-09-14T11:22:50.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.556+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6538090555964333695', time=2024-09-14T13:17:15.174551+0000, chain.objs.size()=1 2024-09-14T11:22:50.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.556+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.562__shadow_.YIIgFTEl3AlLO7RZYpYrD5idspnS-Eh_0 2024-09-14T11:22:50.556 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.557+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4100678465085223980', time=2024-09-14T13:17:31.051637+0000, chain.objs.size()=1 2024-09-14T11:22:50.557 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.557+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.574__shadow:5EcvhA3ORx8ka4hGA.-LfbuGbng4KUK_.tjq0yVl2ULyu42M0ltFk9uuzctfSo0v_0 2024-09-14T11:22:50.557 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.557+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1000387769208484259', time=2024-09-14T13:17:53.156652+0000, chain.objs.size()=1 2024-09-14T11:22:50.557 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.557+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.586__shadow:6bC3gdfQT0o7aJLGGMuo1Qcq30UJmOd_.1roTD2RbA9qIjsSOe3UvJe_TCmvfXht_0 2024-09-14T11:22:50.557 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.557+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2863969448749477620', time=2024-09-14T13:20:04.858198+0000, chain.objs.size()=1 2024-09-14T11:22:50.557 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.557+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.620__shadow_.gvKzo5THdgD9fBB3ScVGOWIHPQeXAfe_0 2024-09-14T11:22:50.557 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.557+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15627551248515893650', time=2024-09-14T13:20:21.234710+0000, chain.objs.size()=1 2024-09-14T11:22:50.557 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.557+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.666__shadow_.eJgNfJqkJR_mqNRd80I3KKlkXbdqKW2_0 2024-09-14T11:22:50.557 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.559+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:50.560 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.561+0000 7f0f19c16800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:22:50.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.562+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:50.561 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.563+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:50.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.563+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43970' 2024-09-14T11:22:50.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.563+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8255690957247670270', time=2024-09-14T13:13:32.822482+0000, chain.objs.size()=1 2024-09-14T11:22:50.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.563+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.157__shadow:Fj9jydKm.eRV.QImRvYXZCo2AXNT0Kf_.ChY4x07DpYpPU-VjN2CsdK2vvr6qwzW_0 2024-09-14T11:22:50.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.563+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15291768249464279346', time=2024-09-14T13:13:45.357095+0000, chain.objs.size()=1 2024-09-14T11:22:50.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.563+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.183__shadow_._svIZ-mWDzs79S_J7LVU6XZhy9Ht-Id_0 2024-09-14T11:22:50.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.563+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.923605318594581630', time=2024-09-14T13:14:45.124860+0000, chain.objs.size()=1 2024-09-14T11:22:50.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.563+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.233__shadow_.rt0vvsQNV_haLNruqwkb0LiGGVX4M8l_0 2024-09-14T11:22:50.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.564+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10723249595062829055', time=2024-09-14T13:14:45.126248+0000, chain.objs.size()=1 2024-09-14T11:22:50.563 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.564+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.233__shadow_.iYwq2wAwczuOM5-7YR95q0-LTkwwr7J_0 2024-09-14T11:22:50.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.564+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11823002203795205727', time=2024-09-14T13:14:47.224829+0000, chain.objs.size()=1 2024-09-14T11:22:50.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.564+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.241__shadow_.9F2hnSmxpsvADxUJnOAzoB7vn-uCDHF_0 2024-09-14T11:22:50.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.564+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6328918587243183245', time=2024-09-14T13:14:59.737120+0000, chain.objs.size()=1 2024-09-14T11:22:50.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.564+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.FR0AP7yJG0QmYek_ZzxjPh3F_KFDRuS_0 2024-09-14T11:22:50.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.564+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9757945207894586749', time=2024-09-14T13:14:59.748080+0000, chain.objs.size()=1 2024-09-14T11:22:50.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.564+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.P4YqD03fIEpQFyceuhMarD0E0ZqzZ3l_0 2024-09-14T11:22:50.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.564+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5148706867533603215', time=2024-09-14T13:14:59.782228+0000, chain.objs.size()=1 2024-09-14T11:22:50.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.564+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.bJjEW3jNUwh5FoqbQYeWysNg87o-j7c_0 2024-09-14T11:22:50.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.564+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14968874247482314310', time=2024-09-14T13:14:59.783987+0000, chain.objs.size()=1 2024-09-14T11:22:50.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.564+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Cpl_OmCspkuMr7fNVzXU7bV5oMh9aJF_0 2024-09-14T11:22:50.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.564+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16615909033720998583', time=2024-09-14T13:14:59.820198+0000, chain.objs.size()=1 2024-09-14T11:22:50.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.564+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.gXOpszfvCJ2DMxxMbAbOwFpbZTRGs6c_0 2024-09-14T11:22:50.564 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.564+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18197468614219152438', time=2024-09-14T13:14:59.822543+0000, chain.objs.size()=1 2024-09-14T11:22:50.565 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.564+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.gPwcxn3zZn75kBdpMhthHECPR2c78u2_0 2024-09-14T11:22:50.565 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.564+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1136492703619691294', time=2024-09-14T13:14:59.941058+0000, chain.objs.size()=1 2024-09-14T11:22:50.565 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.564+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.KiPtThs1XS0opul7KziIwIRovpITEYO_0 2024-09-14T11:22:50.566 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.565+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9618279657602074552', time=2024-09-14T13:14:59.966022+0000, chain.objs.size()=1 2024-09-14T11:22:50.566 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.565+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.5FsPG9DjY7L4KNGcsb19wNceuuaeoTp_0 2024-09-14T11:22:50.566 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.565+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13297587551793849085', time=2024-09-14T13:15:00.094649+0000, chain.objs.size()=1 2024-09-14T11:22:50.566 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.565+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.t-2sOYmB3xpq0CmodOC7AVtNWVchqQ__0 2024-09-14T11:22:50.566 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.566+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8893149000228966738', time=2024-09-14T13:15:00.245292+0000, chain.objs.size()=1 2024-09-14T11:22:50.566 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.566+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Lo2-MYqp1rkq69ckW8GyJ_SzZ4kVCTw_0 2024-09-14T11:22:50.566 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.566+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14411489759689357327', time=2024-09-14T13:15:00.260695+0000, chain.objs.size()=1 2024-09-14T11:22:50.566 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.566+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.qNQIhLIIqTQLFIZcsoEcCZQo_aooX71_0 2024-09-14T11:22:50.566 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.566+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6271213828422244099', time=2024-09-14T13:15:00.273668+0000, chain.objs.size()=1 2024-09-14T11:22:50.566 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.566+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.G5cyoBjl6fXuYT9DbgFA_erxHApfgy1_0 2024-09-14T11:22:50.567 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.566+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8977720029108802124', time=2024-09-14T13:15:00.306404+0000, chain.objs.size()=1 2024-09-14T11:22:50.567 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.566+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.IgDSso1XJpaaHChlf0fvvIhyztH1m1U_0 2024-09-14T11:22:50.567 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.566+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7385385289924549480', time=2024-09-14T13:15:00.431511+0000, chain.objs.size()=1 2024-09-14T11:22:50.567 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.566+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.cQjrktdgRdasW0A01tcY0UdhmpX_xZf_0 2024-09-14T11:22:50.567 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.566+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13378160115219984433', time=2024-09-14T13:15:00.451381+0000, chain.objs.size()=1 2024-09-14T11:22:50.567 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.566+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.A2OKwmjDLk1mmvz2S74za9-Spe8RVzZ_0 2024-09-14T11:22:50.567 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.566+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14173499301262386097', time=2024-09-14T13:15:00.453434+0000, chain.objs.size()=1 2024-09-14T11:22:50.567 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.566+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.o3tbJLeQTXCboxsHIMMSFflx7426UK-_0 2024-09-14T11:22:50.567 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.566+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3106191741504393204', time=2024-09-14T13:15:00.460455+0000, chain.objs.size()=1 2024-09-14T11:22:50.567 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.566+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.eoSxcAMff8hNwsWb7Whfkjz97qa-jSW_0 2024-09-14T11:22:50.567 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.566+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7317641234922770137', time=2024-09-14T13:15:00.461864+0000, chain.objs.size()=1 2024-09-14T11:22:50.567 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.566+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Z-6wR30kL1pCiCSLdmX3JrfCxatvG1x_0 2024-09-14T11:22:50.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.568+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3830288179839255811', time=2024-09-14T13:15:00.561754+0000, chain.objs.size()=1 2024-09-14T11:22:50.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.568+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.dFBm0QxIPmSI8cWcsPe8M6GHPikGqx__0 2024-09-14T11:22:50.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.568+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4519560879676163236', time=2024-09-14T13:15:00.564870+0000, chain.objs.size()=1 2024-09-14T11:22:50.568 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.568+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.byV176YkGVPUs1ppxN6a-z8Pg9cXQGC_0 2024-09-14T11:22:50.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.568+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13012869291702105455', time=2024-09-14T13:15:00.586251+0000, chain.objs.size()=1 2024-09-14T11:22:50.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.568+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.KUlhM9P4grlWxK8YMMJlIMMrPwUGr84_0 2024-09-14T11:22:50.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.569+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12209520568924678218', time=2024-09-14T13:15:00.594149+0000, chain.objs.size()=1 2024-09-14T11:22:50.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.569+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.NoI8d9fyeQ53NpsUsoE7_qeNCO0-dAZ_0 2024-09-14T11:22:50.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.569+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4846255725530141439', time=2024-09-14T13:15:00.622827+0000, chain.objs.size()=1 2024-09-14T11:22:50.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.569+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.JMoNdJSXvNGge5yro8Q1ibn9p5Wc-FW_0 2024-09-14T11:22:50.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.569+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13225515351363809244', time=2024-09-14T13:15:00.720861+0000, chain.objs.size()=1 2024-09-14T11:22:50.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.569+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.4Uuh_Hn99pZ56yrEW0Z6hFLv9ARneH7_0 2024-09-14T11:22:50.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.569+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7014730078994754878', time=2024-09-14T13:15:00.736121+0000, chain.objs.size()=1 2024-09-14T11:22:50.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.569+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.zylh9JE8ZmQkwx8CcM130OvW7MpsXLB_0 2024-09-14T11:22:50.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.569+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12222011878975404616', time=2024-09-14T13:15:00.885059+0000, chain.objs.size()=1 2024-09-14T11:22:50.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.569+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.yl_dENBOWH_SIkFGlO3Njrj5QnHE2T9_0 2024-09-14T11:22:50.569 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.569+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15952661019990410810', time=2024-09-14T13:15:00.942511+0000, chain.objs.size()=1 2024-09-14T11:22:50.570 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.569+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.OOCv5X2zVTgvQ0qugAbUA4f9hgJi8To_0 2024-09-14T11:22:50.570 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.569+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4585987518312458904', time=2024-09-14T13:15:01.434799+0000, chain.objs.size()=1 2024-09-14T11:22:50.570 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.569+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.264__shadow_.lNrHt49e_iNgHgF_2xd0c4_7s_eY-P8_0 2024-09-14T11:22:50.570 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.569+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16700080354784001632', time=2024-09-14T13:15:01.676754+0000, chain.objs.size()=1 2024-09-14T11:22:50.570 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.569+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.265__shadow_.kNvinIzykcoRDDsQ7IuSnPyleSxkWLA_0 2024-09-14T11:22:50.570 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.569+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6867883203434456058', time=2024-09-14T13:15:09.827002+0000, chain.objs.size()=1 2024-09-14T11:22:50.570 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.569+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.293__shadow_.GUFenPTvq1rYTxaw8-U83hjZW0n-06t_0 2024-09-14T11:22:50.570 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.569+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10784536962317212536', time=2024-09-14T13:15:09.828145+0000, chain.objs.size()=1 2024-09-14T11:22:50.570 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.569+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.293__shadow_.pUdBfNe-6OhPm4MficPX7GmYflIE2gG_0 2024-09-14T11:22:50.572 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.570+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14972498184561976630', time=2024-09-14T13:15:09.830707+0000, chain.objs.size()=1 2024-09-14T11:22:50.572 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.570+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.293__shadow_.LpjGqfh5WwHJ5ZKHisYKGYwbXufaXzf_0 2024-09-14T11:22:50.572 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.571+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.415528903653338220', time=2024-09-14T13:15:24.712984+0000, chain.objs.size()=1 2024-09-14T11:22:50.572 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.571+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.vt83kJf-odauyiekS0mNhglFhkbhFRj_0 2024-09-14T11:22:50.572 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.571+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12349091543297240295', time=2024-09-14T13:15:24.714145+0000, chain.objs.size()=1 2024-09-14T11:22:50.572 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.571+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.eF2i9G_tDKDHXvQ7j-9Dp_aeIDc1qST_0 2024-09-14T11:22:50.572 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.571+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12071392568826602173', time=2024-09-14T13:15:24.717091+0000, chain.objs.size()=1 2024-09-14T11:22:50.573 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.571+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.9g-KadT7PAtmk8PaMzJHyXGYSBmz1Rl_0 2024-09-14T11:22:50.573 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.571+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5861397477839281387', time=2024-09-14T13:15:24.747489+0000, chain.objs.size()=1 2024-09-14T11:22:50.573 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.571+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.8zS6Iqg-oHsPn_5jGjs113C5CPKP-cF_0 2024-09-14T11:22:50.573 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.571+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15875445656907654752', time=2024-09-14T13:15:24.896368+0000, chain.objs.size()=1 2024-09-14T11:22:50.573 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.571+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.D1p9amg_u0NQpDxqqMjEMUF-n4JdkPe_0 2024-09-14T11:22:50.573 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.571+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9662448347401852382', time=2024-09-14T13:15:24.901180+0000, chain.objs.size()=1 2024-09-14T11:22:50.573 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.571+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.u2uXjU9XThgosOxa4S41jzV_IdyaQLF_0 2024-09-14T11:22:50.573 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.571+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16961811892432947379', time=2024-09-14T13:15:24.922576+0000, chain.objs.size()=1 2024-09-14T11:22:50.573 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.571+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_._zdPGg6tPOEjyC0851thjsxLt5dkHGw_0 2024-09-14T11:22:50.573 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.571+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8757472333243133293', time=2024-09-14T13:15:24.945249+0000, chain.objs.size()=1 2024-09-14T11:22:50.573 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.571+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.NJq5NJPe9xmBibiYVsrjML66aXZxzur_0 2024-09-14T11:22:50.573 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.571+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17289814714240401062', time=2024-09-14T13:15:24.955412+0000, chain.objs.size()=1 2024-09-14T11:22:50.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.571+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.N7bBWmtSBiV9b-YV2e_k68UtBzOGvC2_0 2024-09-14T11:22:50.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.571+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2571396768027929059', time=2024-09-14T13:15:24.965657+0000, chain.objs.size()=1 2024-09-14T11:22:50.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.571+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.CJuLVtIvy8x7BhIN5o82xzav4sDBi87_0 2024-09-14T11:22:50.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.572+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16912597723333542137', time=2024-09-14T13:15:25.061424+0000, chain.objs.size()=1 2024-09-14T11:22:50.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.572+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.rPzoqbbyRz5NTPJxU1b_CvFo2QNqDxf_0 2024-09-14T11:22:50.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.572+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7158212779130203064', time=2024-09-14T13:15:25.072809+0000, chain.objs.size()=1 2024-09-14T11:22:50.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.572+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.7TWH_0ILg3FcCp2GoMnsGsBCcxNuPZj_0 2024-09-14T11:22:50.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.573+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.906566459436796277', time=2024-09-14T13:15:25.098474+0000, chain.objs.size()=1 2024-09-14T11:22:50.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.573+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.gQFmXeX0hFDcI7sIDh8B3LWx7Ga3oAK_0 2024-09-14T11:22:50.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.573+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15584263826329563395', time=2024-09-14T13:15:25.117567+0000, chain.objs.size()=1 2024-09-14T11:22:50.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.573+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.SXl2NoSU7-Dd5cnh5aSfjCHklQxqx7x_0 2024-09-14T11:22:50.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.573+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8320292430953842690', time=2024-09-14T13:15:25.217239+0000, chain.objs.size()=1 2024-09-14T11:22:50.574 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.573+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.L5LF7xjlb5-GaeTQBrpWWPvwkKRvD9k_0 2024-09-14T11:22:50.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.573+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8273642985138115707', time=2024-09-14T13:15:25.266964+0000, chain.objs.size()=1 2024-09-14T11:22:50.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.573+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.ywb44pcOFnGrj848P-UOcmohFpYrB5r_0 2024-09-14T11:22:50.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.573+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1370829258745679042', time=2024-09-14T13:15:25.368104+0000, chain.objs.size()=1 2024-09-14T11:22:50.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.573+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.VfWqAhZBIILOjPD2_v2UiSrCJjjk6MU_0 2024-09-14T11:22:50.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.573+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13303380719883729760', time=2024-09-14T13:15:25.394545+0000, chain.objs.size()=1 2024-09-14T11:22:50.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.573+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.G5j20WrfwnPD5zU7isdE3oLF8cLlUHD_0 2024-09-14T11:22:50.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.573+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13447644730076540183', time=2024-09-14T13:15:25.415918+0000, chain.objs.size()=1 2024-09-14T11:22:50.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.573+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.fl5_B5FLlnuPIUFp98u0j8Uby7F38eg_0 2024-09-14T11:22:50.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.573+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6001504500537452671', time=2024-09-14T13:15:25.423610+0000, chain.objs.size()=1 2024-09-14T11:22:50.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.573+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.9CeDQm7MCGQunQie9y_-g_XnPdg2Zc3_0 2024-09-14T11:22:50.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.573+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8547599905709175603', time=2024-09-14T13:15:25.425275+0000, chain.objs.size()=1 2024-09-14T11:22:50.575 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.573+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.xAnQpzqTDu4WfgWiAkvhXTNODOGhfVC_0 2024-09-14T11:22:50.576 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.574+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1997309204248068221', time=2024-09-14T13:15:25.538219+0000, chain.objs.size()=1 2024-09-14T11:22:50.577 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.574+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.uqSqyorXeFbWobcmtIFDgJZEqIyHnBm_0 2024-09-14T11:22:50.577 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.575+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13648997318932760497', time=2024-09-14T13:15:25.565868+0000, chain.objs.size()=1 2024-09-14T11:22:50.577 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.575+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.q7wZaWUObFMocIfJdDZYu4m9MyRTrql_0 2024-09-14T11:22:50.577 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.575+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9442897360813183047', time=2024-09-14T13:15:25.600674+0000, chain.objs.size()=1 2024-09-14T11:22:50.577 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.575+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.OFFq9PuNSW7vTzQKob4o64st95cMIUt_0 2024-09-14T11:22:50.577 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.575+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10130148032205923455', time=2024-09-14T13:15:25.711020+0000, chain.objs.size()=1 2024-09-14T11:22:50.577 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.575+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.klS7ynuwA3Ds30Jc9GUHZvRYNl6k-2j_0 2024-09-14T11:22:50.577 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.575+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3508436361974682546', time=2024-09-14T13:15:25.724516+0000, chain.objs.size()=1 2024-09-14T11:22:50.577 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.575+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.vJ375C9bvE6zKwhR_OlZSd7ODVhIVNN_0 2024-09-14T11:22:50.577 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.575+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10772795789207272627', time=2024-09-14T13:15:25.759864+0000, chain.objs.size()=1 2024-09-14T11:22:50.578 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.575+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.gUT37v7HhmS2w5eXJRrj3qMegV0_H0P_0 2024-09-14T11:22:50.578 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.575+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16745304173833918723', time=2024-09-14T13:15:25.766444+0000, chain.objs.size()=1 2024-09-14T11:22:50.578 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.575+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.cWVHdNHgW-h1wHbPS5FJ5nLmxqAdg0H_0 2024-09-14T11:22:50.578 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.576+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1816803757363165200', time=2024-09-14T13:15:25.878163+0000, chain.objs.size()=1 2024-09-14T11:22:50.578 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.576+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.sLwqUiJSaolJbw56QHoCTXmbi8UJW5__0 2024-09-14T11:22:50.578 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.576+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2689229430691103873', time=2024-09-14T13:15:25.922409+0000, chain.objs.size()=1 2024-09-14T11:22:50.578 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.576+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.9wQL8F8r-LveDu3utnAMIUeQWHGUpiT_0 2024-09-14T11:22:50.578 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.576+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.270917653374763156', time=2024-09-14T13:15:25.927358+0000, chain.objs.size()=1 2024-09-14T11:22:50.578 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.576+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.6KezKSM5fCmAXTjriN1yyCDQtFf-If1_0 2024-09-14T11:22:50.578 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.576+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6064540229515741502', time=2024-09-14T13:15:25.941962+0000, chain.objs.size()=1 2024-09-14T11:22:50.578 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.576+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.PM76-3iCwJnJ9jUX1PqzltJ2uc9rOJO_0 2024-09-14T11:22:50.578 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.576+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3387892649641946153', time=2024-09-14T13:15:33.212938+0000, chain.objs.size()=1 2024-09-14T11:22:50.578 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.576+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.ckNx1wJvP1GhfY89b90zEoW23j_WfAs_0 2024-09-14T11:22:50.579 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.577+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15173458128730354524', time=2024-09-14T13:15:33.216882+0000, chain.objs.size()=1 2024-09-14T11:22:50.579 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.577+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.gysXH-Fl4kzTNxiIHFJVpXH-gfi4jAe_0 2024-09-14T11:22:50.579 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.577+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16334825381638685036', time=2024-09-14T13:15:33.233705+0000, chain.objs.size()=1 2024-09-14T11:22:50.579 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.577+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.JTkSJ9_Q2py6kiaqjYOuSDbAJlpcaYd_0 2024-09-14T11:22:50.579 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.577+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10763103468969658158', time=2024-09-14T13:15:33.364244+0000, chain.objs.size()=1 2024-09-14T11:22:50.579 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.577+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.h8IAB0KM9zktMY2LWhJZ8GNNyLOirw2_0 2024-09-14T11:22:50.579 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.577+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2162135971517190153', time=2024-09-14T13:15:33.379357+0000, chain.objs.size()=1 2024-09-14T11:22:50.579 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.577+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.jtw3nEf6MxbI17ZY6gm0Ox7XwTbMPye_0 2024-09-14T11:22:50.579 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.577+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8924610339284945917', time=2024-09-14T13:15:33.391809+0000, chain.objs.size()=1 2024-09-14T11:22:50.579 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.577+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.zTbFehcA--3E0b4EhxwLBpDo8JI1SoC_0 2024-09-14T11:22:50.579 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.577+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8752756327758022853', time=2024-09-14T13:15:33.401397+0000, chain.objs.size()=1 2024-09-14T11:22:50.579 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.577+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.xbWh8K3qOAS3kjAolX4fZ6cxogxnPmH_0 2024-09-14T11:22:50.579 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.577+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17699741699751701428', time=2024-09-14T13:15:33.405949+0000, chain.objs.size()=1 2024-09-14T11:22:50.580 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.577+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Cr2PMPV7SX1dBGF4vX08oxYySpHfR78_0 2024-09-14T11:22:50.580 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.577+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17853212145319598740', time=2024-09-14T13:15:33.446320+0000, chain.objs.size()=1 2024-09-14T11:22:50.580 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.577+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Hu83RlfpbSifWu4JBUadfQTSBMJFnh0_0 2024-09-14T11:22:50.581 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.578+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10350287760338817258', time=2024-09-14T13:15:33.450667+0000, chain.objs.size()=1 2024-09-14T11:22:50.581 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.578+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.RFds3b83TBtUGpp-pIsMpq8sEexwu2l_0 2024-09-14T11:22:50.582 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.578+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.916661210521834293', time=2024-09-14T13:15:33.530491+0000, chain.objs.size()=1 2024-09-14T11:22:50.582 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.578+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.BPBjEfX-5LecyUkzetu-1Vh0bnj4YEM_0 2024-09-14T11:22:50.582 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.578+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.593598451511754352', time=2024-09-14T13:15:33.571854+0000, chain.objs.size()=1 2024-09-14T11:22:50.582 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.578+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.RnW9_ZYWXXRWQWJ5Aidbg1_7QsyQpIw_0 2024-09-14T11:22:50.582 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.579+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3643624760372485581', time=2024-09-14T13:15:33.615344+0000, chain.objs.size()=1 2024-09-14T11:22:50.582 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.579+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.p1VcjZbY96mvV15k5fkbN-CXRKvTqgG_0 2024-09-14T11:22:50.582 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.579+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15773243479655061189', time=2024-09-14T13:15:33.616198+0000, chain.objs.size()=1 2024-09-14T11:22:50.582 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.579+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.kuu8EblzJ92uswGEqpBx-yuUBbssswQ_0 2024-09-14T11:22:50.582 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.579+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5455869202473626646', time=2024-09-14T13:15:33.702778+0000, chain.objs.size()=1 2024-09-14T11:22:50.582 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.579+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.O7aTPcEpnC2PCzt6Bmo5r7vg3Bo2rv3_0 2024-09-14T11:22:50.582 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.579+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2859211431713021947', time=2024-09-14T13:15:33.713345+0000, chain.objs.size()=1 2024-09-14T11:22:50.582 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.579+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.ifETKb-cnpl5ydwFf_Vtzls2eVuhLZa_0 2024-09-14T11:22:50.582 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.579+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9537758118786685678', time=2024-09-14T13:15:33.748729+0000, chain.objs.size()=1 2024-09-14T11:22:50.583 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.579+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.3VGS3rUMkqrcb0VGK_Gw81wsLh_vLQo_0 2024-09-14T11:22:50.583 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.579+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1387251132433265265', time=2024-09-14T13:15:33.751979+0000, chain.objs.size()=1 2024-09-14T11:22:50.583 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.579+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.sLvp0Ak14IoqGbdLijgKoy_tBCK1jEr_0 2024-09-14T11:22:50.583 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.580+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6901958344749449552', time=2024-09-14T13:15:33.762699+0000, chain.objs.size()=1 2024-09-14T11:22:50.583 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.580+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.zBcIyRqVEbcLR7vsbsRcg1R93N1K-1x_0 2024-09-14T11:22:50.583 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.580+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4001061199768067329', time=2024-09-14T13:15:33.766899+0000, chain.objs.size()=1 2024-09-14T11:22:50.583 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.580+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.jP2wVvQV8iu2NUb5COxGEuGAQDC4J7k_0 2024-09-14T11:22:50.583 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.581+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3079885058523571504', time=2024-09-14T13:15:33.922974+0000, chain.objs.size()=1 2024-09-14T11:22:50.583 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.581+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.HrJ83wL222RfRAXA79fESLH091eFGBH_0 2024-09-14T11:22:50.583 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.581+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15012098348470270601', time=2024-09-14T13:15:34.023954+0000, chain.objs.size()=1 2024-09-14T11:22:50.583 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.581+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.5wTihdcKGY-qfaWi6ukc2XtWsfqVwoj_0 2024-09-14T11:22:50.583 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.581+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4252862435474181247', time=2024-09-14T13:15:34.074696+0000, chain.objs.size()=1 2024-09-14T11:22:50.583 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.581+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.vgfP1EfQwR6cjVSam3bsrNgTpBk1g5L_0 2024-09-14T11:22:50.583 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.581+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13405425904115689952', time=2024-09-14T13:15:34.175142+0000, chain.objs.size()=1 2024-09-14T11:22:50.584 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.581+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.FfMJY8630zH0o91K1-dHS9jUgTmNWv8_0 2024-09-14T11:22:50.584 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.581+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1303575323477320595', time=2024-09-14T13:15:34.231842+0000, chain.objs.size()=1 2024-09-14T11:22:50.584 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.581+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.H77Yq8YS1VwBkdqW7-VK-zk14C1MOgl_0 2024-09-14T11:22:50.584 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.581+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14188450175794574638', time=2024-09-14T13:15:34.247224+0000, chain.objs.size()=1 2024-09-14T11:22:50.584 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.581+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.aaOg1IeI4udt9TQ6xEhOSapHNznq0tX_0 2024-09-14T11:22:50.584 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.581+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9197298057023175635', time=2024-09-14T13:15:34.365947+0000, chain.objs.size()=1 2024-09-14T11:22:50.584 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.581+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.DfxCiytmRZdJWQzBgYi3wBfI1_1RJ0j_0 2024-09-14T11:22:50.584 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.581+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.553925206015527532', time=2024-09-14T13:15:34.371261+0000, chain.objs.size()=1 2024-09-14T11:22:50.584 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.581+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.7rAMZC1_ECzqSsnkrdDIOTEObfYHXwL_0 2024-09-14T11:22:50.584 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.581+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11333706554349274496', time=2024-09-14T13:15:34.380743+0000, chain.objs.size()=1 2024-09-14T11:22:50.584 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.581+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.FtQKkYx2fsVCqqUa6pwLNnaRKIGo05D_0 2024-09-14T11:22:50.584 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.581+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7877266147660963331', time=2024-09-14T13:15:34.383692+0000, chain.objs.size()=1 2024-09-14T11:22:50.585 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.582+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.bD0pvS9MuNCWs2w5gJ9p6bMfHMSxXZF_0 2024-09-14T11:22:50.585 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.582+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3670334222095804214', time=2024-09-14T13:15:34.400419+0000, chain.objs.size()=1 2024-09-14T11:22:50.585 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.582+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_._1UmYlsypHgSrmrJbcYtfvIhIql-RWR_0 2024-09-14T11:22:50.586 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.584+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 0/43970 2024-09-14T11:22:50.586 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.586+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-14T11:22:50.586 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.586+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9294093212537376972', time=2024-09-14T13:16:06.468865+0000, chain.objs.size()=1 2024-09-14T11:22:50.586 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.586+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.444__shadow_.ZBULJTc9WpSlecjcyDQbxk5sbvIa4BD_0 2024-09-14T11:22:50.586 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.586+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7568183412588210655', time=2024-09-14T13:16:10.238748+0000, chain.objs.size()=1 2024-09-14T11:22:50.586 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.586+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.457__shadow_.FG7hQD1D68hLuqAJSnJurJFuvsonHAf_0 2024-09-14T11:22:50.586 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.586+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16176182487954377140', time=2024-09-14T13:16:37.946321+0000, chain.objs.size()=2 2024-09-14T11:22:50.586 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.586+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.525__multipart_mymultipart.2~7cN5QnGA8zWJi4cah03qyY83DjpRrzp.1 2024-09-14T11:22:50.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.586+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.525__multipart_mymultipart.2~7cN5QnGA8zWJi4cah03qyY83DjpRrzp.2 2024-09-14T11:22:50.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.586+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='2~iPpCqQ7Fv5WIJRHtlv4GXsbLFNcSqDT', time=2024-09-14T13:16:41.054113+0000, chain.objs.size()=1 2024-09-14T11:22:50.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.586+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.533__multipart_mymultipart.2~iPpCqQ7Fv5WIJRHtlv4GXsbLFNcSqDT.1 2024-09-14T11:22:50.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.586+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16883337952349619393', time=2024-09-14T13:17:10.182060+0000, chain.objs.size()=1 2024-09-14T11:22:50.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.586+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.551__shadow_.HYEuuZ240wdAIAH0-_PG_xXHziBu8oY_0 2024-09-14T11:22:50.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.586+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4278139166500174658', time=2024-09-14T13:17:11.219988+0000, chain.objs.size()=1 2024-09-14T11:22:50.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.586+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.553__shadow_.tUk5IphsXAzVUnMtABf5YoMlvYOjt4W_0 2024-09-14T11:22:50.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.586+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16930589351132357700', time=2024-09-14T13:17:25.170428+0000, chain.objs.size()=1 2024-09-14T11:22:50.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.586+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.569__shadow:YQc0fb6ptzluaMkhSltv2tafKL0ob8U_.Mj1S1XD1t7h_F-9i-kebebyQmMexreM_0 2024-09-14T11:22:50.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.586+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17180661632076143223', time=2024-09-14T13:17:42.509852+0000, chain.objs.size()=1 2024-09-14T11:22:50.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.586+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.577__shadow:fhGfLNBgojiQ1TmCFmx5abm3iLLs02d_.YQXlJamIPxLzg3oF4v4j2wU7y2ucXKl_0 2024-09-14T11:22:50.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.586+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14144722969137958160', time=2024-09-14T13:17:50.039226+0000, chain.objs.size()=1 2024-09-14T11:22:50.587 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.586+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.579__shadow:b2ZoDvt5eabmGYfZzhjmzJYP6pJJKG5_.3GKWhUC5oE0xdK2b4baPDDS0oHesBSW_0 2024-09-14T11:22:50.588 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.586+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6615515592401335667', time=2024-09-14T13:17:52.794453+0000, chain.objs.size()=1 2024-09-14T11:22:50.588 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.586+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.585__shadow:desZo2fp8FblgNmzr9CQiV1HEYXtsyQ_.ZZAeHceSKrhogWOx7gTt3bdPh1hTr7i_0 2024-09-14T11:22:50.588 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.586+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6320293067920653286', time=2024-09-14T13:17:53.511796+0000, chain.objs.size()=1 2024-09-14T11:22:50.588 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.586+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.587__shadow:HQ0XkVeZWGND9kQM5Wfwl-79vwsWpKF_.7F2OVLKN1KFHQxEBtSNtOUvdklLQegx_0 2024-09-14T11:22:50.588 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.588+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8437052949720805930', time=2024-09-14T13:20:08.925174+0000, chain.objs.size()=1 2024-09-14T11:22:50.589 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.588+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.629__shadow_.T4l0FH3G8dYIi_tF2PHb7MOvsPdLITf_0 2024-09-14T11:22:50.589 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.588+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15805378899775766603', time=2024-09-14T13:20:14.252070+0000, chain.objs.size()=1 2024-09-14T11:22:50.589 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.588+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.648__shadow_.2D2zKgP33ZqYWOHS7zZfRHh1RofWpOg_0 2024-09-14T11:22:50.589 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.588+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16410556862710842671', time=2024-09-14T13:20:21.744810+0000, chain.objs.size()=1 2024-09-14T11:22:50.589 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.588+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.668__shadow_.mY8gAfpqfp4HjdZ8mmSVoBfZmUpbCFs_0 2024-09-14T11:22:50.589 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.589+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.92277795968510655', time=2024-09-14T13:20:29.623781+0000, chain.objs.size()=1 2024-09-14T11:22:50.589 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.589+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.701__shadow:o5W0viTDHdLR35XtWuCzl7bV3qN5qey_.ujBOjDRHl5l5w02bMo0z_oZrMviGs4A_0 2024-09-14T11:22:50.589 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.589+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16713784719120680458', time=2024-09-14T13:20:32.830190+0000, chain.objs.size()=1 2024-09-14T11:22:50.589 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.589+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.712__shadow:lc9qq4kIOrxjU1gtsTHV.w.5gpY1tiK_.7YbrltkBi-yNV0Mz1PSvEcXzuvdiLI7_0 2024-09-14T11:22:50.589 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.590+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:50.591 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.592+0000 7f0f19c16800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:22:50.592 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.594+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:50.593 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.594+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:50.594 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.595+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47218' 2024-09-14T11:22:50.594 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.595+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='_RvErIkQLGIlLCubzm4yLKS_ug1h5zq0', time=2024-09-14T13:13:35.187964+0000, chain.objs.size()=2 2024-09-14T11:22:50.594 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.595+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.160__shadow_.H86CsTjhvkWLccm6zdGbww7j_pujeR__0 2024-09-14T11:22:50.594 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.595+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.160__shadow_.H86CsTjhvkWLccm6zdGbww7j_pujeR__1 2024-09-14T11:22:50.594 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.595+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='2~2hccWhdftuRTvMIPsatzpeUAHcx8WIC', time=2024-09-14T13:13:52.425673+0000, chain.objs.size()=1 2024-09-14T11:22:50.595 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.595+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.202__multipart_mymultipart.2~2hccWhdftuRTvMIPsatzpeUAHcx8WIC.1 2024-09-14T11:22:50.595 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.595+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9318536069137420065', time=2024-09-14T13:14:44.588853+0000, chain.objs.size()=1 2024-09-14T11:22:50.595 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.595+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.231__shadow_.MIW6J_GWyUCVbkQCSD95zXMl5VEjHqY_0 2024-09-14T11:22:50.595 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.595+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1926991793010789559', time=2024-09-14T13:14:50.602192+0000, chain.objs.size()=1 2024-09-14T11:22:50.595 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.595+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.253__shadow_.baRuomhcVEp3wFRtX2vqAOQsd_lzp6s_0 2024-09-14T11:22:50.595 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.595+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18052585015785610655', time=2024-09-14T13:14:51.101582+0000, chain.objs.size()=1 2024-09-14T11:22:50.595 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.595+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.255__shadow_.7tjz4vfrlXFu0E2ra5lxQELbRV5VFXQ_0 2024-09-14T11:22:50.595 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.595+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11678543155463736585', time=2024-09-14T13:14:59.753110+0000, chain.objs.size()=1 2024-09-14T11:22:50.595 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.595+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.O7CK1Bit25CMB2KHT5RGcKorNNnyF5g_0 2024-09-14T11:22:50.595 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.595+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3146938988484723443', time=2024-09-14T13:14:59.762602+0000, chain.objs.size()=1 2024-09-14T11:22:50.595 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.595+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.tBXDt4KMEBSAwsL7P1MwCteEB94hfX6_0 2024-09-14T11:22:50.595 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.595+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16869591492709060861', time=2024-09-14T13:14:59.774587+0000, chain.objs.size()=1 2024-09-14T11:22:50.595 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.595+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.u-_KkfGUFdpFRDVa7AYeK71l0e-oTCI_0 2024-09-14T11:22:50.596 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.595+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5084755601129621029', time=2024-09-14T13:14:59.799577+0000, chain.objs.size()=1 2024-09-14T11:22:50.596 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.595+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.PTh434vQ_MbKHH3kPQEU9g-EgKS08b7_0 2024-09-14T11:22:50.596 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.595+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14146080006886799685', time=2024-09-14T13:14:59.809245+0000, chain.objs.size()=1 2024-09-14T11:22:50.596 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.595+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.EYtmbcwIteijV9_I4cWr_9Efce3Bw2M_0 2024-09-14T11:22:50.596 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.595+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1637863612821052450', time=2024-09-14T13:14:59.816590+0000, chain.objs.size()=1 2024-09-14T11:22:50.596 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.595+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.DCA1zVLeYb3auI2ie58Ceip3wzv4yqV_0 2024-09-14T11:22:50.597 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.598+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11041948714757161314', time=2024-09-14T13:14:59.900021+0000, chain.objs.size()=1 2024-09-14T11:22:50.597 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.598+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.UGiUM_FWDDf8Tmhgj3MEELPecOj-rfd_0 2024-09-14T11:22:50.597 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.598+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.137835652271407343', time=2024-09-14T13:14:59.914080+0000, chain.objs.size()=1 2024-09-14T11:22:50.597 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.598+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.hpjQtu_3ngTl5qy2negM2SI7vn4aFou_0 2024-09-14T11:22:50.597 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.598+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6777042656504223737', time=2024-09-14T13:14:59.920906+0000, chain.objs.size()=1 2024-09-14T11:22:50.597 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.598+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Q9JEtQuGeJo11e_ZItrpge1gUamnInU_0 2024-09-14T11:22:50.597 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.598+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5111512509727931438', time=2024-09-14T13:14:59.981235+0000, chain.objs.size()=1 2024-09-14T11:22:50.597 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.598+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.V3-JjNNjrejLMVraraTxktJfyp1LYj0_0 2024-09-14T11:22:50.597 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.598+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2530588439692197335', time=2024-09-14T13:15:00.064441+0000, chain.objs.size()=1 2024-09-14T11:22:50.597 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.598+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.HbeMqntztTYqGnfv9_js4FGKplTgWLx_0 2024-09-14T11:22:50.597 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.598+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18092225387344886145', time=2024-09-14T13:15:00.088500+0000, chain.objs.size()=1 2024-09-14T11:22:50.598 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.598+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.5fEhuGJtDDI-Y-lOFvwwGEzgrSQQIcf_0 2024-09-14T11:22:50.598 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.598+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4520538134117358552', time=2024-09-14T13:15:00.090252+0000, chain.objs.size()=1 2024-09-14T11:22:50.598 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.598+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.jW3FXA6fq9cqio-7C3oswxlwEcnLL7z_0 2024-09-14T11:22:50.598 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.598+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12048995013133118452', time=2024-09-14T13:15:00.090947+0000, chain.objs.size()=1 2024-09-14T11:22:50.598 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.598+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.u5CKVy5tYqkkFgJLmrEFcYXitGNBbDl_0 2024-09-14T11:22:50.598 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.598+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12752969874737250223', time=2024-09-14T13:15:00.148213+0000, chain.objs.size()=1 2024-09-14T11:22:50.598 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.598+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.qzhhC1-_9om_Z8OtW_THlg2VmZMkXfF_0 2024-09-14T11:22:50.598 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.598+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5108507136531284397', time=2024-09-14T13:15:00.151435+0000, chain.objs.size()=1 2024-09-14T11:22:50.598 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.598+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.WzA2yeKyEdLERlACPGDZh7u7m06SrlA_0 2024-09-14T11:22:50.598 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.598+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.545679208005588516', time=2024-09-14T13:15:00.313462+0000, chain.objs.size()=1 2024-09-14T11:22:50.598 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.598+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.fvdsnk2tpAfY_ejzWVCIpes_razo3MO_0 2024-09-14T11:22:50.599 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.599+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1003670507121156227', time=2024-09-14T13:15:00.393124+0000, chain.objs.size()=1 2024-09-14T11:22:50.599 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.599+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.b-7SWZlK9LfETxuWM8ZHiyXO0-Kxp6M_0 2024-09-14T11:22:50.599 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.600+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2405260826500045260', time=2024-09-14T13:15:00.402372+0000, chain.objs.size()=1 2024-09-14T11:22:50.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.600+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.xVS0PW23VL9eGDdoM-iq2X1CrYF0h17_0 2024-09-14T11:22:50.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.600+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16073537405913322339', time=2024-09-14T13:15:00.432342+0000, chain.objs.size()=1 2024-09-14T11:22:50.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.600+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.VpJjvFTCdt4P7g8EXCwnrQNdjyOB9qV_0 2024-09-14T11:22:50.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.600+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.394568176088027239', time=2024-09-14T13:15:00.474836+0000, chain.objs.size()=1 2024-09-14T11:22:50.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.600+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Uqv2ivOCNcS7lxt6g9oq26gZjfp2M3x_0 2024-09-14T11:22:50.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.600+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2850950684669971727', time=2024-09-14T13:15:00.475917+0000, chain.objs.size()=1 2024-09-14T11:22:50.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.600+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.OOAljE_Vg8R-zbAQpmSwEJGECdUDQmE_0 2024-09-14T11:22:50.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.600+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1168378646465271245', time=2024-09-14T13:15:00.584505+0000, chain.objs.size()=1 2024-09-14T11:22:50.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.600+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Wu0cF2DXjcac5urbWWWJ4MCOBwSYqer_0 2024-09-14T11:22:50.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.600+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1609333465853572333', time=2024-09-14T13:15:00.589859+0000, chain.objs.size()=1 2024-09-14T11:22:50.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.600+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.RtxypXqgVXbnNUSiJudv44AqOe82T3m_0 2024-09-14T11:22:50.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.600+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6536760808651248894', time=2024-09-14T13:15:00.592008+0000, chain.objs.size()=1 2024-09-14T11:22:50.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.600+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.eqy4m2uKDb9nUrnuGX428Bkt6VodWt0_0 2024-09-14T11:22:50.600 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.600+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15531608358621538930', time=2024-09-14T13:15:00.714108+0000, chain.objs.size()=1 2024-09-14T11:22:50.601 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.600+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.wkwJn1cyLileZtbAiWdVwTfeg2T2SZg_0 2024-09-14T11:22:50.601 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.600+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11791097455288158855', time=2024-09-14T13:15:00.719741+0000, chain.objs.size()=1 2024-09-14T11:22:50.601 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.600+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.3a79rI3syL8P_D0sbOpilYei2gZ_9DA_0 2024-09-14T11:22:50.601 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.600+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3255445168349988215', time=2024-09-14T13:15:00.724450+0000, chain.objs.size()=1 2024-09-14T11:22:50.601 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.600+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.y5VvlY83SDikAm9H74L7ml-hFuy1-Pu_0 2024-09-14T11:22:50.602 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.602+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5837148080965064058', time=2024-09-14T13:15:00.743959+0000, chain.objs.size()=1 2024-09-14T11:22:50.602 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.602+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.FSIbkaerb_0ucT2NvQNqf_Ca6iUafYF_0 2024-09-14T11:22:50.602 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.602+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13449703528023446660', time=2024-09-14T13:15:00.755238+0000, chain.objs.size()=1 2024-09-14T11:22:50.602 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.602+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.29q_WhmxxXSBdF87T-hv-elWSSXIGIf_0 2024-09-14T11:22:50.602 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.602+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16654308579518463449', time=2024-09-14T13:15:00.763449+0000, chain.objs.size()=1 2024-09-14T11:22:50.602 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.602+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.CpBOkIvyMXcskkv74JsSare_xwNGCOE_0 2024-09-14T11:22:50.602 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.602+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11347993911371481915', time=2024-09-14T13:15:00.767090+0000, chain.objs.size()=1 2024-09-14T11:22:50.603 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.602+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Skcbtb5RkQGBLrkbxZy2EJEW0DfZbbm_0 2024-09-14T11:22:50.603 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.602+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7706663194735526242', time=2024-09-14T13:15:00.896322+0000, chain.objs.size()=1 2024-09-14T11:22:50.603 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.602+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.J6Y9ke9nasILlGX57tHUxyW3N8-7vs1_0 2024-09-14T11:22:50.603 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.602+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14641515877675836821', time=2024-09-14T13:15:00.899153+0000, chain.objs.size()=1 2024-09-14T11:22:50.603 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.602+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.mKRdreioW9jnyHDbBMFpxiwY1GvLACM_0 2024-09-14T11:22:50.603 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.602+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2658044431993450346', time=2024-09-14T13:15:00.936931+0000, chain.objs.size()=1 2024-09-14T11:22:50.603 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.602+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.S71VqDaNZDlbGgbMNQLb4n-4Wl49Gii_0 2024-09-14T11:22:50.603 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.603+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9759687092757125851', time=2024-09-14T13:15:01.676905+0000, chain.objs.size()=1 2024-09-14T11:22:50.603 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.603+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.265__shadow_.GEUMJlGDOHhhD1Qop2-hrxzQfqtuKSS_0 2024-09-14T11:22:50.603 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.603+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13327643182150703141', time=2024-09-14T13:15:02.889035+0000, chain.objs.size()=1 2024-09-14T11:22:50.603 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.603+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.270__shadow_.t-Wm83BomXEFzAiFUY3nMyfb9t_ovXR_0 2024-09-14T11:22:50.603 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.603+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14268965473973647094', time=2024-09-14T13:15:07.797649+0000, chain.objs.size()=1 2024-09-14T11:22:50.603 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.603+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.288__shadow_.hkjGo_XkYJC-o4AUQdBMmPrF5P9RfEQ_0 2024-09-14T11:22:50.604 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.603+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16801258090567929304', time=2024-09-14T13:15:09.247102+0000, chain.objs.size()=1 2024-09-14T11:22:50.604 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.603+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.292__shadow_.leKIwhf4SOgn5Sgc5HydAS6gzwHknmk_0 2024-09-14T11:22:50.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.604+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8461174407108035331', time=2024-09-14T13:15:09.247819+0000, chain.objs.size()=1 2024-09-14T11:22:50.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.604+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.292__shadow_.4u5sdosRnUp4Q9FnbR8ivu97pudv_ds_0 2024-09-14T11:22:50.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.604+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14577510921613012376', time=2024-09-14T13:15:09.255612+0000, chain.objs.size()=1 2024-09-14T11:22:50.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.604+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.292__shadow_.TgJE_J_3mbRJ5HnMynzZIpwF-uNGs0n_0 2024-09-14T11:22:50.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.604+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2330881731690747952', time=2024-09-14T13:15:09.256481+0000, chain.objs.size()=1 2024-09-14T11:22:50.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.604+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.292__shadow_.grVzTH3yu2FNguecBrsjWLxwoNedsOm_0 2024-09-14T11:22:50.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.605+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16275313161881357174', time=2024-09-14T13:15:10.610243+0000, chain.objs.size()=1 2024-09-14T11:22:50.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.605+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.296__shadow_.yLUpPFuvSr-7cBHRDW6spvshpow-qyy_0 2024-09-14T11:22:50.605 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.605+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1555292628423229914', time=2024-09-14T13:15:11.152121+0000, chain.objs.size()=1 2024-09-14T11:22:50.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.605+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.298__shadow_.gv0_fKwXnL7HEJvyCtWOOQuBh1O2vIc_0 2024-09-14T11:22:50.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.605+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4589061343086045320', time=2024-09-14T13:15:12.737864+0000, chain.objs.size()=1 2024-09-14T11:22:50.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.605+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.304__shadow_.rbzE_APp43cFKPN6twZqp0E1BxXStvV_0 2024-09-14T11:22:50.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.605+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12582811067855536206', time=2024-09-14T13:15:17.266976+0000, chain.objs.size()=1 2024-09-14T11:22:50.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.605+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.322__shadow_.VyYtcOQ9UK1Te8kvpNONEEBwKGlGvMi_0 2024-09-14T11:22:50.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.605+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5576048653631991114', time=2024-09-14T13:15:24.730333+0000, chain.objs.size()=1 2024-09-14T11:22:50.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.605+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.7auIRnx_gWsRjyrcCTZbNAE3Lv1oTFw_0 2024-09-14T11:22:50.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.605+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14005740847979660913', time=2024-09-14T13:15:24.748963+0000, chain.objs.size()=1 2024-09-14T11:22:50.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.605+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.XylZbsAlLij_1vElfeQVG_IAGOiNK-e_0 2024-09-14T11:22:50.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.605+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8938144432605690473', time=2024-09-14T13:15:24.765757+0000, chain.objs.size()=1 2024-09-14T11:22:50.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.605+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.PRtfRvFEvUgkXAzxKW9BtbcDAXSZKiJ_0 2024-09-14T11:22:50.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.605+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8199767367515056955', time=2024-09-14T13:15:24.793211+0000, chain.objs.size()=1 2024-09-14T11:22:50.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.605+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.YbFw1tCgIl8F1gU-1MSUwOdNcn9UTrn_0 2024-09-14T11:22:50.606 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.606+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8316910240147691839', time=2024-09-14T13:15:24.883563+0000, chain.objs.size()=1 2024-09-14T11:22:50.607 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.606+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.o2ZsVFIzhgxcdMbMcRuexT38BfWtJQY_0 2024-09-14T11:22:50.607 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.606+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15963474691949633701', time=2024-09-14T13:15:24.918594+0000, chain.objs.size()=1 2024-09-14T11:22:50.607 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.606+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.u8K8R1PFqX1lNQVLDYTCTFcM3N_iroz_0 2024-09-14T11:22:50.607 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.606+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5732711942743597814', time=2024-09-14T13:15:24.920299+0000, chain.objs.size()=1 2024-09-14T11:22:50.607 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.606+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.y2B78Q5l5baG7I6MGaFBD4hgRa6XZNk_0 2024-09-14T11:22:50.608 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.607+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12682906519246096432', time=2024-09-14T13:15:24.934369+0000, chain.objs.size()=1 2024-09-14T11:22:50.608 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.607+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.Z4ZC1im1gB9SVAROVE6td-p3nXELEVp_0 2024-09-14T11:22:50.608 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.607+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16596857311651013229', time=2024-09-14T13:15:24.947931+0000, chain.objs.size()=1 2024-09-14T11:22:50.608 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.607+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.BbTlmD54m04_y2E_G8sGxDCHDgQTMSo_0 2024-09-14T11:22:50.609 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.607+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1524453935648627167', time=2024-09-14T13:15:25.084094+0000, chain.objs.size()=1 2024-09-14T11:22:50.609 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.607+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.HdbMh7ZsXfKCd5WwX5QAPCVYRZDKGuP_0 2024-09-14T11:22:50.609 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.607+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4634580290975751361', time=2024-09-14T13:15:25.085035+0000, chain.objs.size()=1 2024-09-14T11:22:50.609 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.607+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.4XHjg33pxZnYOimxUCVNxGuQMui1E63_0 2024-09-14T11:22:50.609 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.607+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10336570474491912731', time=2024-09-14T13:15:25.132797+0000, chain.objs.size()=1 2024-09-14T11:22:50.609 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.607+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.TQiOjYg-7hoegk-nIqWWjPZw-vyl2IP_0 2024-09-14T11:22:50.609 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.607+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4107462599406709182', time=2024-09-14T13:15:25.220630+0000, chain.objs.size()=1 2024-09-14T11:22:50.609 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.607+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.eQgjatXHdWC4DHLoMjasYEkW0JsE-D1_0 2024-09-14T11:22:50.609 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.607+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.827470283244678382', time=2024-09-14T13:15:25.237921+0000, chain.objs.size()=1 2024-09-14T11:22:50.609 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.607+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.x3V0Edc4Zm8OhJHN552RrX_fBy2aUYh_0 2024-09-14T11:22:50.609 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.607+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1619269864550190229', time=2024-09-14T13:15:25.240407+0000, chain.objs.size()=1 2024-09-14T11:22:50.609 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.607+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.GN1smNqrxtmoJZpASagxyvJtMKLiSSs_0 2024-09-14T11:22:50.610 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.608+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6375271368756314190', time=2024-09-14T13:15:25.242089+0000, chain.objs.size()=1 2024-09-14T11:22:50.610 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.608+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.KMZKU6Ijb2_4tBPInezjRzBL4uXa3ip_0 2024-09-14T11:22:50.610 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.608+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6932675233445841786', time=2024-09-14T13:15:25.287127+0000, chain.objs.size()=1 2024-09-14T11:22:50.610 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.608+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.jpX7giK5BxdL4QzG1iQfdywucQmNfPU_0 2024-09-14T11:22:50.610 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.608+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3380186352855886897', time=2024-09-14T13:15:25.528680+0000, chain.objs.size()=1 2024-09-14T11:22:50.610 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.608+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.kTI2Q8oEdVsEoYzyWOFtW6QCbn33d-d_0 2024-09-14T11:22:50.610 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.608+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4822972641582328197', time=2024-09-14T13:15:25.538651+0000, chain.objs.size()=1 2024-09-14T11:22:50.610 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.608+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.pY8G3qlenw0Z8xflvbelr84EXLZVOTm_0 2024-09-14T11:22:50.610 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.609+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9266937489482405868', time=2024-09-14T13:15:25.539987+0000, chain.objs.size()=1 2024-09-14T11:22:50.610 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.609+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.dsys2kj9L8Njk1_TLOdPdo8vTymgPuw_0 2024-09-14T11:22:50.610 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.609+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.994183853001942374', time=2024-09-14T13:15:25.545962+0000, chain.objs.size()=1 2024-09-14T11:22:50.610 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.609+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.ofNr1JZCAHXHWEtFoKPIYlatnOHQBud_0 2024-09-14T11:22:50.610 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.609+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3302543263517871405', time=2024-09-14T13:15:25.562895+0000, chain.objs.size()=1 2024-09-14T11:22:50.611 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.609+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.OpUWYs_VWOSZ0ZJbhGp3RDxkKBOWf9x_0 2024-09-14T11:22:50.611 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.609+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5219318877178025323', time=2024-09-14T13:15:25.567651+0000, chain.objs.size()=1 2024-09-14T11:22:50.611 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.609+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.HMCTJpEt2z_2Q1SBuBeHbqpBALgkAqo_0 2024-09-14T11:22:50.611 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.609+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11757359989091912340', time=2024-09-14T13:15:25.573345+0000, chain.objs.size()=1 2024-09-14T11:22:50.611 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.609+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.1oLv1EiKte9ug8fW6y3XgHJwEwQ__5q_0 2024-09-14T11:22:50.611 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.609+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.128757532195887657', time=2024-09-14T13:15:25.688286+0000, chain.objs.size()=1 2024-09-14T11:22:50.611 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.609+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.w2Ko5idaClYKgCK4oR-2mk9F-2qvhns_0 2024-09-14T11:22:50.611 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.609+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14031226893727307781', time=2024-09-14T13:15:25.711429+0000, chain.objs.size()=1 2024-09-14T11:22:50.611 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.609+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.hKLtCezY-Dzc3YmYC_blBRnsBx-im-p_0 2024-09-14T11:22:50.613 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.610+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3938437453719200183', time=2024-09-14T13:15:25.744107+0000, chain.objs.size()=1 2024-09-14T11:22:50.613 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.610+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_._NrAop-MpwJ533Z1cspAxgeqwJBxboU_0 2024-09-14T11:22:50.613 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.610+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5717259809393138666', time=2024-09-14T13:15:25.750038+0000, chain.objs.size()=1 2024-09-14T11:22:50.613 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.610+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.fAsorXyCv_phX5Y4dnRZfgHstQfAZKB_0 2024-09-14T11:22:50.613 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.610+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10311739235992426423', time=2024-09-14T13:15:25.880998+0000, chain.objs.size()=1 2024-09-14T11:22:50.613 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.610+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.f2YP0VXZm_QXkd19Ln41UkdGg28UDW3_0 2024-09-14T11:22:50.613 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.610+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11553908772597866952', time=2024-09-14T13:15:25.900572+0000, chain.objs.size()=1 2024-09-14T11:22:50.613 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.610+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.7ijt6YCW_WFRncEwSNzIfNkr7PW3ipL_0 2024-09-14T11:22:50.613 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.611+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6904507850844917853', time=2024-09-14T13:15:25.904341+0000, chain.objs.size()=1 2024-09-14T11:22:50.613 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.611+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.Dv5FwtH101euD4is_Gaj1uaKFNMV2mI_0 2024-09-14T11:22:50.613 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.611+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3214094594002339926', time=2024-09-14T13:15:25.932234+0000, chain.objs.size()=1 2024-09-14T11:22:50.614 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.611+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.o6Zj13v9NJ1WM_gMy1pCQ2L9efj76V6_0 2024-09-14T11:22:50.614 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.611+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4606799610928899590', time=2024-09-14T13:15:33.165730+0000, chain.objs.size()=1 2024-09-14T11:22:50.614 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.611+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.EQLpw2eOPNf0HMfObyGZMHUsKSHA7le_0 2024-09-14T11:22:50.614 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.611+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17581806607759403067', time=2024-09-14T13:15:33.212800+0000, chain.objs.size()=1 2024-09-14T11:22:50.614 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.611+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.OajbgWd_o1j44zbbHtyswRx55MTig7U_0 2024-09-14T11:22:50.614 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.611+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13645972272484463523', time=2024-09-14T13:15:33.370854+0000, chain.objs.size()=1 2024-09-14T11:22:50.614 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.611+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.WKAuLwzshWqpX0Q1Q8FPsV5gm57XKmG_0 2024-09-14T11:22:50.614 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.611+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1471889620744847546', time=2024-09-14T13:15:33.405727+0000, chain.objs.size()=1 2024-09-14T11:22:50.614 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.611+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.JXlc0iyXskQjiXSuZ9PtnRFo8rv4_-y_0 2024-09-14T11:22:50.614 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.611+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15627964232180543239', time=2024-09-14T13:15:33.424038+0000, chain.objs.size()=1 2024-09-14T11:22:50.614 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.611+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.c78SDLT62zfp476bKS6s1VcaDmva0A9_0 2024-09-14T11:22:50.614 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.612+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10633808812550451147', time=2024-09-14T13:15:33.445566+0000, chain.objs.size()=1 2024-09-14T11:22:50.614 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.612+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.iCqHuUftlmS4ttFFJsPkoAywGL3zh1w_0 2024-09-14T11:22:50.614 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.612+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.747656405958616110', time=2024-09-14T13:15:33.454943+0000, chain.objs.size()=1 2024-09-14T11:22:50.615 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.612+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.qH_6edp1SKSpWZfZk_tEKHhgt197RU0_0 2024-09-14T11:22:50.615 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.612+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12680902375185701999', time=2024-09-14T13:15:33.530945+0000, chain.objs.size()=1 2024-09-14T11:22:50.615 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.612+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.160Krt0a7nm9vLFmTXofTehva1krH2C_0 2024-09-14T11:22:50.615 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.612+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7414615515597256656', time=2024-09-14T13:15:33.555402+0000, chain.objs.size()=1 2024-09-14T11:22:50.615 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.612+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.oP79lJUnV0KMzFM8Prexc1FNKRyrjdZ_0 2024-09-14T11:22:50.615 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.612+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8387012617869577093', time=2024-09-14T13:15:33.603044+0000, chain.objs.size()=1 2024-09-14T11:22:50.615 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.612+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.KQeliv6NsrC6hwrSBkAld0CZJ1Y8HRS_0 2024-09-14T11:22:50.615 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.613+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6636615299753463449', time=2024-09-14T13:15:33.613596+0000, chain.objs.size()=1 2024-09-14T11:22:50.615 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.613+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.nzU9n02F4b9hj3EWx9mwmkFnLOPXHCh_0 2024-09-14T11:22:50.615 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.613+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10353218404814700805', time=2024-09-14T13:15:33.615761+0000, chain.objs.size()=1 2024-09-14T11:22:50.615 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.613+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.DkE-OCSdAuGbTAkoA3t5KwGxXtyPpR4_0 2024-09-14T11:22:50.615 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.613+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9667774659630719510', time=2024-09-14T13:15:33.616466+0000, chain.objs.size()=1 2024-09-14T11:22:50.615 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.613+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.YbyuJLOyCX7IslLpQUU_hUUUbpMX3JZ_0 2024-09-14T11:22:50.616 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.613+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13377715786638739662', time=2024-09-14T13:15:33.716921+0000, chain.objs.size()=1 2024-09-14T11:22:50.616 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.613+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.bLnrhw9T8cj_0f7W016SOrMyor68hvx_0 2024-09-14T11:22:50.616 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.613+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.375066554820605226', time=2024-09-14T13:15:33.726882+0000, chain.objs.size()=1 2024-09-14T11:22:50.616 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.613+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.y6CTh2I-ExNNg5NikCcG4vlgqUsK91-_0 2024-09-14T11:22:50.616 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.613+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13640491159832925537', time=2024-09-14T13:15:33.727580+0000, chain.objs.size()=1 2024-09-14T11:22:50.616 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.613+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.SUe364vNO1lSUPtnFe6frkvVO5DdTSn_0 2024-09-14T11:22:50.616 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.613+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15640132029877993387', time=2024-09-14T13:15:33.733666+0000, chain.objs.size()=1 2024-09-14T11:22:50.616 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.613+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.vvK4uqE857vzIiyp5s7GoQEH6A10CQQ_0 2024-09-14T11:22:50.617 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.615+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 0/47218 2024-09-14T11:22:50.617 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.617+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-14T11:22:50.617 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.617+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.412655584554547055', time=2024-09-14T13:15:33.922352+0000, chain.objs.size()=1 2024-09-14T11:22:50.618 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.617+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.4dbPjcgpnLVgzeiQGQtvS06iufuD6tu_0 2024-09-14T11:22:50.618 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.617+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13368409683620111784', time=2024-09-14T13:15:34.023947+0000, chain.objs.size()=1 2024-09-14T11:22:50.618 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.617+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.v76frrdswKY8VFqxjT7Fscw808TmcX8_0 2024-09-14T11:22:50.618 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.617+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2479771275322067572', time=2024-09-14T13:15:34.027740+0000, chain.objs.size()=1 2024-09-14T11:22:50.618 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.617+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_._qZeg45d-tGuwPje88Tt0m0tF5n1AHQ_0 2024-09-14T11:22:50.618 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.617+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5433570610043535330', time=2024-09-14T13:15:34.040609+0000, chain.objs.size()=1 2024-09-14T11:22:50.618 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.617+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.dAnH0gKokFZXWgfc84jayOc_2ZvDquv_0 2024-09-14T11:22:50.618 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.617+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2633629222314239175', time=2024-09-14T13:15:34.045647+0000, chain.objs.size()=1 2024-09-14T11:22:50.618 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.617+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.GDtgXaJkdaE239vQ1YFPduymld5xPRK_0 2024-09-14T11:22:50.618 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.617+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4396887355851540562', time=2024-09-14T13:15:34.061276+0000, chain.objs.size()=1 2024-09-14T11:22:50.618 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.617+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.PKHOQ99hAmgx8aglU1ZYW1bzmRGELj0_0 2024-09-14T11:22:50.618 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.617+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13255929453233813937', time=2024-09-14T13:15:34.072159+0000, chain.objs.size()=1 2024-09-14T11:22:50.618 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.617+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.9_BecxBg953lCyHHqmZ1k3T-FnlrGoH_0 2024-09-14T11:22:50.619 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.617+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13162432143297988230', time=2024-09-14T13:15:34.251473+0000, chain.objs.size()=1 2024-09-14T11:22:50.619 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.617+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.uBlJN_YsMN615DEuJlu_gFW0lQf0u58_0 2024-09-14T11:22:50.619 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.617+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11166394068190656528', time=2024-09-14T13:15:34.360042+0000, chain.objs.size()=1 2024-09-14T11:22:50.619 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.617+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.CFx3Cs-tOeLbCGwi__-zx36sE9Qtxkd_0 2024-09-14T11:22:50.619 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.617+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5054715001128420714', time=2024-09-14T13:15:34.395346+0000, chain.objs.size()=1 2024-09-14T11:22:50.619 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.617+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.dQtm0tuxg4PfOX9iGoqnULHRnVp5zrg_0 2024-09-14T11:22:50.619 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.617+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10431012976687187270', time=2024-09-14T13:15:34.403096+0000, chain.objs.size()=1 2024-09-14T11:22:50.619 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.617+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.BZNNz0HHNmDOoLaf5-f-Yf9evhxm91d_0 2024-09-14T11:22:50.619 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.617+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12933050294774963231', time=2024-09-14T13:15:35.532648+0000, chain.objs.size()=1 2024-09-14T11:22:50.619 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.617+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.329__shadow_.FMtr5K2A0Rlw_wlHCVomnVNNk5FTgso_0 2024-09-14T11:22:50.619 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.619+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14211604420452726951', time=2024-09-14T13:16:02.933257+0000, chain.objs.size()=1 2024-09-14T11:22:50.619 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.619+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.432__shadow_.2IULuzDgBZVaeNTlx6ypQnJp0JlaEV5_0 2024-09-14T11:22:50.620 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.619+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1064261364816082341', time=2024-09-14T13:16:03.731126+0000, chain.objs.size()=1 2024-09-14T11:22:50.620 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.619+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.435__shadow_.HHI4m8qGhkVQuWl-laQGCOCyJJkyXH4_0 2024-09-14T11:22:50.620 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.619+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16462007120952052711', time=2024-09-14T13:16:05.218419+0000, chain.objs.size()=1 2024-09-14T11:22:50.620 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.619+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.440__shadow_.1HefS6rf04YTozqno_DfON1jmXxMFCU_0 2024-09-14T11:22:50.621 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.619+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3664572746817608913', time=2024-09-14T13:16:17.244334+0000, chain.objs.size()=1 2024-09-14T11:22:50.621 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.619+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.484__shadow_.EKv9U5s3_PlRUhJw3mHAPSfQ0xd3elo_0 2024-09-14T11:22:50.621 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.620+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13253665843873687138', time=2024-09-14T13:17:11.532762+0000, chain.objs.size()=1 2024-09-14T11:22:50.621 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.620+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.554__shadow_._Ztz1NDGjY-IMS9-cftvEDkuqpT78uJ_0 2024-09-14T11:22:50.621 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.620+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1157710905751831516', time=2024-09-14T13:17:32.075825+0000, chain.objs.size()=1 2024-09-14T11:22:50.621 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.620+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.576__shadow:vb0FC4qrYGwaJkMwSXtCLc4ip6D5kZj_.RkQs-TkhoRYcJshvpXRK_T4pJH7wNYd_0 2024-09-14T11:22:50.621 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.620+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15010973900053008953', time=2024-09-14T13:17:40.802538+0000, chain.objs.size()=1 2024-09-14T11:22:50.621 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.620+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.577__shadow:Kq6-jGupcYRH9rvxPEY9BLcwyggcpuC_.0ab5KPMa5Qt0ZJV9gEkojmZCYQniOBV_0 2024-09-14T11:22:50.621 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.620+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13256071967806376376', time=2024-09-14T13:20:15.089069+0000, chain.objs.size()=1 2024-09-14T11:22:50.621 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.620+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.650__shadow_.TQMp5WwaY-z9iqwz1vkIiMN8Z3I1fDr_0 2024-09-14T11:22:50.621 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.620+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10859737682209876250', time=2024-09-14T13:20:15.395486+0000, chain.objs.size()=1 2024-09-14T11:22:50.621 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.620+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.651__shadow_.62CrA4sQ7wdHXItoscISOzg3xmGxTP9_0 2024-09-14T11:22:50.621 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.620+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12587385093495663392', time=2024-09-14T13:20:43.457991+0000, chain.objs.size()=1 2024-09-14T11:22:50.621 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.620+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.715__shadow:q5AMsHKZY1osLERNpqKh0TP-ZHRgeQz_.FTlc86F8m3epAHir2HvQFDO75oePx07_0 2024-09-14T11:22:50.622 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.620+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13698615690567446205', time=2024-09-14T13:21:03.647658+0000, chain.objs.size()=1 2024-09-14T11:22:50.622 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.620+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.748__shadow_.4wDfDVAFTgwD1X-acV0_KeL1q3qPV5y_0 2024-09-14T11:22:50.622 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.623+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:50.624 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.625+0000 7f0f19c16800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:22:50.625 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.626+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:50.625 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.627+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:50.627 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.628+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46827' 2024-09-14T11:22:50.627 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.628+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='_aGd5eQ5sF8OXXIuvbmQtazDoRmMmBUq', time=2024-09-14T13:13:37.828177+0000, chain.objs.size()=1 2024-09-14T11:22:50.627 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.628+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.165__shadow_.ta3AbJQAohbLV8AI8mI0InZQQvqrOcJ_0 2024-09-14T11:22:50.627 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.628+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7144501177716997628', time=2024-09-14T13:13:43.993821+0000, chain.objs.size()=1 2024-09-14T11:22:50.627 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.628+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.177__shadow_.WR2SrtQ0TsHDRXHzA4NvYRrgGrTr41a_0 2024-09-14T11:22:50.627 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.628+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17765521049538922489', time=2024-09-14T13:14:47.225385+0000, chain.objs.size()=1 2024-09-14T11:22:50.627 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.628+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.241__shadow_.MkIrijiY-tiqjDA-IOvTjjl0iJCN92D_0 2024-09-14T11:22:50.627 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.628+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7060708044368804209', time=2024-09-14T13:14:47.510479+0000, chain.objs.size()=1 2024-09-14T11:22:50.628 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.628+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.242__shadow_.rDVwY10bbU_6N7KtXqY8m0W9LOM-tIN_0 2024-09-14T11:22:50.628 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.628+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10507614375832898375', time=2024-09-14T13:14:48.784046+0000, chain.objs.size()=1 2024-09-14T11:22:50.628 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.628+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.246__shadow_.-iMRRgKWPNGON1ARBVojqQlJx0g96ZR_0 2024-09-14T11:22:50.628 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.628+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14916685835352828715', time=2024-09-14T13:14:49.069099+0000, chain.objs.size()=1 2024-09-14T11:22:50.628 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.628+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.247__shadow_.KzFyD0iMlFKr6AV3I3XQhGAkMts_OAK_0 2024-09-14T11:22:50.628 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.628+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12117582529002870305', time=2024-09-14T13:14:52.625413+0000, chain.objs.size()=1 2024-09-14T11:22:50.628 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.628+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.261__shadow_.Db-xr4OPRpkZzqIEoAwh69Gcu4Knm0U_0 2024-09-14T11:22:50.628 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.628+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15846160180343292792', time=2024-09-14T13:14:59.738579+0000, chain.objs.size()=1 2024-09-14T11:22:50.628 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.628+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.DNsbt-qqEfwMG6h6ThPE9FVyw5-ml7P_0 2024-09-14T11:22:50.628 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.628+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.939697160117516295', time=2024-09-14T13:14:59.757678+0000, chain.objs.size()=1 2024-09-14T11:22:50.628 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.628+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Id-SQg0awus9JuMtds216LpxfqHZAuq_0 2024-09-14T11:22:50.628 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.628+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2393678647881160918', time=2024-09-14T13:14:59.761008+0000, chain.objs.size()=1 2024-09-14T11:22:50.628 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.628+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.wn0BtccbCZrMx6i19W4Iluy4mwA8MaN_0 2024-09-14T11:22:50.629 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.628+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4491909071131512802', time=2024-09-14T13:14:59.772687+0000, chain.objs.size()=1 2024-09-14T11:22:50.629 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.628+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.-hAQAS_yYzjIIy5tRxsut2gnht67WcF_0 2024-09-14T11:22:50.629 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.628+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4893045035902888665', time=2024-09-14T13:14:59.774194+0000, chain.objs.size()=1 2024-09-14T11:22:50.629 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.628+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.z1bfNkDsLonSBjrYSmrXm4p17IBpJhZ_0 2024-09-14T11:22:50.629 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.629+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17063108866032027423', time=2024-09-14T13:14:59.786611+0000, chain.objs.size()=1 2024-09-14T11:22:50.630 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.629+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.fyuZjPYHbFJ_gaFtNGpElqrZLaruqH8_0 2024-09-14T11:22:50.630 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.630+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8629247739792198899', time=2024-09-14T13:14:59.913750+0000, chain.objs.size()=1 2024-09-14T11:22:50.630 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.630+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.I_u8bT-C4_JcJdYYSC2n2z6dLwvLgFU_0 2024-09-14T11:22:50.630 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.630+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15408270821214313685', time=2024-09-14T13:14:59.955875+0000, chain.objs.size()=1 2024-09-14T11:22:50.630 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.630+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.ywUp-opqBggiRHWlXWMeR_-AkJ6qkka_0 2024-09-14T11:22:50.630 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.630+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2097456601527086064', time=2024-09-14T13:14:59.972155+0000, chain.objs.size()=1 2024-09-14T11:22:50.630 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.630+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.lEfqDePbzwYaxdANCSSBrqo12FYEnYe_0 2024-09-14T11:22:50.630 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.630+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15106704361350036560', time=2024-09-14T13:14:59.980452+0000, chain.objs.size()=1 2024-09-14T11:22:50.630 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.630+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Egam3JLWIKaMbejWa7vOWD30wzxkspM_0 2024-09-14T11:22:50.630 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.630+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5990513002655701856', time=2024-09-14T13:14:59.981447+0000, chain.objs.size()=1 2024-09-14T11:22:50.630 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.630+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.mkovbOA0YXVV9pND_YmvIS6h7RKLQ1E_0 2024-09-14T11:22:50.630 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.630+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3086934690473578355', time=2024-09-14T13:14:59.984791+0000, chain.objs.size()=1 2024-09-14T11:22:50.630 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.630+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.PpnTGXVhfnl71geb7bg49WYU4c3pLUV_0 2024-09-14T11:22:50.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.630+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5290519428649129770', time=2024-09-14T13:15:00.075943+0000, chain.objs.size()=1 2024-09-14T11:22:50.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.630+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.XYlUsVVkkDLilOpXIYfDSNSylcdfxfz_0 2024-09-14T11:22:50.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.630+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6635175634777192296', time=2024-09-14T13:15:00.077547+0000, chain.objs.size()=1 2024-09-14T11:22:50.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.630+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.ceUeeP0PuRxAkW9Ud8eWApZXRFt5tWf_0 2024-09-14T11:22:50.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.630+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5651391024802051967', time=2024-09-14T13:15:00.270116+0000, chain.objs.size()=1 2024-09-14T11:22:50.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.630+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Ns_eqZNURAkFocSsLrxKPoVLFix1Lc9_0 2024-09-14T11:22:50.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.631+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15515998643835339095', time=2024-09-14T13:15:00.283230+0000, chain.objs.size()=1 2024-09-14T11:22:50.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.631+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.GbBQ7k7IO2dGxikCLY_9Fqqd-9S-8Mu_0 2024-09-14T11:22:50.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.631+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1892176376077089752', time=2024-09-14T13:15:00.289804+0000, chain.objs.size()=1 2024-09-14T11:22:50.631 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.631+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.t0olPzfecvBL6xiVfIgkWVaGiNjComQ_0 2024-09-14T11:22:50.632 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.633+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3831341900329097904', time=2024-09-14T13:15:00.401248+0000, chain.objs.size()=1 2024-09-14T11:22:50.632 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.633+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.E5WJw9xHU6bT-wocZ2c9yeW11t9bpWR_0 2024-09-14T11:22:50.632 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.633+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9029277486277641824', time=2024-09-14T13:15:00.405417+0000, chain.objs.size()=1 2024-09-14T11:22:50.632 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.633+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.EVjnYW5Le4ocDt3EXVoG0Nn8L3y855y_0 2024-09-14T11:22:50.632 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.633+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11635193578171795151', time=2024-09-14T13:15:00.468402+0000, chain.objs.size()=1 2024-09-14T11:22:50.632 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.633+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.usyx3gg7wmrT72KiSaSPmTPSejU82us_0 2024-09-14T11:22:50.632 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.633+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14436708959178214868', time=2024-09-14T13:15:00.579230+0000, chain.objs.size()=1 2024-09-14T11:22:50.632 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.633+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.fPEQpViCvwqbY8HiRa3O7Z0dAYgBexe_0 2024-09-14T11:22:50.633 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.634+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18441321070273040252', time=2024-09-14T13:15:00.602797+0000, chain.objs.size()=1 2024-09-14T11:22:50.633 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.634+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.FJxxoxN3xLpAxRC36TGl4z-OXHsv0kS_0 2024-09-14T11:22:50.633 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.634+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2589976521038339079', time=2024-09-14T13:15:00.607408+0000, chain.objs.size()=1 2024-09-14T11:22:50.633 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.634+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.2oN3EqNATtMKyRWjFurzScIf6BljKmk_0 2024-09-14T11:22:50.633 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.634+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9618381502811058077', time=2024-09-14T13:15:00.714427+0000, chain.objs.size()=1 2024-09-14T11:22:50.633 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.634+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.GIx0VoGe1MAEZYd96Wgx7-FUoARBGiu_0 2024-09-14T11:22:50.633 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.634+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7622912094413699392', time=2024-09-14T13:15:00.748068+0000, chain.objs.size()=1 2024-09-14T11:22:50.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.634+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.qKj9sole5u6E3AIn5TZupyiA0Q2mNyF_0 2024-09-14T11:22:50.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.634+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2680715909959716029', time=2024-09-14T13:15:00.763842+0000, chain.objs.size()=1 2024-09-14T11:22:50.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.634+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Gsl1NZ0pRORUtltIWKzFXcJVQDqqv1P_0 2024-09-14T11:22:50.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.634+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8521290516877783123', time=2024-09-14T13:15:00.766777+0000, chain.objs.size()=1 2024-09-14T11:22:50.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.634+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.IiCHSC9aRmBmr4m7pwYEUfgA7GduTM3_0 2024-09-14T11:22:50.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.634+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16507817645715764826', time=2024-09-14T13:15:00.784162+0000, chain.objs.size()=1 2024-09-14T11:22:50.634 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.634+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.uS3VULUYgfcx_7cgxmusN9JaaeJkfgI_0 2024-09-14T11:22:50.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.635+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7724191583064091110', time=2024-09-14T13:15:00.875676+0000, chain.objs.size()=1 2024-09-14T11:22:50.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.635+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.VjBoX4WoPyBMxa0HT_TTrSLoZyFw1ZC_0 2024-09-14T11:22:50.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.635+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11579527276173471666', time=2024-09-14T13:15:00.935625+0000, chain.objs.size()=1 2024-09-14T11:22:50.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.635+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.V_69S303NYs_S3XTMqLU7w-qbO01pC5_0 2024-09-14T11:22:50.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.635+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16457584985871465762', time=2024-09-14T13:15:02.161520+0000, chain.objs.size()=1 2024-09-14T11:22:50.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.635+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.267__shadow_.tPWj-a-Xu07Vgr8U5YakVDi2-8y-InA_0 2024-09-14T11:22:50.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.635+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10456072994852449833', time=2024-09-14T13:15:04.402729+0000, chain.objs.size()=1 2024-09-14T11:22:50.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.635+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.276__shadow_.C2bppfzRJG1MR22vKkn3ry88JoMgn4b_0 2024-09-14T11:22:50.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.636+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4478920427893360687', time=2024-09-14T13:15:05.217953+0000, chain.objs.size()=1 2024-09-14T11:22:50.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.636+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.279__shadow_.csNyCgZw9F77E5bapmFDTuz5IsrFFOr_0 2024-09-14T11:22:50.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.636+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5034845021255779258', time=2024-09-14T13:15:06.422192+0000, chain.objs.size()=1 2024-09-14T11:22:50.635 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.636+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.283__shadow_.FrPyPYhikjE-ujghUWlYlkDjmm8IKx2_0 2024-09-14T11:22:50.636 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.636+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4384657658601016336', time=2024-09-14T13:15:09.825331+0000, chain.objs.size()=1 2024-09-14T11:22:50.636 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.636+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.293__shadow_.6fZb7_2Akb5a4snmjWs5cjMD9notOCG_0 2024-09-14T11:22:50.636 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.636+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.81499751041803034', time=2024-09-14T13:15:09.837345+0000, chain.objs.size()=1 2024-09-14T11:22:50.637 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.636+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.293__shadow_.qD_SI3JwGH85L-BevXQL2GbM-HEFRYa_0 2024-09-14T11:22:50.637 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.636+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15075144529333280989', time=2024-09-14T13:15:11.698147+0000, chain.objs.size()=1 2024-09-14T11:22:50.637 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.636+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.300__shadow_.SB6Vof0bMf17At7zIH5hKQadJxo5wpW_0 2024-09-14T11:22:50.637 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.636+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.110303087984410640', time=2024-09-14T13:15:24.716283+0000, chain.objs.size()=1 2024-09-14T11:22:50.637 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.636+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.bNEGyLTzrZ7ZBTVTGSY8cs2Jr8_VDuJ_0 2024-09-14T11:22:50.637 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.636+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9680615509740195712', time=2024-09-14T13:15:24.728394+0000, chain.objs.size()=1 2024-09-14T11:22:50.637 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.636+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.1BPi46gkFMtHMmST8e-DiMFYdYcL2lr_0 2024-09-14T11:22:50.637 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.637+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8075697708548345438', time=2024-09-14T13:15:24.753439+0000, chain.objs.size()=1 2024-09-14T11:22:50.637 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.637+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.Xf0qwUYqDIG4pWonIp3Kh0PHCJWwIRv_0 2024-09-14T11:22:50.637 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.637+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5547618414828085916', time=2024-09-14T13:15:24.759627+0000, chain.objs.size()=1 2024-09-14T11:22:50.637 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.637+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.3sMrn0nKhpWNkj83KN-JscXjDIxjUWS_0 2024-09-14T11:22:50.637 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.637+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.225713121026414458', time=2024-09-14T13:15:24.767538+0000, chain.objs.size()=1 2024-09-14T11:22:50.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.637+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.sfb4zt_NZYUsVG1XtPPbAm7IcCngHYz_0 2024-09-14T11:22:50.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.637+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11163969282479013914', time=2024-09-14T13:15:24.891751+0000, chain.objs.size()=1 2024-09-14T11:22:50.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.637+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.V5fKu_jpWwg5kM36GuQDJYJHwR_r9-z_0 2024-09-14T11:22:50.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.638+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17770771885716868479', time=2024-09-14T13:15:24.898015+0000, chain.objs.size()=1 2024-09-14T11:22:50.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.638+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.4qnX8k0nzEDnKbqQ9rNW445j7waB72p_0 2024-09-14T11:22:50.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.638+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4368261168368784573', time=2024-09-14T13:15:24.910509+0000, chain.objs.size()=1 2024-09-14T11:22:50.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.638+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.MWmtQNwGZxVgDNpWCoriU9Q3IBLZfFY_0 2024-09-14T11:22:50.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.638+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16140309622470048832', time=2024-09-14T13:15:24.946723+0000, chain.objs.size()=1 2024-09-14T11:22:50.638 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.638+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.MtCG1PnPpFWvvBqEWr-NrmmhPtfn4V8_0 2024-09-14T11:22:50.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.639+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14720240516962048027', time=2024-09-14T13:15:24.967649+0000, chain.objs.size()=1 2024-09-14T11:22:50.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.639+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.aU9AOYnjVLCqfLcJJeM87KAvQKtQD1P_0 2024-09-14T11:22:50.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.639+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15046987386014500154', time=2024-09-14T13:15:25.078699+0000, chain.objs.size()=1 2024-09-14T11:22:50.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.639+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.DjxxxQOX2xTVdq1Jn90L8Ys4hWDU1yE_0 2024-09-14T11:22:50.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.639+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9379851860707816260', time=2024-09-14T13:15:25.088308+0000, chain.objs.size()=1 2024-09-14T11:22:50.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.639+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.g3sESkMta9a5YcvQvg6D-RJYpeULzdU_0 2024-09-14T11:22:50.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.640+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17015397270787180322', time=2024-09-14T13:15:25.092520+0000, chain.objs.size()=1 2024-09-14T11:22:50.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.640+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.xY7woWXaKSwzrDU3mQY8C3c7GJXzAGR_0 2024-09-14T11:22:50.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.640+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10838119729310894631', time=2024-09-14T13:15:25.115439+0000, chain.objs.size()=1 2024-09-14T11:22:50.639 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.640+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.nrC-yt512Vj2lFWa47bzZsYLyrMRFGQ_0 2024-09-14T11:22:50.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.640+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9555132696690305327', time=2024-09-14T13:15:25.204977+0000, chain.objs.size()=1 2024-09-14T11:22:50.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.640+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.xMglANjkbcsTRgkhks_v-jaUVvv4YBp_0 2024-09-14T11:22:50.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.640+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11388907999809522983', time=2024-09-14T13:15:25.206664+0000, chain.objs.size()=1 2024-09-14T11:22:50.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.640+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.ochsiVO08ozyjyZadHHIKnyEHhXuE8T_0 2024-09-14T11:22:50.640 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.641+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3299689110860640071', time=2024-09-14T13:15:25.221291+0000, chain.objs.size()=1 2024-09-14T11:22:50.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.641+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.rv7ZxyJuw1oBl03iU4e4AAU6QQEBehk_0 2024-09-14T11:22:50.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.641+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11911907635919621653', time=2024-09-14T13:15:25.227946+0000, chain.objs.size()=1 2024-09-14T11:22:50.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.641+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.OVpq1LExfUzpL1d1hIhr-RUvrCiEc7w_0 2024-09-14T11:22:50.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.641+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13851529080960336677', time=2024-09-14T13:15:25.240259+0000, chain.objs.size()=1 2024-09-14T11:22:50.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.641+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.EOyzbDH4I8ocFnzR-oHjsy7DYx4UsUc_0 2024-09-14T11:22:50.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.641+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4783297456893192318', time=2024-09-14T13:15:25.241087+0000, chain.objs.size()=1 2024-09-14T11:22:50.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.641+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.3Ju0bfyk0SPgi_h7kCFhr4cQOIlbvOY_0 2024-09-14T11:22:50.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.641+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3704652825537171124', time=2024-09-14T13:15:25.248754+0000, chain.objs.size()=1 2024-09-14T11:22:50.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.641+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.C3nRhH4H8NJcJ7gTlCjP_oJ3r2q18uJ_0 2024-09-14T11:22:50.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.641+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1987989387291547485', time=2024-09-14T13:15:25.285979+0000, chain.objs.size()=1 2024-09-14T11:22:50.641 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.641+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.BltaFoGWD9TQmUPBmKibKchL_yzO7Wd_0 2024-09-14T11:22:50.642 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.641+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9439695828482640821', time=2024-09-14T13:15:25.381580+0000, chain.objs.size()=1 2024-09-14T11:22:50.642 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.641+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.g_7XNaRqX78YoXoHy5eBZd8cIKwLvGB_0 2024-09-14T11:22:50.642 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.642+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3261869156107969440', time=2024-09-14T13:15:25.386926+0000, chain.objs.size()=1 2024-09-14T11:22:50.642 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.642+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.CveXnq9bpE0auXNmWtIIm9kqZ9LacqD_0 2024-09-14T11:22:50.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.643+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13863208917162321194', time=2024-09-14T13:15:25.389239+0000, chain.objs.size()=1 2024-09-14T11:22:50.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.643+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.FiVGOhMRwAr8i-0jkpozwbwuOPduxy2_0 2024-09-14T11:22:50.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.643+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4891154941296568962', time=2024-09-14T13:15:25.403035+0000, chain.objs.size()=1 2024-09-14T11:22:50.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.643+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.y414oqXhOQLfb1vR0pNwSYpNMifC4aN_0 2024-09-14T11:22:50.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.643+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10691585508341564887', time=2024-09-14T13:15:25.452608+0000, chain.objs.size()=1 2024-09-14T11:22:50.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.643+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.nAoi8yfs-z07l_VX2ViPSVNpqHX0KLJ_0 2024-09-14T11:22:50.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.643+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11919415123556226722', time=2024-09-14T13:15:25.526888+0000, chain.objs.size()=1 2024-09-14T11:22:50.643 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.643+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.8FxBa4fM5uSh-g8psMZIQRsR1Gg3DeI_0 2024-09-14T11:22:50.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.643+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4628145546387984253', time=2024-09-14T13:15:25.578792+0000, chain.objs.size()=1 2024-09-14T11:22:50.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.643+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.Iiz_ZdcGDdpx2H5KejtC-IhzOYPfWEz_0 2024-09-14T11:22:50.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.643+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10784143082816609641', time=2024-09-14T13:15:25.584226+0000, chain.objs.size()=1 2024-09-14T11:22:50.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.643+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.mVUemlrpeU1JFLvJFarbKyY1OsUqjC5_0 2024-09-14T11:22:50.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.643+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5428731855580031863', time=2024-09-14T13:15:25.590841+0000, chain.objs.size()=1 2024-09-14T11:22:50.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.643+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.gCeHPviSu27jt7Jrbr6Tywi1DSpLtT3_0 2024-09-14T11:22:50.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.643+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12698561219871802517', time=2024-09-14T13:15:25.598089+0000, chain.objs.size()=1 2024-09-14T11:22:50.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.643+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.VeTpgDyEjOC8fdMUpChZZPZp0BApsGt_0 2024-09-14T11:22:50.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.643+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6434928770281767117', time=2024-09-14T13:15:25.688736+0000, chain.objs.size()=1 2024-09-14T11:22:50.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.643+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.sqxGwERq-flxPwI1KNm-lmQ2nh6SRqs_0 2024-09-14T11:22:50.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.643+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7820078938596714444', time=2024-09-14T13:15:25.695110+0000, chain.objs.size()=1 2024-09-14T11:22:50.644 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.643+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.LOO3jVWLQ38tZ6Sx5oFnYQTrUyIx5FE_0 2024-09-14T11:22:50.645 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.643+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1870021586719849481', time=2024-09-14T13:15:25.699697+0000, chain.objs.size()=1 2024-09-14T11:22:50.645 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.643+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.iIWN1FNqjIyeanBLu-x0WC4bSJabddy_0 2024-09-14T11:22:50.646 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.645+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17235647333198365165', time=2024-09-14T13:15:25.709601+0000, chain.objs.size()=1 2024-09-14T11:22:50.646 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.645+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.AVxnA4IhDZT3v4hah-cncf2kMRrlZCB_0 2024-09-14T11:22:50.646 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.645+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3531398358097247781', time=2024-09-14T13:15:25.723673+0000, chain.objs.size()=1 2024-09-14T11:22:50.647 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.645+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.tTeoXoPp9IEezPt1qUItYeiBPtwbrBc_0 2024-09-14T11:22:50.647 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.645+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13637361306772520351', time=2024-09-14T13:15:25.724444+0000, chain.objs.size()=1 2024-09-14T11:22:50.647 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.645+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.4HiybExuGEw2X-datOtxVArzwDVBBu7_0 2024-09-14T11:22:50.647 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.645+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1709407463714590283', time=2024-09-14T13:15:25.752431+0000, chain.objs.size()=1 2024-09-14T11:22:50.647 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.645+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.jRzt83eXR_nOtiVtTZdmgyNGcN7T5_Z_0 2024-09-14T11:22:50.647 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.645+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13484402760887638261', time=2024-09-14T13:15:25.947984+0000, chain.objs.size()=1 2024-09-14T11:22:50.647 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.645+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.CDR6sqCsKv-N1Ky0C5H4t462mO0SCyZ_0 2024-09-14T11:22:50.647 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.645+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16394965266385947991', time=2024-09-14T13:15:33.166484+0000, chain.objs.size()=1 2024-09-14T11:22:50.647 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.645+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.sZTQbVlKtzY9fj4WrlFzgEtn4oKroj6_0 2024-09-14T11:22:50.647 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.645+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2852154369411447716', time=2024-09-14T13:15:33.180196+0000, chain.objs.size()=1 2024-09-14T11:22:50.647 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.645+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.89M-tI-EjMc_s2W_douyGyu11bLAUgJ_0 2024-09-14T11:22:50.647 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.645+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17395871867408909756', time=2024-09-14T13:15:33.181202+0000, chain.objs.size()=1 2024-09-14T11:22:50.648 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.645+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.ID67xj78hQLdGniTiIVt4gbyvdfYpaE_0 2024-09-14T11:22:50.648 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.645+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4493416646514609174', time=2024-09-14T13:15:33.192917+0000, chain.objs.size()=1 2024-09-14T11:22:50.648 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.645+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.NrMaU-2oPQvWIWOWiRbjOR5i_VDxMkl_0 2024-09-14T11:22:50.648 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.645+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12238872190650493031', time=2024-09-14T13:15:33.218146+0000, chain.objs.size()=1 2024-09-14T11:22:50.648 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.645+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Yx5zmJJGQ_Yu8MgSsYfa_MWQhn2qR4A_0 2024-09-14T11:22:50.648 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.645+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17181572365543323217', time=2024-09-14T13:15:33.223697+0000, chain.objs.size()=1 2024-09-14T11:22:50.648 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.645+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.ELxZ1ibWhy24Lur2_qNfDWtfVb8RDC5_0 2024-09-14T11:22:50.648 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.646+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3232648278504750979', time=2024-09-14T13:15:33.245125+0000, chain.objs.size()=1 2024-09-14T11:22:50.648 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.646+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.coC9TzXpLEhe7iZ2NL0ND2cqvR7aHRG_0 2024-09-14T11:22:50.648 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.647+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6741585474092614439', time=2024-09-14T13:15:33.250486+0000, chain.objs.size()=1 2024-09-14T11:22:50.648 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.647+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.JAxtOV6LDg6wC7xZxCN9vK7LNjLbl5M_0 2024-09-14T11:22:50.648 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.647+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15199668962323457475', time=2024-09-14T13:15:33.367939+0000, chain.objs.size()=1 2024-09-14T11:22:50.648 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.647+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.EohyO_WpaIFlYudYbnGATJ7yPLlhX1Q_0 2024-09-14T11:22:50.649 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.647+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4425097400696463793', time=2024-09-14T13:15:33.430665+0000, chain.objs.size()=1 2024-09-14T11:22:50.649 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.647+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.o5bx6Iv_pnCey0FAV_5tkE-gxQ33BTb_0 2024-09-14T11:22:50.649 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.647+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13443928405379872544', time=2024-09-14T13:15:33.529915+0000, chain.objs.size()=1 2024-09-14T11:22:50.649 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.647+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.qVoFtPw_lSALRgbAuSF31i2bWpl9OgQ_0 2024-09-14T11:22:50.649 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.647+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9147666218413165970', time=2024-09-14T13:15:33.553937+0000, chain.objs.size()=1 2024-09-14T11:22:50.649 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.647+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.shYnQgBwymrUIsJTwTg-ns8AfID7xW2_0 2024-09-14T11:22:50.649 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.647+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12194757869119700608', time=2024-09-14T13:15:33.615769+0000, chain.objs.size()=1 2024-09-14T11:22:50.649 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.647+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.beQSs4-KptecahNKRAhp6m9200e_osJ_0 2024-09-14T11:22:50.649 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.647+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10144313247992349240', time=2024-09-14T13:15:33.706436+0000, chain.objs.size()=1 2024-09-14T11:22:50.649 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.647+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.teNQbwT0bNtywgrdoWroU2WEcQcw6IO_0 2024-09-14T11:22:50.649 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.647+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10160968995216786234', time=2024-09-14T13:15:33.741130+0000, chain.objs.size()=1 2024-09-14T11:22:50.649 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.647+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.d-jl6ozaufBVgThidI2WCvnvltiuoLa_0 2024-09-14T11:22:50.649 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.647+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14494928765917833334', time=2024-09-14T13:15:33.852145+0000, chain.objs.size()=1 2024-09-14T11:22:50.649 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.647+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.li5m9-il-lqIcU34hItHfW3QTZwDOIS_0 2024-09-14T11:22:50.650 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.649+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 0/46827 2024-09-14T11:22:50.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.652+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=37, truncated=0, next_marker='' 2024-09-14T11:22:50.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.652+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13672357036434272656', time=2024-09-14T13:15:33.856361+0000, chain.objs.size()=1 2024-09-14T11:22:50.651 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.652+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.dCBCO_9sGfa3M2nlEVC3hTGjme0Q0xJ_0 2024-09-14T11:22:50.652 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.652+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17175222009133374003', time=2024-09-14T13:15:33.861914+0000, chain.objs.size()=1 2024-09-14T11:22:50.652 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.652+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.-e02vUoBRI6e6SOAJwjEBEHMtCgOy1U_0 2024-09-14T11:22:50.652 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.652+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5535134152873863070', time=2024-09-14T13:15:33.875892+0000, chain.objs.size()=1 2024-09-14T11:22:50.652 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.652+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.E6pknvZnYP1zoJULaOoLgRiXZvAk0xY_0 2024-09-14T11:22:50.652 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.652+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.281258222394171529', time=2024-09-14T13:15:33.901389+0000, chain.objs.size()=1 2024-09-14T11:22:50.652 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.652+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.G4OlPbIsKZ6u_wQ0RBrD8MAXk6zLecG_0 2024-09-14T11:22:50.652 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.652+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3517966595320605934', time=2024-09-14T13:15:33.922886+0000, chain.objs.size()=1 2024-09-14T11:22:50.652 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.652+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.ZMYX916Yf8W6A6O1wDVfUUmXQSKwOTV_0 2024-09-14T11:22:50.652 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.652+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12136732460563589061', time=2024-09-14T13:15:33.926545+0000, chain.objs.size()=1 2024-09-14T11:22:50.652 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.652+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.qRb9E8tdXZjQPRO0x-DRuJOuhimFqsE_0 2024-09-14T11:22:50.652 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.652+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.90466121636233153', time=2024-09-14T13:15:33.934763+0000, chain.objs.size()=1 2024-09-14T11:22:50.652 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.652+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.fE0178VM1rEksO_pwfnbuCa3lVXJ6cp_0 2024-09-14T11:22:50.652 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.652+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8048870604602711012', time=2024-09-14T13:15:34.015690+0000, chain.objs.size()=1 2024-09-14T11:22:50.653 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.652+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.XhUzlByyYPj9gJ9K3G7ueetxoYWbrZV_0 2024-09-14T11:22:50.653 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.652+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4711072794668491742', time=2024-09-14T13:15:34.029119+0000, chain.objs.size()=1 2024-09-14T11:22:50.653 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.652+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.EGBz3en2FYRzVikMJsQsKBvVPWMQR1z_0 2024-09-14T11:22:50.653 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.652+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9610139151256888255', time=2024-09-14T13:15:34.062439+0000, chain.objs.size()=1 2024-09-14T11:22:50.653 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.652+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.ZnKbqJmWbY7d93NYtCqIXt1iIixrXJK_0 2024-09-14T11:22:50.653 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.652+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9418767096526595893', time=2024-09-14T13:15:34.077366+0000, chain.objs.size()=1 2024-09-14T11:22:50.653 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.652+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.XSjggpdxo2OMoiP2xzhwwAyGyHDXwM8_0 2024-09-14T11:22:50.653 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.652+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9428268954949016986', time=2024-09-14T13:15:34.174502+0000, chain.objs.size()=1 2024-09-14T11:22:50.653 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.652+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Js8rstm3CIxYyZ78pWXG3SOEf3oxGLz_0 2024-09-14T11:22:50.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.654+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.465213046784397959', time=2024-09-14T13:15:34.175282+0000, chain.objs.size()=1 2024-09-14T11:22:50.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.654+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.6C01UbZkM8M2q-qpyyAqYm2jzDPxjYv_0 2024-09-14T11:22:50.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.654+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3523527348026443425', time=2024-09-14T13:15:34.185815+0000, chain.objs.size()=1 2024-09-14T11:22:50.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.654+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.hCWCH7e_iK30Ek1EG8TEhhCHGvCIWD-_0 2024-09-14T11:22:50.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.654+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3605672040699309131', time=2024-09-14T13:15:34.209952+0000, chain.objs.size()=1 2024-09-14T11:22:50.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.654+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.5-ZiX0iYr2gG-zCzi6sJiiIocmqyExY_0 2024-09-14T11:22:50.654 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.654+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11202836077130075226', time=2024-09-14T13:15:34.240670+0000, chain.objs.size()=1 2024-09-14T11:22:50.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.654+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.fRb74TT4QlxsXiwclgMd8qcWw3NtFkV_0 2024-09-14T11:22:50.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.654+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10380495283402745616', time=2024-09-14T13:15:34.258258+0000, chain.objs.size()=1 2024-09-14T11:22:50.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.654+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.sdWe9k0SfxLyw9S3DJocTZQYlcP8KJ0_0 2024-09-14T11:22:50.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.654+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16062327273157952047', time=2024-09-14T13:15:34.357390+0000, chain.objs.size()=1 2024-09-14T11:22:50.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.654+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.WN23DamWN0Oso23wlxq0Zc5CN07-vGf_0 2024-09-14T11:22:50.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.654+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13787504715788401211', time=2024-09-14T13:15:34.367217+0000, chain.objs.size()=1 2024-09-14T11:22:50.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.654+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.R5ba85ua0Eriy-EtGwScdy0COK7ufDX_0 2024-09-14T11:22:50.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.654+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16272145888625541657', time=2024-09-14T13:15:46.679505+0000, chain.objs.size()=1 2024-09-14T11:22:50.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.654+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.375__shadow_.71kDpIZnq0o-fbho1zw3fa-uOQPqZoe_0 2024-09-14T11:22:50.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.654+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12285089713995092224', time=2024-09-14T13:16:16.976047+0000, chain.objs.size()=1 2024-09-14T11:22:50.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.654+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.483__shadow_.HSPmFv6Dv1alwe47CLeQ5agg_UYorib_0 2024-09-14T11:22:50.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.654+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14381938772611487806', time=2024-09-14T13:16:18.678605+0000, chain.objs.size()=1 2024-09-14T11:22:50.655 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.654+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.488__shadow_.QsgrOq5ynpzYVD_LrhgNBKHVJsMdO4N_0 2024-09-14T11:22:50.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.654+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='2~NIiQv7HsECjfM7HXopuifuR-QJFlx3l', time=2024-09-14T13:16:33.114532+0000, chain.objs.size()=1 2024-09-14T11:22:50.656 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.654+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.522__multipart_mymultipart.2~NIiQv7HsECjfM7HXopuifuR-QJFlx3l.3 2024-09-14T11:22:50.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.656+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12893780545286384646', time=2024-09-14T13:16:37.833706+0000, chain.objs.size()=1 2024-09-14T11:22:50.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.656+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.524__shadow_.tEygP3axoq8kULypTbjVPPdHs22qIN-_0 2024-09-14T11:22:50.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.656+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17570571961286344974', time=2024-09-14T13:17:13.333686+0000, chain.objs.size()=1 2024-09-14T11:22:50.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.656+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.558__shadow_.CGlwq8l2mny2ecnrS8v76c3PTUgp4KJ_0 2024-09-14T11:22:50.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.656+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15312354674143100174', time=2024-09-14T13:17:13.446677+0000, chain.objs.size()=1 2024-09-14T11:22:50.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.656+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.558__shadow_.3vX4rCojIXoIQckC1tM3valBjLKRNyT_0 2024-09-14T11:22:50.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.656+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17735197810560584679', time=2024-09-14T13:17:23.126362+0000, chain.objs.size()=1 2024-09-14T11:22:50.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.656+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.569__shadow:RteeJ-Z6vXID55o24MD9a3w4t78sJvy_.Rt13F7qJGDajpEs3mTXZTHICVnSXWQC_0 2024-09-14T11:22:50.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.656+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9025479973178848067', time=2024-09-14T13:17:26.676324+0000, chain.objs.size()=1 2024-09-14T11:22:50.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.656+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.569__shadow:MCd9wNN3Y9W9YyC1M-PfuP.dv9WXH8a_.Wf3HeqCEnVtTz3n3GTHQh__W3TFl737_0 2024-09-14T11:22:50.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.656+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11561164377758822392', time=2024-09-14T13:17:31.627141+0000, chain.objs.size()=1 2024-09-14T11:22:50.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.656+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.575__shadow_.ZSnIBCsuuxS1OnV3kVDsVKJ5Y929v6s_0 2024-09-14T11:22:50.657 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.656+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1273327036559810197', time=2024-09-14T13:17:34.094698+0000, chain.objs.size()=1 2024-09-14T11:22:50.658 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.656+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.576__shadow:zKfpU.q8I7yYBnEhl8PSUekvLIwsqBW_.kOHpEJJn0yZ1H-t9Z1WJ57ec4cOTT2b_0 2024-09-14T11:22:50.658 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.656+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3815827090030400692', time=2024-09-14T13:17:47.216779+0000, chain.objs.size()=1 2024-09-14T11:22:50.658 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.656+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.577__shadow:UuaVq517WQ9.mD3.WW9Vyw.E.7wtgH0_.rAG1D7aS-gTCFzhYA4YOB5ND40f9RA5_0 2024-09-14T11:22:50.658 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.656+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5784126438659764045', time=2024-09-14T13:17:50.035414+0000, chain.objs.size()=1 2024-09-14T11:22:50.658 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.656+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.579__shadow:O.0FC9Ev0HYk06lHYESUmO60-d2t84W_.elWaRCXi4kdWKQ4AmPjuOtqUs_V66Ja_0 2024-09-14T11:22:50.658 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.656+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13700216869052804294', time=2024-09-14T13:20:12.473518+0000, chain.objs.size()=1 2024-09-14T11:22:50.658 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.656+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.643__shadow_.NvyY1Dk-ARiofzGFpCEwKMhjJm1m9PH_0 2024-09-14T11:22:50.658 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.656+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1084898537078108012', time=2024-09-14T13:20:27.323747+0000, chain.objs.size()=1 2024-09-14T11:22:50.658 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.656+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.692__shadow:CErIqVrX7Iwmp3AhJxRfVF7g7uGrsO8_.zmX2sQ4lSqAz90G-ytcG-3gi1rjNWlZ_0 2024-09-14T11:22:50.658 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.657+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16334369428637471370', time=2024-09-14T13:21:00.333296+0000, chain.objs.size()=1 2024-09-14T11:22:50.658 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.657+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.742__multipart_mymultipart3.2~DXJV6Tutr-rdM7ns2-JvFrTyznuFHKm.1 2024-09-14T11:22:50.658 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.657+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8745088194202513860', time=2024-09-14T13:21:06.320302+0000, chain.objs.size()=1 2024-09-14T11:22:50.658 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.657+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.755__shadow_.R6vooMtLyA2kYlkHFfQ5EheJ3BakE8M_0 2024-09-14T11:22:50.658 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.658+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11573320480168822308', time=2024-09-14T13:21:10.829243+0000, chain.objs.size()=1 2024-09-14T11:22:50.659 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.658+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.764__shadow_.wZhN_-9haiVJIdWbRayGqwVRI-ebRJM_0 2024-09-14T11:22:50.659 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.659+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:50.660 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.662+0000 7f0f19c16800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:22:50.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.663+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:50.662 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.663+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:50.663 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.664+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45487' 2024-09-14T11:22:50.663 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.664+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13507359495634093646', time=2024-09-14T13:13:33.346347+0000, chain.objs.size()=2 2024-09-14T11:22:50.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.664+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.158__shadow_.-oik_VM9uX49ZLhJTShleooG1PMzVD2_0 2024-09-14T11:22:50.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.664+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.158__shadow_.-oik_VM9uX49ZLhJTShleooG1PMzVD2_1 2024-09-14T11:22:50.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.664+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14432612587031362107', time=2024-09-14T13:13:50.902299+0000, chain.objs.size()=1 2024-09-14T11:22:50.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.664+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.197__shadow_.HecXPgHr3JuICt9uvTEEnAgUvFBjgaz_0 2024-09-14T11:22:50.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.664+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17538117085440735833', time=2024-09-14T13:14:43.937310+0000, chain.objs.size()=1 2024-09-14T11:22:50.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.664+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.228__shadow_.AUafCsXzIp_w-IfGMt2oRMoP6HnZ5J0_0 2024-09-14T11:22:50.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.664+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1531777511346437316', time=2024-09-14T13:14:49.069361+0000, chain.objs.size()=1 2024-09-14T11:22:50.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.664+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.247__shadow_.pbffbgEJaLI14tVrehAFZBP8nE4hk9i_0 2024-09-14T11:22:50.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.664+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.623457347204608625', time=2024-09-14T13:14:50.066922+0000, chain.objs.size()=1 2024-09-14T11:22:50.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.664+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.251__shadow_.HTHxIGEZ0bo_QwYehkeL_IMRQ2-tGPK_0 2024-09-14T11:22:50.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.664+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1538487193974700655', time=2024-09-14T13:14:50.316900+0000, chain.objs.size()=1 2024-09-14T11:22:50.664 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.664+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.252__shadow_.Q4Sdzx_u1mtfja_Hak_kAv-6AkLsb9T_0 2024-09-14T11:22:50.665 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.664+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17774543845707771989', time=2024-09-14T13:14:59.738772+0000, chain.objs.size()=1 2024-09-14T11:22:50.665 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.664+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.S8flslTJAkn4nyDdZ1rjgzZGpVDlQqP_0 2024-09-14T11:22:50.665 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.664+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2939195446869973597', time=2024-09-14T13:14:59.754886+0000, chain.objs.size()=1 2024-09-14T11:22:50.665 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.664+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.vHlKkeEu6pVn1wFFBc3M58ylPmz-Mhd_0 2024-09-14T11:22:50.665 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.664+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12414809193248929407', time=2024-09-14T13:14:59.773109+0000, chain.objs.size()=1 2024-09-14T11:22:50.665 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.664+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.kMml_LA8t1ayvfYVD8aqT_kmKxwCVNJ_0 2024-09-14T11:22:50.665 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.664+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14039974189210525558', time=2024-09-14T13:14:59.810891+0000, chain.objs.size()=1 2024-09-14T11:22:50.665 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.664+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.EOB4YcGOm_XI_vm4hQIELFJwUuXn5xF_0 2024-09-14T11:22:50.665 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.664+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5372455704255531373', time=2024-09-14T13:14:59.813439+0000, chain.objs.size()=1 2024-09-14T11:22:50.665 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.664+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.XvW7ritv6u3mr1T7dutxC51FHXMCv2J_0 2024-09-14T11:22:50.666 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.667+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15040565056126868645', time=2024-09-14T13:14:59.816605+0000, chain.objs.size()=1 2024-09-14T11:22:50.666 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.667+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.c3lNd_hkENQf7Y62Du_i5z8huoa8O-E_0 2024-09-14T11:22:50.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.667+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15705761804111145739', time=2024-09-14T13:14:59.968901+0000, chain.objs.size()=1 2024-09-14T11:22:50.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.667+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.J12ueQHMMeY4TpQjy-Y0YxJ4jrTII8Z_0 2024-09-14T11:22:50.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.667+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.226098683257779690', time=2024-09-14T13:15:00.064934+0000, chain.objs.size()=1 2024-09-14T11:22:50.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.667+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.1JbYUxRI7DSN4uJTNJZ7GedBM-Zy8FQ_0 2024-09-14T11:22:50.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.667+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5719351732534532668', time=2024-09-14T13:15:00.084656+0000, chain.objs.size()=1 2024-09-14T11:22:50.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.667+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.1z-KMW7-D-1s4fMT4OLYqYbPjIX3Q5u_0 2024-09-14T11:22:50.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.667+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5233829000864723791', time=2024-09-14T13:15:00.111869+0000, chain.objs.size()=1 2024-09-14T11:22:50.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.667+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.97mOjqSIn-6vQ4l5oj5qGaazZHhYqSy_0 2024-09-14T11:22:50.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.667+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7357390817617599748', time=2024-09-14T13:15:00.119953+0000, chain.objs.size()=1 2024-09-14T11:22:50.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.668+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.EGeLz6aZwz_o52b_vLywy3MjjxudH4d_0 2024-09-14T11:22:50.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.668+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5513525700516885523', time=2024-09-14T13:15:00.128466+0000, chain.objs.size()=1 2024-09-14T11:22:50.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.668+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.KM7J9FDnSNjV4e21nlHEnhBQZrf6arm_0 2024-09-14T11:22:50.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.668+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.787159629548961208', time=2024-09-14T13:15:00.144674+0000, chain.objs.size()=1 2024-09-14T11:22:50.667 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.668+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.DQLg-PTGYKHpXKmCV3kxJPAZGb4JPnL_0 2024-09-14T11:22:50.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.668+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15692648869989258537', time=2024-09-14T13:15:00.230088+0000, chain.objs.size()=1 2024-09-14T11:22:50.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.668+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.kyBz11wyOtcGvTJt9IVo3hZSKWU4aUM_0 2024-09-14T11:22:50.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.668+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3776447440058639379', time=2024-09-14T13:15:00.281768+0000, chain.objs.size()=1 2024-09-14T11:22:50.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.668+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.rdtZVW0dGcakLWEv6OM40UxuqD9ZX_V_0 2024-09-14T11:22:50.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.668+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.542164147051392843', time=2024-09-14T13:15:00.294423+0000, chain.objs.size()=1 2024-09-14T11:22:50.668 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.668+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.ETogJL9-CMKRdMe6CdH4bnDlF5_W85q_0 2024-09-14T11:22:50.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.670+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6665671496284443605', time=2024-09-14T13:15:00.304062+0000, chain.objs.size()=1 2024-09-14T11:22:50.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.670+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.1RrlI20ViZJvWzFZ0H9DVrTeZ878iit_0 2024-09-14T11:22:50.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.670+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16619804938848047441', time=2024-09-14T13:15:00.310818+0000, chain.objs.size()=1 2024-09-14T11:22:50.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.670+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.0vKE__Z259rmb-bkIj3m0LMpDTbGbmV_0 2024-09-14T11:22:50.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.670+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7294574719953140586', time=2024-09-14T13:15:00.393224+0000, chain.objs.size()=1 2024-09-14T11:22:50.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.670+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.TG0U56R7FaN7XNk2vw1J-Ihzf81i0Km_0 2024-09-14T11:22:50.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.670+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16289098607245139468', time=2024-09-14T13:15:00.416363+0000, chain.objs.size()=1 2024-09-14T11:22:50.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.670+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.irBznGMIV6FKWTih6_xomX9cNkvsP97_0 2024-09-14T11:22:50.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.670+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2998752012511655909', time=2024-09-14T13:15:00.439853+0000, chain.objs.size()=1 2024-09-14T11:22:50.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.670+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.l9V22vp9d2si5sd5Wi4o3vKXMKo8JIU_0 2024-09-14T11:22:50.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.670+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5616762382425250929', time=2024-09-14T13:15:00.454094+0000, chain.objs.size()=1 2024-09-14T11:22:50.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.670+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.AkhEfxl4VdqAm5CRsh0BVydtweNONgX_0 2024-09-14T11:22:50.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.670+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16845519157247193382', time=2024-09-14T13:15:00.459381+0000, chain.objs.size()=1 2024-09-14T11:22:50.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.670+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.do2OEtQyH_Y0Tmk5XDOdwBBNIh6AT4B_0 2024-09-14T11:22:50.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.670+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2707018658719707833', time=2024-09-14T13:15:00.476226+0000, chain.objs.size()=1 2024-09-14T11:22:50.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.670+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.OgPNEcqfOHZS7jXBhXrybgwrh1Fzer6_0 2024-09-14T11:22:50.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.670+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17308674651634930798', time=2024-09-14T13:15:00.562607+0000, chain.objs.size()=1 2024-09-14T11:22:50.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.670+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.x8UOwO_yIGGLajjz4K0nYly241V5Pdi_0 2024-09-14T11:22:50.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.670+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2085877055743740294', time=2024-09-14T13:15:00.566907+0000, chain.objs.size()=1 2024-09-14T11:22:50.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.670+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.utWnUiHgxQh5ihXEgE1T7NZT4N4AxuT_0 2024-09-14T11:22:50.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.670+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4753647044839332997', time=2024-09-14T13:15:00.572114+0000, chain.objs.size()=1 2024-09-14T11:22:50.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.670+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.wbM-fhGLgjXt37MXCjd1swmbFw1igds_0 2024-09-14T11:22:50.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.671+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17534006917750973000', time=2024-09-14T13:15:00.590248+0000, chain.objs.size()=1 2024-09-14T11:22:50.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.671+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.rnzMn2zLS9hY4tcHpdB-7LWtmM05Z79_0 2024-09-14T11:22:50.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.671+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8642226637673312106', time=2024-09-14T13:15:00.742948+0000, chain.objs.size()=1 2024-09-14T11:22:50.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.671+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.TiAqJK2XtobQjtRL75p2ExUwD9f7MAh_0 2024-09-14T11:22:50.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.671+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14831487390593110784', time=2024-09-14T13:15:00.745159+0000, chain.objs.size()=1 2024-09-14T11:22:50.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.671+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.F2X-uT-0xkKA2Ni7rZn6lqgw5IC0cYa_0 2024-09-14T11:22:50.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.672+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5232762674547222588', time=2024-09-14T13:15:00.760043+0000, chain.objs.size()=1 2024-09-14T11:22:50.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.672+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.BIqhFwMPuKXQFAc0Rhrs-XpM7rb6ZoH_0 2024-09-14T11:22:50.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.672+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3832288597986347483', time=2024-09-14T13:15:00.768545+0000, chain.objs.size()=1 2024-09-14T11:22:50.672 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.672+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.UrfX-_dWktH1Y9rVtedWRYMfmyYQHbi_0 2024-09-14T11:22:50.673 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.672+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5585754165964888362', time=2024-09-14T13:15:00.787334+0000, chain.objs.size()=1 2024-09-14T11:22:50.673 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.672+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.iAgdvjyPc9KhXODKXC14PKyGN3dM-CR_0 2024-09-14T11:22:50.673 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.672+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17137510165996008751', time=2024-09-14T13:15:00.871859+0000, chain.objs.size()=1 2024-09-14T11:22:50.673 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.672+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.TOek8fipp_k7dNzQurQP3vo5RvvM1_o_0 2024-09-14T11:22:50.673 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.672+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3601383029171820458', time=2024-09-14T13:15:00.927985+0000, chain.objs.size()=1 2024-09-14T11:22:50.673 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.672+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.izAyxjD3tQ1FavWB94gTc5WC0rD2PON_0 2024-09-14T11:22:50.673 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.672+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4891318024628487041', time=2024-09-14T13:15:08.294666+0000, chain.objs.size()=1 2024-09-14T11:22:50.673 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.672+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.290__shadow_.NucY8jpahtGFdyYDY6tDoTUwyOnP94R_0 2024-09-14T11:22:50.673 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.672+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1298321152231171096', time=2024-09-14T13:15:16.894446+0000, chain.objs.size()=1 2024-09-14T11:22:50.673 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.672+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.321__shadow_.ko9phc3xij0wxai4e4nzEEjrOivf5ig_0 2024-09-14T11:22:50.673 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.672+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3249955298191602895', time=2024-09-14T13:15:24.724385+0000, chain.objs.size()=1 2024-09-14T11:22:50.673 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.672+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.H--yfH3zvzjq58RukmO5n4ZgD6CWo5R_0 2024-09-14T11:22:50.673 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.673+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14172603072013282471', time=2024-09-14T13:15:24.738603+0000, chain.objs.size()=1 2024-09-14T11:22:50.673 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.673+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.od6Le3czcN2Lmdy99YypZVCzGNkTnpM_0 2024-09-14T11:22:50.674 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.673+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6762940038208519255', time=2024-09-14T13:15:24.763514+0000, chain.objs.size()=1 2024-09-14T11:22:50.674 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.673+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.7k6K86mHKjFMDsyRurCmtM3tvYevNs9_0 2024-09-14T11:22:50.674 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.673+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8868613180481813728', time=2024-09-14T13:15:24.764320+0000, chain.objs.size()=1 2024-09-14T11:22:50.674 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.673+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.wENqZcjC9Xhuj2YhbWh5vojUwlC7R01_0 2024-09-14T11:22:50.674 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.675+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2078445937518244811', time=2024-09-14T13:15:24.785511+0000, chain.objs.size()=1 2024-09-14T11:22:50.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.675+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.9BW4qekqfw5FZVqI24otQbaiwG9fpTQ_0 2024-09-14T11:22:50.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.675+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13533136194830585411', time=2024-09-14T13:15:24.800815+0000, chain.objs.size()=1 2024-09-14T11:22:50.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.675+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.Ro2_58CpRat2GEVJnxJe45Zd8h5U7MQ_0 2024-09-14T11:22:50.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.675+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3124118173336939334', time=2024-09-14T13:15:24.893766+0000, chain.objs.size()=1 2024-09-14T11:22:50.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.675+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_._5IlAgUttnN9FCvosjvXkzJdgyn8mjS_0 2024-09-14T11:22:50.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.675+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4164172212960179069', time=2024-09-14T13:15:24.925658+0000, chain.objs.size()=1 2024-09-14T11:22:50.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.675+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.fRaVZTdFDauIH-lRxUMz9gdr56gZbaJ_0 2024-09-14T11:22:50.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.675+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15389300828716568605', time=2024-09-14T13:15:24.943192+0000, chain.objs.size()=1 2024-09-14T11:22:50.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.675+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.3K0RhzctZ_OZpDZkCoEctCZuDUCNdf__0 2024-09-14T11:22:50.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.675+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17882957801166065870', time=2024-09-14T13:15:24.967375+0000, chain.objs.size()=1 2024-09-14T11:22:50.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.675+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.k36eOO6UiuA9G_VmY_-YGanPEOjg6-r_0 2024-09-14T11:22:50.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.675+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4285836916234430974', time=2024-09-14T13:15:25.045355+0000, chain.objs.size()=1 2024-09-14T11:22:50.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.675+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.IfG_FiQhqbMyghWHQ3mjlOqUS5_w9DL_0 2024-09-14T11:22:50.675 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.675+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16444160075768752632', time=2024-09-14T13:15:25.077003+0000, chain.objs.size()=1 2024-09-14T11:22:50.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.675+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.244MhcRA-vSRXJ-nq96rqFtpYT_YU29_0 2024-09-14T11:22:50.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.675+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5544047007757004429', time=2024-09-14T13:15:25.097574+0000, chain.objs.size()=1 2024-09-14T11:22:50.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.675+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.QYqeRj86xtuNkjvrkFQqz6vgWAQ6PRJ_0 2024-09-14T11:22:50.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.675+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6912480729747227523', time=2024-09-14T13:15:25.129376+0000, chain.objs.size()=1 2024-09-14T11:22:50.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.675+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.a3I_6xFzvQewQkMaHK_YRqJN-txlbkV_0 2024-09-14T11:22:50.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.675+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12261375102716200932', time=2024-09-14T13:15:25.230729+0000, chain.objs.size()=1 2024-09-14T11:22:50.676 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.675+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.gvY556VZprNb3I8lXZ3pdh9S3c4KmZs_0 2024-09-14T11:22:50.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.676+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7575690511527250537', time=2024-09-14T13:15:25.253235+0000, chain.objs.size()=1 2024-09-14T11:22:50.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.676+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.0D8fAsceOAQMMEeLZDipziBZkEjlH2L_0 2024-09-14T11:22:50.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.677+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13209928616979940156', time=2024-09-14T13:15:25.279672+0000, chain.objs.size()=1 2024-09-14T11:22:50.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.677+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.OwyYPtN467UpBNfpeUzPD2bzydqu6Wr_0 2024-09-14T11:22:50.677 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.677+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14968200610950165040', time=2024-09-14T13:15:25.281509+0000, chain.objs.size()=1 2024-09-14T11:22:50.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.677+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.cwuknaVglThdeGlJWJ5y7kKMH9G7TBG_0 2024-09-14T11:22:50.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.678+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13939671903461335090', time=2024-09-14T13:15:25.283268+0000, chain.objs.size()=1 2024-09-14T11:22:50.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.678+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.Zem9cJ6Xq_HzrT81YBWQ-f2VGARFGWy_0 2024-09-14T11:22:50.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.678+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15616549745429532308', time=2024-09-14T13:15:25.364458+0000, chain.objs.size()=1 2024-09-14T11:22:50.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.678+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.Ny55YZ2f3xiCC_9KxsMwj8j8ECIr-UV_0 2024-09-14T11:22:50.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.678+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16496297048819870712', time=2024-09-14T13:15:25.390644+0000, chain.objs.size()=1 2024-09-14T11:22:50.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.678+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.NiYIGn8-IrXi9j9UBffr4oouMXk85Ku_0 2024-09-14T11:22:50.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.678+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15950985692609411537', time=2024-09-14T13:15:25.391418+0000, chain.objs.size()=1 2024-09-14T11:22:50.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.678+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.KKljY7qQXcVL2hXtVoh5iacBEHXj5xF_0 2024-09-14T11:22:50.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.678+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1608104855074321567', time=2024-09-14T13:15:25.407908+0000, chain.objs.size()=1 2024-09-14T11:22:50.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.678+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.pRTsi6_wb_IDXFa9bIT6VGaOpiCRyD4_0 2024-09-14T11:22:50.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.678+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9111547249376907056', time=2024-09-14T13:15:25.410506+0000, chain.objs.size()=1 2024-09-14T11:22:50.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.678+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.jgkBRXapVLvXwD2YzUkPe_fHGRKwm-U_0 2024-09-14T11:22:50.678 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.678+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16035725059754773493', time=2024-09-14T13:15:25.418352+0000, chain.objs.size()=1 2024-09-14T11:22:50.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.678+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.nTDu7vwbjS_lreb29eKfUMoKTtTdz0I_0 2024-09-14T11:22:50.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.678+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5021265909883021657', time=2024-09-14T13:15:25.428340+0000, chain.objs.size()=1 2024-09-14T11:22:50.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.678+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.fUHqFTUAa0pVh-fr3YZWB7BfUiZZGkA_0 2024-09-14T11:22:50.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.678+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17918328939677024817', time=2024-09-14T13:15:25.430053+0000, chain.objs.size()=1 2024-09-14T11:22:50.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.678+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.46DH2VL7p0oVMCoqFmUVHgyE_TkKQi__0 2024-09-14T11:22:50.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.678+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2056697195399174133', time=2024-09-14T13:15:25.437718+0000, chain.objs.size()=1 2024-09-14T11:22:50.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.678+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.X3pyvsHqBqydLrekGbpoAXAUu7AkK4q_0 2024-09-14T11:22:50.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.678+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10186686339648240726', time=2024-09-14T13:15:25.438398+0000, chain.objs.size()=1 2024-09-14T11:22:50.679 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.678+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.4puXk41WAA2rVO08JIzrOf4XKMN0-E2_0 2024-09-14T11:22:50.680 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.680+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3741909894651071407', time=2024-09-14T13:15:25.447199+0000, chain.objs.size()=1 2024-09-14T11:22:50.680 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.680+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.yH0JUHyEazRsQQbW5qfdy9qi9dzjJsE_0 2024-09-14T11:22:50.680 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.680+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14172023156695919833', time=2024-09-14T13:15:25.453283+0000, chain.objs.size()=1 2024-09-14T11:22:50.680 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.680+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.3z7-dS_x4SNAdM_B_NCWXKWQ99ZhNbj_0 2024-09-14T11:22:50.680 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.680+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5121627108012156080', time=2024-09-14T13:15:25.545332+0000, chain.objs.size()=1 2024-09-14T11:22:50.680 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.680+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.poc4tdArWGx1ecFp2v8jIpW9CC4-gOR_0 2024-09-14T11:22:50.680 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.680+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12426489912073616913', time=2024-09-14T13:15:25.565495+0000, chain.objs.size()=1 2024-09-14T11:22:50.680 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.680+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.ssp38NcN_yGFU2n9JzYHnK2abjijBDQ_0 2024-09-14T11:22:50.680 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.680+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.151941126742714315', time=2024-09-14T13:15:25.566335+0000, chain.objs.size()=1 2024-09-14T11:22:50.680 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.680+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.zyje5MWo90knKJHcfmYPg5RwBDkicAD_0 2024-09-14T11:22:50.681 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.681+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5304245592262906999', time=2024-09-14T13:15:25.577760+0000, chain.objs.size()=1 2024-09-14T11:22:50.681 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.681+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.vZzuQuBro-hMOeC9xHfU_43amckFb8x_0 2024-09-14T11:22:50.681 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.681+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15075279083121664157', time=2024-09-14T13:15:25.690630+0000, chain.objs.size()=1 2024-09-14T11:22:50.681 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.681+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.Q_zPwheMzSQS2RbqT5LucDD-7rJS70W_0 2024-09-14T11:22:50.681 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.681+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13429831477960368512', time=2024-09-14T13:15:25.703940+0000, chain.objs.size()=1 2024-09-14T11:22:50.681 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.681+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.WTvgnhPeVPxfzFa7IQH4KO79zFTCI-0_0 2024-09-14T11:22:50.681 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.681+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12303258471926272133', time=2024-09-14T13:15:25.879238+0000, chain.objs.size()=1 2024-09-14T11:22:50.681 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.681+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.otYquS27b54lzfVaNzJ1UZshmNcG6av_0 2024-09-14T11:22:50.681 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.681+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7675712477599792750', time=2024-09-14T13:15:25.935702+0000, chain.objs.size()=1 2024-09-14T11:22:50.681 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.681+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.x4ZW1e1qUzzcCJaUazmYfqtnb1SFper_0 2024-09-14T11:22:50.681 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.681+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10587006842662533486', time=2024-09-14T13:15:25.942423+0000, chain.objs.size()=1 2024-09-14T11:22:50.681 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.681+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.wLIIvtHMXkYgi4OGHeeGohEr_-nJrrW_0 2024-09-14T11:22:50.682 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.682+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7076416666583384671', time=2024-09-14T13:15:33.192874+0000, chain.objs.size()=1 2024-09-14T11:22:50.682 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.682+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.6mtJNqlfxit3i9bBEtY6pJUNFfUnI9F_0 2024-09-14T11:22:50.682 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.682+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7010123366250215773', time=2024-09-14T13:15:33.203348+0000, chain.objs.size()=1 2024-09-14T11:22:50.682 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.682+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.7iEHtLrWbIG0kHEv4ROdxU5vpWqnpTJ_0 2024-09-14T11:22:50.682 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.683+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8107175480277790973', time=2024-09-14T13:15:33.207517+0000, chain.objs.size()=1 2024-09-14T11:22:50.682 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.683+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.FTp59-WD9GGJLcfX-E1NRqSRh_mlZ2q_0 2024-09-14T11:22:50.682 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.683+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1254362243160661830', time=2024-09-14T13:15:33.223258+0000, chain.objs.size()=1 2024-09-14T11:22:50.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.683+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.ps7snPYJQ0kwfnpFyx3mriTwx1hdDUI_0 2024-09-14T11:22:50.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.683+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5860682050948316737', time=2024-09-14T13:15:33.246628+0000, chain.objs.size()=1 2024-09-14T11:22:50.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.683+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.fsqYOV3wlv7YhZLY1dUCL3jADUpbe50_0 2024-09-14T11:22:50.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.683+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17646573254315434335', time=2024-09-14T13:15:33.369843+0000, chain.objs.size()=1 2024-09-14T11:22:50.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.683+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.mCcxruKdlkuehDDmv2t0Sx1t2gvVvkf_0 2024-09-14T11:22:50.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.683+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7186651882815978246', time=2024-09-14T13:15:33.437596+0000, chain.objs.size()=1 2024-09-14T11:22:50.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.683+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.maRvXMR8Qe8-joKS8EWVuRyYYdLx0Kw_0 2024-09-14T11:22:50.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.683+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12043167865143569958', time=2024-09-14T13:15:33.546511+0000, chain.objs.size()=1 2024-09-14T11:22:50.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.683+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.niegu0wJMsmicstX7aubghiXfAb0irP_0 2024-09-14T11:22:50.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.683+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1550865586304107860', time=2024-09-14T13:15:33.550752+0000, chain.objs.size()=1 2024-09-14T11:22:50.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.683+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.JBljC10grBYL9EeHpuFy6QIsJTAQMNN_0 2024-09-14T11:22:50.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.683+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6534701656366767672', time=2024-09-14T13:15:33.555350+0000, chain.objs.size()=1 2024-09-14T11:22:50.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.683+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.QquWxCs1jXDF63uRv9CtrTd3x2_VPix_0 2024-09-14T11:22:50.684 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.683+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10292843136837768620', time=2024-09-14T13:15:33.560908+0000, chain.objs.size()=1 2024-09-14T11:22:50.684 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.683+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.ZBp3ar9AI-h7UuQ01MMm7uqXxzhAG7a_0 2024-09-14T11:22:50.684 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.684+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16951335573467403517', time=2024-09-14T13:15:33.592490+0000, chain.objs.size()=1 2024-09-14T11:22:50.685 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.684+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.JPgnp0dZksvi6D29JuiQKGzu3hvoBSV_0 2024-09-14T11:22:50.685 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.685+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9668843872188829545', time=2024-09-14T13:15:33.703515+0000, chain.objs.size()=1 2024-09-14T11:22:50.685 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.685+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.qpf5POaL8UoOaOh_nPqjp3SFeuLRbkd_0 2024-09-14T11:22:50.685 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.685+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7451786850050555014', time=2024-09-14T13:15:33.729802+0000, chain.objs.size()=1 2024-09-14T11:22:50.685 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.685+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.D0Ct1CSeaaYTLCViw2T51Uyl__PEual_0 2024-09-14T11:22:50.685 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.685+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3452328911843268377', time=2024-09-14T13:15:33.761828+0000, chain.objs.size()=1 2024-09-14T11:22:50.685 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.685+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.dSpMJGBxt2oxSgAcH03uS_WLKi_YaxO_0 2024-09-14T11:22:50.685 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.686+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.648728269241876671', time=2024-09-14T13:15:33.779208+0000, chain.objs.size()=1 2024-09-14T11:22:50.685 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.686+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.gRl86rYKgf0HsIuyhVuC0nn2Z5kS6s-_0 2024-09-14T11:22:50.685 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.686+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10127339915515903082', time=2024-09-14T13:15:33.879195+0000, chain.objs.size()=1 2024-09-14T11:22:50.685 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.686+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.7f27xDRNBj-0-p-3Xsp8xD_ypWw3u3I_0 2024-09-14T11:22:50.686 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.687+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 0/45487 2024-09-14T11:22:50.688 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.689+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=27, truncated=0, next_marker='' 2024-09-14T11:22:50.689 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.689+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4862625947536832106', time=2024-09-14T13:15:33.915681+0000, chain.objs.size()=1 2024-09-14T11:22:50.689 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.689+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.yW7tKugZZrckXLLmfSP2fSh5kdk-5V6_0 2024-09-14T11:22:50.689 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.689+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8375737926955571909', time=2024-09-14T13:15:33.917012+0000, chain.objs.size()=1 2024-09-14T11:22:50.689 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.689+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.l3uOCLr451IyO3PdJHxyNniYidG6eD-_0 2024-09-14T11:22:50.689 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.689+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12628356462213304135', time=2024-09-14T13:15:33.926465+0000, chain.objs.size()=1 2024-09-14T11:22:50.689 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.689+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.yIH9CtZhL1QdPgCxWMTrGOmWUcvH0H9_0 2024-09-14T11:22:50.689 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.689+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15444874008652731845', time=2024-09-14T13:15:33.934048+0000, chain.objs.size()=1 2024-09-14T11:22:50.689 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.689+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.UC1U6WZQya2eIFhABxIZaFPX5qUwJc8_0 2024-09-14T11:22:50.689 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.689+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2759543826837729717', time=2024-09-14T13:15:33.939987+0000, chain.objs.size()=1 2024-09-14T11:22:50.689 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.689+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.cZsgfZhOa2Urt6KdpEa5kjKYPPS89y3_0 2024-09-14T11:22:50.689 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.689+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13069865371078520083', time=2024-09-14T13:15:34.016856+0000, chain.objs.size()=1 2024-09-14T11:22:50.689 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.689+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.mrmqGFzthxHMcRvDQp_1tPW6tp5gHQE_0 2024-09-14T11:22:50.689 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.689+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7348696004897952838', time=2024-09-14T13:15:34.043905+0000, chain.objs.size()=1 2024-09-14T11:22:50.690 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.689+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.HweHkRtcvVQXGueJk2WNEzOxAUa8Xiu_0 2024-09-14T11:22:50.690 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.689+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11694512318875793172', time=2024-09-14T13:15:34.048462+0000, chain.objs.size()=1 2024-09-14T11:22:50.690 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.689+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.uh_SAdiyJINVEeSmN_RjsO-135ydvma_0 2024-09-14T11:22:50.690 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.689+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1536175635224459272', time=2024-09-14T13:15:34.200863+0000, chain.objs.size()=1 2024-09-14T11:22:50.690 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.689+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.JebtMqbgLCO2j5GZZwXGTlr0Jt4xj4J_0 2024-09-14T11:22:50.690 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.689+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14384074592809641581', time=2024-09-14T13:15:34.394042+0000, chain.objs.size()=1 2024-09-14T11:22:50.690 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.689+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.NyFjcO51FjMiPbjYMgxzQTUwMgj2aDG_0 2024-09-14T11:22:50.690 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.689+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10735065672988569604', time=2024-09-14T13:15:34.395445+0000, chain.objs.size()=1 2024-09-14T11:22:50.690 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.689+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.GkR9dwKc1cWPtn9dU8OKcE6Gf3smPIC_0 2024-09-14T11:22:50.690 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.689+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4200884489126608723', time=2024-09-14T13:15:38.627238+0000, chain.objs.size()=1 2024-09-14T11:22:50.690 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.689+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.341__shadow_.cuaWSLYZcJKLh9TfDU9l-8I5AvoznMG_0 2024-09-14T11:22:50.691 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.691+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10340111915341673056', time=2024-09-14T13:15:46.390278+0000, chain.objs.size()=1 2024-09-14T11:22:50.691 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.691+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.374__shadow_.KiQ0MWMDsnD87xtd1qJ4K6uCK0iSTKB_0 2024-09-14T11:22:50.691 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.691+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3362748357116406511', time=2024-09-14T13:15:50.846489+0000, chain.objs.size()=1 2024-09-14T11:22:50.691 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.691+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.390__shadow_.PeQ8V8a9nOlTKzjovQkLi6cw6Wj3319_0 2024-09-14T11:22:50.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.691+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10015398694858339129', time=2024-09-14T13:16:03.415131+0000, chain.objs.size()=1 2024-09-14T11:22:50.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.691+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.434__shadow_.ARk1YtnM03EPIX3o3mL5E5Pe2CEB-4d_0 2024-09-14T11:22:50.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.691+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4369943951871356662', time=2024-09-14T13:16:29.086949+0000, chain.objs.size()=6 2024-09-14T11:22:50.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.691+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.519__multipart_mymultipart.2~x1NJvJqKjwHrC3WOycGCyDLfxervghd.1 2024-09-14T11:22:50.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.691+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.519__multipart_mymultipart.2~x1NJvJqKjwHrC3WOycGCyDLfxervghd.2 2024-09-14T11:22:50.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.691+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.519__multipart_mymultipart.2~x1NJvJqKjwHrC3WOycGCyDLfxervghd.3 2024-09-14T11:22:50.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.691+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.519__multipart_mymultipart.2~x1NJvJqKjwHrC3WOycGCyDLfxervghd.4 2024-09-14T11:22:50.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.691+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.519__multipart_mymultipart.2~x1NJvJqKjwHrC3WOycGCyDLfxervghd.5 2024-09-14T11:22:50.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.691+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.519__multipart_mymultipart.2~x1NJvJqKjwHrC3WOycGCyDLfxervghd.6 2024-09-14T11:22:50.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.691+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1020357616442208833', time=2024-09-14T13:16:30.998762+0000, chain.objs.size()=1 2024-09-14T11:22:50.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.691+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.520__shadow:7mqcB4RSGDXuguKbXnlKqbV1u0kuy0Q_.TYtkY_7GlgRdjh6tBfjQ0ftEx_AJ3v4_0 2024-09-14T11:22:50.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.691+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14984801083660442267', time=2024-09-14T13:17:28.526295+0000, chain.objs.size()=1 2024-09-14T11:22:50.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.691+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.573__shadow_._dSATzbvc3Fog3_zUUb2k5YvII9WsqU_0 2024-09-14T11:22:50.693 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.694+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3473147824921147791', time=2024-09-14T13:17:37.072181+0000, chain.objs.size()=1 2024-09-14T11:22:50.693 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.694+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.577__shadow:tjOvbvfzQMWk2SAkiBEVT5iKkoLNOO7_.mYQadNO1IQA-Zdc7ZUN1DLMQrjMUNSD_0 2024-09-14T11:22:50.693 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.694+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7129609486149793314', time=2024-09-14T13:17:53.502851+0000, chain.objs.size()=1 2024-09-14T11:22:50.693 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.694+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.587__shadow:bUbz8RhTrh91u0FSTPoiMQZvYrzKwNS_.6ddc1soXtoz1wtdODjWdbKk3fCGr15t_0 2024-09-14T11:22:50.693 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.694+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.797100067693931197', time=2024-09-14T13:19:03.665542+0000, chain.objs.size()=1 2024-09-14T11:22:50.693 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.694+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.617__shadow_.OmI7c-JsbdFho8p2BEQ1jk2pcjPuhH6_0 2024-09-14T11:22:50.693 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.694+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='2~pbVWGU2TAD23aNRXEZV15v-HVJHccNN', time=2024-09-14T13:20:07.873946+0000, chain.objs.size()=6 2024-09-14T11:22:50.694 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.694+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.625__multipart_multipart_enc.2~pbVWGU2TAD23aNRXEZV15v-HVJHccNN.1 2024-09-14T11:22:50.694 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.694+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.625__multipart_multipart_enc.2~pbVWGU2TAD23aNRXEZV15v-HVJHccNN.2 2024-09-14T11:22:50.694 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.694+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.625__multipart_multipart_enc.2~pbVWGU2TAD23aNRXEZV15v-HVJHccNN.3 2024-09-14T11:22:50.694 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.694+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.625__multipart_multipart_enc.2~pbVWGU2TAD23aNRXEZV15v-HVJHccNN.4 2024-09-14T11:22:50.694 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.694+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.625__multipart_multipart_enc.2~pbVWGU2TAD23aNRXEZV15v-HVJHccNN.5 2024-09-14T11:22:50.694 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.695+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.625__multipart_multipart_enc.2~pbVWGU2TAD23aNRXEZV15v-HVJHccNN.6 2024-09-14T11:22:50.694 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.695+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.754276890008063641', time=2024-09-14T13:20:10.222246+0000, chain.objs.size()=1 2024-09-14T11:22:50.694 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.695+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.634__shadow_.edYvyCMUoMGEIYsT89-c2jaQHY5Vj1p_0 2024-09-14T11:22:50.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.695+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8459839673298898664', time=2024-09-14T13:20:28.392853+0000, chain.objs.size()=1 2024-09-14T11:22:50.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.695+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.696__shadow:S3cfWEbx9.y9kwTfP1C62-.uB.O4i1K_.0sWUR99iiWcKXAKdCrLrisR-4Q9688l_0 2024-09-14T11:22:50.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.697+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1594065981034563484', time=2024-09-14T13:20:31.985103+0000, chain.objs.size()=1 2024-09-14T11:22:50.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.697+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.709__shadow_.IkDSWo_WS1Bd17KoN_Dz3BbCgilD_gv_0 2024-09-14T11:22:50.696 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.697+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15118610389479751467', time=2024-09-14T13:21:00.867980+0000, chain.objs.size()=3 2024-09-14T11:22:50.696 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.697+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.743__multipart_mymultipart3.2~upKGGbOPcHjDEQccoIaB0fjf27NbuQe.1 2024-09-14T11:22:50.696 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.697+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.743__multipart_mymultipart3.2~upKGGbOPcHjDEQccoIaB0fjf27NbuQe.2 2024-09-14T11:22:50.696 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.697+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.743__multipart_mymultipart3.2~upKGGbOPcHjDEQccoIaB0fjf27NbuQe.3 2024-09-14T11:22:50.696 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.697+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.985505490135765444', time=2024-09-14T13:21:13.040293+0000, chain.objs.size()=1 2024-09-14T11:22:50.696 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.697+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.770__shadow_._J1Oh89s8ce87r0zwSekxsK4WJwFllU_0 2024-09-14T11:22:50.698 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.699+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:50.700 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.702+0000 7f0f19c16800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:22:50.701 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.703+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:50.702 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.703+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:50.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.704+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44662' 2024-09-14T11:22:50.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.704+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7047859272130156890', time=2024-09-14T13:13:44.227454+0000, chain.objs.size()=1 2024-09-14T11:22:50.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.704+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.178__shadow_.wYEpdYOA5Sh9WHdThzF34hY2VmjaMDj_0 2024-09-14T11:22:50.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.704+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10151060818971104858', time=2024-09-14T13:13:46.359011+0000, chain.objs.size()=1 2024-09-14T11:22:50.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.704+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.188__shadow_.vp3LGxuRWjCh9njYc4o63jeiHtraE5u_0 2024-09-14T11:22:50.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.704+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2919191855967698', time=2024-09-14T13:14:44.588629+0000, chain.objs.size()=1 2024-09-14T11:22:50.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.704+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.231__shadow_.s365Tl2lPrZLqKqanKmFNUpmOBUQI0b_0 2024-09-14T11:22:50.703 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.704+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7202616407627056353', time=2024-09-14T13:14:45.626717+0000, chain.objs.size()=1 2024-09-14T11:22:50.704 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.704+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.235__shadow_.GBhcwWyg_irTloMAJeE5udXCKwQcoPi_0 2024-09-14T11:22:50.704 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.704+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11572407502563668929', time=2024-09-14T13:14:47.812686+0000, chain.objs.size()=1 2024-09-14T11:22:50.704 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.704+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.243__shadow_.Z8LBRZ_M-nnQLrPcNowEcgZXAy_7oTo_0 2024-09-14T11:22:50.704 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.704+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13501401545539453375', time=2024-09-14T13:14:48.366061+0000, chain.objs.size()=1 2024-09-14T11:22:50.704 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.704+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.245__shadow_.ETsgKW9Fqqzgqe4RigPIur-sjuzxIcl_0 2024-09-14T11:22:50.704 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.704+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12456036988553178327', time=2024-09-14T13:14:48.784231+0000, chain.objs.size()=1 2024-09-14T11:22:50.704 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.704+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.246__shadow_.0VNkGqDOcE1uieLKPbrJh_tVQnS4NdR_0 2024-09-14T11:22:50.704 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.704+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14332841126886679150', time=2024-09-14T13:14:49.069614+0000, chain.objs.size()=1 2024-09-14T11:22:50.704 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.704+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.247__shadow_.3TbOXXjLPSYL8yKTEkjj2fx_kxCX1Ag_0 2024-09-14T11:22:50.704 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.704+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.460196614575914631', time=2024-09-14T13:14:49.319176+0000, chain.objs.size()=1 2024-09-14T11:22:50.704 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.704+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.248__shadow_.SKrJNNFf0B0W6uwmq4o58ZFsBZkrJfi_0 2024-09-14T11:22:50.705 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.704+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9789289424423342955', time=2024-09-14T13:14:59.898271+0000, chain.objs.size()=1 2024-09-14T11:22:50.705 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.704+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.JBYLnqGSrGUxSDorCL6IqWmGI7HNl_j_0 2024-09-14T11:22:50.705 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.704+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7240863848114918876', time=2024-09-14T13:14:59.899720+0000, chain.objs.size()=1 2024-09-14T11:22:50.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.704+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.EnkXTmi1BaOsDbXW2XK0tjnNRszt0Sm_0 2024-09-14T11:22:50.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.704+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15333035928146941382', time=2024-09-14T13:14:59.901919+0000, chain.objs.size()=1 2024-09-14T11:22:50.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.704+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.owBTFefpLby8Tvxb6Na3fMsmapUz_oV_0 2024-09-14T11:22:50.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.706+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4812540881103683632', time=2024-09-14T13:14:59.903012+0000, chain.objs.size()=1 2024-09-14T11:22:50.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.706+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.3e28mL4LYQ7_aHPGfExdmMlaZSaXyU9_0 2024-09-14T11:22:50.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.706+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4528507390186404011', time=2024-09-14T13:14:59.933457+0000, chain.objs.size()=1 2024-09-14T11:22:50.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.706+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.IJe39dBk7HCVAqmI8IT27GxFxEVx2-v_0 2024-09-14T11:22:50.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.706+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17512155608862749783', time=2024-09-14T13:14:59.937446+0000, chain.objs.size()=1 2024-09-14T11:22:50.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.706+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Au_fS3bsm4PakqLLnkiDUfisL_JWpWP_0 2024-09-14T11:22:50.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.706+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2764671186034629113', time=2024-09-14T13:14:59.946871+0000, chain.objs.size()=1 2024-09-14T11:22:50.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.706+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.1gIyygCaCOziA1VcNKou3Rcia4ka8L2_0 2024-09-14T11:22:50.706 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.706+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4843640570345841734', time=2024-09-14T13:14:59.949555+0000, chain.objs.size()=1 2024-09-14T11:22:50.707 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.706+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.8ygJbSnZx6JArmHQiPOHC2fk_xAcMMb_0 2024-09-14T11:22:50.707 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.706+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16423003622864654778', time=2024-09-14T13:15:00.098736+0000, chain.objs.size()=1 2024-09-14T11:22:50.707 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.706+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.EsShQDI3FeaUH9OpgftqLoNDNIcdZ1S_0 2024-09-14T11:22:50.707 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.706+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.410614198541313502', time=2024-09-14T13:15:00.099507+0000, chain.objs.size()=1 2024-09-14T11:22:50.707 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.706+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.p-gobHLUW9no6Rc0tCMfkskWW6ocQ-s_0 2024-09-14T11:22:50.707 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.706+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11920304266053835448', time=2024-09-14T13:15:00.118634+0000, chain.objs.size()=1 2024-09-14T11:22:50.707 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.706+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.DRrHmqbStb9XMpztngBB-9S7yI0jd8N_0 2024-09-14T11:22:50.707 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.707+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2114551933504267152', time=2024-09-14T13:15:00.237020+0000, chain.objs.size()=1 2024-09-14T11:22:50.707 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.707+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.yyHaDmTFi5XGRSGzx76F1WvBkeEXB8A_0 2024-09-14T11:22:50.707 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.707+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15314070393860136730', time=2024-09-14T13:15:00.285688+0000, chain.objs.size()=1 2024-09-14T11:22:50.707 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.707+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.OIWyWv2pBUhOBYCihXkyJWUCbkmVq5y_0 2024-09-14T11:22:50.707 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.707+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.110548817871262424', time=2024-09-14T13:15:00.288488+0000, chain.objs.size()=1 2024-09-14T11:22:50.707 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.707+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.PThtCXywqR2hO_f37ZO34-IPZY-HihK_0 2024-09-14T11:22:50.708 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.708+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.238813831575723184', time=2024-09-14T13:15:00.294510+0000, chain.objs.size()=1 2024-09-14T11:22:50.708 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.708+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.x7eUBqMUhq13tJlbESBa9NkuK9z2DzM_0 2024-09-14T11:22:50.708 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.708+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4870016185943704281', time=2024-09-14T13:15:00.439538+0000, chain.objs.size()=1 2024-09-14T11:22:50.708 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.708+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.ZJ9OOdZPYG0Ix2O1KVN3soiPS3I5PPS_0 2024-09-14T11:22:50.708 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.708+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11789258237115087981', time=2024-09-14T13:15:00.466894+0000, chain.objs.size()=1 2024-09-14T11:22:50.709 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.708+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.d2dPFVau8nd4IRB0or3MWYuJbeEJF6o_0 2024-09-14T11:22:50.709 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.708+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6733952535922029663', time=2024-09-14T13:15:00.582552+0000, chain.objs.size()=1 2024-09-14T11:22:50.709 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.708+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.vKzEIf5AMvcMeBgJ-z6nbl8zx4aljxv_0 2024-09-14T11:22:50.709 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.709+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12315061845239332734', time=2024-09-14T13:15:00.587070+0000, chain.objs.size()=1 2024-09-14T11:22:50.709 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.709+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.2p91DBi8ctsGN9TLv6MaHtpDZOhqk9D_0 2024-09-14T11:22:50.709 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.709+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3715237977678172573', time=2024-09-14T13:15:00.596140+0000, chain.objs.size()=1 2024-09-14T11:22:50.709 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.709+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.TrouF2USJC6WqNKAJ0CIC3IvUYzLPvc_0 2024-09-14T11:22:50.709 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.709+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5564964667200730495', time=2024-09-14T13:15:00.596812+0000, chain.objs.size()=1 2024-09-14T11:22:50.709 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.709+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.s5ERwNKwLVUa2AwSM8zF4I0Vms-Z3lw_0 2024-09-14T11:22:50.709 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.709+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4702036881566875318', time=2024-09-14T13:15:00.711782+0000, chain.objs.size()=1 2024-09-14T11:22:50.709 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.709+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.jTKW4fFCauayVnHqQLh6n09rsOHoHhT_0 2024-09-14T11:22:50.709 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.709+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.450350853283416053', time=2024-09-14T13:15:00.729732+0000, chain.objs.size()=1 2024-09-14T11:22:50.709 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.709+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Zb7iiTv6QJ7GkWupaBkqOjlRnxAhLX4_0 2024-09-14T11:22:50.710 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.709+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13456135019148027473', time=2024-09-14T13:15:00.874901+0000, chain.objs.size()=1 2024-09-14T11:22:50.710 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.709+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.zoB6j_eWkM5f0_ytj6HX5ecZrckaYVt_0 2024-09-14T11:22:50.710 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.709+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16899715937570430849', time=2024-09-14T13:15:00.907020+0000, chain.objs.size()=1 2024-09-14T11:22:50.710 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.709+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.0_acXEKYTXjwvBNcFJPxSdAFeWrxzjL_0 2024-09-14T11:22:50.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.711+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3740321358500880129', time=2024-09-14T13:15:00.919545+0000, chain.objs.size()=1 2024-09-14T11:22:50.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.711+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.pSaibaRrwrOgAL1DAMfw0X3QK9ZRW7J_0 2024-09-14T11:22:50.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.711+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7624314755809664902', time=2024-09-14T13:15:04.717879+0000, chain.objs.size()=1 2024-09-14T11:22:50.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.711+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.277__shadow_.N5POYlMi7Sd1YeZqooqj5mfFkkwrSXy_0 2024-09-14T11:22:50.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.711+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15634148249647887626', time=2024-09-14T13:15:04.967245+0000, chain.objs.size()=1 2024-09-14T11:22:50.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.711+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.278__shadow_.g3AB3yR4FMM--q__6kStB1evANGJ6kE_0 2024-09-14T11:22:50.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.711+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13550603211891204445', time=2024-09-14T13:15:05.715304+0000, chain.objs.size()=1 2024-09-14T11:22:50.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.711+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.281__shadow_.yxGWGJuXP6uHRYlvltPI1L3FHvby9cs_0 2024-09-14T11:22:50.711 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.711+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17637437907647843105', time=2024-09-14T13:15:06.422022+0000, chain.objs.size()=1 2024-09-14T11:22:50.712 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.711+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.283__shadow_.twsLzbZTvUhE1qCmYrS29Sui_Cy4gOJ_0 2024-09-14T11:22:50.712 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.711+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17200199943388821547', time=2024-09-14T13:15:07.001835+0000, chain.objs.size()=1 2024-09-14T11:22:50.712 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.711+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.285__shadow_.pZQ-CKemYFBjnNo4GoilLfGmJ0IYIi4_0 2024-09-14T11:22:50.712 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.711+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9243738740024882389', time=2024-09-14T13:15:09.244158+0000, chain.objs.size()=1 2024-09-14T11:22:50.712 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.711+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.292__shadow_.fDun52-i2--SZnBdW2I18ycunX9I88j_0 2024-09-14T11:22:50.712 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.711+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8481618617864340334', time=2024-09-14T13:15:09.828730+0000, chain.objs.size()=1 2024-09-14T11:22:50.712 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.711+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.293__shadow_.ZtcBMT8zW7kSl2cfdpVIYpE6UgPIqpF_0 2024-09-14T11:22:50.712 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.711+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12708938362971409127', time=2024-09-14T13:15:11.444408+0000, chain.objs.size()=1 2024-09-14T11:22:50.712 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.711+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.299__shadow_.ExgpjZOBZTAS4d_WE4t06J2fLXGkOVb_0 2024-09-14T11:22:50.712 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.711+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14570207092181884368', time=2024-09-14T13:15:11.947688+0000, chain.objs.size()=1 2024-09-14T11:22:50.712 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.711+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.301__shadow_.Nwx-KZUxzHFEYWeG7AtLnZKeTu46F1s_0 2024-09-14T11:22:50.712 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.711+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1046515011634022526', time=2024-09-14T13:15:24.715365+0000, chain.objs.size()=1 2024-09-14T11:22:50.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.711+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.CM1zWNsV4U16GYx55Bt_Sv-Ncn9pLak_0 2024-09-14T11:22:50.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.712+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15654590227003738315', time=2024-09-14T13:15:24.725409+0000, chain.objs.size()=1 2024-09-14T11:22:50.713 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.712+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.vWYeA0OS0c_dyStj9v11WGH1LNHRgHB_0 2024-09-14T11:22:50.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.713+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2259401240650575431', time=2024-09-14T13:15:24.727186+0000, chain.objs.size()=1 2024-09-14T11:22:50.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.713+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.GMouRxZRKz103WUspqdyG88e8a6U5bS_0 2024-09-14T11:22:50.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.713+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12416327613509330235', time=2024-09-14T13:15:24.732765+0000, chain.objs.size()=1 2024-09-14T11:22:50.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.713+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.qoF0VIeNfQmeqvzwUBmew9PeMeh24wa_0 2024-09-14T11:22:50.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.713+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14570824964569753781', time=2024-09-14T13:15:24.757319+0000, chain.objs.size()=1 2024-09-14T11:22:50.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.713+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.WAYCaklOGGv5TCbBDq9jkKE8TUA0gQr_0 2024-09-14T11:22:50.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.714+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5106022744797068315', time=2024-09-14T13:15:24.774764+0000, chain.objs.size()=1 2024-09-14T11:22:50.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.714+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.oGxzIw4mqzrkjvHLXAF0kwhNnjgWv2z_0 2024-09-14T11:22:50.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.714+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1777917557898010580', time=2024-09-14T13:15:24.781663+0000, chain.objs.size()=1 2024-09-14T11:22:50.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.714+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.OIXi3PxS0bmXUkgAKDHfyw8Q7RuP_p-_0 2024-09-14T11:22:50.714 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.714+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2849977396662096296', time=2024-09-14T13:15:24.784419+0000, chain.objs.size()=1 2024-09-14T11:22:50.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.714+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.XGiPP5EUpc6t4PuR0Kau36-U3PNt4Nk_0 2024-09-14T11:22:50.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.714+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7861422076150293994', time=2024-09-14T13:15:24.799871+0000, chain.objs.size()=1 2024-09-14T11:22:50.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.714+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.0yWuL1AWPG_5eApoSJtpDIwnowdb7jq_0 2024-09-14T11:22:50.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.714+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9978324401655510935', time=2024-09-14T13:15:24.881154+0000, chain.objs.size()=1 2024-09-14T11:22:50.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.714+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.oDiSdYlIp0RBmWgSohb7jkVBh1IHoyn_0 2024-09-14T11:22:50.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.714+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4612519873525918175', time=2024-09-14T13:15:24.889935+0000, chain.objs.size()=1 2024-09-14T11:22:50.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.714+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.Ereqc33YQ_HZ85kcoX7rMa02rNISQIi_0 2024-09-14T11:22:50.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.714+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14001221207788489146', time=2024-09-14T13:15:24.913968+0000, chain.objs.size()=1 2024-09-14T11:22:50.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.714+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.ip9fa8j1wz6Xijy8Pab2r8hR1QWt3MC_0 2024-09-14T11:22:50.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.714+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1459708540757078787', time=2024-09-14T13:15:24.945298+0000, chain.objs.size()=1 2024-09-14T11:22:50.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.714+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.BiEzsPiBuHNK41imQpbYOTr9Xi-hUSt_0 2024-09-14T11:22:50.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.715+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16111535386306063023', time=2024-09-14T13:15:24.952868+0000, chain.objs.size()=1 2024-09-14T11:22:50.715 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.715+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.PPAptM2RKhLTAqKKljeX-WUpal19W2j_0 2024-09-14T11:22:50.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.715+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4423076211924990705', time=2024-09-14T13:15:25.054466+0000, chain.objs.size()=1 2024-09-14T11:22:50.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.715+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.YrOVHNIH6MrGxQXANlGl9EL3mFZKtIH_0 2024-09-14T11:22:50.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.715+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4833208242927077577', time=2024-09-14T13:15:25.101589+0000, chain.objs.size()=1 2024-09-14T11:22:50.716 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.715+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.UZTP2Ow9AtrqYl4JsmbE2S9O3Jhkygh_0 2024-09-14T11:22:50.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.716+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17062396318939170246', time=2024-09-14T13:15:25.105433+0000, chain.objs.size()=1 2024-09-14T11:22:50.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.716+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_._GXBzfxmtvn8_nZjK0KSWH2UvpdhFa-_0 2024-09-14T11:22:50.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.716+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14088070803369123282', time=2024-09-14T13:15:25.126768+0000, chain.objs.size()=1 2024-09-14T11:22:50.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.716+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.AJ4Lk81yGdMdrPVsLsb7gPagtl6gVR-_0 2024-09-14T11:22:50.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.716+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2750755533423363717', time=2024-09-14T13:15:25.207837+0000, chain.objs.size()=1 2024-09-14T11:22:50.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.716+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.jiXur5AMlDB2XIiV9592cKke181onOl_0 2024-09-14T11:22:50.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.716+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12311927140975404221', time=2024-09-14T13:15:25.220941+0000, chain.objs.size()=1 2024-09-14T11:22:50.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.716+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.bzTpsytQfGEgasIXMTmJmdatUZDNZa0_0 2024-09-14T11:22:50.717 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.716+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15925848596357873092', time=2024-09-14T13:15:25.284784+0000, chain.objs.size()=1 2024-09-14T11:22:50.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.716+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.JAPXMdUmlzjHTQDJxsAhC495fJdh3j1_0 2024-09-14T11:22:50.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.716+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3190618840608867624', time=2024-09-14T13:15:25.366345+0000, chain.objs.size()=1 2024-09-14T11:22:50.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.716+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.L0sbSRGqmfKTXYXwElKIrkq4xeZBMLG_0 2024-09-14T11:22:50.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.716+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18365360682832579635', time=2024-09-14T13:15:25.527555+0000, chain.objs.size()=1 2024-09-14T11:22:50.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.716+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.a_GwujZpbyj_gewq7fiPrpojud-bdU1_0 2024-09-14T11:22:50.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.716+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10716886847575266031', time=2024-09-14T13:15:25.540586+0000, chain.objs.size()=1 2024-09-14T11:22:50.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.716+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.mAN34YBxsprdqvZfW_9QTb4QfPnFpVV_0 2024-09-14T11:22:50.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.716+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8403804495147746563', time=2024-09-14T13:15:25.579303+0000, chain.objs.size()=1 2024-09-14T11:22:50.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.716+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.KQLMTvQPc_17ijcSV0NIKX3PtHb3c9d_0 2024-09-14T11:22:50.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.717+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8960162230761533421', time=2024-09-14T13:15:25.596288+0000, chain.objs.size()=1 2024-09-14T11:22:50.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.717+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.hx1q3ShBYqicrPk227pjKxgHTt36qwQ_0 2024-09-14T11:22:50.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.718+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1288248954195890486', time=2024-09-14T13:15:25.603019+0000, chain.objs.size()=1 2024-09-14T11:22:50.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.718+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.i72drjp23PbVGnoLtXI0OAJ8zZshLiU_0 2024-09-14T11:22:50.718 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.718+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5131434115511479820', time=2024-09-14T13:15:25.704518+0000, chain.objs.size()=1 2024-09-14T11:22:50.719 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.718+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.Sv43Wbu1qv_ZKW3AC0PfddlMSUOqydI_0 2024-09-14T11:22:50.719 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.718+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12608794831193206684', time=2024-09-14T13:15:25.720672+0000, chain.objs.size()=1 2024-09-14T11:22:50.719 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.718+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.5I3K0-FuQbMhQZx-xcaSej78H81aW-9_0 2024-09-14T11:22:50.719 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.719+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11860357136652249673', time=2024-09-14T13:15:25.754153+0000, chain.objs.size()=1 2024-09-14T11:22:50.720 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.719+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.noMRLWRCJH8eZImemBDP2xXneU5nFva_0 2024-09-14T11:22:50.720 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.719+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.333600526553602751', time=2024-09-14T13:15:25.768365+0000, chain.objs.size()=1 2024-09-14T11:22:50.720 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.719+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.96M-I3djrPKidAWnCTfWGyUw4j9fADR_0 2024-09-14T11:22:50.720 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.719+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4024946850868038259', time=2024-09-14T13:15:25.888345+0000, chain.objs.size()=1 2024-09-14T11:22:50.720 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.719+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.WYs9o1jpjYwmdO9KcDOgWrpt7jJGrZV_0 2024-09-14T11:22:50.720 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.719+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9266536291300259149', time=2024-09-14T13:15:25.906215+0000, chain.objs.size()=1 2024-09-14T11:22:50.720 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.719+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.J8mX6waZUGwjMeJbncFxmJ_SrAOfWt0_0 2024-09-14T11:22:50.720 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.719+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10650731841976269427', time=2024-09-14T13:15:25.941957+0000, chain.objs.size()=1 2024-09-14T11:22:50.720 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.719+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.q59-DCzta0ktbG1j8L7pa_x8jRAXE4__0 2024-09-14T11:22:50.720 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.719+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12652729183596052701', time=2024-09-14T13:15:25.948795+0000, chain.objs.size()=1 2024-09-14T11:22:50.720 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.719+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.fXKaDGxGjCLjJeb8iu3pDAjJIjOi4v8_0 2024-09-14T11:22:50.720 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.719+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11158570910872429565', time=2024-09-14T13:15:33.180143+0000, chain.objs.size()=1 2024-09-14T11:22:50.720 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.719+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.LPjqKvckosVFYaalxe8HszJ6RRMWi45_0 2024-09-14T11:22:50.721 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.719+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15384315402119625691', time=2024-09-14T13:15:33.197609+0000, chain.objs.size()=1 2024-09-14T11:22:50.721 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.719+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.uFFLMGQLMqkfE6C1J6kLp7DCMAi5OqF_0 2024-09-14T11:22:50.721 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.719+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11614904144215639217', time=2024-09-14T13:15:33.224139+0000, chain.objs.size()=1 2024-09-14T11:22:50.721 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.719+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.zTZJATCj85bAj7x48_qmpBU5EyfbbAD_0 2024-09-14T11:22:50.721 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.719+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11562922817702370477', time=2024-09-14T13:15:33.451889+0000, chain.objs.size()=1 2024-09-14T11:22:50.721 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.719+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.UkGBBRuc8aQczFbCi9GcMKWxAsJRo9P_0 2024-09-14T11:22:50.721 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.719+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9337269462920256323', time=2024-09-14T13:15:33.581645+0000, chain.objs.size()=1 2024-09-14T11:22:50.721 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.719+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.B3DdQn5rros9VfMfbIayHf4UJdjrneO_0 2024-09-14T11:22:50.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.722+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5031170998023034813', time=2024-09-14T13:15:33.691451+0000, chain.objs.size()=1 2024-09-14T11:22:50.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.722+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.WXqyDbVVFmsIQkGZ0G5ITFBZiffgSpz_0 2024-09-14T11:22:50.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.722+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17419060648169330409', time=2024-09-14T13:15:33.706435+0000, chain.objs.size()=1 2024-09-14T11:22:50.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.722+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.YVPh7vprpcK4VG0w6ViPVd9YzKB4EEz_0 2024-09-14T11:22:50.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.722+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10130742441003843390', time=2024-09-14T13:15:33.716183+0000, chain.objs.size()=1 2024-09-14T11:22:50.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.722+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.KqYTohDlAVAmllbeSvcZ0S32px45rga_0 2024-09-14T11:22:50.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.723+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2303678639070784574', time=2024-09-14T13:15:33.765128+0000, chain.objs.size()=1 2024-09-14T11:22:50.722 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.723+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.YW5T44fpFrNQ8-4UKwrH_TYTvRFjQA4_0 2024-09-14T11:22:50.723 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.723+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5619988694763520322', time=2024-09-14T13:15:33.776095+0000, chain.objs.size()=1 2024-09-14T11:22:50.723 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.723+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Jo54DDsQxlNFhh_I63cScZU9sfP07J3_0 2024-09-14T11:22:50.723 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.723+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10282160410866167857', time=2024-09-14T13:15:33.851966+0000, chain.objs.size()=1 2024-09-14T11:22:50.723 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.723+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.XL8ZiDI3sgBABKztTwx_KvpTCKK0azE_0 2024-09-14T11:22:50.723 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.723+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11549580970769678934', time=2024-09-14T13:15:33.854908+0000, chain.objs.size()=1 2024-09-14T11:22:50.723 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.723+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.j-zKe1cdhRoU2go0JIW1cc1sFuEEtfU_0 2024-09-14T11:22:50.723 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.723+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13778829698727946861', time=2024-09-14T13:15:33.868930+0000, chain.objs.size()=1 2024-09-14T11:22:50.723 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.723+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.bskkBqyOlBFJ0YiNBWU7nvesjQzxurP_0 2024-09-14T11:22:50.723 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.723+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3503709638314827989', time=2024-09-14T13:15:33.899770+0000, chain.objs.size()=1 2024-09-14T11:22:50.723 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.723+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.-2d_AOjkZCFcfNSvzCYSTxhXp_8gaqc_0 2024-09-14T11:22:50.723 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.723+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14769109093108536079', time=2024-09-14T13:15:33.901352+0000, chain.objs.size()=1 2024-09-14T11:22:50.723 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.723+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.puQgfWDj7TiFCnqFc-Fe1kyIfrL_mOu_0 2024-09-14T11:22:50.723 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.723+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10289758782869461145', time=2024-09-14T13:15:33.925768+0000, chain.objs.size()=1 2024-09-14T11:22:50.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.723+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.kFwTQKjuEwRylsGcYFTJe-MY9jVHtGK_0 2024-09-14T11:22:50.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.724+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7021029642723989736', time=2024-09-14T13:15:33.931875+0000, chain.objs.size()=1 2024-09-14T11:22:50.724 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.724+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Y0wzn2pP_7o7OePs3ynkXMraN-8rdjt_0 2024-09-14T11:22:50.725 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.724+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11596136794155656929', time=2024-09-14T13:15:33.934480+0000, chain.objs.size()=1 2024-09-14T11:22:50.725 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.724+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.QIXUujoIBevqWYYE2SgD_m-OQsVo3Vd_0 2024-09-14T11:22:50.725 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.725+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.251860317738576854', time=2024-09-14T13:15:34.073740+0000, chain.objs.size()=1 2024-09-14T11:22:50.725 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.725+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.bNohR4v7uC1FRJ6Ye1VDMdwnhZwo5li_0 2024-09-14T11:22:50.725 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.725+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12879121679275810039', time=2024-09-14T13:15:34.097932+0000, chain.objs.size()=1 2024-09-14T11:22:50.725 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.725+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.FcDrKX4X8FN0nhCSnKiCxrTkjATC3Jh_0 2024-09-14T11:22:50.725 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.725+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11021088211038008649', time=2024-09-14T13:15:34.193199+0000, chain.objs.size()=1 2024-09-14T11:22:50.725 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.725+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Wcxvecc8y4m-I_NQ9Zp46alpYAo-ZND_0 2024-09-14T11:22:50.725 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.727+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 0/44662 2024-09-14T11:22:50.728 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.729+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-14T11:22:50.728 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.729+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6979809020071270642', time=2024-09-14T13:15:34.202970+0000, chain.objs.size()=1 2024-09-14T11:22:50.728 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.729+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.UU2Gvkf4dn15IpkPxpG94t2vWOOjvfz_0 2024-09-14T11:22:50.728 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.729+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18385741005450407888', time=2024-09-14T13:15:34.334276+0000, chain.objs.size()=1 2024-09-14T11:22:50.728 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.729+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.PJvfLXv0bxm9wIPF2umbKdr032i90rC_0 2024-09-14T11:22:50.728 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.729+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3648450243283189508', time=2024-09-14T13:15:34.335349+0000, chain.objs.size()=1 2024-09-14T11:22:50.728 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.729+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.RnyqKAQlMNc0eSE44XToE4MMNQqh-hS_0 2024-09-14T11:22:50.728 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.729+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16714063904917089529', time=2024-09-14T13:15:34.359906+0000, chain.objs.size()=1 2024-09-14T11:22:50.728 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.729+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.jny4S62p8gGO9hFa4vWJdDBwQx1TtMz_0 2024-09-14T11:22:50.729 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.729+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8958816413702558821', time=2024-09-14T13:15:43.634333+0000, chain.objs.size()=1 2024-09-14T11:22:50.729 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.729+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.367__shadow_.lMLAACaO-NoxLlX9XScnD0h5pXuxYCG_0 2024-09-14T11:22:50.729 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.729+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.917208243312260595', time=2024-09-14T13:15:49.571490+0000, chain.objs.size()=1 2024-09-14T11:22:50.729 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.729+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.384__shadow_.ZXSimRTz7nAxDiMyE7o7XTP3ELQYxtq_0 2024-09-14T11:22:50.729 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.729+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2899233512887849987', time=2024-09-14T13:15:57.488060+0000, chain.objs.size()=1 2024-09-14T11:22:50.729 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.729+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.410__shadow_.jHV1t2x53ixRt-fZA2_KdL4CSr7gaP-_0 2024-09-14T11:22:50.729 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.729+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2980146719278358360', time=2024-09-14T13:16:09.845437+0000, chain.objs.size()=1 2024-09-14T11:22:50.729 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.729+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.456__shadow_.dVGHkIong6Y3hBtLbdXHo3hiYE8p20V_0 2024-09-14T11:22:50.729 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.729+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3335820204684456623', time=2024-09-14T13:16:17.244054+0000, chain.objs.size()=1 2024-09-14T11:22:50.729 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.729+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.484__shadow_.05Eac3lRFClh-00hCo3wjrBSDuD_2KP_0 2024-09-14T11:22:50.729 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.729+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15168985886021697726', time=2024-09-14T13:16:32.405757+0000, chain.objs.size()=6 2024-09-14T11:22:50.729 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.729+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.522__multipart_mymultipart.U1pC0hg2FLQHNdyjqi-7OAe3P5azbqBJ.1 2024-09-14T11:22:50.729 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.729+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.522__multipart_mymultipart.2~4L1LiNuubgrp1jaq-ztcgV5wIlnWTNi.2 2024-09-14T11:22:50.730 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.729+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.522__multipart_mymultipart.2~4L1LiNuubgrp1jaq-ztcgV5wIlnWTNi.3 2024-09-14T11:22:50.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.732+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.522__multipart_mymultipart.2~4L1LiNuubgrp1jaq-ztcgV5wIlnWTNi.4 2024-09-14T11:22:50.731 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.732+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.522__multipart_mymultipart.2~4L1LiNuubgrp1jaq-ztcgV5wIlnWTNi.5 2024-09-14T11:22:50.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.732+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.522__multipart_mymultipart.2~4L1LiNuubgrp1jaq-ztcgV5wIlnWTNi.6 2024-09-14T11:22:50.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.732+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12565648214169095086', time=2024-09-14T13:17:27.012600+0000, chain.objs.size()=1 2024-09-14T11:22:50.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.732+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.569__shadow:wn5a7B4PBGDJzwQTjD7JCwkmrtf7-Sn_.OcwD8Amt6HTzpv5M1aJs_bqafEMC2hZ_0 2024-09-14T11:22:50.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.732+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12179639375734620446', time=2024-09-14T13:17:37.913421+0000, chain.objs.size()=1 2024-09-14T11:22:50.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.732+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.577__shadow:QgF3lIKbFXettw6-ON4cP6HUSZ3R.5u_.8mAVlmyzjzi3-PsR8I-5XrBM7pCmyIN_0 2024-09-14T11:22:50.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.732+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8471787798879993730', time=2024-09-14T13:17:41.380242+0000, chain.objs.size()=1 2024-09-14T11:22:50.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.732+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.577__shadow:vPOW3q8YvIPI7He79VisSH03CGy8eUl_.DfA7ouAPItVHzm8wz7JQUNu3gC3r4e1_0 2024-09-14T11:22:50.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.732+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14979911588056235316', time=2024-09-14T13:17:43.610269+0000, chain.objs.size()=1 2024-09-14T11:22:50.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.732+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.577__shadow:Wsqxr2bGjRqyo.d6AQlCK8TQflCXpKR_.tQuvzksA6ZapTQNJ6sXvBiDlwnMTgT6_0 2024-09-14T11:22:50.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.733+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.514650182265836379', time=2024-09-14T13:17:50.007174+0000, chain.objs.size()=1 2024-09-14T11:22:50.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.733+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.579__shadow:YV-NYSItLJskfIGHEoUoboP6UICrA5a_.eeB8Mv517wVdctmaXRLJe5YqPwrkbuu_0 2024-09-14T11:22:50.732 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.733+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10851190050581292954', time=2024-09-14T13:17:50.052160+0000, chain.objs.size()=1 2024-09-14T11:22:50.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.733+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.579__shadow:h7HPJVMSRHmO2AiGm3Mh50DXdj4BIH2_.gJdgKaz28AX3YjxbGklyPJb4ut8cpDH_0 2024-09-14T11:22:50.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.733+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6369200460137829313', time=2024-09-14T13:20:12.125329+0000, chain.objs.size()=1 2024-09-14T11:22:50.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.733+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.642__shadow_.8kgBk64bHG-N3hwIEFCTXstkUKMhsD6_0 2024-09-14T11:22:50.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.733+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2538711478268698930', time=2024-09-14T13:20:12.826812+0000, chain.objs.size()=1 2024-09-14T11:22:50.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.733+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.644__shadow_.pjpvDR4SiUbvHLZhXB7PjUyuVN0w7FK_0 2024-09-14T11:22:50.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.735+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9209270417146899612', time=2024-09-14T13:20:20.022782+0000, chain.objs.size()=1 2024-09-14T11:22:50.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.735+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.663__shadow_.Ip2s8FGOBqxQzrlf3t11zgDoUPtMssV_0 2024-09-14T11:22:50.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.735+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8978474323610465621', time=2024-09-14T13:20:28.617210+0000, chain.objs.size()=1 2024-09-14T11:22:50.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.735+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.697__shadow:xASAedLaBShPxUwx9Fk7NtsQ34hsXLA_.75uAFTomCCy9DO4iUB4HWUnOTskPr1t_0 2024-09-14T11:22:50.733 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.735+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3021054809747651005', time=2024-09-14T13:21:10.051901+0000, chain.objs.size()=1 2024-09-14T11:22:50.734 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.735+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.762__shadow_.DSq1uLj-vimOBWMSVaWfco3ffe6Y_3z_0 2024-09-14T11:22:50.735 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.736+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:50.737 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.738+0000 7f0f19c16800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:22:50.739 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.740+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:50.739 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.740+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:50.740 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.741+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51116' 2024-09-14T11:22:50.740 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.741+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14566907397605635512', time=2024-09-14T13:13:29.894321+0000, chain.objs.size()=1 2024-09-14T11:22:50.740 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.741+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.151__shadow_.d-qHxf22lNGyyBbEn8ol6MLRMfvmTJA_0 2024-09-14T11:22:50.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.741+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8010323862681696167', time=2024-09-14T13:14:44.300646+0000, chain.objs.size()=1 2024-09-14T11:22:50.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.741+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.230__shadow_.jUXSAWKZOTIVgbwFsHhf5b_TtXzHIWT_0 2024-09-14T11:22:50.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.741+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16280825335979447352', time=2024-09-14T13:14:44.302094+0000, chain.objs.size()=1 2024-09-14T11:22:50.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.741+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.230__shadow_.hPLwfbas7deHZMHQxsZ0RLfUDoXEu9B_0 2024-09-14T11:22:50.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.741+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6072528211788737121', time=2024-09-14T13:14:46.214122+0000, chain.objs.size()=1 2024-09-14T11:22:50.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.741+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.237__shadow_.hDqnPWvcbi4FeUwKJ4Ft8jFTU_ZXqhB_0 2024-09-14T11:22:50.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.741+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14600081791330572268', time=2024-09-14T13:14:46.516644+0000, chain.objs.size()=1 2024-09-14T11:22:50.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.741+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.238__shadow_.G9_PgEeHLtCdSoTwFGsJzrXcNm7kRcR_0 2024-09-14T11:22:50.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.741+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3103651871243474320', time=2024-09-14T13:14:47.225284+0000, chain.objs.size()=1 2024-09-14T11:22:50.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.741+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.241__shadow_.tqXBk2XgHX9UuEwLZibFVvEG2vxnTBk_0 2024-09-14T11:22:50.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.741+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13552341581295501986', time=2024-09-14T13:14:47.226028+0000, chain.objs.size()=1 2024-09-14T11:22:50.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.741+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.241__shadow_.ExqIRj8TcZRAw4hMCxs2nnJZIGrKBiy_0 2024-09-14T11:22:50.741 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.741+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1675854427004764667', time=2024-09-14T13:14:50.316045+0000, chain.objs.size()=1 2024-09-14T11:22:50.742 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.741+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.252__shadow_.nl5T9exE9aqtVg9thzXENneXU1oWxAd_0 2024-09-14T11:22:50.742 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.741+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11499891186154929164', time=2024-09-14T13:14:51.836635+0000, chain.objs.size()=1 2024-09-14T11:22:50.742 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.741+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.258__shadow_.fPevGySJi8vYb4yebe9uedYb16sbQBx_0 2024-09-14T11:22:50.742 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.741+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8105376353790660350', time=2024-09-14T13:14:59.773356+0000, chain.objs.size()=1 2024-09-14T11:22:50.742 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.741+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.KfKMmm6Dra7-94FdpGxPet5kfpxFZ2Y_0 2024-09-14T11:22:50.742 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.741+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4403504036677685830', time=2024-09-14T13:14:59.796603+0000, chain.objs.size()=1 2024-09-14T11:22:50.742 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.741+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.lirqU3Dgd2y99_H6zxIwOUIw44UI07r_0 2024-09-14T11:22:50.742 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.741+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15347176778393210623', time=2024-09-14T13:14:59.800539+0000, chain.objs.size()=1 2024-09-14T11:22:50.742 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.741+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.20DaC_v5sy75DNzcp5JeDZpyxLvxZH5_0 2024-09-14T11:22:50.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.742+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7172878038249643058', time=2024-09-14T13:14:59.805773+0000, chain.objs.size()=1 2024-09-14T11:22:50.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.742+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.NFG0d1KjqiaCR9Q2qXrmkEVt0W_5gut_0 2024-09-14T11:22:50.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.743+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1374498276154867544', time=2024-09-14T13:14:59.823709+0000, chain.objs.size()=1 2024-09-14T11:22:50.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.743+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.gZR1M9qNX_1JSJ6wUwiwRjAiQOK3UOb_0 2024-09-14T11:22:50.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.743+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11103853572144350380', time=2024-09-14T13:14:59.897615+0000, chain.objs.size()=1 2024-09-14T11:22:50.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.743+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.cqqmduboyIHuUglCI_udYPdWgtEwaNA_0 2024-09-14T11:22:50.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.743+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17411328319382779887', time=2024-09-14T13:14:59.923732+0000, chain.objs.size()=1 2024-09-14T11:22:50.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.743+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.2kylHx8a-birnFeOySu8--NiosjuNjJ_0 2024-09-14T11:22:50.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.743+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11442968050926418393', time=2024-09-14T13:14:59.971628+0000, chain.objs.size()=1 2024-09-14T11:22:50.744 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.743+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.qJWW5WpYcmwgkoMtlYayq1Z_LNMf6CB_0 2024-09-14T11:22:50.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.743+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7755836971498894201', time=2024-09-14T13:14:59.978604+0000, chain.objs.size()=1 2024-09-14T11:22:50.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.743+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.fCaXivoasBiekkZl3T1SEQW0S7vFS-z_0 2024-09-14T11:22:50.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.744+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.986773417353309734', time=2024-09-14T13:15:00.062992+0000, chain.objs.size()=1 2024-09-14T11:22:50.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.744+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.IvMG-FrlLB--UyT7wT2PJ3lMu6sCPIQ_0 2024-09-14T11:22:50.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.744+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12462592811363986028', time=2024-09-14T13:15:00.104023+0000, chain.objs.size()=1 2024-09-14T11:22:50.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.744+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.3nAI0V9ZgIe_zCbJ2HXAFDEfBxmU6tS_0 2024-09-14T11:22:50.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.744+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2276894875979309400', time=2024-09-14T13:15:00.108226+0000, chain.objs.size()=1 2024-09-14T11:22:50.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.744+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Ws8Y4BmTOlodkg3U7PynhY-d4gtXNWe_0 2024-09-14T11:22:50.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.744+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5307255011350407492', time=2024-09-14T13:15:00.116974+0000, chain.objs.size()=1 2024-09-14T11:22:50.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.744+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.KvMoFnO4X52ilc8vs9Kld87CRVrtfOy_0 2024-09-14T11:22:50.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.744+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10175027860338261294', time=2024-09-14T13:15:00.124425+0000, chain.objs.size()=1 2024-09-14T11:22:50.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.744+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.bgxB0ae4R8Pkoe6U0xSiiqGrjmad8Mr_0 2024-09-14T11:22:50.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.744+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8769545778360680433', time=2024-09-14T13:15:00.125149+0000, chain.objs.size()=1 2024-09-14T11:22:50.745 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.744+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.mj6mXHMNGcdmqoJ07I8EPgaW3hXVyla_0 2024-09-14T11:22:50.746 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.745+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14765612970960835413', time=2024-09-14T13:15:00.141965+0000, chain.objs.size()=1 2024-09-14T11:22:50.746 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.745+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.yLtgHSEjKVF_ZOr6Sp3JrnmIb-TC3iU_0 2024-09-14T11:22:50.746 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.745+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13954000378674699294', time=2024-09-14T13:15:00.258441+0000, chain.objs.size()=1 2024-09-14T11:22:50.746 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.745+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.68-xu2OdM2g4VvRjWGJHW3YemGiUJEf_0 2024-09-14T11:22:50.746 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.745+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13140915168017823930', time=2024-09-14T13:15:00.313264+0000, chain.objs.size()=1 2024-09-14T11:22:50.746 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.745+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.jLcbfa8E9SWJptPUxLVEkGE-B4-dS87_0 2024-09-14T11:22:50.746 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.746+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13950598128066816970', time=2024-09-14T13:15:00.389906+0000, chain.objs.size()=1 2024-09-14T11:22:50.746 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.746+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.2MH-BjepOleOmAVD8nLG5VKKI-FGBRK_0 2024-09-14T11:22:50.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.746+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4086784540883558844', time=2024-09-14T13:15:00.392886+0000, chain.objs.size()=1 2024-09-14T11:22:50.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.746+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.VcRtNKnewKDgcg1qpvnKvnVq6jByTsS_0 2024-09-14T11:22:50.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.746+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2480945494209827948', time=2024-09-14T13:15:00.401636+0000, chain.objs.size()=1 2024-09-14T11:22:50.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.746+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.kkd2ZBr7hA7RXJJOCMrDMMBEtXFP0ld_0 2024-09-14T11:22:50.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.746+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14325130466379699398', time=2024-09-14T13:15:00.404080+0000, chain.objs.size()=1 2024-09-14T11:22:50.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.746+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.xDuplYcNOKvNprXSZdUDTgpPdXOA1h-_0 2024-09-14T11:22:50.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.746+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9226780841634191942', time=2024-09-14T13:15:00.431482+0000, chain.objs.size()=1 2024-09-14T11:22:50.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.746+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.aW2IEl_jm4wH3M9Wd7bCcmUNLML9tvs_0 2024-09-14T11:22:50.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.746+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7293474907661075754', time=2024-09-14T13:15:00.455995+0000, chain.objs.size()=1 2024-09-14T11:22:50.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.746+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.nAVIZ7ZbDwk5x0rrmyNge_d9llBMS4Y_0 2024-09-14T11:22:50.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.746+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10602805881088703413', time=2024-09-14T13:15:00.462085+0000, chain.objs.size()=1 2024-09-14T11:22:50.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.746+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.rPTXsH6L-DCQMQ0njhMOBSa-ccX7qFg_0 2024-09-14T11:22:50.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.746+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13073509481777437885', time=2024-09-14T13:15:00.611729+0000, chain.objs.size()=1 2024-09-14T11:22:50.747 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.746+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.WknWbLfH-fPUTbTl1KyAQ_CrmnHpspo_0 2024-09-14T11:22:50.748 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.747+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7595701788339714387', time=2024-09-14T13:15:00.627597+0000, chain.objs.size()=1 2024-09-14T11:22:50.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.747+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.6RwAhY3gm426UZLuiIDc-uVWL4ypY0N_0 2024-09-14T11:22:50.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.747+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4863277456224296858', time=2024-09-14T13:15:00.790581+0000, chain.objs.size()=1 2024-09-14T11:22:50.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.747+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.3OL53uXBJreNAP3URkxaG2DqktYq32N_0 2024-09-14T11:22:50.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.747+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10763979874642080141', time=2024-09-14T13:15:00.803570+0000, chain.objs.size()=1 2024-09-14T11:22:50.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.747+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.gr3cBsobQ5EGNKdBF306UNBAKrh7Rth_0 2024-09-14T11:22:50.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.747+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6116864329313849449', time=2024-09-14T13:15:00.935638+0000, chain.objs.size()=1 2024-09-14T11:22:50.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.747+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.9o01mWjfQ2EmKnCsIKZyZYdscoioqDX_0 2024-09-14T11:22:50.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.747+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.862039734066476575', time=2024-09-14T13:15:05.467935+0000, chain.objs.size()=1 2024-09-14T11:22:50.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.747+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.280__shadow_.tqq9z6mjLpyNZtxTdisLZBC7LvEsCaB_0 2024-09-14T11:22:50.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.749+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6811944491003652717', time=2024-09-14T13:15:07.549557+0000, chain.objs.size()=1 2024-09-14T11:22:50.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.749+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.287__shadow_.22Sag2O4n9jLi_041GkD6bctf-ETvwD_0 2024-09-14T11:22:50.749 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.749+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9810829296353337141', time=2024-09-14T13:15:07.550350+0000, chain.objs.size()=1 2024-09-14T11:22:50.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.749+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.287__shadow_.ZccUAQ3adK_qAKlHzvKCq9WP8qz1zJ0_0 2024-09-14T11:22:50.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.749+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.283776162380464377', time=2024-09-14T13:15:08.047295+0000, chain.objs.size()=1 2024-09-14T11:22:50.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.749+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.289__shadow_.TLyynWx3uu-fFBg7NFWSuqpG2mFT4s6_0 2024-09-14T11:22:50.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.749+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10808694549252063209', time=2024-09-14T13:15:09.255582+0000, chain.objs.size()=1 2024-09-14T11:22:50.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.749+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.292__shadow_.9SOeQd1ldeY-2SWmq1YIwTYhoD-stEC_0 2024-09-14T11:22:50.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.749+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13695137021155943876', time=2024-09-14T13:15:09.837062+0000, chain.objs.size()=1 2024-09-14T11:22:50.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.749+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.293__shadow_.33ggND7Oi1w_bZ6TVdjhBwDNcN727Y7_0 2024-09-14T11:22:50.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.749+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9402763762087314364', time=2024-09-14T13:15:24.728160+0000, chain.objs.size()=1 2024-09-14T11:22:50.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.749+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.CHHWTWPtj40VO25bBU2GncLgCqNSW6s_0 2024-09-14T11:22:50.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.749+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14807882733484930351', time=2024-09-14T13:15:24.733072+0000, chain.objs.size()=1 2024-09-14T11:22:50.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.749+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.bDRNPS3QTMP3HwOHTlw658GWNnDwPIv_0 2024-09-14T11:22:50.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.749+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10409532650649737062', time=2024-09-14T13:15:24.909296+0000, chain.objs.size()=1 2024-09-14T11:22:50.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.749+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.aclBOiLYmlXsOdq2LbU0t2ufgrwQq3l_0 2024-09-14T11:22:50.750 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.749+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9516378383817971249', time=2024-09-14T13:15:25.066595+0000, chain.objs.size()=1 2024-09-14T11:22:50.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.749+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.y8INoX6r-OcD6YmhHI4VlT4tkIa6T8z_0 2024-09-14T11:22:50.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.749+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15997721749265908463', time=2024-09-14T13:15:25.097656+0000, chain.objs.size()=1 2024-09-14T11:22:50.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.749+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.W4j68fmLdzfo6eb8IJksViZIYHHJzC6_0 2024-09-14T11:22:50.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.749+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7008333158332483265', time=2024-09-14T13:15:25.118034+0000, chain.objs.size()=1 2024-09-14T11:22:50.751 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.749+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.A4HTgNqNneHr0N_OnuZe6jJSLg7RHvL_0 2024-09-14T11:22:50.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.751+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4880085684570915470', time=2024-09-14T13:15:25.218583+0000, chain.objs.size()=1 2024-09-14T11:22:50.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.751+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.SENs5PWowNdcaNK2ogBetxbrTqdiRBH_0 2024-09-14T11:22:50.752 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.751+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14000489004623985660', time=2024-09-14T13:15:25.228027+0000, chain.objs.size()=1 2024-09-14T11:22:50.753 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.751+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.CwsRmCf7QDWFtJm0SsA1NflVKuJIIhi_0 2024-09-14T11:22:50.753 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.751+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17268012905237636301', time=2024-09-14T13:15:25.258581+0000, chain.objs.size()=1 2024-09-14T11:22:50.753 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.751+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.mVKkMMwcvyv5dZqyLn0SsEE8P-Yw3jT_0 2024-09-14T11:22:50.753 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.751+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14381245099900112046', time=2024-09-14T13:15:25.280975+0000, chain.objs.size()=1 2024-09-14T11:22:50.753 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.751+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.vtRQTgSlJuLR0CNJkU2lsuOByxN1_fK_0 2024-09-14T11:22:50.753 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.751+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9799102034751348572', time=2024-09-14T13:15:25.292106+0000, chain.objs.size()=1 2024-09-14T11:22:50.753 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.751+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.SHINYBpuNvPf-ZbcufFpPdJ3beDBlg__0 2024-09-14T11:22:50.753 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.751+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16185652475322575260', time=2024-09-14T13:15:25.364632+0000, chain.objs.size()=1 2024-09-14T11:22:50.753 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.751+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.utrq7_YjwNUZf-M36iQyQg-p7mQ9OER_0 2024-09-14T11:22:50.753 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.751+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11256285095648027222', time=2024-09-14T13:15:25.411402+0000, chain.objs.size()=1 2024-09-14T11:22:50.753 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.751+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.D6MUBuj4t4L-wQn3pZE1WRZBREJZVOT_0 2024-09-14T11:22:50.753 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.751+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16202810366135469497', time=2024-09-14T13:15:25.427133+0000, chain.objs.size()=1 2024-09-14T11:22:50.753 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.751+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.GZNOjkgx7S_02j5dSX15zTzCu6yYTsp_0 2024-09-14T11:22:50.753 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.751+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.131496031216222676', time=2024-09-14T13:15:25.436860+0000, chain.objs.size()=1 2024-09-14T11:22:50.754 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.751+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.ovUVbCfMFMSO0iJkoDqaSL128cmEOsK_0 2024-09-14T11:22:50.754 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.752+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14118739787772893639', time=2024-09-14T13:15:25.449948+0000, chain.objs.size()=1 2024-09-14T11:22:50.754 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.752+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.3RAjeuNZKKEY6i2zyFKZHj5zXJuIkz4_0 2024-09-14T11:22:50.754 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.752+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3939787814889133331', time=2024-09-14T13:15:25.553549+0000, chain.objs.size()=1 2024-09-14T11:22:50.754 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.752+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.St_6GWE_ay3ky3bJFouOAsGFGlGTP-N_0 2024-09-14T11:22:50.754 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.753+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3000268867244226500', time=2024-09-14T13:15:25.554218+0000, chain.objs.size()=1 2024-09-14T11:22:50.754 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.753+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.XhGY-_ZL2WBc1CSbWkkz-Z54A-cm1ls_0 2024-09-14T11:22:50.754 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.753+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11281806328190613301', time=2024-09-14T13:15:25.718216+0000, chain.objs.size()=1 2024-09-14T11:22:50.754 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.753+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.s77GvCrsznOUbAdtUphfm0y3FJ3zsvi_0 2024-09-14T11:22:50.754 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.753+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1038340536126687481', time=2024-09-14T13:15:25.722955+0000, chain.objs.size()=1 2024-09-14T11:22:50.754 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.753+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.IrnCLYlwwGukf3RDjb6A1DQlvyMqYP-_0 2024-09-14T11:22:50.754 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.753+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14057697976457825249', time=2024-09-14T13:15:25.757321+0000, chain.objs.size()=1 2024-09-14T11:22:50.754 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.753+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.9UBsK9k_9irxLR41DEnGTg8OxlSVjbe_0 2024-09-14T11:22:50.755 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.753+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15293306287141318329', time=2024-09-14T13:15:25.763884+0000, chain.objs.size()=1 2024-09-14T11:22:50.755 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.753+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.O3XYN7TJ0ckMOn1gVdWsKP9iNgqHFwt_0 2024-09-14T11:22:50.755 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.753+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14322756456168767516', time=2024-09-14T13:15:25.769279+0000, chain.objs.size()=1 2024-09-14T11:22:50.755 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.753+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.znmCwAa98pd4PTRP6vLSyGMRy31Zuzv_0 2024-09-14T11:22:50.755 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.753+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16356808177684644537', time=2024-09-14T13:15:25.773777+0000, chain.objs.size()=1 2024-09-14T11:22:50.755 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.753+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.RLAeUgpkYXwr5qFomLkdWQADvEtEIUl_0 2024-09-14T11:22:50.755 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.753+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15172210377279582975', time=2024-09-14T13:15:25.904191+0000, chain.objs.size()=1 2024-09-14T11:22:50.755 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.753+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.s_JbPObqESqFIwBu9oZM3-N-xla1AEa_0 2024-09-14T11:22:50.755 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.753+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15520063999633132371', time=2024-09-14T13:15:25.906440+0000, chain.objs.size()=1 2024-09-14T11:22:50.755 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.753+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.dib5bLdPgNdUf63lMlA0Oa8gr6pjwSf_0 2024-09-14T11:22:50.755 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.754+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8412342295519256025', time=2024-09-14T13:15:25.937239+0000, chain.objs.size()=1 2024-09-14T11:22:50.755 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.754+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_._2RuKUjd7UmrvtanQRE8VxinNfMKY5b_0 2024-09-14T11:22:50.755 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.754+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18328078885250963057', time=2024-09-14T13:15:33.177871+0000, chain.objs.size()=1 2024-09-14T11:22:50.755 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.754+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.bFYOjSiWohGUjScow5vseJutGUe92LV_0 2024-09-14T11:22:50.757 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.755+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12311266065173404548', time=2024-09-14T13:15:33.216175+0000, chain.objs.size()=1 2024-09-14T11:22:50.757 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.755+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.0SOy1zHqaTC3nw9OnyCJh5RT3dv9ymg_0 2024-09-14T11:22:50.757 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.755+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6549943081267762560', time=2024-09-14T13:15:33.236158+0000, chain.objs.size()=1 2024-09-14T11:22:50.757 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.755+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.dxS80hl4RaUvMwWcYGv2ciY6pDG5CYa_0 2024-09-14T11:22:50.757 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.755+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15525354416391944410', time=2024-09-14T13:15:33.365537+0000, chain.objs.size()=1 2024-09-14T11:22:50.757 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.755+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.1zMCFKaQ2nFmZjUHwKi-cdksBlZWvLJ_0 2024-09-14T11:22:50.757 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.755+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16342362341571507077', time=2024-09-14T13:15:33.377943+0000, chain.objs.size()=1 2024-09-14T11:22:50.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.755+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.ZLHYvlJxCLN4foXpdWcRw1cGoib6Ziy_0 2024-09-14T11:22:50.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.755+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17719392336075573917', time=2024-09-14T13:15:33.382901+0000, chain.objs.size()=1 2024-09-14T11:22:50.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.755+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.zW9NuuJdqz-TZI6B_2NHgwtjh-VVScO_0 2024-09-14T11:22:50.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.755+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15541928835626709035', time=2024-09-14T13:15:33.400665+0000, chain.objs.size()=1 2024-09-14T11:22:50.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.755+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.P_Td-Vo1OmdtSUYAgeeB3adOCyodMab_0 2024-09-14T11:22:50.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.756+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12271494464156430328', time=2024-09-14T13:15:33.403252+0000, chain.objs.size()=1 2024-09-14T11:22:50.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.756+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.w8u-c4M7105KRpkNy7JDZNuLAc5nOH6_0 2024-09-14T11:22:50.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.756+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17670575241957462440', time=2024-09-14T13:15:33.419710+0000, chain.objs.size()=1 2024-09-14T11:22:50.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.756+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.z_MLIRFRuNVMunDfMAsVs4rNZBI_gLw_0 2024-09-14T11:22:50.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.756+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10529089567196748654', time=2024-09-14T13:15:33.428966+0000, chain.objs.size()=1 2024-09-14T11:22:50.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.756+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.ECGmBiVebAejxUyI6nMK3AcNWwjv5N6_0 2024-09-14T11:22:50.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.756+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15709270686706538131', time=2024-09-14T13:15:33.433421+0000, chain.objs.size()=1 2024-09-14T11:22:50.758 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.756+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.tnfpCaaBNoiJT7RHi5dYLo_E5QJwBlD_0 2024-09-14T11:22:50.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.757+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9012408266770674365', time=2024-09-14T13:15:33.529977+0000, chain.objs.size()=1 2024-09-14T11:22:50.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.757+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.hIs7lQbuY2J4r1Y7YSry0pGpwRNUSjk_0 2024-09-14T11:22:50.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.758+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13665177983221948501', time=2024-09-14T13:15:33.539494+0000, chain.objs.size()=1 2024-09-14T11:22:50.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.758+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.rjWzCl4nptxo_RDtVkRaGR0HDROzt6l_0 2024-09-14T11:22:50.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.758+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6885011699261132825', time=2024-09-14T13:15:33.543735+0000, chain.objs.size()=1 2024-09-14T11:22:50.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.758+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.BLimwBxVp6I8CKcTmiWvB1o5mJSmJ_N_0 2024-09-14T11:22:50.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.758+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9261322160200055835', time=2024-09-14T13:15:33.586633+0000, chain.objs.size()=1 2024-09-14T11:22:50.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.758+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.03B0rJIAG4FFs6zw_HhTqFUWBW32MAI_0 2024-09-14T11:22:50.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.758+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7748336609268792186', time=2024-09-14T13:15:33.588997+0000, chain.objs.size()=1 2024-09-14T11:22:50.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.758+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.-8dTeu8X96LYE3KwNcAviKOptqFYQR0_0 2024-09-14T11:22:50.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.758+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15231759600617216480', time=2024-09-14T13:15:33.702064+0000, chain.objs.size()=1 2024-09-14T11:22:50.759 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.758+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.9MzlfH9JEAynt-4CQvyh8EjsPvmtuVB_0 2024-09-14T11:22:50.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.758+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12719290788340818513', time=2024-09-14T13:15:33.737848+0000, chain.objs.size()=1 2024-09-14T11:22:50.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.758+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.oqfOOViiypeAJT9aveQt5830ck7Yh2o_0 2024-09-14T11:22:50.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.758+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9962433688582502891', time=2024-09-14T13:15:33.770617+0000, chain.objs.size()=1 2024-09-14T11:22:50.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.758+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Z7DwgEdIfXvJ_dNN7xzhNtmlpek4w4M_0 2024-09-14T11:22:50.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.758+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12803491450702510901', time=2024-09-14T13:15:33.773068+0000, chain.objs.size()=1 2024-09-14T11:22:50.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.758+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.w_Sk9Guv1SDZxWKjyQhHZFMCYNM6U-1_0 2024-09-14T11:22:50.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.758+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14149941502614090124', time=2024-09-14T13:15:33.777679+0000, chain.objs.size()=1 2024-09-14T11:22:50.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.758+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.qZ62JZmb38fU6ganvIB4e10yt6Su8V2_0 2024-09-14T11:22:50.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.758+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2391162863985322882', time=2024-09-14T13:15:33.852646+0000, chain.objs.size()=1 2024-09-14T11:22:50.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.758+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.6Cy5QMjAPKRgXP2e9ajno5JH0f9ms74_0 2024-09-14T11:22:50.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.758+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5896813157657136007', time=2024-09-14T13:15:33.864844+0000, chain.objs.size()=1 2024-09-14T11:22:50.760 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.758+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.jf_esJQVjWuuw8dpkxAR4OobYoxLBR1_0 2024-09-14T11:22:50.761 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.759+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.360308648236638712', time=2024-09-14T13:15:33.868568+0000, chain.objs.size()=1 2024-09-14T11:22:50.761 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.759+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.dRgoev9U4yGdrr1BxmONCb3OUc6uv_N_0 2024-09-14T11:22:50.761 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.759+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17229311538988987744', time=2024-09-14T13:15:33.883569+0000, chain.objs.size()=1 2024-09-14T11:22:50.761 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.760+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.TrDztgCRt3wYTHWWIwg6h8b5LQgI7-R_0 2024-09-14T11:22:50.761 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.760+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12159154895049820787', time=2024-09-14T13:15:34.012951+0000, chain.objs.size()=1 2024-09-14T11:22:50.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.760+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.ijbAP9Pl3m3UgyhSwfSvtK-2xd0kyUS_0 2024-09-14T11:22:50.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.760+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9436170188941213670', time=2024-09-14T13:15:34.014024+0000, chain.objs.size()=1 2024-09-14T11:22:50.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.760+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.x8FHTIxIZRxcyeVFx0AuRLpzrFkSh-y_0 2024-09-14T11:22:50.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.760+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9441880306746075476', time=2024-09-14T13:15:34.038132+0000, chain.objs.size()=1 2024-09-14T11:22:50.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.760+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.5MoOkJatHlBWAQ4BL9nZNyg9j66k4FQ_0 2024-09-14T11:22:50.762 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.761+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 0/51116 2024-09-14T11:22:50.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.764+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-14T11:22:50.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.764+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1358858449117298937', time=2024-09-14T13:15:34.052889+0000, chain.objs.size()=1 2024-09-14T11:22:50.763 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.764+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.5qV5dWsmSQzYEuzpm7d0huHhahKOt-Z_0 2024-09-14T11:22:50.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.764+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11270148372870744401', time=2024-09-14T13:15:34.059805+0000, chain.objs.size()=1 2024-09-14T11:22:50.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.764+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.ynYh4ACPokeJP_S85B6aRwNLA8WD1Pz_0 2024-09-14T11:22:50.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.764+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8457165618619657722', time=2024-09-14T13:15:34.083520+0000, chain.objs.size()=1 2024-09-14T11:22:50.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.764+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.CGbvwhtuaeaeSgXdYmUYGYyppZJ44Z8_0 2024-09-14T11:22:50.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.764+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8577998642213422275', time=2024-09-14T13:15:34.209979+0000, chain.objs.size()=1 2024-09-14T11:22:50.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.764+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Mi1YjBZROqkCzUc57BWPuAoTaRYUXIF_0 2024-09-14T11:22:50.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.764+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16909007428995976515', time=2024-09-14T13:15:34.223528+0000, chain.objs.size()=1 2024-09-14T11:22:50.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.764+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.7-Cn8laPnktpAQfRky5B5tBiflJO5cx_0 2024-09-14T11:22:50.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.764+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3706985296646823821', time=2024-09-14T13:15:34.239795+0000, chain.objs.size()=1 2024-09-14T11:22:50.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.764+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.OYRVMDuJQ2R6yUnjFa3Up902s-b66Oa_0 2024-09-14T11:22:50.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.764+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6486464234898467644', time=2024-09-14T13:15:34.244579+0000, chain.objs.size()=1 2024-09-14T11:22:50.764 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.764+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.ui3a1IcNF1ogvHtr6rYzssryWX4H-tG_0 2024-09-14T11:22:50.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.764+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13696341914940174904', time=2024-09-14T13:15:34.349027+0000, chain.objs.size()=1 2024-09-14T11:22:50.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.764+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.zXfpQ9rbXO8_06duHS9aexd3sZoWXdA_0 2024-09-14T11:22:50.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.764+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2983514715106531687', time=2024-09-14T13:15:34.355055+0000, chain.objs.size()=1 2024-09-14T11:22:50.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.764+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.yXLGfmEdOv1Ql3SPzKMEBIxMURGIhke_0 2024-09-14T11:22:50.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.764+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13666230806056601240', time=2024-09-14T13:15:34.401831+0000, chain.objs.size()=1 2024-09-14T11:22:50.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.764+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Q5lU3n2MTpSsQUaFQqmJ4V23ApjTQ3z_0 2024-09-14T11:22:50.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.764+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14213969013874155622', time=2024-09-14T13:15:50.846777+0000, chain.objs.size()=1 2024-09-14T11:22:50.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.764+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.390__shadow_.9lVw85WqriZKB5-tUMa8EtD59EqhGQn_0 2024-09-14T11:22:50.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.764+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.474765970620107745', time=2024-09-14T13:16:21.686150+0000, chain.objs.size()=1 2024-09-14T11:22:50.765 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.764+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.500__shadow_.k9l2VresgAme5XgjCjfLpTCENgE65YE_0 2024-09-14T11:22:50.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.766+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15088985030166176844', time=2024-09-14T13:16:36.275202+0000, chain.objs.size()=2 2024-09-14T11:22:50.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.766+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.523__multipart_mymultipart.2~LkhYL6Db1ga2rhDXPvtjdxIkhd72G66.1 2024-09-14T11:22:50.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.767+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.523__multipart_mymultipart.2~LkhYL6Db1ga2rhDXPvtjdxIkhd72G66.2 2024-09-14T11:22:50.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.767+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1255825670229445428', time=2024-09-14T13:17:34.374324+0000, chain.objs.size()=1 2024-09-14T11:22:50.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.767+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.576__shadow:pTB3g.AUABnfQFWRXLAQmCa.UOYB4cO_.hY2S2LrRlX2fI_4caVXSb0A6BF2rIri_0 2024-09-14T11:22:50.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.767+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17964057137863353918', time=2024-09-14T13:17:51.359597+0000, chain.objs.size()=1 2024-09-14T11:22:50.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.767+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.582__shadow:qKwqc53APSijsiuPrVZ9KGVQaPexEck_.uQivk5-Lyi907xFJFr_oGPIf-VFfoWO_0 2024-09-14T11:22:50.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.767+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4639188582133123421', time=2024-09-14T13:17:58.281420+0000, chain.objs.size()=1 2024-09-14T11:22:50.766 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.767+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.607__shadow_.iX5n0L3yuI0orK46QO2rKmgrKBMVziL_0 2024-09-14T11:22:50.767 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.768+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:50.769 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.771+0000 7f0f19c16800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:22:50.770 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.772+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:50.771 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.772+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:50.773 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.773+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51641' 2024-09-14T11:22:50.773 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.773+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='_y_SpX0UPgz03SzoIj-wuxz7if73OZwW', time=2024-09-14T13:13:36.155456+0000, chain.objs.size()=2 2024-09-14T11:22:50.773 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.773+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.161__shadow_.1me_lIB0fkmLX6cOjUZf7Q5CuMMugVm_0 2024-09-14T11:22:50.773 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.773+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.161__shadow_.1me_lIB0fkmLX6cOjUZf7Q5CuMMugVm_1 2024-09-14T11:22:50.773 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.773+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15740388099269934842', time=2024-09-14T13:13:43.755727+0000, chain.objs.size()=1 2024-09-14T11:22:50.773 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.773+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.176__shadow_.JZbTsI7dnVkWwSdqt-M4i-TOZ2dAnV7_0 2024-09-14T11:22:50.773 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.774+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17506183191057557651', time=2024-09-14T13:14:44.300823+0000, chain.objs.size()=1 2024-09-14T11:22:50.773 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.774+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.230__shadow_.46sctGPtxN9AcuuqY-MHsjlt25HLE7c_0 2024-09-14T11:22:50.773 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.774+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12888243741505599011', time=2024-09-14T13:14:46.515971+0000, chain.objs.size()=1 2024-09-14T11:22:50.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.774+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.238__shadow_.Ch-tsa6qAPlENMNUFi2impXJojK37Hn_0 2024-09-14T11:22:50.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.774+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2479252793550163905', time=2024-09-14T13:14:59.735585+0000, chain.objs.size()=1 2024-09-14T11:22:50.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.774+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Dj_dIguyHNlKbfzE087qsTliC-taorO_0 2024-09-14T11:22:50.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.774+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10475205110749410501', time=2024-09-14T13:14:59.738805+0000, chain.objs.size()=1 2024-09-14T11:22:50.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.774+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.4YLb8-5W_wV5dfWuBdJqY3dPYnd_2jR_0 2024-09-14T11:22:50.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.774+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7944185510948729384', time=2024-09-14T13:14:59.762038+0000, chain.objs.size()=1 2024-09-14T11:22:50.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.774+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.bnSv2FPr3BAGeaQofSJ3YaQ-ZXSvYg0_0 2024-09-14T11:22:50.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.774+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12502018864525535765', time=2024-09-14T13:14:59.766379+0000, chain.objs.size()=1 2024-09-14T11:22:50.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.774+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.rRqgsdCkdNRlKV6ku191XcnIjgg2bBl_0 2024-09-14T11:22:50.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.774+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18275581806438866413', time=2024-09-14T13:14:59.779393+0000, chain.objs.size()=1 2024-09-14T11:22:50.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.774+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.c8cJldcwpXsL5WXkgzWjMA1txsUDLM8_0 2024-09-14T11:22:50.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.774+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15464188045755584308', time=2024-09-14T13:14:59.784078+0000, chain.objs.size()=1 2024-09-14T11:22:50.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.774+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.jDI-5c4Sf6W1k7WZRM4P6OaH3SU6UCP_0 2024-09-14T11:22:50.774 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.774+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9088722948835887728', time=2024-09-14T13:14:59.786176+0000, chain.objs.size()=1 2024-09-14T11:22:50.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.774+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.YuqlPLI6ZqmzMgIz13b5iCJlD1BqbEG_0 2024-09-14T11:22:50.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.776+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8065797802326925371', time=2024-09-14T13:14:59.795273+0000, chain.objs.size()=1 2024-09-14T11:22:50.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.776+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.M1owgsNwzHUQ-GHzOdIHZ-BJmUj7pcO_0 2024-09-14T11:22:50.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.777+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17634858091730997968', time=2024-09-14T13:14:59.800006+0000, chain.objs.size()=1 2024-09-14T11:22:50.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.777+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.jgVo-hi2E479uoEgKTBDSPewHh5Irqp_0 2024-09-14T11:22:50.775 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.777+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.937591819393275143', time=2024-09-14T13:14:59.809249+0000, chain.objs.size()=1 2024-09-14T11:22:50.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.777+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.rBM966uBqdDZK_aNDv7KpaK8nbkRl_Q_0 2024-09-14T11:22:50.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.777+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7844885944701105906', time=2024-09-14T13:14:59.969491+0000, chain.objs.size()=1 2024-09-14T11:22:50.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.777+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.sRlE7_eR0f0eHH9S4js47rhCugJlHaJ_0 2024-09-14T11:22:50.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.777+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2231402093235139518', time=2024-09-14T13:14:59.985547+0000, chain.objs.size()=1 2024-09-14T11:22:50.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.777+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.dTUcDVfW7CBflMUAwkJeIfX116vrL5p_0 2024-09-14T11:22:50.776 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.777+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4935871555099461089', time=2024-09-14T13:15:00.063176+0000, chain.objs.size()=1 2024-09-14T11:22:50.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.777+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.hjrqp9IZxtnlm0kDJ5yPizvoC_DttWc_0 2024-09-14T11:22:50.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.777+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16333655472784317025', time=2024-09-14T13:15:00.089003+0000, chain.objs.size()=1 2024-09-14T11:22:50.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.777+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.gj2rYjh_3u4DsflmQAtNzjGeQdYJKgP_0 2024-09-14T11:22:50.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.777+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16043121981183055404', time=2024-09-14T13:15:00.132355+0000, chain.objs.size()=1 2024-09-14T11:22:50.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.777+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.P5WPeGZYwExmBPWzPxT7KWpebGenRHG_0 2024-09-14T11:22:50.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.777+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13678168993005616628', time=2024-09-14T13:15:00.227608+0000, chain.objs.size()=1 2024-09-14T11:22:50.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.777+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.SER-HKnDaxK4MWKYgCphddNsi7c15IN_0 2024-09-14T11:22:50.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.777+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13707324910867632292', time=2024-09-14T13:15:00.291808+0000, chain.objs.size()=1 2024-09-14T11:22:50.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.777+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.-R66gdR8zRpn3pYadqNuI2vbezmfpJp_0 2024-09-14T11:22:50.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.777+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16289712826734738328', time=2024-09-14T13:15:00.442436+0000, chain.objs.size()=1 2024-09-14T11:22:50.777 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.777+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.FjXesobCIdgMF5zvXoxieBhXpNzG5E5_0 2024-09-14T11:22:50.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.779+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7559384484751601399', time=2024-09-14T13:15:00.576937+0000, chain.objs.size()=1 2024-09-14T11:22:50.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.779+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.oTBR7azk2QjPsGSyg2mhFEO7QwWIOC8_0 2024-09-14T11:22:50.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.779+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4447663569535532068', time=2024-09-14T13:15:00.593095+0000, chain.objs.size()=1 2024-09-14T11:22:50.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.779+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.xMFNxWi6SLLyLLllTR_h2VtHRvvYx1i_0 2024-09-14T11:22:50.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.779+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4608559766725292816', time=2024-09-14T13:15:00.597334+0000, chain.objs.size()=1 2024-09-14T11:22:50.778 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.779+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.27nt8yF6TH0cwxXN8IwZi1M7XshsPlf_0 2024-09-14T11:22:50.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.779+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17693440858259697035', time=2024-09-14T13:15:00.605139+0000, chain.objs.size()=1 2024-09-14T11:22:50.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.779+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.WEbFmZlTMj1bpS_b8NjMqkyknqJC7eu_0 2024-09-14T11:22:50.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.779+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9397013662119018604', time=2024-09-14T13:15:00.608815+0000, chain.objs.size()=1 2024-09-14T11:22:50.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.779+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.4EJuI8vUHpZxPJAbRKIPYUVVoJfJML__0 2024-09-14T11:22:50.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.779+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12554369775866799417', time=2024-09-14T13:15:00.624890+0000, chain.objs.size()=1 2024-09-14T11:22:50.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.779+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.96wfbA79VjD2vfdnx6qwqwEGpElObwK_0 2024-09-14T11:22:50.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.779+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2423471349020051919', time=2024-09-14T13:15:00.628822+0000, chain.objs.size()=1 2024-09-14T11:22:50.779 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.779+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.m274JMYZMhUs9DLpy0j1eUxa4ZSVR0g_0 2024-09-14T11:22:50.780 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.780+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15082003388080528779', time=2024-09-14T13:15:00.636463+0000, chain.objs.size()=1 2024-09-14T11:22:50.780 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.780+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.TLDJZcFdzK2T-jqnTjH1MJhBBWDrMMi_0 2024-09-14T11:22:50.780 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.780+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11381853338413455206', time=2024-09-14T13:15:00.775236+0000, chain.objs.size()=1 2024-09-14T11:22:50.780 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.780+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.TmXKPaoN2l7ai3b79r-iWn9OJgGZcoy_0 2024-09-14T11:22:50.780 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.781+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14972172002865654107', time=2024-09-14T13:15:00.789303+0000, chain.objs.size()=1 2024-09-14T11:22:50.780 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.781+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.8OAWEISSqFM8ECfq8pO2SfnJ37NhJf4_0 2024-09-14T11:22:50.780 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.781+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16970877464663320186', time=2024-09-14T13:15:00.790137+0000, chain.objs.size()=1 2024-09-14T11:22:50.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.781+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.WkWQ1UBBpsdM42oWEaO4VcNIiphY22D_0 2024-09-14T11:22:50.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.781+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1814670550673045920', time=2024-09-14T13:15:00.795155+0000, chain.objs.size()=1 2024-09-14T11:22:50.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.781+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Blu_z5rESbjpVW2o9fOQ6fzKOLgBtSf_0 2024-09-14T11:22:50.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.781+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13886446343103020009', time=2024-09-14T13:15:00.916828+0000, chain.objs.size()=1 2024-09-14T11:22:50.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.781+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.kLAb6m3cKwBs_2NwfiNVOhIqOoVL3k2_0 2024-09-14T11:22:50.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.781+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.452535642934416393', time=2024-09-14T13:15:00.927280+0000, chain.objs.size()=1 2024-09-14T11:22:50.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.781+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.C6e6tSjkNAE2vmpv5MGyw1AwG_k5Qgr_0 2024-09-14T11:22:50.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.781+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.351115181616770684', time=2024-09-14T13:15:00.943171+0000, chain.objs.size()=1 2024-09-14T11:22:50.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.781+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.GyF_KvhZcflIOCrMqcjYN7Vjz2rb1JW_0 2024-09-14T11:22:50.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.781+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3114162013341152932', time=2024-09-14T13:15:02.888774+0000, chain.objs.size()=1 2024-09-14T11:22:50.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.781+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.270__shadow_.oeZnOyU7rvkvhf5d4RXpakky68jdKPq_0 2024-09-14T11:22:50.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.781+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17166193777640877960', time=2024-09-14T13:15:08.046757+0000, chain.objs.size()=1 2024-09-14T11:22:50.781 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.781+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.289__shadow_.8zQ6my9HZa4BFDGQtT-bo5cWlhBwGo0_0 2024-09-14T11:22:50.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.781+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4686680092941528464', time=2024-09-14T13:15:10.610046+0000, chain.objs.size()=1 2024-09-14T11:22:50.782 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.781+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.296__shadow_.HK2mp-dfvRNUENIhNcnf0tEr36R0Y-z_0 2024-09-14T11:22:50.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.782+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.673018408494688316', time=2024-09-14T13:15:11.947331+0000, chain.objs.size()=1 2024-09-14T11:22:50.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.782+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.301__shadow_.s9DUKh5RIUa7bwYHACv-ETJDt_DI1wp_0 2024-09-14T11:22:50.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.782+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8070583053964125990', time=2024-09-14T13:15:24.765267+0000, chain.objs.size()=1 2024-09-14T11:22:50.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.782+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.oJ5GCG23AB8nLP3iTuvo6UElEb8q7hq_0 2024-09-14T11:22:50.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.782+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10150629549340114780', time=2024-09-14T13:15:24.781381+0000, chain.objs.size()=1 2024-09-14T11:22:50.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.782+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.Fc-XSsLn3rAu5n7oLqCd9FlLw2lnyt1_0 2024-09-14T11:22:50.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.783+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12799786301598217480', time=2024-09-14T13:15:24.796645+0000, chain.objs.size()=1 2024-09-14T11:22:50.783 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.783+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.g-ikww1I7BWpv3li2cq4qAIddI24CAL_0 2024-09-14T11:22:50.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.784+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10911656441297446835', time=2024-09-14T13:15:24.931604+0000, chain.objs.size()=1 2024-09-14T11:22:50.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.784+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.dlNgtEnQFa_ZQGlAH3XgFIlXDGnuWrx_0 2024-09-14T11:22:50.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.784+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2766959826660052886', time=2024-09-14T13:15:24.945081+0000, chain.objs.size()=1 2024-09-14T11:22:50.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.784+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.ojI6uWFzuFvXzhqQ8rRGF3QjuZ05hdw_0 2024-09-14T11:22:50.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.784+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7273641083106061006', time=2024-09-14T13:15:24.947766+0000, chain.objs.size()=1 2024-09-14T11:22:50.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.784+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.mebi1qOumeEmekDxmULoED5VKu_N2xw_0 2024-09-14T11:22:50.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.784+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12061282383655808446', time=2024-09-14T13:15:24.963519+0000, chain.objs.size()=1 2024-09-14T11:22:50.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.784+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.MM_knL6UL-gkdSqivx6a28rhw0TegMb_0 2024-09-14T11:22:50.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.784+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14100459016218085250', time=2024-09-14T13:15:25.079397+0000, chain.objs.size()=1 2024-09-14T11:22:50.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.784+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.m4RK7Fmy388AkUU_fwo9f_AqAtm2Bs9_0 2024-09-14T11:22:50.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.784+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11316466856654140483', time=2024-09-14T13:15:25.118720+0000, chain.objs.size()=1 2024-09-14T11:22:50.784 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.784+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.a8VyvVEwEFmYGKKs7eDkzbBuAdpoRsi_0 2024-09-14T11:22:50.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.784+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6164798609618187191', time=2024-09-14T13:15:25.126870+0000, chain.objs.size()=1 2024-09-14T11:22:50.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.784+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.81NPK9r9sWcXca7EwVEyOnrbcy9mX9U_0 2024-09-14T11:22:50.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.784+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12355341018725909381', time=2024-09-14T13:15:25.130732+0000, chain.objs.size()=1 2024-09-14T11:22:50.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.784+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.VWNMGOKfBu2uiFLi4bfWOtJz_oTS6pL_0 2024-09-14T11:22:50.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.784+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.136843401834531922', time=2024-09-14T13:15:25.208760+0000, chain.objs.size()=1 2024-09-14T11:22:50.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.784+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.tKApVoWKPMHA21Z9tQMpRlvdAZJoBQA_0 2024-09-14T11:22:50.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.785+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3653409412392093591', time=2024-09-14T13:15:25.233508+0000, chain.objs.size()=1 2024-09-14T11:22:50.785 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.785+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.VoX-tT6n7jplz1A_h2aAulLMYYm2OLQ_0 2024-09-14T11:22:50.786 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.785+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14085043568617864701', time=2024-09-14T13:15:25.240138+0000, chain.objs.size()=1 2024-09-14T11:22:50.786 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.785+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.7C6MSlOgg7vS3Fy_SIFEb_4ggqAmoF5_0 2024-09-14T11:22:50.786 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.786+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6925514872077477349', time=2024-09-14T13:15:25.272212+0000, chain.objs.size()=1 2024-09-14T11:22:50.786 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.786+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.JlCH4KGzxINPVy-Z3WRiN0bcP8Xo9qB_0 2024-09-14T11:22:50.787 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.786+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1954837853708932914', time=2024-09-14T13:15:25.278059+0000, chain.objs.size()=1 2024-09-14T11:22:50.787 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.786+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.r_6X9RN6RE8rk3u1r4X5DXoQ6x8vxQp_0 2024-09-14T11:22:50.787 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.786+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.572544400019257350', time=2024-09-14T13:15:25.385828+0000, chain.objs.size()=1 2024-09-14T11:22:50.787 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.786+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.vOFf1g-2hqgf-cVg_Ii_t7YXSWTV1cK_0 2024-09-14T11:22:50.787 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.786+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2484557774657031384', time=2024-09-14T13:15:25.400361+0000, chain.objs.size()=1 2024-09-14T11:22:50.787 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.786+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.2zMdlpk8YVzZSuRguaGr_PpAUHMJyd6_0 2024-09-14T11:22:50.787 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.786+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11445433939796731427', time=2024-09-14T13:15:25.410567+0000, chain.objs.size()=1 2024-09-14T11:22:50.787 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.786+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.CqMYxwQgRIAZ_pnqWL3GpNLgT4H6seD_0 2024-09-14T11:22:50.787 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.786+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13006485984045205409', time=2024-09-14T13:15:25.526481+0000, chain.objs.size()=1 2024-09-14T11:22:50.787 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.786+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.Taj1g2n_5zzZPixIPyETqAndIxRdH80_0 2024-09-14T11:22:50.787 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.786+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2913284597615183828', time=2024-09-14T13:15:25.527327+0000, chain.objs.size()=1 2024-09-14T11:22:50.787 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.786+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.TxzOc_nhTVpRfbu6dVbTBzgoINXUT1x_0 2024-09-14T11:22:50.787 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.787+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8019047215682346641', time=2024-09-14T13:15:25.568800+0000, chain.objs.size()=1 2024-09-14T11:22:50.787 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.787+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.40nwUKJ7UV8nY2Pwhv4buJEqNvU7gDw_0 2024-09-14T11:22:50.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.787+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6574543454878549556', time=2024-09-14T13:15:25.577241+0000, chain.objs.size()=1 2024-09-14T11:22:50.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.787+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.alWPH4hSBl941n59_SFYlEz1lO_TV8T_0 2024-09-14T11:22:50.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.787+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6770262119245997310', time=2024-09-14T13:15:25.578148+0000, chain.objs.size()=1 2024-09-14T11:22:50.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.787+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.HR5LCVuFtfdW1n6LZUiGUaXw7FDMQTZ_0 2024-09-14T11:22:50.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.787+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3451672502559769879', time=2024-09-14T13:15:25.579931+0000, chain.objs.size()=1 2024-09-14T11:22:50.788 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.787+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.m93qsQJ941xb6Hdsf65ZlvPfm_g1eb__0 2024-09-14T11:22:50.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.788+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1227251127985100442', time=2024-09-14T13:15:25.585940+0000, chain.objs.size()=1 2024-09-14T11:22:50.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.788+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.UL2dnmusX1d84P-dpK3SH3Mr5EupjsX_0 2024-09-14T11:22:50.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.788+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10380217768361688979', time=2024-09-14T13:15:25.594932+0000, chain.objs.size()=1 2024-09-14T11:22:50.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.788+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.2XcydYdOdm9O_5Vp50YhSydoPZO1Kc-_0 2024-09-14T11:22:50.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.788+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2195816541836434886', time=2024-09-14T13:15:25.716822+0000, chain.objs.size()=1 2024-09-14T11:22:50.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.788+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.lNApHKov0X4ZcIJsNRD-98vdaRfuQIm_0 2024-09-14T11:22:50.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.788+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7329362273068462718', time=2024-09-14T13:15:25.727970+0000, chain.objs.size()=1 2024-09-14T11:22:50.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.788+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.f_OitGmICLZug1KSWHthxWAK_s5QSai_0 2024-09-14T11:22:50.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.788+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1066661344749992352', time=2024-09-14T13:15:25.739936+0000, chain.objs.size()=1 2024-09-14T11:22:50.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.788+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.sfA1Xxr7ZclPgZs-nY9P06K_taDOW3W_0 2024-09-14T11:22:50.789 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.788+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9814061872950427935', time=2024-09-14T13:15:25.742363+0000, chain.objs.size()=1 2024-09-14T11:22:50.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.788+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.b2OX-Zv8COYY_IhOonVqth31TlJpNx__0 2024-09-14T11:22:50.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.788+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4547887149393120086', time=2024-09-14T13:15:25.880149+0000, chain.objs.size()=1 2024-09-14T11:22:50.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.788+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.oBcay9AjIWvtYSGQxOTl7YN34356pdr_0 2024-09-14T11:22:50.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.789+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16218927679161277195', time=2024-09-14T13:15:25.918102+0000, chain.objs.size()=1 2024-09-14T11:22:50.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.789+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.u6x6S6B4q1bqvENC9KHubmlpP3Qe6cR_0 2024-09-14T11:22:50.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.789+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8872362029072825246', time=2024-09-14T13:15:25.926251+0000, chain.objs.size()=1 2024-09-14T11:22:50.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.789+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.7OCdI7JnfPbKiBdvMulypAaJXDawGza_0 2024-09-14T11:22:50.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.789+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9239711674160149297', time=2024-09-14T13:15:33.198876+0000, chain.objs.size()=1 2024-09-14T11:22:50.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.789+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.TbHdlCMPUy21Zdu2aIurAzbhn0_gXsK_0 2024-09-14T11:22:50.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.789+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10317914214630364133', time=2024-09-14T13:15:33.213142+0000, chain.objs.size()=1 2024-09-14T11:22:50.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.789+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.vnUv5ZwAmty2tc0Hsd2j8CxCoV7SYxP_0 2024-09-14T11:22:50.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.790+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17305495964414207586', time=2024-09-14T13:15:33.226114+0000, chain.objs.size()=1 2024-09-14T11:22:50.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.790+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.M3Xemn2-5qGPXnueCx8Llj7a7qrfICw_0 2024-09-14T11:22:50.790 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.790+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9462168862374546133', time=2024-09-14T13:15:33.240472+0000, chain.objs.size()=1 2024-09-14T11:22:50.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.790+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.9YjTXpAcC-3wCydvELh8atGbXbOjupo_0 2024-09-14T11:22:50.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.790+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9425309555442067769', time=2024-09-14T13:15:33.242974+0000, chain.objs.size()=1 2024-09-14T11:22:50.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.790+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.cKlinYPba5is1XdeaWvRQHF9i3z2Hjz_0 2024-09-14T11:22:50.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.790+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17579895562138663896', time=2024-09-14T13:15:33.247791+0000, chain.objs.size()=1 2024-09-14T11:22:50.791 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.790+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.FjUrz9pUrooo764CofIpn4nHWP3rqgh_0 2024-09-14T11:22:50.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.791+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.673627068105614359', time=2024-09-14T13:15:33.252038+0000, chain.objs.size()=1 2024-09-14T11:22:50.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.791+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Msn9N0CSLfM9aWw9_2_I8i3tIi80_WC_0 2024-09-14T11:22:50.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.791+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9440583985277541620', time=2024-09-14T13:15:33.365801+0000, chain.objs.size()=1 2024-09-14T11:22:50.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.791+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.kpPZySNpd4OfJyXxHNg02nJtgCa6JSP_0 2024-09-14T11:22:50.792 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.791+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14543400385195552536', time=2024-09-14T13:15:33.392203+0000, chain.objs.size()=1 2024-09-14T11:22:50.793 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.791+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.5sjwtSK1KGfqgpWIhluZZUjxoWmSUcG_0 2024-09-14T11:22:50.793 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.791+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13028880425863015474', time=2024-09-14T13:15:33.399543+0000, chain.objs.size()=1 2024-09-14T11:22:50.793 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.791+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.LCBNiyLtFu8NEuI09ov-iaI0s43lRpX_0 2024-09-14T11:22:50.793 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.791+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7459204784770769530', time=2024-09-14T13:15:33.402866+0000, chain.objs.size()=1 2024-09-14T11:22:50.793 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.791+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.VGd5atxYAnJVgQ_cf13SamlBgeEvOCh_0 2024-09-14T11:22:50.793 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.791+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8226815092772246689', time=2024-09-14T13:15:33.412682+0000, chain.objs.size()=1 2024-09-14T11:22:50.793 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.791+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.M5sAFnOVFayWisMz_bQY472QybYyjIm_0 2024-09-14T11:22:50.793 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.791+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16283777642292400310', time=2024-09-14T13:15:33.543521+0000, chain.objs.size()=1 2024-09-14T11:22:50.793 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.791+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.gGp2aSrLjF-ympSOr9mVAiCSW6B1QCx_0 2024-09-14T11:22:50.793 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.792+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15792440188070647191', time=2024-09-14T13:15:33.552143+0000, chain.objs.size()=1 2024-09-14T11:22:50.793 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.792+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.lN1VbpKzmoFXtdefu30-_qeZ9QlEgWv_0 2024-09-14T11:22:50.793 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.792+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3412872284717752473', time=2024-09-14T13:15:33.555511+0000, chain.objs.size()=1 2024-09-14T11:22:50.793 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.792+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Gi6aYRveAZvN4pg4mILJ5ih33UxhoRz_0 2024-09-14T11:22:50.793 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.792+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3389204922743844893', time=2024-09-14T13:15:33.565255+0000, chain.objs.size()=1 2024-09-14T11:22:50.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.792+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.a0oaOe27hSICw5xftaFHj2m-_YWzzm6_0 2024-09-14T11:22:50.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.792+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16797354813071808491', time=2024-09-14T13:15:33.566799+0000, chain.objs.size()=1 2024-09-14T11:22:50.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.792+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.qKgWdIZCuuJMV03NEh_-tjUbo6O02kL_0 2024-09-14T11:22:50.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.792+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4711883759559609456', time=2024-09-14T13:15:33.588654+0000, chain.objs.size()=1 2024-09-14T11:22:50.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.792+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.90pVxozjG7bXPpalaSnuOBfXg21mVHP_0 2024-09-14T11:22:50.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.792+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2436229247629513284', time=2024-09-14T13:15:33.601363+0000, chain.objs.size()=1 2024-09-14T11:22:50.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.792+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.X1OqcCjYUwO_4-APdQabrGtIzFGJEax_0 2024-09-14T11:22:50.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.792+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.884223576957362289', time=2024-09-14T13:15:33.603066+0000, chain.objs.size()=1 2024-09-14T11:22:50.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.792+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.YVVd2LBMYdKwEAXO3ZyQCLdEU_9fpXq_0 2024-09-14T11:22:50.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.792+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7916569834099200675', time=2024-09-14T13:15:33.606172+0000, chain.objs.size()=1 2024-09-14T11:22:50.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.792+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.T5XJFFNLJxlDwfvf7IxY-IYUsy86CNT_0 2024-09-14T11:22:50.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.792+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3713260200628356880', time=2024-09-14T13:15:33.704183+0000, chain.objs.size()=1 2024-09-14T11:22:50.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.792+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.-6wv1aQ3w1ZOZgGRRyhWL_MWOzoQRSY_0 2024-09-14T11:22:50.794 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.793+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14408182995541617195', time=2024-09-14T13:15:33.705351+0000, chain.objs.size()=1 2024-09-14T11:22:50.795 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.793+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.LUY21b0ndUKeKaDEf95T-pDMMnHkmZl_0 2024-09-14T11:22:50.795 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.793+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5449719407573501267', time=2024-09-14T13:15:33.729027+0000, chain.objs.size()=1 2024-09-14T11:22:50.795 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.793+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.zu-DXYQS9-C7JmSP64P1lzq17e5U7rg_0 2024-09-14T11:22:50.795 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.794+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9451861631152170132', time=2024-09-14T13:15:33.736791+0000, chain.objs.size()=1 2024-09-14T11:22:50.795 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.794+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.GTQzrx0kVDNLuEFs8q7dnxIKr3MJc6f_0 2024-09-14T11:22:50.795 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.795+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 0/51641 2024-09-14T11:22:50.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.797+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=41, truncated=0, next_marker='' 2024-09-14T11:22:50.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.797+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.889255505529114465', time=2024-09-14T13:15:33.754768+0000, chain.objs.size()=1 2024-09-14T11:22:50.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.797+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.bEmH92c17YgANIZ1L9oYSaHVajwmNEk_0 2024-09-14T11:22:50.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.797+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1476211957184365873', time=2024-09-14T13:15:33.763379+0000, chain.objs.size()=1 2024-09-14T11:22:50.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.797+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.hMLu8Vp_AudIVyv1LId-ke9QbdGlTcj_0 2024-09-14T11:22:50.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.797+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17562883961204145278', time=2024-09-14T13:15:33.864456+0000, chain.objs.size()=1 2024-09-14T11:22:50.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.797+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Np-sf2JC_Ff8s4T4KCq0k5yBp90kO45_0 2024-09-14T11:22:50.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.797+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9376975779923442537', time=2024-09-14T13:15:33.872649+0000, chain.objs.size()=1 2024-09-14T11:22:50.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.797+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.w5YDCwNl_tW0SBXYG2H1lo9qKWsAiLu_0 2024-09-14T11:22:50.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.797+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11634441864965676160', time=2024-09-14T13:15:33.873481+0000, chain.objs.size()=1 2024-09-14T11:22:50.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.797+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.zeEEgmeEjQu4N-YlFE47bKW2O-ERz9c_0 2024-09-14T11:22:50.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.797+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11391907046469835486', time=2024-09-14T13:15:33.907924+0000, chain.objs.size()=1 2024-09-14T11:22:50.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.797+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.G0FWAgW6mGb4OG16YIebPk8PbFBXsd3_0 2024-09-14T11:22:50.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.797+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17897769614306420396', time=2024-09-14T13:15:33.914076+0000, chain.objs.size()=1 2024-09-14T11:22:50.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.797+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.a_FPmhY8dOAPgYUNXmPkD8RmP5kaJMb_0 2024-09-14T11:22:50.798 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.797+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2364028920879946104', time=2024-09-14T13:15:33.916561+0000, chain.objs.size()=1 2024-09-14T11:22:50.798 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.797+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.nKcYEAmc3MPR7958Qgr0uQ9e4HiFuEm_0 2024-09-14T11:22:50.798 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.797+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8952849837098598849', time=2024-09-14T13:15:34.020210+0000, chain.objs.size()=1 2024-09-14T11:22:50.798 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.797+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.SBK-lfHOR4f5OjW-E0sYif4PKjHJQ1p_0 2024-09-14T11:22:50.798 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.797+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17262519444458493565', time=2024-09-14T13:15:34.028357+0000, chain.objs.size()=1 2024-09-14T11:22:50.798 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.797+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.c3gUH5dJv0EGDLoei-214YTyyVTI_cJ_0 2024-09-14T11:22:50.798 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.797+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12638567807540436880', time=2024-09-14T13:15:34.032838+0000, chain.objs.size()=1 2024-09-14T11:22:50.798 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.797+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.QDwo9lqqcd9aX9J3OO0l1O6GnXFQ2dK_0 2024-09-14T11:22:50.798 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.797+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3394797048283817067', time=2024-09-14T13:15:34.057647+0000, chain.objs.size()=1 2024-09-14T11:22:50.798 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.797+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.0sU1ndWa-L5Ryb5iIenVeCMbd4y87rZ_0 2024-09-14T11:22:50.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.799+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10015386595840786927', time=2024-09-14T13:15:34.067476+0000, chain.objs.size()=1 2024-09-14T11:22:50.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.799+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.w1KrdUUqL7tFN2hLSyVwhYZPlGFt3Q-_0 2024-09-14T11:22:50.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.799+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5167331722348527141', time=2024-09-14T13:15:34.072682+0000, chain.objs.size()=1 2024-09-14T11:22:50.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.799+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.KsO6njaWwd0tWFQub63D126iuofeCx7_0 2024-09-14T11:22:50.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.799+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1415071285685943628', time=2024-09-14T13:15:34.083493+0000, chain.objs.size()=1 2024-09-14T11:22:50.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.799+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.TsN8sgCvECrG4wmrtKqt31G2Y5Hqn_L_0 2024-09-14T11:22:50.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.799+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2271896996027222733', time=2024-09-14T13:15:34.086113+0000, chain.objs.size()=1 2024-09-14T11:22:50.799 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.799+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.dfOYoA-GPnmbe2jQ1ejyNQpM-sVUJFI_0 2024-09-14T11:22:50.800 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.799+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7927968034206759248', time=2024-09-14T13:15:34.088162+0000, chain.objs.size()=1 2024-09-14T11:22:50.800 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.799+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.6o36JAPEBEQ2y1NBxWhZIOfyEQWqfFe_0 2024-09-14T11:22:50.800 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.799+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4957096017195405000', time=2024-09-14T13:15:34.092373+0000, chain.objs.size()=1 2024-09-14T11:22:50.800 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.799+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.FAQr6cBgX8PVCYHIlYmQKcEGiNT2LXD_0 2024-09-14T11:22:50.800 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.799+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4874450658414393715', time=2024-09-14T13:15:34.100055+0000, chain.objs.size()=1 2024-09-14T11:22:50.800 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.799+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.ren4PvApn6TjiIGqP4_8pUpHzz6Vnax_0 2024-09-14T11:22:50.800 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.799+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8411563347712392088', time=2024-09-14T13:15:34.175142+0000, chain.objs.size()=1 2024-09-14T11:22:50.800 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.799+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.e7TJWLeRBOFRg1FqAYclX22Zaqvm1CC_0 2024-09-14T11:22:50.801 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.801+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12351330883754747741', time=2024-09-14T13:15:34.183476+0000, chain.objs.size()=1 2024-09-14T11:22:50.801 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.801+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.pAiA37_piXI1xYZEzBr8XTfzQ3B9qBk_0 2024-09-14T11:22:50.801 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.801+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10711773152923749074', time=2024-09-14T13:15:34.184670+0000, chain.objs.size()=1 2024-09-14T11:22:50.801 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.801+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.OEPsLloPks6-1uL1xP_vrLSPdHcl53b_0 2024-09-14T11:22:50.801 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.801+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15337337513289582370', time=2024-09-14T13:15:34.187372+0000, chain.objs.size()=1 2024-09-14T11:22:50.801 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.801+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.RbFl0FhWKmNtmJN_UrVVSC4yHZjyOF2_0 2024-09-14T11:22:50.801 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.801+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9817560383118632337', time=2024-09-14T13:15:34.197731+0000, chain.objs.size()=1 2024-09-14T11:22:50.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.801+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.rMNIg_rDlsZuywJyBh_n24_Tndi8Oya_0 2024-09-14T11:22:50.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.801+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14473268049842331126', time=2024-09-14T13:15:34.206083+0000, chain.objs.size()=1 2024-09-14T11:22:50.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.801+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.mzBwBHrVO8wvTpR_0vTq5ScQoTOh3l9_0 2024-09-14T11:22:50.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.801+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12716344117069054227', time=2024-09-14T13:15:34.333805+0000, chain.objs.size()=1 2024-09-14T11:22:50.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.801+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.TzkfxNd_DTiRBIEbT9AVcylePIKifLR_0 2024-09-14T11:22:50.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.802+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13557929418277069519', time=2024-09-14T13:15:34.345031+0000, chain.objs.size()=1 2024-09-14T11:22:50.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.802+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.4xm6yWQS9Qwn-4ABI12xWCFaa8t2eQU_0 2024-09-14T11:22:50.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.802+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14793944695328942883', time=2024-09-14T13:15:34.365886+0000, chain.objs.size()=1 2024-09-14T11:22:50.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.802+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.D-dgF5eqjAJ9Z048YFURv2AlWGX_Ep__0 2024-09-14T11:22:50.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.802+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8943474754217903352', time=2024-09-14T13:15:34.370517+0000, chain.objs.size()=1 2024-09-14T11:22:50.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.802+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.GqpBfkqGfwGyP7Y76T7jxO9eexjVPiF_0 2024-09-14T11:22:50.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.802+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16005252131404859771', time=2024-09-14T13:15:48.474877+0000, chain.objs.size()=1 2024-09-14T11:22:50.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.802+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.381__shadow_.GmI9f1JfyGjXREqdW53qV8JtEaLg30X_0 2024-09-14T11:22:50.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.802+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5686550501373345522', time=2024-09-14T13:15:56.805655+0000, chain.objs.size()=1 2024-09-14T11:22:50.802 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.802+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.407__shadow_.5aitzACZbJHMxDGvftjvfpFZZxnKtHz_0 2024-09-14T11:22:50.803 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.803+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6842600588257221427', time=2024-09-14T13:16:08.021928+0000, chain.objs.size()=1 2024-09-14T11:22:50.803 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.803+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.450__shadow_.9dOihVJkL8M5U9B0L259s4SnLmp3CNW_0 2024-09-14T11:22:50.803 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.803+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10388623922660411829', time=2024-09-14T13:16:12.995842+0000, chain.objs.size()=1 2024-09-14T11:22:50.803 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.803+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.464__shadow_.8HAW5TiHE1umuORIfo2QeeT0c8IVGvZ_0 2024-09-14T11:22:50.804 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.803+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5059291599474107400', time=2024-09-14T13:17:10.695153+0000, chain.objs.size()=1 2024-09-14T11:22:50.804 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.803+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.552__shadow_.Zz9F0gaNw2C_MaR4ry-M3xeoj-9h6vN_0 2024-09-14T11:22:50.804 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.803+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13100232666028634382', time=2024-09-14T13:17:27.323894+0000, chain.objs.size()=1 2024-09-14T11:22:50.804 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.803+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.570__shadow:5TMOcZowG9R965iayi6Z-I5MPx0F8nx_.ZzwlUiQqkbZLoGayiA9d5FTIaT-G_tb_0 2024-09-14T11:22:50.804 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.803+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9682987550693212193', time=2024-09-14T13:17:28.136506+0000, chain.objs.size()=1 2024-09-14T11:22:50.804 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.803+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.572__shadow_.x-iVOP4bGnjq70JLGqTUH0o98qi5_D1_0 2024-09-14T11:22:50.804 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.803+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13714398959897789753', time=2024-09-14T13:17:38.457974+0000, chain.objs.size()=1 2024-09-14T11:22:50.804 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.803+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.577__shadow:ndu5uI6MgxQbzCPbK2MoyV.L9vW9Vc1_.1njZt6SESvu9mYDlmIS0f8skNslCZYQ_0 2024-09-14T11:22:50.804 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.804+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10267611606401309953', time=2024-09-14T13:17:39.414022+0000, chain.objs.size()=1 2024-09-14T11:22:50.804 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.804+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.577__shadow:8hP6XW75D-EGZI6Ua-psB.o82kWxlEx_.fVDLsuCs_f2yEFjHX3PR46ZAgmSOGRV_0 2024-09-14T11:22:50.804 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.804+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1225368395010333623', time=2024-09-14T13:20:16.996568+0000, chain.objs.size()=1 2024-09-14T11:22:50.804 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.804+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.656__shadow_.aGiTm53WrsE-Ya5d1GvLTi-cTK14cFT_0 2024-09-14T11:22:50.804 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.804+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9535374436233730290', time=2024-09-14T13:20:22.131615+0000, chain.objs.size()=1 2024-09-14T11:22:50.804 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.804+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.670__shadow_.5nxJojeevyi2BltHrLl0aDR6dexwCVb_0 2024-09-14T11:22:50.805 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.804+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14087145228526312605', time=2024-09-14T13:21:12.621692+0000, chain.objs.size()=1 2024-09-14T11:22:50.805 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.804+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.769__shadow_.nB6f5NWwZvP80wtOUA3EMpZIqoQIQcz_0 2024-09-14T11:22:50.805 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.806+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:50.806 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.808+0000 7f0f19c16800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:22:50.807 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.809+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:50.808 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.809+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:50.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.810+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47496' 2024-09-14T11:22:50.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.810+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5663977224307794623', time=2024-09-14T13:14:45.378026+0000, chain.objs.size()=1 2024-09-14T11:22:50.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.810+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.234__shadow_.6O6zOaPn8wkwAt0byPyoiq0YLoPhFyc_0 2024-09-14T11:22:50.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.810+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15182582533883137719', time=2024-09-14T13:14:45.911433+0000, chain.objs.size()=1 2024-09-14T11:22:50.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.810+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.236__shadow_.00HWJtYltL1W306EJBL8iC4VuaZeaet_0 2024-09-14T11:22:50.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.810+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9680795753748233714', time=2024-09-14T13:14:49.814331+0000, chain.objs.size()=1 2024-09-14T11:22:50.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.810+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.250__shadow_.Ov_9mPtlOHV2vNm5qcbjENxLhkLFtHi_0 2024-09-14T11:22:50.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.810+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15684924620099412201', time=2024-09-14T13:14:59.734377+0000, chain.objs.size()=1 2024-09-14T11:22:50.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.810+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.kiKEBtHiutJ1MDnK4f7texEGGBrS7tg_0 2024-09-14T11:22:50.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.810+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.232149575024542154', time=2024-09-14T13:14:59.765883+0000, chain.objs.size()=1 2024-09-14T11:22:50.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.810+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.DaDILOIXmAOcoI3UIaUArb4yM3EFUov_0 2024-09-14T11:22:50.810 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.810+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15958998134912566826', time=2024-09-14T13:14:59.790897+0000, chain.objs.size()=1 2024-09-14T11:22:50.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.810+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.jBCfVeiJmOvCqItq8H0H-uhJ6Ki1Yr6_0 2024-09-14T11:22:50.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.810+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4406286321084757066', time=2024-09-14T13:14:59.798626+0000, chain.objs.size()=1 2024-09-14T11:22:50.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.810+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.fJOKBty0w-Cog01i5hQGlpjsV7xPLf5_0 2024-09-14T11:22:50.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.810+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4369131264684892448', time=2024-09-14T13:14:59.807385+0000, chain.objs.size()=1 2024-09-14T11:22:50.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.810+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Op8DgWsvi6fNYLdKTVZaVACewkzMCgL_0 2024-09-14T11:22:50.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.810+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2255714905797733937', time=2024-09-14T13:14:59.903441+0000, chain.objs.size()=1 2024-09-14T11:22:50.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.810+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Gh6VAukkoGfRtxRC2k1LwlV52hjli-N_0 2024-09-14T11:22:50.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.810+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6247347994456453453', time=2024-09-14T13:14:59.912009+0000, chain.objs.size()=1 2024-09-14T11:22:50.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.810+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.aJ7aO2JZPUvvpFjMotmZF_ApFwLNlpo_0 2024-09-14T11:22:50.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.810+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6087393875650467881', time=2024-09-14T13:14:59.983452+0000, chain.objs.size()=1 2024-09-14T11:22:50.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.810+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.3kLZHH5Gohfvs525gaQXA-JP4l4jRBW_0 2024-09-14T11:22:50.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.810+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10172328104373598848', time=2024-09-14T13:15:00.066951+0000, chain.objs.size()=1 2024-09-14T11:22:50.811 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.810+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.mjL3D4YYR8kqt5sgke8hmwkjAwc7Bip_0 2024-09-14T11:22:50.812 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.812+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9024910973606288028', time=2024-09-14T13:15:00.139389+0000, chain.objs.size()=1 2024-09-14T11:22:50.812 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.812+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.C9s_R-NuSx14wqhUsEH7aIRg6vFFJXT_0 2024-09-14T11:22:50.812 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.812+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11536788905428010339', time=2024-09-14T13:15:00.242346+0000, chain.objs.size()=1 2024-09-14T11:22:50.812 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.812+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.oP_pMia08sJTeQELXsZs9pqrRO54onP_0 2024-09-14T11:22:50.812 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.812+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.829302105426205930', time=2024-09-14T13:15:00.266450+0000, chain.objs.size()=1 2024-09-14T11:22:50.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.812+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Xx52GsQeeaiKXU-q7oUoZmiAev-vqar_0 2024-09-14T11:22:50.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.813+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17164431006188916174', time=2024-09-14T13:15:00.317601+0000, chain.objs.size()=1 2024-09-14T11:22:50.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.813+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Pt94joPWBYBrNfuk5qwXWIf0mN0FM0b_0 2024-09-14T11:22:50.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.813+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1853318289540382161', time=2024-09-14T13:15:00.425047+0000, chain.objs.size()=1 2024-09-14T11:22:50.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.813+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.yhEoLJCok3EXdCMMf8LqpjbSAM75QGK_0 2024-09-14T11:22:50.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.813+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17104214152877917246', time=2024-09-14T13:15:00.447679+0000, chain.objs.size()=1 2024-09-14T11:22:50.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.813+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.QjpiF0EKa427_4TC_3Iv9cLSh1wei4r_0 2024-09-14T11:22:50.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.813+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15687026127535344748', time=2024-09-14T13:15:00.458239+0000, chain.objs.size()=1 2024-09-14T11:22:50.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.813+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.mdAG6YcYjr2dgAV--U3jYf3l8yZ4qfq_0 2024-09-14T11:22:50.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.813+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10680907032273360611', time=2024-09-14T13:15:00.549393+0000, chain.objs.size()=1 2024-09-14T11:22:50.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.813+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.VIqXzZXdy-elbsYg91q7EdPJeoCaKlU_0 2024-09-14T11:22:50.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.813+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1386556293629160332', time=2024-09-14T13:15:00.563799+0000, chain.objs.size()=1 2024-09-14T11:22:50.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.813+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.CIHYdE15DFKtHM_Sq4VHpxOllgnJARY_0 2024-09-14T11:22:50.813 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.813+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15314891007470789773', time=2024-09-14T13:15:00.564564+0000, chain.objs.size()=1 2024-09-14T11:22:50.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.813+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Bzif7CpmgBuaECI1jiT9CXX8VS8a4tU_0 2024-09-14T11:22:50.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.813+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13510210147865603396', time=2024-09-14T13:15:00.597899+0000, chain.objs.size()=1 2024-09-14T11:22:50.814 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.813+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.ajUo49r0faWOGVxFVRyfPzmlHWcS442_0 2024-09-14T11:22:50.815 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.814+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12733062401654183034', time=2024-09-14T13:15:00.598784+0000, chain.objs.size()=1 2024-09-14T11:22:50.815 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.814+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.anQDOHEBQpTOU7jZhJZrWUXBL8ChrLn_0 2024-09-14T11:22:50.815 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.814+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.668334909723951743', time=2024-09-14T13:15:00.769710+0000, chain.objs.size()=1 2024-09-14T11:22:50.815 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.814+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.FS034ejc0AM2ab-ECoi8yoGxhF3YPJg_0 2024-09-14T11:22:50.815 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.815+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8909804698060893313', time=2024-09-14T13:15:00.800620+0000, chain.objs.size()=1 2024-09-14T11:22:50.815 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.815+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.hR3ivJlBCPa6jhGl0d9qqTYdqQ6zfYT_0 2024-09-14T11:22:50.815 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.815+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.629215712902147982', time=2024-09-14T13:15:00.871296+0000, chain.objs.size()=1 2024-09-14T11:22:50.815 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.815+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.ItCpxVef7Qz8yC0Q22VWmc6zG4g-gPW_0 2024-09-14T11:22:50.815 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.815+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8515416362250802106', time=2024-09-14T13:15:00.905959+0000, chain.objs.size()=1 2024-09-14T11:22:50.815 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.815+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Ler8QOSjHRPT5tnivYa9PFcHG6Rb7N7_0 2024-09-14T11:22:50.815 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.816+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16007558409451487227', time=2024-09-14T13:15:00.914203+0000, chain.objs.size()=1 2024-09-14T11:22:50.815 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.816+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.FTk_rTsOt9U_ytJOSvajt3qjl9_JQBX_0 2024-09-14T11:22:50.815 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.816+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6543416161665568592', time=2024-09-14T13:15:00.925587+0000, chain.objs.size()=1 2024-09-14T11:22:50.815 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.816+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.KDQeLODua8A_GDnflTRsyTHYXnkm6qE_0 2024-09-14T11:22:50.816 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.816+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17277970025166125194', time=2024-09-14T13:15:00.932508+0000, chain.objs.size()=1 2024-09-14T11:22:50.816 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.816+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_._o5AVNRHD0GXyoX5vpbPg6R-ztB3kWl_0 2024-09-14T11:22:50.816 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.816+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17585639316243121041', time=2024-09-14T13:15:05.218115+0000, chain.objs.size()=1 2024-09-14T11:22:50.816 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.816+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.279__shadow_.Z9LGtAJTE-UvOn6SEBc0z_TUwWwyUNj_0 2024-09-14T11:22:50.816 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.816+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15709313181445502095', time=2024-09-14T13:15:11.698460+0000, chain.objs.size()=1 2024-09-14T11:22:50.816 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.816+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.300__shadow_.ZL4y7FwdBo0b-GPC7dFZDQ_t1FFGKQu_0 2024-09-14T11:22:50.816 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.816+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14574014591157784575', time=2024-09-14T13:15:12.488095+0000, chain.objs.size()=1 2024-09-14T11:22:50.816 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.816+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.303__shadow_.yQhNVR4IPMR6dX5miu0iRUNLEmZPGeI_0 2024-09-14T11:22:50.817 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.817+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16008138612533910567', time=2024-09-14T13:15:13.404825+0000, chain.objs.size()=1 2024-09-14T11:22:50.817 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.817+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.306__shadow_.4h3AAeqMQMkztWrR9jzAPFSVgzPhvBF_0 2024-09-14T11:22:50.817 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.817+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17574673470254281311', time=2024-09-14T13:15:24.716269+0000, chain.objs.size()=1 2024-09-14T11:22:50.817 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.817+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.FZaiCVycxz1OeN147XiT2mkbl1KCz08_0 2024-09-14T11:22:50.817 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.817+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14631882834893209705', time=2024-09-14T13:15:24.717089+0000, chain.objs.size()=1 2024-09-14T11:22:50.817 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.818+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.LW--WsmcL4zhvFL3SyvP8JzN2K5Ch4__0 2024-09-14T11:22:50.817 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.818+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14162089171789794303', time=2024-09-14T13:15:24.750049+0000, chain.objs.size()=1 2024-09-14T11:22:50.817 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.818+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.bmBoVtnwa-njn42z48sVSF4L636jpPT_0 2024-09-14T11:22:50.817 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.818+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2429014485779673451', time=2024-09-14T13:15:24.752742+0000, chain.objs.size()=1 2024-09-14T11:22:50.818 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.818+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.6OPJlXIk5DrhowXOE8cbK7E41LoSwiA_0 2024-09-14T11:22:50.818 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.818+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9198439414859021011', time=2024-09-14T13:15:24.898338+0000, chain.objs.size()=1 2024-09-14T11:22:50.818 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.818+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.urjyMXkNZ-tjvOWr5eeCxoNzjw6r_yw_0 2024-09-14T11:22:50.818 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.818+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1967904878566119076', time=2024-09-14T13:15:24.917023+0000, chain.objs.size()=1 2024-09-14T11:22:50.818 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.818+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.PyKd8WUdBfpjlQzwHeNN6A-sCamTb_j_0 2024-09-14T11:22:50.818 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.818+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2926620854604179406', time=2024-09-14T13:15:24.919124+0000, chain.objs.size()=1 2024-09-14T11:22:50.818 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.818+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.exjo3w-JgiI7-xM-sNE6Noc0vun6qk4_0 2024-09-14T11:22:50.818 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.818+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.225209742625196740', time=2024-09-14T13:15:24.927299+0000, chain.objs.size()=1 2024-09-14T11:22:50.818 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.818+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.NtMxvgwUmqSUUC2CqCaH83XkWCEZO1v_0 2024-09-14T11:22:50.818 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.818+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9269283311602391672', time=2024-09-14T13:15:24.954756+0000, chain.objs.size()=1 2024-09-14T11:22:50.818 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.818+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.WRK9Dv0FXQ7KyfU-GBM362pzIU8wp-a_0 2024-09-14T11:22:50.818 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.818+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14497210549574310678', time=2024-09-14T13:15:25.115976+0000, chain.objs.size()=1 2024-09-14T11:22:50.818 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.818+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.gr601OjZzzS-CcdYwqPA99kfU-Rr1Mp_0 2024-09-14T11:22:50.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.820+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13003537923340648032', time=2024-09-14T13:15:25.124269+0000, chain.objs.size()=1 2024-09-14T11:22:50.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.820+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.Dq4KPZG8yeY_pggV0Czl7MCI4p4N-rY_0 2024-09-14T11:22:50.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.820+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6482261597986699084', time=2024-09-14T13:15:25.126723+0000, chain.objs.size()=1 2024-09-14T11:22:50.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.820+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.JNyqPeyFFFzFLV581P7ifu330YH3J8H_0 2024-09-14T11:22:50.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.820+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17608070808886263521', time=2024-09-14T13:15:25.129135+0000, chain.objs.size()=1 2024-09-14T11:22:50.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.820+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.1wEZkNYdQ-ePYQHqaZTkxY51gMiN5VI_0 2024-09-14T11:22:50.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.820+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4355898227305153509', time=2024-09-14T13:15:25.205730+0000, chain.objs.size()=1 2024-09-14T11:22:50.819 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.820+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.JknOowb8JFvNXRBUreSiAc-d7VS2Uk8_0 2024-09-14T11:22:50.820 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.820+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16942778967434410328', time=2024-09-14T13:15:25.207896+0000, chain.objs.size()=1 2024-09-14T11:22:50.820 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.820+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_._C11JAFCcX5BJbeV0w2QD2jxsluL7QT_0 2024-09-14T11:22:50.820 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.820+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5810350094978071859', time=2024-09-14T13:15:25.219411+0000, chain.objs.size()=1 2024-09-14T11:22:50.820 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.820+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.vCJDW4A7TXNlfkCrSv9QIPd1f0P635M_0 2024-09-14T11:22:50.820 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.821+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7043240913490661166', time=2024-09-14T13:15:25.264531+0000, chain.objs.size()=1 2024-09-14T11:22:50.820 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.821+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.gkA0XCo9LPQLUxhukjVIoNwu8u0pexV_0 2024-09-14T11:22:50.820 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.821+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4408166741201536004', time=2024-09-14T13:15:25.368273+0000, chain.objs.size()=1 2024-09-14T11:22:50.821 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.821+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.3WgwyDYSUvYDY7-wpYeuLWlCGlLcIfr_0 2024-09-14T11:22:50.821 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.821+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12757620604798574469', time=2024-09-14T13:15:25.392822+0000, chain.objs.size()=1 2024-09-14T11:22:50.821 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.821+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.cLLu269BYQXDk6xFwHJxLldfGrR_wo6_0 2024-09-14T11:22:50.821 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.821+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.455114799568622459', time=2024-09-14T13:15:25.550331+0000, chain.objs.size()=1 2024-09-14T11:22:50.821 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.821+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.S6PPVWhTjqWxArwIfzxaCMuRdgw6UgY_0 2024-09-14T11:22:50.821 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.821+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13215950846058156429', time=2024-09-14T13:15:25.551066+0000, chain.objs.size()=1 2024-09-14T11:22:50.821 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.821+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.4kcQ0Tf8NzZ6L_KEReJBkNx-kWms7D__0 2024-09-14T11:22:50.821 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.822+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6274475830070525093', time=2024-09-14T13:15:25.560330+0000, chain.objs.size()=1 2024-09-14T11:22:50.821 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.822+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.fayyzCHymbjeQ_4bHhPeGTQPuZFbOAx_0 2024-09-14T11:22:50.822 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.822+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13603684133798992264', time=2024-09-14T13:15:25.581017+0000, chain.objs.size()=1 2024-09-14T11:22:50.822 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.822+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.CrojTvAyBg5G-MF1XjIE6E27OflCpEu_0 2024-09-14T11:22:50.822 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.822+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9727999651968452114', time=2024-09-14T13:15:25.615664+0000, chain.objs.size()=1 2024-09-14T11:22:50.822 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.822+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.cUXkYv9ZleIV8ZENX__bcsPFuRuPPpE_0 2024-09-14T11:22:50.822 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.822+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12277842619378415217', time=2024-09-14T13:15:25.688384+0000, chain.objs.size()=1 2024-09-14T11:22:50.822 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.822+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.ZaP0M0o_PGGz8aLqeWvytLeqgh0LkxJ_0 2024-09-14T11:22:50.822 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.822+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5287136396022801343', time=2024-09-14T13:15:25.701720+0000, chain.objs.size()=1 2024-09-14T11:22:50.822 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.822+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.59CJ5Uy9FkUsGFxD0rdLMaYNBq2bSmG_0 2024-09-14T11:22:50.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.822+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4663736120790248452', time=2024-09-14T13:15:25.737095+0000, chain.objs.size()=1 2024-09-14T11:22:50.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.822+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.Ut1SYoblcXTcdvrRy3DVA1BPX77l1P__0 2024-09-14T11:22:50.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.822+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10111912592238177443', time=2024-09-14T13:15:25.739441+0000, chain.objs.size()=1 2024-09-14T11:22:50.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.822+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.XSAqkccSh_A2PPDnvoh4xSoUeQpAB4M_0 2024-09-14T11:22:50.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.822+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.232291496886979565', time=2024-09-14T13:15:25.776249+0000, chain.objs.size()=1 2024-09-14T11:22:50.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.822+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.mAg-XwqArfZNIQm83z9o1G3FRy13waA_0 2024-09-14T11:22:50.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.823+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5492903726115565733', time=2024-09-14T13:15:25.882951+0000, chain.objs.size()=1 2024-09-14T11:22:50.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.823+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.T-KXWlsPvDbThNK_tARIFmU9DfwLlgj_0 2024-09-14T11:22:50.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.823+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14888205849700946578', time=2024-09-14T13:15:25.883681+0000, chain.objs.size()=1 2024-09-14T11:22:50.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.823+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.iU14COzQ4Jgscn_1IotQP0pMuk_2DPl_0 2024-09-14T11:22:50.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.823+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10943550437269725536', time=2024-09-14T13:15:25.889503+0000, chain.objs.size()=1 2024-09-14T11:22:50.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.823+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.Rke_1Rv-pt7-Cj0BubGGZl1ymNEizFm_0 2024-09-14T11:22:50.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.823+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10645348994650476621', time=2024-09-14T13:15:25.891019+0000, chain.objs.size()=1 2024-09-14T11:22:50.823 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.823+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.cQHb0mPxfW2Bf16Ze8J1tQCBiAKMidy_0 2024-09-14T11:22:50.824 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.824+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.424747176050922045', time=2024-09-14T13:15:25.902124+0000, chain.objs.size()=1 2024-09-14T11:22:50.825 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.824+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.a6G3lxEC5NCw4Ha96o15rXkpi0Wls1o_0 2024-09-14T11:22:50.825 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.824+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15849032279661809847', time=2024-09-14T13:15:25.902938+0000, chain.objs.size()=1 2024-09-14T11:22:50.825 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.824+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.ZZ8kHlYWqMYapxY96JhAltiBYaVUiq4_0 2024-09-14T11:22:50.825 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.824+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11851588005384425792', time=2024-09-14T13:15:33.167849+0000, chain.objs.size()=1 2024-09-14T11:22:50.825 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.824+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.uC0IVUgI2NeA17Yo718f1g5CcS47YC1_0 2024-09-14T11:22:50.825 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.825+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1649524211713978993', time=2024-09-14T13:15:33.180314+0000, chain.objs.size()=1 2024-09-14T11:22:50.825 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.825+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.PLx_6Q4-HYX5veBrhkEhoplnuOSKAtD_0 2024-09-14T11:22:50.825 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.825+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15851667979982960209', time=2024-09-14T13:15:33.192035+0000, chain.objs.size()=1 2024-09-14T11:22:50.825 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.825+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Dcd7AglMlk5M6NuQUOmYM9hfAorV-5h_0 2024-09-14T11:22:50.825 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.825+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6235787554984638024', time=2024-09-14T13:15:33.364053+0000, chain.objs.size()=1 2024-09-14T11:22:50.825 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.825+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.TQN25TaO9idqQFj1Y5h1at5fsOZAeAq_0 2024-09-14T11:22:50.825 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.825+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15317547542841318335', time=2024-09-14T13:15:33.383384+0000, chain.objs.size()=1 2024-09-14T11:22:50.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.825+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.RtcfJUkdD_wPIBjNHnjklvQWvsVKScf_0 2024-09-14T11:22:50.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.825+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2910608691790552400', time=2024-09-14T13:15:33.384140+0000, chain.objs.size()=1 2024-09-14T11:22:50.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.825+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.bcAdS2U-XeSrlvtoylMcGWD1ioZJcAN_0 2024-09-14T11:22:50.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.825+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15097514204028366605', time=2024-09-14T13:15:33.389793+0000, chain.objs.size()=1 2024-09-14T11:22:50.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.825+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.EtlVW0tOpAQvWO2iD__43SCSqRnEwLQ_0 2024-09-14T11:22:50.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.825+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1332355276287512290', time=2024-09-14T13:15:33.415831+0000, chain.objs.size()=1 2024-09-14T11:22:50.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.825+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_._ulbtysxmm4s2poEJ49B1jjD7Cd7bWu_0 2024-09-14T11:22:50.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.825+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5463648389720061628', time=2024-09-14T13:15:33.419694+0000, chain.objs.size()=1 2024-09-14T11:22:50.826 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.825+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.lIfqdHrsueJsTn-c243ghCD9gcdLprH_0 2024-09-14T11:22:50.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.826+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4322167568685343004', time=2024-09-14T13:15:33.446201+0000, chain.objs.size()=1 2024-09-14T11:22:50.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.826+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.XmjCgvgZ3zp-_GNRJhg8jArv7CFGVf2_0 2024-09-14T11:22:50.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.826+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13689855374788981889', time=2024-09-14T13:15:33.554149+0000, chain.objs.size()=1 2024-09-14T11:22:50.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.826+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.iHOOkSxc8fGjs2wlegzVrwzXlFzmuGo_0 2024-09-14T11:22:50.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.826+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8643031776395684025', time=2024-09-14T13:15:33.612060+0000, chain.objs.size()=1 2024-09-14T11:22:50.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.826+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.6MFh7VBUPl4hBIyrBVVzllylEet1U0x_0 2024-09-14T11:22:50.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.827+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7312084843790352689', time=2024-09-14T13:15:33.613530+0000, chain.objs.size()=1 2024-09-14T11:22:50.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.827+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Lpr1U02gyFMSb3ip9116C-c_CxemSJh_0 2024-09-14T11:22:50.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.827+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11448647830992363862', time=2024-09-14T13:15:33.694620+0000, chain.objs.size()=1 2024-09-14T11:22:50.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.827+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.oGCnYoJAIzjIRIbGQyiV1jYyXtWYCqJ_0 2024-09-14T11:22:50.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.827+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15030167754440492918', time=2024-09-14T13:15:33.732969+0000, chain.objs.size()=1 2024-09-14T11:22:50.827 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.827+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.GQ1YIPYpVOtlCFfzJUi6ZTvFJNW0RRn_0 2024-09-14T11:22:50.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.827+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4851618291861672919', time=2024-09-14T13:15:33.756221+0000, chain.objs.size()=1 2024-09-14T11:22:50.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.827+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.WDESJgyEgUbcGJFDVQpHQdSofrPl-1Z_0 2024-09-14T11:22:50.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.827+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4812258038113986296', time=2024-09-14T13:15:33.891702+0000, chain.objs.size()=1 2024-09-14T11:22:50.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.827+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.xezkeuPe3EfgvgR5ENmtycFj0QzreRy_0 2024-09-14T11:22:50.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.827+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11146187317296942000', time=2024-09-14T13:15:33.901547+0000, chain.objs.size()=1 2024-09-14T11:22:50.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.827+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.nE8alaGmMBG4Ed0U_ktmVs6al67UO4b_0 2024-09-14T11:22:50.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.827+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.269894777433927502', time=2024-09-14T13:15:33.915942+0000, chain.objs.size()=1 2024-09-14T11:22:50.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.827+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.jrnCvzEUYq5KiihnfZg9OlUKnCftkYI_0 2024-09-14T11:22:50.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.827+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6853621165442606315', time=2024-09-14T13:15:34.041688+0000, chain.objs.size()=1 2024-09-14T11:22:50.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.827+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.89ERQPZWEOHLfX49muCgRf78Zigaxlz_0 2024-09-14T11:22:50.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.828+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.417973038344062364', time=2024-09-14T13:15:34.073035+0000, chain.objs.size()=1 2024-09-14T11:22:50.828 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.828+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.9XvweHXW0q9jzSPo3t42_0UBwF2aK9b_0 2024-09-14T11:22:50.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.829+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9778070630798628908', time=2024-09-14T13:15:34.096073+0000, chain.objs.size()=1 2024-09-14T11:22:50.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.829+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.oLPeyZaAv5sYCmjyiKKX9f8Arwksn73_0 2024-09-14T11:22:50.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.829+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7048168778485461868', time=2024-09-14T13:15:34.173585+0000, chain.objs.size()=1 2024-09-14T11:22:50.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.829+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.4a1OfiVMKv8mIe4udzqEfN7iDv2lqKC_0 2024-09-14T11:22:50.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.829+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11347201728519326139', time=2024-09-14T13:15:34.197345+0000, chain.objs.size()=1 2024-09-14T11:22:50.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.829+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.5f7gWQWDFk70_m1DMGjCRx8cB8bVwWA_0 2024-09-14T11:22:50.829 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.829+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3377485533878517022', time=2024-09-14T13:15:34.239422+0000, chain.objs.size()=1 2024-09-14T11:22:50.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.829+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.gMWYd2Vv660xJmp9rbDvSmBzBkhsQIt_0 2024-09-14T11:22:50.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.829+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11868384458986043799', time=2024-09-14T13:15:34.253711+0000, chain.objs.size()=1 2024-09-14T11:22:50.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.829+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.lL49FFQXtb_QT1DsFtyn8HNkfAy3mjj_0 2024-09-14T11:22:50.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.830+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3286204270462785070', time=2024-09-14T13:15:34.335543+0000, chain.objs.size()=1 2024-09-14T11:22:50.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.830+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.l1E62NjYqiooZ1jj6YJYjR6-wTsg7jW_0 2024-09-14T11:22:50.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.830+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6516629533808472310', time=2024-09-14T13:15:34.400505+0000, chain.objs.size()=1 2024-09-14T11:22:50.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.830+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.85A-NKd8JoeYBRVb-AIZkWtZlpXm6AF_0 2024-09-14T11:22:50.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.830+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17828528571098761165', time=2024-09-14T13:15:44.346319+0000, chain.objs.size()=1 2024-09-14T11:22:50.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.830+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.370__shadow_.2h3oxYpFbGLf9gj3zDzcq2Mcc3cKBQP_0 2024-09-14T11:22:50.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.830+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13552626015583018189', time=2024-09-14T13:15:47.958573+0000, chain.objs.size()=1 2024-09-14T11:22:50.830 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.830+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.379__shadow_.XYsdi0I4I2wCMIVs8zNrGgj3PPsHRi__0 2024-09-14T11:22:50.831 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.832+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 0/47496 2024-09-14T11:22:50.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.834+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-14T11:22:50.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.834+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16050164620871570481', time=2024-09-14T13:16:13.589727+0000, chain.objs.size()=1 2024-09-14T11:22:50.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.834+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.466__shadow_.fLUvYaA2Fi1fP-yRJYVhRMsyVsow5ok_0 2024-09-14T11:22:50.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.834+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12820472189908019456', time=2024-09-14T13:16:28.028404+0000, chain.objs.size()=1 2024-09-14T11:22:50.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.834+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.518__multipart_mymultipart.2~iWzHEBF1gZEUFQQxbT6anI18eaz9hdU.1 2024-09-14T11:22:50.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.834+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10004085971711311315', time=2024-09-14T13:16:39.204119+0000, chain.objs.size()=1 2024-09-14T11:22:50.833 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.834+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.528__shadow_.qSMat4QDsfcRtv8fQ5D095TS1wOI9-R_0 2024-09-14T11:22:50.834 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.834+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8513540241429946880', time=2024-09-14T13:17:11.653581+0000, chain.objs.size()=1 2024-09-14T11:22:50.834 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.834+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.554__shadow_.FMsATB4kGXf9IXZV7toNql4R_s503SN_0 2024-09-14T11:22:50.834 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.834+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17328063417458546755', time=2024-09-14T13:17:24.426157+0000, chain.objs.size()=1 2024-09-14T11:22:50.834 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.834+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.569__shadow:EM2L-nc.KlNJZmiK8mhHjMiW3-uXVuB_.AA8wM4Ngex_rVfb1sJTW7qtcsluRTFE_0 2024-09-14T11:22:50.834 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.834+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4802752924080878455', time=2024-09-14T13:17:33.774920+0000, chain.objs.size()=1 2024-09-14T11:22:50.834 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.834+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.576__shadow:Kjhuwfw9NgSOK8UQfzXiEMR9KF3U-UE_.1HFya9Z3Yf1LNJ1IIeLlUjOL4nixDZ0_0 2024-09-14T11:22:50.834 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.834+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11314112350042322747', time=2024-09-14T13:17:50.047289+0000, chain.objs.size()=1 2024-09-14T11:22:50.834 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.834+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.579__shadow:ufW7QEJCgqcyOQk-qEZGkW5maW.UvOD_.PoaMBoARb0RpTszkTmF_QkvUirn2eVG_0 2024-09-14T11:22:50.834 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.834+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12393170454693080007', time=2024-09-14T13:17:51.113118+0000, chain.objs.size()=1 2024-09-14T11:22:50.834 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.834+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.580__shadow:uvkV8vyrk1ft.OVxe8Q3wVoKeCgaEU0_.jDhVyFBCwZByM1fMe2IYsh-azj9Bj2h_0 2024-09-14T11:22:50.834 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.834+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14774636739947390122', time=2024-09-14T13:17:55.496544+0000, chain.objs.size()=1 2024-09-14T11:22:50.834 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.834+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.596__shadow_.RuygN1fJp4DCk9o1awjfQT8NCwVHl0p_0 2024-09-14T11:22:50.834 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.834+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14359856600982048924', time=2024-09-14T13:17:58.010563+0000, chain.objs.size()=1 2024-09-14T11:22:50.834 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.834+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.606__shadow_.3Na-7Ymmk4cy4Nk178OCTGLGEdJehmG_0 2024-09-14T11:22:50.835 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.834+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1089918514809856049', time=2024-09-14T13:20:24.235920+0000, chain.objs.size()=1 2024-09-14T11:22:50.835 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.834+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.679__shadow_.5pGGNeER61TJIC9ie2XHZBZ3wxGp3P5_0 2024-09-14T11:22:50.835 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.834+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6084725125297345849', time=2024-09-14T13:20:31.399561+0000, chain.objs.size()=1 2024-09-14T11:22:50.835 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.834+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.707__shadow:mBrvet1IHoOOwugZmcHTF241VMXK8WK_.ASwmcoEf5GMLrFy5vMJulz_LUMAcwuW_0 2024-09-14T11:22:50.835 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.835+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4300255541369328471', time=2024-09-14T13:20:57.383605+0000, chain.objs.size()=1 2024-09-14T11:22:50.835 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.835+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.734__shadow_.8XIPKMOCOC5NJQTnW6PzdEuy_emT9mB_0 2024-09-14T11:22:50.835 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.835+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13666744277709948058', time=2024-09-14T13:21:03.566891+0000, chain.objs.size()=1 2024-09-14T11:22:50.836 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.835+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.748__shadow_.5Baq-S19WnVeltijtfeSTNANvv_u3fj_0 2024-09-14T11:22:50.836 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.835+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.859779603657083636', time=2024-09-14T13:21:16.236042+0000, chain.objs.size()=1 2024-09-14T11:22:50.836 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.835+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.777__shadow_.oPIGn0eBR9wrUQqLktHTjATKdfCTdkD_0 2024-09-14T11:22:50.836 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.837+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:50.838 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.839+0000 7f0f19c16800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:22:50.839 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.840+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:50.839 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.841+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:50.841 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.842+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/69554' 2024-09-14T11:22:50.841 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.842+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14799917068036642308', time=2024-09-14T13:14:48.116842+0000, chain.objs.size()=1 2024-09-14T11:22:50.841 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.842+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.244__shadow_.SvMtzL_kOveK83HkV-SXbIQNNB7jYav_0 2024-09-14T11:22:50.841 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.842+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14315219603610951319', time=2024-09-14T13:14:59.746216+0000, chain.objs.size()=1 2024-09-14T11:22:50.841 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.842+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.RsCLjTtOT_unNL5CEw17rJLdVP15JTr_0 2024-09-14T11:22:50.841 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.842+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15420467412597837657', time=2024-09-14T13:14:59.760001+0000, chain.objs.size()=1 2024-09-14T11:22:50.841 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.842+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.iGoqe4cARZX5DKvYWvWR7_YPDolF4c2_0 2024-09-14T11:22:50.841 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.842+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10085583998310233784', time=2024-09-14T13:14:59.794258+0000, chain.objs.size()=1 2024-09-14T11:22:50.841 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.842+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.GJOZo-eA5KoR1WuK7CVZND2Gi7OIuHp_0 2024-09-14T11:22:50.841 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.842+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18209427339862500318', time=2024-09-14T13:14:59.795555+0000, chain.objs.size()=1 2024-09-14T11:22:50.841 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.842+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.tNVlymLRKld9cQ3Bg9kzPXdCrEOnlVu_0 2024-09-14T11:22:50.841 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.842+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7061407047176287509', time=2024-09-14T13:14:59.806936+0000, chain.objs.size()=1 2024-09-14T11:22:50.842 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.842+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.9qBhozrGiFwadHwN3qeyl6keX1ysgCl_0 2024-09-14T11:22:50.842 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.842+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17128575947778360948', time=2024-09-14T13:14:59.816969+0000, chain.objs.size()=1 2024-09-14T11:22:50.842 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.842+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.s0mJ06FTLXUrTvkffVBKeN7u861PGgh_0 2024-09-14T11:22:50.842 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.842+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4933031676877740846', time=2024-09-14T13:14:59.940052+0000, chain.objs.size()=1 2024-09-14T11:22:50.842 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.842+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.9K_zpQ4P5Y0doMZJL8XKzFUAG_HaApu_0 2024-09-14T11:22:50.842 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.842+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14765181155864713467', time=2024-09-14T13:15:00.062922+0000, chain.objs.size()=1 2024-09-14T11:22:50.842 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.842+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.uhAlM9kWH5ZmP5sarpmIpadhdHlkvvX_0 2024-09-14T11:22:50.842 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.842+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7153103695162175504', time=2024-09-14T13:15:00.137534+0000, chain.objs.size()=1 2024-09-14T11:22:50.842 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.842+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.UhhRJBkLBrbBFLqhVMMUWn2gVYfmZOx_0 2024-09-14T11:22:50.842 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.842+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8365970888734696211', time=2024-09-14T13:15:00.243262+0000, chain.objs.size()=1 2024-09-14T11:22:50.842 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.842+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.ZqsLDmDPJxVUpnxrsTA9niPjagSnEf2_0 2024-09-14T11:22:50.842 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.842+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13976547482004729029', time=2024-09-14T13:15:00.265333+0000, chain.objs.size()=1 2024-09-14T11:22:50.842 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.842+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.ctFIY6WKgk-DyZRQns9hqhKzBKYU1QW_0 2024-09-14T11:22:50.843 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.844+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.453518882459374220', time=2024-09-14T13:15:00.391257+0000, chain.objs.size()=1 2024-09-14T11:22:50.843 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.844+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.EbQREcjiR3WzvAaPJJ2rX7uN4Ah6bJW_0 2024-09-14T11:22:50.844 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.844+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9876067965656471874', time=2024-09-14T13:15:00.392024+0000, chain.objs.size()=1 2024-09-14T11:22:50.844 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.844+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.aewtVgtzuhaI1H9P2RGp6Ib-5X7sq-d_0 2024-09-14T11:22:50.844 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.844+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1391921155638659263', time=2024-09-14T13:15:00.395147+0000, chain.objs.size()=1 2024-09-14T11:22:50.844 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.844+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.hIiPYudM8bHaRoKHDY3C2L9WYPAZIPo_0 2024-09-14T11:22:50.844 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.844+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13794105545913702886', time=2024-09-14T13:15:00.412585+0000, chain.objs.size()=1 2024-09-14T11:22:50.844 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.844+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.ICrd_RkXubYYc_1WxRvCDecyvcB6jI2_0 2024-09-14T11:22:50.844 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.844+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16681828516502779706', time=2024-09-14T13:15:00.459750+0000, chain.objs.size()=1 2024-09-14T11:22:50.844 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.844+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.w2B89bRAvU09acCYo_t61fBDfMEFGJL_0 2024-09-14T11:22:50.844 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.844+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8853194000525789059', time=2024-09-14T13:15:00.477820+0000, chain.objs.size()=1 2024-09-14T11:22:50.844 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.844+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.TKwObyiLpVmWNvkiR-3MclPOf1pZyYs_0 2024-09-14T11:22:50.844 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.844+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14300471253404000655', time=2024-09-14T13:15:00.577732+0000, chain.objs.size()=1 2024-09-14T11:22:50.844 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.844+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.BsmEfvca2RtG1KdbVROfWDFBIZtjxQ4_0 2024-09-14T11:22:50.845 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.844+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15679474345554379295', time=2024-09-14T13:15:00.584797+0000, chain.objs.size()=1 2024-09-14T11:22:50.845 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.844+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.W2QPjqy8YaYxeau4JzJjdZjWw0WqrSo_0 2024-09-14T11:22:50.845 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.844+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5465778242014473322', time=2024-09-14T13:15:00.589415+0000, chain.objs.size()=1 2024-09-14T11:22:50.845 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.844+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.LYmPx7SHuB9GJ2w8OTX8NDXNX9XXWyb_0 2024-09-14T11:22:50.845 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.844+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9767395889233712399', time=2024-09-14T13:15:00.606878+0000, chain.objs.size()=1 2024-09-14T11:22:50.845 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.844+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.ZdDg-9IRW9NmTLIrGRYc0PBZqHbJ3G2_0 2024-09-14T11:22:50.845 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.844+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6435623982750967678', time=2024-09-14T13:15:00.619554+0000, chain.objs.size()=1 2024-09-14T11:22:50.845 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.844+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Wr5OezrQD2OwfRBfkbI0DUWd336A9W8_0 2024-09-14T11:22:50.846 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.846+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11497945138424306546', time=2024-09-14T13:15:00.733740+0000, chain.objs.size()=1 2024-09-14T11:22:50.846 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.846+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.obGRKM36Oyxs-UzMkDAHsBH2wkxzCeD_0 2024-09-14T11:22:50.846 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.846+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17743652317979524083', time=2024-09-14T13:15:00.762830+0000, chain.objs.size()=1 2024-09-14T11:22:50.846 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.846+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.NiIzw-BPWGxHHLdzYKmLEfhkBA4GVYb_0 2024-09-14T11:22:50.846 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.846+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10634462011320772410', time=2024-09-14T13:15:00.769048+0000, chain.objs.size()=1 2024-09-14T11:22:50.846 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.846+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.TJr30Q8uGwOx9vK61_V_kaEAG4ZLCo__0 2024-09-14T11:22:50.846 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.846+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18426968291797032641', time=2024-09-14T13:15:00.795596+0000, chain.objs.size()=1 2024-09-14T11:22:50.846 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.846+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.JKEZDVdHuxVEHHnNqrtHpsB6fUNw9FQ_0 2024-09-14T11:22:50.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.846+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17889637498245503970', time=2024-09-14T13:15:00.797712+0000, chain.objs.size()=1 2024-09-14T11:22:50.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.846+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.lKfSnVfO2rZiMtYj9q74ZWDdsjPxcVs_0 2024-09-14T11:22:50.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.846+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9311417025677771348', time=2024-09-14T13:15:00.889346+0000, chain.objs.size()=1 2024-09-14T11:22:50.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.846+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Xmzq9bPZWGWoEMovMYGtuXKIRpazg0i_0 2024-09-14T11:22:50.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.846+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3696613146485770436', time=2024-09-14T13:15:00.894613+0000, chain.objs.size()=1 2024-09-14T11:22:50.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.846+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.0JvuOnOU4qA4CbdiOKrrNq8CufYOXlE_0 2024-09-14T11:22:50.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.846+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8133885798853773547', time=2024-09-14T13:15:00.901741+0000, chain.objs.size()=1 2024-09-14T11:22:50.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.846+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.tS-4dW3gxZTGTEdbeTR9vqGgXfV7mMd_0 2024-09-14T11:22:50.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.846+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9209884486311466762', time=2024-09-14T13:15:00.924190+0000, chain.objs.size()=1 2024-09-14T11:22:50.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.846+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.-sYGPNo0kXTIPle3UN6EMG40zimB1WY_0 2024-09-14T11:22:50.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.846+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16585489260302297517', time=2024-09-14T13:15:01.434997+0000, chain.objs.size()=1 2024-09-14T11:22:50.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.846+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.264__shadow_.-49CUrk54LZA4rAdbHMSPYbBTvFxx4p_0 2024-09-14T11:22:50.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.846+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3447319012331163075', time=2024-09-14T13:15:01.918824+0000, chain.objs.size()=1 2024-09-14T11:22:50.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.846+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.266__shadow_.vWW1y-HQET6oKY0niCGmlbtRhp4He3Y_0 2024-09-14T11:22:50.847 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.847+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8802535781254204444', time=2024-09-14T13:15:09.247557+0000, chain.objs.size()=1 2024-09-14T11:22:50.848 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.847+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.292__shadow_.riS4mucSkESzVgUHDykph0hTEg4OQhp_0 2024-09-14T11:22:50.849 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.848+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9961797702028312423', time=2024-09-14T13:15:09.248487+0000, chain.objs.size()=1 2024-09-14T11:22:50.849 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.848+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.292__shadow_.yhLDrH72XgT28Y6f-eKQ_m0jt2yKGGi_0 2024-09-14T11:22:50.849 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.848+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4494575701901687723', time=2024-09-14T13:15:09.837109+0000, chain.objs.size()=1 2024-09-14T11:22:50.849 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.848+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.293__shadow_.vxmRn7cQuKkRLEOWT2XG7peEkVOSPBw_0 2024-09-14T11:22:50.849 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.848+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9557279177080707794', time=2024-09-14T13:15:09.837843+0000, chain.objs.size()=1 2024-09-14T11:22:50.849 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.848+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.293__shadow_.RccdpAEvqH6EBBfbWxXQRTZxgCAKVTs_0 2024-09-14T11:22:50.849 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.848+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12220070493468265461', time=2024-09-14T13:15:10.074143+0000, chain.objs.size()=1 2024-09-14T11:22:50.849 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.848+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.294__shadow_.-FhNLRIWWuJQGS-HA-ZcYRjrSvcjF_o_0 2024-09-14T11:22:50.849 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.848+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7230741145163984612', time=2024-09-14T13:15:10.323183+0000, chain.objs.size()=1 2024-09-14T11:22:50.849 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.848+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.295__shadow_.TCnLgR2XL6sPRS82E7GSGpk58A6nkO0_0 2024-09-14T11:22:50.849 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.848+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9365222930853539667', time=2024-09-14T13:15:11.444706+0000, chain.objs.size()=1 2024-09-14T11:22:50.849 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.848+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.299__shadow_.PaCLKXmUakjQG0ODet38XWug78Dqazu_0 2024-09-14T11:22:50.850 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.849+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2801310133650607435', time=2024-09-14T13:15:12.986361+0000, chain.objs.size()=1 2024-09-14T11:22:50.850 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.849+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.305__shadow_.MT_AEqEtQQAON-_X9USHpUHM1S4-9Kf_0 2024-09-14T11:22:50.850 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.849+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1114419469887154604', time=2024-09-14T13:15:24.714969+0000, chain.objs.size()=1 2024-09-14T11:22:50.850 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.849+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.OE4etsv-wtS-WKmrfz0_IOZLD1g2lEF_0 2024-09-14T11:22:50.850 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.849+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10004194555776716354', time=2024-09-14T13:15:24.727800+0000, chain.objs.size()=1 2024-09-14T11:22:50.850 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.849+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.xMsZx7Hz5nnLBac-Qy-qUjNaTvcPRuG_0 2024-09-14T11:22:50.850 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.849+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8354926104924205107', time=2024-09-14T13:15:24.880087+0000, chain.objs.size()=1 2024-09-14T11:22:50.850 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.849+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.oAkV7IP4JmG9ZF-S6TMOdCwQ_EoPSup_0 2024-09-14T11:22:50.850 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.849+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12626833461334437058', time=2024-09-14T13:15:24.881430+0000, chain.objs.size()=1 2024-09-14T11:22:50.850 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.849+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.wlJY-3brSdzHMih_v0z1s7LGTfJEkCR_0 2024-09-14T11:22:50.850 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.850+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3133217276639385283', time=2024-09-14T13:15:24.920702+0000, chain.objs.size()=1 2024-09-14T11:22:50.850 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.850+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.bNmiUD1ndGTYxFM5f-oy__w0xt1t2Xi_0 2024-09-14T11:22:50.851 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.850+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12370200014598716770', time=2024-09-14T13:15:25.045778+0000, chain.objs.size()=1 2024-09-14T11:22:50.851 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.850+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.HqWCfG3OpAtQfQS1OUQ5v45vIzFCiWh_0 2024-09-14T11:22:50.851 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.850+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12704331703914398153', time=2024-09-14T13:15:25.096621+0000, chain.objs.size()=1 2024-09-14T11:22:50.851 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.850+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.AHKf0E15KoQbZKzwHcy9qZ7EGwUzqW5_0 2024-09-14T11:22:50.851 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.851+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17140716717035109638', time=2024-09-14T13:15:25.112852+0000, chain.objs.size()=1 2024-09-14T11:22:50.851 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.851+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.bO4A4knxCf0zfCP7cwFo_-keqGNx-kM_0 2024-09-14T11:22:50.851 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.851+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3613438136782982625', time=2024-09-14T13:15:25.121782+0000, chain.objs.size()=1 2024-09-14T11:22:50.851 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.851+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.zLRQH49kolckWsAzJiQ_A0bXKI5txAj_0 2024-09-14T11:22:50.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.851+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3852978450581985697', time=2024-09-14T13:15:25.208141+0000, chain.objs.size()=1 2024-09-14T11:22:50.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.851+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.c5p4czHULPzBfDNEsZ9yYy0hl9vgWHN_0 2024-09-14T11:22:50.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.851+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7416172062580683240', time=2024-09-14T13:15:25.216075+0000, chain.objs.size()=1 2024-09-14T11:22:50.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.851+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.i8T27-4344c_XS10dfa8XUbtR7l0mnt_0 2024-09-14T11:22:50.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.851+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4968707174185418930', time=2024-09-14T13:15:25.217263+0000, chain.objs.size()=1 2024-09-14T11:22:50.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.851+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.jPhRjD0OsIRZ-WuiUNGyGtAN0hdAUmT_0 2024-09-14T11:22:50.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.851+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1624719490550086329', time=2024-09-14T13:15:25.220190+0000, chain.objs.size()=1 2024-09-14T11:22:50.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.851+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.MeJu3xJZVM6yx2qh0u6qpAQ3X20tSA4_0 2024-09-14T11:22:50.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.851+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9746567619496359264', time=2024-09-14T13:15:25.231543+0000, chain.objs.size()=1 2024-09-14T11:22:50.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.851+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.2fzdEGxqPtV1GiImVRKX5sxnirF4ivP_0 2024-09-14T11:22:50.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.851+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13083740176083652160', time=2024-09-14T13:15:25.263448+0000, chain.objs.size()=1 2024-09-14T11:22:50.852 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.851+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_._U7mZnhQe_hiziUX9b9wACC6aFy8OYm_0 2024-09-14T11:22:50.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.852+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12972886009417961766', time=2024-09-14T13:15:25.264800+0000, chain.objs.size()=1 2024-09-14T11:22:50.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.852+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.rjc2vcoqTTnvbmS2n43VheuEvO-vlVv_0 2024-09-14T11:22:50.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.853+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15097074363723068604', time=2024-09-14T13:15:25.276855+0000, chain.objs.size()=1 2024-09-14T11:22:50.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.853+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.g7zGF9BUV9MkoH0wJBydxxKCM4xsVTs_0 2024-09-14T11:22:50.853 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.853+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6626110193544347122', time=2024-09-14T13:15:25.289055+0000, chain.objs.size()=1 2024-09-14T11:22:50.854 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.853+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.IhWmhEOvzM83ZHXN0gClWjsGxmdWMUR_0 2024-09-14T11:22:50.854 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.853+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8722355239740780146', time=2024-09-14T13:15:25.293423+0000, chain.objs.size()=1 2024-09-14T11:22:50.854 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.853+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.PMH_WwuxqLpKvUbtpOJVq02XREirbMf_0 2024-09-14T11:22:50.854 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.854+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10711172273706964250', time=2024-09-14T13:15:25.399326+0000, chain.objs.size()=1 2024-09-14T11:22:50.854 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.854+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.bfHgTDYg4XT7kNRIXlqD9LnA5LG8iKX_0 2024-09-14T11:22:50.854 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.854+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1976127887583708727', time=2024-09-14T13:15:25.425261+0000, chain.objs.size()=1 2024-09-14T11:22:50.854 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.854+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.Mh4qLqDuNNzz5g3YRzgiodZ6QjCj4OR_0 2024-09-14T11:22:50.854 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.854+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12971994380114828466', time=2024-09-14T13:15:25.452432+0000, chain.objs.size()=1 2024-09-14T11:22:50.854 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.854+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.4WqYrNteiQXxvCrf-rYYx3kb09QHBim_0 2024-09-14T11:22:50.854 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.854+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17241730858382011417', time=2024-09-14T13:15:25.527671+0000, chain.objs.size()=1 2024-09-14T11:22:50.854 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.854+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.TF18rITelmbhfyTVvvzAuos-EwqS_Yk_0 2024-09-14T11:22:50.854 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.854+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4779689215894340975', time=2024-09-14T13:15:25.539783+0000, chain.objs.size()=1 2024-09-14T11:22:50.854 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.854+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.0dJdIx-_9uMC5YcIMSIeedXi7BEI2vr_0 2024-09-14T11:22:50.855 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.854+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11577511542053149198', time=2024-09-14T13:15:25.559195+0000, chain.objs.size()=1 2024-09-14T11:22:50.855 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.854+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.AQUg2UAyRuOUd-GTlRuzkgimDtf4S2r_0 2024-09-14T11:22:50.855 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.854+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3831283898489346021', time=2024-09-14T13:15:25.560032+0000, chain.objs.size()=1 2024-09-14T11:22:50.855 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.854+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.UUT5ckH-yTchY7BxQSXPqUfj2WlRd7d_0 2024-09-14T11:22:50.855 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.854+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11770959596208993373', time=2024-09-14T13:15:25.613036+0000, chain.objs.size()=1 2024-09-14T11:22:50.855 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.854+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.TMs4OA4YeyNRvkvcYdM6_IjpVb1Q59g_0 2024-09-14T11:22:50.856 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.855+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1788612876812267735', time=2024-09-14T13:15:25.702644+0000, chain.objs.size()=1 2024-09-14T11:22:50.856 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.855+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.4Ig6DNEbuALl4uCGoT-Xch1O_WvAM4p_0 2024-09-14T11:22:50.856 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.855+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1797055439833687553', time=2024-09-14T13:15:25.714079+0000, chain.objs.size()=1 2024-09-14T11:22:50.856 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.855+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.IytdZRU57l4IJXr_0dTxV5tyXqx2cBi_0 2024-09-14T11:22:50.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.855+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18384885593742414433', time=2024-09-14T13:15:25.714923+0000, chain.objs.size()=1 2024-09-14T11:22:50.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.855+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.G2seh0SK-JkPo6q30BB_3faDxjnFpmc_0 2024-09-14T11:22:50.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.856+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17233142495112336070', time=2024-09-14T13:15:25.745584+0000, chain.objs.size()=1 2024-09-14T11:22:50.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.856+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.bgOZbHpR7fLVScWAvmvGReksrar2rNq_0 2024-09-14T11:22:50.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.856+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1310522373625688542', time=2024-09-14T13:15:25.759037+0000, chain.objs.size()=1 2024-09-14T11:22:50.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.856+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.sT7oQv0-R6WUnwz0fBaDXoTowQmhqR7_0 2024-09-14T11:22:50.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.856+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12458195703253678341', time=2024-09-14T13:15:25.880332+0000, chain.objs.size()=1 2024-09-14T11:22:50.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.856+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.1JQwuGCeSiHbm2MG4xRdJUqulqmqnjr_0 2024-09-14T11:22:50.857 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.856+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3712704814061168408', time=2024-09-14T13:15:25.921527+0000, chain.objs.size()=1 2024-09-14T11:22:50.858 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.856+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.qZw3TS7kL2coOOZiS7eBm4bmj5EwdnE_0 2024-09-14T11:22:50.858 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.856+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8122955846187505259', time=2024-09-14T13:15:25.947106+0000, chain.objs.size()=1 2024-09-14T11:22:50.858 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.856+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.9ru3QT_RFWgENuUe7aFjYVmonLziJdS_0 2024-09-14T11:22:50.858 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.856+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4276778213858007314', time=2024-09-14T13:15:33.189381+0000, chain.objs.size()=1 2024-09-14T11:22:50.858 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.856+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.-TtYOkf-IUF3pFIfAq2hMabesNaINFo_0 2024-09-14T11:22:50.858 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.856+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11929271545040973992', time=2024-09-14T13:15:33.201560+0000, chain.objs.size()=1 2024-09-14T11:22:50.858 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.856+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.mQNiJFUSy7_wViToyHhJqaC2_bYaJOA_0 2024-09-14T11:22:50.858 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.856+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10116577590292511421', time=2024-09-14T13:15:33.214375+0000, chain.objs.size()=1 2024-09-14T11:22:50.858 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.856+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.rD-QTkTd42cnS7Ppq79zlkQi-iC1z6B_0 2024-09-14T11:22:50.858 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.857+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3059141535596595108', time=2024-09-14T13:15:33.215589+0000, chain.objs.size()=1 2024-09-14T11:22:50.858 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.857+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.n9L2JS3R5M_z4AecjINhZIHhQpWPFXd_0 2024-09-14T11:22:50.858 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.857+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9823308949771604655', time=2024-09-14T13:15:33.219447+0000, chain.objs.size()=1 2024-09-14T11:22:50.858 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.857+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.tPHB4bmtcbZBC2E0-k-IVtVf3cbz_Ws_0 2024-09-14T11:22:50.858 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.857+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7845461053912454730', time=2024-09-14T13:15:33.227697+0000, chain.objs.size()=1 2024-09-14T11:22:50.859 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.857+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.xRT3ceiO1sWC24z2Zjpk_UYJkRLeeiK_0 2024-09-14T11:22:50.860 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.858+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16237133225922734253', time=2024-09-14T13:15:33.392096+0000, chain.objs.size()=1 2024-09-14T11:22:50.860 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.858+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.ZvjXrB3vMAPA5fbnMc2B0tWCEKe6wJ2_0 2024-09-14T11:22:50.860 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.858+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10764333759094246364', time=2024-09-14T13:15:33.408675+0000, chain.objs.size()=1 2024-09-14T11:22:50.860 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.858+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.FuOZ4EAaV1TzO1TNwBphty29TqgjKdv_0 2024-09-14T11:22:50.860 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.858+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12133536786614282619', time=2024-09-14T13:15:33.439336+0000, chain.objs.size()=1 2024-09-14T11:22:50.860 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.858+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.4JkEi7FD_9qP1xhCRNEg9YfuoPyIff6_0 2024-09-14T11:22:50.860 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.858+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4985307530930654889', time=2024-09-14T13:15:33.445256+0000, chain.objs.size()=1 2024-09-14T11:22:50.860 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.858+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.c8dk_Vnzj0-lz50kDKTn4OiFpayCjOw_0 2024-09-14T11:22:50.860 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.858+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10798643409606224717', time=2024-09-14T13:15:33.532248+0000, chain.objs.size()=1 2024-09-14T11:22:50.860 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.858+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.VFqQZyhQBfN1M9AAp0W9J7LGDiuc5Ry_0 2024-09-14T11:22:50.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.858+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4563325798588234847', time=2024-09-14T13:15:33.542954+0000, chain.objs.size()=1 2024-09-14T11:22:50.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.858+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.bAKnXtPcQNKfH2u4h7vSag-ZMS6ezJl_0 2024-09-14T11:22:50.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.858+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11634233621846748750', time=2024-09-14T13:15:33.563497+0000, chain.objs.size()=1 2024-09-14T11:22:50.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.858+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.E2KEZNLLQV3q7cpCOSuTr7oXVfm00gz_0 2024-09-14T11:22:50.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.858+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11760164601061210223', time=2024-09-14T13:15:33.736905+0000, chain.objs.size()=1 2024-09-14T11:22:50.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.858+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.WFP2Wy_7dV2iSfrvorFFpeOYHjX7__K_0 2024-09-14T11:22:50.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.859+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.645381005383093412', time=2024-09-14T13:15:33.746577+0000, chain.objs.size()=1 2024-09-14T11:22:50.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.859+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.B38PHQ9Xu80WY7Dpg_NXHTesZKLTCb6_0 2024-09-14T11:22:50.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.860+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.695111633308958789', time=2024-09-14T13:15:33.751823+0000, chain.objs.size()=1 2024-09-14T11:22:50.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.860+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.cUuwct1IpbUbPBY2tl6pOv6KuI3dsXP_0 2024-09-14T11:22:50.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.860+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6122245179464237771', time=2024-09-14T13:15:33.872094+0000, chain.objs.size()=1 2024-09-14T11:22:50.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.860+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.k70cuJZ1YsBjAOK1aaH7frCn7qlr9Nw_0 2024-09-14T11:22:50.861 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.860+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12737126252054175563', time=2024-09-14T13:15:33.929398+0000, chain.objs.size()=1 2024-09-14T11:22:50.862 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.860+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.IkBYszwS5RDDKbNQViyLbQ09-hSWLMk_0 2024-09-14T11:22:50.862 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.860+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8129418574853675410', time=2024-09-14T13:15:33.940850+0000, chain.objs.size()=1 2024-09-14T11:22:50.862 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.860+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.gE56D-9FTPcyKNogo1RRR-DqljaM_S__0 2024-09-14T11:22:50.862 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.860+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5327167352817001632', time=2024-09-14T13:15:34.014380+0000, chain.objs.size()=1 2024-09-14T11:22:50.862 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.860+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.1G7ZwWkbpAmOdYvGJVAIxmpKEMslCNr_0 2024-09-14T11:22:50.862 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.860+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7513088423020435090', time=2024-09-14T13:15:34.035628+0000, chain.objs.size()=1 2024-09-14T11:22:50.862 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.860+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.dITNAglZzon3VSe2p7IB7x_StTP7qwN_0 2024-09-14T11:22:50.862 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.860+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6887327580929802903', time=2024-09-14T13:15:34.039823+0000, chain.objs.size()=1 2024-09-14T11:22:50.862 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.860+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.kuaaNPxa3wuMtsqhATboh9e3SnvuA58_0 2024-09-14T11:22:50.862 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.861+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4245440592303142271', time=2024-09-14T13:15:34.046956+0000, chain.objs.size()=1 2024-09-14T11:22:50.862 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.861+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.9qo0vlweYEqL8cZT5Wgxx1ZQeZj1C_J_0 2024-09-14T11:22:50.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.863+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 0/69554 2024-09-14T11:22:50.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.866+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=31, truncated=0, next_marker='' 2024-09-14T11:22:50.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.866+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1314418029642684852', time=2024-09-14T13:15:34.058859+0000, chain.objs.size()=1 2024-09-14T11:22:50.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.866+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.J_Wl8ODlRfB3mpA4sGsld_uWeBIJ5PI_0 2024-09-14T11:22:50.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.866+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8017150150289573306', time=2024-09-14T13:15:34.197146+0000, chain.objs.size()=1 2024-09-14T11:22:50.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.866+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.DJ6CYTSgiS8MqtsLWjYGje5sLv5cw0l_0 2024-09-14T11:22:50.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.866+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3700788119296703450', time=2024-09-14T13:15:34.218785+0000, chain.objs.size()=1 2024-09-14T11:22:50.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.866+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.nql7n2yrCtAk7Y_12la3q1fLdvo9L7c_0 2024-09-14T11:22:50.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.866+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8029496250654635138', time=2024-09-14T13:15:34.226096+0000, chain.objs.size()=1 2024-09-14T11:22:50.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.866+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.4szaN0yAEdIMbCj0Z6amNuVk1gPtEPm_0 2024-09-14T11:22:50.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.866+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11874014354763983337', time=2024-09-14T13:15:34.229789+0000, chain.objs.size()=1 2024-09-14T11:22:50.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.866+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.uEIt_arXMInLv5fJ5SD9TCWH11-C638_0 2024-09-14T11:22:50.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.866+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13715888736797131661', time=2024-09-14T13:15:34.236422+0000, chain.objs.size()=1 2024-09-14T11:22:50.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.866+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.AgWUmrhoKA-0bkTq8ww-X9_LEt_EU1t_0 2024-09-14T11:22:50.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.866+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17705222232578117104', time=2024-09-14T13:15:34.261685+0000, chain.objs.size()=1 2024-09-14T11:22:50.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.866+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.z9lM6oUWzZD91vuulF01hsergWjNmnA_0 2024-09-14T11:22:50.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.866+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18110391699273066893', time=2024-09-14T13:16:04.362578+0000, chain.objs.size()=1 2024-09-14T11:22:50.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.866+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.437__shadow_.YLRmTxapokjVLsWLDnayRf_NsSvFaCo_0 2024-09-14T11:22:50.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.866+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11320924792714779395', time=2024-09-14T13:16:04.861333+0000, chain.objs.size()=1 2024-09-14T11:22:50.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.866+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.439__shadow_.gE3_Uj9CfxKEG9aFqYr-P2wfmU_lXud_0 2024-09-14T11:22:50.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.866+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5592960185340400838', time=2024-09-14T13:16:05.848940+0000, chain.objs.size()=1 2024-09-14T11:22:50.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.866+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.442__shadow_.7u5lvXXXfUy_ddY25MIYkBQM1GiJ5H6_0 2024-09-14T11:22:50.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.866+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10346677468477033300', time=2024-09-14T13:16:11.451016+0000, chain.objs.size()=1 2024-09-14T11:22:50.866 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.866+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.460__shadow_.npSZTpLDm1lcCAXoQ_PMgVrBbVbS1Gs_0 2024-09-14T11:22:50.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.866+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13960663825618209543', time=2024-09-14T13:16:13.394985+0000, chain.objs.size()=1 2024-09-14T11:22:50.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.866+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.465__shadow_.AGiRBugdBnLBy0rCnhTgbNACSx46p9a_0 2024-09-14T11:22:50.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.868+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17911251742411203258', time=2024-09-14T13:16:16.119364+0000, chain.objs.size()=1 2024-09-14T11:22:50.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.868+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.481__shadow_.ibq24rVaWcbm9YhEerigFIJ_5GO8N9Z_0 2024-09-14T11:22:50.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.868+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13105615940707034141', time=2024-09-14T13:16:18.678586+0000, chain.objs.size()=1 2024-09-14T11:22:50.868 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.868+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.488__shadow_.QsgrOq5ynpzYVD_LrhgNBKHVJsMdO4N_0 2024-09-14T11:22:50.868 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.868+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16400727839036874775', time=2024-09-14T13:16:31.002971+0000, chain.objs.size()=1 2024-09-14T11:22:50.868 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.868+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.520__shadow:dEgzsRP2q..vEROIsjzwFoveiPgZ6sE_.SlI-nnwJDmXqQ24lopOysa32vsspuxo_0 2024-09-14T11:22:50.868 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.868+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10690895673213515444', time=2024-09-14T13:17:09.890023+0000, chain.objs.size()=1 2024-09-14T11:22:50.868 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.868+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.550__shadow_.oADjq5EmHTHY0pubreYPKoBQEKHDTWQ_0 2024-09-14T11:22:50.868 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.868+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1552348892784584879', time=2024-09-14T13:17:10.271136+0000, chain.objs.size()=1 2024-09-14T11:22:50.868 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.868+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.551__shadow_.KeBtNxAXi61x7COLllOVnNmbNTS-2tP_0 2024-09-14T11:22:50.868 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.868+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10911598916202812324', time=2024-09-14T13:17:12.950775+0000, chain.objs.size()=1 2024-09-14T11:22:50.868 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.868+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.557__shadow_.YDuhyMfUoEWKBdaJZUzCCbUmVYz0jH3_0 2024-09-14T11:22:50.868 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.868+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16289621029680374390', time=2024-09-14T13:17:14.906146+0000, chain.objs.size()=1 2024-09-14T11:22:50.868 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.868+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.561__multipart_mymultipart.JmD0bDwOMcT5gmyjjbsSpWIOSbuTHsiK.1 2024-09-14T11:22:50.869 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.869+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7310997592228437454', time=2024-09-14T13:17:20.154983+0000, chain.objs.size()=1 2024-09-14T11:22:50.869 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.869+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.566__shadow_.Qwxf9OTDPzzJUXENWxI-u1OxQaEK_XD_0 2024-09-14T11:22:50.869 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.869+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2815655896242618289', time=2024-09-14T13:17:31.709067+0000, chain.objs.size()=1 2024-09-14T11:22:50.869 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.869+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.575__shadow:Rn8nqOhCHf-YoapKbt7n-c9e4uWxxfb_.ZN3xsUAYJx5bjeldVJIDjQz9M1cJ62p_0 2024-09-14T11:22:50.869 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.869+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12771348799947780236', time=2024-09-14T13:17:41.040002+0000, chain.objs.size()=1 2024-09-14T11:22:50.870 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.869+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.577__shadow:sdmJ43cBMt4UUkXOUJTUQjNK1c3wdnB_.u4Irme5sVpTR4DPzVvxsU0R9usJ1kld_0 2024-09-14T11:22:50.870 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.869+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13800293632894422514', time=2024-09-14T13:17:48.989509+0000, chain.objs.size()=4 2024-09-14T11:22:50.870 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.869+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.578__multipart_testobj.2~PNlEMi6s0Lm9XhjUhSmy2CrCzTgvqUS.1 2024-09-14T11:22:50.870 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.870+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.578__multipart_testobj.2~PNlEMi6s0Lm9XhjUhSmy2CrCzTgvqUS.2 2024-09-14T11:22:50.870 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.870+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.578__multipart_testobj.2~PNlEMi6s0Lm9XhjUhSmy2CrCzTgvqUS.3 2024-09-14T11:22:50.870 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.870+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.578__multipart_testobj.2~PNlEMi6s0Lm9XhjUhSmy2CrCzTgvqUS.4 2024-09-14T11:22:50.870 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.870+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15054940202967577898', time=2024-09-14T13:17:53.161276+0000, chain.objs.size()=1 2024-09-14T11:22:50.870 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.870+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.586__shadow:LUJwC6SkmYKWzhRM-B9bHnA2Nov16bL_.T9tJC5xSXLtcqRgEmKdeFF9ZguytR5j_0 2024-09-14T11:22:50.870 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.871+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.136596593902452732', time=2024-09-14T13:17:57.773791+0000, chain.objs.size()=1 2024-09-14T11:22:50.870 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.871+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.605__shadow_.7jMFW7S7goFi5O2FzCYCvOfNRQxp0Uh_0 2024-09-14T11:22:50.870 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.871+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10865198116579552299', time=2024-09-14T13:20:08.636356+0000, chain.objs.size()=1 2024-09-14T11:22:50.870 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.871+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.628__shadow_.YBTpIVFBCv4JiD01qnqBc-EDovocJen_0 2024-09-14T11:22:50.871 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.872+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9741789759555717871', time=2024-09-14T13:20:21.234927+0000, chain.objs.size()=1 2024-09-14T11:22:50.871 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.872+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.666__shadow_.m9hO16a1ReSW9dUer5fkzXYux2QosGa_0 2024-09-14T11:22:50.871 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.872+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7960188317102882669', time=2024-09-14T13:20:21.363572+0000, chain.objs.size()=1 2024-09-14T11:22:50.871 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.872+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.666__shadow_.m9hO16a1ReSW9dUer5fkzXYux2QosGa_0 2024-09-14T11:22:50.871 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.872+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9907362899197332183', time=2024-09-14T13:20:29.119116+0000, chain.objs.size()=1 2024-09-14T11:22:50.871 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.872+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.699__shadow:zhf5sTntvkSekoi-e1w9M.KCj.uRTwi_.taj9q-1ubpHH2lUxtUsdOsI0TmXCSiA_0 2024-09-14T11:22:50.871 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.872+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18392660086552859157', time=2024-09-14T13:20:59.223055+0000, chain.objs.size()=1 2024-09-14T11:22:50.871 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.872+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.739__shadow_.UwjC7SpblZ_ul7JTg_pSJl7hg9A2pAG_0 2024-09-14T11:22:50.872 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.872+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2877790613488294663', time=2024-09-14T13:21:07.831724+0000, chain.objs.size()=1 2024-09-14T11:22:50.872 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.872+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.759__shadow_.MEjM92CvEGoKozyidsKx69c-m4hXHDq_0 2024-09-14T11:22:50.872 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.873+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:50.874 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.875+0000 7f0f19c16800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:22:50.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.876+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:50.875 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.877+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:50.877 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.878+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49376' 2024-09-14T11:22:50.877 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.878+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='_vsPz7RVs7hHz5JNqdMVv67N47Sd7SPA', time=2024-09-14T13:13:36.785710+0000, chain.objs.size()=2 2024-09-14T11:22:50.877 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.878+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.161__shadow_.4jiMc7Ul_pXxkH6Z5DR52fam_SyyyZN_0 2024-09-14T11:22:50.877 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.878+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.161__shadow_.4jiMc7Ul_pXxkH6Z5DR52fam_SyyyZN_1 2024-09-14T11:22:50.877 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.878+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.380239432437106410', time=2024-09-14T13:14:48.785263+0000, chain.objs.size()=1 2024-09-14T11:22:50.877 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.878+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.246__shadow_._rN5rdWaGGcFBSKesDhiH0sd695OYEA_0 2024-09-14T11:22:50.877 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.878+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10409756312821933818', time=2024-09-14T13:14:50.601663+0000, chain.objs.size()=1 2024-09-14T11:22:50.878 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.878+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.253__shadow_.-tQvBiyBg378HfmTK-0W_GOLsYHPp1l_0 2024-09-14T11:22:50.878 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.878+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16541671534354086636', time=2024-09-14T13:14:50.852423+0000, chain.objs.size()=1 2024-09-14T11:22:50.878 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.878+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.254__shadow_.q9CemLYr8zE3C-j1g5d43xlmZN_NmLi_0 2024-09-14T11:22:50.878 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.878+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15599813209238053454', time=2024-09-14T13:14:59.734435+0000, chain.objs.size()=1 2024-09-14T11:22:50.878 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.878+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.ksi2zAchop4E7vkc9IEYezn9NH5eRPQ_0 2024-09-14T11:22:50.878 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.878+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15461278876284230761', time=2024-09-14T13:14:59.736615+0000, chain.objs.size()=1 2024-09-14T11:22:50.878 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.878+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Jx6ZRHByZP9VGa8-tTOg57EFaM-b6VA_0 2024-09-14T11:22:50.878 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.878+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12411338733731658897', time=2024-09-14T13:14:59.757851+0000, chain.objs.size()=1 2024-09-14T11:22:50.878 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.878+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.G3saZo4o9tnig7Fom00yDK3DF2qCzNE_0 2024-09-14T11:22:50.878 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.878+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9998594978410189076', time=2024-09-14T13:14:59.920775+0000, chain.objs.size()=1 2024-09-14T11:22:50.878 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.878+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_._HUtEf1yLM5cxtvLBX3HDwRUoTvMvEA_0 2024-09-14T11:22:50.878 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.878+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10651634009064142404', time=2024-09-14T13:14:59.923332+0000, chain.objs.size()=1 2024-09-14T11:22:50.878 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.878+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.XKQI6NCB1BwVNl0VStvMJHgUgNGwpqr_0 2024-09-14T11:22:50.879 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.878+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10252963656135537945', time=2024-09-14T13:14:59.932135+0000, chain.objs.size()=1 2024-09-14T11:22:50.879 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.878+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.sL1VMUBHcfpyOsIH9NASVETum2NJXzh_0 2024-09-14T11:22:50.879 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.878+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5099208974969331713', time=2024-09-14T13:14:59.935302+0000, chain.objs.size()=1 2024-09-14T11:22:50.879 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.878+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.tf-m--HmD1VQv29m6zGOS3HgXMX29Kj_0 2024-09-14T11:22:50.880 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.880+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7621082080427553270', time=2024-09-14T13:14:59.964611+0000, chain.objs.size()=1 2024-09-14T11:22:50.880 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.880+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.ua2T3-ktO2xCyHLTgsdJXeOVteKX4n-_0 2024-09-14T11:22:50.880 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.880+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13862888918119802858', time=2024-09-14T13:15:00.089389+0000, chain.objs.size()=1 2024-09-14T11:22:50.880 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.880+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.365GF_MfPLZCGdwjIETCXTSWEgRT3qC_0 2024-09-14T11:22:50.880 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.880+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13859183066782844500', time=2024-09-14T13:15:00.114375+0000, chain.objs.size()=1 2024-09-14T11:22:50.880 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.880+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Y26APRU8_tUmN60vMnNNRJXFA86ggEq_0 2024-09-14T11:22:50.880 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.880+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9507314301952912824', time=2024-09-14T13:15:00.229201+0000, chain.objs.size()=1 2024-09-14T11:22:50.880 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.880+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.oxGLZG68TBqlnGnPsRclaAtvGMcHcd6_0 2024-09-14T11:22:50.880 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.880+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5159024666605691623', time=2024-09-14T13:15:00.251832+0000, chain.objs.size()=1 2024-09-14T11:22:50.880 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.880+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.bnj_J-EOdf62elOImiWbSZdKixf9OIy_0 2024-09-14T11:22:50.880 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.880+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15335752073835061124', time=2024-09-14T13:15:00.294140+0000, chain.objs.size()=1 2024-09-14T11:22:50.880 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.880+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Q7Dkp4_bnhBWHwQFnceK1ekZlV9rn0M_0 2024-09-14T11:22:50.881 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.880+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8478753568789810478', time=2024-09-14T13:15:00.300944+0000, chain.objs.size()=1 2024-09-14T11:22:50.881 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.880+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Xs6fG40F9ce2tXOjIoeZYT0Ey6y4nI7_0 2024-09-14T11:22:50.881 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.880+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4587761306441727774', time=2024-09-14T13:15:00.391202+0000, chain.objs.size()=1 2024-09-14T11:22:50.881 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.880+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.4sV2MmvHWt6jCrZjHyVcob6PyLINQ9j_0 2024-09-14T11:22:50.881 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.880+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15578608489113773972', time=2024-09-14T13:15:00.393014+0000, chain.objs.size()=1 2024-09-14T11:22:50.881 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.881+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.GiHNmbi6lgFfMsZfGIY4t07c5w3i81S_0 2024-09-14T11:22:50.881 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.881+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8561603640199021247', time=2024-09-14T13:15:00.415410+0000, chain.objs.size()=1 2024-09-14T11:22:50.881 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.881+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.YS7TQayYLV2J6UgFRdWJgvoFJFs6Zyt_0 2024-09-14T11:22:50.881 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.881+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18037662387326880423', time=2024-09-14T13:15:00.418590+0000, chain.objs.size()=1 2024-09-14T11:22:50.881 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.881+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.7RbMKQbQouCWzdySTwg-G5QkdDw5TrF_0 2024-09-14T11:22:50.882 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.882+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12903745020403925064', time=2024-09-14T13:15:00.430013+0000, chain.objs.size()=1 2024-09-14T11:22:50.882 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.882+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.WaZrWvhOw1eimwoo4ccwlfkil1CMFaL_0 2024-09-14T11:22:50.882 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.882+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9161769337076476001', time=2024-09-14T13:15:00.464755+0000, chain.objs.size()=1 2024-09-14T11:22:50.882 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.882+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.pMF5iIQoLmpmIEoNP0i0t1SFM8dgHRp_0 2024-09-14T11:22:50.883 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.882+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14463648257137515826', time=2024-09-14T13:15:00.566665+0000, chain.objs.size()=1 2024-09-14T11:22:50.883 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.882+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.aRKjV_Bf7ZJ9ZuhmDQZm2VfzRIo7a1h_0 2024-09-14T11:22:50.883 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.882+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11399827912911156690', time=2024-09-14T13:15:00.581134+0000, chain.objs.size()=1 2024-09-14T11:22:50.883 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.882+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.imeXJMC1VDal0qvXt21zR22IGWaIt1C_0 2024-09-14T11:22:50.883 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.882+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8744060576580694788', time=2024-09-14T13:15:00.601627+0000, chain.objs.size()=1 2024-09-14T11:22:50.883 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.882+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.fzgk5kvhBjEp7wmkCllEF0VrRaJa7CT_0 2024-09-14T11:22:50.883 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.883+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12940579317546127790', time=2024-09-14T13:15:00.613399+0000, chain.objs.size()=1 2024-09-14T11:22:50.883 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.883+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.1HZNK8dgkcscN1JXXwUkiEItjZQ2wDy_0 2024-09-14T11:22:50.883 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.883+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10591921990159651522', time=2024-09-14T13:15:00.711166+0000, chain.objs.size()=1 2024-09-14T11:22:50.883 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.883+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.dZ9dDGRftCJNHThkxAd-3VEdoRKo2Bn_0 2024-09-14T11:22:50.883 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.883+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.696636886915784257', time=2024-09-14T13:15:00.751281+0000, chain.objs.size()=1 2024-09-14T11:22:50.883 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.883+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.pGPOmisDDQk5JWEuzFtdr6UeVY3pwgg_0 2024-09-14T11:22:50.883 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.883+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8139298103443296960', time=2024-09-14T13:15:00.753558+0000, chain.objs.size()=1 2024-09-14T11:22:50.884 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.883+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Cr5tA402a96gpzNgU7IOYKPQ7j3XP_S_0 2024-09-14T11:22:50.884 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.883+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3384075766089083142', time=2024-09-14T13:15:00.779711+0000, chain.objs.size()=1 2024-09-14T11:22:50.884 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.883+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.7wPQPssWS1uRNLGFG9pmJLU2IUbn5y0_0 2024-09-14T11:22:50.884 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.883+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3177189841665291982', time=2024-09-14T13:15:00.891023+0000, chain.objs.size()=1 2024-09-14T11:22:50.884 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.883+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.PiJt5el8IsugYH_3V5pG1GdM89vbQdo_0 2024-09-14T11:22:50.886 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.884+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9996978067336512309', time=2024-09-14T13:15:06.709969+0000, chain.objs.size()=1 2024-09-14T11:22:50.886 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.885+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.284__shadow_.qm-9TR0kjeJluWSaFTSraETWQD1bl-E_0 2024-09-14T11:22:50.886 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.885+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10551396418913582208', time=2024-09-14T13:15:07.548926+0000, chain.objs.size()=1 2024-09-14T11:22:50.886 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.885+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.287__shadow_.bxBPbrH39WiMzSXtZNblca8WBQC5cZt_0 2024-09-14T11:22:50.886 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.885+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6604386772603117767', time=2024-09-14T13:15:09.244899+0000, chain.objs.size()=1 2024-09-14T11:22:50.886 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.885+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.292__shadow_.imHSsHMOeqJ2oL6T90VH8XI5UbfUD-S_0 2024-09-14T11:22:50.886 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.885+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9127753795341554616', time=2024-09-14T13:15:09.245813+0000, chain.objs.size()=1 2024-09-14T11:22:50.886 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.885+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.292__shadow_.H2PW-PpD8JNkwLsMR6vvICksk8wrxkB_0 2024-09-14T11:22:50.886 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.885+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2143887859149270988', time=2024-09-14T13:15:09.829936+0000, chain.objs.size()=1 2024-09-14T11:22:50.886 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.885+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.293__shadow_.xzA-dGBOkIYGEnKRPClG9fZHUccflSw_0 2024-09-14T11:22:50.886 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.885+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7303687245133417785', time=2024-09-14T13:15:12.236642+0000, chain.objs.size()=1 2024-09-14T11:22:50.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.885+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.302__shadow_.RJ1o1cDdeg7uEQeJbY_VkDyT7lQYNND_0 2024-09-14T11:22:50.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.885+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.896916408450598207', time=2024-09-14T13:15:15.770896+0000, chain.objs.size()=1 2024-09-14T11:22:50.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.885+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.315__shadow_.giWIqvtvcTJPV54TxCuiP8BkU-Ghn0B_0 2024-09-14T11:22:50.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.885+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8998168015170920307', time=2024-09-14T13:15:16.606470+0000, chain.objs.size()=1 2024-09-14T11:22:50.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.885+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.319__shadow:l49O5J8Qif9DWtY361qzORq2iK5p0Mz_.0ljQPN8hGWpL-6XL8c612ggqsGdhtrd_0 2024-09-14T11:22:50.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.885+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10067863215416067840', time=2024-09-14T13:15:24.727583+0000, chain.objs.size()=1 2024-09-14T11:22:50.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.885+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.83sKYw9lIJjVTBocCLpQWAZJDrK5G7n_0 2024-09-14T11:22:50.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.885+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6656430093159463711', time=2024-09-14T13:15:24.753576+0000, chain.objs.size()=1 2024-09-14T11:22:50.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.885+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.YGMn7a9adGmi--zhmZUN3tMj-wgQWZd_0 2024-09-14T11:22:50.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.885+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11716350025496147087', time=2024-09-14T13:15:24.772415+0000, chain.objs.size()=1 2024-09-14T11:22:50.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.885+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.bWxRi13AyhvxZFKHtO-axOtCF5F0rfv_0 2024-09-14T11:22:50.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.887+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16508410744538408431', time=2024-09-14T13:15:24.797477+0000, chain.objs.size()=1 2024-09-14T11:22:50.887 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.887+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.ABsft61UNxcamLzgGcF5IFEaz0W5Ucn_0 2024-09-14T11:22:50.888 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.887+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7796673533023081516', time=2024-09-14T13:15:24.897383+0000, chain.objs.size()=1 2024-09-14T11:22:50.888 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.887+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.TvsxKuZbAeKeZ8I_ky-VEBWiMyo41_U_0 2024-09-14T11:22:50.888 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.887+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5162056645185450881', time=2024-09-14T13:15:24.904585+0000, chain.objs.size()=1 2024-09-14T11:22:50.888 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.887+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.CFCl7hVDnoyU4adnwa_GR1zccfSDK4z_0 2024-09-14T11:22:50.888 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.887+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8745150815315740146', time=2024-09-14T13:15:24.905455+0000, chain.objs.size()=1 2024-09-14T11:22:50.888 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.887+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.uiSuKwNtB_EeJ8HEBB2_cyKubmcmz-X_0 2024-09-14T11:22:50.888 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.887+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16982972739122972071', time=2024-09-14T13:15:24.923372+0000, chain.objs.size()=1 2024-09-14T11:22:50.888 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.887+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.8gUmq09S-Ld-_wSV7yxvt-wUHIQF8Tp_0 2024-09-14T11:22:50.888 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.887+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.531115798390149759', time=2024-09-14T13:15:24.963386+0000, chain.objs.size()=1 2024-09-14T11:22:50.888 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.887+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.gVtsn50VOLQFnsMM_kjN7eVOPhkfmqc_0 2024-09-14T11:22:50.888 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.887+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4684400020842928967', time=2024-09-14T13:15:25.045168+0000, chain.objs.size()=1 2024-09-14T11:22:50.888 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.887+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.eGsvWTCcNzfGq3XWEGjUCoUrbbP5wb4_0 2024-09-14T11:22:50.888 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.887+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9721249701559177766', time=2024-09-14T13:15:25.046670+0000, chain.objs.size()=1 2024-09-14T11:22:50.889 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.887+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.vH4cBAcFc-S74LlpKG77_M7e_siU7iu_0 2024-09-14T11:22:50.890 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.887+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3141043824860827533', time=2024-09-14T13:15:25.078317+0000, chain.objs.size()=1 2024-09-14T11:22:50.890 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.887+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_._wTF1RMDQpSsuQIugcaVbjC6_jC3zii_0 2024-09-14T11:22:50.890 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.888+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17643346946272182654', time=2024-09-14T13:15:25.084264+0000, chain.objs.size()=1 2024-09-14T11:22:50.890 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.888+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.yqt_YkN1wPpL9WvL2NAuQYk-gkXj9o4_0 2024-09-14T11:22:50.890 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.889+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13619286016651056814', time=2024-09-14T13:15:25.127020+0000, chain.objs.size()=1 2024-09-14T11:22:50.890 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.889+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.hElVoMkS6bjHDyHClpVlmrjSoMD_89E_0 2024-09-14T11:22:50.890 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.889+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9772071764377840822', time=2024-09-14T13:15:25.242453+0000, chain.objs.size()=1 2024-09-14T11:22:50.890 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.889+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.SEYX9808kNEFqD1mSVFb1P9enG-qdEl_0 2024-09-14T11:22:50.890 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.889+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13427877063567981006', time=2024-09-14T13:15:25.243657+0000, chain.objs.size()=1 2024-09-14T11:22:50.890 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.889+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.ibnzwVbLByzz68rc1HIXp9IooipiEhY_0 2024-09-14T11:22:50.891 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.889+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2504773895095222351', time=2024-09-14T13:15:25.253330+0000, chain.objs.size()=1 2024-09-14T11:22:50.891 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.889+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.UQhTYMFVUrVpN2Hb7ob1RQu11zbf3xV_0 2024-09-14T11:22:50.891 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.889+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13138963397198494067', time=2024-09-14T13:15:25.264908+0000, chain.objs.size()=1 2024-09-14T11:22:50.891 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.889+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.kzt39D-qObBPxp3Aza6GUgSF6OWoDAx_0 2024-09-14T11:22:50.891 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.889+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1055777329265914187', time=2024-09-14T13:15:25.389609+0000, chain.objs.size()=1 2024-09-14T11:22:50.891 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.889+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.4ZeB17PpADKBXsB3rlykmg6B_h2EM7d_0 2024-09-14T11:22:50.891 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.890+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16321863075346088513', time=2024-09-14T13:15:25.592064+0000, chain.objs.size()=1 2024-09-14T11:22:50.891 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.890+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.wvMZVCCU8L2JwFOwfkJ_CI7w4rLyvUf_0 2024-09-14T11:22:50.891 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.890+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18147491227753718290', time=2024-09-14T13:15:25.595305+0000, chain.objs.size()=1 2024-09-14T11:22:50.891 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.890+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.9PCv4f3xxUeW01OTkZ3nCcfkNU4rZyy_0 2024-09-14T11:22:50.891 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.890+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8979634622400289651', time=2024-09-14T13:15:25.599927+0000, chain.objs.size()=1 2024-09-14T11:22:50.891 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.890+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.M_8iGqLqtX0dw7gteat3ZbVeO2uOEpQ_0 2024-09-14T11:22:50.891 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.890+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2942824763438270682', time=2024-09-14T13:15:25.601785+0000, chain.objs.size()=1 2024-09-14T11:22:50.892 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.890+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.UhkVxvYO64mbwWRFzUlP8BMSoNXqZBQ_0 2024-09-14T11:22:50.892 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.890+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2927884667210855748', time=2024-09-14T13:15:25.690381+0000, chain.objs.size()=1 2024-09-14T11:22:50.892 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.890+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.qNaQiXPQEdEl4R4fug0dVjzXdg_Bval_0 2024-09-14T11:22:50.892 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.890+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2683311694689946480', time=2024-09-14T13:15:25.691165+0000, chain.objs.size()=1 2024-09-14T11:22:50.892 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.890+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.WpIw_dX5spCXFmvj2R68Nl1pLFK2T7D_0 2024-09-14T11:22:50.892 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.890+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5190694957455764508', time=2024-09-14T13:15:25.718307+0000, chain.objs.size()=1 2024-09-14T11:22:50.892 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.890+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.rkoUjD4UIS9cQX4arkRL7Assq1MIAVq_0 2024-09-14T11:22:50.892 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.891+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9266365017401613328', time=2024-09-14T13:15:25.724299+0000, chain.objs.size()=1 2024-09-14T11:22:50.892 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.891+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.u23ZAm38-1bRJF3qvV12gielzc9CxPq_0 2024-09-14T11:22:50.894 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.892+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8796410094194147637', time=2024-09-14T13:15:25.726046+0000, chain.objs.size()=1 2024-09-14T11:22:50.894 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.892+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.z4zfznkl4c-hSoIbyAZeM3LIn8RmE2n_0 2024-09-14T11:22:50.894 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.892+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7177464768502450192', time=2024-09-14T13:15:25.727007+0000, chain.objs.size()=1 2024-09-14T11:22:50.894 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.892+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.eYKadXaWSXnswSJcve58sbNax8XuXMt_0 2024-09-14T11:22:50.894 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.892+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16664157531996635185', time=2024-09-14T13:15:25.755719+0000, chain.objs.size()=1 2024-09-14T11:22:50.894 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.892+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.teyAjr57yRbsvvG1DjS4Y5kFkKDNXrB_0 2024-09-14T11:22:50.894 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.892+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.398843284697599996', time=2024-09-14T13:15:25.774886+0000, chain.objs.size()=1 2024-09-14T11:22:50.894 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.892+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.3BD9CpoMSvsglFBW1Wnv5a2e3PySqhb_0 2024-09-14T11:22:50.894 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.892+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4287600456491538128', time=2024-09-14T13:15:25.889184+0000, chain.objs.size()=1 2024-09-14T11:22:50.894 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.892+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.cGGmJRvZKMcaJzWO0eNHixUpjhvcqD6_0 2024-09-14T11:22:50.894 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.892+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4487928464291579912', time=2024-09-14T13:15:25.933854+0000, chain.objs.size()=1 2024-09-14T11:22:50.894 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.892+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.P2HaUQ7dDfkrtLx5EbHlaT2Z8HR6yEE_0 2024-09-14T11:22:50.895 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.893+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7609135475276778928', time=2024-09-14T13:15:25.944479+0000, chain.objs.size()=1 2024-09-14T11:22:50.895 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.893+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.UI87JYy7VpTMI7s68AX0IXBxI_c1mg3_0 2024-09-14T11:22:50.895 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.893+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6916515782166128516', time=2024-09-14T13:15:33.203421+0000, chain.objs.size()=1 2024-09-14T11:22:50.895 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.893+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.8BNX2PaHiX1c9oPvAuicXDatnyE6XI7_0 2024-09-14T11:22:50.895 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.893+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6674512184414861899', time=2024-09-14T13:15:33.241690+0000, chain.objs.size()=1 2024-09-14T11:22:50.895 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.893+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.-QFWoQRxTFKNO_Q2hwhHJ88GOIcGkCl_0 2024-09-14T11:22:50.895 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.893+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2694679636516122283', time=2024-09-14T13:15:33.245607+0000, chain.objs.size()=1 2024-09-14T11:22:50.895 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.893+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.yD4yqJPtmj1yQn8i41HfI6xwATW1hbO_0 2024-09-14T11:22:50.895 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.893+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16445256510042604895', time=2024-09-14T13:15:33.248797+0000, chain.objs.size()=1 2024-09-14T11:22:50.895 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.893+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.yN8Zbshsfy1PJBy-mc6ikhFRb8lCfXm_0 2024-09-14T11:22:50.895 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.893+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10373661266940738130', time=2024-09-14T13:15:33.363879+0000, chain.objs.size()=1 2024-09-14T11:22:50.895 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.893+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.fCvS2Lbl8zd6JkrcnbGlK9p3rLY-yZi_0 2024-09-14T11:22:50.895 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.894+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8419143766611898296', time=2024-09-14T13:15:33.406127+0000, chain.objs.size()=1 2024-09-14T11:22:50.896 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.894+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.J5OY2dZEmX9XhMvI7Sub-IkcQ8iEx0r_0 2024-09-14T11:22:50.896 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.894+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.650342175962419691', time=2024-09-14T13:15:33.430755+0000, chain.objs.size()=1 2024-09-14T11:22:50.896 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.894+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.iFO-iRa-LPaLAdqOeYG9M_103Tj-b3A_0 2024-09-14T11:22:50.896 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.894+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.975522662479353688', time=2024-09-14T13:15:33.451496+0000, chain.objs.size()=1 2024-09-14T11:22:50.896 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.894+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.kLsKYnjQ-VDhbzPveyqeGMPTMnyAB51_0 2024-09-14T11:22:50.896 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.894+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15594771056416644545', time=2024-09-14T13:15:33.452165+0000, chain.objs.size()=1 2024-09-14T11:22:50.896 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.894+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Eir8nCOPaFP_tiQbxgKT2xjLsqs5Hy__0 2024-09-14T11:22:50.896 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.894+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2928645838008969751', time=2024-09-14T13:15:33.573389+0000, chain.objs.size()=1 2024-09-14T11:22:50.896 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.894+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.YUUWUsvcmJWOOOPY8NqhbeCD05SLvKx_0 2024-09-14T11:22:50.896 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.895+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16452905475009070410', time=2024-09-14T13:15:33.589745+0000, chain.objs.size()=1 2024-09-14T11:22:50.896 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.895+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.xXQtfF3qOrYPII7lpMe9f5by9AMSMgh_0 2024-09-14T11:22:50.896 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.895+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11022582542785828176', time=2024-09-14T13:15:33.704336+0000, chain.objs.size()=1 2024-09-14T11:22:50.896 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.895+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.UVVkCBps60EauBFmoa3-QXzzkHdHOQ9_0 2024-09-14T11:22:50.897 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.895+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14607641323640655792', time=2024-09-14T13:15:33.718970+0000, chain.objs.size()=1 2024-09-14T11:22:50.897 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.895+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.VZhxYHf5XPjldHjrKTZMc-PvD92PR_7_0 2024-09-14T11:22:50.898 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.895+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6500847741958440426', time=2024-09-14T13:15:33.761775+0000, chain.objs.size()=1 2024-09-14T11:22:50.898 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.895+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Y9Z7BZ_2YDXHKZjLrtiuts63O3audGU_0 2024-09-14T11:22:50.898 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.895+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5345735131364885724', time=2024-09-14T13:15:33.880150+0000, chain.objs.size()=1 2024-09-14T11:22:50.898 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.895+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.HslaIeZLQ88lNNuTSU56tDZEAYAj8O0_0 2024-09-14T11:22:50.898 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.896+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18083167589066153198', time=2024-09-14T13:15:33.901537+0000, chain.objs.size()=1 2024-09-14T11:22:50.898 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.896+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.ucJvyDW5Y2rXWXjFzdN77FiDq9khQXk_0 2024-09-14T11:22:50.898 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.896+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2332670423473177448', time=2024-09-14T13:15:33.936144+0000, chain.objs.size()=1 2024-09-14T11:22:50.898 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.896+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.awqx8BoOTCaPc6ANfkyxwK4wHqekqqy_0 2024-09-14T11:22:50.898 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.896+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11256278599459156897', time=2024-09-14T13:15:34.039023+0000, chain.objs.size()=1 2024-09-14T11:22:50.898 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.896+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.MZHFnPJuq6WpzyOFjK2lvNsRGe6j_mv_0 2024-09-14T11:22:50.898 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.896+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7342664593107799537', time=2024-09-14T13:15:34.046876+0000, chain.objs.size()=1 2024-09-14T11:22:50.899 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.896+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.omMfORMt_jd1KdtK17qvywdq4oT0FPC_0 2024-09-14T11:22:50.899 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.896+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5064195545608862588', time=2024-09-14T13:15:34.051866+0000, chain.objs.size()=1 2024-09-14T11:22:50.899 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.896+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.T3ezsPljnLp0hh09V6fqXL3B8xzLcoL_0 2024-09-14T11:22:50.899 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.896+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16437166145685512501', time=2024-09-14T13:15:34.071702+0000, chain.objs.size()=1 2024-09-14T11:22:50.899 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.896+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.fHPgnqVwt1NKMshrtmYwPiI_tBz4JnB_0 2024-09-14T11:22:50.899 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.896+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.809545223664921719', time=2024-09-14T13:15:34.079045+0000, chain.objs.size()=1 2024-09-14T11:22:50.899 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.896+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_._wDkufyZmb5j2s6djJW3a5hikP5Cr7r_0 2024-09-14T11:22:50.899 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.896+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9506669749019415339', time=2024-09-14T13:15:34.196556+0000, chain.objs.size()=1 2024-09-14T11:22:50.899 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.896+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.zRO-3cdcmuxD8Wh4wkBY8oipfV1YRfn_0 2024-09-14T11:22:50.899 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.897+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16387420135213885479', time=2024-09-14T13:15:34.230916+0000, chain.objs.size()=1 2024-09-14T11:22:50.899 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.897+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.iOdl6Yqwn5LTsCm_UiYCJRQfmzGMvjX_0 2024-09-14T11:22:50.899 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.898+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5235921097953654486', time=2024-09-14T13:15:34.246208+0000, chain.objs.size()=1 2024-09-14T11:22:50.899 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.898+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.v52NYNfBlL0ui4uuUItdra-WUsR_S3z_0 2024-09-14T11:22:50.900 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.900+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 0/49376 2024-09-14T11:22:50.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.902+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-14T11:22:50.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.902+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1738504890106767586', time=2024-09-14T13:15:34.332740+0000, chain.objs.size()=1 2024-09-14T11:22:50.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.902+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.A_JI0gXsPBTCY66yDsEogFQkLMJfZBG_0 2024-09-14T11:22:50.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.902+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8804184398024569303', time=2024-09-14T13:15:34.349529+0000, chain.objs.size()=1 2024-09-14T11:22:50.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.902+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.9KwLbF87aCzkYFPpCL6Dx4Lfcqy7Un2_0 2024-09-14T11:22:50.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.902+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6969316425199793493', time=2024-09-14T13:15:34.371937+0000, chain.objs.size()=1 2024-09-14T11:22:50.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.902+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.KQ1_Qzq6pKWZpuJ8d3JHHC8Z-bja_AR_0 2024-09-14T11:22:50.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.902+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7991536225184917582', time=2024-09-14T13:15:34.401899+0000, chain.objs.size()=1 2024-09-14T11:22:50.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.902+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.L5HW51GqJuIOd_tnyesDfTyIYNjO6T6_0 2024-09-14T11:22:50.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.902+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.491466394443968951', time=2024-09-14T13:15:57.031163+0000, chain.objs.size()=1 2024-09-14T11:22:50.901 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.902+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.408__shadow_.uk6QYby3vr4Wvp-Fb3SuB176lVqRlAr_0 2024-09-14T11:22:50.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.902+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2469809162455025454', time=2024-09-14T13:17:24.855353+0000, chain.objs.size()=1 2024-09-14T11:22:50.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.902+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.569__shadow:MnV0u.MM2Q5bGSU0EImFPXyuT9.Otrv_.ToVIMrJnFq3jhaJ6bzDihn_q-rlG99X_0 2024-09-14T11:22:50.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.902+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9708345113636256524', time=2024-09-14T13:17:38.107524+0000, chain.objs.size()=1 2024-09-14T11:22:50.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.902+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.577__shadow:-.7Wmv6oU0ITj5y5CvrXNs.TZItbVM4_.Smo361SyVkzZ6RVOkhGtYzTRKnAHfrn_0 2024-09-14T11:22:50.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.902+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2319309508883963718', time=2024-09-14T13:17:41.565596+0000, chain.objs.size()=1 2024-09-14T11:22:50.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.902+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.577__shadow:Jvfl5OCU6V1FJaEMyTndXR6HzIMXqwd_.uMMz-77Z0n1NGbJUYR3hc5q0cf2Lt6m_0 2024-09-14T11:22:50.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.902+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10387967831206980375', time=2024-09-14T13:17:51.016712+0000, chain.objs.size()=1 2024-09-14T11:22:50.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.902+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.580__shadow:UZ6rciVk4cz13HLmBI9-ugt.Iy9SsZK_.29wENJWWqKHn7sxPxs2aoUoI3ZIgXOr_0 2024-09-14T11:22:50.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.902+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.232683467259696549', time=2024-09-14T13:17:53.395277+0000, chain.objs.size()=1 2024-09-14T11:22:50.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.902+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.587__shadow:aqPpf0UKYl3Y8KxVMAljtByqNHPS5Dl_._8JZsmUYQMaW9GyG-VQESxLE5LuMxob_0 2024-09-14T11:22:50.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.902+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4386781770626717161', time=2024-09-14T13:17:53.440172+0000, chain.objs.size()=1 2024-09-14T11:22:50.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.902+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.587__shadow:zfNv0ezKqqK55vx43kX3CT8-gZpzAlk_.ufez6uBEApUdOwXF1L6SJvOKW0diEgv_0 2024-09-14T11:22:50.902 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.902+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5410792502237260032', time=2024-09-14T13:18:03.271295+0000, chain.objs.size()=1 2024-09-14T11:22:50.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.902+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.616__shadow_.o_0cK47fDf11vF_kXWyZ9OPhhGr8mI1_0 2024-09-14T11:22:50.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.903+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2148354827596815218', time=2024-09-14T13:20:09.698447+0000, chain.objs.size()=1 2024-09-14T11:22:50.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.903+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.632__shadow_.MU9mXTj4LNDnzhXdBsxZMburGH9LkJ8_0 2024-09-14T11:22:50.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.903+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13406426448199298053', time=2024-09-14T13:20:27.544531+0000, chain.objs.size()=1 2024-09-14T11:22:50.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.903+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.693__shadow:MiQ.7FyX8m85K5-tZ26.5jg.BzxJBZd_.SpMbppcy3nilxU63SpAZ_nWget0zr9C_0 2024-09-14T11:22:50.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.903+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6367002355984020373', time=2024-09-14T13:21:07.377075+0000, chain.objs.size()=1 2024-09-14T11:22:50.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.903+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.758__shadow_.XDdXyx47igyAk93JWjCK_kvT745VapA_0 2024-09-14T11:22:50.903 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.905+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:50.905 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.907+0000 7f0f19c16800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:22:50.906 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.908+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:50.907 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.908+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:50.908 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.909+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45998' 2024-09-14T11:22:50.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.909+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14802288460444521983', time=2024-09-14T13:13:38.638541+0000, chain.objs.size()=1 2024-09-14T11:22:50.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.909+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.170__shadow_.oq5BEZDplI8tKNYsIxaObwtdCHwaeCE_0 2024-09-14T11:22:50.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.909+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2744670511431901724', time=2024-09-14T13:14:45.627745+0000, chain.objs.size()=1 2024-09-14T11:22:50.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.909+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.235__shadow_.Fu8L73SNifBz4M0a9JC5VG1e5sUsJAO_0 2024-09-14T11:22:50.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.909+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10294457387158384120', time=2024-09-14T13:14:45.911037+0000, chain.objs.size()=1 2024-09-14T11:22:50.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.909+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.236__shadow_.u1V6I13tkrp2acBac6WAuuM8EMzm4Hg_0 2024-09-14T11:22:50.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.909+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9947169807269254176', time=2024-09-14T13:14:46.968790+0000, chain.objs.size()=1 2024-09-14T11:22:50.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.909+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.240__shadow_.tppNggSgPzK9xjtYTGExiAfyZLBGsnr_0 2024-09-14T11:22:50.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.909+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17964896726788009669', time=2024-09-14T13:14:48.114996+0000, chain.objs.size()=1 2024-09-14T11:22:50.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.909+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.244__shadow_.LDBr6_O7rYsUiLc4_sp6N3Xp8-AbCjS_0 2024-09-14T11:22:50.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.909+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.444667366631671900', time=2024-09-14T13:14:59.736054+0000, chain.objs.size()=1 2024-09-14T11:22:50.909 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.909+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.IE1SL3of2M7UJ1ySiixEtvu9xInOGci_0 2024-09-14T11:22:50.910 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.909+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13573628104007053950', time=2024-09-14T13:14:59.759678+0000, chain.objs.size()=1 2024-09-14T11:22:50.910 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.909+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.WCQA4MAxNi8xQ-7e38_jjFEq08PGGzN_0 2024-09-14T11:22:50.910 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.909+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8597290643814126505', time=2024-09-14T13:14:59.767853+0000, chain.objs.size()=1 2024-09-14T11:22:50.910 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.909+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Hv5HZoF3N-OK2Ss5aKw6MUi8ECQkQyX_0 2024-09-14T11:22:50.910 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.909+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8843290166526040455', time=2024-09-14T13:14:59.820174+0000, chain.objs.size()=1 2024-09-14T11:22:50.910 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.909+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.r_0w6d3vPLAPDup7IYaIZ9ki5Gip0dI_0 2024-09-14T11:22:50.910 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.909+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9747697103802183197', time=2024-09-14T13:14:59.911827+0000, chain.objs.size()=1 2024-09-14T11:22:50.910 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.909+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.R3mKvT4jmtt1XWWo0fMp-7pHRW3TKH1_0 2024-09-14T11:22:50.910 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.910+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10895821573973735862', time=2024-09-14T13:14:59.925298+0000, chain.objs.size()=1 2024-09-14T11:22:50.910 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.910+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.sI3yclTU6yAhC7Yc5loyNPiU_ugKt8I_0 2024-09-14T11:22:50.910 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.910+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17094702845453486147', time=2024-09-14T13:14:59.967823+0000, chain.objs.size()=1 2024-09-14T11:22:50.910 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.910+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.RSAURG80JaRJ1SGZENmKza0LH62QB6h_0 2024-09-14T11:22:50.911 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.911+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12598739486741498024', time=2024-09-14T13:14:59.976223+0000, chain.objs.size()=1 2024-09-14T11:22:50.911 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.911+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.5Ume08a7O3a9_L_4tYnJMTXDJcrvXVx_0 2024-09-14T11:22:50.911 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.911+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2539805550292052893', time=2024-09-14T13:15:00.079341+0000, chain.objs.size()=1 2024-09-14T11:22:50.911 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.911+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Ye9XvnQhmriQxLdozfSCDAlspRyyo8u_0 2024-09-14T11:22:50.911 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.911+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17623741261427792361', time=2024-09-14T13:15:00.083618+0000, chain.objs.size()=1 2024-09-14T11:22:50.911 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.911+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.hBCFIdlOEwPrlgGa411PMkggAeXpZw4_0 2024-09-14T11:22:50.911 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.911+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6905346924369464884', time=2024-09-14T13:15:00.130185+0000, chain.objs.size()=1 2024-09-14T11:22:50.911 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.911+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.6GTGTDdBrcJkpe9um-5CTaoq826CL8H_0 2024-09-14T11:22:50.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.912+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3662003286147931336', time=2024-09-14T13:15:00.146305+0000, chain.objs.size()=1 2024-09-14T11:22:50.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.912+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.jmNmmGX7dMWtIB1VS9_qZcAddkDDMk3_0 2024-09-14T11:22:50.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.912+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16687025555646877593', time=2024-09-14T13:15:00.238112+0000, chain.objs.size()=1 2024-09-14T11:22:50.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.912+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.dpFJ9sEQq_0JiVjKr0HuTyr7O6IP0ts_0 2024-09-14T11:22:50.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.912+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13590391612804222484', time=2024-09-14T13:15:00.276474+0000, chain.objs.size()=1 2024-09-14T11:22:50.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.912+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Y10beePnaGEnlKR1sWLc4TEVGcnQXtm_0 2024-09-14T11:22:50.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.912+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8419884336438149864', time=2024-09-14T13:15:00.299987+0000, chain.objs.size()=1 2024-09-14T11:22:50.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.912+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.e0EPx3vH-51gaOGic1eVR16G8eUSulX_0 2024-09-14T11:22:50.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.912+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17525549612138943337', time=2024-09-14T13:15:00.308128+0000, chain.objs.size()=1 2024-09-14T11:22:50.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.912+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.ZWbniAcajYPwZU5bdgUme9k67JFQCLM_0 2024-09-14T11:22:50.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.912+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6420493336660840795', time=2024-09-14T13:15:00.413554+0000, chain.objs.size()=1 2024-09-14T11:22:50.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.912+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.th0a61qMv524lilTgDzSqhR-oC-Hh6Y_0 2024-09-14T11:22:50.912 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.912+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10188663045095330372', time=2024-09-14T13:15:00.437678+0000, chain.objs.size()=1 2024-09-14T11:22:50.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.912+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.IRQk3y2UjcxWDx4VTptX2SpBR4YaXNi_0 2024-09-14T11:22:50.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.914+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11330186186921476266', time=2024-09-14T13:15:00.441239+0000, chain.objs.size()=1 2024-09-14T11:22:50.913 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.914+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.jUoXuixWscVmoIVhNqOG1A495aIZzRV_0 2024-09-14T11:22:50.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.914+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6354586491919208771', time=2024-09-14T13:15:00.565740+0000, chain.objs.size()=1 2024-09-14T11:22:50.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.914+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.icUc3uixe5SivSkv9vg_gKb5vk27MT7_0 2024-09-14T11:22:50.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.914+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8325024072389751423', time=2024-09-14T13:15:00.573053+0000, chain.objs.size()=1 2024-09-14T11:22:50.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.915+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.OJ9CtSEVTd7IPbu7DpdugeYavDzsIiq_0 2024-09-14T11:22:50.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.915+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16915453482321129121', time=2024-09-14T13:15:00.579979+0000, chain.objs.size()=1 2024-09-14T11:22:50.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.915+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.HWMY_HR9fDinmIEDa4z_voE9eROtaWS_0 2024-09-14T11:22:50.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.915+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8996169332204177853', time=2024-09-14T13:15:00.708965+0000, chain.objs.size()=1 2024-09-14T11:22:50.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.915+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.9Kcg_vAUPsESOpiRzL-TanCtWTk1Xyy_0 2024-09-14T11:22:50.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.915+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1407615035262629880', time=2024-09-14T13:15:00.739317+0000, chain.objs.size()=1 2024-09-14T11:22:50.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.915+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.lp4XzhCO9z0g3kZyeIVJ9cDBbW8sWC8_0 2024-09-14T11:22:50.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.915+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8443782629873287605', time=2024-09-14T13:15:00.745001+0000, chain.objs.size()=1 2024-09-14T11:22:50.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.915+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.JIy-QJEmZdTe1NWvjLU47n_dTvOQLNi_0 2024-09-14T11:22:50.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.915+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7842722567777122429', time=2024-09-14T13:15:00.752201+0000, chain.objs.size()=1 2024-09-14T11:22:50.914 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.915+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.QkKdWbxFN_8rVONHtEqBgJETUlPVBeg_0 2024-09-14T11:22:50.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.915+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7005805354876609788', time=2024-09-14T13:15:00.767357+0000, chain.objs.size()=1 2024-09-14T11:22:50.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.915+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.6hC7a5d2iBwvqn9fPRdYSPB7hn5_Osd_0 2024-09-14T11:22:50.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.915+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4604735667570890919', time=2024-09-14T13:15:00.910559+0000, chain.objs.size()=1 2024-09-14T11:22:50.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.915+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.xXXtcfmQSNuPnxVQ95CycqDNaBKrYaD_0 2024-09-14T11:22:50.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.915+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8172463707448879587', time=2024-09-14T13:15:00.929756+0000, chain.objs.size()=1 2024-09-14T11:22:50.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.915+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.TWed7IszV9kJ9BZtLH4euiNoRcBrIDc_0 2024-09-14T11:22:50.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.916+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4363163124700585886', time=2024-09-14T13:15:00.939219+0000, chain.objs.size()=1 2024-09-14T11:22:50.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.916+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.kIb0nz-_1P_gmU5EPFMr47gDYTMSbPI_0 2024-09-14T11:22:50.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.917+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14861723234892996500', time=2024-09-14T13:15:02.648414+0000, chain.objs.size()=1 2024-09-14T11:22:50.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.917+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.269__shadow_.uXsOrVzP2NTTXcDE2idtEzcmB_OTSKN_0 2024-09-14T11:22:50.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.917+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17382628880659572068', time=2024-09-14T13:15:07.297832+0000, chain.objs.size()=1 2024-09-14T11:22:50.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.917+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.286__shadow_.-omwGHlPvzcEaWzB3c7In3s7x9TK5UR_0 2024-09-14T11:22:50.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.917+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17082561092641529983', time=2024-09-14T13:15:08.048033+0000, chain.objs.size()=1 2024-09-14T11:22:50.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.917+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.289__shadow_.POT1IckloI-LLJL-BEtmxYeRKMOZJKX_0 2024-09-14T11:22:50.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.917+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9361831108507857111', time=2024-09-14T13:15:12.986028+0000, chain.objs.size()=1 2024-09-14T11:22:50.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.917+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.305__shadow_._qCWmAmkJVZHQPvDaFgC8pVLHzKj8O1_0 2024-09-14T11:22:50.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.917+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11350720985689390168', time=2024-09-14T13:15:12.986911+0000, chain.objs.size()=1 2024-09-14T11:22:50.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.917+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.305__shadow_.rUsWjr7pr1M8NkARsy3Tk3UxxYfi24q_0 2024-09-14T11:22:50.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.917+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7273441032701344985', time=2024-09-14T13:15:13.917499+0000, chain.objs.size()=1 2024-09-14T11:22:50.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.917+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.307__shadow:J3wJVDcSsF1H6MIbC5gwif14jR5k9hs_.5VOwA37qe9gQn3zEQhpD8fg_XJHPQaj_0 2024-09-14T11:22:50.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.917+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3678170908666868271', time=2024-09-14T13:15:24.727452+0000, chain.objs.size()=1 2024-09-14T11:22:50.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.917+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.uEFkJGPnTctwzwjAMebgPPCwO9YaMxT_0 2024-09-14T11:22:50.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.917+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2168916622592940589', time=2024-09-14T13:15:24.752402+0000, chain.objs.size()=1 2024-09-14T11:22:50.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.917+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.-wjTw8sk8iIjVTO4XpS29dci8HsB2-j_0 2024-09-14T11:22:50.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.917+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5071592116994570660', time=2024-09-14T13:15:24.775855+0000, chain.objs.size()=1 2024-09-14T11:22:50.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.917+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.tRg1F-GaqXOVhUoPhEb0O1cHvz0SIkB_0 2024-09-14T11:22:50.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.917+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2130882785385136164', time=2024-09-14T13:15:24.776990+0000, chain.objs.size()=1 2024-09-14T11:22:50.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.917+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.zmL37p6Wz3AmfZuaWLAEso4fqFUnPUG_0 2024-09-14T11:22:50.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.917+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9444055615182575821', time=2024-09-14T13:15:24.883281+0000, chain.objs.size()=1 2024-09-14T11:22:50.920 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.917+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.vzkeLVBz0TywTgkUKDgH0Gwrs3EQZv9_0 2024-09-14T11:22:50.922 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.918+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14096209434946397304', time=2024-09-14T13:15:24.883978+0000, chain.objs.size()=1 2024-09-14T11:22:50.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.918+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.i5MynYKGJw9vgBlrn-iRvru-1CycIa9_0 2024-09-14T11:22:50.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.919+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3602137201265941328', time=2024-09-14T13:15:24.917150+0000, chain.objs.size()=1 2024-09-14T11:22:50.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.919+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.uyNSs2A7CZ_bQIRL5MuzRwd1Hi_9T26_0 2024-09-14T11:22:50.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.919+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11667931951994739793', time=2024-09-14T13:15:25.048332+0000, chain.objs.size()=1 2024-09-14T11:22:50.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.919+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.E-j6MAVwwqzJDdJZDQxfAA9QABdfY99_0 2024-09-14T11:22:50.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.919+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6162120489720588720', time=2024-09-14T13:15:25.066675+0000, chain.objs.size()=1 2024-09-14T11:22:50.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.919+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.lkUd9lNWxj8SPEsiLY-cJhEajQptikm_0 2024-09-14T11:22:50.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.919+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1163171271401493069', time=2024-09-14T13:15:25.082537+0000, chain.objs.size()=1 2024-09-14T11:22:50.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.919+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.u4auHPRjTo3WZpueTF-vRrUQUG-1rhU_0 2024-09-14T11:22:50.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.919+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16011282314824753956', time=2024-09-14T13:15:25.119320+0000, chain.objs.size()=1 2024-09-14T11:22:50.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.919+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.GWRfOseEG8EkG2ILFGcKtTcmg4P8y8X_0 2024-09-14T11:22:50.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.919+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5315788583293541803', time=2024-09-14T13:15:25.214557+0000, chain.objs.size()=1 2024-09-14T11:22:50.923 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.919+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.A9eGjLebsHRDBy79qWvoj8WwXiNYFVO_0 2024-09-14T11:22:50.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.919+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11238653620855216995', time=2024-09-14T13:15:25.223591+0000, chain.objs.size()=1 2024-09-14T11:22:50.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.919+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.qchH-itsdtK1SiAd1zaPYiT0kvanzwQ_0 2024-09-14T11:22:50.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.919+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4413178723789080716', time=2024-09-14T13:15:25.278019+0000, chain.objs.size()=1 2024-09-14T11:22:50.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.919+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.iGqJSxHD3hSzOKuQvb3AldDuN6MRglW_0 2024-09-14T11:22:50.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.919+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9067580989412347171', time=2024-09-14T13:15:25.278967+0000, chain.objs.size()=1 2024-09-14T11:22:50.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.919+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.9OzeFdx9c6DNo9_kmBOHgc8TElXbOnY_0 2024-09-14T11:22:50.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.919+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.884648797079593072', time=2024-09-14T13:15:25.384256+0000, chain.objs.size()=1 2024-09-14T11:22:50.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.919+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.LIkuwP-Qn4be4YDCqmqYclL56KSRw91_0 2024-09-14T11:22:50.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.920+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16528768947901587590', time=2024-09-14T13:15:25.388511+0000, chain.objs.size()=1 2024-09-14T11:22:50.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.920+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.vLwePW7GPpy542k4KxfzSD2zq9uaOqp_0 2024-09-14T11:22:50.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.920+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16496412051764146574', time=2024-09-14T13:15:25.396181+0000, chain.objs.size()=1 2024-09-14T11:22:50.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.920+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.DicgcUXKPXtuB-kIQmsAiVAY_w9_1Fa_0 2024-09-14T11:22:50.924 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.921+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7835066110181576397', time=2024-09-14T13:15:25.398200+0000, chain.objs.size()=1 2024-09-14T11:22:50.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.921+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.zWxBS9C7Uwohp8IJlWlO8ZgVBXYVlkd_0 2024-09-14T11:22:50.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.921+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.904800331441643258', time=2024-09-14T13:15:25.400102+0000, chain.objs.size()=1 2024-09-14T11:22:50.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.921+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.bW5chkSI2U9b5AI2DSXxGfX1BgdKBe__0 2024-09-14T11:22:50.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.921+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.705301709791605022', time=2024-09-14T13:15:25.551743+0000, chain.objs.size()=1 2024-09-14T11:22:50.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.921+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.9ijryzxL0zgMkUaohjBbaqcLtEak6c1_0 2024-09-14T11:22:50.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.921+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2792981821948288123', time=2024-09-14T13:15:25.611696+0000, chain.objs.size()=1 2024-09-14T11:22:50.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.921+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.G-FtS3_4wt_rDXlzXwJyYzNgLbAyzpG_0 2024-09-14T11:22:50.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.921+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16287435198491654345', time=2024-09-14T13:15:25.697854+0000, chain.objs.size()=1 2024-09-14T11:22:50.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.921+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.WBlA0-iSrL-T5nWXDRHeAparFBzDugs_0 2024-09-14T11:22:50.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.921+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16036024580232972021', time=2024-09-14T13:15:25.698800+0000, chain.objs.size()=1 2024-09-14T11:22:50.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.921+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.2LjFfdyKL5FTkTvVKNisDId-rmjw0kZ_0 2024-09-14T11:22:50.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.921+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16743039763456106149', time=2024-09-14T13:15:25.733001+0000, chain.objs.size()=1 2024-09-14T11:22:50.925 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.921+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.wEXHUt2aLoMbMZFJ5I3ddCka3mcureY_0 2024-09-14T11:22:50.926 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.921+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3966162264394249899', time=2024-09-14T13:15:25.880048+0000, chain.objs.size()=1 2024-09-14T11:22:50.926 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.921+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.u1zCTfoGlHsUTUJhduXtCEQNZ7asakT_0 2024-09-14T11:22:50.926 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.921+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2973528161536817170', time=2024-09-14T13:15:25.905197+0000, chain.objs.size()=1 2024-09-14T11:22:50.926 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.921+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.mEnAOvp36mluAnTdYt6feQUcAZ2uDTA_0 2024-09-14T11:22:50.926 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.922+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18050687746380277479', time=2024-09-14T13:15:25.945854+0000, chain.objs.size()=1 2024-09-14T11:22:50.926 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.922+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.TzDBPCRsKlmru0kjRYVUYraEeFcBoMF_0 2024-09-14T11:22:50.926 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.923+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18212593885115645462', time=2024-09-14T13:15:33.203573+0000, chain.objs.size()=1 2024-09-14T11:22:50.926 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.923+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_._FlrvlL5VxY_a6PD-ye-iSvT8vcefDZ_0 2024-09-14T11:22:50.926 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.923+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1911153629273883231', time=2024-09-14T13:15:33.375728+0000, chain.objs.size()=1 2024-09-14T11:22:50.926 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.923+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.81uStcONzU-k4hr95gvhQW1GjjKinpA_0 2024-09-14T11:22:50.926 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.923+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7335780881337809178', time=2024-09-14T13:15:33.376474+0000, chain.objs.size()=1 2024-09-14T11:22:50.926 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.923+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.qoap4Ad4KXIlPN6NeQWq0iGNRATlY6l_0 2024-09-14T11:22:50.926 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.923+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.427496178495972687', time=2024-09-14T13:15:33.423818+0000, chain.objs.size()=1 2024-09-14T11:22:50.926 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.923+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.UbqH216MML9uK42CU1oq1wPNB4yA2VS_0 2024-09-14T11:22:50.927 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.924+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9686195394527568980', time=2024-09-14T13:15:33.432623+0000, chain.objs.size()=1 2024-09-14T11:22:50.927 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.924+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.CDuCRl6lTGkcixYa32LN8GUx44KFmU5_0 2024-09-14T11:22:50.927 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.924+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8420081245049703146', time=2024-09-14T13:15:33.541772+0000, chain.objs.size()=1 2024-09-14T11:22:50.927 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.924+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.7W7Rhyynz7M24AJqQNQHC2R4ucUTcg6_0 2024-09-14T11:22:50.927 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.924+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2041876006271841809', time=2024-09-14T13:15:33.544076+0000, chain.objs.size()=1 2024-09-14T11:22:50.927 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.924+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.UDNrBug8-eS3nxT2chnFzGovk2Bl2PK_0 2024-09-14T11:22:50.927 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.924+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.110628245323033888', time=2024-09-14T13:15:33.565386+0000, chain.objs.size()=1 2024-09-14T11:22:50.927 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.924+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_._VsHCao_TmCpUs95GfNqRlLFqnrVpsM_0 2024-09-14T11:22:50.927 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.924+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10488655204589935962', time=2024-09-14T13:15:33.588352+0000, chain.objs.size()=1 2024-09-14T11:22:50.927 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.924+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.QcaRHIMrT-rgRji3sRSC1myvVST-wUH_0 2024-09-14T11:22:50.927 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.924+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10827299692160329048', time=2024-09-14T13:15:33.695495+0000, chain.objs.size()=1 2024-09-14T11:22:50.927 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.924+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.sjtr65nRVsaYjnvKtFjPAri5hy4PYHf_0 2024-09-14T11:22:50.927 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.924+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7504355395530243851', time=2024-09-14T13:15:33.696335+0000, chain.objs.size()=1 2024-09-14T11:22:50.928 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.924+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.JXGlzbyOHVnFgRIba9fHOgZ0rXC3kt7_0 2024-09-14T11:22:50.929 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.926+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15496004340866455757', time=2024-09-14T13:15:33.716319+0000, chain.objs.size()=1 2024-09-14T11:22:50.929 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.926+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Ndz6_ELPD_pV7jaCJ4KTPoIDhUwNE9Q_0 2024-09-14T11:22:50.929 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.926+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14002772291530780104', time=2024-09-14T13:15:33.719587+0000, chain.objs.size()=1 2024-09-14T11:22:50.929 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.926+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.tcnzt1f5B8vkNp88IaI5anRzJqBae-n_0 2024-09-14T11:22:50.929 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.926+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7332118306429996482', time=2024-09-14T13:15:33.725663+0000, chain.objs.size()=1 2024-09-14T11:22:50.930 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.926+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.qhgUjCmPgZfekp5ZVSf6cWko89BnLar_0 2024-09-14T11:22:50.930 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.926+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8647007813354652931', time=2024-09-14T13:15:33.742738+0000, chain.objs.size()=1 2024-09-14T11:22:50.930 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.926+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.pXqqp4t6sP9fy2rkLZsP3TWX06Mkz7H_0 2024-09-14T11:22:50.930 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.926+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10303266257922090766', time=2024-09-14T13:15:33.750271+0000, chain.objs.size()=1 2024-09-14T11:22:50.930 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.926+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Aa_upFlW7jHCOcv_h1S3_0ccQOQsQqV_0 2024-09-14T11:22:50.930 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.926+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8405031263371591849', time=2024-09-14T13:15:33.851951+0000, chain.objs.size()=1 2024-09-14T11:22:50.930 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.926+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.77_FlCAh6vqDqbqCS3CdRNSauC4yqcg_0 2024-09-14T11:22:50.930 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.926+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16936489838409876597', time=2024-09-14T13:15:33.866550+0000, chain.objs.size()=1 2024-09-14T11:22:50.930 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.926+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.0PHqLDIsTTx0y9o48KwBCFipCFon5vo_0 2024-09-14T11:22:50.930 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.926+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7741807853553694097', time=2024-09-14T13:15:34.011145+0000, chain.objs.size()=1 2024-09-14T11:22:50.930 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.926+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.j5joWZHMOHHwFxluVurUIVwGS1vXeiq_0 2024-09-14T11:22:50.930 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.926+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17311752790736927291', time=2024-09-14T13:15:34.016921+0000, chain.objs.size()=1 2024-09-14T11:22:50.930 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.926+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.d9xHigt3ptrPUDrIRZvnA4O0wiWnbv2_0 2024-09-14T11:22:50.931 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.926+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4221528922087682793', time=2024-09-14T13:15:34.032129+0000, chain.objs.size()=1 2024-09-14T11:22:50.931 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.926+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.41ATMb4p0KzxYO5UHMklQjYdZ4Jm0CM_0 2024-09-14T11:22:50.931 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.926+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6853630610149598609', time=2024-09-14T13:15:34.037864+0000, chain.objs.size()=1 2024-09-14T11:22:50.931 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.926+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.UMf2LifK9WZRYL1SrwQ11BbW90vvrv2_0 2024-09-14T11:22:50.931 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.927+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12320404596584167577', time=2024-09-14T13:15:34.063687+0000, chain.objs.size()=1 2024-09-14T11:22:50.931 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.927+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.SrfxxwA_i_6rCkG0v4FhnXWigypP7XP_0 2024-09-14T11:22:50.931 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.927+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13268656009074163767', time=2024-09-14T13:15:34.072102+0000, chain.objs.size()=1 2024-09-14T11:22:50.931 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.927+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.iXMZgU85Zx_ZwCLK7rtv2S8R3h-NuVw_0 2024-09-14T11:22:50.931 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.928+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6851914888285078406', time=2024-09-14T13:15:34.089409+0000, chain.objs.size()=1 2024-09-14T11:22:50.931 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.928+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.n44L6n5w8iPFiW4iXm4C-1WAQFMLmTJ_0 2024-09-14T11:22:50.931 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.928+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11765378321988827014', time=2024-09-14T13:15:34.175003+0000, chain.objs.size()=1 2024-09-14T11:22:50.931 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.928+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.3jCTVvEjLYFZC_RsC8w-8-Kki3XkA5q_0 2024-09-14T11:22:50.931 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.928+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2713762168775123634', time=2024-09-14T13:15:34.187465+0000, chain.objs.size()=1 2024-09-14T11:22:50.932 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.928+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.dLBzkPAx4B8PUKxcDnSW-2MeEKG8mrF_0 2024-09-14T11:22:50.932 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.929+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13468559524754645141', time=2024-09-14T13:15:34.203747+0000, chain.objs.size()=1 2024-09-14T11:22:50.932 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.929+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.7CUPK9SHJ2JsUZD6ew-80Bos2AGGuyI_0 2024-09-14T11:22:50.932 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.929+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12172504659816665735', time=2024-09-14T13:15:34.218733+0000, chain.objs.size()=1 2024-09-14T11:22:50.932 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.929+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.T4ZIRUqeQTZ-ZMB5q42KA9UVsGXP1iE_0 2024-09-14T11:22:50.932 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.929+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.289401827582494699', time=2024-09-14T13:15:34.220452+0000, chain.objs.size()=1 2024-09-14T11:22:50.932 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.929+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.EVdDE1yowyw3qnSj6Yln_hMueRC6Fvp_0 2024-09-14T11:22:50.932 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.929+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4187265936760548130', time=2024-09-14T13:15:34.256310+0000, chain.objs.size()=1 2024-09-14T11:22:50.932 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.929+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.-GZl_NRI2oU8t5TqFgftuwujGoxMAdX_0 2024-09-14T11:22:50.934 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.931+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 0/45998 2024-09-14T11:22:50.934 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.933+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-14T11:22:50.934 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.933+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6419690152163864300', time=2024-09-14T13:15:34.330023+0000, chain.objs.size()=1 2024-09-14T11:22:50.934 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.933+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.FnfnYg07-BG8Ei8nxfMTqHECJbw5RiM_0 2024-09-14T11:22:50.934 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.933+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4180987081378181551', time=2024-09-14T13:15:34.368874+0000, chain.objs.size()=1 2024-09-14T11:22:50.934 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.933+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.46uyThnV9i8d8QKTPJVSGb4t9LFuFtA_0 2024-09-14T11:22:50.934 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.933+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12486331088097852574', time=2024-09-14T13:15:34.389898+0000, chain.objs.size()=1 2024-09-14T11:22:50.934 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.933+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.GKM2uQvBwc87KB0MQKR9tPbhcuc_zV6_0 2024-09-14T11:22:50.934 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.933+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17536583722872183031', time=2024-09-14T13:15:34.390975+0000, chain.objs.size()=1 2024-09-14T11:22:50.935 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.933+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.eq3kuRaPVVnwTk6uhv74WP-ABe4YsdB_0 2024-09-14T11:22:50.935 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.933+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10059642794136524054', time=2024-09-14T13:16:03.201928+0000, chain.objs.size()=1 2024-09-14T11:22:50.935 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.933+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.433__shadow_.cHZZCZklYCRiPm4_EQE8hlZr61ShIoV_0 2024-09-14T11:22:50.935 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.933+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.893115598938609095', time=2024-09-14T13:16:16.975483+0000, chain.objs.size()=1 2024-09-14T11:22:50.935 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.933+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.483__shadow_.Ee8Ye1Sm3J2DwuazFFNMgZ1X5kTi_tR_0 2024-09-14T11:22:50.935 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.933+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16818066918067157497', time=2024-09-14T13:16:18.029522+0000, chain.objs.size()=3 2024-09-14T11:22:50.935 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.933+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.486__shadow_.hhSLkPJJh6uGj1HTHhgVIzDHc0VYLFE_0 2024-09-14T11:22:50.935 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.933+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.486__shadow_.hhSLkPJJh6uGj1HTHhgVIzDHc0VYLFE_1 2024-09-14T11:22:50.935 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.933+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.486__shadow_.hhSLkPJJh6uGj1HTHhgVIzDHc0VYLFE_2 2024-09-14T11:22:50.935 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.933+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9606104094542969550', time=2024-09-14T13:16:23.029184+0000, chain.objs.size()=1 2024-09-14T11:22:50.935 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.933+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.503__shadow:pymE41PAtqbkcQ6I2URloKvd5muPSJ-_.UInzhQl7TQvRYLWzEBL5Aj5TYH25pWP_0 2024-09-14T11:22:50.935 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.933+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12972504029217368944', time=2024-09-14T13:16:27.783626+0000, chain.objs.size()=1 2024-09-14T11:22:50.935 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.933+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.518__multipart_mymultipart.2~fOI6Lb50NzvZibYQyosVGAixuVpdOA7.1 2024-09-14T11:22:50.935 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.933+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10883195261307031619', time=2024-09-14T13:16:34.960026+0000, chain.objs.size()=6 2024-09-14T11:22:50.936 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.933+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.522__multipart_mymultipart.2~H2xWmCMIzpne_d_6wlanKGAkCjFns5_.1 2024-09-14T11:22:50.936 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.935+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.522__multipart_mymultipart.Bf23Vz4Gt6VbUBN6di0DZ-KZag46pgaO.2 2024-09-14T11:22:50.936 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.935+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.522__multipart_mymultipart.PtuKuvyUJQ3K7nF3QD8jJMY4Pvoi2KHr.3 2024-09-14T11:22:50.936 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.935+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.522__multipart_mymultipart.2~H2xWmCMIzpne_d_6wlanKGAkCjFns5_.4 2024-09-14T11:22:50.936 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.935+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.522__multipart_mymultipart.2~H2xWmCMIzpne_d_6wlanKGAkCjFns5_.5 2024-09-14T11:22:50.936 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.935+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.522__multipart_mymultipart.2~H2xWmCMIzpne_d_6wlanKGAkCjFns5_.6 2024-09-14T11:22:50.936 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.935+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1886379106261343847', time=2024-09-14T13:16:55.533073+0000, chain.objs.size()=4 2024-09-14T11:22:50.936 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.935+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.535__multipart_mymultipart.2~R-s3kMwD8Ws-rIlaFO0fJ6wqSl0Gs0Z.1 2024-09-14T11:22:50.937 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.937+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.535__multipart_mymultipart.2~R-s3kMwD8Ws-rIlaFO0fJ6wqSl0Gs0Z.2 2024-09-14T11:22:50.937 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.937+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.535__multipart_mymultipart.OJ2Sihc9yxNruzBDRhQ4ei8PbL-D2xxX.3 2024-09-14T11:22:50.937 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.937+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.535__multipart_mymultipart.2~R-s3kMwD8Ws-rIlaFO0fJ6wqSl0Gs0Z.4 2024-09-14T11:22:50.937 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.937+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10295002880190985621', time=2024-09-14T13:17:12.057118+0000, chain.objs.size()=1 2024-09-14T11:22:50.937 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.937+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.555__shadow_.JYghamqTONkSyiy-aKM7aTnidr9vkyo_0 2024-09-14T11:22:50.937 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.937+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14829780383285428855', time=2024-09-14T13:17:22.954733+0000, chain.objs.size()=1 2024-09-14T11:22:50.937 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.937+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.569__shadow:YdUm0gPM3ZLNzhWl4yuW9T0Y2k6V.3x_.hoNvRxqqrH71cWqiLTuqeX9Kox6F4-q_0 2024-09-14T11:22:50.937 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.938+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10021332580062919888', time=2024-09-14T13:17:29.123570+0000, chain.objs.size()=1 2024-09-14T11:22:50.938 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.938+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.574__shadow_.Gh_r5PuCSTtAkcrno6kjdhAw-NCtiD__0 2024-09-14T11:22:50.938 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.938+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3951120960765469175', time=2024-09-14T13:17:43.891006+0000, chain.objs.size()=1 2024-09-14T11:22:50.938 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.938+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.577__shadow:jJsLXkvvH4-3vbxKRGswoqteImqP5p5_.HDqDepXoT5LajhWFp94iR3hLthHi1KA_0 2024-09-14T11:22:50.938 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.939+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.718994316563303673', time=2024-09-14T13:20:19.588762+0000, chain.objs.size()=6 2024-09-14T11:22:50.938 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.939+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.661__multipart_baz.2~AUKyJ-OBZh-JIOrxUkQI-ZEDYP_1ksb.1 2024-09-14T11:22:50.938 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.939+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.661__multipart_baz.2~AUKyJ-OBZh-JIOrxUkQI-ZEDYP_1ksb.2 2024-09-14T11:22:50.938 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.939+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.661__multipart_baz.2~AUKyJ-OBZh-JIOrxUkQI-ZEDYP_1ksb.3 2024-09-14T11:22:50.938 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.939+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.661__multipart_baz.2~AUKyJ-OBZh-JIOrxUkQI-ZEDYP_1ksb.4 2024-09-14T11:22:50.938 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.940+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.661__multipart_baz.2~AUKyJ-OBZh-JIOrxUkQI-ZEDYP_1ksb.5 2024-09-14T11:22:50.940 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.941+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.661__multipart_baz.2~AUKyJ-OBZh-JIOrxUkQI-ZEDYP_1ksb.6 2024-09-14T11:22:50.940 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.941+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10538987360277722969', time=2024-09-14T13:20:30.498867+0000, chain.objs.size()=1 2024-09-14T11:22:50.940 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.941+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.704__shadow:OwEcHpcGpwuVF-e1nqOFhASBHJqh7FE_.1UxERvpolcez0eDI857y7uKUGU7M1B8_0 2024-09-14T11:22:50.940 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.941+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1153109353450880970', time=2024-09-14T13:20:53.670792+0000, chain.objs.size()=1 2024-09-14T11:22:50.940 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.941+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.719__shadow_.5Ft9LhtTRHKC_GMGQZQ33apEk25PxlO_0 2024-09-14T11:22:50.940 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.941+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11508627123508251024', time=2024-09-14T13:21:03.360892+0000, chain.objs.size()=1 2024-09-14T11:22:50.940 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.941+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.747__shadow_.3MSo0IQNybHQDOsyc8ssaUiQKGW4OS7_0 2024-09-14T11:22:50.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.943+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:50.944 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.945+0000 7f0f19c16800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:22:50.945 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.946+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:50.945 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.947+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:50.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.948+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45256' 2024-09-14T11:22:50.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.948+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3900826942538226995', time=2024-09-14T13:14:45.911259+0000, chain.objs.size()=1 2024-09-14T11:22:50.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.948+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.236__shadow_.qi8NvXcnQbBFR5lrabZTH_S5a-BRaog_0 2024-09-14T11:22:50.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.948+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2049899433039814193', time=2024-09-14T13:14:46.516315+0000, chain.objs.size()=1 2024-09-14T11:22:50.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.948+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.238__shadow_.TdTH0-PfgKo7ALpvxPYG_KnoPhSlVR6_0 2024-09-14T11:22:50.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.948+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8113800514880698411', time=2024-09-14T13:14:47.510842+0000, chain.objs.size()=1 2024-09-14T11:22:50.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.948+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.242__shadow_.854qHXwnkAoYWJKjAXz9L95kc_Nr-LH_0 2024-09-14T11:22:50.947 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.948+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9531410773172371570', time=2024-09-14T13:14:49.319006+0000, chain.objs.size()=1 2024-09-14T11:22:50.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.948+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.248__shadow_.G-H8dZxOv7_11kzdJDnLzLcaGV8nx43_0 2024-09-14T11:22:50.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.948+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16578491539880757841', time=2024-09-14T13:14:59.745755+0000, chain.objs.size()=1 2024-09-14T11:22:50.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.948+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.ZIrjrK_2uo-h1JdlO1S8d4PBPWB1iTK_0 2024-09-14T11:22:50.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.948+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15819667903930804667', time=2024-09-14T13:14:59.773368+0000, chain.objs.size()=1 2024-09-14T11:22:50.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.948+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.ZSZK_9F3S0x34xBwt_ZzdhpaJ8EwNKa_0 2024-09-14T11:22:50.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.948+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16489770599520259145', time=2024-09-14T13:14:59.782760+0000, chain.objs.size()=1 2024-09-14T11:22:50.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.948+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.x5PUTD2TlGTVVKLkhzn942BwUJ8un-J_0 2024-09-14T11:22:50.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.948+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6270046949691015271', time=2024-09-14T13:14:59.901317+0000, chain.objs.size()=1 2024-09-14T11:22:50.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.948+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.j6QBKl-IrNy3k99PjkkfOWRl5EIahtV_0 2024-09-14T11:22:50.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.948+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5703456307845530742', time=2024-09-14T13:14:59.923995+0000, chain.objs.size()=1 2024-09-14T11:22:50.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.948+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.hVud8pm7bfPVN02Z8vpFxKlNutLTIf4_0 2024-09-14T11:22:50.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.948+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13149307346383598656', time=2024-09-14T13:14:59.960020+0000, chain.objs.size()=1 2024-09-14T11:22:50.948 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.948+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.94l2zHMqWAd0vwM049S6p93pazLnnJI_0 2024-09-14T11:22:50.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.948+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6300428018709051918', time=2024-09-14T13:14:59.960803+0000, chain.objs.size()=1 2024-09-14T11:22:50.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.948+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.hiTb4omUrIMDtiy45RZT2pkzSQfv_K8_0 2024-09-14T11:22:50.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.948+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14358941508088966146', time=2024-09-14T13:15:00.066561+0000, chain.objs.size()=1 2024-09-14T11:22:50.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.948+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_._6AHtcFN6c7PGAwfDfwykaXTAGdp3o5_0 2024-09-14T11:22:50.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.950+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3507686985249056419', time=2024-09-14T13:15:00.100592+0000, chain.objs.size()=1 2024-09-14T11:22:50.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.950+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.pFApTpemaqiFK-BbYxzinvXbERUpehg_0 2024-09-14T11:22:50.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.950+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12447145112601945519', time=2024-09-14T13:15:00.145553+0000, chain.objs.size()=1 2024-09-14T11:22:50.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.950+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.n0dkslp2r1utVLicAwHfbyM_1tFbieI_0 2024-09-14T11:22:50.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.950+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8007599801306906667', time=2024-09-14T13:15:00.146897+0000, chain.objs.size()=1 2024-09-14T11:22:50.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.950+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.3uhzQGTzynFBfDmUywUousyLBzygohw_0 2024-09-14T11:22:50.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.950+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13829509891224166572', time=2024-09-14T13:15:00.151408+0000, chain.objs.size()=1 2024-09-14T11:22:50.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.950+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.kYP05lol8A5UnMJRrQ5nU8eLOWwv97r_0 2024-09-14T11:22:50.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.950+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3487708024023409313', time=2024-09-14T13:15:00.255940+0000, chain.objs.size()=1 2024-09-14T11:22:50.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.950+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.ZLaP7SFMVbbezKqPTb3nB43pLpLhinj_0 2024-09-14T11:22:50.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.950+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2102581351510918259', time=2024-09-14T13:15:00.283040+0000, chain.objs.size()=1 2024-09-14T11:22:50.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.950+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.JWiG8PzYEzscbQ0Iie1B9GCsYuW7Tln_0 2024-09-14T11:22:50.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.950+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13576567072194676519', time=2024-09-14T13:15:00.295321+0000, chain.objs.size()=1 2024-09-14T11:22:50.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.950+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.VgxL1jCP1X4WbXFK3UvGb3DlBOpSrdO_0 2024-09-14T11:22:50.950 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.950+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17306190665778300333', time=2024-09-14T13:15:00.312169+0000, chain.objs.size()=1 2024-09-14T11:22:50.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.950+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.8HPutdr8Wv2lG7dAlm2adLkdA_hGEL5_0 2024-09-14T11:22:50.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.950+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17242776555810161102', time=2024-09-14T13:15:00.431954+0000, chain.objs.size()=1 2024-09-14T11:22:50.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.950+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.RblsKKwPSqmJhNagvX6CDFo4h3O7J4Z_0 2024-09-14T11:22:50.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.950+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1065058459001774128', time=2024-09-14T13:15:00.441314+0000, chain.objs.size()=1 2024-09-14T11:22:50.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.950+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.4IhGSqdkIJrNUJtkZb_OoMOOI68tw0x_0 2024-09-14T11:22:50.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.950+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11044819671605454179', time=2024-09-14T13:15:00.551338+0000, chain.objs.size()=1 2024-09-14T11:22:50.951 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.950+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.KrCjDT-CDc9_RFo9C2aZrJiGvPYotKj_0 2024-09-14T11:22:50.952 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.951+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13630282812416425180', time=2024-09-14T13:15:00.710110+0000, chain.objs.size()=1 2024-09-14T11:22:50.952 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.951+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.9KqzzpNzw9NZRxSn4oLCxhV9z0xuCR4_0 2024-09-14T11:22:50.952 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.952+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3325684928118370044', time=2024-09-14T13:15:00.726609+0000, chain.objs.size()=1 2024-09-14T11:22:50.952 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.952+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.DF0DPjuAYb9nduFktJC7bo9L9_GNA1l_0 2024-09-14T11:22:50.952 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.952+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8871149984112085728', time=2024-09-14T13:15:00.731746+0000, chain.objs.size()=1 2024-09-14T11:22:50.952 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.952+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.WLliYXfqKFzbYxC8EnmW-ivsZwHYjes_0 2024-09-14T11:22:50.952 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.952+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16977046097437419281', time=2024-09-14T13:15:00.752217+0000, chain.objs.size()=1 2024-09-14T11:22:50.952 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.952+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.xsZZRIvf1Hh7-zyfKZq8j7lwlebEIrF_0 2024-09-14T11:22:50.952 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.952+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1843659448834829962', time=2024-09-14T13:15:00.754200+0000, chain.objs.size()=1 2024-09-14T11:22:50.952 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.952+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.aPBaG8k9B6euyFwQvM7GaJNjrwl-T2W_0 2024-09-14T11:22:50.952 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.952+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14165817951989089342', time=2024-09-14T13:15:00.757039+0000, chain.objs.size()=1 2024-09-14T11:22:50.953 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.952+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.0wrE4tY5hKIQ0te0SCI493h5Kx8fRg1_0 2024-09-14T11:22:50.953 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.952+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6639732310761176501', time=2024-09-14T13:15:00.773691+0000, chain.objs.size()=1 2024-09-14T11:22:50.953 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.952+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.QHxxPdTDOdfpQQD2_k1r1RZqQA4Y8Mw_0 2024-09-14T11:22:50.953 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.952+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5576065322530507300', time=2024-09-14T13:15:00.781051+0000, chain.objs.size()=1 2024-09-14T11:22:50.953 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.952+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.nqfXQGA6SgERqd2mTPbEsqkh5Jwnx2T_0 2024-09-14T11:22:50.953 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.952+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9085219782886701222', time=2024-09-14T13:15:00.786103+0000, chain.objs.size()=1 2024-09-14T11:22:50.953 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.952+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.VCuWx30xn7mGfteL73d5MvDs73hFjCZ_0 2024-09-14T11:22:50.953 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.952+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2751304286361652872', time=2024-09-14T13:15:00.795682+0000, chain.objs.size()=1 2024-09-14T11:22:50.953 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.952+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.ZRDXeHHC4bi63oopucSL-1MikepkJ64_0 2024-09-14T11:22:50.953 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.952+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15595423675361843498', time=2024-09-14T13:15:00.920709+0000, chain.objs.size()=1 2024-09-14T11:22:50.953 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.952+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.R91w6pLQWmCI8anIzi9h3Ro9iLkT2IB_0 2024-09-14T11:22:50.954 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.953+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5130345946966871154', time=2024-09-14T13:15:00.927568+0000, chain.objs.size()=1 2024-09-14T11:22:50.954 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.953+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.o7NHIy_YN8oWtqxyhSLBNs4FGX4KDqP_0 2024-09-14T11:22:50.954 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.954+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1233744681872772955', time=2024-09-14T13:15:04.402469+0000, chain.objs.size()=1 2024-09-14T11:22:50.954 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.954+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.276__shadow_.bqaLYhfmKayOVTygaijgK15_FlX7Q5z_0 2024-09-14T11:22:50.955 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.954+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18070671097096850517', time=2024-09-14T13:15:05.715804+0000, chain.objs.size()=1 2024-09-14T11:22:50.955 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.954+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.281__shadow_.pmlfcpHPS6dc-B_Vq8yaxMWHPiX5D04_0 2024-09-14T11:22:50.955 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.954+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17758140485621591079', time=2024-09-14T13:15:09.256398+0000, chain.objs.size()=1 2024-09-14T11:22:50.955 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.954+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.292__shadow_.CCqyE66DjCCkiyssiVxLX9sLJ7akBxw_0 2024-09-14T11:22:50.955 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.954+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6933619278940048716', time=2024-09-14T13:15:09.839425+0000, chain.objs.size()=1 2024-09-14T11:22:50.955 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.954+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.293__shadow_.XqZOoStR7TupeypCpzyq4h2grp_x5-x_0 2024-09-14T11:22:50.955 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.954+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.971241525836009360', time=2024-09-14T13:15:10.074023+0000, chain.objs.size()=1 2024-09-14T11:22:50.955 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.954+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.294__shadow_.SFj6YzVeFNlAO16fIsGQrqNdfpybfbo_0 2024-09-14T11:22:50.955 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.954+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13653463711850200129', time=2024-09-14T13:15:11.698190+0000, chain.objs.size()=1 2024-09-14T11:22:50.955 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.954+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.300__shadow_.4tp-xGBNpiRKUmbU6qghN1xHHB4tetS_0 2024-09-14T11:22:50.955 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.954+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2379796101136895776', time=2024-09-14T13:15:16.602463+0000, chain.objs.size()=1 2024-09-14T11:22:50.955 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.954+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.319__shadow:bvFEWwtneg9QKxX0M2lDvKQtOOSWFTk_.7MLrvpmRWmcf4BD2BouyYRwW93t-pcp_0 2024-09-14T11:22:50.955 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.954+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.763609765914839070', time=2024-09-14T13:15:16.895006+0000, chain.objs.size()=1 2024-09-14T11:22:50.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.954+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.321__shadow_._GnKAwD-22Ai5HPSoik1a4mGzqBPI05_0 2024-09-14T11:22:50.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.955+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4214914992209601012', time=2024-09-14T13:15:24.735619+0000, chain.objs.size()=1 2024-09-14T11:22:50.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.955+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.1siwV4uVRY3l54u5JNtFqbnJUrnBprg_0 2024-09-14T11:22:50.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.955+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16464260256952470229', time=2024-09-14T13:15:24.772319+0000, chain.objs.size()=1 2024-09-14T11:22:50.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.955+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.GzPNPuF4QXl6pUWLAACaRpLZJQgVRNy_0 2024-09-14T11:22:50.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.955+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11357657457250526637', time=2024-09-14T13:15:24.784104+0000, chain.objs.size()=1 2024-09-14T11:22:50.956 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.955+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.IrTT0DKLSC4c4uLhyGvm0yQSiNR7yJB_0 2024-09-14T11:22:50.958 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.956+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12076951970754654727', time=2024-09-14T13:15:24.903440+0000, chain.objs.size()=1 2024-09-14T11:22:50.958 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.956+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.GYZb9vYeGO_9MkXMnbldspNvehw0-TW_0 2024-09-14T11:22:50.958 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.956+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17595612559605027864', time=2024-09-14T13:15:25.211718+0000, chain.objs.size()=1 2024-09-14T11:22:50.958 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.956+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.4lZ-1-m-qCL1jWtQS0m-VKYZjGNdcPl_0 2024-09-14T11:22:50.958 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.956+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15461543974477668152', time=2024-09-14T13:15:25.250951+0000, chain.objs.size()=1 2024-09-14T11:22:50.958 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.956+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.AMXzQ6Q6bM4-PTWdFxcDYBthsTlI9ct_0 2024-09-14T11:22:50.958 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.956+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17089704228908760907', time=2024-09-14T13:15:25.267748+0000, chain.objs.size()=1 2024-09-14T11:22:50.958 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.956+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.0DDMOMkAjKvYj4mXgqHsIKBnf_Uh8cQ_0 2024-09-14T11:22:50.958 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.956+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.106141799046364142', time=2024-09-14T13:15:25.392188+0000, chain.objs.size()=1 2024-09-14T11:22:50.958 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.956+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.MxG-G9DKHVtpCVoHU_7OOGXe8gcOWbt_0 2024-09-14T11:22:50.958 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.957+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2748836071748349239', time=2024-09-14T13:15:25.412960+0000, chain.objs.size()=1 2024-09-14T11:22:50.958 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.957+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.rV7DeytGXb8JAU9U4DUQt0VB2ecW-tD_0 2024-09-14T11:22:50.958 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.957+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11681287895120388022', time=2024-09-14T13:15:25.556514+0000, chain.objs.size()=1 2024-09-14T11:22:50.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.957+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.FCDSXXGTnKshkWprSrMCHHdE6E9XBQM_0 2024-09-14T11:22:50.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.957+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.908118509554291085', time=2024-09-14T13:15:25.576494+0000, chain.objs.size()=1 2024-09-14T11:22:50.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.957+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.Ux_irzXoqhCQ-iAxlAiyHoq6fxswXuA_0 2024-09-14T11:22:50.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.957+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7826778925260449294', time=2024-09-14T13:15:25.596918+0000, chain.objs.size()=1 2024-09-14T11:22:50.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.957+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.gTaeAHf8Z5NwPCTAltu0kCjNuGt5b0s_0 2024-09-14T11:22:50.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.957+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10283036118600942615', time=2024-09-14T13:15:25.602884+0000, chain.objs.size()=1 2024-09-14T11:22:50.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.957+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.mbNmdLbv0yaULelZizdRul8O2A2IK-R_0 2024-09-14T11:22:50.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.957+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10882594390680231801', time=2024-09-14T13:15:25.729710+0000, chain.objs.size()=1 2024-09-14T11:22:50.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.957+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.5BYCOxo7vDbzup_B6x6OVHEfiHllTvW_0 2024-09-14T11:22:50.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.958+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7292252808103215290', time=2024-09-14T13:15:25.749735+0000, chain.objs.size()=1 2024-09-14T11:22:50.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.958+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.6DPOEVzYpSxYn06Z2cRwLQQTEVN_LiE_0 2024-09-14T11:22:50.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.958+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8373007375834413443', time=2024-09-14T13:15:25.891709+0000, chain.objs.size()=1 2024-09-14T11:22:50.959 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.958+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.efTOS--eabD4rifLeOpHDCl0izHIxpQ_0 2024-09-14T11:22:50.960 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.958+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6068477972246632512', time=2024-09-14T13:15:25.894205+0000, chain.objs.size()=1 2024-09-14T11:22:50.960 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.958+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.5OELcrgA71BElFyFMTvjcvL3xA0Mj2t_0 2024-09-14T11:22:50.960 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.959+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10476006545033517801', time=2024-09-14T13:15:25.895661+0000, chain.objs.size()=1 2024-09-14T11:22:50.960 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.959+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.ytZVSQ_UnXikg0Py26Oa0RG0NJ15VDt_0 2024-09-14T11:22:50.960 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.959+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11684765497224182016', time=2024-09-14T13:15:25.901501+0000, chain.objs.size()=1 2024-09-14T11:22:50.960 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.959+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.Pstezd8wLS2QH5BYG9ank58CHE-_1wq_0 2024-09-14T11:22:50.960 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.959+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4612555698128475121', time=2024-09-14T13:15:25.902387+0000, chain.objs.size()=1 2024-09-14T11:22:50.960 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.959+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.TFHau1-W5k-rGVfd_mcuPzIBOClbB-n_0 2024-09-14T11:22:50.960 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.959+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1118633956706422818', time=2024-09-14T13:15:25.916481+0000, chain.objs.size()=1 2024-09-14T11:22:50.960 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.959+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.j_nzUN3n51AhFqQ5oysJg7qi7GIUlW2_0 2024-09-14T11:22:50.960 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.959+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6778384328887324047', time=2024-09-14T13:15:25.946271+0000, chain.objs.size()=1 2024-09-14T11:22:50.960 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.959+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.MCF8kZgQ5gqn4-sOmZgVUjeNLeFA8Hf_0 2024-09-14T11:22:50.961 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.959+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12742646006828864831', time=2024-09-14T13:15:33.177823+0000, chain.objs.size()=1 2024-09-14T11:22:50.961 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.959+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.8Pxx7AGZYsJ-pa7wNu42JnqZty3oHqj_0 2024-09-14T11:22:50.961 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.959+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10905625527727398630', time=2024-09-14T13:15:33.180173+0000, chain.objs.size()=1 2024-09-14T11:22:50.961 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.959+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.E5A4gSJTwofdHUMIPO7-m1ydsn9y_Up_0 2024-09-14T11:22:50.961 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.959+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9916101510188718028', time=2024-09-14T13:15:33.192591+0000, chain.objs.size()=1 2024-09-14T11:22:50.961 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.959+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.dxHBIChA2YhQoDtEuc0T8_zaK2VONDX_0 2024-09-14T11:22:50.962 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.959+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13124098113444343488', time=2024-09-14T13:15:33.237148+0000, chain.objs.size()=1 2024-09-14T11:22:50.962 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.959+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.0KrE9TUQKXum4kKimLyjdrRdFo9LzVC_0 2024-09-14T11:22:50.963 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.960+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1670503764268260972', time=2024-09-14T13:15:33.240241+0000, chain.objs.size()=1 2024-09-14T11:22:50.963 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.960+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.ixix1hlSYJ941okvUv2fA8Ndo7hIuH5_0 2024-09-14T11:22:50.963 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.961+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17440786182251005516', time=2024-09-14T13:15:33.374357+0000, chain.objs.size()=1 2024-09-14T11:22:50.963 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.961+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.3cztOYGvXyH5RJxpWcFmt0VNMTbt8ke_0 2024-09-14T11:22:50.963 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.961+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3261100013788173901', time=2024-09-14T13:15:33.378685+0000, chain.objs.size()=1 2024-09-14T11:22:50.963 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.961+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.eULLPPxFTA4sOBoRFJWq5cfk2bSPit3_0 2024-09-14T11:22:50.963 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.961+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.642130213687160272', time=2024-09-14T13:15:33.415914+0000, chain.objs.size()=1 2024-09-14T11:22:50.963 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.961+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.MLSn36FETayMIGE8YG9XQyaCoEGakj__0 2024-09-14T11:22:50.963 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.961+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10595012827431826604', time=2024-09-14T13:15:33.443985+0000, chain.objs.size()=1 2024-09-14T11:22:50.963 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.961+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.mRCcD9XluJ08cAeSH106hWQMX1mhf1p_0 2024-09-14T11:22:50.963 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.961+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.782133385410908123', time=2024-09-14T13:15:33.532669+0000, chain.objs.size()=1 2024-09-14T11:22:50.964 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.961+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_._9WNGJg_WO4eKa7opoXH25NDDwAiPFt_0 2024-09-14T11:22:50.964 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.961+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10232336452570615100', time=2024-09-14T13:15:33.533714+0000, chain.objs.size()=1 2024-09-14T11:22:50.964 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.961+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.xZydgB2GFsVcXsRhvGFZWWtA4I-hjVq_0 2024-09-14T11:22:50.964 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.961+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2092335420688989949', time=2024-09-14T13:15:33.566849+0000, chain.objs.size()=1 2024-09-14T11:22:50.964 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.961+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.d6uZUUreX_IAvvCsz00qPxcdJhyYofh_0 2024-09-14T11:22:50.964 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.961+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14225695195283433138', time=2024-09-14T13:15:33.580531+0000, chain.objs.size()=1 2024-09-14T11:22:50.964 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.961+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_._-TTLDS6SNn_f0VUBEZqd5ncU2mBFf-_0 2024-09-14T11:22:50.964 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.961+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3905079051417931316', time=2024-09-14T13:15:33.581244+0000, chain.objs.size()=1 2024-09-14T11:22:50.964 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.961+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.aYMo30MZhuuftEs_FkpJ4aN_u-3WPDn_0 2024-09-14T11:22:50.964 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.961+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17393697306302567055', time=2024-09-14T13:15:33.582867+0000, chain.objs.size()=1 2024-09-14T11:22:50.964 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.961+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Fc7Tx3mhEk3c53LNcXfdgUXAzxveO9f_0 2024-09-14T11:22:50.964 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.962+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.470804407814192059', time=2024-09-14T13:15:33.594407+0000, chain.objs.size()=1 2024-09-14T11:22:50.964 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.962+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.9UbzyIwNGvy3whGc53Za0_uB-IlNY15_0 2024-09-14T11:22:50.964 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.963+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13130352345586515969', time=2024-09-14T13:15:33.706802+0000, chain.objs.size()=1 2024-09-14T11:22:50.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.963+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.H9NqlPUP96E17rhi4lwlwvPmOuq7ptY_0 2024-09-14T11:22:50.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.963+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1349039748478008612', time=2024-09-14T13:15:33.708880+0000, chain.objs.size()=1 2024-09-14T11:22:50.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.963+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.MrZeypCdTLRlufH_1jhmUyxWmLQIS_p_0 2024-09-14T11:22:50.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.963+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4633552969708977997', time=2024-09-14T13:15:33.767723+0000, chain.objs.size()=1 2024-09-14T11:22:50.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.963+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.tjPM87y9ayLCfIEbXTe_uQ3i_rGfoe2_0 2024-09-14T11:22:50.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.963+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4156608935409288707', time=2024-09-14T13:15:33.774079+0000, chain.objs.size()=1 2024-09-14T11:22:50.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.963+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.-XDTS7b1wH1IT7wMVbM7hX4A2EUV2Wt_0 2024-09-14T11:22:50.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.963+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1879971581241835320', time=2024-09-14T13:15:33.775922+0000, chain.objs.size()=1 2024-09-14T11:22:50.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.963+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.2P1KRAV1Dr8c-bGzRMbxqpLJuPHepIC_0 2024-09-14T11:22:50.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.964+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11724725358868385287', time=2024-09-14T13:15:33.858849+0000, chain.objs.size()=1 2024-09-14T11:22:50.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.964+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.i-rVzwourJb47w-jG_wesBnEA27IFy3_0 2024-09-14T11:22:50.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.964+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10268880886544139633', time=2024-09-14T13:15:33.869902+0000, chain.objs.size()=1 2024-09-14T11:22:50.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.964+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.RYqw9k5VZhMMf4cQTNbjj-f6FVW8UBl_0 2024-09-14T11:22:50.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.964+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17069122848708504176', time=2024-09-14T13:15:33.888412+0000, chain.objs.size()=1 2024-09-14T11:22:50.966 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.964+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.vn1DE9ob3XltVyasGHVQQZ9zwP9zPdk_0 2024-09-14T11:22:50.967 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.964+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18260009975708141145', time=2024-09-14T13:15:33.913045+0000, chain.objs.size()=1 2024-09-14T11:22:50.967 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.964+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.eBxQv8EGHRaM_73wdN8Tmj3BqqLF3jQ_0 2024-09-14T11:22:50.967 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.964+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.164207333648439994', time=2024-09-14T13:15:33.933650+0000, chain.objs.size()=1 2024-09-14T11:22:50.967 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.964+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.1EXQJui6M8YYOMWxfHd4w1_G56eShoo_0 2024-09-14T11:22:50.967 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.964+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8700784033631659431', time=2024-09-14T13:15:34.025062+0000, chain.objs.size()=1 2024-09-14T11:22:50.967 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.964+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.n0y8WQit0Cnncv_1yvoAAH7FauZG0Up_0 2024-09-14T11:22:50.967 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.964+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12745249421628204791', time=2024-09-14T13:15:34.078711+0000, chain.objs.size()=1 2024-09-14T11:22:50.967 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.964+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Ec3mkTBg0E7tgCrBOUG8-zxYicmjb09_0 2024-09-14T11:22:50.967 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.964+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17704890471675617687', time=2024-09-14T13:15:34.080045+0000, chain.objs.size()=1 2024-09-14T11:22:50.967 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.964+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.ijUKDHog2yjnh3idsgMhSrcTYJxCrHU_0 2024-09-14T11:22:50.967 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.965+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14950872745476415853', time=2024-09-14T13:15:34.085601+0000, chain.objs.size()=1 2024-09-14T11:22:50.967 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.965+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.HcRoAioMER9UiugyydxNzkjOVOfCuVZ_0 2024-09-14T11:22:50.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.965+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1934197451606225931', time=2024-09-14T13:15:34.098569+0000, chain.objs.size()=1 2024-09-14T11:22:50.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.965+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.AnVvJHUjCNG63g7ZNBDG89sLbarYKkX_0 2024-09-14T11:22:50.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.965+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4996424298956347359', time=2024-09-14T13:15:34.196173+0000, chain.objs.size()=1 2024-09-14T11:22:50.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.965+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Mrf5-Dls9L-z360zS34f8z-fWE-As4u_0 2024-09-14T11:22:50.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.966+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9506594814138608357', time=2024-09-14T13:15:34.222971+0000, chain.objs.size()=1 2024-09-14T11:22:50.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.966+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.u1MEdUIBChIh7PCX5pddqdoL6dk4y0c_0 2024-09-14T11:22:50.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.966+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6511279639877113983', time=2024-09-14T13:15:34.233115+0000, chain.objs.size()=1 2024-09-14T11:22:50.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.966+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.OSy0liuW8hO9zPefVYtx-7R4-aEE6j3_0 2024-09-14T11:22:50.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.966+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10124024243536283906', time=2024-09-14T13:15:34.336756+0000, chain.objs.size()=1 2024-09-14T11:22:50.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.966+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.-v6wOBRsCogA1Bq1sP7-oUB-w5zaV3Z_0 2024-09-14T11:22:50.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.968+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 0/45256 2024-09-14T11:22:50.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.970+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=25, truncated=0, next_marker='' 2024-09-14T11:22:50.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.970+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6976221150261716457', time=2024-09-14T13:15:34.397795+0000, chain.objs.size()=1 2024-09-14T11:22:50.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.970+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Z5H_mIANxmshhquvbAK7mkuicxmNqiD_0 2024-09-14T11:22:50.969 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.970+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14869192647346569879', time=2024-09-14T13:15:37.555140+0000, chain.objs.size()=1 2024-09-14T11:22:50.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.970+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.337__shadow_.N9bniRrz-MztjzNsbUIr3KkzIBoNu4H_0 2024-09-14T11:22:50.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.970+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4948133866439365026', time=2024-09-14T13:16:09.452951+0000, chain.objs.size()=1 2024-09-14T11:22:50.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.970+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.455__shadow_.6IsJRRzpYYmCW6l0DnDGTvz6iSi11UP_0 2024-09-14T11:22:50.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.970+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18013571879716179658', time=2024-09-14T13:16:11.062495+0000, chain.objs.size()=1 2024-09-14T11:22:50.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.970+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.459__shadow_.ltX2NHhqPrl_HJYyc4YxpTkRffhthvA_0 2024-09-14T11:22:50.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.970+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10861858164959811505', time=2024-09-14T13:16:17.244440+0000, chain.objs.size()=1 2024-09-14T11:22:50.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.970+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.484__shadow_.J29zy45_egLJt_M0bzuJ6H1GrjfKUaO_0 2024-09-14T11:22:50.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.970+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='2~i9h8_GIs_XJwPPKQPK8wlzJQmuVUY3I', time=2024-09-14T13:16:40.384495+0000, chain.objs.size()=1 2024-09-14T11:22:50.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.970+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.531__multipart_mymultipart.2~i9h8_GIs_XJwPPKQPK8wlzJQmuVUY3I.1 2024-09-14T11:22:50.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.970+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9814792611519622475', time=2024-09-14T13:16:57.401016+0000, chain.objs.size()=1 2024-09-14T11:22:50.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.970+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.536__multipart_mymultipart.2~qQi1q9SSKN3WO51CipXvwbQZH5bxOqK.1 2024-09-14T11:22:50.970 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.970+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6530038571735337317', time=2024-09-14T13:17:12.455211+0000, chain.objs.size()=1 2024-09-14T11:22:50.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.970+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.556__shadow_.3c6MAi1nQySZXC25oEArrgw1IbGWoTv_0 2024-09-14T11:22:50.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.970+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12694219255278126964', time=2024-09-14T13:17:14.677606+0000, chain.objs.size()=1 2024-09-14T11:22:50.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.970+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.561__multipart_mymultipart.2~0vOkxUbyt_sPG2BnJ9V_vpg9lGRQFNW.1 2024-09-14T11:22:50.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.970+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.261724511027463531', time=2024-09-14T13:17:23.400080+0000, chain.objs.size()=1 2024-09-14T11:22:50.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.970+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.569__shadow:0gNTrFRgAlesom451D-oAs7jRAzbTlI_.qpJfbuDLl8cePMimnntsQTzkL6kJk3l_0 2024-09-14T11:22:50.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.970+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3606171560042212808', time=2024-09-14T13:17:26.173867+0000, chain.objs.size()=1 2024-09-14T11:22:50.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.970+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.569__shadow:7Agy-GITaGADo4-LIOfM7ecENtyP7ym_.q3YtObS2_0sz5jRtlOZSJZW9f5OCU14_0 2024-09-14T11:22:50.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.970+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15851832802790245218', time=2024-09-14T13:17:30.027896+0000, chain.objs.size()=1 2024-09-14T11:22:50.971 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.970+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.574__shadow:vsiygYJhQuNyA0Pw.2e0vw8PwItMdMT_.nEeWav_pDdeVjNSAlos-jmflf9wJm3K_0 2024-09-14T11:22:50.972 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.971+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8961124497797084056', time=2024-09-14T13:17:32.565576+0000, chain.objs.size()=1 2024-09-14T11:22:50.972 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.971+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.576__shadow:bVxUX.o6Qz6wPukPtiE0I.oYHTHp9yA_.mW4glCexGpAKxBFCTxAGeeV7D9n-yOl_0 2024-09-14T11:22:50.972 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.971+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14314592473348629023', time=2024-09-14T13:17:35.365920+0000, chain.objs.size()=1 2024-09-14T11:22:50.972 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.971+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.577__shadow:wM4nX9aZisVytmc3PxprI70kmEIQpDc_.TUQFaSwKDwX-nbbSWlZPNjZvMLqcAhj_0 2024-09-14T11:22:50.972 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.972+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8159111275486455207', time=2024-09-14T13:17:40.521140+0000, chain.objs.size()=1 2024-09-14T11:22:50.973 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.972+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.577__shadow:iOVfvmhflVXxuN86Wn.IyCOBohi2nvR_.Wg7EwUJjh4Ji6PT6jhqiT3BD0GOquvr_0 2024-09-14T11:22:50.973 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.972+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9416886027864680149', time=2024-09-14T13:17:45.595697+0000, chain.objs.size()=1 2024-09-14T11:22:50.973 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.972+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.577__shadow:2pSptTwHtO0GGOwahbaUIvctHKLjhcl_.-FcB36rvxnKG-GOM2QayWNCmIOqXMTV_0 2024-09-14T11:22:50.973 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.972+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10704716451402250947', time=2024-09-14T13:17:50.023585+0000, chain.objs.size()=1 2024-09-14T11:22:50.973 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.972+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.579__shadow:a4.OlUuHgzXUwtL34FzpBrirc4UhWOt_.eKhTiOhJumspt0_YAKmfaPwSITtAt1h_0 2024-09-14T11:22:50.973 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.972+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14739863630920114868', time=2024-09-14T13:20:06.445714+0000, chain.objs.size()=6 2024-09-14T11:22:50.973 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.972+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.623__multipart_multipart_enc.2~62sLV77nLRLGpHkk3lBHDM6delpBUkG.1 2024-09-14T11:22:50.973 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.973+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.623__multipart_multipart_enc.2~62sLV77nLRLGpHkk3lBHDM6delpBUkG.2 2024-09-14T11:22:50.973 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.973+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.623__multipart_multipart_enc.2~62sLV77nLRLGpHkk3lBHDM6delpBUkG.3 2024-09-14T11:22:50.973 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.973+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.623__multipart_multipart_enc.2~62sLV77nLRLGpHkk3lBHDM6delpBUkG.4 2024-09-14T11:22:50.973 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.973+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.623__multipart_multipart_enc.2~62sLV77nLRLGpHkk3lBHDM6delpBUkG.5 2024-09-14T11:22:50.973 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.973+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.623__multipart_multipart_enc.2~62sLV77nLRLGpHkk3lBHDM6delpBUkG.6 2024-09-14T11:22:50.973 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.973+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13833937712885953065', time=2024-09-14T13:20:15.625842+0000, chain.objs.size()=1 2024-09-14T11:22:50.973 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.973+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.652__shadow_.Y7y2XxwyDOP3LRnU4s-JmDl2u8DWwbB_0 2024-09-14T11:22:50.974 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.973+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5634146067878291751', time=2024-09-14T13:20:21.744548+0000, chain.objs.size()=1 2024-09-14T11:22:50.974 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.973+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.668__shadow_.no0EqZY9wlsLG_b2kKWCmBGhBTXBoAC_0 2024-09-14T11:22:50.974 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.973+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2595064909544501078', time=2024-09-14T13:20:24.236265+0000, chain.objs.size()=1 2024-09-14T11:22:50.974 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.973+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.679__shadow_.691LO55OT_nVd028VKJKcd_GddMOPtb_0 2024-09-14T11:22:50.974 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.976+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17633284566608973160', time=2024-09-14T13:20:29.967149+0000, chain.objs.size()=1 2024-09-14T11:22:50.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.976+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.702__multipart_file1.2~PN_JC5kFmpt1J1vqwUmb8C19pSl1CH4.1 2024-09-14T11:22:50.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.976+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10025562496672942907', time=2024-09-14T13:20:33.253939+0000, chain.objs.size()=1 2024-09-14T11:22:50.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.976+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.714__shadow:X7iacXU7pOT-7BlTA-iZAuJohmaju4n_.hz8nKCxp6tfbswEERFriQZFbYGobDwP_0 2024-09-14T11:22:50.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.976+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1158936645322959815', time=2024-09-14T13:20:53.349155+0000, chain.objs.size()=1 2024-09-14T11:22:50.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.976+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.718__shadow_.yHP2SD4BK5hKSNI1gr6463nCGvBH3D5_0 2024-09-14T11:22:50.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.976+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10690324373667970242', time=2024-09-14T13:21:15.806785+0000, chain.objs.size()=1 2024-09-14T11:22:50.975 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.976+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.776__shadow_.mDaLKKsuF7EOnOkqtwdKyjsA73n-o1j_0 2024-09-14T11:22:50.976 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.977+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:50.978 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.979+0000 7f0f19c16800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:22:50.979 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.981+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:50.980 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.981+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:50.981 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.982+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46998' 2024-09-14T11:22:50.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.982+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='_lzeLjHwZCzWhSUl_MUuydlYQQwfKKbT', time=2024-09-14T13:13:37.232755+0000, chain.objs.size()=1 2024-09-14T11:22:50.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.982+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.163__shadow_.qJXfhr0J2dBqFbdGgYE35ARq3yjScpS_0 2024-09-14T11:22:50.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.982+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16089819726431470810', time=2024-09-14T13:13:52.672676+0000, chain.objs.size()=1 2024-09-14T11:22:50.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.982+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.203__shadow_.lvyZhcbUwPiV6pJ2Ejv50n0TP8Z54t3_0 2024-09-14T11:22:50.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.982+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2005712839528759702', time=2024-09-14T13:14:50.067884+0000, chain.objs.size()=1 2024-09-14T11:22:50.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.982+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.251__shadow_.LBTedTi7VcSYDp2Uy2r0qWUMMFCZzCw_0 2024-09-14T11:22:50.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.982+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2552432429898876728', time=2024-09-14T13:14:50.602848+0000, chain.objs.size()=1 2024-09-14T11:22:50.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.982+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.253__shadow_.iKMoay1MKwSUZtZnE4_w2TJX2Ay-JV5_0 2024-09-14T11:22:50.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.982+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12824756275069485753', time=2024-09-14T13:14:59.745417+0000, chain.objs.size()=1 2024-09-14T11:22:50.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.982+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.GLdz10lImSyU_Z5WHwxgy2n7a2DCV-i_0 2024-09-14T11:22:50.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.982+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3016853652463677756', time=2024-09-14T13:14:59.818466+0000, chain.objs.size()=1 2024-09-14T11:22:50.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.982+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.pDNcqr__d9Wc59FHCxHC8WGJfgabi-a_0 2024-09-14T11:22:50.982 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.982+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9962360493177062839', time=2024-09-14T13:14:59.898880+0000, chain.objs.size()=1 2024-09-14T11:22:50.983 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.982+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.aOmKqc9NIxtc3DCgswbtsfqVSVVH_KX_0 2024-09-14T11:22:50.983 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.982+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3585291675131471818', time=2024-09-14T13:14:59.932295+0000, chain.objs.size()=1 2024-09-14T11:22:50.983 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.982+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.ilPD5a4W3mnsfUTINeet3vCPCMwRDwa_0 2024-09-14T11:22:50.983 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.982+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6136348521467594914', time=2024-09-14T13:14:59.982452+0000, chain.objs.size()=1 2024-09-14T11:22:50.983 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.982+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.3MgtC5l91vn2024AGucD7Hwdmqz_MiB_0 2024-09-14T11:22:50.983 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.982+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10317404943487920189', time=2024-09-14T13:14:59.985651+0000, chain.objs.size()=1 2024-09-14T11:22:50.983 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.982+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.WeGVvDH_JozAJE73bGu01-gNls3DdiX_0 2024-09-14T11:22:50.983 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.982+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13271981830140923821', time=2024-09-14T13:15:00.088619+0000, chain.objs.size()=1 2024-09-14T11:22:50.983 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.982+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.ImsXAwixirqJmWzuzA3qUa2ERpqSBsW_0 2024-09-14T11:22:50.983 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.982+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9724760087404887258', time=2024-09-14T13:15:00.115405+0000, chain.objs.size()=1 2024-09-14T11:22:50.983 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.982+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.qQnX11aCn8MNZ4EyXOvBjL8rGoUi19Y_0 2024-09-14T11:22:50.984 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.984+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16154170988417346035', time=2024-09-14T13:15:00.133855+0000, chain.objs.size()=1 2024-09-14T11:22:50.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.984+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.kfQBnzI4vLsS5WFv9cctqTfxescXsjd_0 2024-09-14T11:22:50.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.984+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5295572351185327280', time=2024-09-14T13:15:00.227290+0000, chain.objs.size()=1 2024-09-14T11:22:50.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.984+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.5HBmQNaVKAja1Le8Hbqm7UgEf-VOHaF_0 2024-09-14T11:22:50.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.984+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7639029905659612186', time=2024-09-14T13:15:00.228193+0000, chain.objs.size()=1 2024-09-14T11:22:50.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.984+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.EyiQy4JKjyY-II_OGW7hHxbPfKNRD6z_0 2024-09-14T11:22:50.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.984+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7817008822556410359', time=2024-09-14T13:15:00.228797+0000, chain.objs.size()=1 2024-09-14T11:22:50.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.984+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.9IshtthFKATF4qJz90H2ymggiVfxRgG_0 2024-09-14T11:22:50.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.984+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13415193273051635412', time=2024-09-14T13:15:00.229472+0000, chain.objs.size()=1 2024-09-14T11:22:50.985 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.984+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Ra6RFupwowfaa1eKVVn_H4DBodnQ-sg_0 2024-09-14T11:22:50.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.984+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16064085515531441650', time=2024-09-14T13:15:00.230864+0000, chain.objs.size()=1 2024-09-14T11:22:50.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.984+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.9LJ6d1EDSrabfXRWrA_HimuC2AzDVws_0 2024-09-14T11:22:50.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.984+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2361897591105222746', time=2024-09-14T13:15:00.240552+0000, chain.objs.size()=1 2024-09-14T11:22:50.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.984+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.zARKu6UuFPkWqsoLkvia1ez1cafF7vR_0 2024-09-14T11:22:50.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.985+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8832132235211681687', time=2024-09-14T13:15:00.250047+0000, chain.objs.size()=1 2024-09-14T11:22:50.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.985+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.gQyyFmUVkCb546dsh124Ey-ZL4wUQgd_0 2024-09-14T11:22:50.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.985+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4487221369702389708', time=2024-09-14T13:15:00.253162+0000, chain.objs.size()=1 2024-09-14T11:22:50.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.985+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.yj7rG8ZTxRjKifQTs36MsnbDQDlXzMI_0 2024-09-14T11:22:50.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.985+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10429900303014909421', time=2024-09-14T13:15:00.259537+0000, chain.objs.size()=1 2024-09-14T11:22:50.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.985+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.mc9Rdm9cxhgQ9b5YrknofPDQonF_08-_0 2024-09-14T11:22:50.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.985+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5698857708357719877', time=2024-09-14T13:15:00.273892+0000, chain.objs.size()=1 2024-09-14T11:22:50.986 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.985+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.KW_6aS9lcEyw8kuByzC1-t_90s1fcMc_0 2024-09-14T11:22:50.988 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.987+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3334395235053768543', time=2024-09-14T13:15:00.286933+0000, chain.objs.size()=1 2024-09-14T11:22:50.988 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.987+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.h0eS9wo_ekjwlmeROmCS2R6YwkAryIv_0 2024-09-14T11:22:50.988 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.987+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15729560513655276964', time=2024-09-14T13:15:00.293232+0000, chain.objs.size()=1 2024-09-14T11:22:50.988 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.987+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.zDr83k6CsuUyDjqvpOqOGAEkuWmBQDp_0 2024-09-14T11:22:50.988 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.987+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7763236959557822996', time=2024-09-14T13:15:00.295572+0000, chain.objs.size()=1 2024-09-14T11:22:50.988 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.987+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.LfMdtZ2XL2MPUHKqo_78tuyx8IYJsRd_0 2024-09-14T11:22:50.988 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.987+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3103549521371867534', time=2024-09-14T13:15:00.401218+0000, chain.objs.size()=1 2024-09-14T11:22:50.988 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.987+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.PCeq6PnpuvqCgtG4_s-YqB0r1_5IGIn_0 2024-09-14T11:22:50.988 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.987+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13492405099201162185', time=2024-09-14T13:15:00.443629+0000, chain.objs.size()=1 2024-09-14T11:22:50.988 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.987+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.AnQIUs-AS7u5h8uoeOTBBorA4OOh8u2_0 2024-09-14T11:22:50.988 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.987+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7550367834729048385', time=2024-09-14T13:15:00.553866+0000, chain.objs.size()=1 2024-09-14T11:22:50.989 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.987+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.NRKM1SNgxgn6RcUMGod6oVhWlQe8CGV_0 2024-09-14T11:22:50.989 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.987+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2029889702427676503', time=2024-09-14T13:15:00.555580+0000, chain.objs.size()=1 2024-09-14T11:22:50.989 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.987+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.NINiOWQYZywVF1OENbtjbmF7K728stM_0 2024-09-14T11:22:50.989 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.987+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8549429217462656788', time=2024-09-14T13:15:00.571923+0000, chain.objs.size()=1 2024-09-14T11:22:50.989 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.987+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.iJ5nWzN_XcmHVfBr_vYwgSj3WKswmm6_0 2024-09-14T11:22:50.989 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.987+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9245586777982313734', time=2024-09-14T13:15:00.630302+0000, chain.objs.size()=1 2024-09-14T11:22:50.989 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.987+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.FXZunTOyEAZD3LkMTKPLBIQqyZxhevn_0 2024-09-14T11:22:50.989 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.987+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7370115790750115717', time=2024-09-14T13:15:00.722452+0000, chain.objs.size()=1 2024-09-14T11:22:50.989 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.987+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.lI2ei08tvQxmpUOPXH1yv2Ro1PxvEjR_0 2024-09-14T11:22:50.989 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.987+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7398213465486352076', time=2024-09-14T13:15:00.723221+0000, chain.objs.size()=1 2024-09-14T11:22:50.989 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.987+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.ChWQUiIFRlNkm7OESB4xrv6yIkSdfBa_0 2024-09-14T11:22:50.989 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.988+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17663792834226341450', time=2024-09-14T13:15:00.752298+0000, chain.objs.size()=1 2024-09-14T11:22:50.989 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.988+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.pwTtL1WY8a8fOE1H1gGtw_qBTrVgcqu_0 2024-09-14T11:22:50.990 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.989+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6141154455681675182', time=2024-09-14T13:15:00.762836+0000, chain.objs.size()=1 2024-09-14T11:22:50.990 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.989+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.JQXjgm8hOtC2IPukAU0WAllGEpS0sOU_0 2024-09-14T11:22:50.990 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.989+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7533743372291227501', time=2024-09-14T13:15:00.880437+0000, chain.objs.size()=1 2024-09-14T11:22:50.990 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.989+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.k_J54YgPMtKM4fy1GClvJsiCD_2nOJ2_0 2024-09-14T11:22:50.990 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.989+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15858664321709209059', time=2024-09-14T13:15:00.884638+0000, chain.objs.size()=1 2024-09-14T11:22:50.990 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.989+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.dBTe1W_EyS6tTr-EIE88TwQ_t8zmE0Y_0 2024-09-14T11:22:50.990 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.991+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16576654868643207419', time=2024-09-14T13:15:00.902329+0000, chain.objs.size()=1 2024-09-14T11:22:50.991 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.991+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.wA4xo8a853WQ7oHuIWXWkae7EN6vztG_0 2024-09-14T11:22:50.991 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.991+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12671952136614674816', time=2024-09-14T13:15:00.941597+0000, chain.objs.size()=1 2024-09-14T11:22:50.991 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.991+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.8O1aUTc2ZdsR5Sd91zYP7rB3j3tXDi7_0 2024-09-14T11:22:50.991 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.991+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18245731910920410663', time=2024-09-14T13:15:01.153287+0000, chain.objs.size()=1 2024-09-14T11:22:50.991 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.991+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.263__shadow_.eny3U0azF7go7Uv1exANWc-7JJLw5vi_0 2024-09-14T11:22:50.991 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.991+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16219923831606475717', time=2024-09-14T13:15:06.422163+0000, chain.objs.size()=1 2024-09-14T11:22:50.991 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.991+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.283__shadow_.7svpHvlBM6x97oL-VOeF_RExDHsmWEf_0 2024-09-14T11:22:50.991 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.991+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4106045500365198153', time=2024-09-14T13:15:07.002452+0000, chain.objs.size()=1 2024-09-14T11:22:50.991 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.991+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.285__shadow_.4FmM0hUNe6cPmYaLbYXiPljGy_vXEnl_0 2024-09-14T11:22:50.991 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.991+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1669758265928452963', time=2024-09-14T13:15:08.047454+0000, chain.objs.size()=1 2024-09-14T11:22:50.991 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.991+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.289__shadow_.BoaYFPTxCFnIbNXZu7PQix13e-t8O3p_0 2024-09-14T11:22:50.992 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.991+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8362756003246337231', time=2024-09-14T13:15:09.256156+0000, chain.objs.size()=1 2024-09-14T11:22:50.992 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.991+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.292__shadow_.gNjTW870ERUoalF0BQi9jny4vVE0Zok_0 2024-09-14T11:22:50.992 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.991+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8909817114908512559', time=2024-09-14T13:15:11.948322+0000, chain.objs.size()=1 2024-09-14T11:22:50.992 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.991+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.301__shadow_.B-gSAc0Nh-FGmNS4KsBR6TpgxBUvFmt_0 2024-09-14T11:22:50.992 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.991+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14563831822619163095', time=2024-09-14T13:15:13.917784+0000, chain.objs.size()=1 2024-09-14T11:22:50.992 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.991+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.307__shadow:p-X5Nj9Tj1whZp3ZVMVYwBTisTrVd0D_.iT8M-jvBCjVcfsXs9tg2zbltM4VVVgd_0 2024-09-14T11:22:50.992 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.991+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2726440296332757861', time=2024-09-14T13:15:15.178770+0000, chain.objs.size()=1 2024-09-14T11:22:50.992 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.991+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.313__shadow_.Wct_o-jxKouJLfZTKUn1RRqAI_MsJ0l_0 2024-09-14T11:22:50.992 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.991+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16094052690344636636', time=2024-09-14T13:15:24.736924+0000, chain.objs.size()=1 2024-09-14T11:22:50.992 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.991+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.XR3cO0FFS3SxdPln7uYcM-tL4bG_bez_0 2024-09-14T11:22:50.993 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.993+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4929902380019936181', time=2024-09-14T13:15:24.790252+0000, chain.objs.size()=1 2024-09-14T11:22:50.993 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.993+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.XvIwLcZI9pprUdvbAlj-ru_BnQgYTVb_0 2024-09-14T11:22:50.993 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.993+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17659158822456043809', time=2024-09-14T13:15:24.882222+0000, chain.objs.size()=1 2024-09-14T11:22:50.994 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.993+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.8IHauBtpe_K-ZYVWkqPM8b3keiviEcF_0 2024-09-14T11:22:50.994 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.993+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13127268309448275538', time=2024-09-14T13:15:24.944436+0000, chain.objs.size()=1 2024-09-14T11:22:50.994 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.993+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.JZeMssZUkP-_xAum7lypJyBd5QyQcCv_0 2024-09-14T11:22:50.994 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.993+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9764381975427763777', time=2024-09-14T13:15:24.946776+0000, chain.objs.size()=1 2024-09-14T11:22:50.994 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.993+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.JyDyA22ZnxYBUNxGZeLK-GN0uikJyWf_0 2024-09-14T11:22:50.994 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.993+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17378618120765795411', time=2024-09-14T13:15:24.954099+0000, chain.objs.size()=1 2024-09-14T11:22:50.994 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.993+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.NWikDXQ2J7GTWSytBzEDdEYNz1TG7lx_0 2024-09-14T11:22:50.994 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.993+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17868306560929583060', time=2024-09-14T13:15:24.956883+0000, chain.objs.size()=1 2024-09-14T11:22:50.994 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.993+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.FaEjkOydm1NxnuPoHh2EvlqRL1YTEEB_0 2024-09-14T11:22:50.994 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.993+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15853899958808914771', time=2024-09-14T13:15:25.042689+0000, chain.objs.size()=1 2024-09-14T11:22:50.994 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.993+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.9_-xtOsvLm5kdtHRP9lft3FcZLs7o-a_0 2024-09-14T11:22:50.994 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.993+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17307680468447647677', time=2024-09-14T13:15:25.059177+0000, chain.objs.size()=1 2024-09-14T11:22:50.995 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.993+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.3IHhlb94B4mwfDOb4Dn1iry5d7MO8NZ_0 2024-09-14T11:22:50.995 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.994+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3486607730691243009', time=2024-09-14T13:15:25.060738+0000, chain.objs.size()=1 2024-09-14T11:22:50.995 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.994+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.wKorz-3rJCCxV8UZJLpv_FruILZRCPE_0 2024-09-14T11:22:50.995 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.994+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9481375438554713670', time=2024-09-14T13:15:25.074674+0000, chain.objs.size()=1 2024-09-14T11:22:50.995 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.994+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.VaUBoQDJkfxS761EAyrDuVmm2CjXGGw_0 2024-09-14T11:22:50.995 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.994+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4141577649870121228', time=2024-09-14T13:15:25.078766+0000, chain.objs.size()=1 2024-09-14T11:22:50.995 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.994+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.f-GKYjod1e7zmZdz57phsCLZqufpB_l_0 2024-09-14T11:22:50.995 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.994+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7297739493518428811', time=2024-09-14T13:15:25.095062+0000, chain.objs.size()=1 2024-09-14T11:22:50.995 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.994+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.sJo1SU4gW71ptRX95YJLFwq4xfqkw_m_0 2024-09-14T11:22:50.995 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.994+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16856933568835688458', time=2024-09-14T13:15:25.106311+0000, chain.objs.size()=1 2024-09-14T11:22:50.995 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.994+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.stzNv9qMLHC4tSdX-dhjwDX2-q0fn2q_0 2024-09-14T11:22:50.995 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.995+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8434556871289124622', time=2024-09-14T13:15:25.259629+0000, chain.objs.size()=1 2024-09-14T11:22:50.995 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.995+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.mTxil5KvgvgRtcGR2WqReLlc8inqSUD_0 2024-09-14T11:22:50.997 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.995+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4717952984537739181', time=2024-09-14T13:15:25.260339+0000, chain.objs.size()=1 2024-09-14T11:22:50.997 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.995+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.4aQGjES5tgMRtfoH5j84C2NQ6VCgbQ5_0 2024-09-14T11:22:50.997 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.995+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14424975042472305646', time=2024-09-14T13:15:25.268454+0000, chain.objs.size()=1 2024-09-14T11:22:50.998 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.995+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.Oo8tv3oqD1GoNgZYnBOAUpI55oJQCyu_0 2024-09-14T11:22:50.998 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.995+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17024052936721069495', time=2024-09-14T13:15:25.365367+0000, chain.objs.size()=1 2024-09-14T11:22:50.998 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.995+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.K3Y4i1XzW794ya6UcENhwaDFgJWmK-j_0 2024-09-14T11:22:50.998 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.995+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14687817744100710783', time=2024-09-14T13:15:25.373686+0000, chain.objs.size()=1 2024-09-14T11:22:50.998 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.995+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.Y8aw5BdCYPBY13TsgS1TfGmO-leuhw2_0 2024-09-14T11:22:50.998 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.995+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14136786614923353114', time=2024-09-14T13:15:25.378374+0000, chain.objs.size()=1 2024-09-14T11:22:50.998 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.995+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.O2W0E9g9Cz4GogL6W65_d71umLTGPLH_0 2024-09-14T11:22:50.998 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.995+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9000900181212419429', time=2024-09-14T13:15:25.391091+0000, chain.objs.size()=1 2024-09-14T11:22:50.998 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.995+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.fhut4w_hK9xIdlFua7sR21lkpHY7bg8_0 2024-09-14T11:22:50.998 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.996+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.81513701204745722', time=2024-09-14T13:15:25.440680+0000, chain.objs.size()=1 2024-09-14T11:22:50.998 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.996+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.6llQC9QVRvvVFsnqfB1cQgV8tzCQ2mI_0 2024-09-14T11:22:50.998 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.996+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11922103841368560748', time=2024-09-14T13:15:25.447767+0000, chain.objs.size()=1 2024-09-14T11:22:50.998 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.996+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.bgjxhrIWkjG3BZQHP1cuAa70su1MTjn_0 2024-09-14T11:22:50.999 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.996+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6430073316854741122', time=2024-09-14T13:15:25.526749+0000, chain.objs.size()=1 2024-09-14T11:22:50.999 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.996+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.FFWlRMwkbR0OCjS12lwLJHfpZjUlXf0_0 2024-09-14T11:22:50.999 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.997+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16556873973531857762', time=2024-09-14T13:15:25.528348+0000, chain.objs.size()=1 2024-09-14T11:22:50.999 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.997+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.2VDAJeFSijQPF2xFRww2vw-n7d9sPfJ_0 2024-09-14T11:22:50.999 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.997+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10338875129028214525', time=2024-09-14T13:15:25.542727+0000, chain.objs.size()=1 2024-09-14T11:22:50.999 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.997+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_._A-snpp5nJUZ8L1AU4uBDtXgxmovMwP_0 2024-09-14T11:22:50.999 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.997+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6779558459727565850', time=2024-09-14T13:15:25.544261+0000, chain.objs.size()=1 2024-09-14T11:22:50.999 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.997+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.W6EhkVVtX9k-LwPRFGQ6_cdcI3lr8Xt_0 2024-09-14T11:22:50.999 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.997+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7222414676017070780', time=2024-09-14T13:15:25.572858+0000, chain.objs.size()=1 2024-09-14T11:22:50.999 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.997+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.S2SkWvYDXUHlW1FjgbY5f810_yizSC2_0 2024-09-14T11:22:50.999 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.997+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8941002032001148872', time=2024-09-14T13:15:25.614162+0000, chain.objs.size()=1 2024-09-14T11:22:50.999 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.997+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.o8HiXlDULFkEnXoDZg2efhxpZsTg-RO_0 2024-09-14T11:22:50.999 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.997+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4028460034906838010', time=2024-09-14T13:15:25.757027+0000, chain.objs.size()=1 2024-09-14T11:22:51.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.997+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.hJsqU8mFXXriBtu8G-TMFPyVLQ6SWNK_0 2024-09-14T11:22:51.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.997+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6953705359635791915', time=2024-09-14T13:15:25.763920+0000, chain.objs.size()=1 2024-09-14T11:22:51.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.997+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.Y1_3H9ffIZ2kV3GSPnMauP0V9ovP3ft_0 2024-09-14T11:22:51.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.997+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3869156484183118776', time=2024-09-14T13:15:25.879217+0000, chain.objs.size()=1 2024-09-14T11:22:51.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.997+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_._z08Y-aeuaiMphNCiKR2hT2IWAHEdJ5_0 2024-09-14T11:22:51.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.998+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8082617906351032267', time=2024-09-14T13:15:25.913765+0000, chain.objs.size()=1 2024-09-14T11:22:51.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.998+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.VhUNKZc60FUhnBhNF6UZ7782gesdJma_0 2024-09-14T11:22:51.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.998+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12178596281077036603', time=2024-09-14T13:15:25.915512+0000, chain.objs.size()=1 2024-09-14T11:22:51.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.998+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.Gu6HYkf05NBWtzZtF5_3bv4E7_j4447_0 2024-09-14T11:22:51.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.998+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13790440241532814427', time=2024-09-14T13:15:33.169029+0000, chain.objs.size()=1 2024-09-14T11:22:51.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.998+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Kj8pfGXspK1SadE8sRu28Z68K69JCYQ_0 2024-09-14T11:22:51.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.998+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.578738046878649795', time=2024-09-14T13:15:33.169655+0000, chain.objs.size()=1 2024-09-14T11:22:51.000 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.998+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.pE8JRNW7TFacBSon_Gky3AQm2pFkMlB_0 2024-09-14T11:22:51.001 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.998+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17511230143542479015', time=2024-09-14T13:15:33.368898+0000, chain.objs.size()=1 2024-09-14T11:22:51.001 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.998+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.VynO5PfjDbAhH2Hz0R20PKqOjvlGziC_0 2024-09-14T11:22:51.001 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.998+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13980119249855886620', time=2024-09-14T13:15:33.415122+0000, chain.objs.size()=1 2024-09-14T11:22:51.001 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.998+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.2Ry6ZH1pYU36nnPJWuruBhgAcazY2Ov_0 2024-09-14T11:22:51.001 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.998+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8255474676034530475', time=2024-09-14T13:15:33.440437+0000, chain.objs.size()=1 2024-09-14T11:22:51.001 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.998+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.XGd7P470RgKBkbxepumFBbsQXuibOqS_0 2024-09-14T11:22:51.001 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.998+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12243256239810546025', time=2024-09-14T13:15:33.452270+0000, chain.objs.size()=1 2024-09-14T11:22:51.001 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.998+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.QIhAnh0E3dwEWWxm1hhm5jtuJSODQC1_0 2024-09-14T11:22:51.001 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.999+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4968769997163670992', time=2024-09-14T13:15:33.539541+0000, chain.objs.size()=1 2024-09-14T11:22:51.001 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.999+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.ukFqu7k1v7c5ZT56EjiZiTsVgR_Sd5g_0 2024-09-14T11:22:51.001 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.999+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5283674307462296627', time=2024-09-14T13:15:33.540966+0000, chain.objs.size()=1 2024-09-14T11:22:51.001 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.999+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.ORoRd71WeJ72SURqRPjDL1KxbjEqHCD_0 2024-09-14T11:22:51.001 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.999+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16494256478856809299', time=2024-09-14T13:15:33.580554+0000, chain.objs.size()=1 2024-09-14T11:22:51.001 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:50.999+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.rfm898yqVub_4FFeyCf78fdCkK17zVE_0 2024-09-14T11:22:51.002 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.001+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1128447864124702047', time=2024-09-14T13:15:33.590134+0000, chain.objs.size()=1 2024-09-14T11:22:51.002 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.001+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.GHx7Vbc1KSpX1XklZU9chwweRb9iyCh_0 2024-09-14T11:22:51.003 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.001+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11908990563646601066', time=2024-09-14T13:15:33.592088+0000, chain.objs.size()=1 2024-09-14T11:22:51.003 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.001+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.HYasvtyu979IjxiPKDYeehCblAEGB3d_0 2024-09-14T11:22:51.003 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.001+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4711891003078637425', time=2024-09-14T13:15:33.736919+0000, chain.objs.size()=1 2024-09-14T11:22:51.003 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.001+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.TvA50XWL9acVua3xdDGtHHiRVkgqrYd_0 2024-09-14T11:22:51.003 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.001+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.102479069518518830', time=2024-09-14T13:15:33.764496+0000, chain.objs.size()=1 2024-09-14T11:22:51.003 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.001+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.OlrC6CXbDVrUutIKmLJLYtR2X7oo-Fm_0 2024-09-14T11:22:51.003 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.001+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8472518473024174680', time=2024-09-14T13:15:33.767839+0000, chain.objs.size()=1 2024-09-14T11:22:51.003 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.001+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.ehxMkWFyMMOHQuXF3OanbZ4PavzBT8y_0 2024-09-14T11:22:51.003 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.001+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5002330833595141904', time=2024-09-14T13:15:33.773386+0000, chain.objs.size()=1 2024-09-14T11:22:51.003 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.001+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.1g0LBHxVzmKJW2UzP0GhCoggZXR5Jjn_0 2024-09-14T11:22:51.003 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.001+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.311982062549513318', time=2024-09-14T13:15:33.778521+0000, chain.objs.size()=1 2024-09-14T11:22:51.003 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.001+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.U0cM57QSAt7SkllvQFrB4iToBPVgTEc_0 2024-09-14T11:22:51.003 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.001+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17359156144504236231', time=2024-09-14T13:15:33.855643+0000, chain.objs.size()=1 2024-09-14T11:22:51.004 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.001+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.n2TtvfwfFKD2uUcJb-LXZSQHiyrZh8-_0 2024-09-14T11:22:51.004 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.001+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1072383686127432634', time=2024-09-14T13:15:33.888492+0000, chain.objs.size()=1 2024-09-14T11:22:51.004 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.001+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.am2SAtfBkgjfAiGdmTtchdLnOr3Vfwt_0 2024-09-14T11:22:51.004 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.003+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 0/46998 2024-09-14T11:22:51.004 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.005+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=28, truncated=0, next_marker='' 2024-09-14T11:22:51.005 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.005+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11047712472828338154', time=2024-09-14T13:15:33.933245+0000, chain.objs.size()=1 2024-09-14T11:22:51.005 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.005+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.P-H_-QynAYx9m4d1ltwmmO3mckou0gY_0 2024-09-14T11:22:51.005 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.005+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16732806474969344650', time=2024-09-14T13:15:34.029128+0000, chain.objs.size()=1 2024-09-14T11:22:51.005 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.005+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.hwkpiAome4iAMps2kSEEQX-8XZlt3OY_0 2024-09-14T11:22:51.005 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.005+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7813491412236719104', time=2024-09-14T13:15:34.081335+0000, chain.objs.size()=1 2024-09-14T11:22:51.005 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.005+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.xeQYzDxvL5lOsVXFCsLloO1RPMlQhNO_0 2024-09-14T11:22:51.005 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.005+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4261401234433401354', time=2024-09-14T13:15:34.092752+0000, chain.objs.size()=1 2024-09-14T11:22:51.005 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.005+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.a0TmRfVPrKYUO11XcZ0bFxY_X1_0Fom_0 2024-09-14T11:22:51.005 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.005+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13048646378666213157', time=2024-09-14T13:15:34.174845+0000, chain.objs.size()=1 2024-09-14T11:22:51.005 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.005+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.DNtDzYggfEFQgDk8cStFR5rB2IUYTSv_0 2024-09-14T11:22:51.005 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.005+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16198636630284780605', time=2024-09-14T13:15:34.176183+0000, chain.objs.size()=1 2024-09-14T11:22:51.005 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.005+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.HAywcnoiB1tmM7ZVr7vmtuY6t2Z1aJ0_0 2024-09-14T11:22:51.006 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.005+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14434873883533501025', time=2024-09-14T13:15:34.187111+0000, chain.objs.size()=1 2024-09-14T11:22:51.006 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.005+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.oLj17Tp-tFjT0otBTThLwi0j-PduAX1_0 2024-09-14T11:22:51.006 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.005+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17511611056435346696', time=2024-09-14T13:15:34.191671+0000, chain.objs.size()=1 2024-09-14T11:22:51.006 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.005+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.O9EdCwii2-fYe3Tl3msG98LA593IfmS_0 2024-09-14T11:22:51.006 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.005+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.73209570357527190', time=2024-09-14T13:15:34.229228+0000, chain.objs.size()=1 2024-09-14T11:22:51.006 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.005+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.yHu1e7Lpz86G9JJLZVQ97CVOj6tyv2m_0 2024-09-14T11:22:51.006 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.005+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4744893534489804238', time=2024-09-14T13:15:34.248286+0000, chain.objs.size()=1 2024-09-14T11:22:51.006 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.005+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.WGcas1BhS_7eIwr-NkRxLmjD1ywe22H_0 2024-09-14T11:22:51.006 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.005+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13993940635787267128', time=2024-09-14T13:15:34.371690+0000, chain.objs.size()=1 2024-09-14T11:22:51.006 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.005+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.E5pOvZJ0Ek3TuEM3_ub0svbnoSDrvve_0 2024-09-14T11:22:51.006 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.005+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12319901982693127933', time=2024-09-14T13:15:34.373365+0000, chain.objs.size()=1 2024-09-14T11:22:51.006 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.005+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.WSdu02rqItTJeF7LfJpBo6Nc9dteLQF_0 2024-09-14T11:22:51.007 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.008+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3264928837443572398', time=2024-09-14T13:15:34.402359+0000, chain.objs.size()=1 2024-09-14T11:22:51.007 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.008+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.sFU_Sijgb3ddFLIeafJL0puu9eNE7ba_0 2024-09-14T11:22:51.007 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.008+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7806945102852918193', time=2024-09-14T13:15:38.890997+0000, chain.objs.size()=1 2024-09-14T11:22:51.007 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.008+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.342__shadow_.olUSQhFG9TUNqnxZjqu3VrDGp8frWsn_0 2024-09-14T11:22:51.008 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.008+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16641112854959112191', time=2024-09-14T13:16:07.313702+0000, chain.objs.size()=1 2024-09-14T11:22:51.008 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.008+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.447__shadow_.xowyNKoOc6R5U-3hvtD5zB4Dp6jee4f_0 2024-09-14T11:22:51.008 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.008+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1028903403367903002', time=2024-09-14T13:16:09.845845+0000, chain.objs.size()=1 2024-09-14T11:22:51.008 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.008+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.456__shadow_.WCS0kR-8zjaFbOKAuCPdQONySWorbMS_0 2024-09-14T11:22:51.008 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.008+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1875219641631661637', time=2024-09-14T13:16:19.926663+0000, chain.objs.size()=1 2024-09-14T11:22:51.008 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.008+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.493__shadow_.QeoHumNyFdnTJS1SU_FeI1CK8OC3qXi_0 2024-09-14T11:22:51.008 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.008+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2022937575588254470', time=2024-09-14T13:16:20.300943+0000, chain.objs.size()=1 2024-09-14T11:22:51.008 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.008+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.495__shadow_.UZZl6LM-kwvyQjLvXwhbYs2ho3hFpmB_0 2024-09-14T11:22:51.008 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.008+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10016811112348862618', time=2024-09-14T13:16:27.530881+0000, chain.objs.size()=1 2024-09-14T11:22:51.008 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.008+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.518__multipart_mymultipart.2~WxI19RJqSSMeJeDziOuBWrOwV9j4nYB.1 2024-09-14T11:22:51.008 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.008+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6712915458273113173', time=2024-09-14T13:16:38.822692+0000, chain.objs.size()=4 2024-09-14T11:22:51.008 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.008+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.527__multipart_mymultipart.2~GfTLD6W4sitjstLby5U89S0Iq3_kCy3.1 2024-09-14T11:22:51.009 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.008+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.527__multipart_mymultipart.2~GfTLD6W4sitjstLby5U89S0Iq3_kCy3.2 2024-09-14T11:22:51.009 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.008+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.527__multipart_mymultipart.2~GfTLD6W4sitjstLby5U89S0Iq3_kCy3.3 2024-09-14T11:22:51.009 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.008+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.527__multipart_mymultipart.2~GfTLD6W4sitjstLby5U89S0Iq3_kCy3.4 2024-09-14T11:22:51.009 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.010+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.232864492957882637', time=2024-09-14T13:17:12.141416+0000, chain.objs.size()=1 2024-09-14T11:22:51.009 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.010+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.555__shadow_.UrGyJp9v625wbImVdoKv0Lh4FDWzEsg_0 2024-09-14T11:22:51.009 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.010+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14111735223267410252', time=2024-09-14T13:17:19.328287+0000, chain.objs.size()=2 2024-09-14T11:22:51.009 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.010+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.563__shadow_.H2uHH5k44c18SdVvr3ZvQhh8MkepVZL_0 2024-09-14T11:22:51.010 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.010+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.563__shadow_.H2uHH5k44c18SdVvr3ZvQhh8MkepVZL_1 2024-09-14T11:22:51.010 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.010+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14352214660489565172', time=2024-09-14T13:17:19.882609+0000, chain.objs.size()=1 2024-09-14T11:22:51.010 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.010+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.565__shadow_.rZSKZlMLj3M8e8gahMAZKFqVAEFriT6_0 2024-09-14T11:22:51.010 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.010+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16438814481133318017', time=2024-09-14T13:17:22.392412+0000, chain.objs.size()=1 2024-09-14T11:22:51.010 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.010+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.569__shadow:QnUwFp70AcOL4jAu9OiXY9pEYU6NOpG_.IkmmsC4iJZMBKCDVgVFTitMv9xhPK-2_0 2024-09-14T11:22:51.010 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.010+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13337875832829846905', time=2024-09-14T13:17:42.061175+0000, chain.objs.size()=1 2024-09-14T11:22:51.010 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.010+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.577__shadow:6.gp29P7GGP9MyfE9sTtsGbNliUmMON_.0sQeb99hMClIBFQr5wOKw1Ap8Ke4gqj_0 2024-09-14T11:22:51.010 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.011+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5988369505143411800', time=2024-09-14T13:17:44.655069+0000, chain.objs.size()=1 2024-09-14T11:22:51.010 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.011+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.577__shadow:UAilkUGJS3l.JgiWh-KbeG2qolKdIDg_.qO-zz2130LilVWMb4QDuSJuphOjFAiL_0 2024-09-14T11:22:51.010 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.011+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7319925324994734003', time=2024-09-14T13:20:20.421095+0000, chain.objs.size()=1 2024-09-14T11:22:51.011 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.011+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.664__shadow_.mPZ6uGJ9tiCocTzOiIdwjMORc626Ian_0 2024-09-14T11:22:51.011 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.011+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13756106285610709020', time=2024-09-14T13:20:30.827067+0000, chain.objs.size()=1 2024-09-14T11:22:51.011 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.011+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.705__shadow:wuF-y0Pha-Tb.hHBZH2V4.t1XP0cE9z_.nvksu96EC6HPHvHPOWSlsqHP2zUxYzu_0 2024-09-14T11:22:51.012 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.014+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:51.014 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.016+0000 7f0f19c16800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:22:51.016 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.017+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:51.016 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.017+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:51.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.018+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44724' 2024-09-14T11:22:51.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.018+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='_qMS9AhD6HJ0cHD_mKL2tA944XT732Tq', time=2024-09-14T13:13:34.795526+0000, chain.objs.size()=2 2024-09-14T11:22:51.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.018+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.160__shadow_.SQv_EyHTBtTq3G0aVfne1gX-tp6ek05_0 2024-09-14T11:22:51.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.018+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.160__shadow_.SQv_EyHTBtTq3G0aVfne1gX-tp6ek05_1 2024-09-14T11:22:51.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.018+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18209569031942389258', time=2024-09-14T13:13:34.993735+0000, chain.objs.size()=2 2024-09-14T11:22:51.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.018+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.160__shadow_.LDRMZlV4yNoXWHGpywueLP4nD2DpabO_0 2024-09-14T11:22:51.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.018+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.160__shadow_.LDRMZlV4yNoXWHGpywueLP4nD2DpabO_1 2024-09-14T11:22:51.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.018+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11328555473862388068', time=2024-09-14T13:13:46.619154+0000, chain.objs.size()=1 2024-09-14T11:22:51.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.018+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.189__shadow_.8ll5ccoO9GC5YjhWzIR1mSmEmTWCp6E_0 2024-09-14T11:22:51.018 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.018+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1475099528327139666', time=2024-09-14T13:14:52.369492+0000, chain.objs.size()=1 2024-09-14T11:22:51.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.018+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.260__shadow_.V2_80vA86aMxUpa90VtVhINXmYmo5NB_0 2024-09-14T11:22:51.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.018+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10792554455541433281', time=2024-09-14T13:14:52.624923+0000, chain.objs.size()=1 2024-09-14T11:22:51.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.018+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.261__shadow_.bxCfpnLfGNpcD3ztL6aa5LcpNdAU3Ug_0 2024-09-14T11:22:51.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.018+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10152445029043178192', time=2024-09-14T13:14:52.625631+0000, chain.objs.size()=1 2024-09-14T11:22:51.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.018+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.261__shadow_.c5zI9paM5pmT1nsG6ayHsJJYy9tDgfO_0 2024-09-14T11:22:51.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.018+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15391536273608254309', time=2024-09-14T13:14:59.793068+0000, chain.objs.size()=1 2024-09-14T11:22:51.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.018+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.7MooKW6zj4gASA19iXQA7hHyWzlR7He_0 2024-09-14T11:22:51.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.019+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7435945825843028484', time=2024-09-14T13:14:59.806230+0000, chain.objs.size()=1 2024-09-14T11:22:51.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.019+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.o0RwwVo03F3h0wPkE_vPEr2sfXWEi_z_0 2024-09-14T11:22:51.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.019+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13490892844414561920', time=2024-09-14T13:14:59.918710+0000, chain.objs.size()=1 2024-09-14T11:22:51.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.019+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.HjrWHpHllnGUDEfCzVK5weFHRNFPOhx_0 2024-09-14T11:22:51.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.019+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12896291535961211586', time=2024-09-14T13:14:59.926186+0000, chain.objs.size()=1 2024-09-14T11:22:51.019 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.019+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.2mi-CJ9-br2auS98kWfFT8meNq1dFDV_0 2024-09-14T11:22:51.021 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.022+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.208373854472760294', time=2024-09-14T13:14:59.957592+0000, chain.objs.size()=1 2024-09-14T11:22:51.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.022+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.wXcF7VneO63W7KZauvz4FUTNoMGtgXT_0 2024-09-14T11:22:51.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.022+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11757978396207411356', time=2024-09-14T13:15:00.099611+0000, chain.objs.size()=1 2024-09-14T11:22:51.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.022+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.ij4_0s8ksAKmdmdCpajWhiHcB58l_lR_0 2024-09-14T11:22:51.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.022+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16669283282715695284', time=2024-09-14T13:15:00.118534+0000, chain.objs.size()=1 2024-09-14T11:22:51.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.022+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.3du1Uc8Rpfnui7Hj4Wsvg2ZtHf4BtSn_0 2024-09-14T11:22:51.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.022+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17162628254721037693', time=2024-09-14T13:15:00.120079+0000, chain.objs.size()=1 2024-09-14T11:22:51.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.022+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Y5KHomkoLYOf8iAQX2dC4FojwtJEBdK_0 2024-09-14T11:22:51.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.022+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2069546141585358145', time=2024-09-14T13:15:00.134032+0000, chain.objs.size()=1 2024-09-14T11:22:51.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.022+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_._HJJN9_pf752mJ51r5mIGnsekH4zvSR_0 2024-09-14T11:22:51.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.022+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18405513714290030709', time=2024-09-14T13:15:00.141702+0000, chain.objs.size()=1 2024-09-14T11:22:51.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.022+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.eSkawpqd6tF1qj7nnERtWh9clWRMa0S_0 2024-09-14T11:22:51.022 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.022+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7505790267285503908', time=2024-09-14T13:15:00.146202+0000, chain.objs.size()=1 2024-09-14T11:22:51.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.022+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.AZ83dKuK0U2AxCqL4t6b7IwDVz_m2RX_0 2024-09-14T11:22:51.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.022+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5392293430818869222', time=2024-09-14T13:15:00.259588+0000, chain.objs.size()=1 2024-09-14T11:22:51.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.022+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.LgNsORB_mpgm4M1g6JDo5TCMfhWZX8U_0 2024-09-14T11:22:51.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.022+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9418470118688933717', time=2024-09-14T13:15:00.297543+0000, chain.objs.size()=1 2024-09-14T11:22:51.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.022+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.0f3wZ2uIOKrPYhAm07q2TkHiyw7c2jK_0 2024-09-14T11:22:51.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.022+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12275189657448640447', time=2024-09-14T13:15:00.389886+0000, chain.objs.size()=1 2024-09-14T11:22:51.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.022+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.pBsXH6Ilxk8vauwJqimpuQTLBccWwwV_0 2024-09-14T11:22:51.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.022+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7654022817513185008', time=2024-09-14T13:15:00.392997+0000, chain.objs.size()=1 2024-09-14T11:22:51.023 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.022+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.7UScZq71on672APzJLSZUx2sDXOlomw_0 2024-09-14T11:22:51.024 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.024+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1353063666107077606', time=2024-09-14T13:15:00.463883+0000, chain.objs.size()=1 2024-09-14T11:22:51.024 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.024+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.n1ufK7Yd7-T85mcy_mpQ4_zkSUombSl_0 2024-09-14T11:22:51.024 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.024+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2555990906869730702', time=2024-09-14T13:15:00.551233+0000, chain.objs.size()=1 2024-09-14T11:22:51.024 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.024+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.lAE9jfSL6qCGp_G0vVh2ciio_w2g-6l_0 2024-09-14T11:22:51.024 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.024+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16952851863407338163', time=2024-09-14T13:15:00.556074+0000, chain.objs.size()=1 2024-09-14T11:22:51.024 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.024+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.-Ii4S9cHeVVetFnWAYWp0K2uTaG7h9e_0 2024-09-14T11:22:51.024 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.025+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15608413559855257447', time=2024-09-14T13:15:00.611857+0000, chain.objs.size()=1 2024-09-14T11:22:51.024 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.025+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.s3jYr8tW3sJG2TtpMZ2CGaXRc8jP8mA_0 2024-09-14T11:22:51.025 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.025+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.656503054112383003', time=2024-09-14T13:15:00.617719+0000, chain.objs.size()=1 2024-09-14T11:22:51.025 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.025+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.7Qtb1Wz5cq4mPfWw_F-DYYjpEaK4-Ih_0 2024-09-14T11:22:51.025 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.025+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16309522799002238411', time=2024-09-14T13:15:00.618402+0000, chain.objs.size()=1 2024-09-14T11:22:51.025 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.025+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.pUu8E5QLmebG1Aa-cOmuUtUMlUCVwTZ_0 2024-09-14T11:22:51.025 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.025+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14698300245720075638', time=2024-09-14T13:15:00.634395+0000, chain.objs.size()=1 2024-09-14T11:22:51.025 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.025+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.4smQ8s91QyvgM2Qn-5E8ofHj7MmjlhN_0 2024-09-14T11:22:51.025 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.025+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10018136184553461238', time=2024-09-14T13:15:00.714738+0000, chain.objs.size()=1 2024-09-14T11:22:51.025 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.025+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.gXBxBpjFZ8qbUvgQur8JQSkaq0BrbBe_0 2024-09-14T11:22:51.025 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.025+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9495205723727954604', time=2024-09-14T13:15:00.780451+0000, chain.objs.size()=1 2024-09-14T11:22:51.025 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.025+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Sil_pJo9dy-WAnO37yeSi-VZCpOg0-f_0 2024-09-14T11:22:51.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.026+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16916825554720642099', time=2024-09-14T13:15:00.783770+0000, chain.objs.size()=1 2024-09-14T11:22:51.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.026+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.6JAxEeRySzSaVFMzij_daM5OI0oID5N_0 2024-09-14T11:22:51.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.026+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16481305973079202011', time=2024-09-14T13:15:00.794949+0000, chain.objs.size()=1 2024-09-14T11:22:51.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.026+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.BtR_MoNMnl5lgQfOB0tP7K4SjUzJrdU_0 2024-09-14T11:22:51.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.026+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1886256608540503821', time=2024-09-14T13:15:00.876527+0000, chain.objs.size()=1 2024-09-14T11:22:51.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.026+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.PdadyOtdR8qFKHq7vaOwSZ3Td5JJMQ9_0 2024-09-14T11:22:51.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.026+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2419660957361041521', time=2024-09-14T13:15:00.892247+0000, chain.objs.size()=1 2024-09-14T11:22:51.026 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.026+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.G4mVOdGOUkpWD6-aB6hz3zz5BlWjGqr_0 2024-09-14T11:22:51.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.026+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12284858539866310874', time=2024-09-14T13:15:00.911927+0000, chain.objs.size()=1 2024-09-14T11:22:51.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.026+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.nfhX8qgQ7oD0dhZr3xYacBsAp9J3RjJ_0 2024-09-14T11:22:51.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.026+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15271069669426800140', time=2024-09-14T13:15:00.920410+0000, chain.objs.size()=1 2024-09-14T11:22:51.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.026+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.db0D24CWaGdghr_B5BCCA5OPMEo4sOB_0 2024-09-14T11:22:51.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.027+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15118904929904399488', time=2024-09-14T13:15:00.929949+0000, chain.objs.size()=1 2024-09-14T11:22:51.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.027+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.2fi6VJvpkok6pe1JUoYzQ3M8qiaIV7y_0 2024-09-14T11:22:51.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.027+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11927214763596976076', time=2024-09-14T13:15:00.934985+0000, chain.objs.size()=1 2024-09-14T11:22:51.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.027+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.pEdLlIipKZ3e_Waot_wnguKfY_P8Vop_0 2024-09-14T11:22:51.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.027+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18427025638649146359', time=2024-09-14T13:15:00.943658+0000, chain.objs.size()=1 2024-09-14T11:22:51.027 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.027+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.7vE-AM5Ug8iVp-w9ROXCM7N-2yHj2SQ_0 2024-09-14T11:22:51.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.028+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4778586629031690867', time=2024-09-14T13:15:00.944379+0000, chain.objs.size()=1 2024-09-14T11:22:51.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.028+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.4RMzKVeA8JWqDQJSs5m4hptZlhRxV3F_0 2024-09-14T11:22:51.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.028+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14455927224203348084', time=2024-09-14T13:15:04.403975+0000, chain.objs.size()=1 2024-09-14T11:22:51.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.028+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.276__shadow_.g6ILfcXds5ojJXetVdYmxqjyFNrUxDk_0 2024-09-14T11:22:51.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.028+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5103801849220951686', time=2024-09-14T13:15:08.651588+0000, chain.objs.size()=1 2024-09-14T11:22:51.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.028+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.291__shadow_.TvqEA5I0vaWC_L3tS1EA1zuLFVa4nCd_0 2024-09-14T11:22:51.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.028+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1486948054984741851', time=2024-09-14T13:15:10.860292+0000, chain.objs.size()=1 2024-09-14T11:22:51.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.029+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.297__shadow_.7k7cboEOCHlZF-UHiTFxR1LwS3eWtmf_0 2024-09-14T11:22:51.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.029+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8829384461136890161', time=2024-09-14T13:15:12.237265+0000, chain.objs.size()=1 2024-09-14T11:22:51.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.029+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.302__shadow_.Ew3W_HQC4ZVNCIdrNHs-CXo8nm5V5RT_0 2024-09-14T11:22:51.028 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.029+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1966317643801219122', time=2024-09-14T13:15:24.771269+0000, chain.objs.size()=1 2024-09-14T11:22:51.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.029+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.ktCN7tGHYbGVfFOPmwtVh2NCSLmKytE_0 2024-09-14T11:22:51.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.029+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.540996742182569836', time=2024-09-14T13:15:24.779407+0000, chain.objs.size()=1 2024-09-14T11:22:51.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.029+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.llIqQH5rM2L7O6QQ7Gqj08Q2bm3S3yQ_0 2024-09-14T11:22:51.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.029+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2754016229391386093', time=2024-09-14T13:15:24.906535+0000, chain.objs.size()=1 2024-09-14T11:22:51.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.029+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.4GGetC7PPa6zZtKPmF0BTTQdh7Ll6bB_0 2024-09-14T11:22:51.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.029+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16191721998803267952', time=2024-09-14T13:15:25.057070+0000, chain.objs.size()=1 2024-09-14T11:22:51.029 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.029+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.DVYUqgmz3ssiFvjMJwfUw4JZEi2mmvL_0 2024-09-14T11:22:51.030 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.030+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1438202324454184017', time=2024-09-14T13:15:25.112368+0000, chain.objs.size()=1 2024-09-14T11:22:51.030 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.030+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.Re6EVU1mtn00tNn2S6MB2RrE70v1Gvn_0 2024-09-14T11:22:51.030 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.030+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8846124306626567088', time=2024-09-14T13:15:25.126399+0000, chain.objs.size()=1 2024-09-14T11:22:51.030 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.030+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.7g2rP7bycXjX1IymzGYuyejq7wVhhVw_0 2024-09-14T11:22:51.030 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.030+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5427401137596742306', time=2024-09-14T13:15:25.205930+0000, chain.objs.size()=1 2024-09-14T11:22:51.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.030+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.081oO0pWlPJoPOMpp1M6HzQ_qyKBRS6_0 2024-09-14T11:22:51.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.031+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7650929063935394752', time=2024-09-14T13:15:25.208231+0000, chain.objs.size()=1 2024-09-14T11:22:51.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.031+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.xcFU1gjeM805o_vk-_rqplmMIYpAyFx_0 2024-09-14T11:22:51.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.031+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6512294488461256323', time=2024-09-14T13:15:25.369042+0000, chain.objs.size()=1 2024-09-14T11:22:51.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.031+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.ZBtlQT1Qhr4pDd0VyGYyBzkmDg6ghOK_0 2024-09-14T11:22:51.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.031+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7726037941676185015', time=2024-09-14T13:15:25.377342+0000, chain.objs.size()=1 2024-09-14T11:22:51.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.031+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.RI2_1LC34bxDTdr3ioKAZ8IXpC-NTzQ_0 2024-09-14T11:22:51.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.031+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2481659544553002225', time=2024-09-14T13:15:25.437397+0000, chain.objs.size()=1 2024-09-14T11:22:51.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.031+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.sp9Fbm-_J2C6Z47b08rC3ZA_Dzbr--y_0 2024-09-14T11:22:51.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.031+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15553361518149058235', time=2024-09-14T13:15:25.606388+0000, chain.objs.size()=1 2024-09-14T11:22:51.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.031+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.2nsO-e99C31vxa8vucjs81jTSQk2Aeg_0 2024-09-14T11:22:51.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.031+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2012633243491490019', time=2024-09-14T13:15:25.610232+0000, chain.objs.size()=1 2024-09-14T11:22:51.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.031+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.1jNy1q59FFxz41TGMtKzBwomRdeDvVc_0 2024-09-14T11:22:51.031 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.031+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9815286158663766359', time=2024-09-14T13:15:25.704661+0000, chain.objs.size()=1 2024-09-14T11:22:51.032 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.031+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.y5lS1B_NdcdpOj0A61UtklvFyEq26WY_0 2024-09-14T11:22:51.032 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.031+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14213242151543295553', time=2024-09-14T13:15:25.734214+0000, chain.objs.size()=1 2024-09-14T11:22:51.032 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.031+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.WDXgOteFaRu9ft10c8a3ldxmVMLTY3D_0 2024-09-14T11:22:51.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.032+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11432538253263187870', time=2024-09-14T13:15:25.755891+0000, chain.objs.size()=1 2024-09-14T11:22:51.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.032+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.69qab47fajfHrMd3vst1nfdstIXum-t_0 2024-09-14T11:22:51.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.032+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14151431365413466958', time=2024-09-14T13:15:25.757222+0000, chain.objs.size()=1 2024-09-14T11:22:51.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.032+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.jGs3SfLgzwI3XHrTCYWnwZfw5Ld68Vn_0 2024-09-14T11:22:51.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.032+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3109273720337199661', time=2024-09-14T13:15:25.770142+0000, chain.objs.size()=1 2024-09-14T11:22:51.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.032+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.VnB5xSln9B656dtJtBVpumE9lheUHGP_0 2024-09-14T11:22:51.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.032+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11506650785283738841', time=2024-09-14T13:15:25.774897+0000, chain.objs.size()=1 2024-09-14T11:22:51.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.032+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.hbz55WOJ9lX-MVX8bBvZAmusBURLIai_0 2024-09-14T11:22:51.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.033+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7953404893604047410', time=2024-09-14T13:15:25.903524+0000, chain.objs.size()=1 2024-09-14T11:22:51.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.033+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.f75JHt_gNC1WtWjU4_AmeWZnQR9QyhB_0 2024-09-14T11:22:51.033 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.033+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3585133866060666307', time=2024-09-14T13:15:25.906299+0000, chain.objs.size()=1 2024-09-14T11:22:51.034 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.033+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.Wl6jbssdzSdGDed-1Xryuzrcano-qrT_0 2024-09-14T11:22:51.034 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.033+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14451255120070015129', time=2024-09-14T13:15:33.164294+0000, chain.objs.size()=1 2024-09-14T11:22:51.034 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.033+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.44xw4f5beMVdGp5VqLba21Vt6yXb_l0_0 2024-09-14T11:22:51.034 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.033+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18411584698071031441', time=2024-09-14T13:15:33.177442+0000, chain.objs.size()=1 2024-09-14T11:22:51.034 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.033+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.x_j0aFlNJwv58psL2nHADXJ6u7cKURB_0 2024-09-14T11:22:51.034 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.033+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18119324839445487290', time=2024-09-14T13:15:33.201455+0000, chain.objs.size()=1 2024-09-14T11:22:51.034 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.033+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.XDHy4vbU3l-28sqgEFbkuOUwqplTmsR_0 2024-09-14T11:22:51.034 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.033+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9617346551475175204', time=2024-09-14T13:15:33.366229+0000, chain.objs.size()=1 2024-09-14T11:22:51.034 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.033+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.2z3x0xhTO3hChgaDyiLZELjV6u4VaWw_0 2024-09-14T11:22:51.034 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.033+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8265059677084506722', time=2024-09-14T13:15:33.434499+0000, chain.objs.size()=1 2024-09-14T11:22:51.034 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.033+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.aqDNW9iPHJb0WZFCr-wRZ1_KvVmzssD_0 2024-09-14T11:22:51.034 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.034+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16661828441052678704', time=2024-09-14T13:15:33.442722+0000, chain.objs.size()=1 2024-09-14T11:22:51.034 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.034+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.YgKe_dE1nBXrgkpgHERQ6FILEYferUe_0 2024-09-14T11:22:51.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.034+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2318870804606388548', time=2024-09-14T13:15:33.455946+0000, chain.objs.size()=1 2024-09-14T11:22:51.035 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.034+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.qSuUgITjE770vdZMjb9Gq9duR_Vznkc_0 2024-09-14T11:22:51.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.034+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14045098174684213291', time=2024-09-14T13:15:33.541497+0000, chain.objs.size()=1 2024-09-14T11:22:51.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.034+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.dj9nxK35nDBGzL8wulh5rVOXmke2uND_0 2024-09-14T11:22:51.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.035+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15324263710920966540', time=2024-09-14T13:15:33.582362+0000, chain.objs.size()=1 2024-09-14T11:22:51.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.035+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.wOVMeQgqWy_SmEZcGtacDQVbYma4XBL_0 2024-09-14T11:22:51.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.035+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5077148875349565571', time=2024-09-14T13:15:33.593725+0000, chain.objs.size()=1 2024-09-14T11:22:51.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.035+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.ZiohBfRwndmNwTPp5WXJRzhKM6LvvIw_0 2024-09-14T11:22:51.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.035+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8694222008839543466', time=2024-09-14T13:15:33.614471+0000, chain.objs.size()=1 2024-09-14T11:22:51.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.035+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.szYNXAobC3wiwTd78ur45b-DtKSfPUH_0 2024-09-14T11:22:51.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.035+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2965423696691750378', time=2024-09-14T13:15:33.693382+0000, chain.objs.size()=1 2024-09-14T11:22:51.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.035+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.pYtGfg5CIbk7Ry2qTPt3Ze6FJFRVpN4_0 2024-09-14T11:22:51.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.035+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2193487622692531451', time=2024-09-14T13:15:33.694329+0000, chain.objs.size()=1 2024-09-14T11:22:51.036 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.035+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.SJgZwgmFoQPtu05_QKIRcWJv2WHWIQk_0 2024-09-14T11:22:51.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.035+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4323338394522404446', time=2024-09-14T13:15:33.732444+0000, chain.objs.size()=1 2024-09-14T11:22:51.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.035+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.7XGBDAO27t0yH9kLAhHJJxyhY_ds-tZ_0 2024-09-14T11:22:51.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.035+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16964428836485124433', time=2024-09-14T13:15:33.755632+0000, chain.objs.size()=1 2024-09-14T11:22:51.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.035+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.fKyPwG8vQHAjFavgdorM6wACeN_18H2_0 2024-09-14T11:22:51.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.035+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5740001837044303111', time=2024-09-14T13:15:33.864123+0000, chain.objs.size()=1 2024-09-14T11:22:51.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.035+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Cij2hIZJCu8xceGYvy_L6RNFUXYYvCO_0 2024-09-14T11:22:51.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.035+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2688550131200276848', time=2024-09-14T13:15:33.866147+0000, chain.objs.size()=1 2024-09-14T11:22:51.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.035+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.fkGUjxqnejkvZemSUAMef_8zBpqmN1y_0 2024-09-14T11:22:51.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.037+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7752125886703348688', time=2024-09-14T13:15:33.885303+0000, chain.objs.size()=1 2024-09-14T11:22:51.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.037+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.r1_gCoxeyFb-t5ujqGmgyOpalvrxiHA_0 2024-09-14T11:22:51.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.037+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2616138005071015284', time=2024-09-14T13:15:33.889215+0000, chain.objs.size()=1 2024-09-14T11:22:51.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.037+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.TQu8ldegVR_Xk6ZMqNKwtsA7xv3N4KY_0 2024-09-14T11:22:51.038 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.038+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2157019289692559879', time=2024-09-14T13:15:33.921098+0000, chain.objs.size()=1 2024-09-14T11:22:51.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.038+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.qoHy7-5yI4NULy3hJjnu1KmZILvLKBc_0 2024-09-14T11:22:51.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.038+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16765463190087547161', time=2024-09-14T13:15:34.027506+0000, chain.objs.size()=1 2024-09-14T11:22:51.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.038+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.PxiRX9cr9kvhZfe-P0j1yV2rDc0rp83_0 2024-09-14T11:22:51.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.038+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16978362573197704542', time=2024-09-14T13:15:34.036160+0000, chain.objs.size()=1 2024-09-14T11:22:51.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.038+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.QKNlN66JjdsvXXLxOz3DC6tVhdKWNfj_0 2024-09-14T11:22:51.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.038+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7838332129803221760', time=2024-09-14T13:15:34.071583+0000, chain.objs.size()=1 2024-09-14T11:22:51.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.038+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.LEmitbRudcvDQUA3OaKKtzuu9c4bYki_0 2024-09-14T11:22:51.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.038+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13254649993938837037', time=2024-09-14T13:15:34.184939+0000, chain.objs.size()=1 2024-09-14T11:22:51.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.038+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.h--e03RIl8YKUhD11p7eHns8Ux207Q__0 2024-09-14T11:22:51.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.038+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4747410222483332987', time=2024-09-14T13:15:34.187836+0000, chain.objs.size()=1 2024-09-14T11:22:51.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.038+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.6WOp5IoAR5Z8GX4kRYnQONWrsTfxa_a_0 2024-09-14T11:22:51.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.038+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18353843665819940672', time=2024-09-14T13:15:34.261696+0000, chain.objs.size()=1 2024-09-14T11:22:51.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.038+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.5U4s45tMphvM4ZeTs0wIUGwfEPk1coE_0 2024-09-14T11:22:51.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.038+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13872239517347816896', time=2024-09-14T13:15:34.346644+0000, chain.objs.size()=1 2024-09-14T11:22:51.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.038+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.YDc3ZCAK_ElHaheg0MhmgMca_s2Z0a9_0 2024-09-14T11:22:51.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.038+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8943477765013538458', time=2024-09-14T13:15:34.383167+0000, chain.objs.size()=1 2024-09-14T11:22:51.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.038+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.5dcy---M2Zx2GXsmM-EOkBx0YIdq2y5_0 2024-09-14T11:22:51.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.038+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10732404365872017670', time=2024-09-14T13:15:34.391106+0000, chain.objs.size()=1 2024-09-14T11:22:51.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.038+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.JI1VzgwCrhFU_eO6EzJkFdrsv9G8QG6_0 2024-09-14T11:22:51.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.038+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6022688276089814044', time=2024-09-14T13:15:34.815348+0000, chain.objs.size()=1 2024-09-14T11:22:51.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.038+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.326__shadow_.IuDbjlmkx9wbMpTNoTdOzKdpIxQN0D-_0 2024-09-14T11:22:51.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.039+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7539463282698154987', time=2024-09-14T13:15:50.846541+0000, chain.objs.size()=1 2024-09-14T11:22:51.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.039+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.390__shadow_.adUBYKhYzmnqwl7mfDeczRO32O-4GM6_0 2024-09-14T11:22:51.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.040+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7854841069601673962', time=2024-09-14T13:16:04.119982+0000, chain.objs.size()=1 2024-09-14T11:22:51.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.040+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.436__shadow_.raAUZcg3bg8E1OrEQ4dgbja3F-C0Z_J_0 2024-09-14T11:22:51.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.040+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11068521056429038638', time=2024-09-14T13:16:19.569231+0000, chain.objs.size()=1 2024-09-14T11:22:51.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.040+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.491__shadow_.xqgEY8RjvS0x4U2vj94yfeyhyKZesdk_0 2024-09-14T11:22:51.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.040+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.368756025954057350', time=2024-09-14T13:16:21.571148+0000, chain.objs.size()=1 2024-09-14T11:22:51.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.040+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.499__shadow_.GcKiPXZeC5XnBIWMPgbydOASuPZ0FCU_0 2024-09-14T11:22:51.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.040+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3196105358519045811', time=2024-09-14T13:16:22.806182+0000, chain.objs.size()=1 2024-09-14T11:22:51.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.040+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.503__shadow:pymE41PAtqbkcQ6I2URloKvd5muPSJ-_.UInzhQl7TQvRYLWzEBL5Aj5TYH25pWP_0 2024-09-14T11:22:51.041 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.042+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 0/44724 2024-09-14T11:22:51.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.044+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-14T11:22:51.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.044+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='2~OGlpevfbyESfXOhfB5JTAvDcwd2Duu6', time=2024-09-14T13:16:39.657337+0000, chain.objs.size()=2 2024-09-14T11:22:51.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.044+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.529__multipart_mymultipart.2~OGlpevfbyESfXOhfB5JTAvDcwd2Duu6.1 2024-09-14T11:22:51.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.044+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.529__multipart_mymultipart.2~OGlpevfbyESfXOhfB5JTAvDcwd2Duu6.2 2024-09-14T11:22:51.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.044+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18380451894371888079', time=2024-09-14T13:17:25.442926+0000, chain.objs.size()=1 2024-09-14T11:22:51.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.044+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.569__shadow:7NkrfxlL7d19DsV9q5DsFhO6cT.CQaC_.xKlfBw5pyhl-H6OMZ8cC2L61dop1IKH_0 2024-09-14T11:22:51.043 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.044+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18017869163415413287', time=2024-09-14T13:17:57.501883+0000, chain.objs.size()=1 2024-09-14T11:22:51.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.044+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.604__shadow_.oLNneiadnF4oDPg0D7PEhPUQz6u-OE5_0 2024-09-14T11:22:51.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.044+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14837137490055312146', time=2024-09-14T13:20:11.775544+0000, chain.objs.size()=1 2024-09-14T11:22:51.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.044+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.641__shadow_.CmOzUouflom5YDQJdhQMv_SkUVlueDG_0 2024-09-14T11:22:51.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.044+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5706982756994628674', time=2024-09-14T13:21:12.242788+0000, chain.objs.size()=1 2024-09-14T11:22:51.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.044+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.768__shadow_.IhbwdGNpGkA7e_0Wt2LazyT6oqq_XBe_0 2024-09-14T11:22:51.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.044+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8076186625681512654', time=2024-09-14T13:21:26.986433+0000, chain.objs.size()=7 2024-09-14T11:22:51.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.044+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.779__shadow_.i9I71GxhUwT6ph0N52Rt-4O9crZCwc__0 2024-09-14T11:22:51.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.044+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.779__shadow_.i9I71GxhUwT6ph0N52Rt-4O9crZCwc__1 2024-09-14T11:22:51.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.044+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.779__shadow_.i9I71GxhUwT6ph0N52Rt-4O9crZCwc__2 2024-09-14T11:22:51.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.044+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.779__shadow_.i9I71GxhUwT6ph0N52Rt-4O9crZCwc__3 2024-09-14T11:22:51.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.044+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.779__shadow_.i9I71GxhUwT6ph0N52Rt-4O9crZCwc__4 2024-09-14T11:22:51.044 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.044+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.779__shadow_.i9I71GxhUwT6ph0N52Rt-4O9crZCwc__5 2024-09-14T11:22:51.045 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.046+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.779__shadow_.i9I71GxhUwT6ph0N52Rt-4O9crZCwc__6 2024-09-14T11:22:51.048 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.049+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:51.050 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.052+0000 7f0f19c16800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:22:51.051 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.053+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:51.052 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.053+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:51.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.054+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46766' 2024-09-14T11:22:51.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.054+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10804405857702125227', time=2024-09-14T13:13:34.343472+0000, chain.objs.size()=3 2024-09-14T11:22:51.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.054+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.159__multipart_mymultipart-FROZEN.2~SYNV8_-NDSFcAoBicq4hieAeh8b8eS-.1 2024-09-14T11:22:51.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.054+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.159__multipart_mymultipart-FROZEN.2~SYNV8_-NDSFcAoBicq4hieAeh8b8eS-.2 2024-09-14T11:22:51.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.054+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.159__multipart_mymultipart-FROZEN.2~SYNV8_-NDSFcAoBicq4hieAeh8b8eS-.3 2024-09-14T11:22:51.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.054+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='_nIVW0OTjfIvDs7NRm6JlSsGZsTXcZm-', time=2024-09-14T13:13:35.061045+0000, chain.objs.size()=2 2024-09-14T11:22:51.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.054+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.160__shadow_.D-5Ag8cIeOhsdvC9AR66syqOzt03hVi_0 2024-09-14T11:22:51.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.054+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.160__shadow_.D-5Ag8cIeOhsdvC9AR66syqOzt03hVi_1 2024-09-14T11:22:51.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.054+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='_Pdawgn5Qop0fZUKd35XuQSXII8J43LA', time=2024-09-14T13:13:36.780877+0000, chain.objs.size()=2 2024-09-14T11:22:51.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.054+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.161__shadow_.1ym7R7a07Tike1n5wWP1VaISQd5N7GC_0 2024-09-14T11:22:51.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.054+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.161__shadow_.1ym7R7a07Tike1n5wWP1VaISQd5N7GC_1 2024-09-14T11:22:51.054 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.054+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7224495943261233802', time=2024-09-14T13:13:44.461401+0000, chain.objs.size()=1 2024-09-14T11:22:51.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.054+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.179__shadow_.iE8Dis9SH71LkWmhvQ0RlbOqJWK7BQp_0 2024-09-14T11:22:51.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.054+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5793487968665100659', time=2024-09-14T13:13:51.377684+0000, chain.objs.size()=1 2024-09-14T11:22:51.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.054+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.199__shadow_.tVn6dOaa1zto1YIB5yNNC-9gnmjWDnm_0 2024-09-14T11:22:51.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.055+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3524396093564749557', time=2024-09-14T13:14:52.369608+0000, chain.objs.size()=1 2024-09-14T11:22:51.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.055+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.260__shadow_.ZvCR7IWsrS6MuFWGhGqd4hJAWeT8rU7_0 2024-09-14T11:22:51.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.055+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2729178389475507263', time=2024-09-14T13:14:59.749984+0000, chain.objs.size()=1 2024-09-14T11:22:51.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.055+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.XU5gCzyU0JM00uMM3k6TWuiXPdkO84j_0 2024-09-14T11:22:51.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.055+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8416984796358844375', time=2024-09-14T13:14:59.765042+0000, chain.objs.size()=1 2024-09-14T11:22:51.055 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.055+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.P6UM2Ca6b7MlOtQg_9gpWmYGJqSRtw3_0 2024-09-14T11:22:51.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.057+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15082761322595460111', time=2024-09-14T13:14:59.773443+0000, chain.objs.size()=1 2024-09-14T11:22:51.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.057+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.aHvaYPFNlubaqfiOIzucc_PsIkPNoE-_0 2024-09-14T11:22:51.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.057+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11701748192802603254', time=2024-09-14T13:14:59.819280+0000, chain.objs.size()=1 2024-09-14T11:22:51.056 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.057+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.KJ2NbnvzBhC1OuwVDCT8rt5zSLPzq_R_0 2024-09-14T11:22:51.057 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.058+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5569828326226970597', time=2024-09-14T13:14:59.909654+0000, chain.objs.size()=1 2024-09-14T11:22:51.057 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.058+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.5aiOUw5OW5c5Sz3HFGSU_IkwcIdpSmS_0 2024-09-14T11:22:51.057 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.058+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12473025413662808169', time=2024-09-14T13:14:59.917832+0000, chain.objs.size()=1 2024-09-14T11:22:51.057 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.058+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.SXrO6Kkvpsl7CqlkKPshhDTp5QQ3jlT_0 2024-09-14T11:22:51.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.059+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11598255638362746545', time=2024-09-14T13:14:59.944946+0000, chain.objs.size()=1 2024-09-14T11:22:51.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.059+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.fTtkqQlrJ6e0bBIphgYUbdGTRWSj3YD_0 2024-09-14T11:22:51.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.059+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15643728146089287092', time=2024-09-14T13:14:59.950228+0000, chain.objs.size()=1 2024-09-14T11:22:51.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.059+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.qjpbKATliS-l2ALk3kM9PbiMrbYn_CR_0 2024-09-14T11:22:51.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.059+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3002774633050451291', time=2024-09-14T13:14:59.952394+0000, chain.objs.size()=1 2024-09-14T11:22:51.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.059+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.dzfuhId0TtoeNpJt0uJ9j0k0lgWcMwf_0 2024-09-14T11:22:51.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.059+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13045062299194958517', time=2024-09-14T13:14:59.961530+0000, chain.objs.size()=1 2024-09-14T11:22:51.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.059+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.e4yipum0MQqKBQ6r5MDcrP20wA314on_0 2024-09-14T11:22:51.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.059+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17569716880293421281', time=2024-09-14T13:15:00.104198+0000, chain.objs.size()=1 2024-09-14T11:22:51.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.059+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.zHhvpWlOPEWLIMevnaI4I2MD9AND_mB_0 2024-09-14T11:22:51.058 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.059+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13534203959973390124', time=2024-09-14T13:15:00.151348+0000, chain.objs.size()=1 2024-09-14T11:22:51.059 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.059+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.pXq3UxRkVcoL0PZKH3e5IeJ7-L1bja3_0 2024-09-14T11:22:51.059 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.059+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5131479365493524983', time=2024-09-14T13:15:00.239403+0000, chain.objs.size()=1 2024-09-14T11:22:51.059 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.059+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.US4vruQF8ZShGab_SMdWr-2LSEPAYAk_0 2024-09-14T11:22:51.059 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.059+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1256576180835310739', time=2024-09-14T13:15:00.240114+0000, chain.objs.size()=1 2024-09-14T11:22:51.059 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.059+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.QD4Yt9w0h1uj4FN-OhCRVK2v0Vy7YSs_0 2024-09-14T11:22:51.059 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.059+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8676839991994371431', time=2024-09-14T13:15:00.303569+0000, chain.objs.size()=1 2024-09-14T11:22:51.059 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.059+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.-M4h8o0rhq5ZY3brFiRBl4b95KrJyUL_0 2024-09-14T11:22:51.059 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.059+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16606283605974994611', time=2024-09-14T13:15:00.408940+0000, chain.objs.size()=1 2024-09-14T11:22:51.059 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.059+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.yYLllAdleslZu7o4tLLrEvlLOffPkxR_0 2024-09-14T11:22:51.060 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.060+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3373560663265341294', time=2024-09-14T13:15:00.432072+0000, chain.objs.size()=1 2024-09-14T11:22:51.060 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.060+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.ALTLhgGQEeGEHVCt2VJ1qUNGtCx-Bxx_0 2024-09-14T11:22:51.060 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.060+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12399245091372351292', time=2024-09-14T13:15:00.455340+0000, chain.objs.size()=1 2024-09-14T11:22:51.060 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.060+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.sRA1xr8QtssVTPW-RrGVcoa-qChERmJ_0 2024-09-14T11:22:51.060 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.060+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9478587027328850025', time=2024-09-14T13:15:00.469393+0000, chain.objs.size()=1 2024-09-14T11:22:51.060 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.060+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.wzupb3HfQa2So_KrMGBEbp8Y7Q4rC1Y_0 2024-09-14T11:22:51.060 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.061+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18436653130143085664', time=2024-09-14T13:15:00.471631+0000, chain.objs.size()=1 2024-09-14T11:22:51.060 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.061+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.U2raOYiahXq3xot4KpsUuxpzriV-eQ3_0 2024-09-14T11:22:51.061 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.062+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8022687203180411489', time=2024-09-14T13:15:00.551800+0000, chain.objs.size()=1 2024-09-14T11:22:51.062 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.062+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.VayAiLQUvL6VcN-Px-A9d44NhV0TmKv_0 2024-09-14T11:22:51.062 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.062+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8598804558618560133', time=2024-09-14T13:15:00.552785+0000, chain.objs.size()=1 2024-09-14T11:22:51.062 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.062+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.yvauHModNLxkm48a9eJmuxywYl_cB5g_0 2024-09-14T11:22:51.062 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.062+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7093943308994081250', time=2024-09-14T13:15:00.560496+0000, chain.objs.size()=1 2024-09-14T11:22:51.062 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.062+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.g5CRyXWa8qmLgjn1ZPP0WvV0UZa5-u2_0 2024-09-14T11:22:51.062 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.062+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14020507943718065814', time=2024-09-14T13:15:00.604677+0000, chain.objs.size()=1 2024-09-14T11:22:51.062 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.062+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.SeiLjq3yYbS-oepn3q99_9L8eiVs2Rq_0 2024-09-14T11:22:51.062 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.062+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3896600257916368935', time=2024-09-14T13:15:00.625110+0000, chain.objs.size()=1 2024-09-14T11:22:51.062 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.062+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.75AI6OsIyRTwYBgcS0ntsExqZYNV54D_0 2024-09-14T11:22:51.062 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.062+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7057231314150194133', time=2024-09-14T13:15:00.708932+0000, chain.objs.size()=1 2024-09-14T11:22:51.062 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.062+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.jR3R3ikI7O4ma3m4LP7a1gUbViqvr8t_0 2024-09-14T11:22:51.062 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.062+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11943546723588095642', time=2024-09-14T13:15:00.723395+0000, chain.objs.size()=1 2024-09-14T11:22:51.062 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.062+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Hw0nU_lpsAe6TxrZkdWuIkgsTFxtW-e_0 2024-09-14T11:22:51.063 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.062+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17310834556050681774', time=2024-09-14T13:15:00.733924+0000, chain.objs.size()=1 2024-09-14T11:22:51.063 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.062+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.o1valrAG-aMZbbqY0twM6d4rvKJ9hJh_0 2024-09-14T11:22:51.063 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.062+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7323324073029377484', time=2024-09-14T13:15:00.745727+0000, chain.objs.size()=1 2024-09-14T11:22:51.063 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.062+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.aKtQ9P0-W5iTbv92ThTlWNDUNa3-eJN_0 2024-09-14T11:22:51.063 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.062+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4666142229690451325', time=2024-09-14T13:15:00.778847+0000, chain.objs.size()=1 2024-09-14T11:22:51.063 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.062+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.AFHHVGGfz2doxyLruDfzwxo_GapmXtx_0 2024-09-14T11:22:51.063 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.062+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2185870419257765806', time=2024-09-14T13:15:00.785888+0000, chain.objs.size()=1 2024-09-14T11:22:51.063 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.062+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.dS6mRJbHyEXnuWJ8cOG8i1m9rZaiYcR_0 2024-09-14T11:22:51.064 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.064+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9346451223515138242', time=2024-09-14T13:15:00.794648+0000, chain.objs.size()=1 2024-09-14T11:22:51.064 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.064+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.ZM5OTxj1orUijw8dEJ80mfPxMKH-U_1_0 2024-09-14T11:22:51.064 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.064+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13434531042181993978', time=2024-09-14T13:15:00.885025+0000, chain.objs.size()=1 2024-09-14T11:22:51.064 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.064+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.lP4PL_SvU5hXaF-k9M2INeCZ7I-7WoJ_0 2024-09-14T11:22:51.064 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.064+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15720407697083332', time=2024-09-14T13:15:00.894158+0000, chain.objs.size()=1 2024-09-14T11:22:51.064 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.064+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.FOVU_jbtl95rv-4sihOuF3A0CfDii4v_0 2024-09-14T11:22:51.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.064+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1570468679115434576', time=2024-09-14T13:15:00.917963+0000, chain.objs.size()=1 2024-09-14T11:22:51.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.064+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.JTTuC3qYpevF458M_ZSpMSd_xD37QNb_0 2024-09-14T11:22:51.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.064+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6922540959762466758', time=2024-09-14T13:15:00.938823+0000, chain.objs.size()=1 2024-09-14T11:22:51.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.064+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.yU_GWI-HhATueeetdnahxhYJBXfN3-I_0 2024-09-14T11:22:51.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.064+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17624073297210349762', time=2024-09-14T13:15:04.148666+0000, chain.objs.size()=1 2024-09-14T11:22:51.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.064+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.275__shadow_.P86OVIc7k1VF3tzyFwrF_N-LuMK1SB9_0 2024-09-14T11:22:51.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.064+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13856412769723301910', time=2024-09-14T13:15:04.401945+0000, chain.objs.size()=1 2024-09-14T11:22:51.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.064+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.276__shadow_.vrp-DswR_x0ZgzDC-034wu__8djFII-_0 2024-09-14T11:22:51.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.064+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12039661089246121959', time=2024-09-14T13:15:05.715445+0000, chain.objs.size()=1 2024-09-14T11:22:51.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.064+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.281__shadow_.2KSUTFwNwn4yl2wWh5P5otuMvPmjJsh_0 2024-09-14T11:22:51.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.064+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5270018753663414038', time=2024-09-14T13:15:09.245300+0000, chain.objs.size()=1 2024-09-14T11:22:51.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.064+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.292__shadow_.wcSAzEPZ654UrbwW6x_RvR3nviP0VLP_0 2024-09-14T11:22:51.065 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.064+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6112411847904361157', time=2024-09-14T13:15:09.838068+0000, chain.objs.size()=1 2024-09-14T11:22:51.066 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.064+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.293__shadow_.olWwPKQ2nk5JFS6zy-TBQjcoFP6RZLA_0 2024-09-14T11:22:51.066 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.064+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1208404979690979419', time=2024-09-14T13:15:12.487724+0000, chain.objs.size()=1 2024-09-14T11:22:51.066 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.064+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.303__shadow_.sgwCo6UPwqZaPbWKBSUYPDKt5KtkSqr_0 2024-09-14T11:22:51.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.066+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15124919017808398438', time=2024-09-14T13:15:24.732184+0000, chain.objs.size()=1 2024-09-14T11:22:51.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.066+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.nooJZ-M6gkTwtYveHwS8w1FxPsmBEwu_0 2024-09-14T11:22:51.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.066+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11022495504592451280', time=2024-09-14T13:15:24.733116+0000, chain.objs.size()=1 2024-09-14T11:22:51.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.066+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.sUMicSiu2bP3CgY-S-SkoaWlt-G86cL_0 2024-09-14T11:22:51.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.066+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14712037679416230211', time=2024-09-14T13:15:24.740460+0000, chain.objs.size()=1 2024-09-14T11:22:51.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.066+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.EY3sixcWhbCoNauAKnVLCXMObeZZA6Q_0 2024-09-14T11:22:51.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.066+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4693040117398517084', time=2024-09-14T13:15:24.763892+0000, chain.objs.size()=1 2024-09-14T11:22:51.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.066+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.FgMrB1ON8woOy8TBsVPZDDt5T2944qw_0 2024-09-14T11:22:51.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.067+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16512170575446753397', time=2024-09-14T13:15:24.776871+0000, chain.objs.size()=1 2024-09-14T11:22:51.067 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.067+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.rOh4evT37g9Y_MQGSTFlw61A0yZ2pZV_0 2024-09-14T11:22:51.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.067+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.336870748833634635', time=2024-09-14T13:15:24.882415+0000, chain.objs.size()=1 2024-09-14T11:22:51.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.067+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.5wEJg_ZhEGOZvr0RrQAPSHxHAqMdPsF_0 2024-09-14T11:22:51.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.067+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6242079619642291006', time=2024-09-14T13:15:24.896761+0000, chain.objs.size()=1 2024-09-14T11:22:51.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.067+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.iinotdg4us6OLJFupgFJ3EX8bxnUYu1_0 2024-09-14T11:22:51.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.067+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2380398195838936998', time=2024-09-14T13:15:24.906495+0000, chain.objs.size()=1 2024-09-14T11:22:51.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.067+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.fFY_HVwrxrD8vArXel46imXw-y-uCxH_0 2024-09-14T11:22:51.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.067+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17146753308596355575', time=2024-09-14T13:15:24.911700+0000, chain.objs.size()=1 2024-09-14T11:22:51.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.067+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.9_V0_mHY8S54Ewbi2F96Rolwtuxs23m_0 2024-09-14T11:22:51.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.067+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13914920861218765614', time=2024-09-14T13:15:24.918859+0000, chain.objs.size()=1 2024-09-14T11:22:51.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.067+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.IqsPVT4uuqg61nNhby1VwFn6KtieP_c_0 2024-09-14T11:22:51.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.067+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7204981505711108285', time=2024-09-14T13:15:24.922587+0000, chain.objs.size()=1 2024-09-14T11:22:51.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.067+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.gBc5763EIuahi2SpHcUgfPO0nc0-t0d_0 2024-09-14T11:22:51.068 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.068+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6139892880770470866', time=2024-09-14T13:15:24.925430+0000, chain.objs.size()=1 2024-09-14T11:22:51.069 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.068+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.X5gpnFt3ibdUz3wV9GveoIkf936ptnD_0 2024-09-14T11:22:51.069 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.069+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1225397961796570527', time=2024-09-14T13:15:24.959968+0000, chain.objs.size()=1 2024-09-14T11:22:51.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.069+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.4lwaZma0r_dlunZD3hZ0KJ9-TQDb0ad_0 2024-09-14T11:22:51.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.069+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6296646014858529727', time=2024-09-14T13:15:25.042209+0000, chain.objs.size()=1 2024-09-14T11:22:51.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.069+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.3xD5NsDh0csvlUODgYFbZaJ1riDVOPC_0 2024-09-14T11:22:51.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.069+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16016445575934209800', time=2024-09-14T13:15:25.046823+0000, chain.objs.size()=1 2024-09-14T11:22:51.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.069+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.4hyLlYn3IXziYdy6A1xk2rAgLhKwS57_0 2024-09-14T11:22:51.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.070+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6814171683051097542', time=2024-09-14T13:15:25.054768+0000, chain.objs.size()=1 2024-09-14T11:22:51.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.070+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.OM0RrZRgG5W3pAZjVfJ7ifqterpEl9W_0 2024-09-14T11:22:51.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.070+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15318445726315850997', time=2024-09-14T13:15:25.105524+0000, chain.objs.size()=1 2024-09-14T11:22:51.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.070+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.T7rESRzCC8FiPkViI6SsHzbQdsI6MqC_0 2024-09-14T11:22:51.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.070+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13408272420261310418', time=2024-09-14T13:15:25.119149+0000, chain.objs.size()=1 2024-09-14T11:22:51.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.070+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.9UJjHs4ddprEKfqKv7oWGlCcrtxQ95a_0 2024-09-14T11:22:51.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.070+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14324436402823241192', time=2024-09-14T13:15:25.205904+0000, chain.objs.size()=1 2024-09-14T11:22:51.070 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.070+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.d5MBygRLROLr3xFN5A4q39AUAEr48hG_0 2024-09-14T11:22:51.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.070+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10823140142697649480', time=2024-09-14T13:15:25.230595+0000, chain.objs.size()=1 2024-09-14T11:22:51.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.070+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.AySfkI2yrdhoJaf716mH_QtFc6Kgo-0_0 2024-09-14T11:22:51.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.070+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12051985394629103100', time=2024-09-14T13:15:25.232995+0000, chain.objs.size()=1 2024-09-14T11:22:51.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.070+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.WrnpRXuWdILmTK07jzXNm-nt9H3zcVs_0 2024-09-14T11:22:51.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.070+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9004229111859835427', time=2024-09-14T13:15:25.367971+0000, chain.objs.size()=1 2024-09-14T11:22:51.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.070+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.YJjGJH_2YXA7Ly2OgPQBVo_aq2aXFjf_0 2024-09-14T11:22:51.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.070+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12438286284535200734', time=2024-09-14T13:15:25.441906+0000, chain.objs.size()=1 2024-09-14T11:22:51.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.070+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.7sfcRQa8mmsfCRblvodZ0wFYb2uj0Da_0 2024-09-14T11:22:51.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.070+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15247943511927089420', time=2024-09-14T13:15:25.549597+0000, chain.objs.size()=1 2024-09-14T11:22:51.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.070+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.mNpyfSoWzliwcdH8cpQnwjvdJCMnFEc_0 2024-09-14T11:22:51.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.070+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15211736634959786951', time=2024-09-14T13:15:25.562664+0000, chain.objs.size()=1 2024-09-14T11:22:51.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.070+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.UNXDKlRGUsrX26EnP3LxGkry2wXVws2_0 2024-09-14T11:22:51.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.070+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1224636752343465176', time=2024-09-14T13:15:25.588290+0000, chain.objs.size()=1 2024-09-14T11:22:51.071 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.070+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.FBfFcY-iRT0n1OFhi5Un5RtHc0ksAS6_0 2024-09-14T11:22:51.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.072+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18136194941575157738', time=2024-09-14T13:15:25.592848+0000, chain.objs.size()=1 2024-09-14T11:22:51.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.072+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.Sb7qaJpxwjGIOUsNAvgXgTMAqvv25yE_0 2024-09-14T11:22:51.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.073+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8592320876790486867', time=2024-09-14T13:15:25.694373+0000, chain.objs.size()=1 2024-09-14T11:22:51.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.073+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.V4a5NXN6QCE3axmMqdBzRgSen4qK2tw_0 2024-09-14T11:22:51.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.073+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14289494609782883241', time=2024-09-14T13:15:25.702366+0000, chain.objs.size()=1 2024-09-14T11:22:51.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.073+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.ca_rGMdgXBnxNH2P4nh9ZsA0Qi-a8gH_0 2024-09-14T11:22:51.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.073+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3878312167680016722', time=2024-09-14T13:15:25.706685+0000, chain.objs.size()=1 2024-09-14T11:22:51.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.073+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.tiyfmnIGyKu8BYKOVNMJfqgSZwiq9Wh_0 2024-09-14T11:22:51.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.073+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12014612652550802425', time=2024-09-14T13:15:25.744361+0000, chain.objs.size()=1 2024-09-14T11:22:51.073 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.073+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.aSMmO3eppo-Yj7SVKY24sMrKBTBpSWg_0 2024-09-14T11:22:51.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.073+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3679027866575187886', time=2024-09-14T13:15:25.750945+0000, chain.objs.size()=1 2024-09-14T11:22:51.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.073+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.5h5vcZelm38bF4RrUrosBspjQFLWgsp_0 2024-09-14T11:22:51.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.073+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7714960165816217666', time=2024-09-14T13:15:25.771446+0000, chain.objs.size()=1 2024-09-14T11:22:51.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.073+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.yZlSqd8a8Kou3-hlpKjL9EjCJSIcG0T_0 2024-09-14T11:22:51.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.073+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11871715571493920045', time=2024-09-14T13:15:25.891390+0000, chain.objs.size()=1 2024-09-14T11:22:51.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.073+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.ia9XQoQ3KsS1fv41KYrVPKFc9t1CaZg_0 2024-09-14T11:22:51.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.073+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2226697591909972605', time=2024-09-14T13:15:33.216885+0000, chain.objs.size()=1 2024-09-14T11:22:51.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.073+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.mpfX3mOLGGVJiHOEOCvaVTPwEp9i5s3_0 2024-09-14T11:22:51.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.073+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4559948931435706983', time=2024-09-14T13:15:33.369095+0000, chain.objs.size()=1 2024-09-14T11:22:51.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.073+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.TFm_bsi1gLbOX3pp9K2WSEwMXzxI3-A_0 2024-09-14T11:22:51.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.073+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3289758042260146521', time=2024-09-14T13:15:33.375393+0000, chain.objs.size()=1 2024-09-14T11:22:51.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.073+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.a2sv42Tl9rUe5wsxRTzuCsNWHN5jQcd_0 2024-09-14T11:22:51.074 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.074+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11658717210087883894', time=2024-09-14T13:15:33.415503+0000, chain.objs.size()=1 2024-09-14T11:22:51.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.074+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.HFa9ygx9I7Zrg5hPFWv-M9fuFnxpjMw_0 2024-09-14T11:22:51.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.074+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3514648599745479806', time=2024-09-14T13:15:33.570264+0000, chain.objs.size()=1 2024-09-14T11:22:51.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.074+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.F_aNIODwgOBo389n5p0lADmRDhsttP3_0 2024-09-14T11:22:51.075 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.074+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5421921676373052677', time=2024-09-14T13:15:33.691248+0000, chain.objs.size()=1 2024-09-14T11:22:51.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.074+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.SKJjRvCfCujFG8lPhZhs4bRmp0pqEM1_0 2024-09-14T11:22:51.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.074+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11933576787376903245', time=2024-09-14T13:15:33.693002+0000, chain.objs.size()=1 2024-09-14T11:22:51.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.074+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.yL2G28oCsTMoAu2yYonuk8NLndgOim9_0 2024-09-14T11:22:51.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.074+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9635881952158729415', time=2024-09-14T13:15:33.712949+0000, chain.objs.size()=1 2024-09-14T11:22:51.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.074+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.tc69tXVaJbEKlgW_yaN5vLlx8KgrNuM_0 2024-09-14T11:22:51.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.074+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14542556911442577308', time=2024-09-14T13:15:33.747624+0000, chain.objs.size()=1 2024-09-14T11:22:51.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.074+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.evJHCTrrc05wOQCal2CP24q9VAFYrip_0 2024-09-14T11:22:51.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.075+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8617741773816891074', time=2024-09-14T13:15:33.750384+0000, chain.objs.size()=1 2024-09-14T11:22:51.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.075+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.DDJ6NG0K8oXD56R18Xs2Hj4oXWWYFmv_0 2024-09-14T11:22:51.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.075+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2536136045400261560', time=2024-09-14T13:15:33.880771+0000, chain.objs.size()=1 2024-09-14T11:22:51.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.075+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.FerAMx6ASvWVyMrJ_r94XF1Dpmckym5_0 2024-09-14T11:22:51.076 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.075+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2011162733966212427', time=2024-09-14T13:15:33.918225+0000, chain.objs.size()=1 2024-09-14T11:22:51.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.075+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.klUdlEEOEqOL0JcJUlnoToFkxJ8EmKM_0 2024-09-14T11:22:51.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.075+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12946198656211823574', time=2024-09-14T13:15:34.035556+0000, chain.objs.size()=1 2024-09-14T11:22:51.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.075+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.O_lNkc61vWHHtTgooP-zOGJPlj93o1x_0 2024-09-14T11:22:51.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.076+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15339300253541242963', time=2024-09-14T13:15:34.048491+0000, chain.objs.size()=1 2024-09-14T11:22:51.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.076+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.e374q_Y7LBzdXeugF1_DsBOSwGcf0hP_0 2024-09-14T11:22:51.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.076+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1413496158528580882', time=2024-09-14T13:15:34.089343+0000, chain.objs.size()=1 2024-09-14T11:22:51.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.076+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Hytgcc6ue7iZKCQKzhrmrRd71F3Pj5y_0 2024-09-14T11:22:51.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.076+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17065640483448705428', time=2024-09-14T13:15:34.172926+0000, chain.objs.size()=1 2024-09-14T11:22:51.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.076+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.uDZOKRVpcnolm9IitVjDnchl2LPS9QB_0 2024-09-14T11:22:51.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.076+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7438615168906275544', time=2024-09-14T13:15:34.177468+0000, chain.objs.size()=1 2024-09-14T11:22:51.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.076+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.EKLOfXEbNrl6TOco-JHZS9vNeOpb2tC_0 2024-09-14T11:22:51.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.076+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15028763727234239300', time=2024-09-14T13:15:34.213998+0000, chain.objs.size()=1 2024-09-14T11:22:51.077 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.076+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.QsvBH0cwU_Rosh1XtLBrPyHNcglAcDI_0 2024-09-14T11:22:51.078 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.079+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 0/46766 2024-09-14T11:22:51.081 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.081+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=31, truncated=0, next_marker='' 2024-09-14T11:22:51.081 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.081+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12079049632017275951', time=2024-09-14T13:15:34.244814+0000, chain.objs.size()=1 2024-09-14T11:22:51.081 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.081+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.05iQufpppXjnYl4N39vqQdVF3zVxFJM_0 2024-09-14T11:22:51.081 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.081+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4369691287705558947', time=2024-09-14T13:15:34.253517+0000, chain.objs.size()=1 2024-09-14T11:22:51.081 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.081+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.VyuE7l11-V_MDEmOwMpUA4npe64dUkK_0 2024-09-14T11:22:51.081 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.081+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3711522411049181649', time=2024-09-14T13:15:34.335883+0000, chain.objs.size()=1 2024-09-14T11:22:51.081 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.081+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.UP70JIWS0zzuxYrabeJQ8_6CrFji9qO_0 2024-09-14T11:22:51.081 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.081+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1181535329466386963', time=2024-09-14T13:15:34.356530+0000, chain.objs.size()=1 2024-09-14T11:22:51.081 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.081+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.OrHPE4rp8ZTDUlQQWCKRxEHlx95fGEM_0 2024-09-14T11:22:51.081 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.081+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15736946463503744498', time=2024-09-14T13:15:34.377648+0000, chain.objs.size()=1 2024-09-14T11:22:51.081 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.081+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.ilIc55h4MosSFyzJfNGukxGCGYT29He_0 2024-09-14T11:22:51.082 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.081+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1188505907629701172', time=2024-09-14T13:15:35.045216+0000, chain.objs.size()=1 2024-09-14T11:22:51.082 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.081+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.327__shadow_.3qw7ifau7jCXjrAW0BX9h7Kq9WgCdY0_0 2024-09-14T11:22:51.082 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.081+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13611440877518209749', time=2024-09-14T13:15:36.796754+0000, chain.objs.size()=1 2024-09-14T11:22:51.082 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.081+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.334__shadow_.3bX29BjDRZPTcZeCWPc0JSiy2H3-dmD_0 2024-09-14T11:22:51.082 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.081+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11088238997564608600', time=2024-09-14T13:15:44.614599+0000, chain.objs.size()=1 2024-09-14T11:22:51.082 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.081+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.371__shadow_.bwP-Lt0qi8MODONBekYlDkuS1wWKfGM_0 2024-09-14T11:22:51.082 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.081+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14027230745426613336', time=2024-09-14T13:15:47.851223+0000, chain.objs.size()=1 2024-09-14T11:22:51.082 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.081+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.379__shadow_.G9wjqYy1pXrtpcAP8OVb0g0XSu6f0zt_0 2024-09-14T11:22:51.082 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.081+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2559746631757192726', time=2024-09-14T13:16:06.164578+0000, chain.objs.size()=1 2024-09-14T11:22:51.082 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.081+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.443__shadow_.dkEDyp9vZQ63q0Bh421_QP61iILBrqY_0 2024-09-14T11:22:51.082 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.081+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.592563163018300358', time=2024-09-14T13:16:11.061623+0000, chain.objs.size()=1 2024-09-14T11:22:51.082 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.081+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.459__shadow_.gz43D7yk1Zp_Oubi6z7jHPG7EdbfACV_0 2024-09-14T11:22:51.082 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.081+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5009765686323925154', time=2024-09-14T13:16:19.684290+0000, chain.objs.size()=1 2024-09-14T11:22:51.083 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.081+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.491__shadow_.xqgEY8RjvS0x4U2vj94yfeyhyKZesdk_0 2024-09-14T11:22:51.084 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.083+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11639445160913905293', time=2024-09-14T13:16:27.286276+0000, chain.objs.size()=1 2024-09-14T11:22:51.084 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.083+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.518__multipart_mymultipart.2~xvUkuiO204mJxyfagcx274Y4dWIPQdR.1 2024-09-14T11:22:51.084 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.083+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6957031852870193758', time=2024-09-14T13:16:27.914457+0000, chain.objs.size()=1 2024-09-14T11:22:51.084 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.083+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.517__shadow_.TI-5eFOP6PUBpA977gjgnFaGQOvgH9L_0 2024-09-14T11:22:51.084 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.083+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15145617982248475537', time=2024-09-14T13:17:21.123419+0000, chain.objs.size()=1 2024-09-14T11:22:51.084 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.083+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.569__shadow:6DqdN5jN9rH4mqUC6NNjXvib2RGYGla_.ykfGffm-1ve8y8j9vf9d-NRfX9pPGBZ_0 2024-09-14T11:22:51.084 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.083+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8918325187431251142', time=2024-09-14T13:17:21.956701+0000, chain.objs.size()=1 2024-09-14T11:22:51.084 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.083+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.569__shadow:zsal.OYgwYbJ80SQApYiYlFDrzZq48z_.7QMFZ8tMP36HpH4APHzpkwQygqMIlvR_0 2024-09-14T11:22:51.084 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.083+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17196992151094458826', time=2024-09-14T13:17:25.002750+0000, chain.objs.size()=1 2024-09-14T11:22:51.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.083+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.569__shadow:gvDrY1ZAHkO9VnFhXypbY8KZ0BE4DDQ_.TOy9BftAzQYBlDY-1kq_gcncBXyUxFU_0 2024-09-14T11:22:51.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.083+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.623129191955352989', time=2024-09-14T13:17:27.433678+0000, chain.objs.size()=1 2024-09-14T11:22:51.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.083+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.570__shadow:3PK31NAwAtTClnJbIH3.Cw5M12Upb5F_.R3T3imaW2YQBUpXynHow_Zam-AHUfRN_0 2024-09-14T11:22:51.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.083+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1077497314206418742', time=2024-09-14T13:17:36.704200+0000, chain.objs.size()=1 2024-09-14T11:22:51.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.083+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.577__shadow:y0QLaRtAjt7sd-WiY7SIzBCTf7kjxP1_.2ZqT3-JrmHS4F1wZrioRIA1NqoQHEc1_0 2024-09-14T11:22:51.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.083+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12872015589538893818', time=2024-09-14T13:17:46.979612+0000, chain.objs.size()=1 2024-09-14T11:22:51.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.083+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.577__shadow:j5dWVoZkTV7tUYpXPb0QX4VOuXv-1qb_.Cawr9QvcTcNryN9w15vgtGiHbtGgegd_0 2024-09-14T11:22:51.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.084+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18115837872092234569', time=2024-09-14T13:20:04.333610+0000, chain.objs.size()=1 2024-09-14T11:22:51.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.084+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.618__shadow_.8DZxpPNzpagtIfP6lkH5ifSgAxhH-QR_0 2024-09-14T11:22:51.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.084+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10700036019262161258', time=2024-09-14T13:20:09.463281+0000, chain.objs.size()=1 2024-09-14T11:22:51.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.084+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.631__shadow_.Chk07opajkxA0XwXehX0dEYmnGHA6YX_0 2024-09-14T11:22:51.085 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.084+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15269862187904523247', time=2024-09-14T13:20:10.468441+0000, chain.objs.size()=1 2024-09-14T11:22:51.086 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.084+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.635__shadow_.-WXk0Cv7cJXNDYcKz6Or-CyCy53rhfj_0 2024-09-14T11:22:51.086 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.084+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10989690390750445110', time=2024-09-14T13:20:10.941498+0000, chain.objs.size()=1 2024-09-14T11:22:51.086 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.084+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.637__shadow_.UexU5V8rk6IPTIWAioF3ym1Am0iLMPz_0 2024-09-14T11:22:51.086 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.085+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10036614193287392218', time=2024-09-14T13:20:14.654028+0000, chain.objs.size()=2 2024-09-14T11:22:51.086 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.085+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.649__shadow_.xjOQ9h0SshC49Fbgin8qYrKLWk20gE__0 2024-09-14T11:22:51.087 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.086+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.649__shadow_.xjOQ9h0SshC49Fbgin8qYrKLWk20gE__1 2024-09-14T11:22:51.087 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.086+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11534870528240724626', time=2024-09-14T13:20:20.023184+0000, chain.objs.size()=1 2024-09-14T11:22:51.087 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.086+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.663__shadow_.U935CkSvjHiWMs06pIN_BBSSPZowv2f_0 2024-09-14T11:22:51.087 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.086+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6866129618989449012', time=2024-09-14T13:20:21.348060+0000, chain.objs.size()=1 2024-09-14T11:22:51.087 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.086+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.666__shadow_.eJgNfJqkJR_mqNRd80I3KKlkXbdqKW2_0 2024-09-14T11:22:51.087 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.086+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18395268058348160383', time=2024-09-14T13:20:21.861143+0000, chain.objs.size()=1 2024-09-14T11:22:51.087 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.086+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.668__shadow_.mY8gAfpqfp4HjdZ8mmSVoBfZmUpbCFs_0 2024-09-14T11:22:51.087 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.086+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14832449260341060808', time=2024-09-14T13:20:22.589912+0000, chain.objs.size()=1 2024-09-14T11:22:51.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.086+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.672__shadow_.P5ss7B3VZP_-PJX46e4f6UfYKH1VEPu_0 2024-09-14T11:22:51.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.086+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11050890629616449475', time=2024-09-14T13:20:30.274120+0000, chain.objs.size()=1 2024-09-14T11:22:51.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.086+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.703__shadow:971ecymHomI7iDVYQMP1J.eEmumlJbO_.rZJjb9dflJkJFbVJiMVT5AMfejdwCjb_0 2024-09-14T11:22:51.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.086+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7400407723466849693', time=2024-09-14T13:20:31.124848+0000, chain.objs.size()=1 2024-09-14T11:22:51.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.086+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.706__shadow_.kf6Ez0-T7AJsHARVCqqD5YcI6fRn1Q7_0 2024-09-14T11:22:51.088 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.088+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:51.089 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.091+0000 7f0f19c16800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:22:51.091 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.092+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:51.091 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.093+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:51.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.094+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=0, next_marker='' 2024-09-14T11:22:51.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.094+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6760856208996315804', time=2024-09-14T13:13:34.726160+0000, chain.objs.size()=2 2024-09-14T11:22:51.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.094+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.160__shadow_.7Fax670LLROwVmeJHJDKdJMv7kEa88W_0 2024-09-14T11:22:51.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.094+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.160__shadow_.7Fax670LLROwVmeJHJDKdJMv7kEa88W_1 2024-09-14T11:22:51.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.094+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='_bl8uS45h2U1fz7kpWS7QMTpZFJg_qhH', time=2024-09-14T13:13:35.197362+0000, chain.objs.size()=1 2024-09-14T11:22:51.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.094+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.160__shadow_.vM4yC_B2PJDomSm6kDvUt9LbmNz6lVU_0 2024-09-14T11:22:51.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.094+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8107323836051585572', time=2024-09-14T13:13:45.134020+0000, chain.objs.size()=1 2024-09-14T11:22:51.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.094+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.182__shadow_.wtQ7z14Nw8lNpYMDniDpw2req7RoXYK_0 2024-09-14T11:22:51.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.094+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13088864986197513845', time=2024-09-14T13:14:46.743312+0000, chain.objs.size()=1 2024-09-14T11:22:51.093 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.094+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.239__shadow_.EocBDrnNCT81ug2FvbcXuv-txI-0KEd_0 2024-09-14T11:22:51.094 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.094+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6161120291384536746', time=2024-09-14T13:14:50.066635+0000, chain.objs.size()=1 2024-09-14T11:22:51.094 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.094+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.251__shadow_.4rqqGzOQ5QUzcoQvWrzVCpltyJxRlka_0 2024-09-14T11:22:51.094 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.094+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9422437911393646750', time=2024-09-14T13:14:51.596858+0000, chain.objs.size()=1 2024-09-14T11:22:51.094 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.094+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.257__shadow_.ySTrfyADdrhT01zbH9bh39caDFdagSb_0 2024-09-14T11:22:51.094 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.094+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8474065991915713658', time=2024-09-14T13:14:59.931099+0000, chain.objs.size()=1 2024-09-14T11:22:51.094 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.094+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.bNCmLe_ub5gtz0BBYPcybujfA4SIFDj_0 2024-09-14T11:22:51.094 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.094+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15064388867803794987', time=2024-09-14T13:14:59.936813+0000, chain.objs.size()=1 2024-09-14T11:22:51.094 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.094+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.-9z9WeZzESsCdtknZlviBiaZiSFNIH-_0 2024-09-14T11:22:51.094 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.094+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2594369308377735330', time=2024-09-14T13:14:59.971224+0000, chain.objs.size()=1 2024-09-14T11:22:51.094 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.094+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.OWYKQKdA2RlCmOH2nzp554gizLdNi_R_0 2024-09-14T11:22:51.094 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.094+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9616428011843865361', time=2024-09-14T13:14:59.978083+0000, chain.objs.size()=1 2024-09-14T11:22:51.094 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.094+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.nCCrKByNsnAjrhUFucgB7nsCx1URcMX_0 2024-09-14T11:22:51.094 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.094+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.656609095537251690', time=2024-09-14T13:15:00.070611+0000, chain.objs.size()=1 2024-09-14T11:22:51.094 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.094+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.zEVrs_bQ3HhYdrOrw9IA0NtapUL8PPr_0 2024-09-14T11:22:51.095 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.096+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9221397944915855104', time=2024-09-14T13:15:00.150206+0000, chain.objs.size()=1 2024-09-14T11:22:51.096 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.096+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.9x2xRPE9FsQ_uSRwxiuMpWMsSb24jip_0 2024-09-14T11:22:51.096 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.096+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10439836459043976128', time=2024-09-14T13:15:00.242328+0000, chain.objs.size()=1 2024-09-14T11:22:51.096 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.096+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.XUfXxp1GhUfgbS7bsneh5fDoHFjaWaN_0 2024-09-14T11:22:51.096 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.096+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15700458979094733072', time=2024-09-14T13:15:00.263576+0000, chain.objs.size()=1 2024-09-14T11:22:51.096 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.096+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.KGVw8wkdRXROP81MoW1KVeso4dgmETq_0 2024-09-14T11:22:51.096 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.096+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.515676189262332507', time=2024-09-14T13:15:00.267343+0000, chain.objs.size()=1 2024-09-14T11:22:51.096 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.096+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.T6bDpMC9d1nQGGJcUrNqIpS172NC3VE_0 2024-09-14T11:22:51.096 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.096+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.545058885319702230', time=2024-09-14T13:15:00.279395+0000, chain.objs.size()=1 2024-09-14T11:22:51.096 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.097+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.xk65sXFq44K13CFrs01P6KANvQclt7C_0 2024-09-14T11:22:51.096 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.097+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16261661684038334379', time=2024-09-14T13:15:00.296961+0000, chain.objs.size()=1 2024-09-14T11:22:51.096 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.097+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.ytMdiDMxzmESgdQePSv2LorNAjrem8y_0 2024-09-14T11:22:51.096 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.097+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.540754684521492682', time=2024-09-14T13:15:00.303885+0000, chain.objs.size()=1 2024-09-14T11:22:51.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.097+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.L4WJwYN7fCzN_9NoWRcBXsV0z6-3l5I_0 2024-09-14T11:22:51.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.097+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2975345677070326832', time=2024-09-14T13:15:00.468664+0000, chain.objs.size()=1 2024-09-14T11:22:51.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.097+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.rNGtanI8ZHSHW9VfgcRM_fo32Y8u1Rn_0 2024-09-14T11:22:51.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.097+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6427797041536942529', time=2024-09-14T13:15:00.469882+0000, chain.objs.size()=1 2024-09-14T11:22:51.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.097+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.lRWeWcwAsQnfXUXgVaclZnDzogh9Ibq_0 2024-09-14T11:22:51.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.097+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15922421690297289875', time=2024-09-14T13:15:00.609608+0000, chain.objs.size()=1 2024-09-14T11:22:51.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.097+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.BXbWcQaEsle_qDJGdRMiBjvtVAgvtP5_0 2024-09-14T11:22:51.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.097+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3879739851751260588', time=2024-09-14T13:15:00.709896+0000, chain.objs.size()=1 2024-09-14T11:22:51.097 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.097+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.aJNbEveMCyQEdrTVtO0Gt5etHPWncPo_0 2024-09-14T11:22:51.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.098+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16758821778646185145', time=2024-09-14T13:15:00.875108+0000, chain.objs.size()=1 2024-09-14T11:22:51.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.098+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.UAPGRTsnf7eiTDnPDbJY-mWAZngEN3H_0 2024-09-14T11:22:51.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.098+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17226737491258342559', time=2024-09-14T13:15:00.885420+0000, chain.objs.size()=1 2024-09-14T11:22:51.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.098+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.v5L28vGIQqESOHYsqMXSxSkqtXkPjCr_0 2024-09-14T11:22:51.098 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.098+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3385463094331814232', time=2024-09-14T13:15:00.886095+0000, chain.objs.size()=1 2024-09-14T11:22:51.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.098+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.wpNgj6iBhEL5-b3p3x6txndxjxwczaT_0 2024-09-14T11:22:51.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.098+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4180648214396683157', time=2024-09-14T13:15:00.906845+0000, chain.objs.size()=1 2024-09-14T11:22:51.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.098+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.yq7fv4gpznL_EXqH4xenaQOsiUPyesc_0 2024-09-14T11:22:51.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.099+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8866443294483957208', time=2024-09-14T13:15:04.148478+0000, chain.objs.size()=1 2024-09-14T11:22:51.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.099+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.275__shadow_.F-xh_EbhHDMzdS-GvtyhksU4q14a4vu_0 2024-09-14T11:22:51.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.099+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3212191988058381045', time=2024-09-14T13:15:05.467515+0000, chain.objs.size()=1 2024-09-14T11:22:51.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.099+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.280__shadow_.NkcdibFEeuHG8A40I9dIr7W21cXq0QP_0 2024-09-14T11:22:51.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.099+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.983002627750153109', time=2024-09-14T13:15:06.174701+0000, chain.objs.size()=1 2024-09-14T11:22:51.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.099+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.282__shadow_.ZJWgloTb5zW2J8cG9Q40cfivymxl2GU_0 2024-09-14T11:22:51.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.099+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1228108184678440895', time=2024-09-14T13:15:06.708822+0000, chain.objs.size()=1 2024-09-14T11:22:51.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.099+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.284__shadow_.owZZLLPtsz71FZgZ8UjHLf9VVn8kx-N_0 2024-09-14T11:22:51.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.099+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10780490734305937325', time=2024-09-14T13:15:09.248844+0000, chain.objs.size()=1 2024-09-14T11:22:51.099 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.099+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.292__shadow_.8S1XPZa6YbNkX4SkMP9e1iSKBJCxJ1X_0 2024-09-14T11:22:51.100 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.099+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13788587406059354274', time=2024-09-14T13:15:10.074081+0000, chain.objs.size()=1 2024-09-14T11:22:51.100 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.099+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.294__shadow_.N3SnaAsx1WeWqEHtj0w5kHbJEzkOjtC_0 2024-09-14T11:22:51.100 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.099+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11258903452755519156', time=2024-09-14T13:15:11.152037+0000, chain.objs.size()=1 2024-09-14T11:22:51.100 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.099+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.298__shadow_.fgCtLNoi2jcfBDp38fuD6W60kEB1OE3_0 2024-09-14T11:22:51.100 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.100+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7245596361436011527', time=2024-09-14T13:15:11.444791+0000, chain.objs.size()=1 2024-09-14T11:22:51.101 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.100+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.299__shadow_.f_eEY0FT0aQca4JUlmMS1TYFoXPstzx_0 2024-09-14T11:22:51.101 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.100+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10950894979014441518', time=2024-09-14T13:15:13.404655+0000, chain.objs.size()=1 2024-09-14T11:22:51.101 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.100+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.306__shadow_.97xxVZ1z45AuAmDTNR2w4g23U3TXtms_0 2024-09-14T11:22:51.101 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.101+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6866553239223825504', time=2024-09-14T13:15:24.739977+0000, chain.objs.size()=1 2024-09-14T11:22:51.101 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.101+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.EBQANxpge3J9oS6pug2sD_4otOOHTzH_0 2024-09-14T11:22:51.101 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.101+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15302007059174722314', time=2024-09-14T13:15:24.774490+0000, chain.objs.size()=1 2024-09-14T11:22:51.101 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.101+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.RKAI_7J8nReka-q7106HWehLiqQanM3_0 2024-09-14T11:22:51.101 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.101+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13664603565505745543', time=2024-09-14T13:15:24.798146+0000, chain.objs.size()=1 2024-09-14T11:22:51.101 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.101+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.-4P9GAo3W7tLGtnlJDb2Jb-pDsYU54V_0 2024-09-14T11:22:51.101 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.101+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11432605826512441968', time=2024-09-14T13:15:24.907304+0000, chain.objs.size()=1 2024-09-14T11:22:51.101 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.101+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.O_sunm8KBHm_k2Cs3ERM6wTchLf4EMv_0 2024-09-14T11:22:51.101 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.101+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5229471720297817442', time=2024-09-14T13:15:24.929046+0000, chain.objs.size()=1 2024-09-14T11:22:51.101 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.101+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.s0Vd5QBXMsAn37t8OdODijc3FYdQilb_0 2024-09-14T11:22:51.101 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.101+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15945199679991040258', time=2024-09-14T13:15:25.044891+0000, chain.objs.size()=1 2024-09-14T11:22:51.102 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.101+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.nIgJ4jhc2A6GJAO6EuOVcAgwDTyOVmP_0 2024-09-14T11:22:51.102 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.101+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7344902797537584152', time=2024-09-14T13:15:25.104809+0000, chain.objs.size()=1 2024-09-14T11:22:51.102 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.101+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.AmgfNLF-VSr50q-zV4j4dM0DK1oFEU8_0 2024-09-14T11:22:51.103 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.102+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1188194013253892458', time=2024-09-14T13:15:25.242003+0000, chain.objs.size()=1 2024-09-14T11:22:51.103 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.102+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.LTeOhUx2G-Mu1TBPLxFI7hTigenzLxp_0 2024-09-14T11:22:51.103 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.102+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11680283373865940965', time=2024-09-14T13:15:25.257083+0000, chain.objs.size()=1 2024-09-14T11:22:51.103 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.102+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.7-jCZipZo3XYM17uNyUEJcojueeW3X8_0 2024-09-14T11:22:51.103 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.102+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4664582474341331153', time=2024-09-14T13:15:25.265521+0000, chain.objs.size()=1 2024-09-14T11:22:51.103 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.102+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.A0IIQxi-FkX_z7BcziQ6aEC5zsAsg3d_0 2024-09-14T11:22:51.103 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.103+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17974622820765265275', time=2024-09-14T13:15:25.382382+0000, chain.objs.size()=1 2024-09-14T11:22:51.103 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.103+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.nA42ezrzJich5ZczZm9w8ZOa_AwJUCp_0 2024-09-14T11:22:51.103 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.103+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.485938962355143402', time=2024-09-14T13:15:25.404422+0000, chain.objs.size()=1 2024-09-14T11:22:51.104 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.103+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.WTdfP8RsPFjXJ1fw_nAXlrwmfVjdNSg_0 2024-09-14T11:22:51.104 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.103+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1280915203640950829', time=2024-09-14T13:15:25.413984+0000, chain.objs.size()=1 2024-09-14T11:22:51.104 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.103+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.pP4XxlpysxzDxcXX8W1IcmQRi74NNvE_0 2024-09-14T11:22:51.104 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.103+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1083562948563791051', time=2024-09-14T13:15:25.448073+0000, chain.objs.size()=1 2024-09-14T11:22:51.104 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.103+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.gfCRyzLGL_bcWgJvyaxVBvp5HUhmSW4_0 2024-09-14T11:22:51.104 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.103+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5329044382030565283', time=2024-09-14T13:15:25.570348+0000, chain.objs.size()=1 2024-09-14T11:22:51.104 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.103+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.iO8If0lzIKW_RVQ2Y426RQlekU28-9V_0 2024-09-14T11:22:51.104 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.103+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5151201837855050775', time=2024-09-14T13:15:25.577211+0000, chain.objs.size()=1 2024-09-14T11:22:51.104 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.103+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.O2gh5I4vMbuusGYPzNyCWx_Axtl--0f_0 2024-09-14T11:22:51.104 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.103+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13575844567142235587', time=2024-09-14T13:15:25.588944+0000, chain.objs.size()=1 2024-09-14T11:22:51.104 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.103+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.rilFpO7QW5OWH8ymL6J0OZ3e5VzRml5_0 2024-09-14T11:22:51.104 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.103+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6884839486904805849', time=2024-09-14T13:15:25.689299+0000, chain.objs.size()=1 2024-09-14T11:22:51.104 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.103+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.SfTATsD_BchEI6L4pTfZ58lIoOqKBK5_0 2024-09-14T11:22:51.105 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.104+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5423128782082767101', time=2024-09-14T13:15:25.690813+0000, chain.objs.size()=1 2024-09-14T11:22:51.105 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.104+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.ltTff2_15RXPy6oap0QHMTtZtZIjhgN_0 2024-09-14T11:22:51.105 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.104+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6236593756719750984', time=2024-09-14T13:15:25.734214+0000, chain.objs.size()=1 2024-09-14T11:22:51.105 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.104+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.lcNJNeOuL9vGBTL69ThWI3AnRFN3jkw_0 2024-09-14T11:22:51.105 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.104+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2214359317036544699', time=2024-09-14T13:15:25.746508+0000, chain.objs.size()=1 2024-09-14T11:22:51.105 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.104+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.SH6pfUJMHiknBWVS2hV1ejhZ1ig-ZQo_0 2024-09-14T11:22:51.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.105+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4134659614600390570', time=2024-09-14T13:15:25.770145+0000, chain.objs.size()=1 2024-09-14T11:22:51.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.105+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.x_lgwJfnxRzYkTl8_IROjoBWGBrxZ3J_0 2024-09-14T11:22:51.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.105+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5496512347221997257', time=2024-09-14T13:15:25.773022+0000, chain.objs.size()=1 2024-09-14T11:22:51.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.105+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.gbH8iUcFZUNZAQ0lsH1wjFW4TOtngfi_0 2024-09-14T11:22:51.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.105+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11312611887180726711', time=2024-09-14T13:15:25.879372+0000, chain.objs.size()=1 2024-09-14T11:22:51.106 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.105+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.jtAjumqdgnF5EsIxm5zzPEVvd785mei_0 2024-09-14T11:22:51.107 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.105+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5992898392471517379', time=2024-09-14T13:15:25.919321+0000, chain.objs.size()=1 2024-09-14T11:22:51.107 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.105+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.7Uk_YyIAcYqkWofgdA6vJypG8akyAYM_0 2024-09-14T11:22:51.107 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.106+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6225204415051561036', time=2024-09-14T13:15:25.921152+0000, chain.objs.size()=1 2024-09-14T11:22:51.107 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.106+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.xQ-7V5LGO86lXWPhPX4p_I0v3f_lu8k_0 2024-09-14T11:22:51.107 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.106+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10666380439405688086', time=2024-09-14T13:15:33.186813+0000, chain.objs.size()=1 2024-09-14T11:22:51.107 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.106+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.gBw570KPuDvjGcjX9QkNFkQDpclk05b_0 2024-09-14T11:22:51.107 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.106+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4929634378405886334', time=2024-09-14T13:15:33.189721+0000, chain.objs.size()=1 2024-09-14T11:22:51.107 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.106+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.EZ1FhZ2Qn_KpORHeULPxLkzk5NlvekN_0 2024-09-14T11:22:51.107 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.106+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7645482773003702161', time=2024-09-14T13:15:33.236745+0000, chain.objs.size()=1 2024-09-14T11:22:51.107 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.106+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.RDSheWNPXweFauKXX7KRuv8QiXv5cqf_0 2024-09-14T11:22:51.107 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.106+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2176033572239647631', time=2024-09-14T13:15:33.370958+0000, chain.objs.size()=1 2024-09-14T11:22:51.107 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.106+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.suSR1vn157fi03du2mWPwOzl11TYWos_0 2024-09-14T11:22:51.107 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.106+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7607542669895687086', time=2024-09-14T13:15:33.392455+0000, chain.objs.size()=1 2024-09-14T11:22:51.107 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.106+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.QSAxB_V1hCgPIwimh0HWDkojOwfkQxD_0 2024-09-14T11:22:51.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.106+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2021928512370332512', time=2024-09-14T13:15:33.531769+0000, chain.objs.size()=1 2024-09-14T11:22:51.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.106+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.RO8Ghk8_U4UdQk10EgkmJRfeX4eDJ9Q_0 2024-09-14T11:22:51.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.107+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5713347044240016499', time=2024-09-14T13:15:33.533726+0000, chain.objs.size()=1 2024-09-14T11:22:51.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.107+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.cwrviheQAtUFLmGrDLezmLn7U2m7jvF_0 2024-09-14T11:22:51.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.107+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5286340117887281696', time=2024-09-14T13:15:33.548486+0000, chain.objs.size()=1 2024-09-14T11:22:51.108 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.107+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.0Hl2ABOfo9Dt9TDWBvyDmGlSmF0Zw02_0 2024-09-14T11:22:51.109 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.108+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1649414261838285846', time=2024-09-14T13:15:33.557082+0000, chain.objs.size()=1 2024-09-14T11:22:51.109 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.108+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.yUQGfwnfq_xesFRmEbiQ1nC7ocPSIeJ_0 2024-09-14T11:22:51.109 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.108+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17622561763983918511', time=2024-09-14T13:15:33.558158+0000, chain.objs.size()=1 2024-09-14T11:22:51.109 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.108+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.6ZhdmCXguDl7KhtufvDTbpIFYE6oS03_0 2024-09-14T11:22:51.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.108+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4160883290246202461', time=2024-09-14T13:15:33.710548+0000, chain.objs.size()=1 2024-09-14T11:22:51.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.108+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.wPHa9V2_XFEGqZbOhz9cxX-dyX6c618_0 2024-09-14T11:22:51.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.108+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10961355077909063871', time=2024-09-14T13:15:33.736665+0000, chain.objs.size()=1 2024-09-14T11:22:51.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.108+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.RzKepN8bDMsRKA17mk7yNjfDByPhoQS_0 2024-09-14T11:22:51.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.108+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5310954211878462909', time=2024-09-14T13:15:33.744102+0000, chain.objs.size()=1 2024-09-14T11:22:51.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.108+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.622b8ogzOP273ABscOyxLHSz2kU1XHU_0 2024-09-14T11:22:51.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.108+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6621291200380012161', time=2024-09-14T13:15:33.751740+0000, chain.objs.size()=1 2024-09-14T11:22:51.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.108+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.c0Kjej1va4cletQgxQze-v7vAWrDXSg_0 2024-09-14T11:22:51.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.108+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18299175318019695776', time=2024-09-14T13:15:33.893768+0000, chain.objs.size()=1 2024-09-14T11:22:51.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.108+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.sbCra8uZ-zQnOH9cxkVlZq8etz0KZEb_0 2024-09-14T11:22:51.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.108+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9639056445311051112', time=2024-09-14T13:15:33.915681+0000, chain.objs.size()=1 2024-09-14T11:22:51.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.108+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.rGdnzyFePH_rmGaw_NBFRnrNf8nkXy8_0 2024-09-14T11:22:51.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.108+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15337767788627879515', time=2024-09-14T13:15:33.927817+0000, chain.objs.size()=1 2024-09-14T11:22:51.110 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.108+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.oT0KYRD7Csb8Nap49gGtTUfKS2xucUV_0 2024-09-14T11:22:51.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.110+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16335614160702622807', time=2024-09-14T13:15:34.012997+0000, chain.objs.size()=1 2024-09-14T11:22:51.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.110+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.dIOXWm7Ip5leXYZyyQYiEZlhcRKPcmy_0 2024-09-14T11:22:51.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.110+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12845668905067134087', time=2024-09-14T13:15:34.025186+0000, chain.objs.size()=1 2024-09-14T11:22:51.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.110+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.rzpSn-hH2hpMNTvxUjdjsMSg0Nh8FWg_0 2024-09-14T11:22:51.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.111+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7833887153907816703', time=2024-09-14T13:15:34.056249+0000, chain.objs.size()=1 2024-09-14T11:22:51.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.111+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.uV4wy1IggnMyWj1MBmhwO1K3YVw633z_0 2024-09-14T11:22:51.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.111+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1933762232721885980', time=2024-09-14T13:15:34.059406+0000, chain.objs.size()=1 2024-09-14T11:22:51.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.111+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.zn1Ks0OhcbEZbpPP_TRMwLLA7EmD1_E_0 2024-09-14T11:22:51.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.111+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2895237590074686301', time=2024-09-14T13:15:34.172029+0000, chain.objs.size()=1 2024-09-14T11:22:51.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.111+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.QeBRv6rTHwj4Th0dQxnff-IYZY29nBQ_0 2024-09-14T11:22:51.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.111+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16370093448717884989', time=2024-09-14T13:15:34.172928+0000, chain.objs.size()=1 2024-09-14T11:22:51.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.111+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.jt7EUq_q6FeFR8s-RGz9gernUiH1Nb8_0 2024-09-14T11:22:51.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.111+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1568533852074678883', time=2024-09-14T13:15:34.174027+0000, chain.objs.size()=1 2024-09-14T11:22:51.111 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.111+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_._o53DFDrHH8Dy-DyDOSLmGa4Bc80yAk_0 2024-09-14T11:22:51.112 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.111+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1295867985153541634', time=2024-09-14T13:15:34.184749+0000, chain.objs.size()=1 2024-09-14T11:22:51.112 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.111+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.oR03Jg5zbHkhaYUQzaQst2pR2Mqr-iT_0 2024-09-14T11:22:51.112 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.111+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11906907095214473719', time=2024-09-14T13:15:34.214928+0000, chain.objs.size()=1 2024-09-14T11:22:51.112 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.111+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.egyOS0OsjBOHtBm4RA_v3lKB9xPbG_N_0 2024-09-14T11:22:51.113 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.112+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.825299974189232621', time=2024-09-14T13:15:34.233048+0000, chain.objs.size()=1 2024-09-14T11:22:51.113 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.112+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_._D7BxnJ9P49cI2dVEUME5MUPaBDLjWL_0 2024-09-14T11:22:51.113 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.112+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9155240293596317210', time=2024-09-14T13:15:34.374512+0000, chain.objs.size()=1 2024-09-14T11:22:51.113 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.112+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.0I651R-zbmfadoBc2OCJF-8amQILOrk_0 2024-09-14T11:22:51.113 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.112+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14399947881063973983', time=2024-09-14T13:15:34.383216+0000, chain.objs.size()=1 2024-09-14T11:22:51.113 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.112+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.PIlJ3XJ5S6Rb9Jd946l94btm7if0f9A_0 2024-09-14T11:22:51.113 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.112+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17210875640591422835', time=2024-09-14T13:16:08.294726+0000, chain.objs.size()=1 2024-09-14T11:22:51.113 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.112+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.451__shadow_.iburoKGmmfyRJAvsav3722GMiYLcMhL_0 2024-09-14T11:22:51.113 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.113+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1455016806322104959', time=2024-09-14T13:16:16.978318+0000, chain.objs.size()=1 2024-09-14T11:22:51.113 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.113+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.483__shadow_.uNo_3IDgYiskpmzwQilJt8YUaB6atyT_0 2024-09-14T11:22:51.113 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.113+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8310413495074346168', time=2024-09-14T13:16:31.109326+0000, chain.objs.size()=3 2024-09-14T11:22:51.113 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.113+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.521__multipart_mymultipart.2~VfOyVQXuO8AMaPyMJAiBLWxy1STL1L4.1 2024-09-14T11:22:51.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.113+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.521__multipart_mymultipart.2~VfOyVQXuO8AMaPyMJAiBLWxy1STL1L4.2 2024-09-14T11:22:51.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.113+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.521__multipart_mymultipart.2~VfOyVQXuO8AMaPyMJAiBLWxy1STL1L4.3 2024-09-14T11:22:51.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.113+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11179724333653388236', time=2024-09-14T13:17:12.827625+0000, chain.objs.size()=1 2024-09-14T11:22:51.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.113+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.557__shadow_.Znrwr_-ppnGtHc9SMoM4L_jwI-B3lOe_0 2024-09-14T11:22:51.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.113+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11490176922757685941', time=2024-09-14T13:17:26.446453+0000, chain.objs.size()=1 2024-09-14T11:22:51.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.113+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.569__shadow:gG3L3ICpG4BFplFnXY33KbJuk7y6FOW_.5tG8lnQKL95GlBk4ylMHJ3d6teotyok_0 2024-09-14T11:22:51.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.113+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12074226786237128308', time=2024-09-14T13:17:26.866005+0000, chain.objs.size()=1 2024-09-14T11:22:51.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.113+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.569__shadow:WLGNOjdqUViTm1fbSkz7eYy.NPSqCY0_.aEotgx_zmSVvtmiu-uD9au9ZQKWhuuk_0 2024-09-14T11:22:51.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.114+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10478831193182025368', time=2024-09-14T13:17:53.507247+0000, chain.objs.size()=1 2024-09-14T11:22:51.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.114+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.587__shadow:bEguqYpuJL5FnoOY8qWiOW.enDmnuQm_.lWj5u6RsC1KP7HQwxnfYSfg3DknXWIo_0 2024-09-14T11:22:51.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.114+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6311368854907616010', time=2024-09-14T13:18:03.039944+0000, chain.objs.size()=6 2024-09-14T11:22:51.114 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.114+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.615__multipart_multipart_enc.2~4hjbQX7-AfgGe1VHGsa0EshdviQr1_R.1 2024-09-14T11:22:51.115 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.115+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.615__multipart_multipart_enc.2~4hjbQX7-AfgGe1VHGsa0EshdviQr1_R.2 2024-09-14T11:22:51.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.116+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.615__multipart_multipart_enc.2~4hjbQX7-AfgGe1VHGsa0EshdviQr1_R.3 2024-09-14T11:22:51.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.116+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.615__multipart_multipart_enc.2~4hjbQX7-AfgGe1VHGsa0EshdviQr1_R.4 2024-09-14T11:22:51.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.116+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.615__multipart_multipart_enc.2~4hjbQX7-AfgGe1VHGsa0EshdviQr1_R.5 2024-09-14T11:22:51.116 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.116+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.615__multipart_multipart_enc.2~4hjbQX7-AfgGe1VHGsa0EshdviQr1_R.6 2024-09-14T11:22:51.117 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.118+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3750923147327907775', time=2024-09-14T13:20:08.097406+0000, chain.objs.size()=1 2024-09-14T11:22:51.117 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.118+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.626__shadow_.aqvsIHa7ayMagoUqnpSrx9cuEEdQ1o7_0 2024-09-14T11:22:51.117 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.118+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10719909905438143527', time=2024-09-14T13:21:02.130234+0000, chain.objs.size()=1 2024-09-14T11:22:51.117 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.118+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.745__shadow_.ITKbjnw57wnhfVIORRAPHZTtvzIAJg8_0 2024-09-14T11:22:51.119 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.121+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:51.128 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.130+0000 7f0f19c16800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:22:51.130 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.131+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:51.130 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.132+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:51.132 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.133+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46945' 2024-09-14T11:22:51.132 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.133+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='_kLkTeBEUcHc8wYe1SEdnAhXhQ_YelY5', time=2024-09-14T13:13:36.645668+0000, chain.objs.size()=2 2024-09-14T11:22:51.132 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.133+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.161__shadow_.43xRYHTOyELbDTfFWe0m3yAHh1UD-ya_0 2024-09-14T11:22:51.132 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.133+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.161__shadow_.43xRYHTOyELbDTfFWe0m3yAHh1UD-ya_1 2024-09-14T11:22:51.132 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.133+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='2~T1ZRySBcUL7iSfqm22xUTVGJP3VOxIV', time=2024-09-14T13:13:52.069602+0000, chain.objs.size()=1 2024-09-14T11:22:51.132 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.133+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.201__multipart_mymultipart.2~T1ZRySBcUL7iSfqm22xUTVGJP3VOxIV.1 2024-09-14T11:22:51.132 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.133+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17113952977237841430', time=2024-09-14T13:14:45.125585+0000, chain.objs.size()=1 2024-09-14T11:22:51.132 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.133+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.233__shadow_.ijr1ktnkMYTVK9GUVD1ONU2JPfJy5wn_0 2024-09-14T11:22:51.132 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.133+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9265375219410272039', time=2024-09-14T13:14:45.378109+0000, chain.objs.size()=1 2024-09-14T11:22:51.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.133+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.234__shadow_.XnNyuf4Bg58g-9ijv7g6nGNGYSW91A0_0 2024-09-14T11:22:51.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.133+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1080499109667311085', time=2024-09-14T13:14:47.813507+0000, chain.objs.size()=1 2024-09-14T11:22:51.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.133+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.243__shadow_.xrQfMCxzaKbQh2AyV6pZo2Rp1pCe9wv_0 2024-09-14T11:22:51.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.133+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6705230587099073498', time=2024-09-14T13:14:48.784887+0000, chain.objs.size()=1 2024-09-14T11:22:51.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.133+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.246__shadow_.OYhaLncZWUK4_kWmaemUWla22JMkEwA_0 2024-09-14T11:22:51.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.133+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1739523440981690898', time=2024-09-14T13:14:49.565806+0000, chain.objs.size()=1 2024-09-14T11:22:51.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.133+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.249__shadow_.JApLWT9zAMMr3hzuhru3zmbLfN9vYWW_0 2024-09-14T11:22:51.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.133+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12726171925257765725', time=2024-09-14T13:14:59.748610+0000, chain.objs.size()=1 2024-09-14T11:22:51.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.133+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.KjALDYMdMxMRnbU2gn4LFBHcB1TZe34_0 2024-09-14T11:22:51.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.133+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11686738324285453544', time=2024-09-14T13:14:59.759459+0000, chain.objs.size()=1 2024-09-14T11:22:51.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.133+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.4jj3SSucIiudP0mKlrRYnjemTCw2pr7_0 2024-09-14T11:22:51.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.133+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13583676035287198854', time=2024-09-14T13:14:59.768642+0000, chain.objs.size()=1 2024-09-14T11:22:51.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.133+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Brv7ULU2Pv7R3UdbWPMaJ-cNrAk-UkJ_0 2024-09-14T11:22:51.133 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.133+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11301749651646242872', time=2024-09-14T13:14:59.786130+0000, chain.objs.size()=1 2024-09-14T11:22:51.134 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.133+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.kYOZZ__RN8WMyZNOSkQO96CtOgdojLK_0 2024-09-14T11:22:51.135 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.136+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13523881762820357166', time=2024-09-14T13:14:59.912456+0000, chain.objs.size()=1 2024-09-14T11:22:51.135 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.136+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Y-t3dh60fTM_yHKLIrxq2XltvcILSyR_0 2024-09-14T11:22:51.135 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.136+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17844016602066809467', time=2024-09-14T13:14:59.946369+0000, chain.objs.size()=1 2024-09-14T11:22:51.135 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.136+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.hw2JriXGIoDMIT-42uu8o8p_1ACi3t6_0 2024-09-14T11:22:51.135 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.136+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4513615954171753604', time=2024-09-14T13:14:59.969482+0000, chain.objs.size()=1 2024-09-14T11:22:51.135 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.136+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.DmyfATaOKiayU0lahnPK7mR4tUqcLgA_0 2024-09-14T11:22:51.135 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.136+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6186665361182151125', time=2024-09-14T13:15:00.061564+0000, chain.objs.size()=1 2024-09-14T11:22:51.135 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.136+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.o6OpP5muz2f0vh-frHi_1DfjExgfvVJ_0 2024-09-14T11:22:51.135 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.136+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16033208839916343498', time=2024-09-14T13:15:00.074305+0000, chain.objs.size()=1 2024-09-14T11:22:51.135 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.136+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.QYRvBe-U9TqpFYZxT6tFImGQEp9kEO3_0 2024-09-14T11:22:51.135 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.136+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3413243602578612956', time=2024-09-14T13:15:00.128509+0000, chain.objs.size()=1 2024-09-14T11:22:51.136 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.136+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.K5SKwfICv0tbGAu2mG4gnFoi7FUr9kd_0 2024-09-14T11:22:51.136 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.136+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7497080797875265273', time=2024-09-14T13:15:00.137784+0000, chain.objs.size()=1 2024-09-14T11:22:51.136 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.136+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.BbL44uNjtBZJ_5SAY_XUPC2f10SBB_0_0 2024-09-14T11:22:51.136 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.136+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12668433697642266574', time=2024-09-14T13:15:00.239179+0000, chain.objs.size()=1 2024-09-14T11:22:51.136 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.136+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.slRT1n2GFoA_nUwna3mX_KTm9efieOO_0 2024-09-14T11:22:51.136 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.136+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4649933613535367073', time=2024-09-14T13:15:00.251792+0000, chain.objs.size()=1 2024-09-14T11:22:51.136 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.136+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.oEKWnS7t-mx-7IUXOB1JJ8_gZr82FbQ_0 2024-09-14T11:22:51.136 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.136+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2727152328025489512', time=2024-09-14T13:15:00.255766+0000, chain.objs.size()=1 2024-09-14T11:22:51.136 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.136+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.irc2IrE72zrL05HMkrZvBeG6V9Yd6Fs_0 2024-09-14T11:22:51.137 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.137+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11948196143674143558', time=2024-09-14T13:15:00.271689+0000, chain.objs.size()=1 2024-09-14T11:22:51.137 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.137+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.IwMPFCJSyCxgqXSFDO1k7WQRUp9aLF__0 2024-09-14T11:22:51.137 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.137+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14326143695748483370', time=2024-09-14T13:15:00.280208+0000, chain.objs.size()=1 2024-09-14T11:22:51.137 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.137+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.sy51K_7cO3SCuLUeTSuy2ogDTHthGyh_0 2024-09-14T11:22:51.137 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.138+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.838908639463224408', time=2024-09-14T13:15:00.281136+0000, chain.objs.size()=1 2024-09-14T11:22:51.137 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.138+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.HXO5wQr4Q1gxJ_oMchYBi4ZbhLp9ZE5_0 2024-09-14T11:22:51.137 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.138+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5867321177449213567', time=2024-09-14T13:15:00.413695+0000, chain.objs.size()=1 2024-09-14T11:22:51.137 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.138+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.ql17zzrn1MZudsXnkqDk1Jq5ho-z6Nl_0 2024-09-14T11:22:51.138 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.138+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10109311870404405545', time=2024-09-14T13:15:00.420547+0000, chain.objs.size()=1 2024-09-14T11:22:51.138 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.138+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.W7JZgCAoECrL6ORCiXiSzhtPukdZvIV_0 2024-09-14T11:22:51.138 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.138+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16274137353843261578', time=2024-09-14T13:15:00.421849+0000, chain.objs.size()=1 2024-09-14T11:22:51.138 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.138+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.CfmWChvcmdx7mj1iWdQ1fbw4ZerqLv0_0 2024-09-14T11:22:51.138 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.138+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15726664897059282300', time=2024-09-14T13:15:00.463249+0000, chain.objs.size()=1 2024-09-14T11:22:51.138 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.138+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.vYgv14pd76LOaXJJWP6ksTDl0-hRSsa_0 2024-09-14T11:22:51.138 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.138+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8288116728019639902', time=2024-09-14T13:15:00.567984+0000, chain.objs.size()=1 2024-09-14T11:22:51.138 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.138+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.f7jRVfGXjX7BtXoIrKTMa5lCZ28zaGp_0 2024-09-14T11:22:51.139 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.139+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4868630354508788932', time=2024-09-14T13:15:00.585298+0000, chain.objs.size()=1 2024-09-14T11:22:51.139 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.139+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.6w1kGUnXatdblOdJ9J2QJf-Kki72V1n_0 2024-09-14T11:22:51.139 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.139+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7262707084548939266', time=2024-09-14T13:15:00.632787+0000, chain.objs.size()=1 2024-09-14T11:22:51.139 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.139+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.idntkPix9BZvgNpA9L9_79E4xCpGYfO_0 2024-09-14T11:22:51.139 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.139+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5386788693514847783', time=2024-09-14T13:15:00.735680+0000, chain.objs.size()=1 2024-09-14T11:22:51.139 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.139+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.rIKbZ0NhqgNE_PdjQc9qtQGo4Nhs328_0 2024-09-14T11:22:51.139 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.139+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3414105327937938231', time=2024-09-14T13:15:00.778962+0000, chain.objs.size()=1 2024-09-14T11:22:51.139 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.139+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.pdejqBDvn4zLO8dqNmOGEqX9gMz-gYA_0 2024-09-14T11:22:51.139 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.140+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14928141178299957971', time=2024-09-14T13:15:00.784057+0000, chain.objs.size()=1 2024-09-14T11:22:51.139 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.140+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.1Syg6EGTzX4bIfLx5G6J60xaC6VPQE8_0 2024-09-14T11:22:51.140 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.140+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12786526789832893957', time=2024-09-14T13:15:00.802036+0000, chain.objs.size()=1 2024-09-14T11:22:51.140 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.140+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.pi1VWysq22nm-EyJSZ0zR6Yfkt5AtS6_0 2024-09-14T11:22:51.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.141+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13107783949789494739', time=2024-09-14T13:15:00.871756+0000, chain.objs.size()=1 2024-09-14T11:22:51.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.141+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.ti1NWWA5pM0Vj-JcEt-woToYHKg1se3_0 2024-09-14T11:22:51.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.141+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3385125307543026891', time=2024-09-14T13:15:00.873862+0000, chain.objs.size()=1 2024-09-14T11:22:51.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.141+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.NBXZpAil0S0eE4D-wEoMnqkt0WPFkz5_0 2024-09-14T11:22:51.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.141+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16070040869298051050', time=2024-09-14T13:15:00.875650+0000, chain.objs.size()=1 2024-09-14T11:22:51.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.141+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.zcqmRCQrFoB-PSfpSZus5XWfjxSyTz8_0 2024-09-14T11:22:51.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.141+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10166871795352293012', time=2024-09-14T13:15:00.889331+0000, chain.objs.size()=1 2024-09-14T11:22:51.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.141+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.vlP9m3oscuT_ZvJCNrDq3b8ZaRNjuej_0 2024-09-14T11:22:51.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.141+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13813772644976048073', time=2024-09-14T13:15:00.894655+0000, chain.objs.size()=1 2024-09-14T11:22:51.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.141+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.R-FMRAeP0I2JbOQiheMrBoK0pAEtmSW_0 2024-09-14T11:22:51.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.141+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9128969729425614517', time=2024-09-14T13:15:01.434830+0000, chain.objs.size()=1 2024-09-14T11:22:51.141 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.141+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.264__shadow_.R5EfuyIFQWQhRqK83XPd-AvF85kGus6_0 2024-09-14T11:22:51.142 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.141+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4523892901342741399', time=2024-09-14T13:15:03.899597+0000, chain.objs.size()=1 2024-09-14T11:22:51.142 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.141+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.274__shadow_.lIWD6eKg71-3AXVp1NoMkJhfIBsf_yP_0 2024-09-14T11:22:51.142 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.141+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17853494573841691841', time=2024-09-14T13:15:06.174045+0000, chain.objs.size()=1 2024-09-14T11:22:51.142 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.141+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.282__shadow_.ua9AjuqkKYf1XD3fucbF0ntpFGja0_7_0 2024-09-14T11:22:51.142 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.141+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11948394753106055616', time=2024-09-14T13:15:07.796991+0000, chain.objs.size()=1 2024-09-14T11:22:51.142 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.141+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.288__shadow_.E3riVruNztbE5oX96VT_C1e90QPKgpb_0 2024-09-14T11:22:51.142 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.141+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8719072302110566049', time=2024-09-14T13:15:07.797744+0000, chain.objs.size()=1 2024-09-14T11:22:51.142 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.141+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.288__shadow_.ZGrB4gg1RAA55KQDhGYHhhKQdd3e5ds_0 2024-09-14T11:22:51.143 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.142+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6561787250646945608', time=2024-09-14T13:15:07.798489+0000, chain.objs.size()=1 2024-09-14T11:22:51.143 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.142+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.288__shadow_.eYAG2k1yf-ybUs-Z2PnbbH_WkarSmcg_0 2024-09-14T11:22:51.143 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.143+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3753308723976262709', time=2024-09-14T13:15:10.610624+0000, chain.objs.size()=1 2024-09-14T11:22:51.143 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.143+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.296__shadow_.M_z2hEhu2ARHBBm5f6-nqqsSuIVQy0i_0 2024-09-14T11:22:51.144 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.143+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14282205245914789835', time=2024-09-14T13:15:10.860305+0000, chain.objs.size()=1 2024-09-14T11:22:51.144 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.143+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.297__shadow_.i_hRXrz_GdvDPpQ1D82VD8bz1dB_9xA_0 2024-09-14T11:22:51.144 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.143+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17869744903045591971', time=2024-09-14T13:15:11.947591+0000, chain.objs.size()=1 2024-09-14T11:22:51.144 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.143+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.301__shadow_.DRtTnweM_auNT3sJclncOtXMyoeLkFw_0 2024-09-14T11:22:51.144 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.144+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15212809693691208309', time=2024-09-14T13:15:24.711846+0000, chain.objs.size()=1 2024-09-14T11:22:51.144 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.144+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.c5pmo4rZVEvDWa1i0vYMSvheLpM1L6C_0 2024-09-14T11:22:51.144 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.144+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2269673121867977793', time=2024-09-14T13:15:24.714581+0000, chain.objs.size()=1 2024-09-14T11:22:51.144 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.144+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.U7iCpTgKVOsBx6R65a1aMTUKYO08jpt_0 2024-09-14T11:22:51.144 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.144+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16692561000059876479', time=2024-09-14T13:15:24.776797+0000, chain.objs.size()=1 2024-09-14T11:22:51.144 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.144+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.SXL4kPjSp-fb3CPKjOicsJJUDUTbj8w_0 2024-09-14T11:22:51.144 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.144+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7262046947204654360', time=2024-09-14T13:15:24.882253+0000, chain.objs.size()=1 2024-09-14T11:22:51.144 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.144+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.sj42OVjVT2PtDW2bxFYzZtBpfOuBlX4_0 2024-09-14T11:22:51.145 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.144+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17384312546784847146', time=2024-09-14T13:15:24.892258+0000, chain.objs.size()=1 2024-09-14T11:22:51.145 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.144+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.gVgwDIIIOgZ6I4WAJeGquwQ-Y1E50ta_0 2024-09-14T11:22:51.145 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.144+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10067055592035654994', time=2024-09-14T13:15:24.918780+0000, chain.objs.size()=1 2024-09-14T11:22:51.145 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.144+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.2bHBQHLL_r2zherqUC2ueSzhvW5CkzS_0 2024-09-14T11:22:51.145 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.144+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16183812935024419630', time=2024-09-14T13:15:24.927691+0000, chain.objs.size()=1 2024-09-14T11:22:51.145 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.144+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.u_iEZ0a5Q69U9oLwd665VihmsKaGso8_0 2024-09-14T11:22:51.145 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.144+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14178259431439287522', time=2024-09-14T13:15:24.935048+0000, chain.objs.size()=1 2024-09-14T11:22:51.145 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.144+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.HoHti8tyHTFpBQ2uGLHl_3rzDtloYD4_0 2024-09-14T11:22:51.146 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.145+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17850518919903830673', time=2024-09-14T13:15:24.939037+0000, chain.objs.size()=1 2024-09-14T11:22:51.147 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.145+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.NCpNnqx9dw-rn_2X5jYawAt1e_KBN7h_0 2024-09-14T11:22:51.147 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.145+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15634435409113478686', time=2024-09-14T13:15:25.043152+0000, chain.objs.size()=1 2024-09-14T11:22:51.147 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.145+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.EF-tu6Tt9QE6_qw8TK4W3QBxNeguGmf_0 2024-09-14T11:22:51.147 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.145+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9732276152158301609', time=2024-09-14T13:15:25.054016+0000, chain.objs.size()=1 2024-09-14T11:22:51.147 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.145+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.-EOcXubQbecTP82dpY1QA60IyoYXKet_0 2024-09-14T11:22:51.147 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.146+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17829161302042281691', time=2024-09-14T13:15:25.231026+0000, chain.objs.size()=1 2024-09-14T11:22:51.147 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.146+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.hGXfiktVnMzNRRgs2XLAK5jaqbtO4T2_0 2024-09-14T11:22:51.147 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.146+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16828611664987135751', time=2024-09-14T13:15:25.274191+0000, chain.objs.size()=1 2024-09-14T11:22:51.147 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.146+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.J5PrzvQy9PzZMNjaZwHxy3laZkLbIVd_0 2024-09-14T11:22:51.147 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.146+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9319394029928451231', time=2024-09-14T13:15:25.287714+0000, chain.objs.size()=1 2024-09-14T11:22:51.147 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.146+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.bo5ICG1bBjsVUx8o4VnqGN1iGSi18KY_0 2024-09-14T11:22:51.147 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.146+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6368494701293904069', time=2024-09-14T13:15:25.288739+0000, chain.objs.size()=1 2024-09-14T11:22:51.148 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.146+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.FuXSlJQyHaAT513EV9ltGrEQ05LsR3t_0 2024-09-14T11:22:51.148 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.146+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3348650845576762457', time=2024-09-14T13:15:25.374062+0000, chain.objs.size()=1 2024-09-14T11:22:51.148 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.146+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.Pf01IWdVCdFjzrYsuHT2pNvdu-0eGO4_0 2024-09-14T11:22:51.148 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.146+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2893178712670263063', time=2024-09-14T13:15:25.413336+0000, chain.objs.size()=1 2024-09-14T11:22:51.148 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.146+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.bQMXNS6GMTMA0s-PW9xip6QtSM41lv5_0 2024-09-14T11:22:51.148 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.147+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7956169392412366900', time=2024-09-14T13:15:25.419941+0000, chain.objs.size()=1 2024-09-14T11:22:51.148 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.147+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.l02khwM4HJSTAUVRs7sFnUp1x3u2iQD_0 2024-09-14T11:22:51.148 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.147+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18346710040832216085', time=2024-09-14T13:15:25.435087+0000, chain.objs.size()=1 2024-09-14T11:22:51.148 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.147+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.3wlcQLM9YtKhW73kSukM5UuMYC60WKq_0 2024-09-14T11:22:51.148 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.147+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9509181873574481463', time=2024-09-14T13:15:25.527995+0000, chain.objs.size()=1 2024-09-14T11:22:51.148 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.147+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.cDUCgFpo6tZx5stXytwm8AhE1aWWE1k_0 2024-09-14T11:22:51.149 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.147+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8556918625292964856', time=2024-09-14T13:15:25.528692+0000, chain.objs.size()=1 2024-09-14T11:22:51.149 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.147+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.6hignTPPe4dZtGTBNhmutIu5S2D5mak_0 2024-09-14T11:22:51.149 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.147+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1677519893063683764', time=2024-09-14T13:15:25.549923+0000, chain.objs.size()=1 2024-09-14T11:22:51.149 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.147+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.azsbI4HLRL_62zjI3NxuY3EaTi6yqrf_0 2024-09-14T11:22:51.149 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.147+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17445250124870428275', time=2024-09-14T13:15:25.561999+0000, chain.objs.size()=1 2024-09-14T11:22:51.149 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.147+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.GFzoQf7dAUVKzkAbznzKFLhlpxiG6LW_0 2024-09-14T11:22:51.149 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.147+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11180617418961845476', time=2024-09-14T13:15:25.587892+0000, chain.objs.size()=1 2024-09-14T11:22:51.149 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.147+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.pxuKzMVosLTn0RTf-MZQDgoKSyCYW6m_0 2024-09-14T11:22:51.149 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.147+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12121885625985847011', time=2024-09-14T13:15:25.609394+0000, chain.objs.size()=1 2024-09-14T11:22:51.149 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.147+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_._7CuJEiaTkF8EysUl0rLu-JWgFA1Ny2_0 2024-09-14T11:22:51.151 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.148+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8086410918288876536', time=2024-09-14T13:15:25.612153+0000, chain.objs.size()=1 2024-09-14T11:22:51.151 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.148+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.Up-AqdXIbR7hMu0KTtdCesATLv8d7_s_0 2024-09-14T11:22:51.151 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.148+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12352527735149799090', time=2024-09-14T13:15:25.613134+0000, chain.objs.size()=1 2024-09-14T11:22:51.151 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.148+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.J6y6dHCOBjxBg2xhBUnB7Cp6Z1-MlI__0 2024-09-14T11:22:51.151 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.148+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2356101493824724179', time=2024-09-14T13:15:25.617071+0000, chain.objs.size()=1 2024-09-14T11:22:51.152 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.148+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.KdG2VeNrzdoNFTGuGb9sno0wJ55UjCg_0 2024-09-14T11:22:51.152 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.149+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1149191730651750923', time=2024-09-14T13:15:25.689891+0000, chain.objs.size()=1 2024-09-14T11:22:51.152 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.149+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.SG-YybZ8oF4yLWXs5xzhI40oC8-HEA7_0 2024-09-14T11:22:51.152 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.149+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11876817242290400655', time=2024-09-14T13:15:25.705114+0000, chain.objs.size()=1 2024-09-14T11:22:51.152 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.149+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.Yv4pC-ZpPHoCd5XG2IkR4NJhdaRXWP5_0 2024-09-14T11:22:51.152 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.149+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11923088158938745981', time=2024-09-14T13:15:25.726231+0000, chain.objs.size()=1 2024-09-14T11:22:51.152 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.149+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.jMNgou7cYGAWOjm2potKtOzd80nY0-E_0 2024-09-14T11:22:51.152 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.149+0000 7f0f14be6640 0 -- 172.21.15.97:0/3336262302 >> [v2:172.21.15.97:6824/2606963136,v1:172.21.15.97:6825/2606963136] conn(0x7f0f08070040 msgr2=0x7f0de008f5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:51.152 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.150+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.946743021056727678', time=2024-09-14T13:15:25.735818+0000, chain.objs.size()=1 2024-09-14T11:22:51.152 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.150+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.FrxyD8L6AR7nsl2Y0g9LlRhoYqQFko5_0 2024-09-14T11:22:51.152 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.150+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1140255002006056757', time=2024-09-14T13:15:25.737494+0000, chain.objs.size()=1 2024-09-14T11:22:51.152 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.150+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.LLmZppjC_NNA51R07wpdOxsBk1KUDmk_0 2024-09-14T11:22:51.152 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.150+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6177129690365097547', time=2024-09-14T13:15:25.738394+0000, chain.objs.size()=1 2024-09-14T11:22:51.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.150+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.x-LbSXRlJuutcqOKTaHHisgsLmWxjlC_0 2024-09-14T11:22:51.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.150+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8632957862507558274', time=2024-09-14T13:15:25.764657+0000, chain.objs.size()=1 2024-09-14T11:22:51.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.150+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.dckXQUzhqm4BlB4YLN01DPgYxA7Vush_0 2024-09-14T11:22:51.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.150+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.396572470473453382', time=2024-09-14T13:15:25.772328+0000, chain.objs.size()=1 2024-09-14T11:22:51.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.150+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.0Wt5bx0eCgCmBh3erh2VIxR0PCL_TZP_0 2024-09-14T11:22:51.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.150+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12548856747063528945', time=2024-09-14T13:15:25.934048+0000, chain.objs.size()=1 2024-09-14T11:22:51.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.150+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.EI7A1jxkVtOtNz4BUs2IkC40c5VwOPu_0 2024-09-14T11:22:51.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.150+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15148292442805302096', time=2024-09-14T13:15:25.936552+0000, chain.objs.size()=1 2024-09-14T11:22:51.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.150+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.DdydLudAzEvfo1_5t-JK2W7V7wrCupx_0 2024-09-14T11:22:51.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.150+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6189827173344314663', time=2024-09-14T13:15:25.946447+0000, chain.objs.size()=1 2024-09-14T11:22:51.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.150+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.LlIIocXvekwo8lgruAgkIlKq61Y_jNL_0 2024-09-14T11:22:51.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.150+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10552456242599711727', time=2024-09-14T13:15:33.178597+0000, chain.objs.size()=1 2024-09-14T11:22:51.153 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.150+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.K2dupX9OpcvmJG5ACSLtWoIDB5oSYfx_0 2024-09-14T11:22:51.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.150+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5814473783330686780', time=2024-09-14T13:15:33.211684+0000, chain.objs.size()=1 2024-09-14T11:22:51.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.150+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.-ZpHcuRImpa4pQC3eznT6mkO9LdH2iU_0 2024-09-14T11:22:51.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.151+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15142581122400186610', time=2024-09-14T13:15:33.213327+0000, chain.objs.size()=1 2024-09-14T11:22:51.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.151+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.JNuZLXFT6OtoUpgmHXEqlgMX6zHNL7J_0 2024-09-14T11:22:51.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.152+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11748709545879141669', time=2024-09-14T13:15:33.235402+0000, chain.objs.size()=1 2024-09-14T11:22:51.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.152+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.V_nOQ3b89JxOP56prcMzqmt2YoaJG7z_0 2024-09-14T11:22:51.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.152+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7733379728177819798', time=2024-09-14T13:15:33.387375+0000, chain.objs.size()=1 2024-09-14T11:22:51.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.152+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.SAtd6wDdhbqNqBhB0v8N7LnsJVl4n5e_0 2024-09-14T11:22:51.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.152+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4296059688411474132', time=2024-09-14T13:15:33.388061+0000, chain.objs.size()=1 2024-09-14T11:22:51.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.152+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.imoVsogL6fz3npm6RbYq5nXsHd1qJ4c_0 2024-09-14T11:22:51.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.152+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8443613241480056324', time=2024-09-14T13:15:33.398028+0000, chain.objs.size()=1 2024-09-14T11:22:51.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.152+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.aKy19NCvLKa4rwfg1DDl23RKr78XYJa_0 2024-09-14T11:22:51.154 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.152+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16614427503223396195', time=2024-09-14T13:15:33.427852+0000, chain.objs.size()=1 2024-09-14T11:22:51.155 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.152+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.KfF-FFAV-8fNiiGrKCJX8hTZTlwOnhZ_0 2024-09-14T11:22:51.155 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.152+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14434634709965549056', time=2024-09-14T13:15:33.447907+0000, chain.objs.size()=1 2024-09-14T11:22:51.155 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.152+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.csZhkQp83pqouJPh7fvM6F-18YI18j5_0 2024-09-14T11:22:51.155 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.152+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10703858303778680370', time=2024-09-14T13:15:33.546954+0000, chain.objs.size()=1 2024-09-14T11:22:51.155 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.152+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.h-wmNZP7LWErEWf6o2nknRypSnD5Q9j_0 2024-09-14T11:22:51.155 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.152+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4275300316931171402', time=2024-09-14T13:15:33.713731+0000, chain.objs.size()=1 2024-09-14T11:22:51.155 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.152+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_._F1BRgEvWq2k7wYmdi7SxExUm__EOf0_0 2024-09-14T11:22:51.155 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.153+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1021154755725410133', time=2024-09-14T13:15:33.732547+0000, chain.objs.size()=1 2024-09-14T11:22:51.156 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.153+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Rags7c7b98yH63slEIcaMd8MskQ618B_0 2024-09-14T11:22:51.156 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.154+0000 7f0f15be8640 0 -- 172.21.15.97:0/3336262302 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f0de0087ab0 msgr2=0x7f0de0089ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:51.156 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.155+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 0/46945 2024-09-14T11:22:51.157 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.157+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=39, truncated=0, next_marker='' 2024-09-14T11:22:51.157 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.157+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.286370422385356392', time=2024-09-14T13:15:33.742789+0000, chain.objs.size()=1 2024-09-14T11:22:51.157 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.157+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Q_3Qq82QTDRQvhhurAI2k6ZUoaXX6sO_0 2024-09-14T11:22:51.157 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.157+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7840226270300394915', time=2024-09-14T13:15:33.758951+0000, chain.objs.size()=1 2024-09-14T11:22:51.157 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.157+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Nt3xP7PZB3rgKwRIh3Vs1JYv3MYyN8__0 2024-09-14T11:22:51.157 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.157+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7902167203547677122', time=2024-09-14T13:15:33.776096+0000, chain.objs.size()=1 2024-09-14T11:22:51.157 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.157+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.wFxPYV_Sbyehqcl4dSslh77Qj4TziPf_0 2024-09-14T11:22:51.157 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.157+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2470988973433965442', time=2024-09-14T13:15:33.778923+0000, chain.objs.size()=1 2024-09-14T11:22:51.157 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.157+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.nXUy9nd5uHZcAP_Mh9qicMpYUrS442T_0 2024-09-14T11:22:51.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.157+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13809899411011281536', time=2024-09-14T13:15:33.862671+0000, chain.objs.size()=1 2024-09-14T11:22:51.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.157+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.fYR4myuaCV7GM0UCxRJ4AxtZRtoPZw6_0 2024-09-14T11:22:51.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.157+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12344714452038655021', time=2024-09-14T13:15:33.898222+0000, chain.objs.size()=1 2024-09-14T11:22:51.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.157+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.qfUvGIHwSZun4Zf0a_UtlSn7BLYVwlL_0 2024-09-14T11:22:51.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.157+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7815547987520673532', time=2024-09-14T13:15:33.913083+0000, chain.objs.size()=1 2024-09-14T11:22:51.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.157+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.dhZH08NJELGwC3KtfKLufWFXhvv2gh0_0 2024-09-14T11:22:51.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.157+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15755622901279549484', time=2024-09-14T13:15:34.027333+0000, chain.objs.size()=1 2024-09-14T11:22:51.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.157+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.1OsIoNngpFt81qD8p0y1TyH8I12FyrO_0 2024-09-14T11:22:51.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.157+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17911519196412637590', time=2024-09-14T13:15:34.050186+0000, chain.objs.size()=1 2024-09-14T11:22:51.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.157+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.7RwTsTfjM1sfKKd5FJQelIHdgGlG49I_0 2024-09-14T11:22:51.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.158+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4930354493290339883', time=2024-09-14T13:15:34.057089+0000, chain.objs.size()=1 2024-09-14T11:22:51.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.158+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.SMHX6wM9o2yzJHxi5YR2akRvJ1_jHzG_0 2024-09-14T11:22:51.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.158+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15205828713035682962', time=2024-09-14T13:15:34.061433+0000, chain.objs.size()=1 2024-09-14T11:22:51.158 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.158+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.dk0WLbCmY6nbPY2M7TCo7xBHcaMDiRR_0 2024-09-14T11:22:51.159 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.158+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1336593712031849166', time=2024-09-14T13:15:34.079077+0000, chain.objs.size()=1 2024-09-14T11:22:51.159 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.158+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.G9Vrr-P8foWSglleQp3q39mQYpJiNFz_0 2024-09-14T11:22:51.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.159+0000 7f0f15be8640 0 -- 172.21.15.97:0/3336262302 >> [v2:172.21.15.97:6800/2189588316,v1:172.21.15.97:6801/2189588316] conn(0x7f0f08070040 msgr2=0x7f0de008f5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:51.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.160+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4596121615900796786', time=2024-09-14T13:15:34.085725+0000, chain.objs.size()=1 2024-09-14T11:22:51.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.160+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.uDd0pP_rMSatOzzotTl_qux81XkUMRS_0 2024-09-14T11:22:51.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.160+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1268787083161870309', time=2024-09-14T13:15:34.095324+0000, chain.objs.size()=1 2024-09-14T11:22:51.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.160+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.qcgdEvvTMAWrTWGxkI_shTlX_evgHDW_0 2024-09-14T11:22:51.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.160+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2350365088466817200', time=2024-09-14T13:15:34.212346+0000, chain.objs.size()=1 2024-09-14T11:22:51.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.160+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.AQteoEbw52eGVQAt7KRamNvEwVr2pCR_0 2024-09-14T11:22:51.160 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.160+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.281032296756497311', time=2024-09-14T13:15:34.217803+0000, chain.objs.size()=1 2024-09-14T11:22:51.161 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.160+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.gv2K-NKJ09dqcXrl33k1ZIiYZXqLS92_0 2024-09-14T11:22:51.161 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.160+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7297709933174693266', time=2024-09-14T13:15:34.218566+0000, chain.objs.size()=1 2024-09-14T11:22:51.161 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.160+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.uGa_29dG0ZEpwoPg3eV_WDCS6KQ-F9q_0 2024-09-14T11:22:51.161 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.160+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4003124258355889364', time=2024-09-14T13:15:34.249306+0000, chain.objs.size()=1 2024-09-14T11:22:51.161 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.160+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.O2AnMXqqSVixFhC3YZhpZ4obQdzmY5M_0 2024-09-14T11:22:51.161 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.160+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16482888814058175127', time=2024-09-14T13:15:34.343944+0000, chain.objs.size()=1 2024-09-14T11:22:51.161 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.160+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.moVgk_qx-hFPQvX31Z51w0vqkx2mLBZ_0 2024-09-14T11:22:51.161 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.160+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13942247561817303219', time=2024-09-14T13:15:34.344757+0000, chain.objs.size()=1 2024-09-14T11:22:51.161 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.160+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.V3TQrnJ0I-H5ncFBlfVfDZi_WelBQhT_0 2024-09-14T11:22:51.161 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.160+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5297028386557551652', time=2024-09-14T13:15:34.370066+0000, chain.objs.size()=1 2024-09-14T11:22:51.161 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.160+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Gdh3lRZhIO7C7tuROS1z8tlaAF-ZUFG_0 2024-09-14T11:22:51.161 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.160+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13042797860899656860', time=2024-09-14T13:15:34.390331+0000, chain.objs.size()=1 2024-09-14T11:22:51.161 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.160+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.GGeu7qF--g9GUNulLsTyHiIGI2EN4rJ_0 2024-09-14T11:22:51.162 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.160+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6269007370491672989', time=2024-09-14T13:15:35.482831+0000, chain.objs.size()=1 2024-09-14T11:22:51.162 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.160+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.329__shadow_.x2gaGDAnEGx81sI32AXxo9SmIYjXp1a_0 2024-09-14T11:22:51.162 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.161+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12861600216636206096', time=2024-09-14T13:15:46.955634+0000, chain.objs.size()=1 2024-09-14T11:22:51.162 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.161+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.376__shadow_.3xvm296CModBpZsSa4NTJ7bv54RKCu1_0 2024-09-14T11:22:51.163 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.162+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2000961898506296664', time=2024-09-14T13:15:57.258132+0000, chain.objs.size()=1 2024-09-14T11:22:51.163 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.162+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.409__shadow_.RH-fSywKAieuXowKJC4kmWjO7ccQneH_0 2024-09-14T11:22:51.164 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.162+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6605470029814190422', time=2024-09-14T13:16:05.535720+0000, chain.objs.size()=1 2024-09-14T11:22:51.164 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.162+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.441__shadow_.j86kWPnwedgjf4AcgNg_1Hz9nWF0edy_0 2024-09-14T11:22:51.164 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.162+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18000259887334785721', time=2024-09-14T13:16:12.241782+0000, chain.objs.size()=1 2024-09-14T11:22:51.164 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.162+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.462__shadow_.VLr-JHCzk0oPncuHrupA6gkbK5Uij-z_0 2024-09-14T11:22:51.164 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.162+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16988638852496051454', time=2024-09-14T13:16:18.354455+0000, chain.objs.size()=1 2024-09-14T11:22:51.164 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.162+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.487__shadow_.Yz1Mgg2NedSaR-i9UWJFOxsMA1tj9Ux_0 2024-09-14T11:22:51.164 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.162+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10155862475364282750', time=2024-09-14T13:16:22.806828+0000, chain.objs.size()=1 2024-09-14T11:22:51.164 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.162+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.503__shadow:pymE41PAtqbkcQ6I2URloKvd5muPSJ-_.UInzhQl7TQvRYLWzEBL5Aj5TYH25pWP_0 2024-09-14T11:22:51.164 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.162+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12040439987660475477', time=2024-09-14T13:16:31.008039+0000, chain.objs.size()=1 2024-09-14T11:22:51.164 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.162+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.520__shadow:TeXnqMD1orw2XIpSAj1njjMBAaX4iN1_.fhirNLcioY_DboMsx8r_-MDxWTmuP0e_0 2024-09-14T11:22:51.164 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.162+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='2~PjcWKMfDysMo3e08mUnXYYTPLN0IQ6m', time=2024-09-14T13:16:32.400552+0000, chain.objs.size()=1 2024-09-14T11:22:51.164 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.162+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.522__multipart_mymultipart.2~PjcWKMfDysMo3e08mUnXYYTPLN0IQ6m.2 2024-09-14T11:22:51.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.162+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13502221869237528457', time=2024-09-14T13:16:36.068414+0000, chain.objs.size()=3 2024-09-14T11:22:51.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.162+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.523__multipart_mymultipart.2~6RfLOmkoDM_YH1FWyjtV0Plw1oGctpr.1 2024-09-14T11:22:51.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.162+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.523__multipart_mymultipart.2~6RfLOmkoDM_YH1FWyjtV0Plw1oGctpr.2 2024-09-14T11:22:51.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.162+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.523__multipart_mymultipart.2~6RfLOmkoDM_YH1FWyjtV0Plw1oGctpr.3 2024-09-14T11:22:51.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.162+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9416787618656404618', time=2024-09-14T13:17:51.007046+0000, chain.objs.size()=1 2024-09-14T11:22:51.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.162+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.580__shadow:vUFJDgDaYxHHxUnfuEXUGZuAYhYX3ha_.ufyV9_YsPmHiAGg0tiS5vjjyneUoUsT_0 2024-09-14T11:22:51.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.163+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='2~ke-4iRzEEjmd9LUR0ZtrfcENrJ0D0Io', time=2024-09-14T13:20:07.185121+0000, chain.objs.size()=6 2024-09-14T11:22:51.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.163+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.624__multipart_multipart_enc.2~ke-4iRzEEjmd9LUR0ZtrfcENrJ0D0Io.1 2024-09-14T11:22:51.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.164+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.624__multipart_multipart_enc.2~ke-4iRzEEjmd9LUR0ZtrfcENrJ0D0Io.2 2024-09-14T11:22:51.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.164+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.624__multipart_multipart_enc.2~ke-4iRzEEjmd9LUR0ZtrfcENrJ0D0Io.3 2024-09-14T11:22:51.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.164+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.624__multipart_multipart_enc.2~ke-4iRzEEjmd9LUR0ZtrfcENrJ0D0Io.4 2024-09-14T11:22:51.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.164+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.624__multipart_multipart_enc.2~ke-4iRzEEjmd9LUR0ZtrfcENrJ0D0Io.5 2024-09-14T11:22:51.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.164+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.624__multipart_multipart_enc.2~ke-4iRzEEjmd9LUR0ZtrfcENrJ0D0Io.6 2024-09-14T11:22:51.165 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.165+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9758947092018477522', time=2024-09-14T13:20:19.709979+0000, chain.objs.size()=6 2024-09-14T11:22:51.166 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.165+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.662__multipart_foo.2~61dSG_byJMuwQQ4fqQcCovuN2bhMifL.1 2024-09-14T11:22:51.166 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.165+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.662__multipart_foo.2~61dSG_byJMuwQQ4fqQcCovuN2bhMifL.2 2024-09-14T11:22:51.166 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.165+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.662__multipart_foo.2~61dSG_byJMuwQQ4fqQcCovuN2bhMifL.3 2024-09-14T11:22:51.166 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.165+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.662__multipart_foo.2~61dSG_byJMuwQQ4fqQcCovuN2bhMifL.4 2024-09-14T11:22:51.166 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.165+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.662__multipart_foo.2~61dSG_byJMuwQQ4fqQcCovuN2bhMifL.5 2024-09-14T11:22:51.166 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.165+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.662__multipart_foo.2~61dSG_byJMuwQQ4fqQcCovuN2bhMifL.6 2024-09-14T11:22:51.166 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.167+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3312224923563253988', time=2024-09-14T13:20:27.753618+0000, chain.objs.size()=1 2024-09-14T11:22:51.166 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.167+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.694__shadow:14GKo8muOkRkZC5BfvXXpP3exTEKfYM_.Jx9Dg7EOQGwS5A3V664gvf9zH0Txi9j_0 2024-09-14T11:22:51.167 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.168+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2975419278353352501', time=2024-09-14T13:20:28.867780+0000, chain.objs.size()=1 2024-09-14T11:22:51.167 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.168+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.698__shadow:e8D-diKG3uAjNougD2gGNLJcwtAjHVA_.ZtcCp-Ej0EcnKm7p9L5R9ftGSuahlEF_0 2024-09-14T11:22:51.167 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.168+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6886793308587068327', time=2024-09-14T13:20:32.274284+0000, chain.objs.size()=1 2024-09-14T11:22:51.167 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.168+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.710__shadow:oTuTwSbDTXrKNFQ5Y1v6ODqG4esWbpO_.7TPFqq_EK93WWjDDVuINKYHYNm-UuUD_0 2024-09-14T11:22:51.167 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.168+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11828215725005280389', time=2024-09-14T13:22:38.828337+0000, chain.objs.size()=1 2024-09-14T11:22:51.167 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.168+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.782__shadow_.S4ccXua5flXKrNHYcvTPT6mvxgJdo0l_0 2024-09-14T11:22:51.168 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.169+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:51.170 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.172+0000 7f0f19c16800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:22:51.171 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.173+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:51.172 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.173+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:51.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.174+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44334' 2024-09-14T11:22:51.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.174+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='_nuoHTh8x5Frs7sibvIpBLqIh8YV8Gfr', time=2024-09-14T13:13:35.192677+0000, chain.objs.size()=2 2024-09-14T11:22:51.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.175+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.160__shadow_.JD0Y3D9_I_MaQqxp9AgtVhGfPaFWMyH_0 2024-09-14T11:22:51.174 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.175+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.160__shadow_.JD0Y3D9_I_MaQqxp9AgtVhGfPaFWMyH_1 2024-09-14T11:22:51.175 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.175+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5973240368746103376', time=2024-09-14T13:13:38.782383+0000, chain.objs.size()=1 2024-09-14T11:22:51.175 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.175+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.171__shadow_.Q_kKp0o8q3g9cMtNU_gpEREeeNGPepi_0 2024-09-14T11:22:51.175 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.175+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12021588685365267254', time=2024-09-14T13:14:45.377827+0000, chain.objs.size()=1 2024-09-14T11:22:51.175 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.175+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.234__shadow_.22FAhn4sM0xc_ylEQOwopCMcoyLFY4u_0 2024-09-14T11:22:51.175 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.175+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7538100708693145628', time=2024-09-14T13:14:47.812266+0000, chain.objs.size()=1 2024-09-14T11:22:51.175 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.175+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.243__shadow_.WnmvgXJeRAJSrmwK0FV6TP3IuZt9Eua_0 2024-09-14T11:22:51.175 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.175+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13359845874870616039', time=2024-09-14T13:14:48.114891+0000, chain.objs.size()=1 2024-09-14T11:22:51.175 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.175+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.244__shadow_.G45Ktjwv7uy64wkKEJtTIfVnj-fsAvB_0 2024-09-14T11:22:51.175 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.175+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9859172203043905335', time=2024-09-14T13:14:51.353380+0000, chain.objs.size()=1 2024-09-14T11:22:51.175 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.175+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.256__shadow_.78OKEk4KJE674r_CZy8VRTk_vUxFXqB_0 2024-09-14T11:22:51.176 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.175+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3863824324310518129', time=2024-09-14T13:14:51.354822+0000, chain.objs.size()=1 2024-09-14T11:22:51.176 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.175+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.256__shadow_.ppwj_exMhewEsCg10Ln951Hq9gsZO6t_0 2024-09-14T11:22:51.176 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.175+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18018901703108287441', time=2024-09-14T13:14:52.369264+0000, chain.objs.size()=1 2024-09-14T11:22:51.176 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.175+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.260__shadow_._UrzMOsE2gtvbR8xyMLZJEIpPkXDLqL_0 2024-09-14T11:22:51.176 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.175+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17238541867454114711', time=2024-09-14T13:14:59.807756+0000, chain.objs.size()=1 2024-09-14T11:22:51.176 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.175+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.3xzCuKSCaVJSipDKn_ahLQm9MqhjZQG_0 2024-09-14T11:22:51.176 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.175+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8065406212061788568', time=2024-09-14T13:14:59.810428+0000, chain.objs.size()=1 2024-09-14T11:22:51.176 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.175+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.EBDI6l5WDlcN4AOsmqK0YDNjPV81ozU_0 2024-09-14T11:22:51.176 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.175+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16944535143912480951', time=2024-09-14T13:14:59.821663+0000, chain.objs.size()=1 2024-09-14T11:22:51.176 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.175+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.r8V9dph71TeX41W4jVv_oi_QOJ7gjKy_0 2024-09-14T11:22:51.178 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.177+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10511850936809322976', time=2024-09-14T13:14:59.822424+0000, chain.objs.size()=1 2024-09-14T11:22:51.178 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.177+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.na9QcWYWyrMtwONIvuJI1AxENEIoRTC_0 2024-09-14T11:22:51.178 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.177+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3795786246431699938', time=2024-09-14T13:14:59.899180+0000, chain.objs.size()=1 2024-09-14T11:22:51.178 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.177+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.6iR-COaKt-oiAT1YxV8uH9OBodBLexZ_0 2024-09-14T11:22:51.178 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.177+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1782233627931223859', time=2024-09-14T13:14:59.940380+0000, chain.objs.size()=1 2024-09-14T11:22:51.178 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.177+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.8yc2oGx5N1L3YkCcjBwuEVzRSHwpS8P_0 2024-09-14T11:22:51.178 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.177+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6195258708800394691', time=2024-09-14T13:14:59.946366+0000, chain.objs.size()=1 2024-09-14T11:22:51.178 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.177+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Su9ZbIKqHixp_uVyv2qHO6m1b2gqyTk_0 2024-09-14T11:22:51.178 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.177+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3753112509007355746', time=2024-09-14T13:14:59.958049+0000, chain.objs.size()=1 2024-09-14T11:22:51.178 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.177+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.npAw48PUHwqdEQoKoop8bLztXcojwGw_0 2024-09-14T11:22:51.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.177+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14367073338532305517', time=2024-09-14T13:14:59.959525+0000, chain.objs.size()=1 2024-09-14T11:22:51.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.177+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.R60a1gPhP2F1L6uDZ_My_OMKHiUd_C8_0 2024-09-14T11:22:51.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.177+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14654178925485290082', time=2024-09-14T13:14:59.986278+0000, chain.objs.size()=1 2024-09-14T11:22:51.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.177+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.1jCEU1oLawh8e_XQqGVa1vPdWpv3-M9_0 2024-09-14T11:22:51.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.177+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9065228503598455708', time=2024-09-14T13:15:00.079873+0000, chain.objs.size()=1 2024-09-14T11:22:51.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.177+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.H_R6JyGuk9XmD2SnJVhyDLpjEJmUGWe_0 2024-09-14T11:22:51.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.177+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4027846601402404948', time=2024-09-14T13:15:00.098450+0000, chain.objs.size()=1 2024-09-14T11:22:51.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.177+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.gahb2TldPBC9ySCPgcSmkeV9qefu0XL_0 2024-09-14T11:22:51.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.177+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14669516627126610672', time=2024-09-14T13:15:00.111506+0000, chain.objs.size()=1 2024-09-14T11:22:51.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.177+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.alEHu0ubGJ1OwIY4xMkfUAuUTURZ_rD_0 2024-09-14T11:22:51.179 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.178+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3359232748549595323', time=2024-09-14T13:15:00.228525+0000, chain.objs.size()=1 2024-09-14T11:22:51.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.178+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.ORyU5u3VF0JCTio2_yrI6nHMpYnmvrB_0 2024-09-14T11:22:51.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.179+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9873856813289910506', time=2024-09-14T13:15:00.302325+0000, chain.objs.size()=1 2024-09-14T11:22:51.180 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.179+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.8-ACp28XsofabYg6lyeOyq4Ekrem9TN_0 2024-09-14T11:22:51.182 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.180+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11854592032098288802', time=2024-09-14T13:15:00.310448+0000, chain.objs.size()=1 2024-09-14T11:22:51.182 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.180+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.-0kPIvvYhr1-EeFCJ04G_Nhat5XE5qc_0 2024-09-14T11:22:51.182 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.180+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6153119018231237510', time=2024-09-14T13:15:00.408813+0000, chain.objs.size()=1 2024-09-14T11:22:51.182 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.180+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.YTHJy49GZGClYxTlwj_yLo1xmCTNbT1_0 2024-09-14T11:22:51.182 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.180+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6549392962519185297', time=2024-09-14T13:15:00.417616+0000, chain.objs.size()=1 2024-09-14T11:22:51.183 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.180+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Cw2L-M-bCRe-UlI6xhts_cPmtFUAO50_0 2024-09-14T11:22:51.183 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.180+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7030220465770800121', time=2024-09-14T13:15:00.424498+0000, chain.objs.size()=1 2024-09-14T11:22:51.183 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.180+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.5ZWZGKVk6GCL-EjXedgFff7zhxr2lwb_0 2024-09-14T11:22:51.183 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.180+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17055942302682354722', time=2024-09-14T13:15:00.429100+0000, chain.objs.size()=1 2024-09-14T11:22:51.183 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.180+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.pDyyhwzWKcKaHX-B7lgsW_dl5Yu8Bba_0 2024-09-14T11:22:51.183 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.180+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18317390285865623339', time=2024-09-14T13:15:00.456183+0000, chain.objs.size()=1 2024-09-14T11:22:51.183 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.180+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.5fCACXAfXxD67EYC1Kl0NwY30P-g617_0 2024-09-14T11:22:51.183 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.180+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1741537137124083469', time=2024-09-14T13:15:00.550347+0000, chain.objs.size()=1 2024-09-14T11:22:51.183 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.180+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.yl-1q3OaN2JeGY0zjCvww110EIo2XeP_0 2024-09-14T11:22:51.183 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.180+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17653821102704770345', time=2024-09-14T13:15:00.576411+0000, chain.objs.size()=1 2024-09-14T11:22:51.183 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.180+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.8yIZOC7z0cOFh9x9Gxnm2Qpcj1xHt9Q_0 2024-09-14T11:22:51.184 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.180+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13482159357359256933', time=2024-09-14T13:15:00.591528+0000, chain.objs.size()=1 2024-09-14T11:22:51.184 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.180+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.MOzKsDiCGMTYMz_TXxkHQCyqOkIgD6v_0 2024-09-14T11:22:51.184 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.180+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1241312866462181616', time=2024-09-14T13:15:00.628020+0000, chain.objs.size()=1 2024-09-14T11:22:51.184 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.180+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.YHdgin5q2amsU1ZnHa2C98Tyzhfvx-I_0 2024-09-14T11:22:51.184 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.180+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8728126179053471818', time=2024-09-14T13:15:00.715707+0000, chain.objs.size()=1 2024-09-14T11:22:51.184 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.180+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.-RLGdotrvEOPL9bgl2SUK_1MQ1WkhBw_0 2024-09-14T11:22:51.184 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.181+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3598820307358564395', time=2024-09-14T13:15:00.728194+0000, chain.objs.size()=1 2024-09-14T11:22:51.184 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.181+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.tFnL9VTfrTLg77LWCcGikiAdb0pIkFj_0 2024-09-14T11:22:51.184 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.181+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10234783516451957136', time=2024-09-14T13:15:00.772020+0000, chain.objs.size()=1 2024-09-14T11:22:51.184 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.181+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.VBaFTXwF-RkYZ3aHB1mnuwA6n7-CbQ2_0 2024-09-14T11:22:51.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.181+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12642455335268218585', time=2024-09-14T13:15:00.889563+0000, chain.objs.size()=1 2024-09-14T11:22:51.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.181+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.4Onhp9FmJK0zMMkwCxjtZDx-FZE6L6Z_0 2024-09-14T11:22:51.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.182+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5639901822215280260', time=2024-09-14T13:15:00.901531+0000, chain.objs.size()=1 2024-09-14T11:22:51.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.182+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.hfmMNHyaUg3vObCjZY5XrOf7k7i-2T9_0 2024-09-14T11:22:51.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.182+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14115716392752445022', time=2024-09-14T13:15:00.926826+0000, chain.objs.size()=1 2024-09-14T11:22:51.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.182+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.JU0ga0OMNy4qkrrbfA8oTCNZ7L8ukqP_0 2024-09-14T11:22:51.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.182+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2299759781458894052', time=2024-09-14T13:15:00.937889+0000, chain.objs.size()=1 2024-09-14T11:22:51.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.182+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.sh-yMOi0PzNCZm8i-8azyxinWmwdGp-_0 2024-09-14T11:22:51.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.182+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7333670811817587326', time=2024-09-14T13:15:00.945435+0000, chain.objs.size()=1 2024-09-14T11:22:51.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.182+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.e4l7hfShdnQygOAQVZrqeTT8e5jhnHF_0 2024-09-14T11:22:51.185 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.182+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18183385293362518614', time=2024-09-14T13:15:02.404988+0000, chain.objs.size()=1 2024-09-14T11:22:51.186 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.182+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.268__shadow_.y5AJp-aoGViHKLfguEcO9kG8_wsSJlE_0 2024-09-14T11:22:51.186 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.182+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.465933692101463399', time=2024-09-14T13:15:03.170368+0000, chain.objs.size()=1 2024-09-14T11:22:51.186 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.182+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.271__shadow_.-lfDN2NkESW8Im6gnV0dRHd8WP_2OAn_0 2024-09-14T11:22:51.186 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.182+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11515538026928977269', time=2024-09-14T13:15:03.414423+0000, chain.objs.size()=1 2024-09-14T11:22:51.186 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.182+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.272__shadow_.MGc8mpbOXO5VV1furKOMb1CXFbYy0gn_0 2024-09-14T11:22:51.186 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.182+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.635891396303239425', time=2024-09-14T13:15:03.415178+0000, chain.objs.size()=1 2024-09-14T11:22:51.186 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.182+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.272__shadow_.cHAcOvdSLrX_oKzIDWlwLiZ5v9ljZik_0 2024-09-14T11:22:51.188 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.184+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1150624469939061151', time=2024-09-14T13:15:06.174796+0000, chain.objs.size()=1 2024-09-14T11:22:51.189 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.184+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.282__shadow_.ywWY_aDSq1n43cQYl-S2jM5pM3mSNtI_0 2024-09-14T11:22:51.189 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.184+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6716194981377607000', time=2024-09-14T13:15:09.253104+0000, chain.objs.size()=1 2024-09-14T11:22:51.189 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.184+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.292__shadow_.tOHTzXnJ5z4ZGN0BfoDGLaMowfaZzOn_0 2024-09-14T11:22:51.189 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.184+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16838846690801780533', time=2024-09-14T13:15:09.827982+0000, chain.objs.size()=1 2024-09-14T11:22:51.189 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.184+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.293__shadow_.zaieSlfQrTKnfDi_EgCOAGqf6B0H0-5_0 2024-09-14T11:22:51.189 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.184+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.434127120872643134', time=2024-09-14T13:15:11.698169+0000, chain.objs.size()=1 2024-09-14T11:22:51.189 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.184+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.300__shadow_.c1csgnl4E4VCrCwVfaHW9ohSDdrcqNf_0 2024-09-14T11:22:51.189 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.184+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1408609611442495900', time=2024-09-14T13:15:24.788600+0000, chain.objs.size()=1 2024-09-14T11:22:51.189 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.184+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.ehfXxUIEjJXRrSROUXqP0-tfd9kObsW_0 2024-09-14T11:22:51.190 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.184+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16170245529676648138', time=2024-09-14T13:15:24.895809+0000, chain.objs.size()=1 2024-09-14T11:22:51.190 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.184+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.HAxxQhb1R7U5IWOXvxnjalfzCZqbKVi_0 2024-09-14T11:22:51.190 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.184+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2053289719922689660', time=2024-09-14T13:15:24.940051+0000, chain.objs.size()=1 2024-09-14T11:22:51.190 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.184+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.hmJmgPheyr8f8qKQYP44EXkXg231O0Z_0 2024-09-14T11:22:51.190 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.184+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13824552435820623983', time=2024-09-14T13:15:24.966775+0000, chain.objs.size()=1 2024-09-14T11:22:51.190 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.184+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.udtXWaeuP2JblZOVufzuaPDUiZB_vFM_0 2024-09-14T11:22:51.190 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.184+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8271983023122857649', time=2024-09-14T13:15:25.057689+0000, chain.objs.size()=1 2024-09-14T11:22:51.190 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.184+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.e7zLiE2F05AI_aYXjYkEiNXyIAZT8Y1_0 2024-09-14T11:22:51.190 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.184+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5890647290863620376', time=2024-09-14T13:15:25.069102+0000, chain.objs.size()=1 2024-09-14T11:22:51.190 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.184+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.3kk2EwRNbWiUfq3ZF7TG1iDiBiD_RDg_0 2024-09-14T11:22:51.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.184+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10993629832154177637', time=2024-09-14T13:15:25.239279+0000, chain.objs.size()=1 2024-09-14T11:22:51.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.184+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.hf3iF4_lggvP46aHoU9g5Gmxo4g4bco_0 2024-09-14T11:22:51.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.185+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2177670412117528238', time=2024-09-14T13:15:25.277366+0000, chain.objs.size()=1 2024-09-14T11:22:51.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.185+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.lbjibmdp0Uf3fTf2v00X4rzgdVIeZi5_0 2024-09-14T11:22:51.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.186+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9097833066668157114', time=2024-09-14T13:15:25.373186+0000, chain.objs.size()=1 2024-09-14T11:22:51.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.186+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.bXzUG6j2TXoQZgNcGDbOT9KQaZNU2fD_0 2024-09-14T11:22:51.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.186+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4296123434814920984', time=2024-09-14T13:15:25.375483+0000, chain.objs.size()=1 2024-09-14T11:22:51.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.186+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.bBHCRKt9PYqccq4g5w8vY_rtMjT7Mp3_0 2024-09-14T11:22:51.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.186+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13226188695835896906', time=2024-09-14T13:15:25.381157+0000, chain.objs.size()=1 2024-09-14T11:22:51.191 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.186+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.U-SHAygPWT4a713M7qxi4_i3Cx5PpFo_0 2024-09-14T11:22:51.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.186+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7601000767182815731', time=2024-09-14T13:15:25.397069+0000, chain.objs.size()=1 2024-09-14T11:22:51.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.186+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.AAYohRn0KrisKgZeQ4Ngf9zqEauiWGw_0 2024-09-14T11:22:51.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.186+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15140012847150759089', time=2024-09-14T13:15:25.413068+0000, chain.objs.size()=1 2024-09-14T11:22:51.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.186+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.e-W9LdgnFzSVuZsuxjylJabJhoKejTV_0 2024-09-14T11:22:51.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.186+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2397585062875426758', time=2024-09-14T13:15:25.426495+0000, chain.objs.size()=1 2024-09-14T11:22:51.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.186+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.H-Y1WXfvxMJHpV2pbpI-AwYhmjDW-wX_0 2024-09-14T11:22:51.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.186+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5523606013956378020', time=2024-09-14T13:15:25.430929+0000, chain.objs.size()=1 2024-09-14T11:22:51.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.186+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.xRKoW8dXzc0mfrQpYp01KaeeXo6Fx19_0 2024-09-14T11:22:51.192 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.187+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16569587201984396274', time=2024-09-14T13:15:25.605870+0000, chain.objs.size()=1 2024-09-14T11:22:51.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.187+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.OOe-tURAf_-WYJnL5PLk3OxL-qrny-l_0 2024-09-14T11:22:51.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.187+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3419376305522632908', time=2024-09-14T13:15:25.731852+0000, chain.objs.size()=1 2024-09-14T11:22:51.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.187+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.EYkUqwwWDSUqERDl4Rb87kLy4CoU6EP_0 2024-09-14T11:22:51.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.189+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16397158658923763049', time=2024-09-14T13:15:25.771311+0000, chain.objs.size()=1 2024-09-14T11:22:51.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.189+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.92jXronKb2xX0j_bIEc-Sl2lC_z_D9x_0 2024-09-14T11:22:51.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.189+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13358348014779552233', time=2024-09-14T13:15:25.916531+0000, chain.objs.size()=1 2024-09-14T11:22:51.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.189+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.FWe806M4wlN40pWiCZMNxlUABvLVT9Y_0 2024-09-14T11:22:51.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.189+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13710942177810887594', time=2024-09-14T13:15:33.166883+0000, chain.objs.size()=1 2024-09-14T11:22:51.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.189+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.GBAErJwwSzCqU_KRfot39BUg8DZFL0S_0 2024-09-14T11:22:51.193 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.189+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9112403657525110703', time=2024-09-14T13:15:33.170191+0000, chain.objs.size()=1 2024-09-14T11:22:51.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.189+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.KgYd8makmVbs81doeBzcQGYDCq6w8H5_0 2024-09-14T11:22:51.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.189+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4921290542422809091', time=2024-09-14T13:15:33.202371+0000, chain.objs.size()=1 2024-09-14T11:22:51.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.189+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.PJH25rRbf2ScV3jTe4Pm1PYPkN66ANo_0 2024-09-14T11:22:51.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.189+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14801470271361880377', time=2024-09-14T13:15:33.216230+0000, chain.objs.size()=1 2024-09-14T11:22:51.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.189+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.TcBkK6F2vh9V8Ls6hIX-kb0zcNiUFWS_0 2024-09-14T11:22:51.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.189+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6033669513214400425', time=2024-09-14T13:15:33.379859+0000, chain.objs.size()=1 2024-09-14T11:22:51.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.189+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.qRkWuHucikWQpLKAz7MmpxuSjHf4HDA_0 2024-09-14T11:22:51.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.189+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.186782071014298933', time=2024-09-14T13:15:33.418384+0000, chain.objs.size()=1 2024-09-14T11:22:51.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.189+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Fd3UEh_PPIML4u0ZBuAMkaSTUINKTW9_0 2024-09-14T11:22:51.194 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.189+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11528553797392868486', time=2024-09-14T13:15:33.567777+0000, chain.objs.size()=1 2024-09-14T11:22:51.195 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.189+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.nN3qIdh5qljvSUxVV5UF9oF-2yc5jMR_0 2024-09-14T11:22:51.195 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.189+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9750374856477204205', time=2024-09-14T13:15:33.577527+0000, chain.objs.size()=1 2024-09-14T11:22:51.195 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.189+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.T_QeoyFzGcWGo18lr5utuh9ejrzhKaB_0 2024-09-14T11:22:51.195 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.189+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18247657600346738841', time=2024-09-14T13:15:33.742856+0000, chain.objs.size()=1 2024-09-14T11:22:51.195 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.189+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Rn2zSoonSs5-m8RyWf1qFKs0wmKX8um_0 2024-09-14T11:22:51.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.190+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.176149811303343670', time=2024-09-14T13:15:33.874062+0000, chain.objs.size()=1 2024-09-14T11:22:51.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.190+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.koSWw9tsAM7cFzGsHHCylX-zGNoEcQF_0 2024-09-14T11:22:51.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.191+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1104650707223398341', time=2024-09-14T13:15:33.909451+0000, chain.objs.size()=1 2024-09-14T11:22:51.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.191+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.ilZ0MT6vrw-hNwd-h-H9L2PUkYgZtPq_0 2024-09-14T11:22:51.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.191+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4382583271948321532', time=2024-09-14T13:15:34.032195+0000, chain.objs.size()=1 2024-09-14T11:22:51.198 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.191+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.DXLliSKI49AJIr55V_nvCMkfBf7qyCL_0 2024-09-14T11:22:51.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.191+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12749357194854962529', time=2024-09-14T13:15:34.040110+0000, chain.objs.size()=1 2024-09-14T11:22:51.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.191+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.9bFtaU5opRykmeN5ZXSpoHdKmk4Gc7K_0 2024-09-14T11:22:51.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.192+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5830637372843772981', time=2024-09-14T13:15:34.206828+0000, chain.objs.size()=1 2024-09-14T11:22:51.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.192+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.M5sVAW1Rx5IHIccJM3EHObYPu7zJXhv_0 2024-09-14T11:22:51.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.192+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11549952563510597401', time=2024-09-14T13:15:34.207686+0000, chain.objs.size()=1 2024-09-14T11:22:51.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.192+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.RINLCPZrkow0tpIbuSf17nah-D0GArt_0 2024-09-14T11:22:51.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.192+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16109530915825616540', time=2024-09-14T13:15:34.236063+0000, chain.objs.size()=1 2024-09-14T11:22:51.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.192+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.UX6kmgi15vskh_eSHnJw9as9RWIdlVX_0 2024-09-14T11:22:51.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.192+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14511707588540749017', time=2024-09-14T13:15:34.346571+0000, chain.objs.size()=1 2024-09-14T11:22:51.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.192+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.CIzpoY0DSvvh6jmDsxH5ovIE_Ps55dy_0 2024-09-14T11:22:51.199 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.192+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.513235995234939618', time=2024-09-14T13:15:34.376021+0000, chain.objs.size()=1 2024-09-14T11:22:51.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.192+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.DtCnZ8V2JleGJ3RpyeHFZ44Jsz6GIyz_0 2024-09-14T11:22:51.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.192+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2427480015100886901', time=2024-09-14T13:15:35.272025+0000, chain.objs.size()=1 2024-09-14T11:22:51.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.192+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.328__shadow_.eAEigyG_9u8T4JCKQ9EhigIPDl9zY22_0 2024-09-14T11:22:51.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.192+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11338533688687826780', time=2024-09-14T13:15:39.566222+0000, chain.objs.size()=1 2024-09-14T11:22:51.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.192+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.345__shadow_.ToEWKiacAX1WYkUm9NOi7C9gQgbkJpG_0 2024-09-14T11:22:51.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.192+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11987732331396442206', time=2024-09-14T13:16:02.303342+0000, chain.objs.size()=1 2024-09-14T11:22:51.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.192+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.430__shadow_.IIowH4B-2zE4xvHO2QVy4v2g8rbV2ae_0 2024-09-14T11:22:51.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.193+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6254397310723876907', time=2024-09-14T13:16:13.395070+0000, chain.objs.size()=1 2024-09-14T11:22:51.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.193+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.465__shadow_.QOOwruJqopjttNsTY273ynKskE0Yp76_0 2024-09-14T11:22:51.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.193+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3682463895217712253', time=2024-09-14T13:16:13.759672+0000, chain.objs.size()=1 2024-09-14T11:22:51.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.193+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.466__shadow_.KseNDZJdQ7lN8PZ-WuvKEi8GmCkt6gP_0 2024-09-14T11:22:51.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.193+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16041871109414108840', time=2024-09-14T13:16:16.119149+0000, chain.objs.size()=1 2024-09-14T11:22:51.200 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.193+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.481__shadow_.toQtB0alLhQIvFDg0TczQnCs2P8dC5__0 2024-09-14T11:22:51.201 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.193+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1594599149562065218', time=2024-09-14T13:16:16.974994+0000, chain.objs.size()=1 2024-09-14T11:22:51.201 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.193+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.483__shadow_.pEXLTMSfjxvkgD3v7gAjSofQnbPCC_L_0 2024-09-14T11:22:51.201 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.193+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11270716730340668993', time=2024-09-14T13:16:20.571097+0000, chain.objs.size()=1 2024-09-14T11:22:51.201 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.193+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.496__shadow_.sEJVPMs3HxmV54mriFAfBHh-1APtUhe_0 2024-09-14T11:22:51.201 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.193+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10685488430282559752', time=2024-09-14T13:16:20.679348+0000, chain.objs.size()=1 2024-09-14T11:22:51.201 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.193+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.496__shadow_.sEJVPMs3HxmV54mriFAfBHh-1APtUhe_0 2024-09-14T11:22:51.201 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.194+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16220694041233996397', time=2024-09-14T13:16:20.680139+0000, chain.objs.size()=1 2024-09-14T11:22:51.201 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.194+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.496__shadow_.sEJVPMs3HxmV54mriFAfBHh-1APtUhe_0 2024-09-14T11:22:51.201 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.194+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7993928980927303701', time=2024-09-14T13:17:10.610623+0000, chain.objs.size()=1 2024-09-14T11:22:51.201 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.194+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.552__shadow_.3TtVpkuMLzCVrx3Na6Z82h7U-GHLLiR_0 2024-09-14T11:22:51.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.194+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16754157628854530102', time=2024-09-14T13:17:13.922363+0000, chain.objs.size()=1 2024-09-14T11:22:51.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.194+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.559__shadow_.JJ19GC4IDbd9XSo3vLgKb5fU5xF1khP_0 2024-09-14T11:22:51.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.195+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8057523508851017627', time=2024-09-14T13:17:21.814400+0000, chain.objs.size()=1 2024-09-14T11:22:51.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.195+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.569__shadow:Q320wAFdhWH0fgNg-DbuRSfelKunPLd_.mZ-PbFZk-MwH9ZOR0o5WNH_AIWOdpaV_0 2024-09-14T11:22:51.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.195+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1482491854104452157', time=2024-09-14T13:17:25.860533+0000, chain.objs.size()=1 2024-09-14T11:22:51.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.195+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.569__shadow:78Xy-2J5FF3EuWpo3g50nnukNcYn610_.ILQqGMLNjd2_uzOq-31bO7PzZKFZlzB_0 2024-09-14T11:22:51.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.196+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 0/44334 2024-09-14T11:22:51.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.198+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-14T11:22:51.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.198+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9650948920565423942', time=2024-09-14T13:17:27.682191+0000, chain.objs.size()=1 2024-09-14T11:22:51.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.198+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.571__shadow_.dmrONTVltYEjbTBGCSrC4QJR58ADVz7_0 2024-09-14T11:22:51.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.198+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10399195558433578902', time=2024-09-14T13:17:30.627585+0000, chain.objs.size()=1 2024-09-14T11:22:51.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.198+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.574__shadow:lWgVmwYW86GrjmRD4PNdHwQRSfNe1ut_.S_xiS75HkIrJhf1tTL2mfsZ_yNvR-bI_0 2024-09-14T11:22:51.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.198+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2495456066724121093', time=2024-09-14T13:17:38.956956+0000, chain.objs.size()=1 2024-09-14T11:22:51.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.198+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.577__shadow:nBzirwLbQJJHumW-SeklMHcxHbXUrwG_.d4Da2JDdtvB9mhiPD-_re5YfzzdLNHJ_0 2024-09-14T11:22:51.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.198+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.657747786177534440', time=2024-09-14T13:17:39.827181+0000, chain.objs.size()=1 2024-09-14T11:22:51.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.198+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.577__shadow:WPDIitBdr26zTzZxaxBzXTP71VElud4_.wn6aH8sR2PAfLTqwzXR8Tt0YR31_dnJ_0 2024-09-14T11:22:51.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.198+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5187503827617416614', time=2024-09-14T13:17:43.287240+0000, chain.objs.size()=1 2024-09-14T11:22:51.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.198+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.577__shadow:txnSKK9Zny3HQhLuEc0UUsqZYgvi052_.dpD2hhuUqBvmcq_myfRnkiG5GzvER8p_0 2024-09-14T11:22:51.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.198+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17656437335934297456', time=2024-09-14T13:17:51.005369+0000, chain.objs.size()=1 2024-09-14T11:22:51.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.198+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.580__shadow:vUFJDgDaYxHHxUnfuEXUGZuAYhYX3ha_.ufyV9_YsPmHiAGg0tiS5vjjyneUoUsT_0 2024-09-14T11:22:51.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.198+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14424601222773434224', time=2024-09-14T13:17:51.112405+0000, chain.objs.size()=1 2024-09-14T11:22:51.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.198+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.580__shadow:uvkV8vyrk1ft.OVxe8Q3wVoKeCgaEU0_.jDhVyFBCwZByM1fMe2IYsh-azj9Bj2h_0 2024-09-14T11:22:51.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.198+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.827801077771973949', time=2024-09-14T13:20:09.936232+0000, chain.objs.size()=1 2024-09-14T11:22:51.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.198+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.633__shadow_.qWz0gDvzKw4tpMLYSUFaoQnYQYwUOdP_0 2024-09-14T11:22:51.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.198+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13874845575720214499', time=2024-09-14T13:20:26.712616+0000, chain.objs.size()=1 2024-09-14T11:22:51.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.198+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.690__shadow:f.yRefUyxkem41jDbDKB6tQq-x1wj3p_.OyNidqKfyqlU4fhE14QpwReV7puwTKs_0 2024-09-14T11:22:51.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.198+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='2~JS22kU1XNXfBqRa13YESsiQdnyMag8Z', time=2024-09-14T13:21:00.390167+0000, chain.objs.size()=1 2024-09-14T11:22:51.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.198+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.742__multipart_mymultipart2.2~JS22kU1XNXfBqRa13YESsiQdnyMag8Z.1 2024-09-14T11:22:51.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.198+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16113741575799077508', time=2024-09-14T13:21:06.712481+0000, chain.objs.size()=1 2024-09-14T11:22:51.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.198+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.756__shadow_.INndMRZ1cmAPpnD4nVP2_JDQJNTOMjW_0 2024-09-14T11:22:51.207 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.200+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:51.207 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.202+0000 7f0f19c16800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:22:51.207 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.204+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:51.207 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.204+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:51.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.205+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50521' 2024-09-14T11:22:51.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.205+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2171440397337964238', time=2024-09-14T13:14:45.377709+0000, chain.objs.size()=1 2024-09-14T11:22:51.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.205+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.234__shadow_.g8_cLEiWQDMDq5VrS5YgH8JvOt7LenR_0 2024-09-14T11:22:51.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.205+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12742625672147075374', time=2024-09-14T13:14:51.836736+0000, chain.objs.size()=1 2024-09-14T11:22:51.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.205+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.258__shadow_.QnRmbJiXHoXGwZanSQyAo_oQAClUzX2_0 2024-09-14T11:22:51.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.205+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4756667079021572669', time=2024-09-14T13:14:59.746470+0000, chain.objs.size()=1 2024-09-14T11:22:51.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.205+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.wyJO0ueODPs_PmOJnBLHzB2WFn5kVWo_0 2024-09-14T11:22:51.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.205+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7303023959553468781', time=2024-09-14T13:14:59.800008+0000, chain.objs.size()=1 2024-09-14T11:22:51.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.205+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.uCPeX2dk5qeMis7nd8VHb_X0p6lyRIc_0 2024-09-14T11:22:51.208 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.205+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9329834979561534183', time=2024-09-14T13:14:59.905042+0000, chain.objs.size()=1 2024-09-14T11:22:51.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.205+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.yUEz9SI-11dCJSJAzPl4qCMRbFcN3uU_0 2024-09-14T11:22:51.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.205+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13702274522381986128', time=2024-09-14T13:14:59.932526+0000, chain.objs.size()=1 2024-09-14T11:22:51.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.205+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.CPupi2_--06q4DxYzqdfiNZ8ANSg8w1_0 2024-09-14T11:22:51.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.205+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9313582223682138969', time=2024-09-14T13:14:59.957643+0000, chain.objs.size()=1 2024-09-14T11:22:51.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.205+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.7dIRa9nbKxZ4I3_m9qY9qD5eBkn60h__0 2024-09-14T11:22:51.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.205+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13962148701921534511', time=2024-09-14T13:14:59.974648+0000, chain.objs.size()=1 2024-09-14T11:22:51.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.205+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.b82oqmgPyI4QcOdFhLo9Mn0wL1VEd3G_0 2024-09-14T11:22:51.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.205+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14269842328473663754', time=2024-09-14T13:14:59.980803+0000, chain.objs.size()=1 2024-09-14T11:22:51.209 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.205+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.1cX3co5IAVaQB6AUb8fN3gZ_6TiEWEh_0 2024-09-14T11:22:51.210 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.205+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15185498422883408703', time=2024-09-14T13:15:00.122187+0000, chain.objs.size()=1 2024-09-14T11:22:51.210 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.205+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.qCW_ty6AE41lRGu4TwTW2XUVqTaF5ok_0 2024-09-14T11:22:51.210 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.205+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5632024985975730109', time=2024-09-14T13:15:00.148845+0000, chain.objs.size()=1 2024-09-14T11:22:51.210 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.205+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.gkOFX81vcAu7dzXEhOxFhY_hutm6VRc_0 2024-09-14T11:22:51.210 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.205+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14620343075850773472', time=2024-09-14T13:15:00.247935+0000, chain.objs.size()=1 2024-09-14T11:22:51.210 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.205+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.XekXaiwdia7Ou8Q-Ze60U9b2FKHRZ3d_0 2024-09-14T11:22:51.210 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.207+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6818187977053558386', time=2024-09-14T13:15:00.252256+0000, chain.objs.size()=1 2024-09-14T11:22:51.210 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.207+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.vpEccC_ZKxY5FYpRFoe4bQeByGqlx46_0 2024-09-14T11:22:51.210 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.207+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18442769531411166893', time=2024-09-14T13:15:00.290606+0000, chain.objs.size()=1 2024-09-14T11:22:51.210 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.207+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.UzV6zS8cs_l23Dco0unqMZAl1hFpr4s_0 2024-09-14T11:22:51.211 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.207+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11230625132428676890', time=2024-09-14T13:15:00.300093+0000, chain.objs.size()=1 2024-09-14T11:22:51.211 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.207+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.H00INNTfXgX9Rdx6gc8NUOHIRFk01bR_0 2024-09-14T11:22:51.211 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.207+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6742480481413960308', time=2024-09-14T13:15:00.408344+0000, chain.objs.size()=1 2024-09-14T11:22:51.211 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.207+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.9q0rRS6qOVtLu1xr_uMmBeqzYno6o1F_0 2024-09-14T11:22:51.211 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.207+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9805115063937624193', time=2024-09-14T13:15:00.413273+0000, chain.objs.size()=1 2024-09-14T11:22:51.211 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.207+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.gB_i54Bx3Cp7LJ43SkMLCGPFFo8AOPx_0 2024-09-14T11:22:51.211 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.207+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17860723378197010647', time=2024-09-14T13:15:00.420731+0000, chain.objs.size()=1 2024-09-14T11:22:51.211 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.207+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.HNOuwhanLlBFFwAw0GFsU-zNHYP2Kso_0 2024-09-14T11:22:51.211 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.207+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7637576651300474449', time=2024-09-14T13:15:00.427476+0000, chain.objs.size()=1 2024-09-14T11:22:51.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.207+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.vgs77yo8ejkfmceLspFoXhRAxSYu6Zv_0 2024-09-14T11:22:51.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.207+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2400444156931217251', time=2024-09-14T13:15:00.450761+0000, chain.objs.size()=1 2024-09-14T11:22:51.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.207+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.x9POoQwy24nl6d0QRzNwdmB_XTYJROH_0 2024-09-14T11:22:51.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.207+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4781481281399965328', time=2024-09-14T13:15:00.470978+0000, chain.objs.size()=1 2024-09-14T11:22:51.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.207+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.gn0AdVDho8IQaBDz_2Fb7YlZt2ptTwG_0 2024-09-14T11:22:51.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.207+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7633191848367762452', time=2024-09-14T13:15:00.551866+0000, chain.objs.size()=1 2024-09-14T11:22:51.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.207+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.LWC03EMUy8xT3dfFJ6qkkPHz6QcaW2B_0 2024-09-14T11:22:51.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.207+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8910955938693806589', time=2024-09-14T13:15:00.563896+0000, chain.objs.size()=1 2024-09-14T11:22:51.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.207+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.fwwQ3p1pDLyPOE1y-9juu8p1CtQ8Uop_0 2024-09-14T11:22:51.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.208+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1685433032798391880', time=2024-09-14T13:15:00.578057+0000, chain.objs.size()=1 2024-09-14T11:22:51.212 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.208+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.0wwahhfMzo52H3NbwUfOng0Ql3SyPUl_0 2024-09-14T11:22:51.213 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.208+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11043539245935273429', time=2024-09-14T13:15:00.598386+0000, chain.objs.size()=1 2024-09-14T11:22:51.213 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.208+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.gErTbXj8o_kUpOvbYt0alrl9LHxIe-F_0 2024-09-14T11:22:51.213 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.209+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17354744182133295143', time=2024-09-14T13:15:00.599785+0000, chain.objs.size()=1 2024-09-14T11:22:51.213 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.209+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.SCmdhhs7df3W3bva8DB3eutVaV5IUay_0 2024-09-14T11:22:51.217 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.209+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5867911828121340752', time=2024-09-14T13:15:00.609277+0000, chain.objs.size()=1 2024-09-14T11:22:51.217 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.209+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.3_wq6CNac_CAxVvU4GWHwmTPd5gEYTJ_0 2024-09-14T11:22:51.217 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.209+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10162844473935006013', time=2024-09-14T13:15:00.622469+0000, chain.objs.size()=1 2024-09-14T11:22:51.217 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.209+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Gh07AmV1IC9vEmr46lewaQfOYnUTjB2_0 2024-09-14T11:22:51.217 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.209+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10287000623482478911', time=2024-09-14T13:15:00.787201+0000, chain.objs.size()=1 2024-09-14T11:22:51.217 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.209+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.tqwkhNDW3eb6bCBu9qJD3pB5m1BRcdJ_0 2024-09-14T11:22:51.218 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.209+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11152573728091996631', time=2024-09-14T13:15:00.881231+0000, chain.objs.size()=1 2024-09-14T11:22:51.218 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.209+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.6VvoWGzZ0cDG6OeGiN8GPxdqf0JStEt_0 2024-09-14T11:22:51.218 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.209+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2331998494203888313', time=2024-09-14T13:15:00.913390+0000, chain.objs.size()=1 2024-09-14T11:22:51.218 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.209+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.-iEViEtN6dmQiXSFMx4DveZ3Fuq18x2_0 2024-09-14T11:22:51.218 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.209+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10034936054828299968', time=2024-09-14T13:15:00.937107+0000, chain.objs.size()=1 2024-09-14T11:22:51.218 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.209+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.udvb1cUuOUxitws90rJZcOgAiJ4HZtS_0 2024-09-14T11:22:51.218 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.209+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1737370760757463814', time=2024-09-14T13:15:00.946030+0000, chain.objs.size()=1 2024-09-14T11:22:51.218 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.209+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.uRCX-w5BMN0s1tqvp3fDKEsIb1-ytyb_0 2024-09-14T11:22:51.218 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.210+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11567981937924858539', time=2024-09-14T13:15:02.161730+0000, chain.objs.size()=1 2024-09-14T11:22:51.219 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.210+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.267__shadow_.Qhpq-SkfHu5PxRF8vQsI_i7QzQUx3MK_0 2024-09-14T11:22:51.219 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.210+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7315868262843673407', time=2024-09-14T13:15:03.654589+0000, chain.objs.size()=1 2024-09-14T11:22:51.219 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.210+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.273__shadow_.bSln0QPPzwEVCx4OhaLnG-BeqecruuU_0 2024-09-14T11:22:51.219 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.210+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.944669944379292398', time=2024-09-14T13:15:03.899376+0000, chain.objs.size()=1 2024-09-14T11:22:51.219 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.210+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.274__shadow_.nxiC54dzbaCpVsqB_czG8II4nktwnoH_0 2024-09-14T11:22:51.219 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.211+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4192166547827099809', time=2024-09-14T13:15:09.836945+0000, chain.objs.size()=1 2024-09-14T11:22:51.219 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.211+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.293__shadow_.Irw9AEQKwobBByLIARPqTUcrAbcCK0O_0 2024-09-14T11:22:51.219 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.211+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9883934783806408780', time=2024-09-14T13:15:09.837660+0000, chain.objs.size()=1 2024-09-14T11:22:51.219 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.211+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.293__shadow_.iimXNLRv8E9FwV6CB8e4gvVTKtMGlgB_0 2024-09-14T11:22:51.219 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.211+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9727787682936221943', time=2024-09-14T13:15:12.487728+0000, chain.objs.size()=1 2024-09-14T11:22:51.219 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.211+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.303__shadow_.slGvA91GNi2ZCgwc4wUJpjlYQ-goOc0_0 2024-09-14T11:22:51.219 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.211+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11098491723077970202', time=2024-09-14T13:15:24.715103+0000, chain.objs.size()=1 2024-09-14T11:22:51.219 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.211+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.1IR77dFNthCe-xZ_tXFReZ4JJ6j0Gtu_0 2024-09-14T11:22:51.220 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.211+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6783326835540213303', time=2024-09-14T13:15:24.724489+0000, chain.objs.size()=1 2024-09-14T11:22:51.220 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.211+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.eErUQBhhsRAKbXpbVN8Qen2F8eNbAyy_0 2024-09-14T11:22:51.220 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.211+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6064151942106318219', time=2024-09-14T13:15:24.752017+0000, chain.objs.size()=1 2024-09-14T11:22:51.220 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.211+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.ivXrYBKwG12S9Dxl7o8kywxHZ-qtl45_0 2024-09-14T11:22:51.220 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.211+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10166076539426988993', time=2024-09-14T13:15:24.801502+0000, chain.objs.size()=1 2024-09-14T11:22:51.220 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.211+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.NKnvRm3GOvP3N0dWNhNaXDpPslCVoKs_0 2024-09-14T11:22:51.220 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.211+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15328851218568954466', time=2024-09-14T13:15:24.878608+0000, chain.objs.size()=1 2024-09-14T11:22:51.220 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.211+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.GZgKs7jvCtpjGomhJL6aBZRZ5m57Py6_0 2024-09-14T11:22:51.220 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.211+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14483282493000428754', time=2024-09-14T13:15:24.909095+0000, chain.objs.size()=1 2024-09-14T11:22:51.221 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.211+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.6CM-1n6UHU6bLop1R7dbhe0UKFENCqp_0 2024-09-14T11:22:51.221 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.212+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7363422278800263468', time=2024-09-14T13:15:24.940767+0000, chain.objs.size()=1 2024-09-14T11:22:51.221 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.212+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.3EppENyN0gdwQak6mQsOLCZfQKdPo0I_0 2024-09-14T11:22:51.221 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.213+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12308535533379750159', time=2024-09-14T13:15:24.942733+0000, chain.objs.size()=1 2024-09-14T11:22:51.221 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.213+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.XQxQphaY1vdEHJIoQJe6_zbxpjEyvuP_0 2024-09-14T11:22:51.221 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.213+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13209221503063245875', time=2024-09-14T13:15:24.951841+0000, chain.objs.size()=1 2024-09-14T11:22:51.221 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.213+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.JBEFkfTn6bNfXsporRpPdfhHJ_l1CGo_0 2024-09-14T11:22:51.221 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.213+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.639754749618421709', time=2024-09-14T13:15:24.954957+0000, chain.objs.size()=1 2024-09-14T11:22:51.221 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.213+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.AfUT6Ev4vZpHrUHzmZzvuWSbgZX4zU1_0 2024-09-14T11:22:51.221 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.213+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18051683718435437949', time=2024-09-14T13:15:24.959853+0000, chain.objs.size()=1 2024-09-14T11:22:51.221 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.213+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.Yj1nl79aLaX1fRsON-A0XHlOGVLnUZ5_0 2024-09-14T11:22:51.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.213+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3986927648875837835', time=2024-09-14T13:15:24.966972+0000, chain.objs.size()=1 2024-09-14T11:22:51.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.213+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.nOZ2IYlqkwwhNChy67_LE4ghAee0t7S_0 2024-09-14T11:22:51.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.213+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6039082859341643543', time=2024-09-14T13:15:25.068085+0000, chain.objs.size()=1 2024-09-14T11:22:51.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.213+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.9X3nJglRqrsZAqsWrZsEVYNPHJmd5j0_0 2024-09-14T11:22:51.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.213+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.844145330055686487', time=2024-09-14T13:15:25.100101+0000, chain.objs.size()=1 2024-09-14T11:22:51.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.213+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.b9fnjazvg2fEHnN5lTIDyf8fxkn-N77_0 2024-09-14T11:22:51.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.213+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13493496927086542763', time=2024-09-14T13:15:25.102596+0000, chain.objs.size()=1 2024-09-14T11:22:51.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.213+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.CTuzx4rXsAzbLrHrxRfszs3LSODkZ8h_0 2024-09-14T11:22:51.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.213+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3299731307097041068', time=2024-09-14T13:15:25.206429+0000, chain.objs.size()=1 2024-09-14T11:22:51.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.213+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.N6VVIVIIku4IG3HNxUdIzGMLQS2JaKP_0 2024-09-14T11:22:51.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.213+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4807355374037018355', time=2024-09-14T13:15:25.246033+0000, chain.objs.size()=1 2024-09-14T11:22:51.222 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.213+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.wpybizb9DyiCg9i2g3u5F8iGJ1A8Jqn_0 2024-09-14T11:22:51.223 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.214+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11029598596418735113', time=2024-09-14T13:15:25.253833+0000, chain.objs.size()=1 2024-09-14T11:22:51.223 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.214+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.kCyvVh1xyXxTCXTRmKBuDKK_7Zzms93_0 2024-09-14T11:22:51.223 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.215+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18422964880649806150', time=2024-09-14T13:15:25.271338+0000, chain.objs.size()=1 2024-09-14T11:22:51.223 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.215+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.2XVqLLm5GvlaUZKmp20_sh80eVQiQ1t_0 2024-09-14T11:22:51.223 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.215+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4839469705703275309', time=2024-09-14T13:15:25.367635+0000, chain.objs.size()=1 2024-09-14T11:22:51.223 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.215+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.jrimG0qf3-Wkvjzp-vz4rIkLj-y41U6_0 2024-09-14T11:22:51.223 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.215+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15136184751498014159', time=2024-09-14T13:15:25.369346+0000, chain.objs.size()=1 2024-09-14T11:22:51.223 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.215+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.y0wnO5sioo9zWuqN6mgeJJlvYLweMKS_0 2024-09-14T11:22:51.223 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.215+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15806585818652941616', time=2024-09-14T13:15:25.426512+0000, chain.objs.size()=1 2024-09-14T11:22:51.223 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.215+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.m94BySb3GU5UPpYpgIZhgzezhYPKQ3b_0 2024-09-14T11:22:51.223 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.215+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15592127122578757381', time=2024-09-14T13:15:25.449289+0000, chain.objs.size()=1 2024-09-14T11:22:51.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.215+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.AFc6HbheUaD3EoJHlpzgFve_IX2Ord0_0 2024-09-14T11:22:51.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.215+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6377831399751485838', time=2024-09-14T13:15:25.528331+0000, chain.objs.size()=1 2024-09-14T11:22:51.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.215+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.XZWcA8DzP0cYDbxffZeC1vJ0JAefxTa_0 2024-09-14T11:22:51.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.215+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3669630445394797089', time=2024-09-14T13:15:25.603261+0000, chain.objs.size()=1 2024-09-14T11:22:51.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.215+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.4AIK5ibsyE_ObYNbvQh9iO5PITQ1VcM_0 2024-09-14T11:22:51.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.215+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3404361699619483880', time=2024-09-14T13:15:25.607547+0000, chain.objs.size()=1 2024-09-14T11:22:51.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.215+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.uVjAQRtLSNEeGvPvwQBtqxnAdveeCq-_0 2024-09-14T11:22:51.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.215+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9371082143172368710', time=2024-09-14T13:15:25.609160+0000, chain.objs.size()=1 2024-09-14T11:22:51.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.215+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.KGxMNknSii9JC30jZQEb9Q22RL1jtjQ_0 2024-09-14T11:22:51.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.215+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12899170614656217697', time=2024-09-14T13:15:25.611746+0000, chain.objs.size()=1 2024-09-14T11:22:51.224 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.215+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.Olj666ijGE2hJfLm6kR1-6_kVfk_flC_0 2024-09-14T11:22:51.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.216+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16842639049899470284', time=2024-09-14T13:15:25.702267+0000, chain.objs.size()=1 2024-09-14T11:22:51.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.216+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.F6UUhGuXT7CyzAxBvAv4y0pffWfN1uB_0 2024-09-14T11:22:51.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.217+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12206064029505344054', time=2024-09-14T13:15:25.759571+0000, chain.objs.size()=1 2024-09-14T11:22:51.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.217+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.OidVVGOpTJNIwr5ZpO9wrLLstEFaLFm_0 2024-09-14T11:22:51.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.217+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10071306008685019157', time=2024-09-14T13:15:25.884073+0000, chain.objs.size()=1 2024-09-14T11:22:51.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.217+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.W7h_v3y_OqN5Mu3X4fDv16V2gwgWRC2_0 2024-09-14T11:22:51.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.217+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5037763792201641362', time=2024-09-14T13:15:25.922588+0000, chain.objs.size()=1 2024-09-14T11:22:51.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.217+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.1giN7TVl0dPrYACxKyp7p5XrX7ja3W3_0 2024-09-14T11:22:51.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.217+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.91962530016990731', time=2024-09-14T13:15:25.924448+0000, chain.objs.size()=1 2024-09-14T11:22:51.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.217+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.te_hMeUw6W984OX5t7fJZuOdSbMTotD_0 2024-09-14T11:22:51.225 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.218+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14269442253434253954', time=2024-09-14T13:15:25.930276+0000, chain.objs.size()=1 2024-09-14T11:22:51.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.218+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.OTHCXy1EdQ0YntnyoczWKozFMD4vTpo_0 2024-09-14T11:22:51.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.218+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1256810952027350864', time=2024-09-14T13:15:33.181292+0000, chain.objs.size()=1 2024-09-14T11:22:51.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.218+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.8fXGn-v5fC9ucCz2uEPUEPY1k8fhnq-_0 2024-09-14T11:22:51.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.218+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8476302727455171615', time=2024-09-14T13:15:33.387268+0000, chain.objs.size()=1 2024-09-14T11:22:51.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.218+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.KGjGGEmmnkePaxmxxLmbyGEsosmXGX4_0 2024-09-14T11:22:51.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.218+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16890117875422699456', time=2024-09-14T13:15:33.453422+0000, chain.objs.size()=1 2024-09-14T11:22:51.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.218+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.7HAg_QQQSAygwZWhfAThKAOC0QDnz4y_0 2024-09-14T11:22:51.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.218+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17934690056281777958', time=2024-09-14T13:15:33.591981+0000, chain.objs.size()=1 2024-09-14T11:22:51.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.218+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.2AlfGASiWXQbDNI0E9nHaCdbd6llUpm_0 2024-09-14T11:22:51.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.218+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14795499520017022967', time=2024-09-14T13:15:33.609158+0000, chain.objs.size()=1 2024-09-14T11:22:51.226 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.218+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.POe0pzQ8dk0RImjiweYoDUSEdLkJwhy_0 2024-09-14T11:22:51.227 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.218+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10157212151481571391', time=2024-09-14T13:15:33.691174+0000, chain.objs.size()=1 2024-09-14T11:22:51.227 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.218+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Fw4gFZSbd_Cbj1lcz-yZuqfDO-nTjGf_0 2024-09-14T11:22:51.230 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.220+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.703137540439954388', time=2024-09-14T13:15:33.726684+0000, chain.objs.size()=1 2024-09-14T11:22:51.230 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.220+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.qnBlYcwi0j1kwOne_9nV_VLGiX41TpP_0 2024-09-14T11:22:51.230 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.220+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16919310120402394874', time=2024-09-14T13:15:33.744740+0000, chain.objs.size()=1 2024-09-14T11:22:51.230 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.220+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.RPiPUdmzFk5QxdfZFz-PTISQ7ibYKbw_0 2024-09-14T11:22:51.230 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.220+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16901767008810724238', time=2024-09-14T13:15:33.753823+0000, chain.objs.size()=1 2024-09-14T11:22:51.230 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.220+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.nHltwSkPB4giKS_K0qtVEF47oFfc3MI_0 2024-09-14T11:22:51.230 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.220+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10832250198252405729', time=2024-09-14T13:15:33.772877+0000, chain.objs.size()=1 2024-09-14T11:22:51.230 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.220+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.yIw0Tf0oEr38gZdljQRLrUwaZENB4O8_0 2024-09-14T11:22:51.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.220+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4838513984249105418', time=2024-09-14T13:15:33.779903+0000, chain.objs.size()=1 2024-09-14T11:22:51.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.220+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.iI5sC6mZJnbIcWkkMmptumM2Qua3sph_0 2024-09-14T11:22:51.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.220+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5211845798941178673', time=2024-09-14T13:15:33.869947+0000, chain.objs.size()=1 2024-09-14T11:22:51.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.220+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.C_L9RIVWQdqdKSsead4ITg7a5ZPdHzA_0 2024-09-14T11:22:51.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.220+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8661640834197275683', time=2024-09-14T13:15:33.879180+0000, chain.objs.size()=1 2024-09-14T11:22:51.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.220+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.uO9nyj_4NHGFdHTPikcW7ZFoXnl6Aqw_0 2024-09-14T11:22:51.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.220+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10250174789639578264', time=2024-09-14T13:15:33.891951+0000, chain.objs.size()=1 2024-09-14T11:22:51.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.220+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.yWyRM0g1glz4nO1HI7HYtymM5s-NBlS_0 2024-09-14T11:22:51.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.220+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9432390100661095555', time=2024-09-14T13:15:34.011232+0000, chain.objs.size()=1 2024-09-14T11:22:51.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.220+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.QAb_I29tndqENUmrt066uKBD4g8JtDC_0 2024-09-14T11:22:51.231 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.220+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13132319962811688519', time=2024-09-14T13:15:34.014440+0000, chain.objs.size()=1 2024-09-14T11:22:51.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.220+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.sKr24fxkjiaV9Lf0rmQmUjRZ5zrZVmx_0 2024-09-14T11:22:51.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.222+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1022567533996009726', time=2024-09-14T13:15:34.046367+0000, chain.objs.size()=1 2024-09-14T11:22:51.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.222+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.b6AHKhEMJoHdnVaMWheoTdCXqHrgt2F_0 2024-09-14T11:22:51.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.222+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11781699617492680176', time=2024-09-14T13:15:34.253225+0000, chain.objs.size()=1 2024-09-14T11:22:51.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.222+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.BEvDMBONp4XTjA6HpW8SiP0NWKeRrSh_0 2024-09-14T11:22:51.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.222+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5619027441348200309', time=2024-09-14T13:15:34.355449+0000, chain.objs.size()=1 2024-09-14T11:22:51.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.222+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.qL4i6HRU_2_IhSNG9VVMq0AcjB-NNio_0 2024-09-14T11:22:51.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.222+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13989983131757207612', time=2024-09-14T13:15:34.385603+0000, chain.objs.size()=1 2024-09-14T11:22:51.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.222+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.iNhk97CWfzIpHovCDK7GJhlvDAQ3hTd_0 2024-09-14T11:22:51.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.222+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1677095044459048156', time=2024-09-14T13:15:34.401870+0000, chain.objs.size()=1 2024-09-14T11:22:51.232 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.222+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.CPd8nzMjHlMUdQThLsJinIREZXk21Ge_0 2024-09-14T11:22:51.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.222+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5293586213916248058', time=2024-09-14T13:15:36.461817+0000, chain.objs.size()=1 2024-09-14T11:22:51.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.222+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.333__shadow_.6OmGJl3Q9Qw8DeEt5K7ziNycOaw-2Ne_0 2024-09-14T11:22:51.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.222+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11141123919253551562', time=2024-09-14T13:15:47.276974+0000, chain.objs.size()=1 2024-09-14T11:22:51.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.222+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.377__shadow_.fFYdY9K-wlNijkuOi_V7FLSGTcHjtZt_0 2024-09-14T11:22:51.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.222+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2577135061038734225', time=2024-09-14T13:16:13.642995+0000, chain.objs.size()=1 2024-09-14T11:22:51.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.222+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.466__shadow_.WqjCmBAGM4nPKTSISzBJld20FzmoWzL_0 2024-09-14T11:22:51.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.222+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7785546429077708757', time=2024-09-14T13:16:17.244609+0000, chain.objs.size()=1 2024-09-14T11:22:51.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.222+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.484__shadow_.70Iyb-GlqL-Q_Aqgir8k_UiujTHmQxt_0 2024-09-14T11:22:51.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.222+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18137944063514223450', time=2024-09-14T13:16:19.123732+0000, chain.objs.size()=1 2024-09-14T11:22:51.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.222+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.490__shadow_.7j5ngtFXq_s7zucXww0UcgXNT854o5O_0 2024-09-14T11:22:51.233 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.222+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18137944063514223450', time=2024-09-14T13:16:19.230073+0000, chain.objs.size()=1 2024-09-14T11:22:51.234 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.222+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.490__shadow_.7j5ngtFXq_s7zucXww0UcgXNT854o5O_0 2024-09-14T11:22:51.234 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.225+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 0/50521 2024-09-14T11:22:51.234 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.227+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-14T11:22:51.234 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.227+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15168695928363016407', time=2024-09-14T13:16:21.686194+0000, chain.objs.size()=1 2024-09-14T11:22:51.234 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.227+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.500__shadow_.k9l2VresgAme5XgjCjfLpTCENgE65YE_0 2024-09-14T11:22:51.234 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.227+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5671879308710153889', time=2024-09-14T13:16:24.781792+0000, chain.objs.size()=6 2024-09-14T11:22:51.234 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.227+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.507__multipart_srcmultipart.2~EQ3ZZNALHrAJsVAZLD-5msuDtyJwYup.1 2024-09-14T11:22:51.234 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.227+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.507__multipart_srcmultipart.2~EQ3ZZNALHrAJsVAZLD-5msuDtyJwYup.2 2024-09-14T11:22:51.234 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.227+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.507__multipart_srcmultipart.2~EQ3ZZNALHrAJsVAZLD-5msuDtyJwYup.3 2024-09-14T11:22:51.234 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.227+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.507__multipart_srcmultipart.2~EQ3ZZNALHrAJsVAZLD-5msuDtyJwYup.4 2024-09-14T11:22:51.234 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.227+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.507__multipart_srcmultipart.2~EQ3ZZNALHrAJsVAZLD-5msuDtyJwYup.5 2024-09-14T11:22:51.234 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.227+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.507__multipart_srcmultipart.2~EQ3ZZNALHrAJsVAZLD-5msuDtyJwYup.6 2024-09-14T11:22:51.235 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.227+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8562793129962502906', time=2024-09-14T13:17:13.482324+0000, chain.objs.size()=1 2024-09-14T11:22:51.235 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.227+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.558__shadow_.aFZgqgkCiqn_gtk-zAh31KqUzkDe3aT_0 2024-09-14T11:22:51.235 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.227+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5666207794373452017', time=2024-09-14T13:17:26.004335+0000, chain.objs.size()=1 2024-09-14T11:22:51.235 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.227+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.569__shadow:M54NQoMcJc-5lm8nDewQlLTrF2OeP1U_.4-K2KbmbwdCAMX8jtSma-lPq0jL0d-a_0 2024-09-14T11:22:51.235 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.227+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7426429916325143412', time=2024-09-14T13:17:27.444782+0000, chain.objs.size()=1 2024-09-14T11:22:51.235 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.227+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.570__shadow:WRhZtBcn423hx4cT0XQRwKqzBU4Eonp_.41rrtEiGAnT8bLmJdzGvq9Fesx8Jn39_0 2024-09-14T11:22:51.235 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.227+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9101724676794299972', time=2024-09-14T13:17:27.468963+0000, chain.objs.size()=1 2024-09-14T11:22:51.235 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.227+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.570__shadow:iTkdaQmE4WyDuXEsWa06FDKKOBGzhz9_.zaSKmWmFWtA_xGcxo3k61btYJ2CQRe9_0 2024-09-14T11:22:51.235 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.227+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17958503914294104645', time=2024-09-14T13:17:34.797156+0000, chain.objs.size()=1 2024-09-14T11:22:51.235 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.227+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.576__shadow:yhVDxWSr0LnP7sCbJC8GWfWPJ5GLkOF_.1nuw0g9CQKmrZ5cTJrWFf9PL8gTBfv8_0 2024-09-14T11:22:51.235 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.228+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6154234578144124191', time=2024-09-14T13:17:51.011548+0000, chain.objs.size()=1 2024-09-14T11:22:51.236 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.228+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.580__shadow:uvkV8vyrk1ft.OVxe8Q3wVoKeCgaEU0_.jDhVyFBCwZByM1fMe2IYsh-azj9Bj2h_0 2024-09-14T11:22:51.236 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.229+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2572348894566323822', time=2024-09-14T13:17:58.550908+0000, chain.objs.size()=1 2024-09-14T11:22:51.236 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.229+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.608__shadow_.QfaKjQfgpRewOpzSipj-sgIzL0VI2kF_0 2024-09-14T11:22:51.236 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.229+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11690251390211728380', time=2024-09-14T13:20:04.267200+0000, chain.objs.size()=1 2024-09-14T11:22:51.236 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.229+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.618__shadow_.EvM0EhdGRMd4jfdDTrKaKzx-uqBKXA__0 2024-09-14T11:22:51.236 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.229+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4194557939906681467', time=2024-09-14T13:20:20.022811+0000, chain.objs.size()=1 2024-09-14T11:22:51.236 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.229+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.663__shadow_.UGn3czp65tQUdq7FmqyG63DApLcaWSQ_0 2024-09-14T11:22:51.236 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.229+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6264639741120083633', time=2024-09-14T13:20:43.745778+0000, chain.objs.size()=1 2024-09-14T11:22:51.236 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.229+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.716__shadow:nwRjFuYnr8ZyX16Dlz29Ob6DO0LAbD7_.ylKHXPPkct-q-uFmNdkBdZ9_8bCb6n8_0 2024-09-14T11:22:51.236 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.229+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='2~im-mqA2_Xcgo834yrtLO5EZLww5D8ag', time=2024-09-14T13:21:00.385564+0000, chain.objs.size()=1 2024-09-14T11:22:51.236 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.229+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.742__multipart_mymultipart.2~im-mqA2_Xcgo834yrtLO5EZLww5D8ag.1 2024-09-14T11:22:51.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.229+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16252602146284234502', time=2024-09-14T13:21:01.125316+0000, chain.objs.size()=1 2024-09-14T11:22:51.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.229+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.744__shadow_.YqUy5gQeGeHaJokXp0jgqiSYmeDhIQJ_0 2024-09-14T11:22:51.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.229+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8084648028724389835', time=2024-09-14T13:21:14.331030+0000, chain.objs.size()=1 2024-09-14T11:22:51.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.229+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.773__shadow_.9MzD9ZtfPyMG1B_I0_aLvHCJZAJ3auQ_0 2024-09-14T11:22:51.237 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.231+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:51.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.233+0000 7f0f19c16800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:22:51.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.234+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:51.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.235+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:51.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.235+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45063' 2024-09-14T11:22:51.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.235+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.207600322662038823', time=2024-09-14T13:13:34.515116+0000, chain.objs.size()=1 2024-09-14T11:22:51.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.236+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.160__shadow_.ct93EUhuJ5XERTHcnoKMWRwGQoIKQr4_0 2024-09-14T11:22:51.240 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.236+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='_hMfWHEfOdSNieRmtBp8xgesf3K1vv4t', time=2024-09-14T13:13:35.665437+0000, chain.objs.size()=1 2024-09-14T11:22:51.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.236+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.161__shadow_.2E3E5qBV-LR6TNkgDPIGxEdjJi_U3DG_0 2024-09-14T11:22:51.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.236+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8443150139449834621', time=2024-09-14T13:14:46.213778+0000, chain.objs.size()=1 2024-09-14T11:22:51.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.236+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.237__shadow_.BS5fqh3t_u8GavA4VwuDqjS-1A8YbKZ_0 2024-09-14T11:22:51.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.236+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16458957257988520869', time=2024-09-14T13:14:47.510047+0000, chain.objs.size()=1 2024-09-14T11:22:51.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.236+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.242__shadow_.vjMyu6JsY4zCu1OnZvYBtqps0wqgnXw_0 2024-09-14T11:22:51.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.236+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17299156349801524278', time=2024-09-14T13:14:48.115846+0000, chain.objs.size()=1 2024-09-14T11:22:51.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.236+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.244__shadow_.F28YFy0Cv_6j8JQwIwTF-o-zp2aDj_p_0 2024-09-14T11:22:51.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.236+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13331020921188431729', time=2024-09-14T13:14:48.366208+0000, chain.objs.size()=1 2024-09-14T11:22:51.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.236+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.245__shadow_.JNzMm3Cx0TFz_zhFKEbBor2LcqtRuk7_0 2024-09-14T11:22:51.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.236+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13569152453215161435', time=2024-09-14T13:14:48.567764+0000, chain.objs.size()=1 2024-09-14T11:22:51.241 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.236+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.245__shadow_.G8l10xlKZ9oGI8hexjNx1CUrlhkPzQx_0 2024-09-14T11:22:51.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.236+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1008329109919141171', time=2024-09-14T13:14:59.734544+0000, chain.objs.size()=1 2024-09-14T11:22:51.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.236+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.k4EvWvs6GBLS70wrrwqhycsv0ocX_wf_0 2024-09-14T11:22:51.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.236+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13846845464077058383', time=2024-09-14T13:14:59.737162+0000, chain.objs.size()=1 2024-09-14T11:22:51.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.236+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.AZ3Wu3iPhIbUZDN_GiBGd6qOur8RxQA_0 2024-09-14T11:22:51.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.236+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17268308972535106405', time=2024-09-14T13:14:59.747160+0000, chain.objs.size()=1 2024-09-14T11:22:51.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.236+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.DZ3OBTyFtujXaTVDkuCvB92wWy2gZPP_0 2024-09-14T11:22:51.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.236+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16408967143287901790', time=2024-09-14T13:14:59.751347+0000, chain.objs.size()=1 2024-09-14T11:22:51.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.236+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_._PWfdVRpsGCsKmwvlRXgOjnJCKD5jqa_0 2024-09-14T11:22:51.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.236+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4935340093834819490', time=2024-09-14T13:14:59.914028+0000, chain.objs.size()=1 2024-09-14T11:22:51.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.236+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.QIr15UKjDiDZIB9nvZ6jWQEgIqles_T_0 2024-09-14T11:22:51.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.238+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9254835955058933488', time=2024-09-14T13:14:59.950443+0000, chain.objs.size()=1 2024-09-14T11:22:51.242 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.238+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.DvdDN0HqEaD1E3QfgZwswe2K4TpOMnw_0 2024-09-14T11:22:51.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.238+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10754612550680538139', time=2024-09-14T13:15:00.062474+0000, chain.objs.size()=1 2024-09-14T11:22:51.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.238+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.unNBlUPhKoXeM_0uKklv5rK-RWl8qHm_0 2024-09-14T11:22:51.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.238+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8676795482899982553', time=2024-09-14T13:15:00.063342+0000, chain.objs.size()=1 2024-09-14T11:22:51.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.238+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.JQ7rU4yM-SFTvtInKcl7uoxG-vmPySJ_0 2024-09-14T11:22:51.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.238+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13161986929946556823', time=2024-09-14T13:15:00.064853+0000, chain.objs.size()=1 2024-09-14T11:22:51.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.238+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.I59uvbpCHLPlYwE0yPDaP5epQwwH9fP_0 2024-09-14T11:22:51.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.238+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5195568503574090222', time=2024-09-14T13:15:00.095963+0000, chain.objs.size()=1 2024-09-14T11:22:51.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.238+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.v5_BwYKIJVkz2QjfIaPEy4rsl98VA7V_0 2024-09-14T11:22:51.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.238+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4510933539273249133', time=2024-09-14T13:15:00.127925+0000, chain.objs.size()=1 2024-09-14T11:22:51.243 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.238+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.qWue1aHilWzHwXHyE259blC4gTJmjIQ_0 2024-09-14T11:22:51.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.238+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14377388442491342216', time=2024-09-14T13:15:00.281017+0000, chain.objs.size()=1 2024-09-14T11:22:51.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.238+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.aZLXX-g4kYi7YVrOLPwh3E163uZGzzJ_0 2024-09-14T11:22:51.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.238+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9808431607802427287', time=2024-09-14T13:15:00.420081+0000, chain.objs.size()=1 2024-09-14T11:22:51.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.238+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.9PfiiR2Haz4ghGxLYCheGHz7WKT2zkm_0 2024-09-14T11:22:51.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.238+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1758917201891360533', time=2024-09-14T13:15:00.428596+0000, chain.objs.size()=1 2024-09-14T11:22:51.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.238+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.SBGa2naCyYMrimgYYn0U14L9GdSXgz7_0 2024-09-14T11:22:51.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.238+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10397538701703975882', time=2024-09-14T13:15:00.441906+0000, chain.objs.size()=1 2024-09-14T11:22:51.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.238+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.ExLlGgg3xqfJ-gDTAh_TUwoe8dag1vO_0 2024-09-14T11:22:51.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.238+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8924292685312922257', time=2024-09-14T13:15:00.562614+0000, chain.objs.size()=1 2024-09-14T11:22:51.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.238+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Cl_AefUiYiNyVrH1osGWtW17y4wbWiI_0 2024-09-14T11:22:51.244 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.240+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13217445128413465537', time=2024-09-14T13:15:00.569731+0000, chain.objs.size()=1 2024-09-14T11:22:51.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.240+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.2FpGUx0tS55028Az14nvBdXAg-mMTCn_0 2024-09-14T11:22:51.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.240+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15597566474936486329', time=2024-09-14T13:15:00.571574+0000, chain.objs.size()=1 2024-09-14T11:22:51.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.240+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.-xAsfZOvdykph65-SyjOP6yhicOOcfE_0 2024-09-14T11:22:51.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.240+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11170463491354324592', time=2024-09-14T13:15:00.574942+0000, chain.objs.size()=1 2024-09-14T11:22:51.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.240+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.XOza1Ce5KhDRVz6toJQHeMeBmHanJ42_0 2024-09-14T11:22:51.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.240+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10712475428521922746', time=2024-09-14T13:15:00.575610+0000, chain.objs.size()=1 2024-09-14T11:22:51.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.240+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.6DLeSFDYNTkuGCPpS-fnzBnv2yOA09J_0 2024-09-14T11:22:51.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.240+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4317726844840834887', time=2024-09-14T13:15:00.636173+0000, chain.objs.size()=1 2024-09-14T11:22:51.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.240+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Ft58SJEpcqc3KSOI9AykTVq12SqwZ4l_0 2024-09-14T11:22:51.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.240+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15899998289435854299', time=2024-09-14T13:15:00.712159+0000, chain.objs.size()=1 2024-09-14T11:22:51.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.240+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.J0drGeRDzt_x4uuGr-_r8MEic2X1wA8_0 2024-09-14T11:22:51.245 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.240+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12476590835650127145', time=2024-09-14T13:15:00.725769+0000, chain.objs.size()=1 2024-09-14T11:22:51.246 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.240+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.CkT0mePgpgcYoC3bs-yZ85CQTjeL1UA_0 2024-09-14T11:22:51.246 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.240+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12191018798098234793', time=2024-09-14T13:15:00.738370+0000, chain.objs.size()=1 2024-09-14T11:22:51.246 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.240+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Zg_d1H7E0Li9oqduTjNqnSIRx_Z8nmH_0 2024-09-14T11:22:51.246 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.240+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15540457222286198601', time=2024-09-14T13:15:00.749735+0000, chain.objs.size()=1 2024-09-14T11:22:51.246 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.240+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.QlRugKsqyMTsVxw1d4JCJLBbXS-yxZy_0 2024-09-14T11:22:51.246 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.240+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13725115547656533420', time=2024-09-14T13:15:00.896602+0000, chain.objs.size()=1 2024-09-14T11:22:51.246 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.240+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.tVARyUEuY_-jssu_6CABGdLUIFe3QyJ_0 2024-09-14T11:22:51.246 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.240+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4727886471223742809', time=2024-09-14T13:15:00.902307+0000, chain.objs.size()=1 2024-09-14T11:22:51.246 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.240+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.ZEgQXlTAMPNz7VS8VwVx-3n-0NSc4Yq_0 2024-09-14T11:22:51.246 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.241+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17810454481430067661', time=2024-09-14T13:15:00.903679+0000, chain.objs.size()=1 2024-09-14T11:22:51.246 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.241+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.o7wdS-yCGTOX2_kqrOgokFv9uJt2NEp_0 2024-09-14T11:22:51.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.242+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11029385555783778895', time=2024-09-14T13:15:00.940459+0000, chain.objs.size()=1 2024-09-14T11:22:51.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.242+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.104RW-1CkOqP37Ch_fUFlxiSH0oZcqD_0 2024-09-14T11:22:51.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.242+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17314024515501265977', time=2024-09-14T13:15:02.648087+0000, chain.objs.size()=1 2024-09-14T11:22:51.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.242+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.269__shadow_.dlEvIbUGdSatcJp--G--355rYt-dc7f_0 2024-09-14T11:22:51.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.242+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15332849954607694776', time=2024-09-14T13:15:05.218001+0000, chain.objs.size()=1 2024-09-14T11:22:51.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.242+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.279__shadow_.RaDrQ9TKi9vlhqYcyYSBWhGHjtrXZE4_0 2024-09-14T11:22:51.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.242+0000 7f0f153e7640 0 -- 172.21.15.97:0/3336262302 >> [v2:172.21.15.152:6800/410517460,v1:172.21.15.152:6801/410517460] conn(0x7f0de008fb00 msgr2=0x7f0de00923e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:51.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.242+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11870768182341524600', time=2024-09-14T13:15:09.243949+0000, chain.objs.size()=1 2024-09-14T11:22:51.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.242+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.292__shadow_._ROVEv8YmHOqVM2KyWIvQZgibalr4gB_0 2024-09-14T11:22:51.250 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.242+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.124661353324075666', time=2024-09-14T13:15:12.237933+0000, chain.objs.size()=1 2024-09-14T11:22:51.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.242+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.302__shadow_.faGWMdWCwvq9IlucDC2fHkl9dDqBfMr_0 2024-09-14T11:22:51.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.242+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.34411843616052070', time=2024-09-14T13:15:24.716570+0000, chain.objs.size()=1 2024-09-14T11:22:51.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.242+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.pAasPvLHnBD45tcaVLshcorkLaATBAk_0 2024-09-14T11:22:51.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.242+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8354478948084846929', time=2024-09-14T13:15:24.723876+0000, chain.objs.size()=1 2024-09-14T11:22:51.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.242+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.L9OE3qxI2RKxx_tEdJHLDwZYxqJWe6O_0 2024-09-14T11:22:51.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.242+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9422449449913580719', time=2024-09-14T13:15:24.743313+0000, chain.objs.size()=1 2024-09-14T11:22:51.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.242+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.mffqnwzKvCH6bb4JFcwaQofetG_xI21_0 2024-09-14T11:22:51.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.242+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16335358301056134222', time=2024-09-14T13:15:24.789952+0000, chain.objs.size()=1 2024-09-14T11:22:51.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.242+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.7XFk1hkDA3R60vUmxI2V1xFODUpXlAm_0 2024-09-14T11:22:51.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.242+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14882005326545103627', time=2024-09-14T13:15:24.881557+0000, chain.objs.size()=1 2024-09-14T11:22:51.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.242+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.3iBZRlYhS4kZT9iYChkFnA9rWXIFL_G_0 2024-09-14T11:22:51.251 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.243+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13778072219483111565', time=2024-09-14T13:15:24.913208+0000, chain.objs.size()=1 2024-09-14T11:22:51.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.243+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.A70K3zC44b_aG6Ro6JWgi-OAep_qpnO_0 2024-09-14T11:22:51.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.244+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2133195183808071476', time=2024-09-14T13:15:24.920519+0000, chain.objs.size()=1 2024-09-14T11:22:51.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.244+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.lg_2MT_OD2MsTk0C0sAghhYSUtHxv_M_0 2024-09-14T11:22:51.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.244+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14426771538271381344', time=2024-09-14T13:15:24.930006+0000, chain.objs.size()=1 2024-09-14T11:22:51.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.244+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_._afR85SJfAPHOXICQ_Y4zb646AFwakT_0 2024-09-14T11:22:51.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.245+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.566871809784811719', time=2024-09-14T13:15:24.931993+0000, chain.objs.size()=1 2024-09-14T11:22:51.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.245+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.uNhgl7-KzGPJNscQRjvOA9-FedTB8Dm_0 2024-09-14T11:22:51.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.245+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4363856468844375531', time=2024-09-14T13:15:24.937666+0000, chain.objs.size()=1 2024-09-14T11:22:51.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.245+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.2n327iEOBJJo8VZtbwo7AqldfAn-AO9_0 2024-09-14T11:22:51.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.245+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.437626648956045452', time=2024-09-14T13:15:24.959195+0000, chain.objs.size()=1 2024-09-14T11:22:51.252 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.245+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.3dRDxGKWm8gziotFbt8ykSO3KF3gpcr_0 2024-09-14T11:22:51.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.245+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13048711873135045557', time=2024-09-14T13:15:25.056217+0000, chain.objs.size()=1 2024-09-14T11:22:51.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.245+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.awishGcAe1SPVUp8EO67P8kpwQ2P_la_0 2024-09-14T11:22:51.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.245+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11661826691958991922', time=2024-09-14T13:15:25.066530+0000, chain.objs.size()=1 2024-09-14T11:22:51.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.245+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.qOJTpOWiHPOwW09T7MJ6adxoFwwUj6i_0 2024-09-14T11:22:51.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.245+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6852621697256708361', time=2024-09-14T13:15:25.071759+0000, chain.objs.size()=1 2024-09-14T11:22:51.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.245+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.IHEmZKNad-BzVvgHASSu5e-7-L2lIL4_0 2024-09-14T11:22:51.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.245+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9933424114286357365', time=2024-09-14T13:15:25.107052+0000, chain.objs.size()=1 2024-09-14T11:22:51.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.245+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.1zQd6NEu4py89SEfywcfn1HGFSAtUZg_0 2024-09-14T11:22:51.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.245+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7950122297426405340', time=2024-09-14T13:15:25.108407+0000, chain.objs.size()=1 2024-09-14T11:22:51.253 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.245+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.Q8_oyhYVUiBXEHPRM_QpUoKx-YDiGFd_0 2024-09-14T11:22:51.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.245+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10641158512591272041', time=2024-09-14T13:15:25.121441+0000, chain.objs.size()=1 2024-09-14T11:22:51.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.245+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.UuR43fac6IXRvzrXf7zbMKFCdNbTnAb_0 2024-09-14T11:22:51.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.245+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1974820025447757255', time=2024-09-14T13:15:25.218274+0000, chain.objs.size()=1 2024-09-14T11:22:51.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.245+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.wY8bPdzG3XUgB1qSCLTidPWIacnpZrk_0 2024-09-14T11:22:51.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.245+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15042683949726468680', time=2024-09-14T13:15:25.220167+0000, chain.objs.size()=1 2024-09-14T11:22:51.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.245+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.hQ3gshdEBp8JSCSnYSPXzQC2trOr9MZ_0 2024-09-14T11:22:51.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.246+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6910088957560048878', time=2024-09-14T13:15:25.251386+0000, chain.objs.size()=1 2024-09-14T11:22:51.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.246+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.0IKJ1BtVs4EGn9Rd-Gx1UcnkidGVWGn_0 2024-09-14T11:22:51.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.247+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10539635295524450735', time=2024-09-14T13:15:25.372951+0000, chain.objs.size()=1 2024-09-14T11:22:51.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.247+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.4bXIV5sAXc4baWEHa8Q1NjU9pPwIfW7_0 2024-09-14T11:22:51.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.247+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6657710089329553861', time=2024-09-14T13:15:25.439041+0000, chain.objs.size()=1 2024-09-14T11:22:51.254 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.247+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.mTLFAYvP7m5z_fgLAXfYUa3k7y1_5WC_0 2024-09-14T11:22:51.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.248+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3238946115643621625', time=2024-09-14T13:15:25.588697+0000, chain.objs.size()=1 2024-09-14T11:22:51.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.248+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.aJjMrjyV31fr9FBLzvvirMkhrr4gfDD_0 2024-09-14T11:22:51.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.248+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14639636243544223681', time=2024-09-14T13:15:25.601248+0000, chain.objs.size()=1 2024-09-14T11:22:51.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.248+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.Jy7AHBYjbHggvpDPajDJ5lI3Ukg918e_0 2024-09-14T11:22:51.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.248+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1733569246865326118', time=2024-09-14T13:15:25.742274+0000, chain.objs.size()=1 2024-09-14T11:22:51.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.248+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.FnwMLrNipS2h1pufrNqFmN3XaKubUtm_0 2024-09-14T11:22:51.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.248+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13837530582076595447', time=2024-09-14T13:15:25.883259+0000, chain.objs.size()=1 2024-09-14T11:22:51.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.248+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.Jd55nc7LqFqLDZNpp3H8h4GKsQPoROK_0 2024-09-14T11:22:51.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.248+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1003988678640789060', time=2024-09-14T13:15:25.892795+0000, chain.objs.size()=1 2024-09-14T11:22:51.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.248+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.3uG8qCXucpZBZhdSz1yct9haK_OdS5P_0 2024-09-14T11:22:51.255 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.248+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6159540867078784353', time=2024-09-14T13:15:25.926393+0000, chain.objs.size()=1 2024-09-14T11:22:51.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.248+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.1XczWvvZwTHaOr9v0dcyqmBE2V0DNNG_0 2024-09-14T11:22:51.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.248+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2484689122227255029', time=2024-09-14T13:15:25.932075+0000, chain.objs.size()=1 2024-09-14T11:22:51.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.248+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.vBYEBnTa6yWJFBbkUJAXhVZl5g66LSi_0 2024-09-14T11:22:51.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.248+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18281697627881825332', time=2024-09-14T13:15:33.189880+0000, chain.objs.size()=1 2024-09-14T11:22:51.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.248+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.jHsh7rnWX5oZH_eZT0RLy0vI-705789_0 2024-09-14T11:22:51.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.248+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7638456411368604018', time=2024-09-14T13:15:33.190558+0000, chain.objs.size()=1 2024-09-14T11:22:51.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.248+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Xs66iGZ3DBGqnR1sicuFTrCFP3mszr1_0 2024-09-14T11:22:51.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.248+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4991730713375983045', time=2024-09-14T13:15:33.203544+0000, chain.objs.size()=1 2024-09-14T11:22:51.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.248+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.9VF5ko2Dhe94Ohtd9aKl4tOmIgJXYUW_0 2024-09-14T11:22:51.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.250+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12105180471218487846', time=2024-09-14T13:15:33.211460+0000, chain.objs.size()=1 2024-09-14T11:22:51.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.250+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.vB3dg08VbXHd5Tw_8i_zw5iFofulwOS_0 2024-09-14T11:22:51.256 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.250+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14208094172047046451', time=2024-09-14T13:15:33.235701+0000, chain.objs.size()=1 2024-09-14T11:22:51.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.250+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.tA3WrVjnFsmtoKlDcptl3zXn1NXWBhO_0 2024-09-14T11:22:51.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.250+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.243064050655028865', time=2024-09-14T13:15:33.370491+0000, chain.objs.size()=1 2024-09-14T11:22:51.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.250+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.hEsUrnpj5MW5NnBcyvBv4zNru-Y3ydc_0 2024-09-14T11:22:51.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.250+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3420503908618060013', time=2024-09-14T13:15:33.381659+0000, chain.objs.size()=1 2024-09-14T11:22:51.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.250+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.tYKrE5ij8zW1HtO2cDr5TxpCX7HKM8e_0 2024-09-14T11:22:51.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.251+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17106565008738948076', time=2024-09-14T13:15:33.386783+0000, chain.objs.size()=1 2024-09-14T11:22:51.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.251+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.pxsUU9UGWwfa9bvoVCikmrbIj7XYUlV_0 2024-09-14T11:22:51.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.251+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8336398677909832885', time=2024-09-14T13:15:33.410905+0000, chain.objs.size()=1 2024-09-14T11:22:51.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.251+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.XVYcKeNc2C1SLGrTnMxYBmDQspGMlZD_0 2024-09-14T11:22:51.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.251+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2813288704345624682', time=2024-09-14T13:15:33.426634+0000, chain.objs.size()=1 2024-09-14T11:22:51.257 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.251+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.9qgmSoyh8GOFGs12nvu7inkAXdV4M1V_0 2024-09-14T11:22:51.258 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.251+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8007710910832844434', time=2024-09-14T13:15:33.575894+0000, chain.objs.size()=1 2024-09-14T11:22:51.258 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.251+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.6-ay8TTAxl7pENNF8Pl2Rd_eVSdJXXk_0 2024-09-14T11:22:51.258 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.251+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16867101908318749425', time=2024-09-14T13:15:33.696263+0000, chain.objs.size()=1 2024-09-14T11:22:51.258 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.251+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.MPAItyV88ocVJ7u27XQH-eOdSCDRwHy_0 2024-09-14T11:22:51.258 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.251+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4636967723064514493', time=2024-09-14T13:15:33.701966+0000, chain.objs.size()=1 2024-09-14T11:22:51.258 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.251+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.gqcNv5wVT_d3C0Lc-lEAIXq-Fs8h033_0 2024-09-14T11:22:51.258 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.251+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9317221281312507668', time=2024-09-14T13:15:33.734689+0000, chain.objs.size()=1 2024-09-14T11:22:51.258 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.251+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.6aDoEEriNDD53X8C014298OAQXRu2kS_0 2024-09-14T11:22:51.261 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.251+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.148912489673659925', time=2024-09-14T13:15:33.866815+0000, chain.objs.size()=1 2024-09-14T11:22:51.261 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.251+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.HOwGgY-4iczaTVxwR0wj7vMEIky0JS9_0 2024-09-14T11:22:51.261 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.252+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16363892006431864960', time=2024-09-14T13:15:33.897229+0000, chain.objs.size()=1 2024-09-14T11:22:51.262 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.252+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.OkvlvLKZx5dfxNWZ0HuZRBCp0W9EGZp_0 2024-09-14T11:22:51.262 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.253+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5677659198804733665', time=2024-09-14T13:15:33.923859+0000, chain.objs.size()=1 2024-09-14T11:22:51.262 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.253+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.n_xX6ygs_LI6AnkRlvnE3WIHqZgaopZ_0 2024-09-14T11:22:51.262 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.253+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14454588332833334409', time=2024-09-14T13:15:34.039452+0000, chain.objs.size()=1 2024-09-14T11:22:51.262 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.253+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.-ajiHh7BbZz4KLhY8E9LOAQrJKM3xrv_0 2024-09-14T11:22:51.262 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.253+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11090888654491203009', time=2024-09-14T13:15:34.061225+0000, chain.objs.size()=1 2024-09-14T11:22:51.262 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.253+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.56R_oR_DU49y0y-czOQvOjHslTqvCbd_0 2024-09-14T11:22:51.262 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.253+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.284564462551801129', time=2024-09-14T13:15:34.081931+0000, chain.objs.size()=1 2024-09-14T11:22:51.262 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.253+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.-QEbCalcd_dNaSAx9qqmom5l4rfkvl4_0 2024-09-14T11:22:51.262 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.254+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17642815291732500285', time=2024-09-14T13:15:34.092259+0000, chain.objs.size()=1 2024-09-14T11:22:51.262 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.254+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Dw-ijtsoLNKT5fSUiXJscOYXqWAizzU_0 2024-09-14T11:22:51.263 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.254+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10434823424181209446', time=2024-09-14T13:15:34.099122+0000, chain.objs.size()=1 2024-09-14T11:22:51.263 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.254+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.x_gA4yijciKrtOQ4NV-evmQgp9_agch_0 2024-09-14T11:22:51.263 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.254+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1045085463532385456', time=2024-09-14T13:15:34.173859+0000, chain.objs.size()=1 2024-09-14T11:22:51.263 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.254+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.H3As2lhfjseTGFkPF3nEoX83p4mIYpY_0 2024-09-14T11:22:51.263 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.254+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6646866221366461337', time=2024-09-14T13:15:34.183556+0000, chain.objs.size()=1 2024-09-14T11:22:51.263 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.254+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.GPCBfS3kCS9r4Slqe6YyGEqjUqZLXbJ_0 2024-09-14T11:22:51.263 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.254+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5448027980381589047', time=2024-09-14T13:15:34.188674+0000, chain.objs.size()=1 2024-09-14T11:22:51.263 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.254+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.ItqaKRFBxrWTcjtPm5Cnqk9qv8UsTWT_0 2024-09-14T11:22:51.263 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.254+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1950447746450102007', time=2024-09-14T13:15:34.195340+0000, chain.objs.size()=1 2024-09-14T11:22:51.263 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.254+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.TRsRoxI-WjkhHy5uIiF2dcyt3wKuOXe_0 2024-09-14T11:22:51.263 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.254+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15731436782653680253', time=2024-09-14T13:15:34.257498+0000, chain.objs.size()=1 2024-09-14T11:22:51.263 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.254+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.aN1xozNA2-ihrJvrH8DtaxwINiDmIrg_0 2024-09-14T11:22:51.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.254+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10531040683028440352', time=2024-09-14T13:15:34.262329+0000, chain.objs.size()=1 2024-09-14T11:22:51.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.254+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.W0y0AobSZOAUDoeMzFXGvD0Uuog42VW_0 2024-09-14T11:22:51.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.254+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1890637870244968821', time=2024-09-14T13:15:34.350138+0000, chain.objs.size()=1 2024-09-14T11:22:51.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.254+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.1xnUTt4aubxMjDSOz-7WOGswnUGtfos_0 2024-09-14T11:22:51.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.254+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9475372771058123774', time=2024-09-14T13:15:34.358058+0000, chain.objs.size()=1 2024-09-14T11:22:51.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.254+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.BCfZs9C_fcF4QrYmyHE6I6-dr1xh8ZN_0 2024-09-14T11:22:51.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.255+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3881487783975075338', time=2024-09-14T13:15:34.369204+0000, chain.objs.size()=1 2024-09-14T11:22:51.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.255+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.PyljtQchEJAp4SBs3Q1fcIpllgVuuet_0 2024-09-14T11:22:51.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.257+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 0/45063 2024-09-14T11:22:51.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.259+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=25, truncated=0, next_marker='' 2024-09-14T11:22:51.264 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.259+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6906307005249537559', time=2024-09-14T13:15:34.379011+0000, chain.objs.size()=1 2024-09-14T11:22:51.265 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.259+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.a8HB_pmw7VdWeXe0dH5E0YHaq4ZPqXo_0 2024-09-14T11:22:51.265 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.259+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9405240366984887868', time=2024-09-14T13:15:34.382402+0000, chain.objs.size()=1 2024-09-14T11:22:51.265 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.259+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.qmQlMSG5B2_50Qd_Xln2NHZfWLjc_Yb_0 2024-09-14T11:22:51.265 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.259+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17363133798531029440', time=2024-09-14T13:15:34.385339+0000, chain.objs.size()=1 2024-09-14T11:22:51.265 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.259+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.E05vxk4ncDTi0pd9K9EmNNouNitH6bV_0 2024-09-14T11:22:51.265 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.259+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7996438736789370166', time=2024-09-14T13:15:36.010021+0000, chain.objs.size()=1 2024-09-14T11:22:51.265 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.259+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.331__shadow_.U481sQMz0ErwnFEUlMTRhuKQdP1jPg4_0 2024-09-14T11:22:51.265 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.259+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3223083884869121720', time=2024-09-14T13:15:36.187646+0000, chain.objs.size()=1 2024-09-14T11:22:51.265 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.259+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.332__shadow_.xyG0n3jIqM55cZ2Bvz7PWwFN2ZsdC-V_0 2024-09-14T11:22:51.265 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.259+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6599770247929008905', time=2024-09-14T13:15:39.116460+0000, chain.objs.size()=1 2024-09-14T11:22:51.266 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.259+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.343__shadow_.sSqlQLmT5y5Bv9p0fcKeghB9gGq_IQi_0 2024-09-14T11:22:51.266 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.259+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2103570067162048042', time=2024-09-14T13:15:47.169737+0000, chain.objs.size()=1 2024-09-14T11:22:51.266 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.259+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.377__shadow_.EskRsB4dkoKFUIBPRyQvS5gHHtPZlmd_0 2024-09-14T11:22:51.266 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.259+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7445102613155159272', time=2024-09-14T13:16:10.628398+0000, chain.objs.size()=1 2024-09-14T11:22:51.266 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.259+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.458__shadow_.WElPsREikc0B3RJKXvXtJ7uhGXJZ2RO_0 2024-09-14T11:22:51.266 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.259+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3425381990257359269', time=2024-09-14T13:16:11.846698+0000, chain.objs.size()=1 2024-09-14T11:22:51.266 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.259+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.461__shadow_.rEQmDnJOJZy1o8A1E-RrieLzC5hwLRM_0 2024-09-14T11:22:51.266 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.259+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12533258248672178323', time=2024-09-14T13:16:22.806939+0000, chain.objs.size()=1 2024-09-14T11:22:51.267 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.259+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.503__shadow:pymE41PAtqbkcQ6I2URloKvd5muPSJ-_.UInzhQl7TQvRYLWzEBL5Aj5TYH25pWP_0 2024-09-14T11:22:51.267 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.259+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7664306323150556265', time=2024-09-14T13:16:35.877720+0000, chain.objs.size()=2 2024-09-14T11:22:51.267 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.259+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.523__multipart_mymultipart.2~6dkDTyITF0ALfXtoBZd3D5OsvEfKvtl.1 2024-09-14T11:22:51.267 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.259+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.523__multipart_mymultipart.2~6dkDTyITF0ALfXtoBZd3D5OsvEfKvtl.2 2024-09-14T11:22:51.267 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.261+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='2~4MbORYWa3lA0CQEtGYLI5OXWQNBQBzE', time=2024-09-14T13:16:38.279799+0000, chain.objs.size()=10 2024-09-14T11:22:51.267 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.261+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.526__multipart_mymultipart.2~4MbORYWa3lA0CQEtGYLI5OXWQNBQBzE.1 2024-09-14T11:22:51.267 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.261+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.526__multipart_mymultipart.2~4MbORYWa3lA0CQEtGYLI5OXWQNBQBzE.2 2024-09-14T11:22:51.267 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.261+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.526__multipart_mymultipart.2~4MbORYWa3lA0CQEtGYLI5OXWQNBQBzE.3 2024-09-14T11:22:51.267 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.262+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.526__multipart_mymultipart.2~4MbORYWa3lA0CQEtGYLI5OXWQNBQBzE.4 2024-09-14T11:22:51.267 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.262+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.526__multipart_mymultipart.2~4MbORYWa3lA0CQEtGYLI5OXWQNBQBzE.5 2024-09-14T11:22:51.267 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.262+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.526__multipart_mymultipart.2~4MbORYWa3lA0CQEtGYLI5OXWQNBQBzE.6 2024-09-14T11:22:51.268 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.262+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.526__multipart_mymultipart.2~4MbORYWa3lA0CQEtGYLI5OXWQNBQBzE.7 2024-09-14T11:22:51.268 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.262+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.526__multipart_mymultipart.2~4MbORYWa3lA0CQEtGYLI5OXWQNBQBzE.8 2024-09-14T11:22:51.268 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.262+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.526__multipart_mymultipart.2~4MbORYWa3lA0CQEtGYLI5OXWQNBQBzE.9 2024-09-14T11:22:51.268 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.262+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.526__multipart_mymultipart.2~4MbORYWa3lA0CQEtGYLI5OXWQNBQBzE.10 2024-09-14T11:22:51.268 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.262+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9379527087771790905', time=2024-09-14T13:17:19.603485+0000, chain.objs.size()=1 2024-09-14T11:22:51.268 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.262+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.564__shadow_.LksnvmryKaJqEdZ3n87HT0juhTBzPNh_0 2024-09-14T11:22:51.268 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.262+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10180796280632921597', time=2024-09-14T13:17:24.661620+0000, chain.objs.size()=1 2024-09-14T11:22:51.268 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.262+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.569__shadow:XiI7uw0SuyhQ4m6w3HzlipDFEv3mQVP_.0NWfZP4sAfeO1Y3-WNzjDp8EBZAtH9a_0 2024-09-14T11:22:51.268 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.262+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4173543969362656063', time=2024-09-14T13:17:28.624091+0000, chain.objs.size()=1 2024-09-14T11:22:51.268 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.262+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.573__shadow_.lY-hx6SsgB8E4NpdzOUYHy3NoTEROAI_0 2024-09-14T11:22:51.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.263+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11153808323955009908', time=2024-09-14T13:17:29.100004+0000, chain.objs.size()=1 2024-09-14T11:22:51.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.263+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.574__shadow_.vaBn3Ni4fp35Ri7XxYs_OMfgADgvvRL_0 2024-09-14T11:22:51.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.263+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15160284197005600310', time=2024-09-14T13:17:46.006371+0000, chain.objs.size()=1 2024-09-14T11:22:51.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.263+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.577__shadow:qmSW.0-lmaRu5X8fv9TsTz-Zf5amX7b_.eh2TnR55Yn2lZKFsLs3pgHWiMIX8Pj0_0 2024-09-14T11:22:51.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.264+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7658480530233776808', time=2024-09-14T13:17:50.020974+0000, chain.objs.size()=1 2024-09-14T11:22:51.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.264+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.579__shadow:YvnLc6q6r7P5LkUm6it6lEfDLdJNSEB_.M7ZpHtXeT_Ni4e1ULVWIW8SJl_ECtAK_0 2024-09-14T11:22:51.270 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.264+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7177922753039092396', time=2024-09-14T13:17:53.436247+0000, chain.objs.size()=1 2024-09-14T11:22:51.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.264+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.587__shadow:HaFdcQBksEPTvlnuGt92G3Kv.Pg3wX._.Ep1-SKR3t2fPqqvmWqmzRM23yPuS4WW_0 2024-09-14T11:22:51.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.264+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11499433850163423766', time=2024-09-14T13:18:02.187234+0000, chain.objs.size()=6 2024-09-14T11:22:51.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.264+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.614__multipart_multipart_enc.2~Cp4Nl8nKsW6J3-tPwWvWKnStOsBvqTW.1 2024-09-14T11:22:51.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.264+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.614__multipart_multipart_enc.2~Cp4Nl8nKsW6J3-tPwWvWKnStOsBvqTW.2 2024-09-14T11:22:51.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.264+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.614__multipart_multipart_enc.2~Cp4Nl8nKsW6J3-tPwWvWKnStOsBvqTW.3 2024-09-14T11:22:51.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.264+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.614__multipart_multipart_enc.2~Cp4Nl8nKsW6J3-tPwWvWKnStOsBvqTW.4 2024-09-14T11:22:51.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.264+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.614__multipart_multipart_enc.2~Cp4Nl8nKsW6J3-tPwWvWKnStOsBvqTW.5 2024-09-14T11:22:51.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.265+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.614__multipart_multipart_enc.2~Cp4Nl8nKsW6J3-tPwWvWKnStOsBvqTW.6 2024-09-14T11:22:51.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.265+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5257024133931484418', time=2024-09-14T13:20:11.662599+0000, chain.objs.size()=1 2024-09-14T11:22:51.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.265+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.640__shadow_.JryhsyJClRS1QQ0iLIpDJKH0JsNwirT_0 2024-09-14T11:22:51.271 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.265+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8648376701010994110', time=2024-09-14T13:20:33.050389+0000, chain.objs.size()=1 2024-09-14T11:22:51.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.265+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.713__shadow:MyLgocR7-ijgTByPNzPbviDGrggTKzb_.Lyb1Lxpk8x01OJcdluOzw9ZZnHCMyFX_0 2024-09-14T11:22:51.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.265+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.85486549125525117', time=2024-09-14T13:20:53.348988+0000, chain.objs.size()=1 2024-09-14T11:22:51.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.265+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.718__shadow_.yHP2SD4BK5hKSNI1gr6463nCGvBH3D5_0 2024-09-14T11:22:51.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.266+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15537496843519042816', time=2024-09-14T13:20:58.307805+0000, chain.objs.size()=10 2024-09-14T11:22:51.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.266+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.735__multipart_foo.2~cvV7X3VXznCzazo05LPBbbc83sgPWWu.1 2024-09-14T11:22:51.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.267+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.735__multipart_foo.2~cvV7X3VXznCzazo05LPBbbc83sgPWWu.2 2024-09-14T11:22:51.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.267+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.735__multipart_foo.2~cvV7X3VXznCzazo05LPBbbc83sgPWWu.3 2024-09-14T11:22:51.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.267+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.735__multipart_foo.2~cvV7X3VXznCzazo05LPBbbc83sgPWWu.4 2024-09-14T11:22:51.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.269+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.735__multipart_foo.2~cvV7X3VXznCzazo05LPBbbc83sgPWWu.5 2024-09-14T11:22:51.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.269+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.735__multipart_foo.2~cvV7X3VXznCzazo05LPBbbc83sgPWWu.6 2024-09-14T11:22:51.272 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.269+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.735__multipart_foo.2~cvV7X3VXznCzazo05LPBbbc83sgPWWu.7 2024-09-14T11:22:51.273 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.269+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.735__multipart_foo.2~cvV7X3VXznCzazo05LPBbbc83sgPWWu.8 2024-09-14T11:22:51.273 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.269+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.735__multipart_foo.2~cvV7X3VXznCzazo05LPBbbc83sgPWWu.9 2024-09-14T11:22:51.273 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.269+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.735__multipart_foo.2~cvV7X3VXznCzazo05LPBbbc83sgPWWu.10 2024-09-14T11:22:51.273 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.269+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14859396123944474491', time=2024-09-14T13:21:07.089218+0000, chain.objs.size()=1 2024-09-14T11:22:51.273 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.269+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.757__shadow_.kRIYALeezCQ_f-cd9YlDpIxLQBcF0hv_0 2024-09-14T11:22:51.273 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.271+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:51.274 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.273+0000 7f0f19c16800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:22:51.274 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.274+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:51.274 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.275+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:51.275 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.276+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46674' 2024-09-14T11:22:51.275 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.276+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12209970120227041491', time=2024-09-14T13:13:37.754473+0000, chain.objs.size()=2 2024-09-14T11:22:51.275 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.276+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.164__multipart_foo.2~2AutKkolD-TZBBIWBXHSoflv-rPizcO.1 2024-09-14T11:22:51.275 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.276+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.164__multipart_foo.2~2AutKkolD-TZBBIWBXHSoflv-rPizcO.2 2024-09-14T11:22:51.275 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.276+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.30961033727909704', time=2024-09-14T13:14:45.626898+0000, chain.objs.size()=1 2024-09-14T11:22:51.275 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.276+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.235__shadow_.xT2a7sl5qY7qaFb5SPSHWBqcfdMEcnS_0 2024-09-14T11:22:51.275 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.276+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5275824246258394480', time=2024-09-14T13:14:46.213904+0000, chain.objs.size()=1 2024-09-14T11:22:51.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.276+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.237__shadow_.Yu2PXEY_gJXe2R9XDfIlwovwm7mYU0Q_0 2024-09-14T11:22:51.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.276+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16659722705188371006', time=2024-09-14T13:14:46.215080+0000, chain.objs.size()=1 2024-09-14T11:22:51.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.276+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.237__shadow_.1D93yes2F84TOkn1V1sj58fxXJLD1sf_0 2024-09-14T11:22:51.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.276+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.650610989331640772', time=2024-09-14T13:14:49.565651+0000, chain.objs.size()=1 2024-09-14T11:22:51.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.276+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.249__shadow_.3uWu7c1jc11d7DXwMfTA-cvrTnka1fs_0 2024-09-14T11:22:51.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.276+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5429231269695413343', time=2024-09-14T13:14:51.353615+0000, chain.objs.size()=1 2024-09-14T11:22:51.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.276+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.256__shadow_.OzHqdZWtTO78x28lfDzbvLGJXk6ii21_0 2024-09-14T11:22:51.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.276+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12481662909595347703', time=2024-09-14T13:14:52.080625+0000, chain.objs.size()=1 2024-09-14T11:22:51.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.276+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.259__shadow_.kcWjomrr-gFMMwe_Xkcy-zW1yVgN4I2_0 2024-09-14T11:22:51.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.276+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1145744111949281715', time=2024-09-14T13:14:59.736984+0000, chain.objs.size()=1 2024-09-14T11:22:51.276 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.276+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.VCIFvc3SSf3Ovsj4Aq2jIov776-o4U-_0 2024-09-14T11:22:51.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.276+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.526545683348330680', time=2024-09-14T13:14:59.756047+0000, chain.objs.size()=1 2024-09-14T11:22:51.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.276+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.ggT9t31HBdbwdXjhqba9snQL_Yukxsv_0 2024-09-14T11:22:51.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.276+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17125872762255475061', time=2024-09-14T13:14:59.775889+0000, chain.objs.size()=1 2024-09-14T11:22:51.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.276+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.0tYEfjW1d5AcAwQYrT4iQ8pp83zQa2N_0 2024-09-14T11:22:51.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.276+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1193396120499059425', time=2024-09-14T13:14:59.797923+0000, chain.objs.size()=1 2024-09-14T11:22:51.277 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.276+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.r-RXlIdfjH8Xz5mNlBqsVOP90A_iLDr_0 2024-09-14T11:22:51.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.278+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4199916685834907060', time=2024-09-14T13:14:59.820999+0000, chain.objs.size()=1 2024-09-14T11:22:51.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.278+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.uwLqppEGgo68n3-j3JmBGgbSRgX8r0X_0 2024-09-14T11:22:51.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.278+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11263705373291235961', time=2024-09-14T13:14:59.822349+0000, chain.objs.size()=1 2024-09-14T11:22:51.278 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.278+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.UQk1vZ1e_zx6e5tIfEPZNSX8P2eCkz5_0 2024-09-14T11:22:51.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.278+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8266478584321399177', time=2024-09-14T13:14:59.899510+0000, chain.objs.size()=1 2024-09-14T11:22:51.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.278+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.lG1MgCEPBOqNdR7-rdecP-W3t5pfio7_0 2024-09-14T11:22:51.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.278+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5577821056623484605', time=2024-09-14T13:14:59.902971+0000, chain.objs.size()=1 2024-09-14T11:22:51.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.278+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.zu0EIgfAZ187qdEw7IJotobKpFXuRhM_0 2024-09-14T11:22:51.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.278+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3639307361036508701', time=2024-09-14T13:14:59.922072+0000, chain.objs.size()=1 2024-09-14T11:22:51.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.278+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.mJgIMKvN3Ue98LIvigX9tGxcao6Klzp_0 2024-09-14T11:22:51.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.278+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5791571599390738501', time=2024-09-14T13:14:59.923858+0000, chain.objs.size()=1 2024-09-14T11:22:51.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.278+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.2ryLe_ZE5s93IbavUcCjbR3jCI2gW-n_0 2024-09-14T11:22:51.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.278+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14352887880406626560', time=2024-09-14T13:14:59.976302+0000, chain.objs.size()=1 2024-09-14T11:22:51.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.278+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.xdjXi4EjXtgEeNsHy0HEMWVw0Xg0OjX_0 2024-09-14T11:22:51.279 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.278+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16593822116115575377', time=2024-09-14T13:14:59.986760+0000, chain.objs.size()=1 2024-09-14T11:22:51.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.278+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.qqMZClyiWpYRpN_FdhcI1k2pS9mhZri_0 2024-09-14T11:22:51.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.278+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12698280238765014738', time=2024-09-14T13:14:59.987428+0000, chain.objs.size()=1 2024-09-14T11:22:51.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.278+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.tKsJJr46N-MFA90NX43d2Ory1qbOucl_0 2024-09-14T11:22:51.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.278+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14886605388480739791', time=2024-09-14T13:15:00.079368+0000, chain.objs.size()=1 2024-09-14T11:22:51.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.278+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.4yEETclzI1AE5YvFepsTtcPCGjgLIuf_0 2024-09-14T11:22:51.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.278+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8438993182020201824', time=2024-09-14T13:15:00.092159+0000, chain.objs.size()=1 2024-09-14T11:22:51.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.278+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.sZr3PXGFvECwcGfvwyS8_FA5vkbkR6k_0 2024-09-14T11:22:51.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.279+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.792802466164630524', time=2024-09-14T13:15:00.097631+0000, chain.objs.size()=1 2024-09-14T11:22:51.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.279+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.ro4TyhO0s3iPo05Lzfs8jkC19ZzJ_mj_0 2024-09-14T11:22:51.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.279+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4855408280118879364', time=2024-09-14T13:15:00.107430+0000, chain.objs.size()=1 2024-09-14T11:22:51.280 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.279+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.f_5HYF0LpY4jtOgfPJFMYEdzPAm7nXC_0 2024-09-14T11:22:51.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.280+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6795765392242294950', time=2024-09-14T13:15:00.109343+0000, chain.objs.size()=1 2024-09-14T11:22:51.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.280+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.YiMvEUrWWmSB4VMLQohZIkG1fJ7iNgC_0 2024-09-14T11:22:51.282 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.280+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9994125967689697237', time=2024-09-14T13:15:00.121381+0000, chain.objs.size()=1 2024-09-14T11:22:51.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.280+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.RnUzrmrvUjT6TkzMfhdrFtEqZucytjq_0 2024-09-14T11:22:51.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.280+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17116334095675272742', time=2024-09-14T13:15:00.132588+0000, chain.objs.size()=1 2024-09-14T11:22:51.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.280+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.o56NT3Q6uuB7jv8pvebkEN5XCYYFIdr_0 2024-09-14T11:22:51.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.280+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9676317903915877327', time=2024-09-14T13:15:00.225426+0000, chain.objs.size()=1 2024-09-14T11:22:51.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.280+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.8uKx6lil0UwrLNu_XBE2O37PPklTPHy_0 2024-09-14T11:22:51.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.280+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8874869010364306435', time=2024-09-14T13:15:00.226383+0000, chain.objs.size()=1 2024-09-14T11:22:51.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.280+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.wn-WpXgzNOvezXS-stK9nclOlD3pBw1_0 2024-09-14T11:22:51.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.280+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7060520649184257717', time=2024-09-14T13:15:00.227431+0000, chain.objs.size()=1 2024-09-14T11:22:51.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.281+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.613cH6CJbxpf1s0FASD91fkxhQGjs3g_0 2024-09-14T11:22:51.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.281+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15959389458887630651', time=2024-09-14T13:15:00.230657+0000, chain.objs.size()=1 2024-09-14T11:22:51.283 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.281+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.SAkiDfppsI2gzNaOODojvEzsrIcZn0V_0 2024-09-14T11:22:51.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.281+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4132534424529462339', time=2024-09-14T13:15:00.239183+0000, chain.objs.size()=1 2024-09-14T11:22:51.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.281+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.DhIz-pGzUFrFbjfdysUW5Zgo4rUpM6i_0 2024-09-14T11:22:51.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.281+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9688636617207678856', time=2024-09-14T13:15:00.271322+0000, chain.objs.size()=1 2024-09-14T11:22:51.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.281+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.rUmdCHa4dQJrpDjrCME6qPuNhm2Uiak_0 2024-09-14T11:22:51.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.281+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3938887509684169911', time=2024-09-14T13:15:00.315896+0000, chain.objs.size()=1 2024-09-14T11:22:51.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.281+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.sN698kMRZfl_Sv8ZMwd68g5e7GWLaZY_0 2024-09-14T11:22:51.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.281+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8514855621964984305', time=2024-09-14T13:15:00.391201+0000, chain.objs.size()=1 2024-09-14T11:22:51.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.281+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.9B3BHjrZQ4oIPx9P3MtX5tgRLx7fvfZ_0 2024-09-14T11:22:51.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.282+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8054576083806594338', time=2024-09-14T13:15:00.400166+0000, chain.objs.size()=1 2024-09-14T11:22:51.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.282+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Ku6HpoN-G-POSERuVI8zgZoO2A50gT__0 2024-09-14T11:22:51.284 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.282+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16232574600008338724', time=2024-09-14T13:15:00.401190+0000, chain.objs.size()=1 2024-09-14T11:22:51.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.282+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.kMeDdeBJkmJc30vKGVL5ppBvn6zxfMf_0 2024-09-14T11:22:51.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.282+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10412245298059618867', time=2024-09-14T13:15:00.402786+0000, chain.objs.size()=1 2024-09-14T11:22:51.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.282+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.jMt78nkvmPEbEF4W46KqtIp9VZfiCoh_0 2024-09-14T11:22:51.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.282+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16480428216628978285', time=2024-09-14T13:15:00.441211+0000, chain.objs.size()=1 2024-09-14T11:22:51.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.282+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.ZYO9JERGDDYQTp1uMS7ofGlvpcK4Qkr_0 2024-09-14T11:22:51.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.282+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16720064521550746810', time=2024-09-14T13:15:00.470925+0000, chain.objs.size()=1 2024-09-14T11:22:51.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.282+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.AQLYqjA-Qw2_vZ_dw4YaFQQjb7PIjX0_0 2024-09-14T11:22:51.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.283+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3510123994533277509', time=2024-09-14T13:15:00.551689+0000, chain.objs.size()=1 2024-09-14T11:22:51.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.283+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.z8nPAduTaRP_BbjEAsQNInaZyKi2OEg_0 2024-09-14T11:22:51.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.283+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11153274700157412138', time=2024-09-14T13:15:00.552989+0000, chain.objs.size()=1 2024-09-14T11:22:51.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.283+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Gkq0q3h4sRdYAPHAxOFjTi0jx1Ghpmz_0 2024-09-14T11:22:51.285 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.283+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4701431277849093894', time=2024-09-14T13:15:00.591204+0000, chain.objs.size()=1 2024-09-14T11:22:51.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.283+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.tcje55zbZ09Am5Mnc1lY3AWX_rX-u-W_0 2024-09-14T11:22:51.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.283+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12000016285245911477', time=2024-09-14T13:15:00.607672+0000, chain.objs.size()=1 2024-09-14T11:22:51.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.283+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.w4cxYRd5ibNek3bhG7rR043jUJOtOru_0 2024-09-14T11:22:51.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.283+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4808674263587795982', time=2024-09-14T13:15:00.622173+0000, chain.objs.size()=1 2024-09-14T11:22:51.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.283+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.SyaNAVWCepYHmEiFbtU_d8FsNRiryHU_0 2024-09-14T11:22:51.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.283+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15022324137885450224', time=2024-09-14T13:15:00.633926+0000, chain.objs.size()=1 2024-09-14T11:22:51.286 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.283+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.IsrXewa9jmUJiqrgfcZGcCXDKkJGfe9_0 2024-09-14T11:22:51.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.284+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.619406768357415636', time=2024-09-14T13:15:00.732727+0000, chain.objs.size()=1 2024-09-14T11:22:51.289 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.284+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.61GkyP2FXHiNv8ITVvTYOT6jWqFW34w_0 2024-09-14T11:22:51.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.284+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6293758930281851638', time=2024-09-14T13:15:00.752257+0000, chain.objs.size()=1 2024-09-14T11:22:51.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.284+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.ljwOIAulYu8XQgVLTBCt7CSr72OJoJd_0 2024-09-14T11:22:51.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.284+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10901797271012119725', time=2024-09-14T13:15:00.895440+0000, chain.objs.size()=1 2024-09-14T11:22:51.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.284+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.OhJqy-TS51AEwyBpAoGB8q2mRYoL4Tr_0 2024-09-14T11:22:51.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.284+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11628917310527474437', time=2024-09-14T13:15:00.935686+0000, chain.objs.size()=1 2024-09-14T11:22:51.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.284+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.zrYZluKDJ1rlA0sdcSY__mpOwslOPLF_0 2024-09-14T11:22:51.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.284+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9937467056621939486', time=2024-09-14T13:15:01.676761+0000, chain.objs.size()=1 2024-09-14T11:22:51.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.284+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.265__shadow_.ITAiInYFTg6Fy_TkT9ltEhDCvZ8bmr4_0 2024-09-14T11:22:51.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.285+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1098821557763427651', time=2024-09-14T13:15:02.648530+0000, chain.objs.size()=1 2024-09-14T11:22:51.290 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.285+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.269__shadow_.ffAuNyS_9k5gMV8ji16oEIQyBQk-KSj_0 2024-09-14T11:22:51.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.285+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4821462568656188180', time=2024-09-14T13:15:07.297140+0000, chain.objs.size()=1 2024-09-14T11:22:51.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.285+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.286__shadow_.-uwFg-ETKPqZzOfuZSMBDsVkHD5Yo4X_0 2024-09-14T11:22:51.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.285+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11397884712766134750', time=2024-09-14T13:15:09.825979+0000, chain.objs.size()=1 2024-09-14T11:22:51.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.285+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.293__shadow_.MAIdIIGG5XPr8DCOKzH8xBMbF5WHlwx_0 2024-09-14T11:22:51.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.285+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4881152502666020410', time=2024-09-14T13:15:10.860820+0000, chain.objs.size()=1 2024-09-14T11:22:51.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.285+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.297__shadow_.JU_TJmv3cDi_cA8s4kxstbuNQ3mY1_C_0 2024-09-14T11:22:51.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.285+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10041421342986728884', time=2024-09-14T13:15:11.152278+0000, chain.objs.size()=1 2024-09-14T11:22:51.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.285+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.298__shadow_.-QriE_dsHXxImNI4wxnszRouCjmHYTq_0 2024-09-14T11:22:51.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.285+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.21065471899906056', time=2024-09-14T13:15:16.604046+0000, chain.objs.size()=1 2024-09-14T11:22:51.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.285+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.319__shadow:J0IlMw6WjDukB.BYWyfYmu1DdlZbpmN_.sHMyRAGSHslb6J4P3hJwyv34RaIENLm_0 2024-09-14T11:22:51.291 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.286+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16694585541079573506', time=2024-09-14T13:15:24.736215+0000, chain.objs.size()=1 2024-09-14T11:22:51.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.286+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.y9FHv3BA1k2uuetmbQgNKTkJxetLymY_0 2024-09-14T11:22:51.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.286+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14013101734350324678', time=2024-09-14T13:15:24.750836+0000, chain.objs.size()=1 2024-09-14T11:22:51.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.286+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.CFUjq3XocMzjoZmloSmgozwNX1sDrcj_0 2024-09-14T11:22:51.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.286+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1112478339932569356', time=2024-09-14T13:15:24.767071+0000, chain.objs.size()=1 2024-09-14T11:22:51.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.286+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.BMHOEaCnvtkACBZNb_dNr_DXg42_7a3_0 2024-09-14T11:22:51.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.286+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3900947939156250374', time=2024-09-14T13:15:24.790342+0000, chain.objs.size()=1 2024-09-14T11:22:51.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.286+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.MGBRC8Gu7oywC6NTHmO9GZUC3nxWXKc_0 2024-09-14T11:22:51.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.286+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13371658716513173917', time=2024-09-14T13:15:24.935221+0000, chain.objs.size()=1 2024-09-14T11:22:51.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.286+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.zqb2CtxP5YMyaQ_JrF3InQOzwCjCzMP_0 2024-09-14T11:22:51.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.286+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18074317855663826868', time=2024-09-14T13:15:25.055746+0000, chain.objs.size()=1 2024-09-14T11:22:51.292 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.286+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.OiGnZNXrUnPIvuvP7x1e9IwVc23qv7Y_0 2024-09-14T11:22:51.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.286+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17576725793487338799', time=2024-09-14T13:15:25.065028+0000, chain.objs.size()=1 2024-09-14T11:22:51.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.286+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.V6CMgA2myVqzamacFPAufyLvu2xPOcu_0 2024-09-14T11:22:51.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.287+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13000817963691723762', time=2024-09-14T13:15:25.074656+0000, chain.objs.size()=1 2024-09-14T11:22:51.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.287+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.z3SxT4NXqoJMpNEYhwxrartM6KFUjeO_0 2024-09-14T11:22:51.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.287+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6588251079120916036', time=2024-09-14T13:15:25.075919+0000, chain.objs.size()=1 2024-09-14T11:22:51.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.287+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.WDdcPp8IPdcONreCALXh7pkhYGNRVux_0 2024-09-14T11:22:51.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.287+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4428179832651882639', time=2024-09-14T13:15:25.093142+0000, chain.objs.size()=1 2024-09-14T11:22:51.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.287+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.DpVm3A7VmhvZI5O1TLdQl1nERQWZGK7_0 2024-09-14T11:22:51.293 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.287+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8975471194551791965', time=2024-09-14T13:15:25.102286+0000, chain.objs.size()=1 2024-09-14T11:22:51.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.287+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.wqXVepLE3QoqIiUXjfPeREdCDt1saOL_0 2024-09-14T11:22:51.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.288+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.468823862636292449', time=2024-09-14T13:15:25.117039+0000, chain.objs.size()=1 2024-09-14T11:22:51.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.288+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.258H8LvAPWuYnqXYZtzkV6Du_qA7c8C_0 2024-09-14T11:22:51.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.288+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8082671896659921140', time=2024-09-14T13:15:25.131928+0000, chain.objs.size()=1 2024-09-14T11:22:51.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.288+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.Fb7-FEw_cMVf2w34-VgFS3sGtYgeRtR_0 2024-09-14T11:22:51.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.288+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.946878809657871321', time=2024-09-14T13:15:25.208403+0000, chain.objs.size()=1 2024-09-14T11:22:51.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.288+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.jD3IlSVrnBeE_tpHFxVid6wk-62LfSv_0 2024-09-14T11:22:51.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.288+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15743650180375749403', time=2024-09-14T13:15:25.251511+0000, chain.objs.size()=1 2024-09-14T11:22:51.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.288+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.0bdngExaecOTPZv1jWpK3iR7NafxrS7_0 2024-09-14T11:22:51.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.288+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8730812130885205574', time=2024-09-14T13:15:25.289817+0000, chain.objs.size()=1 2024-09-14T11:22:51.294 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.288+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.Y1oiHOT2-KncMn3fjgmn61W8k7mvq1e_0 2024-09-14T11:22:51.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.288+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2721911765489710674', time=2024-09-14T13:15:25.365204+0000, chain.objs.size()=1 2024-09-14T11:22:51.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.288+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.Jie8n_rLmbAcmjBdD2Mvg-8IaPcDdx__0 2024-09-14T11:22:51.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.288+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17616734347556813392', time=2024-09-14T13:15:25.366781+0000, chain.objs.size()=1 2024-09-14T11:22:51.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.288+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.jFr8pUWE3LqZUh3gkVnCylY_W1im-DH_0 2024-09-14T11:22:51.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.289+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17080473223980974439', time=2024-09-14T13:15:25.367601+0000, chain.objs.size()=1 2024-09-14T11:22:51.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.289+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.BOgKFzN-pjPU45G-ex7hwR3c1y76rPf_0 2024-09-14T11:22:51.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.289+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7420552383679949826', time=2024-09-14T13:15:25.427215+0000, chain.objs.size()=1 2024-09-14T11:22:51.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.289+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.a_cizbhJ_Fnm3X3S6ZLZEf5vGTsuCLr_0 2024-09-14T11:22:51.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.289+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14578192132379259377', time=2024-09-14T13:15:25.431015+0000, chain.objs.size()=1 2024-09-14T11:22:51.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.289+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.OvxL-kTnzgZRDoSiXv9hko-RRe5ucWD_0 2024-09-14T11:22:51.295 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.289+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1772859165678176085', time=2024-09-14T13:15:25.431708+0000, chain.objs.size()=1 2024-09-14T11:22:51.296 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.289+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.0rgjwmzBMoMMITKGQP0yZbLiEy4wEs5_0 2024-09-14T11:22:51.296 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.290+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3626696613453087802', time=2024-09-14T13:15:25.548801+0000, chain.objs.size()=1 2024-09-14T11:22:51.296 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.290+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.GeRB34oLKH0zkDfoViBVv6yBIkgV5YZ_0 2024-09-14T11:22:51.296 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.290+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3128161609597625645', time=2024-09-14T13:15:25.568085+0000, chain.objs.size()=1 2024-09-14T11:22:51.296 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.290+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.E34PTBR6oyqaCtLDWg36ZmuBHFrZHsi_0 2024-09-14T11:22:51.296 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.290+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1022462733826402873', time=2024-09-14T13:15:25.691299+0000, chain.objs.size()=1 2024-09-14T11:22:51.296 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.290+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.7F40hR7VXy2zm17Mpi_4R5HBXVH16jW_0 2024-09-14T11:22:51.296 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.290+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1719297796378990876', time=2024-09-14T13:15:25.738123+0000, chain.objs.size()=1 2024-09-14T11:22:51.296 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.290+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.53bpa1saBGhMmt8ybcE8MSrmar60ucA_0 2024-09-14T11:22:51.296 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.290+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13744519599388373831', time=2024-09-14T13:15:25.943958+0000, chain.objs.size()=1 2024-09-14T11:22:51.296 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.290+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.kSa6IcfcRlTM8uQIYcyeFDXQULdB0h9_0 2024-09-14T11:22:51.297 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.290+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1913971302340919454', time=2024-09-14T13:15:33.230183+0000, chain.objs.size()=1 2024-09-14T11:22:51.297 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.290+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.t_1ZOecfcR16R5-DBiN3tVScv0Ctmsx_0 2024-09-14T11:22:51.297 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.290+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10547617181043660287', time=2024-09-14T13:15:33.237097+0000, chain.objs.size()=1 2024-09-14T11:22:51.297 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.290+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.uCN91Li-KWC3S2ucZKJuSYLW7jSgM0g_0 2024-09-14T11:22:51.297 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.290+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4348870697429825740', time=2024-09-14T13:15:33.239776+0000, chain.objs.size()=1 2024-09-14T11:22:51.297 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.290+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.w6vDuQh1Jl55yKex6xBOomk1w9xo-BO_0 2024-09-14T11:22:51.297 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.290+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1685088212945637770', time=2024-09-14T13:15:33.366091+0000, chain.objs.size()=1 2024-09-14T11:22:51.297 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.290+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.h1QyOMEqX39DfFQ-9US6ciKCli7tTHb_0 2024-09-14T11:22:51.300 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.292+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1866711680778946610', time=2024-09-14T13:15:33.392802+0000, chain.objs.size()=1 2024-09-14T11:22:51.300 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.292+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.H6-DB8-4pkkyjkm9e5T4g6CJ1CmZz3C_0 2024-09-14T11:22:51.300 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.292+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4516737754105460040', time=2024-09-14T13:15:33.546389+0000, chain.objs.size()=1 2024-09-14T11:22:51.300 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.292+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.ewa7C4F3RSHWCSQvNuteJ-Nk9cvW0Jx_0 2024-09-14T11:22:51.300 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.292+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8890363705026260396', time=2024-09-14T13:15:33.566755+0000, chain.objs.size()=1 2024-09-14T11:22:51.301 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.292+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.ee7D_6kiQ2lJzJXpfT7Opr4cgbx-HrM_0 2024-09-14T11:22:51.301 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.292+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4513595245824885325', time=2024-09-14T13:15:33.592512+0000, chain.objs.size()=1 2024-09-14T11:22:51.301 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.292+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Nm3U8Qq3zlJmpF-hrqqdkE7JOJEeu-t_0 2024-09-14T11:22:51.301 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.292+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13709497756121113046', time=2024-09-14T13:15:33.723798+0000, chain.objs.size()=1 2024-09-14T11:22:51.301 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.292+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.5AdI8TouCLeFJj_hS5SHwvSM3f6fKqz_0 2024-09-14T11:22:51.301 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.293+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8507779513481909223', time=2024-09-14T13:15:33.733496+0000, chain.objs.size()=1 2024-09-14T11:22:51.301 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.293+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.7WKSnYzX1ZwYYnSGvhE8eCS54RRDeZL_0 2024-09-14T11:22:51.301 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.293+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2648513444874867955', time=2024-09-14T13:15:33.763437+0000, chain.objs.size()=1 2024-09-14T11:22:51.301 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.293+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.-4MctLi1BOQX8nUwdrXGBwQqO5Nrzwh_0 2024-09-14T11:22:51.301 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.293+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11669739814513696414', time=2024-09-14T13:15:33.769950+0000, chain.objs.size()=1 2024-09-14T11:22:51.301 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.293+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.9X0kfLOh4882VsRhQQyHBuXPGaVwLUH_0 2024-09-14T11:22:51.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.293+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4065615398399267407', time=2024-09-14T13:15:33.856878+0000, chain.objs.size()=1 2024-09-14T11:22:51.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.293+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.dfNCoOAwwNpvrmjMwrVFPjJgXAiWt3G_0 2024-09-14T11:22:51.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.293+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8785328476455886677', time=2024-09-14T13:15:33.887232+0000, chain.objs.size()=1 2024-09-14T11:22:51.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.293+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.sZJakRsxwIgdB7e0_8JqxnPpbOF1tsC_0 2024-09-14T11:22:51.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.293+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7548292524651158791', time=2024-09-14T13:15:33.925705+0000, chain.objs.size()=1 2024-09-14T11:22:51.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.293+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Q-nTFpBlKPLe3_TAkbeXrwI1h5JYYV1_0 2024-09-14T11:22:51.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.293+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16167799412843005875', time=2024-09-14T13:15:34.011563+0000, chain.objs.size()=1 2024-09-14T11:22:51.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.293+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.2sY4xCRFkyQsRD_JceWlN0DAKpDmW9q_0 2024-09-14T11:22:51.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.295+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 0/46674 2024-09-14T11:22:51.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.297+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=35, truncated=0, next_marker='' 2024-09-14T11:22:51.302 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.297+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.915535327574270041', time=2024-09-14T13:15:34.053735+0000, chain.objs.size()=1 2024-09-14T11:22:51.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.297+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_._rv9yp90CE8lkbzAqCVa9SMpBJGKC9H_0 2024-09-14T11:22:51.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.297+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.990340323263441733', time=2024-09-14T13:15:34.059674+0000, chain.objs.size()=1 2024-09-14T11:22:51.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.297+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.fWZzAYgo0JB05Xi3cTSEAUueO40hnuO_0 2024-09-14T11:22:51.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.297+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6725427732223261757', time=2024-09-14T13:15:34.091992+0000, chain.objs.size()=1 2024-09-14T11:22:51.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.297+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.a-9bzVztl8Elf1EEJYqof8vJJUT6vl2_0 2024-09-14T11:22:51.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.297+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3690113272504264744', time=2024-09-14T13:15:34.092777+0000, chain.objs.size()=1 2024-09-14T11:22:51.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.297+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.nb6x0rBsmeydxeUTnzJibIh5gr9QQYE_0 2024-09-14T11:22:51.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.297+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10143479268338876725', time=2024-09-14T13:15:34.198070+0000, chain.objs.size()=1 2024-09-14T11:22:51.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.297+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.ygCEXU0aifEQepMbG59cOn67_smxWw0_0 2024-09-14T11:22:51.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.297+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14649704247511102776', time=2024-09-14T13:15:34.219165+0000, chain.objs.size()=1 2024-09-14T11:22:51.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.297+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.7kSqnQ-LJUmZYFV561NeyUdW4d72QPM_0 2024-09-14T11:22:51.303 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.297+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3383595608610263713', time=2024-09-14T13:15:34.236116+0000, chain.objs.size()=1 2024-09-14T11:22:51.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.297+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.HkfN4cGsOSn0d3IerJXldzn1U_jhpYK_0 2024-09-14T11:22:51.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.297+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18094602908719058682', time=2024-09-14T13:15:34.251693+0000, chain.objs.size()=1 2024-09-14T11:22:51.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.297+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.yLVsCzPZBPmwABlgy95FSz-yO7KAalh_0 2024-09-14T11:22:51.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.297+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6423136699263590655', time=2024-09-14T13:15:34.343697+0000, chain.objs.size()=1 2024-09-14T11:22:51.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.297+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.DvPQoxwDxDXDArHRq_v62Mzg51XeqZJ_0 2024-09-14T11:22:51.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.297+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12538845669038657974', time=2024-09-14T13:15:34.368401+0000, chain.objs.size()=1 2024-09-14T11:22:51.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.297+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.qOn6nVSJsTsYdFer2ptknuYyJwVcQdP_0 2024-09-14T11:22:51.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.297+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12246313981953239924', time=2024-09-14T13:16:02.661406+0000, chain.objs.size()=1 2024-09-14T11:22:51.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.297+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.431__shadow_.eAGTKSFUMt_6hMOVGMmKBBKQle7AJpM_0 2024-09-14T11:22:51.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.297+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3767378174127470606', time=2024-09-14T13:16:09.452928+0000, chain.objs.size()=1 2024-09-14T11:22:51.304 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.297+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.455__shadow_.OKrzWnZrt8_2abQeNU7HiZyQJDiA2fC_0 2024-09-14T11:22:51.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.298+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13456525688135453133', time=2024-09-14T13:16:12.635973+0000, chain.objs.size()=1 2024-09-14T11:22:51.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.298+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.463__shadow_.GasXnltMUclGkjTuZnJYcIbkJrhBAN1_0 2024-09-14T11:22:51.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.298+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1260392718640617623', time=2024-09-14T13:16:16.975376+0000, chain.objs.size()=1 2024-09-14T11:22:51.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.298+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.483__shadow_.fvBKAMhT6oE2XdtcV6oxOa8SlvYRwzk_0 2024-09-14T11:22:51.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.299+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10150712812227678496', time=2024-09-14T13:16:16.976326+0000, chain.objs.size()=1 2024-09-14T11:22:51.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.299+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.483__shadow_.qD2qJycG9f7kQVDqv93wDFcI1RU47wW_0 2024-09-14T11:22:51.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.299+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5131747274765055351', time=2024-09-14T13:16:26.183631+0000, chain.objs.size()=1 2024-09-14T11:22:51.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.299+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.514__shadow_.H7QJN2F28gb8Poy20TMk9RJZhXg7_fe_0 2024-09-14T11:22:51.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.299+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='2~V9xFUJuXLDyiMDod3XrNKlJiw9L1BRA', time=2024-09-14T13:16:34.945606+0000, chain.objs.size()=1 2024-09-14T11:22:51.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.299+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.522__multipart_mymultipart.2~V9xFUJuXLDyiMDod3XrNKlJiw9L1BRA.1 2024-09-14T11:22:51.305 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.299+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='2~V9xFUJuXLDyiMDod3XrNKlJiw9L1BRA', time=2024-09-14T13:16:34.947287+0000, chain.objs.size()=1 2024-09-14T11:22:51.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.299+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.522__multipart_mymultipart.2~V9xFUJuXLDyiMDod3XrNKlJiw9L1BRA.2 2024-09-14T11:22:51.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.300+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='2~V9xFUJuXLDyiMDod3XrNKlJiw9L1BRA', time=2024-09-14T13:16:34.949073+0000, chain.objs.size()=1 2024-09-14T11:22:51.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.300+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.522__multipart_mymultipart.2~V9xFUJuXLDyiMDod3XrNKlJiw9L1BRA.3 2024-09-14T11:22:51.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.300+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='2~V9xFUJuXLDyiMDod3XrNKlJiw9L1BRA', time=2024-09-14T13:16:34.950641+0000, chain.objs.size()=1 2024-09-14T11:22:51.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.300+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.522__multipart_mymultipart.2~V9xFUJuXLDyiMDod3XrNKlJiw9L1BRA.4 2024-09-14T11:22:51.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.300+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='2~V9xFUJuXLDyiMDod3XrNKlJiw9L1BRA', time=2024-09-14T13:16:34.952531+0000, chain.objs.size()=1 2024-09-14T11:22:51.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.300+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.522__multipart_mymultipart.2~V9xFUJuXLDyiMDod3XrNKlJiw9L1BRA.5 2024-09-14T11:22:51.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.300+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='2~V9xFUJuXLDyiMDod3XrNKlJiw9L1BRA', time=2024-09-14T13:16:34.954120+0000, chain.objs.size()=1 2024-09-14T11:22:51.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.300+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.522__multipart_mymultipart.2~V9xFUJuXLDyiMDod3XrNKlJiw9L1BRA.6 2024-09-14T11:22:51.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.300+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14642926325908444909', time=2024-09-14T13:16:37.263999+0000, chain.objs.size()=2 2024-09-14T11:22:51.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.300+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.525__multipart_mymultipart.2~cNbDl1fj7IuSTLEGex4yQnLRn2G3Wi9.1 2024-09-14T11:22:51.306 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.300+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.525__multipart_mymultipart.2~cNbDl1fj7IuSTLEGex4yQnLRn2G3Wi9.2 2024-09-14T11:22:51.307 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.300+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17628831380819336284', time=2024-09-14T13:17:13.575066+0000, chain.objs.size()=2 2024-09-14T11:22:51.307 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.300+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.558__shadow_.gveIzet8-MJwPyK5CdQM9TrN2jeVK5I_0 2024-09-14T11:22:51.307 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.300+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.558__shadow_.gveIzet8-MJwPyK5CdQM9TrN2jeVK5I_1 2024-09-14T11:22:51.307 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.300+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6843498206939118144', time=2024-09-14T13:17:14.407280+0000, chain.objs.size()=1 2024-09-14T11:22:51.307 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.301+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.560__shadow_.mOACDrFpTZi61htB9UDetbgDVHhq2Ir_0 2024-09-14T11:22:51.307 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.301+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1796481395782563417', time=2024-09-14T13:17:28.082650+0000, chain.objs.size()=1 2024-09-14T11:22:51.307 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.301+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.572__shadow:gGaaIoHUNdhr0NHfKm0gNghZ8nDU66-_.v7w6YiqIUg8dm94yXSbI8OHrbyUL9nI_0 2024-09-14T11:22:51.307 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.301+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.973624095983746900', time=2024-09-14T13:17:35.854346+0000, chain.objs.size()=1 2024-09-14T11:22:51.307 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.301+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.577__shadow:shzyKsFdEk9D4v3mRdrXKUcf9PyTPif_.thPQbrlWxd55AFnza1r_CBNmG8OTaFf_0 2024-09-14T11:22:51.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.302+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8756247063974587395', time=2024-09-14T13:20:09.194881+0000, chain.objs.size()=1 2024-09-14T11:22:51.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.302+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.630__shadow_.Bf7JmDWgtErEGyphJKWKiRdjNytnONf_0 2024-09-14T11:22:51.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.303+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10339269614123945166', time=2024-09-14T13:20:16.248515+0000, chain.objs.size()=1 2024-09-14T11:22:51.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.303+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.654__shadow_.yZz_vabFAkLZ51ZDZraqVVNxXF23mXK_0 2024-09-14T11:22:51.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.303+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.252444132916778946', time=2024-09-14T13:20:19.480157+0000, chain.objs.size()=6 2024-09-14T11:22:51.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.303+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.660__multipart_bar.2~QtcMNq5Zyf64SSByeBlMDP6GmY0mQZg.1 2024-09-14T11:22:51.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.303+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.660__multipart_bar.2~QtcMNq5Zyf64SSByeBlMDP6GmY0mQZg.2 2024-09-14T11:22:51.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.303+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.660__multipart_bar.2~QtcMNq5Zyf64SSByeBlMDP6GmY0mQZg.3 2024-09-14T11:22:51.309 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.303+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.660__multipart_bar.2~QtcMNq5Zyf64SSByeBlMDP6GmY0mQZg.4 2024-09-14T11:22:51.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.304+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.660__multipart_bar.2~QtcMNq5Zyf64SSByeBlMDP6GmY0mQZg.5 2024-09-14T11:22:51.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.304+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.660__multipart_bar.2~QtcMNq5Zyf64SSByeBlMDP6GmY0mQZg.6 2024-09-14T11:22:51.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.304+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14414923750353951797', time=2024-09-14T13:20:20.780372+0000, chain.objs.size()=1 2024-09-14T11:22:51.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.304+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.665__shadow_.g3tXf5IVSsRWYUQC4KAs5NbxoZYh-mn_0 2024-09-14T11:22:51.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.304+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16433126063820533776', time=2024-09-14T13:20:21.234590+0000, chain.objs.size()=1 2024-09-14T11:22:51.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.304+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.666__shadow_.W7i029hH6PZ7U4khzQpc2EOP1bK6qjb_0 2024-09-14T11:22:51.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.304+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15105387056654576441', time=2024-09-14T13:20:24.236091+0000, chain.objs.size()=1 2024-09-14T11:22:51.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.304+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.679__shadow_.jLkTM5I6fkAUStacNMfsctu8fw0Xkcx_0 2024-09-14T11:22:51.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.304+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5004319975217354873', time=2024-09-14T13:20:30.535381+0000, chain.objs.size()=1 2024-09-14T11:22:51.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.304+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.704__shadow:jcLBsbq.1kUrJr5kR94-J8-v9SCM9KF_.cXRzyyRntMAHzdq0Nn3F4xtm95XXq12_0 2024-09-14T11:22:51.310 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.305+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5047249516453175872', time=2024-09-14T13:20:59.526879+0000, chain.objs.size()=1 2024-09-14T11:22:51.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.305+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.740__shadow_.uxrzj2ZeJy6qLZuRXmdAqIKMOHk3pyo_0 2024-09-14T11:22:51.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.308+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:51.311 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.310+0000 7f0f19c16800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:22:51.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.312+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:51.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.312+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:51.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.313+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/42620' 2024-09-14T11:22:51.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.313+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4835913653260432772', time=2024-09-14T13:13:37.902659+0000, chain.objs.size()=1 2024-09-14T11:22:51.312 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.313+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.166__shadow_.ITKHy7oHkqFUc7H2hj_5aHbCobv0XB9_0 2024-09-14T11:22:51.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.313+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3241980014088785865', time=2024-09-14T13:14:52.624357+0000, chain.objs.size()=1 2024-09-14T11:22:51.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.313+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.261__shadow_.tPqePril6RoWImWMTmnKkg-OCqttya4_0 2024-09-14T11:22:51.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.313+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3867379859205751493', time=2024-09-14T13:14:59.746969+0000, chain.objs.size()=1 2024-09-14T11:22:51.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.313+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.XRuUM7wnOd3Z14rTKcQFItNVtfULce__0 2024-09-14T11:22:51.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.313+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12016714864366883556', time=2024-09-14T13:14:59.776595+0000, chain.objs.size()=1 2024-09-14T11:22:51.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.313+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.HH9JpL05k8Jn4cp9fAZObGkVDxr2mRM_0 2024-09-14T11:22:51.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.313+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7789281449913320214', time=2024-09-14T13:14:59.784920+0000, chain.objs.size()=1 2024-09-14T11:22:51.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.313+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.CTYIvt6Mre9zStPv_EgOWT6kKQFXjkm_0 2024-09-14T11:22:51.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.313+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10693155062735252098', time=2024-09-14T13:14:59.798076+0000, chain.objs.size()=1 2024-09-14T11:22:51.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.313+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.9BrR72_pyrjqTudQQ3l19dABk19-FP0_0 2024-09-14T11:22:51.313 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.313+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13516104937824420484', time=2024-09-14T13:14:59.937184+0000, chain.objs.size()=1 2024-09-14T11:22:51.314 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.313+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.8E5zopVMZ0ZJuI0bWBS-TrekY57NFNA_0 2024-09-14T11:22:51.314 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.313+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8648429033449533267', time=2024-09-14T13:14:59.949011+0000, chain.objs.size()=1 2024-09-14T11:22:51.314 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.313+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.V9ALbX9RDQB203hN1xyZCIbaDSGcXZO_0 2024-09-14T11:22:51.314 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.313+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.989294250022712773', time=2024-09-14T13:14:59.953795+0000, chain.objs.size()=1 2024-09-14T11:22:51.314 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.313+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.l2t6zuO4z_QlQNs8cYxobsdRgOIJWWt_0 2024-09-14T11:22:51.314 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.313+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15510286382825025195', time=2024-09-14T13:14:59.964576+0000, chain.objs.size()=1 2024-09-14T11:22:51.314 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.313+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.ArK26gCbL2bTjFTd4rIKXizSnDEmd0S_0 2024-09-14T11:22:51.314 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.313+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9763067065195308753', time=2024-09-14T13:14:59.976969+0000, chain.objs.size()=1 2024-09-14T11:22:51.314 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.313+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.6h23l0NI9Rf30g5aG1ZZYR3zfjez6G6_0 2024-09-14T11:22:51.314 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.313+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16156935431390653747', time=2024-09-14T13:15:00.074427+0000, chain.objs.size()=1 2024-09-14T11:22:51.314 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.313+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.t3Hh-zG6f26ZaatY82ymGgbQFZGosBE_0 2024-09-14T11:22:51.316 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.315+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8491244537387948043', time=2024-09-14T13:15:00.084331+0000, chain.objs.size()=1 2024-09-14T11:22:51.316 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.315+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.pIFIlMD3Kb_tDCxeUFL7D0WOG99D8mi_0 2024-09-14T11:22:51.316 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.315+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14663462063134073578', time=2024-09-14T13:15:00.086004+0000, chain.objs.size()=1 2024-09-14T11:22:51.316 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.315+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.iIY8YDlyhceYp17tgBmxHDibhKFMcxB_0 2024-09-14T11:22:51.316 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.315+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12719940830285490672', time=2024-09-14T13:15:00.105532+0000, chain.objs.size()=1 2024-09-14T11:22:51.316 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.315+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.hUCSP4kk5r4_UhpSk6Il-Ev13QrzYo__0 2024-09-14T11:22:51.316 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.315+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14576748208909589925', time=2024-09-14T13:15:00.121112+0000, chain.objs.size()=1 2024-09-14T11:22:51.316 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.315+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.-NGWyK-sxdfierO2Vv4ijBk0Gt3yL_X_0 2024-09-14T11:22:51.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.315+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6831411647036304533', time=2024-09-14T13:15:00.130429+0000, chain.objs.size()=1 2024-09-14T11:22:51.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.315+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.GnCCUZnZ8zUaX5dD17lSfJQKhYyH_Hx_0 2024-09-14T11:22:51.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.315+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14976284925798498139', time=2024-09-14T13:15:00.133260+0000, chain.objs.size()=1 2024-09-14T11:22:51.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.315+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.RwenNyrI3mqI953uM7nUgVBRoTQ7b1w_0 2024-09-14T11:22:51.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.315+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17954548128264424335', time=2024-09-14T13:15:00.239171+0000, chain.objs.size()=1 2024-09-14T11:22:51.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.315+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.3YcU3TBSoHvFx-CAGpY48Gvp9vba76G_0 2024-09-14T11:22:51.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.315+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8203019318861234715', time=2024-09-14T13:15:00.250269+0000, chain.objs.size()=1 2024-09-14T11:22:51.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.315+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.lyOPnrAKCPSfNXELxQ9EMUKVNPcqQJG_0 2024-09-14T11:22:51.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.315+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9932091893052750708', time=2024-09-14T13:15:00.258124+0000, chain.objs.size()=1 2024-09-14T11:22:51.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.315+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.4Hx327RIKCvlRPQn-4YgZ-_PW2EX4JD_0 2024-09-14T11:22:51.317 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.315+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13604822233876633633', time=2024-09-14T13:15:00.264661+0000, chain.objs.size()=1 2024-09-14T11:22:51.318 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.315+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.H-fiAkANFa1OOGV0602h9o2nuHuDbgy_0 2024-09-14T11:22:51.318 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.315+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5136855068085310658', time=2024-09-14T13:15:00.268991+0000, chain.objs.size()=1 2024-09-14T11:22:51.318 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.315+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.2PzgtChDkIDPbHLvzxor8oTLUDZEXXm_0 2024-09-14T11:22:51.318 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.316+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5428068146942493618', time=2024-09-14T13:15:00.270103+0000, chain.objs.size()=1 2024-09-14T11:22:51.318 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.316+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.kxigvZTRroAGXFpx895rErnaDCWyBCw_0 2024-09-14T11:22:51.318 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.317+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16367110815403534765', time=2024-09-14T13:15:00.279673+0000, chain.objs.size()=1 2024-09-14T11:22:51.318 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.317+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.nCcO1JKRIIx74NhnQAJ4TaQqTgzU5tp_0 2024-09-14T11:22:51.318 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.317+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2168994312716828770', time=2024-09-14T13:15:00.290537+0000, chain.objs.size()=1 2024-09-14T11:22:51.318 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.317+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.wPN1evaOn7Q-F7Tag-U7ohdM7f-jfYS_0 2024-09-14T11:22:51.320 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.317+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2921790383049939966', time=2024-09-14T13:15:00.462857+0000, chain.objs.size()=1 2024-09-14T11:22:51.320 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.317+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.pwvjjCylijzbPR_PGFZe7YdGLdraGUD_0 2024-09-14T11:22:51.320 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.317+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5791668863981255777', time=2024-09-14T13:15:00.464667+0000, chain.objs.size()=1 2024-09-14T11:22:51.320 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.317+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.VAlC3PiiZOaAbbZM4XZ4Cpx0P5O2tFf_0 2024-09-14T11:22:51.320 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.318+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8431625391435564858', time=2024-09-14T13:15:00.552778+0000, chain.objs.size()=1 2024-09-14T11:22:51.320 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.318+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.CwhZqW0A_W0f_L-AK0RH6KgheVbfcaK_0 2024-09-14T11:22:51.320 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.318+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17143314348615712863', time=2024-09-14T13:15:00.563234+0000, chain.objs.size()=1 2024-09-14T11:22:51.321 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.318+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.RIpuy_nCzuiU_-ttD1KScJ0R8Jo57z1_0 2024-09-14T11:22:51.321 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.318+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1625358532997421416', time=2024-09-14T13:15:00.574386+0000, chain.objs.size()=1 2024-09-14T11:22:51.321 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.318+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.94lENbgxPVGzv2m48DV-lT7M0uiZ2AK_0 2024-09-14T11:22:51.321 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.318+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7113234339924563918', time=2024-09-14T13:15:00.612903+0000, chain.objs.size()=1 2024-09-14T11:22:51.321 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.318+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.4NJqz48MWKdXnyTuoGOkulLvmlcbb___0 2024-09-14T11:22:51.321 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.318+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3803546857799216470', time=2024-09-14T13:15:00.625411+0000, chain.objs.size()=1 2024-09-14T11:22:51.321 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.318+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.fBLVcur3j17PVLP27CAsYoKIUnx-fEm_0 2024-09-14T11:22:51.321 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.318+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17609358445862965445', time=2024-09-14T13:15:00.633506+0000, chain.objs.size()=1 2024-09-14T11:22:51.321 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.318+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.aWnDioZLcSA4jYjxKTi0T1U2vJHqim5_0 2024-09-14T11:22:51.321 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.318+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3808001168879107524', time=2024-09-14T13:15:00.634621+0000, chain.objs.size()=1 2024-09-14T11:22:51.321 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.318+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.o_3e-X1y_8eArnsNxjNnJh3X0gaXnnO_0 2024-09-14T11:22:51.322 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.318+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14453613335415115196', time=2024-09-14T13:15:00.723318+0000, chain.objs.size()=1 2024-09-14T11:22:51.322 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.318+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.aR38EVZrwtTXqR77sKXUJ3E3z0RTy7j_0 2024-09-14T11:22:51.322 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.318+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.792786757198816829', time=2024-09-14T13:15:00.731204+0000, chain.objs.size()=1 2024-09-14T11:22:51.322 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.318+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.ap1sCTgcKnbAbr2doPX3YlSNj0BvyUQ_0 2024-09-14T11:22:51.322 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.319+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.923032399833678060', time=2024-09-14T13:15:00.735463+0000, chain.objs.size()=1 2024-09-14T11:22:51.322 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.319+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.WjxD1uCL32PSL3eMhiFqvbq1cJbmbzH_0 2024-09-14T11:22:51.322 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.319+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2277060405314226640', time=2024-09-14T13:15:00.756922+0000, chain.objs.size()=1 2024-09-14T11:22:51.322 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.319+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.ayeTUbVWJQN0HPB5PyfCdsbyymfrMBj_0 2024-09-14T11:22:51.322 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.319+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7494195845766537013', time=2024-09-14T13:15:00.780256+0000, chain.objs.size()=1 2024-09-14T11:22:51.322 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.319+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.c1DYxxSXAnncrLISK-_s6Mfo5fS4Yxq_0 2024-09-14T11:22:51.322 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.320+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2201647499491787002', time=2024-09-14T13:15:00.794224+0000, chain.objs.size()=1 2024-09-14T11:22:51.323 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.320+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.GiBsVMjWwVfyGO6SumsPIXxujMTpMN0_0 2024-09-14T11:22:51.323 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.320+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12311972865555049497', time=2024-09-14T13:15:00.799307+0000, chain.objs.size()=1 2024-09-14T11:22:51.323 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.320+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.aMWm9I6krL3ZZFdjii5z9vEk3I8acnE_0 2024-09-14T11:22:51.323 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.320+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10399230897701033470', time=2024-09-14T13:15:00.889972+0000, chain.objs.size()=1 2024-09-14T11:22:51.323 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.320+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.8PsErNV6eDadaMKzfzYW0uguh1zR2DN_0 2024-09-14T11:22:51.323 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.320+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7629105638193053287', time=2024-09-14T13:15:00.920491+0000, chain.objs.size()=1 2024-09-14T11:22:51.323 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.320+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Ec2t-L_3KZkunpMgCNVgMVKkBt5ARpe_0 2024-09-14T11:22:51.323 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.320+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16832267990668647023', time=2024-09-14T13:15:09.252798+0000, chain.objs.size()=1 2024-09-14T11:22:51.323 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.320+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.292__shadow_.cI2rzmoqXhMvG5X8Gik8wfp7Fu2ptFs_0 2024-09-14T11:22:51.323 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.320+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15797617498128083367', time=2024-09-14T13:15:24.737542+0000, chain.objs.size()=1 2024-09-14T11:22:51.323 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.320+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.-5c_ZqSDShSp2mFMNedD-pwr1MhvvjP_0 2024-09-14T11:22:51.324 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.320+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4871789862402949595', time=2024-09-14T13:15:24.786183+0000, chain.objs.size()=1 2024-09-14T11:22:51.324 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.320+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.84U9WJ_lef3BGQWusils1Jd5rlEGpUU_0 2024-09-14T11:22:51.324 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.320+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7407842228300559557', time=2024-09-14T13:15:24.795888+0000, chain.objs.size()=1 2024-09-14T11:22:51.324 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.320+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.2H3pL9hiu6zW-GbjMBskPswVg_WRWDH_0 2024-09-14T11:22:51.324 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.320+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4219964386402554243', time=2024-09-14T13:15:24.881983+0000, chain.objs.size()=1 2024-09-14T11:22:51.324 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.320+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.ZC_-4mEiORXaQP_AZ_9D2KVHYMi5k5G_0 2024-09-14T11:22:51.324 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.321+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3331976357115888938', time=2024-09-14T13:15:24.893888+0000, chain.objs.size()=1 2024-09-14T11:22:51.324 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.321+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.MlV6OY8VnLFZPxj9iRe2X9THqAinubv_0 2024-09-14T11:22:51.324 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.321+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11527650114169675691', time=2024-09-14T13:15:24.962542+0000, chain.objs.size()=1 2024-09-14T11:22:51.324 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.321+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.VIJLru0tr2J5nUf5KPOR90Geax518yq_0 2024-09-14T11:22:51.326 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.322+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13259000735366864001', time=2024-09-14T13:15:25.070550+0000, chain.objs.size()=1 2024-09-14T11:22:51.326 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.322+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.5wc__WHIzYgxEcpYltsBQMN0YnWJ0ph_0 2024-09-14T11:22:51.326 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.323+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14826188549190038432', time=2024-09-14T13:15:25.089080+0000, chain.objs.size()=1 2024-09-14T11:22:51.327 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.323+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.4KajjddixCozoY3HTTSN6VKEZpZAuvI_0 2024-09-14T11:22:51.327 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.323+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9854473579427478283', time=2024-09-14T13:15:25.228931+0000, chain.objs.size()=1 2024-09-14T11:22:51.327 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.323+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.Ma7iiNukY8Sv20R_o0CYLULS7PekXy__0 2024-09-14T11:22:51.327 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.323+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4826653760156552548', time=2024-09-14T13:15:25.255728+0000, chain.objs.size()=1 2024-09-14T11:22:51.327 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.323+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.D3jkPogD85dA6g18BMG350_S1TtX-9I_0 2024-09-14T11:22:51.327 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.323+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9710998672571174034', time=2024-09-14T13:15:25.274275+0000, chain.objs.size()=1 2024-09-14T11:22:51.327 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.323+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.NN5mSbOGLs4-x1aYq358WGd4QWYBTz7_0 2024-09-14T11:22:51.327 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.323+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9188458017437894147', time=2024-09-14T13:15:25.395218+0000, chain.objs.size()=1 2024-09-14T11:22:51.327 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.323+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.CgMEPykzJ3kZHxoRG2Z4a-ODSpvfID8_0 2024-09-14T11:22:51.327 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.324+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.885054421260173424', time=2024-09-14T13:15:25.421519+0000, chain.objs.size()=1 2024-09-14T11:22:51.328 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.324+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.MZEW3S9g2oIzu0zKKM2LkhF1lnEIP_l_0 2024-09-14T11:22:51.328 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.324+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18354124552436708519', time=2024-09-14T13:15:25.441494+0000, chain.objs.size()=1 2024-09-14T11:22:51.328 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.324+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.WFd8eQuDbjhB6wHw6NlWrDYlz-qtwX0_0 2024-09-14T11:22:51.328 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.324+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4572489374149297568', time=2024-09-14T13:15:25.447134+0000, chain.objs.size()=1 2024-09-14T11:22:51.328 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.324+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.C4eO7BFsvZeYNHNNYcREUUOO3-l2VsT_0 2024-09-14T11:22:51.328 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.324+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11459571300354764543', time=2024-09-14T13:15:25.526632+0000, chain.objs.size()=1 2024-09-14T11:22:51.328 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.324+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.0sgKsZBtSsLQMPR1btUOKz-nPqtXzkn_0 2024-09-14T11:22:51.328 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.324+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5673620729712611949', time=2024-09-14T13:15:25.563106+0000, chain.objs.size()=1 2024-09-14T11:22:51.328 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.324+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.yN0nsYQLDUre_S34XU_VPJlYo-WFprg_0 2024-09-14T11:22:51.328 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.324+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5961241989506890851', time=2024-09-14T13:15:25.703695+0000, chain.objs.size()=1 2024-09-14T11:22:51.328 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.324+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.6-e6UFvLfy_IrN1400NHNGU8BrPAXES_0 2024-09-14T11:22:51.329 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.325+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10587654316196663857', time=2024-09-14T13:15:25.720023+0000, chain.objs.size()=1 2024-09-14T11:22:51.329 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.325+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.DhnuUfQlj0Rrw8T3h-5bJQmLFCO6cer_0 2024-09-14T11:22:51.329 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.325+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8636887522046727386', time=2024-09-14T13:15:25.738792+0000, chain.objs.size()=1 2024-09-14T11:22:51.329 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.325+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.h3RicQw_fFNcFZ99R-BL04VCqjgkGEQ_0 2024-09-14T11:22:51.329 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.325+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2546217881417575234', time=2024-09-14T13:15:25.760312+0000, chain.objs.size()=1 2024-09-14T11:22:51.329 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.325+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.hcszE1GpLn1KwLq-uz7vgycq9GOIAnk_0 2024-09-14T11:22:51.329 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.325+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10425311661486682311', time=2024-09-14T13:15:25.889786+0000, chain.objs.size()=1 2024-09-14T11:22:51.329 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.325+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.zKAj6Iv2zzuP4o8v08zlLn0OlX3b_rm_0 2024-09-14T11:22:51.329 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.325+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6305967390900379341', time=2024-09-14T13:15:25.910864+0000, chain.objs.size()=1 2024-09-14T11:22:51.329 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.325+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.oVhSFCBBUOIgWTcOYp-6m0avBbKvHvG_0 2024-09-14T11:22:51.329 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.326+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5394904688289863538', time=2024-09-14T13:15:25.925003+0000, chain.objs.size()=1 2024-09-14T11:22:51.329 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.326+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.MpVn_30aLbQtylpWzhIGLlQzc66sBSp_0 2024-09-14T11:22:51.330 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.326+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14624172524428803792', time=2024-09-14T13:15:33.177378+0000, chain.objs.size()=1 2024-09-14T11:22:51.330 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.326+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.-aPY5FCTkOtQOPO85F5urqKqSuXz5zz_0 2024-09-14T11:22:51.330 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.326+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8849443605734451381', time=2024-09-14T13:15:33.179472+0000, chain.objs.size()=1 2024-09-14T11:22:51.330 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.326+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.78XKT4U1ARNC-dOgg6OvWPPM6_sEAW5_0 2024-09-14T11:22:51.330 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.326+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11374118260826324844', time=2024-09-14T13:15:33.207639+0000, chain.objs.size()=1 2024-09-14T11:22:51.330 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.326+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.kpYCi-cdZgRfDK8b7cZPsSfOf4iaku7_0 2024-09-14T11:22:51.330 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.326+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17821522840500531799', time=2024-09-14T13:15:33.225403+0000, chain.objs.size()=1 2024-09-14T11:22:51.330 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.326+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.3xg8Giepo9AKu3SLdU3UO2IN8hy568Y_0 2024-09-14T11:22:51.330 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.326+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8753080973991538287', time=2024-09-14T13:15:33.228264+0000, chain.objs.size()=1 2024-09-14T11:22:51.330 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.326+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.vTvlx3wHJiDBxqRrjlVKqpQTHDnGIb7_0 2024-09-14T11:22:51.330 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.326+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15272121427101228191', time=2024-09-14T13:15:33.228954+0000, chain.objs.size()=1 2024-09-14T11:22:51.331 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.326+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.kXWA4NS9QAne_cK7xu98OcYrmIbeYKu_0 2024-09-14T11:22:51.331 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.327+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.471788231459289908', time=2024-09-14T13:15:33.249271+0000, chain.objs.size()=1 2024-09-14T11:22:51.331 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.327+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.cpqgzA_Y1Zp2mIrrdzsMvBZaXp8US1L_0 2024-09-14T11:22:51.331 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.327+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11522665797830466978', time=2024-09-14T13:15:33.383305+0000, chain.objs.size()=1 2024-09-14T11:22:51.331 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.327+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.WCuVwfx28F-W51sa2BVu0fXtVAUAQzR_0 2024-09-14T11:22:51.331 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.327+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3282379391765718734', time=2024-09-14T13:15:33.392069+0000, chain.objs.size()=1 2024-09-14T11:22:51.331 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.327+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.1jq25Ghf9k_xKuX4xF_LDWBLI_jfW0I_0 2024-09-14T11:22:51.331 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.327+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5515241098108837323', time=2024-09-14T13:15:33.392980+0000, chain.objs.size()=1 2024-09-14T11:22:51.331 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.327+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.OEcNcSaZY26XJgVASJ9pFZPteUQ-2pw_0 2024-09-14T11:22:51.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.328+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11941660649102623955', time=2024-09-14T13:15:33.438604+0000, chain.objs.size()=1 2024-09-14T11:22:51.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.328+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.9Np-zIRJbwQm0PAZCON0HX1XuiLvSpR_0 2024-09-14T11:22:51.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.328+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4260377035632286652', time=2024-09-14T13:15:33.442972+0000, chain.objs.size()=1 2024-09-14T11:22:51.333 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.328+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.mkDZxIGW9W-KSWTyZCvQjktdiNebG8X_0 2024-09-14T11:22:51.334 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.328+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17354952010784651930', time=2024-09-14T13:15:33.443681+0000, chain.objs.size()=1 2024-09-14T11:22:51.334 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.328+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.ILO2fqxJcMCE58X7ookAj7L7Fh_FAMr_0 2024-09-14T11:22:51.334 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.328+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.580769614519812232', time=2024-09-14T13:15:33.553963+0000, chain.objs.size()=1 2024-09-14T11:22:51.334 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.328+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.L3PL-GwsQGxOFp5WSp2jYdBTFe9bfvp_0 2024-09-14T11:22:51.334 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.328+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8457686917912155725', time=2024-09-14T13:15:33.573508+0000, chain.objs.size()=1 2024-09-14T11:22:51.334 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.328+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.9OoR2x_rGjwROpVFQa9jL80Is51gNpa_0 2024-09-14T11:22:51.334 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.328+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11489074185570004123', time=2024-09-14T13:15:33.577349+0000, chain.objs.size()=1 2024-09-14T11:22:51.334 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.329+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.zG-xVjFBfyoKMK9lIIfEmhMKuDmjsJf_0 2024-09-14T11:22:51.334 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.329+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15609694994850651107', time=2024-09-14T13:15:33.590526+0000, chain.objs.size()=1 2024-09-14T11:22:51.334 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.329+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.HVHnzWC7DG3LGib16mPwMJw4mrRv4o7_0 2024-09-14T11:22:51.334 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.329+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12152121639938268514', time=2024-09-14T13:15:33.604416+0000, chain.objs.size()=1 2024-09-14T11:22:51.335 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.329+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.LLHDKdCoH-hEg06USGcHGG5_WPEV7zR_0 2024-09-14T11:22:51.335 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.329+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9632354530191926274', time=2024-09-14T13:15:33.724034+0000, chain.objs.size()=1 2024-09-14T11:22:51.335 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.329+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.ZtP8SichjzYUewEfVUafKW04HKS0hsa_0 2024-09-14T11:22:51.335 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.329+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16232712136674867915', time=2024-09-14T13:15:33.851929+0000, chain.objs.size()=1 2024-09-14T11:22:51.335 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.329+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.tqz14qlGR44gvRzsiN0tMuORVZuWwHB_0 2024-09-14T11:22:51.335 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.329+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10330900424750519805', time=2024-09-14T13:15:33.875497+0000, chain.objs.size()=1 2024-09-14T11:22:51.335 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.329+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.3ZP-0kjwejxScI66E3qmwinrcU5gVxJ_0 2024-09-14T11:22:51.335 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.331+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1094628569571194420', time=2024-09-14T13:15:33.882749+0000, chain.objs.size()=1 2024-09-14T11:22:51.335 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.331+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.razlUiNg5MnSwBZDZ_0_DyisKtfJBbg_0 2024-09-14T11:22:51.335 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.331+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13557196710449959578', time=2024-09-14T13:15:33.883599+0000, chain.objs.size()=1 2024-09-14T11:22:51.335 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.331+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.JyRgpG51WaxXUeuFaSqsaX9NIloaIrk_0 2024-09-14T11:22:51.335 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.331+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3566287485836513166', time=2024-09-14T13:15:33.890770+0000, chain.objs.size()=1 2024-09-14T11:22:51.336 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.331+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.QzxoJSaTtgjOv8JGy39FvdkNUWzFy3W_0 2024-09-14T11:22:51.336 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.331+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11526077402950339376', time=2024-09-14T13:15:33.906366+0000, chain.objs.size()=1 2024-09-14T11:22:51.336 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.331+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.pxfS3afZTWr7z9VoJ7zKtPk1mJeayIB_0 2024-09-14T11:22:51.336 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.332+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6043192795101357452', time=2024-09-14T13:15:33.910765+0000, chain.objs.size()=1 2024-09-14T11:22:51.336 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.332+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Qe8spU0fYpKTuZx93lQUtN5cMTGxozy_0 2024-09-14T11:22:51.336 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.332+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.940055270850574022', time=2024-09-14T13:15:33.913804+0000, chain.objs.size()=1 2024-09-14T11:22:51.336 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.332+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.uGJ80O6EWuM9WKbFpQNGAy3JW8VGzHH_0 2024-09-14T11:22:51.336 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.332+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14137352678862793902', time=2024-09-14T13:15:33.924971+0000, chain.objs.size()=1 2024-09-14T11:22:51.336 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.332+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.ZYnBm-GG8Rb7PzSokN0aai2XBgydxbL_0 2024-09-14T11:22:51.336 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.332+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13058092792921955502', time=2024-09-14T13:15:34.017669+0000, chain.objs.size()=1 2024-09-14T11:22:51.337 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.332+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.K7QH8A8zc6qDu6-WWPU6_r2x43Kf18t_0 2024-09-14T11:22:51.337 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.332+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3236189968464563852', time=2024-09-14T13:15:34.022767+0000, chain.objs.size()=1 2024-09-14T11:22:51.337 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.332+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.p1XAKMyRkVfxrzgEMC4Lj3Zz34ws6TU_0 2024-09-14T11:22:51.337 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.332+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13508233463893501474', time=2024-09-14T13:15:34.050470+0000, chain.objs.size()=1 2024-09-14T11:22:51.337 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.332+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.NMUV0O_g2CS7n_yELskuLrBzsC85u6d_0 2024-09-14T11:22:51.337 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.333+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 0/42620 2024-09-14T11:22:51.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.336+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=34, truncated=0, next_marker='' 2024-09-14T11:22:51.338 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.336+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8554734396139582749', time=2024-09-14T13:15:34.052840+0000, chain.objs.size()=1 2024-09-14T11:22:51.339 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.336+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.FWDvKrAaeVE9uft-iH_5ZWcMNJPl6DO_0 2024-09-14T11:22:51.339 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.336+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12518919742484198156', time=2024-09-14T13:15:34.057777+0000, chain.objs.size()=1 2024-09-14T11:22:51.339 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.336+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.8I2hnsOBlLn2_0K94hs5z1wQZTiV1o8_0 2024-09-14T11:22:51.339 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.336+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3983071758124729726', time=2024-09-14T13:15:34.069204+0000, chain.objs.size()=1 2024-09-14T11:22:51.339 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.336+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.XKcr41OjV-sz40151VCDdWp7s3N17tl_0 2024-09-14T11:22:51.339 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.336+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9322741229362237706', time=2024-09-14T13:15:34.099938+0000, chain.objs.size()=1 2024-09-14T11:22:51.339 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.336+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.BQ2TDIxDlsQYkuhFnkp1hSDJmybWhXk_0 2024-09-14T11:22:51.339 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.336+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3428830923230105713', time=2024-09-14T13:15:34.171539+0000, chain.objs.size()=1 2024-09-14T11:22:51.339 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.336+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.vo0s9VgDQhnRQEfzf1fl-GsclWFfwUk_0 2024-09-14T11:22:51.339 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.336+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10869485605529236601', time=2024-09-14T13:15:34.204216+0000, chain.objs.size()=1 2024-09-14T11:22:51.339 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.336+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.mu0QhImMkrg4L1qt-aw6lIblFZfYnx7_0 2024-09-14T11:22:51.340 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.336+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14148397400395771869', time=2024-09-14T13:15:34.207858+0000, chain.objs.size()=1 2024-09-14T11:22:51.340 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.336+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.4AoSqeRep7crJyARmR2DTsYTlkqL_r0_0 2024-09-14T11:22:51.340 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.336+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13891636649833197741', time=2024-09-14T13:15:34.211003+0000, chain.objs.size()=1 2024-09-14T11:22:51.340 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.336+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.wahOnO5cNYqFU_8aH-QBEOoKJFPg5zJ_0 2024-09-14T11:22:51.340 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.336+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11635516126297351198', time=2024-09-14T13:15:34.221334+0000, chain.objs.size()=1 2024-09-14T11:22:51.340 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.336+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.5FERrjoQy-jI7a6CripWNHRJL1i-Doa_0 2024-09-14T11:22:51.340 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.336+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8921734733098172307', time=2024-09-14T13:15:34.243883+0000, chain.objs.size()=1 2024-09-14T11:22:51.340 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.336+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.HkV_Q4RH6fDyF_JnbJQhoBX4G6z2Z8z_0 2024-09-14T11:22:51.340 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.336+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9957596387976806105', time=2024-09-14T13:15:34.332526+0000, chain.objs.size()=1 2024-09-14T11:22:51.340 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.336+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.iBqBlEq02rWy8zcnj6AhrBy3jIjwnU2_0 2024-09-14T11:22:51.340 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.336+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10332147514771151830', time=2024-09-14T13:15:34.354826+0000, chain.objs.size()=1 2024-09-14T11:22:51.341 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.336+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.rR6OCyNMq5tRWKtV31moHk5PmGDhSy-_0 2024-09-14T11:22:51.341 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.338+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15138117111060749355', time=2024-09-14T13:15:34.378463+0000, chain.objs.size()=1 2024-09-14T11:22:51.341 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.338+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.tIpqfvdmda8ktt2tvXeZ6EWeP6nhXA__0 2024-09-14T11:22:51.341 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.338+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5755574541807695944', time=2024-09-14T13:15:34.380419+0000, chain.objs.size()=1 2024-09-14T11:22:51.341 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.338+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.w1BOrICL8v-je2V5QNzfT4MRrgtYSlF_0 2024-09-14T11:22:51.341 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.338+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9605518338024374752', time=2024-09-14T13:15:37.061954+0000, chain.objs.size()=1 2024-09-14T11:22:51.341 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.338+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.335__shadow_.gCm732E6LlpWD_174Fn6Zis6aKBA7PT_0 2024-09-14T11:22:51.341 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.338+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.109267118733329851', time=2024-09-14T13:15:47.637767+0000, chain.objs.size()=1 2024-09-14T11:22:51.341 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.338+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.378__shadow_.Ku1ONGuK3FLt3-GFiY0LP_g-xPwBVzy_0 2024-09-14T11:22:51.341 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.338+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4495182789542282170', time=2024-09-14T13:15:48.940065+0000, chain.objs.size()=1 2024-09-14T11:22:51.341 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.338+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.382__shadow_.LDPMaT_6xkDfj-8t27nrasqg5XBr9eF_0 2024-09-14T11:22:51.342 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.338+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16932182880221102203', time=2024-09-14T13:16:12.829463+0000, chain.objs.size()=1 2024-09-14T11:22:51.342 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.339+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.464__shadow_.-cw1PsNb1_hzcM1APndsS-RPu6DwHZC_0 2024-09-14T11:22:51.342 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.339+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4743551701044169953', time=2024-09-14T13:16:16.975527+0000, chain.objs.size()=1 2024-09-14T11:22:51.342 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.339+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.483__shadow_.Ix665jPEpPnD1V5sNoM9BeeoqZqkTuU_0 2024-09-14T11:22:51.342 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.339+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17146268849674128787', time=2024-09-14T13:16:21.203894+0000, chain.objs.size()=1 2024-09-14T11:22:51.342 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.339+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.498__shadow_.FqOv8zTmmY0bCe9LbsemuJUwo2db-ez_0 2024-09-14T11:22:51.342 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.339+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15050408871783956805', time=2024-09-14T13:16:36.208101+0000, chain.objs.size()=3 2024-09-14T11:22:51.342 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.339+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.523__multipart_mymultipart.2~bZQd4si-t04wAbmszUW4TuM_kuvELgF.1 2024-09-14T11:22:51.342 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.339+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.523__multipart_mymultipart.2~bZQd4si-t04wAbmszUW4TuM_kuvELgF.2 2024-09-14T11:22:51.342 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.339+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.523__multipart_mymultipart.2~bZQd4si-t04wAbmszUW4TuM_kuvELgF.3 2024-09-14T11:22:51.342 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.340+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11528074836071801378', time=2024-09-14T13:17:23.633333+0000, chain.objs.size()=1 2024-09-14T11:22:51.343 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.340+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.569__shadow:iUKl-ZXHsEEvJgwPKAQu8lhbVHmYYIm_.jBm_Ysii5zjbkxfEFrJqB5Ai7S7pSY3_0 2024-09-14T11:22:51.343 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.340+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13798231471961789833', time=2024-09-14T13:17:23.970701+0000, chain.objs.size()=1 2024-09-14T11:22:51.343 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.340+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.569__shadow:rYElcfTGm3F0dmMaFWIxGrlhaRxQYm8_.u2zt09kCwYJ5vskkY2Am0bHjsclG-LK_0 2024-09-14T11:22:51.343 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.340+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.302079257202481701', time=2024-09-14T13:17:25.674508+0000, chain.objs.size()=1 2024-09-14T11:22:51.343 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.340+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.569__shadow:o31uwtTNI6iLCuHHn-TKJFv3QR7Kasv_.mXCPduStrqCKvgV2DlAB88s0gitP6zJ_0 2024-09-14T11:22:51.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.340+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11958089785636742224', time=2024-09-14T13:17:30.347693+0000, chain.objs.size()=1 2024-09-14T11:22:51.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.340+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.574__shadow:pYPUn1--6ttbRD1RXUoVp1lOJSpRJ0h_.4X-ZIw5Q0z_Bs6Iv_QJ-qMbvNjdocNT_0 2024-09-14T11:22:51.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.340+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7020936561464354904', time=2024-09-14T13:17:31.197909+0000, chain.objs.size()=1 2024-09-14T11:22:51.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.340+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.574__shadow:l3hoYVKIVJGHx0zAsiSA76yvlzoPeCF_.Nw0r0kW6lMMXb-T6IdKumQroVmxP-vP_0 2024-09-14T11:22:51.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.341+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.491853554415654409', time=2024-09-14T13:17:50.001027+0000, chain.objs.size()=1 2024-09-14T11:22:51.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.341+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.579__shadow:c84HVagEG97itvh0OB0RE7hTO-6H-Gn_.3jMAJap9tr7F59ywtf_2xpOZ0axs6II_0 2024-09-14T11:22:51.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.341+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2540253898994145680', time=2024-09-14T13:17:50.008878+0000, chain.objs.size()=1 2024-09-14T11:22:51.344 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.341+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.579__shadow:Xp2RfUG3Uf3qJwO-pFcib2caw8a38hC_.ZrU1HCw3NzSTZYj7PUmzIPwlLjWHTc__0 2024-09-14T11:22:51.345 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.341+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1269018652430718205', time=2024-09-14T13:20:15.938011+0000, chain.objs.size()=1 2024-09-14T11:22:51.345 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.341+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.653__shadow_.kENS34mu7vDBkFk553NibmKHyOAR3J1_0 2024-09-14T11:22:51.345 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.341+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11829957921255385176', time=2024-09-14T13:20:22.476990+0000, chain.objs.size()=1 2024-09-14T11:22:51.345 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.341+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.671__shadow_.J3XD2P7jrGFqsz8Ku9vuMwER2SVOG6l_0 2024-09-14T11:22:51.345 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.341+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2670572273174365921', time=2024-09-14T13:20:31.721573+0000, chain.objs.size()=1 2024-09-14T11:22:51.345 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.341+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.708__shadow:zyLcaK6ZThnBgRKeWAIJHjDBK0RH5Eh_.5cfzbAq0Wjy_Y1zYe8MALudTd9ykDND_0 2024-09-14T11:22:51.345 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.342+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6378995761612166944', time=2024-09-14T13:20:53.023460+0000, chain.objs.size()=1 2024-09-14T11:22:51.345 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.342+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.717__shadow:vbR3rGTlp8n8ovjBXTYwvzL2MMP2FCA_.yJ9cbsMWNDfUtmVpsx8L7vC2uXoXs0R_0 2024-09-14T11:22:51.345 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.342+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15771967031155719395', time=2024-09-14T13:21:11.553116+0000, chain.objs.size()=1 2024-09-14T11:22:51.345 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.342+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.766__shadow_.JxrYofLtCpVL_QmFx_DyvxSw1ZUjLMs_0 2024-09-14T11:22:51.345 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.343+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10988430978372196965', time=2024-09-14T13:21:14.895631+0000, chain.objs.size()=1 2024-09-14T11:22:51.346 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.343+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.774__shadow_.DvNve37fGF05ewlhoC4RneAK6z1D1yS_0 2024-09-14T11:22:51.346 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.344+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:51.346 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.346+0000 7f0f19c16800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:22:51.346 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.347+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:51.347 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.348+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:51.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.349+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49218' 2024-09-14T11:22:51.348 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.349+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14386841604193491081', time=2024-09-14T13:13:33.335568+0000, chain.objs.size()=2 2024-09-14T11:22:51.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.349+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.158__shadow_.ZDq9hOPnDIjp6M_2JvXOXVjgvNmUl1o_0 2024-09-14T11:22:51.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.349+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.158__shadow_.ZDq9hOPnDIjp6M_2JvXOXVjgvNmUl1o_1 2024-09-14T11:22:51.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.349+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7307447237104296726', time=2024-09-14T13:13:33.340947+0000, chain.objs.size()=2 2024-09-14T11:22:51.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.349+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.158__shadow_._LtNPh0ORYGQYmHzQrWlEruDrTnwDG3_0 2024-09-14T11:22:51.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.349+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.158__shadow_._LtNPh0ORYGQYmHzQrWlEruDrTnwDG3_1 2024-09-14T11:22:51.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.349+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='_7X8jIoH-6nMNXsp-FkLKwZfRt2aAj3b', time=2024-09-14T13:13:36.791614+0000, chain.objs.size()=1 2024-09-14T11:22:51.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.349+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.161__shadow_.szYvyUzFjR0HEyJlAJEMXI4nQxBndJc_0 2024-09-14T11:22:51.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.349+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10975233913772563035', time=2024-09-14T13:14:46.517255+0000, chain.objs.size()=1 2024-09-14T11:22:51.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.349+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.238__shadow_.Z0tXcywi0Ws4IbjfDs8nAPri9hdxBAy_0 2024-09-14T11:22:51.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.349+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11420987548410942696', time=2024-09-14T13:14:47.813517+0000, chain.objs.size()=1 2024-09-14T11:22:51.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.349+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.243__shadow_.1tCgPMSQvnvRCDLpr42MUP52XLMyb0w_0 2024-09-14T11:22:51.349 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.349+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9111854760704291197', time=2024-09-14T13:14:50.853670+0000, chain.objs.size()=1 2024-09-14T11:22:51.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.349+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.254__shadow_.ouTF2T9JR997UAQ6XL2Lh-SLgr2YVEj_0 2024-09-14T11:22:51.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.349+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9022846815498250863', time=2024-09-14T13:14:52.080768+0000, chain.objs.size()=1 2024-09-14T11:22:51.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.349+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.259__shadow_.wLtnE3j3CTF4Q_s7B2o5XQyFHz-Y9k9_0 2024-09-14T11:22:51.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.349+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10146304260087456772', time=2024-09-14T13:14:59.747877+0000, chain.objs.size()=1 2024-09-14T11:22:51.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.349+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.2vvnzF9V6SZPH1oZ6UdecORGeurYiDY_0 2024-09-14T11:22:51.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.349+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3876525683528052910', time=2024-09-14T13:14:59.751793+0000, chain.objs.size()=1 2024-09-14T11:22:51.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.349+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.cj5nkV-agQWD9sstL226O99S3ZFZp-Q_0 2024-09-14T11:22:51.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.349+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4522958884675649979', time=2024-09-14T13:14:59.771266+0000, chain.objs.size()=1 2024-09-14T11:22:51.350 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.349+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.94uNEk8ihA-w6yqvgvKaC2by8EAZLiz_0 2024-09-14T11:22:51.351 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.351+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4173621253608958627', time=2024-09-14T13:14:59.776499+0000, chain.objs.size()=1 2024-09-14T11:22:51.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.351+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.m_vn7dJzT93Zn5t5vG6gadZNWO0GxZk_0 2024-09-14T11:22:51.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.351+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3781139000546076514', time=2024-09-14T13:14:59.787881+0000, chain.objs.size()=1 2024-09-14T11:22:51.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.351+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.nMSg9ibuZla72qcsFH9HROL0LpSlowD_0 2024-09-14T11:22:51.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.352+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4920267159671866529', time=2024-09-14T13:14:59.796722+0000, chain.objs.size()=1 2024-09-14T11:22:51.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.352+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.qbgVITEbKbgBA1DdVb7yLndgW_H3WPe_0 2024-09-14T11:22:51.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.352+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11009157327738050720', time=2024-09-14T13:15:00.066268+0000, chain.objs.size()=1 2024-09-14T11:22:51.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.352+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.sG2htT6NaR5Wn602OaysiDiWZRK3wqF_0 2024-09-14T11:22:51.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.352+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5463260967753320904', time=2024-09-14T13:15:00.077394+0000, chain.objs.size()=1 2024-09-14T11:22:51.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.352+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.rgeaL-iFA9KfScuvgBGBma3KOsTZMJu_0 2024-09-14T11:22:51.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.352+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7377678138433309930', time=2024-09-14T13:15:00.078526+0000, chain.objs.size()=1 2024-09-14T11:22:51.352 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.352+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.kmFSOmuJSDGxFkjTNKaF83vtZWDHUPL_0 2024-09-14T11:22:51.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.352+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11563420616897411301', time=2024-09-14T13:15:00.144615+0000, chain.objs.size()=1 2024-09-14T11:22:51.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.352+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.EmX_i3aBG2Fnoorrn-bLfJn-MH2P_eW_0 2024-09-14T11:22:51.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.352+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11881612056747118483', time=2024-09-14T13:15:00.229815+0000, chain.objs.size()=1 2024-09-14T11:22:51.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.352+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.EB_pgooD7GIJ_cnpu3EQQMB6NUEmOJd_0 2024-09-14T11:22:51.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.352+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4863777244004757160', time=2024-09-14T13:15:00.243755+0000, chain.objs.size()=1 2024-09-14T11:22:51.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.352+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.CYsXZ_W5w4mb6o1DF0ZFu0ECQgwzA1B_0 2024-09-14T11:22:51.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.352+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13043644856553375008', time=2024-09-14T13:15:00.269724+0000, chain.objs.size()=1 2024-09-14T11:22:51.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.352+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.3yH4c_0O5yt0ghxuPYdES66aGhSQKf-_0 2024-09-14T11:22:51.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.352+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7203781338575357504', time=2024-09-14T13:15:00.278488+0000, chain.objs.size()=1 2024-09-14T11:22:51.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.352+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.5VhxChqIpWtnLO7LR1RQLcPW-gni4Eh_0 2024-09-14T11:22:51.353 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.353+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2297058610291433079', time=2024-09-14T13:15:00.314877+0000, chain.objs.size()=1 2024-09-14T11:22:51.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.353+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.XnHyhushCGs5XclVi0byyochuKKdyDU_0 2024-09-14T11:22:51.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.353+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4705774597515538484', time=2024-09-14T13:15:00.403321+0000, chain.objs.size()=1 2024-09-14T11:22:51.354 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.353+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.eve0oQ9rYwmSq07AD1RVdoeT9n1PFr4_0 2024-09-14T11:22:51.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.354+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6248904665994906311', time=2024-09-14T13:15:00.441027+0000, chain.objs.size()=1 2024-09-14T11:22:51.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.354+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.qY2un2x7MDsSWV-Vo7jFwDJfWdticGM_0 2024-09-14T11:22:51.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.354+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10119767723690632317', time=2024-09-14T13:15:00.478722+0000, chain.objs.size()=1 2024-09-14T11:22:51.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.354+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.bsZ_earfZyXpLX_gC7oavHxi48LtdaM_0 2024-09-14T11:22:51.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.354+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4907471879522002987', time=2024-09-14T13:15:00.554069+0000, chain.objs.size()=1 2024-09-14T11:22:51.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.354+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.IJtHVClFsF1ZE_ucQ1fiih6h_yxYodV_0 2024-09-14T11:22:51.355 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.354+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5620795744761312217', time=2024-09-14T13:15:00.582359+0000, chain.objs.size()=1 2024-09-14T11:22:51.356 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.354+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.h69ucaKipFFqEFZb4kRytCXp2mJx02B_0 2024-09-14T11:22:51.356 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.354+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3537923248311530470', time=2024-09-14T13:15:00.596871+0000, chain.objs.size()=1 2024-09-14T11:22:51.356 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.354+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.vzM-ZMJ34-9IrPTWNADn693D0BarhhX_0 2024-09-14T11:22:51.356 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.354+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11099388828507275458', time=2024-09-14T13:15:00.627826+0000, chain.objs.size()=1 2024-09-14T11:22:51.356 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.354+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.EyvmdkZA3MGkBI35KKVAPGfQxdloe1s_0 2024-09-14T11:22:51.356 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.354+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13736253517954181553', time=2024-09-14T13:15:00.730214+0000, chain.objs.size()=1 2024-09-14T11:22:51.356 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.354+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.fLfbsf5HJtdJMFyuFBxOYzmOlQ8BlOg_0 2024-09-14T11:22:51.356 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.354+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10183632997733975024', time=2024-09-14T13:15:00.773178+0000, chain.objs.size()=1 2024-09-14T11:22:51.356 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.354+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.rc06w36vf0AL7tLmFlJX8vDEQ13M85v_0 2024-09-14T11:22:51.356 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.354+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16190936305697481142', time=2024-09-14T13:15:00.775052+0000, chain.objs.size()=1 2024-09-14T11:22:51.357 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.354+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.j_DzpWov_ONrT-0VPbxssztHsZ_eaRM_0 2024-09-14T11:22:51.357 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.354+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8564162548051455976', time=2024-09-14T13:15:00.793657+0000, chain.objs.size()=1 2024-09-14T11:22:51.357 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.354+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.LlrZimJI9QOi19eKTzUtkbcU6Noi-VE_0 2024-09-14T11:22:51.357 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.356+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.811845709902827434', time=2024-09-14T13:15:00.799237+0000, chain.objs.size()=1 2024-09-14T11:22:51.357 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.356+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.W_-N09CVaFhipQPE9o4dE4PfHFysl5__0 2024-09-14T11:22:51.357 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.356+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3930817095606269081', time=2024-09-14T13:15:00.901114+0000, chain.objs.size()=1 2024-09-14T11:22:51.357 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.356+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.tYJXZPRjMJGkT-MKC2AXBxtXBwSUQPd_0 2024-09-14T11:22:51.357 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.356+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15388150859403923505', time=2024-09-14T13:15:00.907751+0000, chain.objs.size()=1 2024-09-14T11:22:51.357 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.356+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.F6mG1AUSkBBt-DsrCko9yGKgO_SDs5y_0 2024-09-14T11:22:51.359 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.357+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.193664174306449995', time=2024-09-14T13:15:00.908935+0000, chain.objs.size()=1 2024-09-14T11:22:51.359 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.357+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.1t6giC_9mii2IqmyPh3Ue80UtvHOW_h_0 2024-09-14T11:22:51.359 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.357+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8927644014390063045', time=2024-09-14T13:15:00.912659+0000, chain.objs.size()=1 2024-09-14T11:22:51.359 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.357+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.L2WSe5EBS2gUUgyA0bXgxnZNhXObHxo_0 2024-09-14T11:22:51.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.357+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8051729617053484291', time=2024-09-14T13:15:00.915147+0000, chain.objs.size()=1 2024-09-14T11:22:51.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.357+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.4czjz9raP4W82RT93hvfCYtR2sIdbqZ_0 2024-09-14T11:22:51.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.357+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8387503199315595384', time=2024-09-14T13:15:00.928883+0000, chain.objs.size()=1 2024-09-14T11:22:51.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.357+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.C-9ptEvTtphIUB529Lx6pYpEuPO7zlt_0 2024-09-14T11:22:51.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.357+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17469712948929683362', time=2024-09-14T13:15:03.899792+0000, chain.objs.size()=1 2024-09-14T11:22:51.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.357+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.274__shadow_.o82xDUR13EoM71Dt6ImKKHFotNIaoMz_0 2024-09-14T11:22:51.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.357+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5395430619740838662', time=2024-09-14T13:15:05.715644+0000, chain.objs.size()=1 2024-09-14T11:22:51.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.357+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.281__shadow_.DVAtmS2j4lEdHSsQbjRB2lGAZJnKZFL_0 2024-09-14T11:22:51.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.357+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1368569216383804676', time=2024-09-14T13:15:06.174319+0000, chain.objs.size()=1 2024-09-14T11:22:51.360 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.357+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.282__shadow_.FHTxdIrqJAP5vAJv5x5xxnvZctoR8j6_0 2024-09-14T11:22:51.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.357+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4705911966677032341', time=2024-09-14T13:15:08.295549+0000, chain.objs.size()=1 2024-09-14T11:22:51.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.357+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.290__shadow_.6HeYuHVWX6HKs-KebxWycXNYgKJtHGF_0 2024-09-14T11:22:51.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.357+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4986008614666093952', time=2024-09-14T13:15:10.859986+0000, chain.objs.size()=1 2024-09-14T11:22:51.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.357+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.297__shadow_.XczTG2iXg-Esni6CGkGSbLTVYImH816_0 2024-09-14T11:22:51.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.357+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10434568056312324598', time=2024-09-14T13:15:24.739838+0000, chain.objs.size()=1 2024-09-14T11:22:51.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.357+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.RXNpAqMo8PlgnHRglbZVLSHIr_9ciMz_0 2024-09-14T11:22:51.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.357+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18256067673833805222', time=2024-09-14T13:15:24.890788+0000, chain.objs.size()=1 2024-09-14T11:22:51.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.357+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.hjxOGq_fjGcHjFPeERWArsbYNItEfcP_0 2024-09-14T11:22:51.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.359+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3831308328454499349', time=2024-09-14T13:15:24.897601+0000, chain.objs.size()=1 2024-09-14T11:22:51.361 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.359+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.lPqVlUxz5EIqGM-TfuEwOaFnsYnwEWk_0 2024-09-14T11:22:51.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.359+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2126989150166066127', time=2024-09-14T13:15:24.909340+0000, chain.objs.size()=1 2024-09-14T11:22:51.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.359+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.NhAY-iz9LtAyYXgaq7ewQ-CxJd-vEi8_0 2024-09-14T11:22:51.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.359+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.49492513075636737', time=2024-09-14T13:15:24.935913+0000, chain.objs.size()=1 2024-09-14T11:22:51.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.359+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.uAjChfUtJ2cPLBlhnv62k8jOjF3bGL7_0 2024-09-14T11:22:51.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.359+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3248510056156638495', time=2024-09-14T13:15:24.967099+0000, chain.objs.size()=1 2024-09-14T11:22:51.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.359+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.F6CyF6kN5wR4u43g8SCYdC8xCEVPCPD_0 2024-09-14T11:22:51.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.360+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6738185345215162873', time=2024-09-14T13:15:25.086392+0000, chain.objs.size()=1 2024-09-14T11:22:51.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.360+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.K0IW04z83yl6e2M9smNPve_M08L34Iy_0 2024-09-14T11:22:51.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.360+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15592897823983881798', time=2024-09-14T13:15:25.107991+0000, chain.objs.size()=1 2024-09-14T11:22:51.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.360+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.DFNA3k_VOLOmmyioggx6e5bWwEXhYco_0 2024-09-14T11:22:51.362 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.360+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15140996612813344707', time=2024-09-14T13:15:25.110256+0000, chain.objs.size()=1 2024-09-14T11:22:51.363 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.360+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.a9rEoCUBraN9cR2UllMNoxdO9VW-U1p_0 2024-09-14T11:22:51.363 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.360+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3037180712775270703', time=2024-09-14T13:15:25.114192+0000, chain.objs.size()=1 2024-09-14T11:22:51.363 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.360+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.xeFeLcKh957iUltFzaqH9pT1AUzrYKn_0 2024-09-14T11:22:51.363 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.360+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11374396997795139238', time=2024-09-14T13:15:25.115205+0000, chain.objs.size()=1 2024-09-14T11:22:51.363 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.360+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.hiswOshGfxlqvHPo3z8dI_Y2Mx7Cva__0 2024-09-14T11:22:51.363 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.360+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17535610202934275482', time=2024-09-14T13:15:25.125974+0000, chain.objs.size()=1 2024-09-14T11:22:51.363 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.360+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.S25k2TZh9KqrllbTF9MOgrwtdBi0SJQ_0 2024-09-14T11:22:51.363 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.360+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14099756169384774274', time=2024-09-14T13:15:25.228388+0000, chain.objs.size()=1 2024-09-14T11:22:51.363 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.360+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.dhH8zHG1uybB7rIXejygKui_PJfyXTr_0 2024-09-14T11:22:51.366 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.361+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3199645261758464982', time=2024-09-14T13:15:25.274305+0000, chain.objs.size()=1 2024-09-14T11:22:51.366 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.361+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.MDdTm4cvcVTzAYJ2iL-LYnq6o11_dB7_0 2024-09-14T11:22:51.366 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.361+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7205023994007570890', time=2024-09-14T13:15:25.392111+0000, chain.objs.size()=1 2024-09-14T11:22:51.366 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.361+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.e2y3MQxFitbnU2cmXcyKtJyNk24S3G9_0 2024-09-14T11:22:51.366 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.362+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7783548149841068273', time=2024-09-14T13:15:25.405083+0000, chain.objs.size()=1 2024-09-14T11:22:51.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.362+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.8if0429Nuo1eDw4Uf8uhujg5ENVgK86_0 2024-09-14T11:22:51.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.362+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8909928086994421334', time=2024-09-14T13:15:25.414536+0000, chain.objs.size()=1 2024-09-14T11:22:51.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.362+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.PqF3WJ_vghdCMEDaaly9sRjE5zsxfz1_0 2024-09-14T11:22:51.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.362+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.934816690457713303', time=2024-09-14T13:15:25.427343+0000, chain.objs.size()=1 2024-09-14T11:22:51.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.362+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.DTTPJO04xtDlWSNmEOii5EZOMSW63CF_0 2024-09-14T11:22:51.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.362+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13677230221772522266', time=2024-09-14T13:15:25.538864+0000, chain.objs.size()=1 2024-09-14T11:22:51.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.362+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.erdKNQL-tTmQFdMvrHucPQI2H2WKI9y_0 2024-09-14T11:22:51.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.362+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13614634352427035513', time=2024-09-14T13:15:25.542252+0000, chain.objs.size()=1 2024-09-14T11:22:51.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.362+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.lpbn8mVj9Inih5wJTEOwWSCWl7VAfeO_0 2024-09-14T11:22:51.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.362+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3505373476568403712', time=2024-09-14T13:15:25.575594+0000, chain.objs.size()=1 2024-09-14T11:22:51.367 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.362+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.Qe0jYP1b_IqZi23DRj3FFRsEf7DGnmP_0 2024-09-14T11:22:51.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.362+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11897120377299446729', time=2024-09-14T13:15:25.588850+0000, chain.objs.size()=1 2024-09-14T11:22:51.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.362+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.8oqnBcZbRuXrFMWf5-JwNkWQyAbGp6J_0 2024-09-14T11:22:51.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.362+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12217324707978893413', time=2024-09-14T13:15:25.611958+0000, chain.objs.size()=1 2024-09-14T11:22:51.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.362+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.-jYSRTo3mcOYv2G6vxo0t0cs-yy7z_a_0 2024-09-14T11:22:51.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.362+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16745652947235006806', time=2024-09-14T13:15:25.704132+0000, chain.objs.size()=1 2024-09-14T11:22:51.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.362+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.jdIplUa_nMMxL1uWJ8pRwgSoWGspoZs_0 2024-09-14T11:22:51.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.362+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17317930610517981126', time=2024-09-14T13:15:25.736271+0000, chain.objs.size()=1 2024-09-14T11:22:51.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.362+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.8CpWTYEd6H1sEf3DDlgU1DwctMi3wbb_0 2024-09-14T11:22:51.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.364+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16662114481670550557', time=2024-09-14T13:15:25.892660+0000, chain.objs.size()=1 2024-09-14T11:22:51.368 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.364+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.TVPHiiF31a5Lstl2qrrSzpN__iO1Nkd_0 2024-09-14T11:22:51.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.364+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12582732669056481729', time=2024-09-14T13:15:25.910749+0000, chain.objs.size()=1 2024-09-14T11:22:51.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.364+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.2hZ4DfXsYCt-GZFEC2pT2U_sS6Xuaq7_0 2024-09-14T11:22:51.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.364+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10585363749263333743', time=2024-09-14T13:15:33.183445+0000, chain.objs.size()=1 2024-09-14T11:22:51.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.364+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.gvXlJSrrULUPQxw2RGtUrgPHlc4zZq6_0 2024-09-14T11:22:51.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.364+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2069183735851394418', time=2024-09-14T13:15:33.205955+0000, chain.objs.size()=1 2024-09-14T11:22:51.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.364+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.sFDNwVHF_PS9jZ4s-A_Gjae61WDUuJq_0 2024-09-14T11:22:51.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.364+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10382045907579922826', time=2024-09-14T13:15:33.235369+0000, chain.objs.size()=1 2024-09-14T11:22:51.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.364+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.wJwb3bHyZmYEAkgjuLVo3fsKvE6qb9x_0 2024-09-14T11:22:51.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.364+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16501757141736974734', time=2024-09-14T13:15:33.239125+0000, chain.objs.size()=1 2024-09-14T11:22:51.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.364+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.-kEMOx0gTvLr8DN8eoeu6f_bVL4_NBP_0 2024-09-14T11:22:51.369 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.364+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9183469075382709672', time=2024-09-14T13:15:33.249120+0000, chain.objs.size()=1 2024-09-14T11:22:51.370 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.364+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.6FMgFmjZ1hdMcTJzGZPKpFtQoh8HB8k_0 2024-09-14T11:22:51.370 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.364+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15948538560008055005', time=2024-09-14T13:15:33.397779+0000, chain.objs.size()=1 2024-09-14T11:22:51.370 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.364+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.edFC7mtkjdCIUv0pqEQTydgjf65oyQp_0 2024-09-14T11:22:51.370 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.364+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15571103322925141790', time=2024-09-14T13:15:33.402875+0000, chain.objs.size()=1 2024-09-14T11:22:51.370 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.364+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Apks2J2R9k4lpvDcqfuN7my4hkg8-6G_0 2024-09-14T11:22:51.370 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.364+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5687360444054247608', time=2024-09-14T13:15:33.407661+0000, chain.objs.size()=1 2024-09-14T11:22:51.370 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.364+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.ZB6H4sHVjG9o7-UVgAK1xiwxr0qOOi8_0 2024-09-14T11:22:51.370 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.364+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10035743946646269439', time=2024-09-14T13:15:33.429550+0000, chain.objs.size()=1 2024-09-14T11:22:51.370 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.364+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.WbVpIbIHR2xqK2pVRwSsZ5kOyEwSoGD_0 2024-09-14T11:22:51.370 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.366+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10401389904461595092', time=2024-09-14T13:15:33.561908+0000, chain.objs.size()=1 2024-09-14T11:22:51.370 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.366+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.cyBz4pjaCJLfDjd12GgsNW9o3UIg4Oa_0 2024-09-14T11:22:51.371 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.366+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10196470480562740922', time=2024-09-14T13:15:33.599370+0000, chain.objs.size()=1 2024-09-14T11:22:51.371 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.366+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.lVnZ8aF7ej-qLCrrLAfyYZVBT4-NZ6J_0 2024-09-14T11:22:51.371 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.366+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11073548217549785154', time=2024-09-14T13:15:33.707853+0000, chain.objs.size()=1 2024-09-14T11:22:51.371 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.366+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.mdwt93Gh-sLui0gRgZVHkX4R27kK7ZW_0 2024-09-14T11:22:51.371 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.366+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2191553439901894852', time=2024-09-14T13:15:33.742982+0000, chain.objs.size()=1 2024-09-14T11:22:51.371 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.366+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.OrYbZbV55uJoq2LU64px4lBkq3Sn3vq_0 2024-09-14T11:22:51.371 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.366+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12134935314071892910', time=2024-09-14T13:15:33.770723+0000, chain.objs.size()=1 2024-09-14T11:22:51.371 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.366+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.GbZUEqps0-Ie-0vX92or_7hxChixEBM_0 2024-09-14T11:22:51.371 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.366+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8927772035482068187', time=2024-09-14T13:15:33.878667+0000, chain.objs.size()=1 2024-09-14T11:22:51.371 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.366+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.AnGyBwXJH3vTts6XYxuWg5D9OBxpClG_0 2024-09-14T11:22:51.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.366+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11320854258062400610', time=2024-09-14T13:15:33.905184+0000, chain.objs.size()=1 2024-09-14T11:22:51.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.366+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Fx3LugLFh1PyNxajBZNHF07MMl9QQaJ_0 2024-09-14T11:22:51.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.366+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13625090710375868740', time=2024-09-14T13:15:34.049473+0000, chain.objs.size()=1 2024-09-14T11:22:51.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.366+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Wdk37VcTxZoF_qjs7F98GmhaLsqFGrz_0 2024-09-14T11:22:51.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.366+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11821311622718488795', time=2024-09-14T13:15:34.067698+0000, chain.objs.size()=1 2024-09-14T11:22:51.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.366+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.kdrVVIRkuVmhWcfXVHmfg-dWxqx7QV7_0 2024-09-14T11:22:51.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.366+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1402225474850420996', time=2024-09-14T13:15:34.070698+0000, chain.objs.size()=1 2024-09-14T11:22:51.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.366+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.kqfzW1znCEhlyKGzb0IoRUnAOdfgass_0 2024-09-14T11:22:51.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.366+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3838348466305003487', time=2024-09-14T13:15:34.095428+0000, chain.objs.size()=1 2024-09-14T11:22:51.372 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.366+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.0dybSp-VaIJ4WgB4SOqVD1teie19xvS_0 2024-09-14T11:22:51.374 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.368+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10783076408604035052', time=2024-09-14T13:15:34.096853+0000, chain.objs.size()=1 2024-09-14T11:22:51.375 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.368+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.nD7V3XSXhIYJQPvTOpGcu3hjlORqUON_0 2024-09-14T11:22:51.375 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.368+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2831251420345841506', time=2024-09-14T13:15:34.098759+0000, chain.objs.size()=1 2024-09-14T11:22:51.375 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.368+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.R1A5RVDIriJkPidUJdSDyYAI4be0VNn_0 2024-09-14T11:22:51.375 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.368+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7979176705089508147', time=2024-09-14T13:15:34.100781+0000, chain.objs.size()=1 2024-09-14T11:22:51.375 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.368+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.q7DU1iu0X8mXy44pq4j9TZlnugc3mWm_0 2024-09-14T11:22:51.375 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.368+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17261114014934444138', time=2024-09-14T13:15:34.187329+0000, chain.objs.size()=1 2024-09-14T11:22:51.375 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.368+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.d272mey7r1w36ZVqKTbDBvd76LB5dEb_0 2024-09-14T11:22:51.375 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.368+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10353592733471196394', time=2024-09-14T13:15:34.226359+0000, chain.objs.size()=1 2024-09-14T11:22:51.375 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.368+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Vo8y1M1POS0WMz3d4DuQEfN_fGhFq-o_0 2024-09-14T11:22:51.375 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.368+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10450232444312574166', time=2024-09-14T13:15:34.238450+0000, chain.objs.size()=1 2024-09-14T11:22:51.376 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.368+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.1wNNp9pY_TsNz5GPSiZzl_88vVFHSh9_0 2024-09-14T11:22:51.376 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.368+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8603796386914353440', time=2024-09-14T13:15:34.251724+0000, chain.objs.size()=1 2024-09-14T11:22:51.376 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.368+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.0nvMzDLtt79LHwK00DVtB4KQex9OAHc_0 2024-09-14T11:22:51.376 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.369+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6574386393137901689', time=2024-09-14T13:15:34.254569+0000, chain.objs.size()=1 2024-09-14T11:22:51.376 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.369+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.7fR-WWPtHm58J5GcoRXbPS65Eie-3II_0 2024-09-14T11:22:51.376 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.370+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 0/49218 2024-09-14T11:22:51.376 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.373+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=26, truncated=0, next_marker='' 2024-09-14T11:22:51.376 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.373+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9928556211799205329', time=2024-09-14T13:15:34.259156+0000, chain.objs.size()=1 2024-09-14T11:22:51.376 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.373+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.R8BjqZFDkBsrORqrpl2tlBCtK15Pivh_0 2024-09-14T11:22:51.376 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.373+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5889421828320033708', time=2024-09-14T13:15:34.359764+0000, chain.objs.size()=1 2024-09-14T11:22:51.376 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.373+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.DKLPsR8O113pNNurA4o5tMp43WsTuPp_0 2024-09-14T11:22:51.377 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.373+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17922686632564018142', time=2024-09-14T13:15:34.394462+0000, chain.objs.size()=1 2024-09-14T11:22:51.377 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.373+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.nWzhGX9sS-lJ9vRf3Kf4xnSRuUDvKQa_0 2024-09-14T11:22:51.377 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.373+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6025428246147959368', time=2024-09-14T13:15:44.881100+0000, chain.objs.size()=1 2024-09-14T11:22:51.377 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.373+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.372__shadow_.l6ZsxQQrpZlgECSZQQSXpqye5Jyg0hn_0 2024-09-14T11:22:51.377 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.373+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7484573982871285021', time=2024-09-14T13:15:45.147283+0000, chain.objs.size()=1 2024-09-14T11:22:51.377 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.373+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.373__shadow_.uuiSC-IHUZWnQrvMCRGdgUsfKjICAcX_0 2024-09-14T11:22:51.377 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.373+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17036183743723216718', time=2024-09-14T13:15:49.211673+0000, chain.objs.size()=1 2024-09-14T11:22:51.377 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.373+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.383__shadow_.tf4MD-3y74SgQ5wDuIgBquIgUvpiqBq_0 2024-09-14T11:22:51.377 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.373+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16025659171075823797', time=2024-09-14T13:16:02.032292+0000, chain.objs.size()=1 2024-09-14T11:22:51.377 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.373+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.429__shadow_.WPV_3NX9COI-emBPTq5SGGf7vxxa9ae_0 2024-09-14T11:22:51.377 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.373+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10619765181797189669', time=2024-09-14T13:16:10.238890+0000, chain.objs.size()=1 2024-09-14T11:22:51.377 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.373+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.457__shadow_.Opain803MX5Bvbx2x22yUaV6v2hq5oo_0 2024-09-14T11:22:51.378 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.373+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11106551994511231513', time=2024-09-14T13:16:17.244930+0000, chain.objs.size()=1 2024-09-14T11:22:51.378 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.373+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.484__shadow_.hFO3OBBJHE-xPOjJYyrp6ivdK3OHO4T_0 2024-09-14T11:22:51.378 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.373+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2526528602970551463', time=2024-09-14T13:16:22.805900+0000, chain.objs.size()=1 2024-09-14T11:22:51.378 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.373+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.503__shadow:pymE41PAtqbkcQ6I2URloKvd5muPSJ-_.UInzhQl7TQvRYLWzEBL5Aj5TYH25pWP_0 2024-09-14T11:22:51.378 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.373+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17718610856365675893', time=2024-09-14T13:16:24.893914+0000, chain.objs.size()=6 2024-09-14T11:22:51.378 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.373+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.507__multipart_srcmultipart.2~EQ3ZZNALHrAJsVAZLD-5msuDtyJwYup.1 2024-09-14T11:22:51.378 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.373+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.507__multipart_srcmultipart.2~EQ3ZZNALHrAJsVAZLD-5msuDtyJwYup.2 2024-09-14T11:22:51.378 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.374+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.507__multipart_srcmultipart.2~EQ3ZZNALHrAJsVAZLD-5msuDtyJwYup.3 2024-09-14T11:22:51.378 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.374+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.507__multipart_srcmultipart.2~EQ3ZZNALHrAJsVAZLD-5msuDtyJwYup.4 2024-09-14T11:22:51.378 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.376+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.507__multipart_srcmultipart.2~EQ3ZZNALHrAJsVAZLD-5msuDtyJwYup.5 2024-09-14T11:22:51.378 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.376+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.507__multipart_srcmultipart.2~EQ3ZZNALHrAJsVAZLD-5msuDtyJwYup.6 2024-09-14T11:22:51.379 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.376+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6724180101032498770', time=2024-09-14T13:16:26.598650+0000, chain.objs.size()=1 2024-09-14T11:22:51.379 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.376+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.515__shadow_.OKPnpsvfZJNTXcCSIcQ3zVURUuj21RS_0 2024-09-14T11:22:51.379 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.376+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9442357004601665122', time=2024-09-14T13:16:27.914313+0000, chain.objs.size()=1 2024-09-14T11:22:51.379 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.376+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.517__shadow_.OQ7oGiMXp5AhhlUlRc0c6y6ansmE5L__0 2024-09-14T11:22:51.379 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.376+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17116306311314411828', time=2024-09-14T13:16:30.851740+0000, chain.objs.size()=3 2024-09-14T11:22:51.379 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.376+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.521__multipart_mymultipart.2~He9-B_6AcKsxlTX4-jXLUidQvBfynlZ.1 2024-09-14T11:22:51.380 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.376+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.521__multipart_mymultipart.2~He9-B_6AcKsxlTX4-jXLUidQvBfynlZ.2 2024-09-14T11:22:51.380 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.376+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.521__multipart_mymultipart.2~He9-B_6AcKsxlTX4-jXLUidQvBfynlZ.3 2024-09-14T11:22:51.380 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.376+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='2~4L1LiNuubgrp1jaq-ztcgV5wIlnWTNi', time=2024-09-14T13:16:31.693395+0000, chain.objs.size()=1 2024-09-14T11:22:51.381 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.376+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.522__multipart_mymultipart.2~4L1LiNuubgrp1jaq-ztcgV5wIlnWTNi.1 2024-09-14T11:22:51.381 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.376+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13588108405354961607', time=2024-09-14T13:16:39.328835+0000, chain.objs.size()=2 2024-09-14T11:22:51.381 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.376+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.528__multipart_mymultipart.2~KU3y3XXkEUzQeBKkx4VwAfrFlH54uCz.1 2024-09-14T11:22:51.381 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.376+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.528__multipart_mymultipart.2~KU3y3XXkEUzQeBKkx4VwAfrFlH54uCz.2 2024-09-14T11:22:51.381 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.376+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16607809437259458742', time=2024-09-14T13:16:57.717157+0000, chain.objs.size()=1 2024-09-14T11:22:51.381 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.376+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.537__shadow_.jNWUG1ikahQOlWydLs5F0o4sQ5YtTsp_0 2024-09-14T11:22:51.381 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.378+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11276169747243780380', time=2024-09-14T13:17:22.808452+0000, chain.objs.size()=1 2024-09-14T11:22:51.381 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.378+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.569__shadow:wqXf8s3XCzq6.i7iunLWfiY.pDx1U3u_._cBudv-y1L9phvO3VmGmOHt2kPwQh6e_0 2024-09-14T11:22:51.381 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.379+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7456659552201219505', time=2024-09-14T13:17:24.147303+0000, chain.objs.size()=1 2024-09-14T11:22:51.381 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.379+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.569__shadow:wNGRilKeDXG1xC4PGRth4u5AtcTmFXH_.vOzYrRvxxuSYZ14bMUFRWzSWtzSNBqe_0 2024-09-14T11:22:51.381 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.379+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14730571186004368070', time=2024-09-14T13:17:36.300208+0000, chain.objs.size()=1 2024-09-14T11:22:51.382 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.379+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.577__shadow:exJybxp0SXTR4EtkS-ps4A6XX2ojdKm_.pC9EZBpNyZAEcSLLRYtr9s7mAHe8siH_0 2024-09-14T11:22:51.382 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.379+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14215498691331931076', time=2024-09-14T13:17:44.465385+0000, chain.objs.size()=1 2024-09-14T11:22:51.382 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.379+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.577__shadow:mIszFRr94sQ19TjE5Jpu9cBYTXRScYz_.n1gv3Pi82QH-GZCL2Oyo-joUcPtWy9u_0 2024-09-14T11:22:51.382 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.379+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2516161310455505958', time=2024-09-14T13:17:53.152378+0000, chain.objs.size()=1 2024-09-14T11:22:51.382 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.379+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.586__shadow:yccmnSVDVh-ITTkkgnWRGzLiKcQkUyk_.sGHSKMgPl7m2qpxvcsc3nnjS9SXFRRg_0 2024-09-14T11:22:51.382 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.379+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7930559779488637606', time=2024-09-14T13:20:29.374660+0000, chain.objs.size()=1 2024-09-14T11:22:51.382 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.379+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.700__shadow:XryrFHL5cgFvRBTTnZl2t5jBTAIofNj_.VnEc19XxFmRUptfwAKKokR7RmPlZbin_0 2024-09-14T11:22:51.382 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.379+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17689208910114245478', time=2024-09-14T13:21:05.307561+0000, chain.objs.size()=1 2024-09-14T11:22:51.382 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.379+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.752__shadow_.lRjj9lJXkwQE8yl68WlfsyEmhAgVBRj_0 2024-09-14T11:22:51.382 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.379+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5178104462949115852', time=2024-09-14T13:21:05.922860+0000, chain.objs.size()=1 2024-09-14T11:22:51.382 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.379+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.753__shadow_.2YoIduVnUvU-pr8gnYYJYDnrtVkZJhf_0 2024-09-14T11:22:51.383 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.379+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4468067061535747738', time=2024-09-14T13:21:15.373386+0000, chain.objs.size()=1 2024-09-14T11:22:51.383 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.379+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.775__shadow_.WHTZuoreGQZyqORI_Z__ivhvHZaeQPO_0 2024-09-14T11:22:51.383 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.381+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:51.383 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.383+0000 7f0f19c16800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:22:51.383 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.385+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:51.384 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.385+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:51.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.386+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48087' 2024-09-14T11:22:51.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.386+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16648221283324021729', time=2024-09-14T13:13:35.616647+0000, chain.objs.size()=3 2024-09-14T11:22:51.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.386+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.161__multipart_foo-STANDARD.2~I9V6hBMxCb0i5zgG2UXsEgaA1JQQJlL.1 2024-09-14T11:22:51.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.386+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.161__multipart_foo-STANDARD.2~I9V6hBMxCb0i5zgG2UXsEgaA1JQQJlL.2 2024-09-14T11:22:51.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.386+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.161__multipart_foo-STANDARD.2~I9V6hBMxCb0i5zgG2UXsEgaA1JQQJlL.3 2024-09-14T11:22:51.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.386+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='_AXvuCMI7N1vDh3s6LoDiwF4_JLKnVp5', time=2024-09-14T13:13:37.833434+0000, chain.objs.size()=1 2024-09-14T11:22:51.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.386+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.165__shadow_.8Gludmv68CkW-7B-aeTpeFdxeak9j1o_0 2024-09-14T11:22:51.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.386+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12862715825941603196', time=2024-09-14T13:14:49.565842+0000, chain.objs.size()=1 2024-09-14T11:22:51.386 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.386+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.249__shadow_.eDECKJtv5BHKX5Thv_Bhq7S1LYgXiJx_0 2024-09-14T11:22:51.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.386+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.866425009449288232', time=2024-09-14T13:14:49.566566+0000, chain.objs.size()=1 2024-09-14T11:22:51.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.386+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.249__shadow_.GvI7FtHNN178tjcuH4rL74MZxzcDD5G_0 2024-09-14T11:22:51.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.386+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10497183500124440446', time=2024-09-14T13:14:49.814245+0000, chain.objs.size()=1 2024-09-14T11:22:51.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.386+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.250__shadow_.V49EIBR3Zl6Idg-w8uV3sPsO1T4unTB_0 2024-09-14T11:22:51.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.386+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10886757000331073700', time=2024-09-14T13:14:49.814994+0000, chain.objs.size()=1 2024-09-14T11:22:51.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.386+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.250__shadow_.AVLxEVAJ1sC7ecI-8CtN10O7828ZwK4_0 2024-09-14T11:22:51.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.386+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15574941005019908912', time=2024-09-14T13:14:50.852425+0000, chain.objs.size()=1 2024-09-14T11:22:51.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.386+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.254__shadow_.QwwYLAcoQs5sCVNVLfj6SvQrpzRwkpx_0 2024-09-14T11:22:51.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.386+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9122169596225771271', time=2024-09-14T13:14:59.738299+0000, chain.objs.size()=1 2024-09-14T11:22:51.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.386+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.r3_QFRBCSTBHKgVhymnHwi7-WpDwqXx_0 2024-09-14T11:22:51.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.386+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3273012866674345248', time=2024-09-14T13:14:59.789057+0000, chain.objs.size()=1 2024-09-14T11:22:51.387 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.386+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.06tw8nig_ys_ANke7uiKJH-8xsyFBQE_0 2024-09-14T11:22:51.388 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.386+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3660326854951699221', time=2024-09-14T13:14:59.811271+0000, chain.objs.size()=1 2024-09-14T11:22:51.388 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.386+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.GXAHhPXgKdSf_d7-H5d1TcUsR5-mUVL_0 2024-09-14T11:22:51.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.388+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2894049532694006793', time=2024-09-14T13:14:59.899997+0000, chain.objs.size()=1 2024-09-14T11:22:51.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.388+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.28I1pVZZIFVleG6nUWY7sU8HoJFYMu4_0 2024-09-14T11:22:51.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.388+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.241564524103630337', time=2024-09-14T13:14:59.918592+0000, chain.objs.size()=1 2024-09-14T11:22:51.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.388+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_._GsjmQp3MEeSeLmgrPExfI9lOlrXsXi_0 2024-09-14T11:22:51.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.388+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6988382578472823007', time=2024-09-14T13:14:59.928199+0000, chain.objs.size()=1 2024-09-14T11:22:51.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.388+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.XQyE0eOHUkx62f6UhABiQjj9SvohP6h_0 2024-09-14T11:22:51.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.388+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.638203098936011159', time=2024-09-14T13:14:59.931636+0000, chain.objs.size()=1 2024-09-14T11:22:51.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.388+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.EerYBmGCwHaCYMuNpp-nTXFZe0cMB9G_0 2024-09-14T11:22:51.390 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.388+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6204147670593495972', time=2024-09-14T13:14:59.944501+0000, chain.objs.size()=1 2024-09-14T11:22:51.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.388+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.YMWyVcDFc2ehlyqPV5sZm6GTwEnRnly_0 2024-09-14T11:22:51.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.388+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12643714865758991645', time=2024-09-14T13:15:00.064744+0000, chain.objs.size()=1 2024-09-14T11:22:51.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.388+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Xiq0l1GLF1ROgKA5JKnpHMsEUVRZ4cn_0 2024-09-14T11:22:51.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.388+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1241996901191524312', time=2024-09-14T13:15:00.114516+0000, chain.objs.size()=1 2024-09-14T11:22:51.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.388+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.cc5j0DS-0HQm0XzHe1hX3_AB1Rrefqr_0 2024-09-14T11:22:51.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.388+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17897137899130614139', time=2024-09-14T13:15:00.255034+0000, chain.objs.size()=1 2024-09-14T11:22:51.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.388+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_._dV-f3BFG9PVUvzXGzhncp1qPXwL2ir_0 2024-09-14T11:22:51.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.388+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17234512791528974417', time=2024-09-14T13:15:00.282990+0000, chain.objs.size()=1 2024-09-14T11:22:51.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.388+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.M0BAIMeDfbwAEWP8xu-ge6MM27-emfu_0 2024-09-14T11:22:51.391 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.388+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4014590798370363756', time=2024-09-14T13:15:00.313955+0000, chain.objs.size()=1 2024-09-14T11:22:51.392 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.388+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.nu8A_pJU84ciDPNYBBDOGnw4ydT65nl_0 2024-09-14T11:22:51.392 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.388+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10674462965386143836', time=2024-09-14T13:15:00.435899+0000, chain.objs.size()=1 2024-09-14T11:22:51.392 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.388+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.axNdCV1-OYKP2EkC4TnfMqFX5mA-mqW_0 2024-09-14T11:22:51.392 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.390+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13087068756688511125', time=2024-09-14T13:15:00.453252+0000, chain.objs.size()=1 2024-09-14T11:22:51.392 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.390+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.jscP7yPyb-BNVZWYeUd70eiQd_FaOJw_0 2024-09-14T11:22:51.392 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.390+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5027330354525143004', time=2024-09-14T13:15:00.584963+0000, chain.objs.size()=1 2024-09-14T11:22:51.392 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.390+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.b4US7pMQ_VPnumyfbHRYhqBNJGeKx-9_0 2024-09-14T11:22:51.392 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.390+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2452062311052860543', time=2024-09-14T13:15:00.623442+0000, chain.objs.size()=1 2024-09-14T11:22:51.392 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.390+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.NVwFqLw5XB3st3yeF5rem54zdrHhejA_0 2024-09-14T11:22:51.392 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.390+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13880006910521764002', time=2024-09-14T13:15:00.723935+0000, chain.objs.size()=1 2024-09-14T11:22:51.392 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.390+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.erf05VFKmpQDrrm2nt1FfVp0xM6Hm33_0 2024-09-14T11:22:51.392 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.390+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.66134975862271473', time=2024-09-14T13:15:00.739611+0000, chain.objs.size()=1 2024-09-14T11:22:51.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.390+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.cDlgwwfKPbhRrAQgKTz8zj8JvfELHAs_0 2024-09-14T11:22:51.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.390+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15372421661987486044', time=2024-09-14T13:15:00.740671+0000, chain.objs.size()=1 2024-09-14T11:22:51.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.390+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.jeFvLNHshsHBoGioL75eQZvxJvn6gU__0 2024-09-14T11:22:51.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.390+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6195356203173460438', time=2024-09-14T13:15:00.741530+0000, chain.objs.size()=1 2024-09-14T11:22:51.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.390+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.NOUVdYhJWMtPfi_I8Ea_yWFRDdEAg3W_0 2024-09-14T11:22:51.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.390+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14450051353723521926', time=2024-09-14T13:15:00.760608+0000, chain.objs.size()=1 2024-09-14T11:22:51.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.390+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.IIoBcx9Bjb2kpzINPSURkS_ZcVXAbhG_0 2024-09-14T11:22:51.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.390+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7364584241902938573', time=2024-09-14T13:15:00.785837+0000, chain.objs.size()=1 2024-09-14T11:22:51.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.390+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.1D_5nG9eDUyMsQIxIhijisjVlH7SIxA_0 2024-09-14T11:22:51.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.391+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9856261369259700713', time=2024-09-14T13:15:00.801414+0000, chain.objs.size()=1 2024-09-14T11:22:51.393 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.391+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.GHgHwPAxNeGzNz1jhvFCRdN_BnDfEvX_0 2024-09-14T11:22:51.394 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.391+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17602908228534434472', time=2024-09-14T13:15:00.945659+0000, chain.objs.size()=1 2024-09-14T11:22:51.394 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.391+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Up1KYSsXjxjjGIpu-2LD5LQ70TUj3M8_0 2024-09-14T11:22:51.396 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.392+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7723983528925186758', time=2024-09-14T13:15:00.946737+0000, chain.objs.size()=1 2024-09-14T11:22:51.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.392+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.PZJsGfEnmoYHgqcoyuiq86EgbkkhhyQ_0 2024-09-14T11:22:51.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.392+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8423213816845681830', time=2024-09-14T13:15:02.404921+0000, chain.objs.size()=1 2024-09-14T11:22:51.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.392+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.268__shadow_.5DqpJUDHzQCV5DVG1ScnzgViAL7NrWN_0 2024-09-14T11:22:51.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.392+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5822702713007025352', time=2024-09-14T13:15:02.889857+0000, chain.objs.size()=1 2024-09-14T11:22:51.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.392+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.270__shadow_.rYiNIODM2OT7WYfW3wuqk4QAbfreNPX_0 2024-09-14T11:22:51.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.392+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6584641023484181908', time=2024-09-14T13:15:04.149756+0000, chain.objs.size()=1 2024-09-14T11:22:51.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.392+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.275__shadow_.7eUXBS8RTgKBFJPb2eDEXtj4s_eRR4j_0 2024-09-14T11:22:51.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.392+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15110928017996239084', time=2024-09-14T13:15:04.717152+0000, chain.objs.size()=1 2024-09-14T11:22:51.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.392+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.277__shadow_.DZUxRPsk8DawatI3fVLG1EjkLUsDtnz_0 2024-09-14T11:22:51.397 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.392+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6521769440850518585', time=2024-09-14T13:15:05.218187+0000, chain.objs.size()=1 2024-09-14T11:22:51.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.392+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.279__shadow_.ffc4dQxocPANOo4OXARILag0EceP7Gz_0 2024-09-14T11:22:51.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.392+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10671453428186118428', time=2024-09-14T13:15:05.468386+0000, chain.objs.size()=1 2024-09-14T11:22:51.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.392+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.280__shadow_.2kkLXGFKSs21g-P3F7r4OfQ9xyJi1or_0 2024-09-14T11:22:51.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.392+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14097852197630527285', time=2024-09-14T13:15:07.001915+0000, chain.objs.size()=1 2024-09-14T11:22:51.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.392+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.285__shadow_.FrRcH9AcDfgz4n9cQb4lRny6bwN1aL__0 2024-09-14T11:22:51.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.392+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9442743702860753185', time=2024-09-14T13:15:09.829171+0000, chain.objs.size()=1 2024-09-14T11:22:51.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.392+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.293__shadow_.TAcL4RKsbsvyOh6W9g_SmFgy-NSpMu6_0 2024-09-14T11:22:51.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.393+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13345187472720122474', time=2024-09-14T13:15:09.836073+0000, chain.objs.size()=1 2024-09-14T11:22:51.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.393+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.293__shadow_.IjC1ULngxydy3S2N18qJdI6zh8eIHa-_0 2024-09-14T11:22:51.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.393+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3520110432137950758', time=2024-09-14T13:15:10.323459+0000, chain.objs.size()=1 2024-09-14T11:22:51.398 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.393+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.295__shadow_.ngXtVlb4SX9eAe5QAp7KIcQWaASB1EE_0 2024-09-14T11:22:51.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.394+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7050874961918980143', time=2024-09-14T13:15:11.444518+0000, chain.objs.size()=1 2024-09-14T11:22:51.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.394+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.299__shadow_.IcEv_byRuykyCwVIftfolsEK1Nrmu8j_0 2024-09-14T11:22:51.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.394+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13835140961684870708', time=2024-09-14T13:15:12.737991+0000, chain.objs.size()=1 2024-09-14T11:22:51.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.394+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.304__shadow_.9TRAEkWX91t61CvU4BTEvTNE7DwbD6D_0 2024-09-14T11:22:51.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.394+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4228374191452063999', time=2024-09-14T13:15:16.894400+0000, chain.objs.size()=1 2024-09-14T11:22:51.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.394+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.321__shadow_.NLiC6D9sAbTxsiTphWN26rJflMVcq-S_0 2024-09-14T11:22:51.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.394+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11317492427708027846', time=2024-09-14T13:15:24.722666+0000, chain.objs.size()=1 2024-09-14T11:22:51.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.394+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.qnHRjm3qYZFQSP9GVH2RZmjknDr7_Ju_0 2024-09-14T11:22:51.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.394+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9259333467405437543', time=2024-09-14T13:15:24.760439+0000, chain.objs.size()=1 2024-09-14T11:22:51.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.394+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.exLzyDhGnbOFvXpmBHAq3yhs-cJ44c6_0 2024-09-14T11:22:51.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.394+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9702201327442398639', time=2024-09-14T13:15:24.772132+0000, chain.objs.size()=1 2024-09-14T11:22:51.399 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.394+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.vuKOG22MdNkFqKo9n1e7I6IYoOFi-Oi_0 2024-09-14T11:22:51.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.395+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4800653860500461422', time=2024-09-14T13:15:24.801534+0000, chain.objs.size()=1 2024-09-14T11:22:51.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.395+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.U5iX9m4SnONlZVyBLOo7nkPEXKm8cuK_0 2024-09-14T11:22:51.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.395+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3749558735062510648', time=2024-09-14T13:15:24.882897+0000, chain.objs.size()=1 2024-09-14T11:22:51.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.395+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.MqtAScWvyArZKrjL1ylcElydSGMty8K_0 2024-09-14T11:22:51.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.395+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18263747401744259962', time=2024-09-14T13:15:24.883579+0000, chain.objs.size()=1 2024-09-14T11:22:51.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.395+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.pdcBjp_EDY_pC3CHXvXG8cZLhC_QDwL_0 2024-09-14T11:22:51.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.395+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9608687623488114730', time=2024-09-14T13:15:24.906350+0000, chain.objs.size()=1 2024-09-14T11:22:51.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.395+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.ZcVU4tnD5qKjfvZEIWSnGT-HtAhdait_0 2024-09-14T11:22:51.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.395+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8475930954324215096', time=2024-09-14T13:15:25.110524+0000, chain.objs.size()=1 2024-09-14T11:22:51.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.395+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.epVwAy1nOMoAuqPbWr4_6MUh63QjgnJ_0 2024-09-14T11:22:51.400 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.395+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12869330936944917321', time=2024-09-14T13:15:25.221087+0000, chain.objs.size()=1 2024-09-14T11:22:51.401 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.395+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.SOra2PvbnHtAehRF7Sa1xZSIrH1Jk3e_0 2024-09-14T11:22:51.401 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.396+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8076001294244901495', time=2024-09-14T13:15:25.249660+0000, chain.objs.size()=1 2024-09-14T11:22:51.401 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.396+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.hrk_MKdxstR6DhMwToSXWoBVWdk4-cu_0 2024-09-14T11:22:51.401 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.396+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7640283670111668941', time=2024-09-14T13:15:25.287159+0000, chain.objs.size()=1 2024-09-14T11:22:51.401 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.396+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.n3lzs8-cPehWH1fGazUs3R6PmTXRbAo_0 2024-09-14T11:22:51.401 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.397+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4806539291652321142', time=2024-09-14T13:15:25.537443+0000, chain.objs.size()=1 2024-09-14T11:22:51.401 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.397+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.ZmRnSaVqPQxZgp6uxJ1OHFx0ICsFWAL_0 2024-09-14T11:22:51.401 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.397+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6425933820751291668', time=2024-09-14T13:15:25.552285+0000, chain.objs.size()=1 2024-09-14T11:22:51.401 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.397+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.rYfJwmJDCfuR67IjELDbUFxXZVZVi43_0 2024-09-14T11:22:51.401 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.397+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15987063227771913463', time=2024-09-14T13:15:25.563762+0000, chain.objs.size()=1 2024-09-14T11:22:51.402 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.397+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.2HDMtVLyW8YM0ZmYkrr4dxi6ireg2GB_0 2024-09-14T11:22:51.402 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.397+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16199405985207120991', time=2024-09-14T13:15:25.720468+0000, chain.objs.size()=1 2024-09-14T11:22:51.402 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.397+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.VJySbCXXGsvFw1ZiwYKCCbcJHlX4gzL_0 2024-09-14T11:22:51.402 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.397+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4629697134792881666', time=2024-09-14T13:15:25.768658+0000, chain.objs.size()=1 2024-09-14T11:22:51.402 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.397+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.FIq0NaJXaRrhYfRcJrkgAj5olwmN8sD_0 2024-09-14T11:22:51.402 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.397+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9645612360464378292', time=2024-09-14T13:15:25.883516+0000, chain.objs.size()=1 2024-09-14T11:22:51.402 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.397+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.-p5zCgctPirPliEPCuUNO6IxtmW4r9h_0 2024-09-14T11:22:51.402 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.397+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8528946394648206845', time=2024-09-14T13:15:25.894941+0000, chain.objs.size()=1 2024-09-14T11:22:51.402 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.397+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.w6LLODfSlFyi1PaE7HluXJG6P11HYVA_0 2024-09-14T11:22:51.402 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.397+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6167549070216045420', time=2024-09-14T13:15:25.912306+0000, chain.objs.size()=1 2024-09-14T11:22:51.402 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.397+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.9GGbGPS6TI8iYevTlGru1xD8jYaBpLq_0 2024-09-14T11:22:51.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.397+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9489626841823292887', time=2024-09-14T13:15:25.938416+0000, chain.objs.size()=1 2024-09-14T11:22:51.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.397+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.CCeQ-tasuq3xEdUn-Ys9Y-nMnXa5y_7_0 2024-09-14T11:22:51.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.397+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6445514532312914024', time=2024-09-14T13:15:25.947052+0000, chain.objs.size()=1 2024-09-14T11:22:51.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.397+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.HcnGMijHq1ff1LhBFV6dCdqOO-s2fdk_0 2024-09-14T11:22:51.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.397+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7838535994168742309', time=2024-09-14T13:15:33.201819+0000, chain.objs.size()=1 2024-09-14T11:22:51.403 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.397+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.SJutYUrTCUWCyw5AV4N5SmHAySp_2Bb_0 2024-09-14T11:22:51.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.399+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6405000656354311748', time=2024-09-14T13:15:33.254034+0000, chain.objs.size()=1 2024-09-14T11:22:51.405 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.399+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.kqbDXIrGPidPpvCw-xQscbhHKKF7tDy_0 2024-09-14T11:22:51.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.399+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10009941700784388786', time=2024-09-14T13:15:33.408706+0000, chain.objs.size()=1 2024-09-14T11:22:51.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.399+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.qSKOhkfHWG1ZS1IS9rLUa-w090xPrTG_0 2024-09-14T11:22:51.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.399+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13972778257929402641', time=2024-09-14T13:15:33.532478+0000, chain.objs.size()=1 2024-09-14T11:22:51.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.399+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.zKMfn2f4kKxL6GzRXAoQmQHIpsfBiB1_0 2024-09-14T11:22:51.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.399+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3737810062880988863', time=2024-09-14T13:15:33.576150+0000, chain.objs.size()=1 2024-09-14T11:22:51.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.399+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.NwhmYDzbNdVhUSrzxDV--MzE3QEl2qC_0 2024-09-14T11:22:51.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.399+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9591182630029484844', time=2024-09-14T13:15:33.602603+0000, chain.objs.size()=1 2024-09-14T11:22:51.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.399+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.KrTG_eWr4ZpaCaW9V2grh6DOgJ9Zkcc_0 2024-09-14T11:22:51.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.400+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13653595349332968123', time=2024-09-14T13:15:33.615071+0000, chain.objs.size()=1 2024-09-14T11:22:51.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.400+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.o7tgUex3tsHtfz5h7eOxFhBypYA52ZZ_0 2024-09-14T11:22:51.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.400+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7366769680099075719', time=2024-09-14T13:15:33.706419+0000, chain.objs.size()=1 2024-09-14T11:22:51.406 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.400+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Rgvs8GWmhbLlx1x3Zl5WIhVLG7rpUDs_0 2024-09-14T11:22:51.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.400+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1035705185848110958', time=2024-09-14T13:15:33.732988+0000, chain.objs.size()=1 2024-09-14T11:22:51.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.400+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.4O_ILl9KCHWOEU64fkIJXiox3uGscve_0 2024-09-14T11:22:51.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.400+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12282982876463035331', time=2024-09-14T13:15:33.753602+0000, chain.objs.size()=1 2024-09-14T11:22:51.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.400+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.qDOMLvXo3aC97EG11F88fs39QI-uXX1_0 2024-09-14T11:22:51.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.400+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16814231355555337486', time=2024-09-14T13:15:33.761040+0000, chain.objs.size()=1 2024-09-14T11:22:51.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.400+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.5XH91CHY6kdRapQCD7BMXL2Mbnjkj_W_0 2024-09-14T11:22:51.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.400+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17665243769284989947', time=2024-09-14T13:15:33.852093+0000, chain.objs.size()=1 2024-09-14T11:22:51.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.400+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.zBh4Ph1OdoYrxuGXtP3pK7-M5spbsVK_0 2024-09-14T11:22:51.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.400+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17734351214341950789', time=2024-09-14T13:15:33.853507+0000, chain.objs.size()=1 2024-09-14T11:22:51.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.400+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.FqY8a8PJ3TZnt4K3924XnYUgVbWRjOJ_0 2024-09-14T11:22:51.407 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.401+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4477106477210603005', time=2024-09-14T13:15:33.854398+0000, chain.objs.size()=1 2024-09-14T11:22:51.408 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.401+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.AtO-VsHkrfugmS1z1LHAGnWD0CZHlT3_0 2024-09-14T11:22:51.408 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.402+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6299445273109181475', time=2024-09-14T13:15:33.886663+0000, chain.objs.size()=1 2024-09-14T11:22:51.408 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.402+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.QlomwRRe5AuU_NBW4vnWv6oeQ2j6H2m_0 2024-09-14T11:22:51.408 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.402+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8818938718282796113', time=2024-09-14T13:15:33.936254+0000, chain.objs.size()=1 2024-09-14T11:22:51.408 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.402+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.v9ONyKRZfSvUomTrfzKfZvC9uu6_ChN_0 2024-09-14T11:22:51.408 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.402+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18429799408216921450', time=2024-09-14T13:15:33.940012+0000, chain.objs.size()=1 2024-09-14T11:22:51.408 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.402+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Pwnjch9MXOl0iklaRPzXbzT2kfntTMZ_0 2024-09-14T11:22:51.408 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.402+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4164203381781753911', time=2024-09-14T13:15:34.012236+0000, chain.objs.size()=1 2024-09-14T11:22:51.408 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.402+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.f7MRF4DpCklla8SlRxmURM6UgSkz6u6_0 2024-09-14T11:22:51.408 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.402+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11157339261380054610', time=2024-09-14T13:15:34.037803+0000, chain.objs.size()=1 2024-09-14T11:22:51.408 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.402+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.l3rT66-pLKbqktElT1evsjJGupPSxzf_0 2024-09-14T11:22:51.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.402+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10304707344543661805', time=2024-09-14T13:15:34.189497+0000, chain.objs.size()=1 2024-09-14T11:22:51.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.402+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.T_ew7RW5XfsUVAbgi4gkJLt6KMR32BX_0 2024-09-14T11:22:51.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.402+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8200387441090890693', time=2024-09-14T13:15:34.231999+0000, chain.objs.size()=1 2024-09-14T11:22:51.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.402+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.M_VHPhJhZbHH-taprGxSsYxyxGYFWXC_0 2024-09-14T11:22:51.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.402+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7321598794787841431', time=2024-09-14T13:15:34.246750+0000, chain.objs.size()=1 2024-09-14T11:22:51.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.402+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.uBse99Gn-PqXtuYmSy6WlDw5Pqr3GkY_0 2024-09-14T11:22:51.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.402+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3846506844148959650', time=2024-09-14T13:15:34.340313+0000, chain.objs.size()=1 2024-09-14T11:22:51.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.402+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.RqPGK-PRMmb3JZcnN7TYfYwwlcORViw_0 2024-09-14T11:22:51.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.402+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8159612285194673266', time=2024-09-14T13:15:34.344575+0000, chain.objs.size()=1 2024-09-14T11:22:51.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.402+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_._Q8e_5WvM1NNpN2-FM3ZyUqgd4dv-Ac_0 2024-09-14T11:22:51.409 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.403+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9239533648520079244', time=2024-09-14T13:15:34.352012+0000, chain.objs.size()=1 2024-09-14T11:22:51.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.403+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.K6Z6rRDlJ3htcajT4C20UcqQV4DPZjI_0 2024-09-14T11:22:51.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.404+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9845342837000841479', time=2024-09-14T13:15:34.381005+0000, chain.objs.size()=1 2024-09-14T11:22:51.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.404+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.aKLZk6M4piNqInoH_wiglwfL3wEy3vv_0 2024-09-14T11:22:51.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.404+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17348387649512043101', time=2024-09-14T13:15:34.382684+0000, chain.objs.size()=1 2024-09-14T11:22:51.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.404+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.UP1i0HZpKtqGMQP9vzQPMwVSB3zh2nJ_0 2024-09-14T11:22:51.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.404+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7085402907999523205', time=2024-09-14T13:15:34.391706+0000, chain.objs.size()=1 2024-09-14T11:22:51.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.404+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.0UHJ10J933yRpvsk7cW7a-oz0W7pVVE_0 2024-09-14T11:22:51.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.404+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15698942379914716388', time=2024-09-14T13:15:34.392968+0000, chain.objs.size()=1 2024-09-14T11:22:51.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.404+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.-V7P2RU5FzVO8ePL62ksJHLQ1ya95Zf_0 2024-09-14T11:22:51.410 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.404+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9469153996295930776', time=2024-09-14T13:16:11.451463+0000, chain.objs.size()=1 2024-09-14T11:22:51.411 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.404+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.460__shadow_.-hinZmjcPUBFd4241Vd8c9xup4SdKO5_0 2024-09-14T11:22:51.411 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.404+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3282271505637960920', time=2024-09-14T13:16:12.635998+0000, chain.objs.size()=1 2024-09-14T11:22:51.411 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.404+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.463__shadow_.Ohugz5Pch0meuTbKvhTSZGrzEzhv6dc_0 2024-09-14T11:22:51.411 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.404+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7526395205565730049', time=2024-09-14T13:16:12.881298+0000, chain.objs.size()=1 2024-09-14T11:22:51.411 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.404+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.464__shadow_.xu4kiMnwrF-9qTxsIJK3m7LG8nvF0Df_0 2024-09-14T11:22:51.411 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.405+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15280623871025279461', time=2024-09-14T13:16:36.825843+0000, chain.objs.size()=1 2024-09-14T11:22:51.411 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.405+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.525__multipart_mymultipart.2~djfHRpirwNspjlWOCkJ8iTqF-5YjWeP.1 2024-09-14T11:22:51.411 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.406+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 0/48087 2024-09-14T11:22:51.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.408+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-14T11:22:51.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.408+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='2~y66K83jiYqhMRwbZFUu7ad9UZuPIqoq', time=2024-09-14T13:16:40.391235+0000, chain.objs.size()=2 2024-09-14T11:22:51.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.408+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.531__multipart_mymultipart.2~y66K83jiYqhMRwbZFUu7ad9UZuPIqoq.1 2024-09-14T11:22:51.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.408+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.531__multipart_mymultipart.2~y66K83jiYqhMRwbZFUu7ad9UZuPIqoq.2 2024-09-14T11:22:51.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.408+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324164869127646289', time=2024-09-14T13:17:12.365803+0000, chain.objs.size()=1 2024-09-14T11:22:51.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.408+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.556__shadow_.0X2F2pzwxlc8Dq5HyZ9EVHkGTLBAaqs_0 2024-09-14T11:22:51.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.408+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7084189862303555783', time=2024-09-14T13:17:51.005125+0000, chain.objs.size()=1 2024-09-14T11:22:51.414 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.408+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.580__shadow:UZ6rciVk4cz13HLmBI9-ugt.Iy9SsZK_.29wENJWWqKHn7sxPxs2aoUoI3ZIgXOr_0 2024-09-14T11:22:51.415 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.408+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5381561769754445948', time=2024-09-14T13:17:51.006164+0000, chain.objs.size()=1 2024-09-14T11:22:51.415 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.408+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.580__shadow:uvkV8vyrk1ft.OVxe8Q3wVoKeCgaEU0_.jDhVyFBCwZByM1fMe2IYsh-azj9Bj2h_0 2024-09-14T11:22:51.415 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.408+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10456005365768183957', time=2024-09-14T13:17:53.433485+0000, chain.objs.size()=1 2024-09-14T11:22:51.415 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.408+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.587__shadow:9adZ9CFiXobVGxgkQwvOp88A2G03E57_.lw1VxiJmRYl9DpmofP1ryTdt2G6d8Ky_0 2024-09-14T11:22:51.415 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.408+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12785497086988118216', time=2024-09-14T13:20:04.580832+0000, chain.objs.size()=1 2024-09-14T11:22:51.415 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.408+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.619__shadow_.KsoTdCVM7tHsFD361QDxKyuB_vQvrv8_0 2024-09-14T11:22:51.415 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.408+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4194448451743585715', time=2024-09-14T13:20:08.368200+0000, chain.objs.size()=1 2024-09-14T11:22:51.415 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.408+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.627__shadow_.LZFwt8AXFin2QI62DfXuX-TXknLYlfS_0 2024-09-14T11:22:51.415 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.408+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7785328301014196188', time=2024-09-14T13:20:27.002940+0000, chain.objs.size()=1 2024-09-14T11:22:51.415 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.408+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.691__shadow_.RhyjavVERFN-xReQx_pVw1npEToLILo_0 2024-09-14T11:22:51.415 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.408+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4661715911278981932', time=2024-09-14T13:20:28.281995+0000, chain.objs.size()=1 2024-09-14T11:22:51.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.408+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.696__shadow:4Qe6MPCifBmM2f-burYBEdPaKJfAcTt_.R-lf8FIgxk5kGypD_jOJpUkpxpqljuz_0 2024-09-14T11:22:51.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.410+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:51.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.412+0000 7f0f19c16800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:22:51.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.413+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:51.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.414+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:51.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.415+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51499' 2024-09-14T11:22:51.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.415+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4269037114679606740', time=2024-09-14T13:13:29.280508+0000, chain.objs.size()=1 2024-09-14T11:22:51.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.415+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.147__shadow_.sVL-Tie6dqRSxPb1oIfHDuq737VgxZ8_0 2024-09-14T11:22:51.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.415+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11702863065515344975', time=2024-09-14T13:13:36.563135+0000, chain.objs.size()=3 2024-09-14T11:22:51.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.415+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.161__multipart_foo-FROZEN.2~FOy6u8szucEyUjkDVH-GIAaZcO-aR8-.1 2024-09-14T11:22:51.416 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.415+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.161__multipart_foo-FROZEN.2~FOy6u8szucEyUjkDVH-GIAaZcO-aR8-.2 2024-09-14T11:22:51.417 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.415+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.161__multipart_foo-FROZEN.2~FOy6u8szucEyUjkDVH-GIAaZcO-aR8-.3 2024-09-14T11:22:51.417 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.415+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9844543079914587972', time=2024-09-14T13:13:38.053664+0000, chain.objs.size()=1 2024-09-14T11:22:51.417 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.415+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.166__shadow_.mwkxzqTJjTowg9w5PX1dbgkB-iXoptX_0 2024-09-14T11:22:51.417 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.415+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15361641658540365287', time=2024-09-14T13:14:49.814232+0000, chain.objs.size()=1 2024-09-14T11:22:51.417 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.415+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.250__shadow_.xtfQsP9z-KplNtFMW6-Qx-cEBV0JTr__0 2024-09-14T11:22:51.417 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.415+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3378940111097933807', time=2024-09-14T13:14:50.315818+0000, chain.objs.size()=1 2024-09-14T11:22:51.417 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.415+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.252__shadow_.JP92UY11bDB2P7OhLhPmPwIRDhux4qu_0 2024-09-14T11:22:51.417 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.415+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16767552467508399873', time=2024-09-14T13:14:51.101366+0000, chain.objs.size()=1 2024-09-14T11:22:51.417 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.415+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.255__shadow_.zFth4-NEih6sTNm4p6auq6oWrHlL8eE_0 2024-09-14T11:22:51.417 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.415+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15404263920378834263', time=2024-09-14T13:14:51.101891+0000, chain.objs.size()=1 2024-09-14T11:22:51.417 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.415+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.255__shadow_.iw_Q949VQFbKRE820Vcq1ysve4k3RZA_0 2024-09-14T11:22:51.418 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.415+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17659544627354960230', time=2024-09-14T13:14:51.102526+0000, chain.objs.size()=1 2024-09-14T11:22:51.418 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.415+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.255__shadow_.IsKvecTh5ED3OkFgfdn20xkxXLQNNyS_0 2024-09-14T11:22:51.418 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.415+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12897600978657513272', time=2024-09-14T13:14:51.836769+0000, chain.objs.size()=1 2024-09-14T11:22:51.418 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.415+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.258__shadow_.RsIqhjfBc4lfaarwdDlj6V0YPxSnWPs_0 2024-09-14T11:22:51.418 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.415+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3539980858690703244', time=2024-09-14T13:14:52.370784+0000, chain.objs.size()=1 2024-09-14T11:22:51.418 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.415+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.260__shadow_.HknZ594HZDTYQYaam4ReixuYgdagtB__0 2024-09-14T11:22:51.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.417+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12343744215628940109', time=2024-09-14T13:14:59.739479+0000, chain.objs.size()=1 2024-09-14T11:22:51.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.417+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.CrQVViIcWX641fyrJPrDCOjsX7aD0Hw_0 2024-09-14T11:22:51.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.418+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1293892501634209745', time=2024-09-14T13:14:59.744450+0000, chain.objs.size()=1 2024-09-14T11:22:51.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.418+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.NC-yuUmsDXTaTejyhVu769hWENQEaDk_0 2024-09-14T11:22:51.420 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.418+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4180776241931189658', time=2024-09-14T13:14:59.787801+0000, chain.objs.size()=1 2024-09-14T11:22:51.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.418+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.nP1Uic1QYUB_09YmmQRM3-l-ymnmeOU_0 2024-09-14T11:22:51.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.418+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15060940134548590672', time=2024-09-14T13:14:59.796485+0000, chain.objs.size()=1 2024-09-14T11:22:51.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.418+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.KwECO6JgwupplfM6MG9K31jzgFT_n8F_0 2024-09-14T11:22:51.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.418+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7980797625546530665', time=2024-09-14T13:14:59.911475+0000, chain.objs.size()=1 2024-09-14T11:22:51.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.418+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.aDAQrTEDQu5sYaLUhV5P09dSnCx7iBT_0 2024-09-14T11:22:51.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.418+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7319528312290953375', time=2024-09-14T13:14:59.922683+0000, chain.objs.size()=1 2024-09-14T11:22:51.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.418+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.l8j00SHgaCxV6DVhVyqihQNFDzhGJYh_0 2024-09-14T11:22:51.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.418+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.854297088687749841', time=2024-09-14T13:14:59.965228+0000, chain.objs.size()=1 2024-09-14T11:22:51.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.418+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.DBuhRotc5pAazN14JgSpwQ1yuN5NACa_0 2024-09-14T11:22:51.421 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.418+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16989219042693472076', time=2024-09-14T13:14:59.967455+0000, chain.objs.size()=1 2024-09-14T11:22:51.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.418+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.hloavtJZ2Qwyjg1dQEhLev-39Uodt_9_0 2024-09-14T11:22:51.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.418+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12991021865494701262', time=2024-09-14T13:14:59.971626+0000, chain.objs.size()=1 2024-09-14T11:22:51.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.418+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.7uEIKq58Ug7X2qNIBDwGkHsiyt9HxEt_0 2024-09-14T11:22:51.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.418+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7189256384250530618', time=2024-09-14T13:15:00.061266+0000, chain.objs.size()=1 2024-09-14T11:22:51.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.418+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.hgYL6mYV1dF3IppopoctWAbWtrFCmtG_0 2024-09-14T11:22:51.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.418+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7442755893379984114', time=2024-09-14T13:15:00.087541+0000, chain.objs.size()=1 2024-09-14T11:22:51.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.418+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.tN_btwLS3bygWyxAZxXRf6Oipc4ytbs_0 2024-09-14T11:22:51.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.419+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4472028411739118577', time=2024-09-14T13:15:00.101353+0000, chain.objs.size()=1 2024-09-14T11:22:51.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.419+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.d5girljPtu7KKi48ysVnILmlLkIlg0f_0 2024-09-14T11:22:51.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.419+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6019735845221834812', time=2024-09-14T13:15:00.149235+0000, chain.objs.size()=1 2024-09-14T11:22:51.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.419+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.ur0N6j2s8HtdqKd9DpNvT78AA-Sr-oX_0 2024-09-14T11:22:51.422 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.420+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4350532310872932155', time=2024-09-14T13:15:00.240551+0000, chain.objs.size()=1 2024-09-14T11:22:51.423 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.420+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.rYkjLdbY0B3Nr0WjP1UOH6XuB18g1lQ_0 2024-09-14T11:22:51.423 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.420+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1953923143070913964', time=2024-09-14T13:15:00.276576+0000, chain.objs.size()=1 2024-09-14T11:22:51.423 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.420+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.YiRBydskZrvzfSVItnZp5xMX1WLbtdU_0 2024-09-14T11:22:51.423 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.420+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10254622782773119786', time=2024-09-14T13:15:00.305297+0000, chain.objs.size()=1 2024-09-14T11:22:51.423 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.420+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.K0yai6ee3-6pqiks6zqVTNN6rgNyCjP_0 2024-09-14T11:22:51.423 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.420+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9695200686420226077', time=2024-09-14T13:15:00.306313+0000, chain.objs.size()=1 2024-09-14T11:22:51.423 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.420+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.i-OnKwTB-emUn8QR_MBrdEvY-FZYO69_0 2024-09-14T11:22:51.423 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.420+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2284932409677757541', time=2024-09-14T13:15:00.445992+0000, chain.objs.size()=1 2024-09-14T11:22:51.423 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.420+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Q8D6GZu4Vks1tCeTaT7RPD_l_YyO3dz_0 2024-09-14T11:22:51.423 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.420+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13089781468523389714', time=2024-09-14T13:15:00.606301+0000, chain.objs.size()=1 2024-09-14T11:22:51.423 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.420+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.AO1BUhqrx8f2y9IrmXfMFdTlsRAQSPG_0 2024-09-14T11:22:51.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.420+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1389384283288372767', time=2024-09-14T13:15:00.614513+0000, chain.objs.size()=1 2024-09-14T11:22:51.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.420+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.lZ-1PJjPLY64bJxNGNV5Ba0UIKcvlQP_0 2024-09-14T11:22:51.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.420+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12641289968377325475', time=2024-09-14T13:15:00.709379+0000, chain.objs.size()=1 2024-09-14T11:22:51.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.420+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.-ZKfciAhWzgerUe1nY4XYiob27QL3KD_0 2024-09-14T11:22:51.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.420+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1027051194964591931', time=2024-09-14T13:15:00.759807+0000, chain.objs.size()=1 2024-09-14T11:22:51.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.420+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.QvMlwdm2fME0wfcoXXr-uziHA_0hDmq_0 2024-09-14T11:22:51.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.421+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5352539310455582422', time=2024-09-14T13:15:00.801665+0000, chain.objs.size()=1 2024-09-14T11:22:51.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.421+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.5iup6NVLk2oBE4tLbTMZFPgPWUpk2Wy_0 2024-09-14T11:22:51.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.421+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12266846160770617972', time=2024-09-14T13:15:00.884037+0000, chain.objs.size()=1 2024-09-14T11:22:51.424 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.421+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.lHIO3aTEOBZJXxEJwdNtt8plr0sFTlR_0 2024-09-14T11:22:51.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.422+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.304498493772953763', time=2024-09-14T13:15:00.886049+0000, chain.objs.size()=1 2024-09-14T11:22:51.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.422+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Ag7cU8o6mf_uXyuv6l91UiIL1nIBSI3_0 2024-09-14T11:22:51.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.422+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.141132293102012033', time=2024-09-14T13:15:01.152971+0000, chain.objs.size()=1 2024-09-14T11:22:51.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.422+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.263__shadow_.w-BekIuOhIrgu087buOZu2Ffft051TL_0 2024-09-14T11:22:51.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.422+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6036110293509416983', time=2024-09-14T13:15:06.708691+0000, chain.objs.size()=1 2024-09-14T11:22:51.427 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.422+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.284__shadow_.cLwdNR40TBnmTCp1xIF4XOpkRaklbOH_0 2024-09-14T11:22:51.428 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.422+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11955421615108742502', time=2024-09-14T13:15:07.297234+0000, chain.objs.size()=1 2024-09-14T11:22:51.428 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.422+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.286__shadow_.41G1cig_fojihAfpCKSSlt530R-9xTF_0 2024-09-14T11:22:51.428 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.422+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.456341595709990440', time=2024-09-14T13:15:09.828164+0000, chain.objs.size()=1 2024-09-14T11:22:51.428 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.422+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.293__shadow_.MoYM-sTYHGiPM44seJBMDkHC23yoyd5_0 2024-09-14T11:22:51.428 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.422+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18186954692520676546', time=2024-09-14T13:15:09.830498+0000, chain.objs.size()=1 2024-09-14T11:22:51.428 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.422+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.293__shadow_.Fj21UePzfSE8bpacvVB99BwjiHuEtlY_0 2024-09-14T11:22:51.428 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.422+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.719079050488677694', time=2024-09-14T13:15:24.747445+0000, chain.objs.size()=1 2024-09-14T11:22:51.428 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.422+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.pTy17Dq3k6wPdY47urfvASwRLc9VgAV_0 2024-09-14T11:22:51.428 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.422+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5383725297003461135', time=2024-09-14T13:15:24.784300+0000, chain.objs.size()=1 2024-09-14T11:22:51.428 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.422+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.IZyfqWMkIjO_Jt3nljL7pfqn0BCxGrw_0 2024-09-14T11:22:51.429 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.422+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7284202728707103917', time=2024-09-14T13:15:24.785863+0000, chain.objs.size()=1 2024-09-14T11:22:51.429 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.422+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.NMZ7D6nrdg-KPmMCCFYR8-MyJOagxaN_0 2024-09-14T11:22:51.429 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.423+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5711677931725328208', time=2024-09-14T13:15:24.792615+0000, chain.objs.size()=1 2024-09-14T11:22:51.429 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.423+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.SlZROh1YXiQB4BdXncdeh5Oftq07Kpc_0 2024-09-14T11:22:51.429 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.423+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16080599641543487847', time=2024-09-14T13:15:24.795046+0000, chain.objs.size()=1 2024-09-14T11:22:51.429 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.423+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.TL8E193fx_Doy3Mki1BMm4l4FP5IS5-_0 2024-09-14T11:22:51.429 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.423+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10522120122913673629', time=2024-09-14T13:15:24.798161+0000, chain.objs.size()=1 2024-09-14T11:22:51.429 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.423+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.AlbCCkuX645mTfO_LyOBs2K867cqrMX_0 2024-09-14T11:22:51.429 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.423+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9635055160189273091', time=2024-09-14T13:15:24.940151+0000, chain.objs.size()=1 2024-09-14T11:22:51.429 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.423+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.on6dC_pACOWWLWWmfzTkDcM08gwQ4jL_0 2024-09-14T11:22:51.429 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.423+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7343456146742322584', time=2024-09-14T13:15:24.957036+0000, chain.objs.size()=1 2024-09-14T11:22:51.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.423+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.vs-hRyqcAsPc3zhbZJ70Rpk4MyrPQA7_0 2024-09-14T11:22:51.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.424+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9991257334436911324', time=2024-09-14T13:15:25.056054+0000, chain.objs.size()=1 2024-09-14T11:22:51.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.424+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.Xrh_1LPF0A4nCdsUOOJ_jPq8a7hV6Qe_0 2024-09-14T11:22:51.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.424+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15503952177765982994', time=2024-09-14T13:15:25.086983+0000, chain.objs.size()=1 2024-09-14T11:22:51.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.424+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.CZBSQ-emmXCDU0raH_94zwyCq1lvxJ1_0 2024-09-14T11:22:51.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.424+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16581778867001897870', time=2024-09-14T13:15:25.090318+0000, chain.objs.size()=1 2024-09-14T11:22:51.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.424+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.tTAFe5fpENaXNAlgdWWDjtpLTnVXR7A_0 2024-09-14T11:22:51.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.425+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2883899981692409123', time=2024-09-14T13:15:25.132376+0000, chain.objs.size()=1 2024-09-14T11:22:51.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.425+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.TrxMhq1kT4d3Y7cw51tkRBNB8JpmW9o_0 2024-09-14T11:22:51.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.425+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10755762395438156965', time=2024-09-14T13:15:25.230777+0000, chain.objs.size()=1 2024-09-14T11:22:51.430 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.425+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.-Ihiz9tyK7EaPo3yIEac55354zIzYSv_0 2024-09-14T11:22:51.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.425+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7955584670988990448', time=2024-09-14T13:15:25.252809+0000, chain.objs.size()=1 2024-09-14T11:22:51.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.425+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.w7PtSCyzAKTRbLkFXj9j5MkuLsyYYKH_0 2024-09-14T11:22:51.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.425+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8645740796677300713', time=2024-09-14T13:15:25.289880+0000, chain.objs.size()=1 2024-09-14T11:22:51.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.425+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.CWjITewG3OBX2OvmM26d4cCR2zJBB-Z_0 2024-09-14T11:22:51.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.425+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13926251973412172467', time=2024-09-14T13:15:25.376739+0000, chain.objs.size()=1 2024-09-14T11:22:51.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.425+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.ewdNnktgvQenp3DOQBtJKFks7mIwPwD_0 2024-09-14T11:22:51.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.425+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2113106715091824541', time=2024-09-14T13:15:25.420732+0000, chain.objs.size()=1 2024-09-14T11:22:51.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.425+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.eo7XLm57scZ-C5cYhR47L7Zh9aJ2a-Y_0 2024-09-14T11:22:51.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.426+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5055127349132936215', time=2024-09-14T13:15:25.451777+0000, chain.objs.size()=1 2024-09-14T11:22:51.431 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.426+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.VmokxrfrfPodwBAxjBsV1qddKuDUFW-_0 2024-09-14T11:22:51.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.426+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.942905968179593285', time=2024-09-14T13:15:25.550972+0000, chain.objs.size()=1 2024-09-14T11:22:51.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.426+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.ZyzNI9eM1aG6sNuvlojyOc_VL4kAyZ3_0 2024-09-14T11:22:51.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.426+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7669720618472982803', time=2024-09-14T13:15:25.589052+0000, chain.objs.size()=1 2024-09-14T11:22:51.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.426+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.NkU2CYmgoZsWrwxlr0pY-vrGhI53a4W_0 2024-09-14T11:22:51.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.426+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14893615594469913209', time=2024-09-14T13:15:25.692560+0000, chain.objs.size()=1 2024-09-14T11:22:51.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.426+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.AubqR9m_HiEFSefAaU-nPTQRkKH12uX_0 2024-09-14T11:22:51.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.426+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.739191775222541264', time=2024-09-14T13:15:25.701102+0000, chain.objs.size()=1 2024-09-14T11:22:51.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.426+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.kH19NfW-4QqE4GUHuC4fZmIckzVFG0i_0 2024-09-14T11:22:51.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.426+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11377387048576054124', time=2024-09-14T13:15:25.729105+0000, chain.objs.size()=1 2024-09-14T11:22:51.432 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.426+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.BMavw51Sl0rEZfXY6Yyi3GvspCucPGm_0 2024-09-14T11:22:51.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.427+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15359841185570450633', time=2024-09-14T13:15:25.753768+0000, chain.objs.size()=1 2024-09-14T11:22:51.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.427+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.FCEeRJkzuT6ANfLixe97lV9oBYL_2O9_0 2024-09-14T11:22:51.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.427+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16920345877050947622', time=2024-09-14T13:15:25.763964+0000, chain.objs.size()=1 2024-09-14T11:22:51.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.427+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.owOKvx4KKAqSqEQPTI-GYFnm1G4lYQC_0 2024-09-14T11:22:51.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.428+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1060365564916555680', time=2024-09-14T13:15:25.881372+0000, chain.objs.size()=1 2024-09-14T11:22:51.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.428+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.6BkWHp-TlP4EPz6kkVinX8QniAlvG8U_0 2024-09-14T11:22:51.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.428+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1373468218972517058', time=2024-09-14T13:15:25.912360+0000, chain.objs.size()=1 2024-09-14T11:22:51.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.428+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.L-xMx5NInG95TlVXhVP65BCOvY0UZp3_0 2024-09-14T11:22:51.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.428+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11523650293643206616', time=2024-09-14T13:15:25.921166+0000, chain.objs.size()=1 2024-09-14T11:22:51.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.428+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.YbV-K3aMaJNnDn-f4Hh5uiRgeY-N3Q9_0 2024-09-14T11:22:51.433 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.428+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14952371118820071120', time=2024-09-14T13:15:25.928314+0000, chain.objs.size()=1 2024-09-14T11:22:51.434 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.428+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.GY_XHca2WhifoauNVIiYe1vKxLUuL5g_0 2024-09-14T11:22:51.434 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.428+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2273959854897502639', time=2024-09-14T13:15:25.930166+0000, chain.objs.size()=1 2024-09-14T11:22:51.434 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.428+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.cysTNbyq03Y_6bvkwS8P_23YUeiRKE1_0 2024-09-14T11:22:51.436 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.429+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15478031072049012891', time=2024-09-14T13:15:25.940950+0000, chain.objs.size()=1 2024-09-14T11:22:51.436 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.429+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.upFvD3VXL2IXSWsd8a3OvF53-TverTS_0 2024-09-14T11:22:51.436 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.429+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.448675152237337958', time=2024-09-14T13:15:33.179099+0000, chain.objs.size()=1 2024-09-14T11:22:51.436 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.429+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.0CV35HQWgNU8HEz1-VfLq1wY8MEI7tl_0 2024-09-14T11:22:51.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.429+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8493991115304987248', time=2024-09-14T13:15:33.186430+0000, chain.objs.size()=1 2024-09-14T11:22:51.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.429+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.sEcHjUCWj3DjFBWOWZC1cvRlR5xLZRH_0 2024-09-14T11:22:51.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.429+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14716496450854545340', time=2024-09-14T13:15:33.190690+0000, chain.objs.size()=1 2024-09-14T11:22:51.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.429+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.JqXmV1ttJvP4exa4eqr7oehO2KkbAZL_0 2024-09-14T11:22:51.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.429+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2598481395932903145', time=2024-09-14T13:15:33.192394+0000, chain.objs.size()=1 2024-09-14T11:22:51.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.429+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.fwcBmlQAhTOkKAvU_AX8wtjuTc4kdkO_0 2024-09-14T11:22:51.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.429+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2753646586580895756', time=2024-09-14T13:15:33.194547+0000, chain.objs.size()=1 2024-09-14T11:22:51.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.429+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.PraY1PZQy3903FjVCkMdO9KveXoZJ-a_0 2024-09-14T11:22:51.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.429+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1437955048367006073', time=2024-09-14T13:15:33.199891+0000, chain.objs.size()=1 2024-09-14T11:22:51.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.429+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.wo_vCIcJhAo76xKArg6JmOSl1cEByWN_0 2024-09-14T11:22:51.437 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.429+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11597930412304108801', time=2024-09-14T13:15:33.227733+0000, chain.objs.size()=1 2024-09-14T11:22:51.438 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.429+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.IRE-ZeCxpZipL_cyNoxIjxzviSelHwY_0 2024-09-14T11:22:51.438 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.429+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11785478846772617091', time=2024-09-14T13:15:33.239634+0000, chain.objs.size()=1 2024-09-14T11:22:51.438 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.429+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.8ERKVZikIBVzUZ6-rcYN08tuFJnjLMZ_0 2024-09-14T11:22:51.438 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.430+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12995386615068183145', time=2024-09-14T13:15:33.249315+0000, chain.objs.size()=1 2024-09-14T11:22:51.438 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.430+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.LiapQ_kQcoEQNfJIIKW2PS3Q1Wkaap5_0 2024-09-14T11:22:51.438 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.430+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7772461519836750011', time=2024-09-14T13:15:33.251169+0000, chain.objs.size()=1 2024-09-14T11:22:51.438 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.430+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.pwvnAi_ohWntYkcW_LuZgGDwQ2VgwaM_0 2024-09-14T11:22:51.438 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.431+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15453544198132184657', time=2024-09-14T13:15:33.379192+0000, chain.objs.size()=1 2024-09-14T11:22:51.438 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.431+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.PKNwaivsxsNCYBfM1jYkbMMngevXVGS_0 2024-09-14T11:22:51.438 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.432+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7497454634754157125', time=2024-09-14T13:15:33.408093+0000, chain.objs.size()=1 2024-09-14T11:22:51.438 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.432+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.HRFmLNb_r_SL5f5TZ0KO2Qu-oxbGF9I_0 2024-09-14T11:22:51.438 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.432+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7786209394680107070', time=2024-09-14T13:15:33.413675+0000, chain.objs.size()=1 2024-09-14T11:22:51.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.432+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.FGeADDE6mZIMh71loMWcMPUml97r4bG_0 2024-09-14T11:22:51.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.432+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15766773829594947825', time=2024-09-14T13:15:33.416871+0000, chain.objs.size()=1 2024-09-14T11:22:51.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.432+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.I-KrxTeXjfnn-AVI-V-pnz_qohoGJRK_0 2024-09-14T11:22:51.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.432+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2767286332628943812', time=2024-09-14T13:15:33.422873+0000, chain.objs.size()=1 2024-09-14T11:22:51.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.432+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.ME8233ha--GdJl_WjkN7UlvPO04XG6h_0 2024-09-14T11:22:51.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.432+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12346798573310920080', time=2024-09-14T13:15:33.436413+0000, chain.objs.size()=1 2024-09-14T11:22:51.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.432+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.YacC6rU_DvEzeWnhn08iqhjYyqWoMVF_0 2024-09-14T11:22:51.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.432+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8791260428910059736', time=2024-09-14T13:15:33.443274+0000, chain.objs.size()=1 2024-09-14T11:22:51.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.432+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.XT75msR0RJWG0lXe1eLbKSoDL6X7pWo_0 2024-09-14T11:22:51.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.432+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5358677227530719064', time=2024-09-14T13:15:33.452684+0000, chain.objs.size()=1 2024-09-14T11:22:51.439 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.432+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.08CSdh2AaGhZdt4QXvg0ngt0g2_Ul5M_0 2024-09-14T11:22:51.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.432+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8614172580818776630', time=2024-09-14T13:15:33.583512+0000, chain.objs.size()=1 2024-09-14T11:22:51.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.432+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.LRPGRMZnOwesyS65PSXVnwwH7HrJ9Bz_0 2024-09-14T11:22:51.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.432+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5246721234217538924', time=2024-09-14T13:15:33.608167+0000, chain.objs.size()=1 2024-09-14T11:22:51.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.432+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.f-Nj7VCT2b-VkAJZSKfs_m339a2Up1l_0 2024-09-14T11:22:51.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.432+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1056084922198315542', time=2024-09-14T13:15:33.610598+0000, chain.objs.size()=1 2024-09-14T11:22:51.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.432+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.npUtsExMRFOWalYh-a9J7jZNI_bB2lA_0 2024-09-14T11:22:51.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.434+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10849083206606734702', time=2024-09-14T13:15:33.612973+0000, chain.objs.size()=1 2024-09-14T11:22:51.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.434+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.za3oMjiT-YuyZjOdqSc8i25OndAH49I_0 2024-09-14T11:22:51.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.434+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.550578964366959901', time=2024-09-14T13:15:33.715136+0000, chain.objs.size()=1 2024-09-14T11:22:51.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.434+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.gEjI_QAV6pb_ZLK6yIAyi7m2rmMEfug_0 2024-09-14T11:22:51.440 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.434+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14320233583373934127', time=2024-09-14T13:15:33.740878+0000, chain.objs.size()=1 2024-09-14T11:22:51.441 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.434+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.VAvOOH2ed0jiT8zrzl8OV6_0xPtkkSD_0 2024-09-14T11:22:51.441 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.434+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7709466836034602563', time=2024-09-14T13:15:33.771825+0000, chain.objs.size()=1 2024-09-14T11:22:51.441 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.434+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_._nTE1BJr5OuSzPsTQ6RSPNZWGtyG0x9_0 2024-09-14T11:22:51.441 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.434+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10658934310152026133', time=2024-09-14T13:15:33.885018+0000, chain.objs.size()=1 2024-09-14T11:22:51.441 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.434+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.cuRUFlskuaGZSofQn21dOeZCKxBCLD8_0 2024-09-14T11:22:51.441 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.434+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13505114494365392092', time=2024-09-14T13:15:33.912729+0000, chain.objs.size()=1 2024-09-14T11:22:51.441 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.434+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.xY7YKVVkVkQMz4wNBVACwVZ3s-BLvY0_0 2024-09-14T11:22:51.441 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.434+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7305141525997788862', time=2024-09-14T13:15:33.914917+0000, chain.objs.size()=1 2024-09-14T11:22:51.441 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.434+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.cqJoljy4m6Xi4wOMKxOrUp5LqLv_Y33_0 2024-09-14T11:22:51.441 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.434+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11875728287760626191', time=2024-09-14T13:15:33.935822+0000, chain.objs.size()=1 2024-09-14T11:22:51.441 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.434+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.iQd5pUyclvV6ncCf8k0fa2b7nm9UXuK_0 2024-09-14T11:22:51.442 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.436+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 0/51499 2024-09-14T11:22:51.444 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.438+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=33, truncated=0, next_marker='' 2024-09-14T11:22:51.445 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.438+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1224130219264082001', time=2024-09-14T13:15:34.016819+0000, chain.objs.size()=1 2024-09-14T11:22:51.445 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.438+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.wUiv0sfF9l1iiQldkhccCCHSYKlH3kc_0 2024-09-14T11:22:51.445 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.438+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15909949742110647725', time=2024-09-14T13:15:34.017624+0000, chain.objs.size()=1 2024-09-14T11:22:51.445 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.438+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.PASuxrOm-zrGqDRiF-n3WMzFWm4vTz-_0 2024-09-14T11:22:51.445 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.438+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5290472875134309636', time=2024-09-14T13:15:34.059865+0000, chain.objs.size()=1 2024-09-14T11:22:51.445 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.438+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.s56z8724kfoijHSgCw4E4kEbkLEf33X_0 2024-09-14T11:22:51.445 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.438+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7257332144319797600', time=2024-09-14T13:15:34.080076+0000, chain.objs.size()=1 2024-09-14T11:22:51.445 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.438+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.YAVwU3WUo6JRyC6453z-7eV6yddwK3l_0 2024-09-14T11:22:51.445 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.438+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12775431930606839799', time=2024-09-14T13:15:34.093414+0000, chain.objs.size()=1 2024-09-14T11:22:51.445 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.438+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.5DKt5WP--nb5fK5uA8D3A_Sp5_d4ZNZ_0 2024-09-14T11:22:51.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.438+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17864556958565912539', time=2024-09-14T13:15:34.196293+0000, chain.objs.size()=1 2024-09-14T11:22:51.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.438+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.3WAVX3hyrQWVPqLc3MWax6aaxfyqz9h_0 2024-09-14T11:22:51.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.438+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1189030249930341076', time=2024-09-14T13:15:34.203024+0000, chain.objs.size()=1 2024-09-14T11:22:51.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.438+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.tSpm5JusAUQGLrQBSz18xvWbldCl_7P_0 2024-09-14T11:22:51.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.438+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.775673680425375796', time=2024-09-14T13:15:34.222528+0000, chain.objs.size()=1 2024-09-14T11:22:51.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.438+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.pslE0FMEPlredL_xC2TfwwegsO8roOU_0 2024-09-14T11:22:51.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.438+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2854224753123314934', time=2024-09-14T13:15:34.358536+0000, chain.objs.size()=1 2024-09-14T11:22:51.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.438+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.aDsNeiOSGvKXL2-5ATykqyM9qM2m6R-_0 2024-09-14T11:22:51.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.438+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.655865895022945197', time=2024-09-14T13:15:34.368237+0000, chain.objs.size()=1 2024-09-14T11:22:51.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.438+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.spSCRTJ-eRrED3Y-VHl2WfHi0FGgYa5_0 2024-09-14T11:22:51.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.438+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2311915853803870820', time=2024-09-14T13:15:34.372623+0000, chain.objs.size()=1 2024-09-14T11:22:51.446 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.438+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.1lFCPwPnCdlFf0vXlW74f3QEO2CUsxL_0 2024-09-14T11:22:51.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.438+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3056907119357626391', time=2024-09-14T13:16:12.241472+0000, chain.objs.size()=1 2024-09-14T11:22:51.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.438+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.462__shadow_.P7iUugRjiAlhho1kVzZI4sdypApz-SQ_0 2024-09-14T11:22:51.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.440+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16309986096454984531', time=2024-09-14T13:16:12.996629+0000, chain.objs.size()=1 2024-09-14T11:22:51.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.440+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.464__shadow_.AcFJ7BrozovB4QykT94XBmDrSUrCr0S_0 2024-09-14T11:22:51.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.440+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2784554897025183857', time=2024-09-14T13:16:18.354145+0000, chain.objs.size()=1 2024-09-14T11:22:51.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.440+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.487__shadow_.Yz1Mgg2NedSaR-i9UWJFOxsMA1tj9Ux_0 2024-09-14T11:22:51.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.440+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1073189458362454994', time=2024-09-14T13:16:24.668799+0000, chain.objs.size()=6 2024-09-14T11:22:51.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.440+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.507__multipart_srcmultipart.2~EQ3ZZNALHrAJsVAZLD-5msuDtyJwYup.1 2024-09-14T11:22:51.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.440+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.507__multipart_srcmultipart.2~EQ3ZZNALHrAJsVAZLD-5msuDtyJwYup.2 2024-09-14T11:22:51.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.440+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.507__multipart_srcmultipart.2~EQ3ZZNALHrAJsVAZLD-5msuDtyJwYup.3 2024-09-14T11:22:51.447 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.440+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.507__multipart_srcmultipart.2~EQ3ZZNALHrAJsVAZLD-5msuDtyJwYup.4 2024-09-14T11:22:51.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.440+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.507__multipart_srcmultipart.2~EQ3ZZNALHrAJsVAZLD-5msuDtyJwYup.5 2024-09-14T11:22:51.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.440+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.507__multipart_srcmultipart.2~EQ3ZZNALHrAJsVAZLD-5msuDtyJwYup.6 2024-09-14T11:22:51.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.440+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12053300891129181793', time=2024-09-14T13:16:35.722755+0000, chain.objs.size()=2 2024-09-14T11:22:51.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.440+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.523__multipart_mymultipart.2~TOxX7qEhA23YCFP8_M4qa489FyCIZZo.1 2024-09-14T11:22:51.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.440+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.523__multipart_mymultipart.2~TOxX7qEhA23YCFP8_M4qa489FyCIZZo.2 2024-09-14T11:22:51.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.440+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='2~bTsDdnyF9PONyOibh49rRnyfvLjzr5X', time=2024-09-14T13:16:40.397272+0000, chain.objs.size()=1 2024-09-14T11:22:51.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.440+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.531__multipart_mymultipart2.2~bTsDdnyF9PONyOibh49rRnyfvLjzr5X.1 2024-09-14T11:22:51.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.442+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='2~R-s3kMwD8Ws-rIlaFO0fJ6wqSl0Gs0Z', time=2024-09-14T13:16:41.755019+0000, chain.objs.size()=1 2024-09-14T11:22:51.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.442+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.535__multipart_mymultipart.2~R-s3kMwD8Ws-rIlaFO0fJ6wqSl0Gs0Z.3 2024-09-14T11:22:51.448 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.442+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6749238828550005886', time=2024-09-14T13:17:11.102081+0000, chain.objs.size()=1 2024-09-14T11:22:51.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.442+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.553__shadow_.hSWMpzYfr8Wq6HBfni39ZvOFGFmM8Qq_0 2024-09-14T11:22:51.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.442+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='2~_JEH19y1xaPqxvEiLAMkG8voea5ECmQ', time=2024-09-14T13:17:14.745004+0000, chain.objs.size()=1 2024-09-14T11:22:51.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.442+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.561__multipart_mymultipart.2~_JEH19y1xaPqxvEiLAMkG8voea5ECmQ.1 2024-09-14T11:22:51.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.442+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6384196797254607864', time=2024-09-14T13:17:34.607374+0000, chain.objs.size()=1 2024-09-14T11:22:51.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.442+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.576__shadow:aTFJgWSr.tNDELH.R3ePud6KBTDTQTq_.AqrvYHONFS9G06aidUgPAvb6s3eJ2x-_0 2024-09-14T11:22:51.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.442+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13353014394606643546', time=2024-09-14T13:17:44.127475+0000, chain.objs.size()=1 2024-09-14T11:22:51.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.442+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.577__shadow:N6TLIwELQ7yM2RKZ5RCTm98FxC49iha_.u7ybFwKZH_3HUEoaCp10m_gBhpxheeJ_0 2024-09-14T11:22:51.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.442+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.574920349423098291', time=2024-09-14T13:17:45.148001+0000, chain.objs.size()=1 2024-09-14T11:22:51.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.442+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.577__shadow:eY3FrGHBXr7N8Yr1fdFqrfoP2UakRJm_.25shoVovSpdo87lLknSXe17xuOheT_n_0 2024-09-14T11:22:51.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.442+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13039373100192026190', time=2024-09-14T13:17:46.374511+0000, chain.objs.size()=1 2024-09-14T11:22:51.449 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.442+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.577__shadow:GhtSKIvvN1MZ68KH2v9iI.jAXngL0l1_.AEglvvBrlEMGj3fDGKU7p0GtY5GsVUh_0 2024-09-14T11:22:51.450 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.442+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4056340530774745220', time=2024-09-14T13:17:48.871098+0000, chain.objs.size()=4 2024-09-14T11:22:51.450 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.442+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.578__multipart_testobj.2~Ye_2hIogkbd5r2sInZZi6wZDaCi-UKI.1 2024-09-14T11:22:51.450 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.442+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.578__multipart_testobj.2~Ye_2hIogkbd5r2sInZZi6wZDaCi-UKI.2 2024-09-14T11:22:51.450 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.442+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.578__multipart_testobj.2~Ye_2hIogkbd5r2sInZZi6wZDaCi-UKI.3 2024-09-14T11:22:51.450 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.442+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.578__multipart_testobj.2~Ye_2hIogkbd5r2sInZZi6wZDaCi-UKI.4 2024-09-14T11:22:51.450 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.444+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10883778773687653032', time=2024-09-14T13:17:51.355218+0000, chain.objs.size()=1 2024-09-14T11:22:51.450 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.444+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.582__shadow:lNbnOeBDKsWPGwetOr0tHXbinLlnVfW_.-eaqKcpYO7ki28_PcR-au-6qQjrNOZc_0 2024-09-14T11:22:51.450 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.444+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7338955559175186639', time=2024-09-14T13:17:52.799872+0000, chain.objs.size()=1 2024-09-14T11:22:51.450 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.444+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.585__shadow:kedUhNGlXCV8K0UK.lL26XF7gxUuXn9_.O5yZFNOw_fp6k90n6U0atuEHoOWll5r_0 2024-09-14T11:22:51.450 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.444+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2434370246682252568', time=2024-09-14T13:17:57.206177+0000, chain.objs.size()=1 2024-09-14T11:22:51.450 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.444+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.603__shadow_.ML1cwj1VwElE0sU5bXxSVRjNPrWlN9g_0 2024-09-14T11:22:51.451 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.444+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3737145334180718637', time=2024-09-14T13:20:11.245261+0000, chain.objs.size()=1 2024-09-14T11:22:51.451 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.444+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.638__shadow_.8IwVB8LcGaPWAS4KSz7Xx8r1rtBh-bB_0 2024-09-14T11:22:51.451 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.445+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2798333259932472157', time=2024-09-14T13:20:20.420619+0000, chain.objs.size()=1 2024-09-14T11:22:51.451 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.445+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.664__shadow_.3cQYBbcKJ1cWz-quFSDlNTo93ZiOjuD_0 2024-09-14T11:22:51.451 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.445+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3752146000658427242', time=2024-09-14T13:20:59.841780+0000, chain.objs.size()=1 2024-09-14T11:22:51.451 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.445+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.741__shadow_._PXpaNWTgp3kcobZEk3xDznCs0Mdywk_0 2024-09-14T11:22:51.451 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.445+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1429746607992489574', time=2024-09-14T13:21:08.305091+0000, chain.objs.size()=1 2024-09-14T11:22:51.451 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.445+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.760__shadow_.rVepkg6wp6ZAG60jHuOEFWdVFogJ41m_0 2024-09-14T11:22:51.451 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.445+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7764444088890042403', time=2024-09-14T13:21:16.587110+0000, chain.objs.size()=1 2024-09-14T11:22:51.451 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.445+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.778__shadow_.LTczmqsUCDX-ABdlkk_02_vUEUNZFM9_0 2024-09-14T11:22:51.454 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.447+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:51.454 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.449+0000 7f0f19c16800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:22:51.454 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.450+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:51.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.450+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:51.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.451+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47718' 2024-09-14T11:22:51.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.451+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7390273108330902638', time=2024-09-14T13:14:48.115035+0000, chain.objs.size()=1 2024-09-14T11:22:51.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.451+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.244__shadow_.bT5zn6cZg20mwcnvGffDfR8EA-U4AKz_0 2024-09-14T11:22:51.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.451+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14027244141534439150', time=2024-09-14T13:14:51.596985+0000, chain.objs.size()=1 2024-09-14T11:22:51.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.451+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.257__shadow_.1PRbZC903VC42vGL_TaKpnlqBBa4xB7_0 2024-09-14T11:22:51.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.451+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8107216634976472265', time=2024-09-14T13:14:59.757078+0000, chain.objs.size()=1 2024-09-14T11:22:51.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.451+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.qBXtszA8FVitZLEYsn9u-8xCSPtCgdT_0 2024-09-14T11:22:51.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.451+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4264114225443355639', time=2024-09-14T13:14:59.820173+0000, chain.objs.size()=1 2024-09-14T11:22:51.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.451+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.FlDGYG_CDaDGUYu5X8dYDqHNLv4bJgc_0 2024-09-14T11:22:51.455 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.451+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15702384842468597943', time=2024-09-14T13:14:59.944048+0000, chain.objs.size()=1 2024-09-14T11:22:51.456 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.451+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.iZ4_aLm5dsfr8PnUcmpF6yW08Xl6W4v_0 2024-09-14T11:22:51.456 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.451+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15222141485110254973', time=2024-09-14T13:14:59.956666+0000, chain.objs.size()=1 2024-09-14T11:22:51.456 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.451+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.IIIN3-6-ljt_3nCNOwvqqfn5bqE-fZ4_0 2024-09-14T11:22:51.456 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.451+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12596109584671570762', time=2024-09-14T13:15:00.061377+0000, chain.objs.size()=1 2024-09-14T11:22:51.456 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.451+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_._XYVFAxhmAud402vEGwEahZWJpOvuAp_0 2024-09-14T11:22:51.456 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.451+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3030924358902667464', time=2024-09-14T13:15:00.075096+0000, chain.objs.size()=1 2024-09-14T11:22:51.456 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.451+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.RT_BT3Ds8OrbMFVeptjFjGuBJPybG5r_0 2024-09-14T11:22:51.456 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.451+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17044283527017295970', time=2024-09-14T13:15:00.080426+0000, chain.objs.size()=1 2024-09-14T11:22:51.456 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.451+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.qiKrpwNtKk0cl4kOHm61AB5OgBlHiYt_0 2024-09-14T11:22:51.456 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.451+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4909720007551380915', time=2024-09-14T13:15:00.117104+0000, chain.objs.size()=1 2024-09-14T11:22:51.457 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.451+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.v30exXboezprk-nOxOA3P4N_AogUM9F_0 2024-09-14T11:22:51.457 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.451+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11488545230438391175', time=2024-09-14T13:15:00.117774+0000, chain.objs.size()=1 2024-09-14T11:22:51.457 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.451+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.NGRGMug8mgzQYKi7nE8AwZsreV-pE2s_0 2024-09-14T11:22:51.457 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.451+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8169911508387843224', time=2024-09-14T13:15:00.132199+0000, chain.objs.size()=1 2024-09-14T11:22:51.457 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.451+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.AHj1ZRGIHhvujvd-Y6ugvf7UNlaGZsd_0 2024-09-14T11:22:51.457 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.453+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.258186604963448844', time=2024-09-14T13:15:00.230399+0000, chain.objs.size()=1 2024-09-14T11:22:51.457 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.453+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.p1PL5pqdYEzJCtKXCiV4NHyoiP6PtUq_0 2024-09-14T11:22:51.457 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.453+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9319761901051084649', time=2024-09-14T13:15:00.263092+0000, chain.objs.size()=1 2024-09-14T11:22:51.457 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.453+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.MQDJTgsip7ojOnG7PM15Tn2U7v_xzb3_0 2024-09-14T11:22:51.457 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.453+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15976329099229469692', time=2024-09-14T13:15:00.425279+0000, chain.objs.size()=1 2024-09-14T11:22:51.457 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.453+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.aYzAks2gHHjtOMLjjomV-AKItLmdJ3C_0 2024-09-14T11:22:51.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.454+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9308474872746976980', time=2024-09-14T13:15:00.446607+0000, chain.objs.size()=1 2024-09-14T11:22:51.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.454+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.PrjV4KNBnGAWAxCFlREiqOlEaX7VjiG_0 2024-09-14T11:22:51.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.454+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2902684511756015411', time=2024-09-14T13:15:00.450184+0000, chain.objs.size()=1 2024-09-14T11:22:51.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.454+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Kz57iFvPawfM-lyGKURFfnd2pwF9zVH_0 2024-09-14T11:22:51.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.454+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.151288563632527140', time=2024-09-14T13:15:00.553015+0000, chain.objs.size()=1 2024-09-14T11:22:51.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.454+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.cp9J6uL9F_ikP5Oc6594SVrxij63ZyY_0 2024-09-14T11:22:51.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.454+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14470282354192351730', time=2024-09-14T13:15:00.574002+0000, chain.objs.size()=1 2024-09-14T11:22:51.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.454+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.z8otYbfBymi_txyXdWmluo85fmOod-K_0 2024-09-14T11:22:51.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.454+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18189003229710418589', time=2024-09-14T13:15:00.596251+0000, chain.objs.size()=1 2024-09-14T11:22:51.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.455+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.RV2fpYJ6G_8Q_mkPktA3j9f1OpcrWIj_0 2024-09-14T11:22:51.458 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.455+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12309751789588894816', time=2024-09-14T13:15:00.607347+0000, chain.objs.size()=1 2024-09-14T11:22:51.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.455+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.N6Jm5meAxYfQxUd-o_zV3sJt0S-Iuuv_0 2024-09-14T11:22:51.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.455+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1193183011144088711', time=2024-09-14T13:15:00.611166+0000, chain.objs.size()=1 2024-09-14T11:22:51.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.455+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.n5JNXR_jQc4H4ep8OBVkvgbHo6hZBfz_0 2024-09-14T11:22:51.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.455+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17541062577734751422', time=2024-09-14T13:15:00.713949+0000, chain.objs.size()=1 2024-09-14T11:22:51.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.455+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.aioEVrnzNEE0CP1vX9xk4kfNhqKX-IB_0 2024-09-14T11:22:51.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.455+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6322683560197561943', time=2024-09-14T13:15:00.723845+0000, chain.objs.size()=1 2024-09-14T11:22:51.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.455+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.BCjw6m-fEhvZLZjQt1k2_4_rNVKgt5y_0 2024-09-14T11:22:51.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.455+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7402935533365224529', time=2024-09-14T13:15:00.750907+0000, chain.objs.size()=1 2024-09-14T11:22:51.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.455+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_._Y26BhtjhQqU5VzDr4lWCUs__jKH4Sf_0 2024-09-14T11:22:51.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.455+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4791610798369836961', time=2024-09-14T13:15:00.770900+0000, chain.objs.size()=1 2024-09-14T11:22:51.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.455+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.8d11CjEMeYtTbjnXKbD6EOuYckPGi4f_0 2024-09-14T11:22:51.459 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.455+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10024878902181209882', time=2024-09-14T13:15:00.794055+0000, chain.objs.size()=1 2024-09-14T11:22:51.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.455+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Q-tjxoA3ketG6PlP3DqMBswq75au6bG_0 2024-09-14T11:22:51.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.456+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8778997213472465086', time=2024-09-14T13:15:00.799032+0000, chain.objs.size()=1 2024-09-14T11:22:51.460 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.456+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.tej4vU4BL98n6mvge8Mzc5y3s_v1Q7r_0 2024-09-14T11:22:51.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.457+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3025545411437680500', time=2024-09-14T13:15:00.872035+0000, chain.objs.size()=1 2024-09-14T11:22:51.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.457+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.5VOy7mpr77dP7zgice-sfeBEY4YAnv5_0 2024-09-14T11:22:51.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.457+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2779707406544442', time=2024-09-14T13:15:00.882396+0000, chain.objs.size()=1 2024-09-14T11:22:51.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.457+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Km72KHg8_SRG-9t5J2JyL4WKUjLecsg_0 2024-09-14T11:22:51.462 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.457+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4007600104570306296', time=2024-09-14T13:15:00.906585+0000, chain.objs.size()=1 2024-09-14T11:22:51.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.457+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.Csa88czlUwvbMGtsFfM9H_9XOzyxxdB_0 2024-09-14T11:22:51.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.458+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9944590919072604735', time=2024-09-14T13:15:00.924470+0000, chain.objs.size()=1 2024-09-14T11:22:51.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.458+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.262__shadow_.mOWHgyYTaI_03rTpgOfZgYaHgCoSCCr_0 2024-09-14T11:22:51.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.458+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10911607145424548220', time=2024-09-14T13:15:01.918477+0000, chain.objs.size()=1 2024-09-14T11:22:51.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.458+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.266__shadow_.KcloNZp-y2C_H6dyv69Ax-opEkzDV1C_0 2024-09-14T11:22:51.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.458+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10741217961136720916', time=2024-09-14T13:15:02.404778+0000, chain.objs.size()=1 2024-09-14T11:22:51.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.458+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.268__shadow_.xXIDVf2DKRQJm1V_zYipRNpmvL-Klgm_0 2024-09-14T11:22:51.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.458+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10563880839782855382', time=2024-09-14T13:15:04.717027+0000, chain.objs.size()=1 2024-09-14T11:22:51.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.458+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.277__shadow_.6tDtQ_4akh3c9lisp284taCefMzeYsk_0 2024-09-14T11:22:51.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.458+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1200115202736805545', time=2024-09-14T13:15:08.294596+0000, chain.objs.size()=1 2024-09-14T11:22:51.463 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.458+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.290__shadow_.v9Mqgmo5qkuD9WcCpm9tgRwQ_ophsot_0 2024-09-14T11:22:51.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.458+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16259302382058021900', time=2024-09-14T13:15:09.247128+0000, chain.objs.size()=1 2024-09-14T11:22:51.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.458+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.292__shadow_.nrgYZdB0Fxtcfvfxi_dX1WXwnCxAiLI_0 2024-09-14T11:22:51.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.458+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.676047084218750860', time=2024-09-14T13:15:09.825724+0000, chain.objs.size()=1 2024-09-14T11:22:51.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.458+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.293__shadow_.XfgRS9S2gAK0xszspbiiH39m9PXh4Uh_0 2024-09-14T11:22:51.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.458+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6766241253215088835', time=2024-09-14T13:15:09.827313+0000, chain.objs.size()=1 2024-09-14T11:22:51.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.458+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.293__shadow_.M1TN8N73dki70A0hUPsZLnsbvu2D-AI_0 2024-09-14T11:22:51.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.459+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6092752778346209737', time=2024-09-14T13:15:09.829310+0000, chain.objs.size()=1 2024-09-14T11:22:51.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.459+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.293__shadow_.ZIjPfabbOAeuAD6yTyB5sC2EJwgVx_b_0 2024-09-14T11:22:51.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.459+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10261241042012098009', time=2024-09-14T13:15:10.322789+0000, chain.objs.size()=1 2024-09-14T11:22:51.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.459+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.295__shadow_.f-Evfb3Ma6mFW_jEwFEN2HV-RRNBekI_0 2024-09-14T11:22:51.464 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.459+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4117772699689673585', time=2024-09-14T13:15:10.323565+0000, chain.objs.size()=1 2024-09-14T11:22:51.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.459+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.295__shadow_.L9cgZj0FAvP-7_yNfjABwdriI6ZJiR1_0 2024-09-14T11:22:51.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.459+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3285170970554750554', time=2024-09-14T13:15:24.714771+0000, chain.objs.size()=1 2024-09-14T11:22:51.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.459+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.WCKLv1nwwhi1_07tYVH4CUyGl-cEmME_0 2024-09-14T11:22:51.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.459+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13015340897218624375', time=2024-09-14T13:15:24.717291+0000, chain.objs.size()=1 2024-09-14T11:22:51.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.459+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.6SVnpm971Jmdox8pDafggwYY1j5yeDc_0 2024-09-14T11:22:51.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.459+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16094596967891981739', time=2024-09-14T13:15:24.724710+0000, chain.objs.size()=1 2024-09-14T11:22:51.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.459+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.BknjT9TlH6uS8869bxZLvPnlxsIGw-e_0 2024-09-14T11:22:51.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.460+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3360982581311310978', time=2024-09-14T13:15:24.736477+0000, chain.objs.size()=1 2024-09-14T11:22:51.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.460+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.oSpvxdqx9FkyN_1IchvVRj_CLaFVYtp_0 2024-09-14T11:22:51.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.460+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2745968260988236825', time=2024-09-14T13:15:24.752575+0000, chain.objs.size()=1 2024-09-14T11:22:51.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.460+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.fXRLZ5-Pe-gt5x1rP8vIn-85tNsr8My_0 2024-09-14T11:22:51.465 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.460+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15113368506231194034', time=2024-09-14T13:15:24.755243+0000, chain.objs.size()=1 2024-09-14T11:22:51.466 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.460+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.0HbzuQB11wzTxxs3c2b3islHjBY9Dbo_0 2024-09-14T11:22:51.466 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.460+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3718149210897461453', time=2024-09-14T13:15:24.756552+0000, chain.objs.size()=1 2024-09-14T11:22:51.466 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.460+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.S9wN2H2zXU745cLxaKotzKHDqGPTMGM_0 2024-09-14T11:22:51.466 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.460+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6325895752720352861', time=2024-09-14T13:15:24.760681+0000, chain.objs.size()=1 2024-09-14T11:22:51.466 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.460+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.1r31YVmP8N5jq0em18lw5oMH8UzhtEh_0 2024-09-14T11:22:51.466 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.460+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7380811309381915001', time=2024-09-14T13:15:24.761745+0000, chain.objs.size()=1 2024-09-14T11:22:51.466 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.460+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.9jYF7He2KdWDXkvcitNUvlt1zwJynsj_0 2024-09-14T11:22:51.466 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.460+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8044634486011379729', time=2024-09-14T13:15:24.762520+0000, chain.objs.size()=1 2024-09-14T11:22:51.466 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.460+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.k6EwypVEakIwqZmSPW_4JU6zfy7_-3e_0 2024-09-14T11:22:51.466 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.461+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8889675637291066966', time=2024-09-14T13:15:24.766494+0000, chain.objs.size()=1 2024-09-14T11:22:51.467 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.461+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.2d0duMuaec-RrSBn3CRGUikf7Xwl_pD_0 2024-09-14T11:22:51.467 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.462+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2953903898666024780', time=2024-09-14T13:15:24.773856+0000, chain.objs.size()=1 2024-09-14T11:22:51.467 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.462+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.GAhneGVfKlrsLwBrRM8jJvvuoQkz95U_0 2024-09-14T11:22:51.467 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.462+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15182752087633920687', time=2024-09-14T13:15:24.777228+0000, chain.objs.size()=1 2024-09-14T11:22:51.467 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.462+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.mQir2QIgkzhGk2SX0cUphjC06ygvuUm_0 2024-09-14T11:22:51.467 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.462+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12284282470722259559', time=2024-09-14T13:15:24.788330+0000, chain.objs.size()=1 2024-09-14T11:22:51.467 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.462+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.fkhAmn9T8Uw-VJ4EK5xXVhsdznpJmQh_0 2024-09-14T11:22:51.467 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.462+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14114428272588157979', time=2024-09-14T13:15:24.882994+0000, chain.objs.size()=1 2024-09-14T11:22:51.467 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.462+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.WLfmwlcx1-vOTPzCvmkjwvAuuPR4u_6_0 2024-09-14T11:22:51.467 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.462+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13628379328144781022', time=2024-09-14T13:15:24.964416+0000, chain.objs.size()=1 2024-09-14T11:22:51.467 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.462+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.f2rqiUx2wjqx_M9kMdBANncblKTPwCF_0 2024-09-14T11:22:51.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.462+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7453971970416625116', time=2024-09-14T13:15:25.075375+0000, chain.objs.size()=1 2024-09-14T11:22:51.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.462+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.CBcYE9JUUUkWpgwtbWtW5iVfI5v9isY_0 2024-09-14T11:22:51.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.462+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5274731638830349463', time=2024-09-14T13:15:25.081886+0000, chain.objs.size()=1 2024-09-14T11:22:51.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.462+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.xUx6UpbIBzQYm9TRYrFwLQ9M-eUICF5_0 2024-09-14T11:22:51.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.462+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14125189575601334012', time=2024-09-14T13:15:25.090138+0000, chain.objs.size()=1 2024-09-14T11:22:51.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.462+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.C5UI6qTDPOjuOM8miGhzdZ1OCPIUo_Z_0 2024-09-14T11:22:51.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.462+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11203683240288828708', time=2024-09-14T13:15:25.103079+0000, chain.objs.size()=1 2024-09-14T11:22:51.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.462+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.LmXjHEXrfZj33i9kpd0FVW3VCYdevnK_0 2024-09-14T11:22:51.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.462+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2989184470640362552', time=2024-09-14T13:15:25.127448+0000, chain.objs.size()=1 2024-09-14T11:22:51.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.462+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.ZtAKKM3ipEkWH5M0HQab3S-I759AcSH_0 2024-09-14T11:22:51.468 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.462+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1912244714124107071', time=2024-09-14T13:15:25.207086+0000, chain.objs.size()=1 2024-09-14T11:22:51.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.462+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.GZjAciAGta8dPQrvAPm0mWub8rqgQve_0 2024-09-14T11:22:51.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.463+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10139901210458892297', time=2024-09-14T13:15:25.224614+0000, chain.objs.size()=1 2024-09-14T11:22:51.469 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.463+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.n_crg0CRk_kwZjulCN-5lc393RI13mo_0 2024-09-14T11:22:51.471 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.464+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3574041961795235477', time=2024-09-14T13:15:25.234753+0000, chain.objs.size()=1 2024-09-14T11:22:51.472 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.464+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.kY9KFY80OohcEHZlDFrQKsQXOH8DC5L_0 2024-09-14T11:22:51.472 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.464+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6124149990891161883', time=2024-09-14T13:15:25.249087+0000, chain.objs.size()=1 2024-09-14T11:22:51.472 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.464+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.F_lGFi98hHsk14FY6EHVmCqtB1Slm00_0 2024-09-14T11:22:51.472 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.464+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3503623832786711115', time=2024-09-14T13:15:25.250541+0000, chain.objs.size()=1 2024-09-14T11:22:51.472 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.464+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.AXck8Dav4kDA6qFIp5J-mHK9E0bTsq5_0 2024-09-14T11:22:51.472 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.465+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.755880198813871106', time=2024-09-14T13:15:25.261028+0000, chain.objs.size()=1 2024-09-14T11:22:51.472 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.465+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.J8ScgJxynOFKIancJ43f31tb6XQMSN5_0 2024-09-14T11:22:51.472 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.465+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13947588397591750792', time=2024-09-14T13:15:25.287972+0000, chain.objs.size()=1 2024-09-14T11:22:51.472 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.465+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.BN1zRl6ME-1UvMqIWddorlabSo5brXf_0 2024-09-14T11:22:51.472 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.465+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.13298192788289053046', time=2024-09-14T13:15:25.289949+0000, chain.objs.size()=1 2024-09-14T11:22:51.473 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.465+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.yghhWRnBoGwUTx7z6_VF5OIYoDfaOET_0 2024-09-14T11:22:51.473 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.465+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7522731464565171374', time=2024-09-14T13:15:25.291369+0000, chain.objs.size()=1 2024-09-14T11:22:51.473 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.465+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.ySgXQWOw-8IReTVKevswlJTAnWpVoqs_0 2024-09-14T11:22:51.473 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.465+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.969821428883865943', time=2024-09-14T13:15:25.372116+0000, chain.objs.size()=1 2024-09-14T11:22:51.473 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.465+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.Ae-axvS-z2u_Cf_0DZYXHvkJPpvf9QO_0 2024-09-14T11:22:51.473 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.465+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15776129907096617466', time=2024-09-14T13:15:25.379211+0000, chain.objs.size()=1 2024-09-14T11:22:51.473 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.465+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.Dz-UD9Da5h3ht-_WKHF6vVFzK4O6sx0_0 2024-09-14T11:22:51.473 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.465+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17440145121153244609', time=2024-09-14T13:15:25.530449+0000, chain.objs.size()=1 2024-09-14T11:22:51.473 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.465+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.jX14cidR6rPAvayBZVymUpcNFH29V-v_0 2024-09-14T11:22:51.473 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.465+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8195299619524848286', time=2024-09-14T13:15:25.540746+0000, chain.objs.size()=1 2024-09-14T11:22:51.473 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.465+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.5PU_Hch-vusE-WC4oIZE-AmUOVHEmpq_0 2024-09-14T11:22:51.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.466+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5755244844653131860', time=2024-09-14T13:15:25.554702+0000, chain.objs.size()=1 2024-09-14T11:22:51.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.466+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.xdS4yM-CF8fZenBsbnwF8VLg6A0PdWX_0 2024-09-14T11:22:51.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.466+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.828096689799348017', time=2024-09-14T13:15:25.579519+0000, chain.objs.size()=1 2024-09-14T11:22:51.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.466+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.1m7d6y7D5qFdL3GlgrTP7_ozdsf88Nm_0 2024-09-14T11:22:51.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.466+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6342886271642924378', time=2024-09-14T13:15:25.588083+0000, chain.objs.size()=1 2024-09-14T11:22:51.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.466+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.3bJdsQXF8K73Uu_-oa2iqKewMmdUc8w_0 2024-09-14T11:22:51.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.467+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12795158062309137503', time=2024-09-14T13:15:25.615259+0000, chain.objs.size()=1 2024-09-14T11:22:51.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.467+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.fybhbaJH0iI7W2dbQ0K90Q3ZJQs1iUN_0 2024-09-14T11:22:51.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.467+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8018608397587264268', time=2024-09-14T13:15:25.727471+0000, chain.objs.size()=1 2024-09-14T11:22:51.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.467+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.-lkh7qqbhJkpjBDVVUW8rw9_xjIyp97_0 2024-09-14T11:22:51.474 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.467+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11288766437289235941', time=2024-09-14T13:15:25.729871+0000, chain.objs.size()=1 2024-09-14T11:22:51.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.467+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.nAwZ27jdcttag_nhZNPO-4XXJt0Ypkk_0 2024-09-14T11:22:51.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.467+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11886068362854930374', time=2024-09-14T13:15:25.915675+0000, chain.objs.size()=1 2024-09-14T11:22:51.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.467+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.323__shadow_.8hA3EOyF9oPixqZRSdyO5x4tTNqZyZp_0 2024-09-14T11:22:51.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.467+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10968171590094878954', time=2024-09-14T13:15:33.202757+0000, chain.objs.size()=1 2024-09-14T11:22:51.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.467+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.PRWXKrAeB57lfBcr4f24tMTUbHYq2HP_0 2024-09-14T11:22:51.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.467+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11166933464469471962', time=2024-09-14T13:15:33.375733+0000, chain.objs.size()=1 2024-09-14T11:22:51.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.467+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.HF3NVuqkDkI8BcLvfiUlWFpEPAhL8_m_0 2024-09-14T11:22:51.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.467+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.480883275985879687', time=2024-09-14T13:15:33.420610+0000, chain.objs.size()=1 2024-09-14T11:22:51.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.467+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.1a8K7lNGN3u8ThfDgJDpz2EXMRHlkkP_0 2024-09-14T11:22:51.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.467+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.542565998073694080', time=2024-09-14T13:15:33.437217+0000, chain.objs.size()=1 2024-09-14T11:22:51.475 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.467+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.hZuyVfHe4vEYnVJm-tgxlheC0v_h58u_0 2024-09-14T11:22:51.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.468+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15331381646270381509', time=2024-09-14T13:15:33.540107+0000, chain.objs.size()=1 2024-09-14T11:22:51.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.468+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.X3Xb4kqF2CkSTjLDxwn1Qw5XHSJLp6l_0 2024-09-14T11:22:51.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.468+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.11918520142004886289', time=2024-09-14T13:15:33.565409+0000, chain.objs.size()=1 2024-09-14T11:22:51.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.468+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.BsfRVUBgqG9IAYDL4aYZMKOMcRf4yu8_0 2024-09-14T11:22:51.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.468+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5473563966252304042', time=2024-09-14T13:15:33.576757+0000, chain.objs.size()=1 2024-09-14T11:22:51.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.468+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.GDM3AripW5Tu3lKCBzB2D8QWmK1tyWb_0 2024-09-14T11:22:51.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.468+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14242168933254459764', time=2024-09-14T13:15:33.592728+0000, chain.objs.size()=1 2024-09-14T11:22:51.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.468+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.Nout6HlASEtFT1WWscPvAO-oh67BgjK_0 2024-09-14T11:22:51.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.468+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.1620648989341190859', time=2024-09-14T13:15:33.599643+0000, chain.objs.size()=1 2024-09-14T11:22:51.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.469+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.wlF3kUc5Bdoo1la_tDyuj87id5PSeIT_0 2024-09-14T11:22:51.476 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.469+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6657538995820946092', time=2024-09-14T13:15:33.603949+0000, chain.objs.size()=1 2024-09-14T11:22:51.477 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.469+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.C0o4vHmWBzIW6_vfgVvQu6oG-vtXE90_0 2024-09-14T11:22:51.477 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.469+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15165507723420285499', time=2024-09-14T13:15:33.607621+0000, chain.objs.size()=1 2024-09-14T11:22:51.477 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.469+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.I_AUXiPsc72P-ka4OLW4TutoFbFUe7x_0 2024-09-14T11:22:51.477 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.469+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2613251738691992982', time=2024-09-14T13:15:33.615751+0000, chain.objs.size()=1 2024-09-14T11:22:51.477 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.469+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.W7zTdmGrXW9dgzCnnSMlmtuRoaOEXSw_0 2024-09-14T11:22:51.477 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.469+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3123842079941182583', time=2024-09-14T13:15:33.691170+0000, chain.objs.size()=1 2024-09-14T11:22:51.477 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.469+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.lUh0YMlZsTbpo2gFz2KuBhRV9Pgxbxd_0 2024-09-14T11:22:51.477 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.469+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.17997978475195903552', time=2024-09-14T13:15:33.706757+0000, chain.objs.size()=1 2024-09-14T11:22:51.477 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.469+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.LU4mHlR6wU1Q6OUps6QGQTftovx6Xn9_0 2024-09-14T11:22:51.477 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.469+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.2218047649064790677', time=2024-09-14T13:15:33.716523+0000, chain.objs.size()=1 2024-09-14T11:22:51.477 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.469+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.H5VVHCYCTRUZn6764mq-mpUZ46hU1hS_0 2024-09-14T11:22:51.477 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.470+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12793642261999289335', time=2024-09-14T13:15:33.758956+0000, chain.objs.size()=1 2024-09-14T11:22:51.478 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.470+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.-6doRwa5EzMOTjftC_lBurroCgenqAO_0 2024-09-14T11:22:51.478 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.470+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.18023269001764807035', time=2024-09-14T13:15:33.862290+0000, chain.objs.size()=1 2024-09-14T11:22:51.478 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.470+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.uot0dxgl32uPChLYhULUsSJ2gHZzss9_0 2024-09-14T11:22:51.478 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.472+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 0/47718 2024-09-14T11:22:51.481 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.474+0000 7f0f19c16800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=26, truncated=0, next_marker='' 2024-09-14T11:22:51.481 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.474+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9924801315846918163', time=2024-09-14T13:15:33.893621+0000, chain.objs.size()=1 2024-09-14T11:22:51.481 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.474+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.hiOeUFQwqz-FZdH92pP83D3wtA5vUNV_0 2024-09-14T11:22:51.481 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.474+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.3405631864532500196', time=2024-09-14T13:15:33.894410+0000, chain.objs.size()=1 2024-09-14T11:22:51.481 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.474+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.dah7YQ2BTYho9GQlY5L-02_arY_b-PR_0 2024-09-14T11:22:51.481 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.474+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.6812626743307619423', time=2024-09-14T13:15:33.898804+0000, chain.objs.size()=1 2024-09-14T11:22:51.481 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.474+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.PSGUIYoJJS0RD7bAqx0rYH4qm7Q4QJJ_0 2024-09-14T11:22:51.481 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.474+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15557113128425652311', time=2024-09-14T13:15:34.023225+0000, chain.objs.size()=1 2024-09-14T11:22:51.481 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.474+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.MU6VQjkQBagI6DZPDXk5ZxbN4G_IV9__0 2024-09-14T11:22:51.482 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.474+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4983350374180188902', time=2024-09-14T13:15:34.067312+0000, chain.objs.size()=1 2024-09-14T11:22:51.482 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.474+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.pdsbo8Ylaqr8Hhe7RnxwdjP_zm_VtEJ_0 2024-09-14T11:22:51.482 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.474+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9420954579143164295', time=2024-09-14T13:15:34.215302+0000, chain.objs.size()=1 2024-09-14T11:22:51.482 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.474+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.HelI3FxifVIugj31qyGsgGog_y9TaVK_0 2024-09-14T11:22:51.482 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.474+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15376670732154066176', time=2024-09-14T13:15:34.225464+0000, chain.objs.size()=1 2024-09-14T11:22:51.482 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.474+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.lgfgBH5_GdVXJTJQHq1q7cATWecj7C__0 2024-09-14T11:22:51.482 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.474+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.261445082563503271', time=2024-09-14T13:15:34.226355+0000, chain.objs.size()=1 2024-09-14T11:22:51.482 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.474+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.aZLWWKoMBu0ZFAePM-o7DTl9kpgBtFV_0 2024-09-14T11:22:51.482 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.474+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15097644273835820715', time=2024-09-14T13:15:34.258254+0000, chain.objs.size()=1 2024-09-14T11:22:51.482 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.474+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.kXkg3mJrkolLZIgC_vAKC59lvsE4bHc_0 2024-09-14T11:22:51.483 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.474+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12969602453307617205', time=2024-09-14T13:15:34.329490+0000, chain.objs.size()=1 2024-09-14T11:22:51.483 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.474+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.7E7L6A10JDmLtWFRvcmuujpzXZDb9NN_0 2024-09-14T11:22:51.483 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.474+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4329051604727901766', time=2024-09-14T13:15:34.342254+0000, chain.objs.size()=1 2024-09-14T11:22:51.483 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.474+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.EjhL1tLjvHW0ktlcszoiwkgmriUuU3r_0 2024-09-14T11:22:51.483 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.474+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14316569266843237242', time=2024-09-14T13:15:34.348280+0000, chain.objs.size()=1 2024-09-14T11:22:51.483 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.474+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.324__shadow_.VQ6YgyKk5pjaIPfszU_YRAtSC4laRY1_0 2024-09-14T11:22:51.483 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.476+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10848395173231565326', time=2024-09-14T13:16:21.090191+0000, chain.objs.size()=1 2024-09-14T11:22:51.483 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.476+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.497__shadow_.55X9hp3yWRSX90MOM62enhLj4ru-Kwb_0 2024-09-14T11:22:51.483 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.476+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5438143576965939187', time=2024-09-14T13:16:24.669064+0000, chain.objs.size()=6 2024-09-14T11:22:51.483 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.476+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.507__multipart_srcmultipart.2~EQ3ZZNALHrAJsVAZLD-5msuDtyJwYup.1 2024-09-14T11:22:51.483 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.476+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.507__multipart_srcmultipart.2~EQ3ZZNALHrAJsVAZLD-5msuDtyJwYup.2 2024-09-14T11:22:51.483 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.477+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.507__multipart_srcmultipart.2~EQ3ZZNALHrAJsVAZLD-5msuDtyJwYup.3 2024-09-14T11:22:51.484 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.477+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.507__multipart_srcmultipart.2~EQ3ZZNALHrAJsVAZLD-5msuDtyJwYup.4 2024-09-14T11:22:51.484 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.477+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.507__multipart_srcmultipart.2~EQ3ZZNALHrAJsVAZLD-5msuDtyJwYup.5 2024-09-14T11:22:51.484 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.477+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.507__multipart_srcmultipart.2~EQ3ZZNALHrAJsVAZLD-5msuDtyJwYup.6 2024-09-14T11:22:51.484 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.477+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.14041472815959251085', time=2024-09-14T13:16:37.696871+0000, chain.objs.size()=3 2024-09-14T11:22:51.484 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.477+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.525__multipart_mymultipart.2~CmVDQ-_7td0XRRLTIO6RAl6rrkkRORX.1 2024-09-14T11:22:51.484 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.477+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.525__multipart_mymultipart.2~CmVDQ-_7td0XRRLTIO6RAl6rrkkRORX.2 2024-09-14T11:22:51.484 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.477+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.525__multipart_mymultipart.2~CmVDQ-_7td0XRRLTIO6RAl6rrkkRORX.3 2024-09-14T11:22:51.484 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.477+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10711644098884009233', time=2024-09-14T13:17:12.753708+0000, chain.objs.size()=1 2024-09-14T11:22:51.484 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.477+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.557__shadow_.sQlbRPa21LEyJM8vhOwuhpKo4aDUFJK_0 2024-09-14T11:22:51.484 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.480+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9895305860983245963', time=2024-09-14T13:17:29.085754+0000, chain.objs.size()=1 2024-09-14T11:22:51.485 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.480+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.574__shadow_.vzg0JwKbaGsSxEHtNTe7DFpBN3q3y_y_0 2024-09-14T11:22:51.485 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.480+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.16509554958549856297', time=2024-09-14T13:17:33.010111+0000, chain.objs.size()=1 2024-09-14T11:22:51.485 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.480+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.576__shadow:iaip-xTWejhHeT6qjSYcsCyzn0hEWX-_.kalADtSb8vF8EKsOKKKVJ65c4tkrDlG_0 2024-09-14T11:22:51.485 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.480+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.9497145867979831925', time=2024-09-14T13:17:34.944525+0000, chain.objs.size()=1 2024-09-14T11:22:51.485 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.480+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.576__shadow:FxxSYk6yjvbpxAzsSsURX61esmIbKNO_.cjbl98_zK58JIbl21g2L5lEjX_pyDEO_0 2024-09-14T11:22:51.485 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.481+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.5706431465710804073', time=2024-09-14T13:17:37.394675+0000, chain.objs.size()=1 2024-09-14T11:22:51.485 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.481+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.577__shadow:VEt.tPDcGKG82Y8AsWgyCDjuZFM3OcE_.BVWqgXmHqzJA1jyjaTvYQlYlzks4oRn_0 2024-09-14T11:22:51.485 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.481+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.12316431162395764513', time=2024-09-14T13:17:38.255377+0000, chain.objs.size()=1 2024-09-14T11:22:51.485 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.481+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.577__shadow:l03ZwghybzpCSS3140mSfNzjWLWsqj9_.4aDGempz66RTejQWItlcD6tCQRVCmb9_0 2024-09-14T11:22:51.485 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.481+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.8546909842946061336', time=2024-09-14T13:19:03.733771+0000, chain.objs.size()=1 2024-09-14T11:22:51.486 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.481+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.617__shadow_.kgaaHxozzvitOiKd7tNcSX1Py31n7Pk_0 2024-09-14T11:22:51.486 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.481+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.7442211435442600959', time=2024-09-14T13:20:20.780348+0000, chain.objs.size()=1 2024-09-14T11:22:51.486 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.481+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.665__shadow_.bVveS7wJACsLjlbjbIdPlXDkfxX6pcN_0 2024-09-14T11:22:51.486 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.481+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.15048135029584154655', time=2024-09-14T13:20:53.670647+0000, chain.objs.size()=1 2024-09-14T11:22:51.486 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.481+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.719__shadow_.5Ft9LhtTRHKC_GMGQZQ33apEk25PxlO_0 2024-09-14T11:22:51.486 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.481+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.10591510668660369361', time=2024-09-14T13:21:09.585259+0000, chain.objs.size()=1 2024-09-14T11:22:51.486 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.481+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.761__shadow_.QjxzQ63xd8sAiCtHx3p2EQDUSSxv-EL_0 2024-09-14T11:22:51.486 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.481+0000 7f0f19c16800 20 garbage collection: RGWGC::process iterating over entry tag='428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.4469559318798129667', time=2024-09-14T13:21:13.910758+0000, chain.objs.size()=1 2024-09-14T11:22:51.486 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.481+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:428283c8-3a45-44a8-bd53-0ab34f1e0563.4653.772__shadow_.IyT8vG5G8YDQtlYsQKuAvKoDPDIbRMG_0 2024-09-14T11:22:51.487 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.484+0000 7f0f19c16800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:51.487 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.487+0000 7f0dcb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:51.487 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.489+0000 7f0f19c16800 20 remove_watcher() i=0 2024-09-14T11:22:51.487 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.489+0000 7f0f19c16800 2 removed watcher, disabling cache 2024-09-14T11:22:51.488 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.490+0000 7f0f19c16800 20 remove_watcher() i=1 2024-09-14T11:22:51.489 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.491+0000 7f0f19c16800 20 remove_watcher() i=2 2024-09-14T11:22:51.490 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.491+0000 7f0f19c16800 20 remove_watcher() i=3 2024-09-14T11:22:51.491 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.492+0000 7f0f19c16800 20 remove_watcher() i=4 2024-09-14T11:22:51.492 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.494+0000 7f0f19c16800 20 remove_watcher() i=5 2024-09-14T11:22:51.494 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.495+0000 7f0f19c16800 20 remove_watcher() i=6 2024-09-14T11:22:51.495 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-14T11:22:51.496+0000 7f0f19c16800 20 remove_watcher() i=7 2024-09-14T11:22:51.506 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-09-14T11:22:51.518 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-14T11:22:51.541 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-14T11:22:51.541 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:22:51.867 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:22:51.879 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-09-14T11:22:51.882 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":1376,"stamp":"2024-09-14T11:22:51.756586+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":519714181,"num_objects":3605,"num_object_clones":0,"num_object_copies":7210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3605,"num_whiteouts":0,"num_read":306297,"num_read_kb":2750087,"num_write":160993,"num_write_kb":2428955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":190,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13820,"ondisk_log_size":13820,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2715512,"kb_used_data":1305724,"kb_used_omap":12,"kb_used_meta":1409587,"kb_avail":752259208,"statfs":{"total":773094113280,"available":770313428992,"internally_reserved":0,"allocated":1337061376,"data_stored":1295138855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1443417648},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-173140695,"num_objects":-1245,"num_object_clones":0,"num_object_copies":-2490,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1245,"num_whiteouts":0,"num_read":1843,"num_read_kb":2084,"num_write":1435,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004691"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:12.205144+0000","last_change":"2024-09-14T11:11:42.593208+0000","last_active":"2024-09-14T11:19:12.205144+0000","last_peered":"2024-09-14T11:19:12.205144+0000","last_clean":"2024-09-14T11:19:12.205144+0000","last_became_active":"2024-09-14T11:11:42.592933+0000","last_became_peered":"2024-09-14T11:11:42.592933+0000","last_unstale":"2024-09-14T11:19:12.205144+0000","last_undegraded":"2024-09-14T11:19:12.205144+0000","last_fullsized":"2024-09-14T11:19:12.205144+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:50.427016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"260'1","reported_seq":30,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:57.106396+0000","last_change":"2024-09-14T11:01:23.882191+0000","last_active":"2024-09-14T11:18:57.106396+0000","last_peered":"2024-09-14T11:18:57.106396+0000","last_clean":"2024-09-14T11:18:57.106396+0000","last_became_active":"2024-09-14T11:01:23.881902+0000","last_became_peered":"2024-09-14T11:01:23.881902+0000","last_unstale":"2024-09-14T11:18:57.106396+0000","last_undegraded":"2024-09-14T11:18:57.106396+0000","last_fullsized":"2024-09-14T11:18:57.106396+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:46.612242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"260'7","reported_seq":50,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:50.986936+0000","last_change":"2024-09-14T11:01:20.867414+0000","last_active":"2024-09-14T11:18:50.986936+0000","last_peered":"2024-09-14T11:18:50.986936+0000","last_clean":"2024-09-14T11:18:50.986936+0000","last_became_active":"2024-09-14T11:01:20.867142+0000","last_became_peered":"2024-09-14T11:01:20.867142+0000","last_unstale":"2024-09-14T11:18:50.986936+0000","last_undegraded":"2024-09-14T11:18:50.986936+0000","last_fullsized":"2024-09-14T11:18:50.986936+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:51.245462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":17,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"260'30","reported_seq":123,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:41.126104+0000","last_change":"2024-09-14T10:59:48.417565+0000","last_active":"2024-09-14T11:20:41.126104+0000","last_peered":"2024-09-14T11:20:41.126104+0000","last_clean":"2024-09-14T11:20:41.126104+0000","last_became_active":"2024-09-14T10:59:48.416537+0000","last_became_peered":"2024-09-14T10:59:48.416537+0000","last_unstale":"2024-09-14T11:20:41.126104+0000","last_undegraded":"2024-09-14T11:20:41.126104+0000","last_fullsized":"2024-09-14T11:20:41.126104+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:15.136259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":249,"num_read_kb":173,"num_write":73,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:15.984097+0000","last_change":"2024-09-14T11:11:42.588136+0000","last_active":"2024-09-14T11:19:15.984097+0000","last_peered":"2024-09-14T11:19:15.984097+0000","last_clean":"2024-09-14T11:19:15.984097+0000","last_became_active":"2024-09-14T11:11:42.587818+0000","last_became_peered":"2024-09-14T11:11:42.587818+0000","last_unstale":"2024-09-14T11:19:15.984097+0000","last_undegraded":"2024-09-14T11:19:15.984097+0000","last_fullsized":"2024-09-14T11:19:15.984097+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:37.528920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"260'1","reported_seq":29,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:54.982834+0000","last_change":"2024-09-14T11:01:23.881376+0000","last_active":"2024-09-14T11:18:54.982834+0000","last_peered":"2024-09-14T11:18:54.982834+0000","last_clean":"2024-09-14T11:18:54.982834+0000","last_became_active":"2024-09-14T11:01:23.881074+0000","last_became_peered":"2024-09-14T11:01:23.881074+0000","last_unstale":"2024-09-14T11:18:54.982834+0000","last_undegraded":"2024-09-14T11:18:54.982834+0000","last_fullsized":"2024-09-14T11:18:54.982834+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:53.183326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":571,"num_write":1,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"260'8","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:21.253973+0000","last_change":"2024-09-14T11:01:20.868669+0000","last_active":"2024-09-14T11:21:21.253973+0000","last_peered":"2024-09-14T11:21:21.253973+0000","last_clean":"2024-09-14T11:21:21.253973+0000","last_became_active":"2024-09-14T11:01:20.868373+0000","last_became_peered":"2024-09-14T11:01:20.868373+0000","last_unstale":"2024-09-14T11:21:21.253973+0000","last_undegraded":"2024-09-14T11:21:21.253973+0000","last_fullsized":"2024-09-14T11:21:21.253973+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:33:49.244253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10811,"num_write":13,"num_write_kb":10811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"260'56","reported_seq":195,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:56.120455+0000","last_change":"2024-09-14T10:59:48.416508+0000","last_active":"2024-09-14T11:19:56.120455+0000","last_peered":"2024-09-14T11:19:56.120455+0000","last_clean":"2024-09-14T11:19:56.120455+0000","last_became_active":"2024-09-14T10:59:48.416222+0000","last_became_peered":"2024-09-14T10:59:48.416222+0000","last_unstale":"2024-09-14T11:19:56.120455+0000","last_undegraded":"2024-09-14T11:19:56.120455+0000","last_fullsized":"2024-09-14T11:19:56.120455+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:30.061341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":447,"num_read_kb":304,"num_write":135,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:57.106315+0000","last_change":"2024-09-14T11:11:42.593589+0000","last_active":"2024-09-14T11:18:57.106315+0000","last_peered":"2024-09-14T11:18:57.106315+0000","last_clean":"2024-09-14T11:18:57.106315+0000","last_became_active":"2024-09-14T11:11:42.593314+0000","last_became_peered":"2024-09-14T11:11:42.593314+0000","last_unstale":"2024-09-14T11:18:57.106315+0000","last_undegraded":"2024-09-14T11:18:57.106315+0000","last_fullsized":"2024-09-14T11:18:57.106315+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:49.061960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"260'3","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:16.262309+0000","last_change":"2024-09-14T11:01:23.893105+0000","last_active":"2024-09-14T11:22:16.262309+0000","last_peered":"2024-09-14T11:22:16.262309+0000","last_clean":"2024-09-14T11:22:16.262309+0000","last_became_active":"2024-09-14T11:01:23.892846+0000","last_became_peered":"2024-09-14T11:01:23.892846+0000","last_unstale":"2024-09-14T11:22:16.262309+0000","last_undegraded":"2024-09-14T11:22:16.262309+0000","last_fullsized":"2024-09-14T11:22:16.262309+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:50.339780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"260'1","reported_seq":37,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:25.992278+0000","last_change":"2024-09-14T11:01:20.864944+0000","last_active":"2024-09-14T11:19:25.992278+0000","last_peered":"2024-09-14T11:19:25.992278+0000","last_clean":"2024-09-14T11:19:25.992278+0000","last_became_active":"2024-09-14T11:01:20.864672+0000","last_became_peered":"2024-09-14T11:01:20.864672+0000","last_unstale":"2024-09-14T11:19:25.992278+0000","last_undegraded":"2024-09-14T11:19:25.992278+0000","last_fullsized":"2024-09-14T11:19:25.992278+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:06.369402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"260'48","reported_seq":168,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:50.988603+0000","last_change":"2024-09-14T10:59:48.419842+0000","last_active":"2024-09-14T11:19:50.988603+0000","last_peered":"2024-09-14T11:19:50.988603+0000","last_clean":"2024-09-14T11:19:50.988603+0000","last_became_active":"2024-09-14T10:59:48.419525+0000","last_became_peered":"2024-09-14T10:59:48.419525+0000","last_unstale":"2024-09-14T11:19:50.988603+0000","last_undegraded":"2024-09-14T11:19:50.988603+0000","last_fullsized":"2024-09-14T11:19:50.988603+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:04.024597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":364,"num_read_kb":247,"num_write":125,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:01.233674+0000","last_change":"2024-09-14T11:11:42.587584+0000","last_active":"2024-09-14T11:19:01.233674+0000","last_peered":"2024-09-14T11:19:01.233674+0000","last_clean":"2024-09-14T11:19:01.233674+0000","last_became_active":"2024-09-14T11:11:42.587218+0000","last_became_peered":"2024-09-14T11:11:42.587218+0000","last_unstale":"2024-09-14T11:19:01.233674+0000","last_undegraded":"2024-09-14T11:19:01.233674+0000","last_fullsized":"2024-09-14T11:19:01.233674+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:55.734324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"260'1","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:26.237624+0000","last_change":"2024-09-14T11:01:23.887367+0000","last_active":"2024-09-14T11:19:26.237624+0000","last_peered":"2024-09-14T11:19:26.237624+0000","last_clean":"2024-09-14T11:19:26.237624+0000","last_became_active":"2024-09-14T11:01:23.886771+0000","last_became_peered":"2024-09-14T11:01:23.886771+0000","last_unstale":"2024-09-14T11:19:26.237624+0000","last_undegraded":"2024-09-14T11:19:26.237624+0000","last_fullsized":"2024-09-14T11:19:26.237624+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:15.920702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60366,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":118,"num_write":1,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"257'5","reported_seq":50,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:07.117403+0000","last_change":"2024-09-14T11:01:20.862128+0000","last_active":"2024-09-14T11:20:07.117403+0000","last_peered":"2024-09-14T11:20:07.117403+0000","last_clean":"2024-09-14T11:20:07.117403+0000","last_became_active":"2024-09-14T11:01:20.861799+0000","last_became_peered":"2024-09-14T11:01:20.861799+0000","last_unstale":"2024-09-14T11:20:07.117403+0000","last_undegraded":"2024-09-14T11:20:07.117403+0000","last_fullsized":"2024-09-14T11:20:07.117403+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:16.963059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"260'15","reported_seq":77,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:50.988580+0000","last_change":"2024-09-14T10:59:48.411700+0000","last_active":"2024-09-14T11:19:50.988580+0000","last_peered":"2024-09-14T11:19:50.988580+0000","last_clean":"2024-09-14T11:19:50.988580+0000","last_became_active":"2024-09-14T10:59:48.411423+0000","last_became_peered":"2024-09-14T10:59:48.411423+0000","last_unstale":"2024-09-14T11:19:50.988580+0000","last_undegraded":"2024-09-14T11:19:50.988580+0000","last_fullsized":"2024-09-14T11:19:50.988580+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:56.473790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":68,"num_write":41,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:50.995962+0000","last_change":"2024-09-14T11:11:42.584008+0000","last_active":"2024-09-14T11:19:50.995962+0000","last_peered":"2024-09-14T11:19:50.995962+0000","last_clean":"2024-09-14T11:19:50.995962+0000","last_became_active":"2024-09-14T11:11:42.583717+0000","last_became_peered":"2024-09-14T11:11:42.583717+0000","last_unstale":"2024-09-14T11:19:50.995962+0000","last_undegraded":"2024-09-14T11:19:50.995962+0000","last_fullsized":"2024-09-14T11:19:50.995962+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:22:54.043934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"257'3","reported_seq":33,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:22.197565+0000","last_change":"2024-09-14T11:01:23.894300+0000","last_active":"2024-09-14T11:18:22.197565+0000","last_peered":"2024-09-14T11:18:22.197565+0000","last_clean":"2024-09-14T11:18:22.197565+0000","last_became_active":"2024-09-14T11:01:23.894107+0000","last_became_peered":"2024-09-14T11:01:23.894107+0000","last_unstale":"2024-09-14T11:18:22.197565+0000","last_undegraded":"2024-09-14T11:18:22.197565+0000","last_fullsized":"2024-09-14T11:18:22.197565+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:41:19.577357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"260'6","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:41.248008+0000","last_change":"2024-09-14T11:01:20.868842+0000","last_active":"2024-09-14T11:20:41.248008+0000","last_peered":"2024-09-14T11:20:41.248008+0000","last_clean":"2024-09-14T11:20:41.248008+0000","last_became_active":"2024-09-14T11:01:20.867768+0000","last_became_peered":"2024-09-14T11:01:20.867768+0000","last_unstale":"2024-09-14T11:20:41.248008+0000","last_undegraded":"2024-09-14T11:20:41.248008+0000","last_fullsized":"2024-09-14T11:20:41.248008+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:10.338737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"260'40","reported_seq":146,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:50.988519+0000","last_change":"2024-09-14T10:59:48.413952+0000","last_active":"2024-09-14T11:19:50.988519+0000","last_peered":"2024-09-14T11:19:50.988519+0000","last_clean":"2024-09-14T11:19:50.988519+0000","last_became_active":"2024-09-14T10:59:48.413296+0000","last_became_peered":"2024-09-14T10:59:48.413296+0000","last_unstale":"2024-09-14T11:19:50.988519+0000","last_undegraded":"2024-09-14T11:19:50.988519+0000","last_fullsized":"2024-09-14T11:19:50.988519+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:50.801079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":304,"num_read_kb":193,"num_write":101,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:06.121565+0000","last_change":"2024-09-14T11:11:42.582601+0000","last_active":"2024-09-14T11:20:06.121565+0000","last_peered":"2024-09-14T11:20:06.121565+0000","last_clean":"2024-09-14T11:20:06.121565+0000","last_became_active":"2024-09-14T11:11:42.582310+0000","last_became_peered":"2024-09-14T11:11:42.582310+0000","last_unstale":"2024-09-14T11:20:06.121565+0000","last_undegraded":"2024-09-14T11:20:06.121565+0000","last_fullsized":"2024-09-14T11:20:06.121565+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:47:53.329342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"260'7","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:22.101583+0000","last_change":"2024-09-14T11:01:23.888252+0000","last_active":"2024-09-14T11:18:22.101583+0000","last_peered":"2024-09-14T11:18:22.101583+0000","last_clean":"2024-09-14T11:18:22.101583+0000","last_became_active":"2024-09-14T11:01:23.888017+0000","last_became_peered":"2024-09-14T11:01:23.888017+0000","last_unstale":"2024-09-14T11:18:22.101583+0000","last_undegraded":"2024-09-14T11:18:22.101583+0000","last_fullsized":"2024-09-14T11:18:22.101583+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:57.684875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":11264,"num_write":17,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"257'2","reported_seq":37,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:22.101658+0000","last_change":"2024-09-14T11:01:20.863609+0000","last_active":"2024-09-14T11:18:22.101658+0000","last_peered":"2024-09-14T11:18:22.101658+0000","last_clean":"2024-09-14T11:18:22.101658+0000","last_became_active":"2024-09-14T11:01:20.863258+0000","last_became_peered":"2024-09-14T11:01:20.863258+0000","last_unstale":"2024-09-14T11:18:22.101658+0000","last_undegraded":"2024-09-14T11:18:22.101658+0000","last_fullsized":"2024-09-14T11:18:22.101658+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:55.353304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"260'62","reported_seq":215,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:18.893367+0000","last_change":"2024-09-14T10:59:48.420297+0000","last_active":"2024-09-14T11:20:18.893367+0000","last_peered":"2024-09-14T11:20:18.893367+0000","last_clean":"2024-09-14T11:20:18.893367+0000","last_became_active":"2024-09-14T10:59:48.419994+0000","last_became_peered":"2024-09-14T10:59:48.419994+0000","last_unstale":"2024-09-14T11:20:18.893367+0000","last_undegraded":"2024-09-14T11:20:18.893367+0000","last_fullsized":"2024-09-14T11:20:18.893367+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:48.789488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":520,"num_read_kb":329,"num_write":161,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"260'1","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:14.986121+0000","last_change":"2024-09-14T11:11:42.588572+0000","last_active":"2024-09-14T11:19:14.986121+0000","last_peered":"2024-09-14T11:19:14.986121+0000","last_clean":"2024-09-14T11:19:14.986121+0000","last_became_active":"2024-09-14T11:11:42.588308+0000","last_became_peered":"2024-09-14T11:11:42.588308+0000","last_unstale":"2024-09-14T11:19:14.986121+0000","last_undegraded":"2024-09-14T11:19:14.986121+0000","last_fullsized":"2024-09-14T11:19:14.986121+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:38:16.020344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:54.982805+0000","last_change":"2024-09-14T11:01:23.884550+0000","last_active":"2024-09-14T11:18:54.982805+0000","last_peered":"2024-09-14T11:18:54.982805+0000","last_clean":"2024-09-14T11:18:54.982805+0000","last_became_active":"2024-09-14T11:01:23.884138+0000","last_became_peered":"2024-09-14T11:01:23.884138+0000","last_unstale":"2024-09-14T11:18:54.982805+0000","last_undegraded":"2024-09-14T11:18:54.982805+0000","last_fullsized":"2024-09-14T11:18:54.982805+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:10.655429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":33,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:52.202212+0000","last_change":"2024-09-14T11:01:20.855022+0000","last_active":"2024-09-14T11:18:52.202212+0000","last_peered":"2024-09-14T11:18:52.202212+0000","last_clean":"2024-09-14T11:18:52.202212+0000","last_became_active":"2024-09-14T11:01:20.854737+0000","last_became_peered":"2024-09-14T11:01:20.854737+0000","last_unstale":"2024-09-14T11:18:52.202212+0000","last_undegraded":"2024-09-14T11:18:52.202212+0000","last_fullsized":"2024-09-14T11:18:52.202212+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:43.045693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"260'45","reported_seq":163,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:20.991333+0000","last_change":"2024-09-14T10:59:48.420289+0000","last_active":"2024-09-14T11:19:20.991333+0000","last_peered":"2024-09-14T11:19:20.991333+0000","last_clean":"2024-09-14T11:19:20.991333+0000","last_became_active":"2024-09-14T10:59:48.419091+0000","last_became_peered":"2024-09-14T10:59:48.419091+0000","last_unstale":"2024-09-14T11:19:20.991333+0000","last_undegraded":"2024-09-14T11:19:20.991333+0000","last_fullsized":"2024-09-14T11:19:20.991333+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:35.387602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":368,"num_read_kb":243,"num_write":109,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:12.205201+0000","last_change":"2024-09-14T11:11:42.583176+0000","last_active":"2024-09-14T11:19:12.205201+0000","last_peered":"2024-09-14T11:19:12.205201+0000","last_clean":"2024-09-14T11:19:12.205201+0000","last_became_active":"2024-09-14T11:11:42.582899+0000","last_became_peered":"2024-09-14T11:11:42.582899+0000","last_unstale":"2024-09-14T11:19:12.205201+0000","last_undegraded":"2024-09-14T11:19:12.205201+0000","last_fullsized":"2024-09-14T11:19:12.205201+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:00.902463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:55.987589+0000","last_change":"2024-09-14T11:01:23.895643+0000","last_active":"2024-09-14T11:18:55.987589+0000","last_peered":"2024-09-14T11:18:55.987589+0000","last_clean":"2024-09-14T11:18:55.987589+0000","last_became_active":"2024-09-14T11:01:23.894587+0000","last_became_peered":"2024-09-14T11:01:23.894587+0000","last_unstale":"2024-09-14T11:18:55.987589+0000","last_undegraded":"2024-09-14T11:18:55.987589+0000","last_fullsized":"2024-09-14T11:18:55.987589+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:29.534046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"260'2","reported_seq":37,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:50.980652+0000","last_change":"2024-09-14T11:01:20.869542+0000","last_active":"2024-09-14T11:18:50.980652+0000","last_peered":"2024-09-14T11:18:50.980652+0000","last_clean":"2024-09-14T11:18:50.980652+0000","last_became_active":"2024-09-14T11:01:20.869244+0000","last_became_peered":"2024-09-14T11:01:20.869244+0000","last_unstale":"2024-09-14T11:18:50.980652+0000","last_undegraded":"2024-09-14T11:18:50.980652+0000","last_fullsized":"2024-09-14T11:18:50.980652+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:58.638874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"260'35","reported_seq":137,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:58.204964+0000","last_change":"2024-09-14T10:59:48.414261+0000","last_active":"2024-09-14T11:20:58.204964+0000","last_peered":"2024-09-14T11:20:58.204964+0000","last_clean":"2024-09-14T11:20:58.204964+0000","last_became_active":"2024-09-14T10:59:48.414023+0000","last_became_peered":"2024-09-14T10:59:48.414023+0000","last_unstale":"2024-09-14T11:20:58.204964+0000","last_undegraded":"2024-09-14T11:20:58.204964+0000","last_fullsized":"2024-09-14T11:20:58.204964+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:32.125339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":284,"num_read_kb":189,"num_write":86,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:46.231489+0000","last_change":"2024-09-14T11:11:42.592957+0000","last_active":"2024-09-14T11:18:46.231489+0000","last_peered":"2024-09-14T11:18:46.231489+0000","last_clean":"2024-09-14T11:18:46.231489+0000","last_became_active":"2024-09-14T11:11:42.592439+0000","last_became_peered":"2024-09-14T11:11:42.592439+0000","last_unstale":"2024-09-14T11:18:46.231489+0000","last_undegraded":"2024-09-14T11:18:46.231489+0000","last_fullsized":"2024-09-14T11:18:46.231489+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:56:15.581964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"257'3","reported_seq":33,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:20.982723+0000","last_change":"2024-09-14T11:01:23.892350+0000","last_active":"2024-09-14T11:18:20.982723+0000","last_peered":"2024-09-14T11:18:20.982723+0000","last_clean":"2024-09-14T11:18:20.982723+0000","last_became_active":"2024-09-14T11:01:23.891631+0000","last_became_peered":"2024-09-14T11:01:23.891631+0000","last_unstale":"2024-09-14T11:18:20.982723+0000","last_undegraded":"2024-09-14T11:18:20.982723+0000","last_fullsized":"2024-09-14T11:18:20.982723+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:58:22.810241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"260'9","reported_seq":53,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:07.117695+0000","last_change":"2024-09-14T11:01:20.861317+0000","last_active":"2024-09-14T11:20:07.117695+0000","last_peered":"2024-09-14T11:20:07.117695+0000","last_clean":"2024-09-14T11:20:07.117695+0000","last_became_active":"2024-09-14T11:01:20.861043+0000","last_became_peered":"2024-09-14T11:01:20.861043+0000","last_unstale":"2024-09-14T11:20:07.117695+0000","last_undegraded":"2024-09-14T11:20:07.117695+0000","last_fullsized":"2024-09-14T11:20:07.117695+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:42.808761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":17410,"num_write":19,"num_write_kb":12290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"260'250","reported_seq":795,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:11.113999+0000","last_change":"2024-09-14T10:59:48.417407+0000","last_active":"2024-09-14T11:19:11.113999+0000","last_peered":"2024-09-14T11:19:11.113999+0000","last_clean":"2024-09-14T11:19:11.113999+0000","last_became_active":"2024-09-14T10:59:48.416342+0000","last_became_peered":"2024-09-14T10:59:48.416342+0000","last_unstale":"2024-09-14T11:19:11.113999+0000","last_undegraded":"2024-09-14T11:19:11.113999+0000","last_fullsized":"2024-09-14T11:19:11.113999+0000","mapping_epoch":249,"log_start":"257'200","ondisk_log_start":"257'200","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:56:03.687626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2428,"num_read_kb":2819,"num_write":491,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"260'1","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:45.979906+0000","last_change":"2024-09-14T11:11:42.588570+0000","last_active":"2024-09-14T11:18:45.979906+0000","last_peered":"2024-09-14T11:18:45.979906+0000","last_clean":"2024-09-14T11:18:45.979906+0000","last_became_active":"2024-09-14T11:11:42.587835+0000","last_became_peered":"2024-09-14T11:11:42.587835+0000","last_unstale":"2024-09-14T11:18:45.979906+0000","last_undegraded":"2024-09-14T11:18:45.979906+0000","last_fullsized":"2024-09-14T11:18:45.979906+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:05.008377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"260'2","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:06.243716+0000","last_change":"2024-09-14T11:01:23.895555+0000","last_active":"2024-09-14T11:20:06.243716+0000","last_peered":"2024-09-14T11:20:06.243716+0000","last_clean":"2024-09-14T11:20:06.243716+0000","last_became_active":"2024-09-14T11:01:23.892735+0000","last_became_peered":"2024-09-14T11:01:23.892735+0000","last_unstale":"2024-09-14T11:20:06.243716+0000","last_undegraded":"2024-09-14T11:20:06.243716+0000","last_fullsized":"2024-09-14T11:20:06.243716+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:20.552471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"260'3","reported_seq":39,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:17.197007+0000","last_change":"2024-09-14T11:01:20.860826+0000","last_active":"2024-09-14T11:18:17.197007+0000","last_peered":"2024-09-14T11:18:17.197007+0000","last_clean":"2024-09-14T11:18:17.197007+0000","last_became_active":"2024-09-14T11:01:20.860541+0000","last_became_peered":"2024-09-14T11:01:20.860541+0000","last_unstale":"2024-09-14T11:18:17.197007+0000","last_undegraded":"2024-09-14T11:18:17.197007+0000","last_fullsized":"2024-09-14T11:18:17.197007+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:08.358758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60366,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":61,"num_write":3,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"260'12","reported_seq":76,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:11.113972+0000","last_change":"2024-09-14T10:59:48.417263+0000","last_active":"2024-09-14T11:19:11.113972+0000","last_peered":"2024-09-14T11:19:11.113972+0000","last_clean":"2024-09-14T11:19:11.113972+0000","last_became_active":"2024-09-14T10:59:48.417001+0000","last_became_peered":"2024-09-14T10:59:48.417001+0000","last_unstale":"2024-09-14T11:19:11.113972+0000","last_undegraded":"2024-09-14T11:19:11.113972+0000","last_fullsized":"2024-09-14T11:19:11.113972+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:24.272836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":70,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:44.981269+0000","last_change":"2024-09-14T11:11:42.594143+0000","last_active":"2024-09-14T11:18:44.981269+0000","last_peered":"2024-09-14T11:18:44.981269+0000","last_clean":"2024-09-14T11:18:44.981269+0000","last_became_active":"2024-09-14T11:11:42.593873+0000","last_became_peered":"2024-09-14T11:11:42.593873+0000","last_unstale":"2024-09-14T11:18:44.981269+0000","last_undegraded":"2024-09-14T11:18:44.981269+0000","last_fullsized":"2024-09-14T11:18:44.981269+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:38.408015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:20.982781+0000","last_change":"2024-09-14T11:01:23.897460+0000","last_active":"2024-09-14T11:18:20.982781+0000","last_peered":"2024-09-14T11:18:20.982781+0000","last_clean":"2024-09-14T11:18:20.982781+0000","last_became_active":"2024-09-14T11:01:23.897154+0000","last_became_peered":"2024-09-14T11:01:23.897154+0000","last_unstale":"2024-09-14T11:18:20.982781+0000","last_undegraded":"2024-09-14T11:18:20.982781+0000","last_fullsized":"2024-09-14T11:18:20.982781+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:57.444749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"260'2","reported_seq":36,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:41.002355+0000","last_change":"2024-09-14T11:01:20.868430+0000","last_active":"2024-09-14T11:20:41.002355+0000","last_peered":"2024-09-14T11:20:41.002355+0000","last_clean":"2024-09-14T11:20:41.002355+0000","last_became_active":"2024-09-14T11:01:20.868135+0000","last_became_peered":"2024-09-14T11:01:20.868135+0000","last_unstale":"2024-09-14T11:20:41.002355+0000","last_undegraded":"2024-09-14T11:20:41.002355+0000","last_fullsized":"2024-09-14T11:20:41.002355+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:11:52.977202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"260'27","reported_seq":113,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:18.260492+0000","last_change":"2024-09-14T10:59:48.415592+0000","last_active":"2024-09-14T11:20:18.260492+0000","last_peered":"2024-09-14T11:20:18.260492+0000","last_clean":"2024-09-14T11:20:18.260492+0000","last_became_active":"2024-09-14T10:59:48.415324+0000","last_became_peered":"2024-09-14T10:59:48.415324+0000","last_unstale":"2024-09-14T11:20:18.260492+0000","last_undegraded":"2024-09-14T11:20:18.260492+0000","last_fullsized":"2024-09-14T11:20:18.260492+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:36:02.358205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":136,"num_write":70,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:42.200860+0000","last_change":"2024-09-14T11:11:42.592101+0000","last_active":"2024-09-14T11:18:42.200860+0000","last_peered":"2024-09-14T11:18:42.200860+0000","last_clean":"2024-09-14T11:18:42.200860+0000","last_became_active":"2024-09-14T11:11:42.591815+0000","last_became_peered":"2024-09-14T11:11:42.591815+0000","last_unstale":"2024-09-14T11:18:42.200860+0000","last_undegraded":"2024-09-14T11:18:42.200860+0000","last_fullsized":"2024-09-14T11:18:42.200860+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:44:10.362312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"260'2","reported_seq":33,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:22.197640+0000","last_change":"2024-09-14T11:01:23.884051+0000","last_active":"2024-09-14T11:18:22.197640+0000","last_peered":"2024-09-14T11:18:22.197640+0000","last_clean":"2024-09-14T11:18:22.197640+0000","last_became_active":"2024-09-14T11:01:23.883763+0000","last_became_peered":"2024-09-14T11:01:23.883763+0000","last_unstale":"2024-09-14T11:18:22.197640+0000","last_undegraded":"2024-09-14T11:18:22.197640+0000","last_fullsized":"2024-09-14T11:18:22.197640+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:48:45.773610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"260'3","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:16.227393+0000","last_change":"2024-09-14T11:01:20.867156+0000","last_active":"2024-09-14T11:18:16.227393+0000","last_peered":"2024-09-14T11:18:16.227393+0000","last_clean":"2024-09-14T11:18:16.227393+0000","last_became_active":"2024-09-14T11:01:20.866642+0000","last_became_peered":"2024-09-14T11:01:20.866642+0000","last_unstale":"2024-09-14T11:18:16.227393+0000","last_undegraded":"2024-09-14T11:18:16.227393+0000","last_fullsized":"2024-09-14T11:18:16.227393+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:38.426384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":13312,"num_write":8,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"260'32","reported_seq":127,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:37.104014+0000","last_change":"2024-09-14T10:59:48.418606+0000","last_active":"2024-09-14T11:18:37.104014+0000","last_peered":"2024-09-14T11:18:37.104014+0000","last_clean":"2024-09-14T11:18:37.104014+0000","last_became_active":"2024-09-14T10:59:48.418305+0000","last_became_peered":"2024-09-14T10:59:48.418305+0000","last_unstale":"2024-09-14T11:18:37.104014+0000","last_undegraded":"2024-09-14T11:18:37.104014+0000","last_fullsized":"2024-09-14T11:18:37.104014+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:31:32.726408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":251,"num_read_kb":158,"num_write":84,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:01.233757+0000","last_change":"2024-09-14T11:11:42.588989+0000","last_active":"2024-09-14T11:19:01.233757+0000","last_peered":"2024-09-14T11:19:01.233757+0000","last_clean":"2024-09-14T11:19:01.233757+0000","last_became_active":"2024-09-14T11:11:42.588573+0000","last_became_peered":"2024-09-14T11:11:42.588573+0000","last_unstale":"2024-09-14T11:19:01.233757+0000","last_undegraded":"2024-09-14T11:19:01.233757+0000","last_fullsized":"2024-09-14T11:19:01.233757+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:44.929396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:06.243683+0000","last_change":"2024-09-14T11:01:23.895357+0000","last_active":"2024-09-14T11:20:06.243683+0000","last_peered":"2024-09-14T11:20:06.243683+0000","last_clean":"2024-09-14T11:20:06.243683+0000","last_became_active":"2024-09-14T11:01:23.894751+0000","last_became_peered":"2024-09-14T11:01:23.894751+0000","last_unstale":"2024-09-14T11:20:06.243683+0000","last_undegraded":"2024-09-14T11:20:06.243683+0000","last_fullsized":"2024-09-14T11:20:06.243683+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:22:05.395992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:02.116671+0000","last_change":"2024-09-14T11:01:20.867415+0000","last_active":"2024-09-14T11:20:02.116671+0000","last_peered":"2024-09-14T11:20:02.116671+0000","last_clean":"2024-09-14T11:20:02.116671+0000","last_became_active":"2024-09-14T11:01:20.866975+0000","last_became_peered":"2024-09-14T11:01:20.866975+0000","last_unstale":"2024-09-14T11:20:02.116671+0000","last_undegraded":"2024-09-14T11:20:02.116671+0000","last_fullsized":"2024-09-14T11:20:02.116671+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:47.822855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"260'17","reported_seq":82,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:32.103148+0000","last_change":"2024-09-14T10:59:48.421015+0000","last_active":"2024-09-14T11:18:32.103148+0000","last_peered":"2024-09-14T11:18:32.103148+0000","last_clean":"2024-09-14T11:18:32.103148+0000","last_became_active":"2024-09-14T10:59:48.420711+0000","last_became_peered":"2024-09-14T10:59:48.420711+0000","last_unstale":"2024-09-14T11:18:32.103148+0000","last_undegraded":"2024-09-14T11:18:32.103148+0000","last_fullsized":"2024-09-14T11:18:32.103148+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:14:06.864641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":78,"num_write":43,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:00.982102+0000","last_change":"2024-09-14T11:11:42.585332+0000","last_active":"2024-09-14T11:19:00.982102+0000","last_peered":"2024-09-14T11:19:00.982102+0000","last_clean":"2024-09-14T11:19:00.982102+0000","last_became_active":"2024-09-14T11:11:42.583965+0000","last_became_peered":"2024-09-14T11:11:42.583965+0000","last_unstale":"2024-09-14T11:19:00.982102+0000","last_undegraded":"2024-09-14T11:19:00.982102+0000","last_fullsized":"2024-09-14T11:19:00.982102+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:45:52.531506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"257'5","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:06.243650+0000","last_change":"2024-09-14T11:01:23.893658+0000","last_active":"2024-09-14T11:20:06.243650+0000","last_peered":"2024-09-14T11:20:06.243650+0000","last_clean":"2024-09-14T11:20:06.243650+0000","last_became_active":"2024-09-14T11:01:23.893365+0000","last_became_peered":"2024-09-14T11:01:23.893365+0000","last_unstale":"2024-09-14T11:20:06.243650+0000","last_undegraded":"2024-09-14T11:20:06.243650+0000","last_fullsized":"2024-09-14T11:20:06.243650+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:10:44.395112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"260'3","reported_seq":37,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:21.262930+0000","last_change":"2024-09-14T11:01:20.869472+0000","last_active":"2024-09-14T11:22:21.262930+0000","last_peered":"2024-09-14T11:22:21.262930+0000","last_clean":"2024-09-14T11:22:21.262930+0000","last_became_active":"2024-09-14T11:01:20.869209+0000","last_became_peered":"2024-09-14T11:01:20.869209+0000","last_unstale":"2024-09-14T11:22:21.262930+0000","last_undegraded":"2024-09-14T11:22:21.262930+0000","last_fullsized":"2024-09-14T11:22:21.262930+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:54.924564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"260'35","reported_seq":136,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:00.389953+0000","last_change":"2024-09-14T10:59:48.416424+0000","last_active":"2024-09-14T11:21:00.389953+0000","last_peered":"2024-09-14T11:21:00.389953+0000","last_clean":"2024-09-14T11:21:00.389953+0000","last_became_active":"2024-09-14T10:59:48.416149+0000","last_became_peered":"2024-09-14T10:59:48.416149+0000","last_unstale":"2024-09-14T11:21:00.389953+0000","last_undegraded":"2024-09-14T11:21:00.389953+0000","last_fullsized":"2024-09-14T11:21:00.389953+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:12.463862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":285,"num_read_kb":193,"num_write":82,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"259'1","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:46.110446+0000","last_change":"2024-09-14T11:11:42.584334+0000","last_active":"2024-09-14T11:18:46.110446+0000","last_peered":"2024-09-14T11:18:46.110446+0000","last_clean":"2024-09-14T11:18:46.110446+0000","last_became_active":"2024-09-14T11:11:42.583477+0000","last_became_peered":"2024-09-14T11:11:42.583477+0000","last_unstale":"2024-09-14T11:18:46.110446+0000","last_undegraded":"2024-09-14T11:18:46.110446+0000","last_fullsized":"2024-09-14T11:18:46.110446+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:34.189340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"260'8","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:26.017279+0000","last_change":"2024-09-14T11:01:23.891615+0000","last_active":"2024-09-14T11:22:26.017279+0000","last_peered":"2024-09-14T11:22:26.017279+0000","last_clean":"2024-09-14T11:22:26.017279+0000","last_became_active":"2024-09-14T11:01:23.891343+0000","last_became_peered":"2024-09-14T11:01:23.891343+0000","last_unstale":"2024-09-14T11:22:26.017279+0000","last_undegraded":"2024-09-14T11:22:26.017279+0000","last_fullsized":"2024-09-14T11:22:26.017279+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:37.853683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":15362,"num_write":13,"num_write_kb":10242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"260'2","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:02.116735+0000","last_change":"2024-09-14T11:01:20.862125+0000","last_active":"2024-09-14T11:20:02.116735+0000","last_peered":"2024-09-14T11:20:02.116735+0000","last_clean":"2024-09-14T11:20:02.116735+0000","last_became_active":"2024-09-14T11:01:20.861817+0000","last_became_peered":"2024-09-14T11:01:20.861817+0000","last_unstale":"2024-09-14T11:20:02.116735+0000","last_undegraded":"2024-09-14T11:20:02.116735+0000","last_fullsized":"2024-09-14T11:20:02.116735+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:55.520879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"260'106","reported_seq":361,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:29.979162+0000","last_change":"2024-09-14T10:59:48.418299+0000","last_active":"2024-09-14T11:18:29.979162+0000","last_peered":"2024-09-14T11:18:29.979162+0000","last_clean":"2024-09-14T11:18:29.979162+0000","last_became_active":"2024-09-14T10:59:48.418011+0000","last_became_peered":"2024-09-14T10:59:48.418011+0000","last_unstale":"2024-09-14T11:18:29.979162+0000","last_undegraded":"2024-09-14T11:18:29.979162+0000","last_fullsized":"2024-09-14T11:18:29.979162+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:53:09.804245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1045,"num_read_kb":858,"num_write":220,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"260'1","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:00.982068+0000","last_change":"2024-09-14T11:11:42.580964+0000","last_active":"2024-09-14T11:19:00.982068+0000","last_peered":"2024-09-14T11:19:00.982068+0000","last_clean":"2024-09-14T11:19:00.982068+0000","last_became_active":"2024-09-14T11:11:42.580611+0000","last_became_peered":"2024-09-14T11:11:42.580611+0000","last_unstale":"2024-09-14T11:19:00.982068+0000","last_undegraded":"2024-09-14T11:19:00.982068+0000","last_fullsized":"2024-09-14T11:19:00.982068+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:24.715816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:07.117668+0000","last_change":"2024-09-14T11:01:23.886701+0000","last_active":"2024-09-14T11:20:07.117668+0000","last_peered":"2024-09-14T11:20:07.117668+0000","last_clean":"2024-09-14T11:20:07.117668+0000","last_became_active":"2024-09-14T11:01:23.886496+0000","last_became_peered":"2024-09-14T11:01:23.886496+0000","last_unstale":"2024-09-14T11:20:07.117668+0000","last_undegraded":"2024-09-14T11:20:07.117668+0000","last_fullsized":"2024-09-14T11:20:07.117668+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:46.277781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"257'3","reported_seq":40,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:02.116770+0000","last_change":"2024-09-14T11:01:20.863982+0000","last_active":"2024-09-14T11:20:02.116770+0000","last_peered":"2024-09-14T11:20:02.116770+0000","last_clean":"2024-09-14T11:20:02.116770+0000","last_became_active":"2024-09-14T11:01:20.863707+0000","last_became_peered":"2024-09-14T11:01:20.863707+0000","last_unstale":"2024-09-14T11:20:02.116770+0000","last_undegraded":"2024-09-14T11:20:02.116770+0000","last_fullsized":"2024-09-14T11:20:02.116770+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:40.633016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"260'54","reported_seq":190,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:29.870970+0000","last_change":"2024-09-14T10:59:48.422151+0000","last_active":"2024-09-14T11:20:29.870970+0000","last_peered":"2024-09-14T11:20:29.870970+0000","last_clean":"2024-09-14T11:20:29.870970+0000","last_became_active":"2024-09-14T10:59:48.421875+0000","last_became_peered":"2024-09-14T10:59:48.421875+0000","last_unstale":"2024-09-14T11:20:29.870970+0000","last_undegraded":"2024-09-14T11:20:29.870970+0000","last_fullsized":"2024-09-14T11:20:29.870970+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:45.174950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":456,"num_read_kb":308,"num_write":139,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:26.246099+0000","last_change":"2024-09-14T11:11:42.590323+0000","last_active":"2024-09-14T11:20:26.246099+0000","last_peered":"2024-09-14T11:20:26.246099+0000","last_clean":"2024-09-14T11:20:26.246099+0000","last_became_active":"2024-09-14T11:11:42.590056+0000","last_became_peered":"2024-09-14T11:11:42.590056+0000","last_unstale":"2024-09-14T11:20:26.246099+0000","last_undegraded":"2024-09-14T11:20:26.246099+0000","last_fullsized":"2024-09-14T11:20:26.246099+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:24.964712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"260'2","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:41.010434+0000","last_change":"2024-09-14T11:01:23.892070+0000","last_active":"2024-09-14T11:21:41.010434+0000","last_peered":"2024-09-14T11:21:41.010434+0000","last_clean":"2024-09-14T11:21:41.010434+0000","last_became_active":"2024-09-14T11:01:23.891331+0000","last_became_peered":"2024-09-14T11:01:23.891331+0000","last_unstale":"2024-09-14T11:21:41.010434+0000","last_undegraded":"2024-09-14T11:21:41.010434+0000","last_fullsized":"2024-09-14T11:21:41.010434+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:08:04.829621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:19.986970+0000","last_change":"2024-09-14T11:01:20.863405+0000","last_active":"2024-09-14T11:19:19.986970+0000","last_peered":"2024-09-14T11:19:19.986970+0000","last_clean":"2024-09-14T11:19:19.986970+0000","last_became_active":"2024-09-14T11:01:20.863144+0000","last_became_peered":"2024-09-14T11:01:20.863144+0000","last_unstale":"2024-09-14T11:19:19.986970+0000","last_undegraded":"2024-09-14T11:19:19.986970+0000","last_fullsized":"2024-09-14T11:19:19.986970+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:52:05.926396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"260'19","reported_seq":91,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:00.757874+0000","last_change":"2024-09-14T10:59:48.417159+0000","last_active":"2024-09-14T11:21:00.757874+0000","last_peered":"2024-09-14T11:21:00.757874+0000","last_clean":"2024-09-14T11:21:00.757874+0000","last_became_active":"2024-09-14T10:59:48.416902+0000","last_became_peered":"2024-09-14T10:59:48.416902+0000","last_unstale":"2024-09-14T11:21:00.757874+0000","last_undegraded":"2024-09-14T11:21:00.757874+0000","last_fullsized":"2024-09-14T11:21:00.757874+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:14.436213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":98,"num_write":49,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:27.102106+0000","last_change":"2024-09-14T11:11:42.589320+0000","last_active":"2024-09-14T11:18:27.102106+0000","last_peered":"2024-09-14T11:18:27.102106+0000","last_clean":"2024-09-14T11:18:27.102106+0000","last_became_active":"2024-09-14T11:11:42.589071+0000","last_became_peered":"2024-09-14T11:11:42.589071+0000","last_unstale":"2024-09-14T11:18:27.102106+0000","last_undegraded":"2024-09-14T11:18:27.102106+0000","last_fullsized":"2024-09-14T11:18:27.102106+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:24.221085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:25.992224+0000","last_change":"2024-09-14T11:01:23.893015+0000","last_active":"2024-09-14T11:19:25.992224+0000","last_peered":"2024-09-14T11:19:25.992224+0000","last_clean":"2024-09-14T11:19:25.992224+0000","last_became_active":"2024-09-14T11:01:23.892761+0000","last_became_peered":"2024-09-14T11:01:23.892761+0000","last_unstale":"2024-09-14T11:19:25.992224+0000","last_undegraded":"2024-09-14T11:19:25.992224+0000","last_fullsized":"2024-09-14T11:19:25.992224+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:06.763249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:20.984704+0000","last_change":"2024-09-14T11:01:20.866514+0000","last_active":"2024-09-14T11:19:20.984704+0000","last_peered":"2024-09-14T11:19:20.984704+0000","last_clean":"2024-09-14T11:19:20.984704+0000","last_became_active":"2024-09-14T11:01:20.866224+0000","last_became_peered":"2024-09-14T11:01:20.866224+0000","last_unstale":"2024-09-14T11:19:20.984704+0000","last_undegraded":"2024-09-14T11:19:20.984704+0000","last_fullsized":"2024-09-14T11:19:20.984704+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:55.378175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"260'30","reported_seq":122,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:07.117741+0000","last_change":"2024-09-14T10:59:48.416632+0000","last_active":"2024-09-14T11:20:07.117741+0000","last_peered":"2024-09-14T11:20:07.117741+0000","last_clean":"2024-09-14T11:20:07.117741+0000","last_became_active":"2024-09-14T10:59:48.415922+0000","last_became_peered":"2024-09-14T10:59:48.415922+0000","last_unstale":"2024-09-14T11:20:07.117741+0000","last_undegraded":"2024-09-14T11:20:07.117741+0000","last_fullsized":"2024-09-14T11:20:07.117741+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:37.136039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":240,"num_read_kb":165,"num_write":74,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:22.119393+0000","last_change":"2024-09-14T11:11:42.591303+0000","last_active":"2024-09-14T11:20:22.119393+0000","last_peered":"2024-09-14T11:20:22.119393+0000","last_clean":"2024-09-14T11:20:22.119393+0000","last_became_active":"2024-09-14T11:11:42.589881+0000","last_became_peered":"2024-09-14T11:11:42.589881+0000","last_unstale":"2024-09-14T11:20:22.119393+0000","last_undegraded":"2024-09-14T11:20:22.119393+0000","last_fullsized":"2024-09-14T11:20:22.119393+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:53.799897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"257'8","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:30.993019+0000","last_change":"2024-09-14T11:01:23.897536+0000","last_active":"2024-09-14T11:19:30.993019+0000","last_peered":"2024-09-14T11:19:30.993019+0000","last_clean":"2024-09-14T11:19:30.993019+0000","last_became_active":"2024-09-14T11:01:23.897158+0000","last_became_peered":"2024-09-14T11:01:23.897158+0000","last_unstale":"2024-09-14T11:19:30.993019+0000","last_undegraded":"2024-09-14T11:19:30.993019+0000","last_fullsized":"2024-09-14T11:19:30.993019+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:34.363585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6146,"num_write":18,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:20.991433+0000","last_change":"2024-09-14T11:01:20.864291+0000","last_active":"2024-09-14T11:19:20.991433+0000","last_peered":"2024-09-14T11:19:20.991433+0000","last_clean":"2024-09-14T11:19:20.991433+0000","last_became_active":"2024-09-14T11:01:20.863999+0000","last_became_peered":"2024-09-14T11:01:20.863999+0000","last_unstale":"2024-09-14T11:19:20.991433+0000","last_undegraded":"2024-09-14T11:19:20.991433+0000","last_fullsized":"2024-09-14T11:19:20.991433+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:01:25.818000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"260'46","reported_seq":159,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:32.496503+0000","last_change":"2024-09-14T10:59:48.418550+0000","last_active":"2024-09-14T11:20:32.496503+0000","last_peered":"2024-09-14T11:20:32.496503+0000","last_clean":"2024-09-14T11:20:32.496503+0000","last_became_active":"2024-09-14T10:59:48.418276+0000","last_became_peered":"2024-09-14T10:59:48.418276+0000","last_unstale":"2024-09-14T11:20:32.496503+0000","last_undegraded":"2024-09-14T11:20:32.496503+0000","last_fullsized":"2024-09-14T11:20:32.496503+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:57.938381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":345,"num_read_kb":231,"num_write":118,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:22.119116+0000","last_change":"2024-09-14T11:11:42.587132+0000","last_active":"2024-09-14T11:20:22.119116+0000","last_peered":"2024-09-14T11:20:22.119116+0000","last_clean":"2024-09-14T11:20:22.119116+0000","last_became_active":"2024-09-14T11:11:42.586852+0000","last_became_peered":"2024-09-14T11:11:42.586852+0000","last_unstale":"2024-09-14T11:20:22.119116+0000","last_undegraded":"2024-09-14T11:20:22.119116+0000","last_fullsized":"2024-09-14T11:20:22.119116+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:34.192562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"257'3","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:26.237592+0000","last_change":"2024-09-14T11:01:23.887413+0000","last_active":"2024-09-14T11:19:26.237592+0000","last_peered":"2024-09-14T11:19:26.237592+0000","last_clean":"2024-09-14T11:19:26.237592+0000","last_became_active":"2024-09-14T11:01:23.887167+0000","last_became_peered":"2024-09-14T11:01:23.887167+0000","last_unstale":"2024-09-14T11:19:26.237592+0000","last_undegraded":"2024-09-14T11:19:26.237592+0000","last_fullsized":"2024-09-14T11:19:26.237592+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:36:46.808831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"260'4","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:25.992305+0000","last_change":"2024-09-14T11:01:20.857944+0000","last_active":"2024-09-14T11:19:25.992305+0000","last_peered":"2024-09-14T11:19:25.992305+0000","last_clean":"2024-09-14T11:19:25.992305+0000","last_became_active":"2024-09-14T11:01:20.857645+0000","last_became_peered":"2024-09-14T11:01:20.857645+0000","last_unstale":"2024-09-14T11:19:25.992305+0000","last_undegraded":"2024-09-14T11:19:25.992305+0000","last_fullsized":"2024-09-14T11:19:25.992305+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:57:36.222186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":9,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"260'22","reported_seq":101,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:05.990564+0000","last_change":"2024-09-14T10:59:48.413726+0000","last_active":"2024-09-14T11:20:05.990564+0000","last_peered":"2024-09-14T11:20:05.990564+0000","last_clean":"2024-09-14T11:20:05.990564+0000","last_became_active":"2024-09-14T10:59:48.413425+0000","last_became_peered":"2024-09-14T10:59:48.413425+0000","last_unstale":"2024-09-14T11:20:05.990564+0000","last_undegraded":"2024-09-14T11:20:05.990564+0000","last_fullsized":"2024-09-14T11:20:05.990564+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:03.945777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":100,"num_write":57,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:31.229418+0000","last_change":"2024-09-14T11:11:42.588149+0000","last_active":"2024-09-14T11:18:31.229418+0000","last_peered":"2024-09-14T11:18:31.229418+0000","last_clean":"2024-09-14T11:18:31.229418+0000","last_became_active":"2024-09-14T11:11:42.587906+0000","last_became_peered":"2024-09-14T11:11:42.587906+0000","last_unstale":"2024-09-14T11:18:31.229418+0000","last_undegraded":"2024-09-14T11:18:31.229418+0000","last_fullsized":"2024-09-14T11:18:31.229418+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:29.046471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:47.105337+0000","last_change":"2024-09-14T11:01:23.891705+0000","last_active":"2024-09-14T11:18:47.105337+0000","last_peered":"2024-09-14T11:18:47.105337+0000","last_clean":"2024-09-14T11:18:47.105337+0000","last_became_active":"2024-09-14T11:01:23.891424+0000","last_became_peered":"2024-09-14T11:01:23.891424+0000","last_unstale":"2024-09-14T11:18:47.105337+0000","last_undegraded":"2024-09-14T11:18:47.105337+0000","last_fullsized":"2024-09-14T11:18:47.105337+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:57.606174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"260'3","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:40.985234+0000","last_change":"2024-09-14T11:01:20.864246+0000","last_active":"2024-09-14T11:18:40.985234+0000","last_peered":"2024-09-14T11:18:40.985234+0000","last_clean":"2024-09-14T11:18:40.985234+0000","last_became_active":"2024-09-14T11:01:20.863936+0000","last_became_peered":"2024-09-14T11:01:20.863936+0000","last_unstale":"2024-09-14T11:18:40.985234+0000","last_undegraded":"2024-09-14T11:18:40.985234+0000","last_fullsized":"2024-09-14T11:18:40.985234+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:54.851971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":3,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"260'14","reported_seq":80,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:05.990531+0000","last_change":"2024-09-14T10:59:48.414234+0000","last_active":"2024-09-14T11:20:05.990531+0000","last_peered":"2024-09-14T11:20:05.990531+0000","last_clean":"2024-09-14T11:20:05.990531+0000","last_became_active":"2024-09-14T10:59:48.413255+0000","last_became_peered":"2024-09-14T10:59:48.413255+0000","last_unstale":"2024-09-14T11:20:05.990531+0000","last_undegraded":"2024-09-14T11:20:05.990531+0000","last_fullsized":"2024-09-14T11:20:05.990531+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:14.892298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":78,"num_write":38,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:34.979984+0000","last_change":"2024-09-14T11:11:42.588371+0000","last_active":"2024-09-14T11:18:34.979984+0000","last_peered":"2024-09-14T11:18:34.979984+0000","last_clean":"2024-09-14T11:18:34.979984+0000","last_became_active":"2024-09-14T11:11:42.588120+0000","last_became_peered":"2024-09-14T11:11:42.588120+0000","last_unstale":"2024-09-14T11:18:34.979984+0000","last_undegraded":"2024-09-14T11:18:34.979984+0000","last_fullsized":"2024-09-14T11:18:34.979984+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:23.029451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"257'3","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:44.981319+0000","last_change":"2024-09-14T11:01:23.889191+0000","last_active":"2024-09-14T11:18:44.981319+0000","last_peered":"2024-09-14T11:18:44.981319+0000","last_clean":"2024-09-14T11:18:44.981319+0000","last_became_active":"2024-09-14T11:01:23.888873+0000","last_became_peered":"2024-09-14T11:01:23.888873+0000","last_unstale":"2024-09-14T11:18:44.981319+0000","last_undegraded":"2024-09-14T11:18:44.981319+0000","last_fullsized":"2024-09-14T11:18:44.981319+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:21.226880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:41.230765+0000","last_change":"2024-09-14T11:01:20.867172+0000","last_active":"2024-09-14T11:18:41.230765+0000","last_peered":"2024-09-14T11:18:41.230765+0000","last_clean":"2024-09-14T11:18:41.230765+0000","last_became_active":"2024-09-14T11:01:20.865953+0000","last_became_peered":"2024-09-14T11:01:20.865953+0000","last_unstale":"2024-09-14T11:18:41.230765+0000","last_undegraded":"2024-09-14T11:18:41.230765+0000","last_fullsized":"2024-09-14T11:18:41.230765+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:07:32.750973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"260'22","reported_seq":98,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:00.388827+0000","last_change":"2024-09-14T10:59:48.417311+0000","last_active":"2024-09-14T11:21:00.388827+0000","last_peered":"2024-09-14T11:21:00.388827+0000","last_clean":"2024-09-14T11:21:00.388827+0000","last_became_active":"2024-09-14T10:59:48.417013+0000","last_became_peered":"2024-09-14T10:59:48.417013+0000","last_unstale":"2024-09-14T11:21:00.388827+0000","last_undegraded":"2024-09-14T11:21:00.388827+0000","last_fullsized":"2024-09-14T11:21:00.388827+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:55.489720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":110,"num_write":54,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"260'1","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:27.198445+0000","last_change":"2024-09-14T11:11:42.592793+0000","last_active":"2024-09-14T11:18:27.198445+0000","last_peered":"2024-09-14T11:18:27.198445+0000","last_clean":"2024-09-14T11:18:27.198445+0000","last_became_active":"2024-09-14T11:11:42.592514+0000","last_became_peered":"2024-09-14T11:11:42.592514+0000","last_unstale":"2024-09-14T11:18:27.198445+0000","last_undegraded":"2024-09-14T11:18:27.198445+0000","last_fullsized":"2024-09-14T11:18:27.198445+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:15.197793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:25.985335+0000","last_change":"2024-09-14T11:01:23.890689+0000","last_active":"2024-09-14T11:19:25.985335+0000","last_peered":"2024-09-14T11:19:25.985335+0000","last_clean":"2024-09-14T11:19:25.985335+0000","last_became_active":"2024-09-14T11:01:23.890356+0000","last_became_peered":"2024-09-14T11:01:23.890356+0000","last_unstale":"2024-09-14T11:19:25.985335+0000","last_undegraded":"2024-09-14T11:19:25.985335+0000","last_fullsized":"2024-09-14T11:19:25.985335+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:10.636807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"257'3","reported_seq":40,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:45.986096+0000","last_change":"2024-09-14T11:01:20.859484+0000","last_active":"2024-09-14T11:18:45.986096+0000","last_peered":"2024-09-14T11:18:45.986096+0000","last_clean":"2024-09-14T11:18:45.986096+0000","last_became_active":"2024-09-14T11:01:20.859214+0000","last_became_peered":"2024-09-14T11:01:20.859214+0000","last_unstale":"2024-09-14T11:18:45.986096+0000","last_undegraded":"2024-09-14T11:18:45.986096+0000","last_fullsized":"2024-09-14T11:18:45.986096+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:16.912377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"260'23","reported_seq":97,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:21.236876+0000","last_change":"2024-09-14T10:59:48.420616+0000","last_active":"2024-09-14T11:19:21.236876+0000","last_peered":"2024-09-14T11:19:21.236876+0000","last_clean":"2024-09-14T11:19:21.236876+0000","last_became_active":"2024-09-14T10:59:48.420353+0000","last_became_peered":"2024-09-14T10:59:48.420353+0000","last_unstale":"2024-09-14T11:19:21.236876+0000","last_undegraded":"2024-09-14T11:19:21.236876+0000","last_fullsized":"2024-09-14T11:19:21.236876+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:02.159847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":102,"num_write":60,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:30.984019+0000","last_change":"2024-09-14T11:11:42.589448+0000","last_active":"2024-09-14T11:18:30.984019+0000","last_peered":"2024-09-14T11:18:30.984019+0000","last_clean":"2024-09-14T11:18:30.984019+0000","last_became_active":"2024-09-14T11:11:42.589134+0000","last_became_peered":"2024-09-14T11:11:42.589134+0000","last_unstale":"2024-09-14T11:18:30.984019+0000","last_undegraded":"2024-09-14T11:18:30.984019+0000","last_fullsized":"2024-09-14T11:18:30.984019+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:36:39.197914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"260'1","reported_seq":30,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:47.201529+0000","last_change":"2024-09-14T11:01:23.890752+0000","last_active":"2024-09-14T11:18:47.201529+0000","last_peered":"2024-09-14T11:18:47.201529+0000","last_clean":"2024-09-14T11:18:47.201529+0000","last_became_active":"2024-09-14T11:01:23.890433+0000","last_became_peered":"2024-09-14T11:01:23.890433+0000","last_unstale":"2024-09-14T11:18:47.201529+0000","last_undegraded":"2024-09-14T11:18:47.201529+0000","last_fullsized":"2024-09-14T11:18:47.201529+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:00.066817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"257'3","reported_seq":40,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:22.110767+0000","last_change":"2024-09-14T11:01:20.859636+0000","last_active":"2024-09-14T11:19:22.110767+0000","last_peered":"2024-09-14T11:19:22.110767+0000","last_clean":"2024-09-14T11:19:22.110767+0000","last_became_active":"2024-09-14T11:01:20.858834+0000","last_became_peered":"2024-09-14T11:01:20.858834+0000","last_unstale":"2024-09-14T11:19:22.110767+0000","last_undegraded":"2024-09-14T11:19:22.110767+0000","last_fullsized":"2024-09-14T11:19:22.110767+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:26.825835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"260'31","reported_seq":128,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:22.206583+0000","last_change":"2024-09-14T10:59:48.414660+0000","last_active":"2024-09-14T11:19:22.206583+0000","last_peered":"2024-09-14T11:19:22.206583+0000","last_clean":"2024-09-14T11:19:22.206583+0000","last_became_active":"2024-09-14T10:59:48.414351+0000","last_became_peered":"2024-09-14T10:59:48.414351+0000","last_unstale":"2024-09-14T11:19:22.206583+0000","last_undegraded":"2024-09-14T11:19:22.206583+0000","last_fullsized":"2024-09-14T11:19:22.206583+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:47.823706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":249,"num_read_kb":158,"num_write":78,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:02.212097+0000","last_change":"2024-09-14T11:11:42.588279+0000","last_active":"2024-09-14T11:20:02.212097+0000","last_peered":"2024-09-14T11:20:02.212097+0000","last_clean":"2024-09-14T11:20:02.212097+0000","last_became_active":"2024-09-14T11:11:42.587955+0000","last_became_peered":"2024-09-14T11:11:42.587955+0000","last_unstale":"2024-09-14T11:20:02.212097+0000","last_undegraded":"2024-09-14T11:20:02.212097+0000","last_fullsized":"2024-09-14T11:20:02.212097+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:26.572340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"260'8","reported_seq":47,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:16.262273+0000","last_change":"2024-09-14T11:01:23.893822+0000","last_active":"2024-09-14T11:22:16.262273+0000","last_peered":"2024-09-14T11:22:16.262273+0000","last_clean":"2024-09-14T11:22:16.262273+0000","last_became_active":"2024-09-14T11:01:23.891239+0000","last_became_peered":"2024-09-14T11:01:23.891239+0000","last_unstale":"2024-09-14T11:22:16.262273+0000","last_undegraded":"2024-09-14T11:22:16.262273+0000","last_fullsized":"2024-09-14T11:22:16.262273+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:21.232548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20482,"num_write":18,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":35,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:07.117708+0000","last_change":"2024-09-14T11:01:20.867304+0000","last_active":"2024-09-14T11:20:07.117708+0000","last_peered":"2024-09-14T11:20:07.117708+0000","last_clean":"2024-09-14T11:20:07.117708+0000","last_became_active":"2024-09-14T11:01:20.866975+0000","last_became_peered":"2024-09-14T11:01:20.866975+0000","last_unstale":"2024-09-14T11:20:07.117708+0000","last_undegraded":"2024-09-14T11:20:07.117708+0000","last_fullsized":"2024-09-14T11:20:07.117708+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:53.556481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"260'4","reported_seq":50,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:21.115449+0000","last_change":"2024-09-14T10:59:48.417712+0000","last_active":"2024-09-14T11:19:21.115449+0000","last_peered":"2024-09-14T11:19:21.115449+0000","last_clean":"2024-09-14T11:19:21.115449+0000","last_became_active":"2024-09-14T10:59:48.416741+0000","last_became_peered":"2024-09-14T10:59:48.416741+0000","last_unstale":"2024-09-14T11:19:21.115449+0000","last_undegraded":"2024-09-14T11:19:21.115449+0000","last_fullsized":"2024-09-14T11:19:21.115449+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:42.444007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:02.212122+0000","last_change":"2024-09-14T11:11:42.582460+0000","last_active":"2024-09-14T11:20:02.212122+0000","last_peered":"2024-09-14T11:20:02.212122+0000","last_clean":"2024-09-14T11:20:02.212122+0000","last_became_active":"2024-09-14T11:11:42.582190+0000","last_became_peered":"2024-09-14T11:11:42.582190+0000","last_unstale":"2024-09-14T11:20:02.212122+0000","last_undegraded":"2024-09-14T11:20:02.212122+0000","last_fullsized":"2024-09-14T11:20:02.212122+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:34.879085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"260'10","reported_seq":55,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:16.262243+0000","last_change":"2024-09-14T11:01:23.893560+0000","last_active":"2024-09-14T11:22:16.262243+0000","last_peered":"2024-09-14T11:22:16.262243+0000","last_clean":"2024-09-14T11:22:16.262243+0000","last_became_active":"2024-09-14T11:01:23.892344+0000","last_became_peered":"2024-09-14T11:01:23.892344+0000","last_unstale":"2024-09-14T11:22:16.262243+0000","last_undegraded":"2024-09-14T11:22:16.262243+0000","last_fullsized":"2024-09-14T11:22:16.262243+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:12.291644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":30724,"num_write":15,"num_write_kb":10242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"260'2","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:11.138584+0000","last_change":"2024-09-14T11:01:20.863767+0000","last_active":"2024-09-14T11:22:11.138584+0000","last_peered":"2024-09-14T11:22:11.138584+0000","last_clean":"2024-09-14T11:22:11.138584+0000","last_became_active":"2024-09-14T11:01:20.863495+0000","last_became_peered":"2024-09-14T11:01:20.863495+0000","last_unstale":"2024-09-14T11:22:11.138584+0000","last_undegraded":"2024-09-14T11:22:11.138584+0000","last_fullsized":"2024-09-14T11:22:11.138584+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:36:10.395831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"260'32","reported_seq":120,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:22.110836+0000","last_change":"2024-09-14T10:59:48.416964+0000","last_active":"2024-09-14T11:19:22.110836+0000","last_peered":"2024-09-14T11:19:22.110836+0000","last_clean":"2024-09-14T11:19:22.110836+0000","last_became_active":"2024-09-14T10:59:48.416253+0000","last_became_peered":"2024-09-14T10:59:48.416253+0000","last_unstale":"2024-09-14T11:19:22.110836+0000","last_undegraded":"2024-09-14T11:19:22.110836+0000","last_fullsized":"2024-09-14T11:19:22.110836+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:16.459819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":142,"num_write":84,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:46.240692+0000","last_change":"2024-09-14T11:11:42.589281+0000","last_active":"2024-09-14T11:19:46.240692+0000","last_peered":"2024-09-14T11:19:46.240692+0000","last_clean":"2024-09-14T11:19:46.240692+0000","last_became_active":"2024-09-14T11:11:42.588988+0000","last_became_peered":"2024-09-14T11:11:42.588988+0000","last_unstale":"2024-09-14T11:19:46.240692+0000","last_undegraded":"2024-09-14T11:19:46.240692+0000","last_fullsized":"2024-09-14T11:19:46.240692+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:50:56.659833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"260'4","reported_seq":36,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:47.201596+0000","last_change":"2024-09-14T11:01:23.889213+0000","last_active":"2024-09-14T11:18:47.201596+0000","last_peered":"2024-09-14T11:18:47.201596+0000","last_clean":"2024-09-14T11:18:47.201596+0000","last_became_active":"2024-09-14T11:01:23.888845+0000","last_became_peered":"2024-09-14T11:01:23.888845+0000","last_unstale":"2024-09-14T11:18:47.201596+0000","last_undegraded":"2024-09-14T11:18:47.201596+0000","last_fullsized":"2024-09-14T11:18:47.201596+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:20.704713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":11264,"num_write":4,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"257'10","reported_seq":60,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:39.980809+0000","last_change":"2024-09-14T11:01:20.866169+0000","last_active":"2024-09-14T11:18:39.980809+0000","last_peered":"2024-09-14T11:18:39.980809+0000","last_clean":"2024-09-14T11:18:39.980809+0000","last_became_active":"2024-09-14T11:01:20.865891+0000","last_became_peered":"2024-09-14T11:01:20.865891+0000","last_unstale":"2024-09-14T11:18:39.980809+0000","last_undegraded":"2024-09-14T11:18:39.980809+0000","last_fullsized":"2024-09-14T11:18:39.980809+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:22.211764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":24580,"num_write":15,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"260'27","reported_seq":114,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:05.938404+0000","last_change":"2024-09-14T10:59:48.421115+0000","last_active":"2024-09-14T11:20:05.938404+0000","last_peered":"2024-09-14T11:20:05.938404+0000","last_clean":"2024-09-14T11:20:05.938404+0000","last_became_active":"2024-09-14T10:59:48.420845+0000","last_became_peered":"2024-09-14T10:59:48.420845+0000","last_unstale":"2024-09-14T11:20:05.938404+0000","last_undegraded":"2024-09-14T11:20:05.938404+0000","last_fullsized":"2024-09-14T11:20:05.938404+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:56.781294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":135,"num_write":77,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:02.116980+0000","last_change":"2024-09-14T11:11:42.592263+0000","last_active":"2024-09-14T11:20:02.116980+0000","last_peered":"2024-09-14T11:20:02.116980+0000","last_clean":"2024-09-14T11:20:02.116980+0000","last_became_active":"2024-09-14T11:11:42.591734+0000","last_became_peered":"2024-09-14T11:11:42.591734+0000","last_unstale":"2024-09-14T11:20:02.116980+0000","last_undegraded":"2024-09-14T11:20:02.116980+0000","last_fullsized":"2024-09-14T11:20:02.116980+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:48.663357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"260'2","reported_seq":30,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:47.105455+0000","last_change":"2024-09-14T11:01:23.895194+0000","last_active":"2024-09-14T11:18:47.105455+0000","last_peered":"2024-09-14T11:18:47.105455+0000","last_clean":"2024-09-14T11:18:47.105455+0000","last_became_active":"2024-09-14T11:01:23.894904+0000","last_became_peered":"2024-09-14T11:01:23.894904+0000","last_unstale":"2024-09-14T11:18:47.105455+0000","last_undegraded":"2024-09-14T11:18:47.105455+0000","last_fullsized":"2024-09-14T11:18:47.105455+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:18.788575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:42.104731+0000","last_change":"2024-09-14T11:01:20.867989+0000","last_active":"2024-09-14T11:18:42.104731+0000","last_peered":"2024-09-14T11:18:42.104731+0000","last_clean":"2024-09-14T11:18:42.104731+0000","last_became_active":"2024-09-14T11:01:20.867675+0000","last_became_peered":"2024-09-14T11:01:20.867675+0000","last_unstale":"2024-09-14T11:18:42.104731+0000","last_undegraded":"2024-09-14T11:18:42.104731+0000","last_fullsized":"2024-09-14T11:18:42.104731+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:14:01.546319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"260'45","reported_seq":167,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:41.002316+0000","last_change":"2024-09-14T10:59:48.420304+0000","last_active":"2024-09-14T11:20:41.002316+0000","last_peered":"2024-09-14T11:20:41.002316+0000","last_clean":"2024-09-14T11:20:41.002316+0000","last_became_active":"2024-09-14T10:59:48.419276+0000","last_became_peered":"2024-09-14T10:59:48.419276+0000","last_unstale":"2024-09-14T11:20:41.002316+0000","last_undegraded":"2024-09-14T11:20:41.002316+0000","last_fullsized":"2024-09-14T11:20:41.002316+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:28.099017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":347,"num_read_kb":232,"num_write":118,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"259'1","reported_seq":19,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:26.000278+0000","last_change":"2024-09-14T11:11:42.585561+0000","last_active":"2024-09-14T11:20:26.000278+0000","last_peered":"2024-09-14T11:20:26.000278+0000","last_clean":"2024-09-14T11:20:26.000278+0000","last_became_active":"2024-09-14T11:11:42.585114+0000","last_became_peered":"2024-09-14T11:11:42.585114+0000","last_unstale":"2024-09-14T11:20:26.000278+0000","last_undegraded":"2024-09-14T11:20:26.000278+0000","last_fullsized":"2024-09-14T11:20:26.000278+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:57.558919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"260'1","reported_seq":31,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:11.121984+0000","last_change":"2024-09-14T11:01:23.894718+0000","last_active":"2024-09-14T11:20:11.121984+0000","last_peered":"2024-09-14T11:20:11.121984+0000","last_clean":"2024-09-14T11:20:11.121984+0000","last_became_active":"2024-09-14T11:01:23.894464+0000","last_became_peered":"2024-09-14T11:01:23.894464+0000","last_unstale":"2024-09-14T11:20:11.121984+0000","last_undegraded":"2024-09-14T11:20:11.121984+0000","last_fullsized":"2024-09-14T11:20:11.121984+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:05.810582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":35,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:24.987527+0000","last_change":"2024-09-14T11:01:20.869396+0000","last_active":"2024-09-14T11:19:24.987527+0000","last_peered":"2024-09-14T11:19:24.987527+0000","last_clean":"2024-09-14T11:19:24.987527+0000","last_became_active":"2024-09-14T11:01:20.869082+0000","last_became_peered":"2024-09-14T11:01:20.869082+0000","last_unstale":"2024-09-14T11:19:24.987527+0000","last_undegraded":"2024-09-14T11:19:24.987527+0000","last_fullsized":"2024-09-14T11:19:24.987527+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:21.154202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"260'42","reported_seq":152,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:00.225547+0000","last_change":"2024-09-14T10:59:48.420048+0000","last_active":"2024-09-14T11:21:00.225547+0000","last_peered":"2024-09-14T11:21:00.225547+0000","last_clean":"2024-09-14T11:21:00.225547+0000","last_became_active":"2024-09-14T10:59:48.419753+0000","last_became_peered":"2024-09-14T10:59:48.419753+0000","last_unstale":"2024-09-14T11:21:00.225547+0000","last_undegraded":"2024-09-14T11:21:00.225547+0000","last_fullsized":"2024-09-14T11:21:00.225547+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:03.370977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":323,"num_read_kb":218,"num_write":115,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:26.123988+0000","last_change":"2024-09-14T11:11:42.593259+0000","last_active":"2024-09-14T11:20:26.123988+0000","last_peered":"2024-09-14T11:20:26.123988+0000","last_clean":"2024-09-14T11:20:26.123988+0000","last_became_active":"2024-09-14T11:11:42.592960+0000","last_became_peered":"2024-09-14T11:11:42.592960+0000","last_unstale":"2024-09-14T11:20:26.123988+0000","last_undegraded":"2024-09-14T11:20:26.123988+0000","last_fullsized":"2024-09-14T11:20:26.123988+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:01.524529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"260'2","reported_seq":31,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:32.112183+0000","last_change":"2024-09-14T11:01:23.884623+0000","last_active":"2024-09-14T11:19:32.112183+0000","last_peered":"2024-09-14T11:19:32.112183+0000","last_clean":"2024-09-14T11:19:32.112183+0000","last_became_active":"2024-09-14T11:01:23.883464+0000","last_became_peered":"2024-09-14T11:01:23.883464+0000","last_unstale":"2024-09-14T11:19:32.112183+0000","last_undegraded":"2024-09-14T11:19:32.112183+0000","last_fullsized":"2024-09-14T11:19:32.112183+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:39:12.543169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":35,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:07.117641+0000","last_change":"2024-09-14T11:01:20.858331+0000","last_active":"2024-09-14T11:20:07.117641+0000","last_peered":"2024-09-14T11:20:07.117641+0000","last_clean":"2024-09-14T11:20:07.117641+0000","last_became_active":"2024-09-14T11:01:20.858057+0000","last_became_peered":"2024-09-14T11:01:20.858057+0000","last_unstale":"2024-09-14T11:20:07.117641+0000","last_undegraded":"2024-09-14T11:20:07.117641+0000","last_fullsized":"2024-09-14T11:20:07.117641+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:57:11.838133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"260'19","reported_seq":86,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:42.122601+0000","last_change":"2024-09-14T10:59:48.413110+0000","last_active":"2024-09-14T11:20:42.122601+0000","last_peered":"2024-09-14T11:20:42.122601+0000","last_clean":"2024-09-14T11:20:42.122601+0000","last_became_active":"2024-09-14T10:59:48.412832+0000","last_became_peered":"2024-09-14T10:59:48.412832+0000","last_unstale":"2024-09-14T11:20:42.122601+0000","last_undegraded":"2024-09-14T11:20:42.122601+0000","last_fullsized":"2024-09-14T11:20:42.122601+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:06.411861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":68,"num_write":55,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:06.243706+0000","last_change":"2024-09-14T11:11:42.590806+0000","last_active":"2024-09-14T11:20:06.243706+0000","last_peered":"2024-09-14T11:20:06.243706+0000","last_clean":"2024-09-14T11:20:06.243706+0000","last_became_active":"2024-09-14T11:11:42.590549+0000","last_became_peered":"2024-09-14T11:11:42.590549+0000","last_unstale":"2024-09-14T11:20:06.243706+0000","last_undegraded":"2024-09-14T11:20:06.243706+0000","last_fullsized":"2024-09-14T11:20:06.243706+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:47:13.279425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":29,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:09.993244+0000","last_change":"2024-09-14T11:01:23.880483+0000","last_active":"2024-09-14T11:20:09.993244+0000","last_peered":"2024-09-14T11:20:09.993244+0000","last_clean":"2024-09-14T11:20:09.993244+0000","last_became_active":"2024-09-14T11:01:23.880195+0000","last_became_peered":"2024-09-14T11:01:23.880195+0000","last_unstale":"2024-09-14T11:20:09.993244+0000","last_undegraded":"2024-09-14T11:20:09.993244+0000","last_fullsized":"2024-09-14T11:20:09.993244+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:17.209496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":35,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:05.990504+0000","last_change":"2024-09-14T11:01:20.869635+0000","last_active":"2024-09-14T11:20:05.990504+0000","last_peered":"2024-09-14T11:20:05.990504+0000","last_clean":"2024-09-14T11:20:05.990504+0000","last_became_active":"2024-09-14T11:01:20.869312+0000","last_became_peered":"2024-09-14T11:01:20.869312+0000","last_unstale":"2024-09-14T11:20:05.990504+0000","last_undegraded":"2024-09-14T11:20:05.990504+0000","last_fullsized":"2024-09-14T11:20:05.990504+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:36:29.069053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"257'19","reported_seq":97,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:42.122542+0000","last_change":"2024-09-14T10:59:48.418837+0000","last_active":"2024-09-14T11:20:42.122542+0000","last_peered":"2024-09-14T11:20:42.122542+0000","last_clean":"2024-09-14T11:20:42.122542+0000","last_became_active":"2024-09-14T10:59:48.418369+0000","last_became_peered":"2024-09-14T10:59:48.418369+0000","last_unstale":"2024-09-14T11:20:42.122542+0000","last_undegraded":"2024-09-14T11:20:42.122542+0000","last_fullsized":"2024-09-14T11:20:42.122542+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:53.388331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":97,"num_write":49,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:02.117065+0000","last_change":"2024-09-14T11:11:42.593087+0000","last_active":"2024-09-14T11:20:02.117065+0000","last_peered":"2024-09-14T11:20:02.117065+0000","last_clean":"2024-09-14T11:20:02.117065+0000","last_became_active":"2024-09-14T11:11:42.592333+0000","last_became_peered":"2024-09-14T11:11:42.592333+0000","last_unstale":"2024-09-14T11:20:02.117065+0000","last_undegraded":"2024-09-14T11:20:02.117065+0000","last_fullsized":"2024-09-14T11:20:02.117065+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:32.247668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"260'1","reported_seq":31,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:09.993223+0000","last_change":"2024-09-14T11:01:23.882421+0000","last_active":"2024-09-14T11:20:09.993223+0000","last_peered":"2024-09-14T11:20:09.993223+0000","last_clean":"2024-09-14T11:20:09.993223+0000","last_became_active":"2024-09-14T11:01:23.882133+0000","last_became_peered":"2024-09-14T11:01:23.882133+0000","last_unstale":"2024-09-14T11:20:09.993223+0000","last_undegraded":"2024-09-14T11:20:09.993223+0000","last_fullsized":"2024-09-14T11:20:09.993223+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:20.333208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3204,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":35,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:07.117340+0000","last_change":"2024-09-14T11:01:20.861253+0000","last_active":"2024-09-14T11:20:07.117340+0000","last_peered":"2024-09-14T11:20:07.117340+0000","last_clean":"2024-09-14T11:20:07.117340+0000","last_became_active":"2024-09-14T11:01:20.860944+0000","last_became_peered":"2024-09-14T11:01:20.860944+0000","last_unstale":"2024-09-14T11:20:07.117340+0000","last_undegraded":"2024-09-14T11:20:07.117340+0000","last_fullsized":"2024-09-14T11:20:07.117340+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:43.601108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"260'37","reported_seq":141,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:19.371160+0000","last_change":"2024-09-14T10:59:48.420240+0000","last_active":"2024-09-14T11:20:19.371160+0000","last_peered":"2024-09-14T11:20:19.371160+0000","last_clean":"2024-09-14T11:20:19.371160+0000","last_became_active":"2024-09-14T10:59:48.419953+0000","last_became_peered":"2024-09-14T10:59:48.419953+0000","last_unstale":"2024-09-14T11:20:19.371160+0000","last_undegraded":"2024-09-14T11:20:19.371160+0000","last_fullsized":"2024-09-14T11:20:19.371160+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:19.266531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":210,"num_write":90,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"260'286","reported_seq":921,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:09.985550+0000","last_change":"2024-09-14T10:45:43.684610+0000","last_active":"2024-09-14T11:21:09.985550+0000","last_peered":"2024-09-14T11:21:09.985550+0000","last_clean":"2024-09-14T11:21:09.985550+0000","last_became_active":"2024-09-14T10:45:43.684205+0000","last_became_peered":"2024-09-14T10:45:43.684205+0000","last_unstale":"2024-09-14T11:21:09.985550+0000","last_undegraded":"2024-09-14T11:21:09.985550+0000","last_fullsized":"2024-09-14T11:21:09.985550+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:01:55.211378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11900480,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":554,"num_read_kb":37218,"num_write":1014,"num_write_kb":25003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"260'782","reported_seq":2531,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.834281+0000","last_change":"2024-09-14T10:45:45.714795+0000","last_active":"2024-09-14T11:22:42.834281+0000","last_peered":"2024-09-14T11:22:42.834281+0000","last_clean":"2024-09-14T11:22:42.834281+0000","last_became_active":"2024-09-14T10:45:45.714485+0000","last_became_peered":"2024-09-14T10:45:45.714485+0000","last_unstale":"2024-09-14T11:22:42.834281+0000","last_undegraded":"2024-09-14T11:22:42.834281+0000","last_fullsized":"2024-09-14T11:22:42.834281+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:23:57.662505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4300,"num_read_kb":3942,"num_write":1034,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"260'337","reported_seq":1014,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.086853+0000","last_change":"2024-09-14T10:45:43.684416+0000","last_active":"2024-09-14T11:22:51.086853+0000","last_peered":"2024-09-14T11:22:51.086853+0000","last_clean":"2024-09-14T11:22:51.086853+0000","last_became_active":"2024-09-14T10:45:43.683777+0000","last_became_peered":"2024-09-14T10:45:43.683777+0000","last_unstale":"2024-09-14T11:22:51.086853+0000","last_undegraded":"2024-09-14T11:22:51.086853+0000","last_fullsized":"2024-09-14T11:22:51.086853+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:01.676657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23917,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":745,"num_read_kb":10810,"num_write":1134,"num_write_kb":33486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"260'363","reported_seq":1830,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.734957+0000","last_change":"2024-09-14T10:45:45.716175+0000","last_active":"2024-09-14T11:21:28.734957+0000","last_peered":"2024-09-14T11:21:28.734957+0000","last_clean":"2024-09-14T11:21:28.734957+0000","last_became_active":"2024-09-14T10:45:45.715857+0000","last_became_peered":"2024-09-14T10:45:45.715857+0000","last_unstale":"2024-09-14T11:21:28.734957+0000","last_undegraded":"2024-09-14T11:21:28.734957+0000","last_fullsized":"2024-09-14T11:21:28.734957+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:52.361682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2025,"num_read_kb":1946,"num_write":400,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"260'348","reported_seq":1052,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.079373+0000","last_change":"2024-09-14T10:45:43.689580+0000","last_active":"2024-09-14T11:22:51.079373+0000","last_peered":"2024-09-14T11:22:51.079373+0000","last_clean":"2024-09-14T11:22:51.079373+0000","last_became_active":"2024-09-14T10:45:43.689222+0000","last_became_peered":"2024-09-14T10:45:43.689222+0000","last_unstale":"2024-09-14T11:22:51.079373+0000","last_undegraded":"2024-09-14T11:22:51.079373+0000","last_fullsized":"2024-09-14T11:22:51.079373+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:25.612577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":929,"num_read_kb":25215,"num_write":1085,"num_write_kb":46624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"260'805","reported_seq":2235,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:14.951766+0000","last_change":"2024-09-14T10:45:45.718479+0000","last_active":"2024-09-14T11:21:14.951766+0000","last_peered":"2024-09-14T11:21:14.951766+0000","last_clean":"2024-09-14T11:21:14.951766+0000","last_became_active":"2024-09-14T10:45:45.718205+0000","last_became_peered":"2024-09-14T10:45:45.718205+0000","last_unstale":"2024-09-14T11:21:14.951766+0000","last_undegraded":"2024-09-14T11:21:14.951766+0000","last_fullsized":"2024-09-14T11:21:14.951766+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:25.149788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3715,"num_read_kb":3327,"num_write":1051,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"260'321","reported_seq":1063,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:16.586674+0000","last_change":"2024-09-14T10:45:43.689239+0000","last_active":"2024-09-14T11:21:16.586674+0000","last_peered":"2024-09-14T11:21:16.586674+0000","last_clean":"2024-09-14T11:21:16.586674+0000","last_became_active":"2024-09-14T10:45:43.688982+0000","last_became_peered":"2024-09-14T10:45:43.688982+0000","last_unstale":"2024-09-14T11:21:16.586674+0000","last_undegraded":"2024-09-14T11:21:16.586674+0000","last_fullsized":"2024-09-14T11:21:16.586674+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:12.609439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11676363,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":758,"num_read_kb":162477,"num_write":1261,"num_write_kb":45809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"260'456","reported_seq":2005,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.041160+0000","last_change":"2024-09-14T10:45:45.718026+0000","last_active":"2024-09-14T11:21:27.041160+0000","last_peered":"2024-09-14T11:21:27.041160+0000","last_clean":"2024-09-14T11:21:27.041160+0000","last_became_active":"2024-09-14T10:45:45.717699+0000","last_became_peered":"2024-09-14T10:45:45.717699+0000","last_unstale":"2024-09-14T11:21:27.041160+0000","last_undegraded":"2024-09-14T11:21:27.041160+0000","last_fullsized":"2024-09-14T11:21:27.041160+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:20.366459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2461,"num_read_kb":2303,"num_write":536,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"260'292","reported_seq":931,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:58.304735+0000","last_change":"2024-09-14T10:45:43.686364+0000","last_active":"2024-09-14T11:20:58.304735+0000","last_peered":"2024-09-14T11:20:58.304735+0000","last_clean":"2024-09-14T11:20:58.304735+0000","last_became_active":"2024-09-14T10:45:43.686078+0000","last_became_peered":"2024-09-14T10:45:43.686078+0000","last_unstale":"2024-09-14T11:20:58.304735+0000","last_undegraded":"2024-09-14T11:20:58.304735+0000","last_fullsized":"2024-09-14T11:20:58.304735+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:18.961172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":675323,"num_objects":85,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":522,"num_read_kb":61894,"num_write":1086,"num_write_kb":33123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"260'397","reported_seq":2007,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:13.971249+0000","last_change":"2024-09-14T10:45:45.714828+0000","last_active":"2024-09-14T11:21:13.971249+0000","last_peered":"2024-09-14T11:21:13.971249+0000","last_clean":"2024-09-14T11:21:13.971249+0000","last_became_active":"2024-09-14T10:45:45.714345+0000","last_became_peered":"2024-09-14T10:45:45.714345+0000","last_unstale":"2024-09-14T11:21:13.971249+0000","last_undegraded":"2024-09-14T11:21:13.971249+0000","last_fullsized":"2024-09-14T11:21:13.971249+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:55.678707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2395,"num_read_kb":2287,"num_write":454,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"260'295","reported_seq":951,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:04.028564+0000","last_change":"2024-09-14T10:45:43.689767+0000","last_active":"2024-09-14T11:21:04.028564+0000","last_peered":"2024-09-14T11:21:04.028564+0000","last_clean":"2024-09-14T11:21:04.028564+0000","last_became_active":"2024-09-14T10:45:43.689513+0000","last_became_peered":"2024-09-14T10:45:43.689513+0000","last_unstale":"2024-09-14T11:21:04.028564+0000","last_undegraded":"2024-09-14T11:21:04.028564+0000","last_fullsized":"2024-09-14T11:21:04.028564+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:37.766387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17619309,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":629,"num_read_kb":58875,"num_write":1138,"num_write_kb":34980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"260'909","reported_seq":2780,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.732830+0000","last_change":"2024-09-14T10:45:45.722332+0000","last_active":"2024-09-14T11:21:28.732830+0000","last_peered":"2024-09-14T11:21:28.732830+0000","last_clean":"2024-09-14T11:21:28.732830+0000","last_became_active":"2024-09-14T10:45:45.722048+0000","last_became_peered":"2024-09-14T10:45:45.722048+0000","last_unstale":"2024-09-14T11:21:28.732830+0000","last_undegraded":"2024-09-14T11:21:28.732830+0000","last_fullsized":"2024-09-14T11:21:28.732830+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":800,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:09.983695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4452,"num_read_kb":4058,"num_write":1175,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"260'296","reported_seq":930,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:14.812724+0000","last_change":"2024-09-14T10:45:43.690177+0000","last_active":"2024-09-14T11:21:14.812724+0000","last_peered":"2024-09-14T11:21:14.812724+0000","last_clean":"2024-09-14T11:21:14.812724+0000","last_became_active":"2024-09-14T10:45:43.689229+0000","last_became_peered":"2024-09-14T10:45:43.689229+0000","last_unstale":"2024-09-14T11:21:14.812724+0000","last_undegraded":"2024-09-14T11:21:14.812724+0000","last_fullsized":"2024-09-14T11:21:14.812724+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:41:27.105141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5709032,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":530,"num_read_kb":84854,"num_write":1084,"num_write_kb":20352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"260'522","reported_seq":2107,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:13.965056+0000","last_change":"2024-09-14T10:45:45.719274+0000","last_active":"2024-09-14T11:21:13.965056+0000","last_peered":"2024-09-14T11:21:13.965056+0000","last_clean":"2024-09-14T11:21:13.965056+0000","last_became_active":"2024-09-14T10:45:45.718978+0000","last_became_peered":"2024-09-14T10:45:45.718978+0000","last_unstale":"2024-09-14T11:21:13.965056+0000","last_undegraded":"2024-09-14T11:21:13.965056+0000","last_fullsized":"2024-09-14T11:21:13.965056+0000","mapping_epoch":26,"log_start":"260'500","ondisk_log_start":"260'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:26.609949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2761,"num_read_kb":2575,"num_write":634,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"260'330","reported_seq":960,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.138087+0000","last_change":"2024-09-14T10:45:43.687589+0000","last_active":"2024-09-14T11:22:51.138087+0000","last_peered":"2024-09-14T11:22:51.138087+0000","last_clean":"2024-09-14T11:22:51.138087+0000","last_became_active":"2024-09-14T10:45:43.687262+0000","last_became_peered":"2024-09-14T10:45:43.687262+0000","last_unstale":"2024-09-14T11:22:51.138087+0000","last_undegraded":"2024-09-14T11:22:51.138087+0000","last_fullsized":"2024-09-14T11:22:51.138087+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:56:05.018089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27309,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":673,"num_read_kb":42631,"num_write":1149,"num_write_kb":32664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"260'824","reported_seq":2512,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:15.867521+0000","last_change":"2024-09-14T10:45:45.721713+0000","last_active":"2024-09-14T11:21:15.867521+0000","last_peered":"2024-09-14T11:21:15.867521+0000","last_clean":"2024-09-14T11:21:15.867521+0000","last_became_active":"2024-09-14T10:45:45.721400+0000","last_became_peered":"2024-09-14T10:45:45.721400+0000","last_unstale":"2024-09-14T11:21:15.867521+0000","last_undegraded":"2024-09-14T11:21:15.867521+0000","last_fullsized":"2024-09-14T11:21:15.867521+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:10.944485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4476,"num_read_kb":4082,"num_write":1140,"num_write_kb":477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"260'1280","reported_seq":2915,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.732537+0000","last_change":"2024-09-14T10:45:45.710286+0000","last_active":"2024-09-14T11:21:28.732537+0000","last_peered":"2024-09-14T11:21:28.732537+0000","last_clean":"2024-09-14T11:21:28.732537+0000","last_became_active":"2024-09-14T10:45:45.710015+0000","last_became_peered":"2024-09-14T10:45:45.710015+0000","last_unstale":"2024-09-14T11:21:28.732537+0000","last_undegraded":"2024-09-14T11:21:28.732537+0000","last_fullsized":"2024-09-14T11:21:28.732537+0000","mapping_epoch":26,"log_start":"260'1200","ondisk_log_start":"260'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":1200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:23.780013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5907,"num_read_kb":5227,"num_write":1779,"num_write_kb":739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"260'291","reported_seq":892,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:58.073756+0000","last_change":"2024-09-14T10:45:43.678018+0000","last_active":"2024-09-14T11:20:58.073756+0000","last_peered":"2024-09-14T11:20:58.073756+0000","last_clean":"2024-09-14T11:20:58.073756+0000","last_became_active":"2024-09-14T10:45:43.677751+0000","last_became_peered":"2024-09-14T10:45:43.677751+0000","last_unstale":"2024-09-14T11:20:58.073756+0000","last_undegraded":"2024-09-14T11:20:58.073756+0000","last_fullsized":"2024-09-14T11:20:58.073756+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:31.249223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10836945,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":485,"num_read_kb":880,"num_write":1086,"num_write_kb":23836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"260'595","reported_seq":2269,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.326963+0000","last_change":"2024-09-14T10:45:45.714870+0000","last_active":"2024-09-14T11:21:28.326963+0000","last_peered":"2024-09-14T11:21:28.326963+0000","last_clean":"2024-09-14T11:21:28.326963+0000","last_became_active":"2024-09-14T10:45:45.714551+0000","last_became_peered":"2024-09-14T10:45:45.714551+0000","last_unstale":"2024-09-14T11:21:28.326963+0000","last_undegraded":"2024-09-14T11:21:28.326963+0000","last_fullsized":"2024-09-14T11:21:28.326963+0000","mapping_epoch":26,"log_start":"260'500","ondisk_log_start":"260'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":500,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:50.970272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3058,"num_read_kb":2815,"num_write":741,"num_write_kb":205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"260'267","reported_seq":894,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:02.226274+0000","last_change":"2024-09-14T10:45:43.680667+0000","last_active":"2024-09-14T11:22:02.226274+0000","last_peered":"2024-09-14T11:22:02.226274+0000","last_clean":"2024-09-14T11:22:02.226274+0000","last_became_active":"2024-09-14T10:45:43.680355+0000","last_became_peered":"2024-09-14T10:45:43.680355+0000","last_unstale":"2024-09-14T11:22:02.226274+0000","last_undegraded":"2024-09-14T11:22:02.226274+0000","last_fullsized":"2024-09-14T11:22:02.226274+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:57.516008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20278606,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":456,"num_read_kb":36293,"num_write":916,"num_write_kb":55095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"260'493","reported_seq":2162,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:10.106395+0000","last_change":"2024-09-14T10:45:45.721003+0000","last_active":"2024-09-14T11:21:10.106395+0000","last_peered":"2024-09-14T11:21:10.106395+0000","last_clean":"2024-09-14T11:21:10.106395+0000","last_became_active":"2024-09-14T10:45:45.720760+0000","last_became_peered":"2024-09-14T10:45:45.720760+0000","last_unstale":"2024-09-14T11:21:10.106395+0000","last_undegraded":"2024-09-14T11:21:10.106395+0000","last_fullsized":"2024-09-14T11:21:10.106395+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:01.564789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2631,"num_read_kb":2483,"num_write":574,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"260'315","reported_seq":990,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:10.458713+0000","last_change":"2024-09-14T10:45:43.684854+0000","last_active":"2024-09-14T11:21:10.458713+0000","last_peered":"2024-09-14T11:21:10.458713+0000","last_clean":"2024-09-14T11:21:10.458713+0000","last_became_active":"2024-09-14T10:45:43.684428+0000","last_became_peered":"2024-09-14T10:45:43.684428+0000","last_unstale":"2024-09-14T11:21:10.458713+0000","last_undegraded":"2024-09-14T11:21:10.458713+0000","last_fullsized":"2024-09-14T11:21:10.458713+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:19.142556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6726763,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":687,"num_read_kb":9043,"num_write":1153,"num_write_kb":18367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"260'482","reported_seq":2055,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:57.282685+0000","last_change":"2024-09-14T10:45:45.724646+0000","last_active":"2024-09-14T11:21:57.282685+0000","last_peered":"2024-09-14T11:21:57.282685+0000","last_clean":"2024-09-14T11:21:57.282685+0000","last_became_active":"2024-09-14T10:45:45.724302+0000","last_became_peered":"2024-09-14T10:45:45.724302+0000","last_unstale":"2024-09-14T11:21:57.282685+0000","last_undegraded":"2024-09-14T11:21:57.282685+0000","last_fullsized":"2024-09-14T11:21:57.282685+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:59.147972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2564,"num_read_kb":2400,"num_write":575,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"260'278","reported_seq":965,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:15.304782+0000","last_change":"2024-09-14T10:45:43.684077+0000","last_active":"2024-09-14T11:21:15.304782+0000","last_peered":"2024-09-14T11:21:15.304782+0000","last_clean":"2024-09-14T11:21:15.304782+0000","last_became_active":"2024-09-14T10:45:43.683797+0000","last_became_peered":"2024-09-14T10:45:43.683797+0000","last_unstale":"2024-09-14T11:21:15.304782+0000","last_undegraded":"2024-09-14T11:21:15.304782+0000","last_fullsized":"2024-09-14T11:21:15.304782+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:58.402146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5006161,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":659,"num_read_kb":8098,"num_write":1124,"num_write_kb":25345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"260'430","reported_seq":1966,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:57.282334+0000","last_change":"2024-09-14T10:45:45.723905+0000","last_active":"2024-09-14T11:21:57.282334+0000","last_peered":"2024-09-14T11:21:57.282334+0000","last_clean":"2024-09-14T11:21:57.282334+0000","last_became_active":"2024-09-14T10:45:45.723570+0000","last_became_peered":"2024-09-14T10:45:45.723570+0000","last_unstale":"2024-09-14T11:21:57.282334+0000","last_undegraded":"2024-09-14T11:21:57.282334+0000","last_fullsized":"2024-09-14T11:21:57.282334+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:29.680427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2400,"num_read_kb":2278,"num_write":489,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"260'416","reported_seq":1127,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.976345+0000","last_change":"2024-09-14T10:45:43.687914+0000","last_active":"2024-09-14T11:22:50.976345+0000","last_peered":"2024-09-14T11:22:50.976345+0000","last_clean":"2024-09-14T11:22:50.976345+0000","last_became_active":"2024-09-14T10:45:43.687585+0000","last_became_peered":"2024-09-14T10:45:43.687585+0000","last_unstale":"2024-09-14T11:22:50.976345+0000","last_undegraded":"2024-09-14T11:22:50.976345+0000","last_fullsized":"2024-09-14T11:22:50.976345+0000","mapping_epoch":23,"log_start":"260'400","ondisk_log_start":"260'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:00.103110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":649537,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":1117,"num_read_kb":1116,"num_write":1383,"num_write_kb":30799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"260'797","reported_seq":2444,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.833277+0000","last_change":"2024-09-14T10:45:45.714545+0000","last_active":"2024-09-14T11:22:42.833277+0000","last_peered":"2024-09-14T11:22:42.833277+0000","last_clean":"2024-09-14T11:22:42.833277+0000","last_became_active":"2024-09-14T10:45:45.714187+0000","last_became_peered":"2024-09-14T10:45:45.714187+0000","last_unstale":"2024-09-14T11:22:42.833277+0000","last_undegraded":"2024-09-14T11:22:42.833277+0000","last_fullsized":"2024-09-14T11:22:42.833277+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:45.790561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3909,"num_read_kb":3562,"num_write":1036,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"260'312","reported_seq":951,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.960383+0000","last_change":"2024-09-14T10:45:43.682640+0000","last_active":"2024-09-14T11:22:50.960383+0000","last_peered":"2024-09-14T11:22:50.960383+0000","last_clean":"2024-09-14T11:22:50.960383+0000","last_became_active":"2024-09-14T10:45:43.681680+0000","last_became_peered":"2024-09-14T10:45:43.681680+0000","last_unstale":"2024-09-14T11:22:50.960383+0000","last_undegraded":"2024-09-14T11:22:50.960383+0000","last_fullsized":"2024-09-14T11:22:50.960383+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:56.323253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7732508,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":539,"num_read_kb":80056,"num_write":1082,"num_write_kb":31213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"260'166","reported_seq":655,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.801186+0000","last_change":"2024-09-14T10:45:53.749801+0000","last_active":"2024-09-14T11:21:28.801186+0000","last_peered":"2024-09-14T11:21:28.801186+0000","last_clean":"2024-09-14T11:21:28.801186+0000","last_became_active":"2024-09-14T10:45:53.749495+0000","last_became_peered":"2024-09-14T10:45:53.749495+0000","last_unstale":"2024-09-14T11:21:28.801186+0000","last_undegraded":"2024-09-14T11:21:28.801186+0000","last_fullsized":"2024-09-14T11:21:28.801186+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:52.768692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":160,"num_read_kb":158,"num_write":391,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"260'882","reported_seq":2449,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.040798+0000","last_change":"2024-09-14T10:45:45.711094+0000","last_active":"2024-09-14T11:21:27.040798+0000","last_peered":"2024-09-14T11:21:27.040798+0000","last_clean":"2024-09-14T11:21:27.040798+0000","last_became_active":"2024-09-14T10:45:45.710830+0000","last_became_peered":"2024-09-14T10:45:45.710830+0000","last_unstale":"2024-09-14T11:21:27.040798+0000","last_undegraded":"2024-09-14T11:21:27.040798+0000","last_fullsized":"2024-09-14T11:21:27.040798+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":800,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:36:38.927707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5905,"num_read_kb":5530,"num_write":1368,"num_write_kb":537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"260'377","reported_seq":1052,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:09.499854+0000","last_change":"2024-09-14T10:45:43.684728+0000","last_active":"2024-09-14T11:21:09.499854+0000","last_peered":"2024-09-14T11:21:09.499854+0000","last_clean":"2024-09-14T11:21:09.499854+0000","last_became_active":"2024-09-14T10:45:43.684504+0000","last_became_peered":"2024-09-14T10:45:43.684504+0000","last_unstale":"2024-09-14T11:21:09.499854+0000","last_undegraded":"2024-09-14T11:21:09.499854+0000","last_fullsized":"2024-09-14T11:21:09.499854+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:34.311522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7237020,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":782,"num_read_kb":75776,"num_write":1362,"num_write_kb":37052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:37.113110+0000","last_change":"2024-09-14T10:45:47.730971+0000","last_active":"2024-09-14T11:19:37.113110+0000","last_peered":"2024-09-14T11:19:37.113110+0000","last_clean":"2024-09-14T11:19:37.113110+0000","last_became_active":"2024-09-14T10:45:47.730629+0000","last_became_peered":"2024-09-14T10:45:47.730629+0000","last_unstale":"2024-09-14T11:19:37.113110+0000","last_undegraded":"2024-09-14T11:19:37.113110+0000","last_fullsized":"2024-09-14T11:19:37.113110+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:32.300839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"260'333","reported_seq":920,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.380130+0000","last_change":"2024-09-14T10:45:49.734204+0000","last_active":"2024-09-14T11:22:50.380130+0000","last_peered":"2024-09-14T11:22:50.380130+0000","last_clean":"2024-09-14T11:22:50.380130+0000","last_became_active":"2024-09-14T10:45:49.733770+0000","last_became_peered":"2024-09-14T10:45:49.733770+0000","last_unstale":"2024-09-14T11:22:50.380130+0000","last_undegraded":"2024-09-14T11:22:50.380130+0000","last_fullsized":"2024-09-14T11:22:50.380130+0000","mapping_epoch":30,"log_start":"260'300","ondisk_log_start":"260'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:22:33.077712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49773,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":530,"num_read_kb":1113,"num_write":424,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":476,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:42.113693+0000","last_change":"2024-09-14T10:45:51.745748+0000","last_active":"2024-09-14T11:19:42.113693+0000","last_peered":"2024-09-14T11:19:42.113693+0000","last_clean":"2024-09-14T11:19:42.113693+0000","last_became_active":"2024-09-14T10:45:51.745410+0000","last_became_peered":"2024-09-14T10:45:51.745410+0000","last_unstale":"2024-09-14T11:19:42.113693+0000","last_undegraded":"2024-09-14T11:19:42.113693+0000","last_fullsized":"2024-09-14T11:19:42.113693+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:18.010792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"260'94","reported_seq":570,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:57.443244+0000","last_change":"2024-09-14T10:45:53.743811+0000","last_active":"2024-09-14T11:20:57.443244+0000","last_peered":"2024-09-14T11:20:57.443244+0000","last_clean":"2024-09-14T11:20:57.443244+0000","last_became_active":"2024-09-14T10:45:53.743472+0000","last_became_peered":"2024-09-14T10:45:53.743472+0000","last_unstale":"2024-09-14T11:20:57.443244+0000","last_undegraded":"2024-09-14T11:20:57.443244+0000","last_fullsized":"2024-09-14T11:20:57.443244+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:52.958224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":73,"num_read_kb":72,"num_write":215,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"260'380","reported_seq":1786,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.336678+0000","last_change":"2024-09-14T10:45:45.713778+0000","last_active":"2024-09-14T11:21:28.336678+0000","last_peered":"2024-09-14T11:21:28.336678+0000","last_clean":"2024-09-14T11:21:28.336678+0000","last_became_active":"2024-09-14T10:45:45.713502+0000","last_became_peered":"2024-09-14T10:45:45.713502+0000","last_unstale":"2024-09-14T11:21:28.336678+0000","last_undegraded":"2024-09-14T11:21:28.336678+0000","last_fullsized":"2024-09-14T11:21:28.336678+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:23.141736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2020,"num_read_kb":1909,"num_write":423,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"260'272","reported_seq":1001,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.965859+0000","last_change":"2024-09-14T10:45:43.684236+0000","last_active":"2024-09-14T11:22:50.965859+0000","last_peered":"2024-09-14T11:22:50.965859+0000","last_clean":"2024-09-14T11:22:50.965859+0000","last_became_active":"2024-09-14T10:45:43.683964+0000","last_became_peered":"2024-09-14T10:45:43.683964+0000","last_unstale":"2024-09-14T11:22:50.965859+0000","last_undegraded":"2024-09-14T11:22:50.965859+0000","last_fullsized":"2024-09-14T11:22:50.965859+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:17:40.024612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7426285,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":660,"num_read_kb":39643,"num_write":1046,"num_write_kb":23617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:36.108919+0000","last_change":"2024-09-14T10:45:47.730176+0000","last_active":"2024-09-14T11:18:36.108919+0000","last_peered":"2024-09-14T11:18:36.108919+0000","last_clean":"2024-09-14T11:18:36.108919+0000","last_became_active":"2024-09-14T10:45:47.729871+0000","last_became_peered":"2024-09-14T10:45:47.729871+0000","last_unstale":"2024-09-14T11:18:36.108919+0000","last_undegraded":"2024-09-14T11:18:36.108919+0000","last_fullsized":"2024-09-14T11:18:36.108919+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:34.557174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"260'84","reported_seq":592,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:16.298825+0000","last_change":"2024-09-14T10:45:49.733320+0000","last_active":"2024-09-14T11:21:16.298825+0000","last_peered":"2024-09-14T11:21:16.298825+0000","last_clean":"2024-09-14T11:21:16.298825+0000","last_became_active":"2024-09-14T10:45:49.732459+0000","last_became_peered":"2024-09-14T10:45:49.732459+0000","last_unstale":"2024-09-14T11:21:16.298825+0000","last_undegraded":"2024-09-14T11:21:16.298825+0000","last_fullsized":"2024-09-14T11:21:16.298825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:04.811455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":84,"num_read_kb":79,"num_write":56,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":476,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:42.113623+0000","last_change":"2024-09-14T10:45:51.746902+0000","last_active":"2024-09-14T11:19:42.113623+0000","last_peered":"2024-09-14T11:19:42.113623+0000","last_clean":"2024-09-14T11:19:42.113623+0000","last_became_active":"2024-09-14T10:45:51.746608+0000","last_became_peered":"2024-09-14T10:45:51.746608+0000","last_unstale":"2024-09-14T11:19:42.113623+0000","last_undegraded":"2024-09-14T11:19:42.113623+0000","last_fullsized":"2024-09-14T11:19:42.113623+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:13.144965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"260'127","reported_seq":616,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:14.680398+0000","last_change":"2024-09-14T10:45:53.752864+0000","last_active":"2024-09-14T11:21:14.680398+0000","last_peered":"2024-09-14T11:21:14.680398+0000","last_clean":"2024-09-14T11:21:14.680398+0000","last_became_active":"2024-09-14T10:45:53.752597+0000","last_became_peered":"2024-09-14T10:45:53.752597+0000","last_unstale":"2024-09-14T11:21:14.680398+0000","last_undegraded":"2024-09-14T11:21:14.680398+0000","last_fullsized":"2024-09-14T11:21:14.680398+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:09.921876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":152,"num_read_kb":142,"num_write":295,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"260'1282","reported_seq":2988,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:15.435417+0000","last_change":"2024-09-14T10:45:45.725999+0000","last_active":"2024-09-14T11:21:15.435417+0000","last_peered":"2024-09-14T11:21:15.435417+0000","last_clean":"2024-09-14T11:21:15.435417+0000","last_became_active":"2024-09-14T10:45:45.725335+0000","last_became_peered":"2024-09-14T10:45:45.725335+0000","last_unstale":"2024-09-14T11:21:15.435417+0000","last_undegraded":"2024-09-14T11:21:15.435417+0000","last_fullsized":"2024-09-14T11:21:15.435417+0000","mapping_epoch":26,"log_start":"260'1200","ondisk_log_start":"260'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":1200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:56:31.965780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5911,"num_read_kb":5224,"num_write":1759,"num_write_kb":730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"260'281","reported_seq":930,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:13.036893+0000","last_change":"2024-09-14T10:45:43.671411+0000","last_active":"2024-09-14T11:21:13.036893+0000","last_peered":"2024-09-14T11:21:13.036893+0000","last_clean":"2024-09-14T11:21:13.036893+0000","last_became_active":"2024-09-14T10:45:43.671096+0000","last_became_peered":"2024-09-14T10:45:43.671096+0000","last_unstale":"2024-09-14T11:21:13.036893+0000","last_undegraded":"2024-09-14T11:21:13.036893+0000","last_fullsized":"2024-09-14T11:21:13.036893+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:30.153850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11167161,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":615,"num_read_kb":57141,"num_write":1018,"num_write_kb":43933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:41.118430+0000","last_change":"2024-09-14T10:45:47.725982+0000","last_active":"2024-09-14T11:19:41.118430+0000","last_peered":"2024-09-14T11:19:41.118430+0000","last_clean":"2024-09-14T11:19:41.118430+0000","last_became_active":"2024-09-14T10:45:47.724723+0000","last_became_peered":"2024-09-14T10:45:47.724723+0000","last_unstale":"2024-09-14T11:19:41.118430+0000","last_undegraded":"2024-09-14T11:19:41.118430+0000","last_fullsized":"2024-09-14T11:19:41.118430+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:05.411328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"260'110","reported_seq":626,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:56.128174+0000","last_change":"2024-09-14T10:45:49.738230+0000","last_active":"2024-09-14T11:20:56.128174+0000","last_peered":"2024-09-14T11:20:56.128174+0000","last_clean":"2024-09-14T11:20:56.128174+0000","last_became_active":"2024-09-14T10:45:49.737651+0000","last_became_peered":"2024-09-14T10:45:49.737651+0000","last_unstale":"2024-09-14T11:20:56.128174+0000","last_undegraded":"2024-09-14T11:20:56.128174+0000","last_fullsized":"2024-09-14T11:20:56.128174+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:47.715854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":106,"num_write":82,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"260'803","reported_seq":4488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:43.741401+0000","last_change":"2024-09-14T10:45:51.746239+0000","last_active":"2024-09-14T11:22:43.741401+0000","last_peered":"2024-09-14T11:22:43.741401+0000","last_clean":"2024-09-14T11:22:43.741401+0000","last_became_active":"2024-09-14T10:45:51.745441+0000","last_became_peered":"2024-09-14T10:45:51.745441+0000","last_unstale":"2024-09-14T11:22:43.741401+0000","last_undegraded":"2024-09-14T11:22:43.741401+0000","last_fullsized":"2024-09-14T11:22:43.741401+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:37.532791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"260'211","reported_seq":1016,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.737613+0000","last_change":"2024-09-14T10:45:53.753718+0000","last_active":"2024-09-14T11:21:28.737613+0000","last_peered":"2024-09-14T11:21:28.737613+0000","last_clean":"2024-09-14T11:21:28.737613+0000","last_became_active":"2024-09-14T10:45:53.753389+0000","last_became_peered":"2024-09-14T10:45:53.753389+0000","last_unstale":"2024-09-14T11:21:28.737613+0000","last_undegraded":"2024-09-14T11:21:28.737613+0000","last_fullsized":"2024-09-14T11:21:28.737613+0000","mapping_epoch":34,"log_start":"260'200","ondisk_log_start":"260'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:01.726415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":623,"num_read_kb":614,"num_write":459,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"260'900","reported_seq":2535,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.336894+0000","last_change":"2024-09-14T10:45:45.726071+0000","last_active":"2024-09-14T11:21:28.336894+0000","last_peered":"2024-09-14T11:21:28.336894+0000","last_clean":"2024-09-14T11:21:28.336894+0000","last_became_active":"2024-09-14T10:45:45.725700+0000","last_became_peered":"2024-09-14T10:45:45.725700+0000","last_unstale":"2024-09-14T11:21:28.336894+0000","last_undegraded":"2024-09-14T11:21:28.336894+0000","last_fullsized":"2024-09-14T11:21:28.336894+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":800,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:18.814798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4396,"num_read_kb":3931,"num_write":1208,"num_write_kb":463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"260'314","reported_seq":953,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:43.904836+0000","last_change":"2024-09-14T10:45:43.683534+0000","last_active":"2024-09-14T11:20:43.904836+0000","last_peered":"2024-09-14T11:20:43.904836+0000","last_clean":"2024-09-14T11:20:43.904836+0000","last_became_active":"2024-09-14T10:45:43.683274+0000","last_became_peered":"2024-09-14T10:45:43.683274+0000","last_unstale":"2024-09-14T11:20:43.904836+0000","last_undegraded":"2024-09-14T11:20:43.904836+0000","last_fullsized":"2024-09-14T11:20:43.904836+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:02.033164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5574776,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":634,"num_read_kb":4530,"num_write":1072,"num_write_kb":39150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:37.113128+0000","last_change":"2024-09-14T10:45:47.729291+0000","last_active":"2024-09-14T11:19:37.113128+0000","last_peered":"2024-09-14T11:19:37.113128+0000","last_clean":"2024-09-14T11:19:37.113128+0000","last_became_active":"2024-09-14T10:45:47.729004+0000","last_became_peered":"2024-09-14T10:45:47.729004+0000","last_unstale":"2024-09-14T11:19:37.113128+0000","last_undegraded":"2024-09-14T11:19:37.113128+0000","last_fullsized":"2024-09-14T11:19:37.113128+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:50:40.551460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"260'252","reported_seq":791,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:05.007627+0000","last_change":"2024-09-14T10:45:49.729187+0000","last_active":"2024-09-14T11:22:05.007627+0000","last_peered":"2024-09-14T11:22:05.007627+0000","last_clean":"2024-09-14T11:22:05.007627+0000","last_became_active":"2024-09-14T10:45:49.728896+0000","last_became_peered":"2024-09-14T10:45:49.728896+0000","last_unstale":"2024-09-14T11:22:05.007627+0000","last_undegraded":"2024-09-14T11:22:05.007627+0000","last_fullsized":"2024-09-14T11:22:05.007627+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:09:59.076512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55057,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":431,"num_read_kb":926,"num_write":360,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"260'803","reported_seq":3875,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.304071+0000","last_change":"2024-09-14T10:45:51.745148+0000","last_active":"2024-09-14T11:22:50.304071+0000","last_peered":"2024-09-14T11:22:50.304071+0000","last_clean":"2024-09-14T11:22:50.304071+0000","last_became_active":"2024-09-14T10:45:51.744510+0000","last_became_peered":"2024-09-14T10:45:51.744510+0000","last_unstale":"2024-09-14T11:22:50.304071+0000","last_undegraded":"2024-09-14T11:22:50.304071+0000","last_fullsized":"2024-09-14T11:22:50.304071+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:37.874498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"260'638","reported_seq":2325,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.742160+0000","last_change":"2024-09-14T10:45:45.716820+0000","last_active":"2024-09-14T11:21:28.742160+0000","last_peered":"2024-09-14T11:21:28.742160+0000","last_clean":"2024-09-14T11:21:28.742160+0000","last_became_active":"2024-09-14T10:45:45.716537+0000","last_became_peered":"2024-09-14T10:45:45.716537+0000","last_unstale":"2024-09-14T11:21:28.742160+0000","last_undegraded":"2024-09-14T11:21:28.742160+0000","last_fullsized":"2024-09-14T11:21:28.742160+0000","mapping_epoch":26,"log_start":"260'600","ondisk_log_start":"260'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":600,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:58.190819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3192,"num_read_kb":2926,"num_write":775,"num_write_kb":229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"260'292","reported_seq":894,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.997857+0000","last_change":"2024-09-14T10:46:20.046168+0000","last_active":"2024-09-14T11:22:50.997857+0000","last_peered":"2024-09-14T11:22:50.997857+0000","last_clean":"2024-09-14T11:22:50.997857+0000","last_became_active":"2024-09-14T10:46:20.045945+0000","last_became_peered":"2024-09-14T10:46:20.045945+0000","last_unstale":"2024-09-14T11:22:50.997857+0000","last_undegraded":"2024-09-14T11:22:50.997857+0000","last_fullsized":"2024-09-14T11:22:50.997857+0000","mapping_epoch":37,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:32.371701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6293858,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":615,"num_read_kb":12757,"num_write":970,"num_write_kb":36887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":486,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:27.119742+0000","last_change":"2024-09-14T10:45:47.721721+0000","last_active":"2024-09-14T11:20:27.119742+0000","last_peered":"2024-09-14T11:20:27.119742+0000","last_clean":"2024-09-14T11:20:27.119742+0000","last_became_active":"2024-09-14T10:45:47.720639+0000","last_became_peered":"2024-09-14T10:45:47.720639+0000","last_unstale":"2024-09-14T11:20:27.119742+0000","last_undegraded":"2024-09-14T11:20:27.119742+0000","last_fullsized":"2024-09-14T11:20:27.119742+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:32.317587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"260'343","reported_seq":930,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.230665+0000","last_change":"2024-09-14T10:45:49.733109+0000","last_active":"2024-09-14T11:22:42.230665+0000","last_peered":"2024-09-14T11:22:42.230665+0000","last_clean":"2024-09-14T11:22:42.230665+0000","last_became_active":"2024-09-14T10:45:49.732754+0000","last_became_peered":"2024-09-14T10:45:49.732754+0000","last_unstale":"2024-09-14T11:22:42.230665+0000","last_undegraded":"2024-09-14T11:22:42.230665+0000","last_fullsized":"2024-09-14T11:22:42.230665+0000","mapping_epoch":30,"log_start":"260'300","ondisk_log_start":"260'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:34.312772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110456,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":559,"num_read_kb":1190,"num_write":454,"num_write_kb":374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":471,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:35.986676+0000","last_change":"2024-09-14T10:45:51.746554+0000","last_active":"2024-09-14T11:19:35.986676+0000","last_peered":"2024-09-14T11:19:35.986676+0000","last_clean":"2024-09-14T11:19:35.986676+0000","last_became_active":"2024-09-14T10:45:51.746282+0000","last_became_peered":"2024-09-14T10:45:51.746282+0000","last_unstale":"2024-09-14T11:19:35.986676+0000","last_undegraded":"2024-09-14T11:19:35.986676+0000","last_fullsized":"2024-09-14T11:19:35.986676+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:58.772084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"260'557","reported_seq":1354,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:43.728730+0000","last_change":"2024-09-14T10:45:53.756022+0000","last_active":"2024-09-14T11:22:43.728730+0000","last_peered":"2024-09-14T11:22:43.728730+0000","last_clean":"2024-09-14T11:22:43.728730+0000","last_became_active":"2024-09-14T10:45:53.755505+0000","last_became_peered":"2024-09-14T10:45:53.755505+0000","last_unstale":"2024-09-14T11:22:43.728730+0000","last_undegraded":"2024-09-14T11:22:43.728730+0000","last_fullsized":"2024-09-14T11:22:43.728730+0000","mapping_epoch":34,"log_start":"260'500","ondisk_log_start":"260'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:02.468804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1310,"num_read_kb":1299,"num_write":1164,"num_write_kb":395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"260'605","reported_seq":2241,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.048954+0000","last_change":"2024-09-14T10:45:45.727093+0000","last_active":"2024-09-14T11:21:27.048954+0000","last_peered":"2024-09-14T11:21:27.048954+0000","last_clean":"2024-09-14T11:21:27.048954+0000","last_became_active":"2024-09-14T10:45:45.726869+0000","last_became_peered":"2024-09-14T10:45:45.726869+0000","last_unstale":"2024-09-14T11:21:27.048954+0000","last_undegraded":"2024-09-14T11:21:27.048954+0000","last_fullsized":"2024-09-14T11:21:27.048954+0000","mapping_epoch":26,"log_start":"260'500","ondisk_log_start":"260'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":500,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:48.236280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3274,"num_read_kb":2999,"num_write":839,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"260'318","reported_seq":978,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:12.179037+0000","last_change":"2024-09-14T10:45:43.685334+0000","last_active":"2024-09-14T11:21:12.179037+0000","last_peered":"2024-09-14T11:21:12.179037+0000","last_clean":"2024-09-14T11:21:12.179037+0000","last_became_active":"2024-09-14T10:45:43.685087+0000","last_became_peered":"2024-09-14T10:45:43.685087+0000","last_unstale":"2024-09-14T11:21:12.179037+0000","last_undegraded":"2024-09-14T11:21:12.179037+0000","last_fullsized":"2024-09-14T11:21:12.179037+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:08.084059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1137367,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":670,"num_read_kb":49067,"num_write":1227,"num_write_kb":21177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":480,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:30.993267+0000","last_change":"2024-09-14T10:45:47.727776+0000","last_active":"2024-09-14T11:20:30.993267+0000","last_peered":"2024-09-14T11:20:30.993267+0000","last_clean":"2024-09-14T11:20:30.993267+0000","last_became_active":"2024-09-14T10:45:47.727250+0000","last_became_peered":"2024-09-14T10:45:47.727250+0000","last_unstale":"2024-09-14T11:20:30.993267+0000","last_undegraded":"2024-09-14T11:20:30.993267+0000","last_fullsized":"2024-09-14T11:20:30.993267+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:04.583303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"260'256","reported_seq":810,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.980108+0000","last_change":"2024-09-14T10:45:49.735628+0000","last_active":"2024-09-14T11:22:50.980108+0000","last_peered":"2024-09-14T11:22:50.980108+0000","last_clean":"2024-09-14T11:22:50.980108+0000","last_became_active":"2024-09-14T10:45:49.735124+0000","last_became_peered":"2024-09-14T10:45:49.735124+0000","last_unstale":"2024-09-14T11:22:50.980108+0000","last_undegraded":"2024-09-14T11:22:50.980108+0000","last_fullsized":"2024-09-14T11:22:50.980108+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:52.071424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45256,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":435,"num_read_kb":1035,"num_write":356,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:36.125222+0000","last_change":"2024-09-14T10:45:51.745912+0000","last_active":"2024-09-14T11:20:36.125222+0000","last_peered":"2024-09-14T11:20:36.125222+0000","last_clean":"2024-09-14T11:20:36.125222+0000","last_became_active":"2024-09-14T10:45:51.744757+0000","last_became_peered":"2024-09-14T10:45:51.744757+0000","last_unstale":"2024-09-14T11:20:36.125222+0000","last_undegraded":"2024-09-14T11:20:36.125222+0000","last_fullsized":"2024-09-14T11:20:36.125222+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:15.473173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"260'2449","reported_seq":4259,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:57.283800+0000","last_change":"2024-09-14T10:45:53.753015+0000","last_active":"2024-09-14T11:21:57.283800+0000","last_peered":"2024-09-14T11:21:57.283800+0000","last_clean":"2024-09-14T11:21:57.283800+0000","last_became_active":"2024-09-14T10:45:53.752708+0000","last_became_peered":"2024-09-14T10:45:53.752708+0000","last_unstale":"2024-09-14T11:21:57.283800+0000","last_undegraded":"2024-09-14T11:21:57.283800+0000","last_fullsized":"2024-09-14T11:21:57.283800+0000","mapping_epoch":34,"log_start":"260'2400","ondisk_log_start":"260'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":2400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:01:55.437550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6140,"num_read_kb":6145,"num_write":4932,"num_write_kb":1822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"260'757","reported_seq":2462,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.048715+0000","last_change":"2024-09-14T10:45:45.722496+0000","last_active":"2024-09-14T11:21:27.048715+0000","last_peered":"2024-09-14T11:21:27.048715+0000","last_clean":"2024-09-14T11:21:27.048715+0000","last_became_active":"2024-09-14T10:45:45.722006+0000","last_became_peered":"2024-09-14T10:45:45.722006+0000","last_unstale":"2024-09-14T11:21:27.048715+0000","last_undegraded":"2024-09-14T11:21:27.048715+0000","last_fullsized":"2024-09-14T11:21:27.048715+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:00.949810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4059,"num_read_kb":3717,"num_write":984,"num_write_kb":359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"260'303","reported_seq":941,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:26.619307+0000","last_change":"2024-09-14T10:45:43.676243+0000","last_active":"2024-09-14T11:21:26.619307+0000","last_peered":"2024-09-14T11:21:26.619307+0000","last_clean":"2024-09-14T11:21:26.619307+0000","last_became_active":"2024-09-14T10:45:43.675954+0000","last_became_peered":"2024-09-14T10:45:43.675954+0000","last_unstale":"2024-09-14T11:21:26.619307+0000","last_undegraded":"2024-09-14T11:21:26.619307+0000","last_fullsized":"2024-09-14T11:21:26.619307+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:56.905528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17559214,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":579,"num_read_kb":32892,"num_write":1070,"num_write_kb":70045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"36'5","reported_seq":958,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.270306+0000","last_change":"2024-09-14T10:45:47.723683+0000","last_active":"2024-09-14T11:22:50.270306+0000","last_peered":"2024-09-14T11:22:50.270306+0000","last_clean":"2024-09-14T11:22:50.270306+0000","last_became_active":"2024-09-14T10:45:47.723389+0000","last_became_peered":"2024-09-14T10:45:47.723389+0000","last_unstale":"2024-09-14T11:22:50.270306+0000","last_undegraded":"2024-09-14T11:22:50.270306+0000","last_fullsized":"2024-09-14T11:22:50.270306+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:23.601158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"260'267","reported_seq":823,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.015391+0000","last_change":"2024-09-14T10:45:49.729401+0000","last_active":"2024-09-14T11:22:42.015391+0000","last_peered":"2024-09-14T11:22:42.015391+0000","last_clean":"2024-09-14T11:22:42.015391+0000","last_became_active":"2024-09-14T10:45:49.729120+0000","last_became_peered":"2024-09-14T10:45:49.729120+0000","last_unstale":"2024-09-14T11:22:42.015391+0000","last_undegraded":"2024-09-14T11:22:42.015391+0000","last_fullsized":"2024-09-14T11:22:42.015391+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:30.995395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50035,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":431,"num_read_kb":873,"num_write":348,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"260'803","reported_seq":2503,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.305325+0000","last_change":"2024-09-14T10:45:51.745170+0000","last_active":"2024-09-14T11:22:50.305325+0000","last_peered":"2024-09-14T11:22:50.305325+0000","last_clean":"2024-09-14T11:22:50.305325+0000","last_became_active":"2024-09-14T10:45:51.744869+0000","last_became_peered":"2024-09-14T10:45:51.744869+0000","last_unstale":"2024-09-14T11:22:50.305325+0000","last_undegraded":"2024-09-14T11:22:50.305325+0000","last_fullsized":"2024-09-14T11:22:50.305325+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:26.188815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"260'164","reported_seq":638,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.837357+0000","last_change":"2024-09-14T10:45:53.755630+0000","last_active":"2024-09-14T11:22:42.837357+0000","last_peered":"2024-09-14T11:22:42.837357+0000","last_clean":"2024-09-14T11:22:42.837357+0000","last_became_active":"2024-09-14T10:45:53.755367+0000","last_became_peered":"2024-09-14T10:45:53.755367+0000","last_unstale":"2024-09-14T11:22:42.837357+0000","last_undegraded":"2024-09-14T11:22:42.837357+0000","last_fullsized":"2024-09-14T11:22:42.837357+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:07:14.533708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":815,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":135,"num_read_kb":134,"num_write":407,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"260'761","reported_seq":2252,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:15.867801+0000","last_change":"2024-09-14T10:45:45.720145+0000","last_active":"2024-09-14T11:21:15.867801+0000","last_peered":"2024-09-14T11:21:15.867801+0000","last_clean":"2024-09-14T11:21:15.867801+0000","last_became_active":"2024-09-14T10:45:45.719864+0000","last_became_peered":"2024-09-14T10:45:45.719864+0000","last_unstale":"2024-09-14T11:21:15.867801+0000","last_undegraded":"2024-09-14T11:21:15.867801+0000","last_fullsized":"2024-09-14T11:21:15.867801+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:09.038651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3610,"num_read_kb":3266,"num_write":990,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"260'283","reported_seq":908,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.279138+0000","last_change":"2024-09-14T10:45:43.681378+0000","last_active":"2024-09-14T11:22:42.279138+0000","last_peered":"2024-09-14T11:22:42.279138+0000","last_clean":"2024-09-14T11:22:42.279138+0000","last_became_active":"2024-09-14T10:45:43.681137+0000","last_became_peered":"2024-09-14T10:45:43.681137+0000","last_unstale":"2024-09-14T11:22:42.279138+0000","last_undegraded":"2024-09-14T11:22:42.279138+0000","last_fullsized":"2024-09-14T11:22:42.279138+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:46.118247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5577595,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":462,"num_read_kb":31157,"num_write":977,"num_write_kb":37353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":480,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:40.994524+0000","last_change":"2024-09-14T10:45:47.730225+0000","last_active":"2024-09-14T11:20:40.994524+0000","last_peered":"2024-09-14T11:20:40.994524+0000","last_clean":"2024-09-14T11:20:40.994524+0000","last_became_active":"2024-09-14T10:45:47.729815+0000","last_became_peered":"2024-09-14T10:45:47.729815+0000","last_unstale":"2024-09-14T11:20:40.994524+0000","last_undegraded":"2024-09-14T11:20:40.994524+0000","last_fullsized":"2024-09-14T11:20:40.994524+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:42.373217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"260'510","reported_seq":1126,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.091392+0000","last_change":"2024-09-14T10:45:49.736189+0000","last_active":"2024-09-14T11:22:51.091392+0000","last_peered":"2024-09-14T11:22:51.091392+0000","last_clean":"2024-09-14T11:22:51.091392+0000","last_became_active":"2024-09-14T10:45:49.735297+0000","last_became_peered":"2024-09-14T10:45:49.735297+0000","last_unstale":"2024-09-14T11:22:51.091392+0000","last_undegraded":"2024-09-14T11:22:51.091392+0000","last_fullsized":"2024-09-14T11:22:51.091392+0000","mapping_epoch":30,"log_start":"260'400","ondisk_log_start":"260'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:32.962766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93593,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":881,"num_read_kb":2160,"num_write":740,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":471,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:31.246681+0000","last_change":"2024-09-14T10:45:51.749364+0000","last_active":"2024-09-14T11:20:31.246681+0000","last_peered":"2024-09-14T11:20:31.246681+0000","last_clean":"2024-09-14T11:20:31.246681+0000","last_became_active":"2024-09-14T10:45:51.749045+0000","last_became_peered":"2024-09-14T10:45:51.749045+0000","last_unstale":"2024-09-14T11:20:31.246681+0000","last_undegraded":"2024-09-14T11:20:31.246681+0000","last_fullsized":"2024-09-14T11:20:31.246681+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:03.211664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"260'125","reported_seq":630,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:13.515424+0000","last_change":"2024-09-14T10:45:53.752016+0000","last_active":"2024-09-14T11:21:13.515424+0000","last_peered":"2024-09-14T11:21:13.515424+0000","last_clean":"2024-09-14T11:21:13.515424+0000","last_became_active":"2024-09-14T10:45:53.751736+0000","last_became_peered":"2024-09-14T10:45:53.751736+0000","last_unstale":"2024-09-14T11:21:13.515424+0000","last_undegraded":"2024-09-14T11:21:13.515424+0000","last_fullsized":"2024-09-14T11:21:13.515424+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:32.284762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":704,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":191,"num_read_kb":171,"num_write":290,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"260'1189","reported_seq":2739,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.835801+0000","last_change":"2024-09-14T10:45:45.714998+0000","last_active":"2024-09-14T11:22:42.835801+0000","last_peered":"2024-09-14T11:22:42.835801+0000","last_clean":"2024-09-14T11:22:42.835801+0000","last_became_active":"2024-09-14T10:45:45.714723+0000","last_became_peered":"2024-09-14T10:45:45.714723+0000","last_unstale":"2024-09-14T11:22:42.835801+0000","last_undegraded":"2024-09-14T11:22:42.835801+0000","last_fullsized":"2024-09-14T11:22:42.835801+0000","mapping_epoch":26,"log_start":"260'1100","ondisk_log_start":"260'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":1100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:09:48.211216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5470,"num_read_kb":4821,"num_write":1659,"num_write_kb":709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"260'332","reported_seq":955,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.894726+0000","last_change":"2024-09-14T10:45:43.686869+0000","last_active":"2024-09-14T11:22:50.894726+0000","last_peered":"2024-09-14T11:22:50.894726+0000","last_clean":"2024-09-14T11:22:50.894726+0000","last_became_active":"2024-09-14T10:45:43.686531+0000","last_became_peered":"2024-09-14T10:45:43.686531+0000","last_unstale":"2024-09-14T11:22:50.894726+0000","last_undegraded":"2024-09-14T11:22:50.894726+0000","last_fullsized":"2024-09-14T11:22:50.894726+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:55.909629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1173861,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":640,"num_read_kb":7607,"num_write":1231,"num_write_kb":48356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":481,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:35.993761+0000","last_change":"2024-09-14T10:45:47.728475+0000","last_active":"2024-09-14T11:19:35.993761+0000","last_peered":"2024-09-14T11:19:35.993761+0000","last_clean":"2024-09-14T11:19:35.993761+0000","last_became_active":"2024-09-14T10:45:47.728213+0000","last_became_peered":"2024-09-14T10:45:47.728213+0000","last_unstale":"2024-09-14T11:19:35.993761+0000","last_undegraded":"2024-09-14T11:19:35.993761+0000","last_fullsized":"2024-09-14T11:19:35.993761+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:31.424129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"260'259","reported_seq":812,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:52.131713+0000","last_change":"2024-09-14T10:45:49.733110+0000","last_active":"2024-09-14T11:21:52.131713+0000","last_peered":"2024-09-14T11:21:52.131713+0000","last_clean":"2024-09-14T11:21:52.131713+0000","last_became_active":"2024-09-14T10:45:49.732813+0000","last_became_peered":"2024-09-14T10:45:49.732813+0000","last_unstale":"2024-09-14T11:21:52.131713+0000","last_undegraded":"2024-09-14T11:21:52.131713+0000","last_fullsized":"2024-09-14T11:21:52.131713+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:14.432782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49817,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":422,"num_read_kb":832,"num_write":384,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":473,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:45.995350+0000","last_change":"2024-09-14T10:45:51.748689+0000","last_active":"2024-09-14T11:19:45.995350+0000","last_peered":"2024-09-14T11:19:45.995350+0000","last_clean":"2024-09-14T11:19:45.995350+0000","last_became_active":"2024-09-14T10:45:51.748381+0000","last_became_peered":"2024-09-14T10:45:51.748381+0000","last_unstale":"2024-09-14T11:19:45.995350+0000","last_undegraded":"2024-09-14T11:19:45.995350+0000","last_fullsized":"2024-09-14T11:19:45.995350+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:53.908296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"260'98","reported_seq":567,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:56.259131+0000","last_change":"2024-09-14T10:45:53.755248+0000","last_active":"2024-09-14T11:21:56.259131+0000","last_peered":"2024-09-14T11:21:56.259131+0000","last_clean":"2024-09-14T11:21:56.259131+0000","last_became_active":"2024-09-14T10:45:53.755022+0000","last_became_peered":"2024-09-14T10:45:53.755022+0000","last_unstale":"2024-09-14T11:21:56.259131+0000","last_undegraded":"2024-09-14T11:21:56.259131+0000","last_fullsized":"2024-09-14T11:21:56.259131+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:21.675722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":73,"num_read_kb":72,"num_write":223,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"260'435","reported_seq":1975,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.049003+0000","last_change":"2024-09-14T10:45:45.710662+0000","last_active":"2024-09-14T11:21:27.049003+0000","last_peered":"2024-09-14T11:21:27.049003+0000","last_clean":"2024-09-14T11:21:27.049003+0000","last_became_active":"2024-09-14T10:45:45.710367+0000","last_became_peered":"2024-09-14T10:45:45.710367+0000","last_unstale":"2024-09-14T11:21:27.049003+0000","last_undegraded":"2024-09-14T11:21:27.049003+0000","last_fullsized":"2024-09-14T11:21:27.049003+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:39:23.616400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2526,"num_read_kb":2387,"num_write":527,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"260'269","reported_seq":952,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:05.833584+0000","last_change":"2024-09-14T10:45:43.676790+0000","last_active":"2024-09-14T11:21:05.833584+0000","last_peered":"2024-09-14T11:21:05.833584+0000","last_clean":"2024-09-14T11:21:05.833584+0000","last_became_active":"2024-09-14T10:45:43.676514+0000","last_became_peered":"2024-09-14T10:45:43.676514+0000","last_unstale":"2024-09-14T11:21:05.833584+0000","last_undegraded":"2024-09-14T11:21:05.833584+0000","last_fullsized":"2024-09-14T11:21:05.833584+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:19.891010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12217243,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":591,"num_read_kb":125837,"num_write":1010,"num_write_kb":34909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:36.239100+0000","last_change":"2024-09-14T10:45:47.728092+0000","last_active":"2024-09-14T11:19:36.239100+0000","last_peered":"2024-09-14T11:19:36.239100+0000","last_clean":"2024-09-14T11:19:36.239100+0000","last_became_active":"2024-09-14T10:45:47.727632+0000","last_became_peered":"2024-09-14T10:45:47.727632+0000","last_unstale":"2024-09-14T11:19:36.239100+0000","last_undegraded":"2024-09-14T11:19:36.239100+0000","last_fullsized":"2024-09-14T11:19:36.239100+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:44.526326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"260'292","reported_seq":851,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.875892+0000","last_change":"2024-09-14T10:45:49.737975+0000","last_active":"2024-09-14T11:22:50.875892+0000","last_peered":"2024-09-14T11:22:50.875892+0000","last_clean":"2024-09-14T11:22:50.875892+0000","last_became_active":"2024-09-14T10:45:49.737690+0000","last_became_peered":"2024-09-14T10:45:49.737690+0000","last_unstale":"2024-09-14T11:22:50.875892+0000","last_undegraded":"2024-09-14T11:22:50.875892+0000","last_fullsized":"2024-09-14T11:22:50.875892+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:15.403726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69554,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":489,"num_read_kb":1163,"num_write":398,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"260'777","reported_seq":2019,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.300621+0000","last_change":"2024-09-14T10:45:51.749775+0000","last_active":"2024-09-14T11:22:50.300621+0000","last_peered":"2024-09-14T11:22:50.300621+0000","last_clean":"2024-09-14T11:22:50.300621+0000","last_became_active":"2024-09-14T10:45:51.749478+0000","last_became_peered":"2024-09-14T10:45:51.749478+0000","last_unstale":"2024-09-14T11:22:50.300621+0000","last_undegraded":"2024-09-14T11:22:50.300621+0000","last_fullsized":"2024-09-14T11:22:50.300621+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:13:43.438242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"260'128","reported_seq":609,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:13.969218+0000","last_change":"2024-09-14T10:45:53.746737+0000","last_active":"2024-09-14T11:21:13.969218+0000","last_peered":"2024-09-14T11:21:13.969218+0000","last_clean":"2024-09-14T11:21:13.969218+0000","last_became_active":"2024-09-14T10:45:53.746254+0000","last_became_peered":"2024-09-14T10:45:53.746254+0000","last_unstale":"2024-09-14T11:21:13.969218+0000","last_undegraded":"2024-09-14T11:21:13.969218+0000","last_fullsized":"2024-09-14T11:21:13.969218+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:28:26.210153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1445,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":145,"num_read_kb":134,"num_write":327,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"260'483","reported_seq":2054,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.840774+0000","last_change":"2024-09-14T10:45:45.720938+0000","last_active":"2024-09-14T11:22:42.840774+0000","last_peered":"2024-09-14T11:22:42.840774+0000","last_clean":"2024-09-14T11:22:42.840774+0000","last_became_active":"2024-09-14T10:45:45.720660+0000","last_became_peered":"2024-09-14T10:45:45.720660+0000","last_unstale":"2024-09-14T11:22:42.840774+0000","last_undegraded":"2024-09-14T11:22:42.840774+0000","last_fullsized":"2024-09-14T11:22:42.840774+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:36.468993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2593,"num_read_kb":2426,"num_write":578,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"260'263","reported_seq":871,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:26.811434+0000","last_change":"2024-09-14T10:45:43.690826+0000","last_active":"2024-09-14T11:21:26.811434+0000","last_peered":"2024-09-14T11:21:26.811434+0000","last_clean":"2024-09-14T11:21:26.811434+0000","last_became_active":"2024-09-14T10:45:43.690517+0000","last_became_peered":"2024-09-14T10:45:43.690517+0000","last_unstale":"2024-09-14T11:21:26.811434+0000","last_undegraded":"2024-09-14T11:21:26.811434+0000","last_fullsized":"2024-09-14T11:21:26.811434+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:17.734297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15106390,"num_objects":87,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":442,"num_read_kb":51926,"num_write":968,"num_write_kb":23808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1436,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:43.665589+0000","last_change":"2024-09-14T10:45:47.721307+0000","last_active":"2024-09-14T11:22:43.665589+0000","last_peered":"2024-09-14T11:22:43.665589+0000","last_clean":"2024-09-14T11:22:43.665589+0000","last_became_active":"2024-09-14T10:45:47.720716+0000","last_became_peered":"2024-09-14T10:45:47.720716+0000","last_unstale":"2024-09-14T11:22:43.665589+0000","last_undegraded":"2024-09-14T11:22:43.665589+0000","last_fullsized":"2024-09-14T11:22:43.665589+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:49.138193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":949,"num_read_kb":949,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"260'68","reported_seq":563,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:13.520750+0000","last_change":"2024-09-14T10:45:49.733374+0000","last_active":"2024-09-14T11:21:13.520750+0000","last_peered":"2024-09-14T11:21:13.520750+0000","last_clean":"2024-09-14T11:21:13.520750+0000","last_became_active":"2024-09-14T10:45:49.732913+0000","last_became_peered":"2024-09-14T10:45:49.732913+0000","last_unstale":"2024-09-14T11:21:13.520750+0000","last_undegraded":"2024-09-14T11:21:13.520750+0000","last_fullsized":"2024-09-14T11:21:13.520750+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:41.223364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":64,"num_read_kb":57,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"260'794","reported_seq":2411,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:43.919284+0000","last_change":"2024-09-14T10:45:51.741412+0000","last_active":"2024-09-14T11:22:43.919284+0000","last_peered":"2024-09-14T11:22:43.919284+0000","last_clean":"2024-09-14T11:22:43.919284+0000","last_became_active":"2024-09-14T10:45:51.741102+0000","last_became_peered":"2024-09-14T10:45:51.741102+0000","last_unstale":"2024-09-14T11:22:43.919284+0000","last_undegraded":"2024-09-14T11:22:43.919284+0000","last_fullsized":"2024-09-14T11:22:43.919284+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:08.256488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"260'150","reported_seq":656,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:13.516830+0000","last_change":"2024-09-14T10:45:53.752456+0000","last_active":"2024-09-14T11:21:13.516830+0000","last_peered":"2024-09-14T11:21:13.516830+0000","last_clean":"2024-09-14T11:21:13.516830+0000","last_became_active":"2024-09-14T10:45:53.752100+0000","last_became_peered":"2024-09-14T10:45:53.752100+0000","last_unstale":"2024-09-14T11:21:13.516830+0000","last_undegraded":"2024-09-14T11:21:13.516830+0000","last_fullsized":"2024-09-14T11:21:13.516830+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:44.647729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":861,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":268,"num_read_kb":228,"num_write":378,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"260'468","reported_seq":2069,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:16.297144+0000","last_change":"2024-09-14T10:45:45.719579+0000","last_active":"2024-09-14T11:21:16.297144+0000","last_peered":"2024-09-14T11:21:16.297144+0000","last_clean":"2024-09-14T11:21:16.297144+0000","last_became_active":"2024-09-14T10:45:45.719221+0000","last_became_peered":"2024-09-14T10:45:45.719221+0000","last_unstale":"2024-09-14T11:21:16.297144+0000","last_undegraded":"2024-09-14T11:21:16.297144+0000","last_fullsized":"2024-09-14T11:21:16.297144+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:24.645466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2509,"num_read_kb":2365,"num_write":566,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"260'302","reported_seq":904,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.099583+0000","last_change":"2024-09-14T10:45:43.690704+0000","last_active":"2024-09-14T11:22:51.099583+0000","last_peered":"2024-09-14T11:22:51.099583+0000","last_clean":"2024-09-14T11:22:51.099583+0000","last_became_active":"2024-09-14T10:45:43.690417+0000","last_became_peered":"2024-09-14T10:45:43.690417+0000","last_unstale":"2024-09-14T11:22:51.099583+0000","last_undegraded":"2024-09-14T11:22:51.099583+0000","last_fullsized":"2024-09-14T11:22:51.099583+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:28.703262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1309,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":484,"num_read_kb":28260,"num_write":948,"num_write_kb":36225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":479,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:32.112331+0000","last_change":"2024-09-14T10:45:47.731129+0000","last_active":"2024-09-14T11:19:32.112331+0000","last_peered":"2024-09-14T11:19:32.112331+0000","last_clean":"2024-09-14T11:19:32.112331+0000","last_became_active":"2024-09-14T10:45:47.730790+0000","last_became_peered":"2024-09-14T10:45:47.730790+0000","last_unstale":"2024-09-14T11:19:32.112331+0000","last_undegraded":"2024-09-14T11:19:32.112331+0000","last_fullsized":"2024-09-14T11:19:32.112331+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:38.545867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"260'319","reported_seq":900,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:52.131679+0000","last_change":"2024-09-14T10:45:49.735771+0000","last_active":"2024-09-14T11:21:52.131679+0000","last_peered":"2024-09-14T11:21:52.131679+0000","last_clean":"2024-09-14T11:21:52.131679+0000","last_became_active":"2024-09-14T10:45:49.735482+0000","last_became_peered":"2024-09-14T10:45:49.735482+0000","last_unstale":"2024-09-14T11:21:52.131679+0000","last_undegraded":"2024-09-14T11:21:52.131679+0000","last_fullsized":"2024-09-14T11:21:52.131679+0000","mapping_epoch":30,"log_start":"260'300","ondisk_log_start":"260'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:18:04.742025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56235,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":525,"num_read_kb":1022,"num_write":420,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":468,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:39.989653+0000","last_change":"2024-09-14T10:45:51.750926+0000","last_active":"2024-09-14T11:19:39.989653+0000","last_peered":"2024-09-14T11:19:39.989653+0000","last_clean":"2024-09-14T11:19:39.989653+0000","last_became_active":"2024-09-14T10:45:51.750669+0000","last_became_peered":"2024-09-14T10:45:51.750669+0000","last_unstale":"2024-09-14T11:19:39.989653+0000","last_undegraded":"2024-09-14T11:19:39.989653+0000","last_fullsized":"2024-09-14T11:19:39.989653+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:54.215538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"260'118","reported_seq":594,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.200888+0000","last_change":"2024-09-14T10:45:53.749127+0000","last_active":"2024-09-14T11:21:28.200888+0000","last_peered":"2024-09-14T11:21:28.200888+0000","last_clean":"2024-09-14T11:21:28.200888+0000","last_became_active":"2024-09-14T10:45:53.748865+0000","last_became_peered":"2024-09-14T10:45:53.748865+0000","last_unstale":"2024-09-14T11:21:28.200888+0000","last_undegraded":"2024-09-14T11:21:28.200888+0000","last_fullsized":"2024-09-14T11:21:28.200888+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:29.632424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":116,"num_write":279,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"260'612","reported_seq":2403,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.832394+0000","last_change":"2024-09-14T10:45:45.716546+0000","last_active":"2024-09-14T11:22:42.832394+0000","last_peered":"2024-09-14T11:22:42.832394+0000","last_clean":"2024-09-14T11:22:42.832394+0000","last_became_active":"2024-09-14T10:45:45.716236+0000","last_became_peered":"2024-09-14T10:45:45.716236+0000","last_unstale":"2024-09-14T11:22:42.832394+0000","last_undegraded":"2024-09-14T11:22:42.832394+0000","last_fullsized":"2024-09-14T11:22:42.832394+0000","mapping_epoch":26,"log_start":"260'600","ondisk_log_start":"260'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":600,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:59:19.965279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3315,"num_read_kb":3084,"num_write":730,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":601,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:37.112513+0000","last_change":"2024-09-14T10:45:28.986498+0000","last_active":"2024-09-14T11:19:37.112513+0000","last_peered":"2024-09-14T11:19:37.112513+0000","last_clean":"2024-09-14T11:19:37.112513+0000","last_became_active":"2024-09-14T10:45:28.985499+0000","last_became_peered":"2024-09-14T10:45:28.985499+0000","last_unstale":"2024-09-14T11:19:37.112513+0000","last_undegraded":"2024-09-14T11:19:37.112513+0000","last_fullsized":"2024-09-14T11:19:37.112513+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:27.525313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:27.525313+0000","last_clean_scrub_stamp":"2024-09-14T10:45:27.525313+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:42:06.434476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":504,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:57.106903+0000","last_change":"2024-09-14T10:45:35.579820+0000","last_active":"2024-09-14T11:18:57.106903+0000","last_peered":"2024-09-14T11:18:57.106903+0000","last_clean":"2024-09-14T11:18:57.106903+0000","last_became_active":"2024-09-14T10:45:33.610592+0000","last_became_peered":"2024-09-14T10:45:33.610592+0000","last_unstale":"2024-09-14T11:18:57.106903+0000","last_undegraded":"2024-09-14T11:18:57.106903+0000","last_fullsized":"2024-09-14T11:18:57.106903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_clean_scrub_stamp":"2024-09-14T10:45:32.551765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:46:36.542821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043055799999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"260'260","reported_seq":899,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.113170+0000","last_change":"2024-09-14T10:45:43.690581+0000","last_active":"2024-09-14T11:22:51.113170+0000","last_peered":"2024-09-14T11:22:51.113170+0000","last_clean":"2024-09-14T11:22:51.113170+0000","last_became_active":"2024-09-14T10:45:43.690248+0000","last_became_peered":"2024-09-14T10:45:43.690248+0000","last_unstale":"2024-09-14T11:22:51.113170+0000","last_undegraded":"2024-09-14T11:22:51.113170+0000","last_fullsized":"2024-09-14T11:22:51.113170+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:27.312124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243097,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":533,"num_read_kb":56771,"num_write":932,"num_write_kb":24880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:07.204339+0000","last_change":"2024-09-14T10:45:47.723764+0000","last_active":"2024-09-14T11:19:07.204339+0000","last_peered":"2024-09-14T11:19:07.204339+0000","last_clean":"2024-09-14T11:19:07.204339+0000","last_became_active":"2024-09-14T10:45:47.723495+0000","last_became_peered":"2024-09-14T10:45:47.723495+0000","last_unstale":"2024-09-14T11:19:07.204339+0000","last_undegraded":"2024-09-14T11:19:07.204339+0000","last_fullsized":"2024-09-14T11:19:07.204339+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:28.951657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"260'728","reported_seq":1396,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:43.715128+0000","last_change":"2024-09-14T10:45:49.734638+0000","last_active":"2024-09-14T11:22:43.715128+0000","last_peered":"2024-09-14T11:22:43.715128+0000","last_clean":"2024-09-14T11:22:43.715128+0000","last_became_active":"2024-09-14T10:45:49.733774+0000","last_became_peered":"2024-09-14T10:45:49.733774+0000","last_unstale":"2024-09-14T11:22:43.715128+0000","last_undegraded":"2024-09-14T11:22:43.715128+0000","last_fullsized":"2024-09-14T11:22:43.715128+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":700,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:45.811248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":193368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1440,"num_read_kb":3082,"num_write":1348,"num_write_kb":1217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":471,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:31.246761+0000","last_change":"2024-09-14T10:45:51.745875+0000","last_active":"2024-09-14T11:20:31.246761+0000","last_peered":"2024-09-14T11:20:31.246761+0000","last_clean":"2024-09-14T11:20:31.246761+0000","last_became_active":"2024-09-14T10:45:51.745607+0000","last_became_peered":"2024-09-14T10:45:51.745607+0000","last_unstale":"2024-09-14T11:20:31.246761+0000","last_undegraded":"2024-09-14T11:20:31.246761+0000","last_fullsized":"2024-09-14T11:20:31.246761+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:12.059394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"260'234","reported_seq":922,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.747723+0000","last_change":"2024-09-14T10:45:53.751918+0000","last_active":"2024-09-14T11:21:28.747723+0000","last_peered":"2024-09-14T11:21:28.747723+0000","last_clean":"2024-09-14T11:21:28.747723+0000","last_became_active":"2024-09-14T10:45:53.751651+0000","last_became_peered":"2024-09-14T10:45:53.751651+0000","last_unstale":"2024-09-14T11:21:28.747723+0000","last_undegraded":"2024-09-14T11:21:28.747723+0000","last_fullsized":"2024-09-14T11:21:28.747723+0000","mapping_epoch":34,"log_start":"260'200","ondisk_log_start":"260'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:07.313069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":417,"num_read_kb":415,"num_write":468,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"260'500","reported_seq":2079,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:16.297332+0000","last_change":"2024-09-14T10:45:45.721927+0000","last_active":"2024-09-14T11:21:16.297332+0000","last_peered":"2024-09-14T11:21:16.297332+0000","last_clean":"2024-09-14T11:21:16.297332+0000","last_became_active":"2024-09-14T10:45:45.721633+0000","last_became_peered":"2024-09-14T10:45:45.721633+0000","last_unstale":"2024-09-14T11:21:16.297332+0000","last_undegraded":"2024-09-14T11:21:16.297332+0000","last_fullsized":"2024-09-14T11:21:16.297332+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:23.991533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2741,"num_read_kb":2557,"num_write":632,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":504,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:42.113836+0000","last_change":"2024-09-14T10:45:35.580149+0000","last_active":"2024-09-14T11:19:42.113836+0000","last_peered":"2024-09-14T11:19:42.113836+0000","last_clean":"2024-09-14T11:19:42.113836+0000","last_became_active":"2024-09-14T10:45:33.569860+0000","last_became_peered":"2024-09-14T10:45:33.569860+0000","last_unstale":"2024-09-14T11:19:42.113836+0000","last_undegraded":"2024-09-14T11:19:42.113836+0000","last_fullsized":"2024-09-14T11:19:42.113836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_clean_scrub_stamp":"2024-09-14T10:45:32.551765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:19.845227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074400599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"260'308","reported_seq":937,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.000002+0000","last_change":"2024-09-14T10:45:43.680588+0000","last_active":"2024-09-14T11:22:51.000002+0000","last_peered":"2024-09-14T11:22:51.000002+0000","last_clean":"2024-09-14T11:22:51.000002+0000","last_became_active":"2024-09-14T10:45:43.680290+0000","last_became_peered":"2024-09-14T10:45:43.680290+0000","last_unstale":"2024-09-14T11:22:51.000002+0000","last_undegraded":"2024-09-14T11:22:51.000002+0000","last_fullsized":"2024-09-14T11:22:51.000002+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:14.859096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243200,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":626,"num_read_kb":19207,"num_write":1075,"num_write_kb":41133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":480,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:27.120185+0000","last_change":"2024-09-14T10:45:47.728037+0000","last_active":"2024-09-14T11:20:27.120185+0000","last_peered":"2024-09-14T11:20:27.120185+0000","last_clean":"2024-09-14T11:20:27.120185+0000","last_became_active":"2024-09-14T10:45:47.727733+0000","last_became_peered":"2024-09-14T10:45:47.727733+0000","last_unstale":"2024-09-14T11:20:27.120185+0000","last_undegraded":"2024-09-14T11:20:27.120185+0000","last_fullsized":"2024-09-14T11:20:27.120185+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:08.238626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"260'1243","reported_seq":2601,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.016458+0000","last_change":"2024-09-14T10:45:49.731992+0000","last_active":"2024-09-14T11:22:51.016458+0000","last_peered":"2024-09-14T11:22:51.016458+0000","last_clean":"2024-09-14T11:22:51.016458+0000","last_became_active":"2024-09-14T10:45:49.731646+0000","last_became_peered":"2024-09-14T10:45:49.731646+0000","last_unstale":"2024-09-14T11:22:51.016458+0000","last_undegraded":"2024-09-14T11:22:51.016458+0000","last_fullsized":"2024-09-14T11:22:51.016458+0000","mapping_epoch":30,"log_start":"260'1200","ondisk_log_start":"260'1200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":1200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:40.965323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145081,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1971,"num_read_kb":3649,"num_write":1068,"num_write_kb":919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":472,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:17.109984+0000","last_change":"2024-09-14T10:45:51.745733+0000","last_active":"2024-09-14T11:19:17.109984+0000","last_peered":"2024-09-14T11:19:17.109984+0000","last_clean":"2024-09-14T11:19:17.109984+0000","last_became_active":"2024-09-14T10:45:51.745481+0000","last_became_peered":"2024-09-14T10:45:51.745481+0000","last_unstale":"2024-09-14T11:19:17.109984+0000","last_undegraded":"2024-09-14T11:19:17.109984+0000","last_fullsized":"2024-09-14T11:19:17.109984+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:11.216344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"260'292","reported_seq":816,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:43.730260+0000","last_change":"2024-09-14T10:45:53.750529+0000","last_active":"2024-09-14T11:22:43.730260+0000","last_peered":"2024-09-14T11:22:43.730260+0000","last_clean":"2024-09-14T11:22:43.730260+0000","last_became_active":"2024-09-14T10:45:53.750227+0000","last_became_peered":"2024-09-14T10:45:53.750227+0000","last_unstale":"2024-09-14T11:22:43.730260+0000","last_undegraded":"2024-09-14T11:22:43.730260+0000","last_fullsized":"2024-09-14T11:22:43.730260+0000","mapping_epoch":34,"log_start":"260'200","ondisk_log_start":"260'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:38.646551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":463,"num_read_kb":436,"num_write":609,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"260'355","reported_seq":1868,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:11.223921+0000","last_change":"2024-09-14T10:45:45.715226+0000","last_active":"2024-09-14T11:21:11.223921+0000","last_peered":"2024-09-14T11:21:11.223921+0000","last_clean":"2024-09-14T11:21:11.223921+0000","last_became_active":"2024-09-14T10:45:45.714923+0000","last_became_peered":"2024-09-14T10:45:45.714923+0000","last_unstale":"2024-09-14T11:21:11.223921+0000","last_undegraded":"2024-09-14T11:21:11.223921+0000","last_fullsized":"2024-09-14T11:21:11.223921+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:07.817788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2079,"num_read_kb":2005,"num_write":398,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":504,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:55.987569+0000","last_change":"2024-09-14T10:45:36.078832+0000","last_active":"2024-09-14T11:18:55.987569+0000","last_peered":"2024-09-14T11:18:55.987569+0000","last_clean":"2024-09-14T11:18:55.987569+0000","last_became_active":"2024-09-14T10:45:33.569944+0000","last_became_peered":"2024-09-14T10:45:33.569944+0000","last_unstale":"2024-09-14T11:18:55.987569+0000","last_undegraded":"2024-09-14T11:18:55.987569+0000","last_fullsized":"2024-09-14T11:18:55.987569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_clean_scrub_stamp":"2024-09-14T10:45:32.551765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:29.610279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055355599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"260'327","reported_seq":1018,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.075598+0000","last_change":"2024-09-14T10:45:43.684278+0000","last_active":"2024-09-14T11:22:51.075598+0000","last_peered":"2024-09-14T11:22:51.075598+0000","last_clean":"2024-09-14T11:22:51.075598+0000","last_became_active":"2024-09-14T10:45:43.682920+0000","last_became_peered":"2024-09-14T10:45:43.682920+0000","last_unstale":"2024-09-14T11:22:51.075598+0000","last_undegraded":"2024-09-14T11:22:51.075598+0000","last_fullsized":"2024-09-14T11:22:51.075598+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:53.359950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1134086,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":791,"num_read_kb":18154,"num_write":1040,"num_write_kb":35009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":483,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:31.000785+0000","last_change":"2024-09-14T10:45:47.729348+0000","last_active":"2024-09-14T11:20:31.000785+0000","last_peered":"2024-09-14T11:20:31.000785+0000","last_clean":"2024-09-14T11:20:31.000785+0000","last_became_active":"2024-09-14T10:45:47.729061+0000","last_became_peered":"2024-09-14T10:45:47.729061+0000","last_unstale":"2024-09-14T11:20:31.000785+0000","last_undegraded":"2024-09-14T11:20:31.000785+0000","last_fullsized":"2024-09-14T11:20:31.000785+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:40.239555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"260'240","reported_seq":1217,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.211666+0000","last_change":"2024-09-14T10:45:49.732283+0000","last_active":"2024-09-14T11:22:42.211666+0000","last_peered":"2024-09-14T11:22:42.211666+0000","last_clean":"2024-09-14T11:22:42.211666+0000","last_became_active":"2024-09-14T10:45:49.731858+0000","last_became_peered":"2024-09-14T10:45:49.731858+0000","last_unstale":"2024-09-14T11:22:42.211666+0000","last_undegraded":"2024-09-14T11:22:42.211666+0000","last_fullsized":"2024-09-14T11:22:42.211666+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:59.698290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":156,"num_read_kb":145,"num_write":121,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:11.113947+0000","last_change":"2024-09-14T10:45:51.743386+0000","last_active":"2024-09-14T11:19:11.113947+0000","last_peered":"2024-09-14T11:19:11.113947+0000","last_clean":"2024-09-14T11:19:11.113947+0000","last_became_active":"2024-09-14T10:45:51.742651+0000","last_became_peered":"2024-09-14T10:45:51.742651+0000","last_unstale":"2024-09-14T11:19:11.113947+0000","last_undegraded":"2024-09-14T11:19:11.113947+0000","last_fullsized":"2024-09-14T11:19:11.113947+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:56.398753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"260'239","reported_seq":825,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.890931+0000","last_change":"2024-09-14T10:45:53.745667+0000","last_active":"2024-09-14T11:21:28.890931+0000","last_peered":"2024-09-14T11:21:28.890931+0000","last_clean":"2024-09-14T11:21:28.890931+0000","last_became_active":"2024-09-14T10:45:53.744823+0000","last_became_peered":"2024-09-14T10:45:53.744823+0000","last_unstale":"2024-09-14T11:21:28.890931+0000","last_undegraded":"2024-09-14T11:21:28.890931+0000","last_fullsized":"2024-09-14T11:21:28.890931+0000","mapping_epoch":34,"log_start":"260'200","ondisk_log_start":"260'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:01:08.099600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":471,"num_read_kb":497,"num_write":522,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"260'743","reported_seq":2245,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.833846+0000","last_change":"2024-09-14T10:45:45.714387+0000","last_active":"2024-09-14T11:22:42.833846+0000","last_peered":"2024-09-14T11:22:42.833846+0000","last_clean":"2024-09-14T11:22:42.833846+0000","last_became_active":"2024-09-14T10:45:45.714077+0000","last_became_peered":"2024-09-14T10:45:45.714077+0000","last_unstale":"2024-09-14T11:22:42.833846+0000","last_undegraded":"2024-09-14T11:22:42.833846+0000","last_fullsized":"2024-09-14T11:22:42.833846+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":700,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:32:40.285715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3745,"num_read_kb":3391,"num_write":988,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":505,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:57.106867+0000","last_change":"2024-09-14T10:45:35.580322+0000","last_active":"2024-09-14T11:18:57.106867+0000","last_peered":"2024-09-14T11:18:57.106867+0000","last_clean":"2024-09-14T11:18:57.106867+0000","last_became_active":"2024-09-14T10:45:33.612919+0000","last_became_peered":"2024-09-14T10:45:33.612919+0000","last_unstale":"2024-09-14T11:18:57.106867+0000","last_undegraded":"2024-09-14T11:18:57.106867+0000","last_fullsized":"2024-09-14T11:18:57.106867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_clean_scrub_stamp":"2024-09-14T10:45:32.551765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:57.073763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094497699999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"260'276","reported_seq":1144,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:59.526090+0000","last_change":"2024-09-14T10:45:43.679805+0000","last_active":"2024-09-14T11:20:59.526090+0000","last_peered":"2024-09-14T11:20:59.526090+0000","last_clean":"2024-09-14T11:20:59.526090+0000","last_became_active":"2024-09-14T10:45:43.679522+0000","last_became_peered":"2024-09-14T10:45:43.679522+0000","last_unstale":"2024-09-14T11:20:59.526090+0000","last_undegraded":"2024-09-14T11:20:59.526090+0000","last_fullsized":"2024-09-14T11:20:59.526090+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:59.700293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9462467,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1303,"num_read_kb":12976,"num_write":1115,"num_write_kb":34630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"36'3","reported_seq":962,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.271527+0000","last_change":"2024-09-14T10:45:47.727327+0000","last_active":"2024-09-14T11:22:50.271527+0000","last_peered":"2024-09-14T11:22:50.271527+0000","last_clean":"2024-09-14T11:22:50.271527+0000","last_became_active":"2024-09-14T10:45:47.727050+0000","last_became_peered":"2024-09-14T10:45:47.727050+0000","last_unstale":"2024-09-14T11:22:50.271527+0000","last_undegraded":"2024-09-14T11:22:50.271527+0000","last_fullsized":"2024-09-14T11:22:50.271527+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:11.560613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"260'102","reported_seq":617,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:41.139054+0000","last_change":"2024-09-14T10:45:49.734492+0000","last_active":"2024-09-14T11:22:41.139054+0000","last_peered":"2024-09-14T11:22:41.139054+0000","last_clean":"2024-09-14T11:22:41.139054+0000","last_became_active":"2024-09-14T10:45:49.734181+0000","last_became_peered":"2024-09-14T10:45:49.734181+0000","last_unstale":"2024-09-14T11:22:41.139054+0000","last_undegraded":"2024-09-14T11:22:41.139054+0000","last_fullsized":"2024-09-14T11:22:41.139054+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:39.185773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":121,"num_read_kb":115,"num_write":86,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":472,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:32.120940+0000","last_change":"2024-09-14T10:45:51.744573+0000","last_active":"2024-09-14T11:20:32.120940+0000","last_peered":"2024-09-14T11:20:32.120940+0000","last_clean":"2024-09-14T11:20:32.120940+0000","last_became_active":"2024-09-14T10:45:51.744280+0000","last_became_peered":"2024-09-14T10:45:51.744280+0000","last_unstale":"2024-09-14T11:20:32.120940+0000","last_undegraded":"2024-09-14T11:20:32.120940+0000","last_fullsized":"2024-09-14T11:20:32.120940+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:36.528487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"260'117","reported_seq":649,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.997667+0000","last_change":"2024-09-14T10:45:53.746846+0000","last_active":"2024-09-14T11:21:27.997667+0000","last_peered":"2024-09-14T11:21:27.997667+0000","last_clean":"2024-09-14T11:21:27.997667+0000","last_became_active":"2024-09-14T10:45:53.746484+0000","last_became_peered":"2024-09-14T10:45:53.746484+0000","last_unstale":"2024-09-14T11:21:27.997667+0000","last_undegraded":"2024-09-14T11:21:27.997667+0000","last_fullsized":"2024-09-14T11:21:27.997667+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:31.055773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":202,"num_write":278,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"260'1196","reported_seq":2897,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:11.223775+0000","last_change":"2024-09-14T10:45:45.713700+0000","last_active":"2024-09-14T11:21:11.223775+0000","last_peered":"2024-09-14T11:21:11.223775+0000","last_clean":"2024-09-14T11:21:11.223775+0000","last_became_active":"2024-09-14T10:45:45.713440+0000","last_became_peered":"2024-09-14T10:45:45.713440+0000","last_unstale":"2024-09-14T11:21:11.223775+0000","last_undegraded":"2024-09-14T11:21:11.223775+0000","last_fullsized":"2024-09-14T11:21:11.223775+0000","mapping_epoch":26,"log_start":"260'1100","ondisk_log_start":"260'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":1100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:13.974610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5652,"num_read_kb":5051,"num_write":1624,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"260'298","reported_seq":985,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:26.616258+0000","last_change":"2024-09-14T10:45:43.683066+0000","last_active":"2024-09-14T11:21:26.616258+0000","last_peered":"2024-09-14T11:21:26.616258+0000","last_clean":"2024-09-14T11:21:26.616258+0000","last_became_active":"2024-09-14T10:45:43.682711+0000","last_became_peered":"2024-09-14T10:45:43.682711+0000","last_unstale":"2024-09-14T11:21:26.616258+0000","last_undegraded":"2024-09-14T11:21:26.616258+0000","last_fullsized":"2024-09-14T11:21:26.616258+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:13:32.400241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12958652,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":782,"num_read_kb":26785,"num_write":1115,"num_write_kb":27965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":502,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:56.232945+0000","last_change":"2024-09-14T10:45:36.078834+0000","last_active":"2024-09-14T11:18:56.232945+0000","last_peered":"2024-09-14T11:18:56.232945+0000","last_clean":"2024-09-14T11:18:56.232945+0000","last_became_active":"2024-09-14T10:45:33.612983+0000","last_became_peered":"2024-09-14T10:45:33.612983+0000","last_unstale":"2024-09-14T11:18:56.232945+0000","last_undegraded":"2024-09-14T11:18:56.232945+0000","last_fullsized":"2024-09-14T11:18:56.232945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_clean_scrub_stamp":"2024-09-14T10:45:32.551765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:00.753079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053773700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":486,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:11.113928+0000","last_change":"2024-09-14T10:45:47.724950+0000","last_active":"2024-09-14T11:19:11.113928+0000","last_peered":"2024-09-14T11:19:11.113928+0000","last_clean":"2024-09-14T11:19:11.113928+0000","last_became_active":"2024-09-14T10:45:47.724317+0000","last_became_peered":"2024-09-14T10:45:47.724317+0000","last_unstale":"2024-09-14T11:19:11.113928+0000","last_undegraded":"2024-09-14T11:19:11.113928+0000","last_fullsized":"2024-09-14T11:19:11.113928+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:13.067923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"260'544","reported_seq":1180,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.839460+0000","last_change":"2024-09-14T10:45:49.736006+0000","last_active":"2024-09-14T11:22:50.839460+0000","last_peered":"2024-09-14T11:22:50.839460+0000","last_clean":"2024-09-14T11:22:50.839460+0000","last_became_active":"2024-09-14T10:45:49.735662+0000","last_became_peered":"2024-09-14T10:45:49.735662+0000","last_unstale":"2024-09-14T11:22:50.839460+0000","last_undegraded":"2024-09-14T11:22:50.839460+0000","last_fullsized":"2024-09-14T11:22:50.839460+0000","mapping_epoch":30,"log_start":"260'500","ondisk_log_start":"260'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:34.690835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108030,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1548,"num_read_kb":2637,"num_write":2014,"num_write_kb":1867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":469,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:14.986059+0000","last_change":"2024-09-14T10:45:51.749756+0000","last_active":"2024-09-14T11:19:14.986059+0000","last_peered":"2024-09-14T11:19:14.986059+0000","last_clean":"2024-09-14T11:19:14.986059+0000","last_became_active":"2024-09-14T10:45:51.749478+0000","last_became_peered":"2024-09-14T10:45:51.749478+0000","last_unstale":"2024-09-14T11:19:14.986059+0000","last_undegraded":"2024-09-14T11:19:14.986059+0000","last_fullsized":"2024-09-14T11:19:14.986059+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:19.448821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"260'118","reported_seq":604,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:16.644526+0000","last_change":"2024-09-14T10:45:53.749875+0000","last_active":"2024-09-14T11:21:16.644526+0000","last_peered":"2024-09-14T11:21:16.644526+0000","last_clean":"2024-09-14T11:21:16.644526+0000","last_became_active":"2024-09-14T10:45:53.749578+0000","last_became_peered":"2024-09-14T10:45:53.749578+0000","last_unstale":"2024-09-14T11:21:16.644526+0000","last_undegraded":"2024-09-14T11:21:16.644526+0000","last_fullsized":"2024-09-14T11:21:16.644526+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:40.919662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":913,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":137,"num_read_kb":126,"num_write":281,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"260'861","reported_seq":2555,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.049805+0000","last_change":"2024-09-14T10:45:45.720048+0000","last_active":"2024-09-14T11:21:27.049805+0000","last_peered":"2024-09-14T11:21:27.049805+0000","last_clean":"2024-09-14T11:21:27.049805+0000","last_became_active":"2024-09-14T10:45:45.719783+0000","last_became_peered":"2024-09-14T10:45:45.719783+0000","last_unstale":"2024-09-14T11:21:27.049805+0000","last_undegraded":"2024-09-14T11:21:27.049805+0000","last_fullsized":"2024-09-14T11:21:27.049805+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":800,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:34.138598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4184,"num_read_kb":3795,"num_write":1124,"num_write_kb":397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"260'343","reported_seq":957,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.967429+0000","last_change":"2024-09-14T10:45:43.686039+0000","last_active":"2024-09-14T11:22:50.967429+0000","last_peered":"2024-09-14T11:22:50.967429+0000","last_clean":"2024-09-14T11:22:50.967429+0000","last_became_active":"2024-09-14T10:45:43.685775+0000","last_became_peered":"2024-09-14T10:45:43.685775+0000","last_unstale":"2024-09-14T11:22:50.967429+0000","last_undegraded":"2024-09-14T11:22:50.967429+0000","last_fullsized":"2024-09-14T11:22:50.967429+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:18:21.519433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197775,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":637,"num_read_kb":2173,"num_write":1067,"num_write_kb":20935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":503,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:02.107638+0000","last_change":"2024-09-14T10:45:35.580399+0000","last_active":"2024-09-14T11:19:02.107638+0000","last_peered":"2024-09-14T11:19:02.107638+0000","last_clean":"2024-09-14T11:19:02.107638+0000","last_became_active":"2024-09-14T10:45:33.564407+0000","last_became_peered":"2024-09-14T10:45:33.564407+0000","last_unstale":"2024-09-14T11:19:02.107638+0000","last_undegraded":"2024-09-14T11:19:02.107638+0000","last_fullsized":"2024-09-14T11:19:02.107638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_clean_scrub_stamp":"2024-09-14T10:45:32.551765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:15:28.496118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099134599999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:07.204309+0000","last_change":"2024-09-14T10:45:47.726265+0000","last_active":"2024-09-14T11:19:07.204309+0000","last_peered":"2024-09-14T11:19:07.204309+0000","last_clean":"2024-09-14T11:19:07.204309+0000","last_became_active":"2024-09-14T10:45:47.724774+0000","last_became_peered":"2024-09-14T10:45:47.724774+0000","last_unstale":"2024-09-14T11:19:07.204309+0000","last_undegraded":"2024-09-14T11:19:07.204309+0000","last_fullsized":"2024-09-14T11:19:07.204309+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:34.725344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"260'155","reported_seq":691,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:15.998699+0000","last_change":"2024-09-14T10:45:49.731679+0000","last_active":"2024-09-14T11:21:15.998699+0000","last_peered":"2024-09-14T11:21:15.998699+0000","last_clean":"2024-09-14T11:21:15.998699+0000","last_became_active":"2024-09-14T10:45:49.731380+0000","last_became_peered":"2024-09-14T10:45:49.731380+0000","last_unstale":"2024-09-14T11:21:15.998699+0000","last_undegraded":"2024-09-14T11:21:15.998699+0000","last_fullsized":"2024-09-14T11:21:15.998699+0000","mapping_epoch":30,"log_start":"257'100","ondisk_log_start":"257'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:45.555612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":200,"num_read_kb":190,"num_write":162,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"260'793","reported_seq":2737,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:43.740421+0000","last_change":"2024-09-14T10:45:51.747482+0000","last_active":"2024-09-14T11:22:43.740421+0000","last_peered":"2024-09-14T11:22:43.740421+0000","last_clean":"2024-09-14T11:22:43.740421+0000","last_became_active":"2024-09-14T10:45:51.746984+0000","last_became_peered":"2024-09-14T10:45:51.746984+0000","last_unstale":"2024-09-14T11:22:43.740421+0000","last_undegraded":"2024-09-14T11:22:43.740421+0000","last_fullsized":"2024-09-14T11:22:43.740421+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:45.422324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"260'119","reported_seq":610,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:06.014335+0000","last_change":"2024-09-14T10:45:53.750253+0000","last_active":"2024-09-14T11:22:06.014335+0000","last_peered":"2024-09-14T11:22:06.014335+0000","last_clean":"2024-09-14T11:22:06.014335+0000","last_became_active":"2024-09-14T10:45:53.749802+0000","last_became_peered":"2024-09-14T10:45:53.749802+0000","last_unstale":"2024-09-14T11:22:06.014335+0000","last_undegraded":"2024-09-14T11:22:06.014335+0000","last_fullsized":"2024-09-14T11:22:06.014335+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:31.303920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":146,"num_read_kb":135,"num_write":274,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"260'412","reported_seq":1897,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:14.959250+0000","last_change":"2024-09-14T10:45:45.710569+0000","last_active":"2024-09-14T11:21:14.959250+0000","last_peered":"2024-09-14T11:21:14.959250+0000","last_clean":"2024-09-14T11:21:14.959250+0000","last_became_active":"2024-09-14T10:45:45.710204+0000","last_became_peered":"2024-09-14T10:45:45.710204+0000","last_unstale":"2024-09-14T11:21:14.959250+0000","last_undegraded":"2024-09-14T11:21:14.959250+0000","last_fullsized":"2024-09-14T11:21:14.959250+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:02.264958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2141,"num_read_kb":2031,"num_write":456,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"260'348","reported_seq":1117,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.099732+0000","last_change":"2024-09-14T10:45:43.688652+0000","last_active":"2024-09-14T11:22:51.099732+0000","last_peered":"2024-09-14T11:22:51.099732+0000","last_clean":"2024-09-14T11:22:51.099732+0000","last_became_active":"2024-09-14T10:45:43.688114+0000","last_became_peered":"2024-09-14T10:45:43.688114+0000","last_unstale":"2024-09-14T11:22:51.099732+0000","last_undegraded":"2024-09-14T11:22:51.099732+0000","last_fullsized":"2024-09-14T11:22:51.099732+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:15.866413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5413456,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":803,"num_read_kb":15214,"num_write":1150,"num_write_kb":42293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":509,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:16.122560+0000","last_change":"2024-09-14T10:45:35.575588+0000","last_active":"2024-09-14T11:20:16.122560+0000","last_peered":"2024-09-14T11:20:16.122560+0000","last_clean":"2024-09-14T11:20:16.122560+0000","last_became_active":"2024-09-14T10:45:33.610909+0000","last_became_peered":"2024-09-14T10:45:33.610909+0000","last_unstale":"2024-09-14T11:20:16.122560+0000","last_undegraded":"2024-09-14T11:20:16.122560+0000","last_fullsized":"2024-09-14T11:20:16.122560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_clean_scrub_stamp":"2024-09-14T10:45:32.551765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:45.821025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038435900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":480,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:07.108316+0000","last_change":"2024-09-14T10:45:47.728711+0000","last_active":"2024-09-14T11:19:07.108316+0000","last_peered":"2024-09-14T11:19:07.108316+0000","last_clean":"2024-09-14T11:19:07.108316+0000","last_became_active":"2024-09-14T10:45:47.728343+0000","last_became_peered":"2024-09-14T10:45:47.728343+0000","last_unstale":"2024-09-14T11:19:07.108316+0000","last_undegraded":"2024-09-14T11:19:07.108316+0000","last_fullsized":"2024-09-14T11:19:07.108316+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:17.637076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"260'92","reported_seq":605,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:56.315196+0000","last_change":"2024-09-14T10:45:49.736010+0000","last_active":"2024-09-14T11:20:56.315196+0000","last_peered":"2024-09-14T11:20:56.315196+0000","last_clean":"2024-09-14T11:20:56.315196+0000","last_became_active":"2024-09-14T10:45:49.735557+0000","last_became_peered":"2024-09-14T10:45:49.735557+0000","last_unstale":"2024-09-14T11:20:56.315196+0000","last_undegraded":"2024-09-14T11:20:56.315196+0000","last_fullsized":"2024-09-14T11:20:56.315196+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:10:56.092992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"260'804","reported_seq":2211,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.302906+0000","last_change":"2024-09-14T10:45:51.747138+0000","last_active":"2024-09-14T11:22:50.302906+0000","last_peered":"2024-09-14T11:22:50.302906+0000","last_clean":"2024-09-14T11:22:50.302906+0000","last_became_active":"2024-09-14T10:45:51.746874+0000","last_became_peered":"2024-09-14T10:45:51.746874+0000","last_unstale":"2024-09-14T11:22:50.302906+0000","last_undegraded":"2024-09-14T11:22:50.302906+0000","last_fullsized":"2024-09-14T11:22:50.302906+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":700,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:47.844695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"260'171","reported_seq":654,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:06.378984+0000","last_change":"2024-09-14T10:45:53.749142+0000","last_active":"2024-09-14T11:21:06.378984+0000","last_peered":"2024-09-14T11:21:06.378984+0000","last_clean":"2024-09-14T11:21:06.378984+0000","last_became_active":"2024-09-14T10:45:53.748880+0000","last_became_peered":"2024-09-14T10:45:53.748880+0000","last_unstale":"2024-09-14T11:21:06.378984+0000","last_undegraded":"2024-09-14T11:21:06.378984+0000","last_fullsized":"2024-09-14T11:21:06.378984+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:00:48.684200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":483,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":133,"num_read_kb":125,"num_write":394,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"260'405","reported_seq":1915,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.834581+0000","last_change":"2024-09-14T10:45:45.713570+0000","last_active":"2024-09-14T11:22:42.834581+0000","last_peered":"2024-09-14T11:22:42.834581+0000","last_clean":"2024-09-14T11:22:42.834581+0000","last_became_active":"2024-09-14T10:45:45.713313+0000","last_became_peered":"2024-09-14T10:45:45.713313+0000","last_unstale":"2024-09-14T11:22:42.834581+0000","last_undegraded":"2024-09-14T11:22:42.834581+0000","last_fullsized":"2024-09-14T11:22:42.834581+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:00.604945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2392,"num_read_kb":2258,"num_write":470,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"260'350","reported_seq":1090,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.965943+0000","last_change":"2024-09-14T10:45:43.691413+0000","last_active":"2024-09-14T11:22:50.965943+0000","last_peered":"2024-09-14T11:22:50.965943+0000","last_clean":"2024-09-14T11:22:50.965943+0000","last_became_active":"2024-09-14T10:45:43.689593+0000","last_became_peered":"2024-09-14T10:45:43.689593+0000","last_unstale":"2024-09-14T11:22:50.965943+0000","last_undegraded":"2024-09-14T11:22:50.965943+0000","last_fullsized":"2024-09-14T11:22:50.965943+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:27.067114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267503,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":1002,"num_read_kb":46617,"num_write":1235,"num_write_kb":43963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":503,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:17.118867+0000","last_change":"2024-09-14T10:45:35.580545+0000","last_active":"2024-09-14T11:20:17.118867+0000","last_peered":"2024-09-14T11:20:17.118867+0000","last_clean":"2024-09-14T11:20:17.118867+0000","last_became_active":"2024-09-14T10:45:33.610689+0000","last_became_peered":"2024-09-14T10:45:33.610689+0000","last_unstale":"2024-09-14T11:20:17.118867+0000","last_undegraded":"2024-09-14T11:20:17.118867+0000","last_fullsized":"2024-09-14T11:20:17.118867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_clean_scrub_stamp":"2024-09-14T10:45:32.551765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:59.821398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011461920000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:56.120373+0000","last_change":"2024-09-14T10:45:47.728608+0000","last_active":"2024-09-14T11:19:56.120373+0000","last_peered":"2024-09-14T11:19:56.120373+0000","last_clean":"2024-09-14T11:19:56.120373+0000","last_became_active":"2024-09-14T10:45:47.728312+0000","last_became_peered":"2024-09-14T10:45:47.728312+0000","last_unstale":"2024-09-14T11:19:56.120373+0000","last_undegraded":"2024-09-14T11:19:56.120373+0000","last_fullsized":"2024-09-14T11:19:56.120373+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:22.707433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"260'704","reported_seq":1391,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:43.704102+0000","last_change":"2024-09-14T10:45:49.734149+0000","last_active":"2024-09-14T11:22:43.704102+0000","last_peered":"2024-09-14T11:22:43.704102+0000","last_clean":"2024-09-14T11:22:43.704102+0000","last_became_active":"2024-09-14T10:45:49.733812+0000","last_became_peered":"2024-09-14T10:45:49.733812+0000","last_unstale":"2024-09-14T11:22:43.704102+0000","last_undegraded":"2024-09-14T11:22:43.704102+0000","last_fullsized":"2024-09-14T11:22:43.704102+0000","mapping_epoch":30,"log_start":"260'600","ondisk_log_start":"260'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":600,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:05.193302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167039,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1243,"num_read_kb":2680,"num_write":1028,"num_write_kb":871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:11.113894+0000","last_change":"2024-09-14T10:45:51.746053+0000","last_active":"2024-09-14T11:19:11.113894+0000","last_peered":"2024-09-14T11:19:11.113894+0000","last_clean":"2024-09-14T11:19:11.113894+0000","last_became_active":"2024-09-14T10:45:51.745137+0000","last_became_peered":"2024-09-14T10:45:51.745137+0000","last_unstale":"2024-09-14T11:19:11.113894+0000","last_undegraded":"2024-09-14T11:19:11.113894+0000","last_fullsized":"2024-09-14T11:19:11.113894+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:34.202906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"260'130","reported_seq":622,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.045272+0000","last_change":"2024-09-14T10:45:53.751882+0000","last_active":"2024-09-14T11:21:27.045272+0000","last_peered":"2024-09-14T11:21:27.045272+0000","last_clean":"2024-09-14T11:21:27.045272+0000","last_became_active":"2024-09-14T10:45:53.751511+0000","last_became_peered":"2024-09-14T10:45:53.751511+0000","last_unstale":"2024-09-14T11:21:27.045272+0000","last_undegraded":"2024-09-14T11:21:27.045272+0000","last_fullsized":"2024-09-14T11:21:27.045272+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:34.995970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":202,"num_read_kb":180,"num_write":339,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"260'195","reported_seq":792,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.396620+0000","last_change":"2024-09-14T10:45:53.747335+0000","last_active":"2024-09-14T11:21:28.396620+0000","last_peered":"2024-09-14T11:21:28.396620+0000","last_clean":"2024-09-14T11:21:28.396620+0000","last_became_active":"2024-09-14T10:45:53.747090+0000","last_became_peered":"2024-09-14T10:45:53.747090+0000","last_unstale":"2024-09-14T11:21:28.396620+0000","last_undegraded":"2024-09-14T11:21:28.396620+0000","last_fullsized":"2024-09-14T11:21:28.396620+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:02.580660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":464,"num_read_kb":408,"num_write":469,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"260'462","reported_seq":1939,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:09.637868+0000","last_change":"2024-09-14T10:45:45.719507+0000","last_active":"2024-09-14T11:21:09.637868+0000","last_peered":"2024-09-14T11:21:09.637868+0000","last_clean":"2024-09-14T11:21:09.637868+0000","last_became_active":"2024-09-14T10:45:45.719181+0000","last_became_peered":"2024-09-14T10:45:45.719181+0000","last_unstale":"2024-09-14T11:21:09.637868+0000","last_undegraded":"2024-09-14T11:21:09.637868+0000","last_fullsized":"2024-09-14T11:21:09.637868+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:25:12.612090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2298,"num_read_kb":2151,"num_write":532,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"260'329","reported_seq":987,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:59.219456+0000","last_change":"2024-09-14T10:45:43.673724+0000","last_active":"2024-09-14T11:20:59.219456+0000","last_peered":"2024-09-14T11:20:59.219456+0000","last_clean":"2024-09-14T11:20:59.219456+0000","last_became_active":"2024-09-14T10:45:43.673475+0000","last_became_peered":"2024-09-14T10:45:43.673475+0000","last_unstale":"2024-09-14T11:20:59.219456+0000","last_undegraded":"2024-09-14T11:20:59.219456+0000","last_fullsized":"2024-09-14T11:20:59.219456+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:22.605440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22088316,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":690,"num_read_kb":57044,"num_write":1220,"num_write_kb":43494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:30.977699+0000","last_change":"2024-09-14T10:45:47.727115+0000","last_active":"2024-09-14T11:18:30.977699+0000","last_peered":"2024-09-14T11:18:30.977699+0000","last_clean":"2024-09-14T11:18:30.977699+0000","last_became_active":"2024-09-14T10:45:47.726819+0000","last_became_peered":"2024-09-14T10:45:47.726819+0000","last_unstale":"2024-09-14T11:18:30.977699+0000","last_undegraded":"2024-09-14T11:18:30.977699+0000","last_fullsized":"2024-09-14T11:18:30.977699+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:49.723414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"260'271","reported_seq":822,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.561739+0000","last_change":"2024-09-14T10:45:49.733250+0000","last_active":"2024-09-14T11:22:50.561739+0000","last_peered":"2024-09-14T11:22:50.561739+0000","last_clean":"2024-09-14T11:22:50.561739+0000","last_became_active":"2024-09-14T10:45:49.732755+0000","last_became_peered":"2024-09-14T10:45:49.732755+0000","last_unstale":"2024-09-14T11:22:50.561739+0000","last_undegraded":"2024-09-14T11:22:50.561739+0000","last_fullsized":"2024-09-14T11:22:50.561739+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:54:03.582189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48124,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":453,"num_read_kb":1077,"num_write":370,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":472,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:30.983925+0000","last_change":"2024-09-14T10:45:51.747909+0000","last_active":"2024-09-14T11:18:30.983925+0000","last_peered":"2024-09-14T11:18:30.983925+0000","last_clean":"2024-09-14T11:18:30.983925+0000","last_became_active":"2024-09-14T10:45:51.747624+0000","last_became_peered":"2024-09-14T10:45:51.747624+0000","last_unstale":"2024-09-14T11:18:30.983925+0000","last_undegraded":"2024-09-14T11:18:30.983925+0000","last_fullsized":"2024-09-14T11:18:30.983925+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:20.368951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"260'138","reported_seq":626,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:14.388075+0000","last_change":"2024-09-14T10:45:53.751186+0000","last_active":"2024-09-14T11:21:14.388075+0000","last_peered":"2024-09-14T11:21:14.388075+0000","last_clean":"2024-09-14T11:21:14.388075+0000","last_became_active":"2024-09-14T10:45:53.750866+0000","last_became_peered":"2024-09-14T10:45:53.750866+0000","last_unstale":"2024-09-14T11:21:14.388075+0000","last_undegraded":"2024-09-14T11:21:14.388075+0000","last_fullsized":"2024-09-14T11:21:14.388075+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:54.350231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":161,"num_read_kb":145,"num_write":328,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"260'713","reported_seq":2438,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.336687+0000","last_change":"2024-09-14T10:45:45.720031+0000","last_active":"2024-09-14T11:21:28.336687+0000","last_peered":"2024-09-14T11:21:28.336687+0000","last_clean":"2024-09-14T11:21:28.336687+0000","last_became_active":"2024-09-14T10:45:45.719731+0000","last_became_peered":"2024-09-14T10:45:45.719731+0000","last_unstale":"2024-09-14T11:21:28.336687+0000","last_undegraded":"2024-09-14T11:21:28.336687+0000","last_fullsized":"2024-09-14T11:21:28.336687+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":700,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:55.272218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3605,"num_read_kb":3249,"num_write":949,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"260'284","reported_seq":892,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:57.835060+0000","last_change":"2024-09-14T10:45:43.683276+0000","last_active":"2024-09-14T11:20:57.835060+0000","last_peered":"2024-09-14T11:20:57.835060+0000","last_clean":"2024-09-14T11:20:57.835060+0000","last_became_active":"2024-09-14T10:45:43.682925+0000","last_became_peered":"2024-09-14T10:45:43.682925+0000","last_unstale":"2024-09-14T11:20:57.835060+0000","last_undegraded":"2024-09-14T11:20:57.835060+0000","last_fullsized":"2024-09-14T11:20:57.835060+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:31.662072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584968,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":575,"num_read_kb":1213,"num_write":964,"num_write_kb":13029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:31.108226+0000","last_change":"2024-09-14T10:45:47.724937+0000","last_active":"2024-09-14T11:18:31.108226+0000","last_peered":"2024-09-14T11:18:31.108226+0000","last_clean":"2024-09-14T11:18:31.108226+0000","last_became_active":"2024-09-14T10:45:47.724432+0000","last_became_peered":"2024-09-14T10:45:47.724432+0000","last_unstale":"2024-09-14T11:18:31.108226+0000","last_undegraded":"2024-09-14T11:18:31.108226+0000","last_fullsized":"2024-09-14T11:18:31.108226+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:26.499973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"260'45","reported_seq":533,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:51.127494+0000","last_change":"2024-09-14T10:45:49.735467+0000","last_active":"2024-09-14T11:20:51.127494+0000","last_peered":"2024-09-14T11:20:51.127494+0000","last_clean":"2024-09-14T11:20:51.127494+0000","last_became_active":"2024-09-14T10:45:49.735053+0000","last_became_peered":"2024-09-14T10:45:49.735053+0000","last_unstale":"2024-09-14T11:20:51.127494+0000","last_undegraded":"2024-09-14T11:20:51.127494+0000","last_fullsized":"2024-09-14T11:20:51.127494+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:14.336006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":24,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":467,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:34.979850+0000","last_change":"2024-09-14T10:45:51.748011+0000","last_active":"2024-09-14T11:18:34.979850+0000","last_peered":"2024-09-14T11:18:34.979850+0000","last_clean":"2024-09-14T11:18:34.979850+0000","last_became_active":"2024-09-14T10:45:51.747600+0000","last_became_peered":"2024-09-14T10:45:51.747600+0000","last_unstale":"2024-09-14T11:18:34.979850+0000","last_undegraded":"2024-09-14T11:18:34.979850+0000","last_fullsized":"2024-09-14T11:18:34.979850+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:20.639986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"260'223","reported_seq":744,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.339917+0000","last_change":"2024-09-14T10:45:53.751787+0000","last_active":"2024-09-14T11:21:28.339917+0000","last_peered":"2024-09-14T11:21:28.339917+0000","last_clean":"2024-09-14T11:21:28.339917+0000","last_became_active":"2024-09-14T10:45:53.751504+0000","last_became_peered":"2024-09-14T10:45:53.751504+0000","last_unstale":"2024-09-14T11:21:28.339917+0000","last_undegraded":"2024-09-14T11:21:28.339917+0000","last_fullsized":"2024-09-14T11:21:28.339917+0000","mapping_epoch":34,"log_start":"260'200","ondisk_log_start":"260'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:27.845346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":402,"num_read_kb":374,"num_write":536,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"260'726","reported_seq":2170,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:14.386625+0000","last_change":"2024-09-14T10:45:45.714585+0000","last_active":"2024-09-14T11:21:14.386625+0000","last_peered":"2024-09-14T11:21:14.386625+0000","last_clean":"2024-09-14T11:21:14.386625+0000","last_became_active":"2024-09-14T10:45:45.714326+0000","last_became_peered":"2024-09-14T10:45:45.714326+0000","last_unstale":"2024-09-14T11:21:14.386625+0000","last_undegraded":"2024-09-14T11:21:14.386625+0000","last_fullsized":"2024-09-14T11:21:14.386625+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":700,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:55.220424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3492,"num_read_kb":3158,"num_write":966,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"260'319","reported_seq":967,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:11.552773+0000","last_change":"2024-09-14T10:45:43.672043+0000","last_active":"2024-09-14T11:21:11.552773+0000","last_peered":"2024-09-14T11:21:11.552773+0000","last_clean":"2024-09-14T11:21:11.552773+0000","last_became_active":"2024-09-14T10:45:43.671747+0000","last_became_peered":"2024-09-14T10:45:43.671747+0000","last_unstale":"2024-09-14T11:21:11.552773+0000","last_undegraded":"2024-09-14T11:21:11.552773+0000","last_fullsized":"2024-09-14T11:21:11.552773+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:17.021045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15007678,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":632,"num_read_kb":3196,"num_write":1177,"num_write_kb":29609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":475,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:29.979126+0000","last_change":"2024-09-14T10:45:47.731898+0000","last_active":"2024-09-14T11:18:29.979126+0000","last_peered":"2024-09-14T11:18:29.979126+0000","last_clean":"2024-09-14T11:18:29.979126+0000","last_became_active":"2024-09-14T10:45:47.731640+0000","last_became_peered":"2024-09-14T10:45:47.731640+0000","last_unstale":"2024-09-14T11:18:29.979126+0000","last_undegraded":"2024-09-14T11:18:29.979126+0000","last_fullsized":"2024-09-14T11:18:29.979126+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:50:32.387766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"260'317","reported_seq":881,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:43.705489+0000","last_change":"2024-09-14T10:45:49.727713+0000","last_active":"2024-09-14T11:22:43.705489+0000","last_peered":"2024-09-14T11:22:43.705489+0000","last_clean":"2024-09-14T11:22:43.705489+0000","last_became_active":"2024-09-14T10:45:49.727431+0000","last_became_peered":"2024-09-14T10:45:49.727431+0000","last_unstale":"2024-09-14T11:22:43.705489+0000","last_undegraded":"2024-09-14T11:22:43.705489+0000","last_fullsized":"2024-09-14T11:22:43.705489+0000","mapping_epoch":30,"log_start":"260'300","ondisk_log_start":"260'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:44.165025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60297,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":506,"num_read_kb":1020,"num_write":416,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":476,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:32.102760+0000","last_change":"2024-09-14T10:45:51.747148+0000","last_active":"2024-09-14T11:18:32.102760+0000","last_peered":"2024-09-14T11:18:32.102760+0000","last_clean":"2024-09-14T11:18:32.102760+0000","last_became_active":"2024-09-14T10:45:51.746506+0000","last_became_peered":"2024-09-14T10:45:51.746506+0000","last_unstale":"2024-09-14T11:18:32.102760+0000","last_undegraded":"2024-09-14T11:18:32.102760+0000","last_fullsized":"2024-09-14T11:18:32.102760+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:58.299100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"260'144","reported_seq":636,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:12.863430+0000","last_change":"2024-09-14T10:45:53.755475+0000","last_active":"2024-09-14T11:21:12.863430+0000","last_peered":"2024-09-14T11:21:12.863430+0000","last_clean":"2024-09-14T11:21:12.863430+0000","last_became_active":"2024-09-14T10:45:53.755018+0000","last_became_peered":"2024-09-14T10:45:53.755018+0000","last_unstale":"2024-09-14T11:21:12.863430+0000","last_undegraded":"2024-09-14T11:21:12.863430+0000","last_fullsized":"2024-09-14T11:21:12.863430+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:18.887717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":167,"num_write":339,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"260'400","reported_seq":1926,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:13.964839+0000","last_change":"2024-09-14T10:45:45.713424+0000","last_active":"2024-09-14T11:21:13.964839+0000","last_peered":"2024-09-14T11:21:13.964839+0000","last_clean":"2024-09-14T11:21:13.964839+0000","last_became_active":"2024-09-14T10:45:45.713138+0000","last_became_peered":"2024-09-14T10:45:45.713138+0000","last_unstale":"2024-09-14T11:21:13.964839+0000","last_undegraded":"2024-09-14T11:21:13.964839+0000","last_fullsized":"2024-09-14T11:21:13.964839+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:33.204288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2187,"num_read_kb":2089,"num_write":453,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"260'356","reported_seq":966,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.076664+0000","last_change":"2024-09-14T10:45:43.680940+0000","last_active":"2024-09-14T11:22:51.076664+0000","last_peered":"2024-09-14T11:22:51.076664+0000","last_clean":"2024-09-14T11:22:51.076664+0000","last_became_active":"2024-09-14T10:45:43.680629+0000","last_became_peered":"2024-09-14T10:45:43.680629+0000","last_unstale":"2024-09-14T11:22:51.076664+0000","last_undegraded":"2024-09-14T11:22:51.076664+0000","last_fullsized":"2024-09-14T11:22:51.076664+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:50:55.277788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1134943,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":598,"num_read_kb":9938,"num_write":1213,"num_write_kb":44861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:27.102413+0000","last_change":"2024-09-14T10:45:47.728061+0000","last_active":"2024-09-14T11:18:27.102413+0000","last_peered":"2024-09-14T11:18:27.102413+0000","last_clean":"2024-09-14T11:18:27.102413+0000","last_became_active":"2024-09-14T10:45:47.727777+0000","last_became_peered":"2024-09-14T10:45:47.727777+0000","last_unstale":"2024-09-14T11:18:27.102413+0000","last_undegraded":"2024-09-14T11:18:27.102413+0000","last_fullsized":"2024-09-14T11:18:27.102413+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:11.350366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"260'266","reported_seq":815,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:06.713545+0000","last_change":"2024-09-14T10:45:49.727639+0000","last_active":"2024-09-14T11:21:06.713545+0000","last_peered":"2024-09-14T11:21:06.713545+0000","last_clean":"2024-09-14T11:21:06.713545+0000","last_became_active":"2024-09-14T10:45:49.727347+0000","last_became_peered":"2024-09-14T10:45:49.727347+0000","last_unstale":"2024-09-14T11:21:06.713545+0000","last_undegraded":"2024-09-14T11:21:06.713545+0000","last_fullsized":"2024-09-14T11:21:06.713545+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:01.870905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48442,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":404,"num_read_kb":831,"num_write":338,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":472,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:30.983987+0000","last_change":"2024-09-14T10:45:51.746782+0000","last_active":"2024-09-14T11:18:30.983987+0000","last_peered":"2024-09-14T11:18:30.983987+0000","last_clean":"2024-09-14T11:18:30.983987+0000","last_became_active":"2024-09-14T10:45:51.746493+0000","last_became_peered":"2024-09-14T10:45:51.746493+0000","last_unstale":"2024-09-14T11:18:30.983987+0000","last_undegraded":"2024-09-14T11:18:30.983987+0000","last_fullsized":"2024-09-14T11:18:30.983987+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:58.142627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"260'405","reported_seq":1975,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:14.951090+0000","last_change":"2024-09-14T10:45:45.725798+0000","last_active":"2024-09-14T11:21:14.951090+0000","last_peered":"2024-09-14T11:21:14.951090+0000","last_clean":"2024-09-14T11:21:14.951090+0000","last_became_active":"2024-09-14T10:45:45.725430+0000","last_became_peered":"2024-09-14T10:45:45.725430+0000","last_unstale":"2024-09-14T11:21:14.951090+0000","last_undegraded":"2024-09-14T11:21:14.951090+0000","last_fullsized":"2024-09-14T11:21:14.951090+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:31.325345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2252,"num_read_kb":2164,"num_write":454,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"260'295","reported_seq":911,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.109759+0000","last_change":"2024-09-14T10:45:43.684555+0000","last_active":"2024-09-14T11:22:51.109759+0000","last_peered":"2024-09-14T11:22:51.109759+0000","last_clean":"2024-09-14T11:22:51.109759+0000","last_became_active":"2024-09-14T10:45:43.683988+0000","last_became_peered":"2024-09-14T10:45:43.683988+0000","last_unstale":"2024-09-14T11:22:51.109759+0000","last_undegraded":"2024-09-14T11:22:51.109759+0000","last_fullsized":"2024-09-14T11:22:51.109759+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:58:49.723371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5813976,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":539,"num_read_kb":32569,"num_write":1038,"num_write_kb":14583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":481,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:00.990077+0000","last_change":"2024-09-14T10:45:47.728686+0000","last_active":"2024-09-14T11:20:00.990077+0000","last_peered":"2024-09-14T11:20:00.990077+0000","last_clean":"2024-09-14T11:20:00.990077+0000","last_became_active":"2024-09-14T10:45:47.728323+0000","last_became_peered":"2024-09-14T10:45:47.728323+0000","last_unstale":"2024-09-14T11:20:00.990077+0000","last_undegraded":"2024-09-14T11:20:00.990077+0000","last_fullsized":"2024-09-14T11:20:00.990077+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:13:35.492090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"260'486","reported_seq":1088,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.771270+0000","last_change":"2024-09-14T10:45:49.729101+0000","last_active":"2024-09-14T11:22:50.771270+0000","last_peered":"2024-09-14T11:22:50.771270+0000","last_clean":"2024-09-14T11:22:50.771270+0000","last_became_active":"2024-09-14T10:45:49.728841+0000","last_became_peered":"2024-09-14T10:45:49.728841+0000","last_unstale":"2024-09-14T11:22:50.771270+0000","last_undegraded":"2024-09-14T11:22:50.771270+0000","last_fullsized":"2024-09-14T11:22:50.771270+0000","mapping_epoch":30,"log_start":"260'400","ondisk_log_start":"260'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":400,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:11.378740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114572,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":881,"num_read_kb":2022,"num_write":772,"num_write_kb":713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":466,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:24.978449+0000","last_change":"2024-09-14T10:45:51.752010+0000","last_active":"2024-09-14T11:18:24.978449+0000","last_peered":"2024-09-14T11:18:24.978449+0000","last_clean":"2024-09-14T11:18:24.978449+0000","last_became_active":"2024-09-14T10:45:51.751776+0000","last_became_peered":"2024-09-14T10:45:51.751776+0000","last_unstale":"2024-09-14T11:18:24.978449+0000","last_undegraded":"2024-09-14T11:18:24.978449+0000","last_fullsized":"2024-09-14T11:18:24.978449+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:41:21.445606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"260'170","reported_seq":665,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.618448+0000","last_change":"2024-09-14T10:45:53.753181+0000","last_active":"2024-09-14T11:21:28.618448+0000","last_peered":"2024-09-14T11:21:28.618448+0000","last_clean":"2024-09-14T11:21:28.618448+0000","last_became_active":"2024-09-14T10:45:53.752535+0000","last_became_peered":"2024-09-14T10:45:53.752535+0000","last_unstale":"2024-09-14T11:21:28.618448+0000","last_undegraded":"2024-09-14T11:21:28.618448+0000","last_fullsized":"2024-09-14T11:21:28.618448+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:22.683886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":217,"num_read_kb":213,"num_write":386,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"260'440","reported_seq":2084,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.742063+0000","last_change":"2024-09-14T10:45:45.712598+0000","last_active":"2024-09-14T11:21:28.742063+0000","last_peered":"2024-09-14T11:21:28.742063+0000","last_clean":"2024-09-14T11:21:28.742063+0000","last_became_active":"2024-09-14T10:45:45.710498+0000","last_became_peered":"2024-09-14T10:45:45.710498+0000","last_unstale":"2024-09-14T11:21:28.742063+0000","last_undegraded":"2024-09-14T11:21:28.742063+0000","last_fullsized":"2024-09-14T11:21:28.742063+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:47:29.987154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2391,"num_read_kb":2291,"num_write":487,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"260'389","reported_seq":1143,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.104146+0000","last_change":"2024-09-14T10:45:43.688502+0000","last_active":"2024-09-14T11:22:51.104146+0000","last_peered":"2024-09-14T11:22:51.104146+0000","last_clean":"2024-09-14T11:22:51.104146+0000","last_became_active":"2024-09-14T10:45:43.688136+0000","last_became_peered":"2024-09-14T10:45:43.688136+0000","last_unstale":"2024-09-14T11:22:51.104146+0000","last_undegraded":"2024-09-14T11:22:51.104146+0000","last_fullsized":"2024-09-14T11:22:51.104146+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:56:33.762201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243179,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":1033,"num_read_kb":62484,"num_write":1323,"num_write_kb":26359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":477,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:09.985337+0000","last_change":"2024-09-14T10:45:47.726708+0000","last_active":"2024-09-14T11:19:09.985337+0000","last_peered":"2024-09-14T11:19:09.985337+0000","last_clean":"2024-09-14T11:19:09.985337+0000","last_became_active":"2024-09-14T10:45:47.725711+0000","last_became_peered":"2024-09-14T10:45:47.725711+0000","last_unstale":"2024-09-14T11:19:09.985337+0000","last_undegraded":"2024-09-14T11:19:09.985337+0000","last_fullsized":"2024-09-14T11:19:09.985337+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:23.138591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"260'277","reported_seq":830,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.843572+0000","last_change":"2024-09-14T10:45:49.730097+0000","last_active":"2024-09-14T11:22:42.843572+0000","last_peered":"2024-09-14T11:22:42.843572+0000","last_clean":"2024-09-14T11:22:42.843572+0000","last_became_active":"2024-09-14T10:45:49.729803+0000","last_became_peered":"2024-09-14T10:45:49.729803+0000","last_unstale":"2024-09-14T11:22:42.843572+0000","last_undegraded":"2024-09-14T11:22:42.843572+0000","last_fullsized":"2024-09-14T11:22:42.843572+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:44.767050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57256,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":452,"num_read_kb":917,"num_write":382,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":468,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:21.228045+0000","last_change":"2024-09-14T10:45:51.749137+0000","last_active":"2024-09-14T11:18:21.228045+0000","last_peered":"2024-09-14T11:18:21.228045+0000","last_clean":"2024-09-14T11:18:21.228045+0000","last_became_active":"2024-09-14T10:45:51.748871+0000","last_became_peered":"2024-09-14T10:45:51.748871+0000","last_unstale":"2024-09-14T11:18:21.228045+0000","last_undegraded":"2024-09-14T11:18:21.228045+0000","last_fullsized":"2024-09-14T11:18:21.228045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:41.260779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"260'208","reported_seq":1061,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.145844+0000","last_change":"2024-09-14T10:45:53.750953+0000","last_active":"2024-09-14T11:21:27.145844+0000","last_peered":"2024-09-14T11:21:27.145844+0000","last_clean":"2024-09-14T11:21:27.145844+0000","last_became_active":"2024-09-14T10:45:53.750595+0000","last_became_peered":"2024-09-14T10:45:53.750595+0000","last_unstale":"2024-09-14T11:21:27.145844+0000","last_undegraded":"2024-09-14T11:21:27.145844+0000","last_fullsized":"2024-09-14T11:21:27.145844+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:54.639620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1617,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":634,"num_read_kb":624,"num_write":573,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"260'1182","reported_seq":2743,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.327539+0000","last_change":"2024-09-14T10:45:45.722205+0000","last_active":"2024-09-14T11:21:28.327539+0000","last_peered":"2024-09-14T11:21:28.327539+0000","last_clean":"2024-09-14T11:21:28.327539+0000","last_became_active":"2024-09-14T10:45:45.721945+0000","last_became_peered":"2024-09-14T10:45:45.721945+0000","last_unstale":"2024-09-14T11:21:28.327539+0000","last_undegraded":"2024-09-14T11:21:28.327539+0000","last_fullsized":"2024-09-14T11:21:28.327539+0000","mapping_epoch":26,"log_start":"260'1100","ondisk_log_start":"260'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":1100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:32.193876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5490,"num_read_kb":4869,"num_write":1672,"num_write_kb":727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"260'278","reported_seq":912,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:26.651713+0000","last_change":"2024-09-14T10:45:43.682713+0000","last_active":"2024-09-14T11:21:26.651713+0000","last_peered":"2024-09-14T11:21:26.651713+0000","last_clean":"2024-09-14T11:21:26.651713+0000","last_became_active":"2024-09-14T10:45:43.682457+0000","last_became_peered":"2024-09-14T10:45:43.682457+0000","last_unstale":"2024-09-14T11:21:26.651713+0000","last_undegraded":"2024-09-14T11:21:26.651713+0000","last_fullsized":"2024-09-14T11:21:26.651713+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:25.191206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6916743,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":526,"num_read_kb":98004,"num_write":1119,"num_write_kb":36067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":474,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:19.977588+0000","last_change":"2024-09-14T10:45:47.726953+0000","last_active":"2024-09-14T11:18:19.977588+0000","last_peered":"2024-09-14T11:18:19.977588+0000","last_clean":"2024-09-14T11:18:19.977588+0000","last_became_active":"2024-09-14T10:45:47.726635+0000","last_became_peered":"2024-09-14T10:45:47.726635+0000","last_unstale":"2024-09-14T11:18:19.977588+0000","last_undegraded":"2024-09-14T11:18:19.977588+0000","last_fullsized":"2024-09-14T11:18:19.977588+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:12.596595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"260'274","reported_seq":827,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.701917+0000","last_change":"2024-09-14T10:45:49.729734+0000","last_active":"2024-09-14T11:22:50.701917+0000","last_peered":"2024-09-14T11:22:50.701917+0000","last_clean":"2024-09-14T11:22:50.701917+0000","last_became_active":"2024-09-14T10:45:49.729422+0000","last_became_peered":"2024-09-14T10:45:49.729422+0000","last_unstale":"2024-09-14T11:22:50.701917+0000","last_undegraded":"2024-09-14T11:22:50.701917+0000","last_fullsized":"2024-09-14T11:22:50.701917+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:36.625007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45487,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":456,"num_read_kb":1073,"num_write":374,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":475,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:00.997411+0000","last_change":"2024-09-14T10:45:51.748413+0000","last_active":"2024-09-14T11:20:00.997411+0000","last_peered":"2024-09-14T11:20:00.997411+0000","last_clean":"2024-09-14T11:20:00.997411+0000","last_became_active":"2024-09-14T10:45:51.747888+0000","last_became_peered":"2024-09-14T10:45:51.747888+0000","last_unstale":"2024-09-14T11:20:00.997411+0000","last_undegraded":"2024-09-14T11:20:00.997411+0000","last_fullsized":"2024-09-14T11:20:00.997411+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:31:10.652817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"260'126","reported_seq":597,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:43.728256+0000","last_change":"2024-09-14T10:45:53.750141+0000","last_active":"2024-09-14T11:22:43.728256+0000","last_peered":"2024-09-14T11:22:43.728256+0000","last_clean":"2024-09-14T11:22:43.728256+0000","last_became_active":"2024-09-14T10:45:53.749868+0000","last_became_peered":"2024-09-14T10:45:53.749868+0000","last_unstale":"2024-09-14T11:22:43.728256+0000","last_undegraded":"2024-09-14T11:22:43.728256+0000","last_fullsized":"2024-09-14T11:22:43.728256+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:03.049227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":111,"num_write":304,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"260'1124","reported_seq":2685,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:13.095273+0000","last_change":"2024-09-14T10:45:45.711778+0000","last_active":"2024-09-14T11:21:13.095273+0000","last_peered":"2024-09-14T11:21:13.095273+0000","last_clean":"2024-09-14T11:21:13.095273+0000","last_became_active":"2024-09-14T10:45:45.711476+0000","last_became_peered":"2024-09-14T10:45:45.711476+0000","last_unstale":"2024-09-14T11:21:13.095273+0000","last_undegraded":"2024-09-14T11:21:13.095273+0000","last_fullsized":"2024-09-14T11:21:13.095273+0000","mapping_epoch":26,"log_start":"260'1100","ondisk_log_start":"260'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":1100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:10.238217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5159,"num_read_kb":4588,"num_write":1521,"num_write_kb":611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"260'311","reported_seq":986,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.070976+0000","last_change":"2024-09-14T10:45:43.692253+0000","last_active":"2024-09-14T11:22:51.070976+0000","last_peered":"2024-09-14T11:22:51.070976+0000","last_clean":"2024-09-14T11:22:51.070976+0000","last_became_active":"2024-09-14T10:45:43.691976+0000","last_became_peered":"2024-09-14T10:45:43.691976+0000","last_unstale":"2024-09-14T11:22:51.070976+0000","last_undegraded":"2024-09-14T11:22:51.070976+0000","last_fullsized":"2024-09-14T11:22:51.070976+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:28.335886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102644,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":725,"num_read_kb":9027,"num_write":1095,"num_write_kb":58772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":483,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:21.106659+0000","last_change":"2024-09-14T10:45:47.726662+0000","last_active":"2024-09-14T11:18:21.106659+0000","last_peered":"2024-09-14T11:18:21.106659+0000","last_clean":"2024-09-14T11:18:21.106659+0000","last_became_active":"2024-09-14T10:45:47.726392+0000","last_became_peered":"2024-09-14T10:45:47.726392+0000","last_unstale":"2024-09-14T11:18:21.106659+0000","last_undegraded":"2024-09-14T11:18:21.106659+0000","last_fullsized":"2024-09-14T11:18:21.106659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:02:14.749214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"260'79","reported_seq":576,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:05.985921+0000","last_change":"2024-09-14T10:45:49.728741+0000","last_active":"2024-09-14T11:21:05.985921+0000","last_peered":"2024-09-14T11:21:05.985921+0000","last_clean":"2024-09-14T11:21:05.985921+0000","last_became_active":"2024-09-14T10:45:49.728444+0000","last_became_peered":"2024-09-14T10:45:49.728444+0000","last_unstale":"2024-09-14T11:21:05.985921+0000","last_undegraded":"2024-09-14T11:21:05.985921+0000","last_fullsized":"2024-09-14T11:21:05.985921+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:42.103576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":102,"num_read_kb":95,"num_write":120,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"260'790","reported_seq":2260,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:43.739402+0000","last_change":"2024-09-14T10:45:51.746786+0000","last_active":"2024-09-14T11:22:43.739402+0000","last_peered":"2024-09-14T11:22:43.739402+0000","last_clean":"2024-09-14T11:22:43.739402+0000","last_became_active":"2024-09-14T10:45:51.746303+0000","last_became_peered":"2024-09-14T10:45:51.746303+0000","last_unstale":"2024-09-14T11:22:43.739402+0000","last_undegraded":"2024-09-14T11:22:43.739402+0000","last_fullsized":"2024-09-14T11:22:43.739402+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:04.109276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"260'118","reported_seq":594,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:15.160213+0000","last_change":"2024-09-14T10:45:53.751786+0000","last_active":"2024-09-14T11:21:15.160213+0000","last_peered":"2024-09-14T11:21:15.160213+0000","last_clean":"2024-09-14T11:21:15.160213+0000","last_became_active":"2024-09-14T10:45:53.751453+0000","last_became_peered":"2024-09-14T10:45:53.751453+0000","last_unstale":"2024-09-14T11:21:15.160213+0000","last_undegraded":"2024-09-14T11:21:15.160213+0000","last_fullsized":"2024-09-14T11:21:15.160213+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:59.084760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":104,"num_write":274,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"260'444","reported_seq":2012,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:16.290828+0000","last_change":"2024-09-14T10:45:45.726094+0000","last_active":"2024-09-14T11:21:16.290828+0000","last_peered":"2024-09-14T11:21:16.290828+0000","last_clean":"2024-09-14T11:21:16.290828+0000","last_became_active":"2024-09-14T10:45:45.725806+0000","last_became_peered":"2024-09-14T10:45:45.725806+0000","last_unstale":"2024-09-14T11:21:16.290828+0000","last_undegraded":"2024-09-14T11:21:16.290828+0000","last_fullsized":"2024-09-14T11:21:16.290828+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:22.555341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2489,"num_read_kb":2350,"num_write":523,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"260'315","reported_seq":976,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:21.743941+0000","last_change":"2024-09-14T10:45:43.687148+0000","last_active":"2024-09-14T11:20:21.743941+0000","last_peered":"2024-09-14T11:20:21.743941+0000","last_clean":"2024-09-14T11:20:21.743941+0000","last_became_active":"2024-09-14T10:45:43.686768+0000","last_became_peered":"2024-09-14T10:45:43.686768+0000","last_unstale":"2024-09-14T11:20:21.743941+0000","last_undegraded":"2024-09-14T11:20:21.743941+0000","last_fullsized":"2024-09-14T11:20:21.743941+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:33.463121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6292907,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":664,"num_read_kb":58950,"num_write":1256,"num_write_kb":32402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":483,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:17.100449+0000","last_change":"2024-09-14T10:45:47.719027+0000","last_active":"2024-09-14T11:18:17.100449+0000","last_peered":"2024-09-14T11:18:17.100449+0000","last_clean":"2024-09-14T11:18:17.100449+0000","last_became_active":"2024-09-14T10:45:47.718721+0000","last_became_peered":"2024-09-14T10:45:47.718721+0000","last_unstale":"2024-09-14T11:18:17.100449+0000","last_undegraded":"2024-09-14T11:18:17.100449+0000","last_fullsized":"2024-09-14T11:18:17.100449+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:24.577421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"260'288","reported_seq":849,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:07.226802+0000","last_change":"2024-09-14T10:45:49.733977+0000","last_active":"2024-09-14T11:22:07.226802+0000","last_peered":"2024-09-14T11:22:07.226802+0000","last_clean":"2024-09-14T11:22:07.226802+0000","last_became_active":"2024-09-14T10:45:49.733684+0000","last_became_peered":"2024-09-14T10:45:49.733684+0000","last_unstale":"2024-09-14T11:22:07.226802+0000","last_undegraded":"2024-09-14T11:22:07.226802+0000","last_fullsized":"2024-09-14T11:22:07.226802+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:42.242159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54804,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":456,"num_read_kb":913,"num_write":378,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":476,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:41.118307+0000","last_change":"2024-09-14T10:45:51.742049+0000","last_active":"2024-09-14T11:19:41.118307+0000","last_peered":"2024-09-14T11:19:41.118307+0000","last_clean":"2024-09-14T11:19:41.118307+0000","last_became_active":"2024-09-14T10:45:51.741767+0000","last_became_peered":"2024-09-14T10:45:51.741767+0000","last_unstale":"2024-09-14T11:19:41.118307+0000","last_undegraded":"2024-09-14T11:19:41.118307+0000","last_fullsized":"2024-09-14T11:19:41.118307+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:16:02.477621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"260'128","reported_seq":620,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:06.769959+0000","last_change":"2024-09-14T10:45:53.749052+0000","last_active":"2024-09-14T11:21:06.769959+0000","last_peered":"2024-09-14T11:21:06.769959+0000","last_clean":"2024-09-14T11:21:06.769959+0000","last_became_active":"2024-09-14T10:45:53.748760+0000","last_became_peered":"2024-09-14T10:45:53.748760+0000","last_unstale":"2024-09-14T11:21:06.769959+0000","last_undegraded":"2024-09-14T11:21:06.769959+0000","last_fullsized":"2024-09-14T11:21:06.769959+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:12.144519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":155,"num_read_kb":143,"num_write":309,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"260'787","reported_seq":2297,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.832691+0000","last_change":"2024-09-14T10:45:45.718006+0000","last_active":"2024-09-14T11:22:42.832691+0000","last_peered":"2024-09-14T11:22:42.832691+0000","last_clean":"2024-09-14T11:22:42.832691+0000","last_became_active":"2024-09-14T10:45:45.717706+0000","last_became_peered":"2024-09-14T10:45:45.717706+0000","last_unstale":"2024-09-14T11:22:42.832691+0000","last_undegraded":"2024-09-14T11:22:42.832691+0000","last_fullsized":"2024-09-14T11:22:42.832691+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:04.856085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3708,"num_read_kb":3358,"num_write":1019,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"260'267","reported_seq":873,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:10.378878+0000","last_change":"2024-09-14T10:45:43.683275+0000","last_active":"2024-09-14T11:21:10.378878+0000","last_peered":"2024-09-14T11:21:10.378878+0000","last_clean":"2024-09-14T11:21:10.378878+0000","last_became_active":"2024-09-14T10:45:43.683014+0000","last_became_peered":"2024-09-14T10:45:43.683014+0000","last_unstale":"2024-09-14T11:21:10.378878+0000","last_undegraded":"2024-09-14T11:21:10.378878+0000","last_fullsized":"2024-09-14T11:21:10.378878+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:39:23.935741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14159038,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":471,"num_read_kb":15767,"num_write":923,"num_write_kb":32563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":474,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:19.977556+0000","last_change":"2024-09-14T10:45:47.726045+0000","last_active":"2024-09-14T11:18:19.977556+0000","last_peered":"2024-09-14T11:18:19.977556+0000","last_clean":"2024-09-14T11:18:19.977556+0000","last_became_active":"2024-09-14T10:45:47.725850+0000","last_became_peered":"2024-09-14T10:45:47.725850+0000","last_unstale":"2024-09-14T11:18:19.977556+0000","last_undegraded":"2024-09-14T11:18:19.977556+0000","last_fullsized":"2024-09-14T11:18:19.977556+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:53.534864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"260'258","reported_seq":811,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.945561+0000","last_change":"2024-09-14T10:45:49.736850+0000","last_active":"2024-09-14T11:22:50.945561+0000","last_peered":"2024-09-14T11:22:50.945561+0000","last_clean":"2024-09-14T11:22:50.945561+0000","last_became_active":"2024-09-14T10:45:49.736538+0000","last_became_peered":"2024-09-14T10:45:49.736538+0000","last_unstale":"2024-09-14T11:22:50.945561+0000","last_undegraded":"2024-09-14T11:22:50.945561+0000","last_fullsized":"2024-09-14T11:22:50.945561+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:24.205374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45998,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":425,"num_read_kb":1014,"num_write":348,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":470,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:47.114678+0000","last_change":"2024-09-14T10:45:51.745256+0000","last_active":"2024-09-14T11:19:47.114678+0000","last_peered":"2024-09-14T11:19:47.114678+0000","last_clean":"2024-09-14T11:19:47.114678+0000","last_became_active":"2024-09-14T10:45:51.744957+0000","last_became_peered":"2024-09-14T10:45:51.744957+0000","last_unstale":"2024-09-14T11:19:47.114678+0000","last_undegraded":"2024-09-14T11:19:47.114678+0000","last_fullsized":"2024-09-14T11:19:47.114678+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:00.836610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"260'125","reported_seq":625,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.799038+0000","last_change":"2024-09-14T10:45:53.750560+0000","last_active":"2024-09-14T11:21:28.799038+0000","last_peered":"2024-09-14T11:21:28.799038+0000","last_clean":"2024-09-14T11:21:28.799038+0000","last_became_active":"2024-09-14T10:45:53.750287+0000","last_became_peered":"2024-09-14T10:45:53.750287+0000","last_unstale":"2024-09-14T11:21:28.799038+0000","last_undegraded":"2024-09-14T11:21:28.799038+0000","last_fullsized":"2024-09-14T11:21:28.799038+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:48.692799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":175,"num_read_kb":170,"num_write":297,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"260'391","reported_seq":1842,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.835107+0000","last_change":"2024-09-14T10:45:45.713005+0000","last_active":"2024-09-14T11:22:42.835107+0000","last_peered":"2024-09-14T11:22:42.835107+0000","last_clean":"2024-09-14T11:22:42.835107+0000","last_became_active":"2024-09-14T10:45:45.712455+0000","last_became_peered":"2024-09-14T10:45:45.712455+0000","last_unstale":"2024-09-14T11:22:42.835107+0000","last_undegraded":"2024-09-14T11:22:42.835107+0000","last_fullsized":"2024-09-14T11:22:42.835107+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:29.570600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2172,"num_read_kb":2052,"num_write":470,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"260'333","reported_seq":980,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.107858+0000","last_change":"2024-09-14T10:45:43.676752+0000","last_active":"2024-09-14T11:22:51.107858+0000","last_peered":"2024-09-14T11:22:51.107858+0000","last_clean":"2024-09-14T11:22:51.107858+0000","last_became_active":"2024-09-14T10:45:43.676145+0000","last_became_peered":"2024-09-14T10:45:43.676145+0000","last_unstale":"2024-09-14T11:22:51.107858+0000","last_undegraded":"2024-09-14T11:22:51.107858+0000","last_fullsized":"2024-09-14T11:22:51.107858+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:31:26.462692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1441418,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":657,"num_read_kb":38975,"num_write":1163,"num_write_kb":36099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:37.112554+0000","last_change":"2024-09-14T10:45:47.724662+0000","last_active":"2024-09-14T11:19:37.112554+0000","last_peered":"2024-09-14T11:19:37.112554+0000","last_clean":"2024-09-14T11:19:37.112554+0000","last_became_active":"2024-09-14T10:45:47.724065+0000","last_became_peered":"2024-09-14T10:45:47.724065+0000","last_unstale":"2024-09-14T11:19:37.112554+0000","last_undegraded":"2024-09-14T11:19:37.112554+0000","last_fullsized":"2024-09-14T11:19:37.112554+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:57.045602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"260'239","reported_seq":777,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.625663+0000","last_change":"2024-09-14T10:45:49.728006+0000","last_active":"2024-09-14T11:22:50.625663+0000","last_peered":"2024-09-14T11:22:50.625663+0000","last_clean":"2024-09-14T11:22:50.625663+0000","last_became_active":"2024-09-14T10:45:49.727721+0000","last_became_peered":"2024-09-14T10:45:49.727721+0000","last_unstale":"2024-09-14T11:22:50.625663+0000","last_undegraded":"2024-09-14T11:22:50.625663+0000","last_fullsized":"2024-09-14T11:22:50.625663+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:35.275905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47218,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":415,"num_read_kb":1017,"num_write":344,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":469,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:22.101700+0000","last_change":"2024-09-14T10:45:51.742675+0000","last_active":"2024-09-14T11:18:22.101700+0000","last_peered":"2024-09-14T11:18:22.101700+0000","last_clean":"2024-09-14T11:18:22.101700+0000","last_became_active":"2024-09-14T10:45:51.742387+0000","last_became_peered":"2024-09-14T10:45:51.742387+0000","last_unstale":"2024-09-14T11:18:22.101700+0000","last_undegraded":"2024-09-14T11:18:22.101700+0000","last_fullsized":"2024-09-14T11:18:22.101700+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:36.809715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"260'160","reported_seq":1255,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.232516+0000","last_change":"2024-09-14T10:45:53.752874+0000","last_active":"2024-09-14T11:21:27.232516+0000","last_peered":"2024-09-14T11:21:27.232516+0000","last_clean":"2024-09-14T11:21:27.232516+0000","last_became_active":"2024-09-14T10:45:53.752639+0000","last_became_peered":"2024-09-14T10:45:53.752639+0000","last_unstale":"2024-09-14T11:21:27.232516+0000","last_undegraded":"2024-09-14T11:21:27.232516+0000","last_fullsized":"2024-09-14T11:21:27.232516+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:29.390299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":838,"num_read_kb":820,"num_write":382,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"260'397","reported_seq":1903,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:15.867791+0000","last_change":"2024-09-14T10:45:45.719248+0000","last_active":"2024-09-14T11:21:15.867791+0000","last_peered":"2024-09-14T11:21:15.867791+0000","last_clean":"2024-09-14T11:21:15.867791+0000","last_became_active":"2024-09-14T10:45:45.718964+0000","last_became_peered":"2024-09-14T10:45:45.718964+0000","last_unstale":"2024-09-14T11:21:15.867791+0000","last_undegraded":"2024-09-14T11:21:15.867791+0000","last_fullsized":"2024-09-14T11:21:15.867791+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:55.163718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2133,"num_read_kb":2043,"num_write":433,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"260'339","reported_seq":977,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.035464+0000","last_change":"2024-09-14T10:45:43.675554+0000","last_active":"2024-09-14T11:22:51.035464+0000","last_peered":"2024-09-14T11:22:51.035464+0000","last_clean":"2024-09-14T11:22:51.035464+0000","last_became_active":"2024-09-14T10:45:43.675220+0000","last_became_peered":"2024-09-14T10:45:43.675220+0000","last_unstale":"2024-09-14T11:22:51.035464+0000","last_undegraded":"2024-09-14T11:22:51.035464+0000","last_fullsized":"2024-09-14T11:22:51.035464+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:34:09.729685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20992,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":580,"num_read_kb":38424,"num_write":1063,"num_write_kb":41594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":485,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:46.119103+0000","last_change":"2024-09-14T10:45:47.729627+0000","last_active":"2024-09-14T11:19:46.119103+0000","last_peered":"2024-09-14T11:19:46.119103+0000","last_clean":"2024-09-14T11:19:46.119103+0000","last_became_active":"2024-09-14T10:45:47.729338+0000","last_became_peered":"2024-09-14T10:45:47.729338+0000","last_unstale":"2024-09-14T11:19:46.119103+0000","last_undegraded":"2024-09-14T11:19:46.119103+0000","last_fullsized":"2024-09-14T11:19:46.119103+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:15.042150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"260'285","reported_seq":842,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:10.053013+0000","last_change":"2024-09-14T10:45:49.731337+0000","last_active":"2024-09-14T11:21:10.053013+0000","last_peered":"2024-09-14T11:21:10.053013+0000","last_clean":"2024-09-14T11:21:10.053013+0000","last_became_active":"2024-09-14T10:45:49.729842+0000","last_became_peered":"2024-09-14T10:45:49.729842+0000","last_unstale":"2024-09-14T11:21:10.053013+0000","last_undegraded":"2024-09-14T11:21:10.053013+0000","last_fullsized":"2024-09-14T11:21:10.053013+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:25:47.634561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53437,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":465,"num_read_kb":935,"num_write":380,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":475,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:21.106628+0000","last_change":"2024-09-14T10:45:51.745622+0000","last_active":"2024-09-14T11:18:21.106628+0000","last_peered":"2024-09-14T11:18:21.106628+0000","last_clean":"2024-09-14T11:18:21.106628+0000","last_became_active":"2024-09-14T10:45:51.745310+0000","last_became_peered":"2024-09-14T10:45:51.745310+0000","last_unstale":"2024-09-14T11:18:21.106628+0000","last_undegraded":"2024-09-14T11:18:21.106628+0000","last_fullsized":"2024-09-14T11:18:21.106628+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:03.197112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"260'137","reported_seq":616,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.832054+0000","last_change":"2024-09-14T10:45:53.755154+0000","last_active":"2024-09-14T11:22:42.832054+0000","last_peered":"2024-09-14T11:22:42.832054+0000","last_clean":"2024-09-14T11:22:42.832054+0000","last_became_active":"2024-09-14T10:45:53.754826+0000","last_became_peered":"2024-09-14T10:45:53.754826+0000","last_unstale":"2024-09-14T11:22:42.832054+0000","last_undegraded":"2024-09-14T11:22:42.832054+0000","last_fullsized":"2024-09-14T11:22:42.832054+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:13.225340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":657,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":128,"num_read_kb":116,"num_write":335,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"260'420","reported_seq":1963,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:15.435203+0000","last_change":"2024-09-14T10:45:45.709097+0000","last_active":"2024-09-14T11:21:15.435203+0000","last_peered":"2024-09-14T11:21:15.435203+0000","last_clean":"2024-09-14T11:21:15.435203+0000","last_became_active":"2024-09-14T10:45:45.708229+0000","last_became_peered":"2024-09-14T10:45:45.708229+0000","last_unstale":"2024-09-14T11:21:15.435203+0000","last_undegraded":"2024-09-14T11:21:15.435203+0000","last_fullsized":"2024-09-14T11:21:15.435203+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:43.675052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2330,"num_read_kb":2210,"num_write":517,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"260'294","reported_seq":941,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:11.838702+0000","last_change":"2024-09-14T10:45:43.684421+0000","last_active":"2024-09-14T11:21:11.838702+0000","last_peered":"2024-09-14T11:21:11.838702+0000","last_clean":"2024-09-14T11:21:11.838702+0000","last_became_active":"2024-09-14T10:45:43.684102+0000","last_became_peered":"2024-09-14T10:45:43.684102+0000","last_unstale":"2024-09-14T11:21:11.838702+0000","last_undegraded":"2024-09-14T11:21:11.838702+0000","last_fullsized":"2024-09-14T11:21:11.838702+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:13.550852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12551297,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":546,"num_read_kb":82369,"num_write":1003,"num_write_kb":43712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"260'384","reported_seq":1943,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.835413+0000","last_change":"2024-09-14T10:45:45.719252+0000","last_active":"2024-09-14T11:22:42.835413+0000","last_peered":"2024-09-14T11:22:42.835413+0000","last_clean":"2024-09-14T11:22:42.835413+0000","last_became_active":"2024-09-14T10:45:45.718949+0000","last_became_peered":"2024-09-14T10:45:45.718949+0000","last_unstale":"2024-09-14T11:22:42.835413+0000","last_undegraded":"2024-09-14T11:22:42.835413+0000","last_fullsized":"2024-09-14T11:22:42.835413+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:10.419875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2227,"num_read_kb":2135,"num_write":439,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"260'294","reported_seq":906,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.998723+0000","last_change":"2024-09-14T10:45:43.690959+0000","last_active":"2024-09-14T11:22:50.998723+0000","last_peered":"2024-09-14T11:22:50.998723+0000","last_clean":"2024-09-14T11:22:50.998723+0000","last_became_active":"2024-09-14T10:45:43.690675+0000","last_became_peered":"2024-09-14T10:45:43.690675+0000","last_unstale":"2024-09-14T11:22:50.998723+0000","last_undegraded":"2024-09-14T11:22:50.998723+0000","last_fullsized":"2024-09-14T11:22:50.998723+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:38.359419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10810592,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":513,"num_read_kb":9887,"num_write":1014,"num_write_kb":21015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"260'531","reported_seq":2240,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:16.296791+0000","last_change":"2024-09-14T10:45:45.718344+0000","last_active":"2024-09-14T11:21:16.296791+0000","last_peered":"2024-09-14T11:21:16.296791+0000","last_clean":"2024-09-14T11:21:16.296791+0000","last_became_active":"2024-09-14T10:45:45.717393+0000","last_became_peered":"2024-09-14T10:45:45.717393+0000","last_unstale":"2024-09-14T11:21:16.296791+0000","last_undegraded":"2024-09-14T11:21:16.296791+0000","last_fullsized":"2024-09-14T11:21:16.296791+0000","mapping_epoch":26,"log_start":"260'500","ondisk_log_start":"260'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":500,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:54.085248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2830,"num_read_kb":2663,"num_write":635,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"260'315","reported_seq":956,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:19.713137+0000","last_change":"2024-09-14T10:45:43.675487+0000","last_active":"2024-09-14T11:20:19.713137+0000","last_peered":"2024-09-14T11:20:19.713137+0000","last_clean":"2024-09-14T11:20:19.713137+0000","last_became_active":"2024-09-14T10:45:43.675216+0000","last_became_peered":"2024-09-14T10:45:43.675216+0000","last_unstale":"2024-09-14T11:20:19.713137+0000","last_undegraded":"2024-09-14T11:20:19.713137+0000","last_fullsized":"2024-09-14T11:20:19.713137+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:40:10.871125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6337635,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":638,"num_read_kb":14117,"num_write":1152,"num_write_kb":48801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"260'869","reported_seq":2509,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.742312+0000","last_change":"2024-09-14T10:45:45.721319+0000","last_active":"2024-09-14T11:21:28.742312+0000","last_peered":"2024-09-14T11:21:28.742312+0000","last_clean":"2024-09-14T11:21:28.742312+0000","last_became_active":"2024-09-14T10:45:45.720939+0000","last_became_peered":"2024-09-14T10:45:45.720939+0000","last_unstale":"2024-09-14T11:21:28.742312+0000","last_undegraded":"2024-09-14T11:21:28.742312+0000","last_fullsized":"2024-09-14T11:21:28.742312+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":800,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:00.246883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4139,"num_read_kb":3737,"num_write":1132,"num_write_kb":407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"260'297","reported_seq":877,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.101577+0000","last_change":"2024-09-14T10:45:43.682207+0000","last_active":"2024-09-14T11:22:51.101577+0000","last_peered":"2024-09-14T11:22:51.101577+0000","last_clean":"2024-09-14T11:22:51.101577+0000","last_became_active":"2024-09-14T10:45:43.681864+0000","last_became_peered":"2024-09-14T10:45:43.681864+0000","last_unstale":"2024-09-14T11:22:51.101577+0000","last_undegraded":"2024-09-14T11:22:51.101577+0000","last_fullsized":"2024-09-14T11:22:51.101577+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:57.070549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5245087,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":444,"num_read_kb":5481,"num_write":949,"num_write_kb":23381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"260'447","reported_seq":2094,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.733448+0000","last_change":"2024-09-14T10:45:45.722885+0000","last_active":"2024-09-14T11:21:28.733448+0000","last_peered":"2024-09-14T11:21:28.733448+0000","last_clean":"2024-09-14T11:21:28.733448+0000","last_became_active":"2024-09-14T10:45:45.722575+0000","last_became_peered":"2024-09-14T10:45:45.722575+0000","last_unstale":"2024-09-14T11:21:28.733448+0000","last_undegraded":"2024-09-14T11:21:28.733448+0000","last_fullsized":"2024-09-14T11:21:28.733448+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:17.355674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2593,"num_read_kb":2475,"num_write":496,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"260'331","reported_seq":965,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.999911+0000","last_change":"2024-09-14T10:45:43.691467+0000","last_active":"2024-09-14T11:22:50.999911+0000","last_peered":"2024-09-14T11:22:50.999911+0000","last_clean":"2024-09-14T11:22:50.999911+0000","last_became_active":"2024-09-14T10:45:43.691101+0000","last_became_peered":"2024-09-14T10:45:43.691101+0000","last_unstale":"2024-09-14T11:22:50.999911+0000","last_undegraded":"2024-09-14T11:22:50.999911+0000","last_fullsized":"2024-09-14T11:22:50.999911+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:42.090533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1158287,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":609,"num_read_kb":20829,"num_write":1118,"num_write_kb":28609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"260'964","reported_seq":2549,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.733701+0000","last_change":"2024-09-14T10:45:45.717757+0000","last_active":"2024-09-14T11:21:28.733701+0000","last_peered":"2024-09-14T11:21:28.733701+0000","last_clean":"2024-09-14T11:21:28.733701+0000","last_became_active":"2024-09-14T10:45:45.717482+0000","last_became_peered":"2024-09-14T10:45:45.717482+0000","last_unstale":"2024-09-14T11:21:28.733701+0000","last_undegraded":"2024-09-14T11:21:28.733701+0000","last_fullsized":"2024-09-14T11:21:28.733701+0000","mapping_epoch":26,"log_start":"260'900","ondisk_log_start":"260'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":900,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:38.032224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4656,"num_read_kb":4162,"num_write":1345,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"260'397","reported_seq":1036,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.957422+0000","last_change":"2024-09-14T10:45:43.682195+0000","last_active":"2024-09-14T11:22:50.957422+0000","last_peered":"2024-09-14T11:22:50.957422+0000","last_clean":"2024-09-14T11:22:50.957422+0000","last_became_active":"2024-09-14T10:45:43.681769+0000","last_became_peered":"2024-09-14T10:45:43.681769+0000","last_unstale":"2024-09-14T11:22:50.957422+0000","last_undegraded":"2024-09-14T11:22:50.957422+0000","last_fullsized":"2024-09-14T11:22:50.957422+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:19:39.686774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4319,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":866,"num_read_kb":850,"num_write":1191,"num_write_kb":26526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"260'498","reported_seq":2173,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:16.642909+0000","last_change":"2024-09-14T10:45:45.724828+0000","last_active":"2024-09-14T11:21:16.642909+0000","last_peered":"2024-09-14T11:21:16.642909+0000","last_clean":"2024-09-14T11:21:16.642909+0000","last_became_active":"2024-09-14T10:45:45.724491+0000","last_became_peered":"2024-09-14T10:45:45.724491+0000","last_unstale":"2024-09-14T11:21:16.642909+0000","last_undegraded":"2024-09-14T11:21:16.642909+0000","last_fullsized":"2024-09-14T11:21:16.642909+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:19.646816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2800,"num_read_kb":2654,"num_write":635,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"260'287","reported_seq":904,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:59.841393+0000","last_change":"2024-09-14T10:45:43.672840+0000","last_active":"2024-09-14T11:20:59.841393+0000","last_peered":"2024-09-14T11:20:59.841393+0000","last_clean":"2024-09-14T11:20:59.841393+0000","last_became_active":"2024-09-14T10:45:43.672592+0000","last_became_peered":"2024-09-14T10:45:43.672592+0000","last_unstale":"2024-09-14T11:20:59.841393+0000","last_undegraded":"2024-09-14T11:20:59.841393+0000","last_fullsized":"2024-09-14T11:20:59.841393+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:20.782416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6709220,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":509,"num_read_kb":14710,"num_write":969,"num_write_kb":26884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"260'948","reported_seq":2547,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:10.890134+0000","last_change":"2024-09-14T10:45:45.713168+0000","last_active":"2024-09-14T11:21:10.890134+0000","last_peered":"2024-09-14T11:21:10.890134+0000","last_clean":"2024-09-14T11:21:10.890134+0000","last_became_active":"2024-09-14T10:45:45.712642+0000","last_became_peered":"2024-09-14T10:45:45.712642+0000","last_unstale":"2024-09-14T11:21:10.890134+0000","last_undegraded":"2024-09-14T11:21:10.890134+0000","last_fullsized":"2024-09-14T11:21:10.890134+0000","mapping_epoch":26,"log_start":"260'900","ondisk_log_start":"260'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":900,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:58.076786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4544,"num_read_kb":4033,"num_write":1311,"num_write_kb":524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"260'357","reported_seq":998,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.108561+0000","last_change":"2024-09-14T10:45:43.675555+0000","last_active":"2024-09-14T11:22:51.108561+0000","last_peered":"2024-09-14T11:22:51.108561+0000","last_clean":"2024-09-14T11:22:51.108561+0000","last_became_active":"2024-09-14T10:45:43.675233+0000","last_became_peered":"2024-09-14T10:45:43.675233+0000","last_unstale":"2024-09-14T11:22:51.108561+0000","last_undegraded":"2024-09-14T11:22:51.108561+0000","last_fullsized":"2024-09-14T11:22:51.108561+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:01.549298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":397594,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":653,"num_read_kb":10456,"num_write":1251,"num_write_kb":38144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"260'843","reported_seq":2436,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.742304+0000","last_change":"2024-09-14T10:45:45.712273+0000","last_active":"2024-09-14T11:21:28.742304+0000","last_peered":"2024-09-14T11:21:28.742304+0000","last_clean":"2024-09-14T11:21:28.742304+0000","last_became_active":"2024-09-14T10:45:45.711947+0000","last_became_peered":"2024-09-14T10:45:45.711947+0000","last_unstale":"2024-09-14T11:21:28.742304+0000","last_undegraded":"2024-09-14T11:21:28.742304+0000","last_fullsized":"2024-09-14T11:21:28.742304+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":800,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:05:59.351828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4120,"num_read_kb":3716,"num_write":1158,"num_write_kb":467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"260'252","reported_seq":852,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:13.787841+0000","last_change":"2024-09-14T10:45:43.677879+0000","last_active":"2024-09-14T11:21:13.787841+0000","last_peered":"2024-09-14T11:21:13.787841+0000","last_clean":"2024-09-14T11:21:13.787841+0000","last_became_active":"2024-09-14T10:45:43.677597+0000","last_became_peered":"2024-09-14T10:45:43.677597+0000","last_unstale":"2024-09-14T11:21:13.787841+0000","last_undegraded":"2024-09-14T11:21:13.787841+0000","last_fullsized":"2024-09-14T11:21:13.787841+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:12.554551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672162,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":428,"num_read_kb":1898,"num_write":934,"num_write_kb":19841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"260'855","reported_seq":2368,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:13.519366+0000","last_change":"2024-09-14T10:45:45.715549+0000","last_active":"2024-09-14T11:21:13.519366+0000","last_peered":"2024-09-14T11:21:13.519366+0000","last_clean":"2024-09-14T11:21:13.519366+0000","last_became_active":"2024-09-14T10:45:45.715268+0000","last_became_peered":"2024-09-14T10:45:45.715268+0000","last_unstale":"2024-09-14T11:21:13.519366+0000","last_undegraded":"2024-09-14T11:21:13.519366+0000","last_fullsized":"2024-09-14T11:21:13.519366+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":800,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:40.990468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4230,"num_read_kb":3798,"num_write":1192,"num_write_kb":502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"260'339","reported_seq":987,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.103812+0000","last_change":"2024-09-14T10:45:43.681993+0000","last_active":"2024-09-14T11:22:51.103812+0000","last_peered":"2024-09-14T11:22:51.103812+0000","last_clean":"2024-09-14T11:22:51.103812+0000","last_became_active":"2024-09-14T10:45:43.681694+0000","last_became_peered":"2024-09-14T10:45:43.681694+0000","last_unstale":"2024-09-14T11:22:51.103812+0000","last_undegraded":"2024-09-14T11:22:51.103812+0000","last_fullsized":"2024-09-14T11:22:51.103812+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:01.339229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133849,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":697,"num_read_kb":32454,"num_write":1247,"num_write_kb":21071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"260'430","reported_seq":1883,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.336922+0000","last_change":"2024-09-14T10:45:45.723781+0000","last_active":"2024-09-14T11:21:28.336922+0000","last_peered":"2024-09-14T11:21:28.336922+0000","last_clean":"2024-09-14T11:21:28.336922+0000","last_became_active":"2024-09-14T10:45:45.723441+0000","last_became_peered":"2024-09-14T10:45:45.723441+0000","last_unstale":"2024-09-14T11:21:28.336922+0000","last_undegraded":"2024-09-14T11:21:28.336922+0000","last_fullsized":"2024-09-14T11:21:28.336922+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:25.130052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2262,"num_read_kb":2127,"num_write":517,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"260'279","reported_seq":915,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:26.616442+0000","last_change":"2024-09-14T10:45:43.681966+0000","last_active":"2024-09-14T11:21:26.616442+0000","last_peered":"2024-09-14T11:21:26.616442+0000","last_clean":"2024-09-14T11:21:26.616442+0000","last_became_active":"2024-09-14T10:45:43.681441+0000","last_became_peered":"2024-09-14T10:45:43.681441+0000","last_unstale":"2024-09-14T11:21:26.616442+0000","last_undegraded":"2024-09-14T11:21:26.616442+0000","last_fullsized":"2024-09-14T11:21:26.616442+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:17:03.032759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18979549,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":575,"num_read_kb":21101,"num_write":1018,"num_write_kb":38924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"260'751","reported_seq":2222,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:16.648120+0000","last_change":"2024-09-14T10:45:45.711729+0000","last_active":"2024-09-14T11:21:16.648120+0000","last_peered":"2024-09-14T11:21:16.648120+0000","last_clean":"2024-09-14T11:21:16.648120+0000","last_became_active":"2024-09-14T10:45:45.711402+0000","last_became_peered":"2024-09-14T10:45:45.711402+0000","last_unstale":"2024-09-14T11:21:16.648120+0000","last_undegraded":"2024-09-14T11:21:16.648120+0000","last_fullsized":"2024-09-14T11:21:16.648120+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:13:41.088714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3613,"num_read_kb":3262,"num_write":995,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"260'324","reported_seq":945,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.106623+0000","last_change":"2024-09-14T10:45:43.691446+0000","last_active":"2024-09-14T11:22:51.106623+0000","last_peered":"2024-09-14T11:22:51.106623+0000","last_clean":"2024-09-14T11:22:51.106623+0000","last_became_active":"2024-09-14T10:45:43.690104+0000","last_became_peered":"2024-09-14T10:45:43.690104+0000","last_unstale":"2024-09-14T11:22:51.106623+0000","last_undegraded":"2024-09-14T11:22:51.106623+0000","last_fullsized":"2024-09-14T11:22:51.106623+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:57.667620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289114,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":613,"num_read_kb":1889,"num_write":1131,"num_write_kb":1386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"260'584","reported_seq":2224,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:16.648085+0000","last_change":"2024-09-14T10:45:45.723438+0000","last_active":"2024-09-14T11:21:16.648085+0000","last_peered":"2024-09-14T11:21:16.648085+0000","last_clean":"2024-09-14T11:21:16.648085+0000","last_became_active":"2024-09-14T10:45:45.723163+0000","last_became_peered":"2024-09-14T10:45:45.723163+0000","last_unstale":"2024-09-14T11:21:16.648085+0000","last_undegraded":"2024-09-14T11:21:16.648085+0000","last_fullsized":"2024-09-14T11:21:16.648085+0000","mapping_epoch":26,"log_start":"260'500","ondisk_log_start":"260'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":500,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:52.106816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3275,"num_read_kb":3002,"num_write":768,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"260'309","reported_seq":975,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:14.330528+0000","last_change":"2024-09-14T10:45:43.680804+0000","last_active":"2024-09-14T11:21:14.330528+0000","last_peered":"2024-09-14T11:21:14.330528+0000","last_clean":"2024-09-14T11:21:14.330528+0000","last_became_active":"2024-09-14T10:45:43.680517+0000","last_became_peered":"2024-09-14T10:45:43.680517+0000","last_unstale":"2024-09-14T11:21:14.330528+0000","last_undegraded":"2024-09-14T11:21:14.330528+0000","last_fullsized":"2024-09-14T11:21:14.330528+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:45:55.749037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6751287,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":667,"num_read_kb":32475,"num_write":1325,"num_write_kb":39199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"260'767","reported_seq":2281,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:46.011097+0000","last_change":"2024-09-14T10:45:45.719346+0000","last_active":"2024-09-14T11:21:46.011097+0000","last_peered":"2024-09-14T11:21:46.011097+0000","last_clean":"2024-09-14T11:21:46.011097+0000","last_became_active":"2024-09-14T10:45:45.718969+0000","last_became_peered":"2024-09-14T10:45:45.718969+0000","last_unstale":"2024-09-14T11:21:46.011097+0000","last_undegraded":"2024-09-14T11:21:46.011097+0000","last_fullsized":"2024-09-14T11:21:46.011097+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:07:46.732678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3670,"num_read_kb":3326,"num_write":1002,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"260'266","reported_seq":886,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:08.239208+0000","last_change":"2024-09-14T10:45:43.691080+0000","last_active":"2024-09-14T11:21:08.239208+0000","last_peered":"2024-09-14T11:21:08.239208+0000","last_clean":"2024-09-14T11:21:08.239208+0000","last_became_active":"2024-09-14T10:45:43.690489+0000","last_became_peered":"2024-09-14T10:45:43.690489+0000","last_unstale":"2024-09-14T11:21:08.239208+0000","last_undegraded":"2024-09-14T11:21:08.239208+0000","last_fullsized":"2024-09-14T11:21:08.239208+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:15.282672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7471466,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":494,"num_read_kb":22088,"num_write":989,"num_write_kb":34450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"260'625","reported_seq":2199,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:46.134870+0000","last_change":"2024-09-14T10:45:45.727368+0000","last_active":"2024-09-14T11:21:46.134870+0000","last_peered":"2024-09-14T11:21:46.134870+0000","last_clean":"2024-09-14T11:21:46.134870+0000","last_became_active":"2024-09-14T10:45:45.727095+0000","last_became_peered":"2024-09-14T10:45:45.727095+0000","last_unstale":"2024-09-14T11:21:46.134870+0000","last_undegraded":"2024-09-14T11:21:46.134870+0000","last_fullsized":"2024-09-14T11:21:46.134870+0000","mapping_epoch":26,"log_start":"260'600","ondisk_log_start":"260'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":600,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:49.272823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3428,"num_read_kb":3090,"num_write":924,"num_write_kb":450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"260'288","reported_seq":874,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.008854+0000","last_change":"2024-09-14T10:45:43.689500+0000","last_active":"2024-09-14T11:22:51.008854+0000","last_peered":"2024-09-14T11:22:51.008854+0000","last_clean":"2024-09-14T11:22:51.008854+0000","last_became_active":"2024-09-14T10:45:43.689186+0000","last_became_peered":"2024-09-14T10:45:43.689186+0000","last_unstale":"2024-09-14T11:22:51.008854+0000","last_undegraded":"2024-09-14T11:22:51.008854+0000","last_fullsized":"2024-09-14T11:22:51.008854+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:39.910157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6378836,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":438,"num_read_kb":44560,"num_write":917,"num_write_kb":69256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"260'1083","reported_seq":2821,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.337221+0000","last_change":"2024-09-14T10:45:45.720903+0000","last_active":"2024-09-14T11:21:28.337221+0000","last_peered":"2024-09-14T11:21:28.337221+0000","last_clean":"2024-09-14T11:21:28.337221+0000","last_became_active":"2024-09-14T10:45:45.720636+0000","last_became_peered":"2024-09-14T10:45:45.720636+0000","last_unstale":"2024-09-14T11:21:28.337221+0000","last_undegraded":"2024-09-14T11:21:28.337221+0000","last_fullsized":"2024-09-14T11:21:28.337221+0000","mapping_epoch":26,"log_start":"260'1000","ondisk_log_start":"260'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":1000,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:01:02.622281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5348,"num_read_kb":4870,"num_write":1559,"num_write_kb":616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"260'272","reported_seq":944,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:34.177202+0000","last_change":"2024-09-14T10:45:43.682868+0000","last_active":"2024-09-14T11:22:34.177202+0000","last_peered":"2024-09-14T11:22:34.177202+0000","last_clean":"2024-09-14T11:22:34.177202+0000","last_became_active":"2024-09-14T10:45:43.682573+0000","last_became_peered":"2024-09-14T10:45:43.682573+0000","last_unstale":"2024-09-14T11:22:34.177202+0000","last_undegraded":"2024-09-14T11:22:34.177202+0000","last_fullsized":"2024-09-14T11:22:34.177202+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:56.318257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5599748,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":743,"num_read_kb":3981,"num_write":964,"num_write_kb":35472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"260'303","reported_seq":931,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:26.983173+0000","last_change":"2024-09-14T10:45:43.673791+0000","last_active":"2024-09-14T11:21:26.983173+0000","last_peered":"2024-09-14T11:21:26.983173+0000","last_clean":"2024-09-14T11:21:26.983173+0000","last_became_active":"2024-09-14T10:45:43.673527+0000","last_became_peered":"2024-09-14T10:45:43.673527+0000","last_unstale":"2024-09-14T11:21:26.983173+0000","last_undegraded":"2024-09-14T11:21:26.983173+0000","last_fullsized":"2024-09-14T11:21:26.983173+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:05:57.311802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12972944,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":604,"num_read_kb":21996,"num_write":1143,"num_write_kb":25813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"260'1013","reported_seq":2612,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:16.297531+0000","last_change":"2024-09-14T10:45:45.724368+0000","last_active":"2024-09-14T11:21:16.297531+0000","last_peered":"2024-09-14T11:21:16.297531+0000","last_clean":"2024-09-14T11:21:16.297531+0000","last_became_active":"2024-09-14T10:45:45.724040+0000","last_became_peered":"2024-09-14T10:45:45.724040+0000","last_unstale":"2024-09-14T11:21:16.297531+0000","last_undegraded":"2024-09-14T11:21:16.297531+0000","last_fullsized":"2024-09-14T11:21:16.297531+0000","mapping_epoch":26,"log_start":"260'1000","ondisk_log_start":"260'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":1000,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:23.578632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4769,"num_read_kb":4210,"num_write":1424,"num_write_kb":631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"260'359","reported_seq":991,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.079003+0000","last_change":"2024-09-14T10:45:43.687437+0000","last_active":"2024-09-14T11:22:51.079003+0000","last_peered":"2024-09-14T11:22:51.079003+0000","last_clean":"2024-09-14T11:22:51.079003+0000","last_became_active":"2024-09-14T10:45:43.687162+0000","last_became_peered":"2024-09-14T10:45:43.687162+0000","last_unstale":"2024-09-14T11:22:51.079003+0000","last_undegraded":"2024-09-14T11:22:51.079003+0000","last_fullsized":"2024-09-14T11:22:51.079003+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:46.791778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5587407,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":643,"num_read_kb":37348,"num_write":1163,"num_write_kb":26064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"260'477","reported_seq":2017,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.049726+0000","last_change":"2024-09-14T10:45:45.712133+0000","last_active":"2024-09-14T11:21:27.049726+0000","last_peered":"2024-09-14T11:21:27.049726+0000","last_clean":"2024-09-14T11:21:27.049726+0000","last_became_active":"2024-09-14T10:45:45.711869+0000","last_became_peered":"2024-09-14T10:45:45.711869+0000","last_unstale":"2024-09-14T11:21:27.049726+0000","last_undegraded":"2024-09-14T11:21:27.049726+0000","last_fullsized":"2024-09-14T11:21:27.049726+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:06.317656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2555,"num_read_kb":2382,"num_write":592,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10817,"num_read_kb":8523,"num_write":3117,"num_write_kb":1010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1096,"ondisk_log_size":1096,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":14831,"num_objects":87,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":15133,"num_read_kb":14796,"num_write":17057,"num_write_kb":4975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":29662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1479,"ondisk_log_size":1479,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":767,"ondisk_log_size":767,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1769083,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":16792,"num_read_kb":34092,"num_write":14203,"num_write_kb":11560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2256896,"data_stored":1826876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2086,"ondisk_log_size":2086,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2399,"num_read_kb":2860,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":219533,"num_read_kb":201172,"num_write":55836,"num_write_kb":19050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":143,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4159,"ondisk_log_size":4159,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":419112220,"num_objects":3126,"num_object_clones":0,"num_object_copies":6252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3126,"num_whiteouts":0,"num_read":41304,"num_read_kb":2138030,"num_write":70355,"num_write_kb":2157996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":893042688,"data_stored":869394264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3978,"ondisk_log_size":3978,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":41542397,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":122,"num_read_kb":175817,"num_write":141,"num_write_kb":116354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73658368,"data_stored":73650820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81,"ondisk_log_size":81,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":56683470,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":119,"num_read_kb":174730,"num_write":141,"num_write_kb":116354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110227456,"data_stored":110224422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81,"ondisk_log_size":81,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509894,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":431088,"kb_used_data":237472,"kb_used_omap":1,"kb_used_meta":193598,"kb_avail":93940752,"statfs":{"total":96636764160,"available":96195330048,"internally_reserved":0,"allocated":243171328,"data_stored":236611721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":198244807},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509892,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":420236,"kb_used_data":150268,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":93951604,"statfs":{"total":96636764160,"available":96206442496,"internally_reserved":0,"allocated":153874432,"data_stored":148836196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":276429253},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509891,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284676,"kb_used_data":199412,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94087164,"statfs":{"total":96636764160,"available":96345255936,"internally_reserved":0,"allocated":204197888,"data_stored":197333461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542597,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":319504,"kb_used_data":99536,"kb_used_omap":1,"kb_used_meta":219902,"kb_avail":94052336,"statfs":{"total":96636764160,"available":96309592064,"internally_reserved":0,"allocated":101924864,"data_stored":98410709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":225180106},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542597,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":222068,"kb_used_data":128484,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94149772,"statfs":{"total":96636764160,"available":96409366528,"internally_reserved":0,"allocated":131567616,"data_stored":127010417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":95812038},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542599,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":413032,"kb_used_data":157016,"kb_used_omap":1,"kb_used_meta":255998,"kb_avail":93958808,"statfs":{"total":96636764160,"available":96213819392,"internally_reserved":0,"allocated":160784384,"data_stored":154528840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":262142405},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542598,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":262796,"kb_used_data":83120,"kb_used_omap":1,"kb_used_meta":179646,"kb_avail":94109044,"statfs":{"total":96636764160,"available":96367661056,"internally_reserved":0,"allocated":85114880,"data_stored":82138617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":183957957},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575301,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":362112,"kb_used_data":250416,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94009728,"statfs":{"total":96636764160,"available":96265961472,"internally_reserved":0,"allocated":256425984,"data_stored":250268894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":164352000,"data_stored":159069268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":128159744,"data_stored":124666590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":220647424,"data_stored":216021462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":208883712,"data_stored":203865931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45891584,"data_stored":44693796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25268224,"data_stored":23772093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":51146752,"data_stored":49646570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":48693248,"data_stored":47658554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":569344,"data_stored":474626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":472745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":127276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":263709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":46022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":188416,"data_stored":140872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":176128,"data_stored":133606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":212992,"data_stored":168020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":5195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9498624,"data_stored":9497550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":17887232,"data_stored":17886158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":26214400,"data_stored":26214400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3145728,"data_stored":3145728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6295552,"data_stored":6294666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":26218496,"data_stored":26217604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3149824,"data_stored":3148938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5832704,"data_stored":5830447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":13631488,"data_stored":13631488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3792896,"data_stored":3790457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":9498624,"data_stored":9497550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:22:51.898 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:22:52.235 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:22:52.246 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-09-14T11:22:52.248 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":1376,"stamp":"2024-09-14T11:22:51.756586+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":519714181,"num_objects":3605,"num_object_clones":0,"num_object_copies":7210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3605,"num_whiteouts":0,"num_read":306297,"num_read_kb":2750087,"num_write":160993,"num_write_kb":2428955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":190,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13820,"ondisk_log_size":13820,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2715512,"kb_used_data":1305724,"kb_used_omap":12,"kb_used_meta":1409587,"kb_avail":752259208,"statfs":{"total":773094113280,"available":770313428992,"internally_reserved":0,"allocated":1337061376,"data_stored":1295138855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1443417648},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-173140695,"num_objects":-1245,"num_object_clones":0,"num_object_copies":-2490,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1245,"num_whiteouts":0,"num_read":1843,"num_read_kb":2084,"num_write":1435,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004691"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:12.205144+0000","last_change":"2024-09-14T11:11:42.593208+0000","last_active":"2024-09-14T11:19:12.205144+0000","last_peered":"2024-09-14T11:19:12.205144+0000","last_clean":"2024-09-14T11:19:12.205144+0000","last_became_active":"2024-09-14T11:11:42.592933+0000","last_became_peered":"2024-09-14T11:11:42.592933+0000","last_unstale":"2024-09-14T11:19:12.205144+0000","last_undegraded":"2024-09-14T11:19:12.205144+0000","last_fullsized":"2024-09-14T11:19:12.205144+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:50.427016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"260'1","reported_seq":30,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:57.106396+0000","last_change":"2024-09-14T11:01:23.882191+0000","last_active":"2024-09-14T11:18:57.106396+0000","last_peered":"2024-09-14T11:18:57.106396+0000","last_clean":"2024-09-14T11:18:57.106396+0000","last_became_active":"2024-09-14T11:01:23.881902+0000","last_became_peered":"2024-09-14T11:01:23.881902+0000","last_unstale":"2024-09-14T11:18:57.106396+0000","last_undegraded":"2024-09-14T11:18:57.106396+0000","last_fullsized":"2024-09-14T11:18:57.106396+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:46.612242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"260'7","reported_seq":50,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:50.986936+0000","last_change":"2024-09-14T11:01:20.867414+0000","last_active":"2024-09-14T11:18:50.986936+0000","last_peered":"2024-09-14T11:18:50.986936+0000","last_clean":"2024-09-14T11:18:50.986936+0000","last_became_active":"2024-09-14T11:01:20.867142+0000","last_became_peered":"2024-09-14T11:01:20.867142+0000","last_unstale":"2024-09-14T11:18:50.986936+0000","last_undegraded":"2024-09-14T11:18:50.986936+0000","last_fullsized":"2024-09-14T11:18:50.986936+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:51.245462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":17,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"260'30","reported_seq":123,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:41.126104+0000","last_change":"2024-09-14T10:59:48.417565+0000","last_active":"2024-09-14T11:20:41.126104+0000","last_peered":"2024-09-14T11:20:41.126104+0000","last_clean":"2024-09-14T11:20:41.126104+0000","last_became_active":"2024-09-14T10:59:48.416537+0000","last_became_peered":"2024-09-14T10:59:48.416537+0000","last_unstale":"2024-09-14T11:20:41.126104+0000","last_undegraded":"2024-09-14T11:20:41.126104+0000","last_fullsized":"2024-09-14T11:20:41.126104+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:15.136259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":249,"num_read_kb":173,"num_write":73,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:15.984097+0000","last_change":"2024-09-14T11:11:42.588136+0000","last_active":"2024-09-14T11:19:15.984097+0000","last_peered":"2024-09-14T11:19:15.984097+0000","last_clean":"2024-09-14T11:19:15.984097+0000","last_became_active":"2024-09-14T11:11:42.587818+0000","last_became_peered":"2024-09-14T11:11:42.587818+0000","last_unstale":"2024-09-14T11:19:15.984097+0000","last_undegraded":"2024-09-14T11:19:15.984097+0000","last_fullsized":"2024-09-14T11:19:15.984097+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:37.528920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"260'1","reported_seq":29,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:54.982834+0000","last_change":"2024-09-14T11:01:23.881376+0000","last_active":"2024-09-14T11:18:54.982834+0000","last_peered":"2024-09-14T11:18:54.982834+0000","last_clean":"2024-09-14T11:18:54.982834+0000","last_became_active":"2024-09-14T11:01:23.881074+0000","last_became_peered":"2024-09-14T11:01:23.881074+0000","last_unstale":"2024-09-14T11:18:54.982834+0000","last_undegraded":"2024-09-14T11:18:54.982834+0000","last_fullsized":"2024-09-14T11:18:54.982834+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:53.183326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":571,"num_write":1,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"260'8","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:21.253973+0000","last_change":"2024-09-14T11:01:20.868669+0000","last_active":"2024-09-14T11:21:21.253973+0000","last_peered":"2024-09-14T11:21:21.253973+0000","last_clean":"2024-09-14T11:21:21.253973+0000","last_became_active":"2024-09-14T11:01:20.868373+0000","last_became_peered":"2024-09-14T11:01:20.868373+0000","last_unstale":"2024-09-14T11:21:21.253973+0000","last_undegraded":"2024-09-14T11:21:21.253973+0000","last_fullsized":"2024-09-14T11:21:21.253973+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:33:49.244253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10811,"num_write":13,"num_write_kb":10811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"260'56","reported_seq":195,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:56.120455+0000","last_change":"2024-09-14T10:59:48.416508+0000","last_active":"2024-09-14T11:19:56.120455+0000","last_peered":"2024-09-14T11:19:56.120455+0000","last_clean":"2024-09-14T11:19:56.120455+0000","last_became_active":"2024-09-14T10:59:48.416222+0000","last_became_peered":"2024-09-14T10:59:48.416222+0000","last_unstale":"2024-09-14T11:19:56.120455+0000","last_undegraded":"2024-09-14T11:19:56.120455+0000","last_fullsized":"2024-09-14T11:19:56.120455+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:30.061341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":447,"num_read_kb":304,"num_write":135,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:57.106315+0000","last_change":"2024-09-14T11:11:42.593589+0000","last_active":"2024-09-14T11:18:57.106315+0000","last_peered":"2024-09-14T11:18:57.106315+0000","last_clean":"2024-09-14T11:18:57.106315+0000","last_became_active":"2024-09-14T11:11:42.593314+0000","last_became_peered":"2024-09-14T11:11:42.593314+0000","last_unstale":"2024-09-14T11:18:57.106315+0000","last_undegraded":"2024-09-14T11:18:57.106315+0000","last_fullsized":"2024-09-14T11:18:57.106315+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:49.061960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"260'3","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:16.262309+0000","last_change":"2024-09-14T11:01:23.893105+0000","last_active":"2024-09-14T11:22:16.262309+0000","last_peered":"2024-09-14T11:22:16.262309+0000","last_clean":"2024-09-14T11:22:16.262309+0000","last_became_active":"2024-09-14T11:01:23.892846+0000","last_became_peered":"2024-09-14T11:01:23.892846+0000","last_unstale":"2024-09-14T11:22:16.262309+0000","last_undegraded":"2024-09-14T11:22:16.262309+0000","last_fullsized":"2024-09-14T11:22:16.262309+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:50.339780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"260'1","reported_seq":37,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:25.992278+0000","last_change":"2024-09-14T11:01:20.864944+0000","last_active":"2024-09-14T11:19:25.992278+0000","last_peered":"2024-09-14T11:19:25.992278+0000","last_clean":"2024-09-14T11:19:25.992278+0000","last_became_active":"2024-09-14T11:01:20.864672+0000","last_became_peered":"2024-09-14T11:01:20.864672+0000","last_unstale":"2024-09-14T11:19:25.992278+0000","last_undegraded":"2024-09-14T11:19:25.992278+0000","last_fullsized":"2024-09-14T11:19:25.992278+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:06.369402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"260'48","reported_seq":168,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:50.988603+0000","last_change":"2024-09-14T10:59:48.419842+0000","last_active":"2024-09-14T11:19:50.988603+0000","last_peered":"2024-09-14T11:19:50.988603+0000","last_clean":"2024-09-14T11:19:50.988603+0000","last_became_active":"2024-09-14T10:59:48.419525+0000","last_became_peered":"2024-09-14T10:59:48.419525+0000","last_unstale":"2024-09-14T11:19:50.988603+0000","last_undegraded":"2024-09-14T11:19:50.988603+0000","last_fullsized":"2024-09-14T11:19:50.988603+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:04.024597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":364,"num_read_kb":247,"num_write":125,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:01.233674+0000","last_change":"2024-09-14T11:11:42.587584+0000","last_active":"2024-09-14T11:19:01.233674+0000","last_peered":"2024-09-14T11:19:01.233674+0000","last_clean":"2024-09-14T11:19:01.233674+0000","last_became_active":"2024-09-14T11:11:42.587218+0000","last_became_peered":"2024-09-14T11:11:42.587218+0000","last_unstale":"2024-09-14T11:19:01.233674+0000","last_undegraded":"2024-09-14T11:19:01.233674+0000","last_fullsized":"2024-09-14T11:19:01.233674+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:55.734324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"260'1","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:26.237624+0000","last_change":"2024-09-14T11:01:23.887367+0000","last_active":"2024-09-14T11:19:26.237624+0000","last_peered":"2024-09-14T11:19:26.237624+0000","last_clean":"2024-09-14T11:19:26.237624+0000","last_became_active":"2024-09-14T11:01:23.886771+0000","last_became_peered":"2024-09-14T11:01:23.886771+0000","last_unstale":"2024-09-14T11:19:26.237624+0000","last_undegraded":"2024-09-14T11:19:26.237624+0000","last_fullsized":"2024-09-14T11:19:26.237624+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:15.920702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60366,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":118,"num_write":1,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"257'5","reported_seq":50,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:07.117403+0000","last_change":"2024-09-14T11:01:20.862128+0000","last_active":"2024-09-14T11:20:07.117403+0000","last_peered":"2024-09-14T11:20:07.117403+0000","last_clean":"2024-09-14T11:20:07.117403+0000","last_became_active":"2024-09-14T11:01:20.861799+0000","last_became_peered":"2024-09-14T11:01:20.861799+0000","last_unstale":"2024-09-14T11:20:07.117403+0000","last_undegraded":"2024-09-14T11:20:07.117403+0000","last_fullsized":"2024-09-14T11:20:07.117403+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:16.963059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"260'15","reported_seq":77,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:50.988580+0000","last_change":"2024-09-14T10:59:48.411700+0000","last_active":"2024-09-14T11:19:50.988580+0000","last_peered":"2024-09-14T11:19:50.988580+0000","last_clean":"2024-09-14T11:19:50.988580+0000","last_became_active":"2024-09-14T10:59:48.411423+0000","last_became_peered":"2024-09-14T10:59:48.411423+0000","last_unstale":"2024-09-14T11:19:50.988580+0000","last_undegraded":"2024-09-14T11:19:50.988580+0000","last_fullsized":"2024-09-14T11:19:50.988580+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:56.473790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":68,"num_write":41,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:50.995962+0000","last_change":"2024-09-14T11:11:42.584008+0000","last_active":"2024-09-14T11:19:50.995962+0000","last_peered":"2024-09-14T11:19:50.995962+0000","last_clean":"2024-09-14T11:19:50.995962+0000","last_became_active":"2024-09-14T11:11:42.583717+0000","last_became_peered":"2024-09-14T11:11:42.583717+0000","last_unstale":"2024-09-14T11:19:50.995962+0000","last_undegraded":"2024-09-14T11:19:50.995962+0000","last_fullsized":"2024-09-14T11:19:50.995962+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:22:54.043934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"257'3","reported_seq":33,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:22.197565+0000","last_change":"2024-09-14T11:01:23.894300+0000","last_active":"2024-09-14T11:18:22.197565+0000","last_peered":"2024-09-14T11:18:22.197565+0000","last_clean":"2024-09-14T11:18:22.197565+0000","last_became_active":"2024-09-14T11:01:23.894107+0000","last_became_peered":"2024-09-14T11:01:23.894107+0000","last_unstale":"2024-09-14T11:18:22.197565+0000","last_undegraded":"2024-09-14T11:18:22.197565+0000","last_fullsized":"2024-09-14T11:18:22.197565+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:41:19.577357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"260'6","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:41.248008+0000","last_change":"2024-09-14T11:01:20.868842+0000","last_active":"2024-09-14T11:20:41.248008+0000","last_peered":"2024-09-14T11:20:41.248008+0000","last_clean":"2024-09-14T11:20:41.248008+0000","last_became_active":"2024-09-14T11:01:20.867768+0000","last_became_peered":"2024-09-14T11:01:20.867768+0000","last_unstale":"2024-09-14T11:20:41.248008+0000","last_undegraded":"2024-09-14T11:20:41.248008+0000","last_fullsized":"2024-09-14T11:20:41.248008+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:10.338737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"260'40","reported_seq":146,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:50.988519+0000","last_change":"2024-09-14T10:59:48.413952+0000","last_active":"2024-09-14T11:19:50.988519+0000","last_peered":"2024-09-14T11:19:50.988519+0000","last_clean":"2024-09-14T11:19:50.988519+0000","last_became_active":"2024-09-14T10:59:48.413296+0000","last_became_peered":"2024-09-14T10:59:48.413296+0000","last_unstale":"2024-09-14T11:19:50.988519+0000","last_undegraded":"2024-09-14T11:19:50.988519+0000","last_fullsized":"2024-09-14T11:19:50.988519+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:50.801079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":304,"num_read_kb":193,"num_write":101,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:06.121565+0000","last_change":"2024-09-14T11:11:42.582601+0000","last_active":"2024-09-14T11:20:06.121565+0000","last_peered":"2024-09-14T11:20:06.121565+0000","last_clean":"2024-09-14T11:20:06.121565+0000","last_became_active":"2024-09-14T11:11:42.582310+0000","last_became_peered":"2024-09-14T11:11:42.582310+0000","last_unstale":"2024-09-14T11:20:06.121565+0000","last_undegraded":"2024-09-14T11:20:06.121565+0000","last_fullsized":"2024-09-14T11:20:06.121565+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:47:53.329342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"260'7","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:22.101583+0000","last_change":"2024-09-14T11:01:23.888252+0000","last_active":"2024-09-14T11:18:22.101583+0000","last_peered":"2024-09-14T11:18:22.101583+0000","last_clean":"2024-09-14T11:18:22.101583+0000","last_became_active":"2024-09-14T11:01:23.888017+0000","last_became_peered":"2024-09-14T11:01:23.888017+0000","last_unstale":"2024-09-14T11:18:22.101583+0000","last_undegraded":"2024-09-14T11:18:22.101583+0000","last_fullsized":"2024-09-14T11:18:22.101583+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:57.684875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":11264,"num_write":17,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"257'2","reported_seq":37,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:22.101658+0000","last_change":"2024-09-14T11:01:20.863609+0000","last_active":"2024-09-14T11:18:22.101658+0000","last_peered":"2024-09-14T11:18:22.101658+0000","last_clean":"2024-09-14T11:18:22.101658+0000","last_became_active":"2024-09-14T11:01:20.863258+0000","last_became_peered":"2024-09-14T11:01:20.863258+0000","last_unstale":"2024-09-14T11:18:22.101658+0000","last_undegraded":"2024-09-14T11:18:22.101658+0000","last_fullsized":"2024-09-14T11:18:22.101658+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:55.353304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"260'62","reported_seq":215,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:18.893367+0000","last_change":"2024-09-14T10:59:48.420297+0000","last_active":"2024-09-14T11:20:18.893367+0000","last_peered":"2024-09-14T11:20:18.893367+0000","last_clean":"2024-09-14T11:20:18.893367+0000","last_became_active":"2024-09-14T10:59:48.419994+0000","last_became_peered":"2024-09-14T10:59:48.419994+0000","last_unstale":"2024-09-14T11:20:18.893367+0000","last_undegraded":"2024-09-14T11:20:18.893367+0000","last_fullsized":"2024-09-14T11:20:18.893367+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:48.789488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":520,"num_read_kb":329,"num_write":161,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"260'1","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:14.986121+0000","last_change":"2024-09-14T11:11:42.588572+0000","last_active":"2024-09-14T11:19:14.986121+0000","last_peered":"2024-09-14T11:19:14.986121+0000","last_clean":"2024-09-14T11:19:14.986121+0000","last_became_active":"2024-09-14T11:11:42.588308+0000","last_became_peered":"2024-09-14T11:11:42.588308+0000","last_unstale":"2024-09-14T11:19:14.986121+0000","last_undegraded":"2024-09-14T11:19:14.986121+0000","last_fullsized":"2024-09-14T11:19:14.986121+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:38:16.020344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:54.982805+0000","last_change":"2024-09-14T11:01:23.884550+0000","last_active":"2024-09-14T11:18:54.982805+0000","last_peered":"2024-09-14T11:18:54.982805+0000","last_clean":"2024-09-14T11:18:54.982805+0000","last_became_active":"2024-09-14T11:01:23.884138+0000","last_became_peered":"2024-09-14T11:01:23.884138+0000","last_unstale":"2024-09-14T11:18:54.982805+0000","last_undegraded":"2024-09-14T11:18:54.982805+0000","last_fullsized":"2024-09-14T11:18:54.982805+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:10.655429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":33,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:52.202212+0000","last_change":"2024-09-14T11:01:20.855022+0000","last_active":"2024-09-14T11:18:52.202212+0000","last_peered":"2024-09-14T11:18:52.202212+0000","last_clean":"2024-09-14T11:18:52.202212+0000","last_became_active":"2024-09-14T11:01:20.854737+0000","last_became_peered":"2024-09-14T11:01:20.854737+0000","last_unstale":"2024-09-14T11:18:52.202212+0000","last_undegraded":"2024-09-14T11:18:52.202212+0000","last_fullsized":"2024-09-14T11:18:52.202212+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:43.045693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"260'45","reported_seq":163,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:20.991333+0000","last_change":"2024-09-14T10:59:48.420289+0000","last_active":"2024-09-14T11:19:20.991333+0000","last_peered":"2024-09-14T11:19:20.991333+0000","last_clean":"2024-09-14T11:19:20.991333+0000","last_became_active":"2024-09-14T10:59:48.419091+0000","last_became_peered":"2024-09-14T10:59:48.419091+0000","last_unstale":"2024-09-14T11:19:20.991333+0000","last_undegraded":"2024-09-14T11:19:20.991333+0000","last_fullsized":"2024-09-14T11:19:20.991333+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:35.387602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":368,"num_read_kb":243,"num_write":109,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:12.205201+0000","last_change":"2024-09-14T11:11:42.583176+0000","last_active":"2024-09-14T11:19:12.205201+0000","last_peered":"2024-09-14T11:19:12.205201+0000","last_clean":"2024-09-14T11:19:12.205201+0000","last_became_active":"2024-09-14T11:11:42.582899+0000","last_became_peered":"2024-09-14T11:11:42.582899+0000","last_unstale":"2024-09-14T11:19:12.205201+0000","last_undegraded":"2024-09-14T11:19:12.205201+0000","last_fullsized":"2024-09-14T11:19:12.205201+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:00.902463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:55.987589+0000","last_change":"2024-09-14T11:01:23.895643+0000","last_active":"2024-09-14T11:18:55.987589+0000","last_peered":"2024-09-14T11:18:55.987589+0000","last_clean":"2024-09-14T11:18:55.987589+0000","last_became_active":"2024-09-14T11:01:23.894587+0000","last_became_peered":"2024-09-14T11:01:23.894587+0000","last_unstale":"2024-09-14T11:18:55.987589+0000","last_undegraded":"2024-09-14T11:18:55.987589+0000","last_fullsized":"2024-09-14T11:18:55.987589+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:29.534046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"260'2","reported_seq":37,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:50.980652+0000","last_change":"2024-09-14T11:01:20.869542+0000","last_active":"2024-09-14T11:18:50.980652+0000","last_peered":"2024-09-14T11:18:50.980652+0000","last_clean":"2024-09-14T11:18:50.980652+0000","last_became_active":"2024-09-14T11:01:20.869244+0000","last_became_peered":"2024-09-14T11:01:20.869244+0000","last_unstale":"2024-09-14T11:18:50.980652+0000","last_undegraded":"2024-09-14T11:18:50.980652+0000","last_fullsized":"2024-09-14T11:18:50.980652+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:58.638874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"260'35","reported_seq":137,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:58.204964+0000","last_change":"2024-09-14T10:59:48.414261+0000","last_active":"2024-09-14T11:20:58.204964+0000","last_peered":"2024-09-14T11:20:58.204964+0000","last_clean":"2024-09-14T11:20:58.204964+0000","last_became_active":"2024-09-14T10:59:48.414023+0000","last_became_peered":"2024-09-14T10:59:48.414023+0000","last_unstale":"2024-09-14T11:20:58.204964+0000","last_undegraded":"2024-09-14T11:20:58.204964+0000","last_fullsized":"2024-09-14T11:20:58.204964+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:32.125339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":284,"num_read_kb":189,"num_write":86,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:46.231489+0000","last_change":"2024-09-14T11:11:42.592957+0000","last_active":"2024-09-14T11:18:46.231489+0000","last_peered":"2024-09-14T11:18:46.231489+0000","last_clean":"2024-09-14T11:18:46.231489+0000","last_became_active":"2024-09-14T11:11:42.592439+0000","last_became_peered":"2024-09-14T11:11:42.592439+0000","last_unstale":"2024-09-14T11:18:46.231489+0000","last_undegraded":"2024-09-14T11:18:46.231489+0000","last_fullsized":"2024-09-14T11:18:46.231489+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:56:15.581964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"257'3","reported_seq":33,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:20.982723+0000","last_change":"2024-09-14T11:01:23.892350+0000","last_active":"2024-09-14T11:18:20.982723+0000","last_peered":"2024-09-14T11:18:20.982723+0000","last_clean":"2024-09-14T11:18:20.982723+0000","last_became_active":"2024-09-14T11:01:23.891631+0000","last_became_peered":"2024-09-14T11:01:23.891631+0000","last_unstale":"2024-09-14T11:18:20.982723+0000","last_undegraded":"2024-09-14T11:18:20.982723+0000","last_fullsized":"2024-09-14T11:18:20.982723+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:58:22.810241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"260'9","reported_seq":53,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:07.117695+0000","last_change":"2024-09-14T11:01:20.861317+0000","last_active":"2024-09-14T11:20:07.117695+0000","last_peered":"2024-09-14T11:20:07.117695+0000","last_clean":"2024-09-14T11:20:07.117695+0000","last_became_active":"2024-09-14T11:01:20.861043+0000","last_became_peered":"2024-09-14T11:01:20.861043+0000","last_unstale":"2024-09-14T11:20:07.117695+0000","last_undegraded":"2024-09-14T11:20:07.117695+0000","last_fullsized":"2024-09-14T11:20:07.117695+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:42.808761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":17410,"num_write":19,"num_write_kb":12290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"260'250","reported_seq":795,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:11.113999+0000","last_change":"2024-09-14T10:59:48.417407+0000","last_active":"2024-09-14T11:19:11.113999+0000","last_peered":"2024-09-14T11:19:11.113999+0000","last_clean":"2024-09-14T11:19:11.113999+0000","last_became_active":"2024-09-14T10:59:48.416342+0000","last_became_peered":"2024-09-14T10:59:48.416342+0000","last_unstale":"2024-09-14T11:19:11.113999+0000","last_undegraded":"2024-09-14T11:19:11.113999+0000","last_fullsized":"2024-09-14T11:19:11.113999+0000","mapping_epoch":249,"log_start":"257'200","ondisk_log_start":"257'200","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:56:03.687626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2428,"num_read_kb":2819,"num_write":491,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"260'1","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:45.979906+0000","last_change":"2024-09-14T11:11:42.588570+0000","last_active":"2024-09-14T11:18:45.979906+0000","last_peered":"2024-09-14T11:18:45.979906+0000","last_clean":"2024-09-14T11:18:45.979906+0000","last_became_active":"2024-09-14T11:11:42.587835+0000","last_became_peered":"2024-09-14T11:11:42.587835+0000","last_unstale":"2024-09-14T11:18:45.979906+0000","last_undegraded":"2024-09-14T11:18:45.979906+0000","last_fullsized":"2024-09-14T11:18:45.979906+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:05.008377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"260'2","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:06.243716+0000","last_change":"2024-09-14T11:01:23.895555+0000","last_active":"2024-09-14T11:20:06.243716+0000","last_peered":"2024-09-14T11:20:06.243716+0000","last_clean":"2024-09-14T11:20:06.243716+0000","last_became_active":"2024-09-14T11:01:23.892735+0000","last_became_peered":"2024-09-14T11:01:23.892735+0000","last_unstale":"2024-09-14T11:20:06.243716+0000","last_undegraded":"2024-09-14T11:20:06.243716+0000","last_fullsized":"2024-09-14T11:20:06.243716+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:20.552471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"260'3","reported_seq":39,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:17.197007+0000","last_change":"2024-09-14T11:01:20.860826+0000","last_active":"2024-09-14T11:18:17.197007+0000","last_peered":"2024-09-14T11:18:17.197007+0000","last_clean":"2024-09-14T11:18:17.197007+0000","last_became_active":"2024-09-14T11:01:20.860541+0000","last_became_peered":"2024-09-14T11:01:20.860541+0000","last_unstale":"2024-09-14T11:18:17.197007+0000","last_undegraded":"2024-09-14T11:18:17.197007+0000","last_fullsized":"2024-09-14T11:18:17.197007+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:08.358758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60366,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":61,"num_write":3,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"260'12","reported_seq":76,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:11.113972+0000","last_change":"2024-09-14T10:59:48.417263+0000","last_active":"2024-09-14T11:19:11.113972+0000","last_peered":"2024-09-14T11:19:11.113972+0000","last_clean":"2024-09-14T11:19:11.113972+0000","last_became_active":"2024-09-14T10:59:48.417001+0000","last_became_peered":"2024-09-14T10:59:48.417001+0000","last_unstale":"2024-09-14T11:19:11.113972+0000","last_undegraded":"2024-09-14T11:19:11.113972+0000","last_fullsized":"2024-09-14T11:19:11.113972+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:24.272836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":70,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:44.981269+0000","last_change":"2024-09-14T11:11:42.594143+0000","last_active":"2024-09-14T11:18:44.981269+0000","last_peered":"2024-09-14T11:18:44.981269+0000","last_clean":"2024-09-14T11:18:44.981269+0000","last_became_active":"2024-09-14T11:11:42.593873+0000","last_became_peered":"2024-09-14T11:11:42.593873+0000","last_unstale":"2024-09-14T11:18:44.981269+0000","last_undegraded":"2024-09-14T11:18:44.981269+0000","last_fullsized":"2024-09-14T11:18:44.981269+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:38.408015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:20.982781+0000","last_change":"2024-09-14T11:01:23.897460+0000","last_active":"2024-09-14T11:18:20.982781+0000","last_peered":"2024-09-14T11:18:20.982781+0000","last_clean":"2024-09-14T11:18:20.982781+0000","last_became_active":"2024-09-14T11:01:23.897154+0000","last_became_peered":"2024-09-14T11:01:23.897154+0000","last_unstale":"2024-09-14T11:18:20.982781+0000","last_undegraded":"2024-09-14T11:18:20.982781+0000","last_fullsized":"2024-09-14T11:18:20.982781+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:57.444749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"260'2","reported_seq":36,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:41.002355+0000","last_change":"2024-09-14T11:01:20.868430+0000","last_active":"2024-09-14T11:20:41.002355+0000","last_peered":"2024-09-14T11:20:41.002355+0000","last_clean":"2024-09-14T11:20:41.002355+0000","last_became_active":"2024-09-14T11:01:20.868135+0000","last_became_peered":"2024-09-14T11:01:20.868135+0000","last_unstale":"2024-09-14T11:20:41.002355+0000","last_undegraded":"2024-09-14T11:20:41.002355+0000","last_fullsized":"2024-09-14T11:20:41.002355+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:11:52.977202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"260'27","reported_seq":113,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:18.260492+0000","last_change":"2024-09-14T10:59:48.415592+0000","last_active":"2024-09-14T11:20:18.260492+0000","last_peered":"2024-09-14T11:20:18.260492+0000","last_clean":"2024-09-14T11:20:18.260492+0000","last_became_active":"2024-09-14T10:59:48.415324+0000","last_became_peered":"2024-09-14T10:59:48.415324+0000","last_unstale":"2024-09-14T11:20:18.260492+0000","last_undegraded":"2024-09-14T11:20:18.260492+0000","last_fullsized":"2024-09-14T11:20:18.260492+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:36:02.358205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":136,"num_write":70,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:42.200860+0000","last_change":"2024-09-14T11:11:42.592101+0000","last_active":"2024-09-14T11:18:42.200860+0000","last_peered":"2024-09-14T11:18:42.200860+0000","last_clean":"2024-09-14T11:18:42.200860+0000","last_became_active":"2024-09-14T11:11:42.591815+0000","last_became_peered":"2024-09-14T11:11:42.591815+0000","last_unstale":"2024-09-14T11:18:42.200860+0000","last_undegraded":"2024-09-14T11:18:42.200860+0000","last_fullsized":"2024-09-14T11:18:42.200860+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:44:10.362312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"260'2","reported_seq":33,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:22.197640+0000","last_change":"2024-09-14T11:01:23.884051+0000","last_active":"2024-09-14T11:18:22.197640+0000","last_peered":"2024-09-14T11:18:22.197640+0000","last_clean":"2024-09-14T11:18:22.197640+0000","last_became_active":"2024-09-14T11:01:23.883763+0000","last_became_peered":"2024-09-14T11:01:23.883763+0000","last_unstale":"2024-09-14T11:18:22.197640+0000","last_undegraded":"2024-09-14T11:18:22.197640+0000","last_fullsized":"2024-09-14T11:18:22.197640+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:48:45.773610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"260'3","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:16.227393+0000","last_change":"2024-09-14T11:01:20.867156+0000","last_active":"2024-09-14T11:18:16.227393+0000","last_peered":"2024-09-14T11:18:16.227393+0000","last_clean":"2024-09-14T11:18:16.227393+0000","last_became_active":"2024-09-14T11:01:20.866642+0000","last_became_peered":"2024-09-14T11:01:20.866642+0000","last_unstale":"2024-09-14T11:18:16.227393+0000","last_undegraded":"2024-09-14T11:18:16.227393+0000","last_fullsized":"2024-09-14T11:18:16.227393+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:38.426384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":13312,"num_write":8,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"260'32","reported_seq":127,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:37.104014+0000","last_change":"2024-09-14T10:59:48.418606+0000","last_active":"2024-09-14T11:18:37.104014+0000","last_peered":"2024-09-14T11:18:37.104014+0000","last_clean":"2024-09-14T11:18:37.104014+0000","last_became_active":"2024-09-14T10:59:48.418305+0000","last_became_peered":"2024-09-14T10:59:48.418305+0000","last_unstale":"2024-09-14T11:18:37.104014+0000","last_undegraded":"2024-09-14T11:18:37.104014+0000","last_fullsized":"2024-09-14T11:18:37.104014+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:31:32.726408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":251,"num_read_kb":158,"num_write":84,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:01.233757+0000","last_change":"2024-09-14T11:11:42.588989+0000","last_active":"2024-09-14T11:19:01.233757+0000","last_peered":"2024-09-14T11:19:01.233757+0000","last_clean":"2024-09-14T11:19:01.233757+0000","last_became_active":"2024-09-14T11:11:42.588573+0000","last_became_peered":"2024-09-14T11:11:42.588573+0000","last_unstale":"2024-09-14T11:19:01.233757+0000","last_undegraded":"2024-09-14T11:19:01.233757+0000","last_fullsized":"2024-09-14T11:19:01.233757+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:44.929396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:06.243683+0000","last_change":"2024-09-14T11:01:23.895357+0000","last_active":"2024-09-14T11:20:06.243683+0000","last_peered":"2024-09-14T11:20:06.243683+0000","last_clean":"2024-09-14T11:20:06.243683+0000","last_became_active":"2024-09-14T11:01:23.894751+0000","last_became_peered":"2024-09-14T11:01:23.894751+0000","last_unstale":"2024-09-14T11:20:06.243683+0000","last_undegraded":"2024-09-14T11:20:06.243683+0000","last_fullsized":"2024-09-14T11:20:06.243683+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:22:05.395992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:02.116671+0000","last_change":"2024-09-14T11:01:20.867415+0000","last_active":"2024-09-14T11:20:02.116671+0000","last_peered":"2024-09-14T11:20:02.116671+0000","last_clean":"2024-09-14T11:20:02.116671+0000","last_became_active":"2024-09-14T11:01:20.866975+0000","last_became_peered":"2024-09-14T11:01:20.866975+0000","last_unstale":"2024-09-14T11:20:02.116671+0000","last_undegraded":"2024-09-14T11:20:02.116671+0000","last_fullsized":"2024-09-14T11:20:02.116671+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:47.822855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"260'17","reported_seq":82,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:32.103148+0000","last_change":"2024-09-14T10:59:48.421015+0000","last_active":"2024-09-14T11:18:32.103148+0000","last_peered":"2024-09-14T11:18:32.103148+0000","last_clean":"2024-09-14T11:18:32.103148+0000","last_became_active":"2024-09-14T10:59:48.420711+0000","last_became_peered":"2024-09-14T10:59:48.420711+0000","last_unstale":"2024-09-14T11:18:32.103148+0000","last_undegraded":"2024-09-14T11:18:32.103148+0000","last_fullsized":"2024-09-14T11:18:32.103148+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:14:06.864641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":78,"num_write":43,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:00.982102+0000","last_change":"2024-09-14T11:11:42.585332+0000","last_active":"2024-09-14T11:19:00.982102+0000","last_peered":"2024-09-14T11:19:00.982102+0000","last_clean":"2024-09-14T11:19:00.982102+0000","last_became_active":"2024-09-14T11:11:42.583965+0000","last_became_peered":"2024-09-14T11:11:42.583965+0000","last_unstale":"2024-09-14T11:19:00.982102+0000","last_undegraded":"2024-09-14T11:19:00.982102+0000","last_fullsized":"2024-09-14T11:19:00.982102+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:45:52.531506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"257'5","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:06.243650+0000","last_change":"2024-09-14T11:01:23.893658+0000","last_active":"2024-09-14T11:20:06.243650+0000","last_peered":"2024-09-14T11:20:06.243650+0000","last_clean":"2024-09-14T11:20:06.243650+0000","last_became_active":"2024-09-14T11:01:23.893365+0000","last_became_peered":"2024-09-14T11:01:23.893365+0000","last_unstale":"2024-09-14T11:20:06.243650+0000","last_undegraded":"2024-09-14T11:20:06.243650+0000","last_fullsized":"2024-09-14T11:20:06.243650+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:10:44.395112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"260'3","reported_seq":37,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:21.262930+0000","last_change":"2024-09-14T11:01:20.869472+0000","last_active":"2024-09-14T11:22:21.262930+0000","last_peered":"2024-09-14T11:22:21.262930+0000","last_clean":"2024-09-14T11:22:21.262930+0000","last_became_active":"2024-09-14T11:01:20.869209+0000","last_became_peered":"2024-09-14T11:01:20.869209+0000","last_unstale":"2024-09-14T11:22:21.262930+0000","last_undegraded":"2024-09-14T11:22:21.262930+0000","last_fullsized":"2024-09-14T11:22:21.262930+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:54.924564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"260'35","reported_seq":136,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:00.389953+0000","last_change":"2024-09-14T10:59:48.416424+0000","last_active":"2024-09-14T11:21:00.389953+0000","last_peered":"2024-09-14T11:21:00.389953+0000","last_clean":"2024-09-14T11:21:00.389953+0000","last_became_active":"2024-09-14T10:59:48.416149+0000","last_became_peered":"2024-09-14T10:59:48.416149+0000","last_unstale":"2024-09-14T11:21:00.389953+0000","last_undegraded":"2024-09-14T11:21:00.389953+0000","last_fullsized":"2024-09-14T11:21:00.389953+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:12.463862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":285,"num_read_kb":193,"num_write":82,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"259'1","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:46.110446+0000","last_change":"2024-09-14T11:11:42.584334+0000","last_active":"2024-09-14T11:18:46.110446+0000","last_peered":"2024-09-14T11:18:46.110446+0000","last_clean":"2024-09-14T11:18:46.110446+0000","last_became_active":"2024-09-14T11:11:42.583477+0000","last_became_peered":"2024-09-14T11:11:42.583477+0000","last_unstale":"2024-09-14T11:18:46.110446+0000","last_undegraded":"2024-09-14T11:18:46.110446+0000","last_fullsized":"2024-09-14T11:18:46.110446+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:34.189340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"260'8","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:26.017279+0000","last_change":"2024-09-14T11:01:23.891615+0000","last_active":"2024-09-14T11:22:26.017279+0000","last_peered":"2024-09-14T11:22:26.017279+0000","last_clean":"2024-09-14T11:22:26.017279+0000","last_became_active":"2024-09-14T11:01:23.891343+0000","last_became_peered":"2024-09-14T11:01:23.891343+0000","last_unstale":"2024-09-14T11:22:26.017279+0000","last_undegraded":"2024-09-14T11:22:26.017279+0000","last_fullsized":"2024-09-14T11:22:26.017279+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:37.853683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":15362,"num_write":13,"num_write_kb":10242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"260'2","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:02.116735+0000","last_change":"2024-09-14T11:01:20.862125+0000","last_active":"2024-09-14T11:20:02.116735+0000","last_peered":"2024-09-14T11:20:02.116735+0000","last_clean":"2024-09-14T11:20:02.116735+0000","last_became_active":"2024-09-14T11:01:20.861817+0000","last_became_peered":"2024-09-14T11:01:20.861817+0000","last_unstale":"2024-09-14T11:20:02.116735+0000","last_undegraded":"2024-09-14T11:20:02.116735+0000","last_fullsized":"2024-09-14T11:20:02.116735+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:55.520879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"260'106","reported_seq":361,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:29.979162+0000","last_change":"2024-09-14T10:59:48.418299+0000","last_active":"2024-09-14T11:18:29.979162+0000","last_peered":"2024-09-14T11:18:29.979162+0000","last_clean":"2024-09-14T11:18:29.979162+0000","last_became_active":"2024-09-14T10:59:48.418011+0000","last_became_peered":"2024-09-14T10:59:48.418011+0000","last_unstale":"2024-09-14T11:18:29.979162+0000","last_undegraded":"2024-09-14T11:18:29.979162+0000","last_fullsized":"2024-09-14T11:18:29.979162+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:53:09.804245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1045,"num_read_kb":858,"num_write":220,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"260'1","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:00.982068+0000","last_change":"2024-09-14T11:11:42.580964+0000","last_active":"2024-09-14T11:19:00.982068+0000","last_peered":"2024-09-14T11:19:00.982068+0000","last_clean":"2024-09-14T11:19:00.982068+0000","last_became_active":"2024-09-14T11:11:42.580611+0000","last_became_peered":"2024-09-14T11:11:42.580611+0000","last_unstale":"2024-09-14T11:19:00.982068+0000","last_undegraded":"2024-09-14T11:19:00.982068+0000","last_fullsized":"2024-09-14T11:19:00.982068+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:24.715816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:07.117668+0000","last_change":"2024-09-14T11:01:23.886701+0000","last_active":"2024-09-14T11:20:07.117668+0000","last_peered":"2024-09-14T11:20:07.117668+0000","last_clean":"2024-09-14T11:20:07.117668+0000","last_became_active":"2024-09-14T11:01:23.886496+0000","last_became_peered":"2024-09-14T11:01:23.886496+0000","last_unstale":"2024-09-14T11:20:07.117668+0000","last_undegraded":"2024-09-14T11:20:07.117668+0000","last_fullsized":"2024-09-14T11:20:07.117668+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:46.277781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"257'3","reported_seq":40,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:02.116770+0000","last_change":"2024-09-14T11:01:20.863982+0000","last_active":"2024-09-14T11:20:02.116770+0000","last_peered":"2024-09-14T11:20:02.116770+0000","last_clean":"2024-09-14T11:20:02.116770+0000","last_became_active":"2024-09-14T11:01:20.863707+0000","last_became_peered":"2024-09-14T11:01:20.863707+0000","last_unstale":"2024-09-14T11:20:02.116770+0000","last_undegraded":"2024-09-14T11:20:02.116770+0000","last_fullsized":"2024-09-14T11:20:02.116770+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:40.633016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"260'54","reported_seq":190,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:29.870970+0000","last_change":"2024-09-14T10:59:48.422151+0000","last_active":"2024-09-14T11:20:29.870970+0000","last_peered":"2024-09-14T11:20:29.870970+0000","last_clean":"2024-09-14T11:20:29.870970+0000","last_became_active":"2024-09-14T10:59:48.421875+0000","last_became_peered":"2024-09-14T10:59:48.421875+0000","last_unstale":"2024-09-14T11:20:29.870970+0000","last_undegraded":"2024-09-14T11:20:29.870970+0000","last_fullsized":"2024-09-14T11:20:29.870970+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:45.174950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":456,"num_read_kb":308,"num_write":139,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:26.246099+0000","last_change":"2024-09-14T11:11:42.590323+0000","last_active":"2024-09-14T11:20:26.246099+0000","last_peered":"2024-09-14T11:20:26.246099+0000","last_clean":"2024-09-14T11:20:26.246099+0000","last_became_active":"2024-09-14T11:11:42.590056+0000","last_became_peered":"2024-09-14T11:11:42.590056+0000","last_unstale":"2024-09-14T11:20:26.246099+0000","last_undegraded":"2024-09-14T11:20:26.246099+0000","last_fullsized":"2024-09-14T11:20:26.246099+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:24.964712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"260'2","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:41.010434+0000","last_change":"2024-09-14T11:01:23.892070+0000","last_active":"2024-09-14T11:21:41.010434+0000","last_peered":"2024-09-14T11:21:41.010434+0000","last_clean":"2024-09-14T11:21:41.010434+0000","last_became_active":"2024-09-14T11:01:23.891331+0000","last_became_peered":"2024-09-14T11:01:23.891331+0000","last_unstale":"2024-09-14T11:21:41.010434+0000","last_undegraded":"2024-09-14T11:21:41.010434+0000","last_fullsized":"2024-09-14T11:21:41.010434+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:08:04.829621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:19.986970+0000","last_change":"2024-09-14T11:01:20.863405+0000","last_active":"2024-09-14T11:19:19.986970+0000","last_peered":"2024-09-14T11:19:19.986970+0000","last_clean":"2024-09-14T11:19:19.986970+0000","last_became_active":"2024-09-14T11:01:20.863144+0000","last_became_peered":"2024-09-14T11:01:20.863144+0000","last_unstale":"2024-09-14T11:19:19.986970+0000","last_undegraded":"2024-09-14T11:19:19.986970+0000","last_fullsized":"2024-09-14T11:19:19.986970+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:52:05.926396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"260'19","reported_seq":91,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:00.757874+0000","last_change":"2024-09-14T10:59:48.417159+0000","last_active":"2024-09-14T11:21:00.757874+0000","last_peered":"2024-09-14T11:21:00.757874+0000","last_clean":"2024-09-14T11:21:00.757874+0000","last_became_active":"2024-09-14T10:59:48.416902+0000","last_became_peered":"2024-09-14T10:59:48.416902+0000","last_unstale":"2024-09-14T11:21:00.757874+0000","last_undegraded":"2024-09-14T11:21:00.757874+0000","last_fullsized":"2024-09-14T11:21:00.757874+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:14.436213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":98,"num_write":49,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:27.102106+0000","last_change":"2024-09-14T11:11:42.589320+0000","last_active":"2024-09-14T11:18:27.102106+0000","last_peered":"2024-09-14T11:18:27.102106+0000","last_clean":"2024-09-14T11:18:27.102106+0000","last_became_active":"2024-09-14T11:11:42.589071+0000","last_became_peered":"2024-09-14T11:11:42.589071+0000","last_unstale":"2024-09-14T11:18:27.102106+0000","last_undegraded":"2024-09-14T11:18:27.102106+0000","last_fullsized":"2024-09-14T11:18:27.102106+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:24.221085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:25.992224+0000","last_change":"2024-09-14T11:01:23.893015+0000","last_active":"2024-09-14T11:19:25.992224+0000","last_peered":"2024-09-14T11:19:25.992224+0000","last_clean":"2024-09-14T11:19:25.992224+0000","last_became_active":"2024-09-14T11:01:23.892761+0000","last_became_peered":"2024-09-14T11:01:23.892761+0000","last_unstale":"2024-09-14T11:19:25.992224+0000","last_undegraded":"2024-09-14T11:19:25.992224+0000","last_fullsized":"2024-09-14T11:19:25.992224+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:06.763249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:20.984704+0000","last_change":"2024-09-14T11:01:20.866514+0000","last_active":"2024-09-14T11:19:20.984704+0000","last_peered":"2024-09-14T11:19:20.984704+0000","last_clean":"2024-09-14T11:19:20.984704+0000","last_became_active":"2024-09-14T11:01:20.866224+0000","last_became_peered":"2024-09-14T11:01:20.866224+0000","last_unstale":"2024-09-14T11:19:20.984704+0000","last_undegraded":"2024-09-14T11:19:20.984704+0000","last_fullsized":"2024-09-14T11:19:20.984704+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:55.378175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"260'30","reported_seq":122,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:07.117741+0000","last_change":"2024-09-14T10:59:48.416632+0000","last_active":"2024-09-14T11:20:07.117741+0000","last_peered":"2024-09-14T11:20:07.117741+0000","last_clean":"2024-09-14T11:20:07.117741+0000","last_became_active":"2024-09-14T10:59:48.415922+0000","last_became_peered":"2024-09-14T10:59:48.415922+0000","last_unstale":"2024-09-14T11:20:07.117741+0000","last_undegraded":"2024-09-14T11:20:07.117741+0000","last_fullsized":"2024-09-14T11:20:07.117741+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:37.136039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":240,"num_read_kb":165,"num_write":74,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:22.119393+0000","last_change":"2024-09-14T11:11:42.591303+0000","last_active":"2024-09-14T11:20:22.119393+0000","last_peered":"2024-09-14T11:20:22.119393+0000","last_clean":"2024-09-14T11:20:22.119393+0000","last_became_active":"2024-09-14T11:11:42.589881+0000","last_became_peered":"2024-09-14T11:11:42.589881+0000","last_unstale":"2024-09-14T11:20:22.119393+0000","last_undegraded":"2024-09-14T11:20:22.119393+0000","last_fullsized":"2024-09-14T11:20:22.119393+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:53.799897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"257'8","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:30.993019+0000","last_change":"2024-09-14T11:01:23.897536+0000","last_active":"2024-09-14T11:19:30.993019+0000","last_peered":"2024-09-14T11:19:30.993019+0000","last_clean":"2024-09-14T11:19:30.993019+0000","last_became_active":"2024-09-14T11:01:23.897158+0000","last_became_peered":"2024-09-14T11:01:23.897158+0000","last_unstale":"2024-09-14T11:19:30.993019+0000","last_undegraded":"2024-09-14T11:19:30.993019+0000","last_fullsized":"2024-09-14T11:19:30.993019+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:34.363585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6146,"num_write":18,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:20.991433+0000","last_change":"2024-09-14T11:01:20.864291+0000","last_active":"2024-09-14T11:19:20.991433+0000","last_peered":"2024-09-14T11:19:20.991433+0000","last_clean":"2024-09-14T11:19:20.991433+0000","last_became_active":"2024-09-14T11:01:20.863999+0000","last_became_peered":"2024-09-14T11:01:20.863999+0000","last_unstale":"2024-09-14T11:19:20.991433+0000","last_undegraded":"2024-09-14T11:19:20.991433+0000","last_fullsized":"2024-09-14T11:19:20.991433+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:01:25.818000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"260'46","reported_seq":159,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:32.496503+0000","last_change":"2024-09-14T10:59:48.418550+0000","last_active":"2024-09-14T11:20:32.496503+0000","last_peered":"2024-09-14T11:20:32.496503+0000","last_clean":"2024-09-14T11:20:32.496503+0000","last_became_active":"2024-09-14T10:59:48.418276+0000","last_became_peered":"2024-09-14T10:59:48.418276+0000","last_unstale":"2024-09-14T11:20:32.496503+0000","last_undegraded":"2024-09-14T11:20:32.496503+0000","last_fullsized":"2024-09-14T11:20:32.496503+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:57.938381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":345,"num_read_kb":231,"num_write":118,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:22.119116+0000","last_change":"2024-09-14T11:11:42.587132+0000","last_active":"2024-09-14T11:20:22.119116+0000","last_peered":"2024-09-14T11:20:22.119116+0000","last_clean":"2024-09-14T11:20:22.119116+0000","last_became_active":"2024-09-14T11:11:42.586852+0000","last_became_peered":"2024-09-14T11:11:42.586852+0000","last_unstale":"2024-09-14T11:20:22.119116+0000","last_undegraded":"2024-09-14T11:20:22.119116+0000","last_fullsized":"2024-09-14T11:20:22.119116+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:34.192562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"257'3","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:26.237592+0000","last_change":"2024-09-14T11:01:23.887413+0000","last_active":"2024-09-14T11:19:26.237592+0000","last_peered":"2024-09-14T11:19:26.237592+0000","last_clean":"2024-09-14T11:19:26.237592+0000","last_became_active":"2024-09-14T11:01:23.887167+0000","last_became_peered":"2024-09-14T11:01:23.887167+0000","last_unstale":"2024-09-14T11:19:26.237592+0000","last_undegraded":"2024-09-14T11:19:26.237592+0000","last_fullsized":"2024-09-14T11:19:26.237592+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:36:46.808831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"260'4","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:25.992305+0000","last_change":"2024-09-14T11:01:20.857944+0000","last_active":"2024-09-14T11:19:25.992305+0000","last_peered":"2024-09-14T11:19:25.992305+0000","last_clean":"2024-09-14T11:19:25.992305+0000","last_became_active":"2024-09-14T11:01:20.857645+0000","last_became_peered":"2024-09-14T11:01:20.857645+0000","last_unstale":"2024-09-14T11:19:25.992305+0000","last_undegraded":"2024-09-14T11:19:25.992305+0000","last_fullsized":"2024-09-14T11:19:25.992305+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:57:36.222186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":9,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"260'22","reported_seq":101,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:05.990564+0000","last_change":"2024-09-14T10:59:48.413726+0000","last_active":"2024-09-14T11:20:05.990564+0000","last_peered":"2024-09-14T11:20:05.990564+0000","last_clean":"2024-09-14T11:20:05.990564+0000","last_became_active":"2024-09-14T10:59:48.413425+0000","last_became_peered":"2024-09-14T10:59:48.413425+0000","last_unstale":"2024-09-14T11:20:05.990564+0000","last_undegraded":"2024-09-14T11:20:05.990564+0000","last_fullsized":"2024-09-14T11:20:05.990564+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:03.945777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":100,"num_write":57,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:31.229418+0000","last_change":"2024-09-14T11:11:42.588149+0000","last_active":"2024-09-14T11:18:31.229418+0000","last_peered":"2024-09-14T11:18:31.229418+0000","last_clean":"2024-09-14T11:18:31.229418+0000","last_became_active":"2024-09-14T11:11:42.587906+0000","last_became_peered":"2024-09-14T11:11:42.587906+0000","last_unstale":"2024-09-14T11:18:31.229418+0000","last_undegraded":"2024-09-14T11:18:31.229418+0000","last_fullsized":"2024-09-14T11:18:31.229418+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:29.046471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:47.105337+0000","last_change":"2024-09-14T11:01:23.891705+0000","last_active":"2024-09-14T11:18:47.105337+0000","last_peered":"2024-09-14T11:18:47.105337+0000","last_clean":"2024-09-14T11:18:47.105337+0000","last_became_active":"2024-09-14T11:01:23.891424+0000","last_became_peered":"2024-09-14T11:01:23.891424+0000","last_unstale":"2024-09-14T11:18:47.105337+0000","last_undegraded":"2024-09-14T11:18:47.105337+0000","last_fullsized":"2024-09-14T11:18:47.105337+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:57.606174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"260'3","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:40.985234+0000","last_change":"2024-09-14T11:01:20.864246+0000","last_active":"2024-09-14T11:18:40.985234+0000","last_peered":"2024-09-14T11:18:40.985234+0000","last_clean":"2024-09-14T11:18:40.985234+0000","last_became_active":"2024-09-14T11:01:20.863936+0000","last_became_peered":"2024-09-14T11:01:20.863936+0000","last_unstale":"2024-09-14T11:18:40.985234+0000","last_undegraded":"2024-09-14T11:18:40.985234+0000","last_fullsized":"2024-09-14T11:18:40.985234+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:54.851971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":3,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"260'14","reported_seq":80,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:05.990531+0000","last_change":"2024-09-14T10:59:48.414234+0000","last_active":"2024-09-14T11:20:05.990531+0000","last_peered":"2024-09-14T11:20:05.990531+0000","last_clean":"2024-09-14T11:20:05.990531+0000","last_became_active":"2024-09-14T10:59:48.413255+0000","last_became_peered":"2024-09-14T10:59:48.413255+0000","last_unstale":"2024-09-14T11:20:05.990531+0000","last_undegraded":"2024-09-14T11:20:05.990531+0000","last_fullsized":"2024-09-14T11:20:05.990531+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:14.892298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":78,"num_write":38,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:34.979984+0000","last_change":"2024-09-14T11:11:42.588371+0000","last_active":"2024-09-14T11:18:34.979984+0000","last_peered":"2024-09-14T11:18:34.979984+0000","last_clean":"2024-09-14T11:18:34.979984+0000","last_became_active":"2024-09-14T11:11:42.588120+0000","last_became_peered":"2024-09-14T11:11:42.588120+0000","last_unstale":"2024-09-14T11:18:34.979984+0000","last_undegraded":"2024-09-14T11:18:34.979984+0000","last_fullsized":"2024-09-14T11:18:34.979984+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:23.029451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"257'3","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:44.981319+0000","last_change":"2024-09-14T11:01:23.889191+0000","last_active":"2024-09-14T11:18:44.981319+0000","last_peered":"2024-09-14T11:18:44.981319+0000","last_clean":"2024-09-14T11:18:44.981319+0000","last_became_active":"2024-09-14T11:01:23.888873+0000","last_became_peered":"2024-09-14T11:01:23.888873+0000","last_unstale":"2024-09-14T11:18:44.981319+0000","last_undegraded":"2024-09-14T11:18:44.981319+0000","last_fullsized":"2024-09-14T11:18:44.981319+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:21.226880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:41.230765+0000","last_change":"2024-09-14T11:01:20.867172+0000","last_active":"2024-09-14T11:18:41.230765+0000","last_peered":"2024-09-14T11:18:41.230765+0000","last_clean":"2024-09-14T11:18:41.230765+0000","last_became_active":"2024-09-14T11:01:20.865953+0000","last_became_peered":"2024-09-14T11:01:20.865953+0000","last_unstale":"2024-09-14T11:18:41.230765+0000","last_undegraded":"2024-09-14T11:18:41.230765+0000","last_fullsized":"2024-09-14T11:18:41.230765+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:07:32.750973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"260'22","reported_seq":98,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:00.388827+0000","last_change":"2024-09-14T10:59:48.417311+0000","last_active":"2024-09-14T11:21:00.388827+0000","last_peered":"2024-09-14T11:21:00.388827+0000","last_clean":"2024-09-14T11:21:00.388827+0000","last_became_active":"2024-09-14T10:59:48.417013+0000","last_became_peered":"2024-09-14T10:59:48.417013+0000","last_unstale":"2024-09-14T11:21:00.388827+0000","last_undegraded":"2024-09-14T11:21:00.388827+0000","last_fullsized":"2024-09-14T11:21:00.388827+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:55.489720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":110,"num_write":54,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"260'1","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:27.198445+0000","last_change":"2024-09-14T11:11:42.592793+0000","last_active":"2024-09-14T11:18:27.198445+0000","last_peered":"2024-09-14T11:18:27.198445+0000","last_clean":"2024-09-14T11:18:27.198445+0000","last_became_active":"2024-09-14T11:11:42.592514+0000","last_became_peered":"2024-09-14T11:11:42.592514+0000","last_unstale":"2024-09-14T11:18:27.198445+0000","last_undegraded":"2024-09-14T11:18:27.198445+0000","last_fullsized":"2024-09-14T11:18:27.198445+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:15.197793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:25.985335+0000","last_change":"2024-09-14T11:01:23.890689+0000","last_active":"2024-09-14T11:19:25.985335+0000","last_peered":"2024-09-14T11:19:25.985335+0000","last_clean":"2024-09-14T11:19:25.985335+0000","last_became_active":"2024-09-14T11:01:23.890356+0000","last_became_peered":"2024-09-14T11:01:23.890356+0000","last_unstale":"2024-09-14T11:19:25.985335+0000","last_undegraded":"2024-09-14T11:19:25.985335+0000","last_fullsized":"2024-09-14T11:19:25.985335+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:10.636807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"257'3","reported_seq":40,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:45.986096+0000","last_change":"2024-09-14T11:01:20.859484+0000","last_active":"2024-09-14T11:18:45.986096+0000","last_peered":"2024-09-14T11:18:45.986096+0000","last_clean":"2024-09-14T11:18:45.986096+0000","last_became_active":"2024-09-14T11:01:20.859214+0000","last_became_peered":"2024-09-14T11:01:20.859214+0000","last_unstale":"2024-09-14T11:18:45.986096+0000","last_undegraded":"2024-09-14T11:18:45.986096+0000","last_fullsized":"2024-09-14T11:18:45.986096+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:16.912377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"260'23","reported_seq":97,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:21.236876+0000","last_change":"2024-09-14T10:59:48.420616+0000","last_active":"2024-09-14T11:19:21.236876+0000","last_peered":"2024-09-14T11:19:21.236876+0000","last_clean":"2024-09-14T11:19:21.236876+0000","last_became_active":"2024-09-14T10:59:48.420353+0000","last_became_peered":"2024-09-14T10:59:48.420353+0000","last_unstale":"2024-09-14T11:19:21.236876+0000","last_undegraded":"2024-09-14T11:19:21.236876+0000","last_fullsized":"2024-09-14T11:19:21.236876+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:02.159847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":102,"num_write":60,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:30.984019+0000","last_change":"2024-09-14T11:11:42.589448+0000","last_active":"2024-09-14T11:18:30.984019+0000","last_peered":"2024-09-14T11:18:30.984019+0000","last_clean":"2024-09-14T11:18:30.984019+0000","last_became_active":"2024-09-14T11:11:42.589134+0000","last_became_peered":"2024-09-14T11:11:42.589134+0000","last_unstale":"2024-09-14T11:18:30.984019+0000","last_undegraded":"2024-09-14T11:18:30.984019+0000","last_fullsized":"2024-09-14T11:18:30.984019+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:36:39.197914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"260'1","reported_seq":30,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:47.201529+0000","last_change":"2024-09-14T11:01:23.890752+0000","last_active":"2024-09-14T11:18:47.201529+0000","last_peered":"2024-09-14T11:18:47.201529+0000","last_clean":"2024-09-14T11:18:47.201529+0000","last_became_active":"2024-09-14T11:01:23.890433+0000","last_became_peered":"2024-09-14T11:01:23.890433+0000","last_unstale":"2024-09-14T11:18:47.201529+0000","last_undegraded":"2024-09-14T11:18:47.201529+0000","last_fullsized":"2024-09-14T11:18:47.201529+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:00.066817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"257'3","reported_seq":40,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:22.110767+0000","last_change":"2024-09-14T11:01:20.859636+0000","last_active":"2024-09-14T11:19:22.110767+0000","last_peered":"2024-09-14T11:19:22.110767+0000","last_clean":"2024-09-14T11:19:22.110767+0000","last_became_active":"2024-09-14T11:01:20.858834+0000","last_became_peered":"2024-09-14T11:01:20.858834+0000","last_unstale":"2024-09-14T11:19:22.110767+0000","last_undegraded":"2024-09-14T11:19:22.110767+0000","last_fullsized":"2024-09-14T11:19:22.110767+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:26.825835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"260'31","reported_seq":128,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:22.206583+0000","last_change":"2024-09-14T10:59:48.414660+0000","last_active":"2024-09-14T11:19:22.206583+0000","last_peered":"2024-09-14T11:19:22.206583+0000","last_clean":"2024-09-14T11:19:22.206583+0000","last_became_active":"2024-09-14T10:59:48.414351+0000","last_became_peered":"2024-09-14T10:59:48.414351+0000","last_unstale":"2024-09-14T11:19:22.206583+0000","last_undegraded":"2024-09-14T11:19:22.206583+0000","last_fullsized":"2024-09-14T11:19:22.206583+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:47.823706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":249,"num_read_kb":158,"num_write":78,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:02.212097+0000","last_change":"2024-09-14T11:11:42.588279+0000","last_active":"2024-09-14T11:20:02.212097+0000","last_peered":"2024-09-14T11:20:02.212097+0000","last_clean":"2024-09-14T11:20:02.212097+0000","last_became_active":"2024-09-14T11:11:42.587955+0000","last_became_peered":"2024-09-14T11:11:42.587955+0000","last_unstale":"2024-09-14T11:20:02.212097+0000","last_undegraded":"2024-09-14T11:20:02.212097+0000","last_fullsized":"2024-09-14T11:20:02.212097+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:26.572340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"260'8","reported_seq":47,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:16.262273+0000","last_change":"2024-09-14T11:01:23.893822+0000","last_active":"2024-09-14T11:22:16.262273+0000","last_peered":"2024-09-14T11:22:16.262273+0000","last_clean":"2024-09-14T11:22:16.262273+0000","last_became_active":"2024-09-14T11:01:23.891239+0000","last_became_peered":"2024-09-14T11:01:23.891239+0000","last_unstale":"2024-09-14T11:22:16.262273+0000","last_undegraded":"2024-09-14T11:22:16.262273+0000","last_fullsized":"2024-09-14T11:22:16.262273+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:21.232548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20482,"num_write":18,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":35,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:07.117708+0000","last_change":"2024-09-14T11:01:20.867304+0000","last_active":"2024-09-14T11:20:07.117708+0000","last_peered":"2024-09-14T11:20:07.117708+0000","last_clean":"2024-09-14T11:20:07.117708+0000","last_became_active":"2024-09-14T11:01:20.866975+0000","last_became_peered":"2024-09-14T11:01:20.866975+0000","last_unstale":"2024-09-14T11:20:07.117708+0000","last_undegraded":"2024-09-14T11:20:07.117708+0000","last_fullsized":"2024-09-14T11:20:07.117708+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:53.556481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"260'4","reported_seq":50,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:21.115449+0000","last_change":"2024-09-14T10:59:48.417712+0000","last_active":"2024-09-14T11:19:21.115449+0000","last_peered":"2024-09-14T11:19:21.115449+0000","last_clean":"2024-09-14T11:19:21.115449+0000","last_became_active":"2024-09-14T10:59:48.416741+0000","last_became_peered":"2024-09-14T10:59:48.416741+0000","last_unstale":"2024-09-14T11:19:21.115449+0000","last_undegraded":"2024-09-14T11:19:21.115449+0000","last_fullsized":"2024-09-14T11:19:21.115449+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:42.444007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:02.212122+0000","last_change":"2024-09-14T11:11:42.582460+0000","last_active":"2024-09-14T11:20:02.212122+0000","last_peered":"2024-09-14T11:20:02.212122+0000","last_clean":"2024-09-14T11:20:02.212122+0000","last_became_active":"2024-09-14T11:11:42.582190+0000","last_became_peered":"2024-09-14T11:11:42.582190+0000","last_unstale":"2024-09-14T11:20:02.212122+0000","last_undegraded":"2024-09-14T11:20:02.212122+0000","last_fullsized":"2024-09-14T11:20:02.212122+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:34.879085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"260'10","reported_seq":55,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:16.262243+0000","last_change":"2024-09-14T11:01:23.893560+0000","last_active":"2024-09-14T11:22:16.262243+0000","last_peered":"2024-09-14T11:22:16.262243+0000","last_clean":"2024-09-14T11:22:16.262243+0000","last_became_active":"2024-09-14T11:01:23.892344+0000","last_became_peered":"2024-09-14T11:01:23.892344+0000","last_unstale":"2024-09-14T11:22:16.262243+0000","last_undegraded":"2024-09-14T11:22:16.262243+0000","last_fullsized":"2024-09-14T11:22:16.262243+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:12.291644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":30724,"num_write":15,"num_write_kb":10242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"260'2","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:11.138584+0000","last_change":"2024-09-14T11:01:20.863767+0000","last_active":"2024-09-14T11:22:11.138584+0000","last_peered":"2024-09-14T11:22:11.138584+0000","last_clean":"2024-09-14T11:22:11.138584+0000","last_became_active":"2024-09-14T11:01:20.863495+0000","last_became_peered":"2024-09-14T11:01:20.863495+0000","last_unstale":"2024-09-14T11:22:11.138584+0000","last_undegraded":"2024-09-14T11:22:11.138584+0000","last_fullsized":"2024-09-14T11:22:11.138584+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:36:10.395831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"260'32","reported_seq":120,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:22.110836+0000","last_change":"2024-09-14T10:59:48.416964+0000","last_active":"2024-09-14T11:19:22.110836+0000","last_peered":"2024-09-14T11:19:22.110836+0000","last_clean":"2024-09-14T11:19:22.110836+0000","last_became_active":"2024-09-14T10:59:48.416253+0000","last_became_peered":"2024-09-14T10:59:48.416253+0000","last_unstale":"2024-09-14T11:19:22.110836+0000","last_undegraded":"2024-09-14T11:19:22.110836+0000","last_fullsized":"2024-09-14T11:19:22.110836+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:16.459819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":142,"num_write":84,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:46.240692+0000","last_change":"2024-09-14T11:11:42.589281+0000","last_active":"2024-09-14T11:19:46.240692+0000","last_peered":"2024-09-14T11:19:46.240692+0000","last_clean":"2024-09-14T11:19:46.240692+0000","last_became_active":"2024-09-14T11:11:42.588988+0000","last_became_peered":"2024-09-14T11:11:42.588988+0000","last_unstale":"2024-09-14T11:19:46.240692+0000","last_undegraded":"2024-09-14T11:19:46.240692+0000","last_fullsized":"2024-09-14T11:19:46.240692+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:50:56.659833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"260'4","reported_seq":36,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:47.201596+0000","last_change":"2024-09-14T11:01:23.889213+0000","last_active":"2024-09-14T11:18:47.201596+0000","last_peered":"2024-09-14T11:18:47.201596+0000","last_clean":"2024-09-14T11:18:47.201596+0000","last_became_active":"2024-09-14T11:01:23.888845+0000","last_became_peered":"2024-09-14T11:01:23.888845+0000","last_unstale":"2024-09-14T11:18:47.201596+0000","last_undegraded":"2024-09-14T11:18:47.201596+0000","last_fullsized":"2024-09-14T11:18:47.201596+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:20.704713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":11264,"num_write":4,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"257'10","reported_seq":60,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:39.980809+0000","last_change":"2024-09-14T11:01:20.866169+0000","last_active":"2024-09-14T11:18:39.980809+0000","last_peered":"2024-09-14T11:18:39.980809+0000","last_clean":"2024-09-14T11:18:39.980809+0000","last_became_active":"2024-09-14T11:01:20.865891+0000","last_became_peered":"2024-09-14T11:01:20.865891+0000","last_unstale":"2024-09-14T11:18:39.980809+0000","last_undegraded":"2024-09-14T11:18:39.980809+0000","last_fullsized":"2024-09-14T11:18:39.980809+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:22.211764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":24580,"num_write":15,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"260'27","reported_seq":114,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:05.938404+0000","last_change":"2024-09-14T10:59:48.421115+0000","last_active":"2024-09-14T11:20:05.938404+0000","last_peered":"2024-09-14T11:20:05.938404+0000","last_clean":"2024-09-14T11:20:05.938404+0000","last_became_active":"2024-09-14T10:59:48.420845+0000","last_became_peered":"2024-09-14T10:59:48.420845+0000","last_unstale":"2024-09-14T11:20:05.938404+0000","last_undegraded":"2024-09-14T11:20:05.938404+0000","last_fullsized":"2024-09-14T11:20:05.938404+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:56.781294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":135,"num_write":77,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:02.116980+0000","last_change":"2024-09-14T11:11:42.592263+0000","last_active":"2024-09-14T11:20:02.116980+0000","last_peered":"2024-09-14T11:20:02.116980+0000","last_clean":"2024-09-14T11:20:02.116980+0000","last_became_active":"2024-09-14T11:11:42.591734+0000","last_became_peered":"2024-09-14T11:11:42.591734+0000","last_unstale":"2024-09-14T11:20:02.116980+0000","last_undegraded":"2024-09-14T11:20:02.116980+0000","last_fullsized":"2024-09-14T11:20:02.116980+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:48.663357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"260'2","reported_seq":30,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:47.105455+0000","last_change":"2024-09-14T11:01:23.895194+0000","last_active":"2024-09-14T11:18:47.105455+0000","last_peered":"2024-09-14T11:18:47.105455+0000","last_clean":"2024-09-14T11:18:47.105455+0000","last_became_active":"2024-09-14T11:01:23.894904+0000","last_became_peered":"2024-09-14T11:01:23.894904+0000","last_unstale":"2024-09-14T11:18:47.105455+0000","last_undegraded":"2024-09-14T11:18:47.105455+0000","last_fullsized":"2024-09-14T11:18:47.105455+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:18.788575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:42.104731+0000","last_change":"2024-09-14T11:01:20.867989+0000","last_active":"2024-09-14T11:18:42.104731+0000","last_peered":"2024-09-14T11:18:42.104731+0000","last_clean":"2024-09-14T11:18:42.104731+0000","last_became_active":"2024-09-14T11:01:20.867675+0000","last_became_peered":"2024-09-14T11:01:20.867675+0000","last_unstale":"2024-09-14T11:18:42.104731+0000","last_undegraded":"2024-09-14T11:18:42.104731+0000","last_fullsized":"2024-09-14T11:18:42.104731+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:14:01.546319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"260'45","reported_seq":167,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:41.002316+0000","last_change":"2024-09-14T10:59:48.420304+0000","last_active":"2024-09-14T11:20:41.002316+0000","last_peered":"2024-09-14T11:20:41.002316+0000","last_clean":"2024-09-14T11:20:41.002316+0000","last_became_active":"2024-09-14T10:59:48.419276+0000","last_became_peered":"2024-09-14T10:59:48.419276+0000","last_unstale":"2024-09-14T11:20:41.002316+0000","last_undegraded":"2024-09-14T11:20:41.002316+0000","last_fullsized":"2024-09-14T11:20:41.002316+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:28.099017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":347,"num_read_kb":232,"num_write":118,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"259'1","reported_seq":19,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:26.000278+0000","last_change":"2024-09-14T11:11:42.585561+0000","last_active":"2024-09-14T11:20:26.000278+0000","last_peered":"2024-09-14T11:20:26.000278+0000","last_clean":"2024-09-14T11:20:26.000278+0000","last_became_active":"2024-09-14T11:11:42.585114+0000","last_became_peered":"2024-09-14T11:11:42.585114+0000","last_unstale":"2024-09-14T11:20:26.000278+0000","last_undegraded":"2024-09-14T11:20:26.000278+0000","last_fullsized":"2024-09-14T11:20:26.000278+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:57.558919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"260'1","reported_seq":31,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:11.121984+0000","last_change":"2024-09-14T11:01:23.894718+0000","last_active":"2024-09-14T11:20:11.121984+0000","last_peered":"2024-09-14T11:20:11.121984+0000","last_clean":"2024-09-14T11:20:11.121984+0000","last_became_active":"2024-09-14T11:01:23.894464+0000","last_became_peered":"2024-09-14T11:01:23.894464+0000","last_unstale":"2024-09-14T11:20:11.121984+0000","last_undegraded":"2024-09-14T11:20:11.121984+0000","last_fullsized":"2024-09-14T11:20:11.121984+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:05.810582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":35,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:24.987527+0000","last_change":"2024-09-14T11:01:20.869396+0000","last_active":"2024-09-14T11:19:24.987527+0000","last_peered":"2024-09-14T11:19:24.987527+0000","last_clean":"2024-09-14T11:19:24.987527+0000","last_became_active":"2024-09-14T11:01:20.869082+0000","last_became_peered":"2024-09-14T11:01:20.869082+0000","last_unstale":"2024-09-14T11:19:24.987527+0000","last_undegraded":"2024-09-14T11:19:24.987527+0000","last_fullsized":"2024-09-14T11:19:24.987527+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:21.154202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"260'42","reported_seq":152,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:00.225547+0000","last_change":"2024-09-14T10:59:48.420048+0000","last_active":"2024-09-14T11:21:00.225547+0000","last_peered":"2024-09-14T11:21:00.225547+0000","last_clean":"2024-09-14T11:21:00.225547+0000","last_became_active":"2024-09-14T10:59:48.419753+0000","last_became_peered":"2024-09-14T10:59:48.419753+0000","last_unstale":"2024-09-14T11:21:00.225547+0000","last_undegraded":"2024-09-14T11:21:00.225547+0000","last_fullsized":"2024-09-14T11:21:00.225547+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:03.370977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":323,"num_read_kb":218,"num_write":115,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:26.123988+0000","last_change":"2024-09-14T11:11:42.593259+0000","last_active":"2024-09-14T11:20:26.123988+0000","last_peered":"2024-09-14T11:20:26.123988+0000","last_clean":"2024-09-14T11:20:26.123988+0000","last_became_active":"2024-09-14T11:11:42.592960+0000","last_became_peered":"2024-09-14T11:11:42.592960+0000","last_unstale":"2024-09-14T11:20:26.123988+0000","last_undegraded":"2024-09-14T11:20:26.123988+0000","last_fullsized":"2024-09-14T11:20:26.123988+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:01.524529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"260'2","reported_seq":31,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:32.112183+0000","last_change":"2024-09-14T11:01:23.884623+0000","last_active":"2024-09-14T11:19:32.112183+0000","last_peered":"2024-09-14T11:19:32.112183+0000","last_clean":"2024-09-14T11:19:32.112183+0000","last_became_active":"2024-09-14T11:01:23.883464+0000","last_became_peered":"2024-09-14T11:01:23.883464+0000","last_unstale":"2024-09-14T11:19:32.112183+0000","last_undegraded":"2024-09-14T11:19:32.112183+0000","last_fullsized":"2024-09-14T11:19:32.112183+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:39:12.543169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":35,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:07.117641+0000","last_change":"2024-09-14T11:01:20.858331+0000","last_active":"2024-09-14T11:20:07.117641+0000","last_peered":"2024-09-14T11:20:07.117641+0000","last_clean":"2024-09-14T11:20:07.117641+0000","last_became_active":"2024-09-14T11:01:20.858057+0000","last_became_peered":"2024-09-14T11:01:20.858057+0000","last_unstale":"2024-09-14T11:20:07.117641+0000","last_undegraded":"2024-09-14T11:20:07.117641+0000","last_fullsized":"2024-09-14T11:20:07.117641+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:57:11.838133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"260'19","reported_seq":86,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:42.122601+0000","last_change":"2024-09-14T10:59:48.413110+0000","last_active":"2024-09-14T11:20:42.122601+0000","last_peered":"2024-09-14T11:20:42.122601+0000","last_clean":"2024-09-14T11:20:42.122601+0000","last_became_active":"2024-09-14T10:59:48.412832+0000","last_became_peered":"2024-09-14T10:59:48.412832+0000","last_unstale":"2024-09-14T11:20:42.122601+0000","last_undegraded":"2024-09-14T11:20:42.122601+0000","last_fullsized":"2024-09-14T11:20:42.122601+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:06.411861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":68,"num_write":55,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:06.243706+0000","last_change":"2024-09-14T11:11:42.590806+0000","last_active":"2024-09-14T11:20:06.243706+0000","last_peered":"2024-09-14T11:20:06.243706+0000","last_clean":"2024-09-14T11:20:06.243706+0000","last_became_active":"2024-09-14T11:11:42.590549+0000","last_became_peered":"2024-09-14T11:11:42.590549+0000","last_unstale":"2024-09-14T11:20:06.243706+0000","last_undegraded":"2024-09-14T11:20:06.243706+0000","last_fullsized":"2024-09-14T11:20:06.243706+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:47:13.279425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":29,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:09.993244+0000","last_change":"2024-09-14T11:01:23.880483+0000","last_active":"2024-09-14T11:20:09.993244+0000","last_peered":"2024-09-14T11:20:09.993244+0000","last_clean":"2024-09-14T11:20:09.993244+0000","last_became_active":"2024-09-14T11:01:23.880195+0000","last_became_peered":"2024-09-14T11:01:23.880195+0000","last_unstale":"2024-09-14T11:20:09.993244+0000","last_undegraded":"2024-09-14T11:20:09.993244+0000","last_fullsized":"2024-09-14T11:20:09.993244+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:17.209496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":35,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:05.990504+0000","last_change":"2024-09-14T11:01:20.869635+0000","last_active":"2024-09-14T11:20:05.990504+0000","last_peered":"2024-09-14T11:20:05.990504+0000","last_clean":"2024-09-14T11:20:05.990504+0000","last_became_active":"2024-09-14T11:01:20.869312+0000","last_became_peered":"2024-09-14T11:01:20.869312+0000","last_unstale":"2024-09-14T11:20:05.990504+0000","last_undegraded":"2024-09-14T11:20:05.990504+0000","last_fullsized":"2024-09-14T11:20:05.990504+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:36:29.069053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"257'19","reported_seq":97,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:42.122542+0000","last_change":"2024-09-14T10:59:48.418837+0000","last_active":"2024-09-14T11:20:42.122542+0000","last_peered":"2024-09-14T11:20:42.122542+0000","last_clean":"2024-09-14T11:20:42.122542+0000","last_became_active":"2024-09-14T10:59:48.418369+0000","last_became_peered":"2024-09-14T10:59:48.418369+0000","last_unstale":"2024-09-14T11:20:42.122542+0000","last_undegraded":"2024-09-14T11:20:42.122542+0000","last_fullsized":"2024-09-14T11:20:42.122542+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:53.388331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":97,"num_write":49,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:02.117065+0000","last_change":"2024-09-14T11:11:42.593087+0000","last_active":"2024-09-14T11:20:02.117065+0000","last_peered":"2024-09-14T11:20:02.117065+0000","last_clean":"2024-09-14T11:20:02.117065+0000","last_became_active":"2024-09-14T11:11:42.592333+0000","last_became_peered":"2024-09-14T11:11:42.592333+0000","last_unstale":"2024-09-14T11:20:02.117065+0000","last_undegraded":"2024-09-14T11:20:02.117065+0000","last_fullsized":"2024-09-14T11:20:02.117065+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:32.247668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"260'1","reported_seq":31,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:09.993223+0000","last_change":"2024-09-14T11:01:23.882421+0000","last_active":"2024-09-14T11:20:09.993223+0000","last_peered":"2024-09-14T11:20:09.993223+0000","last_clean":"2024-09-14T11:20:09.993223+0000","last_became_active":"2024-09-14T11:01:23.882133+0000","last_became_peered":"2024-09-14T11:01:23.882133+0000","last_unstale":"2024-09-14T11:20:09.993223+0000","last_undegraded":"2024-09-14T11:20:09.993223+0000","last_fullsized":"2024-09-14T11:20:09.993223+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:20.333208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3204,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":35,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:07.117340+0000","last_change":"2024-09-14T11:01:20.861253+0000","last_active":"2024-09-14T11:20:07.117340+0000","last_peered":"2024-09-14T11:20:07.117340+0000","last_clean":"2024-09-14T11:20:07.117340+0000","last_became_active":"2024-09-14T11:01:20.860944+0000","last_became_peered":"2024-09-14T11:01:20.860944+0000","last_unstale":"2024-09-14T11:20:07.117340+0000","last_undegraded":"2024-09-14T11:20:07.117340+0000","last_fullsized":"2024-09-14T11:20:07.117340+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:43.601108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"260'37","reported_seq":141,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:19.371160+0000","last_change":"2024-09-14T10:59:48.420240+0000","last_active":"2024-09-14T11:20:19.371160+0000","last_peered":"2024-09-14T11:20:19.371160+0000","last_clean":"2024-09-14T11:20:19.371160+0000","last_became_active":"2024-09-14T10:59:48.419953+0000","last_became_peered":"2024-09-14T10:59:48.419953+0000","last_unstale":"2024-09-14T11:20:19.371160+0000","last_undegraded":"2024-09-14T11:20:19.371160+0000","last_fullsized":"2024-09-14T11:20:19.371160+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:19.266531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":210,"num_write":90,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"260'286","reported_seq":921,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:09.985550+0000","last_change":"2024-09-14T10:45:43.684610+0000","last_active":"2024-09-14T11:21:09.985550+0000","last_peered":"2024-09-14T11:21:09.985550+0000","last_clean":"2024-09-14T11:21:09.985550+0000","last_became_active":"2024-09-14T10:45:43.684205+0000","last_became_peered":"2024-09-14T10:45:43.684205+0000","last_unstale":"2024-09-14T11:21:09.985550+0000","last_undegraded":"2024-09-14T11:21:09.985550+0000","last_fullsized":"2024-09-14T11:21:09.985550+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:01:55.211378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11900480,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":554,"num_read_kb":37218,"num_write":1014,"num_write_kb":25003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"260'782","reported_seq":2531,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.834281+0000","last_change":"2024-09-14T10:45:45.714795+0000","last_active":"2024-09-14T11:22:42.834281+0000","last_peered":"2024-09-14T11:22:42.834281+0000","last_clean":"2024-09-14T11:22:42.834281+0000","last_became_active":"2024-09-14T10:45:45.714485+0000","last_became_peered":"2024-09-14T10:45:45.714485+0000","last_unstale":"2024-09-14T11:22:42.834281+0000","last_undegraded":"2024-09-14T11:22:42.834281+0000","last_fullsized":"2024-09-14T11:22:42.834281+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:23:57.662505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4300,"num_read_kb":3942,"num_write":1034,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"260'337","reported_seq":1014,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.086853+0000","last_change":"2024-09-14T10:45:43.684416+0000","last_active":"2024-09-14T11:22:51.086853+0000","last_peered":"2024-09-14T11:22:51.086853+0000","last_clean":"2024-09-14T11:22:51.086853+0000","last_became_active":"2024-09-14T10:45:43.683777+0000","last_became_peered":"2024-09-14T10:45:43.683777+0000","last_unstale":"2024-09-14T11:22:51.086853+0000","last_undegraded":"2024-09-14T11:22:51.086853+0000","last_fullsized":"2024-09-14T11:22:51.086853+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:01.676657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23917,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":745,"num_read_kb":10810,"num_write":1134,"num_write_kb":33486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"260'363","reported_seq":1830,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.734957+0000","last_change":"2024-09-14T10:45:45.716175+0000","last_active":"2024-09-14T11:21:28.734957+0000","last_peered":"2024-09-14T11:21:28.734957+0000","last_clean":"2024-09-14T11:21:28.734957+0000","last_became_active":"2024-09-14T10:45:45.715857+0000","last_became_peered":"2024-09-14T10:45:45.715857+0000","last_unstale":"2024-09-14T11:21:28.734957+0000","last_undegraded":"2024-09-14T11:21:28.734957+0000","last_fullsized":"2024-09-14T11:21:28.734957+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:52.361682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2025,"num_read_kb":1946,"num_write":400,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"260'348","reported_seq":1052,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.079373+0000","last_change":"2024-09-14T10:45:43.689580+0000","last_active":"2024-09-14T11:22:51.079373+0000","last_peered":"2024-09-14T11:22:51.079373+0000","last_clean":"2024-09-14T11:22:51.079373+0000","last_became_active":"2024-09-14T10:45:43.689222+0000","last_became_peered":"2024-09-14T10:45:43.689222+0000","last_unstale":"2024-09-14T11:22:51.079373+0000","last_undegraded":"2024-09-14T11:22:51.079373+0000","last_fullsized":"2024-09-14T11:22:51.079373+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:25.612577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":929,"num_read_kb":25215,"num_write":1085,"num_write_kb":46624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"260'805","reported_seq":2235,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:14.951766+0000","last_change":"2024-09-14T10:45:45.718479+0000","last_active":"2024-09-14T11:21:14.951766+0000","last_peered":"2024-09-14T11:21:14.951766+0000","last_clean":"2024-09-14T11:21:14.951766+0000","last_became_active":"2024-09-14T10:45:45.718205+0000","last_became_peered":"2024-09-14T10:45:45.718205+0000","last_unstale":"2024-09-14T11:21:14.951766+0000","last_undegraded":"2024-09-14T11:21:14.951766+0000","last_fullsized":"2024-09-14T11:21:14.951766+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:25.149788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3715,"num_read_kb":3327,"num_write":1051,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"260'321","reported_seq":1063,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:16.586674+0000","last_change":"2024-09-14T10:45:43.689239+0000","last_active":"2024-09-14T11:21:16.586674+0000","last_peered":"2024-09-14T11:21:16.586674+0000","last_clean":"2024-09-14T11:21:16.586674+0000","last_became_active":"2024-09-14T10:45:43.688982+0000","last_became_peered":"2024-09-14T10:45:43.688982+0000","last_unstale":"2024-09-14T11:21:16.586674+0000","last_undegraded":"2024-09-14T11:21:16.586674+0000","last_fullsized":"2024-09-14T11:21:16.586674+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:12.609439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11676363,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":758,"num_read_kb":162477,"num_write":1261,"num_write_kb":45809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"260'456","reported_seq":2005,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.041160+0000","last_change":"2024-09-14T10:45:45.718026+0000","last_active":"2024-09-14T11:21:27.041160+0000","last_peered":"2024-09-14T11:21:27.041160+0000","last_clean":"2024-09-14T11:21:27.041160+0000","last_became_active":"2024-09-14T10:45:45.717699+0000","last_became_peered":"2024-09-14T10:45:45.717699+0000","last_unstale":"2024-09-14T11:21:27.041160+0000","last_undegraded":"2024-09-14T11:21:27.041160+0000","last_fullsized":"2024-09-14T11:21:27.041160+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:20.366459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2461,"num_read_kb":2303,"num_write":536,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"260'292","reported_seq":931,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:58.304735+0000","last_change":"2024-09-14T10:45:43.686364+0000","last_active":"2024-09-14T11:20:58.304735+0000","last_peered":"2024-09-14T11:20:58.304735+0000","last_clean":"2024-09-14T11:20:58.304735+0000","last_became_active":"2024-09-14T10:45:43.686078+0000","last_became_peered":"2024-09-14T10:45:43.686078+0000","last_unstale":"2024-09-14T11:20:58.304735+0000","last_undegraded":"2024-09-14T11:20:58.304735+0000","last_fullsized":"2024-09-14T11:20:58.304735+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:18.961172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":675323,"num_objects":85,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":522,"num_read_kb":61894,"num_write":1086,"num_write_kb":33123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"260'397","reported_seq":2007,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:13.971249+0000","last_change":"2024-09-14T10:45:45.714828+0000","last_active":"2024-09-14T11:21:13.971249+0000","last_peered":"2024-09-14T11:21:13.971249+0000","last_clean":"2024-09-14T11:21:13.971249+0000","last_became_active":"2024-09-14T10:45:45.714345+0000","last_became_peered":"2024-09-14T10:45:45.714345+0000","last_unstale":"2024-09-14T11:21:13.971249+0000","last_undegraded":"2024-09-14T11:21:13.971249+0000","last_fullsized":"2024-09-14T11:21:13.971249+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:55.678707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2395,"num_read_kb":2287,"num_write":454,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"260'295","reported_seq":951,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:04.028564+0000","last_change":"2024-09-14T10:45:43.689767+0000","last_active":"2024-09-14T11:21:04.028564+0000","last_peered":"2024-09-14T11:21:04.028564+0000","last_clean":"2024-09-14T11:21:04.028564+0000","last_became_active":"2024-09-14T10:45:43.689513+0000","last_became_peered":"2024-09-14T10:45:43.689513+0000","last_unstale":"2024-09-14T11:21:04.028564+0000","last_undegraded":"2024-09-14T11:21:04.028564+0000","last_fullsized":"2024-09-14T11:21:04.028564+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:37.766387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17619309,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":629,"num_read_kb":58875,"num_write":1138,"num_write_kb":34980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"260'909","reported_seq":2780,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.732830+0000","last_change":"2024-09-14T10:45:45.722332+0000","last_active":"2024-09-14T11:21:28.732830+0000","last_peered":"2024-09-14T11:21:28.732830+0000","last_clean":"2024-09-14T11:21:28.732830+0000","last_became_active":"2024-09-14T10:45:45.722048+0000","last_became_peered":"2024-09-14T10:45:45.722048+0000","last_unstale":"2024-09-14T11:21:28.732830+0000","last_undegraded":"2024-09-14T11:21:28.732830+0000","last_fullsized":"2024-09-14T11:21:28.732830+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":800,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:09.983695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4452,"num_read_kb":4058,"num_write":1175,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"260'296","reported_seq":930,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:14.812724+0000","last_change":"2024-09-14T10:45:43.690177+0000","last_active":"2024-09-14T11:21:14.812724+0000","last_peered":"2024-09-14T11:21:14.812724+0000","last_clean":"2024-09-14T11:21:14.812724+0000","last_became_active":"2024-09-14T10:45:43.689229+0000","last_became_peered":"2024-09-14T10:45:43.689229+0000","last_unstale":"2024-09-14T11:21:14.812724+0000","last_undegraded":"2024-09-14T11:21:14.812724+0000","last_fullsized":"2024-09-14T11:21:14.812724+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:41:27.105141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5709032,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":530,"num_read_kb":84854,"num_write":1084,"num_write_kb":20352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"260'522","reported_seq":2107,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:13.965056+0000","last_change":"2024-09-14T10:45:45.719274+0000","last_active":"2024-09-14T11:21:13.965056+0000","last_peered":"2024-09-14T11:21:13.965056+0000","last_clean":"2024-09-14T11:21:13.965056+0000","last_became_active":"2024-09-14T10:45:45.718978+0000","last_became_peered":"2024-09-14T10:45:45.718978+0000","last_unstale":"2024-09-14T11:21:13.965056+0000","last_undegraded":"2024-09-14T11:21:13.965056+0000","last_fullsized":"2024-09-14T11:21:13.965056+0000","mapping_epoch":26,"log_start":"260'500","ondisk_log_start":"260'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:26.609949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2761,"num_read_kb":2575,"num_write":634,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"260'330","reported_seq":960,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.138087+0000","last_change":"2024-09-14T10:45:43.687589+0000","last_active":"2024-09-14T11:22:51.138087+0000","last_peered":"2024-09-14T11:22:51.138087+0000","last_clean":"2024-09-14T11:22:51.138087+0000","last_became_active":"2024-09-14T10:45:43.687262+0000","last_became_peered":"2024-09-14T10:45:43.687262+0000","last_unstale":"2024-09-14T11:22:51.138087+0000","last_undegraded":"2024-09-14T11:22:51.138087+0000","last_fullsized":"2024-09-14T11:22:51.138087+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:56:05.018089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27309,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":673,"num_read_kb":42631,"num_write":1149,"num_write_kb":32664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"260'824","reported_seq":2512,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:15.867521+0000","last_change":"2024-09-14T10:45:45.721713+0000","last_active":"2024-09-14T11:21:15.867521+0000","last_peered":"2024-09-14T11:21:15.867521+0000","last_clean":"2024-09-14T11:21:15.867521+0000","last_became_active":"2024-09-14T10:45:45.721400+0000","last_became_peered":"2024-09-14T10:45:45.721400+0000","last_unstale":"2024-09-14T11:21:15.867521+0000","last_undegraded":"2024-09-14T11:21:15.867521+0000","last_fullsized":"2024-09-14T11:21:15.867521+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:10.944485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4476,"num_read_kb":4082,"num_write":1140,"num_write_kb":477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"260'1280","reported_seq":2915,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.732537+0000","last_change":"2024-09-14T10:45:45.710286+0000","last_active":"2024-09-14T11:21:28.732537+0000","last_peered":"2024-09-14T11:21:28.732537+0000","last_clean":"2024-09-14T11:21:28.732537+0000","last_became_active":"2024-09-14T10:45:45.710015+0000","last_became_peered":"2024-09-14T10:45:45.710015+0000","last_unstale":"2024-09-14T11:21:28.732537+0000","last_undegraded":"2024-09-14T11:21:28.732537+0000","last_fullsized":"2024-09-14T11:21:28.732537+0000","mapping_epoch":26,"log_start":"260'1200","ondisk_log_start":"260'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":1200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:23.780013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5907,"num_read_kb":5227,"num_write":1779,"num_write_kb":739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"260'291","reported_seq":892,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:58.073756+0000","last_change":"2024-09-14T10:45:43.678018+0000","last_active":"2024-09-14T11:20:58.073756+0000","last_peered":"2024-09-14T11:20:58.073756+0000","last_clean":"2024-09-14T11:20:58.073756+0000","last_became_active":"2024-09-14T10:45:43.677751+0000","last_became_peered":"2024-09-14T10:45:43.677751+0000","last_unstale":"2024-09-14T11:20:58.073756+0000","last_undegraded":"2024-09-14T11:20:58.073756+0000","last_fullsized":"2024-09-14T11:20:58.073756+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:31.249223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10836945,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":485,"num_read_kb":880,"num_write":1086,"num_write_kb":23836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"260'595","reported_seq":2269,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.326963+0000","last_change":"2024-09-14T10:45:45.714870+0000","last_active":"2024-09-14T11:21:28.326963+0000","last_peered":"2024-09-14T11:21:28.326963+0000","last_clean":"2024-09-14T11:21:28.326963+0000","last_became_active":"2024-09-14T10:45:45.714551+0000","last_became_peered":"2024-09-14T10:45:45.714551+0000","last_unstale":"2024-09-14T11:21:28.326963+0000","last_undegraded":"2024-09-14T11:21:28.326963+0000","last_fullsized":"2024-09-14T11:21:28.326963+0000","mapping_epoch":26,"log_start":"260'500","ondisk_log_start":"260'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":500,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:50.970272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3058,"num_read_kb":2815,"num_write":741,"num_write_kb":205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"260'267","reported_seq":894,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:02.226274+0000","last_change":"2024-09-14T10:45:43.680667+0000","last_active":"2024-09-14T11:22:02.226274+0000","last_peered":"2024-09-14T11:22:02.226274+0000","last_clean":"2024-09-14T11:22:02.226274+0000","last_became_active":"2024-09-14T10:45:43.680355+0000","last_became_peered":"2024-09-14T10:45:43.680355+0000","last_unstale":"2024-09-14T11:22:02.226274+0000","last_undegraded":"2024-09-14T11:22:02.226274+0000","last_fullsized":"2024-09-14T11:22:02.226274+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:57.516008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20278606,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":456,"num_read_kb":36293,"num_write":916,"num_write_kb":55095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"260'493","reported_seq":2162,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:10.106395+0000","last_change":"2024-09-14T10:45:45.721003+0000","last_active":"2024-09-14T11:21:10.106395+0000","last_peered":"2024-09-14T11:21:10.106395+0000","last_clean":"2024-09-14T11:21:10.106395+0000","last_became_active":"2024-09-14T10:45:45.720760+0000","last_became_peered":"2024-09-14T10:45:45.720760+0000","last_unstale":"2024-09-14T11:21:10.106395+0000","last_undegraded":"2024-09-14T11:21:10.106395+0000","last_fullsized":"2024-09-14T11:21:10.106395+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:01.564789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2631,"num_read_kb":2483,"num_write":574,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"260'315","reported_seq":990,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:10.458713+0000","last_change":"2024-09-14T10:45:43.684854+0000","last_active":"2024-09-14T11:21:10.458713+0000","last_peered":"2024-09-14T11:21:10.458713+0000","last_clean":"2024-09-14T11:21:10.458713+0000","last_became_active":"2024-09-14T10:45:43.684428+0000","last_became_peered":"2024-09-14T10:45:43.684428+0000","last_unstale":"2024-09-14T11:21:10.458713+0000","last_undegraded":"2024-09-14T11:21:10.458713+0000","last_fullsized":"2024-09-14T11:21:10.458713+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:19.142556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6726763,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":687,"num_read_kb":9043,"num_write":1153,"num_write_kb":18367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"260'482","reported_seq":2055,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:57.282685+0000","last_change":"2024-09-14T10:45:45.724646+0000","last_active":"2024-09-14T11:21:57.282685+0000","last_peered":"2024-09-14T11:21:57.282685+0000","last_clean":"2024-09-14T11:21:57.282685+0000","last_became_active":"2024-09-14T10:45:45.724302+0000","last_became_peered":"2024-09-14T10:45:45.724302+0000","last_unstale":"2024-09-14T11:21:57.282685+0000","last_undegraded":"2024-09-14T11:21:57.282685+0000","last_fullsized":"2024-09-14T11:21:57.282685+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:59.147972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2564,"num_read_kb":2400,"num_write":575,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"260'278","reported_seq":965,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:15.304782+0000","last_change":"2024-09-14T10:45:43.684077+0000","last_active":"2024-09-14T11:21:15.304782+0000","last_peered":"2024-09-14T11:21:15.304782+0000","last_clean":"2024-09-14T11:21:15.304782+0000","last_became_active":"2024-09-14T10:45:43.683797+0000","last_became_peered":"2024-09-14T10:45:43.683797+0000","last_unstale":"2024-09-14T11:21:15.304782+0000","last_undegraded":"2024-09-14T11:21:15.304782+0000","last_fullsized":"2024-09-14T11:21:15.304782+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:58.402146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5006161,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":659,"num_read_kb":8098,"num_write":1124,"num_write_kb":25345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"260'430","reported_seq":1966,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:57.282334+0000","last_change":"2024-09-14T10:45:45.723905+0000","last_active":"2024-09-14T11:21:57.282334+0000","last_peered":"2024-09-14T11:21:57.282334+0000","last_clean":"2024-09-14T11:21:57.282334+0000","last_became_active":"2024-09-14T10:45:45.723570+0000","last_became_peered":"2024-09-14T10:45:45.723570+0000","last_unstale":"2024-09-14T11:21:57.282334+0000","last_undegraded":"2024-09-14T11:21:57.282334+0000","last_fullsized":"2024-09-14T11:21:57.282334+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:29.680427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2400,"num_read_kb":2278,"num_write":489,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"260'416","reported_seq":1127,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.976345+0000","last_change":"2024-09-14T10:45:43.687914+0000","last_active":"2024-09-14T11:22:50.976345+0000","last_peered":"2024-09-14T11:22:50.976345+0000","last_clean":"2024-09-14T11:22:50.976345+0000","last_became_active":"2024-09-14T10:45:43.687585+0000","last_became_peered":"2024-09-14T10:45:43.687585+0000","last_unstale":"2024-09-14T11:22:50.976345+0000","last_undegraded":"2024-09-14T11:22:50.976345+0000","last_fullsized":"2024-09-14T11:22:50.976345+0000","mapping_epoch":23,"log_start":"260'400","ondisk_log_start":"260'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:00.103110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":649537,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":1117,"num_read_kb":1116,"num_write":1383,"num_write_kb":30799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"260'797","reported_seq":2444,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.833277+0000","last_change":"2024-09-14T10:45:45.714545+0000","last_active":"2024-09-14T11:22:42.833277+0000","last_peered":"2024-09-14T11:22:42.833277+0000","last_clean":"2024-09-14T11:22:42.833277+0000","last_became_active":"2024-09-14T10:45:45.714187+0000","last_became_peered":"2024-09-14T10:45:45.714187+0000","last_unstale":"2024-09-14T11:22:42.833277+0000","last_undegraded":"2024-09-14T11:22:42.833277+0000","last_fullsized":"2024-09-14T11:22:42.833277+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:45.790561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3909,"num_read_kb":3562,"num_write":1036,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"260'312","reported_seq":951,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.960383+0000","last_change":"2024-09-14T10:45:43.682640+0000","last_active":"2024-09-14T11:22:50.960383+0000","last_peered":"2024-09-14T11:22:50.960383+0000","last_clean":"2024-09-14T11:22:50.960383+0000","last_became_active":"2024-09-14T10:45:43.681680+0000","last_became_peered":"2024-09-14T10:45:43.681680+0000","last_unstale":"2024-09-14T11:22:50.960383+0000","last_undegraded":"2024-09-14T11:22:50.960383+0000","last_fullsized":"2024-09-14T11:22:50.960383+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:56.323253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7732508,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":539,"num_read_kb":80056,"num_write":1082,"num_write_kb":31213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"260'166","reported_seq":655,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.801186+0000","last_change":"2024-09-14T10:45:53.749801+0000","last_active":"2024-09-14T11:21:28.801186+0000","last_peered":"2024-09-14T11:21:28.801186+0000","last_clean":"2024-09-14T11:21:28.801186+0000","last_became_active":"2024-09-14T10:45:53.749495+0000","last_became_peered":"2024-09-14T10:45:53.749495+0000","last_unstale":"2024-09-14T11:21:28.801186+0000","last_undegraded":"2024-09-14T11:21:28.801186+0000","last_fullsized":"2024-09-14T11:21:28.801186+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:52.768692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":160,"num_read_kb":158,"num_write":391,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"260'882","reported_seq":2449,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.040798+0000","last_change":"2024-09-14T10:45:45.711094+0000","last_active":"2024-09-14T11:21:27.040798+0000","last_peered":"2024-09-14T11:21:27.040798+0000","last_clean":"2024-09-14T11:21:27.040798+0000","last_became_active":"2024-09-14T10:45:45.710830+0000","last_became_peered":"2024-09-14T10:45:45.710830+0000","last_unstale":"2024-09-14T11:21:27.040798+0000","last_undegraded":"2024-09-14T11:21:27.040798+0000","last_fullsized":"2024-09-14T11:21:27.040798+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":800,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:36:38.927707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5905,"num_read_kb":5530,"num_write":1368,"num_write_kb":537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"260'377","reported_seq":1052,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:09.499854+0000","last_change":"2024-09-14T10:45:43.684728+0000","last_active":"2024-09-14T11:21:09.499854+0000","last_peered":"2024-09-14T11:21:09.499854+0000","last_clean":"2024-09-14T11:21:09.499854+0000","last_became_active":"2024-09-14T10:45:43.684504+0000","last_became_peered":"2024-09-14T10:45:43.684504+0000","last_unstale":"2024-09-14T11:21:09.499854+0000","last_undegraded":"2024-09-14T11:21:09.499854+0000","last_fullsized":"2024-09-14T11:21:09.499854+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:34.311522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7237020,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":782,"num_read_kb":75776,"num_write":1362,"num_write_kb":37052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:37.113110+0000","last_change":"2024-09-14T10:45:47.730971+0000","last_active":"2024-09-14T11:19:37.113110+0000","last_peered":"2024-09-14T11:19:37.113110+0000","last_clean":"2024-09-14T11:19:37.113110+0000","last_became_active":"2024-09-14T10:45:47.730629+0000","last_became_peered":"2024-09-14T10:45:47.730629+0000","last_unstale":"2024-09-14T11:19:37.113110+0000","last_undegraded":"2024-09-14T11:19:37.113110+0000","last_fullsized":"2024-09-14T11:19:37.113110+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:32.300839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"260'333","reported_seq":920,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.380130+0000","last_change":"2024-09-14T10:45:49.734204+0000","last_active":"2024-09-14T11:22:50.380130+0000","last_peered":"2024-09-14T11:22:50.380130+0000","last_clean":"2024-09-14T11:22:50.380130+0000","last_became_active":"2024-09-14T10:45:49.733770+0000","last_became_peered":"2024-09-14T10:45:49.733770+0000","last_unstale":"2024-09-14T11:22:50.380130+0000","last_undegraded":"2024-09-14T11:22:50.380130+0000","last_fullsized":"2024-09-14T11:22:50.380130+0000","mapping_epoch":30,"log_start":"260'300","ondisk_log_start":"260'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:22:33.077712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49773,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":530,"num_read_kb":1113,"num_write":424,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":476,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:42.113693+0000","last_change":"2024-09-14T10:45:51.745748+0000","last_active":"2024-09-14T11:19:42.113693+0000","last_peered":"2024-09-14T11:19:42.113693+0000","last_clean":"2024-09-14T11:19:42.113693+0000","last_became_active":"2024-09-14T10:45:51.745410+0000","last_became_peered":"2024-09-14T10:45:51.745410+0000","last_unstale":"2024-09-14T11:19:42.113693+0000","last_undegraded":"2024-09-14T11:19:42.113693+0000","last_fullsized":"2024-09-14T11:19:42.113693+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:18.010792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"260'94","reported_seq":570,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:57.443244+0000","last_change":"2024-09-14T10:45:53.743811+0000","last_active":"2024-09-14T11:20:57.443244+0000","last_peered":"2024-09-14T11:20:57.443244+0000","last_clean":"2024-09-14T11:20:57.443244+0000","last_became_active":"2024-09-14T10:45:53.743472+0000","last_became_peered":"2024-09-14T10:45:53.743472+0000","last_unstale":"2024-09-14T11:20:57.443244+0000","last_undegraded":"2024-09-14T11:20:57.443244+0000","last_fullsized":"2024-09-14T11:20:57.443244+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:52.958224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":73,"num_read_kb":72,"num_write":215,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"260'380","reported_seq":1786,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.336678+0000","last_change":"2024-09-14T10:45:45.713778+0000","last_active":"2024-09-14T11:21:28.336678+0000","last_peered":"2024-09-14T11:21:28.336678+0000","last_clean":"2024-09-14T11:21:28.336678+0000","last_became_active":"2024-09-14T10:45:45.713502+0000","last_became_peered":"2024-09-14T10:45:45.713502+0000","last_unstale":"2024-09-14T11:21:28.336678+0000","last_undegraded":"2024-09-14T11:21:28.336678+0000","last_fullsized":"2024-09-14T11:21:28.336678+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:23.141736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2020,"num_read_kb":1909,"num_write":423,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"260'272","reported_seq":1001,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.965859+0000","last_change":"2024-09-14T10:45:43.684236+0000","last_active":"2024-09-14T11:22:50.965859+0000","last_peered":"2024-09-14T11:22:50.965859+0000","last_clean":"2024-09-14T11:22:50.965859+0000","last_became_active":"2024-09-14T10:45:43.683964+0000","last_became_peered":"2024-09-14T10:45:43.683964+0000","last_unstale":"2024-09-14T11:22:50.965859+0000","last_undegraded":"2024-09-14T11:22:50.965859+0000","last_fullsized":"2024-09-14T11:22:50.965859+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:17:40.024612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7426285,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":660,"num_read_kb":39643,"num_write":1046,"num_write_kb":23617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:36.108919+0000","last_change":"2024-09-14T10:45:47.730176+0000","last_active":"2024-09-14T11:18:36.108919+0000","last_peered":"2024-09-14T11:18:36.108919+0000","last_clean":"2024-09-14T11:18:36.108919+0000","last_became_active":"2024-09-14T10:45:47.729871+0000","last_became_peered":"2024-09-14T10:45:47.729871+0000","last_unstale":"2024-09-14T11:18:36.108919+0000","last_undegraded":"2024-09-14T11:18:36.108919+0000","last_fullsized":"2024-09-14T11:18:36.108919+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:34.557174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"260'84","reported_seq":592,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:16.298825+0000","last_change":"2024-09-14T10:45:49.733320+0000","last_active":"2024-09-14T11:21:16.298825+0000","last_peered":"2024-09-14T11:21:16.298825+0000","last_clean":"2024-09-14T11:21:16.298825+0000","last_became_active":"2024-09-14T10:45:49.732459+0000","last_became_peered":"2024-09-14T10:45:49.732459+0000","last_unstale":"2024-09-14T11:21:16.298825+0000","last_undegraded":"2024-09-14T11:21:16.298825+0000","last_fullsized":"2024-09-14T11:21:16.298825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:04.811455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":84,"num_read_kb":79,"num_write":56,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":476,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:42.113623+0000","last_change":"2024-09-14T10:45:51.746902+0000","last_active":"2024-09-14T11:19:42.113623+0000","last_peered":"2024-09-14T11:19:42.113623+0000","last_clean":"2024-09-14T11:19:42.113623+0000","last_became_active":"2024-09-14T10:45:51.746608+0000","last_became_peered":"2024-09-14T10:45:51.746608+0000","last_unstale":"2024-09-14T11:19:42.113623+0000","last_undegraded":"2024-09-14T11:19:42.113623+0000","last_fullsized":"2024-09-14T11:19:42.113623+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:13.144965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"260'127","reported_seq":616,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:14.680398+0000","last_change":"2024-09-14T10:45:53.752864+0000","last_active":"2024-09-14T11:21:14.680398+0000","last_peered":"2024-09-14T11:21:14.680398+0000","last_clean":"2024-09-14T11:21:14.680398+0000","last_became_active":"2024-09-14T10:45:53.752597+0000","last_became_peered":"2024-09-14T10:45:53.752597+0000","last_unstale":"2024-09-14T11:21:14.680398+0000","last_undegraded":"2024-09-14T11:21:14.680398+0000","last_fullsized":"2024-09-14T11:21:14.680398+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:09.921876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":152,"num_read_kb":142,"num_write":295,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"260'1282","reported_seq":2988,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:15.435417+0000","last_change":"2024-09-14T10:45:45.725999+0000","last_active":"2024-09-14T11:21:15.435417+0000","last_peered":"2024-09-14T11:21:15.435417+0000","last_clean":"2024-09-14T11:21:15.435417+0000","last_became_active":"2024-09-14T10:45:45.725335+0000","last_became_peered":"2024-09-14T10:45:45.725335+0000","last_unstale":"2024-09-14T11:21:15.435417+0000","last_undegraded":"2024-09-14T11:21:15.435417+0000","last_fullsized":"2024-09-14T11:21:15.435417+0000","mapping_epoch":26,"log_start":"260'1200","ondisk_log_start":"260'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":1200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:56:31.965780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5911,"num_read_kb":5224,"num_write":1759,"num_write_kb":730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"260'281","reported_seq":930,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:13.036893+0000","last_change":"2024-09-14T10:45:43.671411+0000","last_active":"2024-09-14T11:21:13.036893+0000","last_peered":"2024-09-14T11:21:13.036893+0000","last_clean":"2024-09-14T11:21:13.036893+0000","last_became_active":"2024-09-14T10:45:43.671096+0000","last_became_peered":"2024-09-14T10:45:43.671096+0000","last_unstale":"2024-09-14T11:21:13.036893+0000","last_undegraded":"2024-09-14T11:21:13.036893+0000","last_fullsized":"2024-09-14T11:21:13.036893+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:30.153850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11167161,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":615,"num_read_kb":57141,"num_write":1018,"num_write_kb":43933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:41.118430+0000","last_change":"2024-09-14T10:45:47.725982+0000","last_active":"2024-09-14T11:19:41.118430+0000","last_peered":"2024-09-14T11:19:41.118430+0000","last_clean":"2024-09-14T11:19:41.118430+0000","last_became_active":"2024-09-14T10:45:47.724723+0000","last_became_peered":"2024-09-14T10:45:47.724723+0000","last_unstale":"2024-09-14T11:19:41.118430+0000","last_undegraded":"2024-09-14T11:19:41.118430+0000","last_fullsized":"2024-09-14T11:19:41.118430+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:05.411328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"260'110","reported_seq":626,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:56.128174+0000","last_change":"2024-09-14T10:45:49.738230+0000","last_active":"2024-09-14T11:20:56.128174+0000","last_peered":"2024-09-14T11:20:56.128174+0000","last_clean":"2024-09-14T11:20:56.128174+0000","last_became_active":"2024-09-14T10:45:49.737651+0000","last_became_peered":"2024-09-14T10:45:49.737651+0000","last_unstale":"2024-09-14T11:20:56.128174+0000","last_undegraded":"2024-09-14T11:20:56.128174+0000","last_fullsized":"2024-09-14T11:20:56.128174+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:47.715854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":106,"num_write":82,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"260'803","reported_seq":4488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:43.741401+0000","last_change":"2024-09-14T10:45:51.746239+0000","last_active":"2024-09-14T11:22:43.741401+0000","last_peered":"2024-09-14T11:22:43.741401+0000","last_clean":"2024-09-14T11:22:43.741401+0000","last_became_active":"2024-09-14T10:45:51.745441+0000","last_became_peered":"2024-09-14T10:45:51.745441+0000","last_unstale":"2024-09-14T11:22:43.741401+0000","last_undegraded":"2024-09-14T11:22:43.741401+0000","last_fullsized":"2024-09-14T11:22:43.741401+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:37.532791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"260'211","reported_seq":1016,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.737613+0000","last_change":"2024-09-14T10:45:53.753718+0000","last_active":"2024-09-14T11:21:28.737613+0000","last_peered":"2024-09-14T11:21:28.737613+0000","last_clean":"2024-09-14T11:21:28.737613+0000","last_became_active":"2024-09-14T10:45:53.753389+0000","last_became_peered":"2024-09-14T10:45:53.753389+0000","last_unstale":"2024-09-14T11:21:28.737613+0000","last_undegraded":"2024-09-14T11:21:28.737613+0000","last_fullsized":"2024-09-14T11:21:28.737613+0000","mapping_epoch":34,"log_start":"260'200","ondisk_log_start":"260'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:01.726415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":623,"num_read_kb":614,"num_write":459,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"260'900","reported_seq":2535,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.336894+0000","last_change":"2024-09-14T10:45:45.726071+0000","last_active":"2024-09-14T11:21:28.336894+0000","last_peered":"2024-09-14T11:21:28.336894+0000","last_clean":"2024-09-14T11:21:28.336894+0000","last_became_active":"2024-09-14T10:45:45.725700+0000","last_became_peered":"2024-09-14T10:45:45.725700+0000","last_unstale":"2024-09-14T11:21:28.336894+0000","last_undegraded":"2024-09-14T11:21:28.336894+0000","last_fullsized":"2024-09-14T11:21:28.336894+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":800,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:18.814798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4396,"num_read_kb":3931,"num_write":1208,"num_write_kb":463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"260'314","reported_seq":953,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:43.904836+0000","last_change":"2024-09-14T10:45:43.683534+0000","last_active":"2024-09-14T11:20:43.904836+0000","last_peered":"2024-09-14T11:20:43.904836+0000","last_clean":"2024-09-14T11:20:43.904836+0000","last_became_active":"2024-09-14T10:45:43.683274+0000","last_became_peered":"2024-09-14T10:45:43.683274+0000","last_unstale":"2024-09-14T11:20:43.904836+0000","last_undegraded":"2024-09-14T11:20:43.904836+0000","last_fullsized":"2024-09-14T11:20:43.904836+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:02.033164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5574776,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":634,"num_read_kb":4530,"num_write":1072,"num_write_kb":39150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:37.113128+0000","last_change":"2024-09-14T10:45:47.729291+0000","last_active":"2024-09-14T11:19:37.113128+0000","last_peered":"2024-09-14T11:19:37.113128+0000","last_clean":"2024-09-14T11:19:37.113128+0000","last_became_active":"2024-09-14T10:45:47.729004+0000","last_became_peered":"2024-09-14T10:45:47.729004+0000","last_unstale":"2024-09-14T11:19:37.113128+0000","last_undegraded":"2024-09-14T11:19:37.113128+0000","last_fullsized":"2024-09-14T11:19:37.113128+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:50:40.551460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"260'252","reported_seq":791,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:05.007627+0000","last_change":"2024-09-14T10:45:49.729187+0000","last_active":"2024-09-14T11:22:05.007627+0000","last_peered":"2024-09-14T11:22:05.007627+0000","last_clean":"2024-09-14T11:22:05.007627+0000","last_became_active":"2024-09-14T10:45:49.728896+0000","last_became_peered":"2024-09-14T10:45:49.728896+0000","last_unstale":"2024-09-14T11:22:05.007627+0000","last_undegraded":"2024-09-14T11:22:05.007627+0000","last_fullsized":"2024-09-14T11:22:05.007627+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:09:59.076512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55057,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":431,"num_read_kb":926,"num_write":360,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"260'803","reported_seq":3875,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.304071+0000","last_change":"2024-09-14T10:45:51.745148+0000","last_active":"2024-09-14T11:22:50.304071+0000","last_peered":"2024-09-14T11:22:50.304071+0000","last_clean":"2024-09-14T11:22:50.304071+0000","last_became_active":"2024-09-14T10:45:51.744510+0000","last_became_peered":"2024-09-14T10:45:51.744510+0000","last_unstale":"2024-09-14T11:22:50.304071+0000","last_undegraded":"2024-09-14T11:22:50.304071+0000","last_fullsized":"2024-09-14T11:22:50.304071+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:37.874498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"260'638","reported_seq":2325,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.742160+0000","last_change":"2024-09-14T10:45:45.716820+0000","last_active":"2024-09-14T11:21:28.742160+0000","last_peered":"2024-09-14T11:21:28.742160+0000","last_clean":"2024-09-14T11:21:28.742160+0000","last_became_active":"2024-09-14T10:45:45.716537+0000","last_became_peered":"2024-09-14T10:45:45.716537+0000","last_unstale":"2024-09-14T11:21:28.742160+0000","last_undegraded":"2024-09-14T11:21:28.742160+0000","last_fullsized":"2024-09-14T11:21:28.742160+0000","mapping_epoch":26,"log_start":"260'600","ondisk_log_start":"260'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":600,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:58.190819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3192,"num_read_kb":2926,"num_write":775,"num_write_kb":229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"260'292","reported_seq":894,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.997857+0000","last_change":"2024-09-14T10:46:20.046168+0000","last_active":"2024-09-14T11:22:50.997857+0000","last_peered":"2024-09-14T11:22:50.997857+0000","last_clean":"2024-09-14T11:22:50.997857+0000","last_became_active":"2024-09-14T10:46:20.045945+0000","last_became_peered":"2024-09-14T10:46:20.045945+0000","last_unstale":"2024-09-14T11:22:50.997857+0000","last_undegraded":"2024-09-14T11:22:50.997857+0000","last_fullsized":"2024-09-14T11:22:50.997857+0000","mapping_epoch":37,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:32.371701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6293858,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":615,"num_read_kb":12757,"num_write":970,"num_write_kb":36887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":486,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:27.119742+0000","last_change":"2024-09-14T10:45:47.721721+0000","last_active":"2024-09-14T11:20:27.119742+0000","last_peered":"2024-09-14T11:20:27.119742+0000","last_clean":"2024-09-14T11:20:27.119742+0000","last_became_active":"2024-09-14T10:45:47.720639+0000","last_became_peered":"2024-09-14T10:45:47.720639+0000","last_unstale":"2024-09-14T11:20:27.119742+0000","last_undegraded":"2024-09-14T11:20:27.119742+0000","last_fullsized":"2024-09-14T11:20:27.119742+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:32.317587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"260'343","reported_seq":930,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.230665+0000","last_change":"2024-09-14T10:45:49.733109+0000","last_active":"2024-09-14T11:22:42.230665+0000","last_peered":"2024-09-14T11:22:42.230665+0000","last_clean":"2024-09-14T11:22:42.230665+0000","last_became_active":"2024-09-14T10:45:49.732754+0000","last_became_peered":"2024-09-14T10:45:49.732754+0000","last_unstale":"2024-09-14T11:22:42.230665+0000","last_undegraded":"2024-09-14T11:22:42.230665+0000","last_fullsized":"2024-09-14T11:22:42.230665+0000","mapping_epoch":30,"log_start":"260'300","ondisk_log_start":"260'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:34.312772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110456,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":559,"num_read_kb":1190,"num_write":454,"num_write_kb":374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":471,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:35.986676+0000","last_change":"2024-09-14T10:45:51.746554+0000","last_active":"2024-09-14T11:19:35.986676+0000","last_peered":"2024-09-14T11:19:35.986676+0000","last_clean":"2024-09-14T11:19:35.986676+0000","last_became_active":"2024-09-14T10:45:51.746282+0000","last_became_peered":"2024-09-14T10:45:51.746282+0000","last_unstale":"2024-09-14T11:19:35.986676+0000","last_undegraded":"2024-09-14T11:19:35.986676+0000","last_fullsized":"2024-09-14T11:19:35.986676+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:58.772084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"260'557","reported_seq":1354,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:43.728730+0000","last_change":"2024-09-14T10:45:53.756022+0000","last_active":"2024-09-14T11:22:43.728730+0000","last_peered":"2024-09-14T11:22:43.728730+0000","last_clean":"2024-09-14T11:22:43.728730+0000","last_became_active":"2024-09-14T10:45:53.755505+0000","last_became_peered":"2024-09-14T10:45:53.755505+0000","last_unstale":"2024-09-14T11:22:43.728730+0000","last_undegraded":"2024-09-14T11:22:43.728730+0000","last_fullsized":"2024-09-14T11:22:43.728730+0000","mapping_epoch":34,"log_start":"260'500","ondisk_log_start":"260'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:02.468804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1310,"num_read_kb":1299,"num_write":1164,"num_write_kb":395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"260'605","reported_seq":2241,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.048954+0000","last_change":"2024-09-14T10:45:45.727093+0000","last_active":"2024-09-14T11:21:27.048954+0000","last_peered":"2024-09-14T11:21:27.048954+0000","last_clean":"2024-09-14T11:21:27.048954+0000","last_became_active":"2024-09-14T10:45:45.726869+0000","last_became_peered":"2024-09-14T10:45:45.726869+0000","last_unstale":"2024-09-14T11:21:27.048954+0000","last_undegraded":"2024-09-14T11:21:27.048954+0000","last_fullsized":"2024-09-14T11:21:27.048954+0000","mapping_epoch":26,"log_start":"260'500","ondisk_log_start":"260'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":500,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:48.236280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3274,"num_read_kb":2999,"num_write":839,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"260'318","reported_seq":978,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:12.179037+0000","last_change":"2024-09-14T10:45:43.685334+0000","last_active":"2024-09-14T11:21:12.179037+0000","last_peered":"2024-09-14T11:21:12.179037+0000","last_clean":"2024-09-14T11:21:12.179037+0000","last_became_active":"2024-09-14T10:45:43.685087+0000","last_became_peered":"2024-09-14T10:45:43.685087+0000","last_unstale":"2024-09-14T11:21:12.179037+0000","last_undegraded":"2024-09-14T11:21:12.179037+0000","last_fullsized":"2024-09-14T11:21:12.179037+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:08.084059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1137367,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":670,"num_read_kb":49067,"num_write":1227,"num_write_kb":21177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":480,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:30.993267+0000","last_change":"2024-09-14T10:45:47.727776+0000","last_active":"2024-09-14T11:20:30.993267+0000","last_peered":"2024-09-14T11:20:30.993267+0000","last_clean":"2024-09-14T11:20:30.993267+0000","last_became_active":"2024-09-14T10:45:47.727250+0000","last_became_peered":"2024-09-14T10:45:47.727250+0000","last_unstale":"2024-09-14T11:20:30.993267+0000","last_undegraded":"2024-09-14T11:20:30.993267+0000","last_fullsized":"2024-09-14T11:20:30.993267+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:04.583303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"260'256","reported_seq":810,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.980108+0000","last_change":"2024-09-14T10:45:49.735628+0000","last_active":"2024-09-14T11:22:50.980108+0000","last_peered":"2024-09-14T11:22:50.980108+0000","last_clean":"2024-09-14T11:22:50.980108+0000","last_became_active":"2024-09-14T10:45:49.735124+0000","last_became_peered":"2024-09-14T10:45:49.735124+0000","last_unstale":"2024-09-14T11:22:50.980108+0000","last_undegraded":"2024-09-14T11:22:50.980108+0000","last_fullsized":"2024-09-14T11:22:50.980108+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:52.071424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45256,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":435,"num_read_kb":1035,"num_write":356,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:36.125222+0000","last_change":"2024-09-14T10:45:51.745912+0000","last_active":"2024-09-14T11:20:36.125222+0000","last_peered":"2024-09-14T11:20:36.125222+0000","last_clean":"2024-09-14T11:20:36.125222+0000","last_became_active":"2024-09-14T10:45:51.744757+0000","last_became_peered":"2024-09-14T10:45:51.744757+0000","last_unstale":"2024-09-14T11:20:36.125222+0000","last_undegraded":"2024-09-14T11:20:36.125222+0000","last_fullsized":"2024-09-14T11:20:36.125222+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:15.473173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"260'2449","reported_seq":4259,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:57.283800+0000","last_change":"2024-09-14T10:45:53.753015+0000","last_active":"2024-09-14T11:21:57.283800+0000","last_peered":"2024-09-14T11:21:57.283800+0000","last_clean":"2024-09-14T11:21:57.283800+0000","last_became_active":"2024-09-14T10:45:53.752708+0000","last_became_peered":"2024-09-14T10:45:53.752708+0000","last_unstale":"2024-09-14T11:21:57.283800+0000","last_undegraded":"2024-09-14T11:21:57.283800+0000","last_fullsized":"2024-09-14T11:21:57.283800+0000","mapping_epoch":34,"log_start":"260'2400","ondisk_log_start":"260'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":2400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:01:55.437550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6140,"num_read_kb":6145,"num_write":4932,"num_write_kb":1822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"260'757","reported_seq":2462,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.048715+0000","last_change":"2024-09-14T10:45:45.722496+0000","last_active":"2024-09-14T11:21:27.048715+0000","last_peered":"2024-09-14T11:21:27.048715+0000","last_clean":"2024-09-14T11:21:27.048715+0000","last_became_active":"2024-09-14T10:45:45.722006+0000","last_became_peered":"2024-09-14T10:45:45.722006+0000","last_unstale":"2024-09-14T11:21:27.048715+0000","last_undegraded":"2024-09-14T11:21:27.048715+0000","last_fullsized":"2024-09-14T11:21:27.048715+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:00.949810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4059,"num_read_kb":3717,"num_write":984,"num_write_kb":359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"260'303","reported_seq":941,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:26.619307+0000","last_change":"2024-09-14T10:45:43.676243+0000","last_active":"2024-09-14T11:21:26.619307+0000","last_peered":"2024-09-14T11:21:26.619307+0000","last_clean":"2024-09-14T11:21:26.619307+0000","last_became_active":"2024-09-14T10:45:43.675954+0000","last_became_peered":"2024-09-14T10:45:43.675954+0000","last_unstale":"2024-09-14T11:21:26.619307+0000","last_undegraded":"2024-09-14T11:21:26.619307+0000","last_fullsized":"2024-09-14T11:21:26.619307+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:56.905528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17559214,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":579,"num_read_kb":32892,"num_write":1070,"num_write_kb":70045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"36'5","reported_seq":958,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.270306+0000","last_change":"2024-09-14T10:45:47.723683+0000","last_active":"2024-09-14T11:22:50.270306+0000","last_peered":"2024-09-14T11:22:50.270306+0000","last_clean":"2024-09-14T11:22:50.270306+0000","last_became_active":"2024-09-14T10:45:47.723389+0000","last_became_peered":"2024-09-14T10:45:47.723389+0000","last_unstale":"2024-09-14T11:22:50.270306+0000","last_undegraded":"2024-09-14T11:22:50.270306+0000","last_fullsized":"2024-09-14T11:22:50.270306+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:23.601158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"260'267","reported_seq":823,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.015391+0000","last_change":"2024-09-14T10:45:49.729401+0000","last_active":"2024-09-14T11:22:42.015391+0000","last_peered":"2024-09-14T11:22:42.015391+0000","last_clean":"2024-09-14T11:22:42.015391+0000","last_became_active":"2024-09-14T10:45:49.729120+0000","last_became_peered":"2024-09-14T10:45:49.729120+0000","last_unstale":"2024-09-14T11:22:42.015391+0000","last_undegraded":"2024-09-14T11:22:42.015391+0000","last_fullsized":"2024-09-14T11:22:42.015391+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:30.995395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50035,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":431,"num_read_kb":873,"num_write":348,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"260'803","reported_seq":2503,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.305325+0000","last_change":"2024-09-14T10:45:51.745170+0000","last_active":"2024-09-14T11:22:50.305325+0000","last_peered":"2024-09-14T11:22:50.305325+0000","last_clean":"2024-09-14T11:22:50.305325+0000","last_became_active":"2024-09-14T10:45:51.744869+0000","last_became_peered":"2024-09-14T10:45:51.744869+0000","last_unstale":"2024-09-14T11:22:50.305325+0000","last_undegraded":"2024-09-14T11:22:50.305325+0000","last_fullsized":"2024-09-14T11:22:50.305325+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:26.188815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"260'164","reported_seq":638,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.837357+0000","last_change":"2024-09-14T10:45:53.755630+0000","last_active":"2024-09-14T11:22:42.837357+0000","last_peered":"2024-09-14T11:22:42.837357+0000","last_clean":"2024-09-14T11:22:42.837357+0000","last_became_active":"2024-09-14T10:45:53.755367+0000","last_became_peered":"2024-09-14T10:45:53.755367+0000","last_unstale":"2024-09-14T11:22:42.837357+0000","last_undegraded":"2024-09-14T11:22:42.837357+0000","last_fullsized":"2024-09-14T11:22:42.837357+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:07:14.533708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":815,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":135,"num_read_kb":134,"num_write":407,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"260'761","reported_seq":2252,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:15.867801+0000","last_change":"2024-09-14T10:45:45.720145+0000","last_active":"2024-09-14T11:21:15.867801+0000","last_peered":"2024-09-14T11:21:15.867801+0000","last_clean":"2024-09-14T11:21:15.867801+0000","last_became_active":"2024-09-14T10:45:45.719864+0000","last_became_peered":"2024-09-14T10:45:45.719864+0000","last_unstale":"2024-09-14T11:21:15.867801+0000","last_undegraded":"2024-09-14T11:21:15.867801+0000","last_fullsized":"2024-09-14T11:21:15.867801+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:09.038651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3610,"num_read_kb":3266,"num_write":990,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"260'283","reported_seq":908,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.279138+0000","last_change":"2024-09-14T10:45:43.681378+0000","last_active":"2024-09-14T11:22:42.279138+0000","last_peered":"2024-09-14T11:22:42.279138+0000","last_clean":"2024-09-14T11:22:42.279138+0000","last_became_active":"2024-09-14T10:45:43.681137+0000","last_became_peered":"2024-09-14T10:45:43.681137+0000","last_unstale":"2024-09-14T11:22:42.279138+0000","last_undegraded":"2024-09-14T11:22:42.279138+0000","last_fullsized":"2024-09-14T11:22:42.279138+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:46.118247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5577595,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":462,"num_read_kb":31157,"num_write":977,"num_write_kb":37353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":480,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:40.994524+0000","last_change":"2024-09-14T10:45:47.730225+0000","last_active":"2024-09-14T11:20:40.994524+0000","last_peered":"2024-09-14T11:20:40.994524+0000","last_clean":"2024-09-14T11:20:40.994524+0000","last_became_active":"2024-09-14T10:45:47.729815+0000","last_became_peered":"2024-09-14T10:45:47.729815+0000","last_unstale":"2024-09-14T11:20:40.994524+0000","last_undegraded":"2024-09-14T11:20:40.994524+0000","last_fullsized":"2024-09-14T11:20:40.994524+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:42.373217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"260'510","reported_seq":1126,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.091392+0000","last_change":"2024-09-14T10:45:49.736189+0000","last_active":"2024-09-14T11:22:51.091392+0000","last_peered":"2024-09-14T11:22:51.091392+0000","last_clean":"2024-09-14T11:22:51.091392+0000","last_became_active":"2024-09-14T10:45:49.735297+0000","last_became_peered":"2024-09-14T10:45:49.735297+0000","last_unstale":"2024-09-14T11:22:51.091392+0000","last_undegraded":"2024-09-14T11:22:51.091392+0000","last_fullsized":"2024-09-14T11:22:51.091392+0000","mapping_epoch":30,"log_start":"260'400","ondisk_log_start":"260'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:32.962766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93593,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":881,"num_read_kb":2160,"num_write":740,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":471,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:31.246681+0000","last_change":"2024-09-14T10:45:51.749364+0000","last_active":"2024-09-14T11:20:31.246681+0000","last_peered":"2024-09-14T11:20:31.246681+0000","last_clean":"2024-09-14T11:20:31.246681+0000","last_became_active":"2024-09-14T10:45:51.749045+0000","last_became_peered":"2024-09-14T10:45:51.749045+0000","last_unstale":"2024-09-14T11:20:31.246681+0000","last_undegraded":"2024-09-14T11:20:31.246681+0000","last_fullsized":"2024-09-14T11:20:31.246681+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:03.211664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"260'125","reported_seq":630,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:13.515424+0000","last_change":"2024-09-14T10:45:53.752016+0000","last_active":"2024-09-14T11:21:13.515424+0000","last_peered":"2024-09-14T11:21:13.515424+0000","last_clean":"2024-09-14T11:21:13.515424+0000","last_became_active":"2024-09-14T10:45:53.751736+0000","last_became_peered":"2024-09-14T10:45:53.751736+0000","last_unstale":"2024-09-14T11:21:13.515424+0000","last_undegraded":"2024-09-14T11:21:13.515424+0000","last_fullsized":"2024-09-14T11:21:13.515424+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:32.284762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":704,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":191,"num_read_kb":171,"num_write":290,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"260'1189","reported_seq":2739,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.835801+0000","last_change":"2024-09-14T10:45:45.714998+0000","last_active":"2024-09-14T11:22:42.835801+0000","last_peered":"2024-09-14T11:22:42.835801+0000","last_clean":"2024-09-14T11:22:42.835801+0000","last_became_active":"2024-09-14T10:45:45.714723+0000","last_became_peered":"2024-09-14T10:45:45.714723+0000","last_unstale":"2024-09-14T11:22:42.835801+0000","last_undegraded":"2024-09-14T11:22:42.835801+0000","last_fullsized":"2024-09-14T11:22:42.835801+0000","mapping_epoch":26,"log_start":"260'1100","ondisk_log_start":"260'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":1100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:09:48.211216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5470,"num_read_kb":4821,"num_write":1659,"num_write_kb":709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"260'332","reported_seq":955,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.894726+0000","last_change":"2024-09-14T10:45:43.686869+0000","last_active":"2024-09-14T11:22:50.894726+0000","last_peered":"2024-09-14T11:22:50.894726+0000","last_clean":"2024-09-14T11:22:50.894726+0000","last_became_active":"2024-09-14T10:45:43.686531+0000","last_became_peered":"2024-09-14T10:45:43.686531+0000","last_unstale":"2024-09-14T11:22:50.894726+0000","last_undegraded":"2024-09-14T11:22:50.894726+0000","last_fullsized":"2024-09-14T11:22:50.894726+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:55.909629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1173861,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":640,"num_read_kb":7607,"num_write":1231,"num_write_kb":48356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":481,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:35.993761+0000","last_change":"2024-09-14T10:45:47.728475+0000","last_active":"2024-09-14T11:19:35.993761+0000","last_peered":"2024-09-14T11:19:35.993761+0000","last_clean":"2024-09-14T11:19:35.993761+0000","last_became_active":"2024-09-14T10:45:47.728213+0000","last_became_peered":"2024-09-14T10:45:47.728213+0000","last_unstale":"2024-09-14T11:19:35.993761+0000","last_undegraded":"2024-09-14T11:19:35.993761+0000","last_fullsized":"2024-09-14T11:19:35.993761+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:31.424129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"260'259","reported_seq":812,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:52.131713+0000","last_change":"2024-09-14T10:45:49.733110+0000","last_active":"2024-09-14T11:21:52.131713+0000","last_peered":"2024-09-14T11:21:52.131713+0000","last_clean":"2024-09-14T11:21:52.131713+0000","last_became_active":"2024-09-14T10:45:49.732813+0000","last_became_peered":"2024-09-14T10:45:49.732813+0000","last_unstale":"2024-09-14T11:21:52.131713+0000","last_undegraded":"2024-09-14T11:21:52.131713+0000","last_fullsized":"2024-09-14T11:21:52.131713+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:14.432782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49817,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":422,"num_read_kb":832,"num_write":384,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":473,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:45.995350+0000","last_change":"2024-09-14T10:45:51.748689+0000","last_active":"2024-09-14T11:19:45.995350+0000","last_peered":"2024-09-14T11:19:45.995350+0000","last_clean":"2024-09-14T11:19:45.995350+0000","last_became_active":"2024-09-14T10:45:51.748381+0000","last_became_peered":"2024-09-14T10:45:51.748381+0000","last_unstale":"2024-09-14T11:19:45.995350+0000","last_undegraded":"2024-09-14T11:19:45.995350+0000","last_fullsized":"2024-09-14T11:19:45.995350+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:53.908296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"260'98","reported_seq":567,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:56.259131+0000","last_change":"2024-09-14T10:45:53.755248+0000","last_active":"2024-09-14T11:21:56.259131+0000","last_peered":"2024-09-14T11:21:56.259131+0000","last_clean":"2024-09-14T11:21:56.259131+0000","last_became_active":"2024-09-14T10:45:53.755022+0000","last_became_peered":"2024-09-14T10:45:53.755022+0000","last_unstale":"2024-09-14T11:21:56.259131+0000","last_undegraded":"2024-09-14T11:21:56.259131+0000","last_fullsized":"2024-09-14T11:21:56.259131+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:21.675722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":73,"num_read_kb":72,"num_write":223,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"260'435","reported_seq":1975,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.049003+0000","last_change":"2024-09-14T10:45:45.710662+0000","last_active":"2024-09-14T11:21:27.049003+0000","last_peered":"2024-09-14T11:21:27.049003+0000","last_clean":"2024-09-14T11:21:27.049003+0000","last_became_active":"2024-09-14T10:45:45.710367+0000","last_became_peered":"2024-09-14T10:45:45.710367+0000","last_unstale":"2024-09-14T11:21:27.049003+0000","last_undegraded":"2024-09-14T11:21:27.049003+0000","last_fullsized":"2024-09-14T11:21:27.049003+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:39:23.616400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2526,"num_read_kb":2387,"num_write":527,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"260'269","reported_seq":952,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:05.833584+0000","last_change":"2024-09-14T10:45:43.676790+0000","last_active":"2024-09-14T11:21:05.833584+0000","last_peered":"2024-09-14T11:21:05.833584+0000","last_clean":"2024-09-14T11:21:05.833584+0000","last_became_active":"2024-09-14T10:45:43.676514+0000","last_became_peered":"2024-09-14T10:45:43.676514+0000","last_unstale":"2024-09-14T11:21:05.833584+0000","last_undegraded":"2024-09-14T11:21:05.833584+0000","last_fullsized":"2024-09-14T11:21:05.833584+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:19.891010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12217243,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":591,"num_read_kb":125837,"num_write":1010,"num_write_kb":34909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:36.239100+0000","last_change":"2024-09-14T10:45:47.728092+0000","last_active":"2024-09-14T11:19:36.239100+0000","last_peered":"2024-09-14T11:19:36.239100+0000","last_clean":"2024-09-14T11:19:36.239100+0000","last_became_active":"2024-09-14T10:45:47.727632+0000","last_became_peered":"2024-09-14T10:45:47.727632+0000","last_unstale":"2024-09-14T11:19:36.239100+0000","last_undegraded":"2024-09-14T11:19:36.239100+0000","last_fullsized":"2024-09-14T11:19:36.239100+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:44.526326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"260'292","reported_seq":851,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.875892+0000","last_change":"2024-09-14T10:45:49.737975+0000","last_active":"2024-09-14T11:22:50.875892+0000","last_peered":"2024-09-14T11:22:50.875892+0000","last_clean":"2024-09-14T11:22:50.875892+0000","last_became_active":"2024-09-14T10:45:49.737690+0000","last_became_peered":"2024-09-14T10:45:49.737690+0000","last_unstale":"2024-09-14T11:22:50.875892+0000","last_undegraded":"2024-09-14T11:22:50.875892+0000","last_fullsized":"2024-09-14T11:22:50.875892+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:15.403726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69554,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":489,"num_read_kb":1163,"num_write":398,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"260'777","reported_seq":2019,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.300621+0000","last_change":"2024-09-14T10:45:51.749775+0000","last_active":"2024-09-14T11:22:50.300621+0000","last_peered":"2024-09-14T11:22:50.300621+0000","last_clean":"2024-09-14T11:22:50.300621+0000","last_became_active":"2024-09-14T10:45:51.749478+0000","last_became_peered":"2024-09-14T10:45:51.749478+0000","last_unstale":"2024-09-14T11:22:50.300621+0000","last_undegraded":"2024-09-14T11:22:50.300621+0000","last_fullsized":"2024-09-14T11:22:50.300621+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:13:43.438242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"260'128","reported_seq":609,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:13.969218+0000","last_change":"2024-09-14T10:45:53.746737+0000","last_active":"2024-09-14T11:21:13.969218+0000","last_peered":"2024-09-14T11:21:13.969218+0000","last_clean":"2024-09-14T11:21:13.969218+0000","last_became_active":"2024-09-14T10:45:53.746254+0000","last_became_peered":"2024-09-14T10:45:53.746254+0000","last_unstale":"2024-09-14T11:21:13.969218+0000","last_undegraded":"2024-09-14T11:21:13.969218+0000","last_fullsized":"2024-09-14T11:21:13.969218+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:28:26.210153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1445,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":145,"num_read_kb":134,"num_write":327,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"260'483","reported_seq":2054,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.840774+0000","last_change":"2024-09-14T10:45:45.720938+0000","last_active":"2024-09-14T11:22:42.840774+0000","last_peered":"2024-09-14T11:22:42.840774+0000","last_clean":"2024-09-14T11:22:42.840774+0000","last_became_active":"2024-09-14T10:45:45.720660+0000","last_became_peered":"2024-09-14T10:45:45.720660+0000","last_unstale":"2024-09-14T11:22:42.840774+0000","last_undegraded":"2024-09-14T11:22:42.840774+0000","last_fullsized":"2024-09-14T11:22:42.840774+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:36.468993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2593,"num_read_kb":2426,"num_write":578,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"260'263","reported_seq":871,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:26.811434+0000","last_change":"2024-09-14T10:45:43.690826+0000","last_active":"2024-09-14T11:21:26.811434+0000","last_peered":"2024-09-14T11:21:26.811434+0000","last_clean":"2024-09-14T11:21:26.811434+0000","last_became_active":"2024-09-14T10:45:43.690517+0000","last_became_peered":"2024-09-14T10:45:43.690517+0000","last_unstale":"2024-09-14T11:21:26.811434+0000","last_undegraded":"2024-09-14T11:21:26.811434+0000","last_fullsized":"2024-09-14T11:21:26.811434+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:17.734297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15106390,"num_objects":87,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":442,"num_read_kb":51926,"num_write":968,"num_write_kb":23808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1436,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:43.665589+0000","last_change":"2024-09-14T10:45:47.721307+0000","last_active":"2024-09-14T11:22:43.665589+0000","last_peered":"2024-09-14T11:22:43.665589+0000","last_clean":"2024-09-14T11:22:43.665589+0000","last_became_active":"2024-09-14T10:45:47.720716+0000","last_became_peered":"2024-09-14T10:45:47.720716+0000","last_unstale":"2024-09-14T11:22:43.665589+0000","last_undegraded":"2024-09-14T11:22:43.665589+0000","last_fullsized":"2024-09-14T11:22:43.665589+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:49.138193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":949,"num_read_kb":949,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"260'68","reported_seq":563,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:13.520750+0000","last_change":"2024-09-14T10:45:49.733374+0000","last_active":"2024-09-14T11:21:13.520750+0000","last_peered":"2024-09-14T11:21:13.520750+0000","last_clean":"2024-09-14T11:21:13.520750+0000","last_became_active":"2024-09-14T10:45:49.732913+0000","last_became_peered":"2024-09-14T10:45:49.732913+0000","last_unstale":"2024-09-14T11:21:13.520750+0000","last_undegraded":"2024-09-14T11:21:13.520750+0000","last_fullsized":"2024-09-14T11:21:13.520750+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:41.223364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":64,"num_read_kb":57,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"260'794","reported_seq":2411,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:43.919284+0000","last_change":"2024-09-14T10:45:51.741412+0000","last_active":"2024-09-14T11:22:43.919284+0000","last_peered":"2024-09-14T11:22:43.919284+0000","last_clean":"2024-09-14T11:22:43.919284+0000","last_became_active":"2024-09-14T10:45:51.741102+0000","last_became_peered":"2024-09-14T10:45:51.741102+0000","last_unstale":"2024-09-14T11:22:43.919284+0000","last_undegraded":"2024-09-14T11:22:43.919284+0000","last_fullsized":"2024-09-14T11:22:43.919284+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:08.256488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"260'150","reported_seq":656,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:13.516830+0000","last_change":"2024-09-14T10:45:53.752456+0000","last_active":"2024-09-14T11:21:13.516830+0000","last_peered":"2024-09-14T11:21:13.516830+0000","last_clean":"2024-09-14T11:21:13.516830+0000","last_became_active":"2024-09-14T10:45:53.752100+0000","last_became_peered":"2024-09-14T10:45:53.752100+0000","last_unstale":"2024-09-14T11:21:13.516830+0000","last_undegraded":"2024-09-14T11:21:13.516830+0000","last_fullsized":"2024-09-14T11:21:13.516830+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:44.647729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":861,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":268,"num_read_kb":228,"num_write":378,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"260'468","reported_seq":2069,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:16.297144+0000","last_change":"2024-09-14T10:45:45.719579+0000","last_active":"2024-09-14T11:21:16.297144+0000","last_peered":"2024-09-14T11:21:16.297144+0000","last_clean":"2024-09-14T11:21:16.297144+0000","last_became_active":"2024-09-14T10:45:45.719221+0000","last_became_peered":"2024-09-14T10:45:45.719221+0000","last_unstale":"2024-09-14T11:21:16.297144+0000","last_undegraded":"2024-09-14T11:21:16.297144+0000","last_fullsized":"2024-09-14T11:21:16.297144+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:24.645466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2509,"num_read_kb":2365,"num_write":566,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"260'302","reported_seq":904,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.099583+0000","last_change":"2024-09-14T10:45:43.690704+0000","last_active":"2024-09-14T11:22:51.099583+0000","last_peered":"2024-09-14T11:22:51.099583+0000","last_clean":"2024-09-14T11:22:51.099583+0000","last_became_active":"2024-09-14T10:45:43.690417+0000","last_became_peered":"2024-09-14T10:45:43.690417+0000","last_unstale":"2024-09-14T11:22:51.099583+0000","last_undegraded":"2024-09-14T11:22:51.099583+0000","last_fullsized":"2024-09-14T11:22:51.099583+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:28.703262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1309,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":484,"num_read_kb":28260,"num_write":948,"num_write_kb":36225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":479,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:32.112331+0000","last_change":"2024-09-14T10:45:47.731129+0000","last_active":"2024-09-14T11:19:32.112331+0000","last_peered":"2024-09-14T11:19:32.112331+0000","last_clean":"2024-09-14T11:19:32.112331+0000","last_became_active":"2024-09-14T10:45:47.730790+0000","last_became_peered":"2024-09-14T10:45:47.730790+0000","last_unstale":"2024-09-14T11:19:32.112331+0000","last_undegraded":"2024-09-14T11:19:32.112331+0000","last_fullsized":"2024-09-14T11:19:32.112331+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:38.545867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"260'319","reported_seq":900,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:52.131679+0000","last_change":"2024-09-14T10:45:49.735771+0000","last_active":"2024-09-14T11:21:52.131679+0000","last_peered":"2024-09-14T11:21:52.131679+0000","last_clean":"2024-09-14T11:21:52.131679+0000","last_became_active":"2024-09-14T10:45:49.735482+0000","last_became_peered":"2024-09-14T10:45:49.735482+0000","last_unstale":"2024-09-14T11:21:52.131679+0000","last_undegraded":"2024-09-14T11:21:52.131679+0000","last_fullsized":"2024-09-14T11:21:52.131679+0000","mapping_epoch":30,"log_start":"260'300","ondisk_log_start":"260'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:18:04.742025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56235,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":525,"num_read_kb":1022,"num_write":420,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":468,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:39.989653+0000","last_change":"2024-09-14T10:45:51.750926+0000","last_active":"2024-09-14T11:19:39.989653+0000","last_peered":"2024-09-14T11:19:39.989653+0000","last_clean":"2024-09-14T11:19:39.989653+0000","last_became_active":"2024-09-14T10:45:51.750669+0000","last_became_peered":"2024-09-14T10:45:51.750669+0000","last_unstale":"2024-09-14T11:19:39.989653+0000","last_undegraded":"2024-09-14T11:19:39.989653+0000","last_fullsized":"2024-09-14T11:19:39.989653+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:54.215538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"260'118","reported_seq":594,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.200888+0000","last_change":"2024-09-14T10:45:53.749127+0000","last_active":"2024-09-14T11:21:28.200888+0000","last_peered":"2024-09-14T11:21:28.200888+0000","last_clean":"2024-09-14T11:21:28.200888+0000","last_became_active":"2024-09-14T10:45:53.748865+0000","last_became_peered":"2024-09-14T10:45:53.748865+0000","last_unstale":"2024-09-14T11:21:28.200888+0000","last_undegraded":"2024-09-14T11:21:28.200888+0000","last_fullsized":"2024-09-14T11:21:28.200888+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:29.632424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":116,"num_write":279,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"260'612","reported_seq":2403,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.832394+0000","last_change":"2024-09-14T10:45:45.716546+0000","last_active":"2024-09-14T11:22:42.832394+0000","last_peered":"2024-09-14T11:22:42.832394+0000","last_clean":"2024-09-14T11:22:42.832394+0000","last_became_active":"2024-09-14T10:45:45.716236+0000","last_became_peered":"2024-09-14T10:45:45.716236+0000","last_unstale":"2024-09-14T11:22:42.832394+0000","last_undegraded":"2024-09-14T11:22:42.832394+0000","last_fullsized":"2024-09-14T11:22:42.832394+0000","mapping_epoch":26,"log_start":"260'600","ondisk_log_start":"260'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":600,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:59:19.965279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3315,"num_read_kb":3084,"num_write":730,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":601,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:37.112513+0000","last_change":"2024-09-14T10:45:28.986498+0000","last_active":"2024-09-14T11:19:37.112513+0000","last_peered":"2024-09-14T11:19:37.112513+0000","last_clean":"2024-09-14T11:19:37.112513+0000","last_became_active":"2024-09-14T10:45:28.985499+0000","last_became_peered":"2024-09-14T10:45:28.985499+0000","last_unstale":"2024-09-14T11:19:37.112513+0000","last_undegraded":"2024-09-14T11:19:37.112513+0000","last_fullsized":"2024-09-14T11:19:37.112513+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:27.525313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:27.525313+0000","last_clean_scrub_stamp":"2024-09-14T10:45:27.525313+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:42:06.434476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":504,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:57.106903+0000","last_change":"2024-09-14T10:45:35.579820+0000","last_active":"2024-09-14T11:18:57.106903+0000","last_peered":"2024-09-14T11:18:57.106903+0000","last_clean":"2024-09-14T11:18:57.106903+0000","last_became_active":"2024-09-14T10:45:33.610592+0000","last_became_peered":"2024-09-14T10:45:33.610592+0000","last_unstale":"2024-09-14T11:18:57.106903+0000","last_undegraded":"2024-09-14T11:18:57.106903+0000","last_fullsized":"2024-09-14T11:18:57.106903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_clean_scrub_stamp":"2024-09-14T10:45:32.551765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:46:36.542821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043055799999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"260'260","reported_seq":899,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.113170+0000","last_change":"2024-09-14T10:45:43.690581+0000","last_active":"2024-09-14T11:22:51.113170+0000","last_peered":"2024-09-14T11:22:51.113170+0000","last_clean":"2024-09-14T11:22:51.113170+0000","last_became_active":"2024-09-14T10:45:43.690248+0000","last_became_peered":"2024-09-14T10:45:43.690248+0000","last_unstale":"2024-09-14T11:22:51.113170+0000","last_undegraded":"2024-09-14T11:22:51.113170+0000","last_fullsized":"2024-09-14T11:22:51.113170+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:27.312124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243097,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":533,"num_read_kb":56771,"num_write":932,"num_write_kb":24880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:07.204339+0000","last_change":"2024-09-14T10:45:47.723764+0000","last_active":"2024-09-14T11:19:07.204339+0000","last_peered":"2024-09-14T11:19:07.204339+0000","last_clean":"2024-09-14T11:19:07.204339+0000","last_became_active":"2024-09-14T10:45:47.723495+0000","last_became_peered":"2024-09-14T10:45:47.723495+0000","last_unstale":"2024-09-14T11:19:07.204339+0000","last_undegraded":"2024-09-14T11:19:07.204339+0000","last_fullsized":"2024-09-14T11:19:07.204339+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:28.951657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"260'728","reported_seq":1396,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:43.715128+0000","last_change":"2024-09-14T10:45:49.734638+0000","last_active":"2024-09-14T11:22:43.715128+0000","last_peered":"2024-09-14T11:22:43.715128+0000","last_clean":"2024-09-14T11:22:43.715128+0000","last_became_active":"2024-09-14T10:45:49.733774+0000","last_became_peered":"2024-09-14T10:45:49.733774+0000","last_unstale":"2024-09-14T11:22:43.715128+0000","last_undegraded":"2024-09-14T11:22:43.715128+0000","last_fullsized":"2024-09-14T11:22:43.715128+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":700,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:45.811248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":193368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1440,"num_read_kb":3082,"num_write":1348,"num_write_kb":1217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":471,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:31.246761+0000","last_change":"2024-09-14T10:45:51.745875+0000","last_active":"2024-09-14T11:20:31.246761+0000","last_peered":"2024-09-14T11:20:31.246761+0000","last_clean":"2024-09-14T11:20:31.246761+0000","last_became_active":"2024-09-14T10:45:51.745607+0000","last_became_peered":"2024-09-14T10:45:51.745607+0000","last_unstale":"2024-09-14T11:20:31.246761+0000","last_undegraded":"2024-09-14T11:20:31.246761+0000","last_fullsized":"2024-09-14T11:20:31.246761+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:12.059394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"260'234","reported_seq":922,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.747723+0000","last_change":"2024-09-14T10:45:53.751918+0000","last_active":"2024-09-14T11:21:28.747723+0000","last_peered":"2024-09-14T11:21:28.747723+0000","last_clean":"2024-09-14T11:21:28.747723+0000","last_became_active":"2024-09-14T10:45:53.751651+0000","last_became_peered":"2024-09-14T10:45:53.751651+0000","last_unstale":"2024-09-14T11:21:28.747723+0000","last_undegraded":"2024-09-14T11:21:28.747723+0000","last_fullsized":"2024-09-14T11:21:28.747723+0000","mapping_epoch":34,"log_start":"260'200","ondisk_log_start":"260'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:07.313069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":417,"num_read_kb":415,"num_write":468,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"260'500","reported_seq":2079,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:16.297332+0000","last_change":"2024-09-14T10:45:45.721927+0000","last_active":"2024-09-14T11:21:16.297332+0000","last_peered":"2024-09-14T11:21:16.297332+0000","last_clean":"2024-09-14T11:21:16.297332+0000","last_became_active":"2024-09-14T10:45:45.721633+0000","last_became_peered":"2024-09-14T10:45:45.721633+0000","last_unstale":"2024-09-14T11:21:16.297332+0000","last_undegraded":"2024-09-14T11:21:16.297332+0000","last_fullsized":"2024-09-14T11:21:16.297332+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:23.991533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2741,"num_read_kb":2557,"num_write":632,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":504,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:42.113836+0000","last_change":"2024-09-14T10:45:35.580149+0000","last_active":"2024-09-14T11:19:42.113836+0000","last_peered":"2024-09-14T11:19:42.113836+0000","last_clean":"2024-09-14T11:19:42.113836+0000","last_became_active":"2024-09-14T10:45:33.569860+0000","last_became_peered":"2024-09-14T10:45:33.569860+0000","last_unstale":"2024-09-14T11:19:42.113836+0000","last_undegraded":"2024-09-14T11:19:42.113836+0000","last_fullsized":"2024-09-14T11:19:42.113836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_clean_scrub_stamp":"2024-09-14T10:45:32.551765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:19.845227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074400599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"260'308","reported_seq":937,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.000002+0000","last_change":"2024-09-14T10:45:43.680588+0000","last_active":"2024-09-14T11:22:51.000002+0000","last_peered":"2024-09-14T11:22:51.000002+0000","last_clean":"2024-09-14T11:22:51.000002+0000","last_became_active":"2024-09-14T10:45:43.680290+0000","last_became_peered":"2024-09-14T10:45:43.680290+0000","last_unstale":"2024-09-14T11:22:51.000002+0000","last_undegraded":"2024-09-14T11:22:51.000002+0000","last_fullsized":"2024-09-14T11:22:51.000002+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:14.859096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243200,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":626,"num_read_kb":19207,"num_write":1075,"num_write_kb":41133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":480,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:27.120185+0000","last_change":"2024-09-14T10:45:47.728037+0000","last_active":"2024-09-14T11:20:27.120185+0000","last_peered":"2024-09-14T11:20:27.120185+0000","last_clean":"2024-09-14T11:20:27.120185+0000","last_became_active":"2024-09-14T10:45:47.727733+0000","last_became_peered":"2024-09-14T10:45:47.727733+0000","last_unstale":"2024-09-14T11:20:27.120185+0000","last_undegraded":"2024-09-14T11:20:27.120185+0000","last_fullsized":"2024-09-14T11:20:27.120185+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:08.238626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"260'1243","reported_seq":2601,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.016458+0000","last_change":"2024-09-14T10:45:49.731992+0000","last_active":"2024-09-14T11:22:51.016458+0000","last_peered":"2024-09-14T11:22:51.016458+0000","last_clean":"2024-09-14T11:22:51.016458+0000","last_became_active":"2024-09-14T10:45:49.731646+0000","last_became_peered":"2024-09-14T10:45:49.731646+0000","last_unstale":"2024-09-14T11:22:51.016458+0000","last_undegraded":"2024-09-14T11:22:51.016458+0000","last_fullsized":"2024-09-14T11:22:51.016458+0000","mapping_epoch":30,"log_start":"260'1200","ondisk_log_start":"260'1200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":1200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:40.965323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145081,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1971,"num_read_kb":3649,"num_write":1068,"num_write_kb":919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":472,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:17.109984+0000","last_change":"2024-09-14T10:45:51.745733+0000","last_active":"2024-09-14T11:19:17.109984+0000","last_peered":"2024-09-14T11:19:17.109984+0000","last_clean":"2024-09-14T11:19:17.109984+0000","last_became_active":"2024-09-14T10:45:51.745481+0000","last_became_peered":"2024-09-14T10:45:51.745481+0000","last_unstale":"2024-09-14T11:19:17.109984+0000","last_undegraded":"2024-09-14T11:19:17.109984+0000","last_fullsized":"2024-09-14T11:19:17.109984+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:11.216344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"260'292","reported_seq":816,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:43.730260+0000","last_change":"2024-09-14T10:45:53.750529+0000","last_active":"2024-09-14T11:22:43.730260+0000","last_peered":"2024-09-14T11:22:43.730260+0000","last_clean":"2024-09-14T11:22:43.730260+0000","last_became_active":"2024-09-14T10:45:53.750227+0000","last_became_peered":"2024-09-14T10:45:53.750227+0000","last_unstale":"2024-09-14T11:22:43.730260+0000","last_undegraded":"2024-09-14T11:22:43.730260+0000","last_fullsized":"2024-09-14T11:22:43.730260+0000","mapping_epoch":34,"log_start":"260'200","ondisk_log_start":"260'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:38.646551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":463,"num_read_kb":436,"num_write":609,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"260'355","reported_seq":1868,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:11.223921+0000","last_change":"2024-09-14T10:45:45.715226+0000","last_active":"2024-09-14T11:21:11.223921+0000","last_peered":"2024-09-14T11:21:11.223921+0000","last_clean":"2024-09-14T11:21:11.223921+0000","last_became_active":"2024-09-14T10:45:45.714923+0000","last_became_peered":"2024-09-14T10:45:45.714923+0000","last_unstale":"2024-09-14T11:21:11.223921+0000","last_undegraded":"2024-09-14T11:21:11.223921+0000","last_fullsized":"2024-09-14T11:21:11.223921+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:07.817788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2079,"num_read_kb":2005,"num_write":398,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":504,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:55.987569+0000","last_change":"2024-09-14T10:45:36.078832+0000","last_active":"2024-09-14T11:18:55.987569+0000","last_peered":"2024-09-14T11:18:55.987569+0000","last_clean":"2024-09-14T11:18:55.987569+0000","last_became_active":"2024-09-14T10:45:33.569944+0000","last_became_peered":"2024-09-14T10:45:33.569944+0000","last_unstale":"2024-09-14T11:18:55.987569+0000","last_undegraded":"2024-09-14T11:18:55.987569+0000","last_fullsized":"2024-09-14T11:18:55.987569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_clean_scrub_stamp":"2024-09-14T10:45:32.551765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:29.610279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055355599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"260'327","reported_seq":1018,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.075598+0000","last_change":"2024-09-14T10:45:43.684278+0000","last_active":"2024-09-14T11:22:51.075598+0000","last_peered":"2024-09-14T11:22:51.075598+0000","last_clean":"2024-09-14T11:22:51.075598+0000","last_became_active":"2024-09-14T10:45:43.682920+0000","last_became_peered":"2024-09-14T10:45:43.682920+0000","last_unstale":"2024-09-14T11:22:51.075598+0000","last_undegraded":"2024-09-14T11:22:51.075598+0000","last_fullsized":"2024-09-14T11:22:51.075598+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:53.359950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1134086,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":791,"num_read_kb":18154,"num_write":1040,"num_write_kb":35009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":483,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:31.000785+0000","last_change":"2024-09-14T10:45:47.729348+0000","last_active":"2024-09-14T11:20:31.000785+0000","last_peered":"2024-09-14T11:20:31.000785+0000","last_clean":"2024-09-14T11:20:31.000785+0000","last_became_active":"2024-09-14T10:45:47.729061+0000","last_became_peered":"2024-09-14T10:45:47.729061+0000","last_unstale":"2024-09-14T11:20:31.000785+0000","last_undegraded":"2024-09-14T11:20:31.000785+0000","last_fullsized":"2024-09-14T11:20:31.000785+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:40.239555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"260'240","reported_seq":1217,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.211666+0000","last_change":"2024-09-14T10:45:49.732283+0000","last_active":"2024-09-14T11:22:42.211666+0000","last_peered":"2024-09-14T11:22:42.211666+0000","last_clean":"2024-09-14T11:22:42.211666+0000","last_became_active":"2024-09-14T10:45:49.731858+0000","last_became_peered":"2024-09-14T10:45:49.731858+0000","last_unstale":"2024-09-14T11:22:42.211666+0000","last_undegraded":"2024-09-14T11:22:42.211666+0000","last_fullsized":"2024-09-14T11:22:42.211666+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:59.698290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":156,"num_read_kb":145,"num_write":121,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:11.113947+0000","last_change":"2024-09-14T10:45:51.743386+0000","last_active":"2024-09-14T11:19:11.113947+0000","last_peered":"2024-09-14T11:19:11.113947+0000","last_clean":"2024-09-14T11:19:11.113947+0000","last_became_active":"2024-09-14T10:45:51.742651+0000","last_became_peered":"2024-09-14T10:45:51.742651+0000","last_unstale":"2024-09-14T11:19:11.113947+0000","last_undegraded":"2024-09-14T11:19:11.113947+0000","last_fullsized":"2024-09-14T11:19:11.113947+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:56.398753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"260'239","reported_seq":825,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.890931+0000","last_change":"2024-09-14T10:45:53.745667+0000","last_active":"2024-09-14T11:21:28.890931+0000","last_peered":"2024-09-14T11:21:28.890931+0000","last_clean":"2024-09-14T11:21:28.890931+0000","last_became_active":"2024-09-14T10:45:53.744823+0000","last_became_peered":"2024-09-14T10:45:53.744823+0000","last_unstale":"2024-09-14T11:21:28.890931+0000","last_undegraded":"2024-09-14T11:21:28.890931+0000","last_fullsized":"2024-09-14T11:21:28.890931+0000","mapping_epoch":34,"log_start":"260'200","ondisk_log_start":"260'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:01:08.099600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":471,"num_read_kb":497,"num_write":522,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"260'743","reported_seq":2245,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.833846+0000","last_change":"2024-09-14T10:45:45.714387+0000","last_active":"2024-09-14T11:22:42.833846+0000","last_peered":"2024-09-14T11:22:42.833846+0000","last_clean":"2024-09-14T11:22:42.833846+0000","last_became_active":"2024-09-14T10:45:45.714077+0000","last_became_peered":"2024-09-14T10:45:45.714077+0000","last_unstale":"2024-09-14T11:22:42.833846+0000","last_undegraded":"2024-09-14T11:22:42.833846+0000","last_fullsized":"2024-09-14T11:22:42.833846+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":700,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:32:40.285715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3745,"num_read_kb":3391,"num_write":988,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":505,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:57.106867+0000","last_change":"2024-09-14T10:45:35.580322+0000","last_active":"2024-09-14T11:18:57.106867+0000","last_peered":"2024-09-14T11:18:57.106867+0000","last_clean":"2024-09-14T11:18:57.106867+0000","last_became_active":"2024-09-14T10:45:33.612919+0000","last_became_peered":"2024-09-14T10:45:33.612919+0000","last_unstale":"2024-09-14T11:18:57.106867+0000","last_undegraded":"2024-09-14T11:18:57.106867+0000","last_fullsized":"2024-09-14T11:18:57.106867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_clean_scrub_stamp":"2024-09-14T10:45:32.551765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:57.073763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094497699999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"260'276","reported_seq":1144,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:59.526090+0000","last_change":"2024-09-14T10:45:43.679805+0000","last_active":"2024-09-14T11:20:59.526090+0000","last_peered":"2024-09-14T11:20:59.526090+0000","last_clean":"2024-09-14T11:20:59.526090+0000","last_became_active":"2024-09-14T10:45:43.679522+0000","last_became_peered":"2024-09-14T10:45:43.679522+0000","last_unstale":"2024-09-14T11:20:59.526090+0000","last_undegraded":"2024-09-14T11:20:59.526090+0000","last_fullsized":"2024-09-14T11:20:59.526090+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:59.700293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9462467,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1303,"num_read_kb":12976,"num_write":1115,"num_write_kb":34630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"36'3","reported_seq":962,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.271527+0000","last_change":"2024-09-14T10:45:47.727327+0000","last_active":"2024-09-14T11:22:50.271527+0000","last_peered":"2024-09-14T11:22:50.271527+0000","last_clean":"2024-09-14T11:22:50.271527+0000","last_became_active":"2024-09-14T10:45:47.727050+0000","last_became_peered":"2024-09-14T10:45:47.727050+0000","last_unstale":"2024-09-14T11:22:50.271527+0000","last_undegraded":"2024-09-14T11:22:50.271527+0000","last_fullsized":"2024-09-14T11:22:50.271527+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:11.560613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"260'102","reported_seq":617,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:41.139054+0000","last_change":"2024-09-14T10:45:49.734492+0000","last_active":"2024-09-14T11:22:41.139054+0000","last_peered":"2024-09-14T11:22:41.139054+0000","last_clean":"2024-09-14T11:22:41.139054+0000","last_became_active":"2024-09-14T10:45:49.734181+0000","last_became_peered":"2024-09-14T10:45:49.734181+0000","last_unstale":"2024-09-14T11:22:41.139054+0000","last_undegraded":"2024-09-14T11:22:41.139054+0000","last_fullsized":"2024-09-14T11:22:41.139054+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:39.185773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":121,"num_read_kb":115,"num_write":86,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":472,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:32.120940+0000","last_change":"2024-09-14T10:45:51.744573+0000","last_active":"2024-09-14T11:20:32.120940+0000","last_peered":"2024-09-14T11:20:32.120940+0000","last_clean":"2024-09-14T11:20:32.120940+0000","last_became_active":"2024-09-14T10:45:51.744280+0000","last_became_peered":"2024-09-14T10:45:51.744280+0000","last_unstale":"2024-09-14T11:20:32.120940+0000","last_undegraded":"2024-09-14T11:20:32.120940+0000","last_fullsized":"2024-09-14T11:20:32.120940+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:36.528487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"260'117","reported_seq":649,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.997667+0000","last_change":"2024-09-14T10:45:53.746846+0000","last_active":"2024-09-14T11:21:27.997667+0000","last_peered":"2024-09-14T11:21:27.997667+0000","last_clean":"2024-09-14T11:21:27.997667+0000","last_became_active":"2024-09-14T10:45:53.746484+0000","last_became_peered":"2024-09-14T10:45:53.746484+0000","last_unstale":"2024-09-14T11:21:27.997667+0000","last_undegraded":"2024-09-14T11:21:27.997667+0000","last_fullsized":"2024-09-14T11:21:27.997667+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:31.055773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":202,"num_write":278,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"260'1196","reported_seq":2897,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:11.223775+0000","last_change":"2024-09-14T10:45:45.713700+0000","last_active":"2024-09-14T11:21:11.223775+0000","last_peered":"2024-09-14T11:21:11.223775+0000","last_clean":"2024-09-14T11:21:11.223775+0000","last_became_active":"2024-09-14T10:45:45.713440+0000","last_became_peered":"2024-09-14T10:45:45.713440+0000","last_unstale":"2024-09-14T11:21:11.223775+0000","last_undegraded":"2024-09-14T11:21:11.223775+0000","last_fullsized":"2024-09-14T11:21:11.223775+0000","mapping_epoch":26,"log_start":"260'1100","ondisk_log_start":"260'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":1100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:13.974610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5652,"num_read_kb":5051,"num_write":1624,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"260'298","reported_seq":985,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:26.616258+0000","last_change":"2024-09-14T10:45:43.683066+0000","last_active":"2024-09-14T11:21:26.616258+0000","last_peered":"2024-09-14T11:21:26.616258+0000","last_clean":"2024-09-14T11:21:26.616258+0000","last_became_active":"2024-09-14T10:45:43.682711+0000","last_became_peered":"2024-09-14T10:45:43.682711+0000","last_unstale":"2024-09-14T11:21:26.616258+0000","last_undegraded":"2024-09-14T11:21:26.616258+0000","last_fullsized":"2024-09-14T11:21:26.616258+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:13:32.400241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12958652,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":782,"num_read_kb":26785,"num_write":1115,"num_write_kb":27965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":502,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:56.232945+0000","last_change":"2024-09-14T10:45:36.078834+0000","last_active":"2024-09-14T11:18:56.232945+0000","last_peered":"2024-09-14T11:18:56.232945+0000","last_clean":"2024-09-14T11:18:56.232945+0000","last_became_active":"2024-09-14T10:45:33.612983+0000","last_became_peered":"2024-09-14T10:45:33.612983+0000","last_unstale":"2024-09-14T11:18:56.232945+0000","last_undegraded":"2024-09-14T11:18:56.232945+0000","last_fullsized":"2024-09-14T11:18:56.232945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_clean_scrub_stamp":"2024-09-14T10:45:32.551765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:00.753079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053773700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":486,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:11.113928+0000","last_change":"2024-09-14T10:45:47.724950+0000","last_active":"2024-09-14T11:19:11.113928+0000","last_peered":"2024-09-14T11:19:11.113928+0000","last_clean":"2024-09-14T11:19:11.113928+0000","last_became_active":"2024-09-14T10:45:47.724317+0000","last_became_peered":"2024-09-14T10:45:47.724317+0000","last_unstale":"2024-09-14T11:19:11.113928+0000","last_undegraded":"2024-09-14T11:19:11.113928+0000","last_fullsized":"2024-09-14T11:19:11.113928+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:13.067923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"260'544","reported_seq":1180,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.839460+0000","last_change":"2024-09-14T10:45:49.736006+0000","last_active":"2024-09-14T11:22:50.839460+0000","last_peered":"2024-09-14T11:22:50.839460+0000","last_clean":"2024-09-14T11:22:50.839460+0000","last_became_active":"2024-09-14T10:45:49.735662+0000","last_became_peered":"2024-09-14T10:45:49.735662+0000","last_unstale":"2024-09-14T11:22:50.839460+0000","last_undegraded":"2024-09-14T11:22:50.839460+0000","last_fullsized":"2024-09-14T11:22:50.839460+0000","mapping_epoch":30,"log_start":"260'500","ondisk_log_start":"260'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:34.690835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108030,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1548,"num_read_kb":2637,"num_write":2014,"num_write_kb":1867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":469,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:14.986059+0000","last_change":"2024-09-14T10:45:51.749756+0000","last_active":"2024-09-14T11:19:14.986059+0000","last_peered":"2024-09-14T11:19:14.986059+0000","last_clean":"2024-09-14T11:19:14.986059+0000","last_became_active":"2024-09-14T10:45:51.749478+0000","last_became_peered":"2024-09-14T10:45:51.749478+0000","last_unstale":"2024-09-14T11:19:14.986059+0000","last_undegraded":"2024-09-14T11:19:14.986059+0000","last_fullsized":"2024-09-14T11:19:14.986059+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:19.448821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"260'118","reported_seq":604,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:16.644526+0000","last_change":"2024-09-14T10:45:53.749875+0000","last_active":"2024-09-14T11:21:16.644526+0000","last_peered":"2024-09-14T11:21:16.644526+0000","last_clean":"2024-09-14T11:21:16.644526+0000","last_became_active":"2024-09-14T10:45:53.749578+0000","last_became_peered":"2024-09-14T10:45:53.749578+0000","last_unstale":"2024-09-14T11:21:16.644526+0000","last_undegraded":"2024-09-14T11:21:16.644526+0000","last_fullsized":"2024-09-14T11:21:16.644526+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:40.919662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":913,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":137,"num_read_kb":126,"num_write":281,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"260'861","reported_seq":2555,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.049805+0000","last_change":"2024-09-14T10:45:45.720048+0000","last_active":"2024-09-14T11:21:27.049805+0000","last_peered":"2024-09-14T11:21:27.049805+0000","last_clean":"2024-09-14T11:21:27.049805+0000","last_became_active":"2024-09-14T10:45:45.719783+0000","last_became_peered":"2024-09-14T10:45:45.719783+0000","last_unstale":"2024-09-14T11:21:27.049805+0000","last_undegraded":"2024-09-14T11:21:27.049805+0000","last_fullsized":"2024-09-14T11:21:27.049805+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":800,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:34.138598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4184,"num_read_kb":3795,"num_write":1124,"num_write_kb":397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"260'343","reported_seq":957,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.967429+0000","last_change":"2024-09-14T10:45:43.686039+0000","last_active":"2024-09-14T11:22:50.967429+0000","last_peered":"2024-09-14T11:22:50.967429+0000","last_clean":"2024-09-14T11:22:50.967429+0000","last_became_active":"2024-09-14T10:45:43.685775+0000","last_became_peered":"2024-09-14T10:45:43.685775+0000","last_unstale":"2024-09-14T11:22:50.967429+0000","last_undegraded":"2024-09-14T11:22:50.967429+0000","last_fullsized":"2024-09-14T11:22:50.967429+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:18:21.519433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197775,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":637,"num_read_kb":2173,"num_write":1067,"num_write_kb":20935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":503,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:02.107638+0000","last_change":"2024-09-14T10:45:35.580399+0000","last_active":"2024-09-14T11:19:02.107638+0000","last_peered":"2024-09-14T11:19:02.107638+0000","last_clean":"2024-09-14T11:19:02.107638+0000","last_became_active":"2024-09-14T10:45:33.564407+0000","last_became_peered":"2024-09-14T10:45:33.564407+0000","last_unstale":"2024-09-14T11:19:02.107638+0000","last_undegraded":"2024-09-14T11:19:02.107638+0000","last_fullsized":"2024-09-14T11:19:02.107638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_clean_scrub_stamp":"2024-09-14T10:45:32.551765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:15:28.496118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099134599999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:07.204309+0000","last_change":"2024-09-14T10:45:47.726265+0000","last_active":"2024-09-14T11:19:07.204309+0000","last_peered":"2024-09-14T11:19:07.204309+0000","last_clean":"2024-09-14T11:19:07.204309+0000","last_became_active":"2024-09-14T10:45:47.724774+0000","last_became_peered":"2024-09-14T10:45:47.724774+0000","last_unstale":"2024-09-14T11:19:07.204309+0000","last_undegraded":"2024-09-14T11:19:07.204309+0000","last_fullsized":"2024-09-14T11:19:07.204309+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:34.725344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"260'155","reported_seq":691,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:15.998699+0000","last_change":"2024-09-14T10:45:49.731679+0000","last_active":"2024-09-14T11:21:15.998699+0000","last_peered":"2024-09-14T11:21:15.998699+0000","last_clean":"2024-09-14T11:21:15.998699+0000","last_became_active":"2024-09-14T10:45:49.731380+0000","last_became_peered":"2024-09-14T10:45:49.731380+0000","last_unstale":"2024-09-14T11:21:15.998699+0000","last_undegraded":"2024-09-14T11:21:15.998699+0000","last_fullsized":"2024-09-14T11:21:15.998699+0000","mapping_epoch":30,"log_start":"257'100","ondisk_log_start":"257'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:45.555612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":200,"num_read_kb":190,"num_write":162,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"260'793","reported_seq":2737,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:43.740421+0000","last_change":"2024-09-14T10:45:51.747482+0000","last_active":"2024-09-14T11:22:43.740421+0000","last_peered":"2024-09-14T11:22:43.740421+0000","last_clean":"2024-09-14T11:22:43.740421+0000","last_became_active":"2024-09-14T10:45:51.746984+0000","last_became_peered":"2024-09-14T10:45:51.746984+0000","last_unstale":"2024-09-14T11:22:43.740421+0000","last_undegraded":"2024-09-14T11:22:43.740421+0000","last_fullsized":"2024-09-14T11:22:43.740421+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:45.422324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"260'119","reported_seq":610,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:06.014335+0000","last_change":"2024-09-14T10:45:53.750253+0000","last_active":"2024-09-14T11:22:06.014335+0000","last_peered":"2024-09-14T11:22:06.014335+0000","last_clean":"2024-09-14T11:22:06.014335+0000","last_became_active":"2024-09-14T10:45:53.749802+0000","last_became_peered":"2024-09-14T10:45:53.749802+0000","last_unstale":"2024-09-14T11:22:06.014335+0000","last_undegraded":"2024-09-14T11:22:06.014335+0000","last_fullsized":"2024-09-14T11:22:06.014335+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:31.303920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":146,"num_read_kb":135,"num_write":274,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"260'412","reported_seq":1897,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:14.959250+0000","last_change":"2024-09-14T10:45:45.710569+0000","last_active":"2024-09-14T11:21:14.959250+0000","last_peered":"2024-09-14T11:21:14.959250+0000","last_clean":"2024-09-14T11:21:14.959250+0000","last_became_active":"2024-09-14T10:45:45.710204+0000","last_became_peered":"2024-09-14T10:45:45.710204+0000","last_unstale":"2024-09-14T11:21:14.959250+0000","last_undegraded":"2024-09-14T11:21:14.959250+0000","last_fullsized":"2024-09-14T11:21:14.959250+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:02.264958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2141,"num_read_kb":2031,"num_write":456,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"260'348","reported_seq":1117,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.099732+0000","last_change":"2024-09-14T10:45:43.688652+0000","last_active":"2024-09-14T11:22:51.099732+0000","last_peered":"2024-09-14T11:22:51.099732+0000","last_clean":"2024-09-14T11:22:51.099732+0000","last_became_active":"2024-09-14T10:45:43.688114+0000","last_became_peered":"2024-09-14T10:45:43.688114+0000","last_unstale":"2024-09-14T11:22:51.099732+0000","last_undegraded":"2024-09-14T11:22:51.099732+0000","last_fullsized":"2024-09-14T11:22:51.099732+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:15.866413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5413456,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":803,"num_read_kb":15214,"num_write":1150,"num_write_kb":42293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":509,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:16.122560+0000","last_change":"2024-09-14T10:45:35.575588+0000","last_active":"2024-09-14T11:20:16.122560+0000","last_peered":"2024-09-14T11:20:16.122560+0000","last_clean":"2024-09-14T11:20:16.122560+0000","last_became_active":"2024-09-14T10:45:33.610909+0000","last_became_peered":"2024-09-14T10:45:33.610909+0000","last_unstale":"2024-09-14T11:20:16.122560+0000","last_undegraded":"2024-09-14T11:20:16.122560+0000","last_fullsized":"2024-09-14T11:20:16.122560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_clean_scrub_stamp":"2024-09-14T10:45:32.551765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:45.821025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038435900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":480,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:07.108316+0000","last_change":"2024-09-14T10:45:47.728711+0000","last_active":"2024-09-14T11:19:07.108316+0000","last_peered":"2024-09-14T11:19:07.108316+0000","last_clean":"2024-09-14T11:19:07.108316+0000","last_became_active":"2024-09-14T10:45:47.728343+0000","last_became_peered":"2024-09-14T10:45:47.728343+0000","last_unstale":"2024-09-14T11:19:07.108316+0000","last_undegraded":"2024-09-14T11:19:07.108316+0000","last_fullsized":"2024-09-14T11:19:07.108316+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:17.637076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"260'92","reported_seq":605,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:56.315196+0000","last_change":"2024-09-14T10:45:49.736010+0000","last_active":"2024-09-14T11:20:56.315196+0000","last_peered":"2024-09-14T11:20:56.315196+0000","last_clean":"2024-09-14T11:20:56.315196+0000","last_became_active":"2024-09-14T10:45:49.735557+0000","last_became_peered":"2024-09-14T10:45:49.735557+0000","last_unstale":"2024-09-14T11:20:56.315196+0000","last_undegraded":"2024-09-14T11:20:56.315196+0000","last_fullsized":"2024-09-14T11:20:56.315196+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:10:56.092992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"260'804","reported_seq":2211,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.302906+0000","last_change":"2024-09-14T10:45:51.747138+0000","last_active":"2024-09-14T11:22:50.302906+0000","last_peered":"2024-09-14T11:22:50.302906+0000","last_clean":"2024-09-14T11:22:50.302906+0000","last_became_active":"2024-09-14T10:45:51.746874+0000","last_became_peered":"2024-09-14T10:45:51.746874+0000","last_unstale":"2024-09-14T11:22:50.302906+0000","last_undegraded":"2024-09-14T11:22:50.302906+0000","last_fullsized":"2024-09-14T11:22:50.302906+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":700,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:47.844695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"260'171","reported_seq":654,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:06.378984+0000","last_change":"2024-09-14T10:45:53.749142+0000","last_active":"2024-09-14T11:21:06.378984+0000","last_peered":"2024-09-14T11:21:06.378984+0000","last_clean":"2024-09-14T11:21:06.378984+0000","last_became_active":"2024-09-14T10:45:53.748880+0000","last_became_peered":"2024-09-14T10:45:53.748880+0000","last_unstale":"2024-09-14T11:21:06.378984+0000","last_undegraded":"2024-09-14T11:21:06.378984+0000","last_fullsized":"2024-09-14T11:21:06.378984+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:00:48.684200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":483,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":133,"num_read_kb":125,"num_write":394,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"260'405","reported_seq":1915,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.834581+0000","last_change":"2024-09-14T10:45:45.713570+0000","last_active":"2024-09-14T11:22:42.834581+0000","last_peered":"2024-09-14T11:22:42.834581+0000","last_clean":"2024-09-14T11:22:42.834581+0000","last_became_active":"2024-09-14T10:45:45.713313+0000","last_became_peered":"2024-09-14T10:45:45.713313+0000","last_unstale":"2024-09-14T11:22:42.834581+0000","last_undegraded":"2024-09-14T11:22:42.834581+0000","last_fullsized":"2024-09-14T11:22:42.834581+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:00.604945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2392,"num_read_kb":2258,"num_write":470,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"260'350","reported_seq":1090,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.965943+0000","last_change":"2024-09-14T10:45:43.691413+0000","last_active":"2024-09-14T11:22:50.965943+0000","last_peered":"2024-09-14T11:22:50.965943+0000","last_clean":"2024-09-14T11:22:50.965943+0000","last_became_active":"2024-09-14T10:45:43.689593+0000","last_became_peered":"2024-09-14T10:45:43.689593+0000","last_unstale":"2024-09-14T11:22:50.965943+0000","last_undegraded":"2024-09-14T11:22:50.965943+0000","last_fullsized":"2024-09-14T11:22:50.965943+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:27.067114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267503,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":1002,"num_read_kb":46617,"num_write":1235,"num_write_kb":43963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":503,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:17.118867+0000","last_change":"2024-09-14T10:45:35.580545+0000","last_active":"2024-09-14T11:20:17.118867+0000","last_peered":"2024-09-14T11:20:17.118867+0000","last_clean":"2024-09-14T11:20:17.118867+0000","last_became_active":"2024-09-14T10:45:33.610689+0000","last_became_peered":"2024-09-14T10:45:33.610689+0000","last_unstale":"2024-09-14T11:20:17.118867+0000","last_undegraded":"2024-09-14T11:20:17.118867+0000","last_fullsized":"2024-09-14T11:20:17.118867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_clean_scrub_stamp":"2024-09-14T10:45:32.551765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:59.821398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011461920000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:56.120373+0000","last_change":"2024-09-14T10:45:47.728608+0000","last_active":"2024-09-14T11:19:56.120373+0000","last_peered":"2024-09-14T11:19:56.120373+0000","last_clean":"2024-09-14T11:19:56.120373+0000","last_became_active":"2024-09-14T10:45:47.728312+0000","last_became_peered":"2024-09-14T10:45:47.728312+0000","last_unstale":"2024-09-14T11:19:56.120373+0000","last_undegraded":"2024-09-14T11:19:56.120373+0000","last_fullsized":"2024-09-14T11:19:56.120373+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:22.707433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"260'704","reported_seq":1391,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:43.704102+0000","last_change":"2024-09-14T10:45:49.734149+0000","last_active":"2024-09-14T11:22:43.704102+0000","last_peered":"2024-09-14T11:22:43.704102+0000","last_clean":"2024-09-14T11:22:43.704102+0000","last_became_active":"2024-09-14T10:45:49.733812+0000","last_became_peered":"2024-09-14T10:45:49.733812+0000","last_unstale":"2024-09-14T11:22:43.704102+0000","last_undegraded":"2024-09-14T11:22:43.704102+0000","last_fullsized":"2024-09-14T11:22:43.704102+0000","mapping_epoch":30,"log_start":"260'600","ondisk_log_start":"260'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":600,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:05.193302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167039,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1243,"num_read_kb":2680,"num_write":1028,"num_write_kb":871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:11.113894+0000","last_change":"2024-09-14T10:45:51.746053+0000","last_active":"2024-09-14T11:19:11.113894+0000","last_peered":"2024-09-14T11:19:11.113894+0000","last_clean":"2024-09-14T11:19:11.113894+0000","last_became_active":"2024-09-14T10:45:51.745137+0000","last_became_peered":"2024-09-14T10:45:51.745137+0000","last_unstale":"2024-09-14T11:19:11.113894+0000","last_undegraded":"2024-09-14T11:19:11.113894+0000","last_fullsized":"2024-09-14T11:19:11.113894+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:34.202906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"260'130","reported_seq":622,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.045272+0000","last_change":"2024-09-14T10:45:53.751882+0000","last_active":"2024-09-14T11:21:27.045272+0000","last_peered":"2024-09-14T11:21:27.045272+0000","last_clean":"2024-09-14T11:21:27.045272+0000","last_became_active":"2024-09-14T10:45:53.751511+0000","last_became_peered":"2024-09-14T10:45:53.751511+0000","last_unstale":"2024-09-14T11:21:27.045272+0000","last_undegraded":"2024-09-14T11:21:27.045272+0000","last_fullsized":"2024-09-14T11:21:27.045272+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:34.995970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":202,"num_read_kb":180,"num_write":339,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"260'195","reported_seq":792,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.396620+0000","last_change":"2024-09-14T10:45:53.747335+0000","last_active":"2024-09-14T11:21:28.396620+0000","last_peered":"2024-09-14T11:21:28.396620+0000","last_clean":"2024-09-14T11:21:28.396620+0000","last_became_active":"2024-09-14T10:45:53.747090+0000","last_became_peered":"2024-09-14T10:45:53.747090+0000","last_unstale":"2024-09-14T11:21:28.396620+0000","last_undegraded":"2024-09-14T11:21:28.396620+0000","last_fullsized":"2024-09-14T11:21:28.396620+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:02.580660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":464,"num_read_kb":408,"num_write":469,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"260'462","reported_seq":1939,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:09.637868+0000","last_change":"2024-09-14T10:45:45.719507+0000","last_active":"2024-09-14T11:21:09.637868+0000","last_peered":"2024-09-14T11:21:09.637868+0000","last_clean":"2024-09-14T11:21:09.637868+0000","last_became_active":"2024-09-14T10:45:45.719181+0000","last_became_peered":"2024-09-14T10:45:45.719181+0000","last_unstale":"2024-09-14T11:21:09.637868+0000","last_undegraded":"2024-09-14T11:21:09.637868+0000","last_fullsized":"2024-09-14T11:21:09.637868+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:25:12.612090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2298,"num_read_kb":2151,"num_write":532,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"260'329","reported_seq":987,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:59.219456+0000","last_change":"2024-09-14T10:45:43.673724+0000","last_active":"2024-09-14T11:20:59.219456+0000","last_peered":"2024-09-14T11:20:59.219456+0000","last_clean":"2024-09-14T11:20:59.219456+0000","last_became_active":"2024-09-14T10:45:43.673475+0000","last_became_peered":"2024-09-14T10:45:43.673475+0000","last_unstale":"2024-09-14T11:20:59.219456+0000","last_undegraded":"2024-09-14T11:20:59.219456+0000","last_fullsized":"2024-09-14T11:20:59.219456+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:22.605440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22088316,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":690,"num_read_kb":57044,"num_write":1220,"num_write_kb":43494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:30.977699+0000","last_change":"2024-09-14T10:45:47.727115+0000","last_active":"2024-09-14T11:18:30.977699+0000","last_peered":"2024-09-14T11:18:30.977699+0000","last_clean":"2024-09-14T11:18:30.977699+0000","last_became_active":"2024-09-14T10:45:47.726819+0000","last_became_peered":"2024-09-14T10:45:47.726819+0000","last_unstale":"2024-09-14T11:18:30.977699+0000","last_undegraded":"2024-09-14T11:18:30.977699+0000","last_fullsized":"2024-09-14T11:18:30.977699+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:49.723414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"260'271","reported_seq":822,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.561739+0000","last_change":"2024-09-14T10:45:49.733250+0000","last_active":"2024-09-14T11:22:50.561739+0000","last_peered":"2024-09-14T11:22:50.561739+0000","last_clean":"2024-09-14T11:22:50.561739+0000","last_became_active":"2024-09-14T10:45:49.732755+0000","last_became_peered":"2024-09-14T10:45:49.732755+0000","last_unstale":"2024-09-14T11:22:50.561739+0000","last_undegraded":"2024-09-14T11:22:50.561739+0000","last_fullsized":"2024-09-14T11:22:50.561739+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:54:03.582189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48124,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":453,"num_read_kb":1077,"num_write":370,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":472,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:30.983925+0000","last_change":"2024-09-14T10:45:51.747909+0000","last_active":"2024-09-14T11:18:30.983925+0000","last_peered":"2024-09-14T11:18:30.983925+0000","last_clean":"2024-09-14T11:18:30.983925+0000","last_became_active":"2024-09-14T10:45:51.747624+0000","last_became_peered":"2024-09-14T10:45:51.747624+0000","last_unstale":"2024-09-14T11:18:30.983925+0000","last_undegraded":"2024-09-14T11:18:30.983925+0000","last_fullsized":"2024-09-14T11:18:30.983925+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:20.368951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"260'138","reported_seq":626,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:14.388075+0000","last_change":"2024-09-14T10:45:53.751186+0000","last_active":"2024-09-14T11:21:14.388075+0000","last_peered":"2024-09-14T11:21:14.388075+0000","last_clean":"2024-09-14T11:21:14.388075+0000","last_became_active":"2024-09-14T10:45:53.750866+0000","last_became_peered":"2024-09-14T10:45:53.750866+0000","last_unstale":"2024-09-14T11:21:14.388075+0000","last_undegraded":"2024-09-14T11:21:14.388075+0000","last_fullsized":"2024-09-14T11:21:14.388075+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:54.350231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":161,"num_read_kb":145,"num_write":328,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"260'713","reported_seq":2438,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.336687+0000","last_change":"2024-09-14T10:45:45.720031+0000","last_active":"2024-09-14T11:21:28.336687+0000","last_peered":"2024-09-14T11:21:28.336687+0000","last_clean":"2024-09-14T11:21:28.336687+0000","last_became_active":"2024-09-14T10:45:45.719731+0000","last_became_peered":"2024-09-14T10:45:45.719731+0000","last_unstale":"2024-09-14T11:21:28.336687+0000","last_undegraded":"2024-09-14T11:21:28.336687+0000","last_fullsized":"2024-09-14T11:21:28.336687+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":700,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:55.272218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3605,"num_read_kb":3249,"num_write":949,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"260'284","reported_seq":892,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:57.835060+0000","last_change":"2024-09-14T10:45:43.683276+0000","last_active":"2024-09-14T11:20:57.835060+0000","last_peered":"2024-09-14T11:20:57.835060+0000","last_clean":"2024-09-14T11:20:57.835060+0000","last_became_active":"2024-09-14T10:45:43.682925+0000","last_became_peered":"2024-09-14T10:45:43.682925+0000","last_unstale":"2024-09-14T11:20:57.835060+0000","last_undegraded":"2024-09-14T11:20:57.835060+0000","last_fullsized":"2024-09-14T11:20:57.835060+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:31.662072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584968,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":575,"num_read_kb":1213,"num_write":964,"num_write_kb":13029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:31.108226+0000","last_change":"2024-09-14T10:45:47.724937+0000","last_active":"2024-09-14T11:18:31.108226+0000","last_peered":"2024-09-14T11:18:31.108226+0000","last_clean":"2024-09-14T11:18:31.108226+0000","last_became_active":"2024-09-14T10:45:47.724432+0000","last_became_peered":"2024-09-14T10:45:47.724432+0000","last_unstale":"2024-09-14T11:18:31.108226+0000","last_undegraded":"2024-09-14T11:18:31.108226+0000","last_fullsized":"2024-09-14T11:18:31.108226+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:26.499973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"260'45","reported_seq":533,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:51.127494+0000","last_change":"2024-09-14T10:45:49.735467+0000","last_active":"2024-09-14T11:20:51.127494+0000","last_peered":"2024-09-14T11:20:51.127494+0000","last_clean":"2024-09-14T11:20:51.127494+0000","last_became_active":"2024-09-14T10:45:49.735053+0000","last_became_peered":"2024-09-14T10:45:49.735053+0000","last_unstale":"2024-09-14T11:20:51.127494+0000","last_undegraded":"2024-09-14T11:20:51.127494+0000","last_fullsized":"2024-09-14T11:20:51.127494+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:14.336006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":24,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":467,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:34.979850+0000","last_change":"2024-09-14T10:45:51.748011+0000","last_active":"2024-09-14T11:18:34.979850+0000","last_peered":"2024-09-14T11:18:34.979850+0000","last_clean":"2024-09-14T11:18:34.979850+0000","last_became_active":"2024-09-14T10:45:51.747600+0000","last_became_peered":"2024-09-14T10:45:51.747600+0000","last_unstale":"2024-09-14T11:18:34.979850+0000","last_undegraded":"2024-09-14T11:18:34.979850+0000","last_fullsized":"2024-09-14T11:18:34.979850+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:20.639986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"260'223","reported_seq":744,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.339917+0000","last_change":"2024-09-14T10:45:53.751787+0000","last_active":"2024-09-14T11:21:28.339917+0000","last_peered":"2024-09-14T11:21:28.339917+0000","last_clean":"2024-09-14T11:21:28.339917+0000","last_became_active":"2024-09-14T10:45:53.751504+0000","last_became_peered":"2024-09-14T10:45:53.751504+0000","last_unstale":"2024-09-14T11:21:28.339917+0000","last_undegraded":"2024-09-14T11:21:28.339917+0000","last_fullsized":"2024-09-14T11:21:28.339917+0000","mapping_epoch":34,"log_start":"260'200","ondisk_log_start":"260'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:27.845346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":402,"num_read_kb":374,"num_write":536,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"260'726","reported_seq":2170,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:14.386625+0000","last_change":"2024-09-14T10:45:45.714585+0000","last_active":"2024-09-14T11:21:14.386625+0000","last_peered":"2024-09-14T11:21:14.386625+0000","last_clean":"2024-09-14T11:21:14.386625+0000","last_became_active":"2024-09-14T10:45:45.714326+0000","last_became_peered":"2024-09-14T10:45:45.714326+0000","last_unstale":"2024-09-14T11:21:14.386625+0000","last_undegraded":"2024-09-14T11:21:14.386625+0000","last_fullsized":"2024-09-14T11:21:14.386625+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":700,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:55.220424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3492,"num_read_kb":3158,"num_write":966,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"260'319","reported_seq":967,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:11.552773+0000","last_change":"2024-09-14T10:45:43.672043+0000","last_active":"2024-09-14T11:21:11.552773+0000","last_peered":"2024-09-14T11:21:11.552773+0000","last_clean":"2024-09-14T11:21:11.552773+0000","last_became_active":"2024-09-14T10:45:43.671747+0000","last_became_peered":"2024-09-14T10:45:43.671747+0000","last_unstale":"2024-09-14T11:21:11.552773+0000","last_undegraded":"2024-09-14T11:21:11.552773+0000","last_fullsized":"2024-09-14T11:21:11.552773+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:17.021045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15007678,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":632,"num_read_kb":3196,"num_write":1177,"num_write_kb":29609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":475,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:29.979126+0000","last_change":"2024-09-14T10:45:47.731898+0000","last_active":"2024-09-14T11:18:29.979126+0000","last_peered":"2024-09-14T11:18:29.979126+0000","last_clean":"2024-09-14T11:18:29.979126+0000","last_became_active":"2024-09-14T10:45:47.731640+0000","last_became_peered":"2024-09-14T10:45:47.731640+0000","last_unstale":"2024-09-14T11:18:29.979126+0000","last_undegraded":"2024-09-14T11:18:29.979126+0000","last_fullsized":"2024-09-14T11:18:29.979126+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:50:32.387766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"260'317","reported_seq":881,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:43.705489+0000","last_change":"2024-09-14T10:45:49.727713+0000","last_active":"2024-09-14T11:22:43.705489+0000","last_peered":"2024-09-14T11:22:43.705489+0000","last_clean":"2024-09-14T11:22:43.705489+0000","last_became_active":"2024-09-14T10:45:49.727431+0000","last_became_peered":"2024-09-14T10:45:49.727431+0000","last_unstale":"2024-09-14T11:22:43.705489+0000","last_undegraded":"2024-09-14T11:22:43.705489+0000","last_fullsized":"2024-09-14T11:22:43.705489+0000","mapping_epoch":30,"log_start":"260'300","ondisk_log_start":"260'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:44.165025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60297,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":506,"num_read_kb":1020,"num_write":416,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":476,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:32.102760+0000","last_change":"2024-09-14T10:45:51.747148+0000","last_active":"2024-09-14T11:18:32.102760+0000","last_peered":"2024-09-14T11:18:32.102760+0000","last_clean":"2024-09-14T11:18:32.102760+0000","last_became_active":"2024-09-14T10:45:51.746506+0000","last_became_peered":"2024-09-14T10:45:51.746506+0000","last_unstale":"2024-09-14T11:18:32.102760+0000","last_undegraded":"2024-09-14T11:18:32.102760+0000","last_fullsized":"2024-09-14T11:18:32.102760+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:58.299100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"260'144","reported_seq":636,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:12.863430+0000","last_change":"2024-09-14T10:45:53.755475+0000","last_active":"2024-09-14T11:21:12.863430+0000","last_peered":"2024-09-14T11:21:12.863430+0000","last_clean":"2024-09-14T11:21:12.863430+0000","last_became_active":"2024-09-14T10:45:53.755018+0000","last_became_peered":"2024-09-14T10:45:53.755018+0000","last_unstale":"2024-09-14T11:21:12.863430+0000","last_undegraded":"2024-09-14T11:21:12.863430+0000","last_fullsized":"2024-09-14T11:21:12.863430+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:18.887717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":167,"num_write":339,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"260'400","reported_seq":1926,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:13.964839+0000","last_change":"2024-09-14T10:45:45.713424+0000","last_active":"2024-09-14T11:21:13.964839+0000","last_peered":"2024-09-14T11:21:13.964839+0000","last_clean":"2024-09-14T11:21:13.964839+0000","last_became_active":"2024-09-14T10:45:45.713138+0000","last_became_peered":"2024-09-14T10:45:45.713138+0000","last_unstale":"2024-09-14T11:21:13.964839+0000","last_undegraded":"2024-09-14T11:21:13.964839+0000","last_fullsized":"2024-09-14T11:21:13.964839+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:33.204288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2187,"num_read_kb":2089,"num_write":453,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"260'356","reported_seq":966,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.076664+0000","last_change":"2024-09-14T10:45:43.680940+0000","last_active":"2024-09-14T11:22:51.076664+0000","last_peered":"2024-09-14T11:22:51.076664+0000","last_clean":"2024-09-14T11:22:51.076664+0000","last_became_active":"2024-09-14T10:45:43.680629+0000","last_became_peered":"2024-09-14T10:45:43.680629+0000","last_unstale":"2024-09-14T11:22:51.076664+0000","last_undegraded":"2024-09-14T11:22:51.076664+0000","last_fullsized":"2024-09-14T11:22:51.076664+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:50:55.277788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1134943,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":598,"num_read_kb":9938,"num_write":1213,"num_write_kb":44861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:27.102413+0000","last_change":"2024-09-14T10:45:47.728061+0000","last_active":"2024-09-14T11:18:27.102413+0000","last_peered":"2024-09-14T11:18:27.102413+0000","last_clean":"2024-09-14T11:18:27.102413+0000","last_became_active":"2024-09-14T10:45:47.727777+0000","last_became_peered":"2024-09-14T10:45:47.727777+0000","last_unstale":"2024-09-14T11:18:27.102413+0000","last_undegraded":"2024-09-14T11:18:27.102413+0000","last_fullsized":"2024-09-14T11:18:27.102413+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:11.350366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"260'266","reported_seq":815,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:06.713545+0000","last_change":"2024-09-14T10:45:49.727639+0000","last_active":"2024-09-14T11:21:06.713545+0000","last_peered":"2024-09-14T11:21:06.713545+0000","last_clean":"2024-09-14T11:21:06.713545+0000","last_became_active":"2024-09-14T10:45:49.727347+0000","last_became_peered":"2024-09-14T10:45:49.727347+0000","last_unstale":"2024-09-14T11:21:06.713545+0000","last_undegraded":"2024-09-14T11:21:06.713545+0000","last_fullsized":"2024-09-14T11:21:06.713545+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:01.870905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48442,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":404,"num_read_kb":831,"num_write":338,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":472,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:30.983987+0000","last_change":"2024-09-14T10:45:51.746782+0000","last_active":"2024-09-14T11:18:30.983987+0000","last_peered":"2024-09-14T11:18:30.983987+0000","last_clean":"2024-09-14T11:18:30.983987+0000","last_became_active":"2024-09-14T10:45:51.746493+0000","last_became_peered":"2024-09-14T10:45:51.746493+0000","last_unstale":"2024-09-14T11:18:30.983987+0000","last_undegraded":"2024-09-14T11:18:30.983987+0000","last_fullsized":"2024-09-14T11:18:30.983987+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:58.142627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"260'405","reported_seq":1975,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:14.951090+0000","last_change":"2024-09-14T10:45:45.725798+0000","last_active":"2024-09-14T11:21:14.951090+0000","last_peered":"2024-09-14T11:21:14.951090+0000","last_clean":"2024-09-14T11:21:14.951090+0000","last_became_active":"2024-09-14T10:45:45.725430+0000","last_became_peered":"2024-09-14T10:45:45.725430+0000","last_unstale":"2024-09-14T11:21:14.951090+0000","last_undegraded":"2024-09-14T11:21:14.951090+0000","last_fullsized":"2024-09-14T11:21:14.951090+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:31.325345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2252,"num_read_kb":2164,"num_write":454,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"260'295","reported_seq":911,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.109759+0000","last_change":"2024-09-14T10:45:43.684555+0000","last_active":"2024-09-14T11:22:51.109759+0000","last_peered":"2024-09-14T11:22:51.109759+0000","last_clean":"2024-09-14T11:22:51.109759+0000","last_became_active":"2024-09-14T10:45:43.683988+0000","last_became_peered":"2024-09-14T10:45:43.683988+0000","last_unstale":"2024-09-14T11:22:51.109759+0000","last_undegraded":"2024-09-14T11:22:51.109759+0000","last_fullsized":"2024-09-14T11:22:51.109759+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:58:49.723371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5813976,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":539,"num_read_kb":32569,"num_write":1038,"num_write_kb":14583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":481,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:00.990077+0000","last_change":"2024-09-14T10:45:47.728686+0000","last_active":"2024-09-14T11:20:00.990077+0000","last_peered":"2024-09-14T11:20:00.990077+0000","last_clean":"2024-09-14T11:20:00.990077+0000","last_became_active":"2024-09-14T10:45:47.728323+0000","last_became_peered":"2024-09-14T10:45:47.728323+0000","last_unstale":"2024-09-14T11:20:00.990077+0000","last_undegraded":"2024-09-14T11:20:00.990077+0000","last_fullsized":"2024-09-14T11:20:00.990077+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:13:35.492090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"260'486","reported_seq":1088,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.771270+0000","last_change":"2024-09-14T10:45:49.729101+0000","last_active":"2024-09-14T11:22:50.771270+0000","last_peered":"2024-09-14T11:22:50.771270+0000","last_clean":"2024-09-14T11:22:50.771270+0000","last_became_active":"2024-09-14T10:45:49.728841+0000","last_became_peered":"2024-09-14T10:45:49.728841+0000","last_unstale":"2024-09-14T11:22:50.771270+0000","last_undegraded":"2024-09-14T11:22:50.771270+0000","last_fullsized":"2024-09-14T11:22:50.771270+0000","mapping_epoch":30,"log_start":"260'400","ondisk_log_start":"260'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":400,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:11.378740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114572,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":881,"num_read_kb":2022,"num_write":772,"num_write_kb":713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":466,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:24.978449+0000","last_change":"2024-09-14T10:45:51.752010+0000","last_active":"2024-09-14T11:18:24.978449+0000","last_peered":"2024-09-14T11:18:24.978449+0000","last_clean":"2024-09-14T11:18:24.978449+0000","last_became_active":"2024-09-14T10:45:51.751776+0000","last_became_peered":"2024-09-14T10:45:51.751776+0000","last_unstale":"2024-09-14T11:18:24.978449+0000","last_undegraded":"2024-09-14T11:18:24.978449+0000","last_fullsized":"2024-09-14T11:18:24.978449+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:41:21.445606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"260'170","reported_seq":665,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.618448+0000","last_change":"2024-09-14T10:45:53.753181+0000","last_active":"2024-09-14T11:21:28.618448+0000","last_peered":"2024-09-14T11:21:28.618448+0000","last_clean":"2024-09-14T11:21:28.618448+0000","last_became_active":"2024-09-14T10:45:53.752535+0000","last_became_peered":"2024-09-14T10:45:53.752535+0000","last_unstale":"2024-09-14T11:21:28.618448+0000","last_undegraded":"2024-09-14T11:21:28.618448+0000","last_fullsized":"2024-09-14T11:21:28.618448+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:22.683886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":217,"num_read_kb":213,"num_write":386,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"260'440","reported_seq":2084,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.742063+0000","last_change":"2024-09-14T10:45:45.712598+0000","last_active":"2024-09-14T11:21:28.742063+0000","last_peered":"2024-09-14T11:21:28.742063+0000","last_clean":"2024-09-14T11:21:28.742063+0000","last_became_active":"2024-09-14T10:45:45.710498+0000","last_became_peered":"2024-09-14T10:45:45.710498+0000","last_unstale":"2024-09-14T11:21:28.742063+0000","last_undegraded":"2024-09-14T11:21:28.742063+0000","last_fullsized":"2024-09-14T11:21:28.742063+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:47:29.987154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2391,"num_read_kb":2291,"num_write":487,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"260'389","reported_seq":1143,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.104146+0000","last_change":"2024-09-14T10:45:43.688502+0000","last_active":"2024-09-14T11:22:51.104146+0000","last_peered":"2024-09-14T11:22:51.104146+0000","last_clean":"2024-09-14T11:22:51.104146+0000","last_became_active":"2024-09-14T10:45:43.688136+0000","last_became_peered":"2024-09-14T10:45:43.688136+0000","last_unstale":"2024-09-14T11:22:51.104146+0000","last_undegraded":"2024-09-14T11:22:51.104146+0000","last_fullsized":"2024-09-14T11:22:51.104146+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:56:33.762201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243179,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":1033,"num_read_kb":62484,"num_write":1323,"num_write_kb":26359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":477,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:09.985337+0000","last_change":"2024-09-14T10:45:47.726708+0000","last_active":"2024-09-14T11:19:09.985337+0000","last_peered":"2024-09-14T11:19:09.985337+0000","last_clean":"2024-09-14T11:19:09.985337+0000","last_became_active":"2024-09-14T10:45:47.725711+0000","last_became_peered":"2024-09-14T10:45:47.725711+0000","last_unstale":"2024-09-14T11:19:09.985337+0000","last_undegraded":"2024-09-14T11:19:09.985337+0000","last_fullsized":"2024-09-14T11:19:09.985337+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:23.138591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"260'277","reported_seq":830,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.843572+0000","last_change":"2024-09-14T10:45:49.730097+0000","last_active":"2024-09-14T11:22:42.843572+0000","last_peered":"2024-09-14T11:22:42.843572+0000","last_clean":"2024-09-14T11:22:42.843572+0000","last_became_active":"2024-09-14T10:45:49.729803+0000","last_became_peered":"2024-09-14T10:45:49.729803+0000","last_unstale":"2024-09-14T11:22:42.843572+0000","last_undegraded":"2024-09-14T11:22:42.843572+0000","last_fullsized":"2024-09-14T11:22:42.843572+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:44.767050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57256,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":452,"num_read_kb":917,"num_write":382,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":468,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:21.228045+0000","last_change":"2024-09-14T10:45:51.749137+0000","last_active":"2024-09-14T11:18:21.228045+0000","last_peered":"2024-09-14T11:18:21.228045+0000","last_clean":"2024-09-14T11:18:21.228045+0000","last_became_active":"2024-09-14T10:45:51.748871+0000","last_became_peered":"2024-09-14T10:45:51.748871+0000","last_unstale":"2024-09-14T11:18:21.228045+0000","last_undegraded":"2024-09-14T11:18:21.228045+0000","last_fullsized":"2024-09-14T11:18:21.228045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:41.260779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"260'208","reported_seq":1061,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.145844+0000","last_change":"2024-09-14T10:45:53.750953+0000","last_active":"2024-09-14T11:21:27.145844+0000","last_peered":"2024-09-14T11:21:27.145844+0000","last_clean":"2024-09-14T11:21:27.145844+0000","last_became_active":"2024-09-14T10:45:53.750595+0000","last_became_peered":"2024-09-14T10:45:53.750595+0000","last_unstale":"2024-09-14T11:21:27.145844+0000","last_undegraded":"2024-09-14T11:21:27.145844+0000","last_fullsized":"2024-09-14T11:21:27.145844+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:54.639620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1617,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":634,"num_read_kb":624,"num_write":573,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"260'1182","reported_seq":2743,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.327539+0000","last_change":"2024-09-14T10:45:45.722205+0000","last_active":"2024-09-14T11:21:28.327539+0000","last_peered":"2024-09-14T11:21:28.327539+0000","last_clean":"2024-09-14T11:21:28.327539+0000","last_became_active":"2024-09-14T10:45:45.721945+0000","last_became_peered":"2024-09-14T10:45:45.721945+0000","last_unstale":"2024-09-14T11:21:28.327539+0000","last_undegraded":"2024-09-14T11:21:28.327539+0000","last_fullsized":"2024-09-14T11:21:28.327539+0000","mapping_epoch":26,"log_start":"260'1100","ondisk_log_start":"260'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":1100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:32.193876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5490,"num_read_kb":4869,"num_write":1672,"num_write_kb":727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"260'278","reported_seq":912,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:26.651713+0000","last_change":"2024-09-14T10:45:43.682713+0000","last_active":"2024-09-14T11:21:26.651713+0000","last_peered":"2024-09-14T11:21:26.651713+0000","last_clean":"2024-09-14T11:21:26.651713+0000","last_became_active":"2024-09-14T10:45:43.682457+0000","last_became_peered":"2024-09-14T10:45:43.682457+0000","last_unstale":"2024-09-14T11:21:26.651713+0000","last_undegraded":"2024-09-14T11:21:26.651713+0000","last_fullsized":"2024-09-14T11:21:26.651713+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:25.191206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6916743,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":526,"num_read_kb":98004,"num_write":1119,"num_write_kb":36067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":474,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:19.977588+0000","last_change":"2024-09-14T10:45:47.726953+0000","last_active":"2024-09-14T11:18:19.977588+0000","last_peered":"2024-09-14T11:18:19.977588+0000","last_clean":"2024-09-14T11:18:19.977588+0000","last_became_active":"2024-09-14T10:45:47.726635+0000","last_became_peered":"2024-09-14T10:45:47.726635+0000","last_unstale":"2024-09-14T11:18:19.977588+0000","last_undegraded":"2024-09-14T11:18:19.977588+0000","last_fullsized":"2024-09-14T11:18:19.977588+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:12.596595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"260'274","reported_seq":827,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.701917+0000","last_change":"2024-09-14T10:45:49.729734+0000","last_active":"2024-09-14T11:22:50.701917+0000","last_peered":"2024-09-14T11:22:50.701917+0000","last_clean":"2024-09-14T11:22:50.701917+0000","last_became_active":"2024-09-14T10:45:49.729422+0000","last_became_peered":"2024-09-14T10:45:49.729422+0000","last_unstale":"2024-09-14T11:22:50.701917+0000","last_undegraded":"2024-09-14T11:22:50.701917+0000","last_fullsized":"2024-09-14T11:22:50.701917+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:36.625007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45487,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":456,"num_read_kb":1073,"num_write":374,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":475,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:00.997411+0000","last_change":"2024-09-14T10:45:51.748413+0000","last_active":"2024-09-14T11:20:00.997411+0000","last_peered":"2024-09-14T11:20:00.997411+0000","last_clean":"2024-09-14T11:20:00.997411+0000","last_became_active":"2024-09-14T10:45:51.747888+0000","last_became_peered":"2024-09-14T10:45:51.747888+0000","last_unstale":"2024-09-14T11:20:00.997411+0000","last_undegraded":"2024-09-14T11:20:00.997411+0000","last_fullsized":"2024-09-14T11:20:00.997411+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:31:10.652817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"260'126","reported_seq":597,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:43.728256+0000","last_change":"2024-09-14T10:45:53.750141+0000","last_active":"2024-09-14T11:22:43.728256+0000","last_peered":"2024-09-14T11:22:43.728256+0000","last_clean":"2024-09-14T11:22:43.728256+0000","last_became_active":"2024-09-14T10:45:53.749868+0000","last_became_peered":"2024-09-14T10:45:53.749868+0000","last_unstale":"2024-09-14T11:22:43.728256+0000","last_undegraded":"2024-09-14T11:22:43.728256+0000","last_fullsized":"2024-09-14T11:22:43.728256+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:03.049227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":111,"num_write":304,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"260'1124","reported_seq":2685,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:13.095273+0000","last_change":"2024-09-14T10:45:45.711778+0000","last_active":"2024-09-14T11:21:13.095273+0000","last_peered":"2024-09-14T11:21:13.095273+0000","last_clean":"2024-09-14T11:21:13.095273+0000","last_became_active":"2024-09-14T10:45:45.711476+0000","last_became_peered":"2024-09-14T10:45:45.711476+0000","last_unstale":"2024-09-14T11:21:13.095273+0000","last_undegraded":"2024-09-14T11:21:13.095273+0000","last_fullsized":"2024-09-14T11:21:13.095273+0000","mapping_epoch":26,"log_start":"260'1100","ondisk_log_start":"260'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":1100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:10.238217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5159,"num_read_kb":4588,"num_write":1521,"num_write_kb":611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"260'311","reported_seq":986,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.070976+0000","last_change":"2024-09-14T10:45:43.692253+0000","last_active":"2024-09-14T11:22:51.070976+0000","last_peered":"2024-09-14T11:22:51.070976+0000","last_clean":"2024-09-14T11:22:51.070976+0000","last_became_active":"2024-09-14T10:45:43.691976+0000","last_became_peered":"2024-09-14T10:45:43.691976+0000","last_unstale":"2024-09-14T11:22:51.070976+0000","last_undegraded":"2024-09-14T11:22:51.070976+0000","last_fullsized":"2024-09-14T11:22:51.070976+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:28.335886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102644,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":725,"num_read_kb":9027,"num_write":1095,"num_write_kb":58772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":483,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:21.106659+0000","last_change":"2024-09-14T10:45:47.726662+0000","last_active":"2024-09-14T11:18:21.106659+0000","last_peered":"2024-09-14T11:18:21.106659+0000","last_clean":"2024-09-14T11:18:21.106659+0000","last_became_active":"2024-09-14T10:45:47.726392+0000","last_became_peered":"2024-09-14T10:45:47.726392+0000","last_unstale":"2024-09-14T11:18:21.106659+0000","last_undegraded":"2024-09-14T11:18:21.106659+0000","last_fullsized":"2024-09-14T11:18:21.106659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:02:14.749214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"260'79","reported_seq":576,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:05.985921+0000","last_change":"2024-09-14T10:45:49.728741+0000","last_active":"2024-09-14T11:21:05.985921+0000","last_peered":"2024-09-14T11:21:05.985921+0000","last_clean":"2024-09-14T11:21:05.985921+0000","last_became_active":"2024-09-14T10:45:49.728444+0000","last_became_peered":"2024-09-14T10:45:49.728444+0000","last_unstale":"2024-09-14T11:21:05.985921+0000","last_undegraded":"2024-09-14T11:21:05.985921+0000","last_fullsized":"2024-09-14T11:21:05.985921+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:42.103576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":102,"num_read_kb":95,"num_write":120,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"260'790","reported_seq":2260,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:43.739402+0000","last_change":"2024-09-14T10:45:51.746786+0000","last_active":"2024-09-14T11:22:43.739402+0000","last_peered":"2024-09-14T11:22:43.739402+0000","last_clean":"2024-09-14T11:22:43.739402+0000","last_became_active":"2024-09-14T10:45:51.746303+0000","last_became_peered":"2024-09-14T10:45:51.746303+0000","last_unstale":"2024-09-14T11:22:43.739402+0000","last_undegraded":"2024-09-14T11:22:43.739402+0000","last_fullsized":"2024-09-14T11:22:43.739402+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:04.109276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"260'118","reported_seq":594,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:15.160213+0000","last_change":"2024-09-14T10:45:53.751786+0000","last_active":"2024-09-14T11:21:15.160213+0000","last_peered":"2024-09-14T11:21:15.160213+0000","last_clean":"2024-09-14T11:21:15.160213+0000","last_became_active":"2024-09-14T10:45:53.751453+0000","last_became_peered":"2024-09-14T10:45:53.751453+0000","last_unstale":"2024-09-14T11:21:15.160213+0000","last_undegraded":"2024-09-14T11:21:15.160213+0000","last_fullsized":"2024-09-14T11:21:15.160213+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:59.084760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":104,"num_write":274,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"260'444","reported_seq":2012,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:16.290828+0000","last_change":"2024-09-14T10:45:45.726094+0000","last_active":"2024-09-14T11:21:16.290828+0000","last_peered":"2024-09-14T11:21:16.290828+0000","last_clean":"2024-09-14T11:21:16.290828+0000","last_became_active":"2024-09-14T10:45:45.725806+0000","last_became_peered":"2024-09-14T10:45:45.725806+0000","last_unstale":"2024-09-14T11:21:16.290828+0000","last_undegraded":"2024-09-14T11:21:16.290828+0000","last_fullsized":"2024-09-14T11:21:16.290828+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:22.555341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2489,"num_read_kb":2350,"num_write":523,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"260'315","reported_seq":976,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:21.743941+0000","last_change":"2024-09-14T10:45:43.687148+0000","last_active":"2024-09-14T11:20:21.743941+0000","last_peered":"2024-09-14T11:20:21.743941+0000","last_clean":"2024-09-14T11:20:21.743941+0000","last_became_active":"2024-09-14T10:45:43.686768+0000","last_became_peered":"2024-09-14T10:45:43.686768+0000","last_unstale":"2024-09-14T11:20:21.743941+0000","last_undegraded":"2024-09-14T11:20:21.743941+0000","last_fullsized":"2024-09-14T11:20:21.743941+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:33.463121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6292907,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":664,"num_read_kb":58950,"num_write":1256,"num_write_kb":32402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":483,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:17.100449+0000","last_change":"2024-09-14T10:45:47.719027+0000","last_active":"2024-09-14T11:18:17.100449+0000","last_peered":"2024-09-14T11:18:17.100449+0000","last_clean":"2024-09-14T11:18:17.100449+0000","last_became_active":"2024-09-14T10:45:47.718721+0000","last_became_peered":"2024-09-14T10:45:47.718721+0000","last_unstale":"2024-09-14T11:18:17.100449+0000","last_undegraded":"2024-09-14T11:18:17.100449+0000","last_fullsized":"2024-09-14T11:18:17.100449+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:24.577421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"260'288","reported_seq":849,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:07.226802+0000","last_change":"2024-09-14T10:45:49.733977+0000","last_active":"2024-09-14T11:22:07.226802+0000","last_peered":"2024-09-14T11:22:07.226802+0000","last_clean":"2024-09-14T11:22:07.226802+0000","last_became_active":"2024-09-14T10:45:49.733684+0000","last_became_peered":"2024-09-14T10:45:49.733684+0000","last_unstale":"2024-09-14T11:22:07.226802+0000","last_undegraded":"2024-09-14T11:22:07.226802+0000","last_fullsized":"2024-09-14T11:22:07.226802+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:42.242159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54804,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":456,"num_read_kb":913,"num_write":378,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":476,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:41.118307+0000","last_change":"2024-09-14T10:45:51.742049+0000","last_active":"2024-09-14T11:19:41.118307+0000","last_peered":"2024-09-14T11:19:41.118307+0000","last_clean":"2024-09-14T11:19:41.118307+0000","last_became_active":"2024-09-14T10:45:51.741767+0000","last_became_peered":"2024-09-14T10:45:51.741767+0000","last_unstale":"2024-09-14T11:19:41.118307+0000","last_undegraded":"2024-09-14T11:19:41.118307+0000","last_fullsized":"2024-09-14T11:19:41.118307+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:16:02.477621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"260'128","reported_seq":620,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:06.769959+0000","last_change":"2024-09-14T10:45:53.749052+0000","last_active":"2024-09-14T11:21:06.769959+0000","last_peered":"2024-09-14T11:21:06.769959+0000","last_clean":"2024-09-14T11:21:06.769959+0000","last_became_active":"2024-09-14T10:45:53.748760+0000","last_became_peered":"2024-09-14T10:45:53.748760+0000","last_unstale":"2024-09-14T11:21:06.769959+0000","last_undegraded":"2024-09-14T11:21:06.769959+0000","last_fullsized":"2024-09-14T11:21:06.769959+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:12.144519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":155,"num_read_kb":143,"num_write":309,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"260'787","reported_seq":2297,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.832691+0000","last_change":"2024-09-14T10:45:45.718006+0000","last_active":"2024-09-14T11:22:42.832691+0000","last_peered":"2024-09-14T11:22:42.832691+0000","last_clean":"2024-09-14T11:22:42.832691+0000","last_became_active":"2024-09-14T10:45:45.717706+0000","last_became_peered":"2024-09-14T10:45:45.717706+0000","last_unstale":"2024-09-14T11:22:42.832691+0000","last_undegraded":"2024-09-14T11:22:42.832691+0000","last_fullsized":"2024-09-14T11:22:42.832691+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:04.856085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3708,"num_read_kb":3358,"num_write":1019,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"260'267","reported_seq":873,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:10.378878+0000","last_change":"2024-09-14T10:45:43.683275+0000","last_active":"2024-09-14T11:21:10.378878+0000","last_peered":"2024-09-14T11:21:10.378878+0000","last_clean":"2024-09-14T11:21:10.378878+0000","last_became_active":"2024-09-14T10:45:43.683014+0000","last_became_peered":"2024-09-14T10:45:43.683014+0000","last_unstale":"2024-09-14T11:21:10.378878+0000","last_undegraded":"2024-09-14T11:21:10.378878+0000","last_fullsized":"2024-09-14T11:21:10.378878+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:39:23.935741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14159038,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":471,"num_read_kb":15767,"num_write":923,"num_write_kb":32563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":474,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:19.977556+0000","last_change":"2024-09-14T10:45:47.726045+0000","last_active":"2024-09-14T11:18:19.977556+0000","last_peered":"2024-09-14T11:18:19.977556+0000","last_clean":"2024-09-14T11:18:19.977556+0000","last_became_active":"2024-09-14T10:45:47.725850+0000","last_became_peered":"2024-09-14T10:45:47.725850+0000","last_unstale":"2024-09-14T11:18:19.977556+0000","last_undegraded":"2024-09-14T11:18:19.977556+0000","last_fullsized":"2024-09-14T11:18:19.977556+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:53.534864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"260'258","reported_seq":811,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.945561+0000","last_change":"2024-09-14T10:45:49.736850+0000","last_active":"2024-09-14T11:22:50.945561+0000","last_peered":"2024-09-14T11:22:50.945561+0000","last_clean":"2024-09-14T11:22:50.945561+0000","last_became_active":"2024-09-14T10:45:49.736538+0000","last_became_peered":"2024-09-14T10:45:49.736538+0000","last_unstale":"2024-09-14T11:22:50.945561+0000","last_undegraded":"2024-09-14T11:22:50.945561+0000","last_fullsized":"2024-09-14T11:22:50.945561+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:24.205374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45998,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":425,"num_read_kb":1014,"num_write":348,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":470,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:47.114678+0000","last_change":"2024-09-14T10:45:51.745256+0000","last_active":"2024-09-14T11:19:47.114678+0000","last_peered":"2024-09-14T11:19:47.114678+0000","last_clean":"2024-09-14T11:19:47.114678+0000","last_became_active":"2024-09-14T10:45:51.744957+0000","last_became_peered":"2024-09-14T10:45:51.744957+0000","last_unstale":"2024-09-14T11:19:47.114678+0000","last_undegraded":"2024-09-14T11:19:47.114678+0000","last_fullsized":"2024-09-14T11:19:47.114678+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:00.836610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"260'125","reported_seq":625,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.799038+0000","last_change":"2024-09-14T10:45:53.750560+0000","last_active":"2024-09-14T11:21:28.799038+0000","last_peered":"2024-09-14T11:21:28.799038+0000","last_clean":"2024-09-14T11:21:28.799038+0000","last_became_active":"2024-09-14T10:45:53.750287+0000","last_became_peered":"2024-09-14T10:45:53.750287+0000","last_unstale":"2024-09-14T11:21:28.799038+0000","last_undegraded":"2024-09-14T11:21:28.799038+0000","last_fullsized":"2024-09-14T11:21:28.799038+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:48.692799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":175,"num_read_kb":170,"num_write":297,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"260'391","reported_seq":1842,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.835107+0000","last_change":"2024-09-14T10:45:45.713005+0000","last_active":"2024-09-14T11:22:42.835107+0000","last_peered":"2024-09-14T11:22:42.835107+0000","last_clean":"2024-09-14T11:22:42.835107+0000","last_became_active":"2024-09-14T10:45:45.712455+0000","last_became_peered":"2024-09-14T10:45:45.712455+0000","last_unstale":"2024-09-14T11:22:42.835107+0000","last_undegraded":"2024-09-14T11:22:42.835107+0000","last_fullsized":"2024-09-14T11:22:42.835107+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:29.570600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2172,"num_read_kb":2052,"num_write":470,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"260'333","reported_seq":980,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.107858+0000","last_change":"2024-09-14T10:45:43.676752+0000","last_active":"2024-09-14T11:22:51.107858+0000","last_peered":"2024-09-14T11:22:51.107858+0000","last_clean":"2024-09-14T11:22:51.107858+0000","last_became_active":"2024-09-14T10:45:43.676145+0000","last_became_peered":"2024-09-14T10:45:43.676145+0000","last_unstale":"2024-09-14T11:22:51.107858+0000","last_undegraded":"2024-09-14T11:22:51.107858+0000","last_fullsized":"2024-09-14T11:22:51.107858+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:31:26.462692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1441418,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":657,"num_read_kb":38975,"num_write":1163,"num_write_kb":36099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:37.112554+0000","last_change":"2024-09-14T10:45:47.724662+0000","last_active":"2024-09-14T11:19:37.112554+0000","last_peered":"2024-09-14T11:19:37.112554+0000","last_clean":"2024-09-14T11:19:37.112554+0000","last_became_active":"2024-09-14T10:45:47.724065+0000","last_became_peered":"2024-09-14T10:45:47.724065+0000","last_unstale":"2024-09-14T11:19:37.112554+0000","last_undegraded":"2024-09-14T11:19:37.112554+0000","last_fullsized":"2024-09-14T11:19:37.112554+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:57.045602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"260'239","reported_seq":777,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.625663+0000","last_change":"2024-09-14T10:45:49.728006+0000","last_active":"2024-09-14T11:22:50.625663+0000","last_peered":"2024-09-14T11:22:50.625663+0000","last_clean":"2024-09-14T11:22:50.625663+0000","last_became_active":"2024-09-14T10:45:49.727721+0000","last_became_peered":"2024-09-14T10:45:49.727721+0000","last_unstale":"2024-09-14T11:22:50.625663+0000","last_undegraded":"2024-09-14T11:22:50.625663+0000","last_fullsized":"2024-09-14T11:22:50.625663+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:35.275905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47218,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":415,"num_read_kb":1017,"num_write":344,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":469,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:22.101700+0000","last_change":"2024-09-14T10:45:51.742675+0000","last_active":"2024-09-14T11:18:22.101700+0000","last_peered":"2024-09-14T11:18:22.101700+0000","last_clean":"2024-09-14T11:18:22.101700+0000","last_became_active":"2024-09-14T10:45:51.742387+0000","last_became_peered":"2024-09-14T10:45:51.742387+0000","last_unstale":"2024-09-14T11:18:22.101700+0000","last_undegraded":"2024-09-14T11:18:22.101700+0000","last_fullsized":"2024-09-14T11:18:22.101700+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:36.809715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"260'160","reported_seq":1255,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.232516+0000","last_change":"2024-09-14T10:45:53.752874+0000","last_active":"2024-09-14T11:21:27.232516+0000","last_peered":"2024-09-14T11:21:27.232516+0000","last_clean":"2024-09-14T11:21:27.232516+0000","last_became_active":"2024-09-14T10:45:53.752639+0000","last_became_peered":"2024-09-14T10:45:53.752639+0000","last_unstale":"2024-09-14T11:21:27.232516+0000","last_undegraded":"2024-09-14T11:21:27.232516+0000","last_fullsized":"2024-09-14T11:21:27.232516+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:29.390299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":838,"num_read_kb":820,"num_write":382,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"260'397","reported_seq":1903,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:15.867791+0000","last_change":"2024-09-14T10:45:45.719248+0000","last_active":"2024-09-14T11:21:15.867791+0000","last_peered":"2024-09-14T11:21:15.867791+0000","last_clean":"2024-09-14T11:21:15.867791+0000","last_became_active":"2024-09-14T10:45:45.718964+0000","last_became_peered":"2024-09-14T10:45:45.718964+0000","last_unstale":"2024-09-14T11:21:15.867791+0000","last_undegraded":"2024-09-14T11:21:15.867791+0000","last_fullsized":"2024-09-14T11:21:15.867791+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:55.163718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2133,"num_read_kb":2043,"num_write":433,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"260'339","reported_seq":977,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.035464+0000","last_change":"2024-09-14T10:45:43.675554+0000","last_active":"2024-09-14T11:22:51.035464+0000","last_peered":"2024-09-14T11:22:51.035464+0000","last_clean":"2024-09-14T11:22:51.035464+0000","last_became_active":"2024-09-14T10:45:43.675220+0000","last_became_peered":"2024-09-14T10:45:43.675220+0000","last_unstale":"2024-09-14T11:22:51.035464+0000","last_undegraded":"2024-09-14T11:22:51.035464+0000","last_fullsized":"2024-09-14T11:22:51.035464+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:34:09.729685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20992,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":580,"num_read_kb":38424,"num_write":1063,"num_write_kb":41594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":485,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:46.119103+0000","last_change":"2024-09-14T10:45:47.729627+0000","last_active":"2024-09-14T11:19:46.119103+0000","last_peered":"2024-09-14T11:19:46.119103+0000","last_clean":"2024-09-14T11:19:46.119103+0000","last_became_active":"2024-09-14T10:45:47.729338+0000","last_became_peered":"2024-09-14T10:45:47.729338+0000","last_unstale":"2024-09-14T11:19:46.119103+0000","last_undegraded":"2024-09-14T11:19:46.119103+0000","last_fullsized":"2024-09-14T11:19:46.119103+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:15.042150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"260'285","reported_seq":842,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:10.053013+0000","last_change":"2024-09-14T10:45:49.731337+0000","last_active":"2024-09-14T11:21:10.053013+0000","last_peered":"2024-09-14T11:21:10.053013+0000","last_clean":"2024-09-14T11:21:10.053013+0000","last_became_active":"2024-09-14T10:45:49.729842+0000","last_became_peered":"2024-09-14T10:45:49.729842+0000","last_unstale":"2024-09-14T11:21:10.053013+0000","last_undegraded":"2024-09-14T11:21:10.053013+0000","last_fullsized":"2024-09-14T11:21:10.053013+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:25:47.634561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53437,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":465,"num_read_kb":935,"num_write":380,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":475,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:21.106628+0000","last_change":"2024-09-14T10:45:51.745622+0000","last_active":"2024-09-14T11:18:21.106628+0000","last_peered":"2024-09-14T11:18:21.106628+0000","last_clean":"2024-09-14T11:18:21.106628+0000","last_became_active":"2024-09-14T10:45:51.745310+0000","last_became_peered":"2024-09-14T10:45:51.745310+0000","last_unstale":"2024-09-14T11:18:21.106628+0000","last_undegraded":"2024-09-14T11:18:21.106628+0000","last_fullsized":"2024-09-14T11:18:21.106628+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:03.197112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"260'137","reported_seq":616,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.832054+0000","last_change":"2024-09-14T10:45:53.755154+0000","last_active":"2024-09-14T11:22:42.832054+0000","last_peered":"2024-09-14T11:22:42.832054+0000","last_clean":"2024-09-14T11:22:42.832054+0000","last_became_active":"2024-09-14T10:45:53.754826+0000","last_became_peered":"2024-09-14T10:45:53.754826+0000","last_unstale":"2024-09-14T11:22:42.832054+0000","last_undegraded":"2024-09-14T11:22:42.832054+0000","last_fullsized":"2024-09-14T11:22:42.832054+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:13.225340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":657,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":128,"num_read_kb":116,"num_write":335,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"260'420","reported_seq":1963,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:15.435203+0000","last_change":"2024-09-14T10:45:45.709097+0000","last_active":"2024-09-14T11:21:15.435203+0000","last_peered":"2024-09-14T11:21:15.435203+0000","last_clean":"2024-09-14T11:21:15.435203+0000","last_became_active":"2024-09-14T10:45:45.708229+0000","last_became_peered":"2024-09-14T10:45:45.708229+0000","last_unstale":"2024-09-14T11:21:15.435203+0000","last_undegraded":"2024-09-14T11:21:15.435203+0000","last_fullsized":"2024-09-14T11:21:15.435203+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:43.675052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2330,"num_read_kb":2210,"num_write":517,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"260'294","reported_seq":941,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:11.838702+0000","last_change":"2024-09-14T10:45:43.684421+0000","last_active":"2024-09-14T11:21:11.838702+0000","last_peered":"2024-09-14T11:21:11.838702+0000","last_clean":"2024-09-14T11:21:11.838702+0000","last_became_active":"2024-09-14T10:45:43.684102+0000","last_became_peered":"2024-09-14T10:45:43.684102+0000","last_unstale":"2024-09-14T11:21:11.838702+0000","last_undegraded":"2024-09-14T11:21:11.838702+0000","last_fullsized":"2024-09-14T11:21:11.838702+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:13.550852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12551297,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":546,"num_read_kb":82369,"num_write":1003,"num_write_kb":43712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"260'384","reported_seq":1943,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.835413+0000","last_change":"2024-09-14T10:45:45.719252+0000","last_active":"2024-09-14T11:22:42.835413+0000","last_peered":"2024-09-14T11:22:42.835413+0000","last_clean":"2024-09-14T11:22:42.835413+0000","last_became_active":"2024-09-14T10:45:45.718949+0000","last_became_peered":"2024-09-14T10:45:45.718949+0000","last_unstale":"2024-09-14T11:22:42.835413+0000","last_undegraded":"2024-09-14T11:22:42.835413+0000","last_fullsized":"2024-09-14T11:22:42.835413+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:10.419875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2227,"num_read_kb":2135,"num_write":439,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"260'294","reported_seq":906,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.998723+0000","last_change":"2024-09-14T10:45:43.690959+0000","last_active":"2024-09-14T11:22:50.998723+0000","last_peered":"2024-09-14T11:22:50.998723+0000","last_clean":"2024-09-14T11:22:50.998723+0000","last_became_active":"2024-09-14T10:45:43.690675+0000","last_became_peered":"2024-09-14T10:45:43.690675+0000","last_unstale":"2024-09-14T11:22:50.998723+0000","last_undegraded":"2024-09-14T11:22:50.998723+0000","last_fullsized":"2024-09-14T11:22:50.998723+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:38.359419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10810592,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":513,"num_read_kb":9887,"num_write":1014,"num_write_kb":21015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"260'531","reported_seq":2240,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:16.296791+0000","last_change":"2024-09-14T10:45:45.718344+0000","last_active":"2024-09-14T11:21:16.296791+0000","last_peered":"2024-09-14T11:21:16.296791+0000","last_clean":"2024-09-14T11:21:16.296791+0000","last_became_active":"2024-09-14T10:45:45.717393+0000","last_became_peered":"2024-09-14T10:45:45.717393+0000","last_unstale":"2024-09-14T11:21:16.296791+0000","last_undegraded":"2024-09-14T11:21:16.296791+0000","last_fullsized":"2024-09-14T11:21:16.296791+0000","mapping_epoch":26,"log_start":"260'500","ondisk_log_start":"260'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":500,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:54.085248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2830,"num_read_kb":2663,"num_write":635,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"260'315","reported_seq":956,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:19.713137+0000","last_change":"2024-09-14T10:45:43.675487+0000","last_active":"2024-09-14T11:20:19.713137+0000","last_peered":"2024-09-14T11:20:19.713137+0000","last_clean":"2024-09-14T11:20:19.713137+0000","last_became_active":"2024-09-14T10:45:43.675216+0000","last_became_peered":"2024-09-14T10:45:43.675216+0000","last_unstale":"2024-09-14T11:20:19.713137+0000","last_undegraded":"2024-09-14T11:20:19.713137+0000","last_fullsized":"2024-09-14T11:20:19.713137+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:40:10.871125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6337635,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":638,"num_read_kb":14117,"num_write":1152,"num_write_kb":48801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"260'869","reported_seq":2509,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.742312+0000","last_change":"2024-09-14T10:45:45.721319+0000","last_active":"2024-09-14T11:21:28.742312+0000","last_peered":"2024-09-14T11:21:28.742312+0000","last_clean":"2024-09-14T11:21:28.742312+0000","last_became_active":"2024-09-14T10:45:45.720939+0000","last_became_peered":"2024-09-14T10:45:45.720939+0000","last_unstale":"2024-09-14T11:21:28.742312+0000","last_undegraded":"2024-09-14T11:21:28.742312+0000","last_fullsized":"2024-09-14T11:21:28.742312+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":800,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:00.246883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4139,"num_read_kb":3737,"num_write":1132,"num_write_kb":407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"260'297","reported_seq":877,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.101577+0000","last_change":"2024-09-14T10:45:43.682207+0000","last_active":"2024-09-14T11:22:51.101577+0000","last_peered":"2024-09-14T11:22:51.101577+0000","last_clean":"2024-09-14T11:22:51.101577+0000","last_became_active":"2024-09-14T10:45:43.681864+0000","last_became_peered":"2024-09-14T10:45:43.681864+0000","last_unstale":"2024-09-14T11:22:51.101577+0000","last_undegraded":"2024-09-14T11:22:51.101577+0000","last_fullsized":"2024-09-14T11:22:51.101577+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:57.070549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5245087,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":444,"num_read_kb":5481,"num_write":949,"num_write_kb":23381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"260'447","reported_seq":2094,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.733448+0000","last_change":"2024-09-14T10:45:45.722885+0000","last_active":"2024-09-14T11:21:28.733448+0000","last_peered":"2024-09-14T11:21:28.733448+0000","last_clean":"2024-09-14T11:21:28.733448+0000","last_became_active":"2024-09-14T10:45:45.722575+0000","last_became_peered":"2024-09-14T10:45:45.722575+0000","last_unstale":"2024-09-14T11:21:28.733448+0000","last_undegraded":"2024-09-14T11:21:28.733448+0000","last_fullsized":"2024-09-14T11:21:28.733448+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:17.355674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2593,"num_read_kb":2475,"num_write":496,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"260'331","reported_seq":965,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.999911+0000","last_change":"2024-09-14T10:45:43.691467+0000","last_active":"2024-09-14T11:22:50.999911+0000","last_peered":"2024-09-14T11:22:50.999911+0000","last_clean":"2024-09-14T11:22:50.999911+0000","last_became_active":"2024-09-14T10:45:43.691101+0000","last_became_peered":"2024-09-14T10:45:43.691101+0000","last_unstale":"2024-09-14T11:22:50.999911+0000","last_undegraded":"2024-09-14T11:22:50.999911+0000","last_fullsized":"2024-09-14T11:22:50.999911+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:42.090533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1158287,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":609,"num_read_kb":20829,"num_write":1118,"num_write_kb":28609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"260'964","reported_seq":2549,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.733701+0000","last_change":"2024-09-14T10:45:45.717757+0000","last_active":"2024-09-14T11:21:28.733701+0000","last_peered":"2024-09-14T11:21:28.733701+0000","last_clean":"2024-09-14T11:21:28.733701+0000","last_became_active":"2024-09-14T10:45:45.717482+0000","last_became_peered":"2024-09-14T10:45:45.717482+0000","last_unstale":"2024-09-14T11:21:28.733701+0000","last_undegraded":"2024-09-14T11:21:28.733701+0000","last_fullsized":"2024-09-14T11:21:28.733701+0000","mapping_epoch":26,"log_start":"260'900","ondisk_log_start":"260'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":900,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:38.032224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4656,"num_read_kb":4162,"num_write":1345,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"260'397","reported_seq":1036,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.957422+0000","last_change":"2024-09-14T10:45:43.682195+0000","last_active":"2024-09-14T11:22:50.957422+0000","last_peered":"2024-09-14T11:22:50.957422+0000","last_clean":"2024-09-14T11:22:50.957422+0000","last_became_active":"2024-09-14T10:45:43.681769+0000","last_became_peered":"2024-09-14T10:45:43.681769+0000","last_unstale":"2024-09-14T11:22:50.957422+0000","last_undegraded":"2024-09-14T11:22:50.957422+0000","last_fullsized":"2024-09-14T11:22:50.957422+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:19:39.686774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4319,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":866,"num_read_kb":850,"num_write":1191,"num_write_kb":26526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"260'498","reported_seq":2173,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:16.642909+0000","last_change":"2024-09-14T10:45:45.724828+0000","last_active":"2024-09-14T11:21:16.642909+0000","last_peered":"2024-09-14T11:21:16.642909+0000","last_clean":"2024-09-14T11:21:16.642909+0000","last_became_active":"2024-09-14T10:45:45.724491+0000","last_became_peered":"2024-09-14T10:45:45.724491+0000","last_unstale":"2024-09-14T11:21:16.642909+0000","last_undegraded":"2024-09-14T11:21:16.642909+0000","last_fullsized":"2024-09-14T11:21:16.642909+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:19.646816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2800,"num_read_kb":2654,"num_write":635,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"260'287","reported_seq":904,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:59.841393+0000","last_change":"2024-09-14T10:45:43.672840+0000","last_active":"2024-09-14T11:20:59.841393+0000","last_peered":"2024-09-14T11:20:59.841393+0000","last_clean":"2024-09-14T11:20:59.841393+0000","last_became_active":"2024-09-14T10:45:43.672592+0000","last_became_peered":"2024-09-14T10:45:43.672592+0000","last_unstale":"2024-09-14T11:20:59.841393+0000","last_undegraded":"2024-09-14T11:20:59.841393+0000","last_fullsized":"2024-09-14T11:20:59.841393+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:20.782416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6709220,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":509,"num_read_kb":14710,"num_write":969,"num_write_kb":26884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"260'948","reported_seq":2547,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:10.890134+0000","last_change":"2024-09-14T10:45:45.713168+0000","last_active":"2024-09-14T11:21:10.890134+0000","last_peered":"2024-09-14T11:21:10.890134+0000","last_clean":"2024-09-14T11:21:10.890134+0000","last_became_active":"2024-09-14T10:45:45.712642+0000","last_became_peered":"2024-09-14T10:45:45.712642+0000","last_unstale":"2024-09-14T11:21:10.890134+0000","last_undegraded":"2024-09-14T11:21:10.890134+0000","last_fullsized":"2024-09-14T11:21:10.890134+0000","mapping_epoch":26,"log_start":"260'900","ondisk_log_start":"260'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":900,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:58.076786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4544,"num_read_kb":4033,"num_write":1311,"num_write_kb":524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"260'357","reported_seq":998,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.108561+0000","last_change":"2024-09-14T10:45:43.675555+0000","last_active":"2024-09-14T11:22:51.108561+0000","last_peered":"2024-09-14T11:22:51.108561+0000","last_clean":"2024-09-14T11:22:51.108561+0000","last_became_active":"2024-09-14T10:45:43.675233+0000","last_became_peered":"2024-09-14T10:45:43.675233+0000","last_unstale":"2024-09-14T11:22:51.108561+0000","last_undegraded":"2024-09-14T11:22:51.108561+0000","last_fullsized":"2024-09-14T11:22:51.108561+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:01.549298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":397594,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":653,"num_read_kb":10456,"num_write":1251,"num_write_kb":38144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"260'843","reported_seq":2436,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.742304+0000","last_change":"2024-09-14T10:45:45.712273+0000","last_active":"2024-09-14T11:21:28.742304+0000","last_peered":"2024-09-14T11:21:28.742304+0000","last_clean":"2024-09-14T11:21:28.742304+0000","last_became_active":"2024-09-14T10:45:45.711947+0000","last_became_peered":"2024-09-14T10:45:45.711947+0000","last_unstale":"2024-09-14T11:21:28.742304+0000","last_undegraded":"2024-09-14T11:21:28.742304+0000","last_fullsized":"2024-09-14T11:21:28.742304+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":800,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:05:59.351828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4120,"num_read_kb":3716,"num_write":1158,"num_write_kb":467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"260'252","reported_seq":852,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:13.787841+0000","last_change":"2024-09-14T10:45:43.677879+0000","last_active":"2024-09-14T11:21:13.787841+0000","last_peered":"2024-09-14T11:21:13.787841+0000","last_clean":"2024-09-14T11:21:13.787841+0000","last_became_active":"2024-09-14T10:45:43.677597+0000","last_became_peered":"2024-09-14T10:45:43.677597+0000","last_unstale":"2024-09-14T11:21:13.787841+0000","last_undegraded":"2024-09-14T11:21:13.787841+0000","last_fullsized":"2024-09-14T11:21:13.787841+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:12.554551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672162,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":428,"num_read_kb":1898,"num_write":934,"num_write_kb":19841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"260'855","reported_seq":2368,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:13.519366+0000","last_change":"2024-09-14T10:45:45.715549+0000","last_active":"2024-09-14T11:21:13.519366+0000","last_peered":"2024-09-14T11:21:13.519366+0000","last_clean":"2024-09-14T11:21:13.519366+0000","last_became_active":"2024-09-14T10:45:45.715268+0000","last_became_peered":"2024-09-14T10:45:45.715268+0000","last_unstale":"2024-09-14T11:21:13.519366+0000","last_undegraded":"2024-09-14T11:21:13.519366+0000","last_fullsized":"2024-09-14T11:21:13.519366+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":800,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:40.990468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4230,"num_read_kb":3798,"num_write":1192,"num_write_kb":502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"260'339","reported_seq":987,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.103812+0000","last_change":"2024-09-14T10:45:43.681993+0000","last_active":"2024-09-14T11:22:51.103812+0000","last_peered":"2024-09-14T11:22:51.103812+0000","last_clean":"2024-09-14T11:22:51.103812+0000","last_became_active":"2024-09-14T10:45:43.681694+0000","last_became_peered":"2024-09-14T10:45:43.681694+0000","last_unstale":"2024-09-14T11:22:51.103812+0000","last_undegraded":"2024-09-14T11:22:51.103812+0000","last_fullsized":"2024-09-14T11:22:51.103812+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:01.339229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133849,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":697,"num_read_kb":32454,"num_write":1247,"num_write_kb":21071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"260'430","reported_seq":1883,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.336922+0000","last_change":"2024-09-14T10:45:45.723781+0000","last_active":"2024-09-14T11:21:28.336922+0000","last_peered":"2024-09-14T11:21:28.336922+0000","last_clean":"2024-09-14T11:21:28.336922+0000","last_became_active":"2024-09-14T10:45:45.723441+0000","last_became_peered":"2024-09-14T10:45:45.723441+0000","last_unstale":"2024-09-14T11:21:28.336922+0000","last_undegraded":"2024-09-14T11:21:28.336922+0000","last_fullsized":"2024-09-14T11:21:28.336922+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:25.130052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2262,"num_read_kb":2127,"num_write":517,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"260'279","reported_seq":915,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:26.616442+0000","last_change":"2024-09-14T10:45:43.681966+0000","last_active":"2024-09-14T11:21:26.616442+0000","last_peered":"2024-09-14T11:21:26.616442+0000","last_clean":"2024-09-14T11:21:26.616442+0000","last_became_active":"2024-09-14T10:45:43.681441+0000","last_became_peered":"2024-09-14T10:45:43.681441+0000","last_unstale":"2024-09-14T11:21:26.616442+0000","last_undegraded":"2024-09-14T11:21:26.616442+0000","last_fullsized":"2024-09-14T11:21:26.616442+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:17:03.032759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18979549,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":575,"num_read_kb":21101,"num_write":1018,"num_write_kb":38924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"260'751","reported_seq":2222,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:16.648120+0000","last_change":"2024-09-14T10:45:45.711729+0000","last_active":"2024-09-14T11:21:16.648120+0000","last_peered":"2024-09-14T11:21:16.648120+0000","last_clean":"2024-09-14T11:21:16.648120+0000","last_became_active":"2024-09-14T10:45:45.711402+0000","last_became_peered":"2024-09-14T10:45:45.711402+0000","last_unstale":"2024-09-14T11:21:16.648120+0000","last_undegraded":"2024-09-14T11:21:16.648120+0000","last_fullsized":"2024-09-14T11:21:16.648120+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:13:41.088714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3613,"num_read_kb":3262,"num_write":995,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"260'324","reported_seq":945,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.106623+0000","last_change":"2024-09-14T10:45:43.691446+0000","last_active":"2024-09-14T11:22:51.106623+0000","last_peered":"2024-09-14T11:22:51.106623+0000","last_clean":"2024-09-14T11:22:51.106623+0000","last_became_active":"2024-09-14T10:45:43.690104+0000","last_became_peered":"2024-09-14T10:45:43.690104+0000","last_unstale":"2024-09-14T11:22:51.106623+0000","last_undegraded":"2024-09-14T11:22:51.106623+0000","last_fullsized":"2024-09-14T11:22:51.106623+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:57.667620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289114,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":613,"num_read_kb":1889,"num_write":1131,"num_write_kb":1386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"260'584","reported_seq":2224,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:16.648085+0000","last_change":"2024-09-14T10:45:45.723438+0000","last_active":"2024-09-14T11:21:16.648085+0000","last_peered":"2024-09-14T11:21:16.648085+0000","last_clean":"2024-09-14T11:21:16.648085+0000","last_became_active":"2024-09-14T10:45:45.723163+0000","last_became_peered":"2024-09-14T10:45:45.723163+0000","last_unstale":"2024-09-14T11:21:16.648085+0000","last_undegraded":"2024-09-14T11:21:16.648085+0000","last_fullsized":"2024-09-14T11:21:16.648085+0000","mapping_epoch":26,"log_start":"260'500","ondisk_log_start":"260'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":500,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:52.106816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3275,"num_read_kb":3002,"num_write":768,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"260'309","reported_seq":975,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:14.330528+0000","last_change":"2024-09-14T10:45:43.680804+0000","last_active":"2024-09-14T11:21:14.330528+0000","last_peered":"2024-09-14T11:21:14.330528+0000","last_clean":"2024-09-14T11:21:14.330528+0000","last_became_active":"2024-09-14T10:45:43.680517+0000","last_became_peered":"2024-09-14T10:45:43.680517+0000","last_unstale":"2024-09-14T11:21:14.330528+0000","last_undegraded":"2024-09-14T11:21:14.330528+0000","last_fullsized":"2024-09-14T11:21:14.330528+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:45:55.749037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6751287,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":667,"num_read_kb":32475,"num_write":1325,"num_write_kb":39199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"260'767","reported_seq":2281,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:46.011097+0000","last_change":"2024-09-14T10:45:45.719346+0000","last_active":"2024-09-14T11:21:46.011097+0000","last_peered":"2024-09-14T11:21:46.011097+0000","last_clean":"2024-09-14T11:21:46.011097+0000","last_became_active":"2024-09-14T10:45:45.718969+0000","last_became_peered":"2024-09-14T10:45:45.718969+0000","last_unstale":"2024-09-14T11:21:46.011097+0000","last_undegraded":"2024-09-14T11:21:46.011097+0000","last_fullsized":"2024-09-14T11:21:46.011097+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:07:46.732678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3670,"num_read_kb":3326,"num_write":1002,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"260'266","reported_seq":886,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:08.239208+0000","last_change":"2024-09-14T10:45:43.691080+0000","last_active":"2024-09-14T11:21:08.239208+0000","last_peered":"2024-09-14T11:21:08.239208+0000","last_clean":"2024-09-14T11:21:08.239208+0000","last_became_active":"2024-09-14T10:45:43.690489+0000","last_became_peered":"2024-09-14T10:45:43.690489+0000","last_unstale":"2024-09-14T11:21:08.239208+0000","last_undegraded":"2024-09-14T11:21:08.239208+0000","last_fullsized":"2024-09-14T11:21:08.239208+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:15.282672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7471466,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":494,"num_read_kb":22088,"num_write":989,"num_write_kb":34450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"260'625","reported_seq":2199,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:46.134870+0000","last_change":"2024-09-14T10:45:45.727368+0000","last_active":"2024-09-14T11:21:46.134870+0000","last_peered":"2024-09-14T11:21:46.134870+0000","last_clean":"2024-09-14T11:21:46.134870+0000","last_became_active":"2024-09-14T10:45:45.727095+0000","last_became_peered":"2024-09-14T10:45:45.727095+0000","last_unstale":"2024-09-14T11:21:46.134870+0000","last_undegraded":"2024-09-14T11:21:46.134870+0000","last_fullsized":"2024-09-14T11:21:46.134870+0000","mapping_epoch":26,"log_start":"260'600","ondisk_log_start":"260'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":600,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:49.272823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3428,"num_read_kb":3090,"num_write":924,"num_write_kb":450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"260'288","reported_seq":874,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.008854+0000","last_change":"2024-09-14T10:45:43.689500+0000","last_active":"2024-09-14T11:22:51.008854+0000","last_peered":"2024-09-14T11:22:51.008854+0000","last_clean":"2024-09-14T11:22:51.008854+0000","last_became_active":"2024-09-14T10:45:43.689186+0000","last_became_peered":"2024-09-14T10:45:43.689186+0000","last_unstale":"2024-09-14T11:22:51.008854+0000","last_undegraded":"2024-09-14T11:22:51.008854+0000","last_fullsized":"2024-09-14T11:22:51.008854+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:39.910157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6378836,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":438,"num_read_kb":44560,"num_write":917,"num_write_kb":69256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"260'1083","reported_seq":2821,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.337221+0000","last_change":"2024-09-14T10:45:45.720903+0000","last_active":"2024-09-14T11:21:28.337221+0000","last_peered":"2024-09-14T11:21:28.337221+0000","last_clean":"2024-09-14T11:21:28.337221+0000","last_became_active":"2024-09-14T10:45:45.720636+0000","last_became_peered":"2024-09-14T10:45:45.720636+0000","last_unstale":"2024-09-14T11:21:28.337221+0000","last_undegraded":"2024-09-14T11:21:28.337221+0000","last_fullsized":"2024-09-14T11:21:28.337221+0000","mapping_epoch":26,"log_start":"260'1000","ondisk_log_start":"260'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":1000,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:01:02.622281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5348,"num_read_kb":4870,"num_write":1559,"num_write_kb":616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"260'272","reported_seq":944,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:34.177202+0000","last_change":"2024-09-14T10:45:43.682868+0000","last_active":"2024-09-14T11:22:34.177202+0000","last_peered":"2024-09-14T11:22:34.177202+0000","last_clean":"2024-09-14T11:22:34.177202+0000","last_became_active":"2024-09-14T10:45:43.682573+0000","last_became_peered":"2024-09-14T10:45:43.682573+0000","last_unstale":"2024-09-14T11:22:34.177202+0000","last_undegraded":"2024-09-14T11:22:34.177202+0000","last_fullsized":"2024-09-14T11:22:34.177202+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:56.318257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5599748,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":743,"num_read_kb":3981,"num_write":964,"num_write_kb":35472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"260'303","reported_seq":931,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:26.983173+0000","last_change":"2024-09-14T10:45:43.673791+0000","last_active":"2024-09-14T11:21:26.983173+0000","last_peered":"2024-09-14T11:21:26.983173+0000","last_clean":"2024-09-14T11:21:26.983173+0000","last_became_active":"2024-09-14T10:45:43.673527+0000","last_became_peered":"2024-09-14T10:45:43.673527+0000","last_unstale":"2024-09-14T11:21:26.983173+0000","last_undegraded":"2024-09-14T11:21:26.983173+0000","last_fullsized":"2024-09-14T11:21:26.983173+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:05:57.311802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12972944,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":604,"num_read_kb":21996,"num_write":1143,"num_write_kb":25813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"260'1013","reported_seq":2612,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:16.297531+0000","last_change":"2024-09-14T10:45:45.724368+0000","last_active":"2024-09-14T11:21:16.297531+0000","last_peered":"2024-09-14T11:21:16.297531+0000","last_clean":"2024-09-14T11:21:16.297531+0000","last_became_active":"2024-09-14T10:45:45.724040+0000","last_became_peered":"2024-09-14T10:45:45.724040+0000","last_unstale":"2024-09-14T11:21:16.297531+0000","last_undegraded":"2024-09-14T11:21:16.297531+0000","last_fullsized":"2024-09-14T11:21:16.297531+0000","mapping_epoch":26,"log_start":"260'1000","ondisk_log_start":"260'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":1000,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:23.578632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4769,"num_read_kb":4210,"num_write":1424,"num_write_kb":631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"260'359","reported_seq":991,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.079003+0000","last_change":"2024-09-14T10:45:43.687437+0000","last_active":"2024-09-14T11:22:51.079003+0000","last_peered":"2024-09-14T11:22:51.079003+0000","last_clean":"2024-09-14T11:22:51.079003+0000","last_became_active":"2024-09-14T10:45:43.687162+0000","last_became_peered":"2024-09-14T10:45:43.687162+0000","last_unstale":"2024-09-14T11:22:51.079003+0000","last_undegraded":"2024-09-14T11:22:51.079003+0000","last_fullsized":"2024-09-14T11:22:51.079003+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:46.791778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5587407,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":643,"num_read_kb":37348,"num_write":1163,"num_write_kb":26064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"260'477","reported_seq":2017,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.049726+0000","last_change":"2024-09-14T10:45:45.712133+0000","last_active":"2024-09-14T11:21:27.049726+0000","last_peered":"2024-09-14T11:21:27.049726+0000","last_clean":"2024-09-14T11:21:27.049726+0000","last_became_active":"2024-09-14T10:45:45.711869+0000","last_became_peered":"2024-09-14T10:45:45.711869+0000","last_unstale":"2024-09-14T11:21:27.049726+0000","last_undegraded":"2024-09-14T11:21:27.049726+0000","last_fullsized":"2024-09-14T11:21:27.049726+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:06.317656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2555,"num_read_kb":2382,"num_write":592,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10817,"num_read_kb":8523,"num_write":3117,"num_write_kb":1010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1096,"ondisk_log_size":1096,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":14831,"num_objects":87,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":15133,"num_read_kb":14796,"num_write":17057,"num_write_kb":4975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":29662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1479,"ondisk_log_size":1479,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":767,"ondisk_log_size":767,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1769083,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":16792,"num_read_kb":34092,"num_write":14203,"num_write_kb":11560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2256896,"data_stored":1826876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2086,"ondisk_log_size":2086,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2399,"num_read_kb":2860,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":219533,"num_read_kb":201172,"num_write":55836,"num_write_kb":19050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":143,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4159,"ondisk_log_size":4159,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":419112220,"num_objects":3126,"num_object_clones":0,"num_object_copies":6252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3126,"num_whiteouts":0,"num_read":41304,"num_read_kb":2138030,"num_write":70355,"num_write_kb":2157996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":893042688,"data_stored":869394264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3978,"ondisk_log_size":3978,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":41542397,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":122,"num_read_kb":175817,"num_write":141,"num_write_kb":116354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73658368,"data_stored":73650820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81,"ondisk_log_size":81,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":56683470,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":119,"num_read_kb":174730,"num_write":141,"num_write_kb":116354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110227456,"data_stored":110224422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81,"ondisk_log_size":81,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509894,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":431088,"kb_used_data":237472,"kb_used_omap":1,"kb_used_meta":193598,"kb_avail":93940752,"statfs":{"total":96636764160,"available":96195330048,"internally_reserved":0,"allocated":243171328,"data_stored":236611721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":198244807},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509892,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":420236,"kb_used_data":150268,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":93951604,"statfs":{"total":96636764160,"available":96206442496,"internally_reserved":0,"allocated":153874432,"data_stored":148836196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":276429253},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509891,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284676,"kb_used_data":199412,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94087164,"statfs":{"total":96636764160,"available":96345255936,"internally_reserved":0,"allocated":204197888,"data_stored":197333461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542597,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":319504,"kb_used_data":99536,"kb_used_omap":1,"kb_used_meta":219902,"kb_avail":94052336,"statfs":{"total":96636764160,"available":96309592064,"internally_reserved":0,"allocated":101924864,"data_stored":98410709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":225180106},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542597,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":222068,"kb_used_data":128484,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94149772,"statfs":{"total":96636764160,"available":96409366528,"internally_reserved":0,"allocated":131567616,"data_stored":127010417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":95812038},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542599,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":413032,"kb_used_data":157016,"kb_used_omap":1,"kb_used_meta":255998,"kb_avail":93958808,"statfs":{"total":96636764160,"available":96213819392,"internally_reserved":0,"allocated":160784384,"data_stored":154528840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":262142405},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542598,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":262796,"kb_used_data":83120,"kb_used_omap":1,"kb_used_meta":179646,"kb_avail":94109044,"statfs":{"total":96636764160,"available":96367661056,"internally_reserved":0,"allocated":85114880,"data_stored":82138617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":183957957},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575301,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":362112,"kb_used_data":250416,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94009728,"statfs":{"total":96636764160,"available":96265961472,"internally_reserved":0,"allocated":256425984,"data_stored":250268894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":164352000,"data_stored":159069268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":128159744,"data_stored":124666590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":220647424,"data_stored":216021462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":208883712,"data_stored":203865931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45891584,"data_stored":44693796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25268224,"data_stored":23772093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":51146752,"data_stored":49646570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":48693248,"data_stored":47658554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":569344,"data_stored":474626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":472745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":127276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":263709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":46022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":188416,"data_stored":140872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":176128,"data_stored":133606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":212992,"data_stored":168020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":5195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9498624,"data_stored":9497550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":17887232,"data_stored":17886158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":26214400,"data_stored":26214400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3145728,"data_stored":3145728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6295552,"data_stored":6294666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":26218496,"data_stored":26217604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3149824,"data_stored":3148938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5832704,"data_stored":5830447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":13631488,"data_stored":13631488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3792896,"data_stored":3790457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":9498624,"data_stored":9497550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:22:52.262 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-14T11:22:52.262 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:22:52.601 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:22:52.612 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-09-14T11:22:52.614 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":1376,"stamp":"2024-09-14T11:22:51.756586+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":519714181,"num_objects":3605,"num_object_clones":0,"num_object_copies":7210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3605,"num_whiteouts":0,"num_read":306297,"num_read_kb":2750087,"num_write":160993,"num_write_kb":2428955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":190,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13820,"ondisk_log_size":13820,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2715512,"kb_used_data":1305724,"kb_used_omap":12,"kb_used_meta":1409587,"kb_avail":752259208,"statfs":{"total":773094113280,"available":770313428992,"internally_reserved":0,"allocated":1337061376,"data_stored":1295138855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1443417648},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-173140695,"num_objects":-1245,"num_object_clones":0,"num_object_copies":-2490,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1245,"num_whiteouts":0,"num_read":1843,"num_read_kb":2084,"num_write":1435,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004691"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:12.205144+0000","last_change":"2024-09-14T11:11:42.593208+0000","last_active":"2024-09-14T11:19:12.205144+0000","last_peered":"2024-09-14T11:19:12.205144+0000","last_clean":"2024-09-14T11:19:12.205144+0000","last_became_active":"2024-09-14T11:11:42.592933+0000","last_became_peered":"2024-09-14T11:11:42.592933+0000","last_unstale":"2024-09-14T11:19:12.205144+0000","last_undegraded":"2024-09-14T11:19:12.205144+0000","last_fullsized":"2024-09-14T11:19:12.205144+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:50.427016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"260'1","reported_seq":30,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:57.106396+0000","last_change":"2024-09-14T11:01:23.882191+0000","last_active":"2024-09-14T11:18:57.106396+0000","last_peered":"2024-09-14T11:18:57.106396+0000","last_clean":"2024-09-14T11:18:57.106396+0000","last_became_active":"2024-09-14T11:01:23.881902+0000","last_became_peered":"2024-09-14T11:01:23.881902+0000","last_unstale":"2024-09-14T11:18:57.106396+0000","last_undegraded":"2024-09-14T11:18:57.106396+0000","last_fullsized":"2024-09-14T11:18:57.106396+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:46.612242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"260'7","reported_seq":50,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:50.986936+0000","last_change":"2024-09-14T11:01:20.867414+0000","last_active":"2024-09-14T11:18:50.986936+0000","last_peered":"2024-09-14T11:18:50.986936+0000","last_clean":"2024-09-14T11:18:50.986936+0000","last_became_active":"2024-09-14T11:01:20.867142+0000","last_became_peered":"2024-09-14T11:01:20.867142+0000","last_unstale":"2024-09-14T11:18:50.986936+0000","last_undegraded":"2024-09-14T11:18:50.986936+0000","last_fullsized":"2024-09-14T11:18:50.986936+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:51.245462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":17,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"260'30","reported_seq":123,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:41.126104+0000","last_change":"2024-09-14T10:59:48.417565+0000","last_active":"2024-09-14T11:20:41.126104+0000","last_peered":"2024-09-14T11:20:41.126104+0000","last_clean":"2024-09-14T11:20:41.126104+0000","last_became_active":"2024-09-14T10:59:48.416537+0000","last_became_peered":"2024-09-14T10:59:48.416537+0000","last_unstale":"2024-09-14T11:20:41.126104+0000","last_undegraded":"2024-09-14T11:20:41.126104+0000","last_fullsized":"2024-09-14T11:20:41.126104+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:15.136259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":249,"num_read_kb":173,"num_write":73,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:15.984097+0000","last_change":"2024-09-14T11:11:42.588136+0000","last_active":"2024-09-14T11:19:15.984097+0000","last_peered":"2024-09-14T11:19:15.984097+0000","last_clean":"2024-09-14T11:19:15.984097+0000","last_became_active":"2024-09-14T11:11:42.587818+0000","last_became_peered":"2024-09-14T11:11:42.587818+0000","last_unstale":"2024-09-14T11:19:15.984097+0000","last_undegraded":"2024-09-14T11:19:15.984097+0000","last_fullsized":"2024-09-14T11:19:15.984097+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:37.528920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"260'1","reported_seq":29,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:54.982834+0000","last_change":"2024-09-14T11:01:23.881376+0000","last_active":"2024-09-14T11:18:54.982834+0000","last_peered":"2024-09-14T11:18:54.982834+0000","last_clean":"2024-09-14T11:18:54.982834+0000","last_became_active":"2024-09-14T11:01:23.881074+0000","last_became_peered":"2024-09-14T11:01:23.881074+0000","last_unstale":"2024-09-14T11:18:54.982834+0000","last_undegraded":"2024-09-14T11:18:54.982834+0000","last_fullsized":"2024-09-14T11:18:54.982834+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:53.183326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":571,"num_write":1,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"260'8","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:21.253973+0000","last_change":"2024-09-14T11:01:20.868669+0000","last_active":"2024-09-14T11:21:21.253973+0000","last_peered":"2024-09-14T11:21:21.253973+0000","last_clean":"2024-09-14T11:21:21.253973+0000","last_became_active":"2024-09-14T11:01:20.868373+0000","last_became_peered":"2024-09-14T11:01:20.868373+0000","last_unstale":"2024-09-14T11:21:21.253973+0000","last_undegraded":"2024-09-14T11:21:21.253973+0000","last_fullsized":"2024-09-14T11:21:21.253973+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:33:49.244253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10811,"num_write":13,"num_write_kb":10811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"260'56","reported_seq":195,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:56.120455+0000","last_change":"2024-09-14T10:59:48.416508+0000","last_active":"2024-09-14T11:19:56.120455+0000","last_peered":"2024-09-14T11:19:56.120455+0000","last_clean":"2024-09-14T11:19:56.120455+0000","last_became_active":"2024-09-14T10:59:48.416222+0000","last_became_peered":"2024-09-14T10:59:48.416222+0000","last_unstale":"2024-09-14T11:19:56.120455+0000","last_undegraded":"2024-09-14T11:19:56.120455+0000","last_fullsized":"2024-09-14T11:19:56.120455+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:30.061341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":447,"num_read_kb":304,"num_write":135,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:57.106315+0000","last_change":"2024-09-14T11:11:42.593589+0000","last_active":"2024-09-14T11:18:57.106315+0000","last_peered":"2024-09-14T11:18:57.106315+0000","last_clean":"2024-09-14T11:18:57.106315+0000","last_became_active":"2024-09-14T11:11:42.593314+0000","last_became_peered":"2024-09-14T11:11:42.593314+0000","last_unstale":"2024-09-14T11:18:57.106315+0000","last_undegraded":"2024-09-14T11:18:57.106315+0000","last_fullsized":"2024-09-14T11:18:57.106315+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:49.061960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"260'3","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:16.262309+0000","last_change":"2024-09-14T11:01:23.893105+0000","last_active":"2024-09-14T11:22:16.262309+0000","last_peered":"2024-09-14T11:22:16.262309+0000","last_clean":"2024-09-14T11:22:16.262309+0000","last_became_active":"2024-09-14T11:01:23.892846+0000","last_became_peered":"2024-09-14T11:01:23.892846+0000","last_unstale":"2024-09-14T11:22:16.262309+0000","last_undegraded":"2024-09-14T11:22:16.262309+0000","last_fullsized":"2024-09-14T11:22:16.262309+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:50.339780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"260'1","reported_seq":37,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:25.992278+0000","last_change":"2024-09-14T11:01:20.864944+0000","last_active":"2024-09-14T11:19:25.992278+0000","last_peered":"2024-09-14T11:19:25.992278+0000","last_clean":"2024-09-14T11:19:25.992278+0000","last_became_active":"2024-09-14T11:01:20.864672+0000","last_became_peered":"2024-09-14T11:01:20.864672+0000","last_unstale":"2024-09-14T11:19:25.992278+0000","last_undegraded":"2024-09-14T11:19:25.992278+0000","last_fullsized":"2024-09-14T11:19:25.992278+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:06.369402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"260'48","reported_seq":168,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:50.988603+0000","last_change":"2024-09-14T10:59:48.419842+0000","last_active":"2024-09-14T11:19:50.988603+0000","last_peered":"2024-09-14T11:19:50.988603+0000","last_clean":"2024-09-14T11:19:50.988603+0000","last_became_active":"2024-09-14T10:59:48.419525+0000","last_became_peered":"2024-09-14T10:59:48.419525+0000","last_unstale":"2024-09-14T11:19:50.988603+0000","last_undegraded":"2024-09-14T11:19:50.988603+0000","last_fullsized":"2024-09-14T11:19:50.988603+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:04.024597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":364,"num_read_kb":247,"num_write":125,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:01.233674+0000","last_change":"2024-09-14T11:11:42.587584+0000","last_active":"2024-09-14T11:19:01.233674+0000","last_peered":"2024-09-14T11:19:01.233674+0000","last_clean":"2024-09-14T11:19:01.233674+0000","last_became_active":"2024-09-14T11:11:42.587218+0000","last_became_peered":"2024-09-14T11:11:42.587218+0000","last_unstale":"2024-09-14T11:19:01.233674+0000","last_undegraded":"2024-09-14T11:19:01.233674+0000","last_fullsized":"2024-09-14T11:19:01.233674+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:55.734324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"260'1","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:26.237624+0000","last_change":"2024-09-14T11:01:23.887367+0000","last_active":"2024-09-14T11:19:26.237624+0000","last_peered":"2024-09-14T11:19:26.237624+0000","last_clean":"2024-09-14T11:19:26.237624+0000","last_became_active":"2024-09-14T11:01:23.886771+0000","last_became_peered":"2024-09-14T11:01:23.886771+0000","last_unstale":"2024-09-14T11:19:26.237624+0000","last_undegraded":"2024-09-14T11:19:26.237624+0000","last_fullsized":"2024-09-14T11:19:26.237624+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:15.920702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60366,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":118,"num_write":1,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"257'5","reported_seq":50,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:07.117403+0000","last_change":"2024-09-14T11:01:20.862128+0000","last_active":"2024-09-14T11:20:07.117403+0000","last_peered":"2024-09-14T11:20:07.117403+0000","last_clean":"2024-09-14T11:20:07.117403+0000","last_became_active":"2024-09-14T11:01:20.861799+0000","last_became_peered":"2024-09-14T11:01:20.861799+0000","last_unstale":"2024-09-14T11:20:07.117403+0000","last_undegraded":"2024-09-14T11:20:07.117403+0000","last_fullsized":"2024-09-14T11:20:07.117403+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:16.963059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"260'15","reported_seq":77,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:50.988580+0000","last_change":"2024-09-14T10:59:48.411700+0000","last_active":"2024-09-14T11:19:50.988580+0000","last_peered":"2024-09-14T11:19:50.988580+0000","last_clean":"2024-09-14T11:19:50.988580+0000","last_became_active":"2024-09-14T10:59:48.411423+0000","last_became_peered":"2024-09-14T10:59:48.411423+0000","last_unstale":"2024-09-14T11:19:50.988580+0000","last_undegraded":"2024-09-14T11:19:50.988580+0000","last_fullsized":"2024-09-14T11:19:50.988580+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:56.473790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":68,"num_write":41,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:50.995962+0000","last_change":"2024-09-14T11:11:42.584008+0000","last_active":"2024-09-14T11:19:50.995962+0000","last_peered":"2024-09-14T11:19:50.995962+0000","last_clean":"2024-09-14T11:19:50.995962+0000","last_became_active":"2024-09-14T11:11:42.583717+0000","last_became_peered":"2024-09-14T11:11:42.583717+0000","last_unstale":"2024-09-14T11:19:50.995962+0000","last_undegraded":"2024-09-14T11:19:50.995962+0000","last_fullsized":"2024-09-14T11:19:50.995962+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:22:54.043934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"257'3","reported_seq":33,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:22.197565+0000","last_change":"2024-09-14T11:01:23.894300+0000","last_active":"2024-09-14T11:18:22.197565+0000","last_peered":"2024-09-14T11:18:22.197565+0000","last_clean":"2024-09-14T11:18:22.197565+0000","last_became_active":"2024-09-14T11:01:23.894107+0000","last_became_peered":"2024-09-14T11:01:23.894107+0000","last_unstale":"2024-09-14T11:18:22.197565+0000","last_undegraded":"2024-09-14T11:18:22.197565+0000","last_fullsized":"2024-09-14T11:18:22.197565+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:41:19.577357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"260'6","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:41.248008+0000","last_change":"2024-09-14T11:01:20.868842+0000","last_active":"2024-09-14T11:20:41.248008+0000","last_peered":"2024-09-14T11:20:41.248008+0000","last_clean":"2024-09-14T11:20:41.248008+0000","last_became_active":"2024-09-14T11:01:20.867768+0000","last_became_peered":"2024-09-14T11:01:20.867768+0000","last_unstale":"2024-09-14T11:20:41.248008+0000","last_undegraded":"2024-09-14T11:20:41.248008+0000","last_fullsized":"2024-09-14T11:20:41.248008+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:10.338737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"260'40","reported_seq":146,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:50.988519+0000","last_change":"2024-09-14T10:59:48.413952+0000","last_active":"2024-09-14T11:19:50.988519+0000","last_peered":"2024-09-14T11:19:50.988519+0000","last_clean":"2024-09-14T11:19:50.988519+0000","last_became_active":"2024-09-14T10:59:48.413296+0000","last_became_peered":"2024-09-14T10:59:48.413296+0000","last_unstale":"2024-09-14T11:19:50.988519+0000","last_undegraded":"2024-09-14T11:19:50.988519+0000","last_fullsized":"2024-09-14T11:19:50.988519+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:50.801079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":304,"num_read_kb":193,"num_write":101,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:06.121565+0000","last_change":"2024-09-14T11:11:42.582601+0000","last_active":"2024-09-14T11:20:06.121565+0000","last_peered":"2024-09-14T11:20:06.121565+0000","last_clean":"2024-09-14T11:20:06.121565+0000","last_became_active":"2024-09-14T11:11:42.582310+0000","last_became_peered":"2024-09-14T11:11:42.582310+0000","last_unstale":"2024-09-14T11:20:06.121565+0000","last_undegraded":"2024-09-14T11:20:06.121565+0000","last_fullsized":"2024-09-14T11:20:06.121565+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:47:53.329342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"260'7","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:22.101583+0000","last_change":"2024-09-14T11:01:23.888252+0000","last_active":"2024-09-14T11:18:22.101583+0000","last_peered":"2024-09-14T11:18:22.101583+0000","last_clean":"2024-09-14T11:18:22.101583+0000","last_became_active":"2024-09-14T11:01:23.888017+0000","last_became_peered":"2024-09-14T11:01:23.888017+0000","last_unstale":"2024-09-14T11:18:22.101583+0000","last_undegraded":"2024-09-14T11:18:22.101583+0000","last_fullsized":"2024-09-14T11:18:22.101583+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:57.684875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":11264,"num_write":17,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"257'2","reported_seq":37,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:22.101658+0000","last_change":"2024-09-14T11:01:20.863609+0000","last_active":"2024-09-14T11:18:22.101658+0000","last_peered":"2024-09-14T11:18:22.101658+0000","last_clean":"2024-09-14T11:18:22.101658+0000","last_became_active":"2024-09-14T11:01:20.863258+0000","last_became_peered":"2024-09-14T11:01:20.863258+0000","last_unstale":"2024-09-14T11:18:22.101658+0000","last_undegraded":"2024-09-14T11:18:22.101658+0000","last_fullsized":"2024-09-14T11:18:22.101658+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:55.353304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"260'62","reported_seq":215,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:18.893367+0000","last_change":"2024-09-14T10:59:48.420297+0000","last_active":"2024-09-14T11:20:18.893367+0000","last_peered":"2024-09-14T11:20:18.893367+0000","last_clean":"2024-09-14T11:20:18.893367+0000","last_became_active":"2024-09-14T10:59:48.419994+0000","last_became_peered":"2024-09-14T10:59:48.419994+0000","last_unstale":"2024-09-14T11:20:18.893367+0000","last_undegraded":"2024-09-14T11:20:18.893367+0000","last_fullsized":"2024-09-14T11:20:18.893367+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:48.789488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":520,"num_read_kb":329,"num_write":161,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"260'1","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:14.986121+0000","last_change":"2024-09-14T11:11:42.588572+0000","last_active":"2024-09-14T11:19:14.986121+0000","last_peered":"2024-09-14T11:19:14.986121+0000","last_clean":"2024-09-14T11:19:14.986121+0000","last_became_active":"2024-09-14T11:11:42.588308+0000","last_became_peered":"2024-09-14T11:11:42.588308+0000","last_unstale":"2024-09-14T11:19:14.986121+0000","last_undegraded":"2024-09-14T11:19:14.986121+0000","last_fullsized":"2024-09-14T11:19:14.986121+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:38:16.020344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:54.982805+0000","last_change":"2024-09-14T11:01:23.884550+0000","last_active":"2024-09-14T11:18:54.982805+0000","last_peered":"2024-09-14T11:18:54.982805+0000","last_clean":"2024-09-14T11:18:54.982805+0000","last_became_active":"2024-09-14T11:01:23.884138+0000","last_became_peered":"2024-09-14T11:01:23.884138+0000","last_unstale":"2024-09-14T11:18:54.982805+0000","last_undegraded":"2024-09-14T11:18:54.982805+0000","last_fullsized":"2024-09-14T11:18:54.982805+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:10.655429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":33,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:52.202212+0000","last_change":"2024-09-14T11:01:20.855022+0000","last_active":"2024-09-14T11:18:52.202212+0000","last_peered":"2024-09-14T11:18:52.202212+0000","last_clean":"2024-09-14T11:18:52.202212+0000","last_became_active":"2024-09-14T11:01:20.854737+0000","last_became_peered":"2024-09-14T11:01:20.854737+0000","last_unstale":"2024-09-14T11:18:52.202212+0000","last_undegraded":"2024-09-14T11:18:52.202212+0000","last_fullsized":"2024-09-14T11:18:52.202212+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:43.045693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"260'45","reported_seq":163,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:20.991333+0000","last_change":"2024-09-14T10:59:48.420289+0000","last_active":"2024-09-14T11:19:20.991333+0000","last_peered":"2024-09-14T11:19:20.991333+0000","last_clean":"2024-09-14T11:19:20.991333+0000","last_became_active":"2024-09-14T10:59:48.419091+0000","last_became_peered":"2024-09-14T10:59:48.419091+0000","last_unstale":"2024-09-14T11:19:20.991333+0000","last_undegraded":"2024-09-14T11:19:20.991333+0000","last_fullsized":"2024-09-14T11:19:20.991333+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:35.387602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":368,"num_read_kb":243,"num_write":109,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:12.205201+0000","last_change":"2024-09-14T11:11:42.583176+0000","last_active":"2024-09-14T11:19:12.205201+0000","last_peered":"2024-09-14T11:19:12.205201+0000","last_clean":"2024-09-14T11:19:12.205201+0000","last_became_active":"2024-09-14T11:11:42.582899+0000","last_became_peered":"2024-09-14T11:11:42.582899+0000","last_unstale":"2024-09-14T11:19:12.205201+0000","last_undegraded":"2024-09-14T11:19:12.205201+0000","last_fullsized":"2024-09-14T11:19:12.205201+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:00.902463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:55.987589+0000","last_change":"2024-09-14T11:01:23.895643+0000","last_active":"2024-09-14T11:18:55.987589+0000","last_peered":"2024-09-14T11:18:55.987589+0000","last_clean":"2024-09-14T11:18:55.987589+0000","last_became_active":"2024-09-14T11:01:23.894587+0000","last_became_peered":"2024-09-14T11:01:23.894587+0000","last_unstale":"2024-09-14T11:18:55.987589+0000","last_undegraded":"2024-09-14T11:18:55.987589+0000","last_fullsized":"2024-09-14T11:18:55.987589+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:29.534046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"260'2","reported_seq":37,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:50.980652+0000","last_change":"2024-09-14T11:01:20.869542+0000","last_active":"2024-09-14T11:18:50.980652+0000","last_peered":"2024-09-14T11:18:50.980652+0000","last_clean":"2024-09-14T11:18:50.980652+0000","last_became_active":"2024-09-14T11:01:20.869244+0000","last_became_peered":"2024-09-14T11:01:20.869244+0000","last_unstale":"2024-09-14T11:18:50.980652+0000","last_undegraded":"2024-09-14T11:18:50.980652+0000","last_fullsized":"2024-09-14T11:18:50.980652+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:58.638874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"260'35","reported_seq":137,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:58.204964+0000","last_change":"2024-09-14T10:59:48.414261+0000","last_active":"2024-09-14T11:20:58.204964+0000","last_peered":"2024-09-14T11:20:58.204964+0000","last_clean":"2024-09-14T11:20:58.204964+0000","last_became_active":"2024-09-14T10:59:48.414023+0000","last_became_peered":"2024-09-14T10:59:48.414023+0000","last_unstale":"2024-09-14T11:20:58.204964+0000","last_undegraded":"2024-09-14T11:20:58.204964+0000","last_fullsized":"2024-09-14T11:20:58.204964+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:32.125339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":284,"num_read_kb":189,"num_write":86,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:46.231489+0000","last_change":"2024-09-14T11:11:42.592957+0000","last_active":"2024-09-14T11:18:46.231489+0000","last_peered":"2024-09-14T11:18:46.231489+0000","last_clean":"2024-09-14T11:18:46.231489+0000","last_became_active":"2024-09-14T11:11:42.592439+0000","last_became_peered":"2024-09-14T11:11:42.592439+0000","last_unstale":"2024-09-14T11:18:46.231489+0000","last_undegraded":"2024-09-14T11:18:46.231489+0000","last_fullsized":"2024-09-14T11:18:46.231489+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:56:15.581964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"257'3","reported_seq":33,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:20.982723+0000","last_change":"2024-09-14T11:01:23.892350+0000","last_active":"2024-09-14T11:18:20.982723+0000","last_peered":"2024-09-14T11:18:20.982723+0000","last_clean":"2024-09-14T11:18:20.982723+0000","last_became_active":"2024-09-14T11:01:23.891631+0000","last_became_peered":"2024-09-14T11:01:23.891631+0000","last_unstale":"2024-09-14T11:18:20.982723+0000","last_undegraded":"2024-09-14T11:18:20.982723+0000","last_fullsized":"2024-09-14T11:18:20.982723+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:58:22.810241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"260'9","reported_seq":53,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:07.117695+0000","last_change":"2024-09-14T11:01:20.861317+0000","last_active":"2024-09-14T11:20:07.117695+0000","last_peered":"2024-09-14T11:20:07.117695+0000","last_clean":"2024-09-14T11:20:07.117695+0000","last_became_active":"2024-09-14T11:01:20.861043+0000","last_became_peered":"2024-09-14T11:01:20.861043+0000","last_unstale":"2024-09-14T11:20:07.117695+0000","last_undegraded":"2024-09-14T11:20:07.117695+0000","last_fullsized":"2024-09-14T11:20:07.117695+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:42.808761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":17410,"num_write":19,"num_write_kb":12290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"260'250","reported_seq":795,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:11.113999+0000","last_change":"2024-09-14T10:59:48.417407+0000","last_active":"2024-09-14T11:19:11.113999+0000","last_peered":"2024-09-14T11:19:11.113999+0000","last_clean":"2024-09-14T11:19:11.113999+0000","last_became_active":"2024-09-14T10:59:48.416342+0000","last_became_peered":"2024-09-14T10:59:48.416342+0000","last_unstale":"2024-09-14T11:19:11.113999+0000","last_undegraded":"2024-09-14T11:19:11.113999+0000","last_fullsized":"2024-09-14T11:19:11.113999+0000","mapping_epoch":249,"log_start":"257'200","ondisk_log_start":"257'200","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:56:03.687626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2428,"num_read_kb":2819,"num_write":491,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"260'1","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:45.979906+0000","last_change":"2024-09-14T11:11:42.588570+0000","last_active":"2024-09-14T11:18:45.979906+0000","last_peered":"2024-09-14T11:18:45.979906+0000","last_clean":"2024-09-14T11:18:45.979906+0000","last_became_active":"2024-09-14T11:11:42.587835+0000","last_became_peered":"2024-09-14T11:11:42.587835+0000","last_unstale":"2024-09-14T11:18:45.979906+0000","last_undegraded":"2024-09-14T11:18:45.979906+0000","last_fullsized":"2024-09-14T11:18:45.979906+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:05.008377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"260'2","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:06.243716+0000","last_change":"2024-09-14T11:01:23.895555+0000","last_active":"2024-09-14T11:20:06.243716+0000","last_peered":"2024-09-14T11:20:06.243716+0000","last_clean":"2024-09-14T11:20:06.243716+0000","last_became_active":"2024-09-14T11:01:23.892735+0000","last_became_peered":"2024-09-14T11:01:23.892735+0000","last_unstale":"2024-09-14T11:20:06.243716+0000","last_undegraded":"2024-09-14T11:20:06.243716+0000","last_fullsized":"2024-09-14T11:20:06.243716+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:20.552471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"260'3","reported_seq":39,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:17.197007+0000","last_change":"2024-09-14T11:01:20.860826+0000","last_active":"2024-09-14T11:18:17.197007+0000","last_peered":"2024-09-14T11:18:17.197007+0000","last_clean":"2024-09-14T11:18:17.197007+0000","last_became_active":"2024-09-14T11:01:20.860541+0000","last_became_peered":"2024-09-14T11:01:20.860541+0000","last_unstale":"2024-09-14T11:18:17.197007+0000","last_undegraded":"2024-09-14T11:18:17.197007+0000","last_fullsized":"2024-09-14T11:18:17.197007+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:08.358758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60366,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":61,"num_write":3,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"260'12","reported_seq":76,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:11.113972+0000","last_change":"2024-09-14T10:59:48.417263+0000","last_active":"2024-09-14T11:19:11.113972+0000","last_peered":"2024-09-14T11:19:11.113972+0000","last_clean":"2024-09-14T11:19:11.113972+0000","last_became_active":"2024-09-14T10:59:48.417001+0000","last_became_peered":"2024-09-14T10:59:48.417001+0000","last_unstale":"2024-09-14T11:19:11.113972+0000","last_undegraded":"2024-09-14T11:19:11.113972+0000","last_fullsized":"2024-09-14T11:19:11.113972+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:24.272836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":70,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:44.981269+0000","last_change":"2024-09-14T11:11:42.594143+0000","last_active":"2024-09-14T11:18:44.981269+0000","last_peered":"2024-09-14T11:18:44.981269+0000","last_clean":"2024-09-14T11:18:44.981269+0000","last_became_active":"2024-09-14T11:11:42.593873+0000","last_became_peered":"2024-09-14T11:11:42.593873+0000","last_unstale":"2024-09-14T11:18:44.981269+0000","last_undegraded":"2024-09-14T11:18:44.981269+0000","last_fullsized":"2024-09-14T11:18:44.981269+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:38.408015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:20.982781+0000","last_change":"2024-09-14T11:01:23.897460+0000","last_active":"2024-09-14T11:18:20.982781+0000","last_peered":"2024-09-14T11:18:20.982781+0000","last_clean":"2024-09-14T11:18:20.982781+0000","last_became_active":"2024-09-14T11:01:23.897154+0000","last_became_peered":"2024-09-14T11:01:23.897154+0000","last_unstale":"2024-09-14T11:18:20.982781+0000","last_undegraded":"2024-09-14T11:18:20.982781+0000","last_fullsized":"2024-09-14T11:18:20.982781+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:57.444749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"260'2","reported_seq":36,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:41.002355+0000","last_change":"2024-09-14T11:01:20.868430+0000","last_active":"2024-09-14T11:20:41.002355+0000","last_peered":"2024-09-14T11:20:41.002355+0000","last_clean":"2024-09-14T11:20:41.002355+0000","last_became_active":"2024-09-14T11:01:20.868135+0000","last_became_peered":"2024-09-14T11:01:20.868135+0000","last_unstale":"2024-09-14T11:20:41.002355+0000","last_undegraded":"2024-09-14T11:20:41.002355+0000","last_fullsized":"2024-09-14T11:20:41.002355+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:11:52.977202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"260'27","reported_seq":113,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:18.260492+0000","last_change":"2024-09-14T10:59:48.415592+0000","last_active":"2024-09-14T11:20:18.260492+0000","last_peered":"2024-09-14T11:20:18.260492+0000","last_clean":"2024-09-14T11:20:18.260492+0000","last_became_active":"2024-09-14T10:59:48.415324+0000","last_became_peered":"2024-09-14T10:59:48.415324+0000","last_unstale":"2024-09-14T11:20:18.260492+0000","last_undegraded":"2024-09-14T11:20:18.260492+0000","last_fullsized":"2024-09-14T11:20:18.260492+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:36:02.358205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":136,"num_write":70,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:42.200860+0000","last_change":"2024-09-14T11:11:42.592101+0000","last_active":"2024-09-14T11:18:42.200860+0000","last_peered":"2024-09-14T11:18:42.200860+0000","last_clean":"2024-09-14T11:18:42.200860+0000","last_became_active":"2024-09-14T11:11:42.591815+0000","last_became_peered":"2024-09-14T11:11:42.591815+0000","last_unstale":"2024-09-14T11:18:42.200860+0000","last_undegraded":"2024-09-14T11:18:42.200860+0000","last_fullsized":"2024-09-14T11:18:42.200860+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:44:10.362312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"260'2","reported_seq":33,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:22.197640+0000","last_change":"2024-09-14T11:01:23.884051+0000","last_active":"2024-09-14T11:18:22.197640+0000","last_peered":"2024-09-14T11:18:22.197640+0000","last_clean":"2024-09-14T11:18:22.197640+0000","last_became_active":"2024-09-14T11:01:23.883763+0000","last_became_peered":"2024-09-14T11:01:23.883763+0000","last_unstale":"2024-09-14T11:18:22.197640+0000","last_undegraded":"2024-09-14T11:18:22.197640+0000","last_fullsized":"2024-09-14T11:18:22.197640+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:48:45.773610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"260'3","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:16.227393+0000","last_change":"2024-09-14T11:01:20.867156+0000","last_active":"2024-09-14T11:18:16.227393+0000","last_peered":"2024-09-14T11:18:16.227393+0000","last_clean":"2024-09-14T11:18:16.227393+0000","last_became_active":"2024-09-14T11:01:20.866642+0000","last_became_peered":"2024-09-14T11:01:20.866642+0000","last_unstale":"2024-09-14T11:18:16.227393+0000","last_undegraded":"2024-09-14T11:18:16.227393+0000","last_fullsized":"2024-09-14T11:18:16.227393+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:38.426384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":13312,"num_write":8,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"260'32","reported_seq":127,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:37.104014+0000","last_change":"2024-09-14T10:59:48.418606+0000","last_active":"2024-09-14T11:18:37.104014+0000","last_peered":"2024-09-14T11:18:37.104014+0000","last_clean":"2024-09-14T11:18:37.104014+0000","last_became_active":"2024-09-14T10:59:48.418305+0000","last_became_peered":"2024-09-14T10:59:48.418305+0000","last_unstale":"2024-09-14T11:18:37.104014+0000","last_undegraded":"2024-09-14T11:18:37.104014+0000","last_fullsized":"2024-09-14T11:18:37.104014+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:31:32.726408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":251,"num_read_kb":158,"num_write":84,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:01.233757+0000","last_change":"2024-09-14T11:11:42.588989+0000","last_active":"2024-09-14T11:19:01.233757+0000","last_peered":"2024-09-14T11:19:01.233757+0000","last_clean":"2024-09-14T11:19:01.233757+0000","last_became_active":"2024-09-14T11:11:42.588573+0000","last_became_peered":"2024-09-14T11:11:42.588573+0000","last_unstale":"2024-09-14T11:19:01.233757+0000","last_undegraded":"2024-09-14T11:19:01.233757+0000","last_fullsized":"2024-09-14T11:19:01.233757+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:44.929396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:06.243683+0000","last_change":"2024-09-14T11:01:23.895357+0000","last_active":"2024-09-14T11:20:06.243683+0000","last_peered":"2024-09-14T11:20:06.243683+0000","last_clean":"2024-09-14T11:20:06.243683+0000","last_became_active":"2024-09-14T11:01:23.894751+0000","last_became_peered":"2024-09-14T11:01:23.894751+0000","last_unstale":"2024-09-14T11:20:06.243683+0000","last_undegraded":"2024-09-14T11:20:06.243683+0000","last_fullsized":"2024-09-14T11:20:06.243683+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:22:05.395992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:02.116671+0000","last_change":"2024-09-14T11:01:20.867415+0000","last_active":"2024-09-14T11:20:02.116671+0000","last_peered":"2024-09-14T11:20:02.116671+0000","last_clean":"2024-09-14T11:20:02.116671+0000","last_became_active":"2024-09-14T11:01:20.866975+0000","last_became_peered":"2024-09-14T11:01:20.866975+0000","last_unstale":"2024-09-14T11:20:02.116671+0000","last_undegraded":"2024-09-14T11:20:02.116671+0000","last_fullsized":"2024-09-14T11:20:02.116671+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:47.822855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"260'17","reported_seq":82,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:32.103148+0000","last_change":"2024-09-14T10:59:48.421015+0000","last_active":"2024-09-14T11:18:32.103148+0000","last_peered":"2024-09-14T11:18:32.103148+0000","last_clean":"2024-09-14T11:18:32.103148+0000","last_became_active":"2024-09-14T10:59:48.420711+0000","last_became_peered":"2024-09-14T10:59:48.420711+0000","last_unstale":"2024-09-14T11:18:32.103148+0000","last_undegraded":"2024-09-14T11:18:32.103148+0000","last_fullsized":"2024-09-14T11:18:32.103148+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:14:06.864641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":78,"num_write":43,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:00.982102+0000","last_change":"2024-09-14T11:11:42.585332+0000","last_active":"2024-09-14T11:19:00.982102+0000","last_peered":"2024-09-14T11:19:00.982102+0000","last_clean":"2024-09-14T11:19:00.982102+0000","last_became_active":"2024-09-14T11:11:42.583965+0000","last_became_peered":"2024-09-14T11:11:42.583965+0000","last_unstale":"2024-09-14T11:19:00.982102+0000","last_undegraded":"2024-09-14T11:19:00.982102+0000","last_fullsized":"2024-09-14T11:19:00.982102+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:45:52.531506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"257'5","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:06.243650+0000","last_change":"2024-09-14T11:01:23.893658+0000","last_active":"2024-09-14T11:20:06.243650+0000","last_peered":"2024-09-14T11:20:06.243650+0000","last_clean":"2024-09-14T11:20:06.243650+0000","last_became_active":"2024-09-14T11:01:23.893365+0000","last_became_peered":"2024-09-14T11:01:23.893365+0000","last_unstale":"2024-09-14T11:20:06.243650+0000","last_undegraded":"2024-09-14T11:20:06.243650+0000","last_fullsized":"2024-09-14T11:20:06.243650+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:10:44.395112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"260'3","reported_seq":37,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:21.262930+0000","last_change":"2024-09-14T11:01:20.869472+0000","last_active":"2024-09-14T11:22:21.262930+0000","last_peered":"2024-09-14T11:22:21.262930+0000","last_clean":"2024-09-14T11:22:21.262930+0000","last_became_active":"2024-09-14T11:01:20.869209+0000","last_became_peered":"2024-09-14T11:01:20.869209+0000","last_unstale":"2024-09-14T11:22:21.262930+0000","last_undegraded":"2024-09-14T11:22:21.262930+0000","last_fullsized":"2024-09-14T11:22:21.262930+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:54.924564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"260'35","reported_seq":136,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:00.389953+0000","last_change":"2024-09-14T10:59:48.416424+0000","last_active":"2024-09-14T11:21:00.389953+0000","last_peered":"2024-09-14T11:21:00.389953+0000","last_clean":"2024-09-14T11:21:00.389953+0000","last_became_active":"2024-09-14T10:59:48.416149+0000","last_became_peered":"2024-09-14T10:59:48.416149+0000","last_unstale":"2024-09-14T11:21:00.389953+0000","last_undegraded":"2024-09-14T11:21:00.389953+0000","last_fullsized":"2024-09-14T11:21:00.389953+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:12.463862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":285,"num_read_kb":193,"num_write":82,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"259'1","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:46.110446+0000","last_change":"2024-09-14T11:11:42.584334+0000","last_active":"2024-09-14T11:18:46.110446+0000","last_peered":"2024-09-14T11:18:46.110446+0000","last_clean":"2024-09-14T11:18:46.110446+0000","last_became_active":"2024-09-14T11:11:42.583477+0000","last_became_peered":"2024-09-14T11:11:42.583477+0000","last_unstale":"2024-09-14T11:18:46.110446+0000","last_undegraded":"2024-09-14T11:18:46.110446+0000","last_fullsized":"2024-09-14T11:18:46.110446+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:34.189340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"260'8","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:26.017279+0000","last_change":"2024-09-14T11:01:23.891615+0000","last_active":"2024-09-14T11:22:26.017279+0000","last_peered":"2024-09-14T11:22:26.017279+0000","last_clean":"2024-09-14T11:22:26.017279+0000","last_became_active":"2024-09-14T11:01:23.891343+0000","last_became_peered":"2024-09-14T11:01:23.891343+0000","last_unstale":"2024-09-14T11:22:26.017279+0000","last_undegraded":"2024-09-14T11:22:26.017279+0000","last_fullsized":"2024-09-14T11:22:26.017279+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:37.853683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":15362,"num_write":13,"num_write_kb":10242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"260'2","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:02.116735+0000","last_change":"2024-09-14T11:01:20.862125+0000","last_active":"2024-09-14T11:20:02.116735+0000","last_peered":"2024-09-14T11:20:02.116735+0000","last_clean":"2024-09-14T11:20:02.116735+0000","last_became_active":"2024-09-14T11:01:20.861817+0000","last_became_peered":"2024-09-14T11:01:20.861817+0000","last_unstale":"2024-09-14T11:20:02.116735+0000","last_undegraded":"2024-09-14T11:20:02.116735+0000","last_fullsized":"2024-09-14T11:20:02.116735+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:55.520879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"260'106","reported_seq":361,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:29.979162+0000","last_change":"2024-09-14T10:59:48.418299+0000","last_active":"2024-09-14T11:18:29.979162+0000","last_peered":"2024-09-14T11:18:29.979162+0000","last_clean":"2024-09-14T11:18:29.979162+0000","last_became_active":"2024-09-14T10:59:48.418011+0000","last_became_peered":"2024-09-14T10:59:48.418011+0000","last_unstale":"2024-09-14T11:18:29.979162+0000","last_undegraded":"2024-09-14T11:18:29.979162+0000","last_fullsized":"2024-09-14T11:18:29.979162+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:53:09.804245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1045,"num_read_kb":858,"num_write":220,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"260'1","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:00.982068+0000","last_change":"2024-09-14T11:11:42.580964+0000","last_active":"2024-09-14T11:19:00.982068+0000","last_peered":"2024-09-14T11:19:00.982068+0000","last_clean":"2024-09-14T11:19:00.982068+0000","last_became_active":"2024-09-14T11:11:42.580611+0000","last_became_peered":"2024-09-14T11:11:42.580611+0000","last_unstale":"2024-09-14T11:19:00.982068+0000","last_undegraded":"2024-09-14T11:19:00.982068+0000","last_fullsized":"2024-09-14T11:19:00.982068+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:24.715816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:07.117668+0000","last_change":"2024-09-14T11:01:23.886701+0000","last_active":"2024-09-14T11:20:07.117668+0000","last_peered":"2024-09-14T11:20:07.117668+0000","last_clean":"2024-09-14T11:20:07.117668+0000","last_became_active":"2024-09-14T11:01:23.886496+0000","last_became_peered":"2024-09-14T11:01:23.886496+0000","last_unstale":"2024-09-14T11:20:07.117668+0000","last_undegraded":"2024-09-14T11:20:07.117668+0000","last_fullsized":"2024-09-14T11:20:07.117668+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:46.277781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"257'3","reported_seq":40,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:02.116770+0000","last_change":"2024-09-14T11:01:20.863982+0000","last_active":"2024-09-14T11:20:02.116770+0000","last_peered":"2024-09-14T11:20:02.116770+0000","last_clean":"2024-09-14T11:20:02.116770+0000","last_became_active":"2024-09-14T11:01:20.863707+0000","last_became_peered":"2024-09-14T11:01:20.863707+0000","last_unstale":"2024-09-14T11:20:02.116770+0000","last_undegraded":"2024-09-14T11:20:02.116770+0000","last_fullsized":"2024-09-14T11:20:02.116770+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:40.633016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"260'54","reported_seq":190,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:29.870970+0000","last_change":"2024-09-14T10:59:48.422151+0000","last_active":"2024-09-14T11:20:29.870970+0000","last_peered":"2024-09-14T11:20:29.870970+0000","last_clean":"2024-09-14T11:20:29.870970+0000","last_became_active":"2024-09-14T10:59:48.421875+0000","last_became_peered":"2024-09-14T10:59:48.421875+0000","last_unstale":"2024-09-14T11:20:29.870970+0000","last_undegraded":"2024-09-14T11:20:29.870970+0000","last_fullsized":"2024-09-14T11:20:29.870970+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:45.174950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":456,"num_read_kb":308,"num_write":139,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:26.246099+0000","last_change":"2024-09-14T11:11:42.590323+0000","last_active":"2024-09-14T11:20:26.246099+0000","last_peered":"2024-09-14T11:20:26.246099+0000","last_clean":"2024-09-14T11:20:26.246099+0000","last_became_active":"2024-09-14T11:11:42.590056+0000","last_became_peered":"2024-09-14T11:11:42.590056+0000","last_unstale":"2024-09-14T11:20:26.246099+0000","last_undegraded":"2024-09-14T11:20:26.246099+0000","last_fullsized":"2024-09-14T11:20:26.246099+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:24.964712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"260'2","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:41.010434+0000","last_change":"2024-09-14T11:01:23.892070+0000","last_active":"2024-09-14T11:21:41.010434+0000","last_peered":"2024-09-14T11:21:41.010434+0000","last_clean":"2024-09-14T11:21:41.010434+0000","last_became_active":"2024-09-14T11:01:23.891331+0000","last_became_peered":"2024-09-14T11:01:23.891331+0000","last_unstale":"2024-09-14T11:21:41.010434+0000","last_undegraded":"2024-09-14T11:21:41.010434+0000","last_fullsized":"2024-09-14T11:21:41.010434+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:08:04.829621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:19.986970+0000","last_change":"2024-09-14T11:01:20.863405+0000","last_active":"2024-09-14T11:19:19.986970+0000","last_peered":"2024-09-14T11:19:19.986970+0000","last_clean":"2024-09-14T11:19:19.986970+0000","last_became_active":"2024-09-14T11:01:20.863144+0000","last_became_peered":"2024-09-14T11:01:20.863144+0000","last_unstale":"2024-09-14T11:19:19.986970+0000","last_undegraded":"2024-09-14T11:19:19.986970+0000","last_fullsized":"2024-09-14T11:19:19.986970+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:52:05.926396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"260'19","reported_seq":91,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:00.757874+0000","last_change":"2024-09-14T10:59:48.417159+0000","last_active":"2024-09-14T11:21:00.757874+0000","last_peered":"2024-09-14T11:21:00.757874+0000","last_clean":"2024-09-14T11:21:00.757874+0000","last_became_active":"2024-09-14T10:59:48.416902+0000","last_became_peered":"2024-09-14T10:59:48.416902+0000","last_unstale":"2024-09-14T11:21:00.757874+0000","last_undegraded":"2024-09-14T11:21:00.757874+0000","last_fullsized":"2024-09-14T11:21:00.757874+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:14.436213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":98,"num_write":49,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:27.102106+0000","last_change":"2024-09-14T11:11:42.589320+0000","last_active":"2024-09-14T11:18:27.102106+0000","last_peered":"2024-09-14T11:18:27.102106+0000","last_clean":"2024-09-14T11:18:27.102106+0000","last_became_active":"2024-09-14T11:11:42.589071+0000","last_became_peered":"2024-09-14T11:11:42.589071+0000","last_unstale":"2024-09-14T11:18:27.102106+0000","last_undegraded":"2024-09-14T11:18:27.102106+0000","last_fullsized":"2024-09-14T11:18:27.102106+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:24.221085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:25.992224+0000","last_change":"2024-09-14T11:01:23.893015+0000","last_active":"2024-09-14T11:19:25.992224+0000","last_peered":"2024-09-14T11:19:25.992224+0000","last_clean":"2024-09-14T11:19:25.992224+0000","last_became_active":"2024-09-14T11:01:23.892761+0000","last_became_peered":"2024-09-14T11:01:23.892761+0000","last_unstale":"2024-09-14T11:19:25.992224+0000","last_undegraded":"2024-09-14T11:19:25.992224+0000","last_fullsized":"2024-09-14T11:19:25.992224+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:06.763249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:20.984704+0000","last_change":"2024-09-14T11:01:20.866514+0000","last_active":"2024-09-14T11:19:20.984704+0000","last_peered":"2024-09-14T11:19:20.984704+0000","last_clean":"2024-09-14T11:19:20.984704+0000","last_became_active":"2024-09-14T11:01:20.866224+0000","last_became_peered":"2024-09-14T11:01:20.866224+0000","last_unstale":"2024-09-14T11:19:20.984704+0000","last_undegraded":"2024-09-14T11:19:20.984704+0000","last_fullsized":"2024-09-14T11:19:20.984704+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:55.378175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"260'30","reported_seq":122,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:07.117741+0000","last_change":"2024-09-14T10:59:48.416632+0000","last_active":"2024-09-14T11:20:07.117741+0000","last_peered":"2024-09-14T11:20:07.117741+0000","last_clean":"2024-09-14T11:20:07.117741+0000","last_became_active":"2024-09-14T10:59:48.415922+0000","last_became_peered":"2024-09-14T10:59:48.415922+0000","last_unstale":"2024-09-14T11:20:07.117741+0000","last_undegraded":"2024-09-14T11:20:07.117741+0000","last_fullsized":"2024-09-14T11:20:07.117741+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:37.136039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":240,"num_read_kb":165,"num_write":74,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:22.119393+0000","last_change":"2024-09-14T11:11:42.591303+0000","last_active":"2024-09-14T11:20:22.119393+0000","last_peered":"2024-09-14T11:20:22.119393+0000","last_clean":"2024-09-14T11:20:22.119393+0000","last_became_active":"2024-09-14T11:11:42.589881+0000","last_became_peered":"2024-09-14T11:11:42.589881+0000","last_unstale":"2024-09-14T11:20:22.119393+0000","last_undegraded":"2024-09-14T11:20:22.119393+0000","last_fullsized":"2024-09-14T11:20:22.119393+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:53.799897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"257'8","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:30.993019+0000","last_change":"2024-09-14T11:01:23.897536+0000","last_active":"2024-09-14T11:19:30.993019+0000","last_peered":"2024-09-14T11:19:30.993019+0000","last_clean":"2024-09-14T11:19:30.993019+0000","last_became_active":"2024-09-14T11:01:23.897158+0000","last_became_peered":"2024-09-14T11:01:23.897158+0000","last_unstale":"2024-09-14T11:19:30.993019+0000","last_undegraded":"2024-09-14T11:19:30.993019+0000","last_fullsized":"2024-09-14T11:19:30.993019+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:34.363585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6146,"num_write":18,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:20.991433+0000","last_change":"2024-09-14T11:01:20.864291+0000","last_active":"2024-09-14T11:19:20.991433+0000","last_peered":"2024-09-14T11:19:20.991433+0000","last_clean":"2024-09-14T11:19:20.991433+0000","last_became_active":"2024-09-14T11:01:20.863999+0000","last_became_peered":"2024-09-14T11:01:20.863999+0000","last_unstale":"2024-09-14T11:19:20.991433+0000","last_undegraded":"2024-09-14T11:19:20.991433+0000","last_fullsized":"2024-09-14T11:19:20.991433+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:01:25.818000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"260'46","reported_seq":159,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:32.496503+0000","last_change":"2024-09-14T10:59:48.418550+0000","last_active":"2024-09-14T11:20:32.496503+0000","last_peered":"2024-09-14T11:20:32.496503+0000","last_clean":"2024-09-14T11:20:32.496503+0000","last_became_active":"2024-09-14T10:59:48.418276+0000","last_became_peered":"2024-09-14T10:59:48.418276+0000","last_unstale":"2024-09-14T11:20:32.496503+0000","last_undegraded":"2024-09-14T11:20:32.496503+0000","last_fullsized":"2024-09-14T11:20:32.496503+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:57.938381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":345,"num_read_kb":231,"num_write":118,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:22.119116+0000","last_change":"2024-09-14T11:11:42.587132+0000","last_active":"2024-09-14T11:20:22.119116+0000","last_peered":"2024-09-14T11:20:22.119116+0000","last_clean":"2024-09-14T11:20:22.119116+0000","last_became_active":"2024-09-14T11:11:42.586852+0000","last_became_peered":"2024-09-14T11:11:42.586852+0000","last_unstale":"2024-09-14T11:20:22.119116+0000","last_undegraded":"2024-09-14T11:20:22.119116+0000","last_fullsized":"2024-09-14T11:20:22.119116+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:34.192562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"257'3","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:26.237592+0000","last_change":"2024-09-14T11:01:23.887413+0000","last_active":"2024-09-14T11:19:26.237592+0000","last_peered":"2024-09-14T11:19:26.237592+0000","last_clean":"2024-09-14T11:19:26.237592+0000","last_became_active":"2024-09-14T11:01:23.887167+0000","last_became_peered":"2024-09-14T11:01:23.887167+0000","last_unstale":"2024-09-14T11:19:26.237592+0000","last_undegraded":"2024-09-14T11:19:26.237592+0000","last_fullsized":"2024-09-14T11:19:26.237592+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:36:46.808831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"260'4","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:25.992305+0000","last_change":"2024-09-14T11:01:20.857944+0000","last_active":"2024-09-14T11:19:25.992305+0000","last_peered":"2024-09-14T11:19:25.992305+0000","last_clean":"2024-09-14T11:19:25.992305+0000","last_became_active":"2024-09-14T11:01:20.857645+0000","last_became_peered":"2024-09-14T11:01:20.857645+0000","last_unstale":"2024-09-14T11:19:25.992305+0000","last_undegraded":"2024-09-14T11:19:25.992305+0000","last_fullsized":"2024-09-14T11:19:25.992305+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:57:36.222186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":9,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"260'22","reported_seq":101,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:05.990564+0000","last_change":"2024-09-14T10:59:48.413726+0000","last_active":"2024-09-14T11:20:05.990564+0000","last_peered":"2024-09-14T11:20:05.990564+0000","last_clean":"2024-09-14T11:20:05.990564+0000","last_became_active":"2024-09-14T10:59:48.413425+0000","last_became_peered":"2024-09-14T10:59:48.413425+0000","last_unstale":"2024-09-14T11:20:05.990564+0000","last_undegraded":"2024-09-14T11:20:05.990564+0000","last_fullsized":"2024-09-14T11:20:05.990564+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:03.945777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":100,"num_write":57,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:31.229418+0000","last_change":"2024-09-14T11:11:42.588149+0000","last_active":"2024-09-14T11:18:31.229418+0000","last_peered":"2024-09-14T11:18:31.229418+0000","last_clean":"2024-09-14T11:18:31.229418+0000","last_became_active":"2024-09-14T11:11:42.587906+0000","last_became_peered":"2024-09-14T11:11:42.587906+0000","last_unstale":"2024-09-14T11:18:31.229418+0000","last_undegraded":"2024-09-14T11:18:31.229418+0000","last_fullsized":"2024-09-14T11:18:31.229418+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:29.046471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:47.105337+0000","last_change":"2024-09-14T11:01:23.891705+0000","last_active":"2024-09-14T11:18:47.105337+0000","last_peered":"2024-09-14T11:18:47.105337+0000","last_clean":"2024-09-14T11:18:47.105337+0000","last_became_active":"2024-09-14T11:01:23.891424+0000","last_became_peered":"2024-09-14T11:01:23.891424+0000","last_unstale":"2024-09-14T11:18:47.105337+0000","last_undegraded":"2024-09-14T11:18:47.105337+0000","last_fullsized":"2024-09-14T11:18:47.105337+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:57.606174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"260'3","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:40.985234+0000","last_change":"2024-09-14T11:01:20.864246+0000","last_active":"2024-09-14T11:18:40.985234+0000","last_peered":"2024-09-14T11:18:40.985234+0000","last_clean":"2024-09-14T11:18:40.985234+0000","last_became_active":"2024-09-14T11:01:20.863936+0000","last_became_peered":"2024-09-14T11:01:20.863936+0000","last_unstale":"2024-09-14T11:18:40.985234+0000","last_undegraded":"2024-09-14T11:18:40.985234+0000","last_fullsized":"2024-09-14T11:18:40.985234+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:54.851971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":3,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"260'14","reported_seq":80,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:05.990531+0000","last_change":"2024-09-14T10:59:48.414234+0000","last_active":"2024-09-14T11:20:05.990531+0000","last_peered":"2024-09-14T11:20:05.990531+0000","last_clean":"2024-09-14T11:20:05.990531+0000","last_became_active":"2024-09-14T10:59:48.413255+0000","last_became_peered":"2024-09-14T10:59:48.413255+0000","last_unstale":"2024-09-14T11:20:05.990531+0000","last_undegraded":"2024-09-14T11:20:05.990531+0000","last_fullsized":"2024-09-14T11:20:05.990531+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:14.892298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":78,"num_write":38,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:34.979984+0000","last_change":"2024-09-14T11:11:42.588371+0000","last_active":"2024-09-14T11:18:34.979984+0000","last_peered":"2024-09-14T11:18:34.979984+0000","last_clean":"2024-09-14T11:18:34.979984+0000","last_became_active":"2024-09-14T11:11:42.588120+0000","last_became_peered":"2024-09-14T11:11:42.588120+0000","last_unstale":"2024-09-14T11:18:34.979984+0000","last_undegraded":"2024-09-14T11:18:34.979984+0000","last_fullsized":"2024-09-14T11:18:34.979984+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:23.029451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"257'3","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:44.981319+0000","last_change":"2024-09-14T11:01:23.889191+0000","last_active":"2024-09-14T11:18:44.981319+0000","last_peered":"2024-09-14T11:18:44.981319+0000","last_clean":"2024-09-14T11:18:44.981319+0000","last_became_active":"2024-09-14T11:01:23.888873+0000","last_became_peered":"2024-09-14T11:01:23.888873+0000","last_unstale":"2024-09-14T11:18:44.981319+0000","last_undegraded":"2024-09-14T11:18:44.981319+0000","last_fullsized":"2024-09-14T11:18:44.981319+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:21.226880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:41.230765+0000","last_change":"2024-09-14T11:01:20.867172+0000","last_active":"2024-09-14T11:18:41.230765+0000","last_peered":"2024-09-14T11:18:41.230765+0000","last_clean":"2024-09-14T11:18:41.230765+0000","last_became_active":"2024-09-14T11:01:20.865953+0000","last_became_peered":"2024-09-14T11:01:20.865953+0000","last_unstale":"2024-09-14T11:18:41.230765+0000","last_undegraded":"2024-09-14T11:18:41.230765+0000","last_fullsized":"2024-09-14T11:18:41.230765+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:07:32.750973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"260'22","reported_seq":98,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:00.388827+0000","last_change":"2024-09-14T10:59:48.417311+0000","last_active":"2024-09-14T11:21:00.388827+0000","last_peered":"2024-09-14T11:21:00.388827+0000","last_clean":"2024-09-14T11:21:00.388827+0000","last_became_active":"2024-09-14T10:59:48.417013+0000","last_became_peered":"2024-09-14T10:59:48.417013+0000","last_unstale":"2024-09-14T11:21:00.388827+0000","last_undegraded":"2024-09-14T11:21:00.388827+0000","last_fullsized":"2024-09-14T11:21:00.388827+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:55.489720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":110,"num_write":54,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"260'1","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:27.198445+0000","last_change":"2024-09-14T11:11:42.592793+0000","last_active":"2024-09-14T11:18:27.198445+0000","last_peered":"2024-09-14T11:18:27.198445+0000","last_clean":"2024-09-14T11:18:27.198445+0000","last_became_active":"2024-09-14T11:11:42.592514+0000","last_became_peered":"2024-09-14T11:11:42.592514+0000","last_unstale":"2024-09-14T11:18:27.198445+0000","last_undegraded":"2024-09-14T11:18:27.198445+0000","last_fullsized":"2024-09-14T11:18:27.198445+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:15.197793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:25.985335+0000","last_change":"2024-09-14T11:01:23.890689+0000","last_active":"2024-09-14T11:19:25.985335+0000","last_peered":"2024-09-14T11:19:25.985335+0000","last_clean":"2024-09-14T11:19:25.985335+0000","last_became_active":"2024-09-14T11:01:23.890356+0000","last_became_peered":"2024-09-14T11:01:23.890356+0000","last_unstale":"2024-09-14T11:19:25.985335+0000","last_undegraded":"2024-09-14T11:19:25.985335+0000","last_fullsized":"2024-09-14T11:19:25.985335+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:10.636807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"257'3","reported_seq":40,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:45.986096+0000","last_change":"2024-09-14T11:01:20.859484+0000","last_active":"2024-09-14T11:18:45.986096+0000","last_peered":"2024-09-14T11:18:45.986096+0000","last_clean":"2024-09-14T11:18:45.986096+0000","last_became_active":"2024-09-14T11:01:20.859214+0000","last_became_peered":"2024-09-14T11:01:20.859214+0000","last_unstale":"2024-09-14T11:18:45.986096+0000","last_undegraded":"2024-09-14T11:18:45.986096+0000","last_fullsized":"2024-09-14T11:18:45.986096+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:16.912377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"260'23","reported_seq":97,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:21.236876+0000","last_change":"2024-09-14T10:59:48.420616+0000","last_active":"2024-09-14T11:19:21.236876+0000","last_peered":"2024-09-14T11:19:21.236876+0000","last_clean":"2024-09-14T11:19:21.236876+0000","last_became_active":"2024-09-14T10:59:48.420353+0000","last_became_peered":"2024-09-14T10:59:48.420353+0000","last_unstale":"2024-09-14T11:19:21.236876+0000","last_undegraded":"2024-09-14T11:19:21.236876+0000","last_fullsized":"2024-09-14T11:19:21.236876+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:02.159847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":102,"num_write":60,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:30.984019+0000","last_change":"2024-09-14T11:11:42.589448+0000","last_active":"2024-09-14T11:18:30.984019+0000","last_peered":"2024-09-14T11:18:30.984019+0000","last_clean":"2024-09-14T11:18:30.984019+0000","last_became_active":"2024-09-14T11:11:42.589134+0000","last_became_peered":"2024-09-14T11:11:42.589134+0000","last_unstale":"2024-09-14T11:18:30.984019+0000","last_undegraded":"2024-09-14T11:18:30.984019+0000","last_fullsized":"2024-09-14T11:18:30.984019+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:36:39.197914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"260'1","reported_seq":30,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:47.201529+0000","last_change":"2024-09-14T11:01:23.890752+0000","last_active":"2024-09-14T11:18:47.201529+0000","last_peered":"2024-09-14T11:18:47.201529+0000","last_clean":"2024-09-14T11:18:47.201529+0000","last_became_active":"2024-09-14T11:01:23.890433+0000","last_became_peered":"2024-09-14T11:01:23.890433+0000","last_unstale":"2024-09-14T11:18:47.201529+0000","last_undegraded":"2024-09-14T11:18:47.201529+0000","last_fullsized":"2024-09-14T11:18:47.201529+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:00.066817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"257'3","reported_seq":40,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:22.110767+0000","last_change":"2024-09-14T11:01:20.859636+0000","last_active":"2024-09-14T11:19:22.110767+0000","last_peered":"2024-09-14T11:19:22.110767+0000","last_clean":"2024-09-14T11:19:22.110767+0000","last_became_active":"2024-09-14T11:01:20.858834+0000","last_became_peered":"2024-09-14T11:01:20.858834+0000","last_unstale":"2024-09-14T11:19:22.110767+0000","last_undegraded":"2024-09-14T11:19:22.110767+0000","last_fullsized":"2024-09-14T11:19:22.110767+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:26.825835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"260'31","reported_seq":128,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:22.206583+0000","last_change":"2024-09-14T10:59:48.414660+0000","last_active":"2024-09-14T11:19:22.206583+0000","last_peered":"2024-09-14T11:19:22.206583+0000","last_clean":"2024-09-14T11:19:22.206583+0000","last_became_active":"2024-09-14T10:59:48.414351+0000","last_became_peered":"2024-09-14T10:59:48.414351+0000","last_unstale":"2024-09-14T11:19:22.206583+0000","last_undegraded":"2024-09-14T11:19:22.206583+0000","last_fullsized":"2024-09-14T11:19:22.206583+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:47.823706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":249,"num_read_kb":158,"num_write":78,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:02.212097+0000","last_change":"2024-09-14T11:11:42.588279+0000","last_active":"2024-09-14T11:20:02.212097+0000","last_peered":"2024-09-14T11:20:02.212097+0000","last_clean":"2024-09-14T11:20:02.212097+0000","last_became_active":"2024-09-14T11:11:42.587955+0000","last_became_peered":"2024-09-14T11:11:42.587955+0000","last_unstale":"2024-09-14T11:20:02.212097+0000","last_undegraded":"2024-09-14T11:20:02.212097+0000","last_fullsized":"2024-09-14T11:20:02.212097+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:26.572340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"260'8","reported_seq":47,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:16.262273+0000","last_change":"2024-09-14T11:01:23.893822+0000","last_active":"2024-09-14T11:22:16.262273+0000","last_peered":"2024-09-14T11:22:16.262273+0000","last_clean":"2024-09-14T11:22:16.262273+0000","last_became_active":"2024-09-14T11:01:23.891239+0000","last_became_peered":"2024-09-14T11:01:23.891239+0000","last_unstale":"2024-09-14T11:22:16.262273+0000","last_undegraded":"2024-09-14T11:22:16.262273+0000","last_fullsized":"2024-09-14T11:22:16.262273+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:21.232548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20482,"num_write":18,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":35,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:07.117708+0000","last_change":"2024-09-14T11:01:20.867304+0000","last_active":"2024-09-14T11:20:07.117708+0000","last_peered":"2024-09-14T11:20:07.117708+0000","last_clean":"2024-09-14T11:20:07.117708+0000","last_became_active":"2024-09-14T11:01:20.866975+0000","last_became_peered":"2024-09-14T11:01:20.866975+0000","last_unstale":"2024-09-14T11:20:07.117708+0000","last_undegraded":"2024-09-14T11:20:07.117708+0000","last_fullsized":"2024-09-14T11:20:07.117708+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:53.556481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"260'4","reported_seq":50,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:21.115449+0000","last_change":"2024-09-14T10:59:48.417712+0000","last_active":"2024-09-14T11:19:21.115449+0000","last_peered":"2024-09-14T11:19:21.115449+0000","last_clean":"2024-09-14T11:19:21.115449+0000","last_became_active":"2024-09-14T10:59:48.416741+0000","last_became_peered":"2024-09-14T10:59:48.416741+0000","last_unstale":"2024-09-14T11:19:21.115449+0000","last_undegraded":"2024-09-14T11:19:21.115449+0000","last_fullsized":"2024-09-14T11:19:21.115449+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:42.444007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:02.212122+0000","last_change":"2024-09-14T11:11:42.582460+0000","last_active":"2024-09-14T11:20:02.212122+0000","last_peered":"2024-09-14T11:20:02.212122+0000","last_clean":"2024-09-14T11:20:02.212122+0000","last_became_active":"2024-09-14T11:11:42.582190+0000","last_became_peered":"2024-09-14T11:11:42.582190+0000","last_unstale":"2024-09-14T11:20:02.212122+0000","last_undegraded":"2024-09-14T11:20:02.212122+0000","last_fullsized":"2024-09-14T11:20:02.212122+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:34.879085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"260'10","reported_seq":55,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:16.262243+0000","last_change":"2024-09-14T11:01:23.893560+0000","last_active":"2024-09-14T11:22:16.262243+0000","last_peered":"2024-09-14T11:22:16.262243+0000","last_clean":"2024-09-14T11:22:16.262243+0000","last_became_active":"2024-09-14T11:01:23.892344+0000","last_became_peered":"2024-09-14T11:01:23.892344+0000","last_unstale":"2024-09-14T11:22:16.262243+0000","last_undegraded":"2024-09-14T11:22:16.262243+0000","last_fullsized":"2024-09-14T11:22:16.262243+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:12.291644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":30724,"num_write":15,"num_write_kb":10242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"260'2","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:11.138584+0000","last_change":"2024-09-14T11:01:20.863767+0000","last_active":"2024-09-14T11:22:11.138584+0000","last_peered":"2024-09-14T11:22:11.138584+0000","last_clean":"2024-09-14T11:22:11.138584+0000","last_became_active":"2024-09-14T11:01:20.863495+0000","last_became_peered":"2024-09-14T11:01:20.863495+0000","last_unstale":"2024-09-14T11:22:11.138584+0000","last_undegraded":"2024-09-14T11:22:11.138584+0000","last_fullsized":"2024-09-14T11:22:11.138584+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:36:10.395831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"260'32","reported_seq":120,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:22.110836+0000","last_change":"2024-09-14T10:59:48.416964+0000","last_active":"2024-09-14T11:19:22.110836+0000","last_peered":"2024-09-14T11:19:22.110836+0000","last_clean":"2024-09-14T11:19:22.110836+0000","last_became_active":"2024-09-14T10:59:48.416253+0000","last_became_peered":"2024-09-14T10:59:48.416253+0000","last_unstale":"2024-09-14T11:19:22.110836+0000","last_undegraded":"2024-09-14T11:19:22.110836+0000","last_fullsized":"2024-09-14T11:19:22.110836+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:16.459819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":142,"num_write":84,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:46.240692+0000","last_change":"2024-09-14T11:11:42.589281+0000","last_active":"2024-09-14T11:19:46.240692+0000","last_peered":"2024-09-14T11:19:46.240692+0000","last_clean":"2024-09-14T11:19:46.240692+0000","last_became_active":"2024-09-14T11:11:42.588988+0000","last_became_peered":"2024-09-14T11:11:42.588988+0000","last_unstale":"2024-09-14T11:19:46.240692+0000","last_undegraded":"2024-09-14T11:19:46.240692+0000","last_fullsized":"2024-09-14T11:19:46.240692+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:50:56.659833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"260'4","reported_seq":36,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:47.201596+0000","last_change":"2024-09-14T11:01:23.889213+0000","last_active":"2024-09-14T11:18:47.201596+0000","last_peered":"2024-09-14T11:18:47.201596+0000","last_clean":"2024-09-14T11:18:47.201596+0000","last_became_active":"2024-09-14T11:01:23.888845+0000","last_became_peered":"2024-09-14T11:01:23.888845+0000","last_unstale":"2024-09-14T11:18:47.201596+0000","last_undegraded":"2024-09-14T11:18:47.201596+0000","last_fullsized":"2024-09-14T11:18:47.201596+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:20.704713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":11264,"num_write":4,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"257'10","reported_seq":60,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:39.980809+0000","last_change":"2024-09-14T11:01:20.866169+0000","last_active":"2024-09-14T11:18:39.980809+0000","last_peered":"2024-09-14T11:18:39.980809+0000","last_clean":"2024-09-14T11:18:39.980809+0000","last_became_active":"2024-09-14T11:01:20.865891+0000","last_became_peered":"2024-09-14T11:01:20.865891+0000","last_unstale":"2024-09-14T11:18:39.980809+0000","last_undegraded":"2024-09-14T11:18:39.980809+0000","last_fullsized":"2024-09-14T11:18:39.980809+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:22.211764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":24580,"num_write":15,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"260'27","reported_seq":114,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:05.938404+0000","last_change":"2024-09-14T10:59:48.421115+0000","last_active":"2024-09-14T11:20:05.938404+0000","last_peered":"2024-09-14T11:20:05.938404+0000","last_clean":"2024-09-14T11:20:05.938404+0000","last_became_active":"2024-09-14T10:59:48.420845+0000","last_became_peered":"2024-09-14T10:59:48.420845+0000","last_unstale":"2024-09-14T11:20:05.938404+0000","last_undegraded":"2024-09-14T11:20:05.938404+0000","last_fullsized":"2024-09-14T11:20:05.938404+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:56.781294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":135,"num_write":77,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:02.116980+0000","last_change":"2024-09-14T11:11:42.592263+0000","last_active":"2024-09-14T11:20:02.116980+0000","last_peered":"2024-09-14T11:20:02.116980+0000","last_clean":"2024-09-14T11:20:02.116980+0000","last_became_active":"2024-09-14T11:11:42.591734+0000","last_became_peered":"2024-09-14T11:11:42.591734+0000","last_unstale":"2024-09-14T11:20:02.116980+0000","last_undegraded":"2024-09-14T11:20:02.116980+0000","last_fullsized":"2024-09-14T11:20:02.116980+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:48.663357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"260'2","reported_seq":30,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:47.105455+0000","last_change":"2024-09-14T11:01:23.895194+0000","last_active":"2024-09-14T11:18:47.105455+0000","last_peered":"2024-09-14T11:18:47.105455+0000","last_clean":"2024-09-14T11:18:47.105455+0000","last_became_active":"2024-09-14T11:01:23.894904+0000","last_became_peered":"2024-09-14T11:01:23.894904+0000","last_unstale":"2024-09-14T11:18:47.105455+0000","last_undegraded":"2024-09-14T11:18:47.105455+0000","last_fullsized":"2024-09-14T11:18:47.105455+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:18.788575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:42.104731+0000","last_change":"2024-09-14T11:01:20.867989+0000","last_active":"2024-09-14T11:18:42.104731+0000","last_peered":"2024-09-14T11:18:42.104731+0000","last_clean":"2024-09-14T11:18:42.104731+0000","last_became_active":"2024-09-14T11:01:20.867675+0000","last_became_peered":"2024-09-14T11:01:20.867675+0000","last_unstale":"2024-09-14T11:18:42.104731+0000","last_undegraded":"2024-09-14T11:18:42.104731+0000","last_fullsized":"2024-09-14T11:18:42.104731+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:14:01.546319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"260'45","reported_seq":167,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:41.002316+0000","last_change":"2024-09-14T10:59:48.420304+0000","last_active":"2024-09-14T11:20:41.002316+0000","last_peered":"2024-09-14T11:20:41.002316+0000","last_clean":"2024-09-14T11:20:41.002316+0000","last_became_active":"2024-09-14T10:59:48.419276+0000","last_became_peered":"2024-09-14T10:59:48.419276+0000","last_unstale":"2024-09-14T11:20:41.002316+0000","last_undegraded":"2024-09-14T11:20:41.002316+0000","last_fullsized":"2024-09-14T11:20:41.002316+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:28.099017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":347,"num_read_kb":232,"num_write":118,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"259'1","reported_seq":19,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:26.000278+0000","last_change":"2024-09-14T11:11:42.585561+0000","last_active":"2024-09-14T11:20:26.000278+0000","last_peered":"2024-09-14T11:20:26.000278+0000","last_clean":"2024-09-14T11:20:26.000278+0000","last_became_active":"2024-09-14T11:11:42.585114+0000","last_became_peered":"2024-09-14T11:11:42.585114+0000","last_unstale":"2024-09-14T11:20:26.000278+0000","last_undegraded":"2024-09-14T11:20:26.000278+0000","last_fullsized":"2024-09-14T11:20:26.000278+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:57.558919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"260'1","reported_seq":31,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:11.121984+0000","last_change":"2024-09-14T11:01:23.894718+0000","last_active":"2024-09-14T11:20:11.121984+0000","last_peered":"2024-09-14T11:20:11.121984+0000","last_clean":"2024-09-14T11:20:11.121984+0000","last_became_active":"2024-09-14T11:01:23.894464+0000","last_became_peered":"2024-09-14T11:01:23.894464+0000","last_unstale":"2024-09-14T11:20:11.121984+0000","last_undegraded":"2024-09-14T11:20:11.121984+0000","last_fullsized":"2024-09-14T11:20:11.121984+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:05.810582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":35,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:24.987527+0000","last_change":"2024-09-14T11:01:20.869396+0000","last_active":"2024-09-14T11:19:24.987527+0000","last_peered":"2024-09-14T11:19:24.987527+0000","last_clean":"2024-09-14T11:19:24.987527+0000","last_became_active":"2024-09-14T11:01:20.869082+0000","last_became_peered":"2024-09-14T11:01:20.869082+0000","last_unstale":"2024-09-14T11:19:24.987527+0000","last_undegraded":"2024-09-14T11:19:24.987527+0000","last_fullsized":"2024-09-14T11:19:24.987527+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:21.154202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"260'42","reported_seq":152,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:00.225547+0000","last_change":"2024-09-14T10:59:48.420048+0000","last_active":"2024-09-14T11:21:00.225547+0000","last_peered":"2024-09-14T11:21:00.225547+0000","last_clean":"2024-09-14T11:21:00.225547+0000","last_became_active":"2024-09-14T10:59:48.419753+0000","last_became_peered":"2024-09-14T10:59:48.419753+0000","last_unstale":"2024-09-14T11:21:00.225547+0000","last_undegraded":"2024-09-14T11:21:00.225547+0000","last_fullsized":"2024-09-14T11:21:00.225547+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:03.370977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":323,"num_read_kb":218,"num_write":115,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:26.123988+0000","last_change":"2024-09-14T11:11:42.593259+0000","last_active":"2024-09-14T11:20:26.123988+0000","last_peered":"2024-09-14T11:20:26.123988+0000","last_clean":"2024-09-14T11:20:26.123988+0000","last_became_active":"2024-09-14T11:11:42.592960+0000","last_became_peered":"2024-09-14T11:11:42.592960+0000","last_unstale":"2024-09-14T11:20:26.123988+0000","last_undegraded":"2024-09-14T11:20:26.123988+0000","last_fullsized":"2024-09-14T11:20:26.123988+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:01.524529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"260'2","reported_seq":31,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:32.112183+0000","last_change":"2024-09-14T11:01:23.884623+0000","last_active":"2024-09-14T11:19:32.112183+0000","last_peered":"2024-09-14T11:19:32.112183+0000","last_clean":"2024-09-14T11:19:32.112183+0000","last_became_active":"2024-09-14T11:01:23.883464+0000","last_became_peered":"2024-09-14T11:01:23.883464+0000","last_unstale":"2024-09-14T11:19:32.112183+0000","last_undegraded":"2024-09-14T11:19:32.112183+0000","last_fullsized":"2024-09-14T11:19:32.112183+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:39:12.543169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":35,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:07.117641+0000","last_change":"2024-09-14T11:01:20.858331+0000","last_active":"2024-09-14T11:20:07.117641+0000","last_peered":"2024-09-14T11:20:07.117641+0000","last_clean":"2024-09-14T11:20:07.117641+0000","last_became_active":"2024-09-14T11:01:20.858057+0000","last_became_peered":"2024-09-14T11:01:20.858057+0000","last_unstale":"2024-09-14T11:20:07.117641+0000","last_undegraded":"2024-09-14T11:20:07.117641+0000","last_fullsized":"2024-09-14T11:20:07.117641+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:57:11.838133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"260'19","reported_seq":86,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:42.122601+0000","last_change":"2024-09-14T10:59:48.413110+0000","last_active":"2024-09-14T11:20:42.122601+0000","last_peered":"2024-09-14T11:20:42.122601+0000","last_clean":"2024-09-14T11:20:42.122601+0000","last_became_active":"2024-09-14T10:59:48.412832+0000","last_became_peered":"2024-09-14T10:59:48.412832+0000","last_unstale":"2024-09-14T11:20:42.122601+0000","last_undegraded":"2024-09-14T11:20:42.122601+0000","last_fullsized":"2024-09-14T11:20:42.122601+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:06.411861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":68,"num_write":55,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:06.243706+0000","last_change":"2024-09-14T11:11:42.590806+0000","last_active":"2024-09-14T11:20:06.243706+0000","last_peered":"2024-09-14T11:20:06.243706+0000","last_clean":"2024-09-14T11:20:06.243706+0000","last_became_active":"2024-09-14T11:11:42.590549+0000","last_became_peered":"2024-09-14T11:11:42.590549+0000","last_unstale":"2024-09-14T11:20:06.243706+0000","last_undegraded":"2024-09-14T11:20:06.243706+0000","last_fullsized":"2024-09-14T11:20:06.243706+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:47:13.279425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":29,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:09.993244+0000","last_change":"2024-09-14T11:01:23.880483+0000","last_active":"2024-09-14T11:20:09.993244+0000","last_peered":"2024-09-14T11:20:09.993244+0000","last_clean":"2024-09-14T11:20:09.993244+0000","last_became_active":"2024-09-14T11:01:23.880195+0000","last_became_peered":"2024-09-14T11:01:23.880195+0000","last_unstale":"2024-09-14T11:20:09.993244+0000","last_undegraded":"2024-09-14T11:20:09.993244+0000","last_fullsized":"2024-09-14T11:20:09.993244+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:17.209496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":35,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:05.990504+0000","last_change":"2024-09-14T11:01:20.869635+0000","last_active":"2024-09-14T11:20:05.990504+0000","last_peered":"2024-09-14T11:20:05.990504+0000","last_clean":"2024-09-14T11:20:05.990504+0000","last_became_active":"2024-09-14T11:01:20.869312+0000","last_became_peered":"2024-09-14T11:01:20.869312+0000","last_unstale":"2024-09-14T11:20:05.990504+0000","last_undegraded":"2024-09-14T11:20:05.990504+0000","last_fullsized":"2024-09-14T11:20:05.990504+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:36:29.069053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"257'19","reported_seq":97,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:42.122542+0000","last_change":"2024-09-14T10:59:48.418837+0000","last_active":"2024-09-14T11:20:42.122542+0000","last_peered":"2024-09-14T11:20:42.122542+0000","last_clean":"2024-09-14T11:20:42.122542+0000","last_became_active":"2024-09-14T10:59:48.418369+0000","last_became_peered":"2024-09-14T10:59:48.418369+0000","last_unstale":"2024-09-14T11:20:42.122542+0000","last_undegraded":"2024-09-14T11:20:42.122542+0000","last_fullsized":"2024-09-14T11:20:42.122542+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:53.388331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":97,"num_write":49,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:02.117065+0000","last_change":"2024-09-14T11:11:42.593087+0000","last_active":"2024-09-14T11:20:02.117065+0000","last_peered":"2024-09-14T11:20:02.117065+0000","last_clean":"2024-09-14T11:20:02.117065+0000","last_became_active":"2024-09-14T11:11:42.592333+0000","last_became_peered":"2024-09-14T11:11:42.592333+0000","last_unstale":"2024-09-14T11:20:02.117065+0000","last_undegraded":"2024-09-14T11:20:02.117065+0000","last_fullsized":"2024-09-14T11:20:02.117065+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:32.247668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"260'1","reported_seq":31,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:09.993223+0000","last_change":"2024-09-14T11:01:23.882421+0000","last_active":"2024-09-14T11:20:09.993223+0000","last_peered":"2024-09-14T11:20:09.993223+0000","last_clean":"2024-09-14T11:20:09.993223+0000","last_became_active":"2024-09-14T11:01:23.882133+0000","last_became_peered":"2024-09-14T11:01:23.882133+0000","last_unstale":"2024-09-14T11:20:09.993223+0000","last_undegraded":"2024-09-14T11:20:09.993223+0000","last_fullsized":"2024-09-14T11:20:09.993223+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:20.333208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3204,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":35,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:07.117340+0000","last_change":"2024-09-14T11:01:20.861253+0000","last_active":"2024-09-14T11:20:07.117340+0000","last_peered":"2024-09-14T11:20:07.117340+0000","last_clean":"2024-09-14T11:20:07.117340+0000","last_became_active":"2024-09-14T11:01:20.860944+0000","last_became_peered":"2024-09-14T11:01:20.860944+0000","last_unstale":"2024-09-14T11:20:07.117340+0000","last_undegraded":"2024-09-14T11:20:07.117340+0000","last_fullsized":"2024-09-14T11:20:07.117340+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:43.601108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"260'37","reported_seq":141,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:19.371160+0000","last_change":"2024-09-14T10:59:48.420240+0000","last_active":"2024-09-14T11:20:19.371160+0000","last_peered":"2024-09-14T11:20:19.371160+0000","last_clean":"2024-09-14T11:20:19.371160+0000","last_became_active":"2024-09-14T10:59:48.419953+0000","last_became_peered":"2024-09-14T10:59:48.419953+0000","last_unstale":"2024-09-14T11:20:19.371160+0000","last_undegraded":"2024-09-14T11:20:19.371160+0000","last_fullsized":"2024-09-14T11:20:19.371160+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:19.266531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":210,"num_write":90,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"260'286","reported_seq":921,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:09.985550+0000","last_change":"2024-09-14T10:45:43.684610+0000","last_active":"2024-09-14T11:21:09.985550+0000","last_peered":"2024-09-14T11:21:09.985550+0000","last_clean":"2024-09-14T11:21:09.985550+0000","last_became_active":"2024-09-14T10:45:43.684205+0000","last_became_peered":"2024-09-14T10:45:43.684205+0000","last_unstale":"2024-09-14T11:21:09.985550+0000","last_undegraded":"2024-09-14T11:21:09.985550+0000","last_fullsized":"2024-09-14T11:21:09.985550+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:01:55.211378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11900480,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":554,"num_read_kb":37218,"num_write":1014,"num_write_kb":25003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"260'782","reported_seq":2531,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.834281+0000","last_change":"2024-09-14T10:45:45.714795+0000","last_active":"2024-09-14T11:22:42.834281+0000","last_peered":"2024-09-14T11:22:42.834281+0000","last_clean":"2024-09-14T11:22:42.834281+0000","last_became_active":"2024-09-14T10:45:45.714485+0000","last_became_peered":"2024-09-14T10:45:45.714485+0000","last_unstale":"2024-09-14T11:22:42.834281+0000","last_undegraded":"2024-09-14T11:22:42.834281+0000","last_fullsized":"2024-09-14T11:22:42.834281+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:23:57.662505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4300,"num_read_kb":3942,"num_write":1034,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"260'337","reported_seq":1014,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.086853+0000","last_change":"2024-09-14T10:45:43.684416+0000","last_active":"2024-09-14T11:22:51.086853+0000","last_peered":"2024-09-14T11:22:51.086853+0000","last_clean":"2024-09-14T11:22:51.086853+0000","last_became_active":"2024-09-14T10:45:43.683777+0000","last_became_peered":"2024-09-14T10:45:43.683777+0000","last_unstale":"2024-09-14T11:22:51.086853+0000","last_undegraded":"2024-09-14T11:22:51.086853+0000","last_fullsized":"2024-09-14T11:22:51.086853+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:01.676657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23917,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":745,"num_read_kb":10810,"num_write":1134,"num_write_kb":33486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"260'363","reported_seq":1830,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.734957+0000","last_change":"2024-09-14T10:45:45.716175+0000","last_active":"2024-09-14T11:21:28.734957+0000","last_peered":"2024-09-14T11:21:28.734957+0000","last_clean":"2024-09-14T11:21:28.734957+0000","last_became_active":"2024-09-14T10:45:45.715857+0000","last_became_peered":"2024-09-14T10:45:45.715857+0000","last_unstale":"2024-09-14T11:21:28.734957+0000","last_undegraded":"2024-09-14T11:21:28.734957+0000","last_fullsized":"2024-09-14T11:21:28.734957+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:52.361682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2025,"num_read_kb":1946,"num_write":400,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"260'348","reported_seq":1052,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.079373+0000","last_change":"2024-09-14T10:45:43.689580+0000","last_active":"2024-09-14T11:22:51.079373+0000","last_peered":"2024-09-14T11:22:51.079373+0000","last_clean":"2024-09-14T11:22:51.079373+0000","last_became_active":"2024-09-14T10:45:43.689222+0000","last_became_peered":"2024-09-14T10:45:43.689222+0000","last_unstale":"2024-09-14T11:22:51.079373+0000","last_undegraded":"2024-09-14T11:22:51.079373+0000","last_fullsized":"2024-09-14T11:22:51.079373+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:25.612577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":929,"num_read_kb":25215,"num_write":1085,"num_write_kb":46624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"260'805","reported_seq":2235,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:14.951766+0000","last_change":"2024-09-14T10:45:45.718479+0000","last_active":"2024-09-14T11:21:14.951766+0000","last_peered":"2024-09-14T11:21:14.951766+0000","last_clean":"2024-09-14T11:21:14.951766+0000","last_became_active":"2024-09-14T10:45:45.718205+0000","last_became_peered":"2024-09-14T10:45:45.718205+0000","last_unstale":"2024-09-14T11:21:14.951766+0000","last_undegraded":"2024-09-14T11:21:14.951766+0000","last_fullsized":"2024-09-14T11:21:14.951766+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:25.149788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3715,"num_read_kb":3327,"num_write":1051,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"260'321","reported_seq":1063,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:16.586674+0000","last_change":"2024-09-14T10:45:43.689239+0000","last_active":"2024-09-14T11:21:16.586674+0000","last_peered":"2024-09-14T11:21:16.586674+0000","last_clean":"2024-09-14T11:21:16.586674+0000","last_became_active":"2024-09-14T10:45:43.688982+0000","last_became_peered":"2024-09-14T10:45:43.688982+0000","last_unstale":"2024-09-14T11:21:16.586674+0000","last_undegraded":"2024-09-14T11:21:16.586674+0000","last_fullsized":"2024-09-14T11:21:16.586674+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:12.609439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11676363,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":758,"num_read_kb":162477,"num_write":1261,"num_write_kb":45809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"260'456","reported_seq":2005,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.041160+0000","last_change":"2024-09-14T10:45:45.718026+0000","last_active":"2024-09-14T11:21:27.041160+0000","last_peered":"2024-09-14T11:21:27.041160+0000","last_clean":"2024-09-14T11:21:27.041160+0000","last_became_active":"2024-09-14T10:45:45.717699+0000","last_became_peered":"2024-09-14T10:45:45.717699+0000","last_unstale":"2024-09-14T11:21:27.041160+0000","last_undegraded":"2024-09-14T11:21:27.041160+0000","last_fullsized":"2024-09-14T11:21:27.041160+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:20.366459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2461,"num_read_kb":2303,"num_write":536,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"260'292","reported_seq":931,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:58.304735+0000","last_change":"2024-09-14T10:45:43.686364+0000","last_active":"2024-09-14T11:20:58.304735+0000","last_peered":"2024-09-14T11:20:58.304735+0000","last_clean":"2024-09-14T11:20:58.304735+0000","last_became_active":"2024-09-14T10:45:43.686078+0000","last_became_peered":"2024-09-14T10:45:43.686078+0000","last_unstale":"2024-09-14T11:20:58.304735+0000","last_undegraded":"2024-09-14T11:20:58.304735+0000","last_fullsized":"2024-09-14T11:20:58.304735+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:18.961172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":675323,"num_objects":85,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":522,"num_read_kb":61894,"num_write":1086,"num_write_kb":33123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"260'397","reported_seq":2007,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:13.971249+0000","last_change":"2024-09-14T10:45:45.714828+0000","last_active":"2024-09-14T11:21:13.971249+0000","last_peered":"2024-09-14T11:21:13.971249+0000","last_clean":"2024-09-14T11:21:13.971249+0000","last_became_active":"2024-09-14T10:45:45.714345+0000","last_became_peered":"2024-09-14T10:45:45.714345+0000","last_unstale":"2024-09-14T11:21:13.971249+0000","last_undegraded":"2024-09-14T11:21:13.971249+0000","last_fullsized":"2024-09-14T11:21:13.971249+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:55.678707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2395,"num_read_kb":2287,"num_write":454,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"260'295","reported_seq":951,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:04.028564+0000","last_change":"2024-09-14T10:45:43.689767+0000","last_active":"2024-09-14T11:21:04.028564+0000","last_peered":"2024-09-14T11:21:04.028564+0000","last_clean":"2024-09-14T11:21:04.028564+0000","last_became_active":"2024-09-14T10:45:43.689513+0000","last_became_peered":"2024-09-14T10:45:43.689513+0000","last_unstale":"2024-09-14T11:21:04.028564+0000","last_undegraded":"2024-09-14T11:21:04.028564+0000","last_fullsized":"2024-09-14T11:21:04.028564+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:37.766387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17619309,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":629,"num_read_kb":58875,"num_write":1138,"num_write_kb":34980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"260'909","reported_seq":2780,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.732830+0000","last_change":"2024-09-14T10:45:45.722332+0000","last_active":"2024-09-14T11:21:28.732830+0000","last_peered":"2024-09-14T11:21:28.732830+0000","last_clean":"2024-09-14T11:21:28.732830+0000","last_became_active":"2024-09-14T10:45:45.722048+0000","last_became_peered":"2024-09-14T10:45:45.722048+0000","last_unstale":"2024-09-14T11:21:28.732830+0000","last_undegraded":"2024-09-14T11:21:28.732830+0000","last_fullsized":"2024-09-14T11:21:28.732830+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":800,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:09.983695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4452,"num_read_kb":4058,"num_write":1175,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"260'296","reported_seq":930,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:14.812724+0000","last_change":"2024-09-14T10:45:43.690177+0000","last_active":"2024-09-14T11:21:14.812724+0000","last_peered":"2024-09-14T11:21:14.812724+0000","last_clean":"2024-09-14T11:21:14.812724+0000","last_became_active":"2024-09-14T10:45:43.689229+0000","last_became_peered":"2024-09-14T10:45:43.689229+0000","last_unstale":"2024-09-14T11:21:14.812724+0000","last_undegraded":"2024-09-14T11:21:14.812724+0000","last_fullsized":"2024-09-14T11:21:14.812724+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:41:27.105141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5709032,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":530,"num_read_kb":84854,"num_write":1084,"num_write_kb":20352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"260'522","reported_seq":2107,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:13.965056+0000","last_change":"2024-09-14T10:45:45.719274+0000","last_active":"2024-09-14T11:21:13.965056+0000","last_peered":"2024-09-14T11:21:13.965056+0000","last_clean":"2024-09-14T11:21:13.965056+0000","last_became_active":"2024-09-14T10:45:45.718978+0000","last_became_peered":"2024-09-14T10:45:45.718978+0000","last_unstale":"2024-09-14T11:21:13.965056+0000","last_undegraded":"2024-09-14T11:21:13.965056+0000","last_fullsized":"2024-09-14T11:21:13.965056+0000","mapping_epoch":26,"log_start":"260'500","ondisk_log_start":"260'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:26.609949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2761,"num_read_kb":2575,"num_write":634,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"260'330","reported_seq":960,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.138087+0000","last_change":"2024-09-14T10:45:43.687589+0000","last_active":"2024-09-14T11:22:51.138087+0000","last_peered":"2024-09-14T11:22:51.138087+0000","last_clean":"2024-09-14T11:22:51.138087+0000","last_became_active":"2024-09-14T10:45:43.687262+0000","last_became_peered":"2024-09-14T10:45:43.687262+0000","last_unstale":"2024-09-14T11:22:51.138087+0000","last_undegraded":"2024-09-14T11:22:51.138087+0000","last_fullsized":"2024-09-14T11:22:51.138087+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:56:05.018089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27309,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":673,"num_read_kb":42631,"num_write":1149,"num_write_kb":32664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"260'824","reported_seq":2512,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:15.867521+0000","last_change":"2024-09-14T10:45:45.721713+0000","last_active":"2024-09-14T11:21:15.867521+0000","last_peered":"2024-09-14T11:21:15.867521+0000","last_clean":"2024-09-14T11:21:15.867521+0000","last_became_active":"2024-09-14T10:45:45.721400+0000","last_became_peered":"2024-09-14T10:45:45.721400+0000","last_unstale":"2024-09-14T11:21:15.867521+0000","last_undegraded":"2024-09-14T11:21:15.867521+0000","last_fullsized":"2024-09-14T11:21:15.867521+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:10.944485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4476,"num_read_kb":4082,"num_write":1140,"num_write_kb":477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"260'1280","reported_seq":2915,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.732537+0000","last_change":"2024-09-14T10:45:45.710286+0000","last_active":"2024-09-14T11:21:28.732537+0000","last_peered":"2024-09-14T11:21:28.732537+0000","last_clean":"2024-09-14T11:21:28.732537+0000","last_became_active":"2024-09-14T10:45:45.710015+0000","last_became_peered":"2024-09-14T10:45:45.710015+0000","last_unstale":"2024-09-14T11:21:28.732537+0000","last_undegraded":"2024-09-14T11:21:28.732537+0000","last_fullsized":"2024-09-14T11:21:28.732537+0000","mapping_epoch":26,"log_start":"260'1200","ondisk_log_start":"260'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":1200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:23.780013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5907,"num_read_kb":5227,"num_write":1779,"num_write_kb":739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"260'291","reported_seq":892,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:58.073756+0000","last_change":"2024-09-14T10:45:43.678018+0000","last_active":"2024-09-14T11:20:58.073756+0000","last_peered":"2024-09-14T11:20:58.073756+0000","last_clean":"2024-09-14T11:20:58.073756+0000","last_became_active":"2024-09-14T10:45:43.677751+0000","last_became_peered":"2024-09-14T10:45:43.677751+0000","last_unstale":"2024-09-14T11:20:58.073756+0000","last_undegraded":"2024-09-14T11:20:58.073756+0000","last_fullsized":"2024-09-14T11:20:58.073756+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:31.249223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10836945,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":485,"num_read_kb":880,"num_write":1086,"num_write_kb":23836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"260'595","reported_seq":2269,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.326963+0000","last_change":"2024-09-14T10:45:45.714870+0000","last_active":"2024-09-14T11:21:28.326963+0000","last_peered":"2024-09-14T11:21:28.326963+0000","last_clean":"2024-09-14T11:21:28.326963+0000","last_became_active":"2024-09-14T10:45:45.714551+0000","last_became_peered":"2024-09-14T10:45:45.714551+0000","last_unstale":"2024-09-14T11:21:28.326963+0000","last_undegraded":"2024-09-14T11:21:28.326963+0000","last_fullsized":"2024-09-14T11:21:28.326963+0000","mapping_epoch":26,"log_start":"260'500","ondisk_log_start":"260'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":500,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:50.970272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3058,"num_read_kb":2815,"num_write":741,"num_write_kb":205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"260'267","reported_seq":894,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:02.226274+0000","last_change":"2024-09-14T10:45:43.680667+0000","last_active":"2024-09-14T11:22:02.226274+0000","last_peered":"2024-09-14T11:22:02.226274+0000","last_clean":"2024-09-14T11:22:02.226274+0000","last_became_active":"2024-09-14T10:45:43.680355+0000","last_became_peered":"2024-09-14T10:45:43.680355+0000","last_unstale":"2024-09-14T11:22:02.226274+0000","last_undegraded":"2024-09-14T11:22:02.226274+0000","last_fullsized":"2024-09-14T11:22:02.226274+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:57.516008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20278606,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":456,"num_read_kb":36293,"num_write":916,"num_write_kb":55095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"260'493","reported_seq":2162,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:10.106395+0000","last_change":"2024-09-14T10:45:45.721003+0000","last_active":"2024-09-14T11:21:10.106395+0000","last_peered":"2024-09-14T11:21:10.106395+0000","last_clean":"2024-09-14T11:21:10.106395+0000","last_became_active":"2024-09-14T10:45:45.720760+0000","last_became_peered":"2024-09-14T10:45:45.720760+0000","last_unstale":"2024-09-14T11:21:10.106395+0000","last_undegraded":"2024-09-14T11:21:10.106395+0000","last_fullsized":"2024-09-14T11:21:10.106395+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:01.564789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2631,"num_read_kb":2483,"num_write":574,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"260'315","reported_seq":990,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:10.458713+0000","last_change":"2024-09-14T10:45:43.684854+0000","last_active":"2024-09-14T11:21:10.458713+0000","last_peered":"2024-09-14T11:21:10.458713+0000","last_clean":"2024-09-14T11:21:10.458713+0000","last_became_active":"2024-09-14T10:45:43.684428+0000","last_became_peered":"2024-09-14T10:45:43.684428+0000","last_unstale":"2024-09-14T11:21:10.458713+0000","last_undegraded":"2024-09-14T11:21:10.458713+0000","last_fullsized":"2024-09-14T11:21:10.458713+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:19.142556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6726763,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":687,"num_read_kb":9043,"num_write":1153,"num_write_kb":18367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"260'482","reported_seq":2055,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:57.282685+0000","last_change":"2024-09-14T10:45:45.724646+0000","last_active":"2024-09-14T11:21:57.282685+0000","last_peered":"2024-09-14T11:21:57.282685+0000","last_clean":"2024-09-14T11:21:57.282685+0000","last_became_active":"2024-09-14T10:45:45.724302+0000","last_became_peered":"2024-09-14T10:45:45.724302+0000","last_unstale":"2024-09-14T11:21:57.282685+0000","last_undegraded":"2024-09-14T11:21:57.282685+0000","last_fullsized":"2024-09-14T11:21:57.282685+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:59.147972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2564,"num_read_kb":2400,"num_write":575,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"260'278","reported_seq":965,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:15.304782+0000","last_change":"2024-09-14T10:45:43.684077+0000","last_active":"2024-09-14T11:21:15.304782+0000","last_peered":"2024-09-14T11:21:15.304782+0000","last_clean":"2024-09-14T11:21:15.304782+0000","last_became_active":"2024-09-14T10:45:43.683797+0000","last_became_peered":"2024-09-14T10:45:43.683797+0000","last_unstale":"2024-09-14T11:21:15.304782+0000","last_undegraded":"2024-09-14T11:21:15.304782+0000","last_fullsized":"2024-09-14T11:21:15.304782+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:58.402146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5006161,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":659,"num_read_kb":8098,"num_write":1124,"num_write_kb":25345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"260'430","reported_seq":1966,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:57.282334+0000","last_change":"2024-09-14T10:45:45.723905+0000","last_active":"2024-09-14T11:21:57.282334+0000","last_peered":"2024-09-14T11:21:57.282334+0000","last_clean":"2024-09-14T11:21:57.282334+0000","last_became_active":"2024-09-14T10:45:45.723570+0000","last_became_peered":"2024-09-14T10:45:45.723570+0000","last_unstale":"2024-09-14T11:21:57.282334+0000","last_undegraded":"2024-09-14T11:21:57.282334+0000","last_fullsized":"2024-09-14T11:21:57.282334+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:29.680427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2400,"num_read_kb":2278,"num_write":489,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"260'416","reported_seq":1127,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.976345+0000","last_change":"2024-09-14T10:45:43.687914+0000","last_active":"2024-09-14T11:22:50.976345+0000","last_peered":"2024-09-14T11:22:50.976345+0000","last_clean":"2024-09-14T11:22:50.976345+0000","last_became_active":"2024-09-14T10:45:43.687585+0000","last_became_peered":"2024-09-14T10:45:43.687585+0000","last_unstale":"2024-09-14T11:22:50.976345+0000","last_undegraded":"2024-09-14T11:22:50.976345+0000","last_fullsized":"2024-09-14T11:22:50.976345+0000","mapping_epoch":23,"log_start":"260'400","ondisk_log_start":"260'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:00.103110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":649537,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":1117,"num_read_kb":1116,"num_write":1383,"num_write_kb":30799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"260'797","reported_seq":2444,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.833277+0000","last_change":"2024-09-14T10:45:45.714545+0000","last_active":"2024-09-14T11:22:42.833277+0000","last_peered":"2024-09-14T11:22:42.833277+0000","last_clean":"2024-09-14T11:22:42.833277+0000","last_became_active":"2024-09-14T10:45:45.714187+0000","last_became_peered":"2024-09-14T10:45:45.714187+0000","last_unstale":"2024-09-14T11:22:42.833277+0000","last_undegraded":"2024-09-14T11:22:42.833277+0000","last_fullsized":"2024-09-14T11:22:42.833277+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:45.790561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3909,"num_read_kb":3562,"num_write":1036,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"260'312","reported_seq":951,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.960383+0000","last_change":"2024-09-14T10:45:43.682640+0000","last_active":"2024-09-14T11:22:50.960383+0000","last_peered":"2024-09-14T11:22:50.960383+0000","last_clean":"2024-09-14T11:22:50.960383+0000","last_became_active":"2024-09-14T10:45:43.681680+0000","last_became_peered":"2024-09-14T10:45:43.681680+0000","last_unstale":"2024-09-14T11:22:50.960383+0000","last_undegraded":"2024-09-14T11:22:50.960383+0000","last_fullsized":"2024-09-14T11:22:50.960383+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:56.323253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7732508,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":539,"num_read_kb":80056,"num_write":1082,"num_write_kb":31213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"260'166","reported_seq":655,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.801186+0000","last_change":"2024-09-14T10:45:53.749801+0000","last_active":"2024-09-14T11:21:28.801186+0000","last_peered":"2024-09-14T11:21:28.801186+0000","last_clean":"2024-09-14T11:21:28.801186+0000","last_became_active":"2024-09-14T10:45:53.749495+0000","last_became_peered":"2024-09-14T10:45:53.749495+0000","last_unstale":"2024-09-14T11:21:28.801186+0000","last_undegraded":"2024-09-14T11:21:28.801186+0000","last_fullsized":"2024-09-14T11:21:28.801186+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:52.768692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":160,"num_read_kb":158,"num_write":391,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"260'882","reported_seq":2449,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.040798+0000","last_change":"2024-09-14T10:45:45.711094+0000","last_active":"2024-09-14T11:21:27.040798+0000","last_peered":"2024-09-14T11:21:27.040798+0000","last_clean":"2024-09-14T11:21:27.040798+0000","last_became_active":"2024-09-14T10:45:45.710830+0000","last_became_peered":"2024-09-14T10:45:45.710830+0000","last_unstale":"2024-09-14T11:21:27.040798+0000","last_undegraded":"2024-09-14T11:21:27.040798+0000","last_fullsized":"2024-09-14T11:21:27.040798+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":800,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:36:38.927707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5905,"num_read_kb":5530,"num_write":1368,"num_write_kb":537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"260'377","reported_seq":1052,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:09.499854+0000","last_change":"2024-09-14T10:45:43.684728+0000","last_active":"2024-09-14T11:21:09.499854+0000","last_peered":"2024-09-14T11:21:09.499854+0000","last_clean":"2024-09-14T11:21:09.499854+0000","last_became_active":"2024-09-14T10:45:43.684504+0000","last_became_peered":"2024-09-14T10:45:43.684504+0000","last_unstale":"2024-09-14T11:21:09.499854+0000","last_undegraded":"2024-09-14T11:21:09.499854+0000","last_fullsized":"2024-09-14T11:21:09.499854+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:34.311522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7237020,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":782,"num_read_kb":75776,"num_write":1362,"num_write_kb":37052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:37.113110+0000","last_change":"2024-09-14T10:45:47.730971+0000","last_active":"2024-09-14T11:19:37.113110+0000","last_peered":"2024-09-14T11:19:37.113110+0000","last_clean":"2024-09-14T11:19:37.113110+0000","last_became_active":"2024-09-14T10:45:47.730629+0000","last_became_peered":"2024-09-14T10:45:47.730629+0000","last_unstale":"2024-09-14T11:19:37.113110+0000","last_undegraded":"2024-09-14T11:19:37.113110+0000","last_fullsized":"2024-09-14T11:19:37.113110+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:32.300839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"260'333","reported_seq":920,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.380130+0000","last_change":"2024-09-14T10:45:49.734204+0000","last_active":"2024-09-14T11:22:50.380130+0000","last_peered":"2024-09-14T11:22:50.380130+0000","last_clean":"2024-09-14T11:22:50.380130+0000","last_became_active":"2024-09-14T10:45:49.733770+0000","last_became_peered":"2024-09-14T10:45:49.733770+0000","last_unstale":"2024-09-14T11:22:50.380130+0000","last_undegraded":"2024-09-14T11:22:50.380130+0000","last_fullsized":"2024-09-14T11:22:50.380130+0000","mapping_epoch":30,"log_start":"260'300","ondisk_log_start":"260'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:22:33.077712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49773,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":530,"num_read_kb":1113,"num_write":424,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":476,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:42.113693+0000","last_change":"2024-09-14T10:45:51.745748+0000","last_active":"2024-09-14T11:19:42.113693+0000","last_peered":"2024-09-14T11:19:42.113693+0000","last_clean":"2024-09-14T11:19:42.113693+0000","last_became_active":"2024-09-14T10:45:51.745410+0000","last_became_peered":"2024-09-14T10:45:51.745410+0000","last_unstale":"2024-09-14T11:19:42.113693+0000","last_undegraded":"2024-09-14T11:19:42.113693+0000","last_fullsized":"2024-09-14T11:19:42.113693+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:18.010792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"260'94","reported_seq":570,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:57.443244+0000","last_change":"2024-09-14T10:45:53.743811+0000","last_active":"2024-09-14T11:20:57.443244+0000","last_peered":"2024-09-14T11:20:57.443244+0000","last_clean":"2024-09-14T11:20:57.443244+0000","last_became_active":"2024-09-14T10:45:53.743472+0000","last_became_peered":"2024-09-14T10:45:53.743472+0000","last_unstale":"2024-09-14T11:20:57.443244+0000","last_undegraded":"2024-09-14T11:20:57.443244+0000","last_fullsized":"2024-09-14T11:20:57.443244+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:52.958224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":73,"num_read_kb":72,"num_write":215,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"260'380","reported_seq":1786,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.336678+0000","last_change":"2024-09-14T10:45:45.713778+0000","last_active":"2024-09-14T11:21:28.336678+0000","last_peered":"2024-09-14T11:21:28.336678+0000","last_clean":"2024-09-14T11:21:28.336678+0000","last_became_active":"2024-09-14T10:45:45.713502+0000","last_became_peered":"2024-09-14T10:45:45.713502+0000","last_unstale":"2024-09-14T11:21:28.336678+0000","last_undegraded":"2024-09-14T11:21:28.336678+0000","last_fullsized":"2024-09-14T11:21:28.336678+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:23.141736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2020,"num_read_kb":1909,"num_write":423,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"260'272","reported_seq":1001,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.965859+0000","last_change":"2024-09-14T10:45:43.684236+0000","last_active":"2024-09-14T11:22:50.965859+0000","last_peered":"2024-09-14T11:22:50.965859+0000","last_clean":"2024-09-14T11:22:50.965859+0000","last_became_active":"2024-09-14T10:45:43.683964+0000","last_became_peered":"2024-09-14T10:45:43.683964+0000","last_unstale":"2024-09-14T11:22:50.965859+0000","last_undegraded":"2024-09-14T11:22:50.965859+0000","last_fullsized":"2024-09-14T11:22:50.965859+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:17:40.024612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7426285,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":660,"num_read_kb":39643,"num_write":1046,"num_write_kb":23617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:36.108919+0000","last_change":"2024-09-14T10:45:47.730176+0000","last_active":"2024-09-14T11:18:36.108919+0000","last_peered":"2024-09-14T11:18:36.108919+0000","last_clean":"2024-09-14T11:18:36.108919+0000","last_became_active":"2024-09-14T10:45:47.729871+0000","last_became_peered":"2024-09-14T10:45:47.729871+0000","last_unstale":"2024-09-14T11:18:36.108919+0000","last_undegraded":"2024-09-14T11:18:36.108919+0000","last_fullsized":"2024-09-14T11:18:36.108919+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:34.557174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"260'84","reported_seq":592,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:16.298825+0000","last_change":"2024-09-14T10:45:49.733320+0000","last_active":"2024-09-14T11:21:16.298825+0000","last_peered":"2024-09-14T11:21:16.298825+0000","last_clean":"2024-09-14T11:21:16.298825+0000","last_became_active":"2024-09-14T10:45:49.732459+0000","last_became_peered":"2024-09-14T10:45:49.732459+0000","last_unstale":"2024-09-14T11:21:16.298825+0000","last_undegraded":"2024-09-14T11:21:16.298825+0000","last_fullsized":"2024-09-14T11:21:16.298825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:04.811455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":84,"num_read_kb":79,"num_write":56,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":476,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:42.113623+0000","last_change":"2024-09-14T10:45:51.746902+0000","last_active":"2024-09-14T11:19:42.113623+0000","last_peered":"2024-09-14T11:19:42.113623+0000","last_clean":"2024-09-14T11:19:42.113623+0000","last_became_active":"2024-09-14T10:45:51.746608+0000","last_became_peered":"2024-09-14T10:45:51.746608+0000","last_unstale":"2024-09-14T11:19:42.113623+0000","last_undegraded":"2024-09-14T11:19:42.113623+0000","last_fullsized":"2024-09-14T11:19:42.113623+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:13.144965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"260'127","reported_seq":616,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:14.680398+0000","last_change":"2024-09-14T10:45:53.752864+0000","last_active":"2024-09-14T11:21:14.680398+0000","last_peered":"2024-09-14T11:21:14.680398+0000","last_clean":"2024-09-14T11:21:14.680398+0000","last_became_active":"2024-09-14T10:45:53.752597+0000","last_became_peered":"2024-09-14T10:45:53.752597+0000","last_unstale":"2024-09-14T11:21:14.680398+0000","last_undegraded":"2024-09-14T11:21:14.680398+0000","last_fullsized":"2024-09-14T11:21:14.680398+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:09.921876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":152,"num_read_kb":142,"num_write":295,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"260'1282","reported_seq":2988,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:15.435417+0000","last_change":"2024-09-14T10:45:45.725999+0000","last_active":"2024-09-14T11:21:15.435417+0000","last_peered":"2024-09-14T11:21:15.435417+0000","last_clean":"2024-09-14T11:21:15.435417+0000","last_became_active":"2024-09-14T10:45:45.725335+0000","last_became_peered":"2024-09-14T10:45:45.725335+0000","last_unstale":"2024-09-14T11:21:15.435417+0000","last_undegraded":"2024-09-14T11:21:15.435417+0000","last_fullsized":"2024-09-14T11:21:15.435417+0000","mapping_epoch":26,"log_start":"260'1200","ondisk_log_start":"260'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":1200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:56:31.965780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5911,"num_read_kb":5224,"num_write":1759,"num_write_kb":730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"260'281","reported_seq":930,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:13.036893+0000","last_change":"2024-09-14T10:45:43.671411+0000","last_active":"2024-09-14T11:21:13.036893+0000","last_peered":"2024-09-14T11:21:13.036893+0000","last_clean":"2024-09-14T11:21:13.036893+0000","last_became_active":"2024-09-14T10:45:43.671096+0000","last_became_peered":"2024-09-14T10:45:43.671096+0000","last_unstale":"2024-09-14T11:21:13.036893+0000","last_undegraded":"2024-09-14T11:21:13.036893+0000","last_fullsized":"2024-09-14T11:21:13.036893+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:30.153850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11167161,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":615,"num_read_kb":57141,"num_write":1018,"num_write_kb":43933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:41.118430+0000","last_change":"2024-09-14T10:45:47.725982+0000","last_active":"2024-09-14T11:19:41.118430+0000","last_peered":"2024-09-14T11:19:41.118430+0000","last_clean":"2024-09-14T11:19:41.118430+0000","last_became_active":"2024-09-14T10:45:47.724723+0000","last_became_peered":"2024-09-14T10:45:47.724723+0000","last_unstale":"2024-09-14T11:19:41.118430+0000","last_undegraded":"2024-09-14T11:19:41.118430+0000","last_fullsized":"2024-09-14T11:19:41.118430+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:05.411328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"260'110","reported_seq":626,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:56.128174+0000","last_change":"2024-09-14T10:45:49.738230+0000","last_active":"2024-09-14T11:20:56.128174+0000","last_peered":"2024-09-14T11:20:56.128174+0000","last_clean":"2024-09-14T11:20:56.128174+0000","last_became_active":"2024-09-14T10:45:49.737651+0000","last_became_peered":"2024-09-14T10:45:49.737651+0000","last_unstale":"2024-09-14T11:20:56.128174+0000","last_undegraded":"2024-09-14T11:20:56.128174+0000","last_fullsized":"2024-09-14T11:20:56.128174+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:47.715854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":106,"num_write":82,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"260'803","reported_seq":4488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:43.741401+0000","last_change":"2024-09-14T10:45:51.746239+0000","last_active":"2024-09-14T11:22:43.741401+0000","last_peered":"2024-09-14T11:22:43.741401+0000","last_clean":"2024-09-14T11:22:43.741401+0000","last_became_active":"2024-09-14T10:45:51.745441+0000","last_became_peered":"2024-09-14T10:45:51.745441+0000","last_unstale":"2024-09-14T11:22:43.741401+0000","last_undegraded":"2024-09-14T11:22:43.741401+0000","last_fullsized":"2024-09-14T11:22:43.741401+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:37.532791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"260'211","reported_seq":1016,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.737613+0000","last_change":"2024-09-14T10:45:53.753718+0000","last_active":"2024-09-14T11:21:28.737613+0000","last_peered":"2024-09-14T11:21:28.737613+0000","last_clean":"2024-09-14T11:21:28.737613+0000","last_became_active":"2024-09-14T10:45:53.753389+0000","last_became_peered":"2024-09-14T10:45:53.753389+0000","last_unstale":"2024-09-14T11:21:28.737613+0000","last_undegraded":"2024-09-14T11:21:28.737613+0000","last_fullsized":"2024-09-14T11:21:28.737613+0000","mapping_epoch":34,"log_start":"260'200","ondisk_log_start":"260'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:01.726415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":623,"num_read_kb":614,"num_write":459,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"260'900","reported_seq":2535,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.336894+0000","last_change":"2024-09-14T10:45:45.726071+0000","last_active":"2024-09-14T11:21:28.336894+0000","last_peered":"2024-09-14T11:21:28.336894+0000","last_clean":"2024-09-14T11:21:28.336894+0000","last_became_active":"2024-09-14T10:45:45.725700+0000","last_became_peered":"2024-09-14T10:45:45.725700+0000","last_unstale":"2024-09-14T11:21:28.336894+0000","last_undegraded":"2024-09-14T11:21:28.336894+0000","last_fullsized":"2024-09-14T11:21:28.336894+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":800,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:18.814798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4396,"num_read_kb":3931,"num_write":1208,"num_write_kb":463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"260'314","reported_seq":953,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:43.904836+0000","last_change":"2024-09-14T10:45:43.683534+0000","last_active":"2024-09-14T11:20:43.904836+0000","last_peered":"2024-09-14T11:20:43.904836+0000","last_clean":"2024-09-14T11:20:43.904836+0000","last_became_active":"2024-09-14T10:45:43.683274+0000","last_became_peered":"2024-09-14T10:45:43.683274+0000","last_unstale":"2024-09-14T11:20:43.904836+0000","last_undegraded":"2024-09-14T11:20:43.904836+0000","last_fullsized":"2024-09-14T11:20:43.904836+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:02.033164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5574776,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":634,"num_read_kb":4530,"num_write":1072,"num_write_kb":39150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:37.113128+0000","last_change":"2024-09-14T10:45:47.729291+0000","last_active":"2024-09-14T11:19:37.113128+0000","last_peered":"2024-09-14T11:19:37.113128+0000","last_clean":"2024-09-14T11:19:37.113128+0000","last_became_active":"2024-09-14T10:45:47.729004+0000","last_became_peered":"2024-09-14T10:45:47.729004+0000","last_unstale":"2024-09-14T11:19:37.113128+0000","last_undegraded":"2024-09-14T11:19:37.113128+0000","last_fullsized":"2024-09-14T11:19:37.113128+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:50:40.551460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"260'252","reported_seq":791,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:05.007627+0000","last_change":"2024-09-14T10:45:49.729187+0000","last_active":"2024-09-14T11:22:05.007627+0000","last_peered":"2024-09-14T11:22:05.007627+0000","last_clean":"2024-09-14T11:22:05.007627+0000","last_became_active":"2024-09-14T10:45:49.728896+0000","last_became_peered":"2024-09-14T10:45:49.728896+0000","last_unstale":"2024-09-14T11:22:05.007627+0000","last_undegraded":"2024-09-14T11:22:05.007627+0000","last_fullsized":"2024-09-14T11:22:05.007627+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:09:59.076512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55057,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":431,"num_read_kb":926,"num_write":360,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"260'803","reported_seq":3875,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.304071+0000","last_change":"2024-09-14T10:45:51.745148+0000","last_active":"2024-09-14T11:22:50.304071+0000","last_peered":"2024-09-14T11:22:50.304071+0000","last_clean":"2024-09-14T11:22:50.304071+0000","last_became_active":"2024-09-14T10:45:51.744510+0000","last_became_peered":"2024-09-14T10:45:51.744510+0000","last_unstale":"2024-09-14T11:22:50.304071+0000","last_undegraded":"2024-09-14T11:22:50.304071+0000","last_fullsized":"2024-09-14T11:22:50.304071+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:37.874498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"260'638","reported_seq":2325,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.742160+0000","last_change":"2024-09-14T10:45:45.716820+0000","last_active":"2024-09-14T11:21:28.742160+0000","last_peered":"2024-09-14T11:21:28.742160+0000","last_clean":"2024-09-14T11:21:28.742160+0000","last_became_active":"2024-09-14T10:45:45.716537+0000","last_became_peered":"2024-09-14T10:45:45.716537+0000","last_unstale":"2024-09-14T11:21:28.742160+0000","last_undegraded":"2024-09-14T11:21:28.742160+0000","last_fullsized":"2024-09-14T11:21:28.742160+0000","mapping_epoch":26,"log_start":"260'600","ondisk_log_start":"260'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":600,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:58.190819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3192,"num_read_kb":2926,"num_write":775,"num_write_kb":229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"260'292","reported_seq":894,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.997857+0000","last_change":"2024-09-14T10:46:20.046168+0000","last_active":"2024-09-14T11:22:50.997857+0000","last_peered":"2024-09-14T11:22:50.997857+0000","last_clean":"2024-09-14T11:22:50.997857+0000","last_became_active":"2024-09-14T10:46:20.045945+0000","last_became_peered":"2024-09-14T10:46:20.045945+0000","last_unstale":"2024-09-14T11:22:50.997857+0000","last_undegraded":"2024-09-14T11:22:50.997857+0000","last_fullsized":"2024-09-14T11:22:50.997857+0000","mapping_epoch":37,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:32.371701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6293858,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":615,"num_read_kb":12757,"num_write":970,"num_write_kb":36887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":486,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:27.119742+0000","last_change":"2024-09-14T10:45:47.721721+0000","last_active":"2024-09-14T11:20:27.119742+0000","last_peered":"2024-09-14T11:20:27.119742+0000","last_clean":"2024-09-14T11:20:27.119742+0000","last_became_active":"2024-09-14T10:45:47.720639+0000","last_became_peered":"2024-09-14T10:45:47.720639+0000","last_unstale":"2024-09-14T11:20:27.119742+0000","last_undegraded":"2024-09-14T11:20:27.119742+0000","last_fullsized":"2024-09-14T11:20:27.119742+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:32.317587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"260'343","reported_seq":930,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.230665+0000","last_change":"2024-09-14T10:45:49.733109+0000","last_active":"2024-09-14T11:22:42.230665+0000","last_peered":"2024-09-14T11:22:42.230665+0000","last_clean":"2024-09-14T11:22:42.230665+0000","last_became_active":"2024-09-14T10:45:49.732754+0000","last_became_peered":"2024-09-14T10:45:49.732754+0000","last_unstale":"2024-09-14T11:22:42.230665+0000","last_undegraded":"2024-09-14T11:22:42.230665+0000","last_fullsized":"2024-09-14T11:22:42.230665+0000","mapping_epoch":30,"log_start":"260'300","ondisk_log_start":"260'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:34.312772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110456,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":559,"num_read_kb":1190,"num_write":454,"num_write_kb":374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":471,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:35.986676+0000","last_change":"2024-09-14T10:45:51.746554+0000","last_active":"2024-09-14T11:19:35.986676+0000","last_peered":"2024-09-14T11:19:35.986676+0000","last_clean":"2024-09-14T11:19:35.986676+0000","last_became_active":"2024-09-14T10:45:51.746282+0000","last_became_peered":"2024-09-14T10:45:51.746282+0000","last_unstale":"2024-09-14T11:19:35.986676+0000","last_undegraded":"2024-09-14T11:19:35.986676+0000","last_fullsized":"2024-09-14T11:19:35.986676+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:58.772084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"260'557","reported_seq":1354,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:43.728730+0000","last_change":"2024-09-14T10:45:53.756022+0000","last_active":"2024-09-14T11:22:43.728730+0000","last_peered":"2024-09-14T11:22:43.728730+0000","last_clean":"2024-09-14T11:22:43.728730+0000","last_became_active":"2024-09-14T10:45:53.755505+0000","last_became_peered":"2024-09-14T10:45:53.755505+0000","last_unstale":"2024-09-14T11:22:43.728730+0000","last_undegraded":"2024-09-14T11:22:43.728730+0000","last_fullsized":"2024-09-14T11:22:43.728730+0000","mapping_epoch":34,"log_start":"260'500","ondisk_log_start":"260'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:02.468804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1310,"num_read_kb":1299,"num_write":1164,"num_write_kb":395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"260'605","reported_seq":2241,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.048954+0000","last_change":"2024-09-14T10:45:45.727093+0000","last_active":"2024-09-14T11:21:27.048954+0000","last_peered":"2024-09-14T11:21:27.048954+0000","last_clean":"2024-09-14T11:21:27.048954+0000","last_became_active":"2024-09-14T10:45:45.726869+0000","last_became_peered":"2024-09-14T10:45:45.726869+0000","last_unstale":"2024-09-14T11:21:27.048954+0000","last_undegraded":"2024-09-14T11:21:27.048954+0000","last_fullsized":"2024-09-14T11:21:27.048954+0000","mapping_epoch":26,"log_start":"260'500","ondisk_log_start":"260'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":500,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:48.236280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3274,"num_read_kb":2999,"num_write":839,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"260'318","reported_seq":978,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:12.179037+0000","last_change":"2024-09-14T10:45:43.685334+0000","last_active":"2024-09-14T11:21:12.179037+0000","last_peered":"2024-09-14T11:21:12.179037+0000","last_clean":"2024-09-14T11:21:12.179037+0000","last_became_active":"2024-09-14T10:45:43.685087+0000","last_became_peered":"2024-09-14T10:45:43.685087+0000","last_unstale":"2024-09-14T11:21:12.179037+0000","last_undegraded":"2024-09-14T11:21:12.179037+0000","last_fullsized":"2024-09-14T11:21:12.179037+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:08.084059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1137367,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":670,"num_read_kb":49067,"num_write":1227,"num_write_kb":21177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":480,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:30.993267+0000","last_change":"2024-09-14T10:45:47.727776+0000","last_active":"2024-09-14T11:20:30.993267+0000","last_peered":"2024-09-14T11:20:30.993267+0000","last_clean":"2024-09-14T11:20:30.993267+0000","last_became_active":"2024-09-14T10:45:47.727250+0000","last_became_peered":"2024-09-14T10:45:47.727250+0000","last_unstale":"2024-09-14T11:20:30.993267+0000","last_undegraded":"2024-09-14T11:20:30.993267+0000","last_fullsized":"2024-09-14T11:20:30.993267+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:04.583303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"260'256","reported_seq":810,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.980108+0000","last_change":"2024-09-14T10:45:49.735628+0000","last_active":"2024-09-14T11:22:50.980108+0000","last_peered":"2024-09-14T11:22:50.980108+0000","last_clean":"2024-09-14T11:22:50.980108+0000","last_became_active":"2024-09-14T10:45:49.735124+0000","last_became_peered":"2024-09-14T10:45:49.735124+0000","last_unstale":"2024-09-14T11:22:50.980108+0000","last_undegraded":"2024-09-14T11:22:50.980108+0000","last_fullsized":"2024-09-14T11:22:50.980108+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:52.071424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45256,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":435,"num_read_kb":1035,"num_write":356,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:36.125222+0000","last_change":"2024-09-14T10:45:51.745912+0000","last_active":"2024-09-14T11:20:36.125222+0000","last_peered":"2024-09-14T11:20:36.125222+0000","last_clean":"2024-09-14T11:20:36.125222+0000","last_became_active":"2024-09-14T10:45:51.744757+0000","last_became_peered":"2024-09-14T10:45:51.744757+0000","last_unstale":"2024-09-14T11:20:36.125222+0000","last_undegraded":"2024-09-14T11:20:36.125222+0000","last_fullsized":"2024-09-14T11:20:36.125222+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:15.473173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"260'2449","reported_seq":4259,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:57.283800+0000","last_change":"2024-09-14T10:45:53.753015+0000","last_active":"2024-09-14T11:21:57.283800+0000","last_peered":"2024-09-14T11:21:57.283800+0000","last_clean":"2024-09-14T11:21:57.283800+0000","last_became_active":"2024-09-14T10:45:53.752708+0000","last_became_peered":"2024-09-14T10:45:53.752708+0000","last_unstale":"2024-09-14T11:21:57.283800+0000","last_undegraded":"2024-09-14T11:21:57.283800+0000","last_fullsized":"2024-09-14T11:21:57.283800+0000","mapping_epoch":34,"log_start":"260'2400","ondisk_log_start":"260'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":2400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:01:55.437550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6140,"num_read_kb":6145,"num_write":4932,"num_write_kb":1822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"260'757","reported_seq":2462,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.048715+0000","last_change":"2024-09-14T10:45:45.722496+0000","last_active":"2024-09-14T11:21:27.048715+0000","last_peered":"2024-09-14T11:21:27.048715+0000","last_clean":"2024-09-14T11:21:27.048715+0000","last_became_active":"2024-09-14T10:45:45.722006+0000","last_became_peered":"2024-09-14T10:45:45.722006+0000","last_unstale":"2024-09-14T11:21:27.048715+0000","last_undegraded":"2024-09-14T11:21:27.048715+0000","last_fullsized":"2024-09-14T11:21:27.048715+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:00.949810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4059,"num_read_kb":3717,"num_write":984,"num_write_kb":359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"260'303","reported_seq":941,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:26.619307+0000","last_change":"2024-09-14T10:45:43.676243+0000","last_active":"2024-09-14T11:21:26.619307+0000","last_peered":"2024-09-14T11:21:26.619307+0000","last_clean":"2024-09-14T11:21:26.619307+0000","last_became_active":"2024-09-14T10:45:43.675954+0000","last_became_peered":"2024-09-14T10:45:43.675954+0000","last_unstale":"2024-09-14T11:21:26.619307+0000","last_undegraded":"2024-09-14T11:21:26.619307+0000","last_fullsized":"2024-09-14T11:21:26.619307+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:56.905528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17559214,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":579,"num_read_kb":32892,"num_write":1070,"num_write_kb":70045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"36'5","reported_seq":958,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.270306+0000","last_change":"2024-09-14T10:45:47.723683+0000","last_active":"2024-09-14T11:22:50.270306+0000","last_peered":"2024-09-14T11:22:50.270306+0000","last_clean":"2024-09-14T11:22:50.270306+0000","last_became_active":"2024-09-14T10:45:47.723389+0000","last_became_peered":"2024-09-14T10:45:47.723389+0000","last_unstale":"2024-09-14T11:22:50.270306+0000","last_undegraded":"2024-09-14T11:22:50.270306+0000","last_fullsized":"2024-09-14T11:22:50.270306+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:23.601158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"260'267","reported_seq":823,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.015391+0000","last_change":"2024-09-14T10:45:49.729401+0000","last_active":"2024-09-14T11:22:42.015391+0000","last_peered":"2024-09-14T11:22:42.015391+0000","last_clean":"2024-09-14T11:22:42.015391+0000","last_became_active":"2024-09-14T10:45:49.729120+0000","last_became_peered":"2024-09-14T10:45:49.729120+0000","last_unstale":"2024-09-14T11:22:42.015391+0000","last_undegraded":"2024-09-14T11:22:42.015391+0000","last_fullsized":"2024-09-14T11:22:42.015391+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:30.995395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50035,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":431,"num_read_kb":873,"num_write":348,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"260'803","reported_seq":2503,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.305325+0000","last_change":"2024-09-14T10:45:51.745170+0000","last_active":"2024-09-14T11:22:50.305325+0000","last_peered":"2024-09-14T11:22:50.305325+0000","last_clean":"2024-09-14T11:22:50.305325+0000","last_became_active":"2024-09-14T10:45:51.744869+0000","last_became_peered":"2024-09-14T10:45:51.744869+0000","last_unstale":"2024-09-14T11:22:50.305325+0000","last_undegraded":"2024-09-14T11:22:50.305325+0000","last_fullsized":"2024-09-14T11:22:50.305325+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:26.188815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"260'164","reported_seq":638,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.837357+0000","last_change":"2024-09-14T10:45:53.755630+0000","last_active":"2024-09-14T11:22:42.837357+0000","last_peered":"2024-09-14T11:22:42.837357+0000","last_clean":"2024-09-14T11:22:42.837357+0000","last_became_active":"2024-09-14T10:45:53.755367+0000","last_became_peered":"2024-09-14T10:45:53.755367+0000","last_unstale":"2024-09-14T11:22:42.837357+0000","last_undegraded":"2024-09-14T11:22:42.837357+0000","last_fullsized":"2024-09-14T11:22:42.837357+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:07:14.533708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":815,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":135,"num_read_kb":134,"num_write":407,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"260'761","reported_seq":2252,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:15.867801+0000","last_change":"2024-09-14T10:45:45.720145+0000","last_active":"2024-09-14T11:21:15.867801+0000","last_peered":"2024-09-14T11:21:15.867801+0000","last_clean":"2024-09-14T11:21:15.867801+0000","last_became_active":"2024-09-14T10:45:45.719864+0000","last_became_peered":"2024-09-14T10:45:45.719864+0000","last_unstale":"2024-09-14T11:21:15.867801+0000","last_undegraded":"2024-09-14T11:21:15.867801+0000","last_fullsized":"2024-09-14T11:21:15.867801+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:09.038651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3610,"num_read_kb":3266,"num_write":990,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"260'283","reported_seq":908,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.279138+0000","last_change":"2024-09-14T10:45:43.681378+0000","last_active":"2024-09-14T11:22:42.279138+0000","last_peered":"2024-09-14T11:22:42.279138+0000","last_clean":"2024-09-14T11:22:42.279138+0000","last_became_active":"2024-09-14T10:45:43.681137+0000","last_became_peered":"2024-09-14T10:45:43.681137+0000","last_unstale":"2024-09-14T11:22:42.279138+0000","last_undegraded":"2024-09-14T11:22:42.279138+0000","last_fullsized":"2024-09-14T11:22:42.279138+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:46.118247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5577595,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":462,"num_read_kb":31157,"num_write":977,"num_write_kb":37353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":480,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:40.994524+0000","last_change":"2024-09-14T10:45:47.730225+0000","last_active":"2024-09-14T11:20:40.994524+0000","last_peered":"2024-09-14T11:20:40.994524+0000","last_clean":"2024-09-14T11:20:40.994524+0000","last_became_active":"2024-09-14T10:45:47.729815+0000","last_became_peered":"2024-09-14T10:45:47.729815+0000","last_unstale":"2024-09-14T11:20:40.994524+0000","last_undegraded":"2024-09-14T11:20:40.994524+0000","last_fullsized":"2024-09-14T11:20:40.994524+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:42.373217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"260'510","reported_seq":1126,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.091392+0000","last_change":"2024-09-14T10:45:49.736189+0000","last_active":"2024-09-14T11:22:51.091392+0000","last_peered":"2024-09-14T11:22:51.091392+0000","last_clean":"2024-09-14T11:22:51.091392+0000","last_became_active":"2024-09-14T10:45:49.735297+0000","last_became_peered":"2024-09-14T10:45:49.735297+0000","last_unstale":"2024-09-14T11:22:51.091392+0000","last_undegraded":"2024-09-14T11:22:51.091392+0000","last_fullsized":"2024-09-14T11:22:51.091392+0000","mapping_epoch":30,"log_start":"260'400","ondisk_log_start":"260'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:32.962766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93593,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":881,"num_read_kb":2160,"num_write":740,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":471,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:31.246681+0000","last_change":"2024-09-14T10:45:51.749364+0000","last_active":"2024-09-14T11:20:31.246681+0000","last_peered":"2024-09-14T11:20:31.246681+0000","last_clean":"2024-09-14T11:20:31.246681+0000","last_became_active":"2024-09-14T10:45:51.749045+0000","last_became_peered":"2024-09-14T10:45:51.749045+0000","last_unstale":"2024-09-14T11:20:31.246681+0000","last_undegraded":"2024-09-14T11:20:31.246681+0000","last_fullsized":"2024-09-14T11:20:31.246681+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:03.211664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"260'125","reported_seq":630,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:13.515424+0000","last_change":"2024-09-14T10:45:53.752016+0000","last_active":"2024-09-14T11:21:13.515424+0000","last_peered":"2024-09-14T11:21:13.515424+0000","last_clean":"2024-09-14T11:21:13.515424+0000","last_became_active":"2024-09-14T10:45:53.751736+0000","last_became_peered":"2024-09-14T10:45:53.751736+0000","last_unstale":"2024-09-14T11:21:13.515424+0000","last_undegraded":"2024-09-14T11:21:13.515424+0000","last_fullsized":"2024-09-14T11:21:13.515424+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:32.284762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":704,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":191,"num_read_kb":171,"num_write":290,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"260'1189","reported_seq":2739,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.835801+0000","last_change":"2024-09-14T10:45:45.714998+0000","last_active":"2024-09-14T11:22:42.835801+0000","last_peered":"2024-09-14T11:22:42.835801+0000","last_clean":"2024-09-14T11:22:42.835801+0000","last_became_active":"2024-09-14T10:45:45.714723+0000","last_became_peered":"2024-09-14T10:45:45.714723+0000","last_unstale":"2024-09-14T11:22:42.835801+0000","last_undegraded":"2024-09-14T11:22:42.835801+0000","last_fullsized":"2024-09-14T11:22:42.835801+0000","mapping_epoch":26,"log_start":"260'1100","ondisk_log_start":"260'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":1100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:09:48.211216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5470,"num_read_kb":4821,"num_write":1659,"num_write_kb":709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"260'332","reported_seq":955,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.894726+0000","last_change":"2024-09-14T10:45:43.686869+0000","last_active":"2024-09-14T11:22:50.894726+0000","last_peered":"2024-09-14T11:22:50.894726+0000","last_clean":"2024-09-14T11:22:50.894726+0000","last_became_active":"2024-09-14T10:45:43.686531+0000","last_became_peered":"2024-09-14T10:45:43.686531+0000","last_unstale":"2024-09-14T11:22:50.894726+0000","last_undegraded":"2024-09-14T11:22:50.894726+0000","last_fullsized":"2024-09-14T11:22:50.894726+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:55.909629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1173861,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":640,"num_read_kb":7607,"num_write":1231,"num_write_kb":48356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":481,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:35.993761+0000","last_change":"2024-09-14T10:45:47.728475+0000","last_active":"2024-09-14T11:19:35.993761+0000","last_peered":"2024-09-14T11:19:35.993761+0000","last_clean":"2024-09-14T11:19:35.993761+0000","last_became_active":"2024-09-14T10:45:47.728213+0000","last_became_peered":"2024-09-14T10:45:47.728213+0000","last_unstale":"2024-09-14T11:19:35.993761+0000","last_undegraded":"2024-09-14T11:19:35.993761+0000","last_fullsized":"2024-09-14T11:19:35.993761+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:31.424129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"260'259","reported_seq":812,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:52.131713+0000","last_change":"2024-09-14T10:45:49.733110+0000","last_active":"2024-09-14T11:21:52.131713+0000","last_peered":"2024-09-14T11:21:52.131713+0000","last_clean":"2024-09-14T11:21:52.131713+0000","last_became_active":"2024-09-14T10:45:49.732813+0000","last_became_peered":"2024-09-14T10:45:49.732813+0000","last_unstale":"2024-09-14T11:21:52.131713+0000","last_undegraded":"2024-09-14T11:21:52.131713+0000","last_fullsized":"2024-09-14T11:21:52.131713+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:14.432782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49817,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":422,"num_read_kb":832,"num_write":384,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":473,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:45.995350+0000","last_change":"2024-09-14T10:45:51.748689+0000","last_active":"2024-09-14T11:19:45.995350+0000","last_peered":"2024-09-14T11:19:45.995350+0000","last_clean":"2024-09-14T11:19:45.995350+0000","last_became_active":"2024-09-14T10:45:51.748381+0000","last_became_peered":"2024-09-14T10:45:51.748381+0000","last_unstale":"2024-09-14T11:19:45.995350+0000","last_undegraded":"2024-09-14T11:19:45.995350+0000","last_fullsized":"2024-09-14T11:19:45.995350+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:53.908296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"260'98","reported_seq":567,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:56.259131+0000","last_change":"2024-09-14T10:45:53.755248+0000","last_active":"2024-09-14T11:21:56.259131+0000","last_peered":"2024-09-14T11:21:56.259131+0000","last_clean":"2024-09-14T11:21:56.259131+0000","last_became_active":"2024-09-14T10:45:53.755022+0000","last_became_peered":"2024-09-14T10:45:53.755022+0000","last_unstale":"2024-09-14T11:21:56.259131+0000","last_undegraded":"2024-09-14T11:21:56.259131+0000","last_fullsized":"2024-09-14T11:21:56.259131+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:21.675722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":73,"num_read_kb":72,"num_write":223,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"260'435","reported_seq":1975,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.049003+0000","last_change":"2024-09-14T10:45:45.710662+0000","last_active":"2024-09-14T11:21:27.049003+0000","last_peered":"2024-09-14T11:21:27.049003+0000","last_clean":"2024-09-14T11:21:27.049003+0000","last_became_active":"2024-09-14T10:45:45.710367+0000","last_became_peered":"2024-09-14T10:45:45.710367+0000","last_unstale":"2024-09-14T11:21:27.049003+0000","last_undegraded":"2024-09-14T11:21:27.049003+0000","last_fullsized":"2024-09-14T11:21:27.049003+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:39:23.616400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2526,"num_read_kb":2387,"num_write":527,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"260'269","reported_seq":952,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:05.833584+0000","last_change":"2024-09-14T10:45:43.676790+0000","last_active":"2024-09-14T11:21:05.833584+0000","last_peered":"2024-09-14T11:21:05.833584+0000","last_clean":"2024-09-14T11:21:05.833584+0000","last_became_active":"2024-09-14T10:45:43.676514+0000","last_became_peered":"2024-09-14T10:45:43.676514+0000","last_unstale":"2024-09-14T11:21:05.833584+0000","last_undegraded":"2024-09-14T11:21:05.833584+0000","last_fullsized":"2024-09-14T11:21:05.833584+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:19.891010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12217243,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":591,"num_read_kb":125837,"num_write":1010,"num_write_kb":34909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:36.239100+0000","last_change":"2024-09-14T10:45:47.728092+0000","last_active":"2024-09-14T11:19:36.239100+0000","last_peered":"2024-09-14T11:19:36.239100+0000","last_clean":"2024-09-14T11:19:36.239100+0000","last_became_active":"2024-09-14T10:45:47.727632+0000","last_became_peered":"2024-09-14T10:45:47.727632+0000","last_unstale":"2024-09-14T11:19:36.239100+0000","last_undegraded":"2024-09-14T11:19:36.239100+0000","last_fullsized":"2024-09-14T11:19:36.239100+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:44.526326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"260'292","reported_seq":851,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.875892+0000","last_change":"2024-09-14T10:45:49.737975+0000","last_active":"2024-09-14T11:22:50.875892+0000","last_peered":"2024-09-14T11:22:50.875892+0000","last_clean":"2024-09-14T11:22:50.875892+0000","last_became_active":"2024-09-14T10:45:49.737690+0000","last_became_peered":"2024-09-14T10:45:49.737690+0000","last_unstale":"2024-09-14T11:22:50.875892+0000","last_undegraded":"2024-09-14T11:22:50.875892+0000","last_fullsized":"2024-09-14T11:22:50.875892+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:15.403726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69554,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":489,"num_read_kb":1163,"num_write":398,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"260'777","reported_seq":2019,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.300621+0000","last_change":"2024-09-14T10:45:51.749775+0000","last_active":"2024-09-14T11:22:50.300621+0000","last_peered":"2024-09-14T11:22:50.300621+0000","last_clean":"2024-09-14T11:22:50.300621+0000","last_became_active":"2024-09-14T10:45:51.749478+0000","last_became_peered":"2024-09-14T10:45:51.749478+0000","last_unstale":"2024-09-14T11:22:50.300621+0000","last_undegraded":"2024-09-14T11:22:50.300621+0000","last_fullsized":"2024-09-14T11:22:50.300621+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:13:43.438242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"260'128","reported_seq":609,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:13.969218+0000","last_change":"2024-09-14T10:45:53.746737+0000","last_active":"2024-09-14T11:21:13.969218+0000","last_peered":"2024-09-14T11:21:13.969218+0000","last_clean":"2024-09-14T11:21:13.969218+0000","last_became_active":"2024-09-14T10:45:53.746254+0000","last_became_peered":"2024-09-14T10:45:53.746254+0000","last_unstale":"2024-09-14T11:21:13.969218+0000","last_undegraded":"2024-09-14T11:21:13.969218+0000","last_fullsized":"2024-09-14T11:21:13.969218+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:28:26.210153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1445,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":145,"num_read_kb":134,"num_write":327,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"260'483","reported_seq":2054,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.840774+0000","last_change":"2024-09-14T10:45:45.720938+0000","last_active":"2024-09-14T11:22:42.840774+0000","last_peered":"2024-09-14T11:22:42.840774+0000","last_clean":"2024-09-14T11:22:42.840774+0000","last_became_active":"2024-09-14T10:45:45.720660+0000","last_became_peered":"2024-09-14T10:45:45.720660+0000","last_unstale":"2024-09-14T11:22:42.840774+0000","last_undegraded":"2024-09-14T11:22:42.840774+0000","last_fullsized":"2024-09-14T11:22:42.840774+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:36.468993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2593,"num_read_kb":2426,"num_write":578,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"260'263","reported_seq":871,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:26.811434+0000","last_change":"2024-09-14T10:45:43.690826+0000","last_active":"2024-09-14T11:21:26.811434+0000","last_peered":"2024-09-14T11:21:26.811434+0000","last_clean":"2024-09-14T11:21:26.811434+0000","last_became_active":"2024-09-14T10:45:43.690517+0000","last_became_peered":"2024-09-14T10:45:43.690517+0000","last_unstale":"2024-09-14T11:21:26.811434+0000","last_undegraded":"2024-09-14T11:21:26.811434+0000","last_fullsized":"2024-09-14T11:21:26.811434+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:17.734297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15106390,"num_objects":87,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":442,"num_read_kb":51926,"num_write":968,"num_write_kb":23808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1436,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:43.665589+0000","last_change":"2024-09-14T10:45:47.721307+0000","last_active":"2024-09-14T11:22:43.665589+0000","last_peered":"2024-09-14T11:22:43.665589+0000","last_clean":"2024-09-14T11:22:43.665589+0000","last_became_active":"2024-09-14T10:45:47.720716+0000","last_became_peered":"2024-09-14T10:45:47.720716+0000","last_unstale":"2024-09-14T11:22:43.665589+0000","last_undegraded":"2024-09-14T11:22:43.665589+0000","last_fullsized":"2024-09-14T11:22:43.665589+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:49.138193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":949,"num_read_kb":949,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"260'68","reported_seq":563,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:13.520750+0000","last_change":"2024-09-14T10:45:49.733374+0000","last_active":"2024-09-14T11:21:13.520750+0000","last_peered":"2024-09-14T11:21:13.520750+0000","last_clean":"2024-09-14T11:21:13.520750+0000","last_became_active":"2024-09-14T10:45:49.732913+0000","last_became_peered":"2024-09-14T10:45:49.732913+0000","last_unstale":"2024-09-14T11:21:13.520750+0000","last_undegraded":"2024-09-14T11:21:13.520750+0000","last_fullsized":"2024-09-14T11:21:13.520750+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:41.223364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":64,"num_read_kb":57,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"260'794","reported_seq":2411,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:43.919284+0000","last_change":"2024-09-14T10:45:51.741412+0000","last_active":"2024-09-14T11:22:43.919284+0000","last_peered":"2024-09-14T11:22:43.919284+0000","last_clean":"2024-09-14T11:22:43.919284+0000","last_became_active":"2024-09-14T10:45:51.741102+0000","last_became_peered":"2024-09-14T10:45:51.741102+0000","last_unstale":"2024-09-14T11:22:43.919284+0000","last_undegraded":"2024-09-14T11:22:43.919284+0000","last_fullsized":"2024-09-14T11:22:43.919284+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:08.256488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"260'150","reported_seq":656,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:13.516830+0000","last_change":"2024-09-14T10:45:53.752456+0000","last_active":"2024-09-14T11:21:13.516830+0000","last_peered":"2024-09-14T11:21:13.516830+0000","last_clean":"2024-09-14T11:21:13.516830+0000","last_became_active":"2024-09-14T10:45:53.752100+0000","last_became_peered":"2024-09-14T10:45:53.752100+0000","last_unstale":"2024-09-14T11:21:13.516830+0000","last_undegraded":"2024-09-14T11:21:13.516830+0000","last_fullsized":"2024-09-14T11:21:13.516830+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:44.647729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":861,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":268,"num_read_kb":228,"num_write":378,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"260'468","reported_seq":2069,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:16.297144+0000","last_change":"2024-09-14T10:45:45.719579+0000","last_active":"2024-09-14T11:21:16.297144+0000","last_peered":"2024-09-14T11:21:16.297144+0000","last_clean":"2024-09-14T11:21:16.297144+0000","last_became_active":"2024-09-14T10:45:45.719221+0000","last_became_peered":"2024-09-14T10:45:45.719221+0000","last_unstale":"2024-09-14T11:21:16.297144+0000","last_undegraded":"2024-09-14T11:21:16.297144+0000","last_fullsized":"2024-09-14T11:21:16.297144+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:24.645466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2509,"num_read_kb":2365,"num_write":566,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"260'302","reported_seq":904,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.099583+0000","last_change":"2024-09-14T10:45:43.690704+0000","last_active":"2024-09-14T11:22:51.099583+0000","last_peered":"2024-09-14T11:22:51.099583+0000","last_clean":"2024-09-14T11:22:51.099583+0000","last_became_active":"2024-09-14T10:45:43.690417+0000","last_became_peered":"2024-09-14T10:45:43.690417+0000","last_unstale":"2024-09-14T11:22:51.099583+0000","last_undegraded":"2024-09-14T11:22:51.099583+0000","last_fullsized":"2024-09-14T11:22:51.099583+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:28.703262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1309,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":484,"num_read_kb":28260,"num_write":948,"num_write_kb":36225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":479,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:32.112331+0000","last_change":"2024-09-14T10:45:47.731129+0000","last_active":"2024-09-14T11:19:32.112331+0000","last_peered":"2024-09-14T11:19:32.112331+0000","last_clean":"2024-09-14T11:19:32.112331+0000","last_became_active":"2024-09-14T10:45:47.730790+0000","last_became_peered":"2024-09-14T10:45:47.730790+0000","last_unstale":"2024-09-14T11:19:32.112331+0000","last_undegraded":"2024-09-14T11:19:32.112331+0000","last_fullsized":"2024-09-14T11:19:32.112331+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:38.545867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"260'319","reported_seq":900,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:52.131679+0000","last_change":"2024-09-14T10:45:49.735771+0000","last_active":"2024-09-14T11:21:52.131679+0000","last_peered":"2024-09-14T11:21:52.131679+0000","last_clean":"2024-09-14T11:21:52.131679+0000","last_became_active":"2024-09-14T10:45:49.735482+0000","last_became_peered":"2024-09-14T10:45:49.735482+0000","last_unstale":"2024-09-14T11:21:52.131679+0000","last_undegraded":"2024-09-14T11:21:52.131679+0000","last_fullsized":"2024-09-14T11:21:52.131679+0000","mapping_epoch":30,"log_start":"260'300","ondisk_log_start":"260'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:18:04.742025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56235,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":525,"num_read_kb":1022,"num_write":420,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":468,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:39.989653+0000","last_change":"2024-09-14T10:45:51.750926+0000","last_active":"2024-09-14T11:19:39.989653+0000","last_peered":"2024-09-14T11:19:39.989653+0000","last_clean":"2024-09-14T11:19:39.989653+0000","last_became_active":"2024-09-14T10:45:51.750669+0000","last_became_peered":"2024-09-14T10:45:51.750669+0000","last_unstale":"2024-09-14T11:19:39.989653+0000","last_undegraded":"2024-09-14T11:19:39.989653+0000","last_fullsized":"2024-09-14T11:19:39.989653+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:54.215538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"260'118","reported_seq":594,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.200888+0000","last_change":"2024-09-14T10:45:53.749127+0000","last_active":"2024-09-14T11:21:28.200888+0000","last_peered":"2024-09-14T11:21:28.200888+0000","last_clean":"2024-09-14T11:21:28.200888+0000","last_became_active":"2024-09-14T10:45:53.748865+0000","last_became_peered":"2024-09-14T10:45:53.748865+0000","last_unstale":"2024-09-14T11:21:28.200888+0000","last_undegraded":"2024-09-14T11:21:28.200888+0000","last_fullsized":"2024-09-14T11:21:28.200888+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:29.632424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":116,"num_write":279,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"260'612","reported_seq":2403,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.832394+0000","last_change":"2024-09-14T10:45:45.716546+0000","last_active":"2024-09-14T11:22:42.832394+0000","last_peered":"2024-09-14T11:22:42.832394+0000","last_clean":"2024-09-14T11:22:42.832394+0000","last_became_active":"2024-09-14T10:45:45.716236+0000","last_became_peered":"2024-09-14T10:45:45.716236+0000","last_unstale":"2024-09-14T11:22:42.832394+0000","last_undegraded":"2024-09-14T11:22:42.832394+0000","last_fullsized":"2024-09-14T11:22:42.832394+0000","mapping_epoch":26,"log_start":"260'600","ondisk_log_start":"260'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":600,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:59:19.965279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3315,"num_read_kb":3084,"num_write":730,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":601,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:37.112513+0000","last_change":"2024-09-14T10:45:28.986498+0000","last_active":"2024-09-14T11:19:37.112513+0000","last_peered":"2024-09-14T11:19:37.112513+0000","last_clean":"2024-09-14T11:19:37.112513+0000","last_became_active":"2024-09-14T10:45:28.985499+0000","last_became_peered":"2024-09-14T10:45:28.985499+0000","last_unstale":"2024-09-14T11:19:37.112513+0000","last_undegraded":"2024-09-14T11:19:37.112513+0000","last_fullsized":"2024-09-14T11:19:37.112513+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:27.525313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:27.525313+0000","last_clean_scrub_stamp":"2024-09-14T10:45:27.525313+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:42:06.434476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":504,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:57.106903+0000","last_change":"2024-09-14T10:45:35.579820+0000","last_active":"2024-09-14T11:18:57.106903+0000","last_peered":"2024-09-14T11:18:57.106903+0000","last_clean":"2024-09-14T11:18:57.106903+0000","last_became_active":"2024-09-14T10:45:33.610592+0000","last_became_peered":"2024-09-14T10:45:33.610592+0000","last_unstale":"2024-09-14T11:18:57.106903+0000","last_undegraded":"2024-09-14T11:18:57.106903+0000","last_fullsized":"2024-09-14T11:18:57.106903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_clean_scrub_stamp":"2024-09-14T10:45:32.551765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:46:36.542821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043055799999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"260'260","reported_seq":899,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.113170+0000","last_change":"2024-09-14T10:45:43.690581+0000","last_active":"2024-09-14T11:22:51.113170+0000","last_peered":"2024-09-14T11:22:51.113170+0000","last_clean":"2024-09-14T11:22:51.113170+0000","last_became_active":"2024-09-14T10:45:43.690248+0000","last_became_peered":"2024-09-14T10:45:43.690248+0000","last_unstale":"2024-09-14T11:22:51.113170+0000","last_undegraded":"2024-09-14T11:22:51.113170+0000","last_fullsized":"2024-09-14T11:22:51.113170+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:27.312124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243097,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":533,"num_read_kb":56771,"num_write":932,"num_write_kb":24880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:07.204339+0000","last_change":"2024-09-14T10:45:47.723764+0000","last_active":"2024-09-14T11:19:07.204339+0000","last_peered":"2024-09-14T11:19:07.204339+0000","last_clean":"2024-09-14T11:19:07.204339+0000","last_became_active":"2024-09-14T10:45:47.723495+0000","last_became_peered":"2024-09-14T10:45:47.723495+0000","last_unstale":"2024-09-14T11:19:07.204339+0000","last_undegraded":"2024-09-14T11:19:07.204339+0000","last_fullsized":"2024-09-14T11:19:07.204339+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:28.951657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"260'728","reported_seq":1396,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:43.715128+0000","last_change":"2024-09-14T10:45:49.734638+0000","last_active":"2024-09-14T11:22:43.715128+0000","last_peered":"2024-09-14T11:22:43.715128+0000","last_clean":"2024-09-14T11:22:43.715128+0000","last_became_active":"2024-09-14T10:45:49.733774+0000","last_became_peered":"2024-09-14T10:45:49.733774+0000","last_unstale":"2024-09-14T11:22:43.715128+0000","last_undegraded":"2024-09-14T11:22:43.715128+0000","last_fullsized":"2024-09-14T11:22:43.715128+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":700,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:45.811248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":193368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1440,"num_read_kb":3082,"num_write":1348,"num_write_kb":1217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":471,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:31.246761+0000","last_change":"2024-09-14T10:45:51.745875+0000","last_active":"2024-09-14T11:20:31.246761+0000","last_peered":"2024-09-14T11:20:31.246761+0000","last_clean":"2024-09-14T11:20:31.246761+0000","last_became_active":"2024-09-14T10:45:51.745607+0000","last_became_peered":"2024-09-14T10:45:51.745607+0000","last_unstale":"2024-09-14T11:20:31.246761+0000","last_undegraded":"2024-09-14T11:20:31.246761+0000","last_fullsized":"2024-09-14T11:20:31.246761+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:12.059394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"260'234","reported_seq":922,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.747723+0000","last_change":"2024-09-14T10:45:53.751918+0000","last_active":"2024-09-14T11:21:28.747723+0000","last_peered":"2024-09-14T11:21:28.747723+0000","last_clean":"2024-09-14T11:21:28.747723+0000","last_became_active":"2024-09-14T10:45:53.751651+0000","last_became_peered":"2024-09-14T10:45:53.751651+0000","last_unstale":"2024-09-14T11:21:28.747723+0000","last_undegraded":"2024-09-14T11:21:28.747723+0000","last_fullsized":"2024-09-14T11:21:28.747723+0000","mapping_epoch":34,"log_start":"260'200","ondisk_log_start":"260'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:07.313069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":417,"num_read_kb":415,"num_write":468,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"260'500","reported_seq":2079,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:16.297332+0000","last_change":"2024-09-14T10:45:45.721927+0000","last_active":"2024-09-14T11:21:16.297332+0000","last_peered":"2024-09-14T11:21:16.297332+0000","last_clean":"2024-09-14T11:21:16.297332+0000","last_became_active":"2024-09-14T10:45:45.721633+0000","last_became_peered":"2024-09-14T10:45:45.721633+0000","last_unstale":"2024-09-14T11:21:16.297332+0000","last_undegraded":"2024-09-14T11:21:16.297332+0000","last_fullsized":"2024-09-14T11:21:16.297332+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:23.991533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2741,"num_read_kb":2557,"num_write":632,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":504,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:42.113836+0000","last_change":"2024-09-14T10:45:35.580149+0000","last_active":"2024-09-14T11:19:42.113836+0000","last_peered":"2024-09-14T11:19:42.113836+0000","last_clean":"2024-09-14T11:19:42.113836+0000","last_became_active":"2024-09-14T10:45:33.569860+0000","last_became_peered":"2024-09-14T10:45:33.569860+0000","last_unstale":"2024-09-14T11:19:42.113836+0000","last_undegraded":"2024-09-14T11:19:42.113836+0000","last_fullsized":"2024-09-14T11:19:42.113836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_clean_scrub_stamp":"2024-09-14T10:45:32.551765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:19.845227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074400599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"260'308","reported_seq":937,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.000002+0000","last_change":"2024-09-14T10:45:43.680588+0000","last_active":"2024-09-14T11:22:51.000002+0000","last_peered":"2024-09-14T11:22:51.000002+0000","last_clean":"2024-09-14T11:22:51.000002+0000","last_became_active":"2024-09-14T10:45:43.680290+0000","last_became_peered":"2024-09-14T10:45:43.680290+0000","last_unstale":"2024-09-14T11:22:51.000002+0000","last_undegraded":"2024-09-14T11:22:51.000002+0000","last_fullsized":"2024-09-14T11:22:51.000002+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:14.859096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243200,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":626,"num_read_kb":19207,"num_write":1075,"num_write_kb":41133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":480,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:27.120185+0000","last_change":"2024-09-14T10:45:47.728037+0000","last_active":"2024-09-14T11:20:27.120185+0000","last_peered":"2024-09-14T11:20:27.120185+0000","last_clean":"2024-09-14T11:20:27.120185+0000","last_became_active":"2024-09-14T10:45:47.727733+0000","last_became_peered":"2024-09-14T10:45:47.727733+0000","last_unstale":"2024-09-14T11:20:27.120185+0000","last_undegraded":"2024-09-14T11:20:27.120185+0000","last_fullsized":"2024-09-14T11:20:27.120185+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:08.238626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"260'1243","reported_seq":2601,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.016458+0000","last_change":"2024-09-14T10:45:49.731992+0000","last_active":"2024-09-14T11:22:51.016458+0000","last_peered":"2024-09-14T11:22:51.016458+0000","last_clean":"2024-09-14T11:22:51.016458+0000","last_became_active":"2024-09-14T10:45:49.731646+0000","last_became_peered":"2024-09-14T10:45:49.731646+0000","last_unstale":"2024-09-14T11:22:51.016458+0000","last_undegraded":"2024-09-14T11:22:51.016458+0000","last_fullsized":"2024-09-14T11:22:51.016458+0000","mapping_epoch":30,"log_start":"260'1200","ondisk_log_start":"260'1200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":1200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:40.965323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145081,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1971,"num_read_kb":3649,"num_write":1068,"num_write_kb":919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":472,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:17.109984+0000","last_change":"2024-09-14T10:45:51.745733+0000","last_active":"2024-09-14T11:19:17.109984+0000","last_peered":"2024-09-14T11:19:17.109984+0000","last_clean":"2024-09-14T11:19:17.109984+0000","last_became_active":"2024-09-14T10:45:51.745481+0000","last_became_peered":"2024-09-14T10:45:51.745481+0000","last_unstale":"2024-09-14T11:19:17.109984+0000","last_undegraded":"2024-09-14T11:19:17.109984+0000","last_fullsized":"2024-09-14T11:19:17.109984+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:11.216344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"260'292","reported_seq":816,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:43.730260+0000","last_change":"2024-09-14T10:45:53.750529+0000","last_active":"2024-09-14T11:22:43.730260+0000","last_peered":"2024-09-14T11:22:43.730260+0000","last_clean":"2024-09-14T11:22:43.730260+0000","last_became_active":"2024-09-14T10:45:53.750227+0000","last_became_peered":"2024-09-14T10:45:53.750227+0000","last_unstale":"2024-09-14T11:22:43.730260+0000","last_undegraded":"2024-09-14T11:22:43.730260+0000","last_fullsized":"2024-09-14T11:22:43.730260+0000","mapping_epoch":34,"log_start":"260'200","ondisk_log_start":"260'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:38.646551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":463,"num_read_kb":436,"num_write":609,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"260'355","reported_seq":1868,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:11.223921+0000","last_change":"2024-09-14T10:45:45.715226+0000","last_active":"2024-09-14T11:21:11.223921+0000","last_peered":"2024-09-14T11:21:11.223921+0000","last_clean":"2024-09-14T11:21:11.223921+0000","last_became_active":"2024-09-14T10:45:45.714923+0000","last_became_peered":"2024-09-14T10:45:45.714923+0000","last_unstale":"2024-09-14T11:21:11.223921+0000","last_undegraded":"2024-09-14T11:21:11.223921+0000","last_fullsized":"2024-09-14T11:21:11.223921+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:07.817788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2079,"num_read_kb":2005,"num_write":398,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":504,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:55.987569+0000","last_change":"2024-09-14T10:45:36.078832+0000","last_active":"2024-09-14T11:18:55.987569+0000","last_peered":"2024-09-14T11:18:55.987569+0000","last_clean":"2024-09-14T11:18:55.987569+0000","last_became_active":"2024-09-14T10:45:33.569944+0000","last_became_peered":"2024-09-14T10:45:33.569944+0000","last_unstale":"2024-09-14T11:18:55.987569+0000","last_undegraded":"2024-09-14T11:18:55.987569+0000","last_fullsized":"2024-09-14T11:18:55.987569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_clean_scrub_stamp":"2024-09-14T10:45:32.551765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:29.610279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055355599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"260'327","reported_seq":1018,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.075598+0000","last_change":"2024-09-14T10:45:43.684278+0000","last_active":"2024-09-14T11:22:51.075598+0000","last_peered":"2024-09-14T11:22:51.075598+0000","last_clean":"2024-09-14T11:22:51.075598+0000","last_became_active":"2024-09-14T10:45:43.682920+0000","last_became_peered":"2024-09-14T10:45:43.682920+0000","last_unstale":"2024-09-14T11:22:51.075598+0000","last_undegraded":"2024-09-14T11:22:51.075598+0000","last_fullsized":"2024-09-14T11:22:51.075598+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:53.359950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1134086,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":791,"num_read_kb":18154,"num_write":1040,"num_write_kb":35009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":483,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:31.000785+0000","last_change":"2024-09-14T10:45:47.729348+0000","last_active":"2024-09-14T11:20:31.000785+0000","last_peered":"2024-09-14T11:20:31.000785+0000","last_clean":"2024-09-14T11:20:31.000785+0000","last_became_active":"2024-09-14T10:45:47.729061+0000","last_became_peered":"2024-09-14T10:45:47.729061+0000","last_unstale":"2024-09-14T11:20:31.000785+0000","last_undegraded":"2024-09-14T11:20:31.000785+0000","last_fullsized":"2024-09-14T11:20:31.000785+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:40.239555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"260'240","reported_seq":1217,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.211666+0000","last_change":"2024-09-14T10:45:49.732283+0000","last_active":"2024-09-14T11:22:42.211666+0000","last_peered":"2024-09-14T11:22:42.211666+0000","last_clean":"2024-09-14T11:22:42.211666+0000","last_became_active":"2024-09-14T10:45:49.731858+0000","last_became_peered":"2024-09-14T10:45:49.731858+0000","last_unstale":"2024-09-14T11:22:42.211666+0000","last_undegraded":"2024-09-14T11:22:42.211666+0000","last_fullsized":"2024-09-14T11:22:42.211666+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:59.698290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":156,"num_read_kb":145,"num_write":121,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:11.113947+0000","last_change":"2024-09-14T10:45:51.743386+0000","last_active":"2024-09-14T11:19:11.113947+0000","last_peered":"2024-09-14T11:19:11.113947+0000","last_clean":"2024-09-14T11:19:11.113947+0000","last_became_active":"2024-09-14T10:45:51.742651+0000","last_became_peered":"2024-09-14T10:45:51.742651+0000","last_unstale":"2024-09-14T11:19:11.113947+0000","last_undegraded":"2024-09-14T11:19:11.113947+0000","last_fullsized":"2024-09-14T11:19:11.113947+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:56.398753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"260'239","reported_seq":825,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.890931+0000","last_change":"2024-09-14T10:45:53.745667+0000","last_active":"2024-09-14T11:21:28.890931+0000","last_peered":"2024-09-14T11:21:28.890931+0000","last_clean":"2024-09-14T11:21:28.890931+0000","last_became_active":"2024-09-14T10:45:53.744823+0000","last_became_peered":"2024-09-14T10:45:53.744823+0000","last_unstale":"2024-09-14T11:21:28.890931+0000","last_undegraded":"2024-09-14T11:21:28.890931+0000","last_fullsized":"2024-09-14T11:21:28.890931+0000","mapping_epoch":34,"log_start":"260'200","ondisk_log_start":"260'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:01:08.099600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":471,"num_read_kb":497,"num_write":522,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"260'743","reported_seq":2245,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.833846+0000","last_change":"2024-09-14T10:45:45.714387+0000","last_active":"2024-09-14T11:22:42.833846+0000","last_peered":"2024-09-14T11:22:42.833846+0000","last_clean":"2024-09-14T11:22:42.833846+0000","last_became_active":"2024-09-14T10:45:45.714077+0000","last_became_peered":"2024-09-14T10:45:45.714077+0000","last_unstale":"2024-09-14T11:22:42.833846+0000","last_undegraded":"2024-09-14T11:22:42.833846+0000","last_fullsized":"2024-09-14T11:22:42.833846+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":700,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:32:40.285715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3745,"num_read_kb":3391,"num_write":988,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":505,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:57.106867+0000","last_change":"2024-09-14T10:45:35.580322+0000","last_active":"2024-09-14T11:18:57.106867+0000","last_peered":"2024-09-14T11:18:57.106867+0000","last_clean":"2024-09-14T11:18:57.106867+0000","last_became_active":"2024-09-14T10:45:33.612919+0000","last_became_peered":"2024-09-14T10:45:33.612919+0000","last_unstale":"2024-09-14T11:18:57.106867+0000","last_undegraded":"2024-09-14T11:18:57.106867+0000","last_fullsized":"2024-09-14T11:18:57.106867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_clean_scrub_stamp":"2024-09-14T10:45:32.551765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:57.073763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094497699999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"260'276","reported_seq":1144,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:59.526090+0000","last_change":"2024-09-14T10:45:43.679805+0000","last_active":"2024-09-14T11:20:59.526090+0000","last_peered":"2024-09-14T11:20:59.526090+0000","last_clean":"2024-09-14T11:20:59.526090+0000","last_became_active":"2024-09-14T10:45:43.679522+0000","last_became_peered":"2024-09-14T10:45:43.679522+0000","last_unstale":"2024-09-14T11:20:59.526090+0000","last_undegraded":"2024-09-14T11:20:59.526090+0000","last_fullsized":"2024-09-14T11:20:59.526090+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:59.700293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9462467,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":1303,"num_read_kb":12976,"num_write":1115,"num_write_kb":34630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"36'3","reported_seq":962,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.271527+0000","last_change":"2024-09-14T10:45:47.727327+0000","last_active":"2024-09-14T11:22:50.271527+0000","last_peered":"2024-09-14T11:22:50.271527+0000","last_clean":"2024-09-14T11:22:50.271527+0000","last_became_active":"2024-09-14T10:45:47.727050+0000","last_became_peered":"2024-09-14T10:45:47.727050+0000","last_unstale":"2024-09-14T11:22:50.271527+0000","last_undegraded":"2024-09-14T11:22:50.271527+0000","last_fullsized":"2024-09-14T11:22:50.271527+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:11.560613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"260'102","reported_seq":617,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:41.139054+0000","last_change":"2024-09-14T10:45:49.734492+0000","last_active":"2024-09-14T11:22:41.139054+0000","last_peered":"2024-09-14T11:22:41.139054+0000","last_clean":"2024-09-14T11:22:41.139054+0000","last_became_active":"2024-09-14T10:45:49.734181+0000","last_became_peered":"2024-09-14T10:45:49.734181+0000","last_unstale":"2024-09-14T11:22:41.139054+0000","last_undegraded":"2024-09-14T11:22:41.139054+0000","last_fullsized":"2024-09-14T11:22:41.139054+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:39.185773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":121,"num_read_kb":115,"num_write":86,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":472,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:32.120940+0000","last_change":"2024-09-14T10:45:51.744573+0000","last_active":"2024-09-14T11:20:32.120940+0000","last_peered":"2024-09-14T11:20:32.120940+0000","last_clean":"2024-09-14T11:20:32.120940+0000","last_became_active":"2024-09-14T10:45:51.744280+0000","last_became_peered":"2024-09-14T10:45:51.744280+0000","last_unstale":"2024-09-14T11:20:32.120940+0000","last_undegraded":"2024-09-14T11:20:32.120940+0000","last_fullsized":"2024-09-14T11:20:32.120940+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:36.528487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"260'117","reported_seq":649,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.997667+0000","last_change":"2024-09-14T10:45:53.746846+0000","last_active":"2024-09-14T11:21:27.997667+0000","last_peered":"2024-09-14T11:21:27.997667+0000","last_clean":"2024-09-14T11:21:27.997667+0000","last_became_active":"2024-09-14T10:45:53.746484+0000","last_became_peered":"2024-09-14T10:45:53.746484+0000","last_unstale":"2024-09-14T11:21:27.997667+0000","last_undegraded":"2024-09-14T11:21:27.997667+0000","last_fullsized":"2024-09-14T11:21:27.997667+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:31.055773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":202,"num_write":278,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"260'1196","reported_seq":2897,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:11.223775+0000","last_change":"2024-09-14T10:45:45.713700+0000","last_active":"2024-09-14T11:21:11.223775+0000","last_peered":"2024-09-14T11:21:11.223775+0000","last_clean":"2024-09-14T11:21:11.223775+0000","last_became_active":"2024-09-14T10:45:45.713440+0000","last_became_peered":"2024-09-14T10:45:45.713440+0000","last_unstale":"2024-09-14T11:21:11.223775+0000","last_undegraded":"2024-09-14T11:21:11.223775+0000","last_fullsized":"2024-09-14T11:21:11.223775+0000","mapping_epoch":26,"log_start":"260'1100","ondisk_log_start":"260'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":1100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:13.974610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5652,"num_read_kb":5051,"num_write":1624,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"260'298","reported_seq":985,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:26.616258+0000","last_change":"2024-09-14T10:45:43.683066+0000","last_active":"2024-09-14T11:21:26.616258+0000","last_peered":"2024-09-14T11:21:26.616258+0000","last_clean":"2024-09-14T11:21:26.616258+0000","last_became_active":"2024-09-14T10:45:43.682711+0000","last_became_peered":"2024-09-14T10:45:43.682711+0000","last_unstale":"2024-09-14T11:21:26.616258+0000","last_undegraded":"2024-09-14T11:21:26.616258+0000","last_fullsized":"2024-09-14T11:21:26.616258+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:13:32.400241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12958652,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":782,"num_read_kb":26785,"num_write":1115,"num_write_kb":27965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":502,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:56.232945+0000","last_change":"2024-09-14T10:45:36.078834+0000","last_active":"2024-09-14T11:18:56.232945+0000","last_peered":"2024-09-14T11:18:56.232945+0000","last_clean":"2024-09-14T11:18:56.232945+0000","last_became_active":"2024-09-14T10:45:33.612983+0000","last_became_peered":"2024-09-14T10:45:33.612983+0000","last_unstale":"2024-09-14T11:18:56.232945+0000","last_undegraded":"2024-09-14T11:18:56.232945+0000","last_fullsized":"2024-09-14T11:18:56.232945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_clean_scrub_stamp":"2024-09-14T10:45:32.551765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:00.753079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053773700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":486,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:11.113928+0000","last_change":"2024-09-14T10:45:47.724950+0000","last_active":"2024-09-14T11:19:11.113928+0000","last_peered":"2024-09-14T11:19:11.113928+0000","last_clean":"2024-09-14T11:19:11.113928+0000","last_became_active":"2024-09-14T10:45:47.724317+0000","last_became_peered":"2024-09-14T10:45:47.724317+0000","last_unstale":"2024-09-14T11:19:11.113928+0000","last_undegraded":"2024-09-14T11:19:11.113928+0000","last_fullsized":"2024-09-14T11:19:11.113928+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:13.067923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"260'544","reported_seq":1180,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.839460+0000","last_change":"2024-09-14T10:45:49.736006+0000","last_active":"2024-09-14T11:22:50.839460+0000","last_peered":"2024-09-14T11:22:50.839460+0000","last_clean":"2024-09-14T11:22:50.839460+0000","last_became_active":"2024-09-14T10:45:49.735662+0000","last_became_peered":"2024-09-14T10:45:49.735662+0000","last_unstale":"2024-09-14T11:22:50.839460+0000","last_undegraded":"2024-09-14T11:22:50.839460+0000","last_fullsized":"2024-09-14T11:22:50.839460+0000","mapping_epoch":30,"log_start":"260'500","ondisk_log_start":"260'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:34.690835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108030,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1548,"num_read_kb":2637,"num_write":2014,"num_write_kb":1867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":469,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:14.986059+0000","last_change":"2024-09-14T10:45:51.749756+0000","last_active":"2024-09-14T11:19:14.986059+0000","last_peered":"2024-09-14T11:19:14.986059+0000","last_clean":"2024-09-14T11:19:14.986059+0000","last_became_active":"2024-09-14T10:45:51.749478+0000","last_became_peered":"2024-09-14T10:45:51.749478+0000","last_unstale":"2024-09-14T11:19:14.986059+0000","last_undegraded":"2024-09-14T11:19:14.986059+0000","last_fullsized":"2024-09-14T11:19:14.986059+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:19.448821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"260'118","reported_seq":604,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:16.644526+0000","last_change":"2024-09-14T10:45:53.749875+0000","last_active":"2024-09-14T11:21:16.644526+0000","last_peered":"2024-09-14T11:21:16.644526+0000","last_clean":"2024-09-14T11:21:16.644526+0000","last_became_active":"2024-09-14T10:45:53.749578+0000","last_became_peered":"2024-09-14T10:45:53.749578+0000","last_unstale":"2024-09-14T11:21:16.644526+0000","last_undegraded":"2024-09-14T11:21:16.644526+0000","last_fullsized":"2024-09-14T11:21:16.644526+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:40.919662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":913,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":137,"num_read_kb":126,"num_write":281,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"260'861","reported_seq":2555,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.049805+0000","last_change":"2024-09-14T10:45:45.720048+0000","last_active":"2024-09-14T11:21:27.049805+0000","last_peered":"2024-09-14T11:21:27.049805+0000","last_clean":"2024-09-14T11:21:27.049805+0000","last_became_active":"2024-09-14T10:45:45.719783+0000","last_became_peered":"2024-09-14T10:45:45.719783+0000","last_unstale":"2024-09-14T11:21:27.049805+0000","last_undegraded":"2024-09-14T11:21:27.049805+0000","last_fullsized":"2024-09-14T11:21:27.049805+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":800,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:34.138598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4184,"num_read_kb":3795,"num_write":1124,"num_write_kb":397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"260'343","reported_seq":957,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.967429+0000","last_change":"2024-09-14T10:45:43.686039+0000","last_active":"2024-09-14T11:22:50.967429+0000","last_peered":"2024-09-14T11:22:50.967429+0000","last_clean":"2024-09-14T11:22:50.967429+0000","last_became_active":"2024-09-14T10:45:43.685775+0000","last_became_peered":"2024-09-14T10:45:43.685775+0000","last_unstale":"2024-09-14T11:22:50.967429+0000","last_undegraded":"2024-09-14T11:22:50.967429+0000","last_fullsized":"2024-09-14T11:22:50.967429+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:18:21.519433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197775,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":637,"num_read_kb":2173,"num_write":1067,"num_write_kb":20935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":503,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:02.107638+0000","last_change":"2024-09-14T10:45:35.580399+0000","last_active":"2024-09-14T11:19:02.107638+0000","last_peered":"2024-09-14T11:19:02.107638+0000","last_clean":"2024-09-14T11:19:02.107638+0000","last_became_active":"2024-09-14T10:45:33.564407+0000","last_became_peered":"2024-09-14T10:45:33.564407+0000","last_unstale":"2024-09-14T11:19:02.107638+0000","last_undegraded":"2024-09-14T11:19:02.107638+0000","last_fullsized":"2024-09-14T11:19:02.107638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_clean_scrub_stamp":"2024-09-14T10:45:32.551765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:15:28.496118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099134599999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:07.204309+0000","last_change":"2024-09-14T10:45:47.726265+0000","last_active":"2024-09-14T11:19:07.204309+0000","last_peered":"2024-09-14T11:19:07.204309+0000","last_clean":"2024-09-14T11:19:07.204309+0000","last_became_active":"2024-09-14T10:45:47.724774+0000","last_became_peered":"2024-09-14T10:45:47.724774+0000","last_unstale":"2024-09-14T11:19:07.204309+0000","last_undegraded":"2024-09-14T11:19:07.204309+0000","last_fullsized":"2024-09-14T11:19:07.204309+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:34.725344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"260'155","reported_seq":691,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:15.998699+0000","last_change":"2024-09-14T10:45:49.731679+0000","last_active":"2024-09-14T11:21:15.998699+0000","last_peered":"2024-09-14T11:21:15.998699+0000","last_clean":"2024-09-14T11:21:15.998699+0000","last_became_active":"2024-09-14T10:45:49.731380+0000","last_became_peered":"2024-09-14T10:45:49.731380+0000","last_unstale":"2024-09-14T11:21:15.998699+0000","last_undegraded":"2024-09-14T11:21:15.998699+0000","last_fullsized":"2024-09-14T11:21:15.998699+0000","mapping_epoch":30,"log_start":"257'100","ondisk_log_start":"257'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:45.555612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":200,"num_read_kb":190,"num_write":162,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"260'793","reported_seq":2737,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:43.740421+0000","last_change":"2024-09-14T10:45:51.747482+0000","last_active":"2024-09-14T11:22:43.740421+0000","last_peered":"2024-09-14T11:22:43.740421+0000","last_clean":"2024-09-14T11:22:43.740421+0000","last_became_active":"2024-09-14T10:45:51.746984+0000","last_became_peered":"2024-09-14T10:45:51.746984+0000","last_unstale":"2024-09-14T11:22:43.740421+0000","last_undegraded":"2024-09-14T11:22:43.740421+0000","last_fullsized":"2024-09-14T11:22:43.740421+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:45.422324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"260'119","reported_seq":610,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:06.014335+0000","last_change":"2024-09-14T10:45:53.750253+0000","last_active":"2024-09-14T11:22:06.014335+0000","last_peered":"2024-09-14T11:22:06.014335+0000","last_clean":"2024-09-14T11:22:06.014335+0000","last_became_active":"2024-09-14T10:45:53.749802+0000","last_became_peered":"2024-09-14T10:45:53.749802+0000","last_unstale":"2024-09-14T11:22:06.014335+0000","last_undegraded":"2024-09-14T11:22:06.014335+0000","last_fullsized":"2024-09-14T11:22:06.014335+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:31.303920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":146,"num_read_kb":135,"num_write":274,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"260'412","reported_seq":1897,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:14.959250+0000","last_change":"2024-09-14T10:45:45.710569+0000","last_active":"2024-09-14T11:21:14.959250+0000","last_peered":"2024-09-14T11:21:14.959250+0000","last_clean":"2024-09-14T11:21:14.959250+0000","last_became_active":"2024-09-14T10:45:45.710204+0000","last_became_peered":"2024-09-14T10:45:45.710204+0000","last_unstale":"2024-09-14T11:21:14.959250+0000","last_undegraded":"2024-09-14T11:21:14.959250+0000","last_fullsized":"2024-09-14T11:21:14.959250+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:02.264958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2141,"num_read_kb":2031,"num_write":456,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"260'348","reported_seq":1117,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.099732+0000","last_change":"2024-09-14T10:45:43.688652+0000","last_active":"2024-09-14T11:22:51.099732+0000","last_peered":"2024-09-14T11:22:51.099732+0000","last_clean":"2024-09-14T11:22:51.099732+0000","last_became_active":"2024-09-14T10:45:43.688114+0000","last_became_peered":"2024-09-14T10:45:43.688114+0000","last_unstale":"2024-09-14T11:22:51.099732+0000","last_undegraded":"2024-09-14T11:22:51.099732+0000","last_fullsized":"2024-09-14T11:22:51.099732+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:15.866413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5413456,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":803,"num_read_kb":15214,"num_write":1150,"num_write_kb":42293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":509,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:16.122560+0000","last_change":"2024-09-14T10:45:35.575588+0000","last_active":"2024-09-14T11:20:16.122560+0000","last_peered":"2024-09-14T11:20:16.122560+0000","last_clean":"2024-09-14T11:20:16.122560+0000","last_became_active":"2024-09-14T10:45:33.610909+0000","last_became_peered":"2024-09-14T10:45:33.610909+0000","last_unstale":"2024-09-14T11:20:16.122560+0000","last_undegraded":"2024-09-14T11:20:16.122560+0000","last_fullsized":"2024-09-14T11:20:16.122560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_clean_scrub_stamp":"2024-09-14T10:45:32.551765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:45.821025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038435900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":480,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:07.108316+0000","last_change":"2024-09-14T10:45:47.728711+0000","last_active":"2024-09-14T11:19:07.108316+0000","last_peered":"2024-09-14T11:19:07.108316+0000","last_clean":"2024-09-14T11:19:07.108316+0000","last_became_active":"2024-09-14T10:45:47.728343+0000","last_became_peered":"2024-09-14T10:45:47.728343+0000","last_unstale":"2024-09-14T11:19:07.108316+0000","last_undegraded":"2024-09-14T11:19:07.108316+0000","last_fullsized":"2024-09-14T11:19:07.108316+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:17.637076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"260'92","reported_seq":605,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:56.315196+0000","last_change":"2024-09-14T10:45:49.736010+0000","last_active":"2024-09-14T11:20:56.315196+0000","last_peered":"2024-09-14T11:20:56.315196+0000","last_clean":"2024-09-14T11:20:56.315196+0000","last_became_active":"2024-09-14T10:45:49.735557+0000","last_became_peered":"2024-09-14T10:45:49.735557+0000","last_unstale":"2024-09-14T11:20:56.315196+0000","last_undegraded":"2024-09-14T11:20:56.315196+0000","last_fullsized":"2024-09-14T11:20:56.315196+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:10:56.092992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"260'804","reported_seq":2211,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.302906+0000","last_change":"2024-09-14T10:45:51.747138+0000","last_active":"2024-09-14T11:22:50.302906+0000","last_peered":"2024-09-14T11:22:50.302906+0000","last_clean":"2024-09-14T11:22:50.302906+0000","last_became_active":"2024-09-14T10:45:51.746874+0000","last_became_peered":"2024-09-14T10:45:51.746874+0000","last_unstale":"2024-09-14T11:22:50.302906+0000","last_undegraded":"2024-09-14T11:22:50.302906+0000","last_fullsized":"2024-09-14T11:22:50.302906+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":700,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:47.844695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"260'171","reported_seq":654,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:06.378984+0000","last_change":"2024-09-14T10:45:53.749142+0000","last_active":"2024-09-14T11:21:06.378984+0000","last_peered":"2024-09-14T11:21:06.378984+0000","last_clean":"2024-09-14T11:21:06.378984+0000","last_became_active":"2024-09-14T10:45:53.748880+0000","last_became_peered":"2024-09-14T10:45:53.748880+0000","last_unstale":"2024-09-14T11:21:06.378984+0000","last_undegraded":"2024-09-14T11:21:06.378984+0000","last_fullsized":"2024-09-14T11:21:06.378984+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:00:48.684200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":483,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":133,"num_read_kb":125,"num_write":394,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"260'405","reported_seq":1915,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.834581+0000","last_change":"2024-09-14T10:45:45.713570+0000","last_active":"2024-09-14T11:22:42.834581+0000","last_peered":"2024-09-14T11:22:42.834581+0000","last_clean":"2024-09-14T11:22:42.834581+0000","last_became_active":"2024-09-14T10:45:45.713313+0000","last_became_peered":"2024-09-14T10:45:45.713313+0000","last_unstale":"2024-09-14T11:22:42.834581+0000","last_undegraded":"2024-09-14T11:22:42.834581+0000","last_fullsized":"2024-09-14T11:22:42.834581+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:00.604945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2392,"num_read_kb":2258,"num_write":470,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"260'350","reported_seq":1090,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.965943+0000","last_change":"2024-09-14T10:45:43.691413+0000","last_active":"2024-09-14T11:22:50.965943+0000","last_peered":"2024-09-14T11:22:50.965943+0000","last_clean":"2024-09-14T11:22:50.965943+0000","last_became_active":"2024-09-14T10:45:43.689593+0000","last_became_peered":"2024-09-14T10:45:43.689593+0000","last_unstale":"2024-09-14T11:22:50.965943+0000","last_undegraded":"2024-09-14T11:22:50.965943+0000","last_fullsized":"2024-09-14T11:22:50.965943+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:27.067114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267503,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":1002,"num_read_kb":46617,"num_write":1235,"num_write_kb":43963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":503,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:17.118867+0000","last_change":"2024-09-14T10:45:35.580545+0000","last_active":"2024-09-14T11:20:17.118867+0000","last_peered":"2024-09-14T11:20:17.118867+0000","last_clean":"2024-09-14T11:20:17.118867+0000","last_became_active":"2024-09-14T10:45:33.610689+0000","last_became_peered":"2024-09-14T10:45:33.610689+0000","last_unstale":"2024-09-14T11:20:17.118867+0000","last_undegraded":"2024-09-14T11:20:17.118867+0000","last_fullsized":"2024-09-14T11:20:17.118867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_clean_scrub_stamp":"2024-09-14T10:45:32.551765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:59.821398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011461920000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:56.120373+0000","last_change":"2024-09-14T10:45:47.728608+0000","last_active":"2024-09-14T11:19:56.120373+0000","last_peered":"2024-09-14T11:19:56.120373+0000","last_clean":"2024-09-14T11:19:56.120373+0000","last_became_active":"2024-09-14T10:45:47.728312+0000","last_became_peered":"2024-09-14T10:45:47.728312+0000","last_unstale":"2024-09-14T11:19:56.120373+0000","last_undegraded":"2024-09-14T11:19:56.120373+0000","last_fullsized":"2024-09-14T11:19:56.120373+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:22.707433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"260'704","reported_seq":1391,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:43.704102+0000","last_change":"2024-09-14T10:45:49.734149+0000","last_active":"2024-09-14T11:22:43.704102+0000","last_peered":"2024-09-14T11:22:43.704102+0000","last_clean":"2024-09-14T11:22:43.704102+0000","last_became_active":"2024-09-14T10:45:49.733812+0000","last_became_peered":"2024-09-14T10:45:49.733812+0000","last_unstale":"2024-09-14T11:22:43.704102+0000","last_undegraded":"2024-09-14T11:22:43.704102+0000","last_fullsized":"2024-09-14T11:22:43.704102+0000","mapping_epoch":30,"log_start":"260'600","ondisk_log_start":"260'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":600,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:05.193302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167039,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1243,"num_read_kb":2680,"num_write":1028,"num_write_kb":871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:11.113894+0000","last_change":"2024-09-14T10:45:51.746053+0000","last_active":"2024-09-14T11:19:11.113894+0000","last_peered":"2024-09-14T11:19:11.113894+0000","last_clean":"2024-09-14T11:19:11.113894+0000","last_became_active":"2024-09-14T10:45:51.745137+0000","last_became_peered":"2024-09-14T10:45:51.745137+0000","last_unstale":"2024-09-14T11:19:11.113894+0000","last_undegraded":"2024-09-14T11:19:11.113894+0000","last_fullsized":"2024-09-14T11:19:11.113894+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:34.202906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"260'130","reported_seq":622,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.045272+0000","last_change":"2024-09-14T10:45:53.751882+0000","last_active":"2024-09-14T11:21:27.045272+0000","last_peered":"2024-09-14T11:21:27.045272+0000","last_clean":"2024-09-14T11:21:27.045272+0000","last_became_active":"2024-09-14T10:45:53.751511+0000","last_became_peered":"2024-09-14T10:45:53.751511+0000","last_unstale":"2024-09-14T11:21:27.045272+0000","last_undegraded":"2024-09-14T11:21:27.045272+0000","last_fullsized":"2024-09-14T11:21:27.045272+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:34.995970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":202,"num_read_kb":180,"num_write":339,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"260'195","reported_seq":792,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.396620+0000","last_change":"2024-09-14T10:45:53.747335+0000","last_active":"2024-09-14T11:21:28.396620+0000","last_peered":"2024-09-14T11:21:28.396620+0000","last_clean":"2024-09-14T11:21:28.396620+0000","last_became_active":"2024-09-14T10:45:53.747090+0000","last_became_peered":"2024-09-14T10:45:53.747090+0000","last_unstale":"2024-09-14T11:21:28.396620+0000","last_undegraded":"2024-09-14T11:21:28.396620+0000","last_fullsized":"2024-09-14T11:21:28.396620+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:02.580660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":464,"num_read_kb":408,"num_write":469,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"260'462","reported_seq":1939,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:09.637868+0000","last_change":"2024-09-14T10:45:45.719507+0000","last_active":"2024-09-14T11:21:09.637868+0000","last_peered":"2024-09-14T11:21:09.637868+0000","last_clean":"2024-09-14T11:21:09.637868+0000","last_became_active":"2024-09-14T10:45:45.719181+0000","last_became_peered":"2024-09-14T10:45:45.719181+0000","last_unstale":"2024-09-14T11:21:09.637868+0000","last_undegraded":"2024-09-14T11:21:09.637868+0000","last_fullsized":"2024-09-14T11:21:09.637868+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:25:12.612090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2298,"num_read_kb":2151,"num_write":532,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"260'329","reported_seq":987,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:59.219456+0000","last_change":"2024-09-14T10:45:43.673724+0000","last_active":"2024-09-14T11:20:59.219456+0000","last_peered":"2024-09-14T11:20:59.219456+0000","last_clean":"2024-09-14T11:20:59.219456+0000","last_became_active":"2024-09-14T10:45:43.673475+0000","last_became_peered":"2024-09-14T10:45:43.673475+0000","last_unstale":"2024-09-14T11:20:59.219456+0000","last_undegraded":"2024-09-14T11:20:59.219456+0000","last_fullsized":"2024-09-14T11:20:59.219456+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:22.605440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22088316,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":690,"num_read_kb":57044,"num_write":1220,"num_write_kb":43494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:30.977699+0000","last_change":"2024-09-14T10:45:47.727115+0000","last_active":"2024-09-14T11:18:30.977699+0000","last_peered":"2024-09-14T11:18:30.977699+0000","last_clean":"2024-09-14T11:18:30.977699+0000","last_became_active":"2024-09-14T10:45:47.726819+0000","last_became_peered":"2024-09-14T10:45:47.726819+0000","last_unstale":"2024-09-14T11:18:30.977699+0000","last_undegraded":"2024-09-14T11:18:30.977699+0000","last_fullsized":"2024-09-14T11:18:30.977699+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:49.723414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"260'271","reported_seq":822,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.561739+0000","last_change":"2024-09-14T10:45:49.733250+0000","last_active":"2024-09-14T11:22:50.561739+0000","last_peered":"2024-09-14T11:22:50.561739+0000","last_clean":"2024-09-14T11:22:50.561739+0000","last_became_active":"2024-09-14T10:45:49.732755+0000","last_became_peered":"2024-09-14T10:45:49.732755+0000","last_unstale":"2024-09-14T11:22:50.561739+0000","last_undegraded":"2024-09-14T11:22:50.561739+0000","last_fullsized":"2024-09-14T11:22:50.561739+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:54:03.582189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48124,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":453,"num_read_kb":1077,"num_write":370,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":472,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:30.983925+0000","last_change":"2024-09-14T10:45:51.747909+0000","last_active":"2024-09-14T11:18:30.983925+0000","last_peered":"2024-09-14T11:18:30.983925+0000","last_clean":"2024-09-14T11:18:30.983925+0000","last_became_active":"2024-09-14T10:45:51.747624+0000","last_became_peered":"2024-09-14T10:45:51.747624+0000","last_unstale":"2024-09-14T11:18:30.983925+0000","last_undegraded":"2024-09-14T11:18:30.983925+0000","last_fullsized":"2024-09-14T11:18:30.983925+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:20.368951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"260'138","reported_seq":626,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:14.388075+0000","last_change":"2024-09-14T10:45:53.751186+0000","last_active":"2024-09-14T11:21:14.388075+0000","last_peered":"2024-09-14T11:21:14.388075+0000","last_clean":"2024-09-14T11:21:14.388075+0000","last_became_active":"2024-09-14T10:45:53.750866+0000","last_became_peered":"2024-09-14T10:45:53.750866+0000","last_unstale":"2024-09-14T11:21:14.388075+0000","last_undegraded":"2024-09-14T11:21:14.388075+0000","last_fullsized":"2024-09-14T11:21:14.388075+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:54.350231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":161,"num_read_kb":145,"num_write":328,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"260'713","reported_seq":2438,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.336687+0000","last_change":"2024-09-14T10:45:45.720031+0000","last_active":"2024-09-14T11:21:28.336687+0000","last_peered":"2024-09-14T11:21:28.336687+0000","last_clean":"2024-09-14T11:21:28.336687+0000","last_became_active":"2024-09-14T10:45:45.719731+0000","last_became_peered":"2024-09-14T10:45:45.719731+0000","last_unstale":"2024-09-14T11:21:28.336687+0000","last_undegraded":"2024-09-14T11:21:28.336687+0000","last_fullsized":"2024-09-14T11:21:28.336687+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":700,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:55.272218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3605,"num_read_kb":3249,"num_write":949,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"260'284","reported_seq":892,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:57.835060+0000","last_change":"2024-09-14T10:45:43.683276+0000","last_active":"2024-09-14T11:20:57.835060+0000","last_peered":"2024-09-14T11:20:57.835060+0000","last_clean":"2024-09-14T11:20:57.835060+0000","last_became_active":"2024-09-14T10:45:43.682925+0000","last_became_peered":"2024-09-14T10:45:43.682925+0000","last_unstale":"2024-09-14T11:20:57.835060+0000","last_undegraded":"2024-09-14T11:20:57.835060+0000","last_fullsized":"2024-09-14T11:20:57.835060+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:31.662072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584968,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":575,"num_read_kb":1213,"num_write":964,"num_write_kb":13029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:31.108226+0000","last_change":"2024-09-14T10:45:47.724937+0000","last_active":"2024-09-14T11:18:31.108226+0000","last_peered":"2024-09-14T11:18:31.108226+0000","last_clean":"2024-09-14T11:18:31.108226+0000","last_became_active":"2024-09-14T10:45:47.724432+0000","last_became_peered":"2024-09-14T10:45:47.724432+0000","last_unstale":"2024-09-14T11:18:31.108226+0000","last_undegraded":"2024-09-14T11:18:31.108226+0000","last_fullsized":"2024-09-14T11:18:31.108226+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:26.499973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"260'45","reported_seq":533,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:51.127494+0000","last_change":"2024-09-14T10:45:49.735467+0000","last_active":"2024-09-14T11:20:51.127494+0000","last_peered":"2024-09-14T11:20:51.127494+0000","last_clean":"2024-09-14T11:20:51.127494+0000","last_became_active":"2024-09-14T10:45:49.735053+0000","last_became_peered":"2024-09-14T10:45:49.735053+0000","last_unstale":"2024-09-14T11:20:51.127494+0000","last_undegraded":"2024-09-14T11:20:51.127494+0000","last_fullsized":"2024-09-14T11:20:51.127494+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:14.336006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":24,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":467,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:34.979850+0000","last_change":"2024-09-14T10:45:51.748011+0000","last_active":"2024-09-14T11:18:34.979850+0000","last_peered":"2024-09-14T11:18:34.979850+0000","last_clean":"2024-09-14T11:18:34.979850+0000","last_became_active":"2024-09-14T10:45:51.747600+0000","last_became_peered":"2024-09-14T10:45:51.747600+0000","last_unstale":"2024-09-14T11:18:34.979850+0000","last_undegraded":"2024-09-14T11:18:34.979850+0000","last_fullsized":"2024-09-14T11:18:34.979850+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:20.639986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"260'223","reported_seq":744,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.339917+0000","last_change":"2024-09-14T10:45:53.751787+0000","last_active":"2024-09-14T11:21:28.339917+0000","last_peered":"2024-09-14T11:21:28.339917+0000","last_clean":"2024-09-14T11:21:28.339917+0000","last_became_active":"2024-09-14T10:45:53.751504+0000","last_became_peered":"2024-09-14T10:45:53.751504+0000","last_unstale":"2024-09-14T11:21:28.339917+0000","last_undegraded":"2024-09-14T11:21:28.339917+0000","last_fullsized":"2024-09-14T11:21:28.339917+0000","mapping_epoch":34,"log_start":"260'200","ondisk_log_start":"260'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:27.845346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":402,"num_read_kb":374,"num_write":536,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"260'726","reported_seq":2170,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:14.386625+0000","last_change":"2024-09-14T10:45:45.714585+0000","last_active":"2024-09-14T11:21:14.386625+0000","last_peered":"2024-09-14T11:21:14.386625+0000","last_clean":"2024-09-14T11:21:14.386625+0000","last_became_active":"2024-09-14T10:45:45.714326+0000","last_became_peered":"2024-09-14T10:45:45.714326+0000","last_unstale":"2024-09-14T11:21:14.386625+0000","last_undegraded":"2024-09-14T11:21:14.386625+0000","last_fullsized":"2024-09-14T11:21:14.386625+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":700,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:55.220424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3492,"num_read_kb":3158,"num_write":966,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"260'319","reported_seq":967,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:11.552773+0000","last_change":"2024-09-14T10:45:43.672043+0000","last_active":"2024-09-14T11:21:11.552773+0000","last_peered":"2024-09-14T11:21:11.552773+0000","last_clean":"2024-09-14T11:21:11.552773+0000","last_became_active":"2024-09-14T10:45:43.671747+0000","last_became_peered":"2024-09-14T10:45:43.671747+0000","last_unstale":"2024-09-14T11:21:11.552773+0000","last_undegraded":"2024-09-14T11:21:11.552773+0000","last_fullsized":"2024-09-14T11:21:11.552773+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:17.021045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15007678,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":632,"num_read_kb":3196,"num_write":1177,"num_write_kb":29609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":475,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:29.979126+0000","last_change":"2024-09-14T10:45:47.731898+0000","last_active":"2024-09-14T11:18:29.979126+0000","last_peered":"2024-09-14T11:18:29.979126+0000","last_clean":"2024-09-14T11:18:29.979126+0000","last_became_active":"2024-09-14T10:45:47.731640+0000","last_became_peered":"2024-09-14T10:45:47.731640+0000","last_unstale":"2024-09-14T11:18:29.979126+0000","last_undegraded":"2024-09-14T11:18:29.979126+0000","last_fullsized":"2024-09-14T11:18:29.979126+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:50:32.387766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"260'317","reported_seq":881,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:43.705489+0000","last_change":"2024-09-14T10:45:49.727713+0000","last_active":"2024-09-14T11:22:43.705489+0000","last_peered":"2024-09-14T11:22:43.705489+0000","last_clean":"2024-09-14T11:22:43.705489+0000","last_became_active":"2024-09-14T10:45:49.727431+0000","last_became_peered":"2024-09-14T10:45:49.727431+0000","last_unstale":"2024-09-14T11:22:43.705489+0000","last_undegraded":"2024-09-14T11:22:43.705489+0000","last_fullsized":"2024-09-14T11:22:43.705489+0000","mapping_epoch":30,"log_start":"260'300","ondisk_log_start":"260'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:44.165025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60297,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":506,"num_read_kb":1020,"num_write":416,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":476,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:32.102760+0000","last_change":"2024-09-14T10:45:51.747148+0000","last_active":"2024-09-14T11:18:32.102760+0000","last_peered":"2024-09-14T11:18:32.102760+0000","last_clean":"2024-09-14T11:18:32.102760+0000","last_became_active":"2024-09-14T10:45:51.746506+0000","last_became_peered":"2024-09-14T10:45:51.746506+0000","last_unstale":"2024-09-14T11:18:32.102760+0000","last_undegraded":"2024-09-14T11:18:32.102760+0000","last_fullsized":"2024-09-14T11:18:32.102760+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:58.299100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"260'144","reported_seq":636,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:12.863430+0000","last_change":"2024-09-14T10:45:53.755475+0000","last_active":"2024-09-14T11:21:12.863430+0000","last_peered":"2024-09-14T11:21:12.863430+0000","last_clean":"2024-09-14T11:21:12.863430+0000","last_became_active":"2024-09-14T10:45:53.755018+0000","last_became_peered":"2024-09-14T10:45:53.755018+0000","last_unstale":"2024-09-14T11:21:12.863430+0000","last_undegraded":"2024-09-14T11:21:12.863430+0000","last_fullsized":"2024-09-14T11:21:12.863430+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:18.887717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":167,"num_write":339,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"260'400","reported_seq":1926,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:13.964839+0000","last_change":"2024-09-14T10:45:45.713424+0000","last_active":"2024-09-14T11:21:13.964839+0000","last_peered":"2024-09-14T11:21:13.964839+0000","last_clean":"2024-09-14T11:21:13.964839+0000","last_became_active":"2024-09-14T10:45:45.713138+0000","last_became_peered":"2024-09-14T10:45:45.713138+0000","last_unstale":"2024-09-14T11:21:13.964839+0000","last_undegraded":"2024-09-14T11:21:13.964839+0000","last_fullsized":"2024-09-14T11:21:13.964839+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:33.204288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2187,"num_read_kb":2089,"num_write":453,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"260'356","reported_seq":966,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.076664+0000","last_change":"2024-09-14T10:45:43.680940+0000","last_active":"2024-09-14T11:22:51.076664+0000","last_peered":"2024-09-14T11:22:51.076664+0000","last_clean":"2024-09-14T11:22:51.076664+0000","last_became_active":"2024-09-14T10:45:43.680629+0000","last_became_peered":"2024-09-14T10:45:43.680629+0000","last_unstale":"2024-09-14T11:22:51.076664+0000","last_undegraded":"2024-09-14T11:22:51.076664+0000","last_fullsized":"2024-09-14T11:22:51.076664+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:50:55.277788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1134943,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":598,"num_read_kb":9938,"num_write":1213,"num_write_kb":44861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:27.102413+0000","last_change":"2024-09-14T10:45:47.728061+0000","last_active":"2024-09-14T11:18:27.102413+0000","last_peered":"2024-09-14T11:18:27.102413+0000","last_clean":"2024-09-14T11:18:27.102413+0000","last_became_active":"2024-09-14T10:45:47.727777+0000","last_became_peered":"2024-09-14T10:45:47.727777+0000","last_unstale":"2024-09-14T11:18:27.102413+0000","last_undegraded":"2024-09-14T11:18:27.102413+0000","last_fullsized":"2024-09-14T11:18:27.102413+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:11.350366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"260'266","reported_seq":815,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:06.713545+0000","last_change":"2024-09-14T10:45:49.727639+0000","last_active":"2024-09-14T11:21:06.713545+0000","last_peered":"2024-09-14T11:21:06.713545+0000","last_clean":"2024-09-14T11:21:06.713545+0000","last_became_active":"2024-09-14T10:45:49.727347+0000","last_became_peered":"2024-09-14T10:45:49.727347+0000","last_unstale":"2024-09-14T11:21:06.713545+0000","last_undegraded":"2024-09-14T11:21:06.713545+0000","last_fullsized":"2024-09-14T11:21:06.713545+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:01.870905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48442,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":404,"num_read_kb":831,"num_write":338,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":472,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:30.983987+0000","last_change":"2024-09-14T10:45:51.746782+0000","last_active":"2024-09-14T11:18:30.983987+0000","last_peered":"2024-09-14T11:18:30.983987+0000","last_clean":"2024-09-14T11:18:30.983987+0000","last_became_active":"2024-09-14T10:45:51.746493+0000","last_became_peered":"2024-09-14T10:45:51.746493+0000","last_unstale":"2024-09-14T11:18:30.983987+0000","last_undegraded":"2024-09-14T11:18:30.983987+0000","last_fullsized":"2024-09-14T11:18:30.983987+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:58.142627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"260'405","reported_seq":1975,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:14.951090+0000","last_change":"2024-09-14T10:45:45.725798+0000","last_active":"2024-09-14T11:21:14.951090+0000","last_peered":"2024-09-14T11:21:14.951090+0000","last_clean":"2024-09-14T11:21:14.951090+0000","last_became_active":"2024-09-14T10:45:45.725430+0000","last_became_peered":"2024-09-14T10:45:45.725430+0000","last_unstale":"2024-09-14T11:21:14.951090+0000","last_undegraded":"2024-09-14T11:21:14.951090+0000","last_fullsized":"2024-09-14T11:21:14.951090+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:31.325345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2252,"num_read_kb":2164,"num_write":454,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"260'295","reported_seq":911,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.109759+0000","last_change":"2024-09-14T10:45:43.684555+0000","last_active":"2024-09-14T11:22:51.109759+0000","last_peered":"2024-09-14T11:22:51.109759+0000","last_clean":"2024-09-14T11:22:51.109759+0000","last_became_active":"2024-09-14T10:45:43.683988+0000","last_became_peered":"2024-09-14T10:45:43.683988+0000","last_unstale":"2024-09-14T11:22:51.109759+0000","last_undegraded":"2024-09-14T11:22:51.109759+0000","last_fullsized":"2024-09-14T11:22:51.109759+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:58:49.723371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5813976,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":539,"num_read_kb":32569,"num_write":1038,"num_write_kb":14583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":481,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:00.990077+0000","last_change":"2024-09-14T10:45:47.728686+0000","last_active":"2024-09-14T11:20:00.990077+0000","last_peered":"2024-09-14T11:20:00.990077+0000","last_clean":"2024-09-14T11:20:00.990077+0000","last_became_active":"2024-09-14T10:45:47.728323+0000","last_became_peered":"2024-09-14T10:45:47.728323+0000","last_unstale":"2024-09-14T11:20:00.990077+0000","last_undegraded":"2024-09-14T11:20:00.990077+0000","last_fullsized":"2024-09-14T11:20:00.990077+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:13:35.492090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"260'486","reported_seq":1088,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.771270+0000","last_change":"2024-09-14T10:45:49.729101+0000","last_active":"2024-09-14T11:22:50.771270+0000","last_peered":"2024-09-14T11:22:50.771270+0000","last_clean":"2024-09-14T11:22:50.771270+0000","last_became_active":"2024-09-14T10:45:49.728841+0000","last_became_peered":"2024-09-14T10:45:49.728841+0000","last_unstale":"2024-09-14T11:22:50.771270+0000","last_undegraded":"2024-09-14T11:22:50.771270+0000","last_fullsized":"2024-09-14T11:22:50.771270+0000","mapping_epoch":30,"log_start":"260'400","ondisk_log_start":"260'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":400,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:11.378740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114572,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":881,"num_read_kb":2022,"num_write":772,"num_write_kb":713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":466,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:24.978449+0000","last_change":"2024-09-14T10:45:51.752010+0000","last_active":"2024-09-14T11:18:24.978449+0000","last_peered":"2024-09-14T11:18:24.978449+0000","last_clean":"2024-09-14T11:18:24.978449+0000","last_became_active":"2024-09-14T10:45:51.751776+0000","last_became_peered":"2024-09-14T10:45:51.751776+0000","last_unstale":"2024-09-14T11:18:24.978449+0000","last_undegraded":"2024-09-14T11:18:24.978449+0000","last_fullsized":"2024-09-14T11:18:24.978449+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:41:21.445606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"260'170","reported_seq":665,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.618448+0000","last_change":"2024-09-14T10:45:53.753181+0000","last_active":"2024-09-14T11:21:28.618448+0000","last_peered":"2024-09-14T11:21:28.618448+0000","last_clean":"2024-09-14T11:21:28.618448+0000","last_became_active":"2024-09-14T10:45:53.752535+0000","last_became_peered":"2024-09-14T10:45:53.752535+0000","last_unstale":"2024-09-14T11:21:28.618448+0000","last_undegraded":"2024-09-14T11:21:28.618448+0000","last_fullsized":"2024-09-14T11:21:28.618448+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:22.683886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":217,"num_read_kb":213,"num_write":386,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"260'440","reported_seq":2084,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.742063+0000","last_change":"2024-09-14T10:45:45.712598+0000","last_active":"2024-09-14T11:21:28.742063+0000","last_peered":"2024-09-14T11:21:28.742063+0000","last_clean":"2024-09-14T11:21:28.742063+0000","last_became_active":"2024-09-14T10:45:45.710498+0000","last_became_peered":"2024-09-14T10:45:45.710498+0000","last_unstale":"2024-09-14T11:21:28.742063+0000","last_undegraded":"2024-09-14T11:21:28.742063+0000","last_fullsized":"2024-09-14T11:21:28.742063+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:47:29.987154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2391,"num_read_kb":2291,"num_write":487,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"260'389","reported_seq":1143,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.104146+0000","last_change":"2024-09-14T10:45:43.688502+0000","last_active":"2024-09-14T11:22:51.104146+0000","last_peered":"2024-09-14T11:22:51.104146+0000","last_clean":"2024-09-14T11:22:51.104146+0000","last_became_active":"2024-09-14T10:45:43.688136+0000","last_became_peered":"2024-09-14T10:45:43.688136+0000","last_unstale":"2024-09-14T11:22:51.104146+0000","last_undegraded":"2024-09-14T11:22:51.104146+0000","last_fullsized":"2024-09-14T11:22:51.104146+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:56:33.762201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243179,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":1033,"num_read_kb":62484,"num_write":1323,"num_write_kb":26359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":477,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:09.985337+0000","last_change":"2024-09-14T10:45:47.726708+0000","last_active":"2024-09-14T11:19:09.985337+0000","last_peered":"2024-09-14T11:19:09.985337+0000","last_clean":"2024-09-14T11:19:09.985337+0000","last_became_active":"2024-09-14T10:45:47.725711+0000","last_became_peered":"2024-09-14T10:45:47.725711+0000","last_unstale":"2024-09-14T11:19:09.985337+0000","last_undegraded":"2024-09-14T11:19:09.985337+0000","last_fullsized":"2024-09-14T11:19:09.985337+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:23.138591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"260'277","reported_seq":830,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.843572+0000","last_change":"2024-09-14T10:45:49.730097+0000","last_active":"2024-09-14T11:22:42.843572+0000","last_peered":"2024-09-14T11:22:42.843572+0000","last_clean":"2024-09-14T11:22:42.843572+0000","last_became_active":"2024-09-14T10:45:49.729803+0000","last_became_peered":"2024-09-14T10:45:49.729803+0000","last_unstale":"2024-09-14T11:22:42.843572+0000","last_undegraded":"2024-09-14T11:22:42.843572+0000","last_fullsized":"2024-09-14T11:22:42.843572+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:44.767050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57256,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":452,"num_read_kb":917,"num_write":382,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":468,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:21.228045+0000","last_change":"2024-09-14T10:45:51.749137+0000","last_active":"2024-09-14T11:18:21.228045+0000","last_peered":"2024-09-14T11:18:21.228045+0000","last_clean":"2024-09-14T11:18:21.228045+0000","last_became_active":"2024-09-14T10:45:51.748871+0000","last_became_peered":"2024-09-14T10:45:51.748871+0000","last_unstale":"2024-09-14T11:18:21.228045+0000","last_undegraded":"2024-09-14T11:18:21.228045+0000","last_fullsized":"2024-09-14T11:18:21.228045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:41.260779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"260'208","reported_seq":1061,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.145844+0000","last_change":"2024-09-14T10:45:53.750953+0000","last_active":"2024-09-14T11:21:27.145844+0000","last_peered":"2024-09-14T11:21:27.145844+0000","last_clean":"2024-09-14T11:21:27.145844+0000","last_became_active":"2024-09-14T10:45:53.750595+0000","last_became_peered":"2024-09-14T10:45:53.750595+0000","last_unstale":"2024-09-14T11:21:27.145844+0000","last_undegraded":"2024-09-14T11:21:27.145844+0000","last_fullsized":"2024-09-14T11:21:27.145844+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:54.639620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1617,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":634,"num_read_kb":624,"num_write":573,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"260'1182","reported_seq":2743,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.327539+0000","last_change":"2024-09-14T10:45:45.722205+0000","last_active":"2024-09-14T11:21:28.327539+0000","last_peered":"2024-09-14T11:21:28.327539+0000","last_clean":"2024-09-14T11:21:28.327539+0000","last_became_active":"2024-09-14T10:45:45.721945+0000","last_became_peered":"2024-09-14T10:45:45.721945+0000","last_unstale":"2024-09-14T11:21:28.327539+0000","last_undegraded":"2024-09-14T11:21:28.327539+0000","last_fullsized":"2024-09-14T11:21:28.327539+0000","mapping_epoch":26,"log_start":"260'1100","ondisk_log_start":"260'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":1100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:32.193876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5490,"num_read_kb":4869,"num_write":1672,"num_write_kb":727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"260'278","reported_seq":912,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:26.651713+0000","last_change":"2024-09-14T10:45:43.682713+0000","last_active":"2024-09-14T11:21:26.651713+0000","last_peered":"2024-09-14T11:21:26.651713+0000","last_clean":"2024-09-14T11:21:26.651713+0000","last_became_active":"2024-09-14T10:45:43.682457+0000","last_became_peered":"2024-09-14T10:45:43.682457+0000","last_unstale":"2024-09-14T11:21:26.651713+0000","last_undegraded":"2024-09-14T11:21:26.651713+0000","last_fullsized":"2024-09-14T11:21:26.651713+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:25.191206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6916743,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":526,"num_read_kb":98004,"num_write":1119,"num_write_kb":36067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":474,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:19.977588+0000","last_change":"2024-09-14T10:45:47.726953+0000","last_active":"2024-09-14T11:18:19.977588+0000","last_peered":"2024-09-14T11:18:19.977588+0000","last_clean":"2024-09-14T11:18:19.977588+0000","last_became_active":"2024-09-14T10:45:47.726635+0000","last_became_peered":"2024-09-14T10:45:47.726635+0000","last_unstale":"2024-09-14T11:18:19.977588+0000","last_undegraded":"2024-09-14T11:18:19.977588+0000","last_fullsized":"2024-09-14T11:18:19.977588+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:12.596595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"260'274","reported_seq":827,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.701917+0000","last_change":"2024-09-14T10:45:49.729734+0000","last_active":"2024-09-14T11:22:50.701917+0000","last_peered":"2024-09-14T11:22:50.701917+0000","last_clean":"2024-09-14T11:22:50.701917+0000","last_became_active":"2024-09-14T10:45:49.729422+0000","last_became_peered":"2024-09-14T10:45:49.729422+0000","last_unstale":"2024-09-14T11:22:50.701917+0000","last_undegraded":"2024-09-14T11:22:50.701917+0000","last_fullsized":"2024-09-14T11:22:50.701917+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:36.625007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45487,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":456,"num_read_kb":1073,"num_write":374,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":475,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:00.997411+0000","last_change":"2024-09-14T10:45:51.748413+0000","last_active":"2024-09-14T11:20:00.997411+0000","last_peered":"2024-09-14T11:20:00.997411+0000","last_clean":"2024-09-14T11:20:00.997411+0000","last_became_active":"2024-09-14T10:45:51.747888+0000","last_became_peered":"2024-09-14T10:45:51.747888+0000","last_unstale":"2024-09-14T11:20:00.997411+0000","last_undegraded":"2024-09-14T11:20:00.997411+0000","last_fullsized":"2024-09-14T11:20:00.997411+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:31:10.652817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"260'126","reported_seq":597,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:43.728256+0000","last_change":"2024-09-14T10:45:53.750141+0000","last_active":"2024-09-14T11:22:43.728256+0000","last_peered":"2024-09-14T11:22:43.728256+0000","last_clean":"2024-09-14T11:22:43.728256+0000","last_became_active":"2024-09-14T10:45:53.749868+0000","last_became_peered":"2024-09-14T10:45:53.749868+0000","last_unstale":"2024-09-14T11:22:43.728256+0000","last_undegraded":"2024-09-14T11:22:43.728256+0000","last_fullsized":"2024-09-14T11:22:43.728256+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:03.049227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":111,"num_write":304,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"260'1124","reported_seq":2685,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:13.095273+0000","last_change":"2024-09-14T10:45:45.711778+0000","last_active":"2024-09-14T11:21:13.095273+0000","last_peered":"2024-09-14T11:21:13.095273+0000","last_clean":"2024-09-14T11:21:13.095273+0000","last_became_active":"2024-09-14T10:45:45.711476+0000","last_became_peered":"2024-09-14T10:45:45.711476+0000","last_unstale":"2024-09-14T11:21:13.095273+0000","last_undegraded":"2024-09-14T11:21:13.095273+0000","last_fullsized":"2024-09-14T11:21:13.095273+0000","mapping_epoch":26,"log_start":"260'1100","ondisk_log_start":"260'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":1100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:10.238217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5159,"num_read_kb":4588,"num_write":1521,"num_write_kb":611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"260'311","reported_seq":986,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.070976+0000","last_change":"2024-09-14T10:45:43.692253+0000","last_active":"2024-09-14T11:22:51.070976+0000","last_peered":"2024-09-14T11:22:51.070976+0000","last_clean":"2024-09-14T11:22:51.070976+0000","last_became_active":"2024-09-14T10:45:43.691976+0000","last_became_peered":"2024-09-14T10:45:43.691976+0000","last_unstale":"2024-09-14T11:22:51.070976+0000","last_undegraded":"2024-09-14T11:22:51.070976+0000","last_fullsized":"2024-09-14T11:22:51.070976+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:28.335886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102644,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":725,"num_read_kb":9027,"num_write":1095,"num_write_kb":58772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":483,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:21.106659+0000","last_change":"2024-09-14T10:45:47.726662+0000","last_active":"2024-09-14T11:18:21.106659+0000","last_peered":"2024-09-14T11:18:21.106659+0000","last_clean":"2024-09-14T11:18:21.106659+0000","last_became_active":"2024-09-14T10:45:47.726392+0000","last_became_peered":"2024-09-14T10:45:47.726392+0000","last_unstale":"2024-09-14T11:18:21.106659+0000","last_undegraded":"2024-09-14T11:18:21.106659+0000","last_fullsized":"2024-09-14T11:18:21.106659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:02:14.749214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"260'79","reported_seq":576,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:05.985921+0000","last_change":"2024-09-14T10:45:49.728741+0000","last_active":"2024-09-14T11:21:05.985921+0000","last_peered":"2024-09-14T11:21:05.985921+0000","last_clean":"2024-09-14T11:21:05.985921+0000","last_became_active":"2024-09-14T10:45:49.728444+0000","last_became_peered":"2024-09-14T10:45:49.728444+0000","last_unstale":"2024-09-14T11:21:05.985921+0000","last_undegraded":"2024-09-14T11:21:05.985921+0000","last_fullsized":"2024-09-14T11:21:05.985921+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:42.103576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":102,"num_read_kb":95,"num_write":120,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"260'790","reported_seq":2260,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:43.739402+0000","last_change":"2024-09-14T10:45:51.746786+0000","last_active":"2024-09-14T11:22:43.739402+0000","last_peered":"2024-09-14T11:22:43.739402+0000","last_clean":"2024-09-14T11:22:43.739402+0000","last_became_active":"2024-09-14T10:45:51.746303+0000","last_became_peered":"2024-09-14T10:45:51.746303+0000","last_unstale":"2024-09-14T11:22:43.739402+0000","last_undegraded":"2024-09-14T11:22:43.739402+0000","last_fullsized":"2024-09-14T11:22:43.739402+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:04.109276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"260'118","reported_seq":594,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:15.160213+0000","last_change":"2024-09-14T10:45:53.751786+0000","last_active":"2024-09-14T11:21:15.160213+0000","last_peered":"2024-09-14T11:21:15.160213+0000","last_clean":"2024-09-14T11:21:15.160213+0000","last_became_active":"2024-09-14T10:45:53.751453+0000","last_became_peered":"2024-09-14T10:45:53.751453+0000","last_unstale":"2024-09-14T11:21:15.160213+0000","last_undegraded":"2024-09-14T11:21:15.160213+0000","last_fullsized":"2024-09-14T11:21:15.160213+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:59.084760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":104,"num_write":274,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"260'444","reported_seq":2012,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:16.290828+0000","last_change":"2024-09-14T10:45:45.726094+0000","last_active":"2024-09-14T11:21:16.290828+0000","last_peered":"2024-09-14T11:21:16.290828+0000","last_clean":"2024-09-14T11:21:16.290828+0000","last_became_active":"2024-09-14T10:45:45.725806+0000","last_became_peered":"2024-09-14T10:45:45.725806+0000","last_unstale":"2024-09-14T11:21:16.290828+0000","last_undegraded":"2024-09-14T11:21:16.290828+0000","last_fullsized":"2024-09-14T11:21:16.290828+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:22.555341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2489,"num_read_kb":2350,"num_write":523,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"260'315","reported_seq":976,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:21.743941+0000","last_change":"2024-09-14T10:45:43.687148+0000","last_active":"2024-09-14T11:20:21.743941+0000","last_peered":"2024-09-14T11:20:21.743941+0000","last_clean":"2024-09-14T11:20:21.743941+0000","last_became_active":"2024-09-14T10:45:43.686768+0000","last_became_peered":"2024-09-14T10:45:43.686768+0000","last_unstale":"2024-09-14T11:20:21.743941+0000","last_undegraded":"2024-09-14T11:20:21.743941+0000","last_fullsized":"2024-09-14T11:20:21.743941+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:33.463121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6292907,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":664,"num_read_kb":58950,"num_write":1256,"num_write_kb":32402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":483,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:17.100449+0000","last_change":"2024-09-14T10:45:47.719027+0000","last_active":"2024-09-14T11:18:17.100449+0000","last_peered":"2024-09-14T11:18:17.100449+0000","last_clean":"2024-09-14T11:18:17.100449+0000","last_became_active":"2024-09-14T10:45:47.718721+0000","last_became_peered":"2024-09-14T10:45:47.718721+0000","last_unstale":"2024-09-14T11:18:17.100449+0000","last_undegraded":"2024-09-14T11:18:17.100449+0000","last_fullsized":"2024-09-14T11:18:17.100449+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:24.577421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"260'288","reported_seq":849,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:07.226802+0000","last_change":"2024-09-14T10:45:49.733977+0000","last_active":"2024-09-14T11:22:07.226802+0000","last_peered":"2024-09-14T11:22:07.226802+0000","last_clean":"2024-09-14T11:22:07.226802+0000","last_became_active":"2024-09-14T10:45:49.733684+0000","last_became_peered":"2024-09-14T10:45:49.733684+0000","last_unstale":"2024-09-14T11:22:07.226802+0000","last_undegraded":"2024-09-14T11:22:07.226802+0000","last_fullsized":"2024-09-14T11:22:07.226802+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:42.242159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54804,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":456,"num_read_kb":913,"num_write":378,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":476,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:41.118307+0000","last_change":"2024-09-14T10:45:51.742049+0000","last_active":"2024-09-14T11:19:41.118307+0000","last_peered":"2024-09-14T11:19:41.118307+0000","last_clean":"2024-09-14T11:19:41.118307+0000","last_became_active":"2024-09-14T10:45:51.741767+0000","last_became_peered":"2024-09-14T10:45:51.741767+0000","last_unstale":"2024-09-14T11:19:41.118307+0000","last_undegraded":"2024-09-14T11:19:41.118307+0000","last_fullsized":"2024-09-14T11:19:41.118307+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:16:02.477621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"260'128","reported_seq":620,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:06.769959+0000","last_change":"2024-09-14T10:45:53.749052+0000","last_active":"2024-09-14T11:21:06.769959+0000","last_peered":"2024-09-14T11:21:06.769959+0000","last_clean":"2024-09-14T11:21:06.769959+0000","last_became_active":"2024-09-14T10:45:53.748760+0000","last_became_peered":"2024-09-14T10:45:53.748760+0000","last_unstale":"2024-09-14T11:21:06.769959+0000","last_undegraded":"2024-09-14T11:21:06.769959+0000","last_fullsized":"2024-09-14T11:21:06.769959+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:12.144519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":155,"num_read_kb":143,"num_write":309,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"260'787","reported_seq":2297,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.832691+0000","last_change":"2024-09-14T10:45:45.718006+0000","last_active":"2024-09-14T11:22:42.832691+0000","last_peered":"2024-09-14T11:22:42.832691+0000","last_clean":"2024-09-14T11:22:42.832691+0000","last_became_active":"2024-09-14T10:45:45.717706+0000","last_became_peered":"2024-09-14T10:45:45.717706+0000","last_unstale":"2024-09-14T11:22:42.832691+0000","last_undegraded":"2024-09-14T11:22:42.832691+0000","last_fullsized":"2024-09-14T11:22:42.832691+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:04.856085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3708,"num_read_kb":3358,"num_write":1019,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"260'267","reported_seq":873,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:10.378878+0000","last_change":"2024-09-14T10:45:43.683275+0000","last_active":"2024-09-14T11:21:10.378878+0000","last_peered":"2024-09-14T11:21:10.378878+0000","last_clean":"2024-09-14T11:21:10.378878+0000","last_became_active":"2024-09-14T10:45:43.683014+0000","last_became_peered":"2024-09-14T10:45:43.683014+0000","last_unstale":"2024-09-14T11:21:10.378878+0000","last_undegraded":"2024-09-14T11:21:10.378878+0000","last_fullsized":"2024-09-14T11:21:10.378878+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:39:23.935741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14159038,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":471,"num_read_kb":15767,"num_write":923,"num_write_kb":32563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":474,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:19.977556+0000","last_change":"2024-09-14T10:45:47.726045+0000","last_active":"2024-09-14T11:18:19.977556+0000","last_peered":"2024-09-14T11:18:19.977556+0000","last_clean":"2024-09-14T11:18:19.977556+0000","last_became_active":"2024-09-14T10:45:47.725850+0000","last_became_peered":"2024-09-14T10:45:47.725850+0000","last_unstale":"2024-09-14T11:18:19.977556+0000","last_undegraded":"2024-09-14T11:18:19.977556+0000","last_fullsized":"2024-09-14T11:18:19.977556+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:53.534864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"260'258","reported_seq":811,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.945561+0000","last_change":"2024-09-14T10:45:49.736850+0000","last_active":"2024-09-14T11:22:50.945561+0000","last_peered":"2024-09-14T11:22:50.945561+0000","last_clean":"2024-09-14T11:22:50.945561+0000","last_became_active":"2024-09-14T10:45:49.736538+0000","last_became_peered":"2024-09-14T10:45:49.736538+0000","last_unstale":"2024-09-14T11:22:50.945561+0000","last_undegraded":"2024-09-14T11:22:50.945561+0000","last_fullsized":"2024-09-14T11:22:50.945561+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:24.205374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45998,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":425,"num_read_kb":1014,"num_write":348,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":470,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:47.114678+0000","last_change":"2024-09-14T10:45:51.745256+0000","last_active":"2024-09-14T11:19:47.114678+0000","last_peered":"2024-09-14T11:19:47.114678+0000","last_clean":"2024-09-14T11:19:47.114678+0000","last_became_active":"2024-09-14T10:45:51.744957+0000","last_became_peered":"2024-09-14T10:45:51.744957+0000","last_unstale":"2024-09-14T11:19:47.114678+0000","last_undegraded":"2024-09-14T11:19:47.114678+0000","last_fullsized":"2024-09-14T11:19:47.114678+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:00.836610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"260'125","reported_seq":625,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.799038+0000","last_change":"2024-09-14T10:45:53.750560+0000","last_active":"2024-09-14T11:21:28.799038+0000","last_peered":"2024-09-14T11:21:28.799038+0000","last_clean":"2024-09-14T11:21:28.799038+0000","last_became_active":"2024-09-14T10:45:53.750287+0000","last_became_peered":"2024-09-14T10:45:53.750287+0000","last_unstale":"2024-09-14T11:21:28.799038+0000","last_undegraded":"2024-09-14T11:21:28.799038+0000","last_fullsized":"2024-09-14T11:21:28.799038+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:48.692799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":175,"num_read_kb":170,"num_write":297,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"260'391","reported_seq":1842,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.835107+0000","last_change":"2024-09-14T10:45:45.713005+0000","last_active":"2024-09-14T11:22:42.835107+0000","last_peered":"2024-09-14T11:22:42.835107+0000","last_clean":"2024-09-14T11:22:42.835107+0000","last_became_active":"2024-09-14T10:45:45.712455+0000","last_became_peered":"2024-09-14T10:45:45.712455+0000","last_unstale":"2024-09-14T11:22:42.835107+0000","last_undegraded":"2024-09-14T11:22:42.835107+0000","last_fullsized":"2024-09-14T11:22:42.835107+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:29.570600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2172,"num_read_kb":2052,"num_write":470,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"260'333","reported_seq":980,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.107858+0000","last_change":"2024-09-14T10:45:43.676752+0000","last_active":"2024-09-14T11:22:51.107858+0000","last_peered":"2024-09-14T11:22:51.107858+0000","last_clean":"2024-09-14T11:22:51.107858+0000","last_became_active":"2024-09-14T10:45:43.676145+0000","last_became_peered":"2024-09-14T10:45:43.676145+0000","last_unstale":"2024-09-14T11:22:51.107858+0000","last_undegraded":"2024-09-14T11:22:51.107858+0000","last_fullsized":"2024-09-14T11:22:51.107858+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:31:26.462692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1441418,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":657,"num_read_kb":38975,"num_write":1163,"num_write_kb":36099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:37.112554+0000","last_change":"2024-09-14T10:45:47.724662+0000","last_active":"2024-09-14T11:19:37.112554+0000","last_peered":"2024-09-14T11:19:37.112554+0000","last_clean":"2024-09-14T11:19:37.112554+0000","last_became_active":"2024-09-14T10:45:47.724065+0000","last_became_peered":"2024-09-14T10:45:47.724065+0000","last_unstale":"2024-09-14T11:19:37.112554+0000","last_undegraded":"2024-09-14T11:19:37.112554+0000","last_fullsized":"2024-09-14T11:19:37.112554+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:57.045602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"260'239","reported_seq":777,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.625663+0000","last_change":"2024-09-14T10:45:49.728006+0000","last_active":"2024-09-14T11:22:50.625663+0000","last_peered":"2024-09-14T11:22:50.625663+0000","last_clean":"2024-09-14T11:22:50.625663+0000","last_became_active":"2024-09-14T10:45:49.727721+0000","last_became_peered":"2024-09-14T10:45:49.727721+0000","last_unstale":"2024-09-14T11:22:50.625663+0000","last_undegraded":"2024-09-14T11:22:50.625663+0000","last_fullsized":"2024-09-14T11:22:50.625663+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:35.275905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47218,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":415,"num_read_kb":1017,"num_write":344,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":469,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:22.101700+0000","last_change":"2024-09-14T10:45:51.742675+0000","last_active":"2024-09-14T11:18:22.101700+0000","last_peered":"2024-09-14T11:18:22.101700+0000","last_clean":"2024-09-14T11:18:22.101700+0000","last_became_active":"2024-09-14T10:45:51.742387+0000","last_became_peered":"2024-09-14T10:45:51.742387+0000","last_unstale":"2024-09-14T11:18:22.101700+0000","last_undegraded":"2024-09-14T11:18:22.101700+0000","last_fullsized":"2024-09-14T11:18:22.101700+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:36.809715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"260'160","reported_seq":1255,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.232516+0000","last_change":"2024-09-14T10:45:53.752874+0000","last_active":"2024-09-14T11:21:27.232516+0000","last_peered":"2024-09-14T11:21:27.232516+0000","last_clean":"2024-09-14T11:21:27.232516+0000","last_became_active":"2024-09-14T10:45:53.752639+0000","last_became_peered":"2024-09-14T10:45:53.752639+0000","last_unstale":"2024-09-14T11:21:27.232516+0000","last_undegraded":"2024-09-14T11:21:27.232516+0000","last_fullsized":"2024-09-14T11:21:27.232516+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:29.390299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":838,"num_read_kb":820,"num_write":382,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"260'397","reported_seq":1903,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:15.867791+0000","last_change":"2024-09-14T10:45:45.719248+0000","last_active":"2024-09-14T11:21:15.867791+0000","last_peered":"2024-09-14T11:21:15.867791+0000","last_clean":"2024-09-14T11:21:15.867791+0000","last_became_active":"2024-09-14T10:45:45.718964+0000","last_became_peered":"2024-09-14T10:45:45.718964+0000","last_unstale":"2024-09-14T11:21:15.867791+0000","last_undegraded":"2024-09-14T11:21:15.867791+0000","last_fullsized":"2024-09-14T11:21:15.867791+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:55.163718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2133,"num_read_kb":2043,"num_write":433,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"260'339","reported_seq":977,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.035464+0000","last_change":"2024-09-14T10:45:43.675554+0000","last_active":"2024-09-14T11:22:51.035464+0000","last_peered":"2024-09-14T11:22:51.035464+0000","last_clean":"2024-09-14T11:22:51.035464+0000","last_became_active":"2024-09-14T10:45:43.675220+0000","last_became_peered":"2024-09-14T10:45:43.675220+0000","last_unstale":"2024-09-14T11:22:51.035464+0000","last_undegraded":"2024-09-14T11:22:51.035464+0000","last_fullsized":"2024-09-14T11:22:51.035464+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:34:09.729685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20992,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":580,"num_read_kb":38424,"num_write":1063,"num_write_kb":41594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":485,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:46.119103+0000","last_change":"2024-09-14T10:45:47.729627+0000","last_active":"2024-09-14T11:19:46.119103+0000","last_peered":"2024-09-14T11:19:46.119103+0000","last_clean":"2024-09-14T11:19:46.119103+0000","last_became_active":"2024-09-14T10:45:47.729338+0000","last_became_peered":"2024-09-14T10:45:47.729338+0000","last_unstale":"2024-09-14T11:19:46.119103+0000","last_undegraded":"2024-09-14T11:19:46.119103+0000","last_fullsized":"2024-09-14T11:19:46.119103+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:15.042150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"260'285","reported_seq":842,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:10.053013+0000","last_change":"2024-09-14T10:45:49.731337+0000","last_active":"2024-09-14T11:21:10.053013+0000","last_peered":"2024-09-14T11:21:10.053013+0000","last_clean":"2024-09-14T11:21:10.053013+0000","last_became_active":"2024-09-14T10:45:49.729842+0000","last_became_peered":"2024-09-14T10:45:49.729842+0000","last_unstale":"2024-09-14T11:21:10.053013+0000","last_undegraded":"2024-09-14T11:21:10.053013+0000","last_fullsized":"2024-09-14T11:21:10.053013+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:25:47.634561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53437,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":465,"num_read_kb":935,"num_write":380,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":475,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:21.106628+0000","last_change":"2024-09-14T10:45:51.745622+0000","last_active":"2024-09-14T11:18:21.106628+0000","last_peered":"2024-09-14T11:18:21.106628+0000","last_clean":"2024-09-14T11:18:21.106628+0000","last_became_active":"2024-09-14T10:45:51.745310+0000","last_became_peered":"2024-09-14T10:45:51.745310+0000","last_unstale":"2024-09-14T11:18:21.106628+0000","last_undegraded":"2024-09-14T11:18:21.106628+0000","last_fullsized":"2024-09-14T11:18:21.106628+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:03.197112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"260'137","reported_seq":616,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.832054+0000","last_change":"2024-09-14T10:45:53.755154+0000","last_active":"2024-09-14T11:22:42.832054+0000","last_peered":"2024-09-14T11:22:42.832054+0000","last_clean":"2024-09-14T11:22:42.832054+0000","last_became_active":"2024-09-14T10:45:53.754826+0000","last_became_peered":"2024-09-14T10:45:53.754826+0000","last_unstale":"2024-09-14T11:22:42.832054+0000","last_undegraded":"2024-09-14T11:22:42.832054+0000","last_fullsized":"2024-09-14T11:22:42.832054+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:13.225340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":657,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":128,"num_read_kb":116,"num_write":335,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"260'420","reported_seq":1963,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:15.435203+0000","last_change":"2024-09-14T10:45:45.709097+0000","last_active":"2024-09-14T11:21:15.435203+0000","last_peered":"2024-09-14T11:21:15.435203+0000","last_clean":"2024-09-14T11:21:15.435203+0000","last_became_active":"2024-09-14T10:45:45.708229+0000","last_became_peered":"2024-09-14T10:45:45.708229+0000","last_unstale":"2024-09-14T11:21:15.435203+0000","last_undegraded":"2024-09-14T11:21:15.435203+0000","last_fullsized":"2024-09-14T11:21:15.435203+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:43.675052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2330,"num_read_kb":2210,"num_write":517,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"260'294","reported_seq":941,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:11.838702+0000","last_change":"2024-09-14T10:45:43.684421+0000","last_active":"2024-09-14T11:21:11.838702+0000","last_peered":"2024-09-14T11:21:11.838702+0000","last_clean":"2024-09-14T11:21:11.838702+0000","last_became_active":"2024-09-14T10:45:43.684102+0000","last_became_peered":"2024-09-14T10:45:43.684102+0000","last_unstale":"2024-09-14T11:21:11.838702+0000","last_undegraded":"2024-09-14T11:21:11.838702+0000","last_fullsized":"2024-09-14T11:21:11.838702+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:13.550852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12551297,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":546,"num_read_kb":82369,"num_write":1003,"num_write_kb":43712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"260'384","reported_seq":1943,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.835413+0000","last_change":"2024-09-14T10:45:45.719252+0000","last_active":"2024-09-14T11:22:42.835413+0000","last_peered":"2024-09-14T11:22:42.835413+0000","last_clean":"2024-09-14T11:22:42.835413+0000","last_became_active":"2024-09-14T10:45:45.718949+0000","last_became_peered":"2024-09-14T10:45:45.718949+0000","last_unstale":"2024-09-14T11:22:42.835413+0000","last_undegraded":"2024-09-14T11:22:42.835413+0000","last_fullsized":"2024-09-14T11:22:42.835413+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:10.419875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2227,"num_read_kb":2135,"num_write":439,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"260'294","reported_seq":906,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.998723+0000","last_change":"2024-09-14T10:45:43.690959+0000","last_active":"2024-09-14T11:22:50.998723+0000","last_peered":"2024-09-14T11:22:50.998723+0000","last_clean":"2024-09-14T11:22:50.998723+0000","last_became_active":"2024-09-14T10:45:43.690675+0000","last_became_peered":"2024-09-14T10:45:43.690675+0000","last_unstale":"2024-09-14T11:22:50.998723+0000","last_undegraded":"2024-09-14T11:22:50.998723+0000","last_fullsized":"2024-09-14T11:22:50.998723+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:38.359419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10810592,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":513,"num_read_kb":9887,"num_write":1014,"num_write_kb":21015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"260'531","reported_seq":2240,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:16.296791+0000","last_change":"2024-09-14T10:45:45.718344+0000","last_active":"2024-09-14T11:21:16.296791+0000","last_peered":"2024-09-14T11:21:16.296791+0000","last_clean":"2024-09-14T11:21:16.296791+0000","last_became_active":"2024-09-14T10:45:45.717393+0000","last_became_peered":"2024-09-14T10:45:45.717393+0000","last_unstale":"2024-09-14T11:21:16.296791+0000","last_undegraded":"2024-09-14T11:21:16.296791+0000","last_fullsized":"2024-09-14T11:21:16.296791+0000","mapping_epoch":26,"log_start":"260'500","ondisk_log_start":"260'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":500,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:54.085248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2830,"num_read_kb":2663,"num_write":635,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"260'315","reported_seq":956,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:19.713137+0000","last_change":"2024-09-14T10:45:43.675487+0000","last_active":"2024-09-14T11:20:19.713137+0000","last_peered":"2024-09-14T11:20:19.713137+0000","last_clean":"2024-09-14T11:20:19.713137+0000","last_became_active":"2024-09-14T10:45:43.675216+0000","last_became_peered":"2024-09-14T10:45:43.675216+0000","last_unstale":"2024-09-14T11:20:19.713137+0000","last_undegraded":"2024-09-14T11:20:19.713137+0000","last_fullsized":"2024-09-14T11:20:19.713137+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:40:10.871125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6337635,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":638,"num_read_kb":14117,"num_write":1152,"num_write_kb":48801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"260'869","reported_seq":2509,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.742312+0000","last_change":"2024-09-14T10:45:45.721319+0000","last_active":"2024-09-14T11:21:28.742312+0000","last_peered":"2024-09-14T11:21:28.742312+0000","last_clean":"2024-09-14T11:21:28.742312+0000","last_became_active":"2024-09-14T10:45:45.720939+0000","last_became_peered":"2024-09-14T10:45:45.720939+0000","last_unstale":"2024-09-14T11:21:28.742312+0000","last_undegraded":"2024-09-14T11:21:28.742312+0000","last_fullsized":"2024-09-14T11:21:28.742312+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":800,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:00.246883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4139,"num_read_kb":3737,"num_write":1132,"num_write_kb":407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"260'297","reported_seq":877,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.101577+0000","last_change":"2024-09-14T10:45:43.682207+0000","last_active":"2024-09-14T11:22:51.101577+0000","last_peered":"2024-09-14T11:22:51.101577+0000","last_clean":"2024-09-14T11:22:51.101577+0000","last_became_active":"2024-09-14T10:45:43.681864+0000","last_became_peered":"2024-09-14T10:45:43.681864+0000","last_unstale":"2024-09-14T11:22:51.101577+0000","last_undegraded":"2024-09-14T11:22:51.101577+0000","last_fullsized":"2024-09-14T11:22:51.101577+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:57.070549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5245087,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":444,"num_read_kb":5481,"num_write":949,"num_write_kb":23381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"260'447","reported_seq":2094,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.733448+0000","last_change":"2024-09-14T10:45:45.722885+0000","last_active":"2024-09-14T11:21:28.733448+0000","last_peered":"2024-09-14T11:21:28.733448+0000","last_clean":"2024-09-14T11:21:28.733448+0000","last_became_active":"2024-09-14T10:45:45.722575+0000","last_became_peered":"2024-09-14T10:45:45.722575+0000","last_unstale":"2024-09-14T11:21:28.733448+0000","last_undegraded":"2024-09-14T11:21:28.733448+0000","last_fullsized":"2024-09-14T11:21:28.733448+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:17.355674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2593,"num_read_kb":2475,"num_write":496,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"260'331","reported_seq":965,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.999911+0000","last_change":"2024-09-14T10:45:43.691467+0000","last_active":"2024-09-14T11:22:50.999911+0000","last_peered":"2024-09-14T11:22:50.999911+0000","last_clean":"2024-09-14T11:22:50.999911+0000","last_became_active":"2024-09-14T10:45:43.691101+0000","last_became_peered":"2024-09-14T10:45:43.691101+0000","last_unstale":"2024-09-14T11:22:50.999911+0000","last_undegraded":"2024-09-14T11:22:50.999911+0000","last_fullsized":"2024-09-14T11:22:50.999911+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:42.090533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1158287,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":609,"num_read_kb":20829,"num_write":1118,"num_write_kb":28609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"260'964","reported_seq":2549,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.733701+0000","last_change":"2024-09-14T10:45:45.717757+0000","last_active":"2024-09-14T11:21:28.733701+0000","last_peered":"2024-09-14T11:21:28.733701+0000","last_clean":"2024-09-14T11:21:28.733701+0000","last_became_active":"2024-09-14T10:45:45.717482+0000","last_became_peered":"2024-09-14T10:45:45.717482+0000","last_unstale":"2024-09-14T11:21:28.733701+0000","last_undegraded":"2024-09-14T11:21:28.733701+0000","last_fullsized":"2024-09-14T11:21:28.733701+0000","mapping_epoch":26,"log_start":"260'900","ondisk_log_start":"260'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":900,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:38.032224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4656,"num_read_kb":4162,"num_write":1345,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"260'397","reported_seq":1036,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.957422+0000","last_change":"2024-09-14T10:45:43.682195+0000","last_active":"2024-09-14T11:22:50.957422+0000","last_peered":"2024-09-14T11:22:50.957422+0000","last_clean":"2024-09-14T11:22:50.957422+0000","last_became_active":"2024-09-14T10:45:43.681769+0000","last_became_peered":"2024-09-14T10:45:43.681769+0000","last_unstale":"2024-09-14T11:22:50.957422+0000","last_undegraded":"2024-09-14T11:22:50.957422+0000","last_fullsized":"2024-09-14T11:22:50.957422+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:19:39.686774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4319,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":866,"num_read_kb":850,"num_write":1191,"num_write_kb":26526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"260'498","reported_seq":2173,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:16.642909+0000","last_change":"2024-09-14T10:45:45.724828+0000","last_active":"2024-09-14T11:21:16.642909+0000","last_peered":"2024-09-14T11:21:16.642909+0000","last_clean":"2024-09-14T11:21:16.642909+0000","last_became_active":"2024-09-14T10:45:45.724491+0000","last_became_peered":"2024-09-14T10:45:45.724491+0000","last_unstale":"2024-09-14T11:21:16.642909+0000","last_undegraded":"2024-09-14T11:21:16.642909+0000","last_fullsized":"2024-09-14T11:21:16.642909+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:19.646816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2800,"num_read_kb":2654,"num_write":635,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"260'287","reported_seq":904,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:59.841393+0000","last_change":"2024-09-14T10:45:43.672840+0000","last_active":"2024-09-14T11:20:59.841393+0000","last_peered":"2024-09-14T11:20:59.841393+0000","last_clean":"2024-09-14T11:20:59.841393+0000","last_became_active":"2024-09-14T10:45:43.672592+0000","last_became_peered":"2024-09-14T10:45:43.672592+0000","last_unstale":"2024-09-14T11:20:59.841393+0000","last_undegraded":"2024-09-14T11:20:59.841393+0000","last_fullsized":"2024-09-14T11:20:59.841393+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:20.782416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6709220,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":509,"num_read_kb":14710,"num_write":969,"num_write_kb":26884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"260'948","reported_seq":2547,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:10.890134+0000","last_change":"2024-09-14T10:45:45.713168+0000","last_active":"2024-09-14T11:21:10.890134+0000","last_peered":"2024-09-14T11:21:10.890134+0000","last_clean":"2024-09-14T11:21:10.890134+0000","last_became_active":"2024-09-14T10:45:45.712642+0000","last_became_peered":"2024-09-14T10:45:45.712642+0000","last_unstale":"2024-09-14T11:21:10.890134+0000","last_undegraded":"2024-09-14T11:21:10.890134+0000","last_fullsized":"2024-09-14T11:21:10.890134+0000","mapping_epoch":26,"log_start":"260'900","ondisk_log_start":"260'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":900,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:58.076786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4544,"num_read_kb":4033,"num_write":1311,"num_write_kb":524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"260'357","reported_seq":998,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.108561+0000","last_change":"2024-09-14T10:45:43.675555+0000","last_active":"2024-09-14T11:22:51.108561+0000","last_peered":"2024-09-14T11:22:51.108561+0000","last_clean":"2024-09-14T11:22:51.108561+0000","last_became_active":"2024-09-14T10:45:43.675233+0000","last_became_peered":"2024-09-14T10:45:43.675233+0000","last_unstale":"2024-09-14T11:22:51.108561+0000","last_undegraded":"2024-09-14T11:22:51.108561+0000","last_fullsized":"2024-09-14T11:22:51.108561+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:01.549298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":397594,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":653,"num_read_kb":10456,"num_write":1251,"num_write_kb":38144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"260'843","reported_seq":2436,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.742304+0000","last_change":"2024-09-14T10:45:45.712273+0000","last_active":"2024-09-14T11:21:28.742304+0000","last_peered":"2024-09-14T11:21:28.742304+0000","last_clean":"2024-09-14T11:21:28.742304+0000","last_became_active":"2024-09-14T10:45:45.711947+0000","last_became_peered":"2024-09-14T10:45:45.711947+0000","last_unstale":"2024-09-14T11:21:28.742304+0000","last_undegraded":"2024-09-14T11:21:28.742304+0000","last_fullsized":"2024-09-14T11:21:28.742304+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":800,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:05:59.351828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4120,"num_read_kb":3716,"num_write":1158,"num_write_kb":467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"260'252","reported_seq":852,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:13.787841+0000","last_change":"2024-09-14T10:45:43.677879+0000","last_active":"2024-09-14T11:21:13.787841+0000","last_peered":"2024-09-14T11:21:13.787841+0000","last_clean":"2024-09-14T11:21:13.787841+0000","last_became_active":"2024-09-14T10:45:43.677597+0000","last_became_peered":"2024-09-14T10:45:43.677597+0000","last_unstale":"2024-09-14T11:21:13.787841+0000","last_undegraded":"2024-09-14T11:21:13.787841+0000","last_fullsized":"2024-09-14T11:21:13.787841+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:12.554551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672162,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":428,"num_read_kb":1898,"num_write":934,"num_write_kb":19841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"260'855","reported_seq":2368,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:13.519366+0000","last_change":"2024-09-14T10:45:45.715549+0000","last_active":"2024-09-14T11:21:13.519366+0000","last_peered":"2024-09-14T11:21:13.519366+0000","last_clean":"2024-09-14T11:21:13.519366+0000","last_became_active":"2024-09-14T10:45:45.715268+0000","last_became_peered":"2024-09-14T10:45:45.715268+0000","last_unstale":"2024-09-14T11:21:13.519366+0000","last_undegraded":"2024-09-14T11:21:13.519366+0000","last_fullsized":"2024-09-14T11:21:13.519366+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":800,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:40.990468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4230,"num_read_kb":3798,"num_write":1192,"num_write_kb":502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"260'339","reported_seq":987,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.103812+0000","last_change":"2024-09-14T10:45:43.681993+0000","last_active":"2024-09-14T11:22:51.103812+0000","last_peered":"2024-09-14T11:22:51.103812+0000","last_clean":"2024-09-14T11:22:51.103812+0000","last_became_active":"2024-09-14T10:45:43.681694+0000","last_became_peered":"2024-09-14T10:45:43.681694+0000","last_unstale":"2024-09-14T11:22:51.103812+0000","last_undegraded":"2024-09-14T11:22:51.103812+0000","last_fullsized":"2024-09-14T11:22:51.103812+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:01.339229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133849,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":697,"num_read_kb":32454,"num_write":1247,"num_write_kb":21071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"260'430","reported_seq":1883,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.336922+0000","last_change":"2024-09-14T10:45:45.723781+0000","last_active":"2024-09-14T11:21:28.336922+0000","last_peered":"2024-09-14T11:21:28.336922+0000","last_clean":"2024-09-14T11:21:28.336922+0000","last_became_active":"2024-09-14T10:45:45.723441+0000","last_became_peered":"2024-09-14T10:45:45.723441+0000","last_unstale":"2024-09-14T11:21:28.336922+0000","last_undegraded":"2024-09-14T11:21:28.336922+0000","last_fullsized":"2024-09-14T11:21:28.336922+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:25.130052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2262,"num_read_kb":2127,"num_write":517,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"260'279","reported_seq":915,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:26.616442+0000","last_change":"2024-09-14T10:45:43.681966+0000","last_active":"2024-09-14T11:21:26.616442+0000","last_peered":"2024-09-14T11:21:26.616442+0000","last_clean":"2024-09-14T11:21:26.616442+0000","last_became_active":"2024-09-14T10:45:43.681441+0000","last_became_peered":"2024-09-14T10:45:43.681441+0000","last_unstale":"2024-09-14T11:21:26.616442+0000","last_undegraded":"2024-09-14T11:21:26.616442+0000","last_fullsized":"2024-09-14T11:21:26.616442+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:17:03.032759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18979549,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":575,"num_read_kb":21101,"num_write":1018,"num_write_kb":38924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"260'751","reported_seq":2222,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:16.648120+0000","last_change":"2024-09-14T10:45:45.711729+0000","last_active":"2024-09-14T11:21:16.648120+0000","last_peered":"2024-09-14T11:21:16.648120+0000","last_clean":"2024-09-14T11:21:16.648120+0000","last_became_active":"2024-09-14T10:45:45.711402+0000","last_became_peered":"2024-09-14T10:45:45.711402+0000","last_unstale":"2024-09-14T11:21:16.648120+0000","last_undegraded":"2024-09-14T11:21:16.648120+0000","last_fullsized":"2024-09-14T11:21:16.648120+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:13:41.088714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3613,"num_read_kb":3262,"num_write":995,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"260'324","reported_seq":945,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.106623+0000","last_change":"2024-09-14T10:45:43.691446+0000","last_active":"2024-09-14T11:22:51.106623+0000","last_peered":"2024-09-14T11:22:51.106623+0000","last_clean":"2024-09-14T11:22:51.106623+0000","last_became_active":"2024-09-14T10:45:43.690104+0000","last_became_peered":"2024-09-14T10:45:43.690104+0000","last_unstale":"2024-09-14T11:22:51.106623+0000","last_undegraded":"2024-09-14T11:22:51.106623+0000","last_fullsized":"2024-09-14T11:22:51.106623+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:57.667620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289114,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":613,"num_read_kb":1889,"num_write":1131,"num_write_kb":1386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"260'584","reported_seq":2224,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:16.648085+0000","last_change":"2024-09-14T10:45:45.723438+0000","last_active":"2024-09-14T11:21:16.648085+0000","last_peered":"2024-09-14T11:21:16.648085+0000","last_clean":"2024-09-14T11:21:16.648085+0000","last_became_active":"2024-09-14T10:45:45.723163+0000","last_became_peered":"2024-09-14T10:45:45.723163+0000","last_unstale":"2024-09-14T11:21:16.648085+0000","last_undegraded":"2024-09-14T11:21:16.648085+0000","last_fullsized":"2024-09-14T11:21:16.648085+0000","mapping_epoch":26,"log_start":"260'500","ondisk_log_start":"260'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":500,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:52.106816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3275,"num_read_kb":3002,"num_write":768,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"260'309","reported_seq":975,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:14.330528+0000","last_change":"2024-09-14T10:45:43.680804+0000","last_active":"2024-09-14T11:21:14.330528+0000","last_peered":"2024-09-14T11:21:14.330528+0000","last_clean":"2024-09-14T11:21:14.330528+0000","last_became_active":"2024-09-14T10:45:43.680517+0000","last_became_peered":"2024-09-14T10:45:43.680517+0000","last_unstale":"2024-09-14T11:21:14.330528+0000","last_undegraded":"2024-09-14T11:21:14.330528+0000","last_fullsized":"2024-09-14T11:21:14.330528+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:45:55.749037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6751287,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":667,"num_read_kb":32475,"num_write":1325,"num_write_kb":39199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"260'767","reported_seq":2281,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:46.011097+0000","last_change":"2024-09-14T10:45:45.719346+0000","last_active":"2024-09-14T11:21:46.011097+0000","last_peered":"2024-09-14T11:21:46.011097+0000","last_clean":"2024-09-14T11:21:46.011097+0000","last_became_active":"2024-09-14T10:45:45.718969+0000","last_became_peered":"2024-09-14T10:45:45.718969+0000","last_unstale":"2024-09-14T11:21:46.011097+0000","last_undegraded":"2024-09-14T11:21:46.011097+0000","last_fullsized":"2024-09-14T11:21:46.011097+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:07:46.732678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3670,"num_read_kb":3326,"num_write":1002,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"260'266","reported_seq":886,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:08.239208+0000","last_change":"2024-09-14T10:45:43.691080+0000","last_active":"2024-09-14T11:21:08.239208+0000","last_peered":"2024-09-14T11:21:08.239208+0000","last_clean":"2024-09-14T11:21:08.239208+0000","last_became_active":"2024-09-14T10:45:43.690489+0000","last_became_peered":"2024-09-14T10:45:43.690489+0000","last_unstale":"2024-09-14T11:21:08.239208+0000","last_undegraded":"2024-09-14T11:21:08.239208+0000","last_fullsized":"2024-09-14T11:21:08.239208+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:15.282672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7471466,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":494,"num_read_kb":22088,"num_write":989,"num_write_kb":34450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"260'625","reported_seq":2199,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:46.134870+0000","last_change":"2024-09-14T10:45:45.727368+0000","last_active":"2024-09-14T11:21:46.134870+0000","last_peered":"2024-09-14T11:21:46.134870+0000","last_clean":"2024-09-14T11:21:46.134870+0000","last_became_active":"2024-09-14T10:45:45.727095+0000","last_became_peered":"2024-09-14T10:45:45.727095+0000","last_unstale":"2024-09-14T11:21:46.134870+0000","last_undegraded":"2024-09-14T11:21:46.134870+0000","last_fullsized":"2024-09-14T11:21:46.134870+0000","mapping_epoch":26,"log_start":"260'600","ondisk_log_start":"260'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":600,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:49.272823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3428,"num_read_kb":3090,"num_write":924,"num_write_kb":450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"260'288","reported_seq":874,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.008854+0000","last_change":"2024-09-14T10:45:43.689500+0000","last_active":"2024-09-14T11:22:51.008854+0000","last_peered":"2024-09-14T11:22:51.008854+0000","last_clean":"2024-09-14T11:22:51.008854+0000","last_became_active":"2024-09-14T10:45:43.689186+0000","last_became_peered":"2024-09-14T10:45:43.689186+0000","last_unstale":"2024-09-14T11:22:51.008854+0000","last_undegraded":"2024-09-14T11:22:51.008854+0000","last_fullsized":"2024-09-14T11:22:51.008854+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:39.910157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6378836,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":438,"num_read_kb":44560,"num_write":917,"num_write_kb":69256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"260'1083","reported_seq":2821,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.337221+0000","last_change":"2024-09-14T10:45:45.720903+0000","last_active":"2024-09-14T11:21:28.337221+0000","last_peered":"2024-09-14T11:21:28.337221+0000","last_clean":"2024-09-14T11:21:28.337221+0000","last_became_active":"2024-09-14T10:45:45.720636+0000","last_became_peered":"2024-09-14T10:45:45.720636+0000","last_unstale":"2024-09-14T11:21:28.337221+0000","last_undegraded":"2024-09-14T11:21:28.337221+0000","last_fullsized":"2024-09-14T11:21:28.337221+0000","mapping_epoch":26,"log_start":"260'1000","ondisk_log_start":"260'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":1000,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:01:02.622281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5348,"num_read_kb":4870,"num_write":1559,"num_write_kb":616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"260'272","reported_seq":944,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:34.177202+0000","last_change":"2024-09-14T10:45:43.682868+0000","last_active":"2024-09-14T11:22:34.177202+0000","last_peered":"2024-09-14T11:22:34.177202+0000","last_clean":"2024-09-14T11:22:34.177202+0000","last_became_active":"2024-09-14T10:45:43.682573+0000","last_became_peered":"2024-09-14T10:45:43.682573+0000","last_unstale":"2024-09-14T11:22:34.177202+0000","last_undegraded":"2024-09-14T11:22:34.177202+0000","last_fullsized":"2024-09-14T11:22:34.177202+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:56.318257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5599748,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":743,"num_read_kb":3981,"num_write":964,"num_write_kb":35472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"260'303","reported_seq":931,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:26.983173+0000","last_change":"2024-09-14T10:45:43.673791+0000","last_active":"2024-09-14T11:21:26.983173+0000","last_peered":"2024-09-14T11:21:26.983173+0000","last_clean":"2024-09-14T11:21:26.983173+0000","last_became_active":"2024-09-14T10:45:43.673527+0000","last_became_peered":"2024-09-14T10:45:43.673527+0000","last_unstale":"2024-09-14T11:21:26.983173+0000","last_undegraded":"2024-09-14T11:21:26.983173+0000","last_fullsized":"2024-09-14T11:21:26.983173+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:05:57.311802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12972944,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":604,"num_read_kb":21996,"num_write":1143,"num_write_kb":25813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"260'1013","reported_seq":2612,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:16.297531+0000","last_change":"2024-09-14T10:45:45.724368+0000","last_active":"2024-09-14T11:21:16.297531+0000","last_peered":"2024-09-14T11:21:16.297531+0000","last_clean":"2024-09-14T11:21:16.297531+0000","last_became_active":"2024-09-14T10:45:45.724040+0000","last_became_peered":"2024-09-14T10:45:45.724040+0000","last_unstale":"2024-09-14T11:21:16.297531+0000","last_undegraded":"2024-09-14T11:21:16.297531+0000","last_fullsized":"2024-09-14T11:21:16.297531+0000","mapping_epoch":26,"log_start":"260'1000","ondisk_log_start":"260'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":1000,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:23.578632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4769,"num_read_kb":4210,"num_write":1424,"num_write_kb":631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"260'359","reported_seq":991,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.079003+0000","last_change":"2024-09-14T10:45:43.687437+0000","last_active":"2024-09-14T11:22:51.079003+0000","last_peered":"2024-09-14T11:22:51.079003+0000","last_clean":"2024-09-14T11:22:51.079003+0000","last_became_active":"2024-09-14T10:45:43.687162+0000","last_became_peered":"2024-09-14T10:45:43.687162+0000","last_unstale":"2024-09-14T11:22:51.079003+0000","last_undegraded":"2024-09-14T11:22:51.079003+0000","last_fullsized":"2024-09-14T11:22:51.079003+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:46.791778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5587407,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":643,"num_read_kb":37348,"num_write":1163,"num_write_kb":26064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"260'477","reported_seq":2017,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.049726+0000","last_change":"2024-09-14T10:45:45.712133+0000","last_active":"2024-09-14T11:21:27.049726+0000","last_peered":"2024-09-14T11:21:27.049726+0000","last_clean":"2024-09-14T11:21:27.049726+0000","last_became_active":"2024-09-14T10:45:45.711869+0000","last_became_peered":"2024-09-14T10:45:45.711869+0000","last_unstale":"2024-09-14T11:21:27.049726+0000","last_undegraded":"2024-09-14T11:21:27.049726+0000","last_fullsized":"2024-09-14T11:21:27.049726+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:06.317656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2555,"num_read_kb":2382,"num_write":592,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10817,"num_read_kb":8523,"num_write":3117,"num_write_kb":1010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1096,"ondisk_log_size":1096,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":14831,"num_objects":87,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":15133,"num_read_kb":14796,"num_write":17057,"num_write_kb":4975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":29662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1479,"ondisk_log_size":1479,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":767,"ondisk_log_size":767,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1769083,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":16792,"num_read_kb":34092,"num_write":14203,"num_write_kb":11560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2256896,"data_stored":1826876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2086,"ondisk_log_size":2086,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2399,"num_read_kb":2860,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":219533,"num_read_kb":201172,"num_write":55836,"num_write_kb":19050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":143,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4159,"ondisk_log_size":4159,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":419112220,"num_objects":3126,"num_object_clones":0,"num_object_copies":6252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3126,"num_whiteouts":0,"num_read":41304,"num_read_kb":2138030,"num_write":70355,"num_write_kb":2157996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":893042688,"data_stored":869394264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3978,"ondisk_log_size":3978,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":41542397,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":122,"num_read_kb":175817,"num_write":141,"num_write_kb":116354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73658368,"data_stored":73650820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81,"ondisk_log_size":81,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":56683470,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":119,"num_read_kb":174730,"num_write":141,"num_write_kb":116354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110227456,"data_stored":110224422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81,"ondisk_log_size":81,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509894,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":431088,"kb_used_data":237472,"kb_used_omap":1,"kb_used_meta":193598,"kb_avail":93940752,"statfs":{"total":96636764160,"available":96195330048,"internally_reserved":0,"allocated":243171328,"data_stored":236611721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":198244807},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509892,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":420236,"kb_used_data":150268,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":93951604,"statfs":{"total":96636764160,"available":96206442496,"internally_reserved":0,"allocated":153874432,"data_stored":148836196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":276429253},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509891,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284676,"kb_used_data":199412,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94087164,"statfs":{"total":96636764160,"available":96345255936,"internally_reserved":0,"allocated":204197888,"data_stored":197333461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542597,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":319504,"kb_used_data":99536,"kb_used_omap":1,"kb_used_meta":219902,"kb_avail":94052336,"statfs":{"total":96636764160,"available":96309592064,"internally_reserved":0,"allocated":101924864,"data_stored":98410709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":225180106},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542597,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":222068,"kb_used_data":128484,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94149772,"statfs":{"total":96636764160,"available":96409366528,"internally_reserved":0,"allocated":131567616,"data_stored":127010417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":95812038},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542599,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":413032,"kb_used_data":157016,"kb_used_omap":1,"kb_used_meta":255998,"kb_avail":93958808,"statfs":{"total":96636764160,"available":96213819392,"internally_reserved":0,"allocated":160784384,"data_stored":154528840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":262142405},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542598,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":262796,"kb_used_data":83120,"kb_used_omap":1,"kb_used_meta":179646,"kb_avail":94109044,"statfs":{"total":96636764160,"available":96367661056,"internally_reserved":0,"allocated":85114880,"data_stored":82138617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":183957957},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575301,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":362112,"kb_used_data":250416,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94009728,"statfs":{"total":96636764160,"available":96265961472,"internally_reserved":0,"allocated":256425984,"data_stored":250268894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":164352000,"data_stored":159069268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":128159744,"data_stored":124666590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":220647424,"data_stored":216021462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":208883712,"data_stored":203865931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45891584,"data_stored":44693796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25268224,"data_stored":23772093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":51146752,"data_stored":49646570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":48693248,"data_stored":47658554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":569344,"data_stored":474626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":472745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":127276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":263709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":46022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":188416,"data_stored":140872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":176128,"data_stored":133606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":212992,"data_stored":168020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":5195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9498624,"data_stored":9497550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":17887232,"data_stored":17886158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":26214400,"data_stored":26214400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3145728,"data_stored":3145728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6295552,"data_stored":6294666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":26218496,"data_stored":26217604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3149824,"data_stored":3148938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5832704,"data_stored":5830447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":13631488,"data_stored":13631488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3792896,"data_stored":3790457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":9498624,"data_stored":9497550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:22:52.628 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T11:22:52.951 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:22:52.952 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":260,"fsid":"60ee9974-9b9f-4b85-b208-ccd9f5b7c3b9","created":"2024-09-14T10:45:13.908654+0000","modified":"2024-09-14T11:11:43.579323+0000","last_up_change":"2024-09-14T10:45:26.523342+0000","last_in_change":"2024-09-14T10:45:16.472549+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":15,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":68,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T10:45:26.951609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T10:45:32.306341+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-14T10:45:42.504398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-14T10:45:43.997603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-14T10:45:45.863459+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-14T10:45:47.785702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-14T10:45:49.743868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-14T10:45:51.827018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-09-14T10:59:46.419682+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"251","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-09-14T11:01:19.048888+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"254","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-09-14T11:01:22.683603+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"257","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":68,"pool_name":"default.rgw.otp","create_time":"2024-09-14T11:11:40.799189+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"260","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cdfc5a56-a482-40e7-af02-5d9af12dd4ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":258,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2189588316},{"type":"v1","addr":"172.21.15.97:6801","nonce":2189588316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2189588316},{"type":"v1","addr":"172.21.15.97:6803","nonce":2189588316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":2189588316},{"type":"v1","addr":"172.21.15.97:6807","nonce":2189588316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":2189588316},{"type":"v1","addr":"172.21.15.97:6805","nonce":2189588316}]},"public_addr":"172.21.15.97:6801/2189588316","cluster_addr":"172.21.15.97:6803/2189588316","heartbeat_back_addr":"172.21.15.97:6807/2189588316","heartbeat_front_addr":"172.21.15.97:6805/2189588316","state":["exists","up"]},{"osd":1,"uuid":"c0fe1ede-ef7f-4181-8112-6fde8460b61b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":258,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":4093696477},{"type":"v1","addr":"172.21.15.97:6817","nonce":4093696477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":4093696477},{"type":"v1","addr":"172.21.15.97:6819","nonce":4093696477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":4093696477},{"type":"v1","addr":"172.21.15.97:6823","nonce":4093696477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":4093696477},{"type":"v1","addr":"172.21.15.97:6821","nonce":4093696477}]},"public_addr":"172.21.15.97:6817/4093696477","cluster_addr":"172.21.15.97:6819/4093696477","heartbeat_back_addr":"172.21.15.97:6823/4093696477","heartbeat_front_addr":"172.21.15.97:6821/4093696477","state":["exists","up"]},{"osd":2,"uuid":"976dd4fa-681e-42f9-b02b-6667894d9c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":258,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":2081705332},{"type":"v1","addr":"172.21.15.97:6809","nonce":2081705332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":2081705332},{"type":"v1","addr":"172.21.15.97:6811","nonce":2081705332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":2081705332},{"type":"v1","addr":"172.21.15.97:6815","nonce":2081705332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":2081705332},{"type":"v1","addr":"172.21.15.97:6813","nonce":2081705332}]},"public_addr":"172.21.15.97:6809/2081705332","cluster_addr":"172.21.15.97:6811/2081705332","heartbeat_back_addr":"172.21.15.97:6815/2081705332","heartbeat_front_addr":"172.21.15.97:6813/2081705332","state":["exists","up"]},{"osd":3,"uuid":"995c66eb-223f-4f55-923c-f011e5ea02ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":258,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":2606963136},{"type":"v1","addr":"172.21.15.97:6825","nonce":2606963136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":2606963136},{"type":"v1","addr":"172.21.15.97:6827","nonce":2606963136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":2606963136},{"type":"v1","addr":"172.21.15.97:6831","nonce":2606963136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":2606963136},{"type":"v1","addr":"172.21.15.97:6829","nonce":2606963136}]},"public_addr":"172.21.15.97:6825/2606963136","cluster_addr":"172.21.15.97:6827/2606963136","heartbeat_back_addr":"172.21.15.97:6831/2606963136","heartbeat_front_addr":"172.21.15.97:6829/2606963136","state":["exists","up"]},{"osd":4,"uuid":"66b0bec0-8bf3-4f2b-8ee5-5c6cfbea4b66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":258,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":1010851305},{"type":"v1","addr":"172.21.15.152:6809","nonce":1010851305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1010851305},{"type":"v1","addr":"172.21.15.152:6811","nonce":1010851305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1010851305},{"type":"v1","addr":"172.21.15.152:6815","nonce":1010851305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1010851305},{"type":"v1","addr":"172.21.15.152:6813","nonce":1010851305}]},"public_addr":"172.21.15.152:6809/1010851305","cluster_addr":"172.21.15.152:6811/1010851305","heartbeat_back_addr":"172.21.15.152:6815/1010851305","heartbeat_front_addr":"172.21.15.152:6813/1010851305","state":["exists","up"]},{"osd":5,"uuid":"dfcb9f2f-d1fa-44c2-9408-ae3354291069","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":258,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3767355481},{"type":"v1","addr":"172.21.15.152:6825","nonce":3767355481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":3767355481},{"type":"v1","addr":"172.21.15.152:6827","nonce":3767355481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":3767355481},{"type":"v1","addr":"172.21.15.152:6831","nonce":3767355481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":3767355481},{"type":"v1","addr":"172.21.15.152:6829","nonce":3767355481}]},"public_addr":"172.21.15.152:6825/3767355481","cluster_addr":"172.21.15.152:6827/3767355481","heartbeat_back_addr":"172.21.15.152:6831/3767355481","heartbeat_front_addr":"172.21.15.152:6829/3767355481","state":["exists","up"]},{"osd":6,"uuid":"e42c37d5-26d2-492a-9fcd-46c1e405017b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":258,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":410517460},{"type":"v1","addr":"172.21.15.152:6801","nonce":410517460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":410517460},{"type":"v1","addr":"172.21.15.152:6803","nonce":410517460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":410517460},{"type":"v1","addr":"172.21.15.152:6807","nonce":410517460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":410517460},{"type":"v1","addr":"172.21.15.152:6805","nonce":410517460}]},"public_addr":"172.21.15.152:6801/410517460","cluster_addr":"172.21.15.152:6803/410517460","heartbeat_back_addr":"172.21.15.152:6807/410517460","heartbeat_front_addr":"172.21.15.152:6805/410517460","state":["exists","up"]},{"osd":7,"uuid":"0f7d6f9a-cde8-4a3e-82b3-f3e0ef67e0b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":258,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3781551304},{"type":"v1","addr":"172.21.15.152:6817","nonce":3781551304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":3781551304},{"type":"v1","addr":"172.21.15.152:6819","nonce":3781551304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":3781551304},{"type":"v1","addr":"172.21.15.152:6823","nonce":3781551304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3781551304},{"type":"v1","addr":"172.21.15.152:6821","nonce":3781551304}]},"public_addr":"172.21.15.152:6817/3781551304","cluster_addr":"172.21.15.152:6819/3781551304","heartbeat_back_addr":"172.21.15.152:6823/3781551304","heartbeat_front_addr":"172.21.15.152:6821/3781551304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:45:23.025497+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:45:23.458517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:45:22.565887+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:45:23.726820+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:45:22.671680+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:45:23.107369+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:45:22.326483+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:45:23.034557+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:22:53.966 INFO:tasks.ceph:Scrubbing osd.0 2024-09-14T11:22:53.966 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:22:54.116 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-14T11:22:54.116 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:22:54.116 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-14T11:22:54.127 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-14T11:22:54.427 INFO:teuthology.orchestra.run.smithi097.stderr:instructed osd(s) 0 to deep-scrub 2024-09-14T11:22:54.441 INFO:tasks.ceph:Scrubbing osd.1 2024-09-14T11:22:54.441 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:22:54.577 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-14T11:22:54.577 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:22:54.577 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-14T11:22:54.587 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-14T11:22:54.892 INFO:teuthology.orchestra.run.smithi097.stderr:instructed osd(s) 1 to deep-scrub 2024-09-14T11:22:54.906 INFO:tasks.ceph:Scrubbing osd.2 2024-09-14T11:22:54.906 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:22:55.044 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-14T11:22:55.044 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:22:55.044 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-14T11:22:55.055 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-14T11:22:55.354 INFO:teuthology.orchestra.run.smithi097.stderr:instructed osd(s) 2 to deep-scrub 2024-09-14T11:22:55.367 INFO:tasks.ceph:Scrubbing osd.3 2024-09-14T11:22:55.367 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:22:55.502 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-14T11:22:55.502 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:22:55.503 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-14T11:22:55.513 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-14T11:22:55.820 INFO:teuthology.orchestra.run.smithi097.stderr:instructed osd(s) 3 to deep-scrub 2024-09-14T11:22:55.831 INFO:tasks.ceph:Scrubbing osd.4 2024-09-14T11:22:55.831 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:22:55.968 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-14T11:22:55.968 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:22:55.968 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-14T11:22:55.979 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-14T11:22:56.278 INFO:teuthology.orchestra.run.smithi097.stderr:instructed osd(s) 4 to deep-scrub 2024-09-14T11:22:56.291 INFO:tasks.ceph:Scrubbing osd.5 2024-09-14T11:22:56.292 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:22:56.428 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-14T11:22:56.428 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:22:56.428 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-14T11:22:56.439 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-14T11:22:56.739 INFO:teuthology.orchestra.run.smithi097.stderr:instructed osd(s) 5 to deep-scrub 2024-09-14T11:22:56.752 INFO:tasks.ceph:Scrubbing osd.6 2024-09-14T11:22:56.752 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:22:56.890 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-14T11:22:56.891 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:22:56.891 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-14T11:22:56.901 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-14T11:22:57.208 INFO:teuthology.orchestra.run.smithi097.stderr:instructed osd(s) 6 to deep-scrub 2024-09-14T11:22:57.221 INFO:tasks.ceph:Scrubbing osd.7 2024-09-14T11:22:57.222 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:22:57.359 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-14T11:22:57.359 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:22:57.359 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-14T11:22:57.370 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-14T11:22:57.677 INFO:teuthology.orchestra.run.smithi097.stderr:instructed osd(s) 7 to deep-scrub 2024-09-14T11:22:57.690 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:22:58.013 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:22:58.025 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-09-14T11:22:58.027 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":1379,"stamp":"2024-09-14T11:22:57.758800+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":35991604,"num_objects":734,"num_object_clones":0,"num_object_copies":1468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":734,"num_whiteouts":0,"num_read":309464,"num_read_kb":2752545,"num_write":164025,"num_write_kb":2428992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":190,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13676,"ondisk_log_size":13676,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1494452,"kb_used_data":96232,"kb_used_omap":12,"kb_used_meta":1397107,"kb_avail":753480268,"statfs":{"total":773094113280,"available":771563794432,"internally_reserved":0,"allocated":98541568,"data_stored":85444104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1430638128},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-656863178,"num_objects":-4113,"num_object_clones":0,"num_object_copies":-8226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4113,"num_whiteouts":0,"num_read":4754,"num_read_kb":4309,"num_write":4381,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004656"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:12.205144+0000","last_change":"2024-09-14T11:11:42.593208+0000","last_active":"2024-09-14T11:19:12.205144+0000","last_peered":"2024-09-14T11:19:12.205144+0000","last_clean":"2024-09-14T11:19:12.205144+0000","last_became_active":"2024-09-14T11:11:42.592933+0000","last_became_peered":"2024-09-14T11:11:42.592933+0000","last_unstale":"2024-09-14T11:19:12.205144+0000","last_undegraded":"2024-09-14T11:19:12.205144+0000","last_fullsized":"2024-09-14T11:19:12.205144+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:50.427016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"260'2","reported_seq":31,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.128574+0000","last_change":"2024-09-14T11:01:23.882191+0000","last_active":"2024-09-14T11:21:27.128574+0000","last_peered":"2024-09-14T11:21:27.128574+0000","last_clean":"2024-09-14T11:21:27.128574+0000","last_became_active":"2024-09-14T11:01:23.881902+0000","last_became_peered":"2024-09-14T11:01:23.881902+0000","last_unstale":"2024-09-14T11:21:27.128574+0000","last_undegraded":"2024-09-14T11:21:27.128574+0000","last_fullsized":"2024-09-14T11:21:27.128574+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:46.612242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"260'8","reported_seq":51,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:21.007496+0000","last_change":"2024-09-14T11:01:20.867414+0000","last_active":"2024-09-14T11:21:21.007496+0000","last_peered":"2024-09-14T11:21:21.007496+0000","last_clean":"2024-09-14T11:21:21.007496+0000","last_became_active":"2024-09-14T11:01:20.867142+0000","last_became_peered":"2024-09-14T11:01:20.867142+0000","last_unstale":"2024-09-14T11:21:21.007496+0000","last_undegraded":"2024-09-14T11:21:21.007496+0000","last_fullsized":"2024-09-14T11:21:21.007496+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:51.245462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20482,"num_write":18,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"260'30","reported_seq":123,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:41.126104+0000","last_change":"2024-09-14T10:59:48.417565+0000","last_active":"2024-09-14T11:20:41.126104+0000","last_peered":"2024-09-14T11:20:41.126104+0000","last_clean":"2024-09-14T11:20:41.126104+0000","last_became_active":"2024-09-14T10:59:48.416537+0000","last_became_peered":"2024-09-14T10:59:48.416537+0000","last_unstale":"2024-09-14T11:20:41.126104+0000","last_undegraded":"2024-09-14T11:20:41.126104+0000","last_fullsized":"2024-09-14T11:20:41.126104+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:15.136259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":249,"num_read_kb":173,"num_write":73,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:15.984097+0000","last_change":"2024-09-14T11:11:42.588136+0000","last_active":"2024-09-14T11:19:15.984097+0000","last_peered":"2024-09-14T11:19:15.984097+0000","last_clean":"2024-09-14T11:19:15.984097+0000","last_became_active":"2024-09-14T11:11:42.587818+0000","last_became_peered":"2024-09-14T11:11:42.587818+0000","last_unstale":"2024-09-14T11:19:15.984097+0000","last_undegraded":"2024-09-14T11:19:15.984097+0000","last_fullsized":"2024-09-14T11:19:15.984097+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:37.528920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"260'2","reported_seq":30,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:25.002242+0000","last_change":"2024-09-14T11:01:23.881376+0000","last_active":"2024-09-14T11:21:25.002242+0000","last_peered":"2024-09-14T11:21:25.002242+0000","last_clean":"2024-09-14T11:21:25.002242+0000","last_became_active":"2024-09-14T11:01:23.881074+0000","last_became_peered":"2024-09-14T11:01:23.881074+0000","last_unstale":"2024-09-14T11:21:25.002242+0000","last_undegraded":"2024-09-14T11:21:25.002242+0000","last_fullsized":"2024-09-14T11:21:25.002242+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:53.183326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":571,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"260'8","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:21.253973+0000","last_change":"2024-09-14T11:01:20.868669+0000","last_active":"2024-09-14T11:21:21.253973+0000","last_peered":"2024-09-14T11:21:21.253973+0000","last_clean":"2024-09-14T11:21:21.253973+0000","last_became_active":"2024-09-14T11:01:20.868373+0000","last_became_peered":"2024-09-14T11:01:20.868373+0000","last_unstale":"2024-09-14T11:21:21.253973+0000","last_undegraded":"2024-09-14T11:21:21.253973+0000","last_fullsized":"2024-09-14T11:21:21.253973+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:33:49.244253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10811,"num_write":13,"num_write_kb":10811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"260'56","reported_seq":195,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:56.120455+0000","last_change":"2024-09-14T10:59:48.416508+0000","last_active":"2024-09-14T11:19:56.120455+0000","last_peered":"2024-09-14T11:19:56.120455+0000","last_clean":"2024-09-14T11:19:56.120455+0000","last_became_active":"2024-09-14T10:59:48.416222+0000","last_became_peered":"2024-09-14T10:59:48.416222+0000","last_unstale":"2024-09-14T11:19:56.120455+0000","last_undegraded":"2024-09-14T11:19:56.120455+0000","last_fullsized":"2024-09-14T11:19:56.120455+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:30.061341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":447,"num_read_kb":304,"num_write":135,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:57.106315+0000","last_change":"2024-09-14T11:11:42.593589+0000","last_active":"2024-09-14T11:18:57.106315+0000","last_peered":"2024-09-14T11:18:57.106315+0000","last_clean":"2024-09-14T11:18:57.106315+0000","last_became_active":"2024-09-14T11:11:42.593314+0000","last_became_peered":"2024-09-14T11:11:42.593314+0000","last_unstale":"2024-09-14T11:18:57.106315+0000","last_undegraded":"2024-09-14T11:18:57.106315+0000","last_fullsized":"2024-09-14T11:18:57.106315+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:49.061960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"260'3","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:16.262309+0000","last_change":"2024-09-14T11:01:23.893105+0000","last_active":"2024-09-14T11:22:16.262309+0000","last_peered":"2024-09-14T11:22:16.262309+0000","last_clean":"2024-09-14T11:22:16.262309+0000","last_became_active":"2024-09-14T11:01:23.892846+0000","last_became_peered":"2024-09-14T11:01:23.892846+0000","last_unstale":"2024-09-14T11:22:16.262309+0000","last_undegraded":"2024-09-14T11:22:16.262309+0000","last_fullsized":"2024-09-14T11:22:16.262309+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:50.339780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"260'2","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:26.008205+0000","last_change":"2024-09-14T11:01:20.864944+0000","last_active":"2024-09-14T11:21:26.008205+0000","last_peered":"2024-09-14T11:21:26.008205+0000","last_clean":"2024-09-14T11:21:26.008205+0000","last_became_active":"2024-09-14T11:01:20.864672+0000","last_became_peered":"2024-09-14T11:01:20.864672+0000","last_unstale":"2024-09-14T11:21:26.008205+0000","last_undegraded":"2024-09-14T11:21:26.008205+0000","last_fullsized":"2024-09-14T11:21:26.008205+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:06.369402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"260'48","reported_seq":168,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:50.988603+0000","last_change":"2024-09-14T10:59:48.419842+0000","last_active":"2024-09-14T11:19:50.988603+0000","last_peered":"2024-09-14T11:19:50.988603+0000","last_clean":"2024-09-14T11:19:50.988603+0000","last_became_active":"2024-09-14T10:59:48.419525+0000","last_became_peered":"2024-09-14T10:59:48.419525+0000","last_unstale":"2024-09-14T11:19:50.988603+0000","last_undegraded":"2024-09-14T11:19:50.988603+0000","last_fullsized":"2024-09-14T11:19:50.988603+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:04.024597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":364,"num_read_kb":247,"num_write":125,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:01.233674+0000","last_change":"2024-09-14T11:11:42.587584+0000","last_active":"2024-09-14T11:19:01.233674+0000","last_peered":"2024-09-14T11:19:01.233674+0000","last_clean":"2024-09-14T11:19:01.233674+0000","last_became_active":"2024-09-14T11:11:42.587218+0000","last_became_peered":"2024-09-14T11:11:42.587218+0000","last_unstale":"2024-09-14T11:19:01.233674+0000","last_undegraded":"2024-09-14T11:19:01.233674+0000","last_fullsized":"2024-09-14T11:19:01.233674+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:55.734324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"260'2","reported_seq":33,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:26.254717+0000","last_change":"2024-09-14T11:01:23.887367+0000","last_active":"2024-09-14T11:21:26.254717+0000","last_peered":"2024-09-14T11:21:26.254717+0000","last_clean":"2024-09-14T11:21:26.254717+0000","last_became_active":"2024-09-14T11:01:23.886771+0000","last_became_peered":"2024-09-14T11:01:23.886771+0000","last_unstale":"2024-09-14T11:21:26.254717+0000","last_undegraded":"2024-09-14T11:21:26.254717+0000","last_fullsized":"2024-09-14T11:21:26.254717+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:15.920702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":118,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"257'5","reported_seq":50,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:07.117403+0000","last_change":"2024-09-14T11:01:20.862128+0000","last_active":"2024-09-14T11:20:07.117403+0000","last_peered":"2024-09-14T11:20:07.117403+0000","last_clean":"2024-09-14T11:20:07.117403+0000","last_became_active":"2024-09-14T11:01:20.861799+0000","last_became_peered":"2024-09-14T11:01:20.861799+0000","last_unstale":"2024-09-14T11:20:07.117403+0000","last_undegraded":"2024-09-14T11:20:07.117403+0000","last_fullsized":"2024-09-14T11:20:07.117403+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:16.963059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"260'15","reported_seq":77,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:50.988580+0000","last_change":"2024-09-14T10:59:48.411700+0000","last_active":"2024-09-14T11:19:50.988580+0000","last_peered":"2024-09-14T11:19:50.988580+0000","last_clean":"2024-09-14T11:19:50.988580+0000","last_became_active":"2024-09-14T10:59:48.411423+0000","last_became_peered":"2024-09-14T10:59:48.411423+0000","last_unstale":"2024-09-14T11:19:50.988580+0000","last_undegraded":"2024-09-14T11:19:50.988580+0000","last_fullsized":"2024-09-14T11:19:50.988580+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:56.473790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":68,"num_write":41,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:50.995962+0000","last_change":"2024-09-14T11:11:42.584008+0000","last_active":"2024-09-14T11:19:50.995962+0000","last_peered":"2024-09-14T11:19:50.995962+0000","last_clean":"2024-09-14T11:19:50.995962+0000","last_became_active":"2024-09-14T11:11:42.583717+0000","last_became_peered":"2024-09-14T11:11:42.583717+0000","last_unstale":"2024-09-14T11:19:50.995962+0000","last_undegraded":"2024-09-14T11:19:50.995962+0000","last_fullsized":"2024-09-14T11:19:50.995962+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:22:54.043934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"257'3","reported_seq":33,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:22.197565+0000","last_change":"2024-09-14T11:01:23.894300+0000","last_active":"2024-09-14T11:18:22.197565+0000","last_peered":"2024-09-14T11:18:22.197565+0000","last_clean":"2024-09-14T11:18:22.197565+0000","last_became_active":"2024-09-14T11:01:23.894107+0000","last_became_peered":"2024-09-14T11:01:23.894107+0000","last_unstale":"2024-09-14T11:18:22.197565+0000","last_undegraded":"2024-09-14T11:18:22.197565+0000","last_fullsized":"2024-09-14T11:18:22.197565+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:41:19.577357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"260'6","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:41.248008+0000","last_change":"2024-09-14T11:01:20.868842+0000","last_active":"2024-09-14T11:20:41.248008+0000","last_peered":"2024-09-14T11:20:41.248008+0000","last_clean":"2024-09-14T11:20:41.248008+0000","last_became_active":"2024-09-14T11:01:20.867768+0000","last_became_peered":"2024-09-14T11:01:20.867768+0000","last_unstale":"2024-09-14T11:20:41.248008+0000","last_undegraded":"2024-09-14T11:20:41.248008+0000","last_fullsized":"2024-09-14T11:20:41.248008+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:10.338737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"260'40","reported_seq":146,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:50.988519+0000","last_change":"2024-09-14T10:59:48.413952+0000","last_active":"2024-09-14T11:19:50.988519+0000","last_peered":"2024-09-14T11:19:50.988519+0000","last_clean":"2024-09-14T11:19:50.988519+0000","last_became_active":"2024-09-14T10:59:48.413296+0000","last_became_peered":"2024-09-14T10:59:48.413296+0000","last_unstale":"2024-09-14T11:19:50.988519+0000","last_undegraded":"2024-09-14T11:19:50.988519+0000","last_fullsized":"2024-09-14T11:19:50.988519+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:50.801079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":304,"num_read_kb":193,"num_write":101,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:06.121565+0000","last_change":"2024-09-14T11:11:42.582601+0000","last_active":"2024-09-14T11:20:06.121565+0000","last_peered":"2024-09-14T11:20:06.121565+0000","last_clean":"2024-09-14T11:20:06.121565+0000","last_became_active":"2024-09-14T11:11:42.582310+0000","last_became_peered":"2024-09-14T11:11:42.582310+0000","last_unstale":"2024-09-14T11:20:06.121565+0000","last_undegraded":"2024-09-14T11:20:06.121565+0000","last_fullsized":"2024-09-14T11:20:06.121565+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:47:53.329342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"260'8","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:47.123328+0000","last_change":"2024-09-14T11:01:23.888252+0000","last_active":"2024-09-14T11:20:47.123328+0000","last_peered":"2024-09-14T11:20:47.123328+0000","last_clean":"2024-09-14T11:20:47.123328+0000","last_became_active":"2024-09-14T11:01:23.888017+0000","last_became_peered":"2024-09-14T11:01:23.888017+0000","last_unstale":"2024-09-14T11:20:47.123328+0000","last_undegraded":"2024-09-14T11:20:47.123328+0000","last_fullsized":"2024-09-14T11:20:47.123328+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:57.684875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":11264,"num_write":18,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"257'2","reported_seq":37,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:22.101658+0000","last_change":"2024-09-14T11:01:20.863609+0000","last_active":"2024-09-14T11:18:22.101658+0000","last_peered":"2024-09-14T11:18:22.101658+0000","last_clean":"2024-09-14T11:18:22.101658+0000","last_became_active":"2024-09-14T11:01:20.863258+0000","last_became_peered":"2024-09-14T11:01:20.863258+0000","last_unstale":"2024-09-14T11:18:22.101658+0000","last_undegraded":"2024-09-14T11:18:22.101658+0000","last_fullsized":"2024-09-14T11:18:22.101658+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:55.353304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"260'62","reported_seq":215,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:18.893367+0000","last_change":"2024-09-14T10:59:48.420297+0000","last_active":"2024-09-14T11:20:18.893367+0000","last_peered":"2024-09-14T11:20:18.893367+0000","last_clean":"2024-09-14T11:20:18.893367+0000","last_became_active":"2024-09-14T10:59:48.419994+0000","last_became_peered":"2024-09-14T10:59:48.419994+0000","last_unstale":"2024-09-14T11:20:18.893367+0000","last_undegraded":"2024-09-14T11:20:18.893367+0000","last_fullsized":"2024-09-14T11:20:18.893367+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:48.789488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":520,"num_read_kb":329,"num_write":161,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"260'1","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:14.986121+0000","last_change":"2024-09-14T11:11:42.588572+0000","last_active":"2024-09-14T11:19:14.986121+0000","last_peered":"2024-09-14T11:19:14.986121+0000","last_clean":"2024-09-14T11:19:14.986121+0000","last_became_active":"2024-09-14T11:11:42.588308+0000","last_became_peered":"2024-09-14T11:11:42.588308+0000","last_unstale":"2024-09-14T11:19:14.986121+0000","last_undegraded":"2024-09-14T11:19:14.986121+0000","last_fullsized":"2024-09-14T11:19:14.986121+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:38:16.020344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:54.982805+0000","last_change":"2024-09-14T11:01:23.884550+0000","last_active":"2024-09-14T11:18:54.982805+0000","last_peered":"2024-09-14T11:18:54.982805+0000","last_clean":"2024-09-14T11:18:54.982805+0000","last_became_active":"2024-09-14T11:01:23.884138+0000","last_became_peered":"2024-09-14T11:01:23.884138+0000","last_unstale":"2024-09-14T11:18:54.982805+0000","last_undegraded":"2024-09-14T11:18:54.982805+0000","last_fullsized":"2024-09-14T11:18:54.982805+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:10.655429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":33,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:52.202212+0000","last_change":"2024-09-14T11:01:20.855022+0000","last_active":"2024-09-14T11:18:52.202212+0000","last_peered":"2024-09-14T11:18:52.202212+0000","last_clean":"2024-09-14T11:18:52.202212+0000","last_became_active":"2024-09-14T11:01:20.854737+0000","last_became_peered":"2024-09-14T11:01:20.854737+0000","last_unstale":"2024-09-14T11:18:52.202212+0000","last_undegraded":"2024-09-14T11:18:52.202212+0000","last_fullsized":"2024-09-14T11:18:52.202212+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:43.045693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"260'45","reported_seq":163,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:20.991333+0000","last_change":"2024-09-14T10:59:48.420289+0000","last_active":"2024-09-14T11:19:20.991333+0000","last_peered":"2024-09-14T11:19:20.991333+0000","last_clean":"2024-09-14T11:19:20.991333+0000","last_became_active":"2024-09-14T10:59:48.419091+0000","last_became_peered":"2024-09-14T10:59:48.419091+0000","last_unstale":"2024-09-14T11:19:20.991333+0000","last_undegraded":"2024-09-14T11:19:20.991333+0000","last_fullsized":"2024-09-14T11:19:20.991333+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:35.387602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":368,"num_read_kb":243,"num_write":109,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:12.205201+0000","last_change":"2024-09-14T11:11:42.583176+0000","last_active":"2024-09-14T11:19:12.205201+0000","last_peered":"2024-09-14T11:19:12.205201+0000","last_clean":"2024-09-14T11:19:12.205201+0000","last_became_active":"2024-09-14T11:11:42.582899+0000","last_became_peered":"2024-09-14T11:11:42.582899+0000","last_unstale":"2024-09-14T11:19:12.205201+0000","last_undegraded":"2024-09-14T11:19:12.205201+0000","last_fullsized":"2024-09-14T11:19:12.205201+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:00.902463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:55.987589+0000","last_change":"2024-09-14T11:01:23.895643+0000","last_active":"2024-09-14T11:18:55.987589+0000","last_peered":"2024-09-14T11:18:55.987589+0000","last_clean":"2024-09-14T11:18:55.987589+0000","last_became_active":"2024-09-14T11:01:23.894587+0000","last_became_peered":"2024-09-14T11:01:23.894587+0000","last_unstale":"2024-09-14T11:18:55.987589+0000","last_undegraded":"2024-09-14T11:18:55.987589+0000","last_fullsized":"2024-09-14T11:18:55.987589+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:29.534046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"260'3","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:20.999394+0000","last_change":"2024-09-14T11:01:20.869542+0000","last_active":"2024-09-14T11:21:20.999394+0000","last_peered":"2024-09-14T11:21:20.999394+0000","last_clean":"2024-09-14T11:21:20.999394+0000","last_became_active":"2024-09-14T11:01:20.869244+0000","last_became_peered":"2024-09-14T11:01:20.869244+0000","last_unstale":"2024-09-14T11:21:20.999394+0000","last_undegraded":"2024-09-14T11:21:20.999394+0000","last_fullsized":"2024-09-14T11:21:20.999394+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:58.638874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"260'35","reported_seq":137,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:58.204964+0000","last_change":"2024-09-14T10:59:48.414261+0000","last_active":"2024-09-14T11:20:58.204964+0000","last_peered":"2024-09-14T11:20:58.204964+0000","last_clean":"2024-09-14T11:20:58.204964+0000","last_became_active":"2024-09-14T10:59:48.414023+0000","last_became_peered":"2024-09-14T10:59:48.414023+0000","last_unstale":"2024-09-14T11:20:58.204964+0000","last_undegraded":"2024-09-14T11:20:58.204964+0000","last_fullsized":"2024-09-14T11:20:58.204964+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:32.125339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":284,"num_read_kb":189,"num_write":86,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:46.231489+0000","last_change":"2024-09-14T11:11:42.592957+0000","last_active":"2024-09-14T11:18:46.231489+0000","last_peered":"2024-09-14T11:18:46.231489+0000","last_clean":"2024-09-14T11:18:46.231489+0000","last_became_active":"2024-09-14T11:11:42.592439+0000","last_became_peered":"2024-09-14T11:11:42.592439+0000","last_unstale":"2024-09-14T11:18:46.231489+0000","last_undegraded":"2024-09-14T11:18:46.231489+0000","last_fullsized":"2024-09-14T11:18:46.231489+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:56:15.581964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"257'3","reported_seq":33,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:20.982723+0000","last_change":"2024-09-14T11:01:23.892350+0000","last_active":"2024-09-14T11:18:20.982723+0000","last_peered":"2024-09-14T11:18:20.982723+0000","last_clean":"2024-09-14T11:18:20.982723+0000","last_became_active":"2024-09-14T11:01:23.891631+0000","last_became_peered":"2024-09-14T11:01:23.891631+0000","last_unstale":"2024-09-14T11:18:20.982723+0000","last_undegraded":"2024-09-14T11:18:20.982723+0000","last_fullsized":"2024-09-14T11:18:20.982723+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:58:22.810241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"260'11","reported_seq":55,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.352736+0000","last_change":"2024-09-14T11:01:20.861317+0000","last_active":"2024-09-14T11:22:51.352736+0000","last_peered":"2024-09-14T11:22:51.352736+0000","last_clean":"2024-09-14T11:22:51.352736+0000","last_became_active":"2024-09-14T11:01:20.861043+0000","last_became_peered":"2024-09-14T11:01:20.861043+0000","last_unstale":"2024-09-14T11:22:51.352736+0000","last_undegraded":"2024-09-14T11:22:51.352736+0000","last_fullsized":"2024-09-14T11:22:51.352736+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:42.808761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":17410,"num_write":21,"num_write_kb":12290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"260'250","reported_seq":795,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:11.113999+0000","last_change":"2024-09-14T10:59:48.417407+0000","last_active":"2024-09-14T11:19:11.113999+0000","last_peered":"2024-09-14T11:19:11.113999+0000","last_clean":"2024-09-14T11:19:11.113999+0000","last_became_active":"2024-09-14T10:59:48.416342+0000","last_became_peered":"2024-09-14T10:59:48.416342+0000","last_unstale":"2024-09-14T11:19:11.113999+0000","last_undegraded":"2024-09-14T11:19:11.113999+0000","last_fullsized":"2024-09-14T11:19:11.113999+0000","mapping_epoch":249,"log_start":"257'200","ondisk_log_start":"257'200","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:56:03.687626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2428,"num_read_kb":2819,"num_write":491,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"260'1","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:45.979906+0000","last_change":"2024-09-14T11:11:42.588570+0000","last_active":"2024-09-14T11:18:45.979906+0000","last_peered":"2024-09-14T11:18:45.979906+0000","last_clean":"2024-09-14T11:18:45.979906+0000","last_became_active":"2024-09-14T11:11:42.587835+0000","last_became_peered":"2024-09-14T11:11:42.587835+0000","last_unstale":"2024-09-14T11:18:45.979906+0000","last_undegraded":"2024-09-14T11:18:45.979906+0000","last_fullsized":"2024-09-14T11:18:45.979906+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:05.008377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"260'3","reported_seq":33,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:26.263799+0000","last_change":"2024-09-14T11:01:23.895555+0000","last_active":"2024-09-14T11:22:26.263799+0000","last_peered":"2024-09-14T11:22:26.263799+0000","last_clean":"2024-09-14T11:22:26.263799+0000","last_became_active":"2024-09-14T11:01:23.892735+0000","last_became_peered":"2024-09-14T11:01:23.892735+0000","last_unstale":"2024-09-14T11:22:26.263799+0000","last_undegraded":"2024-09-14T11:22:26.263799+0000","last_fullsized":"2024-09-14T11:22:26.263799+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:20.552471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"260'4","reported_seq":40,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:42.216660+0000","last_change":"2024-09-14T11:01:20.860826+0000","last_active":"2024-09-14T11:20:42.216660+0000","last_peered":"2024-09-14T11:20:42.216660+0000","last_clean":"2024-09-14T11:20:42.216660+0000","last_became_active":"2024-09-14T11:01:20.860541+0000","last_became_peered":"2024-09-14T11:01:20.860541+0000","last_unstale":"2024-09-14T11:20:42.216660+0000","last_undegraded":"2024-09-14T11:20:42.216660+0000","last_fullsized":"2024-09-14T11:20:42.216660+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:08.358758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":61,"num_write":4,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"260'12","reported_seq":76,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:11.113972+0000","last_change":"2024-09-14T10:59:48.417263+0000","last_active":"2024-09-14T11:19:11.113972+0000","last_peered":"2024-09-14T11:19:11.113972+0000","last_clean":"2024-09-14T11:19:11.113972+0000","last_became_active":"2024-09-14T10:59:48.417001+0000","last_became_peered":"2024-09-14T10:59:48.417001+0000","last_unstale":"2024-09-14T11:19:11.113972+0000","last_undegraded":"2024-09-14T11:19:11.113972+0000","last_fullsized":"2024-09-14T11:19:11.113972+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:24.272836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":70,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:44.981269+0000","last_change":"2024-09-14T11:11:42.594143+0000","last_active":"2024-09-14T11:18:44.981269+0000","last_peered":"2024-09-14T11:18:44.981269+0000","last_clean":"2024-09-14T11:18:44.981269+0000","last_became_active":"2024-09-14T11:11:42.593873+0000","last_became_peered":"2024-09-14T11:11:42.593873+0000","last_unstale":"2024-09-14T11:18:44.981269+0000","last_undegraded":"2024-09-14T11:18:44.981269+0000","last_fullsized":"2024-09-14T11:18:44.981269+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:38.408015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:20.982781+0000","last_change":"2024-09-14T11:01:23.897460+0000","last_active":"2024-09-14T11:18:20.982781+0000","last_peered":"2024-09-14T11:18:20.982781+0000","last_clean":"2024-09-14T11:18:20.982781+0000","last_became_active":"2024-09-14T11:01:23.897154+0000","last_became_peered":"2024-09-14T11:01:23.897154+0000","last_unstale":"2024-09-14T11:18:20.982781+0000","last_undegraded":"2024-09-14T11:18:20.982781+0000","last_fullsized":"2024-09-14T11:18:20.982781+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:57.444749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"260'2","reported_seq":36,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:41.002355+0000","last_change":"2024-09-14T11:01:20.868430+0000","last_active":"2024-09-14T11:20:41.002355+0000","last_peered":"2024-09-14T11:20:41.002355+0000","last_clean":"2024-09-14T11:20:41.002355+0000","last_became_active":"2024-09-14T11:01:20.868135+0000","last_became_peered":"2024-09-14T11:01:20.868135+0000","last_unstale":"2024-09-14T11:20:41.002355+0000","last_undegraded":"2024-09-14T11:20:41.002355+0000","last_fullsized":"2024-09-14T11:20:41.002355+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:11:52.977202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"260'27","reported_seq":113,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:18.260492+0000","last_change":"2024-09-14T10:59:48.415592+0000","last_active":"2024-09-14T11:20:18.260492+0000","last_peered":"2024-09-14T11:20:18.260492+0000","last_clean":"2024-09-14T11:20:18.260492+0000","last_became_active":"2024-09-14T10:59:48.415324+0000","last_became_peered":"2024-09-14T10:59:48.415324+0000","last_unstale":"2024-09-14T11:20:18.260492+0000","last_undegraded":"2024-09-14T11:20:18.260492+0000","last_fullsized":"2024-09-14T11:20:18.260492+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:36:02.358205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":136,"num_write":70,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:42.200860+0000","last_change":"2024-09-14T11:11:42.592101+0000","last_active":"2024-09-14T11:18:42.200860+0000","last_peered":"2024-09-14T11:18:42.200860+0000","last_clean":"2024-09-14T11:18:42.200860+0000","last_became_active":"2024-09-14T11:11:42.591815+0000","last_became_peered":"2024-09-14T11:11:42.591815+0000","last_unstale":"2024-09-14T11:18:42.200860+0000","last_undegraded":"2024-09-14T11:18:42.200860+0000","last_fullsized":"2024-09-14T11:18:42.200860+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:44:10.362312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"260'3","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:47.217315+0000","last_change":"2024-09-14T11:01:23.884051+0000","last_active":"2024-09-14T11:20:47.217315+0000","last_peered":"2024-09-14T11:20:47.217315+0000","last_clean":"2024-09-14T11:20:47.217315+0000","last_became_active":"2024-09-14T11:01:23.883763+0000","last_became_peered":"2024-09-14T11:01:23.883763+0000","last_unstale":"2024-09-14T11:20:47.217315+0000","last_undegraded":"2024-09-14T11:20:47.217315+0000","last_fullsized":"2024-09-14T11:20:47.217315+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:48:45.773610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"260'5","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.178524+0000","last_change":"2024-09-14T11:01:20.867156+0000","last_active":"2024-09-14T11:22:51.178524+0000","last_peered":"2024-09-14T11:22:51.178524+0000","last_clean":"2024-09-14T11:22:51.178524+0000","last_became_active":"2024-09-14T11:01:20.866642+0000","last_became_peered":"2024-09-14T11:01:20.866642+0000","last_unstale":"2024-09-14T11:22:51.178524+0000","last_undegraded":"2024-09-14T11:22:51.178524+0000","last_fullsized":"2024-09-14T11:22:51.178524+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:38.426384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":13312,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"260'32","reported_seq":127,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:37.104014+0000","last_change":"2024-09-14T10:59:48.418606+0000","last_active":"2024-09-14T11:18:37.104014+0000","last_peered":"2024-09-14T11:18:37.104014+0000","last_clean":"2024-09-14T11:18:37.104014+0000","last_became_active":"2024-09-14T10:59:48.418305+0000","last_became_peered":"2024-09-14T10:59:48.418305+0000","last_unstale":"2024-09-14T11:18:37.104014+0000","last_undegraded":"2024-09-14T11:18:37.104014+0000","last_fullsized":"2024-09-14T11:18:37.104014+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:31:32.726408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":251,"num_read_kb":158,"num_write":84,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:01.233757+0000","last_change":"2024-09-14T11:11:42.588989+0000","last_active":"2024-09-14T11:19:01.233757+0000","last_peered":"2024-09-14T11:19:01.233757+0000","last_clean":"2024-09-14T11:19:01.233757+0000","last_became_active":"2024-09-14T11:11:42.588573+0000","last_became_peered":"2024-09-14T11:11:42.588573+0000","last_unstale":"2024-09-14T11:19:01.233757+0000","last_undegraded":"2024-09-14T11:19:01.233757+0000","last_fullsized":"2024-09-14T11:19:01.233757+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:44.929396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:06.243683+0000","last_change":"2024-09-14T11:01:23.895357+0000","last_active":"2024-09-14T11:20:06.243683+0000","last_peered":"2024-09-14T11:20:06.243683+0000","last_clean":"2024-09-14T11:20:06.243683+0000","last_became_active":"2024-09-14T11:01:23.894751+0000","last_became_peered":"2024-09-14T11:01:23.894751+0000","last_unstale":"2024-09-14T11:20:06.243683+0000","last_undegraded":"2024-09-14T11:20:06.243683+0000","last_fullsized":"2024-09-14T11:20:06.243683+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:22:05.395992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:02.116671+0000","last_change":"2024-09-14T11:01:20.867415+0000","last_active":"2024-09-14T11:20:02.116671+0000","last_peered":"2024-09-14T11:20:02.116671+0000","last_clean":"2024-09-14T11:20:02.116671+0000","last_became_active":"2024-09-14T11:01:20.866975+0000","last_became_peered":"2024-09-14T11:01:20.866975+0000","last_unstale":"2024-09-14T11:20:02.116671+0000","last_undegraded":"2024-09-14T11:20:02.116671+0000","last_fullsized":"2024-09-14T11:20:02.116671+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:47.822855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"260'17","reported_seq":82,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:32.103148+0000","last_change":"2024-09-14T10:59:48.421015+0000","last_active":"2024-09-14T11:18:32.103148+0000","last_peered":"2024-09-14T11:18:32.103148+0000","last_clean":"2024-09-14T11:18:32.103148+0000","last_became_active":"2024-09-14T10:59:48.420711+0000","last_became_peered":"2024-09-14T10:59:48.420711+0000","last_unstale":"2024-09-14T11:18:32.103148+0000","last_undegraded":"2024-09-14T11:18:32.103148+0000","last_fullsized":"2024-09-14T11:18:32.103148+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:14:06.864641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":78,"num_write":43,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:00.982102+0000","last_change":"2024-09-14T11:11:42.585332+0000","last_active":"2024-09-14T11:19:00.982102+0000","last_peered":"2024-09-14T11:19:00.982102+0000","last_clean":"2024-09-14T11:19:00.982102+0000","last_became_active":"2024-09-14T11:11:42.583965+0000","last_became_peered":"2024-09-14T11:11:42.583965+0000","last_unstale":"2024-09-14T11:19:00.982102+0000","last_undegraded":"2024-09-14T11:19:00.982102+0000","last_fullsized":"2024-09-14T11:19:00.982102+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:45:52.531506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"257'5","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:06.243650+0000","last_change":"2024-09-14T11:01:23.893658+0000","last_active":"2024-09-14T11:20:06.243650+0000","last_peered":"2024-09-14T11:20:06.243650+0000","last_clean":"2024-09-14T11:20:06.243650+0000","last_became_active":"2024-09-14T11:01:23.893365+0000","last_became_peered":"2024-09-14T11:01:23.893365+0000","last_unstale":"2024-09-14T11:20:06.243650+0000","last_undegraded":"2024-09-14T11:20:06.243650+0000","last_fullsized":"2024-09-14T11:20:06.243650+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:10:44.395112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"260'3","reported_seq":37,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:21.262930+0000","last_change":"2024-09-14T11:01:20.869472+0000","last_active":"2024-09-14T11:22:21.262930+0000","last_peered":"2024-09-14T11:22:21.262930+0000","last_clean":"2024-09-14T11:22:21.262930+0000","last_became_active":"2024-09-14T11:01:20.869209+0000","last_became_peered":"2024-09-14T11:01:20.869209+0000","last_unstale":"2024-09-14T11:22:21.262930+0000","last_undegraded":"2024-09-14T11:22:21.262930+0000","last_fullsized":"2024-09-14T11:22:21.262930+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:54.924564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"260'35","reported_seq":136,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:00.389953+0000","last_change":"2024-09-14T10:59:48.416424+0000","last_active":"2024-09-14T11:21:00.389953+0000","last_peered":"2024-09-14T11:21:00.389953+0000","last_clean":"2024-09-14T11:21:00.389953+0000","last_became_active":"2024-09-14T10:59:48.416149+0000","last_became_peered":"2024-09-14T10:59:48.416149+0000","last_unstale":"2024-09-14T11:21:00.389953+0000","last_undegraded":"2024-09-14T11:21:00.389953+0000","last_fullsized":"2024-09-14T11:21:00.389953+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:12.463862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":285,"num_read_kb":193,"num_write":82,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"259'1","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:46.110446+0000","last_change":"2024-09-14T11:11:42.584334+0000","last_active":"2024-09-14T11:18:46.110446+0000","last_peered":"2024-09-14T11:18:46.110446+0000","last_clean":"2024-09-14T11:18:46.110446+0000","last_became_active":"2024-09-14T11:11:42.583477+0000","last_became_peered":"2024-09-14T11:11:42.583477+0000","last_unstale":"2024-09-14T11:18:46.110446+0000","last_undegraded":"2024-09-14T11:18:46.110446+0000","last_fullsized":"2024-09-14T11:18:46.110446+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:34.189340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"260'8","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:26.017279+0000","last_change":"2024-09-14T11:01:23.891615+0000","last_active":"2024-09-14T11:22:26.017279+0000","last_peered":"2024-09-14T11:22:26.017279+0000","last_clean":"2024-09-14T11:22:26.017279+0000","last_became_active":"2024-09-14T11:01:23.891343+0000","last_became_peered":"2024-09-14T11:01:23.891343+0000","last_unstale":"2024-09-14T11:22:26.017279+0000","last_undegraded":"2024-09-14T11:22:26.017279+0000","last_fullsized":"2024-09-14T11:22:26.017279+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:37.853683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":15362,"num_write":13,"num_write_kb":10242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"260'3","reported_seq":39,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:22.135312+0000","last_change":"2024-09-14T11:01:20.862125+0000","last_active":"2024-09-14T11:22:22.135312+0000","last_peered":"2024-09-14T11:22:22.135312+0000","last_clean":"2024-09-14T11:22:22.135312+0000","last_became_active":"2024-09-14T11:01:20.861817+0000","last_became_peered":"2024-09-14T11:01:20.861817+0000","last_unstale":"2024-09-14T11:22:22.135312+0000","last_undegraded":"2024-09-14T11:22:22.135312+0000","last_fullsized":"2024-09-14T11:22:22.135312+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:55.520879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"260'106","reported_seq":361,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:29.979162+0000","last_change":"2024-09-14T10:59:48.418299+0000","last_active":"2024-09-14T11:18:29.979162+0000","last_peered":"2024-09-14T11:18:29.979162+0000","last_clean":"2024-09-14T11:18:29.979162+0000","last_became_active":"2024-09-14T10:59:48.418011+0000","last_became_peered":"2024-09-14T10:59:48.418011+0000","last_unstale":"2024-09-14T11:18:29.979162+0000","last_undegraded":"2024-09-14T11:18:29.979162+0000","last_fullsized":"2024-09-14T11:18:29.979162+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:53:09.804245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1045,"num_read_kb":858,"num_write":220,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"260'1","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:00.982068+0000","last_change":"2024-09-14T11:11:42.580964+0000","last_active":"2024-09-14T11:19:00.982068+0000","last_peered":"2024-09-14T11:19:00.982068+0000","last_clean":"2024-09-14T11:19:00.982068+0000","last_became_active":"2024-09-14T11:11:42.580611+0000","last_became_peered":"2024-09-14T11:11:42.580611+0000","last_unstale":"2024-09-14T11:19:00.982068+0000","last_undegraded":"2024-09-14T11:19:00.982068+0000","last_fullsized":"2024-09-14T11:19:00.982068+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:24.715816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:07.117668+0000","last_change":"2024-09-14T11:01:23.886701+0000","last_active":"2024-09-14T11:20:07.117668+0000","last_peered":"2024-09-14T11:20:07.117668+0000","last_clean":"2024-09-14T11:20:07.117668+0000","last_became_active":"2024-09-14T11:01:23.886496+0000","last_became_peered":"2024-09-14T11:01:23.886496+0000","last_unstale":"2024-09-14T11:20:07.117668+0000","last_undegraded":"2024-09-14T11:20:07.117668+0000","last_fullsized":"2024-09-14T11:20:07.117668+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:46.277781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"257'3","reported_seq":40,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:02.116770+0000","last_change":"2024-09-14T11:01:20.863982+0000","last_active":"2024-09-14T11:20:02.116770+0000","last_peered":"2024-09-14T11:20:02.116770+0000","last_clean":"2024-09-14T11:20:02.116770+0000","last_became_active":"2024-09-14T11:01:20.863707+0000","last_became_peered":"2024-09-14T11:01:20.863707+0000","last_unstale":"2024-09-14T11:20:02.116770+0000","last_undegraded":"2024-09-14T11:20:02.116770+0000","last_fullsized":"2024-09-14T11:20:02.116770+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:40.633016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"260'54","reported_seq":190,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:29.870970+0000","last_change":"2024-09-14T10:59:48.422151+0000","last_active":"2024-09-14T11:20:29.870970+0000","last_peered":"2024-09-14T11:20:29.870970+0000","last_clean":"2024-09-14T11:20:29.870970+0000","last_became_active":"2024-09-14T10:59:48.421875+0000","last_became_peered":"2024-09-14T10:59:48.421875+0000","last_unstale":"2024-09-14T11:20:29.870970+0000","last_undegraded":"2024-09-14T11:20:29.870970+0000","last_fullsized":"2024-09-14T11:20:29.870970+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:45.174950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":456,"num_read_kb":308,"num_write":139,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:26.246099+0000","last_change":"2024-09-14T11:11:42.590323+0000","last_active":"2024-09-14T11:20:26.246099+0000","last_peered":"2024-09-14T11:20:26.246099+0000","last_clean":"2024-09-14T11:20:26.246099+0000","last_became_active":"2024-09-14T11:11:42.590056+0000","last_became_peered":"2024-09-14T11:11:42.590056+0000","last_unstale":"2024-09-14T11:20:26.246099+0000","last_undegraded":"2024-09-14T11:20:26.246099+0000","last_fullsized":"2024-09-14T11:20:26.246099+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:24.964712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"260'2","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:41.010434+0000","last_change":"2024-09-14T11:01:23.892070+0000","last_active":"2024-09-14T11:21:41.010434+0000","last_peered":"2024-09-14T11:21:41.010434+0000","last_clean":"2024-09-14T11:21:41.010434+0000","last_became_active":"2024-09-14T11:01:23.891331+0000","last_became_peered":"2024-09-14T11:01:23.891331+0000","last_unstale":"2024-09-14T11:21:41.010434+0000","last_undegraded":"2024-09-14T11:21:41.010434+0000","last_fullsized":"2024-09-14T11:21:41.010434+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:08:04.829621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:19.986970+0000","last_change":"2024-09-14T11:01:20.863405+0000","last_active":"2024-09-14T11:19:19.986970+0000","last_peered":"2024-09-14T11:19:19.986970+0000","last_clean":"2024-09-14T11:19:19.986970+0000","last_became_active":"2024-09-14T11:01:20.863144+0000","last_became_peered":"2024-09-14T11:01:20.863144+0000","last_unstale":"2024-09-14T11:19:19.986970+0000","last_undegraded":"2024-09-14T11:19:19.986970+0000","last_fullsized":"2024-09-14T11:19:19.986970+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:52:05.926396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"260'19","reported_seq":91,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:00.757874+0000","last_change":"2024-09-14T10:59:48.417159+0000","last_active":"2024-09-14T11:21:00.757874+0000","last_peered":"2024-09-14T11:21:00.757874+0000","last_clean":"2024-09-14T11:21:00.757874+0000","last_became_active":"2024-09-14T10:59:48.416902+0000","last_became_peered":"2024-09-14T10:59:48.416902+0000","last_unstale":"2024-09-14T11:21:00.757874+0000","last_undegraded":"2024-09-14T11:21:00.757874+0000","last_fullsized":"2024-09-14T11:21:00.757874+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:14.436213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":98,"num_write":49,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:42.122390+0000","last_change":"2024-09-14T11:11:42.589320+0000","last_active":"2024-09-14T11:20:42.122390+0000","last_peered":"2024-09-14T11:20:42.122390+0000","last_clean":"2024-09-14T11:20:42.122390+0000","last_became_active":"2024-09-14T11:11:42.589071+0000","last_became_peered":"2024-09-14T11:11:42.589071+0000","last_unstale":"2024-09-14T11:20:42.122390+0000","last_undegraded":"2024-09-14T11:20:42.122390+0000","last_fullsized":"2024-09-14T11:20:42.122390+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:25.992224+0000","last_change":"2024-09-14T11:01:23.893015+0000","last_active":"2024-09-14T11:19:25.992224+0000","last_peered":"2024-09-14T11:19:25.992224+0000","last_clean":"2024-09-14T11:19:25.992224+0000","last_became_active":"2024-09-14T11:01:23.892761+0000","last_became_peered":"2024-09-14T11:01:23.892761+0000","last_unstale":"2024-09-14T11:19:25.992224+0000","last_undegraded":"2024-09-14T11:19:25.992224+0000","last_fullsized":"2024-09-14T11:19:25.992224+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:06.763249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:20.984704+0000","last_change":"2024-09-14T11:01:20.866514+0000","last_active":"2024-09-14T11:19:20.984704+0000","last_peered":"2024-09-14T11:19:20.984704+0000","last_clean":"2024-09-14T11:19:20.984704+0000","last_became_active":"2024-09-14T11:01:20.866224+0000","last_became_peered":"2024-09-14T11:01:20.866224+0000","last_unstale":"2024-09-14T11:19:20.984704+0000","last_undegraded":"2024-09-14T11:19:20.984704+0000","last_fullsized":"2024-09-14T11:19:20.984704+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:55.378175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"260'30","reported_seq":122,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:07.117741+0000","last_change":"2024-09-14T10:59:48.416632+0000","last_active":"2024-09-14T11:20:07.117741+0000","last_peered":"2024-09-14T11:20:07.117741+0000","last_clean":"2024-09-14T11:20:07.117741+0000","last_became_active":"2024-09-14T10:59:48.415922+0000","last_became_peered":"2024-09-14T10:59:48.415922+0000","last_unstale":"2024-09-14T11:20:07.117741+0000","last_undegraded":"2024-09-14T11:20:07.117741+0000","last_fullsized":"2024-09-14T11:20:07.117741+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:37.136039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":240,"num_read_kb":165,"num_write":74,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:22.119393+0000","last_change":"2024-09-14T11:11:42.591303+0000","last_active":"2024-09-14T11:20:22.119393+0000","last_peered":"2024-09-14T11:20:22.119393+0000","last_clean":"2024-09-14T11:20:22.119393+0000","last_became_active":"2024-09-14T11:11:42.589881+0000","last_became_peered":"2024-09-14T11:11:42.589881+0000","last_unstale":"2024-09-14T11:20:22.119393+0000","last_undegraded":"2024-09-14T11:20:22.119393+0000","last_fullsized":"2024-09-14T11:20:22.119393+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:53.799897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"257'8","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:30.993019+0000","last_change":"2024-09-14T11:01:23.897536+0000","last_active":"2024-09-14T11:19:30.993019+0000","last_peered":"2024-09-14T11:19:30.993019+0000","last_clean":"2024-09-14T11:19:30.993019+0000","last_became_active":"2024-09-14T11:01:23.897158+0000","last_became_peered":"2024-09-14T11:01:23.897158+0000","last_unstale":"2024-09-14T11:19:30.993019+0000","last_undegraded":"2024-09-14T11:19:30.993019+0000","last_fullsized":"2024-09-14T11:19:30.993019+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:34.363585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6146,"num_write":18,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:20.991433+0000","last_change":"2024-09-14T11:01:20.864291+0000","last_active":"2024-09-14T11:19:20.991433+0000","last_peered":"2024-09-14T11:19:20.991433+0000","last_clean":"2024-09-14T11:19:20.991433+0000","last_became_active":"2024-09-14T11:01:20.863999+0000","last_became_peered":"2024-09-14T11:01:20.863999+0000","last_unstale":"2024-09-14T11:19:20.991433+0000","last_undegraded":"2024-09-14T11:19:20.991433+0000","last_fullsized":"2024-09-14T11:19:20.991433+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:01:25.818000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"260'46","reported_seq":159,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:32.496503+0000","last_change":"2024-09-14T10:59:48.418550+0000","last_active":"2024-09-14T11:20:32.496503+0000","last_peered":"2024-09-14T11:20:32.496503+0000","last_clean":"2024-09-14T11:20:32.496503+0000","last_became_active":"2024-09-14T10:59:48.418276+0000","last_became_peered":"2024-09-14T10:59:48.418276+0000","last_unstale":"2024-09-14T11:20:32.496503+0000","last_undegraded":"2024-09-14T11:20:32.496503+0000","last_fullsized":"2024-09-14T11:20:32.496503+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:57.938381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":345,"num_read_kb":231,"num_write":118,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:22.119116+0000","last_change":"2024-09-14T11:11:42.587132+0000","last_active":"2024-09-14T11:20:22.119116+0000","last_peered":"2024-09-14T11:20:22.119116+0000","last_clean":"2024-09-14T11:20:22.119116+0000","last_became_active":"2024-09-14T11:11:42.586852+0000","last_became_peered":"2024-09-14T11:11:42.586852+0000","last_unstale":"2024-09-14T11:20:22.119116+0000","last_undegraded":"2024-09-14T11:20:22.119116+0000","last_fullsized":"2024-09-14T11:20:22.119116+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:34.192562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"257'3","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:26.237592+0000","last_change":"2024-09-14T11:01:23.887413+0000","last_active":"2024-09-14T11:19:26.237592+0000","last_peered":"2024-09-14T11:19:26.237592+0000","last_clean":"2024-09-14T11:19:26.237592+0000","last_became_active":"2024-09-14T11:01:23.887167+0000","last_became_peered":"2024-09-14T11:01:23.887167+0000","last_unstale":"2024-09-14T11:19:26.237592+0000","last_undegraded":"2024-09-14T11:19:26.237592+0000","last_fullsized":"2024-09-14T11:19:26.237592+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:36:46.808831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"260'6","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.022365+0000","last_change":"2024-09-14T11:01:20.857944+0000","last_active":"2024-09-14T11:22:51.022365+0000","last_peered":"2024-09-14T11:22:51.022365+0000","last_clean":"2024-09-14T11:22:51.022365+0000","last_became_active":"2024-09-14T11:01:20.857645+0000","last_became_peered":"2024-09-14T11:01:20.857645+0000","last_unstale":"2024-09-14T11:22:51.022365+0000","last_undegraded":"2024-09-14T11:22:51.022365+0000","last_fullsized":"2024-09-14T11:22:51.022365+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:57:36.222186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"260'22","reported_seq":101,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:05.990564+0000","last_change":"2024-09-14T10:59:48.413726+0000","last_active":"2024-09-14T11:20:05.990564+0000","last_peered":"2024-09-14T11:20:05.990564+0000","last_clean":"2024-09-14T11:20:05.990564+0000","last_became_active":"2024-09-14T10:59:48.413425+0000","last_became_peered":"2024-09-14T10:59:48.413425+0000","last_unstale":"2024-09-14T11:20:05.990564+0000","last_undegraded":"2024-09-14T11:20:05.990564+0000","last_fullsized":"2024-09-14T11:20:05.990564+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:03.945777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":100,"num_write":57,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:31.229418+0000","last_change":"2024-09-14T11:11:42.588149+0000","last_active":"2024-09-14T11:18:31.229418+0000","last_peered":"2024-09-14T11:18:31.229418+0000","last_clean":"2024-09-14T11:18:31.229418+0000","last_became_active":"2024-09-14T11:11:42.587906+0000","last_became_peered":"2024-09-14T11:11:42.587906+0000","last_unstale":"2024-09-14T11:18:31.229418+0000","last_undegraded":"2024-09-14T11:18:31.229418+0000","last_fullsized":"2024-09-14T11:18:31.229418+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:29.046471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:47.105337+0000","last_change":"2024-09-14T11:01:23.891705+0000","last_active":"2024-09-14T11:18:47.105337+0000","last_peered":"2024-09-14T11:18:47.105337+0000","last_clean":"2024-09-14T11:18:47.105337+0000","last_became_active":"2024-09-14T11:01:23.891424+0000","last_became_peered":"2024-09-14T11:01:23.891424+0000","last_unstale":"2024-09-14T11:18:47.105337+0000","last_undegraded":"2024-09-14T11:18:47.105337+0000","last_fullsized":"2024-09-14T11:18:47.105337+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:57.606174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"260'5","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.022325+0000","last_change":"2024-09-14T11:01:20.864246+0000","last_active":"2024-09-14T11:22:51.022325+0000","last_peered":"2024-09-14T11:22:51.022325+0000","last_clean":"2024-09-14T11:22:51.022325+0000","last_became_active":"2024-09-14T11:01:20.863936+0000","last_became_peered":"2024-09-14T11:01:20.863936+0000","last_unstale":"2024-09-14T11:22:51.022325+0000","last_undegraded":"2024-09-14T11:22:51.022325+0000","last_fullsized":"2024-09-14T11:22:51.022325+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:54.851971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"260'14","reported_seq":80,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:05.990531+0000","last_change":"2024-09-14T10:59:48.414234+0000","last_active":"2024-09-14T11:20:05.990531+0000","last_peered":"2024-09-14T11:20:05.990531+0000","last_clean":"2024-09-14T11:20:05.990531+0000","last_became_active":"2024-09-14T10:59:48.413255+0000","last_became_peered":"2024-09-14T10:59:48.413255+0000","last_unstale":"2024-09-14T11:20:05.990531+0000","last_undegraded":"2024-09-14T11:20:05.990531+0000","last_fullsized":"2024-09-14T11:20:05.990531+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:14.892298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":78,"num_write":38,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:34.979984+0000","last_change":"2024-09-14T11:11:42.588371+0000","last_active":"2024-09-14T11:18:34.979984+0000","last_peered":"2024-09-14T11:18:34.979984+0000","last_clean":"2024-09-14T11:18:34.979984+0000","last_became_active":"2024-09-14T11:11:42.588120+0000","last_became_peered":"2024-09-14T11:11:42.588120+0000","last_unstale":"2024-09-14T11:18:34.979984+0000","last_undegraded":"2024-09-14T11:18:34.979984+0000","last_fullsized":"2024-09-14T11:18:34.979984+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:23.029451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"257'3","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:44.981319+0000","last_change":"2024-09-14T11:01:23.889191+0000","last_active":"2024-09-14T11:18:44.981319+0000","last_peered":"2024-09-14T11:18:44.981319+0000","last_clean":"2024-09-14T11:18:44.981319+0000","last_became_active":"2024-09-14T11:01:23.888873+0000","last_became_peered":"2024-09-14T11:01:23.888873+0000","last_unstale":"2024-09-14T11:18:44.981319+0000","last_undegraded":"2024-09-14T11:18:44.981319+0000","last_fullsized":"2024-09-14T11:18:44.981319+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:21.226880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:41.230765+0000","last_change":"2024-09-14T11:01:20.867172+0000","last_active":"2024-09-14T11:18:41.230765+0000","last_peered":"2024-09-14T11:18:41.230765+0000","last_clean":"2024-09-14T11:18:41.230765+0000","last_became_active":"2024-09-14T11:01:20.865953+0000","last_became_peered":"2024-09-14T11:01:20.865953+0000","last_unstale":"2024-09-14T11:18:41.230765+0000","last_undegraded":"2024-09-14T11:18:41.230765+0000","last_fullsized":"2024-09-14T11:18:41.230765+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:07:32.750973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"260'22","reported_seq":98,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:00.388827+0000","last_change":"2024-09-14T10:59:48.417311+0000","last_active":"2024-09-14T11:21:00.388827+0000","last_peered":"2024-09-14T11:21:00.388827+0000","last_clean":"2024-09-14T11:21:00.388827+0000","last_became_active":"2024-09-14T10:59:48.417013+0000","last_became_peered":"2024-09-14T10:59:48.417013+0000","last_unstale":"2024-09-14T11:21:00.388827+0000","last_undegraded":"2024-09-14T11:21:00.388827+0000","last_fullsized":"2024-09-14T11:21:00.388827+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:55.489720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":110,"num_write":54,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"260'1","reported_seq":19,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:42.216604+0000","last_change":"2024-09-14T11:11:42.592793+0000","last_active":"2024-09-14T11:20:42.216604+0000","last_peered":"2024-09-14T11:20:42.216604+0000","last_clean":"2024-09-14T11:20:42.216604+0000","last_became_active":"2024-09-14T11:11:42.592514+0000","last_became_peered":"2024-09-14T11:11:42.592514+0000","last_unstale":"2024-09-14T11:20:42.216604+0000","last_undegraded":"2024-09-14T11:20:42.216604+0000","last_fullsized":"2024-09-14T11:20:42.216604+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:25.985335+0000","last_change":"2024-09-14T11:01:23.890689+0000","last_active":"2024-09-14T11:19:25.985335+0000","last_peered":"2024-09-14T11:19:25.985335+0000","last_clean":"2024-09-14T11:19:25.985335+0000","last_became_active":"2024-09-14T11:01:23.890356+0000","last_became_peered":"2024-09-14T11:01:23.890356+0000","last_unstale":"2024-09-14T11:19:25.985335+0000","last_undegraded":"2024-09-14T11:19:25.985335+0000","last_fullsized":"2024-09-14T11:19:25.985335+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:10.636807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"257'3","reported_seq":40,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:45.986096+0000","last_change":"2024-09-14T11:01:20.859484+0000","last_active":"2024-09-14T11:18:45.986096+0000","last_peered":"2024-09-14T11:18:45.986096+0000","last_clean":"2024-09-14T11:18:45.986096+0000","last_became_active":"2024-09-14T11:01:20.859214+0000","last_became_peered":"2024-09-14T11:01:20.859214+0000","last_unstale":"2024-09-14T11:18:45.986096+0000","last_undegraded":"2024-09-14T11:18:45.986096+0000","last_fullsized":"2024-09-14T11:18:45.986096+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:16.912377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"260'23","reported_seq":97,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:21.236876+0000","last_change":"2024-09-14T10:59:48.420616+0000","last_active":"2024-09-14T11:19:21.236876+0000","last_peered":"2024-09-14T11:19:21.236876+0000","last_clean":"2024-09-14T11:19:21.236876+0000","last_became_active":"2024-09-14T10:59:48.420353+0000","last_became_peered":"2024-09-14T10:59:48.420353+0000","last_unstale":"2024-09-14T11:19:21.236876+0000","last_undegraded":"2024-09-14T11:19:21.236876+0000","last_fullsized":"2024-09-14T11:19:21.236876+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:02.159847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":102,"num_write":60,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:30.984019+0000","last_change":"2024-09-14T11:11:42.589448+0000","last_active":"2024-09-14T11:18:30.984019+0000","last_peered":"2024-09-14T11:18:30.984019+0000","last_clean":"2024-09-14T11:18:30.984019+0000","last_became_active":"2024-09-14T11:11:42.589134+0000","last_became_peered":"2024-09-14T11:11:42.589134+0000","last_unstale":"2024-09-14T11:18:30.984019+0000","last_undegraded":"2024-09-14T11:18:30.984019+0000","last_fullsized":"2024-09-14T11:18:30.984019+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:36:39.197914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"260'2","reported_seq":31,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:57.218721+0000","last_change":"2024-09-14T11:01:23.890752+0000","last_active":"2024-09-14T11:20:57.218721+0000","last_peered":"2024-09-14T11:20:57.218721+0000","last_clean":"2024-09-14T11:20:57.218721+0000","last_became_active":"2024-09-14T11:01:23.890433+0000","last_became_peered":"2024-09-14T11:01:23.890433+0000","last_unstale":"2024-09-14T11:20:57.218721+0000","last_undegraded":"2024-09-14T11:20:57.218721+0000","last_fullsized":"2024-09-14T11:20:57.218721+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:00.066817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"257'3","reported_seq":40,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:22.110767+0000","last_change":"2024-09-14T11:01:20.859636+0000","last_active":"2024-09-14T11:19:22.110767+0000","last_peered":"2024-09-14T11:19:22.110767+0000","last_clean":"2024-09-14T11:19:22.110767+0000","last_became_active":"2024-09-14T11:01:20.858834+0000","last_became_peered":"2024-09-14T11:01:20.858834+0000","last_unstale":"2024-09-14T11:19:22.110767+0000","last_undegraded":"2024-09-14T11:19:22.110767+0000","last_fullsized":"2024-09-14T11:19:22.110767+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:26.825835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"260'31","reported_seq":128,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:22.206583+0000","last_change":"2024-09-14T10:59:48.414660+0000","last_active":"2024-09-14T11:19:22.206583+0000","last_peered":"2024-09-14T11:19:22.206583+0000","last_clean":"2024-09-14T11:19:22.206583+0000","last_became_active":"2024-09-14T10:59:48.414351+0000","last_became_peered":"2024-09-14T10:59:48.414351+0000","last_unstale":"2024-09-14T11:19:22.206583+0000","last_undegraded":"2024-09-14T11:19:22.206583+0000","last_fullsized":"2024-09-14T11:19:22.206583+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:47.823706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":249,"num_read_kb":158,"num_write":78,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:02.212097+0000","last_change":"2024-09-14T11:11:42.588279+0000","last_active":"2024-09-14T11:20:02.212097+0000","last_peered":"2024-09-14T11:20:02.212097+0000","last_clean":"2024-09-14T11:20:02.212097+0000","last_became_active":"2024-09-14T11:11:42.587955+0000","last_became_peered":"2024-09-14T11:11:42.587955+0000","last_unstale":"2024-09-14T11:20:02.212097+0000","last_undegraded":"2024-09-14T11:20:02.212097+0000","last_fullsized":"2024-09-14T11:20:02.212097+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:26.572340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"260'8","reported_seq":47,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:16.262273+0000","last_change":"2024-09-14T11:01:23.893822+0000","last_active":"2024-09-14T11:22:16.262273+0000","last_peered":"2024-09-14T11:22:16.262273+0000","last_clean":"2024-09-14T11:22:16.262273+0000","last_became_active":"2024-09-14T11:01:23.891239+0000","last_became_peered":"2024-09-14T11:01:23.891239+0000","last_unstale":"2024-09-14T11:22:16.262273+0000","last_undegraded":"2024-09-14T11:22:16.262273+0000","last_fullsized":"2024-09-14T11:22:16.262273+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:21.232548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20482,"num_write":18,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":35,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:07.117708+0000","last_change":"2024-09-14T11:01:20.867304+0000","last_active":"2024-09-14T11:20:07.117708+0000","last_peered":"2024-09-14T11:20:07.117708+0000","last_clean":"2024-09-14T11:20:07.117708+0000","last_became_active":"2024-09-14T11:01:20.866975+0000","last_became_peered":"2024-09-14T11:01:20.866975+0000","last_unstale":"2024-09-14T11:20:07.117708+0000","last_undegraded":"2024-09-14T11:20:07.117708+0000","last_fullsized":"2024-09-14T11:20:07.117708+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:53.556481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"260'4","reported_seq":50,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:21.115449+0000","last_change":"2024-09-14T10:59:48.417712+0000","last_active":"2024-09-14T11:19:21.115449+0000","last_peered":"2024-09-14T11:19:21.115449+0000","last_clean":"2024-09-14T11:19:21.115449+0000","last_became_active":"2024-09-14T10:59:48.416741+0000","last_became_peered":"2024-09-14T10:59:48.416741+0000","last_unstale":"2024-09-14T11:19:21.115449+0000","last_undegraded":"2024-09-14T11:19:21.115449+0000","last_fullsized":"2024-09-14T11:19:21.115449+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:42.444007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:02.212122+0000","last_change":"2024-09-14T11:11:42.582460+0000","last_active":"2024-09-14T11:20:02.212122+0000","last_peered":"2024-09-14T11:20:02.212122+0000","last_clean":"2024-09-14T11:20:02.212122+0000","last_became_active":"2024-09-14T11:11:42.582190+0000","last_became_peered":"2024-09-14T11:11:42.582190+0000","last_unstale":"2024-09-14T11:20:02.212122+0000","last_undegraded":"2024-09-14T11:20:02.212122+0000","last_fullsized":"2024-09-14T11:20:02.212122+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:34.879085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"260'10","reported_seq":55,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:16.262243+0000","last_change":"2024-09-14T11:01:23.893560+0000","last_active":"2024-09-14T11:22:16.262243+0000","last_peered":"2024-09-14T11:22:16.262243+0000","last_clean":"2024-09-14T11:22:16.262243+0000","last_became_active":"2024-09-14T11:01:23.892344+0000","last_became_peered":"2024-09-14T11:01:23.892344+0000","last_unstale":"2024-09-14T11:22:16.262243+0000","last_undegraded":"2024-09-14T11:22:16.262243+0000","last_fullsized":"2024-09-14T11:22:16.262243+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:12.291644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":30724,"num_write":15,"num_write_kb":10242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"260'2","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:11.138584+0000","last_change":"2024-09-14T11:01:20.863767+0000","last_active":"2024-09-14T11:22:11.138584+0000","last_peered":"2024-09-14T11:22:11.138584+0000","last_clean":"2024-09-14T11:22:11.138584+0000","last_became_active":"2024-09-14T11:01:20.863495+0000","last_became_peered":"2024-09-14T11:01:20.863495+0000","last_unstale":"2024-09-14T11:22:11.138584+0000","last_undegraded":"2024-09-14T11:22:11.138584+0000","last_fullsized":"2024-09-14T11:22:11.138584+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:36:10.395831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"260'32","reported_seq":120,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:22.110836+0000","last_change":"2024-09-14T10:59:48.416964+0000","last_active":"2024-09-14T11:19:22.110836+0000","last_peered":"2024-09-14T11:19:22.110836+0000","last_clean":"2024-09-14T11:19:22.110836+0000","last_became_active":"2024-09-14T10:59:48.416253+0000","last_became_peered":"2024-09-14T10:59:48.416253+0000","last_unstale":"2024-09-14T11:19:22.110836+0000","last_undegraded":"2024-09-14T11:19:22.110836+0000","last_fullsized":"2024-09-14T11:19:22.110836+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:16.459819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":142,"num_write":84,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:46.240692+0000","last_change":"2024-09-14T11:11:42.589281+0000","last_active":"2024-09-14T11:19:46.240692+0000","last_peered":"2024-09-14T11:19:46.240692+0000","last_clean":"2024-09-14T11:19:46.240692+0000","last_became_active":"2024-09-14T11:11:42.588988+0000","last_became_peered":"2024-09-14T11:11:42.588988+0000","last_unstale":"2024-09-14T11:19:46.240692+0000","last_undegraded":"2024-09-14T11:19:46.240692+0000","last_fullsized":"2024-09-14T11:19:46.240692+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:50:56.659833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"260'6","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.599106+0000","last_change":"2024-09-14T11:01:23.889213+0000","last_active":"2024-09-14T11:22:50.599106+0000","last_peered":"2024-09-14T11:22:50.599106+0000","last_clean":"2024-09-14T11:22:50.599106+0000","last_became_active":"2024-09-14T11:01:23.888845+0000","last_became_peered":"2024-09-14T11:01:23.888845+0000","last_unstale":"2024-09-14T11:22:50.599106+0000","last_undegraded":"2024-09-14T11:22:50.599106+0000","last_fullsized":"2024-09-14T11:22:50.599106+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:20.704713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"257'10","reported_seq":60,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:39.980809+0000","last_change":"2024-09-14T11:01:20.866169+0000","last_active":"2024-09-14T11:18:39.980809+0000","last_peered":"2024-09-14T11:18:39.980809+0000","last_clean":"2024-09-14T11:18:39.980809+0000","last_became_active":"2024-09-14T11:01:20.865891+0000","last_became_peered":"2024-09-14T11:01:20.865891+0000","last_unstale":"2024-09-14T11:18:39.980809+0000","last_undegraded":"2024-09-14T11:18:39.980809+0000","last_fullsized":"2024-09-14T11:18:39.980809+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:22.211764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":24580,"num_write":15,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"260'27","reported_seq":115,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:49.998360+0000","last_change":"2024-09-14T10:59:48.421115+0000","last_active":"2024-09-14T11:20:49.998360+0000","last_peered":"2024-09-14T11:20:49.998360+0000","last_clean":"2024-09-14T11:20:49.998360+0000","last_became_active":"2024-09-14T10:59:48.420845+0000","last_became_peered":"2024-09-14T10:59:48.420845+0000","last_unstale":"2024-09-14T11:20:49.998360+0000","last_undegraded":"2024-09-14T11:20:49.998360+0000","last_fullsized":"2024-09-14T11:20:49.998360+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:56.781294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":135,"num_write":77,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:02.116980+0000","last_change":"2024-09-14T11:11:42.592263+0000","last_active":"2024-09-14T11:20:02.116980+0000","last_peered":"2024-09-14T11:20:02.116980+0000","last_clean":"2024-09-14T11:20:02.116980+0000","last_became_active":"2024-09-14T11:11:42.591734+0000","last_became_peered":"2024-09-14T11:11:42.591734+0000","last_unstale":"2024-09-14T11:20:02.116980+0000","last_undegraded":"2024-09-14T11:20:02.116980+0000","last_fullsized":"2024-09-14T11:20:02.116980+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:48.663357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"260'3","reported_seq":31,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:57.125206+0000","last_change":"2024-09-14T11:01:23.895194+0000","last_active":"2024-09-14T11:20:57.125206+0000","last_peered":"2024-09-14T11:20:57.125206+0000","last_clean":"2024-09-14T11:20:57.125206+0000","last_became_active":"2024-09-14T11:01:23.894904+0000","last_became_peered":"2024-09-14T11:01:23.894904+0000","last_unstale":"2024-09-14T11:20:57.125206+0000","last_undegraded":"2024-09-14T11:20:57.125206+0000","last_fullsized":"2024-09-14T11:20:57.125206+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:18.788575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:42.104731+0000","last_change":"2024-09-14T11:01:20.867989+0000","last_active":"2024-09-14T11:18:42.104731+0000","last_peered":"2024-09-14T11:18:42.104731+0000","last_clean":"2024-09-14T11:18:42.104731+0000","last_became_active":"2024-09-14T11:01:20.867675+0000","last_became_peered":"2024-09-14T11:01:20.867675+0000","last_unstale":"2024-09-14T11:18:42.104731+0000","last_undegraded":"2024-09-14T11:18:42.104731+0000","last_fullsized":"2024-09-14T11:18:42.104731+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:14:01.546319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"260'45","reported_seq":167,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:41.002316+0000","last_change":"2024-09-14T10:59:48.420304+0000","last_active":"2024-09-14T11:20:41.002316+0000","last_peered":"2024-09-14T11:20:41.002316+0000","last_clean":"2024-09-14T11:20:41.002316+0000","last_became_active":"2024-09-14T10:59:48.419276+0000","last_became_peered":"2024-09-14T10:59:48.419276+0000","last_unstale":"2024-09-14T11:20:41.002316+0000","last_undegraded":"2024-09-14T11:20:41.002316+0000","last_fullsized":"2024-09-14T11:20:41.002316+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:28.099017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":347,"num_read_kb":232,"num_write":118,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"259'1","reported_seq":19,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:26.000278+0000","last_change":"2024-09-14T11:11:42.585561+0000","last_active":"2024-09-14T11:20:26.000278+0000","last_peered":"2024-09-14T11:20:26.000278+0000","last_clean":"2024-09-14T11:20:26.000278+0000","last_became_active":"2024-09-14T11:11:42.585114+0000","last_became_peered":"2024-09-14T11:11:42.585114+0000","last_unstale":"2024-09-14T11:20:26.000278+0000","last_undegraded":"2024-09-14T11:20:26.000278+0000","last_fullsized":"2024-09-14T11:20:26.000278+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:57.558919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"260'2","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:16.139205+0000","last_change":"2024-09-14T11:01:23.894718+0000","last_active":"2024-09-14T11:22:16.139205+0000","last_peered":"2024-09-14T11:22:16.139205+0000","last_clean":"2024-09-14T11:22:16.139205+0000","last_became_active":"2024-09-14T11:01:23.894464+0000","last_became_peered":"2024-09-14T11:01:23.894464+0000","last_unstale":"2024-09-14T11:22:16.139205+0000","last_undegraded":"2024-09-14T11:22:16.139205+0000","last_fullsized":"2024-09-14T11:22:16.139205+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:05.810582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":35,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:24.987527+0000","last_change":"2024-09-14T11:01:20.869396+0000","last_active":"2024-09-14T11:19:24.987527+0000","last_peered":"2024-09-14T11:19:24.987527+0000","last_clean":"2024-09-14T11:19:24.987527+0000","last_became_active":"2024-09-14T11:01:20.869082+0000","last_became_peered":"2024-09-14T11:01:20.869082+0000","last_unstale":"2024-09-14T11:19:24.987527+0000","last_undegraded":"2024-09-14T11:19:24.987527+0000","last_fullsized":"2024-09-14T11:19:24.987527+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:21.154202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"260'42","reported_seq":152,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:00.225547+0000","last_change":"2024-09-14T10:59:48.420048+0000","last_active":"2024-09-14T11:21:00.225547+0000","last_peered":"2024-09-14T11:21:00.225547+0000","last_clean":"2024-09-14T11:21:00.225547+0000","last_became_active":"2024-09-14T10:59:48.419753+0000","last_became_peered":"2024-09-14T10:59:48.419753+0000","last_unstale":"2024-09-14T11:21:00.225547+0000","last_undegraded":"2024-09-14T11:21:00.225547+0000","last_fullsized":"2024-09-14T11:21:00.225547+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:03.370977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":323,"num_read_kb":218,"num_write":115,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:26.123988+0000","last_change":"2024-09-14T11:11:42.593259+0000","last_active":"2024-09-14T11:20:26.123988+0000","last_peered":"2024-09-14T11:20:26.123988+0000","last_clean":"2024-09-14T11:20:26.123988+0000","last_became_active":"2024-09-14T11:11:42.592960+0000","last_became_peered":"2024-09-14T11:11:42.592960+0000","last_unstale":"2024-09-14T11:20:26.123988+0000","last_undegraded":"2024-09-14T11:20:26.123988+0000","last_fullsized":"2024-09-14T11:20:26.123988+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:01.524529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"260'3","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:32.129826+0000","last_change":"2024-09-14T11:01:23.884623+0000","last_active":"2024-09-14T11:21:32.129826+0000","last_peered":"2024-09-14T11:21:32.129826+0000","last_clean":"2024-09-14T11:21:32.129826+0000","last_became_active":"2024-09-14T11:01:23.883464+0000","last_became_peered":"2024-09-14T11:01:23.883464+0000","last_unstale":"2024-09-14T11:21:32.129826+0000","last_undegraded":"2024-09-14T11:21:32.129826+0000","last_fullsized":"2024-09-14T11:21:32.129826+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:39:12.543169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":35,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:07.117641+0000","last_change":"2024-09-14T11:01:20.858331+0000","last_active":"2024-09-14T11:20:07.117641+0000","last_peered":"2024-09-14T11:20:07.117641+0000","last_clean":"2024-09-14T11:20:07.117641+0000","last_became_active":"2024-09-14T11:01:20.858057+0000","last_became_peered":"2024-09-14T11:01:20.858057+0000","last_unstale":"2024-09-14T11:20:07.117641+0000","last_undegraded":"2024-09-14T11:20:07.117641+0000","last_fullsized":"2024-09-14T11:20:07.117641+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:57:11.838133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"260'19","reported_seq":86,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:42.122601+0000","last_change":"2024-09-14T10:59:48.413110+0000","last_active":"2024-09-14T11:20:42.122601+0000","last_peered":"2024-09-14T11:20:42.122601+0000","last_clean":"2024-09-14T11:20:42.122601+0000","last_became_active":"2024-09-14T10:59:48.412832+0000","last_became_peered":"2024-09-14T10:59:48.412832+0000","last_unstale":"2024-09-14T11:20:42.122601+0000","last_undegraded":"2024-09-14T11:20:42.122601+0000","last_fullsized":"2024-09-14T11:20:42.122601+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:06.411861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":68,"num_write":55,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:06.243706+0000","last_change":"2024-09-14T11:11:42.590806+0000","last_active":"2024-09-14T11:20:06.243706+0000","last_peered":"2024-09-14T11:20:06.243706+0000","last_clean":"2024-09-14T11:20:06.243706+0000","last_became_active":"2024-09-14T11:11:42.590549+0000","last_became_peered":"2024-09-14T11:11:42.590549+0000","last_unstale":"2024-09-14T11:20:06.243706+0000","last_undegraded":"2024-09-14T11:20:06.243706+0000","last_fullsized":"2024-09-14T11:20:06.243706+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:47:13.279425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":29,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:09.993244+0000","last_change":"2024-09-14T11:01:23.880483+0000","last_active":"2024-09-14T11:20:09.993244+0000","last_peered":"2024-09-14T11:20:09.993244+0000","last_clean":"2024-09-14T11:20:09.993244+0000","last_became_active":"2024-09-14T11:01:23.880195+0000","last_became_peered":"2024-09-14T11:01:23.880195+0000","last_unstale":"2024-09-14T11:20:09.993244+0000","last_undegraded":"2024-09-14T11:20:09.993244+0000","last_fullsized":"2024-09-14T11:20:09.993244+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:17.209496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":35,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:05.990504+0000","last_change":"2024-09-14T11:01:20.869635+0000","last_active":"2024-09-14T11:20:05.990504+0000","last_peered":"2024-09-14T11:20:05.990504+0000","last_clean":"2024-09-14T11:20:05.990504+0000","last_became_active":"2024-09-14T11:01:20.869312+0000","last_became_peered":"2024-09-14T11:01:20.869312+0000","last_unstale":"2024-09-14T11:20:05.990504+0000","last_undegraded":"2024-09-14T11:20:05.990504+0000","last_fullsized":"2024-09-14T11:20:05.990504+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:36:29.069053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"257'19","reported_seq":97,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:42.122542+0000","last_change":"2024-09-14T10:59:48.418837+0000","last_active":"2024-09-14T11:20:42.122542+0000","last_peered":"2024-09-14T11:20:42.122542+0000","last_clean":"2024-09-14T11:20:42.122542+0000","last_became_active":"2024-09-14T10:59:48.418369+0000","last_became_peered":"2024-09-14T10:59:48.418369+0000","last_unstale":"2024-09-14T11:20:42.122542+0000","last_undegraded":"2024-09-14T11:20:42.122542+0000","last_fullsized":"2024-09-14T11:20:42.122542+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:53.388331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":97,"num_write":49,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:02.117065+0000","last_change":"2024-09-14T11:11:42.593087+0000","last_active":"2024-09-14T11:20:02.117065+0000","last_peered":"2024-09-14T11:20:02.117065+0000","last_clean":"2024-09-14T11:20:02.117065+0000","last_became_active":"2024-09-14T11:11:42.592333+0000","last_became_peered":"2024-09-14T11:11:42.592333+0000","last_unstale":"2024-09-14T11:20:02.117065+0000","last_undegraded":"2024-09-14T11:20:02.117065+0000","last_fullsized":"2024-09-14T11:20:02.117065+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:32.247668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"260'2","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:15.008829+0000","last_change":"2024-09-14T11:01:23.882421+0000","last_active":"2024-09-14T11:22:15.008829+0000","last_peered":"2024-09-14T11:22:15.008829+0000","last_clean":"2024-09-14T11:22:15.008829+0000","last_became_active":"2024-09-14T11:01:23.882133+0000","last_became_peered":"2024-09-14T11:01:23.882133+0000","last_unstale":"2024-09-14T11:22:15.008829+0000","last_undegraded":"2024-09-14T11:22:15.008829+0000","last_fullsized":"2024-09-14T11:22:15.008829+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:20.333208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":35,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:07.117340+0000","last_change":"2024-09-14T11:01:20.861253+0000","last_active":"2024-09-14T11:20:07.117340+0000","last_peered":"2024-09-14T11:20:07.117340+0000","last_clean":"2024-09-14T11:20:07.117340+0000","last_became_active":"2024-09-14T11:01:20.860944+0000","last_became_peered":"2024-09-14T11:01:20.860944+0000","last_unstale":"2024-09-14T11:20:07.117340+0000","last_undegraded":"2024-09-14T11:20:07.117340+0000","last_fullsized":"2024-09-14T11:20:07.117340+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:43.601108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"260'37","reported_seq":141,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:19.371160+0000","last_change":"2024-09-14T10:59:48.420240+0000","last_active":"2024-09-14T11:20:19.371160+0000","last_peered":"2024-09-14T11:20:19.371160+0000","last_clean":"2024-09-14T11:20:19.371160+0000","last_became_active":"2024-09-14T10:59:48.419953+0000","last_became_peered":"2024-09-14T10:59:48.419953+0000","last_unstale":"2024-09-14T11:20:19.371160+0000","last_undegraded":"2024-09-14T11:20:19.371160+0000","last_fullsized":"2024-09-14T11:20:19.371160+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:19.266531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":210,"num_write":90,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"260'349","reported_seq":984,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.468070+0000","last_change":"2024-09-14T10:45:43.684610+0000","last_active":"2024-09-14T11:22:51.468070+0000","last_peered":"2024-09-14T11:22:51.468070+0000","last_clean":"2024-09-14T11:22:51.468070+0000","last_became_active":"2024-09-14T10:45:43.684205+0000","last_became_peered":"2024-09-14T10:45:43.684205+0000","last_unstale":"2024-09-14T11:22:51.468070+0000","last_undegraded":"2024-09-14T11:22:51.468070+0000","last_fullsized":"2024-09-14T11:22:51.468070+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:01:55.211378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133699,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":617,"num_read_kb":37218,"num_write":1077,"num_write_kb":25003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"260'782","reported_seq":2531,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.834281+0000","last_change":"2024-09-14T10:45:45.714795+0000","last_active":"2024-09-14T11:22:42.834281+0000","last_peered":"2024-09-14T11:22:42.834281+0000","last_clean":"2024-09-14T11:22:42.834281+0000","last_became_active":"2024-09-14T10:45:45.714485+0000","last_became_peered":"2024-09-14T10:45:45.714485+0000","last_unstale":"2024-09-14T11:22:42.834281+0000","last_undegraded":"2024-09-14T11:22:42.834281+0000","last_fullsized":"2024-09-14T11:22:42.834281+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:23:57.662505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4300,"num_read_kb":3942,"num_write":1034,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"260'352","reported_seq":1029,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.434109+0000","last_change":"2024-09-14T10:45:43.684416+0000","last_active":"2024-09-14T11:22:51.434109+0000","last_peered":"2024-09-14T11:22:51.434109+0000","last_clean":"2024-09-14T11:22:51.434109+0000","last_became_active":"2024-09-14T10:45:43.683777+0000","last_became_peered":"2024-09-14T10:45:43.683777+0000","last_unstale":"2024-09-14T11:22:51.434109+0000","last_undegraded":"2024-09-14T11:22:51.434109+0000","last_fullsized":"2024-09-14T11:22:51.434109+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:01.676657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":760,"num_read_kb":10810,"num_write":1149,"num_write_kb":33486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"260'363","reported_seq":1830,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.734957+0000","last_change":"2024-09-14T10:45:45.716175+0000","last_active":"2024-09-14T11:21:28.734957+0000","last_peered":"2024-09-14T11:21:28.734957+0000","last_clean":"2024-09-14T11:21:28.734957+0000","last_became_active":"2024-09-14T10:45:45.715857+0000","last_became_peered":"2024-09-14T10:45:45.715857+0000","last_unstale":"2024-09-14T11:21:28.734957+0000","last_undegraded":"2024-09-14T11:21:28.734957+0000","last_fullsized":"2024-09-14T11:21:28.734957+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:52.361682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2025,"num_read_kb":1946,"num_write":400,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"260'376","reported_seq":1080,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.437034+0000","last_change":"2024-09-14T10:45:43.689580+0000","last_active":"2024-09-14T11:22:51.437034+0000","last_peered":"2024-09-14T11:22:51.437034+0000","last_clean":"2024-09-14T11:22:51.437034+0000","last_became_active":"2024-09-14T10:45:43.689222+0000","last_became_peered":"2024-09-14T10:45:43.689222+0000","last_unstale":"2024-09-14T11:22:51.437034+0000","last_undegraded":"2024-09-14T11:22:51.437034+0000","last_fullsized":"2024-09-14T11:22:51.437034+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:25.612577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":957,"num_read_kb":25215,"num_write":1113,"num_write_kb":46624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"260'805","reported_seq":2235,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:14.951766+0000","last_change":"2024-09-14T10:45:45.718479+0000","last_active":"2024-09-14T11:21:14.951766+0000","last_peered":"2024-09-14T11:21:14.951766+0000","last_clean":"2024-09-14T11:21:14.951766+0000","last_became_active":"2024-09-14T10:45:45.718205+0000","last_became_peered":"2024-09-14T10:45:45.718205+0000","last_unstale":"2024-09-14T11:21:14.951766+0000","last_undegraded":"2024-09-14T11:21:14.951766+0000","last_fullsized":"2024-09-14T11:21:14.951766+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:25.149788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3715,"num_read_kb":3327,"num_write":1051,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"260'401","reported_seq":1143,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.472126+0000","last_change":"2024-09-14T10:45:43.689239+0000","last_active":"2024-09-14T11:22:51.472126+0000","last_peered":"2024-09-14T11:22:51.472126+0000","last_clean":"2024-09-14T11:22:51.472126+0000","last_became_active":"2024-09-14T10:45:43.688982+0000","last_became_peered":"2024-09-14T10:45:43.688982+0000","last_unstale":"2024-09-14T11:22:51.472126+0000","last_undegraded":"2024-09-14T11:22:51.472126+0000","last_fullsized":"2024-09-14T11:22:51.472126+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:12.609439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133692,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":838,"num_read_kb":162483,"num_write":1341,"num_write_kb":45809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"260'456","reported_seq":2005,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.041160+0000","last_change":"2024-09-14T10:45:45.718026+0000","last_active":"2024-09-14T11:21:27.041160+0000","last_peered":"2024-09-14T11:21:27.041160+0000","last_clean":"2024-09-14T11:21:27.041160+0000","last_became_active":"2024-09-14T10:45:45.717699+0000","last_became_peered":"2024-09-14T10:45:45.717699+0000","last_unstale":"2024-09-14T11:21:27.041160+0000","last_undegraded":"2024-09-14T11:21:27.041160+0000","last_fullsized":"2024-09-14T11:21:27.041160+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:20.366459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2461,"num_read_kb":2303,"num_write":536,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"260'368","reported_seq":1007,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.477724+0000","last_change":"2024-09-14T10:45:43.686364+0000","last_active":"2024-09-14T11:22:51.477724+0000","last_peered":"2024-09-14T11:22:51.477724+0000","last_clean":"2024-09-14T11:22:51.477724+0000","last_became_active":"2024-09-14T10:45:43.686078+0000","last_became_peered":"2024-09-14T10:45:43.686078+0000","last_unstale":"2024-09-14T11:22:51.477724+0000","last_undegraded":"2024-09-14T11:22:51.477724+0000","last_fullsized":"2024-09-14T11:22:51.477724+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:18.961172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":598,"num_read_kb":61894,"num_write":1162,"num_write_kb":33123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"260'397","reported_seq":2007,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:13.971249+0000","last_change":"2024-09-14T10:45:45.714828+0000","last_active":"2024-09-14T11:21:13.971249+0000","last_peered":"2024-09-14T11:21:13.971249+0000","last_clean":"2024-09-14T11:21:13.971249+0000","last_became_active":"2024-09-14T10:45:45.714345+0000","last_became_peered":"2024-09-14T10:45:45.714345+0000","last_unstale":"2024-09-14T11:21:13.971249+0000","last_undegraded":"2024-09-14T11:21:13.971249+0000","last_fullsized":"2024-09-14T11:21:13.971249+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:55.678707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2395,"num_read_kb":2287,"num_write":454,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"260'355","reported_seq":1011,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.447341+0000","last_change":"2024-09-14T10:45:43.689767+0000","last_active":"2024-09-14T11:22:51.447341+0000","last_peered":"2024-09-14T11:22:51.447341+0000","last_clean":"2024-09-14T11:22:51.447341+0000","last_became_active":"2024-09-14T10:45:43.689513+0000","last_became_peered":"2024-09-14T10:45:43.689513+0000","last_unstale":"2024-09-14T11:22:51.447341+0000","last_undegraded":"2024-09-14T11:22:51.447341+0000","last_fullsized":"2024-09-14T11:22:51.447341+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:37.766387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":492096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":689,"num_read_kb":58877,"num_write":1198,"num_write_kb":34980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"260'909","reported_seq":2780,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.732830+0000","last_change":"2024-09-14T10:45:45.722332+0000","last_active":"2024-09-14T11:21:28.732830+0000","last_peered":"2024-09-14T11:21:28.732830+0000","last_clean":"2024-09-14T11:21:28.732830+0000","last_became_active":"2024-09-14T10:45:45.722048+0000","last_became_peered":"2024-09-14T10:45:45.722048+0000","last_unstale":"2024-09-14T11:21:28.732830+0000","last_undegraded":"2024-09-14T11:21:28.732830+0000","last_fullsized":"2024-09-14T11:21:28.732830+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":800,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:09.983695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4452,"num_read_kb":4058,"num_write":1175,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"260'365","reported_seq":999,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.454253+0000","last_change":"2024-09-14T10:45:43.690177+0000","last_active":"2024-09-14T11:22:51.454253+0000","last_peered":"2024-09-14T11:22:51.454253+0000","last_clean":"2024-09-14T11:22:51.454253+0000","last_became_active":"2024-09-14T10:45:43.689229+0000","last_became_peered":"2024-09-14T10:45:43.689229+0000","last_unstale":"2024-09-14T11:22:51.454253+0000","last_undegraded":"2024-09-14T11:22:51.454253+0000","last_fullsized":"2024-09-14T11:22:51.454253+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:41:27.105141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":599,"num_read_kb":84854,"num_write":1153,"num_write_kb":20352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"260'522","reported_seq":2107,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:13.965056+0000","last_change":"2024-09-14T10:45:45.719274+0000","last_active":"2024-09-14T11:21:13.965056+0000","last_peered":"2024-09-14T11:21:13.965056+0000","last_clean":"2024-09-14T11:21:13.965056+0000","last_became_active":"2024-09-14T10:45:45.718978+0000","last_became_peered":"2024-09-14T10:45:45.718978+0000","last_unstale":"2024-09-14T11:21:13.965056+0000","last_undegraded":"2024-09-14T11:21:13.965056+0000","last_fullsized":"2024-09-14T11:21:13.965056+0000","mapping_epoch":26,"log_start":"260'500","ondisk_log_start":"260'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:26.609949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2761,"num_read_kb":2575,"num_write":634,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"260'339","reported_seq":969,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.428925+0000","last_change":"2024-09-14T10:45:43.687589+0000","last_active":"2024-09-14T11:22:51.428925+0000","last_peered":"2024-09-14T11:22:51.428925+0000","last_clean":"2024-09-14T11:22:51.428925+0000","last_became_active":"2024-09-14T10:45:43.687262+0000","last_became_peered":"2024-09-14T10:45:43.687262+0000","last_unstale":"2024-09-14T11:22:51.428925+0000","last_undegraded":"2024-09-14T11:22:51.428925+0000","last_fullsized":"2024-09-14T11:22:51.428925+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:56:05.018089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":682,"num_read_kb":42631,"num_write":1158,"num_write_kb":32664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"260'824","reported_seq":2512,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:15.867521+0000","last_change":"2024-09-14T10:45:45.721713+0000","last_active":"2024-09-14T11:21:15.867521+0000","last_peered":"2024-09-14T11:21:15.867521+0000","last_clean":"2024-09-14T11:21:15.867521+0000","last_became_active":"2024-09-14T10:45:45.721400+0000","last_became_peered":"2024-09-14T10:45:45.721400+0000","last_unstale":"2024-09-14T11:21:15.867521+0000","last_undegraded":"2024-09-14T11:21:15.867521+0000","last_fullsized":"2024-09-14T11:21:15.867521+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:10.944485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4476,"num_read_kb":4082,"num_write":1140,"num_write_kb":477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"260'1280","reported_seq":2915,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.732537+0000","last_change":"2024-09-14T10:45:45.710286+0000","last_active":"2024-09-14T11:21:28.732537+0000","last_peered":"2024-09-14T11:21:28.732537+0000","last_clean":"2024-09-14T11:21:28.732537+0000","last_became_active":"2024-09-14T10:45:45.710015+0000","last_became_peered":"2024-09-14T10:45:45.710015+0000","last_unstale":"2024-09-14T11:21:28.732537+0000","last_undegraded":"2024-09-14T11:21:28.732537+0000","last_fullsized":"2024-09-14T11:21:28.732537+0000","mapping_epoch":26,"log_start":"260'1200","ondisk_log_start":"260'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":1200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:23.780013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5907,"num_read_kb":5227,"num_write":1779,"num_write_kb":739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"260'360","reported_seq":961,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.463050+0000","last_change":"2024-09-14T10:45:43.678018+0000","last_active":"2024-09-14T11:22:51.463050+0000","last_peered":"2024-09-14T11:22:51.463050+0000","last_clean":"2024-09-14T11:22:51.463050+0000","last_became_active":"2024-09-14T10:45:43.677751+0000","last_became_peered":"2024-09-14T10:45:43.677751+0000","last_unstale":"2024-09-14T11:22:51.463050+0000","last_undegraded":"2024-09-14T11:22:51.463050+0000","last_fullsized":"2024-09-14T11:22:51.463050+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:31.249223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":554,"num_read_kb":880,"num_write":1155,"num_write_kb":23836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"260'595","reported_seq":2269,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.326963+0000","last_change":"2024-09-14T10:45:45.714870+0000","last_active":"2024-09-14T11:21:28.326963+0000","last_peered":"2024-09-14T11:21:28.326963+0000","last_clean":"2024-09-14T11:21:28.326963+0000","last_became_active":"2024-09-14T10:45:45.714551+0000","last_became_peered":"2024-09-14T10:45:45.714551+0000","last_unstale":"2024-09-14T11:21:28.326963+0000","last_undegraded":"2024-09-14T11:21:28.326963+0000","last_fullsized":"2024-09-14T11:21:28.326963+0000","mapping_epoch":26,"log_start":"260'500","ondisk_log_start":"260'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":500,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:50.970272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3058,"num_read_kb":2815,"num_write":741,"num_write_kb":205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"260'352","reported_seq":979,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.477733+0000","last_change":"2024-09-14T10:45:43.680667+0000","last_active":"2024-09-14T11:22:51.477733+0000","last_peered":"2024-09-14T11:22:51.477733+0000","last_clean":"2024-09-14T11:22:51.477733+0000","last_became_active":"2024-09-14T10:45:43.680355+0000","last_became_peered":"2024-09-14T10:45:43.680355+0000","last_unstale":"2024-09-14T11:22:51.477733+0000","last_undegraded":"2024-09-14T11:22:51.477733+0000","last_fullsized":"2024-09-14T11:22:51.477733+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:57.516008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":541,"num_read_kb":36303,"num_write":1001,"num_write_kb":55095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"260'493","reported_seq":2162,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:10.106395+0000","last_change":"2024-09-14T10:45:45.721003+0000","last_active":"2024-09-14T11:21:10.106395+0000","last_peered":"2024-09-14T11:21:10.106395+0000","last_clean":"2024-09-14T11:21:10.106395+0000","last_became_active":"2024-09-14T10:45:45.720760+0000","last_became_peered":"2024-09-14T10:45:45.720760+0000","last_unstale":"2024-09-14T11:21:10.106395+0000","last_undegraded":"2024-09-14T11:21:10.106395+0000","last_fullsized":"2024-09-14T11:21:10.106395+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:01.564789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2631,"num_read_kb":2483,"num_write":574,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"260'384","reported_seq":1059,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.458827+0000","last_change":"2024-09-14T10:45:43.684854+0000","last_active":"2024-09-14T11:22:51.458827+0000","last_peered":"2024-09-14T11:22:51.458827+0000","last_clean":"2024-09-14T11:22:51.458827+0000","last_became_active":"2024-09-14T10:45:43.684428+0000","last_became_peered":"2024-09-14T10:45:43.684428+0000","last_unstale":"2024-09-14T11:22:51.458827+0000","last_undegraded":"2024-09-14T11:22:51.458827+0000","last_fullsized":"2024-09-14T11:22:51.458827+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:19.142556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133668,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":756,"num_read_kb":9043,"num_write":1222,"num_write_kb":18367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"260'482","reported_seq":2055,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:57.282685+0000","last_change":"2024-09-14T10:45:45.724646+0000","last_active":"2024-09-14T11:21:57.282685+0000","last_peered":"2024-09-14T11:21:57.282685+0000","last_clean":"2024-09-14T11:21:57.282685+0000","last_became_active":"2024-09-14T10:45:45.724302+0000","last_became_peered":"2024-09-14T10:45:45.724302+0000","last_unstale":"2024-09-14T11:21:57.282685+0000","last_undegraded":"2024-09-14T11:21:57.282685+0000","last_fullsized":"2024-09-14T11:21:57.282685+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:59.147972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2564,"num_read_kb":2400,"num_write":575,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"260'334","reported_seq":1021,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.455826+0000","last_change":"2024-09-14T10:45:43.684077+0000","last_active":"2024-09-14T11:22:51.455826+0000","last_peered":"2024-09-14T11:22:51.455826+0000","last_clean":"2024-09-14T11:22:51.455826+0000","last_became_active":"2024-09-14T10:45:43.683797+0000","last_became_peered":"2024-09-14T10:45:43.683797+0000","last_unstale":"2024-09-14T11:22:51.455826+0000","last_undegraded":"2024-09-14T11:22:51.455826+0000","last_fullsized":"2024-09-14T11:22:51.455826+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:58.402146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":715,"num_read_kb":8100,"num_write":1180,"num_write_kb":25345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"260'430","reported_seq":1966,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:57.282334+0000","last_change":"2024-09-14T10:45:45.723905+0000","last_active":"2024-09-14T11:21:57.282334+0000","last_peered":"2024-09-14T11:21:57.282334+0000","last_clean":"2024-09-14T11:21:57.282334+0000","last_became_active":"2024-09-14T10:45:45.723570+0000","last_became_peered":"2024-09-14T10:45:45.723570+0000","last_unstale":"2024-09-14T11:21:57.282334+0000","last_undegraded":"2024-09-14T11:21:57.282334+0000","last_fullsized":"2024-09-14T11:21:57.282334+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:29.680427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2400,"num_read_kb":2278,"num_write":489,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"260'436","reported_seq":1147,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.428780+0000","last_change":"2024-09-14T10:45:43.687914+0000","last_active":"2024-09-14T11:22:51.428780+0000","last_peered":"2024-09-14T11:22:51.428780+0000","last_clean":"2024-09-14T11:22:51.428780+0000","last_became_active":"2024-09-14T10:45:43.687585+0000","last_became_peered":"2024-09-14T10:45:43.687585+0000","last_unstale":"2024-09-14T11:22:51.428780+0000","last_undegraded":"2024-09-14T11:22:51.428780+0000","last_fullsized":"2024-09-14T11:22:51.428780+0000","mapping_epoch":23,"log_start":"260'400","ondisk_log_start":"260'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:00.103110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1137,"num_read_kb":1116,"num_write":1403,"num_write_kb":30799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"260'797","reported_seq":2444,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.833277+0000","last_change":"2024-09-14T10:45:45.714545+0000","last_active":"2024-09-14T11:22:42.833277+0000","last_peered":"2024-09-14T11:22:42.833277+0000","last_clean":"2024-09-14T11:22:42.833277+0000","last_became_active":"2024-09-14T10:45:45.714187+0000","last_became_peered":"2024-09-14T10:45:45.714187+0000","last_unstale":"2024-09-14T11:22:42.833277+0000","last_undegraded":"2024-09-14T11:22:42.833277+0000","last_fullsized":"2024-09-14T11:22:42.833277+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:45.790561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3909,"num_read_kb":3562,"num_write":1036,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"260'345","reported_seq":984,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.456634+0000","last_change":"2024-09-14T10:45:43.682640+0000","last_active":"2024-09-14T11:22:51.456634+0000","last_peered":"2024-09-14T11:22:51.456634+0000","last_clean":"2024-09-14T11:22:51.456634+0000","last_became_active":"2024-09-14T10:45:43.681680+0000","last_became_peered":"2024-09-14T10:45:43.681680+0000","last_unstale":"2024-09-14T11:22:51.456634+0000","last_undegraded":"2024-09-14T11:22:51.456634+0000","last_fullsized":"2024-09-14T11:22:51.456634+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:56.323253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":572,"num_read_kb":80059,"num_write":1115,"num_write_kb":31213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"260'166","reported_seq":655,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.801186+0000","last_change":"2024-09-14T10:45:53.749801+0000","last_active":"2024-09-14T11:21:28.801186+0000","last_peered":"2024-09-14T11:21:28.801186+0000","last_clean":"2024-09-14T11:21:28.801186+0000","last_became_active":"2024-09-14T10:45:53.749495+0000","last_became_peered":"2024-09-14T10:45:53.749495+0000","last_unstale":"2024-09-14T11:21:28.801186+0000","last_undegraded":"2024-09-14T11:21:28.801186+0000","last_fullsized":"2024-09-14T11:21:28.801186+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:52.768692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":160,"num_read_kb":158,"num_write":391,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"260'882","reported_seq":2449,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.040798+0000","last_change":"2024-09-14T10:45:45.711094+0000","last_active":"2024-09-14T11:21:27.040798+0000","last_peered":"2024-09-14T11:21:27.040798+0000","last_clean":"2024-09-14T11:21:27.040798+0000","last_became_active":"2024-09-14T10:45:45.710830+0000","last_became_peered":"2024-09-14T10:45:45.710830+0000","last_unstale":"2024-09-14T11:21:27.040798+0000","last_undegraded":"2024-09-14T11:21:27.040798+0000","last_fullsized":"2024-09-14T11:21:27.040798+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":800,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:36:38.927707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5905,"num_read_kb":5530,"num_write":1368,"num_write_kb":537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"260'441","reported_seq":1116,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.480033+0000","last_change":"2024-09-14T10:45:43.684728+0000","last_active":"2024-09-14T11:22:51.480033+0000","last_peered":"2024-09-14T11:22:51.480033+0000","last_clean":"2024-09-14T11:22:51.480033+0000","last_became_active":"2024-09-14T10:45:43.684504+0000","last_became_peered":"2024-09-14T10:45:43.684504+0000","last_unstale":"2024-09-14T11:22:51.480033+0000","last_undegraded":"2024-09-14T11:22:51.480033+0000","last_fullsized":"2024-09-14T11:22:51.480033+0000","mapping_epoch":23,"log_start":"260'400","ondisk_log_start":"260'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:34.311522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133694,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":846,"num_read_kb":75778,"num_write":1426,"num_write_kb":37052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:37.113110+0000","last_change":"2024-09-14T10:45:47.730971+0000","last_active":"2024-09-14T11:19:37.113110+0000","last_peered":"2024-09-14T11:19:37.113110+0000","last_clean":"2024-09-14T11:19:37.113110+0000","last_became_active":"2024-09-14T10:45:47.730629+0000","last_became_peered":"2024-09-14T10:45:47.730629+0000","last_unstale":"2024-09-14T11:19:37.113110+0000","last_undegraded":"2024-09-14T11:19:37.113110+0000","last_fullsized":"2024-09-14T11:19:37.113110+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:32.300839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"260'333","reported_seq":920,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.380130+0000","last_change":"2024-09-14T10:45:49.734204+0000","last_active":"2024-09-14T11:22:50.380130+0000","last_peered":"2024-09-14T11:22:50.380130+0000","last_clean":"2024-09-14T11:22:50.380130+0000","last_became_active":"2024-09-14T10:45:49.733770+0000","last_became_peered":"2024-09-14T10:45:49.733770+0000","last_unstale":"2024-09-14T11:22:50.380130+0000","last_undegraded":"2024-09-14T11:22:50.380130+0000","last_fullsized":"2024-09-14T11:22:50.380130+0000","mapping_epoch":30,"log_start":"260'300","ondisk_log_start":"260'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:22:33.077712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49773,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":530,"num_read_kb":1113,"num_write":424,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":476,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:42.113693+0000","last_change":"2024-09-14T10:45:51.745748+0000","last_active":"2024-09-14T11:19:42.113693+0000","last_peered":"2024-09-14T11:19:42.113693+0000","last_clean":"2024-09-14T11:19:42.113693+0000","last_became_active":"2024-09-14T10:45:51.745410+0000","last_became_peered":"2024-09-14T10:45:51.745410+0000","last_unstale":"2024-09-14T11:19:42.113693+0000","last_undegraded":"2024-09-14T11:19:42.113693+0000","last_fullsized":"2024-09-14T11:19:42.113693+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:18.010792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"260'94","reported_seq":570,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:57.443244+0000","last_change":"2024-09-14T10:45:53.743811+0000","last_active":"2024-09-14T11:20:57.443244+0000","last_peered":"2024-09-14T11:20:57.443244+0000","last_clean":"2024-09-14T11:20:57.443244+0000","last_became_active":"2024-09-14T10:45:53.743472+0000","last_became_peered":"2024-09-14T10:45:53.743472+0000","last_unstale":"2024-09-14T11:20:57.443244+0000","last_undegraded":"2024-09-14T11:20:57.443244+0000","last_fullsized":"2024-09-14T11:20:57.443244+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:52.958224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":73,"num_read_kb":72,"num_write":215,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"260'380","reported_seq":1786,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.336678+0000","last_change":"2024-09-14T10:45:45.713778+0000","last_active":"2024-09-14T11:21:28.336678+0000","last_peered":"2024-09-14T11:21:28.336678+0000","last_clean":"2024-09-14T11:21:28.336678+0000","last_became_active":"2024-09-14T10:45:45.713502+0000","last_became_peered":"2024-09-14T10:45:45.713502+0000","last_unstale":"2024-09-14T11:21:28.336678+0000","last_undegraded":"2024-09-14T11:21:28.336678+0000","last_fullsized":"2024-09-14T11:21:28.336678+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:23.141736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2020,"num_read_kb":1909,"num_write":423,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"260'299","reported_seq":1028,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.441655+0000","last_change":"2024-09-14T10:45:43.684236+0000","last_active":"2024-09-14T11:22:51.441655+0000","last_peered":"2024-09-14T11:22:51.441655+0000","last_clean":"2024-09-14T11:22:51.441655+0000","last_became_active":"2024-09-14T10:45:43.683964+0000","last_became_peered":"2024-09-14T10:45:43.683964+0000","last_unstale":"2024-09-14T11:22:51.441655+0000","last_undegraded":"2024-09-14T11:22:51.441655+0000","last_fullsized":"2024-09-14T11:22:51.441655+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:17:40.024612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133715,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":687,"num_read_kb":39643,"num_write":1073,"num_write_kb":23617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:36.108919+0000","last_change":"2024-09-14T10:45:47.730176+0000","last_active":"2024-09-14T11:18:36.108919+0000","last_peered":"2024-09-14T11:18:36.108919+0000","last_clean":"2024-09-14T11:18:36.108919+0000","last_became_active":"2024-09-14T10:45:47.729871+0000","last_became_peered":"2024-09-14T10:45:47.729871+0000","last_unstale":"2024-09-14T11:18:36.108919+0000","last_undegraded":"2024-09-14T11:18:36.108919+0000","last_fullsized":"2024-09-14T11:18:36.108919+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:34.557174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"260'84","reported_seq":592,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:16.298825+0000","last_change":"2024-09-14T10:45:49.733320+0000","last_active":"2024-09-14T11:21:16.298825+0000","last_peered":"2024-09-14T11:21:16.298825+0000","last_clean":"2024-09-14T11:21:16.298825+0000","last_became_active":"2024-09-14T10:45:49.732459+0000","last_became_peered":"2024-09-14T10:45:49.732459+0000","last_unstale":"2024-09-14T11:21:16.298825+0000","last_undegraded":"2024-09-14T11:21:16.298825+0000","last_fullsized":"2024-09-14T11:21:16.298825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:04.811455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":84,"num_read_kb":79,"num_write":56,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":476,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:42.113623+0000","last_change":"2024-09-14T10:45:51.746902+0000","last_active":"2024-09-14T11:19:42.113623+0000","last_peered":"2024-09-14T11:19:42.113623+0000","last_clean":"2024-09-14T11:19:42.113623+0000","last_became_active":"2024-09-14T10:45:51.746608+0000","last_became_peered":"2024-09-14T10:45:51.746608+0000","last_unstale":"2024-09-14T11:19:42.113623+0000","last_undegraded":"2024-09-14T11:19:42.113623+0000","last_fullsized":"2024-09-14T11:19:42.113623+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:13.144965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"260'127","reported_seq":616,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:14.680398+0000","last_change":"2024-09-14T10:45:53.752864+0000","last_active":"2024-09-14T11:21:14.680398+0000","last_peered":"2024-09-14T11:21:14.680398+0000","last_clean":"2024-09-14T11:21:14.680398+0000","last_became_active":"2024-09-14T10:45:53.752597+0000","last_became_peered":"2024-09-14T10:45:53.752597+0000","last_unstale":"2024-09-14T11:21:14.680398+0000","last_undegraded":"2024-09-14T11:21:14.680398+0000","last_fullsized":"2024-09-14T11:21:14.680398+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:09.921876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":152,"num_read_kb":142,"num_write":295,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"260'1282","reported_seq":2988,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:15.435417+0000","last_change":"2024-09-14T10:45:45.725999+0000","last_active":"2024-09-14T11:21:15.435417+0000","last_peered":"2024-09-14T11:21:15.435417+0000","last_clean":"2024-09-14T11:21:15.435417+0000","last_became_active":"2024-09-14T10:45:45.725335+0000","last_became_peered":"2024-09-14T10:45:45.725335+0000","last_unstale":"2024-09-14T11:21:15.435417+0000","last_undegraded":"2024-09-14T11:21:15.435417+0000","last_fullsized":"2024-09-14T11:21:15.435417+0000","mapping_epoch":26,"log_start":"260'1200","ondisk_log_start":"260'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":1200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:56:31.965780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5911,"num_read_kb":5224,"num_write":1759,"num_write_kb":730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"260'350","reported_seq":999,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.477693+0000","last_change":"2024-09-14T10:45:43.671411+0000","last_active":"2024-09-14T11:22:51.477693+0000","last_peered":"2024-09-14T11:22:51.477693+0000","last_clean":"2024-09-14T11:22:51.477693+0000","last_became_active":"2024-09-14T10:45:43.671096+0000","last_became_peered":"2024-09-14T10:45:43.671096+0000","last_unstale":"2024-09-14T11:22:51.477693+0000","last_undegraded":"2024-09-14T11:22:51.477693+0000","last_fullsized":"2024-09-14T11:22:51.477693+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:30.153850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":684,"num_read_kb":57141,"num_write":1087,"num_write_kb":43933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:41.118430+0000","last_change":"2024-09-14T10:45:47.725982+0000","last_active":"2024-09-14T11:19:41.118430+0000","last_peered":"2024-09-14T11:19:41.118430+0000","last_clean":"2024-09-14T11:19:41.118430+0000","last_became_active":"2024-09-14T10:45:47.724723+0000","last_became_peered":"2024-09-14T10:45:47.724723+0000","last_unstale":"2024-09-14T11:19:41.118430+0000","last_undegraded":"2024-09-14T11:19:41.118430+0000","last_fullsized":"2024-09-14T11:19:41.118430+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:05.411328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"260'110","reported_seq":626,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:56.128174+0000","last_change":"2024-09-14T10:45:49.738230+0000","last_active":"2024-09-14T11:20:56.128174+0000","last_peered":"2024-09-14T11:20:56.128174+0000","last_clean":"2024-09-14T11:20:56.128174+0000","last_became_active":"2024-09-14T10:45:49.737651+0000","last_became_peered":"2024-09-14T10:45:49.737651+0000","last_unstale":"2024-09-14T11:20:56.128174+0000","last_undegraded":"2024-09-14T11:20:56.128174+0000","last_fullsized":"2024-09-14T11:20:56.128174+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:47.715854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":106,"num_write":82,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"260'808","reported_seq":4493,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.153298+0000","last_change":"2024-09-14T10:45:51.746239+0000","last_active":"2024-09-14T11:22:51.153298+0000","last_peered":"2024-09-14T11:22:51.153298+0000","last_clean":"2024-09-14T11:22:51.153298+0000","last_became_active":"2024-09-14T10:45:51.745441+0000","last_became_peered":"2024-09-14T10:45:51.745441+0000","last_unstale":"2024-09-14T11:22:51.153298+0000","last_undegraded":"2024-09-14T11:22:51.153298+0000","last_fullsized":"2024-09-14T11:22:51.153298+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:37.532791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"260'211","reported_seq":1016,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.737613+0000","last_change":"2024-09-14T10:45:53.753718+0000","last_active":"2024-09-14T11:21:28.737613+0000","last_peered":"2024-09-14T11:21:28.737613+0000","last_clean":"2024-09-14T11:21:28.737613+0000","last_became_active":"2024-09-14T10:45:53.753389+0000","last_became_peered":"2024-09-14T10:45:53.753389+0000","last_unstale":"2024-09-14T11:21:28.737613+0000","last_undegraded":"2024-09-14T11:21:28.737613+0000","last_fullsized":"2024-09-14T11:21:28.737613+0000","mapping_epoch":34,"log_start":"260'200","ondisk_log_start":"260'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:01.726415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":623,"num_read_kb":614,"num_write":459,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"260'900","reported_seq":2535,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.336894+0000","last_change":"2024-09-14T10:45:45.726071+0000","last_active":"2024-09-14T11:21:28.336894+0000","last_peered":"2024-09-14T11:21:28.336894+0000","last_clean":"2024-09-14T11:21:28.336894+0000","last_became_active":"2024-09-14T10:45:45.725700+0000","last_became_peered":"2024-09-14T10:45:45.725700+0000","last_unstale":"2024-09-14T11:21:28.336894+0000","last_undegraded":"2024-09-14T11:21:28.336894+0000","last_fullsized":"2024-09-14T11:21:28.336894+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":800,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:18.814798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4396,"num_read_kb":3931,"num_write":1208,"num_write_kb":463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"260'381","reported_seq":1028,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:56.685284+0000","last_change":"2024-09-14T11:22:56.685284+0000","last_active":"2024-09-14T11:22:56.685284+0000","last_peered":"2024-09-14T11:22:56.685284+0000","last_clean":"2024-09-14T11:22:56.685284+0000","last_became_active":"2024-09-14T10:45:43.683274+0000","last_became_peered":"2024-09-14T10:45:43.683274+0000","last_unstale":"2024-09-14T11:22:56.685284+0000","last_undegraded":"2024-09-14T11:22:56.685284+0000","last_fullsized":"2024-09-14T11:22:56.685284+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'381","last_scrub_stamp":"2024-09-14T11:22:56.685220+0000","last_deep_scrub":"260'381","last_deep_scrub_stamp":"2024-09-14T11:22:56.685220+0000","last_clean_scrub_stamp":"2024-09-14T11:22:56.685220+0000","objects_scrubbed":4,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:15.447942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":697,"num_read_kb":4530,"num_write":1135,"num_write_kb":39150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:37.113128+0000","last_change":"2024-09-14T10:45:47.729291+0000","last_active":"2024-09-14T11:19:37.113128+0000","last_peered":"2024-09-14T11:19:37.113128+0000","last_clean":"2024-09-14T11:19:37.113128+0000","last_became_active":"2024-09-14T10:45:47.729004+0000","last_became_peered":"2024-09-14T10:45:47.729004+0000","last_unstale":"2024-09-14T11:19:37.113128+0000","last_undegraded":"2024-09-14T11:19:37.113128+0000","last_fullsized":"2024-09-14T11:19:37.113128+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:50:40.551460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"260'257","reported_seq":801,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.346598+0000","last_change":"2024-09-14T10:45:49.729187+0000","last_active":"2024-09-14T11:22:51.346598+0000","last_peered":"2024-09-14T11:22:51.346598+0000","last_clean":"2024-09-14T11:22:51.346598+0000","last_became_active":"2024-09-14T10:45:49.728896+0000","last_became_peered":"2024-09-14T10:45:49.728896+0000","last_unstale":"2024-09-14T11:22:51.346598+0000","last_undegraded":"2024-09-14T11:22:51.346598+0000","last_fullsized":"2024-09-14T11:22:51.346598+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:09:59.076512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42620,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":444,"num_read_kb":1063,"num_write":366,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"260'804","reported_seq":3876,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.305143+0000","last_change":"2024-09-14T10:45:51.745148+0000","last_active":"2024-09-14T11:22:50.305143+0000","last_peered":"2024-09-14T11:22:50.305143+0000","last_clean":"2024-09-14T11:22:50.305143+0000","last_became_active":"2024-09-14T10:45:51.744510+0000","last_became_peered":"2024-09-14T10:45:51.744510+0000","last_unstale":"2024-09-14T11:22:50.305143+0000","last_undegraded":"2024-09-14T11:22:50.305143+0000","last_fullsized":"2024-09-14T11:22:50.305143+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":700,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:37.874498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"260'638","reported_seq":2325,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.742160+0000","last_change":"2024-09-14T10:45:45.716820+0000","last_active":"2024-09-14T11:21:28.742160+0000","last_peered":"2024-09-14T11:21:28.742160+0000","last_clean":"2024-09-14T11:21:28.742160+0000","last_became_active":"2024-09-14T10:45:45.716537+0000","last_became_peered":"2024-09-14T10:45:45.716537+0000","last_unstale":"2024-09-14T11:21:28.742160+0000","last_undegraded":"2024-09-14T11:21:28.742160+0000","last_fullsized":"2024-09-14T11:21:28.742160+0000","mapping_epoch":26,"log_start":"260'600","ondisk_log_start":"260'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":600,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:58.190819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3192,"num_read_kb":2926,"num_write":775,"num_write_kb":229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"260'310","reported_seq":912,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.421207+0000","last_change":"2024-09-14T10:46:20.046168+0000","last_active":"2024-09-14T11:22:51.421207+0000","last_peered":"2024-09-14T11:22:51.421207+0000","last_clean":"2024-09-14T11:22:51.421207+0000","last_became_active":"2024-09-14T10:46:20.045945+0000","last_became_peered":"2024-09-14T10:46:20.045945+0000","last_unstale":"2024-09-14T11:22:51.421207+0000","last_undegraded":"2024-09-14T11:22:51.421207+0000","last_fullsized":"2024-09-14T11:22:51.421207+0000","mapping_epoch":37,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:32.371701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":633,"num_read_kb":12757,"num_write":988,"num_write_kb":36887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":486,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:27.119742+0000","last_change":"2024-09-14T10:45:47.721721+0000","last_active":"2024-09-14T11:20:27.119742+0000","last_peered":"2024-09-14T11:20:27.119742+0000","last_clean":"2024-09-14T11:20:27.119742+0000","last_became_active":"2024-09-14T10:45:47.720639+0000","last_became_peered":"2024-09-14T10:45:47.720639+0000","last_unstale":"2024-09-14T11:20:27.119742+0000","last_undegraded":"2024-09-14T11:20:27.119742+0000","last_fullsized":"2024-09-14T11:20:27.119742+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:32.317587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"260'348","reported_seq":940,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.523130+0000","last_change":"2024-09-14T10:45:49.733109+0000","last_active":"2024-09-14T11:22:50.523130+0000","last_peered":"2024-09-14T11:22:50.523130+0000","last_clean":"2024-09-14T11:22:50.523130+0000","last_became_active":"2024-09-14T10:45:49.732754+0000","last_became_peered":"2024-09-14T10:45:49.732754+0000","last_unstale":"2024-09-14T11:22:50.523130+0000","last_undegraded":"2024-09-14T11:22:50.523130+0000","last_fullsized":"2024-09-14T11:22:50.523130+0000","mapping_epoch":30,"log_start":"260'300","ondisk_log_start":"260'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:34.312772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99406,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":572,"num_read_kb":1321,"num_write":460,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":471,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:35.986676+0000","last_change":"2024-09-14T10:45:51.746554+0000","last_active":"2024-09-14T11:19:35.986676+0000","last_peered":"2024-09-14T11:19:35.986676+0000","last_clean":"2024-09-14T11:19:35.986676+0000","last_became_active":"2024-09-14T10:45:51.746282+0000","last_became_peered":"2024-09-14T10:45:51.746282+0000","last_unstale":"2024-09-14T11:19:35.986676+0000","last_undegraded":"2024-09-14T11:19:35.986676+0000","last_fullsized":"2024-09-14T11:19:35.986676+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:58.772084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"260'557","reported_seq":1354,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:43.728730+0000","last_change":"2024-09-14T10:45:53.756022+0000","last_active":"2024-09-14T11:22:43.728730+0000","last_peered":"2024-09-14T11:22:43.728730+0000","last_clean":"2024-09-14T11:22:43.728730+0000","last_became_active":"2024-09-14T10:45:53.755505+0000","last_became_peered":"2024-09-14T10:45:53.755505+0000","last_unstale":"2024-09-14T11:22:43.728730+0000","last_undegraded":"2024-09-14T11:22:43.728730+0000","last_fullsized":"2024-09-14T11:22:43.728730+0000","mapping_epoch":34,"log_start":"260'500","ondisk_log_start":"260'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:02.468804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1310,"num_read_kb":1299,"num_write":1164,"num_write_kb":395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"260'605","reported_seq":2241,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.048954+0000","last_change":"2024-09-14T10:45:45.727093+0000","last_active":"2024-09-14T11:21:27.048954+0000","last_peered":"2024-09-14T11:21:27.048954+0000","last_clean":"2024-09-14T11:21:27.048954+0000","last_became_active":"2024-09-14T10:45:45.726869+0000","last_became_peered":"2024-09-14T10:45:45.726869+0000","last_unstale":"2024-09-14T11:21:27.048954+0000","last_undegraded":"2024-09-14T11:21:27.048954+0000","last_fullsized":"2024-09-14T11:21:27.048954+0000","mapping_epoch":26,"log_start":"260'500","ondisk_log_start":"260'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":500,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:48.236280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3274,"num_read_kb":2999,"num_write":839,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"260'384","reported_seq":1044,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.469802+0000","last_change":"2024-09-14T10:45:43.685334+0000","last_active":"2024-09-14T11:22:51.469802+0000","last_peered":"2024-09-14T11:22:51.469802+0000","last_clean":"2024-09-14T11:22:51.469802+0000","last_became_active":"2024-09-14T10:45:43.685087+0000","last_became_peered":"2024-09-14T10:45:43.685087+0000","last_unstale":"2024-09-14T11:22:51.469802+0000","last_undegraded":"2024-09-14T11:22:51.469802+0000","last_fullsized":"2024-09-14T11:22:51.469802+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:08.084059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":736,"num_read_kb":49067,"num_write":1293,"num_write_kb":21177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":480,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:30.993267+0000","last_change":"2024-09-14T10:45:47.727776+0000","last_active":"2024-09-14T11:20:30.993267+0000","last_peered":"2024-09-14T11:20:30.993267+0000","last_clean":"2024-09-14T11:20:30.993267+0000","last_became_active":"2024-09-14T10:45:47.727250+0000","last_became_peered":"2024-09-14T10:45:47.727250+0000","last_unstale":"2024-09-14T11:20:30.993267+0000","last_undegraded":"2024-09-14T11:20:30.993267+0000","last_fullsized":"2024-09-14T11:20:30.993267+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:04.583303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"260'256","reported_seq":810,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.980108+0000","last_change":"2024-09-14T10:45:49.735628+0000","last_active":"2024-09-14T11:22:50.980108+0000","last_peered":"2024-09-14T11:22:50.980108+0000","last_clean":"2024-09-14T11:22:50.980108+0000","last_became_active":"2024-09-14T10:45:49.735124+0000","last_became_peered":"2024-09-14T10:45:49.735124+0000","last_unstale":"2024-09-14T11:22:50.980108+0000","last_undegraded":"2024-09-14T11:22:50.980108+0000","last_fullsized":"2024-09-14T11:22:50.980108+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:52.071424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45256,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":435,"num_read_kb":1035,"num_write":356,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:36.125222+0000","last_change":"2024-09-14T10:45:51.745912+0000","last_active":"2024-09-14T11:20:36.125222+0000","last_peered":"2024-09-14T11:20:36.125222+0000","last_clean":"2024-09-14T11:20:36.125222+0000","last_became_active":"2024-09-14T10:45:51.744757+0000","last_became_peered":"2024-09-14T10:45:51.744757+0000","last_unstale":"2024-09-14T11:20:36.125222+0000","last_undegraded":"2024-09-14T11:20:36.125222+0000","last_fullsized":"2024-09-14T11:20:36.125222+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:15.473173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"260'2449","reported_seq":4259,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:57.283800+0000","last_change":"2024-09-14T10:45:53.753015+0000","last_active":"2024-09-14T11:21:57.283800+0000","last_peered":"2024-09-14T11:21:57.283800+0000","last_clean":"2024-09-14T11:21:57.283800+0000","last_became_active":"2024-09-14T10:45:53.752708+0000","last_became_peered":"2024-09-14T10:45:53.752708+0000","last_unstale":"2024-09-14T11:21:57.283800+0000","last_undegraded":"2024-09-14T11:21:57.283800+0000","last_fullsized":"2024-09-14T11:21:57.283800+0000","mapping_epoch":34,"log_start":"260'2400","ondisk_log_start":"260'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":2400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:01:55.437550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6140,"num_read_kb":6145,"num_write":4932,"num_write_kb":1822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"260'757","reported_seq":2462,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.048715+0000","last_change":"2024-09-14T10:45:45.722496+0000","last_active":"2024-09-14T11:21:27.048715+0000","last_peered":"2024-09-14T11:21:27.048715+0000","last_clean":"2024-09-14T11:21:27.048715+0000","last_became_active":"2024-09-14T10:45:45.722006+0000","last_became_peered":"2024-09-14T10:45:45.722006+0000","last_unstale":"2024-09-14T11:21:27.048715+0000","last_undegraded":"2024-09-14T11:21:27.048715+0000","last_fullsized":"2024-09-14T11:21:27.048715+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:00.949810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4059,"num_read_kb":3717,"num_write":984,"num_write_kb":359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"260'369","reported_seq":1007,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.467852+0000","last_change":"2024-09-14T10:45:43.676243+0000","last_active":"2024-09-14T11:22:51.467852+0000","last_peered":"2024-09-14T11:22:51.467852+0000","last_clean":"2024-09-14T11:22:51.467852+0000","last_became_active":"2024-09-14T10:45:43.675954+0000","last_became_peered":"2024-09-14T10:45:43.675954+0000","last_unstale":"2024-09-14T11:22:51.467852+0000","last_undegraded":"2024-09-14T11:22:51.467852+0000","last_fullsized":"2024-09-14T11:22:51.467852+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:56.905528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":645,"num_read_kb":32892,"num_write":1136,"num_write_kb":70045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"36'5","reported_seq":958,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.270306+0000","last_change":"2024-09-14T10:45:47.723683+0000","last_active":"2024-09-14T11:22:50.270306+0000","last_peered":"2024-09-14T11:22:50.270306+0000","last_clean":"2024-09-14T11:22:50.270306+0000","last_became_active":"2024-09-14T10:45:47.723389+0000","last_became_peered":"2024-09-14T10:45:47.723389+0000","last_unstale":"2024-09-14T11:22:50.270306+0000","last_undegraded":"2024-09-14T11:22:50.270306+0000","last_fullsized":"2024-09-14T11:22:50.270306+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:23.601158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"260'272","reported_seq":833,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.592950+0000","last_change":"2024-09-14T10:45:49.729401+0000","last_active":"2024-09-14T11:22:50.592950+0000","last_peered":"2024-09-14T11:22:50.592950+0000","last_clean":"2024-09-14T11:22:50.592950+0000","last_became_active":"2024-09-14T10:45:49.729120+0000","last_became_peered":"2024-09-14T10:45:49.729120+0000","last_unstale":"2024-09-14T11:22:50.592950+0000","last_undegraded":"2024-09-14T11:22:50.592950+0000","last_fullsized":"2024-09-14T11:22:50.592950+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:30.995395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43970,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":444,"num_read_kb":984,"num_write":354,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"260'804","reported_seq":2504,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.306405+0000","last_change":"2024-09-14T10:45:51.745170+0000","last_active":"2024-09-14T11:22:50.306405+0000","last_peered":"2024-09-14T11:22:50.306405+0000","last_clean":"2024-09-14T11:22:50.306405+0000","last_became_active":"2024-09-14T10:45:51.744869+0000","last_became_peered":"2024-09-14T10:45:51.744869+0000","last_unstale":"2024-09-14T11:22:50.306405+0000","last_undegraded":"2024-09-14T11:22:50.306405+0000","last_fullsized":"2024-09-14T11:22:50.306405+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":700,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:26.188815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"260'164","reported_seq":638,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.837357+0000","last_change":"2024-09-14T10:45:53.755630+0000","last_active":"2024-09-14T11:22:42.837357+0000","last_peered":"2024-09-14T11:22:42.837357+0000","last_clean":"2024-09-14T11:22:42.837357+0000","last_became_active":"2024-09-14T10:45:53.755367+0000","last_became_peered":"2024-09-14T10:45:53.755367+0000","last_unstale":"2024-09-14T11:22:42.837357+0000","last_undegraded":"2024-09-14T11:22:42.837357+0000","last_fullsized":"2024-09-14T11:22:42.837357+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:07:14.533708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":815,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":135,"num_read_kb":134,"num_write":407,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"260'761","reported_seq":2252,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:15.867801+0000","last_change":"2024-09-14T10:45:45.720145+0000","last_active":"2024-09-14T11:21:15.867801+0000","last_peered":"2024-09-14T11:21:15.867801+0000","last_clean":"2024-09-14T11:21:15.867801+0000","last_became_active":"2024-09-14T10:45:45.719864+0000","last_became_peered":"2024-09-14T10:45:45.719864+0000","last_unstale":"2024-09-14T11:21:15.867801+0000","last_undegraded":"2024-09-14T11:21:15.867801+0000","last_fullsized":"2024-09-14T11:21:15.867801+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:09.038651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3610,"num_read_kb":3266,"num_write":990,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"260'352","reported_seq":985,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:56.642945+0000","last_change":"2024-09-14T11:22:56.642945+0000","last_active":"2024-09-14T11:22:56.642945+0000","last_peered":"2024-09-14T11:22:56.642945+0000","last_clean":"2024-09-14T11:22:56.642945+0000","last_became_active":"2024-09-14T10:45:43.681137+0000","last_became_peered":"2024-09-14T10:45:43.681137+0000","last_unstale":"2024-09-14T11:22:56.642945+0000","last_undegraded":"2024-09-14T11:22:56.642945+0000","last_fullsized":"2024-09-14T11:22:56.642945+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'352","last_scrub_stamp":"2024-09-14T11:22:56.642848+0000","last_deep_scrub":"260'352","last_deep_scrub_stamp":"2024-09-14T11:22:56.642848+0000","last_clean_scrub_stamp":"2024-09-14T11:22:56.642848+0000","objects_scrubbed":6,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:18.121328+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":525,"num_read_kb":31159,"num_write":1040,"num_write_kb":37353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":480,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:40.994524+0000","last_change":"2024-09-14T10:45:47.730225+0000","last_active":"2024-09-14T11:20:40.994524+0000","last_peered":"2024-09-14T11:20:40.994524+0000","last_clean":"2024-09-14T11:20:40.994524+0000","last_became_active":"2024-09-14T10:45:47.729815+0000","last_became_peered":"2024-09-14T10:45:47.729815+0000","last_unstale":"2024-09-14T11:20:40.994524+0000","last_undegraded":"2024-09-14T11:20:40.994524+0000","last_fullsized":"2024-09-14T11:20:40.994524+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:42.373217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"260'510","reported_seq":1126,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.091392+0000","last_change":"2024-09-14T10:45:49.736189+0000","last_active":"2024-09-14T11:22:51.091392+0000","last_peered":"2024-09-14T11:22:51.091392+0000","last_clean":"2024-09-14T11:22:51.091392+0000","last_became_active":"2024-09-14T10:45:49.735297+0000","last_became_peered":"2024-09-14T10:45:49.735297+0000","last_unstale":"2024-09-14T11:22:51.091392+0000","last_undegraded":"2024-09-14T11:22:51.091392+0000","last_fullsized":"2024-09-14T11:22:51.091392+0000","mapping_epoch":30,"log_start":"260'400","ondisk_log_start":"260'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:32.962766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93593,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":881,"num_read_kb":2160,"num_write":740,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":471,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:31.246681+0000","last_change":"2024-09-14T10:45:51.749364+0000","last_active":"2024-09-14T11:20:31.246681+0000","last_peered":"2024-09-14T11:20:31.246681+0000","last_clean":"2024-09-14T11:20:31.246681+0000","last_became_active":"2024-09-14T10:45:51.749045+0000","last_became_peered":"2024-09-14T10:45:51.749045+0000","last_unstale":"2024-09-14T11:20:31.246681+0000","last_undegraded":"2024-09-14T11:20:31.246681+0000","last_fullsized":"2024-09-14T11:20:31.246681+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:03.211664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"260'125","reported_seq":630,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:13.515424+0000","last_change":"2024-09-14T10:45:53.752016+0000","last_active":"2024-09-14T11:21:13.515424+0000","last_peered":"2024-09-14T11:21:13.515424+0000","last_clean":"2024-09-14T11:21:13.515424+0000","last_became_active":"2024-09-14T10:45:53.751736+0000","last_became_peered":"2024-09-14T10:45:53.751736+0000","last_unstale":"2024-09-14T11:21:13.515424+0000","last_undegraded":"2024-09-14T11:21:13.515424+0000","last_fullsized":"2024-09-14T11:21:13.515424+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:32.284762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":704,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":191,"num_read_kb":171,"num_write":290,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"260'1189","reported_seq":2739,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.835801+0000","last_change":"2024-09-14T10:45:45.714998+0000","last_active":"2024-09-14T11:22:42.835801+0000","last_peered":"2024-09-14T11:22:42.835801+0000","last_clean":"2024-09-14T11:22:42.835801+0000","last_became_active":"2024-09-14T10:45:45.714723+0000","last_became_peered":"2024-09-14T10:45:45.714723+0000","last_unstale":"2024-09-14T11:22:42.835801+0000","last_undegraded":"2024-09-14T11:22:42.835801+0000","last_fullsized":"2024-09-14T11:22:42.835801+0000","mapping_epoch":26,"log_start":"260'1100","ondisk_log_start":"260'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":1100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:09:48.211216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5470,"num_read_kb":4821,"num_write":1659,"num_write_kb":709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"260'363","reported_seq":986,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.461847+0000","last_change":"2024-09-14T10:45:43.686869+0000","last_active":"2024-09-14T11:22:51.461847+0000","last_peered":"2024-09-14T11:22:51.461847+0000","last_clean":"2024-09-14T11:22:51.461847+0000","last_became_active":"2024-09-14T10:45:43.686531+0000","last_became_peered":"2024-09-14T10:45:43.686531+0000","last_unstale":"2024-09-14T11:22:51.461847+0000","last_undegraded":"2024-09-14T11:22:51.461847+0000","last_fullsized":"2024-09-14T11:22:51.461847+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:55.909629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133692,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":671,"num_read_kb":7607,"num_write":1262,"num_write_kb":48356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":481,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:35.993761+0000","last_change":"2024-09-14T10:45:47.728475+0000","last_active":"2024-09-14T11:19:35.993761+0000","last_peered":"2024-09-14T11:19:35.993761+0000","last_clean":"2024-09-14T11:19:35.993761+0000","last_became_active":"2024-09-14T10:45:47.728213+0000","last_became_peered":"2024-09-14T10:45:47.728213+0000","last_unstale":"2024-09-14T11:19:35.993761+0000","last_undegraded":"2024-09-14T11:19:35.993761+0000","last_fullsized":"2024-09-14T11:19:35.993761+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:31.424129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"260'263","reported_seq":820,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.123754+0000","last_change":"2024-09-14T10:45:49.733110+0000","last_active":"2024-09-14T11:22:51.123754+0000","last_peered":"2024-09-14T11:22:51.123754+0000","last_clean":"2024-09-14T11:22:51.123754+0000","last_became_active":"2024-09-14T10:45:49.732813+0000","last_became_peered":"2024-09-14T10:45:49.732813+0000","last_unstale":"2024-09-14T11:22:51.123754+0000","last_undegraded":"2024-09-14T11:22:51.123754+0000","last_fullsized":"2024-09-14T11:22:51.123754+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:14.432782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14232,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":431,"num_read_kb":915,"num_write":388,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":473,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:45.995350+0000","last_change":"2024-09-14T10:45:51.748689+0000","last_active":"2024-09-14T11:19:45.995350+0000","last_peered":"2024-09-14T11:19:45.995350+0000","last_clean":"2024-09-14T11:19:45.995350+0000","last_became_active":"2024-09-14T10:45:51.748381+0000","last_became_peered":"2024-09-14T10:45:51.748381+0000","last_unstale":"2024-09-14T11:19:45.995350+0000","last_undegraded":"2024-09-14T11:19:45.995350+0000","last_fullsized":"2024-09-14T11:19:45.995350+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:53.908296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"260'98","reported_seq":567,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:56.259131+0000","last_change":"2024-09-14T10:45:53.755248+0000","last_active":"2024-09-14T11:21:56.259131+0000","last_peered":"2024-09-14T11:21:56.259131+0000","last_clean":"2024-09-14T11:21:56.259131+0000","last_became_active":"2024-09-14T10:45:53.755022+0000","last_became_peered":"2024-09-14T10:45:53.755022+0000","last_unstale":"2024-09-14T11:21:56.259131+0000","last_undegraded":"2024-09-14T11:21:56.259131+0000","last_fullsized":"2024-09-14T11:21:56.259131+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:21.675722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":73,"num_read_kb":72,"num_write":223,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"260'435","reported_seq":1975,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.049003+0000","last_change":"2024-09-14T10:45:45.710662+0000","last_active":"2024-09-14T11:21:27.049003+0000","last_peered":"2024-09-14T11:21:27.049003+0000","last_clean":"2024-09-14T11:21:27.049003+0000","last_became_active":"2024-09-14T10:45:45.710367+0000","last_became_peered":"2024-09-14T10:45:45.710367+0000","last_unstale":"2024-09-14T11:21:27.049003+0000","last_undegraded":"2024-09-14T11:21:27.049003+0000","last_fullsized":"2024-09-14T11:21:27.049003+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:39:23.616400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2526,"num_read_kb":2387,"num_write":527,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"260'327","reported_seq":1010,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.430401+0000","last_change":"2024-09-14T10:45:43.676790+0000","last_active":"2024-09-14T11:22:51.430401+0000","last_peered":"2024-09-14T11:22:51.430401+0000","last_clean":"2024-09-14T11:22:51.430401+0000","last_became_active":"2024-09-14T10:45:43.676514+0000","last_became_peered":"2024-09-14T10:45:43.676514+0000","last_unstale":"2024-09-14T11:22:51.430401+0000","last_undegraded":"2024-09-14T11:22:51.430401+0000","last_fullsized":"2024-09-14T11:22:51.430401+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:19.891010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174780,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":649,"num_read_kb":125837,"num_write":1068,"num_write_kb":34909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:36.239100+0000","last_change":"2024-09-14T10:45:47.728092+0000","last_active":"2024-09-14T11:19:36.239100+0000","last_peered":"2024-09-14T11:19:36.239100+0000","last_clean":"2024-09-14T11:19:36.239100+0000","last_became_active":"2024-09-14T10:45:47.727632+0000","last_became_peered":"2024-09-14T10:45:47.727632+0000","last_unstale":"2024-09-14T11:19:36.239100+0000","last_undegraded":"2024-09-14T11:19:36.239100+0000","last_fullsized":"2024-09-14T11:19:36.239100+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:44.526326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"260'292","reported_seq":851,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.875892+0000","last_change":"2024-09-14T10:45:49.737975+0000","last_active":"2024-09-14T11:22:50.875892+0000","last_peered":"2024-09-14T11:22:50.875892+0000","last_clean":"2024-09-14T11:22:50.875892+0000","last_became_active":"2024-09-14T10:45:49.737690+0000","last_became_peered":"2024-09-14T10:45:49.737690+0000","last_unstale":"2024-09-14T11:22:50.875892+0000","last_undegraded":"2024-09-14T11:22:50.875892+0000","last_fullsized":"2024-09-14T11:22:50.875892+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:15.403726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69554,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":489,"num_read_kb":1163,"num_write":398,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"260'778","reported_seq":2020,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.301721+0000","last_change":"2024-09-14T10:45:51.749775+0000","last_active":"2024-09-14T11:22:50.301721+0000","last_peered":"2024-09-14T11:22:50.301721+0000","last_clean":"2024-09-14T11:22:50.301721+0000","last_became_active":"2024-09-14T10:45:51.749478+0000","last_became_peered":"2024-09-14T10:45:51.749478+0000","last_unstale":"2024-09-14T11:22:50.301721+0000","last_undegraded":"2024-09-14T11:22:50.301721+0000","last_fullsized":"2024-09-14T11:22:50.301721+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":700,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:13:43.438242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"260'128","reported_seq":609,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:13.969218+0000","last_change":"2024-09-14T10:45:53.746737+0000","last_active":"2024-09-14T11:21:13.969218+0000","last_peered":"2024-09-14T11:21:13.969218+0000","last_clean":"2024-09-14T11:21:13.969218+0000","last_became_active":"2024-09-14T10:45:53.746254+0000","last_became_peered":"2024-09-14T10:45:53.746254+0000","last_unstale":"2024-09-14T11:21:13.969218+0000","last_undegraded":"2024-09-14T11:21:13.969218+0000","last_fullsized":"2024-09-14T11:21:13.969218+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:28:26.210153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1445,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":145,"num_read_kb":134,"num_write":327,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"260'483","reported_seq":2054,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.840774+0000","last_change":"2024-09-14T10:45:45.720938+0000","last_active":"2024-09-14T11:22:42.840774+0000","last_peered":"2024-09-14T11:22:42.840774+0000","last_clean":"2024-09-14T11:22:42.840774+0000","last_became_active":"2024-09-14T10:45:45.720660+0000","last_became_peered":"2024-09-14T10:45:45.720660+0000","last_unstale":"2024-09-14T11:22:42.840774+0000","last_undegraded":"2024-09-14T11:22:42.840774+0000","last_fullsized":"2024-09-14T11:22:42.840774+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:36.468993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2593,"num_read_kb":2426,"num_write":578,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"260'346","reported_seq":954,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.466219+0000","last_change":"2024-09-14T10:45:43.690826+0000","last_active":"2024-09-14T11:22:51.466219+0000","last_peered":"2024-09-14T11:22:51.466219+0000","last_clean":"2024-09-14T11:22:51.466219+0000","last_became_active":"2024-09-14T10:45:43.690517+0000","last_became_peered":"2024-09-14T10:45:43.690517+0000","last_unstale":"2024-09-14T11:22:51.466219+0000","last_undegraded":"2024-09-14T11:22:51.466219+0000","last_fullsized":"2024-09-14T11:22:51.466219+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:17.734297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267379,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":525,"num_read_kb":51932,"num_write":1051,"num_write_kb":23808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1440,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.282417+0000","last_change":"2024-09-14T10:45:47.721307+0000","last_active":"2024-09-14T11:22:50.282417+0000","last_peered":"2024-09-14T11:22:50.282417+0000","last_clean":"2024-09-14T11:22:50.282417+0000","last_became_active":"2024-09-14T10:45:47.720716+0000","last_became_peered":"2024-09-14T10:45:47.720716+0000","last_unstale":"2024-09-14T11:22:50.282417+0000","last_undegraded":"2024-09-14T11:22:50.282417+0000","last_fullsized":"2024-09-14T11:22:50.282417+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:49.138193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":953,"num_read_kb":953,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"260'68","reported_seq":563,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:13.520750+0000","last_change":"2024-09-14T10:45:49.733374+0000","last_active":"2024-09-14T11:21:13.520750+0000","last_peered":"2024-09-14T11:21:13.520750+0000","last_clean":"2024-09-14T11:21:13.520750+0000","last_became_active":"2024-09-14T10:45:49.732913+0000","last_became_peered":"2024-09-14T10:45:49.732913+0000","last_unstale":"2024-09-14T11:21:13.520750+0000","last_undegraded":"2024-09-14T11:21:13.520750+0000","last_fullsized":"2024-09-14T11:21:13.520750+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:41.223364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":64,"num_read_kb":57,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"260'797","reported_seq":2414,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.302625+0000","last_change":"2024-09-14T10:45:51.741412+0000","last_active":"2024-09-14T11:22:50.302625+0000","last_peered":"2024-09-14T11:22:50.302625+0000","last_clean":"2024-09-14T11:22:50.302625+0000","last_became_active":"2024-09-14T10:45:51.741102+0000","last_became_peered":"2024-09-14T10:45:51.741102+0000","last_unstale":"2024-09-14T11:22:50.302625+0000","last_undegraded":"2024-09-14T11:22:50.302625+0000","last_fullsized":"2024-09-14T11:22:50.302625+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:08.256488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"260'150","reported_seq":656,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:13.516830+0000","last_change":"2024-09-14T10:45:53.752456+0000","last_active":"2024-09-14T11:21:13.516830+0000","last_peered":"2024-09-14T11:21:13.516830+0000","last_clean":"2024-09-14T11:21:13.516830+0000","last_became_active":"2024-09-14T10:45:53.752100+0000","last_became_peered":"2024-09-14T10:45:53.752100+0000","last_unstale":"2024-09-14T11:21:13.516830+0000","last_undegraded":"2024-09-14T11:21:13.516830+0000","last_fullsized":"2024-09-14T11:21:13.516830+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:44.647729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":861,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":268,"num_read_kb":228,"num_write":378,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"260'468","reported_seq":2069,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:16.297144+0000","last_change":"2024-09-14T10:45:45.719579+0000","last_active":"2024-09-14T11:21:16.297144+0000","last_peered":"2024-09-14T11:21:16.297144+0000","last_clean":"2024-09-14T11:21:16.297144+0000","last_became_active":"2024-09-14T10:45:45.719221+0000","last_became_peered":"2024-09-14T10:45:45.719221+0000","last_unstale":"2024-09-14T11:21:16.297144+0000","last_undegraded":"2024-09-14T11:21:16.297144+0000","last_fullsized":"2024-09-14T11:21:16.297144+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:24.645466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2509,"num_read_kb":2365,"num_write":566,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"260'321","reported_seq":923,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.469356+0000","last_change":"2024-09-14T10:45:43.690704+0000","last_active":"2024-09-14T11:22:51.469356+0000","last_peered":"2024-09-14T11:22:51.469356+0000","last_clean":"2024-09-14T11:22:51.469356+0000","last_became_active":"2024-09-14T10:45:43.690417+0000","last_became_peered":"2024-09-14T10:45:43.690417+0000","last_unstale":"2024-09-14T11:22:51.469356+0000","last_undegraded":"2024-09-14T11:22:51.469356+0000","last_fullsized":"2024-09-14T11:22:51.469356+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:28.703262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":503,"num_read_kb":28260,"num_write":967,"num_write_kb":36225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":479,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:32.112331+0000","last_change":"2024-09-14T10:45:47.731129+0000","last_active":"2024-09-14T11:19:32.112331+0000","last_peered":"2024-09-14T11:19:32.112331+0000","last_clean":"2024-09-14T11:19:32.112331+0000","last_became_active":"2024-09-14T10:45:47.730790+0000","last_became_peered":"2024-09-14T10:45:47.730790+0000","last_unstale":"2024-09-14T11:19:32.112331+0000","last_undegraded":"2024-09-14T11:19:32.112331+0000","last_fullsized":"2024-09-14T11:19:32.112331+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:38.545867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"260'324","reported_seq":910,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.415696+0000","last_change":"2024-09-14T10:45:49.735771+0000","last_active":"2024-09-14T11:22:50.415696+0000","last_peered":"2024-09-14T11:22:50.415696+0000","last_clean":"2024-09-14T11:22:50.415696+0000","last_became_active":"2024-09-14T10:45:49.735482+0000","last_became_peered":"2024-09-14T10:45:49.735482+0000","last_unstale":"2024-09-14T11:22:50.415696+0000","last_undegraded":"2024-09-14T11:22:50.415696+0000","last_fullsized":"2024-09-14T11:22:50.415696+0000","mapping_epoch":30,"log_start":"260'300","ondisk_log_start":"260'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:18:04.742025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46045,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":538,"num_read_kb":1149,"num_write":426,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":468,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:39.989653+0000","last_change":"2024-09-14T10:45:51.750926+0000","last_active":"2024-09-14T11:19:39.989653+0000","last_peered":"2024-09-14T11:19:39.989653+0000","last_clean":"2024-09-14T11:19:39.989653+0000","last_became_active":"2024-09-14T10:45:51.750669+0000","last_became_peered":"2024-09-14T10:45:51.750669+0000","last_unstale":"2024-09-14T11:19:39.989653+0000","last_undegraded":"2024-09-14T11:19:39.989653+0000","last_fullsized":"2024-09-14T11:19:39.989653+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:54.215538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"260'118","reported_seq":594,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.200888+0000","last_change":"2024-09-14T10:45:53.749127+0000","last_active":"2024-09-14T11:21:28.200888+0000","last_peered":"2024-09-14T11:21:28.200888+0000","last_clean":"2024-09-14T11:21:28.200888+0000","last_became_active":"2024-09-14T10:45:53.748865+0000","last_became_peered":"2024-09-14T10:45:53.748865+0000","last_unstale":"2024-09-14T11:21:28.200888+0000","last_undegraded":"2024-09-14T11:21:28.200888+0000","last_fullsized":"2024-09-14T11:21:28.200888+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:29.632424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":116,"num_write":279,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"260'612","reported_seq":2403,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.832394+0000","last_change":"2024-09-14T10:45:45.716546+0000","last_active":"2024-09-14T11:22:42.832394+0000","last_peered":"2024-09-14T11:22:42.832394+0000","last_clean":"2024-09-14T11:22:42.832394+0000","last_became_active":"2024-09-14T10:45:45.716236+0000","last_became_peered":"2024-09-14T10:45:45.716236+0000","last_unstale":"2024-09-14T11:22:42.832394+0000","last_undegraded":"2024-09-14T11:22:42.832394+0000","last_fullsized":"2024-09-14T11:22:42.832394+0000","mapping_epoch":26,"log_start":"260'600","ondisk_log_start":"260'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":600,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:59:19.965279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3315,"num_read_kb":3084,"num_write":730,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"260'74","reported_seq":611,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:55.699728+0000","last_change":"2024-09-14T11:22:55.699728+0000","last_active":"2024-09-14T11:22:55.699728+0000","last_peered":"2024-09-14T11:22:55.699728+0000","last_clean":"2024-09-14T11:22:55.699728+0000","last_became_active":"2024-09-14T10:45:28.985499+0000","last_became_peered":"2024-09-14T10:45:28.985499+0000","last_unstale":"2024-09-14T11:22:55.699728+0000","last_undegraded":"2024-09-14T11:22:55.699728+0000","last_fullsized":"2024-09-14T11:22:55.699728+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'74","last_scrub_stamp":"2024-09-14T11:22:55.699647+0000","last_deep_scrub":"260'74","last_deep_scrub_stamp":"2024-09-14T11:22:55.699647+0000","last_clean_scrub_stamp":"2024-09-14T11:22:55.699647+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:04.417375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":504,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:57.106903+0000","last_change":"2024-09-14T10:45:35.579820+0000","last_active":"2024-09-14T11:18:57.106903+0000","last_peered":"2024-09-14T11:18:57.106903+0000","last_clean":"2024-09-14T11:18:57.106903+0000","last_became_active":"2024-09-14T10:45:33.610592+0000","last_became_peered":"2024-09-14T10:45:33.610592+0000","last_unstale":"2024-09-14T11:18:57.106903+0000","last_undegraded":"2024-09-14T11:18:57.106903+0000","last_fullsized":"2024-09-14T11:18:57.106903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_clean_scrub_stamp":"2024-09-14T10:45:32.551765+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:46:36.542821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043055799999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"260'279","reported_seq":918,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.443633+0000","last_change":"2024-09-14T10:45:43.690581+0000","last_active":"2024-09-14T11:22:51.443633+0000","last_peered":"2024-09-14T11:22:51.443633+0000","last_clean":"2024-09-14T11:22:51.443633+0000","last_became_active":"2024-09-14T10:45:43.690248+0000","last_became_peered":"2024-09-14T10:45:43.690248+0000","last_unstale":"2024-09-14T11:22:51.443633+0000","last_undegraded":"2024-09-14T11:22:51.443633+0000","last_fullsized":"2024-09-14T11:22:51.443633+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:27.312124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":552,"num_read_kb":56771,"num_write":951,"num_write_kb":24880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:07.204339+0000","last_change":"2024-09-14T10:45:47.723764+0000","last_active":"2024-09-14T11:19:07.204339+0000","last_peered":"2024-09-14T11:19:07.204339+0000","last_clean":"2024-09-14T11:19:07.204339+0000","last_became_active":"2024-09-14T10:45:47.723495+0000","last_became_peered":"2024-09-14T10:45:47.723495+0000","last_unstale":"2024-09-14T11:19:07.204339+0000","last_undegraded":"2024-09-14T11:19:07.204339+0000","last_fullsized":"2024-09-14T11:19:07.204339+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:28.951657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"260'743","reported_seq":1426,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.449185+0000","last_change":"2024-09-14T10:45:49.734638+0000","last_active":"2024-09-14T11:22:51.449185+0000","last_peered":"2024-09-14T11:22:51.449185+0000","last_clean":"2024-09-14T11:22:51.449185+0000","last_became_active":"2024-09-14T10:45:49.733774+0000","last_became_peered":"2024-09-14T10:45:49.733774+0000","last_unstale":"2024-09-14T11:22:51.449185+0000","last_undegraded":"2024-09-14T11:22:51.449185+0000","last_fullsized":"2024-09-14T11:22:51.449185+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":700,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:45.811248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152864,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1479,"num_read_kb":3507,"num_write":1366,"num_write_kb":1223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":471,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:31.246761+0000","last_change":"2024-09-14T10:45:51.745875+0000","last_active":"2024-09-14T11:20:31.246761+0000","last_peered":"2024-09-14T11:20:31.246761+0000","last_clean":"2024-09-14T11:20:31.246761+0000","last_became_active":"2024-09-14T10:45:51.745607+0000","last_became_peered":"2024-09-14T10:45:51.745607+0000","last_unstale":"2024-09-14T11:20:31.246761+0000","last_undegraded":"2024-09-14T11:20:31.246761+0000","last_fullsized":"2024-09-14T11:20:31.246761+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:12.059394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"260'234","reported_seq":922,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.747723+0000","last_change":"2024-09-14T10:45:53.751918+0000","last_active":"2024-09-14T11:21:28.747723+0000","last_peered":"2024-09-14T11:21:28.747723+0000","last_clean":"2024-09-14T11:21:28.747723+0000","last_became_active":"2024-09-14T10:45:53.751651+0000","last_became_peered":"2024-09-14T10:45:53.751651+0000","last_unstale":"2024-09-14T11:21:28.747723+0000","last_undegraded":"2024-09-14T11:21:28.747723+0000","last_fullsized":"2024-09-14T11:21:28.747723+0000","mapping_epoch":34,"log_start":"260'200","ondisk_log_start":"260'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:07.313069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":417,"num_read_kb":415,"num_write":468,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"260'500","reported_seq":2079,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:16.297332+0000","last_change":"2024-09-14T10:45:45.721927+0000","last_active":"2024-09-14T11:21:16.297332+0000","last_peered":"2024-09-14T11:21:16.297332+0000","last_clean":"2024-09-14T11:21:16.297332+0000","last_became_active":"2024-09-14T10:45:45.721633+0000","last_became_peered":"2024-09-14T10:45:45.721633+0000","last_unstale":"2024-09-14T11:21:16.297332+0000","last_undegraded":"2024-09-14T11:21:16.297332+0000","last_fullsized":"2024-09-14T11:21:16.297332+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:23.991533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2741,"num_read_kb":2557,"num_write":632,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":504,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:42.113836+0000","last_change":"2024-09-14T10:45:35.580149+0000","last_active":"2024-09-14T11:19:42.113836+0000","last_peered":"2024-09-14T11:19:42.113836+0000","last_clean":"2024-09-14T11:19:42.113836+0000","last_became_active":"2024-09-14T10:45:33.569860+0000","last_became_peered":"2024-09-14T10:45:33.569860+0000","last_unstale":"2024-09-14T11:19:42.113836+0000","last_undegraded":"2024-09-14T11:19:42.113836+0000","last_fullsized":"2024-09-14T11:19:42.113836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_clean_scrub_stamp":"2024-09-14T10:45:32.551765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:19.845227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074400599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"260'331","reported_seq":960,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.470640+0000","last_change":"2024-09-14T10:45:43.680588+0000","last_active":"2024-09-14T11:22:51.470640+0000","last_peered":"2024-09-14T11:22:51.470640+0000","last_clean":"2024-09-14T11:22:51.470640+0000","last_became_active":"2024-09-14T10:45:43.680290+0000","last_became_peered":"2024-09-14T10:45:43.680290+0000","last_unstale":"2024-09-14T11:22:51.470640+0000","last_undegraded":"2024-09-14T11:22:51.470640+0000","last_fullsized":"2024-09-14T11:22:51.470640+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:14.859096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":649,"num_read_kb":19207,"num_write":1098,"num_write_kb":41133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":480,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:27.120185+0000","last_change":"2024-09-14T10:45:47.728037+0000","last_active":"2024-09-14T11:20:27.120185+0000","last_peered":"2024-09-14T11:20:27.120185+0000","last_clean":"2024-09-14T11:20:27.120185+0000","last_became_active":"2024-09-14T10:45:47.727733+0000","last_became_peered":"2024-09-14T10:45:47.727733+0000","last_unstale":"2024-09-14T11:20:27.120185+0000","last_undegraded":"2024-09-14T11:20:27.120185+0000","last_fullsized":"2024-09-14T11:20:27.120185+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:08.238626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"260'1248","reported_seq":2611,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.413729+0000","last_change":"2024-09-14T10:45:49.731992+0000","last_active":"2024-09-14T11:22:51.413729+0000","last_peered":"2024-09-14T11:22:51.413729+0000","last_clean":"2024-09-14T11:22:51.413729+0000","last_became_active":"2024-09-14T10:45:49.731646+0000","last_became_peered":"2024-09-14T10:45:49.731646+0000","last_unstale":"2024-09-14T11:22:51.413729+0000","last_undegraded":"2024-09-14T11:22:51.413729+0000","last_fullsized":"2024-09-14T11:22:51.413729+0000","mapping_epoch":30,"log_start":"260'1200","ondisk_log_start":"260'1200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":1200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:40.965323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141569,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1984,"num_read_kb":3752,"num_write":1074,"num_write_kb":921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":472,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:17.109984+0000","last_change":"2024-09-14T10:45:51.745733+0000","last_active":"2024-09-14T11:19:17.109984+0000","last_peered":"2024-09-14T11:19:17.109984+0000","last_clean":"2024-09-14T11:19:17.109984+0000","last_became_active":"2024-09-14T10:45:51.745481+0000","last_became_peered":"2024-09-14T10:45:51.745481+0000","last_unstale":"2024-09-14T11:19:17.109984+0000","last_undegraded":"2024-09-14T11:19:17.109984+0000","last_fullsized":"2024-09-14T11:19:17.109984+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:11.216344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"260'292","reported_seq":816,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:43.730260+0000","last_change":"2024-09-14T10:45:53.750529+0000","last_active":"2024-09-14T11:22:43.730260+0000","last_peered":"2024-09-14T11:22:43.730260+0000","last_clean":"2024-09-14T11:22:43.730260+0000","last_became_active":"2024-09-14T10:45:53.750227+0000","last_became_peered":"2024-09-14T10:45:53.750227+0000","last_unstale":"2024-09-14T11:22:43.730260+0000","last_undegraded":"2024-09-14T11:22:43.730260+0000","last_fullsized":"2024-09-14T11:22:43.730260+0000","mapping_epoch":34,"log_start":"260'200","ondisk_log_start":"260'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:38.646551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":463,"num_read_kb":436,"num_write":609,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"260'355","reported_seq":1868,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:11.223921+0000","last_change":"2024-09-14T10:45:45.715226+0000","last_active":"2024-09-14T11:21:11.223921+0000","last_peered":"2024-09-14T11:21:11.223921+0000","last_clean":"2024-09-14T11:21:11.223921+0000","last_became_active":"2024-09-14T10:45:45.714923+0000","last_became_peered":"2024-09-14T10:45:45.714923+0000","last_unstale":"2024-09-14T11:21:11.223921+0000","last_undegraded":"2024-09-14T11:21:11.223921+0000","last_fullsized":"2024-09-14T11:21:11.223921+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:07.817788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2079,"num_read_kb":2005,"num_write":398,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":504,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:55.987569+0000","last_change":"2024-09-14T10:45:36.078832+0000","last_active":"2024-09-14T11:18:55.987569+0000","last_peered":"2024-09-14T11:18:55.987569+0000","last_clean":"2024-09-14T11:18:55.987569+0000","last_became_active":"2024-09-14T10:45:33.569944+0000","last_became_peered":"2024-09-14T10:45:33.569944+0000","last_unstale":"2024-09-14T11:18:55.987569+0000","last_undegraded":"2024-09-14T11:18:55.987569+0000","last_fullsized":"2024-09-14T11:18:55.987569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_clean_scrub_stamp":"2024-09-14T10:45:32.551765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:29.610279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055355599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"260'359","reported_seq":1050,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.464421+0000","last_change":"2024-09-14T10:45:43.684278+0000","last_active":"2024-09-14T11:22:51.464421+0000","last_peered":"2024-09-14T11:22:51.464421+0000","last_clean":"2024-09-14T11:22:51.464421+0000","last_became_active":"2024-09-14T10:45:43.682920+0000","last_became_peered":"2024-09-14T10:45:43.682920+0000","last_unstale":"2024-09-14T11:22:51.464421+0000","last_undegraded":"2024-09-14T11:22:51.464421+0000","last_fullsized":"2024-09-14T11:22:51.464421+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:53.359950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133679,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":823,"num_read_kb":18154,"num_write":1072,"num_write_kb":35009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":483,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:31.000785+0000","last_change":"2024-09-14T10:45:47.729348+0000","last_active":"2024-09-14T11:20:31.000785+0000","last_peered":"2024-09-14T11:20:31.000785+0000","last_clean":"2024-09-14T11:20:31.000785+0000","last_became_active":"2024-09-14T10:45:47.729061+0000","last_became_peered":"2024-09-14T10:45:47.729061+0000","last_unstale":"2024-09-14T11:20:31.000785+0000","last_undegraded":"2024-09-14T11:20:31.000785+0000","last_fullsized":"2024-09-14T11:20:31.000785+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:40.239555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"260'240","reported_seq":1217,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.211666+0000","last_change":"2024-09-14T10:45:49.732283+0000","last_active":"2024-09-14T11:22:42.211666+0000","last_peered":"2024-09-14T11:22:42.211666+0000","last_clean":"2024-09-14T11:22:42.211666+0000","last_became_active":"2024-09-14T10:45:49.731858+0000","last_became_peered":"2024-09-14T10:45:49.731858+0000","last_unstale":"2024-09-14T11:22:42.211666+0000","last_undegraded":"2024-09-14T11:22:42.211666+0000","last_fullsized":"2024-09-14T11:22:42.211666+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:59.698290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":156,"num_read_kb":145,"num_write":121,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:11.113947+0000","last_change":"2024-09-14T10:45:51.743386+0000","last_active":"2024-09-14T11:19:11.113947+0000","last_peered":"2024-09-14T11:19:11.113947+0000","last_clean":"2024-09-14T11:19:11.113947+0000","last_became_active":"2024-09-14T10:45:51.742651+0000","last_became_peered":"2024-09-14T10:45:51.742651+0000","last_unstale":"2024-09-14T11:19:11.113947+0000","last_undegraded":"2024-09-14T11:19:11.113947+0000","last_fullsized":"2024-09-14T11:19:11.113947+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:56.398753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"260'239","reported_seq":825,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.890931+0000","last_change":"2024-09-14T10:45:53.745667+0000","last_active":"2024-09-14T11:21:28.890931+0000","last_peered":"2024-09-14T11:21:28.890931+0000","last_clean":"2024-09-14T11:21:28.890931+0000","last_became_active":"2024-09-14T10:45:53.744823+0000","last_became_peered":"2024-09-14T10:45:53.744823+0000","last_unstale":"2024-09-14T11:21:28.890931+0000","last_undegraded":"2024-09-14T11:21:28.890931+0000","last_fullsized":"2024-09-14T11:21:28.890931+0000","mapping_epoch":34,"log_start":"260'200","ondisk_log_start":"260'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:01:08.099600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":471,"num_read_kb":497,"num_write":522,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"260'743","reported_seq":2245,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.833846+0000","last_change":"2024-09-14T10:45:45.714387+0000","last_active":"2024-09-14T11:22:42.833846+0000","last_peered":"2024-09-14T11:22:42.833846+0000","last_clean":"2024-09-14T11:22:42.833846+0000","last_became_active":"2024-09-14T10:45:45.714077+0000","last_became_peered":"2024-09-14T10:45:45.714077+0000","last_unstale":"2024-09-14T11:22:42.833846+0000","last_undegraded":"2024-09-14T11:22:42.833846+0000","last_fullsized":"2024-09-14T11:22:42.833846+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":700,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:32:40.285715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3745,"num_read_kb":3391,"num_write":988,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"260'3","reported_seq":514,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:56.321865+0000","last_change":"2024-09-14T11:22:56.321865+0000","last_active":"2024-09-14T11:22:56.321865+0000","last_peered":"2024-09-14T11:22:56.321865+0000","last_clean":"2024-09-14T11:22:56.321865+0000","last_became_active":"2024-09-14T10:45:33.612919+0000","last_became_peered":"2024-09-14T10:45:33.612919+0000","last_unstale":"2024-09-14T11:22:56.321865+0000","last_undegraded":"2024-09-14T11:22:56.321865+0000","last_fullsized":"2024-09-14T11:22:56.321865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T11:22:56.321789+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T11:22:56.321789+0000","last_clean_scrub_stamp":"2024-09-14T11:22:56.321789+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:47.764462+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00094497699999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"260'326","reported_seq":1194,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.394951+0000","last_change":"2024-09-14T10:45:43.679805+0000","last_active":"2024-09-14T11:22:51.394951+0000","last_peered":"2024-09-14T11:22:51.394951+0000","last_clean":"2024-09-14T11:22:51.394951+0000","last_became_active":"2024-09-14T10:45:43.679522+0000","last_became_peered":"2024-09-14T10:45:43.679522+0000","last_unstale":"2024-09-14T11:22:51.394951+0000","last_undegraded":"2024-09-14T11:22:51.394951+0000","last_fullsized":"2024-09-14T11:22:51.394951+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:59.700293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1353,"num_read_kb":12978,"num_write":1165,"num_write_kb":34630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"36'3","reported_seq":962,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.271527+0000","last_change":"2024-09-14T10:45:47.727327+0000","last_active":"2024-09-14T11:22:50.271527+0000","last_peered":"2024-09-14T11:22:50.271527+0000","last_clean":"2024-09-14T11:22:50.271527+0000","last_became_active":"2024-09-14T10:45:47.727050+0000","last_became_peered":"2024-09-14T10:45:47.727050+0000","last_unstale":"2024-09-14T11:22:50.271527+0000","last_undegraded":"2024-09-14T11:22:50.271527+0000","last_fullsized":"2024-09-14T11:22:50.271527+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:11.560613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"260'102","reported_seq":617,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:41.139054+0000","last_change":"2024-09-14T10:45:49.734492+0000","last_active":"2024-09-14T11:22:41.139054+0000","last_peered":"2024-09-14T11:22:41.139054+0000","last_clean":"2024-09-14T11:22:41.139054+0000","last_became_active":"2024-09-14T10:45:49.734181+0000","last_became_peered":"2024-09-14T10:45:49.734181+0000","last_unstale":"2024-09-14T11:22:41.139054+0000","last_undegraded":"2024-09-14T11:22:41.139054+0000","last_fullsized":"2024-09-14T11:22:41.139054+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:39.185773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":121,"num_read_kb":115,"num_write":86,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":472,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:32.120940+0000","last_change":"2024-09-14T10:45:51.744573+0000","last_active":"2024-09-14T11:20:32.120940+0000","last_peered":"2024-09-14T11:20:32.120940+0000","last_clean":"2024-09-14T11:20:32.120940+0000","last_became_active":"2024-09-14T10:45:51.744280+0000","last_became_peered":"2024-09-14T10:45:51.744280+0000","last_unstale":"2024-09-14T11:20:32.120940+0000","last_undegraded":"2024-09-14T11:20:32.120940+0000","last_fullsized":"2024-09-14T11:20:32.120940+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:36.528487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"260'117","reported_seq":649,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.997667+0000","last_change":"2024-09-14T10:45:53.746846+0000","last_active":"2024-09-14T11:21:27.997667+0000","last_peered":"2024-09-14T11:21:27.997667+0000","last_clean":"2024-09-14T11:21:27.997667+0000","last_became_active":"2024-09-14T10:45:53.746484+0000","last_became_peered":"2024-09-14T10:45:53.746484+0000","last_unstale":"2024-09-14T11:21:27.997667+0000","last_undegraded":"2024-09-14T11:21:27.997667+0000","last_fullsized":"2024-09-14T11:21:27.997667+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:31.055773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":202,"num_write":278,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"260'1196","reported_seq":2897,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:11.223775+0000","last_change":"2024-09-14T10:45:45.713700+0000","last_active":"2024-09-14T11:21:11.223775+0000","last_peered":"2024-09-14T11:21:11.223775+0000","last_clean":"2024-09-14T11:21:11.223775+0000","last_became_active":"2024-09-14T10:45:45.713440+0000","last_became_peered":"2024-09-14T10:45:45.713440+0000","last_unstale":"2024-09-14T11:21:11.223775+0000","last_undegraded":"2024-09-14T11:21:11.223775+0000","last_fullsized":"2024-09-14T11:21:11.223775+0000","mapping_epoch":26,"log_start":"260'1100","ondisk_log_start":"260'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":1100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:13.974610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5652,"num_read_kb":5051,"num_write":1624,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"260'365","reported_seq":1052,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.434970+0000","last_change":"2024-09-14T10:45:43.683066+0000","last_active":"2024-09-14T11:22:51.434970+0000","last_peered":"2024-09-14T11:22:51.434970+0000","last_clean":"2024-09-14T11:22:51.434970+0000","last_became_active":"2024-09-14T10:45:43.682711+0000","last_became_peered":"2024-09-14T10:45:43.682711+0000","last_unstale":"2024-09-14T11:22:51.434970+0000","last_undegraded":"2024-09-14T11:22:51.434970+0000","last_fullsized":"2024-09-14T11:22:51.434970+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:13:32.400241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":849,"num_read_kb":26785,"num_write":1182,"num_write_kb":27965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":502,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:56.232945+0000","last_change":"2024-09-14T10:45:36.078834+0000","last_active":"2024-09-14T11:18:56.232945+0000","last_peered":"2024-09-14T11:18:56.232945+0000","last_clean":"2024-09-14T11:18:56.232945+0000","last_became_active":"2024-09-14T10:45:33.612983+0000","last_became_peered":"2024-09-14T10:45:33.612983+0000","last_unstale":"2024-09-14T11:18:56.232945+0000","last_undegraded":"2024-09-14T11:18:56.232945+0000","last_fullsized":"2024-09-14T11:18:56.232945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_clean_scrub_stamp":"2024-09-14T10:45:32.551765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:00.753079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053773700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":486,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:11.113928+0000","last_change":"2024-09-14T10:45:47.724950+0000","last_active":"2024-09-14T11:19:11.113928+0000","last_peered":"2024-09-14T11:19:11.113928+0000","last_clean":"2024-09-14T11:19:11.113928+0000","last_became_active":"2024-09-14T10:45:47.724317+0000","last_became_peered":"2024-09-14T10:45:47.724317+0000","last_unstale":"2024-09-14T11:19:11.113928+0000","last_undegraded":"2024-09-14T11:19:11.113928+0000","last_fullsized":"2024-09-14T11:19:11.113928+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:13.067923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"260'548","reported_seq":1189,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.383696+0000","last_change":"2024-09-14T10:45:49.736006+0000","last_active":"2024-09-14T11:22:51.383696+0000","last_peered":"2024-09-14T11:22:51.383696+0000","last_clean":"2024-09-14T11:22:51.383696+0000","last_became_active":"2024-09-14T10:45:49.735662+0000","last_became_peered":"2024-09-14T10:45:49.735662+0000","last_unstale":"2024-09-14T11:22:51.383696+0000","last_undegraded":"2024-09-14T11:22:51.383696+0000","last_fullsized":"2024-09-14T11:22:51.383696+0000","mapping_epoch":30,"log_start":"260'500","ondisk_log_start":"260'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":500,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:34.690835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96714,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1561,"num_read_kb":2770,"num_write":2020,"num_write_kb":1869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":469,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:14.986059+0000","last_change":"2024-09-14T10:45:51.749756+0000","last_active":"2024-09-14T11:19:14.986059+0000","last_peered":"2024-09-14T11:19:14.986059+0000","last_clean":"2024-09-14T11:19:14.986059+0000","last_became_active":"2024-09-14T10:45:51.749478+0000","last_became_peered":"2024-09-14T10:45:51.749478+0000","last_unstale":"2024-09-14T11:19:14.986059+0000","last_undegraded":"2024-09-14T11:19:14.986059+0000","last_fullsized":"2024-09-14T11:19:14.986059+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:19.448821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"260'118","reported_seq":604,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:16.644526+0000","last_change":"2024-09-14T10:45:53.749875+0000","last_active":"2024-09-14T11:21:16.644526+0000","last_peered":"2024-09-14T11:21:16.644526+0000","last_clean":"2024-09-14T11:21:16.644526+0000","last_became_active":"2024-09-14T10:45:53.749578+0000","last_became_peered":"2024-09-14T10:45:53.749578+0000","last_unstale":"2024-09-14T11:21:16.644526+0000","last_undegraded":"2024-09-14T11:21:16.644526+0000","last_fullsized":"2024-09-14T11:21:16.644526+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:40.919662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":913,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":137,"num_read_kb":126,"num_write":281,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"260'861","reported_seq":2555,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.049805+0000","last_change":"2024-09-14T10:45:45.720048+0000","last_active":"2024-09-14T11:21:27.049805+0000","last_peered":"2024-09-14T11:21:27.049805+0000","last_clean":"2024-09-14T11:21:27.049805+0000","last_became_active":"2024-09-14T10:45:45.719783+0000","last_became_peered":"2024-09-14T10:45:45.719783+0000","last_unstale":"2024-09-14T11:21:27.049805+0000","last_undegraded":"2024-09-14T11:21:27.049805+0000","last_fullsized":"2024-09-14T11:21:27.049805+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":800,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:34.138598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4184,"num_read_kb":3795,"num_write":1124,"num_write_kb":397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"260'366","reported_seq":980,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.469921+0000","last_change":"2024-09-14T10:45:43.686039+0000","last_active":"2024-09-14T11:22:51.469921+0000","last_peered":"2024-09-14T11:22:51.469921+0000","last_clean":"2024-09-14T11:22:51.469921+0000","last_became_active":"2024-09-14T10:45:43.685775+0000","last_became_peered":"2024-09-14T10:45:43.685775+0000","last_unstale":"2024-09-14T11:22:51.469921+0000","last_undegraded":"2024-09-14T11:22:51.469921+0000","last_fullsized":"2024-09-14T11:22:51.469921+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:18:21.519433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":660,"num_read_kb":2173,"num_write":1090,"num_write_kb":20935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":503,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:02.107638+0000","last_change":"2024-09-14T10:45:35.580399+0000","last_active":"2024-09-14T11:19:02.107638+0000","last_peered":"2024-09-14T11:19:02.107638+0000","last_clean":"2024-09-14T11:19:02.107638+0000","last_became_active":"2024-09-14T10:45:33.564407+0000","last_became_peered":"2024-09-14T10:45:33.564407+0000","last_unstale":"2024-09-14T11:19:02.107638+0000","last_undegraded":"2024-09-14T11:19:02.107638+0000","last_fullsized":"2024-09-14T11:19:02.107638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_clean_scrub_stamp":"2024-09-14T10:45:32.551765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:15:28.496118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099134599999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:07.204309+0000","last_change":"2024-09-14T10:45:47.726265+0000","last_active":"2024-09-14T11:19:07.204309+0000","last_peered":"2024-09-14T11:19:07.204309+0000","last_clean":"2024-09-14T11:19:07.204309+0000","last_became_active":"2024-09-14T10:45:47.724774+0000","last_became_peered":"2024-09-14T10:45:47.724774+0000","last_unstale":"2024-09-14T11:19:07.204309+0000","last_undegraded":"2024-09-14T11:19:07.204309+0000","last_fullsized":"2024-09-14T11:19:07.204309+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:34.725344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"260'155","reported_seq":691,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:15.998699+0000","last_change":"2024-09-14T10:45:49.731679+0000","last_active":"2024-09-14T11:21:15.998699+0000","last_peered":"2024-09-14T11:21:15.998699+0000","last_clean":"2024-09-14T11:21:15.998699+0000","last_became_active":"2024-09-14T10:45:49.731380+0000","last_became_peered":"2024-09-14T10:45:49.731380+0000","last_unstale":"2024-09-14T11:21:15.998699+0000","last_undegraded":"2024-09-14T11:21:15.998699+0000","last_fullsized":"2024-09-14T11:21:15.998699+0000","mapping_epoch":30,"log_start":"257'100","ondisk_log_start":"257'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:45.555612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":200,"num_read_kb":190,"num_write":162,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"260'796","reported_seq":2740,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.299652+0000","last_change":"2024-09-14T10:45:51.747482+0000","last_active":"2024-09-14T11:22:50.299652+0000","last_peered":"2024-09-14T11:22:50.299652+0000","last_clean":"2024-09-14T11:22:50.299652+0000","last_became_active":"2024-09-14T10:45:51.746984+0000","last_became_peered":"2024-09-14T10:45:51.746984+0000","last_unstale":"2024-09-14T11:22:50.299652+0000","last_undegraded":"2024-09-14T11:22:50.299652+0000","last_fullsized":"2024-09-14T11:22:50.299652+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:45.422324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"260'119","reported_seq":610,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:06.014335+0000","last_change":"2024-09-14T10:45:53.750253+0000","last_active":"2024-09-14T11:22:06.014335+0000","last_peered":"2024-09-14T11:22:06.014335+0000","last_clean":"2024-09-14T11:22:06.014335+0000","last_became_active":"2024-09-14T10:45:53.749802+0000","last_became_peered":"2024-09-14T10:45:53.749802+0000","last_unstale":"2024-09-14T11:22:06.014335+0000","last_undegraded":"2024-09-14T11:22:06.014335+0000","last_fullsized":"2024-09-14T11:22:06.014335+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:31.303920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":146,"num_read_kb":135,"num_write":274,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"260'412","reported_seq":1897,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:14.959250+0000","last_change":"2024-09-14T10:45:45.710569+0000","last_active":"2024-09-14T11:21:14.959250+0000","last_peered":"2024-09-14T11:21:14.959250+0000","last_clean":"2024-09-14T11:21:14.959250+0000","last_became_active":"2024-09-14T10:45:45.710204+0000","last_became_peered":"2024-09-14T10:45:45.710204+0000","last_unstale":"2024-09-14T11:21:14.959250+0000","last_undegraded":"2024-09-14T11:21:14.959250+0000","last_fullsized":"2024-09-14T11:21:14.959250+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:02.264958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2141,"num_read_kb":2031,"num_write":456,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"260'373","reported_seq":1142,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.467913+0000","last_change":"2024-09-14T10:45:43.688652+0000","last_active":"2024-09-14T11:22:51.467913+0000","last_peered":"2024-09-14T11:22:51.467913+0000","last_clean":"2024-09-14T11:22:51.467913+0000","last_became_active":"2024-09-14T10:45:43.688114+0000","last_became_peered":"2024-09-14T10:45:43.688114+0000","last_unstale":"2024-09-14T11:22:51.467913+0000","last_undegraded":"2024-09-14T11:22:51.467913+0000","last_fullsized":"2024-09-14T11:22:51.467913+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:15.866413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":828,"num_read_kb":15214,"num_write":1175,"num_write_kb":42293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":509,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:16.122560+0000","last_change":"2024-09-14T10:45:35.575588+0000","last_active":"2024-09-14T11:20:16.122560+0000","last_peered":"2024-09-14T11:20:16.122560+0000","last_clean":"2024-09-14T11:20:16.122560+0000","last_became_active":"2024-09-14T10:45:33.610909+0000","last_became_peered":"2024-09-14T10:45:33.610909+0000","last_unstale":"2024-09-14T11:20:16.122560+0000","last_undegraded":"2024-09-14T11:20:16.122560+0000","last_fullsized":"2024-09-14T11:20:16.122560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_clean_scrub_stamp":"2024-09-14T10:45:32.551765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:45.821025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038435900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":480,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:07.108316+0000","last_change":"2024-09-14T10:45:47.728711+0000","last_active":"2024-09-14T11:19:07.108316+0000","last_peered":"2024-09-14T11:19:07.108316+0000","last_clean":"2024-09-14T11:19:07.108316+0000","last_became_active":"2024-09-14T10:45:47.728343+0000","last_became_peered":"2024-09-14T10:45:47.728343+0000","last_unstale":"2024-09-14T11:19:07.108316+0000","last_undegraded":"2024-09-14T11:19:07.108316+0000","last_fullsized":"2024-09-14T11:19:07.108316+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:17.637076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"260'92","reported_seq":605,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:56.315196+0000","last_change":"2024-09-14T10:45:49.736010+0000","last_active":"2024-09-14T11:20:56.315196+0000","last_peered":"2024-09-14T11:20:56.315196+0000","last_clean":"2024-09-14T11:20:56.315196+0000","last_became_active":"2024-09-14T10:45:49.735557+0000","last_became_peered":"2024-09-14T10:45:49.735557+0000","last_unstale":"2024-09-14T11:20:56.315196+0000","last_undegraded":"2024-09-14T11:20:56.315196+0000","last_fullsized":"2024-09-14T11:20:56.315196+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:10:56.092992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"260'805","reported_seq":2212,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.304025+0000","last_change":"2024-09-14T10:45:51.747138+0000","last_active":"2024-09-14T11:22:50.304025+0000","last_peered":"2024-09-14T11:22:50.304025+0000","last_clean":"2024-09-14T11:22:50.304025+0000","last_became_active":"2024-09-14T10:45:51.746874+0000","last_became_peered":"2024-09-14T10:45:51.746874+0000","last_unstale":"2024-09-14T11:22:50.304025+0000","last_undegraded":"2024-09-14T11:22:50.304025+0000","last_fullsized":"2024-09-14T11:22:50.304025+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:47.844695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"260'171","reported_seq":654,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:06.378984+0000","last_change":"2024-09-14T10:45:53.749142+0000","last_active":"2024-09-14T11:21:06.378984+0000","last_peered":"2024-09-14T11:21:06.378984+0000","last_clean":"2024-09-14T11:21:06.378984+0000","last_became_active":"2024-09-14T10:45:53.748880+0000","last_became_peered":"2024-09-14T10:45:53.748880+0000","last_unstale":"2024-09-14T11:21:06.378984+0000","last_undegraded":"2024-09-14T11:21:06.378984+0000","last_fullsized":"2024-09-14T11:21:06.378984+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:00:48.684200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":483,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":133,"num_read_kb":125,"num_write":394,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"260'405","reported_seq":1915,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.834581+0000","last_change":"2024-09-14T10:45:45.713570+0000","last_active":"2024-09-14T11:22:42.834581+0000","last_peered":"2024-09-14T11:22:42.834581+0000","last_clean":"2024-09-14T11:22:42.834581+0000","last_became_active":"2024-09-14T10:45:45.713313+0000","last_became_peered":"2024-09-14T10:45:45.713313+0000","last_unstale":"2024-09-14T11:22:42.834581+0000","last_undegraded":"2024-09-14T11:22:42.834581+0000","last_fullsized":"2024-09-14T11:22:42.834581+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:00.604945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2392,"num_read_kb":2258,"num_write":470,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"260'365","reported_seq":1105,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.465226+0000","last_change":"2024-09-14T10:45:43.691413+0000","last_active":"2024-09-14T11:22:51.465226+0000","last_peered":"2024-09-14T11:22:51.465226+0000","last_clean":"2024-09-14T11:22:51.465226+0000","last_became_active":"2024-09-14T10:45:43.689593+0000","last_became_peered":"2024-09-14T10:45:43.689593+0000","last_unstale":"2024-09-14T11:22:51.465226+0000","last_undegraded":"2024-09-14T11:22:51.465226+0000","last_fullsized":"2024-09-14T11:22:51.465226+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:27.067114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267348,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1017,"num_read_kb":46619,"num_write":1250,"num_write_kb":43963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":503,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:17.118867+0000","last_change":"2024-09-14T10:45:35.580545+0000","last_active":"2024-09-14T11:20:17.118867+0000","last_peered":"2024-09-14T11:20:17.118867+0000","last_clean":"2024-09-14T11:20:17.118867+0000","last_became_active":"2024-09-14T10:45:33.610689+0000","last_became_peered":"2024-09-14T10:45:33.610689+0000","last_unstale":"2024-09-14T11:20:17.118867+0000","last_undegraded":"2024-09-14T11:20:17.118867+0000","last_fullsized":"2024-09-14T11:20:17.118867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:32.551765+0000","last_clean_scrub_stamp":"2024-09-14T10:45:32.551765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:59.821398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011461920000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:56.120373+0000","last_change":"2024-09-14T10:45:47.728608+0000","last_active":"2024-09-14T11:19:56.120373+0000","last_peered":"2024-09-14T11:19:56.120373+0000","last_clean":"2024-09-14T11:19:56.120373+0000","last_became_active":"2024-09-14T10:45:47.728312+0000","last_became_peered":"2024-09-14T10:45:47.728312+0000","last_unstale":"2024-09-14T11:19:56.120373+0000","last_undegraded":"2024-09-14T11:19:56.120373+0000","last_fullsized":"2024-09-14T11:19:56.120373+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:22.707433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"260'719","reported_seq":1421,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.486323+0000","last_change":"2024-09-14T10:45:49.734149+0000","last_active":"2024-09-14T11:22:51.486323+0000","last_peered":"2024-09-14T11:22:51.486323+0000","last_clean":"2024-09-14T11:22:51.486323+0000","last_became_active":"2024-09-14T10:45:49.733812+0000","last_became_peered":"2024-09-14T10:45:49.733812+0000","last_unstale":"2024-09-14T11:22:51.486323+0000","last_undegraded":"2024-09-14T11:22:51.486323+0000","last_fullsized":"2024-09-14T11:22:51.486323+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":700,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:05.193302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137505,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1282,"num_read_kb":3061,"num_write":1046,"num_write_kb":877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:11.113894+0000","last_change":"2024-09-14T10:45:51.746053+0000","last_active":"2024-09-14T11:19:11.113894+0000","last_peered":"2024-09-14T11:19:11.113894+0000","last_clean":"2024-09-14T11:19:11.113894+0000","last_became_active":"2024-09-14T10:45:51.745137+0000","last_became_peered":"2024-09-14T10:45:51.745137+0000","last_unstale":"2024-09-14T11:19:11.113894+0000","last_undegraded":"2024-09-14T11:19:11.113894+0000","last_fullsized":"2024-09-14T11:19:11.113894+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:34.202906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"260'130","reported_seq":622,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.045272+0000","last_change":"2024-09-14T10:45:53.751882+0000","last_active":"2024-09-14T11:21:27.045272+0000","last_peered":"2024-09-14T11:21:27.045272+0000","last_clean":"2024-09-14T11:21:27.045272+0000","last_became_active":"2024-09-14T10:45:53.751511+0000","last_became_peered":"2024-09-14T10:45:53.751511+0000","last_unstale":"2024-09-14T11:21:27.045272+0000","last_undegraded":"2024-09-14T11:21:27.045272+0000","last_fullsized":"2024-09-14T11:21:27.045272+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:34.995970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":202,"num_read_kb":180,"num_write":339,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"260'195","reported_seq":792,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.396620+0000","last_change":"2024-09-14T10:45:53.747335+0000","last_active":"2024-09-14T11:21:28.396620+0000","last_peered":"2024-09-14T11:21:28.396620+0000","last_clean":"2024-09-14T11:21:28.396620+0000","last_became_active":"2024-09-14T10:45:53.747090+0000","last_became_peered":"2024-09-14T10:45:53.747090+0000","last_unstale":"2024-09-14T11:21:28.396620+0000","last_undegraded":"2024-09-14T11:21:28.396620+0000","last_fullsized":"2024-09-14T11:21:28.396620+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:02.580660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":464,"num_read_kb":408,"num_write":469,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"260'462","reported_seq":1939,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:09.637868+0000","last_change":"2024-09-14T10:45:45.719507+0000","last_active":"2024-09-14T11:21:09.637868+0000","last_peered":"2024-09-14T11:21:09.637868+0000","last_clean":"2024-09-14T11:21:09.637868+0000","last_became_active":"2024-09-14T10:45:45.719181+0000","last_became_peered":"2024-09-14T10:45:45.719181+0000","last_unstale":"2024-09-14T11:21:09.637868+0000","last_undegraded":"2024-09-14T11:21:09.637868+0000","last_fullsized":"2024-09-14T11:21:09.637868+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:25:12.612090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2298,"num_read_kb":2151,"num_write":532,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"260'400","reported_seq":1058,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.447272+0000","last_change":"2024-09-14T10:45:43.673724+0000","last_active":"2024-09-14T11:22:51.447272+0000","last_peered":"2024-09-14T11:22:51.447272+0000","last_clean":"2024-09-14T11:22:51.447272+0000","last_became_active":"2024-09-14T10:45:43.673475+0000","last_became_peered":"2024-09-14T10:45:43.673475+0000","last_unstale":"2024-09-14T11:22:51.447272+0000","last_undegraded":"2024-09-14T11:22:51.447272+0000","last_fullsized":"2024-09-14T11:22:51.447272+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:22.605440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":761,"num_read_kb":57050,"num_write":1291,"num_write_kb":43494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:30.977699+0000","last_change":"2024-09-14T10:45:47.727115+0000","last_active":"2024-09-14T11:18:30.977699+0000","last_peered":"2024-09-14T11:18:30.977699+0000","last_clean":"2024-09-14T11:18:30.977699+0000","last_became_active":"2024-09-14T10:45:47.726819+0000","last_became_peered":"2024-09-14T10:45:47.726819+0000","last_unstale":"2024-09-14T11:18:30.977699+0000","last_undegraded":"2024-09-14T11:18:30.977699+0000","last_fullsized":"2024-09-14T11:18:30.977699+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:49.723414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"260'271","reported_seq":822,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.561739+0000","last_change":"2024-09-14T10:45:49.733250+0000","last_active":"2024-09-14T11:22:50.561739+0000","last_peered":"2024-09-14T11:22:50.561739+0000","last_clean":"2024-09-14T11:22:50.561739+0000","last_became_active":"2024-09-14T10:45:49.732755+0000","last_became_peered":"2024-09-14T10:45:49.732755+0000","last_unstale":"2024-09-14T11:22:50.561739+0000","last_undegraded":"2024-09-14T11:22:50.561739+0000","last_fullsized":"2024-09-14T11:22:50.561739+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:54:03.582189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48124,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":453,"num_read_kb":1077,"num_write":370,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":472,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:30.983925+0000","last_change":"2024-09-14T10:45:51.747909+0000","last_active":"2024-09-14T11:18:30.983925+0000","last_peered":"2024-09-14T11:18:30.983925+0000","last_clean":"2024-09-14T11:18:30.983925+0000","last_became_active":"2024-09-14T10:45:51.747624+0000","last_became_peered":"2024-09-14T10:45:51.747624+0000","last_unstale":"2024-09-14T11:18:30.983925+0000","last_undegraded":"2024-09-14T11:18:30.983925+0000","last_fullsized":"2024-09-14T11:18:30.983925+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:20.368951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"260'138","reported_seq":626,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:14.388075+0000","last_change":"2024-09-14T10:45:53.751186+0000","last_active":"2024-09-14T11:21:14.388075+0000","last_peered":"2024-09-14T11:21:14.388075+0000","last_clean":"2024-09-14T11:21:14.388075+0000","last_became_active":"2024-09-14T10:45:53.750866+0000","last_became_peered":"2024-09-14T10:45:53.750866+0000","last_unstale":"2024-09-14T11:21:14.388075+0000","last_undegraded":"2024-09-14T11:21:14.388075+0000","last_fullsized":"2024-09-14T11:21:14.388075+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:54.350231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":161,"num_read_kb":145,"num_write":328,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"260'713","reported_seq":2438,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.336687+0000","last_change":"2024-09-14T10:45:45.720031+0000","last_active":"2024-09-14T11:21:28.336687+0000","last_peered":"2024-09-14T11:21:28.336687+0000","last_clean":"2024-09-14T11:21:28.336687+0000","last_became_active":"2024-09-14T10:45:45.719731+0000","last_became_peered":"2024-09-14T10:45:45.719731+0000","last_unstale":"2024-09-14T11:21:28.336687+0000","last_undegraded":"2024-09-14T11:21:28.336687+0000","last_fullsized":"2024-09-14T11:21:28.336687+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":700,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:55.272218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3605,"num_read_kb":3249,"num_write":949,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"260'335","reported_seq":951,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:55.643327+0000","last_change":"2024-09-14T11:22:55.643327+0000","last_active":"2024-09-14T11:22:55.643327+0000","last_peered":"2024-09-14T11:22:55.643327+0000","last_clean":"2024-09-14T11:22:55.643327+0000","last_became_active":"2024-09-14T10:45:43.682925+0000","last_became_peered":"2024-09-14T10:45:43.682925+0000","last_unstale":"2024-09-14T11:22:55.643327+0000","last_undegraded":"2024-09-14T11:22:55.643327+0000","last_fullsized":"2024-09-14T11:22:55.643327+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'335","last_scrub_stamp":"2024-09-14T11:22:55.643226+0000","last_deep_scrub":"260'335","last_deep_scrub_stamp":"2024-09-14T11:22:55.643226+0000","last_clean_scrub_stamp":"2024-09-14T11:22:55.643226+0000","objects_scrubbed":3,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:47:02.635100+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":623,"num_read_kb":1213,"num_write":1012,"num_write_kb":13029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:31.108226+0000","last_change":"2024-09-14T10:45:47.724937+0000","last_active":"2024-09-14T11:18:31.108226+0000","last_peered":"2024-09-14T11:18:31.108226+0000","last_clean":"2024-09-14T11:18:31.108226+0000","last_became_active":"2024-09-14T10:45:47.724432+0000","last_became_peered":"2024-09-14T10:45:47.724432+0000","last_unstale":"2024-09-14T11:18:31.108226+0000","last_undegraded":"2024-09-14T11:18:31.108226+0000","last_fullsized":"2024-09-14T11:18:31.108226+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:26.499973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"260'45","reported_seq":533,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:51.127494+0000","last_change":"2024-09-14T10:45:49.735467+0000","last_active":"2024-09-14T11:20:51.127494+0000","last_peered":"2024-09-14T11:20:51.127494+0000","last_clean":"2024-09-14T11:20:51.127494+0000","last_became_active":"2024-09-14T10:45:49.735053+0000","last_became_peered":"2024-09-14T10:45:49.735053+0000","last_unstale":"2024-09-14T11:20:51.127494+0000","last_undegraded":"2024-09-14T11:20:51.127494+0000","last_fullsized":"2024-09-14T11:20:51.127494+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:14.336006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":24,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":467,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:34.979850+0000","last_change":"2024-09-14T10:45:51.748011+0000","last_active":"2024-09-14T11:18:34.979850+0000","last_peered":"2024-09-14T11:18:34.979850+0000","last_clean":"2024-09-14T11:18:34.979850+0000","last_became_active":"2024-09-14T10:45:51.747600+0000","last_became_peered":"2024-09-14T10:45:51.747600+0000","last_unstale":"2024-09-14T11:18:34.979850+0000","last_undegraded":"2024-09-14T11:18:34.979850+0000","last_fullsized":"2024-09-14T11:18:34.979850+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:20.639986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"260'223","reported_seq":744,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.339917+0000","last_change":"2024-09-14T10:45:53.751787+0000","last_active":"2024-09-14T11:21:28.339917+0000","last_peered":"2024-09-14T11:21:28.339917+0000","last_clean":"2024-09-14T11:21:28.339917+0000","last_became_active":"2024-09-14T10:45:53.751504+0000","last_became_peered":"2024-09-14T10:45:53.751504+0000","last_unstale":"2024-09-14T11:21:28.339917+0000","last_undegraded":"2024-09-14T11:21:28.339917+0000","last_fullsized":"2024-09-14T11:21:28.339917+0000","mapping_epoch":34,"log_start":"260'200","ondisk_log_start":"260'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:27.845346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":402,"num_read_kb":374,"num_write":536,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"260'726","reported_seq":2170,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:14.386625+0000","last_change":"2024-09-14T10:45:45.714585+0000","last_active":"2024-09-14T11:21:14.386625+0000","last_peered":"2024-09-14T11:21:14.386625+0000","last_clean":"2024-09-14T11:21:14.386625+0000","last_became_active":"2024-09-14T10:45:45.714326+0000","last_became_peered":"2024-09-14T10:45:45.714326+0000","last_unstale":"2024-09-14T11:21:14.386625+0000","last_undegraded":"2024-09-14T11:21:14.386625+0000","last_fullsized":"2024-09-14T11:21:14.386625+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":700,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:55.220424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3492,"num_read_kb":3158,"num_write":966,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"260'390","reported_seq":1038,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.456901+0000","last_change":"2024-09-14T10:45:43.672043+0000","last_active":"2024-09-14T11:22:51.456901+0000","last_peered":"2024-09-14T11:22:51.456901+0000","last_clean":"2024-09-14T11:22:51.456901+0000","last_became_active":"2024-09-14T10:45:43.671747+0000","last_became_peered":"2024-09-14T10:45:43.671747+0000","last_unstale":"2024-09-14T11:22:51.456901+0000","last_undegraded":"2024-09-14T11:22:51.456901+0000","last_fullsized":"2024-09-14T11:22:51.456901+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:17.021045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":703,"num_read_kb":3196,"num_write":1248,"num_write_kb":29609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":475,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:29.979126+0000","last_change":"2024-09-14T10:45:47.731898+0000","last_active":"2024-09-14T11:18:29.979126+0000","last_peered":"2024-09-14T11:18:29.979126+0000","last_clean":"2024-09-14T11:18:29.979126+0000","last_became_active":"2024-09-14T10:45:47.731640+0000","last_became_peered":"2024-09-14T10:45:47.731640+0000","last_unstale":"2024-09-14T11:18:29.979126+0000","last_undegraded":"2024-09-14T11:18:29.979126+0000","last_fullsized":"2024-09-14T11:18:29.979126+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:50:32.387766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"260'321","reported_seq":890,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.310762+0000","last_change":"2024-09-14T10:45:49.727713+0000","last_active":"2024-09-14T11:22:51.310762+0000","last_peered":"2024-09-14T11:22:51.310762+0000","last_clean":"2024-09-14T11:22:51.310762+0000","last_became_active":"2024-09-14T10:45:49.727431+0000","last_became_peered":"2024-09-14T10:45:49.727431+0000","last_unstale":"2024-09-14T11:22:51.310762+0000","last_undegraded":"2024-09-14T11:22:51.310762+0000","last_fullsized":"2024-09-14T11:22:51.310762+0000","mapping_epoch":30,"log_start":"260'300","ondisk_log_start":"260'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:44.165025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46674,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":519,"num_read_kb":1163,"num_write":422,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":476,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:32.102760+0000","last_change":"2024-09-14T10:45:51.747148+0000","last_active":"2024-09-14T11:18:32.102760+0000","last_peered":"2024-09-14T11:18:32.102760+0000","last_clean":"2024-09-14T11:18:32.102760+0000","last_became_active":"2024-09-14T10:45:51.746506+0000","last_became_peered":"2024-09-14T10:45:51.746506+0000","last_unstale":"2024-09-14T11:18:32.102760+0000","last_undegraded":"2024-09-14T11:18:32.102760+0000","last_fullsized":"2024-09-14T11:18:32.102760+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:58.299100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"260'144","reported_seq":636,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:12.863430+0000","last_change":"2024-09-14T10:45:53.755475+0000","last_active":"2024-09-14T11:21:12.863430+0000","last_peered":"2024-09-14T11:21:12.863430+0000","last_clean":"2024-09-14T11:21:12.863430+0000","last_became_active":"2024-09-14T10:45:53.755018+0000","last_became_peered":"2024-09-14T10:45:53.755018+0000","last_unstale":"2024-09-14T11:21:12.863430+0000","last_undegraded":"2024-09-14T11:21:12.863430+0000","last_fullsized":"2024-09-14T11:21:12.863430+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:18.887717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":167,"num_write":339,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"260'400","reported_seq":1926,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:13.964839+0000","last_change":"2024-09-14T10:45:45.713424+0000","last_active":"2024-09-14T11:21:13.964839+0000","last_peered":"2024-09-14T11:21:13.964839+0000","last_clean":"2024-09-14T11:21:13.964839+0000","last_became_active":"2024-09-14T10:45:45.713138+0000","last_became_peered":"2024-09-14T10:45:45.713138+0000","last_unstale":"2024-09-14T11:21:13.964839+0000","last_undegraded":"2024-09-14T11:21:13.964839+0000","last_fullsized":"2024-09-14T11:21:13.964839+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:33.204288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2187,"num_read_kb":2089,"num_write":453,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"260'375","reported_seq":985,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.468120+0000","last_change":"2024-09-14T10:45:43.680940+0000","last_active":"2024-09-14T11:22:51.468120+0000","last_peered":"2024-09-14T11:22:51.468120+0000","last_clean":"2024-09-14T11:22:51.468120+0000","last_became_active":"2024-09-14T10:45:43.680629+0000","last_became_peered":"2024-09-14T10:45:43.680629+0000","last_unstale":"2024-09-14T11:22:51.468120+0000","last_undegraded":"2024-09-14T11:22:51.468120+0000","last_fullsized":"2024-09-14T11:22:51.468120+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:50:55.277788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133684,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":617,"num_read_kb":9938,"num_write":1232,"num_write_kb":44861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:27.102413+0000","last_change":"2024-09-14T10:45:47.728061+0000","last_active":"2024-09-14T11:18:27.102413+0000","last_peered":"2024-09-14T11:18:27.102413+0000","last_clean":"2024-09-14T11:18:27.102413+0000","last_became_active":"2024-09-14T10:45:47.727777+0000","last_became_peered":"2024-09-14T10:45:47.727777+0000","last_unstale":"2024-09-14T11:18:27.102413+0000","last_undegraded":"2024-09-14T11:18:27.102413+0000","last_fullsized":"2024-09-14T11:18:27.102413+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:11.350366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"260'271","reported_seq":825,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.202893+0000","last_change":"2024-09-14T10:45:49.727639+0000","last_active":"2024-09-14T11:22:51.202893+0000","last_peered":"2024-09-14T11:22:51.202893+0000","last_clean":"2024-09-14T11:22:51.202893+0000","last_became_active":"2024-09-14T10:45:49.727347+0000","last_became_peered":"2024-09-14T10:45:49.727347+0000","last_unstale":"2024-09-14T11:22:51.202893+0000","last_undegraded":"2024-09-14T11:22:51.202893+0000","last_fullsized":"2024-09-14T11:22:51.202893+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:01.870905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44334,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":417,"num_read_kb":936,"num_write":344,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":472,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:30.983987+0000","last_change":"2024-09-14T10:45:51.746782+0000","last_active":"2024-09-14T11:18:30.983987+0000","last_peered":"2024-09-14T11:18:30.983987+0000","last_clean":"2024-09-14T11:18:30.983987+0000","last_became_active":"2024-09-14T10:45:51.746493+0000","last_became_peered":"2024-09-14T10:45:51.746493+0000","last_unstale":"2024-09-14T11:18:30.983987+0000","last_undegraded":"2024-09-14T11:18:30.983987+0000","last_fullsized":"2024-09-14T11:18:30.983987+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:58.142627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"260'405","reported_seq":1975,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:14.951090+0000","last_change":"2024-09-14T10:45:45.725798+0000","last_active":"2024-09-14T11:21:14.951090+0000","last_peered":"2024-09-14T11:21:14.951090+0000","last_clean":"2024-09-14T11:21:14.951090+0000","last_became_active":"2024-09-14T10:45:45.725430+0000","last_became_peered":"2024-09-14T10:45:45.725430+0000","last_unstale":"2024-09-14T11:21:14.951090+0000","last_undegraded":"2024-09-14T11:21:14.951090+0000","last_fullsized":"2024-09-14T11:21:14.951090+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:33:31.325345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2252,"num_read_kb":2164,"num_write":454,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"260'318","reported_seq":934,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.444938+0000","last_change":"2024-09-14T10:45:43.684555+0000","last_active":"2024-09-14T11:22:51.444938+0000","last_peered":"2024-09-14T11:22:51.444938+0000","last_clean":"2024-09-14T11:22:51.444938+0000","last_became_active":"2024-09-14T10:45:43.683988+0000","last_became_peered":"2024-09-14T10:45:43.683988+0000","last_unstale":"2024-09-14T11:22:51.444938+0000","last_undegraded":"2024-09-14T11:22:51.444938+0000","last_fullsized":"2024-09-14T11:22:51.444938+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:58:49.723371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":562,"num_read_kb":32573,"num_write":1061,"num_write_kb":14583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":481,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:00.990077+0000","last_change":"2024-09-14T10:45:47.728686+0000","last_active":"2024-09-14T11:20:00.990077+0000","last_peered":"2024-09-14T11:20:00.990077+0000","last_clean":"2024-09-14T11:20:00.990077+0000","last_became_active":"2024-09-14T10:45:47.728323+0000","last_became_peered":"2024-09-14T10:45:47.728323+0000","last_unstale":"2024-09-14T11:20:00.990077+0000","last_undegraded":"2024-09-14T11:20:00.990077+0000","last_fullsized":"2024-09-14T11:20:00.990077+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:13:35.492090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"260'490","reported_seq":1097,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.172306+0000","last_change":"2024-09-14T10:45:49.729101+0000","last_active":"2024-09-14T11:22:51.172306+0000","last_peered":"2024-09-14T11:22:51.172306+0000","last_clean":"2024-09-14T11:22:51.172306+0000","last_became_active":"2024-09-14T10:45:49.728841+0000","last_became_peered":"2024-09-14T10:45:49.728841+0000","last_unstale":"2024-09-14T11:22:51.172306+0000","last_undegraded":"2024-09-14T11:22:51.172306+0000","last_fullsized":"2024-09-14T11:22:51.172306+0000","mapping_epoch":30,"log_start":"260'400","ondisk_log_start":"260'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:11.378740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98061,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":894,"num_read_kb":2175,"num_write":778,"num_write_kb":715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":466,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:24.978449+0000","last_change":"2024-09-14T10:45:51.752010+0000","last_active":"2024-09-14T11:18:24.978449+0000","last_peered":"2024-09-14T11:18:24.978449+0000","last_clean":"2024-09-14T11:18:24.978449+0000","last_became_active":"2024-09-14T10:45:51.751776+0000","last_became_peered":"2024-09-14T10:45:51.751776+0000","last_unstale":"2024-09-14T11:18:24.978449+0000","last_undegraded":"2024-09-14T11:18:24.978449+0000","last_fullsized":"2024-09-14T11:18:24.978449+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:41:21.445606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"260'170","reported_seq":665,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.618448+0000","last_change":"2024-09-14T10:45:53.753181+0000","last_active":"2024-09-14T11:21:28.618448+0000","last_peered":"2024-09-14T11:21:28.618448+0000","last_clean":"2024-09-14T11:21:28.618448+0000","last_became_active":"2024-09-14T10:45:53.752535+0000","last_became_peered":"2024-09-14T10:45:53.752535+0000","last_unstale":"2024-09-14T11:21:28.618448+0000","last_undegraded":"2024-09-14T11:21:28.618448+0000","last_fullsized":"2024-09-14T11:21:28.618448+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:22.683886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":217,"num_read_kb":213,"num_write":386,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"260'440","reported_seq":2084,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.742063+0000","last_change":"2024-09-14T10:45:45.712598+0000","last_active":"2024-09-14T11:21:28.742063+0000","last_peered":"2024-09-14T11:21:28.742063+0000","last_clean":"2024-09-14T11:21:28.742063+0000","last_became_active":"2024-09-14T10:45:45.710498+0000","last_became_peered":"2024-09-14T10:45:45.710498+0000","last_unstale":"2024-09-14T11:21:28.742063+0000","last_undegraded":"2024-09-14T11:21:28.742063+0000","last_fullsized":"2024-09-14T11:21:28.742063+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:47:29.987154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2391,"num_read_kb":2291,"num_write":487,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"260'411","reported_seq":1165,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.469957+0000","last_change":"2024-09-14T10:45:43.688502+0000","last_active":"2024-09-14T11:22:51.469957+0000","last_peered":"2024-09-14T11:22:51.469957+0000","last_clean":"2024-09-14T11:22:51.469957+0000","last_became_active":"2024-09-14T10:45:43.688136+0000","last_became_peered":"2024-09-14T10:45:43.688136+0000","last_unstale":"2024-09-14T11:22:51.469957+0000","last_undegraded":"2024-09-14T11:22:51.469957+0000","last_fullsized":"2024-09-14T11:22:51.469957+0000","mapping_epoch":23,"log_start":"260'400","ondisk_log_start":"260'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:56:33.762201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1055,"num_read_kb":62488,"num_write":1345,"num_write_kb":26359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":477,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:09.985337+0000","last_change":"2024-09-14T10:45:47.726708+0000","last_active":"2024-09-14T11:19:09.985337+0000","last_peered":"2024-09-14T11:19:09.985337+0000","last_clean":"2024-09-14T11:19:09.985337+0000","last_became_active":"2024-09-14T10:45:47.725711+0000","last_became_peered":"2024-09-14T10:45:47.725711+0000","last_unstale":"2024-09-14T11:19:09.985337+0000","last_undegraded":"2024-09-14T11:19:09.985337+0000","last_fullsized":"2024-09-14T11:19:09.985337+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:23.138591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"260'282","reported_seq":840,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.233477+0000","last_change":"2024-09-14T10:45:49.730097+0000","last_active":"2024-09-14T11:22:51.233477+0000","last_peered":"2024-09-14T11:22:51.233477+0000","last_clean":"2024-09-14T11:22:51.233477+0000","last_became_active":"2024-09-14T10:45:49.729803+0000","last_became_peered":"2024-09-14T10:45:49.729803+0000","last_unstale":"2024-09-14T11:22:51.233477+0000","last_undegraded":"2024-09-14T11:22:51.233477+0000","last_fullsized":"2024-09-14T11:22:51.233477+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:44.767050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50521,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":465,"num_read_kb":1032,"num_write":388,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":468,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:21.228045+0000","last_change":"2024-09-14T10:45:51.749137+0000","last_active":"2024-09-14T11:18:21.228045+0000","last_peered":"2024-09-14T11:18:21.228045+0000","last_clean":"2024-09-14T11:18:21.228045+0000","last_became_active":"2024-09-14T10:45:51.748871+0000","last_became_peered":"2024-09-14T10:45:51.748871+0000","last_unstale":"2024-09-14T11:18:21.228045+0000","last_undegraded":"2024-09-14T11:18:21.228045+0000","last_fullsized":"2024-09-14T11:18:21.228045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:41.260779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"260'208","reported_seq":1061,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.145844+0000","last_change":"2024-09-14T10:45:53.750953+0000","last_active":"2024-09-14T11:21:27.145844+0000","last_peered":"2024-09-14T11:21:27.145844+0000","last_clean":"2024-09-14T11:21:27.145844+0000","last_became_active":"2024-09-14T10:45:53.750595+0000","last_became_peered":"2024-09-14T10:45:53.750595+0000","last_unstale":"2024-09-14T11:21:27.145844+0000","last_undegraded":"2024-09-14T11:21:27.145844+0000","last_fullsized":"2024-09-14T11:21:27.145844+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:54.639620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1617,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":634,"num_read_kb":624,"num_write":573,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"260'1182","reported_seq":2743,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.327539+0000","last_change":"2024-09-14T10:45:45.722205+0000","last_active":"2024-09-14T11:21:28.327539+0000","last_peered":"2024-09-14T11:21:28.327539+0000","last_clean":"2024-09-14T11:21:28.327539+0000","last_became_active":"2024-09-14T10:45:45.721945+0000","last_became_peered":"2024-09-14T10:45:45.721945+0000","last_unstale":"2024-09-14T11:21:28.327539+0000","last_undegraded":"2024-09-14T11:21:28.327539+0000","last_fullsized":"2024-09-14T11:21:28.327539+0000","mapping_epoch":26,"log_start":"260'1100","ondisk_log_start":"260'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":1100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:32.193876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5490,"num_read_kb":4869,"num_write":1672,"num_write_kb":727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"260'334","reported_seq":968,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.467856+0000","last_change":"2024-09-14T10:45:43.682713+0000","last_active":"2024-09-14T11:22:51.467856+0000","last_peered":"2024-09-14T11:22:51.467856+0000","last_clean":"2024-09-14T11:22:51.467856+0000","last_became_active":"2024-09-14T10:45:43.682457+0000","last_became_peered":"2024-09-14T10:45:43.682457+0000","last_unstale":"2024-09-14T11:22:51.467856+0000","last_undegraded":"2024-09-14T11:22:51.467856+0000","last_fullsized":"2024-09-14T11:22:51.467856+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:25.191206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":582,"num_read_kb":98004,"num_write":1175,"num_write_kb":36067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":474,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:19.977588+0000","last_change":"2024-09-14T10:45:47.726953+0000","last_active":"2024-09-14T11:18:19.977588+0000","last_peered":"2024-09-14T11:18:19.977588+0000","last_clean":"2024-09-14T11:18:19.977588+0000","last_became_active":"2024-09-14T10:45:47.726635+0000","last_became_peered":"2024-09-14T10:45:47.726635+0000","last_unstale":"2024-09-14T11:18:19.977588+0000","last_undegraded":"2024-09-14T11:18:19.977588+0000","last_fullsized":"2024-09-14T11:18:19.977588+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:12.596595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"260'274","reported_seq":827,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.701917+0000","last_change":"2024-09-14T10:45:49.729734+0000","last_active":"2024-09-14T11:22:50.701917+0000","last_peered":"2024-09-14T11:22:50.701917+0000","last_clean":"2024-09-14T11:22:50.701917+0000","last_became_active":"2024-09-14T10:45:49.729422+0000","last_became_peered":"2024-09-14T10:45:49.729422+0000","last_unstale":"2024-09-14T11:22:50.701917+0000","last_undegraded":"2024-09-14T11:22:50.701917+0000","last_fullsized":"2024-09-14T11:22:50.701917+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:36.625007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45487,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":456,"num_read_kb":1073,"num_write":374,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":475,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:00.997411+0000","last_change":"2024-09-14T10:45:51.748413+0000","last_active":"2024-09-14T11:20:00.997411+0000","last_peered":"2024-09-14T11:20:00.997411+0000","last_clean":"2024-09-14T11:20:00.997411+0000","last_became_active":"2024-09-14T10:45:51.747888+0000","last_became_peered":"2024-09-14T10:45:51.747888+0000","last_unstale":"2024-09-14T11:20:00.997411+0000","last_undegraded":"2024-09-14T11:20:00.997411+0000","last_fullsized":"2024-09-14T11:20:00.997411+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:31:10.652817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"260'126","reported_seq":597,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:43.728256+0000","last_change":"2024-09-14T10:45:53.750141+0000","last_active":"2024-09-14T11:22:43.728256+0000","last_peered":"2024-09-14T11:22:43.728256+0000","last_clean":"2024-09-14T11:22:43.728256+0000","last_became_active":"2024-09-14T10:45:53.749868+0000","last_became_peered":"2024-09-14T10:45:53.749868+0000","last_unstale":"2024-09-14T11:22:43.728256+0000","last_undegraded":"2024-09-14T11:22:43.728256+0000","last_fullsized":"2024-09-14T11:22:43.728256+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:03.049227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":111,"num_write":304,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"260'1124","reported_seq":2685,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:13.095273+0000","last_change":"2024-09-14T10:45:45.711778+0000","last_active":"2024-09-14T11:21:13.095273+0000","last_peered":"2024-09-14T11:21:13.095273+0000","last_clean":"2024-09-14T11:21:13.095273+0000","last_became_active":"2024-09-14T10:45:45.711476+0000","last_became_peered":"2024-09-14T10:45:45.711476+0000","last_unstale":"2024-09-14T11:21:13.095273+0000","last_undegraded":"2024-09-14T11:21:13.095273+0000","last_fullsized":"2024-09-14T11:21:13.095273+0000","mapping_epoch":26,"log_start":"260'1100","ondisk_log_start":"260'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":1100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:10.238217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5159,"num_read_kb":4588,"num_write":1521,"num_write_kb":611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"260'326","reported_seq":1001,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.432096+0000","last_change":"2024-09-14T10:45:43.692253+0000","last_active":"2024-09-14T11:22:51.432096+0000","last_peered":"2024-09-14T11:22:51.432096+0000","last_clean":"2024-09-14T11:22:51.432096+0000","last_became_active":"2024-09-14T10:45:43.691976+0000","last_became_peered":"2024-09-14T10:45:43.691976+0000","last_unstale":"2024-09-14T11:22:51.432096+0000","last_undegraded":"2024-09-14T11:22:51.432096+0000","last_fullsized":"2024-09-14T11:22:51.432096+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:28.335886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":740,"num_read_kb":9027,"num_write":1110,"num_write_kb":58772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":483,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:21.106659+0000","last_change":"2024-09-14T10:45:47.726662+0000","last_active":"2024-09-14T11:18:21.106659+0000","last_peered":"2024-09-14T11:18:21.106659+0000","last_clean":"2024-09-14T11:18:21.106659+0000","last_became_active":"2024-09-14T10:45:47.726392+0000","last_became_peered":"2024-09-14T10:45:47.726392+0000","last_unstale":"2024-09-14T11:18:21.106659+0000","last_undegraded":"2024-09-14T11:18:21.106659+0000","last_fullsized":"2024-09-14T11:18:21.106659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:02:14.749214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"260'79","reported_seq":576,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:05.985921+0000","last_change":"2024-09-14T10:45:49.728741+0000","last_active":"2024-09-14T11:21:05.985921+0000","last_peered":"2024-09-14T11:21:05.985921+0000","last_clean":"2024-09-14T11:21:05.985921+0000","last_became_active":"2024-09-14T10:45:49.728444+0000","last_became_peered":"2024-09-14T10:45:49.728444+0000","last_unstale":"2024-09-14T11:21:05.985921+0000","last_undegraded":"2024-09-14T11:21:05.985921+0000","last_fullsized":"2024-09-14T11:21:05.985921+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:42.103576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":102,"num_read_kb":95,"num_write":120,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"260'795","reported_seq":2265,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.163068+0000","last_change":"2024-09-14T10:45:51.746786+0000","last_active":"2024-09-14T11:22:51.163068+0000","last_peered":"2024-09-14T11:22:51.163068+0000","last_clean":"2024-09-14T11:22:51.163068+0000","last_became_active":"2024-09-14T10:45:51.746303+0000","last_became_peered":"2024-09-14T10:45:51.746303+0000","last_unstale":"2024-09-14T11:22:51.163068+0000","last_undegraded":"2024-09-14T11:22:51.163068+0000","last_fullsized":"2024-09-14T11:22:51.163068+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:04.109276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"260'118","reported_seq":594,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:15.160213+0000","last_change":"2024-09-14T10:45:53.751786+0000","last_active":"2024-09-14T11:21:15.160213+0000","last_peered":"2024-09-14T11:21:15.160213+0000","last_clean":"2024-09-14T11:21:15.160213+0000","last_became_active":"2024-09-14T10:45:53.751453+0000","last_became_peered":"2024-09-14T10:45:53.751453+0000","last_unstale":"2024-09-14T11:21:15.160213+0000","last_undegraded":"2024-09-14T11:21:15.160213+0000","last_fullsized":"2024-09-14T11:21:15.160213+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:59.084760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":104,"num_write":274,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"260'444","reported_seq":2012,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:16.290828+0000","last_change":"2024-09-14T10:45:45.726094+0000","last_active":"2024-09-14T11:21:16.290828+0000","last_peered":"2024-09-14T11:21:16.290828+0000","last_clean":"2024-09-14T11:21:16.290828+0000","last_became_active":"2024-09-14T10:45:45.725806+0000","last_became_peered":"2024-09-14T10:45:45.725806+0000","last_unstale":"2024-09-14T11:21:16.290828+0000","last_undegraded":"2024-09-14T11:21:16.290828+0000","last_fullsized":"2024-09-14T11:21:16.290828+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:22.555341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2489,"num_read_kb":2350,"num_write":523,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"260'372","reported_seq":1033,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.455835+0000","last_change":"2024-09-14T10:45:43.687148+0000","last_active":"2024-09-14T11:22:51.455835+0000","last_peered":"2024-09-14T11:22:51.455835+0000","last_clean":"2024-09-14T11:22:51.455835+0000","last_became_active":"2024-09-14T10:45:43.686768+0000","last_became_peered":"2024-09-14T10:45:43.686768+0000","last_unstale":"2024-09-14T11:22:51.455835+0000","last_undegraded":"2024-09-14T11:22:51.455835+0000","last_fullsized":"2024-09-14T11:22:51.455835+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:33.463121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":721,"num_read_kb":58950,"num_write":1313,"num_write_kb":32402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":483,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:17.100449+0000","last_change":"2024-09-14T10:45:47.719027+0000","last_active":"2024-09-14T11:18:17.100449+0000","last_peered":"2024-09-14T11:18:17.100449+0000","last_clean":"2024-09-14T11:18:17.100449+0000","last_became_active":"2024-09-14T10:45:47.718721+0000","last_became_peered":"2024-09-14T10:45:47.718721+0000","last_unstale":"2024-09-14T11:18:17.100449+0000","last_undegraded":"2024-09-14T11:18:17.100449+0000","last_fullsized":"2024-09-14T11:18:17.100449+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:24.577421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"260'293","reported_seq":859,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.907105+0000","last_change":"2024-09-14T10:45:49.733977+0000","last_active":"2024-09-14T11:22:50.907105+0000","last_peered":"2024-09-14T11:22:50.907105+0000","last_clean":"2024-09-14T11:22:50.907105+0000","last_became_active":"2024-09-14T10:45:49.733684+0000","last_became_peered":"2024-09-14T10:45:49.733684+0000","last_unstale":"2024-09-14T11:22:50.907105+0000","last_undegraded":"2024-09-14T11:22:50.907105+0000","last_fullsized":"2024-09-14T11:22:50.907105+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:42.242159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49376,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":469,"num_read_kb":1024,"num_write":384,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":476,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:41.118307+0000","last_change":"2024-09-14T10:45:51.742049+0000","last_active":"2024-09-14T11:19:41.118307+0000","last_peered":"2024-09-14T11:19:41.118307+0000","last_clean":"2024-09-14T11:19:41.118307+0000","last_became_active":"2024-09-14T10:45:51.741767+0000","last_became_peered":"2024-09-14T10:45:51.741767+0000","last_unstale":"2024-09-14T11:19:41.118307+0000","last_undegraded":"2024-09-14T11:19:41.118307+0000","last_fullsized":"2024-09-14T11:19:41.118307+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:16:02.477621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"260'128","reported_seq":620,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:06.769959+0000","last_change":"2024-09-14T10:45:53.749052+0000","last_active":"2024-09-14T11:21:06.769959+0000","last_peered":"2024-09-14T11:21:06.769959+0000","last_clean":"2024-09-14T11:21:06.769959+0000","last_became_active":"2024-09-14T10:45:53.748760+0000","last_became_peered":"2024-09-14T10:45:53.748760+0000","last_unstale":"2024-09-14T11:21:06.769959+0000","last_undegraded":"2024-09-14T11:21:06.769959+0000","last_fullsized":"2024-09-14T11:21:06.769959+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:12.144519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":155,"num_read_kb":143,"num_write":309,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"260'787","reported_seq":2297,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.832691+0000","last_change":"2024-09-14T10:45:45.718006+0000","last_active":"2024-09-14T11:22:42.832691+0000","last_peered":"2024-09-14T11:22:42.832691+0000","last_clean":"2024-09-14T11:22:42.832691+0000","last_became_active":"2024-09-14T10:45:45.717706+0000","last_became_peered":"2024-09-14T10:45:45.717706+0000","last_unstale":"2024-09-14T11:22:42.832691+0000","last_undegraded":"2024-09-14T11:22:42.832691+0000","last_fullsized":"2024-09-14T11:22:42.832691+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:04.856085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3708,"num_read_kb":3358,"num_write":1019,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"260'341","reported_seq":947,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.441824+0000","last_change":"2024-09-14T10:45:43.683275+0000","last_active":"2024-09-14T11:22:51.441824+0000","last_peered":"2024-09-14T11:22:51.441824+0000","last_clean":"2024-09-14T11:22:51.441824+0000","last_became_active":"2024-09-14T10:45:43.683014+0000","last_became_peered":"2024-09-14T10:45:43.683014+0000","last_unstale":"2024-09-14T11:22:51.441824+0000","last_undegraded":"2024-09-14T11:22:51.441824+0000","last_fullsized":"2024-09-14T11:22:51.441824+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:39:23.935741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133668,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":545,"num_read_kb":15772,"num_write":997,"num_write_kb":32563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":474,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:19.977556+0000","last_change":"2024-09-14T10:45:47.726045+0000","last_active":"2024-09-14T11:18:19.977556+0000","last_peered":"2024-09-14T11:18:19.977556+0000","last_clean":"2024-09-14T11:18:19.977556+0000","last_became_active":"2024-09-14T10:45:47.725850+0000","last_became_peered":"2024-09-14T10:45:47.725850+0000","last_unstale":"2024-09-14T11:18:19.977556+0000","last_undegraded":"2024-09-14T11:18:19.977556+0000","last_fullsized":"2024-09-14T11:18:19.977556+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:53.534864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"260'258","reported_seq":811,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.945561+0000","last_change":"2024-09-14T10:45:49.736850+0000","last_active":"2024-09-14T11:22:50.945561+0000","last_peered":"2024-09-14T11:22:50.945561+0000","last_clean":"2024-09-14T11:22:50.945561+0000","last_became_active":"2024-09-14T10:45:49.736538+0000","last_became_peered":"2024-09-14T10:45:49.736538+0000","last_unstale":"2024-09-14T11:22:50.945561+0000","last_undegraded":"2024-09-14T11:22:50.945561+0000","last_fullsized":"2024-09-14T11:22:50.945561+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:24.205374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45998,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":425,"num_read_kb":1014,"num_write":348,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":470,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:47.114678+0000","last_change":"2024-09-14T10:45:51.745256+0000","last_active":"2024-09-14T11:19:47.114678+0000","last_peered":"2024-09-14T11:19:47.114678+0000","last_clean":"2024-09-14T11:19:47.114678+0000","last_became_active":"2024-09-14T10:45:51.744957+0000","last_became_peered":"2024-09-14T10:45:51.744957+0000","last_unstale":"2024-09-14T11:19:47.114678+0000","last_undegraded":"2024-09-14T11:19:47.114678+0000","last_fullsized":"2024-09-14T11:19:47.114678+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:00.836610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"260'125","reported_seq":625,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.799038+0000","last_change":"2024-09-14T10:45:53.750560+0000","last_active":"2024-09-14T11:21:28.799038+0000","last_peered":"2024-09-14T11:21:28.799038+0000","last_clean":"2024-09-14T11:21:28.799038+0000","last_became_active":"2024-09-14T10:45:53.750287+0000","last_became_peered":"2024-09-14T10:45:53.750287+0000","last_unstale":"2024-09-14T11:21:28.799038+0000","last_undegraded":"2024-09-14T11:21:28.799038+0000","last_fullsized":"2024-09-14T11:21:28.799038+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:48.692799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":175,"num_read_kb":170,"num_write":297,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"260'391","reported_seq":1842,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.835107+0000","last_change":"2024-09-14T10:45:45.713005+0000","last_active":"2024-09-14T11:22:42.835107+0000","last_peered":"2024-09-14T11:22:42.835107+0000","last_clean":"2024-09-14T11:22:42.835107+0000","last_became_active":"2024-09-14T10:45:45.712455+0000","last_became_peered":"2024-09-14T10:45:45.712455+0000","last_unstale":"2024-09-14T11:22:42.835107+0000","last_undegraded":"2024-09-14T11:22:42.835107+0000","last_fullsized":"2024-09-14T11:22:42.835107+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:29.570600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2172,"num_read_kb":2052,"num_write":470,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"260'351","reported_seq":998,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.459387+0000","last_change":"2024-09-14T10:45:43.676752+0000","last_active":"2024-09-14T11:22:51.459387+0000","last_peered":"2024-09-14T11:22:51.459387+0000","last_clean":"2024-09-14T11:22:51.459387+0000","last_became_active":"2024-09-14T10:45:43.676145+0000","last_became_peered":"2024-09-14T10:45:43.676145+0000","last_unstale":"2024-09-14T11:22:51.459387+0000","last_undegraded":"2024-09-14T11:22:51.459387+0000","last_fullsized":"2024-09-14T11:22:51.459387+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:31:26.462692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133740,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":675,"num_read_kb":38975,"num_write":1181,"num_write_kb":36099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:37.112554+0000","last_change":"2024-09-14T10:45:47.724662+0000","last_active":"2024-09-14T11:19:37.112554+0000","last_peered":"2024-09-14T11:19:37.112554+0000","last_clean":"2024-09-14T11:19:37.112554+0000","last_became_active":"2024-09-14T10:45:47.724065+0000","last_became_peered":"2024-09-14T10:45:47.724065+0000","last_unstale":"2024-09-14T11:19:37.112554+0000","last_undegraded":"2024-09-14T11:19:37.112554+0000","last_fullsized":"2024-09-14T11:19:37.112554+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:57.045602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"260'239","reported_seq":777,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.625663+0000","last_change":"2024-09-14T10:45:49.728006+0000","last_active":"2024-09-14T11:22:50.625663+0000","last_peered":"2024-09-14T11:22:50.625663+0000","last_clean":"2024-09-14T11:22:50.625663+0000","last_became_active":"2024-09-14T10:45:49.727721+0000","last_became_peered":"2024-09-14T10:45:49.727721+0000","last_unstale":"2024-09-14T11:22:50.625663+0000","last_undegraded":"2024-09-14T11:22:50.625663+0000","last_fullsized":"2024-09-14T11:22:50.625663+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:35.275905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47218,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":415,"num_read_kb":1017,"num_write":344,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":469,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:22.101700+0000","last_change":"2024-09-14T10:45:51.742675+0000","last_active":"2024-09-14T11:18:22.101700+0000","last_peered":"2024-09-14T11:18:22.101700+0000","last_clean":"2024-09-14T11:18:22.101700+0000","last_became_active":"2024-09-14T10:45:51.742387+0000","last_became_peered":"2024-09-14T10:45:51.742387+0000","last_unstale":"2024-09-14T11:18:22.101700+0000","last_undegraded":"2024-09-14T11:18:22.101700+0000","last_fullsized":"2024-09-14T11:18:22.101700+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:36.809715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"260'160","reported_seq":1255,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.232516+0000","last_change":"2024-09-14T10:45:53.752874+0000","last_active":"2024-09-14T11:21:27.232516+0000","last_peered":"2024-09-14T11:21:27.232516+0000","last_clean":"2024-09-14T11:21:27.232516+0000","last_became_active":"2024-09-14T10:45:53.752639+0000","last_became_peered":"2024-09-14T10:45:53.752639+0000","last_unstale":"2024-09-14T11:21:27.232516+0000","last_undegraded":"2024-09-14T11:21:27.232516+0000","last_fullsized":"2024-09-14T11:21:27.232516+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:29.390299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":838,"num_read_kb":820,"num_write":382,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"260'397","reported_seq":1903,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:15.867791+0000","last_change":"2024-09-14T10:45:45.719248+0000","last_active":"2024-09-14T11:21:15.867791+0000","last_peered":"2024-09-14T11:21:15.867791+0000","last_clean":"2024-09-14T11:21:15.867791+0000","last_became_active":"2024-09-14T10:45:45.718964+0000","last_became_peered":"2024-09-14T10:45:45.718964+0000","last_unstale":"2024-09-14T11:21:15.867791+0000","last_undegraded":"2024-09-14T11:21:15.867791+0000","last_fullsized":"2024-09-14T11:21:15.867791+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:55.163718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2133,"num_read_kb":2043,"num_write":433,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"260'366","reported_seq":1004,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.455146+0000","last_change":"2024-09-14T10:45:43.675554+0000","last_active":"2024-09-14T11:22:51.455146+0000","last_peered":"2024-09-14T11:22:51.455146+0000","last_clean":"2024-09-14T11:22:51.455146+0000","last_became_active":"2024-09-14T10:45:43.675220+0000","last_became_peered":"2024-09-14T10:45:43.675220+0000","last_unstale":"2024-09-14T11:22:51.455146+0000","last_undegraded":"2024-09-14T11:22:51.455146+0000","last_fullsized":"2024-09-14T11:22:51.455146+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:34:09.729685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":607,"num_read_kb":38424,"num_write":1090,"num_write_kb":41594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":485,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:46.119103+0000","last_change":"2024-09-14T10:45:47.729627+0000","last_active":"2024-09-14T11:19:46.119103+0000","last_peered":"2024-09-14T11:19:46.119103+0000","last_clean":"2024-09-14T11:19:46.119103+0000","last_became_active":"2024-09-14T10:45:47.729338+0000","last_became_peered":"2024-09-14T10:45:47.729338+0000","last_unstale":"2024-09-14T11:19:46.119103+0000","last_undegraded":"2024-09-14T11:19:46.119103+0000","last_fullsized":"2024-09-14T11:19:46.119103+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:15.042150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"260'290","reported_seq":852,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.738891+0000","last_change":"2024-09-14T10:45:49.731337+0000","last_active":"2024-09-14T11:22:50.738891+0000","last_peered":"2024-09-14T11:22:50.738891+0000","last_clean":"2024-09-14T11:22:50.738891+0000","last_became_active":"2024-09-14T10:45:49.729842+0000","last_became_peered":"2024-09-14T10:45:49.729842+0000","last_unstale":"2024-09-14T11:22:50.738891+0000","last_undegraded":"2024-09-14T11:22:50.738891+0000","last_fullsized":"2024-09-14T11:22:50.738891+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:25:47.634561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44662,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":478,"num_read_kb":1058,"num_write":386,"num_write_kb":290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":475,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:21.106628+0000","last_change":"2024-09-14T10:45:51.745622+0000","last_active":"2024-09-14T11:18:21.106628+0000","last_peered":"2024-09-14T11:18:21.106628+0000","last_clean":"2024-09-14T11:18:21.106628+0000","last_became_active":"2024-09-14T10:45:51.745310+0000","last_became_peered":"2024-09-14T10:45:51.745310+0000","last_unstale":"2024-09-14T11:18:21.106628+0000","last_undegraded":"2024-09-14T11:18:21.106628+0000","last_fullsized":"2024-09-14T11:18:21.106628+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:03.197112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"260'137","reported_seq":616,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.832054+0000","last_change":"2024-09-14T10:45:53.755154+0000","last_active":"2024-09-14T11:22:42.832054+0000","last_peered":"2024-09-14T11:22:42.832054+0000","last_clean":"2024-09-14T11:22:42.832054+0000","last_became_active":"2024-09-14T10:45:53.754826+0000","last_became_peered":"2024-09-14T10:45:53.754826+0000","last_unstale":"2024-09-14T11:22:42.832054+0000","last_undegraded":"2024-09-14T11:22:42.832054+0000","last_fullsized":"2024-09-14T11:22:42.832054+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:13.225340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":657,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":128,"num_read_kb":116,"num_write":335,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"260'420","reported_seq":1963,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:15.435203+0000","last_change":"2024-09-14T10:45:45.709097+0000","last_active":"2024-09-14T11:21:15.435203+0000","last_peered":"2024-09-14T11:21:15.435203+0000","last_clean":"2024-09-14T11:21:15.435203+0000","last_became_active":"2024-09-14T10:45:45.708229+0000","last_became_peered":"2024-09-14T10:45:45.708229+0000","last_unstale":"2024-09-14T11:21:15.435203+0000","last_undegraded":"2024-09-14T11:21:15.435203+0000","last_fullsized":"2024-09-14T11:21:15.435203+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:43.675052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2330,"num_read_kb":2210,"num_write":517,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"260'367","reported_seq":1014,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.458302+0000","last_change":"2024-09-14T10:45:43.684421+0000","last_active":"2024-09-14T11:22:51.458302+0000","last_peered":"2024-09-14T11:22:51.458302+0000","last_clean":"2024-09-14T11:22:51.458302+0000","last_became_active":"2024-09-14T10:45:43.684102+0000","last_became_peered":"2024-09-14T10:45:43.684102+0000","last_unstale":"2024-09-14T11:22:51.458302+0000","last_undegraded":"2024-09-14T11:22:51.458302+0000","last_fullsized":"2024-09-14T11:22:51.458302+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:13.550852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133709,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":619,"num_read_kb":82373,"num_write":1076,"num_write_kb":43712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"260'384","reported_seq":1943,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.835413+0000","last_change":"2024-09-14T10:45:45.719252+0000","last_active":"2024-09-14T11:22:42.835413+0000","last_peered":"2024-09-14T11:22:42.835413+0000","last_clean":"2024-09-14T11:22:42.835413+0000","last_became_active":"2024-09-14T10:45:45.718949+0000","last_became_peered":"2024-09-14T10:45:45.718949+0000","last_unstale":"2024-09-14T11:22:42.835413+0000","last_undegraded":"2024-09-14T11:22:42.835413+0000","last_fullsized":"2024-09-14T11:22:42.835413+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:10.419875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2227,"num_read_kb":2135,"num_write":439,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"260'308","reported_seq":920,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.467244+0000","last_change":"2024-09-14T10:45:43.690959+0000","last_active":"2024-09-14T11:22:51.467244+0000","last_peered":"2024-09-14T11:22:51.467244+0000","last_clean":"2024-09-14T11:22:51.467244+0000","last_became_active":"2024-09-14T10:45:43.690675+0000","last_became_peered":"2024-09-14T10:45:43.690675+0000","last_unstale":"2024-09-14T11:22:51.467244+0000","last_undegraded":"2024-09-14T11:22:51.467244+0000","last_fullsized":"2024-09-14T11:22:51.467244+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:38.359419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":527,"num_read_kb":9887,"num_write":1028,"num_write_kb":21015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"260'531","reported_seq":2240,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:16.296791+0000","last_change":"2024-09-14T10:45:45.718344+0000","last_active":"2024-09-14T11:21:16.296791+0000","last_peered":"2024-09-14T11:21:16.296791+0000","last_clean":"2024-09-14T11:21:16.296791+0000","last_became_active":"2024-09-14T10:45:45.717393+0000","last_became_peered":"2024-09-14T10:45:45.717393+0000","last_unstale":"2024-09-14T11:21:16.296791+0000","last_undegraded":"2024-09-14T11:21:16.296791+0000","last_fullsized":"2024-09-14T11:21:16.296791+0000","mapping_epoch":26,"log_start":"260'500","ondisk_log_start":"260'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":500,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:54.085248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2830,"num_read_kb":2663,"num_write":635,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"260'385","reported_seq":1026,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.393088+0000","last_change":"2024-09-14T10:45:43.675487+0000","last_active":"2024-09-14T11:22:51.393088+0000","last_peered":"2024-09-14T11:22:51.393088+0000","last_clean":"2024-09-14T11:22:51.393088+0000","last_became_active":"2024-09-14T10:45:43.675216+0000","last_became_peered":"2024-09-14T10:45:43.675216+0000","last_unstale":"2024-09-14T11:22:51.393088+0000","last_undegraded":"2024-09-14T11:22:51.393088+0000","last_fullsized":"2024-09-14T11:22:51.393088+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:40:10.871125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":708,"num_read_kb":14121,"num_write":1222,"num_write_kb":48801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"260'869","reported_seq":2509,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.742312+0000","last_change":"2024-09-14T10:45:45.721319+0000","last_active":"2024-09-14T11:21:28.742312+0000","last_peered":"2024-09-14T11:21:28.742312+0000","last_clean":"2024-09-14T11:21:28.742312+0000","last_became_active":"2024-09-14T10:45:45.720939+0000","last_became_peered":"2024-09-14T10:45:45.720939+0000","last_unstale":"2024-09-14T11:21:28.742312+0000","last_undegraded":"2024-09-14T11:21:28.742312+0000","last_fullsized":"2024-09-14T11:21:28.742312+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":800,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:00.246883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4139,"num_read_kb":3737,"num_write":1132,"num_write_kb":407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"260'312","reported_seq":892,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.358807+0000","last_change":"2024-09-14T10:45:43.682207+0000","last_active":"2024-09-14T11:22:51.358807+0000","last_peered":"2024-09-14T11:22:51.358807+0000","last_clean":"2024-09-14T11:22:51.358807+0000","last_became_active":"2024-09-14T10:45:43.681864+0000","last_became_peered":"2024-09-14T10:45:43.681864+0000","last_unstale":"2024-09-14T11:22:51.358807+0000","last_undegraded":"2024-09-14T11:22:51.358807+0000","last_fullsized":"2024-09-14T11:22:51.358807+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:57.070549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":459,"num_read_kb":5481,"num_write":964,"num_write_kb":23381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"260'447","reported_seq":2094,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.733448+0000","last_change":"2024-09-14T10:45:45.722885+0000","last_active":"2024-09-14T11:21:28.733448+0000","last_peered":"2024-09-14T11:21:28.733448+0000","last_clean":"2024-09-14T11:21:28.733448+0000","last_became_active":"2024-09-14T10:45:45.722575+0000","last_became_peered":"2024-09-14T10:45:45.722575+0000","last_unstale":"2024-09-14T11:21:28.733448+0000","last_undegraded":"2024-09-14T11:21:28.733448+0000","last_fullsized":"2024-09-14T11:21:28.733448+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:17.355674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2593,"num_read_kb":2475,"num_write":496,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"260'359","reported_seq":993,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.463040+0000","last_change":"2024-09-14T10:45:43.691467+0000","last_active":"2024-09-14T11:22:51.463040+0000","last_peered":"2024-09-14T11:22:51.463040+0000","last_clean":"2024-09-14T11:22:51.463040+0000","last_became_active":"2024-09-14T10:45:43.691101+0000","last_became_peered":"2024-09-14T10:45:43.691101+0000","last_unstale":"2024-09-14T11:22:51.463040+0000","last_undegraded":"2024-09-14T11:22:51.463040+0000","last_fullsized":"2024-09-14T11:22:51.463040+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:42.090533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":637,"num_read_kb":20829,"num_write":1146,"num_write_kb":28609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"260'964","reported_seq":2549,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.733701+0000","last_change":"2024-09-14T10:45:45.717757+0000","last_active":"2024-09-14T11:21:28.733701+0000","last_peered":"2024-09-14T11:21:28.733701+0000","last_clean":"2024-09-14T11:21:28.733701+0000","last_became_active":"2024-09-14T10:45:45.717482+0000","last_became_peered":"2024-09-14T10:45:45.717482+0000","last_unstale":"2024-09-14T11:21:28.733701+0000","last_undegraded":"2024-09-14T11:21:28.733701+0000","last_fullsized":"2024-09-14T11:21:28.733701+0000","mapping_epoch":26,"log_start":"260'900","ondisk_log_start":"260'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":900,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:38.032224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4656,"num_read_kb":4162,"num_write":1345,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"260'415","reported_seq":1054,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.473144+0000","last_change":"2024-09-14T10:45:43.682195+0000","last_active":"2024-09-14T11:22:51.473144+0000","last_peered":"2024-09-14T11:22:51.473144+0000","last_clean":"2024-09-14T11:22:51.473144+0000","last_became_active":"2024-09-14T10:45:43.681769+0000","last_became_peered":"2024-09-14T10:45:43.681769+0000","last_unstale":"2024-09-14T11:22:51.473144+0000","last_undegraded":"2024-09-14T11:22:51.473144+0000","last_fullsized":"2024-09-14T11:22:51.473144+0000","mapping_epoch":23,"log_start":"260'400","ondisk_log_start":"260'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:19:39.686774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":884,"num_read_kb":850,"num_write":1209,"num_write_kb":26526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"260'498","reported_seq":2173,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:16.642909+0000","last_change":"2024-09-14T10:45:45.724828+0000","last_active":"2024-09-14T11:21:16.642909+0000","last_peered":"2024-09-14T11:21:16.642909+0000","last_clean":"2024-09-14T11:21:16.642909+0000","last_became_active":"2024-09-14T10:45:45.724491+0000","last_became_peered":"2024-09-14T10:45:45.724491+0000","last_unstale":"2024-09-14T11:21:16.642909+0000","last_undegraded":"2024-09-14T11:21:16.642909+0000","last_fullsized":"2024-09-14T11:21:16.642909+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:19.646816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2800,"num_read_kb":2654,"num_write":635,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"260'359","reported_seq":976,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.462762+0000","last_change":"2024-09-14T10:45:43.672840+0000","last_active":"2024-09-14T11:22:51.462762+0000","last_peered":"2024-09-14T11:22:51.462762+0000","last_clean":"2024-09-14T11:22:51.462762+0000","last_became_active":"2024-09-14T10:45:43.672592+0000","last_became_peered":"2024-09-14T10:45:43.672592+0000","last_unstale":"2024-09-14T11:22:51.462762+0000","last_undegraded":"2024-09-14T11:22:51.462762+0000","last_fullsized":"2024-09-14T11:22:51.462762+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:20.782416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133682,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":581,"num_read_kb":14710,"num_write":1041,"num_write_kb":26884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"260'948","reported_seq":2547,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:10.890134+0000","last_change":"2024-09-14T10:45:45.713168+0000","last_active":"2024-09-14T11:21:10.890134+0000","last_peered":"2024-09-14T11:21:10.890134+0000","last_clean":"2024-09-14T11:21:10.890134+0000","last_became_active":"2024-09-14T10:45:45.712642+0000","last_became_peered":"2024-09-14T10:45:45.712642+0000","last_unstale":"2024-09-14T11:21:10.890134+0000","last_undegraded":"2024-09-14T11:21:10.890134+0000","last_fullsized":"2024-09-14T11:21:10.890134+0000","mapping_epoch":26,"log_start":"260'900","ondisk_log_start":"260'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":900,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:58.076786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4544,"num_read_kb":4033,"num_write":1311,"num_write_kb":524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"260'378","reported_seq":1019,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.420951+0000","last_change":"2024-09-14T10:45:43.675555+0000","last_active":"2024-09-14T11:22:51.420951+0000","last_peered":"2024-09-14T11:22:51.420951+0000","last_clean":"2024-09-14T11:22:51.420951+0000","last_became_active":"2024-09-14T10:45:43.675233+0000","last_became_peered":"2024-09-14T10:45:43.675233+0000","last_unstale":"2024-09-14T11:22:51.420951+0000","last_undegraded":"2024-09-14T11:22:51.420951+0000","last_fullsized":"2024-09-14T11:22:51.420951+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:01.549298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":674,"num_read_kb":10456,"num_write":1272,"num_write_kb":38144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"260'843","reported_seq":2436,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.742304+0000","last_change":"2024-09-14T10:45:45.712273+0000","last_active":"2024-09-14T11:21:28.742304+0000","last_peered":"2024-09-14T11:21:28.742304+0000","last_clean":"2024-09-14T11:21:28.742304+0000","last_became_active":"2024-09-14T10:45:45.711947+0000","last_became_peered":"2024-09-14T10:45:45.711947+0000","last_unstale":"2024-09-14T11:21:28.742304+0000","last_undegraded":"2024-09-14T11:21:28.742304+0000","last_fullsized":"2024-09-14T11:21:28.742304+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":800,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:05:59.351828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4120,"num_read_kb":3716,"num_write":1158,"num_write_kb":467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"260'304","reported_seq":904,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.432395+0000","last_change":"2024-09-14T10:45:43.677879+0000","last_active":"2024-09-14T11:22:51.432395+0000","last_peered":"2024-09-14T11:22:51.432395+0000","last_clean":"2024-09-14T11:22:51.432395+0000","last_became_active":"2024-09-14T10:45:43.677597+0000","last_became_peered":"2024-09-14T10:45:43.677597+0000","last_unstale":"2024-09-14T11:22:51.432395+0000","last_undegraded":"2024-09-14T11:22:51.432395+0000","last_fullsized":"2024-09-14T11:22:51.432395+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:12.554551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":480,"num_read_kb":1898,"num_write":986,"num_write_kb":19841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"260'855","reported_seq":2368,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:13.519366+0000","last_change":"2024-09-14T10:45:45.715549+0000","last_active":"2024-09-14T11:21:13.519366+0000","last_peered":"2024-09-14T11:21:13.519366+0000","last_clean":"2024-09-14T11:21:13.519366+0000","last_became_active":"2024-09-14T10:45:45.715268+0000","last_became_peered":"2024-09-14T10:45:45.715268+0000","last_unstale":"2024-09-14T11:21:13.519366+0000","last_undegraded":"2024-09-14T11:21:13.519366+0000","last_fullsized":"2024-09-14T11:21:13.519366+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":800,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:40.990468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4230,"num_read_kb":3798,"num_write":1192,"num_write_kb":502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"260'353","reported_seq":1001,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.357044+0000","last_change":"2024-09-14T10:45:43.681993+0000","last_active":"2024-09-14T11:22:51.357044+0000","last_peered":"2024-09-14T11:22:51.357044+0000","last_clean":"2024-09-14T11:22:51.357044+0000","last_became_active":"2024-09-14T10:45:43.681694+0000","last_became_peered":"2024-09-14T10:45:43.681694+0000","last_unstale":"2024-09-14T11:22:51.357044+0000","last_undegraded":"2024-09-14T11:22:51.357044+0000","last_fullsized":"2024-09-14T11:22:51.357044+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:01.339229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133679,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":711,"num_read_kb":32454,"num_write":1261,"num_write_kb":21071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"260'430","reported_seq":1883,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.336922+0000","last_change":"2024-09-14T10:45:45.723781+0000","last_active":"2024-09-14T11:21:28.336922+0000","last_peered":"2024-09-14T11:21:28.336922+0000","last_clean":"2024-09-14T11:21:28.336922+0000","last_became_active":"2024-09-14T10:45:45.723441+0000","last_became_peered":"2024-09-14T10:45:45.723441+0000","last_unstale":"2024-09-14T11:21:28.336922+0000","last_undegraded":"2024-09-14T11:21:28.336922+0000","last_fullsized":"2024-09-14T11:21:28.336922+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:25.130052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2262,"num_read_kb":2127,"num_write":517,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"260'353","reported_seq":989,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.454731+0000","last_change":"2024-09-14T10:45:43.681966+0000","last_active":"2024-09-14T11:22:51.454731+0000","last_peered":"2024-09-14T11:22:51.454731+0000","last_clean":"2024-09-14T11:22:51.454731+0000","last_became_active":"2024-09-14T10:45:43.681441+0000","last_became_peered":"2024-09-14T10:45:43.681441+0000","last_unstale":"2024-09-14T11:22:51.454731+0000","last_undegraded":"2024-09-14T11:22:51.454731+0000","last_fullsized":"2024-09-14T11:22:51.454731+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:17:03.032759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244496,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":649,"num_read_kb":21101,"num_write":1092,"num_write_kb":38924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"260'751","reported_seq":2222,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:16.648120+0000","last_change":"2024-09-14T10:45:45.711729+0000","last_active":"2024-09-14T11:21:16.648120+0000","last_peered":"2024-09-14T11:21:16.648120+0000","last_clean":"2024-09-14T11:21:16.648120+0000","last_became_active":"2024-09-14T10:45:45.711402+0000","last_became_peered":"2024-09-14T10:45:45.711402+0000","last_unstale":"2024-09-14T11:21:16.648120+0000","last_undegraded":"2024-09-14T11:21:16.648120+0000","last_fullsized":"2024-09-14T11:21:16.648120+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:13:41.088714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3613,"num_read_kb":3262,"num_write":995,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"260'347","reported_seq":968,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.465448+0000","last_change":"2024-09-14T10:45:43.691446+0000","last_active":"2024-09-14T11:22:51.465448+0000","last_peered":"2024-09-14T11:22:51.465448+0000","last_clean":"2024-09-14T11:22:51.465448+0000","last_became_active":"2024-09-14T10:45:43.690104+0000","last_became_peered":"2024-09-14T10:45:43.690104+0000","last_unstale":"2024-09-14T11:22:51.465448+0000","last_undegraded":"2024-09-14T11:22:51.465448+0000","last_fullsized":"2024-09-14T11:22:51.465448+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:57.667620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":636,"num_read_kb":1890,"num_write":1154,"num_write_kb":1386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"260'584","reported_seq":2224,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:16.648085+0000","last_change":"2024-09-14T10:45:45.723438+0000","last_active":"2024-09-14T11:21:16.648085+0000","last_peered":"2024-09-14T11:21:16.648085+0000","last_clean":"2024-09-14T11:21:16.648085+0000","last_became_active":"2024-09-14T10:45:45.723163+0000","last_became_peered":"2024-09-14T10:45:45.723163+0000","last_unstale":"2024-09-14T11:21:16.648085+0000","last_undegraded":"2024-09-14T11:21:16.648085+0000","last_fullsized":"2024-09-14T11:21:16.648085+0000","mapping_epoch":26,"log_start":"260'500","ondisk_log_start":"260'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":500,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:52.106816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3275,"num_read_kb":3002,"num_write":768,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"260'379","reported_seq":1053,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:54.616609+0000","last_change":"2024-09-14T11:22:54.616609+0000","last_active":"2024-09-14T11:22:54.616609+0000","last_peered":"2024-09-14T11:22:54.616609+0000","last_clean":"2024-09-14T11:22:54.616609+0000","last_became_active":"2024-09-14T10:45:43.680517+0000","last_became_peered":"2024-09-14T10:45:43.680517+0000","last_unstale":"2024-09-14T11:22:54.616609+0000","last_undegraded":"2024-09-14T11:22:54.616609+0000","last_fullsized":"2024-09-14T11:22:54.616609+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'379","last_scrub_stamp":"2024-09-14T11:22:54.616470+0000","last_deep_scrub":"260'379","last_deep_scrub_stamp":"2024-09-14T11:22:54.616470+0000","last_clean_scrub_stamp":"2024-09-14T11:22:54.616470+0000","objects_scrubbed":8,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:48.841281+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133694,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":729,"num_read_kb":32475,"num_write":1387,"num_write_kb":39199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"260'767","reported_seq":2281,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:46.011097+0000","last_change":"2024-09-14T10:45:45.719346+0000","last_active":"2024-09-14T11:21:46.011097+0000","last_peered":"2024-09-14T11:21:46.011097+0000","last_clean":"2024-09-14T11:21:46.011097+0000","last_became_active":"2024-09-14T10:45:45.718969+0000","last_became_peered":"2024-09-14T10:45:45.718969+0000","last_unstale":"2024-09-14T11:21:46.011097+0000","last_undegraded":"2024-09-14T11:21:46.011097+0000","last_fullsized":"2024-09-14T11:21:46.011097+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:07:46.732678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3670,"num_read_kb":3326,"num_write":1002,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"260'335","reported_seq":955,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.477500+0000","last_change":"2024-09-14T10:45:43.691080+0000","last_active":"2024-09-14T11:22:51.477500+0000","last_peered":"2024-09-14T11:22:51.477500+0000","last_clean":"2024-09-14T11:22:51.477500+0000","last_became_active":"2024-09-14T10:45:43.690489+0000","last_became_peered":"2024-09-14T10:45:43.690489+0000","last_unstale":"2024-09-14T11:22:51.477500+0000","last_undegraded":"2024-09-14T11:22:51.477500+0000","last_fullsized":"2024-09-14T11:22:51.477500+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:15.282672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":562,"num_read_kb":22090,"num_write":1057,"num_write_kb":34450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"260'625","reported_seq":2199,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:46.134870+0000","last_change":"2024-09-14T10:45:45.727368+0000","last_active":"2024-09-14T11:21:46.134870+0000","last_peered":"2024-09-14T11:21:46.134870+0000","last_clean":"2024-09-14T11:21:46.134870+0000","last_became_active":"2024-09-14T10:45:45.727095+0000","last_became_peered":"2024-09-14T10:45:45.727095+0000","last_unstale":"2024-09-14T11:21:46.134870+0000","last_undegraded":"2024-09-14T11:21:46.134870+0000","last_fullsized":"2024-09-14T11:21:46.134870+0000","mapping_epoch":26,"log_start":"260'600","ondisk_log_start":"260'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":600,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:49.272823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3428,"num_read_kb":3090,"num_write":924,"num_write_kb":450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"260'307","reported_seq":893,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.467447+0000","last_change":"2024-09-14T10:45:43.689500+0000","last_active":"2024-09-14T11:22:51.467447+0000","last_peered":"2024-09-14T11:22:51.467447+0000","last_clean":"2024-09-14T11:22:51.467447+0000","last_became_active":"2024-09-14T10:45:43.689186+0000","last_became_peered":"2024-09-14T10:45:43.689186+0000","last_unstale":"2024-09-14T11:22:51.467447+0000","last_undegraded":"2024-09-14T11:22:51.467447+0000","last_fullsized":"2024-09-14T11:22:51.467447+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:39.910157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133706,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":457,"num_read_kb":44560,"num_write":936,"num_write_kb":69256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"260'1083","reported_seq":2821,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.337221+0000","last_change":"2024-09-14T10:45:45.720903+0000","last_active":"2024-09-14T11:21:28.337221+0000","last_peered":"2024-09-14T11:21:28.337221+0000","last_clean":"2024-09-14T11:21:28.337221+0000","last_became_active":"2024-09-14T10:45:45.720636+0000","last_became_peered":"2024-09-14T10:45:45.720636+0000","last_unstale":"2024-09-14T11:21:28.337221+0000","last_undegraded":"2024-09-14T11:21:28.337221+0000","last_fullsized":"2024-09-14T11:21:28.337221+0000","mapping_epoch":26,"log_start":"260'1000","ondisk_log_start":"260'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":1000,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:01:02.622281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5348,"num_read_kb":4870,"num_write":1559,"num_write_kb":616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"260'333","reported_seq":1005,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.425788+0000","last_change":"2024-09-14T10:45:43.682868+0000","last_active":"2024-09-14T11:22:51.425788+0000","last_peered":"2024-09-14T11:22:51.425788+0000","last_clean":"2024-09-14T11:22:51.425788+0000","last_became_active":"2024-09-14T10:45:43.682573+0000","last_became_peered":"2024-09-14T10:45:43.682573+0000","last_unstale":"2024-09-14T11:22:51.425788+0000","last_undegraded":"2024-09-14T11:22:51.425788+0000","last_fullsized":"2024-09-14T11:22:51.425788+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:56.318257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244522,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":804,"num_read_kb":3981,"num_write":1025,"num_write_kb":35472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"260'378","reported_seq":1006,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.459888+0000","last_change":"2024-09-14T10:45:43.673791+0000","last_active":"2024-09-14T11:22:51.459888+0000","last_peered":"2024-09-14T11:22:51.459888+0000","last_clean":"2024-09-14T11:22:51.459888+0000","last_became_active":"2024-09-14T10:45:43.673527+0000","last_became_peered":"2024-09-14T10:45:43.673527+0000","last_unstale":"2024-09-14T11:22:51.459888+0000","last_undegraded":"2024-09-14T11:22:51.459888+0000","last_fullsized":"2024-09-14T11:22:51.459888+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:05:57.311802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":679,"num_read_kb":21996,"num_write":1218,"num_write_kb":25813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"260'1013","reported_seq":2612,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:16.297531+0000","last_change":"2024-09-14T10:45:45.724368+0000","last_active":"2024-09-14T11:21:16.297531+0000","last_peered":"2024-09-14T11:21:16.297531+0000","last_clean":"2024-09-14T11:21:16.297531+0000","last_became_active":"2024-09-14T10:45:45.724040+0000","last_became_peered":"2024-09-14T10:45:45.724040+0000","last_unstale":"2024-09-14T11:21:16.297531+0000","last_undegraded":"2024-09-14T11:21:16.297531+0000","last_fullsized":"2024-09-14T11:21:16.297531+0000","mapping_epoch":26,"log_start":"260'1000","ondisk_log_start":"260'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":1000,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:23.578632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4769,"num_read_kb":4210,"num_write":1424,"num_write_kb":631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"260'380","reported_seq":1012,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.443259+0000","last_change":"2024-09-14T10:45:43.687437+0000","last_active":"2024-09-14T11:22:51.443259+0000","last_peered":"2024-09-14T11:22:51.443259+0000","last_clean":"2024-09-14T11:22:51.443259+0000","last_became_active":"2024-09-14T10:45:43.687162+0000","last_became_peered":"2024-09-14T10:45:43.687162+0000","last_unstale":"2024-09-14T11:22:51.443259+0000","last_undegraded":"2024-09-14T11:22:51.443259+0000","last_fullsized":"2024-09-14T11:22:51.443259+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:42.651602+0000","last_clean_scrub_stamp":"2024-09-14T10:45:42.651602+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:46.791778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":664,"num_read_kb":37354,"num_write":1184,"num_write_kb":26064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"260'477","reported_seq":2017,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.049726+0000","last_change":"2024-09-14T10:45:45.712133+0000","last_active":"2024-09-14T11:21:27.049726+0000","last_peered":"2024-09-14T11:21:27.049726+0000","last_clean":"2024-09-14T11:21:27.049726+0000","last_became_active":"2024-09-14T10:45:45.711869+0000","last_became_peered":"2024-09-14T10:45:45.711869+0000","last_unstale":"2024-09-14T11:21:27.049726+0000","last_undegraded":"2024-09-14T11:21:27.049726+0000","last_fullsized":"2024-09-14T11:21:27.049726+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:06.317656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2555,"num_read_kb":2382,"num_write":592,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10817,"num_read_kb":8523,"num_write":3117,"num_write_kb":1010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1096,"ondisk_log_size":1096,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":14831,"num_objects":87,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":15133,"num_read_kb":14796,"num_write":17057,"num_write_kb":4975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":29662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1479,"ondisk_log_size":1479,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":787,"ondisk_log_size":787,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1553710,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":17035,"num_read_kb":36473,"num_write":14315,"num_write_kb":11597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2077,"ondisk_log_size":2077,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2403,"num_read_kb":2864,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":219533,"num_read_kb":201172,"num_write":55836,"num_write_kb":19050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":143,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4159,"ondisk_log_size":4159,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":33830883,"num_objects":281,"num_object_clones":0,"num_object_copies":562,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":281,"num_whiteouts":0,"num_read":44198,"num_read_kb":2138103,"num_write":73249,"num_write_kb":2157996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":68608000,"data_stored":67661766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3794,"ondisk_log_size":3794,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":135,"num_read_kb":175817,"num_write":154,"num_write_kb":116354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":174730,"num_write":154,"num_write_kb":116354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509896,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":216920,"kb_used_data":18916,"kb_used_omap":1,"kb_used_meta":197758,"kb_avail":94154920,"statfs":{"total":96636764160,"available":96414638080,"internally_reserved":0,"allocated":19369984,"data_stored":17696805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":202504647},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509894,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280548,"kb_used_data":10580,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":94091292,"statfs":{"total":96636764160,"available":96349483008,"internally_reserved":0,"allocated":10833920,"data_stored":9216591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":276429253},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509893,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108884,"kb_used_data":19460,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94262956,"statfs":{"total":96636764160,"available":96525266944,"internally_reserved":0,"allocated":19927040,"data_stored":18233635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542598,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":229132,"kb_used_data":9124,"kb_used_omap":1,"kb_used_meta":219902,"kb_avail":94142708,"statfs":{"total":96636764160,"available":96402132992,"internally_reserved":0,"allocated":9342976,"data_stored":7745589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":225180106},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542598,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89460,"kb_used_data":8036,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94282380,"statfs":{"total":96636764160,"available":96545157120,"internally_reserved":0,"allocated":8228864,"data_stored":6610205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":83032518},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542600,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":252272,"kb_used_data":8640,"kb_used_omap":1,"kb_used_meta":243518,"kb_avail":94119568,"statfs":{"total":96636764160,"available":96378437632,"internally_reserved":0,"allocated":8847360,"data_stored":7201151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":249362885},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542599,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":189380,"kb_used_data":9608,"kb_used_omap":1,"kb_used_meta":179646,"kb_avail":94182460,"statfs":{"total":96636764160,"available":96442839040,"internally_reserved":0,"allocated":9838592,"data_stored":8236289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":183957957},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575302,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127856,"kb_used_data":11868,"kb_used_omap":1,"kb_used_meta":115838,"kb_avail":94243984,"statfs":{"total":96636764160,"available":96505839616,"internally_reserved":0,"allocated":12152832,"data_stored":10503839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":118618565},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16318464,"data_stored":16157858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6668288,"data_stored":6553434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8556544,"data_stored":8428200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15777792,"data_stored":15622768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6250496,"data_stored":6160671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4653056,"data_stored":4535149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4632576,"data_stored":4535041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5750784,"data_stored":5668645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":5195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:22:58.100 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.100 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.100 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.100 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.101 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.101 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.101 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.101 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.101 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.101 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.101 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.101 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.101 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.102 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.102 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.102 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.102 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.102 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.102 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.102 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.102 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.102 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.103 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.103 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.103 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.103 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.103 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.103 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.103 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.103 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.103 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.104 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.104 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.104 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.104 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.104 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.104 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.104 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.104 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.104 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.105 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.105 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.105 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.105 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.105 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.105 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.105 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.105 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.105 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.105 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.106 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.106 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.106 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.106 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.106 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.106 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.106 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.106 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.106 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.107 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.107 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.107 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.107 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.107 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.107 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.107 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.107 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.107 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.107 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.108 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.108 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.108 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.108 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.108 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.108 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.108 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.108 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.108 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.109 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.109 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.109 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.109 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.109 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.109 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.109 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.109 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.109 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.109 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.110 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.110 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.110 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.110 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.110 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.110 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.110 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.110 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.110 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.111 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.111 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.111 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.111 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.111 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.111 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.111 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.111 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.111 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.111 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.112 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.112 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.112 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.112 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.112 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.112 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.112 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.112 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.112 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.113 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.113 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.113 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.113 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.113 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.113 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.113 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.113 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.113 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.113 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.114 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.114 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.114 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.114 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.114 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.114 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.114 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.114 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.114 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.115 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.115 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.115 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.115 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.115 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.115 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.115 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.115 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.115 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.115 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.116 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.116 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.116 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.116 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.116 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.116 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.116 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.116 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.116 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.117 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.117 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.117 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.117 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.117 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.117 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-14T10:45:46.700380+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.117 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.117 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.117 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.118 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.118 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.118 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-14T10:45:46.700380+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.118 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.118 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.118 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.118 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.118 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.118 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-14T10:45:46.700380+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.118 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.119 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.119 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.119 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.119 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-14T10:45:46.700380+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.119 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.119 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.119 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.119 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.119 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-14T10:45:46.700380+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.120 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.120 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.120 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.120 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.120 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.120 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-14T10:45:46.700380+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.120 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.120 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.120 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.120 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.121 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.121 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-14T10:45:46.700380+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.121 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.121 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.121 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.121 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.121 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-14T10:45:46.700380+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.121 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.121 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.122 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.122 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.122 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.122 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-14T10:45:46.700380+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.122 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.122 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.122 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.122 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.122 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.123 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-14T10:45:46.700380+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.123 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.123 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.123 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.123 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.123 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.123 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-14T10:45:46.700380+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.123 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.123 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.123 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.124 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.124 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.124 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-14T10:45:46.700380+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.124 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.124 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.124 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.124 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.124 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-14T10:45:32.551765+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.124 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.125 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-14T10:45:46.700380+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.125 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.125 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.125 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.125 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.125 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-14T10:45:32.551765+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.125 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.125 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-14T10:45:46.700380+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.125 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.126 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.126 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.126 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.126 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-14T10:45:32.551765+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.126 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.126 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-14T10:45:46.700380+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.126 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.126 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.126 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.126 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.127 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.127 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-14T10:45:46.700380+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.127 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.127 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.127 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.127 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.127 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.127 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-14T10:45:32.551765+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.127 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-14T10:45:46.700380+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.128 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.128 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.128 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.128 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.128 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.128 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-14T10:45:32.551765+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.128 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-14T10:45:46.700380+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.128 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.128 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.129 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.129 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.129 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.129 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-14T10:45:32.551765+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.129 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-14T10:45:46.700380+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.129 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.129 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.129 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.129 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.130 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.130 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-14T10:45:32.551765+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=32, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.130 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-14T10:45:46.700380+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.130 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.130 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.130 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.130 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.130 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.130 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.130 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-14T10:45:46.700380+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.131 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.131 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.131 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.131 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.131 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-14T10:45:46.700380+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.131 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.131 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.131 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.131 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.132 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.132 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-14T10:45:46.700380+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.132 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.132 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.132 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.132 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.132 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.132 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-14T10:45:46.700380+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.132 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.133 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.133 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.133 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.133 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-14T10:45:46.700380+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.133 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.133 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.133 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.133 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.133 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.133 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-14T10:45:46.700380+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.134 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.134 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.134 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.134 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.134 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.134 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-14T10:45:46.700380+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.134 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.134 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.134 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.135 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.135 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.135 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-14T10:45:46.700380+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.135 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.135 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.135 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.135 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.135 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.135 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-14T10:45:46.700380+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.135 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.136 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.136 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.136 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.136 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.136 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-14T10:45:46.700380+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.136 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.136 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.136 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.136 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.137 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.137 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-14T10:45:46.700380+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.137 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.137 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.137 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.137 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.137 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.137 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-14T10:45:46.700380+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.137 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.138 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.138 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.138 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.138 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.138 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.138 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.138 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.138 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.138 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.138 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.139 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.139 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.139 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.139 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.139 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.139 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.139 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.139 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.139 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.139 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.140 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.140 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.140 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.140 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.140 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.140 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.140 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.140 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.140 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.141 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.141 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.141 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.141 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.141 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.141 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.141 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-14T10:45:42.651602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.141 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:22:58.141 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T11:23:18.142 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:23:18.477 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:23:18.488 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-09-14T11:23:18.490 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":1389,"stamp":"2024-09-14T11:23:17.767721+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":35991604,"num_objects":734,"num_object_clones":0,"num_object_copies":1468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":734,"num_whiteouts":0,"num_read":309464,"num_read_kb":2752545,"num_write":164025,"num_write_kb":2428992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":190,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":585191,"num_omap_keys":1372,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13829,"ondisk_log_size":13829,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1485160,"kb_used_data":96232,"kb_used_omap":12,"kb_used_meta":1388787,"kb_avail":753489560,"statfs":{"total":773094113280,"available":771573309440,"internally_reserved":0,"allocated":98541568,"data_stored":85444104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1422118448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":584759,"num_omap_keys":1370,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005129"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:12.205144+0000","last_change":"2024-09-14T11:11:42.593208+0000","last_active":"2024-09-14T11:19:12.205144+0000","last_peered":"2024-09-14T11:19:12.205144+0000","last_clean":"2024-09-14T11:19:12.205144+0000","last_became_active":"2024-09-14T11:11:42.592933+0000","last_became_peered":"2024-09-14T11:11:42.592933+0000","last_unstale":"2024-09-14T11:19:12.205144+0000","last_undegraded":"2024-09-14T11:19:12.205144+0000","last_fullsized":"2024-09-14T11:19:12.205144+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:50.427016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"260'2","reported_seq":31,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.128574+0000","last_change":"2024-09-14T11:01:23.882191+0000","last_active":"2024-09-14T11:21:27.128574+0000","last_peered":"2024-09-14T11:21:27.128574+0000","last_clean":"2024-09-14T11:21:27.128574+0000","last_became_active":"2024-09-14T11:01:23.881902+0000","last_became_peered":"2024-09-14T11:01:23.881902+0000","last_unstale":"2024-09-14T11:21:27.128574+0000","last_undegraded":"2024-09-14T11:21:27.128574+0000","last_fullsized":"2024-09-14T11:21:27.128574+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:46.612242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"260'8","reported_seq":51,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:21.007496+0000","last_change":"2024-09-14T11:01:20.867414+0000","last_active":"2024-09-14T11:21:21.007496+0000","last_peered":"2024-09-14T11:21:21.007496+0000","last_clean":"2024-09-14T11:21:21.007496+0000","last_became_active":"2024-09-14T11:01:20.867142+0000","last_became_peered":"2024-09-14T11:01:20.867142+0000","last_unstale":"2024-09-14T11:21:21.007496+0000","last_undegraded":"2024-09-14T11:21:21.007496+0000","last_fullsized":"2024-09-14T11:21:21.007496+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:51.245462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20482,"num_write":18,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"260'30","reported_seq":123,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:41.126104+0000","last_change":"2024-09-14T10:59:48.417565+0000","last_active":"2024-09-14T11:20:41.126104+0000","last_peered":"2024-09-14T11:20:41.126104+0000","last_clean":"2024-09-14T11:20:41.126104+0000","last_became_active":"2024-09-14T10:59:48.416537+0000","last_became_peered":"2024-09-14T10:59:48.416537+0000","last_unstale":"2024-09-14T11:20:41.126104+0000","last_undegraded":"2024-09-14T11:20:41.126104+0000","last_fullsized":"2024-09-14T11:20:41.126104+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:15.136259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":249,"num_read_kb":173,"num_write":73,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:15.984097+0000","last_change":"2024-09-14T11:11:42.588136+0000","last_active":"2024-09-14T11:19:15.984097+0000","last_peered":"2024-09-14T11:19:15.984097+0000","last_clean":"2024-09-14T11:19:15.984097+0000","last_became_active":"2024-09-14T11:11:42.587818+0000","last_became_peered":"2024-09-14T11:11:42.587818+0000","last_unstale":"2024-09-14T11:19:15.984097+0000","last_undegraded":"2024-09-14T11:19:15.984097+0000","last_fullsized":"2024-09-14T11:19:15.984097+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:37.528920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"260'2","reported_seq":30,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:25.002242+0000","last_change":"2024-09-14T11:01:23.881376+0000","last_active":"2024-09-14T11:21:25.002242+0000","last_peered":"2024-09-14T11:21:25.002242+0000","last_clean":"2024-09-14T11:21:25.002242+0000","last_became_active":"2024-09-14T11:01:23.881074+0000","last_became_peered":"2024-09-14T11:01:23.881074+0000","last_unstale":"2024-09-14T11:21:25.002242+0000","last_undegraded":"2024-09-14T11:21:25.002242+0000","last_fullsized":"2024-09-14T11:21:25.002242+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:53.183326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":571,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"260'8","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:21.253973+0000","last_change":"2024-09-14T11:01:20.868669+0000","last_active":"2024-09-14T11:21:21.253973+0000","last_peered":"2024-09-14T11:21:21.253973+0000","last_clean":"2024-09-14T11:21:21.253973+0000","last_became_active":"2024-09-14T11:01:20.868373+0000","last_became_peered":"2024-09-14T11:01:20.868373+0000","last_unstale":"2024-09-14T11:21:21.253973+0000","last_undegraded":"2024-09-14T11:21:21.253973+0000","last_fullsized":"2024-09-14T11:21:21.253973+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:33:49.244253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10811,"num_write":13,"num_write_kb":10811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"260'56","reported_seq":195,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:56.120455+0000","last_change":"2024-09-14T10:59:48.416508+0000","last_active":"2024-09-14T11:19:56.120455+0000","last_peered":"2024-09-14T11:19:56.120455+0000","last_clean":"2024-09-14T11:19:56.120455+0000","last_became_active":"2024-09-14T10:59:48.416222+0000","last_became_peered":"2024-09-14T10:59:48.416222+0000","last_unstale":"2024-09-14T11:19:56.120455+0000","last_undegraded":"2024-09-14T11:19:56.120455+0000","last_fullsized":"2024-09-14T11:19:56.120455+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:30.061341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":447,"num_read_kb":304,"num_write":135,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:57.106315+0000","last_change":"2024-09-14T11:11:42.593589+0000","last_active":"2024-09-14T11:18:57.106315+0000","last_peered":"2024-09-14T11:18:57.106315+0000","last_clean":"2024-09-14T11:18:57.106315+0000","last_became_active":"2024-09-14T11:11:42.593314+0000","last_became_peered":"2024-09-14T11:11:42.593314+0000","last_unstale":"2024-09-14T11:18:57.106315+0000","last_undegraded":"2024-09-14T11:18:57.106315+0000","last_fullsized":"2024-09-14T11:18:57.106315+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:49.061960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"260'3","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:16.262309+0000","last_change":"2024-09-14T11:01:23.893105+0000","last_active":"2024-09-14T11:22:16.262309+0000","last_peered":"2024-09-14T11:22:16.262309+0000","last_clean":"2024-09-14T11:22:16.262309+0000","last_became_active":"2024-09-14T11:01:23.892846+0000","last_became_peered":"2024-09-14T11:01:23.892846+0000","last_unstale":"2024-09-14T11:22:16.262309+0000","last_undegraded":"2024-09-14T11:22:16.262309+0000","last_fullsized":"2024-09-14T11:22:16.262309+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:50.339780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"260'2","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:26.008205+0000","last_change":"2024-09-14T11:01:20.864944+0000","last_active":"2024-09-14T11:21:26.008205+0000","last_peered":"2024-09-14T11:21:26.008205+0000","last_clean":"2024-09-14T11:21:26.008205+0000","last_became_active":"2024-09-14T11:01:20.864672+0000","last_became_peered":"2024-09-14T11:01:20.864672+0000","last_unstale":"2024-09-14T11:21:26.008205+0000","last_undegraded":"2024-09-14T11:21:26.008205+0000","last_fullsized":"2024-09-14T11:21:26.008205+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:06.369402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"260'48","reported_seq":168,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:50.988603+0000","last_change":"2024-09-14T10:59:48.419842+0000","last_active":"2024-09-14T11:19:50.988603+0000","last_peered":"2024-09-14T11:19:50.988603+0000","last_clean":"2024-09-14T11:19:50.988603+0000","last_became_active":"2024-09-14T10:59:48.419525+0000","last_became_peered":"2024-09-14T10:59:48.419525+0000","last_unstale":"2024-09-14T11:19:50.988603+0000","last_undegraded":"2024-09-14T11:19:50.988603+0000","last_fullsized":"2024-09-14T11:19:50.988603+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:04.024597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":364,"num_read_kb":247,"num_write":125,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:01.233674+0000","last_change":"2024-09-14T11:11:42.587584+0000","last_active":"2024-09-14T11:19:01.233674+0000","last_peered":"2024-09-14T11:19:01.233674+0000","last_clean":"2024-09-14T11:19:01.233674+0000","last_became_active":"2024-09-14T11:11:42.587218+0000","last_became_peered":"2024-09-14T11:11:42.587218+0000","last_unstale":"2024-09-14T11:19:01.233674+0000","last_undegraded":"2024-09-14T11:19:01.233674+0000","last_fullsized":"2024-09-14T11:19:01.233674+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:55.734324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"260'2","reported_seq":33,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:26.254717+0000","last_change":"2024-09-14T11:01:23.887367+0000","last_active":"2024-09-14T11:21:26.254717+0000","last_peered":"2024-09-14T11:21:26.254717+0000","last_clean":"2024-09-14T11:21:26.254717+0000","last_became_active":"2024-09-14T11:01:23.886771+0000","last_became_peered":"2024-09-14T11:01:23.886771+0000","last_unstale":"2024-09-14T11:21:26.254717+0000","last_undegraded":"2024-09-14T11:21:26.254717+0000","last_fullsized":"2024-09-14T11:21:26.254717+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:15.920702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":118,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"257'5","reported_seq":50,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:07.117403+0000","last_change":"2024-09-14T11:01:20.862128+0000","last_active":"2024-09-14T11:20:07.117403+0000","last_peered":"2024-09-14T11:20:07.117403+0000","last_clean":"2024-09-14T11:20:07.117403+0000","last_became_active":"2024-09-14T11:01:20.861799+0000","last_became_peered":"2024-09-14T11:01:20.861799+0000","last_unstale":"2024-09-14T11:20:07.117403+0000","last_undegraded":"2024-09-14T11:20:07.117403+0000","last_fullsized":"2024-09-14T11:20:07.117403+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:16.963059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"260'15","reported_seq":77,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:50.988580+0000","last_change":"2024-09-14T10:59:48.411700+0000","last_active":"2024-09-14T11:19:50.988580+0000","last_peered":"2024-09-14T11:19:50.988580+0000","last_clean":"2024-09-14T11:19:50.988580+0000","last_became_active":"2024-09-14T10:59:48.411423+0000","last_became_peered":"2024-09-14T10:59:48.411423+0000","last_unstale":"2024-09-14T11:19:50.988580+0000","last_undegraded":"2024-09-14T11:19:50.988580+0000","last_fullsized":"2024-09-14T11:19:50.988580+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:56.473790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":68,"num_write":41,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:50.995962+0000","last_change":"2024-09-14T11:11:42.584008+0000","last_active":"2024-09-14T11:19:50.995962+0000","last_peered":"2024-09-14T11:19:50.995962+0000","last_clean":"2024-09-14T11:19:50.995962+0000","last_became_active":"2024-09-14T11:11:42.583717+0000","last_became_peered":"2024-09-14T11:11:42.583717+0000","last_unstale":"2024-09-14T11:19:50.995962+0000","last_undegraded":"2024-09-14T11:19:50.995962+0000","last_fullsized":"2024-09-14T11:19:50.995962+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:22:54.043934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"257'3","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:47.217246+0000","last_change":"2024-09-14T11:01:23.894300+0000","last_active":"2024-09-14T11:20:47.217246+0000","last_peered":"2024-09-14T11:20:47.217246+0000","last_clean":"2024-09-14T11:20:47.217246+0000","last_became_active":"2024-09-14T11:01:23.894107+0000","last_became_peered":"2024-09-14T11:01:23.894107+0000","last_unstale":"2024-09-14T11:20:47.217246+0000","last_undegraded":"2024-09-14T11:20:47.217246+0000","last_fullsized":"2024-09-14T11:20:47.217246+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"260'6","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.881916+0000","last_change":"2024-09-14T11:01:20.868842+0000","last_active":"2024-09-14T11:22:50.881916+0000","last_peered":"2024-09-14T11:22:50.881916+0000","last_clean":"2024-09-14T11:22:50.881916+0000","last_became_active":"2024-09-14T11:01:20.867768+0000","last_became_peered":"2024-09-14T11:01:20.867768+0000","last_unstale":"2024-09-14T11:22:50.881916+0000","last_undegraded":"2024-09-14T11:22:50.881916+0000","last_fullsized":"2024-09-14T11:22:50.881916+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"260'40","reported_seq":146,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:50.988519+0000","last_change":"2024-09-14T10:59:48.413952+0000","last_active":"2024-09-14T11:19:50.988519+0000","last_peered":"2024-09-14T11:19:50.988519+0000","last_clean":"2024-09-14T11:19:50.988519+0000","last_became_active":"2024-09-14T10:59:48.413296+0000","last_became_peered":"2024-09-14T10:59:48.413296+0000","last_unstale":"2024-09-14T11:19:50.988519+0000","last_undegraded":"2024-09-14T11:19:50.988519+0000","last_fullsized":"2024-09-14T11:19:50.988519+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:50.801079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":304,"num_read_kb":193,"num_write":101,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:06.121565+0000","last_change":"2024-09-14T11:11:42.582601+0000","last_active":"2024-09-14T11:20:06.121565+0000","last_peered":"2024-09-14T11:20:06.121565+0000","last_clean":"2024-09-14T11:20:06.121565+0000","last_became_active":"2024-09-14T11:11:42.582310+0000","last_became_peered":"2024-09-14T11:11:42.582310+0000","last_unstale":"2024-09-14T11:20:06.121565+0000","last_undegraded":"2024-09-14T11:20:06.121565+0000","last_fullsized":"2024-09-14T11:20:06.121565+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:47:53.329342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"260'8","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.421223+0000","last_change":"2024-09-14T11:01:23.888252+0000","last_active":"2024-09-14T11:22:50.421223+0000","last_peered":"2024-09-14T11:22:50.421223+0000","last_clean":"2024-09-14T11:22:50.421223+0000","last_became_active":"2024-09-14T11:01:23.888017+0000","last_became_peered":"2024-09-14T11:01:23.888017+0000","last_unstale":"2024-09-14T11:22:50.421223+0000","last_undegraded":"2024-09-14T11:22:50.421223+0000","last_fullsized":"2024-09-14T11:22:50.421223+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":11264,"num_write":18,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"257'2","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:47.123474+0000","last_change":"2024-09-14T11:01:20.863609+0000","last_active":"2024-09-14T11:20:47.123474+0000","last_peered":"2024-09-14T11:20:47.123474+0000","last_clean":"2024-09-14T11:20:47.123474+0000","last_became_active":"2024-09-14T11:01:20.863258+0000","last_became_peered":"2024-09-14T11:01:20.863258+0000","last_unstale":"2024-09-14T11:20:47.123474+0000","last_undegraded":"2024-09-14T11:20:47.123474+0000","last_fullsized":"2024-09-14T11:20:47.123474+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"260'62","reported_seq":215,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:18.893367+0000","last_change":"2024-09-14T10:59:48.420297+0000","last_active":"2024-09-14T11:20:18.893367+0000","last_peered":"2024-09-14T11:20:18.893367+0000","last_clean":"2024-09-14T11:20:18.893367+0000","last_became_active":"2024-09-14T10:59:48.419994+0000","last_became_peered":"2024-09-14T10:59:48.419994+0000","last_unstale":"2024-09-14T11:20:18.893367+0000","last_undegraded":"2024-09-14T11:20:18.893367+0000","last_fullsized":"2024-09-14T11:20:18.893367+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:48.789488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":520,"num_read_kb":329,"num_write":161,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"260'1","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:14.986121+0000","last_change":"2024-09-14T11:11:42.588572+0000","last_active":"2024-09-14T11:19:14.986121+0000","last_peered":"2024-09-14T11:19:14.986121+0000","last_clean":"2024-09-14T11:19:14.986121+0000","last_became_active":"2024-09-14T11:11:42.588308+0000","last_became_peered":"2024-09-14T11:11:42.588308+0000","last_unstale":"2024-09-14T11:19:14.986121+0000","last_undegraded":"2024-09-14T11:19:14.986121+0000","last_fullsized":"2024-09-14T11:19:14.986121+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:38:16.020344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:54.982805+0000","last_change":"2024-09-14T11:01:23.884550+0000","last_active":"2024-09-14T11:18:54.982805+0000","last_peered":"2024-09-14T11:18:54.982805+0000","last_clean":"2024-09-14T11:18:54.982805+0000","last_became_active":"2024-09-14T11:01:23.884138+0000","last_became_peered":"2024-09-14T11:01:23.884138+0000","last_unstale":"2024-09-14T11:18:54.982805+0000","last_undegraded":"2024-09-14T11:18:54.982805+0000","last_fullsized":"2024-09-14T11:18:54.982805+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:10.655429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":33,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:52.202212+0000","last_change":"2024-09-14T11:01:20.855022+0000","last_active":"2024-09-14T11:18:52.202212+0000","last_peered":"2024-09-14T11:18:52.202212+0000","last_clean":"2024-09-14T11:18:52.202212+0000","last_became_active":"2024-09-14T11:01:20.854737+0000","last_became_peered":"2024-09-14T11:01:20.854737+0000","last_unstale":"2024-09-14T11:18:52.202212+0000","last_undegraded":"2024-09-14T11:18:52.202212+0000","last_fullsized":"2024-09-14T11:18:52.202212+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:43.045693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"260'45","reported_seq":163,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:20.991333+0000","last_change":"2024-09-14T10:59:48.420289+0000","last_active":"2024-09-14T11:19:20.991333+0000","last_peered":"2024-09-14T11:19:20.991333+0000","last_clean":"2024-09-14T11:19:20.991333+0000","last_became_active":"2024-09-14T10:59:48.419091+0000","last_became_peered":"2024-09-14T10:59:48.419091+0000","last_unstale":"2024-09-14T11:19:20.991333+0000","last_undegraded":"2024-09-14T11:19:20.991333+0000","last_fullsized":"2024-09-14T11:19:20.991333+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:35.387602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":368,"num_read_kb":243,"num_write":109,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:12.205201+0000","last_change":"2024-09-14T11:11:42.583176+0000","last_active":"2024-09-14T11:19:12.205201+0000","last_peered":"2024-09-14T11:19:12.205201+0000","last_clean":"2024-09-14T11:19:12.205201+0000","last_became_active":"2024-09-14T11:11:42.582899+0000","last_became_peered":"2024-09-14T11:11:42.582899+0000","last_unstale":"2024-09-14T11:19:12.205201+0000","last_undegraded":"2024-09-14T11:19:12.205201+0000","last_fullsized":"2024-09-14T11:19:12.205201+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:00.902463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:55.987589+0000","last_change":"2024-09-14T11:01:23.895643+0000","last_active":"2024-09-14T11:18:55.987589+0000","last_peered":"2024-09-14T11:18:55.987589+0000","last_clean":"2024-09-14T11:18:55.987589+0000","last_became_active":"2024-09-14T11:01:23.894587+0000","last_became_peered":"2024-09-14T11:01:23.894587+0000","last_unstale":"2024-09-14T11:18:55.987589+0000","last_undegraded":"2024-09-14T11:18:55.987589+0000","last_fullsized":"2024-09-14T11:18:55.987589+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:29.534046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"260'3","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:20.999394+0000","last_change":"2024-09-14T11:01:20.869542+0000","last_active":"2024-09-14T11:21:20.999394+0000","last_peered":"2024-09-14T11:21:20.999394+0000","last_clean":"2024-09-14T11:21:20.999394+0000","last_became_active":"2024-09-14T11:01:20.869244+0000","last_became_peered":"2024-09-14T11:01:20.869244+0000","last_unstale":"2024-09-14T11:21:20.999394+0000","last_undegraded":"2024-09-14T11:21:20.999394+0000","last_fullsized":"2024-09-14T11:21:20.999394+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:58.638874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"260'35","reported_seq":137,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:58.204964+0000","last_change":"2024-09-14T10:59:48.414261+0000","last_active":"2024-09-14T11:20:58.204964+0000","last_peered":"2024-09-14T11:20:58.204964+0000","last_clean":"2024-09-14T11:20:58.204964+0000","last_became_active":"2024-09-14T10:59:48.414023+0000","last_became_peered":"2024-09-14T10:59:48.414023+0000","last_unstale":"2024-09-14T11:20:58.204964+0000","last_undegraded":"2024-09-14T11:20:58.204964+0000","last_fullsized":"2024-09-14T11:20:58.204964+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:32.125339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":284,"num_read_kb":189,"num_write":86,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:46.231489+0000","last_change":"2024-09-14T11:11:42.592957+0000","last_active":"2024-09-14T11:18:46.231489+0000","last_peered":"2024-09-14T11:18:46.231489+0000","last_clean":"2024-09-14T11:18:46.231489+0000","last_became_active":"2024-09-14T11:11:42.592439+0000","last_became_peered":"2024-09-14T11:11:42.592439+0000","last_unstale":"2024-09-14T11:18:46.231489+0000","last_undegraded":"2024-09-14T11:18:46.231489+0000","last_fullsized":"2024-09-14T11:18:46.231489+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:56:15.581964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"257'3","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:46.003045+0000","last_change":"2024-09-14T11:01:23.892350+0000","last_active":"2024-09-14T11:20:46.003045+0000","last_peered":"2024-09-14T11:20:46.003045+0000","last_clean":"2024-09-14T11:20:46.003045+0000","last_became_active":"2024-09-14T11:01:23.891631+0000","last_became_peered":"2024-09-14T11:01:23.891631+0000","last_unstale":"2024-09-14T11:20:46.003045+0000","last_undegraded":"2024-09-14T11:20:46.003045+0000","last_fullsized":"2024-09-14T11:20:46.003045+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"260'11","reported_seq":55,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.352736+0000","last_change":"2024-09-14T11:01:20.861317+0000","last_active":"2024-09-14T11:22:51.352736+0000","last_peered":"2024-09-14T11:22:51.352736+0000","last_clean":"2024-09-14T11:22:51.352736+0000","last_became_active":"2024-09-14T11:01:20.861043+0000","last_became_peered":"2024-09-14T11:01:20.861043+0000","last_unstale":"2024-09-14T11:22:51.352736+0000","last_undegraded":"2024-09-14T11:22:51.352736+0000","last_fullsized":"2024-09-14T11:22:51.352736+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:42.808761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":17410,"num_write":21,"num_write_kb":12290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"260'250","reported_seq":795,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:11.113999+0000","last_change":"2024-09-14T10:59:48.417407+0000","last_active":"2024-09-14T11:19:11.113999+0000","last_peered":"2024-09-14T11:19:11.113999+0000","last_clean":"2024-09-14T11:19:11.113999+0000","last_became_active":"2024-09-14T10:59:48.416342+0000","last_became_peered":"2024-09-14T10:59:48.416342+0000","last_unstale":"2024-09-14T11:19:11.113999+0000","last_undegraded":"2024-09-14T11:19:11.113999+0000","last_fullsized":"2024-09-14T11:19:11.113999+0000","mapping_epoch":249,"log_start":"257'200","ondisk_log_start":"257'200","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:56:03.687626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2428,"num_read_kb":2819,"num_write":491,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"260'1","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:45.979906+0000","last_change":"2024-09-14T11:11:42.588570+0000","last_active":"2024-09-14T11:18:45.979906+0000","last_peered":"2024-09-14T11:18:45.979906+0000","last_clean":"2024-09-14T11:18:45.979906+0000","last_became_active":"2024-09-14T11:11:42.587835+0000","last_became_peered":"2024-09-14T11:11:42.587835+0000","last_unstale":"2024-09-14T11:18:45.979906+0000","last_undegraded":"2024-09-14T11:18:45.979906+0000","last_fullsized":"2024-09-14T11:18:45.979906+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:05.008377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"260'3","reported_seq":33,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:26.263799+0000","last_change":"2024-09-14T11:01:23.895555+0000","last_active":"2024-09-14T11:22:26.263799+0000","last_peered":"2024-09-14T11:22:26.263799+0000","last_clean":"2024-09-14T11:22:26.263799+0000","last_became_active":"2024-09-14T11:01:23.892735+0000","last_became_peered":"2024-09-14T11:01:23.892735+0000","last_unstale":"2024-09-14T11:22:26.263799+0000","last_undegraded":"2024-09-14T11:22:26.263799+0000","last_fullsized":"2024-09-14T11:22:26.263799+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:20.552471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"260'4","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.351671+0000","last_change":"2024-09-14T11:01:20.860826+0000","last_active":"2024-09-14T11:22:51.351671+0000","last_peered":"2024-09-14T11:22:51.351671+0000","last_clean":"2024-09-14T11:22:51.351671+0000","last_became_active":"2024-09-14T11:01:20.860541+0000","last_became_peered":"2024-09-14T11:01:20.860541+0000","last_unstale":"2024-09-14T11:22:51.351671+0000","last_undegraded":"2024-09-14T11:22:51.351671+0000","last_fullsized":"2024-09-14T11:22:51.351671+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":61,"num_write":4,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"260'12","reported_seq":76,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:11.113972+0000","last_change":"2024-09-14T10:59:48.417263+0000","last_active":"2024-09-14T11:19:11.113972+0000","last_peered":"2024-09-14T11:19:11.113972+0000","last_clean":"2024-09-14T11:19:11.113972+0000","last_became_active":"2024-09-14T10:59:48.417001+0000","last_became_peered":"2024-09-14T10:59:48.417001+0000","last_unstale":"2024-09-14T11:19:11.113972+0000","last_undegraded":"2024-09-14T11:19:11.113972+0000","last_fullsized":"2024-09-14T11:19:11.113972+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:24.272836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":70,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:44.981269+0000","last_change":"2024-09-14T11:11:42.594143+0000","last_active":"2024-09-14T11:18:44.981269+0000","last_peered":"2024-09-14T11:18:44.981269+0000","last_clean":"2024-09-14T11:18:44.981269+0000","last_became_active":"2024-09-14T11:11:42.593873+0000","last_became_peered":"2024-09-14T11:11:42.593873+0000","last_unstale":"2024-09-14T11:18:44.981269+0000","last_undegraded":"2024-09-14T11:18:44.981269+0000","last_fullsized":"2024-09-14T11:18:44.981269+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:38.408015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:46.003098+0000","last_change":"2024-09-14T11:01:23.897460+0000","last_active":"2024-09-14T11:20:46.003098+0000","last_peered":"2024-09-14T11:20:46.003098+0000","last_clean":"2024-09-14T11:20:46.003098+0000","last_became_active":"2024-09-14T11:01:23.897154+0000","last_became_peered":"2024-09-14T11:01:23.897154+0000","last_unstale":"2024-09-14T11:20:46.003098+0000","last_undegraded":"2024-09-14T11:20:46.003098+0000","last_fullsized":"2024-09-14T11:20:46.003098+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"260'2","reported_seq":37,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.386599+0000","last_change":"2024-09-14T11:01:20.868430+0000","last_active":"2024-09-14T11:22:50.386599+0000","last_peered":"2024-09-14T11:22:50.386599+0000","last_clean":"2024-09-14T11:22:50.386599+0000","last_became_active":"2024-09-14T11:01:20.868135+0000","last_became_peered":"2024-09-14T11:01:20.868135+0000","last_unstale":"2024-09-14T11:22:50.386599+0000","last_undegraded":"2024-09-14T11:22:50.386599+0000","last_fullsized":"2024-09-14T11:22:50.386599+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"260'27","reported_seq":113,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:18.260492+0000","last_change":"2024-09-14T10:59:48.415592+0000","last_active":"2024-09-14T11:20:18.260492+0000","last_peered":"2024-09-14T11:20:18.260492+0000","last_clean":"2024-09-14T11:20:18.260492+0000","last_became_active":"2024-09-14T10:59:48.415324+0000","last_became_peered":"2024-09-14T10:59:48.415324+0000","last_unstale":"2024-09-14T11:20:18.260492+0000","last_undegraded":"2024-09-14T11:20:18.260492+0000","last_fullsized":"2024-09-14T11:20:18.260492+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:36:02.358205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":136,"num_write":70,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:42.200860+0000","last_change":"2024-09-14T11:11:42.592101+0000","last_active":"2024-09-14T11:18:42.200860+0000","last_peered":"2024-09-14T11:18:42.200860+0000","last_clean":"2024-09-14T11:18:42.200860+0000","last_became_active":"2024-09-14T11:11:42.591815+0000","last_became_peered":"2024-09-14T11:11:42.591815+0000","last_unstale":"2024-09-14T11:18:42.200860+0000","last_undegraded":"2024-09-14T11:18:42.200860+0000","last_fullsized":"2024-09-14T11:18:42.200860+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:44:10.362312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"260'3","reported_seq":35,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.097790+0000","last_change":"2024-09-14T11:01:23.884051+0000","last_active":"2024-09-14T11:22:51.097790+0000","last_peered":"2024-09-14T11:22:51.097790+0000","last_clean":"2024-09-14T11:22:51.097790+0000","last_became_active":"2024-09-14T11:01:23.883763+0000","last_became_peered":"2024-09-14T11:01:23.883763+0000","last_unstale":"2024-09-14T11:22:51.097790+0000","last_undegraded":"2024-09-14T11:22:51.097790+0000","last_fullsized":"2024-09-14T11:22:51.097790+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"260'5","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.419036+0000","last_change":"2024-09-14T11:01:20.867156+0000","last_active":"2024-09-14T11:22:51.419036+0000","last_peered":"2024-09-14T11:22:51.419036+0000","last_clean":"2024-09-14T11:22:51.419036+0000","last_became_active":"2024-09-14T11:01:20.866642+0000","last_became_peered":"2024-09-14T11:01:20.866642+0000","last_unstale":"2024-09-14T11:22:51.419036+0000","last_undegraded":"2024-09-14T11:22:51.419036+0000","last_fullsized":"2024-09-14T11:22:51.419036+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":13312,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"260'32","reported_seq":127,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:37.104014+0000","last_change":"2024-09-14T10:59:48.418606+0000","last_active":"2024-09-14T11:18:37.104014+0000","last_peered":"2024-09-14T11:18:37.104014+0000","last_clean":"2024-09-14T11:18:37.104014+0000","last_became_active":"2024-09-14T10:59:48.418305+0000","last_became_peered":"2024-09-14T10:59:48.418305+0000","last_unstale":"2024-09-14T11:18:37.104014+0000","last_undegraded":"2024-09-14T11:18:37.104014+0000","last_fullsized":"2024-09-14T11:18:37.104014+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:31:32.726408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":251,"num_read_kb":158,"num_write":84,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:01.233757+0000","last_change":"2024-09-14T11:11:42.588989+0000","last_active":"2024-09-14T11:19:01.233757+0000","last_peered":"2024-09-14T11:19:01.233757+0000","last_clean":"2024-09-14T11:19:01.233757+0000","last_became_active":"2024-09-14T11:11:42.588573+0000","last_became_peered":"2024-09-14T11:11:42.588573+0000","last_unstale":"2024-09-14T11:19:01.233757+0000","last_undegraded":"2024-09-14T11:19:01.233757+0000","last_fullsized":"2024-09-14T11:19:01.233757+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:44.929396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:06.243683+0000","last_change":"2024-09-14T11:01:23.895357+0000","last_active":"2024-09-14T11:20:06.243683+0000","last_peered":"2024-09-14T11:20:06.243683+0000","last_clean":"2024-09-14T11:20:06.243683+0000","last_became_active":"2024-09-14T11:01:23.894751+0000","last_became_peered":"2024-09-14T11:01:23.894751+0000","last_unstale":"2024-09-14T11:20:06.243683+0000","last_undegraded":"2024-09-14T11:20:06.243683+0000","last_fullsized":"2024-09-14T11:20:06.243683+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:22:05.395992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:02.116671+0000","last_change":"2024-09-14T11:01:20.867415+0000","last_active":"2024-09-14T11:20:02.116671+0000","last_peered":"2024-09-14T11:20:02.116671+0000","last_clean":"2024-09-14T11:20:02.116671+0000","last_became_active":"2024-09-14T11:01:20.866975+0000","last_became_peered":"2024-09-14T11:01:20.866975+0000","last_unstale":"2024-09-14T11:20:02.116671+0000","last_undegraded":"2024-09-14T11:20:02.116671+0000","last_fullsized":"2024-09-14T11:20:02.116671+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:47.822855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"260'17","reported_seq":83,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:52.124452+0000","last_change":"2024-09-14T10:59:48.421015+0000","last_active":"2024-09-14T11:20:52.124452+0000","last_peered":"2024-09-14T11:20:52.124452+0000","last_clean":"2024-09-14T11:20:52.124452+0000","last_became_active":"2024-09-14T10:59:48.420711+0000","last_became_peered":"2024-09-14T10:59:48.420711+0000","last_unstale":"2024-09-14T11:20:52.124452+0000","last_undegraded":"2024-09-14T11:20:52.124452+0000","last_fullsized":"2024-09-14T11:20:52.124452+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":78,"num_write":43,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:00.982102+0000","last_change":"2024-09-14T11:11:42.585332+0000","last_active":"2024-09-14T11:19:00.982102+0000","last_peered":"2024-09-14T11:19:00.982102+0000","last_clean":"2024-09-14T11:19:00.982102+0000","last_became_active":"2024-09-14T11:11:42.583965+0000","last_became_peered":"2024-09-14T11:11:42.583965+0000","last_unstale":"2024-09-14T11:19:00.982102+0000","last_undegraded":"2024-09-14T11:19:00.982102+0000","last_fullsized":"2024-09-14T11:19:00.982102+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:45:52.531506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"257'5","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:06.243650+0000","last_change":"2024-09-14T11:01:23.893658+0000","last_active":"2024-09-14T11:20:06.243650+0000","last_peered":"2024-09-14T11:20:06.243650+0000","last_clean":"2024-09-14T11:20:06.243650+0000","last_became_active":"2024-09-14T11:01:23.893365+0000","last_became_peered":"2024-09-14T11:01:23.893365+0000","last_unstale":"2024-09-14T11:20:06.243650+0000","last_undegraded":"2024-09-14T11:20:06.243650+0000","last_fullsized":"2024-09-14T11:20:06.243650+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:10:44.395112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"260'3","reported_seq":37,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:21.262930+0000","last_change":"2024-09-14T11:01:20.869472+0000","last_active":"2024-09-14T11:22:21.262930+0000","last_peered":"2024-09-14T11:22:21.262930+0000","last_clean":"2024-09-14T11:22:21.262930+0000","last_became_active":"2024-09-14T11:01:20.869209+0000","last_became_peered":"2024-09-14T11:01:20.869209+0000","last_unstale":"2024-09-14T11:22:21.262930+0000","last_undegraded":"2024-09-14T11:22:21.262930+0000","last_fullsized":"2024-09-14T11:22:21.262930+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:54.924564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"260'35","reported_seq":137,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:00.394172+0000","last_change":"2024-09-14T10:59:48.416424+0000","last_active":"2024-09-14T11:21:00.394172+0000","last_peered":"2024-09-14T11:21:00.394172+0000","last_clean":"2024-09-14T11:21:00.394172+0000","last_became_active":"2024-09-14T10:59:48.416149+0000","last_became_peered":"2024-09-14T10:59:48.416149+0000","last_unstale":"2024-09-14T11:21:00.394172+0000","last_undegraded":"2024-09-14T11:21:00.394172+0000","last_fullsized":"2024-09-14T11:21:00.394172+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":285,"num_read_kb":193,"num_write":82,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"259'1","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:46.110446+0000","last_change":"2024-09-14T11:11:42.584334+0000","last_active":"2024-09-14T11:18:46.110446+0000","last_peered":"2024-09-14T11:18:46.110446+0000","last_clean":"2024-09-14T11:18:46.110446+0000","last_became_active":"2024-09-14T11:11:42.583477+0000","last_became_peered":"2024-09-14T11:11:42.583477+0000","last_unstale":"2024-09-14T11:18:46.110446+0000","last_undegraded":"2024-09-14T11:18:46.110446+0000","last_fullsized":"2024-09-14T11:18:46.110446+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:34.189340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"260'8","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:26.017279+0000","last_change":"2024-09-14T11:01:23.891615+0000","last_active":"2024-09-14T11:22:26.017279+0000","last_peered":"2024-09-14T11:22:26.017279+0000","last_clean":"2024-09-14T11:22:26.017279+0000","last_became_active":"2024-09-14T11:01:23.891343+0000","last_became_peered":"2024-09-14T11:01:23.891343+0000","last_unstale":"2024-09-14T11:22:26.017279+0000","last_undegraded":"2024-09-14T11:22:26.017279+0000","last_fullsized":"2024-09-14T11:22:26.017279+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:37.853683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":15362,"num_write":13,"num_write_kb":10242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"260'3","reported_seq":39,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:22.135312+0000","last_change":"2024-09-14T11:01:20.862125+0000","last_active":"2024-09-14T11:22:22.135312+0000","last_peered":"2024-09-14T11:22:22.135312+0000","last_clean":"2024-09-14T11:22:22.135312+0000","last_became_active":"2024-09-14T11:01:20.861817+0000","last_became_peered":"2024-09-14T11:01:20.861817+0000","last_unstale":"2024-09-14T11:22:22.135312+0000","last_undegraded":"2024-09-14T11:22:22.135312+0000","last_fullsized":"2024-09-14T11:22:22.135312+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:55.520879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"260'106","reported_seq":362,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:49.998286+0000","last_change":"2024-09-14T10:59:48.418299+0000","last_active":"2024-09-14T11:20:49.998286+0000","last_peered":"2024-09-14T11:20:49.998286+0000","last_clean":"2024-09-14T11:20:49.998286+0000","last_became_active":"2024-09-14T10:59:48.418011+0000","last_became_peered":"2024-09-14T10:59:48.418011+0000","last_unstale":"2024-09-14T11:20:49.998286+0000","last_undegraded":"2024-09-14T11:20:49.998286+0000","last_fullsized":"2024-09-14T11:20:49.998286+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1045,"num_read_kb":858,"num_write":220,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"260'1","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:00.982068+0000","last_change":"2024-09-14T11:11:42.580964+0000","last_active":"2024-09-14T11:19:00.982068+0000","last_peered":"2024-09-14T11:19:00.982068+0000","last_clean":"2024-09-14T11:19:00.982068+0000","last_became_active":"2024-09-14T11:11:42.580611+0000","last_became_peered":"2024-09-14T11:11:42.580611+0000","last_unstale":"2024-09-14T11:19:00.982068+0000","last_undegraded":"2024-09-14T11:19:00.982068+0000","last_fullsized":"2024-09-14T11:19:00.982068+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:24.715816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:07.117668+0000","last_change":"2024-09-14T11:01:23.886701+0000","last_active":"2024-09-14T11:20:07.117668+0000","last_peered":"2024-09-14T11:20:07.117668+0000","last_clean":"2024-09-14T11:20:07.117668+0000","last_became_active":"2024-09-14T11:01:23.886496+0000","last_became_peered":"2024-09-14T11:01:23.886496+0000","last_unstale":"2024-09-14T11:20:07.117668+0000","last_undegraded":"2024-09-14T11:20:07.117668+0000","last_fullsized":"2024-09-14T11:20:07.117668+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:46.277781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"257'3","reported_seq":40,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:02.116770+0000","last_change":"2024-09-14T11:01:20.863982+0000","last_active":"2024-09-14T11:20:02.116770+0000","last_peered":"2024-09-14T11:20:02.116770+0000","last_clean":"2024-09-14T11:20:02.116770+0000","last_became_active":"2024-09-14T11:01:20.863707+0000","last_became_peered":"2024-09-14T11:01:20.863707+0000","last_unstale":"2024-09-14T11:20:02.116770+0000","last_undegraded":"2024-09-14T11:20:02.116770+0000","last_fullsized":"2024-09-14T11:20:02.116770+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:40.633016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"260'54","reported_seq":191,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:51.003716+0000","last_change":"2024-09-14T10:59:48.422151+0000","last_active":"2024-09-14T11:20:51.003716+0000","last_peered":"2024-09-14T11:20:51.003716+0000","last_clean":"2024-09-14T11:20:51.003716+0000","last_became_active":"2024-09-14T10:59:48.421875+0000","last_became_peered":"2024-09-14T10:59:48.421875+0000","last_unstale":"2024-09-14T11:20:51.003716+0000","last_undegraded":"2024-09-14T11:20:51.003716+0000","last_fullsized":"2024-09-14T11:20:51.003716+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":456,"num_read_kb":308,"num_write":139,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:26.246099+0000","last_change":"2024-09-14T11:11:42.590323+0000","last_active":"2024-09-14T11:20:26.246099+0000","last_peered":"2024-09-14T11:20:26.246099+0000","last_clean":"2024-09-14T11:20:26.246099+0000","last_became_active":"2024-09-14T11:11:42.590056+0000","last_became_peered":"2024-09-14T11:11:42.590056+0000","last_unstale":"2024-09-14T11:20:26.246099+0000","last_undegraded":"2024-09-14T11:20:26.246099+0000","last_fullsized":"2024-09-14T11:20:26.246099+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:24.964712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"260'2","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:41.010434+0000","last_change":"2024-09-14T11:01:23.892070+0000","last_active":"2024-09-14T11:21:41.010434+0000","last_peered":"2024-09-14T11:21:41.010434+0000","last_clean":"2024-09-14T11:21:41.010434+0000","last_became_active":"2024-09-14T11:01:23.891331+0000","last_became_peered":"2024-09-14T11:01:23.891331+0000","last_unstale":"2024-09-14T11:21:41.010434+0000","last_undegraded":"2024-09-14T11:21:41.010434+0000","last_fullsized":"2024-09-14T11:21:41.010434+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:08:04.829621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:19.986970+0000","last_change":"2024-09-14T11:01:20.863405+0000","last_active":"2024-09-14T11:19:19.986970+0000","last_peered":"2024-09-14T11:19:19.986970+0000","last_clean":"2024-09-14T11:19:19.986970+0000","last_became_active":"2024-09-14T11:01:20.863144+0000","last_became_peered":"2024-09-14T11:01:20.863144+0000","last_unstale":"2024-09-14T11:19:19.986970+0000","last_undegraded":"2024-09-14T11:19:19.986970+0000","last_fullsized":"2024-09-14T11:19:19.986970+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:52:05.926396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"260'19","reported_seq":91,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:00.757874+0000","last_change":"2024-09-14T10:59:48.417159+0000","last_active":"2024-09-14T11:21:00.757874+0000","last_peered":"2024-09-14T11:21:00.757874+0000","last_clean":"2024-09-14T11:21:00.757874+0000","last_became_active":"2024-09-14T10:59:48.416902+0000","last_became_peered":"2024-09-14T10:59:48.416902+0000","last_unstale":"2024-09-14T11:21:00.757874+0000","last_undegraded":"2024-09-14T11:21:00.757874+0000","last_fullsized":"2024-09-14T11:21:00.757874+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:14.436213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":98,"num_write":49,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:42.122390+0000","last_change":"2024-09-14T11:11:42.589320+0000","last_active":"2024-09-14T11:20:42.122390+0000","last_peered":"2024-09-14T11:20:42.122390+0000","last_clean":"2024-09-14T11:20:42.122390+0000","last_became_active":"2024-09-14T11:11:42.589071+0000","last_became_peered":"2024-09-14T11:11:42.589071+0000","last_unstale":"2024-09-14T11:20:42.122390+0000","last_undegraded":"2024-09-14T11:20:42.122390+0000","last_fullsized":"2024-09-14T11:20:42.122390+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:25.992224+0000","last_change":"2024-09-14T11:01:23.893015+0000","last_active":"2024-09-14T11:19:25.992224+0000","last_peered":"2024-09-14T11:19:25.992224+0000","last_clean":"2024-09-14T11:19:25.992224+0000","last_became_active":"2024-09-14T11:01:23.892761+0000","last_became_peered":"2024-09-14T11:01:23.892761+0000","last_unstale":"2024-09-14T11:19:25.992224+0000","last_undegraded":"2024-09-14T11:19:25.992224+0000","last_fullsized":"2024-09-14T11:19:25.992224+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:06.763249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:20.984704+0000","last_change":"2024-09-14T11:01:20.866514+0000","last_active":"2024-09-14T11:19:20.984704+0000","last_peered":"2024-09-14T11:19:20.984704+0000","last_clean":"2024-09-14T11:19:20.984704+0000","last_became_active":"2024-09-14T11:01:20.866224+0000","last_became_peered":"2024-09-14T11:01:20.866224+0000","last_unstale":"2024-09-14T11:19:20.984704+0000","last_undegraded":"2024-09-14T11:19:20.984704+0000","last_fullsized":"2024-09-14T11:19:20.984704+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:55.378175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"260'30","reported_seq":122,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:07.117741+0000","last_change":"2024-09-14T10:59:48.416632+0000","last_active":"2024-09-14T11:20:07.117741+0000","last_peered":"2024-09-14T11:20:07.117741+0000","last_clean":"2024-09-14T11:20:07.117741+0000","last_became_active":"2024-09-14T10:59:48.415922+0000","last_became_peered":"2024-09-14T10:59:48.415922+0000","last_unstale":"2024-09-14T11:20:07.117741+0000","last_undegraded":"2024-09-14T11:20:07.117741+0000","last_fullsized":"2024-09-14T11:20:07.117741+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:37.136039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":240,"num_read_kb":165,"num_write":74,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:22.119393+0000","last_change":"2024-09-14T11:11:42.591303+0000","last_active":"2024-09-14T11:20:22.119393+0000","last_peered":"2024-09-14T11:20:22.119393+0000","last_clean":"2024-09-14T11:20:22.119393+0000","last_became_active":"2024-09-14T11:11:42.589881+0000","last_became_peered":"2024-09-14T11:11:42.589881+0000","last_unstale":"2024-09-14T11:20:22.119393+0000","last_undegraded":"2024-09-14T11:20:22.119393+0000","last_fullsized":"2024-09-14T11:20:22.119393+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:53.799897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"257'8","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:30.993019+0000","last_change":"2024-09-14T11:01:23.897536+0000","last_active":"2024-09-14T11:19:30.993019+0000","last_peered":"2024-09-14T11:19:30.993019+0000","last_clean":"2024-09-14T11:19:30.993019+0000","last_became_active":"2024-09-14T11:01:23.897158+0000","last_became_peered":"2024-09-14T11:01:23.897158+0000","last_unstale":"2024-09-14T11:19:30.993019+0000","last_undegraded":"2024-09-14T11:19:30.993019+0000","last_fullsized":"2024-09-14T11:19:30.993019+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:34.363585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6146,"num_write":18,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:20.991433+0000","last_change":"2024-09-14T11:01:20.864291+0000","last_active":"2024-09-14T11:19:20.991433+0000","last_peered":"2024-09-14T11:19:20.991433+0000","last_clean":"2024-09-14T11:19:20.991433+0000","last_became_active":"2024-09-14T11:01:20.863999+0000","last_became_peered":"2024-09-14T11:01:20.863999+0000","last_unstale":"2024-09-14T11:19:20.991433+0000","last_undegraded":"2024-09-14T11:19:20.991433+0000","last_fullsized":"2024-09-14T11:19:20.991433+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:01:25.818000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"260'46","reported_seq":159,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:32.496503+0000","last_change":"2024-09-14T10:59:48.418550+0000","last_active":"2024-09-14T11:20:32.496503+0000","last_peered":"2024-09-14T11:20:32.496503+0000","last_clean":"2024-09-14T11:20:32.496503+0000","last_became_active":"2024-09-14T10:59:48.418276+0000","last_became_peered":"2024-09-14T10:59:48.418276+0000","last_unstale":"2024-09-14T11:20:32.496503+0000","last_undegraded":"2024-09-14T11:20:32.496503+0000","last_fullsized":"2024-09-14T11:20:32.496503+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:57.938381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":345,"num_read_kb":231,"num_write":118,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:22.119116+0000","last_change":"2024-09-14T11:11:42.587132+0000","last_active":"2024-09-14T11:20:22.119116+0000","last_peered":"2024-09-14T11:20:22.119116+0000","last_clean":"2024-09-14T11:20:22.119116+0000","last_became_active":"2024-09-14T11:11:42.586852+0000","last_became_peered":"2024-09-14T11:11:42.586852+0000","last_unstale":"2024-09-14T11:20:22.119116+0000","last_undegraded":"2024-09-14T11:20:22.119116+0000","last_fullsized":"2024-09-14T11:20:22.119116+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:34.192562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"257'3","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:26.237592+0000","last_change":"2024-09-14T11:01:23.887413+0000","last_active":"2024-09-14T11:19:26.237592+0000","last_peered":"2024-09-14T11:19:26.237592+0000","last_clean":"2024-09-14T11:19:26.237592+0000","last_became_active":"2024-09-14T11:01:23.887167+0000","last_became_peered":"2024-09-14T11:01:23.887167+0000","last_unstale":"2024-09-14T11:19:26.237592+0000","last_undegraded":"2024-09-14T11:19:26.237592+0000","last_fullsized":"2024-09-14T11:19:26.237592+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:36:46.808831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"260'6","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.022365+0000","last_change":"2024-09-14T11:01:20.857944+0000","last_active":"2024-09-14T11:22:51.022365+0000","last_peered":"2024-09-14T11:22:51.022365+0000","last_clean":"2024-09-14T11:22:51.022365+0000","last_became_active":"2024-09-14T11:01:20.857645+0000","last_became_peered":"2024-09-14T11:01:20.857645+0000","last_unstale":"2024-09-14T11:22:51.022365+0000","last_undegraded":"2024-09-14T11:22:51.022365+0000","last_fullsized":"2024-09-14T11:22:51.022365+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:57:36.222186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"260'22","reported_seq":101,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:05.990564+0000","last_change":"2024-09-14T10:59:48.413726+0000","last_active":"2024-09-14T11:20:05.990564+0000","last_peered":"2024-09-14T11:20:05.990564+0000","last_clean":"2024-09-14T11:20:05.990564+0000","last_became_active":"2024-09-14T10:59:48.413425+0000","last_became_peered":"2024-09-14T10:59:48.413425+0000","last_unstale":"2024-09-14T11:20:05.990564+0000","last_undegraded":"2024-09-14T11:20:05.990564+0000","last_fullsized":"2024-09-14T11:20:05.990564+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:03.945777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":100,"num_write":57,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:46.249037+0000","last_change":"2024-09-14T11:11:42.588149+0000","last_active":"2024-09-14T11:20:46.249037+0000","last_peered":"2024-09-14T11:20:46.249037+0000","last_clean":"2024-09-14T11:20:46.249037+0000","last_became_active":"2024-09-14T11:11:42.587906+0000","last_became_peered":"2024-09-14T11:11:42.587906+0000","last_unstale":"2024-09-14T11:20:46.249037+0000","last_undegraded":"2024-09-14T11:20:46.249037+0000","last_fullsized":"2024-09-14T11:20:46.249037+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":29,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:57.125108+0000","last_change":"2024-09-14T11:01:23.891705+0000","last_active":"2024-09-14T11:20:57.125108+0000","last_peered":"2024-09-14T11:20:57.125108+0000","last_clean":"2024-09-14T11:20:57.125108+0000","last_became_active":"2024-09-14T11:01:23.891424+0000","last_became_peered":"2024-09-14T11:01:23.891424+0000","last_unstale":"2024-09-14T11:20:57.125108+0000","last_undegraded":"2024-09-14T11:20:57.125108+0000","last_fullsized":"2024-09-14T11:20:57.125108+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"260'5","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.178883+0000","last_change":"2024-09-14T11:01:20.864246+0000","last_active":"2024-09-14T11:22:51.178883+0000","last_peered":"2024-09-14T11:22:51.178883+0000","last_clean":"2024-09-14T11:22:51.178883+0000","last_became_active":"2024-09-14T11:01:20.863936+0000","last_became_peered":"2024-09-14T11:01:20.863936+0000","last_unstale":"2024-09-14T11:22:51.178883+0000","last_undegraded":"2024-09-14T11:22:51.178883+0000","last_fullsized":"2024-09-14T11:22:51.178883+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"260'14","reported_seq":80,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:05.990531+0000","last_change":"2024-09-14T10:59:48.414234+0000","last_active":"2024-09-14T11:20:05.990531+0000","last_peered":"2024-09-14T11:20:05.990531+0000","last_clean":"2024-09-14T11:20:05.990531+0000","last_became_active":"2024-09-14T10:59:48.413255+0000","last_became_peered":"2024-09-14T10:59:48.413255+0000","last_unstale":"2024-09-14T11:20:05.990531+0000","last_undegraded":"2024-09-14T11:20:05.990531+0000","last_fullsized":"2024-09-14T11:20:05.990531+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:14.892298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":78,"num_write":38,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:49.998395+0000","last_change":"2024-09-14T11:11:42.588371+0000","last_active":"2024-09-14T11:20:49.998395+0000","last_peered":"2024-09-14T11:20:49.998395+0000","last_clean":"2024-09-14T11:20:49.998395+0000","last_became_active":"2024-09-14T11:11:42.588120+0000","last_became_peered":"2024-09-14T11:11:42.588120+0000","last_unstale":"2024-09-14T11:20:49.998395+0000","last_undegraded":"2024-09-14T11:20:49.998395+0000","last_fullsized":"2024-09-14T11:20:49.998395+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"257'3","reported_seq":35,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:54.998860+0000","last_change":"2024-09-14T11:01:23.889191+0000","last_active":"2024-09-14T11:20:54.998860+0000","last_peered":"2024-09-14T11:20:54.998860+0000","last_clean":"2024-09-14T11:20:54.998860+0000","last_became_active":"2024-09-14T11:01:23.888873+0000","last_became_peered":"2024-09-14T11:01:23.888873+0000","last_unstale":"2024-09-14T11:20:54.998860+0000","last_undegraded":"2024-09-14T11:20:54.998860+0000","last_fullsized":"2024-09-14T11:20:54.998860+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":35,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:51.249645+0000","last_change":"2024-09-14T11:01:20.867172+0000","last_active":"2024-09-14T11:20:51.249645+0000","last_peered":"2024-09-14T11:20:51.249645+0000","last_clean":"2024-09-14T11:20:51.249645+0000","last_became_active":"2024-09-14T11:01:20.865953+0000","last_became_peered":"2024-09-14T11:01:20.865953+0000","last_unstale":"2024-09-14T11:20:51.249645+0000","last_undegraded":"2024-09-14T11:20:51.249645+0000","last_fullsized":"2024-09-14T11:20:51.249645+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"260'22","reported_seq":98,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:00.388827+0000","last_change":"2024-09-14T10:59:48.417311+0000","last_active":"2024-09-14T11:21:00.388827+0000","last_peered":"2024-09-14T11:21:00.388827+0000","last_clean":"2024-09-14T11:21:00.388827+0000","last_became_active":"2024-09-14T10:59:48.417013+0000","last_became_peered":"2024-09-14T10:59:48.417013+0000","last_unstale":"2024-09-14T11:21:00.388827+0000","last_undegraded":"2024-09-14T11:21:00.388827+0000","last_fullsized":"2024-09-14T11:21:00.388827+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:55.489720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":110,"num_write":54,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"260'1","reported_seq":19,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:42.216604+0000","last_change":"2024-09-14T11:11:42.592793+0000","last_active":"2024-09-14T11:20:42.216604+0000","last_peered":"2024-09-14T11:20:42.216604+0000","last_clean":"2024-09-14T11:20:42.216604+0000","last_became_active":"2024-09-14T11:11:42.592514+0000","last_became_peered":"2024-09-14T11:11:42.592514+0000","last_unstale":"2024-09-14T11:20:42.216604+0000","last_undegraded":"2024-09-14T11:20:42.216604+0000","last_fullsized":"2024-09-14T11:20:42.216604+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:25.985335+0000","last_change":"2024-09-14T11:01:23.890689+0000","last_active":"2024-09-14T11:19:25.985335+0000","last_peered":"2024-09-14T11:19:25.985335+0000","last_clean":"2024-09-14T11:19:25.985335+0000","last_became_active":"2024-09-14T11:01:23.890356+0000","last_became_peered":"2024-09-14T11:01:23.890356+0000","last_unstale":"2024-09-14T11:19:25.985335+0000","last_undegraded":"2024-09-14T11:19:25.985335+0000","last_fullsized":"2024-09-14T11:19:25.985335+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:10.636807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"257'3","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:56.004344+0000","last_change":"2024-09-14T11:01:20.859484+0000","last_active":"2024-09-14T11:20:56.004344+0000","last_peered":"2024-09-14T11:20:56.004344+0000","last_clean":"2024-09-14T11:20:56.004344+0000","last_became_active":"2024-09-14T11:01:20.859214+0000","last_became_peered":"2024-09-14T11:01:20.859214+0000","last_unstale":"2024-09-14T11:20:56.004344+0000","last_undegraded":"2024-09-14T11:20:56.004344+0000","last_fullsized":"2024-09-14T11:20:56.004344+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"260'23","reported_seq":97,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:21.236876+0000","last_change":"2024-09-14T10:59:48.420616+0000","last_active":"2024-09-14T11:19:21.236876+0000","last_peered":"2024-09-14T11:19:21.236876+0000","last_clean":"2024-09-14T11:19:21.236876+0000","last_became_active":"2024-09-14T10:59:48.420353+0000","last_became_peered":"2024-09-14T10:59:48.420353+0000","last_unstale":"2024-09-14T11:19:21.236876+0000","last_undegraded":"2024-09-14T11:19:21.236876+0000","last_fullsized":"2024-09-14T11:19:21.236876+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:02.159847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":102,"num_write":60,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:46.003030+0000","last_change":"2024-09-14T11:11:42.589448+0000","last_active":"2024-09-14T11:20:46.003030+0000","last_peered":"2024-09-14T11:20:46.003030+0000","last_clean":"2024-09-14T11:20:46.003030+0000","last_became_active":"2024-09-14T11:11:42.589134+0000","last_became_peered":"2024-09-14T11:11:42.589134+0000","last_unstale":"2024-09-14T11:20:46.003030+0000","last_undegraded":"2024-09-14T11:20:46.003030+0000","last_fullsized":"2024-09-14T11:20:46.003030+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"260'2","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.598409+0000","last_change":"2024-09-14T11:01:23.890752+0000","last_active":"2024-09-14T11:22:50.598409+0000","last_peered":"2024-09-14T11:22:50.598409+0000","last_clean":"2024-09-14T11:22:50.598409+0000","last_became_active":"2024-09-14T11:01:23.890433+0000","last_became_peered":"2024-09-14T11:01:23.890433+0000","last_unstale":"2024-09-14T11:22:50.598409+0000","last_undegraded":"2024-09-14T11:22:50.598409+0000","last_fullsized":"2024-09-14T11:22:50.598409+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"257'3","reported_seq":40,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:22.110767+0000","last_change":"2024-09-14T11:01:20.859636+0000","last_active":"2024-09-14T11:19:22.110767+0000","last_peered":"2024-09-14T11:19:22.110767+0000","last_clean":"2024-09-14T11:19:22.110767+0000","last_became_active":"2024-09-14T11:01:20.858834+0000","last_became_peered":"2024-09-14T11:01:20.858834+0000","last_unstale":"2024-09-14T11:19:22.110767+0000","last_undegraded":"2024-09-14T11:19:22.110767+0000","last_fullsized":"2024-09-14T11:19:22.110767+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:26.825835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"260'31","reported_seq":128,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:22.206583+0000","last_change":"2024-09-14T10:59:48.414660+0000","last_active":"2024-09-14T11:19:22.206583+0000","last_peered":"2024-09-14T11:19:22.206583+0000","last_clean":"2024-09-14T11:19:22.206583+0000","last_became_active":"2024-09-14T10:59:48.414351+0000","last_became_peered":"2024-09-14T10:59:48.414351+0000","last_unstale":"2024-09-14T11:19:22.206583+0000","last_undegraded":"2024-09-14T11:19:22.206583+0000","last_fullsized":"2024-09-14T11:19:22.206583+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:47.823706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":249,"num_read_kb":158,"num_write":78,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:02.212097+0000","last_change":"2024-09-14T11:11:42.588279+0000","last_active":"2024-09-14T11:20:02.212097+0000","last_peered":"2024-09-14T11:20:02.212097+0000","last_clean":"2024-09-14T11:20:02.212097+0000","last_became_active":"2024-09-14T11:11:42.587955+0000","last_became_peered":"2024-09-14T11:11:42.587955+0000","last_unstale":"2024-09-14T11:20:02.212097+0000","last_undegraded":"2024-09-14T11:20:02.212097+0000","last_fullsized":"2024-09-14T11:20:02.212097+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:26.572340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"260'8","reported_seq":47,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:16.262273+0000","last_change":"2024-09-14T11:01:23.893822+0000","last_active":"2024-09-14T11:22:16.262273+0000","last_peered":"2024-09-14T11:22:16.262273+0000","last_clean":"2024-09-14T11:22:16.262273+0000","last_became_active":"2024-09-14T11:01:23.891239+0000","last_became_peered":"2024-09-14T11:01:23.891239+0000","last_unstale":"2024-09-14T11:22:16.262273+0000","last_undegraded":"2024-09-14T11:22:16.262273+0000","last_fullsized":"2024-09-14T11:22:16.262273+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:21.232548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20482,"num_write":18,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":35,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:07.117708+0000","last_change":"2024-09-14T11:01:20.867304+0000","last_active":"2024-09-14T11:20:07.117708+0000","last_peered":"2024-09-14T11:20:07.117708+0000","last_clean":"2024-09-14T11:20:07.117708+0000","last_became_active":"2024-09-14T11:01:20.866975+0000","last_became_peered":"2024-09-14T11:01:20.866975+0000","last_unstale":"2024-09-14T11:20:07.117708+0000","last_undegraded":"2024-09-14T11:20:07.117708+0000","last_fullsized":"2024-09-14T11:20:07.117708+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:53.556481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"260'4","reported_seq":50,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:21.115449+0000","last_change":"2024-09-14T10:59:48.417712+0000","last_active":"2024-09-14T11:19:21.115449+0000","last_peered":"2024-09-14T11:19:21.115449+0000","last_clean":"2024-09-14T11:19:21.115449+0000","last_became_active":"2024-09-14T10:59:48.416741+0000","last_became_peered":"2024-09-14T10:59:48.416741+0000","last_unstale":"2024-09-14T11:19:21.115449+0000","last_undegraded":"2024-09-14T11:19:21.115449+0000","last_fullsized":"2024-09-14T11:19:21.115449+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:42.444007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:02.212122+0000","last_change":"2024-09-14T11:11:42.582460+0000","last_active":"2024-09-14T11:20:02.212122+0000","last_peered":"2024-09-14T11:20:02.212122+0000","last_clean":"2024-09-14T11:20:02.212122+0000","last_became_active":"2024-09-14T11:11:42.582190+0000","last_became_peered":"2024-09-14T11:11:42.582190+0000","last_unstale":"2024-09-14T11:20:02.212122+0000","last_undegraded":"2024-09-14T11:20:02.212122+0000","last_fullsized":"2024-09-14T11:20:02.212122+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:34.879085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"260'10","reported_seq":55,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:16.262243+0000","last_change":"2024-09-14T11:01:23.893560+0000","last_active":"2024-09-14T11:22:16.262243+0000","last_peered":"2024-09-14T11:22:16.262243+0000","last_clean":"2024-09-14T11:22:16.262243+0000","last_became_active":"2024-09-14T11:01:23.892344+0000","last_became_peered":"2024-09-14T11:01:23.892344+0000","last_unstale":"2024-09-14T11:22:16.262243+0000","last_undegraded":"2024-09-14T11:22:16.262243+0000","last_fullsized":"2024-09-14T11:22:16.262243+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:12.291644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":30724,"num_write":15,"num_write_kb":10242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"260'2","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:11.138584+0000","last_change":"2024-09-14T11:01:20.863767+0000","last_active":"2024-09-14T11:22:11.138584+0000","last_peered":"2024-09-14T11:22:11.138584+0000","last_clean":"2024-09-14T11:22:11.138584+0000","last_became_active":"2024-09-14T11:01:20.863495+0000","last_became_peered":"2024-09-14T11:01:20.863495+0000","last_unstale":"2024-09-14T11:22:11.138584+0000","last_undegraded":"2024-09-14T11:22:11.138584+0000","last_fullsized":"2024-09-14T11:22:11.138584+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:36:10.395831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"260'32","reported_seq":120,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:22.110836+0000","last_change":"2024-09-14T10:59:48.416964+0000","last_active":"2024-09-14T11:19:22.110836+0000","last_peered":"2024-09-14T11:19:22.110836+0000","last_clean":"2024-09-14T11:19:22.110836+0000","last_became_active":"2024-09-14T10:59:48.416253+0000","last_became_peered":"2024-09-14T10:59:48.416253+0000","last_unstale":"2024-09-14T11:19:22.110836+0000","last_undegraded":"2024-09-14T11:19:22.110836+0000","last_fullsized":"2024-09-14T11:19:22.110836+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:16.459819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":142,"num_write":84,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:46.240692+0000","last_change":"2024-09-14T11:11:42.589281+0000","last_active":"2024-09-14T11:19:46.240692+0000","last_peered":"2024-09-14T11:19:46.240692+0000","last_clean":"2024-09-14T11:19:46.240692+0000","last_became_active":"2024-09-14T11:11:42.588988+0000","last_became_peered":"2024-09-14T11:11:42.588988+0000","last_unstale":"2024-09-14T11:19:46.240692+0000","last_undegraded":"2024-09-14T11:19:46.240692+0000","last_fullsized":"2024-09-14T11:19:46.240692+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:50:56.659833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"260'6","reported_seq":39,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.058605+0000","last_change":"2024-09-14T11:01:23.889213+0000","last_active":"2024-09-14T11:22:51.058605+0000","last_peered":"2024-09-14T11:22:51.058605+0000","last_clean":"2024-09-14T11:22:51.058605+0000","last_became_active":"2024-09-14T11:01:23.888845+0000","last_became_peered":"2024-09-14T11:01:23.888845+0000","last_unstale":"2024-09-14T11:22:51.058605+0000","last_undegraded":"2024-09-14T11:22:51.058605+0000","last_fullsized":"2024-09-14T11:22:51.058605+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"257'10","reported_seq":61,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:49.998384+0000","last_change":"2024-09-14T11:01:20.866169+0000","last_active":"2024-09-14T11:20:49.998384+0000","last_peered":"2024-09-14T11:20:49.998384+0000","last_clean":"2024-09-14T11:20:49.998384+0000","last_became_active":"2024-09-14T11:01:20.865891+0000","last_became_peered":"2024-09-14T11:01:20.865891+0000","last_unstale":"2024-09-14T11:20:49.998384+0000","last_undegraded":"2024-09-14T11:20:49.998384+0000","last_fullsized":"2024-09-14T11:20:49.998384+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":24580,"num_write":15,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"260'27","reported_seq":115,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:49.998360+0000","last_change":"2024-09-14T10:59:48.421115+0000","last_active":"2024-09-14T11:20:49.998360+0000","last_peered":"2024-09-14T11:20:49.998360+0000","last_clean":"2024-09-14T11:20:49.998360+0000","last_became_active":"2024-09-14T10:59:48.420845+0000","last_became_peered":"2024-09-14T10:59:48.420845+0000","last_unstale":"2024-09-14T11:20:49.998360+0000","last_undegraded":"2024-09-14T11:20:49.998360+0000","last_fullsized":"2024-09-14T11:20:49.998360+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:56.781294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":135,"num_write":77,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:02.116980+0000","last_change":"2024-09-14T11:11:42.592263+0000","last_active":"2024-09-14T11:20:02.116980+0000","last_peered":"2024-09-14T11:20:02.116980+0000","last_clean":"2024-09-14T11:20:02.116980+0000","last_became_active":"2024-09-14T11:11:42.591734+0000","last_became_peered":"2024-09-14T11:11:42.591734+0000","last_unstale":"2024-09-14T11:20:02.116980+0000","last_undegraded":"2024-09-14T11:20:02.116980+0000","last_fullsized":"2024-09-14T11:20:02.116980+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:48.663357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"260'3","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.457831+0000","last_change":"2024-09-14T11:01:23.895194+0000","last_active":"2024-09-14T11:22:50.457831+0000","last_peered":"2024-09-14T11:22:50.457831+0000","last_clean":"2024-09-14T11:22:50.457831+0000","last_became_active":"2024-09-14T11:01:23.894904+0000","last_became_peered":"2024-09-14T11:01:23.894904+0000","last_unstale":"2024-09-14T11:22:50.457831+0000","last_undegraded":"2024-09-14T11:22:50.457831+0000","last_fullsized":"2024-09-14T11:22:50.457831+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":35,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:52.124532+0000","last_change":"2024-09-14T11:01:20.867989+0000","last_active":"2024-09-14T11:20:52.124532+0000","last_peered":"2024-09-14T11:20:52.124532+0000","last_clean":"2024-09-14T11:20:52.124532+0000","last_became_active":"2024-09-14T11:01:20.867675+0000","last_became_peered":"2024-09-14T11:01:20.867675+0000","last_unstale":"2024-09-14T11:20:52.124532+0000","last_undegraded":"2024-09-14T11:20:52.124532+0000","last_fullsized":"2024-09-14T11:20:52.124532+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"260'45","reported_seq":167,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:41.002316+0000","last_change":"2024-09-14T10:59:48.420304+0000","last_active":"2024-09-14T11:20:41.002316+0000","last_peered":"2024-09-14T11:20:41.002316+0000","last_clean":"2024-09-14T11:20:41.002316+0000","last_became_active":"2024-09-14T10:59:48.419276+0000","last_became_peered":"2024-09-14T10:59:48.419276+0000","last_unstale":"2024-09-14T11:20:41.002316+0000","last_undegraded":"2024-09-14T11:20:41.002316+0000","last_fullsized":"2024-09-14T11:20:41.002316+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:28.099017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":347,"num_read_kb":232,"num_write":118,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"259'1","reported_seq":19,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:26.000278+0000","last_change":"2024-09-14T11:11:42.585561+0000","last_active":"2024-09-14T11:20:26.000278+0000","last_peered":"2024-09-14T11:20:26.000278+0000","last_clean":"2024-09-14T11:20:26.000278+0000","last_became_active":"2024-09-14T11:11:42.585114+0000","last_became_peered":"2024-09-14T11:11:42.585114+0000","last_unstale":"2024-09-14T11:20:26.000278+0000","last_undegraded":"2024-09-14T11:20:26.000278+0000","last_fullsized":"2024-09-14T11:20:26.000278+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:57.558919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"260'2","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:16.139205+0000","last_change":"2024-09-14T11:01:23.894718+0000","last_active":"2024-09-14T11:22:16.139205+0000","last_peered":"2024-09-14T11:22:16.139205+0000","last_clean":"2024-09-14T11:22:16.139205+0000","last_became_active":"2024-09-14T11:01:23.894464+0000","last_became_peered":"2024-09-14T11:01:23.894464+0000","last_unstale":"2024-09-14T11:22:16.139205+0000","last_undegraded":"2024-09-14T11:22:16.139205+0000","last_fullsized":"2024-09-14T11:22:16.139205+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:05.810582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":35,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:24.987527+0000","last_change":"2024-09-14T11:01:20.869396+0000","last_active":"2024-09-14T11:19:24.987527+0000","last_peered":"2024-09-14T11:19:24.987527+0000","last_clean":"2024-09-14T11:19:24.987527+0000","last_became_active":"2024-09-14T11:01:20.869082+0000","last_became_peered":"2024-09-14T11:01:20.869082+0000","last_unstale":"2024-09-14T11:19:24.987527+0000","last_undegraded":"2024-09-14T11:19:24.987527+0000","last_fullsized":"2024-09-14T11:19:24.987527+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:21.154202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"260'42","reported_seq":152,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:00.225547+0000","last_change":"2024-09-14T10:59:48.420048+0000","last_active":"2024-09-14T11:21:00.225547+0000","last_peered":"2024-09-14T11:21:00.225547+0000","last_clean":"2024-09-14T11:21:00.225547+0000","last_became_active":"2024-09-14T10:59:48.419753+0000","last_became_peered":"2024-09-14T10:59:48.419753+0000","last_unstale":"2024-09-14T11:21:00.225547+0000","last_undegraded":"2024-09-14T11:21:00.225547+0000","last_fullsized":"2024-09-14T11:21:00.225547+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:03.370977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":323,"num_read_kb":218,"num_write":115,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:26.123988+0000","last_change":"2024-09-14T11:11:42.593259+0000","last_active":"2024-09-14T11:20:26.123988+0000","last_peered":"2024-09-14T11:20:26.123988+0000","last_clean":"2024-09-14T11:20:26.123988+0000","last_became_active":"2024-09-14T11:11:42.592960+0000","last_became_peered":"2024-09-14T11:11:42.592960+0000","last_unstale":"2024-09-14T11:20:26.123988+0000","last_undegraded":"2024-09-14T11:20:26.123988+0000","last_fullsized":"2024-09-14T11:20:26.123988+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:01.524529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"260'3","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:32.129826+0000","last_change":"2024-09-14T11:01:23.884623+0000","last_active":"2024-09-14T11:21:32.129826+0000","last_peered":"2024-09-14T11:21:32.129826+0000","last_clean":"2024-09-14T11:21:32.129826+0000","last_became_active":"2024-09-14T11:01:23.883464+0000","last_became_peered":"2024-09-14T11:01:23.883464+0000","last_unstale":"2024-09-14T11:21:32.129826+0000","last_undegraded":"2024-09-14T11:21:32.129826+0000","last_fullsized":"2024-09-14T11:21:32.129826+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:39:12.543169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":35,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:07.117641+0000","last_change":"2024-09-14T11:01:20.858331+0000","last_active":"2024-09-14T11:20:07.117641+0000","last_peered":"2024-09-14T11:20:07.117641+0000","last_clean":"2024-09-14T11:20:07.117641+0000","last_became_active":"2024-09-14T11:01:20.858057+0000","last_became_peered":"2024-09-14T11:01:20.858057+0000","last_unstale":"2024-09-14T11:20:07.117641+0000","last_undegraded":"2024-09-14T11:20:07.117641+0000","last_fullsized":"2024-09-14T11:20:07.117641+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:57:11.838133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"260'19","reported_seq":86,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:42.122601+0000","last_change":"2024-09-14T10:59:48.413110+0000","last_active":"2024-09-14T11:20:42.122601+0000","last_peered":"2024-09-14T11:20:42.122601+0000","last_clean":"2024-09-14T11:20:42.122601+0000","last_became_active":"2024-09-14T10:59:48.412832+0000","last_became_peered":"2024-09-14T10:59:48.412832+0000","last_unstale":"2024-09-14T11:20:42.122601+0000","last_undegraded":"2024-09-14T11:20:42.122601+0000","last_fullsized":"2024-09-14T11:20:42.122601+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:06.411861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":68,"num_write":55,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:06.243706+0000","last_change":"2024-09-14T11:11:42.590806+0000","last_active":"2024-09-14T11:20:06.243706+0000","last_peered":"2024-09-14T11:20:06.243706+0000","last_clean":"2024-09-14T11:20:06.243706+0000","last_became_active":"2024-09-14T11:11:42.590549+0000","last_became_peered":"2024-09-14T11:11:42.590549+0000","last_unstale":"2024-09-14T11:20:06.243706+0000","last_undegraded":"2024-09-14T11:20:06.243706+0000","last_fullsized":"2024-09-14T11:20:06.243706+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:47:13.279425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":29,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:09.993244+0000","last_change":"2024-09-14T11:01:23.880483+0000","last_active":"2024-09-14T11:20:09.993244+0000","last_peered":"2024-09-14T11:20:09.993244+0000","last_clean":"2024-09-14T11:20:09.993244+0000","last_became_active":"2024-09-14T11:01:23.880195+0000","last_became_peered":"2024-09-14T11:01:23.880195+0000","last_unstale":"2024-09-14T11:20:09.993244+0000","last_undegraded":"2024-09-14T11:20:09.993244+0000","last_fullsized":"2024-09-14T11:20:09.993244+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:17.209496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":35,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:05.990504+0000","last_change":"2024-09-14T11:01:20.869635+0000","last_active":"2024-09-14T11:20:05.990504+0000","last_peered":"2024-09-14T11:20:05.990504+0000","last_clean":"2024-09-14T11:20:05.990504+0000","last_became_active":"2024-09-14T11:01:20.869312+0000","last_became_peered":"2024-09-14T11:01:20.869312+0000","last_unstale":"2024-09-14T11:20:05.990504+0000","last_undegraded":"2024-09-14T11:20:05.990504+0000","last_fullsized":"2024-09-14T11:20:05.990504+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:36:29.069053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"257'19","reported_seq":97,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:42.122542+0000","last_change":"2024-09-14T10:59:48.418837+0000","last_active":"2024-09-14T11:20:42.122542+0000","last_peered":"2024-09-14T11:20:42.122542+0000","last_clean":"2024-09-14T11:20:42.122542+0000","last_became_active":"2024-09-14T10:59:48.418369+0000","last_became_peered":"2024-09-14T10:59:48.418369+0000","last_unstale":"2024-09-14T11:20:42.122542+0000","last_undegraded":"2024-09-14T11:20:42.122542+0000","last_fullsized":"2024-09-14T11:20:42.122542+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:53.388331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":97,"num_write":49,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:02.117065+0000","last_change":"2024-09-14T11:11:42.593087+0000","last_active":"2024-09-14T11:20:02.117065+0000","last_peered":"2024-09-14T11:20:02.117065+0000","last_clean":"2024-09-14T11:20:02.117065+0000","last_became_active":"2024-09-14T11:11:42.592333+0000","last_became_peered":"2024-09-14T11:11:42.592333+0000","last_unstale":"2024-09-14T11:20:02.117065+0000","last_undegraded":"2024-09-14T11:20:02.117065+0000","last_fullsized":"2024-09-14T11:20:02.117065+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:32.247668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"260'2","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:15.008829+0000","last_change":"2024-09-14T11:01:23.882421+0000","last_active":"2024-09-14T11:22:15.008829+0000","last_peered":"2024-09-14T11:22:15.008829+0000","last_clean":"2024-09-14T11:22:15.008829+0000","last_became_active":"2024-09-14T11:01:23.882133+0000","last_became_peered":"2024-09-14T11:01:23.882133+0000","last_unstale":"2024-09-14T11:22:15.008829+0000","last_undegraded":"2024-09-14T11:22:15.008829+0000","last_fullsized":"2024-09-14T11:22:15.008829+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:20.333208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":35,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:07.117340+0000","last_change":"2024-09-14T11:01:20.861253+0000","last_active":"2024-09-14T11:20:07.117340+0000","last_peered":"2024-09-14T11:20:07.117340+0000","last_clean":"2024-09-14T11:20:07.117340+0000","last_became_active":"2024-09-14T11:01:20.860944+0000","last_became_peered":"2024-09-14T11:01:20.860944+0000","last_unstale":"2024-09-14T11:20:07.117340+0000","last_undegraded":"2024-09-14T11:20:07.117340+0000","last_fullsized":"2024-09-14T11:20:07.117340+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:43.601108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"260'37","reported_seq":141,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:19.371160+0000","last_change":"2024-09-14T10:59:48.420240+0000","last_active":"2024-09-14T11:20:19.371160+0000","last_peered":"2024-09-14T11:20:19.371160+0000","last_clean":"2024-09-14T11:20:19.371160+0000","last_became_active":"2024-09-14T10:59:48.419953+0000","last_became_peered":"2024-09-14T10:59:48.419953+0000","last_unstale":"2024-09-14T11:20:19.371160+0000","last_undegraded":"2024-09-14T11:20:19.371160+0000","last_fullsized":"2024-09-14T11:20:19.371160+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:19.266531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":210,"num_write":90,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"260'356","reported_seq":1000,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:04.591849+0000","last_change":"2024-09-14T11:23:04.591790+0000","last_active":"2024-09-14T11:23:04.591849+0000","last_peered":"2024-09-14T11:23:04.591849+0000","last_clean":"2024-09-14T11:23:04.591849+0000","last_became_active":"2024-09-14T10:45:43.684205+0000","last_became_peered":"2024-09-14T10:45:43.684205+0000","last_unstale":"2024-09-14T11:23:04.591849+0000","last_undegraded":"2024-09-14T11:23:04.591849+0000","last_fullsized":"2024-09-14T11:23:04.591849+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'356","last_scrub_stamp":"2024-09-14T11:23:04.591679+0000","last_deep_scrub":"260'356","last_deep_scrub_stamp":"2024-09-14T11:23:04.591679+0000","last_clean_scrub_stamp":"2024-09-14T11:23:04.591679+0000","objects_scrubbed":7,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:23.922213+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133699,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":617,"num_read_kb":37218,"num_write":1077,"num_write_kb":25003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"260'785","reported_seq":2543,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:08.629267+0000","last_change":"2024-09-14T11:23:08.629209+0000","last_active":"2024-09-14T11:23:08.629267+0000","last_peered":"2024-09-14T11:23:08.629267+0000","last_clean":"2024-09-14T11:23:08.629267+0000","last_became_active":"2024-09-14T10:45:45.714485+0000","last_became_peered":"2024-09-14T10:45:45.714485+0000","last_unstale":"2024-09-14T11:23:08.629267+0000","last_undegraded":"2024-09-14T11:23:08.629267+0000","last_fullsized":"2024-09-14T11:23:08.629267+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'785","last_scrub_stamp":"2024-09-14T11:23:08.629123+0000","last_deep_scrub":"260'785","last_deep_scrub_stamp":"2024-09-14T11:23:08.629123+0000","last_clean_scrub_stamp":"2024-09-14T11:23:08.629123+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:19:08.756240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4300,"num_read_kb":3942,"num_write":1034,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7375,"num_omap_keys":29,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"260'353","reported_seq":1039,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:08.381428+0000","last_change":"2024-09-14T11:23:08.381363+0000","last_active":"2024-09-14T11:23:08.381428+0000","last_peered":"2024-09-14T11:23:08.381428+0000","last_clean":"2024-09-14T11:23:08.381428+0000","last_became_active":"2024-09-14T10:45:43.683777+0000","last_became_peered":"2024-09-14T10:45:43.683777+0000","last_unstale":"2024-09-14T11:23:08.381428+0000","last_undegraded":"2024-09-14T11:23:08.381428+0000","last_fullsized":"2024-09-14T11:23:08.381428+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'353","last_scrub_stamp":"2024-09-14T11:23:08.381263+0000","last_deep_scrub":"260'353","last_deep_scrub_stamp":"2024-09-14T11:23:08.381263+0000","last_clean_scrub_stamp":"2024-09-14T11:23:08.381263+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:09.498257+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":760,"num_read_kb":10810,"num_write":1149,"num_write_kb":33486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"260'363","reported_seq":1831,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.741845+0000","last_change":"2024-09-14T10:45:45.716175+0000","last_active":"2024-09-14T11:21:28.741845+0000","last_peered":"2024-09-14T11:21:28.741845+0000","last_clean":"2024-09-14T11:21:28.741845+0000","last_became_active":"2024-09-14T10:45:45.715857+0000","last_became_peered":"2024-09-14T10:45:45.715857+0000","last_unstale":"2024-09-14T11:21:28.741845+0000","last_undegraded":"2024-09-14T11:21:28.741845+0000","last_fullsized":"2024-09-14T11:21:28.741845+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2025,"num_read_kb":1946,"num_write":400,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"260'382","reported_seq":1095,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:09.404600+0000","last_change":"2024-09-14T11:23:09.404541+0000","last_active":"2024-09-14T11:23:09.404600+0000","last_peered":"2024-09-14T11:23:09.404600+0000","last_clean":"2024-09-14T11:23:09.404600+0000","last_became_active":"2024-09-14T10:45:43.689222+0000","last_became_peered":"2024-09-14T10:45:43.689222+0000","last_unstale":"2024-09-14T11:23:09.404600+0000","last_undegraded":"2024-09-14T11:23:09.404600+0000","last_fullsized":"2024-09-14T11:23:09.404600+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'382","last_scrub_stamp":"2024-09-14T11:23:09.404431+0000","last_deep_scrub":"260'382","last_deep_scrub_stamp":"2024-09-14T11:23:09.404431+0000","last_clean_scrub_stamp":"2024-09-14T11:23:09.404431+0000","objects_scrubbed":6,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:38:07.421015+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":957,"num_read_kb":25215,"num_write":1113,"num_write_kb":46624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"260'805","reported_seq":2236,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:14.957494+0000","last_change":"2024-09-14T10:45:45.718479+0000","last_active":"2024-09-14T11:21:14.957494+0000","last_peered":"2024-09-14T11:21:14.957494+0000","last_clean":"2024-09-14T11:21:14.957494+0000","last_became_active":"2024-09-14T10:45:45.718205+0000","last_became_peered":"2024-09-14T10:45:45.718205+0000","last_unstale":"2024-09-14T11:21:14.957494+0000","last_undegraded":"2024-09-14T11:21:14.957494+0000","last_fullsized":"2024-09-14T11:21:14.957494+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3715,"num_read_kb":3327,"num_write":1051,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"260'407","reported_seq":1157,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:02.167132+0000","last_change":"2024-09-14T11:23:02.167132+0000","last_active":"2024-09-14T11:23:02.167132+0000","last_peered":"2024-09-14T11:23:02.167132+0000","last_clean":"2024-09-14T11:23:02.167132+0000","last_became_active":"2024-09-14T10:45:43.688982+0000","last_became_peered":"2024-09-14T10:45:43.688982+0000","last_unstale":"2024-09-14T11:23:02.167132+0000","last_undegraded":"2024-09-14T11:23:02.167132+0000","last_fullsized":"2024-09-14T11:23:02.167132+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'407","last_scrub_stamp":"2024-09-14T11:23:02.167030+0000","last_deep_scrub":"260'407","last_deep_scrub_stamp":"2024-09-14T11:23:02.167030+0000","last_clean_scrub_stamp":"2024-09-14T11:23:02.167030+0000","objects_scrubbed":6,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:09.629346+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133692,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":838,"num_read_kb":162483,"num_write":1341,"num_write_kb":45809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"260'458","reported_seq":2016,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:12.794133+0000","last_change":"2024-09-14T11:23:12.794054+0000","last_active":"2024-09-14T11:23:12.794133+0000","last_peered":"2024-09-14T11:23:12.794133+0000","last_clean":"2024-09-14T11:23:12.794133+0000","last_became_active":"2024-09-14T10:45:45.717699+0000","last_became_peered":"2024-09-14T10:45:45.717699+0000","last_unstale":"2024-09-14T11:23:12.794133+0000","last_undegraded":"2024-09-14T11:23:12.794133+0000","last_fullsized":"2024-09-14T11:23:12.794133+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'458","last_scrub_stamp":"2024-09-14T11:23:12.793944+0000","last_deep_scrub":"260'458","last_deep_scrub_stamp":"2024-09-14T11:23:12.793944+0000","last_clean_scrub_stamp":"2024-09-14T11:23:12.793944+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:09.734572+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2461,"num_read_kb":2303,"num_write":536,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"260'377","reported_seq":1025,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:03.611733+0000","last_change":"2024-09-14T11:23:03.611674+0000","last_active":"2024-09-14T11:23:03.611733+0000","last_peered":"2024-09-14T11:23:03.611733+0000","last_clean":"2024-09-14T11:23:03.611733+0000","last_became_active":"2024-09-14T10:45:43.686078+0000","last_became_peered":"2024-09-14T10:45:43.686078+0000","last_unstale":"2024-09-14T11:23:03.611733+0000","last_undegraded":"2024-09-14T11:23:03.611733+0000","last_fullsized":"2024-09-14T11:23:03.611733+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'377","last_scrub_stamp":"2024-09-14T11:23:03.611555+0000","last_deep_scrub":"260'377","last_deep_scrub_stamp":"2024-09-14T11:23:03.611555+0000","last_clean_scrub_stamp":"2024-09-14T11:23:03.611555+0000","objects_scrubbed":9,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:46.384126+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":598,"num_read_kb":61894,"num_write":1162,"num_write_kb":33123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"260'401","reported_seq":2019,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:07.627716+0000","last_change":"2024-09-14T11:23:07.627716+0000","last_active":"2024-09-14T11:23:07.627716+0000","last_peered":"2024-09-14T11:23:07.627716+0000","last_clean":"2024-09-14T11:23:07.627716+0000","last_became_active":"2024-09-14T10:45:45.714345+0000","last_became_peered":"2024-09-14T10:45:45.714345+0000","last_unstale":"2024-09-14T11:23:07.627716+0000","last_undegraded":"2024-09-14T11:23:07.627716+0000","last_fullsized":"2024-09-14T11:23:07.627716+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'401","last_scrub_stamp":"2024-09-14T11:23:07.627629+0000","last_deep_scrub":"260'401","last_deep_scrub_stamp":"2024-09-14T11:23:07.627629+0000","last_clean_scrub_stamp":"2024-09-14T11:23:07.627629+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:58:14.580406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2395,"num_read_kb":2287,"num_write":454,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"260'361","reported_seq":1026,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:01.177685+0000","last_change":"2024-09-14T11:23:01.177616+0000","last_active":"2024-09-14T11:23:01.177685+0000","last_peered":"2024-09-14T11:23:01.177685+0000","last_clean":"2024-09-14T11:23:01.177685+0000","last_became_active":"2024-09-14T10:45:43.689513+0000","last_became_peered":"2024-09-14T10:45:43.689513+0000","last_unstale":"2024-09-14T11:23:01.177685+0000","last_undegraded":"2024-09-14T11:23:01.177685+0000","last_fullsized":"2024-09-14T11:23:01.177685+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'361","last_scrub_stamp":"2024-09-14T11:23:01.177512+0000","last_deep_scrub":"260'361","last_deep_scrub_stamp":"2024-09-14T11:23:01.177512+0000","last_clean_scrub_stamp":"2024-09-14T11:23:01.177512+0000","objects_scrubbed":6,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:32.647394+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":492096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":689,"num_read_kb":58877,"num_write":1198,"num_write_kb":34980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"260'913","reported_seq":2793,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:10.646748+0000","last_change":"2024-09-14T11:23:10.646694+0000","last_active":"2024-09-14T11:23:10.646748+0000","last_peered":"2024-09-14T11:23:10.646748+0000","last_clean":"2024-09-14T11:23:10.646748+0000","last_became_active":"2024-09-14T10:45:45.722048+0000","last_became_peered":"2024-09-14T10:45:45.722048+0000","last_unstale":"2024-09-14T11:23:10.646748+0000","last_undegraded":"2024-09-14T11:23:10.646748+0000","last_fullsized":"2024-09-14T11:23:10.646748+0000","mapping_epoch":26,"log_start":"260'900","ondisk_log_start":"260'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'913","last_scrub_stamp":"2024-09-14T11:23:10.646599+0000","last_deep_scrub":"260'913","last_deep_scrub_stamp":"2024-09-14T11:23:10.646599+0000","last_clean_scrub_stamp":"2024-09-14T11:23:10.646599+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":900,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:43.954240+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4452,"num_read_kb":4058,"num_write":1175,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":735,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"260'370","reported_seq":1013,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:59.523833+0000","last_change":"2024-09-14T11:22:59.523764+0000","last_active":"2024-09-14T11:22:59.523833+0000","last_peered":"2024-09-14T11:22:59.523833+0000","last_clean":"2024-09-14T11:22:59.523833+0000","last_became_active":"2024-09-14T10:45:43.689229+0000","last_became_peered":"2024-09-14T10:45:43.689229+0000","last_unstale":"2024-09-14T11:22:59.523833+0000","last_undegraded":"2024-09-14T11:22:59.523833+0000","last_fullsized":"2024-09-14T11:22:59.523833+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'370","last_scrub_stamp":"2024-09-14T11:22:59.523641+0000","last_deep_scrub":"260'370","last_deep_scrub_stamp":"2024-09-14T11:22:59.523641+0000","last_clean_scrub_stamp":"2024-09-14T11:22:59.523641+0000","objects_scrubbed":5,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:54.893522+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":599,"num_read_kb":84854,"num_write":1153,"num_write_kb":20352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"260'522","reported_seq":2116,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:06.256202+0000","last_change":"2024-09-14T11:23:06.256140+0000","last_active":"2024-09-14T11:23:06.256202+0000","last_peered":"2024-09-14T11:23:06.256202+0000","last_clean":"2024-09-14T11:23:06.256202+0000","last_became_active":"2024-09-14T10:45:45.718978+0000","last_became_peered":"2024-09-14T10:45:45.718978+0000","last_unstale":"2024-09-14T11:23:06.256202+0000","last_undegraded":"2024-09-14T11:23:06.256202+0000","last_fullsized":"2024-09-14T11:23:06.256202+0000","mapping_epoch":26,"log_start":"260'500","ondisk_log_start":"260'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'522","last_scrub_stamp":"2024-09-14T11:23:06.256050+0000","last_deep_scrub":"260'522","last_deep_scrub_stamp":"2024-09-14T11:23:06.256050+0000","last_clean_scrub_stamp":"2024-09-14T11:23:06.256050+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:20:05.550331+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2761,"num_read_kb":2575,"num_write":634,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"260'341","reported_seq":980,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:07.343841+0000","last_change":"2024-09-14T11:23:07.343744+0000","last_active":"2024-09-14T11:23:07.343841+0000","last_peered":"2024-09-14T11:23:07.343841+0000","last_clean":"2024-09-14T11:23:07.343841+0000","last_became_active":"2024-09-14T10:45:43.687262+0000","last_became_peered":"2024-09-14T10:45:43.687262+0000","last_unstale":"2024-09-14T11:23:07.343841+0000","last_undegraded":"2024-09-14T11:23:07.343841+0000","last_fullsized":"2024-09-14T11:23:07.343841+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'341","last_scrub_stamp":"2024-09-14T11:23:07.343639+0000","last_deep_scrub":"260'341","last_deep_scrub_stamp":"2024-09-14T11:23:07.343639+0000","last_clean_scrub_stamp":"2024-09-14T11:23:07.343639+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:20.970032+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":682,"num_read_kb":42631,"num_write":1158,"num_write_kb":32664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"260'824","reported_seq":2513,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:57.282317+0000","last_change":"2024-09-14T10:45:45.721713+0000","last_active":"2024-09-14T11:21:57.282317+0000","last_peered":"2024-09-14T11:21:57.282317+0000","last_clean":"2024-09-14T11:21:57.282317+0000","last_became_active":"2024-09-14T10:45:45.721400+0000","last_became_peered":"2024-09-14T10:45:45.721400+0000","last_unstale":"2024-09-14T11:21:57.282317+0000","last_undegraded":"2024-09-14T11:21:57.282317+0000","last_fullsized":"2024-09-14T11:21:57.282317+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4476,"num_read_kb":4082,"num_write":1140,"num_write_kb":477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"260'1280","reported_seq":2916,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.742305+0000","last_change":"2024-09-14T10:45:45.710286+0000","last_active":"2024-09-14T11:21:28.742305+0000","last_peered":"2024-09-14T11:21:28.742305+0000","last_clean":"2024-09-14T11:21:28.742305+0000","last_became_active":"2024-09-14T10:45:45.710015+0000","last_became_peered":"2024-09-14T10:45:45.710015+0000","last_unstale":"2024-09-14T11:21:28.742305+0000","last_undegraded":"2024-09-14T11:21:28.742305+0000","last_fullsized":"2024-09-14T11:21:28.742305+0000","mapping_epoch":26,"log_start":"260'1200","ondisk_log_start":"260'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":1200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5907,"num_read_kb":5227,"num_write":1779,"num_write_kb":739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"260'363","reported_seq":972,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:00.677668+0000","last_change":"2024-09-14T11:23:00.677668+0000","last_active":"2024-09-14T11:23:00.677668+0000","last_peered":"2024-09-14T11:23:00.677668+0000","last_clean":"2024-09-14T11:23:00.677668+0000","last_became_active":"2024-09-14T10:45:43.677751+0000","last_became_peered":"2024-09-14T10:45:43.677751+0000","last_unstale":"2024-09-14T11:23:00.677668+0000","last_undegraded":"2024-09-14T11:23:00.677668+0000","last_fullsized":"2024-09-14T11:23:00.677668+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'363","last_scrub_stamp":"2024-09-14T11:23:00.677578+0000","last_deep_scrub":"260'363","last_deep_scrub_stamp":"2024-09-14T11:23:00.677578+0000","last_clean_scrub_stamp":"2024-09-14T11:23:00.677578+0000","objects_scrubbed":3,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:46:20.373849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":554,"num_read_kb":880,"num_write":1155,"num_write_kb":23836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"260'598","reported_seq":2281,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:06.638146+0000","last_change":"2024-09-14T11:23:06.638084+0000","last_active":"2024-09-14T11:23:06.638146+0000","last_peered":"2024-09-14T11:23:06.638146+0000","last_clean":"2024-09-14T11:23:06.638146+0000","last_became_active":"2024-09-14T10:45:45.714551+0000","last_became_peered":"2024-09-14T10:45:45.714551+0000","last_unstale":"2024-09-14T11:23:06.638146+0000","last_undegraded":"2024-09-14T11:23:06.638146+0000","last_fullsized":"2024-09-14T11:23:06.638146+0000","mapping_epoch":26,"log_start":"260'500","ondisk_log_start":"260'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'598","last_scrub_stamp":"2024-09-14T11:23:06.637993+0000","last_deep_scrub":"260'598","last_deep_scrub_stamp":"2024-09-14T11:23:06.637993+0000","last_clean_scrub_stamp":"2024-09-14T11:23:06.637993+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":500,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:58.618707+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3058,"num_read_kb":2815,"num_write":741,"num_write_kb":205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":640,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"260'359","reported_seq":994,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:58.562307+0000","last_change":"2024-09-14T11:22:58.562307+0000","last_active":"2024-09-14T11:22:58.562307+0000","last_peered":"2024-09-14T11:22:58.562307+0000","last_clean":"2024-09-14T11:22:58.562307+0000","last_became_active":"2024-09-14T10:45:43.680355+0000","last_became_peered":"2024-09-14T10:45:43.680355+0000","last_unstale":"2024-09-14T11:22:58.562307+0000","last_undegraded":"2024-09-14T11:22:58.562307+0000","last_fullsized":"2024-09-14T11:22:58.562307+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'359","last_scrub_stamp":"2024-09-14T11:22:58.562194+0000","last_deep_scrub":"260'359","last_deep_scrub_stamp":"2024-09-14T11:22:58.562194+0000","last_clean_scrub_stamp":"2024-09-14T11:22:58.562194+0000","objects_scrubbed":8,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:10.587335+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":541,"num_read_kb":36303,"num_write":1001,"num_write_kb":55095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"260'494","reported_seq":2172,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:09.584116+0000","last_change":"2024-09-14T11:23:09.584046+0000","last_active":"2024-09-14T11:23:09.584116+0000","last_peered":"2024-09-14T11:23:09.584116+0000","last_clean":"2024-09-14T11:23:09.584116+0000","last_became_active":"2024-09-14T10:45:45.720760+0000","last_became_peered":"2024-09-14T10:45:45.720760+0000","last_unstale":"2024-09-14T11:23:09.584116+0000","last_undegraded":"2024-09-14T11:23:09.584116+0000","last_fullsized":"2024-09-14T11:23:09.584116+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'494","last_scrub_stamp":"2024-09-14T11:23:09.583958+0000","last_deep_scrub":"260'494","last_deep_scrub_stamp":"2024-09-14T11:23:09.583958+0000","last_clean_scrub_stamp":"2024-09-14T11:23:09.583958+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:01:54.258924+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2631,"num_read_kb":2483,"num_write":574,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"260'388","reported_seq":1071,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:57.604997+0000","last_change":"2024-09-14T11:22:57.604997+0000","last_active":"2024-09-14T11:22:57.604997+0000","last_peered":"2024-09-14T11:22:57.604997+0000","last_clean":"2024-09-14T11:22:57.604997+0000","last_became_active":"2024-09-14T10:45:43.684428+0000","last_became_peered":"2024-09-14T10:45:43.684428+0000","last_unstale":"2024-09-14T11:22:57.604997+0000","last_undegraded":"2024-09-14T11:22:57.604997+0000","last_fullsized":"2024-09-14T11:22:57.604997+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'388","last_scrub_stamp":"2024-09-14T11:22:57.604909+0000","last_deep_scrub":"260'388","last_deep_scrub_stamp":"2024-09-14T11:22:57.604909+0000","last_clean_scrub_stamp":"2024-09-14T11:22:57.604909+0000","objects_scrubbed":4,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:01.600133+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133668,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":756,"num_read_kb":9043,"num_write":1222,"num_write_kb":18367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"260'487","reported_seq":2068,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:10.315984+0000","last_change":"2024-09-14T11:23:10.315984+0000","last_active":"2024-09-14T11:23:10.315984+0000","last_peered":"2024-09-14T11:23:10.315984+0000","last_clean":"2024-09-14T11:23:10.315984+0000","last_became_active":"2024-09-14T10:45:45.724302+0000","last_became_peered":"2024-09-14T10:45:45.724302+0000","last_unstale":"2024-09-14T11:23:10.315984+0000","last_undegraded":"2024-09-14T11:23:10.315984+0000","last_fullsized":"2024-09-14T11:23:10.315984+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'487","last_scrub_stamp":"2024-09-14T11:23:10.315849+0000","last_deep_scrub":"260'487","last_deep_scrub_stamp":"2024-09-14T11:23:10.315849+0000","last_clean_scrub_stamp":"2024-09-14T11:23:10.315849+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:37.803313+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2564,"num_read_kb":2400,"num_write":575,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":460,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"260'336","reported_seq":1031,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:01.602768+0000","last_change":"2024-09-14T11:23:01.602768+0000","last_active":"2024-09-14T11:23:01.602768+0000","last_peered":"2024-09-14T11:23:01.602768+0000","last_clean":"2024-09-14T11:23:01.602768+0000","last_became_active":"2024-09-14T10:45:43.683797+0000","last_became_peered":"2024-09-14T10:45:43.683797+0000","last_unstale":"2024-09-14T11:23:01.602768+0000","last_undegraded":"2024-09-14T11:23:01.602768+0000","last_fullsized":"2024-09-14T11:23:01.602768+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'336","last_scrub_stamp":"2024-09-14T11:23:01.602654+0000","last_deep_scrub":"260'336","last_deep_scrub_stamp":"2024-09-14T11:23:01.602654+0000","last_clean_scrub_stamp":"2024-09-14T11:23:01.602654+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:05.538860+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":715,"num_read_kb":8100,"num_write":1180,"num_write_kb":25345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"260'430","reported_seq":1966,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:57.282334+0000","last_change":"2024-09-14T10:45:45.723905+0000","last_active":"2024-09-14T11:21:57.282334+0000","last_peered":"2024-09-14T11:21:57.282334+0000","last_clean":"2024-09-14T11:21:57.282334+0000","last_became_active":"2024-09-14T10:45:45.723570+0000","last_became_peered":"2024-09-14T10:45:45.723570+0000","last_unstale":"2024-09-14T11:21:57.282334+0000","last_undegraded":"2024-09-14T11:21:57.282334+0000","last_fullsized":"2024-09-14T11:21:57.282334+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:29.680427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2400,"num_read_kb":2278,"num_write":489,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"260'442","reported_seq":1161,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:03.480235+0000","last_change":"2024-09-14T11:23:03.480235+0000","last_active":"2024-09-14T11:23:03.480235+0000","last_peered":"2024-09-14T11:23:03.480235+0000","last_clean":"2024-09-14T11:23:03.480235+0000","last_became_active":"2024-09-14T10:45:43.687585+0000","last_became_peered":"2024-09-14T10:45:43.687585+0000","last_unstale":"2024-09-14T11:23:03.480235+0000","last_undegraded":"2024-09-14T11:23:03.480235+0000","last_fullsized":"2024-09-14T11:23:03.480235+0000","mapping_epoch":23,"log_start":"260'400","ondisk_log_start":"260'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'442","last_scrub_stamp":"2024-09-14T11:23:03.480124+0000","last_deep_scrub":"260'442","last_deep_scrub_stamp":"2024-09-14T11:23:03.480124+0000","last_clean_scrub_stamp":"2024-09-14T11:23:03.480124+0000","objects_scrubbed":6,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:54.485427+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1137,"num_read_kb":1116,"num_write":1403,"num_write_kb":30799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"260'801","reported_seq":2456,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:06.591124+0000","last_change":"2024-09-14T11:23:06.591124+0000","last_active":"2024-09-14T11:23:06.591124+0000","last_peered":"2024-09-14T11:23:06.591124+0000","last_clean":"2024-09-14T11:23:06.591124+0000","last_became_active":"2024-09-14T10:45:45.714187+0000","last_became_peered":"2024-09-14T10:45:45.714187+0000","last_unstale":"2024-09-14T11:23:06.591124+0000","last_undegraded":"2024-09-14T11:23:06.591124+0000","last_fullsized":"2024-09-14T11:23:06.591124+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'801","last_scrub_stamp":"2024-09-14T11:23:06.591022+0000","last_deep_scrub":"260'801","last_deep_scrub_stamp":"2024-09-14T11:23:06.591022+0000","last_clean_scrub_stamp":"2024-09-14T11:23:06.591022+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:23.740415+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3909,"num_read_kb":3562,"num_write":1036,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":245,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"260'348","reported_seq":996,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:00.520173+0000","last_change":"2024-09-14T11:23:00.520074+0000","last_active":"2024-09-14T11:23:00.520173+0000","last_peered":"2024-09-14T11:23:00.520173+0000","last_clean":"2024-09-14T11:23:00.520173+0000","last_became_active":"2024-09-14T10:45:43.681680+0000","last_became_peered":"2024-09-14T10:45:43.681680+0000","last_unstale":"2024-09-14T11:23:00.520173+0000","last_undegraded":"2024-09-14T11:23:00.520173+0000","last_fullsized":"2024-09-14T11:23:00.520173+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'348","last_scrub_stamp":"2024-09-14T11:23:00.519964+0000","last_deep_scrub":"260'348","last_deep_scrub_stamp":"2024-09-14T11:23:00.519964+0000","last_clean_scrub_stamp":"2024-09-14T11:23:00.519964+0000","objects_scrubbed":3,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:19:01.552760+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":572,"num_read_kb":80059,"num_write":1115,"num_write_kb":31213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"260'166","reported_seq":655,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.801186+0000","last_change":"2024-09-14T10:45:53.749801+0000","last_active":"2024-09-14T11:21:28.801186+0000","last_peered":"2024-09-14T11:21:28.801186+0000","last_clean":"2024-09-14T11:21:28.801186+0000","last_became_active":"2024-09-14T10:45:53.749495+0000","last_became_peered":"2024-09-14T10:45:53.749495+0000","last_unstale":"2024-09-14T11:21:28.801186+0000","last_undegraded":"2024-09-14T11:21:28.801186+0000","last_fullsized":"2024-09-14T11:21:28.801186+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:52.768692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":160,"num_read_kb":158,"num_write":391,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"260'885","reported_seq":2461,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:08.342104+0000","last_change":"2024-09-14T11:23:08.342014+0000","last_active":"2024-09-14T11:23:08.342104+0000","last_peered":"2024-09-14T11:23:08.342104+0000","last_clean":"2024-09-14T11:23:08.342104+0000","last_became_active":"2024-09-14T10:45:45.710830+0000","last_became_peered":"2024-09-14T10:45:45.710830+0000","last_unstale":"2024-09-14T11:23:08.342104+0000","last_undegraded":"2024-09-14T11:23:08.342104+0000","last_fullsized":"2024-09-14T11:23:08.342104+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'885","last_scrub_stamp":"2024-09-14T11:23:08.341916+0000","last_deep_scrub":"260'885","last_deep_scrub_stamp":"2024-09-14T11:23:08.341916+0000","last_clean_scrub_stamp":"2024-09-14T11:23:08.341916+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":800,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:21.880977+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5905,"num_read_kb":5530,"num_write":1368,"num_write_kb":537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"260'450","reported_seq":1134,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:05.189040+0000","last_change":"2024-09-14T11:23:05.188952+0000","last_active":"2024-09-14T11:23:05.189040+0000","last_peered":"2024-09-14T11:23:05.189040+0000","last_clean":"2024-09-14T11:23:05.189040+0000","last_became_active":"2024-09-14T10:45:43.684504+0000","last_became_peered":"2024-09-14T10:45:43.684504+0000","last_unstale":"2024-09-14T11:23:05.189040+0000","last_undegraded":"2024-09-14T11:23:05.189040+0000","last_fullsized":"2024-09-14T11:23:05.189040+0000","mapping_epoch":23,"log_start":"260'400","ondisk_log_start":"260'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'450","last_scrub_stamp":"2024-09-14T11:23:05.188789+0000","last_deep_scrub":"260'450","last_deep_scrub_stamp":"2024-09-14T11:23:05.188789+0000","last_clean_scrub_stamp":"2024-09-14T11:23:05.188789+0000","objects_scrubbed":9,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:06.893489+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133694,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":846,"num_read_kb":75778,"num_write":1426,"num_write_kb":37052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:37.113110+0000","last_change":"2024-09-14T10:45:47.730971+0000","last_active":"2024-09-14T11:19:37.113110+0000","last_peered":"2024-09-14T11:19:37.113110+0000","last_clean":"2024-09-14T11:19:37.113110+0000","last_became_active":"2024-09-14T10:45:47.730629+0000","last_became_peered":"2024-09-14T10:45:47.730629+0000","last_unstale":"2024-09-14T11:19:37.113110+0000","last_undegraded":"2024-09-14T11:19:37.113110+0000","last_fullsized":"2024-09-14T11:19:37.113110+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:32.300839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"260'333","reported_seq":920,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.380130+0000","last_change":"2024-09-14T10:45:49.734204+0000","last_active":"2024-09-14T11:22:50.380130+0000","last_peered":"2024-09-14T11:22:50.380130+0000","last_clean":"2024-09-14T11:22:50.380130+0000","last_became_active":"2024-09-14T10:45:49.733770+0000","last_became_peered":"2024-09-14T10:45:49.733770+0000","last_unstale":"2024-09-14T11:22:50.380130+0000","last_undegraded":"2024-09-14T11:22:50.380130+0000","last_fullsized":"2024-09-14T11:22:50.380130+0000","mapping_epoch":30,"log_start":"260'300","ondisk_log_start":"260'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:22:33.077712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49773,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":530,"num_read_kb":1113,"num_write":424,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":476,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:42.113693+0000","last_change":"2024-09-14T10:45:51.745748+0000","last_active":"2024-09-14T11:19:42.113693+0000","last_peered":"2024-09-14T11:19:42.113693+0000","last_clean":"2024-09-14T11:19:42.113693+0000","last_became_active":"2024-09-14T10:45:51.745410+0000","last_became_peered":"2024-09-14T10:45:51.745410+0000","last_unstale":"2024-09-14T11:19:42.113693+0000","last_undegraded":"2024-09-14T11:19:42.113693+0000","last_fullsized":"2024-09-14T11:19:42.113693+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:18.010792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"260'94","reported_seq":570,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:57.443244+0000","last_change":"2024-09-14T10:45:53.743811+0000","last_active":"2024-09-14T11:20:57.443244+0000","last_peered":"2024-09-14T11:20:57.443244+0000","last_clean":"2024-09-14T11:20:57.443244+0000","last_became_active":"2024-09-14T10:45:53.743472+0000","last_became_peered":"2024-09-14T10:45:53.743472+0000","last_unstale":"2024-09-14T11:20:57.443244+0000","last_undegraded":"2024-09-14T11:20:57.443244+0000","last_fullsized":"2024-09-14T11:20:57.443244+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:52.958224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":73,"num_read_kb":72,"num_write":215,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"260'380","reported_seq":1794,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:16.212298+0000","last_change":"2024-09-14T11:23:16.212298+0000","last_active":"2024-09-14T11:23:16.212298+0000","last_peered":"2024-09-14T11:23:16.212298+0000","last_clean":"2024-09-14T11:23:16.212298+0000","last_became_active":"2024-09-14T10:45:45.713502+0000","last_became_peered":"2024-09-14T10:45:45.713502+0000","last_unstale":"2024-09-14T11:23:16.212298+0000","last_undegraded":"2024-09-14T11:23:16.212298+0000","last_fullsized":"2024-09-14T11:23:16.212298+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'380","last_scrub_stamp":"2024-09-14T11:23:16.212209+0000","last_deep_scrub":"260'380","last_deep_scrub_stamp":"2024-09-14T11:23:16.212209+0000","last_clean_scrub_stamp":"2024-09-14T11:23:16.212209+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:05.789118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2020,"num_read_kb":1909,"num_write":423,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"260'306","reported_seq":1044,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:57.547642+0000","last_change":"2024-09-14T11:22:57.547580+0000","last_active":"2024-09-14T11:22:57.547642+0000","last_peered":"2024-09-14T11:22:57.547642+0000","last_clean":"2024-09-14T11:22:57.547642+0000","last_became_active":"2024-09-14T10:45:43.683964+0000","last_became_peered":"2024-09-14T10:45:43.683964+0000","last_unstale":"2024-09-14T11:22:57.547642+0000","last_undegraded":"2024-09-14T11:22:57.547642+0000","last_fullsized":"2024-09-14T11:22:57.547642+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'306","last_scrub_stamp":"2024-09-14T11:22:57.547454+0000","last_deep_scrub":"260'306","last_deep_scrub_stamp":"2024-09-14T11:22:57.547454+0000","last_clean_scrub_stamp":"2024-09-14T11:22:57.547454+0000","objects_scrubbed":7,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:59.621447+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133715,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":687,"num_read_kb":39643,"num_write":1073,"num_write_kb":23617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":485,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:56.128156+0000","last_change":"2024-09-14T10:45:47.730176+0000","last_active":"2024-09-14T11:20:56.128156+0000","last_peered":"2024-09-14T11:20:56.128156+0000","last_clean":"2024-09-14T11:20:56.128156+0000","last_became_active":"2024-09-14T10:45:47.729871+0000","last_became_peered":"2024-09-14T10:45:47.729871+0000","last_unstale":"2024-09-14T11:20:56.128156+0000","last_undegraded":"2024-09-14T11:20:56.128156+0000","last_fullsized":"2024-09-14T11:20:56.128156+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"260'87","reported_seq":603,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:16.577922+0000","last_change":"2024-09-14T11:23:16.577922+0000","last_active":"2024-09-14T11:23:16.577922+0000","last_peered":"2024-09-14T11:23:16.577922+0000","last_clean":"2024-09-14T11:23:16.577922+0000","last_became_active":"2024-09-14T10:45:49.732459+0000","last_became_peered":"2024-09-14T10:45:49.732459+0000","last_unstale":"2024-09-14T11:23:16.577922+0000","last_undegraded":"2024-09-14T11:23:16.577922+0000","last_fullsized":"2024-09-14T11:23:16.577922+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'87","last_scrub_stamp":"2024-09-14T11:23:16.577822+0000","last_deep_scrub":"260'87","last_deep_scrub_stamp":"2024-09-14T11:23:16.577822+0000","last_clean_scrub_stamp":"2024-09-14T11:23:16.577822+0000","objects_scrubbed":3,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:42.355440+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":84,"num_read_kb":79,"num_write":56,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":476,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:42.113623+0000","last_change":"2024-09-14T10:45:51.746902+0000","last_active":"2024-09-14T11:19:42.113623+0000","last_peered":"2024-09-14T11:19:42.113623+0000","last_clean":"2024-09-14T11:19:42.113623+0000","last_became_active":"2024-09-14T10:45:51.746608+0000","last_became_peered":"2024-09-14T10:45:51.746608+0000","last_unstale":"2024-09-14T11:19:42.113623+0000","last_undegraded":"2024-09-14T11:19:42.113623+0000","last_fullsized":"2024-09-14T11:19:42.113623+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:13.144965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"260'127","reported_seq":616,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:14.680398+0000","last_change":"2024-09-14T10:45:53.752864+0000","last_active":"2024-09-14T11:21:14.680398+0000","last_peered":"2024-09-14T11:21:14.680398+0000","last_clean":"2024-09-14T11:21:14.680398+0000","last_became_active":"2024-09-14T10:45:53.752597+0000","last_became_peered":"2024-09-14T10:45:53.752597+0000","last_unstale":"2024-09-14T11:21:14.680398+0000","last_undegraded":"2024-09-14T11:21:14.680398+0000","last_fullsized":"2024-09-14T11:21:14.680398+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:09.921876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":152,"num_read_kb":142,"num_write":295,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"260'1285","reported_seq":2999,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:13.319725+0000","last_change":"2024-09-14T11:23:13.319725+0000","last_active":"2024-09-14T11:23:13.319725+0000","last_peered":"2024-09-14T11:23:13.319725+0000","last_clean":"2024-09-14T11:23:13.319725+0000","last_became_active":"2024-09-14T10:45:45.725335+0000","last_became_peered":"2024-09-14T10:45:45.725335+0000","last_unstale":"2024-09-14T11:23:13.319725+0000","last_undegraded":"2024-09-14T11:23:13.319725+0000","last_fullsized":"2024-09-14T11:23:13.319725+0000","mapping_epoch":26,"log_start":"260'1200","ondisk_log_start":"260'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1285","last_scrub_stamp":"2024-09-14T11:23:13.319628+0000","last_deep_scrub":"260'1285","last_deep_scrub_stamp":"2024-09-14T11:23:13.319628+0000","last_clean_scrub_stamp":"2024-09-14T11:23:13.319628+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":1200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:13:10.353579+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5911,"num_read_kb":5224,"num_write":1759,"num_write_kb":730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":714,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"260'352","reported_seq":1010,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:04.223440+0000","last_change":"2024-09-14T11:23:04.223378+0000","last_active":"2024-09-14T11:23:04.223440+0000","last_peered":"2024-09-14T11:23:04.223440+0000","last_clean":"2024-09-14T11:23:04.223440+0000","last_became_active":"2024-09-14T10:45:43.671096+0000","last_became_peered":"2024-09-14T10:45:43.671096+0000","last_unstale":"2024-09-14T11:23:04.223440+0000","last_undegraded":"2024-09-14T11:23:04.223440+0000","last_fullsized":"2024-09-14T11:23:04.223440+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'352","last_scrub_stamp":"2024-09-14T11:23:04.223284+0000","last_deep_scrub":"260'352","last_deep_scrub_stamp":"2024-09-14T11:23:04.223284+0000","last_clean_scrub_stamp":"2024-09-14T11:23:04.223284+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:49.941234+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":684,"num_read_kb":57141,"num_write":1087,"num_write_kb":43933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:41.118430+0000","last_change":"2024-09-14T10:45:47.725982+0000","last_active":"2024-09-14T11:19:41.118430+0000","last_peered":"2024-09-14T11:19:41.118430+0000","last_clean":"2024-09-14T11:19:41.118430+0000","last_became_active":"2024-09-14T10:45:47.724723+0000","last_became_peered":"2024-09-14T10:45:47.724723+0000","last_unstale":"2024-09-14T11:19:41.118430+0000","last_undegraded":"2024-09-14T11:19:41.118430+0000","last_fullsized":"2024-09-14T11:19:41.118430+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:05.411328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"260'110","reported_seq":627,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:10.527384+0000","last_change":"2024-09-14T10:45:49.738230+0000","last_active":"2024-09-14T11:21:10.527384+0000","last_peered":"2024-09-14T11:21:10.527384+0000","last_clean":"2024-09-14T11:21:10.527384+0000","last_became_active":"2024-09-14T10:45:49.737651+0000","last_became_peered":"2024-09-14T10:45:49.737651+0000","last_unstale":"2024-09-14T11:21:10.527384+0000","last_undegraded":"2024-09-14T11:21:10.527384+0000","last_fullsized":"2024-09-14T11:21:10.527384+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":106,"num_write":82,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"260'808","reported_seq":4493,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.153298+0000","last_change":"2024-09-14T10:45:51.746239+0000","last_active":"2024-09-14T11:22:51.153298+0000","last_peered":"2024-09-14T11:22:51.153298+0000","last_clean":"2024-09-14T11:22:51.153298+0000","last_became_active":"2024-09-14T10:45:51.745441+0000","last_became_peered":"2024-09-14T10:45:51.745441+0000","last_unstale":"2024-09-14T11:22:51.153298+0000","last_undegraded":"2024-09-14T11:22:51.153298+0000","last_fullsized":"2024-09-14T11:22:51.153298+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:37.532791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"260'211","reported_seq":1016,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.737613+0000","last_change":"2024-09-14T10:45:53.753718+0000","last_active":"2024-09-14T11:21:28.737613+0000","last_peered":"2024-09-14T11:21:28.737613+0000","last_clean":"2024-09-14T11:21:28.737613+0000","last_became_active":"2024-09-14T10:45:53.753389+0000","last_became_peered":"2024-09-14T10:45:53.753389+0000","last_unstale":"2024-09-14T11:21:28.737613+0000","last_undegraded":"2024-09-14T11:21:28.737613+0000","last_fullsized":"2024-09-14T11:21:28.737613+0000","mapping_epoch":34,"log_start":"260'200","ondisk_log_start":"260'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:01.726415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":623,"num_read_kb":614,"num_write":459,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"260'902","reported_seq":2545,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:12.363681+0000","last_change":"2024-09-14T11:23:12.363681+0000","last_active":"2024-09-14T11:23:12.363681+0000","last_peered":"2024-09-14T11:23:12.363681+0000","last_clean":"2024-09-14T11:23:12.363681+0000","last_became_active":"2024-09-14T10:45:45.725700+0000","last_became_peered":"2024-09-14T10:45:45.725700+0000","last_unstale":"2024-09-14T11:23:12.363681+0000","last_undegraded":"2024-09-14T11:23:12.363681+0000","last_fullsized":"2024-09-14T11:23:12.363681+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'902","last_scrub_stamp":"2024-09-14T11:23:12.363569+0000","last_deep_scrub":"260'902","last_deep_scrub_stamp":"2024-09-14T11:23:12.363569+0000","last_clean_scrub_stamp":"2024-09-14T11:23:12.363569+0000","objects_scrubbed":2,"log_size":102,"log_dups_size":800,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:00:47.995104+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4396,"num_read_kb":3931,"num_write":1208,"num_write_kb":463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2043,"num_omap_keys":8,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"260'381","reported_seq":1029,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:56.685332+0000","last_change":"2024-09-14T11:22:56.685284+0000","last_active":"2024-09-14T11:22:56.685332+0000","last_peered":"2024-09-14T11:22:56.685332+0000","last_clean":"2024-09-14T11:22:56.685332+0000","last_became_active":"2024-09-14T10:45:43.683274+0000","last_became_peered":"2024-09-14T10:45:43.683274+0000","last_unstale":"2024-09-14T11:22:56.685332+0000","last_undegraded":"2024-09-14T11:22:56.685332+0000","last_fullsized":"2024-09-14T11:22:56.685332+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'381","last_scrub_stamp":"2024-09-14T11:22:56.685220+0000","last_deep_scrub":"260'381","last_deep_scrub_stamp":"2024-09-14T11:22:56.685220+0000","last_clean_scrub_stamp":"2024-09-14T11:22:56.685220+0000","objects_scrubbed":4,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:15.447942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":697,"num_read_kb":4530,"num_write":1135,"num_write_kb":39150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:37.113128+0000","last_change":"2024-09-14T10:45:47.729291+0000","last_active":"2024-09-14T11:19:37.113128+0000","last_peered":"2024-09-14T11:19:37.113128+0000","last_clean":"2024-09-14T11:19:37.113128+0000","last_became_active":"2024-09-14T10:45:47.729004+0000","last_became_peered":"2024-09-14T10:45:47.729004+0000","last_unstale":"2024-09-14T11:19:37.113128+0000","last_undegraded":"2024-09-14T11:19:37.113128+0000","last_fullsized":"2024-09-14T11:19:37.113128+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:50:40.551460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"260'260","reported_seq":812,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:11.406541+0000","last_change":"2024-09-14T11:23:11.406541+0000","last_active":"2024-09-14T11:23:11.406541+0000","last_peered":"2024-09-14T11:23:11.406541+0000","last_clean":"2024-09-14T11:23:11.406541+0000","last_became_active":"2024-09-14T10:45:49.728896+0000","last_became_peered":"2024-09-14T10:45:49.728896+0000","last_unstale":"2024-09-14T11:23:11.406541+0000","last_undegraded":"2024-09-14T11:23:11.406541+0000","last_fullsized":"2024-09-14T11:23:11.406541+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'260","last_scrub_stamp":"2024-09-14T11:23:11.406439+0000","last_deep_scrub":"260'260","last_deep_scrub_stamp":"2024-09-14T11:23:11.406439+0000","last_clean_scrub_stamp":"2024-09-14T11:23:11.406439+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:13.056696+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42620,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":444,"num_read_kb":1063,"num_write":366,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"260'804","reported_seq":3877,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.496503+0000","last_change":"2024-09-14T10:45:51.745148+0000","last_active":"2024-09-14T11:22:51.496503+0000","last_peered":"2024-09-14T11:22:51.496503+0000","last_clean":"2024-09-14T11:22:51.496503+0000","last_became_active":"2024-09-14T10:45:51.744510+0000","last_became_peered":"2024-09-14T10:45:51.744510+0000","last_unstale":"2024-09-14T11:22:51.496503+0000","last_undegraded":"2024-09-14T11:22:51.496503+0000","last_fullsized":"2024-09-14T11:22:51.496503+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":700,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"260'641","reported_seq":2336,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:13.170714+0000","last_change":"2024-09-14T11:23:13.170714+0000","last_active":"2024-09-14T11:23:13.170714+0000","last_peered":"2024-09-14T11:23:13.170714+0000","last_clean":"2024-09-14T11:23:13.170714+0000","last_became_active":"2024-09-14T10:45:45.716537+0000","last_became_peered":"2024-09-14T10:45:45.716537+0000","last_unstale":"2024-09-14T11:23:13.170714+0000","last_undegraded":"2024-09-14T11:23:13.170714+0000","last_fullsized":"2024-09-14T11:23:13.170714+0000","mapping_epoch":26,"log_start":"260'600","ondisk_log_start":"260'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'641","last_scrub_stamp":"2024-09-14T11:23:13.170614+0000","last_deep_scrub":"260'641","last_deep_scrub_stamp":"2024-09-14T11:23:13.170614+0000","last_clean_scrub_stamp":"2024-09-14T11:23:13.170614+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":600,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:09.840189+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3192,"num_read_kb":2926,"num_write":775,"num_write_kb":229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1720,"num_omap_keys":8,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"260'311","reported_seq":921,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:59.747594+0000","last_change":"2024-09-14T11:22:59.747594+0000","last_active":"2024-09-14T11:22:59.747594+0000","last_peered":"2024-09-14T11:22:59.747594+0000","last_clean":"2024-09-14T11:22:59.747594+0000","last_became_active":"2024-09-14T10:46:20.045945+0000","last_became_peered":"2024-09-14T10:46:20.045945+0000","last_unstale":"2024-09-14T11:22:59.747594+0000","last_undegraded":"2024-09-14T11:22:59.747594+0000","last_fullsized":"2024-09-14T11:22:59.747594+0000","mapping_epoch":37,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'311","last_scrub_stamp":"2024-09-14T11:22:59.747508+0000","last_deep_scrub":"260'311","last_deep_scrub_stamp":"2024-09-14T11:22:59.747508+0000","last_clean_scrub_stamp":"2024-09-14T11:22:59.747508+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":200,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:23.526580+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":633,"num_read_kb":12757,"num_write":988,"num_write_kb":36887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":494,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:10.598893+0000","last_change":"2024-09-14T11:23:10.598893+0000","last_active":"2024-09-14T11:23:10.598893+0000","last_peered":"2024-09-14T11:23:10.598893+0000","last_clean":"2024-09-14T11:23:10.598893+0000","last_became_active":"2024-09-14T10:45:47.720639+0000","last_became_peered":"2024-09-14T10:45:47.720639+0000","last_unstale":"2024-09-14T11:23:10.598893+0000","last_undegraded":"2024-09-14T11:23:10.598893+0000","last_fullsized":"2024-09-14T11:23:10.598893+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:10.598806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:10.598806+0000","last_clean_scrub_stamp":"2024-09-14T11:23:10.598806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:01.115042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"260'357","reported_seq":957,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:14.636173+0000","last_change":"2024-09-14T11:23:14.636173+0000","last_active":"2024-09-14T11:23:14.636173+0000","last_peered":"2024-09-14T11:23:14.636173+0000","last_clean":"2024-09-14T11:23:14.636173+0000","last_became_active":"2024-09-14T10:45:49.732754+0000","last_became_peered":"2024-09-14T10:45:49.732754+0000","last_unstale":"2024-09-14T11:23:14.636173+0000","last_undegraded":"2024-09-14T11:23:14.636173+0000","last_fullsized":"2024-09-14T11:23:14.636173+0000","mapping_epoch":30,"log_start":"260'300","ondisk_log_start":"260'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'357","last_scrub_stamp":"2024-09-14T11:23:14.636077+0000","last_deep_scrub":"260'357","last_deep_scrub_stamp":"2024-09-14T11:23:14.636077+0000","last_clean_scrub_stamp":"2024-09-14T11:23:14.636077+0000","objects_scrubbed":10,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:57.050795+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99406,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":572,"num_read_kb":1321,"num_write":460,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":471,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:35.986676+0000","last_change":"2024-09-14T10:45:51.746554+0000","last_active":"2024-09-14T11:19:35.986676+0000","last_peered":"2024-09-14T11:19:35.986676+0000","last_clean":"2024-09-14T11:19:35.986676+0000","last_became_active":"2024-09-14T10:45:51.746282+0000","last_became_peered":"2024-09-14T10:45:51.746282+0000","last_unstale":"2024-09-14T11:19:35.986676+0000","last_undegraded":"2024-09-14T11:19:35.986676+0000","last_fullsized":"2024-09-14T11:19:35.986676+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:58.772084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"260'557","reported_seq":1354,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:43.728730+0000","last_change":"2024-09-14T10:45:53.756022+0000","last_active":"2024-09-14T11:22:43.728730+0000","last_peered":"2024-09-14T11:22:43.728730+0000","last_clean":"2024-09-14T11:22:43.728730+0000","last_became_active":"2024-09-14T10:45:53.755505+0000","last_became_peered":"2024-09-14T10:45:53.755505+0000","last_unstale":"2024-09-14T11:22:43.728730+0000","last_undegraded":"2024-09-14T11:22:43.728730+0000","last_fullsized":"2024-09-14T11:22:43.728730+0000","mapping_epoch":34,"log_start":"260'500","ondisk_log_start":"260'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:02.468804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1310,"num_read_kb":1299,"num_write":1164,"num_write_kb":395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"260'608","reported_seq":2252,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:01.654181+0000","last_change":"2024-09-14T11:23:01.654181+0000","last_active":"2024-09-14T11:23:01.654181+0000","last_peered":"2024-09-14T11:23:01.654181+0000","last_clean":"2024-09-14T11:23:01.654181+0000","last_became_active":"2024-09-14T10:45:45.726869+0000","last_became_peered":"2024-09-14T10:45:45.726869+0000","last_unstale":"2024-09-14T11:23:01.654181+0000","last_undegraded":"2024-09-14T11:23:01.654181+0000","last_fullsized":"2024-09-14T11:23:01.654181+0000","mapping_epoch":26,"log_start":"260'500","ondisk_log_start":"260'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'608","last_scrub_stamp":"2024-09-14T11:23:01.654096+0000","last_deep_scrub":"260'608","last_deep_scrub_stamp":"2024-09-14T11:23:01.654096+0000","last_clean_scrub_stamp":"2024-09-14T11:23:01.654096+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":500,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:34.095164+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3274,"num_read_kb":2999,"num_write":839,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"260'390","reported_seq":1058,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:57.186256+0000","last_change":"2024-09-14T11:22:57.186256+0000","last_active":"2024-09-14T11:22:57.186256+0000","last_peered":"2024-09-14T11:22:57.186256+0000","last_clean":"2024-09-14T11:22:57.186256+0000","last_became_active":"2024-09-14T10:45:43.685087+0000","last_became_peered":"2024-09-14T10:45:43.685087+0000","last_unstale":"2024-09-14T11:22:57.186256+0000","last_undegraded":"2024-09-14T11:22:57.186256+0000","last_fullsized":"2024-09-14T11:22:57.186256+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'390","last_scrub_stamp":"2024-09-14T11:22:57.186147+0000","last_deep_scrub":"260'390","last_deep_scrub_stamp":"2024-09-14T11:22:57.186147+0000","last_clean_scrub_stamp":"2024-09-14T11:22:57.186147+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:33.020000+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":736,"num_read_kb":49067,"num_write":1293,"num_write_kb":21177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:11.277931+0000","last_change":"2024-09-14T11:23:11.277931+0000","last_active":"2024-09-14T11:23:11.277931+0000","last_peered":"2024-09-14T11:23:11.277931+0000","last_clean":"2024-09-14T11:23:11.277931+0000","last_became_active":"2024-09-14T10:45:47.727250+0000","last_became_peered":"2024-09-14T10:45:47.727250+0000","last_unstale":"2024-09-14T11:23:11.277931+0000","last_undegraded":"2024-09-14T11:23:11.277931+0000","last_fullsized":"2024-09-14T11:23:11.277931+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:11.277843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:11.277843+0000","last_clean_scrub_stamp":"2024-09-14T11:23:11.277843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:58:14.240440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"260'256","reported_seq":810,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.980108+0000","last_change":"2024-09-14T10:45:49.735628+0000","last_active":"2024-09-14T11:22:50.980108+0000","last_peered":"2024-09-14T11:22:50.980108+0000","last_clean":"2024-09-14T11:22:50.980108+0000","last_became_active":"2024-09-14T10:45:49.735124+0000","last_became_peered":"2024-09-14T10:45:49.735124+0000","last_unstale":"2024-09-14T11:22:50.980108+0000","last_undegraded":"2024-09-14T11:22:50.980108+0000","last_fullsized":"2024-09-14T11:22:50.980108+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:52.071424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45256,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":435,"num_read_kb":1035,"num_write":356,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:36.125222+0000","last_change":"2024-09-14T10:45:51.745912+0000","last_active":"2024-09-14T11:20:36.125222+0000","last_peered":"2024-09-14T11:20:36.125222+0000","last_clean":"2024-09-14T11:20:36.125222+0000","last_became_active":"2024-09-14T10:45:51.744757+0000","last_became_peered":"2024-09-14T10:45:51.744757+0000","last_unstale":"2024-09-14T11:20:36.125222+0000","last_undegraded":"2024-09-14T11:20:36.125222+0000","last_fullsized":"2024-09-14T11:20:36.125222+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:15.473173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"260'2449","reported_seq":4259,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:57.283800+0000","last_change":"2024-09-14T10:45:53.753015+0000","last_active":"2024-09-14T11:21:57.283800+0000","last_peered":"2024-09-14T11:21:57.283800+0000","last_clean":"2024-09-14T11:21:57.283800+0000","last_became_active":"2024-09-14T10:45:53.752708+0000","last_became_peered":"2024-09-14T10:45:53.752708+0000","last_unstale":"2024-09-14T11:21:57.283800+0000","last_undegraded":"2024-09-14T11:21:57.283800+0000","last_fullsized":"2024-09-14T11:21:57.283800+0000","mapping_epoch":34,"log_start":"260'2400","ondisk_log_start":"260'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":2400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:01:55.437550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6140,"num_read_kb":6145,"num_write":4932,"num_write_kb":1822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"260'761","reported_seq":2474,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:08.293507+0000","last_change":"2024-09-14T11:23:08.293507+0000","last_active":"2024-09-14T11:23:08.293507+0000","last_peered":"2024-09-14T11:23:08.293507+0000","last_clean":"2024-09-14T11:23:08.293507+0000","last_became_active":"2024-09-14T10:45:45.722006+0000","last_became_peered":"2024-09-14T10:45:45.722006+0000","last_unstale":"2024-09-14T11:23:08.293507+0000","last_undegraded":"2024-09-14T11:23:08.293507+0000","last_fullsized":"2024-09-14T11:23:08.293507+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'761","last_scrub_stamp":"2024-09-14T11:23:08.293416+0000","last_deep_scrub":"260'761","last_deep_scrub_stamp":"2024-09-14T11:23:08.293416+0000","last_clean_scrub_stamp":"2024-09-14T11:23:08.293416+0000","objects_scrubbed":4,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:13:56.536477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4059,"num_read_kb":3717,"num_write":984,"num_write_kb":359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4086,"num_omap_keys":16,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"260'375","reported_seq":1021,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:02.277049+0000","last_change":"2024-09-14T11:23:02.277049+0000","last_active":"2024-09-14T11:23:02.277049+0000","last_peered":"2024-09-14T11:23:02.277049+0000","last_clean":"2024-09-14T11:23:02.277049+0000","last_became_active":"2024-09-14T10:45:43.675954+0000","last_became_peered":"2024-09-14T10:45:43.675954+0000","last_unstale":"2024-09-14T11:23:02.277049+0000","last_undegraded":"2024-09-14T11:23:02.277049+0000","last_fullsized":"2024-09-14T11:23:02.277049+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'375","last_scrub_stamp":"2024-09-14T11:23:02.276946+0000","last_deep_scrub":"260'375","last_deep_scrub_stamp":"2024-09-14T11:23:02.276946+0000","last_clean_scrub_stamp":"2024-09-14T11:23:02.276946+0000","objects_scrubbed":6,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:47.616118+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":645,"num_read_kb":32892,"num_write":1136,"num_write_kb":70045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"36'5","reported_seq":958,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.270306+0000","last_change":"2024-09-14T10:45:47.723683+0000","last_active":"2024-09-14T11:22:50.270306+0000","last_peered":"2024-09-14T11:22:50.270306+0000","last_clean":"2024-09-14T11:22:50.270306+0000","last_became_active":"2024-09-14T10:45:47.723389+0000","last_became_peered":"2024-09-14T10:45:47.723389+0000","last_unstale":"2024-09-14T11:22:50.270306+0000","last_undegraded":"2024-09-14T11:22:50.270306+0000","last_fullsized":"2024-09-14T11:22:50.270306+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:23.601158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"260'272","reported_seq":833,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.592950+0000","last_change":"2024-09-14T10:45:49.729401+0000","last_active":"2024-09-14T11:22:50.592950+0000","last_peered":"2024-09-14T11:22:50.592950+0000","last_clean":"2024-09-14T11:22:50.592950+0000","last_became_active":"2024-09-14T10:45:49.729120+0000","last_became_peered":"2024-09-14T10:45:49.729120+0000","last_unstale":"2024-09-14T11:22:50.592950+0000","last_undegraded":"2024-09-14T11:22:50.592950+0000","last_fullsized":"2024-09-14T11:22:50.592950+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:30.995395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43970,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":444,"num_read_kb":984,"num_write":354,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"260'804","reported_seq":2504,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.306405+0000","last_change":"2024-09-14T10:45:51.745170+0000","last_active":"2024-09-14T11:22:50.306405+0000","last_peered":"2024-09-14T11:22:50.306405+0000","last_clean":"2024-09-14T11:22:50.306405+0000","last_became_active":"2024-09-14T10:45:51.744869+0000","last_became_peered":"2024-09-14T10:45:51.744869+0000","last_unstale":"2024-09-14T11:22:50.306405+0000","last_undegraded":"2024-09-14T11:22:50.306405+0000","last_fullsized":"2024-09-14T11:22:50.306405+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":700,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:26.188815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"260'164","reported_seq":638,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.837357+0000","last_change":"2024-09-14T10:45:53.755630+0000","last_active":"2024-09-14T11:22:42.837357+0000","last_peered":"2024-09-14T11:22:42.837357+0000","last_clean":"2024-09-14T11:22:42.837357+0000","last_became_active":"2024-09-14T10:45:53.755367+0000","last_became_peered":"2024-09-14T10:45:53.755367+0000","last_unstale":"2024-09-14T11:22:42.837357+0000","last_undegraded":"2024-09-14T11:22:42.837357+0000","last_fullsized":"2024-09-14T11:22:42.837357+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:07:14.533708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":815,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":135,"num_read_kb":134,"num_write":407,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"260'763","reported_seq":2262,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:10.356193+0000","last_change":"2024-09-14T11:23:10.356193+0000","last_active":"2024-09-14T11:23:10.356193+0000","last_peered":"2024-09-14T11:23:10.356193+0000","last_clean":"2024-09-14T11:23:10.356193+0000","last_became_active":"2024-09-14T10:45:45.719864+0000","last_became_peered":"2024-09-14T10:45:45.719864+0000","last_unstale":"2024-09-14T11:23:10.356193+0000","last_undegraded":"2024-09-14T11:23:10.356193+0000","last_fullsized":"2024-09-14T11:23:10.356193+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'763","last_scrub_stamp":"2024-09-14T11:23:10.356108+0000","last_deep_scrub":"260'763","last_deep_scrub_stamp":"2024-09-14T11:23:10.356108+0000","last_clean_scrub_stamp":"2024-09-14T11:23:10.356108+0000","objects_scrubbed":2,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:25:13.250358+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3610,"num_read_kb":3266,"num_write":990,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"260'352","reported_seq":985,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:56.642945+0000","last_change":"2024-09-14T11:22:56.642945+0000","last_active":"2024-09-14T11:22:56.642945+0000","last_peered":"2024-09-14T11:22:56.642945+0000","last_clean":"2024-09-14T11:22:56.642945+0000","last_became_active":"2024-09-14T10:45:43.681137+0000","last_became_peered":"2024-09-14T10:45:43.681137+0000","last_unstale":"2024-09-14T11:22:56.642945+0000","last_undegraded":"2024-09-14T11:22:56.642945+0000","last_fullsized":"2024-09-14T11:22:56.642945+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'352","last_scrub_stamp":"2024-09-14T11:22:56.642848+0000","last_deep_scrub":"260'352","last_deep_scrub_stamp":"2024-09-14T11:22:56.642848+0000","last_clean_scrub_stamp":"2024-09-14T11:22:56.642848+0000","objects_scrubbed":6,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:18.121328+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":525,"num_read_kb":31159,"num_write":1040,"num_write_kb":37353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:12.307193+0000","last_change":"2024-09-14T11:23:12.307193+0000","last_active":"2024-09-14T11:23:12.307193+0000","last_peered":"2024-09-14T11:23:12.307193+0000","last_clean":"2024-09-14T11:23:12.307193+0000","last_became_active":"2024-09-14T10:45:47.729815+0000","last_became_peered":"2024-09-14T10:45:47.729815+0000","last_unstale":"2024-09-14T11:23:12.307193+0000","last_undegraded":"2024-09-14T11:23:12.307193+0000","last_fullsized":"2024-09-14T11:23:12.307193+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:12.307094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:12.307094+0000","last_clean_scrub_stamp":"2024-09-14T11:23:12.307094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:08.115928+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"260'510","reported_seq":1126,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.091392+0000","last_change":"2024-09-14T10:45:49.736189+0000","last_active":"2024-09-14T11:22:51.091392+0000","last_peered":"2024-09-14T11:22:51.091392+0000","last_clean":"2024-09-14T11:22:51.091392+0000","last_became_active":"2024-09-14T10:45:49.735297+0000","last_became_peered":"2024-09-14T10:45:49.735297+0000","last_unstale":"2024-09-14T11:22:51.091392+0000","last_undegraded":"2024-09-14T11:22:51.091392+0000","last_fullsized":"2024-09-14T11:22:51.091392+0000","mapping_epoch":30,"log_start":"260'400","ondisk_log_start":"260'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:32.962766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93593,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":881,"num_read_kb":2160,"num_write":740,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":471,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:31.246681+0000","last_change":"2024-09-14T10:45:51.749364+0000","last_active":"2024-09-14T11:20:31.246681+0000","last_peered":"2024-09-14T11:20:31.246681+0000","last_clean":"2024-09-14T11:20:31.246681+0000","last_became_active":"2024-09-14T10:45:51.749045+0000","last_became_peered":"2024-09-14T10:45:51.749045+0000","last_unstale":"2024-09-14T11:20:31.246681+0000","last_undegraded":"2024-09-14T11:20:31.246681+0000","last_fullsized":"2024-09-14T11:20:31.246681+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:03.211664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"260'125","reported_seq":630,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:13.515424+0000","last_change":"2024-09-14T10:45:53.752016+0000","last_active":"2024-09-14T11:21:13.515424+0000","last_peered":"2024-09-14T11:21:13.515424+0000","last_clean":"2024-09-14T11:21:13.515424+0000","last_became_active":"2024-09-14T10:45:53.751736+0000","last_became_peered":"2024-09-14T10:45:53.751736+0000","last_unstale":"2024-09-14T11:21:13.515424+0000","last_undegraded":"2024-09-14T11:21:13.515424+0000","last_fullsized":"2024-09-14T11:21:13.515424+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:32.284762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":704,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":191,"num_read_kb":171,"num_write":290,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"260'1192","reported_seq":2750,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:02.564306+0000","last_change":"2024-09-14T11:23:02.564306+0000","last_active":"2024-09-14T11:23:02.564306+0000","last_peered":"2024-09-14T11:23:02.564306+0000","last_clean":"2024-09-14T11:23:02.564306+0000","last_became_active":"2024-09-14T10:45:45.714723+0000","last_became_peered":"2024-09-14T10:45:45.714723+0000","last_unstale":"2024-09-14T11:23:02.564306+0000","last_undegraded":"2024-09-14T11:23:02.564306+0000","last_fullsized":"2024-09-14T11:23:02.564306+0000","mapping_epoch":26,"log_start":"260'1100","ondisk_log_start":"260'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1192","last_scrub_stamp":"2024-09-14T11:23:02.564228+0000","last_deep_scrub":"260'1192","last_deep_scrub_stamp":"2024-09-14T11:23:02.564228+0000","last_clean_scrub_stamp":"2024-09-14T11:23:02.564228+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":1100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:57.673628+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5470,"num_read_kb":4821,"num_write":1659,"num_write_kb":709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"260'368","reported_seq":999,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:58.738182+0000","last_change":"2024-09-14T11:22:58.738182+0000","last_active":"2024-09-14T11:22:58.738182+0000","last_peered":"2024-09-14T11:22:58.738182+0000","last_clean":"2024-09-14T11:22:58.738182+0000","last_became_active":"2024-09-14T10:45:43.686531+0000","last_became_peered":"2024-09-14T10:45:43.686531+0000","last_unstale":"2024-09-14T11:22:58.738182+0000","last_undegraded":"2024-09-14T11:22:58.738182+0000","last_fullsized":"2024-09-14T11:22:58.738182+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'368","last_scrub_stamp":"2024-09-14T11:22:58.738083+0000","last_deep_scrub":"260'368","last_deep_scrub_stamp":"2024-09-14T11:22:58.738083+0000","last_clean_scrub_stamp":"2024-09-14T11:22:58.738083+0000","objects_scrubbed":5,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:58:54.493504+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133692,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":671,"num_read_kb":7607,"num_write":1262,"num_write_kb":48356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:11.697908+0000","last_change":"2024-09-14T11:23:11.697908+0000","last_active":"2024-09-14T11:23:11.697908+0000","last_peered":"2024-09-14T11:23:11.697908+0000","last_clean":"2024-09-14T11:23:11.697908+0000","last_became_active":"2024-09-14T10:45:47.728213+0000","last_became_peered":"2024-09-14T10:45:47.728213+0000","last_unstale":"2024-09-14T11:23:11.697908+0000","last_undegraded":"2024-09-14T11:23:11.697908+0000","last_fullsized":"2024-09-14T11:23:11.697908+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:11.697822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:11.697822+0000","last_clean_scrub_stamp":"2024-09-14T11:23:11.697822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:14:58.462465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"260'269","reported_seq":834,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:15.532763+0000","last_change":"2024-09-14T11:23:15.532763+0000","last_active":"2024-09-14T11:23:15.532763+0000","last_peered":"2024-09-14T11:23:15.532763+0000","last_clean":"2024-09-14T11:23:15.532763+0000","last_became_active":"2024-09-14T10:45:49.732813+0000","last_became_peered":"2024-09-14T10:45:49.732813+0000","last_unstale":"2024-09-14T11:23:15.532763+0000","last_undegraded":"2024-09-14T11:23:15.532763+0000","last_fullsized":"2024-09-14T11:23:15.532763+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'269","last_scrub_stamp":"2024-09-14T11:23:15.532664+0000","last_deep_scrub":"260'269","last_deep_scrub_stamp":"2024-09-14T11:23:15.532664+0000","last_clean_scrub_stamp":"2024-09-14T11:23:15.532664+0000","objects_scrubbed":7,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:03.580995+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14232,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":431,"num_read_kb":915,"num_write":388,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":481,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:15.618806+0000","last_change":"2024-09-14T11:23:15.618806+0000","last_active":"2024-09-14T11:23:15.618806+0000","last_peered":"2024-09-14T11:23:15.618806+0000","last_clean":"2024-09-14T11:23:15.618806+0000","last_became_active":"2024-09-14T10:45:51.748381+0000","last_became_peered":"2024-09-14T10:45:51.748381+0000","last_unstale":"2024-09-14T11:23:15.618806+0000","last_undegraded":"2024-09-14T11:23:15.618806+0000","last_fullsized":"2024-09-14T11:23:15.618806+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:15.618720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:15.618720+0000","last_clean_scrub_stamp":"2024-09-14T11:23:15.618720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:33:06.847139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"260'98","reported_seq":567,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:56.259131+0000","last_change":"2024-09-14T10:45:53.755248+0000","last_active":"2024-09-14T11:21:56.259131+0000","last_peered":"2024-09-14T11:21:56.259131+0000","last_clean":"2024-09-14T11:21:56.259131+0000","last_became_active":"2024-09-14T10:45:53.755022+0000","last_became_peered":"2024-09-14T10:45:53.755022+0000","last_unstale":"2024-09-14T11:21:56.259131+0000","last_undegraded":"2024-09-14T11:21:56.259131+0000","last_fullsized":"2024-09-14T11:21:56.259131+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:21.675722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":73,"num_read_kb":72,"num_write":223,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"260'436","reported_seq":1984,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:15.257923+0000","last_change":"2024-09-14T11:23:15.257923+0000","last_active":"2024-09-14T11:23:15.257923+0000","last_peered":"2024-09-14T11:23:15.257923+0000","last_clean":"2024-09-14T11:23:15.257923+0000","last_became_active":"2024-09-14T10:45:45.710367+0000","last_became_peered":"2024-09-14T10:45:45.710367+0000","last_unstale":"2024-09-14T11:23:15.257923+0000","last_undegraded":"2024-09-14T11:23:15.257923+0000","last_fullsized":"2024-09-14T11:23:15.257923+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'436","last_scrub_stamp":"2024-09-14T11:23:15.257828+0000","last_deep_scrub":"260'436","last_deep_scrub_stamp":"2024-09-14T11:23:15.257828+0000","last_clean_scrub_stamp":"2024-09-14T11:23:15.257828+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:59.527838+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2526,"num_read_kb":2387,"num_write":527,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"260'332","reported_seq":1023,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:01.297073+0000","last_change":"2024-09-14T11:23:01.297073+0000","last_active":"2024-09-14T11:23:01.297073+0000","last_peered":"2024-09-14T11:23:01.297073+0000","last_clean":"2024-09-14T11:23:01.297073+0000","last_became_active":"2024-09-14T10:45:43.676514+0000","last_became_peered":"2024-09-14T10:45:43.676514+0000","last_unstale":"2024-09-14T11:23:01.297073+0000","last_undegraded":"2024-09-14T11:23:01.297073+0000","last_fullsized":"2024-09-14T11:23:01.297073+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'332","last_scrub_stamp":"2024-09-14T11:23:01.296956+0000","last_deep_scrub":"260'332","last_deep_scrub_stamp":"2024-09-14T11:23:01.296956+0000","last_clean_scrub_stamp":"2024-09-14T11:23:01.296956+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:31.917595+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174780,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":649,"num_read_kb":125837,"num_write":1068,"num_write_kb":34909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:36.239100+0000","last_change":"2024-09-14T10:45:47.728092+0000","last_active":"2024-09-14T11:19:36.239100+0000","last_peered":"2024-09-14T11:19:36.239100+0000","last_clean":"2024-09-14T11:19:36.239100+0000","last_became_active":"2024-09-14T10:45:47.727632+0000","last_became_peered":"2024-09-14T10:45:47.727632+0000","last_unstale":"2024-09-14T11:19:36.239100+0000","last_undegraded":"2024-09-14T11:19:36.239100+0000","last_fullsized":"2024-09-14T11:19:36.239100+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:44.526326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"260'292","reported_seq":851,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.875892+0000","last_change":"2024-09-14T10:45:49.737975+0000","last_active":"2024-09-14T11:22:50.875892+0000","last_peered":"2024-09-14T11:22:50.875892+0000","last_clean":"2024-09-14T11:22:50.875892+0000","last_became_active":"2024-09-14T10:45:49.737690+0000","last_became_peered":"2024-09-14T10:45:49.737690+0000","last_unstale":"2024-09-14T11:22:50.875892+0000","last_undegraded":"2024-09-14T11:22:50.875892+0000","last_fullsized":"2024-09-14T11:22:50.875892+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:15.403726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69554,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":489,"num_read_kb":1163,"num_write":398,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"260'778","reported_seq":2028,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:14.637328+0000","last_change":"2024-09-14T11:23:14.637328+0000","last_active":"2024-09-14T11:23:14.637328+0000","last_peered":"2024-09-14T11:23:14.637328+0000","last_clean":"2024-09-14T11:23:14.637328+0000","last_became_active":"2024-09-14T10:45:51.749478+0000","last_became_peered":"2024-09-14T10:45:51.749478+0000","last_unstale":"2024-09-14T11:23:14.637328+0000","last_undegraded":"2024-09-14T11:23:14.637328+0000","last_fullsized":"2024-09-14T11:23:14.637328+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'778","last_scrub_stamp":"2024-09-14T11:23:14.637243+0000","last_deep_scrub":"260'778","last_deep_scrub_stamp":"2024-09-14T11:23:14.637243+0000","last_clean_scrub_stamp":"2024-09-14T11:23:14.637243+0000","objects_scrubbed":1,"log_size":78,"log_dups_size":700,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:52.460981+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"260'128","reported_seq":609,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:13.969218+0000","last_change":"2024-09-14T10:45:53.746737+0000","last_active":"2024-09-14T11:21:13.969218+0000","last_peered":"2024-09-14T11:21:13.969218+0000","last_clean":"2024-09-14T11:21:13.969218+0000","last_became_active":"2024-09-14T10:45:53.746254+0000","last_became_peered":"2024-09-14T10:45:53.746254+0000","last_unstale":"2024-09-14T11:21:13.969218+0000","last_undegraded":"2024-09-14T11:21:13.969218+0000","last_fullsized":"2024-09-14T11:21:13.969218+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:28:26.210153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1445,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":145,"num_read_kb":134,"num_write":327,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"260'484","reported_seq":2063,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:03.211250+0000","last_change":"2024-09-14T11:23:03.211250+0000","last_active":"2024-09-14T11:23:03.211250+0000","last_peered":"2024-09-14T11:23:03.211250+0000","last_clean":"2024-09-14T11:23:03.211250+0000","last_became_active":"2024-09-14T10:45:45.720660+0000","last_became_peered":"2024-09-14T10:45:45.720660+0000","last_unstale":"2024-09-14T11:23:03.211250+0000","last_undegraded":"2024-09-14T11:23:03.211250+0000","last_fullsized":"2024-09-14T11:23:03.211250+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'484","last_scrub_stamp":"2024-09-14T11:23:03.211174+0000","last_deep_scrub":"260'484","last_deep_scrub_stamp":"2024-09-14T11:23:03.211174+0000","last_clean_scrub_stamp":"2024-09-14T11:23:03.211174+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:30.932990+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2593,"num_read_kb":2426,"num_write":578,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"260'355","reported_seq":971,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:03.251849+0000","last_change":"2024-09-14T11:23:03.251849+0000","last_active":"2024-09-14T11:23:03.251849+0000","last_peered":"2024-09-14T11:23:03.251849+0000","last_clean":"2024-09-14T11:23:03.251849+0000","last_became_active":"2024-09-14T10:45:43.690517+0000","last_became_peered":"2024-09-14T10:45:43.690517+0000","last_unstale":"2024-09-14T11:23:03.251849+0000","last_undegraded":"2024-09-14T11:23:03.251849+0000","last_fullsized":"2024-09-14T11:23:03.251849+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'355","last_scrub_stamp":"2024-09-14T11:23:03.251741+0000","last_deep_scrub":"260'355","last_deep_scrub_stamp":"2024-09-14T11:23:03.251741+0000","last_clean_scrub_stamp":"2024-09-14T11:23:03.251741+0000","objects_scrubbed":9,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:26.884843+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267379,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":525,"num_read_kb":51932,"num_write":1051,"num_write_kb":23808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"260'4","reported_seq":1450,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:12.602532+0000","last_change":"2024-09-14T11:23:12.602532+0000","last_active":"2024-09-14T11:23:12.602532+0000","last_peered":"2024-09-14T11:23:12.602532+0000","last_clean":"2024-09-14T11:23:12.602532+0000","last_became_active":"2024-09-14T10:45:47.720716+0000","last_became_peered":"2024-09-14T10:45:47.720716+0000","last_unstale":"2024-09-14T11:23:12.602532+0000","last_undegraded":"2024-09-14T11:23:12.602532+0000","last_fullsized":"2024-09-14T11:23:12.602532+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-14T11:23:12.602439+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-14T11:23:12.602439+0000","last_clean_scrub_stamp":"2024-09-14T11:23:12.602439+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:13:05.573930+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":953,"num_read_kb":953,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"260'68","reported_seq":563,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:13.520750+0000","last_change":"2024-09-14T10:45:49.733374+0000","last_active":"2024-09-14T11:21:13.520750+0000","last_peered":"2024-09-14T11:21:13.520750+0000","last_clean":"2024-09-14T11:21:13.520750+0000","last_became_active":"2024-09-14T10:45:49.732913+0000","last_became_peered":"2024-09-14T10:45:49.732913+0000","last_unstale":"2024-09-14T11:21:13.520750+0000","last_undegraded":"2024-09-14T11:21:13.520750+0000","last_fullsized":"2024-09-14T11:21:13.520750+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:41.223364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":64,"num_read_kb":57,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"260'797","reported_seq":2414,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.302625+0000","last_change":"2024-09-14T10:45:51.741412+0000","last_active":"2024-09-14T11:22:50.302625+0000","last_peered":"2024-09-14T11:22:50.302625+0000","last_clean":"2024-09-14T11:22:50.302625+0000","last_became_active":"2024-09-14T10:45:51.741102+0000","last_became_peered":"2024-09-14T10:45:51.741102+0000","last_unstale":"2024-09-14T11:22:50.302625+0000","last_undegraded":"2024-09-14T11:22:50.302625+0000","last_fullsized":"2024-09-14T11:22:50.302625+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:08.256488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"260'150","reported_seq":656,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:13.516830+0000","last_change":"2024-09-14T10:45:53.752456+0000","last_active":"2024-09-14T11:21:13.516830+0000","last_peered":"2024-09-14T11:21:13.516830+0000","last_clean":"2024-09-14T11:21:13.516830+0000","last_became_active":"2024-09-14T10:45:53.752100+0000","last_became_peered":"2024-09-14T10:45:53.752100+0000","last_unstale":"2024-09-14T11:21:13.516830+0000","last_undegraded":"2024-09-14T11:21:13.516830+0000","last_fullsized":"2024-09-14T11:21:13.516830+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:44.647729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":861,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":268,"num_read_kb":228,"num_write":378,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"260'470","reported_seq":2079,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:02.791198+0000","last_change":"2024-09-14T11:23:02.791198+0000","last_active":"2024-09-14T11:23:02.791198+0000","last_peered":"2024-09-14T11:23:02.791198+0000","last_clean":"2024-09-14T11:23:02.791198+0000","last_became_active":"2024-09-14T10:45:45.719221+0000","last_became_peered":"2024-09-14T10:45:45.719221+0000","last_unstale":"2024-09-14T11:23:02.791198+0000","last_undegraded":"2024-09-14T11:23:02.791198+0000","last_fullsized":"2024-09-14T11:23:02.791198+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'470","last_scrub_stamp":"2024-09-14T11:23:02.791102+0000","last_deep_scrub":"260'470","last_deep_scrub_stamp":"2024-09-14T11:23:02.791102+0000","last_clean_scrub_stamp":"2024-09-14T11:23:02.791102+0000","objects_scrubbed":2,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:33:44.209906+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2509,"num_read_kb":2365,"num_write":566,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":467,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"260'322","reported_seq":932,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:59.033947+0000","last_change":"2024-09-14T11:22:59.033947+0000","last_active":"2024-09-14T11:22:59.033947+0000","last_peered":"2024-09-14T11:22:59.033947+0000","last_clean":"2024-09-14T11:22:59.033947+0000","last_became_active":"2024-09-14T10:45:43.690417+0000","last_became_peered":"2024-09-14T10:45:43.690417+0000","last_unstale":"2024-09-14T11:22:59.033947+0000","last_undegraded":"2024-09-14T11:22:59.033947+0000","last_fullsized":"2024-09-14T11:22:59.033947+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'322","last_scrub_stamp":"2024-09-14T11:22:59.033852+0000","last_deep_scrub":"260'322","last_deep_scrub_stamp":"2024-09-14T11:22:59.033852+0000","last_clean_scrub_stamp":"2024-09-14T11:22:59.033852+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:02.624805+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":503,"num_read_kb":28260,"num_write":967,"num_write_kb":36225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":479,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:32.112331+0000","last_change":"2024-09-14T10:45:47.731129+0000","last_active":"2024-09-14T11:19:32.112331+0000","last_peered":"2024-09-14T11:19:32.112331+0000","last_clean":"2024-09-14T11:19:32.112331+0000","last_became_active":"2024-09-14T10:45:47.730790+0000","last_became_peered":"2024-09-14T10:45:47.730790+0000","last_unstale":"2024-09-14T11:19:32.112331+0000","last_undegraded":"2024-09-14T11:19:32.112331+0000","last_fullsized":"2024-09-14T11:19:32.112331+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:38.545867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"260'331","reported_seq":925,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:14.556096+0000","last_change":"2024-09-14T11:23:14.556096+0000","last_active":"2024-09-14T11:23:14.556096+0000","last_peered":"2024-09-14T11:23:14.556096+0000","last_clean":"2024-09-14T11:23:14.556096+0000","last_became_active":"2024-09-14T10:45:49.735482+0000","last_became_peered":"2024-09-14T10:45:49.735482+0000","last_unstale":"2024-09-14T11:23:14.556096+0000","last_undegraded":"2024-09-14T11:23:14.556096+0000","last_fullsized":"2024-09-14T11:23:14.556096+0000","mapping_epoch":30,"log_start":"260'300","ondisk_log_start":"260'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'331","last_scrub_stamp":"2024-09-14T11:23:14.555977+0000","last_deep_scrub":"260'331","last_deep_scrub_stamp":"2024-09-14T11:23:14.555977+0000","last_clean_scrub_stamp":"2024-09-14T11:23:14.555977+0000","objects_scrubbed":8,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:18.071778+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46045,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":538,"num_read_kb":1149,"num_write":426,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":476,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:12.387005+0000","last_change":"2024-09-14T11:23:12.387005+0000","last_active":"2024-09-14T11:23:12.387005+0000","last_peered":"2024-09-14T11:23:12.387005+0000","last_clean":"2024-09-14T11:23:12.387005+0000","last_became_active":"2024-09-14T10:45:51.750669+0000","last_became_peered":"2024-09-14T10:45:51.750669+0000","last_unstale":"2024-09-14T11:23:12.387005+0000","last_undegraded":"2024-09-14T11:23:12.387005+0000","last_fullsized":"2024-09-14T11:23:12.387005+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:12.386872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:12.386872+0000","last_clean_scrub_stamp":"2024-09-14T11:23:12.386872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:17.249546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"260'118","reported_seq":594,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.200888+0000","last_change":"2024-09-14T10:45:53.749127+0000","last_active":"2024-09-14T11:21:28.200888+0000","last_peered":"2024-09-14T11:21:28.200888+0000","last_clean":"2024-09-14T11:21:28.200888+0000","last_became_active":"2024-09-14T10:45:53.748865+0000","last_became_peered":"2024-09-14T10:45:53.748865+0000","last_unstale":"2024-09-14T11:21:28.200888+0000","last_undegraded":"2024-09-14T11:21:28.200888+0000","last_fullsized":"2024-09-14T11:21:28.200888+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:29.632424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":116,"num_write":279,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"260'614","reported_seq":2413,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:14.210717+0000","last_change":"2024-09-14T11:23:14.210717+0000","last_active":"2024-09-14T11:23:14.210717+0000","last_peered":"2024-09-14T11:23:14.210717+0000","last_clean":"2024-09-14T11:23:14.210717+0000","last_became_active":"2024-09-14T10:45:45.716236+0000","last_became_peered":"2024-09-14T10:45:45.716236+0000","last_unstale":"2024-09-14T11:23:14.210717+0000","last_undegraded":"2024-09-14T11:23:14.210717+0000","last_fullsized":"2024-09-14T11:23:14.210717+0000","mapping_epoch":26,"log_start":"260'600","ondisk_log_start":"260'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'614","last_scrub_stamp":"2024-09-14T11:23:14.210620+0000","last_deep_scrub":"260'614","last_deep_scrub_stamp":"2024-09-14T11:23:14.210620+0000","last_clean_scrub_stamp":"2024-09-14T11:23:14.210620+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":600,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:38:26.756269+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3315,"num_read_kb":3084,"num_write":730,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"260'74","reported_seq":611,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:55.699728+0000","last_change":"2024-09-14T11:22:55.699728+0000","last_active":"2024-09-14T11:22:55.699728+0000","last_peered":"2024-09-14T11:22:55.699728+0000","last_clean":"2024-09-14T11:22:55.699728+0000","last_became_active":"2024-09-14T10:45:28.985499+0000","last_became_peered":"2024-09-14T10:45:28.985499+0000","last_unstale":"2024-09-14T11:22:55.699728+0000","last_undegraded":"2024-09-14T11:22:55.699728+0000","last_fullsized":"2024-09-14T11:22:55.699728+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'74","last_scrub_stamp":"2024-09-14T11:22:55.699647+0000","last_deep_scrub":"260'74","last_deep_scrub_stamp":"2024-09-14T11:22:55.699647+0000","last_clean_scrub_stamp":"2024-09-14T11:22:55.699647+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:04.417375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"260'2","reported_seq":514,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:58.303627+0000","last_change":"2024-09-14T11:22:58.303578+0000","last_active":"2024-09-14T11:22:58.303627+0000","last_peered":"2024-09-14T11:22:58.303627+0000","last_clean":"2024-09-14T11:22:58.303627+0000","last_became_active":"2024-09-14T10:45:33.610592+0000","last_became_peered":"2024-09-14T10:45:33.610592+0000","last_unstale":"2024-09-14T11:22:58.303627+0000","last_undegraded":"2024-09-14T11:22:58.303627+0000","last_fullsized":"2024-09-14T11:22:58.303627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:22:58.303510+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:22:58.303510+0000","last_clean_scrub_stamp":"2024-09-14T11:22:58.303510+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:42.914407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043055799999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"260'280","reported_seq":928,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:57.084934+0000","last_change":"2024-09-14T11:22:57.084842+0000","last_active":"2024-09-14T11:22:57.084934+0000","last_peered":"2024-09-14T11:22:57.084934+0000","last_clean":"2024-09-14T11:22:57.084934+0000","last_became_active":"2024-09-14T10:45:43.690248+0000","last_became_peered":"2024-09-14T10:45:43.690248+0000","last_unstale":"2024-09-14T11:22:57.084934+0000","last_undegraded":"2024-09-14T11:22:57.084934+0000","last_fullsized":"2024-09-14T11:22:57.084934+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'280","last_scrub_stamp":"2024-09-14T11:22:57.084704+0000","last_deep_scrub":"260'280","last_deep_scrub_stamp":"2024-09-14T11:22:57.084704+0000","last_clean_scrub_stamp":"2024-09-14T11:22:57.084704+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:34.397521+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":552,"num_read_kb":56771,"num_write":951,"num_write_kb":24880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":496,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:11.598716+0000","last_change":"2024-09-14T11:23:11.598638+0000","last_active":"2024-09-14T11:23:11.598716+0000","last_peered":"2024-09-14T11:23:11.598716+0000","last_clean":"2024-09-14T11:23:11.598716+0000","last_became_active":"2024-09-14T10:45:47.723495+0000","last_became_peered":"2024-09-14T10:45:47.723495+0000","last_unstale":"2024-09-14T11:23:11.598716+0000","last_undegraded":"2024-09-14T11:23:11.598716+0000","last_fullsized":"2024-09-14T11:23:11.598716+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:11.598555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:11.598555+0000","last_clean_scrub_stamp":"2024-09-14T11:23:11.598555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:36:22.236009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"260'743","reported_seq":1426,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.449185+0000","last_change":"2024-09-14T10:45:49.734638+0000","last_active":"2024-09-14T11:22:51.449185+0000","last_peered":"2024-09-14T11:22:51.449185+0000","last_clean":"2024-09-14T11:22:51.449185+0000","last_became_active":"2024-09-14T10:45:49.733774+0000","last_became_peered":"2024-09-14T10:45:49.733774+0000","last_unstale":"2024-09-14T11:22:51.449185+0000","last_undegraded":"2024-09-14T11:22:51.449185+0000","last_fullsized":"2024-09-14T11:22:51.449185+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":700,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:45.811248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152864,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1479,"num_read_kb":3507,"num_write":1366,"num_write_kb":1223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":471,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:31.246761+0000","last_change":"2024-09-14T10:45:51.745875+0000","last_active":"2024-09-14T11:20:31.246761+0000","last_peered":"2024-09-14T11:20:31.246761+0000","last_clean":"2024-09-14T11:20:31.246761+0000","last_became_active":"2024-09-14T10:45:51.745607+0000","last_became_peered":"2024-09-14T10:45:51.745607+0000","last_unstale":"2024-09-14T11:20:31.246761+0000","last_undegraded":"2024-09-14T11:20:31.246761+0000","last_fullsized":"2024-09-14T11:20:31.246761+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:12.059394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"260'234","reported_seq":922,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.747723+0000","last_change":"2024-09-14T10:45:53.751918+0000","last_active":"2024-09-14T11:21:28.747723+0000","last_peered":"2024-09-14T11:21:28.747723+0000","last_clean":"2024-09-14T11:21:28.747723+0000","last_became_active":"2024-09-14T10:45:53.751651+0000","last_became_peered":"2024-09-14T10:45:53.751651+0000","last_unstale":"2024-09-14T11:21:28.747723+0000","last_undegraded":"2024-09-14T11:21:28.747723+0000","last_fullsized":"2024-09-14T11:21:28.747723+0000","mapping_epoch":34,"log_start":"260'200","ondisk_log_start":"260'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:07.313069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":417,"num_read_kb":415,"num_write":468,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"260'501","reported_seq":2088,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:11.358264+0000","last_change":"2024-09-14T11:23:11.358264+0000","last_active":"2024-09-14T11:23:11.358264+0000","last_peered":"2024-09-14T11:23:11.358264+0000","last_clean":"2024-09-14T11:23:11.358264+0000","last_became_active":"2024-09-14T10:45:45.721633+0000","last_became_peered":"2024-09-14T10:45:45.721633+0000","last_unstale":"2024-09-14T11:23:11.358264+0000","last_undegraded":"2024-09-14T11:23:11.358264+0000","last_fullsized":"2024-09-14T11:23:11.358264+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'501","last_scrub_stamp":"2024-09-14T11:23:11.358175+0000","last_deep_scrub":"260'501","last_deep_scrub_stamp":"2024-09-14T11:23:11.358175+0000","last_clean_scrub_stamp":"2024-09-14T11:23:11.358175+0000","objects_scrubbed":1,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:36.475272+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2741,"num_read_kb":2557,"num_write":632,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":512,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:57.303538+0000","last_change":"2024-09-14T11:22:57.303538+0000","last_active":"2024-09-14T11:22:57.303538+0000","last_peered":"2024-09-14T11:22:57.303538+0000","last_clean":"2024-09-14T11:22:57.303538+0000","last_became_active":"2024-09-14T10:45:33.569860+0000","last_became_peered":"2024-09-14T10:45:33.569860+0000","last_unstale":"2024-09-14T11:22:57.303538+0000","last_undegraded":"2024-09-14T11:22:57.303538+0000","last_fullsized":"2024-09-14T11:22:57.303538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:57.303456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:57.303456+0000","last_clean_scrub_stamp":"2024-09-14T11:22:57.303456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:48:58.728224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074400599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"260'335","reported_seq":973,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:58.571020+0000","last_change":"2024-09-14T11:22:58.570951+0000","last_active":"2024-09-14T11:22:58.571020+0000","last_peered":"2024-09-14T11:22:58.571020+0000","last_clean":"2024-09-14T11:22:58.571020+0000","last_became_active":"2024-09-14T10:45:43.680290+0000","last_became_peered":"2024-09-14T10:45:43.680290+0000","last_unstale":"2024-09-14T11:22:58.571020+0000","last_undegraded":"2024-09-14T11:22:58.571020+0000","last_fullsized":"2024-09-14T11:22:58.571020+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'335","last_scrub_stamp":"2024-09-14T11:22:58.570853+0000","last_deep_scrub":"260'335","last_deep_scrub_stamp":"2024-09-14T11:22:58.570853+0000","last_clean_scrub_stamp":"2024-09-14T11:22:58.570853+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:26.761580+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":649,"num_read_kb":19207,"num_write":1098,"num_write_kb":41133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":480,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:27.120185+0000","last_change":"2024-09-14T10:45:47.728037+0000","last_active":"2024-09-14T11:20:27.120185+0000","last_peered":"2024-09-14T11:20:27.120185+0000","last_clean":"2024-09-14T11:20:27.120185+0000","last_became_active":"2024-09-14T10:45:47.727733+0000","last_became_peered":"2024-09-14T10:45:47.727733+0000","last_unstale":"2024-09-14T11:20:27.120185+0000","last_undegraded":"2024-09-14T11:20:27.120185+0000","last_fullsized":"2024-09-14T11:20:27.120185+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:08.238626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"260'1248","reported_seq":2611,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.413729+0000","last_change":"2024-09-14T10:45:49.731992+0000","last_active":"2024-09-14T11:22:51.413729+0000","last_peered":"2024-09-14T11:22:51.413729+0000","last_clean":"2024-09-14T11:22:51.413729+0000","last_became_active":"2024-09-14T10:45:49.731646+0000","last_became_peered":"2024-09-14T10:45:49.731646+0000","last_unstale":"2024-09-14T11:22:51.413729+0000","last_undegraded":"2024-09-14T11:22:51.413729+0000","last_fullsized":"2024-09-14T11:22:51.413729+0000","mapping_epoch":30,"log_start":"260'1200","ondisk_log_start":"260'1200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":1200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:40.965323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141569,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1984,"num_read_kb":3752,"num_write":1074,"num_write_kb":921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":472,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:17.109984+0000","last_change":"2024-09-14T10:45:51.745733+0000","last_active":"2024-09-14T11:19:17.109984+0000","last_peered":"2024-09-14T11:19:17.109984+0000","last_clean":"2024-09-14T11:19:17.109984+0000","last_became_active":"2024-09-14T10:45:51.745481+0000","last_became_peered":"2024-09-14T10:45:51.745481+0000","last_unstale":"2024-09-14T11:19:17.109984+0000","last_undegraded":"2024-09-14T11:19:17.109984+0000","last_fullsized":"2024-09-14T11:19:17.109984+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:11.216344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"260'292","reported_seq":816,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:43.730260+0000","last_change":"2024-09-14T10:45:53.750529+0000","last_active":"2024-09-14T11:22:43.730260+0000","last_peered":"2024-09-14T11:22:43.730260+0000","last_clean":"2024-09-14T11:22:43.730260+0000","last_became_active":"2024-09-14T10:45:53.750227+0000","last_became_peered":"2024-09-14T10:45:53.750227+0000","last_unstale":"2024-09-14T11:22:43.730260+0000","last_undegraded":"2024-09-14T11:22:43.730260+0000","last_fullsized":"2024-09-14T11:22:43.730260+0000","mapping_epoch":34,"log_start":"260'200","ondisk_log_start":"260'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:38.646551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":463,"num_read_kb":436,"num_write":609,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"260'356","reported_seq":1877,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:07.380950+0000","last_change":"2024-09-14T11:23:07.380950+0000","last_active":"2024-09-14T11:23:07.380950+0000","last_peered":"2024-09-14T11:23:07.380950+0000","last_clean":"2024-09-14T11:23:07.380950+0000","last_became_active":"2024-09-14T10:45:45.714923+0000","last_became_peered":"2024-09-14T10:45:45.714923+0000","last_unstale":"2024-09-14T11:23:07.380950+0000","last_undegraded":"2024-09-14T11:23:07.380950+0000","last_fullsized":"2024-09-14T11:23:07.380950+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'356","last_scrub_stamp":"2024-09-14T11:23:07.380862+0000","last_deep_scrub":"260'356","last_deep_scrub_stamp":"2024-09-14T11:23:07.380862+0000","last_clean_scrub_stamp":"2024-09-14T11:23:07.380862+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:31.182530+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2079,"num_read_kb":2005,"num_write":398,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":513,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:57.710733+0000","last_change":"2024-09-14T11:22:57.710655+0000","last_active":"2024-09-14T11:22:57.710733+0000","last_peered":"2024-09-14T11:22:57.710733+0000","last_clean":"2024-09-14T11:22:57.710733+0000","last_became_active":"2024-09-14T10:45:33.569944+0000","last_became_peered":"2024-09-14T10:45:33.569944+0000","last_unstale":"2024-09-14T11:22:57.710733+0000","last_undegraded":"2024-09-14T11:22:57.710733+0000","last_fullsized":"2024-09-14T11:22:57.710733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:57.710578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:57.710578+0000","last_clean_scrub_stamp":"2024-09-14T11:22:57.710578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:15.018820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055355599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"260'364","reported_seq":1063,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:01.268492+0000","last_change":"2024-09-14T11:23:01.268492+0000","last_active":"2024-09-14T11:23:01.268492+0000","last_peered":"2024-09-14T11:23:01.268492+0000","last_clean":"2024-09-14T11:23:01.268492+0000","last_became_active":"2024-09-14T10:45:43.682920+0000","last_became_peered":"2024-09-14T10:45:43.682920+0000","last_unstale":"2024-09-14T11:23:01.268492+0000","last_undegraded":"2024-09-14T11:23:01.268492+0000","last_fullsized":"2024-09-14T11:23:01.268492+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'364","last_scrub_stamp":"2024-09-14T11:23:01.268391+0000","last_deep_scrub":"260'364","last_deep_scrub_stamp":"2024-09-14T11:23:01.268391+0000","last_clean_scrub_stamp":"2024-09-14T11:23:01.268391+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:16.818916+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133679,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":823,"num_read_kb":18154,"num_write":1072,"num_write_kb":35009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"260'2","reported_seq":492,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:10.674647+0000","last_change":"2024-09-14T11:23:10.674647+0000","last_active":"2024-09-14T11:23:10.674647+0000","last_peered":"2024-09-14T11:23:10.674647+0000","last_clean":"2024-09-14T11:23:10.674647+0000","last_became_active":"2024-09-14T10:45:47.729061+0000","last_became_peered":"2024-09-14T10:45:47.729061+0000","last_unstale":"2024-09-14T11:23:10.674647+0000","last_undegraded":"2024-09-14T11:23:10.674647+0000","last_fullsized":"2024-09-14T11:23:10.674647+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:23:10.674557+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:23:10.674557+0000","last_clean_scrub_stamp":"2024-09-14T11:23:10.674557+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:31.717306+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"260'248","reported_seq":1233,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:13.632569+0000","last_change":"2024-09-14T11:23:13.632569+0000","last_active":"2024-09-14T11:23:13.632569+0000","last_peered":"2024-09-14T11:23:13.632569+0000","last_clean":"2024-09-14T11:23:13.632569+0000","last_became_active":"2024-09-14T10:45:49.731858+0000","last_became_peered":"2024-09-14T10:45:49.731858+0000","last_unstale":"2024-09-14T11:23:13.632569+0000","last_undegraded":"2024-09-14T11:23:13.632569+0000","last_fullsized":"2024-09-14T11:23:13.632569+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'248","last_scrub_stamp":"2024-09-14T11:23:13.632463+0000","last_deep_scrub":"260'248","last_deep_scrub_stamp":"2024-09-14T11:23:13.632463+0000","last_clean_scrub_stamp":"2024-09-14T11:23:13.632463+0000","objects_scrubbed":9,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:07.671389+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":156,"num_read_kb":145,"num_write":121,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5400,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:11.113947+0000","last_change":"2024-09-14T10:45:51.743386+0000","last_active":"2024-09-14T11:19:11.113947+0000","last_peered":"2024-09-14T11:19:11.113947+0000","last_clean":"2024-09-14T11:19:11.113947+0000","last_became_active":"2024-09-14T10:45:51.742651+0000","last_became_peered":"2024-09-14T10:45:51.742651+0000","last_unstale":"2024-09-14T11:19:11.113947+0000","last_undegraded":"2024-09-14T11:19:11.113947+0000","last_fullsized":"2024-09-14T11:19:11.113947+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:56.398753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"260'239","reported_seq":825,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.890931+0000","last_change":"2024-09-14T10:45:53.745667+0000","last_active":"2024-09-14T11:21:28.890931+0000","last_peered":"2024-09-14T11:21:28.890931+0000","last_clean":"2024-09-14T11:21:28.890931+0000","last_became_active":"2024-09-14T10:45:53.744823+0000","last_became_peered":"2024-09-14T10:45:53.744823+0000","last_unstale":"2024-09-14T11:21:28.890931+0000","last_undegraded":"2024-09-14T11:21:28.890931+0000","last_fullsized":"2024-09-14T11:21:28.890931+0000","mapping_epoch":34,"log_start":"260'200","ondisk_log_start":"260'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:01:08.099600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":471,"num_read_kb":497,"num_write":522,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"260'745","reported_seq":2256,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:06.427840+0000","last_change":"2024-09-14T11:23:06.427766+0000","last_active":"2024-09-14T11:23:06.427840+0000","last_peered":"2024-09-14T11:23:06.427840+0000","last_clean":"2024-09-14T11:23:06.427840+0000","last_became_active":"2024-09-14T10:45:45.714077+0000","last_became_peered":"2024-09-14T10:45:45.714077+0000","last_unstale":"2024-09-14T11:23:06.427840+0000","last_undegraded":"2024-09-14T11:23:06.427840+0000","last_fullsized":"2024-09-14T11:23:06.427840+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'745","last_scrub_stamp":"2024-09-14T11:23:06.427683+0000","last_deep_scrub":"260'745","last_deep_scrub_stamp":"2024-09-14T11:23:06.427683+0000","last_clean_scrub_stamp":"2024-09-14T11:23:06.427683+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":700,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:14.547833+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3745,"num_read_kb":3391,"num_write":988,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2262,"num_omap_keys":9,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"260'3","reported_seq":515,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:56.321959+0000","last_change":"2024-09-14T11:22:56.321865+0000","last_active":"2024-09-14T11:22:56.321959+0000","last_peered":"2024-09-14T11:22:56.321959+0000","last_clean":"2024-09-14T11:22:56.321959+0000","last_became_active":"2024-09-14T10:45:33.612919+0000","last_became_peered":"2024-09-14T10:45:33.612919+0000","last_unstale":"2024-09-14T11:22:56.321959+0000","last_undegraded":"2024-09-14T11:22:56.321959+0000","last_fullsized":"2024-09-14T11:22:56.321959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T11:22:56.321789+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T11:22:56.321789+0000","last_clean_scrub_stamp":"2024-09-14T11:22:56.321789+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:47.764462+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00094497699999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"260'329","reported_seq":1206,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:00.571957+0000","last_change":"2024-09-14T11:23:00.571895+0000","last_active":"2024-09-14T11:23:00.571957+0000","last_peered":"2024-09-14T11:23:00.571957+0000","last_clean":"2024-09-14T11:23:00.571957+0000","last_became_active":"2024-09-14T10:45:43.679522+0000","last_became_peered":"2024-09-14T10:45:43.679522+0000","last_unstale":"2024-09-14T11:23:00.571957+0000","last_undegraded":"2024-09-14T11:23:00.571957+0000","last_fullsized":"2024-09-14T11:23:00.571957+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'329","last_scrub_stamp":"2024-09-14T11:23:00.571795+0000","last_deep_scrub":"260'329","last_deep_scrub_stamp":"2024-09-14T11:23:00.571795+0000","last_clean_scrub_stamp":"2024-09-14T11:23:00.571795+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:46.489688+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1353,"num_read_kb":12978,"num_write":1165,"num_write_kb":34630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"260'4","reported_seq":971,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:08.708120+0000","last_change":"2024-09-14T11:23:08.708120+0000","last_active":"2024-09-14T11:23:08.708120+0000","last_peered":"2024-09-14T11:23:08.708120+0000","last_clean":"2024-09-14T11:23:08.708120+0000","last_became_active":"2024-09-14T10:45:47.727050+0000","last_became_peered":"2024-09-14T10:45:47.727050+0000","last_unstale":"2024-09-14T11:23:08.708120+0000","last_undegraded":"2024-09-14T11:23:08.708120+0000","last_fullsized":"2024-09-14T11:23:08.708120+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-14T11:23:08.708034+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-14T11:23:08.708034+0000","last_clean_scrub_stamp":"2024-09-14T11:23:08.708034+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:23.242324+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"260'102","reported_seq":617,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:41.139054+0000","last_change":"2024-09-14T10:45:49.734492+0000","last_active":"2024-09-14T11:22:41.139054+0000","last_peered":"2024-09-14T11:22:41.139054+0000","last_clean":"2024-09-14T11:22:41.139054+0000","last_became_active":"2024-09-14T10:45:49.734181+0000","last_became_peered":"2024-09-14T10:45:49.734181+0000","last_unstale":"2024-09-14T11:22:41.139054+0000","last_undegraded":"2024-09-14T11:22:41.139054+0000","last_fullsized":"2024-09-14T11:22:41.139054+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:39.185773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":121,"num_read_kb":115,"num_write":86,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":472,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:32.120940+0000","last_change":"2024-09-14T10:45:51.744573+0000","last_active":"2024-09-14T11:20:32.120940+0000","last_peered":"2024-09-14T11:20:32.120940+0000","last_clean":"2024-09-14T11:20:32.120940+0000","last_became_active":"2024-09-14T10:45:51.744280+0000","last_became_peered":"2024-09-14T10:45:51.744280+0000","last_unstale":"2024-09-14T11:20:32.120940+0000","last_undegraded":"2024-09-14T11:20:32.120940+0000","last_fullsized":"2024-09-14T11:20:32.120940+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:36.528487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"260'117","reported_seq":649,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.997667+0000","last_change":"2024-09-14T10:45:53.746846+0000","last_active":"2024-09-14T11:21:27.997667+0000","last_peered":"2024-09-14T11:21:27.997667+0000","last_clean":"2024-09-14T11:21:27.997667+0000","last_became_active":"2024-09-14T10:45:53.746484+0000","last_became_peered":"2024-09-14T10:45:53.746484+0000","last_unstale":"2024-09-14T11:21:27.997667+0000","last_undegraded":"2024-09-14T11:21:27.997667+0000","last_fullsized":"2024-09-14T11:21:27.997667+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:31.055773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":202,"num_write":278,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"260'1200","reported_seq":2910,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:02.495387+0000","last_change":"2024-09-14T11:23:02.495332+0000","last_active":"2024-09-14T11:23:02.495387+0000","last_peered":"2024-09-14T11:23:02.495387+0000","last_clean":"2024-09-14T11:23:02.495387+0000","last_became_active":"2024-09-14T10:45:45.713440+0000","last_became_peered":"2024-09-14T10:45:45.713440+0000","last_unstale":"2024-09-14T11:23:02.495387+0000","last_undegraded":"2024-09-14T11:23:02.495387+0000","last_fullsized":"2024-09-14T11:23:02.495387+0000","mapping_epoch":26,"log_start":"260'1100","ondisk_log_start":"260'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1200","last_scrub_stamp":"2024-09-14T11:23:02.495208+0000","last_deep_scrub":"260'1200","last_deep_scrub_stamp":"2024-09-14T11:23:02.495208+0000","last_clean_scrub_stamp":"2024-09-14T11:23:02.495208+0000","objects_scrubbed":4,"log_size":100,"log_dups_size":1100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:18:40.279776+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5652,"num_read_kb":5051,"num_write":1624,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"260'368","reported_seq":1063,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:56.140615+0000","last_change":"2024-09-14T11:22:56.140615+0000","last_active":"2024-09-14T11:22:56.140615+0000","last_peered":"2024-09-14T11:22:56.140615+0000","last_clean":"2024-09-14T11:22:56.140615+0000","last_became_active":"2024-09-14T10:45:43.682711+0000","last_became_peered":"2024-09-14T10:45:43.682711+0000","last_unstale":"2024-09-14T11:22:56.140615+0000","last_undegraded":"2024-09-14T11:22:56.140615+0000","last_fullsized":"2024-09-14T11:22:56.140615+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'368","last_scrub_stamp":"2024-09-14T11:22:56.140537+0000","last_deep_scrub":"260'368","last_deep_scrub_stamp":"2024-09-14T11:22:56.140537+0000","last_clean_scrub_stamp":"2024-09-14T11:22:56.140537+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:56:04.477168+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":849,"num_read_kb":26785,"num_write":1182,"num_write_kb":27965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":511,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:58.210095+0000","last_change":"2024-09-14T11:22:58.210044+0000","last_active":"2024-09-14T11:22:58.210095+0000","last_peered":"2024-09-14T11:22:58.210095+0000","last_clean":"2024-09-14T11:22:58.210095+0000","last_became_active":"2024-09-14T10:45:33.612983+0000","last_became_peered":"2024-09-14T10:45:33.612983+0000","last_unstale":"2024-09-14T11:22:58.210095+0000","last_undegraded":"2024-09-14T11:22:58.210095+0000","last_fullsized":"2024-09-14T11:22:58.210095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:58.209961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:58.209961+0000","last_clean_scrub_stamp":"2024-09-14T11:22:58.209961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:24.187827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053773700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":494,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:14.832421+0000","last_change":"2024-09-14T11:23:14.832421+0000","last_active":"2024-09-14T11:23:14.832421+0000","last_peered":"2024-09-14T11:23:14.832421+0000","last_clean":"2024-09-14T11:23:14.832421+0000","last_became_active":"2024-09-14T10:45:47.724317+0000","last_became_peered":"2024-09-14T10:45:47.724317+0000","last_unstale":"2024-09-14T11:23:14.832421+0000","last_undegraded":"2024-09-14T11:23:14.832421+0000","last_fullsized":"2024-09-14T11:23:14.832421+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:14.832323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:14.832323+0000","last_clean_scrub_stamp":"2024-09-14T11:23:14.832323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:35.877723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"260'555","reported_seq":1204,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:12.702336+0000","last_change":"2024-09-14T11:23:12.702336+0000","last_active":"2024-09-14T11:23:12.702336+0000","last_peered":"2024-09-14T11:23:12.702336+0000","last_clean":"2024-09-14T11:23:12.702336+0000","last_became_active":"2024-09-14T10:45:49.735662+0000","last_became_peered":"2024-09-14T10:45:49.735662+0000","last_unstale":"2024-09-14T11:23:12.702336+0000","last_undegraded":"2024-09-14T11:23:12.702336+0000","last_fullsized":"2024-09-14T11:23:12.702336+0000","mapping_epoch":30,"log_start":"260'500","ondisk_log_start":"260'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'555","last_scrub_stamp":"2024-09-14T11:23:12.702245+0000","last_deep_scrub":"260'555","last_deep_scrub_stamp":"2024-09-14T11:23:12.702245+0000","last_clean_scrub_stamp":"2024-09-14T11:23:12.702245+0000","objects_scrubbed":9,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:15.583995+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96714,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1561,"num_read_kb":2770,"num_write":2020,"num_write_kb":1869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":529654,"num_omap_keys":1194,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":477,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:14.406308+0000","last_change":"2024-09-14T11:23:14.406308+0000","last_active":"2024-09-14T11:23:14.406308+0000","last_peered":"2024-09-14T11:23:14.406308+0000","last_clean":"2024-09-14T11:23:14.406308+0000","last_became_active":"2024-09-14T10:45:51.749478+0000","last_became_peered":"2024-09-14T10:45:51.749478+0000","last_unstale":"2024-09-14T11:23:14.406308+0000","last_undegraded":"2024-09-14T11:23:14.406308+0000","last_fullsized":"2024-09-14T11:23:14.406308+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:14.406216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:14.406216+0000","last_clean_scrub_stamp":"2024-09-14T11:23:14.406216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:10.698911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"260'118","reported_seq":604,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:16.644526+0000","last_change":"2024-09-14T10:45:53.749875+0000","last_active":"2024-09-14T11:21:16.644526+0000","last_peered":"2024-09-14T11:21:16.644526+0000","last_clean":"2024-09-14T11:21:16.644526+0000","last_became_active":"2024-09-14T10:45:53.749578+0000","last_became_peered":"2024-09-14T10:45:53.749578+0000","last_unstale":"2024-09-14T11:21:16.644526+0000","last_undegraded":"2024-09-14T11:21:16.644526+0000","last_fullsized":"2024-09-14T11:21:16.644526+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:40.919662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":913,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":137,"num_read_kb":126,"num_write":281,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"260'864","reported_seq":2567,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:05.472851+0000","last_change":"2024-09-14T11:23:05.472779+0000","last_active":"2024-09-14T11:23:05.472851+0000","last_peered":"2024-09-14T11:23:05.472851+0000","last_clean":"2024-09-14T11:23:05.472851+0000","last_became_active":"2024-09-14T10:45:45.719783+0000","last_became_peered":"2024-09-14T10:45:45.719783+0000","last_unstale":"2024-09-14T11:23:05.472851+0000","last_undegraded":"2024-09-14T11:23:05.472851+0000","last_fullsized":"2024-09-14T11:23:05.472851+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'864","last_scrub_stamp":"2024-09-14T11:23:05.472688+0000","last_deep_scrub":"260'864","last_deep_scrub_stamp":"2024-09-14T11:23:05.472688+0000","last_clean_scrub_stamp":"2024-09-14T11:23:05.472688+0000","objects_scrubbed":3,"log_size":64,"log_dups_size":800,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:31.265160+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4184,"num_read_kb":3795,"num_write":1124,"num_write_kb":397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"260'369","reported_seq":992,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:59.565502+0000","last_change":"2024-09-14T11:22:59.565447+0000","last_active":"2024-09-14T11:22:59.565502+0000","last_peered":"2024-09-14T11:22:59.565502+0000","last_clean":"2024-09-14T11:22:59.565502+0000","last_became_active":"2024-09-14T10:45:43.685775+0000","last_became_peered":"2024-09-14T10:45:43.685775+0000","last_unstale":"2024-09-14T11:22:59.565502+0000","last_undegraded":"2024-09-14T11:22:59.565502+0000","last_fullsized":"2024-09-14T11:22:59.565502+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'369","last_scrub_stamp":"2024-09-14T11:22:59.565357+0000","last_deep_scrub":"260'369","last_deep_scrub_stamp":"2024-09-14T11:22:59.565357+0000","last_clean_scrub_stamp":"2024-09-14T11:22:59.565357+0000","objects_scrubbed":3,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:14.300547+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":660,"num_read_kb":2173,"num_write":1090,"num_write_kb":20935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":512,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:59.293347+0000","last_change":"2024-09-14T11:22:59.293285+0000","last_active":"2024-09-14T11:22:59.293347+0000","last_peered":"2024-09-14T11:22:59.293347+0000","last_clean":"2024-09-14T11:22:59.293347+0000","last_became_active":"2024-09-14T10:45:33.564407+0000","last_became_peered":"2024-09-14T10:45:33.564407+0000","last_unstale":"2024-09-14T11:22:59.293347+0000","last_undegraded":"2024-09-14T11:22:59.293347+0000","last_fullsized":"2024-09-14T11:22:59.293347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:59.293199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:59.293199+0000","last_clean_scrub_stamp":"2024-09-14T11:22:59.293199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:33.650485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099134599999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":496,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:09.610979+0000","last_change":"2024-09-14T11:23:09.610887+0000","last_active":"2024-09-14T11:23:09.610979+0000","last_peered":"2024-09-14T11:23:09.610979+0000","last_clean":"2024-09-14T11:23:09.610979+0000","last_became_active":"2024-09-14T10:45:47.724774+0000","last_became_peered":"2024-09-14T10:45:47.724774+0000","last_unstale":"2024-09-14T11:23:09.610979+0000","last_undegraded":"2024-09-14T11:23:09.610979+0000","last_fullsized":"2024-09-14T11:23:09.610979+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:09.610793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:09.610793+0000","last_clean_scrub_stamp":"2024-09-14T11:23:09.610793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:43.851455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"260'164","reported_seq":708,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:14.279970+0000","last_change":"2024-09-14T11:23:14.279970+0000","last_active":"2024-09-14T11:23:14.279970+0000","last_peered":"2024-09-14T11:23:14.279970+0000","last_clean":"2024-09-14T11:23:14.279970+0000","last_became_active":"2024-09-14T10:45:49.731380+0000","last_became_peered":"2024-09-14T10:45:49.731380+0000","last_unstale":"2024-09-14T11:23:14.279970+0000","last_undegraded":"2024-09-14T11:23:14.279970+0000","last_fullsized":"2024-09-14T11:23:14.279970+0000","mapping_epoch":30,"log_start":"257'100","ondisk_log_start":"257'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'164","last_scrub_stamp":"2024-09-14T11:23:14.279872+0000","last_deep_scrub":"260'164","last_deep_scrub_stamp":"2024-09-14T11:23:14.279872+0000","last_clean_scrub_stamp":"2024-09-14T11:23:14.279872+0000","objects_scrubbed":9,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:37:02.128672+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":200,"num_read_kb":190,"num_write":162,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6272,"num_omap_keys":14,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"260'796","reported_seq":2740,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.299652+0000","last_change":"2024-09-14T10:45:51.747482+0000","last_active":"2024-09-14T11:22:50.299652+0000","last_peered":"2024-09-14T11:22:50.299652+0000","last_clean":"2024-09-14T11:22:50.299652+0000","last_became_active":"2024-09-14T10:45:51.746984+0000","last_became_peered":"2024-09-14T10:45:51.746984+0000","last_unstale":"2024-09-14T11:22:50.299652+0000","last_undegraded":"2024-09-14T11:22:50.299652+0000","last_fullsized":"2024-09-14T11:22:50.299652+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:45.422324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"260'119","reported_seq":610,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:06.014335+0000","last_change":"2024-09-14T10:45:53.750253+0000","last_active":"2024-09-14T11:22:06.014335+0000","last_peered":"2024-09-14T11:22:06.014335+0000","last_clean":"2024-09-14T11:22:06.014335+0000","last_became_active":"2024-09-14T10:45:53.749802+0000","last_became_peered":"2024-09-14T10:45:53.749802+0000","last_unstale":"2024-09-14T11:22:06.014335+0000","last_undegraded":"2024-09-14T11:22:06.014335+0000","last_fullsized":"2024-09-14T11:22:06.014335+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:31.303920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":146,"num_read_kb":135,"num_write":274,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"260'413","reported_seq":1906,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:01.936290+0000","last_change":"2024-09-14T11:23:01.936290+0000","last_active":"2024-09-14T11:23:01.936290+0000","last_peered":"2024-09-14T11:23:01.936290+0000","last_clean":"2024-09-14T11:23:01.936290+0000","last_became_active":"2024-09-14T10:45:45.710204+0000","last_became_peered":"2024-09-14T10:45:45.710204+0000","last_unstale":"2024-09-14T11:23:01.936290+0000","last_undegraded":"2024-09-14T11:23:01.936290+0000","last_fullsized":"2024-09-14T11:23:01.936290+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'413","last_scrub_stamp":"2024-09-14T11:23:01.936187+0000","last_deep_scrub":"260'413","last_deep_scrub_stamp":"2024-09-14T11:23:01.936187+0000","last_clean_scrub_stamp":"2024-09-14T11:23:01.936187+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:16.997744+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2141,"num_read_kb":2031,"num_write":456,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"260'376","reported_seq":1153,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:58.064053+0000","last_change":"2024-09-14T11:22:58.064053+0000","last_active":"2024-09-14T11:22:58.064053+0000","last_peered":"2024-09-14T11:22:58.064053+0000","last_clean":"2024-09-14T11:22:58.064053+0000","last_became_active":"2024-09-14T10:45:43.688114+0000","last_became_peered":"2024-09-14T10:45:43.688114+0000","last_unstale":"2024-09-14T11:22:58.064053+0000","last_undegraded":"2024-09-14T11:22:58.064053+0000","last_fullsized":"2024-09-14T11:22:58.064053+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'376","last_scrub_stamp":"2024-09-14T11:22:58.063966+0000","last_deep_scrub":"260'376","last_deep_scrub_stamp":"2024-09-14T11:22:58.063966+0000","last_clean_scrub_stamp":"2024-09-14T11:22:58.063966+0000","objects_scrubbed":3,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:30.176310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":828,"num_read_kb":15214,"num_write":1175,"num_write_kb":42293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":517,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:00.943595+0000","last_change":"2024-09-14T11:23:00.943595+0000","last_active":"2024-09-14T11:23:00.943595+0000","last_peered":"2024-09-14T11:23:00.943595+0000","last_clean":"2024-09-14T11:23:00.943595+0000","last_became_active":"2024-09-14T10:45:33.610909+0000","last_became_peered":"2024-09-14T10:45:33.610909+0000","last_unstale":"2024-09-14T11:23:00.943595+0000","last_undegraded":"2024-09-14T11:23:00.943595+0000","last_fullsized":"2024-09-14T11:23:00.943595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:00.943508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:00.943508+0000","last_clean_scrub_stamp":"2024-09-14T11:23:00.943508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:53.613527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038435900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":481,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:12.127091+0000","last_change":"2024-09-14T10:45:47.728711+0000","last_active":"2024-09-14T11:21:12.127091+0000","last_peered":"2024-09-14T11:21:12.127091+0000","last_clean":"2024-09-14T11:21:12.127091+0000","last_became_active":"2024-09-14T10:45:47.728343+0000","last_became_peered":"2024-09-14T10:45:47.728343+0000","last_unstale":"2024-09-14T11:21:12.127091+0000","last_undegraded":"2024-09-14T11:21:12.127091+0000","last_fullsized":"2024-09-14T11:21:12.127091+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"260'92","reported_seq":605,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:56.315196+0000","last_change":"2024-09-14T10:45:49.736010+0000","last_active":"2024-09-14T11:20:56.315196+0000","last_peered":"2024-09-14T11:20:56.315196+0000","last_clean":"2024-09-14T11:20:56.315196+0000","last_became_active":"2024-09-14T10:45:49.735557+0000","last_became_peered":"2024-09-14T10:45:49.735557+0000","last_unstale":"2024-09-14T11:20:56.315196+0000","last_undegraded":"2024-09-14T11:20:56.315196+0000","last_fullsized":"2024-09-14T11:20:56.315196+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:10:56.092992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"260'805","reported_seq":2212,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.304025+0000","last_change":"2024-09-14T10:45:51.747138+0000","last_active":"2024-09-14T11:22:50.304025+0000","last_peered":"2024-09-14T11:22:50.304025+0000","last_clean":"2024-09-14T11:22:50.304025+0000","last_became_active":"2024-09-14T10:45:51.746874+0000","last_became_peered":"2024-09-14T10:45:51.746874+0000","last_unstale":"2024-09-14T11:22:50.304025+0000","last_undegraded":"2024-09-14T11:22:50.304025+0000","last_fullsized":"2024-09-14T11:22:50.304025+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:47.844695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"260'171","reported_seq":654,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:06.378984+0000","last_change":"2024-09-14T10:45:53.749142+0000","last_active":"2024-09-14T11:21:06.378984+0000","last_peered":"2024-09-14T11:21:06.378984+0000","last_clean":"2024-09-14T11:21:06.378984+0000","last_became_active":"2024-09-14T10:45:53.748880+0000","last_became_peered":"2024-09-14T10:45:53.748880+0000","last_unstale":"2024-09-14T11:21:06.378984+0000","last_undegraded":"2024-09-14T11:21:06.378984+0000","last_fullsized":"2024-09-14T11:21:06.378984+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:00:48.684200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":483,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":133,"num_read_kb":125,"num_write":394,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"260'405","reported_seq":1916,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.842434+0000","last_change":"2024-09-14T10:45:45.713570+0000","last_active":"2024-09-14T11:22:42.842434+0000","last_peered":"2024-09-14T11:22:42.842434+0000","last_clean":"2024-09-14T11:22:42.842434+0000","last_became_active":"2024-09-14T10:45:45.713313+0000","last_became_peered":"2024-09-14T10:45:45.713313+0000","last_unstale":"2024-09-14T11:22:42.842434+0000","last_undegraded":"2024-09-14T11:22:42.842434+0000","last_fullsized":"2024-09-14T11:22:42.842434+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2392,"num_read_kb":2258,"num_write":470,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"260'370","reported_seq":1118,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:03.896483+0000","last_change":"2024-09-14T11:23:03.896483+0000","last_active":"2024-09-14T11:23:03.896483+0000","last_peered":"2024-09-14T11:23:03.896483+0000","last_clean":"2024-09-14T11:23:03.896483+0000","last_became_active":"2024-09-14T10:45:43.689593+0000","last_became_peered":"2024-09-14T10:45:43.689593+0000","last_unstale":"2024-09-14T11:23:03.896483+0000","last_undegraded":"2024-09-14T11:23:03.896483+0000","last_fullsized":"2024-09-14T11:23:03.896483+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'370","last_scrub_stamp":"2024-09-14T11:23:03.896370+0000","last_deep_scrub":"260'370","last_deep_scrub_stamp":"2024-09-14T11:23:03.896370+0000","last_clean_scrub_stamp":"2024-09-14T11:23:03.896370+0000","objects_scrubbed":5,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:58:27.060305+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267348,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1017,"num_read_kb":46619,"num_write":1250,"num_write_kb":43963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":511,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:00.328992+0000","last_change":"2024-09-14T11:23:00.328992+0000","last_active":"2024-09-14T11:23:00.328992+0000","last_peered":"2024-09-14T11:23:00.328992+0000","last_clean":"2024-09-14T11:23:00.328992+0000","last_became_active":"2024-09-14T10:45:33.610689+0000","last_became_peered":"2024-09-14T10:45:33.610689+0000","last_unstale":"2024-09-14T11:23:00.328992+0000","last_undegraded":"2024-09-14T11:23:00.328992+0000","last_fullsized":"2024-09-14T11:23:00.328992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:00.328887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:00.328887+0000","last_clean_scrub_stamp":"2024-09-14T11:23:00.328887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:01:42.965803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011461920000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":495,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:11.785031+0000","last_change":"2024-09-14T11:23:11.785031+0000","last_active":"2024-09-14T11:23:11.785031+0000","last_peered":"2024-09-14T11:23:11.785031+0000","last_clean":"2024-09-14T11:23:11.785031+0000","last_became_active":"2024-09-14T10:45:47.728312+0000","last_became_peered":"2024-09-14T10:45:47.728312+0000","last_unstale":"2024-09-14T11:23:11.785031+0000","last_undegraded":"2024-09-14T11:23:11.785031+0000","last_fullsized":"2024-09-14T11:23:11.785031+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:11.784943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:11.784943+0000","last_clean_scrub_stamp":"2024-09-14T11:23:11.784943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:16.816883+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"260'724","reported_seq":1434,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:12.640223+0000","last_change":"2024-09-14T11:23:12.640223+0000","last_active":"2024-09-14T11:23:12.640223+0000","last_peered":"2024-09-14T11:23:12.640223+0000","last_clean":"2024-09-14T11:23:12.640223+0000","last_became_active":"2024-09-14T10:45:49.733812+0000","last_became_peered":"2024-09-14T10:45:49.733812+0000","last_unstale":"2024-09-14T11:23:12.640223+0000","last_undegraded":"2024-09-14T11:23:12.640223+0000","last_fullsized":"2024-09-14T11:23:12.640223+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'724","last_scrub_stamp":"2024-09-14T11:23:12.640119+0000","last_deep_scrub":"260'724","last_deep_scrub_stamp":"2024-09-14T11:23:12.640119+0000","last_clean_scrub_stamp":"2024-09-14T11:23:12.640119+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":700,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:51.052214+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137505,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1282,"num_read_kb":3061,"num_write":1046,"num_write_kb":877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:11.113894+0000","last_change":"2024-09-14T10:45:51.746053+0000","last_active":"2024-09-14T11:19:11.113894+0000","last_peered":"2024-09-14T11:19:11.113894+0000","last_clean":"2024-09-14T11:19:11.113894+0000","last_became_active":"2024-09-14T10:45:51.745137+0000","last_became_peered":"2024-09-14T10:45:51.745137+0000","last_unstale":"2024-09-14T11:19:11.113894+0000","last_undegraded":"2024-09-14T11:19:11.113894+0000","last_fullsized":"2024-09-14T11:19:11.113894+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:34.202906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"260'130","reported_seq":622,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.045272+0000","last_change":"2024-09-14T10:45:53.751882+0000","last_active":"2024-09-14T11:21:27.045272+0000","last_peered":"2024-09-14T11:21:27.045272+0000","last_clean":"2024-09-14T11:21:27.045272+0000","last_became_active":"2024-09-14T10:45:53.751511+0000","last_became_peered":"2024-09-14T10:45:53.751511+0000","last_unstale":"2024-09-14T11:21:27.045272+0000","last_undegraded":"2024-09-14T11:21:27.045272+0000","last_fullsized":"2024-09-14T11:21:27.045272+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:34.995970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":202,"num_read_kb":180,"num_write":339,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"260'195","reported_seq":792,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.396620+0000","last_change":"2024-09-14T10:45:53.747335+0000","last_active":"2024-09-14T11:21:28.396620+0000","last_peered":"2024-09-14T11:21:28.396620+0000","last_clean":"2024-09-14T11:21:28.396620+0000","last_became_active":"2024-09-14T10:45:53.747090+0000","last_became_peered":"2024-09-14T10:45:53.747090+0000","last_unstale":"2024-09-14T11:21:28.396620+0000","last_undegraded":"2024-09-14T11:21:28.396620+0000","last_fullsized":"2024-09-14T11:21:28.396620+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:02.580660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":464,"num_read_kb":408,"num_write":469,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"260'463","reported_seq":1949,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:13.405280+0000","last_change":"2024-09-14T11:23:13.405280+0000","last_active":"2024-09-14T11:23:13.405280+0000","last_peered":"2024-09-14T11:23:13.405280+0000","last_clean":"2024-09-14T11:23:13.405280+0000","last_became_active":"2024-09-14T10:45:45.719181+0000","last_became_peered":"2024-09-14T10:45:45.719181+0000","last_unstale":"2024-09-14T11:23:13.405280+0000","last_undegraded":"2024-09-14T11:23:13.405280+0000","last_fullsized":"2024-09-14T11:23:13.405280+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'463","last_scrub_stamp":"2024-09-14T11:23:13.405187+0000","last_deep_scrub":"260'463","last_deep_scrub_stamp":"2024-09-14T11:23:13.405187+0000","last_clean_scrub_stamp":"2024-09-14T11:23:13.405187+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:49:14.290897+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2298,"num_read_kb":2151,"num_write":532,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"260'403","reported_seq":1070,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:06.181433+0000","last_change":"2024-09-14T11:23:06.181360+0000","last_active":"2024-09-14T11:23:06.181433+0000","last_peered":"2024-09-14T11:23:06.181433+0000","last_clean":"2024-09-14T11:23:06.181433+0000","last_became_active":"2024-09-14T10:45:43.673475+0000","last_became_peered":"2024-09-14T10:45:43.673475+0000","last_unstale":"2024-09-14T11:23:06.181433+0000","last_undegraded":"2024-09-14T11:23:06.181433+0000","last_fullsized":"2024-09-14T11:23:06.181433+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'403","last_scrub_stamp":"2024-09-14T11:23:06.181264+0000","last_deep_scrub":"260'403","last_deep_scrub_stamp":"2024-09-14T11:23:06.181264+0000","last_clean_scrub_stamp":"2024-09-14T11:23:06.181264+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:01.791158+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":761,"num_read_kb":57050,"num_write":1291,"num_write_kb":43494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:13.270673+0000","last_change":"2024-09-14T11:23:13.270673+0000","last_active":"2024-09-14T11:23:13.270673+0000","last_peered":"2024-09-14T11:23:13.270673+0000","last_clean":"2024-09-14T11:23:13.270673+0000","last_became_active":"2024-09-14T10:45:47.726819+0000","last_became_peered":"2024-09-14T10:45:47.726819+0000","last_unstale":"2024-09-14T11:23:13.270673+0000","last_undegraded":"2024-09-14T11:23:13.270673+0000","last_fullsized":"2024-09-14T11:23:13.270673+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:13.270587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:13.270587+0000","last_clean_scrub_stamp":"2024-09-14T11:23:13.270587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:32:10.160393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"260'271","reported_seq":823,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.562620+0000","last_change":"2024-09-14T10:45:49.733250+0000","last_active":"2024-09-14T11:22:50.562620+0000","last_peered":"2024-09-14T11:22:50.562620+0000","last_clean":"2024-09-14T11:22:50.562620+0000","last_became_active":"2024-09-14T10:45:49.732755+0000","last_became_peered":"2024-09-14T10:45:49.732755+0000","last_unstale":"2024-09-14T11:22:50.562620+0000","last_undegraded":"2024-09-14T11:22:50.562620+0000","last_fullsized":"2024-09-14T11:22:50.562620+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48124,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":453,"num_read_kb":1077,"num_write":370,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":473,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:51.003675+0000","last_change":"2024-09-14T10:45:51.747909+0000","last_active":"2024-09-14T11:20:51.003675+0000","last_peered":"2024-09-14T11:20:51.003675+0000","last_clean":"2024-09-14T11:20:51.003675+0000","last_became_active":"2024-09-14T10:45:51.747624+0000","last_became_peered":"2024-09-14T10:45:51.747624+0000","last_unstale":"2024-09-14T11:20:51.003675+0000","last_undegraded":"2024-09-14T11:20:51.003675+0000","last_fullsized":"2024-09-14T11:20:51.003675+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"260'138","reported_seq":626,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:14.388075+0000","last_change":"2024-09-14T10:45:53.751186+0000","last_active":"2024-09-14T11:21:14.388075+0000","last_peered":"2024-09-14T11:21:14.388075+0000","last_clean":"2024-09-14T11:21:14.388075+0000","last_became_active":"2024-09-14T10:45:53.750866+0000","last_became_peered":"2024-09-14T10:45:53.750866+0000","last_unstale":"2024-09-14T11:21:14.388075+0000","last_undegraded":"2024-09-14T11:21:14.388075+0000","last_fullsized":"2024-09-14T11:21:14.388075+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:54.350231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":161,"num_read_kb":145,"num_write":328,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"260'718","reported_seq":2452,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:05.853802+0000","last_change":"2024-09-14T11:23:05.853747+0000","last_active":"2024-09-14T11:23:05.853802+0000","last_peered":"2024-09-14T11:23:05.853802+0000","last_clean":"2024-09-14T11:23:05.853802+0000","last_became_active":"2024-09-14T10:45:45.719731+0000","last_became_peered":"2024-09-14T10:45:45.719731+0000","last_unstale":"2024-09-14T11:23:05.853802+0000","last_undegraded":"2024-09-14T11:23:05.853802+0000","last_fullsized":"2024-09-14T11:23:05.853802+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'718","last_scrub_stamp":"2024-09-14T11:23:05.853644+0000","last_deep_scrub":"260'718","last_deep_scrub_stamp":"2024-09-14T11:23:05.853644+0000","last_clean_scrub_stamp":"2024-09-14T11:23:05.853644+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":700,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:10.570219+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3605,"num_read_kb":3249,"num_write":949,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":744,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"260'335","reported_seq":951,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:55.643327+0000","last_change":"2024-09-14T11:22:55.643327+0000","last_active":"2024-09-14T11:22:55.643327+0000","last_peered":"2024-09-14T11:22:55.643327+0000","last_clean":"2024-09-14T11:22:55.643327+0000","last_became_active":"2024-09-14T10:45:43.682925+0000","last_became_peered":"2024-09-14T10:45:43.682925+0000","last_unstale":"2024-09-14T11:22:55.643327+0000","last_undegraded":"2024-09-14T11:22:55.643327+0000","last_fullsized":"2024-09-14T11:22:55.643327+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'335","last_scrub_stamp":"2024-09-14T11:22:55.643226+0000","last_deep_scrub":"260'335","last_deep_scrub_stamp":"2024-09-14T11:22:55.643226+0000","last_clean_scrub_stamp":"2024-09-14T11:22:55.643226+0000","objects_scrubbed":3,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:47:02.635100+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":623,"num_read_kb":1213,"num_write":1012,"num_write_kb":13029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":493,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:15.845183+0000","last_change":"2024-09-14T11:23:15.845183+0000","last_active":"2024-09-14T11:23:15.845183+0000","last_peered":"2024-09-14T11:23:15.845183+0000","last_clean":"2024-09-14T11:23:15.845183+0000","last_became_active":"2024-09-14T10:45:47.724432+0000","last_became_peered":"2024-09-14T10:45:47.724432+0000","last_unstale":"2024-09-14T11:23:15.845183+0000","last_undegraded":"2024-09-14T11:23:15.845183+0000","last_fullsized":"2024-09-14T11:23:15.845183+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:15.845093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:15.845093+0000","last_clean_scrub_stamp":"2024-09-14T11:23:15.845093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:06.714822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"260'45","reported_seq":534,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:03.424788+0000","last_change":"2024-09-14T10:45:49.735467+0000","last_active":"2024-09-14T11:21:03.424788+0000","last_peered":"2024-09-14T11:21:03.424788+0000","last_clean":"2024-09-14T11:21:03.424788+0000","last_became_active":"2024-09-14T10:45:49.735053+0000","last_became_peered":"2024-09-14T10:45:49.735053+0000","last_unstale":"2024-09-14T11:21:03.424788+0000","last_undegraded":"2024-09-14T11:21:03.424788+0000","last_fullsized":"2024-09-14T11:21:03.424788+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":24,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":468,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:54.998886+0000","last_change":"2024-09-14T10:45:51.748011+0000","last_active":"2024-09-14T11:20:54.998886+0000","last_peered":"2024-09-14T11:20:54.998886+0000","last_clean":"2024-09-14T11:20:54.998886+0000","last_became_active":"2024-09-14T10:45:51.747600+0000","last_became_peered":"2024-09-14T10:45:51.747600+0000","last_unstale":"2024-09-14T11:20:54.998886+0000","last_undegraded":"2024-09-14T11:20:54.998886+0000","last_fullsized":"2024-09-14T11:20:54.998886+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"260'223","reported_seq":744,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.339917+0000","last_change":"2024-09-14T10:45:53.751787+0000","last_active":"2024-09-14T11:21:28.339917+0000","last_peered":"2024-09-14T11:21:28.339917+0000","last_clean":"2024-09-14T11:21:28.339917+0000","last_became_active":"2024-09-14T10:45:53.751504+0000","last_became_peered":"2024-09-14T10:45:53.751504+0000","last_unstale":"2024-09-14T11:21:28.339917+0000","last_undegraded":"2024-09-14T11:21:28.339917+0000","last_fullsized":"2024-09-14T11:21:28.339917+0000","mapping_epoch":34,"log_start":"260'200","ondisk_log_start":"260'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:27.845346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":402,"num_read_kb":374,"num_write":536,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"260'728","reported_seq":2181,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:04.897428+0000","last_change":"2024-09-14T11:23:04.897345+0000","last_active":"2024-09-14T11:23:04.897428+0000","last_peered":"2024-09-14T11:23:04.897428+0000","last_clean":"2024-09-14T11:23:04.897428+0000","last_became_active":"2024-09-14T10:45:45.714326+0000","last_became_peered":"2024-09-14T10:45:45.714326+0000","last_unstale":"2024-09-14T11:23:04.897428+0000","last_undegraded":"2024-09-14T11:23:04.897428+0000","last_fullsized":"2024-09-14T11:23:04.897428+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'728","last_scrub_stamp":"2024-09-14T11:23:04.897221+0000","last_deep_scrub":"260'728","last_deep_scrub_stamp":"2024-09-14T11:23:04.897221+0000","last_clean_scrub_stamp":"2024-09-14T11:23:04.897221+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":700,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:36:03.252363+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3492,"num_read_kb":3158,"num_write":966,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"260'397","reported_seq":1053,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:59.257108+0000","last_change":"2024-09-14T11:22:59.257108+0000","last_active":"2024-09-14T11:22:59.257108+0000","last_peered":"2024-09-14T11:22:59.257108+0000","last_clean":"2024-09-14T11:22:59.257108+0000","last_became_active":"2024-09-14T10:45:43.671747+0000","last_became_peered":"2024-09-14T10:45:43.671747+0000","last_unstale":"2024-09-14T11:22:59.257108+0000","last_undegraded":"2024-09-14T11:22:59.257108+0000","last_fullsized":"2024-09-14T11:22:59.257108+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'397","last_scrub_stamp":"2024-09-14T11:22:59.256989+0000","last_deep_scrub":"260'397","last_deep_scrub_stamp":"2024-09-14T11:22:59.256989+0000","last_clean_scrub_stamp":"2024-09-14T11:22:59.256989+0000","objects_scrubbed":7,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:33.390781+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":703,"num_read_kb":3196,"num_write":1248,"num_write_kb":29609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:07.246948+0000","last_change":"2024-09-14T11:23:07.246825+0000","last_active":"2024-09-14T11:23:07.246948+0000","last_peered":"2024-09-14T11:23:07.246948+0000","last_clean":"2024-09-14T11:23:07.246948+0000","last_became_active":"2024-09-14T10:45:47.731640+0000","last_became_peered":"2024-09-14T10:45:47.731640+0000","last_unstale":"2024-09-14T11:23:07.246948+0000","last_undegraded":"2024-09-14T11:23:07.246948+0000","last_fullsized":"2024-09-14T11:23:07.246948+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:07.246721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:07.246721+0000","last_clean_scrub_stamp":"2024-09-14T11:23:07.246721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:46.259045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"260'325","reported_seq":903,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:13.682072+0000","last_change":"2024-09-14T11:23:13.682072+0000","last_active":"2024-09-14T11:23:13.682072+0000","last_peered":"2024-09-14T11:23:13.682072+0000","last_clean":"2024-09-14T11:23:13.682072+0000","last_became_active":"2024-09-14T10:45:49.727431+0000","last_became_peered":"2024-09-14T10:45:49.727431+0000","last_unstale":"2024-09-14T11:23:13.682072+0000","last_undegraded":"2024-09-14T11:23:13.682072+0000","last_fullsized":"2024-09-14T11:23:13.682072+0000","mapping_epoch":30,"log_start":"260'300","ondisk_log_start":"260'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'325","last_scrub_stamp":"2024-09-14T11:23:13.681974+0000","last_deep_scrub":"260'325","last_deep_scrub_stamp":"2024-09-14T11:23:13.681974+0000","last_clean_scrub_stamp":"2024-09-14T11:23:13.681974+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:16:25.075634+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46674,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":519,"num_read_kb":1163,"num_write":422,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":477,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:52.124277+0000","last_change":"2024-09-14T10:45:51.747148+0000","last_active":"2024-09-14T11:20:52.124277+0000","last_peered":"2024-09-14T11:20:52.124277+0000","last_clean":"2024-09-14T11:20:52.124277+0000","last_became_active":"2024-09-14T10:45:51.746506+0000","last_became_peered":"2024-09-14T10:45:51.746506+0000","last_unstale":"2024-09-14T11:20:52.124277+0000","last_undegraded":"2024-09-14T11:20:52.124277+0000","last_fullsized":"2024-09-14T11:20:52.124277+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"260'144","reported_seq":636,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:12.863430+0000","last_change":"2024-09-14T10:45:53.755475+0000","last_active":"2024-09-14T11:21:12.863430+0000","last_peered":"2024-09-14T11:21:12.863430+0000","last_clean":"2024-09-14T11:21:12.863430+0000","last_became_active":"2024-09-14T10:45:53.755018+0000","last_became_peered":"2024-09-14T10:45:53.755018+0000","last_unstale":"2024-09-14T11:21:12.863430+0000","last_undegraded":"2024-09-14T11:21:12.863430+0000","last_fullsized":"2024-09-14T11:21:12.863430+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:18.887717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":167,"num_write":339,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"260'401","reported_seq":1936,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:03.743737+0000","last_change":"2024-09-14T11:23:03.743647+0000","last_active":"2024-09-14T11:23:03.743737+0000","last_peered":"2024-09-14T11:23:03.743737+0000","last_clean":"2024-09-14T11:23:03.743737+0000","last_became_active":"2024-09-14T10:45:45.713138+0000","last_became_peered":"2024-09-14T10:45:45.713138+0000","last_unstale":"2024-09-14T11:23:03.743737+0000","last_undegraded":"2024-09-14T11:23:03.743737+0000","last_fullsized":"2024-09-14T11:23:03.743737+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'401","last_scrub_stamp":"2024-09-14T11:23:03.743538+0000","last_deep_scrub":"260'401","last_deep_scrub_stamp":"2024-09-14T11:23:03.743538+0000","last_clean_scrub_stamp":"2024-09-14T11:23:03.743538+0000","objects_scrubbed":1,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:26.074630+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2187,"num_read_kb":2089,"num_write":453,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"260'381","reported_seq":999,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:57.171682+0000","last_change":"2024-09-14T11:22:57.171682+0000","last_active":"2024-09-14T11:22:57.171682+0000","last_peered":"2024-09-14T11:22:57.171682+0000","last_clean":"2024-09-14T11:22:57.171682+0000","last_became_active":"2024-09-14T10:45:43.680629+0000","last_became_peered":"2024-09-14T10:45:43.680629+0000","last_unstale":"2024-09-14T11:22:57.171682+0000","last_undegraded":"2024-09-14T11:22:57.171682+0000","last_fullsized":"2024-09-14T11:22:57.171682+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'381","last_scrub_stamp":"2024-09-14T11:22:57.171580+0000","last_deep_scrub":"260'381","last_deep_scrub_stamp":"2024-09-14T11:22:57.171580+0000","last_clean_scrub_stamp":"2024-09-14T11:22:57.171580+0000","objects_scrubbed":6,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:30.709275+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133684,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":617,"num_read_kb":9938,"num_write":1232,"num_write_kb":44861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":479,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:47.123458+0000","last_change":"2024-09-14T10:45:47.728061+0000","last_active":"2024-09-14T11:20:47.123458+0000","last_peered":"2024-09-14T11:20:47.123458+0000","last_clean":"2024-09-14T11:20:47.123458+0000","last_became_active":"2024-09-14T10:45:47.727777+0000","last_became_peered":"2024-09-14T10:45:47.727777+0000","last_unstale":"2024-09-14T11:20:47.123458+0000","last_undegraded":"2024-09-14T11:20:47.123458+0000","last_fullsized":"2024-09-14T11:20:47.123458+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"260'274","reported_seq":837,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:15.664884+0000","last_change":"2024-09-14T11:23:15.664884+0000","last_active":"2024-09-14T11:23:15.664884+0000","last_peered":"2024-09-14T11:23:15.664884+0000","last_clean":"2024-09-14T11:23:15.664884+0000","last_became_active":"2024-09-14T10:45:49.727347+0000","last_became_peered":"2024-09-14T10:45:49.727347+0000","last_unstale":"2024-09-14T11:23:15.664884+0000","last_undegraded":"2024-09-14T11:23:15.664884+0000","last_fullsized":"2024-09-14T11:23:15.664884+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'274","last_scrub_stamp":"2024-09-14T11:23:15.664798+0000","last_deep_scrub":"260'274","last_deep_scrub_stamp":"2024-09-14T11:23:15.664798+0000","last_clean_scrub_stamp":"2024-09-14T11:23:15.664798+0000","objects_scrubbed":4,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:54:10.815390+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44334,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":417,"num_read_kb":936,"num_write":344,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":473,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:51.003757+0000","last_change":"2024-09-14T10:45:51.746782+0000","last_active":"2024-09-14T11:20:51.003757+0000","last_peered":"2024-09-14T11:20:51.003757+0000","last_clean":"2024-09-14T11:20:51.003757+0000","last_became_active":"2024-09-14T10:45:51.746493+0000","last_became_peered":"2024-09-14T10:45:51.746493+0000","last_unstale":"2024-09-14T11:20:51.003757+0000","last_undegraded":"2024-09-14T11:20:51.003757+0000","last_fullsized":"2024-09-14T11:20:51.003757+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"260'405","reported_seq":1976,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:14.957976+0000","last_change":"2024-09-14T10:45:45.725798+0000","last_active":"2024-09-14T11:21:14.957976+0000","last_peered":"2024-09-14T11:21:14.957976+0000","last_clean":"2024-09-14T11:21:14.957976+0000","last_became_active":"2024-09-14T10:45:45.725430+0000","last_became_peered":"2024-09-14T10:45:45.725430+0000","last_unstale":"2024-09-14T11:21:14.957976+0000","last_undegraded":"2024-09-14T11:21:14.957976+0000","last_fullsized":"2024-09-14T11:21:14.957976+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2252,"num_read_kb":2164,"num_write":454,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"260'321","reported_seq":945,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:59.248925+0000","last_change":"2024-09-14T11:22:59.248925+0000","last_active":"2024-09-14T11:22:59.248925+0000","last_peered":"2024-09-14T11:22:59.248925+0000","last_clean":"2024-09-14T11:22:59.248925+0000","last_became_active":"2024-09-14T10:45:43.683988+0000","last_became_peered":"2024-09-14T10:45:43.683988+0000","last_unstale":"2024-09-14T11:22:59.248925+0000","last_undegraded":"2024-09-14T11:22:59.248925+0000","last_fullsized":"2024-09-14T11:22:59.248925+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'321","last_scrub_stamp":"2024-09-14T11:22:59.248787+0000","last_deep_scrub":"260'321","last_deep_scrub_stamp":"2024-09-14T11:22:59.248787+0000","last_clean_scrub_stamp":"2024-09-14T11:22:59.248787+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:00.495190+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":562,"num_read_kb":32573,"num_write":1061,"num_write_kb":14583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:15.227653+0000","last_change":"2024-09-14T11:23:15.227653+0000","last_active":"2024-09-14T11:23:15.227653+0000","last_peered":"2024-09-14T11:23:15.227653+0000","last_clean":"2024-09-14T11:23:15.227653+0000","last_became_active":"2024-09-14T10:45:47.728323+0000","last_became_peered":"2024-09-14T10:45:47.728323+0000","last_unstale":"2024-09-14T11:23:15.227653+0000","last_undegraded":"2024-09-14T11:23:15.227653+0000","last_fullsized":"2024-09-14T11:23:15.227653+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:15.227516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:15.227516+0000","last_clean_scrub_stamp":"2024-09-14T11:23:15.227516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:27:28.550391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"260'490","reported_seq":1097,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.172306+0000","last_change":"2024-09-14T10:45:49.729101+0000","last_active":"2024-09-14T11:22:51.172306+0000","last_peered":"2024-09-14T11:22:51.172306+0000","last_clean":"2024-09-14T11:22:51.172306+0000","last_became_active":"2024-09-14T10:45:49.728841+0000","last_became_peered":"2024-09-14T10:45:49.728841+0000","last_unstale":"2024-09-14T11:22:51.172306+0000","last_undegraded":"2024-09-14T11:22:51.172306+0000","last_fullsized":"2024-09-14T11:22:51.172306+0000","mapping_epoch":30,"log_start":"260'400","ondisk_log_start":"260'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:11.378740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98061,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":894,"num_read_kb":2175,"num_write":778,"num_write_kb":715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":466,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:24.978449+0000","last_change":"2024-09-14T10:45:51.752010+0000","last_active":"2024-09-14T11:18:24.978449+0000","last_peered":"2024-09-14T11:18:24.978449+0000","last_clean":"2024-09-14T11:18:24.978449+0000","last_became_active":"2024-09-14T10:45:51.751776+0000","last_became_peered":"2024-09-14T10:45:51.751776+0000","last_unstale":"2024-09-14T11:18:24.978449+0000","last_undegraded":"2024-09-14T11:18:24.978449+0000","last_fullsized":"2024-09-14T11:18:24.978449+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:41:21.445606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"260'170","reported_seq":666,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.796846+0000","last_change":"2024-09-14T10:45:53.753181+0000","last_active":"2024-09-14T11:21:28.796846+0000","last_peered":"2024-09-14T11:21:28.796846+0000","last_clean":"2024-09-14T11:21:28.796846+0000","last_became_active":"2024-09-14T10:45:53.752535+0000","last_became_peered":"2024-09-14T10:45:53.752535+0000","last_unstale":"2024-09-14T11:21:28.796846+0000","last_undegraded":"2024-09-14T11:21:28.796846+0000","last_fullsized":"2024-09-14T11:21:28.796846+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":217,"num_read_kb":213,"num_write":386,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"260'443","reported_seq":2095,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:06.861605+0000","last_change":"2024-09-14T11:23:06.861605+0000","last_active":"2024-09-14T11:23:06.861605+0000","last_peered":"2024-09-14T11:23:06.861605+0000","last_clean":"2024-09-14T11:23:06.861605+0000","last_became_active":"2024-09-14T10:45:45.710498+0000","last_became_peered":"2024-09-14T10:45:45.710498+0000","last_unstale":"2024-09-14T11:23:06.861605+0000","last_undegraded":"2024-09-14T11:23:06.861605+0000","last_fullsized":"2024-09-14T11:23:06.861605+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'443","last_scrub_stamp":"2024-09-14T11:23:06.861513+0000","last_deep_scrub":"260'443","last_deep_scrub_stamp":"2024-09-14T11:23:06.861513+0000","last_clean_scrub_stamp":"2024-09-14T11:23:06.861513+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:22.830553+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2391,"num_read_kb":2291,"num_write":487,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"260'417","reported_seq":1179,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:08.794625+0000","last_change":"2024-09-14T11:23:08.794625+0000","last_active":"2024-09-14T11:23:08.794625+0000","last_peered":"2024-09-14T11:23:08.794625+0000","last_clean":"2024-09-14T11:23:08.794625+0000","last_became_active":"2024-09-14T10:45:43.688136+0000","last_became_peered":"2024-09-14T10:45:43.688136+0000","last_unstale":"2024-09-14T11:23:08.794625+0000","last_undegraded":"2024-09-14T11:23:08.794625+0000","last_fullsized":"2024-09-14T11:23:08.794625+0000","mapping_epoch":23,"log_start":"260'400","ondisk_log_start":"260'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'417","last_scrub_stamp":"2024-09-14T11:23:08.794535+0000","last_deep_scrub":"260'417","last_deep_scrub_stamp":"2024-09-14T11:23:08.794535+0000","last_clean_scrub_stamp":"2024-09-14T11:23:08.794535+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:10:34.992113+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1055,"num_read_kb":62488,"num_write":1345,"num_write_kb":26359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":485,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:10.380490+0000","last_change":"2024-09-14T11:23:10.380490+0000","last_active":"2024-09-14T11:23:10.380490+0000","last_peered":"2024-09-14T11:23:10.380490+0000","last_clean":"2024-09-14T11:23:10.380490+0000","last_became_active":"2024-09-14T10:45:47.725711+0000","last_became_peered":"2024-09-14T10:45:47.725711+0000","last_unstale":"2024-09-14T11:23:10.380490+0000","last_undegraded":"2024-09-14T11:23:10.380490+0000","last_fullsized":"2024-09-14T11:23:10.380490+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:10.380391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:10.380391+0000","last_clean_scrub_stamp":"2024-09-14T11:23:10.380391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:13:32.547617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"260'282","reported_seq":840,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.233477+0000","last_change":"2024-09-14T10:45:49.730097+0000","last_active":"2024-09-14T11:22:51.233477+0000","last_peered":"2024-09-14T11:22:51.233477+0000","last_clean":"2024-09-14T11:22:51.233477+0000","last_became_active":"2024-09-14T10:45:49.729803+0000","last_became_peered":"2024-09-14T10:45:49.729803+0000","last_unstale":"2024-09-14T11:22:51.233477+0000","last_undegraded":"2024-09-14T11:22:51.233477+0000","last_fullsized":"2024-09-14T11:22:51.233477+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:44.767050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50521,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":465,"num_read_kb":1032,"num_write":388,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":468,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:21.228045+0000","last_change":"2024-09-14T10:45:51.749137+0000","last_active":"2024-09-14T11:18:21.228045+0000","last_peered":"2024-09-14T11:18:21.228045+0000","last_clean":"2024-09-14T11:18:21.228045+0000","last_became_active":"2024-09-14T10:45:51.748871+0000","last_became_peered":"2024-09-14T10:45:51.748871+0000","last_unstale":"2024-09-14T11:18:21.228045+0000","last_undegraded":"2024-09-14T11:18:21.228045+0000","last_fullsized":"2024-09-14T11:18:21.228045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:41.260779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"260'208","reported_seq":1062,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.235000+0000","last_change":"2024-09-14T10:45:53.750953+0000","last_active":"2024-09-14T11:21:27.235000+0000","last_peered":"2024-09-14T11:21:27.235000+0000","last_clean":"2024-09-14T11:21:27.235000+0000","last_became_active":"2024-09-14T10:45:53.750595+0000","last_became_peered":"2024-09-14T10:45:53.750595+0000","last_unstale":"2024-09-14T11:21:27.235000+0000","last_undegraded":"2024-09-14T11:21:27.235000+0000","last_fullsized":"2024-09-14T11:21:27.235000+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1617,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":634,"num_read_kb":624,"num_write":573,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"260'1184","reported_seq":2754,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:05.739710+0000","last_change":"2024-09-14T11:23:05.739650+0000","last_active":"2024-09-14T11:23:05.739710+0000","last_peered":"2024-09-14T11:23:05.739710+0000","last_clean":"2024-09-14T11:23:05.739710+0000","last_became_active":"2024-09-14T10:45:45.721945+0000","last_became_peered":"2024-09-14T10:45:45.721945+0000","last_unstale":"2024-09-14T11:23:05.739710+0000","last_undegraded":"2024-09-14T11:23:05.739710+0000","last_fullsized":"2024-09-14T11:23:05.739710+0000","mapping_epoch":26,"log_start":"260'1100","ondisk_log_start":"260'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1184","last_scrub_stamp":"2024-09-14T11:23:05.739562+0000","last_deep_scrub":"260'1184","last_deep_scrub_stamp":"2024-09-14T11:23:05.739562+0000","last_clean_scrub_stamp":"2024-09-14T11:23:05.739562+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":1100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:11.326591+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5490,"num_read_kb":4869,"num_write":1672,"num_write_kb":727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"260'342","reported_seq":985,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:57.727489+0000","last_change":"2024-09-14T11:22:57.727410+0000","last_active":"2024-09-14T11:22:57.727489+0000","last_peered":"2024-09-14T11:22:57.727489+0000","last_clean":"2024-09-14T11:22:57.727489+0000","last_became_active":"2024-09-14T10:45:43.682457+0000","last_became_peered":"2024-09-14T10:45:43.682457+0000","last_unstale":"2024-09-14T11:22:57.727489+0000","last_undegraded":"2024-09-14T11:22:57.727489+0000","last_fullsized":"2024-09-14T11:22:57.727489+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'342","last_scrub_stamp":"2024-09-14T11:22:57.727319+0000","last_deep_scrub":"260'342","last_deep_scrub_stamp":"2024-09-14T11:22:57.727319+0000","last_clean_scrub_stamp":"2024-09-14T11:22:57.727319+0000","objects_scrubbed":8,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:06.095427+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":582,"num_read_kb":98004,"num_write":1175,"num_write_kb":36067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":482,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:09.333221+0000","last_change":"2024-09-14T11:23:09.333221+0000","last_active":"2024-09-14T11:23:09.333221+0000","last_peered":"2024-09-14T11:23:09.333221+0000","last_clean":"2024-09-14T11:23:09.333221+0000","last_became_active":"2024-09-14T10:45:47.726635+0000","last_became_peered":"2024-09-14T10:45:47.726635+0000","last_unstale":"2024-09-14T11:23:09.333221+0000","last_undegraded":"2024-09-14T11:23:09.333221+0000","last_fullsized":"2024-09-14T11:23:09.333221+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:09.333109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:09.333109+0000","last_clean_scrub_stamp":"2024-09-14T11:23:09.333109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:29.617159+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"260'274","reported_seq":827,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.701917+0000","last_change":"2024-09-14T10:45:49.729734+0000","last_active":"2024-09-14T11:22:50.701917+0000","last_peered":"2024-09-14T11:22:50.701917+0000","last_clean":"2024-09-14T11:22:50.701917+0000","last_became_active":"2024-09-14T10:45:49.729422+0000","last_became_peered":"2024-09-14T10:45:49.729422+0000","last_unstale":"2024-09-14T11:22:50.701917+0000","last_undegraded":"2024-09-14T11:22:50.701917+0000","last_fullsized":"2024-09-14T11:22:50.701917+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:36.625007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45487,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":456,"num_read_kb":1073,"num_write":374,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":475,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:00.997411+0000","last_change":"2024-09-14T10:45:51.748413+0000","last_active":"2024-09-14T11:20:00.997411+0000","last_peered":"2024-09-14T11:20:00.997411+0000","last_clean":"2024-09-14T11:20:00.997411+0000","last_became_active":"2024-09-14T10:45:51.747888+0000","last_became_peered":"2024-09-14T10:45:51.747888+0000","last_unstale":"2024-09-14T11:20:00.997411+0000","last_undegraded":"2024-09-14T11:20:00.997411+0000","last_fullsized":"2024-09-14T11:20:00.997411+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:31:10.652817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"260'126","reported_seq":598,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:43.735389+0000","last_change":"2024-09-14T10:45:53.750141+0000","last_active":"2024-09-14T11:22:43.735389+0000","last_peered":"2024-09-14T11:22:43.735389+0000","last_clean":"2024-09-14T11:22:43.735389+0000","last_became_active":"2024-09-14T10:45:53.749868+0000","last_became_peered":"2024-09-14T10:45:53.749868+0000","last_unstale":"2024-09-14T11:22:43.735389+0000","last_undegraded":"2024-09-14T11:22:43.735389+0000","last_fullsized":"2024-09-14T11:22:43.735389+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":111,"num_write":304,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"260'1125","reported_seq":2695,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:07.821294+0000","last_change":"2024-09-14T11:23:07.821236+0000","last_active":"2024-09-14T11:23:07.821294+0000","last_peered":"2024-09-14T11:23:07.821294+0000","last_clean":"2024-09-14T11:23:07.821294+0000","last_became_active":"2024-09-14T10:45:45.711476+0000","last_became_peered":"2024-09-14T10:45:45.711476+0000","last_unstale":"2024-09-14T11:23:07.821294+0000","last_undegraded":"2024-09-14T11:23:07.821294+0000","last_fullsized":"2024-09-14T11:23:07.821294+0000","mapping_epoch":26,"log_start":"260'1100","ondisk_log_start":"260'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1125","last_scrub_stamp":"2024-09-14T11:23:07.821153+0000","last_deep_scrub":"260'1125","last_deep_scrub_stamp":"2024-09-14T11:23:07.821153+0000","last_clean_scrub_stamp":"2024-09-14T11:23:07.821153+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":1100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:28.830288+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5159,"num_read_kb":4588,"num_write":1521,"num_write_kb":611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"260'327","reported_seq":1011,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:59.994822+0000","last_change":"2024-09-14T11:22:59.994756+0000","last_active":"2024-09-14T11:22:59.994822+0000","last_peered":"2024-09-14T11:22:59.994822+0000","last_clean":"2024-09-14T11:22:59.994822+0000","last_became_active":"2024-09-14T10:45:43.691976+0000","last_became_peered":"2024-09-14T10:45:43.691976+0000","last_unstale":"2024-09-14T11:22:59.994822+0000","last_undegraded":"2024-09-14T11:22:59.994822+0000","last_fullsized":"2024-09-14T11:22:59.994822+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'327","last_scrub_stamp":"2024-09-14T11:22:59.994673+0000","last_deep_scrub":"260'327","last_deep_scrub_stamp":"2024-09-14T11:22:59.994673+0000","last_clean_scrub_stamp":"2024-09-14T11:22:59.994673+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:18.919121+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":740,"num_read_kb":9027,"num_write":1110,"num_write_kb":58772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":483,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:21.106659+0000","last_change":"2024-09-14T10:45:47.726662+0000","last_active":"2024-09-14T11:18:21.106659+0000","last_peered":"2024-09-14T11:18:21.106659+0000","last_clean":"2024-09-14T11:18:21.106659+0000","last_became_active":"2024-09-14T10:45:47.726392+0000","last_became_peered":"2024-09-14T10:45:47.726392+0000","last_unstale":"2024-09-14T11:18:21.106659+0000","last_undegraded":"2024-09-14T11:18:21.106659+0000","last_fullsized":"2024-09-14T11:18:21.106659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:02:14.749214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"260'79","reported_seq":576,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:05.985921+0000","last_change":"2024-09-14T10:45:49.728741+0000","last_active":"2024-09-14T11:21:05.985921+0000","last_peered":"2024-09-14T11:21:05.985921+0000","last_clean":"2024-09-14T11:21:05.985921+0000","last_became_active":"2024-09-14T10:45:49.728444+0000","last_became_peered":"2024-09-14T10:45:49.728444+0000","last_unstale":"2024-09-14T11:21:05.985921+0000","last_undegraded":"2024-09-14T11:21:05.985921+0000","last_fullsized":"2024-09-14T11:21:05.985921+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:42.103576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":102,"num_read_kb":95,"num_write":120,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"260'795","reported_seq":2265,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.163068+0000","last_change":"2024-09-14T10:45:51.746786+0000","last_active":"2024-09-14T11:22:51.163068+0000","last_peered":"2024-09-14T11:22:51.163068+0000","last_clean":"2024-09-14T11:22:51.163068+0000","last_became_active":"2024-09-14T10:45:51.746303+0000","last_became_peered":"2024-09-14T10:45:51.746303+0000","last_unstale":"2024-09-14T11:22:51.163068+0000","last_undegraded":"2024-09-14T11:22:51.163068+0000","last_fullsized":"2024-09-14T11:22:51.163068+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:04.109276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"260'118","reported_seq":595,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:15.432755+0000","last_change":"2024-09-14T10:45:53.751786+0000","last_active":"2024-09-14T11:21:15.432755+0000","last_peered":"2024-09-14T11:21:15.432755+0000","last_clean":"2024-09-14T11:21:15.432755+0000","last_became_active":"2024-09-14T10:45:53.751453+0000","last_became_peered":"2024-09-14T10:45:53.751453+0000","last_unstale":"2024-09-14T11:21:15.432755+0000","last_undegraded":"2024-09-14T11:21:15.432755+0000","last_fullsized":"2024-09-14T11:21:15.432755+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":104,"num_write":274,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"260'444","reported_seq":2013,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:16.297585+0000","last_change":"2024-09-14T10:45:45.726094+0000","last_active":"2024-09-14T11:21:16.297585+0000","last_peered":"2024-09-14T11:21:16.297585+0000","last_clean":"2024-09-14T11:21:16.297585+0000","last_became_active":"2024-09-14T10:45:45.725806+0000","last_became_peered":"2024-09-14T10:45:45.725806+0000","last_unstale":"2024-09-14T11:21:16.297585+0000","last_undegraded":"2024-09-14T11:21:16.297585+0000","last_fullsized":"2024-09-14T11:21:16.297585+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2489,"num_read_kb":2350,"num_write":523,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"260'377","reported_seq":1047,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:58.683943+0000","last_change":"2024-09-14T11:22:58.683861+0000","last_active":"2024-09-14T11:22:58.683943+0000","last_peered":"2024-09-14T11:22:58.683943+0000","last_clean":"2024-09-14T11:22:58.683943+0000","last_became_active":"2024-09-14T10:45:43.686768+0000","last_became_peered":"2024-09-14T10:45:43.686768+0000","last_unstale":"2024-09-14T11:22:58.683943+0000","last_undegraded":"2024-09-14T11:22:58.683943+0000","last_fullsized":"2024-09-14T11:22:58.683943+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'377","last_scrub_stamp":"2024-09-14T11:22:58.683760+0000","last_deep_scrub":"260'377","last_deep_scrub_stamp":"2024-09-14T11:22:58.683760+0000","last_clean_scrub_stamp":"2024-09-14T11:22:58.683760+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:01:12.820519+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":721,"num_read_kb":58950,"num_write":1313,"num_write_kb":32402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":492,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:13.574287+0000","last_change":"2024-09-14T11:23:13.574206+0000","last_active":"2024-09-14T11:23:13.574287+0000","last_peered":"2024-09-14T11:23:13.574287+0000","last_clean":"2024-09-14T11:23:13.574287+0000","last_became_active":"2024-09-14T10:45:47.718721+0000","last_became_peered":"2024-09-14T10:45:47.718721+0000","last_unstale":"2024-09-14T11:23:13.574287+0000","last_undegraded":"2024-09-14T11:23:13.574287+0000","last_fullsized":"2024-09-14T11:23:13.574287+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:13.574095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:13.574095+0000","last_clean_scrub_stamp":"2024-09-14T11:23:13.574095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:02.935904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"260'301","reported_seq":875,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:16.621324+0000","last_change":"2024-09-14T11:23:16.621324+0000","last_active":"2024-09-14T11:23:16.621324+0000","last_peered":"2024-09-14T11:23:16.621324+0000","last_clean":"2024-09-14T11:23:16.621324+0000","last_became_active":"2024-09-14T10:45:49.733684+0000","last_became_peered":"2024-09-14T10:45:49.733684+0000","last_unstale":"2024-09-14T11:23:16.621324+0000","last_undegraded":"2024-09-14T11:23:16.621324+0000","last_fullsized":"2024-09-14T11:23:16.621324+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'301","last_scrub_stamp":"2024-09-14T11:23:16.621219+0000","last_deep_scrub":"260'301","last_deep_scrub_stamp":"2024-09-14T11:23:16.621219+0000","last_clean_scrub_stamp":"2024-09-14T11:23:16.621219+0000","objects_scrubbed":9,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:25.617980+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49376,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":469,"num_read_kb":1024,"num_write":384,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":476,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:41.118307+0000","last_change":"2024-09-14T10:45:51.742049+0000","last_active":"2024-09-14T11:19:41.118307+0000","last_peered":"2024-09-14T11:19:41.118307+0000","last_clean":"2024-09-14T11:19:41.118307+0000","last_became_active":"2024-09-14T10:45:51.741767+0000","last_became_peered":"2024-09-14T10:45:51.741767+0000","last_unstale":"2024-09-14T11:19:41.118307+0000","last_undegraded":"2024-09-14T11:19:41.118307+0000","last_fullsized":"2024-09-14T11:19:41.118307+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:16:02.477621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"260'128","reported_seq":620,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:06.769959+0000","last_change":"2024-09-14T10:45:53.749052+0000","last_active":"2024-09-14T11:21:06.769959+0000","last_peered":"2024-09-14T11:21:06.769959+0000","last_clean":"2024-09-14T11:21:06.769959+0000","last_became_active":"2024-09-14T10:45:53.748760+0000","last_became_peered":"2024-09-14T10:45:53.748760+0000","last_unstale":"2024-09-14T11:21:06.769959+0000","last_undegraded":"2024-09-14T11:21:06.769959+0000","last_fullsized":"2024-09-14T11:21:06.769959+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:12.144519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":155,"num_read_kb":143,"num_write":309,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"260'789","reported_seq":2308,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:05.246738+0000","last_change":"2024-09-14T11:23:05.246681+0000","last_active":"2024-09-14T11:23:05.246738+0000","last_peered":"2024-09-14T11:23:05.246738+0000","last_clean":"2024-09-14T11:23:05.246738+0000","last_became_active":"2024-09-14T10:45:45.717706+0000","last_became_peered":"2024-09-14T10:45:45.717706+0000","last_unstale":"2024-09-14T11:23:05.246738+0000","last_undegraded":"2024-09-14T11:23:05.246738+0000","last_fullsized":"2024-09-14T11:23:05.246738+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'789","last_scrub_stamp":"2024-09-14T11:23:05.246600+0000","last_deep_scrub":"260'789","last_deep_scrub_stamp":"2024-09-14T11:23:05.246600+0000","last_clean_scrub_stamp":"2024-09-14T11:23:05.246600+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:29.764214+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3708,"num_read_kb":3358,"num_write":1019,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"260'345","reported_seq":960,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:07.145079+0000","last_change":"2024-09-14T11:23:07.145011+0000","last_active":"2024-09-14T11:23:07.145079+0000","last_peered":"2024-09-14T11:23:07.145079+0000","last_clean":"2024-09-14T11:23:07.145079+0000","last_became_active":"2024-09-14T10:45:43.683014+0000","last_became_peered":"2024-09-14T10:45:43.683014+0000","last_unstale":"2024-09-14T11:23:07.145079+0000","last_undegraded":"2024-09-14T11:23:07.145079+0000","last_fullsized":"2024-09-14T11:23:07.145079+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'345","last_scrub_stamp":"2024-09-14T11:23:07.144903+0000","last_deep_scrub":"260'345","last_deep_scrub_stamp":"2024-09-14T11:23:07.144903+0000","last_clean_scrub_stamp":"2024-09-14T11:23:07.144903+0000","objects_scrubbed":4,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:22.680885+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133668,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":545,"num_read_kb":15772,"num_write":997,"num_write_kb":32563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":474,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:19.977556+0000","last_change":"2024-09-14T10:45:47.726045+0000","last_active":"2024-09-14T11:18:19.977556+0000","last_peered":"2024-09-14T11:18:19.977556+0000","last_clean":"2024-09-14T11:18:19.977556+0000","last_became_active":"2024-09-14T10:45:47.725850+0000","last_became_peered":"2024-09-14T10:45:47.725850+0000","last_unstale":"2024-09-14T11:18:19.977556+0000","last_undegraded":"2024-09-14T11:18:19.977556+0000","last_fullsized":"2024-09-14T11:18:19.977556+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:53.534864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"260'258","reported_seq":811,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.945561+0000","last_change":"2024-09-14T10:45:49.736850+0000","last_active":"2024-09-14T11:22:50.945561+0000","last_peered":"2024-09-14T11:22:50.945561+0000","last_clean":"2024-09-14T11:22:50.945561+0000","last_became_active":"2024-09-14T10:45:49.736538+0000","last_became_peered":"2024-09-14T10:45:49.736538+0000","last_unstale":"2024-09-14T11:22:50.945561+0000","last_undegraded":"2024-09-14T11:22:50.945561+0000","last_fullsized":"2024-09-14T11:22:50.945561+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:24.205374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45998,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":425,"num_read_kb":1014,"num_write":348,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":470,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:47.114678+0000","last_change":"2024-09-14T10:45:51.745256+0000","last_active":"2024-09-14T11:19:47.114678+0000","last_peered":"2024-09-14T11:19:47.114678+0000","last_clean":"2024-09-14T11:19:47.114678+0000","last_became_active":"2024-09-14T10:45:51.744957+0000","last_became_peered":"2024-09-14T10:45:51.744957+0000","last_unstale":"2024-09-14T11:19:47.114678+0000","last_undegraded":"2024-09-14T11:19:47.114678+0000","last_fullsized":"2024-09-14T11:19:47.114678+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:00.836610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"260'125","reported_seq":625,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.799038+0000","last_change":"2024-09-14T10:45:53.750560+0000","last_active":"2024-09-14T11:21:28.799038+0000","last_peered":"2024-09-14T11:21:28.799038+0000","last_clean":"2024-09-14T11:21:28.799038+0000","last_became_active":"2024-09-14T10:45:53.750287+0000","last_became_peered":"2024-09-14T10:45:53.750287+0000","last_unstale":"2024-09-14T11:21:28.799038+0000","last_undegraded":"2024-09-14T11:21:28.799038+0000","last_fullsized":"2024-09-14T11:21:28.799038+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:48.692799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":175,"num_read_kb":170,"num_write":297,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"260'392","reported_seq":1851,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:04.722892+0000","last_change":"2024-09-14T11:23:04.722892+0000","last_active":"2024-09-14T11:23:04.722892+0000","last_peered":"2024-09-14T11:23:04.722892+0000","last_clean":"2024-09-14T11:23:04.722892+0000","last_became_active":"2024-09-14T10:45:45.712455+0000","last_became_peered":"2024-09-14T10:45:45.712455+0000","last_unstale":"2024-09-14T11:23:04.722892+0000","last_undegraded":"2024-09-14T11:23:04.722892+0000","last_fullsized":"2024-09-14T11:23:04.722892+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'392","last_scrub_stamp":"2024-09-14T11:23:04.722800+0000","last_deep_scrub":"260'392","last_deep_scrub_stamp":"2024-09-14T11:23:04.722800+0000","last_clean_scrub_stamp":"2024-09-14T11:23:04.722800+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:20.257987+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2172,"num_read_kb":2052,"num_write":470,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"260'356","reported_seq":1011,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:00.292166+0000","last_change":"2024-09-14T11:23:00.292166+0000","last_active":"2024-09-14T11:23:00.292166+0000","last_peered":"2024-09-14T11:23:00.292166+0000","last_clean":"2024-09-14T11:23:00.292166+0000","last_became_active":"2024-09-14T10:45:43.676145+0000","last_became_peered":"2024-09-14T10:45:43.676145+0000","last_unstale":"2024-09-14T11:23:00.292166+0000","last_undegraded":"2024-09-14T11:23:00.292166+0000","last_fullsized":"2024-09-14T11:23:00.292166+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'356","last_scrub_stamp":"2024-09-14T11:23:00.292074+0000","last_deep_scrub":"260'356","last_deep_scrub_stamp":"2024-09-14T11:23:00.292074+0000","last_clean_scrub_stamp":"2024-09-14T11:23:00.292074+0000","objects_scrubbed":5,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:47.860832+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133740,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":675,"num_read_kb":38975,"num_write":1181,"num_write_kb":36099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":492,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:11.644849+0000","last_change":"2024-09-14T11:23:11.644849+0000","last_active":"2024-09-14T11:23:11.644849+0000","last_peered":"2024-09-14T11:23:11.644849+0000","last_clean":"2024-09-14T11:23:11.644849+0000","last_became_active":"2024-09-14T10:45:47.724065+0000","last_became_peered":"2024-09-14T10:45:47.724065+0000","last_unstale":"2024-09-14T11:23:11.644849+0000","last_undegraded":"2024-09-14T11:23:11.644849+0000","last_fullsized":"2024-09-14T11:23:11.644849+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:11.644749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:11.644749+0000","last_clean_scrub_stamp":"2024-09-14T11:23:11.644749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:54.396791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"260'239","reported_seq":777,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.625663+0000","last_change":"2024-09-14T10:45:49.728006+0000","last_active":"2024-09-14T11:22:50.625663+0000","last_peered":"2024-09-14T11:22:50.625663+0000","last_clean":"2024-09-14T11:22:50.625663+0000","last_became_active":"2024-09-14T10:45:49.727721+0000","last_became_peered":"2024-09-14T10:45:49.727721+0000","last_unstale":"2024-09-14T11:22:50.625663+0000","last_undegraded":"2024-09-14T11:22:50.625663+0000","last_fullsized":"2024-09-14T11:22:50.625663+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:35.275905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47218,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":415,"num_read_kb":1017,"num_write":344,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":469,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:22.101700+0000","last_change":"2024-09-14T10:45:51.742675+0000","last_active":"2024-09-14T11:18:22.101700+0000","last_peered":"2024-09-14T11:18:22.101700+0000","last_clean":"2024-09-14T11:18:22.101700+0000","last_became_active":"2024-09-14T10:45:51.742387+0000","last_became_peered":"2024-09-14T10:45:51.742387+0000","last_unstale":"2024-09-14T11:18:22.101700+0000","last_undegraded":"2024-09-14T11:18:22.101700+0000","last_fullsized":"2024-09-14T11:18:22.101700+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:36.809715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"260'160","reported_seq":1255,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.232516+0000","last_change":"2024-09-14T10:45:53.752874+0000","last_active":"2024-09-14T11:21:27.232516+0000","last_peered":"2024-09-14T11:21:27.232516+0000","last_clean":"2024-09-14T11:21:27.232516+0000","last_became_active":"2024-09-14T10:45:53.752639+0000","last_became_peered":"2024-09-14T10:45:53.752639+0000","last_unstale":"2024-09-14T11:21:27.232516+0000","last_undegraded":"2024-09-14T11:21:27.232516+0000","last_fullsized":"2024-09-14T11:21:27.232516+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:29.390299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":838,"num_read_kb":820,"num_write":382,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"260'400","reported_seq":1914,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:04.247771+0000","last_change":"2024-09-14T11:23:04.247771+0000","last_active":"2024-09-14T11:23:04.247771+0000","last_peered":"2024-09-14T11:23:04.247771+0000","last_clean":"2024-09-14T11:23:04.247771+0000","last_became_active":"2024-09-14T10:45:45.718964+0000","last_became_peered":"2024-09-14T10:45:45.718964+0000","last_unstale":"2024-09-14T11:23:04.247771+0000","last_undegraded":"2024-09-14T11:23:04.247771+0000","last_fullsized":"2024-09-14T11:23:04.247771+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'400","last_scrub_stamp":"2024-09-14T11:23:04.247668+0000","last_deep_scrub":"260'400","last_deep_scrub_stamp":"2024-09-14T11:23:04.247668+0000","last_clean_scrub_stamp":"2024-09-14T11:23:04.247668+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:22:55.596354+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2133,"num_read_kb":2043,"num_write":433,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"260'369","reported_seq":1016,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:04.280661+0000","last_change":"2024-09-14T11:23:04.280580+0000","last_active":"2024-09-14T11:23:04.280661+0000","last_peered":"2024-09-14T11:23:04.280661+0000","last_clean":"2024-09-14T11:23:04.280661+0000","last_became_active":"2024-09-14T10:45:43.675220+0000","last_became_peered":"2024-09-14T10:45:43.675220+0000","last_unstale":"2024-09-14T11:23:04.280661+0000","last_undegraded":"2024-09-14T11:23:04.280661+0000","last_fullsized":"2024-09-14T11:23:04.280661+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'369","last_scrub_stamp":"2024-09-14T11:23:04.280462+0000","last_deep_scrub":"260'369","last_deep_scrub_stamp":"2024-09-14T11:23:04.280462+0000","last_clean_scrub_stamp":"2024-09-14T11:23:04.280462+0000","objects_scrubbed":3,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:23:45.038803+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":607,"num_read_kb":38424,"num_write":1090,"num_write_kb":41594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":485,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:46.119103+0000","last_change":"2024-09-14T10:45:47.729627+0000","last_active":"2024-09-14T11:19:46.119103+0000","last_peered":"2024-09-14T11:19:46.119103+0000","last_clean":"2024-09-14T11:19:46.119103+0000","last_became_active":"2024-09-14T10:45:47.729338+0000","last_became_peered":"2024-09-14T10:45:47.729338+0000","last_unstale":"2024-09-14T11:19:46.119103+0000","last_undegraded":"2024-09-14T11:19:46.119103+0000","last_fullsized":"2024-09-14T11:19:46.119103+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:46.700380+0000","last_clean_scrub_stamp":"2024-09-14T10:45:46.700380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:15.042150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"260'290","reported_seq":852,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.738891+0000","last_change":"2024-09-14T10:45:49.731337+0000","last_active":"2024-09-14T11:22:50.738891+0000","last_peered":"2024-09-14T11:22:50.738891+0000","last_clean":"2024-09-14T11:22:50.738891+0000","last_became_active":"2024-09-14T10:45:49.729842+0000","last_became_peered":"2024-09-14T10:45:49.729842+0000","last_unstale":"2024-09-14T11:22:50.738891+0000","last_undegraded":"2024-09-14T11:22:50.738891+0000","last_fullsized":"2024-09-14T11:22:50.738891+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:48.712312+0000","last_clean_scrub_stamp":"2024-09-14T10:45:48.712312+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:25:47.634561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44662,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":478,"num_read_kb":1058,"num_write":386,"num_write_kb":290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":475,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:21.106628+0000","last_change":"2024-09-14T10:45:51.745622+0000","last_active":"2024-09-14T11:18:21.106628+0000","last_peered":"2024-09-14T11:18:21.106628+0000","last_clean":"2024-09-14T11:18:21.106628+0000","last_became_active":"2024-09-14T10:45:51.745310+0000","last_became_peered":"2024-09-14T10:45:51.745310+0000","last_unstale":"2024-09-14T11:18:21.106628+0000","last_undegraded":"2024-09-14T11:18:21.106628+0000","last_fullsized":"2024-09-14T11:18:21.106628+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:03.197112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"260'137","reported_seq":617,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:42.844601+0000","last_change":"2024-09-14T10:45:53.755154+0000","last_active":"2024-09-14T11:22:42.844601+0000","last_peered":"2024-09-14T11:22:42.844601+0000","last_clean":"2024-09-14T11:22:42.844601+0000","last_became_active":"2024-09-14T10:45:53.754826+0000","last_became_peered":"2024-09-14T10:45:53.754826+0000","last_unstale":"2024-09-14T11:22:42.844601+0000","last_undegraded":"2024-09-14T11:22:42.844601+0000","last_fullsized":"2024-09-14T11:22:42.844601+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":657,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":128,"num_read_kb":116,"num_write":335,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"260'422","reported_seq":1973,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:10.812912+0000","last_change":"2024-09-14T11:23:10.812912+0000","last_active":"2024-09-14T11:23:10.812912+0000","last_peered":"2024-09-14T11:23:10.812912+0000","last_clean":"2024-09-14T11:23:10.812912+0000","last_became_active":"2024-09-14T10:45:45.708229+0000","last_became_peered":"2024-09-14T10:45:45.708229+0000","last_unstale":"2024-09-14T11:23:10.812912+0000","last_undegraded":"2024-09-14T11:23:10.812912+0000","last_fullsized":"2024-09-14T11:23:10.812912+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'422","last_scrub_stamp":"2024-09-14T11:23:10.812799+0000","last_deep_scrub":"260'422","last_deep_scrub_stamp":"2024-09-14T11:23:10.812799+0000","last_clean_scrub_stamp":"2024-09-14T11:23:10.812799+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:04:48.614638+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2330,"num_read_kb":2210,"num_write":517,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"260'373","reported_seq":1029,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:58.207593+0000","last_change":"2024-09-14T11:22:58.207534+0000","last_active":"2024-09-14T11:22:58.207593+0000","last_peered":"2024-09-14T11:22:58.207593+0000","last_clean":"2024-09-14T11:22:58.207593+0000","last_became_active":"2024-09-14T10:45:43.684102+0000","last_became_peered":"2024-09-14T10:45:43.684102+0000","last_unstale":"2024-09-14T11:22:58.207593+0000","last_undegraded":"2024-09-14T11:22:58.207593+0000","last_fullsized":"2024-09-14T11:22:58.207593+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'373","last_scrub_stamp":"2024-09-14T11:22:58.207463+0000","last_deep_scrub":"260'373","last_deep_scrub_stamp":"2024-09-14T11:22:58.207463+0000","last_clean_scrub_stamp":"2024-09-14T11:22:58.207463+0000","objects_scrubbed":6,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:30.442090+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133709,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":619,"num_read_kb":82373,"num_write":1076,"num_write_kb":43712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"260'385","reported_seq":1952,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:09.667862+0000","last_change":"2024-09-14T11:23:09.667862+0000","last_active":"2024-09-14T11:23:09.667862+0000","last_peered":"2024-09-14T11:23:09.667862+0000","last_clean":"2024-09-14T11:23:09.667862+0000","last_became_active":"2024-09-14T10:45:45.718949+0000","last_became_peered":"2024-09-14T10:45:45.718949+0000","last_unstale":"2024-09-14T11:23:09.667862+0000","last_undegraded":"2024-09-14T11:23:09.667862+0000","last_fullsized":"2024-09-14T11:23:09.667862+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'385","last_scrub_stamp":"2024-09-14T11:23:09.667768+0000","last_deep_scrub":"260'385","last_deep_scrub_stamp":"2024-09-14T11:23:09.667768+0000","last_clean_scrub_stamp":"2024-09-14T11:23:09.667768+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:07:20.882638+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2227,"num_read_kb":2135,"num_write":439,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"260'312","reported_seq":933,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:00.766046+0000","last_change":"2024-09-14T11:23:00.765987+0000","last_active":"2024-09-14T11:23:00.766046+0000","last_peered":"2024-09-14T11:23:00.766046+0000","last_clean":"2024-09-14T11:23:00.766046+0000","last_became_active":"2024-09-14T10:45:43.690675+0000","last_became_peered":"2024-09-14T10:45:43.690675+0000","last_unstale":"2024-09-14T11:23:00.766046+0000","last_undegraded":"2024-09-14T11:23:00.766046+0000","last_fullsized":"2024-09-14T11:23:00.766046+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'312","last_scrub_stamp":"2024-09-14T11:23:00.765887+0000","last_deep_scrub":"260'312","last_deep_scrub_stamp":"2024-09-14T11:23:00.765887+0000","last_clean_scrub_stamp":"2024-09-14T11:23:00.765887+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:38:08.181333+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":527,"num_read_kb":9887,"num_write":1028,"num_write_kb":21015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"260'531","reported_seq":2240,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:16.296791+0000","last_change":"2024-09-14T10:45:45.718344+0000","last_active":"2024-09-14T11:21:16.296791+0000","last_peered":"2024-09-14T11:21:16.296791+0000","last_clean":"2024-09-14T11:21:16.296791+0000","last_became_active":"2024-09-14T10:45:45.717393+0000","last_became_peered":"2024-09-14T10:45:45.717393+0000","last_unstale":"2024-09-14T11:21:16.296791+0000","last_undegraded":"2024-09-14T11:21:16.296791+0000","last_fullsized":"2024-09-14T11:21:16.296791+0000","mapping_epoch":26,"log_start":"260'500","ondisk_log_start":"260'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":500,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:54.085248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2830,"num_read_kb":2663,"num_write":635,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"260'389","reported_seq":1039,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:08.148332+0000","last_change":"2024-09-14T11:23:08.148260+0000","last_active":"2024-09-14T11:23:08.148332+0000","last_peered":"2024-09-14T11:23:08.148332+0000","last_clean":"2024-09-14T11:23:08.148332+0000","last_became_active":"2024-09-14T10:45:43.675216+0000","last_became_peered":"2024-09-14T10:45:43.675216+0000","last_unstale":"2024-09-14T11:23:08.148332+0000","last_undegraded":"2024-09-14T11:23:08.148332+0000","last_fullsized":"2024-09-14T11:23:08.148332+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'389","last_scrub_stamp":"2024-09-14T11:23:08.148160+0000","last_deep_scrub":"260'389","last_deep_scrub_stamp":"2024-09-14T11:23:08.148160+0000","last_clean_scrub_stamp":"2024-09-14T11:23:08.148160+0000","objects_scrubbed":4,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:29.501402+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":708,"num_read_kb":14121,"num_write":1222,"num_write_kb":48801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"260'871","reported_seq":2519,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:15.342684+0000","last_change":"2024-09-14T11:23:15.342684+0000","last_active":"2024-09-14T11:23:15.342684+0000","last_peered":"2024-09-14T11:23:15.342684+0000","last_clean":"2024-09-14T11:23:15.342684+0000","last_became_active":"2024-09-14T10:45:45.720939+0000","last_became_peered":"2024-09-14T10:45:45.720939+0000","last_unstale":"2024-09-14T11:23:15.342684+0000","last_undegraded":"2024-09-14T11:23:15.342684+0000","last_fullsized":"2024-09-14T11:23:15.342684+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'871","last_scrub_stamp":"2024-09-14T11:23:15.342592+0000","last_deep_scrub":"260'871","last_deep_scrub_stamp":"2024-09-14T11:23:15.342592+0000","last_clean_scrub_stamp":"2024-09-14T11:23:15.342592+0000","objects_scrubbed":2,"log_size":71,"log_dups_size":800,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:19:11.489780+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4139,"num_read_kb":3737,"num_write":1132,"num_write_kb":407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"260'313","reported_seq":901,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:02.304213+0000","last_change":"2024-09-14T11:23:02.304213+0000","last_active":"2024-09-14T11:23:02.304213+0000","last_peered":"2024-09-14T11:23:02.304213+0000","last_clean":"2024-09-14T11:23:02.304213+0000","last_became_active":"2024-09-14T10:45:43.681864+0000","last_became_peered":"2024-09-14T10:45:43.681864+0000","last_unstale":"2024-09-14T11:23:02.304213+0000","last_undegraded":"2024-09-14T11:23:02.304213+0000","last_fullsized":"2024-09-14T11:23:02.304213+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'313","last_scrub_stamp":"2024-09-14T11:23:02.304103+0000","last_deep_scrub":"260'313","last_deep_scrub_stamp":"2024-09-14T11:23:02.304103+0000","last_clean_scrub_stamp":"2024-09-14T11:23:02.304103+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:15.927678+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":459,"num_read_kb":5481,"num_write":964,"num_write_kb":23381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"260'449","reported_seq":2104,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:14.315348+0000","last_change":"2024-09-14T11:23:14.315348+0000","last_active":"2024-09-14T11:23:14.315348+0000","last_peered":"2024-09-14T11:23:14.315348+0000","last_clean":"2024-09-14T11:23:14.315348+0000","last_became_active":"2024-09-14T10:45:45.722575+0000","last_became_peered":"2024-09-14T10:45:45.722575+0000","last_unstale":"2024-09-14T11:23:14.315348+0000","last_undegraded":"2024-09-14T11:23:14.315348+0000","last_fullsized":"2024-09-14T11:23:14.315348+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'449","last_scrub_stamp":"2024-09-14T11:23:14.315255+0000","last_deep_scrub":"260'449","last_deep_scrub_stamp":"2024-09-14T11:23:14.315255+0000","last_clean_scrub_stamp":"2024-09-14T11:23:14.315255+0000","objects_scrubbed":2,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:15:08.436381+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2593,"num_read_kb":2475,"num_write":496,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"260'361","reported_seq":1003,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:04.433029+0000","last_change":"2024-09-14T11:23:04.433029+0000","last_active":"2024-09-14T11:23:04.433029+0000","last_peered":"2024-09-14T11:23:04.433029+0000","last_clean":"2024-09-14T11:23:04.433029+0000","last_became_active":"2024-09-14T10:45:43.691101+0000","last_became_peered":"2024-09-14T10:45:43.691101+0000","last_unstale":"2024-09-14T11:23:04.433029+0000","last_undegraded":"2024-09-14T11:23:04.433029+0000","last_fullsized":"2024-09-14T11:23:04.433029+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'361","last_scrub_stamp":"2024-09-14T11:23:04.432933+0000","last_deep_scrub":"260'361","last_deep_scrub_stamp":"2024-09-14T11:23:04.432933+0000","last_clean_scrub_stamp":"2024-09-14T11:23:04.432933+0000","objects_scrubbed":2,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:27.282075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":637,"num_read_kb":20829,"num_write":1146,"num_write_kb":28609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"260'965","reported_seq":2559,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:05.592937+0000","last_change":"2024-09-14T11:23:05.592864+0000","last_active":"2024-09-14T11:23:05.592937+0000","last_peered":"2024-09-14T11:23:05.592937+0000","last_clean":"2024-09-14T11:23:05.592937+0000","last_became_active":"2024-09-14T10:45:45.717482+0000","last_became_peered":"2024-09-14T10:45:45.717482+0000","last_unstale":"2024-09-14T11:23:05.592937+0000","last_undegraded":"2024-09-14T11:23:05.592937+0000","last_fullsized":"2024-09-14T11:23:05.592937+0000","mapping_epoch":26,"log_start":"260'900","ondisk_log_start":"260'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'965","last_scrub_stamp":"2024-09-14T11:23:05.592780+0000","last_deep_scrub":"260'965","last_deep_scrub_stamp":"2024-09-14T11:23:05.592780+0000","last_clean_scrub_stamp":"2024-09-14T11:23:05.592780+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":900,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:58.949827+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4656,"num_read_kb":4162,"num_write":1345,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"260'420","reported_seq":1067,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:01.490274+0000","last_change":"2024-09-14T11:23:01.490274+0000","last_active":"2024-09-14T11:23:01.490274+0000","last_peered":"2024-09-14T11:23:01.490274+0000","last_clean":"2024-09-14T11:23:01.490274+0000","last_became_active":"2024-09-14T10:45:43.681769+0000","last_became_peered":"2024-09-14T10:45:43.681769+0000","last_unstale":"2024-09-14T11:23:01.490274+0000","last_undegraded":"2024-09-14T11:23:01.490274+0000","last_fullsized":"2024-09-14T11:23:01.490274+0000","mapping_epoch":23,"log_start":"260'400","ondisk_log_start":"260'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'420","last_scrub_stamp":"2024-09-14T11:23:01.490176+0000","last_deep_scrub":"260'420","last_deep_scrub_stamp":"2024-09-14T11:23:01.490176+0000","last_clean_scrub_stamp":"2024-09-14T11:23:01.490176+0000","objects_scrubbed":5,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:59.490356+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":884,"num_read_kb":850,"num_write":1209,"num_write_kb":26526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"260'499","reported_seq":2183,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:09.302098+0000","last_change":"2024-09-14T11:23:09.302039+0000","last_active":"2024-09-14T11:23:09.302098+0000","last_peered":"2024-09-14T11:23:09.302098+0000","last_clean":"2024-09-14T11:23:09.302098+0000","last_became_active":"2024-09-14T10:45:45.724491+0000","last_became_peered":"2024-09-14T10:45:45.724491+0000","last_unstale":"2024-09-14T11:23:09.302098+0000","last_undegraded":"2024-09-14T11:23:09.302098+0000","last_fullsized":"2024-09-14T11:23:09.302098+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'499","last_scrub_stamp":"2024-09-14T11:23:09.301946+0000","last_deep_scrub":"260'499","last_deep_scrub_stamp":"2024-09-14T11:23:09.301946+0000","last_clean_scrub_stamp":"2024-09-14T11:23:09.301946+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:26.256389+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2800,"num_read_kb":2654,"num_write":635,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"260'363","reported_seq":988,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:00.219177+0000","last_change":"2024-09-14T11:23:00.219177+0000","last_active":"2024-09-14T11:23:00.219177+0000","last_peered":"2024-09-14T11:23:00.219177+0000","last_clean":"2024-09-14T11:23:00.219177+0000","last_became_active":"2024-09-14T10:45:43.672592+0000","last_became_peered":"2024-09-14T10:45:43.672592+0000","last_unstale":"2024-09-14T11:23:00.219177+0000","last_undegraded":"2024-09-14T11:23:00.219177+0000","last_fullsized":"2024-09-14T11:23:00.219177+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'363","last_scrub_stamp":"2024-09-14T11:23:00.219087+0000","last_deep_scrub":"260'363","last_deep_scrub_stamp":"2024-09-14T11:23:00.219087+0000","last_clean_scrub_stamp":"2024-09-14T11:23:00.219087+0000","objects_scrubbed":4,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:53.826069+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133682,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":581,"num_read_kb":14710,"num_write":1041,"num_write_kb":26884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"260'948","reported_seq":2556,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:02.605749+0000","last_change":"2024-09-14T11:23:02.605687+0000","last_active":"2024-09-14T11:23:02.605749+0000","last_peered":"2024-09-14T11:23:02.605749+0000","last_clean":"2024-09-14T11:23:02.605749+0000","last_became_active":"2024-09-14T10:45:45.712642+0000","last_became_peered":"2024-09-14T10:45:45.712642+0000","last_unstale":"2024-09-14T11:23:02.605749+0000","last_undegraded":"2024-09-14T11:23:02.605749+0000","last_fullsized":"2024-09-14T11:23:02.605749+0000","mapping_epoch":26,"log_start":"260'900","ondisk_log_start":"260'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'948","last_scrub_stamp":"2024-09-14T11:23:02.605604+0000","last_deep_scrub":"260'948","last_deep_scrub_stamp":"2024-09-14T11:23:02.605604+0000","last_clean_scrub_stamp":"2024-09-14T11:23:02.605604+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":900,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:29.530400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4544,"num_read_kb":4033,"num_write":1311,"num_write_kb":524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"260'381","reported_seq":1030,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:03.258437+0000","last_change":"2024-09-14T11:23:03.258437+0000","last_active":"2024-09-14T11:23:03.258437+0000","last_peered":"2024-09-14T11:23:03.258437+0000","last_clean":"2024-09-14T11:23:03.258437+0000","last_became_active":"2024-09-14T10:45:43.675233+0000","last_became_peered":"2024-09-14T10:45:43.675233+0000","last_unstale":"2024-09-14T11:23:03.258437+0000","last_undegraded":"2024-09-14T11:23:03.258437+0000","last_fullsized":"2024-09-14T11:23:03.258437+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'381","last_scrub_stamp":"2024-09-14T11:23:03.258350+0000","last_deep_scrub":"260'381","last_deep_scrub_stamp":"2024-09-14T11:23:03.258350+0000","last_clean_scrub_stamp":"2024-09-14T11:23:03.258350+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:04:00.733089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":674,"num_read_kb":10456,"num_write":1272,"num_write_kb":38144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"260'844","reported_seq":2446,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:06.692537+0000","last_change":"2024-09-14T11:23:06.692537+0000","last_active":"2024-09-14T11:23:06.692537+0000","last_peered":"2024-09-14T11:23:06.692537+0000","last_clean":"2024-09-14T11:23:06.692537+0000","last_became_active":"2024-09-14T10:45:45.711947+0000","last_became_peered":"2024-09-14T10:45:45.711947+0000","last_unstale":"2024-09-14T11:23:06.692537+0000","last_undegraded":"2024-09-14T11:23:06.692537+0000","last_fullsized":"2024-09-14T11:23:06.692537+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'844","last_scrub_stamp":"2024-09-14T11:23:06.692450+0000","last_deep_scrub":"260'844","last_deep_scrub_stamp":"2024-09-14T11:23:06.692450+0000","last_clean_scrub_stamp":"2024-09-14T11:23:06.692450+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":800,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:48.375095+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4120,"num_read_kb":3716,"num_write":1158,"num_write_kb":467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"260'307","reported_seq":915,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:09.184657+0000","last_change":"2024-09-14T11:23:09.184657+0000","last_active":"2024-09-14T11:23:09.184657+0000","last_peered":"2024-09-14T11:23:09.184657+0000","last_clean":"2024-09-14T11:23:09.184657+0000","last_became_active":"2024-09-14T10:45:43.677597+0000","last_became_peered":"2024-09-14T10:45:43.677597+0000","last_unstale":"2024-09-14T11:23:09.184657+0000","last_undegraded":"2024-09-14T11:23:09.184657+0000","last_fullsized":"2024-09-14T11:23:09.184657+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'307","last_scrub_stamp":"2024-09-14T11:23:09.184538+0000","last_deep_scrub":"260'307","last_deep_scrub_stamp":"2024-09-14T11:23:09.184538+0000","last_clean_scrub_stamp":"2024-09-14T11:23:09.184538+0000","objects_scrubbed":3,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:11.668626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":480,"num_read_kb":1898,"num_write":986,"num_write_kb":19841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"260'857","reported_seq":2379,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:08.648180+0000","last_change":"2024-09-14T11:23:08.648180+0000","last_active":"2024-09-14T11:23:08.648180+0000","last_peered":"2024-09-14T11:23:08.648180+0000","last_clean":"2024-09-14T11:23:08.648180+0000","last_became_active":"2024-09-14T10:45:45.715268+0000","last_became_peered":"2024-09-14T10:45:45.715268+0000","last_unstale":"2024-09-14T11:23:08.648180+0000","last_undegraded":"2024-09-14T11:23:08.648180+0000","last_fullsized":"2024-09-14T11:23:08.648180+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'857","last_scrub_stamp":"2024-09-14T11:23:08.648098+0000","last_deep_scrub":"260'857","last_deep_scrub_stamp":"2024-09-14T11:23:08.648098+0000","last_clean_scrub_stamp":"2024-09-14T11:23:08.648098+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":800,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:21.218133+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4230,"num_read_kb":3798,"num_write":1192,"num_write_kb":502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"260'355","reported_seq":1011,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:05.289243+0000","last_change":"2024-09-14T11:23:05.289243+0000","last_active":"2024-09-14T11:23:05.289243+0000","last_peered":"2024-09-14T11:23:05.289243+0000","last_clean":"2024-09-14T11:23:05.289243+0000","last_became_active":"2024-09-14T10:45:43.681694+0000","last_became_peered":"2024-09-14T10:45:43.681694+0000","last_unstale":"2024-09-14T11:23:05.289243+0000","last_undegraded":"2024-09-14T11:23:05.289243+0000","last_fullsized":"2024-09-14T11:23:05.289243+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'355","last_scrub_stamp":"2024-09-14T11:23:05.289154+0000","last_deep_scrub":"260'355","last_deep_scrub_stamp":"2024-09-14T11:23:05.289154+0000","last_clean_scrub_stamp":"2024-09-14T11:23:05.289154+0000","objects_scrubbed":2,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:15:49.436744+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133679,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":711,"num_read_kb":32454,"num_write":1261,"num_write_kb":21071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"260'430","reported_seq":1883,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:28.336922+0000","last_change":"2024-09-14T10:45:45.723781+0000","last_active":"2024-09-14T11:21:28.336922+0000","last_peered":"2024-09-14T11:21:28.336922+0000","last_clean":"2024-09-14T11:21:28.336922+0000","last_became_active":"2024-09-14T10:45:45.723441+0000","last_became_peered":"2024-09-14T10:45:45.723441+0000","last_unstale":"2024-09-14T11:21:28.336922+0000","last_undegraded":"2024-09-14T11:21:28.336922+0000","last_fullsized":"2024-09-14T11:21:28.336922+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:44.691628+0000","last_clean_scrub_stamp":"2024-09-14T10:45:44.691628+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:25.130052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2262,"num_read_kb":2127,"num_write":517,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"260'356","reported_seq":1000,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:59.642417+0000","last_change":"2024-09-14T11:22:59.642417+0000","last_active":"2024-09-14T11:22:59.642417+0000","last_peered":"2024-09-14T11:22:59.642417+0000","last_clean":"2024-09-14T11:22:59.642417+0000","last_became_active":"2024-09-14T10:45:43.681441+0000","last_became_peered":"2024-09-14T10:45:43.681441+0000","last_unstale":"2024-09-14T11:22:59.642417+0000","last_undegraded":"2024-09-14T11:22:59.642417+0000","last_fullsized":"2024-09-14T11:22:59.642417+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'356","last_scrub_stamp":"2024-09-14T11:22:59.642325+0000","last_deep_scrub":"260'356","last_deep_scrub_stamp":"2024-09-14T11:22:59.642325+0000","last_clean_scrub_stamp":"2024-09-14T11:22:59.642325+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:41.518525+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244496,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":649,"num_read_kb":21101,"num_write":1092,"num_write_kb":38924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"260'751","reported_seq":2230,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:05.568333+0000","last_change":"2024-09-14T11:23:05.568333+0000","last_active":"2024-09-14T11:23:05.568333+0000","last_peered":"2024-09-14T11:23:05.568333+0000","last_clean":"2024-09-14T11:23:05.568333+0000","last_became_active":"2024-09-14T10:45:45.711402+0000","last_became_peered":"2024-09-14T10:45:45.711402+0000","last_unstale":"2024-09-14T11:23:05.568333+0000","last_undegraded":"2024-09-14T11:23:05.568333+0000","last_fullsized":"2024-09-14T11:23:05.568333+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'751","last_scrub_stamp":"2024-09-14T11:23:05.568226+0000","last_deep_scrub":"260'751","last_deep_scrub_stamp":"2024-09-14T11:23:05.568226+0000","last_clean_scrub_stamp":"2024-09-14T11:23:05.568226+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:00.144694+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3613,"num_read_kb":3262,"num_write":995,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"260'351","reported_seq":980,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:02.925737+0000","last_change":"2024-09-14T11:23:02.925737+0000","last_active":"2024-09-14T11:23:02.925737+0000","last_peered":"2024-09-14T11:23:02.925737+0000","last_clean":"2024-09-14T11:23:02.925737+0000","last_became_active":"2024-09-14T10:45:43.690104+0000","last_became_peered":"2024-09-14T10:45:43.690104+0000","last_unstale":"2024-09-14T11:23:02.925737+0000","last_undegraded":"2024-09-14T11:23:02.925737+0000","last_fullsized":"2024-09-14T11:23:02.925737+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'351","last_scrub_stamp":"2024-09-14T11:23:02.925623+0000","last_deep_scrub":"260'351","last_deep_scrub_stamp":"2024-09-14T11:23:02.925623+0000","last_clean_scrub_stamp":"2024-09-14T11:23:02.925623+0000","objects_scrubbed":4,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:52.477625+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":636,"num_read_kb":1890,"num_write":1154,"num_write_kb":1386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"260'588","reported_seq":2236,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:04.608895+0000","last_change":"2024-09-14T11:23:04.608895+0000","last_active":"2024-09-14T11:23:04.608895+0000","last_peered":"2024-09-14T11:23:04.608895+0000","last_clean":"2024-09-14T11:23:04.608895+0000","last_became_active":"2024-09-14T10:45:45.723163+0000","last_became_peered":"2024-09-14T10:45:45.723163+0000","last_unstale":"2024-09-14T11:23:04.608895+0000","last_undegraded":"2024-09-14T11:23:04.608895+0000","last_fullsized":"2024-09-14T11:23:04.608895+0000","mapping_epoch":26,"log_start":"260'500","ondisk_log_start":"260'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'588","last_scrub_stamp":"2024-09-14T11:23:04.608810+0000","last_deep_scrub":"260'588","last_deep_scrub_stamp":"2024-09-14T11:23:04.608810+0000","last_clean_scrub_stamp":"2024-09-14T11:23:04.608810+0000","objects_scrubbed":4,"log_size":88,"log_dups_size":500,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:14.023702+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3275,"num_read_kb":3002,"num_write":768,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"260'379","reported_seq":1053,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:54.616609+0000","last_change":"2024-09-14T11:22:54.616609+0000","last_active":"2024-09-14T11:22:54.616609+0000","last_peered":"2024-09-14T11:22:54.616609+0000","last_clean":"2024-09-14T11:22:54.616609+0000","last_became_active":"2024-09-14T10:45:43.680517+0000","last_became_peered":"2024-09-14T10:45:43.680517+0000","last_unstale":"2024-09-14T11:22:54.616609+0000","last_undegraded":"2024-09-14T11:22:54.616609+0000","last_fullsized":"2024-09-14T11:22:54.616609+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'379","last_scrub_stamp":"2024-09-14T11:22:54.616470+0000","last_deep_scrub":"260'379","last_deep_scrub_stamp":"2024-09-14T11:22:54.616470+0000","last_clean_scrub_stamp":"2024-09-14T11:22:54.616470+0000","objects_scrubbed":8,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:48.841281+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133694,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":729,"num_read_kb":32475,"num_write":1387,"num_write_kb":39199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"260'770","reported_seq":2292,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:07.714670+0000","last_change":"2024-09-14T11:23:07.714670+0000","last_active":"2024-09-14T11:23:07.714670+0000","last_peered":"2024-09-14T11:23:07.714670+0000","last_clean":"2024-09-14T11:23:07.714670+0000","last_became_active":"2024-09-14T10:45:45.718969+0000","last_became_peered":"2024-09-14T10:45:45.718969+0000","last_unstale":"2024-09-14T11:23:07.714670+0000","last_undegraded":"2024-09-14T11:23:07.714670+0000","last_fullsized":"2024-09-14T11:23:07.714670+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'770","last_scrub_stamp":"2024-09-14T11:23:07.714570+0000","last_deep_scrub":"260'770","last_deep_scrub_stamp":"2024-09-14T11:23:07.714570+0000","last_clean_scrub_stamp":"2024-09-14T11:23:07.714570+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:16.190729+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3670,"num_read_kb":3326,"num_write":1002,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"260'340","reported_seq":968,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:12.215702+0000","last_change":"2024-09-14T11:23:12.215702+0000","last_active":"2024-09-14T11:23:12.215702+0000","last_peered":"2024-09-14T11:23:12.215702+0000","last_clean":"2024-09-14T11:23:12.215702+0000","last_became_active":"2024-09-14T10:45:43.690489+0000","last_became_peered":"2024-09-14T10:45:43.690489+0000","last_unstale":"2024-09-14T11:23:12.215702+0000","last_undegraded":"2024-09-14T11:23:12.215702+0000","last_fullsized":"2024-09-14T11:23:12.215702+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'340","last_scrub_stamp":"2024-09-14T11:23:12.215605+0000","last_deep_scrub":"260'340","last_deep_scrub_stamp":"2024-09-14T11:23:12.215605+0000","last_clean_scrub_stamp":"2024-09-14T11:23:12.215605+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:12.269469+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":562,"num_read_kb":22090,"num_write":1057,"num_write_kb":34450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"260'629","reported_seq":2211,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:09.765722+0000","last_change":"2024-09-14T11:23:09.765722+0000","last_active":"2024-09-14T11:23:09.765722+0000","last_peered":"2024-09-14T11:23:09.765722+0000","last_clean":"2024-09-14T11:23:09.765722+0000","last_became_active":"2024-09-14T10:45:45.727095+0000","last_became_peered":"2024-09-14T10:45:45.727095+0000","last_unstale":"2024-09-14T11:23:09.765722+0000","last_undegraded":"2024-09-14T11:23:09.765722+0000","last_fullsized":"2024-09-14T11:23:09.765722+0000","mapping_epoch":26,"log_start":"260'600","ondisk_log_start":"260'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'629","last_scrub_stamp":"2024-09-14T11:23:09.765606+0000","last_deep_scrub":"260'629","last_deep_scrub_stamp":"2024-09-14T11:23:09.765606+0000","last_clean_scrub_stamp":"2024-09-14T11:23:09.765606+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":600,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:16.812881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3428,"num_read_kb":3090,"num_write":924,"num_write_kb":450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":893,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"260'312","reported_seq":907,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:01.817437+0000","last_change":"2024-09-14T11:23:01.817385+0000","last_active":"2024-09-14T11:23:01.817437+0000","last_peered":"2024-09-14T11:23:01.817437+0000","last_clean":"2024-09-14T11:23:01.817437+0000","last_became_active":"2024-09-14T10:45:43.689186+0000","last_became_peered":"2024-09-14T10:45:43.689186+0000","last_unstale":"2024-09-14T11:23:01.817437+0000","last_undegraded":"2024-09-14T11:23:01.817437+0000","last_fullsized":"2024-09-14T11:23:01.817437+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'312","last_scrub_stamp":"2024-09-14T11:23:01.817298+0000","last_deep_scrub":"260'312","last_deep_scrub_stamp":"2024-09-14T11:23:01.817298+0000","last_clean_scrub_stamp":"2024-09-14T11:23:01.817298+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:01.982799+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133706,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":457,"num_read_kb":44560,"num_write":936,"num_write_kb":69256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"260'1085","reported_seq":2831,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:03.606116+0000","last_change":"2024-09-14T11:23:03.606116+0000","last_active":"2024-09-14T11:23:03.606116+0000","last_peered":"2024-09-14T11:23:03.606116+0000","last_clean":"2024-09-14T11:23:03.606116+0000","last_became_active":"2024-09-14T10:45:45.720636+0000","last_became_peered":"2024-09-14T10:45:45.720636+0000","last_unstale":"2024-09-14T11:23:03.606116+0000","last_undegraded":"2024-09-14T11:23:03.606116+0000","last_fullsized":"2024-09-14T11:23:03.606116+0000","mapping_epoch":26,"log_start":"260'1000","ondisk_log_start":"260'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1085","last_scrub_stamp":"2024-09-14T11:23:03.606026+0000","last_deep_scrub":"260'1085","last_deep_scrub_stamp":"2024-09-14T11:23:03.606026+0000","last_clean_scrub_stamp":"2024-09-14T11:23:03.606026+0000","objects_scrubbed":2,"log_size":85,"log_dups_size":1000,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:51:34.804450+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5348,"num_read_kb":4870,"num_write":1559,"num_write_kb":616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"260'336","reported_seq":1017,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:10.212053+0000","last_change":"2024-09-14T11:23:10.212053+0000","last_active":"2024-09-14T11:23:10.212053+0000","last_peered":"2024-09-14T11:23:10.212053+0000","last_clean":"2024-09-14T11:23:10.212053+0000","last_became_active":"2024-09-14T10:45:43.682573+0000","last_became_peered":"2024-09-14T10:45:43.682573+0000","last_unstale":"2024-09-14T11:23:10.212053+0000","last_undegraded":"2024-09-14T11:23:10.212053+0000","last_fullsized":"2024-09-14T11:23:10.212053+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'336","last_scrub_stamp":"2024-09-14T11:23:10.211893+0000","last_deep_scrub":"260'336","last_deep_scrub_stamp":"2024-09-14T11:23:10.211893+0000","last_clean_scrub_stamp":"2024-09-14T11:23:10.211893+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:35.666356+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244522,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":804,"num_read_kb":3981,"num_write":1025,"num_write_kb":35472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"260'383","reported_seq":1020,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:11.233324+0000","last_change":"2024-09-14T11:23:11.233324+0000","last_active":"2024-09-14T11:23:11.233324+0000","last_peered":"2024-09-14T11:23:11.233324+0000","last_clean":"2024-09-14T11:23:11.233324+0000","last_became_active":"2024-09-14T10:45:43.673527+0000","last_became_peered":"2024-09-14T10:45:43.673527+0000","last_unstale":"2024-09-14T11:23:11.233324+0000","last_undegraded":"2024-09-14T11:23:11.233324+0000","last_fullsized":"2024-09-14T11:23:11.233324+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'383","last_scrub_stamp":"2024-09-14T11:23:11.233207+0000","last_deep_scrub":"260'383","last_deep_scrub_stamp":"2024-09-14T11:23:11.233207+0000","last_clean_scrub_stamp":"2024-09-14T11:23:11.233207+0000","objects_scrubbed":5,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:10:35.983721+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":679,"num_read_kb":21996,"num_write":1218,"num_write_kb":25813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"260'1016","reported_seq":2623,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:13.796760+0000","last_change":"2024-09-14T11:23:13.796760+0000","last_active":"2024-09-14T11:23:13.796760+0000","last_peered":"2024-09-14T11:23:13.796760+0000","last_clean":"2024-09-14T11:23:13.796760+0000","last_became_active":"2024-09-14T10:45:45.724040+0000","last_became_peered":"2024-09-14T10:45:45.724040+0000","last_unstale":"2024-09-14T11:23:13.796760+0000","last_undegraded":"2024-09-14T11:23:13.796760+0000","last_fullsized":"2024-09-14T11:23:13.796760+0000","mapping_epoch":26,"log_start":"260'1000","ondisk_log_start":"260'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1016","last_scrub_stamp":"2024-09-14T11:23:13.796666+0000","last_deep_scrub":"260'1016","last_deep_scrub_stamp":"2024-09-14T11:23:13.796666+0000","last_clean_scrub_stamp":"2024-09-14T11:23:13.796666+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":1000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:58.735365+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4769,"num_read_kb":4210,"num_write":1424,"num_write_kb":631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"260'384","reported_seq":1025,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:06.332254+0000","last_change":"2024-09-14T11:23:06.332254+0000","last_active":"2024-09-14T11:23:06.332254+0000","last_peered":"2024-09-14T11:23:06.332254+0000","last_clean":"2024-09-14T11:23:06.332254+0000","last_became_active":"2024-09-14T10:45:43.687162+0000","last_became_peered":"2024-09-14T10:45:43.687162+0000","last_unstale":"2024-09-14T11:23:06.332254+0000","last_undegraded":"2024-09-14T11:23:06.332254+0000","last_fullsized":"2024-09-14T11:23:06.332254+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'384","last_scrub_stamp":"2024-09-14T11:23:06.332163+0000","last_deep_scrub":"260'384","last_deep_scrub_stamp":"2024-09-14T11:23:06.332163+0000","last_clean_scrub_stamp":"2024-09-14T11:23:06.332163+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:22.685467+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":664,"num_read_kb":37354,"num_write":1184,"num_write_kb":26064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"260'478","reported_seq":2026,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:07.626572+0000","last_change":"2024-09-14T11:23:07.626572+0000","last_active":"2024-09-14T11:23:07.626572+0000","last_peered":"2024-09-14T11:23:07.626572+0000","last_clean":"2024-09-14T11:23:07.626572+0000","last_became_active":"2024-09-14T10:45:45.711869+0000","last_became_peered":"2024-09-14T10:45:45.711869+0000","last_unstale":"2024-09-14T11:23:07.626572+0000","last_undegraded":"2024-09-14T11:23:07.626572+0000","last_fullsized":"2024-09-14T11:23:07.626572+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'478","last_scrub_stamp":"2024-09-14T11:23:07.626475+0000","last_deep_scrub":"260'478","last_deep_scrub_stamp":"2024-09-14T11:23:07.626475+0000","last_clean_scrub_stamp":"2024-09-14T11:23:07.626475+0000","objects_scrubbed":1,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:37.243122+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2555,"num_read_kb":2382,"num_write":592,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":694,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10817,"num_read_kb":8523,"num_write":3117,"num_write_kb":1010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1096,"ondisk_log_size":1096,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":14831,"num_objects":87,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":15133,"num_read_kb":14796,"num_write":17057,"num_write_kb":4975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":29662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1479,"ondisk_log_size":1479,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":787,"ondisk_log_size":787,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1553710,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":17035,"num_read_kb":36473,"num_write":14315,"num_write_kb":11597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":557290,"num_omap_keys":1258,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2149,"ondisk_log_size":2149,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2403,"num_read_kb":2864,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":219533,"num_read_kb":201172,"num_write":55836,"num_write_kb":19050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":143,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27901,"num_omap_keys":114,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4176,"ondisk_log_size":4176,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":33830883,"num_objects":281,"num_object_clones":0,"num_object_copies":562,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":281,"num_whiteouts":0,"num_read":44198,"num_read_kb":2138103,"num_write":73249,"num_write_kb":2157996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":68608000,"data_stored":67661766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3853,"ondisk_log_size":3853,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":135,"num_read_kb":175817,"num_write":154,"num_write_kb":116354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":174730,"num_write":154,"num_write_kb":116354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509900,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":216692,"kb_used_data":18916,"kb_used_omap":1,"kb_used_meta":197758,"kb_avail":94155148,"statfs":{"total":96636764160,"available":96414871552,"internally_reserved":0,"allocated":19369984,"data_stored":17696805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":202504647},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509898,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284708,"kb_used_data":10580,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":94087132,"statfs":{"total":96636764160,"available":96345223168,"internally_reserved":0,"allocated":10833920,"data_stored":9216591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":280689093},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509897,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113044,"kb_used_data":19460,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94258796,"statfs":{"total":96636764160,"available":96521007104,"internally_reserved":0,"allocated":19927040,"data_stored":18233635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542602,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":229044,"kb_used_data":9124,"kb_used_omap":1,"kb_used_meta":219902,"kb_avail":94142796,"statfs":{"total":96636764160,"available":96402223104,"internally_reserved":0,"allocated":9342976,"data_stored":7745589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":225180106},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542602,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89140,"kb_used_data":8036,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94282700,"statfs":{"total":96636764160,"available":96545484800,"internally_reserved":0,"allocated":8228864,"data_stored":6610205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":83032518},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542604,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":252176,"kb_used_data":8640,"kb_used_omap":1,"kb_used_meta":243518,"kb_avail":94119664,"statfs":{"total":96636764160,"available":96378535936,"internally_reserved":0,"allocated":8847360,"data_stored":7201151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":249362885},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542603,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":189272,"kb_used_data":9608,"kb_used_omap":1,"kb_used_meta":179646,"kb_avail":94182568,"statfs":{"total":96636764160,"available":96442949632,"internally_reserved":0,"allocated":9838592,"data_stored":8236289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":183957957},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575306,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":111084,"kb_used_data":11868,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94260756,"statfs":{"total":96636764160,"available":96523014144,"internally_reserved":0,"allocated":12152832,"data_stored":10503839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16318464,"data_stored":16157858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6668288,"data_stored":6553434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8556544,"data_stored":8428200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15777792,"data_stored":15622768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6250496,"data_stored":6160671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4653056,"data_stored":4535149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4632576,"data_stored":4535041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5750784,"data_stored":5668645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":5195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:23:18.504 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.505 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.505 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.505 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.505 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.505 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.505 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.505 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.505 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.505 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.505 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.506 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.506 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.506 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.506 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.506 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.506 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.506 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.506 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.506 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.506 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.507 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.507 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.507 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.507 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.507 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.507 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.507 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.507 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.507 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.507 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.508 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.508 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.508 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.508 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.508 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.508 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.508 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.508 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.508 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.508 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.509 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.509 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.509 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.509 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.509 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.509 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.509 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.509 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.509 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.510 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.510 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.510 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.510 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.510 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.510 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.510 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.510 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.510 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.510 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.511 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.511 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.511 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.511 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.511 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.511 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.511 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.511 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.511 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.512 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.512 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.512 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.512 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.512 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.512 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.512 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.512 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.512 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.513 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.513 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.513 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.513 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.513 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.513 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.513 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.513 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.513 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.513 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.513 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.514 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.514 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.514 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.514 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.514 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.514 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.514 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.514 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.514 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.514 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.515 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.515 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.515 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.515 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.515 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.515 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.515 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.515 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.515 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.515 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.516 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.516 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.516 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.516 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.516 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.516 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.516 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.516 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.516 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.517 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.517 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.517 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.517 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.517 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.517 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.517 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.517 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.517 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.517 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.518 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.518 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.518 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.518 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.518 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.518 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.519 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-14T10:45:46.700380+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.519 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.519 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.519 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.519 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-14T10:45:46.700380+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.519 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.519 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.519 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-14T10:45:46.700380+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.519 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.519 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.520 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.520 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-14T10:45:46.700380+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.520 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.520 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.520 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.520 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.520 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.520 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.521 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-14T10:45:46.700380+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.521 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.521 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.521 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.521 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.521 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.521 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.521 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.522 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-14T10:45:46.700380+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.522 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.522 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.522 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.522 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.522 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.522 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-14T10:45:46.700380+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.522 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.523 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.523 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.523 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.523 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-14T10:45:46.700380+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.523 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.523 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.523 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.523 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.524 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.524 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.524 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.524 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.524 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.524 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.524 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.525 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-14T10:45:46.700380+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.525 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.525 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.525 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.525 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.525 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.525 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.525 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.526 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.526 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.526 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.526 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.526 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.526 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.526 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.526 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.527 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-14T10:45:46.700380+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.527 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.527 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.527 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.527 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.527 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.527 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.527 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.528 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.528 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.528 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.528 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.528 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-14T10:45:46.700380+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.528 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.528 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.528 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.528 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.529 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.529 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.529 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-14T10:45:46.700380+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.529 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.529 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.529 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.529 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.529 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.530 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.530 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-14T10:45:46.700380+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.530 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-14T10:45:48.712312+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.530 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.530 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.530 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.530 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-14T10:45:44.691628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:18.531 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T11:23:38.532 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:23:38.866 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:23:38.877 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-09-14T11:23:38.879 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":1399,"stamp":"2024-09-14T11:23:37.776963+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":35991604,"num_objects":734,"num_object_clones":0,"num_object_copies":1468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":734,"num_whiteouts":0,"num_read":309464,"num_read_kb":2752545,"num_write":164025,"num_write_kb":2428992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":190,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":749334,"num_omap_keys":1781,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13836,"ondisk_log_size":13836,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1489320,"kb_used_data":96232,"kb_used_omap":12,"kb_used_meta":1392947,"kb_avail":753485400,"statfs":{"total":773094113280,"available":771569049600,"internally_reserved":0,"allocated":98541568,"data_stored":85444104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1426378288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":124977,"num_omap_keys":311,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005468"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":25,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:33.560175+0000","last_change":"2024-09-14T11:23:33.560175+0000","last_active":"2024-09-14T11:23:33.560175+0000","last_peered":"2024-09-14T11:23:33.560175+0000","last_clean":"2024-09-14T11:23:33.560175+0000","last_became_active":"2024-09-14T11:11:42.592933+0000","last_became_peered":"2024-09-14T11:11:42.592933+0000","last_unstale":"2024-09-14T11:23:33.560175+0000","last_undegraded":"2024-09-14T11:23:33.560175+0000","last_fullsized":"2024-09-14T11:23:33.560175+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:33.560091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:33.560091+0000","last_clean_scrub_stamp":"2024-09-14T11:23:33.560091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:16.523328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"260'2","reported_seq":39,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:31.535946+0000","last_change":"2024-09-14T11:23:31.535946+0000","last_active":"2024-09-14T11:23:31.535946+0000","last_peered":"2024-09-14T11:23:31.535946+0000","last_clean":"2024-09-14T11:23:31.535946+0000","last_became_active":"2024-09-14T11:01:23.881902+0000","last_became_peered":"2024-09-14T11:01:23.881902+0000","last_unstale":"2024-09-14T11:23:31.535946+0000","last_undegraded":"2024-09-14T11:23:31.535946+0000","last_fullsized":"2024-09-14T11:23:31.535946+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:23:31.535822+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:23:31.535822+0000","last_clean_scrub_stamp":"2024-09-14T11:23:31.535822+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:35.535334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"260'8","reported_seq":59,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:35.827907+0000","last_change":"2024-09-14T11:23:35.827907+0000","last_active":"2024-09-14T11:23:35.827907+0000","last_peered":"2024-09-14T11:23:35.827907+0000","last_clean":"2024-09-14T11:23:35.827907+0000","last_became_active":"2024-09-14T11:01:20.867142+0000","last_became_peered":"2024-09-14T11:01:20.867142+0000","last_unstale":"2024-09-14T11:23:35.827907+0000","last_undegraded":"2024-09-14T11:23:35.827907+0000","last_fullsized":"2024-09-14T11:23:35.827907+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'8","last_scrub_stamp":"2024-09-14T11:23:35.827820+0000","last_deep_scrub":"260'8","last_deep_scrub_stamp":"2024-09-14T11:23:35.827820+0000","last_clean_scrub_stamp":"2024-09-14T11:23:35.827820+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:23.584930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20482,"num_write":18,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"260'30","reported_seq":123,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:41.126104+0000","last_change":"2024-09-14T10:59:48.417565+0000","last_active":"2024-09-14T11:20:41.126104+0000","last_peered":"2024-09-14T11:20:41.126104+0000","last_clean":"2024-09-14T11:20:41.126104+0000","last_became_active":"2024-09-14T10:59:48.416537+0000","last_became_peered":"2024-09-14T10:59:48.416537+0000","last_unstale":"2024-09-14T11:20:41.126104+0000","last_undegraded":"2024-09-14T11:20:41.126104+0000","last_fullsized":"2024-09-14T11:20:41.126104+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:15.136259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":249,"num_read_kb":173,"num_write":73,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:15.984097+0000","last_change":"2024-09-14T11:11:42.588136+0000","last_active":"2024-09-14T11:19:15.984097+0000","last_peered":"2024-09-14T11:19:15.984097+0000","last_clean":"2024-09-14T11:19:15.984097+0000","last_became_active":"2024-09-14T11:11:42.587818+0000","last_became_peered":"2024-09-14T11:11:42.587818+0000","last_unstale":"2024-09-14T11:19:15.984097+0000","last_undegraded":"2024-09-14T11:19:15.984097+0000","last_fullsized":"2024-09-14T11:19:15.984097+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:37.528920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"260'2","reported_seq":30,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:25.002242+0000","last_change":"2024-09-14T11:01:23.881376+0000","last_active":"2024-09-14T11:21:25.002242+0000","last_peered":"2024-09-14T11:21:25.002242+0000","last_clean":"2024-09-14T11:21:25.002242+0000","last_became_active":"2024-09-14T11:01:23.881074+0000","last_became_peered":"2024-09-14T11:01:23.881074+0000","last_unstale":"2024-09-14T11:21:25.002242+0000","last_undegraded":"2024-09-14T11:21:25.002242+0000","last_fullsized":"2024-09-14T11:21:25.002242+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:53.183326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":571,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"260'8","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:21.253973+0000","last_change":"2024-09-14T11:01:20.868669+0000","last_active":"2024-09-14T11:21:21.253973+0000","last_peered":"2024-09-14T11:21:21.253973+0000","last_clean":"2024-09-14T11:21:21.253973+0000","last_became_active":"2024-09-14T11:01:20.868373+0000","last_became_peered":"2024-09-14T11:01:20.868373+0000","last_unstale":"2024-09-14T11:21:21.253973+0000","last_undegraded":"2024-09-14T11:21:21.253973+0000","last_fullsized":"2024-09-14T11:21:21.253973+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:33:49.244253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10811,"num_write":13,"num_write_kb":10811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"260'56","reported_seq":195,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:56.120455+0000","last_change":"2024-09-14T10:59:48.416508+0000","last_active":"2024-09-14T11:19:56.120455+0000","last_peered":"2024-09-14T11:19:56.120455+0000","last_clean":"2024-09-14T11:19:56.120455+0000","last_became_active":"2024-09-14T10:59:48.416222+0000","last_became_peered":"2024-09-14T10:59:48.416222+0000","last_unstale":"2024-09-14T11:19:56.120455+0000","last_undegraded":"2024-09-14T11:19:56.120455+0000","last_fullsized":"2024-09-14T11:19:56.120455+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:30.061341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":447,"num_read_kb":304,"num_write":135,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":25,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:35.599995+0000","last_change":"2024-09-14T11:23:35.599995+0000","last_active":"2024-09-14T11:23:35.599995+0000","last_peered":"2024-09-14T11:23:35.599995+0000","last_clean":"2024-09-14T11:23:35.599995+0000","last_became_active":"2024-09-14T11:11:42.593314+0000","last_became_peered":"2024-09-14T11:11:42.593314+0000","last_unstale":"2024-09-14T11:23:35.599995+0000","last_undegraded":"2024-09-14T11:23:35.599995+0000","last_fullsized":"2024-09-14T11:23:35.599995+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:35.599879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:35.599879+0000","last_clean_scrub_stamp":"2024-09-14T11:23:35.599879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:47:55.344309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"260'3","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:16.262309+0000","last_change":"2024-09-14T11:01:23.893105+0000","last_active":"2024-09-14T11:22:16.262309+0000","last_peered":"2024-09-14T11:22:16.262309+0000","last_clean":"2024-09-14T11:22:16.262309+0000","last_became_active":"2024-09-14T11:01:23.892846+0000","last_became_peered":"2024-09-14T11:01:23.892846+0000","last_unstale":"2024-09-14T11:22:16.262309+0000","last_undegraded":"2024-09-14T11:22:16.262309+0000","last_fullsized":"2024-09-14T11:22:16.262309+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:50.339780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"260'2","reported_seq":39,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.352498+0000","last_change":"2024-09-14T11:01:20.864944+0000","last_active":"2024-09-14T11:22:51.352498+0000","last_peered":"2024-09-14T11:22:51.352498+0000","last_clean":"2024-09-14T11:22:51.352498+0000","last_became_active":"2024-09-14T11:01:20.864672+0000","last_became_peered":"2024-09-14T11:01:20.864672+0000","last_unstale":"2024-09-14T11:22:51.352498+0000","last_undegraded":"2024-09-14T11:22:51.352498+0000","last_fullsized":"2024-09-14T11:22:51.352498+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"260'48","reported_seq":176,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:32.211469+0000","last_change":"2024-09-14T11:23:32.211469+0000","last_active":"2024-09-14T11:23:32.211469+0000","last_peered":"2024-09-14T11:23:32.211469+0000","last_clean":"2024-09-14T11:23:32.211469+0000","last_became_active":"2024-09-14T10:59:48.419525+0000","last_became_peered":"2024-09-14T10:59:48.419525+0000","last_unstale":"2024-09-14T11:23:32.211469+0000","last_undegraded":"2024-09-14T11:23:32.211469+0000","last_fullsized":"2024-09-14T11:23:32.211469+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'48","last_scrub_stamp":"2024-09-14T11:23:32.211344+0000","last_deep_scrub":"260'48","last_deep_scrub_stamp":"2024-09-14T11:23:32.211344+0000","last_clean_scrub_stamp":"2024-09-14T11:23:32.211344+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:38.708280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":364,"num_read_kb":247,"num_write":125,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:01.233674+0000","last_change":"2024-09-14T11:11:42.587584+0000","last_active":"2024-09-14T11:19:01.233674+0000","last_peered":"2024-09-14T11:19:01.233674+0000","last_clean":"2024-09-14T11:19:01.233674+0000","last_became_active":"2024-09-14T11:11:42.587218+0000","last_became_peered":"2024-09-14T11:11:42.587218+0000","last_unstale":"2024-09-14T11:19:01.233674+0000","last_undegraded":"2024-09-14T11:19:01.233674+0000","last_fullsized":"2024-09-14T11:19:01.233674+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:55.734324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"260'2","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.238406+0000","last_change":"2024-09-14T11:01:23.887367+0000","last_active":"2024-09-14T11:22:51.238406+0000","last_peered":"2024-09-14T11:22:51.238406+0000","last_clean":"2024-09-14T11:22:51.238406+0000","last_became_active":"2024-09-14T11:01:23.886771+0000","last_became_peered":"2024-09-14T11:01:23.886771+0000","last_unstale":"2024-09-14T11:22:51.238406+0000","last_undegraded":"2024-09-14T11:22:51.238406+0000","last_fullsized":"2024-09-14T11:22:51.238406+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":118,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"257'5","reported_seq":58,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:32.559543+0000","last_change":"2024-09-14T11:23:32.559543+0000","last_active":"2024-09-14T11:23:32.559543+0000","last_peered":"2024-09-14T11:23:32.559543+0000","last_clean":"2024-09-14T11:23:32.559543+0000","last_became_active":"2024-09-14T11:01:20.861799+0000","last_became_peered":"2024-09-14T11:01:20.861799+0000","last_unstale":"2024-09-14T11:23:32.559543+0000","last_undegraded":"2024-09-14T11:23:32.559543+0000","last_fullsized":"2024-09-14T11:23:32.559543+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'5","last_scrub_stamp":"2024-09-14T11:23:32.559455+0000","last_deep_scrub":"257'5","last_deep_scrub_stamp":"2024-09-14T11:23:32.559455+0000","last_clean_scrub_stamp":"2024-09-14T11:23:32.559455+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:15.145786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"260'15","reported_seq":85,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:30.130793+0000","last_change":"2024-09-14T11:23:30.130793+0000","last_active":"2024-09-14T11:23:30.130793+0000","last_peered":"2024-09-14T11:23:30.130793+0000","last_clean":"2024-09-14T11:23:30.130793+0000","last_became_active":"2024-09-14T10:59:48.411423+0000","last_became_peered":"2024-09-14T10:59:48.411423+0000","last_unstale":"2024-09-14T11:23:30.130793+0000","last_undegraded":"2024-09-14T11:23:30.130793+0000","last_fullsized":"2024-09-14T11:23:30.130793+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'15","last_scrub_stamp":"2024-09-14T11:23:30.130697+0000","last_deep_scrub":"260'15","last_deep_scrub_stamp":"2024-09-14T11:23:30.130697+0000","last_clean_scrub_stamp":"2024-09-14T11:23:30.130697+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:14:49.943927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":68,"num_write":41,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:50.995962+0000","last_change":"2024-09-14T11:11:42.584008+0000","last_active":"2024-09-14T11:19:50.995962+0000","last_peered":"2024-09-14T11:19:50.995962+0000","last_clean":"2024-09-14T11:19:50.995962+0000","last_became_active":"2024-09-14T11:11:42.583717+0000","last_became_peered":"2024-09-14T11:11:42.583717+0000","last_unstale":"2024-09-14T11:19:50.995962+0000","last_undegraded":"2024-09-14T11:19:50.995962+0000","last_fullsized":"2024-09-14T11:19:50.995962+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:22:54.043934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"257'3","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:27.541195+0000","last_change":"2024-09-14T11:23:27.541195+0000","last_active":"2024-09-14T11:23:27.541195+0000","last_peered":"2024-09-14T11:23:27.541195+0000","last_clean":"2024-09-14T11:23:27.541195+0000","last_became_active":"2024-09-14T11:01:23.894107+0000","last_became_peered":"2024-09-14T11:01:23.894107+0000","last_unstale":"2024-09-14T11:23:27.541195+0000","last_undegraded":"2024-09-14T11:23:27.541195+0000","last_fullsized":"2024-09-14T11:23:27.541195+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'3","last_scrub_stamp":"2024-09-14T11:23:27.541106+0000","last_deep_scrub":"257'3","last_deep_scrub_stamp":"2024-09-14T11:23:27.541106+0000","last_clean_scrub_stamp":"2024-09-14T11:23:27.541106+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:28:00.951271+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"260'6","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.881916+0000","last_change":"2024-09-14T11:01:20.868842+0000","last_active":"2024-09-14T11:22:50.881916+0000","last_peered":"2024-09-14T11:22:50.881916+0000","last_clean":"2024-09-14T11:22:50.881916+0000","last_became_active":"2024-09-14T11:01:20.867768+0000","last_became_peered":"2024-09-14T11:01:20.867768+0000","last_unstale":"2024-09-14T11:22:50.881916+0000","last_undegraded":"2024-09-14T11:22:50.881916+0000","last_fullsized":"2024-09-14T11:22:50.881916+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"260'40","reported_seq":154,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:29.172741+0000","last_change":"2024-09-14T11:23:29.172741+0000","last_active":"2024-09-14T11:23:29.172741+0000","last_peered":"2024-09-14T11:23:29.172741+0000","last_clean":"2024-09-14T11:23:29.172741+0000","last_became_active":"2024-09-14T10:59:48.413296+0000","last_became_peered":"2024-09-14T10:59:48.413296+0000","last_unstale":"2024-09-14T11:23:29.172741+0000","last_undegraded":"2024-09-14T11:23:29.172741+0000","last_fullsized":"2024-09-14T11:23:29.172741+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'40","last_scrub_stamp":"2024-09-14T11:23:29.172654+0000","last_deep_scrub":"260'40","last_deep_scrub_stamp":"2024-09-14T11:23:29.172654+0000","last_clean_scrub_stamp":"2024-09-14T11:23:29.172654+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:31.140458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":304,"num_read_kb":193,"num_write":101,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:06.121565+0000","last_change":"2024-09-14T11:11:42.582601+0000","last_active":"2024-09-14T11:20:06.121565+0000","last_peered":"2024-09-14T11:20:06.121565+0000","last_clean":"2024-09-14T11:20:06.121565+0000","last_became_active":"2024-09-14T11:11:42.582310+0000","last_became_peered":"2024-09-14T11:11:42.582310+0000","last_unstale":"2024-09-14T11:20:06.121565+0000","last_undegraded":"2024-09-14T11:20:06.121565+0000","last_fullsized":"2024-09-14T11:20:06.121565+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:47:53.329342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"260'8","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.421223+0000","last_change":"2024-09-14T11:01:23.888252+0000","last_active":"2024-09-14T11:22:50.421223+0000","last_peered":"2024-09-14T11:22:50.421223+0000","last_clean":"2024-09-14T11:22:50.421223+0000","last_became_active":"2024-09-14T11:01:23.888017+0000","last_became_peered":"2024-09-14T11:01:23.888017+0000","last_unstale":"2024-09-14T11:22:50.421223+0000","last_undegraded":"2024-09-14T11:22:50.421223+0000","last_fullsized":"2024-09-14T11:22:50.421223+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":11264,"num_write":18,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"257'2","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:47.123474+0000","last_change":"2024-09-14T11:01:20.863609+0000","last_active":"2024-09-14T11:20:47.123474+0000","last_peered":"2024-09-14T11:20:47.123474+0000","last_clean":"2024-09-14T11:20:47.123474+0000","last_became_active":"2024-09-14T11:01:20.863258+0000","last_became_peered":"2024-09-14T11:01:20.863258+0000","last_unstale":"2024-09-14T11:20:47.123474+0000","last_undegraded":"2024-09-14T11:20:47.123474+0000","last_fullsized":"2024-09-14T11:20:47.123474+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"260'62","reported_seq":223,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:27.335658+0000","last_change":"2024-09-14T11:23:27.335658+0000","last_active":"2024-09-14T11:23:27.335658+0000","last_peered":"2024-09-14T11:23:27.335658+0000","last_clean":"2024-09-14T11:23:27.335658+0000","last_became_active":"2024-09-14T10:59:48.419994+0000","last_became_peered":"2024-09-14T10:59:48.419994+0000","last_unstale":"2024-09-14T11:23:27.335658+0000","last_undegraded":"2024-09-14T11:23:27.335658+0000","last_fullsized":"2024-09-14T11:23:27.335658+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'62","last_scrub_stamp":"2024-09-14T11:23:27.335563+0000","last_deep_scrub":"260'62","last_deep_scrub_stamp":"2024-09-14T11:23:27.335563+0000","last_clean_scrub_stamp":"2024-09-14T11:23:27.335563+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:10.177468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":520,"num_read_kb":329,"num_write":161,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"260'1","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:14.986121+0000","last_change":"2024-09-14T11:11:42.588572+0000","last_active":"2024-09-14T11:19:14.986121+0000","last_peered":"2024-09-14T11:19:14.986121+0000","last_clean":"2024-09-14T11:19:14.986121+0000","last_became_active":"2024-09-14T11:11:42.588308+0000","last_became_peered":"2024-09-14T11:11:42.588308+0000","last_unstale":"2024-09-14T11:19:14.986121+0000","last_undegraded":"2024-09-14T11:19:14.986121+0000","last_fullsized":"2024-09-14T11:19:14.986121+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:38:16.020344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:54.982805+0000","last_change":"2024-09-14T11:01:23.884550+0000","last_active":"2024-09-14T11:18:54.982805+0000","last_peered":"2024-09-14T11:18:54.982805+0000","last_clean":"2024-09-14T11:18:54.982805+0000","last_became_active":"2024-09-14T11:01:23.884138+0000","last_became_peered":"2024-09-14T11:01:23.884138+0000","last_unstale":"2024-09-14T11:18:54.982805+0000","last_undegraded":"2024-09-14T11:18:54.982805+0000","last_fullsized":"2024-09-14T11:18:54.982805+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:10.655429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:23.553826+0000","last_change":"2024-09-14T11:23:23.553826+0000","last_active":"2024-09-14T11:23:23.553826+0000","last_peered":"2024-09-14T11:23:23.553826+0000","last_clean":"2024-09-14T11:23:23.553826+0000","last_became_active":"2024-09-14T11:01:20.854737+0000","last_became_peered":"2024-09-14T11:01:20.854737+0000","last_unstale":"2024-09-14T11:23:23.553826+0000","last_undegraded":"2024-09-14T11:23:23.553826+0000","last_fullsized":"2024-09-14T11:23:23.553826+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:23.553739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:23.553739+0000","last_clean_scrub_stamp":"2024-09-14T11:23:23.553739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:08.924782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"260'45","reported_seq":171,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:27.756122+0000","last_change":"2024-09-14T11:23:27.756122+0000","last_active":"2024-09-14T11:23:27.756122+0000","last_peered":"2024-09-14T11:23:27.756122+0000","last_clean":"2024-09-14T11:23:27.756122+0000","last_became_active":"2024-09-14T10:59:48.419091+0000","last_became_peered":"2024-09-14T10:59:48.419091+0000","last_unstale":"2024-09-14T11:23:27.756122+0000","last_undegraded":"2024-09-14T11:23:27.756122+0000","last_fullsized":"2024-09-14T11:23:27.756122+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'45","last_scrub_stamp":"2024-09-14T11:23:27.756027+0000","last_deep_scrub":"260'45","last_deep_scrub_stamp":"2024-09-14T11:23:27.756027+0000","last_clean_scrub_stamp":"2024-09-14T11:23:27.756027+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:51.744018+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":368,"num_read_kb":243,"num_write":109,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":25,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:31.538044+0000","last_change":"2024-09-14T11:23:31.538044+0000","last_active":"2024-09-14T11:23:31.538044+0000","last_peered":"2024-09-14T11:23:31.538044+0000","last_clean":"2024-09-14T11:23:31.538044+0000","last_became_active":"2024-09-14T11:11:42.582899+0000","last_became_peered":"2024-09-14T11:11:42.582899+0000","last_unstale":"2024-09-14T11:23:31.538044+0000","last_undegraded":"2024-09-14T11:23:31.538044+0000","last_fullsized":"2024-09-14T11:23:31.538044+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:31.537948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:31.537948+0000","last_clean_scrub_stamp":"2024-09-14T11:23:31.537948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:48.541182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:18:55.987589+0000","last_change":"2024-09-14T11:01:23.895643+0000","last_active":"2024-09-14T11:18:55.987589+0000","last_peered":"2024-09-14T11:18:55.987589+0000","last_clean":"2024-09-14T11:18:55.987589+0000","last_became_active":"2024-09-14T11:01:23.894587+0000","last_became_peered":"2024-09-14T11:01:23.894587+0000","last_unstale":"2024-09-14T11:18:55.987589+0000","last_undegraded":"2024-09-14T11:18:55.987589+0000","last_fullsized":"2024-09-14T11:18:55.987589+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:29.534046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"260'3","reported_seq":46,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:33.205078+0000","last_change":"2024-09-14T11:23:33.205078+0000","last_active":"2024-09-14T11:23:33.205078+0000","last_peered":"2024-09-14T11:23:33.205078+0000","last_clean":"2024-09-14T11:23:33.205078+0000","last_became_active":"2024-09-14T11:01:20.869244+0000","last_became_peered":"2024-09-14T11:01:20.869244+0000","last_unstale":"2024-09-14T11:23:33.205078+0000","last_undegraded":"2024-09-14T11:23:33.205078+0000","last_fullsized":"2024-09-14T11:23:33.205078+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T11:23:33.204965+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T11:23:33.204965+0000","last_clean_scrub_stamp":"2024-09-14T11:23:33.204965+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:14:10.951877+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"260'35","reported_seq":145,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:28.181239+0000","last_change":"2024-09-14T11:23:28.181239+0000","last_active":"2024-09-14T11:23:28.181239+0000","last_peered":"2024-09-14T11:23:28.181239+0000","last_clean":"2024-09-14T11:23:28.181239+0000","last_became_active":"2024-09-14T10:59:48.414023+0000","last_became_peered":"2024-09-14T10:59:48.414023+0000","last_unstale":"2024-09-14T11:23:28.181239+0000","last_undegraded":"2024-09-14T11:23:28.181239+0000","last_fullsized":"2024-09-14T11:23:28.181239+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'35","last_scrub_stamp":"2024-09-14T11:23:28.181143+0000","last_deep_scrub":"260'35","last_deep_scrub_stamp":"2024-09-14T11:23:28.181143+0000","last_clean_scrub_stamp":"2024-09-14T11:23:28.181143+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:57.692388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":284,"num_read_kb":189,"num_write":86,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:06.251797+0000","last_change":"2024-09-14T11:11:42.592957+0000","last_active":"2024-09-14T11:21:06.251797+0000","last_peered":"2024-09-14T11:21:06.251797+0000","last_clean":"2024-09-14T11:21:06.251797+0000","last_became_active":"2024-09-14T11:11:42.592439+0000","last_became_peered":"2024-09-14T11:11:42.592439+0000","last_unstale":"2024-09-14T11:21:06.251797+0000","last_undegraded":"2024-09-14T11:21:06.251797+0000","last_fullsized":"2024-09-14T11:21:06.251797+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"257'3","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:46.003045+0000","last_change":"2024-09-14T11:01:23.892350+0000","last_active":"2024-09-14T11:20:46.003045+0000","last_peered":"2024-09-14T11:20:46.003045+0000","last_clean":"2024-09-14T11:20:46.003045+0000","last_became_active":"2024-09-14T11:01:23.891631+0000","last_became_peered":"2024-09-14T11:01:23.891631+0000","last_unstale":"2024-09-14T11:20:46.003045+0000","last_undegraded":"2024-09-14T11:20:46.003045+0000","last_fullsized":"2024-09-14T11:20:46.003045+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"260'11","reported_seq":55,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.352736+0000","last_change":"2024-09-14T11:01:20.861317+0000","last_active":"2024-09-14T11:22:51.352736+0000","last_peered":"2024-09-14T11:22:51.352736+0000","last_clean":"2024-09-14T11:22:51.352736+0000","last_became_active":"2024-09-14T11:01:20.861043+0000","last_became_peered":"2024-09-14T11:01:20.861043+0000","last_unstale":"2024-09-14T11:22:51.352736+0000","last_undegraded":"2024-09-14T11:22:51.352736+0000","last_fullsized":"2024-09-14T11:22:51.352736+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:42.808761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":17410,"num_write":21,"num_write_kb":12290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"260'250","reported_seq":803,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:35.655510+0000","last_change":"2024-09-14T11:23:35.655510+0000","last_active":"2024-09-14T11:23:35.655510+0000","last_peered":"2024-09-14T11:23:35.655510+0000","last_clean":"2024-09-14T11:23:35.655510+0000","last_became_active":"2024-09-14T10:59:48.416342+0000","last_became_peered":"2024-09-14T10:59:48.416342+0000","last_unstale":"2024-09-14T11:23:35.655510+0000","last_undegraded":"2024-09-14T11:23:35.655510+0000","last_fullsized":"2024-09-14T11:23:35.655510+0000","mapping_epoch":249,"log_start":"257'200","ondisk_log_start":"257'200","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'250","last_scrub_stamp":"2024-09-14T11:23:35.655429+0000","last_deep_scrub":"260'250","last_deep_scrub_stamp":"2024-09-14T11:23:35.655429+0000","last_clean_scrub_stamp":"2024-09-14T11:23:35.655429+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:00:13.084282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2428,"num_read_kb":2819,"num_write":491,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"260'1","reported_seq":19,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:05.997593+0000","last_change":"2024-09-14T11:11:42.588570+0000","last_active":"2024-09-14T11:21:05.997593+0000","last_peered":"2024-09-14T11:21:05.997593+0000","last_clean":"2024-09-14T11:21:05.997593+0000","last_became_active":"2024-09-14T11:11:42.587835+0000","last_became_peered":"2024-09-14T11:11:42.587835+0000","last_unstale":"2024-09-14T11:21:05.997593+0000","last_undegraded":"2024-09-14T11:21:05.997593+0000","last_fullsized":"2024-09-14T11:21:05.997593+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"260'3","reported_seq":33,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:26.263799+0000","last_change":"2024-09-14T11:01:23.895555+0000","last_active":"2024-09-14T11:22:26.263799+0000","last_peered":"2024-09-14T11:22:26.263799+0000","last_clean":"2024-09-14T11:22:26.263799+0000","last_became_active":"2024-09-14T11:01:23.892735+0000","last_became_peered":"2024-09-14T11:01:23.892735+0000","last_unstale":"2024-09-14T11:22:26.263799+0000","last_undegraded":"2024-09-14T11:22:26.263799+0000","last_fullsized":"2024-09-14T11:22:26.263799+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:20.552471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"260'4","reported_seq":49,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:22.598035+0000","last_change":"2024-09-14T11:23:22.598035+0000","last_active":"2024-09-14T11:23:22.598035+0000","last_peered":"2024-09-14T11:23:22.598035+0000","last_clean":"2024-09-14T11:23:22.598035+0000","last_became_active":"2024-09-14T11:01:20.860541+0000","last_became_peered":"2024-09-14T11:01:20.860541+0000","last_unstale":"2024-09-14T11:23:22.598035+0000","last_undegraded":"2024-09-14T11:23:22.598035+0000","last_fullsized":"2024-09-14T11:23:22.598035+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-14T11:23:22.597945+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-14T11:23:22.597945+0000","last_clean_scrub_stamp":"2024-09-14T11:23:22.597945+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:04.581022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":61,"num_write":4,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"260'12","reported_seq":84,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:34.637055+0000","last_change":"2024-09-14T11:23:34.637055+0000","last_active":"2024-09-14T11:23:34.637055+0000","last_peered":"2024-09-14T11:23:34.637055+0000","last_clean":"2024-09-14T11:23:34.637055+0000","last_became_active":"2024-09-14T10:59:48.417001+0000","last_became_peered":"2024-09-14T10:59:48.417001+0000","last_unstale":"2024-09-14T11:23:34.637055+0000","last_undegraded":"2024-09-14T11:23:34.637055+0000","last_fullsized":"2024-09-14T11:23:34.637055+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'12","last_scrub_stamp":"2024-09-14T11:23:34.636971+0000","last_deep_scrub":"260'12","last_deep_scrub_stamp":"2024-09-14T11:23:34.636971+0000","last_clean_scrub_stamp":"2024-09-14T11:23:34.636971+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:10.187396+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":70,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:04.999871+0000","last_change":"2024-09-14T11:11:42.594143+0000","last_active":"2024-09-14T11:21:04.999871+0000","last_peered":"2024-09-14T11:21:04.999871+0000","last_clean":"2024-09-14T11:21:04.999871+0000","last_became_active":"2024-09-14T11:11:42.593873+0000","last_became_peered":"2024-09-14T11:11:42.593873+0000","last_unstale":"2024-09-14T11:21:04.999871+0000","last_undegraded":"2024-09-14T11:21:04.999871+0000","last_fullsized":"2024-09-14T11:21:04.999871+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:46.003098+0000","last_change":"2024-09-14T11:01:23.897460+0000","last_active":"2024-09-14T11:20:46.003098+0000","last_peered":"2024-09-14T11:20:46.003098+0000","last_clean":"2024-09-14T11:20:46.003098+0000","last_became_active":"2024-09-14T11:01:23.897154+0000","last_became_peered":"2024-09-14T11:01:23.897154+0000","last_unstale":"2024-09-14T11:20:46.003098+0000","last_undegraded":"2024-09-14T11:20:46.003098+0000","last_fullsized":"2024-09-14T11:20:46.003098+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"260'2","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:33.842422+0000","last_change":"2024-09-14T11:23:33.842422+0000","last_active":"2024-09-14T11:23:33.842422+0000","last_peered":"2024-09-14T11:23:33.842422+0000","last_clean":"2024-09-14T11:23:33.842422+0000","last_became_active":"2024-09-14T11:01:20.868135+0000","last_became_peered":"2024-09-14T11:01:20.868135+0000","last_unstale":"2024-09-14T11:23:33.842422+0000","last_undegraded":"2024-09-14T11:23:33.842422+0000","last_fullsized":"2024-09-14T11:23:33.842422+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:23:33.842335+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:23:33.842335+0000","last_clean_scrub_stamp":"2024-09-14T11:23:33.842335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:46.268446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"260'27","reported_seq":121,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:28.800888+0000","last_change":"2024-09-14T11:23:28.800888+0000","last_active":"2024-09-14T11:23:28.800888+0000","last_peered":"2024-09-14T11:23:28.800888+0000","last_clean":"2024-09-14T11:23:28.800888+0000","last_became_active":"2024-09-14T10:59:48.415324+0000","last_became_peered":"2024-09-14T10:59:48.415324+0000","last_unstale":"2024-09-14T11:23:28.800888+0000","last_undegraded":"2024-09-14T11:23:28.800888+0000","last_fullsized":"2024-09-14T11:23:28.800888+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'27","last_scrub_stamp":"2024-09-14T11:23:28.800763+0000","last_deep_scrub":"260'27","last_deep_scrub_stamp":"2024-09-14T11:23:28.800763+0000","last_clean_scrub_stamp":"2024-09-14T11:23:28.800763+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:44.358336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":136,"num_write":70,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:32.551128+0000","last_change":"2024-09-14T11:23:32.551128+0000","last_active":"2024-09-14T11:23:32.551128+0000","last_peered":"2024-09-14T11:23:32.551128+0000","last_clean":"2024-09-14T11:23:32.551128+0000","last_became_active":"2024-09-14T11:11:42.591815+0000","last_became_peered":"2024-09-14T11:11:42.591815+0000","last_unstale":"2024-09-14T11:23:32.551128+0000","last_undegraded":"2024-09-14T11:23:32.551128+0000","last_fullsized":"2024-09-14T11:23:32.551128+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:32.551039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:32.551039+0000","last_clean_scrub_stamp":"2024-09-14T11:23:32.551039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:29.945074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"260'3","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:26.541198+0000","last_change":"2024-09-14T11:23:26.541198+0000","last_active":"2024-09-14T11:23:26.541198+0000","last_peered":"2024-09-14T11:23:26.541198+0000","last_clean":"2024-09-14T11:23:26.541198+0000","last_became_active":"2024-09-14T11:01:23.883763+0000","last_became_peered":"2024-09-14T11:01:23.883763+0000","last_unstale":"2024-09-14T11:23:26.541198+0000","last_undegraded":"2024-09-14T11:23:26.541198+0000","last_fullsized":"2024-09-14T11:23:26.541198+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T11:23:26.541105+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T11:23:26.541105+0000","last_clean_scrub_stamp":"2024-09-14T11:23:26.541105+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:04.376193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"260'5","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.419036+0000","last_change":"2024-09-14T11:01:20.867156+0000","last_active":"2024-09-14T11:22:51.419036+0000","last_peered":"2024-09-14T11:22:51.419036+0000","last_clean":"2024-09-14T11:22:51.419036+0000","last_became_active":"2024-09-14T11:01:20.866642+0000","last_became_peered":"2024-09-14T11:01:20.866642+0000","last_unstale":"2024-09-14T11:22:51.419036+0000","last_undegraded":"2024-09-14T11:22:51.419036+0000","last_fullsized":"2024-09-14T11:22:51.419036+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":13312,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"260'32","reported_seq":128,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:57.125168+0000","last_change":"2024-09-14T10:59:48.418606+0000","last_active":"2024-09-14T11:20:57.125168+0000","last_peered":"2024-09-14T11:20:57.125168+0000","last_clean":"2024-09-14T11:20:57.125168+0000","last_became_active":"2024-09-14T10:59:48.418305+0000","last_became_peered":"2024-09-14T10:59:48.418305+0000","last_unstale":"2024-09-14T11:20:57.125168+0000","last_undegraded":"2024-09-14T11:20:57.125168+0000","last_fullsized":"2024-09-14T11:20:57.125168+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":251,"num_read_kb":158,"num_write":84,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:01.233757+0000","last_change":"2024-09-14T11:11:42.588989+0000","last_active":"2024-09-14T11:19:01.233757+0000","last_peered":"2024-09-14T11:19:01.233757+0000","last_clean":"2024-09-14T11:19:01.233757+0000","last_became_active":"2024-09-14T11:11:42.588573+0000","last_became_peered":"2024-09-14T11:11:42.588573+0000","last_unstale":"2024-09-14T11:19:01.233757+0000","last_undegraded":"2024-09-14T11:19:01.233757+0000","last_fullsized":"2024-09-14T11:19:01.233757+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:44.929396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:06.243683+0000","last_change":"2024-09-14T11:01:23.895357+0000","last_active":"2024-09-14T11:20:06.243683+0000","last_peered":"2024-09-14T11:20:06.243683+0000","last_clean":"2024-09-14T11:20:06.243683+0000","last_became_active":"2024-09-14T11:01:23.894751+0000","last_became_peered":"2024-09-14T11:01:23.894751+0000","last_unstale":"2024-09-14T11:20:06.243683+0000","last_undegraded":"2024-09-14T11:20:06.243683+0000","last_fullsized":"2024-09-14T11:20:06.243683+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:22:05.395992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:28.499763+0000","last_change":"2024-09-14T11:23:28.499763+0000","last_active":"2024-09-14T11:23:28.499763+0000","last_peered":"2024-09-14T11:23:28.499763+0000","last_clean":"2024-09-14T11:23:28.499763+0000","last_became_active":"2024-09-14T11:01:20.866975+0000","last_became_peered":"2024-09-14T11:01:20.866975+0000","last_unstale":"2024-09-14T11:23:28.499763+0000","last_undegraded":"2024-09-14T11:23:28.499763+0000","last_fullsized":"2024-09-14T11:23:28.499763+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:28.499680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:28.499680+0000","last_clean_scrub_stamp":"2024-09-14T11:23:28.499680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:14.266221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"260'17","reported_seq":83,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:52.124452+0000","last_change":"2024-09-14T10:59:48.421015+0000","last_active":"2024-09-14T11:20:52.124452+0000","last_peered":"2024-09-14T11:20:52.124452+0000","last_clean":"2024-09-14T11:20:52.124452+0000","last_became_active":"2024-09-14T10:59:48.420711+0000","last_became_peered":"2024-09-14T10:59:48.420711+0000","last_unstale":"2024-09-14T11:20:52.124452+0000","last_undegraded":"2024-09-14T11:20:52.124452+0000","last_fullsized":"2024-09-14T11:20:52.124452+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":78,"num_write":43,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":17,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:00.982102+0000","last_change":"2024-09-14T11:11:42.585332+0000","last_active":"2024-09-14T11:19:00.982102+0000","last_peered":"2024-09-14T11:19:00.982102+0000","last_clean":"2024-09-14T11:19:00.982102+0000","last_became_active":"2024-09-14T11:11:42.583965+0000","last_became_peered":"2024-09-14T11:11:42.583965+0000","last_unstale":"2024-09-14T11:19:00.982102+0000","last_undegraded":"2024-09-14T11:19:00.982102+0000","last_fullsized":"2024-09-14T11:19:00.982102+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:45:52.531506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"257'5","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:06.243650+0000","last_change":"2024-09-14T11:01:23.893658+0000","last_active":"2024-09-14T11:20:06.243650+0000","last_peered":"2024-09-14T11:20:06.243650+0000","last_clean":"2024-09-14T11:20:06.243650+0000","last_became_active":"2024-09-14T11:01:23.893365+0000","last_became_peered":"2024-09-14T11:01:23.893365+0000","last_unstale":"2024-09-14T11:20:06.243650+0000","last_undegraded":"2024-09-14T11:20:06.243650+0000","last_fullsized":"2024-09-14T11:20:06.243650+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:10:44.395112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"260'3","reported_seq":37,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:21.262930+0000","last_change":"2024-09-14T11:01:20.869472+0000","last_active":"2024-09-14T11:22:21.262930+0000","last_peered":"2024-09-14T11:22:21.262930+0000","last_clean":"2024-09-14T11:22:21.262930+0000","last_became_active":"2024-09-14T11:01:20.869209+0000","last_became_peered":"2024-09-14T11:01:20.869209+0000","last_unstale":"2024-09-14T11:22:21.262930+0000","last_undegraded":"2024-09-14T11:22:21.262930+0000","last_fullsized":"2024-09-14T11:22:21.262930+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:54.924564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"260'35","reported_seq":145,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:25.748484+0000","last_change":"2024-09-14T11:23:25.748484+0000","last_active":"2024-09-14T11:23:25.748484+0000","last_peered":"2024-09-14T11:23:25.748484+0000","last_clean":"2024-09-14T11:23:25.748484+0000","last_became_active":"2024-09-14T10:59:48.416149+0000","last_became_peered":"2024-09-14T10:59:48.416149+0000","last_unstale":"2024-09-14T11:23:25.748484+0000","last_undegraded":"2024-09-14T11:23:25.748484+0000","last_fullsized":"2024-09-14T11:23:25.748484+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'35","last_scrub_stamp":"2024-09-14T11:23:25.748399+0000","last_deep_scrub":"260'35","last_deep_scrub_stamp":"2024-09-14T11:23:25.748399+0000","last_clean_scrub_stamp":"2024-09-14T11:23:25.748399+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:42.195292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":285,"num_read_kb":193,"num_write":82,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"259'1","reported_seq":19,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:06.129165+0000","last_change":"2024-09-14T11:11:42.584334+0000","last_active":"2024-09-14T11:21:06.129165+0000","last_peered":"2024-09-14T11:21:06.129165+0000","last_clean":"2024-09-14T11:21:06.129165+0000","last_became_active":"2024-09-14T11:11:42.583477+0000","last_became_peered":"2024-09-14T11:11:42.583477+0000","last_unstale":"2024-09-14T11:21:06.129165+0000","last_undegraded":"2024-09-14T11:21:06.129165+0000","last_fullsized":"2024-09-14T11:21:06.129165+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"260'8","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:26.017279+0000","last_change":"2024-09-14T11:01:23.891615+0000","last_active":"2024-09-14T11:22:26.017279+0000","last_peered":"2024-09-14T11:22:26.017279+0000","last_clean":"2024-09-14T11:22:26.017279+0000","last_became_active":"2024-09-14T11:01:23.891343+0000","last_became_peered":"2024-09-14T11:01:23.891343+0000","last_unstale":"2024-09-14T11:22:26.017279+0000","last_undegraded":"2024-09-14T11:22:26.017279+0000","last_fullsized":"2024-09-14T11:22:26.017279+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:37.853683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":15362,"num_write":13,"num_write_kb":10242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"260'3","reported_seq":47,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:29.500998+0000","last_change":"2024-09-14T11:23:29.500998+0000","last_active":"2024-09-14T11:23:29.500998+0000","last_peered":"2024-09-14T11:23:29.500998+0000","last_clean":"2024-09-14T11:23:29.500998+0000","last_became_active":"2024-09-14T11:01:20.861817+0000","last_became_peered":"2024-09-14T11:01:20.861817+0000","last_unstale":"2024-09-14T11:23:29.500998+0000","last_undegraded":"2024-09-14T11:23:29.500998+0000","last_fullsized":"2024-09-14T11:23:29.500998+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T11:23:29.500892+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T11:23:29.500892+0000","last_clean_scrub_stamp":"2024-09-14T11:23:29.500892+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:56:46.263750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"260'106","reported_seq":370,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:30.287346+0000","last_change":"2024-09-14T11:23:30.287346+0000","last_active":"2024-09-14T11:23:30.287346+0000","last_peered":"2024-09-14T11:23:30.287346+0000","last_clean":"2024-09-14T11:23:30.287346+0000","last_became_active":"2024-09-14T10:59:48.418011+0000","last_became_peered":"2024-09-14T10:59:48.418011+0000","last_unstale":"2024-09-14T11:23:30.287346+0000","last_undegraded":"2024-09-14T11:23:30.287346+0000","last_fullsized":"2024-09-14T11:23:30.287346+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'106","last_scrub_stamp":"2024-09-14T11:23:30.287247+0000","last_deep_scrub":"260'106","last_deep_scrub_stamp":"2024-09-14T11:23:30.287247+0000","last_clean_scrub_stamp":"2024-09-14T11:23:30.287247+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:42.685812+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1045,"num_read_kb":858,"num_write":220,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"260'1","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:00.982068+0000","last_change":"2024-09-14T11:11:42.580964+0000","last_active":"2024-09-14T11:19:00.982068+0000","last_peered":"2024-09-14T11:19:00.982068+0000","last_clean":"2024-09-14T11:19:00.982068+0000","last_became_active":"2024-09-14T11:11:42.580611+0000","last_became_peered":"2024-09-14T11:11:42.580611+0000","last_unstale":"2024-09-14T11:19:00.982068+0000","last_undegraded":"2024-09-14T11:19:00.982068+0000","last_fullsized":"2024-09-14T11:19:00.982068+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:24.715816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:07.117668+0000","last_change":"2024-09-14T11:01:23.886701+0000","last_active":"2024-09-14T11:20:07.117668+0000","last_peered":"2024-09-14T11:20:07.117668+0000","last_clean":"2024-09-14T11:20:07.117668+0000","last_became_active":"2024-09-14T11:01:23.886496+0000","last_became_peered":"2024-09-14T11:01:23.886496+0000","last_unstale":"2024-09-14T11:20:07.117668+0000","last_undegraded":"2024-09-14T11:20:07.117668+0000","last_fullsized":"2024-09-14T11:20:07.117668+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:46.277781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"257'3","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:30.486327+0000","last_change":"2024-09-14T11:23:30.486327+0000","last_active":"2024-09-14T11:23:30.486327+0000","last_peered":"2024-09-14T11:23:30.486327+0000","last_clean":"2024-09-14T11:23:30.486327+0000","last_became_active":"2024-09-14T11:01:20.863707+0000","last_became_peered":"2024-09-14T11:01:20.863707+0000","last_unstale":"2024-09-14T11:23:30.486327+0000","last_undegraded":"2024-09-14T11:23:30.486327+0000","last_fullsized":"2024-09-14T11:23:30.486327+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'3","last_scrub_stamp":"2024-09-14T11:23:30.486239+0000","last_deep_scrub":"257'3","last_deep_scrub_stamp":"2024-09-14T11:23:30.486239+0000","last_clean_scrub_stamp":"2024-09-14T11:23:30.486239+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:12.831780+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"260'54","reported_seq":199,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:31.762730+0000","last_change":"2024-09-14T11:23:31.762730+0000","last_active":"2024-09-14T11:23:31.762730+0000","last_peered":"2024-09-14T11:23:31.762730+0000","last_clean":"2024-09-14T11:23:31.762730+0000","last_became_active":"2024-09-14T10:59:48.421875+0000","last_became_peered":"2024-09-14T10:59:48.421875+0000","last_unstale":"2024-09-14T11:23:31.762730+0000","last_undegraded":"2024-09-14T11:23:31.762730+0000","last_fullsized":"2024-09-14T11:23:31.762730+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'54","last_scrub_stamp":"2024-09-14T11:23:31.762641+0000","last_deep_scrub":"260'54","last_deep_scrub_stamp":"2024-09-14T11:23:31.762641+0000","last_clean_scrub_stamp":"2024-09-14T11:23:31.762641+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:50.111431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":456,"num_read_kb":308,"num_write":139,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:26.246099+0000","last_change":"2024-09-14T11:11:42.590323+0000","last_active":"2024-09-14T11:20:26.246099+0000","last_peered":"2024-09-14T11:20:26.246099+0000","last_clean":"2024-09-14T11:20:26.246099+0000","last_became_active":"2024-09-14T11:11:42.590056+0000","last_became_peered":"2024-09-14T11:11:42.590056+0000","last_unstale":"2024-09-14T11:20:26.246099+0000","last_undegraded":"2024-09-14T11:20:26.246099+0000","last_fullsized":"2024-09-14T11:20:26.246099+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:24.964712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"260'2","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:41.010434+0000","last_change":"2024-09-14T11:01:23.892070+0000","last_active":"2024-09-14T11:21:41.010434+0000","last_peered":"2024-09-14T11:21:41.010434+0000","last_clean":"2024-09-14T11:21:41.010434+0000","last_became_active":"2024-09-14T11:01:23.891331+0000","last_became_peered":"2024-09-14T11:01:23.891331+0000","last_unstale":"2024-09-14T11:21:41.010434+0000","last_undegraded":"2024-09-14T11:21:41.010434+0000","last_fullsized":"2024-09-14T11:21:41.010434+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:08:04.829621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:29.268097+0000","last_change":"2024-09-14T11:23:29.268097+0000","last_active":"2024-09-14T11:23:29.268097+0000","last_peered":"2024-09-14T11:23:29.268097+0000","last_clean":"2024-09-14T11:23:29.268097+0000","last_became_active":"2024-09-14T11:01:20.863144+0000","last_became_peered":"2024-09-14T11:01:20.863144+0000","last_unstale":"2024-09-14T11:23:29.268097+0000","last_undegraded":"2024-09-14T11:23:29.268097+0000","last_fullsized":"2024-09-14T11:23:29.268097+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:29.268016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:29.268016+0000","last_clean_scrub_stamp":"2024-09-14T11:23:29.268016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:08.406619+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"260'19","reported_seq":99,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:26.783961+0000","last_change":"2024-09-14T11:23:26.783961+0000","last_active":"2024-09-14T11:23:26.783961+0000","last_peered":"2024-09-14T11:23:26.783961+0000","last_clean":"2024-09-14T11:23:26.783961+0000","last_became_active":"2024-09-14T10:59:48.416902+0000","last_became_peered":"2024-09-14T10:59:48.416902+0000","last_unstale":"2024-09-14T11:23:26.783961+0000","last_undegraded":"2024-09-14T11:23:26.783961+0000","last_fullsized":"2024-09-14T11:23:26.783961+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'19","last_scrub_stamp":"2024-09-14T11:23:26.783854+0000","last_deep_scrub":"260'19","last_deep_scrub_stamp":"2024-09-14T11:23:26.783854+0000","last_clean_scrub_stamp":"2024-09-14T11:23:26.783854+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:07:29.823839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":98,"num_write":49,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:34.568936+0000","last_change":"2024-09-14T11:23:34.568936+0000","last_active":"2024-09-14T11:23:34.568936+0000","last_peered":"2024-09-14T11:23:34.568936+0000","last_clean":"2024-09-14T11:23:34.568936+0000","last_became_active":"2024-09-14T11:11:42.589071+0000","last_became_peered":"2024-09-14T11:11:42.589071+0000","last_unstale":"2024-09-14T11:23:34.568936+0000","last_undegraded":"2024-09-14T11:23:34.568936+0000","last_fullsized":"2024-09-14T11:23:34.568936+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:34.568817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:34.568817+0000","last_clean_scrub_stamp":"2024-09-14T11:23:34.568817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:22.227509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:25.992224+0000","last_change":"2024-09-14T11:01:23.893015+0000","last_active":"2024-09-14T11:19:25.992224+0000","last_peered":"2024-09-14T11:19:25.992224+0000","last_clean":"2024-09-14T11:19:25.992224+0000","last_became_active":"2024-09-14T11:01:23.892761+0000","last_became_peered":"2024-09-14T11:01:23.892761+0000","last_unstale":"2024-09-14T11:19:25.992224+0000","last_undegraded":"2024-09-14T11:19:25.992224+0000","last_fullsized":"2024-09-14T11:19:25.992224+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:06.763249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:34.247044+0000","last_change":"2024-09-14T11:23:34.247044+0000","last_active":"2024-09-14T11:23:34.247044+0000","last_peered":"2024-09-14T11:23:34.247044+0000","last_clean":"2024-09-14T11:23:34.247044+0000","last_became_active":"2024-09-14T11:01:20.866224+0000","last_became_peered":"2024-09-14T11:01:20.866224+0000","last_unstale":"2024-09-14T11:23:34.247044+0000","last_undegraded":"2024-09-14T11:23:34.247044+0000","last_fullsized":"2024-09-14T11:23:34.247044+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:34.246933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:34.246933+0000","last_clean_scrub_stamp":"2024-09-14T11:23:34.246933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:33.947768+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"260'30","reported_seq":122,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:07.117741+0000","last_change":"2024-09-14T10:59:48.416632+0000","last_active":"2024-09-14T11:20:07.117741+0000","last_peered":"2024-09-14T11:20:07.117741+0000","last_clean":"2024-09-14T11:20:07.117741+0000","last_became_active":"2024-09-14T10:59:48.415922+0000","last_became_peered":"2024-09-14T10:59:48.415922+0000","last_unstale":"2024-09-14T11:20:07.117741+0000","last_undegraded":"2024-09-14T11:20:07.117741+0000","last_fullsized":"2024-09-14T11:20:07.117741+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:37.136039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":240,"num_read_kb":165,"num_write":74,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:22.119393+0000","last_change":"2024-09-14T11:11:42.591303+0000","last_active":"2024-09-14T11:20:22.119393+0000","last_peered":"2024-09-14T11:20:22.119393+0000","last_clean":"2024-09-14T11:20:22.119393+0000","last_became_active":"2024-09-14T11:11:42.589881+0000","last_became_peered":"2024-09-14T11:11:42.589881+0000","last_unstale":"2024-09-14T11:20:22.119393+0000","last_undegraded":"2024-09-14T11:20:22.119393+0000","last_fullsized":"2024-09-14T11:20:22.119393+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:53.799897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"257'8","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:30.993019+0000","last_change":"2024-09-14T11:01:23.897536+0000","last_active":"2024-09-14T11:19:30.993019+0000","last_peered":"2024-09-14T11:19:30.993019+0000","last_clean":"2024-09-14T11:19:30.993019+0000","last_became_active":"2024-09-14T11:01:23.897158+0000","last_became_peered":"2024-09-14T11:01:23.897158+0000","last_unstale":"2024-09-14T11:19:30.993019+0000","last_undegraded":"2024-09-14T11:19:30.993019+0000","last_fullsized":"2024-09-14T11:19:30.993019+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:34.363585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6146,"num_write":18,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:32.793230+0000","last_change":"2024-09-14T11:23:32.793230+0000","last_active":"2024-09-14T11:23:32.793230+0000","last_peered":"2024-09-14T11:23:32.793230+0000","last_clean":"2024-09-14T11:23:32.793230+0000","last_became_active":"2024-09-14T11:01:20.863999+0000","last_became_peered":"2024-09-14T11:01:20.863999+0000","last_unstale":"2024-09-14T11:23:32.793230+0000","last_undegraded":"2024-09-14T11:23:32.793230+0000","last_fullsized":"2024-09-14T11:23:32.793230+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:32.793147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:32.793147+0000","last_clean_scrub_stamp":"2024-09-14T11:23:32.793147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:56.481901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"260'46","reported_seq":167,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:26.533025+0000","last_change":"2024-09-14T11:23:26.533025+0000","last_active":"2024-09-14T11:23:26.533025+0000","last_peered":"2024-09-14T11:23:26.533025+0000","last_clean":"2024-09-14T11:23:26.533025+0000","last_became_active":"2024-09-14T10:59:48.418276+0000","last_became_peered":"2024-09-14T10:59:48.418276+0000","last_unstale":"2024-09-14T11:23:26.533025+0000","last_undegraded":"2024-09-14T11:23:26.533025+0000","last_fullsized":"2024-09-14T11:23:26.533025+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'46","last_scrub_stamp":"2024-09-14T11:23:26.532942+0000","last_deep_scrub":"260'46","last_deep_scrub_stamp":"2024-09-14T11:23:26.532942+0000","last_clean_scrub_stamp":"2024-09-14T11:23:26.532942+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:21.614848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":345,"num_read_kb":231,"num_write":118,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:33.554050+0000","last_change":"2024-09-14T11:23:33.554050+0000","last_active":"2024-09-14T11:23:33.554050+0000","last_peered":"2024-09-14T11:23:33.554050+0000","last_clean":"2024-09-14T11:23:33.554050+0000","last_became_active":"2024-09-14T11:11:42.586852+0000","last_became_peered":"2024-09-14T11:11:42.586852+0000","last_unstale":"2024-09-14T11:23:33.554050+0000","last_undegraded":"2024-09-14T11:23:33.554050+0000","last_fullsized":"2024-09-14T11:23:33.554050+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:33.553963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:33.553963+0000","last_clean_scrub_stamp":"2024-09-14T11:23:33.553963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:45.000426+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"257'3","reported_seq":34,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:26.237592+0000","last_change":"2024-09-14T11:01:23.887413+0000","last_active":"2024-09-14T11:19:26.237592+0000","last_peered":"2024-09-14T11:19:26.237592+0000","last_clean":"2024-09-14T11:19:26.237592+0000","last_became_active":"2024-09-14T11:01:23.887167+0000","last_became_peered":"2024-09-14T11:01:23.887167+0000","last_unstale":"2024-09-14T11:19:26.237592+0000","last_undegraded":"2024-09-14T11:19:26.237592+0000","last_fullsized":"2024-09-14T11:19:26.237592+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:36:46.808831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"260'6","reported_seq":52,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:34.820025+0000","last_change":"2024-09-14T11:23:34.820025+0000","last_active":"2024-09-14T11:23:34.820025+0000","last_peered":"2024-09-14T11:23:34.820025+0000","last_clean":"2024-09-14T11:23:34.820025+0000","last_became_active":"2024-09-14T11:01:20.857645+0000","last_became_peered":"2024-09-14T11:01:20.857645+0000","last_unstale":"2024-09-14T11:23:34.820025+0000","last_undegraded":"2024-09-14T11:23:34.820025+0000","last_fullsized":"2024-09-14T11:23:34.820025+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-14T11:23:34.819943+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-14T11:23:34.819943+0000","last_clean_scrub_stamp":"2024-09-14T11:23:34.819943+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:11.438379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"260'22","reported_seq":109,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:27.230474+0000","last_change":"2024-09-14T11:23:27.230474+0000","last_active":"2024-09-14T11:23:27.230474+0000","last_peered":"2024-09-14T11:23:27.230474+0000","last_clean":"2024-09-14T11:23:27.230474+0000","last_became_active":"2024-09-14T10:59:48.413425+0000","last_became_peered":"2024-09-14T10:59:48.413425+0000","last_unstale":"2024-09-14T11:23:27.230474+0000","last_undegraded":"2024-09-14T11:23:27.230474+0000","last_fullsized":"2024-09-14T11:23:27.230474+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'22","last_scrub_stamp":"2024-09-14T11:23:27.230391+0000","last_deep_scrub":"260'22","last_deep_scrub_stamp":"2024-09-14T11:23:27.230391+0000","last_clean_scrub_stamp":"2024-09-14T11:23:27.230391+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:16:44.679862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":100,"num_write":57,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:46.249037+0000","last_change":"2024-09-14T11:11:42.588149+0000","last_active":"2024-09-14T11:20:46.249037+0000","last_peered":"2024-09-14T11:20:46.249037+0000","last_clean":"2024-09-14T11:20:46.249037+0000","last_became_active":"2024-09-14T11:11:42.587906+0000","last_became_peered":"2024-09-14T11:11:42.587906+0000","last_unstale":"2024-09-14T11:20:46.249037+0000","last_undegraded":"2024-09-14T11:20:46.249037+0000","last_fullsized":"2024-09-14T11:20:46.249037+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":29,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:57.125108+0000","last_change":"2024-09-14T11:01:23.891705+0000","last_active":"2024-09-14T11:20:57.125108+0000","last_peered":"2024-09-14T11:20:57.125108+0000","last_clean":"2024-09-14T11:20:57.125108+0000","last_became_active":"2024-09-14T11:01:23.891424+0000","last_became_peered":"2024-09-14T11:01:23.891424+0000","last_unstale":"2024-09-14T11:20:57.125108+0000","last_undegraded":"2024-09-14T11:20:57.125108+0000","last_fullsized":"2024-09-14T11:20:57.125108+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"260'5","reported_seq":52,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:29.788739+0000","last_change":"2024-09-14T11:23:29.788739+0000","last_active":"2024-09-14T11:23:29.788739+0000","last_peered":"2024-09-14T11:23:29.788739+0000","last_clean":"2024-09-14T11:23:29.788739+0000","last_became_active":"2024-09-14T11:01:20.863936+0000","last_became_peered":"2024-09-14T11:01:20.863936+0000","last_unstale":"2024-09-14T11:23:29.788739+0000","last_undegraded":"2024-09-14T11:23:29.788739+0000","last_fullsized":"2024-09-14T11:23:29.788739+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-14T11:23:29.788622+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-14T11:23:29.788622+0000","last_clean_scrub_stamp":"2024-09-14T11:23:29.788622+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:05.759708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"260'14","reported_seq":88,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:26.275701+0000","last_change":"2024-09-14T11:23:26.275701+0000","last_active":"2024-09-14T11:23:26.275701+0000","last_peered":"2024-09-14T11:23:26.275701+0000","last_clean":"2024-09-14T11:23:26.275701+0000","last_became_active":"2024-09-14T10:59:48.413255+0000","last_became_peered":"2024-09-14T10:59:48.413255+0000","last_unstale":"2024-09-14T11:23:26.275701+0000","last_undegraded":"2024-09-14T11:23:26.275701+0000","last_fullsized":"2024-09-14T11:23:26.275701+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'14","last_scrub_stamp":"2024-09-14T11:23:26.275618+0000","last_deep_scrub":"260'14","last_deep_scrub_stamp":"2024-09-14T11:23:26.275618+0000","last_clean_scrub_stamp":"2024-09-14T11:23:26.275618+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:48.948088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":78,"num_write":38,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:34.334249+0000","last_change":"2024-09-14T11:23:34.334249+0000","last_active":"2024-09-14T11:23:34.334249+0000","last_peered":"2024-09-14T11:23:34.334249+0000","last_clean":"2024-09-14T11:23:34.334249+0000","last_became_active":"2024-09-14T11:11:42.588120+0000","last_became_peered":"2024-09-14T11:11:42.588120+0000","last_unstale":"2024-09-14T11:23:34.334249+0000","last_undegraded":"2024-09-14T11:23:34.334249+0000","last_fullsized":"2024-09-14T11:23:34.334249+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:34.334161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:34.334161+0000","last_clean_scrub_stamp":"2024-09-14T11:23:34.334161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:38.062050+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"257'3","reported_seq":35,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:54.998860+0000","last_change":"2024-09-14T11:01:23.889191+0000","last_active":"2024-09-14T11:20:54.998860+0000","last_peered":"2024-09-14T11:20:54.998860+0000","last_clean":"2024-09-14T11:20:54.998860+0000","last_became_active":"2024-09-14T11:01:23.888873+0000","last_became_peered":"2024-09-14T11:01:23.888873+0000","last_unstale":"2024-09-14T11:20:54.998860+0000","last_undegraded":"2024-09-14T11:20:54.998860+0000","last_fullsized":"2024-09-14T11:20:54.998860+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":35,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:51.249645+0000","last_change":"2024-09-14T11:01:20.867172+0000","last_active":"2024-09-14T11:20:51.249645+0000","last_peered":"2024-09-14T11:20:51.249645+0000","last_clean":"2024-09-14T11:20:51.249645+0000","last_became_active":"2024-09-14T11:01:20.865953+0000","last_became_peered":"2024-09-14T11:01:20.865953+0000","last_unstale":"2024-09-14T11:20:51.249645+0000","last_undegraded":"2024-09-14T11:20:51.249645+0000","last_fullsized":"2024-09-14T11:20:51.249645+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"260'22","reported_seq":106,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:24.373706+0000","last_change":"2024-09-14T11:23:24.373706+0000","last_active":"2024-09-14T11:23:24.373706+0000","last_peered":"2024-09-14T11:23:24.373706+0000","last_clean":"2024-09-14T11:23:24.373706+0000","last_became_active":"2024-09-14T10:59:48.417013+0000","last_became_peered":"2024-09-14T10:59:48.417013+0000","last_unstale":"2024-09-14T11:23:24.373706+0000","last_undegraded":"2024-09-14T11:23:24.373706+0000","last_fullsized":"2024-09-14T11:23:24.373706+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'22","last_scrub_stamp":"2024-09-14T11:23:24.373610+0000","last_deep_scrub":"260'22","last_deep_scrub_stamp":"2024-09-14T11:23:24.373610+0000","last_clean_scrub_stamp":"2024-09-14T11:23:24.373610+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:40.881314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":110,"num_write":54,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"260'2","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:30.563204+0000","last_change":"2024-09-14T11:23:30.563204+0000","last_active":"2024-09-14T11:23:30.563204+0000","last_peered":"2024-09-14T11:23:30.563204+0000","last_clean":"2024-09-14T11:23:30.563204+0000","last_became_active":"2024-09-14T11:11:42.592514+0000","last_became_peered":"2024-09-14T11:11:42.592514+0000","last_unstale":"2024-09-14T11:23:30.563204+0000","last_undegraded":"2024-09-14T11:23:30.563204+0000","last_fullsized":"2024-09-14T11:23:30.563204+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:23:30.563111+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:23:30.563111+0000","last_clean_scrub_stamp":"2024-09-14T11:23:30.563111+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:30.285420+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":36,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:35.265320+0000","last_change":"2024-09-14T11:23:35.265320+0000","last_active":"2024-09-14T11:23:35.265320+0000","last_peered":"2024-09-14T11:23:35.265320+0000","last_clean":"2024-09-14T11:23:35.265320+0000","last_became_active":"2024-09-14T11:01:23.890356+0000","last_became_peered":"2024-09-14T11:01:23.890356+0000","last_unstale":"2024-09-14T11:23:35.265320+0000","last_undegraded":"2024-09-14T11:23:35.265320+0000","last_fullsized":"2024-09-14T11:23:35.265320+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:35.265205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:35.265205+0000","last_clean_scrub_stamp":"2024-09-14T11:23:35.265205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:35:30.326948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"257'3","reported_seq":49,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:30.753920+0000","last_change":"2024-09-14T11:23:30.753920+0000","last_active":"2024-09-14T11:23:30.753920+0000","last_peered":"2024-09-14T11:23:30.753920+0000","last_clean":"2024-09-14T11:23:30.753920+0000","last_became_active":"2024-09-14T11:01:20.859214+0000","last_became_peered":"2024-09-14T11:01:20.859214+0000","last_unstale":"2024-09-14T11:23:30.753920+0000","last_undegraded":"2024-09-14T11:23:30.753920+0000","last_fullsized":"2024-09-14T11:23:30.753920+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'3","last_scrub_stamp":"2024-09-14T11:23:30.753835+0000","last_deep_scrub":"257'3","last_deep_scrub_stamp":"2024-09-14T11:23:30.753835+0000","last_clean_scrub_stamp":"2024-09-14T11:23:30.753835+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:35.671869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"260'23","reported_seq":105,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:35.559378+0000","last_change":"2024-09-14T11:23:35.559378+0000","last_active":"2024-09-14T11:23:35.559378+0000","last_peered":"2024-09-14T11:23:35.559378+0000","last_clean":"2024-09-14T11:23:35.559378+0000","last_became_active":"2024-09-14T10:59:48.420353+0000","last_became_peered":"2024-09-14T10:59:48.420353+0000","last_unstale":"2024-09-14T11:23:35.559378+0000","last_undegraded":"2024-09-14T11:23:35.559378+0000","last_fullsized":"2024-09-14T11:23:35.559378+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'23","last_scrub_stamp":"2024-09-14T11:23:35.559300+0000","last_deep_scrub":"260'23","last_deep_scrub_stamp":"2024-09-14T11:23:35.559300+0000","last_clean_scrub_stamp":"2024-09-14T11:23:35.559300+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:57.843507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":102,"num_write":60,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:46.003030+0000","last_change":"2024-09-14T11:11:42.589448+0000","last_active":"2024-09-14T11:20:46.003030+0000","last_peered":"2024-09-14T11:20:46.003030+0000","last_clean":"2024-09-14T11:20:46.003030+0000","last_became_active":"2024-09-14T11:11:42.589134+0000","last_became_peered":"2024-09-14T11:11:42.589134+0000","last_unstale":"2024-09-14T11:20:46.003030+0000","last_undegraded":"2024-09-14T11:20:46.003030+0000","last_fullsized":"2024-09-14T11:20:46.003030+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"260'2","reported_seq":40,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:25.502170+0000","last_change":"2024-09-14T11:23:25.502170+0000","last_active":"2024-09-14T11:23:25.502170+0000","last_peered":"2024-09-14T11:23:25.502170+0000","last_clean":"2024-09-14T11:23:25.502170+0000","last_became_active":"2024-09-14T11:01:23.890433+0000","last_became_peered":"2024-09-14T11:01:23.890433+0000","last_unstale":"2024-09-14T11:23:25.502170+0000","last_undegraded":"2024-09-14T11:23:25.502170+0000","last_fullsized":"2024-09-14T11:23:25.502170+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:23:25.502088+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:23:25.502088+0000","last_clean_scrub_stamp":"2024-09-14T11:23:25.502088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:14:40.764137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"257'3","reported_seq":40,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:22.110767+0000","last_change":"2024-09-14T11:01:20.859636+0000","last_active":"2024-09-14T11:19:22.110767+0000","last_peered":"2024-09-14T11:19:22.110767+0000","last_clean":"2024-09-14T11:19:22.110767+0000","last_became_active":"2024-09-14T11:01:20.858834+0000","last_became_peered":"2024-09-14T11:01:20.858834+0000","last_unstale":"2024-09-14T11:19:22.110767+0000","last_undegraded":"2024-09-14T11:19:22.110767+0000","last_fullsized":"2024-09-14T11:19:22.110767+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:26.825835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"260'31","reported_seq":136,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:21.642794+0000","last_change":"2024-09-14T11:23:21.642794+0000","last_active":"2024-09-14T11:23:21.642794+0000","last_peered":"2024-09-14T11:23:21.642794+0000","last_clean":"2024-09-14T11:23:21.642794+0000","last_became_active":"2024-09-14T10:59:48.414351+0000","last_became_peered":"2024-09-14T10:59:48.414351+0000","last_unstale":"2024-09-14T11:23:21.642794+0000","last_undegraded":"2024-09-14T11:23:21.642794+0000","last_fullsized":"2024-09-14T11:23:21.642794+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'31","last_scrub_stamp":"2024-09-14T11:23:21.642694+0000","last_deep_scrub":"260'31","last_deep_scrub_stamp":"2024-09-14T11:23:21.642694+0000","last_clean_scrub_stamp":"2024-09-14T11:23:21.642694+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:06.209703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":249,"num_read_kb":158,"num_write":78,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:28.531908+0000","last_change":"2024-09-14T11:23:28.531908+0000","last_active":"2024-09-14T11:23:28.531908+0000","last_peered":"2024-09-14T11:23:28.531908+0000","last_clean":"2024-09-14T11:23:28.531908+0000","last_became_active":"2024-09-14T11:11:42.587955+0000","last_became_peered":"2024-09-14T11:11:42.587955+0000","last_unstale":"2024-09-14T11:23:28.531908+0000","last_undegraded":"2024-09-14T11:23:28.531908+0000","last_fullsized":"2024-09-14T11:23:28.531908+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:28.531820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:28.531820+0000","last_clean_scrub_stamp":"2024-09-14T11:23:28.531820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:14.336755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"260'8","reported_seq":47,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:16.262273+0000","last_change":"2024-09-14T11:01:23.893822+0000","last_active":"2024-09-14T11:22:16.262273+0000","last_peered":"2024-09-14T11:22:16.262273+0000","last_clean":"2024-09-14T11:22:16.262273+0000","last_became_active":"2024-09-14T11:01:23.891239+0000","last_became_peered":"2024-09-14T11:01:23.891239+0000","last_unstale":"2024-09-14T11:22:16.262273+0000","last_undegraded":"2024-09-14T11:22:16.262273+0000","last_fullsized":"2024-09-14T11:22:16.262273+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:21.232548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20482,"num_write":18,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":35,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:07.117708+0000","last_change":"2024-09-14T11:01:20.867304+0000","last_active":"2024-09-14T11:20:07.117708+0000","last_peered":"2024-09-14T11:20:07.117708+0000","last_clean":"2024-09-14T11:20:07.117708+0000","last_became_active":"2024-09-14T11:01:20.866975+0000","last_became_peered":"2024-09-14T11:01:20.866975+0000","last_unstale":"2024-09-14T11:20:07.117708+0000","last_undegraded":"2024-09-14T11:20:07.117708+0000","last_fullsized":"2024-09-14T11:20:07.117708+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:53.556481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"260'4","reported_seq":58,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:33.591627+0000","last_change":"2024-09-14T11:23:33.591627+0000","last_active":"2024-09-14T11:23:33.591627+0000","last_peered":"2024-09-14T11:23:33.591627+0000","last_clean":"2024-09-14T11:23:33.591627+0000","last_became_active":"2024-09-14T10:59:48.416741+0000","last_became_peered":"2024-09-14T10:59:48.416741+0000","last_unstale":"2024-09-14T11:23:33.591627+0000","last_undegraded":"2024-09-14T11:23:33.591627+0000","last_fullsized":"2024-09-14T11:23:33.591627+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-14T11:23:33.591548+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-14T11:23:33.591548+0000","last_clean_scrub_stamp":"2024-09-14T11:23:33.591548+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:47:20.251422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:29.517358+0000","last_change":"2024-09-14T11:23:29.517358+0000","last_active":"2024-09-14T11:23:29.517358+0000","last_peered":"2024-09-14T11:23:29.517358+0000","last_clean":"2024-09-14T11:23:29.517358+0000","last_became_active":"2024-09-14T11:11:42.582190+0000","last_became_peered":"2024-09-14T11:11:42.582190+0000","last_unstale":"2024-09-14T11:23:29.517358+0000","last_undegraded":"2024-09-14T11:23:29.517358+0000","last_fullsized":"2024-09-14T11:23:29.517358+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:29.517270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:29.517270+0000","last_clean_scrub_stamp":"2024-09-14T11:23:29.517270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:29:37.345510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"260'10","reported_seq":55,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:16.262243+0000","last_change":"2024-09-14T11:01:23.893560+0000","last_active":"2024-09-14T11:22:16.262243+0000","last_peered":"2024-09-14T11:22:16.262243+0000","last_clean":"2024-09-14T11:22:16.262243+0000","last_became_active":"2024-09-14T11:01:23.892344+0000","last_became_peered":"2024-09-14T11:01:23.892344+0000","last_unstale":"2024-09-14T11:22:16.262243+0000","last_undegraded":"2024-09-14T11:22:16.262243+0000","last_fullsized":"2024-09-14T11:22:16.262243+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:12.291644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":30724,"num_write":15,"num_write_kb":10242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"260'2","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:11.138584+0000","last_change":"2024-09-14T11:01:20.863767+0000","last_active":"2024-09-14T11:22:11.138584+0000","last_peered":"2024-09-14T11:22:11.138584+0000","last_clean":"2024-09-14T11:22:11.138584+0000","last_became_active":"2024-09-14T11:01:20.863495+0000","last_became_peered":"2024-09-14T11:01:20.863495+0000","last_unstale":"2024-09-14T11:22:11.138584+0000","last_undegraded":"2024-09-14T11:22:11.138584+0000","last_fullsized":"2024-09-14T11:22:11.138584+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:36:10.395831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"260'32","reported_seq":120,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:22.110836+0000","last_change":"2024-09-14T10:59:48.416964+0000","last_active":"2024-09-14T11:19:22.110836+0000","last_peered":"2024-09-14T11:19:22.110836+0000","last_clean":"2024-09-14T11:19:22.110836+0000","last_became_active":"2024-09-14T10:59:48.416253+0000","last_became_peered":"2024-09-14T10:59:48.416253+0000","last_unstale":"2024-09-14T11:19:22.110836+0000","last_undegraded":"2024-09-14T11:19:22.110836+0000","last_fullsized":"2024-09-14T11:19:22.110836+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:16.459819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":142,"num_write":84,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:19:46.240692+0000","last_change":"2024-09-14T11:11:42.589281+0000","last_active":"2024-09-14T11:19:46.240692+0000","last_peered":"2024-09-14T11:19:46.240692+0000","last_clean":"2024-09-14T11:19:46.240692+0000","last_became_active":"2024-09-14T11:11:42.588988+0000","last_became_peered":"2024-09-14T11:11:42.588988+0000","last_unstale":"2024-09-14T11:19:46.240692+0000","last_undegraded":"2024-09-14T11:19:46.240692+0000","last_fullsized":"2024-09-14T11:19:46.240692+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:50:56.659833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"260'6","reported_seq":47,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:24.523185+0000","last_change":"2024-09-14T11:23:24.523185+0000","last_active":"2024-09-14T11:23:24.523185+0000","last_peered":"2024-09-14T11:23:24.523185+0000","last_clean":"2024-09-14T11:23:24.523185+0000","last_became_active":"2024-09-14T11:01:23.888845+0000","last_became_peered":"2024-09-14T11:01:23.888845+0000","last_unstale":"2024-09-14T11:23:24.523185+0000","last_undegraded":"2024-09-14T11:23:24.523185+0000","last_fullsized":"2024-09-14T11:23:24.523185+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-14T11:23:24.523101+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-14T11:23:24.523101+0000","last_clean_scrub_stamp":"2024-09-14T11:23:24.523101+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:53.052865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"257'10","reported_seq":69,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:31.296038+0000","last_change":"2024-09-14T11:23:31.296038+0000","last_active":"2024-09-14T11:23:31.296038+0000","last_peered":"2024-09-14T11:23:31.296038+0000","last_clean":"2024-09-14T11:23:31.296038+0000","last_became_active":"2024-09-14T11:01:20.865891+0000","last_became_peered":"2024-09-14T11:01:20.865891+0000","last_unstale":"2024-09-14T11:23:31.296038+0000","last_undegraded":"2024-09-14T11:23:31.296038+0000","last_fullsized":"2024-09-14T11:23:31.296038+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'10","last_scrub_stamp":"2024-09-14T11:23:31.295949+0000","last_deep_scrub":"257'10","last_deep_scrub_stamp":"2024-09-14T11:23:31.295949+0000","last_clean_scrub_stamp":"2024-09-14T11:23:31.295949+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:01.335383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":24580,"num_write":15,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"260'27","reported_seq":123,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:26.327151+0000","last_change":"2024-09-14T11:23:26.327151+0000","last_active":"2024-09-14T11:23:26.327151+0000","last_peered":"2024-09-14T11:23:26.327151+0000","last_clean":"2024-09-14T11:23:26.327151+0000","last_became_active":"2024-09-14T10:59:48.420845+0000","last_became_peered":"2024-09-14T10:59:48.420845+0000","last_unstale":"2024-09-14T11:23:26.327151+0000","last_undegraded":"2024-09-14T11:23:26.327151+0000","last_fullsized":"2024-09-14T11:23:26.327151+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'27","last_scrub_stamp":"2024-09-14T11:23:26.327053+0000","last_deep_scrub":"260'27","last_deep_scrub_stamp":"2024-09-14T11:23:26.327053+0000","last_clean_scrub_stamp":"2024-09-14T11:23:26.327053+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:11.867978+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":135,"num_write":77,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:02.116980+0000","last_change":"2024-09-14T11:11:42.592263+0000","last_active":"2024-09-14T11:20:02.116980+0000","last_peered":"2024-09-14T11:20:02.116980+0000","last_clean":"2024-09-14T11:20:02.116980+0000","last_became_active":"2024-09-14T11:11:42.591734+0000","last_became_peered":"2024-09-14T11:11:42.591734+0000","last_unstale":"2024-09-14T11:20:02.116980+0000","last_undegraded":"2024-09-14T11:20:02.116980+0000","last_fullsized":"2024-09-14T11:20:02.116980+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:48.663357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"260'3","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.457831+0000","last_change":"2024-09-14T11:01:23.895194+0000","last_active":"2024-09-14T11:22:50.457831+0000","last_peered":"2024-09-14T11:22:50.457831+0000","last_clean":"2024-09-14T11:22:50.457831+0000","last_became_active":"2024-09-14T11:01:23.894904+0000","last_became_peered":"2024-09-14T11:01:23.894904+0000","last_unstale":"2024-09-14T11:22:50.457831+0000","last_undegraded":"2024-09-14T11:22:50.457831+0000","last_fullsized":"2024-09-14T11:22:50.457831+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":35,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:52.124532+0000","last_change":"2024-09-14T11:01:20.867989+0000","last_active":"2024-09-14T11:20:52.124532+0000","last_peered":"2024-09-14T11:20:52.124532+0000","last_clean":"2024-09-14T11:20:52.124532+0000","last_became_active":"2024-09-14T11:01:20.867675+0000","last_became_peered":"2024-09-14T11:01:20.867675+0000","last_unstale":"2024-09-14T11:20:52.124532+0000","last_undegraded":"2024-09-14T11:20:52.124532+0000","last_fullsized":"2024-09-14T11:20:52.124532+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"260'45","reported_seq":175,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:24.774146+0000","last_change":"2024-09-14T11:23:24.774146+0000","last_active":"2024-09-14T11:23:24.774146+0000","last_peered":"2024-09-14T11:23:24.774146+0000","last_clean":"2024-09-14T11:23:24.774146+0000","last_became_active":"2024-09-14T10:59:48.419276+0000","last_became_peered":"2024-09-14T10:59:48.419276+0000","last_unstale":"2024-09-14T11:23:24.774146+0000","last_undegraded":"2024-09-14T11:23:24.774146+0000","last_fullsized":"2024-09-14T11:23:24.774146+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'45","last_scrub_stamp":"2024-09-14T11:23:24.774030+0000","last_deep_scrub":"260'45","last_deep_scrub_stamp":"2024-09-14T11:23:24.774030+0000","last_clean_scrub_stamp":"2024-09-14T11:23:24.774030+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:06.668253+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":347,"num_read_kb":232,"num_write":118,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"259'1","reported_seq":19,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:26.000278+0000","last_change":"2024-09-14T11:11:42.585561+0000","last_active":"2024-09-14T11:20:26.000278+0000","last_peered":"2024-09-14T11:20:26.000278+0000","last_clean":"2024-09-14T11:20:26.000278+0000","last_became_active":"2024-09-14T11:11:42.585114+0000","last_became_peered":"2024-09-14T11:11:42.585114+0000","last_unstale":"2024-09-14T11:20:26.000278+0000","last_undegraded":"2024-09-14T11:20:26.000278+0000","last_fullsized":"2024-09-14T11:20:26.000278+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:57.558919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"260'2","reported_seq":32,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:16.139205+0000","last_change":"2024-09-14T11:01:23.894718+0000","last_active":"2024-09-14T11:22:16.139205+0000","last_peered":"2024-09-14T11:22:16.139205+0000","last_clean":"2024-09-14T11:22:16.139205+0000","last_became_active":"2024-09-14T11:01:23.894464+0000","last_became_peered":"2024-09-14T11:01:23.894464+0000","last_unstale":"2024-09-14T11:22:16.139205+0000","last_undegraded":"2024-09-14T11:22:16.139205+0000","last_fullsized":"2024-09-14T11:22:16.139205+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:05.810582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:32.299427+0000","last_change":"2024-09-14T11:23:32.299427+0000","last_active":"2024-09-14T11:23:32.299427+0000","last_peered":"2024-09-14T11:23:32.299427+0000","last_clean":"2024-09-14T11:23:32.299427+0000","last_became_active":"2024-09-14T11:01:20.869082+0000","last_became_peered":"2024-09-14T11:01:20.869082+0000","last_unstale":"2024-09-14T11:23:32.299427+0000","last_undegraded":"2024-09-14T11:23:32.299427+0000","last_fullsized":"2024-09-14T11:23:32.299427+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:32.299346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:32.299346+0000","last_clean_scrub_stamp":"2024-09-14T11:23:32.299346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:58:15.656102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"260'42","reported_seq":160,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:25.349156+0000","last_change":"2024-09-14T11:23:25.349156+0000","last_active":"2024-09-14T11:23:25.349156+0000","last_peered":"2024-09-14T11:23:25.349156+0000","last_clean":"2024-09-14T11:23:25.349156+0000","last_became_active":"2024-09-14T10:59:48.419753+0000","last_became_peered":"2024-09-14T10:59:48.419753+0000","last_unstale":"2024-09-14T11:23:25.349156+0000","last_undegraded":"2024-09-14T11:23:25.349156+0000","last_fullsized":"2024-09-14T11:23:25.349156+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'42","last_scrub_stamp":"2024-09-14T11:23:25.349073+0000","last_deep_scrub":"260'42","last_deep_scrub_stamp":"2024-09-14T11:23:25.349073+0000","last_clean_scrub_stamp":"2024-09-14T11:23:25.349073+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:09.768780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":323,"num_read_kb":218,"num_write":115,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:26.123988+0000","last_change":"2024-09-14T11:11:42.593259+0000","last_active":"2024-09-14T11:20:26.123988+0000","last_peered":"2024-09-14T11:20:26.123988+0000","last_clean":"2024-09-14T11:20:26.123988+0000","last_became_active":"2024-09-14T11:11:42.592960+0000","last_became_peered":"2024-09-14T11:11:42.592960+0000","last_unstale":"2024-09-14T11:20:26.123988+0000","last_undegraded":"2024-09-14T11:20:26.123988+0000","last_fullsized":"2024-09-14T11:20:26.123988+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:01.524529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"260'3","reported_seq":33,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.457105+0000","last_change":"2024-09-14T11:01:23.884623+0000","last_active":"2024-09-14T11:22:50.457105+0000","last_peered":"2024-09-14T11:22:50.457105+0000","last_clean":"2024-09-14T11:22:50.457105+0000","last_became_active":"2024-09-14T11:01:23.883464+0000","last_became_peered":"2024-09-14T11:01:23.883464+0000","last_unstale":"2024-09-14T11:22:50.457105+0000","last_undegraded":"2024-09-14T11:22:50.457105+0000","last_fullsized":"2024-09-14T11:22:50.457105+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":35,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:07.117641+0000","last_change":"2024-09-14T11:01:20.858331+0000","last_active":"2024-09-14T11:20:07.117641+0000","last_peered":"2024-09-14T11:20:07.117641+0000","last_clean":"2024-09-14T11:20:07.117641+0000","last_became_active":"2024-09-14T11:01:20.858057+0000","last_became_peered":"2024-09-14T11:01:20.858057+0000","last_unstale":"2024-09-14T11:20:07.117641+0000","last_undegraded":"2024-09-14T11:20:07.117641+0000","last_fullsized":"2024-09-14T11:20:07.117641+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:57:11.838133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"260'19","reported_seq":86,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:42.122601+0000","last_change":"2024-09-14T10:59:48.413110+0000","last_active":"2024-09-14T11:20:42.122601+0000","last_peered":"2024-09-14T11:20:42.122601+0000","last_clean":"2024-09-14T11:20:42.122601+0000","last_became_active":"2024-09-14T10:59:48.412832+0000","last_became_peered":"2024-09-14T10:59:48.412832+0000","last_unstale":"2024-09-14T11:20:42.122601+0000","last_undegraded":"2024-09-14T11:20:42.122601+0000","last_fullsized":"2024-09-14T11:20:42.122601+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:06.411861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":68,"num_write":55,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:06.243706+0000","last_change":"2024-09-14T11:11:42.590806+0000","last_active":"2024-09-14T11:20:06.243706+0000","last_peered":"2024-09-14T11:20:06.243706+0000","last_clean":"2024-09-14T11:20:06.243706+0000","last_became_active":"2024-09-14T11:11:42.590549+0000","last_became_peered":"2024-09-14T11:11:42.590549+0000","last_unstale":"2024-09-14T11:20:06.243706+0000","last_undegraded":"2024-09-14T11:20:06.243706+0000","last_fullsized":"2024-09-14T11:20:06.243706+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:47:13.279425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":29,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:09.993244+0000","last_change":"2024-09-14T11:01:23.880483+0000","last_active":"2024-09-14T11:20:09.993244+0000","last_peered":"2024-09-14T11:20:09.993244+0000","last_clean":"2024-09-14T11:20:09.993244+0000","last_became_active":"2024-09-14T11:01:23.880195+0000","last_became_peered":"2024-09-14T11:01:23.880195+0000","last_unstale":"2024-09-14T11:20:09.993244+0000","last_undegraded":"2024-09-14T11:20:09.993244+0000","last_fullsized":"2024-09-14T11:20:09.993244+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:17.209496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:31.164981+0000","last_change":"2024-09-14T11:23:31.164981+0000","last_active":"2024-09-14T11:23:31.164981+0000","last_peered":"2024-09-14T11:23:31.164981+0000","last_clean":"2024-09-14T11:23:31.164981+0000","last_became_active":"2024-09-14T11:01:20.869312+0000","last_became_peered":"2024-09-14T11:01:20.869312+0000","last_unstale":"2024-09-14T11:23:31.164981+0000","last_undegraded":"2024-09-14T11:23:31.164981+0000","last_fullsized":"2024-09-14T11:23:31.164981+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:31.164892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:31.164892+0000","last_clean_scrub_stamp":"2024-09-14T11:23:31.164892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:33.758841+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"257'19","reported_seq":97,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:42.122542+0000","last_change":"2024-09-14T10:59:48.418837+0000","last_active":"2024-09-14T11:20:42.122542+0000","last_peered":"2024-09-14T11:20:42.122542+0000","last_clean":"2024-09-14T11:20:42.122542+0000","last_became_active":"2024-09-14T10:59:48.418369+0000","last_became_peered":"2024-09-14T10:59:48.418369+0000","last_unstale":"2024-09-14T11:20:42.122542+0000","last_undegraded":"2024-09-14T11:20:42.122542+0000","last_fullsized":"2024-09-14T11:20:42.122542+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:47.395615+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.395615+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:53.388331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":97,"num_write":49,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:02.117065+0000","last_change":"2024-09-14T11:11:42.593087+0000","last_active":"2024-09-14T11:20:02.117065+0000","last_peered":"2024-09-14T11:20:02.117065+0000","last_clean":"2024-09-14T11:20:02.117065+0000","last_became_active":"2024-09-14T11:11:42.592333+0000","last_became_peered":"2024-09-14T11:11:42.592333+0000","last_unstale":"2024-09-14T11:20:02.117065+0000","last_undegraded":"2024-09-14T11:20:02.117065+0000","last_fullsized":"2024-09-14T11:20:02.117065+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:32.247668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"260'2","reported_seq":40,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:33.294201+0000","last_change":"2024-09-14T11:23:33.294201+0000","last_active":"2024-09-14T11:23:33.294201+0000","last_peered":"2024-09-14T11:23:33.294201+0000","last_clean":"2024-09-14T11:23:33.294201+0000","last_became_active":"2024-09-14T11:01:23.882133+0000","last_became_peered":"2024-09-14T11:01:23.882133+0000","last_unstale":"2024-09-14T11:23:33.294201+0000","last_undegraded":"2024-09-14T11:23:33.294201+0000","last_fullsized":"2024-09-14T11:23:33.294201+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:23:33.294095+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:23:33.294095+0000","last_clean_scrub_stamp":"2024-09-14T11:23:33.294095+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:14:18.806772+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:27.493278+0000","last_change":"2024-09-14T11:23:27.493278+0000","last_active":"2024-09-14T11:23:27.493278+0000","last_peered":"2024-09-14T11:23:27.493278+0000","last_clean":"2024-09-14T11:23:27.493278+0000","last_became_active":"2024-09-14T11:01:20.860944+0000","last_became_peered":"2024-09-14T11:01:20.860944+0000","last_unstale":"2024-09-14T11:23:27.493278+0000","last_undegraded":"2024-09-14T11:23:27.493278+0000","last_fullsized":"2024-09-14T11:23:27.493278+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:27.493188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:27.493188+0000","last_clean_scrub_stamp":"2024-09-14T11:23:27.493188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:10.739573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"260'37","reported_seq":149,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:28.289822+0000","last_change":"2024-09-14T11:23:28.289822+0000","last_active":"2024-09-14T11:23:28.289822+0000","last_peered":"2024-09-14T11:23:28.289822+0000","last_clean":"2024-09-14T11:23:28.289822+0000","last_became_active":"2024-09-14T10:59:48.419953+0000","last_became_peered":"2024-09-14T10:59:48.419953+0000","last_unstale":"2024-09-14T11:23:28.289822+0000","last_undegraded":"2024-09-14T11:23:28.289822+0000","last_fullsized":"2024-09-14T11:23:28.289822+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'37","last_scrub_stamp":"2024-09-14T11:23:28.289745+0000","last_deep_scrub":"260'37","last_deep_scrub_stamp":"2024-09-14T11:23:28.289745+0000","last_clean_scrub_stamp":"2024-09-14T11:23:28.289745+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:16.011756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":210,"num_write":90,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"260'356","reported_seq":1000,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:04.591849+0000","last_change":"2024-09-14T11:23:04.591790+0000","last_active":"2024-09-14T11:23:04.591849+0000","last_peered":"2024-09-14T11:23:04.591849+0000","last_clean":"2024-09-14T11:23:04.591849+0000","last_became_active":"2024-09-14T10:45:43.684205+0000","last_became_peered":"2024-09-14T10:45:43.684205+0000","last_unstale":"2024-09-14T11:23:04.591849+0000","last_undegraded":"2024-09-14T11:23:04.591849+0000","last_fullsized":"2024-09-14T11:23:04.591849+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'356","last_scrub_stamp":"2024-09-14T11:23:04.591679+0000","last_deep_scrub":"260'356","last_deep_scrub_stamp":"2024-09-14T11:23:04.591679+0000","last_clean_scrub_stamp":"2024-09-14T11:23:04.591679+0000","objects_scrubbed":7,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:23.922213+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133699,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":617,"num_read_kb":37218,"num_write":1077,"num_write_kb":25003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"260'785","reported_seq":2543,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:08.629267+0000","last_change":"2024-09-14T11:23:08.629209+0000","last_active":"2024-09-14T11:23:08.629267+0000","last_peered":"2024-09-14T11:23:08.629267+0000","last_clean":"2024-09-14T11:23:08.629267+0000","last_became_active":"2024-09-14T10:45:45.714485+0000","last_became_peered":"2024-09-14T10:45:45.714485+0000","last_unstale":"2024-09-14T11:23:08.629267+0000","last_undegraded":"2024-09-14T11:23:08.629267+0000","last_fullsized":"2024-09-14T11:23:08.629267+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'785","last_scrub_stamp":"2024-09-14T11:23:08.629123+0000","last_deep_scrub":"260'785","last_deep_scrub_stamp":"2024-09-14T11:23:08.629123+0000","last_clean_scrub_stamp":"2024-09-14T11:23:08.629123+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:19:08.756240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4300,"num_read_kb":3942,"num_write":1034,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7375,"num_omap_keys":29,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"260'353","reported_seq":1039,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:08.381428+0000","last_change":"2024-09-14T11:23:08.381363+0000","last_active":"2024-09-14T11:23:08.381428+0000","last_peered":"2024-09-14T11:23:08.381428+0000","last_clean":"2024-09-14T11:23:08.381428+0000","last_became_active":"2024-09-14T10:45:43.683777+0000","last_became_peered":"2024-09-14T10:45:43.683777+0000","last_unstale":"2024-09-14T11:23:08.381428+0000","last_undegraded":"2024-09-14T11:23:08.381428+0000","last_fullsized":"2024-09-14T11:23:08.381428+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'353","last_scrub_stamp":"2024-09-14T11:23:08.381263+0000","last_deep_scrub":"260'353","last_deep_scrub_stamp":"2024-09-14T11:23:08.381263+0000","last_clean_scrub_stamp":"2024-09-14T11:23:08.381263+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:09.498257+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":760,"num_read_kb":10810,"num_write":1149,"num_write_kb":33486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"260'367","reported_seq":1843,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:20.153914+0000","last_change":"2024-09-14T11:23:20.153914+0000","last_active":"2024-09-14T11:23:20.153914+0000","last_peered":"2024-09-14T11:23:20.153914+0000","last_clean":"2024-09-14T11:23:20.153914+0000","last_became_active":"2024-09-14T10:45:45.715857+0000","last_became_peered":"2024-09-14T10:45:45.715857+0000","last_unstale":"2024-09-14T11:23:20.153914+0000","last_undegraded":"2024-09-14T11:23:20.153914+0000","last_fullsized":"2024-09-14T11:23:20.153914+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'367","last_scrub_stamp":"2024-09-14T11:23:20.153830+0000","last_deep_scrub":"260'367","last_deep_scrub_stamp":"2024-09-14T11:23:20.153830+0000","last_clean_scrub_stamp":"2024-09-14T11:23:20.153830+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:36.122734+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2025,"num_read_kb":1946,"num_write":400,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"260'382","reported_seq":1095,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:09.404600+0000","last_change":"2024-09-14T11:23:09.404541+0000","last_active":"2024-09-14T11:23:09.404600+0000","last_peered":"2024-09-14T11:23:09.404600+0000","last_clean":"2024-09-14T11:23:09.404600+0000","last_became_active":"2024-09-14T10:45:43.689222+0000","last_became_peered":"2024-09-14T10:45:43.689222+0000","last_unstale":"2024-09-14T11:23:09.404600+0000","last_undegraded":"2024-09-14T11:23:09.404600+0000","last_fullsized":"2024-09-14T11:23:09.404600+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'382","last_scrub_stamp":"2024-09-14T11:23:09.404431+0000","last_deep_scrub":"260'382","last_deep_scrub_stamp":"2024-09-14T11:23:09.404431+0000","last_clean_scrub_stamp":"2024-09-14T11:23:09.404431+0000","objects_scrubbed":6,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:38:07.421015+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":957,"num_read_kb":25215,"num_write":1113,"num_write_kb":46624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"260'805","reported_seq":2244,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:21.166053+0000","last_change":"2024-09-14T11:23:21.166053+0000","last_active":"2024-09-14T11:23:21.166053+0000","last_peered":"2024-09-14T11:23:21.166053+0000","last_clean":"2024-09-14T11:23:21.166053+0000","last_became_active":"2024-09-14T10:45:45.718205+0000","last_became_peered":"2024-09-14T10:45:45.718205+0000","last_unstale":"2024-09-14T11:23:21.166053+0000","last_undegraded":"2024-09-14T11:23:21.166053+0000","last_fullsized":"2024-09-14T11:23:21.166053+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'805","last_scrub_stamp":"2024-09-14T11:23:21.165903+0000","last_deep_scrub":"260'805","last_deep_scrub_stamp":"2024-09-14T11:23:21.165903+0000","last_clean_scrub_stamp":"2024-09-14T11:23:21.165903+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:27.460262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3715,"num_read_kb":3327,"num_write":1051,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"260'407","reported_seq":1157,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:02.167132+0000","last_change":"2024-09-14T11:23:02.167132+0000","last_active":"2024-09-14T11:23:02.167132+0000","last_peered":"2024-09-14T11:23:02.167132+0000","last_clean":"2024-09-14T11:23:02.167132+0000","last_became_active":"2024-09-14T10:45:43.688982+0000","last_became_peered":"2024-09-14T10:45:43.688982+0000","last_unstale":"2024-09-14T11:23:02.167132+0000","last_undegraded":"2024-09-14T11:23:02.167132+0000","last_fullsized":"2024-09-14T11:23:02.167132+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'407","last_scrub_stamp":"2024-09-14T11:23:02.167030+0000","last_deep_scrub":"260'407","last_deep_scrub_stamp":"2024-09-14T11:23:02.167030+0000","last_clean_scrub_stamp":"2024-09-14T11:23:02.167030+0000","objects_scrubbed":6,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:09.629346+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133692,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":838,"num_read_kb":162483,"num_write":1341,"num_write_kb":45809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"260'458","reported_seq":2016,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:12.794133+0000","last_change":"2024-09-14T11:23:12.794054+0000","last_active":"2024-09-14T11:23:12.794133+0000","last_peered":"2024-09-14T11:23:12.794133+0000","last_clean":"2024-09-14T11:23:12.794133+0000","last_became_active":"2024-09-14T10:45:45.717699+0000","last_became_peered":"2024-09-14T10:45:45.717699+0000","last_unstale":"2024-09-14T11:23:12.794133+0000","last_undegraded":"2024-09-14T11:23:12.794133+0000","last_fullsized":"2024-09-14T11:23:12.794133+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'458","last_scrub_stamp":"2024-09-14T11:23:12.793944+0000","last_deep_scrub":"260'458","last_deep_scrub_stamp":"2024-09-14T11:23:12.793944+0000","last_clean_scrub_stamp":"2024-09-14T11:23:12.793944+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:09.734572+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2461,"num_read_kb":2303,"num_write":536,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"260'377","reported_seq":1025,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:03.611733+0000","last_change":"2024-09-14T11:23:03.611674+0000","last_active":"2024-09-14T11:23:03.611733+0000","last_peered":"2024-09-14T11:23:03.611733+0000","last_clean":"2024-09-14T11:23:03.611733+0000","last_became_active":"2024-09-14T10:45:43.686078+0000","last_became_peered":"2024-09-14T10:45:43.686078+0000","last_unstale":"2024-09-14T11:23:03.611733+0000","last_undegraded":"2024-09-14T11:23:03.611733+0000","last_fullsized":"2024-09-14T11:23:03.611733+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'377","last_scrub_stamp":"2024-09-14T11:23:03.611555+0000","last_deep_scrub":"260'377","last_deep_scrub_stamp":"2024-09-14T11:23:03.611555+0000","last_clean_scrub_stamp":"2024-09-14T11:23:03.611555+0000","objects_scrubbed":9,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:46.384126+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":598,"num_read_kb":61894,"num_write":1162,"num_write_kb":33123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"260'401","reported_seq":2019,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:07.627716+0000","last_change":"2024-09-14T11:23:07.627716+0000","last_active":"2024-09-14T11:23:07.627716+0000","last_peered":"2024-09-14T11:23:07.627716+0000","last_clean":"2024-09-14T11:23:07.627716+0000","last_became_active":"2024-09-14T10:45:45.714345+0000","last_became_peered":"2024-09-14T10:45:45.714345+0000","last_unstale":"2024-09-14T11:23:07.627716+0000","last_undegraded":"2024-09-14T11:23:07.627716+0000","last_fullsized":"2024-09-14T11:23:07.627716+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'401","last_scrub_stamp":"2024-09-14T11:23:07.627629+0000","last_deep_scrub":"260'401","last_deep_scrub_stamp":"2024-09-14T11:23:07.627629+0000","last_clean_scrub_stamp":"2024-09-14T11:23:07.627629+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:58:14.580406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2395,"num_read_kb":2287,"num_write":454,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"260'361","reported_seq":1026,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:01.177685+0000","last_change":"2024-09-14T11:23:01.177616+0000","last_active":"2024-09-14T11:23:01.177685+0000","last_peered":"2024-09-14T11:23:01.177685+0000","last_clean":"2024-09-14T11:23:01.177685+0000","last_became_active":"2024-09-14T10:45:43.689513+0000","last_became_peered":"2024-09-14T10:45:43.689513+0000","last_unstale":"2024-09-14T11:23:01.177685+0000","last_undegraded":"2024-09-14T11:23:01.177685+0000","last_fullsized":"2024-09-14T11:23:01.177685+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'361","last_scrub_stamp":"2024-09-14T11:23:01.177512+0000","last_deep_scrub":"260'361","last_deep_scrub_stamp":"2024-09-14T11:23:01.177512+0000","last_clean_scrub_stamp":"2024-09-14T11:23:01.177512+0000","objects_scrubbed":6,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:32.647394+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":492096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":689,"num_read_kb":58877,"num_write":1198,"num_write_kb":34980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"260'913","reported_seq":2793,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:10.646748+0000","last_change":"2024-09-14T11:23:10.646694+0000","last_active":"2024-09-14T11:23:10.646748+0000","last_peered":"2024-09-14T11:23:10.646748+0000","last_clean":"2024-09-14T11:23:10.646748+0000","last_became_active":"2024-09-14T10:45:45.722048+0000","last_became_peered":"2024-09-14T10:45:45.722048+0000","last_unstale":"2024-09-14T11:23:10.646748+0000","last_undegraded":"2024-09-14T11:23:10.646748+0000","last_fullsized":"2024-09-14T11:23:10.646748+0000","mapping_epoch":26,"log_start":"260'900","ondisk_log_start":"260'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'913","last_scrub_stamp":"2024-09-14T11:23:10.646599+0000","last_deep_scrub":"260'913","last_deep_scrub_stamp":"2024-09-14T11:23:10.646599+0000","last_clean_scrub_stamp":"2024-09-14T11:23:10.646599+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":900,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:43.954240+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4452,"num_read_kb":4058,"num_write":1175,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":735,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"260'370","reported_seq":1013,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:59.523833+0000","last_change":"2024-09-14T11:22:59.523764+0000","last_active":"2024-09-14T11:22:59.523833+0000","last_peered":"2024-09-14T11:22:59.523833+0000","last_clean":"2024-09-14T11:22:59.523833+0000","last_became_active":"2024-09-14T10:45:43.689229+0000","last_became_peered":"2024-09-14T10:45:43.689229+0000","last_unstale":"2024-09-14T11:22:59.523833+0000","last_undegraded":"2024-09-14T11:22:59.523833+0000","last_fullsized":"2024-09-14T11:22:59.523833+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'370","last_scrub_stamp":"2024-09-14T11:22:59.523641+0000","last_deep_scrub":"260'370","last_deep_scrub_stamp":"2024-09-14T11:22:59.523641+0000","last_clean_scrub_stamp":"2024-09-14T11:22:59.523641+0000","objects_scrubbed":5,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:54.893522+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":599,"num_read_kb":84854,"num_write":1153,"num_write_kb":20352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"260'522","reported_seq":2116,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:06.256202+0000","last_change":"2024-09-14T11:23:06.256140+0000","last_active":"2024-09-14T11:23:06.256202+0000","last_peered":"2024-09-14T11:23:06.256202+0000","last_clean":"2024-09-14T11:23:06.256202+0000","last_became_active":"2024-09-14T10:45:45.718978+0000","last_became_peered":"2024-09-14T10:45:45.718978+0000","last_unstale":"2024-09-14T11:23:06.256202+0000","last_undegraded":"2024-09-14T11:23:06.256202+0000","last_fullsized":"2024-09-14T11:23:06.256202+0000","mapping_epoch":26,"log_start":"260'500","ondisk_log_start":"260'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'522","last_scrub_stamp":"2024-09-14T11:23:06.256050+0000","last_deep_scrub":"260'522","last_deep_scrub_stamp":"2024-09-14T11:23:06.256050+0000","last_clean_scrub_stamp":"2024-09-14T11:23:06.256050+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:20:05.550331+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2761,"num_read_kb":2575,"num_write":634,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"260'341","reported_seq":980,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:07.343841+0000","last_change":"2024-09-14T11:23:07.343744+0000","last_active":"2024-09-14T11:23:07.343841+0000","last_peered":"2024-09-14T11:23:07.343841+0000","last_clean":"2024-09-14T11:23:07.343841+0000","last_became_active":"2024-09-14T10:45:43.687262+0000","last_became_peered":"2024-09-14T10:45:43.687262+0000","last_unstale":"2024-09-14T11:23:07.343841+0000","last_undegraded":"2024-09-14T11:23:07.343841+0000","last_fullsized":"2024-09-14T11:23:07.343841+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'341","last_scrub_stamp":"2024-09-14T11:23:07.343639+0000","last_deep_scrub":"260'341","last_deep_scrub_stamp":"2024-09-14T11:23:07.343639+0000","last_clean_scrub_stamp":"2024-09-14T11:23:07.343639+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:20.970032+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":682,"num_read_kb":42631,"num_write":1158,"num_write_kb":32664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"260'829","reported_seq":2526,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:18.423447+0000","last_change":"2024-09-14T11:23:18.423447+0000","last_active":"2024-09-14T11:23:18.423447+0000","last_peered":"2024-09-14T11:23:18.423447+0000","last_clean":"2024-09-14T11:23:18.423447+0000","last_became_active":"2024-09-14T10:45:45.721400+0000","last_became_peered":"2024-09-14T10:45:45.721400+0000","last_unstale":"2024-09-14T11:23:18.423447+0000","last_undegraded":"2024-09-14T11:23:18.423447+0000","last_fullsized":"2024-09-14T11:23:18.423447+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'829","last_scrub_stamp":"2024-09-14T11:23:18.423349+0000","last_deep_scrub":"260'829","last_deep_scrub_stamp":"2024-09-14T11:23:18.423349+0000","last_clean_scrub_stamp":"2024-09-14T11:23:18.423349+0000","objects_scrubbed":5,"log_size":29,"log_dups_size":800,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:43.196057+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4476,"num_read_kb":4082,"num_write":1140,"num_write_kb":477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2301,"num_omap_keys":9,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"260'1281","reported_seq":2925,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:19.131432+0000","last_change":"2024-09-14T11:23:19.131432+0000","last_active":"2024-09-14T11:23:19.131432+0000","last_peered":"2024-09-14T11:23:19.131432+0000","last_clean":"2024-09-14T11:23:19.131432+0000","last_became_active":"2024-09-14T10:45:45.710015+0000","last_became_peered":"2024-09-14T10:45:45.710015+0000","last_unstale":"2024-09-14T11:23:19.131432+0000","last_undegraded":"2024-09-14T11:23:19.131432+0000","last_fullsized":"2024-09-14T11:23:19.131432+0000","mapping_epoch":26,"log_start":"260'1200","ondisk_log_start":"260'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1281","last_scrub_stamp":"2024-09-14T11:23:19.131365+0000","last_deep_scrub":"260'1281","last_deep_scrub_stamp":"2024-09-14T11:23:19.131365+0000","last_clean_scrub_stamp":"2024-09-14T11:23:19.131365+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":1200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:57.896028+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5907,"num_read_kb":5227,"num_write":1779,"num_write_kb":739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"260'363","reported_seq":972,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:00.677668+0000","last_change":"2024-09-14T11:23:00.677668+0000","last_active":"2024-09-14T11:23:00.677668+0000","last_peered":"2024-09-14T11:23:00.677668+0000","last_clean":"2024-09-14T11:23:00.677668+0000","last_became_active":"2024-09-14T10:45:43.677751+0000","last_became_peered":"2024-09-14T10:45:43.677751+0000","last_unstale":"2024-09-14T11:23:00.677668+0000","last_undegraded":"2024-09-14T11:23:00.677668+0000","last_fullsized":"2024-09-14T11:23:00.677668+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'363","last_scrub_stamp":"2024-09-14T11:23:00.677578+0000","last_deep_scrub":"260'363","last_deep_scrub_stamp":"2024-09-14T11:23:00.677578+0000","last_clean_scrub_stamp":"2024-09-14T11:23:00.677578+0000","objects_scrubbed":3,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:46:20.373849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":554,"num_read_kb":880,"num_write":1155,"num_write_kb":23836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"260'598","reported_seq":2281,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:06.638146+0000","last_change":"2024-09-14T11:23:06.638084+0000","last_active":"2024-09-14T11:23:06.638146+0000","last_peered":"2024-09-14T11:23:06.638146+0000","last_clean":"2024-09-14T11:23:06.638146+0000","last_became_active":"2024-09-14T10:45:45.714551+0000","last_became_peered":"2024-09-14T10:45:45.714551+0000","last_unstale":"2024-09-14T11:23:06.638146+0000","last_undegraded":"2024-09-14T11:23:06.638146+0000","last_fullsized":"2024-09-14T11:23:06.638146+0000","mapping_epoch":26,"log_start":"260'500","ondisk_log_start":"260'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'598","last_scrub_stamp":"2024-09-14T11:23:06.637993+0000","last_deep_scrub":"260'598","last_deep_scrub_stamp":"2024-09-14T11:23:06.637993+0000","last_clean_scrub_stamp":"2024-09-14T11:23:06.637993+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":500,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:58.618707+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3058,"num_read_kb":2815,"num_write":741,"num_write_kb":205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":640,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"260'359","reported_seq":994,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:58.562307+0000","last_change":"2024-09-14T11:22:58.562307+0000","last_active":"2024-09-14T11:22:58.562307+0000","last_peered":"2024-09-14T11:22:58.562307+0000","last_clean":"2024-09-14T11:22:58.562307+0000","last_became_active":"2024-09-14T10:45:43.680355+0000","last_became_peered":"2024-09-14T10:45:43.680355+0000","last_unstale":"2024-09-14T11:22:58.562307+0000","last_undegraded":"2024-09-14T11:22:58.562307+0000","last_fullsized":"2024-09-14T11:22:58.562307+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'359","last_scrub_stamp":"2024-09-14T11:22:58.562194+0000","last_deep_scrub":"260'359","last_deep_scrub_stamp":"2024-09-14T11:22:58.562194+0000","last_clean_scrub_stamp":"2024-09-14T11:22:58.562194+0000","objects_scrubbed":8,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:10.587335+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":541,"num_read_kb":36303,"num_write":1001,"num_write_kb":55095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"260'494","reported_seq":2172,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:09.584116+0000","last_change":"2024-09-14T11:23:09.584046+0000","last_active":"2024-09-14T11:23:09.584116+0000","last_peered":"2024-09-14T11:23:09.584116+0000","last_clean":"2024-09-14T11:23:09.584116+0000","last_became_active":"2024-09-14T10:45:45.720760+0000","last_became_peered":"2024-09-14T10:45:45.720760+0000","last_unstale":"2024-09-14T11:23:09.584116+0000","last_undegraded":"2024-09-14T11:23:09.584116+0000","last_fullsized":"2024-09-14T11:23:09.584116+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'494","last_scrub_stamp":"2024-09-14T11:23:09.583958+0000","last_deep_scrub":"260'494","last_deep_scrub_stamp":"2024-09-14T11:23:09.583958+0000","last_clean_scrub_stamp":"2024-09-14T11:23:09.583958+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:01:54.258924+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2631,"num_read_kb":2483,"num_write":574,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"260'388","reported_seq":1071,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:57.604997+0000","last_change":"2024-09-14T11:22:57.604997+0000","last_active":"2024-09-14T11:22:57.604997+0000","last_peered":"2024-09-14T11:22:57.604997+0000","last_clean":"2024-09-14T11:22:57.604997+0000","last_became_active":"2024-09-14T10:45:43.684428+0000","last_became_peered":"2024-09-14T10:45:43.684428+0000","last_unstale":"2024-09-14T11:22:57.604997+0000","last_undegraded":"2024-09-14T11:22:57.604997+0000","last_fullsized":"2024-09-14T11:22:57.604997+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'388","last_scrub_stamp":"2024-09-14T11:22:57.604909+0000","last_deep_scrub":"260'388","last_deep_scrub_stamp":"2024-09-14T11:22:57.604909+0000","last_clean_scrub_stamp":"2024-09-14T11:22:57.604909+0000","objects_scrubbed":4,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:01.600133+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133668,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":756,"num_read_kb":9043,"num_write":1222,"num_write_kb":18367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"260'487","reported_seq":2068,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:10.315984+0000","last_change":"2024-09-14T11:23:10.315984+0000","last_active":"2024-09-14T11:23:10.315984+0000","last_peered":"2024-09-14T11:23:10.315984+0000","last_clean":"2024-09-14T11:23:10.315984+0000","last_became_active":"2024-09-14T10:45:45.724302+0000","last_became_peered":"2024-09-14T10:45:45.724302+0000","last_unstale":"2024-09-14T11:23:10.315984+0000","last_undegraded":"2024-09-14T11:23:10.315984+0000","last_fullsized":"2024-09-14T11:23:10.315984+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'487","last_scrub_stamp":"2024-09-14T11:23:10.315849+0000","last_deep_scrub":"260'487","last_deep_scrub_stamp":"2024-09-14T11:23:10.315849+0000","last_clean_scrub_stamp":"2024-09-14T11:23:10.315849+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:37.803313+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2564,"num_read_kb":2400,"num_write":575,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":460,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"260'336","reported_seq":1031,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:01.602768+0000","last_change":"2024-09-14T11:23:01.602768+0000","last_active":"2024-09-14T11:23:01.602768+0000","last_peered":"2024-09-14T11:23:01.602768+0000","last_clean":"2024-09-14T11:23:01.602768+0000","last_became_active":"2024-09-14T10:45:43.683797+0000","last_became_peered":"2024-09-14T10:45:43.683797+0000","last_unstale":"2024-09-14T11:23:01.602768+0000","last_undegraded":"2024-09-14T11:23:01.602768+0000","last_fullsized":"2024-09-14T11:23:01.602768+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'336","last_scrub_stamp":"2024-09-14T11:23:01.602654+0000","last_deep_scrub":"260'336","last_deep_scrub_stamp":"2024-09-14T11:23:01.602654+0000","last_clean_scrub_stamp":"2024-09-14T11:23:01.602654+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:05.538860+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":715,"num_read_kb":8100,"num_write":1180,"num_write_kb":25345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"260'434","reported_seq":1978,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:17.380987+0000","last_change":"2024-09-14T11:23:17.380987+0000","last_active":"2024-09-14T11:23:17.380987+0000","last_peered":"2024-09-14T11:23:17.380987+0000","last_clean":"2024-09-14T11:23:17.380987+0000","last_became_active":"2024-09-14T10:45:45.723570+0000","last_became_peered":"2024-09-14T10:45:45.723570+0000","last_unstale":"2024-09-14T11:23:17.380987+0000","last_undegraded":"2024-09-14T11:23:17.380987+0000","last_fullsized":"2024-09-14T11:23:17.380987+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'434","last_scrub_stamp":"2024-09-14T11:23:17.380900+0000","last_deep_scrub":"260'434","last_deep_scrub_stamp":"2024-09-14T11:23:17.380900+0000","last_clean_scrub_stamp":"2024-09-14T11:23:17.380900+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:59.821342+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2400,"num_read_kb":2278,"num_write":489,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"260'442","reported_seq":1161,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:03.480235+0000","last_change":"2024-09-14T11:23:03.480235+0000","last_active":"2024-09-14T11:23:03.480235+0000","last_peered":"2024-09-14T11:23:03.480235+0000","last_clean":"2024-09-14T11:23:03.480235+0000","last_became_active":"2024-09-14T10:45:43.687585+0000","last_became_peered":"2024-09-14T10:45:43.687585+0000","last_unstale":"2024-09-14T11:23:03.480235+0000","last_undegraded":"2024-09-14T11:23:03.480235+0000","last_fullsized":"2024-09-14T11:23:03.480235+0000","mapping_epoch":23,"log_start":"260'400","ondisk_log_start":"260'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'442","last_scrub_stamp":"2024-09-14T11:23:03.480124+0000","last_deep_scrub":"260'442","last_deep_scrub_stamp":"2024-09-14T11:23:03.480124+0000","last_clean_scrub_stamp":"2024-09-14T11:23:03.480124+0000","objects_scrubbed":6,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:54.485427+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1137,"num_read_kb":1116,"num_write":1403,"num_write_kb":30799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"260'801","reported_seq":2456,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:06.591124+0000","last_change":"2024-09-14T11:23:06.591124+0000","last_active":"2024-09-14T11:23:06.591124+0000","last_peered":"2024-09-14T11:23:06.591124+0000","last_clean":"2024-09-14T11:23:06.591124+0000","last_became_active":"2024-09-14T10:45:45.714187+0000","last_became_peered":"2024-09-14T10:45:45.714187+0000","last_unstale":"2024-09-14T11:23:06.591124+0000","last_undegraded":"2024-09-14T11:23:06.591124+0000","last_fullsized":"2024-09-14T11:23:06.591124+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'801","last_scrub_stamp":"2024-09-14T11:23:06.591022+0000","last_deep_scrub":"260'801","last_deep_scrub_stamp":"2024-09-14T11:23:06.591022+0000","last_clean_scrub_stamp":"2024-09-14T11:23:06.591022+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:23.740415+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3909,"num_read_kb":3562,"num_write":1036,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":245,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"260'348","reported_seq":996,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:00.520173+0000","last_change":"2024-09-14T11:23:00.520074+0000","last_active":"2024-09-14T11:23:00.520173+0000","last_peered":"2024-09-14T11:23:00.520173+0000","last_clean":"2024-09-14T11:23:00.520173+0000","last_became_active":"2024-09-14T10:45:43.681680+0000","last_became_peered":"2024-09-14T10:45:43.681680+0000","last_unstale":"2024-09-14T11:23:00.520173+0000","last_undegraded":"2024-09-14T11:23:00.520173+0000","last_fullsized":"2024-09-14T11:23:00.520173+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'348","last_scrub_stamp":"2024-09-14T11:23:00.519964+0000","last_deep_scrub":"260'348","last_deep_scrub_stamp":"2024-09-14T11:23:00.519964+0000","last_clean_scrub_stamp":"2024-09-14T11:23:00.519964+0000","objects_scrubbed":3,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:19:01.552760+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":572,"num_read_kb":80059,"num_write":1115,"num_write_kb":31213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"260'167","reported_seq":664,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:20.609247+0000","last_change":"2024-09-14T11:23:20.609247+0000","last_active":"2024-09-14T11:23:20.609247+0000","last_peered":"2024-09-14T11:23:20.609247+0000","last_clean":"2024-09-14T11:23:20.609247+0000","last_became_active":"2024-09-14T10:45:53.749495+0000","last_became_peered":"2024-09-14T10:45:53.749495+0000","last_unstale":"2024-09-14T11:23:20.609247+0000","last_undegraded":"2024-09-14T11:23:20.609247+0000","last_fullsized":"2024-09-14T11:23:20.609247+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'167","last_scrub_stamp":"2024-09-14T11:23:20.609150+0000","last_deep_scrub":"260'167","last_deep_scrub_stamp":"2024-09-14T11:23:20.609150+0000","last_clean_scrub_stamp":"2024-09-14T11:23:20.609150+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:03:11.128451+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":160,"num_read_kb":158,"num_write":391,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"260'885","reported_seq":2461,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:08.342104+0000","last_change":"2024-09-14T11:23:08.342014+0000","last_active":"2024-09-14T11:23:08.342104+0000","last_peered":"2024-09-14T11:23:08.342104+0000","last_clean":"2024-09-14T11:23:08.342104+0000","last_became_active":"2024-09-14T10:45:45.710830+0000","last_became_peered":"2024-09-14T10:45:45.710830+0000","last_unstale":"2024-09-14T11:23:08.342104+0000","last_undegraded":"2024-09-14T11:23:08.342104+0000","last_fullsized":"2024-09-14T11:23:08.342104+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'885","last_scrub_stamp":"2024-09-14T11:23:08.341916+0000","last_deep_scrub":"260'885","last_deep_scrub_stamp":"2024-09-14T11:23:08.341916+0000","last_clean_scrub_stamp":"2024-09-14T11:23:08.341916+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":800,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:21.880977+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5905,"num_read_kb":5530,"num_write":1368,"num_write_kb":537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"260'450","reported_seq":1134,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:05.189040+0000","last_change":"2024-09-14T11:23:05.188952+0000","last_active":"2024-09-14T11:23:05.189040+0000","last_peered":"2024-09-14T11:23:05.189040+0000","last_clean":"2024-09-14T11:23:05.189040+0000","last_became_active":"2024-09-14T10:45:43.684504+0000","last_became_peered":"2024-09-14T10:45:43.684504+0000","last_unstale":"2024-09-14T11:23:05.189040+0000","last_undegraded":"2024-09-14T11:23:05.189040+0000","last_fullsized":"2024-09-14T11:23:05.189040+0000","mapping_epoch":23,"log_start":"260'400","ondisk_log_start":"260'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'450","last_scrub_stamp":"2024-09-14T11:23:05.188789+0000","last_deep_scrub":"260'450","last_deep_scrub_stamp":"2024-09-14T11:23:05.188789+0000","last_clean_scrub_stamp":"2024-09-14T11:23:05.188789+0000","objects_scrubbed":9,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:06.893489+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133694,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":846,"num_read_kb":75778,"num_write":1426,"num_write_kb":37052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":486,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:26.201687+0000","last_change":"2024-09-14T11:23:26.201687+0000","last_active":"2024-09-14T11:23:26.201687+0000","last_peered":"2024-09-14T11:23:26.201687+0000","last_clean":"2024-09-14T11:23:26.201687+0000","last_became_active":"2024-09-14T10:45:47.730629+0000","last_became_peered":"2024-09-14T10:45:47.730629+0000","last_unstale":"2024-09-14T11:23:26.201687+0000","last_undegraded":"2024-09-14T11:23:26.201687+0000","last_fullsized":"2024-09-14T11:23:26.201687+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:26.201579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:26.201579+0000","last_clean_scrub_stamp":"2024-09-14T11:23:26.201579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:45.423285+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"260'338","reported_seq":933,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:24.687756+0000","last_change":"2024-09-14T11:23:24.687756+0000","last_active":"2024-09-14T11:23:24.687756+0000","last_peered":"2024-09-14T11:23:24.687756+0000","last_clean":"2024-09-14T11:23:24.687756+0000","last_became_active":"2024-09-14T10:45:49.733770+0000","last_became_peered":"2024-09-14T10:45:49.733770+0000","last_unstale":"2024-09-14T11:23:24.687756+0000","last_undegraded":"2024-09-14T11:23:24.687756+0000","last_fullsized":"2024-09-14T11:23:24.687756+0000","mapping_epoch":30,"log_start":"260'300","ondisk_log_start":"260'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'338","last_scrub_stamp":"2024-09-14T11:23:24.687646+0000","last_deep_scrub":"260'338","last_deep_scrub_stamp":"2024-09-14T11:23:24.687646+0000","last_clean_scrub_stamp":"2024-09-14T11:23:24.687646+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:56.364701+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49773,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":530,"num_read_kb":1113,"num_write":424,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:19.613258+0000","last_change":"2024-09-14T11:23:19.613258+0000","last_active":"2024-09-14T11:23:19.613258+0000","last_peered":"2024-09-14T11:23:19.613258+0000","last_clean":"2024-09-14T11:23:19.613258+0000","last_became_active":"2024-09-14T10:45:51.745410+0000","last_became_peered":"2024-09-14T10:45:51.745410+0000","last_unstale":"2024-09-14T11:23:19.613258+0000","last_undegraded":"2024-09-14T11:23:19.613258+0000","last_fullsized":"2024-09-14T11:23:19.613258+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:19.613177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:19.613177+0000","last_clean_scrub_stamp":"2024-09-14T11:23:19.613177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:29:07.940790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"260'96","reported_seq":580,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:25.560729+0000","last_change":"2024-09-14T11:23:25.560729+0000","last_active":"2024-09-14T11:23:25.560729+0000","last_peered":"2024-09-14T11:23:25.560729+0000","last_clean":"2024-09-14T11:23:25.560729+0000","last_became_active":"2024-09-14T10:45:53.743472+0000","last_became_peered":"2024-09-14T10:45:53.743472+0000","last_unstale":"2024-09-14T11:23:25.560729+0000","last_undegraded":"2024-09-14T11:23:25.560729+0000","last_fullsized":"2024-09-14T11:23:25.560729+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'96","last_scrub_stamp":"2024-09-14T11:23:25.560642+0000","last_deep_scrub":"260'96","last_deep_scrub_stamp":"2024-09-14T11:23:25.560642+0000","last_clean_scrub_stamp":"2024-09-14T11:23:25.560642+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:20.792449+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":73,"num_read_kb":72,"num_write":215,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"260'380","reported_seq":1794,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:16.212298+0000","last_change":"2024-09-14T11:23:16.212298+0000","last_active":"2024-09-14T11:23:16.212298+0000","last_peered":"2024-09-14T11:23:16.212298+0000","last_clean":"2024-09-14T11:23:16.212298+0000","last_became_active":"2024-09-14T10:45:45.713502+0000","last_became_peered":"2024-09-14T10:45:45.713502+0000","last_unstale":"2024-09-14T11:23:16.212298+0000","last_undegraded":"2024-09-14T11:23:16.212298+0000","last_fullsized":"2024-09-14T11:23:16.212298+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'380","last_scrub_stamp":"2024-09-14T11:23:16.212209+0000","last_deep_scrub":"260'380","last_deep_scrub_stamp":"2024-09-14T11:23:16.212209+0000","last_clean_scrub_stamp":"2024-09-14T11:23:16.212209+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:05.789118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2020,"num_read_kb":1909,"num_write":423,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"260'306","reported_seq":1044,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:57.547642+0000","last_change":"2024-09-14T11:22:57.547580+0000","last_active":"2024-09-14T11:22:57.547642+0000","last_peered":"2024-09-14T11:22:57.547642+0000","last_clean":"2024-09-14T11:22:57.547642+0000","last_became_active":"2024-09-14T10:45:43.683964+0000","last_became_peered":"2024-09-14T10:45:43.683964+0000","last_unstale":"2024-09-14T11:22:57.547642+0000","last_undegraded":"2024-09-14T11:22:57.547642+0000","last_fullsized":"2024-09-14T11:22:57.547642+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'306","last_scrub_stamp":"2024-09-14T11:22:57.547454+0000","last_deep_scrub":"260'306","last_deep_scrub_stamp":"2024-09-14T11:22:57.547454+0000","last_clean_scrub_stamp":"2024-09-14T11:22:57.547454+0000","objects_scrubbed":7,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:59.621447+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133715,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":687,"num_read_kb":39643,"num_write":1073,"num_write_kb":23617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":493,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:16.803040+0000","last_change":"2024-09-14T11:23:16.803040+0000","last_active":"2024-09-14T11:23:16.803040+0000","last_peered":"2024-09-14T11:23:16.803040+0000","last_clean":"2024-09-14T11:23:16.803040+0000","last_became_active":"2024-09-14T10:45:47.729871+0000","last_became_peered":"2024-09-14T10:45:47.729871+0000","last_unstale":"2024-09-14T11:23:16.803040+0000","last_undegraded":"2024-09-14T11:23:16.803040+0000","last_fullsized":"2024-09-14T11:23:16.803040+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:16.802954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:16.802954+0000","last_clean_scrub_stamp":"2024-09-14T11:23:16.802954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:57.985108+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"260'87","reported_seq":603,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:16.577922+0000","last_change":"2024-09-14T11:23:16.577922+0000","last_active":"2024-09-14T11:23:16.577922+0000","last_peered":"2024-09-14T11:23:16.577922+0000","last_clean":"2024-09-14T11:23:16.577922+0000","last_became_active":"2024-09-14T10:45:49.732459+0000","last_became_peered":"2024-09-14T10:45:49.732459+0000","last_unstale":"2024-09-14T11:23:16.577922+0000","last_undegraded":"2024-09-14T11:23:16.577922+0000","last_fullsized":"2024-09-14T11:23:16.577922+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'87","last_scrub_stamp":"2024-09-14T11:23:16.577822+0000","last_deep_scrub":"260'87","last_deep_scrub_stamp":"2024-09-14T11:23:16.577822+0000","last_clean_scrub_stamp":"2024-09-14T11:23:16.577822+0000","objects_scrubbed":3,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:42.355440+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":84,"num_read_kb":79,"num_write":56,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:20.619631+0000","last_change":"2024-09-14T11:23:20.619631+0000","last_active":"2024-09-14T11:23:20.619631+0000","last_peered":"2024-09-14T11:23:20.619631+0000","last_clean":"2024-09-14T11:23:20.619631+0000","last_became_active":"2024-09-14T10:45:51.746608+0000","last_became_peered":"2024-09-14T10:45:51.746608+0000","last_unstale":"2024-09-14T11:23:20.619631+0000","last_undegraded":"2024-09-14T11:23:20.619631+0000","last_fullsized":"2024-09-14T11:23:20.619631+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:20.619548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:20.619548+0000","last_clean_scrub_stamp":"2024-09-14T11:23:20.619548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:01:42.667309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"260'131","reported_seq":629,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:23.276123+0000","last_change":"2024-09-14T11:23:23.276065+0000","last_active":"2024-09-14T11:23:23.276123+0000","last_peered":"2024-09-14T11:23:23.276123+0000","last_clean":"2024-09-14T11:23:23.276123+0000","last_became_active":"2024-09-14T10:45:53.752597+0000","last_became_peered":"2024-09-14T10:45:53.752597+0000","last_unstale":"2024-09-14T11:23:23.276123+0000","last_undegraded":"2024-09-14T11:23:23.276123+0000","last_fullsized":"2024-09-14T11:23:23.276123+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'131","last_scrub_stamp":"2024-09-14T11:23:23.275972+0000","last_deep_scrub":"260'131","last_deep_scrub_stamp":"2024-09-14T11:23:23.275972+0000","last_clean_scrub_stamp":"2024-09-14T11:23:23.275972+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:29.008656+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":152,"num_read_kb":142,"num_write":295,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"260'1285","reported_seq":2999,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:13.319725+0000","last_change":"2024-09-14T11:23:13.319725+0000","last_active":"2024-09-14T11:23:13.319725+0000","last_peered":"2024-09-14T11:23:13.319725+0000","last_clean":"2024-09-14T11:23:13.319725+0000","last_became_active":"2024-09-14T10:45:45.725335+0000","last_became_peered":"2024-09-14T10:45:45.725335+0000","last_unstale":"2024-09-14T11:23:13.319725+0000","last_undegraded":"2024-09-14T11:23:13.319725+0000","last_fullsized":"2024-09-14T11:23:13.319725+0000","mapping_epoch":26,"log_start":"260'1200","ondisk_log_start":"260'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1285","last_scrub_stamp":"2024-09-14T11:23:13.319628+0000","last_deep_scrub":"260'1285","last_deep_scrub_stamp":"2024-09-14T11:23:13.319628+0000","last_clean_scrub_stamp":"2024-09-14T11:23:13.319628+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":1200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:13:10.353579+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5911,"num_read_kb":5224,"num_write":1759,"num_write_kb":730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":714,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"260'352","reported_seq":1010,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:04.223440+0000","last_change":"2024-09-14T11:23:04.223378+0000","last_active":"2024-09-14T11:23:04.223440+0000","last_peered":"2024-09-14T11:23:04.223440+0000","last_clean":"2024-09-14T11:23:04.223440+0000","last_became_active":"2024-09-14T10:45:43.671096+0000","last_became_peered":"2024-09-14T10:45:43.671096+0000","last_unstale":"2024-09-14T11:23:04.223440+0000","last_undegraded":"2024-09-14T11:23:04.223440+0000","last_fullsized":"2024-09-14T11:23:04.223440+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'352","last_scrub_stamp":"2024-09-14T11:23:04.223284+0000","last_deep_scrub":"260'352","last_deep_scrub_stamp":"2024-09-14T11:23:04.223284+0000","last_clean_scrub_stamp":"2024-09-14T11:23:04.223284+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:49.941234+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":684,"num_read_kb":57141,"num_write":1087,"num_write_kb":43933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":492,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:17.805428+0000","last_change":"2024-09-14T11:23:17.805428+0000","last_active":"2024-09-14T11:23:17.805428+0000","last_peered":"2024-09-14T11:23:17.805428+0000","last_clean":"2024-09-14T11:23:17.805428+0000","last_became_active":"2024-09-14T10:45:47.724723+0000","last_became_peered":"2024-09-14T10:45:47.724723+0000","last_unstale":"2024-09-14T11:23:17.805428+0000","last_undegraded":"2024-09-14T11:23:17.805428+0000","last_fullsized":"2024-09-14T11:23:17.805428+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:17.805338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:17.805338+0000","last_clean_scrub_stamp":"2024-09-14T11:23:17.805338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:19.893049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"260'116","reported_seq":641,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:22.729795+0000","last_change":"2024-09-14T11:23:22.729795+0000","last_active":"2024-09-14T11:23:22.729795+0000","last_peered":"2024-09-14T11:23:22.729795+0000","last_clean":"2024-09-14T11:23:22.729795+0000","last_became_active":"2024-09-14T10:45:49.737651+0000","last_became_peered":"2024-09-14T10:45:49.737651+0000","last_unstale":"2024-09-14T11:23:22.729795+0000","last_undegraded":"2024-09-14T11:23:22.729795+0000","last_fullsized":"2024-09-14T11:23:22.729795+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'116","last_scrub_stamp":"2024-09-14T11:23:22.729700+0000","last_deep_scrub":"260'116","last_deep_scrub_stamp":"2024-09-14T11:23:22.729700+0000","last_clean_scrub_stamp":"2024-09-14T11:23:22.729700+0000","objects_scrubbed":6,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:57:47.520816+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":106,"num_write":82,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"260'808","reported_seq":4493,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:51.153298+0000","last_change":"2024-09-14T10:45:51.746239+0000","last_active":"2024-09-14T11:22:51.153298+0000","last_peered":"2024-09-14T11:22:51.153298+0000","last_clean":"2024-09-14T11:22:51.153298+0000","last_became_active":"2024-09-14T10:45:51.745441+0000","last_became_peered":"2024-09-14T10:45:51.745441+0000","last_unstale":"2024-09-14T11:22:51.153298+0000","last_undegraded":"2024-09-14T11:22:51.153298+0000","last_fullsized":"2024-09-14T11:22:51.153298+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:37.532791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"260'213","reported_seq":1027,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:22.441121+0000","last_change":"2024-09-14T11:23:22.441065+0000","last_active":"2024-09-14T11:23:22.441121+0000","last_peered":"2024-09-14T11:23:22.441121+0000","last_clean":"2024-09-14T11:23:22.441121+0000","last_became_active":"2024-09-14T10:45:53.753389+0000","last_became_peered":"2024-09-14T10:45:53.753389+0000","last_unstale":"2024-09-14T11:23:22.441121+0000","last_undegraded":"2024-09-14T11:23:22.441121+0000","last_fullsized":"2024-09-14T11:23:22.441121+0000","mapping_epoch":34,"log_start":"260'200","ondisk_log_start":"260'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'213","last_scrub_stamp":"2024-09-14T11:23:22.440984+0000","last_deep_scrub":"260'213","last_deep_scrub_stamp":"2024-09-14T11:23:22.440984+0000","last_clean_scrub_stamp":"2024-09-14T11:23:22.440984+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:20.195872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":623,"num_read_kb":614,"num_write":459,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"260'902","reported_seq":2545,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:12.363681+0000","last_change":"2024-09-14T11:23:12.363681+0000","last_active":"2024-09-14T11:23:12.363681+0000","last_peered":"2024-09-14T11:23:12.363681+0000","last_clean":"2024-09-14T11:23:12.363681+0000","last_became_active":"2024-09-14T10:45:45.725700+0000","last_became_peered":"2024-09-14T10:45:45.725700+0000","last_unstale":"2024-09-14T11:23:12.363681+0000","last_undegraded":"2024-09-14T11:23:12.363681+0000","last_fullsized":"2024-09-14T11:23:12.363681+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'902","last_scrub_stamp":"2024-09-14T11:23:12.363569+0000","last_deep_scrub":"260'902","last_deep_scrub_stamp":"2024-09-14T11:23:12.363569+0000","last_clean_scrub_stamp":"2024-09-14T11:23:12.363569+0000","objects_scrubbed":2,"log_size":102,"log_dups_size":800,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:00:47.995104+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4396,"num_read_kb":3931,"num_write":1208,"num_write_kb":463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2043,"num_omap_keys":8,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"260'381","reported_seq":1029,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:56.685332+0000","last_change":"2024-09-14T11:22:56.685284+0000","last_active":"2024-09-14T11:22:56.685332+0000","last_peered":"2024-09-14T11:22:56.685332+0000","last_clean":"2024-09-14T11:22:56.685332+0000","last_became_active":"2024-09-14T10:45:43.683274+0000","last_became_peered":"2024-09-14T10:45:43.683274+0000","last_unstale":"2024-09-14T11:22:56.685332+0000","last_undegraded":"2024-09-14T11:22:56.685332+0000","last_fullsized":"2024-09-14T11:22:56.685332+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'381","last_scrub_stamp":"2024-09-14T11:22:56.685220+0000","last_deep_scrub":"260'381","last_deep_scrub_stamp":"2024-09-14T11:22:56.685220+0000","last_clean_scrub_stamp":"2024-09-14T11:22:56.685220+0000","objects_scrubbed":4,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:15.447942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":697,"num_read_kb":4530,"num_write":1135,"num_write_kb":39150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":486,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:27.203464+0000","last_change":"2024-09-14T11:23:27.203464+0000","last_active":"2024-09-14T11:23:27.203464+0000","last_peered":"2024-09-14T11:23:27.203464+0000","last_clean":"2024-09-14T11:23:27.203464+0000","last_became_active":"2024-09-14T10:45:47.729004+0000","last_became_peered":"2024-09-14T10:45:47.729004+0000","last_unstale":"2024-09-14T11:23:27.203464+0000","last_undegraded":"2024-09-14T11:23:27.203464+0000","last_fullsized":"2024-09-14T11:23:27.203464+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:27.203341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:27.203341+0000","last_clean_scrub_stamp":"2024-09-14T11:23:27.203341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:41.034676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"260'260","reported_seq":812,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:11.406541+0000","last_change":"2024-09-14T11:23:11.406541+0000","last_active":"2024-09-14T11:23:11.406541+0000","last_peered":"2024-09-14T11:23:11.406541+0000","last_clean":"2024-09-14T11:23:11.406541+0000","last_became_active":"2024-09-14T10:45:49.728896+0000","last_became_peered":"2024-09-14T10:45:49.728896+0000","last_unstale":"2024-09-14T11:23:11.406541+0000","last_undegraded":"2024-09-14T11:23:11.406541+0000","last_fullsized":"2024-09-14T11:23:11.406541+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'260","last_scrub_stamp":"2024-09-14T11:23:11.406439+0000","last_deep_scrub":"260'260","last_deep_scrub_stamp":"2024-09-14T11:23:11.406439+0000","last_clean_scrub_stamp":"2024-09-14T11:23:11.406439+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:13.056696+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42620,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":444,"num_read_kb":1063,"num_write":366,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"260'805","reported_seq":3886,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:27.542342+0000","last_change":"2024-09-14T11:23:27.542342+0000","last_active":"2024-09-14T11:23:27.542342+0000","last_peered":"2024-09-14T11:23:27.542342+0000","last_clean":"2024-09-14T11:23:27.542342+0000","last_became_active":"2024-09-14T10:45:51.744510+0000","last_became_peered":"2024-09-14T10:45:51.744510+0000","last_unstale":"2024-09-14T11:23:27.542342+0000","last_undegraded":"2024-09-14T11:23:27.542342+0000","last_fullsized":"2024-09-14T11:23:27.542342+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'805","last_scrub_stamp":"2024-09-14T11:23:27.542254+0000","last_deep_scrub":"260'805","last_deep_scrub_stamp":"2024-09-14T11:23:27.542254+0000","last_clean_scrub_stamp":"2024-09-14T11:23:27.542254+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:20.313299+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"260'641","reported_seq":2336,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:13.170714+0000","last_change":"2024-09-14T11:23:13.170714+0000","last_active":"2024-09-14T11:23:13.170714+0000","last_peered":"2024-09-14T11:23:13.170714+0000","last_clean":"2024-09-14T11:23:13.170714+0000","last_became_active":"2024-09-14T10:45:45.716537+0000","last_became_peered":"2024-09-14T10:45:45.716537+0000","last_unstale":"2024-09-14T11:23:13.170714+0000","last_undegraded":"2024-09-14T11:23:13.170714+0000","last_fullsized":"2024-09-14T11:23:13.170714+0000","mapping_epoch":26,"log_start":"260'600","ondisk_log_start":"260'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'641","last_scrub_stamp":"2024-09-14T11:23:13.170614+0000","last_deep_scrub":"260'641","last_deep_scrub_stamp":"2024-09-14T11:23:13.170614+0000","last_clean_scrub_stamp":"2024-09-14T11:23:13.170614+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":600,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:09.840189+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3192,"num_read_kb":2926,"num_write":775,"num_write_kb":229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1720,"num_omap_keys":8,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"260'311","reported_seq":921,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:59.747594+0000","last_change":"2024-09-14T11:22:59.747594+0000","last_active":"2024-09-14T11:22:59.747594+0000","last_peered":"2024-09-14T11:22:59.747594+0000","last_clean":"2024-09-14T11:22:59.747594+0000","last_became_active":"2024-09-14T10:46:20.045945+0000","last_became_peered":"2024-09-14T10:46:20.045945+0000","last_unstale":"2024-09-14T11:22:59.747594+0000","last_undegraded":"2024-09-14T11:22:59.747594+0000","last_fullsized":"2024-09-14T11:22:59.747594+0000","mapping_epoch":37,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'311","last_scrub_stamp":"2024-09-14T11:22:59.747508+0000","last_deep_scrub":"260'311","last_deep_scrub_stamp":"2024-09-14T11:22:59.747508+0000","last_clean_scrub_stamp":"2024-09-14T11:22:59.747508+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":200,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:23.526580+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":633,"num_read_kb":12757,"num_write":988,"num_write_kb":36887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":494,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:10.598893+0000","last_change":"2024-09-14T11:23:10.598893+0000","last_active":"2024-09-14T11:23:10.598893+0000","last_peered":"2024-09-14T11:23:10.598893+0000","last_clean":"2024-09-14T11:23:10.598893+0000","last_became_active":"2024-09-14T10:45:47.720639+0000","last_became_peered":"2024-09-14T10:45:47.720639+0000","last_unstale":"2024-09-14T11:23:10.598893+0000","last_undegraded":"2024-09-14T11:23:10.598893+0000","last_fullsized":"2024-09-14T11:23:10.598893+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:10.598806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:10.598806+0000","last_clean_scrub_stamp":"2024-09-14T11:23:10.598806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:01.115042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"260'357","reported_seq":957,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:14.636173+0000","last_change":"2024-09-14T11:23:14.636173+0000","last_active":"2024-09-14T11:23:14.636173+0000","last_peered":"2024-09-14T11:23:14.636173+0000","last_clean":"2024-09-14T11:23:14.636173+0000","last_became_active":"2024-09-14T10:45:49.732754+0000","last_became_peered":"2024-09-14T10:45:49.732754+0000","last_unstale":"2024-09-14T11:23:14.636173+0000","last_undegraded":"2024-09-14T11:23:14.636173+0000","last_fullsized":"2024-09-14T11:23:14.636173+0000","mapping_epoch":30,"log_start":"260'300","ondisk_log_start":"260'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'357","last_scrub_stamp":"2024-09-14T11:23:14.636077+0000","last_deep_scrub":"260'357","last_deep_scrub_stamp":"2024-09-14T11:23:14.636077+0000","last_clean_scrub_stamp":"2024-09-14T11:23:14.636077+0000","objects_scrubbed":10,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:57.050795+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99406,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":572,"num_read_kb":1321,"num_write":460,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":479,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:21.214100+0000","last_change":"2024-09-14T11:23:21.214100+0000","last_active":"2024-09-14T11:23:21.214100+0000","last_peered":"2024-09-14T11:23:21.214100+0000","last_clean":"2024-09-14T11:23:21.214100+0000","last_became_active":"2024-09-14T10:45:51.746282+0000","last_became_peered":"2024-09-14T10:45:51.746282+0000","last_unstale":"2024-09-14T11:23:21.214100+0000","last_undegraded":"2024-09-14T11:23:21.214100+0000","last_fullsized":"2024-09-14T11:23:21.214100+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:21.214002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:21.214002+0000","last_clean_scrub_stamp":"2024-09-14T11:23:21.214002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:46.235673+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"260'562","reported_seq":1368,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:19.476331+0000","last_change":"2024-09-14T11:23:19.476270+0000","last_active":"2024-09-14T11:23:19.476331+0000","last_peered":"2024-09-14T11:23:19.476331+0000","last_clean":"2024-09-14T11:23:19.476331+0000","last_became_active":"2024-09-14T10:45:53.755505+0000","last_became_peered":"2024-09-14T10:45:53.755505+0000","last_unstale":"2024-09-14T11:23:19.476331+0000","last_undegraded":"2024-09-14T11:23:19.476331+0000","last_fullsized":"2024-09-14T11:23:19.476331+0000","mapping_epoch":34,"log_start":"260'500","ondisk_log_start":"260'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'562","last_scrub_stamp":"2024-09-14T11:23:19.476200+0000","last_deep_scrub":"260'562","last_deep_scrub_stamp":"2024-09-14T11:23:19.476200+0000","last_clean_scrub_stamp":"2024-09-14T11:23:19.476200+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":500,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:15.664428+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1310,"num_read_kb":1299,"num_write":1164,"num_write_kb":395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"260'608","reported_seq":2252,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:01.654181+0000","last_change":"2024-09-14T11:23:01.654181+0000","last_active":"2024-09-14T11:23:01.654181+0000","last_peered":"2024-09-14T11:23:01.654181+0000","last_clean":"2024-09-14T11:23:01.654181+0000","last_became_active":"2024-09-14T10:45:45.726869+0000","last_became_peered":"2024-09-14T10:45:45.726869+0000","last_unstale":"2024-09-14T11:23:01.654181+0000","last_undegraded":"2024-09-14T11:23:01.654181+0000","last_fullsized":"2024-09-14T11:23:01.654181+0000","mapping_epoch":26,"log_start":"260'500","ondisk_log_start":"260'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'608","last_scrub_stamp":"2024-09-14T11:23:01.654096+0000","last_deep_scrub":"260'608","last_deep_scrub_stamp":"2024-09-14T11:23:01.654096+0000","last_clean_scrub_stamp":"2024-09-14T11:23:01.654096+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":500,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:34.095164+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3274,"num_read_kb":2999,"num_write":839,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"260'390","reported_seq":1058,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:57.186256+0000","last_change":"2024-09-14T11:22:57.186256+0000","last_active":"2024-09-14T11:22:57.186256+0000","last_peered":"2024-09-14T11:22:57.186256+0000","last_clean":"2024-09-14T11:22:57.186256+0000","last_became_active":"2024-09-14T10:45:43.685087+0000","last_became_peered":"2024-09-14T10:45:43.685087+0000","last_unstale":"2024-09-14T11:22:57.186256+0000","last_undegraded":"2024-09-14T11:22:57.186256+0000","last_fullsized":"2024-09-14T11:22:57.186256+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'390","last_scrub_stamp":"2024-09-14T11:22:57.186147+0000","last_deep_scrub":"260'390","last_deep_scrub_stamp":"2024-09-14T11:22:57.186147+0000","last_clean_scrub_stamp":"2024-09-14T11:22:57.186147+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:33.020000+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":736,"num_read_kb":49067,"num_write":1293,"num_write_kb":21177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:11.277931+0000","last_change":"2024-09-14T11:23:11.277931+0000","last_active":"2024-09-14T11:23:11.277931+0000","last_peered":"2024-09-14T11:23:11.277931+0000","last_clean":"2024-09-14T11:23:11.277931+0000","last_became_active":"2024-09-14T10:45:47.727250+0000","last_became_peered":"2024-09-14T10:45:47.727250+0000","last_unstale":"2024-09-14T11:23:11.277931+0000","last_undegraded":"2024-09-14T11:23:11.277931+0000","last_fullsized":"2024-09-14T11:23:11.277931+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:11.277843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:11.277843+0000","last_clean_scrub_stamp":"2024-09-14T11:23:11.277843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:58:14.240440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"260'259","reported_seq":821,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:20.713621+0000","last_change":"2024-09-14T11:23:20.713621+0000","last_active":"2024-09-14T11:23:20.713621+0000","last_peered":"2024-09-14T11:23:20.713621+0000","last_clean":"2024-09-14T11:23:20.713621+0000","last_became_active":"2024-09-14T10:45:49.735124+0000","last_became_peered":"2024-09-14T10:45:49.735124+0000","last_unstale":"2024-09-14T11:23:20.713621+0000","last_undegraded":"2024-09-14T11:23:20.713621+0000","last_fullsized":"2024-09-14T11:23:20.713621+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'259","last_scrub_stamp":"2024-09-14T11:23:20.713538+0000","last_deep_scrub":"260'259","last_deep_scrub_stamp":"2024-09-14T11:23:20.713538+0000","last_clean_scrub_stamp":"2024-09-14T11:23:20.713538+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:07:37.494555+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45256,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":435,"num_read_kb":1035,"num_write":356,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":486,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:28.659376+0000","last_change":"2024-09-14T11:23:28.659376+0000","last_active":"2024-09-14T11:23:28.659376+0000","last_peered":"2024-09-14T11:23:28.659376+0000","last_clean":"2024-09-14T11:23:28.659376+0000","last_became_active":"2024-09-14T10:45:51.744757+0000","last_became_peered":"2024-09-14T10:45:51.744757+0000","last_unstale":"2024-09-14T11:23:28.659376+0000","last_undegraded":"2024-09-14T11:23:28.659376+0000","last_fullsized":"2024-09-14T11:23:28.659376+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:28.659275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:28.659275+0000","last_clean_scrub_stamp":"2024-09-14T11:23:28.659275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:33.963832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"260'2451","reported_seq":4270,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:22.593366+0000","last_change":"2024-09-14T11:23:22.593262+0000","last_active":"2024-09-14T11:23:22.593366+0000","last_peered":"2024-09-14T11:23:22.593366+0000","last_clean":"2024-09-14T11:23:22.593366+0000","last_became_active":"2024-09-14T10:45:53.752708+0000","last_became_peered":"2024-09-14T10:45:53.752708+0000","last_unstale":"2024-09-14T11:23:22.593366+0000","last_undegraded":"2024-09-14T11:23:22.593366+0000","last_fullsized":"2024-09-14T11:23:22.593366+0000","mapping_epoch":34,"log_start":"260'2400","ondisk_log_start":"260'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2451","last_scrub_stamp":"2024-09-14T11:23:22.593158+0000","last_deep_scrub":"260'2451","last_deep_scrub_stamp":"2024-09-14T11:23:22.593158+0000","last_clean_scrub_stamp":"2024-09-14T11:23:22.593158+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":2400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:55.784277+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6140,"num_read_kb":6145,"num_write":4932,"num_write_kb":1822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"260'761","reported_seq":2474,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:08.293507+0000","last_change":"2024-09-14T11:23:08.293507+0000","last_active":"2024-09-14T11:23:08.293507+0000","last_peered":"2024-09-14T11:23:08.293507+0000","last_clean":"2024-09-14T11:23:08.293507+0000","last_became_active":"2024-09-14T10:45:45.722006+0000","last_became_peered":"2024-09-14T10:45:45.722006+0000","last_unstale":"2024-09-14T11:23:08.293507+0000","last_undegraded":"2024-09-14T11:23:08.293507+0000","last_fullsized":"2024-09-14T11:23:08.293507+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'761","last_scrub_stamp":"2024-09-14T11:23:08.293416+0000","last_deep_scrub":"260'761","last_deep_scrub_stamp":"2024-09-14T11:23:08.293416+0000","last_clean_scrub_stamp":"2024-09-14T11:23:08.293416+0000","objects_scrubbed":4,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:13:56.536477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4059,"num_read_kb":3717,"num_write":984,"num_write_kb":359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4086,"num_omap_keys":16,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"260'375","reported_seq":1021,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:02.277049+0000","last_change":"2024-09-14T11:23:02.277049+0000","last_active":"2024-09-14T11:23:02.277049+0000","last_peered":"2024-09-14T11:23:02.277049+0000","last_clean":"2024-09-14T11:23:02.277049+0000","last_became_active":"2024-09-14T10:45:43.675954+0000","last_became_peered":"2024-09-14T10:45:43.675954+0000","last_unstale":"2024-09-14T11:23:02.277049+0000","last_undegraded":"2024-09-14T11:23:02.277049+0000","last_fullsized":"2024-09-14T11:23:02.277049+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'375","last_scrub_stamp":"2024-09-14T11:23:02.276946+0000","last_deep_scrub":"260'375","last_deep_scrub_stamp":"2024-09-14T11:23:02.276946+0000","last_clean_scrub_stamp":"2024-09-14T11:23:02.276946+0000","objects_scrubbed":6,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:47.616118+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":645,"num_read_kb":32892,"num_write":1136,"num_write_kb":70045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"260'6","reported_seq":967,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:19.375400+0000","last_change":"2024-09-14T11:23:19.375400+0000","last_active":"2024-09-14T11:23:19.375400+0000","last_peered":"2024-09-14T11:23:19.375400+0000","last_clean":"2024-09-14T11:23:19.375400+0000","last_became_active":"2024-09-14T10:45:47.723389+0000","last_became_peered":"2024-09-14T10:45:47.723389+0000","last_unstale":"2024-09-14T11:23:19.375400+0000","last_undegraded":"2024-09-14T11:23:19.375400+0000","last_fullsized":"2024-09-14T11:23:19.375400+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-14T11:23:19.375250+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-14T11:23:19.375250+0000","last_clean_scrub_stamp":"2024-09-14T11:23:19.375250+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:04:49.975519+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"260'279","reported_seq":848,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:30.260836+0000","last_change":"2024-09-14T11:23:30.260836+0000","last_active":"2024-09-14T11:23:30.260836+0000","last_peered":"2024-09-14T11:23:30.260836+0000","last_clean":"2024-09-14T11:23:30.260836+0000","last_became_active":"2024-09-14T10:45:49.729120+0000","last_became_peered":"2024-09-14T10:45:49.729120+0000","last_unstale":"2024-09-14T11:23:30.260836+0000","last_undegraded":"2024-09-14T11:23:30.260836+0000","last_fullsized":"2024-09-14T11:23:30.260836+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'279","last_scrub_stamp":"2024-09-14T11:23:30.260726+0000","last_deep_scrub":"260'279","last_deep_scrub_stamp":"2024-09-14T11:23:30.260726+0000","last_clean_scrub_stamp":"2024-09-14T11:23:30.260726+0000","objects_scrubbed":7,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:13:27.531076+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43970,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":444,"num_read_kb":984,"num_write":354,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"260'805","reported_seq":2513,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:26.502137+0000","last_change":"2024-09-14T11:23:26.502137+0000","last_active":"2024-09-14T11:23:26.502137+0000","last_peered":"2024-09-14T11:23:26.502137+0000","last_clean":"2024-09-14T11:23:26.502137+0000","last_became_active":"2024-09-14T10:45:51.744869+0000","last_became_peered":"2024-09-14T10:45:51.744869+0000","last_unstale":"2024-09-14T11:23:26.502137+0000","last_undegraded":"2024-09-14T11:23:26.502137+0000","last_fullsized":"2024-09-14T11:23:26.502137+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'805","last_scrub_stamp":"2024-09-14T11:23:26.502056+0000","last_deep_scrub":"260'805","last_deep_scrub_stamp":"2024-09-14T11:23:26.502056+0000","last_clean_scrub_stamp":"2024-09-14T11:23:26.502056+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:05.497437+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"260'166","reported_seq":648,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:22.233284+0000","last_change":"2024-09-14T11:23:22.233284+0000","last_active":"2024-09-14T11:23:22.233284+0000","last_peered":"2024-09-14T11:23:22.233284+0000","last_clean":"2024-09-14T11:23:22.233284+0000","last_became_active":"2024-09-14T10:45:53.755367+0000","last_became_peered":"2024-09-14T10:45:53.755367+0000","last_unstale":"2024-09-14T11:23:22.233284+0000","last_undegraded":"2024-09-14T11:23:22.233284+0000","last_fullsized":"2024-09-14T11:23:22.233284+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'166","last_scrub_stamp":"2024-09-14T11:23:22.233186+0000","last_deep_scrub":"260'166","last_deep_scrub_stamp":"2024-09-14T11:23:22.233186+0000","last_clean_scrub_stamp":"2024-09-14T11:23:22.233186+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:09.280581+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":815,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":135,"num_read_kb":134,"num_write":407,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"260'763","reported_seq":2262,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:10.356193+0000","last_change":"2024-09-14T11:23:10.356193+0000","last_active":"2024-09-14T11:23:10.356193+0000","last_peered":"2024-09-14T11:23:10.356193+0000","last_clean":"2024-09-14T11:23:10.356193+0000","last_became_active":"2024-09-14T10:45:45.719864+0000","last_became_peered":"2024-09-14T10:45:45.719864+0000","last_unstale":"2024-09-14T11:23:10.356193+0000","last_undegraded":"2024-09-14T11:23:10.356193+0000","last_fullsized":"2024-09-14T11:23:10.356193+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'763","last_scrub_stamp":"2024-09-14T11:23:10.356108+0000","last_deep_scrub":"260'763","last_deep_scrub_stamp":"2024-09-14T11:23:10.356108+0000","last_clean_scrub_stamp":"2024-09-14T11:23:10.356108+0000","objects_scrubbed":2,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:25:13.250358+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3610,"num_read_kb":3266,"num_write":990,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"260'352","reported_seq":985,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:56.642945+0000","last_change":"2024-09-14T11:22:56.642945+0000","last_active":"2024-09-14T11:22:56.642945+0000","last_peered":"2024-09-14T11:22:56.642945+0000","last_clean":"2024-09-14T11:22:56.642945+0000","last_became_active":"2024-09-14T10:45:43.681137+0000","last_became_peered":"2024-09-14T10:45:43.681137+0000","last_unstale":"2024-09-14T11:22:56.642945+0000","last_undegraded":"2024-09-14T11:22:56.642945+0000","last_fullsized":"2024-09-14T11:22:56.642945+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'352","last_scrub_stamp":"2024-09-14T11:22:56.642848+0000","last_deep_scrub":"260'352","last_deep_scrub_stamp":"2024-09-14T11:22:56.642848+0000","last_clean_scrub_stamp":"2024-09-14T11:22:56.642848+0000","objects_scrubbed":6,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:18.121328+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":525,"num_read_kb":31159,"num_write":1040,"num_write_kb":37353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:12.307193+0000","last_change":"2024-09-14T11:23:12.307193+0000","last_active":"2024-09-14T11:23:12.307193+0000","last_peered":"2024-09-14T11:23:12.307193+0000","last_clean":"2024-09-14T11:23:12.307193+0000","last_became_active":"2024-09-14T10:45:47.729815+0000","last_became_peered":"2024-09-14T10:45:47.729815+0000","last_unstale":"2024-09-14T11:23:12.307193+0000","last_undegraded":"2024-09-14T11:23:12.307193+0000","last_fullsized":"2024-09-14T11:23:12.307193+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:12.307094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:12.307094+0000","last_clean_scrub_stamp":"2024-09-14T11:23:12.307094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:08.115928+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"260'516","reported_seq":1140,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:23.707399+0000","last_change":"2024-09-14T11:23:23.707399+0000","last_active":"2024-09-14T11:23:23.707399+0000","last_peered":"2024-09-14T11:23:23.707399+0000","last_clean":"2024-09-14T11:23:23.707399+0000","last_became_active":"2024-09-14T10:45:49.735297+0000","last_became_peered":"2024-09-14T10:45:49.735297+0000","last_unstale":"2024-09-14T11:23:23.707399+0000","last_undegraded":"2024-09-14T11:23:23.707399+0000","last_fullsized":"2024-09-14T11:23:23.707399+0000","mapping_epoch":30,"log_start":"260'501","ondisk_log_start":"260'501","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'516","last_scrub_stamp":"2024-09-14T11:23:23.707297+0000","last_deep_scrub":"260'516","last_deep_scrub_stamp":"2024-09-14T11:23:23.707297+0000","last_clean_scrub_stamp":"2024-09-14T11:23:23.707297+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":501,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:06.016393+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93593,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":881,"num_read_kb":2160,"num_write":740,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":479,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:25.476382+0000","last_change":"2024-09-14T11:23:25.476382+0000","last_active":"2024-09-14T11:23:25.476382+0000","last_peered":"2024-09-14T11:23:25.476382+0000","last_clean":"2024-09-14T11:23:25.476382+0000","last_became_active":"2024-09-14T10:45:51.749045+0000","last_became_peered":"2024-09-14T10:45:51.749045+0000","last_unstale":"2024-09-14T11:23:25.476382+0000","last_undegraded":"2024-09-14T11:23:25.476382+0000","last_fullsized":"2024-09-14T11:23:25.476382+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:25.476290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:25.476290+0000","last_clean_scrub_stamp":"2024-09-14T11:23:25.476290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:09.435011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"260'127","reported_seq":640,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:21.718946+0000","last_change":"2024-09-14T11:23:21.718946+0000","last_active":"2024-09-14T11:23:21.718946+0000","last_peered":"2024-09-14T11:23:21.718946+0000","last_clean":"2024-09-14T11:23:21.718946+0000","last_became_active":"2024-09-14T10:45:53.751736+0000","last_became_peered":"2024-09-14T10:45:53.751736+0000","last_unstale":"2024-09-14T11:23:21.718946+0000","last_undegraded":"2024-09-14T11:23:21.718946+0000","last_fullsized":"2024-09-14T11:23:21.718946+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'127","last_scrub_stamp":"2024-09-14T11:23:21.718860+0000","last_deep_scrub":"260'127","last_deep_scrub_stamp":"2024-09-14T11:23:21.718860+0000","last_clean_scrub_stamp":"2024-09-14T11:23:21.718860+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:51:05.364854+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":704,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":191,"num_read_kb":171,"num_write":290,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"260'1192","reported_seq":2750,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:02.564306+0000","last_change":"2024-09-14T11:23:02.564306+0000","last_active":"2024-09-14T11:23:02.564306+0000","last_peered":"2024-09-14T11:23:02.564306+0000","last_clean":"2024-09-14T11:23:02.564306+0000","last_became_active":"2024-09-14T10:45:45.714723+0000","last_became_peered":"2024-09-14T10:45:45.714723+0000","last_unstale":"2024-09-14T11:23:02.564306+0000","last_undegraded":"2024-09-14T11:23:02.564306+0000","last_fullsized":"2024-09-14T11:23:02.564306+0000","mapping_epoch":26,"log_start":"260'1100","ondisk_log_start":"260'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1192","last_scrub_stamp":"2024-09-14T11:23:02.564228+0000","last_deep_scrub":"260'1192","last_deep_scrub_stamp":"2024-09-14T11:23:02.564228+0000","last_clean_scrub_stamp":"2024-09-14T11:23:02.564228+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":1100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:57.673628+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5470,"num_read_kb":4821,"num_write":1659,"num_write_kb":709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"260'368","reported_seq":999,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:58.738182+0000","last_change":"2024-09-14T11:22:58.738182+0000","last_active":"2024-09-14T11:22:58.738182+0000","last_peered":"2024-09-14T11:22:58.738182+0000","last_clean":"2024-09-14T11:22:58.738182+0000","last_became_active":"2024-09-14T10:45:43.686531+0000","last_became_peered":"2024-09-14T10:45:43.686531+0000","last_unstale":"2024-09-14T11:22:58.738182+0000","last_undegraded":"2024-09-14T11:22:58.738182+0000","last_fullsized":"2024-09-14T11:22:58.738182+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'368","last_scrub_stamp":"2024-09-14T11:22:58.738083+0000","last_deep_scrub":"260'368","last_deep_scrub_stamp":"2024-09-14T11:22:58.738083+0000","last_clean_scrub_stamp":"2024-09-14T11:22:58.738083+0000","objects_scrubbed":5,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:58:54.493504+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133692,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":671,"num_read_kb":7607,"num_write":1262,"num_write_kb":48356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:11.697908+0000","last_change":"2024-09-14T11:23:11.697908+0000","last_active":"2024-09-14T11:23:11.697908+0000","last_peered":"2024-09-14T11:23:11.697908+0000","last_clean":"2024-09-14T11:23:11.697908+0000","last_became_active":"2024-09-14T10:45:47.728213+0000","last_became_peered":"2024-09-14T10:45:47.728213+0000","last_unstale":"2024-09-14T11:23:11.697908+0000","last_undegraded":"2024-09-14T11:23:11.697908+0000","last_fullsized":"2024-09-14T11:23:11.697908+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:11.697822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:11.697822+0000","last_clean_scrub_stamp":"2024-09-14T11:23:11.697822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:14:58.462465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"260'269","reported_seq":834,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:15.532763+0000","last_change":"2024-09-14T11:23:15.532763+0000","last_active":"2024-09-14T11:23:15.532763+0000","last_peered":"2024-09-14T11:23:15.532763+0000","last_clean":"2024-09-14T11:23:15.532763+0000","last_became_active":"2024-09-14T10:45:49.732813+0000","last_became_peered":"2024-09-14T10:45:49.732813+0000","last_unstale":"2024-09-14T11:23:15.532763+0000","last_undegraded":"2024-09-14T11:23:15.532763+0000","last_fullsized":"2024-09-14T11:23:15.532763+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'269","last_scrub_stamp":"2024-09-14T11:23:15.532664+0000","last_deep_scrub":"260'269","last_deep_scrub_stamp":"2024-09-14T11:23:15.532664+0000","last_clean_scrub_stamp":"2024-09-14T11:23:15.532664+0000","objects_scrubbed":7,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:03.580995+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14232,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":431,"num_read_kb":915,"num_write":388,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":481,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:15.618806+0000","last_change":"2024-09-14T11:23:15.618806+0000","last_active":"2024-09-14T11:23:15.618806+0000","last_peered":"2024-09-14T11:23:15.618806+0000","last_clean":"2024-09-14T11:23:15.618806+0000","last_became_active":"2024-09-14T10:45:51.748381+0000","last_became_peered":"2024-09-14T10:45:51.748381+0000","last_unstale":"2024-09-14T11:23:15.618806+0000","last_undegraded":"2024-09-14T11:23:15.618806+0000","last_fullsized":"2024-09-14T11:23:15.618806+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:15.618720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:15.618720+0000","last_clean_scrub_stamp":"2024-09-14T11:23:15.618720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:33:06.847139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"260'101","reported_seq":578,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:29.538661+0000","last_change":"2024-09-14T11:23:29.538661+0000","last_active":"2024-09-14T11:23:29.538661+0000","last_peered":"2024-09-14T11:23:29.538661+0000","last_clean":"2024-09-14T11:23:29.538661+0000","last_became_active":"2024-09-14T10:45:53.755022+0000","last_became_peered":"2024-09-14T10:45:53.755022+0000","last_unstale":"2024-09-14T11:23:29.538661+0000","last_undegraded":"2024-09-14T11:23:29.538661+0000","last_fullsized":"2024-09-14T11:23:29.538661+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'101","last_scrub_stamp":"2024-09-14T11:23:29.538571+0000","last_deep_scrub":"260'101","last_deep_scrub_stamp":"2024-09-14T11:23:29.538571+0000","last_clean_scrub_stamp":"2024-09-14T11:23:29.538571+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:37.419182+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":73,"num_read_kb":72,"num_write":223,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"260'436","reported_seq":1984,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:15.257923+0000","last_change":"2024-09-14T11:23:15.257923+0000","last_active":"2024-09-14T11:23:15.257923+0000","last_peered":"2024-09-14T11:23:15.257923+0000","last_clean":"2024-09-14T11:23:15.257923+0000","last_became_active":"2024-09-14T10:45:45.710367+0000","last_became_peered":"2024-09-14T10:45:45.710367+0000","last_unstale":"2024-09-14T11:23:15.257923+0000","last_undegraded":"2024-09-14T11:23:15.257923+0000","last_fullsized":"2024-09-14T11:23:15.257923+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'436","last_scrub_stamp":"2024-09-14T11:23:15.257828+0000","last_deep_scrub":"260'436","last_deep_scrub_stamp":"2024-09-14T11:23:15.257828+0000","last_clean_scrub_stamp":"2024-09-14T11:23:15.257828+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:59.527838+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2526,"num_read_kb":2387,"num_write":527,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"260'332","reported_seq":1023,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:01.297073+0000","last_change":"2024-09-14T11:23:01.297073+0000","last_active":"2024-09-14T11:23:01.297073+0000","last_peered":"2024-09-14T11:23:01.297073+0000","last_clean":"2024-09-14T11:23:01.297073+0000","last_became_active":"2024-09-14T10:45:43.676514+0000","last_became_peered":"2024-09-14T10:45:43.676514+0000","last_unstale":"2024-09-14T11:23:01.297073+0000","last_undegraded":"2024-09-14T11:23:01.297073+0000","last_fullsized":"2024-09-14T11:23:01.297073+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'332","last_scrub_stamp":"2024-09-14T11:23:01.296956+0000","last_deep_scrub":"260'332","last_deep_scrub_stamp":"2024-09-14T11:23:01.296956+0000","last_clean_scrub_stamp":"2024-09-14T11:23:01.296956+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:31.917595+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174780,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":649,"num_read_kb":125837,"num_write":1068,"num_write_kb":34909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":486,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:20.406091+0000","last_change":"2024-09-14T11:23:20.406091+0000","last_active":"2024-09-14T11:23:20.406091+0000","last_peered":"2024-09-14T11:23:20.406091+0000","last_clean":"2024-09-14T11:23:20.406091+0000","last_became_active":"2024-09-14T10:45:47.727632+0000","last_became_peered":"2024-09-14T10:45:47.727632+0000","last_unstale":"2024-09-14T11:23:20.406091+0000","last_undegraded":"2024-09-14T11:23:20.406091+0000","last_fullsized":"2024-09-14T11:23:20.406091+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:20.406006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:20.406006+0000","last_clean_scrub_stamp":"2024-09-14T11:23:20.406006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:21:58.043972+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"260'299","reported_seq":866,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:22.413178+0000","last_change":"2024-09-14T11:23:22.413178+0000","last_active":"2024-09-14T11:23:22.413178+0000","last_peered":"2024-09-14T11:23:22.413178+0000","last_clean":"2024-09-14T11:23:22.413178+0000","last_became_active":"2024-09-14T10:45:49.737690+0000","last_became_peered":"2024-09-14T10:45:49.737690+0000","last_unstale":"2024-09-14T11:23:22.413178+0000","last_undegraded":"2024-09-14T11:23:22.413178+0000","last_fullsized":"2024-09-14T11:23:22.413178+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'299","last_scrub_stamp":"2024-09-14T11:23:22.413077+0000","last_deep_scrub":"260'299","last_deep_scrub_stamp":"2024-09-14T11:23:22.413077+0000","last_clean_scrub_stamp":"2024-09-14T11:23:22.413077+0000","objects_scrubbed":7,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:29.181172+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69554,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":489,"num_read_kb":1163,"num_write":398,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"260'778","reported_seq":2028,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:14.637328+0000","last_change":"2024-09-14T11:23:14.637328+0000","last_active":"2024-09-14T11:23:14.637328+0000","last_peered":"2024-09-14T11:23:14.637328+0000","last_clean":"2024-09-14T11:23:14.637328+0000","last_became_active":"2024-09-14T10:45:51.749478+0000","last_became_peered":"2024-09-14T10:45:51.749478+0000","last_unstale":"2024-09-14T11:23:14.637328+0000","last_undegraded":"2024-09-14T11:23:14.637328+0000","last_fullsized":"2024-09-14T11:23:14.637328+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'778","last_scrub_stamp":"2024-09-14T11:23:14.637243+0000","last_deep_scrub":"260'778","last_deep_scrub_stamp":"2024-09-14T11:23:14.637243+0000","last_clean_scrub_stamp":"2024-09-14T11:23:14.637243+0000","objects_scrubbed":1,"log_size":78,"log_dups_size":700,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:52.460981+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"260'132","reported_seq":622,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:19.230569+0000","last_change":"2024-09-14T11:23:19.230503+0000","last_active":"2024-09-14T11:23:19.230569+0000","last_peered":"2024-09-14T11:23:19.230569+0000","last_clean":"2024-09-14T11:23:19.230569+0000","last_became_active":"2024-09-14T10:45:53.746254+0000","last_became_peered":"2024-09-14T10:45:53.746254+0000","last_unstale":"2024-09-14T11:23:19.230569+0000","last_undegraded":"2024-09-14T11:23:19.230569+0000","last_fullsized":"2024-09-14T11:23:19.230569+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'132","last_scrub_stamp":"2024-09-14T11:23:19.230403+0000","last_deep_scrub":"260'132","last_deep_scrub_stamp":"2024-09-14T11:23:19.230403+0000","last_clean_scrub_stamp":"2024-09-14T11:23:19.230403+0000","objects_scrubbed":4,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:11.653373+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1445,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":145,"num_read_kb":134,"num_write":327,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"260'484","reported_seq":2063,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:03.211250+0000","last_change":"2024-09-14T11:23:03.211250+0000","last_active":"2024-09-14T11:23:03.211250+0000","last_peered":"2024-09-14T11:23:03.211250+0000","last_clean":"2024-09-14T11:23:03.211250+0000","last_became_active":"2024-09-14T10:45:45.720660+0000","last_became_peered":"2024-09-14T10:45:45.720660+0000","last_unstale":"2024-09-14T11:23:03.211250+0000","last_undegraded":"2024-09-14T11:23:03.211250+0000","last_fullsized":"2024-09-14T11:23:03.211250+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'484","last_scrub_stamp":"2024-09-14T11:23:03.211174+0000","last_deep_scrub":"260'484","last_deep_scrub_stamp":"2024-09-14T11:23:03.211174+0000","last_clean_scrub_stamp":"2024-09-14T11:23:03.211174+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:30.932990+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2593,"num_read_kb":2426,"num_write":578,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"260'355","reported_seq":971,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:03.251849+0000","last_change":"2024-09-14T11:23:03.251849+0000","last_active":"2024-09-14T11:23:03.251849+0000","last_peered":"2024-09-14T11:23:03.251849+0000","last_clean":"2024-09-14T11:23:03.251849+0000","last_became_active":"2024-09-14T10:45:43.690517+0000","last_became_peered":"2024-09-14T10:45:43.690517+0000","last_unstale":"2024-09-14T11:23:03.251849+0000","last_undegraded":"2024-09-14T11:23:03.251849+0000","last_fullsized":"2024-09-14T11:23:03.251849+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'355","last_scrub_stamp":"2024-09-14T11:23:03.251741+0000","last_deep_scrub":"260'355","last_deep_scrub_stamp":"2024-09-14T11:23:03.251741+0000","last_clean_scrub_stamp":"2024-09-14T11:23:03.251741+0000","objects_scrubbed":9,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:26.884843+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267379,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":525,"num_read_kb":51932,"num_write":1051,"num_write_kb":23808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"260'4","reported_seq":1450,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:12.602532+0000","last_change":"2024-09-14T11:23:12.602532+0000","last_active":"2024-09-14T11:23:12.602532+0000","last_peered":"2024-09-14T11:23:12.602532+0000","last_clean":"2024-09-14T11:23:12.602532+0000","last_became_active":"2024-09-14T10:45:47.720716+0000","last_became_peered":"2024-09-14T10:45:47.720716+0000","last_unstale":"2024-09-14T11:23:12.602532+0000","last_undegraded":"2024-09-14T11:23:12.602532+0000","last_fullsized":"2024-09-14T11:23:12.602532+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-14T11:23:12.602439+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-14T11:23:12.602439+0000","last_clean_scrub_stamp":"2024-09-14T11:23:12.602439+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:13:05.573930+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":953,"num_read_kb":953,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"260'73","reported_seq":576,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:24.289915+0000","last_change":"2024-09-14T11:23:24.289915+0000","last_active":"2024-09-14T11:23:24.289915+0000","last_peered":"2024-09-14T11:23:24.289915+0000","last_clean":"2024-09-14T11:23:24.289915+0000","last_became_active":"2024-09-14T10:45:49.732913+0000","last_became_peered":"2024-09-14T10:45:49.732913+0000","last_unstale":"2024-09-14T11:23:24.289915+0000","last_undegraded":"2024-09-14T11:23:24.289915+0000","last_fullsized":"2024-09-14T11:23:24.289915+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'73","last_scrub_stamp":"2024-09-14T11:23:24.289827+0000","last_deep_scrub":"260'73","last_deep_scrub_stamp":"2024-09-14T11:23:24.289827+0000","last_clean_scrub_stamp":"2024-09-14T11:23:24.289827+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:30.218833+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":64,"num_read_kb":57,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"260'797","reported_seq":2422,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:18.572515+0000","last_change":"2024-09-14T11:23:18.572515+0000","last_active":"2024-09-14T11:23:18.572515+0000","last_peered":"2024-09-14T11:23:18.572515+0000","last_clean":"2024-09-14T11:23:18.572515+0000","last_became_active":"2024-09-14T10:45:51.741102+0000","last_became_peered":"2024-09-14T10:45:51.741102+0000","last_unstale":"2024-09-14T11:23:18.572515+0000","last_undegraded":"2024-09-14T11:23:18.572515+0000","last_fullsized":"2024-09-14T11:23:18.572515+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'797","last_scrub_stamp":"2024-09-14T11:23:18.572420+0000","last_deep_scrub":"260'797","last_deep_scrub_stamp":"2024-09-14T11:23:18.572420+0000","last_clean_scrub_stamp":"2024-09-14T11:23:18.572420+0000","objects_scrubbed":1,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:22:02.078595+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"260'153","reported_seq":668,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:20.508622+0000","last_change":"2024-09-14T11:23:20.508558+0000","last_active":"2024-09-14T11:23:20.508622+0000","last_peered":"2024-09-14T11:23:20.508622+0000","last_clean":"2024-09-14T11:23:20.508622+0000","last_became_active":"2024-09-14T10:45:53.752100+0000","last_became_peered":"2024-09-14T10:45:53.752100+0000","last_unstale":"2024-09-14T11:23:20.508622+0000","last_undegraded":"2024-09-14T11:23:20.508622+0000","last_fullsized":"2024-09-14T11:23:20.508622+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'153","last_scrub_stamp":"2024-09-14T11:23:20.508469+0000","last_deep_scrub":"260'153","last_deep_scrub_stamp":"2024-09-14T11:23:20.508469+0000","last_clean_scrub_stamp":"2024-09-14T11:23:20.508469+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:34.442103+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":861,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":268,"num_read_kb":228,"num_write":378,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"260'470","reported_seq":2079,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:02.791198+0000","last_change":"2024-09-14T11:23:02.791198+0000","last_active":"2024-09-14T11:23:02.791198+0000","last_peered":"2024-09-14T11:23:02.791198+0000","last_clean":"2024-09-14T11:23:02.791198+0000","last_became_active":"2024-09-14T10:45:45.719221+0000","last_became_peered":"2024-09-14T10:45:45.719221+0000","last_unstale":"2024-09-14T11:23:02.791198+0000","last_undegraded":"2024-09-14T11:23:02.791198+0000","last_fullsized":"2024-09-14T11:23:02.791198+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'470","last_scrub_stamp":"2024-09-14T11:23:02.791102+0000","last_deep_scrub":"260'470","last_deep_scrub_stamp":"2024-09-14T11:23:02.791102+0000","last_clean_scrub_stamp":"2024-09-14T11:23:02.791102+0000","objects_scrubbed":2,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:33:44.209906+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2509,"num_read_kb":2365,"num_write":566,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":467,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"260'322","reported_seq":932,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:59.033947+0000","last_change":"2024-09-14T11:22:59.033947+0000","last_active":"2024-09-14T11:22:59.033947+0000","last_peered":"2024-09-14T11:22:59.033947+0000","last_clean":"2024-09-14T11:22:59.033947+0000","last_became_active":"2024-09-14T10:45:43.690417+0000","last_became_peered":"2024-09-14T10:45:43.690417+0000","last_unstale":"2024-09-14T11:22:59.033947+0000","last_undegraded":"2024-09-14T11:22:59.033947+0000","last_fullsized":"2024-09-14T11:22:59.033947+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'322","last_scrub_stamp":"2024-09-14T11:22:59.033852+0000","last_deep_scrub":"260'322","last_deep_scrub_stamp":"2024-09-14T11:22:59.033852+0000","last_clean_scrub_stamp":"2024-09-14T11:22:59.033852+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:02.624805+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":503,"num_read_kb":28260,"num_write":967,"num_write_kb":36225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:24.159861+0000","last_change":"2024-09-14T11:23:24.159861+0000","last_active":"2024-09-14T11:23:24.159861+0000","last_peered":"2024-09-14T11:23:24.159861+0000","last_clean":"2024-09-14T11:23:24.159861+0000","last_became_active":"2024-09-14T10:45:47.730790+0000","last_became_peered":"2024-09-14T10:45:47.730790+0000","last_unstale":"2024-09-14T11:23:24.159861+0000","last_undegraded":"2024-09-14T11:23:24.159861+0000","last_fullsized":"2024-09-14T11:23:24.159861+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:24.159725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:24.159725+0000","last_clean_scrub_stamp":"2024-09-14T11:23:24.159725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:30.358278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"260'331","reported_seq":925,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:14.556096+0000","last_change":"2024-09-14T11:23:14.556096+0000","last_active":"2024-09-14T11:23:14.556096+0000","last_peered":"2024-09-14T11:23:14.556096+0000","last_clean":"2024-09-14T11:23:14.556096+0000","last_became_active":"2024-09-14T10:45:49.735482+0000","last_became_peered":"2024-09-14T10:45:49.735482+0000","last_unstale":"2024-09-14T11:23:14.556096+0000","last_undegraded":"2024-09-14T11:23:14.556096+0000","last_fullsized":"2024-09-14T11:23:14.556096+0000","mapping_epoch":30,"log_start":"260'300","ondisk_log_start":"260'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'331","last_scrub_stamp":"2024-09-14T11:23:14.555977+0000","last_deep_scrub":"260'331","last_deep_scrub_stamp":"2024-09-14T11:23:14.555977+0000","last_clean_scrub_stamp":"2024-09-14T11:23:14.555977+0000","objects_scrubbed":8,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:18.071778+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46045,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":538,"num_read_kb":1149,"num_write":426,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":476,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:12.387005+0000","last_change":"2024-09-14T11:23:12.387005+0000","last_active":"2024-09-14T11:23:12.387005+0000","last_peered":"2024-09-14T11:23:12.387005+0000","last_clean":"2024-09-14T11:23:12.387005+0000","last_became_active":"2024-09-14T10:45:51.750669+0000","last_became_peered":"2024-09-14T10:45:51.750669+0000","last_unstale":"2024-09-14T11:23:12.387005+0000","last_undegraded":"2024-09-14T11:23:12.387005+0000","last_fullsized":"2024-09-14T11:23:12.387005+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:12.386872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:12.386872+0000","last_clean_scrub_stamp":"2024-09-14T11:23:12.386872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:17.249546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"260'121","reported_seq":606,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:20.690257+0000","last_change":"2024-09-14T11:23:20.690198+0000","last_active":"2024-09-14T11:23:20.690257+0000","last_peered":"2024-09-14T11:23:20.690257+0000","last_clean":"2024-09-14T11:23:20.690257+0000","last_became_active":"2024-09-14T10:45:53.748865+0000","last_became_peered":"2024-09-14T10:45:53.748865+0000","last_unstale":"2024-09-14T11:23:20.690257+0000","last_undegraded":"2024-09-14T11:23:20.690257+0000","last_fullsized":"2024-09-14T11:23:20.690257+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'121","last_scrub_stamp":"2024-09-14T11:23:20.690102+0000","last_deep_scrub":"260'121","last_deep_scrub_stamp":"2024-09-14T11:23:20.690102+0000","last_clean_scrub_stamp":"2024-09-14T11:23:20.690102+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:13:31.152731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":116,"num_write":279,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"260'614","reported_seq":2414,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:14.210822+0000","last_change":"2024-09-14T11:23:14.210717+0000","last_active":"2024-09-14T11:23:14.210822+0000","last_peered":"2024-09-14T11:23:14.210822+0000","last_clean":"2024-09-14T11:23:14.210822+0000","last_became_active":"2024-09-14T10:45:45.716236+0000","last_became_peered":"2024-09-14T10:45:45.716236+0000","last_unstale":"2024-09-14T11:23:14.210822+0000","last_undegraded":"2024-09-14T11:23:14.210822+0000","last_fullsized":"2024-09-14T11:23:14.210822+0000","mapping_epoch":26,"log_start":"260'600","ondisk_log_start":"260'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'614","last_scrub_stamp":"2024-09-14T11:23:14.210620+0000","last_deep_scrub":"260'614","last_deep_scrub_stamp":"2024-09-14T11:23:14.210620+0000","last_clean_scrub_stamp":"2024-09-14T11:23:14.210620+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":600,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:38:26.756269+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3315,"num_read_kb":3084,"num_write":730,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"260'74","reported_seq":612,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:55.699802+0000","last_change":"2024-09-14T11:22:55.699728+0000","last_active":"2024-09-14T11:22:55.699802+0000","last_peered":"2024-09-14T11:22:55.699802+0000","last_clean":"2024-09-14T11:22:55.699802+0000","last_became_active":"2024-09-14T10:45:28.985499+0000","last_became_peered":"2024-09-14T10:45:28.985499+0000","last_unstale":"2024-09-14T11:22:55.699802+0000","last_undegraded":"2024-09-14T11:22:55.699802+0000","last_fullsized":"2024-09-14T11:22:55.699802+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'74","last_scrub_stamp":"2024-09-14T11:22:55.699647+0000","last_deep_scrub":"260'74","last_deep_scrub_stamp":"2024-09-14T11:22:55.699647+0000","last_clean_scrub_stamp":"2024-09-14T11:22:55.699647+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:04.417375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"260'2","reported_seq":514,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:58.303627+0000","last_change":"2024-09-14T11:22:58.303578+0000","last_active":"2024-09-14T11:22:58.303627+0000","last_peered":"2024-09-14T11:22:58.303627+0000","last_clean":"2024-09-14T11:22:58.303627+0000","last_became_active":"2024-09-14T10:45:33.610592+0000","last_became_peered":"2024-09-14T10:45:33.610592+0000","last_unstale":"2024-09-14T11:22:58.303627+0000","last_undegraded":"2024-09-14T11:22:58.303627+0000","last_fullsized":"2024-09-14T11:22:58.303627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:22:58.303510+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:22:58.303510+0000","last_clean_scrub_stamp":"2024-09-14T11:22:58.303510+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:42.914407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043055799999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"260'280","reported_seq":928,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:57.084934+0000","last_change":"2024-09-14T11:22:57.084842+0000","last_active":"2024-09-14T11:22:57.084934+0000","last_peered":"2024-09-14T11:22:57.084934+0000","last_clean":"2024-09-14T11:22:57.084934+0000","last_became_active":"2024-09-14T10:45:43.690248+0000","last_became_peered":"2024-09-14T10:45:43.690248+0000","last_unstale":"2024-09-14T11:22:57.084934+0000","last_undegraded":"2024-09-14T11:22:57.084934+0000","last_fullsized":"2024-09-14T11:22:57.084934+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'280","last_scrub_stamp":"2024-09-14T11:22:57.084704+0000","last_deep_scrub":"260'280","last_deep_scrub_stamp":"2024-09-14T11:22:57.084704+0000","last_clean_scrub_stamp":"2024-09-14T11:22:57.084704+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:34.397521+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":552,"num_read_kb":56771,"num_write":951,"num_write_kb":24880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":496,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:11.598716+0000","last_change":"2024-09-14T11:23:11.598638+0000","last_active":"2024-09-14T11:23:11.598716+0000","last_peered":"2024-09-14T11:23:11.598716+0000","last_clean":"2024-09-14T11:23:11.598716+0000","last_became_active":"2024-09-14T10:45:47.723495+0000","last_became_peered":"2024-09-14T10:45:47.723495+0000","last_unstale":"2024-09-14T11:23:11.598716+0000","last_undegraded":"2024-09-14T11:23:11.598716+0000","last_fullsized":"2024-09-14T11:23:11.598716+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:11.598555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:11.598555+0000","last_clean_scrub_stamp":"2024-09-14T11:23:11.598555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:36:22.236009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"260'749","reported_seq":1440,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:28.247996+0000","last_change":"2024-09-14T11:23:28.247996+0000","last_active":"2024-09-14T11:23:28.247996+0000","last_peered":"2024-09-14T11:23:28.247996+0000","last_clean":"2024-09-14T11:23:28.247996+0000","last_became_active":"2024-09-14T10:45:49.733774+0000","last_became_peered":"2024-09-14T10:45:49.733774+0000","last_unstale":"2024-09-14T11:23:28.247996+0000","last_undegraded":"2024-09-14T11:23:28.247996+0000","last_fullsized":"2024-09-14T11:23:28.247996+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'749","last_scrub_stamp":"2024-09-14T11:23:28.247895+0000","last_deep_scrub":"260'749","last_deep_scrub_stamp":"2024-09-14T11:23:28.247895+0000","last_clean_scrub_stamp":"2024-09-14T11:23:28.247895+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":700,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:06.175200+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152864,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1479,"num_read_kb":3507,"num_write":1366,"num_write_kb":1223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89312,"num_omap_keys":214,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":479,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:24.452245+0000","last_change":"2024-09-14T11:23:24.452245+0000","last_active":"2024-09-14T11:23:24.452245+0000","last_peered":"2024-09-14T11:23:24.452245+0000","last_clean":"2024-09-14T11:23:24.452245+0000","last_became_active":"2024-09-14T10:45:51.745607+0000","last_became_peered":"2024-09-14T10:45:51.745607+0000","last_unstale":"2024-09-14T11:23:24.452245+0000","last_undegraded":"2024-09-14T11:23:24.452245+0000","last_fullsized":"2024-09-14T11:23:24.452245+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:24.452118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:24.452118+0000","last_clean_scrub_stamp":"2024-09-14T11:23:24.452118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:31.791825+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"260'237","reported_seq":933,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:19.622332+0000","last_change":"2024-09-14T11:23:19.622332+0000","last_active":"2024-09-14T11:23:19.622332+0000","last_peered":"2024-09-14T11:23:19.622332+0000","last_clean":"2024-09-14T11:23:19.622332+0000","last_became_active":"2024-09-14T10:45:53.751651+0000","last_became_peered":"2024-09-14T10:45:53.751651+0000","last_unstale":"2024-09-14T11:23:19.622332+0000","last_undegraded":"2024-09-14T11:23:19.622332+0000","last_fullsized":"2024-09-14T11:23:19.622332+0000","mapping_epoch":34,"log_start":"260'200","ondisk_log_start":"260'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'237","last_scrub_stamp":"2024-09-14T11:23:19.622263+0000","last_deep_scrub":"260'237","last_deep_scrub_stamp":"2024-09-14T11:23:19.622263+0000","last_clean_scrub_stamp":"2024-09-14T11:23:19.622263+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:09.518382+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":417,"num_read_kb":415,"num_write":468,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"260'501","reported_seq":2088,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:11.358264+0000","last_change":"2024-09-14T11:23:11.358264+0000","last_active":"2024-09-14T11:23:11.358264+0000","last_peered":"2024-09-14T11:23:11.358264+0000","last_clean":"2024-09-14T11:23:11.358264+0000","last_became_active":"2024-09-14T10:45:45.721633+0000","last_became_peered":"2024-09-14T10:45:45.721633+0000","last_unstale":"2024-09-14T11:23:11.358264+0000","last_undegraded":"2024-09-14T11:23:11.358264+0000","last_fullsized":"2024-09-14T11:23:11.358264+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'501","last_scrub_stamp":"2024-09-14T11:23:11.358175+0000","last_deep_scrub":"260'501","last_deep_scrub_stamp":"2024-09-14T11:23:11.358175+0000","last_clean_scrub_stamp":"2024-09-14T11:23:11.358175+0000","objects_scrubbed":1,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:36.475272+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2741,"num_read_kb":2557,"num_write":632,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":512,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:57.303538+0000","last_change":"2024-09-14T11:22:57.303538+0000","last_active":"2024-09-14T11:22:57.303538+0000","last_peered":"2024-09-14T11:22:57.303538+0000","last_clean":"2024-09-14T11:22:57.303538+0000","last_became_active":"2024-09-14T10:45:33.569860+0000","last_became_peered":"2024-09-14T10:45:33.569860+0000","last_unstale":"2024-09-14T11:22:57.303538+0000","last_undegraded":"2024-09-14T11:22:57.303538+0000","last_fullsized":"2024-09-14T11:22:57.303538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:57.303456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:57.303456+0000","last_clean_scrub_stamp":"2024-09-14T11:22:57.303456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:48:58.728224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074400599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"260'335","reported_seq":973,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:58.571020+0000","last_change":"2024-09-14T11:22:58.570951+0000","last_active":"2024-09-14T11:22:58.571020+0000","last_peered":"2024-09-14T11:22:58.571020+0000","last_clean":"2024-09-14T11:22:58.571020+0000","last_became_active":"2024-09-14T10:45:43.680290+0000","last_became_peered":"2024-09-14T10:45:43.680290+0000","last_unstale":"2024-09-14T11:22:58.571020+0000","last_undegraded":"2024-09-14T11:22:58.571020+0000","last_fullsized":"2024-09-14T11:22:58.571020+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'335","last_scrub_stamp":"2024-09-14T11:22:58.570853+0000","last_deep_scrub":"260'335","last_deep_scrub_stamp":"2024-09-14T11:22:58.570853+0000","last_clean_scrub_stamp":"2024-09-14T11:22:58.570853+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:26.761580+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":649,"num_read_kb":19207,"num_write":1098,"num_write_kb":41133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:23.187737+0000","last_change":"2024-09-14T11:23:23.187737+0000","last_active":"2024-09-14T11:23:23.187737+0000","last_peered":"2024-09-14T11:23:23.187737+0000","last_clean":"2024-09-14T11:23:23.187737+0000","last_became_active":"2024-09-14T10:45:47.727733+0000","last_became_peered":"2024-09-14T10:45:47.727733+0000","last_unstale":"2024-09-14T11:23:23.187737+0000","last_undegraded":"2024-09-14T11:23:23.187737+0000","last_fullsized":"2024-09-14T11:23:23.187737+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:23.187645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:23.187645+0000","last_clean_scrub_stamp":"2024-09-14T11:23:23.187645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:02.771437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"260'1255","reported_seq":2627,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:19.650058+0000","last_change":"2024-09-14T11:23:19.649977+0000","last_active":"2024-09-14T11:23:19.650058+0000","last_peered":"2024-09-14T11:23:19.650058+0000","last_clean":"2024-09-14T11:23:19.650058+0000","last_became_active":"2024-09-14T10:45:49.731646+0000","last_became_peered":"2024-09-14T10:45:49.731646+0000","last_unstale":"2024-09-14T11:23:19.650058+0000","last_undegraded":"2024-09-14T11:23:19.650058+0000","last_fullsized":"2024-09-14T11:23:19.650058+0000","mapping_epoch":30,"log_start":"260'1200","ondisk_log_start":"260'1200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1255","last_scrub_stamp":"2024-09-14T11:23:19.649845+0000","last_deep_scrub":"260'1255","last_deep_scrub_stamp":"2024-09-14T11:23:19.649845+0000","last_clean_scrub_stamp":"2024-09-14T11:23:19.649845+0000","objects_scrubbed":11,"log_size":55,"log_dups_size":1200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:26.770199+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141569,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1984,"num_read_kb":3752,"num_write":1074,"num_write_kb":921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":481,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:34.249984+0000","last_change":"2024-09-14T11:23:34.249984+0000","last_active":"2024-09-14T11:23:34.249984+0000","last_peered":"2024-09-14T11:23:34.249984+0000","last_clean":"2024-09-14T11:23:34.249984+0000","last_became_active":"2024-09-14T10:45:51.745481+0000","last_became_peered":"2024-09-14T10:45:51.745481+0000","last_unstale":"2024-09-14T11:23:34.249984+0000","last_undegraded":"2024-09-14T11:23:34.249984+0000","last_fullsized":"2024-09-14T11:23:34.249984+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:34.249880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:34.249880+0000","last_clean_scrub_stamp":"2024-09-14T11:23:34.249880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:22.847458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"260'294","reported_seq":826,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:30.542511+0000","last_change":"2024-09-14T11:23:30.542511+0000","last_active":"2024-09-14T11:23:30.542511+0000","last_peered":"2024-09-14T11:23:30.542511+0000","last_clean":"2024-09-14T11:23:30.542511+0000","last_became_active":"2024-09-14T10:45:53.750227+0000","last_became_peered":"2024-09-14T10:45:53.750227+0000","last_unstale":"2024-09-14T11:23:30.542511+0000","last_undegraded":"2024-09-14T11:23:30.542511+0000","last_fullsized":"2024-09-14T11:23:30.542511+0000","mapping_epoch":34,"log_start":"260'200","ondisk_log_start":"260'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'294","last_scrub_stamp":"2024-09-14T11:23:30.542425+0000","last_deep_scrub":"260'294","last_deep_scrub_stamp":"2024-09-14T11:23:30.542425+0000","last_clean_scrub_stamp":"2024-09-14T11:23:30.542425+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:08:15.313103+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":463,"num_read_kb":436,"num_write":609,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"260'356","reported_seq":1877,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:07.380950+0000","last_change":"2024-09-14T11:23:07.380950+0000","last_active":"2024-09-14T11:23:07.380950+0000","last_peered":"2024-09-14T11:23:07.380950+0000","last_clean":"2024-09-14T11:23:07.380950+0000","last_became_active":"2024-09-14T10:45:45.714923+0000","last_became_peered":"2024-09-14T10:45:45.714923+0000","last_unstale":"2024-09-14T11:23:07.380950+0000","last_undegraded":"2024-09-14T11:23:07.380950+0000","last_fullsized":"2024-09-14T11:23:07.380950+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'356","last_scrub_stamp":"2024-09-14T11:23:07.380862+0000","last_deep_scrub":"260'356","last_deep_scrub_stamp":"2024-09-14T11:23:07.380862+0000","last_clean_scrub_stamp":"2024-09-14T11:23:07.380862+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:31.182530+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2079,"num_read_kb":2005,"num_write":398,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":513,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:57.710733+0000","last_change":"2024-09-14T11:22:57.710655+0000","last_active":"2024-09-14T11:22:57.710733+0000","last_peered":"2024-09-14T11:22:57.710733+0000","last_clean":"2024-09-14T11:22:57.710733+0000","last_became_active":"2024-09-14T10:45:33.569944+0000","last_became_peered":"2024-09-14T10:45:33.569944+0000","last_unstale":"2024-09-14T11:22:57.710733+0000","last_undegraded":"2024-09-14T11:22:57.710733+0000","last_fullsized":"2024-09-14T11:22:57.710733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:57.710578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:57.710578+0000","last_clean_scrub_stamp":"2024-09-14T11:22:57.710578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:15.018820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055355599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"260'364","reported_seq":1063,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:01.268492+0000","last_change":"2024-09-14T11:23:01.268492+0000","last_active":"2024-09-14T11:23:01.268492+0000","last_peered":"2024-09-14T11:23:01.268492+0000","last_clean":"2024-09-14T11:23:01.268492+0000","last_became_active":"2024-09-14T10:45:43.682920+0000","last_became_peered":"2024-09-14T10:45:43.682920+0000","last_unstale":"2024-09-14T11:23:01.268492+0000","last_undegraded":"2024-09-14T11:23:01.268492+0000","last_fullsized":"2024-09-14T11:23:01.268492+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'364","last_scrub_stamp":"2024-09-14T11:23:01.268391+0000","last_deep_scrub":"260'364","last_deep_scrub_stamp":"2024-09-14T11:23:01.268391+0000","last_clean_scrub_stamp":"2024-09-14T11:23:01.268391+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:16.818916+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133679,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":823,"num_read_kb":18154,"num_write":1072,"num_write_kb":35009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"260'2","reported_seq":492,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:10.674647+0000","last_change":"2024-09-14T11:23:10.674647+0000","last_active":"2024-09-14T11:23:10.674647+0000","last_peered":"2024-09-14T11:23:10.674647+0000","last_clean":"2024-09-14T11:23:10.674647+0000","last_became_active":"2024-09-14T10:45:47.729061+0000","last_became_peered":"2024-09-14T10:45:47.729061+0000","last_unstale":"2024-09-14T11:23:10.674647+0000","last_undegraded":"2024-09-14T11:23:10.674647+0000","last_fullsized":"2024-09-14T11:23:10.674647+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:23:10.674557+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:23:10.674557+0000","last_clean_scrub_stamp":"2024-09-14T11:23:10.674557+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:31.717306+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"260'248","reported_seq":1234,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:13.632628+0000","last_change":"2024-09-14T11:23:13.632569+0000","last_active":"2024-09-14T11:23:13.632628+0000","last_peered":"2024-09-14T11:23:13.632628+0000","last_clean":"2024-09-14T11:23:13.632628+0000","last_became_active":"2024-09-14T10:45:49.731858+0000","last_became_peered":"2024-09-14T10:45:49.731858+0000","last_unstale":"2024-09-14T11:23:13.632628+0000","last_undegraded":"2024-09-14T11:23:13.632628+0000","last_fullsized":"2024-09-14T11:23:13.632628+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'248","last_scrub_stamp":"2024-09-14T11:23:13.632463+0000","last_deep_scrub":"260'248","last_deep_scrub_stamp":"2024-09-14T11:23:13.632463+0000","last_clean_scrub_stamp":"2024-09-14T11:23:13.632463+0000","objects_scrubbed":9,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:07.671389+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":156,"num_read_kb":145,"num_write":121,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5400,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:27.666619+0000","last_change":"2024-09-14T11:23:27.666619+0000","last_active":"2024-09-14T11:23:27.666619+0000","last_peered":"2024-09-14T11:23:27.666619+0000","last_clean":"2024-09-14T11:23:27.666619+0000","last_became_active":"2024-09-14T10:45:51.742651+0000","last_became_peered":"2024-09-14T10:45:51.742651+0000","last_unstale":"2024-09-14T11:23:27.666619+0000","last_undegraded":"2024-09-14T11:23:27.666619+0000","last_fullsized":"2024-09-14T11:23:27.666619+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:27.666534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:27.666534+0000","last_clean_scrub_stamp":"2024-09-14T11:23:27.666534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:57.974502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"260'242","reported_seq":836,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:31.618008+0000","last_change":"2024-09-14T11:23:31.618008+0000","last_active":"2024-09-14T11:23:31.618008+0000","last_peered":"2024-09-14T11:23:31.618008+0000","last_clean":"2024-09-14T11:23:31.618008+0000","last_became_active":"2024-09-14T10:45:53.744823+0000","last_became_peered":"2024-09-14T10:45:53.744823+0000","last_unstale":"2024-09-14T11:23:31.618008+0000","last_undegraded":"2024-09-14T11:23:31.618008+0000","last_fullsized":"2024-09-14T11:23:31.618008+0000","mapping_epoch":34,"log_start":"260'200","ondisk_log_start":"260'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'242","last_scrub_stamp":"2024-09-14T11:23:31.617921+0000","last_deep_scrub":"260'242","last_deep_scrub_stamp":"2024-09-14T11:23:31.617921+0000","last_clean_scrub_stamp":"2024-09-14T11:23:31.617921+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:39.433668+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":471,"num_read_kb":497,"num_write":522,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"260'745","reported_seq":2256,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:06.427840+0000","last_change":"2024-09-14T11:23:06.427766+0000","last_active":"2024-09-14T11:23:06.427840+0000","last_peered":"2024-09-14T11:23:06.427840+0000","last_clean":"2024-09-14T11:23:06.427840+0000","last_became_active":"2024-09-14T10:45:45.714077+0000","last_became_peered":"2024-09-14T10:45:45.714077+0000","last_unstale":"2024-09-14T11:23:06.427840+0000","last_undegraded":"2024-09-14T11:23:06.427840+0000","last_fullsized":"2024-09-14T11:23:06.427840+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'745","last_scrub_stamp":"2024-09-14T11:23:06.427683+0000","last_deep_scrub":"260'745","last_deep_scrub_stamp":"2024-09-14T11:23:06.427683+0000","last_clean_scrub_stamp":"2024-09-14T11:23:06.427683+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":700,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:14.547833+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3745,"num_read_kb":3391,"num_write":988,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2262,"num_omap_keys":9,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"260'3","reported_seq":515,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:56.321959+0000","last_change":"2024-09-14T11:22:56.321865+0000","last_active":"2024-09-14T11:22:56.321959+0000","last_peered":"2024-09-14T11:22:56.321959+0000","last_clean":"2024-09-14T11:22:56.321959+0000","last_became_active":"2024-09-14T10:45:33.612919+0000","last_became_peered":"2024-09-14T10:45:33.612919+0000","last_unstale":"2024-09-14T11:22:56.321959+0000","last_undegraded":"2024-09-14T11:22:56.321959+0000","last_fullsized":"2024-09-14T11:22:56.321959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T11:22:56.321789+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T11:22:56.321789+0000","last_clean_scrub_stamp":"2024-09-14T11:22:56.321789+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:47.764462+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00094497699999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"260'329","reported_seq":1206,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:00.571957+0000","last_change":"2024-09-14T11:23:00.571895+0000","last_active":"2024-09-14T11:23:00.571957+0000","last_peered":"2024-09-14T11:23:00.571957+0000","last_clean":"2024-09-14T11:23:00.571957+0000","last_became_active":"2024-09-14T10:45:43.679522+0000","last_became_peered":"2024-09-14T10:45:43.679522+0000","last_unstale":"2024-09-14T11:23:00.571957+0000","last_undegraded":"2024-09-14T11:23:00.571957+0000","last_fullsized":"2024-09-14T11:23:00.571957+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'329","last_scrub_stamp":"2024-09-14T11:23:00.571795+0000","last_deep_scrub":"260'329","last_deep_scrub_stamp":"2024-09-14T11:23:00.571795+0000","last_clean_scrub_stamp":"2024-09-14T11:23:00.571795+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:46.489688+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1353,"num_read_kb":12978,"num_write":1165,"num_write_kb":34630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"260'4","reported_seq":972,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:08.708188+0000","last_change":"2024-09-14T11:23:08.708120+0000","last_active":"2024-09-14T11:23:08.708188+0000","last_peered":"2024-09-14T11:23:08.708188+0000","last_clean":"2024-09-14T11:23:08.708188+0000","last_became_active":"2024-09-14T10:45:47.727050+0000","last_became_peered":"2024-09-14T10:45:47.727050+0000","last_unstale":"2024-09-14T11:23:08.708188+0000","last_undegraded":"2024-09-14T11:23:08.708188+0000","last_fullsized":"2024-09-14T11:23:08.708188+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-14T11:23:08.708034+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-14T11:23:08.708034+0000","last_clean_scrub_stamp":"2024-09-14T11:23:08.708034+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:23.242324+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"260'109","reported_seq":632,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:21.449544+0000","last_change":"2024-09-14T11:23:21.449544+0000","last_active":"2024-09-14T11:23:21.449544+0000","last_peered":"2024-09-14T11:23:21.449544+0000","last_clean":"2024-09-14T11:23:21.449544+0000","last_became_active":"2024-09-14T10:45:49.734181+0000","last_became_peered":"2024-09-14T10:45:49.734181+0000","last_unstale":"2024-09-14T11:23:21.449544+0000","last_undegraded":"2024-09-14T11:23:21.449544+0000","last_fullsized":"2024-09-14T11:23:21.449544+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'109","last_scrub_stamp":"2024-09-14T11:23:21.449431+0000","last_deep_scrub":"260'109","last_deep_scrub_stamp":"2024-09-14T11:23:21.449431+0000","last_clean_scrub_stamp":"2024-09-14T11:23:21.449431+0000","objects_scrubbed":7,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:19.786794+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":121,"num_read_kb":115,"num_write":86,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3358,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":480,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:35.221473+0000","last_change":"2024-09-14T11:23:35.221473+0000","last_active":"2024-09-14T11:23:35.221473+0000","last_peered":"2024-09-14T11:23:35.221473+0000","last_clean":"2024-09-14T11:23:35.221473+0000","last_became_active":"2024-09-14T10:45:51.744280+0000","last_became_peered":"2024-09-14T10:45:51.744280+0000","last_unstale":"2024-09-14T11:23:35.221473+0000","last_undegraded":"2024-09-14T11:23:35.221473+0000","last_fullsized":"2024-09-14T11:23:35.221473+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:35.221380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:35.221380+0000","last_clean_scrub_stamp":"2024-09-14T11:23:35.221380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:09.486875+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"260'117","reported_seq":657,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:21.587933+0000","last_change":"2024-09-14T11:23:21.587933+0000","last_active":"2024-09-14T11:23:21.587933+0000","last_peered":"2024-09-14T11:23:21.587933+0000","last_clean":"2024-09-14T11:23:21.587933+0000","last_became_active":"2024-09-14T10:45:53.746484+0000","last_became_peered":"2024-09-14T10:45:53.746484+0000","last_unstale":"2024-09-14T11:23:21.587933+0000","last_undegraded":"2024-09-14T11:23:21.587933+0000","last_fullsized":"2024-09-14T11:23:21.587933+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'117","last_scrub_stamp":"2024-09-14T11:23:21.587830+0000","last_deep_scrub":"260'117","last_deep_scrub_stamp":"2024-09-14T11:23:21.587830+0000","last_clean_scrub_stamp":"2024-09-14T11:23:21.587830+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:12.179504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":202,"num_write":278,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"260'1200","reported_seq":2910,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:02.495387+0000","last_change":"2024-09-14T11:23:02.495332+0000","last_active":"2024-09-14T11:23:02.495387+0000","last_peered":"2024-09-14T11:23:02.495387+0000","last_clean":"2024-09-14T11:23:02.495387+0000","last_became_active":"2024-09-14T10:45:45.713440+0000","last_became_peered":"2024-09-14T10:45:45.713440+0000","last_unstale":"2024-09-14T11:23:02.495387+0000","last_undegraded":"2024-09-14T11:23:02.495387+0000","last_fullsized":"2024-09-14T11:23:02.495387+0000","mapping_epoch":26,"log_start":"260'1100","ondisk_log_start":"260'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1200","last_scrub_stamp":"2024-09-14T11:23:02.495208+0000","last_deep_scrub":"260'1200","last_deep_scrub_stamp":"2024-09-14T11:23:02.495208+0000","last_clean_scrub_stamp":"2024-09-14T11:23:02.495208+0000","objects_scrubbed":4,"log_size":100,"log_dups_size":1100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:18:40.279776+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5652,"num_read_kb":5051,"num_write":1624,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"260'368","reported_seq":1064,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:56.140666+0000","last_change":"2024-09-14T11:22:56.140615+0000","last_active":"2024-09-14T11:22:56.140666+0000","last_peered":"2024-09-14T11:22:56.140666+0000","last_clean":"2024-09-14T11:22:56.140666+0000","last_became_active":"2024-09-14T10:45:43.682711+0000","last_became_peered":"2024-09-14T10:45:43.682711+0000","last_unstale":"2024-09-14T11:22:56.140666+0000","last_undegraded":"2024-09-14T11:22:56.140666+0000","last_fullsized":"2024-09-14T11:22:56.140666+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'368","last_scrub_stamp":"2024-09-14T11:22:56.140537+0000","last_deep_scrub":"260'368","last_deep_scrub_stamp":"2024-09-14T11:22:56.140537+0000","last_clean_scrub_stamp":"2024-09-14T11:22:56.140537+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:56:04.477168+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":849,"num_read_kb":26785,"num_write":1182,"num_write_kb":27965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":511,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:58.210095+0000","last_change":"2024-09-14T11:22:58.210044+0000","last_active":"2024-09-14T11:22:58.210095+0000","last_peered":"2024-09-14T11:22:58.210095+0000","last_clean":"2024-09-14T11:22:58.210095+0000","last_became_active":"2024-09-14T10:45:33.612983+0000","last_became_peered":"2024-09-14T10:45:33.612983+0000","last_unstale":"2024-09-14T11:22:58.210095+0000","last_undegraded":"2024-09-14T11:22:58.210095+0000","last_fullsized":"2024-09-14T11:22:58.210095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:58.209961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:58.209961+0000","last_clean_scrub_stamp":"2024-09-14T11:22:58.209961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:24.187827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053773700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":495,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:14.832509+0000","last_change":"2024-09-14T11:23:14.832421+0000","last_active":"2024-09-14T11:23:14.832509+0000","last_peered":"2024-09-14T11:23:14.832509+0000","last_clean":"2024-09-14T11:23:14.832509+0000","last_became_active":"2024-09-14T10:45:47.724317+0000","last_became_peered":"2024-09-14T10:45:47.724317+0000","last_unstale":"2024-09-14T11:23:14.832509+0000","last_undegraded":"2024-09-14T11:23:14.832509+0000","last_fullsized":"2024-09-14T11:23:14.832509+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:14.832323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:14.832323+0000","last_clean_scrub_stamp":"2024-09-14T11:23:14.832323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:35.877723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"260'555","reported_seq":1204,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:12.702336+0000","last_change":"2024-09-14T11:23:12.702336+0000","last_active":"2024-09-14T11:23:12.702336+0000","last_peered":"2024-09-14T11:23:12.702336+0000","last_clean":"2024-09-14T11:23:12.702336+0000","last_became_active":"2024-09-14T10:45:49.735662+0000","last_became_peered":"2024-09-14T10:45:49.735662+0000","last_unstale":"2024-09-14T11:23:12.702336+0000","last_undegraded":"2024-09-14T11:23:12.702336+0000","last_fullsized":"2024-09-14T11:23:12.702336+0000","mapping_epoch":30,"log_start":"260'500","ondisk_log_start":"260'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'555","last_scrub_stamp":"2024-09-14T11:23:12.702245+0000","last_deep_scrub":"260'555","last_deep_scrub_stamp":"2024-09-14T11:23:12.702245+0000","last_clean_scrub_stamp":"2024-09-14T11:23:12.702245+0000","objects_scrubbed":9,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:15.583995+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96714,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1561,"num_read_kb":2770,"num_write":2020,"num_write_kb":1869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":529654,"num_omap_keys":1194,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:14.406366+0000","last_change":"2024-09-14T11:23:14.406308+0000","last_active":"2024-09-14T11:23:14.406366+0000","last_peered":"2024-09-14T11:23:14.406366+0000","last_clean":"2024-09-14T11:23:14.406366+0000","last_became_active":"2024-09-14T10:45:51.749478+0000","last_became_peered":"2024-09-14T10:45:51.749478+0000","last_unstale":"2024-09-14T11:23:14.406366+0000","last_undegraded":"2024-09-14T11:23:14.406366+0000","last_fullsized":"2024-09-14T11:23:14.406366+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:14.406216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:14.406216+0000","last_clean_scrub_stamp":"2024-09-14T11:23:14.406216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:10.698911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"260'122","reported_seq":616,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:32.564446+0000","last_change":"2024-09-14T11:23:32.564446+0000","last_active":"2024-09-14T11:23:32.564446+0000","last_peered":"2024-09-14T11:23:32.564446+0000","last_clean":"2024-09-14T11:23:32.564446+0000","last_became_active":"2024-09-14T10:45:53.749578+0000","last_became_peered":"2024-09-14T10:45:53.749578+0000","last_unstale":"2024-09-14T11:23:32.564446+0000","last_undegraded":"2024-09-14T11:23:32.564446+0000","last_fullsized":"2024-09-14T11:23:32.564446+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'122","last_scrub_stamp":"2024-09-14T11:23:32.564358+0000","last_deep_scrub":"260'122","last_deep_scrub_stamp":"2024-09-14T11:23:32.564358+0000","last_clean_scrub_stamp":"2024-09-14T11:23:32.564358+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:11.546553+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":913,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":137,"num_read_kb":126,"num_write":281,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"260'864","reported_seq":2567,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:05.472851+0000","last_change":"2024-09-14T11:23:05.472779+0000","last_active":"2024-09-14T11:23:05.472851+0000","last_peered":"2024-09-14T11:23:05.472851+0000","last_clean":"2024-09-14T11:23:05.472851+0000","last_became_active":"2024-09-14T10:45:45.719783+0000","last_became_peered":"2024-09-14T10:45:45.719783+0000","last_unstale":"2024-09-14T11:23:05.472851+0000","last_undegraded":"2024-09-14T11:23:05.472851+0000","last_fullsized":"2024-09-14T11:23:05.472851+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'864","last_scrub_stamp":"2024-09-14T11:23:05.472688+0000","last_deep_scrub":"260'864","last_deep_scrub_stamp":"2024-09-14T11:23:05.472688+0000","last_clean_scrub_stamp":"2024-09-14T11:23:05.472688+0000","objects_scrubbed":3,"log_size":64,"log_dups_size":800,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:31.265160+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4184,"num_read_kb":3795,"num_write":1124,"num_write_kb":397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"260'369","reported_seq":992,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:59.565502+0000","last_change":"2024-09-14T11:22:59.565447+0000","last_active":"2024-09-14T11:22:59.565502+0000","last_peered":"2024-09-14T11:22:59.565502+0000","last_clean":"2024-09-14T11:22:59.565502+0000","last_became_active":"2024-09-14T10:45:43.685775+0000","last_became_peered":"2024-09-14T10:45:43.685775+0000","last_unstale":"2024-09-14T11:22:59.565502+0000","last_undegraded":"2024-09-14T11:22:59.565502+0000","last_fullsized":"2024-09-14T11:22:59.565502+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'369","last_scrub_stamp":"2024-09-14T11:22:59.565357+0000","last_deep_scrub":"260'369","last_deep_scrub_stamp":"2024-09-14T11:22:59.565357+0000","last_clean_scrub_stamp":"2024-09-14T11:22:59.565357+0000","objects_scrubbed":3,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:14.300547+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":660,"num_read_kb":2173,"num_write":1090,"num_write_kb":20935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":512,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:59.293347+0000","last_change":"2024-09-14T11:22:59.293285+0000","last_active":"2024-09-14T11:22:59.293347+0000","last_peered":"2024-09-14T11:22:59.293347+0000","last_clean":"2024-09-14T11:22:59.293347+0000","last_became_active":"2024-09-14T10:45:33.564407+0000","last_became_peered":"2024-09-14T10:45:33.564407+0000","last_unstale":"2024-09-14T11:22:59.293347+0000","last_undegraded":"2024-09-14T11:22:59.293347+0000","last_fullsized":"2024-09-14T11:22:59.293347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:59.293199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:59.293199+0000","last_clean_scrub_stamp":"2024-09-14T11:22:59.293199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:33.650485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099134599999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":496,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:09.610979+0000","last_change":"2024-09-14T11:23:09.610887+0000","last_active":"2024-09-14T11:23:09.610979+0000","last_peered":"2024-09-14T11:23:09.610979+0000","last_clean":"2024-09-14T11:23:09.610979+0000","last_became_active":"2024-09-14T10:45:47.724774+0000","last_became_peered":"2024-09-14T10:45:47.724774+0000","last_unstale":"2024-09-14T11:23:09.610979+0000","last_undegraded":"2024-09-14T11:23:09.610979+0000","last_fullsized":"2024-09-14T11:23:09.610979+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:09.610793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:09.610793+0000","last_clean_scrub_stamp":"2024-09-14T11:23:09.610793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:43.851455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"260'164","reported_seq":709,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:14.280039+0000","last_change":"2024-09-14T11:23:14.279970+0000","last_active":"2024-09-14T11:23:14.280039+0000","last_peered":"2024-09-14T11:23:14.280039+0000","last_clean":"2024-09-14T11:23:14.280039+0000","last_became_active":"2024-09-14T10:45:49.731380+0000","last_became_peered":"2024-09-14T10:45:49.731380+0000","last_unstale":"2024-09-14T11:23:14.280039+0000","last_undegraded":"2024-09-14T11:23:14.280039+0000","last_fullsized":"2024-09-14T11:23:14.280039+0000","mapping_epoch":30,"log_start":"257'100","ondisk_log_start":"257'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'164","last_scrub_stamp":"2024-09-14T11:23:14.279872+0000","last_deep_scrub":"260'164","last_deep_scrub_stamp":"2024-09-14T11:23:14.279872+0000","last_clean_scrub_stamp":"2024-09-14T11:23:14.279872+0000","objects_scrubbed":9,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:37:02.128672+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":200,"num_read_kb":190,"num_write":162,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6272,"num_omap_keys":14,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"260'796","reported_seq":2748,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:17.556316+0000","last_change":"2024-09-14T11:23:17.556316+0000","last_active":"2024-09-14T11:23:17.556316+0000","last_peered":"2024-09-14T11:23:17.556316+0000","last_clean":"2024-09-14T11:23:17.556316+0000","last_became_active":"2024-09-14T10:45:51.746984+0000","last_became_peered":"2024-09-14T10:45:51.746984+0000","last_unstale":"2024-09-14T11:23:17.556316+0000","last_undegraded":"2024-09-14T11:23:17.556316+0000","last_fullsized":"2024-09-14T11:23:17.556316+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'796","last_scrub_stamp":"2024-09-14T11:23:17.556213+0000","last_deep_scrub":"260'796","last_deep_scrub_stamp":"2024-09-14T11:23:17.556213+0000","last_clean_scrub_stamp":"2024-09-14T11:23:17.556213+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:46:30.527918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"260'123","reported_seq":622,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:22.762909+0000","last_change":"2024-09-14T11:23:22.762909+0000","last_active":"2024-09-14T11:23:22.762909+0000","last_peered":"2024-09-14T11:23:22.762909+0000","last_clean":"2024-09-14T11:23:22.762909+0000","last_became_active":"2024-09-14T10:45:53.749802+0000","last_became_peered":"2024-09-14T10:45:53.749802+0000","last_unstale":"2024-09-14T11:23:22.762909+0000","last_undegraded":"2024-09-14T11:23:22.762909+0000","last_fullsized":"2024-09-14T11:23:22.762909+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'123","last_scrub_stamp":"2024-09-14T11:23:22.762824+0000","last_deep_scrub":"260'123","last_deep_scrub_stamp":"2024-09-14T11:23:22.762824+0000","last_clean_scrub_stamp":"2024-09-14T11:23:22.762824+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:29.506077+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":146,"num_read_kb":135,"num_write":274,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"260'413","reported_seq":1906,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:01.936290+0000","last_change":"2024-09-14T11:23:01.936290+0000","last_active":"2024-09-14T11:23:01.936290+0000","last_peered":"2024-09-14T11:23:01.936290+0000","last_clean":"2024-09-14T11:23:01.936290+0000","last_became_active":"2024-09-14T10:45:45.710204+0000","last_became_peered":"2024-09-14T10:45:45.710204+0000","last_unstale":"2024-09-14T11:23:01.936290+0000","last_undegraded":"2024-09-14T11:23:01.936290+0000","last_fullsized":"2024-09-14T11:23:01.936290+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'413","last_scrub_stamp":"2024-09-14T11:23:01.936187+0000","last_deep_scrub":"260'413","last_deep_scrub_stamp":"2024-09-14T11:23:01.936187+0000","last_clean_scrub_stamp":"2024-09-14T11:23:01.936187+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:16.997744+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2141,"num_read_kb":2031,"num_write":456,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"260'376","reported_seq":1153,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:58.064053+0000","last_change":"2024-09-14T11:22:58.064053+0000","last_active":"2024-09-14T11:22:58.064053+0000","last_peered":"2024-09-14T11:22:58.064053+0000","last_clean":"2024-09-14T11:22:58.064053+0000","last_became_active":"2024-09-14T10:45:43.688114+0000","last_became_peered":"2024-09-14T10:45:43.688114+0000","last_unstale":"2024-09-14T11:22:58.064053+0000","last_undegraded":"2024-09-14T11:22:58.064053+0000","last_fullsized":"2024-09-14T11:22:58.064053+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'376","last_scrub_stamp":"2024-09-14T11:22:58.063966+0000","last_deep_scrub":"260'376","last_deep_scrub_stamp":"2024-09-14T11:22:58.063966+0000","last_clean_scrub_stamp":"2024-09-14T11:22:58.063966+0000","objects_scrubbed":3,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:30.176310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":828,"num_read_kb":15214,"num_write":1175,"num_write_kb":42293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":517,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:00.943595+0000","last_change":"2024-09-14T11:23:00.943595+0000","last_active":"2024-09-14T11:23:00.943595+0000","last_peered":"2024-09-14T11:23:00.943595+0000","last_clean":"2024-09-14T11:23:00.943595+0000","last_became_active":"2024-09-14T10:45:33.610909+0000","last_became_peered":"2024-09-14T10:45:33.610909+0000","last_unstale":"2024-09-14T11:23:00.943595+0000","last_undegraded":"2024-09-14T11:23:00.943595+0000","last_fullsized":"2024-09-14T11:23:00.943595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:00.943508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:00.943508+0000","last_clean_scrub_stamp":"2024-09-14T11:23:00.943508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:53.613527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038435900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:22.180284+0000","last_change":"2024-09-14T11:23:22.180284+0000","last_active":"2024-09-14T11:23:22.180284+0000","last_peered":"2024-09-14T11:23:22.180284+0000","last_clean":"2024-09-14T11:23:22.180284+0000","last_became_active":"2024-09-14T10:45:47.728343+0000","last_became_peered":"2024-09-14T10:45:47.728343+0000","last_unstale":"2024-09-14T11:23:22.180284+0000","last_undegraded":"2024-09-14T11:23:22.180284+0000","last_fullsized":"2024-09-14T11:23:22.180284+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:22.180193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:22.180193+0000","last_clean_scrub_stamp":"2024-09-14T11:23:22.180193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:14.286725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"260'97","reported_seq":619,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:29.248240+0000","last_change":"2024-09-14T11:23:29.248240+0000","last_active":"2024-09-14T11:23:29.248240+0000","last_peered":"2024-09-14T11:23:29.248240+0000","last_clean":"2024-09-14T11:23:29.248240+0000","last_became_active":"2024-09-14T10:45:49.735557+0000","last_became_peered":"2024-09-14T10:45:49.735557+0000","last_unstale":"2024-09-14T11:23:29.248240+0000","last_undegraded":"2024-09-14T11:23:29.248240+0000","last_fullsized":"2024-09-14T11:23:29.248240+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'97","last_scrub_stamp":"2024-09-14T11:23:29.248143+0000","last_deep_scrub":"260'97","last_deep_scrub_stamp":"2024-09-14T11:23:29.248143+0000","last_clean_scrub_stamp":"2024-09-14T11:23:29.248143+0000","objects_scrubbed":5,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:15.434542+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"260'806","reported_seq":2222,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:23.448147+0000","last_change":"2024-09-14T11:23:23.448147+0000","last_active":"2024-09-14T11:23:23.448147+0000","last_peered":"2024-09-14T11:23:23.448147+0000","last_clean":"2024-09-14T11:23:23.448147+0000","last_became_active":"2024-09-14T10:45:51.746874+0000","last_became_peered":"2024-09-14T10:45:51.746874+0000","last_unstale":"2024-09-14T11:23:23.448147+0000","last_undegraded":"2024-09-14T11:23:23.448147+0000","last_fullsized":"2024-09-14T11:23:23.448147+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'806","last_scrub_stamp":"2024-09-14T11:23:23.448070+0000","last_deep_scrub":"260'806","last_deep_scrub_stamp":"2024-09-14T11:23:23.448070+0000","last_clean_scrub_stamp":"2024-09-14T11:23:23.448070+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:45.072572+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"260'175","reported_seq":666,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:31.528504+0000","last_change":"2024-09-14T11:23:31.528504+0000","last_active":"2024-09-14T11:23:31.528504+0000","last_peered":"2024-09-14T11:23:31.528504+0000","last_clean":"2024-09-14T11:23:31.528504+0000","last_became_active":"2024-09-14T10:45:53.748880+0000","last_became_peered":"2024-09-14T10:45:53.748880+0000","last_unstale":"2024-09-14T11:23:31.528504+0000","last_undegraded":"2024-09-14T11:23:31.528504+0000","last_fullsized":"2024-09-14T11:23:31.528504+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'175","last_scrub_stamp":"2024-09-14T11:23:31.528414+0000","last_deep_scrub":"260'175","last_deep_scrub_stamp":"2024-09-14T11:23:31.528414+0000","last_clean_scrub_stamp":"2024-09-14T11:23:31.528414+0000","objects_scrubbed":4,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:36.836942+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":483,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":133,"num_read_kb":125,"num_write":394,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"260'407","reported_seq":1926,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:15.452071+0000","last_change":"2024-09-14T11:23:15.452071+0000","last_active":"2024-09-14T11:23:15.452071+0000","last_peered":"2024-09-14T11:23:15.452071+0000","last_clean":"2024-09-14T11:23:15.452071+0000","last_became_active":"2024-09-14T10:45:45.713313+0000","last_became_peered":"2024-09-14T10:45:45.713313+0000","last_unstale":"2024-09-14T11:23:15.452071+0000","last_undegraded":"2024-09-14T11:23:15.452071+0000","last_fullsized":"2024-09-14T11:23:15.452071+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'407","last_scrub_stamp":"2024-09-14T11:23:15.451983+0000","last_deep_scrub":"260'407","last_deep_scrub_stamp":"2024-09-14T11:23:15.451983+0000","last_clean_scrub_stamp":"2024-09-14T11:23:15.451983+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:11.569441+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2392,"num_read_kb":2258,"num_write":470,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2804,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"260'370","reported_seq":1118,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:03.896483+0000","last_change":"2024-09-14T11:23:03.896483+0000","last_active":"2024-09-14T11:23:03.896483+0000","last_peered":"2024-09-14T11:23:03.896483+0000","last_clean":"2024-09-14T11:23:03.896483+0000","last_became_active":"2024-09-14T10:45:43.689593+0000","last_became_peered":"2024-09-14T10:45:43.689593+0000","last_unstale":"2024-09-14T11:23:03.896483+0000","last_undegraded":"2024-09-14T11:23:03.896483+0000","last_fullsized":"2024-09-14T11:23:03.896483+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'370","last_scrub_stamp":"2024-09-14T11:23:03.896370+0000","last_deep_scrub":"260'370","last_deep_scrub_stamp":"2024-09-14T11:23:03.896370+0000","last_clean_scrub_stamp":"2024-09-14T11:23:03.896370+0000","objects_scrubbed":5,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:58:27.060305+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267348,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1017,"num_read_kb":46619,"num_write":1250,"num_write_kb":43963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":511,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:00.328992+0000","last_change":"2024-09-14T11:23:00.328992+0000","last_active":"2024-09-14T11:23:00.328992+0000","last_peered":"2024-09-14T11:23:00.328992+0000","last_clean":"2024-09-14T11:23:00.328992+0000","last_became_active":"2024-09-14T10:45:33.610689+0000","last_became_peered":"2024-09-14T10:45:33.610689+0000","last_unstale":"2024-09-14T11:23:00.328992+0000","last_undegraded":"2024-09-14T11:23:00.328992+0000","last_fullsized":"2024-09-14T11:23:00.328992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:00.328887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:00.328887+0000","last_clean_scrub_stamp":"2024-09-14T11:23:00.328887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:01:42.965803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011461920000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":495,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:11.785031+0000","last_change":"2024-09-14T11:23:11.785031+0000","last_active":"2024-09-14T11:23:11.785031+0000","last_peered":"2024-09-14T11:23:11.785031+0000","last_clean":"2024-09-14T11:23:11.785031+0000","last_became_active":"2024-09-14T10:45:47.728312+0000","last_became_peered":"2024-09-14T10:45:47.728312+0000","last_unstale":"2024-09-14T11:23:11.785031+0000","last_undegraded":"2024-09-14T11:23:11.785031+0000","last_fullsized":"2024-09-14T11:23:11.785031+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:11.784943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:11.784943+0000","last_clean_scrub_stamp":"2024-09-14T11:23:11.784943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:16.816883+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"260'724","reported_seq":1435,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:12.640289+0000","last_change":"2024-09-14T11:23:12.640223+0000","last_active":"2024-09-14T11:23:12.640289+0000","last_peered":"2024-09-14T11:23:12.640289+0000","last_clean":"2024-09-14T11:23:12.640289+0000","last_became_active":"2024-09-14T10:45:49.733812+0000","last_became_peered":"2024-09-14T10:45:49.733812+0000","last_unstale":"2024-09-14T11:23:12.640289+0000","last_undegraded":"2024-09-14T11:23:12.640289+0000","last_fullsized":"2024-09-14T11:23:12.640289+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'724","last_scrub_stamp":"2024-09-14T11:23:12.640119+0000","last_deep_scrub":"260'724","last_deep_scrub_stamp":"2024-09-14T11:23:12.640119+0000","last_clean_scrub_stamp":"2024-09-14T11:23:12.640119+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":700,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:51.052214+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137505,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1282,"num_read_kb":3061,"num_write":1046,"num_write_kb":877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:25.729577+0000","last_change":"2024-09-14T11:23:25.729577+0000","last_active":"2024-09-14T11:23:25.729577+0000","last_peered":"2024-09-14T11:23:25.729577+0000","last_clean":"2024-09-14T11:23:25.729577+0000","last_became_active":"2024-09-14T10:45:51.745137+0000","last_became_peered":"2024-09-14T10:45:51.745137+0000","last_unstale":"2024-09-14T11:23:25.729577+0000","last_undegraded":"2024-09-14T11:23:25.729577+0000","last_fullsized":"2024-09-14T11:23:25.729577+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:25.729479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:25.729479+0000","last_clean_scrub_stamp":"2024-09-14T11:23:25.729479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:31:55.711393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"260'134","reported_seq":634,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:23.425573+0000","last_change":"2024-09-14T11:23:23.425573+0000","last_active":"2024-09-14T11:23:23.425573+0000","last_peered":"2024-09-14T11:23:23.425573+0000","last_clean":"2024-09-14T11:23:23.425573+0000","last_became_active":"2024-09-14T10:45:53.751511+0000","last_became_peered":"2024-09-14T10:45:53.751511+0000","last_unstale":"2024-09-14T11:23:23.425573+0000","last_undegraded":"2024-09-14T11:23:23.425573+0000","last_fullsized":"2024-09-14T11:23:23.425573+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'134","last_scrub_stamp":"2024-09-14T11:23:23.425489+0000","last_deep_scrub":"260'134","last_deep_scrub_stamp":"2024-09-14T11:23:23.425489+0000","last_clean_scrub_stamp":"2024-09-14T11:23:23.425489+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:46.588914+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":202,"num_read_kb":180,"num_write":339,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"260'196","reported_seq":802,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:32.572381+0000","last_change":"2024-09-14T11:23:32.572381+0000","last_active":"2024-09-14T11:23:32.572381+0000","last_peered":"2024-09-14T11:23:32.572381+0000","last_clean":"2024-09-14T11:23:32.572381+0000","last_became_active":"2024-09-14T10:45:53.747090+0000","last_became_peered":"2024-09-14T10:45:53.747090+0000","last_unstale":"2024-09-14T11:23:32.572381+0000","last_undegraded":"2024-09-14T11:23:32.572381+0000","last_fullsized":"2024-09-14T11:23:32.572381+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'196","last_scrub_stamp":"2024-09-14T11:23:32.572284+0000","last_deep_scrub":"260'196","last_deep_scrub_stamp":"2024-09-14T11:23:32.572284+0000","last_clean_scrub_stamp":"2024-09-14T11:23:32.572284+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:11.027009+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":464,"num_read_kb":408,"num_write":469,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"260'463","reported_seq":1949,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:13.405280+0000","last_change":"2024-09-14T11:23:13.405280+0000","last_active":"2024-09-14T11:23:13.405280+0000","last_peered":"2024-09-14T11:23:13.405280+0000","last_clean":"2024-09-14T11:23:13.405280+0000","last_became_active":"2024-09-14T10:45:45.719181+0000","last_became_peered":"2024-09-14T10:45:45.719181+0000","last_unstale":"2024-09-14T11:23:13.405280+0000","last_undegraded":"2024-09-14T11:23:13.405280+0000","last_fullsized":"2024-09-14T11:23:13.405280+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'463","last_scrub_stamp":"2024-09-14T11:23:13.405187+0000","last_deep_scrub":"260'463","last_deep_scrub_stamp":"2024-09-14T11:23:13.405187+0000","last_clean_scrub_stamp":"2024-09-14T11:23:13.405187+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:49:14.290897+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2298,"num_read_kb":2151,"num_write":532,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"260'403","reported_seq":1070,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:06.181433+0000","last_change":"2024-09-14T11:23:06.181360+0000","last_active":"2024-09-14T11:23:06.181433+0000","last_peered":"2024-09-14T11:23:06.181433+0000","last_clean":"2024-09-14T11:23:06.181433+0000","last_became_active":"2024-09-14T10:45:43.673475+0000","last_became_peered":"2024-09-14T10:45:43.673475+0000","last_unstale":"2024-09-14T11:23:06.181433+0000","last_undegraded":"2024-09-14T11:23:06.181433+0000","last_fullsized":"2024-09-14T11:23:06.181433+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'403","last_scrub_stamp":"2024-09-14T11:23:06.181264+0000","last_deep_scrub":"260'403","last_deep_scrub_stamp":"2024-09-14T11:23:06.181264+0000","last_clean_scrub_stamp":"2024-09-14T11:23:06.181264+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:01.791158+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":761,"num_read_kb":57050,"num_write":1291,"num_write_kb":43494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:13.270673+0000","last_change":"2024-09-14T11:23:13.270673+0000","last_active":"2024-09-14T11:23:13.270673+0000","last_peered":"2024-09-14T11:23:13.270673+0000","last_clean":"2024-09-14T11:23:13.270673+0000","last_became_active":"2024-09-14T10:45:47.726819+0000","last_became_peered":"2024-09-14T10:45:47.726819+0000","last_unstale":"2024-09-14T11:23:13.270673+0000","last_undegraded":"2024-09-14T11:23:13.270673+0000","last_fullsized":"2024-09-14T11:23:13.270673+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:13.270587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:13.270587+0000","last_clean_scrub_stamp":"2024-09-14T11:23:13.270587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:32:10.160393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"260'275","reported_seq":835,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:20.185781+0000","last_change":"2024-09-14T11:23:20.185781+0000","last_active":"2024-09-14T11:23:20.185781+0000","last_peered":"2024-09-14T11:23:20.185781+0000","last_clean":"2024-09-14T11:23:20.185781+0000","last_became_active":"2024-09-14T10:45:49.732755+0000","last_became_peered":"2024-09-14T10:45:49.732755+0000","last_unstale":"2024-09-14T11:23:20.185781+0000","last_undegraded":"2024-09-14T11:23:20.185781+0000","last_fullsized":"2024-09-14T11:23:20.185781+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'275","last_scrub_stamp":"2024-09-14T11:23:20.185661+0000","last_deep_scrub":"260'275","last_deep_scrub_stamp":"2024-09-14T11:23:20.185661+0000","last_clean_scrub_stamp":"2024-09-14T11:23:20.185661+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:41.760457+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48124,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":453,"num_read_kb":1077,"num_write":370,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":481,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:16.626195+0000","last_change":"2024-09-14T11:23:16.626195+0000","last_active":"2024-09-14T11:23:16.626195+0000","last_peered":"2024-09-14T11:23:16.626195+0000","last_clean":"2024-09-14T11:23:16.626195+0000","last_became_active":"2024-09-14T10:45:51.747624+0000","last_became_peered":"2024-09-14T10:45:51.747624+0000","last_unstale":"2024-09-14T11:23:16.626195+0000","last_undegraded":"2024-09-14T11:23:16.626195+0000","last_fullsized":"2024-09-14T11:23:16.626195+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:16.626109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:16.626109+0000","last_clean_scrub_stamp":"2024-09-14T11:23:16.626109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:14.233513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"260'139","reported_seq":635,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:23.771744+0000","last_change":"2024-09-14T11:23:23.771744+0000","last_active":"2024-09-14T11:23:23.771744+0000","last_peered":"2024-09-14T11:23:23.771744+0000","last_clean":"2024-09-14T11:23:23.771744+0000","last_became_active":"2024-09-14T10:45:53.750866+0000","last_became_peered":"2024-09-14T10:45:53.750866+0000","last_unstale":"2024-09-14T11:23:23.771744+0000","last_undegraded":"2024-09-14T11:23:23.771744+0000","last_fullsized":"2024-09-14T11:23:23.771744+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'139","last_scrub_stamp":"2024-09-14T11:23:23.771657+0000","last_deep_scrub":"260'139","last_deep_scrub_stamp":"2024-09-14T11:23:23.771657+0000","last_clean_scrub_stamp":"2024-09-14T11:23:23.771657+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:32.786651+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":161,"num_read_kb":145,"num_write":328,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"260'718","reported_seq":2452,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:05.853802+0000","last_change":"2024-09-14T11:23:05.853747+0000","last_active":"2024-09-14T11:23:05.853802+0000","last_peered":"2024-09-14T11:23:05.853802+0000","last_clean":"2024-09-14T11:23:05.853802+0000","last_became_active":"2024-09-14T10:45:45.719731+0000","last_became_peered":"2024-09-14T10:45:45.719731+0000","last_unstale":"2024-09-14T11:23:05.853802+0000","last_undegraded":"2024-09-14T11:23:05.853802+0000","last_fullsized":"2024-09-14T11:23:05.853802+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'718","last_scrub_stamp":"2024-09-14T11:23:05.853644+0000","last_deep_scrub":"260'718","last_deep_scrub_stamp":"2024-09-14T11:23:05.853644+0000","last_clean_scrub_stamp":"2024-09-14T11:23:05.853644+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":700,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:10.570219+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3605,"num_read_kb":3249,"num_write":949,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":744,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"260'335","reported_seq":951,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:55.643327+0000","last_change":"2024-09-14T11:22:55.643327+0000","last_active":"2024-09-14T11:22:55.643327+0000","last_peered":"2024-09-14T11:22:55.643327+0000","last_clean":"2024-09-14T11:22:55.643327+0000","last_became_active":"2024-09-14T10:45:43.682925+0000","last_became_peered":"2024-09-14T10:45:43.682925+0000","last_unstale":"2024-09-14T11:22:55.643327+0000","last_undegraded":"2024-09-14T11:22:55.643327+0000","last_fullsized":"2024-09-14T11:22:55.643327+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'335","last_scrub_stamp":"2024-09-14T11:22:55.643226+0000","last_deep_scrub":"260'335","last_deep_scrub_stamp":"2024-09-14T11:22:55.643226+0000","last_clean_scrub_stamp":"2024-09-14T11:22:55.643226+0000","objects_scrubbed":3,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:47:02.635100+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":623,"num_read_kb":1213,"num_write":1012,"num_write_kb":13029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":493,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:15.845183+0000","last_change":"2024-09-14T11:23:15.845183+0000","last_active":"2024-09-14T11:23:15.845183+0000","last_peered":"2024-09-14T11:23:15.845183+0000","last_clean":"2024-09-14T11:23:15.845183+0000","last_became_active":"2024-09-14T10:45:47.724432+0000","last_became_peered":"2024-09-14T10:45:47.724432+0000","last_unstale":"2024-09-14T11:23:15.845183+0000","last_undegraded":"2024-09-14T11:23:15.845183+0000","last_fullsized":"2024-09-14T11:23:15.845183+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:15.845093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:15.845093+0000","last_clean_scrub_stamp":"2024-09-14T11:23:15.845093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:06.714822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"260'48","reported_seq":545,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:21.684279+0000","last_change":"2024-09-14T11:23:21.684279+0000","last_active":"2024-09-14T11:23:21.684279+0000","last_peered":"2024-09-14T11:23:21.684279+0000","last_clean":"2024-09-14T11:23:21.684279+0000","last_became_active":"2024-09-14T10:45:49.735053+0000","last_became_peered":"2024-09-14T10:45:49.735053+0000","last_unstale":"2024-09-14T11:23:21.684279+0000","last_undegraded":"2024-09-14T11:23:21.684279+0000","last_fullsized":"2024-09-14T11:23:21.684279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'48","last_scrub_stamp":"2024-09-14T11:23:21.684200+0000","last_deep_scrub":"260'48","last_deep_scrub_stamp":"2024-09-14T11:23:21.684200+0000","last_clean_scrub_stamp":"2024-09-14T11:23:21.684200+0000","objects_scrubbed":3,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:18.185222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":24,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":476,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:18.488548+0000","last_change":"2024-09-14T11:23:18.488548+0000","last_active":"2024-09-14T11:23:18.488548+0000","last_peered":"2024-09-14T11:23:18.488548+0000","last_clean":"2024-09-14T11:23:18.488548+0000","last_became_active":"2024-09-14T10:45:51.747600+0000","last_became_peered":"2024-09-14T10:45:51.747600+0000","last_unstale":"2024-09-14T11:23:18.488548+0000","last_undegraded":"2024-09-14T11:23:18.488548+0000","last_fullsized":"2024-09-14T11:23:18.488548+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:18.488476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:18.488476+0000","last_clean_scrub_stamp":"2024-09-14T11:23:18.488476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:19.436085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"260'224","reported_seq":754,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:25.291231+0000","last_change":"2024-09-14T11:23:25.291172+0000","last_active":"2024-09-14T11:23:25.291231+0000","last_peered":"2024-09-14T11:23:25.291231+0000","last_clean":"2024-09-14T11:23:25.291231+0000","last_became_active":"2024-09-14T10:45:53.751504+0000","last_became_peered":"2024-09-14T10:45:53.751504+0000","last_unstale":"2024-09-14T11:23:25.291231+0000","last_undegraded":"2024-09-14T11:23:25.291231+0000","last_fullsized":"2024-09-14T11:23:25.291231+0000","mapping_epoch":34,"log_start":"260'200","ondisk_log_start":"260'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'224","last_scrub_stamp":"2024-09-14T11:23:25.291079+0000","last_deep_scrub":"260'224","last_deep_scrub_stamp":"2024-09-14T11:23:25.291079+0000","last_clean_scrub_stamp":"2024-09-14T11:23:25.291079+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:58.984777+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":402,"num_read_kb":374,"num_write":536,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"260'728","reported_seq":2181,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:04.897428+0000","last_change":"2024-09-14T11:23:04.897345+0000","last_active":"2024-09-14T11:23:04.897428+0000","last_peered":"2024-09-14T11:23:04.897428+0000","last_clean":"2024-09-14T11:23:04.897428+0000","last_became_active":"2024-09-14T10:45:45.714326+0000","last_became_peered":"2024-09-14T10:45:45.714326+0000","last_unstale":"2024-09-14T11:23:04.897428+0000","last_undegraded":"2024-09-14T11:23:04.897428+0000","last_fullsized":"2024-09-14T11:23:04.897428+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'728","last_scrub_stamp":"2024-09-14T11:23:04.897221+0000","last_deep_scrub":"260'728","last_deep_scrub_stamp":"2024-09-14T11:23:04.897221+0000","last_clean_scrub_stamp":"2024-09-14T11:23:04.897221+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":700,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:36:03.252363+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3492,"num_read_kb":3158,"num_write":966,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"260'397","reported_seq":1053,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:59.257108+0000","last_change":"2024-09-14T11:22:59.257108+0000","last_active":"2024-09-14T11:22:59.257108+0000","last_peered":"2024-09-14T11:22:59.257108+0000","last_clean":"2024-09-14T11:22:59.257108+0000","last_became_active":"2024-09-14T10:45:43.671747+0000","last_became_peered":"2024-09-14T10:45:43.671747+0000","last_unstale":"2024-09-14T11:22:59.257108+0000","last_undegraded":"2024-09-14T11:22:59.257108+0000","last_fullsized":"2024-09-14T11:22:59.257108+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'397","last_scrub_stamp":"2024-09-14T11:22:59.256989+0000","last_deep_scrub":"260'397","last_deep_scrub_stamp":"2024-09-14T11:22:59.256989+0000","last_clean_scrub_stamp":"2024-09-14T11:22:59.256989+0000","objects_scrubbed":7,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:33.390781+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":703,"num_read_kb":3196,"num_write":1248,"num_write_kb":29609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:07.246948+0000","last_change":"2024-09-14T11:23:07.246825+0000","last_active":"2024-09-14T11:23:07.246948+0000","last_peered":"2024-09-14T11:23:07.246948+0000","last_clean":"2024-09-14T11:23:07.246948+0000","last_became_active":"2024-09-14T10:45:47.731640+0000","last_became_peered":"2024-09-14T10:45:47.731640+0000","last_unstale":"2024-09-14T11:23:07.246948+0000","last_undegraded":"2024-09-14T11:23:07.246948+0000","last_fullsized":"2024-09-14T11:23:07.246948+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:07.246721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:07.246721+0000","last_clean_scrub_stamp":"2024-09-14T11:23:07.246721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:46.259045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"260'325","reported_seq":903,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:13.682072+0000","last_change":"2024-09-14T11:23:13.682072+0000","last_active":"2024-09-14T11:23:13.682072+0000","last_peered":"2024-09-14T11:23:13.682072+0000","last_clean":"2024-09-14T11:23:13.682072+0000","last_became_active":"2024-09-14T10:45:49.727431+0000","last_became_peered":"2024-09-14T10:45:49.727431+0000","last_unstale":"2024-09-14T11:23:13.682072+0000","last_undegraded":"2024-09-14T11:23:13.682072+0000","last_fullsized":"2024-09-14T11:23:13.682072+0000","mapping_epoch":30,"log_start":"260'300","ondisk_log_start":"260'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'325","last_scrub_stamp":"2024-09-14T11:23:13.681974+0000","last_deep_scrub":"260'325","last_deep_scrub_stamp":"2024-09-14T11:23:13.681974+0000","last_clean_scrub_stamp":"2024-09-14T11:23:13.681974+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:16:25.075634+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46674,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":519,"num_read_kb":1163,"num_write":422,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":485,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:24.581005+0000","last_change":"2024-09-14T11:23:24.581005+0000","last_active":"2024-09-14T11:23:24.581005+0000","last_peered":"2024-09-14T11:23:24.581005+0000","last_clean":"2024-09-14T11:23:24.581005+0000","last_became_active":"2024-09-14T10:45:51.746506+0000","last_became_peered":"2024-09-14T10:45:51.746506+0000","last_unstale":"2024-09-14T11:23:24.581005+0000","last_undegraded":"2024-09-14T11:23:24.581005+0000","last_fullsized":"2024-09-14T11:23:24.581005+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:24.580922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:24.580922+0000","last_clean_scrub_stamp":"2024-09-14T11:23:24.580922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:17:37.498334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"260'144","reported_seq":637,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:13.098165+0000","last_change":"2024-09-14T10:45:53.755475+0000","last_active":"2024-09-14T11:21:13.098165+0000","last_peered":"2024-09-14T11:21:13.098165+0000","last_clean":"2024-09-14T11:21:13.098165+0000","last_became_active":"2024-09-14T10:45:53.755018+0000","last_became_peered":"2024-09-14T10:45:53.755018+0000","last_unstale":"2024-09-14T11:21:13.098165+0000","last_undegraded":"2024-09-14T11:21:13.098165+0000","last_fullsized":"2024-09-14T11:21:13.098165+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":167,"num_write":339,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"260'401","reported_seq":1936,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:03.743737+0000","last_change":"2024-09-14T11:23:03.743647+0000","last_active":"2024-09-14T11:23:03.743737+0000","last_peered":"2024-09-14T11:23:03.743737+0000","last_clean":"2024-09-14T11:23:03.743737+0000","last_became_active":"2024-09-14T10:45:45.713138+0000","last_became_peered":"2024-09-14T10:45:45.713138+0000","last_unstale":"2024-09-14T11:23:03.743737+0000","last_undegraded":"2024-09-14T11:23:03.743737+0000","last_fullsized":"2024-09-14T11:23:03.743737+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'401","last_scrub_stamp":"2024-09-14T11:23:03.743538+0000","last_deep_scrub":"260'401","last_deep_scrub_stamp":"2024-09-14T11:23:03.743538+0000","last_clean_scrub_stamp":"2024-09-14T11:23:03.743538+0000","objects_scrubbed":1,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:26.074630+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2187,"num_read_kb":2089,"num_write":453,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"260'381","reported_seq":999,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:57.171682+0000","last_change":"2024-09-14T11:22:57.171682+0000","last_active":"2024-09-14T11:22:57.171682+0000","last_peered":"2024-09-14T11:22:57.171682+0000","last_clean":"2024-09-14T11:22:57.171682+0000","last_became_active":"2024-09-14T10:45:43.680629+0000","last_became_peered":"2024-09-14T10:45:43.680629+0000","last_unstale":"2024-09-14T11:22:57.171682+0000","last_undegraded":"2024-09-14T11:22:57.171682+0000","last_fullsized":"2024-09-14T11:22:57.171682+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'381","last_scrub_stamp":"2024-09-14T11:22:57.171580+0000","last_deep_scrub":"260'381","last_deep_scrub_stamp":"2024-09-14T11:22:57.171580+0000","last_clean_scrub_stamp":"2024-09-14T11:22:57.171580+0000","objects_scrubbed":6,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:30.709275+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133684,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":617,"num_read_kb":9938,"num_write":1232,"num_write_kb":44861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:25.180487+0000","last_change":"2024-09-14T11:23:25.180487+0000","last_active":"2024-09-14T11:23:25.180487+0000","last_peered":"2024-09-14T11:23:25.180487+0000","last_clean":"2024-09-14T11:23:25.180487+0000","last_became_active":"2024-09-14T10:45:47.727777+0000","last_became_peered":"2024-09-14T10:45:47.727777+0000","last_unstale":"2024-09-14T11:23:25.180487+0000","last_undegraded":"2024-09-14T11:23:25.180487+0000","last_fullsized":"2024-09-14T11:23:25.180487+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:25.180385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:25.180385+0000","last_clean_scrub_stamp":"2024-09-14T11:23:25.180385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:13.371559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"260'274","reported_seq":837,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:15.664884+0000","last_change":"2024-09-14T11:23:15.664884+0000","last_active":"2024-09-14T11:23:15.664884+0000","last_peered":"2024-09-14T11:23:15.664884+0000","last_clean":"2024-09-14T11:23:15.664884+0000","last_became_active":"2024-09-14T10:45:49.727347+0000","last_became_peered":"2024-09-14T10:45:49.727347+0000","last_unstale":"2024-09-14T11:23:15.664884+0000","last_undegraded":"2024-09-14T11:23:15.664884+0000","last_fullsized":"2024-09-14T11:23:15.664884+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'274","last_scrub_stamp":"2024-09-14T11:23:15.664798+0000","last_deep_scrub":"260'274","last_deep_scrub_stamp":"2024-09-14T11:23:15.664798+0000","last_clean_scrub_stamp":"2024-09-14T11:23:15.664798+0000","objects_scrubbed":4,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:54:10.815390+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44334,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":417,"num_read_kb":936,"num_write":344,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":481,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:17.617512+0000","last_change":"2024-09-14T11:23:17.617512+0000","last_active":"2024-09-14T11:23:17.617512+0000","last_peered":"2024-09-14T11:23:17.617512+0000","last_clean":"2024-09-14T11:23:17.617512+0000","last_became_active":"2024-09-14T10:45:51.746493+0000","last_became_peered":"2024-09-14T10:45:51.746493+0000","last_unstale":"2024-09-14T11:23:17.617512+0000","last_undegraded":"2024-09-14T11:23:17.617512+0000","last_fullsized":"2024-09-14T11:23:17.617512+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:17.617397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:17.617397+0000","last_clean_scrub_stamp":"2024-09-14T11:23:17.617397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:45.334822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"260'407","reported_seq":1986,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:18.172629+0000","last_change":"2024-09-14T11:23:18.172629+0000","last_active":"2024-09-14T11:23:18.172629+0000","last_peered":"2024-09-14T11:23:18.172629+0000","last_clean":"2024-09-14T11:23:18.172629+0000","last_became_active":"2024-09-14T10:45:45.725430+0000","last_became_peered":"2024-09-14T10:45:45.725430+0000","last_unstale":"2024-09-14T11:23:18.172629+0000","last_undegraded":"2024-09-14T11:23:18.172629+0000","last_fullsized":"2024-09-14T11:23:18.172629+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'407","last_scrub_stamp":"2024-09-14T11:23:18.172553+0000","last_deep_scrub":"260'407","last_deep_scrub_stamp":"2024-09-14T11:23:18.172553+0000","last_clean_scrub_stamp":"2024-09-14T11:23:18.172553+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:03.784478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2252,"num_read_kb":2164,"num_write":454,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"260'321","reported_seq":945,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:59.248925+0000","last_change":"2024-09-14T11:22:59.248925+0000","last_active":"2024-09-14T11:22:59.248925+0000","last_peered":"2024-09-14T11:22:59.248925+0000","last_clean":"2024-09-14T11:22:59.248925+0000","last_became_active":"2024-09-14T10:45:43.683988+0000","last_became_peered":"2024-09-14T10:45:43.683988+0000","last_unstale":"2024-09-14T11:22:59.248925+0000","last_undegraded":"2024-09-14T11:22:59.248925+0000","last_fullsized":"2024-09-14T11:22:59.248925+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'321","last_scrub_stamp":"2024-09-14T11:22:59.248787+0000","last_deep_scrub":"260'321","last_deep_scrub_stamp":"2024-09-14T11:22:59.248787+0000","last_clean_scrub_stamp":"2024-09-14T11:22:59.248787+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:00.495190+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":562,"num_read_kb":32573,"num_write":1061,"num_write_kb":14583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:15.227653+0000","last_change":"2024-09-14T11:23:15.227653+0000","last_active":"2024-09-14T11:23:15.227653+0000","last_peered":"2024-09-14T11:23:15.227653+0000","last_clean":"2024-09-14T11:23:15.227653+0000","last_became_active":"2024-09-14T10:45:47.728323+0000","last_became_peered":"2024-09-14T10:45:47.728323+0000","last_unstale":"2024-09-14T11:23:15.227653+0000","last_undegraded":"2024-09-14T11:23:15.227653+0000","last_fullsized":"2024-09-14T11:23:15.227653+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:15.227516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:15.227516+0000","last_clean_scrub_stamp":"2024-09-14T11:23:15.227516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:27:28.550391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"260'494","reported_seq":1110,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:17.288328+0000","last_change":"2024-09-14T11:23:17.288281+0000","last_active":"2024-09-14T11:23:17.288328+0000","last_peered":"2024-09-14T11:23:17.288328+0000","last_clean":"2024-09-14T11:23:17.288328+0000","last_became_active":"2024-09-14T10:45:49.728841+0000","last_became_peered":"2024-09-14T10:45:49.728841+0000","last_unstale":"2024-09-14T11:23:17.288328+0000","last_undegraded":"2024-09-14T11:23:17.288328+0000","last_fullsized":"2024-09-14T11:23:17.288328+0000","mapping_epoch":30,"log_start":"260'400","ondisk_log_start":"260'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'494","last_scrub_stamp":"2024-09-14T11:23:17.288177+0000","last_deep_scrub":"260'494","last_deep_scrub_stamp":"2024-09-14T11:23:17.288177+0000","last_clean_scrub_stamp":"2024-09-14T11:23:17.288177+0000","objects_scrubbed":6,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:37.878286+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98061,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":894,"num_read_kb":2175,"num_write":778,"num_write_kb":715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":475,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:17.452522+0000","last_change":"2024-09-14T11:23:17.452438+0000","last_active":"2024-09-14T11:23:17.452522+0000","last_peered":"2024-09-14T11:23:17.452522+0000","last_clean":"2024-09-14T11:23:17.452522+0000","last_became_active":"2024-09-14T10:45:51.751776+0000","last_became_peered":"2024-09-14T10:45:51.751776+0000","last_unstale":"2024-09-14T11:23:17.452522+0000","last_undegraded":"2024-09-14T11:23:17.452522+0000","last_fullsized":"2024-09-14T11:23:17.452522+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:17.452340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:17.452340+0000","last_clean_scrub_stamp":"2024-09-14T11:23:17.452340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:14.236792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"260'173","reported_seq":677,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:33.540686+0000","last_change":"2024-09-14T11:23:33.540686+0000","last_active":"2024-09-14T11:23:33.540686+0000","last_peered":"2024-09-14T11:23:33.540686+0000","last_clean":"2024-09-14T11:23:33.540686+0000","last_became_active":"2024-09-14T10:45:53.752535+0000","last_became_peered":"2024-09-14T10:45:53.752535+0000","last_unstale":"2024-09-14T11:23:33.540686+0000","last_undegraded":"2024-09-14T11:23:33.540686+0000","last_fullsized":"2024-09-14T11:23:33.540686+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'173","last_scrub_stamp":"2024-09-14T11:23:33.540563+0000","last_deep_scrub":"260'173","last_deep_scrub_stamp":"2024-09-14T11:23:33.540563+0000","last_clean_scrub_stamp":"2024-09-14T11:23:33.540563+0000","objects_scrubbed":3,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:40.867238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":217,"num_read_kb":213,"num_write":386,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"260'443","reported_seq":2095,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:06.861605+0000","last_change":"2024-09-14T11:23:06.861605+0000","last_active":"2024-09-14T11:23:06.861605+0000","last_peered":"2024-09-14T11:23:06.861605+0000","last_clean":"2024-09-14T11:23:06.861605+0000","last_became_active":"2024-09-14T10:45:45.710498+0000","last_became_peered":"2024-09-14T10:45:45.710498+0000","last_unstale":"2024-09-14T11:23:06.861605+0000","last_undegraded":"2024-09-14T11:23:06.861605+0000","last_fullsized":"2024-09-14T11:23:06.861605+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'443","last_scrub_stamp":"2024-09-14T11:23:06.861513+0000","last_deep_scrub":"260'443","last_deep_scrub_stamp":"2024-09-14T11:23:06.861513+0000","last_clean_scrub_stamp":"2024-09-14T11:23:06.861513+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:22.830553+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2391,"num_read_kb":2291,"num_write":487,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"260'417","reported_seq":1179,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:08.794625+0000","last_change":"2024-09-14T11:23:08.794625+0000","last_active":"2024-09-14T11:23:08.794625+0000","last_peered":"2024-09-14T11:23:08.794625+0000","last_clean":"2024-09-14T11:23:08.794625+0000","last_became_active":"2024-09-14T10:45:43.688136+0000","last_became_peered":"2024-09-14T10:45:43.688136+0000","last_unstale":"2024-09-14T11:23:08.794625+0000","last_undegraded":"2024-09-14T11:23:08.794625+0000","last_fullsized":"2024-09-14T11:23:08.794625+0000","mapping_epoch":23,"log_start":"260'400","ondisk_log_start":"260'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'417","last_scrub_stamp":"2024-09-14T11:23:08.794535+0000","last_deep_scrub":"260'417","last_deep_scrub_stamp":"2024-09-14T11:23:08.794535+0000","last_clean_scrub_stamp":"2024-09-14T11:23:08.794535+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:10:34.992113+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1055,"num_read_kb":62488,"num_write":1345,"num_write_kb":26359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":486,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:10.380555+0000","last_change":"2024-09-14T11:23:10.380490+0000","last_active":"2024-09-14T11:23:10.380555+0000","last_peered":"2024-09-14T11:23:10.380555+0000","last_clean":"2024-09-14T11:23:10.380555+0000","last_became_active":"2024-09-14T10:45:47.725711+0000","last_became_peered":"2024-09-14T10:45:47.725711+0000","last_unstale":"2024-09-14T11:23:10.380555+0000","last_undegraded":"2024-09-14T11:23:10.380555+0000","last_fullsized":"2024-09-14T11:23:10.380555+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:10.380391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:10.380391+0000","last_clean_scrub_stamp":"2024-09-14T11:23:10.380391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:13:32.547617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"260'290","reported_seq":857,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:32.287964+0000","last_change":"2024-09-14T11:23:32.287964+0000","last_active":"2024-09-14T11:23:32.287964+0000","last_peered":"2024-09-14T11:23:32.287964+0000","last_clean":"2024-09-14T11:23:32.287964+0000","last_became_active":"2024-09-14T10:45:49.729803+0000","last_became_peered":"2024-09-14T10:45:49.729803+0000","last_unstale":"2024-09-14T11:23:32.287964+0000","last_undegraded":"2024-09-14T11:23:32.287964+0000","last_fullsized":"2024-09-14T11:23:32.287964+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'290","last_scrub_stamp":"2024-09-14T11:23:32.287847+0000","last_deep_scrub":"260'290","last_deep_scrub_stamp":"2024-09-14T11:23:32.287847+0000","last_clean_scrub_stamp":"2024-09-14T11:23:32.287847+0000","objects_scrubbed":8,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:07.364568+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50521,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":465,"num_read_kb":1032,"num_write":388,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":477,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:28.553892+0000","last_change":"2024-09-14T11:23:28.553892+0000","last_active":"2024-09-14T11:23:28.553892+0000","last_peered":"2024-09-14T11:23:28.553892+0000","last_clean":"2024-09-14T11:23:28.553892+0000","last_became_active":"2024-09-14T10:45:51.748871+0000","last_became_peered":"2024-09-14T10:45:51.748871+0000","last_unstale":"2024-09-14T11:23:28.553892+0000","last_undegraded":"2024-09-14T11:23:28.553892+0000","last_fullsized":"2024-09-14T11:23:28.553892+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:28.553789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:28.553789+0000","last_clean_scrub_stamp":"2024-09-14T11:23:28.553789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:07.534731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"260'208","reported_seq":1062,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.235000+0000","last_change":"2024-09-14T10:45:53.750953+0000","last_active":"2024-09-14T11:21:27.235000+0000","last_peered":"2024-09-14T11:21:27.235000+0000","last_clean":"2024-09-14T11:21:27.235000+0000","last_became_active":"2024-09-14T10:45:53.750595+0000","last_became_peered":"2024-09-14T10:45:53.750595+0000","last_unstale":"2024-09-14T11:21:27.235000+0000","last_undegraded":"2024-09-14T11:21:27.235000+0000","last_fullsized":"2024-09-14T11:21:27.235000+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1617,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":634,"num_read_kb":624,"num_write":573,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"260'1184","reported_seq":2754,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:05.739710+0000","last_change":"2024-09-14T11:23:05.739650+0000","last_active":"2024-09-14T11:23:05.739710+0000","last_peered":"2024-09-14T11:23:05.739710+0000","last_clean":"2024-09-14T11:23:05.739710+0000","last_became_active":"2024-09-14T10:45:45.721945+0000","last_became_peered":"2024-09-14T10:45:45.721945+0000","last_unstale":"2024-09-14T11:23:05.739710+0000","last_undegraded":"2024-09-14T11:23:05.739710+0000","last_fullsized":"2024-09-14T11:23:05.739710+0000","mapping_epoch":26,"log_start":"260'1100","ondisk_log_start":"260'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1184","last_scrub_stamp":"2024-09-14T11:23:05.739562+0000","last_deep_scrub":"260'1184","last_deep_scrub_stamp":"2024-09-14T11:23:05.739562+0000","last_clean_scrub_stamp":"2024-09-14T11:23:05.739562+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":1100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:11.326591+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5490,"num_read_kb":4869,"num_write":1672,"num_write_kb":727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"260'342","reported_seq":985,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:57.727489+0000","last_change":"2024-09-14T11:22:57.727410+0000","last_active":"2024-09-14T11:22:57.727489+0000","last_peered":"2024-09-14T11:22:57.727489+0000","last_clean":"2024-09-14T11:22:57.727489+0000","last_became_active":"2024-09-14T10:45:43.682457+0000","last_became_peered":"2024-09-14T10:45:43.682457+0000","last_unstale":"2024-09-14T11:22:57.727489+0000","last_undegraded":"2024-09-14T11:22:57.727489+0000","last_fullsized":"2024-09-14T11:22:57.727489+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'342","last_scrub_stamp":"2024-09-14T11:22:57.727319+0000","last_deep_scrub":"260'342","last_deep_scrub_stamp":"2024-09-14T11:22:57.727319+0000","last_clean_scrub_stamp":"2024-09-14T11:22:57.727319+0000","objects_scrubbed":8,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:06.095427+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":582,"num_read_kb":98004,"num_write":1175,"num_write_kb":36067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":483,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:09.333304+0000","last_change":"2024-09-14T11:23:09.333221+0000","last_active":"2024-09-14T11:23:09.333304+0000","last_peered":"2024-09-14T11:23:09.333304+0000","last_clean":"2024-09-14T11:23:09.333304+0000","last_became_active":"2024-09-14T10:45:47.726635+0000","last_became_peered":"2024-09-14T10:45:47.726635+0000","last_unstale":"2024-09-14T11:23:09.333304+0000","last_undegraded":"2024-09-14T11:23:09.333304+0000","last_fullsized":"2024-09-14T11:23:09.333304+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:09.333109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:09.333109+0000","last_clean_scrub_stamp":"2024-09-14T11:23:09.333109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:29.617159+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"260'278","reported_seq":840,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:18.241724+0000","last_change":"2024-09-14T11:23:18.241663+0000","last_active":"2024-09-14T11:23:18.241724+0000","last_peered":"2024-09-14T11:23:18.241724+0000","last_clean":"2024-09-14T11:23:18.241724+0000","last_became_active":"2024-09-14T10:45:49.729422+0000","last_became_peered":"2024-09-14T10:45:49.729422+0000","last_unstale":"2024-09-14T11:23:18.241724+0000","last_undegraded":"2024-09-14T11:23:18.241724+0000","last_fullsized":"2024-09-14T11:23:18.241724+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'278","last_scrub_stamp":"2024-09-14T11:23:18.241562+0000","last_deep_scrub":"260'278","last_deep_scrub_stamp":"2024-09-14T11:23:18.241562+0000","last_clean_scrub_stamp":"2024-09-14T11:23:18.241562+0000","objects_scrubbed":5,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:10.259911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45487,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":456,"num_read_kb":1073,"num_write":374,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":483,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:18.604850+0000","last_change":"2024-09-14T11:23:18.604850+0000","last_active":"2024-09-14T11:23:18.604850+0000","last_peered":"2024-09-14T11:23:18.604850+0000","last_clean":"2024-09-14T11:23:18.604850+0000","last_became_active":"2024-09-14T10:45:51.747888+0000","last_became_peered":"2024-09-14T10:45:51.747888+0000","last_unstale":"2024-09-14T11:23:18.604850+0000","last_undegraded":"2024-09-14T11:23:18.604850+0000","last_fullsized":"2024-09-14T11:23:18.604850+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:18.604749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:18.604749+0000","last_clean_scrub_stamp":"2024-09-14T11:23:18.604749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:16:45.867833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"260'126","reported_seq":598,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:43.735389+0000","last_change":"2024-09-14T10:45:53.750141+0000","last_active":"2024-09-14T11:22:43.735389+0000","last_peered":"2024-09-14T11:22:43.735389+0000","last_clean":"2024-09-14T11:22:43.735389+0000","last_became_active":"2024-09-14T10:45:53.749868+0000","last_became_peered":"2024-09-14T10:45:53.749868+0000","last_unstale":"2024-09-14T11:22:43.735389+0000","last_undegraded":"2024-09-14T11:22:43.735389+0000","last_fullsized":"2024-09-14T11:22:43.735389+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":111,"num_write":304,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"260'1125","reported_seq":2695,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:07.821294+0000","last_change":"2024-09-14T11:23:07.821236+0000","last_active":"2024-09-14T11:23:07.821294+0000","last_peered":"2024-09-14T11:23:07.821294+0000","last_clean":"2024-09-14T11:23:07.821294+0000","last_became_active":"2024-09-14T10:45:45.711476+0000","last_became_peered":"2024-09-14T10:45:45.711476+0000","last_unstale":"2024-09-14T11:23:07.821294+0000","last_undegraded":"2024-09-14T11:23:07.821294+0000","last_fullsized":"2024-09-14T11:23:07.821294+0000","mapping_epoch":26,"log_start":"260'1100","ondisk_log_start":"260'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1125","last_scrub_stamp":"2024-09-14T11:23:07.821153+0000","last_deep_scrub":"260'1125","last_deep_scrub_stamp":"2024-09-14T11:23:07.821153+0000","last_clean_scrub_stamp":"2024-09-14T11:23:07.821153+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":1100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:28.830288+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5159,"num_read_kb":4588,"num_write":1521,"num_write_kb":611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"260'327","reported_seq":1011,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:59.994822+0000","last_change":"2024-09-14T11:22:59.994756+0000","last_active":"2024-09-14T11:22:59.994822+0000","last_peered":"2024-09-14T11:22:59.994822+0000","last_clean":"2024-09-14T11:22:59.994822+0000","last_became_active":"2024-09-14T10:45:43.691976+0000","last_became_peered":"2024-09-14T10:45:43.691976+0000","last_unstale":"2024-09-14T11:22:59.994822+0000","last_undegraded":"2024-09-14T11:22:59.994822+0000","last_fullsized":"2024-09-14T11:22:59.994822+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'327","last_scrub_stamp":"2024-09-14T11:22:59.994673+0000","last_deep_scrub":"260'327","last_deep_scrub_stamp":"2024-09-14T11:22:59.994673+0000","last_clean_scrub_stamp":"2024-09-14T11:22:59.994673+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:18.919121+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":740,"num_read_kb":9027,"num_write":1110,"num_write_kb":58772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":492,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:19.749532+0000","last_change":"2024-09-14T11:23:19.749476+0000","last_active":"2024-09-14T11:23:19.749532+0000","last_peered":"2024-09-14T11:23:19.749532+0000","last_clean":"2024-09-14T11:23:19.749532+0000","last_became_active":"2024-09-14T10:45:47.726392+0000","last_became_peered":"2024-09-14T10:45:47.726392+0000","last_unstale":"2024-09-14T11:23:19.749532+0000","last_undegraded":"2024-09-14T11:23:19.749532+0000","last_fullsized":"2024-09-14T11:23:19.749532+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:19.749384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:19.749384+0000","last_clean_scrub_stamp":"2024-09-14T11:23:19.749384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:44:44.489992+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"260'86","reported_seq":591,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:33.242113+0000","last_change":"2024-09-14T11:23:33.242113+0000","last_active":"2024-09-14T11:23:33.242113+0000","last_peered":"2024-09-14T11:23:33.242113+0000","last_clean":"2024-09-14T11:23:33.242113+0000","last_became_active":"2024-09-14T10:45:49.728444+0000","last_became_peered":"2024-09-14T10:45:49.728444+0000","last_unstale":"2024-09-14T11:23:33.242113+0000","last_undegraded":"2024-09-14T11:23:33.242113+0000","last_fullsized":"2024-09-14T11:23:33.242113+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'86","last_scrub_stamp":"2024-09-14T11:23:33.241982+0000","last_deep_scrub":"260'86","last_deep_scrub_stamp":"2024-09-14T11:23:33.241982+0000","last_clean_scrub_stamp":"2024-09-14T11:23:33.241982+0000","objects_scrubbed":7,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:30.428016+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":102,"num_read_kb":95,"num_write":120,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"260'795","reported_seq":2274,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:17.627562+0000","last_change":"2024-09-14T11:23:17.627509+0000","last_active":"2024-09-14T11:23:17.627562+0000","last_peered":"2024-09-14T11:23:17.627562+0000","last_clean":"2024-09-14T11:23:17.627562+0000","last_became_active":"2024-09-14T10:45:51.746303+0000","last_became_peered":"2024-09-14T10:45:51.746303+0000","last_unstale":"2024-09-14T11:23:17.627562+0000","last_undegraded":"2024-09-14T11:23:17.627562+0000","last_fullsized":"2024-09-14T11:23:17.627562+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'795","last_scrub_stamp":"2024-09-14T11:23:17.627416+0000","last_deep_scrub":"260'795","last_deep_scrub_stamp":"2024-09-14T11:23:17.627416+0000","last_clean_scrub_stamp":"2024-09-14T11:23:17.627416+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:25.589494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"260'118","reported_seq":595,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:15.432755+0000","last_change":"2024-09-14T10:45:53.751786+0000","last_active":"2024-09-14T11:21:15.432755+0000","last_peered":"2024-09-14T11:21:15.432755+0000","last_clean":"2024-09-14T11:21:15.432755+0000","last_became_active":"2024-09-14T10:45:53.751453+0000","last_became_peered":"2024-09-14T10:45:53.751453+0000","last_unstale":"2024-09-14T11:21:15.432755+0000","last_undegraded":"2024-09-14T11:21:15.432755+0000","last_fullsized":"2024-09-14T11:21:15.432755+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":104,"num_write":274,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"260'446","reported_seq":2023,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:16.481462+0000","last_change":"2024-09-14T11:23:16.481462+0000","last_active":"2024-09-14T11:23:16.481462+0000","last_peered":"2024-09-14T11:23:16.481462+0000","last_clean":"2024-09-14T11:23:16.481462+0000","last_became_active":"2024-09-14T10:45:45.725806+0000","last_became_peered":"2024-09-14T10:45:45.725806+0000","last_unstale":"2024-09-14T11:23:16.481462+0000","last_undegraded":"2024-09-14T11:23:16.481462+0000","last_fullsized":"2024-09-14T11:23:16.481462+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'446","last_scrub_stamp":"2024-09-14T11:23:16.481367+0000","last_deep_scrub":"260'446","last_deep_scrub_stamp":"2024-09-14T11:23:16.481367+0000","last_clean_scrub_stamp":"2024-09-14T11:23:16.481367+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:41.381657+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2489,"num_read_kb":2350,"num_write":523,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2807,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"260'377","reported_seq":1047,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:58.683943+0000","last_change":"2024-09-14T11:22:58.683861+0000","last_active":"2024-09-14T11:22:58.683943+0000","last_peered":"2024-09-14T11:22:58.683943+0000","last_clean":"2024-09-14T11:22:58.683943+0000","last_became_active":"2024-09-14T10:45:43.686768+0000","last_became_peered":"2024-09-14T10:45:43.686768+0000","last_unstale":"2024-09-14T11:22:58.683943+0000","last_undegraded":"2024-09-14T11:22:58.683943+0000","last_fullsized":"2024-09-14T11:22:58.683943+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'377","last_scrub_stamp":"2024-09-14T11:22:58.683760+0000","last_deep_scrub":"260'377","last_deep_scrub_stamp":"2024-09-14T11:22:58.683760+0000","last_clean_scrub_stamp":"2024-09-14T11:22:58.683760+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:01:12.820519+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":721,"num_read_kb":58950,"num_write":1313,"num_write_kb":32402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":492,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:13.574287+0000","last_change":"2024-09-14T11:23:13.574206+0000","last_active":"2024-09-14T11:23:13.574287+0000","last_peered":"2024-09-14T11:23:13.574287+0000","last_clean":"2024-09-14T11:23:13.574287+0000","last_became_active":"2024-09-14T10:45:47.718721+0000","last_became_peered":"2024-09-14T10:45:47.718721+0000","last_unstale":"2024-09-14T11:23:13.574287+0000","last_undegraded":"2024-09-14T11:23:13.574287+0000","last_fullsized":"2024-09-14T11:23:13.574287+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:13.574095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:13.574095+0000","last_clean_scrub_stamp":"2024-09-14T11:23:13.574095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:02.935904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"260'301","reported_seq":875,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:16.621324+0000","last_change":"2024-09-14T11:23:16.621324+0000","last_active":"2024-09-14T11:23:16.621324+0000","last_peered":"2024-09-14T11:23:16.621324+0000","last_clean":"2024-09-14T11:23:16.621324+0000","last_became_active":"2024-09-14T10:45:49.733684+0000","last_became_peered":"2024-09-14T10:45:49.733684+0000","last_unstale":"2024-09-14T11:23:16.621324+0000","last_undegraded":"2024-09-14T11:23:16.621324+0000","last_fullsized":"2024-09-14T11:23:16.621324+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'301","last_scrub_stamp":"2024-09-14T11:23:16.621219+0000","last_deep_scrub":"260'301","last_deep_scrub_stamp":"2024-09-14T11:23:16.621219+0000","last_clean_scrub_stamp":"2024-09-14T11:23:16.621219+0000","objects_scrubbed":9,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:25.617980+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49376,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":469,"num_read_kb":1024,"num_write":384,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:29.682829+0000","last_change":"2024-09-14T11:23:29.682829+0000","last_active":"2024-09-14T11:23:29.682829+0000","last_peered":"2024-09-14T11:23:29.682829+0000","last_clean":"2024-09-14T11:23:29.682829+0000","last_became_active":"2024-09-14T10:45:51.741767+0000","last_became_peered":"2024-09-14T10:45:51.741767+0000","last_unstale":"2024-09-14T11:23:29.682829+0000","last_undegraded":"2024-09-14T11:23:29.682829+0000","last_fullsized":"2024-09-14T11:23:29.682829+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:29.682725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:29.682725+0000","last_clean_scrub_stamp":"2024-09-14T11:23:29.682725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:17:16.361535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"260'130","reported_seq":630,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:23.555796+0000","last_change":"2024-09-14T11:23:23.555796+0000","last_active":"2024-09-14T11:23:23.555796+0000","last_peered":"2024-09-14T11:23:23.555796+0000","last_clean":"2024-09-14T11:23:23.555796+0000","last_became_active":"2024-09-14T10:45:53.748760+0000","last_became_peered":"2024-09-14T10:45:53.748760+0000","last_unstale":"2024-09-14T11:23:23.555796+0000","last_undegraded":"2024-09-14T11:23:23.555796+0000","last_fullsized":"2024-09-14T11:23:23.555796+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'130","last_scrub_stamp":"2024-09-14T11:23:23.555688+0000","last_deep_scrub":"260'130","last_deep_scrub_stamp":"2024-09-14T11:23:23.555688+0000","last_clean_scrub_stamp":"2024-09-14T11:23:23.555688+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:48.933012+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":155,"num_read_kb":143,"num_write":309,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"260'789","reported_seq":2308,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:05.246738+0000","last_change":"2024-09-14T11:23:05.246681+0000","last_active":"2024-09-14T11:23:05.246738+0000","last_peered":"2024-09-14T11:23:05.246738+0000","last_clean":"2024-09-14T11:23:05.246738+0000","last_became_active":"2024-09-14T10:45:45.717706+0000","last_became_peered":"2024-09-14T10:45:45.717706+0000","last_unstale":"2024-09-14T11:23:05.246738+0000","last_undegraded":"2024-09-14T11:23:05.246738+0000","last_fullsized":"2024-09-14T11:23:05.246738+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'789","last_scrub_stamp":"2024-09-14T11:23:05.246600+0000","last_deep_scrub":"260'789","last_deep_scrub_stamp":"2024-09-14T11:23:05.246600+0000","last_clean_scrub_stamp":"2024-09-14T11:23:05.246600+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:29.764214+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3708,"num_read_kb":3358,"num_write":1019,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"260'345","reported_seq":960,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:07.145079+0000","last_change":"2024-09-14T11:23:07.145011+0000","last_active":"2024-09-14T11:23:07.145079+0000","last_peered":"2024-09-14T11:23:07.145079+0000","last_clean":"2024-09-14T11:23:07.145079+0000","last_became_active":"2024-09-14T10:45:43.683014+0000","last_became_peered":"2024-09-14T10:45:43.683014+0000","last_unstale":"2024-09-14T11:23:07.145079+0000","last_undegraded":"2024-09-14T11:23:07.145079+0000","last_fullsized":"2024-09-14T11:23:07.145079+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'345","last_scrub_stamp":"2024-09-14T11:23:07.144903+0000","last_deep_scrub":"260'345","last_deep_scrub_stamp":"2024-09-14T11:23:07.144903+0000","last_clean_scrub_stamp":"2024-09-14T11:23:07.144903+0000","objects_scrubbed":4,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:22.680885+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133668,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":545,"num_read_kb":15772,"num_write":997,"num_write_kb":32563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":483,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:21.471921+0000","last_change":"2024-09-14T11:23:21.471921+0000","last_active":"2024-09-14T11:23:21.471921+0000","last_peered":"2024-09-14T11:23:21.471921+0000","last_clean":"2024-09-14T11:23:21.471921+0000","last_became_active":"2024-09-14T10:45:47.725850+0000","last_became_peered":"2024-09-14T10:45:47.725850+0000","last_unstale":"2024-09-14T11:23:21.471921+0000","last_undegraded":"2024-09-14T11:23:21.471921+0000","last_fullsized":"2024-09-14T11:23:21.471921+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:21.471821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:21.471821+0000","last_clean_scrub_stamp":"2024-09-14T11:23:21.471821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:22.616539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"260'262","reported_seq":823,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:26.705256+0000","last_change":"2024-09-14T11:23:26.705256+0000","last_active":"2024-09-14T11:23:26.705256+0000","last_peered":"2024-09-14T11:23:26.705256+0000","last_clean":"2024-09-14T11:23:26.705256+0000","last_became_active":"2024-09-14T10:45:49.736538+0000","last_became_peered":"2024-09-14T10:45:49.736538+0000","last_unstale":"2024-09-14T11:23:26.705256+0000","last_undegraded":"2024-09-14T11:23:26.705256+0000","last_fullsized":"2024-09-14T11:23:26.705256+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'262","last_scrub_stamp":"2024-09-14T11:23:26.705160+0000","last_deep_scrub":"260'262","last_deep_scrub_stamp":"2024-09-14T11:23:26.705160+0000","last_clean_scrub_stamp":"2024-09-14T11:23:26.705160+0000","objects_scrubbed":4,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:32.407412+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45998,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":425,"num_read_kb":1014,"num_write":348,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:36.262292+0000","last_change":"2024-09-14T11:23:36.262292+0000","last_active":"2024-09-14T11:23:36.262292+0000","last_peered":"2024-09-14T11:23:36.262292+0000","last_clean":"2024-09-14T11:23:36.262292+0000","last_became_active":"2024-09-14T10:45:51.744957+0000","last_became_peered":"2024-09-14T10:45:51.744957+0000","last_unstale":"2024-09-14T11:23:36.262292+0000","last_undegraded":"2024-09-14T11:23:36.262292+0000","last_fullsized":"2024-09-14T11:23:36.262292+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:36.262199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:36.262199+0000","last_clean_scrub_stamp":"2024-09-14T11:23:36.262199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:17.442538+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"260'127","reported_seq":635,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:34.523851+0000","last_change":"2024-09-14T11:23:34.523851+0000","last_active":"2024-09-14T11:23:34.523851+0000","last_peered":"2024-09-14T11:23:34.523851+0000","last_clean":"2024-09-14T11:23:34.523851+0000","last_became_active":"2024-09-14T10:45:53.750287+0000","last_became_peered":"2024-09-14T10:45:53.750287+0000","last_unstale":"2024-09-14T11:23:34.523851+0000","last_undegraded":"2024-09-14T11:23:34.523851+0000","last_fullsized":"2024-09-14T11:23:34.523851+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'127","last_scrub_stamp":"2024-09-14T11:23:34.523747+0000","last_deep_scrub":"260'127","last_deep_scrub_stamp":"2024-09-14T11:23:34.523747+0000","last_clean_scrub_stamp":"2024-09-14T11:23:34.523747+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:44.520637+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":175,"num_read_kb":170,"num_write":297,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"260'392","reported_seq":1851,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:04.722892+0000","last_change":"2024-09-14T11:23:04.722892+0000","last_active":"2024-09-14T11:23:04.722892+0000","last_peered":"2024-09-14T11:23:04.722892+0000","last_clean":"2024-09-14T11:23:04.722892+0000","last_became_active":"2024-09-14T10:45:45.712455+0000","last_became_peered":"2024-09-14T10:45:45.712455+0000","last_unstale":"2024-09-14T11:23:04.722892+0000","last_undegraded":"2024-09-14T11:23:04.722892+0000","last_fullsized":"2024-09-14T11:23:04.722892+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'392","last_scrub_stamp":"2024-09-14T11:23:04.722800+0000","last_deep_scrub":"260'392","last_deep_scrub_stamp":"2024-09-14T11:23:04.722800+0000","last_clean_scrub_stamp":"2024-09-14T11:23:04.722800+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:20.257987+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2172,"num_read_kb":2052,"num_write":470,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"260'356","reported_seq":1011,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:00.292166+0000","last_change":"2024-09-14T11:23:00.292166+0000","last_active":"2024-09-14T11:23:00.292166+0000","last_peered":"2024-09-14T11:23:00.292166+0000","last_clean":"2024-09-14T11:23:00.292166+0000","last_became_active":"2024-09-14T10:45:43.676145+0000","last_became_peered":"2024-09-14T10:45:43.676145+0000","last_unstale":"2024-09-14T11:23:00.292166+0000","last_undegraded":"2024-09-14T11:23:00.292166+0000","last_fullsized":"2024-09-14T11:23:00.292166+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'356","last_scrub_stamp":"2024-09-14T11:23:00.292074+0000","last_deep_scrub":"260'356","last_deep_scrub_stamp":"2024-09-14T11:23:00.292074+0000","last_clean_scrub_stamp":"2024-09-14T11:23:00.292074+0000","objects_scrubbed":5,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:47.860832+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133740,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":675,"num_read_kb":38975,"num_write":1181,"num_write_kb":36099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":492,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:11.644849+0000","last_change":"2024-09-14T11:23:11.644849+0000","last_active":"2024-09-14T11:23:11.644849+0000","last_peered":"2024-09-14T11:23:11.644849+0000","last_clean":"2024-09-14T11:23:11.644849+0000","last_became_active":"2024-09-14T10:45:47.724065+0000","last_became_peered":"2024-09-14T10:45:47.724065+0000","last_unstale":"2024-09-14T11:23:11.644849+0000","last_undegraded":"2024-09-14T11:23:11.644849+0000","last_fullsized":"2024-09-14T11:23:11.644849+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:11.644749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:11.644749+0000","last_clean_scrub_stamp":"2024-09-14T11:23:11.644749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:54.396791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"260'240","reported_seq":787,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:16.224647+0000","last_change":"2024-09-14T11:23:16.224587+0000","last_active":"2024-09-14T11:23:16.224647+0000","last_peered":"2024-09-14T11:23:16.224647+0000","last_clean":"2024-09-14T11:23:16.224647+0000","last_became_active":"2024-09-14T10:45:49.727721+0000","last_became_peered":"2024-09-14T10:45:49.727721+0000","last_unstale":"2024-09-14T11:23:16.224647+0000","last_undegraded":"2024-09-14T11:23:16.224647+0000","last_fullsized":"2024-09-14T11:23:16.224647+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'240","last_scrub_stamp":"2024-09-14T11:23:16.224504+0000","last_deep_scrub":"260'240","last_deep_scrub_stamp":"2024-09-14T11:23:16.224504+0000","last_clean_scrub_stamp":"2024-09-14T11:23:16.224504+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:07.387698+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47218,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":415,"num_read_kb":1017,"num_write":344,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":470,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:52.124432+0000","last_change":"2024-09-14T10:45:51.742675+0000","last_active":"2024-09-14T11:20:52.124432+0000","last_peered":"2024-09-14T11:20:52.124432+0000","last_clean":"2024-09-14T11:20:52.124432+0000","last_became_active":"2024-09-14T10:45:51.742387+0000","last_became_peered":"2024-09-14T10:45:51.742387+0000","last_unstale":"2024-09-14T11:20:52.124432+0000","last_undegraded":"2024-09-14T11:20:52.124432+0000","last_fullsized":"2024-09-14T11:20:52.124432+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:50.727439+0000","last_clean_scrub_stamp":"2024-09-14T10:45:50.727439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"260'160","reported_seq":1255,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:21:27.232516+0000","last_change":"2024-09-14T10:45:53.752874+0000","last_active":"2024-09-14T11:21:27.232516+0000","last_peered":"2024-09-14T11:21:27.232516+0000","last_clean":"2024-09-14T11:21:27.232516+0000","last_became_active":"2024-09-14T10:45:53.752639+0000","last_became_peered":"2024-09-14T10:45:53.752639+0000","last_unstale":"2024-09-14T11:21:27.232516+0000","last_undegraded":"2024-09-14T11:21:27.232516+0000","last_fullsized":"2024-09-14T11:21:27.232516+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:45:52.731646+0000","last_clean_scrub_stamp":"2024-09-14T10:45:52.731646+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:29.390299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":838,"num_read_kb":820,"num_write":382,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"260'400","reported_seq":1914,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:04.247771+0000","last_change":"2024-09-14T11:23:04.247771+0000","last_active":"2024-09-14T11:23:04.247771+0000","last_peered":"2024-09-14T11:23:04.247771+0000","last_clean":"2024-09-14T11:23:04.247771+0000","last_became_active":"2024-09-14T10:45:45.718964+0000","last_became_peered":"2024-09-14T10:45:45.718964+0000","last_unstale":"2024-09-14T11:23:04.247771+0000","last_undegraded":"2024-09-14T11:23:04.247771+0000","last_fullsized":"2024-09-14T11:23:04.247771+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'400","last_scrub_stamp":"2024-09-14T11:23:04.247668+0000","last_deep_scrub":"260'400","last_deep_scrub_stamp":"2024-09-14T11:23:04.247668+0000","last_clean_scrub_stamp":"2024-09-14T11:23:04.247668+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:22:55.596354+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2133,"num_read_kb":2043,"num_write":433,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"260'369","reported_seq":1016,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:04.280661+0000","last_change":"2024-09-14T11:23:04.280580+0000","last_active":"2024-09-14T11:23:04.280661+0000","last_peered":"2024-09-14T11:23:04.280661+0000","last_clean":"2024-09-14T11:23:04.280661+0000","last_became_active":"2024-09-14T10:45:43.675220+0000","last_became_peered":"2024-09-14T10:45:43.675220+0000","last_unstale":"2024-09-14T11:23:04.280661+0000","last_undegraded":"2024-09-14T11:23:04.280661+0000","last_fullsized":"2024-09-14T11:23:04.280661+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'369","last_scrub_stamp":"2024-09-14T11:23:04.280462+0000","last_deep_scrub":"260'369","last_deep_scrub_stamp":"2024-09-14T11:23:04.280462+0000","last_clean_scrub_stamp":"2024-09-14T11:23:04.280462+0000","objects_scrubbed":3,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:23:45.038803+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":607,"num_read_kb":38424,"num_write":1090,"num_write_kb":41594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"260'2","reported_seq":494,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:18.777321+0000","last_change":"2024-09-14T11:23:18.777321+0000","last_active":"2024-09-14T11:23:18.777321+0000","last_peered":"2024-09-14T11:23:18.777321+0000","last_clean":"2024-09-14T11:23:18.777321+0000","last_became_active":"2024-09-14T10:45:47.729338+0000","last_became_peered":"2024-09-14T10:45:47.729338+0000","last_unstale":"2024-09-14T11:23:18.777321+0000","last_undegraded":"2024-09-14T11:23:18.777321+0000","last_fullsized":"2024-09-14T11:23:18.777321+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:23:18.777242+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:23:18.777242+0000","last_clean_scrub_stamp":"2024-09-14T11:23:18.777242+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:28.099114+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"260'295","reported_seq":866,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:31.242864+0000","last_change":"2024-09-14T11:23:31.242864+0000","last_active":"2024-09-14T11:23:31.242864+0000","last_peered":"2024-09-14T11:23:31.242864+0000","last_clean":"2024-09-14T11:23:31.242864+0000","last_became_active":"2024-09-14T10:45:49.729842+0000","last_became_peered":"2024-09-14T10:45:49.729842+0000","last_unstale":"2024-09-14T11:23:31.242864+0000","last_undegraded":"2024-09-14T11:23:31.242864+0000","last_fullsized":"2024-09-14T11:23:31.242864+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'295","last_scrub_stamp":"2024-09-14T11:23:31.242769+0000","last_deep_scrub":"260'295","last_deep_scrub_stamp":"2024-09-14T11:23:31.242769+0000","last_clean_scrub_stamp":"2024-09-14T11:23:31.242769+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:47:02.860388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44662,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":478,"num_read_kb":1058,"num_write":386,"num_write_kb":290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:30.659654+0000","last_change":"2024-09-14T11:23:30.659654+0000","last_active":"2024-09-14T11:23:30.659654+0000","last_peered":"2024-09-14T11:23:30.659654+0000","last_clean":"2024-09-14T11:23:30.659654+0000","last_became_active":"2024-09-14T10:45:51.745310+0000","last_became_peered":"2024-09-14T10:45:51.745310+0000","last_unstale":"2024-09-14T11:23:30.659654+0000","last_undegraded":"2024-09-14T11:23:30.659654+0000","last_fullsized":"2024-09-14T11:23:30.659654+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:30.659557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:30.659557+0000","last_clean_scrub_stamp":"2024-09-14T11:23:30.659557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:47.082535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"260'142","reported_seq":630,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:18.626544+0000","last_change":"2024-09-14T11:23:18.626544+0000","last_active":"2024-09-14T11:23:18.626544+0000","last_peered":"2024-09-14T11:23:18.626544+0000","last_clean":"2024-09-14T11:23:18.626544+0000","last_became_active":"2024-09-14T10:45:53.754826+0000","last_became_peered":"2024-09-14T10:45:53.754826+0000","last_unstale":"2024-09-14T11:23:18.626544+0000","last_undegraded":"2024-09-14T11:23:18.626544+0000","last_fullsized":"2024-09-14T11:23:18.626544+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'142","last_scrub_stamp":"2024-09-14T11:23:18.626459+0000","last_deep_scrub":"260'142","last_deep_scrub_stamp":"2024-09-14T11:23:18.626459+0000","last_clean_scrub_stamp":"2024-09-14T11:23:18.626459+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:19:11.355018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":657,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":128,"num_read_kb":116,"num_write":335,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"260'422","reported_seq":1973,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:10.812912+0000","last_change":"2024-09-14T11:23:10.812912+0000","last_active":"2024-09-14T11:23:10.812912+0000","last_peered":"2024-09-14T11:23:10.812912+0000","last_clean":"2024-09-14T11:23:10.812912+0000","last_became_active":"2024-09-14T10:45:45.708229+0000","last_became_peered":"2024-09-14T10:45:45.708229+0000","last_unstale":"2024-09-14T11:23:10.812912+0000","last_undegraded":"2024-09-14T11:23:10.812912+0000","last_fullsized":"2024-09-14T11:23:10.812912+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'422","last_scrub_stamp":"2024-09-14T11:23:10.812799+0000","last_deep_scrub":"260'422","last_deep_scrub_stamp":"2024-09-14T11:23:10.812799+0000","last_clean_scrub_stamp":"2024-09-14T11:23:10.812799+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:04:48.614638+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2330,"num_read_kb":2210,"num_write":517,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"260'373","reported_seq":1029,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:58.207593+0000","last_change":"2024-09-14T11:22:58.207534+0000","last_active":"2024-09-14T11:22:58.207593+0000","last_peered":"2024-09-14T11:22:58.207593+0000","last_clean":"2024-09-14T11:22:58.207593+0000","last_became_active":"2024-09-14T10:45:43.684102+0000","last_became_peered":"2024-09-14T10:45:43.684102+0000","last_unstale":"2024-09-14T11:22:58.207593+0000","last_undegraded":"2024-09-14T11:22:58.207593+0000","last_fullsized":"2024-09-14T11:22:58.207593+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'373","last_scrub_stamp":"2024-09-14T11:22:58.207463+0000","last_deep_scrub":"260'373","last_deep_scrub_stamp":"2024-09-14T11:22:58.207463+0000","last_clean_scrub_stamp":"2024-09-14T11:22:58.207463+0000","objects_scrubbed":6,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:30.442090+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133709,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":619,"num_read_kb":82373,"num_write":1076,"num_write_kb":43712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"260'385","reported_seq":1952,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:09.667862+0000","last_change":"2024-09-14T11:23:09.667862+0000","last_active":"2024-09-14T11:23:09.667862+0000","last_peered":"2024-09-14T11:23:09.667862+0000","last_clean":"2024-09-14T11:23:09.667862+0000","last_became_active":"2024-09-14T10:45:45.718949+0000","last_became_peered":"2024-09-14T10:45:45.718949+0000","last_unstale":"2024-09-14T11:23:09.667862+0000","last_undegraded":"2024-09-14T11:23:09.667862+0000","last_fullsized":"2024-09-14T11:23:09.667862+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'385","last_scrub_stamp":"2024-09-14T11:23:09.667768+0000","last_deep_scrub":"260'385","last_deep_scrub_stamp":"2024-09-14T11:23:09.667768+0000","last_clean_scrub_stamp":"2024-09-14T11:23:09.667768+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:07:20.882638+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2227,"num_read_kb":2135,"num_write":439,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"260'312","reported_seq":933,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:00.766046+0000","last_change":"2024-09-14T11:23:00.765987+0000","last_active":"2024-09-14T11:23:00.766046+0000","last_peered":"2024-09-14T11:23:00.766046+0000","last_clean":"2024-09-14T11:23:00.766046+0000","last_became_active":"2024-09-14T10:45:43.690675+0000","last_became_peered":"2024-09-14T10:45:43.690675+0000","last_unstale":"2024-09-14T11:23:00.766046+0000","last_undegraded":"2024-09-14T11:23:00.766046+0000","last_fullsized":"2024-09-14T11:23:00.766046+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'312","last_scrub_stamp":"2024-09-14T11:23:00.765887+0000","last_deep_scrub":"260'312","last_deep_scrub_stamp":"2024-09-14T11:23:00.765887+0000","last_clean_scrub_stamp":"2024-09-14T11:23:00.765887+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:38:08.181333+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":527,"num_read_kb":9887,"num_write":1028,"num_write_kb":21015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"260'535","reported_seq":2252,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:17.205485+0000","last_change":"2024-09-14T11:23:17.205485+0000","last_active":"2024-09-14T11:23:17.205485+0000","last_peered":"2024-09-14T11:23:17.205485+0000","last_clean":"2024-09-14T11:23:17.205485+0000","last_became_active":"2024-09-14T10:45:45.717393+0000","last_became_peered":"2024-09-14T10:45:45.717393+0000","last_unstale":"2024-09-14T11:23:17.205485+0000","last_undegraded":"2024-09-14T11:23:17.205485+0000","last_fullsized":"2024-09-14T11:23:17.205485+0000","mapping_epoch":26,"log_start":"260'500","ondisk_log_start":"260'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'535","last_scrub_stamp":"2024-09-14T11:23:17.205379+0000","last_deep_scrub":"260'535","last_deep_scrub_stamp":"2024-09-14T11:23:17.205379+0000","last_clean_scrub_stamp":"2024-09-14T11:23:17.205379+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:56.826924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2830,"num_read_kb":2663,"num_write":635,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"260'389","reported_seq":1039,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:08.148332+0000","last_change":"2024-09-14T11:23:08.148260+0000","last_active":"2024-09-14T11:23:08.148332+0000","last_peered":"2024-09-14T11:23:08.148332+0000","last_clean":"2024-09-14T11:23:08.148332+0000","last_became_active":"2024-09-14T10:45:43.675216+0000","last_became_peered":"2024-09-14T10:45:43.675216+0000","last_unstale":"2024-09-14T11:23:08.148332+0000","last_undegraded":"2024-09-14T11:23:08.148332+0000","last_fullsized":"2024-09-14T11:23:08.148332+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'389","last_scrub_stamp":"2024-09-14T11:23:08.148160+0000","last_deep_scrub":"260'389","last_deep_scrub_stamp":"2024-09-14T11:23:08.148160+0000","last_clean_scrub_stamp":"2024-09-14T11:23:08.148160+0000","objects_scrubbed":4,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:29.501402+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":708,"num_read_kb":14121,"num_write":1222,"num_write_kb":48801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"260'871","reported_seq":2519,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:15.342684+0000","last_change":"2024-09-14T11:23:15.342684+0000","last_active":"2024-09-14T11:23:15.342684+0000","last_peered":"2024-09-14T11:23:15.342684+0000","last_clean":"2024-09-14T11:23:15.342684+0000","last_became_active":"2024-09-14T10:45:45.720939+0000","last_became_peered":"2024-09-14T10:45:45.720939+0000","last_unstale":"2024-09-14T11:23:15.342684+0000","last_undegraded":"2024-09-14T11:23:15.342684+0000","last_fullsized":"2024-09-14T11:23:15.342684+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'871","last_scrub_stamp":"2024-09-14T11:23:15.342592+0000","last_deep_scrub":"260'871","last_deep_scrub_stamp":"2024-09-14T11:23:15.342592+0000","last_clean_scrub_stamp":"2024-09-14T11:23:15.342592+0000","objects_scrubbed":2,"log_size":71,"log_dups_size":800,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:19:11.489780+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4139,"num_read_kb":3737,"num_write":1132,"num_write_kb":407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"260'313","reported_seq":902,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:02.304298+0000","last_change":"2024-09-14T11:23:02.304213+0000","last_active":"2024-09-14T11:23:02.304298+0000","last_peered":"2024-09-14T11:23:02.304298+0000","last_clean":"2024-09-14T11:23:02.304298+0000","last_became_active":"2024-09-14T10:45:43.681864+0000","last_became_peered":"2024-09-14T10:45:43.681864+0000","last_unstale":"2024-09-14T11:23:02.304298+0000","last_undegraded":"2024-09-14T11:23:02.304298+0000","last_fullsized":"2024-09-14T11:23:02.304298+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'313","last_scrub_stamp":"2024-09-14T11:23:02.304103+0000","last_deep_scrub":"260'313","last_deep_scrub_stamp":"2024-09-14T11:23:02.304103+0000","last_clean_scrub_stamp":"2024-09-14T11:23:02.304103+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:15.927678+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":459,"num_read_kb":5481,"num_write":964,"num_write_kb":23381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"260'449","reported_seq":2105,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:14.315404+0000","last_change":"2024-09-14T11:23:14.315348+0000","last_active":"2024-09-14T11:23:14.315404+0000","last_peered":"2024-09-14T11:23:14.315404+0000","last_clean":"2024-09-14T11:23:14.315404+0000","last_became_active":"2024-09-14T10:45:45.722575+0000","last_became_peered":"2024-09-14T10:45:45.722575+0000","last_unstale":"2024-09-14T11:23:14.315404+0000","last_undegraded":"2024-09-14T11:23:14.315404+0000","last_fullsized":"2024-09-14T11:23:14.315404+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'449","last_scrub_stamp":"2024-09-14T11:23:14.315255+0000","last_deep_scrub":"260'449","last_deep_scrub_stamp":"2024-09-14T11:23:14.315255+0000","last_clean_scrub_stamp":"2024-09-14T11:23:14.315255+0000","objects_scrubbed":2,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:15:08.436381+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2593,"num_read_kb":2475,"num_write":496,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"260'361","reported_seq":1003,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:04.433029+0000","last_change":"2024-09-14T11:23:04.433029+0000","last_active":"2024-09-14T11:23:04.433029+0000","last_peered":"2024-09-14T11:23:04.433029+0000","last_clean":"2024-09-14T11:23:04.433029+0000","last_became_active":"2024-09-14T10:45:43.691101+0000","last_became_peered":"2024-09-14T10:45:43.691101+0000","last_unstale":"2024-09-14T11:23:04.433029+0000","last_undegraded":"2024-09-14T11:23:04.433029+0000","last_fullsized":"2024-09-14T11:23:04.433029+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'361","last_scrub_stamp":"2024-09-14T11:23:04.432933+0000","last_deep_scrub":"260'361","last_deep_scrub_stamp":"2024-09-14T11:23:04.432933+0000","last_clean_scrub_stamp":"2024-09-14T11:23:04.432933+0000","objects_scrubbed":2,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:27.282075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":637,"num_read_kb":20829,"num_write":1146,"num_write_kb":28609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"260'965","reported_seq":2559,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:05.592937+0000","last_change":"2024-09-14T11:23:05.592864+0000","last_active":"2024-09-14T11:23:05.592937+0000","last_peered":"2024-09-14T11:23:05.592937+0000","last_clean":"2024-09-14T11:23:05.592937+0000","last_became_active":"2024-09-14T10:45:45.717482+0000","last_became_peered":"2024-09-14T10:45:45.717482+0000","last_unstale":"2024-09-14T11:23:05.592937+0000","last_undegraded":"2024-09-14T11:23:05.592937+0000","last_fullsized":"2024-09-14T11:23:05.592937+0000","mapping_epoch":26,"log_start":"260'900","ondisk_log_start":"260'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'965","last_scrub_stamp":"2024-09-14T11:23:05.592780+0000","last_deep_scrub":"260'965","last_deep_scrub_stamp":"2024-09-14T11:23:05.592780+0000","last_clean_scrub_stamp":"2024-09-14T11:23:05.592780+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":900,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:58.949827+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4656,"num_read_kb":4162,"num_write":1345,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"260'420","reported_seq":1067,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:01.490274+0000","last_change":"2024-09-14T11:23:01.490274+0000","last_active":"2024-09-14T11:23:01.490274+0000","last_peered":"2024-09-14T11:23:01.490274+0000","last_clean":"2024-09-14T11:23:01.490274+0000","last_became_active":"2024-09-14T10:45:43.681769+0000","last_became_peered":"2024-09-14T10:45:43.681769+0000","last_unstale":"2024-09-14T11:23:01.490274+0000","last_undegraded":"2024-09-14T11:23:01.490274+0000","last_fullsized":"2024-09-14T11:23:01.490274+0000","mapping_epoch":23,"log_start":"260'400","ondisk_log_start":"260'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'420","last_scrub_stamp":"2024-09-14T11:23:01.490176+0000","last_deep_scrub":"260'420","last_deep_scrub_stamp":"2024-09-14T11:23:01.490176+0000","last_clean_scrub_stamp":"2024-09-14T11:23:01.490176+0000","objects_scrubbed":5,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:59.490356+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":884,"num_read_kb":850,"num_write":1209,"num_write_kb":26526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"260'499","reported_seq":2183,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:09.302098+0000","last_change":"2024-09-14T11:23:09.302039+0000","last_active":"2024-09-14T11:23:09.302098+0000","last_peered":"2024-09-14T11:23:09.302098+0000","last_clean":"2024-09-14T11:23:09.302098+0000","last_became_active":"2024-09-14T10:45:45.724491+0000","last_became_peered":"2024-09-14T10:45:45.724491+0000","last_unstale":"2024-09-14T11:23:09.302098+0000","last_undegraded":"2024-09-14T11:23:09.302098+0000","last_fullsized":"2024-09-14T11:23:09.302098+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'499","last_scrub_stamp":"2024-09-14T11:23:09.301946+0000","last_deep_scrub":"260'499","last_deep_scrub_stamp":"2024-09-14T11:23:09.301946+0000","last_clean_scrub_stamp":"2024-09-14T11:23:09.301946+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:26.256389+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2800,"num_read_kb":2654,"num_write":635,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"260'363","reported_seq":988,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:00.219177+0000","last_change":"2024-09-14T11:23:00.219177+0000","last_active":"2024-09-14T11:23:00.219177+0000","last_peered":"2024-09-14T11:23:00.219177+0000","last_clean":"2024-09-14T11:23:00.219177+0000","last_became_active":"2024-09-14T10:45:43.672592+0000","last_became_peered":"2024-09-14T10:45:43.672592+0000","last_unstale":"2024-09-14T11:23:00.219177+0000","last_undegraded":"2024-09-14T11:23:00.219177+0000","last_fullsized":"2024-09-14T11:23:00.219177+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'363","last_scrub_stamp":"2024-09-14T11:23:00.219087+0000","last_deep_scrub":"260'363","last_deep_scrub_stamp":"2024-09-14T11:23:00.219087+0000","last_clean_scrub_stamp":"2024-09-14T11:23:00.219087+0000","objects_scrubbed":4,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:53.826069+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133682,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":581,"num_read_kb":14710,"num_write":1041,"num_write_kb":26884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"260'948","reported_seq":2556,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:02.605749+0000","last_change":"2024-09-14T11:23:02.605687+0000","last_active":"2024-09-14T11:23:02.605749+0000","last_peered":"2024-09-14T11:23:02.605749+0000","last_clean":"2024-09-14T11:23:02.605749+0000","last_became_active":"2024-09-14T10:45:45.712642+0000","last_became_peered":"2024-09-14T10:45:45.712642+0000","last_unstale":"2024-09-14T11:23:02.605749+0000","last_undegraded":"2024-09-14T11:23:02.605749+0000","last_fullsized":"2024-09-14T11:23:02.605749+0000","mapping_epoch":26,"log_start":"260'900","ondisk_log_start":"260'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'948","last_scrub_stamp":"2024-09-14T11:23:02.605604+0000","last_deep_scrub":"260'948","last_deep_scrub_stamp":"2024-09-14T11:23:02.605604+0000","last_clean_scrub_stamp":"2024-09-14T11:23:02.605604+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":900,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:29.530400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4544,"num_read_kb":4033,"num_write":1311,"num_write_kb":524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"260'381","reported_seq":1030,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:03.258437+0000","last_change":"2024-09-14T11:23:03.258437+0000","last_active":"2024-09-14T11:23:03.258437+0000","last_peered":"2024-09-14T11:23:03.258437+0000","last_clean":"2024-09-14T11:23:03.258437+0000","last_became_active":"2024-09-14T10:45:43.675233+0000","last_became_peered":"2024-09-14T10:45:43.675233+0000","last_unstale":"2024-09-14T11:23:03.258437+0000","last_undegraded":"2024-09-14T11:23:03.258437+0000","last_fullsized":"2024-09-14T11:23:03.258437+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'381","last_scrub_stamp":"2024-09-14T11:23:03.258350+0000","last_deep_scrub":"260'381","last_deep_scrub_stamp":"2024-09-14T11:23:03.258350+0000","last_clean_scrub_stamp":"2024-09-14T11:23:03.258350+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:04:00.733089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":674,"num_read_kb":10456,"num_write":1272,"num_write_kb":38144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"260'844","reported_seq":2446,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:06.692537+0000","last_change":"2024-09-14T11:23:06.692537+0000","last_active":"2024-09-14T11:23:06.692537+0000","last_peered":"2024-09-14T11:23:06.692537+0000","last_clean":"2024-09-14T11:23:06.692537+0000","last_became_active":"2024-09-14T10:45:45.711947+0000","last_became_peered":"2024-09-14T10:45:45.711947+0000","last_unstale":"2024-09-14T11:23:06.692537+0000","last_undegraded":"2024-09-14T11:23:06.692537+0000","last_fullsized":"2024-09-14T11:23:06.692537+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'844","last_scrub_stamp":"2024-09-14T11:23:06.692450+0000","last_deep_scrub":"260'844","last_deep_scrub_stamp":"2024-09-14T11:23:06.692450+0000","last_clean_scrub_stamp":"2024-09-14T11:23:06.692450+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":800,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:48.375095+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4120,"num_read_kb":3716,"num_write":1158,"num_write_kb":467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"260'307","reported_seq":915,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:09.184657+0000","last_change":"2024-09-14T11:23:09.184657+0000","last_active":"2024-09-14T11:23:09.184657+0000","last_peered":"2024-09-14T11:23:09.184657+0000","last_clean":"2024-09-14T11:23:09.184657+0000","last_became_active":"2024-09-14T10:45:43.677597+0000","last_became_peered":"2024-09-14T10:45:43.677597+0000","last_unstale":"2024-09-14T11:23:09.184657+0000","last_undegraded":"2024-09-14T11:23:09.184657+0000","last_fullsized":"2024-09-14T11:23:09.184657+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'307","last_scrub_stamp":"2024-09-14T11:23:09.184538+0000","last_deep_scrub":"260'307","last_deep_scrub_stamp":"2024-09-14T11:23:09.184538+0000","last_clean_scrub_stamp":"2024-09-14T11:23:09.184538+0000","objects_scrubbed":3,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:11.668626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":480,"num_read_kb":1898,"num_write":986,"num_write_kb":19841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"260'857","reported_seq":2379,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:08.648180+0000","last_change":"2024-09-14T11:23:08.648180+0000","last_active":"2024-09-14T11:23:08.648180+0000","last_peered":"2024-09-14T11:23:08.648180+0000","last_clean":"2024-09-14T11:23:08.648180+0000","last_became_active":"2024-09-14T10:45:45.715268+0000","last_became_peered":"2024-09-14T10:45:45.715268+0000","last_unstale":"2024-09-14T11:23:08.648180+0000","last_undegraded":"2024-09-14T11:23:08.648180+0000","last_fullsized":"2024-09-14T11:23:08.648180+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'857","last_scrub_stamp":"2024-09-14T11:23:08.648098+0000","last_deep_scrub":"260'857","last_deep_scrub_stamp":"2024-09-14T11:23:08.648098+0000","last_clean_scrub_stamp":"2024-09-14T11:23:08.648098+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":800,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:21.218133+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4230,"num_read_kb":3798,"num_write":1192,"num_write_kb":502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"260'355","reported_seq":1011,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:05.289243+0000","last_change":"2024-09-14T11:23:05.289243+0000","last_active":"2024-09-14T11:23:05.289243+0000","last_peered":"2024-09-14T11:23:05.289243+0000","last_clean":"2024-09-14T11:23:05.289243+0000","last_became_active":"2024-09-14T10:45:43.681694+0000","last_became_peered":"2024-09-14T10:45:43.681694+0000","last_unstale":"2024-09-14T11:23:05.289243+0000","last_undegraded":"2024-09-14T11:23:05.289243+0000","last_fullsized":"2024-09-14T11:23:05.289243+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'355","last_scrub_stamp":"2024-09-14T11:23:05.289154+0000","last_deep_scrub":"260'355","last_deep_scrub_stamp":"2024-09-14T11:23:05.289154+0000","last_clean_scrub_stamp":"2024-09-14T11:23:05.289154+0000","objects_scrubbed":2,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:15:49.436744+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133679,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":711,"num_read_kb":32454,"num_write":1261,"num_write_kb":21071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"260'432","reported_seq":1893,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:16.353009+0000","last_change":"2024-09-14T11:23:16.353009+0000","last_active":"2024-09-14T11:23:16.353009+0000","last_peered":"2024-09-14T11:23:16.353009+0000","last_clean":"2024-09-14T11:23:16.353009+0000","last_became_active":"2024-09-14T10:45:45.723441+0000","last_became_peered":"2024-09-14T10:45:45.723441+0000","last_unstale":"2024-09-14T11:23:16.353009+0000","last_undegraded":"2024-09-14T11:23:16.353009+0000","last_fullsized":"2024-09-14T11:23:16.353009+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'432","last_scrub_stamp":"2024-09-14T11:23:16.352923+0000","last_deep_scrub":"260'432","last_deep_scrub_stamp":"2024-09-14T11:23:16.352923+0000","last_clean_scrub_stamp":"2024-09-14T11:23:16.352923+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:43.275404+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2262,"num_read_kb":2127,"num_write":517,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"260'356","reported_seq":1000,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:59.642417+0000","last_change":"2024-09-14T11:22:59.642417+0000","last_active":"2024-09-14T11:22:59.642417+0000","last_peered":"2024-09-14T11:22:59.642417+0000","last_clean":"2024-09-14T11:22:59.642417+0000","last_became_active":"2024-09-14T10:45:43.681441+0000","last_became_peered":"2024-09-14T10:45:43.681441+0000","last_unstale":"2024-09-14T11:22:59.642417+0000","last_undegraded":"2024-09-14T11:22:59.642417+0000","last_fullsized":"2024-09-14T11:22:59.642417+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'356","last_scrub_stamp":"2024-09-14T11:22:59.642325+0000","last_deep_scrub":"260'356","last_deep_scrub_stamp":"2024-09-14T11:22:59.642325+0000","last_clean_scrub_stamp":"2024-09-14T11:22:59.642325+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:41.518525+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244496,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":649,"num_read_kb":21101,"num_write":1092,"num_write_kb":38924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"260'751","reported_seq":2230,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:05.568333+0000","last_change":"2024-09-14T11:23:05.568333+0000","last_active":"2024-09-14T11:23:05.568333+0000","last_peered":"2024-09-14T11:23:05.568333+0000","last_clean":"2024-09-14T11:23:05.568333+0000","last_became_active":"2024-09-14T10:45:45.711402+0000","last_became_peered":"2024-09-14T10:45:45.711402+0000","last_unstale":"2024-09-14T11:23:05.568333+0000","last_undegraded":"2024-09-14T11:23:05.568333+0000","last_fullsized":"2024-09-14T11:23:05.568333+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'751","last_scrub_stamp":"2024-09-14T11:23:05.568226+0000","last_deep_scrub":"260'751","last_deep_scrub_stamp":"2024-09-14T11:23:05.568226+0000","last_clean_scrub_stamp":"2024-09-14T11:23:05.568226+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:00.144694+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3613,"num_read_kb":3262,"num_write":995,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"260'351","reported_seq":980,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:02.925737+0000","last_change":"2024-09-14T11:23:02.925737+0000","last_active":"2024-09-14T11:23:02.925737+0000","last_peered":"2024-09-14T11:23:02.925737+0000","last_clean":"2024-09-14T11:23:02.925737+0000","last_became_active":"2024-09-14T10:45:43.690104+0000","last_became_peered":"2024-09-14T10:45:43.690104+0000","last_unstale":"2024-09-14T11:23:02.925737+0000","last_undegraded":"2024-09-14T11:23:02.925737+0000","last_fullsized":"2024-09-14T11:23:02.925737+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'351","last_scrub_stamp":"2024-09-14T11:23:02.925623+0000","last_deep_scrub":"260'351","last_deep_scrub_stamp":"2024-09-14T11:23:02.925623+0000","last_clean_scrub_stamp":"2024-09-14T11:23:02.925623+0000","objects_scrubbed":4,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:52.477625+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":636,"num_read_kb":1890,"num_write":1154,"num_write_kb":1386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"260'588","reported_seq":2236,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:04.608895+0000","last_change":"2024-09-14T11:23:04.608895+0000","last_active":"2024-09-14T11:23:04.608895+0000","last_peered":"2024-09-14T11:23:04.608895+0000","last_clean":"2024-09-14T11:23:04.608895+0000","last_became_active":"2024-09-14T10:45:45.723163+0000","last_became_peered":"2024-09-14T10:45:45.723163+0000","last_unstale":"2024-09-14T11:23:04.608895+0000","last_undegraded":"2024-09-14T11:23:04.608895+0000","last_fullsized":"2024-09-14T11:23:04.608895+0000","mapping_epoch":26,"log_start":"260'500","ondisk_log_start":"260'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'588","last_scrub_stamp":"2024-09-14T11:23:04.608810+0000","last_deep_scrub":"260'588","last_deep_scrub_stamp":"2024-09-14T11:23:04.608810+0000","last_clean_scrub_stamp":"2024-09-14T11:23:04.608810+0000","objects_scrubbed":4,"log_size":88,"log_dups_size":500,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:14.023702+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3275,"num_read_kb":3002,"num_write":768,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"260'379","reported_seq":1053,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:54.616609+0000","last_change":"2024-09-14T11:22:54.616609+0000","last_active":"2024-09-14T11:22:54.616609+0000","last_peered":"2024-09-14T11:22:54.616609+0000","last_clean":"2024-09-14T11:22:54.616609+0000","last_became_active":"2024-09-14T10:45:43.680517+0000","last_became_peered":"2024-09-14T10:45:43.680517+0000","last_unstale":"2024-09-14T11:22:54.616609+0000","last_undegraded":"2024-09-14T11:22:54.616609+0000","last_fullsized":"2024-09-14T11:22:54.616609+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'379","last_scrub_stamp":"2024-09-14T11:22:54.616470+0000","last_deep_scrub":"260'379","last_deep_scrub_stamp":"2024-09-14T11:22:54.616470+0000","last_clean_scrub_stamp":"2024-09-14T11:22:54.616470+0000","objects_scrubbed":8,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:48.841281+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133694,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":729,"num_read_kb":32475,"num_write":1387,"num_write_kb":39199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"260'770","reported_seq":2292,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:07.714670+0000","last_change":"2024-09-14T11:23:07.714670+0000","last_active":"2024-09-14T11:23:07.714670+0000","last_peered":"2024-09-14T11:23:07.714670+0000","last_clean":"2024-09-14T11:23:07.714670+0000","last_became_active":"2024-09-14T10:45:45.718969+0000","last_became_peered":"2024-09-14T10:45:45.718969+0000","last_unstale":"2024-09-14T11:23:07.714670+0000","last_undegraded":"2024-09-14T11:23:07.714670+0000","last_fullsized":"2024-09-14T11:23:07.714670+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'770","last_scrub_stamp":"2024-09-14T11:23:07.714570+0000","last_deep_scrub":"260'770","last_deep_scrub_stamp":"2024-09-14T11:23:07.714570+0000","last_clean_scrub_stamp":"2024-09-14T11:23:07.714570+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:16.190729+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3670,"num_read_kb":3326,"num_write":1002,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"260'340","reported_seq":968,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:12.215702+0000","last_change":"2024-09-14T11:23:12.215702+0000","last_active":"2024-09-14T11:23:12.215702+0000","last_peered":"2024-09-14T11:23:12.215702+0000","last_clean":"2024-09-14T11:23:12.215702+0000","last_became_active":"2024-09-14T10:45:43.690489+0000","last_became_peered":"2024-09-14T10:45:43.690489+0000","last_unstale":"2024-09-14T11:23:12.215702+0000","last_undegraded":"2024-09-14T11:23:12.215702+0000","last_fullsized":"2024-09-14T11:23:12.215702+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'340","last_scrub_stamp":"2024-09-14T11:23:12.215605+0000","last_deep_scrub":"260'340","last_deep_scrub_stamp":"2024-09-14T11:23:12.215605+0000","last_clean_scrub_stamp":"2024-09-14T11:23:12.215605+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:12.269469+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":562,"num_read_kb":22090,"num_write":1057,"num_write_kb":34450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"260'629","reported_seq":2211,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:09.765722+0000","last_change":"2024-09-14T11:23:09.765722+0000","last_active":"2024-09-14T11:23:09.765722+0000","last_peered":"2024-09-14T11:23:09.765722+0000","last_clean":"2024-09-14T11:23:09.765722+0000","last_became_active":"2024-09-14T10:45:45.727095+0000","last_became_peered":"2024-09-14T10:45:45.727095+0000","last_unstale":"2024-09-14T11:23:09.765722+0000","last_undegraded":"2024-09-14T11:23:09.765722+0000","last_fullsized":"2024-09-14T11:23:09.765722+0000","mapping_epoch":26,"log_start":"260'600","ondisk_log_start":"260'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'629","last_scrub_stamp":"2024-09-14T11:23:09.765606+0000","last_deep_scrub":"260'629","last_deep_scrub_stamp":"2024-09-14T11:23:09.765606+0000","last_clean_scrub_stamp":"2024-09-14T11:23:09.765606+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":600,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:16.812881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3428,"num_read_kb":3090,"num_write":924,"num_write_kb":450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":893,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"260'312","reported_seq":907,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:01.817437+0000","last_change":"2024-09-14T11:23:01.817385+0000","last_active":"2024-09-14T11:23:01.817437+0000","last_peered":"2024-09-14T11:23:01.817437+0000","last_clean":"2024-09-14T11:23:01.817437+0000","last_became_active":"2024-09-14T10:45:43.689186+0000","last_became_peered":"2024-09-14T10:45:43.689186+0000","last_unstale":"2024-09-14T11:23:01.817437+0000","last_undegraded":"2024-09-14T11:23:01.817437+0000","last_fullsized":"2024-09-14T11:23:01.817437+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'312","last_scrub_stamp":"2024-09-14T11:23:01.817298+0000","last_deep_scrub":"260'312","last_deep_scrub_stamp":"2024-09-14T11:23:01.817298+0000","last_clean_scrub_stamp":"2024-09-14T11:23:01.817298+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:01.982799+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133706,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":457,"num_read_kb":44560,"num_write":936,"num_write_kb":69256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"260'1085","reported_seq":2831,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:03.606116+0000","last_change":"2024-09-14T11:23:03.606116+0000","last_active":"2024-09-14T11:23:03.606116+0000","last_peered":"2024-09-14T11:23:03.606116+0000","last_clean":"2024-09-14T11:23:03.606116+0000","last_became_active":"2024-09-14T10:45:45.720636+0000","last_became_peered":"2024-09-14T10:45:45.720636+0000","last_unstale":"2024-09-14T11:23:03.606116+0000","last_undegraded":"2024-09-14T11:23:03.606116+0000","last_fullsized":"2024-09-14T11:23:03.606116+0000","mapping_epoch":26,"log_start":"260'1000","ondisk_log_start":"260'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1085","last_scrub_stamp":"2024-09-14T11:23:03.606026+0000","last_deep_scrub":"260'1085","last_deep_scrub_stamp":"2024-09-14T11:23:03.606026+0000","last_clean_scrub_stamp":"2024-09-14T11:23:03.606026+0000","objects_scrubbed":2,"log_size":85,"log_dups_size":1000,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:51:34.804450+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5348,"num_read_kb":4870,"num_write":1559,"num_write_kb":616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"260'336","reported_seq":1017,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:10.212053+0000","last_change":"2024-09-14T11:23:10.212053+0000","last_active":"2024-09-14T11:23:10.212053+0000","last_peered":"2024-09-14T11:23:10.212053+0000","last_clean":"2024-09-14T11:23:10.212053+0000","last_became_active":"2024-09-14T10:45:43.682573+0000","last_became_peered":"2024-09-14T10:45:43.682573+0000","last_unstale":"2024-09-14T11:23:10.212053+0000","last_undegraded":"2024-09-14T11:23:10.212053+0000","last_fullsized":"2024-09-14T11:23:10.212053+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'336","last_scrub_stamp":"2024-09-14T11:23:10.211893+0000","last_deep_scrub":"260'336","last_deep_scrub_stamp":"2024-09-14T11:23:10.211893+0000","last_clean_scrub_stamp":"2024-09-14T11:23:10.211893+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:35.666356+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244522,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":804,"num_read_kb":3981,"num_write":1025,"num_write_kb":35472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"260'383","reported_seq":1020,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:11.233324+0000","last_change":"2024-09-14T11:23:11.233324+0000","last_active":"2024-09-14T11:23:11.233324+0000","last_peered":"2024-09-14T11:23:11.233324+0000","last_clean":"2024-09-14T11:23:11.233324+0000","last_became_active":"2024-09-14T10:45:43.673527+0000","last_became_peered":"2024-09-14T10:45:43.673527+0000","last_unstale":"2024-09-14T11:23:11.233324+0000","last_undegraded":"2024-09-14T11:23:11.233324+0000","last_fullsized":"2024-09-14T11:23:11.233324+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'383","last_scrub_stamp":"2024-09-14T11:23:11.233207+0000","last_deep_scrub":"260'383","last_deep_scrub_stamp":"2024-09-14T11:23:11.233207+0000","last_clean_scrub_stamp":"2024-09-14T11:23:11.233207+0000","objects_scrubbed":5,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:10:35.983721+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":679,"num_read_kb":21996,"num_write":1218,"num_write_kb":25813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"260'1016","reported_seq":2623,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:13.796760+0000","last_change":"2024-09-14T11:23:13.796760+0000","last_active":"2024-09-14T11:23:13.796760+0000","last_peered":"2024-09-14T11:23:13.796760+0000","last_clean":"2024-09-14T11:23:13.796760+0000","last_became_active":"2024-09-14T10:45:45.724040+0000","last_became_peered":"2024-09-14T10:45:45.724040+0000","last_unstale":"2024-09-14T11:23:13.796760+0000","last_undegraded":"2024-09-14T11:23:13.796760+0000","last_fullsized":"2024-09-14T11:23:13.796760+0000","mapping_epoch":26,"log_start":"260'1000","ondisk_log_start":"260'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1016","last_scrub_stamp":"2024-09-14T11:23:13.796666+0000","last_deep_scrub":"260'1016","last_deep_scrub_stamp":"2024-09-14T11:23:13.796666+0000","last_clean_scrub_stamp":"2024-09-14T11:23:13.796666+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":1000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:58.735365+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4769,"num_read_kb":4210,"num_write":1424,"num_write_kb":631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"260'384","reported_seq":1025,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:06.332254+0000","last_change":"2024-09-14T11:23:06.332254+0000","last_active":"2024-09-14T11:23:06.332254+0000","last_peered":"2024-09-14T11:23:06.332254+0000","last_clean":"2024-09-14T11:23:06.332254+0000","last_became_active":"2024-09-14T10:45:43.687162+0000","last_became_peered":"2024-09-14T10:45:43.687162+0000","last_unstale":"2024-09-14T11:23:06.332254+0000","last_undegraded":"2024-09-14T11:23:06.332254+0000","last_fullsized":"2024-09-14T11:23:06.332254+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'384","last_scrub_stamp":"2024-09-14T11:23:06.332163+0000","last_deep_scrub":"260'384","last_deep_scrub_stamp":"2024-09-14T11:23:06.332163+0000","last_clean_scrub_stamp":"2024-09-14T11:23:06.332163+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:22.685467+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":664,"num_read_kb":37354,"num_write":1184,"num_write_kb":26064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"260'478","reported_seq":2026,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:07.626572+0000","last_change":"2024-09-14T11:23:07.626572+0000","last_active":"2024-09-14T11:23:07.626572+0000","last_peered":"2024-09-14T11:23:07.626572+0000","last_clean":"2024-09-14T11:23:07.626572+0000","last_became_active":"2024-09-14T10:45:45.711869+0000","last_became_peered":"2024-09-14T10:45:45.711869+0000","last_unstale":"2024-09-14T11:23:07.626572+0000","last_undegraded":"2024-09-14T11:23:07.626572+0000","last_fullsized":"2024-09-14T11:23:07.626572+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'478","last_scrub_stamp":"2024-09-14T11:23:07.626475+0000","last_deep_scrub":"260'478","last_deep_scrub_stamp":"2024-09-14T11:23:07.626475+0000","last_clean_scrub_stamp":"2024-09-14T11:23:07.626475+0000","objects_scrubbed":1,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:37.243122+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2555,"num_read_kb":2382,"num_write":592,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":694,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10817,"num_read_kb":8523,"num_write":3117,"num_write_kb":1010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1096,"ondisk_log_size":1096,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":14831,"num_objects":87,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":15133,"num_read_kb":14796,"num_write":17057,"num_write_kb":4975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2512,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":29662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1551,"ondisk_log_size":1551,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":790,"ondisk_log_size":790,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1553710,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":17035,"num_read_kb":36473,"num_write":14315,"num_write_kb":11597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":710380,"num_omap_keys":1616,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2052,"ondisk_log_size":2052,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2403,"num_read_kb":2864,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":219533,"num_read_kb":201172,"num_write":55836,"num_write_kb":19050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":143,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":36254,"num_omap_keys":147,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4202,"ondisk_log_size":4202,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":33830883,"num_objects":281,"num_object_clones":0,"num_object_copies":562,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":281,"num_whiteouts":0,"num_read":44198,"num_read_kb":2138103,"num_write":73249,"num_write_kb":2157996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":68608000,"data_stored":67661766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3853,"ondisk_log_size":3853,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":135,"num_read_kb":175817,"num_write":154,"num_write_kb":116354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":174730,"num_write":154,"num_write_kb":116354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509904,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":216692,"kb_used_data":18916,"kb_used_omap":1,"kb_used_meta":197758,"kb_avail":94155148,"statfs":{"total":96636764160,"available":96414871552,"internally_reserved":0,"allocated":19369984,"data_stored":17696805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":202504647},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509902,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284708,"kb_used_data":10580,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":94087132,"statfs":{"total":96636764160,"available":96345223168,"internally_reserved":0,"allocated":10833920,"data_stored":9216591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":280689093},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509901,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113044,"kb_used_data":19460,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94258796,"statfs":{"total":96636764160,"available":96521007104,"internally_reserved":0,"allocated":19927040,"data_stored":18233635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542606,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":229044,"kb_used_data":9124,"kb_used_omap":1,"kb_used_meta":219902,"kb_avail":94142796,"statfs":{"total":96636764160,"available":96402223104,"internally_reserved":0,"allocated":9342976,"data_stored":7745589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":225180106},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542606,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89140,"kb_used_data":8036,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94282700,"statfs":{"total":96636764160,"available":96545484800,"internally_reserved":0,"allocated":8228864,"data_stored":6610205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":83032518},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542608,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":252176,"kb_used_data":8640,"kb_used_omap":1,"kb_used_meta":243518,"kb_avail":94119664,"statfs":{"total":96636764160,"available":96378535936,"internally_reserved":0,"allocated":8847360,"data_stored":7201151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":249362885},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542607,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":193432,"kb_used_data":9608,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":94178408,"statfs":{"total":96636764160,"available":96438689792,"internally_reserved":0,"allocated":9838592,"data_stored":8236289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":188217797},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575310,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":111084,"kb_used_data":11868,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94260756,"statfs":{"total":96636764160,"available":96523014144,"internally_reserved":0,"allocated":12152832,"data_stored":10503839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16318464,"data_stored":16157858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6668288,"data_stored":6553434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8556544,"data_stored":8428200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15777792,"data_stored":15622768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6250496,"data_stored":6160671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4653056,"data_stored":4535149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4632576,"data_stored":4535041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5750784,"data_stored":5668645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":5195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:23:38.893 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.893 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.893 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.893 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.894 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.894 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.894 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.894 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.894 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.894 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.894 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.894 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.894 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.895 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.895 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.895 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.895 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.895 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.895 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.895 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.895 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.896 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.896 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.896 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.896 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.896 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.896 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.896 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.896 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.896 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.897 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.897 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.897 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.897 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.897 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.897 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.897 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.897 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.898 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.898 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.898 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.898 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.898 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.898 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.898 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.898 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.899 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.899 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.899 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.899 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.899 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.899 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.899 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.899 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.900 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.900 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.900 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.900 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.900 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.900 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.900 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.900 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.901 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.901 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.901 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.901 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.901 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-14T10:59:47.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.901 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.902 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.903 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.903 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.903 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.904 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.904 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-14T10:45:50.727439+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.904 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-14T10:45:52.731646+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=45, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:38.904 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T11:23:58.906 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:23:59.239 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:23:59.251 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-09-14T11:23:59.253 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":1409,"stamp":"2024-09-14T11:23:57.786109+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":35991604,"num_objects":734,"num_object_clones":0,"num_object_copies":1468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":734,"num_whiteouts":0,"num_read":309464,"num_read_kb":2752545,"num_write":164025,"num_write_kb":2428992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":190,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":750274,"num_omap_keys":1791,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13757,"ondisk_log_size":13757,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1493480,"kb_used_data":96232,"kb_used_omap":12,"kb_used_meta":1397107,"kb_avail":753481240,"statfs":{"total":773094113280,"available":771564789760,"internally_reserved":0,"allocated":98541568,"data_stored":85444104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1430638128},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":376,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005294"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":25,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:33.560175+0000","last_change":"2024-09-14T11:23:33.560175+0000","last_active":"2024-09-14T11:23:33.560175+0000","last_peered":"2024-09-14T11:23:33.560175+0000","last_clean":"2024-09-14T11:23:33.560175+0000","last_became_active":"2024-09-14T11:11:42.592933+0000","last_became_peered":"2024-09-14T11:11:42.592933+0000","last_unstale":"2024-09-14T11:23:33.560175+0000","last_undegraded":"2024-09-14T11:23:33.560175+0000","last_fullsized":"2024-09-14T11:23:33.560175+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:33.560091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:33.560091+0000","last_clean_scrub_stamp":"2024-09-14T11:23:33.560091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:16.523328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"260'2","reported_seq":40,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:31.536031+0000","last_change":"2024-09-14T11:23:31.535946+0000","last_active":"2024-09-14T11:23:31.536031+0000","last_peered":"2024-09-14T11:23:31.536031+0000","last_clean":"2024-09-14T11:23:31.536031+0000","last_became_active":"2024-09-14T11:01:23.881902+0000","last_became_peered":"2024-09-14T11:01:23.881902+0000","last_unstale":"2024-09-14T11:23:31.536031+0000","last_undegraded":"2024-09-14T11:23:31.536031+0000","last_fullsized":"2024-09-14T11:23:31.536031+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:23:31.535822+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:23:31.535822+0000","last_clean_scrub_stamp":"2024-09-14T11:23:31.535822+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:35.535334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"260'8","reported_seq":60,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:35.827963+0000","last_change":"2024-09-14T11:23:35.827907+0000","last_active":"2024-09-14T11:23:35.827963+0000","last_peered":"2024-09-14T11:23:35.827963+0000","last_clean":"2024-09-14T11:23:35.827963+0000","last_became_active":"2024-09-14T11:01:20.867142+0000","last_became_peered":"2024-09-14T11:01:20.867142+0000","last_unstale":"2024-09-14T11:23:35.827963+0000","last_undegraded":"2024-09-14T11:23:35.827963+0000","last_fullsized":"2024-09-14T11:23:35.827963+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'8","last_scrub_stamp":"2024-09-14T11:23:35.827820+0000","last_deep_scrub":"260'8","last_deep_scrub_stamp":"2024-09-14T11:23:35.827820+0000","last_clean_scrub_stamp":"2024-09-14T11:23:35.827820+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:23.584930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20482,"num_write":18,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"260'30","reported_seq":131,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:36.693388+0000","last_change":"2024-09-14T11:23:36.693388+0000","last_active":"2024-09-14T11:23:36.693388+0000","last_peered":"2024-09-14T11:23:36.693388+0000","last_clean":"2024-09-14T11:23:36.693388+0000","last_became_active":"2024-09-14T10:59:48.416537+0000","last_became_peered":"2024-09-14T10:59:48.416537+0000","last_unstale":"2024-09-14T11:23:36.693388+0000","last_undegraded":"2024-09-14T11:23:36.693388+0000","last_fullsized":"2024-09-14T11:23:36.693388+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'30","last_scrub_stamp":"2024-09-14T11:23:36.693306+0000","last_deep_scrub":"260'30","last_deep_scrub_stamp":"2024-09-14T11:23:36.693306+0000","last_clean_scrub_stamp":"2024-09-14T11:23:36.693306+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:14.676967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":249,"num_read_kb":173,"num_write":73,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":25,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:39.336123+0000","last_change":"2024-09-14T11:23:39.336123+0000","last_active":"2024-09-14T11:23:39.336123+0000","last_peered":"2024-09-14T11:23:39.336123+0000","last_clean":"2024-09-14T11:23:39.336123+0000","last_became_active":"2024-09-14T11:11:42.587818+0000","last_became_peered":"2024-09-14T11:11:42.587818+0000","last_unstale":"2024-09-14T11:23:39.336123+0000","last_undegraded":"2024-09-14T11:23:39.336123+0000","last_fullsized":"2024-09-14T11:23:39.336123+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:39.336034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:39.336034+0000","last_clean_scrub_stamp":"2024-09-14T11:23:39.336034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:28.266229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"260'2","reported_seq":39,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:36.340173+0000","last_change":"2024-09-14T11:23:36.340117+0000","last_active":"2024-09-14T11:23:36.340173+0000","last_peered":"2024-09-14T11:23:36.340173+0000","last_clean":"2024-09-14T11:23:36.340173+0000","last_became_active":"2024-09-14T11:01:23.881074+0000","last_became_peered":"2024-09-14T11:01:23.881074+0000","last_unstale":"2024-09-14T11:23:36.340173+0000","last_undegraded":"2024-09-14T11:23:36.340173+0000","last_fullsized":"2024-09-14T11:23:36.340173+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:23:36.340032+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:23:36.340032+0000","last_clean_scrub_stamp":"2024-09-14T11:23:36.340032+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:40:27.471764+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":571,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"260'8","reported_seq":57,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:40.610010+0000","last_change":"2024-09-14T11:23:40.609940+0000","last_active":"2024-09-14T11:23:40.610010+0000","last_peered":"2024-09-14T11:23:40.610010+0000","last_clean":"2024-09-14T11:23:40.610010+0000","last_became_active":"2024-09-14T11:01:20.868373+0000","last_became_peered":"2024-09-14T11:01:20.868373+0000","last_unstale":"2024-09-14T11:23:40.610010+0000","last_undegraded":"2024-09-14T11:23:40.610010+0000","last_fullsized":"2024-09-14T11:23:40.610010+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'8","last_scrub_stamp":"2024-09-14T11:23:40.609844+0000","last_deep_scrub":"260'8","last_deep_scrub_stamp":"2024-09-14T11:23:40.609844+0000","last_clean_scrub_stamp":"2024-09-14T11:23:40.609844+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:15.660130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10811,"num_write":13,"num_write_kb":10811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"260'56","reported_seq":204,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:37.678477+0000","last_change":"2024-09-14T11:23:37.678392+0000","last_active":"2024-09-14T11:23:37.678477+0000","last_peered":"2024-09-14T11:23:37.678477+0000","last_clean":"2024-09-14T11:23:37.678477+0000","last_became_active":"2024-09-14T10:59:48.416222+0000","last_became_peered":"2024-09-14T10:59:48.416222+0000","last_unstale":"2024-09-14T11:23:37.678477+0000","last_undegraded":"2024-09-14T11:23:37.678477+0000","last_fullsized":"2024-09-14T11:23:37.678477+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'56","last_scrub_stamp":"2024-09-14T11:23:37.678312+0000","last_deep_scrub":"260'56","last_deep_scrub_stamp":"2024-09-14T11:23:37.678312+0000","last_clean_scrub_stamp":"2024-09-14T11:23:37.678312+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:33.010328+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":447,"num_read_kb":304,"num_write":135,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:35.600074+0000","last_change":"2024-09-14T11:23:35.599995+0000","last_active":"2024-09-14T11:23:35.600074+0000","last_peered":"2024-09-14T11:23:35.600074+0000","last_clean":"2024-09-14T11:23:35.600074+0000","last_became_active":"2024-09-14T11:11:42.593314+0000","last_became_peered":"2024-09-14T11:11:42.593314+0000","last_unstale":"2024-09-14T11:23:35.600074+0000","last_undegraded":"2024-09-14T11:23:35.600074+0000","last_fullsized":"2024-09-14T11:23:35.600074+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:35.599879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:35.599879+0000","last_clean_scrub_stamp":"2024-09-14T11:23:35.599879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:47:55.344309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"260'3","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:48.681970+0000","last_change":"2024-09-14T11:23:48.681970+0000","last_active":"2024-09-14T11:23:48.681970+0000","last_peered":"2024-09-14T11:23:48.681970+0000","last_clean":"2024-09-14T11:23:48.681970+0000","last_became_active":"2024-09-14T11:01:23.892846+0000","last_became_peered":"2024-09-14T11:01:23.892846+0000","last_unstale":"2024-09-14T11:23:48.681970+0000","last_undegraded":"2024-09-14T11:23:48.681970+0000","last_fullsized":"2024-09-14T11:23:48.681970+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T11:23:48.681878+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T11:23:48.681878+0000","last_clean_scrub_stamp":"2024-09-14T11:23:48.681878+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:17:45.275403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"260'2","reported_seq":47,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:36.814321+0000","last_change":"2024-09-14T11:23:36.814321+0000","last_active":"2024-09-14T11:23:36.814321+0000","last_peered":"2024-09-14T11:23:36.814321+0000","last_clean":"2024-09-14T11:23:36.814321+0000","last_became_active":"2024-09-14T11:01:20.864672+0000","last_became_peered":"2024-09-14T11:01:20.864672+0000","last_unstale":"2024-09-14T11:23:36.814321+0000","last_undegraded":"2024-09-14T11:23:36.814321+0000","last_fullsized":"2024-09-14T11:23:36.814321+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:23:36.814216+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:23:36.814216+0000","last_clean_scrub_stamp":"2024-09-14T11:23:36.814216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:48:31.171854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"260'48","reported_seq":176,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:32.211469+0000","last_change":"2024-09-14T11:23:32.211469+0000","last_active":"2024-09-14T11:23:32.211469+0000","last_peered":"2024-09-14T11:23:32.211469+0000","last_clean":"2024-09-14T11:23:32.211469+0000","last_became_active":"2024-09-14T10:59:48.419525+0000","last_became_peered":"2024-09-14T10:59:48.419525+0000","last_unstale":"2024-09-14T11:23:32.211469+0000","last_undegraded":"2024-09-14T11:23:32.211469+0000","last_fullsized":"2024-09-14T11:23:32.211469+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'48","last_scrub_stamp":"2024-09-14T11:23:32.211344+0000","last_deep_scrub":"260'48","last_deep_scrub_stamp":"2024-09-14T11:23:32.211344+0000","last_clean_scrub_stamp":"2024-09-14T11:23:32.211344+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:38.708280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":364,"num_read_kb":247,"num_write":125,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:55.660953+0000","last_change":"2024-09-14T11:23:55.660845+0000","last_active":"2024-09-14T11:23:55.660953+0000","last_peered":"2024-09-14T11:23:55.660953+0000","last_clean":"2024-09-14T11:23:55.660953+0000","last_became_active":"2024-09-14T11:11:42.587218+0000","last_became_peered":"2024-09-14T11:11:42.587218+0000","last_unstale":"2024-09-14T11:23:55.660953+0000","last_undegraded":"2024-09-14T11:23:55.660953+0000","last_fullsized":"2024-09-14T11:23:55.660953+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:55.660732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:55.660732+0000","last_clean_scrub_stamp":"2024-09-14T11:23:55.660732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:45.998493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"260'2","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:47.688948+0000","last_change":"2024-09-14T11:23:47.688948+0000","last_active":"2024-09-14T11:23:47.688948+0000","last_peered":"2024-09-14T11:23:47.688948+0000","last_clean":"2024-09-14T11:23:47.688948+0000","last_became_active":"2024-09-14T11:01:23.886771+0000","last_became_peered":"2024-09-14T11:01:23.886771+0000","last_unstale":"2024-09-14T11:23:47.688948+0000","last_undegraded":"2024-09-14T11:23:47.688948+0000","last_fullsized":"2024-09-14T11:23:47.688948+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:23:47.688858+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:23:47.688858+0000","last_clean_scrub_stamp":"2024-09-14T11:23:47.688858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:23:32.298587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":118,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"257'5","reported_seq":58,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:32.559543+0000","last_change":"2024-09-14T11:23:32.559543+0000","last_active":"2024-09-14T11:23:32.559543+0000","last_peered":"2024-09-14T11:23:32.559543+0000","last_clean":"2024-09-14T11:23:32.559543+0000","last_became_active":"2024-09-14T11:01:20.861799+0000","last_became_peered":"2024-09-14T11:01:20.861799+0000","last_unstale":"2024-09-14T11:23:32.559543+0000","last_undegraded":"2024-09-14T11:23:32.559543+0000","last_fullsized":"2024-09-14T11:23:32.559543+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'5","last_scrub_stamp":"2024-09-14T11:23:32.559455+0000","last_deep_scrub":"257'5","last_deep_scrub_stamp":"2024-09-14T11:23:32.559455+0000","last_clean_scrub_stamp":"2024-09-14T11:23:32.559455+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:15.145786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"260'15","reported_seq":85,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:30.130793+0000","last_change":"2024-09-14T11:23:30.130793+0000","last_active":"2024-09-14T11:23:30.130793+0000","last_peered":"2024-09-14T11:23:30.130793+0000","last_clean":"2024-09-14T11:23:30.130793+0000","last_became_active":"2024-09-14T10:59:48.411423+0000","last_became_peered":"2024-09-14T10:59:48.411423+0000","last_unstale":"2024-09-14T11:23:30.130793+0000","last_undegraded":"2024-09-14T11:23:30.130793+0000","last_fullsized":"2024-09-14T11:23:30.130793+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'15","last_scrub_stamp":"2024-09-14T11:23:30.130697+0000","last_deep_scrub":"260'15","last_deep_scrub_stamp":"2024-09-14T11:23:30.130697+0000","last_clean_scrub_stamp":"2024-09-14T11:23:30.130697+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:14:49.943927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":68,"num_write":41,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:46.841887+0000","last_change":"2024-09-14T11:23:46.841798+0000","last_active":"2024-09-14T11:23:46.841887+0000","last_peered":"2024-09-14T11:23:46.841887+0000","last_clean":"2024-09-14T11:23:46.841887+0000","last_became_active":"2024-09-14T11:11:42.583717+0000","last_became_peered":"2024-09-14T11:11:42.583717+0000","last_unstale":"2024-09-14T11:23:46.841887+0000","last_undegraded":"2024-09-14T11:23:46.841887+0000","last_fullsized":"2024-09-14T11:23:46.841887+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:46.841692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:46.841692+0000","last_clean_scrub_stamp":"2024-09-14T11:23:46.841692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:30.010935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"257'3","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:27.541195+0000","last_change":"2024-09-14T11:23:27.541195+0000","last_active":"2024-09-14T11:23:27.541195+0000","last_peered":"2024-09-14T11:23:27.541195+0000","last_clean":"2024-09-14T11:23:27.541195+0000","last_became_active":"2024-09-14T11:01:23.894107+0000","last_became_peered":"2024-09-14T11:01:23.894107+0000","last_unstale":"2024-09-14T11:23:27.541195+0000","last_undegraded":"2024-09-14T11:23:27.541195+0000","last_fullsized":"2024-09-14T11:23:27.541195+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'3","last_scrub_stamp":"2024-09-14T11:23:27.541106+0000","last_deep_scrub":"257'3","last_deep_scrub_stamp":"2024-09-14T11:23:27.541106+0000","last_clean_scrub_stamp":"2024-09-14T11:23:27.541106+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:28:00.951271+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"260'6","reported_seq":53,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:39.647526+0000","last_change":"2024-09-14T11:23:39.647526+0000","last_active":"2024-09-14T11:23:39.647526+0000","last_peered":"2024-09-14T11:23:39.647526+0000","last_clean":"2024-09-14T11:23:39.647526+0000","last_became_active":"2024-09-14T11:01:20.867768+0000","last_became_peered":"2024-09-14T11:01:20.867768+0000","last_unstale":"2024-09-14T11:23:39.647526+0000","last_undegraded":"2024-09-14T11:23:39.647526+0000","last_fullsized":"2024-09-14T11:23:39.647526+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-14T11:23:39.647423+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-14T11:23:39.647423+0000","last_clean_scrub_stamp":"2024-09-14T11:23:39.647423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:37.269875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"260'40","reported_seq":154,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:29.172741+0000","last_change":"2024-09-14T11:23:29.172741+0000","last_active":"2024-09-14T11:23:29.172741+0000","last_peered":"2024-09-14T11:23:29.172741+0000","last_clean":"2024-09-14T11:23:29.172741+0000","last_became_active":"2024-09-14T10:59:48.413296+0000","last_became_peered":"2024-09-14T10:59:48.413296+0000","last_unstale":"2024-09-14T11:23:29.172741+0000","last_undegraded":"2024-09-14T11:23:29.172741+0000","last_fullsized":"2024-09-14T11:23:29.172741+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'40","last_scrub_stamp":"2024-09-14T11:23:29.172654+0000","last_deep_scrub":"260'40","last_deep_scrub_stamp":"2024-09-14T11:23:29.172654+0000","last_clean_scrub_stamp":"2024-09-14T11:23:29.172654+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:31.140458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":304,"num_read_kb":193,"num_write":101,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:42.609549+0000","last_change":"2024-09-14T11:23:42.609549+0000","last_active":"2024-09-14T11:23:42.609549+0000","last_peered":"2024-09-14T11:23:42.609549+0000","last_clean":"2024-09-14T11:23:42.609549+0000","last_became_active":"2024-09-14T11:11:42.582310+0000","last_became_peered":"2024-09-14T11:11:42.582310+0000","last_unstale":"2024-09-14T11:23:42.609549+0000","last_undegraded":"2024-09-14T11:23:42.609549+0000","last_fullsized":"2024-09-14T11:23:42.609549+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:42.609452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:42.609452+0000","last_clean_scrub_stamp":"2024-09-14T11:23:42.609452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:04:55.422405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"260'8","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:50.421223+0000","last_change":"2024-09-14T11:01:23.888252+0000","last_active":"2024-09-14T11:22:50.421223+0000","last_peered":"2024-09-14T11:22:50.421223+0000","last_clean":"2024-09-14T11:22:50.421223+0000","last_became_active":"2024-09-14T11:01:23.888017+0000","last_became_peered":"2024-09-14T11:01:23.888017+0000","last_unstale":"2024-09-14T11:22:50.421223+0000","last_undegraded":"2024-09-14T11:22:50.421223+0000","last_fullsized":"2024-09-14T11:22:50.421223+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":11264,"num_write":18,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"257'2","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:47.123474+0000","last_change":"2024-09-14T11:01:20.863609+0000","last_active":"2024-09-14T11:20:47.123474+0000","last_peered":"2024-09-14T11:20:47.123474+0000","last_clean":"2024-09-14T11:20:47.123474+0000","last_became_active":"2024-09-14T11:01:20.863258+0000","last_became_peered":"2024-09-14T11:01:20.863258+0000","last_unstale":"2024-09-14T11:20:47.123474+0000","last_undegraded":"2024-09-14T11:20:47.123474+0000","last_fullsized":"2024-09-14T11:20:47.123474+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:19.834649+0000","last_clean_scrub_stamp":"2024-09-14T11:01:19.834649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"260'62","reported_seq":223,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:27.335658+0000","last_change":"2024-09-14T11:23:27.335658+0000","last_active":"2024-09-14T11:23:27.335658+0000","last_peered":"2024-09-14T11:23:27.335658+0000","last_clean":"2024-09-14T11:23:27.335658+0000","last_became_active":"2024-09-14T10:59:48.419994+0000","last_became_peered":"2024-09-14T10:59:48.419994+0000","last_unstale":"2024-09-14T11:23:27.335658+0000","last_undegraded":"2024-09-14T11:23:27.335658+0000","last_fullsized":"2024-09-14T11:23:27.335658+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'62","last_scrub_stamp":"2024-09-14T11:23:27.335563+0000","last_deep_scrub":"260'62","last_deep_scrub_stamp":"2024-09-14T11:23:27.335563+0000","last_clean_scrub_stamp":"2024-09-14T11:23:27.335563+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:10.177468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":520,"num_read_kb":329,"num_write":161,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"260'2","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:40.260066+0000","last_change":"2024-09-14T11:23:40.260066+0000","last_active":"2024-09-14T11:23:40.260066+0000","last_peered":"2024-09-14T11:23:40.260066+0000","last_clean":"2024-09-14T11:23:40.260066+0000","last_became_active":"2024-09-14T11:11:42.588308+0000","last_became_peered":"2024-09-14T11:11:42.588308+0000","last_unstale":"2024-09-14T11:23:40.260066+0000","last_undegraded":"2024-09-14T11:23:40.260066+0000","last_fullsized":"2024-09-14T11:23:40.260066+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:23:40.259968+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:23:40.259968+0000","last_clean_scrub_stamp":"2024-09-14T11:23:40.259968+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:56.678699+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":36,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:39.279825+0000","last_change":"2024-09-14T11:23:39.279747+0000","last_active":"2024-09-14T11:23:39.279825+0000","last_peered":"2024-09-14T11:23:39.279825+0000","last_clean":"2024-09-14T11:23:39.279825+0000","last_became_active":"2024-09-14T11:01:23.884138+0000","last_became_peered":"2024-09-14T11:01:23.884138+0000","last_unstale":"2024-09-14T11:23:39.279825+0000","last_undegraded":"2024-09-14T11:23:39.279825+0000","last_fullsized":"2024-09-14T11:23:39.279825+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:39.279655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:39.279655+0000","last_clean_scrub_stamp":"2024-09-14T11:23:39.279655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:51.502440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:23.553877+0000","last_change":"2024-09-14T11:23:23.553826+0000","last_active":"2024-09-14T11:23:23.553877+0000","last_peered":"2024-09-14T11:23:23.553877+0000","last_clean":"2024-09-14T11:23:23.553877+0000","last_became_active":"2024-09-14T11:01:20.854737+0000","last_became_peered":"2024-09-14T11:01:20.854737+0000","last_unstale":"2024-09-14T11:23:23.553877+0000","last_undegraded":"2024-09-14T11:23:23.553877+0000","last_fullsized":"2024-09-14T11:23:23.553877+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:23.553739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:23.553739+0000","last_clean_scrub_stamp":"2024-09-14T11:23:23.553739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:08.924782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"260'45","reported_seq":171,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:27.756122+0000","last_change":"2024-09-14T11:23:27.756122+0000","last_active":"2024-09-14T11:23:27.756122+0000","last_peered":"2024-09-14T11:23:27.756122+0000","last_clean":"2024-09-14T11:23:27.756122+0000","last_became_active":"2024-09-14T10:59:48.419091+0000","last_became_peered":"2024-09-14T10:59:48.419091+0000","last_unstale":"2024-09-14T11:23:27.756122+0000","last_undegraded":"2024-09-14T11:23:27.756122+0000","last_fullsized":"2024-09-14T11:23:27.756122+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'45","last_scrub_stamp":"2024-09-14T11:23:27.756027+0000","last_deep_scrub":"260'45","last_deep_scrub_stamp":"2024-09-14T11:23:27.756027+0000","last_clean_scrub_stamp":"2024-09-14T11:23:27.756027+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:51.744018+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":368,"num_read_kb":243,"num_write":109,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":25,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:31.538044+0000","last_change":"2024-09-14T11:23:31.538044+0000","last_active":"2024-09-14T11:23:31.538044+0000","last_peered":"2024-09-14T11:23:31.538044+0000","last_clean":"2024-09-14T11:23:31.538044+0000","last_became_active":"2024-09-14T11:11:42.582899+0000","last_became_peered":"2024-09-14T11:11:42.582899+0000","last_unstale":"2024-09-14T11:23:31.538044+0000","last_undegraded":"2024-09-14T11:23:31.538044+0000","last_fullsized":"2024-09-14T11:23:31.538044+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:31.537948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:31.537948+0000","last_clean_scrub_stamp":"2024-09-14T11:23:31.537948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:48.541182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":36,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:43.894427+0000","last_change":"2024-09-14T11:23:43.894340+0000","last_active":"2024-09-14T11:23:43.894427+0000","last_peered":"2024-09-14T11:23:43.894427+0000","last_clean":"2024-09-14T11:23:43.894427+0000","last_became_active":"2024-09-14T11:01:23.894587+0000","last_became_peered":"2024-09-14T11:01:23.894587+0000","last_unstale":"2024-09-14T11:23:43.894427+0000","last_undegraded":"2024-09-14T11:23:43.894427+0000","last_fullsized":"2024-09-14T11:23:43.894427+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:43.894248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:43.894248+0000","last_clean_scrub_stamp":"2024-09-14T11:23:43.894248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:33.450732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"260'3","reported_seq":47,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:33.205160+0000","last_change":"2024-09-14T11:23:33.205078+0000","last_active":"2024-09-14T11:23:33.205160+0000","last_peered":"2024-09-14T11:23:33.205160+0000","last_clean":"2024-09-14T11:23:33.205160+0000","last_became_active":"2024-09-14T11:01:20.869244+0000","last_became_peered":"2024-09-14T11:01:20.869244+0000","last_unstale":"2024-09-14T11:23:33.205160+0000","last_undegraded":"2024-09-14T11:23:33.205160+0000","last_fullsized":"2024-09-14T11:23:33.205160+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T11:23:33.204965+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T11:23:33.204965+0000","last_clean_scrub_stamp":"2024-09-14T11:23:33.204965+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:14:10.951877+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"260'35","reported_seq":145,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:28.181239+0000","last_change":"2024-09-14T11:23:28.181239+0000","last_active":"2024-09-14T11:23:28.181239+0000","last_peered":"2024-09-14T11:23:28.181239+0000","last_clean":"2024-09-14T11:23:28.181239+0000","last_became_active":"2024-09-14T10:59:48.414023+0000","last_became_peered":"2024-09-14T10:59:48.414023+0000","last_unstale":"2024-09-14T11:23:28.181239+0000","last_undegraded":"2024-09-14T11:23:28.181239+0000","last_fullsized":"2024-09-14T11:23:28.181239+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'35","last_scrub_stamp":"2024-09-14T11:23:28.181143+0000","last_deep_scrub":"260'35","last_deep_scrub_stamp":"2024-09-14T11:23:28.181143+0000","last_clean_scrub_stamp":"2024-09-14T11:23:28.181143+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:57.692388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":284,"num_read_kb":189,"num_write":86,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:53.623667+0000","last_change":"2024-09-14T11:23:53.623667+0000","last_active":"2024-09-14T11:23:53.623667+0000","last_peered":"2024-09-14T11:23:53.623667+0000","last_clean":"2024-09-14T11:23:53.623667+0000","last_became_active":"2024-09-14T11:11:42.592439+0000","last_became_peered":"2024-09-14T11:11:42.592439+0000","last_unstale":"2024-09-14T11:23:53.623667+0000","last_undegraded":"2024-09-14T11:23:53.623667+0000","last_fullsized":"2024-09-14T11:23:53.623667+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:53.623571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:53.623571+0000","last_clean_scrub_stamp":"2024-09-14T11:23:53.623571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:42.584352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"257'3","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:40.908281+0000","last_change":"2024-09-14T11:23:40.908281+0000","last_active":"2024-09-14T11:23:40.908281+0000","last_peered":"2024-09-14T11:23:40.908281+0000","last_clean":"2024-09-14T11:23:40.908281+0000","last_became_active":"2024-09-14T11:01:23.891631+0000","last_became_peered":"2024-09-14T11:01:23.891631+0000","last_unstale":"2024-09-14T11:23:40.908281+0000","last_undegraded":"2024-09-14T11:23:40.908281+0000","last_fullsized":"2024-09-14T11:23:40.908281+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'3","last_scrub_stamp":"2024-09-14T11:23:40.908197+0000","last_deep_scrub":"257'3","last_deep_scrub_stamp":"2024-09-14T11:23:40.908197+0000","last_clean_scrub_stamp":"2024-09-14T11:23:40.908197+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:54:01.206445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"260'11","reported_seq":63,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:54.286583+0000","last_change":"2024-09-14T11:23:54.286583+0000","last_active":"2024-09-14T11:23:54.286583+0000","last_peered":"2024-09-14T11:23:54.286583+0000","last_clean":"2024-09-14T11:23:54.286583+0000","last_became_active":"2024-09-14T11:01:20.861043+0000","last_became_peered":"2024-09-14T11:01:20.861043+0000","last_unstale":"2024-09-14T11:23:54.286583+0000","last_undegraded":"2024-09-14T11:23:54.286583+0000","last_fullsized":"2024-09-14T11:23:54.286583+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'11","last_scrub_stamp":"2024-09-14T11:23:54.286464+0000","last_deep_scrub":"260'11","last_deep_scrub_stamp":"2024-09-14T11:23:54.286464+0000","last_clean_scrub_stamp":"2024-09-14T11:23:54.286464+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:01.335940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":17410,"num_write":21,"num_write_kb":12290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"260'250","reported_seq":803,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:35.655510+0000","last_change":"2024-09-14T11:23:35.655510+0000","last_active":"2024-09-14T11:23:35.655510+0000","last_peered":"2024-09-14T11:23:35.655510+0000","last_clean":"2024-09-14T11:23:35.655510+0000","last_became_active":"2024-09-14T10:59:48.416342+0000","last_became_peered":"2024-09-14T10:59:48.416342+0000","last_unstale":"2024-09-14T11:23:35.655510+0000","last_undegraded":"2024-09-14T11:23:35.655510+0000","last_fullsized":"2024-09-14T11:23:35.655510+0000","mapping_epoch":249,"log_start":"257'200","ondisk_log_start":"257'200","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'250","last_scrub_stamp":"2024-09-14T11:23:35.655429+0000","last_deep_scrub":"260'250","last_deep_scrub_stamp":"2024-09-14T11:23:35.655429+0000","last_clean_scrub_stamp":"2024-09-14T11:23:35.655429+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:00:13.084282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2428,"num_read_kb":2819,"num_write":491,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"260'2","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:36.269800+0000","last_change":"2024-09-14T11:23:36.269800+0000","last_active":"2024-09-14T11:23:36.269800+0000","last_peered":"2024-09-14T11:23:36.269800+0000","last_clean":"2024-09-14T11:23:36.269800+0000","last_became_active":"2024-09-14T11:11:42.587835+0000","last_became_peered":"2024-09-14T11:11:42.587835+0000","last_unstale":"2024-09-14T11:23:36.269800+0000","last_undegraded":"2024-09-14T11:23:36.269800+0000","last_fullsized":"2024-09-14T11:23:36.269800+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:23:36.269714+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:23:36.269714+0000","last_clean_scrub_stamp":"2024-09-14T11:23:36.269714+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:11.209024+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"260'3","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:46.663116+0000","last_change":"2024-09-14T11:23:46.663116+0000","last_active":"2024-09-14T11:23:46.663116+0000","last_peered":"2024-09-14T11:23:46.663116+0000","last_clean":"2024-09-14T11:23:46.663116+0000","last_became_active":"2024-09-14T11:01:23.892735+0000","last_became_peered":"2024-09-14T11:01:23.892735+0000","last_unstale":"2024-09-14T11:23:46.663116+0000","last_undegraded":"2024-09-14T11:23:46.663116+0000","last_fullsized":"2024-09-14T11:23:46.663116+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T11:23:46.663035+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T11:23:46.663035+0000","last_clean_scrub_stamp":"2024-09-14T11:23:46.663035+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:58:50.263185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"260'4","reported_seq":49,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:22.598035+0000","last_change":"2024-09-14T11:23:22.598035+0000","last_active":"2024-09-14T11:23:22.598035+0000","last_peered":"2024-09-14T11:23:22.598035+0000","last_clean":"2024-09-14T11:23:22.598035+0000","last_became_active":"2024-09-14T11:01:20.860541+0000","last_became_peered":"2024-09-14T11:01:20.860541+0000","last_unstale":"2024-09-14T11:23:22.598035+0000","last_undegraded":"2024-09-14T11:23:22.598035+0000","last_fullsized":"2024-09-14T11:23:22.598035+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-14T11:23:22.597945+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-14T11:23:22.597945+0000","last_clean_scrub_stamp":"2024-09-14T11:23:22.597945+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:04.581022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":61,"num_write":4,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"260'12","reported_seq":84,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:34.637055+0000","last_change":"2024-09-14T11:23:34.637055+0000","last_active":"2024-09-14T11:23:34.637055+0000","last_peered":"2024-09-14T11:23:34.637055+0000","last_clean":"2024-09-14T11:23:34.637055+0000","last_became_active":"2024-09-14T10:59:48.417001+0000","last_became_peered":"2024-09-14T10:59:48.417001+0000","last_unstale":"2024-09-14T11:23:34.637055+0000","last_undegraded":"2024-09-14T11:23:34.637055+0000","last_fullsized":"2024-09-14T11:23:34.637055+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'12","last_scrub_stamp":"2024-09-14T11:23:34.636971+0000","last_deep_scrub":"260'12","last_deep_scrub_stamp":"2024-09-14T11:23:34.636971+0000","last_clean_scrub_stamp":"2024-09-14T11:23:34.636971+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:10.187396+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":70,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:37.322794+0000","last_change":"2024-09-14T11:23:37.322794+0000","last_active":"2024-09-14T11:23:37.322794+0000","last_peered":"2024-09-14T11:23:37.322794+0000","last_clean":"2024-09-14T11:23:37.322794+0000","last_became_active":"2024-09-14T11:11:42.593873+0000","last_became_peered":"2024-09-14T11:11:42.593873+0000","last_unstale":"2024-09-14T11:23:37.322794+0000","last_undegraded":"2024-09-14T11:23:37.322794+0000","last_fullsized":"2024-09-14T11:23:37.322794+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:37.322693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:37.322693+0000","last_clean_scrub_stamp":"2024-09-14T11:23:37.322693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:39.923521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":36,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:42.910036+0000","last_change":"2024-09-14T11:23:42.910036+0000","last_active":"2024-09-14T11:23:42.910036+0000","last_peered":"2024-09-14T11:23:42.910036+0000","last_clean":"2024-09-14T11:23:42.910036+0000","last_became_active":"2024-09-14T11:01:23.897154+0000","last_became_peered":"2024-09-14T11:01:23.897154+0000","last_unstale":"2024-09-14T11:23:42.910036+0000","last_undegraded":"2024-09-14T11:23:42.910036+0000","last_fullsized":"2024-09-14T11:23:42.910036+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:42.909945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:42.909945+0000","last_clean_scrub_stamp":"2024-09-14T11:23:42.909945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:00:24.409515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"260'2","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:33.842422+0000","last_change":"2024-09-14T11:23:33.842422+0000","last_active":"2024-09-14T11:23:33.842422+0000","last_peered":"2024-09-14T11:23:33.842422+0000","last_clean":"2024-09-14T11:23:33.842422+0000","last_became_active":"2024-09-14T11:01:20.868135+0000","last_became_peered":"2024-09-14T11:01:20.868135+0000","last_unstale":"2024-09-14T11:23:33.842422+0000","last_undegraded":"2024-09-14T11:23:33.842422+0000","last_fullsized":"2024-09-14T11:23:33.842422+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:23:33.842335+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:23:33.842335+0000","last_clean_scrub_stamp":"2024-09-14T11:23:33.842335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:46.268446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"260'27","reported_seq":121,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:28.800888+0000","last_change":"2024-09-14T11:23:28.800888+0000","last_active":"2024-09-14T11:23:28.800888+0000","last_peered":"2024-09-14T11:23:28.800888+0000","last_clean":"2024-09-14T11:23:28.800888+0000","last_became_active":"2024-09-14T10:59:48.415324+0000","last_became_peered":"2024-09-14T10:59:48.415324+0000","last_unstale":"2024-09-14T11:23:28.800888+0000","last_undegraded":"2024-09-14T11:23:28.800888+0000","last_fullsized":"2024-09-14T11:23:28.800888+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'27","last_scrub_stamp":"2024-09-14T11:23:28.800763+0000","last_deep_scrub":"260'27","last_deep_scrub_stamp":"2024-09-14T11:23:28.800763+0000","last_clean_scrub_stamp":"2024-09-14T11:23:28.800763+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:44.358336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":136,"num_write":70,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:32.551128+0000","last_change":"2024-09-14T11:23:32.551128+0000","last_active":"2024-09-14T11:23:32.551128+0000","last_peered":"2024-09-14T11:23:32.551128+0000","last_clean":"2024-09-14T11:23:32.551128+0000","last_became_active":"2024-09-14T11:11:42.591815+0000","last_became_peered":"2024-09-14T11:11:42.591815+0000","last_unstale":"2024-09-14T11:23:32.551128+0000","last_undegraded":"2024-09-14T11:23:32.551128+0000","last_fullsized":"2024-09-14T11:23:32.551128+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:32.551039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:32.551039+0000","last_clean_scrub_stamp":"2024-09-14T11:23:32.551039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:29.945074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"260'3","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:26.541198+0000","last_change":"2024-09-14T11:23:26.541198+0000","last_active":"2024-09-14T11:23:26.541198+0000","last_peered":"2024-09-14T11:23:26.541198+0000","last_clean":"2024-09-14T11:23:26.541198+0000","last_became_active":"2024-09-14T11:01:23.883763+0000","last_became_peered":"2024-09-14T11:01:23.883763+0000","last_unstale":"2024-09-14T11:23:26.541198+0000","last_undegraded":"2024-09-14T11:23:26.541198+0000","last_fullsized":"2024-09-14T11:23:26.541198+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T11:23:26.541105+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T11:23:26.541105+0000","last_clean_scrub_stamp":"2024-09-14T11:23:26.541105+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:04.376193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"260'5","reported_seq":52,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:38.651718+0000","last_change":"2024-09-14T11:23:38.651718+0000","last_active":"2024-09-14T11:23:38.651718+0000","last_peered":"2024-09-14T11:23:38.651718+0000","last_clean":"2024-09-14T11:23:38.651718+0000","last_became_active":"2024-09-14T11:01:20.866642+0000","last_became_peered":"2024-09-14T11:01:20.866642+0000","last_unstale":"2024-09-14T11:23:38.651718+0000","last_undegraded":"2024-09-14T11:23:38.651718+0000","last_fullsized":"2024-09-14T11:23:38.651718+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-14T11:23:38.651598+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-14T11:23:38.651598+0000","last_clean_scrub_stamp":"2024-09-14T11:23:38.651598+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:18.402367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":13312,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"260'32","reported_seq":136,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:49.325993+0000","last_change":"2024-09-14T11:23:49.325993+0000","last_active":"2024-09-14T11:23:49.325993+0000","last_peered":"2024-09-14T11:23:49.325993+0000","last_clean":"2024-09-14T11:23:49.325993+0000","last_became_active":"2024-09-14T10:59:48.418305+0000","last_became_peered":"2024-09-14T10:59:48.418305+0000","last_unstale":"2024-09-14T11:23:49.325993+0000","last_undegraded":"2024-09-14T11:23:49.325993+0000","last_fullsized":"2024-09-14T11:23:49.325993+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'32","last_scrub_stamp":"2024-09-14T11:23:49.325858+0000","last_deep_scrub":"260'32","last_deep_scrub_stamp":"2024-09-14T11:23:49.325858+0000","last_clean_scrub_stamp":"2024-09-14T11:23:49.325858+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:19:40.091519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":251,"num_read_kb":158,"num_write":84,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:54.636642+0000","last_change":"2024-09-14T11:23:54.636642+0000","last_active":"2024-09-14T11:23:54.636642+0000","last_peered":"2024-09-14T11:23:54.636642+0000","last_clean":"2024-09-14T11:23:54.636642+0000","last_became_active":"2024-09-14T11:11:42.588573+0000","last_became_peered":"2024-09-14T11:11:42.588573+0000","last_unstale":"2024-09-14T11:23:54.636642+0000","last_undegraded":"2024-09-14T11:23:54.636642+0000","last_fullsized":"2024-09-14T11:23:54.636642+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:54.636541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:54.636541+0000","last_clean_scrub_stamp":"2024-09-14T11:23:54.636541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:13.077906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":36,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:44.640871+0000","last_change":"2024-09-14T11:23:44.640871+0000","last_active":"2024-09-14T11:23:44.640871+0000","last_peered":"2024-09-14T11:23:44.640871+0000","last_clean":"2024-09-14T11:23:44.640871+0000","last_became_active":"2024-09-14T11:01:23.894751+0000","last_became_peered":"2024-09-14T11:01:23.894751+0000","last_unstale":"2024-09-14T11:23:44.640871+0000","last_undegraded":"2024-09-14T11:23:44.640871+0000","last_fullsized":"2024-09-14T11:23:44.640871+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:44.640775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:44.640775+0000","last_clean_scrub_stamp":"2024-09-14T11:23:44.640775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:15.919564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:28.499763+0000","last_change":"2024-09-14T11:23:28.499763+0000","last_active":"2024-09-14T11:23:28.499763+0000","last_peered":"2024-09-14T11:23:28.499763+0000","last_clean":"2024-09-14T11:23:28.499763+0000","last_became_active":"2024-09-14T11:01:20.866975+0000","last_became_peered":"2024-09-14T11:01:20.866975+0000","last_unstale":"2024-09-14T11:23:28.499763+0000","last_undegraded":"2024-09-14T11:23:28.499763+0000","last_fullsized":"2024-09-14T11:23:28.499763+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:28.499680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:28.499680+0000","last_clean_scrub_stamp":"2024-09-14T11:23:28.499680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:14.266221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"260'17","reported_seq":91,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:47.328072+0000","last_change":"2024-09-14T11:23:47.328072+0000","last_active":"2024-09-14T11:23:47.328072+0000","last_peered":"2024-09-14T11:23:47.328072+0000","last_clean":"2024-09-14T11:23:47.328072+0000","last_became_active":"2024-09-14T10:59:48.420711+0000","last_became_peered":"2024-09-14T10:59:48.420711+0000","last_unstale":"2024-09-14T11:23:47.328072+0000","last_undegraded":"2024-09-14T11:23:47.328072+0000","last_fullsized":"2024-09-14T11:23:47.328072+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'17","last_scrub_stamp":"2024-09-14T11:23:47.327953+0000","last_deep_scrub":"260'17","last_deep_scrub_stamp":"2024-09-14T11:23:47.327953+0000","last_clean_scrub_stamp":"2024-09-14T11:23:47.327953+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:04:46.458061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":78,"num_write":43,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:38.299232+0000","last_change":"2024-09-14T11:23:38.299155+0000","last_active":"2024-09-14T11:23:38.299232+0000","last_peered":"2024-09-14T11:23:38.299232+0000","last_clean":"2024-09-14T11:23:38.299232+0000","last_became_active":"2024-09-14T11:11:42.583965+0000","last_became_peered":"2024-09-14T11:11:42.583965+0000","last_unstale":"2024-09-14T11:23:38.299232+0000","last_undegraded":"2024-09-14T11:23:38.299232+0000","last_fullsized":"2024-09-14T11:23:38.299232+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:38.299035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:38.299035+0000","last_clean_scrub_stamp":"2024-09-14T11:23:38.299035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:08.765002+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"257'5","reported_seq":51,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:42.630157+0000","last_change":"2024-09-14T11:23:42.630157+0000","last_active":"2024-09-14T11:23:42.630157+0000","last_peered":"2024-09-14T11:23:42.630157+0000","last_clean":"2024-09-14T11:23:42.630157+0000","last_became_active":"2024-09-14T11:01:23.893365+0000","last_became_peered":"2024-09-14T11:01:23.893365+0000","last_unstale":"2024-09-14T11:23:42.630157+0000","last_undegraded":"2024-09-14T11:23:42.630157+0000","last_fullsized":"2024-09-14T11:23:42.630157+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'5","last_scrub_stamp":"2024-09-14T11:23:42.630036+0000","last_deep_scrub":"257'5","last_deep_scrub_stamp":"2024-09-14T11:23:42.630036+0000","last_clean_scrub_stamp":"2024-09-14T11:23:42.630036+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:40.544674+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"260'3","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:37.650095+0000","last_change":"2024-09-14T11:23:37.650095+0000","last_active":"2024-09-14T11:23:37.650095+0000","last_peered":"2024-09-14T11:23:37.650095+0000","last_clean":"2024-09-14T11:23:37.650095+0000","last_became_active":"2024-09-14T11:01:20.869209+0000","last_became_peered":"2024-09-14T11:01:20.869209+0000","last_unstale":"2024-09-14T11:23:37.650095+0000","last_undegraded":"2024-09-14T11:23:37.650095+0000","last_fullsized":"2024-09-14T11:23:37.650095+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T11:23:37.649997+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T11:23:37.649997+0000","last_clean_scrub_stamp":"2024-09-14T11:23:37.649997+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:01:53.309609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"260'35","reported_seq":145,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:25.748484+0000","last_change":"2024-09-14T11:23:25.748484+0000","last_active":"2024-09-14T11:23:25.748484+0000","last_peered":"2024-09-14T11:23:25.748484+0000","last_clean":"2024-09-14T11:23:25.748484+0000","last_became_active":"2024-09-14T10:59:48.416149+0000","last_became_peered":"2024-09-14T10:59:48.416149+0000","last_unstale":"2024-09-14T11:23:25.748484+0000","last_undegraded":"2024-09-14T11:23:25.748484+0000","last_fullsized":"2024-09-14T11:23:25.748484+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'35","last_scrub_stamp":"2024-09-14T11:23:25.748399+0000","last_deep_scrub":"260'35","last_deep_scrub_stamp":"2024-09-14T11:23:25.748399+0000","last_clean_scrub_stamp":"2024-09-14T11:23:25.748399+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:42.195292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":285,"num_read_kb":193,"num_write":82,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"260'2","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:41.620661+0000","last_change":"2024-09-14T11:23:41.620661+0000","last_active":"2024-09-14T11:23:41.620661+0000","last_peered":"2024-09-14T11:23:41.620661+0000","last_clean":"2024-09-14T11:23:41.620661+0000","last_became_active":"2024-09-14T11:11:42.583477+0000","last_became_peered":"2024-09-14T11:11:42.583477+0000","last_unstale":"2024-09-14T11:23:41.620661+0000","last_undegraded":"2024-09-14T11:23:41.620661+0000","last_fullsized":"2024-09-14T11:23:41.620661+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:23:41.620559+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:23:41.620559+0000","last_clean_scrub_stamp":"2024-09-14T11:23:41.620559+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:21.095844+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"260'8","reported_seq":53,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:41.883597+0000","last_change":"2024-09-14T11:23:41.883597+0000","last_active":"2024-09-14T11:23:41.883597+0000","last_peered":"2024-09-14T11:23:41.883597+0000","last_clean":"2024-09-14T11:23:41.883597+0000","last_became_active":"2024-09-14T11:01:23.891343+0000","last_became_peered":"2024-09-14T11:01:23.891343+0000","last_unstale":"2024-09-14T11:23:41.883597+0000","last_undegraded":"2024-09-14T11:23:41.883597+0000","last_fullsized":"2024-09-14T11:23:41.883597+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'8","last_scrub_stamp":"2024-09-14T11:23:41.883510+0000","last_deep_scrub":"260'8","last_deep_scrub_stamp":"2024-09-14T11:23:41.883510+0000","last_clean_scrub_stamp":"2024-09-14T11:23:41.883510+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:39:42.260527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":15362,"num_write":13,"num_write_kb":10242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"260'3","reported_seq":47,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:29.500998+0000","last_change":"2024-09-14T11:23:29.500998+0000","last_active":"2024-09-14T11:23:29.500998+0000","last_peered":"2024-09-14T11:23:29.500998+0000","last_clean":"2024-09-14T11:23:29.500998+0000","last_became_active":"2024-09-14T11:01:20.861817+0000","last_became_peered":"2024-09-14T11:01:20.861817+0000","last_unstale":"2024-09-14T11:23:29.500998+0000","last_undegraded":"2024-09-14T11:23:29.500998+0000","last_fullsized":"2024-09-14T11:23:29.500998+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T11:23:29.500892+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T11:23:29.500892+0000","last_clean_scrub_stamp":"2024-09-14T11:23:29.500892+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:56:46.263750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"260'106","reported_seq":370,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:30.287346+0000","last_change":"2024-09-14T11:23:30.287346+0000","last_active":"2024-09-14T11:23:30.287346+0000","last_peered":"2024-09-14T11:23:30.287346+0000","last_clean":"2024-09-14T11:23:30.287346+0000","last_became_active":"2024-09-14T10:59:48.418011+0000","last_became_peered":"2024-09-14T10:59:48.418011+0000","last_unstale":"2024-09-14T11:23:30.287346+0000","last_undegraded":"2024-09-14T11:23:30.287346+0000","last_fullsized":"2024-09-14T11:23:30.287346+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'106","last_scrub_stamp":"2024-09-14T11:23:30.287247+0000","last_deep_scrub":"260'106","last_deep_scrub_stamp":"2024-09-14T11:23:30.287247+0000","last_clean_scrub_stamp":"2024-09-14T11:23:30.287247+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:42.685812+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1045,"num_read_kb":858,"num_write":220,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"260'2","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:37.295373+0000","last_change":"2024-09-14T11:23:37.295307+0000","last_active":"2024-09-14T11:23:37.295373+0000","last_peered":"2024-09-14T11:23:37.295373+0000","last_clean":"2024-09-14T11:23:37.295373+0000","last_became_active":"2024-09-14T11:11:42.580611+0000","last_became_peered":"2024-09-14T11:11:42.580611+0000","last_unstale":"2024-09-14T11:23:37.295373+0000","last_undegraded":"2024-09-14T11:23:37.295373+0000","last_fullsized":"2024-09-14T11:23:37.295373+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:23:37.295213+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:23:37.295213+0000","last_clean_scrub_stamp":"2024-09-14T11:23:37.295213+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:59.398297+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:07.117668+0000","last_change":"2024-09-14T11:01:23.886701+0000","last_active":"2024-09-14T11:20:07.117668+0000","last_peered":"2024-09-14T11:20:07.117668+0000","last_clean":"2024-09-14T11:20:07.117668+0000","last_became_active":"2024-09-14T11:01:23.886496+0000","last_became_peered":"2024-09-14T11:01:23.886496+0000","last_unstale":"2024-09-14T11:20:07.117668+0000","last_undegraded":"2024-09-14T11:20:07.117668+0000","last_fullsized":"2024-09-14T11:20:07.117668+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:46.277781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"257'3","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:30.486327+0000","last_change":"2024-09-14T11:23:30.486327+0000","last_active":"2024-09-14T11:23:30.486327+0000","last_peered":"2024-09-14T11:23:30.486327+0000","last_clean":"2024-09-14T11:23:30.486327+0000","last_became_active":"2024-09-14T11:01:20.863707+0000","last_became_peered":"2024-09-14T11:01:20.863707+0000","last_unstale":"2024-09-14T11:23:30.486327+0000","last_undegraded":"2024-09-14T11:23:30.486327+0000","last_fullsized":"2024-09-14T11:23:30.486327+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'3","last_scrub_stamp":"2024-09-14T11:23:30.486239+0000","last_deep_scrub":"257'3","last_deep_scrub_stamp":"2024-09-14T11:23:30.486239+0000","last_clean_scrub_stamp":"2024-09-14T11:23:30.486239+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:12.831780+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"260'54","reported_seq":199,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:31.762730+0000","last_change":"2024-09-14T11:23:31.762730+0000","last_active":"2024-09-14T11:23:31.762730+0000","last_peered":"2024-09-14T11:23:31.762730+0000","last_clean":"2024-09-14T11:23:31.762730+0000","last_became_active":"2024-09-14T10:59:48.421875+0000","last_became_peered":"2024-09-14T10:59:48.421875+0000","last_unstale":"2024-09-14T11:23:31.762730+0000","last_undegraded":"2024-09-14T11:23:31.762730+0000","last_fullsized":"2024-09-14T11:23:31.762730+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'54","last_scrub_stamp":"2024-09-14T11:23:31.762641+0000","last_deep_scrub":"260'54","last_deep_scrub_stamp":"2024-09-14T11:23:31.762641+0000","last_clean_scrub_stamp":"2024-09-14T11:23:31.762641+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:50.111431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":456,"num_read_kb":308,"num_write":139,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:51.663675+0000","last_change":"2024-09-14T11:23:51.663675+0000","last_active":"2024-09-14T11:23:51.663675+0000","last_peered":"2024-09-14T11:23:51.663675+0000","last_clean":"2024-09-14T11:23:51.663675+0000","last_became_active":"2024-09-14T11:11:42.590056+0000","last_became_peered":"2024-09-14T11:11:42.590056+0000","last_unstale":"2024-09-14T11:23:51.663675+0000","last_undegraded":"2024-09-14T11:23:51.663675+0000","last_fullsized":"2024-09-14T11:23:51.663675+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:51.663593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:51.663593+0000","last_clean_scrub_stamp":"2024-09-14T11:23:51.663593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:26.893565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"260'2","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:39.868241+0000","last_change":"2024-09-14T11:23:39.868167+0000","last_active":"2024-09-14T11:23:39.868241+0000","last_peered":"2024-09-14T11:23:39.868241+0000","last_clean":"2024-09-14T11:23:39.868241+0000","last_became_active":"2024-09-14T11:01:23.891331+0000","last_became_peered":"2024-09-14T11:01:23.891331+0000","last_unstale":"2024-09-14T11:23:39.868241+0000","last_undegraded":"2024-09-14T11:23:39.868241+0000","last_fullsized":"2024-09-14T11:23:39.868241+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:23:39.868078+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:23:39.868078+0000","last_clean_scrub_stamp":"2024-09-14T11:23:39.868078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:31.820742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:29.268150+0000","last_change":"2024-09-14T11:23:29.268097+0000","last_active":"2024-09-14T11:23:29.268150+0000","last_peered":"2024-09-14T11:23:29.268150+0000","last_clean":"2024-09-14T11:23:29.268150+0000","last_became_active":"2024-09-14T11:01:20.863144+0000","last_became_peered":"2024-09-14T11:01:20.863144+0000","last_unstale":"2024-09-14T11:23:29.268150+0000","last_undegraded":"2024-09-14T11:23:29.268150+0000","last_fullsized":"2024-09-14T11:23:29.268150+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:29.268016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:29.268016+0000","last_clean_scrub_stamp":"2024-09-14T11:23:29.268016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:08.406619+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"260'19","reported_seq":99,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:26.783961+0000","last_change":"2024-09-14T11:23:26.783961+0000","last_active":"2024-09-14T11:23:26.783961+0000","last_peered":"2024-09-14T11:23:26.783961+0000","last_clean":"2024-09-14T11:23:26.783961+0000","last_became_active":"2024-09-14T10:59:48.416902+0000","last_became_peered":"2024-09-14T10:59:48.416902+0000","last_unstale":"2024-09-14T11:23:26.783961+0000","last_undegraded":"2024-09-14T11:23:26.783961+0000","last_fullsized":"2024-09-14T11:23:26.783961+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'19","last_scrub_stamp":"2024-09-14T11:23:26.783854+0000","last_deep_scrub":"260'19","last_deep_scrub_stamp":"2024-09-14T11:23:26.783854+0000","last_clean_scrub_stamp":"2024-09-14T11:23:26.783854+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:07:29.823839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":98,"num_write":49,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:34.568936+0000","last_change":"2024-09-14T11:23:34.568936+0000","last_active":"2024-09-14T11:23:34.568936+0000","last_peered":"2024-09-14T11:23:34.568936+0000","last_clean":"2024-09-14T11:23:34.568936+0000","last_became_active":"2024-09-14T11:11:42.589071+0000","last_became_peered":"2024-09-14T11:11:42.589071+0000","last_unstale":"2024-09-14T11:23:34.568936+0000","last_undegraded":"2024-09-14T11:23:34.568936+0000","last_fullsized":"2024-09-14T11:23:34.568936+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:34.568817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:34.568817+0000","last_clean_scrub_stamp":"2024-09-14T11:23:34.568817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:22.227509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":37,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:37.860430+0000","last_change":"2024-09-14T11:23:37.860373+0000","last_active":"2024-09-14T11:23:37.860430+0000","last_peered":"2024-09-14T11:23:37.860430+0000","last_clean":"2024-09-14T11:23:37.860430+0000","last_became_active":"2024-09-14T11:01:23.892761+0000","last_became_peered":"2024-09-14T11:01:23.892761+0000","last_unstale":"2024-09-14T11:23:37.860430+0000","last_undegraded":"2024-09-14T11:23:37.860430+0000","last_fullsized":"2024-09-14T11:23:37.860430+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:37.860264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:37.860264+0000","last_clean_scrub_stamp":"2024-09-14T11:23:37.860264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:01.452013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:34.247128+0000","last_change":"2024-09-14T11:23:34.247044+0000","last_active":"2024-09-14T11:23:34.247128+0000","last_peered":"2024-09-14T11:23:34.247128+0000","last_clean":"2024-09-14T11:23:34.247128+0000","last_became_active":"2024-09-14T11:01:20.866224+0000","last_became_peered":"2024-09-14T11:01:20.866224+0000","last_unstale":"2024-09-14T11:23:34.247128+0000","last_undegraded":"2024-09-14T11:23:34.247128+0000","last_fullsized":"2024-09-14T11:23:34.247128+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:34.246933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:34.246933+0000","last_clean_scrub_stamp":"2024-09-14T11:23:34.246933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:33.947768+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"260'30","reported_seq":130,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:48.281818+0000","last_change":"2024-09-14T11:23:48.281818+0000","last_active":"2024-09-14T11:23:48.281818+0000","last_peered":"2024-09-14T11:23:48.281818+0000","last_clean":"2024-09-14T11:23:48.281818+0000","last_became_active":"2024-09-14T10:59:48.415922+0000","last_became_peered":"2024-09-14T10:59:48.415922+0000","last_unstale":"2024-09-14T11:23:48.281818+0000","last_undegraded":"2024-09-14T11:23:48.281818+0000","last_fullsized":"2024-09-14T11:23:48.281818+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'30","last_scrub_stamp":"2024-09-14T11:23:48.281713+0000","last_deep_scrub":"260'30","last_deep_scrub_stamp":"2024-09-14T11:23:48.281713+0000","last_clean_scrub_stamp":"2024-09-14T11:23:48.281713+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:09:10.677790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":240,"num_read_kb":165,"num_write":74,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:22.119393+0000","last_change":"2024-09-14T11:11:42.591303+0000","last_active":"2024-09-14T11:20:22.119393+0000","last_peered":"2024-09-14T11:20:22.119393+0000","last_clean":"2024-09-14T11:20:22.119393+0000","last_became_active":"2024-09-14T11:11:42.589881+0000","last_became_peered":"2024-09-14T11:11:42.589881+0000","last_unstale":"2024-09-14T11:20:22.119393+0000","last_undegraded":"2024-09-14T11:20:22.119393+0000","last_fullsized":"2024-09-14T11:20:22.119393+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:53.799897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"257'8","reported_seq":53,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:38.824603+0000","last_change":"2024-09-14T11:23:38.824603+0000","last_active":"2024-09-14T11:23:38.824603+0000","last_peered":"2024-09-14T11:23:38.824603+0000","last_clean":"2024-09-14T11:23:38.824603+0000","last_became_active":"2024-09-14T11:01:23.897158+0000","last_became_peered":"2024-09-14T11:01:23.897158+0000","last_unstale":"2024-09-14T11:23:38.824603+0000","last_undegraded":"2024-09-14T11:23:38.824603+0000","last_fullsized":"2024-09-14T11:23:38.824603+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'8","last_scrub_stamp":"2024-09-14T11:23:38.824508+0000","last_deep_scrub":"257'8","last_deep_scrub_stamp":"2024-09-14T11:23:38.824508+0000","last_clean_scrub_stamp":"2024-09-14T11:23:38.824508+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:58.417987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6146,"num_write":18,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:32.793284+0000","last_change":"2024-09-14T11:23:32.793230+0000","last_active":"2024-09-14T11:23:32.793284+0000","last_peered":"2024-09-14T11:23:32.793284+0000","last_clean":"2024-09-14T11:23:32.793284+0000","last_became_active":"2024-09-14T11:01:20.863999+0000","last_became_peered":"2024-09-14T11:01:20.863999+0000","last_unstale":"2024-09-14T11:23:32.793284+0000","last_undegraded":"2024-09-14T11:23:32.793284+0000","last_fullsized":"2024-09-14T11:23:32.793284+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:32.793147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:32.793147+0000","last_clean_scrub_stamp":"2024-09-14T11:23:32.793147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:56.481901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"260'46","reported_seq":167,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:26.533025+0000","last_change":"2024-09-14T11:23:26.533025+0000","last_active":"2024-09-14T11:23:26.533025+0000","last_peered":"2024-09-14T11:23:26.533025+0000","last_clean":"2024-09-14T11:23:26.533025+0000","last_became_active":"2024-09-14T10:59:48.418276+0000","last_became_peered":"2024-09-14T10:59:48.418276+0000","last_unstale":"2024-09-14T11:23:26.533025+0000","last_undegraded":"2024-09-14T11:23:26.533025+0000","last_fullsized":"2024-09-14T11:23:26.533025+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'46","last_scrub_stamp":"2024-09-14T11:23:26.532942+0000","last_deep_scrub":"260'46","last_deep_scrub_stamp":"2024-09-14T11:23:26.532942+0000","last_clean_scrub_stamp":"2024-09-14T11:23:26.532942+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:21.614848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":345,"num_read_kb":231,"num_write":118,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:33.554050+0000","last_change":"2024-09-14T11:23:33.554050+0000","last_active":"2024-09-14T11:23:33.554050+0000","last_peered":"2024-09-14T11:23:33.554050+0000","last_clean":"2024-09-14T11:23:33.554050+0000","last_became_active":"2024-09-14T11:11:42.586852+0000","last_became_peered":"2024-09-14T11:11:42.586852+0000","last_unstale":"2024-09-14T11:23:33.554050+0000","last_undegraded":"2024-09-14T11:23:33.554050+0000","last_fullsized":"2024-09-14T11:23:33.554050+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:33.553963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:33.553963+0000","last_clean_scrub_stamp":"2024-09-14T11:23:33.553963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:45.000426+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"257'3","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:41.612280+0000","last_change":"2024-09-14T11:23:41.612222+0000","last_active":"2024-09-14T11:23:41.612280+0000","last_peered":"2024-09-14T11:23:41.612280+0000","last_clean":"2024-09-14T11:23:41.612280+0000","last_became_active":"2024-09-14T11:01:23.887167+0000","last_became_peered":"2024-09-14T11:01:23.887167+0000","last_unstale":"2024-09-14T11:23:41.612280+0000","last_undegraded":"2024-09-14T11:23:41.612280+0000","last_fullsized":"2024-09-14T11:23:41.612280+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'3","last_scrub_stamp":"2024-09-14T11:23:41.612123+0000","last_deep_scrub":"257'3","last_deep_scrub_stamp":"2024-09-14T11:23:41.612123+0000","last_clean_scrub_stamp":"2024-09-14T11:23:41.612123+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:03.854131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"260'6","reported_seq":53,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:34.820097+0000","last_change":"2024-09-14T11:23:34.820025+0000","last_active":"2024-09-14T11:23:34.820097+0000","last_peered":"2024-09-14T11:23:34.820097+0000","last_clean":"2024-09-14T11:23:34.820097+0000","last_became_active":"2024-09-14T11:01:20.857645+0000","last_became_peered":"2024-09-14T11:01:20.857645+0000","last_unstale":"2024-09-14T11:23:34.820097+0000","last_undegraded":"2024-09-14T11:23:34.820097+0000","last_fullsized":"2024-09-14T11:23:34.820097+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-14T11:23:34.819943+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-14T11:23:34.819943+0000","last_clean_scrub_stamp":"2024-09-14T11:23:34.819943+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:11.438379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"260'22","reported_seq":109,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:27.230474+0000","last_change":"2024-09-14T11:23:27.230474+0000","last_active":"2024-09-14T11:23:27.230474+0000","last_peered":"2024-09-14T11:23:27.230474+0000","last_clean":"2024-09-14T11:23:27.230474+0000","last_became_active":"2024-09-14T10:59:48.413425+0000","last_became_peered":"2024-09-14T10:59:48.413425+0000","last_unstale":"2024-09-14T11:23:27.230474+0000","last_undegraded":"2024-09-14T11:23:27.230474+0000","last_fullsized":"2024-09-14T11:23:27.230474+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'22","last_scrub_stamp":"2024-09-14T11:23:27.230391+0000","last_deep_scrub":"260'22","last_deep_scrub_stamp":"2024-09-14T11:23:27.230391+0000","last_clean_scrub_stamp":"2024-09-14T11:23:27.230391+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:16:44.679862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":100,"num_write":57,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:50.644175+0000","last_change":"2024-09-14T11:23:50.644175+0000","last_active":"2024-09-14T11:23:50.644175+0000","last_peered":"2024-09-14T11:23:50.644175+0000","last_clean":"2024-09-14T11:23:50.644175+0000","last_became_active":"2024-09-14T11:11:42.587906+0000","last_became_peered":"2024-09-14T11:11:42.587906+0000","last_unstale":"2024-09-14T11:23:50.644175+0000","last_undegraded":"2024-09-14T11:23:50.644175+0000","last_fullsized":"2024-09-14T11:23:50.644175+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:50.644067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:50.644067+0000","last_clean_scrub_stamp":"2024-09-14T11:23:50.644067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:16.580879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":29,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:57.125108+0000","last_change":"2024-09-14T11:01:23.891705+0000","last_active":"2024-09-14T11:20:57.125108+0000","last_peered":"2024-09-14T11:20:57.125108+0000","last_clean":"2024-09-14T11:20:57.125108+0000","last_became_active":"2024-09-14T11:01:23.891424+0000","last_became_peered":"2024-09-14T11:01:23.891424+0000","last_unstale":"2024-09-14T11:20:57.125108+0000","last_undegraded":"2024-09-14T11:20:57.125108+0000","last_fullsized":"2024-09-14T11:20:57.125108+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:01:22.859353+0000","last_clean_scrub_stamp":"2024-09-14T11:01:22.859353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"260'5","reported_seq":52,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:29.788739+0000","last_change":"2024-09-14T11:23:29.788739+0000","last_active":"2024-09-14T11:23:29.788739+0000","last_peered":"2024-09-14T11:23:29.788739+0000","last_clean":"2024-09-14T11:23:29.788739+0000","last_became_active":"2024-09-14T11:01:20.863936+0000","last_became_peered":"2024-09-14T11:01:20.863936+0000","last_unstale":"2024-09-14T11:23:29.788739+0000","last_undegraded":"2024-09-14T11:23:29.788739+0000","last_fullsized":"2024-09-14T11:23:29.788739+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-14T11:23:29.788622+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-14T11:23:29.788622+0000","last_clean_scrub_stamp":"2024-09-14T11:23:29.788622+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:05.759708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"260'14","reported_seq":88,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:26.275701+0000","last_change":"2024-09-14T11:23:26.275701+0000","last_active":"2024-09-14T11:23:26.275701+0000","last_peered":"2024-09-14T11:23:26.275701+0000","last_clean":"2024-09-14T11:23:26.275701+0000","last_became_active":"2024-09-14T10:59:48.413255+0000","last_became_peered":"2024-09-14T10:59:48.413255+0000","last_unstale":"2024-09-14T11:23:26.275701+0000","last_undegraded":"2024-09-14T11:23:26.275701+0000","last_fullsized":"2024-09-14T11:23:26.275701+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'14","last_scrub_stamp":"2024-09-14T11:23:26.275618+0000","last_deep_scrub":"260'14","last_deep_scrub_stamp":"2024-09-14T11:23:26.275618+0000","last_clean_scrub_stamp":"2024-09-14T11:23:26.275618+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:48.948088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":78,"num_write":38,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:34.334249+0000","last_change":"2024-09-14T11:23:34.334249+0000","last_active":"2024-09-14T11:23:34.334249+0000","last_peered":"2024-09-14T11:23:34.334249+0000","last_clean":"2024-09-14T11:23:34.334249+0000","last_became_active":"2024-09-14T11:11:42.588120+0000","last_became_peered":"2024-09-14T11:11:42.588120+0000","last_unstale":"2024-09-14T11:23:34.334249+0000","last_undegraded":"2024-09-14T11:23:34.334249+0000","last_fullsized":"2024-09-14T11:23:34.334249+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:34.334161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:34.334161+0000","last_clean_scrub_stamp":"2024-09-14T11:23:34.334161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:38.062050+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"257'3","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:35.381552+0000","last_change":"2024-09-14T11:23:35.381552+0000","last_active":"2024-09-14T11:23:35.381552+0000","last_peered":"2024-09-14T11:23:35.381552+0000","last_clean":"2024-09-14T11:23:35.381552+0000","last_became_active":"2024-09-14T11:01:23.888873+0000","last_became_peered":"2024-09-14T11:01:23.888873+0000","last_unstale":"2024-09-14T11:23:35.381552+0000","last_undegraded":"2024-09-14T11:23:35.381552+0000","last_fullsized":"2024-09-14T11:23:35.381552+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'3","last_scrub_stamp":"2024-09-14T11:23:35.381434+0000","last_deep_scrub":"257'3","last_deep_scrub_stamp":"2024-09-14T11:23:35.381434+0000","last_clean_scrub_stamp":"2024-09-14T11:23:35.381434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:46.609607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:36.602652+0000","last_change":"2024-09-14T11:23:36.602652+0000","last_active":"2024-09-14T11:23:36.602652+0000","last_peered":"2024-09-14T11:23:36.602652+0000","last_clean":"2024-09-14T11:23:36.602652+0000","last_became_active":"2024-09-14T11:01:20.865953+0000","last_became_peered":"2024-09-14T11:01:20.865953+0000","last_unstale":"2024-09-14T11:23:36.602652+0000","last_undegraded":"2024-09-14T11:23:36.602652+0000","last_fullsized":"2024-09-14T11:23:36.602652+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:36.602555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:36.602555+0000","last_clean_scrub_stamp":"2024-09-14T11:23:36.602555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:12.445976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"260'22","reported_seq":107,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:24.373765+0000","last_change":"2024-09-14T11:23:24.373706+0000","last_active":"2024-09-14T11:23:24.373765+0000","last_peered":"2024-09-14T11:23:24.373765+0000","last_clean":"2024-09-14T11:23:24.373765+0000","last_became_active":"2024-09-14T10:59:48.417013+0000","last_became_peered":"2024-09-14T10:59:48.417013+0000","last_unstale":"2024-09-14T11:23:24.373765+0000","last_undegraded":"2024-09-14T11:23:24.373765+0000","last_fullsized":"2024-09-14T11:23:24.373765+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'22","last_scrub_stamp":"2024-09-14T11:23:24.373610+0000","last_deep_scrub":"260'22","last_deep_scrub_stamp":"2024-09-14T11:23:24.373610+0000","last_clean_scrub_stamp":"2024-09-14T11:23:24.373610+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:40.881314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":110,"num_write":54,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"260'2","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:30.563204+0000","last_change":"2024-09-14T11:23:30.563204+0000","last_active":"2024-09-14T11:23:30.563204+0000","last_peered":"2024-09-14T11:23:30.563204+0000","last_clean":"2024-09-14T11:23:30.563204+0000","last_became_active":"2024-09-14T11:11:42.592514+0000","last_became_peered":"2024-09-14T11:11:42.592514+0000","last_unstale":"2024-09-14T11:23:30.563204+0000","last_undegraded":"2024-09-14T11:23:30.563204+0000","last_fullsized":"2024-09-14T11:23:30.563204+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:23:30.563111+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:23:30.563111+0000","last_clean_scrub_stamp":"2024-09-14T11:23:30.563111+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:30.285420+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":37,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:35.265407+0000","last_change":"2024-09-14T11:23:35.265320+0000","last_active":"2024-09-14T11:23:35.265407+0000","last_peered":"2024-09-14T11:23:35.265407+0000","last_clean":"2024-09-14T11:23:35.265407+0000","last_became_active":"2024-09-14T11:01:23.890356+0000","last_became_peered":"2024-09-14T11:01:23.890356+0000","last_unstale":"2024-09-14T11:23:35.265407+0000","last_undegraded":"2024-09-14T11:23:35.265407+0000","last_fullsized":"2024-09-14T11:23:35.265407+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:35.265205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:35.265205+0000","last_clean_scrub_stamp":"2024-09-14T11:23:35.265205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:35:30.326948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"257'3","reported_seq":49,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:30.753920+0000","last_change":"2024-09-14T11:23:30.753920+0000","last_active":"2024-09-14T11:23:30.753920+0000","last_peered":"2024-09-14T11:23:30.753920+0000","last_clean":"2024-09-14T11:23:30.753920+0000","last_became_active":"2024-09-14T11:01:20.859214+0000","last_became_peered":"2024-09-14T11:01:20.859214+0000","last_unstale":"2024-09-14T11:23:30.753920+0000","last_undegraded":"2024-09-14T11:23:30.753920+0000","last_fullsized":"2024-09-14T11:23:30.753920+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'3","last_scrub_stamp":"2024-09-14T11:23:30.753835+0000","last_deep_scrub":"257'3","last_deep_scrub_stamp":"2024-09-14T11:23:30.753835+0000","last_clean_scrub_stamp":"2024-09-14T11:23:30.753835+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:35.671869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"260'23","reported_seq":106,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:35.559452+0000","last_change":"2024-09-14T11:23:35.559378+0000","last_active":"2024-09-14T11:23:35.559452+0000","last_peered":"2024-09-14T11:23:35.559452+0000","last_clean":"2024-09-14T11:23:35.559452+0000","last_became_active":"2024-09-14T10:59:48.420353+0000","last_became_peered":"2024-09-14T10:59:48.420353+0000","last_unstale":"2024-09-14T11:23:35.559452+0000","last_undegraded":"2024-09-14T11:23:35.559452+0000","last_fullsized":"2024-09-14T11:23:35.559452+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'23","last_scrub_stamp":"2024-09-14T11:23:35.559300+0000","last_deep_scrub":"260'23","last_deep_scrub_stamp":"2024-09-14T11:23:35.559300+0000","last_clean_scrub_stamp":"2024-09-14T11:23:35.559300+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:57.843507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":102,"num_write":60,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:45.874032+0000","last_change":"2024-09-14T11:23:45.874032+0000","last_active":"2024-09-14T11:23:45.874032+0000","last_peered":"2024-09-14T11:23:45.874032+0000","last_clean":"2024-09-14T11:23:45.874032+0000","last_became_active":"2024-09-14T11:11:42.589134+0000","last_became_peered":"2024-09-14T11:11:42.589134+0000","last_unstale":"2024-09-14T11:23:45.874032+0000","last_undegraded":"2024-09-14T11:23:45.874032+0000","last_fullsized":"2024-09-14T11:23:45.874032+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:45.873944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:45.873944+0000","last_clean_scrub_stamp":"2024-09-14T11:23:45.873944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:34.505917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"260'2","reported_seq":40,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:25.502170+0000","last_change":"2024-09-14T11:23:25.502170+0000","last_active":"2024-09-14T11:23:25.502170+0000","last_peered":"2024-09-14T11:23:25.502170+0000","last_clean":"2024-09-14T11:23:25.502170+0000","last_became_active":"2024-09-14T11:01:23.890433+0000","last_became_peered":"2024-09-14T11:01:23.890433+0000","last_unstale":"2024-09-14T11:23:25.502170+0000","last_undegraded":"2024-09-14T11:23:25.502170+0000","last_fullsized":"2024-09-14T11:23:25.502170+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:23:25.502088+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:23:25.502088+0000","last_clean_scrub_stamp":"2024-09-14T11:23:25.502088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:14:40.764137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"257'3","reported_seq":49,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:53.292758+0000","last_change":"2024-09-14T11:23:53.292758+0000","last_active":"2024-09-14T11:23:53.292758+0000","last_peered":"2024-09-14T11:23:53.292758+0000","last_clean":"2024-09-14T11:23:53.292758+0000","last_became_active":"2024-09-14T11:01:20.858834+0000","last_became_peered":"2024-09-14T11:01:20.858834+0000","last_unstale":"2024-09-14T11:23:53.292758+0000","last_undegraded":"2024-09-14T11:23:53.292758+0000","last_fullsized":"2024-09-14T11:23:53.292758+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'3","last_scrub_stamp":"2024-09-14T11:23:53.292653+0000","last_deep_scrub":"257'3","last_deep_scrub_stamp":"2024-09-14T11:23:53.292653+0000","last_clean_scrub_stamp":"2024-09-14T11:23:53.292653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:24.192751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"260'31","reported_seq":137,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:21.642886+0000","last_change":"2024-09-14T11:23:21.642794+0000","last_active":"2024-09-14T11:23:21.642886+0000","last_peered":"2024-09-14T11:23:21.642886+0000","last_clean":"2024-09-14T11:23:21.642886+0000","last_became_active":"2024-09-14T10:59:48.414351+0000","last_became_peered":"2024-09-14T10:59:48.414351+0000","last_unstale":"2024-09-14T11:23:21.642886+0000","last_undegraded":"2024-09-14T11:23:21.642886+0000","last_fullsized":"2024-09-14T11:23:21.642886+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'31","last_scrub_stamp":"2024-09-14T11:23:21.642694+0000","last_deep_scrub":"260'31","last_deep_scrub_stamp":"2024-09-14T11:23:21.642694+0000","last_clean_scrub_stamp":"2024-09-14T11:23:21.642694+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:06.209703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":249,"num_read_kb":158,"num_write":78,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:28.531908+0000","last_change":"2024-09-14T11:23:28.531908+0000","last_active":"2024-09-14T11:23:28.531908+0000","last_peered":"2024-09-14T11:23:28.531908+0000","last_clean":"2024-09-14T11:23:28.531908+0000","last_became_active":"2024-09-14T11:11:42.587955+0000","last_became_peered":"2024-09-14T11:11:42.587955+0000","last_unstale":"2024-09-14T11:23:28.531908+0000","last_undegraded":"2024-09-14T11:23:28.531908+0000","last_fullsized":"2024-09-14T11:23:28.531908+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:28.531820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:28.531820+0000","last_clean_scrub_stamp":"2024-09-14T11:23:28.531820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:14.336755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"260'8","reported_seq":55,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:43.619145+0000","last_change":"2024-09-14T11:23:43.619145+0000","last_active":"2024-09-14T11:23:43.619145+0000","last_peered":"2024-09-14T11:23:43.619145+0000","last_clean":"2024-09-14T11:23:43.619145+0000","last_became_active":"2024-09-14T11:01:23.891239+0000","last_became_peered":"2024-09-14T11:01:23.891239+0000","last_unstale":"2024-09-14T11:23:43.619145+0000","last_undegraded":"2024-09-14T11:23:43.619145+0000","last_fullsized":"2024-09-14T11:23:43.619145+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'8","last_scrub_stamp":"2024-09-14T11:23:43.619054+0000","last_deep_scrub":"260'8","last_deep_scrub_stamp":"2024-09-14T11:23:43.619054+0000","last_clean_scrub_stamp":"2024-09-14T11:23:43.619054+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:33.510441+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20482,"num_write":18,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:51.301811+0000","last_change":"2024-09-14T11:23:51.301811+0000","last_active":"2024-09-14T11:23:51.301811+0000","last_peered":"2024-09-14T11:23:51.301811+0000","last_clean":"2024-09-14T11:23:51.301811+0000","last_became_active":"2024-09-14T11:01:20.866975+0000","last_became_peered":"2024-09-14T11:01:20.866975+0000","last_unstale":"2024-09-14T11:23:51.301811+0000","last_undegraded":"2024-09-14T11:23:51.301811+0000","last_fullsized":"2024-09-14T11:23:51.301811+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:51.301717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:51.301717+0000","last_clean_scrub_stamp":"2024-09-14T11:23:51.301717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:54:11.888281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"260'4","reported_seq":59,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:33.591701+0000","last_change":"2024-09-14T11:23:33.591627+0000","last_active":"2024-09-14T11:23:33.591701+0000","last_peered":"2024-09-14T11:23:33.591701+0000","last_clean":"2024-09-14T11:23:33.591701+0000","last_became_active":"2024-09-14T10:59:48.416741+0000","last_became_peered":"2024-09-14T10:59:48.416741+0000","last_unstale":"2024-09-14T11:23:33.591701+0000","last_undegraded":"2024-09-14T11:23:33.591701+0000","last_fullsized":"2024-09-14T11:23:33.591701+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-14T11:23:33.591548+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-14T11:23:33.591548+0000","last_clean_scrub_stamp":"2024-09-14T11:23:33.591548+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:47:20.251422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:29.517358+0000","last_change":"2024-09-14T11:23:29.517358+0000","last_active":"2024-09-14T11:23:29.517358+0000","last_peered":"2024-09-14T11:23:29.517358+0000","last_clean":"2024-09-14T11:23:29.517358+0000","last_became_active":"2024-09-14T11:11:42.582190+0000","last_became_peered":"2024-09-14T11:11:42.582190+0000","last_unstale":"2024-09-14T11:23:29.517358+0000","last_undegraded":"2024-09-14T11:23:29.517358+0000","last_fullsized":"2024-09-14T11:23:29.517358+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:29.517270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:29.517270+0000","last_clean_scrub_stamp":"2024-09-14T11:23:29.517270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:29:37.345510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"260'10","reported_seq":63,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:45.646153+0000","last_change":"2024-09-14T11:23:45.646153+0000","last_active":"2024-09-14T11:23:45.646153+0000","last_peered":"2024-09-14T11:23:45.646153+0000","last_clean":"2024-09-14T11:23:45.646153+0000","last_became_active":"2024-09-14T11:01:23.892344+0000","last_became_peered":"2024-09-14T11:01:23.892344+0000","last_unstale":"2024-09-14T11:23:45.646153+0000","last_undegraded":"2024-09-14T11:23:45.646153+0000","last_fullsized":"2024-09-14T11:23:45.646153+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'10","last_scrub_stamp":"2024-09-14T11:23:45.646032+0000","last_deep_scrub":"260'10","last_deep_scrub_stamp":"2024-09-14T11:23:45.646032+0000","last_clean_scrub_stamp":"2024-09-14T11:23:45.646032+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:46.075293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":30724,"num_write":15,"num_write_kb":10242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"260'2","reported_seq":46,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:38.657830+0000","last_change":"2024-09-14T11:23:38.657830+0000","last_active":"2024-09-14T11:23:38.657830+0000","last_peered":"2024-09-14T11:23:38.657830+0000","last_clean":"2024-09-14T11:23:38.657830+0000","last_became_active":"2024-09-14T11:01:20.863495+0000","last_became_peered":"2024-09-14T11:01:20.863495+0000","last_unstale":"2024-09-14T11:23:38.657830+0000","last_undegraded":"2024-09-14T11:23:38.657830+0000","last_fullsized":"2024-09-14T11:23:38.657830+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:23:38.657735+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:23:38.657735+0000","last_clean_scrub_stamp":"2024-09-14T11:23:38.657735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:20.926948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"260'32","reported_seq":129,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:46.325100+0000","last_change":"2024-09-14T11:23:46.325100+0000","last_active":"2024-09-14T11:23:46.325100+0000","last_peered":"2024-09-14T11:23:46.325100+0000","last_clean":"2024-09-14T11:23:46.325100+0000","last_became_active":"2024-09-14T10:59:48.416253+0000","last_became_peered":"2024-09-14T10:59:48.416253+0000","last_unstale":"2024-09-14T11:23:46.325100+0000","last_undegraded":"2024-09-14T11:23:46.325100+0000","last_fullsized":"2024-09-14T11:23:46.325100+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'32","last_scrub_stamp":"2024-09-14T11:23:46.325015+0000","last_deep_scrub":"260'32","last_deep_scrub_stamp":"2024-09-14T11:23:46.325015+0000","last_clean_scrub_stamp":"2024-09-14T11:23:46.325015+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:35.215321+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":142,"num_write":84,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:52.633255+0000","last_change":"2024-09-14T11:23:52.633255+0000","last_active":"2024-09-14T11:23:52.633255+0000","last_peered":"2024-09-14T11:23:52.633255+0000","last_clean":"2024-09-14T11:23:52.633255+0000","last_became_active":"2024-09-14T11:11:42.588988+0000","last_became_peered":"2024-09-14T11:11:42.588988+0000","last_unstale":"2024-09-14T11:23:52.633255+0000","last_undegraded":"2024-09-14T11:23:52.633255+0000","last_fullsized":"2024-09-14T11:23:52.633255+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:52.633169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:52.633169+0000","last_clean_scrub_stamp":"2024-09-14T11:23:52.633169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:31.702877+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"260'6","reported_seq":47,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:24.523185+0000","last_change":"2024-09-14T11:23:24.523185+0000","last_active":"2024-09-14T11:23:24.523185+0000","last_peered":"2024-09-14T11:23:24.523185+0000","last_clean":"2024-09-14T11:23:24.523185+0000","last_became_active":"2024-09-14T11:01:23.888845+0000","last_became_peered":"2024-09-14T11:01:23.888845+0000","last_unstale":"2024-09-14T11:23:24.523185+0000","last_undegraded":"2024-09-14T11:23:24.523185+0000","last_fullsized":"2024-09-14T11:23:24.523185+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-14T11:23:24.523101+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-14T11:23:24.523101+0000","last_clean_scrub_stamp":"2024-09-14T11:23:24.523101+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:53.052865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"257'10","reported_seq":69,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:31.296038+0000","last_change":"2024-09-14T11:23:31.296038+0000","last_active":"2024-09-14T11:23:31.296038+0000","last_peered":"2024-09-14T11:23:31.296038+0000","last_clean":"2024-09-14T11:23:31.296038+0000","last_became_active":"2024-09-14T11:01:20.865891+0000","last_became_peered":"2024-09-14T11:01:20.865891+0000","last_unstale":"2024-09-14T11:23:31.296038+0000","last_undegraded":"2024-09-14T11:23:31.296038+0000","last_fullsized":"2024-09-14T11:23:31.296038+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'10","last_scrub_stamp":"2024-09-14T11:23:31.295949+0000","last_deep_scrub":"257'10","last_deep_scrub_stamp":"2024-09-14T11:23:31.295949+0000","last_clean_scrub_stamp":"2024-09-14T11:23:31.295949+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:01.335383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":24580,"num_write":15,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"260'27","reported_seq":123,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:26.327151+0000","last_change":"2024-09-14T11:23:26.327151+0000","last_active":"2024-09-14T11:23:26.327151+0000","last_peered":"2024-09-14T11:23:26.327151+0000","last_clean":"2024-09-14T11:23:26.327151+0000","last_became_active":"2024-09-14T10:59:48.420845+0000","last_became_peered":"2024-09-14T10:59:48.420845+0000","last_unstale":"2024-09-14T11:23:26.327151+0000","last_undegraded":"2024-09-14T11:23:26.327151+0000","last_fullsized":"2024-09-14T11:23:26.327151+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'27","last_scrub_stamp":"2024-09-14T11:23:26.327053+0000","last_deep_scrub":"260'27","last_deep_scrub_stamp":"2024-09-14T11:23:26.327053+0000","last_clean_scrub_stamp":"2024-09-14T11:23:26.327053+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:11.867978+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":135,"num_write":77,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:02.116980+0000","last_change":"2024-09-14T11:11:42.592263+0000","last_active":"2024-09-14T11:20:02.116980+0000","last_peered":"2024-09-14T11:20:02.116980+0000","last_clean":"2024-09-14T11:20:02.116980+0000","last_became_active":"2024-09-14T11:11:42.591734+0000","last_became_peered":"2024-09-14T11:11:42.591734+0000","last_unstale":"2024-09-14T11:20:02.116980+0000","last_undegraded":"2024-09-14T11:20:02.116980+0000","last_fullsized":"2024-09-14T11:20:02.116980+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:48.663357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"260'3","reported_seq":40,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:56.243607+0000","last_change":"2024-09-14T11:23:56.243607+0000","last_active":"2024-09-14T11:23:56.243607+0000","last_peered":"2024-09-14T11:23:56.243607+0000","last_clean":"2024-09-14T11:23:56.243607+0000","last_became_active":"2024-09-14T11:01:23.894904+0000","last_became_peered":"2024-09-14T11:01:23.894904+0000","last_unstale":"2024-09-14T11:23:56.243607+0000","last_undegraded":"2024-09-14T11:23:56.243607+0000","last_fullsized":"2024-09-14T11:23:56.243607+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T11:23:56.243480+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T11:23:56.243480+0000","last_clean_scrub_stamp":"2024-09-14T11:23:56.243480+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:30.185738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:52.257308+0000","last_change":"2024-09-14T11:23:52.257308+0000","last_active":"2024-09-14T11:23:52.257308+0000","last_peered":"2024-09-14T11:23:52.257308+0000","last_clean":"2024-09-14T11:23:52.257308+0000","last_became_active":"2024-09-14T11:01:20.867675+0000","last_became_peered":"2024-09-14T11:01:20.867675+0000","last_unstale":"2024-09-14T11:23:52.257308+0000","last_undegraded":"2024-09-14T11:23:52.257308+0000","last_fullsized":"2024-09-14T11:23:52.257308+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:52.257221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:52.257221+0000","last_clean_scrub_stamp":"2024-09-14T11:23:52.257221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:12.109098+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"260'45","reported_seq":175,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:24.774146+0000","last_change":"2024-09-14T11:23:24.774146+0000","last_active":"2024-09-14T11:23:24.774146+0000","last_peered":"2024-09-14T11:23:24.774146+0000","last_clean":"2024-09-14T11:23:24.774146+0000","last_became_active":"2024-09-14T10:59:48.419276+0000","last_became_peered":"2024-09-14T10:59:48.419276+0000","last_unstale":"2024-09-14T11:23:24.774146+0000","last_undegraded":"2024-09-14T11:23:24.774146+0000","last_fullsized":"2024-09-14T11:23:24.774146+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'45","last_scrub_stamp":"2024-09-14T11:23:24.774030+0000","last_deep_scrub":"260'45","last_deep_scrub_stamp":"2024-09-14T11:23:24.774030+0000","last_clean_scrub_stamp":"2024-09-14T11:23:24.774030+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:06.668253+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":347,"num_read_kb":232,"num_write":118,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"260'2","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:44.854924+0000","last_change":"2024-09-14T11:23:44.854924+0000","last_active":"2024-09-14T11:23:44.854924+0000","last_peered":"2024-09-14T11:23:44.854924+0000","last_clean":"2024-09-14T11:23:44.854924+0000","last_became_active":"2024-09-14T11:11:42.585114+0000","last_became_peered":"2024-09-14T11:11:42.585114+0000","last_unstale":"2024-09-14T11:23:44.854924+0000","last_undegraded":"2024-09-14T11:23:44.854924+0000","last_fullsized":"2024-09-14T11:23:44.854924+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:23:44.854832+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:23:44.854832+0000","last_clean_scrub_stamp":"2024-09-14T11:23:44.854832+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:26.199257+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"260'2","reported_seq":40,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:39.649254+0000","last_change":"2024-09-14T11:23:39.649254+0000","last_active":"2024-09-14T11:23:39.649254+0000","last_peered":"2024-09-14T11:23:39.649254+0000","last_clean":"2024-09-14T11:23:39.649254+0000","last_became_active":"2024-09-14T11:01:23.894464+0000","last_became_peered":"2024-09-14T11:01:23.894464+0000","last_unstale":"2024-09-14T11:23:39.649254+0000","last_undegraded":"2024-09-14T11:23:39.649254+0000","last_fullsized":"2024-09-14T11:23:39.649254+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:23:39.649180+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:23:39.649180+0000","last_clean_scrub_stamp":"2024-09-14T11:23:39.649180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:10.704274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:32.299427+0000","last_change":"2024-09-14T11:23:32.299427+0000","last_active":"2024-09-14T11:23:32.299427+0000","last_peered":"2024-09-14T11:23:32.299427+0000","last_clean":"2024-09-14T11:23:32.299427+0000","last_became_active":"2024-09-14T11:01:20.869082+0000","last_became_peered":"2024-09-14T11:01:20.869082+0000","last_unstale":"2024-09-14T11:23:32.299427+0000","last_undegraded":"2024-09-14T11:23:32.299427+0000","last_fullsized":"2024-09-14T11:23:32.299427+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:32.299346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:32.299346+0000","last_clean_scrub_stamp":"2024-09-14T11:23:32.299346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:58:15.656102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"260'42","reported_seq":160,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:25.349156+0000","last_change":"2024-09-14T11:23:25.349156+0000","last_active":"2024-09-14T11:23:25.349156+0000","last_peered":"2024-09-14T11:23:25.349156+0000","last_clean":"2024-09-14T11:23:25.349156+0000","last_became_active":"2024-09-14T10:59:48.419753+0000","last_became_peered":"2024-09-14T10:59:48.419753+0000","last_unstale":"2024-09-14T11:23:25.349156+0000","last_undegraded":"2024-09-14T11:23:25.349156+0000","last_fullsized":"2024-09-14T11:23:25.349156+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'42","last_scrub_stamp":"2024-09-14T11:23:25.349073+0000","last_deep_scrub":"260'42","last_deep_scrub_stamp":"2024-09-14T11:23:25.349073+0000","last_clean_scrub_stamp":"2024-09-14T11:23:25.349073+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:09.768780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":323,"num_read_kb":218,"num_write":115,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:40.618270+0000","last_change":"2024-09-14T11:23:40.618270+0000","last_active":"2024-09-14T11:23:40.618270+0000","last_peered":"2024-09-14T11:23:40.618270+0000","last_clean":"2024-09-14T11:23:40.618270+0000","last_became_active":"2024-09-14T11:11:42.592960+0000","last_became_peered":"2024-09-14T11:11:42.592960+0000","last_unstale":"2024-09-14T11:23:40.618270+0000","last_undegraded":"2024-09-14T11:23:40.618270+0000","last_fullsized":"2024-09-14T11:23:40.618270+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:40.618157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:40.618157+0000","last_clean_scrub_stamp":"2024-09-14T11:23:40.618157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:39:37.762915+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"260'3","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:55.253601+0000","last_change":"2024-09-14T11:23:55.253601+0000","last_active":"2024-09-14T11:23:55.253601+0000","last_peered":"2024-09-14T11:23:55.253601+0000","last_clean":"2024-09-14T11:23:55.253601+0000","last_became_active":"2024-09-14T11:01:23.883464+0000","last_became_peered":"2024-09-14T11:01:23.883464+0000","last_unstale":"2024-09-14T11:23:55.253601+0000","last_undegraded":"2024-09-14T11:23:55.253601+0000","last_fullsized":"2024-09-14T11:23:55.253601+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T11:23:55.253501+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T11:23:55.253501+0000","last_clean_scrub_stamp":"2024-09-14T11:23:55.253501+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:26.748932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:50.308839+0000","last_change":"2024-09-14T11:23:50.308839+0000","last_active":"2024-09-14T11:23:50.308839+0000","last_peered":"2024-09-14T11:23:50.308839+0000","last_clean":"2024-09-14T11:23:50.308839+0000","last_became_active":"2024-09-14T11:01:20.858057+0000","last_became_peered":"2024-09-14T11:01:20.858057+0000","last_unstale":"2024-09-14T11:23:50.308839+0000","last_undegraded":"2024-09-14T11:23:50.308839+0000","last_fullsized":"2024-09-14T11:23:50.308839+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:50.308746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:50.308746+0000","last_clean_scrub_stamp":"2024-09-14T11:23:50.308746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:39.478771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"260'19","reported_seq":94,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:45.286689+0000","last_change":"2024-09-14T11:23:45.286689+0000","last_active":"2024-09-14T11:23:45.286689+0000","last_peered":"2024-09-14T11:23:45.286689+0000","last_clean":"2024-09-14T11:23:45.286689+0000","last_became_active":"2024-09-14T10:59:48.412832+0000","last_became_peered":"2024-09-14T10:59:48.412832+0000","last_unstale":"2024-09-14T11:23:45.286689+0000","last_undegraded":"2024-09-14T11:23:45.286689+0000","last_fullsized":"2024-09-14T11:23:45.286689+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'19","last_scrub_stamp":"2024-09-14T11:23:45.286560+0000","last_deep_scrub":"260'19","last_deep_scrub_stamp":"2024-09-14T11:23:45.286560+0000","last_clean_scrub_stamp":"2024-09-14T11:23:45.286560+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:21.438372+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":68,"num_write":55,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:49.636400+0000","last_change":"2024-09-14T11:23:49.636400+0000","last_active":"2024-09-14T11:23:49.636400+0000","last_peered":"2024-09-14T11:23:49.636400+0000","last_clean":"2024-09-14T11:23:49.636400+0000","last_became_active":"2024-09-14T11:11:42.590549+0000","last_became_peered":"2024-09-14T11:11:42.590549+0000","last_unstale":"2024-09-14T11:23:49.636400+0000","last_undegraded":"2024-09-14T11:23:49.636400+0000","last_fullsized":"2024-09-14T11:23:49.636400+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:49.636309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:49.636309+0000","last_clean_scrub_stamp":"2024-09-14T11:23:49.636309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:34.493124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":37,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:38.280035+0000","last_change":"2024-09-14T11:23:38.280035+0000","last_active":"2024-09-14T11:23:38.280035+0000","last_peered":"2024-09-14T11:23:38.280035+0000","last_clean":"2024-09-14T11:23:38.280035+0000","last_became_active":"2024-09-14T11:01:23.880195+0000","last_became_peered":"2024-09-14T11:01:23.880195+0000","last_unstale":"2024-09-14T11:23:38.280035+0000","last_undegraded":"2024-09-14T11:23:38.280035+0000","last_fullsized":"2024-09-14T11:23:38.280035+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:38.279944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:38.279944+0000","last_clean_scrub_stamp":"2024-09-14T11:23:38.279944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:01:59.809087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:31.164981+0000","last_change":"2024-09-14T11:23:31.164981+0000","last_active":"2024-09-14T11:23:31.164981+0000","last_peered":"2024-09-14T11:23:31.164981+0000","last_clean":"2024-09-14T11:23:31.164981+0000","last_became_active":"2024-09-14T11:01:20.869312+0000","last_became_peered":"2024-09-14T11:01:20.869312+0000","last_unstale":"2024-09-14T11:23:31.164981+0000","last_undegraded":"2024-09-14T11:23:31.164981+0000","last_fullsized":"2024-09-14T11:23:31.164981+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:31.164892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:31.164892+0000","last_clean_scrub_stamp":"2024-09-14T11:23:31.164892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:33.758841+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"257'19","reported_seq":105,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:44.245082+0000","last_change":"2024-09-14T11:23:44.245082+0000","last_active":"2024-09-14T11:23:44.245082+0000","last_peered":"2024-09-14T11:23:44.245082+0000","last_clean":"2024-09-14T11:23:44.245082+0000","last_became_active":"2024-09-14T10:59:48.418369+0000","last_became_peered":"2024-09-14T10:59:48.418369+0000","last_unstale":"2024-09-14T11:23:44.245082+0000","last_undegraded":"2024-09-14T11:23:44.245082+0000","last_fullsized":"2024-09-14T11:23:44.245082+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'19","last_scrub_stamp":"2024-09-14T11:23:44.244959+0000","last_deep_scrub":"257'19","last_deep_scrub_stamp":"2024-09-14T11:23:44.244959+0000","last_clean_scrub_stamp":"2024-09-14T11:23:44.244959+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:19:48.568895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":97,"num_write":49,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":18,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:20:02.117065+0000","last_change":"2024-09-14T11:11:42.593087+0000","last_active":"2024-09-14T11:20:02.117065+0000","last_peered":"2024-09-14T11:20:02.117065+0000","last_clean":"2024-09-14T11:20:02.117065+0000","last_became_active":"2024-09-14T11:11:42.592333+0000","last_became_peered":"2024-09-14T11:11:42.592333+0000","last_unstale":"2024-09-14T11:20:02.117065+0000","last_undegraded":"2024-09-14T11:20:02.117065+0000","last_fullsized":"2024-09-14T11:20:02.117065+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:41.563447+0000","last_clean_scrub_stamp":"2024-09-14T11:11:41.563447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:32.247668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"260'2","reported_seq":40,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:33.294201+0000","last_change":"2024-09-14T11:23:33.294201+0000","last_active":"2024-09-14T11:23:33.294201+0000","last_peered":"2024-09-14T11:23:33.294201+0000","last_clean":"2024-09-14T11:23:33.294201+0000","last_became_active":"2024-09-14T11:01:23.882133+0000","last_became_peered":"2024-09-14T11:01:23.882133+0000","last_unstale":"2024-09-14T11:23:33.294201+0000","last_undegraded":"2024-09-14T11:23:33.294201+0000","last_fullsized":"2024-09-14T11:23:33.294201+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:23:33.294095+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:23:33.294095+0000","last_clean_scrub_stamp":"2024-09-14T11:23:33.294095+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:14:18.806772+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:27.493278+0000","last_change":"2024-09-14T11:23:27.493278+0000","last_active":"2024-09-14T11:23:27.493278+0000","last_peered":"2024-09-14T11:23:27.493278+0000","last_clean":"2024-09-14T11:23:27.493278+0000","last_became_active":"2024-09-14T11:01:20.860944+0000","last_became_peered":"2024-09-14T11:01:20.860944+0000","last_unstale":"2024-09-14T11:23:27.493278+0000","last_undegraded":"2024-09-14T11:23:27.493278+0000","last_fullsized":"2024-09-14T11:23:27.493278+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:27.493188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:27.493188+0000","last_clean_scrub_stamp":"2024-09-14T11:23:27.493188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:10.739573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"260'37","reported_seq":149,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:28.289822+0000","last_change":"2024-09-14T11:23:28.289822+0000","last_active":"2024-09-14T11:23:28.289822+0000","last_peered":"2024-09-14T11:23:28.289822+0000","last_clean":"2024-09-14T11:23:28.289822+0000","last_became_active":"2024-09-14T10:59:48.419953+0000","last_became_peered":"2024-09-14T10:59:48.419953+0000","last_unstale":"2024-09-14T11:23:28.289822+0000","last_undegraded":"2024-09-14T11:23:28.289822+0000","last_fullsized":"2024-09-14T11:23:28.289822+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'37","last_scrub_stamp":"2024-09-14T11:23:28.289745+0000","last_deep_scrub":"260'37","last_deep_scrub_stamp":"2024-09-14T11:23:28.289745+0000","last_clean_scrub_stamp":"2024-09-14T11:23:28.289745+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:16.011756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":210,"num_write":90,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"260'356","reported_seq":1000,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:04.591849+0000","last_change":"2024-09-14T11:23:04.591790+0000","last_active":"2024-09-14T11:23:04.591849+0000","last_peered":"2024-09-14T11:23:04.591849+0000","last_clean":"2024-09-14T11:23:04.591849+0000","last_became_active":"2024-09-14T10:45:43.684205+0000","last_became_peered":"2024-09-14T10:45:43.684205+0000","last_unstale":"2024-09-14T11:23:04.591849+0000","last_undegraded":"2024-09-14T11:23:04.591849+0000","last_fullsized":"2024-09-14T11:23:04.591849+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'356","last_scrub_stamp":"2024-09-14T11:23:04.591679+0000","last_deep_scrub":"260'356","last_deep_scrub_stamp":"2024-09-14T11:23:04.591679+0000","last_clean_scrub_stamp":"2024-09-14T11:23:04.591679+0000","objects_scrubbed":7,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:23.922213+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133699,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":617,"num_read_kb":37218,"num_write":1077,"num_write_kb":25003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"260'785","reported_seq":2543,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:08.629267+0000","last_change":"2024-09-14T11:23:08.629209+0000","last_active":"2024-09-14T11:23:08.629267+0000","last_peered":"2024-09-14T11:23:08.629267+0000","last_clean":"2024-09-14T11:23:08.629267+0000","last_became_active":"2024-09-14T10:45:45.714485+0000","last_became_peered":"2024-09-14T10:45:45.714485+0000","last_unstale":"2024-09-14T11:23:08.629267+0000","last_undegraded":"2024-09-14T11:23:08.629267+0000","last_fullsized":"2024-09-14T11:23:08.629267+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'785","last_scrub_stamp":"2024-09-14T11:23:08.629123+0000","last_deep_scrub":"260'785","last_deep_scrub_stamp":"2024-09-14T11:23:08.629123+0000","last_clean_scrub_stamp":"2024-09-14T11:23:08.629123+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:19:08.756240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4300,"num_read_kb":3942,"num_write":1034,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7375,"num_omap_keys":29,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"260'353","reported_seq":1039,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:08.381428+0000","last_change":"2024-09-14T11:23:08.381363+0000","last_active":"2024-09-14T11:23:08.381428+0000","last_peered":"2024-09-14T11:23:08.381428+0000","last_clean":"2024-09-14T11:23:08.381428+0000","last_became_active":"2024-09-14T10:45:43.683777+0000","last_became_peered":"2024-09-14T10:45:43.683777+0000","last_unstale":"2024-09-14T11:23:08.381428+0000","last_undegraded":"2024-09-14T11:23:08.381428+0000","last_fullsized":"2024-09-14T11:23:08.381428+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'353","last_scrub_stamp":"2024-09-14T11:23:08.381263+0000","last_deep_scrub":"260'353","last_deep_scrub_stamp":"2024-09-14T11:23:08.381263+0000","last_clean_scrub_stamp":"2024-09-14T11:23:08.381263+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:09.498257+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":760,"num_read_kb":10810,"num_write":1149,"num_write_kb":33486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"260'367","reported_seq":1843,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:20.153914+0000","last_change":"2024-09-14T11:23:20.153914+0000","last_active":"2024-09-14T11:23:20.153914+0000","last_peered":"2024-09-14T11:23:20.153914+0000","last_clean":"2024-09-14T11:23:20.153914+0000","last_became_active":"2024-09-14T10:45:45.715857+0000","last_became_peered":"2024-09-14T10:45:45.715857+0000","last_unstale":"2024-09-14T11:23:20.153914+0000","last_undegraded":"2024-09-14T11:23:20.153914+0000","last_fullsized":"2024-09-14T11:23:20.153914+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'367","last_scrub_stamp":"2024-09-14T11:23:20.153830+0000","last_deep_scrub":"260'367","last_deep_scrub_stamp":"2024-09-14T11:23:20.153830+0000","last_clean_scrub_stamp":"2024-09-14T11:23:20.153830+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:36.122734+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2025,"num_read_kb":1946,"num_write":400,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"260'382","reported_seq":1095,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:09.404600+0000","last_change":"2024-09-14T11:23:09.404541+0000","last_active":"2024-09-14T11:23:09.404600+0000","last_peered":"2024-09-14T11:23:09.404600+0000","last_clean":"2024-09-14T11:23:09.404600+0000","last_became_active":"2024-09-14T10:45:43.689222+0000","last_became_peered":"2024-09-14T10:45:43.689222+0000","last_unstale":"2024-09-14T11:23:09.404600+0000","last_undegraded":"2024-09-14T11:23:09.404600+0000","last_fullsized":"2024-09-14T11:23:09.404600+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'382","last_scrub_stamp":"2024-09-14T11:23:09.404431+0000","last_deep_scrub":"260'382","last_deep_scrub_stamp":"2024-09-14T11:23:09.404431+0000","last_clean_scrub_stamp":"2024-09-14T11:23:09.404431+0000","objects_scrubbed":6,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:38:07.421015+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":957,"num_read_kb":25215,"num_write":1113,"num_write_kb":46624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"260'805","reported_seq":2244,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:21.166053+0000","last_change":"2024-09-14T11:23:21.166053+0000","last_active":"2024-09-14T11:23:21.166053+0000","last_peered":"2024-09-14T11:23:21.166053+0000","last_clean":"2024-09-14T11:23:21.166053+0000","last_became_active":"2024-09-14T10:45:45.718205+0000","last_became_peered":"2024-09-14T10:45:45.718205+0000","last_unstale":"2024-09-14T11:23:21.166053+0000","last_undegraded":"2024-09-14T11:23:21.166053+0000","last_fullsized":"2024-09-14T11:23:21.166053+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'805","last_scrub_stamp":"2024-09-14T11:23:21.165903+0000","last_deep_scrub":"260'805","last_deep_scrub_stamp":"2024-09-14T11:23:21.165903+0000","last_clean_scrub_stamp":"2024-09-14T11:23:21.165903+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:27.460262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3715,"num_read_kb":3327,"num_write":1051,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"260'407","reported_seq":1158,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:02.167203+0000","last_change":"2024-09-14T11:23:02.167132+0000","last_active":"2024-09-14T11:23:02.167203+0000","last_peered":"2024-09-14T11:23:02.167203+0000","last_clean":"2024-09-14T11:23:02.167203+0000","last_became_active":"2024-09-14T10:45:43.688982+0000","last_became_peered":"2024-09-14T10:45:43.688982+0000","last_unstale":"2024-09-14T11:23:02.167203+0000","last_undegraded":"2024-09-14T11:23:02.167203+0000","last_fullsized":"2024-09-14T11:23:02.167203+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'407","last_scrub_stamp":"2024-09-14T11:23:02.167030+0000","last_deep_scrub":"260'407","last_deep_scrub_stamp":"2024-09-14T11:23:02.167030+0000","last_clean_scrub_stamp":"2024-09-14T11:23:02.167030+0000","objects_scrubbed":6,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:09.629346+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133692,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":838,"num_read_kb":162483,"num_write":1341,"num_write_kb":45809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"260'458","reported_seq":2016,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:12.794133+0000","last_change":"2024-09-14T11:23:12.794054+0000","last_active":"2024-09-14T11:23:12.794133+0000","last_peered":"2024-09-14T11:23:12.794133+0000","last_clean":"2024-09-14T11:23:12.794133+0000","last_became_active":"2024-09-14T10:45:45.717699+0000","last_became_peered":"2024-09-14T10:45:45.717699+0000","last_unstale":"2024-09-14T11:23:12.794133+0000","last_undegraded":"2024-09-14T11:23:12.794133+0000","last_fullsized":"2024-09-14T11:23:12.794133+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'458","last_scrub_stamp":"2024-09-14T11:23:12.793944+0000","last_deep_scrub":"260'458","last_deep_scrub_stamp":"2024-09-14T11:23:12.793944+0000","last_clean_scrub_stamp":"2024-09-14T11:23:12.793944+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:09.734572+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2461,"num_read_kb":2303,"num_write":536,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"260'377","reported_seq":1025,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:03.611733+0000","last_change":"2024-09-14T11:23:03.611674+0000","last_active":"2024-09-14T11:23:03.611733+0000","last_peered":"2024-09-14T11:23:03.611733+0000","last_clean":"2024-09-14T11:23:03.611733+0000","last_became_active":"2024-09-14T10:45:43.686078+0000","last_became_peered":"2024-09-14T10:45:43.686078+0000","last_unstale":"2024-09-14T11:23:03.611733+0000","last_undegraded":"2024-09-14T11:23:03.611733+0000","last_fullsized":"2024-09-14T11:23:03.611733+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'377","last_scrub_stamp":"2024-09-14T11:23:03.611555+0000","last_deep_scrub":"260'377","last_deep_scrub_stamp":"2024-09-14T11:23:03.611555+0000","last_clean_scrub_stamp":"2024-09-14T11:23:03.611555+0000","objects_scrubbed":9,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:46.384126+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":598,"num_read_kb":61894,"num_write":1162,"num_write_kb":33123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"260'401","reported_seq":2020,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:07.627790+0000","last_change":"2024-09-14T11:23:07.627716+0000","last_active":"2024-09-14T11:23:07.627790+0000","last_peered":"2024-09-14T11:23:07.627790+0000","last_clean":"2024-09-14T11:23:07.627790+0000","last_became_active":"2024-09-14T10:45:45.714345+0000","last_became_peered":"2024-09-14T10:45:45.714345+0000","last_unstale":"2024-09-14T11:23:07.627790+0000","last_undegraded":"2024-09-14T11:23:07.627790+0000","last_fullsized":"2024-09-14T11:23:07.627790+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'401","last_scrub_stamp":"2024-09-14T11:23:07.627629+0000","last_deep_scrub":"260'401","last_deep_scrub_stamp":"2024-09-14T11:23:07.627629+0000","last_clean_scrub_stamp":"2024-09-14T11:23:07.627629+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:58:14.580406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2395,"num_read_kb":2287,"num_write":454,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"260'361","reported_seq":1026,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:01.177685+0000","last_change":"2024-09-14T11:23:01.177616+0000","last_active":"2024-09-14T11:23:01.177685+0000","last_peered":"2024-09-14T11:23:01.177685+0000","last_clean":"2024-09-14T11:23:01.177685+0000","last_became_active":"2024-09-14T10:45:43.689513+0000","last_became_peered":"2024-09-14T10:45:43.689513+0000","last_unstale":"2024-09-14T11:23:01.177685+0000","last_undegraded":"2024-09-14T11:23:01.177685+0000","last_fullsized":"2024-09-14T11:23:01.177685+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'361","last_scrub_stamp":"2024-09-14T11:23:01.177512+0000","last_deep_scrub":"260'361","last_deep_scrub_stamp":"2024-09-14T11:23:01.177512+0000","last_clean_scrub_stamp":"2024-09-14T11:23:01.177512+0000","objects_scrubbed":6,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:32.647394+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":492096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":689,"num_read_kb":58877,"num_write":1198,"num_write_kb":34980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"260'913","reported_seq":2793,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:10.646748+0000","last_change":"2024-09-14T11:23:10.646694+0000","last_active":"2024-09-14T11:23:10.646748+0000","last_peered":"2024-09-14T11:23:10.646748+0000","last_clean":"2024-09-14T11:23:10.646748+0000","last_became_active":"2024-09-14T10:45:45.722048+0000","last_became_peered":"2024-09-14T10:45:45.722048+0000","last_unstale":"2024-09-14T11:23:10.646748+0000","last_undegraded":"2024-09-14T11:23:10.646748+0000","last_fullsized":"2024-09-14T11:23:10.646748+0000","mapping_epoch":26,"log_start":"260'900","ondisk_log_start":"260'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'913","last_scrub_stamp":"2024-09-14T11:23:10.646599+0000","last_deep_scrub":"260'913","last_deep_scrub_stamp":"2024-09-14T11:23:10.646599+0000","last_clean_scrub_stamp":"2024-09-14T11:23:10.646599+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":900,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:43.954240+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4452,"num_read_kb":4058,"num_write":1175,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":735,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"260'370","reported_seq":1013,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:59.523833+0000","last_change":"2024-09-14T11:22:59.523764+0000","last_active":"2024-09-14T11:22:59.523833+0000","last_peered":"2024-09-14T11:22:59.523833+0000","last_clean":"2024-09-14T11:22:59.523833+0000","last_became_active":"2024-09-14T10:45:43.689229+0000","last_became_peered":"2024-09-14T10:45:43.689229+0000","last_unstale":"2024-09-14T11:22:59.523833+0000","last_undegraded":"2024-09-14T11:22:59.523833+0000","last_fullsized":"2024-09-14T11:22:59.523833+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'370","last_scrub_stamp":"2024-09-14T11:22:59.523641+0000","last_deep_scrub":"260'370","last_deep_scrub_stamp":"2024-09-14T11:22:59.523641+0000","last_clean_scrub_stamp":"2024-09-14T11:22:59.523641+0000","objects_scrubbed":5,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:54.893522+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":599,"num_read_kb":84854,"num_write":1153,"num_write_kb":20352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"260'522","reported_seq":2116,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:06.256202+0000","last_change":"2024-09-14T11:23:06.256140+0000","last_active":"2024-09-14T11:23:06.256202+0000","last_peered":"2024-09-14T11:23:06.256202+0000","last_clean":"2024-09-14T11:23:06.256202+0000","last_became_active":"2024-09-14T10:45:45.718978+0000","last_became_peered":"2024-09-14T10:45:45.718978+0000","last_unstale":"2024-09-14T11:23:06.256202+0000","last_undegraded":"2024-09-14T11:23:06.256202+0000","last_fullsized":"2024-09-14T11:23:06.256202+0000","mapping_epoch":26,"log_start":"260'500","ondisk_log_start":"260'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'522","last_scrub_stamp":"2024-09-14T11:23:06.256050+0000","last_deep_scrub":"260'522","last_deep_scrub_stamp":"2024-09-14T11:23:06.256050+0000","last_clean_scrub_stamp":"2024-09-14T11:23:06.256050+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:20:05.550331+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2761,"num_read_kb":2575,"num_write":634,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"260'341","reported_seq":980,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:07.343841+0000","last_change":"2024-09-14T11:23:07.343744+0000","last_active":"2024-09-14T11:23:07.343841+0000","last_peered":"2024-09-14T11:23:07.343841+0000","last_clean":"2024-09-14T11:23:07.343841+0000","last_became_active":"2024-09-14T10:45:43.687262+0000","last_became_peered":"2024-09-14T10:45:43.687262+0000","last_unstale":"2024-09-14T11:23:07.343841+0000","last_undegraded":"2024-09-14T11:23:07.343841+0000","last_fullsized":"2024-09-14T11:23:07.343841+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'341","last_scrub_stamp":"2024-09-14T11:23:07.343639+0000","last_deep_scrub":"260'341","last_deep_scrub_stamp":"2024-09-14T11:23:07.343639+0000","last_clean_scrub_stamp":"2024-09-14T11:23:07.343639+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:20.970032+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":682,"num_read_kb":42631,"num_write":1158,"num_write_kb":32664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"260'829","reported_seq":2526,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:18.423447+0000","last_change":"2024-09-14T11:23:18.423447+0000","last_active":"2024-09-14T11:23:18.423447+0000","last_peered":"2024-09-14T11:23:18.423447+0000","last_clean":"2024-09-14T11:23:18.423447+0000","last_became_active":"2024-09-14T10:45:45.721400+0000","last_became_peered":"2024-09-14T10:45:45.721400+0000","last_unstale":"2024-09-14T11:23:18.423447+0000","last_undegraded":"2024-09-14T11:23:18.423447+0000","last_fullsized":"2024-09-14T11:23:18.423447+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'829","last_scrub_stamp":"2024-09-14T11:23:18.423349+0000","last_deep_scrub":"260'829","last_deep_scrub_stamp":"2024-09-14T11:23:18.423349+0000","last_clean_scrub_stamp":"2024-09-14T11:23:18.423349+0000","objects_scrubbed":5,"log_size":29,"log_dups_size":800,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:43.196057+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4476,"num_read_kb":4082,"num_write":1140,"num_write_kb":477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2301,"num_omap_keys":9,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"260'1281","reported_seq":2925,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:19.131432+0000","last_change":"2024-09-14T11:23:19.131432+0000","last_active":"2024-09-14T11:23:19.131432+0000","last_peered":"2024-09-14T11:23:19.131432+0000","last_clean":"2024-09-14T11:23:19.131432+0000","last_became_active":"2024-09-14T10:45:45.710015+0000","last_became_peered":"2024-09-14T10:45:45.710015+0000","last_unstale":"2024-09-14T11:23:19.131432+0000","last_undegraded":"2024-09-14T11:23:19.131432+0000","last_fullsized":"2024-09-14T11:23:19.131432+0000","mapping_epoch":26,"log_start":"260'1200","ondisk_log_start":"260'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1281","last_scrub_stamp":"2024-09-14T11:23:19.131365+0000","last_deep_scrub":"260'1281","last_deep_scrub_stamp":"2024-09-14T11:23:19.131365+0000","last_clean_scrub_stamp":"2024-09-14T11:23:19.131365+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":1200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:57.896028+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5907,"num_read_kb":5227,"num_write":1779,"num_write_kb":739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"260'363","reported_seq":972,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:00.677668+0000","last_change":"2024-09-14T11:23:00.677668+0000","last_active":"2024-09-14T11:23:00.677668+0000","last_peered":"2024-09-14T11:23:00.677668+0000","last_clean":"2024-09-14T11:23:00.677668+0000","last_became_active":"2024-09-14T10:45:43.677751+0000","last_became_peered":"2024-09-14T10:45:43.677751+0000","last_unstale":"2024-09-14T11:23:00.677668+0000","last_undegraded":"2024-09-14T11:23:00.677668+0000","last_fullsized":"2024-09-14T11:23:00.677668+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'363","last_scrub_stamp":"2024-09-14T11:23:00.677578+0000","last_deep_scrub":"260'363","last_deep_scrub_stamp":"2024-09-14T11:23:00.677578+0000","last_clean_scrub_stamp":"2024-09-14T11:23:00.677578+0000","objects_scrubbed":3,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:46:20.373849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":554,"num_read_kb":880,"num_write":1155,"num_write_kb":23836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"260'598","reported_seq":2281,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:06.638146+0000","last_change":"2024-09-14T11:23:06.638084+0000","last_active":"2024-09-14T11:23:06.638146+0000","last_peered":"2024-09-14T11:23:06.638146+0000","last_clean":"2024-09-14T11:23:06.638146+0000","last_became_active":"2024-09-14T10:45:45.714551+0000","last_became_peered":"2024-09-14T10:45:45.714551+0000","last_unstale":"2024-09-14T11:23:06.638146+0000","last_undegraded":"2024-09-14T11:23:06.638146+0000","last_fullsized":"2024-09-14T11:23:06.638146+0000","mapping_epoch":26,"log_start":"260'500","ondisk_log_start":"260'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'598","last_scrub_stamp":"2024-09-14T11:23:06.637993+0000","last_deep_scrub":"260'598","last_deep_scrub_stamp":"2024-09-14T11:23:06.637993+0000","last_clean_scrub_stamp":"2024-09-14T11:23:06.637993+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":500,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:58.618707+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3058,"num_read_kb":2815,"num_write":741,"num_write_kb":205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":640,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"260'359","reported_seq":994,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:58.562307+0000","last_change":"2024-09-14T11:22:58.562307+0000","last_active":"2024-09-14T11:22:58.562307+0000","last_peered":"2024-09-14T11:22:58.562307+0000","last_clean":"2024-09-14T11:22:58.562307+0000","last_became_active":"2024-09-14T10:45:43.680355+0000","last_became_peered":"2024-09-14T10:45:43.680355+0000","last_unstale":"2024-09-14T11:22:58.562307+0000","last_undegraded":"2024-09-14T11:22:58.562307+0000","last_fullsized":"2024-09-14T11:22:58.562307+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'359","last_scrub_stamp":"2024-09-14T11:22:58.562194+0000","last_deep_scrub":"260'359","last_deep_scrub_stamp":"2024-09-14T11:22:58.562194+0000","last_clean_scrub_stamp":"2024-09-14T11:22:58.562194+0000","objects_scrubbed":8,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:10.587335+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":541,"num_read_kb":36303,"num_write":1001,"num_write_kb":55095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"260'494","reported_seq":2172,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:09.584116+0000","last_change":"2024-09-14T11:23:09.584046+0000","last_active":"2024-09-14T11:23:09.584116+0000","last_peered":"2024-09-14T11:23:09.584116+0000","last_clean":"2024-09-14T11:23:09.584116+0000","last_became_active":"2024-09-14T10:45:45.720760+0000","last_became_peered":"2024-09-14T10:45:45.720760+0000","last_unstale":"2024-09-14T11:23:09.584116+0000","last_undegraded":"2024-09-14T11:23:09.584116+0000","last_fullsized":"2024-09-14T11:23:09.584116+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'494","last_scrub_stamp":"2024-09-14T11:23:09.583958+0000","last_deep_scrub":"260'494","last_deep_scrub_stamp":"2024-09-14T11:23:09.583958+0000","last_clean_scrub_stamp":"2024-09-14T11:23:09.583958+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:01:54.258924+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2631,"num_read_kb":2483,"num_write":574,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"260'388","reported_seq":1071,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:57.604997+0000","last_change":"2024-09-14T11:22:57.604997+0000","last_active":"2024-09-14T11:22:57.604997+0000","last_peered":"2024-09-14T11:22:57.604997+0000","last_clean":"2024-09-14T11:22:57.604997+0000","last_became_active":"2024-09-14T10:45:43.684428+0000","last_became_peered":"2024-09-14T10:45:43.684428+0000","last_unstale":"2024-09-14T11:22:57.604997+0000","last_undegraded":"2024-09-14T11:22:57.604997+0000","last_fullsized":"2024-09-14T11:22:57.604997+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'388","last_scrub_stamp":"2024-09-14T11:22:57.604909+0000","last_deep_scrub":"260'388","last_deep_scrub_stamp":"2024-09-14T11:22:57.604909+0000","last_clean_scrub_stamp":"2024-09-14T11:22:57.604909+0000","objects_scrubbed":4,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:01.600133+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133668,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":756,"num_read_kb":9043,"num_write":1222,"num_write_kb":18367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"260'487","reported_seq":2068,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:10.315984+0000","last_change":"2024-09-14T11:23:10.315984+0000","last_active":"2024-09-14T11:23:10.315984+0000","last_peered":"2024-09-14T11:23:10.315984+0000","last_clean":"2024-09-14T11:23:10.315984+0000","last_became_active":"2024-09-14T10:45:45.724302+0000","last_became_peered":"2024-09-14T10:45:45.724302+0000","last_unstale":"2024-09-14T11:23:10.315984+0000","last_undegraded":"2024-09-14T11:23:10.315984+0000","last_fullsized":"2024-09-14T11:23:10.315984+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'487","last_scrub_stamp":"2024-09-14T11:23:10.315849+0000","last_deep_scrub":"260'487","last_deep_scrub_stamp":"2024-09-14T11:23:10.315849+0000","last_clean_scrub_stamp":"2024-09-14T11:23:10.315849+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:37.803313+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2564,"num_read_kb":2400,"num_write":575,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":460,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"260'336","reported_seq":1031,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:01.602768+0000","last_change":"2024-09-14T11:23:01.602768+0000","last_active":"2024-09-14T11:23:01.602768+0000","last_peered":"2024-09-14T11:23:01.602768+0000","last_clean":"2024-09-14T11:23:01.602768+0000","last_became_active":"2024-09-14T10:45:43.683797+0000","last_became_peered":"2024-09-14T10:45:43.683797+0000","last_unstale":"2024-09-14T11:23:01.602768+0000","last_undegraded":"2024-09-14T11:23:01.602768+0000","last_fullsized":"2024-09-14T11:23:01.602768+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'336","last_scrub_stamp":"2024-09-14T11:23:01.602654+0000","last_deep_scrub":"260'336","last_deep_scrub_stamp":"2024-09-14T11:23:01.602654+0000","last_clean_scrub_stamp":"2024-09-14T11:23:01.602654+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:05.538860+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":715,"num_read_kb":8100,"num_write":1180,"num_write_kb":25345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"260'434","reported_seq":1978,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:17.380987+0000","last_change":"2024-09-14T11:23:17.380987+0000","last_active":"2024-09-14T11:23:17.380987+0000","last_peered":"2024-09-14T11:23:17.380987+0000","last_clean":"2024-09-14T11:23:17.380987+0000","last_became_active":"2024-09-14T10:45:45.723570+0000","last_became_peered":"2024-09-14T10:45:45.723570+0000","last_unstale":"2024-09-14T11:23:17.380987+0000","last_undegraded":"2024-09-14T11:23:17.380987+0000","last_fullsized":"2024-09-14T11:23:17.380987+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'434","last_scrub_stamp":"2024-09-14T11:23:17.380900+0000","last_deep_scrub":"260'434","last_deep_scrub_stamp":"2024-09-14T11:23:17.380900+0000","last_clean_scrub_stamp":"2024-09-14T11:23:17.380900+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:59.821342+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2400,"num_read_kb":2278,"num_write":489,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"260'442","reported_seq":1161,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:03.480235+0000","last_change":"2024-09-14T11:23:03.480235+0000","last_active":"2024-09-14T11:23:03.480235+0000","last_peered":"2024-09-14T11:23:03.480235+0000","last_clean":"2024-09-14T11:23:03.480235+0000","last_became_active":"2024-09-14T10:45:43.687585+0000","last_became_peered":"2024-09-14T10:45:43.687585+0000","last_unstale":"2024-09-14T11:23:03.480235+0000","last_undegraded":"2024-09-14T11:23:03.480235+0000","last_fullsized":"2024-09-14T11:23:03.480235+0000","mapping_epoch":23,"log_start":"260'400","ondisk_log_start":"260'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'442","last_scrub_stamp":"2024-09-14T11:23:03.480124+0000","last_deep_scrub":"260'442","last_deep_scrub_stamp":"2024-09-14T11:23:03.480124+0000","last_clean_scrub_stamp":"2024-09-14T11:23:03.480124+0000","objects_scrubbed":6,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:54.485427+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1137,"num_read_kb":1116,"num_write":1403,"num_write_kb":30799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"260'801","reported_seq":2456,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:06.591124+0000","last_change":"2024-09-14T11:23:06.591124+0000","last_active":"2024-09-14T11:23:06.591124+0000","last_peered":"2024-09-14T11:23:06.591124+0000","last_clean":"2024-09-14T11:23:06.591124+0000","last_became_active":"2024-09-14T10:45:45.714187+0000","last_became_peered":"2024-09-14T10:45:45.714187+0000","last_unstale":"2024-09-14T11:23:06.591124+0000","last_undegraded":"2024-09-14T11:23:06.591124+0000","last_fullsized":"2024-09-14T11:23:06.591124+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'801","last_scrub_stamp":"2024-09-14T11:23:06.591022+0000","last_deep_scrub":"260'801","last_deep_scrub_stamp":"2024-09-14T11:23:06.591022+0000","last_clean_scrub_stamp":"2024-09-14T11:23:06.591022+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:23.740415+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3909,"num_read_kb":3562,"num_write":1036,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":245,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"260'348","reported_seq":996,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:00.520173+0000","last_change":"2024-09-14T11:23:00.520074+0000","last_active":"2024-09-14T11:23:00.520173+0000","last_peered":"2024-09-14T11:23:00.520173+0000","last_clean":"2024-09-14T11:23:00.520173+0000","last_became_active":"2024-09-14T10:45:43.681680+0000","last_became_peered":"2024-09-14T10:45:43.681680+0000","last_unstale":"2024-09-14T11:23:00.520173+0000","last_undegraded":"2024-09-14T11:23:00.520173+0000","last_fullsized":"2024-09-14T11:23:00.520173+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'348","last_scrub_stamp":"2024-09-14T11:23:00.519964+0000","last_deep_scrub":"260'348","last_deep_scrub_stamp":"2024-09-14T11:23:00.519964+0000","last_clean_scrub_stamp":"2024-09-14T11:23:00.519964+0000","objects_scrubbed":3,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:19:01.552760+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":572,"num_read_kb":80059,"num_write":1115,"num_write_kb":31213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"260'167","reported_seq":664,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:20.609247+0000","last_change":"2024-09-14T11:23:20.609247+0000","last_active":"2024-09-14T11:23:20.609247+0000","last_peered":"2024-09-14T11:23:20.609247+0000","last_clean":"2024-09-14T11:23:20.609247+0000","last_became_active":"2024-09-14T10:45:53.749495+0000","last_became_peered":"2024-09-14T10:45:53.749495+0000","last_unstale":"2024-09-14T11:23:20.609247+0000","last_undegraded":"2024-09-14T11:23:20.609247+0000","last_fullsized":"2024-09-14T11:23:20.609247+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'167","last_scrub_stamp":"2024-09-14T11:23:20.609150+0000","last_deep_scrub":"260'167","last_deep_scrub_stamp":"2024-09-14T11:23:20.609150+0000","last_clean_scrub_stamp":"2024-09-14T11:23:20.609150+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:03:11.128451+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":160,"num_read_kb":158,"num_write":391,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"260'885","reported_seq":2461,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:08.342104+0000","last_change":"2024-09-14T11:23:08.342014+0000","last_active":"2024-09-14T11:23:08.342104+0000","last_peered":"2024-09-14T11:23:08.342104+0000","last_clean":"2024-09-14T11:23:08.342104+0000","last_became_active":"2024-09-14T10:45:45.710830+0000","last_became_peered":"2024-09-14T10:45:45.710830+0000","last_unstale":"2024-09-14T11:23:08.342104+0000","last_undegraded":"2024-09-14T11:23:08.342104+0000","last_fullsized":"2024-09-14T11:23:08.342104+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'885","last_scrub_stamp":"2024-09-14T11:23:08.341916+0000","last_deep_scrub":"260'885","last_deep_scrub_stamp":"2024-09-14T11:23:08.341916+0000","last_clean_scrub_stamp":"2024-09-14T11:23:08.341916+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":800,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:21.880977+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5905,"num_read_kb":5530,"num_write":1368,"num_write_kb":537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"260'450","reported_seq":1134,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:05.189040+0000","last_change":"2024-09-14T11:23:05.188952+0000","last_active":"2024-09-14T11:23:05.189040+0000","last_peered":"2024-09-14T11:23:05.189040+0000","last_clean":"2024-09-14T11:23:05.189040+0000","last_became_active":"2024-09-14T10:45:43.684504+0000","last_became_peered":"2024-09-14T10:45:43.684504+0000","last_unstale":"2024-09-14T11:23:05.189040+0000","last_undegraded":"2024-09-14T11:23:05.189040+0000","last_fullsized":"2024-09-14T11:23:05.189040+0000","mapping_epoch":23,"log_start":"260'400","ondisk_log_start":"260'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'450","last_scrub_stamp":"2024-09-14T11:23:05.188789+0000","last_deep_scrub":"260'450","last_deep_scrub_stamp":"2024-09-14T11:23:05.188789+0000","last_clean_scrub_stamp":"2024-09-14T11:23:05.188789+0000","objects_scrubbed":9,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:06.893489+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133694,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":846,"num_read_kb":75778,"num_write":1426,"num_write_kb":37052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":486,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:26.201687+0000","last_change":"2024-09-14T11:23:26.201687+0000","last_active":"2024-09-14T11:23:26.201687+0000","last_peered":"2024-09-14T11:23:26.201687+0000","last_clean":"2024-09-14T11:23:26.201687+0000","last_became_active":"2024-09-14T10:45:47.730629+0000","last_became_peered":"2024-09-14T10:45:47.730629+0000","last_unstale":"2024-09-14T11:23:26.201687+0000","last_undegraded":"2024-09-14T11:23:26.201687+0000","last_fullsized":"2024-09-14T11:23:26.201687+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:26.201579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:26.201579+0000","last_clean_scrub_stamp":"2024-09-14T11:23:26.201579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:45.423285+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"260'338","reported_seq":933,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:24.687756+0000","last_change":"2024-09-14T11:23:24.687756+0000","last_active":"2024-09-14T11:23:24.687756+0000","last_peered":"2024-09-14T11:23:24.687756+0000","last_clean":"2024-09-14T11:23:24.687756+0000","last_became_active":"2024-09-14T10:45:49.733770+0000","last_became_peered":"2024-09-14T10:45:49.733770+0000","last_unstale":"2024-09-14T11:23:24.687756+0000","last_undegraded":"2024-09-14T11:23:24.687756+0000","last_fullsized":"2024-09-14T11:23:24.687756+0000","mapping_epoch":30,"log_start":"260'300","ondisk_log_start":"260'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'338","last_scrub_stamp":"2024-09-14T11:23:24.687646+0000","last_deep_scrub":"260'338","last_deep_scrub_stamp":"2024-09-14T11:23:24.687646+0000","last_clean_scrub_stamp":"2024-09-14T11:23:24.687646+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:56.364701+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49773,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":530,"num_read_kb":1113,"num_write":424,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:19.613258+0000","last_change":"2024-09-14T11:23:19.613258+0000","last_active":"2024-09-14T11:23:19.613258+0000","last_peered":"2024-09-14T11:23:19.613258+0000","last_clean":"2024-09-14T11:23:19.613258+0000","last_became_active":"2024-09-14T10:45:51.745410+0000","last_became_peered":"2024-09-14T10:45:51.745410+0000","last_unstale":"2024-09-14T11:23:19.613258+0000","last_undegraded":"2024-09-14T11:23:19.613258+0000","last_fullsized":"2024-09-14T11:23:19.613258+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:19.613177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:19.613177+0000","last_clean_scrub_stamp":"2024-09-14T11:23:19.613177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:29:07.940790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"260'96","reported_seq":580,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:25.560729+0000","last_change":"2024-09-14T11:23:25.560729+0000","last_active":"2024-09-14T11:23:25.560729+0000","last_peered":"2024-09-14T11:23:25.560729+0000","last_clean":"2024-09-14T11:23:25.560729+0000","last_became_active":"2024-09-14T10:45:53.743472+0000","last_became_peered":"2024-09-14T10:45:53.743472+0000","last_unstale":"2024-09-14T11:23:25.560729+0000","last_undegraded":"2024-09-14T11:23:25.560729+0000","last_fullsized":"2024-09-14T11:23:25.560729+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'96","last_scrub_stamp":"2024-09-14T11:23:25.560642+0000","last_deep_scrub":"260'96","last_deep_scrub_stamp":"2024-09-14T11:23:25.560642+0000","last_clean_scrub_stamp":"2024-09-14T11:23:25.560642+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:20.792449+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":73,"num_read_kb":72,"num_write":215,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"260'380","reported_seq":1794,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:16.212298+0000","last_change":"2024-09-14T11:23:16.212298+0000","last_active":"2024-09-14T11:23:16.212298+0000","last_peered":"2024-09-14T11:23:16.212298+0000","last_clean":"2024-09-14T11:23:16.212298+0000","last_became_active":"2024-09-14T10:45:45.713502+0000","last_became_peered":"2024-09-14T10:45:45.713502+0000","last_unstale":"2024-09-14T11:23:16.212298+0000","last_undegraded":"2024-09-14T11:23:16.212298+0000","last_fullsized":"2024-09-14T11:23:16.212298+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'380","last_scrub_stamp":"2024-09-14T11:23:16.212209+0000","last_deep_scrub":"260'380","last_deep_scrub_stamp":"2024-09-14T11:23:16.212209+0000","last_clean_scrub_stamp":"2024-09-14T11:23:16.212209+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:05.789118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2020,"num_read_kb":1909,"num_write":423,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"260'306","reported_seq":1044,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:57.547642+0000","last_change":"2024-09-14T11:22:57.547580+0000","last_active":"2024-09-14T11:22:57.547642+0000","last_peered":"2024-09-14T11:22:57.547642+0000","last_clean":"2024-09-14T11:22:57.547642+0000","last_became_active":"2024-09-14T10:45:43.683964+0000","last_became_peered":"2024-09-14T10:45:43.683964+0000","last_unstale":"2024-09-14T11:22:57.547642+0000","last_undegraded":"2024-09-14T11:22:57.547642+0000","last_fullsized":"2024-09-14T11:22:57.547642+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'306","last_scrub_stamp":"2024-09-14T11:22:57.547454+0000","last_deep_scrub":"260'306","last_deep_scrub_stamp":"2024-09-14T11:22:57.547454+0000","last_clean_scrub_stamp":"2024-09-14T11:22:57.547454+0000","objects_scrubbed":7,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:59.621447+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133715,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":687,"num_read_kb":39643,"num_write":1073,"num_write_kb":23617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":493,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:16.803040+0000","last_change":"2024-09-14T11:23:16.803040+0000","last_active":"2024-09-14T11:23:16.803040+0000","last_peered":"2024-09-14T11:23:16.803040+0000","last_clean":"2024-09-14T11:23:16.803040+0000","last_became_active":"2024-09-14T10:45:47.729871+0000","last_became_peered":"2024-09-14T10:45:47.729871+0000","last_unstale":"2024-09-14T11:23:16.803040+0000","last_undegraded":"2024-09-14T11:23:16.803040+0000","last_fullsized":"2024-09-14T11:23:16.803040+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:16.802954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:16.802954+0000","last_clean_scrub_stamp":"2024-09-14T11:23:16.802954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:57.985108+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"260'87","reported_seq":603,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:16.577922+0000","last_change":"2024-09-14T11:23:16.577922+0000","last_active":"2024-09-14T11:23:16.577922+0000","last_peered":"2024-09-14T11:23:16.577922+0000","last_clean":"2024-09-14T11:23:16.577922+0000","last_became_active":"2024-09-14T10:45:49.732459+0000","last_became_peered":"2024-09-14T10:45:49.732459+0000","last_unstale":"2024-09-14T11:23:16.577922+0000","last_undegraded":"2024-09-14T11:23:16.577922+0000","last_fullsized":"2024-09-14T11:23:16.577922+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'87","last_scrub_stamp":"2024-09-14T11:23:16.577822+0000","last_deep_scrub":"260'87","last_deep_scrub_stamp":"2024-09-14T11:23:16.577822+0000","last_clean_scrub_stamp":"2024-09-14T11:23:16.577822+0000","objects_scrubbed":3,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:42.355440+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":84,"num_read_kb":79,"num_write":56,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:20.619631+0000","last_change":"2024-09-14T11:23:20.619631+0000","last_active":"2024-09-14T11:23:20.619631+0000","last_peered":"2024-09-14T11:23:20.619631+0000","last_clean":"2024-09-14T11:23:20.619631+0000","last_became_active":"2024-09-14T10:45:51.746608+0000","last_became_peered":"2024-09-14T10:45:51.746608+0000","last_unstale":"2024-09-14T11:23:20.619631+0000","last_undegraded":"2024-09-14T11:23:20.619631+0000","last_fullsized":"2024-09-14T11:23:20.619631+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:20.619548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:20.619548+0000","last_clean_scrub_stamp":"2024-09-14T11:23:20.619548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:01:42.667309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"260'131","reported_seq":629,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:23.276123+0000","last_change":"2024-09-14T11:23:23.276065+0000","last_active":"2024-09-14T11:23:23.276123+0000","last_peered":"2024-09-14T11:23:23.276123+0000","last_clean":"2024-09-14T11:23:23.276123+0000","last_became_active":"2024-09-14T10:45:53.752597+0000","last_became_peered":"2024-09-14T10:45:53.752597+0000","last_unstale":"2024-09-14T11:23:23.276123+0000","last_undegraded":"2024-09-14T11:23:23.276123+0000","last_fullsized":"2024-09-14T11:23:23.276123+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'131","last_scrub_stamp":"2024-09-14T11:23:23.275972+0000","last_deep_scrub":"260'131","last_deep_scrub_stamp":"2024-09-14T11:23:23.275972+0000","last_clean_scrub_stamp":"2024-09-14T11:23:23.275972+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:29.008656+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":152,"num_read_kb":142,"num_write":295,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"260'1285","reported_seq":2999,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:13.319725+0000","last_change":"2024-09-14T11:23:13.319725+0000","last_active":"2024-09-14T11:23:13.319725+0000","last_peered":"2024-09-14T11:23:13.319725+0000","last_clean":"2024-09-14T11:23:13.319725+0000","last_became_active":"2024-09-14T10:45:45.725335+0000","last_became_peered":"2024-09-14T10:45:45.725335+0000","last_unstale":"2024-09-14T11:23:13.319725+0000","last_undegraded":"2024-09-14T11:23:13.319725+0000","last_fullsized":"2024-09-14T11:23:13.319725+0000","mapping_epoch":26,"log_start":"260'1200","ondisk_log_start":"260'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1285","last_scrub_stamp":"2024-09-14T11:23:13.319628+0000","last_deep_scrub":"260'1285","last_deep_scrub_stamp":"2024-09-14T11:23:13.319628+0000","last_clean_scrub_stamp":"2024-09-14T11:23:13.319628+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":1200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:13:10.353579+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5911,"num_read_kb":5224,"num_write":1759,"num_write_kb":730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":714,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"260'352","reported_seq":1010,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:04.223440+0000","last_change":"2024-09-14T11:23:04.223378+0000","last_active":"2024-09-14T11:23:04.223440+0000","last_peered":"2024-09-14T11:23:04.223440+0000","last_clean":"2024-09-14T11:23:04.223440+0000","last_became_active":"2024-09-14T10:45:43.671096+0000","last_became_peered":"2024-09-14T10:45:43.671096+0000","last_unstale":"2024-09-14T11:23:04.223440+0000","last_undegraded":"2024-09-14T11:23:04.223440+0000","last_fullsized":"2024-09-14T11:23:04.223440+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'352","last_scrub_stamp":"2024-09-14T11:23:04.223284+0000","last_deep_scrub":"260'352","last_deep_scrub_stamp":"2024-09-14T11:23:04.223284+0000","last_clean_scrub_stamp":"2024-09-14T11:23:04.223284+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:49.941234+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":684,"num_read_kb":57141,"num_write":1087,"num_write_kb":43933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":492,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:17.805428+0000","last_change":"2024-09-14T11:23:17.805428+0000","last_active":"2024-09-14T11:23:17.805428+0000","last_peered":"2024-09-14T11:23:17.805428+0000","last_clean":"2024-09-14T11:23:17.805428+0000","last_became_active":"2024-09-14T10:45:47.724723+0000","last_became_peered":"2024-09-14T10:45:47.724723+0000","last_unstale":"2024-09-14T11:23:17.805428+0000","last_undegraded":"2024-09-14T11:23:17.805428+0000","last_fullsized":"2024-09-14T11:23:17.805428+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:17.805338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:17.805338+0000","last_clean_scrub_stamp":"2024-09-14T11:23:17.805338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:19.893049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"260'116","reported_seq":641,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:22.729795+0000","last_change":"2024-09-14T11:23:22.729795+0000","last_active":"2024-09-14T11:23:22.729795+0000","last_peered":"2024-09-14T11:23:22.729795+0000","last_clean":"2024-09-14T11:23:22.729795+0000","last_became_active":"2024-09-14T10:45:49.737651+0000","last_became_peered":"2024-09-14T10:45:49.737651+0000","last_unstale":"2024-09-14T11:23:22.729795+0000","last_undegraded":"2024-09-14T11:23:22.729795+0000","last_fullsized":"2024-09-14T11:23:22.729795+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'116","last_scrub_stamp":"2024-09-14T11:23:22.729700+0000","last_deep_scrub":"260'116","last_deep_scrub_stamp":"2024-09-14T11:23:22.729700+0000","last_clean_scrub_stamp":"2024-09-14T11:23:22.729700+0000","objects_scrubbed":6,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:57:47.520816+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":106,"num_write":82,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"260'809","reported_seq":4502,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:41.255626+0000","last_change":"2024-09-14T11:23:41.255626+0000","last_active":"2024-09-14T11:23:41.255626+0000","last_peered":"2024-09-14T11:23:41.255626+0000","last_clean":"2024-09-14T11:23:41.255626+0000","last_became_active":"2024-09-14T10:45:51.745441+0000","last_became_peered":"2024-09-14T10:45:51.745441+0000","last_unstale":"2024-09-14T11:23:41.255626+0000","last_undegraded":"2024-09-14T11:23:41.255626+0000","last_fullsized":"2024-09-14T11:23:41.255626+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'809","last_scrub_stamp":"2024-09-14T11:23:41.255544+0000","last_deep_scrub":"260'809","last_deep_scrub_stamp":"2024-09-14T11:23:41.255544+0000","last_clean_scrub_stamp":"2024-09-14T11:23:41.255544+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:12.499777+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"260'213","reported_seq":1027,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:22.441121+0000","last_change":"2024-09-14T11:23:22.441065+0000","last_active":"2024-09-14T11:23:22.441121+0000","last_peered":"2024-09-14T11:23:22.441121+0000","last_clean":"2024-09-14T11:23:22.441121+0000","last_became_active":"2024-09-14T10:45:53.753389+0000","last_became_peered":"2024-09-14T10:45:53.753389+0000","last_unstale":"2024-09-14T11:23:22.441121+0000","last_undegraded":"2024-09-14T11:23:22.441121+0000","last_fullsized":"2024-09-14T11:23:22.441121+0000","mapping_epoch":34,"log_start":"260'200","ondisk_log_start":"260'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'213","last_scrub_stamp":"2024-09-14T11:23:22.440984+0000","last_deep_scrub":"260'213","last_deep_scrub_stamp":"2024-09-14T11:23:22.440984+0000","last_clean_scrub_stamp":"2024-09-14T11:23:22.440984+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:20.195872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":623,"num_read_kb":614,"num_write":459,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"260'902","reported_seq":2545,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:12.363681+0000","last_change":"2024-09-14T11:23:12.363681+0000","last_active":"2024-09-14T11:23:12.363681+0000","last_peered":"2024-09-14T11:23:12.363681+0000","last_clean":"2024-09-14T11:23:12.363681+0000","last_became_active":"2024-09-14T10:45:45.725700+0000","last_became_peered":"2024-09-14T10:45:45.725700+0000","last_unstale":"2024-09-14T11:23:12.363681+0000","last_undegraded":"2024-09-14T11:23:12.363681+0000","last_fullsized":"2024-09-14T11:23:12.363681+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'902","last_scrub_stamp":"2024-09-14T11:23:12.363569+0000","last_deep_scrub":"260'902","last_deep_scrub_stamp":"2024-09-14T11:23:12.363569+0000","last_clean_scrub_stamp":"2024-09-14T11:23:12.363569+0000","objects_scrubbed":2,"log_size":102,"log_dups_size":800,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:00:47.995104+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4396,"num_read_kb":3931,"num_write":1208,"num_write_kb":463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2043,"num_omap_keys":8,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"260'381","reported_seq":1029,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:56.685332+0000","last_change":"2024-09-14T11:22:56.685284+0000","last_active":"2024-09-14T11:22:56.685332+0000","last_peered":"2024-09-14T11:22:56.685332+0000","last_clean":"2024-09-14T11:22:56.685332+0000","last_became_active":"2024-09-14T10:45:43.683274+0000","last_became_peered":"2024-09-14T10:45:43.683274+0000","last_unstale":"2024-09-14T11:22:56.685332+0000","last_undegraded":"2024-09-14T11:22:56.685332+0000","last_fullsized":"2024-09-14T11:22:56.685332+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'381","last_scrub_stamp":"2024-09-14T11:22:56.685220+0000","last_deep_scrub":"260'381","last_deep_scrub_stamp":"2024-09-14T11:22:56.685220+0000","last_clean_scrub_stamp":"2024-09-14T11:22:56.685220+0000","objects_scrubbed":4,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:15.447942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":697,"num_read_kb":4530,"num_write":1135,"num_write_kb":39150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":486,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:27.203464+0000","last_change":"2024-09-14T11:23:27.203464+0000","last_active":"2024-09-14T11:23:27.203464+0000","last_peered":"2024-09-14T11:23:27.203464+0000","last_clean":"2024-09-14T11:23:27.203464+0000","last_became_active":"2024-09-14T10:45:47.729004+0000","last_became_peered":"2024-09-14T10:45:47.729004+0000","last_unstale":"2024-09-14T11:23:27.203464+0000","last_undegraded":"2024-09-14T11:23:27.203464+0000","last_fullsized":"2024-09-14T11:23:27.203464+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:27.203341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:27.203341+0000","last_clean_scrub_stamp":"2024-09-14T11:23:27.203341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:41.034676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"260'260","reported_seq":812,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:11.406541+0000","last_change":"2024-09-14T11:23:11.406541+0000","last_active":"2024-09-14T11:23:11.406541+0000","last_peered":"2024-09-14T11:23:11.406541+0000","last_clean":"2024-09-14T11:23:11.406541+0000","last_became_active":"2024-09-14T10:45:49.728896+0000","last_became_peered":"2024-09-14T10:45:49.728896+0000","last_unstale":"2024-09-14T11:23:11.406541+0000","last_undegraded":"2024-09-14T11:23:11.406541+0000","last_fullsized":"2024-09-14T11:23:11.406541+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'260","last_scrub_stamp":"2024-09-14T11:23:11.406439+0000","last_deep_scrub":"260'260","last_deep_scrub_stamp":"2024-09-14T11:23:11.406439+0000","last_clean_scrub_stamp":"2024-09-14T11:23:11.406439+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:13.056696+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42620,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":444,"num_read_kb":1063,"num_write":366,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"260'805","reported_seq":3886,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:27.542342+0000","last_change":"2024-09-14T11:23:27.542342+0000","last_active":"2024-09-14T11:23:27.542342+0000","last_peered":"2024-09-14T11:23:27.542342+0000","last_clean":"2024-09-14T11:23:27.542342+0000","last_became_active":"2024-09-14T10:45:51.744510+0000","last_became_peered":"2024-09-14T10:45:51.744510+0000","last_unstale":"2024-09-14T11:23:27.542342+0000","last_undegraded":"2024-09-14T11:23:27.542342+0000","last_fullsized":"2024-09-14T11:23:27.542342+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'805","last_scrub_stamp":"2024-09-14T11:23:27.542254+0000","last_deep_scrub":"260'805","last_deep_scrub_stamp":"2024-09-14T11:23:27.542254+0000","last_clean_scrub_stamp":"2024-09-14T11:23:27.542254+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:20.313299+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"260'641","reported_seq":2336,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:13.170714+0000","last_change":"2024-09-14T11:23:13.170714+0000","last_active":"2024-09-14T11:23:13.170714+0000","last_peered":"2024-09-14T11:23:13.170714+0000","last_clean":"2024-09-14T11:23:13.170714+0000","last_became_active":"2024-09-14T10:45:45.716537+0000","last_became_peered":"2024-09-14T10:45:45.716537+0000","last_unstale":"2024-09-14T11:23:13.170714+0000","last_undegraded":"2024-09-14T11:23:13.170714+0000","last_fullsized":"2024-09-14T11:23:13.170714+0000","mapping_epoch":26,"log_start":"260'600","ondisk_log_start":"260'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'641","last_scrub_stamp":"2024-09-14T11:23:13.170614+0000","last_deep_scrub":"260'641","last_deep_scrub_stamp":"2024-09-14T11:23:13.170614+0000","last_clean_scrub_stamp":"2024-09-14T11:23:13.170614+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":600,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:09.840189+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3192,"num_read_kb":2926,"num_write":775,"num_write_kb":229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1720,"num_omap_keys":8,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"260'311","reported_seq":921,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:59.747594+0000","last_change":"2024-09-14T11:22:59.747594+0000","last_active":"2024-09-14T11:22:59.747594+0000","last_peered":"2024-09-14T11:22:59.747594+0000","last_clean":"2024-09-14T11:22:59.747594+0000","last_became_active":"2024-09-14T10:46:20.045945+0000","last_became_peered":"2024-09-14T10:46:20.045945+0000","last_unstale":"2024-09-14T11:22:59.747594+0000","last_undegraded":"2024-09-14T11:22:59.747594+0000","last_fullsized":"2024-09-14T11:22:59.747594+0000","mapping_epoch":37,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'311","last_scrub_stamp":"2024-09-14T11:22:59.747508+0000","last_deep_scrub":"260'311","last_deep_scrub_stamp":"2024-09-14T11:22:59.747508+0000","last_clean_scrub_stamp":"2024-09-14T11:22:59.747508+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":200,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:23.526580+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":633,"num_read_kb":12757,"num_write":988,"num_write_kb":36887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":494,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:10.598893+0000","last_change":"2024-09-14T11:23:10.598893+0000","last_active":"2024-09-14T11:23:10.598893+0000","last_peered":"2024-09-14T11:23:10.598893+0000","last_clean":"2024-09-14T11:23:10.598893+0000","last_became_active":"2024-09-14T10:45:47.720639+0000","last_became_peered":"2024-09-14T10:45:47.720639+0000","last_unstale":"2024-09-14T11:23:10.598893+0000","last_undegraded":"2024-09-14T11:23:10.598893+0000","last_fullsized":"2024-09-14T11:23:10.598893+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:10.598806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:10.598806+0000","last_clean_scrub_stamp":"2024-09-14T11:23:10.598806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:01.115042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"260'357","reported_seq":957,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:14.636173+0000","last_change":"2024-09-14T11:23:14.636173+0000","last_active":"2024-09-14T11:23:14.636173+0000","last_peered":"2024-09-14T11:23:14.636173+0000","last_clean":"2024-09-14T11:23:14.636173+0000","last_became_active":"2024-09-14T10:45:49.732754+0000","last_became_peered":"2024-09-14T10:45:49.732754+0000","last_unstale":"2024-09-14T11:23:14.636173+0000","last_undegraded":"2024-09-14T11:23:14.636173+0000","last_fullsized":"2024-09-14T11:23:14.636173+0000","mapping_epoch":30,"log_start":"260'300","ondisk_log_start":"260'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'357","last_scrub_stamp":"2024-09-14T11:23:14.636077+0000","last_deep_scrub":"260'357","last_deep_scrub_stamp":"2024-09-14T11:23:14.636077+0000","last_clean_scrub_stamp":"2024-09-14T11:23:14.636077+0000","objects_scrubbed":10,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:57.050795+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99406,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":572,"num_read_kb":1321,"num_write":460,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":479,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:21.214100+0000","last_change":"2024-09-14T11:23:21.214100+0000","last_active":"2024-09-14T11:23:21.214100+0000","last_peered":"2024-09-14T11:23:21.214100+0000","last_clean":"2024-09-14T11:23:21.214100+0000","last_became_active":"2024-09-14T10:45:51.746282+0000","last_became_peered":"2024-09-14T10:45:51.746282+0000","last_unstale":"2024-09-14T11:23:21.214100+0000","last_undegraded":"2024-09-14T11:23:21.214100+0000","last_fullsized":"2024-09-14T11:23:21.214100+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:21.214002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:21.214002+0000","last_clean_scrub_stamp":"2024-09-14T11:23:21.214002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:46.235673+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"260'562","reported_seq":1368,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:19.476331+0000","last_change":"2024-09-14T11:23:19.476270+0000","last_active":"2024-09-14T11:23:19.476331+0000","last_peered":"2024-09-14T11:23:19.476331+0000","last_clean":"2024-09-14T11:23:19.476331+0000","last_became_active":"2024-09-14T10:45:53.755505+0000","last_became_peered":"2024-09-14T10:45:53.755505+0000","last_unstale":"2024-09-14T11:23:19.476331+0000","last_undegraded":"2024-09-14T11:23:19.476331+0000","last_fullsized":"2024-09-14T11:23:19.476331+0000","mapping_epoch":34,"log_start":"260'500","ondisk_log_start":"260'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'562","last_scrub_stamp":"2024-09-14T11:23:19.476200+0000","last_deep_scrub":"260'562","last_deep_scrub_stamp":"2024-09-14T11:23:19.476200+0000","last_clean_scrub_stamp":"2024-09-14T11:23:19.476200+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":500,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:15.664428+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1310,"num_read_kb":1299,"num_write":1164,"num_write_kb":395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"260'608","reported_seq":2252,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:01.654181+0000","last_change":"2024-09-14T11:23:01.654181+0000","last_active":"2024-09-14T11:23:01.654181+0000","last_peered":"2024-09-14T11:23:01.654181+0000","last_clean":"2024-09-14T11:23:01.654181+0000","last_became_active":"2024-09-14T10:45:45.726869+0000","last_became_peered":"2024-09-14T10:45:45.726869+0000","last_unstale":"2024-09-14T11:23:01.654181+0000","last_undegraded":"2024-09-14T11:23:01.654181+0000","last_fullsized":"2024-09-14T11:23:01.654181+0000","mapping_epoch":26,"log_start":"260'500","ondisk_log_start":"260'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'608","last_scrub_stamp":"2024-09-14T11:23:01.654096+0000","last_deep_scrub":"260'608","last_deep_scrub_stamp":"2024-09-14T11:23:01.654096+0000","last_clean_scrub_stamp":"2024-09-14T11:23:01.654096+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":500,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:34.095164+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3274,"num_read_kb":2999,"num_write":839,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"260'390","reported_seq":1058,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:57.186256+0000","last_change":"2024-09-14T11:22:57.186256+0000","last_active":"2024-09-14T11:22:57.186256+0000","last_peered":"2024-09-14T11:22:57.186256+0000","last_clean":"2024-09-14T11:22:57.186256+0000","last_became_active":"2024-09-14T10:45:43.685087+0000","last_became_peered":"2024-09-14T10:45:43.685087+0000","last_unstale":"2024-09-14T11:22:57.186256+0000","last_undegraded":"2024-09-14T11:22:57.186256+0000","last_fullsized":"2024-09-14T11:22:57.186256+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'390","last_scrub_stamp":"2024-09-14T11:22:57.186147+0000","last_deep_scrub":"260'390","last_deep_scrub_stamp":"2024-09-14T11:22:57.186147+0000","last_clean_scrub_stamp":"2024-09-14T11:22:57.186147+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:33.020000+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":736,"num_read_kb":49067,"num_write":1293,"num_write_kb":21177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:11.277931+0000","last_change":"2024-09-14T11:23:11.277931+0000","last_active":"2024-09-14T11:23:11.277931+0000","last_peered":"2024-09-14T11:23:11.277931+0000","last_clean":"2024-09-14T11:23:11.277931+0000","last_became_active":"2024-09-14T10:45:47.727250+0000","last_became_peered":"2024-09-14T10:45:47.727250+0000","last_unstale":"2024-09-14T11:23:11.277931+0000","last_undegraded":"2024-09-14T11:23:11.277931+0000","last_fullsized":"2024-09-14T11:23:11.277931+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:11.277843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:11.277843+0000","last_clean_scrub_stamp":"2024-09-14T11:23:11.277843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:58:14.240440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"260'259","reported_seq":821,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:20.713621+0000","last_change":"2024-09-14T11:23:20.713621+0000","last_active":"2024-09-14T11:23:20.713621+0000","last_peered":"2024-09-14T11:23:20.713621+0000","last_clean":"2024-09-14T11:23:20.713621+0000","last_became_active":"2024-09-14T10:45:49.735124+0000","last_became_peered":"2024-09-14T10:45:49.735124+0000","last_unstale":"2024-09-14T11:23:20.713621+0000","last_undegraded":"2024-09-14T11:23:20.713621+0000","last_fullsized":"2024-09-14T11:23:20.713621+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'259","last_scrub_stamp":"2024-09-14T11:23:20.713538+0000","last_deep_scrub":"260'259","last_deep_scrub_stamp":"2024-09-14T11:23:20.713538+0000","last_clean_scrub_stamp":"2024-09-14T11:23:20.713538+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:07:37.494555+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45256,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":435,"num_read_kb":1035,"num_write":356,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":486,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:28.659376+0000","last_change":"2024-09-14T11:23:28.659376+0000","last_active":"2024-09-14T11:23:28.659376+0000","last_peered":"2024-09-14T11:23:28.659376+0000","last_clean":"2024-09-14T11:23:28.659376+0000","last_became_active":"2024-09-14T10:45:51.744757+0000","last_became_peered":"2024-09-14T10:45:51.744757+0000","last_unstale":"2024-09-14T11:23:28.659376+0000","last_undegraded":"2024-09-14T11:23:28.659376+0000","last_fullsized":"2024-09-14T11:23:28.659376+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:28.659275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:28.659275+0000","last_clean_scrub_stamp":"2024-09-14T11:23:28.659275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:33.963832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"260'2451","reported_seq":4270,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:22.593366+0000","last_change":"2024-09-14T11:23:22.593262+0000","last_active":"2024-09-14T11:23:22.593366+0000","last_peered":"2024-09-14T11:23:22.593366+0000","last_clean":"2024-09-14T11:23:22.593366+0000","last_became_active":"2024-09-14T10:45:53.752708+0000","last_became_peered":"2024-09-14T10:45:53.752708+0000","last_unstale":"2024-09-14T11:23:22.593366+0000","last_undegraded":"2024-09-14T11:23:22.593366+0000","last_fullsized":"2024-09-14T11:23:22.593366+0000","mapping_epoch":34,"log_start":"260'2400","ondisk_log_start":"260'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2451","last_scrub_stamp":"2024-09-14T11:23:22.593158+0000","last_deep_scrub":"260'2451","last_deep_scrub_stamp":"2024-09-14T11:23:22.593158+0000","last_clean_scrub_stamp":"2024-09-14T11:23:22.593158+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":2400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:55.784277+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6140,"num_read_kb":6145,"num_write":4932,"num_write_kb":1822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"260'761","reported_seq":2474,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:08.293507+0000","last_change":"2024-09-14T11:23:08.293507+0000","last_active":"2024-09-14T11:23:08.293507+0000","last_peered":"2024-09-14T11:23:08.293507+0000","last_clean":"2024-09-14T11:23:08.293507+0000","last_became_active":"2024-09-14T10:45:45.722006+0000","last_became_peered":"2024-09-14T10:45:45.722006+0000","last_unstale":"2024-09-14T11:23:08.293507+0000","last_undegraded":"2024-09-14T11:23:08.293507+0000","last_fullsized":"2024-09-14T11:23:08.293507+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'761","last_scrub_stamp":"2024-09-14T11:23:08.293416+0000","last_deep_scrub":"260'761","last_deep_scrub_stamp":"2024-09-14T11:23:08.293416+0000","last_clean_scrub_stamp":"2024-09-14T11:23:08.293416+0000","objects_scrubbed":4,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:13:56.536477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4059,"num_read_kb":3717,"num_write":984,"num_write_kb":359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4086,"num_omap_keys":16,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"260'375","reported_seq":1021,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:02.277049+0000","last_change":"2024-09-14T11:23:02.277049+0000","last_active":"2024-09-14T11:23:02.277049+0000","last_peered":"2024-09-14T11:23:02.277049+0000","last_clean":"2024-09-14T11:23:02.277049+0000","last_became_active":"2024-09-14T10:45:43.675954+0000","last_became_peered":"2024-09-14T10:45:43.675954+0000","last_unstale":"2024-09-14T11:23:02.277049+0000","last_undegraded":"2024-09-14T11:23:02.277049+0000","last_fullsized":"2024-09-14T11:23:02.277049+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'375","last_scrub_stamp":"2024-09-14T11:23:02.276946+0000","last_deep_scrub":"260'375","last_deep_scrub_stamp":"2024-09-14T11:23:02.276946+0000","last_clean_scrub_stamp":"2024-09-14T11:23:02.276946+0000","objects_scrubbed":6,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:47.616118+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":645,"num_read_kb":32892,"num_write":1136,"num_write_kb":70045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"260'6","reported_seq":967,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:19.375400+0000","last_change":"2024-09-14T11:23:19.375400+0000","last_active":"2024-09-14T11:23:19.375400+0000","last_peered":"2024-09-14T11:23:19.375400+0000","last_clean":"2024-09-14T11:23:19.375400+0000","last_became_active":"2024-09-14T10:45:47.723389+0000","last_became_peered":"2024-09-14T10:45:47.723389+0000","last_unstale":"2024-09-14T11:23:19.375400+0000","last_undegraded":"2024-09-14T11:23:19.375400+0000","last_fullsized":"2024-09-14T11:23:19.375400+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-14T11:23:19.375250+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-14T11:23:19.375250+0000","last_clean_scrub_stamp":"2024-09-14T11:23:19.375250+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:04:49.975519+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"260'279","reported_seq":848,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:30.260836+0000","last_change":"2024-09-14T11:23:30.260836+0000","last_active":"2024-09-14T11:23:30.260836+0000","last_peered":"2024-09-14T11:23:30.260836+0000","last_clean":"2024-09-14T11:23:30.260836+0000","last_became_active":"2024-09-14T10:45:49.729120+0000","last_became_peered":"2024-09-14T10:45:49.729120+0000","last_unstale":"2024-09-14T11:23:30.260836+0000","last_undegraded":"2024-09-14T11:23:30.260836+0000","last_fullsized":"2024-09-14T11:23:30.260836+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'279","last_scrub_stamp":"2024-09-14T11:23:30.260726+0000","last_deep_scrub":"260'279","last_deep_scrub_stamp":"2024-09-14T11:23:30.260726+0000","last_clean_scrub_stamp":"2024-09-14T11:23:30.260726+0000","objects_scrubbed":7,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:13:27.531076+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43970,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":444,"num_read_kb":984,"num_write":354,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"260'805","reported_seq":2513,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:26.502137+0000","last_change":"2024-09-14T11:23:26.502137+0000","last_active":"2024-09-14T11:23:26.502137+0000","last_peered":"2024-09-14T11:23:26.502137+0000","last_clean":"2024-09-14T11:23:26.502137+0000","last_became_active":"2024-09-14T10:45:51.744869+0000","last_became_peered":"2024-09-14T10:45:51.744869+0000","last_unstale":"2024-09-14T11:23:26.502137+0000","last_undegraded":"2024-09-14T11:23:26.502137+0000","last_fullsized":"2024-09-14T11:23:26.502137+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'805","last_scrub_stamp":"2024-09-14T11:23:26.502056+0000","last_deep_scrub":"260'805","last_deep_scrub_stamp":"2024-09-14T11:23:26.502056+0000","last_clean_scrub_stamp":"2024-09-14T11:23:26.502056+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:05.497437+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"260'166","reported_seq":648,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:22.233284+0000","last_change":"2024-09-14T11:23:22.233284+0000","last_active":"2024-09-14T11:23:22.233284+0000","last_peered":"2024-09-14T11:23:22.233284+0000","last_clean":"2024-09-14T11:23:22.233284+0000","last_became_active":"2024-09-14T10:45:53.755367+0000","last_became_peered":"2024-09-14T10:45:53.755367+0000","last_unstale":"2024-09-14T11:23:22.233284+0000","last_undegraded":"2024-09-14T11:23:22.233284+0000","last_fullsized":"2024-09-14T11:23:22.233284+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'166","last_scrub_stamp":"2024-09-14T11:23:22.233186+0000","last_deep_scrub":"260'166","last_deep_scrub_stamp":"2024-09-14T11:23:22.233186+0000","last_clean_scrub_stamp":"2024-09-14T11:23:22.233186+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:09.280581+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":815,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":135,"num_read_kb":134,"num_write":407,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"260'763","reported_seq":2262,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:10.356193+0000","last_change":"2024-09-14T11:23:10.356193+0000","last_active":"2024-09-14T11:23:10.356193+0000","last_peered":"2024-09-14T11:23:10.356193+0000","last_clean":"2024-09-14T11:23:10.356193+0000","last_became_active":"2024-09-14T10:45:45.719864+0000","last_became_peered":"2024-09-14T10:45:45.719864+0000","last_unstale":"2024-09-14T11:23:10.356193+0000","last_undegraded":"2024-09-14T11:23:10.356193+0000","last_fullsized":"2024-09-14T11:23:10.356193+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'763","last_scrub_stamp":"2024-09-14T11:23:10.356108+0000","last_deep_scrub":"260'763","last_deep_scrub_stamp":"2024-09-14T11:23:10.356108+0000","last_clean_scrub_stamp":"2024-09-14T11:23:10.356108+0000","objects_scrubbed":2,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:25:13.250358+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3610,"num_read_kb":3266,"num_write":990,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"260'352","reported_seq":985,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:56.642945+0000","last_change":"2024-09-14T11:22:56.642945+0000","last_active":"2024-09-14T11:22:56.642945+0000","last_peered":"2024-09-14T11:22:56.642945+0000","last_clean":"2024-09-14T11:22:56.642945+0000","last_became_active":"2024-09-14T10:45:43.681137+0000","last_became_peered":"2024-09-14T10:45:43.681137+0000","last_unstale":"2024-09-14T11:22:56.642945+0000","last_undegraded":"2024-09-14T11:22:56.642945+0000","last_fullsized":"2024-09-14T11:22:56.642945+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'352","last_scrub_stamp":"2024-09-14T11:22:56.642848+0000","last_deep_scrub":"260'352","last_deep_scrub_stamp":"2024-09-14T11:22:56.642848+0000","last_clean_scrub_stamp":"2024-09-14T11:22:56.642848+0000","objects_scrubbed":6,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:18.121328+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":525,"num_read_kb":31159,"num_write":1040,"num_write_kb":37353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:12.307193+0000","last_change":"2024-09-14T11:23:12.307193+0000","last_active":"2024-09-14T11:23:12.307193+0000","last_peered":"2024-09-14T11:23:12.307193+0000","last_clean":"2024-09-14T11:23:12.307193+0000","last_became_active":"2024-09-14T10:45:47.729815+0000","last_became_peered":"2024-09-14T10:45:47.729815+0000","last_unstale":"2024-09-14T11:23:12.307193+0000","last_undegraded":"2024-09-14T11:23:12.307193+0000","last_fullsized":"2024-09-14T11:23:12.307193+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:12.307094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:12.307094+0000","last_clean_scrub_stamp":"2024-09-14T11:23:12.307094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:08.115928+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"260'516","reported_seq":1140,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:23.707399+0000","last_change":"2024-09-14T11:23:23.707399+0000","last_active":"2024-09-14T11:23:23.707399+0000","last_peered":"2024-09-14T11:23:23.707399+0000","last_clean":"2024-09-14T11:23:23.707399+0000","last_became_active":"2024-09-14T10:45:49.735297+0000","last_became_peered":"2024-09-14T10:45:49.735297+0000","last_unstale":"2024-09-14T11:23:23.707399+0000","last_undegraded":"2024-09-14T11:23:23.707399+0000","last_fullsized":"2024-09-14T11:23:23.707399+0000","mapping_epoch":30,"log_start":"260'501","ondisk_log_start":"260'501","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'516","last_scrub_stamp":"2024-09-14T11:23:23.707297+0000","last_deep_scrub":"260'516","last_deep_scrub_stamp":"2024-09-14T11:23:23.707297+0000","last_clean_scrub_stamp":"2024-09-14T11:23:23.707297+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":501,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:06.016393+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93593,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":881,"num_read_kb":2160,"num_write":740,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":479,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:25.476382+0000","last_change":"2024-09-14T11:23:25.476382+0000","last_active":"2024-09-14T11:23:25.476382+0000","last_peered":"2024-09-14T11:23:25.476382+0000","last_clean":"2024-09-14T11:23:25.476382+0000","last_became_active":"2024-09-14T10:45:51.749045+0000","last_became_peered":"2024-09-14T10:45:51.749045+0000","last_unstale":"2024-09-14T11:23:25.476382+0000","last_undegraded":"2024-09-14T11:23:25.476382+0000","last_fullsized":"2024-09-14T11:23:25.476382+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:25.476290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:25.476290+0000","last_clean_scrub_stamp":"2024-09-14T11:23:25.476290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:09.435011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"260'127","reported_seq":640,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:21.718946+0000","last_change":"2024-09-14T11:23:21.718946+0000","last_active":"2024-09-14T11:23:21.718946+0000","last_peered":"2024-09-14T11:23:21.718946+0000","last_clean":"2024-09-14T11:23:21.718946+0000","last_became_active":"2024-09-14T10:45:53.751736+0000","last_became_peered":"2024-09-14T10:45:53.751736+0000","last_unstale":"2024-09-14T11:23:21.718946+0000","last_undegraded":"2024-09-14T11:23:21.718946+0000","last_fullsized":"2024-09-14T11:23:21.718946+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'127","last_scrub_stamp":"2024-09-14T11:23:21.718860+0000","last_deep_scrub":"260'127","last_deep_scrub_stamp":"2024-09-14T11:23:21.718860+0000","last_clean_scrub_stamp":"2024-09-14T11:23:21.718860+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:51:05.364854+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":704,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":191,"num_read_kb":171,"num_write":290,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"260'1192","reported_seq":2750,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:02.564306+0000","last_change":"2024-09-14T11:23:02.564306+0000","last_active":"2024-09-14T11:23:02.564306+0000","last_peered":"2024-09-14T11:23:02.564306+0000","last_clean":"2024-09-14T11:23:02.564306+0000","last_became_active":"2024-09-14T10:45:45.714723+0000","last_became_peered":"2024-09-14T10:45:45.714723+0000","last_unstale":"2024-09-14T11:23:02.564306+0000","last_undegraded":"2024-09-14T11:23:02.564306+0000","last_fullsized":"2024-09-14T11:23:02.564306+0000","mapping_epoch":26,"log_start":"260'1100","ondisk_log_start":"260'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1192","last_scrub_stamp":"2024-09-14T11:23:02.564228+0000","last_deep_scrub":"260'1192","last_deep_scrub_stamp":"2024-09-14T11:23:02.564228+0000","last_clean_scrub_stamp":"2024-09-14T11:23:02.564228+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":1100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:57.673628+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5470,"num_read_kb":4821,"num_write":1659,"num_write_kb":709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"260'368","reported_seq":999,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:58.738182+0000","last_change":"2024-09-14T11:22:58.738182+0000","last_active":"2024-09-14T11:22:58.738182+0000","last_peered":"2024-09-14T11:22:58.738182+0000","last_clean":"2024-09-14T11:22:58.738182+0000","last_became_active":"2024-09-14T10:45:43.686531+0000","last_became_peered":"2024-09-14T10:45:43.686531+0000","last_unstale":"2024-09-14T11:22:58.738182+0000","last_undegraded":"2024-09-14T11:22:58.738182+0000","last_fullsized":"2024-09-14T11:22:58.738182+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'368","last_scrub_stamp":"2024-09-14T11:22:58.738083+0000","last_deep_scrub":"260'368","last_deep_scrub_stamp":"2024-09-14T11:22:58.738083+0000","last_clean_scrub_stamp":"2024-09-14T11:22:58.738083+0000","objects_scrubbed":5,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:58:54.493504+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133692,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":671,"num_read_kb":7607,"num_write":1262,"num_write_kb":48356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:11.697908+0000","last_change":"2024-09-14T11:23:11.697908+0000","last_active":"2024-09-14T11:23:11.697908+0000","last_peered":"2024-09-14T11:23:11.697908+0000","last_clean":"2024-09-14T11:23:11.697908+0000","last_became_active":"2024-09-14T10:45:47.728213+0000","last_became_peered":"2024-09-14T10:45:47.728213+0000","last_unstale":"2024-09-14T11:23:11.697908+0000","last_undegraded":"2024-09-14T11:23:11.697908+0000","last_fullsized":"2024-09-14T11:23:11.697908+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:11.697822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:11.697822+0000","last_clean_scrub_stamp":"2024-09-14T11:23:11.697822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:14:58.462465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"260'269","reported_seq":834,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:15.532763+0000","last_change":"2024-09-14T11:23:15.532763+0000","last_active":"2024-09-14T11:23:15.532763+0000","last_peered":"2024-09-14T11:23:15.532763+0000","last_clean":"2024-09-14T11:23:15.532763+0000","last_became_active":"2024-09-14T10:45:49.732813+0000","last_became_peered":"2024-09-14T10:45:49.732813+0000","last_unstale":"2024-09-14T11:23:15.532763+0000","last_undegraded":"2024-09-14T11:23:15.532763+0000","last_fullsized":"2024-09-14T11:23:15.532763+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'269","last_scrub_stamp":"2024-09-14T11:23:15.532664+0000","last_deep_scrub":"260'269","last_deep_scrub_stamp":"2024-09-14T11:23:15.532664+0000","last_clean_scrub_stamp":"2024-09-14T11:23:15.532664+0000","objects_scrubbed":7,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:03.580995+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14232,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":431,"num_read_kb":915,"num_write":388,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":481,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:15.618806+0000","last_change":"2024-09-14T11:23:15.618806+0000","last_active":"2024-09-14T11:23:15.618806+0000","last_peered":"2024-09-14T11:23:15.618806+0000","last_clean":"2024-09-14T11:23:15.618806+0000","last_became_active":"2024-09-14T10:45:51.748381+0000","last_became_peered":"2024-09-14T10:45:51.748381+0000","last_unstale":"2024-09-14T11:23:15.618806+0000","last_undegraded":"2024-09-14T11:23:15.618806+0000","last_fullsized":"2024-09-14T11:23:15.618806+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:15.618720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:15.618720+0000","last_clean_scrub_stamp":"2024-09-14T11:23:15.618720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:33:06.847139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"260'101","reported_seq":578,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:29.538661+0000","last_change":"2024-09-14T11:23:29.538661+0000","last_active":"2024-09-14T11:23:29.538661+0000","last_peered":"2024-09-14T11:23:29.538661+0000","last_clean":"2024-09-14T11:23:29.538661+0000","last_became_active":"2024-09-14T10:45:53.755022+0000","last_became_peered":"2024-09-14T10:45:53.755022+0000","last_unstale":"2024-09-14T11:23:29.538661+0000","last_undegraded":"2024-09-14T11:23:29.538661+0000","last_fullsized":"2024-09-14T11:23:29.538661+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'101","last_scrub_stamp":"2024-09-14T11:23:29.538571+0000","last_deep_scrub":"260'101","last_deep_scrub_stamp":"2024-09-14T11:23:29.538571+0000","last_clean_scrub_stamp":"2024-09-14T11:23:29.538571+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:37.419182+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":73,"num_read_kb":72,"num_write":223,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"260'436","reported_seq":1984,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:15.257923+0000","last_change":"2024-09-14T11:23:15.257923+0000","last_active":"2024-09-14T11:23:15.257923+0000","last_peered":"2024-09-14T11:23:15.257923+0000","last_clean":"2024-09-14T11:23:15.257923+0000","last_became_active":"2024-09-14T10:45:45.710367+0000","last_became_peered":"2024-09-14T10:45:45.710367+0000","last_unstale":"2024-09-14T11:23:15.257923+0000","last_undegraded":"2024-09-14T11:23:15.257923+0000","last_fullsized":"2024-09-14T11:23:15.257923+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'436","last_scrub_stamp":"2024-09-14T11:23:15.257828+0000","last_deep_scrub":"260'436","last_deep_scrub_stamp":"2024-09-14T11:23:15.257828+0000","last_clean_scrub_stamp":"2024-09-14T11:23:15.257828+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:59.527838+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2526,"num_read_kb":2387,"num_write":527,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"260'332","reported_seq":1023,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:01.297073+0000","last_change":"2024-09-14T11:23:01.297073+0000","last_active":"2024-09-14T11:23:01.297073+0000","last_peered":"2024-09-14T11:23:01.297073+0000","last_clean":"2024-09-14T11:23:01.297073+0000","last_became_active":"2024-09-14T10:45:43.676514+0000","last_became_peered":"2024-09-14T10:45:43.676514+0000","last_unstale":"2024-09-14T11:23:01.297073+0000","last_undegraded":"2024-09-14T11:23:01.297073+0000","last_fullsized":"2024-09-14T11:23:01.297073+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'332","last_scrub_stamp":"2024-09-14T11:23:01.296956+0000","last_deep_scrub":"260'332","last_deep_scrub_stamp":"2024-09-14T11:23:01.296956+0000","last_clean_scrub_stamp":"2024-09-14T11:23:01.296956+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:31.917595+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174780,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":649,"num_read_kb":125837,"num_write":1068,"num_write_kb":34909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":486,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:20.406091+0000","last_change":"2024-09-14T11:23:20.406091+0000","last_active":"2024-09-14T11:23:20.406091+0000","last_peered":"2024-09-14T11:23:20.406091+0000","last_clean":"2024-09-14T11:23:20.406091+0000","last_became_active":"2024-09-14T10:45:47.727632+0000","last_became_peered":"2024-09-14T10:45:47.727632+0000","last_unstale":"2024-09-14T11:23:20.406091+0000","last_undegraded":"2024-09-14T11:23:20.406091+0000","last_fullsized":"2024-09-14T11:23:20.406091+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:20.406006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:20.406006+0000","last_clean_scrub_stamp":"2024-09-14T11:23:20.406006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:21:58.043972+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"260'299","reported_seq":866,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:22.413178+0000","last_change":"2024-09-14T11:23:22.413178+0000","last_active":"2024-09-14T11:23:22.413178+0000","last_peered":"2024-09-14T11:23:22.413178+0000","last_clean":"2024-09-14T11:23:22.413178+0000","last_became_active":"2024-09-14T10:45:49.737690+0000","last_became_peered":"2024-09-14T10:45:49.737690+0000","last_unstale":"2024-09-14T11:23:22.413178+0000","last_undegraded":"2024-09-14T11:23:22.413178+0000","last_fullsized":"2024-09-14T11:23:22.413178+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'299","last_scrub_stamp":"2024-09-14T11:23:22.413077+0000","last_deep_scrub":"260'299","last_deep_scrub_stamp":"2024-09-14T11:23:22.413077+0000","last_clean_scrub_stamp":"2024-09-14T11:23:22.413077+0000","objects_scrubbed":7,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:29.181172+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69554,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":489,"num_read_kb":1163,"num_write":398,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"260'778","reported_seq":2028,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:14.637328+0000","last_change":"2024-09-14T11:23:14.637328+0000","last_active":"2024-09-14T11:23:14.637328+0000","last_peered":"2024-09-14T11:23:14.637328+0000","last_clean":"2024-09-14T11:23:14.637328+0000","last_became_active":"2024-09-14T10:45:51.749478+0000","last_became_peered":"2024-09-14T10:45:51.749478+0000","last_unstale":"2024-09-14T11:23:14.637328+0000","last_undegraded":"2024-09-14T11:23:14.637328+0000","last_fullsized":"2024-09-14T11:23:14.637328+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'778","last_scrub_stamp":"2024-09-14T11:23:14.637243+0000","last_deep_scrub":"260'778","last_deep_scrub_stamp":"2024-09-14T11:23:14.637243+0000","last_clean_scrub_stamp":"2024-09-14T11:23:14.637243+0000","objects_scrubbed":1,"log_size":78,"log_dups_size":700,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:52.460981+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"260'132","reported_seq":622,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:19.230569+0000","last_change":"2024-09-14T11:23:19.230503+0000","last_active":"2024-09-14T11:23:19.230569+0000","last_peered":"2024-09-14T11:23:19.230569+0000","last_clean":"2024-09-14T11:23:19.230569+0000","last_became_active":"2024-09-14T10:45:53.746254+0000","last_became_peered":"2024-09-14T10:45:53.746254+0000","last_unstale":"2024-09-14T11:23:19.230569+0000","last_undegraded":"2024-09-14T11:23:19.230569+0000","last_fullsized":"2024-09-14T11:23:19.230569+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'132","last_scrub_stamp":"2024-09-14T11:23:19.230403+0000","last_deep_scrub":"260'132","last_deep_scrub_stamp":"2024-09-14T11:23:19.230403+0000","last_clean_scrub_stamp":"2024-09-14T11:23:19.230403+0000","objects_scrubbed":4,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:11.653373+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1445,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":145,"num_read_kb":134,"num_write":327,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"260'484","reported_seq":2063,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:03.211250+0000","last_change":"2024-09-14T11:23:03.211250+0000","last_active":"2024-09-14T11:23:03.211250+0000","last_peered":"2024-09-14T11:23:03.211250+0000","last_clean":"2024-09-14T11:23:03.211250+0000","last_became_active":"2024-09-14T10:45:45.720660+0000","last_became_peered":"2024-09-14T10:45:45.720660+0000","last_unstale":"2024-09-14T11:23:03.211250+0000","last_undegraded":"2024-09-14T11:23:03.211250+0000","last_fullsized":"2024-09-14T11:23:03.211250+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'484","last_scrub_stamp":"2024-09-14T11:23:03.211174+0000","last_deep_scrub":"260'484","last_deep_scrub_stamp":"2024-09-14T11:23:03.211174+0000","last_clean_scrub_stamp":"2024-09-14T11:23:03.211174+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:30.932990+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2593,"num_read_kb":2426,"num_write":578,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"260'355","reported_seq":971,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:03.251849+0000","last_change":"2024-09-14T11:23:03.251849+0000","last_active":"2024-09-14T11:23:03.251849+0000","last_peered":"2024-09-14T11:23:03.251849+0000","last_clean":"2024-09-14T11:23:03.251849+0000","last_became_active":"2024-09-14T10:45:43.690517+0000","last_became_peered":"2024-09-14T10:45:43.690517+0000","last_unstale":"2024-09-14T11:23:03.251849+0000","last_undegraded":"2024-09-14T11:23:03.251849+0000","last_fullsized":"2024-09-14T11:23:03.251849+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'355","last_scrub_stamp":"2024-09-14T11:23:03.251741+0000","last_deep_scrub":"260'355","last_deep_scrub_stamp":"2024-09-14T11:23:03.251741+0000","last_clean_scrub_stamp":"2024-09-14T11:23:03.251741+0000","objects_scrubbed":9,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:26.884843+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267379,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":525,"num_read_kb":51932,"num_write":1051,"num_write_kb":23808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"260'4","reported_seq":1450,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:12.602532+0000","last_change":"2024-09-14T11:23:12.602532+0000","last_active":"2024-09-14T11:23:12.602532+0000","last_peered":"2024-09-14T11:23:12.602532+0000","last_clean":"2024-09-14T11:23:12.602532+0000","last_became_active":"2024-09-14T10:45:47.720716+0000","last_became_peered":"2024-09-14T10:45:47.720716+0000","last_unstale":"2024-09-14T11:23:12.602532+0000","last_undegraded":"2024-09-14T11:23:12.602532+0000","last_fullsized":"2024-09-14T11:23:12.602532+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-14T11:23:12.602439+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-14T11:23:12.602439+0000","last_clean_scrub_stamp":"2024-09-14T11:23:12.602439+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:13:05.573930+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":953,"num_read_kb":953,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"260'73","reported_seq":576,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:24.289915+0000","last_change":"2024-09-14T11:23:24.289915+0000","last_active":"2024-09-14T11:23:24.289915+0000","last_peered":"2024-09-14T11:23:24.289915+0000","last_clean":"2024-09-14T11:23:24.289915+0000","last_became_active":"2024-09-14T10:45:49.732913+0000","last_became_peered":"2024-09-14T10:45:49.732913+0000","last_unstale":"2024-09-14T11:23:24.289915+0000","last_undegraded":"2024-09-14T11:23:24.289915+0000","last_fullsized":"2024-09-14T11:23:24.289915+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'73","last_scrub_stamp":"2024-09-14T11:23:24.289827+0000","last_deep_scrub":"260'73","last_deep_scrub_stamp":"2024-09-14T11:23:24.289827+0000","last_clean_scrub_stamp":"2024-09-14T11:23:24.289827+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:30.218833+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":64,"num_read_kb":57,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"260'797","reported_seq":2422,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:18.572515+0000","last_change":"2024-09-14T11:23:18.572515+0000","last_active":"2024-09-14T11:23:18.572515+0000","last_peered":"2024-09-14T11:23:18.572515+0000","last_clean":"2024-09-14T11:23:18.572515+0000","last_became_active":"2024-09-14T10:45:51.741102+0000","last_became_peered":"2024-09-14T10:45:51.741102+0000","last_unstale":"2024-09-14T11:23:18.572515+0000","last_undegraded":"2024-09-14T11:23:18.572515+0000","last_fullsized":"2024-09-14T11:23:18.572515+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'797","last_scrub_stamp":"2024-09-14T11:23:18.572420+0000","last_deep_scrub":"260'797","last_deep_scrub_stamp":"2024-09-14T11:23:18.572420+0000","last_clean_scrub_stamp":"2024-09-14T11:23:18.572420+0000","objects_scrubbed":1,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:22:02.078595+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"260'153","reported_seq":668,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:20.508622+0000","last_change":"2024-09-14T11:23:20.508558+0000","last_active":"2024-09-14T11:23:20.508622+0000","last_peered":"2024-09-14T11:23:20.508622+0000","last_clean":"2024-09-14T11:23:20.508622+0000","last_became_active":"2024-09-14T10:45:53.752100+0000","last_became_peered":"2024-09-14T10:45:53.752100+0000","last_unstale":"2024-09-14T11:23:20.508622+0000","last_undegraded":"2024-09-14T11:23:20.508622+0000","last_fullsized":"2024-09-14T11:23:20.508622+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'153","last_scrub_stamp":"2024-09-14T11:23:20.508469+0000","last_deep_scrub":"260'153","last_deep_scrub_stamp":"2024-09-14T11:23:20.508469+0000","last_clean_scrub_stamp":"2024-09-14T11:23:20.508469+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:34.442103+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":861,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":268,"num_read_kb":228,"num_write":378,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"260'470","reported_seq":2079,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:02.791198+0000","last_change":"2024-09-14T11:23:02.791198+0000","last_active":"2024-09-14T11:23:02.791198+0000","last_peered":"2024-09-14T11:23:02.791198+0000","last_clean":"2024-09-14T11:23:02.791198+0000","last_became_active":"2024-09-14T10:45:45.719221+0000","last_became_peered":"2024-09-14T10:45:45.719221+0000","last_unstale":"2024-09-14T11:23:02.791198+0000","last_undegraded":"2024-09-14T11:23:02.791198+0000","last_fullsized":"2024-09-14T11:23:02.791198+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'470","last_scrub_stamp":"2024-09-14T11:23:02.791102+0000","last_deep_scrub":"260'470","last_deep_scrub_stamp":"2024-09-14T11:23:02.791102+0000","last_clean_scrub_stamp":"2024-09-14T11:23:02.791102+0000","objects_scrubbed":2,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:33:44.209906+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2509,"num_read_kb":2365,"num_write":566,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":467,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"260'322","reported_seq":932,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:59.033947+0000","last_change":"2024-09-14T11:22:59.033947+0000","last_active":"2024-09-14T11:22:59.033947+0000","last_peered":"2024-09-14T11:22:59.033947+0000","last_clean":"2024-09-14T11:22:59.033947+0000","last_became_active":"2024-09-14T10:45:43.690417+0000","last_became_peered":"2024-09-14T10:45:43.690417+0000","last_unstale":"2024-09-14T11:22:59.033947+0000","last_undegraded":"2024-09-14T11:22:59.033947+0000","last_fullsized":"2024-09-14T11:22:59.033947+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'322","last_scrub_stamp":"2024-09-14T11:22:59.033852+0000","last_deep_scrub":"260'322","last_deep_scrub_stamp":"2024-09-14T11:22:59.033852+0000","last_clean_scrub_stamp":"2024-09-14T11:22:59.033852+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:02.624805+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":503,"num_read_kb":28260,"num_write":967,"num_write_kb":36225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:24.159861+0000","last_change":"2024-09-14T11:23:24.159861+0000","last_active":"2024-09-14T11:23:24.159861+0000","last_peered":"2024-09-14T11:23:24.159861+0000","last_clean":"2024-09-14T11:23:24.159861+0000","last_became_active":"2024-09-14T10:45:47.730790+0000","last_became_peered":"2024-09-14T10:45:47.730790+0000","last_unstale":"2024-09-14T11:23:24.159861+0000","last_undegraded":"2024-09-14T11:23:24.159861+0000","last_fullsized":"2024-09-14T11:23:24.159861+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:24.159725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:24.159725+0000","last_clean_scrub_stamp":"2024-09-14T11:23:24.159725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:30.358278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"260'331","reported_seq":925,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:14.556096+0000","last_change":"2024-09-14T11:23:14.556096+0000","last_active":"2024-09-14T11:23:14.556096+0000","last_peered":"2024-09-14T11:23:14.556096+0000","last_clean":"2024-09-14T11:23:14.556096+0000","last_became_active":"2024-09-14T10:45:49.735482+0000","last_became_peered":"2024-09-14T10:45:49.735482+0000","last_unstale":"2024-09-14T11:23:14.556096+0000","last_undegraded":"2024-09-14T11:23:14.556096+0000","last_fullsized":"2024-09-14T11:23:14.556096+0000","mapping_epoch":30,"log_start":"260'300","ondisk_log_start":"260'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'331","last_scrub_stamp":"2024-09-14T11:23:14.555977+0000","last_deep_scrub":"260'331","last_deep_scrub_stamp":"2024-09-14T11:23:14.555977+0000","last_clean_scrub_stamp":"2024-09-14T11:23:14.555977+0000","objects_scrubbed":8,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:18.071778+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46045,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":538,"num_read_kb":1149,"num_write":426,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":476,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:12.387005+0000","last_change":"2024-09-14T11:23:12.387005+0000","last_active":"2024-09-14T11:23:12.387005+0000","last_peered":"2024-09-14T11:23:12.387005+0000","last_clean":"2024-09-14T11:23:12.387005+0000","last_became_active":"2024-09-14T10:45:51.750669+0000","last_became_peered":"2024-09-14T10:45:51.750669+0000","last_unstale":"2024-09-14T11:23:12.387005+0000","last_undegraded":"2024-09-14T11:23:12.387005+0000","last_fullsized":"2024-09-14T11:23:12.387005+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:12.386872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:12.386872+0000","last_clean_scrub_stamp":"2024-09-14T11:23:12.386872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:17.249546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"260'121","reported_seq":606,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:20.690257+0000","last_change":"2024-09-14T11:23:20.690198+0000","last_active":"2024-09-14T11:23:20.690257+0000","last_peered":"2024-09-14T11:23:20.690257+0000","last_clean":"2024-09-14T11:23:20.690257+0000","last_became_active":"2024-09-14T10:45:53.748865+0000","last_became_peered":"2024-09-14T10:45:53.748865+0000","last_unstale":"2024-09-14T11:23:20.690257+0000","last_undegraded":"2024-09-14T11:23:20.690257+0000","last_fullsized":"2024-09-14T11:23:20.690257+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'121","last_scrub_stamp":"2024-09-14T11:23:20.690102+0000","last_deep_scrub":"260'121","last_deep_scrub_stamp":"2024-09-14T11:23:20.690102+0000","last_clean_scrub_stamp":"2024-09-14T11:23:20.690102+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:13:31.152731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":116,"num_write":279,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"260'614","reported_seq":2414,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:14.210822+0000","last_change":"2024-09-14T11:23:14.210717+0000","last_active":"2024-09-14T11:23:14.210822+0000","last_peered":"2024-09-14T11:23:14.210822+0000","last_clean":"2024-09-14T11:23:14.210822+0000","last_became_active":"2024-09-14T10:45:45.716236+0000","last_became_peered":"2024-09-14T10:45:45.716236+0000","last_unstale":"2024-09-14T11:23:14.210822+0000","last_undegraded":"2024-09-14T11:23:14.210822+0000","last_fullsized":"2024-09-14T11:23:14.210822+0000","mapping_epoch":26,"log_start":"260'600","ondisk_log_start":"260'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'614","last_scrub_stamp":"2024-09-14T11:23:14.210620+0000","last_deep_scrub":"260'614","last_deep_scrub_stamp":"2024-09-14T11:23:14.210620+0000","last_clean_scrub_stamp":"2024-09-14T11:23:14.210620+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":600,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:38:26.756269+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3315,"num_read_kb":3084,"num_write":730,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"260'74","reported_seq":612,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:55.699802+0000","last_change":"2024-09-14T11:22:55.699728+0000","last_active":"2024-09-14T11:22:55.699802+0000","last_peered":"2024-09-14T11:22:55.699802+0000","last_clean":"2024-09-14T11:22:55.699802+0000","last_became_active":"2024-09-14T10:45:28.985499+0000","last_became_peered":"2024-09-14T10:45:28.985499+0000","last_unstale":"2024-09-14T11:22:55.699802+0000","last_undegraded":"2024-09-14T11:22:55.699802+0000","last_fullsized":"2024-09-14T11:22:55.699802+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'74","last_scrub_stamp":"2024-09-14T11:22:55.699647+0000","last_deep_scrub":"260'74","last_deep_scrub_stamp":"2024-09-14T11:22:55.699647+0000","last_clean_scrub_stamp":"2024-09-14T11:22:55.699647+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:04.417375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"260'2","reported_seq":514,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:58.303627+0000","last_change":"2024-09-14T11:22:58.303578+0000","last_active":"2024-09-14T11:22:58.303627+0000","last_peered":"2024-09-14T11:22:58.303627+0000","last_clean":"2024-09-14T11:22:58.303627+0000","last_became_active":"2024-09-14T10:45:33.610592+0000","last_became_peered":"2024-09-14T10:45:33.610592+0000","last_unstale":"2024-09-14T11:22:58.303627+0000","last_undegraded":"2024-09-14T11:22:58.303627+0000","last_fullsized":"2024-09-14T11:22:58.303627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:22:58.303510+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:22:58.303510+0000","last_clean_scrub_stamp":"2024-09-14T11:22:58.303510+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:42.914407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043055799999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"260'280","reported_seq":928,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:57.084934+0000","last_change":"2024-09-14T11:22:57.084842+0000","last_active":"2024-09-14T11:22:57.084934+0000","last_peered":"2024-09-14T11:22:57.084934+0000","last_clean":"2024-09-14T11:22:57.084934+0000","last_became_active":"2024-09-14T10:45:43.690248+0000","last_became_peered":"2024-09-14T10:45:43.690248+0000","last_unstale":"2024-09-14T11:22:57.084934+0000","last_undegraded":"2024-09-14T11:22:57.084934+0000","last_fullsized":"2024-09-14T11:22:57.084934+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'280","last_scrub_stamp":"2024-09-14T11:22:57.084704+0000","last_deep_scrub":"260'280","last_deep_scrub_stamp":"2024-09-14T11:22:57.084704+0000","last_clean_scrub_stamp":"2024-09-14T11:22:57.084704+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:34.397521+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":552,"num_read_kb":56771,"num_write":951,"num_write_kb":24880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":496,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:11.598716+0000","last_change":"2024-09-14T11:23:11.598638+0000","last_active":"2024-09-14T11:23:11.598716+0000","last_peered":"2024-09-14T11:23:11.598716+0000","last_clean":"2024-09-14T11:23:11.598716+0000","last_became_active":"2024-09-14T10:45:47.723495+0000","last_became_peered":"2024-09-14T10:45:47.723495+0000","last_unstale":"2024-09-14T11:23:11.598716+0000","last_undegraded":"2024-09-14T11:23:11.598716+0000","last_fullsized":"2024-09-14T11:23:11.598716+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:11.598555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:11.598555+0000","last_clean_scrub_stamp":"2024-09-14T11:23:11.598555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:36:22.236009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"260'749","reported_seq":1440,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:28.247996+0000","last_change":"2024-09-14T11:23:28.247996+0000","last_active":"2024-09-14T11:23:28.247996+0000","last_peered":"2024-09-14T11:23:28.247996+0000","last_clean":"2024-09-14T11:23:28.247996+0000","last_became_active":"2024-09-14T10:45:49.733774+0000","last_became_peered":"2024-09-14T10:45:49.733774+0000","last_unstale":"2024-09-14T11:23:28.247996+0000","last_undegraded":"2024-09-14T11:23:28.247996+0000","last_fullsized":"2024-09-14T11:23:28.247996+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'749","last_scrub_stamp":"2024-09-14T11:23:28.247895+0000","last_deep_scrub":"260'749","last_deep_scrub_stamp":"2024-09-14T11:23:28.247895+0000","last_clean_scrub_stamp":"2024-09-14T11:23:28.247895+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":700,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:06.175200+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152864,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1479,"num_read_kb":3507,"num_write":1366,"num_write_kb":1223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89312,"num_omap_keys":214,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":479,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:24.452245+0000","last_change":"2024-09-14T11:23:24.452245+0000","last_active":"2024-09-14T11:23:24.452245+0000","last_peered":"2024-09-14T11:23:24.452245+0000","last_clean":"2024-09-14T11:23:24.452245+0000","last_became_active":"2024-09-14T10:45:51.745607+0000","last_became_peered":"2024-09-14T10:45:51.745607+0000","last_unstale":"2024-09-14T11:23:24.452245+0000","last_undegraded":"2024-09-14T11:23:24.452245+0000","last_fullsized":"2024-09-14T11:23:24.452245+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:24.452118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:24.452118+0000","last_clean_scrub_stamp":"2024-09-14T11:23:24.452118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:31.791825+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"260'237","reported_seq":933,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:19.622332+0000","last_change":"2024-09-14T11:23:19.622332+0000","last_active":"2024-09-14T11:23:19.622332+0000","last_peered":"2024-09-14T11:23:19.622332+0000","last_clean":"2024-09-14T11:23:19.622332+0000","last_became_active":"2024-09-14T10:45:53.751651+0000","last_became_peered":"2024-09-14T10:45:53.751651+0000","last_unstale":"2024-09-14T11:23:19.622332+0000","last_undegraded":"2024-09-14T11:23:19.622332+0000","last_fullsized":"2024-09-14T11:23:19.622332+0000","mapping_epoch":34,"log_start":"260'200","ondisk_log_start":"260'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'237","last_scrub_stamp":"2024-09-14T11:23:19.622263+0000","last_deep_scrub":"260'237","last_deep_scrub_stamp":"2024-09-14T11:23:19.622263+0000","last_clean_scrub_stamp":"2024-09-14T11:23:19.622263+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:09.518382+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":417,"num_read_kb":415,"num_write":468,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"260'501","reported_seq":2088,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:11.358264+0000","last_change":"2024-09-14T11:23:11.358264+0000","last_active":"2024-09-14T11:23:11.358264+0000","last_peered":"2024-09-14T11:23:11.358264+0000","last_clean":"2024-09-14T11:23:11.358264+0000","last_became_active":"2024-09-14T10:45:45.721633+0000","last_became_peered":"2024-09-14T10:45:45.721633+0000","last_unstale":"2024-09-14T11:23:11.358264+0000","last_undegraded":"2024-09-14T11:23:11.358264+0000","last_fullsized":"2024-09-14T11:23:11.358264+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'501","last_scrub_stamp":"2024-09-14T11:23:11.358175+0000","last_deep_scrub":"260'501","last_deep_scrub_stamp":"2024-09-14T11:23:11.358175+0000","last_clean_scrub_stamp":"2024-09-14T11:23:11.358175+0000","objects_scrubbed":1,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:36.475272+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2741,"num_read_kb":2557,"num_write":632,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":513,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:57.303611+0000","last_change":"2024-09-14T11:22:57.303538+0000","last_active":"2024-09-14T11:22:57.303611+0000","last_peered":"2024-09-14T11:22:57.303611+0000","last_clean":"2024-09-14T11:22:57.303611+0000","last_became_active":"2024-09-14T10:45:33.569860+0000","last_became_peered":"2024-09-14T10:45:33.569860+0000","last_unstale":"2024-09-14T11:22:57.303611+0000","last_undegraded":"2024-09-14T11:22:57.303611+0000","last_fullsized":"2024-09-14T11:22:57.303611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:57.303456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:57.303456+0000","last_clean_scrub_stamp":"2024-09-14T11:22:57.303456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:48:58.728224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074400599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"260'335","reported_seq":973,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:58.571020+0000","last_change":"2024-09-14T11:22:58.570951+0000","last_active":"2024-09-14T11:22:58.571020+0000","last_peered":"2024-09-14T11:22:58.571020+0000","last_clean":"2024-09-14T11:22:58.571020+0000","last_became_active":"2024-09-14T10:45:43.680290+0000","last_became_peered":"2024-09-14T10:45:43.680290+0000","last_unstale":"2024-09-14T11:22:58.571020+0000","last_undegraded":"2024-09-14T11:22:58.571020+0000","last_fullsized":"2024-09-14T11:22:58.571020+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'335","last_scrub_stamp":"2024-09-14T11:22:58.570853+0000","last_deep_scrub":"260'335","last_deep_scrub_stamp":"2024-09-14T11:22:58.570853+0000","last_clean_scrub_stamp":"2024-09-14T11:22:58.570853+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:26.761580+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":649,"num_read_kb":19207,"num_write":1098,"num_write_kb":41133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:23.187737+0000","last_change":"2024-09-14T11:23:23.187737+0000","last_active":"2024-09-14T11:23:23.187737+0000","last_peered":"2024-09-14T11:23:23.187737+0000","last_clean":"2024-09-14T11:23:23.187737+0000","last_became_active":"2024-09-14T10:45:47.727733+0000","last_became_peered":"2024-09-14T10:45:47.727733+0000","last_unstale":"2024-09-14T11:23:23.187737+0000","last_undegraded":"2024-09-14T11:23:23.187737+0000","last_fullsized":"2024-09-14T11:23:23.187737+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:23.187645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:23.187645+0000","last_clean_scrub_stamp":"2024-09-14T11:23:23.187645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:02.771437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"260'1255","reported_seq":2627,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:19.650058+0000","last_change":"2024-09-14T11:23:19.649977+0000","last_active":"2024-09-14T11:23:19.650058+0000","last_peered":"2024-09-14T11:23:19.650058+0000","last_clean":"2024-09-14T11:23:19.650058+0000","last_became_active":"2024-09-14T10:45:49.731646+0000","last_became_peered":"2024-09-14T10:45:49.731646+0000","last_unstale":"2024-09-14T11:23:19.650058+0000","last_undegraded":"2024-09-14T11:23:19.650058+0000","last_fullsized":"2024-09-14T11:23:19.650058+0000","mapping_epoch":30,"log_start":"260'1200","ondisk_log_start":"260'1200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1255","last_scrub_stamp":"2024-09-14T11:23:19.649845+0000","last_deep_scrub":"260'1255","last_deep_scrub_stamp":"2024-09-14T11:23:19.649845+0000","last_clean_scrub_stamp":"2024-09-14T11:23:19.649845+0000","objects_scrubbed":11,"log_size":55,"log_dups_size":1200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:26.770199+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141569,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1984,"num_read_kb":3752,"num_write":1074,"num_write_kb":921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":481,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:34.249984+0000","last_change":"2024-09-14T11:23:34.249984+0000","last_active":"2024-09-14T11:23:34.249984+0000","last_peered":"2024-09-14T11:23:34.249984+0000","last_clean":"2024-09-14T11:23:34.249984+0000","last_became_active":"2024-09-14T10:45:51.745481+0000","last_became_peered":"2024-09-14T10:45:51.745481+0000","last_unstale":"2024-09-14T11:23:34.249984+0000","last_undegraded":"2024-09-14T11:23:34.249984+0000","last_fullsized":"2024-09-14T11:23:34.249984+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:34.249880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:34.249880+0000","last_clean_scrub_stamp":"2024-09-14T11:23:34.249880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:22.847458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"260'294","reported_seq":826,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:30.542511+0000","last_change":"2024-09-14T11:23:30.542511+0000","last_active":"2024-09-14T11:23:30.542511+0000","last_peered":"2024-09-14T11:23:30.542511+0000","last_clean":"2024-09-14T11:23:30.542511+0000","last_became_active":"2024-09-14T10:45:53.750227+0000","last_became_peered":"2024-09-14T10:45:53.750227+0000","last_unstale":"2024-09-14T11:23:30.542511+0000","last_undegraded":"2024-09-14T11:23:30.542511+0000","last_fullsized":"2024-09-14T11:23:30.542511+0000","mapping_epoch":34,"log_start":"260'200","ondisk_log_start":"260'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'294","last_scrub_stamp":"2024-09-14T11:23:30.542425+0000","last_deep_scrub":"260'294","last_deep_scrub_stamp":"2024-09-14T11:23:30.542425+0000","last_clean_scrub_stamp":"2024-09-14T11:23:30.542425+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:08:15.313103+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":463,"num_read_kb":436,"num_write":609,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"260'356","reported_seq":1877,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:07.380950+0000","last_change":"2024-09-14T11:23:07.380950+0000","last_active":"2024-09-14T11:23:07.380950+0000","last_peered":"2024-09-14T11:23:07.380950+0000","last_clean":"2024-09-14T11:23:07.380950+0000","last_became_active":"2024-09-14T10:45:45.714923+0000","last_became_peered":"2024-09-14T10:45:45.714923+0000","last_unstale":"2024-09-14T11:23:07.380950+0000","last_undegraded":"2024-09-14T11:23:07.380950+0000","last_fullsized":"2024-09-14T11:23:07.380950+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'356","last_scrub_stamp":"2024-09-14T11:23:07.380862+0000","last_deep_scrub":"260'356","last_deep_scrub_stamp":"2024-09-14T11:23:07.380862+0000","last_clean_scrub_stamp":"2024-09-14T11:23:07.380862+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:31.182530+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2079,"num_read_kb":2005,"num_write":398,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":513,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:57.710733+0000","last_change":"2024-09-14T11:22:57.710655+0000","last_active":"2024-09-14T11:22:57.710733+0000","last_peered":"2024-09-14T11:22:57.710733+0000","last_clean":"2024-09-14T11:22:57.710733+0000","last_became_active":"2024-09-14T10:45:33.569944+0000","last_became_peered":"2024-09-14T10:45:33.569944+0000","last_unstale":"2024-09-14T11:22:57.710733+0000","last_undegraded":"2024-09-14T11:22:57.710733+0000","last_fullsized":"2024-09-14T11:22:57.710733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:57.710578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:57.710578+0000","last_clean_scrub_stamp":"2024-09-14T11:22:57.710578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:15.018820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055355599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"260'364","reported_seq":1064,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:01.268567+0000","last_change":"2024-09-14T11:23:01.268492+0000","last_active":"2024-09-14T11:23:01.268567+0000","last_peered":"2024-09-14T11:23:01.268567+0000","last_clean":"2024-09-14T11:23:01.268567+0000","last_became_active":"2024-09-14T10:45:43.682920+0000","last_became_peered":"2024-09-14T10:45:43.682920+0000","last_unstale":"2024-09-14T11:23:01.268567+0000","last_undegraded":"2024-09-14T11:23:01.268567+0000","last_fullsized":"2024-09-14T11:23:01.268567+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'364","last_scrub_stamp":"2024-09-14T11:23:01.268391+0000","last_deep_scrub":"260'364","last_deep_scrub_stamp":"2024-09-14T11:23:01.268391+0000","last_clean_scrub_stamp":"2024-09-14T11:23:01.268391+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:16.818916+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133679,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":823,"num_read_kb":18154,"num_write":1072,"num_write_kb":35009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"260'2","reported_seq":492,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:10.674647+0000","last_change":"2024-09-14T11:23:10.674647+0000","last_active":"2024-09-14T11:23:10.674647+0000","last_peered":"2024-09-14T11:23:10.674647+0000","last_clean":"2024-09-14T11:23:10.674647+0000","last_became_active":"2024-09-14T10:45:47.729061+0000","last_became_peered":"2024-09-14T10:45:47.729061+0000","last_unstale":"2024-09-14T11:23:10.674647+0000","last_undegraded":"2024-09-14T11:23:10.674647+0000","last_fullsized":"2024-09-14T11:23:10.674647+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:23:10.674557+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:23:10.674557+0000","last_clean_scrub_stamp":"2024-09-14T11:23:10.674557+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:31.717306+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"260'248","reported_seq":1234,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:13.632628+0000","last_change":"2024-09-14T11:23:13.632569+0000","last_active":"2024-09-14T11:23:13.632628+0000","last_peered":"2024-09-14T11:23:13.632628+0000","last_clean":"2024-09-14T11:23:13.632628+0000","last_became_active":"2024-09-14T10:45:49.731858+0000","last_became_peered":"2024-09-14T10:45:49.731858+0000","last_unstale":"2024-09-14T11:23:13.632628+0000","last_undegraded":"2024-09-14T11:23:13.632628+0000","last_fullsized":"2024-09-14T11:23:13.632628+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'248","last_scrub_stamp":"2024-09-14T11:23:13.632463+0000","last_deep_scrub":"260'248","last_deep_scrub_stamp":"2024-09-14T11:23:13.632463+0000","last_clean_scrub_stamp":"2024-09-14T11:23:13.632463+0000","objects_scrubbed":9,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:07.671389+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":156,"num_read_kb":145,"num_write":121,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5400,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:27.666619+0000","last_change":"2024-09-14T11:23:27.666619+0000","last_active":"2024-09-14T11:23:27.666619+0000","last_peered":"2024-09-14T11:23:27.666619+0000","last_clean":"2024-09-14T11:23:27.666619+0000","last_became_active":"2024-09-14T10:45:51.742651+0000","last_became_peered":"2024-09-14T10:45:51.742651+0000","last_unstale":"2024-09-14T11:23:27.666619+0000","last_undegraded":"2024-09-14T11:23:27.666619+0000","last_fullsized":"2024-09-14T11:23:27.666619+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:27.666534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:27.666534+0000","last_clean_scrub_stamp":"2024-09-14T11:23:27.666534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:57.974502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"260'242","reported_seq":836,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:31.618008+0000","last_change":"2024-09-14T11:23:31.618008+0000","last_active":"2024-09-14T11:23:31.618008+0000","last_peered":"2024-09-14T11:23:31.618008+0000","last_clean":"2024-09-14T11:23:31.618008+0000","last_became_active":"2024-09-14T10:45:53.744823+0000","last_became_peered":"2024-09-14T10:45:53.744823+0000","last_unstale":"2024-09-14T11:23:31.618008+0000","last_undegraded":"2024-09-14T11:23:31.618008+0000","last_fullsized":"2024-09-14T11:23:31.618008+0000","mapping_epoch":34,"log_start":"260'200","ondisk_log_start":"260'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'242","last_scrub_stamp":"2024-09-14T11:23:31.617921+0000","last_deep_scrub":"260'242","last_deep_scrub_stamp":"2024-09-14T11:23:31.617921+0000","last_clean_scrub_stamp":"2024-09-14T11:23:31.617921+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:39.433668+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":471,"num_read_kb":497,"num_write":522,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"260'745","reported_seq":2256,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:06.427840+0000","last_change":"2024-09-14T11:23:06.427766+0000","last_active":"2024-09-14T11:23:06.427840+0000","last_peered":"2024-09-14T11:23:06.427840+0000","last_clean":"2024-09-14T11:23:06.427840+0000","last_became_active":"2024-09-14T10:45:45.714077+0000","last_became_peered":"2024-09-14T10:45:45.714077+0000","last_unstale":"2024-09-14T11:23:06.427840+0000","last_undegraded":"2024-09-14T11:23:06.427840+0000","last_fullsized":"2024-09-14T11:23:06.427840+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'745","last_scrub_stamp":"2024-09-14T11:23:06.427683+0000","last_deep_scrub":"260'745","last_deep_scrub_stamp":"2024-09-14T11:23:06.427683+0000","last_clean_scrub_stamp":"2024-09-14T11:23:06.427683+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":700,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:14.547833+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3745,"num_read_kb":3391,"num_write":988,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2262,"num_omap_keys":9,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"260'3","reported_seq":515,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:56.321959+0000","last_change":"2024-09-14T11:22:56.321865+0000","last_active":"2024-09-14T11:22:56.321959+0000","last_peered":"2024-09-14T11:22:56.321959+0000","last_clean":"2024-09-14T11:22:56.321959+0000","last_became_active":"2024-09-14T10:45:33.612919+0000","last_became_peered":"2024-09-14T10:45:33.612919+0000","last_unstale":"2024-09-14T11:22:56.321959+0000","last_undegraded":"2024-09-14T11:22:56.321959+0000","last_fullsized":"2024-09-14T11:22:56.321959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T11:22:56.321789+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T11:22:56.321789+0000","last_clean_scrub_stamp":"2024-09-14T11:22:56.321789+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:47.764462+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00094497699999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"260'329","reported_seq":1206,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:00.571957+0000","last_change":"2024-09-14T11:23:00.571895+0000","last_active":"2024-09-14T11:23:00.571957+0000","last_peered":"2024-09-14T11:23:00.571957+0000","last_clean":"2024-09-14T11:23:00.571957+0000","last_became_active":"2024-09-14T10:45:43.679522+0000","last_became_peered":"2024-09-14T10:45:43.679522+0000","last_unstale":"2024-09-14T11:23:00.571957+0000","last_undegraded":"2024-09-14T11:23:00.571957+0000","last_fullsized":"2024-09-14T11:23:00.571957+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'329","last_scrub_stamp":"2024-09-14T11:23:00.571795+0000","last_deep_scrub":"260'329","last_deep_scrub_stamp":"2024-09-14T11:23:00.571795+0000","last_clean_scrub_stamp":"2024-09-14T11:23:00.571795+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:46.489688+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1353,"num_read_kb":12978,"num_write":1165,"num_write_kb":34630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"260'4","reported_seq":972,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:08.708188+0000","last_change":"2024-09-14T11:23:08.708120+0000","last_active":"2024-09-14T11:23:08.708188+0000","last_peered":"2024-09-14T11:23:08.708188+0000","last_clean":"2024-09-14T11:23:08.708188+0000","last_became_active":"2024-09-14T10:45:47.727050+0000","last_became_peered":"2024-09-14T10:45:47.727050+0000","last_unstale":"2024-09-14T11:23:08.708188+0000","last_undegraded":"2024-09-14T11:23:08.708188+0000","last_fullsized":"2024-09-14T11:23:08.708188+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-14T11:23:08.708034+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-14T11:23:08.708034+0000","last_clean_scrub_stamp":"2024-09-14T11:23:08.708034+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:23.242324+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"260'109","reported_seq":632,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:21.449544+0000","last_change":"2024-09-14T11:23:21.449544+0000","last_active":"2024-09-14T11:23:21.449544+0000","last_peered":"2024-09-14T11:23:21.449544+0000","last_clean":"2024-09-14T11:23:21.449544+0000","last_became_active":"2024-09-14T10:45:49.734181+0000","last_became_peered":"2024-09-14T10:45:49.734181+0000","last_unstale":"2024-09-14T11:23:21.449544+0000","last_undegraded":"2024-09-14T11:23:21.449544+0000","last_fullsized":"2024-09-14T11:23:21.449544+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'109","last_scrub_stamp":"2024-09-14T11:23:21.449431+0000","last_deep_scrub":"260'109","last_deep_scrub_stamp":"2024-09-14T11:23:21.449431+0000","last_clean_scrub_stamp":"2024-09-14T11:23:21.449431+0000","objects_scrubbed":7,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:19.786794+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":121,"num_read_kb":115,"num_write":86,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3358,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":480,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:35.221473+0000","last_change":"2024-09-14T11:23:35.221473+0000","last_active":"2024-09-14T11:23:35.221473+0000","last_peered":"2024-09-14T11:23:35.221473+0000","last_clean":"2024-09-14T11:23:35.221473+0000","last_became_active":"2024-09-14T10:45:51.744280+0000","last_became_peered":"2024-09-14T10:45:51.744280+0000","last_unstale":"2024-09-14T11:23:35.221473+0000","last_undegraded":"2024-09-14T11:23:35.221473+0000","last_fullsized":"2024-09-14T11:23:35.221473+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:35.221380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:35.221380+0000","last_clean_scrub_stamp":"2024-09-14T11:23:35.221380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:09.486875+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"260'117","reported_seq":657,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:21.587933+0000","last_change":"2024-09-14T11:23:21.587933+0000","last_active":"2024-09-14T11:23:21.587933+0000","last_peered":"2024-09-14T11:23:21.587933+0000","last_clean":"2024-09-14T11:23:21.587933+0000","last_became_active":"2024-09-14T10:45:53.746484+0000","last_became_peered":"2024-09-14T10:45:53.746484+0000","last_unstale":"2024-09-14T11:23:21.587933+0000","last_undegraded":"2024-09-14T11:23:21.587933+0000","last_fullsized":"2024-09-14T11:23:21.587933+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'117","last_scrub_stamp":"2024-09-14T11:23:21.587830+0000","last_deep_scrub":"260'117","last_deep_scrub_stamp":"2024-09-14T11:23:21.587830+0000","last_clean_scrub_stamp":"2024-09-14T11:23:21.587830+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:12.179504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":202,"num_write":278,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"260'1200","reported_seq":2910,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:02.495387+0000","last_change":"2024-09-14T11:23:02.495332+0000","last_active":"2024-09-14T11:23:02.495387+0000","last_peered":"2024-09-14T11:23:02.495387+0000","last_clean":"2024-09-14T11:23:02.495387+0000","last_became_active":"2024-09-14T10:45:45.713440+0000","last_became_peered":"2024-09-14T10:45:45.713440+0000","last_unstale":"2024-09-14T11:23:02.495387+0000","last_undegraded":"2024-09-14T11:23:02.495387+0000","last_fullsized":"2024-09-14T11:23:02.495387+0000","mapping_epoch":26,"log_start":"260'1100","ondisk_log_start":"260'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1200","last_scrub_stamp":"2024-09-14T11:23:02.495208+0000","last_deep_scrub":"260'1200","last_deep_scrub_stamp":"2024-09-14T11:23:02.495208+0000","last_clean_scrub_stamp":"2024-09-14T11:23:02.495208+0000","objects_scrubbed":4,"log_size":100,"log_dups_size":1100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:18:40.279776+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5652,"num_read_kb":5051,"num_write":1624,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"260'368","reported_seq":1064,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:56.140666+0000","last_change":"2024-09-14T11:22:56.140615+0000","last_active":"2024-09-14T11:22:56.140666+0000","last_peered":"2024-09-14T11:22:56.140666+0000","last_clean":"2024-09-14T11:22:56.140666+0000","last_became_active":"2024-09-14T10:45:43.682711+0000","last_became_peered":"2024-09-14T10:45:43.682711+0000","last_unstale":"2024-09-14T11:22:56.140666+0000","last_undegraded":"2024-09-14T11:22:56.140666+0000","last_fullsized":"2024-09-14T11:22:56.140666+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'368","last_scrub_stamp":"2024-09-14T11:22:56.140537+0000","last_deep_scrub":"260'368","last_deep_scrub_stamp":"2024-09-14T11:22:56.140537+0000","last_clean_scrub_stamp":"2024-09-14T11:22:56.140537+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:56:04.477168+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":849,"num_read_kb":26785,"num_write":1182,"num_write_kb":27965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":511,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:58.210095+0000","last_change":"2024-09-14T11:22:58.210044+0000","last_active":"2024-09-14T11:22:58.210095+0000","last_peered":"2024-09-14T11:22:58.210095+0000","last_clean":"2024-09-14T11:22:58.210095+0000","last_became_active":"2024-09-14T10:45:33.612983+0000","last_became_peered":"2024-09-14T10:45:33.612983+0000","last_unstale":"2024-09-14T11:22:58.210095+0000","last_undegraded":"2024-09-14T11:22:58.210095+0000","last_fullsized":"2024-09-14T11:22:58.210095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:58.209961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:58.209961+0000","last_clean_scrub_stamp":"2024-09-14T11:22:58.209961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:24.187827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053773700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":495,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:14.832509+0000","last_change":"2024-09-14T11:23:14.832421+0000","last_active":"2024-09-14T11:23:14.832509+0000","last_peered":"2024-09-14T11:23:14.832509+0000","last_clean":"2024-09-14T11:23:14.832509+0000","last_became_active":"2024-09-14T10:45:47.724317+0000","last_became_peered":"2024-09-14T10:45:47.724317+0000","last_unstale":"2024-09-14T11:23:14.832509+0000","last_undegraded":"2024-09-14T11:23:14.832509+0000","last_fullsized":"2024-09-14T11:23:14.832509+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:14.832323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:14.832323+0000","last_clean_scrub_stamp":"2024-09-14T11:23:14.832323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:35.877723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"260'555","reported_seq":1204,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:12.702336+0000","last_change":"2024-09-14T11:23:12.702336+0000","last_active":"2024-09-14T11:23:12.702336+0000","last_peered":"2024-09-14T11:23:12.702336+0000","last_clean":"2024-09-14T11:23:12.702336+0000","last_became_active":"2024-09-14T10:45:49.735662+0000","last_became_peered":"2024-09-14T10:45:49.735662+0000","last_unstale":"2024-09-14T11:23:12.702336+0000","last_undegraded":"2024-09-14T11:23:12.702336+0000","last_fullsized":"2024-09-14T11:23:12.702336+0000","mapping_epoch":30,"log_start":"260'500","ondisk_log_start":"260'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'555","last_scrub_stamp":"2024-09-14T11:23:12.702245+0000","last_deep_scrub":"260'555","last_deep_scrub_stamp":"2024-09-14T11:23:12.702245+0000","last_clean_scrub_stamp":"2024-09-14T11:23:12.702245+0000","objects_scrubbed":9,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:15.583995+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96714,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1561,"num_read_kb":2770,"num_write":2020,"num_write_kb":1869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":529654,"num_omap_keys":1194,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:14.406366+0000","last_change":"2024-09-14T11:23:14.406308+0000","last_active":"2024-09-14T11:23:14.406366+0000","last_peered":"2024-09-14T11:23:14.406366+0000","last_clean":"2024-09-14T11:23:14.406366+0000","last_became_active":"2024-09-14T10:45:51.749478+0000","last_became_peered":"2024-09-14T10:45:51.749478+0000","last_unstale":"2024-09-14T11:23:14.406366+0000","last_undegraded":"2024-09-14T11:23:14.406366+0000","last_fullsized":"2024-09-14T11:23:14.406366+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:14.406216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:14.406216+0000","last_clean_scrub_stamp":"2024-09-14T11:23:14.406216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:10.698911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"260'122","reported_seq":616,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:32.564446+0000","last_change":"2024-09-14T11:23:32.564446+0000","last_active":"2024-09-14T11:23:32.564446+0000","last_peered":"2024-09-14T11:23:32.564446+0000","last_clean":"2024-09-14T11:23:32.564446+0000","last_became_active":"2024-09-14T10:45:53.749578+0000","last_became_peered":"2024-09-14T10:45:53.749578+0000","last_unstale":"2024-09-14T11:23:32.564446+0000","last_undegraded":"2024-09-14T11:23:32.564446+0000","last_fullsized":"2024-09-14T11:23:32.564446+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'122","last_scrub_stamp":"2024-09-14T11:23:32.564358+0000","last_deep_scrub":"260'122","last_deep_scrub_stamp":"2024-09-14T11:23:32.564358+0000","last_clean_scrub_stamp":"2024-09-14T11:23:32.564358+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:11.546553+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":913,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":137,"num_read_kb":126,"num_write":281,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"260'864","reported_seq":2567,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:05.472851+0000","last_change":"2024-09-14T11:23:05.472779+0000","last_active":"2024-09-14T11:23:05.472851+0000","last_peered":"2024-09-14T11:23:05.472851+0000","last_clean":"2024-09-14T11:23:05.472851+0000","last_became_active":"2024-09-14T10:45:45.719783+0000","last_became_peered":"2024-09-14T10:45:45.719783+0000","last_unstale":"2024-09-14T11:23:05.472851+0000","last_undegraded":"2024-09-14T11:23:05.472851+0000","last_fullsized":"2024-09-14T11:23:05.472851+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'864","last_scrub_stamp":"2024-09-14T11:23:05.472688+0000","last_deep_scrub":"260'864","last_deep_scrub_stamp":"2024-09-14T11:23:05.472688+0000","last_clean_scrub_stamp":"2024-09-14T11:23:05.472688+0000","objects_scrubbed":3,"log_size":64,"log_dups_size":800,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:31.265160+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4184,"num_read_kb":3795,"num_write":1124,"num_write_kb":397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"260'369","reported_seq":992,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:59.565502+0000","last_change":"2024-09-14T11:22:59.565447+0000","last_active":"2024-09-14T11:22:59.565502+0000","last_peered":"2024-09-14T11:22:59.565502+0000","last_clean":"2024-09-14T11:22:59.565502+0000","last_became_active":"2024-09-14T10:45:43.685775+0000","last_became_peered":"2024-09-14T10:45:43.685775+0000","last_unstale":"2024-09-14T11:22:59.565502+0000","last_undegraded":"2024-09-14T11:22:59.565502+0000","last_fullsized":"2024-09-14T11:22:59.565502+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'369","last_scrub_stamp":"2024-09-14T11:22:59.565357+0000","last_deep_scrub":"260'369","last_deep_scrub_stamp":"2024-09-14T11:22:59.565357+0000","last_clean_scrub_stamp":"2024-09-14T11:22:59.565357+0000","objects_scrubbed":3,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:14.300547+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":660,"num_read_kb":2173,"num_write":1090,"num_write_kb":20935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":512,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:59.293347+0000","last_change":"2024-09-14T11:22:59.293285+0000","last_active":"2024-09-14T11:22:59.293347+0000","last_peered":"2024-09-14T11:22:59.293347+0000","last_clean":"2024-09-14T11:22:59.293347+0000","last_became_active":"2024-09-14T10:45:33.564407+0000","last_became_peered":"2024-09-14T10:45:33.564407+0000","last_unstale":"2024-09-14T11:22:59.293347+0000","last_undegraded":"2024-09-14T11:22:59.293347+0000","last_fullsized":"2024-09-14T11:22:59.293347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:59.293199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:59.293199+0000","last_clean_scrub_stamp":"2024-09-14T11:22:59.293199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:33.650485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099134599999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":496,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:09.610979+0000","last_change":"2024-09-14T11:23:09.610887+0000","last_active":"2024-09-14T11:23:09.610979+0000","last_peered":"2024-09-14T11:23:09.610979+0000","last_clean":"2024-09-14T11:23:09.610979+0000","last_became_active":"2024-09-14T10:45:47.724774+0000","last_became_peered":"2024-09-14T10:45:47.724774+0000","last_unstale":"2024-09-14T11:23:09.610979+0000","last_undegraded":"2024-09-14T11:23:09.610979+0000","last_fullsized":"2024-09-14T11:23:09.610979+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:09.610793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:09.610793+0000","last_clean_scrub_stamp":"2024-09-14T11:23:09.610793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:43.851455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"260'164","reported_seq":709,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:14.280039+0000","last_change":"2024-09-14T11:23:14.279970+0000","last_active":"2024-09-14T11:23:14.280039+0000","last_peered":"2024-09-14T11:23:14.280039+0000","last_clean":"2024-09-14T11:23:14.280039+0000","last_became_active":"2024-09-14T10:45:49.731380+0000","last_became_peered":"2024-09-14T10:45:49.731380+0000","last_unstale":"2024-09-14T11:23:14.280039+0000","last_undegraded":"2024-09-14T11:23:14.280039+0000","last_fullsized":"2024-09-14T11:23:14.280039+0000","mapping_epoch":30,"log_start":"257'100","ondisk_log_start":"257'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'164","last_scrub_stamp":"2024-09-14T11:23:14.279872+0000","last_deep_scrub":"260'164","last_deep_scrub_stamp":"2024-09-14T11:23:14.279872+0000","last_clean_scrub_stamp":"2024-09-14T11:23:14.279872+0000","objects_scrubbed":9,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:37:02.128672+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":200,"num_read_kb":190,"num_write":162,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6272,"num_omap_keys":14,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"260'796","reported_seq":2749,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:17.556395+0000","last_change":"2024-09-14T11:23:17.556316+0000","last_active":"2024-09-14T11:23:17.556395+0000","last_peered":"2024-09-14T11:23:17.556395+0000","last_clean":"2024-09-14T11:23:17.556395+0000","last_became_active":"2024-09-14T10:45:51.746984+0000","last_became_peered":"2024-09-14T10:45:51.746984+0000","last_unstale":"2024-09-14T11:23:17.556395+0000","last_undegraded":"2024-09-14T11:23:17.556395+0000","last_fullsized":"2024-09-14T11:23:17.556395+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'796","last_scrub_stamp":"2024-09-14T11:23:17.556213+0000","last_deep_scrub":"260'796","last_deep_scrub_stamp":"2024-09-14T11:23:17.556213+0000","last_clean_scrub_stamp":"2024-09-14T11:23:17.556213+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:46:30.527918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"260'123","reported_seq":622,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:22.762909+0000","last_change":"2024-09-14T11:23:22.762909+0000","last_active":"2024-09-14T11:23:22.762909+0000","last_peered":"2024-09-14T11:23:22.762909+0000","last_clean":"2024-09-14T11:23:22.762909+0000","last_became_active":"2024-09-14T10:45:53.749802+0000","last_became_peered":"2024-09-14T10:45:53.749802+0000","last_unstale":"2024-09-14T11:23:22.762909+0000","last_undegraded":"2024-09-14T11:23:22.762909+0000","last_fullsized":"2024-09-14T11:23:22.762909+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'123","last_scrub_stamp":"2024-09-14T11:23:22.762824+0000","last_deep_scrub":"260'123","last_deep_scrub_stamp":"2024-09-14T11:23:22.762824+0000","last_clean_scrub_stamp":"2024-09-14T11:23:22.762824+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:29.506077+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":146,"num_read_kb":135,"num_write":274,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"260'413","reported_seq":1907,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:01.936384+0000","last_change":"2024-09-14T11:23:01.936290+0000","last_active":"2024-09-14T11:23:01.936384+0000","last_peered":"2024-09-14T11:23:01.936384+0000","last_clean":"2024-09-14T11:23:01.936384+0000","last_became_active":"2024-09-14T10:45:45.710204+0000","last_became_peered":"2024-09-14T10:45:45.710204+0000","last_unstale":"2024-09-14T11:23:01.936384+0000","last_undegraded":"2024-09-14T11:23:01.936384+0000","last_fullsized":"2024-09-14T11:23:01.936384+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'413","last_scrub_stamp":"2024-09-14T11:23:01.936187+0000","last_deep_scrub":"260'413","last_deep_scrub_stamp":"2024-09-14T11:23:01.936187+0000","last_clean_scrub_stamp":"2024-09-14T11:23:01.936187+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:16.997744+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2141,"num_read_kb":2031,"num_write":456,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"260'376","reported_seq":1153,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:58.064053+0000","last_change":"2024-09-14T11:22:58.064053+0000","last_active":"2024-09-14T11:22:58.064053+0000","last_peered":"2024-09-14T11:22:58.064053+0000","last_clean":"2024-09-14T11:22:58.064053+0000","last_became_active":"2024-09-14T10:45:43.688114+0000","last_became_peered":"2024-09-14T10:45:43.688114+0000","last_unstale":"2024-09-14T11:22:58.064053+0000","last_undegraded":"2024-09-14T11:22:58.064053+0000","last_fullsized":"2024-09-14T11:22:58.064053+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'376","last_scrub_stamp":"2024-09-14T11:22:58.063966+0000","last_deep_scrub":"260'376","last_deep_scrub_stamp":"2024-09-14T11:22:58.063966+0000","last_clean_scrub_stamp":"2024-09-14T11:22:58.063966+0000","objects_scrubbed":3,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:30.176310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":828,"num_read_kb":15214,"num_write":1175,"num_write_kb":42293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":517,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:00.943595+0000","last_change":"2024-09-14T11:23:00.943595+0000","last_active":"2024-09-14T11:23:00.943595+0000","last_peered":"2024-09-14T11:23:00.943595+0000","last_clean":"2024-09-14T11:23:00.943595+0000","last_became_active":"2024-09-14T10:45:33.610909+0000","last_became_peered":"2024-09-14T10:45:33.610909+0000","last_unstale":"2024-09-14T11:23:00.943595+0000","last_undegraded":"2024-09-14T11:23:00.943595+0000","last_fullsized":"2024-09-14T11:23:00.943595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:00.943508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:00.943508+0000","last_clean_scrub_stamp":"2024-09-14T11:23:00.943508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:53.613527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038435900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:22.180284+0000","last_change":"2024-09-14T11:23:22.180284+0000","last_active":"2024-09-14T11:23:22.180284+0000","last_peered":"2024-09-14T11:23:22.180284+0000","last_clean":"2024-09-14T11:23:22.180284+0000","last_became_active":"2024-09-14T10:45:47.728343+0000","last_became_peered":"2024-09-14T10:45:47.728343+0000","last_unstale":"2024-09-14T11:23:22.180284+0000","last_undegraded":"2024-09-14T11:23:22.180284+0000","last_fullsized":"2024-09-14T11:23:22.180284+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:22.180193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:22.180193+0000","last_clean_scrub_stamp":"2024-09-14T11:23:22.180193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:14.286725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"260'97","reported_seq":619,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:29.248240+0000","last_change":"2024-09-14T11:23:29.248240+0000","last_active":"2024-09-14T11:23:29.248240+0000","last_peered":"2024-09-14T11:23:29.248240+0000","last_clean":"2024-09-14T11:23:29.248240+0000","last_became_active":"2024-09-14T10:45:49.735557+0000","last_became_peered":"2024-09-14T10:45:49.735557+0000","last_unstale":"2024-09-14T11:23:29.248240+0000","last_undegraded":"2024-09-14T11:23:29.248240+0000","last_fullsized":"2024-09-14T11:23:29.248240+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'97","last_scrub_stamp":"2024-09-14T11:23:29.248143+0000","last_deep_scrub":"260'97","last_deep_scrub_stamp":"2024-09-14T11:23:29.248143+0000","last_clean_scrub_stamp":"2024-09-14T11:23:29.248143+0000","objects_scrubbed":5,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:15.434542+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"260'806","reported_seq":2222,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:23.448147+0000","last_change":"2024-09-14T11:23:23.448147+0000","last_active":"2024-09-14T11:23:23.448147+0000","last_peered":"2024-09-14T11:23:23.448147+0000","last_clean":"2024-09-14T11:23:23.448147+0000","last_became_active":"2024-09-14T10:45:51.746874+0000","last_became_peered":"2024-09-14T10:45:51.746874+0000","last_unstale":"2024-09-14T11:23:23.448147+0000","last_undegraded":"2024-09-14T11:23:23.448147+0000","last_fullsized":"2024-09-14T11:23:23.448147+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'806","last_scrub_stamp":"2024-09-14T11:23:23.448070+0000","last_deep_scrub":"260'806","last_deep_scrub_stamp":"2024-09-14T11:23:23.448070+0000","last_clean_scrub_stamp":"2024-09-14T11:23:23.448070+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:45.072572+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"260'175","reported_seq":666,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:31.528504+0000","last_change":"2024-09-14T11:23:31.528504+0000","last_active":"2024-09-14T11:23:31.528504+0000","last_peered":"2024-09-14T11:23:31.528504+0000","last_clean":"2024-09-14T11:23:31.528504+0000","last_became_active":"2024-09-14T10:45:53.748880+0000","last_became_peered":"2024-09-14T10:45:53.748880+0000","last_unstale":"2024-09-14T11:23:31.528504+0000","last_undegraded":"2024-09-14T11:23:31.528504+0000","last_fullsized":"2024-09-14T11:23:31.528504+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'175","last_scrub_stamp":"2024-09-14T11:23:31.528414+0000","last_deep_scrub":"260'175","last_deep_scrub_stamp":"2024-09-14T11:23:31.528414+0000","last_clean_scrub_stamp":"2024-09-14T11:23:31.528414+0000","objects_scrubbed":4,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:36.836942+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":483,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":133,"num_read_kb":125,"num_write":394,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"260'407","reported_seq":1926,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:15.452071+0000","last_change":"2024-09-14T11:23:15.452071+0000","last_active":"2024-09-14T11:23:15.452071+0000","last_peered":"2024-09-14T11:23:15.452071+0000","last_clean":"2024-09-14T11:23:15.452071+0000","last_became_active":"2024-09-14T10:45:45.713313+0000","last_became_peered":"2024-09-14T10:45:45.713313+0000","last_unstale":"2024-09-14T11:23:15.452071+0000","last_undegraded":"2024-09-14T11:23:15.452071+0000","last_fullsized":"2024-09-14T11:23:15.452071+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'407","last_scrub_stamp":"2024-09-14T11:23:15.451983+0000","last_deep_scrub":"260'407","last_deep_scrub_stamp":"2024-09-14T11:23:15.451983+0000","last_clean_scrub_stamp":"2024-09-14T11:23:15.451983+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:11.569441+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2392,"num_read_kb":2258,"num_write":470,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2804,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"260'370","reported_seq":1118,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:03.896483+0000","last_change":"2024-09-14T11:23:03.896483+0000","last_active":"2024-09-14T11:23:03.896483+0000","last_peered":"2024-09-14T11:23:03.896483+0000","last_clean":"2024-09-14T11:23:03.896483+0000","last_became_active":"2024-09-14T10:45:43.689593+0000","last_became_peered":"2024-09-14T10:45:43.689593+0000","last_unstale":"2024-09-14T11:23:03.896483+0000","last_undegraded":"2024-09-14T11:23:03.896483+0000","last_fullsized":"2024-09-14T11:23:03.896483+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'370","last_scrub_stamp":"2024-09-14T11:23:03.896370+0000","last_deep_scrub":"260'370","last_deep_scrub_stamp":"2024-09-14T11:23:03.896370+0000","last_clean_scrub_stamp":"2024-09-14T11:23:03.896370+0000","objects_scrubbed":5,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:58:27.060305+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267348,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1017,"num_read_kb":46619,"num_write":1250,"num_write_kb":43963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":511,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:00.328992+0000","last_change":"2024-09-14T11:23:00.328992+0000","last_active":"2024-09-14T11:23:00.328992+0000","last_peered":"2024-09-14T11:23:00.328992+0000","last_clean":"2024-09-14T11:23:00.328992+0000","last_became_active":"2024-09-14T10:45:33.610689+0000","last_became_peered":"2024-09-14T10:45:33.610689+0000","last_unstale":"2024-09-14T11:23:00.328992+0000","last_undegraded":"2024-09-14T11:23:00.328992+0000","last_fullsized":"2024-09-14T11:23:00.328992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:00.328887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:00.328887+0000","last_clean_scrub_stamp":"2024-09-14T11:23:00.328887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:01:42.965803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011461920000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":496,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:11.785097+0000","last_change":"2024-09-14T11:23:11.785031+0000","last_active":"2024-09-14T11:23:11.785097+0000","last_peered":"2024-09-14T11:23:11.785097+0000","last_clean":"2024-09-14T11:23:11.785097+0000","last_became_active":"2024-09-14T10:45:47.728312+0000","last_became_peered":"2024-09-14T10:45:47.728312+0000","last_unstale":"2024-09-14T11:23:11.785097+0000","last_undegraded":"2024-09-14T11:23:11.785097+0000","last_fullsized":"2024-09-14T11:23:11.785097+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:11.784943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:11.784943+0000","last_clean_scrub_stamp":"2024-09-14T11:23:11.784943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:16.816883+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"260'724","reported_seq":1435,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:12.640289+0000","last_change":"2024-09-14T11:23:12.640223+0000","last_active":"2024-09-14T11:23:12.640289+0000","last_peered":"2024-09-14T11:23:12.640289+0000","last_clean":"2024-09-14T11:23:12.640289+0000","last_became_active":"2024-09-14T10:45:49.733812+0000","last_became_peered":"2024-09-14T10:45:49.733812+0000","last_unstale":"2024-09-14T11:23:12.640289+0000","last_undegraded":"2024-09-14T11:23:12.640289+0000","last_fullsized":"2024-09-14T11:23:12.640289+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'724","last_scrub_stamp":"2024-09-14T11:23:12.640119+0000","last_deep_scrub":"260'724","last_deep_scrub_stamp":"2024-09-14T11:23:12.640119+0000","last_clean_scrub_stamp":"2024-09-14T11:23:12.640119+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":700,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:51.052214+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137505,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1282,"num_read_kb":3061,"num_write":1046,"num_write_kb":877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:25.729577+0000","last_change":"2024-09-14T11:23:25.729577+0000","last_active":"2024-09-14T11:23:25.729577+0000","last_peered":"2024-09-14T11:23:25.729577+0000","last_clean":"2024-09-14T11:23:25.729577+0000","last_became_active":"2024-09-14T10:45:51.745137+0000","last_became_peered":"2024-09-14T10:45:51.745137+0000","last_unstale":"2024-09-14T11:23:25.729577+0000","last_undegraded":"2024-09-14T11:23:25.729577+0000","last_fullsized":"2024-09-14T11:23:25.729577+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:25.729479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:25.729479+0000","last_clean_scrub_stamp":"2024-09-14T11:23:25.729479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:31:55.711393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"260'134","reported_seq":634,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:23.425573+0000","last_change":"2024-09-14T11:23:23.425573+0000","last_active":"2024-09-14T11:23:23.425573+0000","last_peered":"2024-09-14T11:23:23.425573+0000","last_clean":"2024-09-14T11:23:23.425573+0000","last_became_active":"2024-09-14T10:45:53.751511+0000","last_became_peered":"2024-09-14T10:45:53.751511+0000","last_unstale":"2024-09-14T11:23:23.425573+0000","last_undegraded":"2024-09-14T11:23:23.425573+0000","last_fullsized":"2024-09-14T11:23:23.425573+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'134","last_scrub_stamp":"2024-09-14T11:23:23.425489+0000","last_deep_scrub":"260'134","last_deep_scrub_stamp":"2024-09-14T11:23:23.425489+0000","last_clean_scrub_stamp":"2024-09-14T11:23:23.425489+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:46.588914+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":202,"num_read_kb":180,"num_write":339,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"260'196","reported_seq":802,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:32.572381+0000","last_change":"2024-09-14T11:23:32.572381+0000","last_active":"2024-09-14T11:23:32.572381+0000","last_peered":"2024-09-14T11:23:32.572381+0000","last_clean":"2024-09-14T11:23:32.572381+0000","last_became_active":"2024-09-14T10:45:53.747090+0000","last_became_peered":"2024-09-14T10:45:53.747090+0000","last_unstale":"2024-09-14T11:23:32.572381+0000","last_undegraded":"2024-09-14T11:23:32.572381+0000","last_fullsized":"2024-09-14T11:23:32.572381+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'196","last_scrub_stamp":"2024-09-14T11:23:32.572284+0000","last_deep_scrub":"260'196","last_deep_scrub_stamp":"2024-09-14T11:23:32.572284+0000","last_clean_scrub_stamp":"2024-09-14T11:23:32.572284+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:11.027009+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":464,"num_read_kb":408,"num_write":469,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"260'463","reported_seq":1949,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:13.405280+0000","last_change":"2024-09-14T11:23:13.405280+0000","last_active":"2024-09-14T11:23:13.405280+0000","last_peered":"2024-09-14T11:23:13.405280+0000","last_clean":"2024-09-14T11:23:13.405280+0000","last_became_active":"2024-09-14T10:45:45.719181+0000","last_became_peered":"2024-09-14T10:45:45.719181+0000","last_unstale":"2024-09-14T11:23:13.405280+0000","last_undegraded":"2024-09-14T11:23:13.405280+0000","last_fullsized":"2024-09-14T11:23:13.405280+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'463","last_scrub_stamp":"2024-09-14T11:23:13.405187+0000","last_deep_scrub":"260'463","last_deep_scrub_stamp":"2024-09-14T11:23:13.405187+0000","last_clean_scrub_stamp":"2024-09-14T11:23:13.405187+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:49:14.290897+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2298,"num_read_kb":2151,"num_write":532,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"260'403","reported_seq":1070,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:06.181433+0000","last_change":"2024-09-14T11:23:06.181360+0000","last_active":"2024-09-14T11:23:06.181433+0000","last_peered":"2024-09-14T11:23:06.181433+0000","last_clean":"2024-09-14T11:23:06.181433+0000","last_became_active":"2024-09-14T10:45:43.673475+0000","last_became_peered":"2024-09-14T10:45:43.673475+0000","last_unstale":"2024-09-14T11:23:06.181433+0000","last_undegraded":"2024-09-14T11:23:06.181433+0000","last_fullsized":"2024-09-14T11:23:06.181433+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'403","last_scrub_stamp":"2024-09-14T11:23:06.181264+0000","last_deep_scrub":"260'403","last_deep_scrub_stamp":"2024-09-14T11:23:06.181264+0000","last_clean_scrub_stamp":"2024-09-14T11:23:06.181264+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:01.791158+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":761,"num_read_kb":57050,"num_write":1291,"num_write_kb":43494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:13.270673+0000","last_change":"2024-09-14T11:23:13.270673+0000","last_active":"2024-09-14T11:23:13.270673+0000","last_peered":"2024-09-14T11:23:13.270673+0000","last_clean":"2024-09-14T11:23:13.270673+0000","last_became_active":"2024-09-14T10:45:47.726819+0000","last_became_peered":"2024-09-14T10:45:47.726819+0000","last_unstale":"2024-09-14T11:23:13.270673+0000","last_undegraded":"2024-09-14T11:23:13.270673+0000","last_fullsized":"2024-09-14T11:23:13.270673+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:13.270587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:13.270587+0000","last_clean_scrub_stamp":"2024-09-14T11:23:13.270587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:32:10.160393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"260'275","reported_seq":835,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:20.185781+0000","last_change":"2024-09-14T11:23:20.185781+0000","last_active":"2024-09-14T11:23:20.185781+0000","last_peered":"2024-09-14T11:23:20.185781+0000","last_clean":"2024-09-14T11:23:20.185781+0000","last_became_active":"2024-09-14T10:45:49.732755+0000","last_became_peered":"2024-09-14T10:45:49.732755+0000","last_unstale":"2024-09-14T11:23:20.185781+0000","last_undegraded":"2024-09-14T11:23:20.185781+0000","last_fullsized":"2024-09-14T11:23:20.185781+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'275","last_scrub_stamp":"2024-09-14T11:23:20.185661+0000","last_deep_scrub":"260'275","last_deep_scrub_stamp":"2024-09-14T11:23:20.185661+0000","last_clean_scrub_stamp":"2024-09-14T11:23:20.185661+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:41.760457+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48124,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":453,"num_read_kb":1077,"num_write":370,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":481,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:16.626195+0000","last_change":"2024-09-14T11:23:16.626195+0000","last_active":"2024-09-14T11:23:16.626195+0000","last_peered":"2024-09-14T11:23:16.626195+0000","last_clean":"2024-09-14T11:23:16.626195+0000","last_became_active":"2024-09-14T10:45:51.747624+0000","last_became_peered":"2024-09-14T10:45:51.747624+0000","last_unstale":"2024-09-14T11:23:16.626195+0000","last_undegraded":"2024-09-14T11:23:16.626195+0000","last_fullsized":"2024-09-14T11:23:16.626195+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:16.626109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:16.626109+0000","last_clean_scrub_stamp":"2024-09-14T11:23:16.626109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:14.233513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"260'139","reported_seq":635,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:23.771744+0000","last_change":"2024-09-14T11:23:23.771744+0000","last_active":"2024-09-14T11:23:23.771744+0000","last_peered":"2024-09-14T11:23:23.771744+0000","last_clean":"2024-09-14T11:23:23.771744+0000","last_became_active":"2024-09-14T10:45:53.750866+0000","last_became_peered":"2024-09-14T10:45:53.750866+0000","last_unstale":"2024-09-14T11:23:23.771744+0000","last_undegraded":"2024-09-14T11:23:23.771744+0000","last_fullsized":"2024-09-14T11:23:23.771744+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'139","last_scrub_stamp":"2024-09-14T11:23:23.771657+0000","last_deep_scrub":"260'139","last_deep_scrub_stamp":"2024-09-14T11:23:23.771657+0000","last_clean_scrub_stamp":"2024-09-14T11:23:23.771657+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:32.786651+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":161,"num_read_kb":145,"num_write":328,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"260'718","reported_seq":2452,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:05.853802+0000","last_change":"2024-09-14T11:23:05.853747+0000","last_active":"2024-09-14T11:23:05.853802+0000","last_peered":"2024-09-14T11:23:05.853802+0000","last_clean":"2024-09-14T11:23:05.853802+0000","last_became_active":"2024-09-14T10:45:45.719731+0000","last_became_peered":"2024-09-14T10:45:45.719731+0000","last_unstale":"2024-09-14T11:23:05.853802+0000","last_undegraded":"2024-09-14T11:23:05.853802+0000","last_fullsized":"2024-09-14T11:23:05.853802+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'718","last_scrub_stamp":"2024-09-14T11:23:05.853644+0000","last_deep_scrub":"260'718","last_deep_scrub_stamp":"2024-09-14T11:23:05.853644+0000","last_clean_scrub_stamp":"2024-09-14T11:23:05.853644+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":700,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:10.570219+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3605,"num_read_kb":3249,"num_write":949,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":744,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"260'335","reported_seq":951,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:55.643327+0000","last_change":"2024-09-14T11:22:55.643327+0000","last_active":"2024-09-14T11:22:55.643327+0000","last_peered":"2024-09-14T11:22:55.643327+0000","last_clean":"2024-09-14T11:22:55.643327+0000","last_became_active":"2024-09-14T10:45:43.682925+0000","last_became_peered":"2024-09-14T10:45:43.682925+0000","last_unstale":"2024-09-14T11:22:55.643327+0000","last_undegraded":"2024-09-14T11:22:55.643327+0000","last_fullsized":"2024-09-14T11:22:55.643327+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'335","last_scrub_stamp":"2024-09-14T11:22:55.643226+0000","last_deep_scrub":"260'335","last_deep_scrub_stamp":"2024-09-14T11:22:55.643226+0000","last_clean_scrub_stamp":"2024-09-14T11:22:55.643226+0000","objects_scrubbed":3,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:47:02.635100+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":623,"num_read_kb":1213,"num_write":1012,"num_write_kb":13029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":493,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:15.845183+0000","last_change":"2024-09-14T11:23:15.845183+0000","last_active":"2024-09-14T11:23:15.845183+0000","last_peered":"2024-09-14T11:23:15.845183+0000","last_clean":"2024-09-14T11:23:15.845183+0000","last_became_active":"2024-09-14T10:45:47.724432+0000","last_became_peered":"2024-09-14T10:45:47.724432+0000","last_unstale":"2024-09-14T11:23:15.845183+0000","last_undegraded":"2024-09-14T11:23:15.845183+0000","last_fullsized":"2024-09-14T11:23:15.845183+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:15.845093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:15.845093+0000","last_clean_scrub_stamp":"2024-09-14T11:23:15.845093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:06.714822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"260'48","reported_seq":545,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:21.684279+0000","last_change":"2024-09-14T11:23:21.684279+0000","last_active":"2024-09-14T11:23:21.684279+0000","last_peered":"2024-09-14T11:23:21.684279+0000","last_clean":"2024-09-14T11:23:21.684279+0000","last_became_active":"2024-09-14T10:45:49.735053+0000","last_became_peered":"2024-09-14T10:45:49.735053+0000","last_unstale":"2024-09-14T11:23:21.684279+0000","last_undegraded":"2024-09-14T11:23:21.684279+0000","last_fullsized":"2024-09-14T11:23:21.684279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'48","last_scrub_stamp":"2024-09-14T11:23:21.684200+0000","last_deep_scrub":"260'48","last_deep_scrub_stamp":"2024-09-14T11:23:21.684200+0000","last_clean_scrub_stamp":"2024-09-14T11:23:21.684200+0000","objects_scrubbed":3,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:18.185222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":24,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":476,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:18.488548+0000","last_change":"2024-09-14T11:23:18.488548+0000","last_active":"2024-09-14T11:23:18.488548+0000","last_peered":"2024-09-14T11:23:18.488548+0000","last_clean":"2024-09-14T11:23:18.488548+0000","last_became_active":"2024-09-14T10:45:51.747600+0000","last_became_peered":"2024-09-14T10:45:51.747600+0000","last_unstale":"2024-09-14T11:23:18.488548+0000","last_undegraded":"2024-09-14T11:23:18.488548+0000","last_fullsized":"2024-09-14T11:23:18.488548+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:18.488476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:18.488476+0000","last_clean_scrub_stamp":"2024-09-14T11:23:18.488476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:19.436085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"260'224","reported_seq":754,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:25.291231+0000","last_change":"2024-09-14T11:23:25.291172+0000","last_active":"2024-09-14T11:23:25.291231+0000","last_peered":"2024-09-14T11:23:25.291231+0000","last_clean":"2024-09-14T11:23:25.291231+0000","last_became_active":"2024-09-14T10:45:53.751504+0000","last_became_peered":"2024-09-14T10:45:53.751504+0000","last_unstale":"2024-09-14T11:23:25.291231+0000","last_undegraded":"2024-09-14T11:23:25.291231+0000","last_fullsized":"2024-09-14T11:23:25.291231+0000","mapping_epoch":34,"log_start":"260'200","ondisk_log_start":"260'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'224","last_scrub_stamp":"2024-09-14T11:23:25.291079+0000","last_deep_scrub":"260'224","last_deep_scrub_stamp":"2024-09-14T11:23:25.291079+0000","last_clean_scrub_stamp":"2024-09-14T11:23:25.291079+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:58.984777+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":402,"num_read_kb":374,"num_write":536,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"260'728","reported_seq":2181,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:04.897428+0000","last_change":"2024-09-14T11:23:04.897345+0000","last_active":"2024-09-14T11:23:04.897428+0000","last_peered":"2024-09-14T11:23:04.897428+0000","last_clean":"2024-09-14T11:23:04.897428+0000","last_became_active":"2024-09-14T10:45:45.714326+0000","last_became_peered":"2024-09-14T10:45:45.714326+0000","last_unstale":"2024-09-14T11:23:04.897428+0000","last_undegraded":"2024-09-14T11:23:04.897428+0000","last_fullsized":"2024-09-14T11:23:04.897428+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'728","last_scrub_stamp":"2024-09-14T11:23:04.897221+0000","last_deep_scrub":"260'728","last_deep_scrub_stamp":"2024-09-14T11:23:04.897221+0000","last_clean_scrub_stamp":"2024-09-14T11:23:04.897221+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":700,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:36:03.252363+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3492,"num_read_kb":3158,"num_write":966,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"260'397","reported_seq":1053,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:59.257108+0000","last_change":"2024-09-14T11:22:59.257108+0000","last_active":"2024-09-14T11:22:59.257108+0000","last_peered":"2024-09-14T11:22:59.257108+0000","last_clean":"2024-09-14T11:22:59.257108+0000","last_became_active":"2024-09-14T10:45:43.671747+0000","last_became_peered":"2024-09-14T10:45:43.671747+0000","last_unstale":"2024-09-14T11:22:59.257108+0000","last_undegraded":"2024-09-14T11:22:59.257108+0000","last_fullsized":"2024-09-14T11:22:59.257108+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'397","last_scrub_stamp":"2024-09-14T11:22:59.256989+0000","last_deep_scrub":"260'397","last_deep_scrub_stamp":"2024-09-14T11:22:59.256989+0000","last_clean_scrub_stamp":"2024-09-14T11:22:59.256989+0000","objects_scrubbed":7,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:33.390781+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":703,"num_read_kb":3196,"num_write":1248,"num_write_kb":29609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:07.246948+0000","last_change":"2024-09-14T11:23:07.246825+0000","last_active":"2024-09-14T11:23:07.246948+0000","last_peered":"2024-09-14T11:23:07.246948+0000","last_clean":"2024-09-14T11:23:07.246948+0000","last_became_active":"2024-09-14T10:45:47.731640+0000","last_became_peered":"2024-09-14T10:45:47.731640+0000","last_unstale":"2024-09-14T11:23:07.246948+0000","last_undegraded":"2024-09-14T11:23:07.246948+0000","last_fullsized":"2024-09-14T11:23:07.246948+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:07.246721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:07.246721+0000","last_clean_scrub_stamp":"2024-09-14T11:23:07.246721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:46.259045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"260'325","reported_seq":903,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:13.682072+0000","last_change":"2024-09-14T11:23:13.682072+0000","last_active":"2024-09-14T11:23:13.682072+0000","last_peered":"2024-09-14T11:23:13.682072+0000","last_clean":"2024-09-14T11:23:13.682072+0000","last_became_active":"2024-09-14T10:45:49.727431+0000","last_became_peered":"2024-09-14T10:45:49.727431+0000","last_unstale":"2024-09-14T11:23:13.682072+0000","last_undegraded":"2024-09-14T11:23:13.682072+0000","last_fullsized":"2024-09-14T11:23:13.682072+0000","mapping_epoch":30,"log_start":"260'300","ondisk_log_start":"260'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'325","last_scrub_stamp":"2024-09-14T11:23:13.681974+0000","last_deep_scrub":"260'325","last_deep_scrub_stamp":"2024-09-14T11:23:13.681974+0000","last_clean_scrub_stamp":"2024-09-14T11:23:13.681974+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:16:25.075634+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46674,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":519,"num_read_kb":1163,"num_write":422,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":485,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:24.581005+0000","last_change":"2024-09-14T11:23:24.581005+0000","last_active":"2024-09-14T11:23:24.581005+0000","last_peered":"2024-09-14T11:23:24.581005+0000","last_clean":"2024-09-14T11:23:24.581005+0000","last_became_active":"2024-09-14T10:45:51.746506+0000","last_became_peered":"2024-09-14T10:45:51.746506+0000","last_unstale":"2024-09-14T11:23:24.581005+0000","last_undegraded":"2024-09-14T11:23:24.581005+0000","last_fullsized":"2024-09-14T11:23:24.581005+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:24.580922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:24.580922+0000","last_clean_scrub_stamp":"2024-09-14T11:23:24.580922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:17:37.498334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"260'145","reported_seq":646,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:43.199787+0000","last_change":"2024-09-14T11:23:43.199787+0000","last_active":"2024-09-14T11:23:43.199787+0000","last_peered":"2024-09-14T11:23:43.199787+0000","last_clean":"2024-09-14T11:23:43.199787+0000","last_became_active":"2024-09-14T10:45:53.755018+0000","last_became_peered":"2024-09-14T10:45:53.755018+0000","last_unstale":"2024-09-14T11:23:43.199787+0000","last_undegraded":"2024-09-14T11:23:43.199787+0000","last_fullsized":"2024-09-14T11:23:43.199787+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'145","last_scrub_stamp":"2024-09-14T11:23:43.199696+0000","last_deep_scrub":"260'145","last_deep_scrub_stamp":"2024-09-14T11:23:43.199696+0000","last_clean_scrub_stamp":"2024-09-14T11:23:43.199696+0000","objects_scrubbed":1,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:13.351727+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":167,"num_write":339,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"260'401","reported_seq":1936,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:03.743737+0000","last_change":"2024-09-14T11:23:03.743647+0000","last_active":"2024-09-14T11:23:03.743737+0000","last_peered":"2024-09-14T11:23:03.743737+0000","last_clean":"2024-09-14T11:23:03.743737+0000","last_became_active":"2024-09-14T10:45:45.713138+0000","last_became_peered":"2024-09-14T10:45:45.713138+0000","last_unstale":"2024-09-14T11:23:03.743737+0000","last_undegraded":"2024-09-14T11:23:03.743737+0000","last_fullsized":"2024-09-14T11:23:03.743737+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'401","last_scrub_stamp":"2024-09-14T11:23:03.743538+0000","last_deep_scrub":"260'401","last_deep_scrub_stamp":"2024-09-14T11:23:03.743538+0000","last_clean_scrub_stamp":"2024-09-14T11:23:03.743538+0000","objects_scrubbed":1,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:26.074630+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2187,"num_read_kb":2089,"num_write":453,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"260'381","reported_seq":999,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:57.171682+0000","last_change":"2024-09-14T11:22:57.171682+0000","last_active":"2024-09-14T11:22:57.171682+0000","last_peered":"2024-09-14T11:22:57.171682+0000","last_clean":"2024-09-14T11:22:57.171682+0000","last_became_active":"2024-09-14T10:45:43.680629+0000","last_became_peered":"2024-09-14T10:45:43.680629+0000","last_unstale":"2024-09-14T11:22:57.171682+0000","last_undegraded":"2024-09-14T11:22:57.171682+0000","last_fullsized":"2024-09-14T11:22:57.171682+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'381","last_scrub_stamp":"2024-09-14T11:22:57.171580+0000","last_deep_scrub":"260'381","last_deep_scrub_stamp":"2024-09-14T11:22:57.171580+0000","last_clean_scrub_stamp":"2024-09-14T11:22:57.171580+0000","objects_scrubbed":6,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:30.709275+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133684,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":617,"num_read_kb":9938,"num_write":1232,"num_write_kb":44861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:25.180487+0000","last_change":"2024-09-14T11:23:25.180487+0000","last_active":"2024-09-14T11:23:25.180487+0000","last_peered":"2024-09-14T11:23:25.180487+0000","last_clean":"2024-09-14T11:23:25.180487+0000","last_became_active":"2024-09-14T10:45:47.727777+0000","last_became_peered":"2024-09-14T10:45:47.727777+0000","last_unstale":"2024-09-14T11:23:25.180487+0000","last_undegraded":"2024-09-14T11:23:25.180487+0000","last_fullsized":"2024-09-14T11:23:25.180487+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:25.180385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:25.180385+0000","last_clean_scrub_stamp":"2024-09-14T11:23:25.180385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:13.371559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"260'274","reported_seq":837,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:15.664884+0000","last_change":"2024-09-14T11:23:15.664884+0000","last_active":"2024-09-14T11:23:15.664884+0000","last_peered":"2024-09-14T11:23:15.664884+0000","last_clean":"2024-09-14T11:23:15.664884+0000","last_became_active":"2024-09-14T10:45:49.727347+0000","last_became_peered":"2024-09-14T10:45:49.727347+0000","last_unstale":"2024-09-14T11:23:15.664884+0000","last_undegraded":"2024-09-14T11:23:15.664884+0000","last_fullsized":"2024-09-14T11:23:15.664884+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'274","last_scrub_stamp":"2024-09-14T11:23:15.664798+0000","last_deep_scrub":"260'274","last_deep_scrub_stamp":"2024-09-14T11:23:15.664798+0000","last_clean_scrub_stamp":"2024-09-14T11:23:15.664798+0000","objects_scrubbed":4,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:54:10.815390+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44334,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":417,"num_read_kb":936,"num_write":344,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":481,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:17.617512+0000","last_change":"2024-09-14T11:23:17.617512+0000","last_active":"2024-09-14T11:23:17.617512+0000","last_peered":"2024-09-14T11:23:17.617512+0000","last_clean":"2024-09-14T11:23:17.617512+0000","last_became_active":"2024-09-14T10:45:51.746493+0000","last_became_peered":"2024-09-14T10:45:51.746493+0000","last_unstale":"2024-09-14T11:23:17.617512+0000","last_undegraded":"2024-09-14T11:23:17.617512+0000","last_fullsized":"2024-09-14T11:23:17.617512+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:17.617397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:17.617397+0000","last_clean_scrub_stamp":"2024-09-14T11:23:17.617397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:45.334822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"260'407","reported_seq":1986,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:18.172629+0000","last_change":"2024-09-14T11:23:18.172629+0000","last_active":"2024-09-14T11:23:18.172629+0000","last_peered":"2024-09-14T11:23:18.172629+0000","last_clean":"2024-09-14T11:23:18.172629+0000","last_became_active":"2024-09-14T10:45:45.725430+0000","last_became_peered":"2024-09-14T10:45:45.725430+0000","last_unstale":"2024-09-14T11:23:18.172629+0000","last_undegraded":"2024-09-14T11:23:18.172629+0000","last_fullsized":"2024-09-14T11:23:18.172629+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'407","last_scrub_stamp":"2024-09-14T11:23:18.172553+0000","last_deep_scrub":"260'407","last_deep_scrub_stamp":"2024-09-14T11:23:18.172553+0000","last_clean_scrub_stamp":"2024-09-14T11:23:18.172553+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:03.784478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2252,"num_read_kb":2164,"num_write":454,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"260'321","reported_seq":945,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:59.248925+0000","last_change":"2024-09-14T11:22:59.248925+0000","last_active":"2024-09-14T11:22:59.248925+0000","last_peered":"2024-09-14T11:22:59.248925+0000","last_clean":"2024-09-14T11:22:59.248925+0000","last_became_active":"2024-09-14T10:45:43.683988+0000","last_became_peered":"2024-09-14T10:45:43.683988+0000","last_unstale":"2024-09-14T11:22:59.248925+0000","last_undegraded":"2024-09-14T11:22:59.248925+0000","last_fullsized":"2024-09-14T11:22:59.248925+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'321","last_scrub_stamp":"2024-09-14T11:22:59.248787+0000","last_deep_scrub":"260'321","last_deep_scrub_stamp":"2024-09-14T11:22:59.248787+0000","last_clean_scrub_stamp":"2024-09-14T11:22:59.248787+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:00.495190+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":562,"num_read_kb":32573,"num_write":1061,"num_write_kb":14583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:15.227653+0000","last_change":"2024-09-14T11:23:15.227653+0000","last_active":"2024-09-14T11:23:15.227653+0000","last_peered":"2024-09-14T11:23:15.227653+0000","last_clean":"2024-09-14T11:23:15.227653+0000","last_became_active":"2024-09-14T10:45:47.728323+0000","last_became_peered":"2024-09-14T10:45:47.728323+0000","last_unstale":"2024-09-14T11:23:15.227653+0000","last_undegraded":"2024-09-14T11:23:15.227653+0000","last_fullsized":"2024-09-14T11:23:15.227653+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:15.227516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:15.227516+0000","last_clean_scrub_stamp":"2024-09-14T11:23:15.227516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:27:28.550391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"260'494","reported_seq":1110,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:17.288328+0000","last_change":"2024-09-14T11:23:17.288281+0000","last_active":"2024-09-14T11:23:17.288328+0000","last_peered":"2024-09-14T11:23:17.288328+0000","last_clean":"2024-09-14T11:23:17.288328+0000","last_became_active":"2024-09-14T10:45:49.728841+0000","last_became_peered":"2024-09-14T10:45:49.728841+0000","last_unstale":"2024-09-14T11:23:17.288328+0000","last_undegraded":"2024-09-14T11:23:17.288328+0000","last_fullsized":"2024-09-14T11:23:17.288328+0000","mapping_epoch":30,"log_start":"260'400","ondisk_log_start":"260'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'494","last_scrub_stamp":"2024-09-14T11:23:17.288177+0000","last_deep_scrub":"260'494","last_deep_scrub_stamp":"2024-09-14T11:23:17.288177+0000","last_clean_scrub_stamp":"2024-09-14T11:23:17.288177+0000","objects_scrubbed":6,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:37.878286+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98061,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":894,"num_read_kb":2175,"num_write":778,"num_write_kb":715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":475,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:17.452522+0000","last_change":"2024-09-14T11:23:17.452438+0000","last_active":"2024-09-14T11:23:17.452522+0000","last_peered":"2024-09-14T11:23:17.452522+0000","last_clean":"2024-09-14T11:23:17.452522+0000","last_became_active":"2024-09-14T10:45:51.751776+0000","last_became_peered":"2024-09-14T10:45:51.751776+0000","last_unstale":"2024-09-14T11:23:17.452522+0000","last_undegraded":"2024-09-14T11:23:17.452522+0000","last_fullsized":"2024-09-14T11:23:17.452522+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:17.452340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:17.452340+0000","last_clean_scrub_stamp":"2024-09-14T11:23:17.452340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:14.236792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"260'173","reported_seq":677,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:33.540686+0000","last_change":"2024-09-14T11:23:33.540686+0000","last_active":"2024-09-14T11:23:33.540686+0000","last_peered":"2024-09-14T11:23:33.540686+0000","last_clean":"2024-09-14T11:23:33.540686+0000","last_became_active":"2024-09-14T10:45:53.752535+0000","last_became_peered":"2024-09-14T10:45:53.752535+0000","last_unstale":"2024-09-14T11:23:33.540686+0000","last_undegraded":"2024-09-14T11:23:33.540686+0000","last_fullsized":"2024-09-14T11:23:33.540686+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'173","last_scrub_stamp":"2024-09-14T11:23:33.540563+0000","last_deep_scrub":"260'173","last_deep_scrub_stamp":"2024-09-14T11:23:33.540563+0000","last_clean_scrub_stamp":"2024-09-14T11:23:33.540563+0000","objects_scrubbed":3,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:40.867238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":217,"num_read_kb":213,"num_write":386,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"260'443","reported_seq":2096,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:06.861671+0000","last_change":"2024-09-14T11:23:06.861605+0000","last_active":"2024-09-14T11:23:06.861671+0000","last_peered":"2024-09-14T11:23:06.861671+0000","last_clean":"2024-09-14T11:23:06.861671+0000","last_became_active":"2024-09-14T10:45:45.710498+0000","last_became_peered":"2024-09-14T10:45:45.710498+0000","last_unstale":"2024-09-14T11:23:06.861671+0000","last_undegraded":"2024-09-14T11:23:06.861671+0000","last_fullsized":"2024-09-14T11:23:06.861671+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'443","last_scrub_stamp":"2024-09-14T11:23:06.861513+0000","last_deep_scrub":"260'443","last_deep_scrub_stamp":"2024-09-14T11:23:06.861513+0000","last_clean_scrub_stamp":"2024-09-14T11:23:06.861513+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:22.830553+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2391,"num_read_kb":2291,"num_write":487,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"260'417","reported_seq":1179,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:08.794625+0000","last_change":"2024-09-14T11:23:08.794625+0000","last_active":"2024-09-14T11:23:08.794625+0000","last_peered":"2024-09-14T11:23:08.794625+0000","last_clean":"2024-09-14T11:23:08.794625+0000","last_became_active":"2024-09-14T10:45:43.688136+0000","last_became_peered":"2024-09-14T10:45:43.688136+0000","last_unstale":"2024-09-14T11:23:08.794625+0000","last_undegraded":"2024-09-14T11:23:08.794625+0000","last_fullsized":"2024-09-14T11:23:08.794625+0000","mapping_epoch":23,"log_start":"260'400","ondisk_log_start":"260'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'417","last_scrub_stamp":"2024-09-14T11:23:08.794535+0000","last_deep_scrub":"260'417","last_deep_scrub_stamp":"2024-09-14T11:23:08.794535+0000","last_clean_scrub_stamp":"2024-09-14T11:23:08.794535+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:10:34.992113+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1055,"num_read_kb":62488,"num_write":1345,"num_write_kb":26359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":486,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:10.380555+0000","last_change":"2024-09-14T11:23:10.380490+0000","last_active":"2024-09-14T11:23:10.380555+0000","last_peered":"2024-09-14T11:23:10.380555+0000","last_clean":"2024-09-14T11:23:10.380555+0000","last_became_active":"2024-09-14T10:45:47.725711+0000","last_became_peered":"2024-09-14T10:45:47.725711+0000","last_unstale":"2024-09-14T11:23:10.380555+0000","last_undegraded":"2024-09-14T11:23:10.380555+0000","last_fullsized":"2024-09-14T11:23:10.380555+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:10.380391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:10.380391+0000","last_clean_scrub_stamp":"2024-09-14T11:23:10.380391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:13:32.547617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"260'290","reported_seq":857,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:32.287964+0000","last_change":"2024-09-14T11:23:32.287964+0000","last_active":"2024-09-14T11:23:32.287964+0000","last_peered":"2024-09-14T11:23:32.287964+0000","last_clean":"2024-09-14T11:23:32.287964+0000","last_became_active":"2024-09-14T10:45:49.729803+0000","last_became_peered":"2024-09-14T10:45:49.729803+0000","last_unstale":"2024-09-14T11:23:32.287964+0000","last_undegraded":"2024-09-14T11:23:32.287964+0000","last_fullsized":"2024-09-14T11:23:32.287964+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'290","last_scrub_stamp":"2024-09-14T11:23:32.287847+0000","last_deep_scrub":"260'290","last_deep_scrub_stamp":"2024-09-14T11:23:32.287847+0000","last_clean_scrub_stamp":"2024-09-14T11:23:32.287847+0000","objects_scrubbed":8,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:07.364568+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50521,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":465,"num_read_kb":1032,"num_write":388,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":477,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:28.553892+0000","last_change":"2024-09-14T11:23:28.553892+0000","last_active":"2024-09-14T11:23:28.553892+0000","last_peered":"2024-09-14T11:23:28.553892+0000","last_clean":"2024-09-14T11:23:28.553892+0000","last_became_active":"2024-09-14T10:45:51.748871+0000","last_became_peered":"2024-09-14T10:45:51.748871+0000","last_unstale":"2024-09-14T11:23:28.553892+0000","last_undegraded":"2024-09-14T11:23:28.553892+0000","last_fullsized":"2024-09-14T11:23:28.553892+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:28.553789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:28.553789+0000","last_clean_scrub_stamp":"2024-09-14T11:23:28.553789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:07.534731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"260'214","reported_seq":1076,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:40.213886+0000","last_change":"2024-09-14T11:23:40.213886+0000","last_active":"2024-09-14T11:23:40.213886+0000","last_peered":"2024-09-14T11:23:40.213886+0000","last_clean":"2024-09-14T11:23:40.213886+0000","last_became_active":"2024-09-14T10:45:53.750595+0000","last_became_peered":"2024-09-14T10:45:53.750595+0000","last_unstale":"2024-09-14T11:23:40.213886+0000","last_undegraded":"2024-09-14T11:23:40.213886+0000","last_fullsized":"2024-09-14T11:23:40.213886+0000","mapping_epoch":34,"log_start":"260'200","ondisk_log_start":"260'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'214","last_scrub_stamp":"2024-09-14T11:23:40.213792+0000","last_deep_scrub":"260'214","last_deep_scrub_stamp":"2024-09-14T11:23:40.213792+0000","last_clean_scrub_stamp":"2024-09-14T11:23:40.213792+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:15.484099+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1617,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":634,"num_read_kb":624,"num_write":573,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"260'1184","reported_seq":2754,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:05.739710+0000","last_change":"2024-09-14T11:23:05.739650+0000","last_active":"2024-09-14T11:23:05.739710+0000","last_peered":"2024-09-14T11:23:05.739710+0000","last_clean":"2024-09-14T11:23:05.739710+0000","last_became_active":"2024-09-14T10:45:45.721945+0000","last_became_peered":"2024-09-14T10:45:45.721945+0000","last_unstale":"2024-09-14T11:23:05.739710+0000","last_undegraded":"2024-09-14T11:23:05.739710+0000","last_fullsized":"2024-09-14T11:23:05.739710+0000","mapping_epoch":26,"log_start":"260'1100","ondisk_log_start":"260'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1184","last_scrub_stamp":"2024-09-14T11:23:05.739562+0000","last_deep_scrub":"260'1184","last_deep_scrub_stamp":"2024-09-14T11:23:05.739562+0000","last_clean_scrub_stamp":"2024-09-14T11:23:05.739562+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":1100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:11.326591+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5490,"num_read_kb":4869,"num_write":1672,"num_write_kb":727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"260'342","reported_seq":985,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:57.727489+0000","last_change":"2024-09-14T11:22:57.727410+0000","last_active":"2024-09-14T11:22:57.727489+0000","last_peered":"2024-09-14T11:22:57.727489+0000","last_clean":"2024-09-14T11:22:57.727489+0000","last_became_active":"2024-09-14T10:45:43.682457+0000","last_became_peered":"2024-09-14T10:45:43.682457+0000","last_unstale":"2024-09-14T11:22:57.727489+0000","last_undegraded":"2024-09-14T11:22:57.727489+0000","last_fullsized":"2024-09-14T11:22:57.727489+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'342","last_scrub_stamp":"2024-09-14T11:22:57.727319+0000","last_deep_scrub":"260'342","last_deep_scrub_stamp":"2024-09-14T11:22:57.727319+0000","last_clean_scrub_stamp":"2024-09-14T11:22:57.727319+0000","objects_scrubbed":8,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:06.095427+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":582,"num_read_kb":98004,"num_write":1175,"num_write_kb":36067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":483,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:09.333304+0000","last_change":"2024-09-14T11:23:09.333221+0000","last_active":"2024-09-14T11:23:09.333304+0000","last_peered":"2024-09-14T11:23:09.333304+0000","last_clean":"2024-09-14T11:23:09.333304+0000","last_became_active":"2024-09-14T10:45:47.726635+0000","last_became_peered":"2024-09-14T10:45:47.726635+0000","last_unstale":"2024-09-14T11:23:09.333304+0000","last_undegraded":"2024-09-14T11:23:09.333304+0000","last_fullsized":"2024-09-14T11:23:09.333304+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:09.333109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:09.333109+0000","last_clean_scrub_stamp":"2024-09-14T11:23:09.333109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:29.617159+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"260'278","reported_seq":840,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:18.241724+0000","last_change":"2024-09-14T11:23:18.241663+0000","last_active":"2024-09-14T11:23:18.241724+0000","last_peered":"2024-09-14T11:23:18.241724+0000","last_clean":"2024-09-14T11:23:18.241724+0000","last_became_active":"2024-09-14T10:45:49.729422+0000","last_became_peered":"2024-09-14T10:45:49.729422+0000","last_unstale":"2024-09-14T11:23:18.241724+0000","last_undegraded":"2024-09-14T11:23:18.241724+0000","last_fullsized":"2024-09-14T11:23:18.241724+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'278","last_scrub_stamp":"2024-09-14T11:23:18.241562+0000","last_deep_scrub":"260'278","last_deep_scrub_stamp":"2024-09-14T11:23:18.241562+0000","last_clean_scrub_stamp":"2024-09-14T11:23:18.241562+0000","objects_scrubbed":5,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:10.259911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45487,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":456,"num_read_kb":1073,"num_write":374,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":483,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:18.604850+0000","last_change":"2024-09-14T11:23:18.604850+0000","last_active":"2024-09-14T11:23:18.604850+0000","last_peered":"2024-09-14T11:23:18.604850+0000","last_clean":"2024-09-14T11:23:18.604850+0000","last_became_active":"2024-09-14T10:45:51.747888+0000","last_became_peered":"2024-09-14T10:45:51.747888+0000","last_unstale":"2024-09-14T11:23:18.604850+0000","last_undegraded":"2024-09-14T11:23:18.604850+0000","last_fullsized":"2024-09-14T11:23:18.604850+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:18.604749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:18.604749+0000","last_clean_scrub_stamp":"2024-09-14T11:23:18.604749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:16:45.867833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"260'129","reported_seq":609,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:39.190296+0000","last_change":"2024-09-14T11:23:39.190296+0000","last_active":"2024-09-14T11:23:39.190296+0000","last_peered":"2024-09-14T11:23:39.190296+0000","last_clean":"2024-09-14T11:23:39.190296+0000","last_became_active":"2024-09-14T10:45:53.749868+0000","last_became_peered":"2024-09-14T10:45:53.749868+0000","last_unstale":"2024-09-14T11:23:39.190296+0000","last_undegraded":"2024-09-14T11:23:39.190296+0000","last_fullsized":"2024-09-14T11:23:39.190296+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'129","last_scrub_stamp":"2024-09-14T11:23:39.190227+0000","last_deep_scrub":"260'129","last_deep_scrub_stamp":"2024-09-14T11:23:39.190227+0000","last_clean_scrub_stamp":"2024-09-14T11:23:39.190227+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:33.524402+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":111,"num_write":304,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"260'1125","reported_seq":2695,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:07.821294+0000","last_change":"2024-09-14T11:23:07.821236+0000","last_active":"2024-09-14T11:23:07.821294+0000","last_peered":"2024-09-14T11:23:07.821294+0000","last_clean":"2024-09-14T11:23:07.821294+0000","last_became_active":"2024-09-14T10:45:45.711476+0000","last_became_peered":"2024-09-14T10:45:45.711476+0000","last_unstale":"2024-09-14T11:23:07.821294+0000","last_undegraded":"2024-09-14T11:23:07.821294+0000","last_fullsized":"2024-09-14T11:23:07.821294+0000","mapping_epoch":26,"log_start":"260'1100","ondisk_log_start":"260'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1125","last_scrub_stamp":"2024-09-14T11:23:07.821153+0000","last_deep_scrub":"260'1125","last_deep_scrub_stamp":"2024-09-14T11:23:07.821153+0000","last_clean_scrub_stamp":"2024-09-14T11:23:07.821153+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":1100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:28.830288+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5159,"num_read_kb":4588,"num_write":1521,"num_write_kb":611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"260'327","reported_seq":1011,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:59.994822+0000","last_change":"2024-09-14T11:22:59.994756+0000","last_active":"2024-09-14T11:22:59.994822+0000","last_peered":"2024-09-14T11:22:59.994822+0000","last_clean":"2024-09-14T11:22:59.994822+0000","last_became_active":"2024-09-14T10:45:43.691976+0000","last_became_peered":"2024-09-14T10:45:43.691976+0000","last_unstale":"2024-09-14T11:22:59.994822+0000","last_undegraded":"2024-09-14T11:22:59.994822+0000","last_fullsized":"2024-09-14T11:22:59.994822+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'327","last_scrub_stamp":"2024-09-14T11:22:59.994673+0000","last_deep_scrub":"260'327","last_deep_scrub_stamp":"2024-09-14T11:22:59.994673+0000","last_clean_scrub_stamp":"2024-09-14T11:22:59.994673+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:18.919121+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":740,"num_read_kb":9027,"num_write":1110,"num_write_kb":58772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":492,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:19.749532+0000","last_change":"2024-09-14T11:23:19.749476+0000","last_active":"2024-09-14T11:23:19.749532+0000","last_peered":"2024-09-14T11:23:19.749532+0000","last_clean":"2024-09-14T11:23:19.749532+0000","last_became_active":"2024-09-14T10:45:47.726392+0000","last_became_peered":"2024-09-14T10:45:47.726392+0000","last_unstale":"2024-09-14T11:23:19.749532+0000","last_undegraded":"2024-09-14T11:23:19.749532+0000","last_fullsized":"2024-09-14T11:23:19.749532+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:19.749384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:19.749384+0000","last_clean_scrub_stamp":"2024-09-14T11:23:19.749384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:44:44.489992+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"260'86","reported_seq":591,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:33.242113+0000","last_change":"2024-09-14T11:23:33.242113+0000","last_active":"2024-09-14T11:23:33.242113+0000","last_peered":"2024-09-14T11:23:33.242113+0000","last_clean":"2024-09-14T11:23:33.242113+0000","last_became_active":"2024-09-14T10:45:49.728444+0000","last_became_peered":"2024-09-14T10:45:49.728444+0000","last_unstale":"2024-09-14T11:23:33.242113+0000","last_undegraded":"2024-09-14T11:23:33.242113+0000","last_fullsized":"2024-09-14T11:23:33.242113+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'86","last_scrub_stamp":"2024-09-14T11:23:33.241982+0000","last_deep_scrub":"260'86","last_deep_scrub_stamp":"2024-09-14T11:23:33.241982+0000","last_clean_scrub_stamp":"2024-09-14T11:23:33.241982+0000","objects_scrubbed":7,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:30.428016+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":102,"num_read_kb":95,"num_write":120,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"260'795","reported_seq":2274,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:17.627562+0000","last_change":"2024-09-14T11:23:17.627509+0000","last_active":"2024-09-14T11:23:17.627562+0000","last_peered":"2024-09-14T11:23:17.627562+0000","last_clean":"2024-09-14T11:23:17.627562+0000","last_became_active":"2024-09-14T10:45:51.746303+0000","last_became_peered":"2024-09-14T10:45:51.746303+0000","last_unstale":"2024-09-14T11:23:17.627562+0000","last_undegraded":"2024-09-14T11:23:17.627562+0000","last_fullsized":"2024-09-14T11:23:17.627562+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'795","last_scrub_stamp":"2024-09-14T11:23:17.627416+0000","last_deep_scrub":"260'795","last_deep_scrub_stamp":"2024-09-14T11:23:17.627416+0000","last_clean_scrub_stamp":"2024-09-14T11:23:17.627416+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:25.589494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"260'120","reported_seq":605,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:38.201114+0000","last_change":"2024-09-14T11:23:38.201114+0000","last_active":"2024-09-14T11:23:38.201114+0000","last_peered":"2024-09-14T11:23:38.201114+0000","last_clean":"2024-09-14T11:23:38.201114+0000","last_became_active":"2024-09-14T10:45:53.751453+0000","last_became_peered":"2024-09-14T10:45:53.751453+0000","last_unstale":"2024-09-14T11:23:38.201114+0000","last_undegraded":"2024-09-14T11:23:38.201114+0000","last_fullsized":"2024-09-14T11:23:38.201114+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'120","last_scrub_stamp":"2024-09-14T11:23:38.201006+0000","last_deep_scrub":"260'120","last_deep_scrub_stamp":"2024-09-14T11:23:38.201006+0000","last_clean_scrub_stamp":"2024-09-14T11:23:38.201006+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:19.464909+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":104,"num_write":274,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"260'446","reported_seq":2023,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:16.481462+0000","last_change":"2024-09-14T11:23:16.481462+0000","last_active":"2024-09-14T11:23:16.481462+0000","last_peered":"2024-09-14T11:23:16.481462+0000","last_clean":"2024-09-14T11:23:16.481462+0000","last_became_active":"2024-09-14T10:45:45.725806+0000","last_became_peered":"2024-09-14T10:45:45.725806+0000","last_unstale":"2024-09-14T11:23:16.481462+0000","last_undegraded":"2024-09-14T11:23:16.481462+0000","last_fullsized":"2024-09-14T11:23:16.481462+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'446","last_scrub_stamp":"2024-09-14T11:23:16.481367+0000","last_deep_scrub":"260'446","last_deep_scrub_stamp":"2024-09-14T11:23:16.481367+0000","last_clean_scrub_stamp":"2024-09-14T11:23:16.481367+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:41.381657+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2489,"num_read_kb":2350,"num_write":523,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2807,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"260'377","reported_seq":1047,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:58.683943+0000","last_change":"2024-09-14T11:22:58.683861+0000","last_active":"2024-09-14T11:22:58.683943+0000","last_peered":"2024-09-14T11:22:58.683943+0000","last_clean":"2024-09-14T11:22:58.683943+0000","last_became_active":"2024-09-14T10:45:43.686768+0000","last_became_peered":"2024-09-14T10:45:43.686768+0000","last_unstale":"2024-09-14T11:22:58.683943+0000","last_undegraded":"2024-09-14T11:22:58.683943+0000","last_fullsized":"2024-09-14T11:22:58.683943+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'377","last_scrub_stamp":"2024-09-14T11:22:58.683760+0000","last_deep_scrub":"260'377","last_deep_scrub_stamp":"2024-09-14T11:22:58.683760+0000","last_clean_scrub_stamp":"2024-09-14T11:22:58.683760+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:01:12.820519+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":721,"num_read_kb":58950,"num_write":1313,"num_write_kb":32402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":492,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:13.574287+0000","last_change":"2024-09-14T11:23:13.574206+0000","last_active":"2024-09-14T11:23:13.574287+0000","last_peered":"2024-09-14T11:23:13.574287+0000","last_clean":"2024-09-14T11:23:13.574287+0000","last_became_active":"2024-09-14T10:45:47.718721+0000","last_became_peered":"2024-09-14T10:45:47.718721+0000","last_unstale":"2024-09-14T11:23:13.574287+0000","last_undegraded":"2024-09-14T11:23:13.574287+0000","last_fullsized":"2024-09-14T11:23:13.574287+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:13.574095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:13.574095+0000","last_clean_scrub_stamp":"2024-09-14T11:23:13.574095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:02.935904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"260'301","reported_seq":875,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:16.621324+0000","last_change":"2024-09-14T11:23:16.621324+0000","last_active":"2024-09-14T11:23:16.621324+0000","last_peered":"2024-09-14T11:23:16.621324+0000","last_clean":"2024-09-14T11:23:16.621324+0000","last_became_active":"2024-09-14T10:45:49.733684+0000","last_became_peered":"2024-09-14T10:45:49.733684+0000","last_unstale":"2024-09-14T11:23:16.621324+0000","last_undegraded":"2024-09-14T11:23:16.621324+0000","last_fullsized":"2024-09-14T11:23:16.621324+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'301","last_scrub_stamp":"2024-09-14T11:23:16.621219+0000","last_deep_scrub":"260'301","last_deep_scrub_stamp":"2024-09-14T11:23:16.621219+0000","last_clean_scrub_stamp":"2024-09-14T11:23:16.621219+0000","objects_scrubbed":9,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:25.617980+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49376,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":469,"num_read_kb":1024,"num_write":384,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:29.682829+0000","last_change":"2024-09-14T11:23:29.682829+0000","last_active":"2024-09-14T11:23:29.682829+0000","last_peered":"2024-09-14T11:23:29.682829+0000","last_clean":"2024-09-14T11:23:29.682829+0000","last_became_active":"2024-09-14T10:45:51.741767+0000","last_became_peered":"2024-09-14T10:45:51.741767+0000","last_unstale":"2024-09-14T11:23:29.682829+0000","last_undegraded":"2024-09-14T11:23:29.682829+0000","last_fullsized":"2024-09-14T11:23:29.682829+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:29.682725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:29.682725+0000","last_clean_scrub_stamp":"2024-09-14T11:23:29.682725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:17:16.361535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"260'130","reported_seq":630,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:23.555796+0000","last_change":"2024-09-14T11:23:23.555796+0000","last_active":"2024-09-14T11:23:23.555796+0000","last_peered":"2024-09-14T11:23:23.555796+0000","last_clean":"2024-09-14T11:23:23.555796+0000","last_became_active":"2024-09-14T10:45:53.748760+0000","last_became_peered":"2024-09-14T10:45:53.748760+0000","last_unstale":"2024-09-14T11:23:23.555796+0000","last_undegraded":"2024-09-14T11:23:23.555796+0000","last_fullsized":"2024-09-14T11:23:23.555796+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'130","last_scrub_stamp":"2024-09-14T11:23:23.555688+0000","last_deep_scrub":"260'130","last_deep_scrub_stamp":"2024-09-14T11:23:23.555688+0000","last_clean_scrub_stamp":"2024-09-14T11:23:23.555688+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:48.933012+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":155,"num_read_kb":143,"num_write":309,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"260'789","reported_seq":2308,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:05.246738+0000","last_change":"2024-09-14T11:23:05.246681+0000","last_active":"2024-09-14T11:23:05.246738+0000","last_peered":"2024-09-14T11:23:05.246738+0000","last_clean":"2024-09-14T11:23:05.246738+0000","last_became_active":"2024-09-14T10:45:45.717706+0000","last_became_peered":"2024-09-14T10:45:45.717706+0000","last_unstale":"2024-09-14T11:23:05.246738+0000","last_undegraded":"2024-09-14T11:23:05.246738+0000","last_fullsized":"2024-09-14T11:23:05.246738+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'789","last_scrub_stamp":"2024-09-14T11:23:05.246600+0000","last_deep_scrub":"260'789","last_deep_scrub_stamp":"2024-09-14T11:23:05.246600+0000","last_clean_scrub_stamp":"2024-09-14T11:23:05.246600+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:29.764214+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3708,"num_read_kb":3358,"num_write":1019,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"260'345","reported_seq":960,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:07.145079+0000","last_change":"2024-09-14T11:23:07.145011+0000","last_active":"2024-09-14T11:23:07.145079+0000","last_peered":"2024-09-14T11:23:07.145079+0000","last_clean":"2024-09-14T11:23:07.145079+0000","last_became_active":"2024-09-14T10:45:43.683014+0000","last_became_peered":"2024-09-14T10:45:43.683014+0000","last_unstale":"2024-09-14T11:23:07.145079+0000","last_undegraded":"2024-09-14T11:23:07.145079+0000","last_fullsized":"2024-09-14T11:23:07.145079+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'345","last_scrub_stamp":"2024-09-14T11:23:07.144903+0000","last_deep_scrub":"260'345","last_deep_scrub_stamp":"2024-09-14T11:23:07.144903+0000","last_clean_scrub_stamp":"2024-09-14T11:23:07.144903+0000","objects_scrubbed":4,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:22.680885+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133668,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":545,"num_read_kb":15772,"num_write":997,"num_write_kb":32563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":483,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:21.471921+0000","last_change":"2024-09-14T11:23:21.471921+0000","last_active":"2024-09-14T11:23:21.471921+0000","last_peered":"2024-09-14T11:23:21.471921+0000","last_clean":"2024-09-14T11:23:21.471921+0000","last_became_active":"2024-09-14T10:45:47.725850+0000","last_became_peered":"2024-09-14T10:45:47.725850+0000","last_unstale":"2024-09-14T11:23:21.471921+0000","last_undegraded":"2024-09-14T11:23:21.471921+0000","last_fullsized":"2024-09-14T11:23:21.471921+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:21.471821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:21.471821+0000","last_clean_scrub_stamp":"2024-09-14T11:23:21.471821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:22.616539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"260'262","reported_seq":823,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:26.705256+0000","last_change":"2024-09-14T11:23:26.705256+0000","last_active":"2024-09-14T11:23:26.705256+0000","last_peered":"2024-09-14T11:23:26.705256+0000","last_clean":"2024-09-14T11:23:26.705256+0000","last_became_active":"2024-09-14T10:45:49.736538+0000","last_became_peered":"2024-09-14T10:45:49.736538+0000","last_unstale":"2024-09-14T11:23:26.705256+0000","last_undegraded":"2024-09-14T11:23:26.705256+0000","last_fullsized":"2024-09-14T11:23:26.705256+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'262","last_scrub_stamp":"2024-09-14T11:23:26.705160+0000","last_deep_scrub":"260'262","last_deep_scrub_stamp":"2024-09-14T11:23:26.705160+0000","last_clean_scrub_stamp":"2024-09-14T11:23:26.705160+0000","objects_scrubbed":4,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:32.407412+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45998,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":425,"num_read_kb":1014,"num_write":348,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:36.262292+0000","last_change":"2024-09-14T11:23:36.262292+0000","last_active":"2024-09-14T11:23:36.262292+0000","last_peered":"2024-09-14T11:23:36.262292+0000","last_clean":"2024-09-14T11:23:36.262292+0000","last_became_active":"2024-09-14T10:45:51.744957+0000","last_became_peered":"2024-09-14T10:45:51.744957+0000","last_unstale":"2024-09-14T11:23:36.262292+0000","last_undegraded":"2024-09-14T11:23:36.262292+0000","last_fullsized":"2024-09-14T11:23:36.262292+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:36.262199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:36.262199+0000","last_clean_scrub_stamp":"2024-09-14T11:23:36.262199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:17.442538+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"260'127","reported_seq":635,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:34.523851+0000","last_change":"2024-09-14T11:23:34.523851+0000","last_active":"2024-09-14T11:23:34.523851+0000","last_peered":"2024-09-14T11:23:34.523851+0000","last_clean":"2024-09-14T11:23:34.523851+0000","last_became_active":"2024-09-14T10:45:53.750287+0000","last_became_peered":"2024-09-14T10:45:53.750287+0000","last_unstale":"2024-09-14T11:23:34.523851+0000","last_undegraded":"2024-09-14T11:23:34.523851+0000","last_fullsized":"2024-09-14T11:23:34.523851+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'127","last_scrub_stamp":"2024-09-14T11:23:34.523747+0000","last_deep_scrub":"260'127","last_deep_scrub_stamp":"2024-09-14T11:23:34.523747+0000","last_clean_scrub_stamp":"2024-09-14T11:23:34.523747+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:44.520637+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":175,"num_read_kb":170,"num_write":297,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"260'392","reported_seq":1851,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:04.722892+0000","last_change":"2024-09-14T11:23:04.722892+0000","last_active":"2024-09-14T11:23:04.722892+0000","last_peered":"2024-09-14T11:23:04.722892+0000","last_clean":"2024-09-14T11:23:04.722892+0000","last_became_active":"2024-09-14T10:45:45.712455+0000","last_became_peered":"2024-09-14T10:45:45.712455+0000","last_unstale":"2024-09-14T11:23:04.722892+0000","last_undegraded":"2024-09-14T11:23:04.722892+0000","last_fullsized":"2024-09-14T11:23:04.722892+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'392","last_scrub_stamp":"2024-09-14T11:23:04.722800+0000","last_deep_scrub":"260'392","last_deep_scrub_stamp":"2024-09-14T11:23:04.722800+0000","last_clean_scrub_stamp":"2024-09-14T11:23:04.722800+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:20.257987+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2172,"num_read_kb":2052,"num_write":470,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"260'356","reported_seq":1012,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:00.292249+0000","last_change":"2024-09-14T11:23:00.292166+0000","last_active":"2024-09-14T11:23:00.292249+0000","last_peered":"2024-09-14T11:23:00.292249+0000","last_clean":"2024-09-14T11:23:00.292249+0000","last_became_active":"2024-09-14T10:45:43.676145+0000","last_became_peered":"2024-09-14T10:45:43.676145+0000","last_unstale":"2024-09-14T11:23:00.292249+0000","last_undegraded":"2024-09-14T11:23:00.292249+0000","last_fullsized":"2024-09-14T11:23:00.292249+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'356","last_scrub_stamp":"2024-09-14T11:23:00.292074+0000","last_deep_scrub":"260'356","last_deep_scrub_stamp":"2024-09-14T11:23:00.292074+0000","last_clean_scrub_stamp":"2024-09-14T11:23:00.292074+0000","objects_scrubbed":5,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:47.860832+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133740,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":675,"num_read_kb":38975,"num_write":1181,"num_write_kb":36099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":492,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:11.644849+0000","last_change":"2024-09-14T11:23:11.644849+0000","last_active":"2024-09-14T11:23:11.644849+0000","last_peered":"2024-09-14T11:23:11.644849+0000","last_clean":"2024-09-14T11:23:11.644849+0000","last_became_active":"2024-09-14T10:45:47.724065+0000","last_became_peered":"2024-09-14T10:45:47.724065+0000","last_unstale":"2024-09-14T11:23:11.644849+0000","last_undegraded":"2024-09-14T11:23:11.644849+0000","last_fullsized":"2024-09-14T11:23:11.644849+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:11.644749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:11.644749+0000","last_clean_scrub_stamp":"2024-09-14T11:23:11.644749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:54.396791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"260'240","reported_seq":787,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:16.224647+0000","last_change":"2024-09-14T11:23:16.224587+0000","last_active":"2024-09-14T11:23:16.224647+0000","last_peered":"2024-09-14T11:23:16.224647+0000","last_clean":"2024-09-14T11:23:16.224647+0000","last_became_active":"2024-09-14T10:45:49.727721+0000","last_became_peered":"2024-09-14T10:45:49.727721+0000","last_unstale":"2024-09-14T11:23:16.224647+0000","last_undegraded":"2024-09-14T11:23:16.224647+0000","last_fullsized":"2024-09-14T11:23:16.224647+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'240","last_scrub_stamp":"2024-09-14T11:23:16.224504+0000","last_deep_scrub":"260'240","last_deep_scrub_stamp":"2024-09-14T11:23:16.224504+0000","last_clean_scrub_stamp":"2024-09-14T11:23:16.224504+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:07.387698+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47218,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":415,"num_read_kb":1017,"num_write":344,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:37.230678+0000","last_change":"2024-09-14T11:23:37.230678+0000","last_active":"2024-09-14T11:23:37.230678+0000","last_peered":"2024-09-14T11:23:37.230678+0000","last_clean":"2024-09-14T11:23:37.230678+0000","last_became_active":"2024-09-14T10:45:51.742387+0000","last_became_peered":"2024-09-14T10:45:51.742387+0000","last_unstale":"2024-09-14T11:23:37.230678+0000","last_undegraded":"2024-09-14T11:23:37.230678+0000","last_fullsized":"2024-09-14T11:23:37.230678+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:37.230587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:37.230587+0000","last_clean_scrub_stamp":"2024-09-14T11:23:37.230587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:21.629906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"260'163","reported_seq":1266,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:42.237809+0000","last_change":"2024-09-14T11:23:42.237809+0000","last_active":"2024-09-14T11:23:42.237809+0000","last_peered":"2024-09-14T11:23:42.237809+0000","last_clean":"2024-09-14T11:23:42.237809+0000","last_became_active":"2024-09-14T10:45:53.752639+0000","last_became_peered":"2024-09-14T10:45:53.752639+0000","last_unstale":"2024-09-14T11:23:42.237809+0000","last_undegraded":"2024-09-14T11:23:42.237809+0000","last_fullsized":"2024-09-14T11:23:42.237809+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'163","last_scrub_stamp":"2024-09-14T11:23:42.237714+0000","last_deep_scrub":"260'163","last_deep_scrub_stamp":"2024-09-14T11:23:42.237714+0000","last_clean_scrub_stamp":"2024-09-14T11:23:42.237714+0000","objects_scrubbed":3,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:47:21.197349+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":838,"num_read_kb":820,"num_write":382,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"260'400","reported_seq":1914,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:04.247771+0000","last_change":"2024-09-14T11:23:04.247771+0000","last_active":"2024-09-14T11:23:04.247771+0000","last_peered":"2024-09-14T11:23:04.247771+0000","last_clean":"2024-09-14T11:23:04.247771+0000","last_became_active":"2024-09-14T10:45:45.718964+0000","last_became_peered":"2024-09-14T10:45:45.718964+0000","last_unstale":"2024-09-14T11:23:04.247771+0000","last_undegraded":"2024-09-14T11:23:04.247771+0000","last_fullsized":"2024-09-14T11:23:04.247771+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'400","last_scrub_stamp":"2024-09-14T11:23:04.247668+0000","last_deep_scrub":"260'400","last_deep_scrub_stamp":"2024-09-14T11:23:04.247668+0000","last_clean_scrub_stamp":"2024-09-14T11:23:04.247668+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:22:55.596354+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2133,"num_read_kb":2043,"num_write":433,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"260'369","reported_seq":1016,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:04.280661+0000","last_change":"2024-09-14T11:23:04.280580+0000","last_active":"2024-09-14T11:23:04.280661+0000","last_peered":"2024-09-14T11:23:04.280661+0000","last_clean":"2024-09-14T11:23:04.280661+0000","last_became_active":"2024-09-14T10:45:43.675220+0000","last_became_peered":"2024-09-14T10:45:43.675220+0000","last_unstale":"2024-09-14T11:23:04.280661+0000","last_undegraded":"2024-09-14T11:23:04.280661+0000","last_fullsized":"2024-09-14T11:23:04.280661+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'369","last_scrub_stamp":"2024-09-14T11:23:04.280462+0000","last_deep_scrub":"260'369","last_deep_scrub_stamp":"2024-09-14T11:23:04.280462+0000","last_clean_scrub_stamp":"2024-09-14T11:23:04.280462+0000","objects_scrubbed":3,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:23:45.038803+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":607,"num_read_kb":38424,"num_write":1090,"num_write_kb":41594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"260'2","reported_seq":494,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:18.777321+0000","last_change":"2024-09-14T11:23:18.777321+0000","last_active":"2024-09-14T11:23:18.777321+0000","last_peered":"2024-09-14T11:23:18.777321+0000","last_clean":"2024-09-14T11:23:18.777321+0000","last_became_active":"2024-09-14T10:45:47.729338+0000","last_became_peered":"2024-09-14T10:45:47.729338+0000","last_unstale":"2024-09-14T11:23:18.777321+0000","last_undegraded":"2024-09-14T11:23:18.777321+0000","last_fullsized":"2024-09-14T11:23:18.777321+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:23:18.777242+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:23:18.777242+0000","last_clean_scrub_stamp":"2024-09-14T11:23:18.777242+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:28.099114+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"260'295","reported_seq":866,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:31.242864+0000","last_change":"2024-09-14T11:23:31.242864+0000","last_active":"2024-09-14T11:23:31.242864+0000","last_peered":"2024-09-14T11:23:31.242864+0000","last_clean":"2024-09-14T11:23:31.242864+0000","last_became_active":"2024-09-14T10:45:49.729842+0000","last_became_peered":"2024-09-14T10:45:49.729842+0000","last_unstale":"2024-09-14T11:23:31.242864+0000","last_undegraded":"2024-09-14T11:23:31.242864+0000","last_fullsized":"2024-09-14T11:23:31.242864+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'295","last_scrub_stamp":"2024-09-14T11:23:31.242769+0000","last_deep_scrub":"260'295","last_deep_scrub_stamp":"2024-09-14T11:23:31.242769+0000","last_clean_scrub_stamp":"2024-09-14T11:23:31.242769+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:47:02.860388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44662,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":478,"num_read_kb":1058,"num_write":386,"num_write_kb":290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:30.659654+0000","last_change":"2024-09-14T11:23:30.659654+0000","last_active":"2024-09-14T11:23:30.659654+0000","last_peered":"2024-09-14T11:23:30.659654+0000","last_clean":"2024-09-14T11:23:30.659654+0000","last_became_active":"2024-09-14T10:45:51.745310+0000","last_became_peered":"2024-09-14T10:45:51.745310+0000","last_unstale":"2024-09-14T11:23:30.659654+0000","last_undegraded":"2024-09-14T11:23:30.659654+0000","last_fullsized":"2024-09-14T11:23:30.659654+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:30.659557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:30.659557+0000","last_clean_scrub_stamp":"2024-09-14T11:23:30.659557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:47.082535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"260'142","reported_seq":630,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:18.626544+0000","last_change":"2024-09-14T11:23:18.626544+0000","last_active":"2024-09-14T11:23:18.626544+0000","last_peered":"2024-09-14T11:23:18.626544+0000","last_clean":"2024-09-14T11:23:18.626544+0000","last_became_active":"2024-09-14T10:45:53.754826+0000","last_became_peered":"2024-09-14T10:45:53.754826+0000","last_unstale":"2024-09-14T11:23:18.626544+0000","last_undegraded":"2024-09-14T11:23:18.626544+0000","last_fullsized":"2024-09-14T11:23:18.626544+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'142","last_scrub_stamp":"2024-09-14T11:23:18.626459+0000","last_deep_scrub":"260'142","last_deep_scrub_stamp":"2024-09-14T11:23:18.626459+0000","last_clean_scrub_stamp":"2024-09-14T11:23:18.626459+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:19:11.355018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":657,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":128,"num_read_kb":116,"num_write":335,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"260'422","reported_seq":1973,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:10.812912+0000","last_change":"2024-09-14T11:23:10.812912+0000","last_active":"2024-09-14T11:23:10.812912+0000","last_peered":"2024-09-14T11:23:10.812912+0000","last_clean":"2024-09-14T11:23:10.812912+0000","last_became_active":"2024-09-14T10:45:45.708229+0000","last_became_peered":"2024-09-14T10:45:45.708229+0000","last_unstale":"2024-09-14T11:23:10.812912+0000","last_undegraded":"2024-09-14T11:23:10.812912+0000","last_fullsized":"2024-09-14T11:23:10.812912+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'422","last_scrub_stamp":"2024-09-14T11:23:10.812799+0000","last_deep_scrub":"260'422","last_deep_scrub_stamp":"2024-09-14T11:23:10.812799+0000","last_clean_scrub_stamp":"2024-09-14T11:23:10.812799+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:04:48.614638+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2330,"num_read_kb":2210,"num_write":517,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"260'373","reported_seq":1029,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:58.207593+0000","last_change":"2024-09-14T11:22:58.207534+0000","last_active":"2024-09-14T11:22:58.207593+0000","last_peered":"2024-09-14T11:22:58.207593+0000","last_clean":"2024-09-14T11:22:58.207593+0000","last_became_active":"2024-09-14T10:45:43.684102+0000","last_became_peered":"2024-09-14T10:45:43.684102+0000","last_unstale":"2024-09-14T11:22:58.207593+0000","last_undegraded":"2024-09-14T11:22:58.207593+0000","last_fullsized":"2024-09-14T11:22:58.207593+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'373","last_scrub_stamp":"2024-09-14T11:22:58.207463+0000","last_deep_scrub":"260'373","last_deep_scrub_stamp":"2024-09-14T11:22:58.207463+0000","last_clean_scrub_stamp":"2024-09-14T11:22:58.207463+0000","objects_scrubbed":6,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:30.442090+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133709,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":619,"num_read_kb":82373,"num_write":1076,"num_write_kb":43712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"260'385","reported_seq":1952,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:09.667862+0000","last_change":"2024-09-14T11:23:09.667862+0000","last_active":"2024-09-14T11:23:09.667862+0000","last_peered":"2024-09-14T11:23:09.667862+0000","last_clean":"2024-09-14T11:23:09.667862+0000","last_became_active":"2024-09-14T10:45:45.718949+0000","last_became_peered":"2024-09-14T10:45:45.718949+0000","last_unstale":"2024-09-14T11:23:09.667862+0000","last_undegraded":"2024-09-14T11:23:09.667862+0000","last_fullsized":"2024-09-14T11:23:09.667862+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'385","last_scrub_stamp":"2024-09-14T11:23:09.667768+0000","last_deep_scrub":"260'385","last_deep_scrub_stamp":"2024-09-14T11:23:09.667768+0000","last_clean_scrub_stamp":"2024-09-14T11:23:09.667768+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:07:20.882638+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2227,"num_read_kb":2135,"num_write":439,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"260'312","reported_seq":933,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:00.766046+0000","last_change":"2024-09-14T11:23:00.765987+0000","last_active":"2024-09-14T11:23:00.766046+0000","last_peered":"2024-09-14T11:23:00.766046+0000","last_clean":"2024-09-14T11:23:00.766046+0000","last_became_active":"2024-09-14T10:45:43.690675+0000","last_became_peered":"2024-09-14T10:45:43.690675+0000","last_unstale":"2024-09-14T11:23:00.766046+0000","last_undegraded":"2024-09-14T11:23:00.766046+0000","last_fullsized":"2024-09-14T11:23:00.766046+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'312","last_scrub_stamp":"2024-09-14T11:23:00.765887+0000","last_deep_scrub":"260'312","last_deep_scrub_stamp":"2024-09-14T11:23:00.765887+0000","last_clean_scrub_stamp":"2024-09-14T11:23:00.765887+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:38:08.181333+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":527,"num_read_kb":9887,"num_write":1028,"num_write_kb":21015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"260'535","reported_seq":2252,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:17.205485+0000","last_change":"2024-09-14T11:23:17.205485+0000","last_active":"2024-09-14T11:23:17.205485+0000","last_peered":"2024-09-14T11:23:17.205485+0000","last_clean":"2024-09-14T11:23:17.205485+0000","last_became_active":"2024-09-14T10:45:45.717393+0000","last_became_peered":"2024-09-14T10:45:45.717393+0000","last_unstale":"2024-09-14T11:23:17.205485+0000","last_undegraded":"2024-09-14T11:23:17.205485+0000","last_fullsized":"2024-09-14T11:23:17.205485+0000","mapping_epoch":26,"log_start":"260'500","ondisk_log_start":"260'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'535","last_scrub_stamp":"2024-09-14T11:23:17.205379+0000","last_deep_scrub":"260'535","last_deep_scrub_stamp":"2024-09-14T11:23:17.205379+0000","last_clean_scrub_stamp":"2024-09-14T11:23:17.205379+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:56.826924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2830,"num_read_kb":2663,"num_write":635,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"260'389","reported_seq":1039,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:08.148332+0000","last_change":"2024-09-14T11:23:08.148260+0000","last_active":"2024-09-14T11:23:08.148332+0000","last_peered":"2024-09-14T11:23:08.148332+0000","last_clean":"2024-09-14T11:23:08.148332+0000","last_became_active":"2024-09-14T10:45:43.675216+0000","last_became_peered":"2024-09-14T10:45:43.675216+0000","last_unstale":"2024-09-14T11:23:08.148332+0000","last_undegraded":"2024-09-14T11:23:08.148332+0000","last_fullsized":"2024-09-14T11:23:08.148332+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'389","last_scrub_stamp":"2024-09-14T11:23:08.148160+0000","last_deep_scrub":"260'389","last_deep_scrub_stamp":"2024-09-14T11:23:08.148160+0000","last_clean_scrub_stamp":"2024-09-14T11:23:08.148160+0000","objects_scrubbed":4,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:29.501402+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":708,"num_read_kb":14121,"num_write":1222,"num_write_kb":48801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"260'871","reported_seq":2519,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:15.342684+0000","last_change":"2024-09-14T11:23:15.342684+0000","last_active":"2024-09-14T11:23:15.342684+0000","last_peered":"2024-09-14T11:23:15.342684+0000","last_clean":"2024-09-14T11:23:15.342684+0000","last_became_active":"2024-09-14T10:45:45.720939+0000","last_became_peered":"2024-09-14T10:45:45.720939+0000","last_unstale":"2024-09-14T11:23:15.342684+0000","last_undegraded":"2024-09-14T11:23:15.342684+0000","last_fullsized":"2024-09-14T11:23:15.342684+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'871","last_scrub_stamp":"2024-09-14T11:23:15.342592+0000","last_deep_scrub":"260'871","last_deep_scrub_stamp":"2024-09-14T11:23:15.342592+0000","last_clean_scrub_stamp":"2024-09-14T11:23:15.342592+0000","objects_scrubbed":2,"log_size":71,"log_dups_size":800,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:19:11.489780+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4139,"num_read_kb":3737,"num_write":1132,"num_write_kb":407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"260'313","reported_seq":902,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:02.304298+0000","last_change":"2024-09-14T11:23:02.304213+0000","last_active":"2024-09-14T11:23:02.304298+0000","last_peered":"2024-09-14T11:23:02.304298+0000","last_clean":"2024-09-14T11:23:02.304298+0000","last_became_active":"2024-09-14T10:45:43.681864+0000","last_became_peered":"2024-09-14T10:45:43.681864+0000","last_unstale":"2024-09-14T11:23:02.304298+0000","last_undegraded":"2024-09-14T11:23:02.304298+0000","last_fullsized":"2024-09-14T11:23:02.304298+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'313","last_scrub_stamp":"2024-09-14T11:23:02.304103+0000","last_deep_scrub":"260'313","last_deep_scrub_stamp":"2024-09-14T11:23:02.304103+0000","last_clean_scrub_stamp":"2024-09-14T11:23:02.304103+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:15.927678+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":459,"num_read_kb":5481,"num_write":964,"num_write_kb":23381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"260'449","reported_seq":2105,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:14.315404+0000","last_change":"2024-09-14T11:23:14.315348+0000","last_active":"2024-09-14T11:23:14.315404+0000","last_peered":"2024-09-14T11:23:14.315404+0000","last_clean":"2024-09-14T11:23:14.315404+0000","last_became_active":"2024-09-14T10:45:45.722575+0000","last_became_peered":"2024-09-14T10:45:45.722575+0000","last_unstale":"2024-09-14T11:23:14.315404+0000","last_undegraded":"2024-09-14T11:23:14.315404+0000","last_fullsized":"2024-09-14T11:23:14.315404+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'449","last_scrub_stamp":"2024-09-14T11:23:14.315255+0000","last_deep_scrub":"260'449","last_deep_scrub_stamp":"2024-09-14T11:23:14.315255+0000","last_clean_scrub_stamp":"2024-09-14T11:23:14.315255+0000","objects_scrubbed":2,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:15:08.436381+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2593,"num_read_kb":2475,"num_write":496,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"260'361","reported_seq":1003,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:04.433029+0000","last_change":"2024-09-14T11:23:04.433029+0000","last_active":"2024-09-14T11:23:04.433029+0000","last_peered":"2024-09-14T11:23:04.433029+0000","last_clean":"2024-09-14T11:23:04.433029+0000","last_became_active":"2024-09-14T10:45:43.691101+0000","last_became_peered":"2024-09-14T10:45:43.691101+0000","last_unstale":"2024-09-14T11:23:04.433029+0000","last_undegraded":"2024-09-14T11:23:04.433029+0000","last_fullsized":"2024-09-14T11:23:04.433029+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'361","last_scrub_stamp":"2024-09-14T11:23:04.432933+0000","last_deep_scrub":"260'361","last_deep_scrub_stamp":"2024-09-14T11:23:04.432933+0000","last_clean_scrub_stamp":"2024-09-14T11:23:04.432933+0000","objects_scrubbed":2,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:27.282075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":637,"num_read_kb":20829,"num_write":1146,"num_write_kb":28609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"260'965","reported_seq":2559,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:05.592937+0000","last_change":"2024-09-14T11:23:05.592864+0000","last_active":"2024-09-14T11:23:05.592937+0000","last_peered":"2024-09-14T11:23:05.592937+0000","last_clean":"2024-09-14T11:23:05.592937+0000","last_became_active":"2024-09-14T10:45:45.717482+0000","last_became_peered":"2024-09-14T10:45:45.717482+0000","last_unstale":"2024-09-14T11:23:05.592937+0000","last_undegraded":"2024-09-14T11:23:05.592937+0000","last_fullsized":"2024-09-14T11:23:05.592937+0000","mapping_epoch":26,"log_start":"260'900","ondisk_log_start":"260'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'965","last_scrub_stamp":"2024-09-14T11:23:05.592780+0000","last_deep_scrub":"260'965","last_deep_scrub_stamp":"2024-09-14T11:23:05.592780+0000","last_clean_scrub_stamp":"2024-09-14T11:23:05.592780+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":900,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:58.949827+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4656,"num_read_kb":4162,"num_write":1345,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"260'420","reported_seq":1067,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:01.490274+0000","last_change":"2024-09-14T11:23:01.490274+0000","last_active":"2024-09-14T11:23:01.490274+0000","last_peered":"2024-09-14T11:23:01.490274+0000","last_clean":"2024-09-14T11:23:01.490274+0000","last_became_active":"2024-09-14T10:45:43.681769+0000","last_became_peered":"2024-09-14T10:45:43.681769+0000","last_unstale":"2024-09-14T11:23:01.490274+0000","last_undegraded":"2024-09-14T11:23:01.490274+0000","last_fullsized":"2024-09-14T11:23:01.490274+0000","mapping_epoch":23,"log_start":"260'400","ondisk_log_start":"260'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'420","last_scrub_stamp":"2024-09-14T11:23:01.490176+0000","last_deep_scrub":"260'420","last_deep_scrub_stamp":"2024-09-14T11:23:01.490176+0000","last_clean_scrub_stamp":"2024-09-14T11:23:01.490176+0000","objects_scrubbed":5,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:59.490356+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":884,"num_read_kb":850,"num_write":1209,"num_write_kb":26526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"260'499","reported_seq":2183,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:09.302098+0000","last_change":"2024-09-14T11:23:09.302039+0000","last_active":"2024-09-14T11:23:09.302098+0000","last_peered":"2024-09-14T11:23:09.302098+0000","last_clean":"2024-09-14T11:23:09.302098+0000","last_became_active":"2024-09-14T10:45:45.724491+0000","last_became_peered":"2024-09-14T10:45:45.724491+0000","last_unstale":"2024-09-14T11:23:09.302098+0000","last_undegraded":"2024-09-14T11:23:09.302098+0000","last_fullsized":"2024-09-14T11:23:09.302098+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'499","last_scrub_stamp":"2024-09-14T11:23:09.301946+0000","last_deep_scrub":"260'499","last_deep_scrub_stamp":"2024-09-14T11:23:09.301946+0000","last_clean_scrub_stamp":"2024-09-14T11:23:09.301946+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:26.256389+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2800,"num_read_kb":2654,"num_write":635,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"260'363","reported_seq":988,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:00.219177+0000","last_change":"2024-09-14T11:23:00.219177+0000","last_active":"2024-09-14T11:23:00.219177+0000","last_peered":"2024-09-14T11:23:00.219177+0000","last_clean":"2024-09-14T11:23:00.219177+0000","last_became_active":"2024-09-14T10:45:43.672592+0000","last_became_peered":"2024-09-14T10:45:43.672592+0000","last_unstale":"2024-09-14T11:23:00.219177+0000","last_undegraded":"2024-09-14T11:23:00.219177+0000","last_fullsized":"2024-09-14T11:23:00.219177+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'363","last_scrub_stamp":"2024-09-14T11:23:00.219087+0000","last_deep_scrub":"260'363","last_deep_scrub_stamp":"2024-09-14T11:23:00.219087+0000","last_clean_scrub_stamp":"2024-09-14T11:23:00.219087+0000","objects_scrubbed":4,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:53.826069+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133682,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":581,"num_read_kb":14710,"num_write":1041,"num_write_kb":26884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"260'948","reported_seq":2556,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:02.605749+0000","last_change":"2024-09-14T11:23:02.605687+0000","last_active":"2024-09-14T11:23:02.605749+0000","last_peered":"2024-09-14T11:23:02.605749+0000","last_clean":"2024-09-14T11:23:02.605749+0000","last_became_active":"2024-09-14T10:45:45.712642+0000","last_became_peered":"2024-09-14T10:45:45.712642+0000","last_unstale":"2024-09-14T11:23:02.605749+0000","last_undegraded":"2024-09-14T11:23:02.605749+0000","last_fullsized":"2024-09-14T11:23:02.605749+0000","mapping_epoch":26,"log_start":"260'900","ondisk_log_start":"260'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'948","last_scrub_stamp":"2024-09-14T11:23:02.605604+0000","last_deep_scrub":"260'948","last_deep_scrub_stamp":"2024-09-14T11:23:02.605604+0000","last_clean_scrub_stamp":"2024-09-14T11:23:02.605604+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":900,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:29.530400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4544,"num_read_kb":4033,"num_write":1311,"num_write_kb":524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"260'381","reported_seq":1030,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:03.258437+0000","last_change":"2024-09-14T11:23:03.258437+0000","last_active":"2024-09-14T11:23:03.258437+0000","last_peered":"2024-09-14T11:23:03.258437+0000","last_clean":"2024-09-14T11:23:03.258437+0000","last_became_active":"2024-09-14T10:45:43.675233+0000","last_became_peered":"2024-09-14T10:45:43.675233+0000","last_unstale":"2024-09-14T11:23:03.258437+0000","last_undegraded":"2024-09-14T11:23:03.258437+0000","last_fullsized":"2024-09-14T11:23:03.258437+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'381","last_scrub_stamp":"2024-09-14T11:23:03.258350+0000","last_deep_scrub":"260'381","last_deep_scrub_stamp":"2024-09-14T11:23:03.258350+0000","last_clean_scrub_stamp":"2024-09-14T11:23:03.258350+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:04:00.733089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":674,"num_read_kb":10456,"num_write":1272,"num_write_kb":38144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"260'844","reported_seq":2446,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:06.692537+0000","last_change":"2024-09-14T11:23:06.692537+0000","last_active":"2024-09-14T11:23:06.692537+0000","last_peered":"2024-09-14T11:23:06.692537+0000","last_clean":"2024-09-14T11:23:06.692537+0000","last_became_active":"2024-09-14T10:45:45.711947+0000","last_became_peered":"2024-09-14T10:45:45.711947+0000","last_unstale":"2024-09-14T11:23:06.692537+0000","last_undegraded":"2024-09-14T11:23:06.692537+0000","last_fullsized":"2024-09-14T11:23:06.692537+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'844","last_scrub_stamp":"2024-09-14T11:23:06.692450+0000","last_deep_scrub":"260'844","last_deep_scrub_stamp":"2024-09-14T11:23:06.692450+0000","last_clean_scrub_stamp":"2024-09-14T11:23:06.692450+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":800,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:48.375095+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4120,"num_read_kb":3716,"num_write":1158,"num_write_kb":467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"260'307","reported_seq":915,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:09.184657+0000","last_change":"2024-09-14T11:23:09.184657+0000","last_active":"2024-09-14T11:23:09.184657+0000","last_peered":"2024-09-14T11:23:09.184657+0000","last_clean":"2024-09-14T11:23:09.184657+0000","last_became_active":"2024-09-14T10:45:43.677597+0000","last_became_peered":"2024-09-14T10:45:43.677597+0000","last_unstale":"2024-09-14T11:23:09.184657+0000","last_undegraded":"2024-09-14T11:23:09.184657+0000","last_fullsized":"2024-09-14T11:23:09.184657+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'307","last_scrub_stamp":"2024-09-14T11:23:09.184538+0000","last_deep_scrub":"260'307","last_deep_scrub_stamp":"2024-09-14T11:23:09.184538+0000","last_clean_scrub_stamp":"2024-09-14T11:23:09.184538+0000","objects_scrubbed":3,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:11.668626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":480,"num_read_kb":1898,"num_write":986,"num_write_kb":19841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"260'857","reported_seq":2379,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:08.648180+0000","last_change":"2024-09-14T11:23:08.648180+0000","last_active":"2024-09-14T11:23:08.648180+0000","last_peered":"2024-09-14T11:23:08.648180+0000","last_clean":"2024-09-14T11:23:08.648180+0000","last_became_active":"2024-09-14T10:45:45.715268+0000","last_became_peered":"2024-09-14T10:45:45.715268+0000","last_unstale":"2024-09-14T11:23:08.648180+0000","last_undegraded":"2024-09-14T11:23:08.648180+0000","last_fullsized":"2024-09-14T11:23:08.648180+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'857","last_scrub_stamp":"2024-09-14T11:23:08.648098+0000","last_deep_scrub":"260'857","last_deep_scrub_stamp":"2024-09-14T11:23:08.648098+0000","last_clean_scrub_stamp":"2024-09-14T11:23:08.648098+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":800,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:21.218133+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4230,"num_read_kb":3798,"num_write":1192,"num_write_kb":502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"260'355","reported_seq":1011,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:05.289243+0000","last_change":"2024-09-14T11:23:05.289243+0000","last_active":"2024-09-14T11:23:05.289243+0000","last_peered":"2024-09-14T11:23:05.289243+0000","last_clean":"2024-09-14T11:23:05.289243+0000","last_became_active":"2024-09-14T10:45:43.681694+0000","last_became_peered":"2024-09-14T10:45:43.681694+0000","last_unstale":"2024-09-14T11:23:05.289243+0000","last_undegraded":"2024-09-14T11:23:05.289243+0000","last_fullsized":"2024-09-14T11:23:05.289243+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'355","last_scrub_stamp":"2024-09-14T11:23:05.289154+0000","last_deep_scrub":"260'355","last_deep_scrub_stamp":"2024-09-14T11:23:05.289154+0000","last_clean_scrub_stamp":"2024-09-14T11:23:05.289154+0000","objects_scrubbed":2,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:15:49.436744+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133679,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":711,"num_read_kb":32454,"num_write":1261,"num_write_kb":21071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"260'432","reported_seq":1893,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:16.353009+0000","last_change":"2024-09-14T11:23:16.353009+0000","last_active":"2024-09-14T11:23:16.353009+0000","last_peered":"2024-09-14T11:23:16.353009+0000","last_clean":"2024-09-14T11:23:16.353009+0000","last_became_active":"2024-09-14T10:45:45.723441+0000","last_became_peered":"2024-09-14T10:45:45.723441+0000","last_unstale":"2024-09-14T11:23:16.353009+0000","last_undegraded":"2024-09-14T11:23:16.353009+0000","last_fullsized":"2024-09-14T11:23:16.353009+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'432","last_scrub_stamp":"2024-09-14T11:23:16.352923+0000","last_deep_scrub":"260'432","last_deep_scrub_stamp":"2024-09-14T11:23:16.352923+0000","last_clean_scrub_stamp":"2024-09-14T11:23:16.352923+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:43.275404+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2262,"num_read_kb":2127,"num_write":517,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"260'356","reported_seq":1000,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:59.642417+0000","last_change":"2024-09-14T11:22:59.642417+0000","last_active":"2024-09-14T11:22:59.642417+0000","last_peered":"2024-09-14T11:22:59.642417+0000","last_clean":"2024-09-14T11:22:59.642417+0000","last_became_active":"2024-09-14T10:45:43.681441+0000","last_became_peered":"2024-09-14T10:45:43.681441+0000","last_unstale":"2024-09-14T11:22:59.642417+0000","last_undegraded":"2024-09-14T11:22:59.642417+0000","last_fullsized":"2024-09-14T11:22:59.642417+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'356","last_scrub_stamp":"2024-09-14T11:22:59.642325+0000","last_deep_scrub":"260'356","last_deep_scrub_stamp":"2024-09-14T11:22:59.642325+0000","last_clean_scrub_stamp":"2024-09-14T11:22:59.642325+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:41.518525+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244496,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":649,"num_read_kb":21101,"num_write":1092,"num_write_kb":38924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"260'751","reported_seq":2230,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:05.568333+0000","last_change":"2024-09-14T11:23:05.568333+0000","last_active":"2024-09-14T11:23:05.568333+0000","last_peered":"2024-09-14T11:23:05.568333+0000","last_clean":"2024-09-14T11:23:05.568333+0000","last_became_active":"2024-09-14T10:45:45.711402+0000","last_became_peered":"2024-09-14T10:45:45.711402+0000","last_unstale":"2024-09-14T11:23:05.568333+0000","last_undegraded":"2024-09-14T11:23:05.568333+0000","last_fullsized":"2024-09-14T11:23:05.568333+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'751","last_scrub_stamp":"2024-09-14T11:23:05.568226+0000","last_deep_scrub":"260'751","last_deep_scrub_stamp":"2024-09-14T11:23:05.568226+0000","last_clean_scrub_stamp":"2024-09-14T11:23:05.568226+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:00.144694+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3613,"num_read_kb":3262,"num_write":995,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"260'351","reported_seq":980,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:02.925737+0000","last_change":"2024-09-14T11:23:02.925737+0000","last_active":"2024-09-14T11:23:02.925737+0000","last_peered":"2024-09-14T11:23:02.925737+0000","last_clean":"2024-09-14T11:23:02.925737+0000","last_became_active":"2024-09-14T10:45:43.690104+0000","last_became_peered":"2024-09-14T10:45:43.690104+0000","last_unstale":"2024-09-14T11:23:02.925737+0000","last_undegraded":"2024-09-14T11:23:02.925737+0000","last_fullsized":"2024-09-14T11:23:02.925737+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'351","last_scrub_stamp":"2024-09-14T11:23:02.925623+0000","last_deep_scrub":"260'351","last_deep_scrub_stamp":"2024-09-14T11:23:02.925623+0000","last_clean_scrub_stamp":"2024-09-14T11:23:02.925623+0000","objects_scrubbed":4,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:52.477625+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":636,"num_read_kb":1890,"num_write":1154,"num_write_kb":1386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"260'588","reported_seq":2236,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:04.608895+0000","last_change":"2024-09-14T11:23:04.608895+0000","last_active":"2024-09-14T11:23:04.608895+0000","last_peered":"2024-09-14T11:23:04.608895+0000","last_clean":"2024-09-14T11:23:04.608895+0000","last_became_active":"2024-09-14T10:45:45.723163+0000","last_became_peered":"2024-09-14T10:45:45.723163+0000","last_unstale":"2024-09-14T11:23:04.608895+0000","last_undegraded":"2024-09-14T11:23:04.608895+0000","last_fullsized":"2024-09-14T11:23:04.608895+0000","mapping_epoch":26,"log_start":"260'500","ondisk_log_start":"260'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'588","last_scrub_stamp":"2024-09-14T11:23:04.608810+0000","last_deep_scrub":"260'588","last_deep_scrub_stamp":"2024-09-14T11:23:04.608810+0000","last_clean_scrub_stamp":"2024-09-14T11:23:04.608810+0000","objects_scrubbed":4,"log_size":88,"log_dups_size":500,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:14.023702+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3275,"num_read_kb":3002,"num_write":768,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"260'379","reported_seq":1053,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:54.616609+0000","last_change":"2024-09-14T11:22:54.616609+0000","last_active":"2024-09-14T11:22:54.616609+0000","last_peered":"2024-09-14T11:22:54.616609+0000","last_clean":"2024-09-14T11:22:54.616609+0000","last_became_active":"2024-09-14T10:45:43.680517+0000","last_became_peered":"2024-09-14T10:45:43.680517+0000","last_unstale":"2024-09-14T11:22:54.616609+0000","last_undegraded":"2024-09-14T11:22:54.616609+0000","last_fullsized":"2024-09-14T11:22:54.616609+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'379","last_scrub_stamp":"2024-09-14T11:22:54.616470+0000","last_deep_scrub":"260'379","last_deep_scrub_stamp":"2024-09-14T11:22:54.616470+0000","last_clean_scrub_stamp":"2024-09-14T11:22:54.616470+0000","objects_scrubbed":8,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:48.841281+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133694,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":729,"num_read_kb":32475,"num_write":1387,"num_write_kb":39199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"260'770","reported_seq":2292,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:07.714670+0000","last_change":"2024-09-14T11:23:07.714670+0000","last_active":"2024-09-14T11:23:07.714670+0000","last_peered":"2024-09-14T11:23:07.714670+0000","last_clean":"2024-09-14T11:23:07.714670+0000","last_became_active":"2024-09-14T10:45:45.718969+0000","last_became_peered":"2024-09-14T10:45:45.718969+0000","last_unstale":"2024-09-14T11:23:07.714670+0000","last_undegraded":"2024-09-14T11:23:07.714670+0000","last_fullsized":"2024-09-14T11:23:07.714670+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'770","last_scrub_stamp":"2024-09-14T11:23:07.714570+0000","last_deep_scrub":"260'770","last_deep_scrub_stamp":"2024-09-14T11:23:07.714570+0000","last_clean_scrub_stamp":"2024-09-14T11:23:07.714570+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:16.190729+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3670,"num_read_kb":3326,"num_write":1002,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"260'340","reported_seq":968,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:12.215702+0000","last_change":"2024-09-14T11:23:12.215702+0000","last_active":"2024-09-14T11:23:12.215702+0000","last_peered":"2024-09-14T11:23:12.215702+0000","last_clean":"2024-09-14T11:23:12.215702+0000","last_became_active":"2024-09-14T10:45:43.690489+0000","last_became_peered":"2024-09-14T10:45:43.690489+0000","last_unstale":"2024-09-14T11:23:12.215702+0000","last_undegraded":"2024-09-14T11:23:12.215702+0000","last_fullsized":"2024-09-14T11:23:12.215702+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'340","last_scrub_stamp":"2024-09-14T11:23:12.215605+0000","last_deep_scrub":"260'340","last_deep_scrub_stamp":"2024-09-14T11:23:12.215605+0000","last_clean_scrub_stamp":"2024-09-14T11:23:12.215605+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:12.269469+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":562,"num_read_kb":22090,"num_write":1057,"num_write_kb":34450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"260'629","reported_seq":2211,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:09.765722+0000","last_change":"2024-09-14T11:23:09.765722+0000","last_active":"2024-09-14T11:23:09.765722+0000","last_peered":"2024-09-14T11:23:09.765722+0000","last_clean":"2024-09-14T11:23:09.765722+0000","last_became_active":"2024-09-14T10:45:45.727095+0000","last_became_peered":"2024-09-14T10:45:45.727095+0000","last_unstale":"2024-09-14T11:23:09.765722+0000","last_undegraded":"2024-09-14T11:23:09.765722+0000","last_fullsized":"2024-09-14T11:23:09.765722+0000","mapping_epoch":26,"log_start":"260'600","ondisk_log_start":"260'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'629","last_scrub_stamp":"2024-09-14T11:23:09.765606+0000","last_deep_scrub":"260'629","last_deep_scrub_stamp":"2024-09-14T11:23:09.765606+0000","last_clean_scrub_stamp":"2024-09-14T11:23:09.765606+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":600,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:16.812881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3428,"num_read_kb":3090,"num_write":924,"num_write_kb":450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":893,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"260'312","reported_seq":907,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:01.817437+0000","last_change":"2024-09-14T11:23:01.817385+0000","last_active":"2024-09-14T11:23:01.817437+0000","last_peered":"2024-09-14T11:23:01.817437+0000","last_clean":"2024-09-14T11:23:01.817437+0000","last_became_active":"2024-09-14T10:45:43.689186+0000","last_became_peered":"2024-09-14T10:45:43.689186+0000","last_unstale":"2024-09-14T11:23:01.817437+0000","last_undegraded":"2024-09-14T11:23:01.817437+0000","last_fullsized":"2024-09-14T11:23:01.817437+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'312","last_scrub_stamp":"2024-09-14T11:23:01.817298+0000","last_deep_scrub":"260'312","last_deep_scrub_stamp":"2024-09-14T11:23:01.817298+0000","last_clean_scrub_stamp":"2024-09-14T11:23:01.817298+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:01.982799+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133706,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":457,"num_read_kb":44560,"num_write":936,"num_write_kb":69256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"260'1085","reported_seq":2831,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:03.606116+0000","last_change":"2024-09-14T11:23:03.606116+0000","last_active":"2024-09-14T11:23:03.606116+0000","last_peered":"2024-09-14T11:23:03.606116+0000","last_clean":"2024-09-14T11:23:03.606116+0000","last_became_active":"2024-09-14T10:45:45.720636+0000","last_became_peered":"2024-09-14T10:45:45.720636+0000","last_unstale":"2024-09-14T11:23:03.606116+0000","last_undegraded":"2024-09-14T11:23:03.606116+0000","last_fullsized":"2024-09-14T11:23:03.606116+0000","mapping_epoch":26,"log_start":"260'1000","ondisk_log_start":"260'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1085","last_scrub_stamp":"2024-09-14T11:23:03.606026+0000","last_deep_scrub":"260'1085","last_deep_scrub_stamp":"2024-09-14T11:23:03.606026+0000","last_clean_scrub_stamp":"2024-09-14T11:23:03.606026+0000","objects_scrubbed":2,"log_size":85,"log_dups_size":1000,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:51:34.804450+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5348,"num_read_kb":4870,"num_write":1559,"num_write_kb":616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"260'336","reported_seq":1017,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:10.212053+0000","last_change":"2024-09-14T11:23:10.212053+0000","last_active":"2024-09-14T11:23:10.212053+0000","last_peered":"2024-09-14T11:23:10.212053+0000","last_clean":"2024-09-14T11:23:10.212053+0000","last_became_active":"2024-09-14T10:45:43.682573+0000","last_became_peered":"2024-09-14T10:45:43.682573+0000","last_unstale":"2024-09-14T11:23:10.212053+0000","last_undegraded":"2024-09-14T11:23:10.212053+0000","last_fullsized":"2024-09-14T11:23:10.212053+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'336","last_scrub_stamp":"2024-09-14T11:23:10.211893+0000","last_deep_scrub":"260'336","last_deep_scrub_stamp":"2024-09-14T11:23:10.211893+0000","last_clean_scrub_stamp":"2024-09-14T11:23:10.211893+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:35.666356+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244522,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":804,"num_read_kb":3981,"num_write":1025,"num_write_kb":35472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"260'383","reported_seq":1020,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:11.233324+0000","last_change":"2024-09-14T11:23:11.233324+0000","last_active":"2024-09-14T11:23:11.233324+0000","last_peered":"2024-09-14T11:23:11.233324+0000","last_clean":"2024-09-14T11:23:11.233324+0000","last_became_active":"2024-09-14T10:45:43.673527+0000","last_became_peered":"2024-09-14T10:45:43.673527+0000","last_unstale":"2024-09-14T11:23:11.233324+0000","last_undegraded":"2024-09-14T11:23:11.233324+0000","last_fullsized":"2024-09-14T11:23:11.233324+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'383","last_scrub_stamp":"2024-09-14T11:23:11.233207+0000","last_deep_scrub":"260'383","last_deep_scrub_stamp":"2024-09-14T11:23:11.233207+0000","last_clean_scrub_stamp":"2024-09-14T11:23:11.233207+0000","objects_scrubbed":5,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:10:35.983721+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":679,"num_read_kb":21996,"num_write":1218,"num_write_kb":25813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"260'1016","reported_seq":2623,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:13.796760+0000","last_change":"2024-09-14T11:23:13.796760+0000","last_active":"2024-09-14T11:23:13.796760+0000","last_peered":"2024-09-14T11:23:13.796760+0000","last_clean":"2024-09-14T11:23:13.796760+0000","last_became_active":"2024-09-14T10:45:45.724040+0000","last_became_peered":"2024-09-14T10:45:45.724040+0000","last_unstale":"2024-09-14T11:23:13.796760+0000","last_undegraded":"2024-09-14T11:23:13.796760+0000","last_fullsized":"2024-09-14T11:23:13.796760+0000","mapping_epoch":26,"log_start":"260'1000","ondisk_log_start":"260'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1016","last_scrub_stamp":"2024-09-14T11:23:13.796666+0000","last_deep_scrub":"260'1016","last_deep_scrub_stamp":"2024-09-14T11:23:13.796666+0000","last_clean_scrub_stamp":"2024-09-14T11:23:13.796666+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":1000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:58.735365+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4769,"num_read_kb":4210,"num_write":1424,"num_write_kb":631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"260'384","reported_seq":1025,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:06.332254+0000","last_change":"2024-09-14T11:23:06.332254+0000","last_active":"2024-09-14T11:23:06.332254+0000","last_peered":"2024-09-14T11:23:06.332254+0000","last_clean":"2024-09-14T11:23:06.332254+0000","last_became_active":"2024-09-14T10:45:43.687162+0000","last_became_peered":"2024-09-14T10:45:43.687162+0000","last_unstale":"2024-09-14T11:23:06.332254+0000","last_undegraded":"2024-09-14T11:23:06.332254+0000","last_fullsized":"2024-09-14T11:23:06.332254+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'384","last_scrub_stamp":"2024-09-14T11:23:06.332163+0000","last_deep_scrub":"260'384","last_deep_scrub_stamp":"2024-09-14T11:23:06.332163+0000","last_clean_scrub_stamp":"2024-09-14T11:23:06.332163+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:22.685467+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":664,"num_read_kb":37354,"num_write":1184,"num_write_kb":26064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"260'478","reported_seq":2026,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:07.626572+0000","last_change":"2024-09-14T11:23:07.626572+0000","last_active":"2024-09-14T11:23:07.626572+0000","last_peered":"2024-09-14T11:23:07.626572+0000","last_clean":"2024-09-14T11:23:07.626572+0000","last_became_active":"2024-09-14T10:45:45.711869+0000","last_became_peered":"2024-09-14T10:45:45.711869+0000","last_unstale":"2024-09-14T11:23:07.626572+0000","last_undegraded":"2024-09-14T11:23:07.626572+0000","last_fullsized":"2024-09-14T11:23:07.626572+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'478","last_scrub_stamp":"2024-09-14T11:23:07.626475+0000","last_deep_scrub":"260'478","last_deep_scrub_stamp":"2024-09-14T11:23:07.626475+0000","last_clean_scrub_stamp":"2024-09-14T11:23:07.626475+0000","objects_scrubbed":1,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:37.243122+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2555,"num_read_kb":2382,"num_write":592,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":694,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10817,"num_read_kb":8523,"num_write":3117,"num_write_kb":1010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1096,"ondisk_log_size":1096,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":14831,"num_objects":87,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":15133,"num_read_kb":14796,"num_write":17057,"num_write_kb":4975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2512,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":29662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1466,"ondisk_log_size":1466,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":791,"ondisk_log_size":791,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1553710,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":17035,"num_read_kb":36473,"num_write":14315,"num_write_kb":11597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":710380,"num_omap_keys":1616,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2052,"ondisk_log_size":2052,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2403,"num_read_kb":2864,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":219533,"num_read_kb":201172,"num_write":55836,"num_write_kb":19050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":143,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":36254,"num_omap_keys":147,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4202,"ondisk_log_size":4202,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":33830883,"num_objects":281,"num_object_clones":0,"num_object_copies":562,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":281,"num_whiteouts":0,"num_read":44198,"num_read_kb":2138103,"num_write":73249,"num_write_kb":2157996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":68608000,"data_stored":67661766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3853,"ondisk_log_size":3853,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":135,"num_read_kb":175817,"num_write":154,"num_write_kb":116354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":174730,"num_write":154,"num_write_kb":116354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509908,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":216692,"kb_used_data":18916,"kb_used_omap":1,"kb_used_meta":197758,"kb_avail":94155148,"statfs":{"total":96636764160,"available":96414871552,"internally_reserved":0,"allocated":19369984,"data_stored":17696805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":202504647},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509906,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284708,"kb_used_data":10580,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":94087132,"statfs":{"total":96636764160,"available":96345223168,"internally_reserved":0,"allocated":10833920,"data_stored":9216591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":280689093},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509905,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113044,"kb_used_data":19460,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94258796,"statfs":{"total":96636764160,"available":96521007104,"internally_reserved":0,"allocated":19927040,"data_stored":18233635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542610,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":229044,"kb_used_data":9124,"kb_used_omap":1,"kb_used_meta":219902,"kb_avail":94142796,"statfs":{"total":96636764160,"available":96402223104,"internally_reserved":0,"allocated":9342976,"data_stored":7745589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":225180106},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542610,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89140,"kb_used_data":8036,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94282700,"statfs":{"total":96636764160,"available":96545484800,"internally_reserved":0,"allocated":8228864,"data_stored":6610205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":83032518},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542612,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":256336,"kb_used_data":8640,"kb_used_omap":1,"kb_used_meta":247678,"kb_avail":94115504,"statfs":{"total":96636764160,"available":96374276096,"internally_reserved":0,"allocated":8847360,"data_stored":7201151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":253622725},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542611,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":193432,"kb_used_data":9608,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":94178408,"statfs":{"total":96636764160,"available":96438689792,"internally_reserved":0,"allocated":9838592,"data_stored":8236289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":188217797},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575314,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":111084,"kb_used_data":11868,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94260756,"statfs":{"total":96636764160,"available":96523014144,"internally_reserved":0,"allocated":12152832,"data_stored":10503839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16318464,"data_stored":16157858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6668288,"data_stored":6553434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8556544,"data_stored":8428200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15777792,"data_stored":15622768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6250496,"data_stored":6160671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4653056,"data_stored":4535149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4632576,"data_stored":4535041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5750784,"data_stored":5668645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":5195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:23:59.270 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:59.270 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-14T11:01:19.834649+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=19, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:59.271 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:59.271 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:59.271 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-14T11:01:22.859353+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=1, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:59.272 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:59.272 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-14T11:11:41.563447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=41, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=52, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:23:59.275 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T11:24:19.276 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:24:19.619 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-14T11:24:19.632 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-09-14T11:24:19.634 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":1419,"stamp":"2024-09-14T11:24:17.795063+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":35991604,"num_objects":734,"num_object_clones":0,"num_object_copies":1468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":734,"num_whiteouts":0,"num_read":309464,"num_read_kb":2752545,"num_write":164025,"num_write_kb":2428992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":190,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":750274,"num_omap_keys":1791,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13757,"ondisk_log_size":13757,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1493480,"kb_used_data":96232,"kb_used_omap":12,"kb_used_meta":1397107,"kb_avail":753481240,"statfs":{"total":773094113280,"available":771564789760,"internally_reserved":0,"allocated":98541568,"data_stored":85444104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1430638128},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005238"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:33.560230+0000","last_change":"2024-09-14T11:23:33.560175+0000","last_active":"2024-09-14T11:23:33.560230+0000","last_peered":"2024-09-14T11:23:33.560230+0000","last_clean":"2024-09-14T11:23:33.560230+0000","last_became_active":"2024-09-14T11:11:42.592933+0000","last_became_peered":"2024-09-14T11:11:42.592933+0000","last_unstale":"2024-09-14T11:23:33.560230+0000","last_undegraded":"2024-09-14T11:23:33.560230+0000","last_fullsized":"2024-09-14T11:23:33.560230+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:33.560091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:33.560091+0000","last_clean_scrub_stamp":"2024-09-14T11:23:33.560091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:16.523328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"260'2","reported_seq":40,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:31.536031+0000","last_change":"2024-09-14T11:23:31.535946+0000","last_active":"2024-09-14T11:23:31.536031+0000","last_peered":"2024-09-14T11:23:31.536031+0000","last_clean":"2024-09-14T11:23:31.536031+0000","last_became_active":"2024-09-14T11:01:23.881902+0000","last_became_peered":"2024-09-14T11:01:23.881902+0000","last_unstale":"2024-09-14T11:23:31.536031+0000","last_undegraded":"2024-09-14T11:23:31.536031+0000","last_fullsized":"2024-09-14T11:23:31.536031+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:23:31.535822+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:23:31.535822+0000","last_clean_scrub_stamp":"2024-09-14T11:23:31.535822+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:35.535334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"260'8","reported_seq":60,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:35.827963+0000","last_change":"2024-09-14T11:23:35.827907+0000","last_active":"2024-09-14T11:23:35.827963+0000","last_peered":"2024-09-14T11:23:35.827963+0000","last_clean":"2024-09-14T11:23:35.827963+0000","last_became_active":"2024-09-14T11:01:20.867142+0000","last_became_peered":"2024-09-14T11:01:20.867142+0000","last_unstale":"2024-09-14T11:23:35.827963+0000","last_undegraded":"2024-09-14T11:23:35.827963+0000","last_fullsized":"2024-09-14T11:23:35.827963+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'8","last_scrub_stamp":"2024-09-14T11:23:35.827820+0000","last_deep_scrub":"260'8","last_deep_scrub_stamp":"2024-09-14T11:23:35.827820+0000","last_clean_scrub_stamp":"2024-09-14T11:23:35.827820+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:23.584930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20482,"num_write":18,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"260'30","reported_seq":131,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:36.693388+0000","last_change":"2024-09-14T11:23:36.693388+0000","last_active":"2024-09-14T11:23:36.693388+0000","last_peered":"2024-09-14T11:23:36.693388+0000","last_clean":"2024-09-14T11:23:36.693388+0000","last_became_active":"2024-09-14T10:59:48.416537+0000","last_became_peered":"2024-09-14T10:59:48.416537+0000","last_unstale":"2024-09-14T11:23:36.693388+0000","last_undegraded":"2024-09-14T11:23:36.693388+0000","last_fullsized":"2024-09-14T11:23:36.693388+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'30","last_scrub_stamp":"2024-09-14T11:23:36.693306+0000","last_deep_scrub":"260'30","last_deep_scrub_stamp":"2024-09-14T11:23:36.693306+0000","last_clean_scrub_stamp":"2024-09-14T11:23:36.693306+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:14.676967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":249,"num_read_kb":173,"num_write":73,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:39.336179+0000","last_change":"2024-09-14T11:23:39.336123+0000","last_active":"2024-09-14T11:23:39.336179+0000","last_peered":"2024-09-14T11:23:39.336179+0000","last_clean":"2024-09-14T11:23:39.336179+0000","last_became_active":"2024-09-14T11:11:42.587818+0000","last_became_peered":"2024-09-14T11:11:42.587818+0000","last_unstale":"2024-09-14T11:23:39.336179+0000","last_undegraded":"2024-09-14T11:23:39.336179+0000","last_fullsized":"2024-09-14T11:23:39.336179+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:39.336034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:39.336034+0000","last_clean_scrub_stamp":"2024-09-14T11:23:39.336034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:28.266229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"260'2","reported_seq":39,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:36.340173+0000","last_change":"2024-09-14T11:23:36.340117+0000","last_active":"2024-09-14T11:23:36.340173+0000","last_peered":"2024-09-14T11:23:36.340173+0000","last_clean":"2024-09-14T11:23:36.340173+0000","last_became_active":"2024-09-14T11:01:23.881074+0000","last_became_peered":"2024-09-14T11:01:23.881074+0000","last_unstale":"2024-09-14T11:23:36.340173+0000","last_undegraded":"2024-09-14T11:23:36.340173+0000","last_fullsized":"2024-09-14T11:23:36.340173+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:23:36.340032+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:23:36.340032+0000","last_clean_scrub_stamp":"2024-09-14T11:23:36.340032+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:40:27.471764+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":571,"num_write":2,"num_write_kb":571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"260'8","reported_seq":57,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:40.610010+0000","last_change":"2024-09-14T11:23:40.609940+0000","last_active":"2024-09-14T11:23:40.610010+0000","last_peered":"2024-09-14T11:23:40.610010+0000","last_clean":"2024-09-14T11:23:40.610010+0000","last_became_active":"2024-09-14T11:01:20.868373+0000","last_became_peered":"2024-09-14T11:01:20.868373+0000","last_unstale":"2024-09-14T11:23:40.610010+0000","last_undegraded":"2024-09-14T11:23:40.610010+0000","last_fullsized":"2024-09-14T11:23:40.610010+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'8","last_scrub_stamp":"2024-09-14T11:23:40.609844+0000","last_deep_scrub":"260'8","last_deep_scrub_stamp":"2024-09-14T11:23:40.609844+0000","last_clean_scrub_stamp":"2024-09-14T11:23:40.609844+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:15.660130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10811,"num_write":13,"num_write_kb":10811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"260'56","reported_seq":204,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:37.678477+0000","last_change":"2024-09-14T11:23:37.678392+0000","last_active":"2024-09-14T11:23:37.678477+0000","last_peered":"2024-09-14T11:23:37.678477+0000","last_clean":"2024-09-14T11:23:37.678477+0000","last_became_active":"2024-09-14T10:59:48.416222+0000","last_became_peered":"2024-09-14T10:59:48.416222+0000","last_unstale":"2024-09-14T11:23:37.678477+0000","last_undegraded":"2024-09-14T11:23:37.678477+0000","last_fullsized":"2024-09-14T11:23:37.678477+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'56","last_scrub_stamp":"2024-09-14T11:23:37.678312+0000","last_deep_scrub":"260'56","last_deep_scrub_stamp":"2024-09-14T11:23:37.678312+0000","last_clean_scrub_stamp":"2024-09-14T11:23:37.678312+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:33.010328+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":447,"num_read_kb":304,"num_write":135,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:35.600074+0000","last_change":"2024-09-14T11:23:35.599995+0000","last_active":"2024-09-14T11:23:35.600074+0000","last_peered":"2024-09-14T11:23:35.600074+0000","last_clean":"2024-09-14T11:23:35.600074+0000","last_became_active":"2024-09-14T11:11:42.593314+0000","last_became_peered":"2024-09-14T11:11:42.593314+0000","last_unstale":"2024-09-14T11:23:35.600074+0000","last_undegraded":"2024-09-14T11:23:35.600074+0000","last_fullsized":"2024-09-14T11:23:35.600074+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:35.599879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:35.599879+0000","last_clean_scrub_stamp":"2024-09-14T11:23:35.599879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:47:55.344309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"260'3","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:48.681970+0000","last_change":"2024-09-14T11:23:48.681970+0000","last_active":"2024-09-14T11:23:48.681970+0000","last_peered":"2024-09-14T11:23:48.681970+0000","last_clean":"2024-09-14T11:23:48.681970+0000","last_became_active":"2024-09-14T11:01:23.892846+0000","last_became_peered":"2024-09-14T11:01:23.892846+0000","last_unstale":"2024-09-14T11:23:48.681970+0000","last_undegraded":"2024-09-14T11:23:48.681970+0000","last_fullsized":"2024-09-14T11:23:48.681970+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T11:23:48.681878+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T11:23:48.681878+0000","last_clean_scrub_stamp":"2024-09-14T11:23:48.681878+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:17:45.275403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"260'2","reported_seq":47,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:36.814321+0000","last_change":"2024-09-14T11:23:36.814321+0000","last_active":"2024-09-14T11:23:36.814321+0000","last_peered":"2024-09-14T11:23:36.814321+0000","last_clean":"2024-09-14T11:23:36.814321+0000","last_became_active":"2024-09-14T11:01:20.864672+0000","last_became_peered":"2024-09-14T11:01:20.864672+0000","last_unstale":"2024-09-14T11:23:36.814321+0000","last_undegraded":"2024-09-14T11:23:36.814321+0000","last_fullsized":"2024-09-14T11:23:36.814321+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:23:36.814216+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:23:36.814216+0000","last_clean_scrub_stamp":"2024-09-14T11:23:36.814216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:48:31.171854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"260'48","reported_seq":176,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:32.211469+0000","last_change":"2024-09-14T11:23:32.211469+0000","last_active":"2024-09-14T11:23:32.211469+0000","last_peered":"2024-09-14T11:23:32.211469+0000","last_clean":"2024-09-14T11:23:32.211469+0000","last_became_active":"2024-09-14T10:59:48.419525+0000","last_became_peered":"2024-09-14T10:59:48.419525+0000","last_unstale":"2024-09-14T11:23:32.211469+0000","last_undegraded":"2024-09-14T11:23:32.211469+0000","last_fullsized":"2024-09-14T11:23:32.211469+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'48","last_scrub_stamp":"2024-09-14T11:23:32.211344+0000","last_deep_scrub":"260'48","last_deep_scrub_stamp":"2024-09-14T11:23:32.211344+0000","last_clean_scrub_stamp":"2024-09-14T11:23:32.211344+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:38.708280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":364,"num_read_kb":247,"num_write":125,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:55.660953+0000","last_change":"2024-09-14T11:23:55.660845+0000","last_active":"2024-09-14T11:23:55.660953+0000","last_peered":"2024-09-14T11:23:55.660953+0000","last_clean":"2024-09-14T11:23:55.660953+0000","last_became_active":"2024-09-14T11:11:42.587218+0000","last_became_peered":"2024-09-14T11:11:42.587218+0000","last_unstale":"2024-09-14T11:23:55.660953+0000","last_undegraded":"2024-09-14T11:23:55.660953+0000","last_fullsized":"2024-09-14T11:23:55.660953+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:55.660732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:55.660732+0000","last_clean_scrub_stamp":"2024-09-14T11:23:55.660732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:45.998493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"260'2","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:47.688948+0000","last_change":"2024-09-14T11:23:47.688948+0000","last_active":"2024-09-14T11:23:47.688948+0000","last_peered":"2024-09-14T11:23:47.688948+0000","last_clean":"2024-09-14T11:23:47.688948+0000","last_became_active":"2024-09-14T11:01:23.886771+0000","last_became_peered":"2024-09-14T11:01:23.886771+0000","last_unstale":"2024-09-14T11:23:47.688948+0000","last_undegraded":"2024-09-14T11:23:47.688948+0000","last_fullsized":"2024-09-14T11:23:47.688948+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:23:47.688858+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:23:47.688858+0000","last_clean_scrub_stamp":"2024-09-14T11:23:47.688858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:23:32.298587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":118,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"257'5","reported_seq":59,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:32.559598+0000","last_change":"2024-09-14T11:23:32.559543+0000","last_active":"2024-09-14T11:23:32.559598+0000","last_peered":"2024-09-14T11:23:32.559598+0000","last_clean":"2024-09-14T11:23:32.559598+0000","last_became_active":"2024-09-14T11:01:20.861799+0000","last_became_peered":"2024-09-14T11:01:20.861799+0000","last_unstale":"2024-09-14T11:23:32.559598+0000","last_undegraded":"2024-09-14T11:23:32.559598+0000","last_fullsized":"2024-09-14T11:23:32.559598+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'5","last_scrub_stamp":"2024-09-14T11:23:32.559455+0000","last_deep_scrub":"257'5","last_deep_scrub_stamp":"2024-09-14T11:23:32.559455+0000","last_clean_scrub_stamp":"2024-09-14T11:23:32.559455+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:15.145786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"260'15","reported_seq":85,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:30.130793+0000","last_change":"2024-09-14T11:23:30.130793+0000","last_active":"2024-09-14T11:23:30.130793+0000","last_peered":"2024-09-14T11:23:30.130793+0000","last_clean":"2024-09-14T11:23:30.130793+0000","last_became_active":"2024-09-14T10:59:48.411423+0000","last_became_peered":"2024-09-14T10:59:48.411423+0000","last_unstale":"2024-09-14T11:23:30.130793+0000","last_undegraded":"2024-09-14T11:23:30.130793+0000","last_fullsized":"2024-09-14T11:23:30.130793+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'15","last_scrub_stamp":"2024-09-14T11:23:30.130697+0000","last_deep_scrub":"260'15","last_deep_scrub_stamp":"2024-09-14T11:23:30.130697+0000","last_clean_scrub_stamp":"2024-09-14T11:23:30.130697+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:14:49.943927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":68,"num_write":41,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:46.841887+0000","last_change":"2024-09-14T11:23:46.841798+0000","last_active":"2024-09-14T11:23:46.841887+0000","last_peered":"2024-09-14T11:23:46.841887+0000","last_clean":"2024-09-14T11:23:46.841887+0000","last_became_active":"2024-09-14T11:11:42.583717+0000","last_became_peered":"2024-09-14T11:11:42.583717+0000","last_unstale":"2024-09-14T11:23:46.841887+0000","last_undegraded":"2024-09-14T11:23:46.841887+0000","last_fullsized":"2024-09-14T11:23:46.841887+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:46.841692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:46.841692+0000","last_clean_scrub_stamp":"2024-09-14T11:23:46.841692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:30.010935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"257'3","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:27.541195+0000","last_change":"2024-09-14T11:23:27.541195+0000","last_active":"2024-09-14T11:23:27.541195+0000","last_peered":"2024-09-14T11:23:27.541195+0000","last_clean":"2024-09-14T11:23:27.541195+0000","last_became_active":"2024-09-14T11:01:23.894107+0000","last_became_peered":"2024-09-14T11:01:23.894107+0000","last_unstale":"2024-09-14T11:23:27.541195+0000","last_undegraded":"2024-09-14T11:23:27.541195+0000","last_fullsized":"2024-09-14T11:23:27.541195+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'3","last_scrub_stamp":"2024-09-14T11:23:27.541106+0000","last_deep_scrub":"257'3","last_deep_scrub_stamp":"2024-09-14T11:23:27.541106+0000","last_clean_scrub_stamp":"2024-09-14T11:23:27.541106+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:28:00.951271+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"260'6","reported_seq":53,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:39.647526+0000","last_change":"2024-09-14T11:23:39.647526+0000","last_active":"2024-09-14T11:23:39.647526+0000","last_peered":"2024-09-14T11:23:39.647526+0000","last_clean":"2024-09-14T11:23:39.647526+0000","last_became_active":"2024-09-14T11:01:20.867768+0000","last_became_peered":"2024-09-14T11:01:20.867768+0000","last_unstale":"2024-09-14T11:23:39.647526+0000","last_undegraded":"2024-09-14T11:23:39.647526+0000","last_fullsized":"2024-09-14T11:23:39.647526+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-14T11:23:39.647423+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-14T11:23:39.647423+0000","last_clean_scrub_stamp":"2024-09-14T11:23:39.647423+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:37.269875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"260'40","reported_seq":154,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:29.172741+0000","last_change":"2024-09-14T11:23:29.172741+0000","last_active":"2024-09-14T11:23:29.172741+0000","last_peered":"2024-09-14T11:23:29.172741+0000","last_clean":"2024-09-14T11:23:29.172741+0000","last_became_active":"2024-09-14T10:59:48.413296+0000","last_became_peered":"2024-09-14T10:59:48.413296+0000","last_unstale":"2024-09-14T11:23:29.172741+0000","last_undegraded":"2024-09-14T11:23:29.172741+0000","last_fullsized":"2024-09-14T11:23:29.172741+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'40","last_scrub_stamp":"2024-09-14T11:23:29.172654+0000","last_deep_scrub":"260'40","last_deep_scrub_stamp":"2024-09-14T11:23:29.172654+0000","last_clean_scrub_stamp":"2024-09-14T11:23:29.172654+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:31.140458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":304,"num_read_kb":193,"num_write":101,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:42.609642+0000","last_change":"2024-09-14T11:23:42.609549+0000","last_active":"2024-09-14T11:23:42.609642+0000","last_peered":"2024-09-14T11:23:42.609642+0000","last_clean":"2024-09-14T11:23:42.609642+0000","last_became_active":"2024-09-14T11:11:42.582310+0000","last_became_peered":"2024-09-14T11:11:42.582310+0000","last_unstale":"2024-09-14T11:23:42.609642+0000","last_undegraded":"2024-09-14T11:23:42.609642+0000","last_fullsized":"2024-09-14T11:23:42.609642+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:42.609452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:42.609452+0000","last_clean_scrub_stamp":"2024-09-14T11:23:42.609452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:04:55.422405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"260'8","reported_seq":51,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:59.215017+0000","last_change":"2024-09-14T11:23:59.215017+0000","last_active":"2024-09-14T11:23:59.215017+0000","last_peered":"2024-09-14T11:23:59.215017+0000","last_clean":"2024-09-14T11:23:59.215017+0000","last_became_active":"2024-09-14T11:01:23.888017+0000","last_became_peered":"2024-09-14T11:01:23.888017+0000","last_unstale":"2024-09-14T11:23:59.215017+0000","last_undegraded":"2024-09-14T11:23:59.215017+0000","last_fullsized":"2024-09-14T11:23:59.215017+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'8","last_scrub_stamp":"2024-09-14T11:23:59.214885+0000","last_deep_scrub":"260'8","last_deep_scrub_stamp":"2024-09-14T11:23:59.214885+0000","last_clean_scrub_stamp":"2024-09-14T11:23:59.214885+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:58:48.111827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":11264,"num_write":18,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"257'2","reported_seq":46,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:24:02.281147+0000","last_change":"2024-09-14T11:24:02.281147+0000","last_active":"2024-09-14T11:24:02.281147+0000","last_peered":"2024-09-14T11:24:02.281147+0000","last_clean":"2024-09-14T11:24:02.281147+0000","last_became_active":"2024-09-14T11:01:20.863258+0000","last_became_peered":"2024-09-14T11:01:20.863258+0000","last_unstale":"2024-09-14T11:24:02.281147+0000","last_undegraded":"2024-09-14T11:24:02.281147+0000","last_fullsized":"2024-09-14T11:24:02.281147+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'2","last_scrub_stamp":"2024-09-14T11:24:02.281016+0000","last_deep_scrub":"257'2","last_deep_scrub_stamp":"2024-09-14T11:24:02.281016+0000","last_clean_scrub_stamp":"2024-09-14T11:24:02.281016+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:10.128750+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"260'62","reported_seq":223,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:27.335658+0000","last_change":"2024-09-14T11:23:27.335658+0000","last_active":"2024-09-14T11:23:27.335658+0000","last_peered":"2024-09-14T11:23:27.335658+0000","last_clean":"2024-09-14T11:23:27.335658+0000","last_became_active":"2024-09-14T10:59:48.419994+0000","last_became_peered":"2024-09-14T10:59:48.419994+0000","last_unstale":"2024-09-14T11:23:27.335658+0000","last_undegraded":"2024-09-14T11:23:27.335658+0000","last_fullsized":"2024-09-14T11:23:27.335658+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'62","last_scrub_stamp":"2024-09-14T11:23:27.335563+0000","last_deep_scrub":"260'62","last_deep_scrub_stamp":"2024-09-14T11:23:27.335563+0000","last_clean_scrub_stamp":"2024-09-14T11:23:27.335563+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:10.177468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":520,"num_read_kb":329,"num_write":161,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"260'2","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:40.260162+0000","last_change":"2024-09-14T11:23:40.260066+0000","last_active":"2024-09-14T11:23:40.260162+0000","last_peered":"2024-09-14T11:23:40.260162+0000","last_clean":"2024-09-14T11:23:40.260162+0000","last_became_active":"2024-09-14T11:11:42.588308+0000","last_became_peered":"2024-09-14T11:11:42.588308+0000","last_unstale":"2024-09-14T11:23:40.260162+0000","last_undegraded":"2024-09-14T11:23:40.260162+0000","last_fullsized":"2024-09-14T11:23:40.260162+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:23:40.259968+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:23:40.259968+0000","last_clean_scrub_stamp":"2024-09-14T11:23:40.259968+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:56.678699+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":36,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:39.279825+0000","last_change":"2024-09-14T11:23:39.279747+0000","last_active":"2024-09-14T11:23:39.279825+0000","last_peered":"2024-09-14T11:23:39.279825+0000","last_clean":"2024-09-14T11:23:39.279825+0000","last_became_active":"2024-09-14T11:01:23.884138+0000","last_became_peered":"2024-09-14T11:01:23.884138+0000","last_unstale":"2024-09-14T11:23:39.279825+0000","last_undegraded":"2024-09-14T11:23:39.279825+0000","last_fullsized":"2024-09-14T11:23:39.279825+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:39.279655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:39.279655+0000","last_clean_scrub_stamp":"2024-09-14T11:23:39.279655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:51.502440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:23.553877+0000","last_change":"2024-09-14T11:23:23.553826+0000","last_active":"2024-09-14T11:23:23.553877+0000","last_peered":"2024-09-14T11:23:23.553877+0000","last_clean":"2024-09-14T11:23:23.553877+0000","last_became_active":"2024-09-14T11:01:20.854737+0000","last_became_peered":"2024-09-14T11:01:20.854737+0000","last_unstale":"2024-09-14T11:23:23.553877+0000","last_undegraded":"2024-09-14T11:23:23.553877+0000","last_fullsized":"2024-09-14T11:23:23.553877+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:23.553739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:23.553739+0000","last_clean_scrub_stamp":"2024-09-14T11:23:23.553739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:08.924782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"260'45","reported_seq":172,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:27.756247+0000","last_change":"2024-09-14T11:23:27.756122+0000","last_active":"2024-09-14T11:23:27.756247+0000","last_peered":"2024-09-14T11:23:27.756247+0000","last_clean":"2024-09-14T11:23:27.756247+0000","last_became_active":"2024-09-14T10:59:48.419091+0000","last_became_peered":"2024-09-14T10:59:48.419091+0000","last_unstale":"2024-09-14T11:23:27.756247+0000","last_undegraded":"2024-09-14T11:23:27.756247+0000","last_fullsized":"2024-09-14T11:23:27.756247+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'45","last_scrub_stamp":"2024-09-14T11:23:27.756027+0000","last_deep_scrub":"260'45","last_deep_scrub_stamp":"2024-09-14T11:23:27.756027+0000","last_clean_scrub_stamp":"2024-09-14T11:23:27.756027+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:51.744018+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":368,"num_read_kb":243,"num_write":109,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:31.538139+0000","last_change":"2024-09-14T11:23:31.538044+0000","last_active":"2024-09-14T11:23:31.538139+0000","last_peered":"2024-09-14T11:23:31.538139+0000","last_clean":"2024-09-14T11:23:31.538139+0000","last_became_active":"2024-09-14T11:11:42.582899+0000","last_became_peered":"2024-09-14T11:11:42.582899+0000","last_unstale":"2024-09-14T11:23:31.538139+0000","last_undegraded":"2024-09-14T11:23:31.538139+0000","last_fullsized":"2024-09-14T11:23:31.538139+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:31.537948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:31.537948+0000","last_clean_scrub_stamp":"2024-09-14T11:23:31.537948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:48.541182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":36,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:43.894427+0000","last_change":"2024-09-14T11:23:43.894340+0000","last_active":"2024-09-14T11:23:43.894427+0000","last_peered":"2024-09-14T11:23:43.894427+0000","last_clean":"2024-09-14T11:23:43.894427+0000","last_became_active":"2024-09-14T11:01:23.894587+0000","last_became_peered":"2024-09-14T11:01:23.894587+0000","last_unstale":"2024-09-14T11:23:43.894427+0000","last_undegraded":"2024-09-14T11:23:43.894427+0000","last_fullsized":"2024-09-14T11:23:43.894427+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:43.894248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:43.894248+0000","last_clean_scrub_stamp":"2024-09-14T11:23:43.894248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:33.450732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"260'3","reported_seq":47,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:33.205160+0000","last_change":"2024-09-14T11:23:33.205078+0000","last_active":"2024-09-14T11:23:33.205160+0000","last_peered":"2024-09-14T11:23:33.205160+0000","last_clean":"2024-09-14T11:23:33.205160+0000","last_became_active":"2024-09-14T11:01:20.869244+0000","last_became_peered":"2024-09-14T11:01:20.869244+0000","last_unstale":"2024-09-14T11:23:33.205160+0000","last_undegraded":"2024-09-14T11:23:33.205160+0000","last_fullsized":"2024-09-14T11:23:33.205160+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T11:23:33.204965+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T11:23:33.204965+0000","last_clean_scrub_stamp":"2024-09-14T11:23:33.204965+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:14:10.951877+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"260'35","reported_seq":146,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:28.181303+0000","last_change":"2024-09-14T11:23:28.181239+0000","last_active":"2024-09-14T11:23:28.181303+0000","last_peered":"2024-09-14T11:23:28.181303+0000","last_clean":"2024-09-14T11:23:28.181303+0000","last_became_active":"2024-09-14T10:59:48.414023+0000","last_became_peered":"2024-09-14T10:59:48.414023+0000","last_unstale":"2024-09-14T11:23:28.181303+0000","last_undegraded":"2024-09-14T11:23:28.181303+0000","last_fullsized":"2024-09-14T11:23:28.181303+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'35","last_scrub_stamp":"2024-09-14T11:23:28.181143+0000","last_deep_scrub":"260'35","last_deep_scrub_stamp":"2024-09-14T11:23:28.181143+0000","last_clean_scrub_stamp":"2024-09-14T11:23:28.181143+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:57.692388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":284,"num_read_kb":189,"num_write":86,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:53.623667+0000","last_change":"2024-09-14T11:23:53.623667+0000","last_active":"2024-09-14T11:23:53.623667+0000","last_peered":"2024-09-14T11:23:53.623667+0000","last_clean":"2024-09-14T11:23:53.623667+0000","last_became_active":"2024-09-14T11:11:42.592439+0000","last_became_peered":"2024-09-14T11:11:42.592439+0000","last_unstale":"2024-09-14T11:23:53.623667+0000","last_undegraded":"2024-09-14T11:23:53.623667+0000","last_fullsized":"2024-09-14T11:23:53.623667+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:53.623571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:53.623571+0000","last_clean_scrub_stamp":"2024-09-14T11:23:53.623571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:42.584352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"257'3","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:40.908281+0000","last_change":"2024-09-14T11:23:40.908281+0000","last_active":"2024-09-14T11:23:40.908281+0000","last_peered":"2024-09-14T11:23:40.908281+0000","last_clean":"2024-09-14T11:23:40.908281+0000","last_became_active":"2024-09-14T11:01:23.891631+0000","last_became_peered":"2024-09-14T11:01:23.891631+0000","last_unstale":"2024-09-14T11:23:40.908281+0000","last_undegraded":"2024-09-14T11:23:40.908281+0000","last_fullsized":"2024-09-14T11:23:40.908281+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'3","last_scrub_stamp":"2024-09-14T11:23:40.908197+0000","last_deep_scrub":"257'3","last_deep_scrub_stamp":"2024-09-14T11:23:40.908197+0000","last_clean_scrub_stamp":"2024-09-14T11:23:40.908197+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:54:01.206445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"260'11","reported_seq":63,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:54.286583+0000","last_change":"2024-09-14T11:23:54.286583+0000","last_active":"2024-09-14T11:23:54.286583+0000","last_peered":"2024-09-14T11:23:54.286583+0000","last_clean":"2024-09-14T11:23:54.286583+0000","last_became_active":"2024-09-14T11:01:20.861043+0000","last_became_peered":"2024-09-14T11:01:20.861043+0000","last_unstale":"2024-09-14T11:23:54.286583+0000","last_undegraded":"2024-09-14T11:23:54.286583+0000","last_fullsized":"2024-09-14T11:23:54.286583+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'11","last_scrub_stamp":"2024-09-14T11:23:54.286464+0000","last_deep_scrub":"260'11","last_deep_scrub_stamp":"2024-09-14T11:23:54.286464+0000","last_clean_scrub_stamp":"2024-09-14T11:23:54.286464+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:01.335940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":17410,"num_write":21,"num_write_kb":12290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"260'250","reported_seq":804,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:35.655585+0000","last_change":"2024-09-14T11:23:35.655510+0000","last_active":"2024-09-14T11:23:35.655585+0000","last_peered":"2024-09-14T11:23:35.655585+0000","last_clean":"2024-09-14T11:23:35.655585+0000","last_became_active":"2024-09-14T10:59:48.416342+0000","last_became_peered":"2024-09-14T10:59:48.416342+0000","last_unstale":"2024-09-14T11:23:35.655585+0000","last_undegraded":"2024-09-14T11:23:35.655585+0000","last_fullsized":"2024-09-14T11:23:35.655585+0000","mapping_epoch":249,"log_start":"257'200","ondisk_log_start":"257'200","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'250","last_scrub_stamp":"2024-09-14T11:23:35.655429+0000","last_deep_scrub":"260'250","last_deep_scrub_stamp":"2024-09-14T11:23:35.655429+0000","last_clean_scrub_stamp":"2024-09-14T11:23:35.655429+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:00:13.084282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2428,"num_read_kb":2819,"num_write":491,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"260'2","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:36.269800+0000","last_change":"2024-09-14T11:23:36.269800+0000","last_active":"2024-09-14T11:23:36.269800+0000","last_peered":"2024-09-14T11:23:36.269800+0000","last_clean":"2024-09-14T11:23:36.269800+0000","last_became_active":"2024-09-14T11:11:42.587835+0000","last_became_peered":"2024-09-14T11:11:42.587835+0000","last_unstale":"2024-09-14T11:23:36.269800+0000","last_undegraded":"2024-09-14T11:23:36.269800+0000","last_fullsized":"2024-09-14T11:23:36.269800+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:23:36.269714+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:23:36.269714+0000","last_clean_scrub_stamp":"2024-09-14T11:23:36.269714+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:11.209024+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"260'3","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:46.663116+0000","last_change":"2024-09-14T11:23:46.663116+0000","last_active":"2024-09-14T11:23:46.663116+0000","last_peered":"2024-09-14T11:23:46.663116+0000","last_clean":"2024-09-14T11:23:46.663116+0000","last_became_active":"2024-09-14T11:01:23.892735+0000","last_became_peered":"2024-09-14T11:01:23.892735+0000","last_unstale":"2024-09-14T11:23:46.663116+0000","last_undegraded":"2024-09-14T11:23:46.663116+0000","last_fullsized":"2024-09-14T11:23:46.663116+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T11:23:46.663035+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T11:23:46.663035+0000","last_clean_scrub_stamp":"2024-09-14T11:23:46.663035+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:58:50.263185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"260'4","reported_seq":49,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:22.598035+0000","last_change":"2024-09-14T11:23:22.598035+0000","last_active":"2024-09-14T11:23:22.598035+0000","last_peered":"2024-09-14T11:23:22.598035+0000","last_clean":"2024-09-14T11:23:22.598035+0000","last_became_active":"2024-09-14T11:01:20.860541+0000","last_became_peered":"2024-09-14T11:01:20.860541+0000","last_unstale":"2024-09-14T11:23:22.598035+0000","last_undegraded":"2024-09-14T11:23:22.598035+0000","last_fullsized":"2024-09-14T11:23:22.598035+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-14T11:23:22.597945+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-14T11:23:22.597945+0000","last_clean_scrub_stamp":"2024-09-14T11:23:22.597945+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:04.581022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":61,"num_write":4,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"260'12","reported_seq":85,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:34.637117+0000","last_change":"2024-09-14T11:23:34.637055+0000","last_active":"2024-09-14T11:23:34.637117+0000","last_peered":"2024-09-14T11:23:34.637117+0000","last_clean":"2024-09-14T11:23:34.637117+0000","last_became_active":"2024-09-14T10:59:48.417001+0000","last_became_peered":"2024-09-14T10:59:48.417001+0000","last_unstale":"2024-09-14T11:23:34.637117+0000","last_undegraded":"2024-09-14T11:23:34.637117+0000","last_fullsized":"2024-09-14T11:23:34.637117+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'12","last_scrub_stamp":"2024-09-14T11:23:34.636971+0000","last_deep_scrub":"260'12","last_deep_scrub_stamp":"2024-09-14T11:23:34.636971+0000","last_clean_scrub_stamp":"2024-09-14T11:23:34.636971+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:10.187396+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":70,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:37.322794+0000","last_change":"2024-09-14T11:23:37.322794+0000","last_active":"2024-09-14T11:23:37.322794+0000","last_peered":"2024-09-14T11:23:37.322794+0000","last_clean":"2024-09-14T11:23:37.322794+0000","last_became_active":"2024-09-14T11:11:42.593873+0000","last_became_peered":"2024-09-14T11:11:42.593873+0000","last_unstale":"2024-09-14T11:23:37.322794+0000","last_undegraded":"2024-09-14T11:23:37.322794+0000","last_fullsized":"2024-09-14T11:23:37.322794+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:37.322693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:37.322693+0000","last_clean_scrub_stamp":"2024-09-14T11:23:37.322693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:39.923521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":36,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:42.910036+0000","last_change":"2024-09-14T11:23:42.910036+0000","last_active":"2024-09-14T11:23:42.910036+0000","last_peered":"2024-09-14T11:23:42.910036+0000","last_clean":"2024-09-14T11:23:42.910036+0000","last_became_active":"2024-09-14T11:01:23.897154+0000","last_became_peered":"2024-09-14T11:01:23.897154+0000","last_unstale":"2024-09-14T11:23:42.910036+0000","last_undegraded":"2024-09-14T11:23:42.910036+0000","last_fullsized":"2024-09-14T11:23:42.910036+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:42.909945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:42.909945+0000","last_clean_scrub_stamp":"2024-09-14T11:23:42.909945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:00:24.409515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"260'2","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:33.842422+0000","last_change":"2024-09-14T11:23:33.842422+0000","last_active":"2024-09-14T11:23:33.842422+0000","last_peered":"2024-09-14T11:23:33.842422+0000","last_clean":"2024-09-14T11:23:33.842422+0000","last_became_active":"2024-09-14T11:01:20.868135+0000","last_became_peered":"2024-09-14T11:01:20.868135+0000","last_unstale":"2024-09-14T11:23:33.842422+0000","last_undegraded":"2024-09-14T11:23:33.842422+0000","last_fullsized":"2024-09-14T11:23:33.842422+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:23:33.842335+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:23:33.842335+0000","last_clean_scrub_stamp":"2024-09-14T11:23:33.842335+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:46.268446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"260'27","reported_seq":122,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:28.800973+0000","last_change":"2024-09-14T11:23:28.800888+0000","last_active":"2024-09-14T11:23:28.800973+0000","last_peered":"2024-09-14T11:23:28.800973+0000","last_clean":"2024-09-14T11:23:28.800973+0000","last_became_active":"2024-09-14T10:59:48.415324+0000","last_became_peered":"2024-09-14T10:59:48.415324+0000","last_unstale":"2024-09-14T11:23:28.800973+0000","last_undegraded":"2024-09-14T11:23:28.800973+0000","last_fullsized":"2024-09-14T11:23:28.800973+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'27","last_scrub_stamp":"2024-09-14T11:23:28.800763+0000","last_deep_scrub":"260'27","last_deep_scrub_stamp":"2024-09-14T11:23:28.800763+0000","last_clean_scrub_stamp":"2024-09-14T11:23:28.800763+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:44.358336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":136,"num_write":70,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:32.551128+0000","last_change":"2024-09-14T11:23:32.551128+0000","last_active":"2024-09-14T11:23:32.551128+0000","last_peered":"2024-09-14T11:23:32.551128+0000","last_clean":"2024-09-14T11:23:32.551128+0000","last_became_active":"2024-09-14T11:11:42.591815+0000","last_became_peered":"2024-09-14T11:11:42.591815+0000","last_unstale":"2024-09-14T11:23:32.551128+0000","last_undegraded":"2024-09-14T11:23:32.551128+0000","last_fullsized":"2024-09-14T11:23:32.551128+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:32.551039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:32.551039+0000","last_clean_scrub_stamp":"2024-09-14T11:23:32.551039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:29.945074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"260'3","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:26.541198+0000","last_change":"2024-09-14T11:23:26.541198+0000","last_active":"2024-09-14T11:23:26.541198+0000","last_peered":"2024-09-14T11:23:26.541198+0000","last_clean":"2024-09-14T11:23:26.541198+0000","last_became_active":"2024-09-14T11:01:23.883763+0000","last_became_peered":"2024-09-14T11:01:23.883763+0000","last_unstale":"2024-09-14T11:23:26.541198+0000","last_undegraded":"2024-09-14T11:23:26.541198+0000","last_fullsized":"2024-09-14T11:23:26.541198+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T11:23:26.541105+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T11:23:26.541105+0000","last_clean_scrub_stamp":"2024-09-14T11:23:26.541105+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:04.376193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"260'5","reported_seq":52,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:38.651718+0000","last_change":"2024-09-14T11:23:38.651718+0000","last_active":"2024-09-14T11:23:38.651718+0000","last_peered":"2024-09-14T11:23:38.651718+0000","last_clean":"2024-09-14T11:23:38.651718+0000","last_became_active":"2024-09-14T11:01:20.866642+0000","last_became_peered":"2024-09-14T11:01:20.866642+0000","last_unstale":"2024-09-14T11:23:38.651718+0000","last_undegraded":"2024-09-14T11:23:38.651718+0000","last_fullsized":"2024-09-14T11:23:38.651718+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-14T11:23:38.651598+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-14T11:23:38.651598+0000","last_clean_scrub_stamp":"2024-09-14T11:23:38.651598+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:18.402367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":13312,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"260'32","reported_seq":136,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:49.325993+0000","last_change":"2024-09-14T11:23:49.325993+0000","last_active":"2024-09-14T11:23:49.325993+0000","last_peered":"2024-09-14T11:23:49.325993+0000","last_clean":"2024-09-14T11:23:49.325993+0000","last_became_active":"2024-09-14T10:59:48.418305+0000","last_became_peered":"2024-09-14T10:59:48.418305+0000","last_unstale":"2024-09-14T11:23:49.325993+0000","last_undegraded":"2024-09-14T11:23:49.325993+0000","last_fullsized":"2024-09-14T11:23:49.325993+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'32","last_scrub_stamp":"2024-09-14T11:23:49.325858+0000","last_deep_scrub":"260'32","last_deep_scrub_stamp":"2024-09-14T11:23:49.325858+0000","last_clean_scrub_stamp":"2024-09-14T11:23:49.325858+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:19:40.091519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":251,"num_read_kb":158,"num_write":84,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:54.636642+0000","last_change":"2024-09-14T11:23:54.636642+0000","last_active":"2024-09-14T11:23:54.636642+0000","last_peered":"2024-09-14T11:23:54.636642+0000","last_clean":"2024-09-14T11:23:54.636642+0000","last_became_active":"2024-09-14T11:11:42.588573+0000","last_became_peered":"2024-09-14T11:11:42.588573+0000","last_unstale":"2024-09-14T11:23:54.636642+0000","last_undegraded":"2024-09-14T11:23:54.636642+0000","last_fullsized":"2024-09-14T11:23:54.636642+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:54.636541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:54.636541+0000","last_clean_scrub_stamp":"2024-09-14T11:23:54.636541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:13.077906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":36,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:44.640871+0000","last_change":"2024-09-14T11:23:44.640871+0000","last_active":"2024-09-14T11:23:44.640871+0000","last_peered":"2024-09-14T11:23:44.640871+0000","last_clean":"2024-09-14T11:23:44.640871+0000","last_became_active":"2024-09-14T11:01:23.894751+0000","last_became_peered":"2024-09-14T11:01:23.894751+0000","last_unstale":"2024-09-14T11:23:44.640871+0000","last_undegraded":"2024-09-14T11:23:44.640871+0000","last_fullsized":"2024-09-14T11:23:44.640871+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:44.640775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:44.640775+0000","last_clean_scrub_stamp":"2024-09-14T11:23:44.640775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:15.919564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:28.499763+0000","last_change":"2024-09-14T11:23:28.499763+0000","last_active":"2024-09-14T11:23:28.499763+0000","last_peered":"2024-09-14T11:23:28.499763+0000","last_clean":"2024-09-14T11:23:28.499763+0000","last_became_active":"2024-09-14T11:01:20.866975+0000","last_became_peered":"2024-09-14T11:01:20.866975+0000","last_unstale":"2024-09-14T11:23:28.499763+0000","last_undegraded":"2024-09-14T11:23:28.499763+0000","last_fullsized":"2024-09-14T11:23:28.499763+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:28.499680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:28.499680+0000","last_clean_scrub_stamp":"2024-09-14T11:23:28.499680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:14.266221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"260'17","reported_seq":91,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:47.328072+0000","last_change":"2024-09-14T11:23:47.328072+0000","last_active":"2024-09-14T11:23:47.328072+0000","last_peered":"2024-09-14T11:23:47.328072+0000","last_clean":"2024-09-14T11:23:47.328072+0000","last_became_active":"2024-09-14T10:59:48.420711+0000","last_became_peered":"2024-09-14T10:59:48.420711+0000","last_unstale":"2024-09-14T11:23:47.328072+0000","last_undegraded":"2024-09-14T11:23:47.328072+0000","last_fullsized":"2024-09-14T11:23:47.328072+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'17","last_scrub_stamp":"2024-09-14T11:23:47.327953+0000","last_deep_scrub":"260'17","last_deep_scrub_stamp":"2024-09-14T11:23:47.327953+0000","last_clean_scrub_stamp":"2024-09-14T11:23:47.327953+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:04:46.458061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":78,"num_write":43,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:38.299232+0000","last_change":"2024-09-14T11:23:38.299155+0000","last_active":"2024-09-14T11:23:38.299232+0000","last_peered":"2024-09-14T11:23:38.299232+0000","last_clean":"2024-09-14T11:23:38.299232+0000","last_became_active":"2024-09-14T11:11:42.583965+0000","last_became_peered":"2024-09-14T11:11:42.583965+0000","last_unstale":"2024-09-14T11:23:38.299232+0000","last_undegraded":"2024-09-14T11:23:38.299232+0000","last_fullsized":"2024-09-14T11:23:38.299232+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:38.299035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:38.299035+0000","last_clean_scrub_stamp":"2024-09-14T11:23:38.299035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:08.765002+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"257'5","reported_seq":51,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:42.630157+0000","last_change":"2024-09-14T11:23:42.630157+0000","last_active":"2024-09-14T11:23:42.630157+0000","last_peered":"2024-09-14T11:23:42.630157+0000","last_clean":"2024-09-14T11:23:42.630157+0000","last_became_active":"2024-09-14T11:01:23.893365+0000","last_became_peered":"2024-09-14T11:01:23.893365+0000","last_unstale":"2024-09-14T11:23:42.630157+0000","last_undegraded":"2024-09-14T11:23:42.630157+0000","last_fullsized":"2024-09-14T11:23:42.630157+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'5","last_scrub_stamp":"2024-09-14T11:23:42.630036+0000","last_deep_scrub":"257'5","last_deep_scrub_stamp":"2024-09-14T11:23:42.630036+0000","last_clean_scrub_stamp":"2024-09-14T11:23:42.630036+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:40.544674+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"260'3","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:37.650095+0000","last_change":"2024-09-14T11:23:37.650095+0000","last_active":"2024-09-14T11:23:37.650095+0000","last_peered":"2024-09-14T11:23:37.650095+0000","last_clean":"2024-09-14T11:23:37.650095+0000","last_became_active":"2024-09-14T11:01:20.869209+0000","last_became_peered":"2024-09-14T11:01:20.869209+0000","last_unstale":"2024-09-14T11:23:37.650095+0000","last_undegraded":"2024-09-14T11:23:37.650095+0000","last_fullsized":"2024-09-14T11:23:37.650095+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T11:23:37.649997+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T11:23:37.649997+0000","last_clean_scrub_stamp":"2024-09-14T11:23:37.649997+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:01:53.309609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"260'35","reported_seq":145,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:25.748484+0000","last_change":"2024-09-14T11:23:25.748484+0000","last_active":"2024-09-14T11:23:25.748484+0000","last_peered":"2024-09-14T11:23:25.748484+0000","last_clean":"2024-09-14T11:23:25.748484+0000","last_became_active":"2024-09-14T10:59:48.416149+0000","last_became_peered":"2024-09-14T10:59:48.416149+0000","last_unstale":"2024-09-14T11:23:25.748484+0000","last_undegraded":"2024-09-14T11:23:25.748484+0000","last_fullsized":"2024-09-14T11:23:25.748484+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'35","last_scrub_stamp":"2024-09-14T11:23:25.748399+0000","last_deep_scrub":"260'35","last_deep_scrub_stamp":"2024-09-14T11:23:25.748399+0000","last_clean_scrub_stamp":"2024-09-14T11:23:25.748399+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:42.195292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":285,"num_read_kb":193,"num_write":82,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"260'2","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:41.620661+0000","last_change":"2024-09-14T11:23:41.620661+0000","last_active":"2024-09-14T11:23:41.620661+0000","last_peered":"2024-09-14T11:23:41.620661+0000","last_clean":"2024-09-14T11:23:41.620661+0000","last_became_active":"2024-09-14T11:11:42.583477+0000","last_became_peered":"2024-09-14T11:11:42.583477+0000","last_unstale":"2024-09-14T11:23:41.620661+0000","last_undegraded":"2024-09-14T11:23:41.620661+0000","last_fullsized":"2024-09-14T11:23:41.620661+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:23:41.620559+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:23:41.620559+0000","last_clean_scrub_stamp":"2024-09-14T11:23:41.620559+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:21.095844+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"260'8","reported_seq":53,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:41.883597+0000","last_change":"2024-09-14T11:23:41.883597+0000","last_active":"2024-09-14T11:23:41.883597+0000","last_peered":"2024-09-14T11:23:41.883597+0000","last_clean":"2024-09-14T11:23:41.883597+0000","last_became_active":"2024-09-14T11:01:23.891343+0000","last_became_peered":"2024-09-14T11:01:23.891343+0000","last_unstale":"2024-09-14T11:23:41.883597+0000","last_undegraded":"2024-09-14T11:23:41.883597+0000","last_fullsized":"2024-09-14T11:23:41.883597+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'8","last_scrub_stamp":"2024-09-14T11:23:41.883510+0000","last_deep_scrub":"260'8","last_deep_scrub_stamp":"2024-09-14T11:23:41.883510+0000","last_clean_scrub_stamp":"2024-09-14T11:23:41.883510+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:39:42.260527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":15362,"num_write":13,"num_write_kb":10242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"260'3","reported_seq":47,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:29.500998+0000","last_change":"2024-09-14T11:23:29.500998+0000","last_active":"2024-09-14T11:23:29.500998+0000","last_peered":"2024-09-14T11:23:29.500998+0000","last_clean":"2024-09-14T11:23:29.500998+0000","last_became_active":"2024-09-14T11:01:20.861817+0000","last_became_peered":"2024-09-14T11:01:20.861817+0000","last_unstale":"2024-09-14T11:23:29.500998+0000","last_undegraded":"2024-09-14T11:23:29.500998+0000","last_fullsized":"2024-09-14T11:23:29.500998+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T11:23:29.500892+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T11:23:29.500892+0000","last_clean_scrub_stamp":"2024-09-14T11:23:29.500892+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:56:46.263750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"260'106","reported_seq":370,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:30.287346+0000","last_change":"2024-09-14T11:23:30.287346+0000","last_active":"2024-09-14T11:23:30.287346+0000","last_peered":"2024-09-14T11:23:30.287346+0000","last_clean":"2024-09-14T11:23:30.287346+0000","last_became_active":"2024-09-14T10:59:48.418011+0000","last_became_peered":"2024-09-14T10:59:48.418011+0000","last_unstale":"2024-09-14T11:23:30.287346+0000","last_undegraded":"2024-09-14T11:23:30.287346+0000","last_fullsized":"2024-09-14T11:23:30.287346+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'106","last_scrub_stamp":"2024-09-14T11:23:30.287247+0000","last_deep_scrub":"260'106","last_deep_scrub_stamp":"2024-09-14T11:23:30.287247+0000","last_clean_scrub_stamp":"2024-09-14T11:23:30.287247+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:42.685812+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1045,"num_read_kb":858,"num_write":220,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"260'2","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:37.295373+0000","last_change":"2024-09-14T11:23:37.295307+0000","last_active":"2024-09-14T11:23:37.295373+0000","last_peered":"2024-09-14T11:23:37.295373+0000","last_clean":"2024-09-14T11:23:37.295373+0000","last_became_active":"2024-09-14T11:11:42.580611+0000","last_became_peered":"2024-09-14T11:11:42.580611+0000","last_unstale":"2024-09-14T11:23:37.295373+0000","last_undegraded":"2024-09-14T11:23:37.295373+0000","last_fullsized":"2024-09-14T11:23:37.295373+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:23:37.295213+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:23:37.295213+0000","last_clean_scrub_stamp":"2024-09-14T11:23:37.295213+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:59.398297+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":36,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:58.218671+0000","last_change":"2024-09-14T11:23:58.218671+0000","last_active":"2024-09-14T11:23:58.218671+0000","last_peered":"2024-09-14T11:23:58.218671+0000","last_clean":"2024-09-14T11:23:58.218671+0000","last_became_active":"2024-09-14T11:01:23.886496+0000","last_became_peered":"2024-09-14T11:01:23.886496+0000","last_unstale":"2024-09-14T11:23:58.218671+0000","last_undegraded":"2024-09-14T11:23:58.218671+0000","last_fullsized":"2024-09-14T11:23:58.218671+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:58.218568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:58.218568+0000","last_clean_scrub_stamp":"2024-09-14T11:23:58.218568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:56:58.573129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"257'3","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:30.486327+0000","last_change":"2024-09-14T11:23:30.486327+0000","last_active":"2024-09-14T11:23:30.486327+0000","last_peered":"2024-09-14T11:23:30.486327+0000","last_clean":"2024-09-14T11:23:30.486327+0000","last_became_active":"2024-09-14T11:01:20.863707+0000","last_became_peered":"2024-09-14T11:01:20.863707+0000","last_unstale":"2024-09-14T11:23:30.486327+0000","last_undegraded":"2024-09-14T11:23:30.486327+0000","last_fullsized":"2024-09-14T11:23:30.486327+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'3","last_scrub_stamp":"2024-09-14T11:23:30.486239+0000","last_deep_scrub":"257'3","last_deep_scrub_stamp":"2024-09-14T11:23:30.486239+0000","last_clean_scrub_stamp":"2024-09-14T11:23:30.486239+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:12.831780+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"260'54","reported_seq":199,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:31.762730+0000","last_change":"2024-09-14T11:23:31.762730+0000","last_active":"2024-09-14T11:23:31.762730+0000","last_peered":"2024-09-14T11:23:31.762730+0000","last_clean":"2024-09-14T11:23:31.762730+0000","last_became_active":"2024-09-14T10:59:48.421875+0000","last_became_peered":"2024-09-14T10:59:48.421875+0000","last_unstale":"2024-09-14T11:23:31.762730+0000","last_undegraded":"2024-09-14T11:23:31.762730+0000","last_fullsized":"2024-09-14T11:23:31.762730+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'54","last_scrub_stamp":"2024-09-14T11:23:31.762641+0000","last_deep_scrub":"260'54","last_deep_scrub_stamp":"2024-09-14T11:23:31.762641+0000","last_clean_scrub_stamp":"2024-09-14T11:23:31.762641+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:50.111431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":456,"num_read_kb":308,"num_write":139,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:51.663675+0000","last_change":"2024-09-14T11:23:51.663675+0000","last_active":"2024-09-14T11:23:51.663675+0000","last_peered":"2024-09-14T11:23:51.663675+0000","last_clean":"2024-09-14T11:23:51.663675+0000","last_became_active":"2024-09-14T11:11:42.590056+0000","last_became_peered":"2024-09-14T11:11:42.590056+0000","last_unstale":"2024-09-14T11:23:51.663675+0000","last_undegraded":"2024-09-14T11:23:51.663675+0000","last_fullsized":"2024-09-14T11:23:51.663675+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:51.663593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:51.663593+0000","last_clean_scrub_stamp":"2024-09-14T11:23:51.663593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:26.893565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"260'2","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:39.868241+0000","last_change":"2024-09-14T11:23:39.868167+0000","last_active":"2024-09-14T11:23:39.868241+0000","last_peered":"2024-09-14T11:23:39.868241+0000","last_clean":"2024-09-14T11:23:39.868241+0000","last_became_active":"2024-09-14T11:01:23.891331+0000","last_became_peered":"2024-09-14T11:01:23.891331+0000","last_unstale":"2024-09-14T11:23:39.868241+0000","last_undegraded":"2024-09-14T11:23:39.868241+0000","last_fullsized":"2024-09-14T11:23:39.868241+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:23:39.868078+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:23:39.868078+0000","last_clean_scrub_stamp":"2024-09-14T11:23:39.868078+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:31.820742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:29.268150+0000","last_change":"2024-09-14T11:23:29.268097+0000","last_active":"2024-09-14T11:23:29.268150+0000","last_peered":"2024-09-14T11:23:29.268150+0000","last_clean":"2024-09-14T11:23:29.268150+0000","last_became_active":"2024-09-14T11:01:20.863144+0000","last_became_peered":"2024-09-14T11:01:20.863144+0000","last_unstale":"2024-09-14T11:23:29.268150+0000","last_undegraded":"2024-09-14T11:23:29.268150+0000","last_fullsized":"2024-09-14T11:23:29.268150+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:29.268016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:29.268016+0000","last_clean_scrub_stamp":"2024-09-14T11:23:29.268016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:08.406619+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"260'19","reported_seq":99,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:26.783961+0000","last_change":"2024-09-14T11:23:26.783961+0000","last_active":"2024-09-14T11:23:26.783961+0000","last_peered":"2024-09-14T11:23:26.783961+0000","last_clean":"2024-09-14T11:23:26.783961+0000","last_became_active":"2024-09-14T10:59:48.416902+0000","last_became_peered":"2024-09-14T10:59:48.416902+0000","last_unstale":"2024-09-14T11:23:26.783961+0000","last_undegraded":"2024-09-14T11:23:26.783961+0000","last_fullsized":"2024-09-14T11:23:26.783961+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'19","last_scrub_stamp":"2024-09-14T11:23:26.783854+0000","last_deep_scrub":"260'19","last_deep_scrub_stamp":"2024-09-14T11:23:26.783854+0000","last_clean_scrub_stamp":"2024-09-14T11:23:26.783854+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:07:29.823839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":98,"num_write":49,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:34.568936+0000","last_change":"2024-09-14T11:23:34.568936+0000","last_active":"2024-09-14T11:23:34.568936+0000","last_peered":"2024-09-14T11:23:34.568936+0000","last_clean":"2024-09-14T11:23:34.568936+0000","last_became_active":"2024-09-14T11:11:42.589071+0000","last_became_peered":"2024-09-14T11:11:42.589071+0000","last_unstale":"2024-09-14T11:23:34.568936+0000","last_undegraded":"2024-09-14T11:23:34.568936+0000","last_fullsized":"2024-09-14T11:23:34.568936+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:34.568817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:34.568817+0000","last_clean_scrub_stamp":"2024-09-14T11:23:34.568817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:22.227509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":37,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:37.860430+0000","last_change":"2024-09-14T11:23:37.860373+0000","last_active":"2024-09-14T11:23:37.860430+0000","last_peered":"2024-09-14T11:23:37.860430+0000","last_clean":"2024-09-14T11:23:37.860430+0000","last_became_active":"2024-09-14T11:01:23.892761+0000","last_became_peered":"2024-09-14T11:01:23.892761+0000","last_unstale":"2024-09-14T11:23:37.860430+0000","last_undegraded":"2024-09-14T11:23:37.860430+0000","last_fullsized":"2024-09-14T11:23:37.860430+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:37.860264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:37.860264+0000","last_clean_scrub_stamp":"2024-09-14T11:23:37.860264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:01.452013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:34.247128+0000","last_change":"2024-09-14T11:23:34.247044+0000","last_active":"2024-09-14T11:23:34.247128+0000","last_peered":"2024-09-14T11:23:34.247128+0000","last_clean":"2024-09-14T11:23:34.247128+0000","last_became_active":"2024-09-14T11:01:20.866224+0000","last_became_peered":"2024-09-14T11:01:20.866224+0000","last_unstale":"2024-09-14T11:23:34.247128+0000","last_undegraded":"2024-09-14T11:23:34.247128+0000","last_fullsized":"2024-09-14T11:23:34.247128+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:34.246933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:34.246933+0000","last_clean_scrub_stamp":"2024-09-14T11:23:34.246933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:33.947768+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"260'30","reported_seq":130,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:48.281818+0000","last_change":"2024-09-14T11:23:48.281818+0000","last_active":"2024-09-14T11:23:48.281818+0000","last_peered":"2024-09-14T11:23:48.281818+0000","last_clean":"2024-09-14T11:23:48.281818+0000","last_became_active":"2024-09-14T10:59:48.415922+0000","last_became_peered":"2024-09-14T10:59:48.415922+0000","last_unstale":"2024-09-14T11:23:48.281818+0000","last_undegraded":"2024-09-14T11:23:48.281818+0000","last_fullsized":"2024-09-14T11:23:48.281818+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'30","last_scrub_stamp":"2024-09-14T11:23:48.281713+0000","last_deep_scrub":"260'30","last_deep_scrub_stamp":"2024-09-14T11:23:48.281713+0000","last_clean_scrub_stamp":"2024-09-14T11:23:48.281713+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:09:10.677790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":240,"num_read_kb":165,"num_write":74,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:24:03.321879+0000","last_change":"2024-09-14T11:24:03.321879+0000","last_active":"2024-09-14T11:24:03.321879+0000","last_peered":"2024-09-14T11:24:03.321879+0000","last_clean":"2024-09-14T11:24:03.321879+0000","last_became_active":"2024-09-14T11:11:42.589881+0000","last_became_peered":"2024-09-14T11:11:42.589881+0000","last_unstale":"2024-09-14T11:24:03.321879+0000","last_undegraded":"2024-09-14T11:24:03.321879+0000","last_fullsized":"2024-09-14T11:24:03.321879+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:03.321789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:03.321789+0000","last_clean_scrub_stamp":"2024-09-14T11:24:03.321789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:15:45.120047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"257'8","reported_seq":54,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:38.824656+0000","last_change":"2024-09-14T11:23:38.824603+0000","last_active":"2024-09-14T11:23:38.824656+0000","last_peered":"2024-09-14T11:23:38.824656+0000","last_clean":"2024-09-14T11:23:38.824656+0000","last_became_active":"2024-09-14T11:01:23.897158+0000","last_became_peered":"2024-09-14T11:01:23.897158+0000","last_unstale":"2024-09-14T11:23:38.824656+0000","last_undegraded":"2024-09-14T11:23:38.824656+0000","last_fullsized":"2024-09-14T11:23:38.824656+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'8","last_scrub_stamp":"2024-09-14T11:23:38.824508+0000","last_deep_scrub":"257'8","last_deep_scrub_stamp":"2024-09-14T11:23:38.824508+0000","last_clean_scrub_stamp":"2024-09-14T11:23:38.824508+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:58.417987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6146,"num_write":18,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:32.793284+0000","last_change":"2024-09-14T11:23:32.793230+0000","last_active":"2024-09-14T11:23:32.793284+0000","last_peered":"2024-09-14T11:23:32.793284+0000","last_clean":"2024-09-14T11:23:32.793284+0000","last_became_active":"2024-09-14T11:01:20.863999+0000","last_became_peered":"2024-09-14T11:01:20.863999+0000","last_unstale":"2024-09-14T11:23:32.793284+0000","last_undegraded":"2024-09-14T11:23:32.793284+0000","last_fullsized":"2024-09-14T11:23:32.793284+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:32.793147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:32.793147+0000","last_clean_scrub_stamp":"2024-09-14T11:23:32.793147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:56.481901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"260'46","reported_seq":167,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:26.533025+0000","last_change":"2024-09-14T11:23:26.533025+0000","last_active":"2024-09-14T11:23:26.533025+0000","last_peered":"2024-09-14T11:23:26.533025+0000","last_clean":"2024-09-14T11:23:26.533025+0000","last_became_active":"2024-09-14T10:59:48.418276+0000","last_became_peered":"2024-09-14T10:59:48.418276+0000","last_unstale":"2024-09-14T11:23:26.533025+0000","last_undegraded":"2024-09-14T11:23:26.533025+0000","last_fullsized":"2024-09-14T11:23:26.533025+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'46","last_scrub_stamp":"2024-09-14T11:23:26.532942+0000","last_deep_scrub":"260'46","last_deep_scrub_stamp":"2024-09-14T11:23:26.532942+0000","last_clean_scrub_stamp":"2024-09-14T11:23:26.532942+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:21.614848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":345,"num_read_kb":231,"num_write":118,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:33.554050+0000","last_change":"2024-09-14T11:23:33.554050+0000","last_active":"2024-09-14T11:23:33.554050+0000","last_peered":"2024-09-14T11:23:33.554050+0000","last_clean":"2024-09-14T11:23:33.554050+0000","last_became_active":"2024-09-14T11:11:42.586852+0000","last_became_peered":"2024-09-14T11:11:42.586852+0000","last_unstale":"2024-09-14T11:23:33.554050+0000","last_undegraded":"2024-09-14T11:23:33.554050+0000","last_fullsized":"2024-09-14T11:23:33.554050+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:33.553963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:33.553963+0000","last_clean_scrub_stamp":"2024-09-14T11:23:33.553963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:45.000426+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"257'3","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:41.612280+0000","last_change":"2024-09-14T11:23:41.612222+0000","last_active":"2024-09-14T11:23:41.612280+0000","last_peered":"2024-09-14T11:23:41.612280+0000","last_clean":"2024-09-14T11:23:41.612280+0000","last_became_active":"2024-09-14T11:01:23.887167+0000","last_became_peered":"2024-09-14T11:01:23.887167+0000","last_unstale":"2024-09-14T11:23:41.612280+0000","last_undegraded":"2024-09-14T11:23:41.612280+0000","last_fullsized":"2024-09-14T11:23:41.612280+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'3","last_scrub_stamp":"2024-09-14T11:23:41.612123+0000","last_deep_scrub":"257'3","last_deep_scrub_stamp":"2024-09-14T11:23:41.612123+0000","last_clean_scrub_stamp":"2024-09-14T11:23:41.612123+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:03.854131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"260'6","reported_seq":53,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:34.820097+0000","last_change":"2024-09-14T11:23:34.820025+0000","last_active":"2024-09-14T11:23:34.820097+0000","last_peered":"2024-09-14T11:23:34.820097+0000","last_clean":"2024-09-14T11:23:34.820097+0000","last_became_active":"2024-09-14T11:01:20.857645+0000","last_became_peered":"2024-09-14T11:01:20.857645+0000","last_unstale":"2024-09-14T11:23:34.820097+0000","last_undegraded":"2024-09-14T11:23:34.820097+0000","last_fullsized":"2024-09-14T11:23:34.820097+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-14T11:23:34.819943+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-14T11:23:34.819943+0000","last_clean_scrub_stamp":"2024-09-14T11:23:34.819943+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:11.438379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"260'22","reported_seq":109,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:27.230474+0000","last_change":"2024-09-14T11:23:27.230474+0000","last_active":"2024-09-14T11:23:27.230474+0000","last_peered":"2024-09-14T11:23:27.230474+0000","last_clean":"2024-09-14T11:23:27.230474+0000","last_became_active":"2024-09-14T10:59:48.413425+0000","last_became_peered":"2024-09-14T10:59:48.413425+0000","last_unstale":"2024-09-14T11:23:27.230474+0000","last_undegraded":"2024-09-14T11:23:27.230474+0000","last_fullsized":"2024-09-14T11:23:27.230474+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'22","last_scrub_stamp":"2024-09-14T11:23:27.230391+0000","last_deep_scrub":"260'22","last_deep_scrub_stamp":"2024-09-14T11:23:27.230391+0000","last_clean_scrub_stamp":"2024-09-14T11:23:27.230391+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:16:44.679862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":100,"num_write":57,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:50.644175+0000","last_change":"2024-09-14T11:23:50.644175+0000","last_active":"2024-09-14T11:23:50.644175+0000","last_peered":"2024-09-14T11:23:50.644175+0000","last_clean":"2024-09-14T11:23:50.644175+0000","last_became_active":"2024-09-14T11:11:42.587906+0000","last_became_peered":"2024-09-14T11:11:42.587906+0000","last_unstale":"2024-09-14T11:23:50.644175+0000","last_undegraded":"2024-09-14T11:23:50.644175+0000","last_fullsized":"2024-09-14T11:23:50.644175+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:50.644067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:50.644067+0000","last_clean_scrub_stamp":"2024-09-14T11:23:50.644067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:16.580879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":37,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:57.216902+0000","last_change":"2024-09-14T11:23:57.216902+0000","last_active":"2024-09-14T11:23:57.216902+0000","last_peered":"2024-09-14T11:23:57.216902+0000","last_clean":"2024-09-14T11:23:57.216902+0000","last_became_active":"2024-09-14T11:01:23.891424+0000","last_became_peered":"2024-09-14T11:01:23.891424+0000","last_unstale":"2024-09-14T11:23:57.216902+0000","last_undegraded":"2024-09-14T11:23:57.216902+0000","last_fullsized":"2024-09-14T11:23:57.216902+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:57.216777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:57.216777+0000","last_clean_scrub_stamp":"2024-09-14T11:23:57.216777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:08.040895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"260'5","reported_seq":52,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:29.788739+0000","last_change":"2024-09-14T11:23:29.788739+0000","last_active":"2024-09-14T11:23:29.788739+0000","last_peered":"2024-09-14T11:23:29.788739+0000","last_clean":"2024-09-14T11:23:29.788739+0000","last_became_active":"2024-09-14T11:01:20.863936+0000","last_became_peered":"2024-09-14T11:01:20.863936+0000","last_unstale":"2024-09-14T11:23:29.788739+0000","last_undegraded":"2024-09-14T11:23:29.788739+0000","last_fullsized":"2024-09-14T11:23:29.788739+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-14T11:23:29.788622+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-14T11:23:29.788622+0000","last_clean_scrub_stamp":"2024-09-14T11:23:29.788622+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:05.759708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"260'14","reported_seq":88,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:26.275701+0000","last_change":"2024-09-14T11:23:26.275701+0000","last_active":"2024-09-14T11:23:26.275701+0000","last_peered":"2024-09-14T11:23:26.275701+0000","last_clean":"2024-09-14T11:23:26.275701+0000","last_became_active":"2024-09-14T10:59:48.413255+0000","last_became_peered":"2024-09-14T10:59:48.413255+0000","last_unstale":"2024-09-14T11:23:26.275701+0000","last_undegraded":"2024-09-14T11:23:26.275701+0000","last_fullsized":"2024-09-14T11:23:26.275701+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'14","last_scrub_stamp":"2024-09-14T11:23:26.275618+0000","last_deep_scrub":"260'14","last_deep_scrub_stamp":"2024-09-14T11:23:26.275618+0000","last_clean_scrub_stamp":"2024-09-14T11:23:26.275618+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:48.948088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":78,"num_write":38,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:34.334249+0000","last_change":"2024-09-14T11:23:34.334249+0000","last_active":"2024-09-14T11:23:34.334249+0000","last_peered":"2024-09-14T11:23:34.334249+0000","last_clean":"2024-09-14T11:23:34.334249+0000","last_became_active":"2024-09-14T11:11:42.588120+0000","last_became_peered":"2024-09-14T11:11:42.588120+0000","last_unstale":"2024-09-14T11:23:34.334249+0000","last_undegraded":"2024-09-14T11:23:34.334249+0000","last_fullsized":"2024-09-14T11:23:34.334249+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:34.334161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:34.334161+0000","last_clean_scrub_stamp":"2024-09-14T11:23:34.334161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:38.062050+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"257'3","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:35.381552+0000","last_change":"2024-09-14T11:23:35.381552+0000","last_active":"2024-09-14T11:23:35.381552+0000","last_peered":"2024-09-14T11:23:35.381552+0000","last_clean":"2024-09-14T11:23:35.381552+0000","last_became_active":"2024-09-14T11:01:23.888873+0000","last_became_peered":"2024-09-14T11:01:23.888873+0000","last_unstale":"2024-09-14T11:23:35.381552+0000","last_undegraded":"2024-09-14T11:23:35.381552+0000","last_fullsized":"2024-09-14T11:23:35.381552+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'3","last_scrub_stamp":"2024-09-14T11:23:35.381434+0000","last_deep_scrub":"257'3","last_deep_scrub_stamp":"2024-09-14T11:23:35.381434+0000","last_clean_scrub_stamp":"2024-09-14T11:23:35.381434+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:46.609607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:36.602652+0000","last_change":"2024-09-14T11:23:36.602652+0000","last_active":"2024-09-14T11:23:36.602652+0000","last_peered":"2024-09-14T11:23:36.602652+0000","last_clean":"2024-09-14T11:23:36.602652+0000","last_became_active":"2024-09-14T11:01:20.865953+0000","last_became_peered":"2024-09-14T11:01:20.865953+0000","last_unstale":"2024-09-14T11:23:36.602652+0000","last_undegraded":"2024-09-14T11:23:36.602652+0000","last_fullsized":"2024-09-14T11:23:36.602652+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:36.602555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:36.602555+0000","last_clean_scrub_stamp":"2024-09-14T11:23:36.602555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:12.445976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"260'22","reported_seq":107,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:24.373765+0000","last_change":"2024-09-14T11:23:24.373706+0000","last_active":"2024-09-14T11:23:24.373765+0000","last_peered":"2024-09-14T11:23:24.373765+0000","last_clean":"2024-09-14T11:23:24.373765+0000","last_became_active":"2024-09-14T10:59:48.417013+0000","last_became_peered":"2024-09-14T10:59:48.417013+0000","last_unstale":"2024-09-14T11:23:24.373765+0000","last_undegraded":"2024-09-14T11:23:24.373765+0000","last_fullsized":"2024-09-14T11:23:24.373765+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'22","last_scrub_stamp":"2024-09-14T11:23:24.373610+0000","last_deep_scrub":"260'22","last_deep_scrub_stamp":"2024-09-14T11:23:24.373610+0000","last_clean_scrub_stamp":"2024-09-14T11:23:24.373610+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:40.881314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":110,"num_write":54,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"260'2","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:30.563204+0000","last_change":"2024-09-14T11:23:30.563204+0000","last_active":"2024-09-14T11:23:30.563204+0000","last_peered":"2024-09-14T11:23:30.563204+0000","last_clean":"2024-09-14T11:23:30.563204+0000","last_became_active":"2024-09-14T11:11:42.592514+0000","last_became_peered":"2024-09-14T11:11:42.592514+0000","last_unstale":"2024-09-14T11:23:30.563204+0000","last_undegraded":"2024-09-14T11:23:30.563204+0000","last_fullsized":"2024-09-14T11:23:30.563204+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:23:30.563111+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:23:30.563111+0000","last_clean_scrub_stamp":"2024-09-14T11:23:30.563111+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:30.285420+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":37,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:35.265407+0000","last_change":"2024-09-14T11:23:35.265320+0000","last_active":"2024-09-14T11:23:35.265407+0000","last_peered":"2024-09-14T11:23:35.265407+0000","last_clean":"2024-09-14T11:23:35.265407+0000","last_became_active":"2024-09-14T11:01:23.890356+0000","last_became_peered":"2024-09-14T11:01:23.890356+0000","last_unstale":"2024-09-14T11:23:35.265407+0000","last_undegraded":"2024-09-14T11:23:35.265407+0000","last_fullsized":"2024-09-14T11:23:35.265407+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:35.265205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:35.265205+0000","last_clean_scrub_stamp":"2024-09-14T11:23:35.265205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:35:30.326948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"257'3","reported_seq":49,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:30.753920+0000","last_change":"2024-09-14T11:23:30.753920+0000","last_active":"2024-09-14T11:23:30.753920+0000","last_peered":"2024-09-14T11:23:30.753920+0000","last_clean":"2024-09-14T11:23:30.753920+0000","last_became_active":"2024-09-14T11:01:20.859214+0000","last_became_peered":"2024-09-14T11:01:20.859214+0000","last_unstale":"2024-09-14T11:23:30.753920+0000","last_undegraded":"2024-09-14T11:23:30.753920+0000","last_fullsized":"2024-09-14T11:23:30.753920+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'3","last_scrub_stamp":"2024-09-14T11:23:30.753835+0000","last_deep_scrub":"257'3","last_deep_scrub_stamp":"2024-09-14T11:23:30.753835+0000","last_clean_scrub_stamp":"2024-09-14T11:23:30.753835+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:35.671869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"260'23","reported_seq":106,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:35.559452+0000","last_change":"2024-09-14T11:23:35.559378+0000","last_active":"2024-09-14T11:23:35.559452+0000","last_peered":"2024-09-14T11:23:35.559452+0000","last_clean":"2024-09-14T11:23:35.559452+0000","last_became_active":"2024-09-14T10:59:48.420353+0000","last_became_peered":"2024-09-14T10:59:48.420353+0000","last_unstale":"2024-09-14T11:23:35.559452+0000","last_undegraded":"2024-09-14T11:23:35.559452+0000","last_fullsized":"2024-09-14T11:23:35.559452+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'23","last_scrub_stamp":"2024-09-14T11:23:35.559300+0000","last_deep_scrub":"260'23","last_deep_scrub_stamp":"2024-09-14T11:23:35.559300+0000","last_clean_scrub_stamp":"2024-09-14T11:23:35.559300+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:57.843507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":102,"num_write":60,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:45.874032+0000","last_change":"2024-09-14T11:23:45.874032+0000","last_active":"2024-09-14T11:23:45.874032+0000","last_peered":"2024-09-14T11:23:45.874032+0000","last_clean":"2024-09-14T11:23:45.874032+0000","last_became_active":"2024-09-14T11:11:42.589134+0000","last_became_peered":"2024-09-14T11:11:42.589134+0000","last_unstale":"2024-09-14T11:23:45.874032+0000","last_undegraded":"2024-09-14T11:23:45.874032+0000","last_fullsized":"2024-09-14T11:23:45.874032+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:45.873944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:45.873944+0000","last_clean_scrub_stamp":"2024-09-14T11:23:45.873944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:34.505917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"260'2","reported_seq":40,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:25.502170+0000","last_change":"2024-09-14T11:23:25.502170+0000","last_active":"2024-09-14T11:23:25.502170+0000","last_peered":"2024-09-14T11:23:25.502170+0000","last_clean":"2024-09-14T11:23:25.502170+0000","last_became_active":"2024-09-14T11:01:23.890433+0000","last_became_peered":"2024-09-14T11:01:23.890433+0000","last_unstale":"2024-09-14T11:23:25.502170+0000","last_undegraded":"2024-09-14T11:23:25.502170+0000","last_fullsized":"2024-09-14T11:23:25.502170+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:23:25.502088+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:23:25.502088+0000","last_clean_scrub_stamp":"2024-09-14T11:23:25.502088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:14:40.764137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"257'3","reported_seq":49,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:53.292758+0000","last_change":"2024-09-14T11:23:53.292758+0000","last_active":"2024-09-14T11:23:53.292758+0000","last_peered":"2024-09-14T11:23:53.292758+0000","last_clean":"2024-09-14T11:23:53.292758+0000","last_became_active":"2024-09-14T11:01:20.858834+0000","last_became_peered":"2024-09-14T11:01:20.858834+0000","last_unstale":"2024-09-14T11:23:53.292758+0000","last_undegraded":"2024-09-14T11:23:53.292758+0000","last_fullsized":"2024-09-14T11:23:53.292758+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'3","last_scrub_stamp":"2024-09-14T11:23:53.292653+0000","last_deep_scrub":"257'3","last_deep_scrub_stamp":"2024-09-14T11:23:53.292653+0000","last_clean_scrub_stamp":"2024-09-14T11:23:53.292653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:24.192751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"260'31","reported_seq":137,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:21.642886+0000","last_change":"2024-09-14T11:23:21.642794+0000","last_active":"2024-09-14T11:23:21.642886+0000","last_peered":"2024-09-14T11:23:21.642886+0000","last_clean":"2024-09-14T11:23:21.642886+0000","last_became_active":"2024-09-14T10:59:48.414351+0000","last_became_peered":"2024-09-14T10:59:48.414351+0000","last_unstale":"2024-09-14T11:23:21.642886+0000","last_undegraded":"2024-09-14T11:23:21.642886+0000","last_fullsized":"2024-09-14T11:23:21.642886+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'31","last_scrub_stamp":"2024-09-14T11:23:21.642694+0000","last_deep_scrub":"260'31","last_deep_scrub_stamp":"2024-09-14T11:23:21.642694+0000","last_clean_scrub_stamp":"2024-09-14T11:23:21.642694+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:06.209703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":249,"num_read_kb":158,"num_write":78,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:28.531990+0000","last_change":"2024-09-14T11:23:28.531908+0000","last_active":"2024-09-14T11:23:28.531990+0000","last_peered":"2024-09-14T11:23:28.531990+0000","last_clean":"2024-09-14T11:23:28.531990+0000","last_became_active":"2024-09-14T11:11:42.587955+0000","last_became_peered":"2024-09-14T11:11:42.587955+0000","last_unstale":"2024-09-14T11:23:28.531990+0000","last_undegraded":"2024-09-14T11:23:28.531990+0000","last_fullsized":"2024-09-14T11:23:28.531990+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:28.531820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:28.531820+0000","last_clean_scrub_stamp":"2024-09-14T11:23:28.531820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:14.336755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"260'8","reported_seq":55,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:43.619145+0000","last_change":"2024-09-14T11:23:43.619145+0000","last_active":"2024-09-14T11:23:43.619145+0000","last_peered":"2024-09-14T11:23:43.619145+0000","last_clean":"2024-09-14T11:23:43.619145+0000","last_became_active":"2024-09-14T11:01:23.891239+0000","last_became_peered":"2024-09-14T11:01:23.891239+0000","last_unstale":"2024-09-14T11:23:43.619145+0000","last_undegraded":"2024-09-14T11:23:43.619145+0000","last_fullsized":"2024-09-14T11:23:43.619145+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'8","last_scrub_stamp":"2024-09-14T11:23:43.619054+0000","last_deep_scrub":"260'8","last_deep_scrub_stamp":"2024-09-14T11:23:43.619054+0000","last_clean_scrub_stamp":"2024-09-14T11:23:43.619054+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:33.510441+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20482,"num_write":18,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:51.301886+0000","last_change":"2024-09-14T11:23:51.301811+0000","last_active":"2024-09-14T11:23:51.301886+0000","last_peered":"2024-09-14T11:23:51.301886+0000","last_clean":"2024-09-14T11:23:51.301886+0000","last_became_active":"2024-09-14T11:01:20.866975+0000","last_became_peered":"2024-09-14T11:01:20.866975+0000","last_unstale":"2024-09-14T11:23:51.301886+0000","last_undegraded":"2024-09-14T11:23:51.301886+0000","last_fullsized":"2024-09-14T11:23:51.301886+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:51.301717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:51.301717+0000","last_clean_scrub_stamp":"2024-09-14T11:23:51.301717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:54:11.888281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"260'4","reported_seq":59,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:33.591701+0000","last_change":"2024-09-14T11:23:33.591627+0000","last_active":"2024-09-14T11:23:33.591701+0000","last_peered":"2024-09-14T11:23:33.591701+0000","last_clean":"2024-09-14T11:23:33.591701+0000","last_became_active":"2024-09-14T10:59:48.416741+0000","last_became_peered":"2024-09-14T10:59:48.416741+0000","last_unstale":"2024-09-14T11:23:33.591701+0000","last_undegraded":"2024-09-14T11:23:33.591701+0000","last_fullsized":"2024-09-14T11:23:33.591701+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-14T11:23:33.591548+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-14T11:23:33.591548+0000","last_clean_scrub_stamp":"2024-09-14T11:23:33.591548+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:47:20.251422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:29.517439+0000","last_change":"2024-09-14T11:23:29.517358+0000","last_active":"2024-09-14T11:23:29.517439+0000","last_peered":"2024-09-14T11:23:29.517439+0000","last_clean":"2024-09-14T11:23:29.517439+0000","last_became_active":"2024-09-14T11:11:42.582190+0000","last_became_peered":"2024-09-14T11:11:42.582190+0000","last_unstale":"2024-09-14T11:23:29.517439+0000","last_undegraded":"2024-09-14T11:23:29.517439+0000","last_fullsized":"2024-09-14T11:23:29.517439+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:29.517270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:29.517270+0000","last_clean_scrub_stamp":"2024-09-14T11:23:29.517270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:29:37.345510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"260'10","reported_seq":63,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:45.646153+0000","last_change":"2024-09-14T11:23:45.646153+0000","last_active":"2024-09-14T11:23:45.646153+0000","last_peered":"2024-09-14T11:23:45.646153+0000","last_clean":"2024-09-14T11:23:45.646153+0000","last_became_active":"2024-09-14T11:01:23.892344+0000","last_became_peered":"2024-09-14T11:01:23.892344+0000","last_unstale":"2024-09-14T11:23:45.646153+0000","last_undegraded":"2024-09-14T11:23:45.646153+0000","last_fullsized":"2024-09-14T11:23:45.646153+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'10","last_scrub_stamp":"2024-09-14T11:23:45.646032+0000","last_deep_scrub":"260'10","last_deep_scrub_stamp":"2024-09-14T11:23:45.646032+0000","last_clean_scrub_stamp":"2024-09-14T11:23:45.646032+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:46.075293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":30724,"num_write":15,"num_write_kb":10242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"260'2","reported_seq":47,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:38.657888+0000","last_change":"2024-09-14T11:23:38.657830+0000","last_active":"2024-09-14T11:23:38.657888+0000","last_peered":"2024-09-14T11:23:38.657888+0000","last_clean":"2024-09-14T11:23:38.657888+0000","last_became_active":"2024-09-14T11:01:20.863495+0000","last_became_peered":"2024-09-14T11:01:20.863495+0000","last_unstale":"2024-09-14T11:23:38.657888+0000","last_undegraded":"2024-09-14T11:23:38.657888+0000","last_fullsized":"2024-09-14T11:23:38.657888+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:23:38.657735+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:23:38.657735+0000","last_clean_scrub_stamp":"2024-09-14T11:23:38.657735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:20.926948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"260'32","reported_seq":129,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:46.325100+0000","last_change":"2024-09-14T11:23:46.325100+0000","last_active":"2024-09-14T11:23:46.325100+0000","last_peered":"2024-09-14T11:23:46.325100+0000","last_clean":"2024-09-14T11:23:46.325100+0000","last_became_active":"2024-09-14T10:59:48.416253+0000","last_became_peered":"2024-09-14T10:59:48.416253+0000","last_unstale":"2024-09-14T11:23:46.325100+0000","last_undegraded":"2024-09-14T11:23:46.325100+0000","last_fullsized":"2024-09-14T11:23:46.325100+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'32","last_scrub_stamp":"2024-09-14T11:23:46.325015+0000","last_deep_scrub":"260'32","last_deep_scrub_stamp":"2024-09-14T11:23:46.325015+0000","last_clean_scrub_stamp":"2024-09-14T11:23:46.325015+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:35.215321+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":142,"num_write":84,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:52.633255+0000","last_change":"2024-09-14T11:23:52.633255+0000","last_active":"2024-09-14T11:23:52.633255+0000","last_peered":"2024-09-14T11:23:52.633255+0000","last_clean":"2024-09-14T11:23:52.633255+0000","last_became_active":"2024-09-14T11:11:42.588988+0000","last_became_peered":"2024-09-14T11:11:42.588988+0000","last_unstale":"2024-09-14T11:23:52.633255+0000","last_undegraded":"2024-09-14T11:23:52.633255+0000","last_fullsized":"2024-09-14T11:23:52.633255+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:52.633169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:52.633169+0000","last_clean_scrub_stamp":"2024-09-14T11:23:52.633169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:31.702877+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"260'6","reported_seq":47,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:24.523185+0000","last_change":"2024-09-14T11:23:24.523185+0000","last_active":"2024-09-14T11:23:24.523185+0000","last_peered":"2024-09-14T11:23:24.523185+0000","last_clean":"2024-09-14T11:23:24.523185+0000","last_became_active":"2024-09-14T11:01:23.888845+0000","last_became_peered":"2024-09-14T11:01:23.888845+0000","last_unstale":"2024-09-14T11:23:24.523185+0000","last_undegraded":"2024-09-14T11:23:24.523185+0000","last_fullsized":"2024-09-14T11:23:24.523185+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-14T11:23:24.523101+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-14T11:23:24.523101+0000","last_clean_scrub_stamp":"2024-09-14T11:23:24.523101+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:53.052865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"257'10","reported_seq":69,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:31.296038+0000","last_change":"2024-09-14T11:23:31.296038+0000","last_active":"2024-09-14T11:23:31.296038+0000","last_peered":"2024-09-14T11:23:31.296038+0000","last_clean":"2024-09-14T11:23:31.296038+0000","last_became_active":"2024-09-14T11:01:20.865891+0000","last_became_peered":"2024-09-14T11:01:20.865891+0000","last_unstale":"2024-09-14T11:23:31.296038+0000","last_undegraded":"2024-09-14T11:23:31.296038+0000","last_fullsized":"2024-09-14T11:23:31.296038+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'10","last_scrub_stamp":"2024-09-14T11:23:31.295949+0000","last_deep_scrub":"257'10","last_deep_scrub_stamp":"2024-09-14T11:23:31.295949+0000","last_clean_scrub_stamp":"2024-09-14T11:23:31.295949+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:01.335383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":24580,"num_write":15,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"260'27","reported_seq":123,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:26.327151+0000","last_change":"2024-09-14T11:23:26.327151+0000","last_active":"2024-09-14T11:23:26.327151+0000","last_peered":"2024-09-14T11:23:26.327151+0000","last_clean":"2024-09-14T11:23:26.327151+0000","last_became_active":"2024-09-14T10:59:48.420845+0000","last_became_peered":"2024-09-14T10:59:48.420845+0000","last_unstale":"2024-09-14T11:23:26.327151+0000","last_undegraded":"2024-09-14T11:23:26.327151+0000","last_fullsized":"2024-09-14T11:23:26.327151+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'27","last_scrub_stamp":"2024-09-14T11:23:26.327053+0000","last_deep_scrub":"260'27","last_deep_scrub_stamp":"2024-09-14T11:23:26.327053+0000","last_clean_scrub_stamp":"2024-09-14T11:23:26.327053+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:11.867978+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":135,"num_write":77,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:24:01.280397+0000","last_change":"2024-09-14T11:24:01.280339+0000","last_active":"2024-09-14T11:24:01.280397+0000","last_peered":"2024-09-14T11:24:01.280397+0000","last_clean":"2024-09-14T11:24:01.280397+0000","last_became_active":"2024-09-14T11:11:42.591734+0000","last_became_peered":"2024-09-14T11:11:42.591734+0000","last_unstale":"2024-09-14T11:24:01.280397+0000","last_undegraded":"2024-09-14T11:24:01.280397+0000","last_fullsized":"2024-09-14T11:24:01.280397+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:01.280243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:01.280243+0000","last_clean_scrub_stamp":"2024-09-14T11:24:01.280243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:51.262332+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"260'3","reported_seq":40,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:56.243607+0000","last_change":"2024-09-14T11:23:56.243607+0000","last_active":"2024-09-14T11:23:56.243607+0000","last_peered":"2024-09-14T11:23:56.243607+0000","last_clean":"2024-09-14T11:23:56.243607+0000","last_became_active":"2024-09-14T11:01:23.894904+0000","last_became_peered":"2024-09-14T11:01:23.894904+0000","last_unstale":"2024-09-14T11:23:56.243607+0000","last_undegraded":"2024-09-14T11:23:56.243607+0000","last_fullsized":"2024-09-14T11:23:56.243607+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T11:23:56.243480+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T11:23:56.243480+0000","last_clean_scrub_stamp":"2024-09-14T11:23:56.243480+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:30.185738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:52.257308+0000","last_change":"2024-09-14T11:23:52.257308+0000","last_active":"2024-09-14T11:23:52.257308+0000","last_peered":"2024-09-14T11:23:52.257308+0000","last_clean":"2024-09-14T11:23:52.257308+0000","last_became_active":"2024-09-14T11:01:20.867675+0000","last_became_peered":"2024-09-14T11:01:20.867675+0000","last_unstale":"2024-09-14T11:23:52.257308+0000","last_undegraded":"2024-09-14T11:23:52.257308+0000","last_fullsized":"2024-09-14T11:23:52.257308+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:52.257221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:52.257221+0000","last_clean_scrub_stamp":"2024-09-14T11:23:52.257221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:12.109098+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"260'45","reported_seq":175,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:24.774146+0000","last_change":"2024-09-14T11:23:24.774146+0000","last_active":"2024-09-14T11:23:24.774146+0000","last_peered":"2024-09-14T11:23:24.774146+0000","last_clean":"2024-09-14T11:23:24.774146+0000","last_became_active":"2024-09-14T10:59:48.419276+0000","last_became_peered":"2024-09-14T10:59:48.419276+0000","last_unstale":"2024-09-14T11:23:24.774146+0000","last_undegraded":"2024-09-14T11:23:24.774146+0000","last_fullsized":"2024-09-14T11:23:24.774146+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'45","last_scrub_stamp":"2024-09-14T11:23:24.774030+0000","last_deep_scrub":"260'45","last_deep_scrub_stamp":"2024-09-14T11:23:24.774030+0000","last_clean_scrub_stamp":"2024-09-14T11:23:24.774030+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:06.668253+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":347,"num_read_kb":232,"num_write":118,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"260'2","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:44.854924+0000","last_change":"2024-09-14T11:23:44.854924+0000","last_active":"2024-09-14T11:23:44.854924+0000","last_peered":"2024-09-14T11:23:44.854924+0000","last_clean":"2024-09-14T11:23:44.854924+0000","last_became_active":"2024-09-14T11:11:42.585114+0000","last_became_peered":"2024-09-14T11:11:42.585114+0000","last_unstale":"2024-09-14T11:23:44.854924+0000","last_undegraded":"2024-09-14T11:23:44.854924+0000","last_fullsized":"2024-09-14T11:23:44.854924+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:23:44.854832+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:23:44.854832+0000","last_clean_scrub_stamp":"2024-09-14T11:23:44.854832+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:26.199257+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"260'2","reported_seq":40,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:39.649254+0000","last_change":"2024-09-14T11:23:39.649254+0000","last_active":"2024-09-14T11:23:39.649254+0000","last_peered":"2024-09-14T11:23:39.649254+0000","last_clean":"2024-09-14T11:23:39.649254+0000","last_became_active":"2024-09-14T11:01:23.894464+0000","last_became_peered":"2024-09-14T11:01:23.894464+0000","last_unstale":"2024-09-14T11:23:39.649254+0000","last_undegraded":"2024-09-14T11:23:39.649254+0000","last_fullsized":"2024-09-14T11:23:39.649254+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:23:39.649180+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:23:39.649180+0000","last_clean_scrub_stamp":"2024-09-14T11:23:39.649180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:10.704274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:32.299427+0000","last_change":"2024-09-14T11:23:32.299427+0000","last_active":"2024-09-14T11:23:32.299427+0000","last_peered":"2024-09-14T11:23:32.299427+0000","last_clean":"2024-09-14T11:23:32.299427+0000","last_became_active":"2024-09-14T11:01:20.869082+0000","last_became_peered":"2024-09-14T11:01:20.869082+0000","last_unstale":"2024-09-14T11:23:32.299427+0000","last_undegraded":"2024-09-14T11:23:32.299427+0000","last_fullsized":"2024-09-14T11:23:32.299427+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:32.299346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:32.299346+0000","last_clean_scrub_stamp":"2024-09-14T11:23:32.299346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:58:15.656102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"260'42","reported_seq":160,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:25.349156+0000","last_change":"2024-09-14T11:23:25.349156+0000","last_active":"2024-09-14T11:23:25.349156+0000","last_peered":"2024-09-14T11:23:25.349156+0000","last_clean":"2024-09-14T11:23:25.349156+0000","last_became_active":"2024-09-14T10:59:48.419753+0000","last_became_peered":"2024-09-14T10:59:48.419753+0000","last_unstale":"2024-09-14T11:23:25.349156+0000","last_undegraded":"2024-09-14T11:23:25.349156+0000","last_fullsized":"2024-09-14T11:23:25.349156+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'42","last_scrub_stamp":"2024-09-14T11:23:25.349073+0000","last_deep_scrub":"260'42","last_deep_scrub_stamp":"2024-09-14T11:23:25.349073+0000","last_clean_scrub_stamp":"2024-09-14T11:23:25.349073+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:09.768780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":323,"num_read_kb":218,"num_write":115,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:40.618270+0000","last_change":"2024-09-14T11:23:40.618270+0000","last_active":"2024-09-14T11:23:40.618270+0000","last_peered":"2024-09-14T11:23:40.618270+0000","last_clean":"2024-09-14T11:23:40.618270+0000","last_became_active":"2024-09-14T11:11:42.592960+0000","last_became_peered":"2024-09-14T11:11:42.592960+0000","last_unstale":"2024-09-14T11:23:40.618270+0000","last_undegraded":"2024-09-14T11:23:40.618270+0000","last_fullsized":"2024-09-14T11:23:40.618270+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:40.618157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:40.618157+0000","last_clean_scrub_stamp":"2024-09-14T11:23:40.618157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:39:37.762915+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"260'3","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:55.253601+0000","last_change":"2024-09-14T11:23:55.253601+0000","last_active":"2024-09-14T11:23:55.253601+0000","last_peered":"2024-09-14T11:23:55.253601+0000","last_clean":"2024-09-14T11:23:55.253601+0000","last_became_active":"2024-09-14T11:01:23.883464+0000","last_became_peered":"2024-09-14T11:01:23.883464+0000","last_unstale":"2024-09-14T11:23:55.253601+0000","last_undegraded":"2024-09-14T11:23:55.253601+0000","last_fullsized":"2024-09-14T11:23:55.253601+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T11:23:55.253501+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T11:23:55.253501+0000","last_clean_scrub_stamp":"2024-09-14T11:23:55.253501+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:26.748932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:50.308919+0000","last_change":"2024-09-14T11:23:50.308839+0000","last_active":"2024-09-14T11:23:50.308919+0000","last_peered":"2024-09-14T11:23:50.308919+0000","last_clean":"2024-09-14T11:23:50.308919+0000","last_became_active":"2024-09-14T11:01:20.858057+0000","last_became_peered":"2024-09-14T11:01:20.858057+0000","last_unstale":"2024-09-14T11:23:50.308919+0000","last_undegraded":"2024-09-14T11:23:50.308919+0000","last_fullsized":"2024-09-14T11:23:50.308919+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:50.308746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:50.308746+0000","last_clean_scrub_stamp":"2024-09-14T11:23:50.308746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:39.478771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"260'19","reported_seq":94,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:45.286689+0000","last_change":"2024-09-14T11:23:45.286689+0000","last_active":"2024-09-14T11:23:45.286689+0000","last_peered":"2024-09-14T11:23:45.286689+0000","last_clean":"2024-09-14T11:23:45.286689+0000","last_became_active":"2024-09-14T10:59:48.412832+0000","last_became_peered":"2024-09-14T10:59:48.412832+0000","last_unstale":"2024-09-14T11:23:45.286689+0000","last_undegraded":"2024-09-14T11:23:45.286689+0000","last_fullsized":"2024-09-14T11:23:45.286689+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'19","last_scrub_stamp":"2024-09-14T11:23:45.286560+0000","last_deep_scrub":"260'19","last_deep_scrub_stamp":"2024-09-14T11:23:45.286560+0000","last_clean_scrub_stamp":"2024-09-14T11:23:45.286560+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:21.438372+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":68,"num_write":55,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:49.636462+0000","last_change":"2024-09-14T11:23:49.636400+0000","last_active":"2024-09-14T11:23:49.636462+0000","last_peered":"2024-09-14T11:23:49.636462+0000","last_clean":"2024-09-14T11:23:49.636462+0000","last_became_active":"2024-09-14T11:11:42.590549+0000","last_became_peered":"2024-09-14T11:11:42.590549+0000","last_unstale":"2024-09-14T11:23:49.636462+0000","last_undegraded":"2024-09-14T11:23:49.636462+0000","last_fullsized":"2024-09-14T11:23:49.636462+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:49.636309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:49.636309+0000","last_clean_scrub_stamp":"2024-09-14T11:23:49.636309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:34.493124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":37,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:38.280035+0000","last_change":"2024-09-14T11:23:38.280035+0000","last_active":"2024-09-14T11:23:38.280035+0000","last_peered":"2024-09-14T11:23:38.280035+0000","last_clean":"2024-09-14T11:23:38.280035+0000","last_became_active":"2024-09-14T11:01:23.880195+0000","last_became_peered":"2024-09-14T11:01:23.880195+0000","last_unstale":"2024-09-14T11:23:38.280035+0000","last_undegraded":"2024-09-14T11:23:38.280035+0000","last_fullsized":"2024-09-14T11:23:38.280035+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:38.279944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:38.279944+0000","last_clean_scrub_stamp":"2024-09-14T11:23:38.279944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:01:59.809087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:31.165042+0000","last_change":"2024-09-14T11:23:31.164981+0000","last_active":"2024-09-14T11:23:31.165042+0000","last_peered":"2024-09-14T11:23:31.165042+0000","last_clean":"2024-09-14T11:23:31.165042+0000","last_became_active":"2024-09-14T11:01:20.869312+0000","last_became_peered":"2024-09-14T11:01:20.869312+0000","last_unstale":"2024-09-14T11:23:31.165042+0000","last_undegraded":"2024-09-14T11:23:31.165042+0000","last_fullsized":"2024-09-14T11:23:31.165042+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:31.164892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:31.164892+0000","last_clean_scrub_stamp":"2024-09-14T11:23:31.164892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:33.758841+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"257'19","reported_seq":105,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:44.245082+0000","last_change":"2024-09-14T11:23:44.245082+0000","last_active":"2024-09-14T11:23:44.245082+0000","last_peered":"2024-09-14T11:23:44.245082+0000","last_clean":"2024-09-14T11:23:44.245082+0000","last_became_active":"2024-09-14T10:59:48.418369+0000","last_became_peered":"2024-09-14T10:59:48.418369+0000","last_unstale":"2024-09-14T11:23:44.245082+0000","last_undegraded":"2024-09-14T11:23:44.245082+0000","last_fullsized":"2024-09-14T11:23:44.245082+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'19","last_scrub_stamp":"2024-09-14T11:23:44.244959+0000","last_deep_scrub":"257'19","last_deep_scrub_stamp":"2024-09-14T11:23:44.244959+0000","last_clean_scrub_stamp":"2024-09-14T11:23:44.244959+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:19:48.568895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":97,"num_write":49,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:24:00.251470+0000","last_change":"2024-09-14T11:24:00.251405+0000","last_active":"2024-09-14T11:24:00.251470+0000","last_peered":"2024-09-14T11:24:00.251470+0000","last_clean":"2024-09-14T11:24:00.251470+0000","last_became_active":"2024-09-14T11:11:42.592333+0000","last_became_peered":"2024-09-14T11:11:42.592333+0000","last_unstale":"2024-09-14T11:24:00.251470+0000","last_undegraded":"2024-09-14T11:24:00.251470+0000","last_fullsized":"2024-09-14T11:24:00.251470+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:00.251309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:00.251309+0000","last_clean_scrub_stamp":"2024-09-14T11:24:00.251309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:17.170839+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"260'2","reported_seq":40,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:33.294201+0000","last_change":"2024-09-14T11:23:33.294201+0000","last_active":"2024-09-14T11:23:33.294201+0000","last_peered":"2024-09-14T11:23:33.294201+0000","last_clean":"2024-09-14T11:23:33.294201+0000","last_became_active":"2024-09-14T11:01:23.882133+0000","last_became_peered":"2024-09-14T11:01:23.882133+0000","last_unstale":"2024-09-14T11:23:33.294201+0000","last_undegraded":"2024-09-14T11:23:33.294201+0000","last_fullsized":"2024-09-14T11:23:33.294201+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:23:33.294095+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:23:33.294095+0000","last_clean_scrub_stamp":"2024-09-14T11:23:33.294095+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:14:18.806772+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:27.493348+0000","last_change":"2024-09-14T11:23:27.493278+0000","last_active":"2024-09-14T11:23:27.493348+0000","last_peered":"2024-09-14T11:23:27.493348+0000","last_clean":"2024-09-14T11:23:27.493348+0000","last_became_active":"2024-09-14T11:01:20.860944+0000","last_became_peered":"2024-09-14T11:01:20.860944+0000","last_unstale":"2024-09-14T11:23:27.493348+0000","last_undegraded":"2024-09-14T11:23:27.493348+0000","last_fullsized":"2024-09-14T11:23:27.493348+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:27.493188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:27.493188+0000","last_clean_scrub_stamp":"2024-09-14T11:23:27.493188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:10.739573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"260'37","reported_seq":150,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:28.289879+0000","last_change":"2024-09-14T11:23:28.289822+0000","last_active":"2024-09-14T11:23:28.289879+0000","last_peered":"2024-09-14T11:23:28.289879+0000","last_clean":"2024-09-14T11:23:28.289879+0000","last_became_active":"2024-09-14T10:59:48.419953+0000","last_became_peered":"2024-09-14T10:59:48.419953+0000","last_unstale":"2024-09-14T11:23:28.289879+0000","last_undegraded":"2024-09-14T11:23:28.289879+0000","last_fullsized":"2024-09-14T11:23:28.289879+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":249,"last_epoch_clean":250,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'37","last_scrub_stamp":"2024-09-14T11:23:28.289745+0000","last_deep_scrub":"260'37","last_deep_scrub_stamp":"2024-09-14T11:23:28.289745+0000","last_clean_scrub_stamp":"2024-09-14T11:23:28.289745+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:16.011756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":210,"num_write":90,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"260'356","reported_seq":1000,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:04.591849+0000","last_change":"2024-09-14T11:23:04.591790+0000","last_active":"2024-09-14T11:23:04.591849+0000","last_peered":"2024-09-14T11:23:04.591849+0000","last_clean":"2024-09-14T11:23:04.591849+0000","last_became_active":"2024-09-14T10:45:43.684205+0000","last_became_peered":"2024-09-14T10:45:43.684205+0000","last_unstale":"2024-09-14T11:23:04.591849+0000","last_undegraded":"2024-09-14T11:23:04.591849+0000","last_fullsized":"2024-09-14T11:23:04.591849+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'356","last_scrub_stamp":"2024-09-14T11:23:04.591679+0000","last_deep_scrub":"260'356","last_deep_scrub_stamp":"2024-09-14T11:23:04.591679+0000","last_clean_scrub_stamp":"2024-09-14T11:23:04.591679+0000","objects_scrubbed":7,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:23.922213+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133699,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":617,"num_read_kb":37218,"num_write":1077,"num_write_kb":25003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"260'785","reported_seq":2543,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:08.629267+0000","last_change":"2024-09-14T11:23:08.629209+0000","last_active":"2024-09-14T11:23:08.629267+0000","last_peered":"2024-09-14T11:23:08.629267+0000","last_clean":"2024-09-14T11:23:08.629267+0000","last_became_active":"2024-09-14T10:45:45.714485+0000","last_became_peered":"2024-09-14T10:45:45.714485+0000","last_unstale":"2024-09-14T11:23:08.629267+0000","last_undegraded":"2024-09-14T11:23:08.629267+0000","last_fullsized":"2024-09-14T11:23:08.629267+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'785","last_scrub_stamp":"2024-09-14T11:23:08.629123+0000","last_deep_scrub":"260'785","last_deep_scrub_stamp":"2024-09-14T11:23:08.629123+0000","last_clean_scrub_stamp":"2024-09-14T11:23:08.629123+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:19:08.756240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4300,"num_read_kb":3942,"num_write":1034,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7375,"num_omap_keys":29,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"260'353","reported_seq":1039,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:08.381428+0000","last_change":"2024-09-14T11:23:08.381363+0000","last_active":"2024-09-14T11:23:08.381428+0000","last_peered":"2024-09-14T11:23:08.381428+0000","last_clean":"2024-09-14T11:23:08.381428+0000","last_became_active":"2024-09-14T10:45:43.683777+0000","last_became_peered":"2024-09-14T10:45:43.683777+0000","last_unstale":"2024-09-14T11:23:08.381428+0000","last_undegraded":"2024-09-14T11:23:08.381428+0000","last_fullsized":"2024-09-14T11:23:08.381428+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'353","last_scrub_stamp":"2024-09-14T11:23:08.381263+0000","last_deep_scrub":"260'353","last_deep_scrub_stamp":"2024-09-14T11:23:08.381263+0000","last_clean_scrub_stamp":"2024-09-14T11:23:08.381263+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:09.498257+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":760,"num_read_kb":10810,"num_write":1149,"num_write_kb":33486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"260'367","reported_seq":1843,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:20.153914+0000","last_change":"2024-09-14T11:23:20.153914+0000","last_active":"2024-09-14T11:23:20.153914+0000","last_peered":"2024-09-14T11:23:20.153914+0000","last_clean":"2024-09-14T11:23:20.153914+0000","last_became_active":"2024-09-14T10:45:45.715857+0000","last_became_peered":"2024-09-14T10:45:45.715857+0000","last_unstale":"2024-09-14T11:23:20.153914+0000","last_undegraded":"2024-09-14T11:23:20.153914+0000","last_fullsized":"2024-09-14T11:23:20.153914+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'367","last_scrub_stamp":"2024-09-14T11:23:20.153830+0000","last_deep_scrub":"260'367","last_deep_scrub_stamp":"2024-09-14T11:23:20.153830+0000","last_clean_scrub_stamp":"2024-09-14T11:23:20.153830+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:36.122734+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2025,"num_read_kb":1946,"num_write":400,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"260'382","reported_seq":1095,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:09.404600+0000","last_change":"2024-09-14T11:23:09.404541+0000","last_active":"2024-09-14T11:23:09.404600+0000","last_peered":"2024-09-14T11:23:09.404600+0000","last_clean":"2024-09-14T11:23:09.404600+0000","last_became_active":"2024-09-14T10:45:43.689222+0000","last_became_peered":"2024-09-14T10:45:43.689222+0000","last_unstale":"2024-09-14T11:23:09.404600+0000","last_undegraded":"2024-09-14T11:23:09.404600+0000","last_fullsized":"2024-09-14T11:23:09.404600+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'382","last_scrub_stamp":"2024-09-14T11:23:09.404431+0000","last_deep_scrub":"260'382","last_deep_scrub_stamp":"2024-09-14T11:23:09.404431+0000","last_clean_scrub_stamp":"2024-09-14T11:23:09.404431+0000","objects_scrubbed":6,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:38:07.421015+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":957,"num_read_kb":25215,"num_write":1113,"num_write_kb":46624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"260'805","reported_seq":2244,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:21.166053+0000","last_change":"2024-09-14T11:23:21.166053+0000","last_active":"2024-09-14T11:23:21.166053+0000","last_peered":"2024-09-14T11:23:21.166053+0000","last_clean":"2024-09-14T11:23:21.166053+0000","last_became_active":"2024-09-14T10:45:45.718205+0000","last_became_peered":"2024-09-14T10:45:45.718205+0000","last_unstale":"2024-09-14T11:23:21.166053+0000","last_undegraded":"2024-09-14T11:23:21.166053+0000","last_fullsized":"2024-09-14T11:23:21.166053+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'805","last_scrub_stamp":"2024-09-14T11:23:21.165903+0000","last_deep_scrub":"260'805","last_deep_scrub_stamp":"2024-09-14T11:23:21.165903+0000","last_clean_scrub_stamp":"2024-09-14T11:23:21.165903+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:27.460262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3715,"num_read_kb":3327,"num_write":1051,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"260'407","reported_seq":1158,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:02.167203+0000","last_change":"2024-09-14T11:23:02.167132+0000","last_active":"2024-09-14T11:23:02.167203+0000","last_peered":"2024-09-14T11:23:02.167203+0000","last_clean":"2024-09-14T11:23:02.167203+0000","last_became_active":"2024-09-14T10:45:43.688982+0000","last_became_peered":"2024-09-14T10:45:43.688982+0000","last_unstale":"2024-09-14T11:23:02.167203+0000","last_undegraded":"2024-09-14T11:23:02.167203+0000","last_fullsized":"2024-09-14T11:23:02.167203+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'407","last_scrub_stamp":"2024-09-14T11:23:02.167030+0000","last_deep_scrub":"260'407","last_deep_scrub_stamp":"2024-09-14T11:23:02.167030+0000","last_clean_scrub_stamp":"2024-09-14T11:23:02.167030+0000","objects_scrubbed":6,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:09.629346+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133692,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":838,"num_read_kb":162483,"num_write":1341,"num_write_kb":45809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"260'458","reported_seq":2016,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:12.794133+0000","last_change":"2024-09-14T11:23:12.794054+0000","last_active":"2024-09-14T11:23:12.794133+0000","last_peered":"2024-09-14T11:23:12.794133+0000","last_clean":"2024-09-14T11:23:12.794133+0000","last_became_active":"2024-09-14T10:45:45.717699+0000","last_became_peered":"2024-09-14T10:45:45.717699+0000","last_unstale":"2024-09-14T11:23:12.794133+0000","last_undegraded":"2024-09-14T11:23:12.794133+0000","last_fullsized":"2024-09-14T11:23:12.794133+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'458","last_scrub_stamp":"2024-09-14T11:23:12.793944+0000","last_deep_scrub":"260'458","last_deep_scrub_stamp":"2024-09-14T11:23:12.793944+0000","last_clean_scrub_stamp":"2024-09-14T11:23:12.793944+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:09.734572+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2461,"num_read_kb":2303,"num_write":536,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"260'377","reported_seq":1025,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:03.611733+0000","last_change":"2024-09-14T11:23:03.611674+0000","last_active":"2024-09-14T11:23:03.611733+0000","last_peered":"2024-09-14T11:23:03.611733+0000","last_clean":"2024-09-14T11:23:03.611733+0000","last_became_active":"2024-09-14T10:45:43.686078+0000","last_became_peered":"2024-09-14T10:45:43.686078+0000","last_unstale":"2024-09-14T11:23:03.611733+0000","last_undegraded":"2024-09-14T11:23:03.611733+0000","last_fullsized":"2024-09-14T11:23:03.611733+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'377","last_scrub_stamp":"2024-09-14T11:23:03.611555+0000","last_deep_scrub":"260'377","last_deep_scrub_stamp":"2024-09-14T11:23:03.611555+0000","last_clean_scrub_stamp":"2024-09-14T11:23:03.611555+0000","objects_scrubbed":9,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:46.384126+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":598,"num_read_kb":61894,"num_write":1162,"num_write_kb":33123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"260'401","reported_seq":2020,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:07.627790+0000","last_change":"2024-09-14T11:23:07.627716+0000","last_active":"2024-09-14T11:23:07.627790+0000","last_peered":"2024-09-14T11:23:07.627790+0000","last_clean":"2024-09-14T11:23:07.627790+0000","last_became_active":"2024-09-14T10:45:45.714345+0000","last_became_peered":"2024-09-14T10:45:45.714345+0000","last_unstale":"2024-09-14T11:23:07.627790+0000","last_undegraded":"2024-09-14T11:23:07.627790+0000","last_fullsized":"2024-09-14T11:23:07.627790+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'401","last_scrub_stamp":"2024-09-14T11:23:07.627629+0000","last_deep_scrub":"260'401","last_deep_scrub_stamp":"2024-09-14T11:23:07.627629+0000","last_clean_scrub_stamp":"2024-09-14T11:23:07.627629+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:58:14.580406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2395,"num_read_kb":2287,"num_write":454,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"260'361","reported_seq":1026,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:01.177685+0000","last_change":"2024-09-14T11:23:01.177616+0000","last_active":"2024-09-14T11:23:01.177685+0000","last_peered":"2024-09-14T11:23:01.177685+0000","last_clean":"2024-09-14T11:23:01.177685+0000","last_became_active":"2024-09-14T10:45:43.689513+0000","last_became_peered":"2024-09-14T10:45:43.689513+0000","last_unstale":"2024-09-14T11:23:01.177685+0000","last_undegraded":"2024-09-14T11:23:01.177685+0000","last_fullsized":"2024-09-14T11:23:01.177685+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'361","last_scrub_stamp":"2024-09-14T11:23:01.177512+0000","last_deep_scrub":"260'361","last_deep_scrub_stamp":"2024-09-14T11:23:01.177512+0000","last_clean_scrub_stamp":"2024-09-14T11:23:01.177512+0000","objects_scrubbed":6,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:32.647394+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":492096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":689,"num_read_kb":58877,"num_write":1198,"num_write_kb":34980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"260'913","reported_seq":2793,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:10.646748+0000","last_change":"2024-09-14T11:23:10.646694+0000","last_active":"2024-09-14T11:23:10.646748+0000","last_peered":"2024-09-14T11:23:10.646748+0000","last_clean":"2024-09-14T11:23:10.646748+0000","last_became_active":"2024-09-14T10:45:45.722048+0000","last_became_peered":"2024-09-14T10:45:45.722048+0000","last_unstale":"2024-09-14T11:23:10.646748+0000","last_undegraded":"2024-09-14T11:23:10.646748+0000","last_fullsized":"2024-09-14T11:23:10.646748+0000","mapping_epoch":26,"log_start":"260'900","ondisk_log_start":"260'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'913","last_scrub_stamp":"2024-09-14T11:23:10.646599+0000","last_deep_scrub":"260'913","last_deep_scrub_stamp":"2024-09-14T11:23:10.646599+0000","last_clean_scrub_stamp":"2024-09-14T11:23:10.646599+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":900,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:43.954240+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4452,"num_read_kb":4058,"num_write":1175,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":735,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"260'370","reported_seq":1013,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:59.523833+0000","last_change":"2024-09-14T11:22:59.523764+0000","last_active":"2024-09-14T11:22:59.523833+0000","last_peered":"2024-09-14T11:22:59.523833+0000","last_clean":"2024-09-14T11:22:59.523833+0000","last_became_active":"2024-09-14T10:45:43.689229+0000","last_became_peered":"2024-09-14T10:45:43.689229+0000","last_unstale":"2024-09-14T11:22:59.523833+0000","last_undegraded":"2024-09-14T11:22:59.523833+0000","last_fullsized":"2024-09-14T11:22:59.523833+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'370","last_scrub_stamp":"2024-09-14T11:22:59.523641+0000","last_deep_scrub":"260'370","last_deep_scrub_stamp":"2024-09-14T11:22:59.523641+0000","last_clean_scrub_stamp":"2024-09-14T11:22:59.523641+0000","objects_scrubbed":5,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:54.893522+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":599,"num_read_kb":84854,"num_write":1153,"num_write_kb":20352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"260'522","reported_seq":2116,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:06.256202+0000","last_change":"2024-09-14T11:23:06.256140+0000","last_active":"2024-09-14T11:23:06.256202+0000","last_peered":"2024-09-14T11:23:06.256202+0000","last_clean":"2024-09-14T11:23:06.256202+0000","last_became_active":"2024-09-14T10:45:45.718978+0000","last_became_peered":"2024-09-14T10:45:45.718978+0000","last_unstale":"2024-09-14T11:23:06.256202+0000","last_undegraded":"2024-09-14T11:23:06.256202+0000","last_fullsized":"2024-09-14T11:23:06.256202+0000","mapping_epoch":26,"log_start":"260'500","ondisk_log_start":"260'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'522","last_scrub_stamp":"2024-09-14T11:23:06.256050+0000","last_deep_scrub":"260'522","last_deep_scrub_stamp":"2024-09-14T11:23:06.256050+0000","last_clean_scrub_stamp":"2024-09-14T11:23:06.256050+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:20:05.550331+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2761,"num_read_kb":2575,"num_write":634,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"260'341","reported_seq":980,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:07.343841+0000","last_change":"2024-09-14T11:23:07.343744+0000","last_active":"2024-09-14T11:23:07.343841+0000","last_peered":"2024-09-14T11:23:07.343841+0000","last_clean":"2024-09-14T11:23:07.343841+0000","last_became_active":"2024-09-14T10:45:43.687262+0000","last_became_peered":"2024-09-14T10:45:43.687262+0000","last_unstale":"2024-09-14T11:23:07.343841+0000","last_undegraded":"2024-09-14T11:23:07.343841+0000","last_fullsized":"2024-09-14T11:23:07.343841+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'341","last_scrub_stamp":"2024-09-14T11:23:07.343639+0000","last_deep_scrub":"260'341","last_deep_scrub_stamp":"2024-09-14T11:23:07.343639+0000","last_clean_scrub_stamp":"2024-09-14T11:23:07.343639+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:20.970032+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":682,"num_read_kb":42631,"num_write":1158,"num_write_kb":32664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"260'829","reported_seq":2526,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:18.423447+0000","last_change":"2024-09-14T11:23:18.423447+0000","last_active":"2024-09-14T11:23:18.423447+0000","last_peered":"2024-09-14T11:23:18.423447+0000","last_clean":"2024-09-14T11:23:18.423447+0000","last_became_active":"2024-09-14T10:45:45.721400+0000","last_became_peered":"2024-09-14T10:45:45.721400+0000","last_unstale":"2024-09-14T11:23:18.423447+0000","last_undegraded":"2024-09-14T11:23:18.423447+0000","last_fullsized":"2024-09-14T11:23:18.423447+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'829","last_scrub_stamp":"2024-09-14T11:23:18.423349+0000","last_deep_scrub":"260'829","last_deep_scrub_stamp":"2024-09-14T11:23:18.423349+0000","last_clean_scrub_stamp":"2024-09-14T11:23:18.423349+0000","objects_scrubbed":5,"log_size":29,"log_dups_size":800,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:43.196057+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4476,"num_read_kb":4082,"num_write":1140,"num_write_kb":477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2301,"num_omap_keys":9,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"260'1281","reported_seq":2925,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:19.131432+0000","last_change":"2024-09-14T11:23:19.131432+0000","last_active":"2024-09-14T11:23:19.131432+0000","last_peered":"2024-09-14T11:23:19.131432+0000","last_clean":"2024-09-14T11:23:19.131432+0000","last_became_active":"2024-09-14T10:45:45.710015+0000","last_became_peered":"2024-09-14T10:45:45.710015+0000","last_unstale":"2024-09-14T11:23:19.131432+0000","last_undegraded":"2024-09-14T11:23:19.131432+0000","last_fullsized":"2024-09-14T11:23:19.131432+0000","mapping_epoch":26,"log_start":"260'1200","ondisk_log_start":"260'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1281","last_scrub_stamp":"2024-09-14T11:23:19.131365+0000","last_deep_scrub":"260'1281","last_deep_scrub_stamp":"2024-09-14T11:23:19.131365+0000","last_clean_scrub_stamp":"2024-09-14T11:23:19.131365+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":1200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:57.896028+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5907,"num_read_kb":5227,"num_write":1779,"num_write_kb":739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"260'363","reported_seq":972,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:00.677668+0000","last_change":"2024-09-14T11:23:00.677668+0000","last_active":"2024-09-14T11:23:00.677668+0000","last_peered":"2024-09-14T11:23:00.677668+0000","last_clean":"2024-09-14T11:23:00.677668+0000","last_became_active":"2024-09-14T10:45:43.677751+0000","last_became_peered":"2024-09-14T10:45:43.677751+0000","last_unstale":"2024-09-14T11:23:00.677668+0000","last_undegraded":"2024-09-14T11:23:00.677668+0000","last_fullsized":"2024-09-14T11:23:00.677668+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'363","last_scrub_stamp":"2024-09-14T11:23:00.677578+0000","last_deep_scrub":"260'363","last_deep_scrub_stamp":"2024-09-14T11:23:00.677578+0000","last_clean_scrub_stamp":"2024-09-14T11:23:00.677578+0000","objects_scrubbed":3,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:46:20.373849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":554,"num_read_kb":880,"num_write":1155,"num_write_kb":23836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"260'598","reported_seq":2281,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:06.638146+0000","last_change":"2024-09-14T11:23:06.638084+0000","last_active":"2024-09-14T11:23:06.638146+0000","last_peered":"2024-09-14T11:23:06.638146+0000","last_clean":"2024-09-14T11:23:06.638146+0000","last_became_active":"2024-09-14T10:45:45.714551+0000","last_became_peered":"2024-09-14T10:45:45.714551+0000","last_unstale":"2024-09-14T11:23:06.638146+0000","last_undegraded":"2024-09-14T11:23:06.638146+0000","last_fullsized":"2024-09-14T11:23:06.638146+0000","mapping_epoch":26,"log_start":"260'500","ondisk_log_start":"260'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'598","last_scrub_stamp":"2024-09-14T11:23:06.637993+0000","last_deep_scrub":"260'598","last_deep_scrub_stamp":"2024-09-14T11:23:06.637993+0000","last_clean_scrub_stamp":"2024-09-14T11:23:06.637993+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":500,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:58.618707+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3058,"num_read_kb":2815,"num_write":741,"num_write_kb":205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":640,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"260'359","reported_seq":994,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:58.562307+0000","last_change":"2024-09-14T11:22:58.562307+0000","last_active":"2024-09-14T11:22:58.562307+0000","last_peered":"2024-09-14T11:22:58.562307+0000","last_clean":"2024-09-14T11:22:58.562307+0000","last_became_active":"2024-09-14T10:45:43.680355+0000","last_became_peered":"2024-09-14T10:45:43.680355+0000","last_unstale":"2024-09-14T11:22:58.562307+0000","last_undegraded":"2024-09-14T11:22:58.562307+0000","last_fullsized":"2024-09-14T11:22:58.562307+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'359","last_scrub_stamp":"2024-09-14T11:22:58.562194+0000","last_deep_scrub":"260'359","last_deep_scrub_stamp":"2024-09-14T11:22:58.562194+0000","last_clean_scrub_stamp":"2024-09-14T11:22:58.562194+0000","objects_scrubbed":8,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:10.587335+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":541,"num_read_kb":36303,"num_write":1001,"num_write_kb":55095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"260'494","reported_seq":2172,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:09.584116+0000","last_change":"2024-09-14T11:23:09.584046+0000","last_active":"2024-09-14T11:23:09.584116+0000","last_peered":"2024-09-14T11:23:09.584116+0000","last_clean":"2024-09-14T11:23:09.584116+0000","last_became_active":"2024-09-14T10:45:45.720760+0000","last_became_peered":"2024-09-14T10:45:45.720760+0000","last_unstale":"2024-09-14T11:23:09.584116+0000","last_undegraded":"2024-09-14T11:23:09.584116+0000","last_fullsized":"2024-09-14T11:23:09.584116+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'494","last_scrub_stamp":"2024-09-14T11:23:09.583958+0000","last_deep_scrub":"260'494","last_deep_scrub_stamp":"2024-09-14T11:23:09.583958+0000","last_clean_scrub_stamp":"2024-09-14T11:23:09.583958+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:01:54.258924+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2631,"num_read_kb":2483,"num_write":574,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"260'388","reported_seq":1071,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:57.604997+0000","last_change":"2024-09-14T11:22:57.604997+0000","last_active":"2024-09-14T11:22:57.604997+0000","last_peered":"2024-09-14T11:22:57.604997+0000","last_clean":"2024-09-14T11:22:57.604997+0000","last_became_active":"2024-09-14T10:45:43.684428+0000","last_became_peered":"2024-09-14T10:45:43.684428+0000","last_unstale":"2024-09-14T11:22:57.604997+0000","last_undegraded":"2024-09-14T11:22:57.604997+0000","last_fullsized":"2024-09-14T11:22:57.604997+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'388","last_scrub_stamp":"2024-09-14T11:22:57.604909+0000","last_deep_scrub":"260'388","last_deep_scrub_stamp":"2024-09-14T11:22:57.604909+0000","last_clean_scrub_stamp":"2024-09-14T11:22:57.604909+0000","objects_scrubbed":4,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:01.600133+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133668,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":756,"num_read_kb":9043,"num_write":1222,"num_write_kb":18367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"260'487","reported_seq":2068,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:10.315984+0000","last_change":"2024-09-14T11:23:10.315984+0000","last_active":"2024-09-14T11:23:10.315984+0000","last_peered":"2024-09-14T11:23:10.315984+0000","last_clean":"2024-09-14T11:23:10.315984+0000","last_became_active":"2024-09-14T10:45:45.724302+0000","last_became_peered":"2024-09-14T10:45:45.724302+0000","last_unstale":"2024-09-14T11:23:10.315984+0000","last_undegraded":"2024-09-14T11:23:10.315984+0000","last_fullsized":"2024-09-14T11:23:10.315984+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'487","last_scrub_stamp":"2024-09-14T11:23:10.315849+0000","last_deep_scrub":"260'487","last_deep_scrub_stamp":"2024-09-14T11:23:10.315849+0000","last_clean_scrub_stamp":"2024-09-14T11:23:10.315849+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:37.803313+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2564,"num_read_kb":2400,"num_write":575,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":460,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"260'336","reported_seq":1031,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:01.602768+0000","last_change":"2024-09-14T11:23:01.602768+0000","last_active":"2024-09-14T11:23:01.602768+0000","last_peered":"2024-09-14T11:23:01.602768+0000","last_clean":"2024-09-14T11:23:01.602768+0000","last_became_active":"2024-09-14T10:45:43.683797+0000","last_became_peered":"2024-09-14T10:45:43.683797+0000","last_unstale":"2024-09-14T11:23:01.602768+0000","last_undegraded":"2024-09-14T11:23:01.602768+0000","last_fullsized":"2024-09-14T11:23:01.602768+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'336","last_scrub_stamp":"2024-09-14T11:23:01.602654+0000","last_deep_scrub":"260'336","last_deep_scrub_stamp":"2024-09-14T11:23:01.602654+0000","last_clean_scrub_stamp":"2024-09-14T11:23:01.602654+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:05.538860+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":715,"num_read_kb":8100,"num_write":1180,"num_write_kb":25345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"260'434","reported_seq":1978,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:17.380987+0000","last_change":"2024-09-14T11:23:17.380987+0000","last_active":"2024-09-14T11:23:17.380987+0000","last_peered":"2024-09-14T11:23:17.380987+0000","last_clean":"2024-09-14T11:23:17.380987+0000","last_became_active":"2024-09-14T10:45:45.723570+0000","last_became_peered":"2024-09-14T10:45:45.723570+0000","last_unstale":"2024-09-14T11:23:17.380987+0000","last_undegraded":"2024-09-14T11:23:17.380987+0000","last_fullsized":"2024-09-14T11:23:17.380987+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'434","last_scrub_stamp":"2024-09-14T11:23:17.380900+0000","last_deep_scrub":"260'434","last_deep_scrub_stamp":"2024-09-14T11:23:17.380900+0000","last_clean_scrub_stamp":"2024-09-14T11:23:17.380900+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:59.821342+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2400,"num_read_kb":2278,"num_write":489,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"260'442","reported_seq":1161,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:03.480235+0000","last_change":"2024-09-14T11:23:03.480235+0000","last_active":"2024-09-14T11:23:03.480235+0000","last_peered":"2024-09-14T11:23:03.480235+0000","last_clean":"2024-09-14T11:23:03.480235+0000","last_became_active":"2024-09-14T10:45:43.687585+0000","last_became_peered":"2024-09-14T10:45:43.687585+0000","last_unstale":"2024-09-14T11:23:03.480235+0000","last_undegraded":"2024-09-14T11:23:03.480235+0000","last_fullsized":"2024-09-14T11:23:03.480235+0000","mapping_epoch":23,"log_start":"260'400","ondisk_log_start":"260'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'442","last_scrub_stamp":"2024-09-14T11:23:03.480124+0000","last_deep_scrub":"260'442","last_deep_scrub_stamp":"2024-09-14T11:23:03.480124+0000","last_clean_scrub_stamp":"2024-09-14T11:23:03.480124+0000","objects_scrubbed":6,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:54.485427+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1137,"num_read_kb":1116,"num_write":1403,"num_write_kb":30799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"260'801","reported_seq":2456,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:06.591124+0000","last_change":"2024-09-14T11:23:06.591124+0000","last_active":"2024-09-14T11:23:06.591124+0000","last_peered":"2024-09-14T11:23:06.591124+0000","last_clean":"2024-09-14T11:23:06.591124+0000","last_became_active":"2024-09-14T10:45:45.714187+0000","last_became_peered":"2024-09-14T10:45:45.714187+0000","last_unstale":"2024-09-14T11:23:06.591124+0000","last_undegraded":"2024-09-14T11:23:06.591124+0000","last_fullsized":"2024-09-14T11:23:06.591124+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'801","last_scrub_stamp":"2024-09-14T11:23:06.591022+0000","last_deep_scrub":"260'801","last_deep_scrub_stamp":"2024-09-14T11:23:06.591022+0000","last_clean_scrub_stamp":"2024-09-14T11:23:06.591022+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:23.740415+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3909,"num_read_kb":3562,"num_write":1036,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":245,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"260'348","reported_seq":996,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:00.520173+0000","last_change":"2024-09-14T11:23:00.520074+0000","last_active":"2024-09-14T11:23:00.520173+0000","last_peered":"2024-09-14T11:23:00.520173+0000","last_clean":"2024-09-14T11:23:00.520173+0000","last_became_active":"2024-09-14T10:45:43.681680+0000","last_became_peered":"2024-09-14T10:45:43.681680+0000","last_unstale":"2024-09-14T11:23:00.520173+0000","last_undegraded":"2024-09-14T11:23:00.520173+0000","last_fullsized":"2024-09-14T11:23:00.520173+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'348","last_scrub_stamp":"2024-09-14T11:23:00.519964+0000","last_deep_scrub":"260'348","last_deep_scrub_stamp":"2024-09-14T11:23:00.519964+0000","last_clean_scrub_stamp":"2024-09-14T11:23:00.519964+0000","objects_scrubbed":3,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:19:01.552760+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":572,"num_read_kb":80059,"num_write":1115,"num_write_kb":31213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"260'167","reported_seq":664,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:20.609247+0000","last_change":"2024-09-14T11:23:20.609247+0000","last_active":"2024-09-14T11:23:20.609247+0000","last_peered":"2024-09-14T11:23:20.609247+0000","last_clean":"2024-09-14T11:23:20.609247+0000","last_became_active":"2024-09-14T10:45:53.749495+0000","last_became_peered":"2024-09-14T10:45:53.749495+0000","last_unstale":"2024-09-14T11:23:20.609247+0000","last_undegraded":"2024-09-14T11:23:20.609247+0000","last_fullsized":"2024-09-14T11:23:20.609247+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'167","last_scrub_stamp":"2024-09-14T11:23:20.609150+0000","last_deep_scrub":"260'167","last_deep_scrub_stamp":"2024-09-14T11:23:20.609150+0000","last_clean_scrub_stamp":"2024-09-14T11:23:20.609150+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:03:11.128451+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":160,"num_read_kb":158,"num_write":391,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"260'885","reported_seq":2461,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:08.342104+0000","last_change":"2024-09-14T11:23:08.342014+0000","last_active":"2024-09-14T11:23:08.342104+0000","last_peered":"2024-09-14T11:23:08.342104+0000","last_clean":"2024-09-14T11:23:08.342104+0000","last_became_active":"2024-09-14T10:45:45.710830+0000","last_became_peered":"2024-09-14T10:45:45.710830+0000","last_unstale":"2024-09-14T11:23:08.342104+0000","last_undegraded":"2024-09-14T11:23:08.342104+0000","last_fullsized":"2024-09-14T11:23:08.342104+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'885","last_scrub_stamp":"2024-09-14T11:23:08.341916+0000","last_deep_scrub":"260'885","last_deep_scrub_stamp":"2024-09-14T11:23:08.341916+0000","last_clean_scrub_stamp":"2024-09-14T11:23:08.341916+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":800,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:21.880977+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5905,"num_read_kb":5530,"num_write":1368,"num_write_kb":537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"260'450","reported_seq":1134,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:05.189040+0000","last_change":"2024-09-14T11:23:05.188952+0000","last_active":"2024-09-14T11:23:05.189040+0000","last_peered":"2024-09-14T11:23:05.189040+0000","last_clean":"2024-09-14T11:23:05.189040+0000","last_became_active":"2024-09-14T10:45:43.684504+0000","last_became_peered":"2024-09-14T10:45:43.684504+0000","last_unstale":"2024-09-14T11:23:05.189040+0000","last_undegraded":"2024-09-14T11:23:05.189040+0000","last_fullsized":"2024-09-14T11:23:05.189040+0000","mapping_epoch":23,"log_start":"260'400","ondisk_log_start":"260'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'450","last_scrub_stamp":"2024-09-14T11:23:05.188789+0000","last_deep_scrub":"260'450","last_deep_scrub_stamp":"2024-09-14T11:23:05.188789+0000","last_clean_scrub_stamp":"2024-09-14T11:23:05.188789+0000","objects_scrubbed":9,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:06.893489+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133694,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":846,"num_read_kb":75778,"num_write":1426,"num_write_kb":37052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":486,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:26.201687+0000","last_change":"2024-09-14T11:23:26.201687+0000","last_active":"2024-09-14T11:23:26.201687+0000","last_peered":"2024-09-14T11:23:26.201687+0000","last_clean":"2024-09-14T11:23:26.201687+0000","last_became_active":"2024-09-14T10:45:47.730629+0000","last_became_peered":"2024-09-14T10:45:47.730629+0000","last_unstale":"2024-09-14T11:23:26.201687+0000","last_undegraded":"2024-09-14T11:23:26.201687+0000","last_fullsized":"2024-09-14T11:23:26.201687+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:26.201579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:26.201579+0000","last_clean_scrub_stamp":"2024-09-14T11:23:26.201579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:45.423285+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"260'338","reported_seq":933,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:24.687756+0000","last_change":"2024-09-14T11:23:24.687756+0000","last_active":"2024-09-14T11:23:24.687756+0000","last_peered":"2024-09-14T11:23:24.687756+0000","last_clean":"2024-09-14T11:23:24.687756+0000","last_became_active":"2024-09-14T10:45:49.733770+0000","last_became_peered":"2024-09-14T10:45:49.733770+0000","last_unstale":"2024-09-14T11:23:24.687756+0000","last_undegraded":"2024-09-14T11:23:24.687756+0000","last_fullsized":"2024-09-14T11:23:24.687756+0000","mapping_epoch":30,"log_start":"260'300","ondisk_log_start":"260'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'338","last_scrub_stamp":"2024-09-14T11:23:24.687646+0000","last_deep_scrub":"260'338","last_deep_scrub_stamp":"2024-09-14T11:23:24.687646+0000","last_clean_scrub_stamp":"2024-09-14T11:23:24.687646+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:56.364701+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49773,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":530,"num_read_kb":1113,"num_write":424,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:19.613258+0000","last_change":"2024-09-14T11:23:19.613258+0000","last_active":"2024-09-14T11:23:19.613258+0000","last_peered":"2024-09-14T11:23:19.613258+0000","last_clean":"2024-09-14T11:23:19.613258+0000","last_became_active":"2024-09-14T10:45:51.745410+0000","last_became_peered":"2024-09-14T10:45:51.745410+0000","last_unstale":"2024-09-14T11:23:19.613258+0000","last_undegraded":"2024-09-14T11:23:19.613258+0000","last_fullsized":"2024-09-14T11:23:19.613258+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:19.613177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:19.613177+0000","last_clean_scrub_stamp":"2024-09-14T11:23:19.613177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:29:07.940790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"260'96","reported_seq":580,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:25.560729+0000","last_change":"2024-09-14T11:23:25.560729+0000","last_active":"2024-09-14T11:23:25.560729+0000","last_peered":"2024-09-14T11:23:25.560729+0000","last_clean":"2024-09-14T11:23:25.560729+0000","last_became_active":"2024-09-14T10:45:53.743472+0000","last_became_peered":"2024-09-14T10:45:53.743472+0000","last_unstale":"2024-09-14T11:23:25.560729+0000","last_undegraded":"2024-09-14T11:23:25.560729+0000","last_fullsized":"2024-09-14T11:23:25.560729+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'96","last_scrub_stamp":"2024-09-14T11:23:25.560642+0000","last_deep_scrub":"260'96","last_deep_scrub_stamp":"2024-09-14T11:23:25.560642+0000","last_clean_scrub_stamp":"2024-09-14T11:23:25.560642+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:20.792449+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":73,"num_read_kb":72,"num_write":215,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"260'380","reported_seq":1794,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:16.212298+0000","last_change":"2024-09-14T11:23:16.212298+0000","last_active":"2024-09-14T11:23:16.212298+0000","last_peered":"2024-09-14T11:23:16.212298+0000","last_clean":"2024-09-14T11:23:16.212298+0000","last_became_active":"2024-09-14T10:45:45.713502+0000","last_became_peered":"2024-09-14T10:45:45.713502+0000","last_unstale":"2024-09-14T11:23:16.212298+0000","last_undegraded":"2024-09-14T11:23:16.212298+0000","last_fullsized":"2024-09-14T11:23:16.212298+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'380","last_scrub_stamp":"2024-09-14T11:23:16.212209+0000","last_deep_scrub":"260'380","last_deep_scrub_stamp":"2024-09-14T11:23:16.212209+0000","last_clean_scrub_stamp":"2024-09-14T11:23:16.212209+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:05.789118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2020,"num_read_kb":1909,"num_write":423,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"260'306","reported_seq":1044,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:57.547642+0000","last_change":"2024-09-14T11:22:57.547580+0000","last_active":"2024-09-14T11:22:57.547642+0000","last_peered":"2024-09-14T11:22:57.547642+0000","last_clean":"2024-09-14T11:22:57.547642+0000","last_became_active":"2024-09-14T10:45:43.683964+0000","last_became_peered":"2024-09-14T10:45:43.683964+0000","last_unstale":"2024-09-14T11:22:57.547642+0000","last_undegraded":"2024-09-14T11:22:57.547642+0000","last_fullsized":"2024-09-14T11:22:57.547642+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'306","last_scrub_stamp":"2024-09-14T11:22:57.547454+0000","last_deep_scrub":"260'306","last_deep_scrub_stamp":"2024-09-14T11:22:57.547454+0000","last_clean_scrub_stamp":"2024-09-14T11:22:57.547454+0000","objects_scrubbed":7,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:59.621447+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133715,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":687,"num_read_kb":39643,"num_write":1073,"num_write_kb":23617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":493,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:16.803040+0000","last_change":"2024-09-14T11:23:16.803040+0000","last_active":"2024-09-14T11:23:16.803040+0000","last_peered":"2024-09-14T11:23:16.803040+0000","last_clean":"2024-09-14T11:23:16.803040+0000","last_became_active":"2024-09-14T10:45:47.729871+0000","last_became_peered":"2024-09-14T10:45:47.729871+0000","last_unstale":"2024-09-14T11:23:16.803040+0000","last_undegraded":"2024-09-14T11:23:16.803040+0000","last_fullsized":"2024-09-14T11:23:16.803040+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:16.802954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:16.802954+0000","last_clean_scrub_stamp":"2024-09-14T11:23:16.802954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:57.985108+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"260'87","reported_seq":603,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:16.577922+0000","last_change":"2024-09-14T11:23:16.577922+0000","last_active":"2024-09-14T11:23:16.577922+0000","last_peered":"2024-09-14T11:23:16.577922+0000","last_clean":"2024-09-14T11:23:16.577922+0000","last_became_active":"2024-09-14T10:45:49.732459+0000","last_became_peered":"2024-09-14T10:45:49.732459+0000","last_unstale":"2024-09-14T11:23:16.577922+0000","last_undegraded":"2024-09-14T11:23:16.577922+0000","last_fullsized":"2024-09-14T11:23:16.577922+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'87","last_scrub_stamp":"2024-09-14T11:23:16.577822+0000","last_deep_scrub":"260'87","last_deep_scrub_stamp":"2024-09-14T11:23:16.577822+0000","last_clean_scrub_stamp":"2024-09-14T11:23:16.577822+0000","objects_scrubbed":3,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:42.355440+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":84,"num_read_kb":79,"num_write":56,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:20.619631+0000","last_change":"2024-09-14T11:23:20.619631+0000","last_active":"2024-09-14T11:23:20.619631+0000","last_peered":"2024-09-14T11:23:20.619631+0000","last_clean":"2024-09-14T11:23:20.619631+0000","last_became_active":"2024-09-14T10:45:51.746608+0000","last_became_peered":"2024-09-14T10:45:51.746608+0000","last_unstale":"2024-09-14T11:23:20.619631+0000","last_undegraded":"2024-09-14T11:23:20.619631+0000","last_fullsized":"2024-09-14T11:23:20.619631+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:20.619548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:20.619548+0000","last_clean_scrub_stamp":"2024-09-14T11:23:20.619548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:01:42.667309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"260'131","reported_seq":629,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:23.276123+0000","last_change":"2024-09-14T11:23:23.276065+0000","last_active":"2024-09-14T11:23:23.276123+0000","last_peered":"2024-09-14T11:23:23.276123+0000","last_clean":"2024-09-14T11:23:23.276123+0000","last_became_active":"2024-09-14T10:45:53.752597+0000","last_became_peered":"2024-09-14T10:45:53.752597+0000","last_unstale":"2024-09-14T11:23:23.276123+0000","last_undegraded":"2024-09-14T11:23:23.276123+0000","last_fullsized":"2024-09-14T11:23:23.276123+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'131","last_scrub_stamp":"2024-09-14T11:23:23.275972+0000","last_deep_scrub":"260'131","last_deep_scrub_stamp":"2024-09-14T11:23:23.275972+0000","last_clean_scrub_stamp":"2024-09-14T11:23:23.275972+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:29.008656+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":152,"num_read_kb":142,"num_write":295,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"260'1285","reported_seq":2999,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:13.319725+0000","last_change":"2024-09-14T11:23:13.319725+0000","last_active":"2024-09-14T11:23:13.319725+0000","last_peered":"2024-09-14T11:23:13.319725+0000","last_clean":"2024-09-14T11:23:13.319725+0000","last_became_active":"2024-09-14T10:45:45.725335+0000","last_became_peered":"2024-09-14T10:45:45.725335+0000","last_unstale":"2024-09-14T11:23:13.319725+0000","last_undegraded":"2024-09-14T11:23:13.319725+0000","last_fullsized":"2024-09-14T11:23:13.319725+0000","mapping_epoch":26,"log_start":"260'1200","ondisk_log_start":"260'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1285","last_scrub_stamp":"2024-09-14T11:23:13.319628+0000","last_deep_scrub":"260'1285","last_deep_scrub_stamp":"2024-09-14T11:23:13.319628+0000","last_clean_scrub_stamp":"2024-09-14T11:23:13.319628+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":1200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:13:10.353579+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5911,"num_read_kb":5224,"num_write":1759,"num_write_kb":730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":714,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"260'352","reported_seq":1010,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:04.223440+0000","last_change":"2024-09-14T11:23:04.223378+0000","last_active":"2024-09-14T11:23:04.223440+0000","last_peered":"2024-09-14T11:23:04.223440+0000","last_clean":"2024-09-14T11:23:04.223440+0000","last_became_active":"2024-09-14T10:45:43.671096+0000","last_became_peered":"2024-09-14T10:45:43.671096+0000","last_unstale":"2024-09-14T11:23:04.223440+0000","last_undegraded":"2024-09-14T11:23:04.223440+0000","last_fullsized":"2024-09-14T11:23:04.223440+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'352","last_scrub_stamp":"2024-09-14T11:23:04.223284+0000","last_deep_scrub":"260'352","last_deep_scrub_stamp":"2024-09-14T11:23:04.223284+0000","last_clean_scrub_stamp":"2024-09-14T11:23:04.223284+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:49.941234+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":684,"num_read_kb":57141,"num_write":1087,"num_write_kb":43933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":492,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:17.805428+0000","last_change":"2024-09-14T11:23:17.805428+0000","last_active":"2024-09-14T11:23:17.805428+0000","last_peered":"2024-09-14T11:23:17.805428+0000","last_clean":"2024-09-14T11:23:17.805428+0000","last_became_active":"2024-09-14T10:45:47.724723+0000","last_became_peered":"2024-09-14T10:45:47.724723+0000","last_unstale":"2024-09-14T11:23:17.805428+0000","last_undegraded":"2024-09-14T11:23:17.805428+0000","last_fullsized":"2024-09-14T11:23:17.805428+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:17.805338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:17.805338+0000","last_clean_scrub_stamp":"2024-09-14T11:23:17.805338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:19.893049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"260'116","reported_seq":641,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:22.729795+0000","last_change":"2024-09-14T11:23:22.729795+0000","last_active":"2024-09-14T11:23:22.729795+0000","last_peered":"2024-09-14T11:23:22.729795+0000","last_clean":"2024-09-14T11:23:22.729795+0000","last_became_active":"2024-09-14T10:45:49.737651+0000","last_became_peered":"2024-09-14T10:45:49.737651+0000","last_unstale":"2024-09-14T11:23:22.729795+0000","last_undegraded":"2024-09-14T11:23:22.729795+0000","last_fullsized":"2024-09-14T11:23:22.729795+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'116","last_scrub_stamp":"2024-09-14T11:23:22.729700+0000","last_deep_scrub":"260'116","last_deep_scrub_stamp":"2024-09-14T11:23:22.729700+0000","last_clean_scrub_stamp":"2024-09-14T11:23:22.729700+0000","objects_scrubbed":6,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:57:47.520816+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":106,"num_write":82,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"260'809","reported_seq":4502,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:41.255626+0000","last_change":"2024-09-14T11:23:41.255626+0000","last_active":"2024-09-14T11:23:41.255626+0000","last_peered":"2024-09-14T11:23:41.255626+0000","last_clean":"2024-09-14T11:23:41.255626+0000","last_became_active":"2024-09-14T10:45:51.745441+0000","last_became_peered":"2024-09-14T10:45:51.745441+0000","last_unstale":"2024-09-14T11:23:41.255626+0000","last_undegraded":"2024-09-14T11:23:41.255626+0000","last_fullsized":"2024-09-14T11:23:41.255626+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'809","last_scrub_stamp":"2024-09-14T11:23:41.255544+0000","last_deep_scrub":"260'809","last_deep_scrub_stamp":"2024-09-14T11:23:41.255544+0000","last_clean_scrub_stamp":"2024-09-14T11:23:41.255544+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:12.499777+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"260'213","reported_seq":1027,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:22.441121+0000","last_change":"2024-09-14T11:23:22.441065+0000","last_active":"2024-09-14T11:23:22.441121+0000","last_peered":"2024-09-14T11:23:22.441121+0000","last_clean":"2024-09-14T11:23:22.441121+0000","last_became_active":"2024-09-14T10:45:53.753389+0000","last_became_peered":"2024-09-14T10:45:53.753389+0000","last_unstale":"2024-09-14T11:23:22.441121+0000","last_undegraded":"2024-09-14T11:23:22.441121+0000","last_fullsized":"2024-09-14T11:23:22.441121+0000","mapping_epoch":34,"log_start":"260'200","ondisk_log_start":"260'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'213","last_scrub_stamp":"2024-09-14T11:23:22.440984+0000","last_deep_scrub":"260'213","last_deep_scrub_stamp":"2024-09-14T11:23:22.440984+0000","last_clean_scrub_stamp":"2024-09-14T11:23:22.440984+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:20.195872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":623,"num_read_kb":614,"num_write":459,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"260'902","reported_seq":2545,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:12.363681+0000","last_change":"2024-09-14T11:23:12.363681+0000","last_active":"2024-09-14T11:23:12.363681+0000","last_peered":"2024-09-14T11:23:12.363681+0000","last_clean":"2024-09-14T11:23:12.363681+0000","last_became_active":"2024-09-14T10:45:45.725700+0000","last_became_peered":"2024-09-14T10:45:45.725700+0000","last_unstale":"2024-09-14T11:23:12.363681+0000","last_undegraded":"2024-09-14T11:23:12.363681+0000","last_fullsized":"2024-09-14T11:23:12.363681+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'902","last_scrub_stamp":"2024-09-14T11:23:12.363569+0000","last_deep_scrub":"260'902","last_deep_scrub_stamp":"2024-09-14T11:23:12.363569+0000","last_clean_scrub_stamp":"2024-09-14T11:23:12.363569+0000","objects_scrubbed":2,"log_size":102,"log_dups_size":800,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:00:47.995104+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4396,"num_read_kb":3931,"num_write":1208,"num_write_kb":463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2043,"num_omap_keys":8,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"260'381","reported_seq":1029,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:56.685332+0000","last_change":"2024-09-14T11:22:56.685284+0000","last_active":"2024-09-14T11:22:56.685332+0000","last_peered":"2024-09-14T11:22:56.685332+0000","last_clean":"2024-09-14T11:22:56.685332+0000","last_became_active":"2024-09-14T10:45:43.683274+0000","last_became_peered":"2024-09-14T10:45:43.683274+0000","last_unstale":"2024-09-14T11:22:56.685332+0000","last_undegraded":"2024-09-14T11:22:56.685332+0000","last_fullsized":"2024-09-14T11:22:56.685332+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'381","last_scrub_stamp":"2024-09-14T11:22:56.685220+0000","last_deep_scrub":"260'381","last_deep_scrub_stamp":"2024-09-14T11:22:56.685220+0000","last_clean_scrub_stamp":"2024-09-14T11:22:56.685220+0000","objects_scrubbed":4,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:15.447942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":697,"num_read_kb":4530,"num_write":1135,"num_write_kb":39150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":486,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:27.203464+0000","last_change":"2024-09-14T11:23:27.203464+0000","last_active":"2024-09-14T11:23:27.203464+0000","last_peered":"2024-09-14T11:23:27.203464+0000","last_clean":"2024-09-14T11:23:27.203464+0000","last_became_active":"2024-09-14T10:45:47.729004+0000","last_became_peered":"2024-09-14T10:45:47.729004+0000","last_unstale":"2024-09-14T11:23:27.203464+0000","last_undegraded":"2024-09-14T11:23:27.203464+0000","last_fullsized":"2024-09-14T11:23:27.203464+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:27.203341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:27.203341+0000","last_clean_scrub_stamp":"2024-09-14T11:23:27.203341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:41.034676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"260'260","reported_seq":812,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:11.406541+0000","last_change":"2024-09-14T11:23:11.406541+0000","last_active":"2024-09-14T11:23:11.406541+0000","last_peered":"2024-09-14T11:23:11.406541+0000","last_clean":"2024-09-14T11:23:11.406541+0000","last_became_active":"2024-09-14T10:45:49.728896+0000","last_became_peered":"2024-09-14T10:45:49.728896+0000","last_unstale":"2024-09-14T11:23:11.406541+0000","last_undegraded":"2024-09-14T11:23:11.406541+0000","last_fullsized":"2024-09-14T11:23:11.406541+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'260","last_scrub_stamp":"2024-09-14T11:23:11.406439+0000","last_deep_scrub":"260'260","last_deep_scrub_stamp":"2024-09-14T11:23:11.406439+0000","last_clean_scrub_stamp":"2024-09-14T11:23:11.406439+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:13.056696+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42620,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":444,"num_read_kb":1063,"num_write":366,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"260'805","reported_seq":3886,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:27.542342+0000","last_change":"2024-09-14T11:23:27.542342+0000","last_active":"2024-09-14T11:23:27.542342+0000","last_peered":"2024-09-14T11:23:27.542342+0000","last_clean":"2024-09-14T11:23:27.542342+0000","last_became_active":"2024-09-14T10:45:51.744510+0000","last_became_peered":"2024-09-14T10:45:51.744510+0000","last_unstale":"2024-09-14T11:23:27.542342+0000","last_undegraded":"2024-09-14T11:23:27.542342+0000","last_fullsized":"2024-09-14T11:23:27.542342+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'805","last_scrub_stamp":"2024-09-14T11:23:27.542254+0000","last_deep_scrub":"260'805","last_deep_scrub_stamp":"2024-09-14T11:23:27.542254+0000","last_clean_scrub_stamp":"2024-09-14T11:23:27.542254+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:20.313299+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"260'641","reported_seq":2336,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:13.170714+0000","last_change":"2024-09-14T11:23:13.170714+0000","last_active":"2024-09-14T11:23:13.170714+0000","last_peered":"2024-09-14T11:23:13.170714+0000","last_clean":"2024-09-14T11:23:13.170714+0000","last_became_active":"2024-09-14T10:45:45.716537+0000","last_became_peered":"2024-09-14T10:45:45.716537+0000","last_unstale":"2024-09-14T11:23:13.170714+0000","last_undegraded":"2024-09-14T11:23:13.170714+0000","last_fullsized":"2024-09-14T11:23:13.170714+0000","mapping_epoch":26,"log_start":"260'600","ondisk_log_start":"260'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'641","last_scrub_stamp":"2024-09-14T11:23:13.170614+0000","last_deep_scrub":"260'641","last_deep_scrub_stamp":"2024-09-14T11:23:13.170614+0000","last_clean_scrub_stamp":"2024-09-14T11:23:13.170614+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":600,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:09.840189+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3192,"num_read_kb":2926,"num_write":775,"num_write_kb":229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1720,"num_omap_keys":8,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"260'311","reported_seq":921,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:59.747594+0000","last_change":"2024-09-14T11:22:59.747594+0000","last_active":"2024-09-14T11:22:59.747594+0000","last_peered":"2024-09-14T11:22:59.747594+0000","last_clean":"2024-09-14T11:22:59.747594+0000","last_became_active":"2024-09-14T10:46:20.045945+0000","last_became_peered":"2024-09-14T10:46:20.045945+0000","last_unstale":"2024-09-14T11:22:59.747594+0000","last_undegraded":"2024-09-14T11:22:59.747594+0000","last_fullsized":"2024-09-14T11:22:59.747594+0000","mapping_epoch":37,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'311","last_scrub_stamp":"2024-09-14T11:22:59.747508+0000","last_deep_scrub":"260'311","last_deep_scrub_stamp":"2024-09-14T11:22:59.747508+0000","last_clean_scrub_stamp":"2024-09-14T11:22:59.747508+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":200,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:23.526580+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":633,"num_read_kb":12757,"num_write":988,"num_write_kb":36887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":494,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:10.598893+0000","last_change":"2024-09-14T11:23:10.598893+0000","last_active":"2024-09-14T11:23:10.598893+0000","last_peered":"2024-09-14T11:23:10.598893+0000","last_clean":"2024-09-14T11:23:10.598893+0000","last_became_active":"2024-09-14T10:45:47.720639+0000","last_became_peered":"2024-09-14T10:45:47.720639+0000","last_unstale":"2024-09-14T11:23:10.598893+0000","last_undegraded":"2024-09-14T11:23:10.598893+0000","last_fullsized":"2024-09-14T11:23:10.598893+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:10.598806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:10.598806+0000","last_clean_scrub_stamp":"2024-09-14T11:23:10.598806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:01.115042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"260'357","reported_seq":957,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:14.636173+0000","last_change":"2024-09-14T11:23:14.636173+0000","last_active":"2024-09-14T11:23:14.636173+0000","last_peered":"2024-09-14T11:23:14.636173+0000","last_clean":"2024-09-14T11:23:14.636173+0000","last_became_active":"2024-09-14T10:45:49.732754+0000","last_became_peered":"2024-09-14T10:45:49.732754+0000","last_unstale":"2024-09-14T11:23:14.636173+0000","last_undegraded":"2024-09-14T11:23:14.636173+0000","last_fullsized":"2024-09-14T11:23:14.636173+0000","mapping_epoch":30,"log_start":"260'300","ondisk_log_start":"260'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'357","last_scrub_stamp":"2024-09-14T11:23:14.636077+0000","last_deep_scrub":"260'357","last_deep_scrub_stamp":"2024-09-14T11:23:14.636077+0000","last_clean_scrub_stamp":"2024-09-14T11:23:14.636077+0000","objects_scrubbed":10,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:57.050795+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99406,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":572,"num_read_kb":1321,"num_write":460,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":480,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:21.214165+0000","last_change":"2024-09-14T11:23:21.214100+0000","last_active":"2024-09-14T11:23:21.214165+0000","last_peered":"2024-09-14T11:23:21.214165+0000","last_clean":"2024-09-14T11:23:21.214165+0000","last_became_active":"2024-09-14T10:45:51.746282+0000","last_became_peered":"2024-09-14T10:45:51.746282+0000","last_unstale":"2024-09-14T11:23:21.214165+0000","last_undegraded":"2024-09-14T11:23:21.214165+0000","last_fullsized":"2024-09-14T11:23:21.214165+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:21.214002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:21.214002+0000","last_clean_scrub_stamp":"2024-09-14T11:23:21.214002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:46.235673+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"260'562","reported_seq":1368,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:19.476331+0000","last_change":"2024-09-14T11:23:19.476270+0000","last_active":"2024-09-14T11:23:19.476331+0000","last_peered":"2024-09-14T11:23:19.476331+0000","last_clean":"2024-09-14T11:23:19.476331+0000","last_became_active":"2024-09-14T10:45:53.755505+0000","last_became_peered":"2024-09-14T10:45:53.755505+0000","last_unstale":"2024-09-14T11:23:19.476331+0000","last_undegraded":"2024-09-14T11:23:19.476331+0000","last_fullsized":"2024-09-14T11:23:19.476331+0000","mapping_epoch":34,"log_start":"260'500","ondisk_log_start":"260'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'562","last_scrub_stamp":"2024-09-14T11:23:19.476200+0000","last_deep_scrub":"260'562","last_deep_scrub_stamp":"2024-09-14T11:23:19.476200+0000","last_clean_scrub_stamp":"2024-09-14T11:23:19.476200+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":500,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:15.664428+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1310,"num_read_kb":1299,"num_write":1164,"num_write_kb":395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"260'608","reported_seq":2252,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:01.654181+0000","last_change":"2024-09-14T11:23:01.654181+0000","last_active":"2024-09-14T11:23:01.654181+0000","last_peered":"2024-09-14T11:23:01.654181+0000","last_clean":"2024-09-14T11:23:01.654181+0000","last_became_active":"2024-09-14T10:45:45.726869+0000","last_became_peered":"2024-09-14T10:45:45.726869+0000","last_unstale":"2024-09-14T11:23:01.654181+0000","last_undegraded":"2024-09-14T11:23:01.654181+0000","last_fullsized":"2024-09-14T11:23:01.654181+0000","mapping_epoch":26,"log_start":"260'500","ondisk_log_start":"260'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'608","last_scrub_stamp":"2024-09-14T11:23:01.654096+0000","last_deep_scrub":"260'608","last_deep_scrub_stamp":"2024-09-14T11:23:01.654096+0000","last_clean_scrub_stamp":"2024-09-14T11:23:01.654096+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":500,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:34.095164+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3274,"num_read_kb":2999,"num_write":839,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"260'390","reported_seq":1059,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:57.186338+0000","last_change":"2024-09-14T11:22:57.186256+0000","last_active":"2024-09-14T11:22:57.186338+0000","last_peered":"2024-09-14T11:22:57.186338+0000","last_clean":"2024-09-14T11:22:57.186338+0000","last_became_active":"2024-09-14T10:45:43.685087+0000","last_became_peered":"2024-09-14T10:45:43.685087+0000","last_unstale":"2024-09-14T11:22:57.186338+0000","last_undegraded":"2024-09-14T11:22:57.186338+0000","last_fullsized":"2024-09-14T11:22:57.186338+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'390","last_scrub_stamp":"2024-09-14T11:22:57.186147+0000","last_deep_scrub":"260'390","last_deep_scrub_stamp":"2024-09-14T11:22:57.186147+0000","last_clean_scrub_stamp":"2024-09-14T11:22:57.186147+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:33.020000+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":736,"num_read_kb":49067,"num_write":1293,"num_write_kb":21177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:11.277931+0000","last_change":"2024-09-14T11:23:11.277931+0000","last_active":"2024-09-14T11:23:11.277931+0000","last_peered":"2024-09-14T11:23:11.277931+0000","last_clean":"2024-09-14T11:23:11.277931+0000","last_became_active":"2024-09-14T10:45:47.727250+0000","last_became_peered":"2024-09-14T10:45:47.727250+0000","last_unstale":"2024-09-14T11:23:11.277931+0000","last_undegraded":"2024-09-14T11:23:11.277931+0000","last_fullsized":"2024-09-14T11:23:11.277931+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:11.277843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:11.277843+0000","last_clean_scrub_stamp":"2024-09-14T11:23:11.277843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:58:14.240440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"260'259","reported_seq":822,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:20.713683+0000","last_change":"2024-09-14T11:23:20.713621+0000","last_active":"2024-09-14T11:23:20.713683+0000","last_peered":"2024-09-14T11:23:20.713683+0000","last_clean":"2024-09-14T11:23:20.713683+0000","last_became_active":"2024-09-14T10:45:49.735124+0000","last_became_peered":"2024-09-14T10:45:49.735124+0000","last_unstale":"2024-09-14T11:23:20.713683+0000","last_undegraded":"2024-09-14T11:23:20.713683+0000","last_fullsized":"2024-09-14T11:23:20.713683+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'259","last_scrub_stamp":"2024-09-14T11:23:20.713538+0000","last_deep_scrub":"260'259","last_deep_scrub_stamp":"2024-09-14T11:23:20.713538+0000","last_clean_scrub_stamp":"2024-09-14T11:23:20.713538+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:07:37.494555+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45256,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":435,"num_read_kb":1035,"num_write":356,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":486,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:28.659376+0000","last_change":"2024-09-14T11:23:28.659376+0000","last_active":"2024-09-14T11:23:28.659376+0000","last_peered":"2024-09-14T11:23:28.659376+0000","last_clean":"2024-09-14T11:23:28.659376+0000","last_became_active":"2024-09-14T10:45:51.744757+0000","last_became_peered":"2024-09-14T10:45:51.744757+0000","last_unstale":"2024-09-14T11:23:28.659376+0000","last_undegraded":"2024-09-14T11:23:28.659376+0000","last_fullsized":"2024-09-14T11:23:28.659376+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:28.659275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:28.659275+0000","last_clean_scrub_stamp":"2024-09-14T11:23:28.659275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:33.963832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"260'2451","reported_seq":4270,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:22.593366+0000","last_change":"2024-09-14T11:23:22.593262+0000","last_active":"2024-09-14T11:23:22.593366+0000","last_peered":"2024-09-14T11:23:22.593366+0000","last_clean":"2024-09-14T11:23:22.593366+0000","last_became_active":"2024-09-14T10:45:53.752708+0000","last_became_peered":"2024-09-14T10:45:53.752708+0000","last_unstale":"2024-09-14T11:23:22.593366+0000","last_undegraded":"2024-09-14T11:23:22.593366+0000","last_fullsized":"2024-09-14T11:23:22.593366+0000","mapping_epoch":34,"log_start":"260'2400","ondisk_log_start":"260'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2451","last_scrub_stamp":"2024-09-14T11:23:22.593158+0000","last_deep_scrub":"260'2451","last_deep_scrub_stamp":"2024-09-14T11:23:22.593158+0000","last_clean_scrub_stamp":"2024-09-14T11:23:22.593158+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":2400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:55.784277+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6140,"num_read_kb":6145,"num_write":4932,"num_write_kb":1822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"260'761","reported_seq":2474,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:08.293507+0000","last_change":"2024-09-14T11:23:08.293507+0000","last_active":"2024-09-14T11:23:08.293507+0000","last_peered":"2024-09-14T11:23:08.293507+0000","last_clean":"2024-09-14T11:23:08.293507+0000","last_became_active":"2024-09-14T10:45:45.722006+0000","last_became_peered":"2024-09-14T10:45:45.722006+0000","last_unstale":"2024-09-14T11:23:08.293507+0000","last_undegraded":"2024-09-14T11:23:08.293507+0000","last_fullsized":"2024-09-14T11:23:08.293507+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'761","last_scrub_stamp":"2024-09-14T11:23:08.293416+0000","last_deep_scrub":"260'761","last_deep_scrub_stamp":"2024-09-14T11:23:08.293416+0000","last_clean_scrub_stamp":"2024-09-14T11:23:08.293416+0000","objects_scrubbed":4,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:13:56.536477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4059,"num_read_kb":3717,"num_write":984,"num_write_kb":359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4086,"num_omap_keys":16,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"260'375","reported_seq":1022,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:02.277112+0000","last_change":"2024-09-14T11:23:02.277049+0000","last_active":"2024-09-14T11:23:02.277112+0000","last_peered":"2024-09-14T11:23:02.277112+0000","last_clean":"2024-09-14T11:23:02.277112+0000","last_became_active":"2024-09-14T10:45:43.675954+0000","last_became_peered":"2024-09-14T10:45:43.675954+0000","last_unstale":"2024-09-14T11:23:02.277112+0000","last_undegraded":"2024-09-14T11:23:02.277112+0000","last_fullsized":"2024-09-14T11:23:02.277112+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'375","last_scrub_stamp":"2024-09-14T11:23:02.276946+0000","last_deep_scrub":"260'375","last_deep_scrub_stamp":"2024-09-14T11:23:02.276946+0000","last_clean_scrub_stamp":"2024-09-14T11:23:02.276946+0000","objects_scrubbed":6,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:47.616118+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":645,"num_read_kb":32892,"num_write":1136,"num_write_kb":70045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"260'6","reported_seq":968,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:19.375471+0000","last_change":"2024-09-14T11:23:19.375400+0000","last_active":"2024-09-14T11:23:19.375471+0000","last_peered":"2024-09-14T11:23:19.375471+0000","last_clean":"2024-09-14T11:23:19.375471+0000","last_became_active":"2024-09-14T10:45:47.723389+0000","last_became_peered":"2024-09-14T10:45:47.723389+0000","last_unstale":"2024-09-14T11:23:19.375471+0000","last_undegraded":"2024-09-14T11:23:19.375471+0000","last_fullsized":"2024-09-14T11:23:19.375471+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-14T11:23:19.375250+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-14T11:23:19.375250+0000","last_clean_scrub_stamp":"2024-09-14T11:23:19.375250+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:04:49.975519+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"260'279","reported_seq":848,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:30.260836+0000","last_change":"2024-09-14T11:23:30.260836+0000","last_active":"2024-09-14T11:23:30.260836+0000","last_peered":"2024-09-14T11:23:30.260836+0000","last_clean":"2024-09-14T11:23:30.260836+0000","last_became_active":"2024-09-14T10:45:49.729120+0000","last_became_peered":"2024-09-14T10:45:49.729120+0000","last_unstale":"2024-09-14T11:23:30.260836+0000","last_undegraded":"2024-09-14T11:23:30.260836+0000","last_fullsized":"2024-09-14T11:23:30.260836+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'279","last_scrub_stamp":"2024-09-14T11:23:30.260726+0000","last_deep_scrub":"260'279","last_deep_scrub_stamp":"2024-09-14T11:23:30.260726+0000","last_clean_scrub_stamp":"2024-09-14T11:23:30.260726+0000","objects_scrubbed":7,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:13:27.531076+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43970,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":444,"num_read_kb":984,"num_write":354,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"260'805","reported_seq":2513,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:26.502137+0000","last_change":"2024-09-14T11:23:26.502137+0000","last_active":"2024-09-14T11:23:26.502137+0000","last_peered":"2024-09-14T11:23:26.502137+0000","last_clean":"2024-09-14T11:23:26.502137+0000","last_became_active":"2024-09-14T10:45:51.744869+0000","last_became_peered":"2024-09-14T10:45:51.744869+0000","last_unstale":"2024-09-14T11:23:26.502137+0000","last_undegraded":"2024-09-14T11:23:26.502137+0000","last_fullsized":"2024-09-14T11:23:26.502137+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'805","last_scrub_stamp":"2024-09-14T11:23:26.502056+0000","last_deep_scrub":"260'805","last_deep_scrub_stamp":"2024-09-14T11:23:26.502056+0000","last_clean_scrub_stamp":"2024-09-14T11:23:26.502056+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:05.497437+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"260'166","reported_seq":648,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:22.233284+0000","last_change":"2024-09-14T11:23:22.233284+0000","last_active":"2024-09-14T11:23:22.233284+0000","last_peered":"2024-09-14T11:23:22.233284+0000","last_clean":"2024-09-14T11:23:22.233284+0000","last_became_active":"2024-09-14T10:45:53.755367+0000","last_became_peered":"2024-09-14T10:45:53.755367+0000","last_unstale":"2024-09-14T11:23:22.233284+0000","last_undegraded":"2024-09-14T11:23:22.233284+0000","last_fullsized":"2024-09-14T11:23:22.233284+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'166","last_scrub_stamp":"2024-09-14T11:23:22.233186+0000","last_deep_scrub":"260'166","last_deep_scrub_stamp":"2024-09-14T11:23:22.233186+0000","last_clean_scrub_stamp":"2024-09-14T11:23:22.233186+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:09.280581+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":815,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":135,"num_read_kb":134,"num_write":407,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"260'763","reported_seq":2263,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:10.356254+0000","last_change":"2024-09-14T11:23:10.356193+0000","last_active":"2024-09-14T11:23:10.356254+0000","last_peered":"2024-09-14T11:23:10.356254+0000","last_clean":"2024-09-14T11:23:10.356254+0000","last_became_active":"2024-09-14T10:45:45.719864+0000","last_became_peered":"2024-09-14T10:45:45.719864+0000","last_unstale":"2024-09-14T11:23:10.356254+0000","last_undegraded":"2024-09-14T11:23:10.356254+0000","last_fullsized":"2024-09-14T11:23:10.356254+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'763","last_scrub_stamp":"2024-09-14T11:23:10.356108+0000","last_deep_scrub":"260'763","last_deep_scrub_stamp":"2024-09-14T11:23:10.356108+0000","last_clean_scrub_stamp":"2024-09-14T11:23:10.356108+0000","objects_scrubbed":2,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:25:13.250358+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3610,"num_read_kb":3266,"num_write":990,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"260'352","reported_seq":986,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:56.642995+0000","last_change":"2024-09-14T11:22:56.642945+0000","last_active":"2024-09-14T11:22:56.642995+0000","last_peered":"2024-09-14T11:22:56.642995+0000","last_clean":"2024-09-14T11:22:56.642995+0000","last_became_active":"2024-09-14T10:45:43.681137+0000","last_became_peered":"2024-09-14T10:45:43.681137+0000","last_unstale":"2024-09-14T11:22:56.642995+0000","last_undegraded":"2024-09-14T11:22:56.642995+0000","last_fullsized":"2024-09-14T11:22:56.642995+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'352","last_scrub_stamp":"2024-09-14T11:22:56.642848+0000","last_deep_scrub":"260'352","last_deep_scrub_stamp":"2024-09-14T11:22:56.642848+0000","last_clean_scrub_stamp":"2024-09-14T11:22:56.642848+0000","objects_scrubbed":6,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:18.121328+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":525,"num_read_kb":31159,"num_write":1040,"num_write_kb":37353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:12.307193+0000","last_change":"2024-09-14T11:23:12.307193+0000","last_active":"2024-09-14T11:23:12.307193+0000","last_peered":"2024-09-14T11:23:12.307193+0000","last_clean":"2024-09-14T11:23:12.307193+0000","last_became_active":"2024-09-14T10:45:47.729815+0000","last_became_peered":"2024-09-14T10:45:47.729815+0000","last_unstale":"2024-09-14T11:23:12.307193+0000","last_undegraded":"2024-09-14T11:23:12.307193+0000","last_fullsized":"2024-09-14T11:23:12.307193+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:12.307094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:12.307094+0000","last_clean_scrub_stamp":"2024-09-14T11:23:12.307094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:08.115928+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"260'516","reported_seq":1140,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:23.707399+0000","last_change":"2024-09-14T11:23:23.707399+0000","last_active":"2024-09-14T11:23:23.707399+0000","last_peered":"2024-09-14T11:23:23.707399+0000","last_clean":"2024-09-14T11:23:23.707399+0000","last_became_active":"2024-09-14T10:45:49.735297+0000","last_became_peered":"2024-09-14T10:45:49.735297+0000","last_unstale":"2024-09-14T11:23:23.707399+0000","last_undegraded":"2024-09-14T11:23:23.707399+0000","last_fullsized":"2024-09-14T11:23:23.707399+0000","mapping_epoch":30,"log_start":"260'501","ondisk_log_start":"260'501","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'516","last_scrub_stamp":"2024-09-14T11:23:23.707297+0000","last_deep_scrub":"260'516","last_deep_scrub_stamp":"2024-09-14T11:23:23.707297+0000","last_clean_scrub_stamp":"2024-09-14T11:23:23.707297+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":501,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:06.016393+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93593,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":881,"num_read_kb":2160,"num_write":740,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":479,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:25.476382+0000","last_change":"2024-09-14T11:23:25.476382+0000","last_active":"2024-09-14T11:23:25.476382+0000","last_peered":"2024-09-14T11:23:25.476382+0000","last_clean":"2024-09-14T11:23:25.476382+0000","last_became_active":"2024-09-14T10:45:51.749045+0000","last_became_peered":"2024-09-14T10:45:51.749045+0000","last_unstale":"2024-09-14T11:23:25.476382+0000","last_undegraded":"2024-09-14T11:23:25.476382+0000","last_fullsized":"2024-09-14T11:23:25.476382+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:25.476290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:25.476290+0000","last_clean_scrub_stamp":"2024-09-14T11:23:25.476290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:09.435011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"260'127","reported_seq":640,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:21.718946+0000","last_change":"2024-09-14T11:23:21.718946+0000","last_active":"2024-09-14T11:23:21.718946+0000","last_peered":"2024-09-14T11:23:21.718946+0000","last_clean":"2024-09-14T11:23:21.718946+0000","last_became_active":"2024-09-14T10:45:53.751736+0000","last_became_peered":"2024-09-14T10:45:53.751736+0000","last_unstale":"2024-09-14T11:23:21.718946+0000","last_undegraded":"2024-09-14T11:23:21.718946+0000","last_fullsized":"2024-09-14T11:23:21.718946+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'127","last_scrub_stamp":"2024-09-14T11:23:21.718860+0000","last_deep_scrub":"260'127","last_deep_scrub_stamp":"2024-09-14T11:23:21.718860+0000","last_clean_scrub_stamp":"2024-09-14T11:23:21.718860+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:51:05.364854+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":704,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":191,"num_read_kb":171,"num_write":290,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"260'1192","reported_seq":2751,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:02.564376+0000","last_change":"2024-09-14T11:23:02.564306+0000","last_active":"2024-09-14T11:23:02.564376+0000","last_peered":"2024-09-14T11:23:02.564376+0000","last_clean":"2024-09-14T11:23:02.564376+0000","last_became_active":"2024-09-14T10:45:45.714723+0000","last_became_peered":"2024-09-14T10:45:45.714723+0000","last_unstale":"2024-09-14T11:23:02.564376+0000","last_undegraded":"2024-09-14T11:23:02.564376+0000","last_fullsized":"2024-09-14T11:23:02.564376+0000","mapping_epoch":26,"log_start":"260'1100","ondisk_log_start":"260'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1192","last_scrub_stamp":"2024-09-14T11:23:02.564228+0000","last_deep_scrub":"260'1192","last_deep_scrub_stamp":"2024-09-14T11:23:02.564228+0000","last_clean_scrub_stamp":"2024-09-14T11:23:02.564228+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":1100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:57.673628+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5470,"num_read_kb":4821,"num_write":1659,"num_write_kb":709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"260'368","reported_seq":1000,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:58.738255+0000","last_change":"2024-09-14T11:22:58.738182+0000","last_active":"2024-09-14T11:22:58.738255+0000","last_peered":"2024-09-14T11:22:58.738255+0000","last_clean":"2024-09-14T11:22:58.738255+0000","last_became_active":"2024-09-14T10:45:43.686531+0000","last_became_peered":"2024-09-14T10:45:43.686531+0000","last_unstale":"2024-09-14T11:22:58.738255+0000","last_undegraded":"2024-09-14T11:22:58.738255+0000","last_fullsized":"2024-09-14T11:22:58.738255+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'368","last_scrub_stamp":"2024-09-14T11:22:58.738083+0000","last_deep_scrub":"260'368","last_deep_scrub_stamp":"2024-09-14T11:22:58.738083+0000","last_clean_scrub_stamp":"2024-09-14T11:22:58.738083+0000","objects_scrubbed":5,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:58:54.493504+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133692,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":671,"num_read_kb":7607,"num_write":1262,"num_write_kb":48356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":490,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:11.697969+0000","last_change":"2024-09-14T11:23:11.697908+0000","last_active":"2024-09-14T11:23:11.697969+0000","last_peered":"2024-09-14T11:23:11.697969+0000","last_clean":"2024-09-14T11:23:11.697969+0000","last_became_active":"2024-09-14T10:45:47.728213+0000","last_became_peered":"2024-09-14T10:45:47.728213+0000","last_unstale":"2024-09-14T11:23:11.697969+0000","last_undegraded":"2024-09-14T11:23:11.697969+0000","last_fullsized":"2024-09-14T11:23:11.697969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:11.697822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:11.697822+0000","last_clean_scrub_stamp":"2024-09-14T11:23:11.697822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:14:58.462465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"260'269","reported_seq":835,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:15.532823+0000","last_change":"2024-09-14T11:23:15.532763+0000","last_active":"2024-09-14T11:23:15.532823+0000","last_peered":"2024-09-14T11:23:15.532823+0000","last_clean":"2024-09-14T11:23:15.532823+0000","last_became_active":"2024-09-14T10:45:49.732813+0000","last_became_peered":"2024-09-14T10:45:49.732813+0000","last_unstale":"2024-09-14T11:23:15.532823+0000","last_undegraded":"2024-09-14T11:23:15.532823+0000","last_fullsized":"2024-09-14T11:23:15.532823+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'269","last_scrub_stamp":"2024-09-14T11:23:15.532664+0000","last_deep_scrub":"260'269","last_deep_scrub_stamp":"2024-09-14T11:23:15.532664+0000","last_clean_scrub_stamp":"2024-09-14T11:23:15.532664+0000","objects_scrubbed":7,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:03.580995+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14232,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":431,"num_read_kb":915,"num_write":388,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":482,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:15.618874+0000","last_change":"2024-09-14T11:23:15.618806+0000","last_active":"2024-09-14T11:23:15.618874+0000","last_peered":"2024-09-14T11:23:15.618874+0000","last_clean":"2024-09-14T11:23:15.618874+0000","last_became_active":"2024-09-14T10:45:51.748381+0000","last_became_peered":"2024-09-14T10:45:51.748381+0000","last_unstale":"2024-09-14T11:23:15.618874+0000","last_undegraded":"2024-09-14T11:23:15.618874+0000","last_fullsized":"2024-09-14T11:23:15.618874+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:15.618720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:15.618720+0000","last_clean_scrub_stamp":"2024-09-14T11:23:15.618720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:33:06.847139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"260'101","reported_seq":579,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:29.538732+0000","last_change":"2024-09-14T11:23:29.538661+0000","last_active":"2024-09-14T11:23:29.538732+0000","last_peered":"2024-09-14T11:23:29.538732+0000","last_clean":"2024-09-14T11:23:29.538732+0000","last_became_active":"2024-09-14T10:45:53.755022+0000","last_became_peered":"2024-09-14T10:45:53.755022+0000","last_unstale":"2024-09-14T11:23:29.538732+0000","last_undegraded":"2024-09-14T11:23:29.538732+0000","last_fullsized":"2024-09-14T11:23:29.538732+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'101","last_scrub_stamp":"2024-09-14T11:23:29.538571+0000","last_deep_scrub":"260'101","last_deep_scrub_stamp":"2024-09-14T11:23:29.538571+0000","last_clean_scrub_stamp":"2024-09-14T11:23:29.538571+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:37.419182+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":73,"num_read_kb":72,"num_write":223,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"260'436","reported_seq":1985,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:15.257995+0000","last_change":"2024-09-14T11:23:15.257923+0000","last_active":"2024-09-14T11:23:15.257995+0000","last_peered":"2024-09-14T11:23:15.257995+0000","last_clean":"2024-09-14T11:23:15.257995+0000","last_became_active":"2024-09-14T10:45:45.710367+0000","last_became_peered":"2024-09-14T10:45:45.710367+0000","last_unstale":"2024-09-14T11:23:15.257995+0000","last_undegraded":"2024-09-14T11:23:15.257995+0000","last_fullsized":"2024-09-14T11:23:15.257995+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'436","last_scrub_stamp":"2024-09-14T11:23:15.257828+0000","last_deep_scrub":"260'436","last_deep_scrub_stamp":"2024-09-14T11:23:15.257828+0000","last_clean_scrub_stamp":"2024-09-14T11:23:15.257828+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:59.527838+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2526,"num_read_kb":2387,"num_write":527,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"260'332","reported_seq":1023,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:01.297073+0000","last_change":"2024-09-14T11:23:01.297073+0000","last_active":"2024-09-14T11:23:01.297073+0000","last_peered":"2024-09-14T11:23:01.297073+0000","last_clean":"2024-09-14T11:23:01.297073+0000","last_became_active":"2024-09-14T10:45:43.676514+0000","last_became_peered":"2024-09-14T10:45:43.676514+0000","last_unstale":"2024-09-14T11:23:01.297073+0000","last_undegraded":"2024-09-14T11:23:01.297073+0000","last_fullsized":"2024-09-14T11:23:01.297073+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'332","last_scrub_stamp":"2024-09-14T11:23:01.296956+0000","last_deep_scrub":"260'332","last_deep_scrub_stamp":"2024-09-14T11:23:01.296956+0000","last_clean_scrub_stamp":"2024-09-14T11:23:01.296956+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:31.917595+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174780,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":649,"num_read_kb":125837,"num_write":1068,"num_write_kb":34909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:20.406145+0000","last_change":"2024-09-14T11:23:20.406091+0000","last_active":"2024-09-14T11:23:20.406145+0000","last_peered":"2024-09-14T11:23:20.406145+0000","last_clean":"2024-09-14T11:23:20.406145+0000","last_became_active":"2024-09-14T10:45:47.727632+0000","last_became_peered":"2024-09-14T10:45:47.727632+0000","last_unstale":"2024-09-14T11:23:20.406145+0000","last_undegraded":"2024-09-14T11:23:20.406145+0000","last_fullsized":"2024-09-14T11:23:20.406145+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:20.406006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:20.406006+0000","last_clean_scrub_stamp":"2024-09-14T11:23:20.406006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:21:58.043972+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"260'299","reported_seq":867,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:22.413247+0000","last_change":"2024-09-14T11:23:22.413178+0000","last_active":"2024-09-14T11:23:22.413247+0000","last_peered":"2024-09-14T11:23:22.413247+0000","last_clean":"2024-09-14T11:23:22.413247+0000","last_became_active":"2024-09-14T10:45:49.737690+0000","last_became_peered":"2024-09-14T10:45:49.737690+0000","last_unstale":"2024-09-14T11:23:22.413247+0000","last_undegraded":"2024-09-14T11:23:22.413247+0000","last_fullsized":"2024-09-14T11:23:22.413247+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'299","last_scrub_stamp":"2024-09-14T11:23:22.413077+0000","last_deep_scrub":"260'299","last_deep_scrub_stamp":"2024-09-14T11:23:22.413077+0000","last_clean_scrub_stamp":"2024-09-14T11:23:22.413077+0000","objects_scrubbed":7,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:29.181172+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69554,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":489,"num_read_kb":1163,"num_write":398,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"260'778","reported_seq":2029,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:14.637393+0000","last_change":"2024-09-14T11:23:14.637328+0000","last_active":"2024-09-14T11:23:14.637393+0000","last_peered":"2024-09-14T11:23:14.637393+0000","last_clean":"2024-09-14T11:23:14.637393+0000","last_became_active":"2024-09-14T10:45:51.749478+0000","last_became_peered":"2024-09-14T10:45:51.749478+0000","last_unstale":"2024-09-14T11:23:14.637393+0000","last_undegraded":"2024-09-14T11:23:14.637393+0000","last_fullsized":"2024-09-14T11:23:14.637393+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'778","last_scrub_stamp":"2024-09-14T11:23:14.637243+0000","last_deep_scrub":"260'778","last_deep_scrub_stamp":"2024-09-14T11:23:14.637243+0000","last_clean_scrub_stamp":"2024-09-14T11:23:14.637243+0000","objects_scrubbed":1,"log_size":78,"log_dups_size":700,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:52.460981+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"260'132","reported_seq":622,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:19.230569+0000","last_change":"2024-09-14T11:23:19.230503+0000","last_active":"2024-09-14T11:23:19.230569+0000","last_peered":"2024-09-14T11:23:19.230569+0000","last_clean":"2024-09-14T11:23:19.230569+0000","last_became_active":"2024-09-14T10:45:53.746254+0000","last_became_peered":"2024-09-14T10:45:53.746254+0000","last_unstale":"2024-09-14T11:23:19.230569+0000","last_undegraded":"2024-09-14T11:23:19.230569+0000","last_fullsized":"2024-09-14T11:23:19.230569+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'132","last_scrub_stamp":"2024-09-14T11:23:19.230403+0000","last_deep_scrub":"260'132","last_deep_scrub_stamp":"2024-09-14T11:23:19.230403+0000","last_clean_scrub_stamp":"2024-09-14T11:23:19.230403+0000","objects_scrubbed":4,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:11.653373+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1445,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":145,"num_read_kb":134,"num_write":327,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"260'484","reported_seq":2064,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:03.211306+0000","last_change":"2024-09-14T11:23:03.211250+0000","last_active":"2024-09-14T11:23:03.211306+0000","last_peered":"2024-09-14T11:23:03.211306+0000","last_clean":"2024-09-14T11:23:03.211306+0000","last_became_active":"2024-09-14T10:45:45.720660+0000","last_became_peered":"2024-09-14T10:45:45.720660+0000","last_unstale":"2024-09-14T11:23:03.211306+0000","last_undegraded":"2024-09-14T11:23:03.211306+0000","last_fullsized":"2024-09-14T11:23:03.211306+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'484","last_scrub_stamp":"2024-09-14T11:23:03.211174+0000","last_deep_scrub":"260'484","last_deep_scrub_stamp":"2024-09-14T11:23:03.211174+0000","last_clean_scrub_stamp":"2024-09-14T11:23:03.211174+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:30.932990+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2593,"num_read_kb":2426,"num_write":578,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"260'355","reported_seq":971,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:03.251849+0000","last_change":"2024-09-14T11:23:03.251849+0000","last_active":"2024-09-14T11:23:03.251849+0000","last_peered":"2024-09-14T11:23:03.251849+0000","last_clean":"2024-09-14T11:23:03.251849+0000","last_became_active":"2024-09-14T10:45:43.690517+0000","last_became_peered":"2024-09-14T10:45:43.690517+0000","last_unstale":"2024-09-14T11:23:03.251849+0000","last_undegraded":"2024-09-14T11:23:03.251849+0000","last_fullsized":"2024-09-14T11:23:03.251849+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'355","last_scrub_stamp":"2024-09-14T11:23:03.251741+0000","last_deep_scrub":"260'355","last_deep_scrub_stamp":"2024-09-14T11:23:03.251741+0000","last_clean_scrub_stamp":"2024-09-14T11:23:03.251741+0000","objects_scrubbed":9,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:26.884843+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267379,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":525,"num_read_kb":51932,"num_write":1051,"num_write_kb":23808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"260'4","reported_seq":1451,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:12.602590+0000","last_change":"2024-09-14T11:23:12.602532+0000","last_active":"2024-09-14T11:23:12.602590+0000","last_peered":"2024-09-14T11:23:12.602590+0000","last_clean":"2024-09-14T11:23:12.602590+0000","last_became_active":"2024-09-14T10:45:47.720716+0000","last_became_peered":"2024-09-14T10:45:47.720716+0000","last_unstale":"2024-09-14T11:23:12.602590+0000","last_undegraded":"2024-09-14T11:23:12.602590+0000","last_fullsized":"2024-09-14T11:23:12.602590+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-14T11:23:12.602439+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-14T11:23:12.602439+0000","last_clean_scrub_stamp":"2024-09-14T11:23:12.602439+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:13:05.573930+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":953,"num_read_kb":953,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"260'73","reported_seq":577,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:24.289973+0000","last_change":"2024-09-14T11:23:24.289915+0000","last_active":"2024-09-14T11:23:24.289973+0000","last_peered":"2024-09-14T11:23:24.289973+0000","last_clean":"2024-09-14T11:23:24.289973+0000","last_became_active":"2024-09-14T10:45:49.732913+0000","last_became_peered":"2024-09-14T10:45:49.732913+0000","last_unstale":"2024-09-14T11:23:24.289973+0000","last_undegraded":"2024-09-14T11:23:24.289973+0000","last_fullsized":"2024-09-14T11:23:24.289973+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'73","last_scrub_stamp":"2024-09-14T11:23:24.289827+0000","last_deep_scrub":"260'73","last_deep_scrub_stamp":"2024-09-14T11:23:24.289827+0000","last_clean_scrub_stamp":"2024-09-14T11:23:24.289827+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:30.218833+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":64,"num_read_kb":57,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"260'797","reported_seq":2423,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:18.572590+0000","last_change":"2024-09-14T11:23:18.572515+0000","last_active":"2024-09-14T11:23:18.572590+0000","last_peered":"2024-09-14T11:23:18.572590+0000","last_clean":"2024-09-14T11:23:18.572590+0000","last_became_active":"2024-09-14T10:45:51.741102+0000","last_became_peered":"2024-09-14T10:45:51.741102+0000","last_unstale":"2024-09-14T11:23:18.572590+0000","last_undegraded":"2024-09-14T11:23:18.572590+0000","last_fullsized":"2024-09-14T11:23:18.572590+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'797","last_scrub_stamp":"2024-09-14T11:23:18.572420+0000","last_deep_scrub":"260'797","last_deep_scrub_stamp":"2024-09-14T11:23:18.572420+0000","last_clean_scrub_stamp":"2024-09-14T11:23:18.572420+0000","objects_scrubbed":1,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:22:02.078595+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"260'153","reported_seq":668,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:20.508622+0000","last_change":"2024-09-14T11:23:20.508558+0000","last_active":"2024-09-14T11:23:20.508622+0000","last_peered":"2024-09-14T11:23:20.508622+0000","last_clean":"2024-09-14T11:23:20.508622+0000","last_became_active":"2024-09-14T10:45:53.752100+0000","last_became_peered":"2024-09-14T10:45:53.752100+0000","last_unstale":"2024-09-14T11:23:20.508622+0000","last_undegraded":"2024-09-14T11:23:20.508622+0000","last_fullsized":"2024-09-14T11:23:20.508622+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'153","last_scrub_stamp":"2024-09-14T11:23:20.508469+0000","last_deep_scrub":"260'153","last_deep_scrub_stamp":"2024-09-14T11:23:20.508469+0000","last_clean_scrub_stamp":"2024-09-14T11:23:20.508469+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:34.442103+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":861,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":268,"num_read_kb":228,"num_write":378,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"260'470","reported_seq":2080,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:02.791301+0000","last_change":"2024-09-14T11:23:02.791198+0000","last_active":"2024-09-14T11:23:02.791301+0000","last_peered":"2024-09-14T11:23:02.791301+0000","last_clean":"2024-09-14T11:23:02.791301+0000","last_became_active":"2024-09-14T10:45:45.719221+0000","last_became_peered":"2024-09-14T10:45:45.719221+0000","last_unstale":"2024-09-14T11:23:02.791301+0000","last_undegraded":"2024-09-14T11:23:02.791301+0000","last_fullsized":"2024-09-14T11:23:02.791301+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'470","last_scrub_stamp":"2024-09-14T11:23:02.791102+0000","last_deep_scrub":"260'470","last_deep_scrub_stamp":"2024-09-14T11:23:02.791102+0000","last_clean_scrub_stamp":"2024-09-14T11:23:02.791102+0000","objects_scrubbed":2,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:33:44.209906+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2509,"num_read_kb":2365,"num_write":566,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":467,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"260'322","reported_seq":932,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:59.033947+0000","last_change":"2024-09-14T11:22:59.033947+0000","last_active":"2024-09-14T11:22:59.033947+0000","last_peered":"2024-09-14T11:22:59.033947+0000","last_clean":"2024-09-14T11:22:59.033947+0000","last_became_active":"2024-09-14T10:45:43.690417+0000","last_became_peered":"2024-09-14T10:45:43.690417+0000","last_unstale":"2024-09-14T11:22:59.033947+0000","last_undegraded":"2024-09-14T11:22:59.033947+0000","last_fullsized":"2024-09-14T11:22:59.033947+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'322","last_scrub_stamp":"2024-09-14T11:22:59.033852+0000","last_deep_scrub":"260'322","last_deep_scrub_stamp":"2024-09-14T11:22:59.033852+0000","last_clean_scrub_stamp":"2024-09-14T11:22:59.033852+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:02.624805+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":503,"num_read_kb":28260,"num_write":967,"num_write_kb":36225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:24.159981+0000","last_change":"2024-09-14T11:23:24.159861+0000","last_active":"2024-09-14T11:23:24.159981+0000","last_peered":"2024-09-14T11:23:24.159981+0000","last_clean":"2024-09-14T11:23:24.159981+0000","last_became_active":"2024-09-14T10:45:47.730790+0000","last_became_peered":"2024-09-14T10:45:47.730790+0000","last_unstale":"2024-09-14T11:23:24.159981+0000","last_undegraded":"2024-09-14T11:23:24.159981+0000","last_fullsized":"2024-09-14T11:23:24.159981+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:24.159725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:24.159725+0000","last_clean_scrub_stamp":"2024-09-14T11:23:24.159725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:30.358278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"260'331","reported_seq":926,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:14.556155+0000","last_change":"2024-09-14T11:23:14.556096+0000","last_active":"2024-09-14T11:23:14.556155+0000","last_peered":"2024-09-14T11:23:14.556155+0000","last_clean":"2024-09-14T11:23:14.556155+0000","last_became_active":"2024-09-14T10:45:49.735482+0000","last_became_peered":"2024-09-14T10:45:49.735482+0000","last_unstale":"2024-09-14T11:23:14.556155+0000","last_undegraded":"2024-09-14T11:23:14.556155+0000","last_fullsized":"2024-09-14T11:23:14.556155+0000","mapping_epoch":30,"log_start":"260'300","ondisk_log_start":"260'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'331","last_scrub_stamp":"2024-09-14T11:23:14.555977+0000","last_deep_scrub":"260'331","last_deep_scrub_stamp":"2024-09-14T11:23:14.555977+0000","last_clean_scrub_stamp":"2024-09-14T11:23:14.555977+0000","objects_scrubbed":8,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:18.071778+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46045,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":538,"num_read_kb":1149,"num_write":426,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":477,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:12.387070+0000","last_change":"2024-09-14T11:23:12.387005+0000","last_active":"2024-09-14T11:23:12.387070+0000","last_peered":"2024-09-14T11:23:12.387070+0000","last_clean":"2024-09-14T11:23:12.387070+0000","last_became_active":"2024-09-14T10:45:51.750669+0000","last_became_peered":"2024-09-14T10:45:51.750669+0000","last_unstale":"2024-09-14T11:23:12.387070+0000","last_undegraded":"2024-09-14T11:23:12.387070+0000","last_fullsized":"2024-09-14T11:23:12.387070+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:12.386872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:12.386872+0000","last_clean_scrub_stamp":"2024-09-14T11:23:12.386872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:17.249546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"260'121","reported_seq":606,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:20.690257+0000","last_change":"2024-09-14T11:23:20.690198+0000","last_active":"2024-09-14T11:23:20.690257+0000","last_peered":"2024-09-14T11:23:20.690257+0000","last_clean":"2024-09-14T11:23:20.690257+0000","last_became_active":"2024-09-14T10:45:53.748865+0000","last_became_peered":"2024-09-14T10:45:53.748865+0000","last_unstale":"2024-09-14T11:23:20.690257+0000","last_undegraded":"2024-09-14T11:23:20.690257+0000","last_fullsized":"2024-09-14T11:23:20.690257+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'121","last_scrub_stamp":"2024-09-14T11:23:20.690102+0000","last_deep_scrub":"260'121","last_deep_scrub_stamp":"2024-09-14T11:23:20.690102+0000","last_clean_scrub_stamp":"2024-09-14T11:23:20.690102+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:13:31.152731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":448,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":116,"num_write":279,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"260'614","reported_seq":2414,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:14.210822+0000","last_change":"2024-09-14T11:23:14.210717+0000","last_active":"2024-09-14T11:23:14.210822+0000","last_peered":"2024-09-14T11:23:14.210822+0000","last_clean":"2024-09-14T11:23:14.210822+0000","last_became_active":"2024-09-14T10:45:45.716236+0000","last_became_peered":"2024-09-14T10:45:45.716236+0000","last_unstale":"2024-09-14T11:23:14.210822+0000","last_undegraded":"2024-09-14T11:23:14.210822+0000","last_fullsized":"2024-09-14T11:23:14.210822+0000","mapping_epoch":26,"log_start":"260'600","ondisk_log_start":"260'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'614","last_scrub_stamp":"2024-09-14T11:23:14.210620+0000","last_deep_scrub":"260'614","last_deep_scrub_stamp":"2024-09-14T11:23:14.210620+0000","last_clean_scrub_stamp":"2024-09-14T11:23:14.210620+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":600,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:38:26.756269+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3315,"num_read_kb":3084,"num_write":730,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"260'74","reported_seq":612,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:55.699802+0000","last_change":"2024-09-14T11:22:55.699728+0000","last_active":"2024-09-14T11:22:55.699802+0000","last_peered":"2024-09-14T11:22:55.699802+0000","last_clean":"2024-09-14T11:22:55.699802+0000","last_became_active":"2024-09-14T10:45:28.985499+0000","last_became_peered":"2024-09-14T10:45:28.985499+0000","last_unstale":"2024-09-14T11:22:55.699802+0000","last_undegraded":"2024-09-14T11:22:55.699802+0000","last_fullsized":"2024-09-14T11:22:55.699802+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'74","last_scrub_stamp":"2024-09-14T11:22:55.699647+0000","last_deep_scrub":"260'74","last_deep_scrub_stamp":"2024-09-14T11:22:55.699647+0000","last_clean_scrub_stamp":"2024-09-14T11:22:55.699647+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:04.417375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"260'2","reported_seq":514,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:58.303627+0000","last_change":"2024-09-14T11:22:58.303578+0000","last_active":"2024-09-14T11:22:58.303627+0000","last_peered":"2024-09-14T11:22:58.303627+0000","last_clean":"2024-09-14T11:22:58.303627+0000","last_became_active":"2024-09-14T10:45:33.610592+0000","last_became_peered":"2024-09-14T10:45:33.610592+0000","last_unstale":"2024-09-14T11:22:58.303627+0000","last_undegraded":"2024-09-14T11:22:58.303627+0000","last_fullsized":"2024-09-14T11:22:58.303627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:22:58.303510+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:22:58.303510+0000","last_clean_scrub_stamp":"2024-09-14T11:22:58.303510+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:42.914407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043055799999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"260'280","reported_seq":928,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:57.084934+0000","last_change":"2024-09-14T11:22:57.084842+0000","last_active":"2024-09-14T11:22:57.084934+0000","last_peered":"2024-09-14T11:22:57.084934+0000","last_clean":"2024-09-14T11:22:57.084934+0000","last_became_active":"2024-09-14T10:45:43.690248+0000","last_became_peered":"2024-09-14T10:45:43.690248+0000","last_unstale":"2024-09-14T11:22:57.084934+0000","last_undegraded":"2024-09-14T11:22:57.084934+0000","last_fullsized":"2024-09-14T11:22:57.084934+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'280","last_scrub_stamp":"2024-09-14T11:22:57.084704+0000","last_deep_scrub":"260'280","last_deep_scrub_stamp":"2024-09-14T11:22:57.084704+0000","last_clean_scrub_stamp":"2024-09-14T11:22:57.084704+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:34.397521+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":552,"num_read_kb":56771,"num_write":951,"num_write_kb":24880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":496,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:11.598716+0000","last_change":"2024-09-14T11:23:11.598638+0000","last_active":"2024-09-14T11:23:11.598716+0000","last_peered":"2024-09-14T11:23:11.598716+0000","last_clean":"2024-09-14T11:23:11.598716+0000","last_became_active":"2024-09-14T10:45:47.723495+0000","last_became_peered":"2024-09-14T10:45:47.723495+0000","last_unstale":"2024-09-14T11:23:11.598716+0000","last_undegraded":"2024-09-14T11:23:11.598716+0000","last_fullsized":"2024-09-14T11:23:11.598716+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:11.598555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:11.598555+0000","last_clean_scrub_stamp":"2024-09-14T11:23:11.598555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:36:22.236009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"260'749","reported_seq":1440,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:28.247996+0000","last_change":"2024-09-14T11:23:28.247996+0000","last_active":"2024-09-14T11:23:28.247996+0000","last_peered":"2024-09-14T11:23:28.247996+0000","last_clean":"2024-09-14T11:23:28.247996+0000","last_became_active":"2024-09-14T10:45:49.733774+0000","last_became_peered":"2024-09-14T10:45:49.733774+0000","last_unstale":"2024-09-14T11:23:28.247996+0000","last_undegraded":"2024-09-14T11:23:28.247996+0000","last_fullsized":"2024-09-14T11:23:28.247996+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'749","last_scrub_stamp":"2024-09-14T11:23:28.247895+0000","last_deep_scrub":"260'749","last_deep_scrub_stamp":"2024-09-14T11:23:28.247895+0000","last_clean_scrub_stamp":"2024-09-14T11:23:28.247895+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":700,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:06.175200+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152864,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1479,"num_read_kb":3507,"num_write":1366,"num_write_kb":1223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89312,"num_omap_keys":214,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":479,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:24.452245+0000","last_change":"2024-09-14T11:23:24.452245+0000","last_active":"2024-09-14T11:23:24.452245+0000","last_peered":"2024-09-14T11:23:24.452245+0000","last_clean":"2024-09-14T11:23:24.452245+0000","last_became_active":"2024-09-14T10:45:51.745607+0000","last_became_peered":"2024-09-14T10:45:51.745607+0000","last_unstale":"2024-09-14T11:23:24.452245+0000","last_undegraded":"2024-09-14T11:23:24.452245+0000","last_fullsized":"2024-09-14T11:23:24.452245+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:24.452118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:24.452118+0000","last_clean_scrub_stamp":"2024-09-14T11:23:24.452118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:31.791825+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"260'237","reported_seq":933,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:19.622332+0000","last_change":"2024-09-14T11:23:19.622332+0000","last_active":"2024-09-14T11:23:19.622332+0000","last_peered":"2024-09-14T11:23:19.622332+0000","last_clean":"2024-09-14T11:23:19.622332+0000","last_became_active":"2024-09-14T10:45:53.751651+0000","last_became_peered":"2024-09-14T10:45:53.751651+0000","last_unstale":"2024-09-14T11:23:19.622332+0000","last_undegraded":"2024-09-14T11:23:19.622332+0000","last_fullsized":"2024-09-14T11:23:19.622332+0000","mapping_epoch":34,"log_start":"260'200","ondisk_log_start":"260'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'237","last_scrub_stamp":"2024-09-14T11:23:19.622263+0000","last_deep_scrub":"260'237","last_deep_scrub_stamp":"2024-09-14T11:23:19.622263+0000","last_clean_scrub_stamp":"2024-09-14T11:23:19.622263+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:09.518382+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":417,"num_read_kb":415,"num_write":468,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"260'501","reported_seq":2088,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:11.358264+0000","last_change":"2024-09-14T11:23:11.358264+0000","last_active":"2024-09-14T11:23:11.358264+0000","last_peered":"2024-09-14T11:23:11.358264+0000","last_clean":"2024-09-14T11:23:11.358264+0000","last_became_active":"2024-09-14T10:45:45.721633+0000","last_became_peered":"2024-09-14T10:45:45.721633+0000","last_unstale":"2024-09-14T11:23:11.358264+0000","last_undegraded":"2024-09-14T11:23:11.358264+0000","last_fullsized":"2024-09-14T11:23:11.358264+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'501","last_scrub_stamp":"2024-09-14T11:23:11.358175+0000","last_deep_scrub":"260'501","last_deep_scrub_stamp":"2024-09-14T11:23:11.358175+0000","last_clean_scrub_stamp":"2024-09-14T11:23:11.358175+0000","objects_scrubbed":1,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:36.475272+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2741,"num_read_kb":2557,"num_write":632,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":513,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:57.303611+0000","last_change":"2024-09-14T11:22:57.303538+0000","last_active":"2024-09-14T11:22:57.303611+0000","last_peered":"2024-09-14T11:22:57.303611+0000","last_clean":"2024-09-14T11:22:57.303611+0000","last_became_active":"2024-09-14T10:45:33.569860+0000","last_became_peered":"2024-09-14T10:45:33.569860+0000","last_unstale":"2024-09-14T11:22:57.303611+0000","last_undegraded":"2024-09-14T11:22:57.303611+0000","last_fullsized":"2024-09-14T11:22:57.303611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:57.303456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:57.303456+0000","last_clean_scrub_stamp":"2024-09-14T11:22:57.303456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:48:58.728224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074400599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"260'335","reported_seq":973,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:58.571020+0000","last_change":"2024-09-14T11:22:58.570951+0000","last_active":"2024-09-14T11:22:58.571020+0000","last_peered":"2024-09-14T11:22:58.571020+0000","last_clean":"2024-09-14T11:22:58.571020+0000","last_became_active":"2024-09-14T10:45:43.680290+0000","last_became_peered":"2024-09-14T10:45:43.680290+0000","last_unstale":"2024-09-14T11:22:58.571020+0000","last_undegraded":"2024-09-14T11:22:58.571020+0000","last_fullsized":"2024-09-14T11:22:58.571020+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'335","last_scrub_stamp":"2024-09-14T11:22:58.570853+0000","last_deep_scrub":"260'335","last_deep_scrub_stamp":"2024-09-14T11:22:58.570853+0000","last_clean_scrub_stamp":"2024-09-14T11:22:58.570853+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:26.761580+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":649,"num_read_kb":19207,"num_write":1098,"num_write_kb":41133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:23.187737+0000","last_change":"2024-09-14T11:23:23.187737+0000","last_active":"2024-09-14T11:23:23.187737+0000","last_peered":"2024-09-14T11:23:23.187737+0000","last_clean":"2024-09-14T11:23:23.187737+0000","last_became_active":"2024-09-14T10:45:47.727733+0000","last_became_peered":"2024-09-14T10:45:47.727733+0000","last_unstale":"2024-09-14T11:23:23.187737+0000","last_undegraded":"2024-09-14T11:23:23.187737+0000","last_fullsized":"2024-09-14T11:23:23.187737+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:23.187645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:23.187645+0000","last_clean_scrub_stamp":"2024-09-14T11:23:23.187645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:02.771437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"260'1255","reported_seq":2627,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:19.650058+0000","last_change":"2024-09-14T11:23:19.649977+0000","last_active":"2024-09-14T11:23:19.650058+0000","last_peered":"2024-09-14T11:23:19.650058+0000","last_clean":"2024-09-14T11:23:19.650058+0000","last_became_active":"2024-09-14T10:45:49.731646+0000","last_became_peered":"2024-09-14T10:45:49.731646+0000","last_unstale":"2024-09-14T11:23:19.650058+0000","last_undegraded":"2024-09-14T11:23:19.650058+0000","last_fullsized":"2024-09-14T11:23:19.650058+0000","mapping_epoch":30,"log_start":"260'1200","ondisk_log_start":"260'1200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1255","last_scrub_stamp":"2024-09-14T11:23:19.649845+0000","last_deep_scrub":"260'1255","last_deep_scrub_stamp":"2024-09-14T11:23:19.649845+0000","last_clean_scrub_stamp":"2024-09-14T11:23:19.649845+0000","objects_scrubbed":11,"log_size":55,"log_dups_size":1200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:26.770199+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141569,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1984,"num_read_kb":3752,"num_write":1074,"num_write_kb":921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":481,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:34.249984+0000","last_change":"2024-09-14T11:23:34.249984+0000","last_active":"2024-09-14T11:23:34.249984+0000","last_peered":"2024-09-14T11:23:34.249984+0000","last_clean":"2024-09-14T11:23:34.249984+0000","last_became_active":"2024-09-14T10:45:51.745481+0000","last_became_peered":"2024-09-14T10:45:51.745481+0000","last_unstale":"2024-09-14T11:23:34.249984+0000","last_undegraded":"2024-09-14T11:23:34.249984+0000","last_fullsized":"2024-09-14T11:23:34.249984+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:34.249880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:34.249880+0000","last_clean_scrub_stamp":"2024-09-14T11:23:34.249880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:22.847458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"260'294","reported_seq":826,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:30.542511+0000","last_change":"2024-09-14T11:23:30.542511+0000","last_active":"2024-09-14T11:23:30.542511+0000","last_peered":"2024-09-14T11:23:30.542511+0000","last_clean":"2024-09-14T11:23:30.542511+0000","last_became_active":"2024-09-14T10:45:53.750227+0000","last_became_peered":"2024-09-14T10:45:53.750227+0000","last_unstale":"2024-09-14T11:23:30.542511+0000","last_undegraded":"2024-09-14T11:23:30.542511+0000","last_fullsized":"2024-09-14T11:23:30.542511+0000","mapping_epoch":34,"log_start":"260'200","ondisk_log_start":"260'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'294","last_scrub_stamp":"2024-09-14T11:23:30.542425+0000","last_deep_scrub":"260'294","last_deep_scrub_stamp":"2024-09-14T11:23:30.542425+0000","last_clean_scrub_stamp":"2024-09-14T11:23:30.542425+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:08:15.313103+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":463,"num_read_kb":436,"num_write":609,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"260'356","reported_seq":1877,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:07.380950+0000","last_change":"2024-09-14T11:23:07.380950+0000","last_active":"2024-09-14T11:23:07.380950+0000","last_peered":"2024-09-14T11:23:07.380950+0000","last_clean":"2024-09-14T11:23:07.380950+0000","last_became_active":"2024-09-14T10:45:45.714923+0000","last_became_peered":"2024-09-14T10:45:45.714923+0000","last_unstale":"2024-09-14T11:23:07.380950+0000","last_undegraded":"2024-09-14T11:23:07.380950+0000","last_fullsized":"2024-09-14T11:23:07.380950+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'356","last_scrub_stamp":"2024-09-14T11:23:07.380862+0000","last_deep_scrub":"260'356","last_deep_scrub_stamp":"2024-09-14T11:23:07.380862+0000","last_clean_scrub_stamp":"2024-09-14T11:23:07.380862+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:31.182530+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2079,"num_read_kb":2005,"num_write":398,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":513,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:57.710733+0000","last_change":"2024-09-14T11:22:57.710655+0000","last_active":"2024-09-14T11:22:57.710733+0000","last_peered":"2024-09-14T11:22:57.710733+0000","last_clean":"2024-09-14T11:22:57.710733+0000","last_became_active":"2024-09-14T10:45:33.569944+0000","last_became_peered":"2024-09-14T10:45:33.569944+0000","last_unstale":"2024-09-14T11:22:57.710733+0000","last_undegraded":"2024-09-14T11:22:57.710733+0000","last_fullsized":"2024-09-14T11:22:57.710733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:57.710578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:57.710578+0000","last_clean_scrub_stamp":"2024-09-14T11:22:57.710578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:15.018820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055355599999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"260'364","reported_seq":1064,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:01.268567+0000","last_change":"2024-09-14T11:23:01.268492+0000","last_active":"2024-09-14T11:23:01.268567+0000","last_peered":"2024-09-14T11:23:01.268567+0000","last_clean":"2024-09-14T11:23:01.268567+0000","last_became_active":"2024-09-14T10:45:43.682920+0000","last_became_peered":"2024-09-14T10:45:43.682920+0000","last_unstale":"2024-09-14T11:23:01.268567+0000","last_undegraded":"2024-09-14T11:23:01.268567+0000","last_fullsized":"2024-09-14T11:23:01.268567+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'364","last_scrub_stamp":"2024-09-14T11:23:01.268391+0000","last_deep_scrub":"260'364","last_deep_scrub_stamp":"2024-09-14T11:23:01.268391+0000","last_clean_scrub_stamp":"2024-09-14T11:23:01.268391+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:16.818916+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133679,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":823,"num_read_kb":18154,"num_write":1072,"num_write_kb":35009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"260'2","reported_seq":492,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:10.674647+0000","last_change":"2024-09-14T11:23:10.674647+0000","last_active":"2024-09-14T11:23:10.674647+0000","last_peered":"2024-09-14T11:23:10.674647+0000","last_clean":"2024-09-14T11:23:10.674647+0000","last_became_active":"2024-09-14T10:45:47.729061+0000","last_became_peered":"2024-09-14T10:45:47.729061+0000","last_unstale":"2024-09-14T11:23:10.674647+0000","last_undegraded":"2024-09-14T11:23:10.674647+0000","last_fullsized":"2024-09-14T11:23:10.674647+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:23:10.674557+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:23:10.674557+0000","last_clean_scrub_stamp":"2024-09-14T11:23:10.674557+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:31.717306+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"260'248","reported_seq":1234,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:13.632628+0000","last_change":"2024-09-14T11:23:13.632569+0000","last_active":"2024-09-14T11:23:13.632628+0000","last_peered":"2024-09-14T11:23:13.632628+0000","last_clean":"2024-09-14T11:23:13.632628+0000","last_became_active":"2024-09-14T10:45:49.731858+0000","last_became_peered":"2024-09-14T10:45:49.731858+0000","last_unstale":"2024-09-14T11:23:13.632628+0000","last_undegraded":"2024-09-14T11:23:13.632628+0000","last_fullsized":"2024-09-14T11:23:13.632628+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'248","last_scrub_stamp":"2024-09-14T11:23:13.632463+0000","last_deep_scrub":"260'248","last_deep_scrub_stamp":"2024-09-14T11:23:13.632463+0000","last_clean_scrub_stamp":"2024-09-14T11:23:13.632463+0000","objects_scrubbed":9,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:07.671389+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":156,"num_read_kb":145,"num_write":121,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5400,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:27.666619+0000","last_change":"2024-09-14T11:23:27.666619+0000","last_active":"2024-09-14T11:23:27.666619+0000","last_peered":"2024-09-14T11:23:27.666619+0000","last_clean":"2024-09-14T11:23:27.666619+0000","last_became_active":"2024-09-14T10:45:51.742651+0000","last_became_peered":"2024-09-14T10:45:51.742651+0000","last_unstale":"2024-09-14T11:23:27.666619+0000","last_undegraded":"2024-09-14T11:23:27.666619+0000","last_fullsized":"2024-09-14T11:23:27.666619+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:27.666534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:27.666534+0000","last_clean_scrub_stamp":"2024-09-14T11:23:27.666534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:57.974502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"260'242","reported_seq":837,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:31.618062+0000","last_change":"2024-09-14T11:23:31.618008+0000","last_active":"2024-09-14T11:23:31.618062+0000","last_peered":"2024-09-14T11:23:31.618062+0000","last_clean":"2024-09-14T11:23:31.618062+0000","last_became_active":"2024-09-14T10:45:53.744823+0000","last_became_peered":"2024-09-14T10:45:53.744823+0000","last_unstale":"2024-09-14T11:23:31.618062+0000","last_undegraded":"2024-09-14T11:23:31.618062+0000","last_fullsized":"2024-09-14T11:23:31.618062+0000","mapping_epoch":34,"log_start":"260'200","ondisk_log_start":"260'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'242","last_scrub_stamp":"2024-09-14T11:23:31.617921+0000","last_deep_scrub":"260'242","last_deep_scrub_stamp":"2024-09-14T11:23:31.617921+0000","last_clean_scrub_stamp":"2024-09-14T11:23:31.617921+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:39.433668+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":471,"num_read_kb":497,"num_write":522,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"260'745","reported_seq":2256,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:06.427840+0000","last_change":"2024-09-14T11:23:06.427766+0000","last_active":"2024-09-14T11:23:06.427840+0000","last_peered":"2024-09-14T11:23:06.427840+0000","last_clean":"2024-09-14T11:23:06.427840+0000","last_became_active":"2024-09-14T10:45:45.714077+0000","last_became_peered":"2024-09-14T10:45:45.714077+0000","last_unstale":"2024-09-14T11:23:06.427840+0000","last_undegraded":"2024-09-14T11:23:06.427840+0000","last_fullsized":"2024-09-14T11:23:06.427840+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'745","last_scrub_stamp":"2024-09-14T11:23:06.427683+0000","last_deep_scrub":"260'745","last_deep_scrub_stamp":"2024-09-14T11:23:06.427683+0000","last_clean_scrub_stamp":"2024-09-14T11:23:06.427683+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":700,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:14.547833+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3745,"num_read_kb":3391,"num_write":988,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2262,"num_omap_keys":9,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"260'3","reported_seq":515,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:56.321959+0000","last_change":"2024-09-14T11:22:56.321865+0000","last_active":"2024-09-14T11:22:56.321959+0000","last_peered":"2024-09-14T11:22:56.321959+0000","last_clean":"2024-09-14T11:22:56.321959+0000","last_became_active":"2024-09-14T10:45:33.612919+0000","last_became_peered":"2024-09-14T10:45:33.612919+0000","last_unstale":"2024-09-14T11:22:56.321959+0000","last_undegraded":"2024-09-14T11:22:56.321959+0000","last_fullsized":"2024-09-14T11:22:56.321959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T11:22:56.321789+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T11:22:56.321789+0000","last_clean_scrub_stamp":"2024-09-14T11:22:56.321789+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:47.764462+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00094497699999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"260'329","reported_seq":1206,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:00.571957+0000","last_change":"2024-09-14T11:23:00.571895+0000","last_active":"2024-09-14T11:23:00.571957+0000","last_peered":"2024-09-14T11:23:00.571957+0000","last_clean":"2024-09-14T11:23:00.571957+0000","last_became_active":"2024-09-14T10:45:43.679522+0000","last_became_peered":"2024-09-14T10:45:43.679522+0000","last_unstale":"2024-09-14T11:23:00.571957+0000","last_undegraded":"2024-09-14T11:23:00.571957+0000","last_fullsized":"2024-09-14T11:23:00.571957+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'329","last_scrub_stamp":"2024-09-14T11:23:00.571795+0000","last_deep_scrub":"260'329","last_deep_scrub_stamp":"2024-09-14T11:23:00.571795+0000","last_clean_scrub_stamp":"2024-09-14T11:23:00.571795+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:46.489688+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1353,"num_read_kb":12978,"num_write":1165,"num_write_kb":34630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"260'4","reported_seq":972,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:08.708188+0000","last_change":"2024-09-14T11:23:08.708120+0000","last_active":"2024-09-14T11:23:08.708188+0000","last_peered":"2024-09-14T11:23:08.708188+0000","last_clean":"2024-09-14T11:23:08.708188+0000","last_became_active":"2024-09-14T10:45:47.727050+0000","last_became_peered":"2024-09-14T10:45:47.727050+0000","last_unstale":"2024-09-14T11:23:08.708188+0000","last_undegraded":"2024-09-14T11:23:08.708188+0000","last_fullsized":"2024-09-14T11:23:08.708188+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-14T11:23:08.708034+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-14T11:23:08.708034+0000","last_clean_scrub_stamp":"2024-09-14T11:23:08.708034+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:23.242324+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"260'109","reported_seq":632,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:21.449544+0000","last_change":"2024-09-14T11:23:21.449544+0000","last_active":"2024-09-14T11:23:21.449544+0000","last_peered":"2024-09-14T11:23:21.449544+0000","last_clean":"2024-09-14T11:23:21.449544+0000","last_became_active":"2024-09-14T10:45:49.734181+0000","last_became_peered":"2024-09-14T10:45:49.734181+0000","last_unstale":"2024-09-14T11:23:21.449544+0000","last_undegraded":"2024-09-14T11:23:21.449544+0000","last_fullsized":"2024-09-14T11:23:21.449544+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'109","last_scrub_stamp":"2024-09-14T11:23:21.449431+0000","last_deep_scrub":"260'109","last_deep_scrub_stamp":"2024-09-14T11:23:21.449431+0000","last_clean_scrub_stamp":"2024-09-14T11:23:21.449431+0000","objects_scrubbed":7,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:19.786794+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":121,"num_read_kb":115,"num_write":86,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3358,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":480,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:35.221473+0000","last_change":"2024-09-14T11:23:35.221473+0000","last_active":"2024-09-14T11:23:35.221473+0000","last_peered":"2024-09-14T11:23:35.221473+0000","last_clean":"2024-09-14T11:23:35.221473+0000","last_became_active":"2024-09-14T10:45:51.744280+0000","last_became_peered":"2024-09-14T10:45:51.744280+0000","last_unstale":"2024-09-14T11:23:35.221473+0000","last_undegraded":"2024-09-14T11:23:35.221473+0000","last_fullsized":"2024-09-14T11:23:35.221473+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:35.221380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:35.221380+0000","last_clean_scrub_stamp":"2024-09-14T11:23:35.221380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:09.486875+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"260'117","reported_seq":657,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:21.587933+0000","last_change":"2024-09-14T11:23:21.587933+0000","last_active":"2024-09-14T11:23:21.587933+0000","last_peered":"2024-09-14T11:23:21.587933+0000","last_clean":"2024-09-14T11:23:21.587933+0000","last_became_active":"2024-09-14T10:45:53.746484+0000","last_became_peered":"2024-09-14T10:45:53.746484+0000","last_unstale":"2024-09-14T11:23:21.587933+0000","last_undegraded":"2024-09-14T11:23:21.587933+0000","last_fullsized":"2024-09-14T11:23:21.587933+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'117","last_scrub_stamp":"2024-09-14T11:23:21.587830+0000","last_deep_scrub":"260'117","last_deep_scrub_stamp":"2024-09-14T11:23:21.587830+0000","last_clean_scrub_stamp":"2024-09-14T11:23:21.587830+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:12.179504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":202,"num_write":278,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"260'1200","reported_seq":2910,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:02.495387+0000","last_change":"2024-09-14T11:23:02.495332+0000","last_active":"2024-09-14T11:23:02.495387+0000","last_peered":"2024-09-14T11:23:02.495387+0000","last_clean":"2024-09-14T11:23:02.495387+0000","last_became_active":"2024-09-14T10:45:45.713440+0000","last_became_peered":"2024-09-14T10:45:45.713440+0000","last_unstale":"2024-09-14T11:23:02.495387+0000","last_undegraded":"2024-09-14T11:23:02.495387+0000","last_fullsized":"2024-09-14T11:23:02.495387+0000","mapping_epoch":26,"log_start":"260'1100","ondisk_log_start":"260'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1200","last_scrub_stamp":"2024-09-14T11:23:02.495208+0000","last_deep_scrub":"260'1200","last_deep_scrub_stamp":"2024-09-14T11:23:02.495208+0000","last_clean_scrub_stamp":"2024-09-14T11:23:02.495208+0000","objects_scrubbed":4,"log_size":100,"log_dups_size":1100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:18:40.279776+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5652,"num_read_kb":5051,"num_write":1624,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"260'368","reported_seq":1064,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:56.140666+0000","last_change":"2024-09-14T11:22:56.140615+0000","last_active":"2024-09-14T11:22:56.140666+0000","last_peered":"2024-09-14T11:22:56.140666+0000","last_clean":"2024-09-14T11:22:56.140666+0000","last_became_active":"2024-09-14T10:45:43.682711+0000","last_became_peered":"2024-09-14T10:45:43.682711+0000","last_unstale":"2024-09-14T11:22:56.140666+0000","last_undegraded":"2024-09-14T11:22:56.140666+0000","last_fullsized":"2024-09-14T11:22:56.140666+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'368","last_scrub_stamp":"2024-09-14T11:22:56.140537+0000","last_deep_scrub":"260'368","last_deep_scrub_stamp":"2024-09-14T11:22:56.140537+0000","last_clean_scrub_stamp":"2024-09-14T11:22:56.140537+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:56:04.477168+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":849,"num_read_kb":26785,"num_write":1182,"num_write_kb":27965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":511,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:58.210095+0000","last_change":"2024-09-14T11:22:58.210044+0000","last_active":"2024-09-14T11:22:58.210095+0000","last_peered":"2024-09-14T11:22:58.210095+0000","last_clean":"2024-09-14T11:22:58.210095+0000","last_became_active":"2024-09-14T10:45:33.612983+0000","last_became_peered":"2024-09-14T10:45:33.612983+0000","last_unstale":"2024-09-14T11:22:58.210095+0000","last_undegraded":"2024-09-14T11:22:58.210095+0000","last_fullsized":"2024-09-14T11:22:58.210095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:58.209961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:58.209961+0000","last_clean_scrub_stamp":"2024-09-14T11:22:58.209961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:24.187827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053773700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":495,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:14.832509+0000","last_change":"2024-09-14T11:23:14.832421+0000","last_active":"2024-09-14T11:23:14.832509+0000","last_peered":"2024-09-14T11:23:14.832509+0000","last_clean":"2024-09-14T11:23:14.832509+0000","last_became_active":"2024-09-14T10:45:47.724317+0000","last_became_peered":"2024-09-14T10:45:47.724317+0000","last_unstale":"2024-09-14T11:23:14.832509+0000","last_undegraded":"2024-09-14T11:23:14.832509+0000","last_fullsized":"2024-09-14T11:23:14.832509+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:14.832323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:14.832323+0000","last_clean_scrub_stamp":"2024-09-14T11:23:14.832323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:35.877723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"260'555","reported_seq":1205,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:12.702394+0000","last_change":"2024-09-14T11:23:12.702336+0000","last_active":"2024-09-14T11:23:12.702394+0000","last_peered":"2024-09-14T11:23:12.702394+0000","last_clean":"2024-09-14T11:23:12.702394+0000","last_became_active":"2024-09-14T10:45:49.735662+0000","last_became_peered":"2024-09-14T10:45:49.735662+0000","last_unstale":"2024-09-14T11:23:12.702394+0000","last_undegraded":"2024-09-14T11:23:12.702394+0000","last_fullsized":"2024-09-14T11:23:12.702394+0000","mapping_epoch":30,"log_start":"260'500","ondisk_log_start":"260'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'555","last_scrub_stamp":"2024-09-14T11:23:12.702245+0000","last_deep_scrub":"260'555","last_deep_scrub_stamp":"2024-09-14T11:23:12.702245+0000","last_clean_scrub_stamp":"2024-09-14T11:23:12.702245+0000","objects_scrubbed":9,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:15.583995+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96714,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1561,"num_read_kb":2770,"num_write":2020,"num_write_kb":1869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":529654,"num_omap_keys":1194,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:14.406366+0000","last_change":"2024-09-14T11:23:14.406308+0000","last_active":"2024-09-14T11:23:14.406366+0000","last_peered":"2024-09-14T11:23:14.406366+0000","last_clean":"2024-09-14T11:23:14.406366+0000","last_became_active":"2024-09-14T10:45:51.749478+0000","last_became_peered":"2024-09-14T10:45:51.749478+0000","last_unstale":"2024-09-14T11:23:14.406366+0000","last_undegraded":"2024-09-14T11:23:14.406366+0000","last_fullsized":"2024-09-14T11:23:14.406366+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:14.406216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:14.406216+0000","last_clean_scrub_stamp":"2024-09-14T11:23:14.406216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:10.698911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"260'122","reported_seq":617,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:32.564513+0000","last_change":"2024-09-14T11:23:32.564446+0000","last_active":"2024-09-14T11:23:32.564513+0000","last_peered":"2024-09-14T11:23:32.564513+0000","last_clean":"2024-09-14T11:23:32.564513+0000","last_became_active":"2024-09-14T10:45:53.749578+0000","last_became_peered":"2024-09-14T10:45:53.749578+0000","last_unstale":"2024-09-14T11:23:32.564513+0000","last_undegraded":"2024-09-14T11:23:32.564513+0000","last_fullsized":"2024-09-14T11:23:32.564513+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'122","last_scrub_stamp":"2024-09-14T11:23:32.564358+0000","last_deep_scrub":"260'122","last_deep_scrub_stamp":"2024-09-14T11:23:32.564358+0000","last_clean_scrub_stamp":"2024-09-14T11:23:32.564358+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:11.546553+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":913,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":137,"num_read_kb":126,"num_write":281,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"260'864","reported_seq":2567,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:05.472851+0000","last_change":"2024-09-14T11:23:05.472779+0000","last_active":"2024-09-14T11:23:05.472851+0000","last_peered":"2024-09-14T11:23:05.472851+0000","last_clean":"2024-09-14T11:23:05.472851+0000","last_became_active":"2024-09-14T10:45:45.719783+0000","last_became_peered":"2024-09-14T10:45:45.719783+0000","last_unstale":"2024-09-14T11:23:05.472851+0000","last_undegraded":"2024-09-14T11:23:05.472851+0000","last_fullsized":"2024-09-14T11:23:05.472851+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'864","last_scrub_stamp":"2024-09-14T11:23:05.472688+0000","last_deep_scrub":"260'864","last_deep_scrub_stamp":"2024-09-14T11:23:05.472688+0000","last_clean_scrub_stamp":"2024-09-14T11:23:05.472688+0000","objects_scrubbed":3,"log_size":64,"log_dups_size":800,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:31.265160+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4184,"num_read_kb":3795,"num_write":1124,"num_write_kb":397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"260'369","reported_seq":992,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:59.565502+0000","last_change":"2024-09-14T11:22:59.565447+0000","last_active":"2024-09-14T11:22:59.565502+0000","last_peered":"2024-09-14T11:22:59.565502+0000","last_clean":"2024-09-14T11:22:59.565502+0000","last_became_active":"2024-09-14T10:45:43.685775+0000","last_became_peered":"2024-09-14T10:45:43.685775+0000","last_unstale":"2024-09-14T11:22:59.565502+0000","last_undegraded":"2024-09-14T11:22:59.565502+0000","last_fullsized":"2024-09-14T11:22:59.565502+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'369","last_scrub_stamp":"2024-09-14T11:22:59.565357+0000","last_deep_scrub":"260'369","last_deep_scrub_stamp":"2024-09-14T11:22:59.565357+0000","last_clean_scrub_stamp":"2024-09-14T11:22:59.565357+0000","objects_scrubbed":3,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:14.300547+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":660,"num_read_kb":2173,"num_write":1090,"num_write_kb":20935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":512,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:59.293347+0000","last_change":"2024-09-14T11:22:59.293285+0000","last_active":"2024-09-14T11:22:59.293347+0000","last_peered":"2024-09-14T11:22:59.293347+0000","last_clean":"2024-09-14T11:22:59.293347+0000","last_became_active":"2024-09-14T10:45:33.564407+0000","last_became_peered":"2024-09-14T10:45:33.564407+0000","last_unstale":"2024-09-14T11:22:59.293347+0000","last_undegraded":"2024-09-14T11:22:59.293347+0000","last_fullsized":"2024-09-14T11:22:59.293347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:59.293199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:59.293199+0000","last_clean_scrub_stamp":"2024-09-14T11:22:59.293199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:33.650485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099134599999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":496,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:09.610979+0000","last_change":"2024-09-14T11:23:09.610887+0000","last_active":"2024-09-14T11:23:09.610979+0000","last_peered":"2024-09-14T11:23:09.610979+0000","last_clean":"2024-09-14T11:23:09.610979+0000","last_became_active":"2024-09-14T10:45:47.724774+0000","last_became_peered":"2024-09-14T10:45:47.724774+0000","last_unstale":"2024-09-14T11:23:09.610979+0000","last_undegraded":"2024-09-14T11:23:09.610979+0000","last_fullsized":"2024-09-14T11:23:09.610979+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:09.610793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:09.610793+0000","last_clean_scrub_stamp":"2024-09-14T11:23:09.610793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:43.851455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"260'164","reported_seq":709,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:14.280039+0000","last_change":"2024-09-14T11:23:14.279970+0000","last_active":"2024-09-14T11:23:14.280039+0000","last_peered":"2024-09-14T11:23:14.280039+0000","last_clean":"2024-09-14T11:23:14.280039+0000","last_became_active":"2024-09-14T10:45:49.731380+0000","last_became_peered":"2024-09-14T10:45:49.731380+0000","last_unstale":"2024-09-14T11:23:14.280039+0000","last_undegraded":"2024-09-14T11:23:14.280039+0000","last_fullsized":"2024-09-14T11:23:14.280039+0000","mapping_epoch":30,"log_start":"257'100","ondisk_log_start":"257'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'164","last_scrub_stamp":"2024-09-14T11:23:14.279872+0000","last_deep_scrub":"260'164","last_deep_scrub_stamp":"2024-09-14T11:23:14.279872+0000","last_clean_scrub_stamp":"2024-09-14T11:23:14.279872+0000","objects_scrubbed":9,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:37:02.128672+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":200,"num_read_kb":190,"num_write":162,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6272,"num_omap_keys":14,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"260'796","reported_seq":2749,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:17.556395+0000","last_change":"2024-09-14T11:23:17.556316+0000","last_active":"2024-09-14T11:23:17.556395+0000","last_peered":"2024-09-14T11:23:17.556395+0000","last_clean":"2024-09-14T11:23:17.556395+0000","last_became_active":"2024-09-14T10:45:51.746984+0000","last_became_peered":"2024-09-14T10:45:51.746984+0000","last_unstale":"2024-09-14T11:23:17.556395+0000","last_undegraded":"2024-09-14T11:23:17.556395+0000","last_fullsized":"2024-09-14T11:23:17.556395+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'796","last_scrub_stamp":"2024-09-14T11:23:17.556213+0000","last_deep_scrub":"260'796","last_deep_scrub_stamp":"2024-09-14T11:23:17.556213+0000","last_clean_scrub_stamp":"2024-09-14T11:23:17.556213+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:46:30.527918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"260'123","reported_seq":622,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:22.762909+0000","last_change":"2024-09-14T11:23:22.762909+0000","last_active":"2024-09-14T11:23:22.762909+0000","last_peered":"2024-09-14T11:23:22.762909+0000","last_clean":"2024-09-14T11:23:22.762909+0000","last_became_active":"2024-09-14T10:45:53.749802+0000","last_became_peered":"2024-09-14T10:45:53.749802+0000","last_unstale":"2024-09-14T11:23:22.762909+0000","last_undegraded":"2024-09-14T11:23:22.762909+0000","last_fullsized":"2024-09-14T11:23:22.762909+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'123","last_scrub_stamp":"2024-09-14T11:23:22.762824+0000","last_deep_scrub":"260'123","last_deep_scrub_stamp":"2024-09-14T11:23:22.762824+0000","last_clean_scrub_stamp":"2024-09-14T11:23:22.762824+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:29.506077+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":146,"num_read_kb":135,"num_write":274,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"260'413","reported_seq":1907,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:01.936384+0000","last_change":"2024-09-14T11:23:01.936290+0000","last_active":"2024-09-14T11:23:01.936384+0000","last_peered":"2024-09-14T11:23:01.936384+0000","last_clean":"2024-09-14T11:23:01.936384+0000","last_became_active":"2024-09-14T10:45:45.710204+0000","last_became_peered":"2024-09-14T10:45:45.710204+0000","last_unstale":"2024-09-14T11:23:01.936384+0000","last_undegraded":"2024-09-14T11:23:01.936384+0000","last_fullsized":"2024-09-14T11:23:01.936384+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'413","last_scrub_stamp":"2024-09-14T11:23:01.936187+0000","last_deep_scrub":"260'413","last_deep_scrub_stamp":"2024-09-14T11:23:01.936187+0000","last_clean_scrub_stamp":"2024-09-14T11:23:01.936187+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:16.997744+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2141,"num_read_kb":2031,"num_write":456,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"260'376","reported_seq":1153,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:58.064053+0000","last_change":"2024-09-14T11:22:58.064053+0000","last_active":"2024-09-14T11:22:58.064053+0000","last_peered":"2024-09-14T11:22:58.064053+0000","last_clean":"2024-09-14T11:22:58.064053+0000","last_became_active":"2024-09-14T10:45:43.688114+0000","last_became_peered":"2024-09-14T10:45:43.688114+0000","last_unstale":"2024-09-14T11:22:58.064053+0000","last_undegraded":"2024-09-14T11:22:58.064053+0000","last_fullsized":"2024-09-14T11:22:58.064053+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'376","last_scrub_stamp":"2024-09-14T11:22:58.063966+0000","last_deep_scrub":"260'376","last_deep_scrub_stamp":"2024-09-14T11:22:58.063966+0000","last_clean_scrub_stamp":"2024-09-14T11:22:58.063966+0000","objects_scrubbed":3,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:30.176310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":828,"num_read_kb":15214,"num_write":1175,"num_write_kb":42293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":517,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:00.943595+0000","last_change":"2024-09-14T11:23:00.943595+0000","last_active":"2024-09-14T11:23:00.943595+0000","last_peered":"2024-09-14T11:23:00.943595+0000","last_clean":"2024-09-14T11:23:00.943595+0000","last_became_active":"2024-09-14T10:45:33.610909+0000","last_became_peered":"2024-09-14T10:45:33.610909+0000","last_unstale":"2024-09-14T11:23:00.943595+0000","last_undegraded":"2024-09-14T11:23:00.943595+0000","last_fullsized":"2024-09-14T11:23:00.943595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:00.943508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:00.943508+0000","last_clean_scrub_stamp":"2024-09-14T11:23:00.943508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:53.613527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038435900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:22.180284+0000","last_change":"2024-09-14T11:23:22.180284+0000","last_active":"2024-09-14T11:23:22.180284+0000","last_peered":"2024-09-14T11:23:22.180284+0000","last_clean":"2024-09-14T11:23:22.180284+0000","last_became_active":"2024-09-14T10:45:47.728343+0000","last_became_peered":"2024-09-14T10:45:47.728343+0000","last_unstale":"2024-09-14T11:23:22.180284+0000","last_undegraded":"2024-09-14T11:23:22.180284+0000","last_fullsized":"2024-09-14T11:23:22.180284+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:22.180193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:22.180193+0000","last_clean_scrub_stamp":"2024-09-14T11:23:22.180193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:14.286725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"260'97","reported_seq":619,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:29.248240+0000","last_change":"2024-09-14T11:23:29.248240+0000","last_active":"2024-09-14T11:23:29.248240+0000","last_peered":"2024-09-14T11:23:29.248240+0000","last_clean":"2024-09-14T11:23:29.248240+0000","last_became_active":"2024-09-14T10:45:49.735557+0000","last_became_peered":"2024-09-14T10:45:49.735557+0000","last_unstale":"2024-09-14T11:23:29.248240+0000","last_undegraded":"2024-09-14T11:23:29.248240+0000","last_fullsized":"2024-09-14T11:23:29.248240+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'97","last_scrub_stamp":"2024-09-14T11:23:29.248143+0000","last_deep_scrub":"260'97","last_deep_scrub_stamp":"2024-09-14T11:23:29.248143+0000","last_clean_scrub_stamp":"2024-09-14T11:23:29.248143+0000","objects_scrubbed":5,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:15.434542+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":68,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"260'806","reported_seq":2222,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:23.448147+0000","last_change":"2024-09-14T11:23:23.448147+0000","last_active":"2024-09-14T11:23:23.448147+0000","last_peered":"2024-09-14T11:23:23.448147+0000","last_clean":"2024-09-14T11:23:23.448147+0000","last_became_active":"2024-09-14T10:45:51.746874+0000","last_became_peered":"2024-09-14T10:45:51.746874+0000","last_unstale":"2024-09-14T11:23:23.448147+0000","last_undegraded":"2024-09-14T11:23:23.448147+0000","last_fullsized":"2024-09-14T11:23:23.448147+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'806","last_scrub_stamp":"2024-09-14T11:23:23.448070+0000","last_deep_scrub":"260'806","last_deep_scrub_stamp":"2024-09-14T11:23:23.448070+0000","last_clean_scrub_stamp":"2024-09-14T11:23:23.448070+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:45.072572+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"260'175","reported_seq":667,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:31.528570+0000","last_change":"2024-09-14T11:23:31.528504+0000","last_active":"2024-09-14T11:23:31.528570+0000","last_peered":"2024-09-14T11:23:31.528570+0000","last_clean":"2024-09-14T11:23:31.528570+0000","last_became_active":"2024-09-14T10:45:53.748880+0000","last_became_peered":"2024-09-14T10:45:53.748880+0000","last_unstale":"2024-09-14T11:23:31.528570+0000","last_undegraded":"2024-09-14T11:23:31.528570+0000","last_fullsized":"2024-09-14T11:23:31.528570+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'175","last_scrub_stamp":"2024-09-14T11:23:31.528414+0000","last_deep_scrub":"260'175","last_deep_scrub_stamp":"2024-09-14T11:23:31.528414+0000","last_clean_scrub_stamp":"2024-09-14T11:23:31.528414+0000","objects_scrubbed":4,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:36.836942+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":483,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":133,"num_read_kb":125,"num_write":394,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"260'407","reported_seq":1926,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:15.452071+0000","last_change":"2024-09-14T11:23:15.452071+0000","last_active":"2024-09-14T11:23:15.452071+0000","last_peered":"2024-09-14T11:23:15.452071+0000","last_clean":"2024-09-14T11:23:15.452071+0000","last_became_active":"2024-09-14T10:45:45.713313+0000","last_became_peered":"2024-09-14T10:45:45.713313+0000","last_unstale":"2024-09-14T11:23:15.452071+0000","last_undegraded":"2024-09-14T11:23:15.452071+0000","last_fullsized":"2024-09-14T11:23:15.452071+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'407","last_scrub_stamp":"2024-09-14T11:23:15.451983+0000","last_deep_scrub":"260'407","last_deep_scrub_stamp":"2024-09-14T11:23:15.451983+0000","last_clean_scrub_stamp":"2024-09-14T11:23:15.451983+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:11.569441+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2392,"num_read_kb":2258,"num_write":470,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2804,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"260'370","reported_seq":1118,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:03.896483+0000","last_change":"2024-09-14T11:23:03.896483+0000","last_active":"2024-09-14T11:23:03.896483+0000","last_peered":"2024-09-14T11:23:03.896483+0000","last_clean":"2024-09-14T11:23:03.896483+0000","last_became_active":"2024-09-14T10:45:43.689593+0000","last_became_peered":"2024-09-14T10:45:43.689593+0000","last_unstale":"2024-09-14T11:23:03.896483+0000","last_undegraded":"2024-09-14T11:23:03.896483+0000","last_fullsized":"2024-09-14T11:23:03.896483+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'370","last_scrub_stamp":"2024-09-14T11:23:03.896370+0000","last_deep_scrub":"260'370","last_deep_scrub_stamp":"2024-09-14T11:23:03.896370+0000","last_clean_scrub_stamp":"2024-09-14T11:23:03.896370+0000","objects_scrubbed":5,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:58:27.060305+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267348,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1017,"num_read_kb":46619,"num_write":1250,"num_write_kb":43963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":511,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:00.328992+0000","last_change":"2024-09-14T11:23:00.328992+0000","last_active":"2024-09-14T11:23:00.328992+0000","last_peered":"2024-09-14T11:23:00.328992+0000","last_clean":"2024-09-14T11:23:00.328992+0000","last_became_active":"2024-09-14T10:45:33.610689+0000","last_became_peered":"2024-09-14T10:45:33.610689+0000","last_unstale":"2024-09-14T11:23:00.328992+0000","last_undegraded":"2024-09-14T11:23:00.328992+0000","last_fullsized":"2024-09-14T11:23:00.328992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:00.328887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:00.328887+0000","last_clean_scrub_stamp":"2024-09-14T11:23:00.328887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:01:42.965803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011461920000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":496,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:11.785097+0000","last_change":"2024-09-14T11:23:11.785031+0000","last_active":"2024-09-14T11:23:11.785097+0000","last_peered":"2024-09-14T11:23:11.785097+0000","last_clean":"2024-09-14T11:23:11.785097+0000","last_became_active":"2024-09-14T10:45:47.728312+0000","last_became_peered":"2024-09-14T10:45:47.728312+0000","last_unstale":"2024-09-14T11:23:11.785097+0000","last_undegraded":"2024-09-14T11:23:11.785097+0000","last_fullsized":"2024-09-14T11:23:11.785097+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:11.784943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:11.784943+0000","last_clean_scrub_stamp":"2024-09-14T11:23:11.784943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:16.816883+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"260'724","reported_seq":1435,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:12.640289+0000","last_change":"2024-09-14T11:23:12.640223+0000","last_active":"2024-09-14T11:23:12.640289+0000","last_peered":"2024-09-14T11:23:12.640289+0000","last_clean":"2024-09-14T11:23:12.640289+0000","last_became_active":"2024-09-14T10:45:49.733812+0000","last_became_peered":"2024-09-14T10:45:49.733812+0000","last_unstale":"2024-09-14T11:23:12.640289+0000","last_undegraded":"2024-09-14T11:23:12.640289+0000","last_fullsized":"2024-09-14T11:23:12.640289+0000","mapping_epoch":30,"log_start":"260'700","ondisk_log_start":"260'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'724","last_scrub_stamp":"2024-09-14T11:23:12.640119+0000","last_deep_scrub":"260'724","last_deep_scrub_stamp":"2024-09-14T11:23:12.640119+0000","last_clean_scrub_stamp":"2024-09-14T11:23:12.640119+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":700,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:51.052214+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137505,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1282,"num_read_kb":3061,"num_write":1046,"num_write_kb":877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:25.729577+0000","last_change":"2024-09-14T11:23:25.729577+0000","last_active":"2024-09-14T11:23:25.729577+0000","last_peered":"2024-09-14T11:23:25.729577+0000","last_clean":"2024-09-14T11:23:25.729577+0000","last_became_active":"2024-09-14T10:45:51.745137+0000","last_became_peered":"2024-09-14T10:45:51.745137+0000","last_unstale":"2024-09-14T11:23:25.729577+0000","last_undegraded":"2024-09-14T11:23:25.729577+0000","last_fullsized":"2024-09-14T11:23:25.729577+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:25.729479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:25.729479+0000","last_clean_scrub_stamp":"2024-09-14T11:23:25.729479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:31:55.711393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"260'134","reported_seq":635,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:23.425651+0000","last_change":"2024-09-14T11:23:23.425573+0000","last_active":"2024-09-14T11:23:23.425651+0000","last_peered":"2024-09-14T11:23:23.425651+0000","last_clean":"2024-09-14T11:23:23.425651+0000","last_became_active":"2024-09-14T10:45:53.751511+0000","last_became_peered":"2024-09-14T10:45:53.751511+0000","last_unstale":"2024-09-14T11:23:23.425651+0000","last_undegraded":"2024-09-14T11:23:23.425651+0000","last_fullsized":"2024-09-14T11:23:23.425651+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'134","last_scrub_stamp":"2024-09-14T11:23:23.425489+0000","last_deep_scrub":"260'134","last_deep_scrub_stamp":"2024-09-14T11:23:23.425489+0000","last_clean_scrub_stamp":"2024-09-14T11:23:23.425489+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:46.588914+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":202,"num_read_kb":180,"num_write":339,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"260'196","reported_seq":802,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:32.572381+0000","last_change":"2024-09-14T11:23:32.572381+0000","last_active":"2024-09-14T11:23:32.572381+0000","last_peered":"2024-09-14T11:23:32.572381+0000","last_clean":"2024-09-14T11:23:32.572381+0000","last_became_active":"2024-09-14T10:45:53.747090+0000","last_became_peered":"2024-09-14T10:45:53.747090+0000","last_unstale":"2024-09-14T11:23:32.572381+0000","last_undegraded":"2024-09-14T11:23:32.572381+0000","last_fullsized":"2024-09-14T11:23:32.572381+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'196","last_scrub_stamp":"2024-09-14T11:23:32.572284+0000","last_deep_scrub":"260'196","last_deep_scrub_stamp":"2024-09-14T11:23:32.572284+0000","last_clean_scrub_stamp":"2024-09-14T11:23:32.572284+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:11.027009+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":464,"num_read_kb":408,"num_write":469,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"260'463","reported_seq":1949,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:13.405280+0000","last_change":"2024-09-14T11:23:13.405280+0000","last_active":"2024-09-14T11:23:13.405280+0000","last_peered":"2024-09-14T11:23:13.405280+0000","last_clean":"2024-09-14T11:23:13.405280+0000","last_became_active":"2024-09-14T10:45:45.719181+0000","last_became_peered":"2024-09-14T10:45:45.719181+0000","last_unstale":"2024-09-14T11:23:13.405280+0000","last_undegraded":"2024-09-14T11:23:13.405280+0000","last_fullsized":"2024-09-14T11:23:13.405280+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'463","last_scrub_stamp":"2024-09-14T11:23:13.405187+0000","last_deep_scrub":"260'463","last_deep_scrub_stamp":"2024-09-14T11:23:13.405187+0000","last_clean_scrub_stamp":"2024-09-14T11:23:13.405187+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:49:14.290897+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2298,"num_read_kb":2151,"num_write":532,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"260'403","reported_seq":1070,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:06.181433+0000","last_change":"2024-09-14T11:23:06.181360+0000","last_active":"2024-09-14T11:23:06.181433+0000","last_peered":"2024-09-14T11:23:06.181433+0000","last_clean":"2024-09-14T11:23:06.181433+0000","last_became_active":"2024-09-14T10:45:43.673475+0000","last_became_peered":"2024-09-14T10:45:43.673475+0000","last_unstale":"2024-09-14T11:23:06.181433+0000","last_undegraded":"2024-09-14T11:23:06.181433+0000","last_fullsized":"2024-09-14T11:23:06.181433+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'403","last_scrub_stamp":"2024-09-14T11:23:06.181264+0000","last_deep_scrub":"260'403","last_deep_scrub_stamp":"2024-09-14T11:23:06.181264+0000","last_clean_scrub_stamp":"2024-09-14T11:23:06.181264+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:01.791158+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":761,"num_read_kb":57050,"num_write":1291,"num_write_kb":43494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:13.270673+0000","last_change":"2024-09-14T11:23:13.270673+0000","last_active":"2024-09-14T11:23:13.270673+0000","last_peered":"2024-09-14T11:23:13.270673+0000","last_clean":"2024-09-14T11:23:13.270673+0000","last_became_active":"2024-09-14T10:45:47.726819+0000","last_became_peered":"2024-09-14T10:45:47.726819+0000","last_unstale":"2024-09-14T11:23:13.270673+0000","last_undegraded":"2024-09-14T11:23:13.270673+0000","last_fullsized":"2024-09-14T11:23:13.270673+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:13.270587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:13.270587+0000","last_clean_scrub_stamp":"2024-09-14T11:23:13.270587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:32:10.160393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"260'275","reported_seq":835,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:20.185781+0000","last_change":"2024-09-14T11:23:20.185781+0000","last_active":"2024-09-14T11:23:20.185781+0000","last_peered":"2024-09-14T11:23:20.185781+0000","last_clean":"2024-09-14T11:23:20.185781+0000","last_became_active":"2024-09-14T10:45:49.732755+0000","last_became_peered":"2024-09-14T10:45:49.732755+0000","last_unstale":"2024-09-14T11:23:20.185781+0000","last_undegraded":"2024-09-14T11:23:20.185781+0000","last_fullsized":"2024-09-14T11:23:20.185781+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'275","last_scrub_stamp":"2024-09-14T11:23:20.185661+0000","last_deep_scrub":"260'275","last_deep_scrub_stamp":"2024-09-14T11:23:20.185661+0000","last_clean_scrub_stamp":"2024-09-14T11:23:20.185661+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:41.760457+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48124,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":453,"num_read_kb":1077,"num_write":370,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":481,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:16.626195+0000","last_change":"2024-09-14T11:23:16.626195+0000","last_active":"2024-09-14T11:23:16.626195+0000","last_peered":"2024-09-14T11:23:16.626195+0000","last_clean":"2024-09-14T11:23:16.626195+0000","last_became_active":"2024-09-14T10:45:51.747624+0000","last_became_peered":"2024-09-14T10:45:51.747624+0000","last_unstale":"2024-09-14T11:23:16.626195+0000","last_undegraded":"2024-09-14T11:23:16.626195+0000","last_fullsized":"2024-09-14T11:23:16.626195+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:16.626109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:16.626109+0000","last_clean_scrub_stamp":"2024-09-14T11:23:16.626109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:14.233513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"260'139","reported_seq":636,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:23.771825+0000","last_change":"2024-09-14T11:23:23.771744+0000","last_active":"2024-09-14T11:23:23.771825+0000","last_peered":"2024-09-14T11:23:23.771825+0000","last_clean":"2024-09-14T11:23:23.771825+0000","last_became_active":"2024-09-14T10:45:53.750866+0000","last_became_peered":"2024-09-14T10:45:53.750866+0000","last_unstale":"2024-09-14T11:23:23.771825+0000","last_undegraded":"2024-09-14T11:23:23.771825+0000","last_fullsized":"2024-09-14T11:23:23.771825+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'139","last_scrub_stamp":"2024-09-14T11:23:23.771657+0000","last_deep_scrub":"260'139","last_deep_scrub_stamp":"2024-09-14T11:23:23.771657+0000","last_clean_scrub_stamp":"2024-09-14T11:23:23.771657+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:32.786651+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":161,"num_read_kb":145,"num_write":328,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"260'718","reported_seq":2452,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:05.853802+0000","last_change":"2024-09-14T11:23:05.853747+0000","last_active":"2024-09-14T11:23:05.853802+0000","last_peered":"2024-09-14T11:23:05.853802+0000","last_clean":"2024-09-14T11:23:05.853802+0000","last_became_active":"2024-09-14T10:45:45.719731+0000","last_became_peered":"2024-09-14T10:45:45.719731+0000","last_unstale":"2024-09-14T11:23:05.853802+0000","last_undegraded":"2024-09-14T11:23:05.853802+0000","last_fullsized":"2024-09-14T11:23:05.853802+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'718","last_scrub_stamp":"2024-09-14T11:23:05.853644+0000","last_deep_scrub":"260'718","last_deep_scrub_stamp":"2024-09-14T11:23:05.853644+0000","last_clean_scrub_stamp":"2024-09-14T11:23:05.853644+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":700,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:10.570219+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3605,"num_read_kb":3249,"num_write":949,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":744,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"260'335","reported_seq":951,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:55.643327+0000","last_change":"2024-09-14T11:22:55.643327+0000","last_active":"2024-09-14T11:22:55.643327+0000","last_peered":"2024-09-14T11:22:55.643327+0000","last_clean":"2024-09-14T11:22:55.643327+0000","last_became_active":"2024-09-14T10:45:43.682925+0000","last_became_peered":"2024-09-14T10:45:43.682925+0000","last_unstale":"2024-09-14T11:22:55.643327+0000","last_undegraded":"2024-09-14T11:22:55.643327+0000","last_fullsized":"2024-09-14T11:22:55.643327+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'335","last_scrub_stamp":"2024-09-14T11:22:55.643226+0000","last_deep_scrub":"260'335","last_deep_scrub_stamp":"2024-09-14T11:22:55.643226+0000","last_clean_scrub_stamp":"2024-09-14T11:22:55.643226+0000","objects_scrubbed":3,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:47:02.635100+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":623,"num_read_kb":1213,"num_write":1012,"num_write_kb":13029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":493,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:15.845183+0000","last_change":"2024-09-14T11:23:15.845183+0000","last_active":"2024-09-14T11:23:15.845183+0000","last_peered":"2024-09-14T11:23:15.845183+0000","last_clean":"2024-09-14T11:23:15.845183+0000","last_became_active":"2024-09-14T10:45:47.724432+0000","last_became_peered":"2024-09-14T10:45:47.724432+0000","last_unstale":"2024-09-14T11:23:15.845183+0000","last_undegraded":"2024-09-14T11:23:15.845183+0000","last_fullsized":"2024-09-14T11:23:15.845183+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:15.845093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:15.845093+0000","last_clean_scrub_stamp":"2024-09-14T11:23:15.845093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:06.714822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"260'48","reported_seq":545,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:21.684279+0000","last_change":"2024-09-14T11:23:21.684279+0000","last_active":"2024-09-14T11:23:21.684279+0000","last_peered":"2024-09-14T11:23:21.684279+0000","last_clean":"2024-09-14T11:23:21.684279+0000","last_became_active":"2024-09-14T10:45:49.735053+0000","last_became_peered":"2024-09-14T10:45:49.735053+0000","last_unstale":"2024-09-14T11:23:21.684279+0000","last_undegraded":"2024-09-14T11:23:21.684279+0000","last_fullsized":"2024-09-14T11:23:21.684279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'48","last_scrub_stamp":"2024-09-14T11:23:21.684200+0000","last_deep_scrub":"260'48","last_deep_scrub_stamp":"2024-09-14T11:23:21.684200+0000","last_clean_scrub_stamp":"2024-09-14T11:23:21.684200+0000","objects_scrubbed":3,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:18.185222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":24,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":476,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:18.488548+0000","last_change":"2024-09-14T11:23:18.488548+0000","last_active":"2024-09-14T11:23:18.488548+0000","last_peered":"2024-09-14T11:23:18.488548+0000","last_clean":"2024-09-14T11:23:18.488548+0000","last_became_active":"2024-09-14T10:45:51.747600+0000","last_became_peered":"2024-09-14T10:45:51.747600+0000","last_unstale":"2024-09-14T11:23:18.488548+0000","last_undegraded":"2024-09-14T11:23:18.488548+0000","last_fullsized":"2024-09-14T11:23:18.488548+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:18.488476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:18.488476+0000","last_clean_scrub_stamp":"2024-09-14T11:23:18.488476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:19.436085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"260'224","reported_seq":754,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:25.291231+0000","last_change":"2024-09-14T11:23:25.291172+0000","last_active":"2024-09-14T11:23:25.291231+0000","last_peered":"2024-09-14T11:23:25.291231+0000","last_clean":"2024-09-14T11:23:25.291231+0000","last_became_active":"2024-09-14T10:45:53.751504+0000","last_became_peered":"2024-09-14T10:45:53.751504+0000","last_unstale":"2024-09-14T11:23:25.291231+0000","last_undegraded":"2024-09-14T11:23:25.291231+0000","last_fullsized":"2024-09-14T11:23:25.291231+0000","mapping_epoch":34,"log_start":"260'200","ondisk_log_start":"260'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'224","last_scrub_stamp":"2024-09-14T11:23:25.291079+0000","last_deep_scrub":"260'224","last_deep_scrub_stamp":"2024-09-14T11:23:25.291079+0000","last_clean_scrub_stamp":"2024-09-14T11:23:25.291079+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:58.984777+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":402,"num_read_kb":374,"num_write":536,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"260'728","reported_seq":2181,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:04.897428+0000","last_change":"2024-09-14T11:23:04.897345+0000","last_active":"2024-09-14T11:23:04.897428+0000","last_peered":"2024-09-14T11:23:04.897428+0000","last_clean":"2024-09-14T11:23:04.897428+0000","last_became_active":"2024-09-14T10:45:45.714326+0000","last_became_peered":"2024-09-14T10:45:45.714326+0000","last_unstale":"2024-09-14T11:23:04.897428+0000","last_undegraded":"2024-09-14T11:23:04.897428+0000","last_fullsized":"2024-09-14T11:23:04.897428+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'728","last_scrub_stamp":"2024-09-14T11:23:04.897221+0000","last_deep_scrub":"260'728","last_deep_scrub_stamp":"2024-09-14T11:23:04.897221+0000","last_clean_scrub_stamp":"2024-09-14T11:23:04.897221+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":700,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:36:03.252363+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3492,"num_read_kb":3158,"num_write":966,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"260'397","reported_seq":1053,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:59.257108+0000","last_change":"2024-09-14T11:22:59.257108+0000","last_active":"2024-09-14T11:22:59.257108+0000","last_peered":"2024-09-14T11:22:59.257108+0000","last_clean":"2024-09-14T11:22:59.257108+0000","last_became_active":"2024-09-14T10:45:43.671747+0000","last_became_peered":"2024-09-14T10:45:43.671747+0000","last_unstale":"2024-09-14T11:22:59.257108+0000","last_undegraded":"2024-09-14T11:22:59.257108+0000","last_fullsized":"2024-09-14T11:22:59.257108+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'397","last_scrub_stamp":"2024-09-14T11:22:59.256989+0000","last_deep_scrub":"260'397","last_deep_scrub_stamp":"2024-09-14T11:22:59.256989+0000","last_clean_scrub_stamp":"2024-09-14T11:22:59.256989+0000","objects_scrubbed":7,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:33.390781+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":703,"num_read_kb":3196,"num_write":1248,"num_write_kb":29609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:07.246948+0000","last_change":"2024-09-14T11:23:07.246825+0000","last_active":"2024-09-14T11:23:07.246948+0000","last_peered":"2024-09-14T11:23:07.246948+0000","last_clean":"2024-09-14T11:23:07.246948+0000","last_became_active":"2024-09-14T10:45:47.731640+0000","last_became_peered":"2024-09-14T10:45:47.731640+0000","last_unstale":"2024-09-14T11:23:07.246948+0000","last_undegraded":"2024-09-14T11:23:07.246948+0000","last_fullsized":"2024-09-14T11:23:07.246948+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:07.246721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:07.246721+0000","last_clean_scrub_stamp":"2024-09-14T11:23:07.246721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:46.259045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"260'325","reported_seq":903,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:13.682072+0000","last_change":"2024-09-14T11:23:13.682072+0000","last_active":"2024-09-14T11:23:13.682072+0000","last_peered":"2024-09-14T11:23:13.682072+0000","last_clean":"2024-09-14T11:23:13.682072+0000","last_became_active":"2024-09-14T10:45:49.727431+0000","last_became_peered":"2024-09-14T10:45:49.727431+0000","last_unstale":"2024-09-14T11:23:13.682072+0000","last_undegraded":"2024-09-14T11:23:13.682072+0000","last_fullsized":"2024-09-14T11:23:13.682072+0000","mapping_epoch":30,"log_start":"260'300","ondisk_log_start":"260'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'325","last_scrub_stamp":"2024-09-14T11:23:13.681974+0000","last_deep_scrub":"260'325","last_deep_scrub_stamp":"2024-09-14T11:23:13.681974+0000","last_clean_scrub_stamp":"2024-09-14T11:23:13.681974+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:16:25.075634+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46674,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":519,"num_read_kb":1163,"num_write":422,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":485,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:24.581005+0000","last_change":"2024-09-14T11:23:24.581005+0000","last_active":"2024-09-14T11:23:24.581005+0000","last_peered":"2024-09-14T11:23:24.581005+0000","last_clean":"2024-09-14T11:23:24.581005+0000","last_became_active":"2024-09-14T10:45:51.746506+0000","last_became_peered":"2024-09-14T10:45:51.746506+0000","last_unstale":"2024-09-14T11:23:24.581005+0000","last_undegraded":"2024-09-14T11:23:24.581005+0000","last_fullsized":"2024-09-14T11:23:24.581005+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:24.580922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:24.580922+0000","last_clean_scrub_stamp":"2024-09-14T11:23:24.580922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:17:37.498334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"260'145","reported_seq":646,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:43.199787+0000","last_change":"2024-09-14T11:23:43.199787+0000","last_active":"2024-09-14T11:23:43.199787+0000","last_peered":"2024-09-14T11:23:43.199787+0000","last_clean":"2024-09-14T11:23:43.199787+0000","last_became_active":"2024-09-14T10:45:53.755018+0000","last_became_peered":"2024-09-14T10:45:53.755018+0000","last_unstale":"2024-09-14T11:23:43.199787+0000","last_undegraded":"2024-09-14T11:23:43.199787+0000","last_fullsized":"2024-09-14T11:23:43.199787+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'145","last_scrub_stamp":"2024-09-14T11:23:43.199696+0000","last_deep_scrub":"260'145","last_deep_scrub_stamp":"2024-09-14T11:23:43.199696+0000","last_clean_scrub_stamp":"2024-09-14T11:23:43.199696+0000","objects_scrubbed":1,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:13.351727+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":167,"num_write":339,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"260'401","reported_seq":1936,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:03.743737+0000","last_change":"2024-09-14T11:23:03.743647+0000","last_active":"2024-09-14T11:23:03.743737+0000","last_peered":"2024-09-14T11:23:03.743737+0000","last_clean":"2024-09-14T11:23:03.743737+0000","last_became_active":"2024-09-14T10:45:45.713138+0000","last_became_peered":"2024-09-14T10:45:45.713138+0000","last_unstale":"2024-09-14T11:23:03.743737+0000","last_undegraded":"2024-09-14T11:23:03.743737+0000","last_fullsized":"2024-09-14T11:23:03.743737+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'401","last_scrub_stamp":"2024-09-14T11:23:03.743538+0000","last_deep_scrub":"260'401","last_deep_scrub_stamp":"2024-09-14T11:23:03.743538+0000","last_clean_scrub_stamp":"2024-09-14T11:23:03.743538+0000","objects_scrubbed":1,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:26.074630+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2187,"num_read_kb":2089,"num_write":453,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"260'381","reported_seq":999,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:57.171682+0000","last_change":"2024-09-14T11:22:57.171682+0000","last_active":"2024-09-14T11:22:57.171682+0000","last_peered":"2024-09-14T11:22:57.171682+0000","last_clean":"2024-09-14T11:22:57.171682+0000","last_became_active":"2024-09-14T10:45:43.680629+0000","last_became_peered":"2024-09-14T10:45:43.680629+0000","last_unstale":"2024-09-14T11:22:57.171682+0000","last_undegraded":"2024-09-14T11:22:57.171682+0000","last_fullsized":"2024-09-14T11:22:57.171682+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'381","last_scrub_stamp":"2024-09-14T11:22:57.171580+0000","last_deep_scrub":"260'381","last_deep_scrub_stamp":"2024-09-14T11:22:57.171580+0000","last_clean_scrub_stamp":"2024-09-14T11:22:57.171580+0000","objects_scrubbed":6,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:30.709275+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133684,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":617,"num_read_kb":9938,"num_write":1232,"num_write_kb":44861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:25.180487+0000","last_change":"2024-09-14T11:23:25.180487+0000","last_active":"2024-09-14T11:23:25.180487+0000","last_peered":"2024-09-14T11:23:25.180487+0000","last_clean":"2024-09-14T11:23:25.180487+0000","last_became_active":"2024-09-14T10:45:47.727777+0000","last_became_peered":"2024-09-14T10:45:47.727777+0000","last_unstale":"2024-09-14T11:23:25.180487+0000","last_undegraded":"2024-09-14T11:23:25.180487+0000","last_fullsized":"2024-09-14T11:23:25.180487+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:25.180385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:25.180385+0000","last_clean_scrub_stamp":"2024-09-14T11:23:25.180385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:13.371559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"260'274","reported_seq":837,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:15.664884+0000","last_change":"2024-09-14T11:23:15.664884+0000","last_active":"2024-09-14T11:23:15.664884+0000","last_peered":"2024-09-14T11:23:15.664884+0000","last_clean":"2024-09-14T11:23:15.664884+0000","last_became_active":"2024-09-14T10:45:49.727347+0000","last_became_peered":"2024-09-14T10:45:49.727347+0000","last_unstale":"2024-09-14T11:23:15.664884+0000","last_undegraded":"2024-09-14T11:23:15.664884+0000","last_fullsized":"2024-09-14T11:23:15.664884+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'274","last_scrub_stamp":"2024-09-14T11:23:15.664798+0000","last_deep_scrub":"260'274","last_deep_scrub_stamp":"2024-09-14T11:23:15.664798+0000","last_clean_scrub_stamp":"2024-09-14T11:23:15.664798+0000","objects_scrubbed":4,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:54:10.815390+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44334,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":417,"num_read_kb":936,"num_write":344,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":481,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:17.617512+0000","last_change":"2024-09-14T11:23:17.617512+0000","last_active":"2024-09-14T11:23:17.617512+0000","last_peered":"2024-09-14T11:23:17.617512+0000","last_clean":"2024-09-14T11:23:17.617512+0000","last_became_active":"2024-09-14T10:45:51.746493+0000","last_became_peered":"2024-09-14T10:45:51.746493+0000","last_unstale":"2024-09-14T11:23:17.617512+0000","last_undegraded":"2024-09-14T11:23:17.617512+0000","last_fullsized":"2024-09-14T11:23:17.617512+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:17.617397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:17.617397+0000","last_clean_scrub_stamp":"2024-09-14T11:23:17.617397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:45.334822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"260'407","reported_seq":1986,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:18.172629+0000","last_change":"2024-09-14T11:23:18.172629+0000","last_active":"2024-09-14T11:23:18.172629+0000","last_peered":"2024-09-14T11:23:18.172629+0000","last_clean":"2024-09-14T11:23:18.172629+0000","last_became_active":"2024-09-14T10:45:45.725430+0000","last_became_peered":"2024-09-14T10:45:45.725430+0000","last_unstale":"2024-09-14T11:23:18.172629+0000","last_undegraded":"2024-09-14T11:23:18.172629+0000","last_fullsized":"2024-09-14T11:23:18.172629+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'407","last_scrub_stamp":"2024-09-14T11:23:18.172553+0000","last_deep_scrub":"260'407","last_deep_scrub_stamp":"2024-09-14T11:23:18.172553+0000","last_clean_scrub_stamp":"2024-09-14T11:23:18.172553+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:03.784478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2252,"num_read_kb":2164,"num_write":454,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"260'321","reported_seq":945,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:59.248925+0000","last_change":"2024-09-14T11:22:59.248925+0000","last_active":"2024-09-14T11:22:59.248925+0000","last_peered":"2024-09-14T11:22:59.248925+0000","last_clean":"2024-09-14T11:22:59.248925+0000","last_became_active":"2024-09-14T10:45:43.683988+0000","last_became_peered":"2024-09-14T10:45:43.683988+0000","last_unstale":"2024-09-14T11:22:59.248925+0000","last_undegraded":"2024-09-14T11:22:59.248925+0000","last_fullsized":"2024-09-14T11:22:59.248925+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'321","last_scrub_stamp":"2024-09-14T11:22:59.248787+0000","last_deep_scrub":"260'321","last_deep_scrub_stamp":"2024-09-14T11:22:59.248787+0000","last_clean_scrub_stamp":"2024-09-14T11:22:59.248787+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:00.495190+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":562,"num_read_kb":32573,"num_write":1061,"num_write_kb":14583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":490,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:15.227737+0000","last_change":"2024-09-14T11:23:15.227653+0000","last_active":"2024-09-14T11:23:15.227737+0000","last_peered":"2024-09-14T11:23:15.227737+0000","last_clean":"2024-09-14T11:23:15.227737+0000","last_became_active":"2024-09-14T10:45:47.728323+0000","last_became_peered":"2024-09-14T10:45:47.728323+0000","last_unstale":"2024-09-14T11:23:15.227737+0000","last_undegraded":"2024-09-14T11:23:15.227737+0000","last_fullsized":"2024-09-14T11:23:15.227737+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:15.227516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:15.227516+0000","last_clean_scrub_stamp":"2024-09-14T11:23:15.227516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:27:28.550391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"260'494","reported_seq":1110,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:17.288328+0000","last_change":"2024-09-14T11:23:17.288281+0000","last_active":"2024-09-14T11:23:17.288328+0000","last_peered":"2024-09-14T11:23:17.288328+0000","last_clean":"2024-09-14T11:23:17.288328+0000","last_became_active":"2024-09-14T10:45:49.728841+0000","last_became_peered":"2024-09-14T10:45:49.728841+0000","last_unstale":"2024-09-14T11:23:17.288328+0000","last_undegraded":"2024-09-14T11:23:17.288328+0000","last_fullsized":"2024-09-14T11:23:17.288328+0000","mapping_epoch":30,"log_start":"260'400","ondisk_log_start":"260'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'494","last_scrub_stamp":"2024-09-14T11:23:17.288177+0000","last_deep_scrub":"260'494","last_deep_scrub_stamp":"2024-09-14T11:23:17.288177+0000","last_clean_scrub_stamp":"2024-09-14T11:23:17.288177+0000","objects_scrubbed":6,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:37.878286+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98061,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":894,"num_read_kb":2175,"num_write":778,"num_write_kb":715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":475,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:17.452522+0000","last_change":"2024-09-14T11:23:17.452438+0000","last_active":"2024-09-14T11:23:17.452522+0000","last_peered":"2024-09-14T11:23:17.452522+0000","last_clean":"2024-09-14T11:23:17.452522+0000","last_became_active":"2024-09-14T10:45:51.751776+0000","last_became_peered":"2024-09-14T10:45:51.751776+0000","last_unstale":"2024-09-14T11:23:17.452522+0000","last_undegraded":"2024-09-14T11:23:17.452522+0000","last_fullsized":"2024-09-14T11:23:17.452522+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:17.452340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:17.452340+0000","last_clean_scrub_stamp":"2024-09-14T11:23:17.452340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:14.236792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"260'173","reported_seq":677,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:33.540686+0000","last_change":"2024-09-14T11:23:33.540686+0000","last_active":"2024-09-14T11:23:33.540686+0000","last_peered":"2024-09-14T11:23:33.540686+0000","last_clean":"2024-09-14T11:23:33.540686+0000","last_became_active":"2024-09-14T10:45:53.752535+0000","last_became_peered":"2024-09-14T10:45:53.752535+0000","last_unstale":"2024-09-14T11:23:33.540686+0000","last_undegraded":"2024-09-14T11:23:33.540686+0000","last_fullsized":"2024-09-14T11:23:33.540686+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'173","last_scrub_stamp":"2024-09-14T11:23:33.540563+0000","last_deep_scrub":"260'173","last_deep_scrub_stamp":"2024-09-14T11:23:33.540563+0000","last_clean_scrub_stamp":"2024-09-14T11:23:33.540563+0000","objects_scrubbed":3,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:40.867238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":217,"num_read_kb":213,"num_write":386,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"260'443","reported_seq":2096,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:06.861671+0000","last_change":"2024-09-14T11:23:06.861605+0000","last_active":"2024-09-14T11:23:06.861671+0000","last_peered":"2024-09-14T11:23:06.861671+0000","last_clean":"2024-09-14T11:23:06.861671+0000","last_became_active":"2024-09-14T10:45:45.710498+0000","last_became_peered":"2024-09-14T10:45:45.710498+0000","last_unstale":"2024-09-14T11:23:06.861671+0000","last_undegraded":"2024-09-14T11:23:06.861671+0000","last_fullsized":"2024-09-14T11:23:06.861671+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'443","last_scrub_stamp":"2024-09-14T11:23:06.861513+0000","last_deep_scrub":"260'443","last_deep_scrub_stamp":"2024-09-14T11:23:06.861513+0000","last_clean_scrub_stamp":"2024-09-14T11:23:06.861513+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:22.830553+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2391,"num_read_kb":2291,"num_write":487,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"260'417","reported_seq":1179,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:08.794625+0000","last_change":"2024-09-14T11:23:08.794625+0000","last_active":"2024-09-14T11:23:08.794625+0000","last_peered":"2024-09-14T11:23:08.794625+0000","last_clean":"2024-09-14T11:23:08.794625+0000","last_became_active":"2024-09-14T10:45:43.688136+0000","last_became_peered":"2024-09-14T10:45:43.688136+0000","last_unstale":"2024-09-14T11:23:08.794625+0000","last_undegraded":"2024-09-14T11:23:08.794625+0000","last_fullsized":"2024-09-14T11:23:08.794625+0000","mapping_epoch":23,"log_start":"260'400","ondisk_log_start":"260'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'417","last_scrub_stamp":"2024-09-14T11:23:08.794535+0000","last_deep_scrub":"260'417","last_deep_scrub_stamp":"2024-09-14T11:23:08.794535+0000","last_clean_scrub_stamp":"2024-09-14T11:23:08.794535+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:10:34.992113+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1055,"num_read_kb":62488,"num_write":1345,"num_write_kb":26359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":486,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:10.380555+0000","last_change":"2024-09-14T11:23:10.380490+0000","last_active":"2024-09-14T11:23:10.380555+0000","last_peered":"2024-09-14T11:23:10.380555+0000","last_clean":"2024-09-14T11:23:10.380555+0000","last_became_active":"2024-09-14T10:45:47.725711+0000","last_became_peered":"2024-09-14T10:45:47.725711+0000","last_unstale":"2024-09-14T11:23:10.380555+0000","last_undegraded":"2024-09-14T11:23:10.380555+0000","last_fullsized":"2024-09-14T11:23:10.380555+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:10.380391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:10.380391+0000","last_clean_scrub_stamp":"2024-09-14T11:23:10.380391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:13:32.547617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"260'290","reported_seq":857,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:32.287964+0000","last_change":"2024-09-14T11:23:32.287964+0000","last_active":"2024-09-14T11:23:32.287964+0000","last_peered":"2024-09-14T11:23:32.287964+0000","last_clean":"2024-09-14T11:23:32.287964+0000","last_became_active":"2024-09-14T10:45:49.729803+0000","last_became_peered":"2024-09-14T10:45:49.729803+0000","last_unstale":"2024-09-14T11:23:32.287964+0000","last_undegraded":"2024-09-14T11:23:32.287964+0000","last_fullsized":"2024-09-14T11:23:32.287964+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'290","last_scrub_stamp":"2024-09-14T11:23:32.287847+0000","last_deep_scrub":"260'290","last_deep_scrub_stamp":"2024-09-14T11:23:32.287847+0000","last_clean_scrub_stamp":"2024-09-14T11:23:32.287847+0000","objects_scrubbed":8,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:07.364568+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50521,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":465,"num_read_kb":1032,"num_write":388,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":477,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:28.553892+0000","last_change":"2024-09-14T11:23:28.553892+0000","last_active":"2024-09-14T11:23:28.553892+0000","last_peered":"2024-09-14T11:23:28.553892+0000","last_clean":"2024-09-14T11:23:28.553892+0000","last_became_active":"2024-09-14T10:45:51.748871+0000","last_became_peered":"2024-09-14T10:45:51.748871+0000","last_unstale":"2024-09-14T11:23:28.553892+0000","last_undegraded":"2024-09-14T11:23:28.553892+0000","last_fullsized":"2024-09-14T11:23:28.553892+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:28.553789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:28.553789+0000","last_clean_scrub_stamp":"2024-09-14T11:23:28.553789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:07.534731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"260'214","reported_seq":1076,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:40.213886+0000","last_change":"2024-09-14T11:23:40.213886+0000","last_active":"2024-09-14T11:23:40.213886+0000","last_peered":"2024-09-14T11:23:40.213886+0000","last_clean":"2024-09-14T11:23:40.213886+0000","last_became_active":"2024-09-14T10:45:53.750595+0000","last_became_peered":"2024-09-14T10:45:53.750595+0000","last_unstale":"2024-09-14T11:23:40.213886+0000","last_undegraded":"2024-09-14T11:23:40.213886+0000","last_fullsized":"2024-09-14T11:23:40.213886+0000","mapping_epoch":34,"log_start":"260'200","ondisk_log_start":"260'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'214","last_scrub_stamp":"2024-09-14T11:23:40.213792+0000","last_deep_scrub":"260'214","last_deep_scrub_stamp":"2024-09-14T11:23:40.213792+0000","last_clean_scrub_stamp":"2024-09-14T11:23:40.213792+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:15.484099+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1617,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":634,"num_read_kb":624,"num_write":573,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"260'1184","reported_seq":2754,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:05.739710+0000","last_change":"2024-09-14T11:23:05.739650+0000","last_active":"2024-09-14T11:23:05.739710+0000","last_peered":"2024-09-14T11:23:05.739710+0000","last_clean":"2024-09-14T11:23:05.739710+0000","last_became_active":"2024-09-14T10:45:45.721945+0000","last_became_peered":"2024-09-14T10:45:45.721945+0000","last_unstale":"2024-09-14T11:23:05.739710+0000","last_undegraded":"2024-09-14T11:23:05.739710+0000","last_fullsized":"2024-09-14T11:23:05.739710+0000","mapping_epoch":26,"log_start":"260'1100","ondisk_log_start":"260'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1184","last_scrub_stamp":"2024-09-14T11:23:05.739562+0000","last_deep_scrub":"260'1184","last_deep_scrub_stamp":"2024-09-14T11:23:05.739562+0000","last_clean_scrub_stamp":"2024-09-14T11:23:05.739562+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":1100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:11.326591+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5490,"num_read_kb":4869,"num_write":1672,"num_write_kb":727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"260'342","reported_seq":985,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:57.727489+0000","last_change":"2024-09-14T11:22:57.727410+0000","last_active":"2024-09-14T11:22:57.727489+0000","last_peered":"2024-09-14T11:22:57.727489+0000","last_clean":"2024-09-14T11:22:57.727489+0000","last_became_active":"2024-09-14T10:45:43.682457+0000","last_became_peered":"2024-09-14T10:45:43.682457+0000","last_unstale":"2024-09-14T11:22:57.727489+0000","last_undegraded":"2024-09-14T11:22:57.727489+0000","last_fullsized":"2024-09-14T11:22:57.727489+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'342","last_scrub_stamp":"2024-09-14T11:22:57.727319+0000","last_deep_scrub":"260'342","last_deep_scrub_stamp":"2024-09-14T11:22:57.727319+0000","last_clean_scrub_stamp":"2024-09-14T11:22:57.727319+0000","objects_scrubbed":8,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:06.095427+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":582,"num_read_kb":98004,"num_write":1175,"num_write_kb":36067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":483,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:09.333304+0000","last_change":"2024-09-14T11:23:09.333221+0000","last_active":"2024-09-14T11:23:09.333304+0000","last_peered":"2024-09-14T11:23:09.333304+0000","last_clean":"2024-09-14T11:23:09.333304+0000","last_became_active":"2024-09-14T10:45:47.726635+0000","last_became_peered":"2024-09-14T10:45:47.726635+0000","last_unstale":"2024-09-14T11:23:09.333304+0000","last_undegraded":"2024-09-14T11:23:09.333304+0000","last_fullsized":"2024-09-14T11:23:09.333304+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:09.333109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:09.333109+0000","last_clean_scrub_stamp":"2024-09-14T11:23:09.333109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:29.617159+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"260'278","reported_seq":840,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:18.241724+0000","last_change":"2024-09-14T11:23:18.241663+0000","last_active":"2024-09-14T11:23:18.241724+0000","last_peered":"2024-09-14T11:23:18.241724+0000","last_clean":"2024-09-14T11:23:18.241724+0000","last_became_active":"2024-09-14T10:45:49.729422+0000","last_became_peered":"2024-09-14T10:45:49.729422+0000","last_unstale":"2024-09-14T11:23:18.241724+0000","last_undegraded":"2024-09-14T11:23:18.241724+0000","last_fullsized":"2024-09-14T11:23:18.241724+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'278","last_scrub_stamp":"2024-09-14T11:23:18.241562+0000","last_deep_scrub":"260'278","last_deep_scrub_stamp":"2024-09-14T11:23:18.241562+0000","last_clean_scrub_stamp":"2024-09-14T11:23:18.241562+0000","objects_scrubbed":5,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:10.259911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45487,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":456,"num_read_kb":1073,"num_write":374,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:18.604912+0000","last_change":"2024-09-14T11:23:18.604850+0000","last_active":"2024-09-14T11:23:18.604912+0000","last_peered":"2024-09-14T11:23:18.604912+0000","last_clean":"2024-09-14T11:23:18.604912+0000","last_became_active":"2024-09-14T10:45:51.747888+0000","last_became_peered":"2024-09-14T10:45:51.747888+0000","last_unstale":"2024-09-14T11:23:18.604912+0000","last_undegraded":"2024-09-14T11:23:18.604912+0000","last_fullsized":"2024-09-14T11:23:18.604912+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:18.604749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:18.604749+0000","last_clean_scrub_stamp":"2024-09-14T11:23:18.604749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:16:45.867833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"260'129","reported_seq":609,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:39.190296+0000","last_change":"2024-09-14T11:23:39.190296+0000","last_active":"2024-09-14T11:23:39.190296+0000","last_peered":"2024-09-14T11:23:39.190296+0000","last_clean":"2024-09-14T11:23:39.190296+0000","last_became_active":"2024-09-14T10:45:53.749868+0000","last_became_peered":"2024-09-14T10:45:53.749868+0000","last_unstale":"2024-09-14T11:23:39.190296+0000","last_undegraded":"2024-09-14T11:23:39.190296+0000","last_fullsized":"2024-09-14T11:23:39.190296+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'129","last_scrub_stamp":"2024-09-14T11:23:39.190227+0000","last_deep_scrub":"260'129","last_deep_scrub_stamp":"2024-09-14T11:23:39.190227+0000","last_clean_scrub_stamp":"2024-09-14T11:23:39.190227+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:33.524402+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":111,"num_write":304,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"260'1125","reported_seq":2695,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:07.821294+0000","last_change":"2024-09-14T11:23:07.821236+0000","last_active":"2024-09-14T11:23:07.821294+0000","last_peered":"2024-09-14T11:23:07.821294+0000","last_clean":"2024-09-14T11:23:07.821294+0000","last_became_active":"2024-09-14T10:45:45.711476+0000","last_became_peered":"2024-09-14T10:45:45.711476+0000","last_unstale":"2024-09-14T11:23:07.821294+0000","last_undegraded":"2024-09-14T11:23:07.821294+0000","last_fullsized":"2024-09-14T11:23:07.821294+0000","mapping_epoch":26,"log_start":"260'1100","ondisk_log_start":"260'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1125","last_scrub_stamp":"2024-09-14T11:23:07.821153+0000","last_deep_scrub":"260'1125","last_deep_scrub_stamp":"2024-09-14T11:23:07.821153+0000","last_clean_scrub_stamp":"2024-09-14T11:23:07.821153+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":1100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:28.830288+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5159,"num_read_kb":4588,"num_write":1521,"num_write_kb":611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"260'327","reported_seq":1011,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:59.994822+0000","last_change":"2024-09-14T11:22:59.994756+0000","last_active":"2024-09-14T11:22:59.994822+0000","last_peered":"2024-09-14T11:22:59.994822+0000","last_clean":"2024-09-14T11:22:59.994822+0000","last_became_active":"2024-09-14T10:45:43.691976+0000","last_became_peered":"2024-09-14T10:45:43.691976+0000","last_unstale":"2024-09-14T11:22:59.994822+0000","last_undegraded":"2024-09-14T11:22:59.994822+0000","last_fullsized":"2024-09-14T11:22:59.994822+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'327","last_scrub_stamp":"2024-09-14T11:22:59.994673+0000","last_deep_scrub":"260'327","last_deep_scrub_stamp":"2024-09-14T11:22:59.994673+0000","last_clean_scrub_stamp":"2024-09-14T11:22:59.994673+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:18.919121+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":740,"num_read_kb":9027,"num_write":1110,"num_write_kb":58772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":492,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:19.749532+0000","last_change":"2024-09-14T11:23:19.749476+0000","last_active":"2024-09-14T11:23:19.749532+0000","last_peered":"2024-09-14T11:23:19.749532+0000","last_clean":"2024-09-14T11:23:19.749532+0000","last_became_active":"2024-09-14T10:45:47.726392+0000","last_became_peered":"2024-09-14T10:45:47.726392+0000","last_unstale":"2024-09-14T11:23:19.749532+0000","last_undegraded":"2024-09-14T11:23:19.749532+0000","last_fullsized":"2024-09-14T11:23:19.749532+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:19.749384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:19.749384+0000","last_clean_scrub_stamp":"2024-09-14T11:23:19.749384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:44:44.489992+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"260'86","reported_seq":592,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:33.242212+0000","last_change":"2024-09-14T11:23:33.242113+0000","last_active":"2024-09-14T11:23:33.242212+0000","last_peered":"2024-09-14T11:23:33.242212+0000","last_clean":"2024-09-14T11:23:33.242212+0000","last_became_active":"2024-09-14T10:45:49.728444+0000","last_became_peered":"2024-09-14T10:45:49.728444+0000","last_unstale":"2024-09-14T11:23:33.242212+0000","last_undegraded":"2024-09-14T11:23:33.242212+0000","last_fullsized":"2024-09-14T11:23:33.242212+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'86","last_scrub_stamp":"2024-09-14T11:23:33.241982+0000","last_deep_scrub":"260'86","last_deep_scrub_stamp":"2024-09-14T11:23:33.241982+0000","last_clean_scrub_stamp":"2024-09-14T11:23:33.241982+0000","objects_scrubbed":7,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:30.428016+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":102,"num_read_kb":95,"num_write":120,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"260'795","reported_seq":2274,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:17.627562+0000","last_change":"2024-09-14T11:23:17.627509+0000","last_active":"2024-09-14T11:23:17.627562+0000","last_peered":"2024-09-14T11:23:17.627562+0000","last_clean":"2024-09-14T11:23:17.627562+0000","last_became_active":"2024-09-14T10:45:51.746303+0000","last_became_peered":"2024-09-14T10:45:51.746303+0000","last_unstale":"2024-09-14T11:23:17.627562+0000","last_undegraded":"2024-09-14T11:23:17.627562+0000","last_fullsized":"2024-09-14T11:23:17.627562+0000","mapping_epoch":32,"log_start":"260'700","ondisk_log_start":"260'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'795","last_scrub_stamp":"2024-09-14T11:23:17.627416+0000","last_deep_scrub":"260'795","last_deep_scrub_stamp":"2024-09-14T11:23:17.627416+0000","last_clean_scrub_stamp":"2024-09-14T11:23:17.627416+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:25.589494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"260'120","reported_seq":605,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:38.201114+0000","last_change":"2024-09-14T11:23:38.201114+0000","last_active":"2024-09-14T11:23:38.201114+0000","last_peered":"2024-09-14T11:23:38.201114+0000","last_clean":"2024-09-14T11:23:38.201114+0000","last_became_active":"2024-09-14T10:45:53.751453+0000","last_became_peered":"2024-09-14T10:45:53.751453+0000","last_unstale":"2024-09-14T11:23:38.201114+0000","last_undegraded":"2024-09-14T11:23:38.201114+0000","last_fullsized":"2024-09-14T11:23:38.201114+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'120","last_scrub_stamp":"2024-09-14T11:23:38.201006+0000","last_deep_scrub":"260'120","last_deep_scrub_stamp":"2024-09-14T11:23:38.201006+0000","last_clean_scrub_stamp":"2024-09-14T11:23:38.201006+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:19.464909+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":104,"num_write":274,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"260'446","reported_seq":2023,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:16.481462+0000","last_change":"2024-09-14T11:23:16.481462+0000","last_active":"2024-09-14T11:23:16.481462+0000","last_peered":"2024-09-14T11:23:16.481462+0000","last_clean":"2024-09-14T11:23:16.481462+0000","last_became_active":"2024-09-14T10:45:45.725806+0000","last_became_peered":"2024-09-14T10:45:45.725806+0000","last_unstale":"2024-09-14T11:23:16.481462+0000","last_undegraded":"2024-09-14T11:23:16.481462+0000","last_fullsized":"2024-09-14T11:23:16.481462+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'446","last_scrub_stamp":"2024-09-14T11:23:16.481367+0000","last_deep_scrub":"260'446","last_deep_scrub_stamp":"2024-09-14T11:23:16.481367+0000","last_clean_scrub_stamp":"2024-09-14T11:23:16.481367+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:41.381657+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2489,"num_read_kb":2350,"num_write":523,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2807,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"260'377","reported_seq":1047,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:58.683943+0000","last_change":"2024-09-14T11:22:58.683861+0000","last_active":"2024-09-14T11:22:58.683943+0000","last_peered":"2024-09-14T11:22:58.683943+0000","last_clean":"2024-09-14T11:22:58.683943+0000","last_became_active":"2024-09-14T10:45:43.686768+0000","last_became_peered":"2024-09-14T10:45:43.686768+0000","last_unstale":"2024-09-14T11:22:58.683943+0000","last_undegraded":"2024-09-14T11:22:58.683943+0000","last_fullsized":"2024-09-14T11:22:58.683943+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'377","last_scrub_stamp":"2024-09-14T11:22:58.683760+0000","last_deep_scrub":"260'377","last_deep_scrub_stamp":"2024-09-14T11:22:58.683760+0000","last_clean_scrub_stamp":"2024-09-14T11:22:58.683760+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:01:12.820519+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":721,"num_read_kb":58950,"num_write":1313,"num_write_kb":32402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":492,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:13.574287+0000","last_change":"2024-09-14T11:23:13.574206+0000","last_active":"2024-09-14T11:23:13.574287+0000","last_peered":"2024-09-14T11:23:13.574287+0000","last_clean":"2024-09-14T11:23:13.574287+0000","last_became_active":"2024-09-14T10:45:47.718721+0000","last_became_peered":"2024-09-14T10:45:47.718721+0000","last_unstale":"2024-09-14T11:23:13.574287+0000","last_undegraded":"2024-09-14T11:23:13.574287+0000","last_fullsized":"2024-09-14T11:23:13.574287+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:13.574095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:13.574095+0000","last_clean_scrub_stamp":"2024-09-14T11:23:13.574095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:02.935904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"260'301","reported_seq":875,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:16.621324+0000","last_change":"2024-09-14T11:23:16.621324+0000","last_active":"2024-09-14T11:23:16.621324+0000","last_peered":"2024-09-14T11:23:16.621324+0000","last_clean":"2024-09-14T11:23:16.621324+0000","last_became_active":"2024-09-14T10:45:49.733684+0000","last_became_peered":"2024-09-14T10:45:49.733684+0000","last_unstale":"2024-09-14T11:23:16.621324+0000","last_undegraded":"2024-09-14T11:23:16.621324+0000","last_fullsized":"2024-09-14T11:23:16.621324+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'301","last_scrub_stamp":"2024-09-14T11:23:16.621219+0000","last_deep_scrub":"260'301","last_deep_scrub_stamp":"2024-09-14T11:23:16.621219+0000","last_clean_scrub_stamp":"2024-09-14T11:23:16.621219+0000","objects_scrubbed":9,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:25.617980+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49376,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":469,"num_read_kb":1024,"num_write":384,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:29.682829+0000","last_change":"2024-09-14T11:23:29.682829+0000","last_active":"2024-09-14T11:23:29.682829+0000","last_peered":"2024-09-14T11:23:29.682829+0000","last_clean":"2024-09-14T11:23:29.682829+0000","last_became_active":"2024-09-14T10:45:51.741767+0000","last_became_peered":"2024-09-14T10:45:51.741767+0000","last_unstale":"2024-09-14T11:23:29.682829+0000","last_undegraded":"2024-09-14T11:23:29.682829+0000","last_fullsized":"2024-09-14T11:23:29.682829+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:29.682725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:29.682725+0000","last_clean_scrub_stamp":"2024-09-14T11:23:29.682725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:17:16.361535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"260'130","reported_seq":630,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:23.555796+0000","last_change":"2024-09-14T11:23:23.555796+0000","last_active":"2024-09-14T11:23:23.555796+0000","last_peered":"2024-09-14T11:23:23.555796+0000","last_clean":"2024-09-14T11:23:23.555796+0000","last_became_active":"2024-09-14T10:45:53.748760+0000","last_became_peered":"2024-09-14T10:45:53.748760+0000","last_unstale":"2024-09-14T11:23:23.555796+0000","last_undegraded":"2024-09-14T11:23:23.555796+0000","last_fullsized":"2024-09-14T11:23:23.555796+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'130","last_scrub_stamp":"2024-09-14T11:23:23.555688+0000","last_deep_scrub":"260'130","last_deep_scrub_stamp":"2024-09-14T11:23:23.555688+0000","last_clean_scrub_stamp":"2024-09-14T11:23:23.555688+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:48.933012+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":155,"num_read_kb":143,"num_write":309,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"260'789","reported_seq":2308,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:05.246738+0000","last_change":"2024-09-14T11:23:05.246681+0000","last_active":"2024-09-14T11:23:05.246738+0000","last_peered":"2024-09-14T11:23:05.246738+0000","last_clean":"2024-09-14T11:23:05.246738+0000","last_became_active":"2024-09-14T10:45:45.717706+0000","last_became_peered":"2024-09-14T10:45:45.717706+0000","last_unstale":"2024-09-14T11:23:05.246738+0000","last_undegraded":"2024-09-14T11:23:05.246738+0000","last_fullsized":"2024-09-14T11:23:05.246738+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'789","last_scrub_stamp":"2024-09-14T11:23:05.246600+0000","last_deep_scrub":"260'789","last_deep_scrub_stamp":"2024-09-14T11:23:05.246600+0000","last_clean_scrub_stamp":"2024-09-14T11:23:05.246600+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:29.764214+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3708,"num_read_kb":3358,"num_write":1019,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"260'345","reported_seq":960,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:07.145079+0000","last_change":"2024-09-14T11:23:07.145011+0000","last_active":"2024-09-14T11:23:07.145079+0000","last_peered":"2024-09-14T11:23:07.145079+0000","last_clean":"2024-09-14T11:23:07.145079+0000","last_became_active":"2024-09-14T10:45:43.683014+0000","last_became_peered":"2024-09-14T10:45:43.683014+0000","last_unstale":"2024-09-14T11:23:07.145079+0000","last_undegraded":"2024-09-14T11:23:07.145079+0000","last_fullsized":"2024-09-14T11:23:07.145079+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'345","last_scrub_stamp":"2024-09-14T11:23:07.144903+0000","last_deep_scrub":"260'345","last_deep_scrub_stamp":"2024-09-14T11:23:07.144903+0000","last_clean_scrub_stamp":"2024-09-14T11:23:07.144903+0000","objects_scrubbed":4,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:22.680885+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133668,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":545,"num_read_kb":15772,"num_write":997,"num_write_kb":32563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":483,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:21.471921+0000","last_change":"2024-09-14T11:23:21.471921+0000","last_active":"2024-09-14T11:23:21.471921+0000","last_peered":"2024-09-14T11:23:21.471921+0000","last_clean":"2024-09-14T11:23:21.471921+0000","last_became_active":"2024-09-14T10:45:47.725850+0000","last_became_peered":"2024-09-14T10:45:47.725850+0000","last_unstale":"2024-09-14T11:23:21.471921+0000","last_undegraded":"2024-09-14T11:23:21.471921+0000","last_fullsized":"2024-09-14T11:23:21.471921+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:21.471821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:21.471821+0000","last_clean_scrub_stamp":"2024-09-14T11:23:21.471821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:22.616539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"260'262","reported_seq":823,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:26.705256+0000","last_change":"2024-09-14T11:23:26.705256+0000","last_active":"2024-09-14T11:23:26.705256+0000","last_peered":"2024-09-14T11:23:26.705256+0000","last_clean":"2024-09-14T11:23:26.705256+0000","last_became_active":"2024-09-14T10:45:49.736538+0000","last_became_peered":"2024-09-14T10:45:49.736538+0000","last_unstale":"2024-09-14T11:23:26.705256+0000","last_undegraded":"2024-09-14T11:23:26.705256+0000","last_fullsized":"2024-09-14T11:23:26.705256+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'262","last_scrub_stamp":"2024-09-14T11:23:26.705160+0000","last_deep_scrub":"260'262","last_deep_scrub_stamp":"2024-09-14T11:23:26.705160+0000","last_clean_scrub_stamp":"2024-09-14T11:23:26.705160+0000","objects_scrubbed":4,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:32.407412+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45998,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":425,"num_read_kb":1014,"num_write":348,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:36.262292+0000","last_change":"2024-09-14T11:23:36.262292+0000","last_active":"2024-09-14T11:23:36.262292+0000","last_peered":"2024-09-14T11:23:36.262292+0000","last_clean":"2024-09-14T11:23:36.262292+0000","last_became_active":"2024-09-14T10:45:51.744957+0000","last_became_peered":"2024-09-14T10:45:51.744957+0000","last_unstale":"2024-09-14T11:23:36.262292+0000","last_undegraded":"2024-09-14T11:23:36.262292+0000","last_fullsized":"2024-09-14T11:23:36.262292+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:36.262199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:36.262199+0000","last_clean_scrub_stamp":"2024-09-14T11:23:36.262199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:17.442538+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"260'127","reported_seq":635,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:34.523851+0000","last_change":"2024-09-14T11:23:34.523851+0000","last_active":"2024-09-14T11:23:34.523851+0000","last_peered":"2024-09-14T11:23:34.523851+0000","last_clean":"2024-09-14T11:23:34.523851+0000","last_became_active":"2024-09-14T10:45:53.750287+0000","last_became_peered":"2024-09-14T10:45:53.750287+0000","last_unstale":"2024-09-14T11:23:34.523851+0000","last_undegraded":"2024-09-14T11:23:34.523851+0000","last_fullsized":"2024-09-14T11:23:34.523851+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'127","last_scrub_stamp":"2024-09-14T11:23:34.523747+0000","last_deep_scrub":"260'127","last_deep_scrub_stamp":"2024-09-14T11:23:34.523747+0000","last_clean_scrub_stamp":"2024-09-14T11:23:34.523747+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:44.520637+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":175,"num_read_kb":170,"num_write":297,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"260'392","reported_seq":1851,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:04.722892+0000","last_change":"2024-09-14T11:23:04.722892+0000","last_active":"2024-09-14T11:23:04.722892+0000","last_peered":"2024-09-14T11:23:04.722892+0000","last_clean":"2024-09-14T11:23:04.722892+0000","last_became_active":"2024-09-14T10:45:45.712455+0000","last_became_peered":"2024-09-14T10:45:45.712455+0000","last_unstale":"2024-09-14T11:23:04.722892+0000","last_undegraded":"2024-09-14T11:23:04.722892+0000","last_fullsized":"2024-09-14T11:23:04.722892+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'392","last_scrub_stamp":"2024-09-14T11:23:04.722800+0000","last_deep_scrub":"260'392","last_deep_scrub_stamp":"2024-09-14T11:23:04.722800+0000","last_clean_scrub_stamp":"2024-09-14T11:23:04.722800+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:20.257987+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2172,"num_read_kb":2052,"num_write":470,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"260'356","reported_seq":1012,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:00.292249+0000","last_change":"2024-09-14T11:23:00.292166+0000","last_active":"2024-09-14T11:23:00.292249+0000","last_peered":"2024-09-14T11:23:00.292249+0000","last_clean":"2024-09-14T11:23:00.292249+0000","last_became_active":"2024-09-14T10:45:43.676145+0000","last_became_peered":"2024-09-14T10:45:43.676145+0000","last_unstale":"2024-09-14T11:23:00.292249+0000","last_undegraded":"2024-09-14T11:23:00.292249+0000","last_fullsized":"2024-09-14T11:23:00.292249+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'356","last_scrub_stamp":"2024-09-14T11:23:00.292074+0000","last_deep_scrub":"260'356","last_deep_scrub_stamp":"2024-09-14T11:23:00.292074+0000","last_clean_scrub_stamp":"2024-09-14T11:23:00.292074+0000","objects_scrubbed":5,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:47.860832+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133740,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":675,"num_read_kb":38975,"num_write":1181,"num_write_kb":36099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":492,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:11.644849+0000","last_change":"2024-09-14T11:23:11.644849+0000","last_active":"2024-09-14T11:23:11.644849+0000","last_peered":"2024-09-14T11:23:11.644849+0000","last_clean":"2024-09-14T11:23:11.644849+0000","last_became_active":"2024-09-14T10:45:47.724065+0000","last_became_peered":"2024-09-14T10:45:47.724065+0000","last_unstale":"2024-09-14T11:23:11.644849+0000","last_undegraded":"2024-09-14T11:23:11.644849+0000","last_fullsized":"2024-09-14T11:23:11.644849+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:11.644749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:11.644749+0000","last_clean_scrub_stamp":"2024-09-14T11:23:11.644749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:54.396791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"260'240","reported_seq":787,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:16.224647+0000","last_change":"2024-09-14T11:23:16.224587+0000","last_active":"2024-09-14T11:23:16.224647+0000","last_peered":"2024-09-14T11:23:16.224647+0000","last_clean":"2024-09-14T11:23:16.224647+0000","last_became_active":"2024-09-14T10:45:49.727721+0000","last_became_peered":"2024-09-14T10:45:49.727721+0000","last_unstale":"2024-09-14T11:23:16.224647+0000","last_undegraded":"2024-09-14T11:23:16.224647+0000","last_fullsized":"2024-09-14T11:23:16.224647+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'240","last_scrub_stamp":"2024-09-14T11:23:16.224504+0000","last_deep_scrub":"260'240","last_deep_scrub_stamp":"2024-09-14T11:23:16.224504+0000","last_clean_scrub_stamp":"2024-09-14T11:23:16.224504+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:07.387698+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47218,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":415,"num_read_kb":1017,"num_write":344,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":478,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:37.230678+0000","last_change":"2024-09-14T11:23:37.230678+0000","last_active":"2024-09-14T11:23:37.230678+0000","last_peered":"2024-09-14T11:23:37.230678+0000","last_clean":"2024-09-14T11:23:37.230678+0000","last_became_active":"2024-09-14T10:45:51.742387+0000","last_became_peered":"2024-09-14T10:45:51.742387+0000","last_unstale":"2024-09-14T11:23:37.230678+0000","last_undegraded":"2024-09-14T11:23:37.230678+0000","last_fullsized":"2024-09-14T11:23:37.230678+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:37.230587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:37.230587+0000","last_clean_scrub_stamp":"2024-09-14T11:23:37.230587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:21.629906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"260'163","reported_seq":1266,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:42.237809+0000","last_change":"2024-09-14T11:23:42.237809+0000","last_active":"2024-09-14T11:23:42.237809+0000","last_peered":"2024-09-14T11:23:42.237809+0000","last_clean":"2024-09-14T11:23:42.237809+0000","last_became_active":"2024-09-14T10:45:53.752639+0000","last_became_peered":"2024-09-14T10:45:53.752639+0000","last_unstale":"2024-09-14T11:23:42.237809+0000","last_undegraded":"2024-09-14T11:23:42.237809+0000","last_fullsized":"2024-09-14T11:23:42.237809+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'163","last_scrub_stamp":"2024-09-14T11:23:42.237714+0000","last_deep_scrub":"260'163","last_deep_scrub_stamp":"2024-09-14T11:23:42.237714+0000","last_clean_scrub_stamp":"2024-09-14T11:23:42.237714+0000","objects_scrubbed":3,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:47:21.197349+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":838,"num_read_kb":820,"num_write":382,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"260'400","reported_seq":1914,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:04.247771+0000","last_change":"2024-09-14T11:23:04.247771+0000","last_active":"2024-09-14T11:23:04.247771+0000","last_peered":"2024-09-14T11:23:04.247771+0000","last_clean":"2024-09-14T11:23:04.247771+0000","last_became_active":"2024-09-14T10:45:45.718964+0000","last_became_peered":"2024-09-14T10:45:45.718964+0000","last_unstale":"2024-09-14T11:23:04.247771+0000","last_undegraded":"2024-09-14T11:23:04.247771+0000","last_fullsized":"2024-09-14T11:23:04.247771+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'400","last_scrub_stamp":"2024-09-14T11:23:04.247668+0000","last_deep_scrub":"260'400","last_deep_scrub_stamp":"2024-09-14T11:23:04.247668+0000","last_clean_scrub_stamp":"2024-09-14T11:23:04.247668+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:22:55.596354+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2133,"num_read_kb":2043,"num_write":433,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"260'369","reported_seq":1016,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:04.280661+0000","last_change":"2024-09-14T11:23:04.280580+0000","last_active":"2024-09-14T11:23:04.280661+0000","last_peered":"2024-09-14T11:23:04.280661+0000","last_clean":"2024-09-14T11:23:04.280661+0000","last_became_active":"2024-09-14T10:45:43.675220+0000","last_became_peered":"2024-09-14T10:45:43.675220+0000","last_unstale":"2024-09-14T11:23:04.280661+0000","last_undegraded":"2024-09-14T11:23:04.280661+0000","last_fullsized":"2024-09-14T11:23:04.280661+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'369","last_scrub_stamp":"2024-09-14T11:23:04.280462+0000","last_deep_scrub":"260'369","last_deep_scrub_stamp":"2024-09-14T11:23:04.280462+0000","last_clean_scrub_stamp":"2024-09-14T11:23:04.280462+0000","objects_scrubbed":3,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:23:45.038803+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":607,"num_read_kb":38424,"num_write":1090,"num_write_kb":41594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"260'2","reported_seq":494,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:18.777321+0000","last_change":"2024-09-14T11:23:18.777321+0000","last_active":"2024-09-14T11:23:18.777321+0000","last_peered":"2024-09-14T11:23:18.777321+0000","last_clean":"2024-09-14T11:23:18.777321+0000","last_became_active":"2024-09-14T10:45:47.729338+0000","last_became_peered":"2024-09-14T10:45:47.729338+0000","last_unstale":"2024-09-14T11:23:18.777321+0000","last_undegraded":"2024-09-14T11:23:18.777321+0000","last_fullsized":"2024-09-14T11:23:18.777321+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:23:18.777242+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:23:18.777242+0000","last_clean_scrub_stamp":"2024-09-14T11:23:18.777242+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:28.099114+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"260'295","reported_seq":866,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:31.242864+0000","last_change":"2024-09-14T11:23:31.242864+0000","last_active":"2024-09-14T11:23:31.242864+0000","last_peered":"2024-09-14T11:23:31.242864+0000","last_clean":"2024-09-14T11:23:31.242864+0000","last_became_active":"2024-09-14T10:45:49.729842+0000","last_became_peered":"2024-09-14T10:45:49.729842+0000","last_unstale":"2024-09-14T11:23:31.242864+0000","last_undegraded":"2024-09-14T11:23:31.242864+0000","last_fullsized":"2024-09-14T11:23:31.242864+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'295","last_scrub_stamp":"2024-09-14T11:23:31.242769+0000","last_deep_scrub":"260'295","last_deep_scrub_stamp":"2024-09-14T11:23:31.242769+0000","last_clean_scrub_stamp":"2024-09-14T11:23:31.242769+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:47:02.860388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44662,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":478,"num_read_kb":1058,"num_write":386,"num_write_kb":290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:30.659654+0000","last_change":"2024-09-14T11:23:30.659654+0000","last_active":"2024-09-14T11:23:30.659654+0000","last_peered":"2024-09-14T11:23:30.659654+0000","last_clean":"2024-09-14T11:23:30.659654+0000","last_became_active":"2024-09-14T10:45:51.745310+0000","last_became_peered":"2024-09-14T10:45:51.745310+0000","last_unstale":"2024-09-14T11:23:30.659654+0000","last_undegraded":"2024-09-14T11:23:30.659654+0000","last_fullsized":"2024-09-14T11:23:30.659654+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:23:30.659557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:23:30.659557+0000","last_clean_scrub_stamp":"2024-09-14T11:23:30.659557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:47.082535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"260'142","reported_seq":630,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:18.626544+0000","last_change":"2024-09-14T11:23:18.626544+0000","last_active":"2024-09-14T11:23:18.626544+0000","last_peered":"2024-09-14T11:23:18.626544+0000","last_clean":"2024-09-14T11:23:18.626544+0000","last_became_active":"2024-09-14T10:45:53.754826+0000","last_became_peered":"2024-09-14T10:45:53.754826+0000","last_unstale":"2024-09-14T11:23:18.626544+0000","last_undegraded":"2024-09-14T11:23:18.626544+0000","last_fullsized":"2024-09-14T11:23:18.626544+0000","mapping_epoch":34,"log_start":"260'100","ondisk_log_start":"260'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'142","last_scrub_stamp":"2024-09-14T11:23:18.626459+0000","last_deep_scrub":"260'142","last_deep_scrub_stamp":"2024-09-14T11:23:18.626459+0000","last_clean_scrub_stamp":"2024-09-14T11:23:18.626459+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:19:11.355018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":657,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":128,"num_read_kb":116,"num_write":335,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"260'422","reported_seq":1973,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:10.812912+0000","last_change":"2024-09-14T11:23:10.812912+0000","last_active":"2024-09-14T11:23:10.812912+0000","last_peered":"2024-09-14T11:23:10.812912+0000","last_clean":"2024-09-14T11:23:10.812912+0000","last_became_active":"2024-09-14T10:45:45.708229+0000","last_became_peered":"2024-09-14T10:45:45.708229+0000","last_unstale":"2024-09-14T11:23:10.812912+0000","last_undegraded":"2024-09-14T11:23:10.812912+0000","last_fullsized":"2024-09-14T11:23:10.812912+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'422","last_scrub_stamp":"2024-09-14T11:23:10.812799+0000","last_deep_scrub":"260'422","last_deep_scrub_stamp":"2024-09-14T11:23:10.812799+0000","last_clean_scrub_stamp":"2024-09-14T11:23:10.812799+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:04:48.614638+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2330,"num_read_kb":2210,"num_write":517,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"260'373","reported_seq":1029,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:58.207593+0000","last_change":"2024-09-14T11:22:58.207534+0000","last_active":"2024-09-14T11:22:58.207593+0000","last_peered":"2024-09-14T11:22:58.207593+0000","last_clean":"2024-09-14T11:22:58.207593+0000","last_became_active":"2024-09-14T10:45:43.684102+0000","last_became_peered":"2024-09-14T10:45:43.684102+0000","last_unstale":"2024-09-14T11:22:58.207593+0000","last_undegraded":"2024-09-14T11:22:58.207593+0000","last_fullsized":"2024-09-14T11:22:58.207593+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'373","last_scrub_stamp":"2024-09-14T11:22:58.207463+0000","last_deep_scrub":"260'373","last_deep_scrub_stamp":"2024-09-14T11:22:58.207463+0000","last_clean_scrub_stamp":"2024-09-14T11:22:58.207463+0000","objects_scrubbed":6,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:30.442090+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133709,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":619,"num_read_kb":82373,"num_write":1076,"num_write_kb":43712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"260'385","reported_seq":1952,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:09.667862+0000","last_change":"2024-09-14T11:23:09.667862+0000","last_active":"2024-09-14T11:23:09.667862+0000","last_peered":"2024-09-14T11:23:09.667862+0000","last_clean":"2024-09-14T11:23:09.667862+0000","last_became_active":"2024-09-14T10:45:45.718949+0000","last_became_peered":"2024-09-14T10:45:45.718949+0000","last_unstale":"2024-09-14T11:23:09.667862+0000","last_undegraded":"2024-09-14T11:23:09.667862+0000","last_fullsized":"2024-09-14T11:23:09.667862+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'385","last_scrub_stamp":"2024-09-14T11:23:09.667768+0000","last_deep_scrub":"260'385","last_deep_scrub_stamp":"2024-09-14T11:23:09.667768+0000","last_clean_scrub_stamp":"2024-09-14T11:23:09.667768+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:07:20.882638+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2227,"num_read_kb":2135,"num_write":439,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"260'312","reported_seq":933,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:00.766046+0000","last_change":"2024-09-14T11:23:00.765987+0000","last_active":"2024-09-14T11:23:00.766046+0000","last_peered":"2024-09-14T11:23:00.766046+0000","last_clean":"2024-09-14T11:23:00.766046+0000","last_became_active":"2024-09-14T10:45:43.690675+0000","last_became_peered":"2024-09-14T10:45:43.690675+0000","last_unstale":"2024-09-14T11:23:00.766046+0000","last_undegraded":"2024-09-14T11:23:00.766046+0000","last_fullsized":"2024-09-14T11:23:00.766046+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'312","last_scrub_stamp":"2024-09-14T11:23:00.765887+0000","last_deep_scrub":"260'312","last_deep_scrub_stamp":"2024-09-14T11:23:00.765887+0000","last_clean_scrub_stamp":"2024-09-14T11:23:00.765887+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:38:08.181333+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":527,"num_read_kb":9887,"num_write":1028,"num_write_kb":21015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"260'535","reported_seq":2252,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:17.205485+0000","last_change":"2024-09-14T11:23:17.205485+0000","last_active":"2024-09-14T11:23:17.205485+0000","last_peered":"2024-09-14T11:23:17.205485+0000","last_clean":"2024-09-14T11:23:17.205485+0000","last_became_active":"2024-09-14T10:45:45.717393+0000","last_became_peered":"2024-09-14T10:45:45.717393+0000","last_unstale":"2024-09-14T11:23:17.205485+0000","last_undegraded":"2024-09-14T11:23:17.205485+0000","last_fullsized":"2024-09-14T11:23:17.205485+0000","mapping_epoch":26,"log_start":"260'500","ondisk_log_start":"260'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'535","last_scrub_stamp":"2024-09-14T11:23:17.205379+0000","last_deep_scrub":"260'535","last_deep_scrub_stamp":"2024-09-14T11:23:17.205379+0000","last_clean_scrub_stamp":"2024-09-14T11:23:17.205379+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:56.826924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2830,"num_read_kb":2663,"num_write":635,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"260'389","reported_seq":1039,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:08.148332+0000","last_change":"2024-09-14T11:23:08.148260+0000","last_active":"2024-09-14T11:23:08.148332+0000","last_peered":"2024-09-14T11:23:08.148332+0000","last_clean":"2024-09-14T11:23:08.148332+0000","last_became_active":"2024-09-14T10:45:43.675216+0000","last_became_peered":"2024-09-14T10:45:43.675216+0000","last_unstale":"2024-09-14T11:23:08.148332+0000","last_undegraded":"2024-09-14T11:23:08.148332+0000","last_fullsized":"2024-09-14T11:23:08.148332+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'389","last_scrub_stamp":"2024-09-14T11:23:08.148160+0000","last_deep_scrub":"260'389","last_deep_scrub_stamp":"2024-09-14T11:23:08.148160+0000","last_clean_scrub_stamp":"2024-09-14T11:23:08.148160+0000","objects_scrubbed":4,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:29.501402+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":708,"num_read_kb":14121,"num_write":1222,"num_write_kb":48801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"260'871","reported_seq":2519,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:15.342684+0000","last_change":"2024-09-14T11:23:15.342684+0000","last_active":"2024-09-14T11:23:15.342684+0000","last_peered":"2024-09-14T11:23:15.342684+0000","last_clean":"2024-09-14T11:23:15.342684+0000","last_became_active":"2024-09-14T10:45:45.720939+0000","last_became_peered":"2024-09-14T10:45:45.720939+0000","last_unstale":"2024-09-14T11:23:15.342684+0000","last_undegraded":"2024-09-14T11:23:15.342684+0000","last_fullsized":"2024-09-14T11:23:15.342684+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'871","last_scrub_stamp":"2024-09-14T11:23:15.342592+0000","last_deep_scrub":"260'871","last_deep_scrub_stamp":"2024-09-14T11:23:15.342592+0000","last_clean_scrub_stamp":"2024-09-14T11:23:15.342592+0000","objects_scrubbed":2,"log_size":71,"log_dups_size":800,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:19:11.489780+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4139,"num_read_kb":3737,"num_write":1132,"num_write_kb":407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"260'313","reported_seq":902,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:02.304298+0000","last_change":"2024-09-14T11:23:02.304213+0000","last_active":"2024-09-14T11:23:02.304298+0000","last_peered":"2024-09-14T11:23:02.304298+0000","last_clean":"2024-09-14T11:23:02.304298+0000","last_became_active":"2024-09-14T10:45:43.681864+0000","last_became_peered":"2024-09-14T10:45:43.681864+0000","last_unstale":"2024-09-14T11:23:02.304298+0000","last_undegraded":"2024-09-14T11:23:02.304298+0000","last_fullsized":"2024-09-14T11:23:02.304298+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'313","last_scrub_stamp":"2024-09-14T11:23:02.304103+0000","last_deep_scrub":"260'313","last_deep_scrub_stamp":"2024-09-14T11:23:02.304103+0000","last_clean_scrub_stamp":"2024-09-14T11:23:02.304103+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:15.927678+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":459,"num_read_kb":5481,"num_write":964,"num_write_kb":23381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"260'449","reported_seq":2105,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:14.315404+0000","last_change":"2024-09-14T11:23:14.315348+0000","last_active":"2024-09-14T11:23:14.315404+0000","last_peered":"2024-09-14T11:23:14.315404+0000","last_clean":"2024-09-14T11:23:14.315404+0000","last_became_active":"2024-09-14T10:45:45.722575+0000","last_became_peered":"2024-09-14T10:45:45.722575+0000","last_unstale":"2024-09-14T11:23:14.315404+0000","last_undegraded":"2024-09-14T11:23:14.315404+0000","last_fullsized":"2024-09-14T11:23:14.315404+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'449","last_scrub_stamp":"2024-09-14T11:23:14.315255+0000","last_deep_scrub":"260'449","last_deep_scrub_stamp":"2024-09-14T11:23:14.315255+0000","last_clean_scrub_stamp":"2024-09-14T11:23:14.315255+0000","objects_scrubbed":2,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:15:08.436381+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2593,"num_read_kb":2475,"num_write":496,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"260'361","reported_seq":1003,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:04.433029+0000","last_change":"2024-09-14T11:23:04.433029+0000","last_active":"2024-09-14T11:23:04.433029+0000","last_peered":"2024-09-14T11:23:04.433029+0000","last_clean":"2024-09-14T11:23:04.433029+0000","last_became_active":"2024-09-14T10:45:43.691101+0000","last_became_peered":"2024-09-14T10:45:43.691101+0000","last_unstale":"2024-09-14T11:23:04.433029+0000","last_undegraded":"2024-09-14T11:23:04.433029+0000","last_fullsized":"2024-09-14T11:23:04.433029+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'361","last_scrub_stamp":"2024-09-14T11:23:04.432933+0000","last_deep_scrub":"260'361","last_deep_scrub_stamp":"2024-09-14T11:23:04.432933+0000","last_clean_scrub_stamp":"2024-09-14T11:23:04.432933+0000","objects_scrubbed":2,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:27.282075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":637,"num_read_kb":20829,"num_write":1146,"num_write_kb":28609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"260'965","reported_seq":2559,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:05.592937+0000","last_change":"2024-09-14T11:23:05.592864+0000","last_active":"2024-09-14T11:23:05.592937+0000","last_peered":"2024-09-14T11:23:05.592937+0000","last_clean":"2024-09-14T11:23:05.592937+0000","last_became_active":"2024-09-14T10:45:45.717482+0000","last_became_peered":"2024-09-14T10:45:45.717482+0000","last_unstale":"2024-09-14T11:23:05.592937+0000","last_undegraded":"2024-09-14T11:23:05.592937+0000","last_fullsized":"2024-09-14T11:23:05.592937+0000","mapping_epoch":26,"log_start":"260'900","ondisk_log_start":"260'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'965","last_scrub_stamp":"2024-09-14T11:23:05.592780+0000","last_deep_scrub":"260'965","last_deep_scrub_stamp":"2024-09-14T11:23:05.592780+0000","last_clean_scrub_stamp":"2024-09-14T11:23:05.592780+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":900,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:58.949827+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4656,"num_read_kb":4162,"num_write":1345,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"260'420","reported_seq":1067,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:01.490274+0000","last_change":"2024-09-14T11:23:01.490274+0000","last_active":"2024-09-14T11:23:01.490274+0000","last_peered":"2024-09-14T11:23:01.490274+0000","last_clean":"2024-09-14T11:23:01.490274+0000","last_became_active":"2024-09-14T10:45:43.681769+0000","last_became_peered":"2024-09-14T10:45:43.681769+0000","last_unstale":"2024-09-14T11:23:01.490274+0000","last_undegraded":"2024-09-14T11:23:01.490274+0000","last_fullsized":"2024-09-14T11:23:01.490274+0000","mapping_epoch":23,"log_start":"260'400","ondisk_log_start":"260'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'420","last_scrub_stamp":"2024-09-14T11:23:01.490176+0000","last_deep_scrub":"260'420","last_deep_scrub_stamp":"2024-09-14T11:23:01.490176+0000","last_clean_scrub_stamp":"2024-09-14T11:23:01.490176+0000","objects_scrubbed":5,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:59.490356+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":884,"num_read_kb":850,"num_write":1209,"num_write_kb":26526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"260'499","reported_seq":2183,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:09.302098+0000","last_change":"2024-09-14T11:23:09.302039+0000","last_active":"2024-09-14T11:23:09.302098+0000","last_peered":"2024-09-14T11:23:09.302098+0000","last_clean":"2024-09-14T11:23:09.302098+0000","last_became_active":"2024-09-14T10:45:45.724491+0000","last_became_peered":"2024-09-14T10:45:45.724491+0000","last_unstale":"2024-09-14T11:23:09.302098+0000","last_undegraded":"2024-09-14T11:23:09.302098+0000","last_fullsized":"2024-09-14T11:23:09.302098+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'499","last_scrub_stamp":"2024-09-14T11:23:09.301946+0000","last_deep_scrub":"260'499","last_deep_scrub_stamp":"2024-09-14T11:23:09.301946+0000","last_clean_scrub_stamp":"2024-09-14T11:23:09.301946+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:26.256389+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2800,"num_read_kb":2654,"num_write":635,"num_write_kb":196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"260'363","reported_seq":988,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:00.219177+0000","last_change":"2024-09-14T11:23:00.219177+0000","last_active":"2024-09-14T11:23:00.219177+0000","last_peered":"2024-09-14T11:23:00.219177+0000","last_clean":"2024-09-14T11:23:00.219177+0000","last_became_active":"2024-09-14T10:45:43.672592+0000","last_became_peered":"2024-09-14T10:45:43.672592+0000","last_unstale":"2024-09-14T11:23:00.219177+0000","last_undegraded":"2024-09-14T11:23:00.219177+0000","last_fullsized":"2024-09-14T11:23:00.219177+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'363","last_scrub_stamp":"2024-09-14T11:23:00.219087+0000","last_deep_scrub":"260'363","last_deep_scrub_stamp":"2024-09-14T11:23:00.219087+0000","last_clean_scrub_stamp":"2024-09-14T11:23:00.219087+0000","objects_scrubbed":4,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:53.826069+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133682,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":581,"num_read_kb":14710,"num_write":1041,"num_write_kb":26884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"260'948","reported_seq":2556,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:02.605749+0000","last_change":"2024-09-14T11:23:02.605687+0000","last_active":"2024-09-14T11:23:02.605749+0000","last_peered":"2024-09-14T11:23:02.605749+0000","last_clean":"2024-09-14T11:23:02.605749+0000","last_became_active":"2024-09-14T10:45:45.712642+0000","last_became_peered":"2024-09-14T10:45:45.712642+0000","last_unstale":"2024-09-14T11:23:02.605749+0000","last_undegraded":"2024-09-14T11:23:02.605749+0000","last_fullsized":"2024-09-14T11:23:02.605749+0000","mapping_epoch":26,"log_start":"260'900","ondisk_log_start":"260'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'948","last_scrub_stamp":"2024-09-14T11:23:02.605604+0000","last_deep_scrub":"260'948","last_deep_scrub_stamp":"2024-09-14T11:23:02.605604+0000","last_clean_scrub_stamp":"2024-09-14T11:23:02.605604+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":900,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:29.530400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4544,"num_read_kb":4033,"num_write":1311,"num_write_kb":524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"260'381","reported_seq":1030,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:03.258437+0000","last_change":"2024-09-14T11:23:03.258437+0000","last_active":"2024-09-14T11:23:03.258437+0000","last_peered":"2024-09-14T11:23:03.258437+0000","last_clean":"2024-09-14T11:23:03.258437+0000","last_became_active":"2024-09-14T10:45:43.675233+0000","last_became_peered":"2024-09-14T10:45:43.675233+0000","last_unstale":"2024-09-14T11:23:03.258437+0000","last_undegraded":"2024-09-14T11:23:03.258437+0000","last_fullsized":"2024-09-14T11:23:03.258437+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'381","last_scrub_stamp":"2024-09-14T11:23:03.258350+0000","last_deep_scrub":"260'381","last_deep_scrub_stamp":"2024-09-14T11:23:03.258350+0000","last_clean_scrub_stamp":"2024-09-14T11:23:03.258350+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:04:00.733089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":674,"num_read_kb":10456,"num_write":1272,"num_write_kb":38144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"260'844","reported_seq":2446,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:06.692537+0000","last_change":"2024-09-14T11:23:06.692537+0000","last_active":"2024-09-14T11:23:06.692537+0000","last_peered":"2024-09-14T11:23:06.692537+0000","last_clean":"2024-09-14T11:23:06.692537+0000","last_became_active":"2024-09-14T10:45:45.711947+0000","last_became_peered":"2024-09-14T10:45:45.711947+0000","last_unstale":"2024-09-14T11:23:06.692537+0000","last_undegraded":"2024-09-14T11:23:06.692537+0000","last_fullsized":"2024-09-14T11:23:06.692537+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'844","last_scrub_stamp":"2024-09-14T11:23:06.692450+0000","last_deep_scrub":"260'844","last_deep_scrub_stamp":"2024-09-14T11:23:06.692450+0000","last_clean_scrub_stamp":"2024-09-14T11:23:06.692450+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":800,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:48.375095+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4120,"num_read_kb":3716,"num_write":1158,"num_write_kb":467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"260'307","reported_seq":915,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:09.184657+0000","last_change":"2024-09-14T11:23:09.184657+0000","last_active":"2024-09-14T11:23:09.184657+0000","last_peered":"2024-09-14T11:23:09.184657+0000","last_clean":"2024-09-14T11:23:09.184657+0000","last_became_active":"2024-09-14T10:45:43.677597+0000","last_became_peered":"2024-09-14T10:45:43.677597+0000","last_unstale":"2024-09-14T11:23:09.184657+0000","last_undegraded":"2024-09-14T11:23:09.184657+0000","last_fullsized":"2024-09-14T11:23:09.184657+0000","mapping_epoch":23,"log_start":"260'200","ondisk_log_start":"260'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'307","last_scrub_stamp":"2024-09-14T11:23:09.184538+0000","last_deep_scrub":"260'307","last_deep_scrub_stamp":"2024-09-14T11:23:09.184538+0000","last_clean_scrub_stamp":"2024-09-14T11:23:09.184538+0000","objects_scrubbed":3,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:11.668626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":480,"num_read_kb":1898,"num_write":986,"num_write_kb":19841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"260'857","reported_seq":2379,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:08.648180+0000","last_change":"2024-09-14T11:23:08.648180+0000","last_active":"2024-09-14T11:23:08.648180+0000","last_peered":"2024-09-14T11:23:08.648180+0000","last_clean":"2024-09-14T11:23:08.648180+0000","last_became_active":"2024-09-14T10:45:45.715268+0000","last_became_peered":"2024-09-14T10:45:45.715268+0000","last_unstale":"2024-09-14T11:23:08.648180+0000","last_undegraded":"2024-09-14T11:23:08.648180+0000","last_fullsized":"2024-09-14T11:23:08.648180+0000","mapping_epoch":26,"log_start":"260'800","ondisk_log_start":"260'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'857","last_scrub_stamp":"2024-09-14T11:23:08.648098+0000","last_deep_scrub":"260'857","last_deep_scrub_stamp":"2024-09-14T11:23:08.648098+0000","last_clean_scrub_stamp":"2024-09-14T11:23:08.648098+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":800,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:21.218133+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4230,"num_read_kb":3798,"num_write":1192,"num_write_kb":502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"260'355","reported_seq":1012,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:05.289303+0000","last_change":"2024-09-14T11:23:05.289243+0000","last_active":"2024-09-14T11:23:05.289303+0000","last_peered":"2024-09-14T11:23:05.289303+0000","last_clean":"2024-09-14T11:23:05.289303+0000","last_became_active":"2024-09-14T10:45:43.681694+0000","last_became_peered":"2024-09-14T10:45:43.681694+0000","last_unstale":"2024-09-14T11:23:05.289303+0000","last_undegraded":"2024-09-14T11:23:05.289303+0000","last_fullsized":"2024-09-14T11:23:05.289303+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'355","last_scrub_stamp":"2024-09-14T11:23:05.289154+0000","last_deep_scrub":"260'355","last_deep_scrub_stamp":"2024-09-14T11:23:05.289154+0000","last_clean_scrub_stamp":"2024-09-14T11:23:05.289154+0000","objects_scrubbed":2,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:15:49.436744+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133679,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":711,"num_read_kb":32454,"num_write":1261,"num_write_kb":21071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"260'432","reported_seq":1894,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:16.353071+0000","last_change":"2024-09-14T11:23:16.353009+0000","last_active":"2024-09-14T11:23:16.353071+0000","last_peered":"2024-09-14T11:23:16.353071+0000","last_clean":"2024-09-14T11:23:16.353071+0000","last_became_active":"2024-09-14T10:45:45.723441+0000","last_became_peered":"2024-09-14T10:45:45.723441+0000","last_unstale":"2024-09-14T11:23:16.353071+0000","last_undegraded":"2024-09-14T11:23:16.353071+0000","last_fullsized":"2024-09-14T11:23:16.353071+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'432","last_scrub_stamp":"2024-09-14T11:23:16.352923+0000","last_deep_scrub":"260'432","last_deep_scrub_stamp":"2024-09-14T11:23:16.352923+0000","last_clean_scrub_stamp":"2024-09-14T11:23:16.352923+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:43.275404+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2262,"num_read_kb":2127,"num_write":517,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"260'356","reported_seq":1001,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:59.642473+0000","last_change":"2024-09-14T11:22:59.642417+0000","last_active":"2024-09-14T11:22:59.642473+0000","last_peered":"2024-09-14T11:22:59.642473+0000","last_clean":"2024-09-14T11:22:59.642473+0000","last_became_active":"2024-09-14T10:45:43.681441+0000","last_became_peered":"2024-09-14T10:45:43.681441+0000","last_unstale":"2024-09-14T11:22:59.642473+0000","last_undegraded":"2024-09-14T11:22:59.642473+0000","last_fullsized":"2024-09-14T11:22:59.642473+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'356","last_scrub_stamp":"2024-09-14T11:22:59.642325+0000","last_deep_scrub":"260'356","last_deep_scrub_stamp":"2024-09-14T11:22:59.642325+0000","last_clean_scrub_stamp":"2024-09-14T11:22:59.642325+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:41.518525+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244496,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":649,"num_read_kb":21101,"num_write":1092,"num_write_kb":38924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"260'751","reported_seq":2231,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:05.568393+0000","last_change":"2024-09-14T11:23:05.568333+0000","last_active":"2024-09-14T11:23:05.568393+0000","last_peered":"2024-09-14T11:23:05.568393+0000","last_clean":"2024-09-14T11:23:05.568393+0000","last_became_active":"2024-09-14T10:45:45.711402+0000","last_became_peered":"2024-09-14T10:45:45.711402+0000","last_unstale":"2024-09-14T11:23:05.568393+0000","last_undegraded":"2024-09-14T11:23:05.568393+0000","last_fullsized":"2024-09-14T11:23:05.568393+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'751","last_scrub_stamp":"2024-09-14T11:23:05.568226+0000","last_deep_scrub":"260'751","last_deep_scrub_stamp":"2024-09-14T11:23:05.568226+0000","last_clean_scrub_stamp":"2024-09-14T11:23:05.568226+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:00.144694+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3613,"num_read_kb":3262,"num_write":995,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"260'351","reported_seq":981,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:02.925799+0000","last_change":"2024-09-14T11:23:02.925737+0000","last_active":"2024-09-14T11:23:02.925799+0000","last_peered":"2024-09-14T11:23:02.925799+0000","last_clean":"2024-09-14T11:23:02.925799+0000","last_became_active":"2024-09-14T10:45:43.690104+0000","last_became_peered":"2024-09-14T10:45:43.690104+0000","last_unstale":"2024-09-14T11:23:02.925799+0000","last_undegraded":"2024-09-14T11:23:02.925799+0000","last_fullsized":"2024-09-14T11:23:02.925799+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'351","last_scrub_stamp":"2024-09-14T11:23:02.925623+0000","last_deep_scrub":"260'351","last_deep_scrub_stamp":"2024-09-14T11:23:02.925623+0000","last_clean_scrub_stamp":"2024-09-14T11:23:02.925623+0000","objects_scrubbed":4,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:52.477625+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":636,"num_read_kb":1890,"num_write":1154,"num_write_kb":1386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"260'588","reported_seq":2237,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:04.608974+0000","last_change":"2024-09-14T11:23:04.608895+0000","last_active":"2024-09-14T11:23:04.608974+0000","last_peered":"2024-09-14T11:23:04.608974+0000","last_clean":"2024-09-14T11:23:04.608974+0000","last_became_active":"2024-09-14T10:45:45.723163+0000","last_became_peered":"2024-09-14T10:45:45.723163+0000","last_unstale":"2024-09-14T11:23:04.608974+0000","last_undegraded":"2024-09-14T11:23:04.608974+0000","last_fullsized":"2024-09-14T11:23:04.608974+0000","mapping_epoch":26,"log_start":"260'500","ondisk_log_start":"260'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'588","last_scrub_stamp":"2024-09-14T11:23:04.608810+0000","last_deep_scrub":"260'588","last_deep_scrub_stamp":"2024-09-14T11:23:04.608810+0000","last_clean_scrub_stamp":"2024-09-14T11:23:04.608810+0000","objects_scrubbed":4,"log_size":88,"log_dups_size":500,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:14.023702+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3275,"num_read_kb":3002,"num_write":768,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"260'379","reported_seq":1054,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:22:54.616701+0000","last_change":"2024-09-14T11:22:54.616609+0000","last_active":"2024-09-14T11:22:54.616701+0000","last_peered":"2024-09-14T11:22:54.616701+0000","last_clean":"2024-09-14T11:22:54.616701+0000","last_became_active":"2024-09-14T10:45:43.680517+0000","last_became_peered":"2024-09-14T10:45:43.680517+0000","last_unstale":"2024-09-14T11:22:54.616701+0000","last_undegraded":"2024-09-14T11:22:54.616701+0000","last_fullsized":"2024-09-14T11:22:54.616701+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'379","last_scrub_stamp":"2024-09-14T11:22:54.616470+0000","last_deep_scrub":"260'379","last_deep_scrub_stamp":"2024-09-14T11:22:54.616470+0000","last_clean_scrub_stamp":"2024-09-14T11:22:54.616470+0000","objects_scrubbed":8,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:48.841281+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133694,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":729,"num_read_kb":32475,"num_write":1387,"num_write_kb":39199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"260'770","reported_seq":2293,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:07.714736+0000","last_change":"2024-09-14T11:23:07.714670+0000","last_active":"2024-09-14T11:23:07.714736+0000","last_peered":"2024-09-14T11:23:07.714736+0000","last_clean":"2024-09-14T11:23:07.714736+0000","last_became_active":"2024-09-14T10:45:45.718969+0000","last_became_peered":"2024-09-14T10:45:45.718969+0000","last_unstale":"2024-09-14T11:23:07.714736+0000","last_undegraded":"2024-09-14T11:23:07.714736+0000","last_fullsized":"2024-09-14T11:23:07.714736+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'770","last_scrub_stamp":"2024-09-14T11:23:07.714570+0000","last_deep_scrub":"260'770","last_deep_scrub_stamp":"2024-09-14T11:23:07.714570+0000","last_clean_scrub_stamp":"2024-09-14T11:23:07.714570+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:16.190729+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3670,"num_read_kb":3326,"num_write":1002,"num_write_kb":356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"260'340","reported_seq":969,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:12.215763+0000","last_change":"2024-09-14T11:23:12.215702+0000","last_active":"2024-09-14T11:23:12.215763+0000","last_peered":"2024-09-14T11:23:12.215763+0000","last_clean":"2024-09-14T11:23:12.215763+0000","last_became_active":"2024-09-14T10:45:43.690489+0000","last_became_peered":"2024-09-14T10:45:43.690489+0000","last_unstale":"2024-09-14T11:23:12.215763+0000","last_undegraded":"2024-09-14T11:23:12.215763+0000","last_fullsized":"2024-09-14T11:23:12.215763+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'340","last_scrub_stamp":"2024-09-14T11:23:12.215605+0000","last_deep_scrub":"260'340","last_deep_scrub_stamp":"2024-09-14T11:23:12.215605+0000","last_clean_scrub_stamp":"2024-09-14T11:23:12.215605+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:12.269469+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":562,"num_read_kb":22090,"num_write":1057,"num_write_kb":34450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"260'629","reported_seq":2212,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:09.765804+0000","last_change":"2024-09-14T11:23:09.765722+0000","last_active":"2024-09-14T11:23:09.765804+0000","last_peered":"2024-09-14T11:23:09.765804+0000","last_clean":"2024-09-14T11:23:09.765804+0000","last_became_active":"2024-09-14T10:45:45.727095+0000","last_became_peered":"2024-09-14T10:45:45.727095+0000","last_unstale":"2024-09-14T11:23:09.765804+0000","last_undegraded":"2024-09-14T11:23:09.765804+0000","last_fullsized":"2024-09-14T11:23:09.765804+0000","mapping_epoch":26,"log_start":"260'600","ondisk_log_start":"260'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'629","last_scrub_stamp":"2024-09-14T11:23:09.765606+0000","last_deep_scrub":"260'629","last_deep_scrub_stamp":"2024-09-14T11:23:09.765606+0000","last_clean_scrub_stamp":"2024-09-14T11:23:09.765606+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":600,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:16.812881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3428,"num_read_kb":3090,"num_write":924,"num_write_kb":450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":893,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"260'312","reported_seq":907,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:01.817437+0000","last_change":"2024-09-14T11:23:01.817385+0000","last_active":"2024-09-14T11:23:01.817437+0000","last_peered":"2024-09-14T11:23:01.817437+0000","last_clean":"2024-09-14T11:23:01.817437+0000","last_became_active":"2024-09-14T10:45:43.689186+0000","last_became_peered":"2024-09-14T10:45:43.689186+0000","last_unstale":"2024-09-14T11:23:01.817437+0000","last_undegraded":"2024-09-14T11:23:01.817437+0000","last_fullsized":"2024-09-14T11:23:01.817437+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'312","last_scrub_stamp":"2024-09-14T11:23:01.817298+0000","last_deep_scrub":"260'312","last_deep_scrub_stamp":"2024-09-14T11:23:01.817298+0000","last_clean_scrub_stamp":"2024-09-14T11:23:01.817298+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:01.982799+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133706,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":457,"num_read_kb":44560,"num_write":936,"num_write_kb":69256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"260'1085","reported_seq":2831,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:03.606116+0000","last_change":"2024-09-14T11:23:03.606116+0000","last_active":"2024-09-14T11:23:03.606116+0000","last_peered":"2024-09-14T11:23:03.606116+0000","last_clean":"2024-09-14T11:23:03.606116+0000","last_became_active":"2024-09-14T10:45:45.720636+0000","last_became_peered":"2024-09-14T10:45:45.720636+0000","last_unstale":"2024-09-14T11:23:03.606116+0000","last_undegraded":"2024-09-14T11:23:03.606116+0000","last_fullsized":"2024-09-14T11:23:03.606116+0000","mapping_epoch":26,"log_start":"260'1000","ondisk_log_start":"260'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1085","last_scrub_stamp":"2024-09-14T11:23:03.606026+0000","last_deep_scrub":"260'1085","last_deep_scrub_stamp":"2024-09-14T11:23:03.606026+0000","last_clean_scrub_stamp":"2024-09-14T11:23:03.606026+0000","objects_scrubbed":2,"log_size":85,"log_dups_size":1000,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:51:34.804450+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5348,"num_read_kb":4870,"num_write":1559,"num_write_kb":616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"260'336","reported_seq":1017,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:10.212053+0000","last_change":"2024-09-14T11:23:10.212053+0000","last_active":"2024-09-14T11:23:10.212053+0000","last_peered":"2024-09-14T11:23:10.212053+0000","last_clean":"2024-09-14T11:23:10.212053+0000","last_became_active":"2024-09-14T10:45:43.682573+0000","last_became_peered":"2024-09-14T10:45:43.682573+0000","last_unstale":"2024-09-14T11:23:10.212053+0000","last_undegraded":"2024-09-14T11:23:10.212053+0000","last_fullsized":"2024-09-14T11:23:10.212053+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'336","last_scrub_stamp":"2024-09-14T11:23:10.211893+0000","last_deep_scrub":"260'336","last_deep_scrub_stamp":"2024-09-14T11:23:10.211893+0000","last_clean_scrub_stamp":"2024-09-14T11:23:10.211893+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:35.666356+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244522,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":804,"num_read_kb":3981,"num_write":1025,"num_write_kb":35472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"260'383","reported_seq":1020,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:11.233324+0000","last_change":"2024-09-14T11:23:11.233324+0000","last_active":"2024-09-14T11:23:11.233324+0000","last_peered":"2024-09-14T11:23:11.233324+0000","last_clean":"2024-09-14T11:23:11.233324+0000","last_became_active":"2024-09-14T10:45:43.673527+0000","last_became_peered":"2024-09-14T10:45:43.673527+0000","last_unstale":"2024-09-14T11:23:11.233324+0000","last_undegraded":"2024-09-14T11:23:11.233324+0000","last_fullsized":"2024-09-14T11:23:11.233324+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'383","last_scrub_stamp":"2024-09-14T11:23:11.233207+0000","last_deep_scrub":"260'383","last_deep_scrub_stamp":"2024-09-14T11:23:11.233207+0000","last_clean_scrub_stamp":"2024-09-14T11:23:11.233207+0000","objects_scrubbed":5,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:10:35.983721+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":679,"num_read_kb":21996,"num_write":1218,"num_write_kb":25813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"260'1016","reported_seq":2623,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:13.796760+0000","last_change":"2024-09-14T11:23:13.796760+0000","last_active":"2024-09-14T11:23:13.796760+0000","last_peered":"2024-09-14T11:23:13.796760+0000","last_clean":"2024-09-14T11:23:13.796760+0000","last_became_active":"2024-09-14T10:45:45.724040+0000","last_became_peered":"2024-09-14T10:45:45.724040+0000","last_unstale":"2024-09-14T11:23:13.796760+0000","last_undegraded":"2024-09-14T11:23:13.796760+0000","last_fullsized":"2024-09-14T11:23:13.796760+0000","mapping_epoch":26,"log_start":"260'1000","ondisk_log_start":"260'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'1016","last_scrub_stamp":"2024-09-14T11:23:13.796666+0000","last_deep_scrub":"260'1016","last_deep_scrub_stamp":"2024-09-14T11:23:13.796666+0000","last_clean_scrub_stamp":"2024-09-14T11:23:13.796666+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":1000,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:58.735365+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4769,"num_read_kb":4210,"num_write":1424,"num_write_kb":631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"260'384","reported_seq":1025,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:06.332254+0000","last_change":"2024-09-14T11:23:06.332254+0000","last_active":"2024-09-14T11:23:06.332254+0000","last_peered":"2024-09-14T11:23:06.332254+0000","last_clean":"2024-09-14T11:23:06.332254+0000","last_became_active":"2024-09-14T10:45:43.687162+0000","last_became_peered":"2024-09-14T10:45:43.687162+0000","last_unstale":"2024-09-14T11:23:06.332254+0000","last_undegraded":"2024-09-14T11:23:06.332254+0000","last_fullsized":"2024-09-14T11:23:06.332254+0000","mapping_epoch":23,"log_start":"260'300","ondisk_log_start":"260'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'384","last_scrub_stamp":"2024-09-14T11:23:06.332163+0000","last_deep_scrub":"260'384","last_deep_scrub_stamp":"2024-09-14T11:23:06.332163+0000","last_clean_scrub_stamp":"2024-09-14T11:23:06.332163+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:22.685467+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":664,"num_read_kb":37354,"num_write":1184,"num_write_kb":26064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"260'478","reported_seq":2026,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-14T11:23:07.626572+0000","last_change":"2024-09-14T11:23:07.626572+0000","last_active":"2024-09-14T11:23:07.626572+0000","last_peered":"2024-09-14T11:23:07.626572+0000","last_clean":"2024-09-14T11:23:07.626572+0000","last_became_active":"2024-09-14T10:45:45.711869+0000","last_became_peered":"2024-09-14T10:45:45.711869+0000","last_unstale":"2024-09-14T11:23:07.626572+0000","last_undegraded":"2024-09-14T11:23:07.626572+0000","last_fullsized":"2024-09-14T11:23:07.626572+0000","mapping_epoch":26,"log_start":"260'400","ondisk_log_start":"260'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'478","last_scrub_stamp":"2024-09-14T11:23:07.626475+0000","last_deep_scrub":"260'478","last_deep_scrub_stamp":"2024-09-14T11:23:07.626475+0000","last_clean_scrub_stamp":"2024-09-14T11:23:07.626475+0000","objects_scrubbed":1,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:37.243122+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2555,"num_read_kb":2382,"num_write":592,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":694,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10817,"num_read_kb":8523,"num_write":3117,"num_write_kb":1010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1096,"ondisk_log_size":1096,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":14831,"num_objects":87,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":15133,"num_read_kb":14796,"num_write":17057,"num_write_kb":4975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2512,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":29662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1466,"ondisk_log_size":1466,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":791,"ondisk_log_size":791,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1553710,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":17035,"num_read_kb":36473,"num_write":14315,"num_write_kb":11597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":710380,"num_omap_keys":1616,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2052,"ondisk_log_size":2052,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2403,"num_read_kb":2864,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":219533,"num_read_kb":201172,"num_write":55836,"num_write_kb":19050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":143,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":36254,"num_omap_keys":147,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4202,"ondisk_log_size":4202,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":33830883,"num_objects":281,"num_object_clones":0,"num_object_copies":562,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":281,"num_whiteouts":0,"num_read":44198,"num_read_kb":2138103,"num_write":73249,"num_write_kb":2157996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":68608000,"data_stored":67661766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3853,"ondisk_log_size":3853,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":135,"num_read_kb":175817,"num_write":154,"num_write_kb":116354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":174730,"num_write":154,"num_write_kb":116354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509912,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":216692,"kb_used_data":18916,"kb_used_omap":1,"kb_used_meta":197758,"kb_avail":94155148,"statfs":{"total":96636764160,"available":96414871552,"internally_reserved":0,"allocated":19369984,"data_stored":17696805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":202504647},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509910,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284708,"kb_used_data":10580,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":94087132,"statfs":{"total":96636764160,"available":96345223168,"internally_reserved":0,"allocated":10833920,"data_stored":9216591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":280689093},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509909,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113044,"kb_used_data":19460,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94258796,"statfs":{"total":96636764160,"available":96521007104,"internally_reserved":0,"allocated":19927040,"data_stored":18233635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542614,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":229044,"kb_used_data":9124,"kb_used_omap":1,"kb_used_meta":219902,"kb_avail":94142796,"statfs":{"total":96636764160,"available":96402223104,"internally_reserved":0,"allocated":9342976,"data_stored":7745589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":225180106},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542614,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89140,"kb_used_data":8036,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94282700,"statfs":{"total":96636764160,"available":96545484800,"internally_reserved":0,"allocated":8228864,"data_stored":6610205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":83032518},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542616,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":256336,"kb_used_data":8640,"kb_used_omap":1,"kb_used_meta":247678,"kb_avail":94115504,"statfs":{"total":96636764160,"available":96374276096,"internally_reserved":0,"allocated":8847360,"data_stored":7201151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":253622725},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542615,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":193432,"kb_used_data":9608,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":94178408,"statfs":{"total":96636764160,"available":96438689792,"internally_reserved":0,"allocated":9838592,"data_stored":8236289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":188217797},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575318,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":111084,"kb_used_data":11868,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94260756,"statfs":{"total":96636764160,"available":96523014144,"internally_reserved":0,"allocated":12152832,"data_stored":10503839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16318464,"data_stored":16157858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6668288,"data_stored":6553434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8556544,"data_stored":8428200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15777792,"data_stored":15622768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6250496,"data_stored":6160671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4653056,"data_stored":4535149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4632576,"data_stored":4535041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5750784,"data_stored":5668645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":5195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:24:19.655 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-14T11:24:19.984 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-14T11:24:19.984 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-14T11:24:19.985 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-14T11:24:19.985 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:24:20.044 INFO:tasks.ceph.osd.0:Stopped 2024-09-14T11:24:20.044 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-14T11:24:20.044 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:24:20.092 INFO:tasks.ceph.osd.1:Stopped 2024-09-14T11:24:20.092 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-14T11:24:20.092 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:24:20.150 INFO:tasks.ceph.osd.2:Stopped 2024-09-14T11:24:20.150 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-14T11:24:20.151 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:24:20.196 INFO:tasks.ceph.osd.3:Stopped 2024-09-14T11:24:20.196 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-14T11:24:20.196 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:24:20.253 INFO:tasks.ceph.osd.4:Stopped 2024-09-14T11:24:20.253 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-14T11:24:20.253 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:24:20.301 INFO:tasks.ceph.osd.5:Stopped 2024-09-14T11:24:20.301 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-14T11:24:20.301 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:24:20.342 INFO:tasks.ceph.osd.6:Stopped 2024-09-14T11:24:20.343 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-14T11:24:20.343 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:24:20.382 INFO:tasks.ceph.osd.7:Stopped 2024-09-14T11:24:20.383 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-14T11:24:20.383 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-14T11:24:20.383 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:24:20.411 INFO:tasks.ceph.mgr.y:Stopped 2024-09-14T11:24:20.411 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-14T11:24:20.411 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:24:20.449 INFO:tasks.ceph.mgr.x:Stopped 2024-09-14T11:24:20.449 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-14T11:24:20.449 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-14T11:24:20.450 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:24:20.466 INFO:tasks.ceph.mon.a:Stopped 2024-09-14T11:24:20.466 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-14T11:24:20.466 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:24:20.518 INFO:tasks.ceph.mon.c:Stopped 2024-09-14T11:24:20.518 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-14T11:24:20.519 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:24:20.531 INFO:tasks.ceph.mon.b:Stopped 2024-09-14T11:24:20.531 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-14T11:24:20.531 DEBUG:teuthology.orchestra.run.smithi097:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-09-14T11:24:20.600 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi097.front.sepia.ceph.com 2024-09-14T11:24:20.600 DEBUG:teuthology.orchestra.run.smithi097:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-14T11:24:20.887 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi097.front.sepia.ceph.com 2024-09-14T11:24:20.887 DEBUG:teuthology.orchestra.run.smithi097:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-14T11:24:20.986 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi097.front.sepia.ceph.com 2024-09-14T11:24:20.986 DEBUG:teuthology.orchestra.run.smithi097:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-14T11:24:21.062 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi097.front.sepia.ceph.com 2024-09-14T11:24:21.062 DEBUG:teuthology.orchestra.run.smithi097:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-14T11:24:21.142 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi152.front.sepia.ceph.com 2024-09-14T11:24:21.142 DEBUG:teuthology.orchestra.run.smithi152:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-14T11:24:21.307 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi152.front.sepia.ceph.com 2024-09-14T11:24:21.307 DEBUG:teuthology.orchestra.run.smithi152:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-14T11:24:21.395 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi152.front.sepia.ceph.com 2024-09-14T11:24:21.395 DEBUG:teuthology.orchestra.run.smithi152:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-14T11:24:21.466 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi152.front.sepia.ceph.com 2024-09-14T11:24:21.467 DEBUG:teuthology.orchestra.run.smithi152:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-14T11:24:21.539 INFO:tasks.ceph:Archiving mon data... 2024-09-14T11:24:21.541 DEBUG:teuthology.misc:Transferring archived files from smithi097:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904126/data/mon.a.tgz 2024-09-14T11:24:21.541 DEBUG:teuthology.orchestra.run.smithi097:> mktemp 2024-09-14T11:24:21.571 INFO:teuthology.orchestra.run.smithi097.stdout:/tmp/tmp.eJBPQ1hEZ4 2024-09-14T11:24:21.571 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.eJBPQ1hEZ4 2024-09-14T11:24:21.786 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0666 /tmp/tmp.eJBPQ1hEZ4 2024-09-14T11:24:21.896 DEBUG:teuthology.orchestra.remote:smithi097:/tmp/tmp.eJBPQ1hEZ4 is 524KB 2024-09-14T11:24:21.994 DEBUG:teuthology.orchestra.run.smithi097:> rm -fr /tmp/tmp.eJBPQ1hEZ4 2024-09-14T11:24:22.023 DEBUG:teuthology.misc:Transferring archived files from smithi097:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904126/data/mon.c.tgz 2024-09-14T11:24:22.023 DEBUG:teuthology.orchestra.run.smithi097:> mktemp 2024-09-14T11:24:22.091 INFO:teuthology.orchestra.run.smithi097.stdout:/tmp/tmp.4VUBerjMHX 2024-09-14T11:24:22.091 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.4VUBerjMHX 2024-09-14T11:24:22.291 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0666 /tmp/tmp.4VUBerjMHX 2024-09-14T11:24:22.401 DEBUG:teuthology.orchestra.remote:smithi097:/tmp/tmp.4VUBerjMHX is 550KB 2024-09-14T11:24:22.500 DEBUG:teuthology.orchestra.run.smithi097:> rm -fr /tmp/tmp.4VUBerjMHX 2024-09-14T11:24:22.529 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904126/data/mon.b.tgz 2024-09-14T11:24:22.529 DEBUG:teuthology.orchestra.run.smithi152:> mktemp 2024-09-14T11:24:22.564 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/tmp.mrUJ4X2cPd 2024-09-14T11:24:22.564 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.mrUJ4X2cPd 2024-09-14T11:24:22.789 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0666 /tmp/tmp.mrUJ4X2cPd 2024-09-14T11:24:22.901 DEBUG:teuthology.orchestra.remote:smithi152:/tmp/tmp.mrUJ4X2cPd is 550KB 2024-09-14T11:24:22.998 DEBUG:teuthology.orchestra.run.smithi152:> rm -fr /tmp/tmp.mrUJ4X2cPd 2024-09-14T11:24:23.028 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-14T11:24:23.028 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-14T11:24:23.030 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-14T11:24:23.137 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-14T11:24:23.174 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-14T11:24:23.174 INFO:tasks.ceph:Archiving crash dumps... 2024-09-14T11:24:23.176 DEBUG:teuthology.misc:Transferring archived files from smithi097:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904126/remote/smithi097/crash 2024-09-14T11:24:23.177 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-14T11:24:23.215 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904126/remote/smithi152/crash 2024-09-14T11:24:23.216 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-14T11:24:23.254 INFO:tasks.ceph:Compressing logs... 2024-09-14T11:24:23.254 DEBUG:teuthology.orchestra.run.smithi097:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-14T11:24:23.260 DEBUG:teuthology.orchestra.run.smithi152:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-14T11:24:23.354 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32695.log 2024-09-14T11:24:23.354 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-14T11:24:23.355 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32651.log 2024-09-14T11:24:23.355 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.32695.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32695.log.gz 2024-09-14T11:24:23.355 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32926.log 2024-09-14T11:24:23.355 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-osd.7.log: /var/log/ceph/ceph-client.admin.32651.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-14T11:24:23.355 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32651.log.gz 2024-09-14T11:24:23.355 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.32926.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-14T11:24:23.355 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32926.log.gz 2024-09-14T11:24:23.355 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32739.log 2024-09-14T11:24:23.355 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-14T11:24:23.355 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.32739.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-14T11:24:23.355 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32739.log.gz 2024-09-14T11:24:23.355 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-14T11:24:23.355 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32873.log 2024-09-14T11:24:23.356 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-14T11:24:23.356 INFO:teuthology.orchestra.run.smithi152.stderr: 90.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-14T11:24:23.356 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.32873.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32873.log.gz 2024-09-14T11:24:23.356 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-14T11:24:23.356 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose --/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.32783.log 2024-09-14T11:24:23.356 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32827.log 2024-09-14T11:24:23.356 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.32783.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32783.log.gz 2024-09-14T11:24:23.356 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32591.log 2024-09-14T11:24:23.356 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.32827.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32827.log.gz 2024-09-14T11:24:23.356 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.32591.log: 27.4% -- replaced with /var/log/ceph/ceph-client.admin.32591.log.gz 2024-09-14T11:24:23.356 INFO:teuthology.orchestra.run.smithi152.stderr: 87.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-14T11:24:23.370 INFO:teuthology.orchestra.run.smithi152.stderr: 94.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-14T11:24:23.402 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-14T11:24:23.402 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171699.log 2024-09-14T11:24:23.402 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175164.log 2024-09-14T11:24:23.402 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.171699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71410.log 2024-09-14T11:24:23.402 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.175164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112151.log 2024-09-14T11:24:23.402 INFO:teuthology.orchestra.run.smithi097.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.171699.log.gz 2024-09-14T11:24:23.402 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109795.log 2024-09-14T11:24:23.402 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.71410.log: /var/log/ceph/ceph-client.admin.112151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76317.log 2024-09-14T11:24:23.402 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.109795.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.112151.log.gz 2024-09-14T11:24:23.402 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103905.log 2024-09-14T11:24:23.402 INFO:teuthology.orchestra.run.smithi097.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.109795.log.gz 2024-09-14T11:24:23.403 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.76317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178240.log 2024-09-14T11:24:23.403 INFO:teuthology.orchestra.run.smithi097.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.175164.log.gz 2024-09-14T11:24:23.403 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.103905.log: 84.2% -- replaced with /var/log/ceph/ceph-client.0.76317.log.gz 2024-09-14T11:24:23.403 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77636.log 2024-09-14T11:24:23.403 INFO:teuthology.orchestra.run.smithi097.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.103905.log.gz 2024-09-14T11:24:23.403 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.178240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62609.log 2024-09-14T11:24:23.403 INFO:teuthology.orchestra.run.smithi097.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.0.178240.log.gz 2024-09-14T11:24:23.403 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.77636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190787.log 2024-09-14T11:24:23.403 INFO:teuthology.orchestra.run.smithi097.stderr: 48.9% -- replaced with /var/log/ceph/ceph-client.admin.77636.log.gz 2024-09-14T11:24:23.403 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.62609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126288.log 2024-09-14T11:24:23.403 INFO:teuthology.orchestra.run.smithi097.stderr: 57.2% -- replaced with /var/log/ceph/ceph-client.admin.62609.log.gz 2024-09-14T11:24:23.403 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.190787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39033.log 2024-09-14T11:24:23.403 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190787.log.gz 2024-09-14T11:24:23.403 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.126288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180676.log 2024-09-14T11:24:23.404 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.39033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101549.log 2024-09-14T11:24:23.404 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39033.log.gz 2024-09-14T11:24:23.404 INFO:teuthology.orchestra.run.smithi097.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.126288.log.gz 2024-09-14T11:24:23.404 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.180676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120397.log 2024-09-14T11:24:23.404 INFO:teuthology.orchestra.run.smithi097.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.0.180676.log.gz/var/log/ceph/ceph-client.admin.101549.log: 2024-09-14T11:24:23.404 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50102.log 2024-09-14T11:24:23.404 INFO:teuthology.orchestra.run.smithi097.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.101549.log.gz 2024-09-14T11:24:23.404 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.120397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154563.log 2024-09-14T11:24:23.404 INFO:teuthology.orchestra.run.smithi097.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.71410.log.gz 2024-09-14T11:24:23.404 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.50102.log: 89.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.120397.log.gz 2024-09-14T11:24:23.404 INFO:teuthology.orchestra.run.smithi097.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.63114.log 2024-09-14T11:24:23.404 INFO:teuthology.orchestra.run.smithi097.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.50102.log.gz 2024-09-14T11:24:23.404 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.154563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141014.log 2024-09-14T11:24:23.405 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39031.log 2024-09-14T11:24:23.405 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.63114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99782.log 2024-09-14T11:24:23.405 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.141014.log: /var/log/ceph/ceph-client.admin.39031.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39031.log.gz 2024-09-14T11:24:23.405 INFO:teuthology.orchestra.run.smithi097.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.141014.log.gzgzip 2024-09-14T11:24:23.405 INFO:teuthology.orchestra.run.smithi097.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.38598.log 2024-09-14T11:24:23.405 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.184330.log 2024-09-14T11:24:23.405 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.99782.log: /var/log/ceph/ceph-client.admin.38598.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.99782.log.gz 2024-09-14T11:24:23.405 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41250.log 2024-09-14T11:24:23.405 INFO:teuthology.orchestra.run.smithi097.stderr: 85.9% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154563.log.gz -- replaced with /var/log/ceph/ceph-client.admin.38598.log.gz 2024-09-14T11:24:23.405 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-09-14T11:24:23.405 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.184330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187883.log 2024-09-14T11:24:23.405 INFO:teuthology.orchestra.run.smithi097.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.0.184330.log.gz 2024-09-14T11:24:23.405 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.41250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144549.log 2024-09-14T11:24:23.406 INFO:teuthology.orchestra.run.smithi097.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.41250.log.gz 2024-09-14T11:24:23.406 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187953.log 2024-09-14T11:24:23.406 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.187883.log: 53.6% -- replaced with /var/log/ceph/ceph-client.admin.187883.log.gz 2024-09-14T11:24:23.406 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.144549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62335.log 2024-09-14T11:24:23.406 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.187953.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.144549.log.gz 2024-09-14T11:24:23.406 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191479.log 2024-09-14T11:24:23.406 INFO:teuthology.orchestra.run.smithi097.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.187953.log.gz 2024-09-14T11:24:23.406 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82701.log 2024-09-14T11:24:23.406 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.62335.log: 59.8% -- replaced with /var/log/ceph/ceph-client.admin.62335.log.gz 2024-09-14T11:24:23.406 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.191479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115096.log 2024-09-14T11:24:23.406 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191479.log.gz 2024-09-14T11:24:23.406 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.82701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122164.log 2024-09-14T11:24:23.406 INFO:teuthology.orchestra.run.smithi097.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.82701.log.gz 2024-09-14T11:24:23.406 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.115096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131589.log 2024-09-14T11:24:23.407 INFO:teuthology.orchestra.run.smithi097.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.115096.log.gz 2024-09-14T11:24:23.407 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104494.log 2024-09-14T11:24:23.407 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.122164.log: /var/log/ceph/ceph-client.admin.131589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191525.log 2024-09-14T11:24:23.407 INFO:teuthology.orchestra.run.smithi097.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.131589.log.gz 2024-09-14T11:24:23.407 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.104494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60211.log 2024-09-14T11:24:23.407 INFO:teuthology.orchestra.run.smithi097.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.104494.log.gz 2024-09-14T11:24:23.407 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40158.log 2024-09-14T11:24:23.407 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.191525.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191525.log.gz 2024-09-14T11:24:23.407 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.60211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165235.log 2024-09-14T11:24:23.407 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60211.log.gz 2024-09-14T11:24:23.407 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.40158.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40158.log.gz 2024-09-14T11:24:23.407 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60235.log 2024-09-14T11:24:23.407 INFO:teuthology.orchestra.run.smithi097.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.122164.log.gz 2024-09-14T11:24:23.407 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.165235.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-14T11:24:23.408 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165235.log.gz 2024-09-14T11:24:23.408 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.60235.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.60235.log.gz 2024-09-14T11:24:23.408 INFO:teuthology.orchestra.run.smithi097.stderr: --verbose -- /var/log/ceph/ceph-client.admin.106261.log 2024-09-14T11:24:23.408 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39971.log 2024-09-14T11:24:23.408 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.106261.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.106261.log.gz 2024-09-14T11:24:23.408 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138658.log 2024-09-14T11:24:23.408 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-14T11:24:23.408 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.39971.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39971.log.gz 2024-09-14T11:24:23.408 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.138658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.179458.log 2024-09-14T11:24:23.408 INFO:teuthology.orchestra.run.smithi097.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.138658.log.gz 2024-09-14T11:24:23.408 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86235.log 2024-09-14T11:24:23.409 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.179458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187905.log 2024-09-14T11:24:23.409 INFO:teuthology.orchestra.run.smithi097.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.0.179458.log.gz 2024-09-14T11:24:23.409 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.86235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74376.log 2024-09-14T11:24:23.409 INFO:teuthology.orchestra.run.smithi097.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.86235.log.gz 2024-09-14T11:24:23.409 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.187905.log: gzip -5 0.0% --verbose -- /var/log/ceph/ceph-client.admin.132178.log 2024-09-14T11:24:23.409 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.187905.log.gz 2024-09-14T11:24:23.409 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.74376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42462.log 2024-09-14T11:24:23.409 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.132178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162242.log 2024-09-14T11:24:23.409 INFO:teuthology.orchestra.run.smithi097.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.132178.log.gz 2024-09-14T11:24:23.409 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.42462.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.74376.log.gz 2024-09-14T11:24:23.409 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151618.log 2024-09-14T11:24:23.409 INFO:teuthology.orchestra.run.smithi097.stderr: 43.5% -- replaced with /var/log/ceph/ceph-client.0.42462.log.gz 2024-09-14T11:24:23.410 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105083.log 2024-09-14T11:24:23.410 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.162242.log: /var/log/ceph/ceph-client.admin.151618.log: gzip -5 81.9% -- replaced with /var/log/ceph/ceph-client.admin.162242.log.gz 2024-09-14T11:24:23.410 INFO:teuthology.orchestra.run.smithi097.stderr: --verbose -- /var/log/ceph/ceph-client.admin.149262.log 2024-09-14T11:24:23.410 INFO:teuthology.orchestra.run.smithi097.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.151618.log.gz 2024-09-14T11:24:23.410 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.105083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190833.log 2024-09-14T11:24:23.410 INFO:teuthology.orchestra.run.smithi097.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.105083.log.gz 2024-09-14T11:24:23.410 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.184939.log 2024-09-14T11:24:23.410 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.149262.log: /var/log/ceph/ceph-client.admin.190833.log: 85.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93892.log 2024-09-14T11:24:23.410 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.149262.log.gz 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190833.log.gz 2024-09-14T11:24:23.410 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-09-14T11:24:23.410 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.184939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166461.log 2024-09-14T11:24:23.410 INFO:teuthology.orchestra.run.smithi097.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.0.184939.log.gz 2024-09-14T11:24:23.410 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.93892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38774.log 2024-09-14T11:24:23.411 INFO:teuthology.orchestra.run.smithi097.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.93892.log.gz 2024-09-14T11:24:23.411 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.166461.log: /var/log/ceph/ceph-client.admin.152207.log 2024-09-14T11:24:23.411 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.38774.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.166461.log.gz 2024-09-14T11:24:23.411 INFO:teuthology.orchestra.run.smithi097.stderr:gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38774.log.gz 2024-09-14T11:24:23.411 INFO:teuthology.orchestra.run.smithi097.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.43065.log 2024-09-14T11:24:23.411 INFO:teuthology.orchestra.run.smithi097.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.63114.log.gz 2024-09-14T11:24:23.411 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.152207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133356.log 2024-09-14T11:24:23.411 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.43065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39770.log 2024-09-14T11:24:23.411 INFO:teuthology.orchestra.run.smithi097.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.152207.log.gz 2024-09-14T11:24:23.411 INFO:teuthology.orchestra.run.smithi097.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.0.43065.log.gz 2024-09-14T11:24:23.411 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.133356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118041.log 2024-09-14T11:24:23.411 INFO:teuthology.orchestra.run.smithi097.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.133356.log.gz 2024-09-14T11:24:23.411 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92714.log 2024-09-14T11:24:23.411 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.39770.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39770.log.gz 2024-09-14T11:24:23.412 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.118041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186704.log 2024-09-14T11:24:23.412 INFO:teuthology.orchestra.run.smithi097.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.118041.log.gz 2024-09-14T11:24:23.412 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171091.log 2024-09-14T11:24:23.412 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.92714.log: /var/log/ceph/ceph-client.admin.186704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63894.log 2024-09-14T11:24:23.412 INFO:teuthology.orchestra.run.smithi097.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.92714.log.gz 2024-09-14T11:24:23.412 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.171091.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.186704.log.gz 2024-09-14T11:24:23.412 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39401.log 2024-09-14T11:24:23.412 INFO:teuthology.orchestra.run.smithi097.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.171091.log.gz 2024-09-14T11:24:23.412 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.63894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160475.log 2024-09-14T11:24:23.412 INFO:teuthology.orchestra.run.smithi097.stderr: 19.5% -- replaced with /var/log/ceph/ceph-client.admin.63894.log.gz 2024-09-14T11:24:23.412 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.39401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56629.log 2024-09-14T11:24:23.412 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39401.log.gz 2024-09-14T11:24:23.412 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.160475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73168.log 2024-09-14T11:24:23.413 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56629.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.160475.log.gz 2024-09-14T11:24:23.413 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191203.log 2024-09-14T11:24:23.413 INFO:teuthology.orchestra.run.smithi097.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.56629.log.gz 2024-09-14T11:24:23.413 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.73168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103316.log 2024-09-14T11:24:23.413 INFO:teuthology.orchestra.run.smithi097.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.73168.log.gz 2024-09-14T11:24:23.413 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.191203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39769.log 2024-09-14T11:24:23.413 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191203.log.gz 2024-09-14T11:24:23.413 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.103316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39388.log 2024-09-14T11:24:23.413 INFO:teuthology.orchestra.run.smithi097.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.103316.log.gz 2024-09-14T11:24:23.413 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.39769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113329.log 2024-09-14T11:24:23.413 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39769.log.gz 2024-09-14T11:24:23.413 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.39388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40384.log 2024-09-14T11:24:23.413 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39388.log.gz 2024-09-14T11:24:23.414 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.113329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40610.log 2024-09-14T11:24:23.414 INFO:teuthology.orchestra.run.smithi097.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.113329.log.gz 2024-09-14T11:24:23.414 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.40384.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40384.log.gz 2024-09-14T11:24:23.414 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40123.log 2024-09-14T11:24:23.414 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.40610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111562.log 2024-09-14T11:24:23.414 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40610.log.gz 2024-09-14T11:24:23.414 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.40123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38820.log 2024-09-14T11:24:23.414 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40123.log.gz 2024-09-14T11:24:23.414 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.111562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127466.log 2024-09-14T11:24:23.414 INFO:teuthology.orchestra.run.smithi097.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.111562.log.gz 2024-09-14T11:24:23.414 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.38820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110384.log 2024-09-14T11:24:23.414 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38820.log.gz 2024-09-14T11:24:23.414 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.127466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188589.log 2024-09-14T11:24:23.414 INFO:teuthology.orchestra.run.smithi097.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.127466.log.gz 2024-09-14T11:24:23.415 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.110384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49513.log 2024-09-14T11:24:23.415 INFO:teuthology.orchestra.run.smithi097.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.110384.log.gz 2024-09-14T11:24:23.415 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.188589.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188589.log.gz 2024-09-14T11:24:23.415 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38534.log 2024-09-14T11:24:23.415 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.176411.log 2024-09-14T11:24:23.415 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.49513.log: /var/log/ceph/ceph-client.admin.38534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191157.log 2024-09-14T11:24:23.415 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38534.log.gz 2024-09-14T11:24:23.415 INFO:teuthology.orchestra.run.smithi097.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.49513.log.gz 2024-09-14T11:24:23.415 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.176411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38623.log 2024-09-14T11:24:23.415 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.191157.log: 83.9% -- replaced with /var/log/ceph/ceph-client.0.176411.log.gz 2024-09-14T11:24:23.415 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191157.log.gz 2024-09-14T11:24:23.415 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44880.log 2024-09-14T11:24:23.415 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39384.log 2024-09-14T11:24:23.416 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.38623.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38623.log.gz 2024-09-14T11:24:23.416 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.44880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39766.log 2024-09-14T11:24:23.416 INFO:teuthology.orchestra.run.smithi097.stderr: 43.5% -- replaced with /var/log/ceph/ceph-client.0.44880.log.gz 2024-09-14T11:24:23.416 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.39384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63245.log 2024-09-14T11:24:23.416 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39384.log.gz 2024-09-14T11:24:23.416 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.39766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102138.log 2024-09-14T11:24:23.416 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39766.log.gz 2024-09-14T11:24:23.416 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.63245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153974.log 2024-09-14T11:24:23.416 INFO:teuthology.orchestra.run.smithi097.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.63245.log.gz 2024-09-14T11:24:23.416 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.102138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59033.log 2024-09-14T11:24:23.416 INFO:teuthology.orchestra.run.smithi097.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.102138.log.gz 2024-09-14T11:24:23.416 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39028.log 2024-09-14T11:24:23.416 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.153974.log: /var/log/ceph/ceph-client.admin.59033.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.153974.log.gz 2024-09-14T11:24:23.417 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180067.log 2024-09-14T11:24:23.417 INFO:teuthology.orchestra.run.smithi097.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.59033.log.gz 2024-09-14T11:24:23.417 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.39028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92125.log 2024-09-14T11:24:23.417 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39028.log.gz 2024-09-14T11:24:23.417 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.180067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40520.log 2024-09-14T11:24:23.417 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.92125.log: 80.4% -- replaced with /var/log/ceph/ceph-client.0.180067.log.gz 2024-09-14T11:24:23.417 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75557.log 2024-09-14T11:24:23.417 INFO:teuthology.orchestra.run.smithi097.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.92125.log.gz 2024-09-14T11:24:23.417 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.40520.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.125110.log -- replaced with /var/log/ceph/ceph-client.admin.40520.log.gz 2024-09-14T11:24:23.417 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-09-14T11:24:23.417 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.75557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51917.log 2024-09-14T11:24:23.417 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.125110.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.75557.log.gz 2024-09-14T11:24:23.417 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152796.log 2024-09-14T11:24:23.418 INFO:teuthology.orchestra.run.smithi097.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.125110.log.gz 2024-09-14T11:24:23.418 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88591.log 2024-09-14T11:24:23.418 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.51917.log: /var/log/ceph/ceph-client.admin.152796.log: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.51917.log.gz 2024-09-14T11:24:23.418 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191803.log 2024-09-14T11:24:23.418 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.88591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164646.log 2024-09-14T11:24:23.418 INFO:teuthology.orchestra.run.smithi097.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.88591.log.gz 2024-09-14T11:24:23.418 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.191803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67073.log 2024-09-14T11:24:23.418 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191803.log.gz 2024-09-14T11:24:23.418 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.164646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190695.log 2024-09-14T11:24:23.418 INFO:teuthology.orchestra.run.smithi097.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.152796.log.gz/var/log/ceph/ceph-client.admin.67073.log: 2024-09-14T11:24:23.418 INFO:teuthology.orchestra.run.smithi097.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.164646.log.gz 2024-09-14T11:24:23.418 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51893.log 2024-09-14T11:24:23.418 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.190695.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190695.log.gz 2024-09-14T11:24:23.418 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52506.log 2024-09-14T11:24:23.419 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48287.log 2024-09-14T11:24:23.419 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.51893.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51893.log.gz 2024-09-14T11:24:23.419 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.52506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69552.log 2024-09-14T11:24:23.419 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.48287.log: gzip -5 --verbose -- 86.1% -- replaced with /var/log/ceph/ceph-client.admin.52506.log.gz 2024-09-14T11:24:23.419 INFO:teuthology.orchestra.run.smithi097.stderr: /var/log/ceph/ceph-client.admin.188613.log 2024-09-14T11:24:23.419 INFO:teuthology.orchestra.run.smithi097.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.48287.log.gz 2024-09-14T11:24:23.419 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.69552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160454.log 2024-09-14T11:24:23.419 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.188613.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188613.log.gz 2024-09-14T11:24:23.419 INFO:teuthology.orchestra.run.smithi097.stderr: --verbose -- /var/log/ceph/ceph-client.admin.142781.log 2024-09-14T11:24:23.419 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.160454.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160454.log.gz 2024-09-14T11:24:23.419 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159275.log 2024-09-14T11:24:23.419 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.142781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38728.log 2024-09-14T11:24:23.419 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.159275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32785.log 2024-09-14T11:24:23.419 INFO:teuthology.orchestra.run.smithi097.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.159275.log.gz 92.5% 2024-09-14T11:24:23.420 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.69552.log.gz 2024-09-14T11:24:23.420 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.38728.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38728.log.gz 2024-09-14T11:24:23.420 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54862.log 2024-09-14T11:24:23.420 INFO:teuthology.orchestra.run.smithi097.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.142781.log.gz 2024-09-14T11:24:23.420 INFO:teuthology.orchestra.run.smithi097.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.67073.log.gz 2024-09-14T11:24:23.420 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.32785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123932.log 2024-09-14T11:24:23.420 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32785.log.gz 2024-09-14T11:24:23.420 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.54862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.183112.log 2024-09-14T11:24:23.420 INFO:teuthology.orchestra.run.smithi097.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.54862.log.gz 2024-09-14T11:24:23.420 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.123932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39032.log 2024-09-14T11:24:23.420 INFO:teuthology.orchestra.run.smithi097.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.123932.log.gz 2024-09-14T11:24:23.420 INFO:teuthology.orchestra.run.smithi097.stderr:gzip/var/log/ceph/ceph-client.0.183112.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.59622.log 2024-09-14T11:24:23.420 INFO:teuthology.orchestra.run.smithi097.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.0.183112.log.gz 2024-09-14T11:24:23.420 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.39032.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-14T11:24:23.421 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39032.log.gz 2024-09-14T11:24:23.421 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.59622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155741.log 2024-09-14T11:24:23.421 INFO:teuthology.orchestra.run.smithi097.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.59622.log.gz 2024-09-14T11:24:23.421 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131000.log 2024-09-14T11:24:23.421 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91536.log 2024-09-14T11:24:23.421 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.155741.log: /var/log/ceph/ceph-client.admin.131000.log: gzip -5 --verbose -- 85.4% /var/log/ceph/ceph-client.admin.100371.log 2024-09-14T11:24:23.421 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.155741.log.gz 2024-09-14T11:24:23.421 INFO:teuthology.orchestra.run.smithi097.stderr: 81.9%/var/log/ceph/ceph-client.admin.91536.log: -- replaced with /var/log/ceph/ceph-client.admin.131000.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39760.log 2024-09-14T11:24:23.421 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-09-14T11:24:23.421 INFO:teuthology.orchestra.run.smithi097.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.91536.log.gz 2024-09-14T11:24:23.421 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.100371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175772.log 2024-09-14T11:24:23.421 INFO:teuthology.orchestra.run.smithi097.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.100371.log.gz 2024-09-14T11:24:23.421 INFO:teuthology.orchestra.run.smithi097.stderr:gzip/var/log/ceph/ceph-client.admin.39760.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.51869.log 2024-09-14T11:24:23.422 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39760.log.gz 2024-09-14T11:24:23.422 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.175772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40430.log 2024-09-14T11:24:23.422 INFO:teuthology.orchestra.run.smithi097.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.175772.log.gz 2024-09-14T11:24:23.422 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.51869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158686.log 2024-09-14T11:24:23.422 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51869.log.gz 2024-09-14T11:24:23.422 INFO:teuthology.orchestra.run.smithi097.stderr: 94.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-14T11:24:23.422 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188662.log 2024-09-14T11:24:23.422 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.40430.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40430.log.gz 2024-09-14T11:24:23.422 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.158686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156919.log 2024-09-14T11:24:23.422 INFO:teuthology.orchestra.run.smithi097.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.158686.log.gz 2024-09-14T11:24:23.422 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.188662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44277.log 2024-09-14T11:24:23.422 INFO:teuthology.orchestra.run.smithi097.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.188662.log.gz 2024-09-14T11:24:23.422 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191341.log 2024-09-14T11:24:23.422 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.156919.log: /var/log/ceph/ceph-client.0.44277.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.156919.log.gz 2024-09-14T11:24:23.423 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72074.log 2024-09-14T11:24:23.423 INFO:teuthology.orchestra.run.smithi097.stderr: 44.2% -- replaced with /var/log/ceph/ceph-client.0.44277.log.gz 2024-09-14T11:24:23.423 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.191341.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191341.log.gz 2024-09-14T11:24:23.423 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79756.log 2024-09-14T11:24:23.423 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.72074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191249.log 2024-09-14T11:24:23.423 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.79756.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.72074.log.gz 2024-09-14T11:24:23.423 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68933.log 2024-09-14T11:24:23.423 INFO:teuthology.orchestra.run.smithi097.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.79756.log.gz 2024-09-14T11:24:23.423 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51280.log 2024-09-14T11:24:23.423 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.191249.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191249.log.gz 2024-09-14T11:24:23.423 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.68933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95659.log 2024-09-14T11:24:23.423 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.51280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81523.log 2024-09-14T11:24:23.424 INFO:teuthology.orchestra.run.smithi097.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.51280.log.gz 2024-09-14T11:24:23.424 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.95659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143370.log 2024-09-14T11:24:23.424 INFO:teuthology.orchestra.run.smithi097.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.95659.log.gz 2024-09-14T11:24:23.424 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.81523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85646.log 2024-09-14T11:24:23.424 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.143370.log: gzip -5 --verbose -- 89.1% -- replaced with /var/log/ceph/ceph-client.admin.81523.log.gz 2024-09-14T11:24:23.424 INFO:teuthology.orchestra.run.smithi097.stderr: /var/log/ceph/ceph-client.0.40633.log 2024-09-14T11:24:23.424 INFO:teuthology.orchestra.run.smithi097.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.143370.log.gz 2024-09-14T11:24:23.424 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.85646.log: 81.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.85646.log.gz 2024-09-14T11:24:23.424 INFO:teuthology.orchestra.run.smithi097.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.164057.log 2024-09-14T11:24:23.424 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74966.log 2024-09-14T11:24:23.424 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.40633.log: /var/log/ceph/ceph-client.admin.164057.log: gzip 86.9% -- replaced with /var/log/ceph/ceph-client.admin.164057.log.gz 2024-09-14T11:24:23.424 INFO:teuthology.orchestra.run.smithi097.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.119808.log 2024-09-14T11:24:23.424 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.74966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.183721.log 80.9% -- replaced with /var/log/ceph/ceph-client.admin.74966.log.gz 2024-09-14T11:24:23.425 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-09-14T11:24:23.425 INFO:teuthology.orchestra.run.smithi097.stderr: 95.9% -- replaced with /var/log/ceph/ceph-client.0.40633.log.gz 2024-09-14T11:24:23.425 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.119808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40086.log 2024-09-14T11:24:23.425 INFO:teuthology.orchestra.run.smithi097.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.119808.log.gz 2024-09-14T11:24:23.425 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.183721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134534.log 2024-09-14T11:24:23.425 INFO:teuthology.orchestra.run.smithi097.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.0.183721.log.gz 2024-09-14T11:24:23.425 INFO:teuthology.orchestra.run.smithi097.stderr:gzip/var/log/ceph/ceph-client.admin.40086.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.80934.log 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40086.log.gz 2024-09-14T11:24:23.425 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-09-14T11:24:23.425 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.134534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135712.log 2024-09-14T11:24:23.425 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.80934.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2024-09-14T11:24:23.425 INFO:teuthology.orchestra.run.smithi097.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.80934.log.gz 2024-09-14T11:24:23.425 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.135712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77692.log 2024-09-14T11:24:23.425 INFO:teuthology.orchestra.run.smithi097.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.135712.log.gz 2024-09-14T11:24:23.426 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70171.log 2024-09-14T11:24:23.426 INFO:teuthology.orchestra.run.smithi097.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.134534.log.gz 2024-09-14T11:24:23.426 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ops-log-ceph-client.admin.log: /var/log/ceph/ceph-client.0.77692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39400.log 2024-09-14T11:24:23.426 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.70171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150440.log 2024-09-14T11:24:23.426 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.39400.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39400.log.gz 2024-09-14T11:24:23.426 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80345.log 2024-09-14T11:24:23.426 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.150440.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.70171.log.gz 2024-09-14T11:24:23.426 INFO:teuthology.orchestra.run.smithi097.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.150440.log.gz 2024-09-14T11:24:23.426 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39402.log 2024-09-14T11:24:23.426 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.80345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57831.log 2024-09-14T11:24:23.426 INFO:teuthology.orchestra.run.smithi097.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.77692.log.gz 2024-09-14T11:24:23.426 INFO:teuthology.orchestra.run.smithi097.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.80345.log.gz 2024-09-14T11:24:23.426 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.39402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158097.log 2024-09-14T11:24:23.426 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39402.log.gz 2024-09-14T11:24:23.427 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.57831.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57831.log.gz 2024-09-14T11:24:23.427 INFO:teuthology.orchestra.run.smithi097.stderr: --verbose -- /var/log/ceph/ceph-client.admin.168947.log 2024-09-14T11:24:23.427 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.158097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141603.log 2024-09-14T11:24:23.427 INFO:teuthology.orchestra.run.smithi097.stderr: 88.9%/var/log/ceph/ceph-client.admin.168947.log: -- replaced with /var/log/ceph/ceph-client.admin.158097.log.gz 2024-09-14T11:24:23.427 INFO:teuthology.orchestra.run.smithi097.stderr: 94.2% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2024-09-14T11:24:23.427 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156330.log 2024-09-14T11:24:23.427 INFO:teuthology.orchestra.run.smithi097.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.168947.log.gz 2024-09-14T11:24:23.427 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123343.log 2024-09-14T11:24:23.427 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.141603.log: /var/log/ceph/ceph-client.admin.156330.log: 81.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97426.log 2024-09-14T11:24:23.427 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.141603.log.gz 2024-09-14T11:24:23.427 INFO:teuthology.orchestra.run.smithi097.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.156330.log.gz 2024-09-14T11:24:23.427 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.123343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191111.log 2024-09-14T11:24:23.427 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.97426.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.123343.log.gz 2024-09-14T11:24:23.427 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.185548.log 2024-09-14T11:24:23.428 INFO:teuthology.orchestra.run.smithi097.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.97426.log.gz 2024-09-14T11:24:23.428 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.191111.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191111.log.gz 2024-09-14T11:24:23.428 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66454.log 2024-09-14T11:24:23.428 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.185548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56040.log 2024-09-14T11:24:23.428 INFO:teuthology.orchestra.run.smithi097.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.0.185548.log.gz 2024-09-14T11:24:23.428 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.66454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191663.log 2024-09-14T11:24:23.428 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5/var/log/ceph/ceph-client.admin.56040.log: --verbose -- /var/log/ceph/ceph-client.admin.119219.log 2024-09-14T11:24:23.428 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.191663.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.56040.log.gz 2024-09-14T11:24:23.428 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191663.log.gz 2024-09-14T11:24:23.428 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63828.log 2024-09-14T11:24:23.428 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.119219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159864.log 2024-09-14T11:24:23.428 INFO:teuthology.orchestra.run.smithi097.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.119219.log.gz 2024-09-14T11:24:23.428 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.63828.log: gzip 19.9% -- replaced with /var/log/ceph/ceph-client.admin.63828.log.gz 2024-09-14T11:24:23.429 INFO:teuthology.orchestra.run.smithi097.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.60848.log 2024-09-14T11:24:23.429 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.159864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162831.log 2024-09-14T11:24:23.429 INFO:teuthology.orchestra.run.smithi097.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.159864.log.gz 2024-09-14T11:24:23.429 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.60848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133945.log 2024-09-14T11:24:23.429 INFO:teuthology.orchestra.run.smithi097.stderr: 86.2%/var/log/ceph/ceph-client.admin.162831.log: -- replaced with /var/log/ceph/ceph-client.admin.60848.log.gz 2024-09-14T11:24:23.429 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-14T11:24:23.429 INFO:teuthology.orchestra.run.smithi097.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.162831.log.gz 2024-09-14T11:24:23.429 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39768.log 2024-09-14T11:24:23.429 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.133945.log: /var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.26700.log 2024-09-14T11:24:23.429 INFO:teuthology.orchestra.run.smithi097.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.133945.log.gz 2024-09-14T11:24:23.429 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.39768.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39768.log.gz 2024-09-14T11:24:23.429 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116863.log 2024-09-14T11:24:23.429 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5/var/log/ceph/ceph.tmp-client.admin.26700.log: --verbose -- /var/log/ceph/ceph-client.admin.39763.log 93.1% -- replaced with /var/log/ceph/ceph-client.admin.66454.log.gz 2024-09-14T11:24:23.430 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.26700.log.gz 2024-09-14T11:24:23.430 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-09-14T11:24:23.430 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.116863.log: -- /var/log/ceph/ceph-client.admin.73757.log 2024-09-14T11:24:23.430 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.39763.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.116863.log.gz 2024-09-14T11:24:23.430 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39763.log.gz 2024-09-14T11:24:23.430 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39390.log 2024-09-14T11:24:23.430 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85057.log 2024-09-14T11:24:23.430 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.73757.log: /var/log/ceph/ceph-client.admin.39390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188543.log 2024-09-14T11:24:23.430 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39390.log.gz 2024-09-14T11:24:23.430 INFO:teuthology.orchestra.run.smithi097.stderr: 84.3%/var/log/ceph/ceph-client.admin.85057.log: -- replaced with /var/log/ceph/ceph-client.admin.73757.log.gz 2024-09-14T11:24:23.430 INFO:teuthology.orchestra.run.smithi097.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.85057.log.gz 2024-09-14T11:24:23.430 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105672.log 2024-09-14T11:24:23.430 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.188543.log: 24.4% -- replaced with /var/log/ceph/ceph-client.admin.188543.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57855.log 2024-09-14T11:24:23.431 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-09-14T11:24:23.431 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.105672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188638.log 2024-09-14T11:24:23.431 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.57855.log: gzip -5 87.4% -- replaced with /var/log/ceph/ceph-client.admin.105672.log.gz 2024-09-14T11:24:23.431 INFO:teuthology.orchestra.run.smithi097.stderr: --verbose -- /var/log/ceph/ceph-client.admin.187929.log 2024-09-14T11:24:23.431 INFO:teuthology.orchestra.run.smithi097.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.57855.log.gz 2024-09-14T11:24:23.431 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.188638.log: /var/log/ceph/ceph-client.admin.65835.log 2024-09-14T11:24:23.431 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188638.log.gz 2024-09-14T11:24:23.431 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.187929.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.187929.log.gz 2024-09-14T11:24:23.431 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41853.log 2024-09-14T11:24:23.431 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49489.log 2024-09-14T11:24:23.431 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.65835.log: /var/log/ceph/ceph-client.0.41853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165872.log 2024-09-14T11:24:23.431 INFO:teuthology.orchestra.run.smithi097.stderr: 80.5%/var/log/ceph/ceph-client.admin.49489.log: -- replaced with /var/log/ceph/ceph-client.0.41853.log.gz 2024-09-14T11:24:23.431 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49489.log.gz 2024-09-14T11:24:23.431 INFO:teuthology.orchestra.run.smithi097.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.68933.log.gz 2024-09-14T11:24:23.431 INFO:teuthology.orchestra.run.smithi097.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.65835.log.gz 2024-09-14T11:24:23.432 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118630.log 2024-09-14T11:24:23.432 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.165872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88002.log 2024-09-14T11:24:23.432 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.118630.log: gzip 86.8% -- replaced with /var/log/ceph/ceph-client.admin.165872.log.gz 2024-09-14T11:24:23.432 INFO:teuthology.orchestra.run.smithi097.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.132767.log 2024-09-14T11:24:23.432 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.88002.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.118630.log.gz 2024-09-14T11:24:23.432 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128055.log 2024-09-14T11:24:23.432 INFO:teuthology.orchestra.run.smithi097.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.88002.log.gz 2024-09-14T11:24:23.432 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.132767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142192.log 2024-09-14T11:24:23.432 INFO:teuthology.orchestra.run.smithi097.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.132767.log.gz 2024-09-14T11:24:23.432 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.128055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39602.log 2024-09-14T11:24:23.432 INFO:teuthology.orchestra.run.smithi097.stderr:gzip/var/log/ceph/ceph-client.admin.142192.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.126877.log 2024-09-14T11:24:23.432 INFO:teuthology.orchestra.run.smithi097.stderr: 81.8%/var/log/ceph/ceph-client.admin.39602.log: -- replaced with /var/log/ceph/ceph-client.admin.142192.log.gz 2024-09-14T11:24:23.432 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39602.log.gz 2024-09-14T11:24:23.433 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-14T11:24:23.433 INFO:teuthology.orchestra.run.smithi097.stderr:gzip/var/log/ceph/ceph-client.admin.126877.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.84468.log 2024-09-14T11:24:23.433 INFO:teuthology.orchestra.run.smithi097.stderr: 81.7%/var/log/ceph/ceph-mon.a.log: -- replaced with /var/log/ceph/ceph-client.admin.126877.log.gz 2024-09-14T11:24:23.433 INFO:teuthology.orchestra.run.smithi097.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.128055.log.gz 2024-09-14T11:24:23.433 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146905.log 2024-09-14T11:24:23.433 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.84468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114507.log 2024-09-14T11:24:23.433 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.146905.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.84468.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145138.log 2024-09-14T11:24:23.433 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-09-14T11:24:23.433 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187293.log 2024-09-14T11:24:23.433 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.145138.log: /var/log/ceph/ceph-client.admin.114507.log: 81.7% 81.8% -- replaced with /var/log/ceph/ceph-client.admin.114507.log.gz 2024-09-14T11:24:23.433 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.145138.log.gz 2024-09-14T11:24:23.433 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191065.log 2024-09-14T11:24:23.433 INFO:teuthology.orchestra.run.smithi097.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.146905.log.gz 2024-09-14T11:24:23.433 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.187293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113918.log 2024-09-14T11:24:23.434 INFO:teuthology.orchestra.run.smithi097.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.187293.log.gz 2024-09-14T11:24:23.434 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40119.log/var/log/ceph/ceph-client.admin.191065.log: 2024-09-14T11:24:23.434 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191065.log.gz 2024-09-14T11:24:23.434 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.113918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67693.log 2024-09-14T11:24:23.434 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.40119.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40119.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62727.log 2024-09-14T11:24:23.434 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-09-14T11:24:23.434 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140425.log 2024-09-14T11:24:23.434 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.62727.log: /var/log/ceph/ceph-client.admin.67693.log: 49.1% 87.0% -- replaced with /var/log/ceph/ceph-client.admin.113918.log.gz 2024-09-14T11:24:23.434 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62727.log.gz 2024-09-14T11:24:23.434 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-14T11:24:23.434 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.140425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165283.log 2024-09-14T11:24:23.434 INFO:teuthology.orchestra.run.smithi097.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.140425.log.gz 2024-09-14T11:24:23.435 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33117.log 2024-09-14T11:24:23.435 INFO:teuthology.orchestra.run.smithi097.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.67693.log.gz 2024-09-14T11:24:23.435 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.165283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70790.log 2024-09-14T11:24:23.435 INFO:teuthology.orchestra.run.smithi097.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.165283.log.gz 2024-09-14T11:24:23.435 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.33117.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33117.log.gz 2024-09-14T11:24:23.435 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.167690.log 2024-09-14T11:24:23.435 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.70790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49465.log 2024-09-14T11:24:23.435 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.167690.log: 84.1% -- replaced with /var/log/ceph/ceph-client.0.167690.log.gz 2024-09-14T11:24:23.435 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63181.log 2024-09-14T11:24:23.435 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.49465.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.70790.log.gz 2024-09-14T11:24:23.435 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49465.log.gz 2024-09-14T11:24:23.435 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53684.log 2024-09-14T11:24:23.435 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.63181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191710.log 2024-09-14T11:24:23.435 INFO:teuthology.orchestra.run.smithi097.stderr: 56.6% -- replaced with /var/log/ceph/ceph-client.admin.63181.log.gz 2024-09-14T11:24:23.436 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.53684.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.53684.log.gz 2024-09-14T11:24:23.436 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57807.log 2024-09-14T11:24:23.436 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.191710.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191710.log.gz 2024-09-14T11:24:23.436 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-14T11:24:23.436 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147494.log 2024-09-14T11:24:23.436 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.57807.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57807.log.gz 2024-09-14T11:24:23.436 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37989.log 2024-09-14T11:24:23.436 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.147494.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.147494.log.gz 2024-09-14T11:24:23.436 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.177020.log 2024-09-14T11:24:23.436 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.37989.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37989.log.gz 2024-09-14T11:24:23.436 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146316.log 2024-09-14T11:24:23.436 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.177020.log: 83.9% -- replaced with /var/log/ceph/ceph-client.0.177020.log.gz 2024-09-14T11:24:23.436 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40564.log 2024-09-14T11:24:23.437 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.146316.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.146316.log.gz 2024-09-14T11:24:23.437 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39361.log 2024-09-14T11:24:23.437 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.40564.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40564.log.gz 2024-09-14T11:24:23.437 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65216.log 2024-09-14T11:24:23.437 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.39361.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39361.log.gz 2024-09-14T11:24:23.437 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45483.log 2024-09-14T11:24:23.437 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.65216.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.65216.log.gz 2024-09-14T11:24:23.437 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64008.log 2024-09-14T11:24:23.437 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.45483.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.45483.log.gz 2024-09-14T11:24:23.437 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96248.log 2024-09-14T11:24:23.437 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.64008.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.64008.log.gz 2024-09-14T11:24:23.437 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-14T11:24:23.437 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.96248.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.96248.log.gz 2024-09-14T11:24:23.438 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139836.log 2024-09-14T11:24:23.458 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191757.log 2024-09-14T11:24:23.458 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.139836.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.139836.log.gz 2024-09-14T11:24:23.459 INFO:teuthology.orchestra.run.smithi097.stderr: 93.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-14T11:24:23.459 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55451.log 2024-09-14T11:24:23.459 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.191757.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191757.log.gz 2024-09-14T11:24:23.459 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.181894.log 2024-09-14T11:24:23.459 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.55451.log: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.55451.log.gz 2024-09-14T11:24:23.459 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50691.log 2024-09-14T11:24:23.459 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.181894.log: 80.4% -- replaced with /var/log/ceph/ceph-client.0.181894.log.gz 2024-09-14T11:24:23.459 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128644.log 2024-09-14T11:24:23.459 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.50691.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.50691.log.gz 2024-09-14T11:24:23.459 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124521.log 2024-09-14T11:24:23.459 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.128644.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.128644.log.gz 2024-09-14T11:24:23.459 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47698.log 2024-09-14T11:24:23.459 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.124521.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.124521.log.gz 2024-09-14T11:24:23.459 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40338.log 2024-09-14T11:24:23.460 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.47698.log: 83.4% -- replaced with /var/log/ceph/ceph-client.admin.47698.log.gz 2024-09-14T11:24:23.460 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138069.log 2024-09-14T11:24:23.460 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.40338.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40338.log.gz 2024-09-14T11:24:23.460 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43674.log 2024-09-14T11:24:23.460 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.138069.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.138069.log.gz 2024-09-14T11:24:23.460 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94481.log 2024-09-14T11:24:23.460 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.43674.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.43674.log.gz 2024-09-14T11:24:23.460 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161653.log 2024-09-14T11:24:23.460 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.94481.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.94481.log.gz 2024-09-14T11:24:23.460 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109206.log 2024-09-14T11:24:23.460 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.161653.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.161653.log.gz 2024-09-14T11:24:23.460 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98604.log 2024-09-14T11:24:23.460 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.109206.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.109206.log.gz 2024-09-14T11:24:23.461 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99193.log 2024-09-14T11:24:23.461 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.98604.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.98604.log.gz 2024-09-14T11:24:23.461 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76148.log 2024-09-14T11:24:23.461 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.99193.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.99193.log.gz 2024-09-14T11:24:23.461 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188565.log 2024-09-14T11:24:23.461 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.76148.log: 24.4% -- replaced with /var/log/ceph/ceph-client.admin.76148.log.gz 2024-09-14T11:24:23.461 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178849.log 2024-09-14T11:24:23.461 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.188565.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188565.log.gz 2024-09-14T11:24:23.461 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90947.log 2024-09-14T11:24:23.461 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.178849.log: 80.2% -- replaced with /var/log/ceph/ceph-client.0.178849.log.gz 2024-09-14T11:24:23.461 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122753.log 2024-09-14T11:24:23.461 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.90947.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.90947.log.gz 2024-09-14T11:24:23.461 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89769.log 2024-09-14T11:24:23.461 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.122753.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.122753.log.gz 2024-09-14T11:24:23.462 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40159.log 2024-09-14T11:24:23.462 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.89769.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.89769.log.gz 2024-09-14T11:24:23.462 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53095.log 2024-09-14T11:24:23.462 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.40159.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40159.log.gz 2024-09-14T11:24:23.462 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169875.log 2024-09-14T11:24:23.462 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.53095.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.53095.log.gz 2024-09-14T11:24:23.462 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54273.log 2024-09-14T11:24:23.462 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.169875.log: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.169875.log.gz 2024-09-14T11:24:23.462 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.189358.log 2024-09-14T11:24:23.462 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.54273.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.54273.log.gz 2024-09-14T11:24:23.462 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108617.log 2024-09-14T11:24:23.462 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.189358.log: 80.6% -- replaced with /var/log/ceph/ceph-client.0.189358.log.gz 2024-09-14T11:24:23.462 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79167.log 2024-09-14T11:24:23.462 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.108617.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.108617.log.gz 2024-09-14T11:24:23.463 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129233.log 2024-09-14T11:24:23.463 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.79167.log: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.79167.log.gz 2024-09-14T11:24:23.463 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121575.log 2024-09-14T11:24:23.463 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.129233.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.129233.log.gz 2024-09-14T11:24:23.463 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61437.log 2024-09-14T11:24:23.463 INFO:teuthology.orchestra.run.smithi097.stderr: 94.8% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-14T11:24:23.463 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.121575.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.121575.log.gz 2024-09-14T11:24:23.463 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149851.log 2024-09-14T11:24:23.463 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125699.log 2024-09-14T11:24:23.463 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.61437.log: /var/log/ceph/ceph-client.admin.149851.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.61437.log.gz 2024-09-14T11:24:23.463 INFO:teuthology.orchestra.run.smithi097.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.149851.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136302.log 2024-09-14T11:24:23.463 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-09-14T11:24:23.463 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.125699.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.125699.log.gz 2024-09-14T11:24:23.464 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191847.log 2024-09-14T11:24:23.464 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38682.log 2024-09-14T11:24:23.464 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.136302.log: /var/log/ceph/ceph-client.admin.191847.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191847.log.gz 2024-09-14T11:24:23.464 INFO:teuthology.orchestra.run.smithi097.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.136302.log.gz 2024-09-14T11:24:23.464 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39029.log 2024-09-14T11:24:23.464 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40474.log 2024-09-14T11:24:23.464 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.38682.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38682.log.gz 2024-09-14T11:24:23.464 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.39029.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39029.log.gz 2024-09-14T11:24:23.464 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173669.log 2024-09-14T11:24:23.464 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.40474.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40474.log.gz 2024-09-14T11:24:23.464 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191433.log 2024-09-14T11:24:23.464 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86824.log 2024-09-14T11:24:23.465 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.173669.log: /var/log/ceph/ceph-client.admin.191433.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191433.log.gz 2024-09-14T11:24:23.465 INFO:teuthology.orchestra.run.smithi097.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.173669.log.gz 2024-09-14T11:24:23.465 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47109.log 2024-09-14T11:24:23.465 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191571.log 2024-09-14T11:24:23.465 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.86824.log: /var/log/ceph/ceph-client.admin.47109.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.86824.log.gz 2024-09-14T11:24:23.465 INFO:teuthology.orchestra.run.smithi097.stderr: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.47109.log.gzgzip 2024-09-14T11:24:23.465 INFO:teuthology.orchestra.run.smithi097.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.165259.log 2024-09-14T11:24:23.465 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.191571.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191571.log.gz 2024-09-14T11:24:23.465 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110973.log 2024-09-14T11:24:23.465 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83879.log 2024-09-14T11:24:23.465 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.165259.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165259.log.gz 2024-09-14T11:24:23.465 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.110973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39759.log 2024-09-14T11:24:23.466 INFO:teuthology.orchestra.run.smithi097.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.110973.log.gz 2024-09-14T11:24:23.466 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.83879.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.83879.log.gz 2024-09-14T11:24:23.466 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172453.log 2024-09-14T11:24:23.466 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117452.log 2024-09-14T11:24:23.466 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.39759.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39759.log.gz 2024-09-14T11:24:23.466 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.172453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100960.log 2024-09-14T11:24:23.466 INFO:teuthology.orchestra.run.smithi097.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.172453.log.gz 2024-09-14T11:24:23.466 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.117452.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.117452.log.gz 2024-09-14T11:24:23.466 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163444.log 2024-09-14T11:24:23.466 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39034.log 2024-09-14T11:24:23.466 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.100960.log: /var/log/ceph/ceph-client.admin.163444.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163444.log.gz 2024-09-14T11:24:23.466 INFO:teuthology.orchestra.run.smithi097.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.100960.log.gz 2024-09-14T11:24:23.466 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-14T11:24:23.467 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148083.log 2024-09-14T11:24:23.467 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.39034.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39034.log.gz 2024-09-14T11:24:23.467 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64597.log 2024-09-14T11:24:23.467 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.148083.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.148083.log.gz 2024-09-14T11:24:23.467 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39994.log 2024-09-14T11:24:23.467 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.64597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135123.log 2024-09-14T11:24:23.467 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.39994.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39994.log.gz 2024-09-14T11:24:23.470 INFO:teuthology.orchestra.run.smithi097.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.64597.log.gz 2024-09-14T11:24:23.471 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60259.log 2024-09-14T11:24:23.471 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.135123.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.135123.log.gz 2024-09-14T11:24:23.472 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190879.log 2024-09-14T11:24:23.472 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.60259.log: 83.5% -- replaced with /var/log/ceph/ceph-client.admin.60259.log.gz 2024-09-14T11:24:23.473 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191018.log 2024-09-14T11:24:23.473 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.190879.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190879.log.gz 2024-09-14T11:24:23.473 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39023.log 2024-09-14T11:24:23.474 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.191018.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191018.log.gz 2024-09-14T11:24:23.474 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157508.log 2024-09-14T11:24:23.475 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.39023.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39023.log.gz 2024-09-14T11:24:23.475 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39399.log 2024-09-14T11:24:23.475 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.157508.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.157508.log.gz 2024-09-14T11:24:23.476 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137480.log 2024-09-14T11:24:23.476 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.39399.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39399.log.gz 2024-09-14T11:24:23.477 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78301.log 2024-09-14T11:24:23.477 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.137480.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.137480.log.gz 2024-09-14T11:24:23.478 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112740.log 2024-09-14T11:24:23.478 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.78301.log: 80.2% -- replaced with /var/log/ceph/ceph-client.0.78301.log.gz 2024-09-14T11:24:23.479 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116274.log 2024-09-14T11:24:23.479 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.112740.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.112740.log.gz 2024-09-14T11:24:23.480 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83290.log 2024-09-14T11:24:23.480 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.116274.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.116274.log.gz 2024-09-14T11:24:23.481 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139247.log 2024-09-14T11:24:23.481 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.83290.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.83290.log.gz 2024-09-14T11:24:23.482 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102727.log 2024-09-14T11:24:23.482 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.139247.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.139247.log.gz 2024-09-14T11:24:23.483 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90358.log 2024-09-14T11:24:23.483 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.102727.log: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.102727.log.gz 2024-09-14T11:24:23.484 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191617.log 2024-09-14T11:24:23.484 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.90358.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.90358.log.gz 2024-09-14T11:24:23.485 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82112.log 2024-09-14T11:24:23.485 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.191617.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191617.log.gz 2024-09-14T11:24:23.486 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130411.log 2024-09-14T11:24:23.486 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.82112.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.82112.log.gz 2024-09-14T11:24:23.487 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63050.log 2024-09-14T11:24:23.487 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.130411.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.130411.log.gz 2024-09-14T11:24:23.487 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.177629.log 2024-09-14T11:24:23.488 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.63050.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63050.log.gz 2024-09-14T11:24:23.488 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.190062.log 2024-09-14T11:24:23.489 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.177629.log: 80.2% -- replaced with /var/log/ceph/ceph-client.0.177629.log.gz 2024-09-14T11:24:23.489 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108028.log 2024-09-14T11:24:23.502 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.190062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190972.log 2024-09-14T11:24:23.503 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.108028.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.108028.log.gz 2024-09-14T11:24:23.516 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95070.log 2024-09-14T11:24:23.517 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.190972.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190972.log.gz 2024-09-14T11:24:23.520 INFO:teuthology.orchestra.run.smithi097.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.0.190062.log.gz 2024-09-14T11:24:23.521 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129822.log 2024-09-14T11:24:23.521 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.95070.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.95070.log.gz 2024-09-14T11:24:23.521 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68313.log 2024-09-14T11:24:23.522 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.129822.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.129822.log.gz 2024-09-14T11:24:23.523 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153385.log 2024-09-14T11:24:23.525 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.68313.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.68313.log.gz 2024-09-14T11:24:23.525 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87413.log 2024-09-14T11:24:23.525 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.153385.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.153385.log.gz 2024-09-14T11:24:23.526 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89180.log 2024-09-14T11:24:23.527 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.87413.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.87413.log.gz 2024-09-14T11:24:23.527 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98015.log 2024-09-14T11:24:23.528 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.89180.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.89180.log.gz 2024-09-14T11:24:23.528 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93303.log 2024-09-14T11:24:23.529 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.98015.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.98015.log.gz 2024-09-14T11:24:23.529 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148673.log 2024-09-14T11:24:23.530 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.93303.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.93303.log.gz 2024-09-14T11:24:23.530 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191387.log 2024-09-14T11:24:23.530 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.148673.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.148673.log.gz 2024-09-14T11:24:23.531 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155152.log 2024-09-14T11:24:23.531 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.191387.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191387.log.gz 2024-09-14T11:24:23.532 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170483.log 2024-09-14T11:24:23.532 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.155152.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.155152.log.gz 2024-09-14T11:24:23.533 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107439.log 2024-09-14T11:24:23.533 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.170483.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.170483.log.gz 2024-09-14T11:24:23.534 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.181285.log 2024-09-14T11:24:23.536 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.107439.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.107439.log.gz 2024-09-14T11:24:23.536 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106850.log 2024-09-14T11:24:23.537 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.181285.log: 80.3% -- replaced with /var/log/ceph/ceph-client.0.181285.log.gz 2024-09-14T11:24:23.537 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-14T11:24:23.538 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.106850.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.106850.log.gz 2024-09-14T11:24:23.538 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173061.log 2024-09-14T11:24:23.547 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.182503.log 2024-09-14T11:24:23.548 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.173061.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.173061.log.gz 2024-09-14T11:24:23.561 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190926.log 2024-09-14T11:24:23.562 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.182503.log: 83.8% -- replaced with /var/log/ceph/ceph-client.0.182503.log.gz 2024-09-14T11:24:23.562 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76926.log 2024-09-14T11:24:23.563 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.190926.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190926.log.gz 2024-09-14T11:24:23.580 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174277.log 2024-09-14T11:24:23.580 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.76926.log: 84.2% -- replaced with /var/log/ceph/ceph-client.0.76926.log.gz 2024-09-14T11:24:23.593 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115685.log 2024-09-14T11:24:23.593 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.174277.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.174277.log.gz 2024-09-14T11:24:23.602 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120986.log 2024-09-14T11:24:23.602 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.115685.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.115685.log.gz 2024-09-14T11:24:23.619 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191295.log 2024-09-14T11:24:23.619 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.120986.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.120986.log.gz 2024-09-14T11:24:23.628 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33207.log 2024-09-14T11:24:23.628 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.191295.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191295.log.gz 2024-09-14T11:24:23.637 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62969.log 2024-09-14T11:24:23.637 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.33207.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33207.log.gz 2024-09-14T11:24:23.653 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161064.log 2024-09-14T11:24:23.653 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.62969.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.62969.log.gz 2024-09-14T11:24:23.662 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136891.log 2024-09-14T11:24:23.675 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.161064.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.161064.log.gz 2024-09-14T11:24:23.678 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96837.log 2024-09-14T11:24:23.679 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.136891.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.136891.log.gz 2024-09-14T11:24:23.687 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151029.log 2024-09-14T11:24:23.690 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.96837.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.96837.log.gz 2024-09-14T11:24:23.700 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163420.log 2024-09-14T11:24:23.701 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.151029.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.151029.log.gz 2024-09-14T11:24:23.711 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58444.log 2024-09-14T11:24:23.712 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.163420.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163420.log.gz 2024-09-14T11:24:23.722 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40089.log 2024-09-14T11:24:23.723 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.58444.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.58444.log.gz 2024-09-14T11:24:23.733 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57218.log 2024-09-14T11:24:23.733 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.40089.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40089.log.gz 2024-09-14T11:24:23.753 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48876.log 2024-09-14T11:24:23.753 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.57218.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.57218.log.gz 2024-09-14T11:24:23.761 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145727.log 2024-09-14T11:24:23.771 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.48876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168339.log 2024-09-14T11:24:23.774 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.145727.log: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.48876.log.gz 2024-09-14T11:24:23.780 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143959.log 2024-09-14T11:24:23.783 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.168339.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.145727.log.gz 2024-09-14T11:24:23.788 INFO:teuthology.orchestra.run.smithi097.stderr: 87.4% 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-14T11:24:23.788 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.168339.log.gz 2024-09-14T11:24:23.788 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163468.log 2024-09-14T11:24:23.789 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.143959.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.143959.log.gz 2024-09-14T11:24:23.789 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39024.log 2024-09-14T11:24:23.790 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.163468.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.163468.log.gz 2024-09-14T11:24:23.790 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190741.log 2024-09-14T11:24:23.791 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.39024.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39024.log.gz 2024-09-14T11:24:23.791 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.190741.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190741.log.gz 2024-09-14T11:24:24.119 INFO:teuthology.orchestra.run.smithi152.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-14T11:24:24.345 INFO:teuthology.orchestra.run.smithi097.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-14T11:24:25.447 INFO:teuthology.orchestra.run.smithi097.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-14T11:24:27.601 INFO:teuthology.orchestra.run.smithi097.stderr: 93.2% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-14T11:24:31.185 INFO:teuthology.orchestra.run.smithi152.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-14T11:24:31.386 INFO:teuthology.orchestra.run.smithi097.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-14T11:24:32.177 INFO:teuthology.orchestra.run.smithi152.stderr: 94.7% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-14T11:24:32.402 INFO:teuthology.orchestra.run.smithi097.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-14T11:24:34.581 INFO:teuthology.orchestra.run.smithi097.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-14T11:24:35.717 INFO:teuthology.orchestra.run.smithi152.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-14T11:24:41.551 INFO:teuthology.orchestra.run.smithi097.stderr: 95.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-14T11:24:41.553 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-09-14T11:24:41.553 INFO:teuthology.orchestra.run.smithi097.stderr:real 0m18.268s 2024-09-14T11:24:41.553 INFO:teuthology.orchestra.run.smithi097.stderr:user 0m52.374s 2024-09-14T11:24:41.553 INFO:teuthology.orchestra.run.smithi097.stderr:sys 0m2.106s 2024-09-14T11:24:42.190 INFO:teuthology.orchestra.run.smithi152.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-14T11:24:42.192 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-09-14T11:24:42.192 INFO:teuthology.orchestra.run.smithi152.stderr:real 0m18.863s 2024-09-14T11:24:42.192 INFO:teuthology.orchestra.run.smithi152.stderr:user 0m46.950s 2024-09-14T11:24:42.192 INFO:teuthology.orchestra.run.smithi152.stderr:sys 0m1.710s 2024-09-14T11:24:42.193 INFO:tasks.ceph:Archiving logs... 2024-09-14T11:24:42.193 DEBUG:teuthology.misc:Transferring archived files from smithi097:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904126/remote/smithi097/log 2024-09-14T11:24:42.194 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-14T11:24:49.200 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904126/remote/smithi152/log 2024-09-14T11:24:49.201 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-14T11:24:55.769 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-14T11:24:55.778 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-14T11:24:55.778 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-14T11:24:55.781 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-14T11:24:55.890 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-14T11:24:55.902 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-14T11:24:55.902 DEBUG:teuthology.orchestra.run.smithi097:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T11:24:55.905 DEBUG:teuthology.orchestra.run.smithi152:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T11:24:55.933 INFO:teuthology.orchestra.run.smithi097.stderr:bash: line 1: ntpq: command not found 2024-09-14T11:24:55.935 INFO:teuthology.orchestra.run.smithi152.stderr:bash: line 1: ntpq: command not found 2024-09-14T11:24:55.938 INFO:teuthology.orchestra.run.smithi097.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T11:24:55.938 INFO:teuthology.orchestra.run.smithi097.stdout:=============================================================================== 2024-09-14T11:24:55.938 INFO:teuthology.orchestra.run.smithi097.stdout:^* hv01.front.sepia.ceph.com 3 6 377 30 +2688us[+2702us] +/- 42ms 2024-09-14T11:24:55.938 INFO:teuthology.orchestra.run.smithi097.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 27 +1943us[+1943us] +/- 62ms 2024-09-14T11:24:55.938 INFO:teuthology.orchestra.run.smithi097.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 32 -9841us[-9827us] +/- 90ms 2024-09-14T11:24:55.938 INFO:teuthology.orchestra.run.smithi097.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T11:24:55.939 INFO:teuthology.orchestra.run.smithi152.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T11:24:55.939 INFO:teuthology.orchestra.run.smithi152.stdout:=============================================================================== 2024-09-14T11:24:55.939 INFO:teuthology.orchestra.run.smithi152.stdout:^* hv01.front.sepia.ceph.com 3 7 377 30 +2709us[+2697us] +/- 42ms 2024-09-14T11:24:55.939 INFO:teuthology.orchestra.run.smithi152.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 100 +1935us[+1626us] +/- 61ms 2024-09-14T11:24:55.939 INFO:teuthology.orchestra.run.smithi152.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 28 -9809us[-9809us] +/- 90ms 2024-09-14T11:24:55.939 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T11:24:55.940 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-14T11:24:55.950 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-14T11:24:55.951 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-14T11:24:55.959 DEBUG:teuthology.orchestra.run.smithi097:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-14T11:24:56.061 DEBUG:teuthology.orchestra.run.smithi152:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-14T11:24:56.139 DEBUG:teuthology.orchestra.run.smithi097:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T11:24:56.181 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:24:56.181 DEBUG:teuthology.orchestra.run.smithi152:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T11:24:56.221 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:24:56.222 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-14T11:24:56.232 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-14T11:24:56.246 INFO:teuthology.task.internal:Duration was 2849.072136 seconds 2024-09-14T11:24:56.246 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-14T11:24:56.256 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-14T11:24:56.256 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-14T11:24:56.259 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-14T11:24:56.310 INFO:teuthology.orchestra.run.smithi097.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T11:24:56.315 INFO:teuthology.orchestra.run.smithi152.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T11:24:56.671 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-14T11:24:56.671 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi097.front.sepia.ceph.com 2024-09-14T11:24:56.671 DEBUG:teuthology.orchestra.run.smithi097:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-14T11:24:56.704 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi152.front.sepia.ceph.com 2024-09-14T11:24:56.705 DEBUG:teuthology.orchestra.run.smithi152:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-14T11:24:56.743 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-14T11:24:56.743 DEBUG:teuthology.orchestra.run.smithi097:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-14T11:24:56.747 DEBUG:teuthology.orchestra.run.smithi152:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-14T11:24:56.824 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-14T11:24:56.824 DEBUG:teuthology.orchestra.run.smithi097:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-14T11:24:56.827 DEBUG:teuthology.orchestra.run.smithi152:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-14T11:24:56.977 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-14T11:24:56.988 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-14T11:24:56.988 DEBUG:teuthology.orchestra.run.smithi097:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-14T11:24:57.026 DEBUG:teuthology.orchestra.run.smithi152:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-14T11:24:57.065 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-14T11:24:57.077 DEBUG:teuthology.orchestra.run.smithi097:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-14T11:24:57.080 DEBUG:teuthology.orchestra.run.smithi152:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-14T11:24:57.113 INFO:teuthology.orchestra.run.smithi097.stdout:kernel.core_pattern = core 2024-09-14T11:24:57.142 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern = core 2024-09-14T11:24:57.160 DEBUG:teuthology.orchestra.run.smithi097:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-14T11:24:57.195 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:24:57.195 DEBUG:teuthology.orchestra.run.smithi152:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-14T11:24:57.227 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:24:57.228 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-14T11:24:57.239 INFO:teuthology.task.internal:Transferring archived files... 2024-09-14T11:24:57.240 DEBUG:teuthology.misc:Transferring archived files from smithi097:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904126/remote/smithi097 2024-09-14T11:24:57.240 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-14T11:24:57.288 DEBUG:teuthology.misc:Transferring archived files from smithi152:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904126/remote/smithi152 2024-09-14T11:24:57.288 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-14T11:24:57.334 INFO:teuthology.task.internal:Removing archive directory... 2024-09-14T11:24:57.334 DEBUG:teuthology.orchestra.run.smithi097:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-14T11:24:57.337 DEBUG:teuthology.orchestra.run.smithi152:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-14T11:24:57.397 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-14T11:24:57.410 INFO:teuthology.task.internal:Not uploading archives. 2024-09-14T11:24:57.410 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-14T11:24:57.421 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-14T11:24:57.421 DEBUG:teuthology.orchestra.run.smithi097:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-14T11:24:57.424 DEBUG:teuthology.orchestra.run.smithi152:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-14T11:24:57.450 INFO:teuthology.orchestra.run.smithi097.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 14 11:24 /home/ubuntu/cephtest 2024-09-14T11:24:57.467 INFO:teuthology.orchestra.run.smithi152.stdout: 265836 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 14 11:24 /home/ubuntu/cephtest 2024-09-14T11:24:57.468 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-14T11:24:57.479 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-14T11:24:57.505 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install accounts$/{main} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} duration: 2849.07213640213 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-14T11:24:57.505 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-14T11:24:57.584 INFO:teuthology.run:pass